2024-08-31T01:50:00.022 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-08-31T01:50:00.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T01:50:00.114 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-30_21:08:02-orch-squid-distro-default-smithi/7882518 branch: squid description: orch/cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/connectivity task/test_rgw_multisite} email: ceph-qa@ceph.com first_in_suite: false job_id: '7882518' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-08-30_21:08:02-orch-squid-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: false mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - MON_DOWN - mons down - mon down - out of quorum log-only-match: - CEPHADM_ sha1: 34b9d27bc925f169ace27b9f1f204536aa49fc0b ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 34b9d27bc925f169ace27b9f1f204536aa49fc0b workunit: branch: squid sha1: 244a32d3583bb0aa259286ff61157888a54a3ca5 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - mon.a - mgr.a - osd.0 - - host.b - mon.b - mgr.b - osd.1 - - host.c - mon.c - osd.2 seed: 6007 sha1: 34b9d27bc925f169ace27b9f1f204536aa49fc0b sleep_before_teardown: 0 subset: 49/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_244a32d3583bb0aa259286ff61157888a54a3ca5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 244a32d3583bb0aa259286ff61157888a54a3ca5 targets: smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL8JLmc6htn2QiceRMOvbA6awAVnx1WMWnqHDhG2ohFTd2pNF0ZrOCV9GyocsQ+5b6yUIBFC2aIq2eBkIF2o4FE= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZnFooN6u4SBphVfVX9e7yatHlFb3AqeOHSHtPipuXmmg5Hst+Nzug4WWNB7FVa4FnMHStD19XA6kqxaa6ZTIk= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHiEyxSF2JcIhMutgDlMx61UwElZPP9k1LUg9yYMPJcCxbvsgm3lhztUGakE0Nt0y+COUlSsDmxx0OvsznVf8w4= tasks: - install: null - cephadm: null - cephadm.shell: host.a: - ceph mgr module enable rgw - rgw_module.apply: specs: - rgw_realm: myrealm1 rgw_zone: myzone1 rgw_zonegroup: myzonegroup1 spec: rgw_frontend_port: 5500 - cephadm.shell: host.a: - 'set -e set -x while true; do TOKEN=$(ceph rgw realm tokens | jq -r ''.[0].token''); echo $TOKEN; if [ "$TOKEN" != "master zone has no endpoint" ]; then break; fi; sleep 5; done TOKENS=$(ceph rgw realm tokens) echo $TOKENS | jq --exit-status ''.[0].realm == "myrealm1"'' echo $TOKENS | jq --exit-status ''.[0].token'' TOKEN_JSON=$(ceph rgw realm tokens | jq -r ''.[0].token'' | base64 --decode) echo $TOKEN_JSON | jq --exit-status ''.realm_name == "myrealm1"'' echo $TOKEN_JSON | jq --exit-status ''.endpoint | test("http://.+:\\d+")'' echo $TOKEN_JSON | jq --exit-status ''.realm_id | test("^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$")'' echo $TOKEN_JSON | jq --exit-status ''.access_key'' echo $TOKEN_JSON | jq --exit-status ''.secret'' ' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-08-30_21:08:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-31T01:50:00.115 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_244a32d3583bb0aa259286ff61157888a54a3ca5/qa; will attempt to use it 2024-08-31T01:50:00.115 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_244a32d3583bb0aa259286ff61157888a54a3ca5/qa/tasks 2024-08-31T01:50:00.115 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-31T01:50:00.117 INFO:teuthology.task.internal:Checking packages... 2024-08-31T01:50:00.138 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '34b9d27bc925f169ace27b9f1f204536aa49fc0b' 2024-08-31T01:50:00.138 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T01:50:00.138 INFO:teuthology.packaging:ref: None 2024-08-31T01:50:00.138 INFO:teuthology.packaging:tag: None 2024-08-31T01:50:00.138 INFO:teuthology.packaging:branch: squid 2024-08-31T01:50:00.139 INFO:teuthology.packaging:sha1: 34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T01:50:00.139 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-08-31T01:50:00.334 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-242-g244a32d3-1jammy 2024-08-31T01:50:00.336 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-31T01:50:00.343 INFO:teuthology.task.internal:no buildpackages task found 2024-08-31T01:50:00.343 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-31T01:50:00.349 INFO:teuthology.task.internal:Saving configuration 2024-08-31T01:50:00.360 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-31T01:50:00.367 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-31T01:50:00.392 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-30_21:08:02-orch-squid-distro-default-smithi/7882518', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 01:43:14.592993', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILMa8HopFTiopNc4f2kOxC34VU7P+0Z0liVXR0jw3GTp'} 2024-08-31T01:50:00.414 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-30_21:08:02-orch-squid-distro-default-smithi/7882518', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 01:43:14.595047', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAEkL379dsQz9T4CHuOLO+9a0Zb5a5o+3d1tXSfzqYdi'} 2024-08-31T01:50:00.437 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-30_21:08:02-orch-squid-distro-default-smithi/7882518', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 01:43:14.596353', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFumZVt3J5irQvvaku/9ppntgD3/5zusF8XZ39WBPKma'} 2024-08-31T01:50:00.438 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-31T01:50:00.444 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.a', 'osd.0'] 2024-08-31T01:50:00.444 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['host.b', 'mon.b', 'mgr.b', 'osd.1'] 2024-08-31T01:50:00.444 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['host.c', 'mon.c', 'osd.2'] 2024-08-31T01:50:00.444 INFO:teuthology.run_tasks:Running task console_log... 2024-08-31T01:50:00.539 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f00e5fe0280>, signals=[15]) 2024-08-31T01:50:00.539 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-31T01:50:00.545 INFO:teuthology.task.internal:Opening connections... 2024-08-31T01:50:00.545 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2024-08-31T01:50:00.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:50:00.633 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2024-08-31T01:50:00.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:50:00.710 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-08-31T01:50:00.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:50:00.790 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-31T01:50:00.797 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-08-31T01:50:00.802 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-08-31T01:50:00.803 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-08-31T01:50:00.848 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-31T01:50:00.848 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Ubuntu" 2024-08-31T01:50:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="22.04" 2024-08-31T01:50:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-31T01:50:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_CODENAME=jammy 2024-08-31T01:50:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:ID=ubuntu 2024-08-31T01:50:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE=debian 2024-08-31T01:50:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-31T01:50:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-31T01:50:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-31T01:50:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-31T01:50:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:UBUNTU_CODENAME=jammy 2024-08-31T01:50:00.850 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-08-31T01:50:00.874 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-08-31T01:50:00.879 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-08-31T01:50:00.879 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="22.04" 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=jammy 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-31T01:50:00.930 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=jammy 2024-08-31T01:50:00.931 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-08-31T01:50:00.983 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-08-31T01:50:00.989 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-08-31T01:50:00.989 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-08-31T01:50:01.037 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-08-31T01:50:01.037 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu" 2024-08-31T01:50:01.037 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="22.04" 2024-08-31T01:50:01.037 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-08-31T01:50:01.037 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=jammy 2024-08-31T01:50:01.038 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu 2024-08-31T01:50:01.038 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian 2024-08-31T01:50:01.038 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/" 2024-08-31T01:50:01.038 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-08-31T01:50:01.038 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-08-31T01:50:01.038 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-08-31T01:50:01.038 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=jammy 2024-08-31T01:50:01.038 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-08-31T01:50:01.066 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-31T01:50:01.076 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-31T01:50:01.121 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-31T01:50:01.121 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2024-08-31T01:50:01.123 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2024-08-31T01:50:01.130 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-08-31T01:50:01.135 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-31T01:50:01.141 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-31T01:50:01.141 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2024-08-31T01:50:01.173 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2024-08-31T01:50:01.177 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-08-31T01:50:01.248 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-31T01:50:01.323 INFO:teuthology.run_tasks:Running task kernel... 2024-08-31T01:50:01.341 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-31T01:50:01.341 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}, 'host.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-31T01:50:01.341 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T01:50:01.342 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T01:50:01.342 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T01:50:01.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T01:50:01.347 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-08-31T01:50:01.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T01:50:01.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T01:50:01.349 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-08-31T01:50:01.349 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-08-31T01:50:01.398 INFO:teuthology.orchestra.run.smithi163.stdout:5.15.0-56-generic 2024-08-31T01:50:01.399 INFO:teuthology.task.kernel:Running kernel on smithi163: 5.15.0-56-generic 2024-08-31T01:50:01.399 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get clean 2024-08-31T01:50:01.401 INFO:teuthology.orchestra.run.smithi191.stdout:5.15.0-56-generic 2024-08-31T01:50:01.401 INFO:teuthology.orchestra.run.smithi027.stdout:5.15.0-56-generic 2024-08-31T01:50:01.401 INFO:teuthology.task.kernel:Running kernel on smithi191: 5.15.0-56-generic 2024-08-31T01:50:01.401 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get clean 2024-08-31T01:50:01.402 INFO:teuthology.task.kernel:Running kernel on smithi027: 5.15.0-56-generic 2024-08-31T01:50:01.402 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get clean 2024-08-31T01:50:01.514 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2024-08-31T01:50:01.520 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2024-08-31T01:50:01.526 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get update 2024-08-31T01:50:01.644 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-31T01:50:01.668 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-31T01:50:01.729 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T01:50:01.759 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-31T01:50:01.766 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-08-31T01:50:01.823 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-08-31T01:50:01.844 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T01:50:01.845 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T01:50:01.871 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [531 kB] 2024-08-31T01:50:01.881 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,769 kB] 2024-08-31T01:50:01.926 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-31T01:50:01.931 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-08-31T01:50:01.949 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,769 kB] 2024-08-31T01:50:01.966 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-08-31T01:50:01.983 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [531 kB] 2024-08-31T01:50:01.988 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [290 kB] 2024-08-31T01:50:01.989 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [290 kB] 2024-08-31T01:50:01.991 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.2 kB] 2024-08-31T01:50:01.991 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,308 kB] 2024-08-31T01:50:01.994 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.2 kB] 2024-08-31T01:50:01.995 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.3 kB] 2024-08-31T01:50:01.996 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,308 kB] 2024-08-31T01:50:02.011 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.3 kB] 2024-08-31T01:50:02.012 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [398 kB] 2024-08-31T01:50:02.015 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [572 B] 2024-08-31T01:50:02.016 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [890 kB] 2024-08-31T01:50:02.024 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [622 kB] 2024-08-31T01:50:02.028 INFO:teuthology.orchestra.run.smithi191.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [398 kB] 2024-08-31T01:50:02.029 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [175 kB] 2024-08-31T01:50:02.031 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.0 kB] 2024-08-31T01:50:02.031 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-08-31T01:50:02.031 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-08-31T01:50:02.032 INFO:teuthology.orchestra.run.smithi191.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [572 B] 2024-08-31T01:50:02.032 INFO:teuthology.orchestra.run.smithi191.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [622 kB] 2024-08-31T01:50:02.038 INFO:teuthology.orchestra.run.smithi191.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [890 kB] 2024-08-31T01:50:02.043 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-08-31T01:50:02.043 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-08-31T01:50:02.046 INFO:teuthology.orchestra.run.smithi191.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [175 kB] 2024-08-31T01:50:02.047 INFO:teuthology.orchestra.run.smithi191.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.0 kB] 2024-08-31T01:50:02.047 INFO:teuthology.orchestra.run.smithi191.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-08-31T01:50:02.074 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-08-31T01:50:02.074 INFO:teuthology.orchestra.run.smithi191.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-08-31T01:50:02.074 INFO:teuthology.orchestra.run.smithi191.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-08-31T01:50:02.074 INFO:teuthology.orchestra.run.smithi191.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-08-31T01:50:02.079 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-08-31T01:50:02.082 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-08-31T01:50:02.082 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,384 kB] 2024-08-31T01:50:02.099 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.9 kB] 2024-08-31T01:50:02.099 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-08-31T01:50:02.103 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2024-08-31T01:50:02.103 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,112 kB] 2024-08-31T01:50:02.132 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [726 kB] 2024-08-31T01:50:02.137 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [260 kB] 2024-08-31T01:50:02.138 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.0 kB] 2024-08-31T01:50:02.139 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-08-31T01:50:02.140 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-08-31T01:50:02.140 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-08-31T01:50:02.140 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-08-31T01:50:02.140 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-08-31T01:50:02.145 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-08-31T01:50:02.150 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-08-31T01:50:02.167 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-08-31T01:50:02.167 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-08-31T01:50:02.168 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-08-31T01:50:02.168 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-08-31T01:50:02.168 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-08-31T01:50:02.227 INFO:teuthology.orchestra.run.smithi163.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,769 kB] 2024-08-31T01:50:02.280 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-08-31T01:50:02.282 INFO:teuthology.orchestra.run.smithi191.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-08-31T01:50:02.418 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-08-31T01:50:02.421 INFO:teuthology.orchestra.run.smithi191.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-08-31T01:50:02.615 INFO:teuthology.orchestra.run.smithi191.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-08-31T01:50:02.646 INFO:teuthology.orchestra.run.smithi163.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [531 kB] 2024-08-31T01:50:02.663 INFO:teuthology.orchestra.run.smithi163.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [290 kB] 2024-08-31T01:50:02.671 INFO:teuthology.orchestra.run.smithi163.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.2 kB] 2024-08-31T01:50:02.672 INFO:teuthology.orchestra.run.smithi163.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.3 kB] 2024-08-31T01:50:02.673 INFO:teuthology.orchestra.run.smithi163.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,308 kB] 2024-08-31T01:50:02.733 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-08-31T01:50:02.768 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-08-31T01:50:02.769 INFO:teuthology.orchestra.run.smithi163.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [398 kB] 2024-08-31T01:50:02.772 INFO:teuthology.orchestra.run.smithi191.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-08-31T01:50:02.780 INFO:teuthology.orchestra.run.smithi163.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [572 B] 2024-08-31T01:50:02.780 INFO:teuthology.orchestra.run.smithi163.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [622 kB] 2024-08-31T01:50:02.783 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-08-31T01:50:02.783 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,384 kB] 2024-08-31T01:50:02.786 INFO:teuthology.orchestra.run.smithi191.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-08-31T01:50:02.787 INFO:teuthology.orchestra.run.smithi191.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,384 kB] 2024-08-31T01:50:02.796 INFO:teuthology.orchestra.run.smithi163.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [890 kB] 2024-08-31T01:50:02.822 INFO:teuthology.orchestra.run.smithi163.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [175 kB] 2024-08-31T01:50:02.828 INFO:teuthology.orchestra.run.smithi163.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.0 kB] 2024-08-31T01:50:02.829 INFO:teuthology.orchestra.run.smithi163.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-08-31T01:50:02.829 INFO:teuthology.orchestra.run.smithi163.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-08-31T01:50:02.830 INFO:teuthology.orchestra.run.smithi163.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-08-31T01:50:02.850 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.9 kB] 2024-08-31T01:50:02.852 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-08-31T01:50:02.854 INFO:teuthology.orchestra.run.smithi191.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.9 kB] 2024-08-31T01:50:02.855 INFO:teuthology.orchestra.run.smithi191.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-08-31T01:50:02.868 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2024-08-31T01:50:02.868 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [726 kB] 2024-08-31T01:50:02.872 INFO:teuthology.orchestra.run.smithi191.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2024-08-31T01:50:02.873 INFO:teuthology.orchestra.run.smithi191.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [726 kB] 2024-08-31T01:50:02.889 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,112 kB] 2024-08-31T01:50:02.895 INFO:teuthology.orchestra.run.smithi191.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,112 kB] 2024-08-31T01:50:02.910 INFO:teuthology.orchestra.run.smithi163.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-08-31T01:50:02.920 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [260 kB] 2024-08-31T01:50:02.923 INFO:teuthology.orchestra.run.smithi191.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [260 kB] 2024-08-31T01:50:02.925 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.0 kB] 2024-08-31T01:50:02.926 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-08-31T01:50:02.926 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-08-31T01:50:02.929 INFO:teuthology.orchestra.run.smithi191.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.0 kB] 2024-08-31T01:50:02.938 INFO:teuthology.orchestra.run.smithi191.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-08-31T01:50:02.939 INFO:teuthology.orchestra.run.smithi191.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-08-31T01:50:02.939 INFO:teuthology.orchestra.run.smithi191.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-08-31T01:50:02.940 INFO:teuthology.orchestra.run.smithi191.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-08-31T01:50:02.978 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-08-31T01:50:02.978 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-08-31T01:50:02.978 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-08-31T01:50:02.980 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-08-31T01:50:02.981 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-08-31T01:50:03.011 INFO:teuthology.orchestra.run.smithi191.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-08-31T01:50:03.013 INFO:teuthology.orchestra.run.smithi191.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-08-31T01:50:03.014 INFO:teuthology.orchestra.run.smithi191.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-08-31T01:50:03.015 INFO:teuthology.orchestra.run.smithi191.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-08-31T01:50:03.015 INFO:teuthology.orchestra.run.smithi191.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-08-31T01:50:03.019 INFO:teuthology.orchestra.run.smithi191.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-08-31T01:50:03.059 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-08-31T01:50:03.059 INFO:teuthology.orchestra.run.smithi027.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-08-31T01:50:03.060 INFO:teuthology.orchestra.run.smithi027.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-08-31T01:50:03.061 INFO:teuthology.orchestra.run.smithi027.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-08-31T01:50:03.062 INFO:teuthology.orchestra.run.smithi027.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-08-31T01:50:03.100 INFO:teuthology.orchestra.run.smithi191.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-08-31T01:50:03.101 INFO:teuthology.orchestra.run.smithi191.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-08-31T01:50:08.111 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 15.7 MB in 2s (7,201 kB/s) 2024-08-31T01:50:08.239 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 15.7 MB in 2s (7,590 kB/s) 2024-08-31T01:50:08.633 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 15.7 MB in 2s (7,142 kB/s) 2024-08-31T01:50:09.520 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-08-31T01:50:09.537 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-31T01:50:09.590 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-08-31T01:50:09.716 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-08-31T01:50:09.734 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-31T01:50:09.776 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2024-08-31T01:50:09.776 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2024-08-31T01:50:09.795 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-08-31T01:50:09.942 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T01:50:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T01:50:09.942 INFO:teuthology.orchestra.run.smithi163.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T01:50:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T01:50:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-31T01:50:09.943 INFO:teuthology.orchestra.run.smithi163.stdout: python2.7-minimal 2024-08-31T01:50:09.943 INFO:teuthology.orchestra.run.smithi163.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T01:50:09.944 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2024-08-31T01:50:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-08-31T01:50:09.944 INFO:teuthology.orchestra.run.smithi163.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-08-31T01:50:09.945 INFO:teuthology.orchestra.run.smithi163.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-08-31T01:50:09.946 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2024-08-31T01:50:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-08-31T01:50:09.946 INFO:teuthology.orchestra.run.smithi163.stdout:Recommended packages: 2024-08-31T01:50:09.946 INFO:teuthology.orchestra.run.smithi163.stdout: thermald 2024-08-31T01:50:09.981 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-08-31T01:50:09.982 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-08-31T01:50:09.998 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2024-08-31T01:50:09.998 INFO:teuthology.orchestra.run.smithi163.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-08-31T01:50:09.998 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-08-31T01:50:09.999 INFO:teuthology.orchestra.run.smithi163.stdout: linux-modules-extra-5.15.0-119-generic 2024-08-31T01:50:10.000 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages will be upgraded: 2024-08-31T01:50:10.001 INFO:teuthology.orchestra.run.smithi163.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-31T01:50:10.014 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-08-31T01:50:10.032 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-31T01:50:10.097 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-08-31T01:50:10.147 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T01:50:10.147 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T01:50:10.147 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T01:50:10.147 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T01:50:10.148 INFO:teuthology.orchestra.run.smithi191.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-31T01:50:10.148 INFO:teuthology.orchestra.run.smithi191.stdout: python2.7-minimal 2024-08-31T01:50:10.148 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T01:50:10.149 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2024-08-31T01:50:10.149 INFO:teuthology.orchestra.run.smithi191.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-08-31T01:50:10.149 INFO:teuthology.orchestra.run.smithi191.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-08-31T01:50:10.149 INFO:teuthology.orchestra.run.smithi191.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-08-31T01:50:10.150 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2024-08-31T01:50:10.150 INFO:teuthology.orchestra.run.smithi191.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-08-31T01:50:10.150 INFO:teuthology.orchestra.run.smithi191.stdout:Recommended packages: 2024-08-31T01:50:10.150 INFO:teuthology.orchestra.run.smithi191.stdout: thermald 2024-08-31T01:50:10.179 INFO:teuthology.orchestra.run.smithi163.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-08-31T01:50:10.179 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 113 MB of archives. 2024-08-31T01:50:10.179 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 583 MB of additional disk space will be used. 2024-08-31T01:50:10.180 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-08-31T01:50:10.187 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2024-08-31T01:50:10.187 INFO:teuthology.orchestra.run.smithi191.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-08-31T01:50:10.187 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-08-31T01:50:10.187 INFO:teuthology.orchestra.run.smithi191.stdout: linux-modules-extra-5.15.0-119-generic 2024-08-31T01:50:10.188 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages will be upgraded: 2024-08-31T01:50:10.189 INFO:teuthology.orchestra.run.smithi191.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-31T01:50:10.305 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-08-31T01:50:10.305 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-08-31T01:50:10.367 INFO:teuthology.orchestra.run.smithi191.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-08-31T01:50:10.367 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 113 MB of archives. 2024-08-31T01:50:10.367 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 583 MB of additional disk space will be used. 2024-08-31T01:50:10.367 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-08-31T01:50:10.500 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T01:50:10.501 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T01:50:10.501 INFO:teuthology.orchestra.run.smithi027.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T01:50:10.501 INFO:teuthology.orchestra.run.smithi027.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T01:50:10.501 INFO:teuthology.orchestra.run.smithi027.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-08-31T01:50:10.501 INFO:teuthology.orchestra.run.smithi027.stdout: python2.7-minimal 2024-08-31T01:50:10.501 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T01:50:10.503 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2024-08-31T01:50:10.503 INFO:teuthology.orchestra.run.smithi027.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-08-31T01:50:10.503 INFO:teuthology.orchestra.run.smithi027.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-08-31T01:50:10.503 INFO:teuthology.orchestra.run.smithi027.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-08-31T01:50:10.505 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2024-08-31T01:50:10.505 INFO:teuthology.orchestra.run.smithi027.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-08-31T01:50:10.505 INFO:teuthology.orchestra.run.smithi027.stdout:Recommended packages: 2024-08-31T01:50:10.505 INFO:teuthology.orchestra.run.smithi027.stdout: thermald 2024-08-31T01:50:10.560 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2024-08-31T01:50:10.560 INFO:teuthology.orchestra.run.smithi027.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-08-31T01:50:10.560 INFO:teuthology.orchestra.run.smithi027.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-08-31T01:50:10.560 INFO:teuthology.orchestra.run.smithi027.stdout: linux-modules-extra-5.15.0-119-generic 2024-08-31T01:50:10.562 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages will be upgraded: 2024-08-31T01:50:10.562 INFO:teuthology.orchestra.run.smithi027.stdout: linux-generic linux-headers-generic linux-image-generic 2024-08-31T01:50:10.743 INFO:teuthology.orchestra.run.smithi027.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-08-31T01:50:10.744 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 113 MB of archives. 2024-08-31T01:50:10.744 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 583 MB of additional disk space will be used. 2024-08-31T01:50:10.744 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-08-31T01:50:11.577 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-08-31T01:50:11.782 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-08-31T01:50:11.927 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-08-31T01:50:12.158 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-08-31T01:50:12.197 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-08-31T01:50:12.516 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-08-31T01:50:14.122 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-08-31T01:50:14.123 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-08-31T01:50:14.123 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-08-31T01:50:14.374 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-08-31T01:50:14.375 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-08-31T01:50:14.375 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-08-31T01:50:14.660 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-08-31T01:50:14.740 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-08-31T01:50:14.740 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-08-31T01:50:14.740 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-08-31T01:50:14.795 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-08-31T01:50:15.018 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-08-31T01:50:15.092 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-08-31T01:50:15.130 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-08-31T01:50:15.174 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-08-31T01:50:15.188 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 113 MB in 5s (23.7 MB/s) 2024-08-31T01:50:15.380 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-08-31T01:50:15.556 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 113 MB in 5s (23.0 MB/s) 2024-08-31T01:50:15.586 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 113 MB in 5s (24.6 MB/s) 2024-08-31T01:50:15.740 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-08-31T01:50:15.745 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-08-31T01:50:17.402 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-08-31T01:50:17.407 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:17.477 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:17.801 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-08-31T01:50:17.805 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:17.806 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-08-31T01:50:17.811 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:17.892 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:17.987 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:19.573 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-08-31T01:50:19.594 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:19.688 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:20.126 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-08-31T01:50:20.147 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:20.151 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-08-31T01:50:20.172 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:20.184 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:20.279 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:20.413 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-08-31T01:50:20.435 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:20.523 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:20.949 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-08-31T01:50:20.970 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:20.999 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:21.087 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-08-31T01:50:21.107 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:21.145 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:26.929 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-08-31T01:50:27.045 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-31T01:50:27.328 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-08-31T01:50:27.398 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-08-31T01:50:27.449 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-31T01:50:27.508 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-31T01:50:27.596 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-08-31T01:50:27.699 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-31T01:50:27.761 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-08-31T01:50:27.771 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-08-31T01:50:27.810 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-08-31T01:50:27.850 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-08-31T01:50:27.973 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-08-31T01:50:27.978 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-31T01:50:28.104 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-31T01:50:28.273 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-08-31T01:50:28.284 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-08-31T01:50:28.314 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-08-31T01:50:28.399 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-08-31T01:50:28.410 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-08-31T01:50:28.493 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-08-31T01:50:33.685 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-08-31T01:50:33.721 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:33.759 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:33.957 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-08-31T01:50:33.994 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:34.031 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:34.109 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-08-31T01:50:34.146 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-08-31T01:50:34.184 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:36.360 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-08-31T01:50:36.494 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-31T01:50:36.835 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-08-31T01:50:36.851 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-08-31T01:50:36.982 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:36.985 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-31T01:50:37.108 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-08-31T01:50:38.029 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:38.144 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-08-31T01:50:38.156 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-08-31T01:50:38.265 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:38.280 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-08-31T01:50:38.508 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-08-31T01:50:38.612 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:38.613 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-08-31T01:50:38.727 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:38.853 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-08-31T01:50:39.015 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:39.455 INFO:teuthology.orchestra.run.smithi163.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-08-31T01:50:39.456 INFO:teuthology.orchestra.run.smithi163.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-08-31T01:50:39.456 INFO:teuthology.orchestra.run.smithi163.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-08-31T01:50:39.456 INFO:teuthology.orchestra.run.smithi163.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-08-31T01:50:39.596 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:39.939 INFO:teuthology.orchestra.run.smithi027.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-08-31T01:50:39.940 INFO:teuthology.orchestra.run.smithi027.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-08-31T01:50:39.940 INFO:teuthology.orchestra.run.smithi027.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-08-31T01:50:39.940 INFO:teuthology.orchestra.run.smithi027.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-08-31T01:50:40.105 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:40.384 INFO:teuthology.orchestra.run.smithi191.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-08-31T01:50:40.384 INFO:teuthology.orchestra.run.smithi191.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-08-31T01:50:40.384 INFO:teuthology.orchestra.run.smithi191.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-08-31T01:50:40.384 INFO:teuthology.orchestra.run.smithi191.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-08-31T01:50:40.534 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:40.964 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:41.748 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:41.919 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:42.323 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-08-31T01:50:42.449 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-08-31T01:50:42.576 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:42.646 INFO:teuthology.orchestra.run.smithi163.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-31T01:50:42.646 INFO:teuthology.orchestra.run.smithi163.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-08-31T01:50:43.917 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-08-31T01:50:43.987 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-08-31T01:50:44.042 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-08-31T01:50:44.121 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-08-31T01:50:44.177 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:44.247 INFO:teuthology.orchestra.run.smithi027.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-31T01:50:44.247 INFO:teuthology.orchestra.run.smithi027.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-08-31T01:50:44.248 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-08-31T01:50:44.297 INFO:teuthology.orchestra.run.smithi191.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-08-31T01:50:44.297 INFO:teuthology.orchestra.run.smithi191.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-08-31T01:50:56.919 INFO:teuthology.orchestra.run.smithi163.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-31T01:50:56.919 INFO:teuthology.orchestra.run.smithi163.stdout:Sourcing file `/etc/default/grub' 2024-08-31T01:50:56.947 INFO:teuthology.orchestra.run.smithi163.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-31T01:50:56.956 INFO:teuthology.orchestra.run.smithi163.stdout:Generating grub configuration file ... 2024-08-31T01:50:57.213 INFO:teuthology.orchestra.run.smithi163.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-08-31T01:50:57.243 INFO:teuthology.orchestra.run.smithi163.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-08-31T01:50:57.524 INFO:teuthology.orchestra.run.smithi163.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-31T01:50:57.530 INFO:teuthology.orchestra.run.smithi163.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-31T01:50:57.609 INFO:teuthology.orchestra.run.smithi163.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-31T01:50:57.615 INFO:teuthology.orchestra.run.smithi163.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-31T01:50:57.788 INFO:teuthology.orchestra.run.smithi163.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-31T01:50:57.788 INFO:teuthology.orchestra.run.smithi163.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-08-31T01:50:57.788 INFO:teuthology.orchestra.run.smithi163.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-31T01:50:57.832 INFO:teuthology.orchestra.run.smithi163.stdout:done 2024-08-31T01:50:58.295 DEBUG:teuthology.orchestra.run.smithi163:> dpkg -s linux-image-generic 2024-08-31T01:50:58.318 INFO:teuthology.orchestra.run.smithi163.stdout:Package: linux-image-generic 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Status: install ok installed 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Priority: optional 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Section: kernel 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Installed-Size: 21 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Maintainer: Ubuntu Kernel Team 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: amd64 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Source: linux-meta 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Version: 5.15.0.119.119 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Recommends: thermald 2024-08-31T01:50:58.319 INFO:teuthology.orchestra.run.smithi163.stdout:Description: Generic Linux kernel image 2024-08-31T01:50:58.320 INFO:teuthology.orchestra.run.smithi163.stdout: This package will always depend on the latest generic kernel image 2024-08-31T01:50:58.320 INFO:teuthology.orchestra.run.smithi163.stdout: available. 2024-08-31T01:50:58.320 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-08-31T01:50:58.320 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-31T01:50:58.320 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-31T01:50:58.320 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-08-31T01:50:58.320 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi163.front.sepia.ceph.com, path=None, version=distro) 2024-08-31T01:50:58.321 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get clean 2024-08-31T01:50:58.375 INFO:teuthology.orchestra.run.smithi027.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-31T01:50:58.375 INFO:teuthology.orchestra.run.smithi027.stdout:Sourcing file `/etc/default/grub' 2024-08-31T01:50:58.381 INFO:teuthology.orchestra.run.smithi027.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-31T01:50:58.393 INFO:teuthology.orchestra.run.smithi027.stdout:Generating grub configuration file ... 2024-08-31T01:50:58.407 INFO:teuthology.orchestra.run.smithi191.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-08-31T01:50:58.407 INFO:teuthology.orchestra.run.smithi191.stdout:Sourcing file `/etc/default/grub' 2024-08-31T01:50:58.427 INFO:teuthology.orchestra.run.smithi191.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-31T01:50:58.455 INFO:teuthology.orchestra.run.smithi191.stdout:Generating grub configuration file ... 2024-08-31T01:50:58.480 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get update 2024-08-31T01:50:58.670 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-08-31T01:50:58.687 INFO:teuthology.orchestra.run.smithi027.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-08-31T01:50:58.701 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-08-31T01:50:58.703 INFO:teuthology.orchestra.run.smithi027.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-08-31T01:50:58.734 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T01:50:58.735 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-31T01:50:58.806 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-31T01:50:58.887 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-31T01:50:58.992 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-31T01:50:58.997 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-31T01:50:59.027 INFO:teuthology.orchestra.run.smithi027.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-31T01:50:59.033 INFO:teuthology.orchestra.run.smithi027.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-31T01:50:59.068 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-31T01:50:59.073 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-31T01:50:59.104 INFO:teuthology.orchestra.run.smithi027.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-31T01:50:59.110 INFO:teuthology.orchestra.run.smithi027.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-31T01:50:59.230 INFO:teuthology.orchestra.run.smithi191.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-31T01:50:59.230 INFO:teuthology.orchestra.run.smithi191.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-08-31T01:50:59.230 INFO:teuthology.orchestra.run.smithi191.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-31T01:50:59.270 INFO:teuthology.orchestra.run.smithi027.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-31T01:50:59.270 INFO:teuthology.orchestra.run.smithi027.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-08-31T01:50:59.270 INFO:teuthology.orchestra.run.smithi027.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-31T01:50:59.273 INFO:teuthology.orchestra.run.smithi191.stdout:done 2024-08-31T01:50:59.301 INFO:teuthology.orchestra.run.smithi027.stdout:done 2024-08-31T01:50:59.747 DEBUG:teuthology.orchestra.run.smithi191:> dpkg -s linux-image-generic 2024-08-31T01:50:59.767 INFO:teuthology.orchestra.run.smithi191.stdout:Package: linux-image-generic 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Status: install ok installed 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Priority: optional 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Section: kernel 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Installed-Size: 21 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Maintainer: Ubuntu Kernel Team 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: amd64 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Source: linux-meta 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Version: 5.15.0.119.119 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-31T01:50:59.768 INFO:teuthology.orchestra.run.smithi191.stdout:Recommends: thermald 2024-08-31T01:50:59.769 INFO:teuthology.orchestra.run.smithi191.stdout:Description: Generic Linux kernel image 2024-08-31T01:50:59.769 INFO:teuthology.orchestra.run.smithi191.stdout: This package will always depend on the latest generic kernel image 2024-08-31T01:50:59.769 INFO:teuthology.orchestra.run.smithi191.stdout: available. 2024-08-31T01:50:59.769 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-08-31T01:50:59.769 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-31T01:50:59.769 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-31T01:50:59.769 INFO:teuthology.task.kernel:Installing distro kernel on host.c... 2024-08-31T01:50:59.769 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi191.front.sepia.ceph.com, path=None, version=distro) 2024-08-31T01:50:59.769 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get clean 2024-08-31T01:50:59.777 DEBUG:teuthology.orchestra.run.smithi027:> dpkg -s linux-image-generic 2024-08-31T01:50:59.794 INFO:teuthology.orchestra.run.smithi027.stdout:Package: linux-image-generic 2024-08-31T01:50:59.794 INFO:teuthology.orchestra.run.smithi027.stdout:Status: install ok installed 2024-08-31T01:50:59.794 INFO:teuthology.orchestra.run.smithi027.stdout:Priority: optional 2024-08-31T01:50:59.794 INFO:teuthology.orchestra.run.smithi027.stdout:Section: kernel 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout:Installed-Size: 21 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout:Maintainer: Ubuntu Kernel Team 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: amd64 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout:Source: linux-meta 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout:Version: 5.15.0.119.119 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout:Recommends: thermald 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout:Description: Generic Linux kernel image 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout: This package will always depend on the latest generic kernel image 2024-08-31T01:50:59.795 INFO:teuthology.orchestra.run.smithi027.stdout: available. 2024-08-31T01:50:59.795 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-08-31T01:50:59.796 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-31T01:50:59.796 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-31T01:50:59.796 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-08-31T01:50:59.796 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi027.front.sepia.ceph.com, path=None, version=distro) 2024-08-31T01:50:59.796 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get clean 2024-08-31T01:50:59.914 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2024-08-31T01:50:59.970 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2024-08-31T01:51:00.025 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-31T01:51:00.082 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T01:51:00.082 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-31T01:51:00.091 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-31T01:51:00.108 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-31T01:51:00.147 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T01:51:00.229 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-31T01:51:00.243 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-08-31T01:51:00.261 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-31T01:51:00.311 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-31T01:51:00.325 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-08-31T01:51:00.535 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2024-08-31T01:51:00.536 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2024-08-31T01:51:00.712 INFO:teuthology.orchestra.run.smithi163.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-08-31T01:51:00.712 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T01:51:00.712 INFO:teuthology.orchestra.run.smithi163.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T01:51:00.712 INFO:teuthology.orchestra.run.smithi163.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T01:51:00.712 INFO:teuthology.orchestra.run.smithi163.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T01:51:00.713 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-31T01:51:00.713 INFO:teuthology.orchestra.run.smithi163.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-31T01:51:00.713 INFO:teuthology.orchestra.run.smithi163.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T01:51:00.753 INFO:teuthology.orchestra.run.smithi163.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-08-31T01:51:00.755 DEBUG:teuthology.orchestra.run.smithi163:> dpkg -s linux-image-generic 2024-08-31T01:51:00.770 INFO:teuthology.orchestra.run.smithi163.stdout:Package: linux-image-generic 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Status: install ok installed 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Priority: optional 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Section: kernel 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Installed-Size: 21 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Maintainer: Ubuntu Kernel Team 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: amd64 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Source: linux-meta 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Version: 5.15.0.119.119 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-31T01:51:00.771 INFO:teuthology.orchestra.run.smithi163.stdout:Recommends: thermald 2024-08-31T01:51:00.772 INFO:teuthology.orchestra.run.smithi163.stdout:Description: Generic Linux kernel image 2024-08-31T01:51:00.772 INFO:teuthology.orchestra.run.smithi163.stdout: This package will always depend on the latest generic kernel image 2024-08-31T01:51:00.772 INFO:teuthology.orchestra.run.smithi163.stdout: available. 2024-08-31T01:51:00.772 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-08-31T01:51:00.823 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.NNdininTHz 2024-08-31T01:51:00.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NNdininTHz 2024-08-31T01:51:00.889 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.NNdininTHz 2024-08-31T01:51:01.003 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.NNdininTHz is 10KB 2024-08-31T01:51:01.014 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.NNdininTHz 2024-08-31T01:51:01.019 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-31T01:51:01.078 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T01:51:01.078 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-31T01:51:01.079 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-31T01:51:01.146 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-08-31T01:51:01.146 DEBUG:teuthology.orchestra.run.smithi163:> sudo update-grub 2024-08-31T01:51:01.451 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-08-31T01:51:01.470 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-31T01:51:01.522 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-08-31T01:51:01.532 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-08-31T01:51:01.551 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-08-31T01:51:01.611 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-08-31T01:51:01.711 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-08-31T01:51:01.711 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-08-31T01:51:01.830 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-08-31T01:51:01.831 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-08-31T01:51:01.884 INFO:teuthology.orchestra.run.smithi027.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-08-31T01:51:01.884 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T01:51:01.884 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T01:51:01.884 INFO:teuthology.orchestra.run.smithi027.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T01:51:01.884 INFO:teuthology.orchestra.run.smithi027.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T01:51:01.884 INFO:teuthology.orchestra.run.smithi027.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-31T01:51:01.884 INFO:teuthology.orchestra.run.smithi027.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-31T01:51:01.884 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T01:51:01.925 INFO:teuthology.orchestra.run.smithi027.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-08-31T01:51:01.927 DEBUG:teuthology.orchestra.run.smithi027:> dpkg -s linux-image-generic 2024-08-31T01:51:01.986 INFO:teuthology.orchestra.run.smithi027.stdout:Package: linux-image-generic 2024-08-31T01:51:01.986 INFO:teuthology.orchestra.run.smithi027.stdout:Status: install ok installed 2024-08-31T01:51:01.986 INFO:teuthology.orchestra.run.smithi027.stdout:Priority: optional 2024-08-31T01:51:01.986 INFO:teuthology.orchestra.run.smithi027.stdout:Section: kernel 2024-08-31T01:51:01.986 INFO:teuthology.orchestra.run.smithi027.stdout:Installed-Size: 21 2024-08-31T01:51:01.986 INFO:teuthology.orchestra.run.smithi027.stdout:Maintainer: Ubuntu Kernel Team 2024-08-31T01:51:01.986 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: amd64 2024-08-31T01:51:01.986 INFO:teuthology.orchestra.run.smithi027.stdout:Source: linux-meta 2024-08-31T01:51:01.986 INFO:teuthology.orchestra.run.smithi027.stdout:Version: 5.15.0.119.119 2024-08-31T01:51:01.987 INFO:teuthology.orchestra.run.smithi027.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-31T01:51:01.987 INFO:teuthology.orchestra.run.smithi027.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-31T01:51:01.987 INFO:teuthology.orchestra.run.smithi027.stdout:Recommends: thermald 2024-08-31T01:51:01.987 INFO:teuthology.orchestra.run.smithi027.stdout:Description: Generic Linux kernel image 2024-08-31T01:51:01.987 INFO:teuthology.orchestra.run.smithi027.stdout: This package will always depend on the latest generic kernel image 2024-08-31T01:51:01.987 INFO:teuthology.orchestra.run.smithi027.stdout: available. 2024-08-31T01:51:01.988 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2024-08-31T01:51:02.006 INFO:teuthology.orchestra.run.smithi191.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-08-31T01:51:02.006 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T01:51:02.006 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T01:51:02.006 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T01:51:02.006 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T01:51:02.007 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-31T01:51:02.007 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-31T01:51:02.007 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T01:51:02.035 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.YBsggDu85J 2024-08-31T01:51:02.035 DEBUG:teuthology.orchestra.run.smithi027:> sudo cp /boot/grub/grub.cfg /tmp/tmp.YBsggDu85J 2024-08-31T01:51:02.046 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-08-31T01:51:02.048 DEBUG:teuthology.orchestra.run.smithi191:> dpkg -s linux-image-generic 2024-08-31T01:51:02.060 INFO:teuthology.orchestra.run.smithi191.stdout:Package: linux-image-generic 2024-08-31T01:51:02.060 INFO:teuthology.orchestra.run.smithi191.stdout:Status: install ok installed 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Priority: optional 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Section: kernel 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Installed-Size: 21 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Maintainer: Ubuntu Kernel Team 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: amd64 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Source: linux-meta 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Version: 5.15.0.119.119 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Recommends: thermald 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout:Description: Generic Linux kernel image 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout: This package will always depend on the latest generic kernel image 2024-08-31T01:51:02.061 INFO:teuthology.orchestra.run.smithi191.stdout: available. 2024-08-31T01:51:02.061 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-08-31T01:51:02.092 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.YBsggDu85J 2024-08-31T01:51:02.108 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.N29MjVYY2O 2024-08-31T01:51:02.108 DEBUG:teuthology.orchestra.run.smithi191:> sudo cp /boot/grub/grub.cfg /tmp/tmp.N29MjVYY2O 2024-08-31T01:51:02.164 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.N29MjVYY2O 2024-08-31T01:51:02.209 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.YBsggDu85J is 10KB 2024-08-31T01:51:02.223 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.YBsggDu85J 2024-08-31T01:51:02.229 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-31T01:51:02.277 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.N29MjVYY2O is 10KB 2024-08-31T01:51:02.282 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T01:51:02.282 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-31T01:51:02.282 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-31T01:51:02.290 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.N29MjVYY2O 2024-08-31T01:51:02.295 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-08-31T01:51:02.347 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T01:51:02.347 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-08-31T01:51:02.347 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-08-31T01:51:02.350 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-08-31T01:51:02.350 DEBUG:teuthology.orchestra.run.smithi027:> sudo update-grub 2024-08-31T01:51:02.382 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub' 2024-08-31T01:51:02.383 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-31T01:51:02.385 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2024-08-31T01:51:02.425 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-08-31T01:51:02.425 DEBUG:teuthology.orchestra.run.smithi191:> sudo update-grub 2024-08-31T01:51:02.561 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-08-31T01:51:02.566 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-08-31T01:51:02.806 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-31T01:51:02.812 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-31T01:51:02.854 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-31T01:51:02.859 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-31T01:51:03.009 INFO:teuthology.orchestra.run.smithi163.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-31T01:51:03.009 INFO:teuthology.orchestra.run.smithi163.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-31T01:51:03.009 INFO:teuthology.orchestra.run.smithi163.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-31T01:51:03.032 INFO:teuthology.orchestra.run.smithi163.stderr:done 2024-08-31T01:51:03.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo shutdown -r now 2024-08-31T01:51:03.545 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub' 2024-08-31T01:51:03.546 INFO:teuthology.orchestra.run.smithi027.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-31T01:51:03.549 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2024-08-31T01:51:03.737 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-08-31T01:51:03.742 INFO:teuthology.orchestra.run.smithi191.stderr:Sourcing file `/etc/default/grub' 2024-08-31T01:51:03.743 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-08-31T01:51:03.743 INFO:teuthology.orchestra.run.smithi191.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-08-31T01:51:03.747 INFO:teuthology.orchestra.run.smithi191.stderr:Generating grub configuration file ... 2024-08-31T01:51:03.935 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-08-31T01:51:03.940 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-08-31T01:51:03.983 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-31T01:51:03.989 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-31T01:51:04.031 INFO:teuthology.orchestra.run.smithi027.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-31T01:51:04.037 INFO:teuthology.orchestra.run.smithi027.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-31T01:51:04.158 INFO:teuthology.orchestra.run.smithi027.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-31T01:51:04.158 INFO:teuthology.orchestra.run.smithi027.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-31T01:51:04.158 INFO:teuthology.orchestra.run.smithi027.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-31T01:51:04.169 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-08-31T01:51:04.169 INFO:teuthology.orchestra.run.smithi027.stderr:done 2024-08-31T01:51:04.173 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-08-31T01:51:04.182 DEBUG:teuthology.orchestra.run.smithi027:> sudo shutdown -r now 2024-08-31T01:51:04.210 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-08-31T01:51:04.215 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-08-31T01:51:04.352 INFO:teuthology.orchestra.run.smithi191.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-08-31T01:51:04.352 INFO:teuthology.orchestra.run.smithi191.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-08-31T01:51:04.352 INFO:teuthology.orchestra.run.smithi191.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-08-31T01:51:04.387 INFO:teuthology.orchestra.run.smithi191.stderr:done 2024-08-31T01:51:04.396 DEBUG:teuthology.orchestra.run.smithi191:> sudo shutdown -r now 2024-08-31T01:51:33.070 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-08-31T01:51:33.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-08-31T01:51:33.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:51:34.187 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-08-31T01:51:34.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-08-31T01:51:34.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:51:34.399 INFO:teuthology.task.kernel:Checking client host.c for new kernel version... 2024-08-31T01:51:34.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-08-31T01:51:34.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:51:51.613 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-08-31T01:51:52.637 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-08-31T01:51:52.893 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-08-31T01:52:00.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-08-31T01:52:00.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:52:01.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-08-31T01:52:01.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:52:01.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-08-31T01:52:01.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:52:03.677 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-08-31T01:52:04.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-08-31T01:52:04.957 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-08-31T01:52:15.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-08-31T01:52:15.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:52:16.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-08-31T01:52:16.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:52:16.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-08-31T01:52:16.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:52:18.749 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-08-31T01:52:19.773 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-08-31T01:52:33.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-08-31T01:52:33.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:52:34.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-08-31T01:52:34.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:52:37.853 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-08-31T01:52:48.669 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-08-31T01:52:49.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-08-31T01:52:49.235 INFO:teuthology.task.kernel:Checking kernel version of host.c, want "5.15.0-119-generic"... 2024-08-31T01:52:49.235 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-08-31T01:52:49.280 INFO:teuthology.orchestra.run.smithi191.stdout:5.15.0-119-generic 2024-08-31T01:52:49.280 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-08-31T01:52:49.280 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-31T01:52:49.280 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-31T01:52:50.282 INFO:teuthology.task.kernel:Enabling kdb on host.c... 2024-08-31T01:52:50.282 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T01:52:50.347 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2024-08-31T01:52:50.374 DEBUG:teuthology.parallel:result is None 2024-08-31T01:52:55.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-08-31T01:52:55.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:53:27.620 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-08-31T01:53:28.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-08-31T01:53:28.199 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.15.0-119-generic"... 2024-08-31T01:53:28.199 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-08-31T01:53:28.244 INFO:teuthology.orchestra.run.smithi027.stdout:5.15.0-119-generic 2024-08-31T01:53:28.244 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-08-31T01:53:28.244 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-31T01:53:28.244 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-31T01:53:29.245 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-08-31T01:53:29.245 DEBUG:teuthology.orchestra.run.smithi027:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T01:53:29.333 INFO:teuthology.orchestra.run.smithi027.stdout:ttyS1 2024-08-31T01:53:29.354 DEBUG:teuthology.parallel:result is None 2024-08-31T01:53:33.768 DEBUG:teuthology.orchestra.remote:timed out 2024-08-31T01:53:51.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-08-31T01:53:51.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T01:53:52.074 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-08-31T01:53:52.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-08-31T01:53:52.663 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.15.0-119-generic"... 2024-08-31T01:53:52.663 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-08-31T01:53:52.707 INFO:teuthology.orchestra.run.smithi163.stdout:5.15.0-119-generic 2024-08-31T01:53:52.708 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-08-31T01:53:52.708 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-31T01:53:52.708 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-08-31T01:53:53.709 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-08-31T01:53:53.709 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T01:53:53.772 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2024-08-31T01:53:53.805 DEBUG:teuthology.parallel:result is None 2024-08-31T01:53:53.806 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-31T01:53:53.814 INFO:teuthology.task.internal:Creating test directory... 2024-08-31T01:53:53.815 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T01:53:53.817 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T01:53:53.820 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T01:53:53.827 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-31T01:53:53.836 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-31T01:53:53.851 INFO:teuthology.task.internal:Creating archive directory... 2024-08-31T01:53:53.851 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T01:53:53.865 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T01:53:53.867 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T01:53:53.894 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-31T01:53:53.906 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-31T01:53:53.906 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T01:53:53.925 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T01:53:53.928 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T01:53:53.946 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T01:53:53.948 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T01:53:53.956 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T01:53:53.957 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T01:53:53.975 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T01:53:53.984 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T01:53:53.986 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-31T01:53:53.997 INFO:teuthology.task.internal:Configuring sudo... 2024-08-31T01:53:53.997 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T01:53:53.999 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T01:53:54.002 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T01:53:54.031 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-31T01:53:54.048 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-31T01:53:54.048 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T01:53:54.053 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T01:53:54.077 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T01:53:54.082 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T01:53:54.104 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T01:53:54.152 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T01:53:54.152 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T01:53:54.212 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T01:53:54.218 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T01:53:54.264 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T01:53:54.265 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T01:53:54.333 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T01:53:54.339 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T01:53:54.388 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T01:53:54.388 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T01:53:54.461 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2024-08-31T01:53:54.464 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2024-08-31T01:53:54.466 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-08-31T01:53:54.542 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-31T01:53:54.553 INFO:teuthology.task.internal:Starting timer... 2024-08-31T01:53:54.553 INFO:teuthology.run_tasks:Running task pcp... 2024-08-31T01:53:54.572 INFO:teuthology.run_tasks:Running task selinux... 2024-08-31T01:53:54.583 DEBUG:teuthology.task.selinux:Excluding smithi027: OS 'ubuntu' does not support SELinux 2024-08-31T01:53:54.583 DEBUG:teuthology.task.selinux:Excluding smithi163: OS 'ubuntu' does not support SELinux 2024-08-31T01:53:54.584 DEBUG:teuthology.task.selinux:Excluding smithi191: OS 'ubuntu' does not support SELinux 2024-08-31T01:53:54.584 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-31T01:53:54.584 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-08-31T01:53:54.584 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-31T01:53:54.584 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-31T01:53:54.594 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-31T01:53:54.597 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-31T01:53:54.706 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-31T01:53:54.718 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-31T01:53:54.719 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi027.front.sepia.ceph.com,smithi163.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-31T02:01:27.064 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-08-31T02:01:27.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-08-31T02:01:27.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T02:01:27.152 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-08-31T02:01:27.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-08-31T02:01:27.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-08-31T02:01:27.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T02:01:27.299 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-08-31T02:01:27.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-08-31T02:01:27.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-08-31T02:01:27.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T02:01:27.465 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-08-31T02:01:27.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-08-31T02:01:27.537 INFO:teuthology.run_tasks:Running task clock... 2024-08-31T02:01:27.547 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-31T02:01:27.547 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T02:01:27.548 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T02:01:27.550 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T02:01:27.550 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T02:01:27.552 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T02:01:27.553 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T02:01:27.579 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-31T02:01:27.579 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: Command line: ntpd -gq 2024-08-31T02:01:27.579 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: ---------------------------------------------------- 2024-08-31T02:01:27.579 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: ntp-4 is maintained by Network Time Foundation, 2024-08-31T02:01:27.579 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-31T02:01:27.579 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: corporation. Support and training for ntp-4 are 2024-08-31T02:01:27.579 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: available at https://www.nwtime.org/support 2024-08-31T02:01:27.579 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: ---------------------------------------------------- 2024-08-31T02:01:27.579 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: proto: precision = 0.045 usec (-24) 2024-08-31T02:01:27.580 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: basedate set to 2022-02-04 2024-08-31T02:01:27.580 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: gps base set to 2022-02-06 (week 2196) 2024-08-31T02:01:27.580 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T02:01:27.580 INFO:teuthology.orchestra.run.smithi027.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T02:01:27.581 INFO:teuthology.orchestra.run.smithi027.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-31T02:01:27.582 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: restrict ::: KOD does nothing without LIMITED. 2024-08-31T02:01:27.582 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: Listen and drop on 0 v6wildcard [::]:123 2024-08-31T02:01:27.582 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-31T02:01:27.582 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: Listen normally on 2 lo 127.0.0.1:123 2024-08-31T02:01:27.582 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: Listen normally on 3 ens1f0 172.21.15.27:123 2024-08-31T02:01:27.582 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: Listen normally on 4 lo [::1]:123 2024-08-31T02:01:27.582 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:395a%4]:123 2024-08-31T02:01:27.582 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:27 ntpd[18264]: Listening on routing socket on fd #22 for interface updates 2024-08-31T02:01:27.583 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-31T02:01:27.584 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: Command line: ntpd -gq 2024-08-31T02:01:27.584 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: ---------------------------------------------------- 2024-08-31T02:01:27.584 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: ntp-4 is maintained by Network Time Foundation, 2024-08-31T02:01:27.584 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-31T02:01:27.584 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: corporation. Support and training for ntp-4 are 2024-08-31T02:01:27.585 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: available at https://www.nwtime.org/support 2024-08-31T02:01:27.585 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: ---------------------------------------------------- 2024-08-31T02:01:27.585 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: proto: precision = 0.060 usec (-24) 2024-08-31T02:01:27.585 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: basedate set to 2022-02-04 2024-08-31T02:01:27.585 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: gps base set to 2022-02-06 (week 2196) 2024-08-31T02:01:27.585 INFO:teuthology.orchestra.run.smithi163.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T02:01:27.586 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T02:01:27.586 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: restrict ::: KOD does nothing without LIMITED. 2024-08-31T02:01:27.586 INFO:teuthology.orchestra.run.smithi163.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-31T02:01:27.587 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: Listen and drop on 0 v6wildcard [::]:123 2024-08-31T02:01:27.587 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-31T02:01:27.587 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: Listen normally on 2 lo 127.0.0.1:123 2024-08-31T02:01:27.587 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: Listen normally on 3 enp3s0f1 172.21.15.163:123 2024-08-31T02:01:27.587 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: Listen normally on 4 lo [::1]:123 2024-08-31T02:01:27.587 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d5b%5]:123 2024-08-31T02:01:27.587 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:27 ntpd[18410]: Listening on routing socket on fd #22 for interface updates 2024-08-31T02:01:27.608 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-08-31T02:01:27.608 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: Command line: ntpd -gq 2024-08-31T02:01:27.608 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: ---------------------------------------------------- 2024-08-31T02:01:27.608 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: ntp-4 is maintained by Network Time Foundation, 2024-08-31T02:01:27.608 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-08-31T02:01:27.609 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: corporation. Support and training for ntp-4 are 2024-08-31T02:01:27.609 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: available at https://www.nwtime.org/support 2024-08-31T02:01:27.609 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: ---------------------------------------------------- 2024-08-31T02:01:27.609 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: proto: precision = 0.045 usec (-24) 2024-08-31T02:01:27.609 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: basedate set to 2022-02-04 2024-08-31T02:01:27.609 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: gps base set to 2022-02-06 (week 2196) 2024-08-31T02:01:27.609 INFO:teuthology.orchestra.run.smithi191.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T02:01:27.610 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-08-31T02:01:27.610 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: restrict ::: KOD does nothing without LIMITED. 2024-08-31T02:01:27.610 INFO:teuthology.orchestra.run.smithi191.stderr:restrict ::: KOD does nothing without LIMITED. 2024-08-31T02:01:27.611 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: Listen and drop on 0 v6wildcard [::]:123 2024-08-31T02:01:27.611 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-08-31T02:01:27.611 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: Listen normally on 2 lo 127.0.0.1:123 2024-08-31T02:01:27.611 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: Listen normally on 3 enp3s0f1 172.21.15.191:123 2024-08-31T02:01:27.611 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: Listen normally on 4 lo [::1]:123 2024-08-31T02:01:27.611 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7211%5]:123 2024-08-31T02:01:27.611 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:27 ntpd[18479]: Listening on routing socket on fd #22 for interface updates 2024-08-31T02:01:28.579 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:28 ntpd[18264]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:28.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:28 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:28 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:28 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:28 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:28 ntpd[18410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:28.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:28 ntpd[18410]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:28.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:28 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:28 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:28 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:28 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:28 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:28.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:28 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:28.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:28 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:28.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:28 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:29.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:29.610 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:29 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:30.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:30 ntpd[18264]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:30.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:30 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:30.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:30 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:30.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:30 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:30.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:30 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:30.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:30 ntpd[18410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:30.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:30 ntpd[18410]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:30.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:30 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:30.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:30 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:30.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:30 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:30.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:30 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:30.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:30 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:30.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:30 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:31.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:31.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:31.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:31.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:31.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:31.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:31.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:31.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:31.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:31.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:31.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:31.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:31.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:31.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:31 ntpd[18410]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:31.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:31.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:31 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:32.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:32.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:32 ntpd[18264]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:32.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:32 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:32 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:32 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:32 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:32 ntpd[18410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:32.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:32 ntpd[18410]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:32.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:32 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:32 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:32 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:32.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:32 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:32.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:32 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:32.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:32 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:33.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:33.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:33 ntpd[18410]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:33.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:33.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:33.610 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:33.610 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:33.610 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:33.610 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:33.610 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:33.610 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:33.610 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:33.611 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:33.611 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:33.611 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:33 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:34.579 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:34.579 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:34.579 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:34.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:34.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:34.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:34.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:34.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:34.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:34.580 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:34.580 INFO:teuthology.orchestra.run.smithi027.stdout:31 Aug 02:01:34 ntpd[18264]: ntpd: time slew -0.001169 s 2024-08-31T02:01:34.581 INFO:teuthology.orchestra.run.smithi027.stdout:ntpd: time slew -0.001169s 2024-08-31T02:01:34.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-31T02:01:34.581 INFO:teuthology.orchestra.run.smithi027.stderr:31 Aug 02:01:34 ntpd[18264]: can't open /var/log/ntpstats/loopstats.20240831: Permission denied 2024-08-31T02:01:34.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:34 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:34.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:34 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:34.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:34 ntpd[18410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:34.582 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:34 ntpd[18410]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:34.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:34 ntpd[18410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:34.583 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:34 ntpd[18410]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:34.583 INFO:teuthology.orchestra.run.smithi163.stdout:31 Aug 02:01:34 ntpd[18410]: ntpd: time slew +0.001665 s 2024-08-31T02:01:34.584 INFO:teuthology.orchestra.run.smithi163.stdout:ntpd: time slew +0.001665s 2024-08-31T02:01:34.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:34 ntpd[18410]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-31T02:01:34.584 INFO:teuthology.orchestra.run.smithi163.stderr:31 Aug 02:01:34 ntpd[18410]: can't open /var/log/ntpstats/loopstats.20240831: Permission denied 2024-08-31T02:01:34.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:34 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:34.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:34 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:34.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:34 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-08-31T02:01:34.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:34 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240831: Permission denied 2024-08-31T02:01:34.608 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:34 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-08-31T02:01:34.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:34 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240831: Permission denied 2024-08-31T02:01:34.609 INFO:teuthology.orchestra.run.smithi191.stdout:31 Aug 02:01:34 ntpd[18479]: ntpd: time slew -0.001022 s 2024-08-31T02:01:34.609 INFO:teuthology.orchestra.run.smithi191.stdout:ntpd: time slew -0.001022s 2024-08-31T02:01:34.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:34 ntpd[18479]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-08-31T02:01:34.609 INFO:teuthology.orchestra.run.smithi191.stderr:31 Aug 02:01:34 ntpd[18479]: can't open /var/log/ntpstats/loopstats.20240831: Permission denied 2024-08-31T02:01:34.626 INFO:teuthology.orchestra.run.smithi027.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T02:01:34.626 INFO:teuthology.orchestra.run.smithi027.stdout:============================================================================== 2024-08-31T02:01:34.627 INFO:teuthology.orchestra.run.smithi027.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.627 INFO:teuthology.orchestra.run.smithi027.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.627 INFO:teuthology.orchestra.run.smithi027.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.627 INFO:teuthology.orchestra.run.smithi027.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.634 INFO:teuthology.orchestra.run.smithi163.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T02:01:34.634 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================== 2024-08-31T02:01:34.634 INFO:teuthology.orchestra.run.smithi163.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.634 INFO:teuthology.orchestra.run.smithi163.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.635 INFO:teuthology.orchestra.run.smithi163.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.635 INFO:teuthology.orchestra.run.smithi163.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.668 INFO:teuthology.orchestra.run.smithi191.stdout: remote refid st t when poll reach delay offset jitter 2024-08-31T02:01:34.668 INFO:teuthology.orchestra.run.smithi191.stdout:============================================================================== 2024-08-31T02:01:34.668 INFO:teuthology.orchestra.run.smithi191.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.669 INFO:teuthology.orchestra.run.smithi191.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.669 INFO:teuthology.orchestra.run.smithi191.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.669 INFO:teuthology.orchestra.run.smithi191.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-08-31T02:01:34.670 INFO:teuthology.run_tasks:Running task install... 2024-08-31T02:01:34.678 DEBUG:teuthology.task.install:project ceph 2024-08-31T02:01:34.678 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '34b9d27bc925f169ace27b9f1f204536aa49fc0b'}} 2024-08-31T02:01:34.678 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '34b9d27bc925f169ace27b9f1f204536aa49fc0b'} 2024-08-31T02:01:34.678 INFO:teuthology.task.install:Using flavor: default 2024-08-31T02:01:34.687 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-31T02:01:34.687 INFO:teuthology.task.install:extra packages: [] 2024-08-31T02:01:34.688 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-key list | grep Ceph 2024-08-31T02:01:34.688 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-key list | grep Ceph 2024-08-31T02:01:34.689 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-key list | grep Ceph 2024-08-31T02:01:34.749 INFO:teuthology.orchestra.run.smithi027.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-31T02:01:34.749 INFO:teuthology.orchestra.run.smithi163.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-31T02:01:34.770 INFO:teuthology.orchestra.run.smithi191.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-08-31T02:01:34.777 INFO:teuthology.orchestra.run.smithi163.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-31T02:01:34.777 INFO:teuthology.orchestra.run.smithi163.stdout:uid [ unknown] Ceph.com (release key) 2024-08-31T02:01:34.777 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-08-31T02:01:34.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:01:34.783 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-31T02:01:34.783 INFO:teuthology.orchestra.run.smithi027.stdout:uid [ unknown] Ceph.com (release key) 2024-08-31T02:01:34.783 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-08-31T02:01:34.784 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:01:34.799 INFO:teuthology.orchestra.run.smithi191.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-08-31T02:01:34.799 INFO:teuthology.orchestra.run.smithi191.stdout:uid [ unknown] Ceph.com (release key) 2024-08-31T02:01:34.799 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-08-31T02:01:34.799 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:01:34.931 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default/ 2024-08-31T02:01:34.932 INFO:teuthology.task.install.deb:Package version is 19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:01:34.935 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default/ 2024-08-31T02:01:34.936 INFO:teuthology.task.install.deb:Package version is 19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:01:34.948 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default/ 2024-08-31T02:01:34.949 INFO:teuthology.task.install.deb:Package version is 19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:01:35.043 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T02:01:35.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-31T02:01:35.049 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:01:35.050 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-31T02:01:35.057 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get update 2024-08-31T02:01:35.059 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T02:01:35.059 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-08-31T02:01:35.064 DEBUG:teuthology.orchestra.run.smithi027:> sudo apt-get update 2024-08-31T02:01:35.073 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2024-08-31T02:01:35.224 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-31T02:01:35.276 INFO:teuthology.orchestra.run.smithi163.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy InRelease 2024-08-31T02:01:35.292 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy InRelease 2024-08-31T02:01:35.297 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy InRelease 2024-08-31T02:01:35.297 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-08-31T02:01:35.313 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-08-31T02:01:35.319 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-08-31T02:01:35.319 INFO:teuthology.orchestra.run.smithi163.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-31T02:01:35.337 INFO:teuthology.orchestra.run.smithi027.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-31T02:01:35.340 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-08-31T02:01:35.342 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-08-31T02:01:35.348 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T02:01:35.368 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T02:01:35.368 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-31T02:01:35.368 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-08-31T02:01:35.369 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2024-08-31T02:01:35.371 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-08-31T02:01:35.371 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-08-31T02:01:35.372 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-08-31T02:01:35.398 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2024-08-31T02:01:35.399 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2024-08-31T02:01:35.429 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-31T02:01:35.440 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-31T02:01:35.444 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-08-31T02:01:35.511 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-31T02:01:35.521 INFO:teuthology.orchestra.run.smithi027.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-31T02:01:35.525 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-08-31T02:01:35.658 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 28.9 kB in 0s (70.1 kB/s) 2024-08-31T02:01:35.740 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 28.9 kB in 0s (59.4 kB/s) 2024-08-31T02:01:35.775 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 28.9 kB in 1s (56.6 kB/s) 2024-08-31T02:01:36.706 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-08-31T02:01:36.722 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-240-g34b9d27b-1jammy cephadm=19.1.1-240-g34b9d27b-1jammy ceph-mds=19.1.1-240-g34b9d27b-1jammy ceph-mgr=19.1.1-240-g34b9d27b-1jammy ceph-common=19.1.1-240-g34b9d27b-1jammy ceph-fuse=19.1.1-240-g34b9d27b-1jammy ceph-test=19.1.1-240-g34b9d27b-1jammy ceph-volume=19.1.1-240-g34b9d27b-1jammy radosgw=19.1.1-240-g34b9d27b-1jammy python3-rados=19.1.1-240-g34b9d27b-1jammy python3-rgw=19.1.1-240-g34b9d27b-1jammy python3-cephfs=19.1.1-240-g34b9d27b-1jammy python3-rbd=19.1.1-240-g34b9d27b-1jammy libcephfs2=19.1.1-240-g34b9d27b-1jammy libcephfs-dev=19.1.1-240-g34b9d27b-1jammy librados2=19.1.1-240-g34b9d27b-1jammy librbd1=19.1.1-240-g34b9d27b-1jammy rbd-fuse=19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:01:36.783 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-08-31T02:01:36.787 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2024-08-31T02:01:36.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-240-g34b9d27b-1jammy cephadm=19.1.1-240-g34b9d27b-1jammy ceph-mds=19.1.1-240-g34b9d27b-1jammy ceph-mgr=19.1.1-240-g34b9d27b-1jammy ceph-common=19.1.1-240-g34b9d27b-1jammy ceph-fuse=19.1.1-240-g34b9d27b-1jammy ceph-test=19.1.1-240-g34b9d27b-1jammy ceph-volume=19.1.1-240-g34b9d27b-1jammy radosgw=19.1.1-240-g34b9d27b-1jammy python3-rados=19.1.1-240-g34b9d27b-1jammy python3-rgw=19.1.1-240-g34b9d27b-1jammy python3-cephfs=19.1.1-240-g34b9d27b-1jammy python3-rbd=19.1.1-240-g34b9d27b-1jammy libcephfs2=19.1.1-240-g34b9d27b-1jammy libcephfs-dev=19.1.1-240-g34b9d27b-1jammy librados2=19.1.1-240-g34b9d27b-1jammy librbd1=19.1.1-240-g34b9d27b-1jammy rbd-fuse=19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:01:36.805 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-08-31T02:01:36.821 DEBUG:teuthology.orchestra.run.smithi027:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-240-g34b9d27b-1jammy cephadm=19.1.1-240-g34b9d27b-1jammy ceph-mds=19.1.1-240-g34b9d27b-1jammy ceph-mgr=19.1.1-240-g34b9d27b-1jammy ceph-common=19.1.1-240-g34b9d27b-1jammy ceph-fuse=19.1.1-240-g34b9d27b-1jammy ceph-test=19.1.1-240-g34b9d27b-1jammy ceph-volume=19.1.1-240-g34b9d27b-1jammy radosgw=19.1.1-240-g34b9d27b-1jammy python3-rados=19.1.1-240-g34b9d27b-1jammy python3-rgw=19.1.1-240-g34b9d27b-1jammy python3-cephfs=19.1.1-240-g34b9d27b-1jammy python3-rbd=19.1.1-240-g34b9d27b-1jammy libcephfs2=19.1.1-240-g34b9d27b-1jammy libcephfs-dev=19.1.1-240-g34b9d27b-1jammy librados2=19.1.1-240-g34b9d27b-1jammy librbd1=19.1.1-240-g34b9d27b-1jammy rbd-fuse=19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:01:36.853 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2024-08-31T02:01:36.877 INFO:teuthology.orchestra.run.smithi027.stdout:Reading package lists... 2024-08-31T02:01:36.995 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2024-08-31T02:01:36.996 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2024-08-31T02:01:37.038 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2024-08-31T02:01:37.038 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2024-08-31T02:01:37.066 INFO:teuthology.orchestra.run.smithi027.stdout:Building dependency tree... 2024-08-31T02:01:37.067 INFO:teuthology.orchestra.run.smithi027.stdout:Reading state information... 2024-08-31T02:01:37.188 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T02:01:37.188 INFO:teuthology.orchestra.run.smithi163.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T02:01:37.188 INFO:teuthology.orchestra.run.smithi163.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T02:01:37.188 INFO:teuthology.orchestra.run.smithi163.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T02:01:37.189 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-31T02:01:37.189 INFO:teuthology.orchestra.run.smithi163.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-31T02:01:37.189 INFO:teuthology.orchestra.run.smithi163.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T02:01:37.190 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2024-08-31T02:01:37.190 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-31T02:01:37.190 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-31T02:01:37.190 INFO:teuthology.orchestra.run.smithi163.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T02:01:37.190 INFO:teuthology.orchestra.run.smithi163.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-31T02:01:37.191 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-31T02:01:37.191 INFO:teuthology.orchestra.run.smithi163.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-31T02:01:37.191 INFO:teuthology.orchestra.run.smithi163.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-08-31T02:01:37.192 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-31T02:01:37.193 INFO:teuthology.orchestra.run.smithi163.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-31T02:01:37.193 INFO:teuthology.orchestra.run.smithi163.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-31T02:01:37.193 INFO:teuthology.orchestra.run.smithi163.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-31T02:01:37.193 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-08-31T02:01:37.193 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet zip 2024-08-31T02:01:37.193 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2024-08-31T02:01:37.194 INFO:teuthology.orchestra.run.smithi163.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-31T02:01:37.194 INFO:teuthology.orchestra.run.smithi163.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-31T02:01:37.194 INFO:teuthology.orchestra.run.smithi163.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-31T02:01:37.194 INFO:teuthology.orchestra.run.smithi163.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-31T02:01:37.194 INFO:teuthology.orchestra.run.smithi163.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-31T02:01:37.194 INFO:teuthology.orchestra.run.smithi163.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-31T02:01:37.194 INFO:teuthology.orchestra.run.smithi163.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-31T02:01:37.194 INFO:teuthology.orchestra.run.smithi163.stdout:Recommended packages: 2024-08-31T02:01:37.194 INFO:teuthology.orchestra.run.smithi163.stdout: btrfs-tools 2024-08-31T02:01:37.224 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T02:01:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T02:01:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T02:01:37.224 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T02:01:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-31T02:01:37.225 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-31T02:01:37.225 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T02:01:37.225 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2024-08-31T02:01:37.226 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-31T02:01:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-31T02:01:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T02:01:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-31T02:01:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-31T02:01:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-31T02:01:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-31T02:01:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-31T02:01:37.227 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-31T02:01:37.228 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-31T02:01:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-08-31T02:01:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet zip 2024-08-31T02:01:37.229 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2024-08-31T02:01:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-31T02:01:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-31T02:01:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-31T02:01:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-31T02:01:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-31T02:01:37.229 INFO:teuthology.orchestra.run.smithi191.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-31T02:01:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-31T02:01:37.230 INFO:teuthology.orchestra.run.smithi191.stdout:Recommended packages: 2024-08-31T02:01:37.230 INFO:teuthology.orchestra.run.smithi191.stdout: btrfs-tools 2024-08-31T02:01:37.260 INFO:teuthology.orchestra.run.smithi027.stdout:The following packages were automatically installed and are no longer required: 2024-08-31T02:01:37.260 INFO:teuthology.orchestra.run.smithi027.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-08-31T02:01:37.260 INFO:teuthology.orchestra.run.smithi027.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-08-31T02:01:37.261 INFO:teuthology.orchestra.run.smithi027.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-08-31T02:01:37.261 INFO:teuthology.orchestra.run.smithi027.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-08-31T02:01:37.261 INFO:teuthology.orchestra.run.smithi027.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-08-31T02:01:37.261 INFO:teuthology.orchestra.run.smithi027.stdout:Use 'sudo apt autoremove' to remove them. 2024-08-31T02:01:37.262 INFO:teuthology.orchestra.run.smithi027.stdout:The following additional packages will be installed: 2024-08-31T02:01:37.262 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-08-31T02:01:37.262 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-08-31T02:01:37.263 INFO:teuthology.orchestra.run.smithi027.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-08-31T02:01:37.263 INFO:teuthology.orchestra.run.smithi027.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-08-31T02:01:37.263 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-08-31T02:01:37.263 INFO:teuthology.orchestra.run.smithi027.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-08-31T02:01:37.264 INFO:teuthology.orchestra.run.smithi027.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-08-31T02:01:37.265 INFO:teuthology.orchestra.run.smithi027.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-08-31T02:01:37.265 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-08-31T02:01:37.265 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet zip 2024-08-31T02:01:37.265 INFO:teuthology.orchestra.run.smithi027.stdout:Suggested packages: 2024-08-31T02:01:37.265 INFO:teuthology.orchestra.run.smithi027.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-08-31T02:01:37.265 INFO:teuthology.orchestra.run.smithi027.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-08-31T02:01:37.265 INFO:teuthology.orchestra.run.smithi027.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-08-31T02:01:37.265 INFO:teuthology.orchestra.run.smithi027.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-08-31T02:01:37.265 INFO:teuthology.orchestra.run.smithi027.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-08-31T02:01:37.265 INFO:teuthology.orchestra.run.smithi027.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-08-31T02:01:37.266 INFO:teuthology.orchestra.run.smithi027.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-08-31T02:01:37.266 INFO:teuthology.orchestra.run.smithi027.stdout:Recommended packages: 2024-08-31T02:01:37.266 INFO:teuthology.orchestra.run.smithi027.stdout: btrfs-tools 2024-08-31T02:01:37.294 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2024-08-31T02:01:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-31T02:01:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-31T02:01:37.294 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-08-31T02:01:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-08-31T02:01:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-08-31T02:01:37.295 INFO:teuthology.orchestra.run.smithi163.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-08-31T02:01:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-08-31T02:01:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-08-31T02:01:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-08-31T02:01:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-08-31T02:01:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-08-31T02:01:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-31T02:01:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-31T02:01:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-31T02:01:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-31T02:01:37.296 INFO:teuthology.orchestra.run.smithi163.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-31T02:01:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-31T02:01:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-31T02:01:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-08-31T02:01:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-08-31T02:01:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-08-31T02:01:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-08-31T02:01:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-08-31T02:01:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-08-31T02:01:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-08-31T02:01:37.297 INFO:teuthology.orchestra.run.smithi163.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-08-31T02:01:37.332 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2024-08-31T02:01:37.332 INFO:teuthology.orchestra.run.smithi191.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-31T02:01:37.332 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-31T02:01:37.332 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-08-31T02:01:37.333 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-08-31T02:01:37.333 INFO:teuthology.orchestra.run.smithi191.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-08-31T02:01:37.333 INFO:teuthology.orchestra.run.smithi191.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-08-31T02:01:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-08-31T02:01:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-08-31T02:01:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-08-31T02:01:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-08-31T02:01:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-08-31T02:01:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-31T02:01:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-31T02:01:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-31T02:01:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-31T02:01:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-31T02:01:37.335 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-31T02:01:37.335 INFO:teuthology.orchestra.run.smithi191.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-31T02:01:37.335 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-08-31T02:01:37.335 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-08-31T02:01:37.335 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-08-31T02:01:37.335 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-08-31T02:01:37.335 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-08-31T02:01:37.335 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-08-31T02:01:37.335 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-08-31T02:01:37.335 INFO:teuthology.orchestra.run.smithi191.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-08-31T02:01:37.357 INFO:teuthology.orchestra.run.smithi163.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-08-31T02:01:37.357 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 181 MB of archives. 2024-08-31T02:01:37.358 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 829 MB of additional disk space will be used. 2024-08-31T02:01:37.358 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-31T02:01:37.369 INFO:teuthology.orchestra.run.smithi027.stdout:The following NEW packages will be installed: 2024-08-31T02:01:37.369 INFO:teuthology.orchestra.run.smithi027.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-08-31T02:01:37.369 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-08-31T02:01:37.369 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-08-31T02:01:37.371 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-08-31T02:01:37.372 INFO:teuthology.orchestra.run.smithi027.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-08-31T02:01:37.432 INFO:teuthology.orchestra.run.smithi027.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-08-31T02:01:37.432 INFO:teuthology.orchestra.run.smithi027.stdout:Need to get 181 MB of archives. 2024-08-31T02:01:37.433 INFO:teuthology.orchestra.run.smithi027.stdout:After this operation, 829 MB of additional disk space will be used. 2024-08-31T02:01:37.433 INFO:teuthology.orchestra.run.smithi027.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-31T02:01:37.441 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-240-g34b9d27b-1jammy [3,589 kB] 2024-08-31T02:01:37.446 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-31T02:01:37.449 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-31T02:01:37.466 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-31T02:01:37.476 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-08-31T02:01:37.476 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 181 MB of archives. 2024-08-31T02:01:37.477 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 829 MB of additional disk space will be used. 2024-08-31T02:01:37.477 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-240-g34b9d27b-1jammy [3,589 kB] 2024-08-31T02:01:37.516 INFO:teuthology.orchestra.run.smithi027.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-240-g34b9d27b-1jammy [3,589 kB] 2024-08-31T02:01:37.520 INFO:teuthology.orchestra.run.smithi027.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-31T02:01:37.521 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-08-31T02:01:37.523 INFO:teuthology.orchestra.run.smithi027.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-31T02:01:37.526 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-31T02:01:37.530 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-31T02:01:37.540 INFO:teuthology.orchestra.run.smithi027.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-31T02:01:37.542 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-31T02:01:37.547 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-31T02:01:37.547 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-31T02:01:37.548 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-31T02:01:37.556 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-31T02:01:37.559 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-31T02:01:37.561 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-31T02:01:37.562 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-31T02:01:37.564 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-31T02:01:37.566 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-31T02:01:37.580 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-31T02:01:37.582 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-31T02:01:37.583 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-31T02:01:37.583 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-31T02:01:37.585 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-31T02:01:37.585 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-31T02:01:37.585 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-31T02:01:37.585 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-31T02:01:37.598 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-31T02:01:37.599 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-31T02:01:37.602 INFO:teuthology.orchestra.run.smithi027.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-31T02:01:37.607 INFO:teuthology.orchestra.run.smithi027.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-31T02:01:37.616 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-31T02:01:37.618 INFO:teuthology.orchestra.run.smithi163.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-31T02:01:37.619 INFO:teuthology.orchestra.run.smithi163.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-31T02:01:37.619 INFO:teuthology.orchestra.run.smithi163.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-31T02:01:37.620 INFO:teuthology.orchestra.run.smithi027.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-31T02:01:37.620 INFO:teuthology.orchestra.run.smithi163.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-31T02:01:37.621 INFO:teuthology.orchestra.run.smithi163.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-31T02:01:37.621 INFO:teuthology.orchestra.run.smithi163.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-31T02:01:37.622 INFO:teuthology.orchestra.run.smithi163.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-31T02:01:37.624 INFO:teuthology.orchestra.run.smithi027.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-31T02:01:37.624 INFO:teuthology.orchestra.run.smithi027.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-31T02:01:37.625 INFO:teuthology.orchestra.run.smithi027.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-31T02:01:37.634 INFO:teuthology.orchestra.run.smithi163.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-31T02:01:37.634 INFO:teuthology.orchestra.run.smithi027.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-31T02:01:37.634 INFO:teuthology.orchestra.run.smithi163.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-31T02:01:37.635 INFO:teuthology.orchestra.run.smithi163.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-240-g34b9d27b-1jammy [3,240 kB] 2024-08-31T02:01:37.636 INFO:teuthology.orchestra.run.smithi027.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-31T02:01:37.638 INFO:teuthology.orchestra.run.smithi027.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-31T02:01:37.639 INFO:teuthology.orchestra.run.smithi027.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-31T02:01:37.641 INFO:teuthology.orchestra.run.smithi027.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-31T02:01:37.643 INFO:teuthology.orchestra.run.smithi027.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-31T02:01:37.651 INFO:teuthology.orchestra.run.smithi163.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-31T02:01:37.657 INFO:teuthology.orchestra.run.smithi163.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-31T02:01:37.657 INFO:teuthology.orchestra.run.smithi163.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-31T02:01:37.658 INFO:teuthology.orchestra.run.smithi027.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-31T02:01:37.658 INFO:teuthology.orchestra.run.smithi163.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-31T02:01:37.658 INFO:teuthology.orchestra.run.smithi163.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-31T02:01:37.660 INFO:teuthology.orchestra.run.smithi163.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-31T02:01:37.660 INFO:teuthology.orchestra.run.smithi027.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-31T02:01:37.660 INFO:teuthology.orchestra.run.smithi027.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-31T02:01:37.660 INFO:teuthology.orchestra.run.smithi027.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-31T02:01:37.661 INFO:teuthology.orchestra.run.smithi163.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-31T02:01:37.662 INFO:teuthology.orchestra.run.smithi027.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-31T02:01:37.662 INFO:teuthology.orchestra.run.smithi027.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-31T02:01:37.662 INFO:teuthology.orchestra.run.smithi027.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-31T02:01:37.663 INFO:teuthology.orchestra.run.smithi163.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-31T02:01:37.663 INFO:teuthology.orchestra.run.smithi027.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-31T02:01:37.669 INFO:teuthology.orchestra.run.smithi163.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-31T02:01:37.670 INFO:teuthology.orchestra.run.smithi163.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-31T02:01:37.676 INFO:teuthology.orchestra.run.smithi027.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-31T02:01:37.677 INFO:teuthology.orchestra.run.smithi027.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-31T02:01:37.686 INFO:teuthology.orchestra.run.smithi163.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-31T02:01:37.687 INFO:teuthology.orchestra.run.smithi163.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-31T02:01:37.687 INFO:teuthology.orchestra.run.smithi163.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-31T02:01:37.690 INFO:teuthology.orchestra.run.smithi163.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-31T02:01:37.695 INFO:teuthology.orchestra.run.smithi027.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-31T02:01:37.698 INFO:teuthology.orchestra.run.smithi027.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-31T02:01:37.698 INFO:teuthology.orchestra.run.smithi027.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-31T02:01:37.699 INFO:teuthology.orchestra.run.smithi027.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-31T02:01:37.699 INFO:teuthology.orchestra.run.smithi027.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-31T02:01:37.701 INFO:teuthology.orchestra.run.smithi027.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-31T02:01:37.701 INFO:teuthology.orchestra.run.smithi027.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-31T02:01:37.701 INFO:teuthology.orchestra.run.smithi027.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-31T02:01:37.714 INFO:teuthology.orchestra.run.smithi027.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-31T02:01:37.715 INFO:teuthology.orchestra.run.smithi027.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-31T02:01:37.718 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-240-g34b9d27b-1jammy [3,240 kB] 2024-08-31T02:01:37.733 INFO:teuthology.orchestra.run.smithi027.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-31T02:01:37.738 INFO:teuthology.orchestra.run.smithi027.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-31T02:01:37.738 INFO:teuthology.orchestra.run.smithi027.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-31T02:01:37.739 INFO:teuthology.orchestra.run.smithi027.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-31T02:01:37.740 INFO:teuthology.orchestra.run.smithi027.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-31T02:01:37.741 INFO:teuthology.orchestra.run.smithi027.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-31T02:01:37.742 INFO:teuthology.orchestra.run.smithi163.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-31T02:01:37.743 INFO:teuthology.orchestra.run.smithi027.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-31T02:01:37.743 INFO:teuthology.orchestra.run.smithi163.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-31T02:01:37.744 INFO:teuthology.orchestra.run.smithi027.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-31T02:01:37.744 INFO:teuthology.orchestra.run.smithi163.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-31T02:01:37.745 INFO:teuthology.orchestra.run.smithi163.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-31T02:01:37.746 INFO:teuthology.orchestra.run.smithi163.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-31T02:01:37.751 INFO:teuthology.orchestra.run.smithi027.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-31T02:01:37.752 INFO:teuthology.orchestra.run.smithi027.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-31T02:01:37.760 INFO:teuthology.orchestra.run.smithi163.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-240-g34b9d27b-1jammy [719 kB] 2024-08-31T02:01:37.763 INFO:teuthology.orchestra.run.smithi163.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-31T02:01:37.765 INFO:teuthology.orchestra.run.smithi163.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-31T02:01:37.765 INFO:teuthology.orchestra.run.smithi163.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-31T02:01:37.770 INFO:teuthology.orchestra.run.smithi027.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-31T02:01:37.771 INFO:teuthology.orchestra.run.smithi027.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-31T02:01:37.772 INFO:teuthology.orchestra.run.smithi027.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-31T02:01:37.774 INFO:teuthology.orchestra.run.smithi163.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-240-g34b9d27b-1jammy [356 kB] 2024-08-31T02:01:37.775 INFO:teuthology.orchestra.run.smithi027.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-31T02:01:37.780 INFO:teuthology.orchestra.run.smithi163.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-31T02:01:37.780 INFO:teuthology.orchestra.run.smithi163.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-31T02:01:37.781 INFO:teuthology.orchestra.run.smithi163.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-240-g34b9d27b-1jammy [32.8 kB] 2024-08-31T02:01:37.782 INFO:teuthology.orchestra.run.smithi163.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-240-g34b9d27b-1jammy [180 kB] 2024-08-31T02:01:37.783 INFO:teuthology.orchestra.run.smithi163.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-31T02:01:37.784 INFO:teuthology.orchestra.run.smithi163.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-31T02:01:37.784 INFO:teuthology.orchestra.run.smithi163.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-31T02:01:37.785 INFO:teuthology.orchestra.run.smithi163.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-31T02:01:37.785 INFO:teuthology.orchestra.run.smithi163.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-31T02:01:37.800 INFO:teuthology.orchestra.run.smithi163.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-31T02:01:37.802 INFO:teuthology.orchestra.run.smithi163.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-240-g34b9d27b-1jammy [67.6 kB] 2024-08-31T02:01:37.803 INFO:teuthology.orchestra.run.smithi163.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-31T02:01:37.804 INFO:teuthology.orchestra.run.smithi163.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-240-g34b9d27b-1jammy [333 kB] 2024-08-31T02:01:37.805 INFO:teuthology.orchestra.run.smithi163.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-31T02:01:37.806 INFO:teuthology.orchestra.run.smithi163.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-31T02:01:37.807 INFO:teuthology.orchestra.run.smithi163.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-31T02:01:37.810 INFO:teuthology.orchestra.run.smithi163.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-240-g34b9d27b-1jammy [6,874 kB] 2024-08-31T02:01:37.818 INFO:teuthology.orchestra.run.smithi163.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-31T02:01:37.820 INFO:teuthology.orchestra.run.smithi163.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-31T02:01:37.821 INFO:teuthology.orchestra.run.smithi163.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-31T02:01:37.821 INFO:teuthology.orchestra.run.smithi163.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-31T02:01:37.826 INFO:teuthology.orchestra.run.smithi163.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-31T02:01:37.832 INFO:teuthology.orchestra.run.smithi027.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-31T02:01:37.833 INFO:teuthology.orchestra.run.smithi027.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-31T02:01:37.834 INFO:teuthology.orchestra.run.smithi027.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-31T02:01:37.834 INFO:teuthology.orchestra.run.smithi027.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-31T02:01:37.835 INFO:teuthology.orchestra.run.smithi163.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-31T02:01:37.836 INFO:teuthology.orchestra.run.smithi027.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-31T02:01:37.838 INFO:teuthology.orchestra.run.smithi163.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-31T02:01:37.838 INFO:teuthology.orchestra.run.smithi163.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-31T02:01:37.838 INFO:teuthology.orchestra.run.smithi163.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-31T02:01:37.839 INFO:teuthology.orchestra.run.smithi163.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-31T02:01:37.843 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-240-g34b9d27b-1jammy [719 kB] 2024-08-31T02:01:37.853 INFO:teuthology.orchestra.run.smithi163.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-31T02:01:37.854 INFO:teuthology.orchestra.run.smithi163.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-31T02:01:37.854 INFO:teuthology.orchestra.run.smithi027.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-31T02:01:37.856 INFO:teuthology.orchestra.run.smithi027.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-31T02:01:37.856 INFO:teuthology.orchestra.run.smithi027.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-31T02:01:37.857 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-240-g34b9d27b-1jammy [356 kB] 2024-08-31T02:01:37.860 INFO:teuthology.orchestra.run.smithi163.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-31T02:01:37.860 INFO:teuthology.orchestra.run.smithi163.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-31T02:01:37.860 INFO:teuthology.orchestra.run.smithi163.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-31T02:01:37.864 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-240-g34b9d27b-1jammy [32.8 kB] 2024-08-31T02:01:37.865 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-240-g34b9d27b-1jammy [180 kB] 2024-08-31T02:01:37.870 INFO:teuthology.orchestra.run.smithi163.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-31T02:01:37.870 INFO:teuthology.orchestra.run.smithi163.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-31T02:01:37.871 INFO:teuthology.orchestra.run.smithi027.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-31T02:01:37.871 INFO:teuthology.orchestra.run.smithi027.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-31T02:01:37.871 INFO:teuthology.orchestra.run.smithi027.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-31T02:01:37.872 INFO:teuthology.orchestra.run.smithi027.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-31T02:01:37.872 INFO:teuthology.orchestra.run.smithi027.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-31T02:01:37.873 INFO:teuthology.orchestra.run.smithi027.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-31T02:01:37.885 INFO:teuthology.orchestra.run.smithi027.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-31T02:01:37.885 INFO:teuthology.orchestra.run.smithi027.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-31T02:01:37.889 INFO:teuthology.orchestra.run.smithi027.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-31T02:01:37.896 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-240-g34b9d27b-1jammy [67.6 kB] 2024-08-31T02:01:37.898 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-240-g34b9d27b-1jammy [333 kB] 2024-08-31T02:01:37.902 INFO:teuthology.orchestra.run.smithi027.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-31T02:01:37.903 INFO:teuthology.orchestra.run.smithi027.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-31T02:01:37.904 INFO:teuthology.orchestra.run.smithi027.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-31T02:01:37.904 INFO:teuthology.orchestra.run.smithi191.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-240-g34b9d27b-1jammy [6,874 kB] 2024-08-31T02:01:37.907 INFO:teuthology.orchestra.run.smithi027.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-31T02:01:37.910 INFO:teuthology.orchestra.run.smithi027.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-31T02:01:37.910 INFO:teuthology.orchestra.run.smithi027.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-31T02:01:37.911 INFO:teuthology.orchestra.run.smithi027.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-31T02:01:37.919 INFO:teuthology.orchestra.run.smithi027.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-31T02:01:37.920 INFO:teuthology.orchestra.run.smithi027.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-31T02:01:37.922 INFO:teuthology.orchestra.run.smithi027.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-31T02:01:37.936 INFO:teuthology.orchestra.run.smithi027.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-31T02:01:37.937 INFO:teuthology.orchestra.run.smithi027.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-31T02:01:37.937 INFO:teuthology.orchestra.run.smithi027.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-31T02:01:37.939 INFO:teuthology.orchestra.run.smithi027.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-31T02:01:37.939 INFO:teuthology.orchestra.run.smithi027.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-31T02:01:37.944 INFO:teuthology.orchestra.run.smithi191.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-08-31T02:01:37.945 INFO:teuthology.orchestra.run.smithi027.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-31T02:01:37.946 INFO:teuthology.orchestra.run.smithi027.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-31T02:01:37.953 INFO:teuthology.orchestra.run.smithi027.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-31T02:01:37.953 INFO:teuthology.orchestra.run.smithi027.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-240-g34b9d27b-1jammy [3,240 kB] 2024-08-31T02:01:37.955 INFO:teuthology.orchestra.run.smithi027.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-31T02:01:37.956 INFO:teuthology.orchestra.run.smithi027.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-31T02:01:37.957 INFO:teuthology.orchestra.run.smithi191.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-08-31T02:01:38.037 INFO:teuthology.orchestra.run.smithi191.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-08-31T02:01:38.069 INFO:teuthology.orchestra.run.smithi163.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-240-g34b9d27b-1jammy [112 kB] 2024-08-31T02:01:38.072 INFO:teuthology.orchestra.run.smithi163.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-240-g34b9d27b-1jammy [472 kB] 2024-08-31T02:01:38.081 INFO:teuthology.orchestra.run.smithi163.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-240-g34b9d27b-1jammy [25.9 MB] 2024-08-31T02:01:38.188 INFO:teuthology.orchestra.run.smithi191.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-240-g34b9d27b-1jammy [112 kB] 2024-08-31T02:01:38.191 INFO:teuthology.orchestra.run.smithi191.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-240-g34b9d27b-1jammy [472 kB] 2024-08-31T02:01:38.200 INFO:teuthology.orchestra.run.smithi191.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-240-g34b9d27b-1jammy [25.9 MB] 2024-08-31T02:01:38.268 INFO:teuthology.orchestra.run.smithi191.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-08-31T02:01:38.277 INFO:teuthology.orchestra.run.smithi191.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-08-31T02:01:38.306 INFO:teuthology.orchestra.run.smithi191.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-08-31T02:01:38.315 INFO:teuthology.orchestra.run.smithi191.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-08-31T02:01:38.316 INFO:teuthology.orchestra.run.smithi191.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-08-31T02:01:38.317 INFO:teuthology.orchestra.run.smithi191.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-08-31T02:01:38.335 INFO:teuthology.orchestra.run.smithi191.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-08-31T02:01:38.339 INFO:teuthology.orchestra.run.smithi191.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-08-31T02:01:38.347 INFO:teuthology.orchestra.run.smithi027.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-240-g34b9d27b-1jammy [719 kB] 2024-08-31T02:01:38.348 INFO:teuthology.orchestra.run.smithi191.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-08-31T02:01:38.352 INFO:teuthology.orchestra.run.smithi191.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-08-31T02:01:38.386 INFO:teuthology.orchestra.run.smithi027.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-240-g34b9d27b-1jammy [356 kB] 2024-08-31T02:01:38.394 INFO:teuthology.orchestra.run.smithi027.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-240-g34b9d27b-1jammy [32.8 kB] 2024-08-31T02:01:38.395 INFO:teuthology.orchestra.run.smithi027.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-240-g34b9d27b-1jammy [180 kB] 2024-08-31T02:01:38.399 INFO:teuthology.orchestra.run.smithi027.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-240-g34b9d27b-1jammy [67.6 kB] 2024-08-31T02:01:38.401 INFO:teuthology.orchestra.run.smithi027.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-240-g34b9d27b-1jammy [333 kB] 2024-08-31T02:01:38.426 INFO:teuthology.orchestra.run.smithi027.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-240-g34b9d27b-1jammy [6,874 kB] 2024-08-31T02:01:38.433 INFO:teuthology.orchestra.run.smithi191.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-08-31T02:01:38.437 INFO:teuthology.orchestra.run.smithi191.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-08-31T02:01:38.442 INFO:teuthology.orchestra.run.smithi191.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-08-31T02:01:38.446 INFO:teuthology.orchestra.run.smithi191.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-08-31T02:01:38.447 INFO:teuthology.orchestra.run.smithi191.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-08-31T02:01:38.448 INFO:teuthology.orchestra.run.smithi191.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-08-31T02:01:38.450 INFO:teuthology.orchestra.run.smithi191.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-08-31T02:01:38.450 INFO:teuthology.orchestra.run.smithi191.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-08-31T02:01:38.451 INFO:teuthology.orchestra.run.smithi191.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-08-31T02:01:38.515 INFO:teuthology.orchestra.run.smithi191.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-08-31T02:01:38.533 INFO:teuthology.orchestra.run.smithi191.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-08-31T02:01:38.535 INFO:teuthology.orchestra.run.smithi191.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-08-31T02:01:38.535 INFO:teuthology.orchestra.run.smithi191.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-08-31T02:01:38.540 INFO:teuthology.orchestra.run.smithi191.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-08-31T02:01:38.541 INFO:teuthology.orchestra.run.smithi191.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-08-31T02:01:38.596 INFO:teuthology.orchestra.run.smithi191.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-08-31T02:01:38.597 INFO:teuthology.orchestra.run.smithi191.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-08-31T02:01:38.599 INFO:teuthology.orchestra.run.smithi191.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-08-31T02:01:38.600 INFO:teuthology.orchestra.run.smithi191.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-08-31T02:01:38.677 INFO:teuthology.orchestra.run.smithi191.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-08-31T02:01:38.679 INFO:teuthology.orchestra.run.smithi191.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-08-31T02:01:38.681 INFO:teuthology.orchestra.run.smithi191.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-08-31T02:01:38.682 INFO:teuthology.orchestra.run.smithi191.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-08-31T02:01:38.693 INFO:teuthology.orchestra.run.smithi191.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-08-31T02:01:38.758 INFO:teuthology.orchestra.run.smithi191.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-08-31T02:01:38.759 INFO:teuthology.orchestra.run.smithi191.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-08-31T02:01:38.760 INFO:teuthology.orchestra.run.smithi191.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-08-31T02:01:38.763 INFO:teuthology.orchestra.run.smithi191.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-08-31T02:01:38.767 INFO:teuthology.orchestra.run.smithi191.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-08-31T02:01:38.839 INFO:teuthology.orchestra.run.smithi191.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-08-31T02:01:38.842 INFO:teuthology.orchestra.run.smithi191.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-08-31T02:01:38.843 INFO:teuthology.orchestra.run.smithi191.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-08-31T02:01:38.848 INFO:teuthology.orchestra.run.smithi191.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-08-31T02:01:38.849 INFO:teuthology.orchestra.run.smithi191.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-08-31T02:01:38.920 INFO:teuthology.orchestra.run.smithi191.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-08-31T02:01:38.925 INFO:teuthology.orchestra.run.smithi191.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-08-31T02:01:38.972 INFO:teuthology.orchestra.run.smithi027.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-240-g34b9d27b-1jammy [112 kB] 2024-08-31T02:01:38.975 INFO:teuthology.orchestra.run.smithi027.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-240-g34b9d27b-1jammy [472 kB] 2024-08-31T02:01:39.018 INFO:teuthology.orchestra.run.smithi027.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-240-g34b9d27b-1jammy [25.9 MB] 2024-08-31T02:01:39.089 INFO:teuthology.orchestra.run.smithi191.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-08-31T02:01:39.091 INFO:teuthology.orchestra.run.smithi191.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-08-31T02:01:39.093 INFO:teuthology.orchestra.run.smithi191.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-08-31T02:01:39.094 INFO:teuthology.orchestra.run.smithi191.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-08-31T02:01:39.097 INFO:teuthology.orchestra.run.smithi191.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-08-31T02:01:39.132 INFO:teuthology.orchestra.run.smithi191.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-08-31T02:01:39.135 INFO:teuthology.orchestra.run.smithi191.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-08-31T02:01:39.136 INFO:teuthology.orchestra.run.smithi191.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-08-31T02:01:39.195 INFO:teuthology.orchestra.run.smithi191.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-08-31T02:01:39.196 INFO:teuthology.orchestra.run.smithi191.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-08-31T02:01:39.242 INFO:teuthology.orchestra.run.smithi163.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-240-g34b9d27b-1jammy [5,144 kB] 2024-08-31T02:01:39.258 INFO:teuthology.orchestra.run.smithi191.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-08-31T02:01:39.329 INFO:teuthology.orchestra.run.smithi191.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-08-31T02:01:39.330 INFO:teuthology.orchestra.run.smithi191.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-08-31T02:01:39.330 INFO:teuthology.orchestra.run.smithi191.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-240-g34b9d27b-1jammy [5,144 kB] 2024-08-31T02:01:39.331 INFO:teuthology.orchestra.run.smithi191.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-08-31T02:01:39.332 INFO:teuthology.orchestra.run.smithi191.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-08-31T02:01:39.334 INFO:teuthology.orchestra.run.smithi191.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-08-31T02:01:39.342 INFO:teuthology.orchestra.run.smithi191.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-08-31T02:01:39.347 INFO:teuthology.orchestra.run.smithi191.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-08-31T02:01:39.351 INFO:teuthology.orchestra.run.smithi191.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-08-31T02:01:39.352 INFO:teuthology.orchestra.run.smithi191.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-08-31T02:01:39.361 INFO:teuthology.orchestra.run.smithi163.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-240-g34b9d27b-1jammy [245 kB] 2024-08-31T02:01:39.367 INFO:teuthology.orchestra.run.smithi163.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-240-g34b9d27b-1jammy [124 kB] 2024-08-31T02:01:39.369 INFO:teuthology.orchestra.run.smithi163.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-240-g34b9d27b-1jammy [1,555 kB] 2024-08-31T02:01:39.421 INFO:teuthology.orchestra.run.smithi191.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-08-31T02:01:39.428 INFO:teuthology.orchestra.run.smithi191.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-08-31T02:01:39.430 INFO:teuthology.orchestra.run.smithi191.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-08-31T02:01:39.431 INFO:teuthology.orchestra.run.smithi191.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-08-31T02:01:39.451 INFO:teuthology.orchestra.run.smithi163.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-240-g34b9d27b-1jammy [6,142 kB] 2024-08-31T02:01:39.458 INFO:teuthology.orchestra.run.smithi191.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-240-g34b9d27b-1jammy [245 kB] 2024-08-31T02:01:39.473 INFO:teuthology.orchestra.run.smithi191.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-240-g34b9d27b-1jammy [124 kB] 2024-08-31T02:01:39.475 INFO:teuthology.orchestra.run.smithi191.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-240-g34b9d27b-1jammy [1,555 kB] 2024-08-31T02:01:39.502 INFO:teuthology.orchestra.run.smithi191.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-08-31T02:01:39.504 INFO:teuthology.orchestra.run.smithi191.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-08-31T02:01:39.512 INFO:teuthology.orchestra.run.smithi191.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-08-31T02:01:39.512 INFO:teuthology.orchestra.run.smithi191.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-08-31T02:01:39.514 INFO:teuthology.orchestra.run.smithi191.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-08-31T02:01:39.515 INFO:teuthology.orchestra.run.smithi191.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-08-31T02:01:39.533 INFO:teuthology.orchestra.run.smithi191.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-240-g34b9d27b-1jammy [6,142 kB] 2024-08-31T02:01:39.583 INFO:teuthology.orchestra.run.smithi191.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-08-31T02:01:39.585 INFO:teuthology.orchestra.run.smithi191.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-08-31T02:01:39.603 INFO:teuthology.orchestra.run.smithi191.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-08-31T02:01:39.604 INFO:teuthology.orchestra.run.smithi191.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-08-31T02:01:39.664 INFO:teuthology.orchestra.run.smithi191.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-08-31T02:01:39.670 INFO:teuthology.orchestra.run.smithi191.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-08-31T02:01:39.672 INFO:teuthology.orchestra.run.smithi191.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-08-31T02:01:39.705 INFO:teuthology.orchestra.run.smithi163.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-240-g34b9d27b-1jammy [22.8 MB] 2024-08-31T02:01:39.780 INFO:teuthology.orchestra.run.smithi191.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-240-g34b9d27b-1jammy [22.8 MB] 2024-08-31T02:01:40.738 INFO:teuthology.orchestra.run.smithi163.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-240-g34b9d27b-1jammy [14.1 kB] 2024-08-31T02:01:40.738 INFO:teuthology.orchestra.run.smithi163.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-240-g34b9d27b-1jammy [877 kB] 2024-08-31T02:01:40.755 INFO:teuthology.orchestra.run.smithi163.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-240-g34b9d27b-1jammy [2,462 kB] 2024-08-31T02:01:40.789 INFO:teuthology.orchestra.run.smithi191.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-240-g34b9d27b-1jammy [14.1 kB] 2024-08-31T02:01:40.790 INFO:teuthology.orchestra.run.smithi191.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-240-g34b9d27b-1jammy [877 kB] 2024-08-31T02:01:40.797 INFO:teuthology.orchestra.run.smithi163.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-240-g34b9d27b-1jammy [794 kB] 2024-08-31T02:01:40.807 INFO:teuthology.orchestra.run.smithi163.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-240-g34b9d27b-1jammy [152 kB] 2024-08-31T02:01:40.807 INFO:teuthology.orchestra.run.smithi191.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-240-g34b9d27b-1jammy [2,462 kB] 2024-08-31T02:01:40.809 INFO:teuthology.orchestra.run.smithi163.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-240-g34b9d27b-1jammy [2,323 kB] 2024-08-31T02:01:40.849 INFO:teuthology.orchestra.run.smithi191.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-240-g34b9d27b-1jammy [794 kB] 2024-08-31T02:01:40.880 INFO:teuthology.orchestra.run.smithi191.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-240-g34b9d27b-1jammy [152 kB] 2024-08-31T02:01:40.883 INFO:teuthology.orchestra.run.smithi191.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-240-g34b9d27b-1jammy [2,323 kB] 2024-08-31T02:01:40.899 INFO:teuthology.orchestra.run.smithi163.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-240-g34b9d27b-1jammy [8,625 kB] 2024-08-31T02:01:40.974 INFO:teuthology.orchestra.run.smithi191.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-240-g34b9d27b-1jammy [8,625 kB] 2024-08-31T02:01:41.246 INFO:teuthology.orchestra.run.smithi163.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-240-g34b9d27b-1jammy [14.2 kB] 2024-08-31T02:01:41.247 INFO:teuthology.orchestra.run.smithi163.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-240-g34b9d27b-1jammy [51.3 MB] 2024-08-31T02:01:41.274 INFO:teuthology.orchestra.run.smithi027.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-240-g34b9d27b-1jammy [5,144 kB] 2024-08-31T02:01:41.321 INFO:teuthology.orchestra.run.smithi191.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-240-g34b9d27b-1jammy [14.2 kB] 2024-08-31T02:01:41.322 INFO:teuthology.orchestra.run.smithi191.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-240-g34b9d27b-1jammy [51.3 MB] 2024-08-31T02:01:41.679 INFO:teuthology.orchestra.run.smithi027.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-240-g34b9d27b-1jammy [245 kB] 2024-08-31T02:01:41.685 INFO:teuthology.orchestra.run.smithi027.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-240-g34b9d27b-1jammy [124 kB] 2024-08-31T02:01:41.688 INFO:teuthology.orchestra.run.smithi027.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-240-g34b9d27b-1jammy [1,555 kB] 2024-08-31T02:01:41.868 INFO:teuthology.orchestra.run.smithi027.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-240-g34b9d27b-1jammy [6,142 kB] 2024-08-31T02:01:42.436 INFO:teuthology.orchestra.run.smithi027.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-240-g34b9d27b-1jammy [22.8 MB] 2024-08-31T02:01:43.532 INFO:teuthology.orchestra.run.smithi163.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-240-g34b9d27b-1jammy [130 kB] 2024-08-31T02:01:43.534 INFO:teuthology.orchestra.run.smithi163.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-240-g34b9d27b-1jammy [39.0 kB] 2024-08-31T02:01:43.535 INFO:teuthology.orchestra.run.smithi163.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-240-g34b9d27b-1jammy [13.6 MB] 2024-08-31T02:01:43.640 INFO:teuthology.orchestra.run.smithi191.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-240-g34b9d27b-1jammy [130 kB] 2024-08-31T02:01:43.643 INFO:teuthology.orchestra.run.smithi191.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-240-g34b9d27b-1jammy [39.0 kB] 2024-08-31T02:01:43.644 INFO:teuthology.orchestra.run.smithi191.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-240-g34b9d27b-1jammy [13.6 MB] 2024-08-31T02:01:43.850 INFO:teuthology.orchestra.run.smithi163.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-240-g34b9d27b-1jammy [91.5 kB] 2024-08-31T02:01:43.982 INFO:teuthology.orchestra.run.smithi191.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-240-g34b9d27b-1jammy [91.5 kB] 2024-08-31T02:01:44.111 INFO:teuthology.orchestra.run.smithi027.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-240-g34b9d27b-1jammy [14.1 kB] 2024-08-31T02:01:44.112 INFO:teuthology.orchestra.run.smithi027.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-240-g34b9d27b-1jammy [877 kB] 2024-08-31T02:01:44.129 INFO:teuthology.orchestra.run.smithi027.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-240-g34b9d27b-1jammy [2,462 kB] 2024-08-31T02:01:44.178 INFO:teuthology.orchestra.run.smithi027.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-240-g34b9d27b-1jammy [794 kB] 2024-08-31T02:01:44.198 INFO:teuthology.orchestra.run.smithi027.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-240-g34b9d27b-1jammy [152 kB] 2024-08-31T02:01:44.201 INFO:teuthology.orchestra.run.smithi027.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-240-g34b9d27b-1jammy [2,323 kB] 2024-08-31T02:01:44.268 INFO:teuthology.orchestra.run.smithi027.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-240-g34b9d27b-1jammy [8,625 kB] 2024-08-31T02:01:44.432 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 181 MB in 7s (27.6 MB/s) 2024-08-31T02:01:44.500 INFO:teuthology.orchestra.run.smithi027.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-240-g34b9d27b-1jammy [14.2 kB] 2024-08-31T02:01:44.501 INFO:teuthology.orchestra.run.smithi027.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-240-g34b9d27b-1jammy [51.3 MB] 2024-08-31T02:01:44.542 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 181 MB in 7s (27.3 MB/s) 2024-08-31T02:01:44.592 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-31T02:01:44.687 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-08-31T02:01:44.692 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-31T02:01:44.705 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-31T02:01:44.766 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T02:01:44.800 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-08-31T02:01:44.806 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-31T02:01:44.904 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T02:01:45.052 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-31T02:01:45.078 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-31T02:01:45.111 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T02:01:45.241 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-31T02:01:45.268 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-31T02:01:45.308 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T02:01:45.516 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-31T02:01:45.542 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-31T02:01:45.605 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T02:01:45.620 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-31T02:01:45.647 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-31T02:01:45.687 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T02:01:46.059 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-31T02:01:46.085 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T02:01:46.133 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:01:46.140 INFO:teuthology.orchestra.run.smithi027.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-240-g34b9d27b-1jammy [130 kB] 2024-08-31T02:01:46.143 INFO:teuthology.orchestra.run.smithi027.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-240-g34b9d27b-1jammy [39.0 kB] 2024-08-31T02:01:46.144 INFO:teuthology.orchestra.run.smithi027.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-240-g34b9d27b-1jammy [13.6 MB] 2024-08-31T02:01:46.150 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-31T02:01:46.176 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T02:01:46.225 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:01:46.434 INFO:teuthology.orchestra.run.smithi027.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-240-g34b9d27b-1jammy [91.5 kB] 2024-08-31T02:01:46.529 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-31T02:01:46.555 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T02:01:46.587 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:01:46.604 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-31T02:01:46.631 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T02:01:46.671 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:01:46.940 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-31T02:01:46.966 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T02:01:47.006 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:01:47.008 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-31T02:01:47.031 INFO:teuthology.orchestra.run.smithi027.stdout:Fetched 181 MB in 9s (20.0 MB/s) 2024-08-31T02:01:47.034 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T02:01:47.075 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:01:47.241 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-08-31T02:01:47.344 INFO:teuthology.orchestra.run.smithi027.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-08-31T02:01:47.350 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-08-31T02:01:47.359 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-31T02:01:47.386 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-31T02:01:47.387 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-31T02:01:47.402 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-31T02:01:47.426 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T02:01:47.437 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T02:01:47.447 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T02:01:47.712 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librados2. 2024-08-31T02:01:47.728 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../007-librados2_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:47.749 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librados2. 2024-08-31T02:01:47.762 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librados2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:47.776 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../007-librados2_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:47.816 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librados2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:47.860 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-08-31T02:01:47.886 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-08-31T02:01:47.925 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T02:01:48.198 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librbd1. 2024-08-31T02:01:48.224 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../008-librbd1_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:48.261 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librbd1. 2024-08-31T02:01:48.264 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librbd1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:48.270 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-08-31T02:01:48.287 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../008-librbd1_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:48.297 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-08-31T02:01:48.327 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librbd1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:48.337 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T02:01:48.709 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs2. 2024-08-31T02:01:48.725 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:48.740 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-08-31T02:01:48.767 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T02:01:48.768 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:48.815 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:01:49.015 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libcephfs2. 2024-08-31T02:01:49.041 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:49.053 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rados. 2024-08-31T02:01:49.080 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../010-python3-rados_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:49.081 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libcephfs2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:49.120 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rados (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:49.185 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-08-31T02:01:49.212 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T02:01:49.243 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:01:49.385 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rados. 2024-08-31T02:01:49.389 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-31T02:01:49.411 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../010-python3-rados_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:49.416 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:01:49.448 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-ceph-argparse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:49.451 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rados (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:49.588 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-08-31T02:01:49.615 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-08-31T02:01:49.655 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:01:49.700 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cephfs. 2024-08-31T02:01:49.726 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:49.730 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-31T02:01:49.745 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:01:49.767 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cephfs (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:49.780 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-ceph-argparse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:49.999 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-08-31T02:01:50.016 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cephfs. 2024-08-31T02:01:50.026 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-08-31T02:01:50.043 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:50.066 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T02:01:50.083 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cephfs (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:50.086 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-31T02:01:50.112 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:01:50.153 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:50.395 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-31T02:01:50.402 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librados2. 2024-08-31T02:01:50.409 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:01:50.429 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../007-librados2_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:50.462 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:50.469 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librados2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:50.539 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-31T02:01:50.565 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-31T02:01:50.605 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T02:01:50.749 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-31T02:01:50.775 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-31T02:01:50.807 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T02:01:50.942 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-prettytable. 2024-08-31T02:01:50.968 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-08-31T02:01:51.008 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-31T02:01:51.021 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librbd1. 2024-08-31T02:01:51.048 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../008-librbd1_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:51.088 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librbd1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:51.111 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-prettytable. 2024-08-31T02:01:51.137 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-08-31T02:01:51.177 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-31T02:01:51.244 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rbd. 2024-08-31T02:01:51.260 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:51.294 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rbd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:51.439 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rbd. 2024-08-31T02:01:51.455 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:51.482 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs2. 2024-08-31T02:01:51.489 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rbd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:51.498 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:51.532 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:51.622 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-31T02:01:51.648 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-31T02:01:51.688 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T02:01:51.793 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rados. 2024-08-31T02:01:51.809 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../010-python3-rados_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:51.818 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-31T02:01:51.843 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rados (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:51.844 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-31T02:01:51.884 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T02:01:51.975 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-31T02:01:52.001 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-31T02:01:52.041 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T02:01:52.154 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-08-31T02:01:52.172 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-31T02:01:52.181 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:01:52.198 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-31T02:01:52.221 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-argparse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:52.238 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T02:01:52.344 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-31T02:01:52.370 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-31T02:01:52.410 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T02:01:52.498 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cephfs. 2024-08-31T02:01:52.514 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:52.550 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-31T02:01:52.556 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cephfs (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:52.577 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-31T02:01:52.617 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T02:01:52.689 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package lua5.1. 2024-08-31T02:01:52.715 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-31T02:01:52.747 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-31T02:01:52.876 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-ceph-common. 2024-08-31T02:01:52.903 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:01:52.913 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua5.1. 2024-08-31T02:01:52.939 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-31T02:01:52.942 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:52.979 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-31T02:01:53.058 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package lua-any. 2024-08-31T02:01:53.074 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-08-31T02:01:53.117 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-31T02:01:53.262 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-wcwidth. 2024-08-31T02:01:53.289 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-08-31T02:01:53.292 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua-any. 2024-08-31T02:01:53.307 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-08-31T02:01:53.329 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T02:01:53.350 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-31T02:01:53.369 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package zip. 2024-08-31T02:01:53.384 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-08-31T02:01:53.427 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking zip (3.0-12build2) ... 2024-08-31T02:01:53.598 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-prettytable. 2024-08-31T02:01:53.603 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package zip. 2024-08-31T02:01:53.614 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-08-31T02:01:53.630 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-08-31T02:01:53.648 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-08-31T02:01:53.670 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking zip (3.0-12build2) ... 2024-08-31T02:01:53.722 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package unzip. 2024-08-31T02:01:53.748 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-31T02:01:53.789 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-31T02:01:53.909 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rbd. 2024-08-31T02:01:53.936 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:53.950 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package unzip. 2024-08-31T02:01:53.975 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rbd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:53.976 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-31T02:01:54.008 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-31T02:01:54.151 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package luarocks. 2024-08-31T02:01:54.177 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-31T02:01:54.217 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-31T02:01:54.329 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-08-31T02:01:54.355 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-08-31T02:01:54.395 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T02:01:54.530 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package luarocks. 2024-08-31T02:01:54.556 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-31T02:01:54.596 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-31T02:01:54.609 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librgw2. 2024-08-31T02:01:54.635 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../025-librgw2_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:54.675 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librgw2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:54.698 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-08-31T02:01:54.725 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-08-31T02:01:54.764 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T02:01:54.940 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librgw2. 2024-08-31T02:01:54.967 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../025-librgw2_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:54.998 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librgw2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:55.034 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-08-31T02:01:55.050 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-08-31T02:01:55.084 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T02:01:55.228 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rgw. 2024-08-31T02:01:55.254 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:55.294 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:55.404 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package lua5.1. 2024-08-31T02:01:55.430 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-08-31T02:01:55.470 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-08-31T02:01:55.560 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rgw. 2024-08-31T02:01:55.575 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:55.580 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-31T02:01:55.607 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-31T02:01:55.618 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:55.648 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T02:01:55.966 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libradosstriper1. 2024-08-31T02:01:55.993 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:55.997 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-31T02:01:56.023 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-31T02:01:56.033 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libradosstriper1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:56.064 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T02:01:56.065 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package lua-any. 2024-08-31T02:01:56.092 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-08-31T02:01:56.132 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking lua-any (27ubuntu1) ... 2024-08-31T02:01:56.334 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libradosstriper1. 2024-08-31T02:01:56.360 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:56.376 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package zip. 2024-08-31T02:01:56.392 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-08-31T02:01:56.392 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libradosstriper1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:56.426 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking zip (3.0-12build2) ... 2024-08-31T02:01:56.461 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-common. 2024-08-31T02:01:56.488 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../029-ceph-common_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:56.528 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:56.687 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package unzip. 2024-08-31T02:01:56.714 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-08-31T02:01:56.754 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-08-31T02:01:56.838 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-common. 2024-08-31T02:01:56.865 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../029-ceph-common_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:56.905 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:57.141 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package luarocks. 2024-08-31T02:01:57.168 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-08-31T02:01:57.208 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-08-31T02:01:57.599 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package librgw2. 2024-08-31T02:01:57.625 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../025-librgw2_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:57.665 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking librgw2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:57.833 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-base. 2024-08-31T02:01:57.859 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../030-ceph-base_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:57.909 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-base (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:58.178 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-base. 2024-08-31T02:01:58.205 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../030-ceph-base_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:58.226 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rgw. 2024-08-31T02:01:58.242 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:58.246 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-base (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:58.284 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:58.479 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-31T02:01:58.505 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-31T02:01:58.545 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-31T02:01:58.629 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package liboath0:amd64. 2024-08-31T02:01:58.656 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-08-31T02:01:58.695 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T02:01:58.806 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cheroot. 2024-08-31T02:01:58.833 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-31T02:01:58.842 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-31T02:01:58.869 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-31T02:01:58.873 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T02:01:58.909 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-31T02:01:59.031 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libradosstriper1. 2024-08-31T02:01:59.058 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:59.098 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libradosstriper1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:59.209 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-31T02:01:59.236 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-31T02:01:59.276 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-31T02:01:59.405 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cheroot. 2024-08-31T02:01:59.431 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-31T02:01:59.471 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T02:01:59.527 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-common. 2024-08-31T02:01:59.553 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../029-ceph-common_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:01:59.578 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-31T02:01:59.593 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:01:59.605 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-31T02:01:59.645 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-31T02:01:59.758 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-31T02:01:59.774 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-31T02:01:59.809 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-31T02:01:59.923 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-31T02:01:59.949 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-31T02:01:59.981 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-31T02:02:00.079 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-31T02:02:00.105 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-31T02:02:00.145 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-31T02:02:00.259 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-tempora. 2024-08-31T02:02:00.285 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-08-31T02:02:00.326 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-31T02:02:00.449 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-31T02:02:00.476 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-31T02:02:00.516 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-31T02:02:00.628 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-portend. 2024-08-31T02:02:00.655 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-08-31T02:02:00.695 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-31T02:02:00.770 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-tempora. 2024-08-31T02:02:00.796 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-08-31T02:02:00.836 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-31T02:02:00.973 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-base. 2024-08-31T02:02:00.998 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-31T02:02:01.000 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../030-ceph-base_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:01.024 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-31T02:02:01.049 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-base (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:01.064 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-31T02:02:01.123 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-portend. 2024-08-31T02:02:01.149 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-08-31T02:02:01.190 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-31T02:02:01.317 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-31T02:02:01.343 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-31T02:02:01.376 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-31T02:02:01.452 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-31T02:02:01.467 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-31T02:02:01.502 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-31T02:02:01.704 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-natsort. 2024-08-31T02:02:01.719 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-08-31T02:02:01.730 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-08-31T02:02:01.746 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-08-31T02:02:01.770 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-31T02:02:01.781 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-31T02:02:01.785 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-08-31T02:02:01.807 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-31T02:02:01.848 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-31T02:02:02.056 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-logutils. 2024-08-31T02:02:02.072 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-08-31T02:02:02.088 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cheroot. 2024-08-31T02:02:02.106 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-31T02:02:02.115 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-08-31T02:02:02.155 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T02:02:02.177 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-natsort. 2024-08-31T02:02:02.203 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-08-31T02:02:02.235 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-31T02:02:02.376 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-31T02:02:02.403 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-31T02:02:02.443 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-31T02:02:02.491 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-08-31T02:02:02.518 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-08-31T02:02:02.558 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-08-31T02:02:02.573 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-logutils. 2024-08-31T02:02:02.600 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-08-31T02:02:02.639 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-31T02:02:02.746 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-mako. 2024-08-31T02:02:02.772 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-31T02:02:02.812 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T02:02:02.886 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.text. 2024-08-31T02:02:02.912 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-08-31T02:02:02.951 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-31T02:02:03.072 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-08-31T02:02:03.072 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-31T02:02:03.072 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-31T02:02:03.132 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-31T02:02:03.158 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-31T02:02:03.198 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-31T02:02:03.257 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-08-31T02:02:03.284 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-08-31T02:02:03.288 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-mako. 2024-08-31T02:02:03.315 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-31T02:02:03.323 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-08-31T02:02:03.347 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T02:02:03.485 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-31T02:02:03.511 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-31T02:02:03.551 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-31T02:02:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-tempora. 2024-08-31T02:02:03.653 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-08-31T02:02:03.659 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-31T02:02:03.686 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-31T02:02:03.693 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-08-31T02:02:03.726 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-31T02:02:03.795 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-webob. 2024-08-31T02:02:03.811 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-31T02:02:03.854 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-31T02:02:03.970 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-portend. 2024-08-31T02:02:03.987 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-08-31T02:02:04.032 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-08-31T02:02:04.032 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-31T02:02:04.056 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-31T02:02:04.096 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-31T02:02:04.198 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-waitress. 2024-08-31T02:02:04.225 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-31T02:02:04.268 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T02:02:04.315 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-08-31T02:02:04.342 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-08-31T02:02:04.382 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-08-31T02:02:04.400 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-webob. 2024-08-31T02:02:04.426 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-31T02:02:04.466 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-31T02:02:04.585 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-tempita. 2024-08-31T02:02:04.611 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-31T02:02:04.651 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T02:02:04.685 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cherrypy3. 2024-08-31T02:02:04.711 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-08-31T02:02:04.751 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-08-31T02:02:04.879 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-waitress. 2024-08-31T02:02:04.905 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-31T02:02:04.929 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-paste. 2024-08-31T02:02:04.956 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-31T02:02:04.957 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T02:02:04.987 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T02:02:05.080 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-natsort. 2024-08-31T02:02:05.096 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-08-31T02:02:05.130 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-08-31T02:02:05.266 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-tempita. 2024-08-31T02:02:05.293 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-31T02:02:05.315 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-31T02:02:05.341 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T02:02:05.342 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-31T02:02:05.382 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T02:02:05.450 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-logutils. 2024-08-31T02:02:05.477 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-08-31T02:02:05.516 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-08-31T02:02:05.586 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-paste. 2024-08-31T02:02:05.613 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-31T02:02:05.653 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T02:02:05.685 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-31T02:02:05.711 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-31T02:02:05.743 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-31T02:02:05.827 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-markupsafe. 2024-08-31T02:02:05.855 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-08-31T02:02:05.894 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-08-31T02:02:05.990 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-31T02:02:06.006 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-31T02:02:06.013 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-webtest. 2024-08-31T02:02:06.040 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-08-31T02:02:06.049 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T02:02:06.080 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-31T02:02:06.206 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-mako. 2024-08-31T02:02:06.233 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-08-31T02:02:06.272 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T02:02:06.311 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-31T02:02:06.337 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-31T02:02:06.369 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-31T02:02:06.390 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pecan. 2024-08-31T02:02:06.417 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-31T02:02:06.457 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T02:02:06.584 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplegeneric. 2024-08-31T02:02:06.611 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-08-31T02:02:06.642 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-08-31T02:02:06.673 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-webtest. 2024-08-31T02:02:06.700 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-08-31T02:02:06.740 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-31T02:02:06.853 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-certifi. 2024-08-31T02:02:06.880 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-08-31T02:02:06.920 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-singledispatch. 2024-08-31T02:02:06.920 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-31T02:02:06.947 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-08-31T02:02:07.011 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-08-31T02:02:07.035 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pecan. 2024-08-31T02:02:07.061 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-31T02:02:07.101 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T02:02:07.190 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-idna. 2024-08-31T02:02:07.216 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-31T02:02:07.248 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T02:02:07.314 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webob. 2024-08-31T02:02:07.341 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-08-31T02:02:07.381 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-08-31T02:02:07.458 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-certifi. 2024-08-31T02:02:07.485 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-08-31T02:02:07.525 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-31T02:02:07.568 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-urllib3. 2024-08-31T02:02:07.594 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-31T02:02:07.634 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T02:02:07.726 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-waitress. 2024-08-31T02:02:07.753 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-08-31T02:02:07.795 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-idna. 2024-08-31T02:02:07.795 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T02:02:07.810 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-31T02:02:07.853 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T02:02:07.962 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-requests. 2024-08-31T02:02:07.988 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-31T02:02:08.028 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T02:02:08.103 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-tempita. 2024-08-31T02:02:08.131 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-08-31T02:02:08.165 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-urllib3. 2024-08-31T02:02:08.170 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T02:02:08.192 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-31T02:02:08.232 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T02:02:08.356 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-31T02:02:08.383 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-31T02:02:08.423 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T02:02:08.448 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-paste. 2024-08-31T02:02:08.475 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-08-31T02:02:08.532 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T02:02:08.553 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-requests. 2024-08-31T02:02:08.580 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-31T02:02:08.619 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T02:02:08.718 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-31T02:02:08.733 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:08.776 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-modules-core (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:08.851 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-08-31T02:02:08.867 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-08-31T02:02:08.901 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T02:02:08.941 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-31T02:02:08.967 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-31T02:02:09.007 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T02:02:09.114 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-31T02:02:09.141 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:09.154 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastedeploy. 2024-08-31T02:02:09.172 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:09.181 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-08-31T02:02:09.220 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-08-31T02:02:09.327 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-31T02:02:09.342 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:09.385 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-modules-core (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:09.467 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-31T02:02:09.493 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-31T02:02:09.524 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-webtest. 2024-08-31T02:02:09.533 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-31T02:02:09.551 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-08-31T02:02:09.590 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-08-31T02:02:09.725 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-31T02:02:09.752 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:09.783 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:09.844 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-openssl. 2024-08-31T02:02:09.871 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-08-31T02:02:09.885 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pecan. 2024-08-31T02:02:09.911 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-31T02:02:09.912 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-08-31T02:02:09.951 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T02:02:10.087 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-31T02:02:10.114 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-31T02:02:10.153 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-31T02:02:10.214 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr. 2024-08-31T02:02:10.241 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:10.280 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:10.323 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-certifi. 2024-08-31T02:02:10.351 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-08-31T02:02:10.389 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-08-31T02:02:10.750 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-openssl. 2024-08-31T02:02:10.777 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-08-31T02:02:11.193 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-31T02:02:11.559 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mon. 2024-08-31T02:02:11.586 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:11.625 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mon (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:11.654 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr. 2024-08-31T02:02:11.680 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:11.720 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:11.801 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-idna. 2024-08-31T02:02:11.829 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-08-31T02:02:11.859 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T02:02:12.125 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mon. 2024-08-31T02:02:12.151 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:12.171 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-urllib3. 2024-08-31T02:02:12.191 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mon (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:12.198 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-08-31T02:02:12.221 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-osd. 2024-08-31T02:02:12.237 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T02:02:12.247 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:12.287 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-osd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:12.557 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-requests. 2024-08-31T02:02:12.585 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-08-31T02:02:12.624 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T02:02:12.829 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-osd. 2024-08-31T02:02:12.856 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:12.887 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-osd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:12.935 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-werkzeug. 2024-08-31T02:02:12.962 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-08-31T02:02:13.002 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T02:02:13.296 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-08-31T02:02:13.313 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:13.332 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph. 2024-08-31T02:02:13.354 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-modules-core (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:13.358 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../066-ceph_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:13.398 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:13.685 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-fuse. 2024-08-31T02:02:13.709 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-08-31T02:02:13.711 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:13.725 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:13.759 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:13.759 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:13.958 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph. 2024-08-31T02:02:13.985 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../066-ceph_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:14.025 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:14.079 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-bcrypt. 2024-08-31T02:02:14.106 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-08-31T02:02:14.121 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mds. 2024-08-31T02:02:14.145 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-08-31T02:02:14.147 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:14.187 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mds (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:14.328 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-fuse. 2024-08-31T02:02:14.355 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:14.394 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:14.457 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-openssl. 2024-08-31T02:02:14.484 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-08-31T02:02:14.523 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-08-31T02:02:14.573 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package cephadm. 2024-08-31T02:02:14.600 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../069-cephadm_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:14.640 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:14.732 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mds. 2024-08-31T02:02:14.759 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:14.809 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr. 2024-08-31T02:02:14.825 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:14.859 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:14.914 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mds (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:14.960 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-31T02:02:14.986 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-31T02:02:15.026 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-31T02:02:15.238 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mon. 2024-08-31T02:02:15.265 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:15.302 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package cephadm. 2024-08-31T02:02:15.304 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mon (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:15.329 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../069-cephadm_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:15.353 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-31T02:02:15.369 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:15.369 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T02:02:15.412 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:15.656 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-31T02:02:15.683 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-31T02:02:15.723 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-31T02:02:15.916 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-osd. 2024-08-31T02:02:15.944 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:15.983 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-osd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:16.060 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-31T02:02:16.075 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T02:02:16.109 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:16.483 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-babel. 2024-08-31T02:02:16.511 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T02:02:16.544 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:16.822 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jinja2. 2024-08-31T02:02:16.849 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-31T02:02:16.879 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T02:02:17.036 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph. 2024-08-31T02:02:17.052 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../066-ceph_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:17.086 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:17.126 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-babel. 2024-08-31T02:02:17.153 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T02:02:17.192 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:17.216 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-31T02:02:17.232 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:17.265 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:17.372 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-fuse. 2024-08-31T02:02:17.400 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:17.447 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:17.512 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jinja2. 2024-08-31T02:02:17.539 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-31T02:02:17.568 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-31T02:02:17.578 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T02:02:17.584 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-08-31T02:02:17.618 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-31T02:02:17.825 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mds. 2024-08-31T02:02:17.852 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:17.892 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mds (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:17.896 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-routes. 2024-08-31T02:02:17.923 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-31T02:02:17.923 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-31T02:02:17.950 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:17.963 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T02:02:17.989 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:18.266 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-31T02:02:18.284 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-31T02:02:18.293 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:18.295 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package cephadm. 2024-08-31T02:02:18.311 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-08-31T02:02:18.322 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../069-cephadm_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:18.324 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-dashboard (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:18.351 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-31T02:02:18.361 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:18.639 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-asyncssh. 2024-08-31T02:02:18.653 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-routes. 2024-08-31T02:02:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-08-31T02:02:18.680 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-31T02:02:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-08-31T02:02:18.720 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T02:02:18.992 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-babel-localedata. 2024-08-31T02:02:19.008 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T02:02:19.014 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-31T02:02:19.041 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:19.042 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:19.073 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-dashboard (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:19.654 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-31T02:02:19.681 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-31T02:02:19.720 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T02:02:20.072 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-babel. 2024-08-31T02:02:20.100 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-08-31T02:02:20.138 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:20.224 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-joblib. 2024-08-31T02:02:20.250 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-31T02:02:20.290 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T02:02:20.428 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-31T02:02:20.444 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-31T02:02:20.475 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-jinja2. 2024-08-31T02:02:20.486 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T02:02:20.502 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-08-31T02:02:20.541 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T02:02:20.643 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-31T02:02:20.670 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-31T02:02:20.701 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-31T02:02:20.894 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-08-31T02:02:20.922 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:20.961 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:20.964 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-joblib. 2024-08-31T02:02:20.987 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-sklearn. 2024-08-31T02:02:20.991 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-31T02:02:21.017 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-31T02:02:21.030 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T02:02:21.297 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-repoze.lru. 2024-08-31T02:02:21.325 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-08-31T02:02:21.364 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-08-31T02:02:21.366 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T02:02:21.426 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-31T02:02:21.453 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-31T02:02:21.492 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-31T02:02:21.667 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-routes. 2024-08-31T02:02:21.694 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-08-31T02:02:21.733 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T02:02:21.787 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-sklearn. 2024-08-31T02:02:21.814 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-31T02:02:21.853 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T02:02:22.104 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-31T02:02:22.120 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-08-31T02:02:22.131 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:22.148 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:22.195 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-dashboard (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:22.264 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:22.586 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-31T02:02:22.614 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:22.746 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:23.259 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cachetools. 2024-08-31T02:02:23.286 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-08-31T02:02:23.325 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-31T02:02:23.425 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-08-31T02:02:23.441 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-08-31T02:02:23.475 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T02:02:23.612 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-31T02:02:23.639 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-31T02:02:23.670 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-31T02:02:23.784 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cachetools. 2024-08-31T02:02:23.811 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-08-31T02:02:23.841 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-31T02:02:23.948 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-31T02:02:23.970 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-joblib. 2024-08-31T02:02:23.976 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-31T02:02:23.997 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-08-31T02:02:24.014 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T02:02:24.036 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T02:02:24.144 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-31T02:02:24.171 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-31T02:02:24.210 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-31T02:02:24.284 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rsa. 2024-08-31T02:02:24.311 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-08-31T02:02:24.350 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-31T02:02:24.398 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-08-31T02:02:24.426 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-08-31T02:02:24.465 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-08-31T02:02:24.522 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-31T02:02:24.549 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-31T02:02:24.589 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T02:02:24.679 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-google-auth. 2024-08-31T02:02:24.706 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-08-31T02:02:24.745 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-31T02:02:24.768 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-sklearn. 2024-08-31T02:02:24.795 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-08-31T02:02:24.834 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T02:02:24.909 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rsa. 2024-08-31T02:02:24.936 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-08-31T02:02:24.975 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-31T02:02:25.065 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-31T02:02:25.092 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-31T02:02:25.131 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T02:02:25.400 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-google-auth. 2024-08-31T02:02:25.417 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-websocket. 2024-08-31T02:02:25.428 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-08-31T02:02:25.445 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-08-31T02:02:25.476 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-31T02:02:25.528 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-31T02:02:25.576 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-08-31T02:02:25.604 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:25.736 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:25.821 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-31T02:02:25.848 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-31T02:02:25.873 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-31T02:02:25.887 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T02:02:25.900 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-31T02:02:25.939 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T02:02:26.259 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-websocket. 2024-08-31T02:02:26.286 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-08-31T02:02:26.325 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-31T02:02:26.509 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-31T02:02:26.525 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:26.567 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:26.603 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-31T02:02:26.619 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-31T02:02:26.653 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T02:02:26.707 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-cachetools. 2024-08-31T02:02:26.736 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-08-31T02:02:26.773 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-08-31T02:02:26.887 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-31T02:02:26.914 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-31T02:02:26.953 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T02:02:27.243 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1. 2024-08-31T02:02:27.256 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-31T02:02:27.271 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-08-31T02:02:27.284 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T02:02:27.310 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-08-31T02:02:27.314 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T02:02:27.334 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-31T02:02:27.362 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:27.400 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:27.541 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package jq. 2024-08-31T02:02:27.569 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T02:02:27.608 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-31T02:02:27.630 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-08-31T02:02:27.657 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-08-31T02:02:27.696 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T02:02:27.728 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-31T02:02:27.756 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-31T02:02:27.794 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T02:02:27.843 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package socat. 2024-08-31T02:02:27.860 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-31T02:02:27.902 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-31T02:02:28.017 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-rsa. 2024-08-31T02:02:28.044 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-08-31T02:02:28.082 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-rsa (4.8-1) ... 2024-08-31T02:02:28.131 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-31T02:02:28.158 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T02:02:28.197 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T02:02:28.205 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package xmlstarlet. 2024-08-31T02:02:28.221 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-31T02:02:28.263 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-31T02:02:28.403 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-google-auth. 2024-08-31T02:02:28.431 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-08-31T02:02:28.433 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package jq. 2024-08-31T02:02:28.449 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T02:02:28.469 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-08-31T02:02:28.483 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-31T02:02:28.617 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-test. 2024-08-31T02:02:28.701 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../097-ceph-test_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:28.701 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-test (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:28.702 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package socat. 2024-08-31T02:02:28.729 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-31T02:02:28.769 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-31T02:02:28.798 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-08-31T02:02:28.825 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-08-31T02:02:28.873 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T02:02:29.072 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package xmlstarlet. 2024-08-31T02:02:29.099 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-31T02:02:29.163 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-31T02:02:29.184 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-websocket. 2024-08-31T02:02:29.212 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-08-31T02:02:29.250 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-08-31T02:02:29.534 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-test. 2024-08-31T02:02:29.550 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../097-ceph-test_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:29.562 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-kubernetes. 2024-08-31T02:02:29.590 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-08-31T02:02:29.592 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-test (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:29.629 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T02:02:30.277 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-08-31T02:02:30.304 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:30.334 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:30.654 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libonig5:amd64. 2024-08-31T02:02:30.681 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-08-31T02:02:30.720 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T02:02:30.988 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-volume. 2024-08-31T02:02:31.004 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:31.037 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-volume (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:31.065 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libjq1:amd64. 2024-08-31T02:02:31.094 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T02:02:31.132 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T02:02:31.333 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-31T02:02:31.349 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:31.376 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package jq. 2024-08-31T02:02:31.382 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs-dev (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:31.393 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-08-31T02:02:31.426 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-08-31T02:02:31.660 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-31T02:02:31.676 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-31T02:02:31.679 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package socat. 2024-08-31T02:02:31.696 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-08-31T02:02:31.710 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T02:02:31.737 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-08-31T02:02:32.155 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-volume. 2024-08-31T02:02:32.183 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:32.190 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package xmlstarlet. 2024-08-31T02:02:32.219 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-08-31T02:02:32.221 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-volume (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:32.257 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-08-31T02:02:32.281 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-31T02:02:32.309 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-08-31T02:02:32.347 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-31T02:02:32.558 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-31T02:02:32.575 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:32.616 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libcephfs-dev (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:32.727 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package nvme-cli. 2024-08-31T02:02:32.754 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-31T02:02:32.770 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-test. 2024-08-31T02:02:32.793 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T02:02:32.798 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../097-ceph-test_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:32.836 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-test (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:32.936 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-31T02:02:32.964 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-31T02:02:33.002 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T02:02:33.206 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package pkg-config. 2024-08-31T02:02:33.233 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-31T02:02:33.272 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T02:02:33.323 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-31T02:02:33.351 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-08-31T02:02:33.390 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-31T02:02:33.509 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-31T02:02:33.524 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-31T02:02:33.558 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-31T02:02:33.719 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package nvme-cli. 2024-08-31T02:02:33.746 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-31T02:02:33.777 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T02:02:33.945 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-31T02:02:33.973 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-31T02:02:34.003 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-31T02:02:34.190 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package pkg-config. 2024-08-31T02:02:34.218 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-31T02:02:34.248 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T02:02:34.273 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pastescript. 2024-08-31T02:02:34.300 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-31T02:02:34.364 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-31T02:02:34.501 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-31T02:02:34.517 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-31T02:02:34.559 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-31T02:02:34.684 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pluggy. 2024-08-31T02:02:34.711 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-31T02:02:34.750 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-31T02:02:34.937 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-31T02:02:34.962 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-31T02:02:35.004 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-31T02:02:35.070 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-psutil. 2024-08-31T02:02:35.074 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package ceph-volume. 2024-08-31T02:02:35.097 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-31T02:02:35.102 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-240-g34b9d27b-1jammy_all.deb ... 2024-08-31T02:02:35.144 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-31T02:02:35.149 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking ceph-volume (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:35.264 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pastescript. 2024-08-31T02:02:35.280 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-31T02:02:35.324 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-31T02:02:35.444 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package libcephfs-dev. 2024-08-31T02:02:35.461 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:35.481 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-py. 2024-08-31T02:02:35.494 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking libcephfs-dev (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:35.508 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-08-31T02:02:35.547 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-31T02:02:35.626 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pluggy. 2024-08-31T02:02:35.654 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-31T02:02:35.692 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-31T02:02:35.780 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package lua-socket:amd64. 2024-08-31T02:02:35.792 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pygments. 2024-08-31T02:02:35.808 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-08-31T02:02:35.819 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-31T02:02:35.847 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T02:02:35.850 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T02:02:36.029 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-psutil. 2024-08-31T02:02:36.056 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-31T02:02:36.095 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-31T02:02:36.177 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package lua-sec:amd64. 2024-08-31T02:02:36.205 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-08-31T02:02:36.243 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-08-31T02:02:36.329 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-31T02:02:36.357 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-31T02:02:36.395 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-31T02:02:36.414 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-py. 2024-08-31T02:02:36.442 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-08-31T02:02:36.481 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-31T02:02:36.614 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package nvme-cli. 2024-08-31T02:02:36.642 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-08-31T02:02:36.680 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T02:02:36.785 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pygments. 2024-08-31T02:02:36.812 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-31T02:02:36.851 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T02:02:36.940 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-toml. 2024-08-31T02:02:36.968 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-08-31T02:02:37.031 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-31T02:02:37.111 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package pkg-config. 2024-08-31T02:02:37.139 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-08-31T02:02:37.177 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T02:02:37.254 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-31T02:02:37.271 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-31T02:02:37.304 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-31T02:02:37.334 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pytest. 2024-08-31T02:02:37.362 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-31T02:02:37.400 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T02:02:37.405 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-08-31T02:02:37.421 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-08-31T02:02:37.454 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-08-31T02:02:37.599 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-toml. 2024-08-31T02:02:37.626 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-08-31T02:02:37.665 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-31T02:02:37.729 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-simplejson. 2024-08-31T02:02:37.757 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-31T02:02:37.795 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-31T02:02:37.858 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-iniconfig. 2024-08-31T02:02:37.874 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-08-31T02:02:37.908 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-08-31T02:02:37.960 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pytest. 2024-08-31T02:02:37.988 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-31T02:02:38.026 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T02:02:38.031 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-31T02:02:38.048 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-31T02:02:38.081 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-31T02:02:38.194 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pastescript. 2024-08-31T02:02:38.222 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-08-31T02:02:38.260 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-08-31T02:02:38.338 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-simplejson. 2024-08-31T02:02:38.366 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-31T02:02:38.404 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-31T02:02:38.581 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pluggy. 2024-08-31T02:02:38.608 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-08-31T02:02:38.647 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-08-31T02:02:38.657 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-31T02:02:38.684 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-31T02:02:38.723 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-31T02:02:38.768 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package radosgw. 2024-08-31T02:02:38.795 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../116-radosgw_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:38.826 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking radosgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:38.967 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-psutil. 2024-08-31T02:02:38.995 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-08-31T02:02:39.033 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-08-31T02:02:39.370 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-py. 2024-08-31T02:02:39.397 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-08-31T02:02:39.444 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-py (1.10.0-1) ... 2024-08-31T02:02:39.477 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package radosgw. 2024-08-31T02:02:39.505 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../116-radosgw_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:39.543 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking radosgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:39.629 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package rbd-fuse. 2024-08-31T02:02:39.645 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:39.687 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking rbd-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:39.781 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pygments. 2024-08-31T02:02:39.809 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-08-31T02:02:39.847 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T02:02:39.992 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-31T02:02:40.242 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T02:02:40.320 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pyinotify. 2024-08-31T02:02:40.338 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package rbd-fuse. 2024-08-31T02:02:40.348 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-08-31T02:02:40.354 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:40.368 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T02:02:40.387 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-08-31T02:02:40.396 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking rbd-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:40.619 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-31T02:02:40.706 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-toml. 2024-08-31T02:02:40.709 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-31T02:02:40.734 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-08-31T02:02:40.773 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-08-31T02:02:40.958 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-31T02:02:41.076 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-pytest. 2024-08-31T02:02:41.103 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-08-31T02:02:41.142 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T02:02:41.185 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T02:02:41.302 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T02:02:41.379 INFO:teuthology.orchestra.run.smithi163.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-31T02:02:41.436 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:41.488 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package python3-simplejson. 2024-08-31T02:02:41.515 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-08-31T02:02:41.538 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-31T02:02:41.553 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-08-31T02:02:41.832 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-08-31T02:02:41.860 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-08-31T02:02:41.888 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-31T02:02:41.898 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-08-31T02:02:41.944 INFO:teuthology.orchestra.run.smithi163.stdout:Adding system user cephadm....done 2024-08-31T02:02:42.083 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T02:02:42.309 INFO:teuthology.orchestra.run.smithi191.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-31T02:02:42.376 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-31T02:02:42.387 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:42.602 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package radosgw. 2024-08-31T02:02:42.628 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-31T02:02:42.631 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../116-radosgw_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:42.668 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking radosgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:42.729 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-31T02:02:42.937 INFO:teuthology.orchestra.run.smithi191.stdout:Adding system user cephadm....done 2024-08-31T02:02:42.963 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-31T02:02:43.093 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T02:02:43.247 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T02:02:43.374 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-31T02:02:43.394 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-31T02:02:43.522 INFO:teuthology.orchestra.run.smithi027.stdout:Selecting previously unselected package rbd-fuse. 2024-08-31T02:02:43.538 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-240-g34b9d27b-1jammy_amd64.deb ... 2024-08-31T02:02:43.580 INFO:teuthology.orchestra.run.smithi027.stdout:Unpacking rbd-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:43.637 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-31T02:02:43.692 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T02:02:43.746 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-31T02:02:43.910 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-08-31T02:02:43.997 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-31T02:02:44.060 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-31T02:02:44.169 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-08-31T02:02:44.286 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-08-31T02:02:44.312 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-31T02:02:44.319 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T02:02:44.491 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-31T02:02:44.563 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-31T02:02:44.563 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-08-31T02:02:44.785 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T02:02:44.823 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-31T02:02:44.877 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-08-31T02:02:45.082 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-31T02:02:45.153 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-31T02:02:45.320 INFO:teuthology.orchestra.run.smithi027.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-08-31T02:02:45.358 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-31T02:02:45.388 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-31T02:02:45.397 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:45.609 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-ceph-argparse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:45.647 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-31T02:02:45.940 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-31T02:02:45.965 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T02:02:46.169 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T02:02:46.192 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-31T02:02:46.230 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user cephadm....done 2024-08-31T02:02:46.270 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T02:02:46.379 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-08-31T02:02:46.379 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-31T02:02:46.459 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-31T02:02:46.630 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-31T02:02:46.655 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-08-31T02:02:46.727 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-ceph-argparse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:46.906 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-08-31T02:02:46.986 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T02:02:47.023 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-31T02:02:47.032 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-08-31T02:02:47.044 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-31T02:02:47.108 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T02:02:47.112 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T02:02:47.226 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-31T02:02:47.238 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T02:02:47.291 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-08-31T02:02:47.364 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-31T02:02:47.552 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-08-31T02:02:47.585 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:47.623 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-31T02:02:47.653 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-py (1.10.0-1) ... 2024-08-31T02:02:47.695 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-31T02:02:47.946 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T02:02:47.954 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-08-31T02:02:48.002 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-31T02:02:48.029 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-31T02:02:48.101 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T02:02:48.222 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-31T02:02:48.227 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-31T02:02:48.315 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-08-31T02:02:48.540 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up zip (3.0-12build2) ... 2024-08-31T02:02:48.570 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:48.574 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-08-31T02:02:48.665 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T02:02:48.679 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-31T02:02:48.842 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-08-31T02:02:48.930 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T02:02:49.061 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-08-31T02:02:49.190 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-31T02:02:49.303 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-08-31T02:02:49.367 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T02:02:49.508 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up zip (3.0-12build2) ... 2024-08-31T02:02:49.562 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-08-31T02:02:49.626 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T02:02:49.634 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T02:02:49.728 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-31T02:02:49.838 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-argparse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:49.845 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T02:02:50.115 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-08-31T02:02:50.138 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-31T02:02:50.241 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-08-31T02:02:50.294 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T02:02:50.367 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-08-31T02:02:50.501 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-08-31T02:02:50.539 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-31T02:02:50.545 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T02:02:50.646 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-31T02:02:50.744 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-08-31T02:02:50.747 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T02:02:50.790 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T02:02:51.039 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-31T02:02:51.119 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-08-31T02:02:51.151 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-08-31T02:02:51.183 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T02:02:51.214 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-08-31T02:02:51.340 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-08-31T02:02:51.415 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-31T02:02:51.476 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T02:02:51.658 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T02:02:51.708 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:51.811 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-31T02:02:51.833 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-08-31T02:02:52.026 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T02:02:52.045 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-31T02:02:52.118 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-08-31T02:02:52.154 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:52.311 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T02:02:52.386 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-08-31T02:02:52.564 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T02:02:52.654 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-31T02:02:52.687 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up zip (3.0-12build2) ... 2024-08-31T02:02:52.813 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-08-31T02:02:52.890 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T02:02:52.913 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-31T02:02:53.039 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:53.340 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T02:02:53.549 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-08-31T02:02:53.642 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T02:02:53.808 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-08-31T02:02:53.934 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-08-31T02:02:54.043 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-08-31T02:02:54.053 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T02:02:54.288 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:02:54.336 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-08-31T02:02:54.422 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-31T02:02:54.690 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T02:02:54.721 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-08-31T02:02:54.763 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T02:02:54.816 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-31T02:02:54.942 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T02:02:54.971 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-08-31T02:02:55.007 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:02:55.124 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-31T02:02:55.268 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-31T02:02:55.357 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-08-31T02:02:55.400 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T02:02:55.526 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-31T02:02:55.528 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-31T02:02:55.652 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T02:02:55.666 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-08-31T02:02:55.770 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:02:55.880 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-31T02:02:55.954 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-31T02:02:56.018 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-08-31T02:02:56.181 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-31T02:02:56.205 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-31T02:02:56.252 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-08-31T02:02:56.362 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:02:56.432 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-31T02:02:56.464 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:02:56.598 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-31T02:02:56.671 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-08-31T02:02:56.691 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-31T02:02:56.900 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-31T02:02:56.950 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-31T02:02:56.997 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-08-31T02:02:57.168 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-31T02:02:57.193 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-31T02:02:57.435 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-31T02:02:57.453 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T02:02:57.579 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-31T02:02:57.695 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-31T02:02:57.854 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T02:02:57.945 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-31T02:02:57.980 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T02:02:58.213 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T02:02:58.228 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-08-31T02:02:58.282 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-31T02:02:58.339 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-31T02:02:58.480 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:02:58.582 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-31T02:02:58.614 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-toml (0.10.2-1) ... 2024-08-31T02:02:58.615 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T02:02:58.716 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T02:02:58.833 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T02:02:58.890 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-08-31T02:02:58.959 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-31T02:02:59.001 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-31T02:02:59.016 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-08-31T02:02:59.086 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:59.142 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-08-31T02:02:59.157 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-31T02:02:59.327 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-31T02:02:59.404 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T02:02:59.435 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-08-31T02:02:59.530 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T02:02:59.577 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T02:02:59.678 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-08-31T02:02:59.704 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-31T02:02:59.830 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T02:02:59.906 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-31T02:02:59.918 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-31T02:02:59.929 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:03:00.055 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-08-31T02:03:00.157 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-31T02:03:00.164 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T02:03:00.283 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-31T02:03:00.290 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T02:03:00.381 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-08-31T02:03:00.550 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:03:00.641 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-08-31T02:03:00.659 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-31T02:03:00.676 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T02:03:00.909 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-08-31T02:03:00.918 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-31T02:03:01.003 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T02:03:01.044 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-31T02:03:01.152 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-08-31T02:03:01.295 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:03:01.295 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T02:03:01.394 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-08-31T02:03:01.421 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T02:03:01.563 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-31T02:03:01.670 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-08-31T02:03:01.689 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-31T02:03:01.747 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T02:03:01.796 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-08-31T02:03:01.957 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-31T02:03:02.056 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T02:03:02.089 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-08-31T02:03:02.215 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-08-31T02:03:02.224 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T02:03:02.316 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-31T02:03:02.467 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-31T02:03:02.516 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-08-31T02:03:02.561 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-31T02:03:02.735 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-31T02:03:02.842 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-08-31T02:03:02.929 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-31T02:03:03.002 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T02:03:03.085 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-08-31T02:03:03.195 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-08-31T02:03:03.214 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T02:03:03.364 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-31T02:03:03.549 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T02:03:03.622 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-08-31T02:03:03.675 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librados2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:03.749 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-31T02:03:03.801 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libsqlite3-mod-ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:03.802 INFO:teuthology.orchestra.run.smithi027.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-08-31T02:03:03.921 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-31T02:03:04.017 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T02:03:04.056 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-08-31T02:03:04.182 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-08-31T02:03:04.258 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:04.353 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T02:03:04.384 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libradosstriper1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:04.479 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librados2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:04.510 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-31T02:03:04.583 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-08-31T02:03:04.605 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libsqlite3-mod-ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:04.731 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-31T02:03:04.778 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librbd1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:04.835 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up lua-any (27ubuntu1) ... 2024-08-31T02:03:04.930 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-modules-core (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:04.936 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-portend (3.0.0-1) ... 2024-08-31T02:03:05.034 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libcephfs2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:05.056 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:05.159 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libradosstriper1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:05.178 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-08-31T02:03:05.264 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T02:03:05.264 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T02:03:05.294 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-31T02:03:05.304 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-08-31T02:03:05.595 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librbd1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:05.630 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-08-31T02:03:05.716 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs-dev (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:05.721 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-modules-core (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:05.825 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rados (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:05.864 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:05.931 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-08-31T02:03:05.934 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librgw2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:06.044 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T02:03:06.075 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T02:03:06.076 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T02:03:06.208 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-08-31T02:03:06.334 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rsa (4.8-1) ... 2024-08-31T02:03:06.548 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libcephfs-dev (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:06.593 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-08-31T02:03:06.676 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rados (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:06.819 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librgw2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:06.853 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-08-31T02:03:06.945 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T02:03:07.206 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-08-31T02:03:07.265 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rbd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:07.391 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up rbd-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:07.517 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:07.591 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-08-31T02:03:07.668 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cephfs (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:07.786 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:07.909 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-08-31T02:03:08.098 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rbd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:08.233 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up rbd-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:08.245 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-08-31T02:03:08.304 INFO:teuthology.orchestra.run.smithi163.stdout:Adding group ceph....done 2024-08-31T02:03:08.333 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:08.371 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librados2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:08.460 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cephfs (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:08.523 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libsqlite3-mod-ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:08.586 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:08.606 INFO:teuthology.orchestra.run.smithi163.stdout:Adding system user ceph....done 2024-08-31T02:03:08.648 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-08-31T02:03:08.783 INFO:teuthology.orchestra.run.smithi163.stdout:Setting system user ceph properties....done 2024-08-31T02:03:08.803 INFO:teuthology.orchestra.run.smithi163.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-31T02:03:08.938 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-31T02:03:08.969 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:09.069 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libradosstriper1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:09.153 INFO:teuthology.orchestra.run.smithi191.stdout:Adding group ceph....done 2024-08-31T02:03:09.187 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-08-31T02:03:09.248 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-31T02:03:09.464 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librbd1 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:09.496 INFO:teuthology.orchestra.run.smithi191.stdout:Adding system user ceph....done 2024-08-31T02:03:09.590 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-modules-core (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:09.664 INFO:teuthology.orchestra.run.smithi191.stdout:Setting system user ceph properties....done 2024-08-31T02:03:09.679 INFO:teuthology.orchestra.run.smithi191.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-31T02:03:09.705 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-test (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:09.716 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:09.817 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-31T02:03:09.857 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up radosgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:09.935 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T02:03:09.935 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-08-31T02:03:10.169 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-31T02:03:10.325 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T02:03:10.325 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T02:03:10.450 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up libcephfs-dev (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:10.559 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rados (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:10.636 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-test (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:10.661 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up librgw2 (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:10.762 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up radosgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:10.770 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-08-31T02:03:10.821 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-base (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:11.227 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T02:03:11.228 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T02:03:11.294 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-31T02:03:11.738 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mds (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:11.950 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T02:03:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T02:03:11.982 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rbd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:11.988 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-base (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:12.108 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up rbd-fuse (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:12.226 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-rgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:12.327 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up python3-cephfs (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:12.428 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-common (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:12.440 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:12.465 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-31T02:03:12.703 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T02:03:12.703 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T02:03:12.924 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mds (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:12.996 INFO:teuthology.orchestra.run.smithi027.stdout:Adding group ceph....done 2024-08-31T02:03:13.158 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T02:03:13.158 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T02:03:13.242 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-osd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:13.331 INFO:teuthology.orchestra.run.smithi027.stdout:Adding system user ceph....done 2024-08-31T02:03:13.440 INFO:teuthology.orchestra.run.smithi027.stdout:Setting system user ceph properties....done 2024-08-31T02:03:13.456 INFO:teuthology.orchestra.run.smithi027.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-08-31T02:03:13.508 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T02:03:13.509 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T02:03:13.601 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:13.609 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-08-31T02:03:13.823 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T02:03:13.823 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T02:03:13.936 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-08-31T02:03:14.027 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-k8sevents (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:14.153 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:14.285 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-osd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:14.305 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mon (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:14.388 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-test (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:14.508 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T02:03:14.508 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T02:03:14.514 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up radosgw (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:14.569 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T02:03:14.569 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T02:03:14.947 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:14.996 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T02:03:14.996 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-08-31T02:03:15.062 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-k8sevents (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:15.074 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:15.163 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:15.200 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-dashboard (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:15.288 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mon (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:15.351 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-volume (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:15.441 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-base (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:15.485 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T02:03:15.485 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T02:03:15.704 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T02:03:15.828 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-08-31T02:03:15.830 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T02:03:15.973 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:15.983 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T02:03:16.099 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:16.233 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-dashboard (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:16.309 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mds (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:16.384 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-volume (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:16.550 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T02:03:16.550 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-08-31T02:03:16.742 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T02:03:16.746 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T02:03:16.855 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T02:03:17.007 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T02:03:17.036 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:17.239 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T02:03:17.239 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-08-31T02:03:17.379 INFO:teuthology.orchestra.run.smithi163.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T02:03:17.386 DEBUG:teuthology.parallel:result is None 2024-08-31T02:03:17.729 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-osd (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:17.993 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T02:03:17.993 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-08-31T02:03:18.308 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T02:03:18.472 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-k8sevents (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:18.598 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mon (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:18.956 INFO:teuthology.orchestra.run.smithi191.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T02:03:18.961 DEBUG:teuthology.parallel:result is None 2024-08-31T02:03:18.971 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T02:03:18.972 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-08-31T02:03:19.468 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-cephadm (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:19.594 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:19.695 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-mgr-dashboard (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:19.838 INFO:teuthology.orchestra.run.smithi027.stdout:Setting up ceph-volume (19.1.1-240-g34b9d27b-1jammy) ... 2024-08-31T02:03:20.216 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-08-31T02:03:20.325 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-08-31T02:03:20.644 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-08-31T02:03:21.820 INFO:teuthology.orchestra.run.smithi027.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-08-31T02:03:22.472 INFO:teuthology.orchestra.run.smithi027.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-08-31T02:03:22.477 DEBUG:teuthology.parallel:result is None 2024-08-31T02:03:22.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:03:22.634 DEBUG:teuthology.orchestra.run.smithi027:> dpkg-query -W -f '${Version}' ceph 2024-08-31T02:03:22.653 INFO:teuthology.orchestra.run.smithi027.stdout:19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:03:22.654 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:03:22.654 INFO:teuthology.task.install:The correct ceph version 19.1.1-240-g34b9d27b-1jammy is installed. 2024-08-31T02:03:22.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:03:22.797 DEBUG:teuthology.orchestra.run.smithi163:> dpkg-query -W -f '${Version}' ceph 2024-08-31T02:03:22.816 INFO:teuthology.orchestra.run.smithi163.stdout:19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:03:22.817 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:03:22.817 INFO:teuthology.task.install:The correct ceph version 19.1.1-240-g34b9d27b-1jammy is installed. 2024-08-31T02:03:22.819 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:03:22.959 DEBUG:teuthology.orchestra.run.smithi191:> dpkg-query -W -f '${Version}' ceph 2024-08-31T02:03:22.978 INFO:teuthology.orchestra.run.smithi191.stdout:19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:03:22.978 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-240-g34b9d27b-1jammy 2024-08-31T02:03:22.978 INFO:teuthology.task.install:The correct ceph version 19.1.1-240-g34b9d27b-1jammy is installed. 2024-08-31T02:03:22.980 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-31T02:03:22.980 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:03:22.980 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T02:03:22.995 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T02:03:22.995 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T02:03:23.009 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T02:03:23.009 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T02:03:23.033 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-31T02:03:23.033 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:03:23.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T02:03:23.050 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T02:03:23.106 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T02:03:23.106 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T02:03:23.120 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T02:03:23.173 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T02:03:23.174 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T02:03:23.187 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T02:03:23.241 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-31T02:03:23.241 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:03:23.241 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T02:03:23.255 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T02:03:23.310 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T02:03:23.310 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T02:03:23.323 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T02:03:23.378 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T02:03:23.378 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T02:03:23.392 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T02:03:23.447 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-31T02:03:23.447 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:03:23.447 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T02:03:23.461 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T02:03:23.517 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T02:03:23.518 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T02:03:23.531 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T02:03:23.585 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T02:03:23.586 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T02:03:23.599 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T02:03:23.656 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-31T02:03:23.746 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': False}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'MON_DOWN', 'mons down', 'mon down', 'out of quorum'], 'log-only-match': ['CEPHADM_'], 'sha1': '34b9d27bc925f169ace27b9f1f204536aa49fc0b'} 2024-08-31T02:03:23.747 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:03:23.747 INFO:tasks.cephadm:Cluster fsid is 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:03:23.747 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-31T02:03:23.747 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.27', 'mon.b': '172.21.15.163', 'mon.c': '172.21.15.191'} 2024-08-31T02:03:23.747 INFO:tasks.cephadm:First mon is mon.a on smithi027 2024-08-31T02:03:23.747 INFO:tasks.cephadm:First mgr is a 2024-08-31T02:03:23.748 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-31T02:03:23.748 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname $(hostname -s) 2024-08-31T02:03:23.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname $(hostname -s) 2024-08-31T02:03:23.776 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname $(hostname -s) 2024-08-31T02:03:23.791 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-31T02:03:23.792 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:03:23.930 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '34b9d27bc925f169ace27b9f1f204536aa49fc0b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/55958/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-240-g34b9d27b', 'node_name': '172.21.2.17+braggi17', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-240-g34b9d27b-1jammy'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-08-29 21:35:00.873227', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}, {'status': 'ready', 'sha1': '34b9d27bc925f169ace27b9f1f204536aa49fc0b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/55953/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-240-g34b9d27b', 'node_name': '172.21.2.9+braggi09', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-240-g34b9d27b-1jammy'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-08-29 20:29:26.825547', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-08-31T02:03:24.067 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 34b9d27bc925f169ace27b9f1f204536aa49fc0b from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:03:24.069 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-08-31T02:03:24.069 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-08-31T02:03:24.069 DEBUG:teuthology.orchestra.run.smithi027:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T02:03:24.577 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791837 Aug 31 02:03 /home/ubuntu/cephtest/cephadm 2024-08-31T02:03:24.578 DEBUG:teuthology.orchestra.run.smithi163:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T02:03:25.012 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791837 Aug 31 02:03 /home/ubuntu/cephtest/cephadm 2024-08-31T02:03:25.012 DEBUG:teuthology.orchestra.run.smithi191:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/34b9d27bc925f169ace27b9f1f204536aa49fc0b/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T02:03:25.474 INFO:teuthology.orchestra.run.smithi191.stdout:-rw-rw-r-- 1 ubuntu ubuntu 791837 Aug 31 02:03 /home/ubuntu/cephtest/cephadm 2024-08-31T02:03:25.474 DEBUG:teuthology.orchestra.run.smithi027:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T02:03:25.483 DEBUG:teuthology.orchestra.run.smithi163:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T02:03:25.490 DEBUG:teuthology.orchestra.run.smithi191:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T02:03:25.507 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b on all hosts... 2024-08-31T02:03:25.507 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b pull 2024-08-31T02:03:25.527 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b pull 2024-08-31T02:03:25.536 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b pull 2024-08-31T02:03:25.714 INFO:teuthology.orchestra.run.smithi027.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b... 2024-08-31T02:03:25.717 INFO:teuthology.orchestra.run.smithi163.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b... 2024-08-31T02:03:25.723 INFO:teuthology.orchestra.run.smithi191.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b... 2024-08-31T02:04:23.380 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-08-31T02:04:23.380 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 19.1.1-240-g34b9d27b (34b9d27bc925f169ace27b9f1f204536aa49fc0b) squid (rc)", 2024-08-31T02:04:23.380 INFO:teuthology.orchestra.run.smithi191.stdout: "image_id": "72d622302cc2dfd9a14fce59282763f83eedbe02409f698c76a88e3ae2f36da3", 2024-08-31T02:04:23.381 INFO:teuthology.orchestra.run.smithi191.stdout: "repo_digests": [ 2024-08-31T02:04:23.381 INFO:teuthology.orchestra.run.smithi191.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:8b075137a5ab0999d974fdcffab872d229d50e3354e13aec412ebf6380176769" 2024-08-31T02:04:23.381 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-08-31T02:04:23.381 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-08-31T02:04:44.856 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2024-08-31T02:04:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_version": "ceph version 19.1.1-240-g34b9d27b (34b9d27bc925f169ace27b9f1f204536aa49fc0b) squid (rc)", 2024-08-31T02:04:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "image_id": "72d622302cc2dfd9a14fce59282763f83eedbe02409f698c76a88e3ae2f36da3", 2024-08-31T02:04:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "repo_digests": [ 2024-08-31T02:04:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:8b075137a5ab0999d974fdcffab872d229d50e3354e13aec412ebf6380176769" 2024-08-31T02:04:44.857 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2024-08-31T02:04:44.857 INFO:teuthology.orchestra.run.smithi163.stdout:} 2024-08-31T02:04:47.684 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-08-31T02:04:47.684 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 19.1.1-240-g34b9d27b (34b9d27bc925f169ace27b9f1f204536aa49fc0b) squid (rc)", 2024-08-31T02:04:47.684 INFO:teuthology.orchestra.run.smithi027.stdout: "image_id": "72d622302cc2dfd9a14fce59282763f83eedbe02409f698c76a88e3ae2f36da3", 2024-08-31T02:04:47.684 INFO:teuthology.orchestra.run.smithi027.stdout: "repo_digests": [ 2024-08-31T02:04:47.684 INFO:teuthology.orchestra.run.smithi027.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:8b075137a5ab0999d974fdcffab872d229d50e3354e13aec412ebf6380176769" 2024-08-31T02:04:47.685 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-08-31T02:04:47.685 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-08-31T02:04:47.734 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph 2024-08-31T02:04:47.749 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph 2024-08-31T02:04:47.765 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph 2024-08-31T02:04:47.780 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /etc/ceph 2024-08-31T02:04:47.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /etc/ceph 2024-08-31T02:04:47.825 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /etc/ceph 2024-08-31T02:04:47.841 INFO:tasks.cephadm:Writing seed config... 2024-08-31T02:04:47.843 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-08-31T02:04:47.843 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-31T02:04:47.843 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-31T02:04:47.843 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = False 2024-08-31T02:04:47.843 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-31T02:04:47.843 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-31T02:04:47.843 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-31T02:04:47.844 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-31T02:04:47.844 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-31T02:04:47.844 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:04:47.845 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-31T02:04:47.859 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3427ee8e-673d-11ef-bcd4-c7b262605968 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = False [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-08-31T02:04:47.859 DEBUG:teuthology.orchestra.run.smithi027:mon.a> sudo journalctl -f -n 0 -u ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mon.a.service 2024-08-31T02:04:47.908 DEBUG:teuthology.orchestra.run.smithi027:mgr.a> sudo journalctl -f -n 0 -u ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mgr.a.service 2024-08-31T02:04:47.958 INFO:tasks.cephadm:Bootstrapping... 2024-08-31T02:04:47.959 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b -v bootstrap --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.27 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-31T02:04:48.191 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-08-31T02:04:48.191 INFO:teuthology.orchestra.run.smithi027.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b', '-v', 'bootstrap', '--fsid', '3427ee8e-673d-11ef-bcd4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.27', '--skip-admin-label'] 2024-08-31T02:04:48.191 INFO:teuthology.orchestra.run.smithi027.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-31T02:04:48.192 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying podman|docker is present... 2024-08-31T02:04:48.192 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying lvm2 is present... 2024-08-31T02:04:48.192 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying time synchronization is in place... 2024-08-31T02:04:48.197 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T02:04:48.197 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T02:04:48.201 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T02:04:48.201 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-08-31T02:04:48.205 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-08-31T02:04:48.205 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-08-31T02:04:48.209 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-08-31T02:04:48.209 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-08-31T02:04:48.213 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-08-31T02:04:48.213 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout masked 2024-08-31T02:04:48.217 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-08-31T02:04:48.217 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-08-31T02:04:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-08-31T02:04:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-08-31T02:04:48.224 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-08-31T02:04:48.224 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-08-31T02:04:48.228 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout enabled 2024-08-31T02:04:48.232 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout active 2024-08-31T02:04:48.232 INFO:teuthology.orchestra.run.smithi027.stdout:Unit ntp.service is enabled and running 2024-08-31T02:04:48.233 INFO:teuthology.orchestra.run.smithi027.stdout:Repeating the final host check... 2024-08-31T02:04:48.233 INFO:teuthology.orchestra.run.smithi027.stdout:docker (/usr/bin/docker) is present 2024-08-31T02:04:48.233 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl is present 2024-08-31T02:04:48.233 INFO:teuthology.orchestra.run.smithi027.stdout:lvcreate is present 2024-08-31T02:04:48.236 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T02:04:48.236 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T02:04:48.240 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T02:04:48.240 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-08-31T02:04:48.243 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-08-31T02:04:48.244 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-08-31T02:04:48.247 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-08-31T02:04:48.247 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-08-31T02:04:48.251 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-08-31T02:04:48.251 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout masked 2024-08-31T02:04:48.255 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-08-31T02:04:48.255 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-08-31T02:04:48.258 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-08-31T02:04:48.259 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-08-31T02:04:48.262 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-08-31T02:04:48.262 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-08-31T02:04:48.266 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout enabled 2024-08-31T02:04:48.270 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout active 2024-08-31T02:04:48.271 INFO:teuthology.orchestra.run.smithi027.stdout:Unit ntp.service is enabled and running 2024-08-31T02:04:48.271 INFO:teuthology.orchestra.run.smithi027.stdout:Host looks OK 2024-08-31T02:04:48.271 INFO:teuthology.orchestra.run.smithi027.stdout:Cluster fsid: 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:04:48.271 INFO:teuthology.orchestra.run.smithi027.stdout:Acquiring lock 140479385484112 on /run/cephadm/3427ee8e-673d-11ef-bcd4-c7b262605968.lock 2024-08-31T02:04:48.271 INFO:teuthology.orchestra.run.smithi027.stdout:Lock 140479385484112 acquired on /run/cephadm/3427ee8e-673d-11ef-bcd4-c7b262605968.lock 2024-08-31T02:04:48.271 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying IP 172.21.15.27 port 3300 ... 2024-08-31T02:04:48.271 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying IP 172.21.15.27 port 6789 ... 2024-08-31T02:04:48.271 INFO:teuthology.orchestra.run.smithi027.stdout:Base mon IP(s) is [172.21.15.27:3300, 172.21.15.27:6789], mon addrv is [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-08-31T02:04:48.273 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 2024-08-31T02:04:48.273 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-08-31T02:04:48.273 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.27 2024-08-31T02:04:48.275 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-31T02:04:48.276 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-08-31T02:04:48.276 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2024-08-31T02:04:48.277 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-31T02:04:48.278 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-31T02:04:48.278 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T02:04:48.278 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-31T02:04:48.278 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2024-08-31T02:04:48.278 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T02:04:48.279 INFO:teuthology.orchestra.run.smithi027.stdout:Mon IP `172.21.15.27` is in CIDR network `172.21.0.0/20` 2024-08-31T02:04:48.279 INFO:teuthology.orchestra.run.smithi027.stdout:Mon IP `172.21.15.27` is in CIDR network `172.21.0.0/20` 2024-08-31T02:04:48.279 INFO:teuthology.orchestra.run.smithi027.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-31T02:04:48.279 INFO:teuthology.orchestra.run.smithi027.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-31T02:04:48.279 INFO:teuthology.orchestra.run.smithi027.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b... 2024-08-31T02:04:48.557 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/docker: stdout 34b9d27bc925f169ace27b9f1f204536aa49fc0b: Pulling from ceph-ci/ceph 2024-08-31T02:04:48.557 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/docker: stdout Digest: sha256:8b075137a5ab0999d974fdcffab872d229d50e3354e13aec412ebf6380176769 2024-08-31T02:04:48.557 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:04:48.557 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b 2024-08-31T02:04:50.163 INFO:teuthology.orchestra.run.smithi027.stdout:ceph: stdout ceph version 19.1.1-240-g34b9d27b (34b9d27bc925f169ace27b9f1f204536aa49fc0b) squid (rc) 2024-08-31T02:04:50.163 INFO:teuthology.orchestra.run.smithi027.stdout:Ceph version: ceph version 19.1.1-240-g34b9d27b (34b9d27bc925f169ace27b9f1f204536aa49fc0b) squid (rc) 2024-08-31T02:04:50.163 INFO:teuthology.orchestra.run.smithi027.stdout:Extracting ceph user uid/gid from container image... 2024-08-31T02:04:51.711 INFO:teuthology.orchestra.run.smithi027.stdout:stat: stdout 167 167 2024-08-31T02:04:51.711 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial keys... 2024-08-31T02:04:53.101 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQBEetJmjcIRIxAAVWWKCua6A8PN612z0AVS3Q== 2024-08-31T02:04:54.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQBGetJmEN5uARAAsUoP8tc9jDcYsvOvr1Pr2Q== 2024-08-31T02:04:56.111 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQBHetJmL+99HxAAaQr970WmwlIJd+eohBfIxA== 2024-08-31T02:04:56.112 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial monmap... 2024-08-31T02:04:57.686 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T02:04:57.686 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-31T02:04:57.686 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:04:57.686 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T02:04:57.686 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool for a [v2:172.21.15.27:3300,v1:172.21.15.27:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T02:04:57.686 INFO:teuthology.orchestra.run.smithi027.stdout:setting min_mon_release = quincy 2024-08-31T02:04:57.686 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: set fsid to 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:04:57.686 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T02:04:57.686 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:04:57.686 INFO:teuthology.orchestra.run.smithi027.stdout:Creating mon... 2024-08-31T02:04:59.200 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.571+0000 7f69e3e51c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.571+0000 7f69e3e51c80 1 imported monmap: 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-08-31T02:04:57.087327+0000 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.571+0000 7f69e3e51c80 0 /usr/bin/ceph-mon: set fsid to 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:04:59.201 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: RocksDB version: 7.9.2 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Git sha 0 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Compile date 2024-08-29 18:05:07 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: DB SUMMARY 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: DB Session ID: AAKXB4384B94L2H69J6G 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.error_if_exists: 0 2024-08-31T02:04:59.202 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.create_if_missing: 1 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.paranoid_checks: 1 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.env: 0x56325b118940 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.fs: PosixFileSystem 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.info_log: 0x56325d088a20 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.statistics: (nil) 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.use_fsync: 0 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_log_file_size: 0 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T02:04:59.203 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.allow_fallocate: 1 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.use_direct_reads: 0 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.create_missing_column_families: 0 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.db_log_dir: 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.wal_dir: 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T02:04:59.204 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.advise_random_on_open: 1 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.write_buffer_manager: 0x56325d08f4a0 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.rate_limiter: (nil) 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-08-31T02:04:59.205 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.unordered_write: 0 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.row_cache: None 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.wal_filter: None 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.two_write_queues: 0 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.manual_wal_flush: 0 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.wal_compression: 0 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.atomic_flush: 0 2024-08-31T02:04:59.206 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.log_readahead_size: 0 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_background_jobs: 2 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_background_compactions: -1 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_subcompactions: 1 2024-08-31T02:04:59.207 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T02:04:59.208 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T02:04:59.208 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T02:04:59.208 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_total_wal_size: 0 2024-08-31T02:04:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T02:04:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T02:04:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T02:04:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T02:04:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_open_files: -1 2024-08-31T02:04:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.bytes_per_sync: 0 2024-08-31T02:04:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T02:04:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T02:04:59.226 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Options.max_background_flushes: -1 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Compression algorithms supported: 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: kZSTD supported: 0 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: kXpressCompression supported: 0 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: kBZip2Compression supported: 0 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: kLZ4Compression supported: 1 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: kZlibCompression supported: 1 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: kSnappyCompression supported: 1 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T02:04:59.227 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.575+0000 7f69e3e51c80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.merge_operator: 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_filter: None 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_filter_factory: None 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T02:04:59.228 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56325d088660) 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x56325d073090 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-08-31T02:04:59.229 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-08-31T02:04:59.230 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-08-31T02:04:59.231 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compression: NoCompression 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.num_levels: 7 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T02:04:59.232 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compression_opts.level: 32767 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compression_opts.enabled: false 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T02:04:59.233 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T02:04:59.234 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.arena_block_size: 1048576 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T02:04:59.235 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.inplace_update_support: 0 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.bloom_locality: 0 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.max_successive_merges: 0 2024-08-31T02:04:59.236 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.force_consistency_checks: 1 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.ttl: 2592000 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.enable_blob_files: false 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.min_blob_size: 0 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.blob_file_size: 268435456 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T02:04:59.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1df77ab7-9326-4a6c-8e92-66a3b1df80da 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56325d0a0e00 2024-08-31T02:04:59.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69e3e51c80 4 rocksdb: DB pointer 0x56325d17a000 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69db5dc640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.579+0000 7f69db5dc640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-08-31T02:04:59.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T02:04:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x56325d073090#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.6e-05 secs_since: 0 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.583+0000 7f69e3e51c80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.583+0000 7f69e3e51c80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-mon: stderr debug 2024-08-31T02:04:58.583+0000 7f69e3e51c80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-08-31T02:04:59.241 INFO:teuthology.orchestra.run.smithi027.stdout:create mon.a on 2024-08-31T02:04:59.494 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-08-31T02:04:59.683 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-08-31T02:04:59.903 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968.target -> /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968.target. 2024-08-31T02:04:59.903 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968.target -> /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968.target. 2024-08-31T02:05:00.194 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mon.a 2024-08-31T02:05:00.194 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mon.a.service: Unit ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mon.a.service not loaded. 2024-08-31T02:05:00.382 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968.target.wants/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mon.a.service -> /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service. 2024-08-31T02:05:00.391 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld does not appear to be present 2024-08-31T02:05:00.391 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T02:05:00.391 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mon to start... 2024-08-31T02:05:00.391 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mon... 2024-08-31T02:05:02.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:02 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.026121+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T02:05:02.854 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout cluster: 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout id: 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout services: 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.238497s) 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout data: 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-31T02:05:02.855 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-31T02:05:02.856 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout pgs: 2024-08-31T02:05:02.856 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:02.856 INFO:teuthology.orchestra.run.smithi027.stdout:mon is available 2024-08-31T02:05:02.856 INFO:teuthology.orchestra.run.smithi027.stdout:Assimilating anything we can from ceph.conf... 2024-08-31T02:05:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.029414+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T02:05:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.029583+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-08-31T02:05:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.029596+0000 mon.a (mon.0) 4 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:05:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.029605+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-08-31T02:04:57.087327+0000 2024-08-31T02:05:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.029613+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:05:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.029621+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:05:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.029629+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-08-31T02:05:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.029637+0000 mon.a (mon.0) 9 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:05:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.031767+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-08-31T02:05:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.034042+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-08-31T02:05:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: cluster 2024-08-31T02:05:02.034522+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-08-31T02:05:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:03 smithi027 bash[22127]: audit 2024-08-31T02:05:02.267840+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.27:0/2115244901' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-08-31T02:05:04.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:04 smithi027 bash[22127]: audit 2024-08-31T02:05:04.064090+0000 mon.a (mon.0) 14 : audit [INF] from='client.? 172.21.15.27:0/1326263634' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-31T02:05:04.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:04 smithi027 bash[22127]: audit 2024-08-31T02:05:04.066849+0000 mon.a (mon.0) 15 : audit [INF] from='client.? 172.21.15.27:0/1326263634' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-31T02:05:04.637 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:04.637 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T02:05:04.637 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout fsid = 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:05:04.637 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-08-31T02:05:04.637 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T02:05:04.637 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = False 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T02:05:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:Generating new minimal ceph.conf... 2024-08-31T02:05:06.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:05 smithi027 bash[22127]: audit 2024-08-31T02:05:05.744256+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? 172.21.15.27:0/2666289442' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:05:06.292 INFO:teuthology.orchestra.run.smithi027.stdout:Restarting the monitor... 2024-08-31T02:05:06.659 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:06 smithi027 systemd[1]: Stopping Ceph mon.a for 3427ee8e-673d-11ef-bcd4-c7b262605968... 2024-08-31T02:05:06.659 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:06 smithi027 bash[22127]: debug 2024-08-31T02:05:06.423+0000 7f4f10f0e640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-08-31T02:05:06.659 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:06 smithi027 bash[22127]: debug 2024-08-31T02:05:06.423+0000 7f4f10f0e640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-31T02:05:07.265 INFO:teuthology.orchestra.run.smithi027.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-31T02:05:07.374 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:07 smithi027 bash[22513]: ceph-3427ee8e-673d-11ef-bcd4-c7b262605968-mon-a 2024-08-31T02:05:07.374 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:07 smithi027 bash[22574]: ceph-3427ee8e-673d-11ef-bcd4-c7b262605968-mon-a 2024-08-31T02:05:07.374 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:07 smithi027 systemd[1]: ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-31T02:05:07.374 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:07 smithi027 systemd[1]: Stopped Ceph mon.a for 3427ee8e-673d-11ef-bcd4-c7b262605968. 2024-08-31T02:05:07.374 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:07 smithi027 systemd[1]: Started Ceph mon.a for 3427ee8e-673d-11ef-bcd4-c7b262605968. 2024-08-31T02:05:08.974 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.783+0000 7fec669cac80 0 set uid:gid to 167:167 (ceph:ceph) 2024-08-31T02:05:08.974 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.783+0000 7fec669cac80 0 ceph version 19.1.1-240-g34b9d27b (34b9d27bc925f169ace27b9f1f204536aa49fc0b) squid (rc), process ceph-mon, pid 7 2024-08-31T02:05:08.974 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.783+0000 7fec669cac80 0 pidfile_write: ignore empty --pid-file 2024-08-31T02:05:08.974 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.787+0000 7fec669cac80 0 load: jerasure load: lrc 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: RocksDB version: 7.9.2 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Git sha 0 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Compile date 2024-08-29 18:05:07 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: DB SUMMARY 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: DB Session ID: W64MHQN0N2CAVZK0QTI0 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: CURRENT file: CURRENT 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: IDENTITY file: IDENTITY 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 88773 ; 2024-08-31T02:05:08.975 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.error_if_exists: 0 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.create_if_missing: 0 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.paranoid_checks: 1 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.env: 0x5624240a9940 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.fs: PosixFileSystem 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.info_log: 0x5624266bf560 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_file_opening_threads: 16 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.statistics: (nil) 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.use_fsync: 0 2024-08-31T02:05:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_log_file_size: 0 2024-08-31T02:05:08.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T02:05:08.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T02:05:08.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.keep_log_file_num: 1000 2024-08-31T02:05:08.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.recycle_log_file_num: 0 2024-08-31T02:05:08.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.allow_fallocate: 1 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.allow_mmap_reads: 0 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.allow_mmap_writes: 0 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.use_direct_reads: 0 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.create_missing_column_families: 0 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.db_log_dir: 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.wal_dir: 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T02:05:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.advise_random_on_open: 1 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.db_write_buffer_size: 0 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.write_buffer_manager: 0x5624266cedc0 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.rate_limiter: (nil) 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.wal_recovery_mode: 2 2024-08-31T02:05:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.enable_thread_tracking: 0 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.enable_pipelined_write: 0 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.unordered_write: 0 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.row_cache: None 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.wal_filter: None 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.allow_ingest_behind: 0 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.two_write_queues: 0 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.manual_wal_flush: 0 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.wal_compression: 0 2024-08-31T02:05:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.atomic_flush: 0 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.log_readahead_size: 0 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.best_efforts_recovery: 0 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.allow_data_in_errors: 0 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.db_host_id: __hostname__ 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_background_jobs: 2 2024-08-31T02:05:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_background_compactions: -1 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_subcompactions: 1 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_total_wal_size: 0 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_open_files: -1 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bytes_per_sync: 0 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T02:05:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_readahead_size: 0 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_background_flushes: -1 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Compression algorithms supported: 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: kZSTD supported: 0 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: kXpressCompression supported: 0 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: kBZip2Compression supported: 0 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: kLZ4Compression supported: 1 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: kZlibCompression supported: 1 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: kLZ4HCCompression supported: 1 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: kSnappyCompression supported: 1 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T02:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.merge_operator: 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_filter: None 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_filter_factory: None 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.sst_partitioner_factory: None 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5624266bf180) 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cache_index_and_filter_blocks: 1 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T02:05:08.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T02:05:08.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: pin_top_level_index_and_filter: 1 2024-08-31T02:05:08.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: index_type: 0 2024-08-31T02:05:08.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: data_block_index_type: 0 2024-08-31T02:05:08.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: index_shortening: 1 2024-08-31T02:05:08.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: data_block_hash_table_util_ratio: 0.750000 2024-08-31T02:05:08.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: checksum: 4 2024-08-31T02:05:08.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: no_block_cache: 0 2024-08-31T02:05:08.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: block_cache: 0x5624266b5090 2024-08-31T02:05:08.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: block_cache_name: BinnedLRUCache 2024-08-31T02:05:08.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: block_cache_options: 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: capacity : 536870912 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: num_shard_bits : 4 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: strict_capacity_limit : 0 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: high_pri_pool_ratio: 0.000 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: block_cache_compressed: (nil) 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: persistent_cache: (nil) 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: block_size: 4096 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: block_size_deviation: 10 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: block_restart_interval: 16 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: index_block_restart_interval: 1 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: metadata_block_size: 4096 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: partition_filters: 0 2024-08-31T02:05:08.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: use_delta_encoding: 1 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: filter_policy: bloomfilter 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: whole_key_filtering: 1 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: verify_compression: 0 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: read_amp_bytes_per_bit: 0 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: format_version: 5 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: enable_index_compression: 1 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: block_align: 0 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: max_auto_readahead_size: 262144 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: prepopulate_block_cache: 0 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: initial_auto_readahead_size: 8192 2024-08-31T02:05:08.988 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: num_file_reads_for_auto_readahead: 2 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.write_buffer_size: 33554432 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_write_buffer_number: 2 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compression: NoCompression 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bottommost_compression: Disabled 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.prefix_extractor: nullptr 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.num_levels: 7 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T02:05:08.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compression_opts.level: 32767 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compression_opts.strategy: 0 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T02:05:08.990 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compression_opts.enabled: false 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.target_file_size_base: 67108864 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T02:05:08.991 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.arena_block_size: 1048576 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.disable_auto_compactions: 0 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T02:05:08.992 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.inplace_update_support: 0 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T02:05:08.993 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.bloom_locality: 0 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.max_successive_merges: 0 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.paranoid_file_checks: 0 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.force_consistency_checks: 1 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.report_bg_io_stats: 0 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.ttl: 2592000 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.enable_blob_files: false 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.min_blob_size: 0 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.blob_file_size: 268435456 2024-08-31T02:05:08.994 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.blob_file_starting_level: 0 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1df77ab7-9326-4a6c-8e92-66a3b1df80da 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725069908796340, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725069908797330, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85390, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 258, "table_properties": {"data_size": 83537, "index_size": 237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10201, "raw_average_key_size": 47, "raw_value_size": 77744, "raw_average_value_size": 358, "num_data_blocks": 11, "num_entries": 217, "num_filter_entries": 217, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725069908, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1df77ab7-9326-4a6c-8e92-66a3b1df80da", "db_session_id": "W64MHQN0N2CAVZK0QTI0", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-31T02:05:08.995 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725069908797456, "job": 1, "event": "recovery_finished"} 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.791+0000 7fec669cac80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5624266e0e00 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 4 rocksdb: DB pointer 0x5624267e0000 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec5c793640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec5c793640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: ** DB Stats ** 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T02:05:08.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: ** Compaction Stats [default] ** 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: L0 2/0 85.25 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Sum 2/0 85.25 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: ** Compaction Stats [default] ** 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 133.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T02:05:08.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: AddFile(Keys): cumulative 0, interval 0 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Cumulative compaction: 0.00 GB write, 22.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Interval compaction: 0.00 GB write, 22.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Block cache BinnedLRUCache@0x5624266b5090#7 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: ** File Read Latency Histogram By Level [default] ** 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] at bind addrs [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 1 mon.a@-1(???) e1 preinit fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 0 mon.a@-1(???).mds e1 new map 2024-08-31T02:05:08.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 0 mon.a@-1(???).mds e1 print_map 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: e1 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: btime 2024-08-31T02:05:02:030013+0000 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: legacy client fscid: -1 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: No filesystems configured 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: debug 2024-08-31T02:05:08.795+0000 7fec669cac80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.823167+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T02:05:08.999 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.823229+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-08-31T02:05:09.000 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.823238+0000 mon.a (mon.0) 3 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:05:09.000 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.823244+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-08-31T02:04:57.087327+0000 2024-08-31T02:05:09.000 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.823257+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:05:09.000 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.823264+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:05:09.000 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.823272+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-08-31T02:05:09.000 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.823278+0000 mon.a (mon.0) 8 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:05:09.000 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.823670+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-08-31T02:05:09.000 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.823693+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-08-31T02:05:09.000 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:08 smithi027 bash[22610]: cluster 2024-08-31T02:05:08.824105+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-08-31T02:05:09.546 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-31T02:05:09.572 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-31T02:05:09.572 INFO:teuthology.orchestra.run.smithi027.stdout:Creating mgr... 2024-08-31T02:05:09.572 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-31T02:05:09.572 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-31T02:05:09.888 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:09 smithi027 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:05:09.888 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:09 smithi027 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:05:09.889 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:09 smithi027 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:05:09.893 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mgr.a 2024-08-31T02:05:09.893 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mgr.a.service: Unit ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mgr.a.service not loaded. 2024-08-31T02:05:10.089 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968.target.wants/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mgr.a.service -> /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service. 2024-08-31T02:05:10.097 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld does not appear to be present 2024-08-31T02:05:10.097 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T02:05:10.097 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld does not appear to be present 2024-08-31T02:05:10.098 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-31T02:05:10.098 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr to start... 2024-08-31T02:05:10.098 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr... 2024-08-31T02:05:10.193 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:10 smithi027 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:05:10.193 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:10 smithi027 systemd[1]: Started Ceph mgr.a for 3427ee8e-673d-11ef-bcd4-c7b262605968. 2024-08-31T02:05:10.194 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:09 smithi027 bash[22610]: audit 2024-08-31T02:05:08.963019+0000 mon.a (mon.0) 12 : audit [INF] from='client.? 172.21.15.27:0/1448274323' entity='client.admin' 2024-08-31T02:05:10.194 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:10 smithi027 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:05:11.922 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:11 smithi027 bash[22863]: debug 2024-08-31T02:05:11.806+0000 7f6424f18040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-31T02:05:12.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:11 smithi027 bash[22610]: audit 2024-08-31T02:05:11.913073+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? 172.21.15.27:0/928554493' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-31T02:05:12.511 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:12.511 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-08-31T02:05:12.511 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "3427ee8e-673d-11ef-bcd4-c7b262605968", 2024-08-31T02:05:12.511 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T02:05:12.511 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T02:05:12.511 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T02:05:12.511 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T02:05:12.511 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T02:05:12.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:12.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T02:05:12.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:12.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T02:05:12.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T02:05:12.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T02:05:12.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T02:05:12.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T02:05:12.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T02:05:12.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:12.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T02:05:12.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T02:05:12.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T02:05:12.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T02:05:02:030013+0000", 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T02:05:12.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T02:05:02.030799+0000", 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:12.518 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T02:05:12.519 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-08-31T02:05:12.519 INFO:teuthology.orchestra.run.smithi027.stdout:mgr not available, waiting (1/15)... 2024-08-31T02:05:13.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:13 smithi027 bash[22863]: debug 2024-08-31T02:05:13.050+0000 7f6424f18040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-31T02:05:13.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:13 smithi027 bash[22863]: debug 2024-08-31T02:05:13.118+0000 7f6424f18040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-31T02:05:13.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:13 smithi027 bash[22863]: debug 2024-08-31T02:05:13.274+0000 7f6424f18040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-31T02:05:14.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:13 smithi027 bash[22863]: debug 2024-08-31T02:05:13.954+0000 7f6424f18040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-31T02:05:14.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:14 smithi027 bash[22863]: debug 2024-08-31T02:05:14.026+0000 7f6424f18040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-31T02:05:14.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:14 smithi027 bash[22863]: debug 2024-08-31T02:05:14.098+0000 7f6424f18040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-31T02:05:14.601 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:14 smithi027 bash[22863]: debug 2024-08-31T02:05:14.290+0000 7f6424f18040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-31T02:05:14.601 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:14 smithi027 bash[22863]: debug 2024-08-31T02:05:14.370+0000 7f6424f18040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-31T02:05:14.601 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:14 smithi027 bash[22863]: debug 2024-08-31T02:05:14.442+0000 7f6424f18040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-31T02:05:14.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:14 smithi027 bash[22863]: debug 2024-08-31T02:05:14.710+0000 7f6424f18040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-31T02:05:14.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:14 smithi027 bash[22863]: debug 2024-08-31T02:05:14.778+0000 7f6424f18040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-31T02:05:15.334 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:14 smithi027 bash[22863]: debug 2024-08-31T02:05:14.982+0000 7f6424f18040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-31T02:05:15.336 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:15 smithi027 bash[22863]: debug 2024-08-31T02:05:15.066+0000 7f6424f18040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-31T02:05:15.695 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:15 smithi027 bash[22863]: debug 2024-08-31T02:05:15.330+0000 7f6424f18040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-31T02:05:15.695 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:15 smithi027 bash[22863]: debug 2024-08-31T02:05:15.522+0000 7f6424f18040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:05:15.695 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:15 smithi027 bash[22863]: debug 2024-08-31T02:05:15.694+0000 7f6424f18040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-31T02:05:15.950 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:15 smithi027 bash[22610]: audit 2024-08-31T02:05:15.759901+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? 172.21.15.27:0/2673733596' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-31T02:05:15.951 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:15 smithi027 bash[22863]: debug 2024-08-31T02:05:15.778+0000 7f6424f18040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-31T02:05:16.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:15 smithi027 bash[22863]: debug 2024-08-31T02:05:15.966+0000 7f6424f18040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:05:16.291 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:16.291 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "3427ee8e-673d-11ef-bcd4-c7b262605968", 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T02:05:16.292 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T02:05:16.293 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T02:05:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T02:05:02:030013+0000", 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T02:05:16.298 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T02:05:02.030799+0000", 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-08-31T02:05:16.299 INFO:teuthology.orchestra.run.smithi027.stdout:mgr not available, waiting (2/15)... 2024-08-31T02:05:17.115 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:16 smithi027 bash[22863]: debug 2024-08-31T02:05:16.802+0000 7f6424f18040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-31T02:05:17.115 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:16 smithi027 bash[22863]: debug 2024-08-31T02:05:16.882+0000 7f6424f18040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-31T02:05:17.115 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22863]: debug 2024-08-31T02:05:17.114+0000 7f6424f18040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-31T02:05:17.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22863]: debug 2024-08-31T02:05:17.190+0000 7f6424f18040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-31T02:05:17.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22863]: debug 2024-08-31T02:05:17.594+0000 7f6424f18040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-31T02:05:17.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22863]: debug 2024-08-31T02:05:17.678+0000 7f6424f18040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-31T02:05:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: cluster 2024-08-31T02:05:17.700810+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon a 2024-08-31T02:05:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: cluster 2024-08-31T02:05:17.707880+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: a(active, starting, since 0.00715177s) 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: audit 2024-08-31T02:05:17.709348+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: audit 2024-08-31T02:05:17.709548+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: audit 2024-08-31T02:05:17.709720+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: audit 2024-08-31T02:05:17.709884+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: audit 2024-08-31T02:05:17.710066+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: audit 2024-08-31T02:05:17.710237+0000 mon.a (mon.0) 22 : audit [DBG] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: audit 2024-08-31T02:05:17.710407+0000 mon.a (mon.0) 23 : audit [DBG] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: audit 2024-08-31T02:05:17.710923+0000 mon.a (mon.0) 24 : audit [DBG] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: cluster 2024-08-31T02:05:17.737049+0000 mon.a (mon.0) 25 : cluster [INF] Manager daemon a is now available 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: audit 2024-08-31T02:05:17.748140+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-08-31T02:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:17 smithi027 bash[22610]: audit 2024-08-31T02:05:17.750478+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-08-31T02:05:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:18 smithi027 bash[22610]: audit 2024-08-31T02:05:17.760493+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' 2024-08-31T02:05:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:18 smithi027 bash[22610]: audit 2024-08-31T02:05:17.765371+0000 mon.a (mon.0) 29 : audit [INF] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' 2024-08-31T02:05:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:18 smithi027 bash[22610]: audit 2024-08-31T02:05:17.770813+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.14100 172.21.15.27:0/3450609257' entity='mgr.a' 2024-08-31T02:05:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:18 smithi027 bash[22610]: cluster 2024-08-31T02:05:18.715859+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e3: a(active, since 1.01513s) 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "3427ee8e-673d-11ef-bcd4-c7b262605968", 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-08-31T02:05:20.600 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T02:05:20.601 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T02:05:20.602 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T02:05:20.602 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T02:05:20.605 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:20.605 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T02:05:20.605 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T02:05:20.605 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T02:05:20.605 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T02:05:20.605 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T02:05:20.605 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T02:05:20.605 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T02:05:20.605 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T02:05:02:030013+0000", 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T02:05:20.606 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T02:05:02.030799+0000", 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-08-31T02:05:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:mgr is available 2024-08-31T02:05:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:20 smithi027 bash[22610]: cluster 2024-08-31T02:05:19.770305+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e4: a(active, since 2s) 2024-08-31T02:05:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:20 smithi027 bash[22610]: audit 2024-08-31T02:05:20.053175+0000 mon.a (mon.0) 33 : audit [DBG] from='client.? 172.21.15.27:0/3790357687' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-31T02:05:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:22 smithi027 bash[22610]: audit 2024-08-31T02:05:21.969977+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.27:0/1957756815' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-31T02:05:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:22 smithi027 bash[22610]: audit 2024-08-31T02:05:21.974683+0000 mon.a (mon.0) 35 : audit [INF] from='client.? 172.21.15.27:0/1957756815' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-31T02:05:22.499 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:22.499 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout fsid = 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T02:05:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:Enabling cephadm module... 2024-08-31T02:05:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:23 smithi027 bash[22610]: audit 2024-08-31T02:05:23.915579+0000 mon.a (mon.0) 36 : audit [INF] from='client.? 172.21.15.27:0/1057404217' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-08-31T02:05:24.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:24 smithi027 bash[22863]: ignoring --setuser ceph since I am not root 2024-08-31T02:05:24.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:24 smithi027 bash[22863]: ignoring --setgroup ceph since I am not root 2024-08-31T02:05:24.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:24 smithi027 bash[22863]: debug 2024-08-31T02:05:24.122+0000 7fd9f78ad040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-31T02:05:25.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:24 smithi027 bash[22610]: audit 2024-08-31T02:05:23.967400+0000 mon.a (mon.0) 37 : audit [INF] from='client.? 172.21.15.27:0/1057404217' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-31T02:05:25.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:24 smithi027 bash[22610]: cluster 2024-08-31T02:05:23.972575+0000 mon.a (mon.0) 38 : cluster [DBG] mgrmap e5: a(active, since 6s) 2024-08-31T02:05:25.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:25 smithi027 bash[22863]: debug 2024-08-31T02:05:25.366+0000 7fd9f78ad040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-31T02:05:25.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:25 smithi027 bash[22863]: debug 2024-08-31T02:05:25.434+0000 7fd9f78ad040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-31T02:05:25.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:25 smithi027 bash[22863]: debug 2024-08-31T02:05:25.598+0000 7fd9f78ad040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-31T02:05:26.285 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:26 smithi027 bash[22610]: audit 2024-08-31T02:05:26.004963+0000 mon.a (mon.0) 39 : audit [DBG] from='client.? 172.21.15.27:0/3494346378' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-31T02:05:26.586 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-08-31T02:05:26.586 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-31T02:05:26.586 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T02:05:26.586 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "active_name": "a", 2024-08-31T02:05:26.586 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T02:05:26.586 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-08-31T02:05:26.586 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for the mgr to restart... 2024-08-31T02:05:26.586 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr epoch 5... 2024-08-31T02:05:26.626 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:26 smithi027 bash[22863]: debug 2024-08-31T02:05:26.282+0000 7fd9f78ad040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-31T02:05:26.627 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:26 smithi027 bash[22863]: debug 2024-08-31T02:05:26.354+0000 7fd9f78ad040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-31T02:05:26.627 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:26 smithi027 bash[22863]: debug 2024-08-31T02:05:26.426+0000 7fd9f78ad040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-31T02:05:26.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:26 smithi027 bash[22863]: debug 2024-08-31T02:05:26.626+0000 7fd9f78ad040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-31T02:05:26.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:26 smithi027 bash[22863]: debug 2024-08-31T02:05:26.706+0000 7fd9f78ad040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-31T02:05:26.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:26 smithi027 bash[22863]: debug 2024-08-31T02:05:26.778+0000 7fd9f78ad040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-31T02:05:27.325 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:27 smithi027 bash[22863]: debug 2024-08-31T02:05:27.046+0000 7fd9f78ad040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-31T02:05:27.325 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:27 smithi027 bash[22863]: debug 2024-08-31T02:05:27.118+0000 7fd9f78ad040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-31T02:05:27.582 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:27 smithi027 bash[22863]: debug 2024-08-31T02:05:27.322+0000 7fd9f78ad040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-31T02:05:27.582 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:27 smithi027 bash[22863]: debug 2024-08-31T02:05:27.406+0000 7fd9f78ad040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-31T02:05:27.862 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:27 smithi027 bash[22863]: debug 2024-08-31T02:05:27.674+0000 7fd9f78ad040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-31T02:05:28.114 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:27 smithi027 bash[22863]: debug 2024-08-31T02:05:27.862+0000 7fd9f78ad040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:05:28.114 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:28 smithi027 bash[22863]: debug 2024-08-31T02:05:28.030+0000 7fd9f78ad040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-31T02:05:28.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:28 smithi027 bash[22863]: debug 2024-08-31T02:05:28.114+0000 7fd9f78ad040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-31T02:05:28.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:28 smithi027 bash[22863]: debug 2024-08-31T02:05:28.298+0000 7fd9f78ad040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:05:29.455 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:29 smithi027 bash[22863]: debug 2024-08-31T02:05:29.142+0000 7fd9f78ad040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-31T02:05:29.455 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:29 smithi027 bash[22863]: debug 2024-08-31T02:05:29.218+0000 7fd9f78ad040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-31T02:05:29.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:29 smithi027 bash[22863]: debug 2024-08-31T02:05:29.454+0000 7fd9f78ad040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-31T02:05:29.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:29 smithi027 bash[22863]: debug 2024-08-31T02:05:29.530+0000 7fd9f78ad040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-31T02:05:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22610]: cluster 2024-08-31T02:05:30.041467+0000 mon.a (mon.0) 40 : cluster [INF] Active manager daemon a restarted 2024-08-31T02:05:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22610]: cluster 2024-08-31T02:05:30.041916+0000 mon.a (mon.0) 41 : cluster [INF] Activating manager daemon a 2024-08-31T02:05:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22610]: cluster 2024-08-31T02:05:30.048299+0000 mon.a (mon.0) 42 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-08-31T02:05:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22610]: cluster 2024-08-31T02:05:30.048406+0000 mon.a (mon.0) 43 : cluster [DBG] mgrmap e6: a(active, starting, since 0.00667359s) 2024-08-31T02:05:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22610]: audit 2024-08-31T02:05:30.051461+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:05:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22610]: audit 2024-08-31T02:05:30.053062+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-08-31T02:05:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22610]: audit 2024-08-31T02:05:30.054157+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T02:05:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22610]: audit 2024-08-31T02:05:30.054364+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T02:05:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22610]: audit 2024-08-31T02:05:30.054531+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T02:05:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22610]: cluster 2024-08-31T02:05:30.076726+0000 mon.a (mon.0) 49 : cluster [INF] Manager daemon a is now available 2024-08-31T02:05:30.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:29 smithi027 bash[22863]: debug 2024-08-31T02:05:29.938+0000 7fd9f78ad040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-31T02:05:30.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:30 smithi027 bash[22863]: debug 2024-08-31T02:05:30.018+0000 7fd9f78ad040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-31T02:05:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:31 smithi027 bash[22610]: cephadm 2024-08-31T02:05:30.090078+0000 mgr.a (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-08-31T02:05:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:31 smithi027 bash[22610]: audit 2024-08-31T02:05:30.094746+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:31 smithi027 bash[22610]: audit 2024-08-31T02:05:30.107832+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:31 smithi027 bash[22610]: audit 2024-08-31T02:05:30.111623+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:05:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:31 smithi027 bash[22610]: audit 2024-08-31T02:05:30.114010+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:05:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:31 smithi027 bash[22610]: audit 2024-08-31T02:05:30.125032+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-08-31T02:05:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:31 smithi027 bash[22610]: audit 2024-08-31T02:05:30.127354+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-08-31T02:05:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:31 smithi027 bash[22610]: audit 2024-08-31T02:05:30.834352+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:31 smithi027 bash[22610]: audit 2024-08-31T02:05:30.841230+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:31 smithi027 bash[22610]: cluster 2024-08-31T02:05:31.055871+0000 mon.a (mon.0) 58 : cluster [DBG] mgrmap e7: a(active, since 1.01411s) 2024-08-31T02:05:31.644 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-08-31T02:05:31.644 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-31T02:05:31.644 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T02:05:31.644 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-08-31T02:05:31.644 INFO:teuthology.orchestra.run.smithi027.stdout:mgr epoch 5 is available 2024-08-31T02:05:31.644 INFO:teuthology.orchestra.run.smithi027.stdout:Setting orchestrator backend to cephadm... 2024-08-31T02:05:32.415 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:32 smithi027 bash[22610]: audit 2024-08-31T02:05:31.054353+0000 mgr.a (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-31T02:05:32.415 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:32 smithi027 bash[22610]: audit 2024-08-31T02:05:31.071644+0000 mgr.a (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-31T02:05:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22610]: cluster 2024-08-31T02:05:32.106270+0000 mon.a (mon.0) 59 : cluster [DBG] mgrmap e8: a(active, since 2s) 2024-08-31T02:05:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22610]: cephadm 2024-08-31T02:05:32.913598+0000 mgr.a (mgr.14118) 4 : cephadm [INF] [31/Aug/2024:02:05:32] ENGINE Bus STARTING 2024-08-31T02:05:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22610]: audit 2024-08-31T02:05:32.951984+0000 mgr.a (mgr.14118) 5 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:05:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22610]: audit 2024-08-31T02:05:32.958192+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22610]: audit 2024-08-31T02:05:32.973932+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:05:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22610]: cephadm 2024-08-31T02:05:33.015398+0000 mgr.a (mgr.14118) 6 : cephadm [INF] [31/Aug/2024:02:05:33] ENGINE Serving on http://172.21.15.27:8765 2024-08-31T02:05:33.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: debug 2024-08-31T02:05:33.134+0000 7fd95eb6d640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:02:05:33] ENGINE Error in HTTPServer.serve 2024-08-31T02:05:33.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: Traceback (most recent call last): 2024-08-31T02:05:33.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T02:05:33.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: self._connections.run(self.expiration_interval) 2024-08-31T02:05:33.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T02:05:33.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: self._run(expiration_interval) 2024-08-31T02:05:33.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T02:05:33.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T02:05:33.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T02:05:33.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T02:05:33.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T02:05:33.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: s = self.context.wrap_socket( 2024-08-31T02:05:33.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T02:05:33.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: return self.sslsocket_class._create( 2024-08-31T02:05:33.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T02:05:33.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: self.do_handshake() 2024-08-31T02:05:33.235 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T02:05:33.235 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: self._sslobj.do_handshake() 2024-08-31T02:05:33.235 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:33 smithi027 bash[22863]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T02:05:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: cephadm 2024-08-31T02:05:33.135417+0000 mgr.a (mgr.14118) 7 : cephadm [INF] [31/Aug/2024:02:05:33] ENGINE Serving on https://172.21.15.27:7150 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: cephadm 2024-08-31T02:05:33.135671+0000 mgr.a (mgr.14118) 8 : cephadm [INF] [31/Aug/2024:02:05:33] ENGINE Bus STARTED 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: audit 2024-08-31T02:05:33.136627+0000 mon.a (mon.0) 62 : audit [DBG] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: cephadm 2024-08-31T02:05:33.137121+0000 mgr.a (mgr.14118) 9 : cephadm [ERR] [31/Aug/2024:02:05:33] ENGINE Error in HTTPServer.serve 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: Traceback (most recent call last): 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: self._connections.run(self.expiration_interval) 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: self._run(expiration_interval) 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T02:05:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T02:05:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T02:05:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: s = self.context.wrap_socket( 2024-08-31T02:05:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T02:05:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: return self.sslsocket_class._create( 2024-08-31T02:05:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T02:05:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: self.do_handshake() 2024-08-31T02:05:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T02:05:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: self._sslobj.do_handshake() 2024-08-31T02:05:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:34 smithi027 bash[22610]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T02:05:35.350 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-31T02:05:35.350 INFO:teuthology.orchestra.run.smithi027.stdout:Generating ssh key... 2024-08-31T02:05:35.438 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:35 smithi027 bash[22610]: audit 2024-08-31T02:05:34.788121+0000 mgr.a (mgr.14118) 10 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:05:37.340 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22610]: audit 2024-08-31T02:05:36.741950+0000 mgr.a (mgr.14118) 11 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:05:37.340 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22610]: cephadm 2024-08-31T02:05:36.742148+0000 mgr.a (mgr.14118) 12 : cephadm [INF] Generating ssh key... 2024-08-31T02:05:37.340 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: Generating public/private rsa key pair. 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: Your identification has been saved in /tmp/tmpf9pvtcz0/key 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: Your public key has been saved in /tmp/tmpf9pvtcz0/key.pub 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: The key fingerprint is: 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: SHA256:opoI1VQX6yfHQmGgPfZaSVLbQ1jPCYErVpxRjN7kR20 ceph-3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: The key's randomart image is: 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: +---[RSA 3072]----+ 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: | ooB@*. . | 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: | + +B*o+..E | 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: | o =o==o.+. | 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: | o .oBooo.. | 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: | . ....S +. | 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: | . . + = | 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: |. . . | 2024-08-31T02:05:37.341 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: |.. o | 2024-08-31T02:05:37.342 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: |. o | 2024-08-31T02:05:37.342 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:37 smithi027 bash[22863]: +----[SHA256]-----+ 2024-08-31T02:05:38.650 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:38 smithi027 bash[22610]: audit 2024-08-31T02:05:37.319455+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:38.650 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:38 smithi027 bash[22610]: audit 2024-08-31T02:05:37.323860+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:39.706 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuMVzDhQj3PnYtenHMt6kwiX0ys/OZeEGgNqT4CAqpfNkerorbCCy/sdPUm3heke9Q8VVwQ7XjZ/tL3MwZrVsegS+kzURcoFE9OD75JBfr8/U9K7E+TAVMhrB7csYq07WPoTGpUjQWK2fKFo59tUQ5PLNA2e43mcNk+tBzdbVSgcGk8Xytm6FBN1aOr4McRYD4ya3mmQsN03SxoI1mJ2OWZOIR8NL4lKTgJbCfdhPWwE/lQnx6JB5SJRVx1z/VkYaZM7LRyUagwwHUI5Q7dKkPSy1Tkr9lUN6nvRyScOpOpwTMm6BrEqagqVjhLNHME5zvQ5czmXu99sdTqKLZOR+lWd17dvfZKQXTASgFrQmBsVsXzh+f3WRzlqAI07+U6R72bORQw2HPJrpN0cZlYuN912J0SSywfltno4jyxv/S1MbzonSWLPjQ9PqUp2iQeb6EIyHsSfqFQpzGm+hUCifq9SzVIzTFNxNYlwom/8b/T8qpisggyIdWzmjt/mKXm1s= ceph-3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:05:39.707 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-31T02:05:39.707 INFO:teuthology.orchestra.run.smithi027.stdout:Adding key to root@localhost authorized_keys... 2024-08-31T02:05:39.707 INFO:teuthology.orchestra.run.smithi027.stdout:Adding host smithi027... 2024-08-31T02:05:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:40 smithi027 bash[22610]: audit 2024-08-31T02:05:39.180288+0000 mgr.a (mgr.14118) 13 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:05:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:42 smithi027 bash[22610]: audit 2024-08-31T02:05:41.177142+0000 mgr.a (mgr.14118) 14 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi027", "addr": "172.21.15.27", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:05:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:43 smithi027 bash[22610]: cephadm 2024-08-31T02:05:42.432426+0000 mgr.a (mgr.14118) 15 : cephadm [INF] Deploying cephadm binary to smithi027 2024-08-31T02:05:46.706 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Added host 'smithi027' with addr '172.21.15.27' 2024-08-31T02:05:46.706 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying unmanaged mon service... 2024-08-31T02:05:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:46 smithi027 bash[22610]: audit 2024-08-31T02:05:45.911253+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:46 smithi027 bash[22610]: cephadm 2024-08-31T02:05:45.911713+0000 mgr.a (mgr.14118) 16 : cephadm [INF] Added host smithi027 2024-08-31T02:05:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:46 smithi027 bash[22610]: audit 2024-08-31T02:05:45.912065+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:05:49.511 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-31T02:05:50.717 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying unmanaged mgr service... 2024-08-31T02:05:50.718 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:49 smithi027 bash[22610]: audit 2024-08-31T02:05:48.763211+0000 mgr.a (mgr.14118) 17 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:05:50.718 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:49 smithi027 bash[22610]: cephadm 2024-08-31T02:05:48.764878+0000 mgr.a (mgr.14118) 18 : cephadm [INF] Saving service mon spec with placement count:5 2024-08-31T02:05:50.718 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:49 smithi027 bash[22610]: audit 2024-08-31T02:05:48.769568+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:50.718 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:49 smithi027 bash[22610]: audit 2024-08-31T02:05:49.263956+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:51.222 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:50 smithi027 bash[22610]: audit 2024-08-31T02:05:49.866577+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:51.595 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-31T02:05:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:51 smithi027 bash[22610]: cluster 2024-08-31T02:05:50.055873+0000 mgr.a (mgr.14118) 19 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:05:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:51 smithi027 bash[22610]: audit 2024-08-31T02:05:51.052029+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.14118 172.21.15.27:0/3776554724' entity='mgr.a' 2024-08-31T02:05:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:52 smithi027 bash[22610]: audit 2024-08-31T02:05:51.045024+0000 mgr.a (mgr.14118) 20 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:05:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:52 smithi027 bash[22610]: cephadm 2024-08-31T02:05:51.047425+0000 mgr.a (mgr.14118) 21 : cephadm [INF] Saving service mgr spec with placement count:2 2024-08-31T02:05:54.205 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:53 smithi027 bash[22610]: cluster 2024-08-31T02:05:52.056418+0000 mgr.a (mgr.14118) 22 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:05:54.205 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:53 smithi027 bash[22610]: audit 2024-08-31T02:05:52.916486+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.15.27:0/1733102883' entity='client.admin' 2024-08-31T02:05:55.292 INFO:teuthology.orchestra.run.smithi027.stdout:Enabling the dashboard module... 2024-08-31T02:05:56.119 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:55 smithi027 bash[22610]: cluster 2024-08-31T02:05:54.056862+0000 mgr.a (mgr.14118) 23 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:05:56.119 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:55 smithi027 bash[22610]: audit 2024-08-31T02:05:54.741140+0000 mon.a (mon.0) 72 : audit [INF] from='client.? 172.21.15.27:0/100661598' entity='client.admin' 2024-08-31T02:05:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:56 smithi027 bash[22610]: audit 2024-08-31T02:05:56.737528+0000 mon.a (mon.0) 73 : audit [INF] from='client.? 172.21.15.27:0/2446963810' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-08-31T02:05:57.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:56 smithi027 bash[22863]: ignoring --setuser ceph since I am not root 2024-08-31T02:05:57.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:56 smithi027 bash[22863]: ignoring --setgroup ceph since I am not root 2024-08-31T02:05:57.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:56 smithi027 bash[22863]: debug 2024-08-31T02:05:56.913+0000 7f2c48472040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-31T02:05:58.005 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:57 smithi027 bash[22610]: audit 2024-08-31T02:05:56.748423+0000 mon.a (mon.0) 74 : audit [INF] from='client.? 172.21.15.27:0/2446963810' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-31T02:05:58.005 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:57 smithi027 bash[22610]: cluster 2024-08-31T02:05:56.753255+0000 mon.a (mon.0) 75 : cluster [DBG] mgrmap e9: a(active, since 26s) 2024-08-31T02:05:58.270 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:58 smithi027 bash[22863]: debug 2024-08-31T02:05:58.165+0000 7f2c48472040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-31T02:05:58.271 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:58 smithi027 bash[22863]: debug 2024-08-31T02:05:58.237+0000 7f2c48472040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-31T02:05:58.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:58 smithi027 bash[22863]: debug 2024-08-31T02:05:58.401+0000 7f2c48472040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-31T02:05:59.159 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:59 smithi027 bash[22863]: debug 2024-08-31T02:05:59.085+0000 7f2c48472040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-31T02:05:59.159 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:05:58 smithi027 bash[22610]: audit 2024-08-31T02:05:58.860635+0000 mon.a (mon.0) 76 : audit [DBG] from='client.? 172.21.15.27:0/1387216458' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-31T02:05:59.424 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:59 smithi027 bash[22863]: debug 2024-08-31T02:05:59.157+0000 7f2c48472040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-31T02:05:59.424 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:59 smithi027 bash[22863]: debug 2024-08-31T02:05:59.229+0000 7f2c48472040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-31T02:05:59.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-08-31T02:05:59.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-31T02:05:59.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T02:05:59.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "active_name": "a", 2024-08-31T02:05:59.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T02:05:59.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-08-31T02:05:59.516 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for the mgr to restart... 2024-08-31T02:05:59.516 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr epoch 9... 2024-08-31T02:05:59.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:59 smithi027 bash[22863]: debug 2024-08-31T02:05:59.421+0000 7f2c48472040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-31T02:05:59.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:59 smithi027 bash[22863]: debug 2024-08-31T02:05:59.501+0000 7f2c48472040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-31T02:05:59.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:59 smithi027 bash[22863]: debug 2024-08-31T02:05:59.573+0000 7f2c48472040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-31T02:06:00.149 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:59 smithi027 bash[22863]: debug 2024-08-31T02:05:59.845+0000 7f2c48472040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-31T02:06:00.149 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:05:59 smithi027 bash[22863]: debug 2024-08-31T02:05:59.913+0000 7f2c48472040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-31T02:06:00.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:00 smithi027 bash[22863]: debug 2024-08-31T02:06:00.145+0000 7f2c48472040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-31T02:06:00.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:00 smithi027 bash[22863]: debug 2024-08-31T02:06:00.229+0000 7f2c48472040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-31T02:06:00.857 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:00 smithi027 bash[22863]: debug 2024-08-31T02:06:00.493+0000 7f2c48472040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-31T02:06:00.857 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:00 smithi027 bash[22863]: debug 2024-08-31T02:06:00.685+0000 7f2c48472040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:06:01.125 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:00 smithi027 bash[22863]: debug 2024-08-31T02:06:00.853+0000 7f2c48472040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-31T02:06:01.125 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:00 smithi027 bash[22863]: debug 2024-08-31T02:06:00.937+0000 7f2c48472040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-31T02:06:02.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:01 smithi027 bash[22863]: debug 2024-08-31T02:06:01.121+0000 7f2c48472040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:06:02.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:01 smithi027 bash[22863]: debug 2024-08-31T02:06:01.973+0000 7f2c48472040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-31T02:06:02.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22863]: debug 2024-08-31T02:06:02.053+0000 7f2c48472040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-31T02:06:02.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22863]: debug 2024-08-31T02:06:02.285+0000 7f2c48472040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-31T02:06:02.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22863]: debug 2024-08-31T02:06:02.361+0000 7f2c48472040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-31T02:06:03.117 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22863]: debug 2024-08-31T02:06:02.769+0000 7f2c48472040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-31T02:06:03.117 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22863]: debug 2024-08-31T02:06:02.853+0000 7f2c48472040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-31T02:06:03.117 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22610]: cluster 2024-08-31T02:06:02.876930+0000 mon.a (mon.0) 77 : cluster [INF] Active manager daemon a restarted 2024-08-31T02:06:03.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22610]: cluster 2024-08-31T02:06:02.877512+0000 mon.a (mon.0) 78 : cluster [INF] Activating manager daemon a 2024-08-31T02:06:03.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22610]: cluster 2024-08-31T02:06:02.884532+0000 mon.a (mon.0) 79 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-08-31T02:06:03.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22610]: cluster 2024-08-31T02:06:02.884809+0000 mon.a (mon.0) 80 : cluster [DBG] mgrmap e10: a(active, starting, since 0.00747624s) 2024-08-31T02:06:03.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22610]: audit 2024-08-31T02:06:02.886126+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:06:03.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22610]: audit 2024-08-31T02:06:02.887165+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-08-31T02:06:03.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22610]: audit 2024-08-31T02:06:02.888178+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T02:06:03.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22610]: audit 2024-08-31T02:06:02.888351+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T02:06:03.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22610]: audit 2024-08-31T02:06:02.888478+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T02:06:03.118 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:02 smithi027 bash[22610]: cluster 2024-08-31T02:06:02.912796+0000 mon.a (mon.0) 86 : cluster [INF] Manager daemon a is now available 2024-08-31T02:06:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:03 smithi027 bash[22610]: audit 2024-08-31T02:06:02.932667+0000 mon.a (mon.0) 87 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:06:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:03 smithi027 bash[22610]: audit 2024-08-31T02:06:02.948425+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-08-31T02:06:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:03 smithi027 bash[22610]: audit 2024-08-31T02:06:02.950736+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-08-31T02:06:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:03 smithi027 bash[22610]: cluster 2024-08-31T02:06:03.889481+0000 mon.a (mon.0) 90 : cluster [DBG] mgrmap e11: a(active, since 1.01215s) 2024-08-31T02:06:04.563 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-08-31T02:06:04.563 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-31T02:06:04.563 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T02:06:04.563 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-08-31T02:06:04.563 INFO:teuthology.orchestra.run.smithi027.stdout:mgr epoch 9 is available 2024-08-31T02:06:04.563 INFO:teuthology.orchestra.run.smithi027.stdout:Generating a dashboard self-signed certificate... 2024-08-31T02:06:04.932 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: debug 2024-08-31T02:06:04.704+0000 7f2bb377a640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:02:06:04] ENGINE Error in HTTPServer.serve 2024-08-31T02:06:04.932 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: Traceback (most recent call last): 2024-08-31T02:06:04.932 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T02:06:04.932 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: self._connections.run(self.expiration_interval) 2024-08-31T02:06:04.932 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T02:06:04.932 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: self._run(expiration_interval) 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: s = self.context.wrap_socket( 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: return self.sslsocket_class._create( 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: self.do_handshake() 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: self._sslobj.do_handshake() 2024-08-31T02:06:04.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22863]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T02:06:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: cephadm 2024-08-31T02:06:04.582411+0000 mgr.a (mgr.14150) 3 : cephadm [INF] [31/Aug/2024:02:06:04] ENGINE Bus STARTING 2024-08-31T02:06:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: cephadm 2024-08-31T02:06:04.706179+0000 mgr.a (mgr.14150) 4 : cephadm [INF] [31/Aug/2024:02:06:04] ENGINE Serving on https://172.21.15.27:7150 2024-08-31T02:06:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: cephadm 2024-08-31T02:06:04.709620+0000 mgr.a (mgr.14150) 5 : cephadm [ERR] [31/Aug/2024:02:06:04] ENGINE Error in HTTPServer.serve 2024-08-31T02:06:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: Traceback (most recent call last): 2024-08-31T02:06:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T02:06:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: self._connections.run(self.expiration_interval) 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: self._run(expiration_interval) 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: s = self.context.wrap_socket( 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: return self.sslsocket_class._create( 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: self.do_handshake() 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T02:06:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: self._sslobj.do_handshake() 2024-08-31T02:06:05.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T02:06:05.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: cephadm 2024-08-31T02:06:04.807335+0000 mgr.a (mgr.14150) 6 : cephadm [INF] [31/Aug/2024:02:06:04] ENGINE Serving on http://172.21.15.27:8765 2024-08-31T02:06:05.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:04 smithi027 bash[22610]: cephadm 2024-08-31T02:06:04.807447+0000 mgr.a (mgr.14150) 7 : cephadm [INF] [31/Aug/2024:02:06:04] ENGINE Bus STARTED 2024-08-31T02:06:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:05 smithi027 bash[22610]: cluster 2024-08-31T02:06:04.943274+0000 mon.a (mon.0) 91 : cluster [DBG] mgrmap e12: a(active, since 2s) 2024-08-31T02:06:06.670 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-08-31T02:06:06.670 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial admin user... 2024-08-31T02:06:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:07 smithi027 bash[22610]: audit 2024-08-31T02:06:06.039671+0000 mgr.a (mgr.14150) 8 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:06:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:07 smithi027 bash[22610]: audit 2024-08-31T02:06:06.121471+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:07 smithi027 bash[22610]: audit 2024-08-31T02:06:06.126236+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:08.938 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$pZHccXwHYbiGGmCt/R.K/Og1L8S56Y3PdpTXWXYERrJQVEDfDzrzC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725069968, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-31T02:06:08.938 INFO:teuthology.orchestra.run.smithi027.stdout:Fetching dashboard port number... 2024-08-31T02:06:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:09 smithi027 bash[22610]: audit 2024-08-31T02:06:08.070244+0000 mgr.a (mgr.14150) 9 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:06:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:09 smithi027 bash[22610]: audit 2024-08-31T02:06:08.342053+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:10 smithi027 bash[22610]: cluster 2024-08-31T02:06:09.350858+0000 mon.a (mon.0) 95 : cluster [DBG] mgrmap e13: a(active, since 6s) 2024-08-31T02:06:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:10 smithi027 bash[22610]: audit 2024-08-31T02:06:09.606539+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:10 smithi027 bash[22610]: audit 2024-08-31T02:06:10.299154+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.15.27:0/3063148393' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-08-31T02:06:10.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 8443 2024-08-31T02:06:10.876 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld does not appear to be present 2024-08-31T02:06:10.876 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-31T02:06:10.878 INFO:teuthology.orchestra.run.smithi027.stdout:Ceph Dashboard is now available at: 2024-08-31T02:06:10.878 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:10.878 INFO:teuthology.orchestra.run.smithi027.stdout: URL: https://smithi027.front.sepia.ceph.com:8443/ 2024-08-31T02:06:10.878 INFO:teuthology.orchestra.run.smithi027.stdout: User: admin 2024-08-31T02:06:10.878 INFO:teuthology.orchestra.run.smithi027.stdout: Password: q5zburi87q 2024-08-31T02:06:10.878 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:10.878 INFO:teuthology.orchestra.run.smithi027.stdout:Saving cluster configuration to /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config directory 2024-08-31T02:06:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:11 smithi027 bash[22610]: audit 2024-08-31T02:06:10.771828+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:13.085 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout:Or, if you are only running a single cluster on this host: 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout: ceph telemetry on 2024-08-31T02:06:13.086 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:13.087 INFO:teuthology.orchestra.run.smithi027.stdout:For more information see: 2024-08-31T02:06:13.087 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:13.087 INFO:teuthology.orchestra.run.smithi027.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-31T02:06:13.087 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:13.087 INFO:teuthology.orchestra.run.smithi027.stdout:Bootstrap complete. 2024-08-31T02:06:13.139 INFO:tasks.cephadm:Fetching config... 2024-08-31T02:06:13.139 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:06:13.139 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-31T02:06:13.145 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-31T02:06:13.145 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:06:13.145 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-31T02:06:13.198 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-31T02:06:13.198 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:06:13.198 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-31T02:06:13.258 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-31T02:06:13.258 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:06:13.258 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-31T02:06:13.306 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-31T02:06:13.306 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuMVzDhQj3PnYtenHMt6kwiX0ys/OZeEGgNqT4CAqpfNkerorbCCy/sdPUm3heke9Q8VVwQ7XjZ/tL3MwZrVsegS+kzURcoFE9OD75JBfr8/U9K7E+TAVMhrB7csYq07WPoTGpUjQWK2fKFo59tUQ5PLNA2e43mcNk+tBzdbVSgcGk8Xytm6FBN1aOr4McRYD4ya3mmQsN03SxoI1mJ2OWZOIR8NL4lKTgJbCfdhPWwE/lQnx6JB5SJRVx1z/VkYaZM7LRyUagwwHUI5Q7dKkPSy1Tkr9lUN6nvRyScOpOpwTMm6BrEqagqVjhLNHME5zvQ5czmXu99sdTqKLZOR+lWd17dvfZKQXTASgFrQmBsVsXzh+f3WRzlqAI07+U6R72bORQw2HPJrpN0cZlYuN912J0SSywfltno4jyxv/S1MbzonSWLPjQ9PqUp2iQeb6EIyHsSfqFQpzGm+hUCifq9SzVIzTFNxNYlwom/8b/T8qpisggyIdWzmjt/mKXm1s= ceph-3427ee8e-673d-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T02:06:13.371 INFO:teuthology.orchestra.run.smithi027.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuMVzDhQj3PnYtenHMt6kwiX0ys/OZeEGgNqT4CAqpfNkerorbCCy/sdPUm3heke9Q8VVwQ7XjZ/tL3MwZrVsegS+kzURcoFE9OD75JBfr8/U9K7E+TAVMhrB7csYq07WPoTGpUjQWK2fKFo59tUQ5PLNA2e43mcNk+tBzdbVSgcGk8Xytm6FBN1aOr4McRYD4ya3mmQsN03SxoI1mJ2OWZOIR8NL4lKTgJbCfdhPWwE/lQnx6JB5SJRVx1z/VkYaZM7LRyUagwwHUI5Q7dKkPSy1Tkr9lUN6nvRyScOpOpwTMm6BrEqagqVjhLNHME5zvQ5czmXu99sdTqKLZOR+lWd17dvfZKQXTASgFrQmBsVsXzh+f3WRzlqAI07+U6R72bORQw2HPJrpN0cZlYuN912J0SSywfltno4jyxv/S1MbzonSWLPjQ9PqUp2iQeb6EIyHsSfqFQpzGm+hUCifq9SzVIzTFNxNYlwom/8b/T8qpisggyIdWzmjt/mKXm1s= ceph-3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:06:13.381 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuMVzDhQj3PnYtenHMt6kwiX0ys/OZeEGgNqT4CAqpfNkerorbCCy/sdPUm3heke9Q8VVwQ7XjZ/tL3MwZrVsegS+kzURcoFE9OD75JBfr8/U9K7E+TAVMhrB7csYq07WPoTGpUjQWK2fKFo59tUQ5PLNA2e43mcNk+tBzdbVSgcGk8Xytm6FBN1aOr4McRYD4ya3mmQsN03SxoI1mJ2OWZOIR8NL4lKTgJbCfdhPWwE/lQnx6JB5SJRVx1z/VkYaZM7LRyUagwwHUI5Q7dKkPSy1Tkr9lUN6nvRyScOpOpwTMm6BrEqagqVjhLNHME5zvQ5czmXu99sdTqKLZOR+lWd17dvfZKQXTASgFrQmBsVsXzh+f3WRzlqAI07+U6R72bORQw2HPJrpN0cZlYuN912J0SSywfltno4jyxv/S1MbzonSWLPjQ9PqUp2iQeb6EIyHsSfqFQpzGm+hUCifq9SzVIzTFNxNYlwom/8b/T8qpisggyIdWzmjt/mKXm1s= ceph-3427ee8e-673d-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T02:06:13.407 INFO:teuthology.orchestra.run.smithi163.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuMVzDhQj3PnYtenHMt6kwiX0ys/OZeEGgNqT4CAqpfNkerorbCCy/sdPUm3heke9Q8VVwQ7XjZ/tL3MwZrVsegS+kzURcoFE9OD75JBfr8/U9K7E+TAVMhrB7csYq07WPoTGpUjQWK2fKFo59tUQ5PLNA2e43mcNk+tBzdbVSgcGk8Xytm6FBN1aOr4McRYD4ya3mmQsN03SxoI1mJ2OWZOIR8NL4lKTgJbCfdhPWwE/lQnx6JB5SJRVx1z/VkYaZM7LRyUagwwHUI5Q7dKkPSy1Tkr9lUN6nvRyScOpOpwTMm6BrEqagqVjhLNHME5zvQ5czmXu99sdTqKLZOR+lWd17dvfZKQXTASgFrQmBsVsXzh+f3WRzlqAI07+U6R72bORQw2HPJrpN0cZlYuN912J0SSywfltno4jyxv/S1MbzonSWLPjQ9PqUp2iQeb6EIyHsSfqFQpzGm+hUCifq9SzVIzTFNxNYlwom/8b/T8qpisggyIdWzmjt/mKXm1s= ceph-3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:06:13.416 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuMVzDhQj3PnYtenHMt6kwiX0ys/OZeEGgNqT4CAqpfNkerorbCCy/sdPUm3heke9Q8VVwQ7XjZ/tL3MwZrVsegS+kzURcoFE9OD75JBfr8/U9K7E+TAVMhrB7csYq07WPoTGpUjQWK2fKFo59tUQ5PLNA2e43mcNk+tBzdbVSgcGk8Xytm6FBN1aOr4McRYD4ya3mmQsN03SxoI1mJ2OWZOIR8NL4lKTgJbCfdhPWwE/lQnx6JB5SJRVx1z/VkYaZM7LRyUagwwHUI5Q7dKkPSy1Tkr9lUN6nvRyScOpOpwTMm6BrEqagqVjhLNHME5zvQ5czmXu99sdTqKLZOR+lWd17dvfZKQXTASgFrQmBsVsXzh+f3WRzlqAI07+U6R72bORQw2HPJrpN0cZlYuN912J0SSywfltno4jyxv/S1MbzonSWLPjQ9PqUp2iQeb6EIyHsSfqFQpzGm+hUCifq9SzVIzTFNxNYlwom/8b/T8qpisggyIdWzmjt/mKXm1s= ceph-3427ee8e-673d-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T02:06:13.439 INFO:teuthology.orchestra.run.smithi191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuMVzDhQj3PnYtenHMt6kwiX0ys/OZeEGgNqT4CAqpfNkerorbCCy/sdPUm3heke9Q8VVwQ7XjZ/tL3MwZrVsegS+kzURcoFE9OD75JBfr8/U9K7E+TAVMhrB7csYq07WPoTGpUjQWK2fKFo59tUQ5PLNA2e43mcNk+tBzdbVSgcGk8Xytm6FBN1aOr4McRYD4ya3mmQsN03SxoI1mJ2OWZOIR8NL4lKTgJbCfdhPWwE/lQnx6JB5SJRVx1z/VkYaZM7LRyUagwwHUI5Q7dKkPSy1Tkr9lUN6nvRyScOpOpwTMm6BrEqagqVjhLNHME5zvQ5czmXu99sdTqKLZOR+lWd17dvfZKQXTASgFrQmBsVsXzh+f3WRzlqAI07+U6R72bORQw2HPJrpN0cZlYuN912J0SSywfltno4jyxv/S1MbzonSWLPjQ9PqUp2iQeb6EIyHsSfqFQpzGm+hUCifq9SzVIzTFNxNYlwom/8b/T8qpisggyIdWzmjt/mKXm1s= ceph-3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:06:13.449 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-31T02:06:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:13 smithi027 bash[22610]: audit 2024-08-31T02:06:12.445388+0000 mon.a (mon.0) 99 : audit [INF] from='client.? 172.21.15.27:0/266744743' entity='client.admin' 2024-08-31T02:06:17.939 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:06:20.131 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-31T02:06:20.208 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-31T02:06:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:20 smithi027 bash[22610]: audit 2024-08-31T02:06:19.457725+0000 mon.a (mon.0) 100 : audit [INF] from='client.? 172.21.15.27:0/281986974' entity='client.admin' 2024-08-31T02:06:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:20 smithi027 bash[22610]: audit 2024-08-31T02:06:20.435032+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:20 smithi027 bash[22610]: audit 2024-08-31T02:06:20.436991+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:20 smithi027 bash[22610]: audit 2024-08-31T02:06:20.437752+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi027", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:06:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:20 smithi027 bash[22610]: audit 2024-08-31T02:06:20.440546+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:20 smithi027 bash[22610]: audit 2024-08-31T02:06:20.454945+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:06:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:21 smithi027 bash[22610]: audit 2024-08-31T02:06:20.460416+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:23 smithi027 bash[22610]: cluster 2024-08-31T02:06:22.889833+0000 mgr.a (mgr.14150) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:06:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:25 smithi027 bash[22610]: cluster 2024-08-31T02:06:24.890255+0000 mgr.a (mgr.14150) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:26.961 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi163 2024-08-31T02:06:26.962 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T02:06:26.962 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/etc/ceph/ceph.conf 2024-08-31T02:06:26.968 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T02:06:26.968 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:06:27.015 INFO:tasks.cephadm:Adding host smithi163 to orchestrator... 2024-08-31T02:06:27.015 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph orch host add smithi163 2024-08-31T02:06:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: audit 2024-08-31T02:06:26.322267+0000 mgr.a (mgr.14150) 12 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:06:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: audit 2024-08-31T02:06:26.325551+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: audit 2024-08-31T02:06:26.326696+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:06:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: audit 2024-08-31T02:06:26.329406+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:06:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: audit 2024-08-31T02:06:26.330505+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:06:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: cephadm 2024-08-31T02:06:26.332170+0000 mgr.a (mgr.14150) 13 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.conf 2024-08-31T02:06:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: cephadm 2024-08-31T02:06:26.426488+0000 mgr.a (mgr.14150) 14 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:06:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: cephadm 2024-08-31T02:06:26.507215+0000 mgr.a (mgr.14150) 15 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:06:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: cephadm 2024-08-31T02:06:26.589709+0000 mgr.a (mgr.14150) 16 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:06:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: audit 2024-08-31T02:06:26.685661+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: audit 2024-08-31T02:06:26.688103+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:27 smithi027 bash[22610]: audit 2024-08-31T02:06:26.691376+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:28 smithi027 bash[22610]: cluster 2024-08-31T02:06:26.890695+0000 mgr.a (mgr.14150) 17 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:30 smithi027 bash[22610]: cluster 2024-08-31T02:06:28.891067+0000 mgr.a (mgr.14150) 18 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:31.750 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:06:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:32 smithi027 bash[22610]: cluster 2024-08-31T02:06:30.891482+0000 mgr.a (mgr.14150) 19 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:34 smithi027 bash[22610]: cluster 2024-08-31T02:06:32.891762+0000 mgr.a (mgr.14150) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:34 smithi027 bash[22610]: audit 2024-08-31T02:06:33.121096+0000 mgr.a (mgr.14150) 21 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi163", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:06:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:35 smithi027 bash[22610]: cephadm 2024-08-31T02:06:34.428378+0000 mgr.a (mgr.14150) 22 : cephadm [INF] Deploying cephadm binary to smithi163 2024-08-31T02:06:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:36 smithi027 bash[22610]: cluster 2024-08-31T02:06:34.892105+0000 mgr.a (mgr.14150) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:38.131 INFO:teuthology.orchestra.run.smithi027.stdout:Added host 'smithi163' with addr '172.21.15.163' 2024-08-31T02:06:38.748 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T02:06:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:38 smithi027 bash[22610]: cluster 2024-08-31T02:06:36.892357+0000 mgr.a (mgr.14150) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:38 smithi027 bash[22610]: audit 2024-08-31T02:06:38.129997+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:38 smithi027 bash[22610]: audit 2024-08-31T02:06:38.131733+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:06:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:38 smithi027 bash[22610]: audit 2024-08-31T02:06:38.635755+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:39 smithi027 bash[22610]: cephadm 2024-08-31T02:06:38.130897+0000 mgr.a (mgr.14150) 25 : cephadm [INF] Added host smithi163 2024-08-31T02:06:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:40 smithi027 bash[22610]: cluster 2024-08-31T02:06:38.892596+0000 mgr.a (mgr.14150) 26 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:40 smithi027 bash[22610]: audit 2024-08-31T02:06:40.161930+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:42 smithi027 bash[22610]: cluster 2024-08-31T02:06:40.892973+0000 mgr.a (mgr.14150) 27 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:42 smithi027 bash[22610]: audit 2024-08-31T02:06:41.531703+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:43.480 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:06:44.969 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:06:44.969 INFO:teuthology.orchestra.run.smithi027.stdout:[{"addr": "172.21.15.27", "hostname": "smithi027", "labels": [], "status": ""}, {"addr": "172.21.15.163", "hostname": "smithi163", "labels": [], "status": ""}] 2024-08-31T02:06:44.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:44 smithi027 bash[22610]: cluster 2024-08-31T02:06:42.893378+0000 mgr.a (mgr.14150) 28 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:45.595 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi191 2024-08-31T02:06:45.595 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T02:06:45.595 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.conf 2024-08-31T02:06:45.601 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T02:06:45.601 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:06:45.647 INFO:tasks.cephadm:Adding host smithi191 to orchestrator... 2024-08-31T02:06:45.647 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph orch host add smithi191 2024-08-31T02:06:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:46 smithi027 bash[22610]: cluster 2024-08-31T02:06:44.893666+0000 mgr.a (mgr.14150) 29 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:46 smithi027 bash[22610]: audit 2024-08-31T02:06:44.969185+0000 mgr.a (mgr.14150) 30 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T02:06:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: cluster 2024-08-31T02:06:46.894036+0000 mgr.a (mgr.14150) 31 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: audit 2024-08-31T02:06:47.303050+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: audit 2024-08-31T02:06:47.310376+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: audit 2024-08-31T02:06:47.316249+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: audit 2024-08-31T02:06:47.321245+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: audit 2024-08-31T02:06:47.322894+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi163", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: audit 2024-08-31T02:06:47.325211+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: audit 2024-08-31T02:06:47.326767+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: cephadm 2024-08-31T02:06:47.329093+0000 mgr.a (mgr.14150) 32 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.conf 2024-08-31T02:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: cephadm 2024-08-31T02:06:47.515851+0000 mgr.a (mgr.14150) 33 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: cephadm 2024-08-31T02:06:47.676467+0000 mgr.a (mgr.14150) 34 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: audit 2024-08-31T02:06:47.971020+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: audit 2024-08-31T02:06:47.975994+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:48 smithi027 bash[22610]: audit 2024-08-31T02:06:47.981777+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:49 smithi027 bash[22610]: cephadm 2024-08-31T02:06:47.821674+0000 mgr.a (mgr.14150) 35 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:06:50.379 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:06:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:50 smithi027 bash[22610]: cluster 2024-08-31T02:06:48.894447+0000 mgr.a (mgr.14150) 36 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:52 smithi027 bash[22610]: cluster 2024-08-31T02:06:50.894911+0000 mgr.a (mgr.14150) 37 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:52 smithi027 bash[22610]: audit 2024-08-31T02:06:51.780710+0000 mgr.a (mgr.14150) 38 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:06:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:54 smithi027 bash[22610]: cluster 2024-08-31T02:06:52.895334+0000 mgr.a (mgr.14150) 39 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:54 smithi027 bash[22610]: cephadm 2024-08-31T02:06:53.068158+0000 mgr.a (mgr.14150) 40 : cephadm [INF] Deploying cephadm binary to smithi191 2024-08-31T02:06:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:56 smithi027 bash[22610]: cluster 2024-08-31T02:06:54.895802+0000 mgr.a (mgr.14150) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:06:56.786 INFO:teuthology.orchestra.run.smithi027.stdout:Added host 'smithi191' with addr '172.21.15.191' 2024-08-31T02:06:57.435 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T02:06:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:57 smithi027 bash[22610]: audit 2024-08-31T02:06:56.785600+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:57 smithi027 bash[22610]: cephadm 2024-08-31T02:06:56.786386+0000 mgr.a (mgr.14150) 42 : cephadm [INF] Added host smithi191 2024-08-31T02:06:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:57 smithi027 bash[22610]: audit 2024-08-31T02:06:56.787217+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:06:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:57 smithi027 bash[22610]: audit 2024-08-31T02:06:57.296656+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:06:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:58 smithi027 bash[22610]: cluster 2024-08-31T02:06:56.896250+0000 mgr.a (mgr.14150) 43 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:59 smithi027 bash[22610]: audit 2024-08-31T02:06:58.822801+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:06:59 smithi027 bash[22610]: cluster 2024-08-31T02:06:58.896690+0000 mgr.a (mgr.14150) 44 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:01 smithi027 bash[22610]: audit 2024-08-31T02:07:00.057767+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:02.173 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:07:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:02 smithi027 bash[22610]: cluster 2024-08-31T02:07:00.897108+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:03.541 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:07:03.541 INFO:teuthology.orchestra.run.smithi027.stdout:[{"addr": "172.21.15.27", "hostname": "smithi027", "labels": [], "status": ""}, {"addr": "172.21.15.163", "hostname": "smithi163", "labels": [], "status": ""}, {"addr": "172.21.15.191", "hostname": "smithi191", "labels": [], "status": ""}] 2024-08-31T02:07:04.149 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-31T02:07:04.150 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph osd crush tunables default 2024-08-31T02:07:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:04 smithi027 bash[22610]: cluster 2024-08-31T02:07:02.897507+0000 mgr.a (mgr.14150) 46 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:04 smithi027 bash[22610]: audit 2024-08-31T02:07:03.540651+0000 mgr.a (mgr.14150) 47 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T02:07:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: cluster 2024-08-31T02:07:04.897959+0000 mgr.a (mgr.14150) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: audit 2024-08-31T02:07:05.633162+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: audit 2024-08-31T02:07:05.638774+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: audit 2024-08-31T02:07:05.645106+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: audit 2024-08-31T02:07:05.650670+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: audit 2024-08-31T02:07:05.652399+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:07:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: audit 2024-08-31T02:07:05.654342+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: audit 2024-08-31T02:07:05.656008+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: cephadm 2024-08-31T02:07:05.658525+0000 mgr.a (mgr.14150) 49 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2024-08-31T02:07:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: audit 2024-08-31T02:07:06.296064+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: audit 2024-08-31T02:07:06.301688+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:06 smithi027 bash[22610]: audit 2024-08-31T02:07:06.308313+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:07 smithi027 bash[22610]: cephadm 2024-08-31T02:07:05.840592+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:07 smithi027 bash[22610]: cephadm 2024-08-31T02:07:05.998759+0000 mgr.a (mgr.14150) 51 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:07:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:07 smithi027 bash[22610]: cephadm 2024-08-31T02:07:06.147686+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:07:08.881 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:07:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:08 smithi027 bash[22610]: cluster 2024-08-31T02:07:06.898294+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:10.639 INFO:teuthology.orchestra.run.smithi027.stderr:adjusted tunables profile to default 2024-08-31T02:07:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:10 smithi027 bash[22610]: cluster 2024-08-31T02:07:08.898555+0000 mgr.a (mgr.14150) 54 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:10 smithi027 bash[22610]: audit 2024-08-31T02:07:10.334816+0000 mon.a (mon.0) 144 : audit [INF] from='client.? 172.21.15.27:0/1700001933' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-31T02:07:11.266 INFO:tasks.cephadm:Adding mon.a on smithi027 2024-08-31T02:07:11.266 INFO:tasks.cephadm:Adding mon.b on smithi163 2024-08-31T02:07:11.266 INFO:tasks.cephadm:Adding mon.c on smithi191 2024-08-31T02:07:11.266 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph orch apply mon '3;smithi027:172.21.15.27=a;smithi163:172.21.15.163=b;smithi191:172.21.15.191=c' 2024-08-31T02:07:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:11 smithi027 bash[22610]: audit 2024-08-31T02:07:10.639434+0000 mon.a (mon.0) 145 : audit [INF] from='client.? 172.21.15.27:0/1700001933' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T02:07:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:11 smithi027 bash[22610]: cluster 2024-08-31T02:07:10.644131+0000 mon.a (mon.0) 146 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:12.492 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:12 smithi027 bash[22610]: cluster 2024-08-31T02:07:10.898973+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:13.760 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mon update... 2024-08-31T02:07:14.353 DEBUG:teuthology.orchestra.run.smithi163:mon.b> sudo journalctl -f -n 0 -u ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mon.b.service 2024-08-31T02:07:14.356 DEBUG:teuthology.orchestra.run.smithi191:mon.c> sudo journalctl -f -n 0 -u ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mon.c.service 2024-08-31T02:07:14.358 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T02:07:14.359 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T02:07:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:14 smithi027 bash[22610]: cluster 2024-08-31T02:07:12.899387+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:14 smithi027 bash[22610]: audit 2024-08-31T02:07:13.748896+0000 mgr.a (mgr.14150) 57 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi027:172.21.15.27=a;smithi163:172.21.15.163=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:07:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:14 smithi027 bash[22610]: cephadm 2024-08-31T02:07:13.754055+0000 mgr.a (mgr.14150) 58 : cephadm [INF] Saving service mon spec with placement smithi027:172.21.15.27=a;smithi163:172.21.15.163=b;smithi191:172.21.15.191=c;count:3 2024-08-31T02:07:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:14 smithi027 bash[22610]: audit 2024-08-31T02:07:13.759428+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:14 smithi027 bash[22610]: audit 2024-08-31T02:07:13.761091+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:14 smithi027 bash[22610]: audit 2024-08-31T02:07:14.460967+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:14 smithi027 bash[22610]: audit 2024-08-31T02:07:14.462423+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:14 smithi027 bash[22610]: audit 2024-08-31T02:07:14.469298+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:14 smithi027 bash[22610]: audit 2024-08-31T02:07:14.471581+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:14 smithi027 bash[22610]: audit 2024-08-31T02:07:14.472826+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:15.620 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:15 smithi027 bash[22610]: cephadm 2024-08-31T02:07:14.474309+0000 mgr.a (mgr.14150) 59 : cephadm [INF] Deploying daemon mon.c on smithi191 2024-08-31T02:07:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:16 smithi027 bash[22610]: cluster 2024-08-31T02:07:14.899805+0000 mgr.a (mgr.14150) 60 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:17.281 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-08-31T02:07:17.282 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-08-31T02:07:17.282 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"3427ee8e-673d-11ef-bcd4-c7b262605968","modified":"2024-08-31T02:04:57.087327Z","created":"2024-08-31T02:04:57.087327Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T02:07:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:17 smithi027 bash[22610]: audit 2024-08-31T02:07:17.281729+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.15.191:0/1657154883' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T02:07:19.160 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T02:07:19.160 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T02:07:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:18 smithi027 bash[22610]: cluster 2024-08-31T02:07:16.900211+0000 mgr.a (mgr.14150) 61 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:20.176 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:20 smithi191 systemd[1]: Started Ceph mon.c for 3427ee8e-673d-11ef-bcd4-c7b262605968. 2024-08-31T02:07:20.365 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T02:07:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:20 smithi027 bash[22610]: cluster 2024-08-31T02:07:18.900598+0000 mgr.a (mgr.14150) 62 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:20 smithi027 bash[22610]: audit 2024-08-31T02:07:20.112878+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:20 smithi027 bash[22610]: audit 2024-08-31T02:07:20.119018+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:20 smithi027 bash[22610]: audit 2024-08-31T02:07:20.125557+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:20 smithi027 bash[22610]: audit 2024-08-31T02:07:20.127009+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:20 smithi027 bash[22610]: audit 2024-08-31T02:07:20.128987+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:21.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.718+0000 7f5bd8978c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-08-31T02:07:21.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.718+0000 7f5bd8978c80 0 ceph version 19.1.1-240-g34b9d27b (34b9d27bc925f169ace27b9f1f204536aa49fc0b) squid (rc), process ceph-mon, pid 7 2024-08-31T02:07:21.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.718+0000 7f5bd8978c80 0 pidfile_write: ignore empty --pid-file 2024-08-31T02:07:21.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 0 load: jerasure load: lrc 2024-08-31T02:07:21.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: RocksDB version: 7.9.2 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Git sha 0 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Compile date 2024-08-29 18:05:07 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: DB SUMMARY 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: DB Session ID: 2JTHDKOL5LWQB1G6RHAK 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: CURRENT file: CURRENT 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: IDENTITY file: IDENTITY 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.error_if_exists: 0 2024-08-31T02:07:21.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.create_if_missing: 0 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.paranoid_checks: 1 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.env: 0x55695fae7940 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.fs: PosixFileSystem 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.info_log: 0x556960cd1560 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.statistics: (nil) 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.use_fsync: 0 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_log_file_size: 0 2024-08-31T02:07:21.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.allow_fallocate: 1 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.use_direct_reads: 0 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.create_missing_column_families: 0 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.db_log_dir: 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.wal_dir: 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T02:07:21.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.advise_random_on_open: 1 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.write_buffer_manager: 0x556960ce0dc0 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.rate_limiter: (nil) 2024-08-31T02:07:21.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.unordered_write: 0 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.row_cache: None 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.wal_filter: None 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-08-31T02:07:21.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.two_write_queues: 0 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.manual_wal_flush: 0 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.wal_compression: 0 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.atomic_flush: 0 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.log_readahead_size: 0 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-08-31T02:07:21.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-08-31T02:07:21.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T02:07:21.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_background_jobs: 2 2024-08-31T02:07:21.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_background_compactions: -1 2024-08-31T02:07:21.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_subcompactions: 1 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_total_wal_size: 0 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_open_files: -1 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bytes_per_sync: 0 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T02:07:21.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_background_flushes: -1 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Compression algorithms supported: 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: kZSTD supported: 0 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: kXpressCompression supported: 0 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: kBZip2Compression supported: 0 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: kLZ4Compression supported: 1 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: kZlibCompression supported: 1 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: kSnappyCompression supported: 1 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T02:07:21.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.merge_operator: 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_filter: None 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_filter_factory: None 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556960cd1180) 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cache_index_and_filter_blocks: 1 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: pin_top_level_index_and_filter: 1 2024-08-31T02:07:21.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: index_type: 0 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: data_block_index_type: 0 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: index_shortening: 1 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: data_block_hash_table_util_ratio: 0.750000 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: checksum: 4 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: no_block_cache: 0 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: block_cache: 0x556960cc7090 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: block_cache_name: BinnedLRUCache 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: block_cache_options: 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: capacity : 536870912 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: num_shard_bits : 4 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: strict_capacity_limit : 0 2024-08-31T02:07:21.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: high_pri_pool_ratio: 0.000 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: block_cache_compressed: (nil) 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: persistent_cache: (nil) 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: block_size: 4096 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: block_size_deviation: 10 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: block_restart_interval: 16 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: index_block_restart_interval: 1 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: metadata_block_size: 4096 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: partition_filters: 0 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: use_delta_encoding: 1 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: filter_policy: bloomfilter 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: whole_key_filtering: 1 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: verify_compression: 0 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: read_amp_bytes_per_bit: 0 2024-08-31T02:07:21.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: format_version: 5 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: enable_index_compression: 1 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: block_align: 0 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: max_auto_readahead_size: 262144 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: prepopulate_block_cache: 0 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: initial_auto_readahead_size: 8192 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: num_file_reads_for_auto_readahead: 2 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compression: NoCompression 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T02:07:21.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.num_levels: 7 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T02:07:21.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compression_opts.level: 32767 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compression_opts.enabled: false 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-08-31T02:07:21.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.arena_block_size: 1048576 2024-08-31T02:07:21.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T02:07:21.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.inplace_update_support: 0 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.bloom_locality: 0 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.max_successive_merges: 0 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.force_consistency_checks: 1 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.ttl: 2592000 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T02:07:21.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.enable_blob_files: false 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.min_blob_size: 0 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.blob_file_size: 268435456 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.722+0000 7f5bd8978c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T02:07:21.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b605960f-faf2-415f-a87b-e440a1b94ebd 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725070041729405, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725070041729827, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725070041, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b605960f-faf2-415f-a87b-e440a1b94ebd", "db_session_id": "2JTHDKOL5LWQB1G6RHAK", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725070041729956, "job": 1, "event": "recovery_finished"} 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556960cf2e00 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 4 rocksdb: DB pointer 0x556960df2000 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bce741640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bce741640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: ** DB Stats ** 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T02:07:21.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: ** Compaction Stats [default] ** 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: ** Compaction Stats [default] ** 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T02:07:21.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: AddFile(Keys): cumulative 0, interval 0 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Cumulative compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Interval compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Block cache BinnedLRUCache@0x556960cc7090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-31T02:07:21.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: ** File Read Latency Histogram By Level [default] ** 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 0 using public_addr v2:172.21.15.191:0/0 -> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 0 starting mon.c rank -1 at public addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] at bind addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.726+0000 7f5bd8978c80 1 mon.c@-1(???) e0 preinit fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 0 mon.c@-1(synchronizing).mds e1 new map 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 0 mon.c@-1(synchronizing).mds e1 print_map 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: e1 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: btime 2024-08-31T02:05:02:030013+0000 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: legacy client fscid: -1 2024-08-31T02:07:21.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: No filesystems configured 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:26.890695+0000 mgr.a (mgr.14150) 17 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:28.891067+0000 mgr.a (mgr.14150) 18 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:30.891482+0000 mgr.a (mgr.14150) 19 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:32.891762+0000 mgr.a (mgr.14150) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:33.121096+0000 mgr.a (mgr.14150) 21 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi163", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:06:34.428378+0000 mgr.a (mgr.14150) 22 : cephadm [INF] Deploying cephadm binary to smithi163 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:34.892105+0000 mgr.a (mgr.14150) 23 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:36.892357+0000 mgr.a (mgr.14150) 24 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:38.129997+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:38.131733+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:38.635755+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:06:38.130897+0000 mgr.a (mgr.14150) 25 : cephadm [INF] Added host smithi163 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:38.892596+0000 mgr.a (mgr.14150) 26 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:40.161930+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:40.892973+0000 mgr.a (mgr.14150) 27 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:41.531703+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:42.893378+0000 mgr.a (mgr.14150) 28 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:44.893666+0000 mgr.a (mgr.14150) 29 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:44.969185+0000 mgr.a (mgr.14150) 30 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:46.894036+0000 mgr.a (mgr.14150) 31 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:47.303050+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:47.310376+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:47.316249+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:47.321245+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:47.322894+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi163", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:47.325211+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:47.326767+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:06:47.329093+0000 mgr.a (mgr.14150) 32 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.conf 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:06:47.515851+0000 mgr.a (mgr.14150) 33 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:06:47.676467+0000 mgr.a (mgr.14150) 34 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:47.971020+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:47.975994+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:47.981777+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:06:47.821674+0000 mgr.a (mgr.14150) 35 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:48.894447+0000 mgr.a (mgr.14150) 36 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:50.894911+0000 mgr.a (mgr.14150) 37 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:51.780710+0000 mgr.a (mgr.14150) 38 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:52.895334+0000 mgr.a (mgr.14150) 39 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:06:53.068158+0000 mgr.a (mgr.14150) 40 : cephadm [INF] Deploying cephadm binary to smithi191 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:54.895802+0000 mgr.a (mgr.14150) 41 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:56.785600+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:06:56.786386+0000 mgr.a (mgr.14150) 42 : cephadm [INF] Added host smithi191 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:56.787217+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:57.296656+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:56.896250+0000 mgr.a (mgr.14150) 43 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:06:58.822801+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:06:58.896690+0000 mgr.a (mgr.14150) 44 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:00.057767+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:00.897108+0000 mgr.a (mgr.14150) 45 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:02.897507+0000 mgr.a (mgr.14150) 46 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:03.540651+0000 mgr.a (mgr.14150) 47 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:04.897959+0000 mgr.a (mgr.14150) 48 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:05.633162+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:05.638774+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:05.645106+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:05.650670+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:05.652399+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:05.654342+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:05.656008+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:07:05.658525+0000 mgr.a (mgr.14150) 49 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:06.296064+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:06.301688+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:06.308313+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:07:05.840592+0000 mgr.a (mgr.14150) 50 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:07:05.998759+0000 mgr.a (mgr.14150) 51 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:07:06.147686+0000 mgr.a (mgr.14150) 52 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:06.898294+0000 mgr.a (mgr.14150) 53 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:08.898555+0000 mgr.a (mgr.14150) 54 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:10.334816+0000 mon.a (mon.0) 144 : audit [INF] from='client.? 172.21.15.27:0/1700001933' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:10.639434+0000 mon.a (mon.0) 145 : audit [INF] from='client.? 172.21.15.27:0/1700001933' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:10.644131+0000 mon.a (mon.0) 146 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:10.898973+0000 mgr.a (mgr.14150) 55 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:12.899387+0000 mgr.a (mgr.14150) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:13.748896+0000 mgr.a (mgr.14150) 57 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi027:172.21.15.27=a;smithi163:172.21.15.163=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:07:13.754055+0000 mgr.a (mgr.14150) 58 : cephadm [INF] Saving service mon spec with placement smithi027:172.21.15.27=a;smithi163:172.21.15.163=b;smithi191:172.21.15.191=c;count:3 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:13.759428+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:13.761091+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:14.460967+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:14.462423+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:14.469298+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:14.471581+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:21.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:14.472826+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cephadm 2024-08-31T02:07:14.474309+0000 mgr.a (mgr.14150) 59 : cephadm [INF] Deploying daemon mon.c on smithi191 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:14.899805+0000 mgr.a (mgr.14150) 60 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:17.281729+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.15.191:0/1657154883' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:16.900211+0000 mgr.a (mgr.14150) 61 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: cluster 2024-08-31T02:07:18.900598+0000 mgr.a (mgr.14150) 62 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:20.112878+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:20.119018+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:20.125557+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:20.127009+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: audit 2024-08-31T02:07:20.128987+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:21.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:21 smithi191 bash[24992]: debug 2024-08-31T02:07:21.754+0000 7f5bd1747640 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-31T02:07:26.303 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: audit 2024-08-31T02:07:14.462423+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:26.303 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: audit 2024-08-31T02:07:14.469298+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:26.303 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: audit 2024-08-31T02:07:14.471581+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:26.303 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: audit 2024-08-31T02:07:14.472826+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:26.303 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: cephadm 2024-08-31T02:07:14.474309+0000 mgr.a (mgr.14150) 59 : cephadm [INF] Deploying daemon mon.c on smithi191 2024-08-31T02:07:26.303 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: cluster 2024-08-31T02:07:14.899805+0000 mgr.a (mgr.14150) 60 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: audit 2024-08-31T02:07:17.281729+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.15.191:0/1657154883' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T02:07:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: cluster 2024-08-31T02:07:16.900211+0000 mgr.a (mgr.14150) 61 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: cluster 2024-08-31T02:07:18.900598+0000 mgr.a (mgr.14150) 62 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: audit 2024-08-31T02:07:20.112878+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: audit 2024-08-31T02:07:20.119018+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: audit 2024-08-31T02:07:20.125557+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: audit 2024-08-31T02:07:20.127009+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: audit 2024-08-31T02:07:20.128987+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:26 smithi163 bash[24253]: debug 2024-08-31T02:07:26.295+0000 7fbbf1cb7640 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-31T02:07:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:20.900989+0000 mgr.a (mgr.14150) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:21.770258+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:07:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:21.770602+0000 mon.a (mon.0) 162 : cluster [INF] mon.a calling monitor election 2024-08-31T02:07:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:21.791983+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:22.765073+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:22.901399+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:23.765083+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:23.768652+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-08-31T02:07:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:24.765042+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:24.901784+0000 mgr.a (mgr.14150) 66 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:25.765155+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:26.306808+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:27.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:26.765576+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.813372+0000 mon.a (mon.0) 170 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T02:07:27.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.821053+0000 mon.a (mon.0) 171 : cluster [DBG] monmap epoch 2 2024-08-31T02:07:27.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.821103+0000 mon.a (mon.0) 172 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:27.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.821139+0000 mon.a (mon.0) 173 : cluster [DBG] last_changed 2024-08-31T02:07:21.764489+0000 2024-08-31T02:07:27.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.821180+0000 mon.a (mon.0) 174 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:07:27.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.821214+0000 mon.a (mon.0) 175 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:07:27.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.821254+0000 mon.a (mon.0) 176 : cluster [DBG] election_strategy: 1 2024-08-31T02:07:27.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.821296+0000 mon.a (mon.0) 177 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:07:27.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.821335+0000 mon.a (mon.0) 178 : cluster [DBG] 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-08-31T02:07:27.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.839614+0000 mon.a (mon.0) 179 : cluster [DBG] fsmap 2024-08-31T02:07:27.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.839702+0000 mon.a (mon.0) 180 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:27.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.840029+0000 mon.a (mon.0) 181 : cluster [DBG] mgrmap e13: a(active, since 83s) 2024-08-31T02:07:27.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.840356+0000 mon.a (mon.0) 182 : cluster [INF] overall HEALTH_OK 2024-08-31T02:07:27.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:26.848661+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:27.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:26.856575+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:27.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:26.865795+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:27.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:26 smithi027 bash[22610]: audit 2024-08-31T02:07:26.873461+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:27.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:20.900989+0000 mgr.a (mgr.14150) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:27.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:21.770258+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:07:27.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:21.770602+0000 mon.a (mon.0) 162 : cluster [INF] mon.a calling monitor election 2024-08-31T02:07:27.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:21.791983+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:22.765073+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:22.901399+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:23.765083+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:23.768652+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:24.765042+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:24.901784+0000 mgr.a (mgr.14150) 66 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:25.765155+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:26.306808+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:26.765576+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.813372+0000 mon.a (mon.0) 170 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.821053+0000 mon.a (mon.0) 171 : cluster [DBG] monmap epoch 2 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.821103+0000 mon.a (mon.0) 172 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.821139+0000 mon.a (mon.0) 173 : cluster [DBG] last_changed 2024-08-31T02:07:21.764489+0000 2024-08-31T02:07:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.821180+0000 mon.a (mon.0) 174 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.821214+0000 mon.a (mon.0) 175 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.821254+0000 mon.a (mon.0) 176 : cluster [DBG] election_strategy: 1 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.821296+0000 mon.a (mon.0) 177 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.821335+0000 mon.a (mon.0) 178 : cluster [DBG] 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.839614+0000 mon.a (mon.0) 179 : cluster [DBG] fsmap 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.839702+0000 mon.a (mon.0) 180 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.840029+0000 mon.a (mon.0) 181 : cluster [DBG] mgrmap e13: a(active, since 83s) 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.840356+0000 mon.a (mon.0) 182 : cluster [INF] overall HEALTH_OK 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:26.848661+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:26.856575+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:26.865795+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:26 smithi191 bash[24992]: audit 2024-08-31T02:07:26.873461+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:28.096 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-08-31T02:07:28.096 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"3427ee8e-673d-11ef-bcd4-c7b262605968","modified":"2024-08-31T02:07:21.764489Z","created":"2024-08-31T02:04:57.087327Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T02:07:28.097 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2024-08-31T02:07:28.163 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:27 smithi191 bash[24992]: cluster 2024-08-31T02:07:26.902119+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:28.164 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:27 smithi191 bash[24992]: audit 2024-08-31T02:07:26.965775+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:28.164 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:27 smithi191 bash[24992]: audit 2024-08-31T02:07:27.306779+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:28.164 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:27 smithi191 bash[24992]: audit 2024-08-31T02:07:27.765713+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:27 smithi027 bash[22610]: cluster 2024-08-31T02:07:26.902119+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:27 smithi027 bash[22610]: audit 2024-08-31T02:07:26.965775+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:27 smithi027 bash[22610]: audit 2024-08-31T02:07:27.306779+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:27 smithi027 bash[22610]: audit 2024-08-31T02:07:27.765713+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:29.872 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T02:07:29.873 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T02:07:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:28.312673+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:07:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:28.313071+0000 mon.a (mon.0) 194 : cluster [INF] mon.a calling monitor election 2024-08-31T02:07:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:28.313451+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-08-31T02:07:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:28.332230+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:28.332459+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:28.902494+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:29.307187+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:30.307397+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:30.902916+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:31.307452+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:32.307590+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:33.307691+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.332211+0000 mon.a (mon.0) 202 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.338382+0000 mon.a (mon.0) 203 : cluster [DBG] monmap epoch 3 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.338414+0000 mon.a (mon.0) 204 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.338434+0000 mon.a (mon.0) 205 : cluster [DBG] last_changed 2024-08-31T02:07:28.306948+0000 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.338452+0000 mon.a (mon.0) 206 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.338468+0000 mon.a (mon.0) 207 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.338486+0000 mon.a (mon.0) 208 : cluster [DBG] election_strategy: 1 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.338511+0000 mon.a (mon.0) 209 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.338532+0000 mon.a (mon.0) 210 : cluster [DBG] 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.338554+0000 mon.a (mon.0) 211 : cluster [DBG] 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-08-31T02:07:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.359698+0000 mon.a (mon.0) 212 : cluster [DBG] fsmap 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.359751+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.360015+0000 mon.a (mon.0) 214 : cluster [DBG] mgrmap e13: a(active, since 90s) 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.360322+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.367000+0000 mon.a (mon.0) 216 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.367033+0000 mon.a (mon.0) 217 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: cluster 2024-08-31T02:07:33.367075+0000 mon.a (mon.0) 218 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] is down (out of quorum) 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:33.371961+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:33.378301+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:33.385303+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:33.392249+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:33.393772+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:33.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:33 smithi027 bash[22610]: audit 2024-08-31T02:07:33.395641+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:33.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:28.312673+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:07:33.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:28.313071+0000 mon.a (mon.0) 194 : cluster [INF] mon.a calling monitor election 2024-08-31T02:07:33.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:28.313451+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-08-31T02:07:33.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:28.332230+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:28.332459+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:33.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:28.902494+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:33.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:29.307187+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:30.307397+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:30.902916+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:31.307452+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:32.307590+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:33.307691+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.332211+0000 mon.a (mon.0) 202 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.338382+0000 mon.a (mon.0) 203 : cluster [DBG] monmap epoch 3 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.338414+0000 mon.a (mon.0) 204 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.338434+0000 mon.a (mon.0) 205 : cluster [DBG] last_changed 2024-08-31T02:07:28.306948+0000 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.338452+0000 mon.a (mon.0) 206 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.338468+0000 mon.a (mon.0) 207 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.338486+0000 mon.a (mon.0) 208 : cluster [DBG] election_strategy: 1 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.338511+0000 mon.a (mon.0) 209 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.338532+0000 mon.a (mon.0) 210 : cluster [DBG] 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.338554+0000 mon.a (mon.0) 211 : cluster [DBG] 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.359698+0000 mon.a (mon.0) 212 : cluster [DBG] fsmap 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.359751+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.360015+0000 mon.a (mon.0) 214 : cluster [DBG] mgrmap e13: a(active, since 90s) 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.360322+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.367000+0000 mon.a (mon.0) 216 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.367033+0000 mon.a (mon.0) 217 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: cluster 2024-08-31T02:07:33.367075+0000 mon.a (mon.0) 218 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] is down (out of quorum) 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:33.371961+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:33.378301+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:33.385303+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:33.392249+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:33.393772+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:33 smithi191 bash[24992]: audit 2024-08-31T02:07:33.395641+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:34.350 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T02:07:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: cluster 2024-08-31T02:07:32.903280+0000 mgr.a (mgr.14150) 70 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: cephadm 2024-08-31T02:07:33.397996+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.conf 2024-08-31T02:07:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: cephadm 2024-08-31T02:07:33.398682+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.conf 2024-08-31T02:07:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: cephadm 2024-08-31T02:07:33.400444+0000 mgr.a (mgr.14150) 73 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: cephadm 2024-08-31T02:07:33.666824+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: cephadm 2024-08-31T02:07:33.667172+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: cephadm 2024-08-31T02:07:33.667696+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.868797+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.875360+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.881869+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.888485+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.895021+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.901965+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.910141+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.971648+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.975818+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.979574+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.984792+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.986117+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:34.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.987668+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T02:07:34.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:33.989111+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:34.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:34 smithi027 bash[22610]: audit 2024-08-31T02:07:34.307894+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:34.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: cluster 2024-08-31T02:07:32.903280+0000 mgr.a (mgr.14150) 70 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:34.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: cephadm 2024-08-31T02:07:33.397996+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.conf 2024-08-31T02:07:34.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: cephadm 2024-08-31T02:07:33.398682+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.conf 2024-08-31T02:07:34.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: cephadm 2024-08-31T02:07:33.400444+0000 mgr.a (mgr.14150) 73 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2024-08-31T02:07:34.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: cephadm 2024-08-31T02:07:33.666824+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:34.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: cephadm 2024-08-31T02:07:33.667172+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:34.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: cephadm 2024-08-31T02:07:33.667696+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:34.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.868797+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.875360+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.881869+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.888485+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.895021+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.901965+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.910141+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.971648+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.975818+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.979574+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.984792+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.986117+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.987668+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T02:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:33.989111+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:34 smithi191 bash[24992]: audit 2024-08-31T02:07:34.307894+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:20.900989+0000 mgr.a (mgr.14150) 64 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:21.770258+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:21.770602+0000 mon.a (mon.0) 162 : cluster [INF] mon.a calling monitor election 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:21.791983+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:22.765073+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:22.901399+0000 mgr.a (mgr.14150) 65 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:23.765083+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:23.768652+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:24.765042+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:24.901784+0000 mgr.a (mgr.14150) 66 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:25.765155+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:26.306808+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:26.765576+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.813372+0000 mon.a (mon.0) 170 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T02:07:35.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.821053+0000 mon.a (mon.0) 171 : cluster [DBG] monmap epoch 2 2024-08-31T02:07:35.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.821103+0000 mon.a (mon.0) 172 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:35.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.821139+0000 mon.a (mon.0) 173 : cluster [DBG] last_changed 2024-08-31T02:07:21.764489+0000 2024-08-31T02:07:35.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.821180+0000 mon.a (mon.0) 174 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:07:35.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.821214+0000 mon.a (mon.0) 175 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:07:35.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.821254+0000 mon.a (mon.0) 176 : cluster [DBG] election_strategy: 1 2024-08-31T02:07:35.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.821296+0000 mon.a (mon.0) 177 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:07:35.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.821335+0000 mon.a (mon.0) 178 : cluster [DBG] 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-08-31T02:07:35.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.839614+0000 mon.a (mon.0) 179 : cluster [DBG] fsmap 2024-08-31T02:07:35.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.839702+0000 mon.a (mon.0) 180 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:35.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.840029+0000 mon.a (mon.0) 181 : cluster [DBG] mgrmap e13: a(active, since 83s) 2024-08-31T02:07:35.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.840356+0000 mon.a (mon.0) 182 : cluster [INF] overall HEALTH_OK 2024-08-31T02:07:35.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:26.848661+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:26.856575+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:26.865795+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:26.873461+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:26.902119+0000 mgr.a (mgr.14150) 67 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:35.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:26.965775+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:35.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:27.306779+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:35.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:27.765713+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:35.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:28.312673+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:07:35.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:28.313071+0000 mon.a (mon.0) 194 : cluster [INF] mon.a calling monitor election 2024-08-31T02:07:35.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:28.313451+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-08-31T02:07:35.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:28.332230+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:35.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:28.332459+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:07:35.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:28.902494+0000 mgr.a (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:35.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:29.307187+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:35.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:30.307397+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:35.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:30.902916+0000 mgr.a (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:35.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:31.307452+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:35.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:32.307590+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:35.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.307691+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:35.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.332211+0000 mon.a (mon.0) 202 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T02:07:35.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.338382+0000 mon.a (mon.0) 203 : cluster [DBG] monmap epoch 3 2024-08-31T02:07:35.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.338414+0000 mon.a (mon.0) 204 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:35.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.338434+0000 mon.a (mon.0) 205 : cluster [DBG] last_changed 2024-08-31T02:07:28.306948+0000 2024-08-31T02:07:35.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.338452+0000 mon.a (mon.0) 206 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.338468+0000 mon.a (mon.0) 207 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.338486+0000 mon.a (mon.0) 208 : cluster [DBG] election_strategy: 1 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.338511+0000 mon.a (mon.0) 209 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.338532+0000 mon.a (mon.0) 210 : cluster [DBG] 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.338554+0000 mon.a (mon.0) 211 : cluster [DBG] 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.359698+0000 mon.a (mon.0) 212 : cluster [DBG] fsmap 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.359751+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.360015+0000 mon.a (mon.0) 214 : cluster [DBG] mgrmap e13: a(active, since 90s) 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.360322+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.367000+0000 mon.a (mon.0) 216 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.367033+0000 mon.a (mon.0) 217 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:33.367075+0000 mon.a (mon.0) 218 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] is down (out of quorum) 2024-08-31T02:07:35.706 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.371961+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.378301+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.385303+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.392249+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.393772+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.395641+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:32.903280+0000 mgr.a (mgr.14150) 70 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cephadm 2024-08-31T02:07:33.397996+0000 mgr.a (mgr.14150) 71 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.conf 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cephadm 2024-08-31T02:07:33.398682+0000 mgr.a (mgr.14150) 72 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.conf 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cephadm 2024-08-31T02:07:33.400444+0000 mgr.a (mgr.14150) 73 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cephadm 2024-08-31T02:07:33.666824+0000 mgr.a (mgr.14150) 74 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cephadm 2024-08-31T02:07:33.667172+0000 mgr.a (mgr.14150) 75 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cephadm 2024-08-31T02:07:33.667696+0000 mgr.a (mgr.14150) 76 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.868797+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.707 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.875360+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.708 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.881869+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.708 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.888485+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.708 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.895021+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.708 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.901965+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.708 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.910141+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.708 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.971648+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.708 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.975818+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.708 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.979574+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.708 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.984792+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:35.708 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.986117+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:35.709 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.987668+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T02:07:35.709 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:33.989111+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:35.709 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: audit 2024-08-31T02:07:34.307894+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:35.709 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:30.308525+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-08-31T02:07:35.709 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.343530+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-08-31T02:07:35.709 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.344639+0000 mon.a (mon.0) 241 : cluster [INF] mon.a calling monitor election 2024-08-31T02:07:35.709 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.346546+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-08-31T02:07:35.709 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.388588+0000 mon.a (mon.0) 242 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T02:07:35.709 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.402070+0000 mon.a (mon.0) 243 : cluster [DBG] monmap epoch 3 2024-08-31T02:07:35.709 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.402103+0000 mon.a (mon.0) 244 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.402137+0000 mon.a (mon.0) 245 : cluster [DBG] last_changed 2024-08-31T02:07:28.306948+0000 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.402169+0000 mon.a (mon.0) 246 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.402202+0000 mon.a (mon.0) 247 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.402234+0000 mon.a (mon.0) 248 : cluster [DBG] election_strategy: 1 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.402266+0000 mon.a (mon.0) 249 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.402298+0000 mon.a (mon.0) 250 : cluster [DBG] 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.402330+0000 mon.a (mon.0) 251 : cluster [DBG] 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.403480+0000 mon.a (mon.0) 252 : cluster [DBG] fsmap 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.403553+0000 mon.a (mon.0) 253 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.403839+0000 mon.a (mon.0) 254 : cluster [DBG] mgrmap e13: a(active, since 92s) 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.404135+0000 mon.a (mon.0) 255 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.404173+0000 mon.a (mon.0) 256 : cluster [INF] Cluster is now healthy 2024-08-31T02:07:35.710 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:35 smithi163 bash[24253]: cluster 2024-08-31T02:07:35.409876+0000 mon.a (mon.0) 257 : cluster [INF] overall HEALTH_OK 2024-08-31T02:07:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:30.308525+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-08-31T02:07:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.343530+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-08-31T02:07:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.344639+0000 mon.a (mon.0) 241 : cluster [INF] mon.a calling monitor election 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.346546+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.388588+0000 mon.a (mon.0) 242 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.402070+0000 mon.a (mon.0) 243 : cluster [DBG] monmap epoch 3 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.402103+0000 mon.a (mon.0) 244 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.402137+0000 mon.a (mon.0) 245 : cluster [DBG] last_changed 2024-08-31T02:07:28.306948+0000 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.402169+0000 mon.a (mon.0) 246 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.402202+0000 mon.a (mon.0) 247 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.402234+0000 mon.a (mon.0) 248 : cluster [DBG] election_strategy: 1 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.402266+0000 mon.a (mon.0) 249 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.402298+0000 mon.a (mon.0) 250 : cluster [DBG] 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.402330+0000 mon.a (mon.0) 251 : cluster [DBG] 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.403480+0000 mon.a (mon.0) 252 : cluster [DBG] fsmap 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.403553+0000 mon.a (mon.0) 253 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.403839+0000 mon.a (mon.0) 254 : cluster [DBG] mgrmap e13: a(active, since 92s) 2024-08-31T02:07:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.404135+0000 mon.a (mon.0) 255 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-08-31T02:07:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.404173+0000 mon.a (mon.0) 256 : cluster [INF] Cluster is now healthy 2024-08-31T02:07:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:35 smithi027 bash[22610]: cluster 2024-08-31T02:07:35.409876+0000 mon.a (mon.0) 257 : cluster [INF] overall HEALTH_OK 2024-08-31T02:07:35.780 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 3 2024-08-31T02:07:35.781 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-08-31T02:07:35.781 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":3,"fsid":"3427ee8e-673d-11ef-bcd4-c7b262605968","modified":"2024-08-31T02:07:28.306948Z","created":"2024-08-31T02:04:57.087327Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:3300","nonce":0},{"type":"v1","addr":"172.21.15.163:6789","nonce":0}]},"addr":"172.21.15.163:6789/0","public_addr":"172.21.15.163:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-31T02:07:35.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:30.308525+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-08-31T02:07:35.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.343530+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-08-31T02:07:35.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.344639+0000 mon.a (mon.0) 241 : cluster [INF] mon.a calling monitor election 2024-08-31T02:07:35.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.346546+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-08-31T02:07:35.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.388588+0000 mon.a (mon.0) 242 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T02:07:35.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.402070+0000 mon.a (mon.0) 243 : cluster [DBG] monmap epoch 3 2024-08-31T02:07:35.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.402103+0000 mon.a (mon.0) 244 : cluster [DBG] fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:35.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.402137+0000 mon.a (mon.0) 245 : cluster [DBG] last_changed 2024-08-31T02:07:28.306948+0000 2024-08-31T02:07:35.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.402169+0000 mon.a (mon.0) 246 : cluster [DBG] created 2024-08-31T02:04:57.087327+0000 2024-08-31T02:07:35.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.402202+0000 mon.a (mon.0) 247 : cluster [DBG] min_mon_release 19 (squid) 2024-08-31T02:07:35.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.402234+0000 mon.a (mon.0) 248 : cluster [DBG] election_strategy: 1 2024-08-31T02:07:35.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.402266+0000 mon.a (mon.0) 249 : cluster [DBG] 0: [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon.a 2024-08-31T02:07:35.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.402298+0000 mon.a (mon.0) 250 : cluster [DBG] 1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.c 2024-08-31T02:07:35.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.402330+0000 mon.a (mon.0) 251 : cluster [DBG] 2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.b 2024-08-31T02:07:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.403480+0000 mon.a (mon.0) 252 : cluster [DBG] fsmap 2024-08-31T02:07:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.403553+0000 mon.a (mon.0) 253 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-08-31T02:07:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.403839+0000 mon.a (mon.0) 254 : cluster [DBG] mgrmap e13: a(active, since 92s) 2024-08-31T02:07:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.404135+0000 mon.a (mon.0) 255 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-08-31T02:07:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.404173+0000 mon.a (mon.0) 256 : cluster [INF] Cluster is now healthy 2024-08-31T02:07:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:35 smithi191 bash[24992]: cluster 2024-08-31T02:07:35.409876+0000 mon.a (mon.0) 257 : cluster [INF] overall HEALTH_OK 2024-08-31T02:07:36.372 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-31T02:07:36.372 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph config generate-minimal-conf 2024-08-31T02:07:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:36 smithi163 bash[24253]: cluster 2024-08-31T02:07:34.903696+0000 mgr.a (mgr.14150) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:36 smithi163 bash[24253]: audit 2024-08-31T02:07:35.780756+0000 mon.a (mon.0) 258 : audit [DBG] from='client.? 172.21.15.191:0/222840051' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T02:07:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:36 smithi163 bash[24253]: audit 2024-08-31T02:07:36.260213+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:36 smithi163 bash[24253]: audit 2024-08-31T02:07:36.264991+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:36 smithi163 bash[24253]: audit 2024-08-31T02:07:36.266926+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:36 smithi163 bash[24253]: audit 2024-08-31T02:07:36.268212+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T02:07:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:36 smithi163 bash[24253]: audit 2024-08-31T02:07:36.269444+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:36 smithi163 bash[24253]: audit 2024-08-31T02:07:36.308003+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:36 smithi027 bash[22610]: cluster 2024-08-31T02:07:34.903696+0000 mgr.a (mgr.14150) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:36 smithi027 bash[22610]: audit 2024-08-31T02:07:35.780756+0000 mon.a (mon.0) 258 : audit [DBG] from='client.? 172.21.15.191:0/222840051' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T02:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:36 smithi027 bash[22610]: audit 2024-08-31T02:07:36.260213+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:36 smithi027 bash[22610]: audit 2024-08-31T02:07:36.264991+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:36 smithi027 bash[22610]: audit 2024-08-31T02:07:36.266926+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:36 smithi027 bash[22610]: audit 2024-08-31T02:07:36.268212+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T02:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:36 smithi027 bash[22610]: audit 2024-08-31T02:07:36.269444+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:36 smithi027 bash[22610]: audit 2024-08-31T02:07:36.308003+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:36 smithi191 bash[24992]: cluster 2024-08-31T02:07:34.903696+0000 mgr.a (mgr.14150) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:36 smithi191 bash[24992]: audit 2024-08-31T02:07:35.780756+0000 mon.a (mon.0) 258 : audit [DBG] from='client.? 172.21.15.191:0/222840051' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-31T02:07:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:36 smithi191 bash[24992]: audit 2024-08-31T02:07:36.260213+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:36 smithi191 bash[24992]: audit 2024-08-31T02:07:36.264991+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:36 smithi191 bash[24992]: audit 2024-08-31T02:07:36.266926+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:36 smithi191 bash[24992]: audit 2024-08-31T02:07:36.268212+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T02:07:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:36 smithi191 bash[24992]: audit 2024-08-31T02:07:36.269444+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:36 smithi191 bash[24992]: audit 2024-08-31T02:07:36.308003+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:07:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:37 smithi163 bash[24253]: cephadm 2024-08-31T02:07:36.266433+0000 mgr.a (mgr.14150) 80 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-08-31T02:07:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:37 smithi163 bash[24253]: cephadm 2024-08-31T02:07:36.271042+0000 mgr.a (mgr.14150) 81 : cephadm [INF] Reconfiguring daemon mon.b on smithi163 2024-08-31T02:07:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:37 smithi027 bash[22610]: cephadm 2024-08-31T02:07:36.266433+0000 mgr.a (mgr.14150) 80 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-08-31T02:07:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:37 smithi027 bash[22610]: cephadm 2024-08-31T02:07:36.271042+0000 mgr.a (mgr.14150) 81 : cephadm [INF] Reconfiguring daemon mon.b on smithi163 2024-08-31T02:07:37.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:37 smithi191 bash[24992]: cephadm 2024-08-31T02:07:36.266433+0000 mgr.a (mgr.14150) 80 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-08-31T02:07:37.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:37 smithi191 bash[24992]: cephadm 2024-08-31T02:07:36.271042+0000 mgr.a (mgr.14150) 81 : cephadm [INF] Reconfiguring daemon mon.b on smithi163 2024-08-31T02:07:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:38 smithi163 bash[24253]: cluster 2024-08-31T02:07:36.904096+0000 mgr.a (mgr.14150) 82 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:38 smithi027 bash[22610]: cluster 2024-08-31T02:07:36.904096+0000 mgr.a (mgr.14150) 82 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:38 smithi191 bash[24992]: cluster 2024-08-31T02:07:36.904096+0000 mgr.a (mgr.14150) 82 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:39.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:39 smithi191 bash[24992]: audit 2024-08-31T02:07:38.512368+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:39.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:39 smithi191 bash[24992]: audit 2024-08-31T02:07:38.519083+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:39.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:39 smithi191 bash[24992]: cephadm 2024-08-31T02:07:38.520569+0000 mgr.a (mgr.14150) 83 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-08-31T02:07:39.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:39 smithi191 bash[24992]: audit 2024-08-31T02:07:38.521135+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:39.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:39 smithi191 bash[24992]: audit 2024-08-31T02:07:38.522852+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T02:07:39.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:39 smithi191 bash[24992]: audit 2024-08-31T02:07:38.524565+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:39.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:39 smithi191 bash[24992]: cephadm 2024-08-31T02:07:38.526411+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring daemon mon.c on smithi191 2024-08-31T02:07:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:39 smithi163 bash[24253]: audit 2024-08-31T02:07:38.512368+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:39 smithi163 bash[24253]: audit 2024-08-31T02:07:38.519083+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:39 smithi163 bash[24253]: cephadm 2024-08-31T02:07:38.520569+0000 mgr.a (mgr.14150) 83 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-08-31T02:07:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:39 smithi163 bash[24253]: audit 2024-08-31T02:07:38.521135+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:39 smithi163 bash[24253]: audit 2024-08-31T02:07:38.522852+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T02:07:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:39 smithi163 bash[24253]: audit 2024-08-31T02:07:38.524565+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:39 smithi163 bash[24253]: cephadm 2024-08-31T02:07:38.526411+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring daemon mon.c on smithi191 2024-08-31T02:07:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:39 smithi027 bash[22610]: audit 2024-08-31T02:07:38.512368+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:39 smithi027 bash[22610]: audit 2024-08-31T02:07:38.519083+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:39 smithi027 bash[22610]: cephadm 2024-08-31T02:07:38.520569+0000 mgr.a (mgr.14150) 83 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-08-31T02:07:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:39 smithi027 bash[22610]: audit 2024-08-31T02:07:38.521135+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-31T02:07:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:39 smithi027 bash[22610]: audit 2024-08-31T02:07:38.522852+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-31T02:07:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:39 smithi027 bash[22610]: audit 2024-08-31T02:07:38.524565+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:39 smithi027 bash[22610]: cephadm 2024-08-31T02:07:38.526411+0000 mgr.a (mgr.14150) 84 : cephadm [INF] Reconfiguring daemon mon.c on smithi191 2024-08-31T02:07:40.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:40 smithi191 bash[24992]: cluster 2024-08-31T02:07:38.904494+0000 mgr.a (mgr.14150) 85 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:40 smithi163 bash[24253]: cluster 2024-08-31T02:07:38.904494+0000 mgr.a (mgr.14150) 85 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:40 smithi027 bash[22610]: cluster 2024-08-31T02:07:38.904494+0000 mgr.a (mgr.14150) 85 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:41.106 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:07:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:41 smithi163 bash[24253]: audit 2024-08-31T02:07:40.597146+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:41 smithi163 bash[24253]: audit 2024-08-31T02:07:40.604183+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:41 smithi163 bash[24253]: audit 2024-08-31T02:07:40.606416+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:41 smithi163 bash[24253]: audit 2024-08-31T02:07:40.609242+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:41 smithi163 bash[24253]: audit 2024-08-31T02:07:40.610625+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:41 smithi163 bash[24253]: audit 2024-08-31T02:07:40.619320+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:41 smithi027 bash[22610]: audit 2024-08-31T02:07:40.597146+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:41 smithi027 bash[22610]: audit 2024-08-31T02:07:40.604183+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:41 smithi027 bash[22610]: audit 2024-08-31T02:07:40.606416+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:41 smithi027 bash[22610]: audit 2024-08-31T02:07:40.609242+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:41 smithi027 bash[22610]: audit 2024-08-31T02:07:40.610625+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:41 smithi027 bash[22610]: audit 2024-08-31T02:07:40.619320+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:42.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:41 smithi191 bash[24992]: audit 2024-08-31T02:07:40.597146+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:42.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:41 smithi191 bash[24992]: audit 2024-08-31T02:07:40.604183+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:42.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:41 smithi191 bash[24992]: audit 2024-08-31T02:07:40.606416+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:42.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:41 smithi191 bash[24992]: audit 2024-08-31T02:07:40.609242+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:42.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:41 smithi191 bash[24992]: audit 2024-08-31T02:07:40.610625+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:42.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:41 smithi191 bash[24992]: audit 2024-08-31T02:07:40.619320+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:42.565 INFO:teuthology.orchestra.run.smithi027.stdout:# minimal ceph.conf for 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:42.566 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2024-08-31T02:07:42.566 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = 3427ee8e-673d-11ef-bcd4-c7b262605968 2024-08-31T02:07:42.566 INFO:teuthology.orchestra.run.smithi027.stdout: mon_host = [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] 2024-08-31T02:07:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:42 smithi163 bash[24253]: cluster 2024-08-31T02:07:40.904899+0000 mgr.a (mgr.14150) 86 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:42 smithi163 bash[24253]: audit 2024-08-31T02:07:42.566405+0000 mon.a (mon.0) 276 : audit [DBG] from='client.? 172.21.15.27:0/3735889347' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:42 smithi027 bash[22610]: cluster 2024-08-31T02:07:40.904899+0000 mgr.a (mgr.14150) 86 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:42 smithi027 bash[22610]: audit 2024-08-31T02:07:42.566405+0000 mon.a (mon.0) 276 : audit [DBG] from='client.? 172.21.15.27:0/3735889347' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:42 smithi191 bash[24992]: cluster 2024-08-31T02:07:40.904899+0000 mgr.a (mgr.14150) 86 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:42 smithi191 bash[24992]: audit 2024-08-31T02:07:42.566405+0000 mon.a (mon.0) 276 : audit [DBG] from='client.? 172.21.15.27:0/3735889347' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:43.188 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-31T02:07:43.189 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:07:43.189 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T02:07:43.202 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:07:43.202 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:07:43.257 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T02:07:43.257 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T02:07:43.271 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T02:07:43.271 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:07:43.326 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T02:07:43.326 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T02:07:43.341 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T02:07:43.341 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:07:43.395 INFO:tasks.cephadm:Adding mgr.a on smithi027 2024-08-31T02:07:43.395 INFO:tasks.cephadm:Adding mgr.b on smithi163 2024-08-31T02:07:43.395 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph orch apply mgr '2;smithi027=a;smithi163=b' 2024-08-31T02:07:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:44 smithi163 bash[24253]: cluster 2024-08-31T02:07:42.905311+0000 mgr.a (mgr.14150) 87 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:44 smithi027 bash[22610]: cluster 2024-08-31T02:07:42.905311+0000 mgr.a (mgr.14150) 87 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:45.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:44 smithi191 bash[24992]: cluster 2024-08-31T02:07:42.905311+0000 mgr.a (mgr.14150) 87 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:46 smithi163 bash[24253]: cluster 2024-08-31T02:07:44.905735+0000 mgr.a (mgr.14150) 88 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:46 smithi027 bash[22610]: cluster 2024-08-31T02:07:44.905735+0000 mgr.a (mgr.14150) 88 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:47.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:46 smithi191 bash[24992]: cluster 2024-08-31T02:07:44.905735+0000 mgr.a (mgr.14150) 88 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:47.153 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T02:07:48.440 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mgr update... 2024-08-31T02:07:48.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:48 smithi191 bash[24992]: cluster 2024-08-31T02:07:46.906136+0000 mgr.a (mgr.14150) 89 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:48.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:48 smithi191 bash[24992]: audit 2024-08-31T02:07:48.440076+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:48.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:48 smithi191 bash[24992]: audit 2024-08-31T02:07:48.441786+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:48 smithi163 bash[24253]: cluster 2024-08-31T02:07:46.906136+0000 mgr.a (mgr.14150) 89 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:48 smithi163 bash[24253]: audit 2024-08-31T02:07:48.440076+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:48 smithi163 bash[24253]: audit 2024-08-31T02:07:48.441786+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:48 smithi027 bash[22610]: cluster 2024-08-31T02:07:46.906136+0000 mgr.a (mgr.14150) 89 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:48 smithi027 bash[22610]: audit 2024-08-31T02:07:48.440076+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:48 smithi027 bash[22610]: audit 2024-08-31T02:07:48.441786+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:49.103 DEBUG:teuthology.orchestra.run.smithi163:mgr.b> sudo journalctl -f -n 0 -u ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@mgr.b.service 2024-08-31T02:07:49.106 INFO:tasks.cephadm:Deploying OSDs... 2024-08-31T02:07:49.106 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-08-31T02:07:49.106 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T02:07:49.112 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T02:07:49.113 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2024-08-31T02:07:49.158 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T02:07:49.159 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:49.159 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-08-31T02:07:49.159 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:49.159 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-08-31 01:57:51.575802625 +0000 2024-08-31T02:07:49.159 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-08-31 01:57:51.323804876 +0000 2024-08-31T02:07:49.159 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-08-31 01:57:51.323804876 +0000 2024-08-31T02:07:49.159 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-08-31T02:07:49.159 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T02:07:49.214 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-08-31T02:07:49.214 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-08-31T02:07:49.214 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000350479 s, 1.5 MB/s 2024-08-31T02:07:49.215 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T02:07:49.264 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2024-08-31T02:07:49.310 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T02:07:49.310 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:49.310 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-08-31T02:07:49.310 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:49.310 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-08-31 01:57:52.123797730 +0000 2024-08-31T02:07:49.310 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-08-31 01:57:51.839800266 +0000 2024-08-31T02:07:49.311 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-08-31 01:57:51.839800266 +0000 2024-08-31T02:07:49.311 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-08-31T02:07:49.311 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T02:07:49.364 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-08-31T02:07:49.364 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-08-31T02:07:49.364 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000312527 s, 1.6 MB/s 2024-08-31T02:07:49.365 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T02:07:49.415 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2024-08-31T02:07:49.462 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T02:07:49.462 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:49.462 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-08-31T02:07:49.462 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:49.462 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-08-31 01:57:52.607793407 +0000 2024-08-31T02:07:49.462 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-08-31 01:57:52.347795729 +0000 2024-08-31T02:07:49.462 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-08-31 01:57:52.347795729 +0000 2024-08-31T02:07:49.462 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-08-31T02:07:49.463 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T02:07:49.517 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-08-31T02:07:49.517 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-08-31T02:07:49.517 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000409921 s, 1.2 MB/s 2024-08-31T02:07:49.518 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T02:07:49.567 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2024-08-31T02:07:49.614 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T02:07:49.614 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:49.614 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 5h/5d Inode: 944 Links: 1 2024-08-31T02:07:49.614 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:49.614 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-08-31 01:57:53.095789047 +0000 2024-08-31T02:07:49.614 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-08-31 01:57:52.835791369 +0000 2024-08-31T02:07:49.614 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-08-31 01:57:52.835791369 +0000 2024-08-31T02:07:49.614 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: - 2024-08-31T02:07:49.615 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T02:07:49.669 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-08-31T02:07:49.669 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-08-31T02:07:49.670 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000313166 s, 1.6 MB/s 2024-08-31T02:07:49.671 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T02:07:49.720 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-08-31T02:07:49.720 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T02:07:49.725 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T02:07:49.725 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2024-08-31T02:07:49.768 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T02:07:49.769 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:49.769 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-08-31T02:07:49.769 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:49.769 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-08-31 01:57:49.303550586 +0000 2024-08-31T02:07:49.769 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-08-31 01:57:49.047518570 +0000 2024-08-31T02:07:49.769 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-08-31 01:57:49.047518570 +0000 2024-08-31T02:07:49.769 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2024-08-31T02:07:49.769 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T02:07:49.819 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-08-31T02:07:49.819 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-08-31T02:07:49.819 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000331677 s, 1.5 MB/s 2024-08-31T02:07:49.820 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T02:07:49.870 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2024-08-31T02:07:49.917 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T02:07:49.917 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:49.917 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-08-31T02:07:49.918 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:49.918 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-08-31 01:57:49.803613121 +0000 2024-08-31T02:07:49.918 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-08-31 01:57:49.539580103 +0000 2024-08-31T02:07:49.918 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-08-31 01:57:49.539580103 +0000 2024-08-31T02:07:49.918 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2024-08-31T02:07:49.918 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T02:07:49.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:49 smithi163 bash[24253]: audit 2024-08-31T02:07:48.431042+0000 mgr.a (mgr.14150) 90 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi027=a;smithi163=b", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:07:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:49 smithi163 bash[24253]: cephadm 2024-08-31T02:07:48.434028+0000 mgr.a (mgr.14150) 91 : cephadm [INF] Saving service mgr spec with placement smithi027=a;smithi163=b;count:2 2024-08-31T02:07:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:49 smithi163 bash[24253]: audit 2024-08-31T02:07:49.156087+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:49 smithi163 bash[24253]: audit 2024-08-31T02:07:49.157569+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:49 smithi163 bash[24253]: audit 2024-08-31T02:07:49.166409+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:49 smithi163 bash[24253]: audit 2024-08-31T02:07:49.169226+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T02:07:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:49 smithi163 bash[24253]: audit 2024-08-31T02:07:49.172809+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T02:07:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:49 smithi163 bash[24253]: audit 2024-08-31T02:07:49.176857+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T02:07:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:49 smithi163 bash[24253]: audit 2024-08-31T02:07:49.178333+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:49.959 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-08-31T02:07:49.959 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-08-31T02:07:49.960 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.00032129 s, 1.6 MB/s 2024-08-31T02:07:49.961 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T02:07:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:49 smithi027 bash[22610]: audit 2024-08-31T02:07:48.431042+0000 mgr.a (mgr.14150) 90 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi027=a;smithi163=b", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:07:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:49 smithi027 bash[22610]: cephadm 2024-08-31T02:07:48.434028+0000 mgr.a (mgr.14150) 91 : cephadm [INF] Saving service mgr spec with placement smithi027=a;smithi163=b;count:2 2024-08-31T02:07:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:49 smithi027 bash[22610]: audit 2024-08-31T02:07:49.156087+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:49 smithi027 bash[22610]: audit 2024-08-31T02:07:49.157569+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:49 smithi027 bash[22610]: audit 2024-08-31T02:07:49.166409+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:49 smithi027 bash[22610]: audit 2024-08-31T02:07:49.169226+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T02:07:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:49 smithi027 bash[22610]: audit 2024-08-31T02:07:49.172809+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T02:07:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:49 smithi027 bash[22610]: audit 2024-08-31T02:07:49.176857+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T02:07:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:49 smithi027 bash[22610]: audit 2024-08-31T02:07:49.178333+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:50.007 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2024-08-31T02:07:50.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:49 smithi191 bash[24992]: audit 2024-08-31T02:07:48.431042+0000 mgr.a (mgr.14150) 90 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi027=a;smithi163=b", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:07:50.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:49 smithi191 bash[24992]: cephadm 2024-08-31T02:07:48.434028+0000 mgr.a (mgr.14150) 91 : cephadm [INF] Saving service mgr spec with placement smithi027=a;smithi163=b;count:2 2024-08-31T02:07:50.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:49 smithi191 bash[24992]: audit 2024-08-31T02:07:49.156087+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:50.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:49 smithi191 bash[24992]: audit 2024-08-31T02:07:49.157569+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:50.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:49 smithi191 bash[24992]: audit 2024-08-31T02:07:49.166409+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:50.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:49 smithi191 bash[24992]: audit 2024-08-31T02:07:49.169226+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T02:07:50.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:49 smithi191 bash[24992]: audit 2024-08-31T02:07:49.172809+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T02:07:50.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:49 smithi191 bash[24992]: audit 2024-08-31T02:07:49.176857+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T02:07:50.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:49 smithi191 bash[24992]: audit 2024-08-31T02:07:49.178333+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:50.054 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T02:07:50.054 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:50.054 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-08-31T02:07:50.054 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:50.054 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-08-31 01:57:50.271670592 +0000 2024-08-31T02:07:50.055 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-08-31 01:57:50.039642504 +0000 2024-08-31T02:07:50.055 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-08-31 01:57:50.039642504 +0000 2024-08-31T02:07:50.055 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2024-08-31T02:07:50.055 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T02:07:50.108 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-08-31T02:07:50.109 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-08-31T02:07:50.109 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000401773 s, 1.3 MB/s 2024-08-31T02:07:50.110 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T02:07:50.159 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2024-08-31T02:07:50.210 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T02:07:50.210 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:50.210 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 936 Links: 1 2024-08-31T02:07:50.210 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:50.210 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-08-31 01:57:50.775731610 +0000 2024-08-31T02:07:50.210 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-08-31 01:57:50.515700132 +0000 2024-08-31T02:07:50.211 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-08-31 01:57:50.515700132 +0000 2024-08-31T02:07:50.211 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2024-08-31T02:07:50.211 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T02:07:50.265 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-08-31T02:07:50.265 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-08-31T02:07:50.265 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.00030624 s, 1.7 MB/s 2024-08-31T02:07:50.266 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T02:07:50.316 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-08-31T02:07:50.316 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T02:07:50.322 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T02:07:50.322 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-08-31T02:07:50.371 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T02:07:50.371 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:50.371 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 882 Links: 1 2024-08-31T02:07:50.371 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:50.371 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-08-31 01:57:50.130366367 +0000 2024-08-31T02:07:50.372 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-08-31 01:57:49.886368534 +0000 2024-08-31T02:07:50.372 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-08-31 01:57:49.886368534 +0000 2024-08-31T02:07:50.372 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2024-08-31T02:07:50.372 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T02:07:50.426 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-08-31T02:07:50.426 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-08-31T02:07:50.426 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000362959 s, 1.4 MB/s 2024-08-31T02:07:50.427 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T02:07:50.476 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-08-31T02:07:50.522 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T02:07:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:50.523 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-08-31T02:07:50.523 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:50.523 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-08-31 01:57:50.374364200 +0000 2024-08-31T02:07:50.523 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-08-31 01:57:50.370364234 +0000 2024-08-31T02:07:50.523 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-08-31 01:57:50.370364234 +0000 2024-08-31T02:07:50.523 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2024-08-31T02:07:50.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T02:07:50.577 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-08-31T02:07:50.577 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-08-31T02:07:50.577 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000426086 s, 1.2 MB/s 2024-08-31T02:07:50.578 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T02:07:50.627 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-08-31T02:07:50.678 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T02:07:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:50.679 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-08-31T02:07:50.679 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:50.679 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-08-31 01:57:51.122357555 +0000 2024-08-31T02:07:50.679 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-08-31 01:57:50.874359758 +0000 2024-08-31T02:07:50.679 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-08-31 01:57:50.874359758 +0000 2024-08-31T02:07:50.679 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2024-08-31T02:07:50.679 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T02:07:50.730 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:50 smithi191 bash[24992]: cluster 2024-08-31T02:07:48.906539+0000 mgr.a (mgr.14150) 92 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:50.730 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:50 smithi191 bash[24992]: cephadm 2024-08-31T02:07:49.179977+0000 mgr.a (mgr.14150) 93 : cephadm [INF] Deploying daemon mgr.b on smithi163 2024-08-31T02:07:50.733 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-08-31T02:07:50.733 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-08-31T02:07:50.733 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000367595 s, 1.4 MB/s 2024-08-31T02:07:50.734 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T02:07:50.784 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-08-31T02:07:50.830 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T02:07:50.830 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T02:07:50.831 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-08-31T02:07:50.831 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T02:07:50.831 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-08-31 01:57:51.638352971 +0000 2024-08-31T02:07:50.831 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-08-31 01:57:51.398355103 +0000 2024-08-31T02:07:50.831 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-08-31 01:57:51.398355103 +0000 2024-08-31T02:07:50.831 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2024-08-31T02:07:50.831 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T02:07:50.885 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-08-31T02:07:50.885 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-08-31T02:07:50.885 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000323519 s, 1.6 MB/s 2024-08-31T02:07:50.886 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T02:07:50.906 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:50 smithi163 bash[24253]: cluster 2024-08-31T02:07:48.906539+0000 mgr.a (mgr.14150) 92 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:50.906 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:50 smithi163 bash[24253]: cephadm 2024-08-31T02:07:49.179977+0000 mgr.a (mgr.14150) 93 : cephadm [INF] Deploying daemon mgr.b on smithi163 2024-08-31T02:07:50.936 INFO:tasks.cephadm:Deploying osd.0 on smithi027 with /dev/vg_nvme/lv_4... 2024-08-31T02:07:50.936 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T02:07:50.947 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:50 smithi027 bash[22610]: cluster 2024-08-31T02:07:48.906539+0000 mgr.a (mgr.14150) 92 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:50.947 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:50 smithi027 bash[22610]: cephadm 2024-08-31T02:07:49.179977+0000 mgr.a (mgr.14150) 93 : cephadm [INF] Deploying daemon mgr.b on smithi163 2024-08-31T02:07:52.061 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:51 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:07:52.061 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:52 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:07:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:52 smithi163 bash[24253]: cluster 2024-08-31T02:07:50.907008+0000 mgr.a (mgr.14150) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:52 smithi163 bash[24253]: audit 2024-08-31T02:07:52.205947+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:52 smithi163 bash[24253]: audit 2024-08-31T02:07:52.213036+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:52 smithi163 bash[24253]: audit 2024-08-31T02:07:52.220090+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:52 smithi163 bash[24253]: audit 2024-08-31T02:07:52.226665+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:52 smithi163 bash[24253]: audit 2024-08-31T02:07:52.314890+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:52 smithi027 bash[22610]: cluster 2024-08-31T02:07:50.907008+0000 mgr.a (mgr.14150) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:52 smithi027 bash[22610]: audit 2024-08-31T02:07:52.205947+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:52 smithi027 bash[22610]: audit 2024-08-31T02:07:52.213036+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:52 smithi027 bash[22610]: audit 2024-08-31T02:07:52.220090+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:52 smithi027 bash[22610]: audit 2024-08-31T02:07:52.226665+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:52 smithi027 bash[22610]: audit 2024-08-31T02:07:52.314890+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:52 smithi191 bash[24992]: cluster 2024-08-31T02:07:50.907008+0000 mgr.a (mgr.14150) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:52 smithi191 bash[24992]: audit 2024-08-31T02:07:52.205947+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:52 smithi191 bash[24992]: audit 2024-08-31T02:07:52.213036+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:53.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:52 smithi191 bash[24992]: audit 2024-08-31T02:07:52.220090+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:53.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:52 smithi191 bash[24992]: audit 2024-08-31T02:07:52.226665+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:53.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:52 smithi191 bash[24992]: audit 2024-08-31T02:07:52.314890+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:07:53.700 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:53 smithi163 bash[24766]: debug 2024-08-31T02:07:53.591+0000 7f48ab9d9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-31T02:07:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:53 smithi027 bash[22610]: cluster 2024-08-31T02:07:52.907478+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:53 smithi027 bash[22610]: audit 2024-08-31T02:07:52.960326+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:54.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:53 smithi191 bash[24992]: cluster 2024-08-31T02:07:52.907478+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:54.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:53 smithi191 bash[24992]: audit 2024-08-31T02:07:52.960326+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:53 smithi163 bash[24253]: cluster 2024-08-31T02:07:52.907478+0000 mgr.a (mgr.14150) 95 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:53 smithi163 bash[24253]: audit 2024-08-31T02:07:52.960326+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:55.199 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:54 smithi163 bash[24766]: debug 2024-08-31T02:07:54.775+0000 7f48ab9d9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-31T02:07:55.200 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:54 smithi163 bash[24766]: debug 2024-08-31T02:07:54.839+0000 7f48ab9d9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-31T02:07:55.200 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:54 smithi163 bash[24766]: debug 2024-08-31T02:07:54.987+0000 7f48ab9d9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-31T02:07:55.674 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:07:55.949 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:55 smithi163 bash[24766]: debug 2024-08-31T02:07:55.635+0000 7f48ab9d9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-31T02:07:55.950 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:55 smithi163 bash[24766]: debug 2024-08-31T02:07:55.703+0000 7f48ab9d9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-31T02:07:55.950 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:55 smithi163 bash[24766]: debug 2024-08-31T02:07:55.771+0000 7f48ab9d9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-31T02:07:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:55 smithi027 bash[22610]: cluster 2024-08-31T02:07:54.907887+0000 mgr.a (mgr.14150) 96 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:56.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:55 smithi191 bash[24992]: cluster 2024-08-31T02:07:54.907887+0000 mgr.a (mgr.14150) 96 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:56.359 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:55 smithi163 bash[24253]: cluster 2024-08-31T02:07:54.907887+0000 mgr.a (mgr.14150) 96 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:56.359 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:55 smithi163 bash[24766]: debug 2024-08-31T02:07:55.955+0000 7f48ab9d9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-31T02:07:56.360 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:56 smithi163 bash[24766]: debug 2024-08-31T02:07:56.035+0000 7f48ab9d9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-31T02:07:56.360 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:56 smithi163 bash[24766]: debug 2024-08-31T02:07:56.103+0000 7f48ab9d9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-31T02:07:56.360 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:56 smithi163 bash[24766]: debug 2024-08-31T02:07:56.355+0000 7f48ab9d9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-31T02:07:56.619 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:56 smithi163 bash[24766]: debug 2024-08-31T02:07:56.423+0000 7f48ab9d9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-31T02:07:56.945 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:56 smithi163 bash[24766]: debug 2024-08-31T02:07:56.615+0000 7f48ab9d9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-31T02:07:56.945 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:56 smithi163 bash[24766]: debug 2024-08-31T02:07:56.691+0000 7f48ab9d9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-31T02:07:57.199 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:56 smithi163 bash[24766]: debug 2024-08-31T02:07:56.939+0000 7f48ab9d9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-31T02:07:57.200 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:57 smithi163 bash[24766]: debug 2024-08-31T02:07:57.115+0000 7f48ab9d9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:07:57.555 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:57 smithi163 bash[24766]: debug 2024-08-31T02:07:57.275+0000 7f48ab9d9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-31T02:07:57.555 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:57 smithi163 bash[24766]: debug 2024-08-31T02:07:57.359+0000 7f48ab9d9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-31T02:07:57.949 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:57 smithi163 bash[24766]: debug 2024-08-31T02:07:57.551+0000 7f48ab9d9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:07:58.657 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24766]: debug 2024-08-31T02:07:58.355+0000 7f48ab9d9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-31T02:07:58.657 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24766]: debug 2024-08-31T02:07:58.431+0000 7f48ab9d9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-31T02:07:58.657 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24766]: debug 2024-08-31T02:07:58.651+0000 7f48ab9d9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-31T02:07:58.657 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: cluster 2024-08-31T02:07:56.908307+0000 mgr.a (mgr.14150) 97 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:58.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: audit 2024-08-31T02:07:57.529890+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:58.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: audit 2024-08-31T02:07:57.536592+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:58.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: audit 2024-08-31T02:07:57.537823+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:58.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: audit 2024-08-31T02:07:57.538792+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:58.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: audit 2024-08-31T02:07:57.546053+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:58.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: cephadm 2024-08-31T02:07:57.606399+0000 mgr.a (mgr.14150) 98 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-08-31T02:07:58.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: audit 2024-08-31T02:07:57.606899+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T02:07:58.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: audit 2024-08-31T02:07:57.608210+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T02:07:58.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: audit 2024-08-31T02:07:57.609113+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:58.658 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24253]: cephadm 2024-08-31T02:07:57.610083+0000 mgr.a (mgr.14150) 99 : cephadm [INF] Reconfiguring daemon mgr.a on smithi027 2024-08-31T02:07:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: cluster 2024-08-31T02:07:56.908307+0000 mgr.a (mgr.14150) 97 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: audit 2024-08-31T02:07:57.529890+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: audit 2024-08-31T02:07:57.536592+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: audit 2024-08-31T02:07:57.537823+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: audit 2024-08-31T02:07:57.538792+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: audit 2024-08-31T02:07:57.546053+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: cephadm 2024-08-31T02:07:57.606399+0000 mgr.a (mgr.14150) 98 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-08-31T02:07:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: audit 2024-08-31T02:07:57.606899+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T02:07:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: audit 2024-08-31T02:07:57.608210+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T02:07:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: audit 2024-08-31T02:07:57.609113+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:58 smithi027 bash[22610]: cephadm 2024-08-31T02:07:57.610083+0000 mgr.a (mgr.14150) 99 : cephadm [INF] Reconfiguring daemon mgr.a on smithi027 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: cluster 2024-08-31T02:07:56.908307+0000 mgr.a (mgr.14150) 97 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: audit 2024-08-31T02:07:57.529890+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: audit 2024-08-31T02:07:57.536592+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: audit 2024-08-31T02:07:57.537823+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: audit 2024-08-31T02:07:57.538792+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: audit 2024-08-31T02:07:57.546053+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: cephadm 2024-08-31T02:07:57.606399+0000 mgr.a (mgr.14150) 98 : cephadm [INF] Reconfiguring mgr.a (unknown last config time)... 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: audit 2024-08-31T02:07:57.606899+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: audit 2024-08-31T02:07:57.608210+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: audit 2024-08-31T02:07:57.609113+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:07:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:58 smithi191 bash[24992]: cephadm 2024-08-31T02:07:57.610083+0000 mgr.a (mgr.14150) 99 : cephadm [INF] Reconfiguring daemon mgr.a on smithi027 2024-08-31T02:07:58.949 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:58 smithi163 bash[24766]: debug 2024-08-31T02:07:58.727+0000 7f48ab9d9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-31T02:07:59.449 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:59 smithi163 bash[24766]: debug 2024-08-31T02:07:59.111+0000 7f48ab9d9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-31T02:07:59.449 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:07:59 smithi163 bash[24766]: debug 2024-08-31T02:07:59.187+0000 7f48ab9d9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-31T02:07:59.695 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:07:59.746 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi027:vg_nvme/lv_4 2024-08-31T02:07:59.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:59 smithi191 bash[24992]: cluster 2024-08-31T02:07:59.214028+0000 mon.a (mon.0) 300 : cluster [DBG] Standby manager daemon b started 2024-08-31T02:07:59.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:59 smithi191 bash[24992]: audit 2024-08-31T02:07:59.214735+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-08-31T02:07:59.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:59 smithi191 bash[24992]: audit 2024-08-31T02:07:59.215444+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T02:07:59.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:59 smithi191 bash[24992]: audit 2024-08-31T02:07:59.216623+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-08-31T02:07:59.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:07:59 smithi191 bash[24992]: audit 2024-08-31T02:07:59.217210+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T02:07:59.799 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:59 smithi027 bash[22610]: cluster 2024-08-31T02:07:59.214028+0000 mon.a (mon.0) 300 : cluster [DBG] Standby manager daemon b started 2024-08-31T02:07:59.799 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:59 smithi027 bash[22610]: audit 2024-08-31T02:07:59.214735+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-08-31T02:07:59.799 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:59 smithi027 bash[22610]: audit 2024-08-31T02:07:59.215444+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T02:07:59.799 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:59 smithi027 bash[22610]: audit 2024-08-31T02:07:59.216623+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-08-31T02:07:59.799 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:07:59 smithi027 bash[22610]: audit 2024-08-31T02:07:59.217210+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T02:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:59 smithi163 bash[24253]: cluster 2024-08-31T02:07:59.214028+0000 mon.a (mon.0) 300 : cluster [DBG] Standby manager daemon b started 2024-08-31T02:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:59 smithi163 bash[24253]: audit 2024-08-31T02:07:59.214735+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-08-31T02:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:59 smithi163 bash[24253]: audit 2024-08-31T02:07:59.215444+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T02:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:59 smithi163 bash[24253]: audit 2024-08-31T02:07:59.216623+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-08-31T02:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:07:59 smithi163 bash[24253]: audit 2024-08-31T02:07:59.217210+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.163:0/2261807433' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T02:08:00.797 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:00 smithi027 bash[22610]: cluster 2024-08-31T02:07:58.908742+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:00.797 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:00 smithi027 bash[22610]: cluster 2024-08-31T02:07:59.550315+0000 mon.a (mon.0) 301 : cluster [DBG] mgrmap e14: a(active, since 116s), standbys: b 2024-08-31T02:08:00.797 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:00 smithi027 bash[22610]: audit 2024-08-31T02:07:59.550561+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-08-31T02:08:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:00 smithi163 bash[24253]: cluster 2024-08-31T02:07:58.908742+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:00 smithi163 bash[24253]: cluster 2024-08-31T02:07:59.550315+0000 mon.a (mon.0) 301 : cluster [DBG] mgrmap e14: a(active, since 116s), standbys: b 2024-08-31T02:08:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:00 smithi163 bash[24253]: audit 2024-08-31T02:07:59.550561+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-08-31T02:08:01.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:00 smithi191 bash[24992]: cluster 2024-08-31T02:07:58.908742+0000 mgr.a (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:01.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:00 smithi191 bash[24992]: cluster 2024-08-31T02:07:59.550315+0000 mon.a (mon.0) 301 : cluster [DBG] mgrmap e14: a(active, since 116s), standbys: b 2024-08-31T02:08:01.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:00 smithi191 bash[24992]: audit 2024-08-31T02:07:59.550561+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-08-31T02:08:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:02 smithi027 bash[22610]: cluster 2024-08-31T02:08:00.909038+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:02 smithi027 bash[22610]: audit 2024-08-31T02:08:01.467888+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:02 smithi027 bash[22610]: audit 2024-08-31T02:08:01.474280+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:02 smithi027 bash[22610]: audit 2024-08-31T02:08:01.477124+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:08:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:02 smithi027 bash[22610]: audit 2024-08-31T02:08:02.196788+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:02 smithi027 bash[22610]: audit 2024-08-31T02:08:02.198148+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:08:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:02 smithi027 bash[22610]: audit 2024-08-31T02:08:02.207008+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:02.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:02 smithi191 bash[24992]: cluster 2024-08-31T02:08:00.909038+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:02.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:02 smithi191 bash[24992]: audit 2024-08-31T02:08:01.467888+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:02.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:02 smithi191 bash[24992]: audit 2024-08-31T02:08:01.474280+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:02.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:02 smithi191 bash[24992]: audit 2024-08-31T02:08:01.477124+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:08:02.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:02 smithi191 bash[24992]: audit 2024-08-31T02:08:02.196788+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:02.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:02 smithi191 bash[24992]: audit 2024-08-31T02:08:02.198148+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:08:02.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:02 smithi191 bash[24992]: audit 2024-08-31T02:08:02.207008+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:02 smithi163 bash[24253]: cluster 2024-08-31T02:08:00.909038+0000 mgr.a (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:02 smithi163 bash[24253]: audit 2024-08-31T02:08:01.467888+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:02 smithi163 bash[24253]: audit 2024-08-31T02:08:01.474280+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:02 smithi163 bash[24253]: audit 2024-08-31T02:08:01.477124+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:08:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:02 smithi163 bash[24253]: audit 2024-08-31T02:08:02.196788+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:02 smithi163 bash[24253]: audit 2024-08-31T02:08:02.198148+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:08:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:02 smithi163 bash[24253]: audit 2024-08-31T02:08:02.207008+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:04.517 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:08:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:04 smithi027 bash[22610]: cluster 2024-08-31T02:08:02.909466+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:04.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:04 smithi191 bash[24992]: cluster 2024-08-31T02:08:02.909466+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:04 smithi163 bash[24253]: cluster 2024-08-31T02:08:02.909466+0000 mgr.a (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:06 smithi027 bash[22610]: cluster 2024-08-31T02:08:04.909937+0000 mgr.a (mgr.14150) 103 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:06 smithi027 bash[22610]: audit 2024-08-31T02:08:05.780747+0000 mgr.a (mgr.14150) 104 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:08:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:06 smithi027 bash[22610]: audit 2024-08-31T02:08:05.783589+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T02:08:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:06 smithi027 bash[22610]: audit 2024-08-31T02:08:05.789148+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T02:08:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:06 smithi027 bash[22610]: audit 2024-08-31T02:08:05.790329+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:06.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:06 smithi191 bash[24992]: cluster 2024-08-31T02:08:04.909937+0000 mgr.a (mgr.14150) 103 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:06.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:06 smithi191 bash[24992]: audit 2024-08-31T02:08:05.780747+0000 mgr.a (mgr.14150) 104 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:08:06.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:06 smithi191 bash[24992]: audit 2024-08-31T02:08:05.783589+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T02:08:06.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:06 smithi191 bash[24992]: audit 2024-08-31T02:08:05.789148+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T02:08:06.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:06 smithi191 bash[24992]: audit 2024-08-31T02:08:05.790329+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:06 smithi163 bash[24253]: cluster 2024-08-31T02:08:04.909937+0000 mgr.a (mgr.14150) 103 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:06 smithi163 bash[24253]: audit 2024-08-31T02:08:05.780747+0000 mgr.a (mgr.14150) 104 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:08:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:06 smithi163 bash[24253]: audit 2024-08-31T02:08:05.783589+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T02:08:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:06 smithi163 bash[24253]: audit 2024-08-31T02:08:05.789148+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T02:08:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:06 smithi163 bash[24253]: audit 2024-08-31T02:08:05.790329+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:08 smithi027 bash[22610]: cluster 2024-08-31T02:08:06.910340+0000 mgr.a (mgr.14150) 105 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:08.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:08 smithi191 bash[24992]: cluster 2024-08-31T02:08:06.910340+0000 mgr.a (mgr.14150) 105 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:08 smithi163 bash[24253]: cluster 2024-08-31T02:08:06.910340+0000 mgr.a (mgr.14150) 105 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:10.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:10 smithi191 bash[24992]: cluster 2024-08-31T02:08:08.910834+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:10.934 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:10 smithi027 bash[22610]: cluster 2024-08-31T02:08:08.910834+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:10 smithi163 bash[24253]: cluster 2024-08-31T02:08:08.910834+0000 mgr.a (mgr.14150) 106 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:12.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:12 smithi191 bash[24992]: cluster 2024-08-31T02:08:10.911250+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:12 smithi163 bash[24253]: cluster 2024-08-31T02:08:10.911250+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:12 smithi027 bash[22610]: cluster 2024-08-31T02:08:10.911250+0000 mgr.a (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:14.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:14 smithi191 bash[24992]: cluster 2024-08-31T02:08:12.911686+0000 mgr.a (mgr.14150) 108 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:14.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:14 smithi191 bash[24992]: audit 2024-08-31T02:08:14.279020+0000 mon.a (mon.0) 312 : audit [INF] from='client.? 172.21.15.27:0/3015867698' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ef3f583-172f-4979-a8bf-888626b06aa6"}]: dispatch 2024-08-31T02:08:14.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:14 smithi191 bash[24992]: audit 2024-08-31T02:08:14.281511+0000 mon.a (mon.0) 313 : audit [INF] from='client.? 172.21.15.27:0/3015867698' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ef3f583-172f-4979-a8bf-888626b06aa6"}]': finished 2024-08-31T02:08:14.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:14 smithi191 bash[24992]: cluster 2024-08-31T02:08:14.285097+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-08-31T02:08:14.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:14 smithi191 bash[24992]: audit 2024-08-31T02:08:14.285469+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:14 smithi163 bash[24253]: cluster 2024-08-31T02:08:12.911686+0000 mgr.a (mgr.14150) 108 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:14 smithi163 bash[24253]: audit 2024-08-31T02:08:14.279020+0000 mon.a (mon.0) 312 : audit [INF] from='client.? 172.21.15.27:0/3015867698' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ef3f583-172f-4979-a8bf-888626b06aa6"}]: dispatch 2024-08-31T02:08:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:14 smithi163 bash[24253]: audit 2024-08-31T02:08:14.281511+0000 mon.a (mon.0) 313 : audit [INF] from='client.? 172.21.15.27:0/3015867698' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ef3f583-172f-4979-a8bf-888626b06aa6"}]': finished 2024-08-31T02:08:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:14 smithi163 bash[24253]: cluster 2024-08-31T02:08:14.285097+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-08-31T02:08:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:14 smithi163 bash[24253]: audit 2024-08-31T02:08:14.285469+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:14 smithi027 bash[22610]: cluster 2024-08-31T02:08:12.911686+0000 mgr.a (mgr.14150) 108 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:14 smithi027 bash[22610]: audit 2024-08-31T02:08:14.279020+0000 mon.a (mon.0) 312 : audit [INF] from='client.? 172.21.15.27:0/3015867698' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ef3f583-172f-4979-a8bf-888626b06aa6"}]: dispatch 2024-08-31T02:08:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:14 smithi027 bash[22610]: audit 2024-08-31T02:08:14.281511+0000 mon.a (mon.0) 313 : audit [INF] from='client.? 172.21.15.27:0/3015867698' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ef3f583-172f-4979-a8bf-888626b06aa6"}]': finished 2024-08-31T02:08:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:14 smithi027 bash[22610]: cluster 2024-08-31T02:08:14.285097+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-08-31T02:08:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:14 smithi027 bash[22610]: audit 2024-08-31T02:08:14.285469+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:15.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:15 smithi191 bash[24992]: audit 2024-08-31T02:08:14.939424+0000 mon.a (mon.0) 316 : audit [DBG] from='client.? 172.21.15.27:0/634032238' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T02:08:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:15 smithi163 bash[24253]: audit 2024-08-31T02:08:14.939424+0000 mon.a (mon.0) 316 : audit [DBG] from='client.? 172.21.15.27:0/634032238' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T02:08:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:15 smithi027 bash[22610]: audit 2024-08-31T02:08:14.939424+0000 mon.a (mon.0) 316 : audit [DBG] from='client.? 172.21.15.27:0/634032238' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T02:08:16.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:16 smithi191 bash[24992]: cluster 2024-08-31T02:08:14.912153+0000 mgr.a (mgr.14150) 109 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:16 smithi163 bash[24253]: cluster 2024-08-31T02:08:14.912153+0000 mgr.a (mgr.14150) 109 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:16 smithi027 bash[22610]: cluster 2024-08-31T02:08:14.912153+0000 mgr.a (mgr.14150) 109 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:18 smithi027 bash[22610]: cluster 2024-08-31T02:08:16.912663+0000 mgr.a (mgr.14150) 110 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:18.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:18 smithi191 bash[24992]: cluster 2024-08-31T02:08:16.912663+0000 mgr.a (mgr.14150) 110 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:18 smithi163 bash[24253]: cluster 2024-08-31T02:08:16.912663+0000 mgr.a (mgr.14150) 110 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:20.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:20 smithi191 bash[24992]: cluster 2024-08-31T02:08:18.913226+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:20 smithi163 bash[24253]: cluster 2024-08-31T02:08:18.913226+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:20 smithi027 bash[22610]: cluster 2024-08-31T02:08:18.913226+0000 mgr.a (mgr.14150) 111 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:22.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:22 smithi191 bash[24992]: cluster 2024-08-31T02:08:20.913692+0000 mgr.a (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:22 smithi163 bash[24253]: cluster 2024-08-31T02:08:20.913692+0000 mgr.a (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:22 smithi027 bash[22610]: cluster 2024-08-31T02:08:20.913692+0000 mgr.a (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:24.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:24 smithi191 bash[24992]: cluster 2024-08-31T02:08:22.914131+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:24 smithi163 bash[24253]: cluster 2024-08-31T02:08:22.914131+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:24.969 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:24 smithi027 bash[22610]: cluster 2024-08-31T02:08:22.914131+0000 mgr.a (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:26.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:26 smithi191 bash[24992]: cluster 2024-08-31T02:08:24.914656+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:26 smithi163 bash[24253]: cluster 2024-08-31T02:08:24.914656+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:26.957 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:26 smithi027 bash[22610]: cluster 2024-08-31T02:08:24.914656+0000 mgr.a (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:28.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:28 smithi191 bash[24992]: cluster 2024-08-31T02:08:26.915172+0000 mgr.a (mgr.14150) 115 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:28.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:28 smithi191 bash[24992]: audit 2024-08-31T02:08:27.580042+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-31T02:08:28.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:28 smithi191 bash[24992]: audit 2024-08-31T02:08:27.581740+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:28.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:28 smithi191 bash[24992]: cephadm 2024-08-31T02:08:27.583298+0000 mgr.a (mgr.14150) 116 : cephadm [INF] Deploying daemon osd.0 on smithi027 2024-08-31T02:08:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:28 smithi163 bash[24253]: cluster 2024-08-31T02:08:26.915172+0000 mgr.a (mgr.14150) 115 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:28 smithi163 bash[24253]: audit 2024-08-31T02:08:27.580042+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-31T02:08:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:28 smithi163 bash[24253]: audit 2024-08-31T02:08:27.581740+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:28 smithi163 bash[24253]: cephadm 2024-08-31T02:08:27.583298+0000 mgr.a (mgr.14150) 116 : cephadm [INF] Deploying daemon osd.0 on smithi027 2024-08-31T02:08:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:28 smithi027 bash[22610]: cluster 2024-08-31T02:08:26.915172+0000 mgr.a (mgr.14150) 115 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:28 smithi027 bash[22610]: audit 2024-08-31T02:08:27.580042+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-31T02:08:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:28 smithi027 bash[22610]: audit 2024-08-31T02:08:27.581740+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:28 smithi027 bash[22610]: cephadm 2024-08-31T02:08:27.583298+0000 mgr.a (mgr.14150) 116 : cephadm [INF] Deploying daemon osd.0 on smithi027 2024-08-31T02:08:30.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:30 smithi191 bash[24992]: cluster 2024-08-31T02:08:28.915554+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:30.787 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:30 smithi027 bash[22610]: cluster 2024-08-31T02:08:28.915554+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:30 smithi163 bash[24253]: cluster 2024-08-31T02:08:28.915554+0000 mgr.a (mgr.14150) 117 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:31 smithi027 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:08:31.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:08:31 smithi027 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:08:32.237 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:32 smithi027 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:08:32.237 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:08:32 smithi027 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:08:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:32 smithi027 bash[22610]: cluster 2024-08-31T02:08:30.915881+0000 mgr.a (mgr.14150) 118 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:32 smithi027 bash[22610]: audit 2024-08-31T02:08:32.278382+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:08:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:32 smithi027 bash[22610]: audit 2024-08-31T02:08:32.282119+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:32 smithi027 bash[22610]: audit 2024-08-31T02:08:32.286088+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:32.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:32 smithi191 bash[24992]: cluster 2024-08-31T02:08:30.915881+0000 mgr.a (mgr.14150) 118 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:32.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:32 smithi191 bash[24992]: audit 2024-08-31T02:08:32.278382+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:08:32.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:32 smithi191 bash[24992]: audit 2024-08-31T02:08:32.282119+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:32.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:32 smithi191 bash[24992]: audit 2024-08-31T02:08:32.286088+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:32 smithi163 bash[24253]: cluster 2024-08-31T02:08:30.915881+0000 mgr.a (mgr.14150) 118 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:32 smithi163 bash[24253]: audit 2024-08-31T02:08:32.278382+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:08:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:32 smithi163 bash[24253]: audit 2024-08-31T02:08:32.282119+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:32 smithi163 bash[24253]: audit 2024-08-31T02:08:32.286088+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:34 smithi163 bash[24253]: cluster 2024-08-31T02:08:32.916268+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:34 smithi027 bash[22610]: cluster 2024-08-31T02:08:32.916268+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:35.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:34 smithi191 bash[24992]: cluster 2024-08-31T02:08:32.916268+0000 mgr.a (mgr.14150) 119 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:36 smithi163 bash[24253]: cluster 2024-08-31T02:08:34.916711+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:36 smithi027 bash[22610]: cluster 2024-08-31T02:08:34.916711+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:37.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:36 smithi191 bash[24992]: cluster 2024-08-31T02:08:34.916711+0000 mgr.a (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:38.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:38 smithi027 bash[22610]: cluster 2024-08-31T02:08:36.917179+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:38.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:38 smithi027 bash[22610]: audit 2024-08-31T02:08:37.842255+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:38.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:38 smithi027 bash[22610]: audit 2024-08-31T02:08:37.848186+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:38.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:38 smithi027 bash[22610]: audit 2024-08-31T02:08:38.489170+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:38.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:38 smithi027 bash[22610]: audit 2024-08-31T02:08:38.490390+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:08:38.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:38 smithi027 bash[22610]: audit 2024-08-31T02:08:38.498568+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:38 smithi163 bash[24253]: cluster 2024-08-31T02:08:36.917179+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:38 smithi163 bash[24253]: audit 2024-08-31T02:08:37.842255+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:38 smithi163 bash[24253]: audit 2024-08-31T02:08:37.848186+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:38 smithi163 bash[24253]: audit 2024-08-31T02:08:38.489170+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:38 smithi163 bash[24253]: audit 2024-08-31T02:08:38.490390+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:08:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:38 smithi163 bash[24253]: audit 2024-08-31T02:08:38.498568+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:38 smithi191 bash[24992]: cluster 2024-08-31T02:08:36.917179+0000 mgr.a (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:38 smithi191 bash[24992]: audit 2024-08-31T02:08:37.842255+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:38 smithi191 bash[24992]: audit 2024-08-31T02:08:37.848186+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:38 smithi191 bash[24992]: audit 2024-08-31T02:08:38.489170+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:38 smithi191 bash[24992]: audit 2024-08-31T02:08:38.490390+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:08:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:38 smithi191 bash[24992]: audit 2024-08-31T02:08:38.498568+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:40 smithi163 bash[24253]: cluster 2024-08-31T02:08:38.917662+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:40 smithi027 bash[22610]: cluster 2024-08-31T02:08:38.917662+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:41.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:40 smithi191 bash[24992]: cluster 2024-08-31T02:08:38.917662+0000 mgr.a (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:41 smithi163 bash[24253]: audit 2024-08-31T02:08:41.090803+0000 mon.a (mon.0) 327 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-31T02:08:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:41 smithi027 bash[22610]: audit 2024-08-31T02:08:41.090803+0000 mon.a (mon.0) 327 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-31T02:08:42.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:41 smithi191 bash[24992]: audit 2024-08-31T02:08:41.090803+0000 mon.a (mon.0) 327 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-31T02:08:42.292 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 0 on host 'smithi027' 2024-08-31T02:08:42.894 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:42 smithi027 bash[22610]: cluster 2024-08-31T02:08:40.918036+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:42.894 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:42 smithi027 bash[22610]: audit 2024-08-31T02:08:41.556684+0000 mon.a (mon.0) 328 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T02:08:42.894 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:42 smithi027 bash[22610]: cluster 2024-08-31T02:08:41.558993+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-08-31T02:08:42.894 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:42 smithi027 bash[22610]: audit 2024-08-31T02:08:41.559282+0000 mon.a (mon.0) 330 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-08-31T02:08:42.894 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:42 smithi027 bash[22610]: audit 2024-08-31T02:08:41.559592+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:42.894 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:42 smithi027 bash[22610]: audit 2024-08-31T02:08:42.277649+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:08:42.894 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:42 smithi027 bash[22610]: audit 2024-08-31T02:08:42.283005+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:42.895 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:42 smithi027 bash[22610]: audit 2024-08-31T02:08:42.288349+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:42.896 DEBUG:teuthology.orchestra.run.smithi027:osd.0> sudo journalctl -f -n 0 -u ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@osd.0.service 2024-08-31T02:08:42.938 INFO:tasks.cephadm:Deploying osd.1 on smithi163 with /dev/vg_nvme/lv_4... 2024-08-31T02:08:42.939 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T02:08:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:42 smithi163 bash[24253]: cluster 2024-08-31T02:08:40.918036+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:42 smithi163 bash[24253]: audit 2024-08-31T02:08:41.556684+0000 mon.a (mon.0) 328 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T02:08:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:42 smithi163 bash[24253]: cluster 2024-08-31T02:08:41.558993+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-08-31T02:08:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:42 smithi163 bash[24253]: audit 2024-08-31T02:08:41.559282+0000 mon.a (mon.0) 330 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-08-31T02:08:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:42 smithi163 bash[24253]: audit 2024-08-31T02:08:41.559592+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:42 smithi163 bash[24253]: audit 2024-08-31T02:08:42.277649+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:08:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:42 smithi163 bash[24253]: audit 2024-08-31T02:08:42.283005+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:42 smithi163 bash[24253]: audit 2024-08-31T02:08:42.288349+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:42 smithi191 bash[24992]: cluster 2024-08-31T02:08:40.918036+0000 mgr.a (mgr.14150) 123 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:42 smithi191 bash[24992]: audit 2024-08-31T02:08:41.556684+0000 mon.a (mon.0) 328 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T02:08:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:42 smithi191 bash[24992]: cluster 2024-08-31T02:08:41.558993+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-08-31T02:08:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:42 smithi191 bash[24992]: audit 2024-08-31T02:08:41.559282+0000 mon.a (mon.0) 330 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-08-31T02:08:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:42 smithi191 bash[24992]: audit 2024-08-31T02:08:41.559592+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:42 smithi191 bash[24992]: audit 2024-08-31T02:08:42.277649+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:08:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:42 smithi191 bash[24992]: audit 2024-08-31T02:08:42.283005+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:43.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:42 smithi191 bash[24992]: audit 2024-08-31T02:08:42.288349+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:43 smithi163 bash[24253]: audit 2024-08-31T02:08:42.559117+0000 mon.a (mon.0) 335 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-08-31T02:08:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:43 smithi163 bash[24253]: cluster 2024-08-31T02:08:42.563881+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-08-31T02:08:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:43 smithi163 bash[24253]: audit 2024-08-31T02:08:42.565142+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:43 smithi163 bash[24253]: audit 2024-08-31T02:08:42.574083+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:43 smithi027 bash[22610]: audit 2024-08-31T02:08:42.559117+0000 mon.a (mon.0) 335 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-08-31T02:08:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:43 smithi027 bash[22610]: cluster 2024-08-31T02:08:42.563881+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-08-31T02:08:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:43 smithi027 bash[22610]: audit 2024-08-31T02:08:42.565142+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:43 smithi027 bash[22610]: audit 2024-08-31T02:08:42.574083+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:44.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:43 smithi191 bash[24992]: audit 2024-08-31T02:08:42.559117+0000 mon.a (mon.0) 335 : audit [INF] from='osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-08-31T02:08:44.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:43 smithi191 bash[24992]: cluster 2024-08-31T02:08:42.563881+0000 mon.a (mon.0) 336 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-08-31T02:08:44.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:43 smithi191 bash[24992]: audit 2024-08-31T02:08:42.565142+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:44.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:43 smithi191 bash[24992]: audit 2024-08-31T02:08:42.574083+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:44 smithi163 bash[24253]: cluster 2024-08-31T02:08:42.113132+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-08-31T02:08:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:44 smithi163 bash[24253]: cluster 2024-08-31T02:08:42.113274+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-08-31T02:08:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:44 smithi163 bash[24253]: cluster 2024-08-31T02:08:42.918429+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:44 smithi163 bash[24253]: cluster 2024-08-31T02:08:43.573385+0000 mon.a (mon.0) 339 : cluster [INF] osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736] boot 2024-08-31T02:08:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:44 smithi163 bash[24253]: cluster 2024-08-31T02:08:43.573449+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-08-31T02:08:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:44 smithi163 bash[24253]: audit 2024-08-31T02:08:43.574093+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:44 smithi027 bash[22610]: cluster 2024-08-31T02:08:42.113132+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-08-31T02:08:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:44 smithi027 bash[22610]: cluster 2024-08-31T02:08:42.113274+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-08-31T02:08:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:44 smithi027 bash[22610]: cluster 2024-08-31T02:08:42.918429+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:44 smithi027 bash[22610]: cluster 2024-08-31T02:08:43.573385+0000 mon.a (mon.0) 339 : cluster [INF] osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736] boot 2024-08-31T02:08:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:44 smithi027 bash[22610]: cluster 2024-08-31T02:08:43.573449+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-08-31T02:08:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:44 smithi027 bash[22610]: audit 2024-08-31T02:08:43.574093+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:45.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:44 smithi191 bash[24992]: cluster 2024-08-31T02:08:42.113132+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-08-31T02:08:45.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:44 smithi191 bash[24992]: cluster 2024-08-31T02:08:42.113274+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-08-31T02:08:45.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:44 smithi191 bash[24992]: cluster 2024-08-31T02:08:42.918429+0000 mgr.a (mgr.14150) 124 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T02:08:45.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:44 smithi191 bash[24992]: cluster 2024-08-31T02:08:43.573385+0000 mon.a (mon.0) 339 : cluster [INF] osd.0 [v2:172.21.15.27:6802/2589790736,v1:172.21.15.27:6803/2589790736] boot 2024-08-31T02:08:45.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:44 smithi191 bash[24992]: cluster 2024-08-31T02:08:43.573449+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-08-31T02:08:45.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:44 smithi191 bash[24992]: audit 2024-08-31T02:08:43.574093+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:08:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:45 smithi163 bash[24253]: cluster 2024-08-31T02:08:44.593666+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-08-31T02:08:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:45 smithi027 bash[22610]: cluster 2024-08-31T02:08:44.593666+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-08-31T02:08:46.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:45 smithi191 bash[24992]: cluster 2024-08-31T02:08:44.593666+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-08-31T02:08:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:46 smithi163 bash[24253]: cluster 2024-08-31T02:08:44.918941+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:46 smithi027 bash[22610]: cluster 2024-08-31T02:08:44.918941+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:47.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:46 smithi191 bash[24992]: cluster 2024-08-31T02:08:44.918941+0000 mgr.a (mgr.14150) 125 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:47.663 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T02:08:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:48 smithi027 bash[22610]: cluster 2024-08-31T02:08:46.919408+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:48.917 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:48 smithi163 bash[24253]: cluster 2024-08-31T02:08:46.919408+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:49.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:48 smithi191 bash[24992]: cluster 2024-08-31T02:08:46.919408+0000 mgr.a (mgr.14150) 126 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:50 smithi163 bash[24253]: cluster 2024-08-31T02:08:48.919887+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:50 smithi027 bash[22610]: cluster 2024-08-31T02:08:48.919887+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:51.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:50 smithi191 bash[24992]: cluster 2024-08-31T02:08:48.919887+0000 mgr.a (mgr.14150) 127 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:51.754 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-08-31T02:08:51.804 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi163:vg_nvme/lv_4 2024-08-31T02:08:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:52 smithi163 bash[24253]: cluster 2024-08-31T02:08:50.920359+0000 mgr.a (mgr.14150) 128 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:52 smithi163 bash[24253]: audit 2024-08-31T02:08:52.028062+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:52 smithi163 bash[24253]: audit 2024-08-31T02:08:52.035447+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:52 smithi163 bash[24253]: audit 2024-08-31T02:08:52.037949+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:08:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:52 smithi163 bash[24253]: audit 2024-08-31T02:08:52.045186+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:52 smithi163 bash[24253]: audit 2024-08-31T02:08:52.049016+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:52 smithi163 bash[24253]: audit 2024-08-31T02:08:52.050509+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:08:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:52 smithi163 bash[24253]: audit 2024-08-31T02:08:52.059547+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:52 smithi027 bash[22610]: cluster 2024-08-31T02:08:50.920359+0000 mgr.a (mgr.14150) 128 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:52 smithi027 bash[22610]: audit 2024-08-31T02:08:52.028062+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:52 smithi027 bash[22610]: audit 2024-08-31T02:08:52.035447+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:52 smithi027 bash[22610]: audit 2024-08-31T02:08:52.037949+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:08:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:52 smithi027 bash[22610]: audit 2024-08-31T02:08:52.045186+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:52 smithi027 bash[22610]: audit 2024-08-31T02:08:52.049016+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:52 smithi027 bash[22610]: audit 2024-08-31T02:08:52.050509+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:08:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:52 smithi027 bash[22610]: audit 2024-08-31T02:08:52.059547+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:52 smithi191 bash[24992]: cluster 2024-08-31T02:08:50.920359+0000 mgr.a (mgr.14150) 128 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:52 smithi191 bash[24992]: audit 2024-08-31T02:08:52.028062+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:52 smithi191 bash[24992]: audit 2024-08-31T02:08:52.035447+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:52 smithi191 bash[24992]: audit 2024-08-31T02:08:52.037949+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:08:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:52 smithi191 bash[24992]: audit 2024-08-31T02:08:52.045186+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:52 smithi191 bash[24992]: audit 2024-08-31T02:08:52.049016+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:52 smithi191 bash[24992]: audit 2024-08-31T02:08:52.050509+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:08:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:52 smithi191 bash[24992]: audit 2024-08-31T02:08:52.059547+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:08:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:53 smithi163 bash[24253]: cephadm 2024-08-31T02:08:52.019686+0000 mgr.a (mgr.14150) 129 : cephadm [INF] Detected new or changed devices on smithi027 2024-08-31T02:08:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:53 smithi163 bash[24253]: cephadm 2024-08-31T02:08:52.039183+0000 mgr.a (mgr.14150) 130 : cephadm [INF] Adjusting osd_memory_target on smithi027 to 17265M 2024-08-31T02:08:53.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:53 smithi027 bash[22610]: cephadm 2024-08-31T02:08:52.019686+0000 mgr.a (mgr.14150) 129 : cephadm [INF] Detected new or changed devices on smithi027 2024-08-31T02:08:53.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:53 smithi027 bash[22610]: cephadm 2024-08-31T02:08:52.039183+0000 mgr.a (mgr.14150) 130 : cephadm [INF] Adjusting osd_memory_target on smithi027 to 17265M 2024-08-31T02:08:54.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:53 smithi191 bash[24992]: cephadm 2024-08-31T02:08:52.019686+0000 mgr.a (mgr.14150) 129 : cephadm [INF] Detected new or changed devices on smithi027 2024-08-31T02:08:54.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:53 smithi191 bash[24992]: cephadm 2024-08-31T02:08:52.039183+0000 mgr.a (mgr.14150) 130 : cephadm [INF] Adjusting osd_memory_target on smithi027 to 17265M 2024-08-31T02:08:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:54 smithi163 bash[24253]: cluster 2024-08-31T02:08:52.920838+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:54 smithi027 bash[22610]: cluster 2024-08-31T02:08:52.920838+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:55.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:54 smithi191 bash[24992]: cluster 2024-08-31T02:08:52.920838+0000 mgr.a (mgr.14150) 131 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:56.570 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T02:08:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:56 smithi163 bash[24253]: cluster 2024-08-31T02:08:54.921306+0000 mgr.a (mgr.14150) 132 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:56 smithi027 bash[22610]: cluster 2024-08-31T02:08:54.921306+0000 mgr.a (mgr.14150) 132 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:57.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:56 smithi191 bash[24992]: cluster 2024-08-31T02:08:54.921306+0000 mgr.a (mgr.14150) 132 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:58 smithi163 bash[24253]: cluster 2024-08-31T02:08:56.921742+0000 mgr.a (mgr.14150) 133 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:58 smithi163 bash[24253]: audit 2024-08-31T02:08:57.959203+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T02:08:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:58 smithi163 bash[24253]: audit 2024-08-31T02:08:57.965230+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T02:08:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:58 smithi163 bash[24253]: audit 2024-08-31T02:08:57.966840+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:58 smithi027 bash[22610]: cluster 2024-08-31T02:08:56.921742+0000 mgr.a (mgr.14150) 133 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:58 smithi027 bash[22610]: audit 2024-08-31T02:08:57.959203+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T02:08:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:58 smithi027 bash[22610]: audit 2024-08-31T02:08:57.965230+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T02:08:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:58 smithi027 bash[22610]: audit 2024-08-31T02:08:57.966840+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:59.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:58 smithi191 bash[24992]: cluster 2024-08-31T02:08:56.921742+0000 mgr.a (mgr.14150) 133 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:08:59.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:58 smithi191 bash[24992]: audit 2024-08-31T02:08:57.959203+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T02:08:59.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:58 smithi191 bash[24992]: audit 2024-08-31T02:08:57.965230+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T02:08:59.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:58 smithi191 bash[24992]: audit 2024-08-31T02:08:57.966840+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:08:59.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:08:59 smithi163 bash[24253]: audit 2024-08-31T02:08:57.952408+0000 mgr.a (mgr.14150) 134 : audit [DBG] from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:08:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:08:59 smithi027 bash[22610]: audit 2024-08-31T02:08:57.952408+0000 mgr.a (mgr.14150) 134 : audit [DBG] from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:09:00.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:08:59 smithi191 bash[24992]: audit 2024-08-31T02:08:57.952408+0000 mgr.a (mgr.14150) 134 : audit [DBG] from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:09:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:00 smithi163 bash[24253]: cluster 2024-08-31T02:08:58.922196+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:00 smithi027 bash[22610]: cluster 2024-08-31T02:08:58.922196+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:01.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:00 smithi191 bash[24992]: cluster 2024-08-31T02:08:58.922196+0000 mgr.a (mgr.14150) 135 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:02.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:02 smithi163 bash[24253]: cluster 2024-08-31T02:09:00.922779+0000 mgr.a (mgr.14150) 136 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:02 smithi027 bash[22610]: cluster 2024-08-31T02:09:00.922779+0000 mgr.a (mgr.14150) 136 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:03.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:02 smithi191 bash[24992]: cluster 2024-08-31T02:09:00.922779+0000 mgr.a (mgr.14150) 136 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:04.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:04 smithi163 bash[24253]: cluster 2024-08-31T02:09:02.923277+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:04 smithi027 bash[22610]: cluster 2024-08-31T02:09:02.923277+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:05.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:04 smithi191 bash[24992]: cluster 2024-08-31T02:09:02.923277+0000 mgr.a (mgr.14150) 137 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:06.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:06 smithi163 bash[24253]: cluster 2024-08-31T02:09:04.923870+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:06 smithi027 bash[22610]: cluster 2024-08-31T02:09:04.923870+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:07.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:06 smithi191 bash[24992]: cluster 2024-08-31T02:09:04.923870+0000 mgr.a (mgr.14150) 138 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:07 smithi163 bash[24253]: audit 2024-08-31T02:09:06.758410+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.163:0/844800552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40e2bd1e-964a-4db4-acba-e52c1a5b5432"}]: dispatch 2024-08-31T02:09:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:07 smithi163 bash[24253]: audit 2024-08-31T02:09:06.758908+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40e2bd1e-964a-4db4-acba-e52c1a5b5432"}]: dispatch 2024-08-31T02:09:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:07 smithi163 bash[24253]: audit 2024-08-31T02:09:06.762235+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40e2bd1e-964a-4db4-acba-e52c1a5b5432"}]': finished 2024-08-31T02:09:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:07 smithi163 bash[24253]: cluster 2024-08-31T02:09:06.767085+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-08-31T02:09:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:07 smithi163 bash[24253]: audit 2024-08-31T02:09:06.767606+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:07 smithi163 bash[24253]: audit 2024-08-31T02:09:07.389016+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.163:0/137061986' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T02:09:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:07 smithi027 bash[22610]: audit 2024-08-31T02:09:06.758410+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.163:0/844800552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40e2bd1e-964a-4db4-acba-e52c1a5b5432"}]: dispatch 2024-08-31T02:09:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:07 smithi027 bash[22610]: audit 2024-08-31T02:09:06.758908+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40e2bd1e-964a-4db4-acba-e52c1a5b5432"}]: dispatch 2024-08-31T02:09:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:07 smithi027 bash[22610]: audit 2024-08-31T02:09:06.762235+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40e2bd1e-964a-4db4-acba-e52c1a5b5432"}]': finished 2024-08-31T02:09:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:07 smithi027 bash[22610]: cluster 2024-08-31T02:09:06.767085+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-08-31T02:09:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:07 smithi027 bash[22610]: audit 2024-08-31T02:09:06.767606+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:07 smithi027 bash[22610]: audit 2024-08-31T02:09:07.389016+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.163:0/137061986' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T02:09:08.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:07 smithi191 bash[24992]: audit 2024-08-31T02:09:06.758410+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.163:0/844800552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40e2bd1e-964a-4db4-acba-e52c1a5b5432"}]: dispatch 2024-08-31T02:09:08.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:07 smithi191 bash[24992]: audit 2024-08-31T02:09:06.758908+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40e2bd1e-964a-4db4-acba-e52c1a5b5432"}]: dispatch 2024-08-31T02:09:08.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:07 smithi191 bash[24992]: audit 2024-08-31T02:09:06.762235+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40e2bd1e-964a-4db4-acba-e52c1a5b5432"}]': finished 2024-08-31T02:09:08.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:07 smithi191 bash[24992]: cluster 2024-08-31T02:09:06.767085+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-08-31T02:09:08.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:07 smithi191 bash[24992]: audit 2024-08-31T02:09:06.767606+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:08.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:07 smithi191 bash[24992]: audit 2024-08-31T02:09:07.389016+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.163:0/137061986' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T02:09:09.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:08 smithi191 bash[24992]: cluster 2024-08-31T02:09:06.924414+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:09.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:08 smithi163 bash[24253]: cluster 2024-08-31T02:09:06.924414+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:08 smithi027 bash[22610]: cluster 2024-08-31T02:09:06.924414+0000 mgr.a (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:10.836 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:10 smithi163 bash[24253]: cluster 2024-08-31T02:09:08.924876+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:11.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:10 smithi191 bash[24992]: cluster 2024-08-31T02:09:08.924876+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:10 smithi027 bash[22610]: cluster 2024-08-31T02:09:08.924876+0000 mgr.a (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:12 smithi191 bash[24992]: cluster 2024-08-31T02:09:10.925439+0000 mgr.a (mgr.14150) 141 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:13.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:12 smithi163 bash[24253]: cluster 2024-08-31T02:09:10.925439+0000 mgr.a (mgr.14150) 141 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:12 smithi027 bash[22610]: cluster 2024-08-31T02:09:10.925439+0000 mgr.a (mgr.14150) 141 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:15.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:14 smithi191 bash[24992]: cluster 2024-08-31T02:09:12.925906+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:15.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:14 smithi163 bash[24253]: cluster 2024-08-31T02:09:12.925906+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:14 smithi027 bash[22610]: cluster 2024-08-31T02:09:12.925906+0000 mgr.a (mgr.14150) 142 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:17.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:16 smithi163 bash[24253]: cluster 2024-08-31T02:09:14.926433+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:16 smithi027 bash[22610]: cluster 2024-08-31T02:09:14.926433+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:17.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:16 smithi191 bash[24992]: cluster 2024-08-31T02:09:14.926433+0000 mgr.a (mgr.14150) 143 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:19.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:18 smithi163 bash[24253]: cluster 2024-08-31T02:09:16.927012+0000 mgr.a (mgr.14150) 144 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:18 smithi027 bash[22610]: cluster 2024-08-31T02:09:16.927012+0000 mgr.a (mgr.14150) 144 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:19.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:18 smithi191 bash[24992]: cluster 2024-08-31T02:09:16.927012+0000 mgr.a (mgr.14150) 144 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:21.131 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:20 smithi163 bash[24253]: cluster 2024-08-31T02:09:18.927503+0000 mgr.a (mgr.14150) 145 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:21.131 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:20 smithi163 bash[24253]: audit 2024-08-31T02:09:20.503650+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-31T02:09:21.131 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:20 smithi163 bash[24253]: audit 2024-08-31T02:09:20.505436+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:20 smithi027 bash[22610]: cluster 2024-08-31T02:09:18.927503+0000 mgr.a (mgr.14150) 145 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:20 smithi027 bash[22610]: audit 2024-08-31T02:09:20.503650+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-31T02:09:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:20 smithi027 bash[22610]: audit 2024-08-31T02:09:20.505436+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:21.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:20 smithi191 bash[24992]: cluster 2024-08-31T02:09:18.927503+0000 mgr.a (mgr.14150) 145 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:21.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:20 smithi191 bash[24992]: audit 2024-08-31T02:09:20.503650+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-31T02:09:21.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:20 smithi191 bash[24992]: audit 2024-08-31T02:09:20.505436+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:22.101 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:21 smithi163 bash[24253]: cephadm 2024-08-31T02:09:20.507062+0000 mgr.a (mgr.14150) 146 : cephadm [INF] Deploying daemon osd.1 on smithi163 2024-08-31T02:09:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:21 smithi027 bash[22610]: cephadm 2024-08-31T02:09:20.507062+0000 mgr.a (mgr.14150) 146 : cephadm [INF] Deploying daemon osd.1 on smithi163 2024-08-31T02:09:22.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:21 smithi191 bash[24992]: cephadm 2024-08-31T02:09:20.507062+0000 mgr.a (mgr.14150) 146 : cephadm [INF] Deploying daemon osd.1 on smithi163 2024-08-31T02:09:23.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:22 smithi163 bash[24253]: cluster 2024-08-31T02:09:20.928052+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:22 smithi027 bash[22610]: cluster 2024-08-31T02:09:20.928052+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:23.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:22 smithi191 bash[24992]: cluster 2024-08-31T02:09:20.928052+0000 mgr.a (mgr.14150) 147 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:25.097 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:24 smithi163 bash[24253]: cluster 2024-08-31T02:09:22.928621+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:25.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:24 smithi027 bash[22610]: cluster 2024-08-31T02:09:22.928621+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:25.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:24 smithi191 bash[24992]: cluster 2024-08-31T02:09:22.928621+0000 mgr.a (mgr.14150) 148 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:25.350 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:25 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:09:25.351 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:09:25 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:09:25.669 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:25 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:09:25.669 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:09:25 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:09:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:25 smithi163 bash[24253]: audit 2024-08-31T02:09:25.603550+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:09:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:25 smithi163 bash[24253]: audit 2024-08-31T02:09:25.610700+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:25 smithi163 bash[24253]: audit 2024-08-31T02:09:25.617982+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:25 smithi027 bash[22610]: audit 2024-08-31T02:09:25.603550+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:09:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:25 smithi027 bash[22610]: audit 2024-08-31T02:09:25.610700+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:25 smithi027 bash[22610]: audit 2024-08-31T02:09:25.617982+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:26.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:25 smithi191 bash[24992]: audit 2024-08-31T02:09:25.603550+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:09:26.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:25 smithi191 bash[24992]: audit 2024-08-31T02:09:25.610700+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:26.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:25 smithi191 bash[24992]: audit 2024-08-31T02:09:25.617982+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:27.095 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:26 smithi163 bash[24253]: cluster 2024-08-31T02:09:24.929183+0000 mgr.a (mgr.14150) 149 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:26 smithi027 bash[22610]: cluster 2024-08-31T02:09:24.929183+0000 mgr.a (mgr.14150) 149 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:27.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:26 smithi191 bash[24992]: cluster 2024-08-31T02:09:24.929183+0000 mgr.a (mgr.14150) 149 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:29.081 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:28 smithi163 bash[24253]: cluster 2024-08-31T02:09:26.929670+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:28 smithi027 bash[22610]: cluster 2024-08-31T02:09:26.929670+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:29.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:28 smithi191 bash[24992]: cluster 2024-08-31T02:09:26.929670+0000 mgr.a (mgr.14150) 150 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:30.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:30 smithi163 bash[24253]: cluster 2024-08-31T02:09:28.930143+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:30 smithi027 bash[22610]: cluster 2024-08-31T02:09:28.930143+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:31.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:30 smithi191 bash[24992]: cluster 2024-08-31T02:09:28.930143+0000 mgr.a (mgr.14150) 151 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:31 smithi027 bash[22610]: cluster 2024-08-31T02:09:30.930603+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:31 smithi027 bash[22610]: audit 2024-08-31T02:09:30.962913+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:31 smithi027 bash[22610]: audit 2024-08-31T02:09:30.972093+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:31 smithi027 bash[22610]: audit 2024-08-31T02:09:31.646998+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:31 smithi027 bash[22610]: audit 2024-08-31T02:09:31.648846+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:09:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:31 smithi027 bash[22610]: audit 2024-08-31T02:09:31.657683+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:31 smithi191 bash[24992]: cluster 2024-08-31T02:09:30.930603+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:31 smithi191 bash[24992]: audit 2024-08-31T02:09:30.962913+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:31 smithi191 bash[24992]: audit 2024-08-31T02:09:30.972093+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:31 smithi191 bash[24992]: audit 2024-08-31T02:09:31.646998+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:31 smithi191 bash[24992]: audit 2024-08-31T02:09:31.648846+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:09:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:31 smithi191 bash[24992]: audit 2024-08-31T02:09:31.657683+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:32.332 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:32 smithi163 bash[24253]: cluster 2024-08-31T02:09:30.930603+0000 mgr.a (mgr.14150) 152 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:32.332 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:32 smithi163 bash[24253]: audit 2024-08-31T02:09:30.962913+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:32.332 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:32 smithi163 bash[24253]: audit 2024-08-31T02:09:30.972093+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:32.332 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:32 smithi163 bash[24253]: audit 2024-08-31T02:09:31.646998+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:32.332 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:32 smithi163 bash[24253]: audit 2024-08-31T02:09:31.648846+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:09:32.332 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:32 smithi163 bash[24253]: audit 2024-08-31T02:09:31.657683+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:34.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:33 smithi163 bash[24253]: cluster 2024-08-31T02:09:32.931044+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:34.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:33 smithi163 bash[24253]: audit 2024-08-31T02:09:33.896849+0000 mon.a (mon.0) 367 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-31T02:09:34.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:33 smithi163 bash[24253]: audit 2024-08-31T02:09:33.896868+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.163:6800/3221236780,v1:172.21.15.163:6801/3221236780]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-31T02:09:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:33 smithi027 bash[22610]: cluster 2024-08-31T02:09:32.931044+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:33 smithi027 bash[22610]: audit 2024-08-31T02:09:33.896849+0000 mon.a (mon.0) 367 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-31T02:09:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:33 smithi027 bash[22610]: audit 2024-08-31T02:09:33.896868+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.163:6800/3221236780,v1:172.21.15.163:6801/3221236780]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-31T02:09:34.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:33 smithi191 bash[24992]: cluster 2024-08-31T02:09:32.931044+0000 mgr.a (mgr.14150) 153 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:34.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:33 smithi191 bash[24992]: audit 2024-08-31T02:09:33.896849+0000 mon.a (mon.0) 367 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-31T02:09:34.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:33 smithi191 bash[24992]: audit 2024-08-31T02:09:33.896868+0000 mon.b (mon.2) 9 : audit [INF] from='osd.1 [v2:172.21.15.163:6800/3221236780,v1:172.21.15.163:6801/3221236780]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-31T02:09:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:34 smithi191 bash[24992]: audit 2024-08-31T02:09:33.967006+0000 mon.a (mon.0) 368 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T02:09:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:34 smithi191 bash[24992]: audit 2024-08-31T02:09:33.970881+0000 mon.b (mon.2) 10 : audit [INF] from='osd.1 [v2:172.21.15.163:6800/3221236780,v1:172.21.15.163:6801/3221236780]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-08-31T02:09:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:34 smithi191 bash[24992]: cluster 2024-08-31T02:09:33.974016+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-08-31T02:09:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:34 smithi191 bash[24992]: audit 2024-08-31T02:09:33.974969+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:34 smithi191 bash[24992]: audit 2024-08-31T02:09:33.975642+0000 mon.a (mon.0) 371 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-08-31T02:09:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:34 smithi191 bash[24992]: audit 2024-08-31T02:09:34.969316+0000 mon.a (mon.0) 372 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-08-31T02:09:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:34 smithi191 bash[24992]: cluster 2024-08-31T02:09:34.974160+0000 mon.a (mon.0) 373 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-08-31T02:09:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:34 smithi191 bash[24992]: audit 2024-08-31T02:09:34.974671+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:35.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:34 smithi163 bash[24253]: audit 2024-08-31T02:09:33.967006+0000 mon.a (mon.0) 368 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T02:09:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:34 smithi163 bash[24253]: audit 2024-08-31T02:09:33.970881+0000 mon.b (mon.2) 10 : audit [INF] from='osd.1 [v2:172.21.15.163:6800/3221236780,v1:172.21.15.163:6801/3221236780]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-08-31T02:09:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:34 smithi163 bash[24253]: cluster 2024-08-31T02:09:33.974016+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-08-31T02:09:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:34 smithi163 bash[24253]: audit 2024-08-31T02:09:33.974969+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:34 smithi163 bash[24253]: audit 2024-08-31T02:09:33.975642+0000 mon.a (mon.0) 371 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-08-31T02:09:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:34 smithi163 bash[24253]: audit 2024-08-31T02:09:34.969316+0000 mon.a (mon.0) 372 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-08-31T02:09:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:34 smithi163 bash[24253]: cluster 2024-08-31T02:09:34.974160+0000 mon.a (mon.0) 373 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-08-31T02:09:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:34 smithi163 bash[24253]: audit 2024-08-31T02:09:34.974671+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:34 smithi027 bash[22610]: audit 2024-08-31T02:09:33.967006+0000 mon.a (mon.0) 368 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T02:09:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:34 smithi027 bash[22610]: audit 2024-08-31T02:09:33.970881+0000 mon.b (mon.2) 10 : audit [INF] from='osd.1 [v2:172.21.15.163:6800/3221236780,v1:172.21.15.163:6801/3221236780]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-08-31T02:09:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:34 smithi027 bash[22610]: cluster 2024-08-31T02:09:33.974016+0000 mon.a (mon.0) 369 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-08-31T02:09:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:34 smithi027 bash[22610]: audit 2024-08-31T02:09:33.974969+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:34 smithi027 bash[22610]: audit 2024-08-31T02:09:33.975642+0000 mon.a (mon.0) 371 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2024-08-31T02:09:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:34 smithi027 bash[22610]: audit 2024-08-31T02:09:34.969316+0000 mon.a (mon.0) 372 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2024-08-31T02:09:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:34 smithi027 bash[22610]: cluster 2024-08-31T02:09:34.974160+0000 mon.a (mon.0) 373 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-08-31T02:09:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:34 smithi027 bash[22610]: audit 2024-08-31T02:09:34.974671+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:35.978 INFO:teuthology.orchestra.run.smithi163.stdout:Created osd(s) 1 on host 'smithi163' 2024-08-31T02:09:36.280 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:35 smithi163 bash[24253]: cluster 2024-08-31T02:09:34.931496+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:36.280 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:35 smithi163 bash[24253]: audit 2024-08-31T02:09:34.982895+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:36.280 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:35 smithi163 bash[24253]: audit 2024-08-31T02:09:35.959260+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:09:36.281 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:35 smithi163 bash[24253]: audit 2024-08-31T02:09:35.966272+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:36.281 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:35 smithi163 bash[24253]: audit 2024-08-31T02:09:35.974355+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:36.281 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:35 smithi163 bash[24253]: audit 2024-08-31T02:09:35.981453+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:36.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:35 smithi191 bash[24992]: cluster 2024-08-31T02:09:34.931496+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:36.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:35 smithi191 bash[24992]: audit 2024-08-31T02:09:34.982895+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:36.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:35 smithi191 bash[24992]: audit 2024-08-31T02:09:35.959260+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:09:36.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:35 smithi191 bash[24992]: audit 2024-08-31T02:09:35.966272+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:36.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:35 smithi191 bash[24992]: audit 2024-08-31T02:09:35.974355+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:36.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:35 smithi191 bash[24992]: audit 2024-08-31T02:09:35.981453+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:35 smithi027 bash[22610]: cluster 2024-08-31T02:09:34.931496+0000 mgr.a (mgr.14150) 154 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:35 smithi027 bash[22610]: audit 2024-08-31T02:09:34.982895+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:35 smithi027 bash[22610]: audit 2024-08-31T02:09:35.959260+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:09:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:35 smithi027 bash[22610]: audit 2024-08-31T02:09:35.966272+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:36 smithi027 bash[22610]: audit 2024-08-31T02:09:35.974355+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:36 smithi027 bash[22610]: audit 2024-08-31T02:09:35.981453+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:36.757 DEBUG:teuthology.orchestra.run.smithi163:osd.1> sudo journalctl -f -n 0 -u ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@osd.1.service 2024-08-31T02:09:36.759 INFO:tasks.cephadm:Deploying osd.2 on smithi191 with /dev/vg_nvme/lv_4... 2024-08-31T02:09:36.760 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T02:09:37.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:37 smithi191 bash[24992]: cluster 2024-08-31T02:09:34.919562+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-08-31T02:09:37.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:37 smithi191 bash[24992]: cluster 2024-08-31T02:09:34.919732+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-08-31T02:09:37.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:37 smithi191 bash[24992]: cluster 2024-08-31T02:09:35.991753+0000 mon.a (mon.0) 380 : cluster [INF] osd.1 [v2:172.21.15.163:6800/3221236780,v1:172.21.15.163:6801/3221236780] boot 2024-08-31T02:09:37.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:37 smithi191 bash[24992]: cluster 2024-08-31T02:09:35.991853+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-08-31T02:09:37.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:37 smithi191 bash[24992]: audit 2024-08-31T02:09:35.992478+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:37.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:37 smithi163 bash[24253]: cluster 2024-08-31T02:09:34.919562+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-08-31T02:09:37.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:37 smithi163 bash[24253]: cluster 2024-08-31T02:09:34.919732+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-08-31T02:09:37.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:37 smithi163 bash[24253]: cluster 2024-08-31T02:09:35.991753+0000 mon.a (mon.0) 380 : cluster [INF] osd.1 [v2:172.21.15.163:6800/3221236780,v1:172.21.15.163:6801/3221236780] boot 2024-08-31T02:09:37.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:37 smithi163 bash[24253]: cluster 2024-08-31T02:09:35.991853+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-08-31T02:09:37.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:37 smithi163 bash[24253]: audit 2024-08-31T02:09:35.992478+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:37 smithi027 bash[22610]: cluster 2024-08-31T02:09:34.919562+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-08-31T02:09:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:37 smithi027 bash[22610]: cluster 2024-08-31T02:09:34.919732+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-08-31T02:09:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:37 smithi027 bash[22610]: cluster 2024-08-31T02:09:35.991753+0000 mon.a (mon.0) 380 : cluster [INF] osd.1 [v2:172.21.15.163:6800/3221236780,v1:172.21.15.163:6801/3221236780] boot 2024-08-31T02:09:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:37 smithi027 bash[22610]: cluster 2024-08-31T02:09:35.991853+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-08-31T02:09:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:37 smithi027 bash[22610]: audit 2024-08-31T02:09:35.992478+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:09:38.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:38 smithi191 bash[24992]: cluster 2024-08-31T02:09:36.931935+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:38.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:38 smithi191 bash[24992]: cluster 2024-08-31T02:09:37.008010+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-08-31T02:09:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:38 smithi163 bash[24253]: cluster 2024-08-31T02:09:36.931935+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:38 smithi163 bash[24253]: cluster 2024-08-31T02:09:37.008010+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-08-31T02:09:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:38 smithi027 bash[22610]: cluster 2024-08-31T02:09:36.931935+0000 mgr.a (mgr.14150) 155 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-08-31T02:09:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:38 smithi027 bash[22610]: cluster 2024-08-31T02:09:37.008010+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-08-31T02:09:40.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:40 smithi191 bash[24992]: cluster 2024-08-31T02:09:38.932397+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:40.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:40 smithi163 bash[24253]: cluster 2024-08-31T02:09:38.932397+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:40.476 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T02:09:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:40 smithi027 bash[22610]: cluster 2024-08-31T02:09:38.932397+0000 mgr.a (mgr.14150) 156 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:42.269 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:42 smithi163 bash[24253]: cluster 2024-08-31T02:09:40.932853+0000 mgr.a (mgr.14150) 157 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:42.274 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:42 smithi191 bash[24992]: cluster 2024-08-31T02:09:40.932853+0000 mgr.a (mgr.14150) 157 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:42 smithi027 bash[22610]: cluster 2024-08-31T02:09:40.932853+0000 mgr.a (mgr.14150) 157 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:44.213 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-08-31T02:09:44.263 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi191:vg_nvme/lv_4 2024-08-31T02:09:44.274 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:44 smithi191 bash[24992]: cluster 2024-08-31T02:09:42.933315+0000 mgr.a (mgr.14150) 158 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:44.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:44 smithi163 bash[24253]: cluster 2024-08-31T02:09:42.933315+0000 mgr.a (mgr.14150) 158 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:44 smithi027 bash[22610]: cluster 2024-08-31T02:09:42.933315+0000 mgr.a (mgr.14150) 158 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:46.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:46 smithi191 bash[24992]: cluster 2024-08-31T02:09:44.933789+0000 mgr.a (mgr.14150) 159 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:46.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:46 smithi191 bash[24992]: audit 2024-08-31T02:09:45.983376+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:46.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:46 smithi191 bash[24992]: audit 2024-08-31T02:09:45.992367+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:46.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:46 smithi191 bash[24992]: audit 2024-08-31T02:09:45.994872+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:09:46.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:46 smithi191 bash[24992]: audit 2024-08-31T02:09:46.003852+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:46.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:46 smithi191 bash[24992]: audit 2024-08-31T02:09:46.008000+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:46.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:46 smithi191 bash[24992]: audit 2024-08-31T02:09:46.009747+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:09:46.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:46 smithi163 bash[24253]: cluster 2024-08-31T02:09:44.933789+0000 mgr.a (mgr.14150) 159 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:46.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:46 smithi163 bash[24253]: audit 2024-08-31T02:09:45.983376+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:46.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:46 smithi163 bash[24253]: audit 2024-08-31T02:09:45.992367+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:46.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:46 smithi163 bash[24253]: audit 2024-08-31T02:09:45.994872+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:09:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:46 smithi163 bash[24253]: audit 2024-08-31T02:09:46.003852+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:46 smithi163 bash[24253]: audit 2024-08-31T02:09:46.008000+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:46 smithi163 bash[24253]: audit 2024-08-31T02:09:46.009747+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:09:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:46 smithi027 bash[22610]: cluster 2024-08-31T02:09:44.933789+0000 mgr.a (mgr.14150) 159 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:46 smithi027 bash[22610]: audit 2024-08-31T02:09:45.983376+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:46 smithi027 bash[22610]: audit 2024-08-31T02:09:45.992367+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:46 smithi027 bash[22610]: audit 2024-08-31T02:09:45.994872+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:09:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:46 smithi027 bash[22610]: audit 2024-08-31T02:09:46.003852+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:46 smithi027 bash[22610]: audit 2024-08-31T02:09:46.008000+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:46 smithi027 bash[22610]: audit 2024-08-31T02:09:46.009747+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:09:47.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:47 smithi191 bash[24992]: cephadm 2024-08-31T02:09:45.975135+0000 mgr.a (mgr.14150) 160 : cephadm [INF] Detected new or changed devices on smithi163 2024-08-31T02:09:47.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:47 smithi191 bash[24992]: cephadm 2024-08-31T02:09:45.996308+0000 mgr.a (mgr.14150) 161 : cephadm [INF] Adjusting osd_memory_target on smithi163 to 17265M 2024-08-31T02:09:47.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:47 smithi191 bash[24992]: audit 2024-08-31T02:09:46.020732+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:47.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:47 smithi163 bash[24253]: cephadm 2024-08-31T02:09:45.975135+0000 mgr.a (mgr.14150) 160 : cephadm [INF] Detected new or changed devices on smithi163 2024-08-31T02:09:47.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:47 smithi163 bash[24253]: cephadm 2024-08-31T02:09:45.996308+0000 mgr.a (mgr.14150) 161 : cephadm [INF] Adjusting osd_memory_target on smithi163 to 17265M 2024-08-31T02:09:47.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:47 smithi163 bash[24253]: audit 2024-08-31T02:09:46.020732+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:47 smithi027 bash[22610]: cephadm 2024-08-31T02:09:45.975135+0000 mgr.a (mgr.14150) 160 : cephadm [INF] Detected new or changed devices on smithi163 2024-08-31T02:09:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:47 smithi027 bash[22610]: cephadm 2024-08-31T02:09:45.996308+0000 mgr.a (mgr.14150) 161 : cephadm [INF] Adjusting osd_memory_target on smithi163 to 17265M 2024-08-31T02:09:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:47 smithi027 bash[22610]: audit 2024-08-31T02:09:46.020732+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:09:47.978 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T02:09:48.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:48 smithi163 bash[24253]: cluster 2024-08-31T02:09:46.934256+0000 mgr.a (mgr.14150) 162 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:48 smithi027 bash[22610]: cluster 2024-08-31T02:09:46.934256+0000 mgr.a (mgr.14150) 162 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:48.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:48 smithi191 bash[24992]: cluster 2024-08-31T02:09:46.934256+0000 mgr.a (mgr.14150) 162 : cluster [DBG] pgmap v116: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:50.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:50 smithi163 bash[24253]: cluster 2024-08-31T02:09:48.934759+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:50.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:50 smithi163 bash[24253]: audit 2024-08-31T02:09:49.328138+0000 mgr.a (mgr.14150) 164 : audit [DBG] from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:09:50.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:50 smithi163 bash[24253]: audit 2024-08-31T02:09:49.334935+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T02:09:50.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:50 smithi163 bash[24253]: audit 2024-08-31T02:09:49.340980+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T02:09:50.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:50 smithi163 bash[24253]: audit 2024-08-31T02:09:49.342812+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:50 smithi027 bash[22610]: cluster 2024-08-31T02:09:48.934759+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:50 smithi027 bash[22610]: audit 2024-08-31T02:09:49.328138+0000 mgr.a (mgr.14150) 164 : audit [DBG] from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:09:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:50 smithi027 bash[22610]: audit 2024-08-31T02:09:49.334935+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T02:09:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:50 smithi027 bash[22610]: audit 2024-08-31T02:09:49.340980+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T02:09:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:50 smithi027 bash[22610]: audit 2024-08-31T02:09:49.342812+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:50.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:50 smithi191 bash[24992]: cluster 2024-08-31T02:09:48.934759+0000 mgr.a (mgr.14150) 163 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:50.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:50 smithi191 bash[24992]: audit 2024-08-31T02:09:49.328138+0000 mgr.a (mgr.14150) 164 : audit [DBG] from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:09:50.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:50 smithi191 bash[24992]: audit 2024-08-31T02:09:49.334935+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-31T02:09:50.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:50 smithi191 bash[24992]: audit 2024-08-31T02:09:49.340980+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-31T02:09:50.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:50 smithi191 bash[24992]: audit 2024-08-31T02:09:49.342812+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:09:52.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:52 smithi163 bash[24253]: cluster 2024-08-31T02:09:50.935267+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:52 smithi027 bash[22610]: cluster 2024-08-31T02:09:50.935267+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:52.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:52 smithi191 bash[24992]: cluster 2024-08-31T02:09:50.935267+0000 mgr.a (mgr.14150) 165 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:54.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:54 smithi163 bash[24253]: cluster 2024-08-31T02:09:52.935865+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:54.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:54 smithi191 bash[24992]: cluster 2024-08-31T02:09:52.935865+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:54 smithi027 bash[22610]: cluster 2024-08-31T02:09:52.935865+0000 mgr.a (mgr.14150) 166 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:56.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:56 smithi163 bash[24253]: cluster 2024-08-31T02:09:54.936463+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:56 smithi027 bash[22610]: cluster 2024-08-31T02:09:54.936463+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:56.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:56 smithi191 bash[24992]: cluster 2024-08-31T02:09:54.936463+0000 mgr.a (mgr.14150) 167 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:58.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:58 smithi163 bash[24253]: cluster 2024-08-31T02:09:56.937035+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:58.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:58 smithi163 bash[24253]: audit 2024-08-31T02:09:57.701926+0000 mon.a (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "911830fd-7cfb-47f1-b579-cf264cf2e461"}]: dispatch 2024-08-31T02:09:58.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:58 smithi163 bash[24253]: audit 2024-08-31T02:09:57.703288+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.191:0/921827983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "911830fd-7cfb-47f1-b579-cf264cf2e461"}]: dispatch 2024-08-31T02:09:58.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:58 smithi163 bash[24253]: audit 2024-08-31T02:09:57.705274+0000 mon.a (mon.0) 395 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "911830fd-7cfb-47f1-b579-cf264cf2e461"}]': finished 2024-08-31T02:09:58.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:58 smithi163 bash[24253]: cluster 2024-08-31T02:09:57.710151+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-08-31T02:09:58.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:58 smithi163 bash[24253]: audit 2024-08-31T02:09:57.710669+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:09:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:58 smithi027 bash[22610]: cluster 2024-08-31T02:09:56.937035+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:58 smithi027 bash[22610]: audit 2024-08-31T02:09:57.701926+0000 mon.a (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "911830fd-7cfb-47f1-b579-cf264cf2e461"}]: dispatch 2024-08-31T02:09:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:58 smithi027 bash[22610]: audit 2024-08-31T02:09:57.703288+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.191:0/921827983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "911830fd-7cfb-47f1-b579-cf264cf2e461"}]: dispatch 2024-08-31T02:09:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:58 smithi027 bash[22610]: audit 2024-08-31T02:09:57.705274+0000 mon.a (mon.0) 395 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "911830fd-7cfb-47f1-b579-cf264cf2e461"}]': finished 2024-08-31T02:09:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:58 smithi027 bash[22610]: cluster 2024-08-31T02:09:57.710151+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-08-31T02:09:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:58 smithi027 bash[22610]: audit 2024-08-31T02:09:57.710669+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:09:58.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:58 smithi191 bash[24992]: cluster 2024-08-31T02:09:56.937035+0000 mgr.a (mgr.14150) 168 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:09:58.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:58 smithi191 bash[24992]: audit 2024-08-31T02:09:57.701926+0000 mon.a (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "911830fd-7cfb-47f1-b579-cf264cf2e461"}]: dispatch 2024-08-31T02:09:58.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:58 smithi191 bash[24992]: audit 2024-08-31T02:09:57.703288+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.191:0/921827983' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "911830fd-7cfb-47f1-b579-cf264cf2e461"}]: dispatch 2024-08-31T02:09:58.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:58 smithi191 bash[24992]: audit 2024-08-31T02:09:57.705274+0000 mon.a (mon.0) 395 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "911830fd-7cfb-47f1-b579-cf264cf2e461"}]': finished 2024-08-31T02:09:58.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:58 smithi191 bash[24992]: cluster 2024-08-31T02:09:57.710151+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-08-31T02:09:58.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:58 smithi191 bash[24992]: audit 2024-08-31T02:09:57.710669+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:09:59.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:09:59 smithi163 bash[24253]: audit 2024-08-31T02:09:58.291607+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.191:0/2701245857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T02:09:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:09:59 smithi027 bash[22610]: audit 2024-08-31T02:09:58.291607+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.191:0/2701245857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T02:09:59.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:09:59 smithi191 bash[24992]: audit 2024-08-31T02:09:58.291607+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.191:0/2701245857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-31T02:10:00.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:00 smithi163 bash[24253]: cluster 2024-08-31T02:09:58.937631+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:00.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:00 smithi163 bash[24253]: cluster 2024-08-31T02:10:00.000152+0000 mon.a (mon.0) 398 : cluster [INF] overall HEALTH_OK 2024-08-31T02:10:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:00 smithi027 bash[22610]: cluster 2024-08-31T02:09:58.937631+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:00 smithi027 bash[22610]: cluster 2024-08-31T02:10:00.000152+0000 mon.a (mon.0) 398 : cluster [INF] overall HEALTH_OK 2024-08-31T02:10:00.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:00 smithi191 bash[24992]: cluster 2024-08-31T02:09:58.937631+0000 mgr.a (mgr.14150) 169 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:00.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:00 smithi191 bash[24992]: cluster 2024-08-31T02:10:00.000152+0000 mon.a (mon.0) 398 : cluster [INF] overall HEALTH_OK 2024-08-31T02:10:02.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:02 smithi191 bash[24992]: cluster 2024-08-31T02:10:00.938157+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:02.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:02 smithi163 bash[24253]: cluster 2024-08-31T02:10:00.938157+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:02 smithi027 bash[22610]: cluster 2024-08-31T02:10:00.938157+0000 mgr.a (mgr.14150) 170 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:04.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:04 smithi163 bash[24253]: cluster 2024-08-31T02:10:02.938640+0000 mgr.a (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:04 smithi027 bash[22610]: cluster 2024-08-31T02:10:02.938640+0000 mgr.a (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:04 smithi191 bash[24992]: cluster 2024-08-31T02:10:02.938640+0000 mgr.a (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:06.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:06 smithi163 bash[24253]: cluster 2024-08-31T02:10:04.939142+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:06 smithi027 bash[22610]: cluster 2024-08-31T02:10:04.939142+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:06.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:06 smithi191 bash[24992]: cluster 2024-08-31T02:10:04.939142+0000 mgr.a (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:08 smithi163 bash[24253]: cluster 2024-08-31T02:10:06.939628+0000 mgr.a (mgr.14150) 173 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:08.453 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:08 smithi191 bash[24992]: cluster 2024-08-31T02:10:06.939628+0000 mgr.a (mgr.14150) 173 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:08.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:08 smithi027 bash[22610]: cluster 2024-08-31T02:10:06.939628+0000 mgr.a (mgr.14150) 173 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:10.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:10 smithi191 bash[24992]: cluster 2024-08-31T02:10:08.940131+0000 mgr.a (mgr.14150) 174 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:10.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:10 smithi163 bash[24253]: cluster 2024-08-31T02:10:08.940131+0000 mgr.a (mgr.14150) 174 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:10 smithi027 bash[22610]: cluster 2024-08-31T02:10:08.940131+0000 mgr.a (mgr.14150) 174 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:11.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:11 smithi163 bash[24253]: audit 2024-08-31T02:10:10.974934+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-31T02:10:11.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:11 smithi163 bash[24253]: audit 2024-08-31T02:10:10.976844+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:10:11.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:11 smithi191 bash[24992]: audit 2024-08-31T02:10:10.974934+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-31T02:10:11.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:11 smithi191 bash[24992]: audit 2024-08-31T02:10:10.976844+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:10:11.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:11 smithi027 bash[22610]: audit 2024-08-31T02:10:10.974934+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-31T02:10:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:11 smithi027 bash[22610]: audit 2024-08-31T02:10:10.976844+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:10:12.365 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:12 smithi191 bash[24992]: cluster 2024-08-31T02:10:10.940725+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:12.365 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:12 smithi191 bash[24992]: cephadm 2024-08-31T02:10:10.978536+0000 mgr.a (mgr.14150) 176 : cephadm [INF] Deploying daemon osd.2 on smithi191 2024-08-31T02:10:12.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:12 smithi163 bash[24253]: cluster 2024-08-31T02:10:10.940725+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:12.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:12 smithi163 bash[24253]: cephadm 2024-08-31T02:10:10.978536+0000 mgr.a (mgr.14150) 176 : cephadm [INF] Deploying daemon osd.2 on smithi191 2024-08-31T02:10:12.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:12 smithi027 bash[22610]: cluster 2024-08-31T02:10:10.940725+0000 mgr.a (mgr.14150) 175 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:12 smithi027 bash[22610]: cephadm 2024-08-31T02:10:10.978536+0000 mgr.a (mgr.14150) 176 : cephadm [INF] Deploying daemon osd.2 on smithi191 2024-08-31T02:10:14.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:14 smithi163 bash[24253]: cluster 2024-08-31T02:10:12.941301+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:14.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:14 smithi027 bash[22610]: cluster 2024-08-31T02:10:12.941301+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:14.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:14 smithi191 bash[24992]: cluster 2024-08-31T02:10:12.941301+0000 mgr.a (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:15.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:14 smithi191 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:10:15.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:15 smithi191 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:10:16.363 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:16 smithi191 bash[24992]: cluster 2024-08-31T02:10:14.941911+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:16.363 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:16 smithi191 bash[24992]: audit 2024-08-31T02:10:15.242634+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:10:16.363 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:16 smithi191 bash[24992]: audit 2024-08-31T02:10:15.249596+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:16.363 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:16 smithi191 bash[24992]: audit 2024-08-31T02:10:15.256782+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:16.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:16 smithi163 bash[24253]: cluster 2024-08-31T02:10:14.941911+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:16.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:16 smithi163 bash[24253]: audit 2024-08-31T02:10:15.242634+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:10:16.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:16 smithi163 bash[24253]: audit 2024-08-31T02:10:15.249596+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:16.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:16 smithi163 bash[24253]: audit 2024-08-31T02:10:15.256782+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:16 smithi027 bash[22610]: cluster 2024-08-31T02:10:14.941911+0000 mgr.a (mgr.14150) 178 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:16 smithi027 bash[22610]: audit 2024-08-31T02:10:15.242634+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:10:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:16 smithi027 bash[22610]: audit 2024-08-31T02:10:15.249596+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:16 smithi027 bash[22610]: audit 2024-08-31T02:10:15.256782+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:18.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:18 smithi163 bash[24253]: cluster 2024-08-31T02:10:16.942421+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:18 smithi027 bash[22610]: cluster 2024-08-31T02:10:16.942421+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:18.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:18 smithi191 bash[24992]: cluster 2024-08-31T02:10:16.942421+0000 mgr.a (mgr.14150) 179 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:20.397 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:20 smithi191 bash[24992]: cluster 2024-08-31T02:10:18.942909+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:20.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:20 smithi163 bash[24253]: cluster 2024-08-31T02:10:18.942909+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:20 smithi027 bash[22610]: cluster 2024-08-31T02:10:18.942909+0000 mgr.a (mgr.14150) 180 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:21 smithi163 bash[24253]: audit 2024-08-31T02:10:20.542186+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:21 smithi163 bash[24253]: audit 2024-08-31T02:10:20.549653+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:21 smithi163 bash[24253]: audit 2024-08-31T02:10:20.551225+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:10:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:21 smithi163 bash[24253]: audit 2024-08-31T02:10:20.552998+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:10:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:21 smithi163 bash[24253]: audit 2024-08-31T02:10:20.562348+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:21 smithi027 bash[22610]: audit 2024-08-31T02:10:20.542186+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:21 smithi027 bash[22610]: audit 2024-08-31T02:10:20.549653+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:21 smithi027 bash[22610]: audit 2024-08-31T02:10:20.551225+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:10:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:21 smithi027 bash[22610]: audit 2024-08-31T02:10:20.552998+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:10:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:21 smithi027 bash[22610]: audit 2024-08-31T02:10:20.562348+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:22.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:21 smithi191 bash[24992]: audit 2024-08-31T02:10:20.542186+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:22.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:21 smithi191 bash[24992]: audit 2024-08-31T02:10:20.549653+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:22.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:21 smithi191 bash[24992]: audit 2024-08-31T02:10:20.551225+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:10:22.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:21 smithi191 bash[24992]: audit 2024-08-31T02:10:20.552998+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:10:22.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:21 smithi191 bash[24992]: audit 2024-08-31T02:10:20.562348+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:22.899 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:22 smithi191 bash[24992]: cluster 2024-08-31T02:10:20.943407+0000 mgr.a (mgr.14150) 181 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:22.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:22 smithi163 bash[24253]: cluster 2024-08-31T02:10:20.943407+0000 mgr.a (mgr.14150) 181 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:22.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:22 smithi027 bash[22610]: cluster 2024-08-31T02:10:20.943407+0000 mgr.a (mgr.14150) 181 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:24.865 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 2 on host 'smithi191' 2024-08-31T02:10:24.882 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:24 smithi191 bash[24992]: cluster 2024-08-31T02:10:22.943873+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:24.882 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:24 smithi191 bash[24992]: audit 2024-08-31T02:10:23.583686+0000 mon.a (mon.0) 409 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-31T02:10:24.882 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:24 smithi191 bash[24992]: audit 2024-08-31T02:10:23.584960+0000 mon.c (mon.1) 6 : audit [INF] from='osd.2 [v2:172.21.15.191:6800/1551371735,v1:172.21.15.191:6801/1551371735]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-31T02:10:24.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:24 smithi163 bash[24253]: cluster 2024-08-31T02:10:22.943873+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:24.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:24 smithi163 bash[24253]: audit 2024-08-31T02:10:23.583686+0000 mon.a (mon.0) 409 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-31T02:10:24.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:24 smithi163 bash[24253]: audit 2024-08-31T02:10:23.584960+0000 mon.c (mon.1) 6 : audit [INF] from='osd.2 [v2:172.21.15.191:6800/1551371735,v1:172.21.15.191:6801/1551371735]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-31T02:10:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:24 smithi027 bash[22610]: cluster 2024-08-31T02:10:22.943873+0000 mgr.a (mgr.14150) 182 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:24 smithi027 bash[22610]: audit 2024-08-31T02:10:23.583686+0000 mon.a (mon.0) 409 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-31T02:10:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:24 smithi027 bash[22610]: audit 2024-08-31T02:10:23.584960+0000 mon.c (mon.1) 6 : audit [INF] from='osd.2 [v2:172.21.15.191:6800/1551371735,v1:172.21.15.191:6801/1551371735]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-31T02:10:25.418 DEBUG:teuthology.orchestra.run.smithi191:osd.2> sudo journalctl -f -n 0 -u ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@osd.2.service 2024-08-31T02:10:25.463 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2024-08-31T02:10:25.463 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T02:10:25.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:25 smithi027 bash[22610]: audit 2024-08-31T02:10:24.574651+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T02:10:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:25 smithi027 bash[22610]: cluster 2024-08-31T02:10:24.579348+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-08-31T02:10:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:25 smithi027 bash[22610]: audit 2024-08-31T02:10:24.579826+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:25 smithi027 bash[22610]: audit 2024-08-31T02:10:24.582391+0000 mon.a (mon.0) 413 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-08-31T02:10:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:25 smithi027 bash[22610]: audit 2024-08-31T02:10:24.583644+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.191:6800/1551371735,v1:172.21.15.191:6801/1551371735]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-08-31T02:10:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:25 smithi027 bash[22610]: audit 2024-08-31T02:10:24.847061+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:10:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:25 smithi027 bash[22610]: audit 2024-08-31T02:10:24.854506+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:25 smithi027 bash[22610]: audit 2024-08-31T02:10:24.862351+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:25.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:25 smithi191 bash[24992]: audit 2024-08-31T02:10:24.574651+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T02:10:25.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:25 smithi191 bash[24992]: cluster 2024-08-31T02:10:24.579348+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-08-31T02:10:25.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:25 smithi191 bash[24992]: audit 2024-08-31T02:10:24.579826+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:25.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:25 smithi191 bash[24992]: audit 2024-08-31T02:10:24.582391+0000 mon.a (mon.0) 413 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-08-31T02:10:25.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:25 smithi191 bash[24992]: audit 2024-08-31T02:10:24.583644+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.191:6800/1551371735,v1:172.21.15.191:6801/1551371735]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-08-31T02:10:25.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:25 smithi191 bash[24992]: audit 2024-08-31T02:10:24.847061+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:10:25.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:25 smithi191 bash[24992]: audit 2024-08-31T02:10:24.854506+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:25.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:25 smithi191 bash[24992]: audit 2024-08-31T02:10:24.862351+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:25 smithi163 bash[24253]: audit 2024-08-31T02:10:24.574651+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T02:10:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:25 smithi163 bash[24253]: cluster 2024-08-31T02:10:24.579348+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-08-31T02:10:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:25 smithi163 bash[24253]: audit 2024-08-31T02:10:24.579826+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:25 smithi163 bash[24253]: audit 2024-08-31T02:10:24.582391+0000 mon.a (mon.0) 413 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-08-31T02:10:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:25 smithi163 bash[24253]: audit 2024-08-31T02:10:24.583644+0000 mon.c (mon.1) 7 : audit [INF] from='osd.2 [v2:172.21.15.191:6800/1551371735,v1:172.21.15.191:6801/1551371735]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-08-31T02:10:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:25 smithi163 bash[24253]: audit 2024-08-31T02:10:24.847061+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:10:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:25 smithi163 bash[24253]: audit 2024-08-31T02:10:24.854506+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:25 smithi163 bash[24253]: audit 2024-08-31T02:10:24.862351+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:26.535 INFO:journalctl@ceph.osd.2.smithi191.stdout:Aug 31 02:10:26 smithi191 bash[27893]: debug 2024-08-31T02:10:26.135+0000 7f8770b6e640 -1 osd.2 0 waiting for initial osdmap 2024-08-31T02:10:26.536 INFO:journalctl@ceph.osd.2.smithi191.stdout:Aug 31 02:10:26 smithi191 bash[27893]: debug 2024-08-31T02:10:26.171+0000 7f876817a640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T02:10:26.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:26 smithi163 bash[24253]: cluster 2024-08-31T02:10:24.632124+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-08-31T02:10:26.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:26 smithi163 bash[24253]: cluster 2024-08-31T02:10:24.632266+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-08-31T02:10:26.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:26 smithi163 bash[24253]: cluster 2024-08-31T02:10:24.944362+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:26.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:26 smithi163 bash[24253]: audit 2024-08-31T02:10:25.577153+0000 mon.a (mon.0) 417 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-08-31T02:10:26.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:26 smithi163 bash[24253]: cluster 2024-08-31T02:10:25.582208+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-08-31T02:10:26.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:26 smithi163 bash[24253]: audit 2024-08-31T02:10:25.583029+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:26.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:26 smithi163 bash[24253]: audit 2024-08-31T02:10:25.592785+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:26.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:26 smithi163 bash[24253]: audit 2024-08-31T02:10:26.142781+0000 mon.a (mon.0) 421 : audit [INF] from='osd.2 ' entity='osd.2' 2024-08-31T02:10:26.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:26 smithi027 bash[22610]: cluster 2024-08-31T02:10:24.632124+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-08-31T02:10:26.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:26 smithi027 bash[22610]: cluster 2024-08-31T02:10:24.632266+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-08-31T02:10:26.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:26 smithi027 bash[22610]: cluster 2024-08-31T02:10:24.944362+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:26.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:26 smithi027 bash[22610]: audit 2024-08-31T02:10:25.577153+0000 mon.a (mon.0) 417 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-08-31T02:10:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:26 smithi027 bash[22610]: cluster 2024-08-31T02:10:25.582208+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-08-31T02:10:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:26 smithi027 bash[22610]: audit 2024-08-31T02:10:25.583029+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:26 smithi027 bash[22610]: audit 2024-08-31T02:10:25.592785+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:26 smithi027 bash[22610]: audit 2024-08-31T02:10:26.142781+0000 mon.a (mon.0) 421 : audit [INF] from='osd.2 ' entity='osd.2' 2024-08-31T02:10:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:26 smithi191 bash[24992]: cluster 2024-08-31T02:10:24.632124+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-08-31T02:10:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:26 smithi191 bash[24992]: cluster 2024-08-31T02:10:24.632266+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-08-31T02:10:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:26 smithi191 bash[24992]: cluster 2024-08-31T02:10:24.944362+0000 mgr.a (mgr.14150) 183 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:26 smithi191 bash[24992]: audit 2024-08-31T02:10:25.577153+0000 mon.a (mon.0) 417 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-08-31T02:10:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:26 smithi191 bash[24992]: cluster 2024-08-31T02:10:25.582208+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-08-31T02:10:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:26 smithi191 bash[24992]: audit 2024-08-31T02:10:25.583029+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:26 smithi191 bash[24992]: audit 2024-08-31T02:10:25.592785+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:26 smithi191 bash[24992]: audit 2024-08-31T02:10:26.142781+0000 mon.a (mon.0) 421 : audit [INF] from='osd.2 ' entity='osd.2' 2024-08-31T02:10:27.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:27 smithi163 bash[24253]: audit 2024-08-31T02:10:26.595985+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:27.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:27 smithi163 bash[24253]: cluster 2024-08-31T02:10:27.148244+0000 mon.a (mon.0) 423 : cluster [INF] osd.2 [v2:172.21.15.191:6800/1551371735,v1:172.21.15.191:6801/1551371735] boot 2024-08-31T02:10:27.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:27 smithi163 bash[24253]: cluster 2024-08-31T02:10:27.148313+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-08-31T02:10:27.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:27 smithi163 bash[24253]: audit 2024-08-31T02:10:27.148555+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:27 smithi027 bash[22610]: audit 2024-08-31T02:10:26.595985+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:27 smithi027 bash[22610]: cluster 2024-08-31T02:10:27.148244+0000 mon.a (mon.0) 423 : cluster [INF] osd.2 [v2:172.21.15.191:6800/1551371735,v1:172.21.15.191:6801/1551371735] boot 2024-08-31T02:10:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:27 smithi027 bash[22610]: cluster 2024-08-31T02:10:27.148313+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-08-31T02:10:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:27 smithi027 bash[22610]: audit 2024-08-31T02:10:27.148555+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:27 smithi191 bash[24992]: audit 2024-08-31T02:10:26.595985+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:27 smithi191 bash[24992]: cluster 2024-08-31T02:10:27.148244+0000 mon.a (mon.0) 423 : cluster [INF] osd.2 [v2:172.21.15.191:6800/1551371735,v1:172.21.15.191:6801/1551371735] boot 2024-08-31T02:10:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:27 smithi191 bash[24992]: cluster 2024-08-31T02:10:27.148313+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-08-31T02:10:28.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:27 smithi191 bash[24992]: audit 2024-08-31T02:10:27.148555+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:10:28.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:28 smithi163 bash[24253]: cluster 2024-08-31T02:10:26.944824+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v139: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:28.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:28 smithi027 bash[22610]: cluster 2024-08-31T02:10:26.944824+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v139: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:29.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:28 smithi191 bash[24992]: cluster 2024-08-31T02:10:26.944824+0000 mgr.a (mgr.14150) 184 : cluster [DBG] pgmap v139: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-08-31T02:10:29.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:29 smithi163 bash[24253]: cluster 2024-08-31T02:10:28.614662+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-08-31T02:10:29.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:29 smithi163 bash[24253]: audit 2024-08-31T02:10:29.110243+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-31T02:10:29.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:29 smithi027 bash[22610]: cluster 2024-08-31T02:10:28.614662+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-08-31T02:10:29.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:29 smithi027 bash[22610]: audit 2024-08-31T02:10:29.110243+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-31T02:10:29.983 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:29 smithi191 bash[24992]: cluster 2024-08-31T02:10:28.614662+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-08-31T02:10:29.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:29 smithi191 bash[24992]: audit 2024-08-31T02:10:29.110243+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-31T02:10:30.207 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:10:30.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:30 smithi027 bash[22610]: cluster 2024-08-31T02:10:28.945271+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v142: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:30.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:30 smithi027 bash[22610]: audit 2024-08-31T02:10:29.618152+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T02:10:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:30 smithi027 bash[22610]: cluster 2024-08-31T02:10:29.623556+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-08-31T02:10:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:30 smithi027 bash[22610]: audit 2024-08-31T02:10:29.625005+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-31T02:10:30.899 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:30 smithi191 bash[24992]: cluster 2024-08-31T02:10:28.945271+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v142: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:30.899 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:30 smithi191 bash[24992]: audit 2024-08-31T02:10:29.618152+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T02:10:30.899 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:30 smithi191 bash[24992]: cluster 2024-08-31T02:10:29.623556+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-08-31T02:10:30.899 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:30 smithi191 bash[24992]: audit 2024-08-31T02:10:29.625005+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-31T02:10:30.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:30 smithi163 bash[24253]: cluster 2024-08-31T02:10:28.945271+0000 mgr.a (mgr.14150) 185 : cluster [DBG] pgmap v142: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:30.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:30 smithi163 bash[24253]: audit 2024-08-31T02:10:29.618152+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T02:10:30.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:30 smithi163 bash[24253]: cluster 2024-08-31T02:10:29.623556+0000 mon.a (mon.0) 429 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-08-31T02:10:30.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:30 smithi163 bash[24253]: audit 2024-08-31T02:10:29.625005+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-31T02:10:31.863 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:10:31.875 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:31 smithi027 bash[22610]: audit 2024-08-31T02:10:30.620656+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T02:10:31.875 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:31 smithi027 bash[22610]: cluster 2024-08-31T02:10:30.626153+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-08-31T02:10:31.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:31 smithi163 bash[24253]: audit 2024-08-31T02:10:30.620656+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T02:10:31.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:31 smithi163 bash[24253]: cluster 2024-08-31T02:10:30.626153+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-08-31T02:10:32.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:31 smithi191 bash[24992]: audit 2024-08-31T02:10:30.620656+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T02:10:32.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:31 smithi191 bash[24992]: cluster 2024-08-31T02:10:30.626153+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-08-31T02:10:32.562 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"num_osds":3,"num_up_osds":3,"osd_up_since":1725070227,"num_in_osds":3,"osd_in_since":1725070197,"num_remapped_pgs":0} 2024-08-31T02:10:32.563 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T02:10:32.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:32 smithi163 bash[24253]: cluster 2024-08-31T02:10:30.945581+0000 mgr.a (mgr.14150) 186 : cluster [DBG] pgmap v145: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:32.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:32 smithi163 bash[24253]: cluster 2024-08-31T02:10:31.643900+0000 mon.a (mon.0) 433 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-08-31T02:10:32.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:32 smithi163 bash[24253]: cluster 2024-08-31T02:10:31.643955+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-08-31T02:10:32.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:32 smithi163 bash[24253]: audit 2024-08-31T02:10:31.821017+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:32.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:32 smithi163 bash[24253]: audit 2024-08-31T02:10:31.864975+0000 mon.a (mon.0) 436 : audit [DBG] from='client.? 172.21.15.27:0/2530143687' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-31T02:10:32.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:32 smithi027 bash[22610]: cluster 2024-08-31T02:10:30.945581+0000 mgr.a (mgr.14150) 186 : cluster [DBG] pgmap v145: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:32.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:32 smithi027 bash[22610]: cluster 2024-08-31T02:10:31.643900+0000 mon.a (mon.0) 433 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-08-31T02:10:32.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:32 smithi027 bash[22610]: cluster 2024-08-31T02:10:31.643955+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-08-31T02:10:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:32 smithi027 bash[22610]: audit 2024-08-31T02:10:31.821017+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:32 smithi027 bash[22610]: audit 2024-08-31T02:10:31.864975+0000 mon.a (mon.0) 436 : audit [DBG] from='client.? 172.21.15.27:0/2530143687' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-31T02:10:33.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:32 smithi191 bash[24992]: cluster 2024-08-31T02:10:30.945581+0000 mgr.a (mgr.14150) 186 : cluster [DBG] pgmap v145: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:33.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:32 smithi191 bash[24992]: cluster 2024-08-31T02:10:31.643900+0000 mon.a (mon.0) 433 : cluster [DBG] mgrmap e15: a(active, since 4m), standbys: b 2024-08-31T02:10:33.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:32 smithi191 bash[24992]: cluster 2024-08-31T02:10:31.643955+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-08-31T02:10:33.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:32 smithi191 bash[24992]: audit 2024-08-31T02:10:31.821017+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:33.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:32 smithi191 bash[24992]: audit 2024-08-31T02:10:31.864975+0000 mon.a (mon.0) 436 : audit [DBG] from='client.? 172.21.15.27:0/2530143687' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-31T02:10:34.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:34 smithi163 bash[24253]: audit 2024-08-31T02:10:32.766870+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:34.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:34 smithi163 bash[24253]: audit 2024-08-31T02:10:33.724156+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:34.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:34 smithi163 bash[24253]: audit 2024-08-31T02:10:33.726846+0000 mon.a (mon.0) 439 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T02:10:34.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:34 smithi163 bash[24253]: audit 2024-08-31T02:10:34.643510+0000 mon.a (mon.0) 440 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T02:10:34.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:34 smithi027 bash[22610]: audit 2024-08-31T02:10:32.766870+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:34.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:34 smithi027 bash[22610]: audit 2024-08-31T02:10:33.724156+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:34.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:34 smithi027 bash[22610]: audit 2024-08-31T02:10:33.726846+0000 mon.a (mon.0) 439 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T02:10:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:34 smithi027 bash[22610]: audit 2024-08-31T02:10:34.643510+0000 mon.a (mon.0) 440 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T02:10:35.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:34 smithi191 bash[24992]: audit 2024-08-31T02:10:32.766870+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:35.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:34 smithi191 bash[24992]: audit 2024-08-31T02:10:33.724156+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:35.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:34 smithi191 bash[24992]: audit 2024-08-31T02:10:33.726846+0000 mon.a (mon.0) 439 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T02:10:35.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:34 smithi191 bash[24992]: audit 2024-08-31T02:10:34.643510+0000 mon.a (mon.0) 440 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T02:10:36.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: cluster 2024-08-31T02:10:32.946056+0000 mgr.a (mgr.14150) 187 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:36.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: cephadm 2024-08-31T02:10:34.177604+0000 mgr.a (mgr.14150) 188 : cephadm [INF] Detected new or changed devices on smithi191 2024-08-31T02:10:36.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:34.646189+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:10:36.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:34.646305+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:10:36.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:34.649661+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:10:36.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:34.659991+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:36.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:34.660097+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T02:10:36.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:34.660311+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:10:36.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:34.660449+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:10:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:34.660599+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:10:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:35.530435+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T02:10:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:35.537524+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:35.538368+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:10:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:35.539086+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:10:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:35.539477+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:10:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:36 smithi163 bash[24253]: audit 2024-08-31T02:10:35.540131+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: cluster 2024-08-31T02:10:32.946056+0000 mgr.a (mgr.14150) 187 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: cephadm 2024-08-31T02:10:34.177604+0000 mgr.a (mgr.14150) 188 : cephadm [INF] Detected new or changed devices on smithi191 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:34.646189+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:34.646305+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:34.649661+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:34.659991+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:34.660097+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:34.660311+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:34.660449+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:34.660599+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:10:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:35.530435+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T02:10:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:35.537524+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:35.538368+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:10:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:35.539086+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:10:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:35.539477+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:10:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:36 smithi027 bash[22610]: audit 2024-08-31T02:10:35.540131+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:10:36.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: cluster 2024-08-31T02:10:32.946056+0000 mgr.a (mgr.14150) 187 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: cephadm 2024-08-31T02:10:34.177604+0000 mgr.a (mgr.14150) 188 : cephadm [INF] Detected new or changed devices on smithi191 2024-08-31T02:10:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:34.646189+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:10:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:34.646305+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:10:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:34.649661+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:10:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:34.659991+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:34.660097+0000 mon.c (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T02:10:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:34.660311+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:10:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:34.660449+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:10:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:34.660599+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:10:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:35.530435+0000 mon.c (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T02:10:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:35.537524+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:35.538368+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:10:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:35.539086+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:10:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:35.539477+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:10:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:36 smithi191 bash[24992]: audit 2024-08-31T02:10:35.540131+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:10:37.304 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:10:37.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:37 smithi163 bash[24253]: cluster 2024-08-31T02:10:34.946653+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:37.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:37 smithi163 bash[24253]: audit 2024-08-31T02:10:35.533985+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T02:10:37.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:37 smithi163 bash[24253]: cephadm 2024-08-31T02:10:35.541470+0000 mgr.a (mgr.14150) 190 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 21361M 2024-08-31T02:10:37.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:37 smithi163 bash[24253]: audit 2024-08-31T02:10:36.411244+0000 mon.b (mon.2) 12 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T02:10:37.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:37 smithi163 bash[24253]: audit 2024-08-31T02:10:36.419559+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:37.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:37 smithi163 bash[24253]: audit 2024-08-31T02:10:36.433898+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:10:37.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:37 smithi163 bash[24253]: audit 2024-08-31T02:10:36.436266+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:10:37.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:37 smithi163 bash[24253]: audit 2024-08-31T02:10:36.446140+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:37.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:37 smithi027 bash[22610]: cluster 2024-08-31T02:10:34.946653+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:37.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:37 smithi027 bash[22610]: audit 2024-08-31T02:10:35.533985+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T02:10:37.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:37 smithi027 bash[22610]: cephadm 2024-08-31T02:10:35.541470+0000 mgr.a (mgr.14150) 190 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 21361M 2024-08-31T02:10:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:37 smithi027 bash[22610]: audit 2024-08-31T02:10:36.411244+0000 mon.b (mon.2) 12 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T02:10:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:37 smithi027 bash[22610]: audit 2024-08-31T02:10:36.419559+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:37 smithi027 bash[22610]: audit 2024-08-31T02:10:36.433898+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:10:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:37 smithi027 bash[22610]: audit 2024-08-31T02:10:36.436266+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:10:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:37 smithi027 bash[22610]: audit 2024-08-31T02:10:36.446140+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:37.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:37 smithi191 bash[24992]: cluster 2024-08-31T02:10:34.946653+0000 mgr.a (mgr.14150) 189 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:37.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:37 smithi191 bash[24992]: audit 2024-08-31T02:10:35.533985+0000 mon.b (mon.2) 11 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T02:10:37.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:37 smithi191 bash[24992]: cephadm 2024-08-31T02:10:35.541470+0000 mgr.a (mgr.14150) 190 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 21361M 2024-08-31T02:10:37.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:37 smithi191 bash[24992]: audit 2024-08-31T02:10:36.411244+0000 mon.b (mon.2) 12 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T02:10:37.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:37 smithi191 bash[24992]: audit 2024-08-31T02:10:36.419559+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:37.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:37 smithi191 bash[24992]: audit 2024-08-31T02:10:36.433898+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:10:37.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:37 smithi191 bash[24992]: audit 2024-08-31T02:10:36.436266+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:10:37.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:37 smithi191 bash[24992]: audit 2024-08-31T02:10:36.446140+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:10:38.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:38 smithi163 bash[24253]: cluster 2024-08-31T02:10:36.947227+0000 mgr.a (mgr.14150) 191 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:38.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:38 smithi027 bash[22610]: cluster 2024-08-31T02:10:36.947227+0000 mgr.a (mgr.14150) 191 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:38 smithi191 bash[24992]: cluster 2024-08-31T02:10:36.947227+0000 mgr.a (mgr.14150) 191 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:38.993 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:10:38.993 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"3427ee8e-673d-11ef-bcd4-c7b262605968","created":"2024-08-31T02:05:02.030228+0000","modified":"2024-08-31T02:10:31.629050+0000","last_up_change":"2024-08-31T02:10:27.138823+0000","last_in_change":"2024-08-31T02:09:57.702823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T02:10:29.557743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ef3f583-172f-4979-a8bf-888626b06aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6803","nonce":2589790736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6805","nonce":2589790736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6809","nonce":2589790736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6807","nonce":2589790736}]},"public_addr":"172.21.15.27:6803/2589790736","cluster_addr":"172.21.15.27:6805/2589790736","heartbeat_back_addr":"172.21.15.27:6809/2589790736","heartbeat_front_addr":"172.21.15.27:6807/2589790736","state":["exists","up"]},{"osd":1,"uuid":"40e2bd1e-964a-4db4-acba-e52c1a5b5432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6801","nonce":3221236780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6803","nonce":3221236780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6807","nonce":3221236780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6805","nonce":3221236780}]},"public_addr":"172.21.15.163:6801/3221236780","cluster_addr":"172.21.15.163:6803/3221236780","heartbeat_back_addr":"172.21.15.163:6807/3221236780","heartbeat_front_addr":"172.21.15.163:6805/3221236780","state":["exists","up"]},{"osd":2,"uuid":"911830fd-7cfb-47f1-b579-cf264cf2e461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6801","nonce":1551371735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6803","nonce":1551371735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6807","nonce":1551371735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6805","nonce":1551371735}]},"public_addr":"172.21.15.191:6801/1551371735","cluster_addr":"172.21.15.191:6803/1551371735","heartbeat_back_addr":"172.21.15.191:6807/1551371735","heartbeat_front_addr":"172.21.15.191:6805/1551371735","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T02:08:42.113279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T02:09:34.919739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T02:10:24.632272+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/3407934166":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/903318807":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/2914866275":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/2853150403":"2024-09-01T02:05:30.041498+0000","172.21.15.27:0/1451794588":"2024-09-01T02:05:30.041498+0000","172.21.15.27:6800/3949437201":"2024-09-01T02:06:02.876986+0000","172.21.15.27:6801/1868756612":"2024-09-01T02:05:30.041498+0000","172.21.15.27:6800/1868756612":"2024-09-01T02:05:30.041498+0000","172.21.15.27:6801/3949437201":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/2248689415":"2024-09-01T02:05:30.041498+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T02:10:39.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:39 smithi027 bash[22610]: audit 2024-08-31T02:10:38.994580+0000 mon.a (mon.0) 457 : audit [DBG] from='client.? 172.21.15.27:0/3930523949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T02:10:39.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:39 smithi191 bash[24992]: audit 2024-08-31T02:10:38.994580+0000 mon.a (mon.0) 457 : audit [DBG] from='client.? 172.21.15.27:0/3930523949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T02:10:39.788 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T02:10:29.557743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T02:10:39.788 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-31T02:10:39.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:39 smithi163 bash[24253]: audit 2024-08-31T02:10:38.994580+0000 mon.a (mon.0) 457 : audit [DBG] from='client.? 172.21.15.27:0/3930523949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T02:10:40.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:40 smithi027 bash[22610]: cluster 2024-08-31T02:10:38.947767+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-08-31T02:10:40.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:40 smithi191 bash[24992]: cluster 2024-08-31T02:10:38.947767+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-08-31T02:10:40.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:40 smithi163 bash[24253]: cluster 2024-08-31T02:10:38.947767+0000 mgr.a (mgr.14150) 192 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-08-31T02:10:42.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:42 smithi027 bash[22610]: cluster 2024-08-31T02:10:40.948312+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-08-31T02:10:42.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:42 smithi191 bash[24992]: cluster 2024-08-31T02:10:40.948312+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-08-31T02:10:42.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:42 smithi163 bash[24253]: cluster 2024-08-31T02:10:40.948312+0000 mgr.a (mgr.14150) 193 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-08-31T02:10:44.529 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:10:44.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:44 smithi027 bash[22610]: cluster 2024-08-31T02:10:42.948872+0000 mgr.a (mgr.14150) 194 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-08-31T02:10:44.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:44 smithi191 bash[24992]: cluster 2024-08-31T02:10:42.948872+0000 mgr.a (mgr.14150) 194 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-08-31T02:10:44.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:44 smithi163 bash[24253]: cluster 2024-08-31T02:10:42.948872+0000 mgr.a (mgr.14150) 194 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-08-31T02:10:46.023 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-08-31T02:10:46.623 INFO:tasks.cephadm:Setting up client nodes... 2024-08-31T02:10:46.623 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-31T02:10:46.623 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-31T02:10:46.623 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph mgr dump --format=json 2024-08-31T02:10:46.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:46 smithi027 bash[22610]: cluster 2024-08-31T02:10:44.949415+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-31T02:10:46.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:46 smithi027 bash[22610]: audit 2024-08-31T02:10:46.024899+0000 mon.a (mon.0) 458 : audit [DBG] from='client.? 172.21.15.27:0/1511979053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-31T02:10:46.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:46 smithi191 bash[24992]: cluster 2024-08-31T02:10:44.949415+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-31T02:10:46.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:46 smithi191 bash[24992]: audit 2024-08-31T02:10:46.024899+0000 mon.a (mon.0) 458 : audit [DBG] from='client.? 172.21.15.27:0/1511979053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-31T02:10:46.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:46 smithi163 bash[24253]: cluster 2024-08-31T02:10:44.949415+0000 mgr.a (mgr.14150) 195 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-31T02:10:46.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:46 smithi163 bash[24253]: audit 2024-08-31T02:10:46.024899+0000 mon.a (mon.0) 458 : audit [DBG] from='client.? 172.21.15.27:0/1511979053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-31T02:10:48.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:48 smithi027 bash[22610]: cluster 2024-08-31T02:10:46.949962+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-31T02:10:48.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:48 smithi191 bash[24992]: cluster 2024-08-31T02:10:46.949962+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-31T02:10:48.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:48 smithi163 bash[24253]: cluster 2024-08-31T02:10:46.949962+0000 mgr.a (mgr.14150) 196 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-31T02:10:50.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:50 smithi027 bash[22610]: cluster 2024-08-31T02:10:48.950527+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-31T02:10:50.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:50 smithi191 bash[24992]: cluster 2024-08-31T02:10:48.950527+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-31T02:10:50.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:50 smithi163 bash[24253]: cluster 2024-08-31T02:10:48.950527+0000 mgr.a (mgr.14150) 197 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-08-31T02:10:51.368 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:10:52.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:52 smithi027 bash[22610]: cluster 2024-08-31T02:10:50.951065+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:52.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:52 smithi191 bash[24992]: cluster 2024-08-31T02:10:50.951065+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:52.865 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:10:52.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:52 smithi163 bash[24253]: cluster 2024-08-31T02:10:50.951065+0000 mgr.a (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:53.541 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":15,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":4263230579},{"type":"v1","addr":"172.21.15.27:6801","nonce":4263230579}]},"active_addr":"172.21.15.27:6801/4263230579","active_change":"2024-08-31T02:06:02.877306+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24107,"name":"b","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.27:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":3136009165}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":4198760049}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":3231242566}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":3573104120}]}]} 2024-08-31T02:10:53.545 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-31T02:10:53.545 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-31T02:10:53.545 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T02:10:53.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:53 smithi191 bash[24992]: audit 2024-08-31T02:10:52.857013+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.21.15.27:0/1800751520' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-31T02:10:53.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:53 smithi163 bash[24253]: audit 2024-08-31T02:10:52.857013+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.21.15.27:0/1800751520' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-31T02:10:53.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:53 smithi027 bash[22610]: audit 2024-08-31T02:10:52.857013+0000 mon.a (mon.0) 459 : audit [DBG] from='client.? 172.21.15.27:0/1800751520' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-31T02:10:54.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:54 smithi191 bash[24992]: cluster 2024-08-31T02:10:52.951679+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:54.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:54 smithi163 bash[24253]: cluster 2024-08-31T02:10:52.951679+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:54.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:54 smithi027 bash[22610]: cluster 2024-08-31T02:10:52.951679+0000 mgr.a (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:56.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:56 smithi191 bash[24992]: cluster 2024-08-31T02:10:54.952187+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:56.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:56 smithi163 bash[24253]: cluster 2024-08-31T02:10:54.952187+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:56 smithi027 bash[22610]: cluster 2024-08-31T02:10:54.952187+0000 mgr.a (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:58.293 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:10:58.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:10:58 smithi027 bash[22610]: cluster 2024-08-31T02:10:56.952716+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:58.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:10:58 smithi191 bash[24992]: cluster 2024-08-31T02:10:56.952716+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:58.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:10:58 smithi163 bash[24253]: cluster 2024-08-31T02:10:56.952716+0000 mgr.a (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:10:59.908 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:10:59.908 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"3427ee8e-673d-11ef-bcd4-c7b262605968","created":"2024-08-31T02:05:02.030228+0000","modified":"2024-08-31T02:10:31.629050+0000","last_up_change":"2024-08-31T02:10:27.138823+0000","last_in_change":"2024-08-31T02:09:57.702823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T02:10:29.557743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ef3f583-172f-4979-a8bf-888626b06aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6803","nonce":2589790736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6805","nonce":2589790736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6809","nonce":2589790736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6807","nonce":2589790736}]},"public_addr":"172.21.15.27:6803/2589790736","cluster_addr":"172.21.15.27:6805/2589790736","heartbeat_back_addr":"172.21.15.27:6809/2589790736","heartbeat_front_addr":"172.21.15.27:6807/2589790736","state":["exists","up"]},{"osd":1,"uuid":"40e2bd1e-964a-4db4-acba-e52c1a5b5432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6801","nonce":3221236780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6803","nonce":3221236780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6807","nonce":3221236780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6805","nonce":3221236780}]},"public_addr":"172.21.15.163:6801/3221236780","cluster_addr":"172.21.15.163:6803/3221236780","heartbeat_back_addr":"172.21.15.163:6807/3221236780","heartbeat_front_addr":"172.21.15.163:6805/3221236780","state":["exists","up"]},{"osd":2,"uuid":"911830fd-7cfb-47f1-b579-cf264cf2e461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6801","nonce":1551371735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6803","nonce":1551371735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6807","nonce":1551371735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6805","nonce":1551371735}]},"public_addr":"172.21.15.191:6801/1551371735","cluster_addr":"172.21.15.191:6803/1551371735","heartbeat_back_addr":"172.21.15.191:6807/1551371735","heartbeat_front_addr":"172.21.15.191:6805/1551371735","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T02:08:42.113279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T02:09:34.919739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T02:10:24.632272+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/3407934166":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/903318807":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/2914866275":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/2853150403":"2024-09-01T02:05:30.041498+0000","172.21.15.27:0/1451794588":"2024-09-01T02:05:30.041498+0000","172.21.15.27:6800/3949437201":"2024-09-01T02:06:02.876986+0000","172.21.15.27:6801/1868756612":"2024-09-01T02:05:30.041498+0000","172.21.15.27:6800/1868756612":"2024-09-01T02:05:30.041498+0000","172.21.15.27:6801/3949437201":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/2248689415":"2024-09-01T02:05:30.041498+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T02:11:00.591 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-31T02:11:00.591 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T02:11:00.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:00 smithi191 bash[24992]: cluster 2024-08-31T02:10:58.953289+0000 mgr.a (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:00.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:00 smithi191 bash[24992]: audit 2024-08-31T02:10:59.909175+0000 mon.a (mon.0) 460 : audit [DBG] from='client.? 172.21.15.27:0/3789446884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T02:11:00.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:00 smithi163 bash[24253]: cluster 2024-08-31T02:10:58.953289+0000 mgr.a (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:00.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:00 smithi163 bash[24253]: audit 2024-08-31T02:10:59.909175+0000 mon.a (mon.0) 460 : audit [DBG] from='client.? 172.21.15.27:0/3789446884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T02:11:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:00 smithi027 bash[22610]: cluster 2024-08-31T02:10:58.953289+0000 mgr.a (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:00 smithi027 bash[22610]: audit 2024-08-31T02:10:59.909175+0000 mon.a (mon.0) 460 : audit [DBG] from='client.? 172.21.15.27:0/3789446884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T02:11:02.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:02 smithi191 bash[24992]: cluster 2024-08-31T02:11:00.953816+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:02.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:02 smithi163 bash[24253]: cluster 2024-08-31T02:11:00.953816+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:02.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:02 smithi027 bash[22610]: cluster 2024-08-31T02:11:00.953816+0000 mgr.a (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:04.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:04 smithi191 bash[24992]: cluster 2024-08-31T02:11:02.954381+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:04.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:04 smithi163 bash[24253]: cluster 2024-08-31T02:11:02.954381+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:04.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:04 smithi027 bash[22610]: cluster 2024-08-31T02:11:02.954381+0000 mgr.a (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:05.339 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:06.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:06 smithi191 bash[24992]: cluster 2024-08-31T02:11:04.955081+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:06.864 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:11:06.865 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":22,"fsid":"3427ee8e-673d-11ef-bcd4-c7b262605968","created":"2024-08-31T02:05:02.030228+0000","modified":"2024-08-31T02:10:31.629050+0000","last_up_change":"2024-08-31T02:10:27.138823+0000","last_in_change":"2024-08-31T02:09:57.702823+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T02:10:29.557743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4ef3f583-172f-4979-a8bf-888626b06aa6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6803","nonce":2589790736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6805","nonce":2589790736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6809","nonce":2589790736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":2589790736},{"type":"v1","addr":"172.21.15.27:6807","nonce":2589790736}]},"public_addr":"172.21.15.27:6803/2589790736","cluster_addr":"172.21.15.27:6805/2589790736","heartbeat_back_addr":"172.21.15.27:6809/2589790736","heartbeat_front_addr":"172.21.15.27:6807/2589790736","state":["exists","up"]},{"osd":1,"uuid":"40e2bd1e-964a-4db4-acba-e52c1a5b5432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6801","nonce":3221236780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6803","nonce":3221236780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6807","nonce":3221236780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3221236780},{"type":"v1","addr":"172.21.15.163:6805","nonce":3221236780}]},"public_addr":"172.21.15.163:6801/3221236780","cluster_addr":"172.21.15.163:6803/3221236780","heartbeat_back_addr":"172.21.15.163:6807/3221236780","heartbeat_front_addr":"172.21.15.163:6805/3221236780","state":["exists","up"]},{"osd":2,"uuid":"911830fd-7cfb-47f1-b579-cf264cf2e461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6801","nonce":1551371735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6803","nonce":1551371735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6807","nonce":1551371735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":1551371735},{"type":"v1","addr":"172.21.15.191:6805","nonce":1551371735}]},"public_addr":"172.21.15.191:6801/1551371735","cluster_addr":"172.21.15.191:6803/1551371735","heartbeat_back_addr":"172.21.15.191:6807/1551371735","heartbeat_front_addr":"172.21.15.191:6805/1551371735","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T02:08:42.113279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T02:09:34.919739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T02:10:24.632272+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/3407934166":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/903318807":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/2914866275":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/2853150403":"2024-09-01T02:05:30.041498+0000","172.21.15.27:0/1451794588":"2024-09-01T02:05:30.041498+0000","172.21.15.27:6800/3949437201":"2024-09-01T02:06:02.876986+0000","172.21.15.27:6801/1868756612":"2024-09-01T02:05:30.041498+0000","172.21.15.27:6800/1868756612":"2024-09-01T02:05:30.041498+0000","172.21.15.27:6801/3949437201":"2024-09-01T02:06:02.876986+0000","172.21.15.27:0/2248689415":"2024-09-01T02:05:30.041498+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T02:11:06.876 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:06 smithi027 bash[22610]: cluster 2024-08-31T02:11:04.955081+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:06.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:06 smithi163 bash[24253]: cluster 2024-08-31T02:11:04.955081+0000 mgr.a (mgr.14150) 205 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:07.524 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-31T02:11:07.525 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-31T02:11:07.525 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-31T02:11:07.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:07 smithi191 bash[24992]: audit 2024-08-31T02:11:06.865846+0000 mon.a (mon.0) 461 : audit [DBG] from='client.? 172.21.15.27:0/975065475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T02:11:07.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:07 smithi163 bash[24253]: audit 2024-08-31T02:11:06.865846+0000 mon.a (mon.0) 461 : audit [DBG] from='client.? 172.21.15.27:0/975065475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T02:11:07.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:07 smithi027 bash[22610]: audit 2024-08-31T02:11:06.865846+0000 mon.a (mon.0) 461 : audit [DBG] from='client.? 172.21.15.27:0/975065475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-31T02:11:08.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:08 smithi191 bash[24992]: cluster 2024-08-31T02:11:06.955507+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:08.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:08 smithi163 bash[24253]: cluster 2024-08-31T02:11:06.955507+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:08 smithi027 bash[22610]: cluster 2024-08-31T02:11:06.955507+0000 mgr.a (mgr.14150) 206 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:10.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:10 smithi191 bash[24992]: cluster 2024-08-31T02:11:08.956005+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:10.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:10 smithi163 bash[24253]: cluster 2024-08-31T02:11:08.956005+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:10.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:10 smithi027 bash[22610]: cluster 2024-08-31T02:11:08.956005+0000 mgr.a (mgr.14150) 207 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:12.276 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:12.276 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:12.277 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:12.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:12 smithi027 bash[22610]: cluster 2024-08-31T02:11:10.956522+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:12.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:12 smithi163 bash[24253]: cluster 2024-08-31T02:11:10.956522+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:13.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:12 smithi191 bash[24992]: cluster 2024-08-31T02:11:10.956522+0000 mgr.a (mgr.14150) 208 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:14.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:14 smithi163 bash[24253]: cluster 2024-08-31T02:11:12.957070+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:14.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:14 smithi027 bash[22610]: cluster 2024-08-31T02:11:12.957070+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:15.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:14 smithi191 bash[24992]: cluster 2024-08-31T02:11:12.957070+0000 mgr.a (mgr.14150) 209 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:15.528 INFO:teuthology.orchestra.run.smithi027.stdout:77309411341 2024-08-31T02:11:15.528 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-31T02:11:15.933 INFO:teuthology.orchestra.run.smithi027.stdout:55834574871 2024-08-31T02:11:15.934 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-31T02:11:16.003 INFO:teuthology.orchestra.run.smithi027.stdout:34359738401 2024-08-31T02:11:16.003 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-31T02:11:16.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:16 smithi163 bash[24253]: cluster 2024-08-31T02:11:14.957567+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:16.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:16 smithi027 bash[22610]: cluster 2024-08-31T02:11:14.957567+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:17.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:16 smithi191 bash[24992]: cluster 2024-08-31T02:11:14.957567+0000 mgr.a (mgr.14150) 210 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:18.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:18 smithi163 bash[24253]: cluster 2024-08-31T02:11:16.958107+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:18.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:18 smithi027 bash[22610]: cluster 2024-08-31T02:11:16.958107+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:19.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:18 smithi191 bash[24992]: cluster 2024-08-31T02:11:16.958107+0000 mgr.a (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:20.274 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:20.275 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:20.275 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:20.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:20 smithi027 bash[22610]: cluster 2024-08-31T02:11:18.958651+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:20 smithi163 bash[24253]: cluster 2024-08-31T02:11:18.958651+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:21.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:20 smithi191 bash[24992]: cluster 2024-08-31T02:11:18.958651+0000 mgr.a (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:22.277 INFO:teuthology.orchestra.run.smithi027.stdout:77309411342 2024-08-31T02:11:22.524 INFO:teuthology.orchestra.run.smithi027.stdout:55834574872 2024-08-31T02:11:22.634 INFO:teuthology.orchestra.run.smithi027.stdout:34359738403 2024-08-31T02:11:22.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:22 smithi163 bash[24253]: cluster 2024-08-31T02:11:20.959216+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:22.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:22 smithi163 bash[24253]: audit 2024-08-31T02:11:22.279454+0000 mon.a (mon.0) 462 : audit [DBG] from='client.? 172.21.15.27:0/3158368675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-31T02:11:22.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:22 smithi163 bash[24253]: audit 2024-08-31T02:11:22.526559+0000 mon.a (mon.0) 463 : audit [DBG] from='client.? 172.21.15.27:0/3468912247' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-31T02:11:22.963 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:22 smithi027 bash[22610]: cluster 2024-08-31T02:11:20.959216+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:22.963 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:22 smithi027 bash[22610]: audit 2024-08-31T02:11:22.279454+0000 mon.a (mon.0) 462 : audit [DBG] from='client.? 172.21.15.27:0/3158368675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-31T02:11:22.963 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:22 smithi027 bash[22610]: audit 2024-08-31T02:11:22.526559+0000 mon.a (mon.0) 463 : audit [DBG] from='client.? 172.21.15.27:0/3468912247' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-31T02:11:22.998 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411341 got 77309411342 for osd.2 2024-08-31T02:11:22.999 DEBUG:teuthology.parallel:result is None 2024-08-31T02:11:23.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:22 smithi191 bash[24992]: cluster 2024-08-31T02:11:20.959216+0000 mgr.a (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:23.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:22 smithi191 bash[24992]: audit 2024-08-31T02:11:22.279454+0000 mon.a (mon.0) 462 : audit [DBG] from='client.? 172.21.15.27:0/3158368675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-31T02:11:23.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:22 smithi191 bash[24992]: audit 2024-08-31T02:11:22.526559+0000 mon.a (mon.0) 463 : audit [DBG] from='client.? 172.21.15.27:0/3468912247' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-31T02:11:23.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:23 smithi027 bash[22610]: audit 2024-08-31T02:11:22.636782+0000 mon.a (mon.0) 464 : audit [DBG] from='client.? 172.21.15.27:0/3035610195' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-31T02:11:23.792 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574871 got 55834574872 for osd.1 2024-08-31T02:11:23.792 DEBUG:teuthology.parallel:result is None 2024-08-31T02:11:23.845 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738401 got 34359738403 for osd.0 2024-08-31T02:11:23.846 DEBUG:teuthology.parallel:result is None 2024-08-31T02:11:23.846 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T02:11:23.846 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T02:11:23.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:23 smithi163 bash[24253]: audit 2024-08-31T02:11:22.636782+0000 mon.a (mon.0) 464 : audit [DBG] from='client.? 172.21.15.27:0/3035610195' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-31T02:11:24.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:23 smithi191 bash[24992]: audit 2024-08-31T02:11:22.636782+0000 mon.a (mon.0) 464 : audit [DBG] from='client.? 172.21.15.27:0/3035610195' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-31T02:11:24.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:24 smithi163 bash[24253]: cluster 2024-08-31T02:11:22.959729+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:24.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:24 smithi027 bash[22610]: cluster 2024-08-31T02:11:22.959729+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:25.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:24 smithi191 bash[24992]: cluster 2024-08-31T02:11:22.959729+0000 mgr.a (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:26 smithi163 bash[24253]: cluster 2024-08-31T02:11:24.960370+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:26.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:26 smithi027 bash[22610]: cluster 2024-08-31T02:11:24.960370+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:26 smithi191 bash[24992]: cluster 2024-08-31T02:11:24.960370+0000 mgr.a (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:28.588 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:28 smithi163 bash[24253]: cluster 2024-08-31T02:11:26.960933+0000 mgr.a (mgr.14150) 216 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:28.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:28 smithi027 bash[22610]: cluster 2024-08-31T02:11:26.960933+0000 mgr.a (mgr.14150) 216 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:29.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:28 smithi191 bash[24992]: cluster 2024-08-31T02:11:26.960933+0000 mgr.a (mgr.14150) 216 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:30.034 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-08-31T02:11:30.034 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:11:30.685 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2024-08-31T02:11:28.961248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":281235456,"kb_used":88772,"kb_used_data":2292,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":281146684,"statfs":{"total":287985106944,"available":287894204416,"internally_reserved":0,"allocated":2347008,"data_stored":1944759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003377"},"pg_stats":[{"pgid":"1.0","version":"22'137","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-31T02:10:36.434181+0000","last_change":"2024-08-31T02:10:30.629067+0000","last_active":"2024-08-31T02:10:36.434181+0000","last_peered":"2024-08-31T02:10:36.434181+0000","last_clean":"2024-08-31T02:10:36.434181+0000","last_became_active":"2024-08-31T02:10:30.628254+0000","last_became_peered":"2024-08-31T02:10:30.628254+0000","last_unstale":"2024-08-31T02:10:36.434181+0000","last_undegraded":"2024-08-31T02:10:36.434181+0000","last_fullsized":"2024-08-31T02:10:36.434181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T02:10:29.609827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T02:10:29.609827+0000","last_clean_scrub_stamp":"2024-08-31T02:10:29.609827+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:56:14.249756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411344,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738404,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T02:11:30.685 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T02:11:30.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:30 smithi163 bash[24253]: cluster 2024-08-31T02:11:28.961618+0000 mgr.a (mgr.14150) 217 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:30.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:30 smithi027 bash[22610]: cluster 2024-08-31T02:11:28.961618+0000 mgr.a (mgr.14150) 217 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:31.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:30 smithi191 bash[24992]: cluster 2024-08-31T02:11:28.961618+0000 mgr.a (mgr.14150) 217 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:31 smithi163 bash[24253]: audit 2024-08-31T02:11:30.035583+0000 mgr.a (mgr.14150) 218 : audit [DBG] from='client.14364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T02:11:31.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:31 smithi027 bash[22610]: audit 2024-08-31T02:11:30.035583+0000 mgr.a (mgr.14150) 218 : audit [DBG] from='client.14364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T02:11:32.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:31 smithi191 bash[24992]: audit 2024-08-31T02:11:30.035583+0000 mgr.a (mgr.14150) 218 : audit [DBG] from='client.14364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T02:11:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:32 smithi163 bash[24253]: cluster 2024-08-31T02:11:30.962321+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:32.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:32 smithi027 bash[22610]: cluster 2024-08-31T02:11:30.962321+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:33.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:32 smithi191 bash[24992]: cluster 2024-08-31T02:11:30.962321+0000 mgr.a (mgr.14150) 219 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:34 smithi163 bash[24253]: cluster 2024-08-31T02:11:32.962923+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:34.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:34 smithi027 bash[22610]: cluster 2024-08-31T02:11:32.962923+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:35.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:34 smithi191 bash[24992]: cluster 2024-08-31T02:11:32.962923+0000 mgr.a (mgr.14150) 220 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:35.430 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:36.860 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-08-31T02:11:36.860 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:11:36.872 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:36 smithi027 bash[22610]: cluster 2024-08-31T02:11:34.963407+0000 mgr.a (mgr.14150) 221 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:36.872 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:36 smithi027 bash[22610]: audit 2024-08-31T02:11:36.538493+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:11:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:36 smithi163 bash[24253]: cluster 2024-08-31T02:11:34.963407+0000 mgr.a (mgr.14150) 221 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:36 smithi163 bash[24253]: audit 2024-08-31T02:11:36.538493+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:11:37.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:36 smithi191 bash[24992]: cluster 2024-08-31T02:11:34.963407+0000 mgr.a (mgr.14150) 221 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:37.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:36 smithi191 bash[24992]: audit 2024-08-31T02:11:36.538493+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:11:37.504 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-08-31T02:11:34.963169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":281235456,"kb_used":88772,"kb_used_data":2292,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":281146684,"statfs":{"total":287985106944,"available":287894204416,"internally_reserved":0,"allocated":2347008,"data_stored":1944759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003706"},"pg_stats":[{"pgid":"1.0","version":"22'137","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-31T02:10:36.434181+0000","last_change":"2024-08-31T02:10:30.629067+0000","last_active":"2024-08-31T02:10:36.434181+0000","last_peered":"2024-08-31T02:10:36.434181+0000","last_clean":"2024-08-31T02:10:36.434181+0000","last_became_active":"2024-08-31T02:10:30.628254+0000","last_became_peered":"2024-08-31T02:10:30.628254+0000","last_unstale":"2024-08-31T02:10:36.434181+0000","last_undegraded":"2024-08-31T02:10:36.434181+0000","last_fullsized":"2024-08-31T02:10:36.434181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T02:10:29.609827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T02:10:29.609827+0000","last_clean_scrub_stamp":"2024-08-31T02:10:29.609827+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T04:56:14.249756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411345,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27788,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717364,"statfs":{"total":95995035648,"available":95966580736,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":782336,"data_stored":648253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T02:11:37.505 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T02:11:37.505 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-31T02:11:37.505 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-31T02:11:37.505 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-31T02:11:37.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:37 smithi163 bash[24253]: audit 2024-08-31T02:11:36.862110+0000 mgr.a (mgr.14150) 222 : audit [DBG] from='client.14370 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T02:11:37.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:37 smithi163 bash[24253]: audit 2024-08-31T02:11:37.333147+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:11:37.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:37 smithi163 bash[24253]: audit 2024-08-31T02:11:37.334841+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:11:37.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:37 smithi163 bash[24253]: audit 2024-08-31T02:11:37.342265+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:11:37.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:37 smithi027 bash[22610]: audit 2024-08-31T02:11:36.862110+0000 mgr.a (mgr.14150) 222 : audit [DBG] from='client.14370 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T02:11:37.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:37 smithi027 bash[22610]: audit 2024-08-31T02:11:37.333147+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:11:37.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:37 smithi027 bash[22610]: audit 2024-08-31T02:11:37.334841+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:11:37.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:37 smithi027 bash[22610]: audit 2024-08-31T02:11:37.342265+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:11:38.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:37 smithi191 bash[24992]: audit 2024-08-31T02:11:36.862110+0000 mgr.a (mgr.14150) 222 : audit [DBG] from='client.14370 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T02:11:38.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:37 smithi191 bash[24992]: audit 2024-08-31T02:11:37.333147+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:11:38.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:37 smithi191 bash[24992]: audit 2024-08-31T02:11:37.334841+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:11:38.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:37 smithi191 bash[24992]: audit 2024-08-31T02:11:37.342265+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14150 172.21.15.27:0/1409807919' entity='mgr.a' 2024-08-31T02:11:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:38 smithi163 bash[24253]: cluster 2024-08-31T02:11:36.963763+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:38.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:38 smithi027 bash[22610]: cluster 2024-08-31T02:11:36.963763+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:38 smithi191 bash[24992]: cluster 2024-08-31T02:11:36.963763+0000 mgr.a (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:40.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:40 smithi163 bash[24253]: cluster 2024-08-31T02:11:38.964355+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:40.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:40 smithi027 bash[22610]: cluster 2024-08-31T02:11:38.964355+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:41.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:40 smithi191 bash[24992]: cluster 2024-08-31T02:11:38.964355+0000 mgr.a (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:42.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:42 smithi163 bash[24253]: cluster 2024-08-31T02:11:40.965027+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:42.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:42 smithi027 bash[22610]: cluster 2024-08-31T02:11:40.965027+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:43.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:42 smithi191 bash[24992]: cluster 2024-08-31T02:11:40.965027+0000 mgr.a (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:43.715 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-08-31T02:11:43.715 INFO:teuthology.orchestra.run.smithi027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-31T02:11:44.374 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-31T02:11:44.374 INFO:tasks.cephadm:Setup complete, yielding 2024-08-31T02:11:44.374 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T02:11:44.385 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-08-31T02:11:44.385 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- bash -c 'ceph mgr module enable rgw' 2024-08-31T02:11:44.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:44 smithi027 bash[22610]: cluster 2024-08-31T02:11:42.965733+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:44.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:44 smithi027 bash[22610]: audit 2024-08-31T02:11:43.717928+0000 mon.a (mon.0) 469 : audit [DBG] from='client.? 172.21.15.27:0/754590239' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-31T02:11:44.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:44 smithi163 bash[24253]: cluster 2024-08-31T02:11:42.965733+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:44.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:44 smithi163 bash[24253]: audit 2024-08-31T02:11:43.717928+0000 mon.a (mon.0) 469 : audit [DBG] from='client.? 172.21.15.27:0/754590239' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-31T02:11:45.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:44 smithi191 bash[24992]: cluster 2024-08-31T02:11:42.965733+0000 mgr.a (mgr.14150) 226 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:45.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:44 smithi191 bash[24992]: audit 2024-08-31T02:11:43.717928+0000 mon.a (mon.0) 469 : audit [DBG] from='client.? 172.21.15.27:0/754590239' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-31T02:11:46.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:46 smithi163 bash[24253]: cluster 2024-08-31T02:11:44.966354+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:46.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:46 smithi027 bash[22610]: cluster 2024-08-31T02:11:44.966354+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:47.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:46 smithi191 bash[24992]: cluster 2024-08-31T02:11:44.966354+0000 mgr.a (mgr.14150) 227 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:48 smithi163 bash[24253]: cluster 2024-08-31T02:11:46.966920+0000 mgr.a (mgr.14150) 228 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:48.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:48 smithi027 bash[22610]: cluster 2024-08-31T02:11:46.966920+0000 mgr.a (mgr.14150) 228 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:49.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:48 smithi191 bash[24992]: cluster 2024-08-31T02:11:46.966920+0000 mgr.a (mgr.14150) 228 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:49.125 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:50.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:50 smithi163 bash[24253]: cluster 2024-08-31T02:11:48.967439+0000 mgr.a (mgr.14150) 229 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:50.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:50 smithi163 bash[24253]: audit 2024-08-31T02:11:50.569240+0000 mon.a (mon.0) 470 : audit [INF] from='client.? 172.21.15.27:0/1483875125' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-08-31T02:11:50.947 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:50 smithi163 bash[24766]: ignoring --setuser ceph since I am not root 2024-08-31T02:11:50.947 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:50 smithi163 bash[24766]: ignoring --setgroup ceph since I am not root 2024-08-31T02:11:50.947 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:50 smithi163 bash[24766]: debug 2024-08-31T02:11:50.716+0000 7ff62f661640 1 -- 172.21.15.163:0/1785621119 <== mon.2 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a6e6d70e0 con 0x556a6e6d9400 2024-08-31T02:11:50.947 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:50 smithi163 bash[24766]: debug 2024-08-31T02:11:50.828+0000 7ff631ebd040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-31T02:11:50.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:50 smithi027 bash[22610]: cluster 2024-08-31T02:11:48.967439+0000 mgr.a (mgr.14150) 229 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:50.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:50 smithi027 bash[22610]: audit 2024-08-31T02:11:50.569240+0000 mon.a (mon.0) 470 : audit [INF] from='client.? 172.21.15.27:0/1483875125' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-08-31T02:11:50.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:50 smithi027 bash[22863]: ignoring --setuser ceph since I am not root 2024-08-31T02:11:50.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:50 smithi027 bash[22863]: ignoring --setgroup ceph since I am not root 2024-08-31T02:11:50.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:50 smithi027 bash[22863]: debug 2024-08-31T02:11:50.809+0000 7f9d29db3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-31T02:11:51.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:50 smithi191 bash[24992]: cluster 2024-08-31T02:11:48.967439+0000 mgr.a (mgr.14150) 229 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 87 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:51.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:50 smithi191 bash[24992]: audit 2024-08-31T02:11:50.569240+0000 mon.a (mon.0) 470 : audit [INF] from='client.? 172.21.15.27:0/1483875125' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "rgw"}]: dispatch 2024-08-31T02:11:51.328 INFO:teuthology.run_tasks:Running task rgw_module.apply... 2024-08-31T02:11:51.358 INFO:tasks.rgw_module:Applying spec(s): rgw_realm: myrealm1 rgw_zone: myzone1 rgw_zonegroup: myzonegroup1 spec: rgw_frontend_port: 5500 2024-08-31T02:11:51.358 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- ceph rgw realm bootstrap -i - 2024-08-31T02:11:51.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:51 smithi163 bash[24253]: audit 2024-08-31T02:11:50.642452+0000 mon.a (mon.0) 471 : audit [INF] from='client.? 172.21.15.27:0/1483875125' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-08-31T02:11:51.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:51 smithi163 bash[24253]: cluster 2024-08-31T02:11:50.651384+0000 mon.a (mon.0) 472 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-08-31T02:11:51.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:51 smithi027 bash[22610]: audit 2024-08-31T02:11:50.642452+0000 mon.a (mon.0) 471 : audit [INF] from='client.? 172.21.15.27:0/1483875125' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-08-31T02:11:51.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:51 smithi027 bash[22610]: cluster 2024-08-31T02:11:50.651384+0000 mon.a (mon.0) 472 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-08-31T02:11:52.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:51 smithi191 bash[24992]: audit 2024-08-31T02:11:50.642452+0000 mon.a (mon.0) 471 : audit [INF] from='client.? 172.21.15.27:0/1483875125' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "rgw"}]': finished 2024-08-31T02:11:52.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:51 smithi191 bash[24992]: cluster 2024-08-31T02:11:50.651384+0000 mon.a (mon.0) 472 : cluster [DBG] mgrmap e16: a(active, since 5m), standbys: b 2024-08-31T02:11:52.446 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:52 smithi163 bash[24766]: debug 2024-08-31T02:11:52.032+0000 7ff631ebd040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-31T02:11:52.446 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:52 smithi163 bash[24766]: debug 2024-08-31T02:11:52.100+0000 7ff631ebd040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-31T02:11:52.446 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:52 smithi163 bash[24766]: debug 2024-08-31T02:11:52.248+0000 7ff631ebd040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-31T02:11:52.480 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:52 smithi027 bash[22863]: debug 2024-08-31T02:11:52.053+0000 7f9d29db3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-31T02:11:52.480 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:52 smithi027 bash[22863]: debug 2024-08-31T02:11:52.121+0000 7f9d29db3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-31T02:11:52.480 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:52 smithi027 bash[22863]: debug 2024-08-31T02:11:52.281+0000 7f9d29db3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-31T02:11:53.196 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:52 smithi163 bash[24766]: debug 2024-08-31T02:11:52.888+0000 7ff631ebd040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-31T02:11:53.196 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:52 smithi163 bash[24766]: debug 2024-08-31T02:11:52.960+0000 7ff631ebd040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-31T02:11:53.196 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:53 smithi163 bash[24766]: debug 2024-08-31T02:11:53.028+0000 7ff631ebd040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-31T02:11:53.230 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:52 smithi027 bash[22863]: debug 2024-08-31T02:11:52.957+0000 7f9d29db3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-31T02:11:53.230 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:53 smithi027 bash[22863]: debug 2024-08-31T02:11:53.029+0000 7f9d29db3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-31T02:11:53.230 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:53 smithi027 bash[22863]: debug 2024-08-31T02:11:53.101+0000 7f9d29db3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-31T02:11:53.610 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:53 smithi163 bash[24766]: debug 2024-08-31T02:11:53.212+0000 7ff631ebd040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-31T02:11:53.610 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:53 smithi163 bash[24766]: debug 2024-08-31T02:11:53.288+0000 7ff631ebd040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-31T02:11:53.610 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:53 smithi163 bash[24766]: debug 2024-08-31T02:11:53.356+0000 7ff631ebd040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-31T02:11:53.610 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:53 smithi163 bash[24766]: debug 2024-08-31T02:11:53.608+0000 7ff631ebd040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-31T02:11:53.713 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:53 smithi027 bash[22863]: debug 2024-08-31T02:11:53.293+0000 7f9d29db3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-31T02:11:53.713 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:53 smithi027 bash[22863]: debug 2024-08-31T02:11:53.373+0000 7f9d29db3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-31T02:11:53.713 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:53 smithi027 bash[22863]: debug 2024-08-31T02:11:53.445+0000 7f9d29db3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-31T02:11:53.872 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:53 smithi163 bash[24766]: debug 2024-08-31T02:11:53.676+0000 7ff631ebd040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-31T02:11:53.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:53 smithi027 bash[22863]: debug 2024-08-31T02:11:53.713+0000 7f9d29db3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-31T02:11:53.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:53 smithi027 bash[22863]: debug 2024-08-31T02:11:53.785+0000 7f9d29db3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-31T02:11:54.196 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:53 smithi163 bash[24766]: debug 2024-08-31T02:11:53.872+0000 7ff631ebd040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-31T02:11:54.196 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:53 smithi163 bash[24766]: debug 2024-08-31T02:11:53.948+0000 7ff631ebd040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-31T02:11:54.330 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:53 smithi027 bash[22863]: debug 2024-08-31T02:11:53.989+0000 7f9d29db3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-31T02:11:54.330 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:54 smithi027 bash[22863]: debug 2024-08-31T02:11:54.069+0000 7f9d29db3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-31T02:11:54.533 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:54 smithi163 bash[24766]: debug 2024-08-31T02:11:54.196+0000 7ff631ebd040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-31T02:11:54.533 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:54 smithi163 bash[24766]: debug 2024-08-31T02:11:54.372+0000 7ff631ebd040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:11:54.685 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:54 smithi027 bash[22863]: debug 2024-08-31T02:11:54.329+0000 7f9d29db3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-31T02:11:54.686 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:54 smithi027 bash[22863]: debug 2024-08-31T02:11:54.513+0000 7f9d29db3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:11:54.790 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:54 smithi163 bash[24766]: debug 2024-08-31T02:11:54.532+0000 7ff631ebd040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-31T02:11:54.790 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:54 smithi163 bash[24766]: debug 2024-08-31T02:11:54.612+0000 7ff631ebd040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-31T02:11:54.954 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:54 smithi027 bash[22863]: debug 2024-08-31T02:11:54.685+0000 7f9d29db3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-31T02:11:54.954 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:54 smithi027 bash[22863]: debug 2024-08-31T02:11:54.765+0000 7f9d29db3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-31T02:11:55.196 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:54 smithi163 bash[24766]: debug 2024-08-31T02:11:54.788+0000 7ff631ebd040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:11:55.230 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:54 smithi027 bash[22863]: debug 2024-08-31T02:11:54.953+0000 7f9d29db3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-31T02:11:55.896 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:55 smithi163 bash[24766]: debug 2024-08-31T02:11:55.596+0000 7ff631ebd040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-31T02:11:55.897 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:55 smithi163 bash[24766]: debug 2024-08-31T02:11:55.672+0000 7ff631ebd040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-31T02:11:56.092 INFO:teuthology.orchestra.run.smithi027.stdout:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:11:56.125 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:55 smithi027 bash[22863]: debug 2024-08-31T02:11:55.813+0000 7f9d29db3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-31T02:11:56.125 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:55 smithi027 bash[22863]: debug 2024-08-31T02:11:55.889+0000 7f9d29db3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-31T02:11:56.196 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:55 smithi163 bash[24766]: debug 2024-08-31T02:11:55.896+0000 7ff631ebd040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-31T02:11:56.196 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:55 smithi163 bash[24766]: debug 2024-08-31T02:11:55.968+0000 7ff631ebd040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-31T02:11:56.480 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:56 smithi027 bash[22863]: debug 2024-08-31T02:11:56.125+0000 7f9d29db3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-31T02:11:56.480 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:56 smithi027 bash[22863]: debug 2024-08-31T02:11:56.201+0000 7f9d29db3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-31T02:11:56.696 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:56 smithi163 bash[24766]: debug 2024-08-31T02:11:56.356+0000 7ff631ebd040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-31T02:11:56.696 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:11:56 smithi163 bash[24766]: debug 2024-08-31T02:11:56.436+0000 7ff631ebd040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-31T02:11:56.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:56 smithi163 bash[24253]: cluster 2024-08-31T02:11:56.460386+0000 mon.a (mon.0) 473 : cluster [DBG] Standby manager daemon b restarted 2024-08-31T02:11:56.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:56 smithi163 bash[24253]: cluster 2024-08-31T02:11:56.460542+0000 mon.a (mon.0) 474 : cluster [DBG] Standby manager daemon b started 2024-08-31T02:11:56.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:56 smithi163 bash[24253]: audit 2024-08-31T02:11:56.464053+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-08-31T02:11:56.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:56 smithi163 bash[24253]: audit 2024-08-31T02:11:56.465136+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T02:11:56.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:56 smithi163 bash[24253]: audit 2024-08-31T02:11:56.466173+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-08-31T02:11:56.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:56 smithi163 bash[24253]: audit 2024-08-31T02:11:56.466612+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T02:11:56.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:56 smithi191 bash[24992]: cluster 2024-08-31T02:11:56.460386+0000 mon.a (mon.0) 473 : cluster [DBG] Standby manager daemon b restarted 2024-08-31T02:11:56.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:56 smithi191 bash[24992]: cluster 2024-08-31T02:11:56.460542+0000 mon.a (mon.0) 474 : cluster [DBG] Standby manager daemon b started 2024-08-31T02:11:56.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:56 smithi191 bash[24992]: audit 2024-08-31T02:11:56.464053+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-08-31T02:11:56.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:56 smithi191 bash[24992]: audit 2024-08-31T02:11:56.465136+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T02:11:56.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:56 smithi191 bash[24992]: audit 2024-08-31T02:11:56.466173+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-08-31T02:11:56.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:56 smithi191 bash[24992]: audit 2024-08-31T02:11:56.466612+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T02:11:56.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:56 smithi027 bash[22863]: debug 2024-08-31T02:11:56.613+0000 7f9d29db3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-31T02:11:56.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:56 smithi027 bash[22863]: debug 2024-08-31T02:11:56.693+0000 7f9d29db3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-31T02:11:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:56 smithi027 bash[22610]: cluster 2024-08-31T02:11:56.460386+0000 mon.a (mon.0) 473 : cluster [DBG] Standby manager daemon b restarted 2024-08-31T02:11:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:56 smithi027 bash[22610]: cluster 2024-08-31T02:11:56.460542+0000 mon.a (mon.0) 474 : cluster [DBG] Standby manager daemon b started 2024-08-31T02:11:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:56 smithi027 bash[22610]: audit 2024-08-31T02:11:56.464053+0000 mon.b (mon.2) 13 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2024-08-31T02:11:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:56 smithi027 bash[22610]: audit 2024-08-31T02:11:56.465136+0000 mon.b (mon.2) 14 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-31T02:11:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:56 smithi027 bash[22610]: audit 2024-08-31T02:11:56.466173+0000 mon.b (mon.2) 15 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2024-08-31T02:11:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:56 smithi027 bash[22610]: audit 2024-08-31T02:11:56.466612+0000 mon.b (mon.2) 16 : audit [DBG] from='mgr.? 172.21.15.163:0/3068840302' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-31T02:11:57.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: cluster 2024-08-31T02:11:56.522014+0000 mon.a (mon.0) 475 : cluster [DBG] mgrmap e17: a(active, since 5m), standbys: b 2024-08-31T02:11:57.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: cluster 2024-08-31T02:11:56.720553+0000 mon.a (mon.0) 476 : cluster [INF] Active manager daemon a restarted 2024-08-31T02:11:57.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: cluster 2024-08-31T02:11:56.721140+0000 mon.a (mon.0) 477 : cluster [INF] Activating manager daemon a 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: cluster 2024-08-31T02:11:56.730681+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: cluster 2024-08-31T02:11:56.731164+0000 mon.a (mon.0) 479 : cluster [DBG] mgrmap e18: a(active, starting, since 0.0102775s), standbys: b 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.734227+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.734755+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.735303+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.737412+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.737934+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.738438+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.738908+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.739382+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.739879+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T02:11:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.740176+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T02:11:57.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.740722+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T02:11:57.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: cluster 2024-08-31T02:11:56.765003+0000 mon.a (mon.0) 491 : cluster [INF] Manager daemon a is now available 2024-08-31T02:11:57.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.785630+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:11:57.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.806273+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-08-31T02:11:57.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:57 smithi191 bash[24992]: audit 2024-08-31T02:11:56.823317+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-08-31T02:11:57.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: cluster 2024-08-31T02:11:56.522014+0000 mon.a (mon.0) 475 : cluster [DBG] mgrmap e17: a(active, since 5m), standbys: b 2024-08-31T02:11:57.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: cluster 2024-08-31T02:11:56.720553+0000 mon.a (mon.0) 476 : cluster [INF] Active manager daemon a restarted 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: cluster 2024-08-31T02:11:56.721140+0000 mon.a (mon.0) 477 : cluster [INF] Activating manager daemon a 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: cluster 2024-08-31T02:11:56.730681+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: cluster 2024-08-31T02:11:56.731164+0000 mon.a (mon.0) 479 : cluster [DBG] mgrmap e18: a(active, starting, since 0.0102775s), standbys: b 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.734227+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.734755+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.735303+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.737412+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.737934+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.738438+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.738908+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.739382+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.739879+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T02:11:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.740176+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T02:11:57.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.740722+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T02:11:57.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: cluster 2024-08-31T02:11:56.765003+0000 mon.a (mon.0) 491 : cluster [INF] Manager daemon a is now available 2024-08-31T02:11:57.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.785630+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:11:57.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.806273+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-08-31T02:11:57.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:57 smithi163 bash[24253]: audit 2024-08-31T02:11:56.823317+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-08-31T02:11:57.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: cluster 2024-08-31T02:11:56.522014+0000 mon.a (mon.0) 475 : cluster [DBG] mgrmap e17: a(active, since 5m), standbys: b 2024-08-31T02:11:57.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: cluster 2024-08-31T02:11:56.720553+0000 mon.a (mon.0) 476 : cluster [INF] Active manager daemon a restarted 2024-08-31T02:11:57.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: cluster 2024-08-31T02:11:56.721140+0000 mon.a (mon.0) 477 : cluster [INF] Activating manager daemon a 2024-08-31T02:11:57.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: cluster 2024-08-31T02:11:56.730681+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2024-08-31T02:11:57.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: cluster 2024-08-31T02:11:56.731164+0000 mon.a (mon.0) 479 : cluster [DBG] mgrmap e18: a(active, starting, since 0.0102775s), standbys: b 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.734227+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.734755+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.735303+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.737412+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.737934+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.738438+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.738908+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.739382+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.739879+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.740176+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.740722+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: cluster 2024-08-31T02:11:56.765003+0000 mon.a (mon.0) 491 : cluster [INF] Manager daemon a is now available 2024-08-31T02:11:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.785630+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:11:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.806273+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2024-08-31T02:11:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:57 smithi027 bash[22610]: audit 2024-08-31T02:11:56.823317+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2024-08-31T02:11:59.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:58 smithi191 bash[24992]: cluster 2024-08-31T02:11:57.743460+0000 mgr.a (mgr.14388) 1 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:59.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:58 smithi191 bash[24992]: cluster 2024-08-31T02:11:57.743505+0000 mon.a (mon.0) 495 : cluster [DBG] mgrmap e19: a(active, since 1.02262s), standbys: b 2024-08-31T02:11:59.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:58 smithi191 bash[24992]: audit 2024-08-31T02:11:57.902330+0000 mgr.a (mgr.14388) 2 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:11:59.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:58 smithi163 bash[24253]: cluster 2024-08-31T02:11:57.743460+0000 mgr.a (mgr.14388) 1 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:59.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:58 smithi163 bash[24253]: cluster 2024-08-31T02:11:57.743505+0000 mon.a (mon.0) 495 : cluster [DBG] mgrmap e19: a(active, since 1.02262s), standbys: b 2024-08-31T02:11:59.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:58 smithi163 bash[24253]: audit 2024-08-31T02:11:57.902330+0000 mgr.a (mgr.14388) 2 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:11:59.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:58 smithi027 bash[22610]: cluster 2024-08-31T02:11:57.743460+0000 mgr.a (mgr.14388) 1 : cluster [DBG] pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:11:59.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:58 smithi027 bash[22610]: cluster 2024-08-31T02:11:57.743505+0000 mon.a (mon.0) 495 : cluster [DBG] mgrmap e19: a(active, since 1.02262s), standbys: b 2024-08-31T02:11:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:58 smithi027 bash[22610]: audit 2024-08-31T02:11:57.902330+0000 mgr.a (mgr.14388) 2 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "rgw realm bootstrap", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:11:59.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: debug 2024-08-31T02:11:59.597+0000 7f9c87e31640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:02:11:59] ENGINE Error in HTTPServer.serve 2024-08-31T02:11:59.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: Traceback (most recent call last): 2024-08-31T02:11:59.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: self._connections.run(self.expiration_interval) 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: self._run(expiration_interval) 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: s = self.context.wrap_socket( 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: return self.sslsocket_class._create( 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: self.do_handshake() 2024-08-31T02:11:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T02:11:59.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: self._sslobj.do_handshake() 2024-08-31T02:11:59.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22863]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T02:11:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: cluster 2024-08-31T02:11:58.743029+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-08-31T02:11:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: audit 2024-08-31T02:11:58.744339+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.15.27:0/1362248818' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-08-31T02:11:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: cephadm 2024-08-31T02:11:59.470358+0000 mgr.a (mgr.14388) 4 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Bus STARTING 2024-08-31T02:11:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: cephadm 2024-08-31T02:11:59.594624+0000 mgr.a (mgr.14388) 5 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Serving on https://172.21.15.27:7150 2024-08-31T02:11:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: cephadm 2024-08-31T02:11:59.599347+0000 mgr.a (mgr.14388) 6 : cephadm [ERR] [31/Aug/2024:02:11:59] ENGINE Error in HTTPServer.serve 2024-08-31T02:11:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: Traceback (most recent call last): 2024-08-31T02:11:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T02:11:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: self._connections.run(self.expiration_interval) 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: self._run(expiration_interval) 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: s = self.context.wrap_socket( 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: return self.sslsocket_class._create( 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: self.do_handshake() 2024-08-31T02:11:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T02:11:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: self._sslobj.do_handshake() 2024-08-31T02:11:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T02:11:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: cephadm 2024-08-31T02:11:59.695806+0000 mgr.a (mgr.14388) 7 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Serving on http://172.21.15.27:8765 2024-08-31T02:11:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:11:59 smithi027 bash[22610]: cephadm 2024-08-31T02:11:59.695953+0000 mgr.a (mgr.14388) 8 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Bus STARTED 2024-08-31T02:12:00.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: cluster 2024-08-31T02:11:58.743029+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-08-31T02:12:00.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: audit 2024-08-31T02:11:58.744339+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.15.27:0/1362248818' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: cephadm 2024-08-31T02:11:59.470358+0000 mgr.a (mgr.14388) 4 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Bus STARTING 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: cephadm 2024-08-31T02:11:59.594624+0000 mgr.a (mgr.14388) 5 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Serving on https://172.21.15.27:7150 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: cephadm 2024-08-31T02:11:59.599347+0000 mgr.a (mgr.14388) 6 : cephadm [ERR] [31/Aug/2024:02:11:59] ENGINE Error in HTTPServer.serve 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: Traceback (most recent call last): 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: self._connections.run(self.expiration_interval) 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: self._run(expiration_interval) 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T02:12:00.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T02:12:00.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: s = self.context.wrap_socket( 2024-08-31T02:12:00.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T02:12:00.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: return self.sslsocket_class._create( 2024-08-31T02:12:00.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T02:12:00.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: self.do_handshake() 2024-08-31T02:12:00.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T02:12:00.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: self._sslobj.do_handshake() 2024-08-31T02:12:00.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T02:12:00.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: cephadm 2024-08-31T02:11:59.695806+0000 mgr.a (mgr.14388) 7 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Serving on http://172.21.15.27:8765 2024-08-31T02:12:00.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:11:59 smithi191 bash[24992]: cephadm 2024-08-31T02:11:59.695953+0000 mgr.a (mgr.14388) 8 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Bus STARTED 2024-08-31T02:12:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: cluster 2024-08-31T02:11:58.743029+0000 mon.a (mon.0) 496 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2024-08-31T02:12:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: audit 2024-08-31T02:11:58.744339+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.15.27:0/1362248818' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-08-31T02:12:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: cephadm 2024-08-31T02:11:59.470358+0000 mgr.a (mgr.14388) 4 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Bus STARTING 2024-08-31T02:12:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: cephadm 2024-08-31T02:11:59.594624+0000 mgr.a (mgr.14388) 5 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Serving on https://172.21.15.27:7150 2024-08-31T02:12:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: cephadm 2024-08-31T02:11:59.599347+0000 mgr.a (mgr.14388) 6 : cephadm [ERR] [31/Aug/2024:02:11:59] ENGINE Error in HTTPServer.serve 2024-08-31T02:12:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: Traceback (most recent call last): 2024-08-31T02:12:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T02:12:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: self._connections.run(self.expiration_interval) 2024-08-31T02:12:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: self._run(expiration_interval) 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: s = self.context.wrap_socket( 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: return self.sslsocket_class._create( 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: self.do_handshake() 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T02:12:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: self._sslobj.do_handshake() 2024-08-31T02:12:00.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T02:12:00.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: cephadm 2024-08-31T02:11:59.695806+0000 mgr.a (mgr.14388) 7 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Serving on http://172.21.15.27:8765 2024-08-31T02:12:00.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:11:59 smithi163 bash[24253]: cephadm 2024-08-31T02:11:59.695953+0000 mgr.a (mgr.14388) 8 : cephadm [INF] [31/Aug/2024:02:11:59] ENGINE Bus STARTED 2024-08-31T02:12:01.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:01 smithi163 bash[24253]: audit 2024-08-31T02:11:59.751668+0000 mon.a (mon.0) 498 : audit [INF] from='client.? 172.21.15.27:0/1362248818' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-08-31T02:12:01.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:01 smithi163 bash[24253]: cluster 2024-08-31T02:11:59.768940+0000 mon.a (mon.0) 499 : cluster [DBG] mgrmap e20: a(active, since 3s), standbys: b 2024-08-31T02:12:01.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:01 smithi163 bash[24253]: cluster 2024-08-31T02:11:59.769295+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-08-31T02:12:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:01 smithi027 bash[22610]: audit 2024-08-31T02:11:59.751668+0000 mon.a (mon.0) 498 : audit [INF] from='client.? 172.21.15.27:0/1362248818' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-08-31T02:12:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:01 smithi027 bash[22610]: cluster 2024-08-31T02:11:59.768940+0000 mon.a (mon.0) 499 : cluster [DBG] mgrmap e20: a(active, since 3s), standbys: b 2024-08-31T02:12:01.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:01 smithi027 bash[22610]: cluster 2024-08-31T02:11:59.769295+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-08-31T02:12:01.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:01 smithi191 bash[24992]: audit 2024-08-31T02:11:59.751668+0000 mon.a (mon.0) 498 : audit [INF] from='client.? 172.21.15.27:0/1362248818' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-08-31T02:12:01.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:01 smithi191 bash[24992]: cluster 2024-08-31T02:11:59.768940+0000 mon.a (mon.0) 499 : cluster [DBG] mgrmap e20: a(active, since 3s), standbys: b 2024-08-31T02:12:01.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:01 smithi191 bash[24992]: cluster 2024-08-31T02:11:59.769295+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e25: 3 total, 3 up, 3 in 2024-08-31T02:12:02.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:02 smithi163 bash[24253]: cluster 2024-08-31T02:12:00.739048+0000 mgr.a (mgr.14388) 9 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:12:02.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:02 smithi163 bash[24253]: cluster 2024-08-31T02:12:01.120922+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-08-31T02:12:02.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:02 smithi163 bash[24253]: audit 2024-08-31T02:12:01.121888+0000 mon.a (mon.0) 502 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-08-31T02:12:02.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:02 smithi163 bash[24253]: cluster 2024-08-31T02:12:01.173005+0000 mon.a (mon.0) 503 : cluster [DBG] mgrmap e21: a(active, since 4s), standbys: b 2024-08-31T02:12:02.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:02 smithi027 bash[22610]: cluster 2024-08-31T02:12:00.739048+0000 mgr.a (mgr.14388) 9 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:12:02.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:02 smithi027 bash[22610]: cluster 2024-08-31T02:12:01.120922+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-08-31T02:12:02.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:02 smithi027 bash[22610]: audit 2024-08-31T02:12:01.121888+0000 mon.a (mon.0) 502 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-08-31T02:12:02.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:02 smithi027 bash[22610]: cluster 2024-08-31T02:12:01.173005+0000 mon.a (mon.0) 503 : cluster [DBG] mgrmap e21: a(active, since 4s), standbys: b 2024-08-31T02:12:02.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:02 smithi191 bash[24992]: cluster 2024-08-31T02:12:00.739048+0000 mgr.a (mgr.14388) 9 : cluster [DBG] pgmap v7: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:12:02.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:02 smithi191 bash[24992]: cluster 2024-08-31T02:12:01.120922+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e26: 3 total, 3 up, 3 in 2024-08-31T02:12:02.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:02 smithi191 bash[24992]: audit 2024-08-31T02:12:01.121888+0000 mon.a (mon.0) 502 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]: dispatch 2024-08-31T02:12:02.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:02 smithi191 bash[24992]: cluster 2024-08-31T02:12:01.173005+0000 mon.a (mon.0) 503 : cluster [DBG] mgrmap e21: a(active, since 4s), standbys: b 2024-08-31T02:12:03.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:03 smithi163 bash[24253]: audit 2024-08-31T02:12:02.118816+0000 mon.a (mon.0) 504 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-08-31T02:12:03.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:03 smithi163 bash[24253]: cluster 2024-08-31T02:12:02.126484+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-08-31T02:12:03.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:03 smithi163 bash[24253]: audit 2024-08-31T02:12:02.633407+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:03 smithi163 bash[24253]: audit 2024-08-31T02:12:02.636675+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:03 smithi163 bash[24253]: audit 2024-08-31T02:12:02.647072+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:03 smithi163 bash[24253]: audit 2024-08-31T02:12:02.650570+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:03 smithi163 bash[24253]: audit 2024-08-31T02:12:02.672833+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:03 smithi163 bash[24253]: audit 2024-08-31T02:12:02.677435+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:03 smithi027 bash[22610]: audit 2024-08-31T02:12:02.118816+0000 mon.a (mon.0) 504 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-08-31T02:12:03.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:03 smithi027 bash[22610]: cluster 2024-08-31T02:12:02.126484+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-08-31T02:12:03.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:03 smithi027 bash[22610]: audit 2024-08-31T02:12:02.633407+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:03 smithi027 bash[22610]: audit 2024-08-31T02:12:02.636675+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:03 smithi027 bash[22610]: audit 2024-08-31T02:12:02.647072+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:03 smithi027 bash[22610]: audit 2024-08-31T02:12:02.650570+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:03 smithi027 bash[22610]: audit 2024-08-31T02:12:02.672833+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:03 smithi027 bash[22610]: audit 2024-08-31T02:12:02.677435+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:03 smithi191 bash[24992]: audit 2024-08-31T02:12:02.118816+0000 mon.a (mon.0) 504 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.log","app": "rgw"}]': finished 2024-08-31T02:12:03.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:03 smithi191 bash[24992]: cluster 2024-08-31T02:12:02.126484+0000 mon.a (mon.0) 505 : cluster [DBG] osdmap e27: 3 total, 3 up, 3 in 2024-08-31T02:12:03.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:03 smithi191 bash[24992]: audit 2024-08-31T02:12:02.633407+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:03 smithi191 bash[24992]: audit 2024-08-31T02:12:02.636675+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:03 smithi191 bash[24992]: audit 2024-08-31T02:12:02.647072+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:03 smithi191 bash[24992]: audit 2024-08-31T02:12:02.650570+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:03 smithi191 bash[24992]: audit 2024-08-31T02:12:02.672833+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:03.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:03 smithi191 bash[24992]: audit 2024-08-31T02:12:02.677435+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: cluster 2024-08-31T02:12:02.739561+0000 mgr.a (mgr.14388) 10 : cluster [DBG] pgmap v10: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:12:04.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: cluster 2024-08-31T02:12:03.142182+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-08-31T02:12:04.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: audit 2024-08-31T02:12:03.144666+0000 mon.a (mon.0) 513 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-08-31T02:12:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: audit 2024-08-31T02:12:03.874236+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: audit 2024-08-31T02:12:03.879788+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: audit 2024-08-31T02:12:03.885921+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: audit 2024-08-31T02:12:03.891586+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: audit 2024-08-31T02:12:03.901342+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: audit 2024-08-31T02:12:03.906660+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: audit 2024-08-31T02:12:03.908642+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:04 smithi163 bash[24253]: audit 2024-08-31T02:12:03.909752+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:04.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: cluster 2024-08-31T02:12:02.739561+0000 mgr.a (mgr.14388) 10 : cluster [DBG] pgmap v10: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:12:04.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: cluster 2024-08-31T02:12:03.142182+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-08-31T02:12:04.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: audit 2024-08-31T02:12:03.144666+0000 mon.a (mon.0) 513 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-08-31T02:12:04.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: audit 2024-08-31T02:12:03.874236+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: audit 2024-08-31T02:12:03.879788+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: audit 2024-08-31T02:12:03.885921+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: audit 2024-08-31T02:12:03.891586+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: audit 2024-08-31T02:12:03.901342+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: audit 2024-08-31T02:12:03.906660+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: audit 2024-08-31T02:12:03.908642+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:04.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:04 smithi027 bash[22610]: audit 2024-08-31T02:12:03.909752+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: cluster 2024-08-31T02:12:02.739561+0000 mgr.a (mgr.14388) 10 : cluster [DBG] pgmap v10: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-08-31T02:12:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: cluster 2024-08-31T02:12:03.142182+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e28: 3 total, 3 up, 3 in 2024-08-31T02:12:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: audit 2024-08-31T02:12:03.144666+0000 mon.a (mon.0) 513 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]: dispatch 2024-08-31T02:12:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: audit 2024-08-31T02:12:03.874236+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: audit 2024-08-31T02:12:03.879788+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: audit 2024-08-31T02:12:03.885921+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: audit 2024-08-31T02:12:03.891586+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: audit 2024-08-31T02:12:03.901342+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: audit 2024-08-31T02:12:03.906660+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:04.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: audit 2024-08-31T02:12:03.908642+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:04.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:04 smithi191 bash[24992]: audit 2024-08-31T02:12:03.909752+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:03.911611+0000 mgr.a (mgr.14388) 11 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.conf 2024-08-31T02:12:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:03.912038+0000 mgr.a (mgr.14388) 12 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.conf 2024-08-31T02:12:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:03.913086+0000 mgr.a (mgr.14388) 13 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2024-08-31T02:12:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:04.126616+0000 mgr.a (mgr.14388) 14 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:12:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:04.126968+0000 mgr.a (mgr.14388) 15 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:12:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:04.127157+0000 mgr.a (mgr.14388) 16 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:12:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.140856+0000 mon.a (mon.0) 522 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cluster 2024-08-31T02:12:04.144562+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:04.327897+0000 mgr.a (mgr.14388) 17 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:04.328117+0000 mgr.a (mgr.14388) 18 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:04.328363+0000 mgr.a (mgr.14388) 19 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:04.507794+0000 mgr.a (mgr.14388) 20 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:04.508137+0000 mgr.a (mgr.14388) 21 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: cephadm 2024-08-31T02:12:04.508518+0000 mgr.a (mgr.14388) 22 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.692378+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.697597+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.701947+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.706401+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.710765+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.715134+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.719497+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.772847+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.775357+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.776557+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:05 smithi163 bash[24253]: audit 2024-08-31T02:12:04.783810+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:03.911611+0000 mgr.a (mgr.14388) 11 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.conf 2024-08-31T02:12:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:03.912038+0000 mgr.a (mgr.14388) 12 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.conf 2024-08-31T02:12:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:03.913086+0000 mgr.a (mgr.14388) 13 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2024-08-31T02:12:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:04.126616+0000 mgr.a (mgr.14388) 14 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:12:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:04.126968+0000 mgr.a (mgr.14388) 15 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:12:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:04.127157+0000 mgr.a (mgr.14388) 16 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:12:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.140856+0000 mon.a (mon.0) 522 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-08-31T02:12:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cluster 2024-08-31T02:12:04.144562+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-08-31T02:12:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:04.327897+0000 mgr.a (mgr.14388) 17 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:12:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:04.328117+0000 mgr.a (mgr.14388) 18 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:04.328363+0000 mgr.a (mgr.14388) 19 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:04.507794+0000 mgr.a (mgr.14388) 20 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:04.508137+0000 mgr.a (mgr.14388) 21 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: cephadm 2024-08-31T02:12:04.508518+0000 mgr.a (mgr.14388) 22 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.692378+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.697597+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.701947+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.706401+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.710765+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.715134+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.719497+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.772847+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.775357+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.776557+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:05 smithi027 bash[22610]: audit 2024-08-31T02:12:04.783810+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:03.911611+0000 mgr.a (mgr.14388) 11 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.conf 2024-08-31T02:12:05.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:03.912038+0000 mgr.a (mgr.14388) 12 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.conf 2024-08-31T02:12:05.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:03.913086+0000 mgr.a (mgr.14388) 13 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2024-08-31T02:12:05.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:04.126616+0000 mgr.a (mgr.14388) 14 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:04.126968+0000 mgr.a (mgr.14388) 15 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:04.127157+0000 mgr.a (mgr.14388) 16 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.140856+0000 mon.a (mon.0) 522 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.control","app": "rgw"}]': finished 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cluster 2024-08-31T02:12:04.144562+0000 mon.a (mon.0) 523 : cluster [DBG] osdmap e29: 3 total, 3 up, 3 in 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:04.327897+0000 mgr.a (mgr.14388) 17 : cephadm [INF] Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:04.328117+0000 mgr.a (mgr.14388) 18 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:04.328363+0000 mgr.a (mgr.14388) 19 : cephadm [INF] Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:04.507794+0000 mgr.a (mgr.14388) 20 : cephadm [INF] Updating smithi191:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:04.508137+0000 mgr.a (mgr.14388) 21 : cephadm [INF] Updating smithi027:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: cephadm 2024-08-31T02:12:04.508518+0000 mgr.a (mgr.14388) 22 : cephadm [INF] Updating smithi163:/var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.692378+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.697597+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.701947+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.706401+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.710765+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.715134+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.719497+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:05.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.772847+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:05.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.775357+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:05.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.776557+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:05.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:05 smithi191 bash[24992]: audit 2024-08-31T02:12:04.783810+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:06.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:06 smithi163 bash[24253]: cluster 2024-08-31T02:12:04.740105+0000 mgr.a (mgr.14388) 23 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-08-31T02:12:06.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:06 smithi163 bash[24253]: cluster 2024-08-31T02:12:05.168940+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-08-31T02:12:06.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:06 smithi163 bash[24253]: audit 2024-08-31T02:12:05.171038+0000 mon.a (mon.0) 536 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:06.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:06 smithi027 bash[22610]: cluster 2024-08-31T02:12:04.740105+0000 mgr.a (mgr.14388) 23 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-08-31T02:12:06.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:06 smithi027 bash[22610]: cluster 2024-08-31T02:12:05.168940+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-08-31T02:12:06.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:06 smithi027 bash[22610]: audit 2024-08-31T02:12:05.171038+0000 mon.a (mon.0) 536 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:06.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:06 smithi191 bash[24992]: cluster 2024-08-31T02:12:04.740105+0000 mgr.a (mgr.14388) 23 : cluster [DBG] pgmap v13: 97 pgs: 32 unknown, 65 active+clean; 579 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-08-31T02:12:06.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:06 smithi191 bash[24992]: cluster 2024-08-31T02:12:05.168940+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e30: 3 total, 3 up, 3 in 2024-08-31T02:12:06.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:06 smithi191 bash[24992]: audit 2024-08-31T02:12:05.171038+0000 mon.a (mon.0) 536 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:07.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:07 smithi163 bash[24253]: audit 2024-08-31T02:12:06.165994+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:07.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:07 smithi163 bash[24253]: cluster 2024-08-31T02:12:06.171804+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-08-31T02:12:07.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:07 smithi163 bash[24253]: audit 2024-08-31T02:12:06.185866+0000 mon.a (mon.0) 539 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:07.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:07 smithi027 bash[22610]: audit 2024-08-31T02:12:06.165994+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:07.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:07 smithi027 bash[22610]: cluster 2024-08-31T02:12:06.171804+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-08-31T02:12:07.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:07 smithi027 bash[22610]: audit 2024-08-31T02:12:06.185866+0000 mon.a (mon.0) 539 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:07.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:07 smithi191 bash[24992]: audit 2024-08-31T02:12:06.165994+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "myzone1.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:07.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:07 smithi191 bash[24992]: cluster 2024-08-31T02:12:06.171804+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e31: 3 total, 3 up, 3 in 2024-08-31T02:12:07.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:07 smithi191 bash[24992]: audit 2024-08-31T02:12:06.185866+0000 mon.a (mon.0) 539 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:08.073 INFO:teuthology.orchestra.run.smithi027.stdout:Realm(s) created correctly. Please, use 'ceph rgw realm tokens' to get the token. 2024-08-31T02:12:08.424 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: cluster 2024-08-31T02:12:06.740738+0000 mgr.a (mgr.14388) 24 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-08-31T02:12:08.424 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: audit 2024-08-31T02:12:07.184578+0000 mon.a (mon.0) 540 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:08.424 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: cluster 2024-08-31T02:12:07.195928+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-08-31T02:12:08.424 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: audit 2024-08-31T02:12:08.075401+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:08.424 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: audit 2024-08-31T02:12:08.076808+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:08.425 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: audit 2024-08-31T02:12:08.079311+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:08.425 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: audit 2024-08-31T02:12:08.080371+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:08.425 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: audit 2024-08-31T02:12:08.087895+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:08.425 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: audit 2024-08-31T02:12:08.091154+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi163.cwqfjo", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-08-31T02:12:08.425 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: audit 2024-08-31T02:12:08.094815+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi163.cwqfjo", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-08-31T02:12:08.425 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: audit 2024-08-31T02:12:08.103072+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:08.425 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:08 smithi027 bash[22610]: audit 2024-08-31T02:12:08.104710+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:08.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: cluster 2024-08-31T02:12:06.740738+0000 mgr.a (mgr.14388) 24 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-08-31T02:12:08.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: audit 2024-08-31T02:12:07.184578+0000 mon.a (mon.0) 540 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:08.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: cluster 2024-08-31T02:12:07.195928+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-08-31T02:12:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: audit 2024-08-31T02:12:08.075401+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: audit 2024-08-31T02:12:08.076808+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: audit 2024-08-31T02:12:08.079311+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: audit 2024-08-31T02:12:08.080371+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: audit 2024-08-31T02:12:08.087895+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: audit 2024-08-31T02:12:08.091154+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi163.cwqfjo", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-08-31T02:12:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: audit 2024-08-31T02:12:08.094815+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi163.cwqfjo", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-08-31T02:12:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: audit 2024-08-31T02:12:08.103072+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:08 smithi163 bash[24253]: audit 2024-08-31T02:12:08.104710+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: cluster 2024-08-31T02:12:06.740738+0000 mgr.a (mgr.14388) 24 : cluster [DBG] pgmap v16: 129 pgs: 64 unknown, 65 active+clean; 579 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 3.5 KiB/s wr, 42 op/s 2024-08-31T02:12:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: audit 2024-08-31T02:12:07.184578+0000 mon.a (mon.0) 540 : audit [INF] from='client.? 172.21.15.27:0/3511835458' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "myzone1.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: cluster 2024-08-31T02:12:07.195928+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e32: 3 total, 3 up, 3 in 2024-08-31T02:12:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: audit 2024-08-31T02:12:08.075401+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: audit 2024-08-31T02:12:08.076808+0000 mon.a (mon.0) 543 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: audit 2024-08-31T02:12:08.079311+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: audit 2024-08-31T02:12:08.080371+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: audit 2024-08-31T02:12:08.087895+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:08.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: audit 2024-08-31T02:12:08.091154+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi163.cwqfjo", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-08-31T02:12:08.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: audit 2024-08-31T02:12:08.094815+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi163.cwqfjo", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-08-31T02:12:08.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: audit 2024-08-31T02:12:08.103072+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:08.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:08 smithi191 bash[24992]: audit 2024-08-31T02:12:08.104710+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:09.086 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T02:12:09.096 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi027.front.sepia.ceph.com 2024-08-31T02:12:09.096 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:34b9d27bc925f169ace27b9f1f204536aa49fc0b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3427ee8e-673d-11ef-bcd4-c7b262605968 -- bash -c 'set -e 2024-08-31T02:12:09.096 DEBUG:teuthology.orchestra.run.smithi027:> set -x 2024-08-31T02:12:09.096 DEBUG:teuthology.orchestra.run.smithi027:> while true; do TOKEN=$(ceph rgw realm tokens | jq -r '"'"'.[0].token'"'"'); echo $TOKEN; if [ "$TOKEN" != "master zone has no endpoint" ]; then break; fi; sleep 5; done 2024-08-31T02:12:09.097 DEBUG:teuthology.orchestra.run.smithi027:> TOKENS=$(ceph rgw realm tokens) 2024-08-31T02:12:09.097 DEBUG:teuthology.orchestra.run.smithi027:> echo $TOKENS | jq --exit-status '"'"'.[0].realm == "myrealm1"'"'"' 2024-08-31T02:12:09.097 DEBUG:teuthology.orchestra.run.smithi027:> echo $TOKENS | jq --exit-status '"'"'.[0].token'"'"' 2024-08-31T02:12:09.097 DEBUG:teuthology.orchestra.run.smithi027:> TOKEN_JSON=$(ceph rgw realm tokens | jq -r '"'"'.[0].token'"'"' | base64 --decode) 2024-08-31T02:12:09.097 DEBUG:teuthology.orchestra.run.smithi027:> echo $TOKEN_JSON | jq --exit-status '"'"'.realm_name == "myrealm1"'"'"' 2024-08-31T02:12:09.097 DEBUG:teuthology.orchestra.run.smithi027:> echo $TOKEN_JSON | jq --exit-status '"'"'.endpoint | test("http://.+:\\d+")'"'"' 2024-08-31T02:12:09.097 DEBUG:teuthology.orchestra.run.smithi027:> echo $TOKEN_JSON | jq --exit-status '"'"'.realm_id | test("^[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}$")'"'"' 2024-08-31T02:12:09.097 DEBUG:teuthology.orchestra.run.smithi027:> echo $TOKEN_JSON | jq --exit-status '"'"'.access_key'"'"' 2024-08-31T02:12:09.097 DEBUG:teuthology.orchestra.run.smithi027:> echo $TOKEN_JSON | jq --exit-status '"'"'.secret'"'"' 2024-08-31T02:12:09.097 DEBUG:teuthology.orchestra.run.smithi027:> ' 2024-08-31T02:12:09.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:09 smithi163 bash[24253]: cephadm 2024-08-31T02:12:08.068525+0000 mgr.a (mgr.14388) 25 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-08-31T02:12:09.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:09 smithi163 bash[24253]: cephadm 2024-08-31T02:12:08.105837+0000 mgr.a (mgr.14388) 26 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi163.cwqfjo on smithi163 2024-08-31T02:12:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:09 smithi027 bash[22610]: cephadm 2024-08-31T02:12:08.068525+0000 mgr.a (mgr.14388) 25 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-08-31T02:12:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:09 smithi027 bash[22610]: cephadm 2024-08-31T02:12:08.105837+0000 mgr.a (mgr.14388) 26 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi163.cwqfjo on smithi163 2024-08-31T02:12:09.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:09 smithi191 bash[24992]: cephadm 2024-08-31T02:12:08.068525+0000 mgr.a (mgr.14388) 25 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-08-31T02:12:09.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:09 smithi191 bash[24992]: cephadm 2024-08-31T02:12:08.105837+0000 mgr.a (mgr.14388) 26 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi163.cwqfjo on smithi163 2024-08-31T02:12:10.413 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:10 smithi163 bash[24253]: cluster 2024-08-31T02:12:08.742364+0000 mgr.a (mgr.14388) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-08-31T02:12:10.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:10 smithi027 bash[22610]: cluster 2024-08-31T02:12:08.742364+0000 mgr.a (mgr.14388) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-08-31T02:12:10.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:10 smithi191 bash[24992]: cluster 2024-08-31T02:12:08.742364+0000 mgr.a (mgr.14388) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 9.1 KiB/s rd, 3.7 KiB/s wr, 14 op/s 2024-08-31T02:12:11.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:11 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:12:11.197 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:12:11 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:12:11.197 INFO:journalctl@ceph.osd.1.smithi163.stdout:Aug 31 02:12:11 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:12:11.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:11 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:12:11.696 INFO:journalctl@ceph.mgr.b.smithi163.stdout:Aug 31 02:12:11 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:12:11.696 INFO:journalctl@ceph.osd.1.smithi163.stdout:Aug 31 02:12:11 smithi163 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:12:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:12 smithi163 bash[24253]: cluster 2024-08-31T02:12:10.743095+0000 mgr.a (mgr.14388) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-08-31T02:12:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:12 smithi163 bash[24253]: audit 2024-08-31T02:12:11.417194+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:12 smithi163 bash[24253]: audit 2024-08-31T02:12:11.426985+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:12 smithi163 bash[24253]: audit 2024-08-31T02:12:11.436627+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:12 smithi163 bash[24253]: audit 2024-08-31T02:12:11.438291+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi191.otecdx", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-08-31T02:12:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:12 smithi163 bash[24253]: audit 2024-08-31T02:12:11.442735+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi191.otecdx", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-08-31T02:12:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:12 smithi163 bash[24253]: audit 2024-08-31T02:12:11.454296+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:12 smithi163 bash[24253]: audit 2024-08-31T02:12:11.458005+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:12 smithi163 bash[24253]: cephadm 2024-08-31T02:12:11.460019+0000 mgr.a (mgr.14388) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi191.otecdx on smithi191 2024-08-31T02:12:12.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:12 smithi027 bash[22610]: cluster 2024-08-31T02:12:10.743095+0000 mgr.a (mgr.14388) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-08-31T02:12:12.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:12 smithi027 bash[22610]: audit 2024-08-31T02:12:11.417194+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:12 smithi027 bash[22610]: audit 2024-08-31T02:12:11.426985+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:12 smithi027 bash[22610]: audit 2024-08-31T02:12:11.436627+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:12 smithi027 bash[22610]: audit 2024-08-31T02:12:11.438291+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi191.otecdx", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-08-31T02:12:12.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:12 smithi027 bash[22610]: audit 2024-08-31T02:12:11.442735+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi191.otecdx", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-08-31T02:12:12.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:12 smithi027 bash[22610]: audit 2024-08-31T02:12:11.454296+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:12 smithi027 bash[22610]: audit 2024-08-31T02:12:11.458005+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:12.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:12 smithi027 bash[22610]: cephadm 2024-08-31T02:12:11.460019+0000 mgr.a (mgr.14388) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi191.otecdx on smithi191 2024-08-31T02:12:12.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:12 smithi191 bash[24992]: cluster 2024-08-31T02:12:10.743095+0000 mgr.a (mgr.14388) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-08-31T02:12:12.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:12 smithi191 bash[24992]: audit 2024-08-31T02:12:11.417194+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:12 smithi191 bash[24992]: audit 2024-08-31T02:12:11.426985+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:12 smithi191 bash[24992]: audit 2024-08-31T02:12:11.436627+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:12 smithi191 bash[24992]: audit 2024-08-31T02:12:11.438291+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi191.otecdx", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-08-31T02:12:12.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:12 smithi191 bash[24992]: audit 2024-08-31T02:12:11.442735+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.myrealm1.myzone1.smithi191.otecdx", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-08-31T02:12:12.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:12 smithi191 bash[24992]: audit 2024-08-31T02:12:11.454296+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:12.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:12 smithi191 bash[24992]: audit 2024-08-31T02:12:11.458005+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:12.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:12 smithi191 bash[24992]: cephadm 2024-08-31T02:12:11.460019+0000 mgr.a (mgr.14388) 29 : cephadm [INF] Deploying daemon rgw.myrealm1.myzone1.smithi191.otecdx on smithi191 2024-08-31T02:12:13.837 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/3427ee8e-673d-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T02:12:14.145 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:14 smithi191 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:12:14.145 INFO:journalctl@ceph.osd.2.smithi191.stdout:Aug 31 02:12:14 smithi191 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:12:14.443 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:14 smithi191 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:12:14.443 INFO:journalctl@ceph.osd.2.smithi191.stdout:Aug 31 02:12:14 smithi191 systemd[1]: /etc/systemd/system/ceph-3427ee8e-673d-11ef-bcd4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-08-31T02:12:14.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:14 smithi027 bash[22610]: cluster 2024-08-31T02:12:12.743994+0000 mgr.a (mgr.14388) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 582 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-08-31T02:12:14.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:14 smithi027 bash[22610]: cluster 2024-08-31T02:12:13.434341+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-08-31T02:12:14.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:14 smithi027 bash[22610]: audit 2024-08-31T02:12:13.437477+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-08-31T02:12:14.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:14 smithi027 bash[22610]: audit 2024-08-31T02:12:13.438615+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-08-31T02:12:14.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:14 smithi191 bash[24992]: cluster 2024-08-31T02:12:12.743994+0000 mgr.a (mgr.14388) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 582 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-08-31T02:12:14.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:14 smithi191 bash[24992]: cluster 2024-08-31T02:12:13.434341+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-08-31T02:12:14.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:14 smithi191 bash[24992]: audit 2024-08-31T02:12:13.437477+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-08-31T02:12:14.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:14 smithi191 bash[24992]: audit 2024-08-31T02:12:13.438615+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-08-31T02:12:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:14 smithi163 bash[24253]: cluster 2024-08-31T02:12:12.743994+0000 mgr.a (mgr.14388) 30 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 582 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-08-31T02:12:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:14 smithi163 bash[24253]: cluster 2024-08-31T02:12:13.434341+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e33: 3 total, 3 up, 3 in 2024-08-31T02:12:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:14 smithi163 bash[24253]: audit 2024-08-31T02:12:13.437477+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-08-31T02:12:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:14 smithi163 bash[24253]: audit 2024-08-31T02:12:13.438615+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-08-31T02:12:15.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:12:15.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:12:15.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:12:15.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:15 smithi163 bash[24253]: audit 2024-08-31T02:12:14.430355+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:15.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:15 smithi163 bash[24253]: audit 2024-08-31T02:12:14.433473+0000 mon.a (mon.0) 561 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-08-31T02:12:15.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:15 smithi163 bash[24253]: cluster 2024-08-31T02:12:14.437166+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-08-31T02:12:15.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:15 smithi163 bash[24253]: audit 2024-08-31T02:12:14.450373+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:15.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:15 smithi163 bash[24253]: audit 2024-08-31T02:12:14.462983+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:15.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:15 smithi163 bash[24253]: audit 2024-08-31T02:12:14.465127+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:15.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:15 smithi163 bash[24253]: audit 2024-08-31T02:12:14.468717+0000 mgr.a (mgr.14388) 31 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:15.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:15 smithi027 bash[22610]: audit 2024-08-31T02:12:14.430355+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:15.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:15 smithi027 bash[22610]: audit 2024-08-31T02:12:14.433473+0000 mon.a (mon.0) 561 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-08-31T02:12:15.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:15 smithi027 bash[22610]: cluster 2024-08-31T02:12:14.437166+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-08-31T02:12:15.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:15 smithi027 bash[22610]: audit 2024-08-31T02:12:14.450373+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:15.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:15 smithi027 bash[22610]: audit 2024-08-31T02:12:14.462983+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:15.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:15 smithi027 bash[22610]: audit 2024-08-31T02:12:14.465127+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:15.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:15 smithi027 bash[22610]: audit 2024-08-31T02:12:14.468717+0000 mgr.a (mgr.14388) 31 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:15.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:15 smithi191 bash[24992]: audit 2024-08-31T02:12:14.430355+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:15.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:15 smithi191 bash[24992]: audit 2024-08-31T02:12:14.433473+0000 mon.a (mon.0) 561 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-08-31T02:12:15.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:15 smithi191 bash[24992]: cluster 2024-08-31T02:12:14.437166+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e34: 3 total, 3 up, 3 in 2024-08-31T02:12:15.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:15 smithi191 bash[24992]: audit 2024-08-31T02:12:14.450373+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:15.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:15 smithi191 bash[24992]: audit 2024-08-31T02:12:14.462983+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:15.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:15 smithi191 bash[24992]: audit 2024-08-31T02:12:14.465127+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:15.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:15 smithi191 bash[24992]: audit 2024-08-31T02:12:14.468717+0000 mgr.a (mgr.14388) 31 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:16 smithi027 bash[22610]: cluster 2024-08-31T02:12:14.744892+0000 mgr.a (mgr.14388) 32 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-08-31T02:12:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:16 smithi027 bash[22610]: audit 2024-08-31T02:12:15.369711+0000 mgr.a (mgr.14388) 33 : audit [DBG] from='client.14724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:16 smithi027 bash[22610]: cluster 2024-08-31T02:12:15.457450+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-08-31T02:12:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:16 smithi027 bash[22610]: audit 2024-08-31T02:12:15.468391+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-08-31T02:12:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:16 smithi027 bash[22610]: audit 2024-08-31T02:12:15.468738+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-08-31T02:12:16.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:16 smithi191 bash[24992]: cluster 2024-08-31T02:12:14.744892+0000 mgr.a (mgr.14388) 32 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-08-31T02:12:16.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:16 smithi191 bash[24992]: audit 2024-08-31T02:12:15.369711+0000 mgr.a (mgr.14388) 33 : audit [DBG] from='client.14724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:16.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:16 smithi191 bash[24992]: cluster 2024-08-31T02:12:15.457450+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-08-31T02:12:16.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:16 smithi191 bash[24992]: audit 2024-08-31T02:12:15.468391+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-08-31T02:12:16.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:16 smithi191 bash[24992]: audit 2024-08-31T02:12:15.468738+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-08-31T02:12:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:16 smithi163 bash[24253]: cluster 2024-08-31T02:12:14.744892+0000 mgr.a (mgr.14388) 32 : cluster [DBG] pgmap v23: 161 pgs: 32 unknown, 129 active+clean; 584 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-08-31T02:12:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:16 smithi163 bash[24253]: audit 2024-08-31T02:12:15.369711+0000 mgr.a (mgr.14388) 33 : audit [DBG] from='client.14724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:16 smithi163 bash[24253]: cluster 2024-08-31T02:12:15.457450+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e35: 3 total, 3 up, 3 in 2024-08-31T02:12:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:16 smithi163 bash[24253]: audit 2024-08-31T02:12:15.468391+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-08-31T02:12:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:16 smithi163 bash[24253]: audit 2024-08-31T02:12:15.468738+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-08-31T02:12:17.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:17 smithi191 bash[24992]: audit 2024-08-31T02:12:16.464482+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-08-31T02:12:17.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:17 smithi191 bash[24992]: cluster 2024-08-31T02:12:16.470903+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-08-31T02:12:17.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:17 smithi163 bash[24253]: audit 2024-08-31T02:12:16.464482+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-08-31T02:12:17.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:17 smithi163 bash[24253]: cluster 2024-08-31T02:12:16.470903+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-08-31T02:12:17.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:17 smithi027 bash[22610]: audit 2024-08-31T02:12:16.464482+0000 mon.a (mon.0) 568 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-08-31T02:12:17.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:17 smithi027 bash[22610]: cluster 2024-08-31T02:12:16.470903+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e36: 3 total, 3 up, 3 in 2024-08-31T02:12:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:18 smithi163 bash[24253]: cluster 2024-08-31T02:12:16.745736+0000 mgr.a (mgr.14388) 34 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 584 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 3.5 KiB/s wr, 16 op/s 2024-08-31T02:12:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:18 smithi163 bash[24253]: cluster 2024-08-31T02:12:17.547034+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-08-31T02:12:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:18 smithi163 bash[24253]: audit 2024-08-31T02:12:17.550363+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:18 smithi163 bash[24253]: audit 2024-08-31T02:12:17.550566+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.191:0/2240672276' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:18.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:18 smithi163 bash[24253]: audit 2024-08-31T02:12:17.550998+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:18.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:18 smithi163 bash[24253]: audit 2024-08-31T02:12:17.551267+0000 mon.a (mon.0) 572 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:18.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:18 smithi163 bash[24253]: audit 2024-08-31T02:12:17.551926+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:18.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:18 smithi027 bash[22610]: cluster 2024-08-31T02:12:16.745736+0000 mgr.a (mgr.14388) 34 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 584 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 3.5 KiB/s wr, 16 op/s 2024-08-31T02:12:18.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:18 smithi027 bash[22610]: cluster 2024-08-31T02:12:17.547034+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-08-31T02:12:18.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:18 smithi027 bash[22610]: audit 2024-08-31T02:12:17.550363+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:18.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:18 smithi027 bash[22610]: audit 2024-08-31T02:12:17.550566+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.191:0/2240672276' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:18 smithi027 bash[22610]: audit 2024-08-31T02:12:17.550998+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:18 smithi027 bash[22610]: audit 2024-08-31T02:12:17.551267+0000 mon.a (mon.0) 572 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:18 smithi027 bash[22610]: audit 2024-08-31T02:12:17.551926+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:19.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:18 smithi191 bash[24992]: cluster 2024-08-31T02:12:16.745736+0000 mgr.a (mgr.14388) 34 : cluster [DBG] pgmap v26: 193 pgs: 64 unknown, 129 active+clean; 584 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 3.5 KiB/s wr, 16 op/s 2024-08-31T02:12:19.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:18 smithi191 bash[24992]: cluster 2024-08-31T02:12:17.547034+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e37: 3 total, 3 up, 3 in 2024-08-31T02:12:19.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:18 smithi191 bash[24992]: audit 2024-08-31T02:12:17.550363+0000 mon.a (mon.0) 571 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:19.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:18 smithi191 bash[24992]: audit 2024-08-31T02:12:17.550566+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.191:0/2240672276' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:19.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:18 smithi191 bash[24992]: audit 2024-08-31T02:12:17.550998+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:19.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:18 smithi191 bash[24992]: audit 2024-08-31T02:12:17.551267+0000 mon.a (mon.0) 572 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:19.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:18 smithi191 bash[24992]: audit 2024-08-31T02:12:17.551926+0000 mon.a (mon.0) 573 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-08-31T02:12:19.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:19 smithi163 bash[24253]: audit 2024-08-31T02:12:18.554590+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:19.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:19 smithi163 bash[24253]: audit 2024-08-31T02:12:18.554783+0000 mon.a (mon.0) 575 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:19.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:19 smithi163 bash[24253]: audit 2024-08-31T02:12:18.554969+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:19.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:19 smithi163 bash[24253]: cluster 2024-08-31T02:12:18.561948+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-08-31T02:12:19.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:19 smithi163 bash[24253]: audit 2024-08-31T02:12:18.564448+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:19.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:19 smithi163 bash[24253]: audit 2024-08-31T02:12:18.565085+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:19.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:19 smithi163 bash[24253]: audit 2024-08-31T02:12:18.565291+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.191:0/2240672276' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:19.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:19 smithi163 bash[24253]: audit 2024-08-31T02:12:18.566038+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:19.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:19 smithi163 bash[24253]: audit 2024-08-31T02:12:18.567228+0000 mon.a (mon.0) 580 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:19.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22863]: debug 2024-08-31T02:12:19.661+0000 7f9ca2115640 -1 mgr.server reply reply (152) Unknown error 152 2024-08-31T02:12:19.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22863]: debug 2024-08-31T02:12:19.677+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: 2024-08-31T02:12:19.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22610]: audit 2024-08-31T02:12:18.554590+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22610]: audit 2024-08-31T02:12:18.554783+0000 mon.a (mon.0) 575 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22610]: audit 2024-08-31T02:12:18.554969+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22610]: cluster 2024-08-31T02:12:18.561948+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-08-31T02:12:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22610]: audit 2024-08-31T02:12:18.564448+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22610]: audit 2024-08-31T02:12:18.565085+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22610]: audit 2024-08-31T02:12:18.565291+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.191:0/2240672276' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22610]: audit 2024-08-31T02:12:18.566038+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:19 smithi027 bash[22610]: audit 2024-08-31T02:12:18.567228+0000 mon.a (mon.0) 580 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:20.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:19 smithi191 bash[24992]: audit 2024-08-31T02:12:18.554590+0000 mon.a (mon.0) 574 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:20.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:19 smithi191 bash[24992]: audit 2024-08-31T02:12:18.554783+0000 mon.a (mon.0) 575 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:20.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:19 smithi191 bash[24992]: audit 2024-08-31T02:12:18.554969+0000 mon.a (mon.0) 576 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-08-31T02:12:20.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:19 smithi191 bash[24992]: cluster 2024-08-31T02:12:18.561948+0000 mon.a (mon.0) 577 : cluster [DBG] osdmap e38: 3 total, 3 up, 3 in 2024-08-31T02:12:20.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:19 smithi191 bash[24992]: audit 2024-08-31T02:12:18.564448+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.163:0/497288664' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:20.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:19 smithi191 bash[24992]: audit 2024-08-31T02:12:18.565085+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:20.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:19 smithi191 bash[24992]: audit 2024-08-31T02:12:18.565291+0000 mon.c (mon.1) 11 : audit [INF] from='client.? 172.21.15.191:0/2240672276' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:20.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:19 smithi191 bash[24992]: audit 2024-08-31T02:12:18.566038+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:20.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:19 smithi191 bash[24992]: audit 2024-08-31T02:12:18.567228+0000 mon.a (mon.0) 580 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-08-31T02:12:20.207 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:12:20.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:12:20.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:12:20.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:12:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:12:20.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: cluster 2024-08-31T02:12:18.746583+0000 mgr.a (mgr.14388) 35 : cluster [DBG] pgmap v29: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-08-31T02:12:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: audit 2024-08-31T02:12:19.563172+0000 mon.a (mon.0) 581 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: audit 2024-08-31T02:12:19.563385+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: audit 2024-08-31T02:12:19.563517+0000 mon.a (mon.0) 583 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: cluster 2024-08-31T02:12:19.571942+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-08-31T02:12:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: cephadm 2024-08-31T02:12:19.681493+0000 mgr.a (mgr.14388) 36 : cephadm [ERR] Error when trying to update rgw zone: 2024-08-31T02:12:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: cluster 2024-08-31T02:12:19.682695+0000 mgr.a (mgr.14388) 37 : cluster [DBG] pgmap v31: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 1.6 KiB/s wr, 25 op/s 2024-08-31T02:12:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: audit 2024-08-31T02:12:19.689287+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: audit 2024-08-31T02:12:19.697190+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: audit 2024-08-31T02:12:19.704825+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:20.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: cephadm 2024-08-31T02:12:19.706855+0000 mgr.a (mgr.14388) 38 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-08-31T02:12:20.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: audit 2024-08-31T02:12:19.713165+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:20.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: audit 2024-08-31T02:12:19.718179+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:20.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:20 smithi163 bash[24253]: audit 2024-08-31T02:12:19.780415+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:20.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: cluster 2024-08-31T02:12:18.746583+0000 mgr.a (mgr.14388) 35 : cluster [DBG] pgmap v29: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-08-31T02:12:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: audit 2024-08-31T02:12:19.563172+0000 mon.a (mon.0) 581 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: audit 2024-08-31T02:12:19.563385+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: audit 2024-08-31T02:12:19.563517+0000 mon.a (mon.0) 583 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: cluster 2024-08-31T02:12:19.571942+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-08-31T02:12:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: cephadm 2024-08-31T02:12:19.681493+0000 mgr.a (mgr.14388) 36 : cephadm [ERR] Error when trying to update rgw zone: 2024-08-31T02:12:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: cluster 2024-08-31T02:12:19.682695+0000 mgr.a (mgr.14388) 37 : cluster [DBG] pgmap v31: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 1.6 KiB/s wr, 25 op/s 2024-08-31T02:12:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: audit 2024-08-31T02:12:19.689287+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: audit 2024-08-31T02:12:19.697190+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: audit 2024-08-31T02:12:19.704825+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: cephadm 2024-08-31T02:12:19.706855+0000 mgr.a (mgr.14388) 38 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-08-31T02:12:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: audit 2024-08-31T02:12:19.713165+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: audit 2024-08-31T02:12:19.718179+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:20 smithi027 bash[22610]: audit 2024-08-31T02:12:19.780415+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:21.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: cluster 2024-08-31T02:12:18.746583+0000 mgr.a (mgr.14388) 35 : cluster [DBG] pgmap v29: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 1.2 KiB/s wr, 20 op/s 2024-08-31T02:12:21.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: audit 2024-08-31T02:12:19.563172+0000 mon.a (mon.0) 581 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi163.cwqfjo' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:21.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: audit 2024-08-31T02:12:19.563385+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.rgw.myrealm1.myzone1.smithi191.otecdx' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:21.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: audit 2024-08-31T02:12:19.563517+0000 mon.a (mon.0) 583 : audit [INF] from='client.? 172.21.15.27:0/597330205' entity='mgr.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-08-31T02:12:21.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: cluster 2024-08-31T02:12:19.571942+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e39: 3 total, 3 up, 3 in 2024-08-31T02:12:21.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: cephadm 2024-08-31T02:12:19.681493+0000 mgr.a (mgr.14388) 36 : cephadm [ERR] Error when trying to update rgw zone: 2024-08-31T02:12:21.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: cluster 2024-08-31T02:12:19.682695+0000 mgr.a (mgr.14388) 37 : cluster [DBG] pgmap v31: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 1.6 KiB/s wr, 25 op/s 2024-08-31T02:12:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: audit 2024-08-31T02:12:19.689287+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: audit 2024-08-31T02:12:19.697190+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: audit 2024-08-31T02:12:19.704825+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: cephadm 2024-08-31T02:12:19.706855+0000 mgr.a (mgr.14388) 38 : cephadm [INF] Saving service rgw.myrealm1.myzone1 spec with placement count:2 2024-08-31T02:12:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: audit 2024-08-31T02:12:19.713165+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: audit 2024-08-31T02:12:19.718179+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:20 smithi191 bash[24992]: audit 2024-08-31T02:12:19.780415+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:21.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:21 smithi163 bash[24253]: cluster 2024-08-31T02:12:20.563200+0000 mon.a (mon.0) 591 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-08-31T02:12:21.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:21 smithi027 bash[22610]: cluster 2024-08-31T02:12:20.563200+0000 mon.a (mon.0) 591 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-08-31T02:12:22.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:21 smithi191 bash[24992]: cluster 2024-08-31T02:12:20.563200+0000 mon.a (mon.0) 591 : cluster [WRN] Health check failed: Cannot update rgw endpoints, error: {err} (CEPHADM_RGW) 2024-08-31T02:12:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:22 smithi163 bash[24253]: cluster 2024-08-31T02:12:21.683626+0000 mgr.a (mgr.14388) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 1.0 KiB/s wr, 16 op/s 2024-08-31T02:12:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:22 smithi163 bash[24253]: audit 2024-08-31T02:12:21.819064+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:22.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:22 smithi027 bash[22610]: cluster 2024-08-31T02:12:21.683626+0000 mgr.a (mgr.14388) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 1.0 KiB/s wr, 16 op/s 2024-08-31T02:12:22.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:22 smithi027 bash[22610]: audit 2024-08-31T02:12:21.819064+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:23.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:22 smithi191 bash[24992]: cluster 2024-08-31T02:12:21.683626+0000 mgr.a (mgr.14388) 39 : cluster [DBG] pgmap v32: 225 pgs: 32 creating+peering, 193 active+clean; 585 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 1.0 KiB/s wr, 16 op/s 2024-08-31T02:12:23.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:22 smithi191 bash[24992]: audit 2024-08-31T02:12:21.819064+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:24.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:23 smithi191 bash[24992]: cluster 2024-08-31T02:12:23.685783+0000 mgr.a (mgr.14388) 40 : cluster [DBG] pgmap v33: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 272 KiB/s rd, 6.5 KiB/s wr, 500 op/s 2024-08-31T02:12:24.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:23 smithi163 bash[24253]: cluster 2024-08-31T02:12:23.685783+0000 mgr.a (mgr.14388) 40 : cluster [DBG] pgmap v33: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 272 KiB/s rd, 6.5 KiB/s wr, 500 op/s 2024-08-31T02:12:24.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:23 smithi027 bash[22610]: cluster 2024-08-31T02:12:23.685783+0000 mgr.a (mgr.14388) 40 : cluster [DBG] pgmap v33: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 272 KiB/s rd, 6.5 KiB/s wr, 500 op/s 2024-08-31T02:12:25.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:12:25.209 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:12:25.209 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:12:25.967 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:12:25.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:12:25.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:12:25.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:12:25.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:12:26.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.121421+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.131335+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.168217+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.177915+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.180167+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.182108+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: cephadm 2024-08-31T02:12:25.193898+0000 mgr.a (mgr.14388) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.563656+0000 mgr.a (mgr.14388) 42 : audit [DBG] from='client.14898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.665459+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.673082+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.679681+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: cluster 2024-08-31T02:12:25.686354+0000 mgr.a (mgr.14388) 43 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 224 KiB/s rd, 4.9 KiB/s wr, 420 op/s 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.688084+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:26 smithi163 bash[24253]: audit 2024-08-31T02:12:25.689150+0000 mgr.a (mgr.14388) 44 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.121421+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.131335+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.168217+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.177915+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.180167+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.182108+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: cephadm 2024-08-31T02:12:25.193898+0000 mgr.a (mgr.14388) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-08-31T02:12:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.563656+0000 mgr.a (mgr.14388) 42 : audit [DBG] from='client.14898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.665459+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.673082+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.679681+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: cluster 2024-08-31T02:12:25.686354+0000 mgr.a (mgr.14388) 43 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 224 KiB/s rd, 4.9 KiB/s wr, 420 op/s 2024-08-31T02:12:26.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.688084+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:26.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22610]: audit 2024-08-31T02:12:25.689150+0000 mgr.a (mgr.14388) 44 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.121421+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.131335+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.168217+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.177915+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.180167+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.182108+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: cephadm 2024-08-31T02:12:25.193898+0000 mgr.a (mgr.14388) 41 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-08-31T02:12:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.563656+0000 mgr.a (mgr.14388) 42 : audit [DBG] from='client.14898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.665459+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.673082+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.679681+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:26.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: cluster 2024-08-31T02:12:25.686354+0000 mgr.a (mgr.14388) 43 : cluster [DBG] pgmap v34: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 224 KiB/s rd, 4.9 KiB/s wr, 420 op/s 2024-08-31T02:12:26.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.688084+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:26.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:26 smithi191 bash[24992]: audit 2024-08-31T02:12:25.689150+0000 mgr.a (mgr.14388) 44 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:26.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22863]: debug 2024-08-31T02:12:26.633+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:12:26.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:12:26 smithi027 bash[22863]: debug 2024-08-31T02:12:26.637+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:12:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:27 smithi163 bash[24253]: audit 2024-08-31T02:12:26.638043+0000 mgr.a (mgr.14388) 45 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:12:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:27 smithi163 bash[24253]: cephadm 2024-08-31T02:12:26.639511+0000 mgr.a (mgr.14388) 46 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:12:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:27 smithi163 bash[24253]: cluster 2024-08-31T02:12:26.640022+0000 mgr.a (mgr.14388) 47 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 203 KiB/s rd, 4.4 KiB/s wr, 379 op/s 2024-08-31T02:12:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:27 smithi163 bash[24253]: audit 2024-08-31T02:12:26.703264+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:27 smithi163 bash[24253]: audit 2024-08-31T02:12:26.705433+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:27.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:27 smithi163 bash[24253]: audit 2024-08-31T02:12:26.706209+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:27.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:27 smithi163 bash[24253]: cephadm 2024-08-31T02:12:26.710558+0000 mgr.a (mgr.14388) 48 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-08-31T02:12:27.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:27 smithi163 bash[24253]: audit 2024-08-31T02:12:26.968437+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:27.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:27 smithi163 bash[24253]: audit 2024-08-31T02:12:26.970614+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:27.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22863]: debug 2024-08-31T02:12:27.625+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:12:27.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22863]: debug 2024-08-31T02:12:27.625+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:12:27.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22610]: audit 2024-08-31T02:12:26.638043+0000 mgr.a (mgr.14388) 45 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:12:27.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22610]: cephadm 2024-08-31T02:12:26.639511+0000 mgr.a (mgr.14388) 46 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:12:27.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22610]: cluster 2024-08-31T02:12:26.640022+0000 mgr.a (mgr.14388) 47 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 203 KiB/s rd, 4.4 KiB/s wr, 379 op/s 2024-08-31T02:12:27.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22610]: audit 2024-08-31T02:12:26.703264+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22610]: audit 2024-08-31T02:12:26.705433+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22610]: audit 2024-08-31T02:12:26.706209+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22610]: cephadm 2024-08-31T02:12:26.710558+0000 mgr.a (mgr.14388) 48 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-08-31T02:12:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22610]: audit 2024-08-31T02:12:26.968437+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:27 smithi027 bash[22610]: audit 2024-08-31T02:12:26.970614+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:27 smithi191 bash[24992]: audit 2024-08-31T02:12:26.638043+0000 mgr.a (mgr.14388) 45 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:12:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:27 smithi191 bash[24992]: cephadm 2024-08-31T02:12:26.639511+0000 mgr.a (mgr.14388) 46 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:12:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:27 smithi191 bash[24992]: cluster 2024-08-31T02:12:26.640022+0000 mgr.a (mgr.14388) 47 : cluster [DBG] pgmap v35: 225 pgs: 225 active+clean; 588 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 203 KiB/s rd, 4.4 KiB/s wr, 379 op/s 2024-08-31T02:12:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:27 smithi191 bash[24992]: audit 2024-08-31T02:12:26.703264+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:12:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:27 smithi191 bash[24992]: audit 2024-08-31T02:12:26.705433+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:12:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:27 smithi191 bash[24992]: audit 2024-08-31T02:12:26.706209+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:12:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:27 smithi191 bash[24992]: cephadm 2024-08-31T02:12:26.710558+0000 mgr.a (mgr.14388) 48 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-08-31T02:12:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:27 smithi191 bash[24992]: audit 2024-08-31T02:12:26.968437+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:28.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:27 smithi191 bash[24992]: audit 2024-08-31T02:12:26.970614+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:28 smithi163 bash[24253]: audit 2024-08-31T02:12:26.971529+0000 mgr.a (mgr.14388) 49 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:28 smithi163 bash[24253]: audit 2024-08-31T02:12:27.627620+0000 mgr.a (mgr.14388) 50 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:12:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:28 smithi163 bash[24253]: cephadm 2024-08-31T02:12:27.628852+0000 mgr.a (mgr.14388) 51 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:12:28.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:28 smithi027 bash[22610]: audit 2024-08-31T02:12:26.971529+0000 mgr.a (mgr.14388) 49 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:28.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:28 smithi027 bash[22610]: audit 2024-08-31T02:12:27.627620+0000 mgr.a (mgr.14388) 50 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:12:28.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:28 smithi027 bash[22610]: cephadm 2024-08-31T02:12:27.628852+0000 mgr.a (mgr.14388) 51 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:12:29.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:28 smithi191 bash[24992]: audit 2024-08-31T02:12:26.971529+0000 mgr.a (mgr.14388) 49 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:12:29.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:28 smithi191 bash[24992]: audit 2024-08-31T02:12:27.627620+0000 mgr.a (mgr.14388) 50 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:12:29.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:28 smithi191 bash[24992]: cephadm 2024-08-31T02:12:27.628852+0000 mgr.a (mgr.14388) 51 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:12:29.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:29 smithi163 bash[24253]: cluster 2024-08-31T02:12:28.642214+0000 mgr.a (mgr.14388) 52 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 199 KiB/s rd, 5.2 KiB/s wr, 352 op/s 2024-08-31T02:12:29.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:29 smithi027 bash[22610]: cluster 2024-08-31T02:12:28.642214+0000 mgr.a (mgr.14388) 52 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 199 KiB/s rd, 5.2 KiB/s wr, 352 op/s 2024-08-31T02:12:30.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:29 smithi191 bash[24992]: cluster 2024-08-31T02:12:28.642214+0000 mgr.a (mgr.14388) 52 : cluster [DBG] pgmap v36: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 199 KiB/s rd, 5.2 KiB/s wr, 352 op/s 2024-08-31T02:12:30.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:12:30.969 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:12:30.970 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:12:31.722 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:12:31.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:12:31.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:12:31.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:12:31.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:12:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:31 smithi163 bash[24253]: cluster 2024-08-31T02:12:30.643086+0000 mgr.a (mgr.14388) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 165 KiB/s rd, 4.3 KiB/s wr, 291 op/s 2024-08-31T02:12:31.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:31 smithi027 bash[22610]: cluster 2024-08-31T02:12:30.643086+0000 mgr.a (mgr.14388) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 165 KiB/s rd, 4.3 KiB/s wr, 291 op/s 2024-08-31T02:12:32.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:31 smithi191 bash[24992]: cluster 2024-08-31T02:12:30.643086+0000 mgr.a (mgr.14388) 53 : cluster [DBG] pgmap v37: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 165 KiB/s rd, 4.3 KiB/s wr, 291 op/s 2024-08-31T02:12:32.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:32 smithi027 bash[22610]: audit 2024-08-31T02:12:31.304923+0000 mgr.a (mgr.14388) 54 : audit [DBG] from='client.15255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:32.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:32 smithi027 bash[22610]: audit 2024-08-31T02:12:31.836181+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:33.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:32 smithi191 bash[24992]: audit 2024-08-31T02:12:31.304923+0000 mgr.a (mgr.14388) 54 : audit [DBG] from='client.15255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:33.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:32 smithi191 bash[24992]: audit 2024-08-31T02:12:31.836181+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:33.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:32 smithi163 bash[24253]: audit 2024-08-31T02:12:31.304923+0000 mgr.a (mgr.14388) 54 : audit [DBG] from='client.15255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:33.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:32 smithi163 bash[24253]: audit 2024-08-31T02:12:31.836181+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:12:33.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:33 smithi027 bash[22610]: cluster 2024-08-31T02:12:32.644047+0000 mgr.a (mgr.14388) 55 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 165 KiB/s rd, 4.3 KiB/s wr, 291 op/s 2024-08-31T02:12:34.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:33 smithi191 bash[24992]: cluster 2024-08-31T02:12:32.644047+0000 mgr.a (mgr.14388) 55 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 165 KiB/s rd, 4.3 KiB/s wr, 291 op/s 2024-08-31T02:12:34.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:33 smithi163 bash[24253]: cluster 2024-08-31T02:12:32.644047+0000 mgr.a (mgr.14388) 55 : cluster [DBG] pgmap v38: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 165 KiB/s rd, 4.3 KiB/s wr, 291 op/s 2024-08-31T02:12:35.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:35 smithi027 bash[22610]: cluster 2024-08-31T02:12:34.646194+0000 mgr.a (mgr.14388) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-08-31T02:12:36.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:35 smithi191 bash[24992]: cluster 2024-08-31T02:12:34.646194+0000 mgr.a (mgr.14388) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-08-31T02:12:36.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:35 smithi163 bash[24253]: cluster 2024-08-31T02:12:34.646194+0000 mgr.a (mgr.14388) 56 : cluster [DBG] pgmap v39: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-08-31T02:12:36.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:12:36.725 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:12:36.725 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:12:37.488 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:12:37.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:12:37.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:12:37.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:12:37.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:12:37.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:37 smithi027 bash[22610]: cluster 2024-08-31T02:12:36.647004+0000 mgr.a (mgr.14388) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-08-31T02:12:38.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:37 smithi191 bash[24992]: cluster 2024-08-31T02:12:36.647004+0000 mgr.a (mgr.14388) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-08-31T02:12:38.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:37 smithi163 bash[24253]: cluster 2024-08-31T02:12:36.647004+0000 mgr.a (mgr.14388) 57 : cluster [DBG] pgmap v40: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 1.1 KiB/s wr, 19 op/s 2024-08-31T02:12:38.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:38 smithi027 bash[22610]: audit 2024-08-31T02:12:37.063519+0000 mgr.a (mgr.14388) 58 : audit [DBG] from='client.15327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:39.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:38 smithi191 bash[24992]: audit 2024-08-31T02:12:37.063519+0000 mgr.a (mgr.14388) 58 : audit [DBG] from='client.15327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:39.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:38 smithi163 bash[24253]: audit 2024-08-31T02:12:37.063519+0000 mgr.a (mgr.14388) 58 : audit [DBG] from='client.15327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:39.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:39 smithi027 bash[22610]: cluster 2024-08-31T02:12:38.649306+0000 mgr.a (mgr.14388) 59 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 1023 B/s wr, 18 op/s 2024-08-31T02:12:40.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:39 smithi191 bash[24992]: cluster 2024-08-31T02:12:38.649306+0000 mgr.a (mgr.14388) 59 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 1023 B/s wr, 18 op/s 2024-08-31T02:12:40.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:39 smithi163 bash[24253]: cluster 2024-08-31T02:12:38.649306+0000 mgr.a (mgr.14388) 59 : cluster [DBG] pgmap v41: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 1023 B/s wr, 18 op/s 2024-08-31T02:12:40.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:40 smithi027 bash[22610]: cluster 2024-08-31T02:12:40.650109+0000 mgr.a (mgr.14388) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:41.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:40 smithi191 bash[24992]: cluster 2024-08-31T02:12:40.650109+0000 mgr.a (mgr.14388) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:41.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:40 smithi163 bash[24253]: cluster 2024-08-31T02:12:40.650109+0000 mgr.a (mgr.14388) 60 : cluster [DBG] pgmap v42: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:42.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:12:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:12:42.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:12:43.226 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:12:43.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:12:43.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:12:43.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:12:43.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:12:43.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:43 smithi027 bash[22610]: cluster 2024-08-31T02:12:42.650577+0000 mgr.a (mgr.14388) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:44.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:43 smithi191 bash[24992]: cluster 2024-08-31T02:12:42.650577+0000 mgr.a (mgr.14388) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:44.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:43 smithi163 bash[24253]: cluster 2024-08-31T02:12:42.650577+0000 mgr.a (mgr.14388) 61 : cluster [DBG] pgmap v43: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:44.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:44 smithi027 bash[22610]: audit 2024-08-31T02:12:42.825710+0000 mgr.a (mgr.14388) 62 : audit [DBG] from='client.15402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:45.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:44 smithi191 bash[24992]: audit 2024-08-31T02:12:42.825710+0000 mgr.a (mgr.14388) 62 : audit [DBG] from='client.15402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:45.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:44 smithi163 bash[24253]: audit 2024-08-31T02:12:42.825710+0000 mgr.a (mgr.14388) 62 : audit [DBG] from='client.15402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:45.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:45 smithi027 bash[22610]: cluster 2024-08-31T02:12:44.653113+0000 mgr.a (mgr.14388) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:46.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:45 smithi191 bash[24992]: cluster 2024-08-31T02:12:44.653113+0000 mgr.a (mgr.14388) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:46.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:45 smithi163 bash[24253]: cluster 2024-08-31T02:12:44.653113+0000 mgr.a (mgr.14388) 63 : cluster [DBG] pgmap v44: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:46.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:46 smithi027 bash[22610]: cluster 2024-08-31T02:12:46.653902+0000 mgr.a (mgr.14388) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:12:47.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:46 smithi191 bash[24992]: cluster 2024-08-31T02:12:46.653902+0000 mgr.a (mgr.14388) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:12:47.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:46 smithi163 bash[24253]: cluster 2024-08-31T02:12:46.653902+0000 mgr.a (mgr.14388) 64 : cluster [DBG] pgmap v45: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:12:48.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:12:48.228 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:12:48.228 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:12:48.980 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:12:48.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:12:48.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:12:48.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:12:48.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:12:49.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:49 smithi027 bash[22610]: audit 2024-08-31T02:12:48.566826+0000 mgr.a (mgr.14388) 65 : audit [DBG] from='client.15477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:49.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:49 smithi027 bash[22610]: cluster 2024-08-31T02:12:48.655104+0000 mgr.a (mgr.14388) 66 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:50.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:49 smithi191 bash[24992]: audit 2024-08-31T02:12:48.566826+0000 mgr.a (mgr.14388) 65 : audit [DBG] from='client.15477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:50.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:49 smithi191 bash[24992]: cluster 2024-08-31T02:12:48.655104+0000 mgr.a (mgr.14388) 66 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:50.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:49 smithi163 bash[24253]: audit 2024-08-31T02:12:48.566826+0000 mgr.a (mgr.14388) 65 : audit [DBG] from='client.15477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:50.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:49 smithi163 bash[24253]: cluster 2024-08-31T02:12:48.655104+0000 mgr.a (mgr.14388) 66 : cluster [DBG] pgmap v46: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:51.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:51 smithi027 bash[22610]: cluster 2024-08-31T02:12:50.655964+0000 mgr.a (mgr.14388) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:12:52.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:51 smithi191 bash[24992]: cluster 2024-08-31T02:12:50.655964+0000 mgr.a (mgr.14388) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:12:52.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:51 smithi163 bash[24253]: cluster 2024-08-31T02:12:50.655964+0000 mgr.a (mgr.14388) 67 : cluster [DBG] pgmap v47: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:12:53.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:52 smithi191 bash[24992]: cluster 2024-08-31T02:12:52.656750+0000 mgr.a (mgr.14388) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:12:53.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:52 smithi163 bash[24253]: cluster 2024-08-31T02:12:52.656750+0000 mgr.a (mgr.14388) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:12:53.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:52 smithi027 bash[22610]: cluster 2024-08-31T02:12:52.656750+0000 mgr.a (mgr.14388) 68 : cluster [DBG] pgmap v48: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:12:53.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:12:53.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:12:53.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:12:54.723 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:12:54.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:12:54.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:12:54.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:12:54.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:12:55.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:55 smithi027 bash[22610]: audit 2024-08-31T02:12:54.315311+0000 mgr.a (mgr.14388) 69 : audit [DBG] from='client.15552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:55.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:55 smithi027 bash[22610]: cluster 2024-08-31T02:12:54.658262+0000 mgr.a (mgr.14388) 70 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:56.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:55 smithi191 bash[24992]: audit 2024-08-31T02:12:54.315311+0000 mgr.a (mgr.14388) 69 : audit [DBG] from='client.15552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:56.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:55 smithi191 bash[24992]: cluster 2024-08-31T02:12:54.658262+0000 mgr.a (mgr.14388) 70 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:56.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:55 smithi163 bash[24253]: audit 2024-08-31T02:12:54.315311+0000 mgr.a (mgr.14388) 69 : audit [DBG] from='client.15552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:12:56.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:55 smithi163 bash[24253]: cluster 2024-08-31T02:12:54.658262+0000 mgr.a (mgr.14388) 70 : cluster [DBG] pgmap v49: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:57.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:57 smithi027 bash[22610]: cluster 2024-08-31T02:12:56.659065+0000 mgr.a (mgr.14388) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:58.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:57 smithi191 bash[24992]: cluster 2024-08-31T02:12:56.659065+0000 mgr.a (mgr.14388) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:58.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:57 smithi163 bash[24253]: cluster 2024-08-31T02:12:56.659065+0000 mgr.a (mgr.14388) 71 : cluster [DBG] pgmap v50: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:12:59.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:12:58 smithi191 bash[24992]: cluster 2024-08-31T02:12:58.661023+0000 mgr.a (mgr.14388) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:12:59.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:12:58 smithi163 bash[24253]: cluster 2024-08-31T02:12:58.661023+0000 mgr.a (mgr.14388) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:12:59.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:12:58 smithi027 bash[22610]: cluster 2024-08-31T02:12:58.661023+0000 mgr.a (mgr.14388) 72 : cluster [DBG] pgmap v51: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:12:59.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:12:59.725 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:12:59.725 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:00.449 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:00.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:00.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:00.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:00.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:01.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:01 smithi027 bash[22610]: audit 2024-08-31T02:13:00.056887+0000 mgr.a (mgr.14388) 73 : audit [DBG] from='client.15630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:01.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:01 smithi027 bash[22610]: cluster 2024-08-31T02:13:00.662079+0000 mgr.a (mgr.14388) 74 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:02.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:01 smithi191 bash[24992]: audit 2024-08-31T02:13:00.056887+0000 mgr.a (mgr.14388) 73 : audit [DBG] from='client.15630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:02.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:01 smithi191 bash[24992]: cluster 2024-08-31T02:13:00.662079+0000 mgr.a (mgr.14388) 74 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:02.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:01 smithi163 bash[24253]: audit 2024-08-31T02:13:00.056887+0000 mgr.a (mgr.14388) 73 : audit [DBG] from='client.15630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:02.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:01 smithi163 bash[24253]: cluster 2024-08-31T02:13:00.662079+0000 mgr.a (mgr.14388) 74 : cluster [DBG] pgmap v52: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:02.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:02 smithi027 bash[22610]: cluster 2024-08-31T02:13:02.662977+0000 mgr.a (mgr.14388) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:03.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:02 smithi191 bash[24992]: cluster 2024-08-31T02:13:02.662977+0000 mgr.a (mgr.14388) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:03.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:02 smithi163 bash[24253]: cluster 2024-08-31T02:13:02.662977+0000 mgr.a (mgr.14388) 75 : cluster [DBG] pgmap v53: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:05.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:04 smithi191 bash[24992]: cluster 2024-08-31T02:13:04.665115+0000 mgr.a (mgr.14388) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:05.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:04 smithi163 bash[24253]: cluster 2024-08-31T02:13:04.665115+0000 mgr.a (mgr.14388) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:05.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:04 smithi027 bash[22610]: cluster 2024-08-31T02:13:04.665115+0000 mgr.a (mgr.14388) 76 : cluster [DBG] pgmap v54: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:05.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:13:05.451 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:13:05.451 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:06.216 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:06.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:07.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:06 smithi191 bash[24992]: audit 2024-08-31T02:13:05.788462+0000 mgr.a (mgr.14388) 77 : audit [DBG] from='client.15708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:07.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:06 smithi191 bash[24992]: cluster 2024-08-31T02:13:06.666147+0000 mgr.a (mgr.14388) 78 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:07.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:06 smithi163 bash[24253]: audit 2024-08-31T02:13:05.788462+0000 mgr.a (mgr.14388) 77 : audit [DBG] from='client.15708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:07.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:06 smithi163 bash[24253]: cluster 2024-08-31T02:13:06.666147+0000 mgr.a (mgr.14388) 78 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:07.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:06 smithi027 bash[22610]: audit 2024-08-31T02:13:05.788462+0000 mgr.a (mgr.14388) 77 : audit [DBG] from='client.15708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:07.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:06 smithi027 bash[22610]: cluster 2024-08-31T02:13:06.666147+0000 mgr.a (mgr.14388) 78 : cluster [DBG] pgmap v55: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:09.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:08 smithi191 bash[24992]: cluster 2024-08-31T02:13:08.668355+0000 mgr.a (mgr.14388) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:09.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:08 smithi163 bash[24253]: cluster 2024-08-31T02:13:08.668355+0000 mgr.a (mgr.14388) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:09.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:08 smithi027 bash[22610]: cluster 2024-08-31T02:13:08.668355+0000 mgr.a (mgr.14388) 79 : cluster [DBG] pgmap v56: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:11.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:10 smithi191 bash[24992]: cluster 2024-08-31T02:13:10.669152+0000 mgr.a (mgr.14388) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:11.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:10 smithi163 bash[24253]: cluster 2024-08-31T02:13:10.669152+0000 mgr.a (mgr.14388) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:11.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:13:11.218 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:13:11.218 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:11.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:10 smithi027 bash[22610]: cluster 2024-08-31T02:13:10.669152+0000 mgr.a (mgr.14388) 80 : cluster [DBG] pgmap v57: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:11.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:11.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:11.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:11.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:11.946 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:12.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:11 smithi191 bash[24992]: audit 2024-08-31T02:13:11.545683+0000 mgr.a (mgr.14388) 81 : audit [DBG] from='client.15783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:12.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:11 smithi163 bash[24253]: audit 2024-08-31T02:13:11.545683+0000 mgr.a (mgr.14388) 81 : audit [DBG] from='client.15783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:12.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:11 smithi027 bash[22610]: audit 2024-08-31T02:13:11.545683+0000 mgr.a (mgr.14388) 81 : audit [DBG] from='client.15783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:12 smithi191 bash[24992]: cluster 2024-08-31T02:13:12.670144+0000 mgr.a (mgr.14388) 82 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:13.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:12 smithi163 bash[24253]: cluster 2024-08-31T02:13:12.670144+0000 mgr.a (mgr.14388) 82 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:13.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:12 smithi027 bash[22610]: cluster 2024-08-31T02:13:12.670144+0000 mgr.a (mgr.14388) 82 : cluster [DBG] pgmap v58: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:15.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:14 smithi191 bash[24992]: cluster 2024-08-31T02:13:14.672372+0000 mgr.a (mgr.14388) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:15.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:14 smithi163 bash[24253]: cluster 2024-08-31T02:13:14.672372+0000 mgr.a (mgr.14388) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:15.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:14 smithi027 bash[22610]: cluster 2024-08-31T02:13:14.672372+0000 mgr.a (mgr.14388) 83 : cluster [DBG] pgmap v59: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:16.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:13:16.948 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:13:16.948 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:17.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:16 smithi191 bash[24992]: cluster 2024-08-31T02:13:16.673139+0000 mgr.a (mgr.14388) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:17.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:16 smithi163 bash[24253]: cluster 2024-08-31T02:13:16.673139+0000 mgr.a (mgr.14388) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:17.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:16 smithi027 bash[22610]: cluster 2024-08-31T02:13:16.673139+0000 mgr.a (mgr.14388) 84 : cluster [DBG] pgmap v60: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:17.722 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:17.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:17.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:17.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:17.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:18.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:17 smithi191 bash[24992]: audit 2024-08-31T02:13:17.287409+0000 mgr.a (mgr.14388) 85 : audit [DBG] from='client.15861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:18.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:17 smithi163 bash[24253]: audit 2024-08-31T02:13:17.287409+0000 mgr.a (mgr.14388) 85 : audit [DBG] from='client.15861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:18.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:17 smithi027 bash[22610]: audit 2024-08-31T02:13:17.287409+0000 mgr.a (mgr.14388) 85 : audit [DBG] from='client.15861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:19.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:18 smithi191 bash[24992]: cluster 2024-08-31T02:13:18.675512+0000 mgr.a (mgr.14388) 86 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:19.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:18 smithi163 bash[24253]: cluster 2024-08-31T02:13:18.675512+0000 mgr.a (mgr.14388) 86 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:19.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:18 smithi027 bash[22610]: cluster 2024-08-31T02:13:18.675512+0000 mgr.a (mgr.14388) 86 : cluster [DBG] pgmap v61: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:21.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:20 smithi191 bash[24992]: cluster 2024-08-31T02:13:20.676295+0000 mgr.a (mgr.14388) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:21.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:20 smithi163 bash[24253]: cluster 2024-08-31T02:13:20.676295+0000 mgr.a (mgr.14388) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:21.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:20 smithi027 bash[22610]: cluster 2024-08-31T02:13:20.676295+0000 mgr.a (mgr.14388) 87 : cluster [DBG] pgmap v62: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:22.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:13:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:13:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:23.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:22 smithi191 bash[24992]: cluster 2024-08-31T02:13:22.677058+0000 mgr.a (mgr.14388) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:23.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:22 smithi163 bash[24253]: cluster 2024-08-31T02:13:22.677058+0000 mgr.a (mgr.14388) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:23.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:22 smithi027 bash[22610]: cluster 2024-08-31T02:13:22.677058+0000 mgr.a (mgr.14388) 88 : cluster [DBG] pgmap v63: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:23.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:23.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:23.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:23.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:23.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:24.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:23 smithi191 bash[24992]: audit 2024-08-31T02:13:23.065153+0000 mgr.a (mgr.14388) 89 : audit [DBG] from='client.15939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:24.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:23 smithi163 bash[24253]: audit 2024-08-31T02:13:23.065153+0000 mgr.a (mgr.14388) 89 : audit [DBG] from='client.15939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:24.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:23 smithi027 bash[22610]: audit 2024-08-31T02:13:23.065153+0000 mgr.a (mgr.14388) 89 : audit [DBG] from='client.15939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:25.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:24 smithi191 bash[24992]: cluster 2024-08-31T02:13:24.679653+0000 mgr.a (mgr.14388) 90 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:25.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:24 smithi163 bash[24253]: cluster 2024-08-31T02:13:24.679653+0000 mgr.a (mgr.14388) 90 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:25.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:24 smithi027 bash[22610]: cluster 2024-08-31T02:13:24.679653+0000 mgr.a (mgr.14388) 90 : cluster [DBG] pgmap v64: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:27.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:26 smithi191 bash[24992]: cluster 2024-08-31T02:13:26.680423+0000 mgr.a (mgr.14388) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:13:27.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:26 smithi163 bash[24253]: cluster 2024-08-31T02:13:26.680423+0000 mgr.a (mgr.14388) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:13:27.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:26 smithi027 bash[22610]: cluster 2024-08-31T02:13:26.680423+0000 mgr.a (mgr.14388) 91 : cluster [DBG] pgmap v65: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:13:28.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:27 smithi191 bash[24992]: audit 2024-08-31T02:13:27.698113+0000 mon.a (mon.0) 609 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:13:28.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:27 smithi163 bash[24253]: audit 2024-08-31T02:13:27.698113+0000 mon.a (mon.0) 609 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:13:28.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:27 smithi027 bash[22610]: audit 2024-08-31T02:13:27.698113+0000 mon.a (mon.0) 609 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:13:28.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:13:28.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:13:28.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:29.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:28 smithi191 bash[24992]: audit 2024-08-31T02:13:28.539893+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:13:29.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:28 smithi191 bash[24992]: audit 2024-08-31T02:13:28.540834+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:13:29.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:28 smithi191 bash[24992]: audit 2024-08-31T02:13:28.548505+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:13:29.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:28 smithi191 bash[24992]: audit 2024-08-31T02:13:28.551468+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:13:29.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:28 smithi191 bash[24992]: audit 2024-08-31T02:13:28.553597+0000 mgr.a (mgr.14388) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:13:29.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:28 smithi191 bash[24992]: cluster 2024-08-31T02:13:28.681669+0000 mgr.a (mgr.14388) 93 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:29.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:28 smithi163 bash[24253]: audit 2024-08-31T02:13:28.539893+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:13:29.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:28 smithi163 bash[24253]: audit 2024-08-31T02:13:28.540834+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:13:29.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:28 smithi163 bash[24253]: audit 2024-08-31T02:13:28.548505+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:13:29.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:28 smithi163 bash[24253]: audit 2024-08-31T02:13:28.551468+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:13:29.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:28 smithi163 bash[24253]: audit 2024-08-31T02:13:28.553597+0000 mgr.a (mgr.14388) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:13:29.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:28 smithi163 bash[24253]: cluster 2024-08-31T02:13:28.681669+0000 mgr.a (mgr.14388) 93 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:29.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:28 smithi027 bash[22610]: audit 2024-08-31T02:13:28.539893+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:13:29.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:28 smithi027 bash[22610]: audit 2024-08-31T02:13:28.540834+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:13:29.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:28 smithi027 bash[22610]: audit 2024-08-31T02:13:28.548505+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:13:29.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:28 smithi027 bash[22610]: audit 2024-08-31T02:13:28.551468+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:13:29.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:28 smithi027 bash[22610]: audit 2024-08-31T02:13:28.553597+0000 mgr.a (mgr.14388) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:13:29.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:28 smithi027 bash[22610]: cluster 2024-08-31T02:13:28.681669+0000 mgr.a (mgr.14388) 93 : cluster [DBG] pgmap v66: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:29.626 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:29.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:29.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:29.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:29.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:29.729 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:13:29 smithi027 bash[22863]: debug 2024-08-31T02:13:29.236+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:13:29.729 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:13:29 smithi027 bash[22863]: debug 2024-08-31T02:13:29.248+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:13:30.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:30 smithi163 bash[24253]: audit 2024-08-31T02:13:28.846251+0000 mgr.a (mgr.14388) 94 : audit [DBG] from='client.16017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:30.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:30 smithi163 bash[24253]: audit 2024-08-31T02:13:29.241499+0000 mgr.a (mgr.14388) 95 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:13:30.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:30 smithi163 bash[24253]: cephadm 2024-08-31T02:13:29.251188+0000 mgr.a (mgr.14388) 96 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:13:30.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:30 smithi027 bash[22610]: audit 2024-08-31T02:13:28.846251+0000 mgr.a (mgr.14388) 94 : audit [DBG] from='client.16017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:30.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:30 smithi027 bash[22610]: audit 2024-08-31T02:13:29.241499+0000 mgr.a (mgr.14388) 95 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:13:30.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:30 smithi027 bash[22610]: cephadm 2024-08-31T02:13:29.251188+0000 mgr.a (mgr.14388) 96 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:13:31.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:30 smithi191 bash[24992]: audit 2024-08-31T02:13:28.846251+0000 mgr.a (mgr.14388) 94 : audit [DBG] from='client.16017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:31.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:30 smithi191 bash[24992]: audit 2024-08-31T02:13:29.241499+0000 mgr.a (mgr.14388) 95 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:13:31.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:30 smithi191 bash[24992]: cephadm 2024-08-31T02:13:29.251188+0000 mgr.a (mgr.14388) 96 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:13:31.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:31 smithi163 bash[24253]: cluster 2024-08-31T02:13:30.682541+0000 mgr.a (mgr.14388) 97 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:13:31.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:31 smithi027 bash[22610]: cluster 2024-08-31T02:13:30.682541+0000 mgr.a (mgr.14388) 97 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:13:32.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:31 smithi191 bash[24992]: cluster 2024-08-31T02:13:30.682541+0000 mgr.a (mgr.14388) 97 : cluster [DBG] pgmap v67: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:13:33.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:32 smithi191 bash[24992]: cluster 2024-08-31T02:13:32.683305+0000 mgr.a (mgr.14388) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:13:33.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:32 smithi163 bash[24253]: cluster 2024-08-31T02:13:32.683305+0000 mgr.a (mgr.14388) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:13:33.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:32 smithi027 bash[22610]: cluster 2024-08-31T02:13:32.683305+0000 mgr.a (mgr.14388) 98 : cluster [DBG] pgmap v68: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:13:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:13:34.628 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:13:34.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:35.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:34 smithi191 bash[24992]: cluster 2024-08-31T02:13:34.685453+0000 mgr.a (mgr.14388) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:35.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:34 smithi163 bash[24253]: cluster 2024-08-31T02:13:34.685453+0000 mgr.a (mgr.14388) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:35.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:34 smithi027 bash[22610]: cluster 2024-08-31T02:13:34.685453+0000 mgr.a (mgr.14388) 99 : cluster [DBG] pgmap v69: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:35.363 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:35.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:35.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:35.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:35.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:36.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:35 smithi191 bash[24992]: audit 2024-08-31T02:13:34.960157+0000 mgr.a (mgr.14388) 100 : audit [DBG] from='client.16200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:36.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:35 smithi163 bash[24253]: audit 2024-08-31T02:13:34.960157+0000 mgr.a (mgr.14388) 100 : audit [DBG] from='client.16200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:36.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:35 smithi027 bash[22610]: audit 2024-08-31T02:13:34.960157+0000 mgr.a (mgr.14388) 100 : audit [DBG] from='client.16200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:37.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:36 smithi163 bash[24253]: cluster 2024-08-31T02:13:36.686315+0000 mgr.a (mgr.14388) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:37.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:36 smithi027 bash[22610]: cluster 2024-08-31T02:13:36.686315+0000 mgr.a (mgr.14388) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:37.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:36 smithi191 bash[24992]: cluster 2024-08-31T02:13:36.686315+0000 mgr.a (mgr.14388) 101 : cluster [DBG] pgmap v70: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:39.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:38 smithi191 bash[24992]: cluster 2024-08-31T02:13:38.688474+0000 mgr.a (mgr.14388) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:39.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:38 smithi163 bash[24253]: cluster 2024-08-31T02:13:38.688474+0000 mgr.a (mgr.14388) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:39.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:38 smithi027 bash[22610]: cluster 2024-08-31T02:13:38.688474+0000 mgr.a (mgr.14388) 102 : cluster [DBG] pgmap v71: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:40.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:13:40.365 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:13:40.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:41.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:40 smithi191 bash[24992]: cluster 2024-08-31T02:13:40.689184+0000 mgr.a (mgr.14388) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:41.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:40 smithi191 bash[24992]: audit 2024-08-31T02:13:40.699630+0000 mgr.a (mgr.14388) 104 : audit [DBG] from='client.16275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:41.104 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:41.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:41.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:41.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:41.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:41.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:40 smithi163 bash[24253]: cluster 2024-08-31T02:13:40.689184+0000 mgr.a (mgr.14388) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:41.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:40 smithi163 bash[24253]: audit 2024-08-31T02:13:40.699630+0000 mgr.a (mgr.14388) 104 : audit [DBG] from='client.16275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:41.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:40 smithi027 bash[22610]: cluster 2024-08-31T02:13:40.689184+0000 mgr.a (mgr.14388) 103 : cluster [DBG] pgmap v72: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:41.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:40 smithi027 bash[22610]: audit 2024-08-31T02:13:40.699630+0000 mgr.a (mgr.14388) 104 : audit [DBG] from='client.16275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:43.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:42 smithi191 bash[24992]: cluster 2024-08-31T02:13:42.690123+0000 mgr.a (mgr.14388) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:43.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:42 smithi163 bash[24253]: cluster 2024-08-31T02:13:42.690123+0000 mgr.a (mgr.14388) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:43.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:42 smithi027 bash[22610]: cluster 2024-08-31T02:13:42.690123+0000 mgr.a (mgr.14388) 105 : cluster [DBG] pgmap v73: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:45.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:44 smithi191 bash[24992]: cluster 2024-08-31T02:13:44.692347+0000 mgr.a (mgr.14388) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:45.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:44 smithi163 bash[24253]: cluster 2024-08-31T02:13:44.692347+0000 mgr.a (mgr.14388) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:45.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:44 smithi027 bash[22610]: cluster 2024-08-31T02:13:44.692347+0000 mgr.a (mgr.14388) 106 : cluster [DBG] pgmap v74: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:13:46.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:13:46.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:13:46.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:46.867 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:46.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:46.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:46.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:46.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:47.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:46 smithi191 bash[24992]: audit 2024-08-31T02:13:46.446037+0000 mgr.a (mgr.14388) 107 : audit [DBG] from='client.16353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:47.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:46 smithi191 bash[24992]: cluster 2024-08-31T02:13:46.692904+0000 mgr.a (mgr.14388) 108 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:47.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:46 smithi163 bash[24253]: audit 2024-08-31T02:13:46.446037+0000 mgr.a (mgr.14388) 107 : audit [DBG] from='client.16353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:47.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:46 smithi163 bash[24253]: cluster 2024-08-31T02:13:46.692904+0000 mgr.a (mgr.14388) 108 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:46 smithi027 bash[22610]: audit 2024-08-31T02:13:46.446037+0000 mgr.a (mgr.14388) 107 : audit [DBG] from='client.16353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:46 smithi027 bash[22610]: cluster 2024-08-31T02:13:46.692904+0000 mgr.a (mgr.14388) 108 : cluster [DBG] pgmap v75: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:49.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:48 smithi191 bash[24992]: cluster 2024-08-31T02:13:48.695097+0000 mgr.a (mgr.14388) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:49.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:48 smithi163 bash[24253]: cluster 2024-08-31T02:13:48.695097+0000 mgr.a (mgr.14388) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:49.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:48 smithi027 bash[22610]: cluster 2024-08-31T02:13:48.695097+0000 mgr.a (mgr.14388) 109 : cluster [DBG] pgmap v76: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:51.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:50 smithi191 bash[24992]: cluster 2024-08-31T02:13:50.695825+0000 mgr.a (mgr.14388) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:51.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:50 smithi163 bash[24253]: cluster 2024-08-31T02:13:50.695825+0000 mgr.a (mgr.14388) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:51.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:50 smithi027 bash[22610]: cluster 2024-08-31T02:13:50.695825+0000 mgr.a (mgr.14388) 110 : cluster [DBG] pgmap v77: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:51.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:13:51.869 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:13:51.870 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:52.623 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:52.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:52.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:52.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:52.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:53.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:52 smithi191 bash[24992]: audit 2024-08-31T02:13:52.210808+0000 mgr.a (mgr.14388) 111 : audit [DBG] from='client.16428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:53.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:52 smithi191 bash[24992]: cluster 2024-08-31T02:13:52.696577+0000 mgr.a (mgr.14388) 112 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:53.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:52 smithi163 bash[24253]: audit 2024-08-31T02:13:52.210808+0000 mgr.a (mgr.14388) 111 : audit [DBG] from='client.16428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:53.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:52 smithi163 bash[24253]: cluster 2024-08-31T02:13:52.696577+0000 mgr.a (mgr.14388) 112 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:53.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:52 smithi027 bash[22610]: audit 2024-08-31T02:13:52.210808+0000 mgr.a (mgr.14388) 111 : audit [DBG] from='client.16428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:53.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:52 smithi027 bash[22610]: cluster 2024-08-31T02:13:52.696577+0000 mgr.a (mgr.14388) 112 : cluster [DBG] pgmap v78: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:55.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:54 smithi191 bash[24992]: cluster 2024-08-31T02:13:54.698690+0000 mgr.a (mgr.14388) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:55.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:54 smithi163 bash[24253]: cluster 2024-08-31T02:13:54.698690+0000 mgr.a (mgr.14388) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:55.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:54 smithi027 bash[22610]: cluster 2024-08-31T02:13:54.698690+0000 mgr.a (mgr.14388) 113 : cluster [DBG] pgmap v79: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:13:57.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:56 smithi191 bash[24992]: cluster 2024-08-31T02:13:56.699474+0000 mgr.a (mgr.14388) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:57.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:56 smithi163 bash[24253]: cluster 2024-08-31T02:13:56.699474+0000 mgr.a (mgr.14388) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:57.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:56 smithi027 bash[22610]: cluster 2024-08-31T02:13:56.699474+0000 mgr.a (mgr.14388) 114 : cluster [DBG] pgmap v80: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:57.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:13:57.626 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:13:57.626 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:13:58.348 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:13:58.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:13:58.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:13:58.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:13:58.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:13:59.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:58 smithi191 bash[24992]: audit 2024-08-31T02:13:57.951380+0000 mgr.a (mgr.14388) 115 : audit [DBG] from='client.16503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:59.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:13:58 smithi191 bash[24992]: cluster 2024-08-31T02:13:58.702090+0000 mgr.a (mgr.14388) 116 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:59.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:58 smithi163 bash[24253]: audit 2024-08-31T02:13:57.951380+0000 mgr.a (mgr.14388) 115 : audit [DBG] from='client.16503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:59.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:13:58 smithi163 bash[24253]: cluster 2024-08-31T02:13:58.702090+0000 mgr.a (mgr.14388) 116 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:13:59.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:58 smithi027 bash[22610]: audit 2024-08-31T02:13:57.951380+0000 mgr.a (mgr.14388) 115 : audit [DBG] from='client.16503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:13:59.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:13:58 smithi027 bash[22610]: cluster 2024-08-31T02:13:58.702090+0000 mgr.a (mgr.14388) 116 : cluster [DBG] pgmap v81: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:01.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:00 smithi191 bash[24992]: cluster 2024-08-31T02:14:00.702914+0000 mgr.a (mgr.14388) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:14:01.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:00 smithi163 bash[24253]: cluster 2024-08-31T02:14:00.702914+0000 mgr.a (mgr.14388) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:14:01.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:00 smithi027 bash[22610]: cluster 2024-08-31T02:14:00.702914+0000 mgr.a (mgr.14388) 117 : cluster [DBG] pgmap v82: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:14:03.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:02 smithi191 bash[24992]: cluster 2024-08-31T02:14:02.703702+0000 mgr.a (mgr.14388) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:14:03.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:02 smithi163 bash[24253]: cluster 2024-08-31T02:14:02.703702+0000 mgr.a (mgr.14388) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:14:03.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:02 smithi027 bash[22610]: cluster 2024-08-31T02:14:02.703702+0000 mgr.a (mgr.14388) 118 : cluster [DBG] pgmap v83: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:14:03.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:14:03.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:14:03.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:14:04.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:03 smithi191 bash[24992]: audit 2024-08-31T02:14:03.690658+0000 mgr.a (mgr.14388) 119 : audit [DBG] from='client.16581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:04.095 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:14:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:14:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:14:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:14:04.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:14:04.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:03 smithi163 bash[24253]: audit 2024-08-31T02:14:03.690658+0000 mgr.a (mgr.14388) 119 : audit [DBG] from='client.16581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:04.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:03 smithi027 bash[22610]: audit 2024-08-31T02:14:03.690658+0000 mgr.a (mgr.14388) 119 : audit [DBG] from='client.16581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:05.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:04 smithi163 bash[24253]: cluster 2024-08-31T02:14:04.706318+0000 mgr.a (mgr.14388) 120 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:05.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:04 smithi027 bash[22610]: cluster 2024-08-31T02:14:04.706318+0000 mgr.a (mgr.14388) 120 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:05.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:04 smithi191 bash[24992]: cluster 2024-08-31T02:14:04.706318+0000 mgr.a (mgr.14388) 120 : cluster [DBG] pgmap v84: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:07.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:06 smithi191 bash[24992]: cluster 2024-08-31T02:14:06.707136+0000 mgr.a (mgr.14388) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:14:07.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:06 smithi163 bash[24253]: cluster 2024-08-31T02:14:06.707136+0000 mgr.a (mgr.14388) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:14:07.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:06 smithi027 bash[22610]: cluster 2024-08-31T02:14:06.707136+0000 mgr.a (mgr.14388) 121 : cluster [DBG] pgmap v85: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:14:09.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:08 smithi191 bash[24992]: cluster 2024-08-31T02:14:08.709012+0000 mgr.a (mgr.14388) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:09.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:14:09.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:14:09.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:14:09.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:08 smithi163 bash[24253]: cluster 2024-08-31T02:14:08.709012+0000 mgr.a (mgr.14388) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:09.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:08 smithi027 bash[22610]: cluster 2024-08-31T02:14:08.709012+0000 mgr.a (mgr.14388) 122 : cluster [DBG] pgmap v86: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:09.836 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:14:09.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:14:09.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:14:09.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:14:09.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:14:10.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:09 smithi191 bash[24992]: audit 2024-08-31T02:14:09.434932+0000 mgr.a (mgr.14388) 123 : audit [DBG] from='client.16659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:10.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:09 smithi163 bash[24253]: audit 2024-08-31T02:14:09.434932+0000 mgr.a (mgr.14388) 123 : audit [DBG] from='client.16659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:10.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:09 smithi027 bash[22610]: audit 2024-08-31T02:14:09.434932+0000 mgr.a (mgr.14388) 123 : audit [DBG] from='client.16659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:11.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:10 smithi163 bash[24253]: cluster 2024-08-31T02:14:10.710054+0000 mgr.a (mgr.14388) 124 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:11.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:10 smithi027 bash[22610]: cluster 2024-08-31T02:14:10.710054+0000 mgr.a (mgr.14388) 124 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:11.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:10 smithi191 bash[24992]: cluster 2024-08-31T02:14:10.710054+0000 mgr.a (mgr.14388) 124 : cluster [DBG] pgmap v87: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:12 smithi191 bash[24992]: cluster 2024-08-31T02:14:12.711010+0000 mgr.a (mgr.14388) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:13.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:12 smithi163 bash[24253]: cluster 2024-08-31T02:14:12.711010+0000 mgr.a (mgr.14388) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:13.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:12 smithi027 bash[22610]: cluster 2024-08-31T02:14:12.711010+0000 mgr.a (mgr.14388) 125 : cluster [DBG] pgmap v88: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:14.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:14:14.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:14:14.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:14:15.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:14 smithi191 bash[24992]: cluster 2024-08-31T02:14:14.713201+0000 mgr.a (mgr.14388) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:15.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:14 smithi163 bash[24253]: cluster 2024-08-31T02:14:14.713201+0000 mgr.a (mgr.14388) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:15.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:14 smithi027 bash[22610]: cluster 2024-08-31T02:14:14.713201+0000 mgr.a (mgr.14388) 126 : cluster [DBG] pgmap v89: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:15.577 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:14:15.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:14:15.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:14:15.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:14:15.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:14:16.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:15 smithi163 bash[24253]: audit 2024-08-31T02:14:15.175290+0000 mgr.a (mgr.14388) 127 : audit [DBG] from='client.16734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:16.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:15 smithi027 bash[22610]: audit 2024-08-31T02:14:15.175290+0000 mgr.a (mgr.14388) 127 : audit [DBG] from='client.16734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:16.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:15 smithi191 bash[24992]: audit 2024-08-31T02:14:15.175290+0000 mgr.a (mgr.14388) 127 : audit [DBG] from='client.16734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:17.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:16 smithi163 bash[24253]: cluster 2024-08-31T02:14:16.714077+0000 mgr.a (mgr.14388) 128 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:17.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:16 smithi027 bash[22610]: cluster 2024-08-31T02:14:16.714077+0000 mgr.a (mgr.14388) 128 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:17.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:16 smithi191 bash[24992]: cluster 2024-08-31T02:14:16.714077+0000 mgr.a (mgr.14388) 128 : cluster [DBG] pgmap v90: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:19.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:18 smithi191 bash[24992]: cluster 2024-08-31T02:14:18.716303+0000 mgr.a (mgr.14388) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:19.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:18 smithi163 bash[24253]: cluster 2024-08-31T02:14:18.716303+0000 mgr.a (mgr.14388) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:19.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:18 smithi027 bash[22610]: cluster 2024-08-31T02:14:18.716303+0000 mgr.a (mgr.14388) 129 : cluster [DBG] pgmap v91: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:20.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:14:20.580 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:14:20.580 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:14:21.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:20 smithi191 bash[24992]: cluster 2024-08-31T02:14:20.716851+0000 mgr.a (mgr.14388) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:21.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:20 smithi163 bash[24253]: cluster 2024-08-31T02:14:20.716851+0000 mgr.a (mgr.14388) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:21.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:20 smithi027 bash[22610]: cluster 2024-08-31T02:14:20.716851+0000 mgr.a (mgr.14388) 130 : cluster [DBG] pgmap v92: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:21.309 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:14:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:14:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:14:21.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:14:21.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:14:22.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:21 smithi163 bash[24253]: audit 2024-08-31T02:14:20.910910+0000 mgr.a (mgr.14388) 131 : audit [DBG] from='client.16809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:22.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:21 smithi027 bash[22610]: audit 2024-08-31T02:14:20.910910+0000 mgr.a (mgr.14388) 131 : audit [DBG] from='client.16809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:22.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:21 smithi191 bash[24992]: audit 2024-08-31T02:14:20.910910+0000 mgr.a (mgr.14388) 131 : audit [DBG] from='client.16809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:23.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:22 smithi163 bash[24253]: cluster 2024-08-31T02:14:22.717691+0000 mgr.a (mgr.14388) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:23.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:22 smithi027 bash[22610]: cluster 2024-08-31T02:14:22.717691+0000 mgr.a (mgr.14388) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:23.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:22 smithi191 bash[24992]: cluster 2024-08-31T02:14:22.717691+0000 mgr.a (mgr.14388) 132 : cluster [DBG] pgmap v93: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:25.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:24 smithi191 bash[24992]: cluster 2024-08-31T02:14:24.719897+0000 mgr.a (mgr.14388) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:25.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:24 smithi163 bash[24253]: cluster 2024-08-31T02:14:24.719897+0000 mgr.a (mgr.14388) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:25.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:24 smithi027 bash[22610]: cluster 2024-08-31T02:14:24.719897+0000 mgr.a (mgr.14388) 133 : cluster [DBG] pgmap v94: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:14:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:14:26.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:14:27.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:26 smithi191 bash[24992]: audit 2024-08-31T02:14:26.649752+0000 mgr.a (mgr.14388) 134 : audit [DBG] from='client.16884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:27.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:26 smithi191 bash[24992]: cluster 2024-08-31T02:14:26.720622+0000 mgr.a (mgr.14388) 135 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:27.050 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:14:27.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:14:27.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:14:27.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:14:27.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:14:27.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:26 smithi163 bash[24253]: audit 2024-08-31T02:14:26.649752+0000 mgr.a (mgr.14388) 134 : audit [DBG] from='client.16884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:27.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:26 smithi163 bash[24253]: cluster 2024-08-31T02:14:26.720622+0000 mgr.a (mgr.14388) 135 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:27.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:26 smithi027 bash[22610]: audit 2024-08-31T02:14:26.649752+0000 mgr.a (mgr.14388) 134 : audit [DBG] from='client.16884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:27.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:26 smithi027 bash[22610]: cluster 2024-08-31T02:14:26.720622+0000 mgr.a (mgr.14388) 135 : cluster [DBG] pgmap v95: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:29.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:28 smithi191 bash[24992]: cluster 2024-08-31T02:14:28.722852+0000 mgr.a (mgr.14388) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:29.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:28 smithi163 bash[24253]: cluster 2024-08-31T02:14:28.722852+0000 mgr.a (mgr.14388) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:29.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:28 smithi027 bash[22610]: cluster 2024-08-31T02:14:28.722852+0000 mgr.a (mgr.14388) 136 : cluster [DBG] pgmap v96: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:30.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:29 smithi163 bash[24253]: audit 2024-08-31T02:14:29.304343+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:14:30.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:29 smithi027 bash[22610]: audit 2024-08-31T02:14:29.304343+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:14:30.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:29 smithi191 bash[24992]: audit 2024-08-31T02:14:29.304343+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:14:31.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:30 smithi163 bash[24253]: audit 2024-08-31T02:14:30.140970+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:14:31.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:30 smithi163 bash[24253]: audit 2024-08-31T02:14:30.142530+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:14:31.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:30 smithi163 bash[24253]: audit 2024-08-31T02:14:30.150416+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:14:31.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:30 smithi163 bash[24253]: audit 2024-08-31T02:14:30.155329+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:14:31.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:30 smithi163 bash[24253]: audit 2024-08-31T02:14:30.156546+0000 mgr.a (mgr.14388) 137 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:14:31.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:30 smithi163 bash[24253]: cluster 2024-08-31T02:14:30.723354+0000 mgr.a (mgr.14388) 138 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:31.229 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:14:30 smithi027 bash[22863]: debug 2024-08-31T02:14:30.855+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:14:31.229 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:14:30 smithi027 bash[22863]: debug 2024-08-31T02:14:30.855+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:14:31.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:30 smithi027 bash[22610]: audit 2024-08-31T02:14:30.140970+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:14:31.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:30 smithi027 bash[22610]: audit 2024-08-31T02:14:30.142530+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:14:31.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:30 smithi027 bash[22610]: audit 2024-08-31T02:14:30.150416+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:14:31.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:30 smithi027 bash[22610]: audit 2024-08-31T02:14:30.155329+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:14:31.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:30 smithi027 bash[22610]: audit 2024-08-31T02:14:30.156546+0000 mgr.a (mgr.14388) 137 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:14:31.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:30 smithi027 bash[22610]: cluster 2024-08-31T02:14:30.723354+0000 mgr.a (mgr.14388) 138 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:31.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:30 smithi191 bash[24992]: audit 2024-08-31T02:14:30.140970+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:14:31.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:30 smithi191 bash[24992]: audit 2024-08-31T02:14:30.142530+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:14:31.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:30 smithi191 bash[24992]: audit 2024-08-31T02:14:30.150416+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:14:31.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:30 smithi191 bash[24992]: audit 2024-08-31T02:14:30.155329+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:14:31.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:30 smithi191 bash[24992]: audit 2024-08-31T02:14:30.156546+0000 mgr.a (mgr.14388) 137 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:14:31.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:30 smithi191 bash[24992]: cluster 2024-08-31T02:14:30.723354+0000 mgr.a (mgr.14388) 138 : cluster [DBG] pgmap v97: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:32.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:14:32.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:14:32.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:14:32.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:32 smithi163 bash[24253]: audit 2024-08-31T02:14:30.859546+0000 mgr.a (mgr.14388) 139 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:14:32.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:32 smithi163 bash[24253]: cephadm 2024-08-31T02:14:30.860737+0000 mgr.a (mgr.14388) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:14:32.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:32 smithi027 bash[22610]: audit 2024-08-31T02:14:30.859546+0000 mgr.a (mgr.14388) 139 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:14:32.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:32 smithi027 bash[22610]: cephadm 2024-08-31T02:14:30.860737+0000 mgr.a (mgr.14388) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:14:32.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:32 smithi191 bash[24992]: audit 2024-08-31T02:14:30.859546+0000 mgr.a (mgr.14388) 139 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:14:32.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:32 smithi191 bash[24992]: cephadm 2024-08-31T02:14:30.860737+0000 mgr.a (mgr.14388) 140 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:14:32.817 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:14:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:14:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:14:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:14:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:14:33.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:33 smithi163 bash[24253]: audit 2024-08-31T02:14:32.393053+0000 mgr.a (mgr.14388) 141 : audit [DBG] from='client.17064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:33.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:33 smithi163 bash[24253]: cluster 2024-08-31T02:14:32.724037+0000 mgr.a (mgr.14388) 142 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:33.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:33 smithi027 bash[22610]: audit 2024-08-31T02:14:32.393053+0000 mgr.a (mgr.14388) 141 : audit [DBG] from='client.17064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:33.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:33 smithi027 bash[22610]: cluster 2024-08-31T02:14:32.724037+0000 mgr.a (mgr.14388) 142 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:33.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:33 smithi191 bash[24992]: audit 2024-08-31T02:14:32.393053+0000 mgr.a (mgr.14388) 141 : audit [DBG] from='client.17064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:33.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:33 smithi191 bash[24992]: cluster 2024-08-31T02:14:32.724037+0000 mgr.a (mgr.14388) 142 : cluster [DBG] pgmap v98: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:35.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:34 smithi163 bash[24253]: cluster 2024-08-31T02:14:34.726293+0000 mgr.a (mgr.14388) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:14:35.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:34 smithi027 bash[22610]: cluster 2024-08-31T02:14:34.726293+0000 mgr.a (mgr.14388) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:14:35.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:34 smithi191 bash[24992]: cluster 2024-08-31T02:14:34.726293+0000 mgr.a (mgr.14388) 143 : cluster [DBG] pgmap v99: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:14:37.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:36 smithi163 bash[24253]: cluster 2024-08-31T02:14:36.727167+0000 mgr.a (mgr.14388) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:14:37.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:36 smithi027 bash[22610]: cluster 2024-08-31T02:14:36.727167+0000 mgr.a (mgr.14388) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:14:37.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:36 smithi191 bash[24992]: cluster 2024-08-31T02:14:36.727167+0000 mgr.a (mgr.14388) 144 : cluster [DBG] pgmap v100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:14:37.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:14:37.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:14:37.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:14:38.592 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:14:38.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:14:38.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:14:38.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:14:38.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:14:39.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:38 smithi163 bash[24253]: audit 2024-08-31T02:14:38.157996+0000 mgr.a (mgr.14388) 145 : audit [DBG] from='client.17142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:39.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:38 smithi163 bash[24253]: cluster 2024-08-31T02:14:38.729861+0000 mgr.a (mgr.14388) 146 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:14:39.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:38 smithi027 bash[22610]: audit 2024-08-31T02:14:38.157996+0000 mgr.a (mgr.14388) 145 : audit [DBG] from='client.17142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:39.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:38 smithi027 bash[22610]: cluster 2024-08-31T02:14:38.729861+0000 mgr.a (mgr.14388) 146 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:14:39.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:38 smithi191 bash[24992]: audit 2024-08-31T02:14:38.157996+0000 mgr.a (mgr.14388) 145 : audit [DBG] from='client.17142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:39.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:38 smithi191 bash[24992]: cluster 2024-08-31T02:14:38.729861+0000 mgr.a (mgr.14388) 146 : cluster [DBG] pgmap v101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:14:41.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:40 smithi163 bash[24253]: cluster 2024-08-31T02:14:40.730664+0000 mgr.a (mgr.14388) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:14:41.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:40 smithi027 bash[22610]: cluster 2024-08-31T02:14:40.730664+0000 mgr.a (mgr.14388) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:14:41.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:40 smithi191 bash[24992]: cluster 2024-08-31T02:14:40.730664+0000 mgr.a (mgr.14388) 147 : cluster [DBG] pgmap v102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:14:43.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:42 smithi163 bash[24253]: cluster 2024-08-31T02:14:42.731455+0000 mgr.a (mgr.14388) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:14:43.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:42 smithi027 bash[22610]: cluster 2024-08-31T02:14:42.731455+0000 mgr.a (mgr.14388) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:14:43.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:42 smithi191 bash[24992]: cluster 2024-08-31T02:14:42.731455+0000 mgr.a (mgr.14388) 148 : cluster [DBG] pgmap v103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:14:43.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:14:43.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:14:43.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:14:44.356 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:14:44.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:14:44.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:14:44.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:14:44.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:14:45.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:44 smithi163 bash[24253]: audit 2024-08-31T02:14:43.934896+0000 mgr.a (mgr.14388) 149 : audit [DBG] from='client.17220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:45.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:44 smithi163 bash[24253]: cluster 2024-08-31T02:14:44.733951+0000 mgr.a (mgr.14388) 150 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:14:45.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:44 smithi027 bash[22610]: audit 2024-08-31T02:14:43.934896+0000 mgr.a (mgr.14388) 149 : audit [DBG] from='client.17220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:45.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:44 smithi027 bash[22610]: cluster 2024-08-31T02:14:44.733951+0000 mgr.a (mgr.14388) 150 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:14:45.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:44 smithi191 bash[24992]: audit 2024-08-31T02:14:43.934896+0000 mgr.a (mgr.14388) 149 : audit [DBG] from='client.17220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:45.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:44 smithi191 bash[24992]: cluster 2024-08-31T02:14:44.733951+0000 mgr.a (mgr.14388) 150 : cluster [DBG] pgmap v104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:14:47.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:46 smithi163 bash[24253]: cluster 2024-08-31T02:14:46.734788+0000 mgr.a (mgr.14388) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:14:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:46 smithi027 bash[22610]: cluster 2024-08-31T02:14:46.734788+0000 mgr.a (mgr.14388) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:14:47.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:46 smithi191 bash[24992]: cluster 2024-08-31T02:14:46.734788+0000 mgr.a (mgr.14388) 151 : cluster [DBG] pgmap v105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:14:49.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:48 smithi163 bash[24253]: cluster 2024-08-31T02:14:48.736720+0000 mgr.a (mgr.14388) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:14:49.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:48 smithi027 bash[22610]: cluster 2024-08-31T02:14:48.736720+0000 mgr.a (mgr.14388) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:14:49.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:48 smithi191 bash[24992]: cluster 2024-08-31T02:14:48.736720+0000 mgr.a (mgr.14388) 152 : cluster [DBG] pgmap v106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:14:49.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:14:49.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:14:49.359 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:14:50.092 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:14:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:14:50.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:14:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:14:50.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:14:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:49 smithi163 bash[24253]: audit 2024-08-31T02:14:49.692906+0000 mgr.a (mgr.14388) 153 : audit [DBG] from='client.17292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:50.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:49 smithi027 bash[22610]: audit 2024-08-31T02:14:49.692906+0000 mgr.a (mgr.14388) 153 : audit [DBG] from='client.17292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:50.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:49 smithi191 bash[24992]: audit 2024-08-31T02:14:49.692906+0000 mgr.a (mgr.14388) 153 : audit [DBG] from='client.17292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:51.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:50 smithi163 bash[24253]: cluster 2024-08-31T02:14:50.737609+0000 mgr.a (mgr.14388) 154 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:51.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:50 smithi027 bash[22610]: cluster 2024-08-31T02:14:50.737609+0000 mgr.a (mgr.14388) 154 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:51.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:50 smithi191 bash[24992]: cluster 2024-08-31T02:14:50.737609+0000 mgr.a (mgr.14388) 154 : cluster [DBG] pgmap v107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:53.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:52 smithi163 bash[24253]: cluster 2024-08-31T02:14:52.738408+0000 mgr.a (mgr.14388) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:53.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:52 smithi027 bash[22610]: cluster 2024-08-31T02:14:52.738408+0000 mgr.a (mgr.14388) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:53.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:52 smithi191 bash[24992]: cluster 2024-08-31T02:14:52.738408+0000 mgr.a (mgr.14388) 155 : cluster [DBG] pgmap v108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:55.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:14:55.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:14:55.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:14:55.849 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:14:55.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:14:55.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:14:55.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:14:55.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:14:56.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:55 smithi163 bash[24253]: cluster 2024-08-31T02:14:54.740582+0000 mgr.a (mgr.14388) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:56.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:55 smithi163 bash[24253]: audit 2024-08-31T02:14:55.432051+0000 mgr.a (mgr.14388) 157 : audit [DBG] from='client.17370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:56.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:55 smithi027 bash[22610]: cluster 2024-08-31T02:14:54.740582+0000 mgr.a (mgr.14388) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:56.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:55 smithi027 bash[22610]: audit 2024-08-31T02:14:55.432051+0000 mgr.a (mgr.14388) 157 : audit [DBG] from='client.17370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:56.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:55 smithi191 bash[24992]: cluster 2024-08-31T02:14:54.740582+0000 mgr.a (mgr.14388) 156 : cluster [DBG] pgmap v109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:14:56.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:55 smithi191 bash[24992]: audit 2024-08-31T02:14:55.432051+0000 mgr.a (mgr.14388) 157 : audit [DBG] from='client.17370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:14:58.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:57 smithi163 bash[24253]: cluster 2024-08-31T02:14:56.741455+0000 mgr.a (mgr.14388) 158 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:58.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:57 smithi027 bash[22610]: cluster 2024-08-31T02:14:56.741455+0000 mgr.a (mgr.14388) 158 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:14:58.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:57 smithi191 bash[24992]: cluster 2024-08-31T02:14:56.741455+0000 mgr.a (mgr.14388) 158 : cluster [DBG] pgmap v110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:00.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:14:59 smithi163 bash[24253]: cluster 2024-08-31T02:14:58.743665+0000 mgr.a (mgr.14388) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:00.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:14:59 smithi027 bash[22610]: cluster 2024-08-31T02:14:58.743665+0000 mgr.a (mgr.14388) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:00.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:14:59 smithi191 bash[24992]: cluster 2024-08-31T02:14:58.743665+0000 mgr.a (mgr.14388) 159 : cluster [DBG] pgmap v111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:00.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:00.851 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:00.851 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:01.605 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:01.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:02.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:01 smithi163 bash[24253]: cluster 2024-08-31T02:15:00.744376+0000 mgr.a (mgr.14388) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:02.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:01 smithi163 bash[24253]: audit 2024-08-31T02:15:01.188745+0000 mgr.a (mgr.14388) 161 : audit [DBG] from='client.17448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:02.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:01 smithi027 bash[22610]: cluster 2024-08-31T02:15:00.744376+0000 mgr.a (mgr.14388) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:02.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:01 smithi027 bash[22610]: audit 2024-08-31T02:15:01.188745+0000 mgr.a (mgr.14388) 161 : audit [DBG] from='client.17448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:02.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:01 smithi191 bash[24992]: cluster 2024-08-31T02:15:00.744376+0000 mgr.a (mgr.14388) 160 : cluster [DBG] pgmap v112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:02.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:01 smithi191 bash[24992]: audit 2024-08-31T02:15:01.188745+0000 mgr.a (mgr.14388) 161 : audit [DBG] from='client.17448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:04.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:03 smithi027 bash[22610]: cluster 2024-08-31T02:15:02.745258+0000 mgr.a (mgr.14388) 162 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:04.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:03 smithi191 bash[24992]: cluster 2024-08-31T02:15:02.745258+0000 mgr.a (mgr.14388) 162 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:04.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:03 smithi163 bash[24253]: cluster 2024-08-31T02:15:02.745258+0000 mgr.a (mgr.14388) 162 : cluster [DBG] pgmap v113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:06.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:05 smithi027 bash[22610]: cluster 2024-08-31T02:15:04.747594+0000 mgr.a (mgr.14388) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:06.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:05 smithi191 bash[24992]: cluster 2024-08-31T02:15:04.747594+0000 mgr.a (mgr.14388) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:06.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:05 smithi163 bash[24253]: cluster 2024-08-31T02:15:04.747594+0000 mgr.a (mgr.14388) 163 : cluster [DBG] pgmap v114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:06.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:06.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:07.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:07.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:07.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:07.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:07.365 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:08.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:07 smithi191 bash[24992]: cluster 2024-08-31T02:15:06.748157+0000 mgr.a (mgr.14388) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:08.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:07 smithi191 bash[24992]: audit 2024-08-31T02:15:06.946963+0000 mgr.a (mgr.14388) 165 : audit [DBG] from='client.17523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:08.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:07 smithi163 bash[24253]: cluster 2024-08-31T02:15:06.748157+0000 mgr.a (mgr.14388) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:08.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:07 smithi163 bash[24253]: audit 2024-08-31T02:15:06.946963+0000 mgr.a (mgr.14388) 165 : audit [DBG] from='client.17523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:08.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:07 smithi027 bash[22610]: cluster 2024-08-31T02:15:06.748157+0000 mgr.a (mgr.14388) 164 : cluster [DBG] pgmap v115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:08.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:07 smithi027 bash[22610]: audit 2024-08-31T02:15:06.946963+0000 mgr.a (mgr.14388) 165 : audit [DBG] from='client.17523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:10.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:09 smithi191 bash[24992]: cluster 2024-08-31T02:15:08.750510+0000 mgr.a (mgr.14388) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:10.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:09 smithi163 bash[24253]: cluster 2024-08-31T02:15:08.750510+0000 mgr.a (mgr.14388) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:10.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:09 smithi027 bash[22610]: cluster 2024-08-31T02:15:08.750510+0000 mgr.a (mgr.14388) 166 : cluster [DBG] pgmap v116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:12.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:11 smithi191 bash[24992]: cluster 2024-08-31T02:15:10.751451+0000 mgr.a (mgr.14388) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:12.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:12.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:12.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:12.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:11 smithi163 bash[24253]: cluster 2024-08-31T02:15:10.751451+0000 mgr.a (mgr.14388) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:12.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:11 smithi027 bash[22610]: cluster 2024-08-31T02:15:10.751451+0000 mgr.a (mgr.14388) 167 : cluster [DBG] pgmap v117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:13.105 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:13.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:13.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:13.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:13.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:13.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:13 smithi191 bash[24992]: audit 2024-08-31T02:15:12.706366+0000 mgr.a (mgr.14388) 168 : audit [DBG] from='client.17601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:13.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:13 smithi163 bash[24253]: audit 2024-08-31T02:15:12.706366+0000 mgr.a (mgr.14388) 168 : audit [DBG] from='client.17601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:13.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:13 smithi027 bash[22610]: audit 2024-08-31T02:15:12.706366+0000 mgr.a (mgr.14388) 168 : audit [DBG] from='client.17601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:14.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:14 smithi191 bash[24992]: cluster 2024-08-31T02:15:12.752539+0000 mgr.a (mgr.14388) 169 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:14.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:14 smithi163 bash[24253]: cluster 2024-08-31T02:15:12.752539+0000 mgr.a (mgr.14388) 169 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:14.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:14 smithi027 bash[22610]: cluster 2024-08-31T02:15:12.752539+0000 mgr.a (mgr.14388) 169 : cluster [DBG] pgmap v118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:16.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:16 smithi191 bash[24992]: cluster 2024-08-31T02:15:14.755319+0000 mgr.a (mgr.14388) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:16.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:16 smithi163 bash[24253]: cluster 2024-08-31T02:15:14.755319+0000 mgr.a (mgr.14388) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:16.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:16 smithi027 bash[22610]: cluster 2024-08-31T02:15:14.755319+0000 mgr.a (mgr.14388) 170 : cluster [DBG] pgmap v119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:18.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:18.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:18.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:18.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:18 smithi191 bash[24992]: cluster 2024-08-31T02:15:16.756236+0000 mgr.a (mgr.14388) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:15:18.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:18 smithi163 bash[24253]: cluster 2024-08-31T02:15:16.756236+0000 mgr.a (mgr.14388) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:15:18.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:18 smithi027 bash[22610]: cluster 2024-08-31T02:15:16.756236+0000 mgr.a (mgr.14388) 171 : cluster [DBG] pgmap v120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:15:18.859 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:18.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:18.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:18.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:18.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:19.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:19 smithi191 bash[24992]: audit 2024-08-31T02:15:18.445169+0000 mgr.a (mgr.14388) 172 : audit [DBG] from='client.17679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:19.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:19 smithi163 bash[24253]: audit 2024-08-31T02:15:18.445169+0000 mgr.a (mgr.14388) 172 : audit [DBG] from='client.17679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:19.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:19 smithi027 bash[22610]: audit 2024-08-31T02:15:18.445169+0000 mgr.a (mgr.14388) 172 : audit [DBG] from='client.17679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:20.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:20 smithi191 bash[24992]: cluster 2024-08-31T02:15:18.757642+0000 mgr.a (mgr.14388) 173 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:20.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:20 smithi163 bash[24253]: cluster 2024-08-31T02:15:18.757642+0000 mgr.a (mgr.14388) 173 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:20.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:20 smithi027 bash[22610]: cluster 2024-08-31T02:15:18.757642+0000 mgr.a (mgr.14388) 173 : cluster [DBG] pgmap v121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:22.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:22 smithi191 bash[24992]: cluster 2024-08-31T02:15:20.758516+0000 mgr.a (mgr.14388) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:15:22.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:22 smithi163 bash[24253]: cluster 2024-08-31T02:15:20.758516+0000 mgr.a (mgr.14388) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:15:22.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:22 smithi027 bash[22610]: cluster 2024-08-31T02:15:20.758516+0000 mgr.a (mgr.14388) 174 : cluster [DBG] pgmap v122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:15:23.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:24.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:24 smithi191 bash[24992]: cluster 2024-08-31T02:15:22.759380+0000 mgr.a (mgr.14388) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:15:24.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:24 smithi163 bash[24253]: cluster 2024-08-31T02:15:22.759380+0000 mgr.a (mgr.14388) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:15:24.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:24 smithi027 bash[22610]: cluster 2024-08-31T02:15:22.759380+0000 mgr.a (mgr.14388) 175 : cluster [DBG] pgmap v123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:15:24.610 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:24.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:24.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:24.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:24.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:25.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:25 smithi191 bash[24992]: audit 2024-08-31T02:15:24.205328+0000 mgr.a (mgr.14388) 176 : audit [DBG] from='client.17757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:25.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:25 smithi163 bash[24253]: audit 2024-08-31T02:15:24.205328+0000 mgr.a (mgr.14388) 176 : audit [DBG] from='client.17757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:25.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:25 smithi027 bash[22610]: audit 2024-08-31T02:15:24.205328+0000 mgr.a (mgr.14388) 176 : audit [DBG] from='client.17757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:26.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:26 smithi163 bash[24253]: cluster 2024-08-31T02:15:24.762111+0000 mgr.a (mgr.14388) 177 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:26.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:26 smithi027 bash[22610]: cluster 2024-08-31T02:15:24.762111+0000 mgr.a (mgr.14388) 177 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:26.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:26 smithi191 bash[24992]: cluster 2024-08-31T02:15:24.762111+0000 mgr.a (mgr.14388) 177 : cluster [DBG] pgmap v124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:28.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:28 smithi163 bash[24253]: cluster 2024-08-31T02:15:26.762960+0000 mgr.a (mgr.14388) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:28.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:28 smithi027 bash[22610]: cluster 2024-08-31T02:15:26.762960+0000 mgr.a (mgr.14388) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:28.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:28 smithi191 bash[24992]: cluster 2024-08-31T02:15:26.762960+0000 mgr.a (mgr.14388) 178 : cluster [DBG] pgmap v125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:29.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:29.613 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:29.613 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:30.381 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:30.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:30.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:30.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:30.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:30.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:30 smithi163 bash[24253]: cluster 2024-08-31T02:15:28.764930+0000 mgr.a (mgr.14388) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:30.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:30 smithi027 bash[22610]: cluster 2024-08-31T02:15:28.764930+0000 mgr.a (mgr.14388) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:30.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:30 smithi191 bash[24992]: cluster 2024-08-31T02:15:28.764930+0000 mgr.a (mgr.14388) 179 : cluster [DBG] pgmap v126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:31.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:31 smithi163 bash[24253]: audit 2024-08-31T02:15:29.953750+0000 mgr.a (mgr.14388) 180 : audit [DBG] from='client.17835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:31.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:31 smithi163 bash[24253]: audit 2024-08-31T02:15:30.910841+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:15:31.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:31 smithi027 bash[22610]: audit 2024-08-31T02:15:29.953750+0000 mgr.a (mgr.14388) 180 : audit [DBG] from='client.17835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:31.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:31 smithi027 bash[22610]: audit 2024-08-31T02:15:30.910841+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:15:31.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:31 smithi191 bash[24992]: audit 2024-08-31T02:15:29.953750+0000 mgr.a (mgr.14388) 180 : audit [DBG] from='client.17835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:31.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:31 smithi191 bash[24992]: audit 2024-08-31T02:15:30.910841+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:15:32.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:32 smithi163 bash[24253]: cluster 2024-08-31T02:15:30.765877+0000 mgr.a (mgr.14388) 181 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:32.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:32 smithi163 bash[24253]: audit 2024-08-31T02:15:31.752357+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:15:32.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:32 smithi163 bash[24253]: audit 2024-08-31T02:15:31.754006+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:15:32.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:32 smithi163 bash[24253]: audit 2024-08-31T02:15:31.764011+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:15:32.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:32 smithi163 bash[24253]: audit 2024-08-31T02:15:31.768931+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:15:32.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:32 smithi027 bash[22610]: cluster 2024-08-31T02:15:30.765877+0000 mgr.a (mgr.14388) 181 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:32.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:32 smithi027 bash[22610]: audit 2024-08-31T02:15:31.752357+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:15:32.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:32 smithi027 bash[22610]: audit 2024-08-31T02:15:31.754006+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:15:32.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:32 smithi027 bash[22610]: audit 2024-08-31T02:15:31.764011+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:15:32.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:32 smithi027 bash[22610]: audit 2024-08-31T02:15:31.768931+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:15:32.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:32 smithi191 bash[24992]: cluster 2024-08-31T02:15:30.765877+0000 mgr.a (mgr.14388) 181 : cluster [DBG] pgmap v127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:32.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:32 smithi191 bash[24992]: audit 2024-08-31T02:15:31.752357+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:15:32.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:32 smithi191 bash[24992]: audit 2024-08-31T02:15:31.754006+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:15:32.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:32 smithi191 bash[24992]: audit 2024-08-31T02:15:31.764011+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:15:32.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:32 smithi191 bash[24992]: audit 2024-08-31T02:15:31.768931+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:15:32.978 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:15:32 smithi027 bash[22863]: debug 2024-08-31T02:15:32.494+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:15:32.978 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:15:32 smithi027 bash[22863]: debug 2024-08-31T02:15:32.494+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:15:33.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:33 smithi163 bash[24253]: audit 2024-08-31T02:15:31.771363+0000 mgr.a (mgr.14388) 182 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:15:33.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:33 smithi163 bash[24253]: audit 2024-08-31T02:15:32.497284+0000 mgr.a (mgr.14388) 183 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:15:33.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:33 smithi163 bash[24253]: cephadm 2024-08-31T02:15:32.498694+0000 mgr.a (mgr.14388) 184 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:15:33.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:33 smithi027 bash[22610]: audit 2024-08-31T02:15:31.771363+0000 mgr.a (mgr.14388) 182 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:15:33.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:33 smithi027 bash[22610]: audit 2024-08-31T02:15:32.497284+0000 mgr.a (mgr.14388) 183 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:15:33.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:33 smithi027 bash[22610]: cephadm 2024-08-31T02:15:32.498694+0000 mgr.a (mgr.14388) 184 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:15:33.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:33 smithi191 bash[24992]: audit 2024-08-31T02:15:31.771363+0000 mgr.a (mgr.14388) 182 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:15:33.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:33 smithi191 bash[24992]: audit 2024-08-31T02:15:32.497284+0000 mgr.a (mgr.14388) 183 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:15:33.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:33 smithi191 bash[24992]: cephadm 2024-08-31T02:15:32.498694+0000 mgr.a (mgr.14388) 184 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:15:34.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:34 smithi163 bash[24253]: cluster 2024-08-31T02:15:32.766816+0000 mgr.a (mgr.14388) 185 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:34.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:34 smithi027 bash[22610]: cluster 2024-08-31T02:15:32.766816+0000 mgr.a (mgr.14388) 185 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:34.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:34 smithi191 bash[24992]: cluster 2024-08-31T02:15:32.766816+0000 mgr.a (mgr.14388) 185 : cluster [DBG] pgmap v128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:35.383 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:36.121 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:36.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:36.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:36.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:36.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:36.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:36 smithi163 bash[24253]: cluster 2024-08-31T02:15:34.768994+0000 mgr.a (mgr.14388) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:36.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:36 smithi163 bash[24253]: audit 2024-08-31T02:15:35.710664+0000 mgr.a (mgr.14388) 187 : audit [DBG] from='client.18012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:36.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:36 smithi027 bash[22610]: cluster 2024-08-31T02:15:34.768994+0000 mgr.a (mgr.14388) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:36.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:36 smithi027 bash[22610]: audit 2024-08-31T02:15:35.710664+0000 mgr.a (mgr.14388) 187 : audit [DBG] from='client.18012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:36.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:36 smithi191 bash[24992]: cluster 2024-08-31T02:15:34.768994+0000 mgr.a (mgr.14388) 186 : cluster [DBG] pgmap v129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:36.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:36 smithi191 bash[24992]: audit 2024-08-31T02:15:35.710664+0000 mgr.a (mgr.14388) 187 : audit [DBG] from='client.18012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:38.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:38 smithi163 bash[24253]: cluster 2024-08-31T02:15:36.769967+0000 mgr.a (mgr.14388) 188 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:38.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:38 smithi027 bash[22610]: cluster 2024-08-31T02:15:36.769967+0000 mgr.a (mgr.14388) 188 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:38.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:38 smithi191 bash[24992]: cluster 2024-08-31T02:15:36.769967+0000 mgr.a (mgr.14388) 188 : cluster [DBG] pgmap v130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:40.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:40 smithi163 bash[24253]: cluster 2024-08-31T02:15:38.772276+0000 mgr.a (mgr.14388) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:40.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:40 smithi027 bash[22610]: cluster 2024-08-31T02:15:38.772276+0000 mgr.a (mgr.14388) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:40.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:40 smithi191 bash[24992]: cluster 2024-08-31T02:15:38.772276+0000 mgr.a (mgr.14388) 189 : cluster [DBG] pgmap v131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:41.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:41.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:41.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:41.863 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:41.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:41.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:41.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:41.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:42.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:42 smithi163 bash[24253]: cluster 2024-08-31T02:15:40.773036+0000 mgr.a (mgr.14388) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:42.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:42 smithi163 bash[24253]: audit 2024-08-31T02:15:41.456115+0000 mgr.a (mgr.14388) 191 : audit [DBG] from='client.18090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:42.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:42 smithi027 bash[22610]: cluster 2024-08-31T02:15:40.773036+0000 mgr.a (mgr.14388) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:42.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:42 smithi027 bash[22610]: audit 2024-08-31T02:15:41.456115+0000 mgr.a (mgr.14388) 191 : audit [DBG] from='client.18090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:42.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:42 smithi191 bash[24992]: cluster 2024-08-31T02:15:40.773036+0000 mgr.a (mgr.14388) 190 : cluster [DBG] pgmap v132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:42.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:42 smithi191 bash[24992]: audit 2024-08-31T02:15:41.456115+0000 mgr.a (mgr.14388) 191 : audit [DBG] from='client.18090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:44.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:44 smithi163 bash[24253]: cluster 2024-08-31T02:15:42.773991+0000 mgr.a (mgr.14388) 192 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:44.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:44 smithi027 bash[22610]: cluster 2024-08-31T02:15:42.773991+0000 mgr.a (mgr.14388) 192 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:44.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:44 smithi191 bash[24992]: cluster 2024-08-31T02:15:42.773991+0000 mgr.a (mgr.14388) 192 : cluster [DBG] pgmap v133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:46.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:46 smithi163 bash[24253]: cluster 2024-08-31T02:15:44.776242+0000 mgr.a (mgr.14388) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:46.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:46 smithi027 bash[22610]: cluster 2024-08-31T02:15:44.776242+0000 mgr.a (mgr.14388) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:46.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:46 smithi191 bash[24992]: cluster 2024-08-31T02:15:44.776242+0000 mgr.a (mgr.14388) 193 : cluster [DBG] pgmap v134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:15:46.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:46.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:46.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:47.637 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:47.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:47.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:47.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:47.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:48.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:48 smithi163 bash[24253]: cluster 2024-08-31T02:15:46.777136+0000 mgr.a (mgr.14388) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:48.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:48 smithi163 bash[24253]: audit 2024-08-31T02:15:47.209849+0000 mgr.a (mgr.14388) 195 : audit [DBG] from='client.18165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:48.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:48 smithi027 bash[22610]: cluster 2024-08-31T02:15:46.777136+0000 mgr.a (mgr.14388) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:48.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:48 smithi027 bash[22610]: audit 2024-08-31T02:15:47.209849+0000 mgr.a (mgr.14388) 195 : audit [DBG] from='client.18165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:48.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:48 smithi191 bash[24992]: cluster 2024-08-31T02:15:46.777136+0000 mgr.a (mgr.14388) 194 : cluster [DBG] pgmap v135: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:48.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:48 smithi191 bash[24992]: audit 2024-08-31T02:15:47.209849+0000 mgr.a (mgr.14388) 195 : audit [DBG] from='client.18165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:50.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:50 smithi163 bash[24253]: cluster 2024-08-31T02:15:48.779707+0000 mgr.a (mgr.14388) 196 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:50.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:50 smithi027 bash[22610]: cluster 2024-08-31T02:15:48.779707+0000 mgr.a (mgr.14388) 196 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:50.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:50 smithi191 bash[24992]: cluster 2024-08-31T02:15:48.779707+0000 mgr.a (mgr.14388) 196 : cluster [DBG] pgmap v136: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:15:52.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:52 smithi163 bash[24253]: cluster 2024-08-31T02:15:50.780538+0000 mgr.a (mgr.14388) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:52.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:52 smithi027 bash[22610]: cluster 2024-08-31T02:15:50.780538+0000 mgr.a (mgr.14388) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:52.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:52 smithi191 bash[24992]: cluster 2024-08-31T02:15:50.780538+0000 mgr.a (mgr.14388) 197 : cluster [DBG] pgmap v137: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:52.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:52.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:52.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:53.376 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:53.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:53.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:54.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:54 smithi163 bash[24253]: cluster 2024-08-31T02:15:52.781014+0000 mgr.a (mgr.14388) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:54.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:54 smithi163 bash[24253]: audit 2024-08-31T02:15:52.979912+0000 mgr.a (mgr.14388) 199 : audit [DBG] from='client.18243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:54.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:54 smithi027 bash[22610]: cluster 2024-08-31T02:15:52.781014+0000 mgr.a (mgr.14388) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:54.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:54 smithi027 bash[22610]: audit 2024-08-31T02:15:52.979912+0000 mgr.a (mgr.14388) 199 : audit [DBG] from='client.18243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:54.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:54 smithi191 bash[24992]: cluster 2024-08-31T02:15:52.781014+0000 mgr.a (mgr.14388) 198 : cluster [DBG] pgmap v138: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:54.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:54 smithi191 bash[24992]: audit 2024-08-31T02:15:52.979912+0000 mgr.a (mgr.14388) 199 : audit [DBG] from='client.18243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:56.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:56 smithi163 bash[24253]: cluster 2024-08-31T02:15:54.783743+0000 mgr.a (mgr.14388) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:56.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:56 smithi027 bash[22610]: cluster 2024-08-31T02:15:54.783743+0000 mgr.a (mgr.14388) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:56.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:56 smithi191 bash[24992]: cluster 2024-08-31T02:15:54.783743+0000 mgr.a (mgr.14388) 200 : cluster [DBG] pgmap v139: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:15:58.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:15:58.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:15:58.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:15:58.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:58 smithi163 bash[24253]: cluster 2024-08-31T02:15:56.784624+0000 mgr.a (mgr.14388) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:15:58.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:58 smithi027 bash[22610]: cluster 2024-08-31T02:15:56.784624+0000 mgr.a (mgr.14388) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:15:58.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:58 smithi191 bash[24992]: cluster 2024-08-31T02:15:56.784624+0000 mgr.a (mgr.14388) 201 : cluster [DBG] pgmap v140: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:15:59.115 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:15:59.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:15:59.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:15:59.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:15:59.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:15:59.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:15:59 smithi163 bash[24253]: audit 2024-08-31T02:15:58.716313+0000 mgr.a (mgr.14388) 202 : audit [DBG] from='client.18321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:59.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:15:59 smithi027 bash[22610]: audit 2024-08-31T02:15:58.716313+0000 mgr.a (mgr.14388) 202 : audit [DBG] from='client.18321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:15:59.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:15:59 smithi191 bash[24992]: audit 2024-08-31T02:15:58.716313+0000 mgr.a (mgr.14388) 202 : audit [DBG] from='client.18321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:00.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:00 smithi163 bash[24253]: cluster 2024-08-31T02:15:58.785948+0000 mgr.a (mgr.14388) 203 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:00.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:00 smithi027 bash[22610]: cluster 2024-08-31T02:15:58.785948+0000 mgr.a (mgr.14388) 203 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:00.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:00 smithi191 bash[24992]: cluster 2024-08-31T02:15:58.785948+0000 mgr.a (mgr.14388) 203 : cluster [DBG] pgmap v141: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:02.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:02 smithi163 bash[24253]: cluster 2024-08-31T02:16:00.786858+0000 mgr.a (mgr.14388) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:16:02.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:02 smithi027 bash[22610]: cluster 2024-08-31T02:16:00.786858+0000 mgr.a (mgr.14388) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:16:02.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:02 smithi191 bash[24992]: cluster 2024-08-31T02:16:00.786858+0000 mgr.a (mgr.14388) 204 : cluster [DBG] pgmap v142: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:16:04.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:16:04.118 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:16:04.118 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:16:04.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:04 smithi163 bash[24253]: cluster 2024-08-31T02:16:02.787650+0000 mgr.a (mgr.14388) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:16:04.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:04 smithi027 bash[22610]: cluster 2024-08-31T02:16:02.787650+0000 mgr.a (mgr.14388) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:16:04.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:04 smithi191 bash[24992]: cluster 2024-08-31T02:16:02.787650+0000 mgr.a (mgr.14388) 205 : cluster [DBG] pgmap v143: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:16:04.859 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:16:04.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:16:04.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:16:04.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:16:04.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:16:05.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:05 smithi163 bash[24253]: audit 2024-08-31T02:16:04.458962+0000 mgr.a (mgr.14388) 206 : audit [DBG] from='client.18399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:05.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:05 smithi027 bash[22610]: audit 2024-08-31T02:16:04.458962+0000 mgr.a (mgr.14388) 206 : audit [DBG] from='client.18399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:05.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:05 smithi191 bash[24992]: audit 2024-08-31T02:16:04.458962+0000 mgr.a (mgr.14388) 206 : audit [DBG] from='client.18399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:06.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:06 smithi163 bash[24253]: cluster 2024-08-31T02:16:04.788901+0000 mgr.a (mgr.14388) 207 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:06.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:06 smithi027 bash[22610]: cluster 2024-08-31T02:16:04.788901+0000 mgr.a (mgr.14388) 207 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:06.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:06 smithi191 bash[24992]: cluster 2024-08-31T02:16:04.788901+0000 mgr.a (mgr.14388) 207 : cluster [DBG] pgmap v144: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:08.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:08 smithi163 bash[24253]: cluster 2024-08-31T02:16:06.789778+0000 mgr.a (mgr.14388) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:08.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:08 smithi027 bash[22610]: cluster 2024-08-31T02:16:06.789778+0000 mgr.a (mgr.14388) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:08.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:08 smithi191 bash[24992]: cluster 2024-08-31T02:16:06.789778+0000 mgr.a (mgr.14388) 208 : cluster [DBG] pgmap v145: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:09.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:16:09.861 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:16:09.861 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:16:10.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:10 smithi163 bash[24253]: cluster 2024-08-31T02:16:08.791791+0000 mgr.a (mgr.14388) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:10.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:10 smithi027 bash[22610]: cluster 2024-08-31T02:16:08.791791+0000 mgr.a (mgr.14388) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:10.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:10 smithi191 bash[24992]: cluster 2024-08-31T02:16:08.791791+0000 mgr.a (mgr.14388) 209 : cluster [DBG] pgmap v146: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:10.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:16:10.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:16:10.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:16:10.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:16:10.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:16:11.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:11 smithi163 bash[24253]: audit 2024-08-31T02:16:10.200433+0000 mgr.a (mgr.14388) 210 : audit [DBG] from='client.18474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:11.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:11 smithi027 bash[22610]: audit 2024-08-31T02:16:10.200433+0000 mgr.a (mgr.14388) 210 : audit [DBG] from='client.18474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:11.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:11 smithi191 bash[24992]: audit 2024-08-31T02:16:10.200433+0000 mgr.a (mgr.14388) 210 : audit [DBG] from='client.18474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:12.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:12 smithi163 bash[24253]: cluster 2024-08-31T02:16:10.792725+0000 mgr.a (mgr.14388) 211 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:12.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:12 smithi027 bash[22610]: cluster 2024-08-31T02:16:10.792725+0000 mgr.a (mgr.14388) 211 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:12.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:12 smithi191 bash[24992]: cluster 2024-08-31T02:16:10.792725+0000 mgr.a (mgr.14388) 211 : cluster [DBG] pgmap v147: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:14.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:14 smithi163 bash[24253]: cluster 2024-08-31T02:16:12.793492+0000 mgr.a (mgr.14388) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:14.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:14 smithi027 bash[22610]: cluster 2024-08-31T02:16:12.793492+0000 mgr.a (mgr.14388) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:14.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:14 smithi191 bash[24992]: cluster 2024-08-31T02:16:12.793492+0000 mgr.a (mgr.14388) 212 : cluster [DBG] pgmap v148: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:15.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:16:15.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:16:15.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:16:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:16:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:16:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:16:16.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:16:16.341 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:16:16.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:16 smithi163 bash[24253]: cluster 2024-08-31T02:16:14.795718+0000 mgr.a (mgr.14388) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:16.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:16 smithi027 bash[22610]: cluster 2024-08-31T02:16:14.795718+0000 mgr.a (mgr.14388) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:16.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:16 smithi191 bash[24992]: cluster 2024-08-31T02:16:14.795718+0000 mgr.a (mgr.14388) 213 : cluster [DBG] pgmap v149: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:17.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:17 smithi163 bash[24253]: audit 2024-08-31T02:16:15.939488+0000 mgr.a (mgr.14388) 214 : audit [DBG] from='client.18552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:17.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:17 smithi027 bash[22610]: audit 2024-08-31T02:16:15.939488+0000 mgr.a (mgr.14388) 214 : audit [DBG] from='client.18552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:17.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:17 smithi191 bash[24992]: audit 2024-08-31T02:16:15.939488+0000 mgr.a (mgr.14388) 214 : audit [DBG] from='client.18552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:18.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:18 smithi163 bash[24253]: cluster 2024-08-31T02:16:16.796782+0000 mgr.a (mgr.14388) 215 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:18.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:18 smithi027 bash[22610]: cluster 2024-08-31T02:16:16.796782+0000 mgr.a (mgr.14388) 215 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:18.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:18 smithi191 bash[24992]: cluster 2024-08-31T02:16:16.796782+0000 mgr.a (mgr.14388) 215 : cluster [DBG] pgmap v150: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:20.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:20 smithi163 bash[24253]: cluster 2024-08-31T02:16:18.799168+0000 mgr.a (mgr.14388) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:20.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:20 smithi027 bash[22610]: cluster 2024-08-31T02:16:18.799168+0000 mgr.a (mgr.14388) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:20.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:20 smithi191 bash[24992]: cluster 2024-08-31T02:16:18.799168+0000 mgr.a (mgr.14388) 216 : cluster [DBG] pgmap v151: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:21.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:16:21.342 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:16:21.342 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:16:22.070 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:16:22.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:16:22.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:16:22.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:16:22.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:16:22.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:22 smithi163 bash[24253]: cluster 2024-08-31T02:16:20.799966+0000 mgr.a (mgr.14388) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:22.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:22 smithi163 bash[24253]: audit 2024-08-31T02:16:21.676967+0000 mgr.a (mgr.14388) 218 : audit [DBG] from='client.18630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:22.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:22 smithi027 bash[22610]: cluster 2024-08-31T02:16:20.799966+0000 mgr.a (mgr.14388) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:22.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:22 smithi027 bash[22610]: audit 2024-08-31T02:16:21.676967+0000 mgr.a (mgr.14388) 218 : audit [DBG] from='client.18630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:22.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:22 smithi191 bash[24992]: cluster 2024-08-31T02:16:20.799966+0000 mgr.a (mgr.14388) 217 : cluster [DBG] pgmap v152: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:22.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:22 smithi191 bash[24992]: audit 2024-08-31T02:16:21.676967+0000 mgr.a (mgr.14388) 218 : audit [DBG] from='client.18630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:24.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:24 smithi027 bash[22610]: cluster 2024-08-31T02:16:22.801027+0000 mgr.a (mgr.14388) 219 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:24.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:24 smithi191 bash[24992]: cluster 2024-08-31T02:16:22.801027+0000 mgr.a (mgr.14388) 219 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:24.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:24 smithi163 bash[24253]: cluster 2024-08-31T02:16:22.801027+0000 mgr.a (mgr.14388) 219 : cluster [DBG] pgmap v153: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:26.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:26 smithi027 bash[22610]: cluster 2024-08-31T02:16:24.803304+0000 mgr.a (mgr.14388) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:26.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:26 smithi191 bash[24992]: cluster 2024-08-31T02:16:24.803304+0000 mgr.a (mgr.14388) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:26.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:26 smithi163 bash[24253]: cluster 2024-08-31T02:16:24.803304+0000 mgr.a (mgr.14388) 220 : cluster [DBG] pgmap v154: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:16:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:16:27.072 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:16:27.808 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:16:27.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:16:27.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:16:27.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:16:27.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:16:28.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:28 smithi027 bash[22610]: cluster 2024-08-31T02:16:26.804068+0000 mgr.a (mgr.14388) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:28.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:28 smithi027 bash[22610]: audit 2024-08-31T02:16:27.406318+0000 mgr.a (mgr.14388) 222 : audit [DBG] from='client.18708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:28.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:28 smithi191 bash[24992]: cluster 2024-08-31T02:16:26.804068+0000 mgr.a (mgr.14388) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:28.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:28 smithi191 bash[24992]: audit 2024-08-31T02:16:27.406318+0000 mgr.a (mgr.14388) 222 : audit [DBG] from='client.18708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:28.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:28 smithi163 bash[24253]: cluster 2024-08-31T02:16:26.804068+0000 mgr.a (mgr.14388) 221 : cluster [DBG] pgmap v155: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:28.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:28 smithi163 bash[24253]: audit 2024-08-31T02:16:27.406318+0000 mgr.a (mgr.14388) 222 : audit [DBG] from='client.18708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:30.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:30 smithi027 bash[22610]: cluster 2024-08-31T02:16:28.806476+0000 mgr.a (mgr.14388) 223 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:30.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:30 smithi191 bash[24992]: cluster 2024-08-31T02:16:28.806476+0000 mgr.a (mgr.14388) 223 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:30.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:30 smithi163 bash[24253]: cluster 2024-08-31T02:16:28.806476+0000 mgr.a (mgr.14388) 223 : cluster [DBG] pgmap v156: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:32.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:32 smithi027 bash[22610]: cluster 2024-08-31T02:16:30.807255+0000 mgr.a (mgr.14388) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:32.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:32 smithi191 bash[24992]: cluster 2024-08-31T02:16:30.807255+0000 mgr.a (mgr.14388) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:32.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:32 smithi163 bash[24253]: cluster 2024-08-31T02:16:30.807255+0000 mgr.a (mgr.14388) 224 : cluster [DBG] pgmap v157: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:32.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:16:32.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:16:32.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:16:33.477 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:33 smithi027 bash[22610]: audit 2024-08-31T02:16:32.553005+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:16:33.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:33 smithi027 bash[22610]: audit 2024-08-31T02:16:33.189099+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:16:33.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:33 smithi027 bash[22610]: audit 2024-08-31T02:16:33.200082+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:16:33.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:33 smithi191 bash[24992]: audit 2024-08-31T02:16:32.553005+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:16:33.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:33 smithi191 bash[24992]: audit 2024-08-31T02:16:33.189099+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:16:33.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:33 smithi191 bash[24992]: audit 2024-08-31T02:16:33.200082+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:16:33.544 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:16:33.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:16:33.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:16:33.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:16:33.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:16:33.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:33 smithi163 bash[24253]: audit 2024-08-31T02:16:32.553005+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:16:33.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:33 smithi163 bash[24253]: audit 2024-08-31T02:16:33.189099+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:16:33.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:33 smithi163 bash[24253]: audit 2024-08-31T02:16:33.200082+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:16:34.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:34 smithi027 bash[22610]: cluster 2024-08-31T02:16:32.808729+0000 mgr.a (mgr.14388) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:34.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:34 smithi027 bash[22610]: audit 2024-08-31T02:16:33.144969+0000 mgr.a (mgr.14388) 226 : audit [DBG] from='client.18786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:34.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:34 smithi027 bash[22610]: audit 2024-08-31T02:16:33.971106+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:16:34.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:34 smithi027 bash[22610]: audit 2024-08-31T02:16:33.972746+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:16:34.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:34 smithi027 bash[22610]: audit 2024-08-31T02:16:33.982555+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:16:34.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:34 smithi027 bash[22610]: audit 2024-08-31T02:16:33.987439+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:16:34.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:34 smithi191 bash[24992]: cluster 2024-08-31T02:16:32.808729+0000 mgr.a (mgr.14388) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:34.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:34 smithi191 bash[24992]: audit 2024-08-31T02:16:33.144969+0000 mgr.a (mgr.14388) 226 : audit [DBG] from='client.18786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:34.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:34 smithi191 bash[24992]: audit 2024-08-31T02:16:33.971106+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:16:34.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:34 smithi191 bash[24992]: audit 2024-08-31T02:16:33.972746+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:16:34.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:34 smithi191 bash[24992]: audit 2024-08-31T02:16:33.982555+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:16:34.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:34 smithi191 bash[24992]: audit 2024-08-31T02:16:33.987439+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:16:34.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:34 smithi163 bash[24253]: cluster 2024-08-31T02:16:32.808729+0000 mgr.a (mgr.14388) 225 : cluster [DBG] pgmap v158: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:34.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:34 smithi163 bash[24253]: audit 2024-08-31T02:16:33.144969+0000 mgr.a (mgr.14388) 226 : audit [DBG] from='client.18786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:34.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:34 smithi163 bash[24253]: audit 2024-08-31T02:16:33.971106+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:16:34.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:34 smithi163 bash[24253]: audit 2024-08-31T02:16:33.972746+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:16:34.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:34 smithi163 bash[24253]: audit 2024-08-31T02:16:33.982555+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:16:34.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:34 smithi163 bash[24253]: audit 2024-08-31T02:16:33.987439+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:16:34.978 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:16:34 smithi027 bash[22863]: debug 2024-08-31T02:16:34.677+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:16:34.978 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:16:34 smithi027 bash[22863]: debug 2024-08-31T02:16:34.681+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:16:35.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:35 smithi191 bash[24992]: audit 2024-08-31T02:16:33.989802+0000 mgr.a (mgr.14388) 227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:16:35.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:35 smithi191 bash[24992]: audit 2024-08-31T02:16:34.681996+0000 mgr.a (mgr.14388) 228 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:16:35.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:35 smithi191 bash[24992]: cephadm 2024-08-31T02:16:34.683418+0000 mgr.a (mgr.14388) 229 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:16:35.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:35 smithi163 bash[24253]: audit 2024-08-31T02:16:33.989802+0000 mgr.a (mgr.14388) 227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:16:35.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:35 smithi163 bash[24253]: audit 2024-08-31T02:16:34.681996+0000 mgr.a (mgr.14388) 228 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:16:35.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:35 smithi163 bash[24253]: cephadm 2024-08-31T02:16:34.683418+0000 mgr.a (mgr.14388) 229 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:16:35.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:35 smithi027 bash[22610]: audit 2024-08-31T02:16:33.989802+0000 mgr.a (mgr.14388) 227 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:16:35.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:35 smithi027 bash[22610]: audit 2024-08-31T02:16:34.681996+0000 mgr.a (mgr.14388) 228 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:16:35.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:35 smithi027 bash[22610]: cephadm 2024-08-31T02:16:34.683418+0000 mgr.a (mgr.14388) 229 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:16:36.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:36 smithi191 bash[24992]: cluster 2024-08-31T02:16:34.810456+0000 mgr.a (mgr.14388) 230 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:36.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:36 smithi163 bash[24253]: cluster 2024-08-31T02:16:34.810456+0000 mgr.a (mgr.14388) 230 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:36.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:36 smithi027 bash[22610]: cluster 2024-08-31T02:16:34.810456+0000 mgr.a (mgr.14388) 230 : cluster [DBG] pgmap v159: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:38.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:38 smithi191 bash[24992]: cluster 2024-08-31T02:16:36.811239+0000 mgr.a (mgr.14388) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:16:38.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:16:38.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:16:38.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:16:38.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:38 smithi163 bash[24253]: cluster 2024-08-31T02:16:36.811239+0000 mgr.a (mgr.14388) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:16:38.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:38 smithi027 bash[22610]: cluster 2024-08-31T02:16:36.811239+0000 mgr.a (mgr.14388) 231 : cluster [DBG] pgmap v160: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:16:39.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:16:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:16:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:16:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:16:39.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:16:40.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:40 smithi191 bash[24992]: cluster 2024-08-31T02:16:38.813159+0000 mgr.a (mgr.14388) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:40.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:40 smithi191 bash[24992]: audit 2024-08-31T02:16:38.889460+0000 mgr.a (mgr.14388) 233 : audit [DBG] from='client.18969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:40.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:40 smithi163 bash[24253]: cluster 2024-08-31T02:16:38.813159+0000 mgr.a (mgr.14388) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:40.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:40 smithi163 bash[24253]: audit 2024-08-31T02:16:38.889460+0000 mgr.a (mgr.14388) 233 : audit [DBG] from='client.18969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:40.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:40 smithi027 bash[22610]: cluster 2024-08-31T02:16:38.813159+0000 mgr.a (mgr.14388) 232 : cluster [DBG] pgmap v161: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:40.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:40 smithi027 bash[22610]: audit 2024-08-31T02:16:38.889460+0000 mgr.a (mgr.14388) 233 : audit [DBG] from='client.18969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:42.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:42 smithi191 bash[24992]: cluster 2024-08-31T02:16:40.814203+0000 mgr.a (mgr.14388) 234 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:16:42.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:42 smithi163 bash[24253]: cluster 2024-08-31T02:16:40.814203+0000 mgr.a (mgr.14388) 234 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:16:42.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:42 smithi027 bash[22610]: cluster 2024-08-31T02:16:40.814203+0000 mgr.a (mgr.14388) 234 : cluster [DBG] pgmap v162: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:16:44.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:16:44.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:16:44.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:16:44.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:44 smithi191 bash[24992]: cluster 2024-08-31T02:16:42.816308+0000 mgr.a (mgr.14388) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:44.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:44 smithi163 bash[24253]: cluster 2024-08-31T02:16:42.816308+0000 mgr.a (mgr.14388) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:44.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:44 smithi027 bash[22610]: cluster 2024-08-31T02:16:42.816308+0000 mgr.a (mgr.14388) 235 : cluster [DBG] pgmap v163: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:45.066 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:16:45.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:16:45.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:16:45.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:16:45.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:16:45.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:45 smithi191 bash[24992]: audit 2024-08-31T02:16:44.634500+0000 mgr.a (mgr.14388) 236 : audit [DBG] from='client.19047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:45.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:45 smithi163 bash[24253]: audit 2024-08-31T02:16:44.634500+0000 mgr.a (mgr.14388) 236 : audit [DBG] from='client.19047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:45.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:45 smithi027 bash[22610]: audit 2024-08-31T02:16:44.634500+0000 mgr.a (mgr.14388) 236 : audit [DBG] from='client.19047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:46.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:46 smithi191 bash[24992]: cluster 2024-08-31T02:16:44.816862+0000 mgr.a (mgr.14388) 237 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:46.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:46 smithi163 bash[24253]: cluster 2024-08-31T02:16:44.816862+0000 mgr.a (mgr.14388) 237 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:46.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:46 smithi027 bash[22610]: cluster 2024-08-31T02:16:44.816862+0000 mgr.a (mgr.14388) 237 : cluster [DBG] pgmap v164: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:48.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:48 smithi191 bash[24992]: cluster 2024-08-31T02:16:46.817851+0000 mgr.a (mgr.14388) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:48.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:48 smithi163 bash[24253]: cluster 2024-08-31T02:16:46.817851+0000 mgr.a (mgr.14388) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:48.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:48 smithi027 bash[22610]: cluster 2024-08-31T02:16:46.817851+0000 mgr.a (mgr.14388) 238 : cluster [DBG] pgmap v165: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:50.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:16:50.068 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:16:50.069 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:16:50.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:50 smithi191 bash[24992]: cluster 2024-08-31T02:16:48.820229+0000 mgr.a (mgr.14388) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:50.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:50 smithi163 bash[24253]: cluster 2024-08-31T02:16:48.820229+0000 mgr.a (mgr.14388) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:50.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:50 smithi027 bash[22610]: cluster 2024-08-31T02:16:48.820229+0000 mgr.a (mgr.14388) 239 : cluster [DBG] pgmap v166: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:16:50.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:16:50.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:16:50.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:16:50.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:16:50.808 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:16:51.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:51 smithi163 bash[24253]: audit 2024-08-31T02:16:50.399787+0000 mgr.a (mgr.14388) 240 : audit [DBG] from='client.19125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:51.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:51 smithi027 bash[22610]: audit 2024-08-31T02:16:50.399787+0000 mgr.a (mgr.14388) 240 : audit [DBG] from='client.19125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:51.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:51 smithi191 bash[24992]: audit 2024-08-31T02:16:50.399787+0000 mgr.a (mgr.14388) 240 : audit [DBG] from='client.19125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:52.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:52 smithi163 bash[24253]: cluster 2024-08-31T02:16:50.820791+0000 mgr.a (mgr.14388) 241 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:52.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:52 smithi027 bash[22610]: cluster 2024-08-31T02:16:50.820791+0000 mgr.a (mgr.14388) 241 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:52.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:52 smithi191 bash[24992]: cluster 2024-08-31T02:16:50.820791+0000 mgr.a (mgr.14388) 241 : cluster [DBG] pgmap v167: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:54.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:54 smithi163 bash[24253]: cluster 2024-08-31T02:16:52.822909+0000 mgr.a (mgr.14388) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:54.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:54 smithi027 bash[22610]: cluster 2024-08-31T02:16:52.822909+0000 mgr.a (mgr.14388) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:54.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:54 smithi191 bash[24992]: cluster 2024-08-31T02:16:52.822909+0000 mgr.a (mgr.14388) 242 : cluster [DBG] pgmap v168: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:16:55.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:16:55.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:16:55.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:16:56.589 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:16:56.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:16:56.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:16:56.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:16:56.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:16:56.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:56 smithi163 bash[24253]: cluster 2024-08-31T02:16:54.823658+0000 mgr.a (mgr.14388) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:56.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:56 smithi027 bash[22610]: cluster 2024-08-31T02:16:54.823658+0000 mgr.a (mgr.14388) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:56.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:56 smithi191 bash[24992]: cluster 2024-08-31T02:16:54.823658+0000 mgr.a (mgr.14388) 243 : cluster [DBG] pgmap v169: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:57.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:57 smithi163 bash[24253]: audit 2024-08-31T02:16:56.152660+0000 mgr.a (mgr.14388) 244 : audit [DBG] from='client.19200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:57.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:57 smithi027 bash[22610]: audit 2024-08-31T02:16:56.152660+0000 mgr.a (mgr.14388) 244 : audit [DBG] from='client.19200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:57.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:57 smithi191 bash[24992]: audit 2024-08-31T02:16:56.152660+0000 mgr.a (mgr.14388) 244 : audit [DBG] from='client.19200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:16:58.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:16:58 smithi163 bash[24253]: cluster 2024-08-31T02:16:56.824656+0000 mgr.a (mgr.14388) 245 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:58.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:16:58 smithi027 bash[22610]: cluster 2024-08-31T02:16:56.824656+0000 mgr.a (mgr.14388) 245 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:16:58.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:16:58 smithi191 bash[24992]: cluster 2024-08-31T02:16:56.824656+0000 mgr.a (mgr.14388) 245 : cluster [DBG] pgmap v170: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:00.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:00 smithi163 bash[24253]: cluster 2024-08-31T02:16:58.826887+0000 mgr.a (mgr.14388) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:00.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:00 smithi027 bash[22610]: cluster 2024-08-31T02:16:58.826887+0000 mgr.a (mgr.14388) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:00.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:00 smithi191 bash[24992]: cluster 2024-08-31T02:16:58.826887+0000 mgr.a (mgr.14388) 246 : cluster [DBG] pgmap v171: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:01.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:01.591 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:01.591 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:17:02.328 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:17:02.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:17:02.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:17:02.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:17:02.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:17:02.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:02 smithi163 bash[24253]: cluster 2024-08-31T02:17:00.827644+0000 mgr.a (mgr.14388) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:02.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:02 smithi027 bash[22610]: cluster 2024-08-31T02:17:00.827644+0000 mgr.a (mgr.14388) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:02.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:02 smithi191 bash[24992]: cluster 2024-08-31T02:17:00.827644+0000 mgr.a (mgr.14388) 247 : cluster [DBG] pgmap v172: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:03.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:03 smithi163 bash[24253]: audit 2024-08-31T02:17:01.922295+0000 mgr.a (mgr.14388) 248 : audit [DBG] from='client.19278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:03.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:03 smithi027 bash[22610]: audit 2024-08-31T02:17:01.922295+0000 mgr.a (mgr.14388) 248 : audit [DBG] from='client.19278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:03.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:03 smithi191 bash[24992]: audit 2024-08-31T02:17:01.922295+0000 mgr.a (mgr.14388) 248 : audit [DBG] from='client.19278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:04.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:04 smithi163 bash[24253]: cluster 2024-08-31T02:17:02.829915+0000 mgr.a (mgr.14388) 249 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:04.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:04 smithi027 bash[22610]: cluster 2024-08-31T02:17:02.829915+0000 mgr.a (mgr.14388) 249 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:04.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:04 smithi191 bash[24992]: cluster 2024-08-31T02:17:02.829915+0000 mgr.a (mgr.14388) 249 : cluster [DBG] pgmap v173: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:06.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:06 smithi163 bash[24253]: cluster 2024-08-31T02:17:04.830666+0000 mgr.a (mgr.14388) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:06.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:06 smithi027 bash[22610]: cluster 2024-08-31T02:17:04.830666+0000 mgr.a (mgr.14388) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:06.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:06 smithi191 bash[24992]: cluster 2024-08-31T02:17:04.830666+0000 mgr.a (mgr.14388) 250 : cluster [DBG] pgmap v174: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:07.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:07.330 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:07.330 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:17:08.105 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:17:08.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:17:08.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:17:08.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:17:08.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:17:08.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:08 smithi163 bash[24253]: cluster 2024-08-31T02:17:06.831445+0000 mgr.a (mgr.14388) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:08.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:08 smithi163 bash[24253]: audit 2024-08-31T02:17:07.670996+0000 mgr.a (mgr.14388) 252 : audit [DBG] from='client.19353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:08.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:08 smithi027 bash[22610]: cluster 2024-08-31T02:17:06.831445+0000 mgr.a (mgr.14388) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:08.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:08 smithi027 bash[22610]: audit 2024-08-31T02:17:07.670996+0000 mgr.a (mgr.14388) 252 : audit [DBG] from='client.19353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:08.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:08 smithi191 bash[24992]: cluster 2024-08-31T02:17:06.831445+0000 mgr.a (mgr.14388) 251 : cluster [DBG] pgmap v175: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:08.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:08 smithi191 bash[24992]: audit 2024-08-31T02:17:07.670996+0000 mgr.a (mgr.14388) 252 : audit [DBG] from='client.19353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:10.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:10 smithi163 bash[24253]: cluster 2024-08-31T02:17:08.834149+0000 mgr.a (mgr.14388) 253 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:10.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:10 smithi027 bash[22610]: cluster 2024-08-31T02:17:08.834149+0000 mgr.a (mgr.14388) 253 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:10.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:10 smithi191 bash[24992]: cluster 2024-08-31T02:17:08.834149+0000 mgr.a (mgr.14388) 253 : cluster [DBG] pgmap v176: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:12.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:12 smithi163 bash[24253]: cluster 2024-08-31T02:17:10.835048+0000 mgr.a (mgr.14388) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:17:12.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:12 smithi027 bash[22610]: cluster 2024-08-31T02:17:10.835048+0000 mgr.a (mgr.14388) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:17:12.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:12 smithi191 bash[24992]: cluster 2024-08-31T02:17:10.835048+0000 mgr.a (mgr.14388) 254 : cluster [DBG] pgmap v177: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:17:13.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:13.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:13.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:17:13.847 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:17:13.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:17:13.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:17:13.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:17:13.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:17:14.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:14 smithi163 bash[24253]: cluster 2024-08-31T02:17:12.836951+0000 mgr.a (mgr.14388) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:14.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:14 smithi163 bash[24253]: audit 2024-08-31T02:17:13.445108+0000 mgr.a (mgr.14388) 256 : audit [DBG] from='client.19428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:14.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:14 smithi027 bash[22610]: cluster 2024-08-31T02:17:12.836951+0000 mgr.a (mgr.14388) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:14.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:14 smithi027 bash[22610]: audit 2024-08-31T02:17:13.445108+0000 mgr.a (mgr.14388) 256 : audit [DBG] from='client.19428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:14.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:14 smithi191 bash[24992]: cluster 2024-08-31T02:17:12.836951+0000 mgr.a (mgr.14388) 255 : cluster [DBG] pgmap v178: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:14.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:14 smithi191 bash[24992]: audit 2024-08-31T02:17:13.445108+0000 mgr.a (mgr.14388) 256 : audit [DBG] from='client.19428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:16.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:16 smithi163 bash[24253]: cluster 2024-08-31T02:17:14.837854+0000 mgr.a (mgr.14388) 257 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:17:16.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:16 smithi027 bash[22610]: cluster 2024-08-31T02:17:14.837854+0000 mgr.a (mgr.14388) 257 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:17:16.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:16 smithi191 bash[24992]: cluster 2024-08-31T02:17:14.837854+0000 mgr.a (mgr.14388) 257 : cluster [DBG] pgmap v179: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:17:18.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:18 smithi163 bash[24253]: cluster 2024-08-31T02:17:16.838627+0000 mgr.a (mgr.14388) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:17:18.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:18 smithi027 bash[22610]: cluster 2024-08-31T02:17:16.838627+0000 mgr.a (mgr.14388) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:17:18.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:18 smithi191 bash[24992]: cluster 2024-08-31T02:17:16.838627+0000 mgr.a (mgr.14388) 258 : cluster [DBG] pgmap v180: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:17:18.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:18.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:17:19.614 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:17:19.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:17:19.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:17:19.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:17:19.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:17:20.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:20 smithi163 bash[24253]: cluster 2024-08-31T02:17:18.840857+0000 mgr.a (mgr.14388) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:20.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:20 smithi163 bash[24253]: audit 2024-08-31T02:17:19.190053+0000 mgr.a (mgr.14388) 260 : audit [DBG] from='client.19506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:20.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:20 smithi027 bash[22610]: cluster 2024-08-31T02:17:18.840857+0000 mgr.a (mgr.14388) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:20.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:20 smithi027 bash[22610]: audit 2024-08-31T02:17:19.190053+0000 mgr.a (mgr.14388) 260 : audit [DBG] from='client.19506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:20.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:20 smithi191 bash[24992]: cluster 2024-08-31T02:17:18.840857+0000 mgr.a (mgr.14388) 259 : cluster [DBG] pgmap v181: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:20.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:20 smithi191 bash[24992]: audit 2024-08-31T02:17:19.190053+0000 mgr.a (mgr.14388) 260 : audit [DBG] from='client.19506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:22.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:22 smithi163 bash[24253]: cluster 2024-08-31T02:17:20.841760+0000 mgr.a (mgr.14388) 261 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:22.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:22 smithi027 bash[22610]: cluster 2024-08-31T02:17:20.841760+0000 mgr.a (mgr.14388) 261 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:22.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:22 smithi191 bash[24992]: cluster 2024-08-31T02:17:20.841760+0000 mgr.a (mgr.14388) 261 : cluster [DBG] pgmap v182: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:24.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:24.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:24.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:17:24.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:24 smithi163 bash[24253]: cluster 2024-08-31T02:17:22.843900+0000 mgr.a (mgr.14388) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:24.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:24 smithi027 bash[22610]: cluster 2024-08-31T02:17:22.843900+0000 mgr.a (mgr.14388) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:24.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:24 smithi191 bash[24992]: cluster 2024-08-31T02:17:22.843900+0000 mgr.a (mgr.14388) 262 : cluster [DBG] pgmap v183: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:25.379 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:17:25.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:17:25.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:17:25.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:17:25.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:17:26.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:26 smithi163 bash[24253]: cluster 2024-08-31T02:17:24.844436+0000 mgr.a (mgr.14388) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:26.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:26 smithi163 bash[24253]: audit 2024-08-31T02:17:24.960092+0000 mgr.a (mgr.14388) 264 : audit [DBG] from='client.19581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:26.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:26 smithi027 bash[22610]: cluster 2024-08-31T02:17:24.844436+0000 mgr.a (mgr.14388) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:26.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:26 smithi027 bash[22610]: audit 2024-08-31T02:17:24.960092+0000 mgr.a (mgr.14388) 264 : audit [DBG] from='client.19581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:26.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:26 smithi191 bash[24992]: cluster 2024-08-31T02:17:24.844436+0000 mgr.a (mgr.14388) 263 : cluster [DBG] pgmap v184: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:26.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:26 smithi191 bash[24992]: audit 2024-08-31T02:17:24.960092+0000 mgr.a (mgr.14388) 264 : audit [DBG] from='client.19581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:28.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:28 smithi163 bash[24253]: cluster 2024-08-31T02:17:26.845316+0000 mgr.a (mgr.14388) 265 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:28.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:28 smithi027 bash[22610]: cluster 2024-08-31T02:17:26.845316+0000 mgr.a (mgr.14388) 265 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:28.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:28 smithi191 bash[24992]: cluster 2024-08-31T02:17:26.845316+0000 mgr.a (mgr.14388) 265 : cluster [DBG] pgmap v185: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:30.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:30.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:30.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:17:30.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:30 smithi163 bash[24253]: cluster 2024-08-31T02:17:28.847513+0000 mgr.a (mgr.14388) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:30.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:30 smithi027 bash[22610]: cluster 2024-08-31T02:17:28.847513+0000 mgr.a (mgr.14388) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:30.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:30 smithi191 bash[24992]: cluster 2024-08-31T02:17:28.847513+0000 mgr.a (mgr.14388) 266 : cluster [DBG] pgmap v186: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:31.134 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:17:31.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:17:31.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:17:31.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:17:31.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:17:31.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:31 smithi163 bash[24253]: audit 2024-08-31T02:17:30.727542+0000 mgr.a (mgr.14388) 267 : audit [DBG] from='client.19659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:31.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:31 smithi027 bash[22610]: audit 2024-08-31T02:17:30.727542+0000 mgr.a (mgr.14388) 267 : audit [DBG] from='client.19659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:31.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:31 smithi191 bash[24992]: audit 2024-08-31T02:17:30.727542+0000 mgr.a (mgr.14388) 267 : audit [DBG] from='client.19659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:32.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:32 smithi163 bash[24253]: cluster 2024-08-31T02:17:30.848080+0000 mgr.a (mgr.14388) 268 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:32.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:32 smithi027 bash[22610]: cluster 2024-08-31T02:17:30.848080+0000 mgr.a (mgr.14388) 268 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:32.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:32 smithi191 bash[24992]: cluster 2024-08-31T02:17:30.848080+0000 mgr.a (mgr.14388) 268 : cluster [DBG] pgmap v187: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:34.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:34 smithi163 bash[24253]: cluster 2024-08-31T02:17:32.850243+0000 mgr.a (mgr.14388) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:34.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:34 smithi027 bash[22610]: cluster 2024-08-31T02:17:32.850243+0000 mgr.a (mgr.14388) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:34.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:34 smithi191 bash[24992]: cluster 2024-08-31T02:17:32.850243+0000 mgr.a (mgr.14388) 269 : cluster [DBG] pgmap v188: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:17:35.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:35 smithi163 bash[24253]: audit 2024-08-31T02:17:34.735482+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:17:35.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:35 smithi163 bash[24253]: audit 2024-08-31T02:17:35.346336+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:35 smithi163 bash[24253]: audit 2024-08-31T02:17:35.352466+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:35 smithi163 bash[24253]: audit 2024-08-31T02:17:35.368785+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:35 smithi163 bash[24253]: audit 2024-08-31T02:17:35.376906+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:35 smithi027 bash[22610]: audit 2024-08-31T02:17:34.735482+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:17:35.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:35 smithi027 bash[22610]: audit 2024-08-31T02:17:35.346336+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:35 smithi027 bash[22610]: audit 2024-08-31T02:17:35.352466+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:35 smithi027 bash[22610]: audit 2024-08-31T02:17:35.368785+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:35 smithi027 bash[22610]: audit 2024-08-31T02:17:35.376906+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:35 smithi191 bash[24992]: audit 2024-08-31T02:17:34.735482+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:17:35.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:35 smithi191 bash[24992]: audit 2024-08-31T02:17:35.346336+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:35 smithi191 bash[24992]: audit 2024-08-31T02:17:35.352466+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:35 smithi191 bash[24992]: audit 2024-08-31T02:17:35.368785+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:35.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:35 smithi191 bash[24992]: audit 2024-08-31T02:17:35.376906+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:36.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:36.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:36.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:17:36.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:36 smithi163 bash[24253]: cluster 2024-08-31T02:17:34.851042+0000 mgr.a (mgr.14388) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:36.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:36 smithi163 bash[24253]: audit 2024-08-31T02:17:36.025414+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:17:36.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:36 smithi163 bash[24253]: audit 2024-08-31T02:17:36.026786+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:17:36.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:36 smithi163 bash[24253]: audit 2024-08-31T02:17:36.036785+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:36.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:36 smithi163 bash[24253]: audit 2024-08-31T02:17:36.041547+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:17:36.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:36 smithi027 bash[22610]: cluster 2024-08-31T02:17:34.851042+0000 mgr.a (mgr.14388) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:36.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:36 smithi027 bash[22610]: audit 2024-08-31T02:17:36.025414+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:17:36.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:36 smithi027 bash[22610]: audit 2024-08-31T02:17:36.026786+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:17:36.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:36 smithi027 bash[22610]: audit 2024-08-31T02:17:36.036785+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:36.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:36 smithi027 bash[22610]: audit 2024-08-31T02:17:36.041547+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:17:36.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:36 smithi191 bash[24992]: cluster 2024-08-31T02:17:34.851042+0000 mgr.a (mgr.14388) 270 : cluster [DBG] pgmap v189: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:36.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:36 smithi191 bash[24992]: audit 2024-08-31T02:17:36.025414+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:17:36.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:36 smithi191 bash[24992]: audit 2024-08-31T02:17:36.026786+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:17:36.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:36 smithi191 bash[24992]: audit 2024-08-31T02:17:36.036785+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:17:36.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:36 smithi191 bash[24992]: audit 2024-08-31T02:17:36.041547+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:17:37.141 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:17:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:17:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:17:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:17:37.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:17:37.227 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:17:36 smithi027 bash[22863]: debug 2024-08-31T02:17:36.748+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:17:37.227 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:17:36 smithi027 bash[22863]: debug 2024-08-31T02:17:36.760+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:17:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:37 smithi163 bash[24253]: audit 2024-08-31T02:17:36.043764+0000 mgr.a (mgr.14388) 271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:17:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:37 smithi163 bash[24253]: audit 2024-08-31T02:17:36.470708+0000 mgr.a (mgr.14388) 272 : audit [DBG] from='client.19767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:37 smithi163 bash[24253]: audit 2024-08-31T02:17:36.754243+0000 mgr.a (mgr.14388) 273 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:17:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:37 smithi163 bash[24253]: cephadm 2024-08-31T02:17:36.764627+0000 mgr.a (mgr.14388) 274 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:17:37.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:37 smithi027 bash[22610]: audit 2024-08-31T02:17:36.043764+0000 mgr.a (mgr.14388) 271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:17:37.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:37 smithi027 bash[22610]: audit 2024-08-31T02:17:36.470708+0000 mgr.a (mgr.14388) 272 : audit [DBG] from='client.19767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:37.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:37 smithi027 bash[22610]: audit 2024-08-31T02:17:36.754243+0000 mgr.a (mgr.14388) 273 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:17:37.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:37 smithi027 bash[22610]: cephadm 2024-08-31T02:17:36.764627+0000 mgr.a (mgr.14388) 274 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:17:37.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:37 smithi191 bash[24992]: audit 2024-08-31T02:17:36.043764+0000 mgr.a (mgr.14388) 271 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:17:37.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:37 smithi191 bash[24992]: audit 2024-08-31T02:17:36.470708+0000 mgr.a (mgr.14388) 272 : audit [DBG] from='client.19767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:37.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:37 smithi191 bash[24992]: audit 2024-08-31T02:17:36.754243+0000 mgr.a (mgr.14388) 273 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:17:37.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:37 smithi191 bash[24992]: cephadm 2024-08-31T02:17:36.764627+0000 mgr.a (mgr.14388) 274 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:17:38.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:38 smithi163 bash[24253]: cluster 2024-08-31T02:17:36.851495+0000 mgr.a (mgr.14388) 275 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:38.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:38 smithi027 bash[22610]: cluster 2024-08-31T02:17:36.851495+0000 mgr.a (mgr.14388) 275 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:38 smithi191 bash[24992]: cluster 2024-08-31T02:17:36.851495+0000 mgr.a (mgr.14388) 275 : cluster [DBG] pgmap v190: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:40.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:40 smithi163 bash[24253]: cluster 2024-08-31T02:17:38.853729+0000 mgr.a (mgr.14388) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:40.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:40 smithi027 bash[22610]: cluster 2024-08-31T02:17:38.853729+0000 mgr.a (mgr.14388) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:40.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:40 smithi191 bash[24992]: cluster 2024-08-31T02:17:38.853729+0000 mgr.a (mgr.14388) 276 : cluster [DBG] pgmap v191: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:42.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:42.143 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:42.143 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:17:42.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:42 smithi163 bash[24253]: cluster 2024-08-31T02:17:40.854526+0000 mgr.a (mgr.14388) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:42.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:42 smithi027 bash[22610]: cluster 2024-08-31T02:17:40.854526+0000 mgr.a (mgr.14388) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:42.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:42 smithi191 bash[24992]: cluster 2024-08-31T02:17:40.854526+0000 mgr.a (mgr.14388) 277 : cluster [DBG] pgmap v192: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:42.869 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:17:42.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:17:42.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:17:42.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:17:42.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:17:43.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:43 smithi027 bash[22610]: audit 2024-08-31T02:17:42.474960+0000 mgr.a (mgr.14388) 278 : audit [DBG] from='client.19917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:43.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:43 smithi191 bash[24992]: audit 2024-08-31T02:17:42.474960+0000 mgr.a (mgr.14388) 278 : audit [DBG] from='client.19917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:43.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:43 smithi163 bash[24253]: audit 2024-08-31T02:17:42.474960+0000 mgr.a (mgr.14388) 278 : audit [DBG] from='client.19917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:44.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:44 smithi027 bash[22610]: cluster 2024-08-31T02:17:42.855793+0000 mgr.a (mgr.14388) 279 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:44.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:44 smithi191 bash[24992]: cluster 2024-08-31T02:17:42.855793+0000 mgr.a (mgr.14388) 279 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:44.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:44 smithi163 bash[24253]: cluster 2024-08-31T02:17:42.855793+0000 mgr.a (mgr.14388) 279 : cluster [DBG] pgmap v193: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:46.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:46 smithi027 bash[22610]: cluster 2024-08-31T02:17:44.856556+0000 mgr.a (mgr.14388) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:17:46.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:46 smithi191 bash[24992]: cluster 2024-08-31T02:17:44.856556+0000 mgr.a (mgr.14388) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:17:46.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:46 smithi163 bash[24253]: cluster 2024-08-31T02:17:44.856556+0000 mgr.a (mgr.14388) 280 : cluster [DBG] pgmap v194: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:17:47.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:47.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:47.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:17:48.615 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:17:48.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:17:48.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:17:48.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:17:48.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:17:48.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:48 smithi027 bash[22610]: cluster 2024-08-31T02:17:46.857374+0000 mgr.a (mgr.14388) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:17:48.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:48 smithi191 bash[24992]: cluster 2024-08-31T02:17:46.857374+0000 mgr.a (mgr.14388) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:17:48.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:48 smithi163 bash[24253]: cluster 2024-08-31T02:17:46.857374+0000 mgr.a (mgr.14388) 281 : cluster [DBG] pgmap v195: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:17:49.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:49 smithi027 bash[22610]: audit 2024-08-31T02:17:48.210800+0000 mgr.a (mgr.14388) 282 : audit [DBG] from='client.19992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:49.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:49 smithi191 bash[24992]: audit 2024-08-31T02:17:48.210800+0000 mgr.a (mgr.14388) 282 : audit [DBG] from='client.19992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:49.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:49 smithi163 bash[24253]: audit 2024-08-31T02:17:48.210800+0000 mgr.a (mgr.14388) 282 : audit [DBG] from='client.19992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:50.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:50 smithi027 bash[22610]: cluster 2024-08-31T02:17:48.860023+0000 mgr.a (mgr.14388) 283 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:50.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:50 smithi191 bash[24992]: cluster 2024-08-31T02:17:48.860023+0000 mgr.a (mgr.14388) 283 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:50.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:50 smithi163 bash[24253]: cluster 2024-08-31T02:17:48.860023+0000 mgr.a (mgr.14388) 283 : cluster [DBG] pgmap v196: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:17:52.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:52 smithi027 bash[22610]: cluster 2024-08-31T02:17:50.860840+0000 mgr.a (mgr.14388) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:17:52.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:52 smithi191 bash[24992]: cluster 2024-08-31T02:17:50.860840+0000 mgr.a (mgr.14388) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:17:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:52 smithi163 bash[24253]: cluster 2024-08-31T02:17:50.860840+0000 mgr.a (mgr.14388) 284 : cluster [DBG] pgmap v197: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:17:53.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:53.617 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:53.617 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:17:54.360 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:17:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:17:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:17:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:17:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:17:54.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:54 smithi191 bash[24992]: cluster 2024-08-31T02:17:52.862794+0000 mgr.a (mgr.14388) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:54.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:54 smithi163 bash[24253]: cluster 2024-08-31T02:17:52.862794+0000 mgr.a (mgr.14388) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:54.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:54 smithi027 bash[22610]: cluster 2024-08-31T02:17:52.862794+0000 mgr.a (mgr.14388) 285 : cluster [DBG] pgmap v198: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:17:55.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:55 smithi191 bash[24992]: audit 2024-08-31T02:17:53.959413+0000 mgr.a (mgr.14388) 286 : audit [DBG] from='client.20067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:55.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:55 smithi163 bash[24253]: audit 2024-08-31T02:17:53.959413+0000 mgr.a (mgr.14388) 286 : audit [DBG] from='client.20067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:55.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:55 smithi027 bash[22610]: audit 2024-08-31T02:17:53.959413+0000 mgr.a (mgr.14388) 286 : audit [DBG] from='client.20067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:17:56.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:56 smithi191 bash[24992]: cluster 2024-08-31T02:17:54.863827+0000 mgr.a (mgr.14388) 287 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:17:56.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:56 smithi163 bash[24253]: cluster 2024-08-31T02:17:54.863827+0000 mgr.a (mgr.14388) 287 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:17:56.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:56 smithi027 bash[22610]: cluster 2024-08-31T02:17:54.863827+0000 mgr.a (mgr.14388) 287 : cluster [DBG] pgmap v199: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:17:58.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:17:58 smithi191 bash[24992]: cluster 2024-08-31T02:17:56.864649+0000 mgr.a (mgr.14388) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:17:58.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:17:58 smithi163 bash[24253]: cluster 2024-08-31T02:17:56.864649+0000 mgr.a (mgr.14388) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:17:58.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:17:58 smithi027 bash[22610]: cluster 2024-08-31T02:17:56.864649+0000 mgr.a (mgr.14388) 288 : cluster [DBG] pgmap v200: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:17:59.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:17:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:17:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:00.103 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:00.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:00.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:00 smithi191 bash[24992]: cluster 2024-08-31T02:17:58.866934+0000 mgr.a (mgr.14388) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:18:00.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:00 smithi191 bash[24992]: audit 2024-08-31T02:17:59.699833+0000 mgr.a (mgr.14388) 290 : audit [DBG] from='client.20145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:00.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:00 smithi163 bash[24253]: cluster 2024-08-31T02:17:58.866934+0000 mgr.a (mgr.14388) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:18:00.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:00 smithi163 bash[24253]: audit 2024-08-31T02:17:59.699833+0000 mgr.a (mgr.14388) 290 : audit [DBG] from='client.20145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:00.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:00 smithi027 bash[22610]: cluster 2024-08-31T02:17:58.866934+0000 mgr.a (mgr.14388) 289 : cluster [DBG] pgmap v201: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:18:00.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:00 smithi027 bash[22610]: audit 2024-08-31T02:17:59.699833+0000 mgr.a (mgr.14388) 290 : audit [DBG] from='client.20145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:02.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:02 smithi191 bash[24992]: cluster 2024-08-31T02:18:00.867855+0000 mgr.a (mgr.14388) 291 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:02.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:02 smithi163 bash[24253]: cluster 2024-08-31T02:18:00.867855+0000 mgr.a (mgr.14388) 291 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:02.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:02 smithi027 bash[22610]: cluster 2024-08-31T02:18:00.867855+0000 mgr.a (mgr.14388) 291 : cluster [DBG] pgmap v202: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:04.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:04 smithi191 bash[24992]: cluster 2024-08-31T02:18:02.869971+0000 mgr.a (mgr.14388) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:04.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:04 smithi163 bash[24253]: cluster 2024-08-31T02:18:02.869971+0000 mgr.a (mgr.14388) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:04.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:04 smithi027 bash[22610]: cluster 2024-08-31T02:18:02.869971+0000 mgr.a (mgr.14388) 292 : cluster [DBG] pgmap v203: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:05.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:18:05.105 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:18:05.105 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:05.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:05.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:05.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:05.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:05.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:06.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:06 smithi191 bash[24992]: cluster 2024-08-31T02:18:04.870784+0000 mgr.a (mgr.14388) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:06.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:06 smithi191 bash[24992]: audit 2024-08-31T02:18:05.448631+0000 mgr.a (mgr.14388) 294 : audit [DBG] from='client.20223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:06.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:06 smithi163 bash[24253]: cluster 2024-08-31T02:18:04.870784+0000 mgr.a (mgr.14388) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:06.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:06 smithi163 bash[24253]: audit 2024-08-31T02:18:05.448631+0000 mgr.a (mgr.14388) 294 : audit [DBG] from='client.20223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:06.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:06 smithi027 bash[22610]: cluster 2024-08-31T02:18:04.870784+0000 mgr.a (mgr.14388) 293 : cluster [DBG] pgmap v204: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:06.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:06 smithi027 bash[22610]: audit 2024-08-31T02:18:05.448631+0000 mgr.a (mgr.14388) 294 : audit [DBG] from='client.20223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:08.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:08 smithi191 bash[24992]: cluster 2024-08-31T02:18:06.871764+0000 mgr.a (mgr.14388) 295 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:08.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:08 smithi163 bash[24253]: cluster 2024-08-31T02:18:06.871764+0000 mgr.a (mgr.14388) 295 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:08.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:08 smithi027 bash[22610]: cluster 2024-08-31T02:18:06.871764+0000 mgr.a (mgr.14388) 295 : cluster [DBG] pgmap v205: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:10.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:10 smithi191 bash[24992]: cluster 2024-08-31T02:18:08.874107+0000 mgr.a (mgr.14388) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:10.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:18:10.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:18:10.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:10.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:10 smithi163 bash[24253]: cluster 2024-08-31T02:18:08.874107+0000 mgr.a (mgr.14388) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:10.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:10 smithi027 bash[22610]: cluster 2024-08-31T02:18:08.874107+0000 mgr.a (mgr.14388) 296 : cluster [DBG] pgmap v206: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:11.615 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:11.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:11.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:11.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:11.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:12.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:12 smithi191 bash[24992]: cluster 2024-08-31T02:18:10.875063+0000 mgr.a (mgr.14388) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:12.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:12 smithi191 bash[24992]: audit 2024-08-31T02:18:11.208443+0000 mgr.a (mgr.14388) 298 : audit [DBG] from='client.20301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:12.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:12 smithi163 bash[24253]: cluster 2024-08-31T02:18:10.875063+0000 mgr.a (mgr.14388) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:12.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:12 smithi163 bash[24253]: audit 2024-08-31T02:18:11.208443+0000 mgr.a (mgr.14388) 298 : audit [DBG] from='client.20301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:12.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:12 smithi027 bash[22610]: cluster 2024-08-31T02:18:10.875063+0000 mgr.a (mgr.14388) 297 : cluster [DBG] pgmap v207: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:12.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:12 smithi027 bash[22610]: audit 2024-08-31T02:18:11.208443+0000 mgr.a (mgr.14388) 298 : audit [DBG] from='client.20301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:14.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:14 smithi191 bash[24992]: cluster 2024-08-31T02:18:12.877295+0000 mgr.a (mgr.14388) 299 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:14.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:14 smithi163 bash[24253]: cluster 2024-08-31T02:18:12.877295+0000 mgr.a (mgr.14388) 299 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:14.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:14 smithi027 bash[22610]: cluster 2024-08-31T02:18:12.877295+0000 mgr.a (mgr.14388) 299 : cluster [DBG] pgmap v208: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:16.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:18:16.617 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:18:16.617 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:16.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:16 smithi191 bash[24992]: cluster 2024-08-31T02:18:14.878185+0000 mgr.a (mgr.14388) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:16.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:16 smithi163 bash[24253]: cluster 2024-08-31T02:18:14.878185+0000 mgr.a (mgr.14388) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:16.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:16 smithi027 bash[22610]: cluster 2024-08-31T02:18:14.878185+0000 mgr.a (mgr.14388) 300 : cluster [DBG] pgmap v209: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:17.386 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:17.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:17.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:17.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:17.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:18.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:18 smithi163 bash[24253]: cluster 2024-08-31T02:18:16.878954+0000 mgr.a (mgr.14388) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:18.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:18 smithi163 bash[24253]: audit 2024-08-31T02:18:16.958171+0000 mgr.a (mgr.14388) 302 : audit [DBG] from='client.20379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:18.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:18 smithi027 bash[22610]: cluster 2024-08-31T02:18:16.878954+0000 mgr.a (mgr.14388) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:18.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:18 smithi027 bash[22610]: audit 2024-08-31T02:18:16.958171+0000 mgr.a (mgr.14388) 302 : audit [DBG] from='client.20379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:19.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:18 smithi191 bash[24992]: cluster 2024-08-31T02:18:16.878954+0000 mgr.a (mgr.14388) 301 : cluster [DBG] pgmap v210: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:19.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:18 smithi191 bash[24992]: audit 2024-08-31T02:18:16.958171+0000 mgr.a (mgr.14388) 302 : audit [DBG] from='client.20379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:20.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:20 smithi163 bash[24253]: cluster 2024-08-31T02:18:18.881264+0000 mgr.a (mgr.14388) 303 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:20.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:20 smithi027 bash[22610]: cluster 2024-08-31T02:18:18.881264+0000 mgr.a (mgr.14388) 303 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:21.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:20 smithi191 bash[24992]: cluster 2024-08-31T02:18:18.881264+0000 mgr.a (mgr.14388) 303 : cluster [DBG] pgmap v211: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:18:22.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:18:22.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:18:22.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:22.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:22 smithi163 bash[24253]: cluster 2024-08-31T02:18:20.882076+0000 mgr.a (mgr.14388) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:22.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:22 smithi027 bash[22610]: cluster 2024-08-31T02:18:20.882076+0000 mgr.a (mgr.14388) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:23.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:22 smithi191 bash[24992]: cluster 2024-08-31T02:18:20.882076+0000 mgr.a (mgr.14388) 304 : cluster [DBG] pgmap v212: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:23.151 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:23.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:23.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:23.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:23.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:23.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:23 smithi163 bash[24253]: audit 2024-08-31T02:18:22.736945+0000 mgr.a (mgr.14388) 305 : audit [DBG] from='client.20457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:23.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:23 smithi027 bash[22610]: audit 2024-08-31T02:18:22.736945+0000 mgr.a (mgr.14388) 305 : audit [DBG] from='client.20457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:24.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:23 smithi191 bash[24992]: audit 2024-08-31T02:18:22.736945+0000 mgr.a (mgr.14388) 305 : audit [DBG] from='client.20457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:24.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:24 smithi163 bash[24253]: cluster 2024-08-31T02:18:22.883428+0000 mgr.a (mgr.14388) 306 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:24.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:24 smithi027 bash[22610]: cluster 2024-08-31T02:18:22.883428+0000 mgr.a (mgr.14388) 306 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:25.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:24 smithi191 bash[24992]: cluster 2024-08-31T02:18:22.883428+0000 mgr.a (mgr.14388) 306 : cluster [DBG] pgmap v213: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:26.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:26 smithi163 bash[24253]: cluster 2024-08-31T02:18:24.884259+0000 mgr.a (mgr.14388) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:18:26.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:26 smithi027 bash[22610]: cluster 2024-08-31T02:18:24.884259+0000 mgr.a (mgr.14388) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:18:27.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:26 smithi191 bash[24992]: cluster 2024-08-31T02:18:24.884259+0000 mgr.a (mgr.14388) 307 : cluster [DBG] pgmap v214: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:18:28.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:18:28.153 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:18:28.153 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:28.898 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:28.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:28.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:28.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:28.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:28.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:28 smithi163 bash[24253]: cluster 2024-08-31T02:18:26.885016+0000 mgr.a (mgr.14388) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:18:28.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:28 smithi027 bash[22610]: cluster 2024-08-31T02:18:26.885016+0000 mgr.a (mgr.14388) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:18:29.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:28 smithi191 bash[24992]: cluster 2024-08-31T02:18:26.885016+0000 mgr.a (mgr.14388) 308 : cluster [DBG] pgmap v215: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:18:29.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:29 smithi163 bash[24253]: audit 2024-08-31T02:18:28.491005+0000 mgr.a (mgr.14388) 309 : audit [DBG] from='client.20532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:29.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:29 smithi027 bash[22610]: audit 2024-08-31T02:18:28.491005+0000 mgr.a (mgr.14388) 309 : audit [DBG] from='client.20532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:30.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:29 smithi191 bash[24992]: audit 2024-08-31T02:18:28.491005+0000 mgr.a (mgr.14388) 309 : audit [DBG] from='client.20532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:30.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:30 smithi163 bash[24253]: cluster 2024-08-31T02:18:28.886509+0000 mgr.a (mgr.14388) 310 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:30.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:30 smithi027 bash[22610]: cluster 2024-08-31T02:18:28.886509+0000 mgr.a (mgr.14388) 310 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:31.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:30 smithi191 bash[24992]: cluster 2024-08-31T02:18:28.886509+0000 mgr.a (mgr.14388) 310 : cluster [DBG] pgmap v216: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:32.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:32 smithi163 bash[24253]: cluster 2024-08-31T02:18:30.887252+0000 mgr.a (mgr.14388) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:18:32.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:32 smithi027 bash[22610]: cluster 2024-08-31T02:18:30.887252+0000 mgr.a (mgr.14388) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:18:33.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:32 smithi191 bash[24992]: cluster 2024-08-31T02:18:30.887252+0000 mgr.a (mgr.14388) 311 : cluster [DBG] pgmap v217: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:18:33.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:18:33.901 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:18:33.901 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:34.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:34.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:34.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:34.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:34.672 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:34.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:34 smithi163 bash[24253]: cluster 2024-08-31T02:18:32.889131+0000 mgr.a (mgr.14388) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:34.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:34 smithi027 bash[22610]: cluster 2024-08-31T02:18:32.889131+0000 mgr.a (mgr.14388) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:35.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:34 smithi191 bash[24992]: cluster 2024-08-31T02:18:32.889131+0000 mgr.a (mgr.14388) 312 : cluster [DBG] pgmap v218: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:35.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:35 smithi163 bash[24253]: audit 2024-08-31T02:18:34.241310+0000 mgr.a (mgr.14388) 313 : audit [DBG] from='client.20607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:35.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:35 smithi027 bash[22610]: audit 2024-08-31T02:18:34.241310+0000 mgr.a (mgr.14388) 313 : audit [DBG] from='client.20607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:36.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:35 smithi191 bash[24992]: audit 2024-08-31T02:18:34.241310+0000 mgr.a (mgr.14388) 313 : audit [DBG] from='client.20607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:36.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:36 smithi163 bash[24253]: cluster 2024-08-31T02:18:34.890160+0000 mgr.a (mgr.14388) 314 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:36.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:36 smithi027 bash[22610]: cluster 2024-08-31T02:18:34.890160+0000 mgr.a (mgr.14388) 314 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:37.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:36 smithi191 bash[24992]: cluster 2024-08-31T02:18:34.890160+0000 mgr.a (mgr.14388) 314 : cluster [DBG] pgmap v219: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:37.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:37 smithi163 bash[24253]: audit 2024-08-31T02:18:36.817752+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:18:37.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:37 smithi027 bash[22610]: audit 2024-08-31T02:18:36.817752+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:18:38.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:37 smithi191 bash[24992]: audit 2024-08-31T02:18:36.817752+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:18:38.727 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:18:38 smithi027 bash[22863]: debug 2024-08-31T02:18:38.399+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:18:38.727 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:18:38 smithi027 bash[22863]: debug 2024-08-31T02:18:38.403+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:18:38.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:38 smithi027 bash[22610]: cluster 2024-08-31T02:18:36.891168+0000 mgr.a (mgr.14388) 315 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:38.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:38 smithi027 bash[22610]: audit 2024-08-31T02:18:37.689646+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:18:38.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:38 smithi027 bash[22610]: audit 2024-08-31T02:18:37.691364+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:18:38.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:38 smithi027 bash[22610]: audit 2024-08-31T02:18:37.701590+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:18:38.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:38 smithi027 bash[22610]: audit 2024-08-31T02:18:37.706412+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:18:38.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:38 smithi027 bash[22610]: audit 2024-08-31T02:18:37.708096+0000 mgr.a (mgr.14388) 316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:18:38.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:38 smithi163 bash[24253]: cluster 2024-08-31T02:18:36.891168+0000 mgr.a (mgr.14388) 315 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:38.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:38 smithi163 bash[24253]: audit 2024-08-31T02:18:37.689646+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:18:38.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:38 smithi163 bash[24253]: audit 2024-08-31T02:18:37.691364+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:18:38.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:38 smithi163 bash[24253]: audit 2024-08-31T02:18:37.701590+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:18:38.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:38 smithi163 bash[24253]: audit 2024-08-31T02:18:37.706412+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:18:38.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:38 smithi163 bash[24253]: audit 2024-08-31T02:18:37.708096+0000 mgr.a (mgr.14388) 316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:18:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:38 smithi191 bash[24992]: cluster 2024-08-31T02:18:36.891168+0000 mgr.a (mgr.14388) 315 : cluster [DBG] pgmap v220: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:38 smithi191 bash[24992]: audit 2024-08-31T02:18:37.689646+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:18:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:38 smithi191 bash[24992]: audit 2024-08-31T02:18:37.691364+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:18:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:38 smithi191 bash[24992]: audit 2024-08-31T02:18:37.701590+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:18:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:38 smithi191 bash[24992]: audit 2024-08-31T02:18:37.706412+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:18:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:38 smithi191 bash[24992]: audit 2024-08-31T02:18:37.708096+0000 mgr.a (mgr.14388) 316 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:18:39.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:18:39.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:18:39.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:39.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:39 smithi163 bash[24253]: audit 2024-08-31T02:18:38.405949+0000 mgr.a (mgr.14388) 317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:18:39.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:39 smithi163 bash[24253]: cephadm 2024-08-31T02:18:38.407155+0000 mgr.a (mgr.14388) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:18:39.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:39 smithi027 bash[22610]: audit 2024-08-31T02:18:38.405949+0000 mgr.a (mgr.14388) 317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:18:39.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:39 smithi027 bash[22610]: cephadm 2024-08-31T02:18:38.407155+0000 mgr.a (mgr.14388) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:18:40.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:39 smithi191 bash[24992]: audit 2024-08-31T02:18:38.405949+0000 mgr.a (mgr.14388) 317 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:18:40.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:39 smithi191 bash[24992]: cephadm 2024-08-31T02:18:38.407155+0000 mgr.a (mgr.14388) 318 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:18:40.411 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:40.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:40.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:40.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:40.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:40.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:40 smithi163 bash[24253]: cluster 2024-08-31T02:18:38.893738+0000 mgr.a (mgr.14388) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T02:18:40.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:40 smithi027 bash[22610]: cluster 2024-08-31T02:18:38.893738+0000 mgr.a (mgr.14388) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T02:18:41.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:40 smithi191 bash[24992]: cluster 2024-08-31T02:18:38.893738+0000 mgr.a (mgr.14388) 319 : cluster [DBG] pgmap v221: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T02:18:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:41 smithi163 bash[24253]: audit 2024-08-31T02:18:40.003402+0000 mgr.a (mgr.14388) 320 : audit [DBG] from='client.20793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:41.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:41 smithi027 bash[22610]: audit 2024-08-31T02:18:40.003402+0000 mgr.a (mgr.14388) 320 : audit [DBG] from='client.20793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:42.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:41 smithi191 bash[24992]: audit 2024-08-31T02:18:40.003402+0000 mgr.a (mgr.14388) 320 : audit [DBG] from='client.20793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:42.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:42 smithi163 bash[24253]: cluster 2024-08-31T02:18:40.894629+0000 mgr.a (mgr.14388) 321 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:18:42.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:42 smithi027 bash[22610]: cluster 2024-08-31T02:18:40.894629+0000 mgr.a (mgr.14388) 321 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:18:43.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:42 smithi191 bash[24992]: cluster 2024-08-31T02:18:40.894629+0000 mgr.a (mgr.14388) 321 : cluster [DBG] pgmap v222: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:18:44.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:44 smithi163 bash[24253]: cluster 2024-08-31T02:18:42.896733+0000 mgr.a (mgr.14388) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:44.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:44 smithi027 bash[22610]: cluster 2024-08-31T02:18:42.896733+0000 mgr.a (mgr.14388) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:45.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:44 smithi191 bash[24992]: cluster 2024-08-31T02:18:42.896733+0000 mgr.a (mgr.14388) 322 : cluster [DBG] pgmap v223: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:45.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:18:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:18:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:46.154 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:46.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:46.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:46.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:46.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:46.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:46 smithi163 bash[24253]: cluster 2024-08-31T02:18:44.897492+0000 mgr.a (mgr.14388) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:46.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:46 smithi163 bash[24253]: audit 2024-08-31T02:18:45.752096+0000 mgr.a (mgr.14388) 324 : audit [DBG] from='client.20868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:46.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:46 smithi027 bash[22610]: cluster 2024-08-31T02:18:44.897492+0000 mgr.a (mgr.14388) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:46.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:46 smithi027 bash[22610]: audit 2024-08-31T02:18:45.752096+0000 mgr.a (mgr.14388) 324 : audit [DBG] from='client.20868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:47.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:46 smithi191 bash[24992]: cluster 2024-08-31T02:18:44.897492+0000 mgr.a (mgr.14388) 323 : cluster [DBG] pgmap v224: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:47.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:46 smithi191 bash[24992]: audit 2024-08-31T02:18:45.752096+0000 mgr.a (mgr.14388) 324 : audit [DBG] from='client.20868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:48.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:48 smithi163 bash[24253]: cluster 2024-08-31T02:18:46.898384+0000 mgr.a (mgr.14388) 325 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:48.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:48 smithi027 bash[22610]: cluster 2024-08-31T02:18:46.898384+0000 mgr.a (mgr.14388) 325 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:49.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:48 smithi191 bash[24992]: cluster 2024-08-31T02:18:46.898384+0000 mgr.a (mgr.14388) 325 : cluster [DBG] pgmap v225: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:50.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:50 smithi163 bash[24253]: cluster 2024-08-31T02:18:48.900592+0000 mgr.a (mgr.14388) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:50.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:50 smithi027 bash[22610]: cluster 2024-08-31T02:18:48.900592+0000 mgr.a (mgr.14388) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:51.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:50 smithi191 bash[24992]: cluster 2024-08-31T02:18:48.900592+0000 mgr.a (mgr.14388) 326 : cluster [DBG] pgmap v226: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:51.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:18:51.156 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:18:51.156 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:51.918 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:51.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:51.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:51.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:51.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:52 smithi163 bash[24253]: cluster 2024-08-31T02:18:50.901368+0000 mgr.a (mgr.14388) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:18:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:52 smithi163 bash[24253]: audit 2024-08-31T02:18:51.500565+0000 mgr.a (mgr.14388) 328 : audit [DBG] from='client.20946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:52.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:52 smithi027 bash[22610]: cluster 2024-08-31T02:18:50.901368+0000 mgr.a (mgr.14388) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:18:52.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:52 smithi027 bash[22610]: audit 2024-08-31T02:18:51.500565+0000 mgr.a (mgr.14388) 328 : audit [DBG] from='client.20946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:53.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:52 smithi191 bash[24992]: cluster 2024-08-31T02:18:50.901368+0000 mgr.a (mgr.14388) 327 : cluster [DBG] pgmap v227: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:18:53.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:52 smithi191 bash[24992]: audit 2024-08-31T02:18:51.500565+0000 mgr.a (mgr.14388) 328 : audit [DBG] from='client.20946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:54.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:54 smithi163 bash[24253]: cluster 2024-08-31T02:18:52.903568+0000 mgr.a (mgr.14388) 329 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:54.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:54 smithi027 bash[22610]: cluster 2024-08-31T02:18:52.903568+0000 mgr.a (mgr.14388) 329 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:55.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:54 smithi191 bash[24992]: cluster 2024-08-31T02:18:52.903568+0000 mgr.a (mgr.14388) 329 : cluster [DBG] pgmap v228: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:18:56.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:18:56.920 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:18:56.921 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:18:56.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:56 smithi163 bash[24253]: cluster 2024-08-31T02:18:54.904342+0000 mgr.a (mgr.14388) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:56.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:56 smithi027 bash[22610]: cluster 2024-08-31T02:18:54.904342+0000 mgr.a (mgr.14388) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:57.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:56 smithi191 bash[24992]: cluster 2024-08-31T02:18:54.904342+0000 mgr.a (mgr.14388) 330 : cluster [DBG] pgmap v229: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:57.701 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:18:57.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:18:57.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:18:57.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:18:57.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:18:58.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:58 smithi163 bash[24253]: cluster 2024-08-31T02:18:56.905086+0000 mgr.a (mgr.14388) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:58.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:18:58 smithi163 bash[24253]: audit 2024-08-31T02:18:57.266799+0000 mgr.a (mgr.14388) 332 : audit [DBG] from='client.21021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:58.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:58 smithi027 bash[22610]: cluster 2024-08-31T02:18:56.905086+0000 mgr.a (mgr.14388) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:58.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:18:58 smithi027 bash[22610]: audit 2024-08-31T02:18:57.266799+0000 mgr.a (mgr.14388) 332 : audit [DBG] from='client.21021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:18:59.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:58 smithi191 bash[24992]: cluster 2024-08-31T02:18:56.905086+0000 mgr.a (mgr.14388) 331 : cluster [DBG] pgmap v230: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:18:59.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:18:58 smithi191 bash[24992]: audit 2024-08-31T02:18:57.266799+0000 mgr.a (mgr.14388) 332 : audit [DBG] from='client.21021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:00.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:00 smithi163 bash[24253]: cluster 2024-08-31T02:18:58.907469+0000 mgr.a (mgr.14388) 333 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:00.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:00 smithi027 bash[22610]: cluster 2024-08-31T02:18:58.907469+0000 mgr.a (mgr.14388) 333 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:01.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:00 smithi191 bash[24992]: cluster 2024-08-31T02:18:58.907469+0000 mgr.a (mgr.14388) 333 : cluster [DBG] pgmap v231: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:02.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:19:02.704 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:19:02.704 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:19:02.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:02 smithi163 bash[24253]: cluster 2024-08-31T02:19:00.908259+0000 mgr.a (mgr.14388) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:02.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:02 smithi027 bash[22610]: cluster 2024-08-31T02:19:00.908259+0000 mgr.a (mgr.14388) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:03.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:02 smithi191 bash[24992]: cluster 2024-08-31T02:19:00.908259+0000 mgr.a (mgr.14388) 334 : cluster [DBG] pgmap v232: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:03.470 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:19:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:19:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:19:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:19:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:19:04.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:04 smithi163 bash[24253]: cluster 2024-08-31T02:19:02.910268+0000 mgr.a (mgr.14388) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:04.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:04 smithi163 bash[24253]: audit 2024-08-31T02:19:03.045533+0000 mgr.a (mgr.14388) 336 : audit [DBG] from='client.21099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:04.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:04 smithi027 bash[22610]: cluster 2024-08-31T02:19:02.910268+0000 mgr.a (mgr.14388) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:04.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:04 smithi027 bash[22610]: audit 2024-08-31T02:19:03.045533+0000 mgr.a (mgr.14388) 336 : audit [DBG] from='client.21099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:05.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:04 smithi191 bash[24992]: cluster 2024-08-31T02:19:02.910268+0000 mgr.a (mgr.14388) 335 : cluster [DBG] pgmap v233: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:05.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:04 smithi191 bash[24992]: audit 2024-08-31T02:19:03.045533+0000 mgr.a (mgr.14388) 336 : audit [DBG] from='client.21099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:06.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:06 smithi163 bash[24253]: cluster 2024-08-31T02:19:04.911268+0000 mgr.a (mgr.14388) 337 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:19:06.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:06 smithi027 bash[22610]: cluster 2024-08-31T02:19:04.911268+0000 mgr.a (mgr.14388) 337 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:19:07.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:06 smithi191 bash[24992]: cluster 2024-08-31T02:19:04.911268+0000 mgr.a (mgr.14388) 337 : cluster [DBG] pgmap v234: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:19:08.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:19:08.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:19:08.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:19:08.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:08 smithi163 bash[24253]: cluster 2024-08-31T02:19:06.912066+0000 mgr.a (mgr.14388) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:19:08.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:08 smithi027 bash[22610]: cluster 2024-08-31T02:19:06.912066+0000 mgr.a (mgr.14388) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:19:09.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:08 smithi191 bash[24992]: cluster 2024-08-31T02:19:06.912066+0000 mgr.a (mgr.14388) 338 : cluster [DBG] pgmap v235: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:19:09.206 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:19:09.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:19:09.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:19:09.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:19:09.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:19:10.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:10 smithi163 bash[24253]: audit 2024-08-31T02:19:08.809357+0000 mgr.a (mgr.14388) 339 : audit [DBG] from='client.21174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:10.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:10 smithi163 bash[24253]: cluster 2024-08-31T02:19:08.913167+0000 mgr.a (mgr.14388) 340 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:10.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:10 smithi027 bash[22610]: audit 2024-08-31T02:19:08.809357+0000 mgr.a (mgr.14388) 339 : audit [DBG] from='client.21174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:10.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:10 smithi027 bash[22610]: cluster 2024-08-31T02:19:08.913167+0000 mgr.a (mgr.14388) 340 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:11.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:10 smithi191 bash[24992]: audit 2024-08-31T02:19:08.809357+0000 mgr.a (mgr.14388) 339 : audit [DBG] from='client.21174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:11.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:10 smithi191 bash[24992]: cluster 2024-08-31T02:19:08.913167+0000 mgr.a (mgr.14388) 340 : cluster [DBG] pgmap v236: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:12.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:12 smithi163 bash[24253]: cluster 2024-08-31T02:19:10.914060+0000 mgr.a (mgr.14388) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:19:12.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:12 smithi027 bash[22610]: cluster 2024-08-31T02:19:10.914060+0000 mgr.a (mgr.14388) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:19:13.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:12 smithi191 bash[24992]: cluster 2024-08-31T02:19:10.914060+0000 mgr.a (mgr.14388) 341 : cluster [DBG] pgmap v237: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:19:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:19:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:19:14.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:14 smithi163 bash[24253]: cluster 2024-08-31T02:19:12.916199+0000 mgr.a (mgr.14388) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:14.949 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:19:14.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:19:14.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:19:14.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:19:14.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:19:14.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:14 smithi027 bash[22610]: cluster 2024-08-31T02:19:12.916199+0000 mgr.a (mgr.14388) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:15.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:14 smithi191 bash[24992]: cluster 2024-08-31T02:19:12.916199+0000 mgr.a (mgr.14388) 342 : cluster [DBG] pgmap v238: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:15.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:15 smithi027 bash[22610]: audit 2024-08-31T02:19:14.549367+0000 mgr.a (mgr.14388) 343 : audit [DBG] from='client.21252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:16.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:15 smithi191 bash[24992]: audit 2024-08-31T02:19:14.549367+0000 mgr.a (mgr.14388) 343 : audit [DBG] from='client.21252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:16.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:15 smithi163 bash[24253]: audit 2024-08-31T02:19:14.549367+0000 mgr.a (mgr.14388) 343 : audit [DBG] from='client.21252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:16.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:16 smithi027 bash[22610]: cluster 2024-08-31T02:19:14.916696+0000 mgr.a (mgr.14388) 344 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:17.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:16 smithi191 bash[24992]: cluster 2024-08-31T02:19:14.916696+0000 mgr.a (mgr.14388) 344 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:17.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:16 smithi163 bash[24253]: cluster 2024-08-31T02:19:14.916696+0000 mgr.a (mgr.14388) 344 : cluster [DBG] pgmap v239: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:18.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:18 smithi027 bash[22610]: cluster 2024-08-31T02:19:16.917418+0000 mgr.a (mgr.14388) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:19.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:18 smithi191 bash[24992]: cluster 2024-08-31T02:19:16.917418+0000 mgr.a (mgr.14388) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:19.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:18 smithi163 bash[24253]: cluster 2024-08-31T02:19:16.917418+0000 mgr.a (mgr.14388) 345 : cluster [DBG] pgmap v240: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:19:19.951 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:19:19.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:19:20.704 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:19:20.704 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:19:20.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:19:20.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:19:20.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:19:20.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:20 smithi027 bash[22610]: cluster 2024-08-31T02:19:18.919612+0000 mgr.a (mgr.14388) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:21.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:20 smithi191 bash[24992]: cluster 2024-08-31T02:19:18.919612+0000 mgr.a (mgr.14388) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:21.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:20 smithi163 bash[24253]: cluster 2024-08-31T02:19:18.919612+0000 mgr.a (mgr.14388) 346 : cluster [DBG] pgmap v241: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:21.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:21 smithi027 bash[22610]: audit 2024-08-31T02:19:20.291386+0000 mgr.a (mgr.14388) 347 : audit [DBG] from='client.21330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:22.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:21 smithi191 bash[24992]: audit 2024-08-31T02:19:20.291386+0000 mgr.a (mgr.14388) 347 : audit [DBG] from='client.21330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:22.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:21 smithi163 bash[24253]: audit 2024-08-31T02:19:20.291386+0000 mgr.a (mgr.14388) 347 : audit [DBG] from='client.21330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:22.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:22 smithi027 bash[22610]: cluster 2024-08-31T02:19:20.920527+0000 mgr.a (mgr.14388) 348 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:23.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:22 smithi191 bash[24992]: cluster 2024-08-31T02:19:20.920527+0000 mgr.a (mgr.14388) 348 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:23.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:22 smithi163 bash[24253]: cluster 2024-08-31T02:19:20.920527+0000 mgr.a (mgr.14388) 348 : cluster [DBG] pgmap v242: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:25.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:24 smithi191 bash[24992]: cluster 2024-08-31T02:19:22.922627+0000 mgr.a (mgr.14388) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:25.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:24 smithi163 bash[24253]: cluster 2024-08-31T02:19:22.922627+0000 mgr.a (mgr.14388) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:25.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:24 smithi027 bash[22610]: cluster 2024-08-31T02:19:22.922627+0000 mgr.a (mgr.14388) 349 : cluster [DBG] pgmap v243: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:25.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:19:25.706 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:19:25.707 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:19:26.442 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:19:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:19:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:19:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:19:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:19:27.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:26 smithi191 bash[24992]: cluster 2024-08-31T02:19:24.923391+0000 mgr.a (mgr.14388) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:27.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:26 smithi163 bash[24253]: cluster 2024-08-31T02:19:24.923391+0000 mgr.a (mgr.14388) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:27.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:26 smithi027 bash[22610]: cluster 2024-08-31T02:19:24.923391+0000 mgr.a (mgr.14388) 350 : cluster [DBG] pgmap v244: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:28.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:27 smithi191 bash[24992]: audit 2024-08-31T02:19:26.040864+0000 mgr.a (mgr.14388) 351 : audit [DBG] from='client.21408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:28.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:27 smithi163 bash[24253]: audit 2024-08-31T02:19:26.040864+0000 mgr.a (mgr.14388) 351 : audit [DBG] from='client.21408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:28.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:27 smithi027 bash[22610]: audit 2024-08-31T02:19:26.040864+0000 mgr.a (mgr.14388) 351 : audit [DBG] from='client.21408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:29.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:28 smithi191 bash[24992]: cluster 2024-08-31T02:19:26.924327+0000 mgr.a (mgr.14388) 352 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:29.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:28 smithi163 bash[24253]: cluster 2024-08-31T02:19:26.924327+0000 mgr.a (mgr.14388) 352 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:29.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:28 smithi027 bash[22610]: cluster 2024-08-31T02:19:26.924327+0000 mgr.a (mgr.14388) 352 : cluster [DBG] pgmap v245: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:31.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:30 smithi191 bash[24992]: cluster 2024-08-31T02:19:28.926516+0000 mgr.a (mgr.14388) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:31.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:30 smithi163 bash[24253]: cluster 2024-08-31T02:19:28.926516+0000 mgr.a (mgr.14388) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:31.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:30 smithi027 bash[22610]: cluster 2024-08-31T02:19:28.926516+0000 mgr.a (mgr.14388) 353 : cluster [DBG] pgmap v246: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:31.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:19:31.444 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:19:31.444 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:19:32.185 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:19:32.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:19:32.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:19:32.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:19:32.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:19:33.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:32 smithi191 bash[24992]: cluster 2024-08-31T02:19:30.927294+0000 mgr.a (mgr.14388) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:33.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:32 smithi191 bash[24992]: audit 2024-08-31T02:19:31.783771+0000 mgr.a (mgr.14388) 355 : audit [DBG] from='client.21480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:33.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:32 smithi163 bash[24253]: cluster 2024-08-31T02:19:30.927294+0000 mgr.a (mgr.14388) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:33.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:32 smithi163 bash[24253]: audit 2024-08-31T02:19:31.783771+0000 mgr.a (mgr.14388) 355 : audit [DBG] from='client.21480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:33.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:32 smithi027 bash[22610]: cluster 2024-08-31T02:19:30.927294+0000 mgr.a (mgr.14388) 354 : cluster [DBG] pgmap v247: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:33.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:32 smithi027 bash[22610]: audit 2024-08-31T02:19:31.783771+0000 mgr.a (mgr.14388) 355 : audit [DBG] from='client.21480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:35.034 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:34 smithi191 bash[24992]: cluster 2024-08-31T02:19:32.929598+0000 mgr.a (mgr.14388) 356 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:35.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:34 smithi163 bash[24253]: cluster 2024-08-31T02:19:32.929598+0000 mgr.a (mgr.14388) 356 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:35.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:34 smithi027 bash[22610]: cluster 2024-08-31T02:19:32.929598+0000 mgr.a (mgr.14388) 356 : cluster [DBG] pgmap v248: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:19:37.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:36 smithi191 bash[24992]: cluster 2024-08-31T02:19:34.930441+0000 mgr.a (mgr.14388) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:37.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:19:37.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:19:37.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:19:37.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:36 smithi163 bash[24253]: cluster 2024-08-31T02:19:34.930441+0000 mgr.a (mgr.14388) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:37.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:36 smithi027 bash[22610]: cluster 2024-08-31T02:19:34.930441+0000 mgr.a (mgr.14388) 357 : cluster [DBG] pgmap v249: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:37.927 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:19:37.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:19:37.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:19:37.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:19:37.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:19:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:38 smithi191 bash[24992]: cluster 2024-08-31T02:19:36.931244+0000 mgr.a (mgr.14388) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:38 smithi191 bash[24992]: audit 2024-08-31T02:19:37.524886+0000 mgr.a (mgr.14388) 359 : audit [DBG] from='client.21555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:39.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:38 smithi191 bash[24992]: audit 2024-08-31T02:19:38.455690+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:19:39.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:38 smithi163 bash[24253]: cluster 2024-08-31T02:19:36.931244+0000 mgr.a (mgr.14388) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:39.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:38 smithi163 bash[24253]: audit 2024-08-31T02:19:37.524886+0000 mgr.a (mgr.14388) 359 : audit [DBG] from='client.21555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:39.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:38 smithi163 bash[24253]: audit 2024-08-31T02:19:38.455690+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:19:39.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:38 smithi027 bash[22610]: cluster 2024-08-31T02:19:36.931244+0000 mgr.a (mgr.14388) 358 : cluster [DBG] pgmap v250: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:39.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:38 smithi027 bash[22610]: audit 2024-08-31T02:19:37.524886+0000 mgr.a (mgr.14388) 359 : audit [DBG] from='client.21555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:39.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:38 smithi027 bash[22610]: audit 2024-08-31T02:19:38.455690+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:19:40.028 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:39 smithi027 bash[22610]: audit 2024-08-31T02:19:39.306370+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:19:40.029 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:39 smithi027 bash[22610]: audit 2024-08-31T02:19:39.308203+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:19:40.029 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:39 smithi027 bash[22610]: audit 2024-08-31T02:19:39.318660+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:19:40.029 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:39 smithi027 bash[22610]: audit 2024-08-31T02:19:39.321398+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:19:40.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:39 smithi191 bash[24992]: audit 2024-08-31T02:19:39.306370+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:19:40.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:39 smithi191 bash[24992]: audit 2024-08-31T02:19:39.308203+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:19:40.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:39 smithi191 bash[24992]: audit 2024-08-31T02:19:39.318660+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:19:40.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:39 smithi191 bash[24992]: audit 2024-08-31T02:19:39.321398+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:19:40.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:39 smithi163 bash[24253]: audit 2024-08-31T02:19:39.306370+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:19:40.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:39 smithi163 bash[24253]: audit 2024-08-31T02:19:39.308203+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:19:40.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:39 smithi163 bash[24253]: audit 2024-08-31T02:19:39.318660+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:19:40.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:39 smithi163 bash[24253]: audit 2024-08-31T02:19:39.321398+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:19:40.476 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:19:40 smithi027 bash[22863]: debug 2024-08-31T02:19:40.034+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:19:40.476 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:19:40 smithi027 bash[22863]: debug 2024-08-31T02:19:40.034+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:19:41.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:40 smithi191 bash[24992]: cluster 2024-08-31T02:19:38.933515+0000 mgr.a (mgr.14388) 360 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:19:41.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:40 smithi191 bash[24992]: audit 2024-08-31T02:19:39.323758+0000 mgr.a (mgr.14388) 361 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:19:41.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:40 smithi163 bash[24253]: cluster 2024-08-31T02:19:38.933515+0000 mgr.a (mgr.14388) 360 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:19:41.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:40 smithi163 bash[24253]: audit 2024-08-31T02:19:39.323758+0000 mgr.a (mgr.14388) 361 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:19:41.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:40 smithi027 bash[22610]: cluster 2024-08-31T02:19:38.933515+0000 mgr.a (mgr.14388) 360 : cluster [DBG] pgmap v251: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:19:41.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:40 smithi027 bash[22610]: audit 2024-08-31T02:19:39.323758+0000 mgr.a (mgr.14388) 361 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:19:42.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:41 smithi191 bash[24992]: audit 2024-08-31T02:19:40.035826+0000 mgr.a (mgr.14388) 362 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:19:42.035 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:41 smithi191 bash[24992]: cephadm 2024-08-31T02:19:40.037134+0000 mgr.a (mgr.14388) 363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:19:42.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:41 smithi163 bash[24253]: audit 2024-08-31T02:19:40.035826+0000 mgr.a (mgr.14388) 362 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:19:42.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:41 smithi163 bash[24253]: cephadm 2024-08-31T02:19:40.037134+0000 mgr.a (mgr.14388) 363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:19:42.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:41 smithi027 bash[22610]: audit 2024-08-31T02:19:40.035826+0000 mgr.a (mgr.14388) 362 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:19:42.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:41 smithi027 bash[22610]: cephadm 2024-08-31T02:19:40.037134+0000 mgr.a (mgr.14388) 363 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:19:42.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:19:42.929 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:19:42.930 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:19:43.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:42 smithi163 bash[24253]: cluster 2024-08-31T02:19:40.934454+0000 mgr.a (mgr.14388) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:19:43.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:42 smithi027 bash[22610]: cluster 2024-08-31T02:19:40.934454+0000 mgr.a (mgr.14388) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:19:43.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:42 smithi191 bash[24992]: cluster 2024-08-31T02:19:40.934454+0000 mgr.a (mgr.14388) 364 : cluster [DBG] pgmap v252: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:19:43.685 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:19:43.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:19:43.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:19:43.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:19:43.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:19:45.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:44 smithi163 bash[24253]: cluster 2024-08-31T02:19:42.936666+0000 mgr.a (mgr.14388) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:19:45.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:44 smithi163 bash[24253]: audit 2024-08-31T02:19:43.272664+0000 mgr.a (mgr.14388) 366 : audit [DBG] from='client.21732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:45.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:44 smithi027 bash[22610]: cluster 2024-08-31T02:19:42.936666+0000 mgr.a (mgr.14388) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:19:45.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:44 smithi027 bash[22610]: audit 2024-08-31T02:19:43.272664+0000 mgr.a (mgr.14388) 366 : audit [DBG] from='client.21732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:45.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:44 smithi191 bash[24992]: cluster 2024-08-31T02:19:42.936666+0000 mgr.a (mgr.14388) 365 : cluster [DBG] pgmap v253: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:19:45.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:44 smithi191 bash[24992]: audit 2024-08-31T02:19:43.272664+0000 mgr.a (mgr.14388) 366 : audit [DBG] from='client.21732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:47.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:46 smithi163 bash[24253]: cluster 2024-08-31T02:19:44.937618+0000 mgr.a (mgr.14388) 367 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:19:47.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:46 smithi027 bash[22610]: cluster 2024-08-31T02:19:44.937618+0000 mgr.a (mgr.14388) 367 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:19:47.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:46 smithi191 bash[24992]: cluster 2024-08-31T02:19:44.937618+0000 mgr.a (mgr.14388) 367 : cluster [DBG] pgmap v254: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:19:48.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:19:48.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:19:48.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:19:49.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:48 smithi163 bash[24253]: cluster 2024-08-31T02:19:46.938546+0000 mgr.a (mgr.14388) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:19:49.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:48 smithi027 bash[22610]: cluster 2024-08-31T02:19:46.938546+0000 mgr.a (mgr.14388) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:19:49.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:48 smithi191 bash[24992]: cluster 2024-08-31T02:19:46.938546+0000 mgr.a (mgr.14388) 368 : cluster [DBG] pgmap v255: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:19:49.458 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:19:49.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:19:49.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:19:49.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:19:49.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:19:50.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:49 smithi163 bash[24253]: cluster 2024-08-31T02:19:48.940703+0000 mgr.a (mgr.14388) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:19:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:49 smithi163 bash[24253]: audit 2024-08-31T02:19:49.035142+0000 mgr.a (mgr.14388) 370 : audit [DBG] from='client.21807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:49 smithi027 bash[22610]: cluster 2024-08-31T02:19:48.940703+0000 mgr.a (mgr.14388) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:19:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:49 smithi027 bash[22610]: audit 2024-08-31T02:19:49.035142+0000 mgr.a (mgr.14388) 370 : audit [DBG] from='client.21807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:50.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:49 smithi191 bash[24992]: cluster 2024-08-31T02:19:48.940703+0000 mgr.a (mgr.14388) 369 : cluster [DBG] pgmap v256: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:19:50.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:49 smithi191 bash[24992]: audit 2024-08-31T02:19:49.035142+0000 mgr.a (mgr.14388) 370 : audit [DBG] from='client.21807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:52.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:51 smithi191 bash[24992]: cluster 2024-08-31T02:19:50.941628+0000 mgr.a (mgr.14388) 371 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:19:52.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:51 smithi163 bash[24253]: cluster 2024-08-31T02:19:50.941628+0000 mgr.a (mgr.14388) 371 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:19:52.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:51 smithi027 bash[22610]: cluster 2024-08-31T02:19:50.941628+0000 mgr.a (mgr.14388) 371 : cluster [DBG] pgmap v257: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:19:54.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:53 smithi191 bash[24992]: cluster 2024-08-31T02:19:52.943789+0000 mgr.a (mgr.14388) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:19:54.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:54 smithi163 bash[24253]: cluster 2024-08-31T02:19:52.943789+0000 mgr.a (mgr.14388) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:19:54.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:19:54.460 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:19:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:19:54.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:54 smithi027 bash[22610]: cluster 2024-08-31T02:19:52.943789+0000 mgr.a (mgr.14388) 372 : cluster [DBG] pgmap v258: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:19:55.215 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:19:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:19:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:19:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:19:55.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:19:55.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:55 smithi191 bash[24992]: audit 2024-08-31T02:19:54.800853+0000 mgr.a (mgr.14388) 373 : audit [DBG] from='client.21882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:55.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:55 smithi163 bash[24253]: audit 2024-08-31T02:19:54.800853+0000 mgr.a (mgr.14388) 373 : audit [DBG] from='client.21882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:55.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:55 smithi027 bash[22610]: audit 2024-08-31T02:19:54.800853+0000 mgr.a (mgr.14388) 373 : audit [DBG] from='client.21882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:19:56.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:56 smithi191 bash[24992]: cluster 2024-08-31T02:19:54.944328+0000 mgr.a (mgr.14388) 374 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:56.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:56 smithi163 bash[24253]: cluster 2024-08-31T02:19:54.944328+0000 mgr.a (mgr.14388) 374 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:56.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:56 smithi027 bash[22610]: cluster 2024-08-31T02:19:54.944328+0000 mgr.a (mgr.14388) 374 : cluster [DBG] pgmap v259: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:58.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:19:58 smithi191 bash[24992]: cluster 2024-08-31T02:19:56.945328+0000 mgr.a (mgr.14388) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:58.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:19:58 smithi163 bash[24253]: cluster 2024-08-31T02:19:56.945328+0000 mgr.a (mgr.14388) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:19:58.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:19:58 smithi027 bash[22610]: cluster 2024-08-31T02:19:56.945328+0000 mgr.a (mgr.14388) 375 : cluster [DBG] pgmap v260: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:00.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:00.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:00.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:00 smithi191 bash[24992]: cluster 2024-08-31T02:19:58.947556+0000 mgr.a (mgr.14388) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:00.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:00 smithi191 bash[24992]: cluster 2024-08-31T02:20:00.000175+0000 mon.a (mon.0) 650 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:20:00.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:00 smithi191 bash[24992]: cluster 2024-08-31T02:20:00.000233+0000 mon.a (mon.0) 651 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-08-31T02:20:00.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:00 smithi191 bash[24992]: cluster 2024-08-31T02:20:00.000270+0000 mon.a (mon.0) 652 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:20:00.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:00 smithi163 bash[24253]: cluster 2024-08-31T02:19:58.947556+0000 mgr.a (mgr.14388) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:00.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:00 smithi163 bash[24253]: cluster 2024-08-31T02:20:00.000175+0000 mon.a (mon.0) 650 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:20:00.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:00 smithi163 bash[24253]: cluster 2024-08-31T02:20:00.000233+0000 mon.a (mon.0) 651 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-08-31T02:20:00.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:00 smithi163 bash[24253]: cluster 2024-08-31T02:20:00.000270+0000 mon.a (mon.0) 652 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:20:00.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:00 smithi027 bash[22610]: cluster 2024-08-31T02:19:58.947556+0000 mgr.a (mgr.14388) 376 : cluster [DBG] pgmap v261: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:00.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:00 smithi027 bash[22610]: cluster 2024-08-31T02:20:00.000175+0000 mon.a (mon.0) 650 : cluster [WRN] Health detail: HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:20:00.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:00 smithi027 bash[22610]: cluster 2024-08-31T02:20:00.000233+0000 mon.a (mon.0) 651 : cluster [WRN] [WRN] CEPHADM_RGW: Cannot update rgw endpoints, error: {err} 2024-08-31T02:20:00.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:00 smithi027 bash[22610]: cluster 2024-08-31T02:20:00.000270+0000 mon.a (mon.0) 652 : cluster [WRN] Cannot update rgw endpoints for daemon rgw.myrealm1.myzone1, error: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:20:00.996 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:00.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:00.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:00.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:00.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:01.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:01 smithi191 bash[24992]: audit 2024-08-31T02:20:00.561139+0000 mgr.a (mgr.14388) 377 : audit [DBG] from='client.21957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:01.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:01 smithi163 bash[24253]: audit 2024-08-31T02:20:00.561139+0000 mgr.a (mgr.14388) 377 : audit [DBG] from='client.21957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:01.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:01 smithi027 bash[22610]: audit 2024-08-31T02:20:00.561139+0000 mgr.a (mgr.14388) 377 : audit [DBG] from='client.21957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:02.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:02 smithi191 bash[24992]: cluster 2024-08-31T02:20:00.948541+0000 mgr.a (mgr.14388) 378 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:02.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:02 smithi163 bash[24253]: cluster 2024-08-31T02:20:00.948541+0000 mgr.a (mgr.14388) 378 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:02.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:02 smithi027 bash[22610]: cluster 2024-08-31T02:20:00.948541+0000 mgr.a (mgr.14388) 378 : cluster [DBG] pgmap v262: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:04.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:04 smithi191 bash[24992]: cluster 2024-08-31T02:20:02.950672+0000 mgr.a (mgr.14388) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:04.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:04 smithi163 bash[24253]: cluster 2024-08-31T02:20:02.950672+0000 mgr.a (mgr.14388) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:04.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:04 smithi027 bash[22610]: cluster 2024-08-31T02:20:02.950672+0000 mgr.a (mgr.14388) 379 : cluster [DBG] pgmap v263: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:05.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:05.999 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:06.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:06 smithi191 bash[24992]: cluster 2024-08-31T02:20:04.951427+0000 mgr.a (mgr.14388) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:06.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:06 smithi163 bash[24253]: cluster 2024-08-31T02:20:04.951427+0000 mgr.a (mgr.14388) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:06.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:06 smithi027 bash[22610]: cluster 2024-08-31T02:20:04.951427+0000 mgr.a (mgr.14388) 380 : cluster [DBG] pgmap v264: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:06.737 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:06.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:06.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:06.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:06.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:07.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:07 smithi163 bash[24253]: audit 2024-08-31T02:20:06.339725+0000 mgr.a (mgr.14388) 381 : audit [DBG] from='client.22029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:07.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:07 smithi027 bash[22610]: audit 2024-08-31T02:20:06.339725+0000 mgr.a (mgr.14388) 381 : audit [DBG] from='client.22029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:07.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:07 smithi191 bash[24992]: audit 2024-08-31T02:20:06.339725+0000 mgr.a (mgr.14388) 381 : audit [DBG] from='client.22029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:08.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:08 smithi163 bash[24253]: cluster 2024-08-31T02:20:06.952318+0000 mgr.a (mgr.14388) 382 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:08.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:08 smithi027 bash[22610]: cluster 2024-08-31T02:20:06.952318+0000 mgr.a (mgr.14388) 382 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:08 smithi191 bash[24992]: cluster 2024-08-31T02:20:06.952318+0000 mgr.a (mgr.14388) 382 : cluster [DBG] pgmap v265: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:10.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:10 smithi163 bash[24253]: cluster 2024-08-31T02:20:08.954496+0000 mgr.a (mgr.14388) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:10.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:10 smithi027 bash[22610]: cluster 2024-08-31T02:20:08.954496+0000 mgr.a (mgr.14388) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:10.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:10 smithi191 bash[24992]: cluster 2024-08-31T02:20:08.954496+0000 mgr.a (mgr.14388) 383 : cluster [DBG] pgmap v266: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:11.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:11.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:11.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:12.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:12 smithi163 bash[24253]: cluster 2024-08-31T02:20:10.955284+0000 mgr.a (mgr.14388) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:12.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:12 smithi027 bash[22610]: cluster 2024-08-31T02:20:10.955284+0000 mgr.a (mgr.14388) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:12.476 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:12.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:12.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:12.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:12.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:12.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:12 smithi191 bash[24992]: cluster 2024-08-31T02:20:10.955284+0000 mgr.a (mgr.14388) 384 : cluster [DBG] pgmap v267: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:13.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:13 smithi163 bash[24253]: audit 2024-08-31T02:20:12.078870+0000 mgr.a (mgr.14388) 385 : audit [DBG] from='client.22107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:13.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:13 smithi027 bash[22610]: audit 2024-08-31T02:20:12.078870+0000 mgr.a (mgr.14388) 385 : audit [DBG] from='client.22107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:13.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:13 smithi191 bash[24992]: audit 2024-08-31T02:20:12.078870+0000 mgr.a (mgr.14388) 385 : audit [DBG] from='client.22107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:14.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:14 smithi163 bash[24253]: cluster 2024-08-31T02:20:12.957530+0000 mgr.a (mgr.14388) 386 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:14.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:14 smithi027 bash[22610]: cluster 2024-08-31T02:20:12.957530+0000 mgr.a (mgr.14388) 386 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:14.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:14 smithi191 bash[24992]: cluster 2024-08-31T02:20:12.957530+0000 mgr.a (mgr.14388) 386 : cluster [DBG] pgmap v268: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:16.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:16 smithi163 bash[24253]: cluster 2024-08-31T02:20:14.958313+0000 mgr.a (mgr.14388) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:16.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:16 smithi027 bash[22610]: cluster 2024-08-31T02:20:14.958313+0000 mgr.a (mgr.14388) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:16.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:16 smithi191 bash[24992]: cluster 2024-08-31T02:20:14.958313+0000 mgr.a (mgr.14388) 387 : cluster [DBG] pgmap v269: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:17.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:17.479 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:17.479 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:18.213 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:18.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:18.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:18.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:18.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:18.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:18 smithi163 bash[24253]: cluster 2024-08-31T02:20:16.959094+0000 mgr.a (mgr.14388) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:18.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:18 smithi163 bash[24253]: audit 2024-08-31T02:20:17.816827+0000 mgr.a (mgr.14388) 389 : audit [DBG] from='client.22185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:18.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:18 smithi027 bash[22610]: cluster 2024-08-31T02:20:16.959094+0000 mgr.a (mgr.14388) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:18.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:18 smithi027 bash[22610]: audit 2024-08-31T02:20:17.816827+0000 mgr.a (mgr.14388) 389 : audit [DBG] from='client.22185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:18.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:18 smithi191 bash[24992]: cluster 2024-08-31T02:20:16.959094+0000 mgr.a (mgr.14388) 388 : cluster [DBG] pgmap v270: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:18.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:18 smithi191 bash[24992]: audit 2024-08-31T02:20:17.816827+0000 mgr.a (mgr.14388) 389 : audit [DBG] from='client.22185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:20.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:20 smithi163 bash[24253]: cluster 2024-08-31T02:20:18.961846+0000 mgr.a (mgr.14388) 390 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:20.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:20 smithi027 bash[22610]: cluster 2024-08-31T02:20:18.961846+0000 mgr.a (mgr.14388) 390 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:20.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:20 smithi191 bash[24992]: cluster 2024-08-31T02:20:18.961846+0000 mgr.a (mgr.14388) 390 : cluster [DBG] pgmap v271: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:22.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:22 smithi163 bash[24253]: cluster 2024-08-31T02:20:20.962648+0000 mgr.a (mgr.14388) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:20:22.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:22 smithi027 bash[22610]: cluster 2024-08-31T02:20:20.962648+0000 mgr.a (mgr.14388) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:20:22.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:22 smithi191 bash[24992]: cluster 2024-08-31T02:20:20.962648+0000 mgr.a (mgr.14388) 391 : cluster [DBG] pgmap v272: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:20:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:23.955 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:23.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:23.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:23.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:23.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:24.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:24 smithi163 bash[24253]: cluster 2024-08-31T02:20:22.964565+0000 mgr.a (mgr.14388) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:24.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:24 smithi163 bash[24253]: audit 2024-08-31T02:20:23.549306+0000 mgr.a (mgr.14388) 393 : audit [DBG] from='client.22257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:24.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:24 smithi027 bash[22610]: cluster 2024-08-31T02:20:22.964565+0000 mgr.a (mgr.14388) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:24.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:24 smithi027 bash[22610]: audit 2024-08-31T02:20:23.549306+0000 mgr.a (mgr.14388) 393 : audit [DBG] from='client.22257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:24.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:24 smithi191 bash[24992]: cluster 2024-08-31T02:20:22.964565+0000 mgr.a (mgr.14388) 392 : cluster [DBG] pgmap v273: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:24.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:24 smithi191 bash[24992]: audit 2024-08-31T02:20:23.549306+0000 mgr.a (mgr.14388) 393 : audit [DBG] from='client.22257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:26.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:26 smithi163 bash[24253]: cluster 2024-08-31T02:20:24.965489+0000 mgr.a (mgr.14388) 394 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:20:26.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:26 smithi027 bash[22610]: cluster 2024-08-31T02:20:24.965489+0000 mgr.a (mgr.14388) 394 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:20:26.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:26 smithi191 bash[24992]: cluster 2024-08-31T02:20:24.965489+0000 mgr.a (mgr.14388) 394 : cluster [DBG] pgmap v274: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:20:28.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:28 smithi163 bash[24253]: cluster 2024-08-31T02:20:26.966293+0000 mgr.a (mgr.14388) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:20:28.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:28 smithi027 bash[22610]: cluster 2024-08-31T02:20:26.966293+0000 mgr.a (mgr.14388) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:20:28.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:28 smithi191 bash[24992]: cluster 2024-08-31T02:20:26.966293+0000 mgr.a (mgr.14388) 395 : cluster [DBG] pgmap v275: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:20:28.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:28.957 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:28.957 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:29.698 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:29.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:29.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:29.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:29.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:30.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:30 smithi163 bash[24253]: cluster 2024-08-31T02:20:28.968464+0000 mgr.a (mgr.14388) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:30.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:30 smithi163 bash[24253]: audit 2024-08-31T02:20:29.294322+0000 mgr.a (mgr.14388) 397 : audit [DBG] from='client.22329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:30.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:30 smithi027 bash[22610]: cluster 2024-08-31T02:20:28.968464+0000 mgr.a (mgr.14388) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:30.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:30 smithi027 bash[22610]: audit 2024-08-31T02:20:29.294322+0000 mgr.a (mgr.14388) 397 : audit [DBG] from='client.22329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:30.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:30 smithi191 bash[24992]: cluster 2024-08-31T02:20:28.968464+0000 mgr.a (mgr.14388) 396 : cluster [DBG] pgmap v276: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:30.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:30 smithi191 bash[24992]: audit 2024-08-31T02:20:29.294322+0000 mgr.a (mgr.14388) 397 : audit [DBG] from='client.22329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:32.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:32 smithi163 bash[24253]: cluster 2024-08-31T02:20:30.969325+0000 mgr.a (mgr.14388) 398 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:32.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:32 smithi027 bash[22610]: cluster 2024-08-31T02:20:30.969325+0000 mgr.a (mgr.14388) 398 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:32.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:32 smithi191 bash[24992]: cluster 2024-08-31T02:20:30.969325+0000 mgr.a (mgr.14388) 398 : cluster [DBG] pgmap v277: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:34.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:34 smithi163 bash[24253]: cluster 2024-08-31T02:20:32.971566+0000 mgr.a (mgr.14388) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:34.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:34 smithi027 bash[22610]: cluster 2024-08-31T02:20:32.971566+0000 mgr.a (mgr.14388) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:34.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:34 smithi191 bash[24992]: cluster 2024-08-31T02:20:32.971566+0000 mgr.a (mgr.14388) 399 : cluster [DBG] pgmap v278: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:34.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:34.701 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:34.701 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:35.469 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:35.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:35.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:35.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:35.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:36.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:36 smithi163 bash[24253]: cluster 2024-08-31T02:20:34.972117+0000 mgr.a (mgr.14388) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:36.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:36 smithi163 bash[24253]: audit 2024-08-31T02:20:35.046847+0000 mgr.a (mgr.14388) 401 : audit [DBG] from='client.22404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:36.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:36 smithi027 bash[22610]: cluster 2024-08-31T02:20:34.972117+0000 mgr.a (mgr.14388) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:36.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:36 smithi027 bash[22610]: audit 2024-08-31T02:20:35.046847+0000 mgr.a (mgr.14388) 401 : audit [DBG] from='client.22404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:36.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:36 smithi191 bash[24992]: cluster 2024-08-31T02:20:34.972117+0000 mgr.a (mgr.14388) 400 : cluster [DBG] pgmap v279: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:36.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:36 smithi191 bash[24992]: audit 2024-08-31T02:20:35.046847+0000 mgr.a (mgr.14388) 401 : audit [DBG] from='client.22404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:38.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:38 smithi163 bash[24253]: cluster 2024-08-31T02:20:36.973082+0000 mgr.a (mgr.14388) 402 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:38.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:38 smithi027 bash[22610]: cluster 2024-08-31T02:20:36.973082+0000 mgr.a (mgr.14388) 402 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:38.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:38 smithi191 bash[24992]: cluster 2024-08-31T02:20:36.973082+0000 mgr.a (mgr.14388) 402 : cluster [DBG] pgmap v280: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:40.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:40 smithi163 bash[24253]: cluster 2024-08-31T02:20:38.975449+0000 mgr.a (mgr.14388) 403 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:40.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:40 smithi163 bash[24253]: audit 2024-08-31T02:20:40.087883+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:20:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:40.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:40.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:40 smithi027 bash[22610]: cluster 2024-08-31T02:20:38.975449+0000 mgr.a (mgr.14388) 403 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:40.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:40 smithi027 bash[22610]: audit 2024-08-31T02:20:40.087883+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:20:40.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:40 smithi191 bash[24992]: cluster 2024-08-31T02:20:38.975449+0000 mgr.a (mgr.14388) 403 : cluster [DBG] pgmap v281: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:20:40.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:40 smithi191 bash[24992]: audit 2024-08-31T02:20:40.087883+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:20:41.233 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:41.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:41.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:41.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:41.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:41.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:41 smithi163 bash[24253]: audit 2024-08-31T02:20:40.810588+0000 mgr.a (mgr.14388) 404 : audit [DBG] from='client.22482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:41.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:41 smithi163 bash[24253]: audit 2024-08-31T02:20:40.970591+0000 mon.a (mon.0) 654 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:20:41.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:41 smithi163 bash[24253]: audit 2024-08-31T02:20:40.971912+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:20:41.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:41 smithi163 bash[24253]: audit 2024-08-31T02:20:40.979595+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:20:41.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:41 smithi163 bash[24253]: audit 2024-08-31T02:20:40.982099+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:20:41.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:41 smithi027 bash[22610]: audit 2024-08-31T02:20:40.810588+0000 mgr.a (mgr.14388) 404 : audit [DBG] from='client.22482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:41.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:41 smithi027 bash[22610]: audit 2024-08-31T02:20:40.970591+0000 mon.a (mon.0) 654 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:20:41.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:41 smithi027 bash[22610]: audit 2024-08-31T02:20:40.971912+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:20:41.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:41 smithi027 bash[22610]: audit 2024-08-31T02:20:40.979595+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:20:41.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:41 smithi027 bash[22610]: audit 2024-08-31T02:20:40.982099+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:20:41.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:41 smithi191 bash[24992]: audit 2024-08-31T02:20:40.810588+0000 mgr.a (mgr.14388) 404 : audit [DBG] from='client.22482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:41.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:41 smithi191 bash[24992]: audit 2024-08-31T02:20:40.970591+0000 mon.a (mon.0) 654 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:20:41.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:41 smithi191 bash[24992]: audit 2024-08-31T02:20:40.971912+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:20:41.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:41 smithi191 bash[24992]: audit 2024-08-31T02:20:40.979595+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:20:41.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:41 smithi191 bash[24992]: audit 2024-08-31T02:20:40.982099+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:20:42.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:42 smithi027 bash[22610]: cluster 2024-08-31T02:20:40.975978+0000 mgr.a (mgr.14388) 405 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:42.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:42 smithi027 bash[22610]: audit 2024-08-31T02:20:40.983733+0000 mgr.a (mgr.14388) 406 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:20:42.225 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:20:41 smithi027 bash[22863]: debug 2024-08-31T02:20:41.909+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:20:42.226 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:20:41 smithi027 bash[22863]: debug 2024-08-31T02:20:41.913+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:20:42.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:42 smithi163 bash[24253]: cluster 2024-08-31T02:20:40.975978+0000 mgr.a (mgr.14388) 405 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:42.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:42 smithi163 bash[24253]: audit 2024-08-31T02:20:40.983733+0000 mgr.a (mgr.14388) 406 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:20:42.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:42 smithi191 bash[24992]: cluster 2024-08-31T02:20:40.975978+0000 mgr.a (mgr.14388) 405 : cluster [DBG] pgmap v282: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:42.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:42 smithi191 bash[24992]: audit 2024-08-31T02:20:40.983733+0000 mgr.a (mgr.14388) 406 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:20:43.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:43 smithi163 bash[24253]: audit 2024-08-31T02:20:41.913687+0000 mgr.a (mgr.14388) 407 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:20:43.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:43 smithi163 bash[24253]: cephadm 2024-08-31T02:20:41.914839+0000 mgr.a (mgr.14388) 408 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:20:43.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:43 smithi027 bash[22610]: audit 2024-08-31T02:20:41.913687+0000 mgr.a (mgr.14388) 407 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:20:43.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:43 smithi027 bash[22610]: cephadm 2024-08-31T02:20:41.914839+0000 mgr.a (mgr.14388) 408 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:20:43.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:43 smithi191 bash[24992]: audit 2024-08-31T02:20:41.913687+0000 mgr.a (mgr.14388) 407 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:20:43.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:43 smithi191 bash[24992]: cephadm 2024-08-31T02:20:41.914839+0000 mgr.a (mgr.14388) 408 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:20:44.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:44 smithi163 bash[24253]: cluster 2024-08-31T02:20:42.978261+0000 mgr.a (mgr.14388) 409 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:44.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:44 smithi027 bash[22610]: cluster 2024-08-31T02:20:42.978261+0000 mgr.a (mgr.14388) 409 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:44.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:44 smithi191 bash[24992]: cluster 2024-08-31T02:20:42.978261+0000 mgr.a (mgr.14388) 409 : cluster [DBG] pgmap v283: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:46.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:46.234 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:46.234 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:46.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:46 smithi163 bash[24253]: cluster 2024-08-31T02:20:44.979065+0000 mgr.a (mgr.14388) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:46.477 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:46 smithi027 bash[22610]: cluster 2024-08-31T02:20:44.979065+0000 mgr.a (mgr.14388) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:46.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:46 smithi191 bash[24992]: cluster 2024-08-31T02:20:44.979065+0000 mgr.a (mgr.14388) 410 : cluster [DBG] pgmap v284: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:47.003 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:47.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:47.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:47.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:47.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:47.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:47 smithi163 bash[24253]: audit 2024-08-31T02:20:46.584578+0000 mgr.a (mgr.14388) 411 : audit [DBG] from='client.22665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:47.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:47 smithi027 bash[22610]: audit 2024-08-31T02:20:46.584578+0000 mgr.a (mgr.14388) 411 : audit [DBG] from='client.22665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:47.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:47 smithi191 bash[24992]: audit 2024-08-31T02:20:46.584578+0000 mgr.a (mgr.14388) 411 : audit [DBG] from='client.22665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:48.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:48 smithi163 bash[24253]: cluster 2024-08-31T02:20:46.979666+0000 mgr.a (mgr.14388) 412 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:48.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:48 smithi027 bash[22610]: cluster 2024-08-31T02:20:46.979666+0000 mgr.a (mgr.14388) 412 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:48.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:48 smithi191 bash[24992]: cluster 2024-08-31T02:20:46.979666+0000 mgr.a (mgr.14388) 412 : cluster [DBG] pgmap v285: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:50.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:50 smithi163 bash[24253]: cluster 2024-08-31T02:20:48.981951+0000 mgr.a (mgr.14388) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:50.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:50 smithi027 bash[22610]: cluster 2024-08-31T02:20:48.981951+0000 mgr.a (mgr.14388) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:50.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:50 smithi191 bash[24992]: cluster 2024-08-31T02:20:48.981951+0000 mgr.a (mgr.14388) 413 : cluster [DBG] pgmap v286: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:52.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:52.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:52.008 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:52.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:52 smithi163 bash[24253]: cluster 2024-08-31T02:20:50.982762+0000 mgr.a (mgr.14388) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:52.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:52 smithi027 bash[22610]: cluster 2024-08-31T02:20:50.982762+0000 mgr.a (mgr.14388) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:52.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:52 smithi191 bash[24992]: cluster 2024-08-31T02:20:50.982762+0000 mgr.a (mgr.14388) 414 : cluster [DBG] pgmap v287: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:52.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:52.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:52.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:52.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:52.762 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:53.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:53 smithi163 bash[24253]: audit 2024-08-31T02:20:52.344670+0000 mgr.a (mgr.14388) 415 : audit [DBG] from='client.22737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:53.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:53 smithi027 bash[22610]: audit 2024-08-31T02:20:52.344670+0000 mgr.a (mgr.14388) 415 : audit [DBG] from='client.22737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:53.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:53 smithi191 bash[24992]: audit 2024-08-31T02:20:52.344670+0000 mgr.a (mgr.14388) 415 : audit [DBG] from='client.22737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:54.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:54 smithi163 bash[24253]: cluster 2024-08-31T02:20:52.984995+0000 mgr.a (mgr.14388) 416 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:54.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:54 smithi027 bash[22610]: cluster 2024-08-31T02:20:52.984995+0000 mgr.a (mgr.14388) 416 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:54.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:54 smithi191 bash[24992]: cluster 2024-08-31T02:20:52.984995+0000 mgr.a (mgr.14388) 416 : cluster [DBG] pgmap v288: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:20:56.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:56 smithi163 bash[24253]: cluster 2024-08-31T02:20:54.985796+0000 mgr.a (mgr.14388) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:56.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:56 smithi027 bash[22610]: cluster 2024-08-31T02:20:54.985796+0000 mgr.a (mgr.14388) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:56.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:56 smithi191 bash[24992]: cluster 2024-08-31T02:20:54.985796+0000 mgr.a (mgr.14388) 417 : cluster [DBG] pgmap v289: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:57.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:20:57.764 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:20:57.764 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:20:58.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:58 smithi163 bash[24253]: cluster 2024-08-31T02:20:56.986708+0000 mgr.a (mgr.14388) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:58.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:58 smithi027 bash[22610]: cluster 2024-08-31T02:20:56.986708+0000 mgr.a (mgr.14388) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:58.518 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:20:58.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:20:58.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:20:58.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:20:58.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:20:58.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:58 smithi191 bash[24992]: cluster 2024-08-31T02:20:56.986708+0000 mgr.a (mgr.14388) 418 : cluster [DBG] pgmap v290: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:20:59.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:20:59 smithi163 bash[24253]: audit 2024-08-31T02:20:58.104844+0000 mgr.a (mgr.14388) 419 : audit [DBG] from='client.22809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:59.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:20:59 smithi027 bash[22610]: audit 2024-08-31T02:20:58.104844+0000 mgr.a (mgr.14388) 419 : audit [DBG] from='client.22809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:20:59.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:20:59 smithi191 bash[24992]: audit 2024-08-31T02:20:58.104844+0000 mgr.a (mgr.14388) 419 : audit [DBG] from='client.22809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:00.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:00 smithi163 bash[24253]: cluster 2024-08-31T02:20:58.989493+0000 mgr.a (mgr.14388) 420 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:00.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:00 smithi027 bash[22610]: cluster 2024-08-31T02:20:58.989493+0000 mgr.a (mgr.14388) 420 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:00.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:00 smithi191 bash[24992]: cluster 2024-08-31T02:20:58.989493+0000 mgr.a (mgr.14388) 420 : cluster [DBG] pgmap v291: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:02.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:02 smithi027 bash[22610]: cluster 2024-08-31T02:21:00.990263+0000 mgr.a (mgr.14388) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:21:02.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:02 smithi191 bash[24992]: cluster 2024-08-31T02:21:00.990263+0000 mgr.a (mgr.14388) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:21:02.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:02 smithi163 bash[24253]: cluster 2024-08-31T02:21:00.990263+0000 mgr.a (mgr.14388) 421 : cluster [DBG] pgmap v292: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:21:03.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:21:03.520 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:21:03.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:21:04.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:21:04.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:21:04.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:21:04.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:21:04.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:21:04.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:04 smithi027 bash[22610]: cluster 2024-08-31T02:21:02.992090+0000 mgr.a (mgr.14388) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:04.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:04 smithi191 bash[24992]: cluster 2024-08-31T02:21:02.992090+0000 mgr.a (mgr.14388) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:04.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:04 smithi163 bash[24253]: cluster 2024-08-31T02:21:02.992090+0000 mgr.a (mgr.14388) 422 : cluster [DBG] pgmap v293: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:05.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:05 smithi027 bash[22610]: audit 2024-08-31T02:21:03.860223+0000 mgr.a (mgr.14388) 423 : audit [DBG] from='client.22887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:05.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:05 smithi191 bash[24992]: audit 2024-08-31T02:21:03.860223+0000 mgr.a (mgr.14388) 423 : audit [DBG] from='client.22887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:05.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:05 smithi163 bash[24253]: audit 2024-08-31T02:21:03.860223+0000 mgr.a (mgr.14388) 423 : audit [DBG] from='client.22887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:06.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:06 smithi027 bash[22610]: cluster 2024-08-31T02:21:04.992958+0000 mgr.a (mgr.14388) 424 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:21:06.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:06 smithi191 bash[24992]: cluster 2024-08-31T02:21:04.992958+0000 mgr.a (mgr.14388) 424 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:21:06.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:06 smithi163 bash[24253]: cluster 2024-08-31T02:21:04.992958+0000 mgr.a (mgr.14388) 424 : cluster [DBG] pgmap v294: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:21:08.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:08 smithi027 bash[22610]: cluster 2024-08-31T02:21:06.993777+0000 mgr.a (mgr.14388) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:21:08.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:08 smithi191 bash[24992]: cluster 2024-08-31T02:21:06.993777+0000 mgr.a (mgr.14388) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:21:08.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:08 smithi163 bash[24253]: cluster 2024-08-31T02:21:06.993777+0000 mgr.a (mgr.14388) 425 : cluster [DBG] pgmap v295: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:21:09.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:21:09.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:21:09.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:21:10.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:21:10.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:21:10.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:21:10.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:21:10.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:21:10.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:10 smithi027 bash[22610]: cluster 2024-08-31T02:21:08.995999+0000 mgr.a (mgr.14388) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:10.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:10 smithi027 bash[22610]: audit 2024-08-31T02:21:09.596090+0000 mgr.a (mgr.14388) 427 : audit [DBG] from='client.22959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:10.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:10 smithi191 bash[24992]: cluster 2024-08-31T02:21:08.995999+0000 mgr.a (mgr.14388) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:10.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:10 smithi191 bash[24992]: audit 2024-08-31T02:21:09.596090+0000 mgr.a (mgr.14388) 427 : audit [DBG] from='client.22959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:10.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:10 smithi163 bash[24253]: cluster 2024-08-31T02:21:08.995999+0000 mgr.a (mgr.14388) 426 : cluster [DBG] pgmap v296: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:10.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:10 smithi163 bash[24253]: audit 2024-08-31T02:21:09.596090+0000 mgr.a (mgr.14388) 427 : audit [DBG] from='client.22959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:12.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:12 smithi027 bash[22610]: cluster 2024-08-31T02:21:10.997051+0000 mgr.a (mgr.14388) 428 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:12.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:12 smithi191 bash[24992]: cluster 2024-08-31T02:21:10.997051+0000 mgr.a (mgr.14388) 428 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:12.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:12 smithi163 bash[24253]: cluster 2024-08-31T02:21:10.997051+0000 mgr.a (mgr.14388) 428 : cluster [DBG] pgmap v297: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:14.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:14 smithi191 bash[24992]: cluster 2024-08-31T02:21:12.999382+0000 mgr.a (mgr.14388) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:14.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:14 smithi163 bash[24253]: cluster 2024-08-31T02:21:12.999382+0000 mgr.a (mgr.14388) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:14.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:14 smithi027 bash[22610]: cluster 2024-08-31T02:21:12.999382+0000 mgr.a (mgr.14388) 429 : cluster [DBG] pgmap v298: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:15.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:21:15.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:21:15.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:21:15.764 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:21:15.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:21:15.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:21:15.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:21:15.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:21:16.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:16 smithi191 bash[24992]: cluster 2024-08-31T02:21:15.000325+0000 mgr.a (mgr.14388) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:16.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:16 smithi191 bash[24992]: audit 2024-08-31T02:21:15.356668+0000 mgr.a (mgr.14388) 431 : audit [DBG] from='client.23037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:16.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:16 smithi163 bash[24253]: cluster 2024-08-31T02:21:15.000325+0000 mgr.a (mgr.14388) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:16.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:16 smithi163 bash[24253]: audit 2024-08-31T02:21:15.356668+0000 mgr.a (mgr.14388) 431 : audit [DBG] from='client.23037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:16.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:16 smithi027 bash[22610]: cluster 2024-08-31T02:21:15.000325+0000 mgr.a (mgr.14388) 430 : cluster [DBG] pgmap v299: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:16.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:16 smithi027 bash[22610]: audit 2024-08-31T02:21:15.356668+0000 mgr.a (mgr.14388) 431 : audit [DBG] from='client.23037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:18.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:18 smithi191 bash[24992]: cluster 2024-08-31T02:21:17.001216+0000 mgr.a (mgr.14388) 432 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:18.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:18 smithi163 bash[24253]: cluster 2024-08-31T02:21:17.001216+0000 mgr.a (mgr.14388) 432 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:18.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:18 smithi027 bash[22610]: cluster 2024-08-31T02:21:17.001216+0000 mgr.a (mgr.14388) 432 : cluster [DBG] pgmap v300: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:20.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:20 smithi191 bash[24992]: cluster 2024-08-31T02:21:19.003434+0000 mgr.a (mgr.14388) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:20.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:20 smithi163 bash[24253]: cluster 2024-08-31T02:21:19.003434+0000 mgr.a (mgr.14388) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:20.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:20 smithi027 bash[22610]: cluster 2024-08-31T02:21:19.003434+0000 mgr.a (mgr.14388) 433 : cluster [DBG] pgmap v301: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:20.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:21:20.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:21:20.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:21:21.507 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:21:21.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:21:21.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:21:21.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:21:21.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:21:22.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:22 smithi191 bash[24992]: cluster 2024-08-31T02:21:21.004169+0000 mgr.a (mgr.14388) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:22.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:22 smithi191 bash[24992]: audit 2024-08-31T02:21:21.106707+0000 mgr.a (mgr.14388) 435 : audit [DBG] from='client.23115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:22.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:22 smithi163 bash[24253]: cluster 2024-08-31T02:21:21.004169+0000 mgr.a (mgr.14388) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:22.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:22 smithi163 bash[24253]: audit 2024-08-31T02:21:21.106707+0000 mgr.a (mgr.14388) 435 : audit [DBG] from='client.23115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:22.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:22 smithi027 bash[22610]: cluster 2024-08-31T02:21:21.004169+0000 mgr.a (mgr.14388) 434 : cluster [DBG] pgmap v302: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:22.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:22 smithi027 bash[22610]: audit 2024-08-31T02:21:21.106707+0000 mgr.a (mgr.14388) 435 : audit [DBG] from='client.23115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:24.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:24 smithi191 bash[24992]: cluster 2024-08-31T02:21:23.006326+0000 mgr.a (mgr.14388) 436 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:24.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:24 smithi163 bash[24253]: cluster 2024-08-31T02:21:23.006326+0000 mgr.a (mgr.14388) 436 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:24.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:24 smithi027 bash[22610]: cluster 2024-08-31T02:21:23.006326+0000 mgr.a (mgr.14388) 436 : cluster [DBG] pgmap v303: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:26.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:21:26.509 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:21:26.509 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:21:26.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:26 smithi191 bash[24992]: cluster 2024-08-31T02:21:25.007118+0000 mgr.a (mgr.14388) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:26.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:26 smithi163 bash[24253]: cluster 2024-08-31T02:21:25.007118+0000 mgr.a (mgr.14388) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:26.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:26 smithi027 bash[22610]: cluster 2024-08-31T02:21:25.007118+0000 mgr.a (mgr.14388) 437 : cluster [DBG] pgmap v304: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:27.251 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:21:27.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:21:27.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:21:27.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:21:27.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:21:28.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:28 smithi191 bash[24992]: audit 2024-08-31T02:21:26.851363+0000 mgr.a (mgr.14388) 438 : audit [DBG] from='client.23193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:28.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:28 smithi191 bash[24992]: cluster 2024-08-31T02:21:27.007643+0000 mgr.a (mgr.14388) 439 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:28.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:28 smithi163 bash[24253]: audit 2024-08-31T02:21:26.851363+0000 mgr.a (mgr.14388) 438 : audit [DBG] from='client.23193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:28.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:28 smithi163 bash[24253]: cluster 2024-08-31T02:21:27.007643+0000 mgr.a (mgr.14388) 439 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:28.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:28 smithi027 bash[22610]: audit 2024-08-31T02:21:26.851363+0000 mgr.a (mgr.14388) 438 : audit [DBG] from='client.23193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:28.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:28 smithi027 bash[22610]: cluster 2024-08-31T02:21:27.007643+0000 mgr.a (mgr.14388) 439 : cluster [DBG] pgmap v305: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:30.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:30 smithi191 bash[24992]: cluster 2024-08-31T02:21:29.009876+0000 mgr.a (mgr.14388) 440 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:30.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:30 smithi163 bash[24253]: cluster 2024-08-31T02:21:29.009876+0000 mgr.a (mgr.14388) 440 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:30.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:30 smithi027 bash[22610]: cluster 2024-08-31T02:21:29.009876+0000 mgr.a (mgr.14388) 440 : cluster [DBG] pgmap v306: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:21:32.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:21:32.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:21:32.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:21:32.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:32 smithi191 bash[24992]: cluster 2024-08-31T02:21:31.010668+0000 mgr.a (mgr.14388) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:32.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:32 smithi163 bash[24253]: cluster 2024-08-31T02:21:31.010668+0000 mgr.a (mgr.14388) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:32.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:32 smithi027 bash[22610]: cluster 2024-08-31T02:21:31.010668+0000 mgr.a (mgr.14388) 441 : cluster [DBG] pgmap v307: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:33.026 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:21:33.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:21:33.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:21:33.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:21:33.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:21:33.534 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:33 smithi191 bash[24992]: audit 2024-08-31T02:21:32.596142+0000 mgr.a (mgr.14388) 442 : audit [DBG] from='client.23271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:33.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:33 smithi163 bash[24253]: audit 2024-08-31T02:21:32.596142+0000 mgr.a (mgr.14388) 442 : audit [DBG] from='client.23271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:33.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:33 smithi027 bash[22610]: audit 2024-08-31T02:21:32.596142+0000 mgr.a (mgr.14388) 442 : audit [DBG] from='client.23271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:34.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:34 smithi191 bash[24992]: cluster 2024-08-31T02:21:33.012136+0000 mgr.a (mgr.14388) 443 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:21:34.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:34 smithi163 bash[24253]: cluster 2024-08-31T02:21:33.012136+0000 mgr.a (mgr.14388) 443 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:21:34.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:34 smithi027 bash[22610]: cluster 2024-08-31T02:21:33.012136+0000 mgr.a (mgr.14388) 443 : cluster [DBG] pgmap v308: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:21:36.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:36 smithi191 bash[24992]: cluster 2024-08-31T02:21:35.012877+0000 mgr.a (mgr.14388) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:21:36.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:36 smithi163 bash[24253]: cluster 2024-08-31T02:21:35.012877+0000 mgr.a (mgr.14388) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:21:36.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:36 smithi027 bash[22610]: cluster 2024-08-31T02:21:35.012877+0000 mgr.a (mgr.14388) 444 : cluster [DBG] pgmap v309: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:21:38.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:21:38.028 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:21:38.028 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:21:38.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:38 smithi163 bash[24253]: cluster 2024-08-31T02:21:37.013649+0000 mgr.a (mgr.14388) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:21:38.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:38 smithi027 bash[22610]: cluster 2024-08-31T02:21:37.013649+0000 mgr.a (mgr.14388) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:21:38.770 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:21:38.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:21:38.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:21:38.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:21:38.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:21:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:38 smithi191 bash[24992]: cluster 2024-08-31T02:21:37.013649+0000 mgr.a (mgr.14388) 445 : cluster [DBG] pgmap v310: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:21:39.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:39 smithi163 bash[24253]: audit 2024-08-31T02:21:38.370023+0000 mgr.a (mgr.14388) 446 : audit [DBG] from='client.23349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:39.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:39 smithi027 bash[22610]: audit 2024-08-31T02:21:38.370023+0000 mgr.a (mgr.14388) 446 : audit [DBG] from='client.23349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:39.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:39 smithi191 bash[24992]: audit 2024-08-31T02:21:38.370023+0000 mgr.a (mgr.14388) 446 : audit [DBG] from='client.23349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:40.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:40 smithi163 bash[24253]: cluster 2024-08-31T02:21:39.016300+0000 mgr.a (mgr.14388) 447 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:40.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:40 smithi027 bash[22610]: cluster 2024-08-31T02:21:39.016300+0000 mgr.a (mgr.14388) 447 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:40.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:40 smithi191 bash[24992]: cluster 2024-08-31T02:21:39.016300+0000 mgr.a (mgr.14388) 447 : cluster [DBG] pgmap v311: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:42.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:42 smithi163 bash[24253]: cluster 2024-08-31T02:21:41.017200+0000 mgr.a (mgr.14388) 448 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:21:42.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:42 smithi163 bash[24253]: audit 2024-08-31T02:21:41.967016+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:21:42.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:42 smithi027 bash[22610]: cluster 2024-08-31T02:21:41.017200+0000 mgr.a (mgr.14388) 448 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:21:42.724 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:42 smithi027 bash[22610]: audit 2024-08-31T02:21:41.967016+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:21:42.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:42 smithi191 bash[24992]: cluster 2024-08-31T02:21:41.017200+0000 mgr.a (mgr.14388) 448 : cluster [DBG] pgmap v312: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:21:42.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:42 smithi191 bash[24992]: audit 2024-08-31T02:21:41.967016+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:21:43.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:43 smithi163 bash[24253]: audit 2024-08-31T02:21:42.822032+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:21:43.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:43 smithi163 bash[24253]: audit 2024-08-31T02:21:42.823878+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:21:43.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:43 smithi163 bash[24253]: audit 2024-08-31T02:21:42.834508+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:21:43.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:43 smithi163 bash[24253]: audit 2024-08-31T02:21:42.839340+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:21:43.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:43 smithi163 bash[24253]: audit 2024-08-31T02:21:42.841564+0000 mgr.a (mgr.14388) 449 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:21:43.724 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:21:43 smithi027 bash[22863]: debug 2024-08-31T02:21:43.540+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:21:43.725 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:21:43 smithi027 bash[22863]: debug 2024-08-31T02:21:43.544+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:21:43.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:43 smithi027 bash[22610]: audit 2024-08-31T02:21:42.822032+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:21:43.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:43 smithi027 bash[22610]: audit 2024-08-31T02:21:42.823878+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:21:43.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:43 smithi027 bash[22610]: audit 2024-08-31T02:21:42.834508+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:21:43.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:43 smithi027 bash[22610]: audit 2024-08-31T02:21:42.839340+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:21:43.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:43 smithi027 bash[22610]: audit 2024-08-31T02:21:42.841564+0000 mgr.a (mgr.14388) 449 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:21:43.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:21:43.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:21:43.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:21:43.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:43 smithi191 bash[24992]: audit 2024-08-31T02:21:42.822032+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:21:43.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:43 smithi191 bash[24992]: audit 2024-08-31T02:21:42.823878+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:21:43.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:43 smithi191 bash[24992]: audit 2024-08-31T02:21:42.834508+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:21:43.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:43 smithi191 bash[24992]: audit 2024-08-31T02:21:42.839340+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:21:43.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:43 smithi191 bash[24992]: audit 2024-08-31T02:21:42.841564+0000 mgr.a (mgr.14388) 449 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:21:44.511 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:21:44.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:21:44.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:21:44.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:21:44.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:21:45.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:44 smithi163 bash[24253]: cluster 2024-08-31T02:21:43.018489+0000 mgr.a (mgr.14388) 450 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:45.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:44 smithi163 bash[24253]: audit 2024-08-31T02:21:43.545706+0000 mgr.a (mgr.14388) 451 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:21:45.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:44 smithi163 bash[24253]: cephadm 2024-08-31T02:21:43.547182+0000 mgr.a (mgr.14388) 452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:21:45.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:44 smithi027 bash[22610]: cluster 2024-08-31T02:21:43.018489+0000 mgr.a (mgr.14388) 450 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:45.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:44 smithi027 bash[22610]: audit 2024-08-31T02:21:43.545706+0000 mgr.a (mgr.14388) 451 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:21:45.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:44 smithi027 bash[22610]: cephadm 2024-08-31T02:21:43.547182+0000 mgr.a (mgr.14388) 452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:21:45.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:44 smithi191 bash[24992]: cluster 2024-08-31T02:21:43.018489+0000 mgr.a (mgr.14388) 450 : cluster [DBG] pgmap v313: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:21:45.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:44 smithi191 bash[24992]: audit 2024-08-31T02:21:43.545706+0000 mgr.a (mgr.14388) 451 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:21:45.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:44 smithi191 bash[24992]: cephadm 2024-08-31T02:21:43.547182+0000 mgr.a (mgr.14388) 452 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:21:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:45 smithi163 bash[24253]: audit 2024-08-31T02:21:44.114928+0000 mgr.a (mgr.14388) 453 : audit [DBG] from='client.23535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:46.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:45 smithi027 bash[22610]: audit 2024-08-31T02:21:44.114928+0000 mgr.a (mgr.14388) 453 : audit [DBG] from='client.23535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:46.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:45 smithi191 bash[24992]: audit 2024-08-31T02:21:44.114928+0000 mgr.a (mgr.14388) 453 : audit [DBG] from='client.23535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:47.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:46 smithi163 bash[24253]: cluster 2024-08-31T02:21:45.019338+0000 mgr.a (mgr.14388) 454 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:21:47.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:46 smithi027 bash[22610]: cluster 2024-08-31T02:21:45.019338+0000 mgr.a (mgr.14388) 454 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:21:47.284 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:46 smithi191 bash[24992]: cluster 2024-08-31T02:21:45.019338+0000 mgr.a (mgr.14388) 454 : cluster [DBG] pgmap v314: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:21:49.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:48 smithi163 bash[24253]: cluster 2024-08-31T02:21:47.020116+0000 mgr.a (mgr.14388) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:21:49.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:48 smithi027 bash[22610]: cluster 2024-08-31T02:21:47.020116+0000 mgr.a (mgr.14388) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:21:49.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:48 smithi191 bash[24992]: cluster 2024-08-31T02:21:47.020116+0000 mgr.a (mgr.14388) 455 : cluster [DBG] pgmap v315: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:21:49.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:21:49.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:21:49.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:21:50.274 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:21:50.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:21:50.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:21:50.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:21:50.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:21:51.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:50 smithi163 bash[24253]: cluster 2024-08-31T02:21:49.022280+0000 mgr.a (mgr.14388) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:51.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:50 smithi163 bash[24253]: audit 2024-08-31T02:21:49.858414+0000 mgr.a (mgr.14388) 457 : audit [DBG] from='client.23613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:51.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:50 smithi027 bash[22610]: cluster 2024-08-31T02:21:49.022280+0000 mgr.a (mgr.14388) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:51.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:50 smithi027 bash[22610]: audit 2024-08-31T02:21:49.858414+0000 mgr.a (mgr.14388) 457 : audit [DBG] from='client.23613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:51.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:50 smithi191 bash[24992]: cluster 2024-08-31T02:21:49.022280+0000 mgr.a (mgr.14388) 456 : cluster [DBG] pgmap v316: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:51.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:50 smithi191 bash[24992]: audit 2024-08-31T02:21:49.858414+0000 mgr.a (mgr.14388) 457 : audit [DBG] from='client.23613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:53.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:52 smithi163 bash[24253]: cluster 2024-08-31T02:21:51.023156+0000 mgr.a (mgr.14388) 458 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:53.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:52 smithi027 bash[22610]: cluster 2024-08-31T02:21:51.023156+0000 mgr.a (mgr.14388) 458 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:53.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:52 smithi191 bash[24992]: cluster 2024-08-31T02:21:51.023156+0000 mgr.a (mgr.14388) 458 : cluster [DBG] pgmap v317: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:55.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:54 smithi163 bash[24253]: cluster 2024-08-31T02:21:53.025429+0000 mgr.a (mgr.14388) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:55.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:54 smithi027 bash[22610]: cluster 2024-08-31T02:21:53.025429+0000 mgr.a (mgr.14388) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:55.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:21:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:21:55.277 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:21:55.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:54 smithi191 bash[24992]: cluster 2024-08-31T02:21:53.025429+0000 mgr.a (mgr.14388) 459 : cluster [DBG] pgmap v318: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:56.038 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:21:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:21:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:21:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:21:56.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:21:57.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:56 smithi163 bash[24253]: cluster 2024-08-31T02:21:55.026378+0000 mgr.a (mgr.14388) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:57.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:56 smithi163 bash[24253]: audit 2024-08-31T02:21:55.618353+0000 mgr.a (mgr.14388) 461 : audit [DBG] from='client.23688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:57.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:56 smithi027 bash[22610]: cluster 2024-08-31T02:21:55.026378+0000 mgr.a (mgr.14388) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:57.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:56 smithi027 bash[22610]: audit 2024-08-31T02:21:55.618353+0000 mgr.a (mgr.14388) 461 : audit [DBG] from='client.23688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:57.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:56 smithi191 bash[24992]: cluster 2024-08-31T02:21:55.026378+0000 mgr.a (mgr.14388) 460 : cluster [DBG] pgmap v319: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:57.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:56 smithi191 bash[24992]: audit 2024-08-31T02:21:55.618353+0000 mgr.a (mgr.14388) 461 : audit [DBG] from='client.23688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:21:59.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:58 smithi163 bash[24253]: cluster 2024-08-31T02:21:57.027289+0000 mgr.a (mgr.14388) 462 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:59.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:58 smithi027 bash[22610]: cluster 2024-08-31T02:21:57.027289+0000 mgr.a (mgr.14388) 462 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:21:59.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:58 smithi191 bash[24992]: cluster 2024-08-31T02:21:57.027289+0000 mgr.a (mgr.14388) 462 : cluster [DBG] pgmap v320: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:22:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:21:59 smithi163 bash[24253]: cluster 2024-08-31T02:21:59.029498+0000 mgr.a (mgr.14388) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:22:00.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:21:59 smithi027 bash[22610]: cluster 2024-08-31T02:21:59.029498+0000 mgr.a (mgr.14388) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:22:00.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:21:59 smithi191 bash[24992]: cluster 2024-08-31T02:21:59.029498+0000 mgr.a (mgr.14388) 463 : cluster [DBG] pgmap v321: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:22:01.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:01.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:01.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:01.796 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:01.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:01.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:01.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:01.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:22:02.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:02 smithi163 bash[24253]: cluster 2024-08-31T02:22:01.030258+0000 mgr.a (mgr.14388) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:02.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:02 smithi163 bash[24253]: audit 2024-08-31T02:22:01.382420+0000 mgr.a (mgr.14388) 465 : audit [DBG] from='client.23766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:02.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:02 smithi027 bash[22610]: cluster 2024-08-31T02:22:01.030258+0000 mgr.a (mgr.14388) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:02.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:02 smithi027 bash[22610]: audit 2024-08-31T02:22:01.382420+0000 mgr.a (mgr.14388) 465 : audit [DBG] from='client.23766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:02.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:02 smithi191 bash[24992]: cluster 2024-08-31T02:22:01.030258+0000 mgr.a (mgr.14388) 464 : cluster [DBG] pgmap v322: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:02.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:02 smithi191 bash[24992]: audit 2024-08-31T02:22:01.382420+0000 mgr.a (mgr.14388) 465 : audit [DBG] from='client.23766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:04.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:04 smithi163 bash[24253]: cluster 2024-08-31T02:22:03.032533+0000 mgr.a (mgr.14388) 466 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:04.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:04 smithi027 bash[22610]: cluster 2024-08-31T02:22:03.032533+0000 mgr.a (mgr.14388) 466 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:04 smithi191 bash[24992]: cluster 2024-08-31T02:22:03.032533+0000 mgr.a (mgr.14388) 466 : cluster [DBG] pgmap v323: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:06.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:06 smithi163 bash[24253]: cluster 2024-08-31T02:22:05.033337+0000 mgr.a (mgr.14388) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:06.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:06 smithi027 bash[22610]: cluster 2024-08-31T02:22:05.033337+0000 mgr.a (mgr.14388) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:06.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:06 smithi191 bash[24992]: cluster 2024-08-31T02:22:05.033337+0000 mgr.a (mgr.14388) 467 : cluster [DBG] pgmap v324: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:06.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:06.799 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:06.799 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:07.580 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:07.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:07.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:07.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:07.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:22:08.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:08 smithi163 bash[24253]: cluster 2024-08-31T02:22:07.033891+0000 mgr.a (mgr.14388) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:08.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:08 smithi163 bash[24253]: audit 2024-08-31T02:22:07.145401+0000 mgr.a (mgr.14388) 469 : audit [DBG] from='client.23844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:08.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:08 smithi027 bash[22610]: cluster 2024-08-31T02:22:07.033891+0000 mgr.a (mgr.14388) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:08.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:08 smithi027 bash[22610]: audit 2024-08-31T02:22:07.145401+0000 mgr.a (mgr.14388) 469 : audit [DBG] from='client.23844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:08 smithi191 bash[24992]: cluster 2024-08-31T02:22:07.033891+0000 mgr.a (mgr.14388) 468 : cluster [DBG] pgmap v325: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:08 smithi191 bash[24992]: audit 2024-08-31T02:22:07.145401+0000 mgr.a (mgr.14388) 469 : audit [DBG] from='client.23844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:10.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:10 smithi163 bash[24253]: cluster 2024-08-31T02:22:09.036176+0000 mgr.a (mgr.14388) 470 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:10.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:10 smithi027 bash[22610]: cluster 2024-08-31T02:22:09.036176+0000 mgr.a (mgr.14388) 470 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:10.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:10 smithi191 bash[24992]: cluster 2024-08-31T02:22:09.036176+0000 mgr.a (mgr.14388) 470 : cluster [DBG] pgmap v326: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:12.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:12 smithi163 bash[24253]: cluster 2024-08-31T02:22:11.036940+0000 mgr.a (mgr.14388) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:12.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:12 smithi027 bash[22610]: cluster 2024-08-31T02:22:11.036940+0000 mgr.a (mgr.14388) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:12.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:12 smithi191 bash[24992]: cluster 2024-08-31T02:22:11.036940+0000 mgr.a (mgr.14388) 471 : cluster [DBG] pgmap v327: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:12.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:12.582 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:12.582 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:13.352 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:13.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:13.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:13.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:13.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:22:14.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:14 smithi163 bash[24253]: audit 2024-08-31T02:22:12.926666+0000 mgr.a (mgr.14388) 472 : audit [DBG] from='client.23919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:14.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:14 smithi163 bash[24253]: cluster 2024-08-31T02:22:13.038179+0000 mgr.a (mgr.14388) 473 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:14.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:14 smithi027 bash[22610]: audit 2024-08-31T02:22:12.926666+0000 mgr.a (mgr.14388) 472 : audit [DBG] from='client.23919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:14.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:14 smithi027 bash[22610]: cluster 2024-08-31T02:22:13.038179+0000 mgr.a (mgr.14388) 473 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:14.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:14 smithi191 bash[24992]: audit 2024-08-31T02:22:12.926666+0000 mgr.a (mgr.14388) 472 : audit [DBG] from='client.23919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:14.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:14 smithi191 bash[24992]: cluster 2024-08-31T02:22:13.038179+0000 mgr.a (mgr.14388) 473 : cluster [DBG] pgmap v328: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:16.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:16 smithi163 bash[24253]: cluster 2024-08-31T02:22:15.039027+0000 mgr.a (mgr.14388) 474 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:22:16.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:16 smithi027 bash[22610]: cluster 2024-08-31T02:22:15.039027+0000 mgr.a (mgr.14388) 474 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:22:16.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:16 smithi191 bash[24992]: cluster 2024-08-31T02:22:15.039027+0000 mgr.a (mgr.14388) 474 : cluster [DBG] pgmap v329: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:22:18.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:18.354 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:18.355 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:18.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:18 smithi163 bash[24253]: cluster 2024-08-31T02:22:17.039794+0000 mgr.a (mgr.14388) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:22:18.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:18 smithi027 bash[22610]: cluster 2024-08-31T02:22:17.039794+0000 mgr.a (mgr.14388) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:22:18.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:18 smithi191 bash[24992]: cluster 2024-08-31T02:22:17.039794+0000 mgr.a (mgr.14388) 475 : cluster [DBG] pgmap v330: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:22:19.126 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:19.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:19.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:19.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:19.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:22:19.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:19 smithi163 bash[24253]: audit 2024-08-31T02:22:18.703731+0000 mgr.a (mgr.14388) 476 : audit [DBG] from='client.23991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:19.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:19 smithi027 bash[22610]: audit 2024-08-31T02:22:18.703731+0000 mgr.a (mgr.14388) 476 : audit [DBG] from='client.23991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:19.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:19 smithi191 bash[24992]: audit 2024-08-31T02:22:18.703731+0000 mgr.a (mgr.14388) 476 : audit [DBG] from='client.23991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:20.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:20 smithi163 bash[24253]: cluster 2024-08-31T02:22:19.041528+0000 mgr.a (mgr.14388) 477 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:20.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:20 smithi027 bash[22610]: cluster 2024-08-31T02:22:19.041528+0000 mgr.a (mgr.14388) 477 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:20 smithi191 bash[24992]: cluster 2024-08-31T02:22:19.041528+0000 mgr.a (mgr.14388) 477 : cluster [DBG] pgmap v331: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:22.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:22 smithi163 bash[24253]: cluster 2024-08-31T02:22:21.042257+0000 mgr.a (mgr.14388) 478 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:22:22.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:22 smithi027 bash[22610]: cluster 2024-08-31T02:22:21.042257+0000 mgr.a (mgr.14388) 478 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:22:22.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:22 smithi191 bash[24992]: cluster 2024-08-31T02:22:21.042257+0000 mgr.a (mgr.14388) 478 : cluster [DBG] pgmap v332: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:22:24.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:24.129 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:24.129 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:24.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:24 smithi163 bash[24253]: cluster 2024-08-31T02:22:23.044266+0000 mgr.a (mgr.14388) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:24.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:24 smithi027 bash[22610]: cluster 2024-08-31T02:22:23.044266+0000 mgr.a (mgr.14388) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:24.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:24 smithi191 bash[24992]: cluster 2024-08-31T02:22:23.044266+0000 mgr.a (mgr.14388) 479 : cluster [DBG] pgmap v333: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:24.884 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:24.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:24.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:24.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:24.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:22:25.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:25 smithi163 bash[24253]: audit 2024-08-31T02:22:24.471390+0000 mgr.a (mgr.14388) 480 : audit [DBG] from='client.24069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:25.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:25 smithi027 bash[22610]: audit 2024-08-31T02:22:24.471390+0000 mgr.a (mgr.14388) 480 : audit [DBG] from='client.24069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:25.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:25 smithi191 bash[24992]: audit 2024-08-31T02:22:24.471390+0000 mgr.a (mgr.14388) 480 : audit [DBG] from='client.24069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:26.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:26 smithi163 bash[24253]: cluster 2024-08-31T02:22:25.045106+0000 mgr.a (mgr.14388) 481 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:26.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:26 smithi027 bash[22610]: cluster 2024-08-31T02:22:25.045106+0000 mgr.a (mgr.14388) 481 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:26 smithi191 bash[24992]: cluster 2024-08-31T02:22:25.045106+0000 mgr.a (mgr.14388) 481 : cluster [DBG] pgmap v334: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:28.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:28 smithi163 bash[24253]: cluster 2024-08-31T02:22:27.045851+0000 mgr.a (mgr.14388) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:28.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:28 smithi027 bash[22610]: cluster 2024-08-31T02:22:27.045851+0000 mgr.a (mgr.14388) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:28.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:28 smithi191 bash[24992]: cluster 2024-08-31T02:22:27.045851+0000 mgr.a (mgr.14388) 482 : cluster [DBG] pgmap v335: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:29.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:29.887 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:29.887 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:30.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:30 smithi163 bash[24253]: cluster 2024-08-31T02:22:29.048067+0000 mgr.a (mgr.14388) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 0 B/s wr, 121 op/s 2024-08-31T02:22:30.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:30 smithi027 bash[22610]: cluster 2024-08-31T02:22:29.048067+0000 mgr.a (mgr.14388) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 0 B/s wr, 121 op/s 2024-08-31T02:22:30.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:30 smithi191 bash[24992]: cluster 2024-08-31T02:22:29.048067+0000 mgr.a (mgr.14388) 483 : cluster [DBG] pgmap v336: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 0 B/s wr, 121 op/s 2024-08-31T02:22:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:30.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:30.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:30.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:30.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:22:31.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:31 smithi163 bash[24253]: audit 2024-08-31T02:22:30.229982+0000 mgr.a (mgr.14388) 484 : audit [DBG] from='client.24147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:31.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:31 smithi027 bash[22610]: audit 2024-08-31T02:22:30.229982+0000 mgr.a (mgr.14388) 484 : audit [DBG] from='client.24147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:31.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:31 smithi191 bash[24992]: audit 2024-08-31T02:22:30.229982+0000 mgr.a (mgr.14388) 484 : audit [DBG] from='client.24147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:32.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:32 smithi163 bash[24253]: cluster 2024-08-31T02:22:31.049034+0000 mgr.a (mgr.14388) 485 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:32.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:32 smithi027 bash[22610]: cluster 2024-08-31T02:22:31.049034+0000 mgr.a (mgr.14388) 485 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:32.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:32 smithi191 bash[24992]: cluster 2024-08-31T02:22:31.049034+0000 mgr.a (mgr.14388) 485 : cluster [DBG] pgmap v337: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-08-31T02:22:34.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:34 smithi163 bash[24253]: cluster 2024-08-31T02:22:33.051176+0000 mgr.a (mgr.14388) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 0 B/s wr, 121 op/s 2024-08-31T02:22:34.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:34 smithi027 bash[22610]: cluster 2024-08-31T02:22:33.051176+0000 mgr.a (mgr.14388) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 0 B/s wr, 121 op/s 2024-08-31T02:22:34.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:34 smithi191 bash[24992]: cluster 2024-08-31T02:22:33.051176+0000 mgr.a (mgr.14388) 486 : cluster [DBG] pgmap v338: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 74 KiB/s rd, 0 B/s wr, 121 op/s 2024-08-31T02:22:35.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:35.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:35.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:36.401 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:36.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:36.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:36.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:36.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:22:36.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:36 smithi163 bash[24253]: cluster 2024-08-31T02:22:35.051935+0000 mgr.a (mgr.14388) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:36.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:36 smithi027 bash[22610]: cluster 2024-08-31T02:22:35.051935+0000 mgr.a (mgr.14388) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:36.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:36 smithi191 bash[24992]: cluster 2024-08-31T02:22:35.051935+0000 mgr.a (mgr.14388) 487 : cluster [DBG] pgmap v339: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:37.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:37 smithi163 bash[24253]: audit 2024-08-31T02:22:35.988680+0000 mgr.a (mgr.14388) 488 : audit [DBG] from='client.24225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:37.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:37 smithi027 bash[22610]: audit 2024-08-31T02:22:35.988680+0000 mgr.a (mgr.14388) 488 : audit [DBG] from='client.24225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:37.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:37 smithi191 bash[24992]: audit 2024-08-31T02:22:35.988680+0000 mgr.a (mgr.14388) 488 : audit [DBG] from='client.24225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:38.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:38 smithi163 bash[24253]: cluster 2024-08-31T02:22:37.052997+0000 mgr.a (mgr.14388) 489 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:38.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:38 smithi027 bash[22610]: cluster 2024-08-31T02:22:37.052997+0000 mgr.a (mgr.14388) 489 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:38.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:38 smithi191 bash[24992]: cluster 2024-08-31T02:22:37.052997+0000 mgr.a (mgr.14388) 489 : cluster [DBG] pgmap v340: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:40.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:40 smithi163 bash[24253]: cluster 2024-08-31T02:22:39.055286+0000 mgr.a (mgr.14388) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:40.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:40 smithi027 bash[22610]: cluster 2024-08-31T02:22:39.055286+0000 mgr.a (mgr.14388) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:40.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:40 smithi191 bash[24992]: cluster 2024-08-31T02:22:39.055286+0000 mgr.a (mgr.14388) 490 : cluster [DBG] pgmap v341: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:41.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:41.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:41.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:42.172 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:42.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:42.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:42.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:42.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:22:42.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:42 smithi163 bash[24253]: cluster 2024-08-31T02:22:41.056053+0000 mgr.a (mgr.14388) 491 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:42.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:42 smithi163 bash[24253]: audit 2024-08-31T02:22:41.748660+0000 mgr.a (mgr.14388) 492 : audit [DBG] from='client.24303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:42.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:42 smithi027 bash[22610]: cluster 2024-08-31T02:22:41.056053+0000 mgr.a (mgr.14388) 491 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:42.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:42 smithi027 bash[22610]: audit 2024-08-31T02:22:41.748660+0000 mgr.a (mgr.14388) 492 : audit [DBG] from='client.24303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:42.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:42 smithi191 bash[24992]: cluster 2024-08-31T02:22:41.056053+0000 mgr.a (mgr.14388) 491 : cluster [DBG] pgmap v342: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:42.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:42 smithi191 bash[24992]: audit 2024-08-31T02:22:41.748660+0000 mgr.a (mgr.14388) 492 : audit [DBG] from='client.24303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:44.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:44 smithi163 bash[24253]: cluster 2024-08-31T02:22:43.058488+0000 mgr.a (mgr.14388) 493 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:44.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:44 smithi163 bash[24253]: audit 2024-08-31T02:22:43.601446+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:22:44.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:44 smithi027 bash[22610]: cluster 2024-08-31T02:22:43.058488+0000 mgr.a (mgr.14388) 493 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:44.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:44 smithi027 bash[22610]: audit 2024-08-31T02:22:43.601446+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:22:44.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:44 smithi191 bash[24992]: cluster 2024-08-31T02:22:43.058488+0000 mgr.a (mgr.14388) 493 : cluster [DBG] pgmap v343: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:22:44.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:44 smithi191 bash[24992]: audit 2024-08-31T02:22:43.601446+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:22:46.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:46 smithi027 bash[22610]: cluster 2024-08-31T02:22:45.059436+0000 mgr.a (mgr.14388) 494 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:46.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:46 smithi191 bash[24992]: cluster 2024-08-31T02:22:45.059436+0000 mgr.a (mgr.14388) 494 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:46.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:46 smithi163 bash[24253]: cluster 2024-08-31T02:22:45.059436+0000 mgr.a (mgr.14388) 494 : cluster [DBG] pgmap v344: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:47.174 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:47.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:47.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:47.911 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:47.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:47.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:47.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:47.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:22:48.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:48 smithi027 bash[22610]: cluster 2024-08-31T02:22:47.060348+0000 mgr.a (mgr.14388) 495 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:48.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:48 smithi027 bash[22610]: audit 2024-08-31T02:22:47.515390+0000 mgr.a (mgr.14388) 496 : audit [DBG] from='client.24378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:48.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:48 smithi191 bash[24992]: cluster 2024-08-31T02:22:47.060348+0000 mgr.a (mgr.14388) 495 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:48.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:48 smithi191 bash[24992]: audit 2024-08-31T02:22:47.515390+0000 mgr.a (mgr.14388) 496 : audit [DBG] from='client.24378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:48.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:48 smithi163 bash[24253]: cluster 2024-08-31T02:22:47.060348+0000 mgr.a (mgr.14388) 495 : cluster [DBG] pgmap v345: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:22:48.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:48 smithi163 bash[24253]: audit 2024-08-31T02:22:47.515390+0000 mgr.a (mgr.14388) 496 : audit [DBG] from='client.24378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:50.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:48.945529+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:48.949349+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:48.954447+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:48.959668+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:48.966901+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:48.972416+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: cluster 2024-08-31T02:22:49.062770+0000 mgr.a (mgr.14388) 497 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:49.679449+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:49.679837+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: cephadm 2024-08-31T02:22:49.680947+0000 mgr.a (mgr.14388) 498 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 20337M 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: cephadm 2024-08-31T02:22:49.681506+0000 mgr.a (mgr.14388) 499 : cephadm [INF] Adjusting osd_memory_target on smithi163 to 16241M 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:49.687357+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:49.694603+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:49.698585+0000 mon.a (mon.0) 674 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:22:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:49.700133+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:22:50.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:49.709520+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:49.712098+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:22:50.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:49 smithi163 bash[24253]: audit 2024-08-31T02:22:49.714312+0000 mgr.a (mgr.14388) 500 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:48.945529+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:48.949349+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:48.954447+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:48.959668+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:48.966901+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:48.972416+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: cluster 2024-08-31T02:22:49.062770+0000 mgr.a (mgr.14388) 497 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:49.679449+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:49.679837+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: cephadm 2024-08-31T02:22:49.680947+0000 mgr.a (mgr.14388) 498 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 20337M 2024-08-31T02:22:50.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: cephadm 2024-08-31T02:22:49.681506+0000 mgr.a (mgr.14388) 499 : cephadm [INF] Adjusting osd_memory_target on smithi163 to 16241M 2024-08-31T02:22:50.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:49.687357+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:49.694603+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:49.698585+0000 mon.a (mon.0) 674 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:22:50.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:49.700133+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:22:50.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:49.709520+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:49.712098+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:22:50.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:49 smithi027 bash[22610]: audit 2024-08-31T02:22:49.714312+0000 mgr.a (mgr.14388) 500 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:48.945529+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:48.949349+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:48.954447+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:48.959668+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:48.966901+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:48.972416+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: cluster 2024-08-31T02:22:49.062770+0000 mgr.a (mgr.14388) 497 : cluster [DBG] pgmap v346: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:49.679449+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:49.679837+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: cephadm 2024-08-31T02:22:49.680947+0000 mgr.a (mgr.14388) 498 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 20337M 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: cephadm 2024-08-31T02:22:49.681506+0000 mgr.a (mgr.14388) 499 : cephadm [INF] Adjusting osd_memory_target on smithi163 to 16241M 2024-08-31T02:22:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:49.687357+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:49.694603+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:49.698585+0000 mon.a (mon.0) 674 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:22:50.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:49.700133+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:22:50.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:49.709520+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:22:50.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:49.712098+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:22:50.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:49 smithi191 bash[24992]: audit 2024-08-31T02:22:49.714312+0000 mgr.a (mgr.14388) 500 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:22:50.725 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:22:50 smithi027 bash[22863]: debug 2024-08-31T02:22:50.418+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:22:50.725 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:22:50 smithi027 bash[22863]: debug 2024-08-31T02:22:50.418+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:22:51.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:50 smithi027 bash[22610]: audit 2024-08-31T02:22:50.420833+0000 mgr.a (mgr.14388) 501 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:22:51.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:50 smithi027 bash[22610]: cephadm 2024-08-31T02:22:50.422271+0000 mgr.a (mgr.14388) 502 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:22:51.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:50 smithi191 bash[24992]: audit 2024-08-31T02:22:50.420833+0000 mgr.a (mgr.14388) 501 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:22:51.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:50 smithi191 bash[24992]: cephadm 2024-08-31T02:22:50.422271+0000 mgr.a (mgr.14388) 502 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:22:51.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:50 smithi163 bash[24253]: audit 2024-08-31T02:22:50.420833+0000 mgr.a (mgr.14388) 501 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:22:51.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:50 smithi163 bash[24253]: cephadm 2024-08-31T02:22:50.422271+0000 mgr.a (mgr.14388) 502 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:22:52.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:51 smithi191 bash[24992]: cluster 2024-08-31T02:22:51.063754+0000 mgr.a (mgr.14388) 503 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:22:52.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:51 smithi163 bash[24253]: cluster 2024-08-31T02:22:51.063754+0000 mgr.a (mgr.14388) 503 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:22:52.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:51 smithi027 bash[22610]: cluster 2024-08-31T02:22:51.063754+0000 mgr.a (mgr.14388) 503 : cluster [DBG] pgmap v347: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:22:52.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:52.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:52.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:53.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:53.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:22:53.690 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:54.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:54 smithi163 bash[24253]: cluster 2024-08-31T02:22:53.064795+0000 mgr.a (mgr.14388) 504 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:22:54.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:54 smithi163 bash[24253]: audit 2024-08-31T02:22:53.259161+0000 mgr.a (mgr.14388) 505 : audit [DBG] from='client.24561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:54.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:54 smithi027 bash[22610]: cluster 2024-08-31T02:22:53.064795+0000 mgr.a (mgr.14388) 504 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:22:54.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:54 smithi027 bash[22610]: audit 2024-08-31T02:22:53.259161+0000 mgr.a (mgr.14388) 505 : audit [DBG] from='client.24561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:54.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:54 smithi191 bash[24992]: cluster 2024-08-31T02:22:53.064795+0000 mgr.a (mgr.14388) 504 : cluster [DBG] pgmap v348: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:22:54.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:54 smithi191 bash[24992]: audit 2024-08-31T02:22:53.259161+0000 mgr.a (mgr.14388) 505 : audit [DBG] from='client.24561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:22:56.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:56 smithi163 bash[24253]: cluster 2024-08-31T02:22:55.065687+0000 mgr.a (mgr.14388) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:22:56.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:56 smithi027 bash[22610]: cluster 2024-08-31T02:22:55.065687+0000 mgr.a (mgr.14388) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:22:56.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:56 smithi191 bash[24992]: cluster 2024-08-31T02:22:55.065687+0000 mgr.a (mgr.14388) 506 : cluster [DBG] pgmap v349: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:22:58.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:22:58 smithi163 bash[24253]: cluster 2024-08-31T02:22:57.066464+0000 mgr.a (mgr.14388) 507 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:22:58.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:22:58 smithi027 bash[22610]: cluster 2024-08-31T02:22:57.066464+0000 mgr.a (mgr.14388) 507 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:22:58.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:22:58 smithi191 bash[24992]: cluster 2024-08-31T02:22:57.066464+0000 mgr.a (mgr.14388) 507 : cluster [DBG] pgmap v350: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:22:58.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:22:58.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:22:58.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:22:59.440 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:22:59.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:22:59.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:22:59.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:22:59.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:00.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:00 smithi163 bash[24253]: audit 2024-08-31T02:22:59.032835+0000 mgr.a (mgr.14388) 508 : audit [DBG] from='client.24636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:00.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:00 smithi163 bash[24253]: cluster 2024-08-31T02:22:59.069370+0000 mgr.a (mgr.14388) 509 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:00.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:00 smithi027 bash[22610]: audit 2024-08-31T02:22:59.032835+0000 mgr.a (mgr.14388) 508 : audit [DBG] from='client.24636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:00.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:00 smithi027 bash[22610]: cluster 2024-08-31T02:22:59.069370+0000 mgr.a (mgr.14388) 509 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:00.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:00 smithi191 bash[24992]: audit 2024-08-31T02:22:59.032835+0000 mgr.a (mgr.14388) 508 : audit [DBG] from='client.24636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:00.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:00 smithi191 bash[24992]: cluster 2024-08-31T02:22:59.069370+0000 mgr.a (mgr.14388) 509 : cluster [DBG] pgmap v351: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:02.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:02 smithi163 bash[24253]: cluster 2024-08-31T02:23:01.070440+0000 mgr.a (mgr.14388) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:23:02.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:02 smithi027 bash[22610]: cluster 2024-08-31T02:23:01.070440+0000 mgr.a (mgr.14388) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:23:02.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:02 smithi191 bash[24992]: cluster 2024-08-31T02:23:01.070440+0000 mgr.a (mgr.14388) 510 : cluster [DBG] pgmap v352: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:23:04.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:23:04.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:23:04.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:23:04.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:04 smithi163 bash[24253]: cluster 2024-08-31T02:23:03.072770+0000 mgr.a (mgr.14388) 511 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:04.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:04 smithi027 bash[22610]: cluster 2024-08-31T02:23:03.072770+0000 mgr.a (mgr.14388) 511 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:04.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:04 smithi191 bash[24992]: cluster 2024-08-31T02:23:03.072770+0000 mgr.a (mgr.14388) 511 : cluster [DBG] pgmap v353: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:05.195 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:23:05.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:23:05.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:23:05.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:23:05.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:05.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:05 smithi163 bash[24253]: audit 2024-08-31T02:23:04.788372+0000 mgr.a (mgr.14388) 512 : audit [DBG] from='client.24711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:05.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:05 smithi027 bash[22610]: audit 2024-08-31T02:23:04.788372+0000 mgr.a (mgr.14388) 512 : audit [DBG] from='client.24711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:05.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:05 smithi191 bash[24992]: audit 2024-08-31T02:23:04.788372+0000 mgr.a (mgr.14388) 512 : audit [DBG] from='client.24711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:06.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:06 smithi163 bash[24253]: cluster 2024-08-31T02:23:05.073349+0000 mgr.a (mgr.14388) 513 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:06.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:06 smithi027 bash[22610]: cluster 2024-08-31T02:23:05.073349+0000 mgr.a (mgr.14388) 513 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:06.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:06 smithi191 bash[24992]: cluster 2024-08-31T02:23:05.073349+0000 mgr.a (mgr.14388) 513 : cluster [DBG] pgmap v354: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:08.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:08 smithi163 bash[24253]: cluster 2024-08-31T02:23:07.074241+0000 mgr.a (mgr.14388) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:08.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:08 smithi027 bash[22610]: cluster 2024-08-31T02:23:07.074241+0000 mgr.a (mgr.14388) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:08.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:08 smithi191 bash[24992]: cluster 2024-08-31T02:23:07.074241+0000 mgr.a (mgr.14388) 514 : cluster [DBG] pgmap v355: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:10.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:23:10.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:23:10.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:23:10.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:10 smithi163 bash[24253]: cluster 2024-08-31T02:23:09.076517+0000 mgr.a (mgr.14388) 515 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:10.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:10 smithi027 bash[22610]: cluster 2024-08-31T02:23:09.076517+0000 mgr.a (mgr.14388) 515 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:10.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:10 smithi191 bash[24992]: cluster 2024-08-31T02:23:09.076517+0000 mgr.a (mgr.14388) 515 : cluster [DBG] pgmap v356: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:10.935 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:23:10.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:23:10.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:23:10.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:23:10.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:11.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:11 smithi163 bash[24253]: audit 2024-08-31T02:23:10.539916+0000 mgr.a (mgr.14388) 516 : audit [DBG] from='client.24789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:11.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:11 smithi027 bash[22610]: audit 2024-08-31T02:23:10.539916+0000 mgr.a (mgr.14388) 516 : audit [DBG] from='client.24789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:11.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:11 smithi191 bash[24992]: audit 2024-08-31T02:23:10.539916+0000 mgr.a (mgr.14388) 516 : audit [DBG] from='client.24789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:12.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:12 smithi163 bash[24253]: cluster 2024-08-31T02:23:11.077577+0000 mgr.a (mgr.14388) 517 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:12.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:12 smithi027 bash[22610]: cluster 2024-08-31T02:23:11.077577+0000 mgr.a (mgr.14388) 517 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:12.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:12 smithi191 bash[24992]: cluster 2024-08-31T02:23:11.077577+0000 mgr.a (mgr.14388) 517 : cluster [DBG] pgmap v357: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:14.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:14 smithi163 bash[24253]: cluster 2024-08-31T02:23:13.079895+0000 mgr.a (mgr.14388) 518 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:14.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:14 smithi027 bash[22610]: cluster 2024-08-31T02:23:13.079895+0000 mgr.a (mgr.14388) 518 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:14.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:14 smithi191 bash[24992]: cluster 2024-08-31T02:23:13.079895+0000 mgr.a (mgr.14388) 518 : cluster [DBG] pgmap v358: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:23:15.937 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:23:15.938 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:23:16.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:16 smithi163 bash[24253]: cluster 2024-08-31T02:23:15.080673+0000 mgr.a (mgr.14388) 519 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:16.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:16 smithi027 bash[22610]: cluster 2024-08-31T02:23:15.080673+0000 mgr.a (mgr.14388) 519 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:16.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:16 smithi191 bash[24992]: cluster 2024-08-31T02:23:15.080673+0000 mgr.a (mgr.14388) 519 : cluster [DBG] pgmap v359: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:16.685 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:23:16.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:23:16.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:23:16.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:23:16.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:17.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:17 smithi163 bash[24253]: audit 2024-08-31T02:23:16.280025+0000 mgr.a (mgr.14388) 520 : audit [DBG] from='client.24867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:17.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:17 smithi027 bash[22610]: audit 2024-08-31T02:23:16.280025+0000 mgr.a (mgr.14388) 520 : audit [DBG] from='client.24867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:17.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:17 smithi191 bash[24992]: audit 2024-08-31T02:23:16.280025+0000 mgr.a (mgr.14388) 520 : audit [DBG] from='client.24867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:18.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:18 smithi163 bash[24253]: cluster 2024-08-31T02:23:17.081572+0000 mgr.a (mgr.14388) 521 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:18.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:18 smithi027 bash[22610]: cluster 2024-08-31T02:23:17.081572+0000 mgr.a (mgr.14388) 521 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:18.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:18 smithi191 bash[24992]: cluster 2024-08-31T02:23:17.081572+0000 mgr.a (mgr.14388) 521 : cluster [DBG] pgmap v360: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:20.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:20 smithi163 bash[24253]: cluster 2024-08-31T02:23:19.083808+0000 mgr.a (mgr.14388) 522 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:20.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:20 smithi027 bash[22610]: cluster 2024-08-31T02:23:19.083808+0000 mgr.a (mgr.14388) 522 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:20.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:20 smithi191 bash[24992]: cluster 2024-08-31T02:23:19.083808+0000 mgr.a (mgr.14388) 522 : cluster [DBG] pgmap v361: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:21.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:23:21.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:23:21.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:23:22.442 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:23:22.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:23:22.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:23:22.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:23:22.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:22.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:22 smithi027 bash[22610]: cluster 2024-08-31T02:23:21.084605+0000 mgr.a (mgr.14388) 523 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:22.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:22 smithi191 bash[24992]: cluster 2024-08-31T02:23:21.084605+0000 mgr.a (mgr.14388) 523 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:22.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:22 smithi163 bash[24253]: cluster 2024-08-31T02:23:21.084605+0000 mgr.a (mgr.14388) 523 : cluster [DBG] pgmap v362: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:23.474 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:23 smithi027 bash[22610]: audit 2024-08-31T02:23:22.030912+0000 mgr.a (mgr.14388) 524 : audit [DBG] from='client.24942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:23.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:23 smithi191 bash[24992]: audit 2024-08-31T02:23:22.030912+0000 mgr.a (mgr.14388) 524 : audit [DBG] from='client.24942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:23.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:23 smithi163 bash[24253]: audit 2024-08-31T02:23:22.030912+0000 mgr.a (mgr.14388) 524 : audit [DBG] from='client.24942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:24.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:24 smithi027 bash[22610]: cluster 2024-08-31T02:23:23.086954+0000 mgr.a (mgr.14388) 525 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:24.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:24 smithi191 bash[24992]: cluster 2024-08-31T02:23:23.086954+0000 mgr.a (mgr.14388) 525 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:24.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:24 smithi163 bash[24253]: cluster 2024-08-31T02:23:23.086954+0000 mgr.a (mgr.14388) 525 : cluster [DBG] pgmap v363: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:26.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:26 smithi027 bash[22610]: cluster 2024-08-31T02:23:25.087720+0000 mgr.a (mgr.14388) 526 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:26.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:26 smithi191 bash[24992]: cluster 2024-08-31T02:23:25.087720+0000 mgr.a (mgr.14388) 526 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:26.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:26 smithi163 bash[24253]: cluster 2024-08-31T02:23:25.087720+0000 mgr.a (mgr.14388) 526 : cluster [DBG] pgmap v364: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:23:27.444 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:23:27.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:23:28.220 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:23:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:23:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:23:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:23:28.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:28.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:28 smithi027 bash[22610]: cluster 2024-08-31T02:23:27.088473+0000 mgr.a (mgr.14388) 527 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:28.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:28 smithi027 bash[22610]: audit 2024-08-31T02:23:27.795049+0000 mgr.a (mgr.14388) 528 : audit [DBG] from='client.25020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:28.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:28 smithi191 bash[24992]: cluster 2024-08-31T02:23:27.088473+0000 mgr.a (mgr.14388) 527 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:28.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:28 smithi191 bash[24992]: audit 2024-08-31T02:23:27.795049+0000 mgr.a (mgr.14388) 528 : audit [DBG] from='client.25020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:28.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:28 smithi163 bash[24253]: cluster 2024-08-31T02:23:27.088473+0000 mgr.a (mgr.14388) 527 : cluster [DBG] pgmap v365: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:28.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:28 smithi163 bash[24253]: audit 2024-08-31T02:23:27.795049+0000 mgr.a (mgr.14388) 528 : audit [DBG] from='client.25020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:30.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:30 smithi027 bash[22610]: cluster 2024-08-31T02:23:29.091239+0000 mgr.a (mgr.14388) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:30.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:30 smithi191 bash[24992]: cluster 2024-08-31T02:23:29.091239+0000 mgr.a (mgr.14388) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:30.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:30 smithi163 bash[24253]: cluster 2024-08-31T02:23:29.091239+0000 mgr.a (mgr.14388) 529 : cluster [DBG] pgmap v366: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:32.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:32 smithi027 bash[22610]: cluster 2024-08-31T02:23:31.092024+0000 mgr.a (mgr.14388) 530 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:23:32.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:32 smithi191 bash[24992]: cluster 2024-08-31T02:23:31.092024+0000 mgr.a (mgr.14388) 530 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:23:32.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:32 smithi163 bash[24253]: cluster 2024-08-31T02:23:31.092024+0000 mgr.a (mgr.14388) 530 : cluster [DBG] pgmap v367: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:23:33.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:23:33.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:23:33.223 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:23:33.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:23:33.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:23:33.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:23:33.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:33.992 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:23:34.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:34 smithi191 bash[24992]: cluster 2024-08-31T02:23:33.093920+0000 mgr.a (mgr.14388) 531 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:34.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:34 smithi191 bash[24992]: audit 2024-08-31T02:23:33.571989+0000 mgr.a (mgr.14388) 532 : audit [DBG] from='client.25098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:34.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:34 smithi163 bash[24253]: cluster 2024-08-31T02:23:33.093920+0000 mgr.a (mgr.14388) 531 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:34.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:34 smithi163 bash[24253]: audit 2024-08-31T02:23:33.571989+0000 mgr.a (mgr.14388) 532 : audit [DBG] from='client.25098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:34.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:34 smithi027 bash[22610]: cluster 2024-08-31T02:23:33.093920+0000 mgr.a (mgr.14388) 531 : cluster [DBG] pgmap v368: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:34.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:34 smithi027 bash[22610]: audit 2024-08-31T02:23:33.571989+0000 mgr.a (mgr.14388) 532 : audit [DBG] from='client.25098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:36.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:36 smithi191 bash[24992]: cluster 2024-08-31T02:23:35.094930+0000 mgr.a (mgr.14388) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:23:36.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:36 smithi163 bash[24253]: cluster 2024-08-31T02:23:35.094930+0000 mgr.a (mgr.14388) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:23:36.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:36 smithi027 bash[22610]: cluster 2024-08-31T02:23:35.094930+0000 mgr.a (mgr.14388) 533 : cluster [DBG] pgmap v369: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:23:38.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:38 smithi191 bash[24992]: cluster 2024-08-31T02:23:37.095704+0000 mgr.a (mgr.14388) 534 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:23:38.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:38 smithi163 bash[24253]: cluster 2024-08-31T02:23:37.095704+0000 mgr.a (mgr.14388) 534 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:23:38.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:38 smithi027 bash[22610]: cluster 2024-08-31T02:23:37.095704+0000 mgr.a (mgr.14388) 534 : cluster [DBG] pgmap v370: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:23:38.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:23:38.994 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:23:38.994 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:23:39.727 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:23:39.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:23:39.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:23:39.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:23:39.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:40.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:40 smithi191 bash[24992]: cluster 2024-08-31T02:23:39.096886+0000 mgr.a (mgr.14388) 535 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:40.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:40 smithi191 bash[24992]: audit 2024-08-31T02:23:39.324858+0000 mgr.a (mgr.14388) 536 : audit [DBG] from='client.25176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:40.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:40 smithi163 bash[24253]: cluster 2024-08-31T02:23:39.096886+0000 mgr.a (mgr.14388) 535 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:40.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:40 smithi163 bash[24253]: audit 2024-08-31T02:23:39.324858+0000 mgr.a (mgr.14388) 536 : audit [DBG] from='client.25176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:40.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:40 smithi027 bash[22610]: cluster 2024-08-31T02:23:39.096886+0000 mgr.a (mgr.14388) 535 : cluster [DBG] pgmap v371: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:40.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:40 smithi027 bash[22610]: audit 2024-08-31T02:23:39.324858+0000 mgr.a (mgr.14388) 536 : audit [DBG] from='client.25176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:42.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:42 smithi191 bash[24992]: cluster 2024-08-31T02:23:41.097708+0000 mgr.a (mgr.14388) 537 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:42.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:42 smithi163 bash[24253]: cluster 2024-08-31T02:23:41.097708+0000 mgr.a (mgr.14388) 537 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:42.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:42 smithi027 bash[22610]: cluster 2024-08-31T02:23:41.097708+0000 mgr.a (mgr.14388) 537 : cluster [DBG] pgmap v372: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:44.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:44 smithi191 bash[24992]: cluster 2024-08-31T02:23:43.099829+0000 mgr.a (mgr.14388) 538 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:44.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:44 smithi163 bash[24253]: cluster 2024-08-31T02:23:43.099829+0000 mgr.a (mgr.14388) 538 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:44.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:44 smithi027 bash[22610]: cluster 2024-08-31T02:23:43.099829+0000 mgr.a (mgr.14388) 538 : cluster [DBG] pgmap v373: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:44.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:23:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:23:44.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:23:45.461 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:23:45.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:23:45.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:23:45.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:23:45.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:46.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:46 smithi191 bash[24992]: audit 2024-08-31T02:23:45.069776+0000 mgr.a (mgr.14388) 539 : audit [DBG] from='client.25254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:46.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:46 smithi191 bash[24992]: cluster 2024-08-31T02:23:45.100720+0000 mgr.a (mgr.14388) 540 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:46.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:46 smithi163 bash[24253]: audit 2024-08-31T02:23:45.069776+0000 mgr.a (mgr.14388) 539 : audit [DBG] from='client.25254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:46.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:46 smithi163 bash[24253]: cluster 2024-08-31T02:23:45.100720+0000 mgr.a (mgr.14388) 540 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:46.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:46 smithi027 bash[22610]: audit 2024-08-31T02:23:45.069776+0000 mgr.a (mgr.14388) 539 : audit [DBG] from='client.25254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:46.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:46 smithi027 bash[22610]: cluster 2024-08-31T02:23:45.100720+0000 mgr.a (mgr.14388) 540 : cluster [DBG] pgmap v374: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:48.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:48 smithi191 bash[24992]: cluster 2024-08-31T02:23:47.101629+0000 mgr.a (mgr.14388) 541 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:48.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:48 smithi163 bash[24253]: cluster 2024-08-31T02:23:47.101629+0000 mgr.a (mgr.14388) 541 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:48.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:48 smithi027 bash[22610]: cluster 2024-08-31T02:23:47.101629+0000 mgr.a (mgr.14388) 541 : cluster [DBG] pgmap v375: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:50.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:23:50.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:23:50.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:23:50.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:50 smithi191 bash[24992]: cluster 2024-08-31T02:23:49.103901+0000 mgr.a (mgr.14388) 542 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:50.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:50 smithi163 bash[24253]: cluster 2024-08-31T02:23:49.103901+0000 mgr.a (mgr.14388) 542 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:50.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:50 smithi027 bash[22610]: cluster 2024-08-31T02:23:49.103901+0000 mgr.a (mgr.14388) 542 : cluster [DBG] pgmap v376: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:23:51.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:23:51.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:23:51.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:23:51.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:51.236 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:23:51.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:51 smithi191 bash[24992]: audit 2024-08-31T02:23:50.481049+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:23:51.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:51 smithi191 bash[24992]: audit 2024-08-31T02:23:50.804742+0000 mgr.a (mgr.14388) 543 : audit [DBG] from='client.25332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:51.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:51 smithi163 bash[24253]: audit 2024-08-31T02:23:50.481049+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:23:51.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:51 smithi163 bash[24253]: audit 2024-08-31T02:23:50.804742+0000 mgr.a (mgr.14388) 543 : audit [DBG] from='client.25332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:51.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:51 smithi027 bash[22610]: audit 2024-08-31T02:23:50.481049+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:23:51.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:51 smithi027 bash[22610]: audit 2024-08-31T02:23:50.804742+0000 mgr.a (mgr.14388) 543 : audit [DBG] from='client.25332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:52.272 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:23:51 smithi027 bash[22863]: debug 2024-08-31T02:23:51.984+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:23:52.272 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:23:51 smithi027 bash[22863]: debug 2024-08-31T02:23:51.988+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:23:52.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:52 smithi191 bash[24992]: cluster 2024-08-31T02:23:51.104602+0000 mgr.a (mgr.14388) 544 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:52.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:52 smithi191 bash[24992]: audit 2024-08-31T02:23:51.302016+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:23:52.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:52 smithi191 bash[24992]: audit 2024-08-31T02:23:51.302807+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:23:52.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:52 smithi191 bash[24992]: audit 2024-08-31T02:23:51.307690+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:23:52.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:52 smithi191 bash[24992]: audit 2024-08-31T02:23:51.309562+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:23:52.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:52 smithi191 bash[24992]: audit 2024-08-31T02:23:51.310538+0000 mgr.a (mgr.14388) 545 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:23:52.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:52 smithi163 bash[24253]: cluster 2024-08-31T02:23:51.104602+0000 mgr.a (mgr.14388) 544 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:52.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:52 smithi163 bash[24253]: audit 2024-08-31T02:23:51.302016+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:23:52.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:52 smithi163 bash[24253]: audit 2024-08-31T02:23:51.302807+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:23:52.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:52 smithi163 bash[24253]: audit 2024-08-31T02:23:51.307690+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:23:52.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:52 smithi163 bash[24253]: audit 2024-08-31T02:23:51.309562+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:23:52.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:52 smithi163 bash[24253]: audit 2024-08-31T02:23:51.310538+0000 mgr.a (mgr.14388) 545 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:23:52.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:52 smithi027 bash[22610]: cluster 2024-08-31T02:23:51.104602+0000 mgr.a (mgr.14388) 544 : cluster [DBG] pgmap v377: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:23:52.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:52 smithi027 bash[22610]: audit 2024-08-31T02:23:51.302016+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:23:52.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:52 smithi027 bash[22610]: audit 2024-08-31T02:23:51.302807+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:23:52.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:52 smithi027 bash[22610]: audit 2024-08-31T02:23:51.307690+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:23:52.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:52 smithi027 bash[22610]: audit 2024-08-31T02:23:51.309562+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:23:52.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:52 smithi027 bash[22610]: audit 2024-08-31T02:23:51.310538+0000 mgr.a (mgr.14388) 545 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:23:53.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:53 smithi191 bash[24992]: audit 2024-08-31T02:23:51.989248+0000 mgr.a (mgr.14388) 546 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:23:53.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:53 smithi191 bash[24992]: cephadm 2024-08-31T02:23:51.990766+0000 mgr.a (mgr.14388) 547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:23:53.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:53 smithi163 bash[24253]: audit 2024-08-31T02:23:51.989248+0000 mgr.a (mgr.14388) 546 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:23:53.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:53 smithi163 bash[24253]: cephadm 2024-08-31T02:23:51.990766+0000 mgr.a (mgr.14388) 547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:23:53.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:53 smithi027 bash[22610]: audit 2024-08-31T02:23:51.989248+0000 mgr.a (mgr.14388) 546 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:23:53.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:53 smithi027 bash[22610]: cephadm 2024-08-31T02:23:51.990766+0000 mgr.a (mgr.14388) 547 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:23:54.535 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:54 smithi191 bash[24992]: cluster 2024-08-31T02:23:53.106799+0000 mgr.a (mgr.14388) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:54.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:54 smithi163 bash[24253]: cluster 2024-08-31T02:23:53.106799+0000 mgr.a (mgr.14388) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:54.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:54 smithi027 bash[22610]: cluster 2024-08-31T02:23:53.106799+0000 mgr.a (mgr.14388) 548 : cluster [DBG] pgmap v378: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:56.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:23:56.239 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:23:56.239 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:23:56.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:56 smithi163 bash[24253]: cluster 2024-08-31T02:23:55.107589+0000 mgr.a (mgr.14388) 549 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:56.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:56 smithi027 bash[22610]: cluster 2024-08-31T02:23:55.107589+0000 mgr.a (mgr.14388) 549 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:56.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:56 smithi191 bash[24992]: cluster 2024-08-31T02:23:55.107589+0000 mgr.a (mgr.14388) 549 : cluster [DBG] pgmap v379: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:57.005 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:23:57.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:23:57.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:23:57.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:23:57.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:23:57.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:57 smithi163 bash[24253]: audit 2024-08-31T02:23:56.586405+0000 mgr.a (mgr.14388) 550 : audit [DBG] from='client.25515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:57.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:57 smithi027 bash[22610]: audit 2024-08-31T02:23:56.586405+0000 mgr.a (mgr.14388) 550 : audit [DBG] from='client.25515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:57.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:57 smithi191 bash[24992]: audit 2024-08-31T02:23:56.586405+0000 mgr.a (mgr.14388) 550 : audit [DBG] from='client.25515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:23:58.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:23:58 smithi163 bash[24253]: cluster 2024-08-31T02:23:57.108065+0000 mgr.a (mgr.14388) 551 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:58.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:23:58 smithi027 bash[22610]: cluster 2024-08-31T02:23:57.108065+0000 mgr.a (mgr.14388) 551 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:23:58.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:23:58 smithi191 bash[24992]: cluster 2024-08-31T02:23:57.108065+0000 mgr.a (mgr.14388) 551 : cluster [DBG] pgmap v380: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:24:00.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:00 smithi163 bash[24253]: cluster 2024-08-31T02:23:59.110256+0000 mgr.a (mgr.14388) 552 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:24:00.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:00 smithi027 bash[22610]: cluster 2024-08-31T02:23:59.110256+0000 mgr.a (mgr.14388) 552 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:24:00.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:00 smithi191 bash[24992]: cluster 2024-08-31T02:23:59.110256+0000 mgr.a (mgr.14388) 552 : cluster [DBG] pgmap v381: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:24:02.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:02.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:02.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:24:02.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:02 smithi163 bash[24253]: cluster 2024-08-31T02:24:01.111100+0000 mgr.a (mgr.14388) 553 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:24:02.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:02 smithi027 bash[22610]: cluster 2024-08-31T02:24:01.111100+0000 mgr.a (mgr.14388) 553 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:24:02.780 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:24:02.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:24:02.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:24:02.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:24:02.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:24:02.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:02 smithi191 bash[24992]: cluster 2024-08-31T02:24:01.111100+0000 mgr.a (mgr.14388) 553 : cluster [DBG] pgmap v382: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:24:03.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:03 smithi163 bash[24253]: audit 2024-08-31T02:24:02.355804+0000 mgr.a (mgr.14388) 554 : audit [DBG] from='client.25593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:03.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:03 smithi027 bash[22610]: audit 2024-08-31T02:24:02.355804+0000 mgr.a (mgr.14388) 554 : audit [DBG] from='client.25593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:03.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:03 smithi191 bash[24992]: audit 2024-08-31T02:24:02.355804+0000 mgr.a (mgr.14388) 554 : audit [DBG] from='client.25593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:04.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:04 smithi163 bash[24253]: cluster 2024-08-31T02:24:03.113310+0000 mgr.a (mgr.14388) 555 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:24:04.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:04 smithi027 bash[22610]: cluster 2024-08-31T02:24:03.113310+0000 mgr.a (mgr.14388) 555 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:24:04.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:04 smithi191 bash[24992]: cluster 2024-08-31T02:24:03.113310+0000 mgr.a (mgr.14388) 555 : cluster [DBG] pgmap v383: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:24:06.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:06 smithi163 bash[24253]: cluster 2024-08-31T02:24:05.114102+0000 mgr.a (mgr.14388) 556 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:06.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:06 smithi027 bash[22610]: cluster 2024-08-31T02:24:05.114102+0000 mgr.a (mgr.14388) 556 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:06.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:06 smithi191 bash[24992]: cluster 2024-08-31T02:24:05.114102+0000 mgr.a (mgr.14388) 556 : cluster [DBG] pgmap v384: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:07.782 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:07.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:24:08.561 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:24:08.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:24:08.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:24:08.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:24:08.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:24:08.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:08 smithi163 bash[24253]: cluster 2024-08-31T02:24:07.114888+0000 mgr.a (mgr.14388) 557 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:08.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:08 smithi027 bash[22610]: cluster 2024-08-31T02:24:07.114888+0000 mgr.a (mgr.14388) 557 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:08.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:08 smithi191 bash[24992]: cluster 2024-08-31T02:24:07.114888+0000 mgr.a (mgr.14388) 557 : cluster [DBG] pgmap v385: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:09.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:09 smithi163 bash[24253]: audit 2024-08-31T02:24:08.130715+0000 mgr.a (mgr.14388) 558 : audit [DBG] from='client.25671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:09.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:09 smithi027 bash[22610]: audit 2024-08-31T02:24:08.130715+0000 mgr.a (mgr.14388) 558 : audit [DBG] from='client.25671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:09.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:09 smithi191 bash[24992]: audit 2024-08-31T02:24:08.130715+0000 mgr.a (mgr.14388) 558 : audit [DBG] from='client.25671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:10.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:10 smithi163 bash[24253]: cluster 2024-08-31T02:24:09.117616+0000 mgr.a (mgr.14388) 559 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:10.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:10 smithi027 bash[22610]: cluster 2024-08-31T02:24:09.117616+0000 mgr.a (mgr.14388) 559 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:10.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:10 smithi191 bash[24992]: cluster 2024-08-31T02:24:09.117616+0000 mgr.a (mgr.14388) 559 : cluster [DBG] pgmap v386: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:12.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:12 smithi163 bash[24253]: cluster 2024-08-31T02:24:11.118349+0000 mgr.a (mgr.14388) 560 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:24:12.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:12 smithi027 bash[22610]: cluster 2024-08-31T02:24:11.118349+0000 mgr.a (mgr.14388) 560 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:24:12.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:12 smithi191 bash[24992]: cluster 2024-08-31T02:24:11.118349+0000 mgr.a (mgr.14388) 560 : cluster [DBG] pgmap v387: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:24:13.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:13.563 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:13.563 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:24:14.328 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:24:14.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:24:14.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:24:14.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:24:14.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:24:14.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:14 smithi163 bash[24253]: cluster 2024-08-31T02:24:13.120265+0000 mgr.a (mgr.14388) 561 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:14.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:14 smithi163 bash[24253]: audit 2024-08-31T02:24:13.905055+0000 mgr.a (mgr.14388) 562 : audit [DBG] from='client.25746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:14.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:14 smithi027 bash[22610]: cluster 2024-08-31T02:24:13.120265+0000 mgr.a (mgr.14388) 561 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:14.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:14 smithi027 bash[22610]: audit 2024-08-31T02:24:13.905055+0000 mgr.a (mgr.14388) 562 : audit [DBG] from='client.25746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:14.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:14 smithi191 bash[24992]: cluster 2024-08-31T02:24:13.120265+0000 mgr.a (mgr.14388) 561 : cluster [DBG] pgmap v388: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:14.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:14 smithi191 bash[24992]: audit 2024-08-31T02:24:13.905055+0000 mgr.a (mgr.14388) 562 : audit [DBG] from='client.25746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:16.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:16 smithi163 bash[24253]: cluster 2024-08-31T02:24:15.121354+0000 mgr.a (mgr.14388) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:24:16.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:16 smithi027 bash[22610]: cluster 2024-08-31T02:24:15.121354+0000 mgr.a (mgr.14388) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:24:16.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:16 smithi191 bash[24992]: cluster 2024-08-31T02:24:15.121354+0000 mgr.a (mgr.14388) 563 : cluster [DBG] pgmap v389: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:24:18.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:18 smithi163 bash[24253]: cluster 2024-08-31T02:24:17.122282+0000 mgr.a (mgr.14388) 564 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:24:18.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:18 smithi027 bash[22610]: cluster 2024-08-31T02:24:17.122282+0000 mgr.a (mgr.14388) 564 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:24:18.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:18 smithi191 bash[24992]: cluster 2024-08-31T02:24:17.122282+0000 mgr.a (mgr.14388) 564 : cluster [DBG] pgmap v390: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:24:19.330 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:19.330 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:19.330 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:24:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:24:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:24:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:24:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:24:20.064 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:24:20.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:20 smithi163 bash[24253]: cluster 2024-08-31T02:24:19.124553+0000 mgr.a (mgr.14388) 565 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:20.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:20 smithi163 bash[24253]: audit 2024-08-31T02:24:19.669307+0000 mgr.a (mgr.14388) 566 : audit [DBG] from='client.25824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:20.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:20 smithi027 bash[22610]: cluster 2024-08-31T02:24:19.124553+0000 mgr.a (mgr.14388) 565 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:20.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:20 smithi027 bash[22610]: audit 2024-08-31T02:24:19.669307+0000 mgr.a (mgr.14388) 566 : audit [DBG] from='client.25824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:20.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:20 smithi191 bash[24992]: cluster 2024-08-31T02:24:19.124553+0000 mgr.a (mgr.14388) 565 : cluster [DBG] pgmap v391: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:20.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:20 smithi191 bash[24992]: audit 2024-08-31T02:24:19.669307+0000 mgr.a (mgr.14388) 566 : audit [DBG] from='client.25824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:22.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:22 smithi163 bash[24253]: cluster 2024-08-31T02:24:21.125438+0000 mgr.a (mgr.14388) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:22.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:22 smithi027 bash[22610]: cluster 2024-08-31T02:24:21.125438+0000 mgr.a (mgr.14388) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:22.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:22 smithi191 bash[24992]: cluster 2024-08-31T02:24:21.125438+0000 mgr.a (mgr.14388) 567 : cluster [DBG] pgmap v392: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:24.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:24 smithi163 bash[24253]: cluster 2024-08-31T02:24:23.127642+0000 mgr.a (mgr.14388) 568 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:24.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:24 smithi027 bash[22610]: cluster 2024-08-31T02:24:23.127642+0000 mgr.a (mgr.14388) 568 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:24.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:24 smithi191 bash[24992]: cluster 2024-08-31T02:24:23.127642+0000 mgr.a (mgr.14388) 568 : cluster [DBG] pgmap v393: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:24:25.834 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:24:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:24:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:24:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:24:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:24:26.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:26 smithi163 bash[24253]: cluster 2024-08-31T02:24:25.128443+0000 mgr.a (mgr.14388) 569 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:26.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:26 smithi163 bash[24253]: audit 2024-08-31T02:24:25.407141+0000 mgr.a (mgr.14388) 570 : audit [DBG] from='client.25896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:26.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:26 smithi027 bash[22610]: cluster 2024-08-31T02:24:25.128443+0000 mgr.a (mgr.14388) 569 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:26.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:26 smithi027 bash[22610]: audit 2024-08-31T02:24:25.407141+0000 mgr.a (mgr.14388) 570 : audit [DBG] from='client.25896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:26.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:26 smithi191 bash[24992]: cluster 2024-08-31T02:24:25.128443+0000 mgr.a (mgr.14388) 569 : cluster [DBG] pgmap v394: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:26.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:26 smithi191 bash[24992]: audit 2024-08-31T02:24:25.407141+0000 mgr.a (mgr.14388) 570 : audit [DBG] from='client.25896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:28.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:28 smithi163 bash[24253]: cluster 2024-08-31T02:24:27.129355+0000 mgr.a (mgr.14388) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:28.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:28 smithi027 bash[22610]: cluster 2024-08-31T02:24:27.129355+0000 mgr.a (mgr.14388) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:28.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:28 smithi191 bash[24992]: cluster 2024-08-31T02:24:27.129355+0000 mgr.a (mgr.14388) 571 : cluster [DBG] pgmap v395: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:30.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:30 smithi163 bash[24253]: cluster 2024-08-31T02:24:29.131606+0000 mgr.a (mgr.14388) 572 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:30.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:30 smithi027 bash[22610]: cluster 2024-08-31T02:24:29.131606+0000 mgr.a (mgr.14388) 572 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:30.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:30 smithi191 bash[24992]: cluster 2024-08-31T02:24:29.131606+0000 mgr.a (mgr.14388) 572 : cluster [DBG] pgmap v396: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:30.836 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:30.836 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:24:31.576 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:24:31.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:24:31.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:24:31.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:24:31.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:24:32.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:32 smithi163 bash[24253]: cluster 2024-08-31T02:24:31.132304+0000 mgr.a (mgr.14388) 573 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:32.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:32 smithi163 bash[24253]: audit 2024-08-31T02:24:31.176593+0000 mgr.a (mgr.14388) 574 : audit [DBG] from='client.25971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:32.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:32 smithi027 bash[22610]: cluster 2024-08-31T02:24:31.132304+0000 mgr.a (mgr.14388) 573 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:32.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:32 smithi027 bash[22610]: audit 2024-08-31T02:24:31.176593+0000 mgr.a (mgr.14388) 574 : audit [DBG] from='client.25971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:32.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:32 smithi191 bash[24992]: cluster 2024-08-31T02:24:31.132304+0000 mgr.a (mgr.14388) 573 : cluster [DBG] pgmap v397: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:32.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:32 smithi191 bash[24992]: audit 2024-08-31T02:24:31.176593+0000 mgr.a (mgr.14388) 574 : audit [DBG] from='client.25971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:34.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:34 smithi163 bash[24253]: cluster 2024-08-31T02:24:33.134484+0000 mgr.a (mgr.14388) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:34.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:34 smithi027 bash[22610]: cluster 2024-08-31T02:24:33.134484+0000 mgr.a (mgr.14388) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:34.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:34 smithi191 bash[24992]: cluster 2024-08-31T02:24:33.134484+0000 mgr.a (mgr.14388) 575 : cluster [DBG] pgmap v398: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:36.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:36.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:36.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:24:36.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:36 smithi163 bash[24253]: cluster 2024-08-31T02:24:35.135263+0000 mgr.a (mgr.14388) 576 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:36.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:36 smithi027 bash[22610]: cluster 2024-08-31T02:24:35.135263+0000 mgr.a (mgr.14388) 576 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:36.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:36 smithi191 bash[24992]: cluster 2024-08-31T02:24:35.135263+0000 mgr.a (mgr.14388) 576 : cluster [DBG] pgmap v399: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:37.355 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:24:37.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:24:37.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:24:37.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:24:37.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:24:38.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:38 smithi163 bash[24253]: audit 2024-08-31T02:24:36.923951+0000 mgr.a (mgr.14388) 577 : audit [DBG] from='client.26046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:38.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:38 smithi163 bash[24253]: cluster 2024-08-31T02:24:37.135841+0000 mgr.a (mgr.14388) 578 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:38.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:38 smithi027 bash[22610]: audit 2024-08-31T02:24:36.923951+0000 mgr.a (mgr.14388) 577 : audit [DBG] from='client.26046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:38.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:38 smithi027 bash[22610]: cluster 2024-08-31T02:24:37.135841+0000 mgr.a (mgr.14388) 578 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:38 smithi191 bash[24992]: audit 2024-08-31T02:24:36.923951+0000 mgr.a (mgr.14388) 577 : audit [DBG] from='client.26046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:38 smithi191 bash[24992]: cluster 2024-08-31T02:24:37.135841+0000 mgr.a (mgr.14388) 578 : cluster [DBG] pgmap v400: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:40.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:40 smithi163 bash[24253]: cluster 2024-08-31T02:24:39.138116+0000 mgr.a (mgr.14388) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:40.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:40 smithi027 bash[22610]: cluster 2024-08-31T02:24:39.138116+0000 mgr.a (mgr.14388) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:40.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:40 smithi191 bash[24992]: cluster 2024-08-31T02:24:39.138116+0000 mgr.a (mgr.14388) 579 : cluster [DBG] pgmap v401: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:24:42.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:42.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:42.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:24:42.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:42 smithi163 bash[24253]: cluster 2024-08-31T02:24:41.138929+0000 mgr.a (mgr.14388) 580 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:42.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:42 smithi027 bash[22610]: cluster 2024-08-31T02:24:41.138929+0000 mgr.a (mgr.14388) 580 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:42.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:42 smithi191 bash[24992]: cluster 2024-08-31T02:24:41.138929+0000 mgr.a (mgr.14388) 580 : cluster [DBG] pgmap v402: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:43.124 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:24:43.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:24:43.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:24:43.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:24:43.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:24:43.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:43 smithi163 bash[24253]: audit 2024-08-31T02:24:42.701176+0000 mgr.a (mgr.14388) 581 : audit [DBG] from='client.26124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:43.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:43 smithi027 bash[22610]: audit 2024-08-31T02:24:42.701176+0000 mgr.a (mgr.14388) 581 : audit [DBG] from='client.26124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:43.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:43 smithi191 bash[24992]: audit 2024-08-31T02:24:42.701176+0000 mgr.a (mgr.14388) 581 : audit [DBG] from='client.26124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:44.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:44 smithi163 bash[24253]: cluster 2024-08-31T02:24:43.140140+0000 mgr.a (mgr.14388) 582 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:24:44.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:44 smithi027 bash[22610]: cluster 2024-08-31T02:24:43.140140+0000 mgr.a (mgr.14388) 582 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:24:44.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:44 smithi191 bash[24992]: cluster 2024-08-31T02:24:43.140140+0000 mgr.a (mgr.14388) 582 : cluster [DBG] pgmap v403: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:24:46.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:46 smithi027 bash[22610]: cluster 2024-08-31T02:24:45.140897+0000 mgr.a (mgr.14388) 583 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:24:46.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:46 smithi191 bash[24992]: cluster 2024-08-31T02:24:45.140897+0000 mgr.a (mgr.14388) 583 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:24:46.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:46 smithi163 bash[24253]: cluster 2024-08-31T02:24:45.140897+0000 mgr.a (mgr.14388) 583 : cluster [DBG] pgmap v404: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:24:48.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:48.127 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:48.127 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:24:48.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:48 smithi027 bash[22610]: cluster 2024-08-31T02:24:47.141669+0000 mgr.a (mgr.14388) 584 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:24:48.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:48 smithi191 bash[24992]: cluster 2024-08-31T02:24:47.141669+0000 mgr.a (mgr.14388) 584 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:24:48.867 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:24:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:24:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:24:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:24:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:24:48.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:48 smithi163 bash[24253]: cluster 2024-08-31T02:24:47.141669+0000 mgr.a (mgr.14388) 584 : cluster [DBG] pgmap v405: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:24:49.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:49 smithi027 bash[22610]: audit 2024-08-31T02:24:48.459166+0000 mgr.a (mgr.14388) 585 : audit [DBG] from='client.26202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:49.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:49 smithi191 bash[24992]: audit 2024-08-31T02:24:48.459166+0000 mgr.a (mgr.14388) 585 : audit [DBG] from='client.26202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:49.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:49 smithi163 bash[24253]: audit 2024-08-31T02:24:48.459166+0000 mgr.a (mgr.14388) 585 : audit [DBG] from='client.26202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:50.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:50 smithi027 bash[22610]: cluster 2024-08-31T02:24:49.144376+0000 mgr.a (mgr.14388) 586 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:50.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:50 smithi191 bash[24992]: cluster 2024-08-31T02:24:49.144376+0000 mgr.a (mgr.14388) 586 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:50.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:50 smithi163 bash[24253]: cluster 2024-08-31T02:24:49.144376+0000 mgr.a (mgr.14388) 586 : cluster [DBG] pgmap v406: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:52.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:52 smithi027 bash[22610]: cluster 2024-08-31T02:24:51.145135+0000 mgr.a (mgr.14388) 587 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:24:52.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:52 smithi027 bash[22610]: audit 2024-08-31T02:24:52.040677+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:24:52.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:52 smithi191 bash[24992]: cluster 2024-08-31T02:24:51.145135+0000 mgr.a (mgr.14388) 587 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:24:52.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:52 smithi191 bash[24992]: audit 2024-08-31T02:24:52.040677+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:24:52.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:52 smithi163 bash[24253]: cluster 2024-08-31T02:24:51.145135+0000 mgr.a (mgr.14388) 587 : cluster [DBG] pgmap v407: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:24:52.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:52 smithi163 bash[24253]: audit 2024-08-31T02:24:52.040677+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:24:53.726 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:24:53 smithi027 bash[22863]: debug 2024-08-31T02:24:53.598+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:24:53.726 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:24:53 smithi027 bash[22863]: debug 2024-08-31T02:24:53.598+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:24:53.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:53 smithi027 bash[22610]: audit 2024-08-31T02:24:52.879091+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:24:53.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:53 smithi027 bash[22610]: audit 2024-08-31T02:24:52.880432+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:24:53.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:53 smithi027 bash[22610]: audit 2024-08-31T02:24:52.889273+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:24:53.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:53 smithi027 bash[22610]: audit 2024-08-31T02:24:52.891825+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:24:53.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:53 smithi027 bash[22610]: audit 2024-08-31T02:24:52.894046+0000 mgr.a (mgr.14388) 588 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:24:53.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:53 smithi191 bash[24992]: audit 2024-08-31T02:24:52.879091+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:24:53.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:53 smithi191 bash[24992]: audit 2024-08-31T02:24:52.880432+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:24:53.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:53 smithi191 bash[24992]: audit 2024-08-31T02:24:52.889273+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:24:53.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:53 smithi191 bash[24992]: audit 2024-08-31T02:24:52.891825+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:24:53.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:53 smithi191 bash[24992]: audit 2024-08-31T02:24:52.894046+0000 mgr.a (mgr.14388) 588 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:24:53.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:53.869 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:53.869 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:24:53.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:53 smithi163 bash[24253]: audit 2024-08-31T02:24:52.879091+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:24:53.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:53 smithi163 bash[24253]: audit 2024-08-31T02:24:52.880432+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:24:53.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:53 smithi163 bash[24253]: audit 2024-08-31T02:24:52.889273+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:24:53.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:53 smithi163 bash[24253]: audit 2024-08-31T02:24:52.891825+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:24:53.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:53 smithi163 bash[24253]: audit 2024-08-31T02:24:52.894046+0000 mgr.a (mgr.14388) 588 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:24:54.636 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:24:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:24:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:24:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:24:54.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:24:55.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:54 smithi163 bash[24253]: cluster 2024-08-31T02:24:53.146468+0000 mgr.a (mgr.14388) 589 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:55.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:54 smithi163 bash[24253]: audit 2024-08-31T02:24:53.599917+0000 mgr.a (mgr.14388) 590 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:24:55.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:54 smithi163 bash[24253]: cephadm 2024-08-31T02:24:53.601054+0000 mgr.a (mgr.14388) 591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:24:55.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:54 smithi027 bash[22610]: cluster 2024-08-31T02:24:53.146468+0000 mgr.a (mgr.14388) 589 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:55.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:54 smithi027 bash[22610]: audit 2024-08-31T02:24:53.599917+0000 mgr.a (mgr.14388) 590 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:24:55.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:54 smithi027 bash[22610]: cephadm 2024-08-31T02:24:53.601054+0000 mgr.a (mgr.14388) 591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:24:55.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:54 smithi191 bash[24992]: cluster 2024-08-31T02:24:53.146468+0000 mgr.a (mgr.14388) 589 : cluster [DBG] pgmap v408: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:24:55.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:54 smithi191 bash[24992]: audit 2024-08-31T02:24:53.599917+0000 mgr.a (mgr.14388) 590 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:24:55.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:54 smithi191 bash[24992]: cephadm 2024-08-31T02:24:53.601054+0000 mgr.a (mgr.14388) 591 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:24:56.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:55 smithi163 bash[24253]: audit 2024-08-31T02:24:54.206462+0000 mgr.a (mgr.14388) 592 : audit [DBG] from='client.26388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:56.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:55 smithi027 bash[22610]: audit 2024-08-31T02:24:54.206462+0000 mgr.a (mgr.14388) 592 : audit [DBG] from='client.26388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:56.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:55 smithi191 bash[24992]: audit 2024-08-31T02:24:54.206462+0000 mgr.a (mgr.14388) 592 : audit [DBG] from='client.26388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:24:57.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:56 smithi163 bash[24253]: cluster 2024-08-31T02:24:55.147380+0000 mgr.a (mgr.14388) 593 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:24:57.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:56 smithi027 bash[22610]: cluster 2024-08-31T02:24:55.147380+0000 mgr.a (mgr.14388) 593 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:24:57.285 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:56 smithi191 bash[24992]: cluster 2024-08-31T02:24:55.147380+0000 mgr.a (mgr.14388) 593 : cluster [DBG] pgmap v409: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:24:59.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:24:58 smithi163 bash[24253]: cluster 2024-08-31T02:24:57.148166+0000 mgr.a (mgr.14388) 594 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:24:59.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:24:58 smithi027 bash[22610]: cluster 2024-08-31T02:24:57.148166+0000 mgr.a (mgr.14388) 594 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:24:59.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:24:58 smithi191 bash[24992]: cluster 2024-08-31T02:24:57.148166+0000 mgr.a (mgr.14388) 594 : cluster [DBG] pgmap v410: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:24:59.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:24:59.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:24:59.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:00.381 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:00.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:00.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:00.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:00.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:01.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:00 smithi163 bash[24253]: cluster 2024-08-31T02:24:59.150340+0000 mgr.a (mgr.14388) 595 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:01.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:00 smithi027 bash[22610]: cluster 2024-08-31T02:24:59.150340+0000 mgr.a (mgr.14388) 595 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:01.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:00 smithi191 bash[24992]: cluster 2024-08-31T02:24:59.150340+0000 mgr.a (mgr.14388) 595 : cluster [DBG] pgmap v411: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:02.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:01 smithi163 bash[24253]: audit 2024-08-31T02:24:59.978393+0000 mgr.a (mgr.14388) 596 : audit [DBG] from='client.26463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:02.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:01 smithi027 bash[22610]: audit 2024-08-31T02:24:59.978393+0000 mgr.a (mgr.14388) 596 : audit [DBG] from='client.26463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:02.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:01 smithi191 bash[24992]: audit 2024-08-31T02:24:59.978393+0000 mgr.a (mgr.14388) 596 : audit [DBG] from='client.26463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:03.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:02 smithi163 bash[24253]: cluster 2024-08-31T02:25:01.151058+0000 mgr.a (mgr.14388) 597 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:03.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:02 smithi027 bash[22610]: cluster 2024-08-31T02:25:01.151058+0000 mgr.a (mgr.14388) 597 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:03.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:02 smithi191 bash[24992]: cluster 2024-08-31T02:25:01.151058+0000 mgr.a (mgr.14388) 597 : cluster [DBG] pgmap v412: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:05.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:04 smithi163 bash[24253]: cluster 2024-08-31T02:25:03.153176+0000 mgr.a (mgr.14388) 598 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:05.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:04 smithi027 bash[22610]: cluster 2024-08-31T02:25:03.153176+0000 mgr.a (mgr.14388) 598 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:05.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:04 smithi191 bash[24992]: cluster 2024-08-31T02:25:03.153176+0000 mgr.a (mgr.14388) 598 : cluster [DBG] pgmap v413: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:05.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:25:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:25:05.384 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:06.126 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:06.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:06.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:06 smithi163 bash[24253]: cluster 2024-08-31T02:25:05.153947+0000 mgr.a (mgr.14388) 599 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:06.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:06 smithi163 bash[24253]: audit 2024-08-31T02:25:05.721338+0000 mgr.a (mgr.14388) 600 : audit [DBG] from='client.26538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:06.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:06 smithi027 bash[22610]: cluster 2024-08-31T02:25:05.153947+0000 mgr.a (mgr.14388) 599 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:06.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:06 smithi027 bash[22610]: audit 2024-08-31T02:25:05.721338+0000 mgr.a (mgr.14388) 600 : audit [DBG] from='client.26538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:06.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:06 smithi191 bash[24992]: cluster 2024-08-31T02:25:05.153947+0000 mgr.a (mgr.14388) 599 : cluster [DBG] pgmap v414: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:06.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:06 smithi191 bash[24992]: audit 2024-08-31T02:25:05.721338+0000 mgr.a (mgr.14388) 600 : audit [DBG] from='client.26538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:08.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:08 smithi027 bash[22610]: cluster 2024-08-31T02:25:07.154845+0000 mgr.a (mgr.14388) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:08.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:08 smithi191 bash[24992]: cluster 2024-08-31T02:25:07.154845+0000 mgr.a (mgr.14388) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:08.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:08 smithi163 bash[24253]: cluster 2024-08-31T02:25:07.154845+0000 mgr.a (mgr.14388) 601 : cluster [DBG] pgmap v415: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:10.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:10 smithi027 bash[22610]: cluster 2024-08-31T02:25:09.157087+0000 mgr.a (mgr.14388) 602 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:10.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:10 smithi191 bash[24992]: cluster 2024-08-31T02:25:09.157087+0000 mgr.a (mgr.14388) 602 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:10.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:10 smithi163 bash[24253]: cluster 2024-08-31T02:25:09.157087+0000 mgr.a (mgr.14388) 602 : cluster [DBG] pgmap v416: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:25:11.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:25:11.129 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:25:11.129 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:11.903 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:11.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:11.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:11.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:11.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:12.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:12 smithi027 bash[22610]: cluster 2024-08-31T02:25:11.157638+0000 mgr.a (mgr.14388) 603 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:12.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:12 smithi027 bash[22610]: audit 2024-08-31T02:25:11.475232+0000 mgr.a (mgr.14388) 604 : audit [DBG] from='client.26613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:12.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:12 smithi191 bash[24992]: cluster 2024-08-31T02:25:11.157638+0000 mgr.a (mgr.14388) 603 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:12.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:12 smithi191 bash[24992]: audit 2024-08-31T02:25:11.475232+0000 mgr.a (mgr.14388) 604 : audit [DBG] from='client.26613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:12.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:12 smithi163 bash[24253]: cluster 2024-08-31T02:25:11.157638+0000 mgr.a (mgr.14388) 603 : cluster [DBG] pgmap v417: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:12.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:12 smithi163 bash[24253]: audit 2024-08-31T02:25:11.475232+0000 mgr.a (mgr.14388) 604 : audit [DBG] from='client.26613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:14.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:14 smithi027 bash[22610]: cluster 2024-08-31T02:25:13.159840+0000 mgr.a (mgr.14388) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:14.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:14 smithi191 bash[24992]: cluster 2024-08-31T02:25:13.159840+0000 mgr.a (mgr.14388) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:14.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:14 smithi163 bash[24253]: cluster 2024-08-31T02:25:13.159840+0000 mgr.a (mgr.14388) 605 : cluster [DBG] pgmap v418: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:16.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:16 smithi027 bash[22610]: cluster 2024-08-31T02:25:15.160605+0000 mgr.a (mgr.14388) 606 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:16.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:16 smithi191 bash[24992]: cluster 2024-08-31T02:25:15.160605+0000 mgr.a (mgr.14388) 606 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:16.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:16 smithi163 bash[24253]: cluster 2024-08-31T02:25:15.160605+0000 mgr.a (mgr.14388) 606 : cluster [DBG] pgmap v419: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:16.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:25:16.906 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:25:16.906 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:17.671 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:17.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:17.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:17.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:17.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:18.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:18 smithi027 bash[22610]: cluster 2024-08-31T02:25:17.161360+0000 mgr.a (mgr.14388) 607 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:18.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:18 smithi027 bash[22610]: audit 2024-08-31T02:25:17.247180+0000 mgr.a (mgr.14388) 608 : audit [DBG] from='client.26691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:18.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:18 smithi191 bash[24992]: cluster 2024-08-31T02:25:17.161360+0000 mgr.a (mgr.14388) 607 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:18.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:18 smithi191 bash[24992]: audit 2024-08-31T02:25:17.247180+0000 mgr.a (mgr.14388) 608 : audit [DBG] from='client.26691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:18.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:18 smithi163 bash[24253]: cluster 2024-08-31T02:25:17.161360+0000 mgr.a (mgr.14388) 607 : cluster [DBG] pgmap v420: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:18.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:18 smithi163 bash[24253]: audit 2024-08-31T02:25:17.247180+0000 mgr.a (mgr.14388) 608 : audit [DBG] from='client.26691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:20.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:20 smithi191 bash[24992]: cluster 2024-08-31T02:25:19.163700+0000 mgr.a (mgr.14388) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:20.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:20 smithi163 bash[24253]: cluster 2024-08-31T02:25:19.163700+0000 mgr.a (mgr.14388) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:20.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:20 smithi027 bash[22610]: cluster 2024-08-31T02:25:19.163700+0000 mgr.a (mgr.14388) 609 : cluster [DBG] pgmap v421: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:22.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:22 smithi191 bash[24992]: cluster 2024-08-31T02:25:21.164490+0000 mgr.a (mgr.14388) 610 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:22.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:25:22.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:25:22.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:22.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:22 smithi163 bash[24253]: cluster 2024-08-31T02:25:21.164490+0000 mgr.a (mgr.14388) 610 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:22.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:22 smithi027 bash[22610]: cluster 2024-08-31T02:25:21.164490+0000 mgr.a (mgr.14388) 610 : cluster [DBG] pgmap v422: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:23.437 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:23.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:23.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:23.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:23.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:24.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:24 smithi191 bash[24992]: audit 2024-08-31T02:25:23.014292+0000 mgr.a (mgr.14388) 611 : audit [DBG] from='client.26769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:24.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:24 smithi191 bash[24992]: cluster 2024-08-31T02:25:23.166330+0000 mgr.a (mgr.14388) 612 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:24.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:24 smithi163 bash[24253]: audit 2024-08-31T02:25:23.014292+0000 mgr.a (mgr.14388) 611 : audit [DBG] from='client.26769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:24.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:24 smithi163 bash[24253]: cluster 2024-08-31T02:25:23.166330+0000 mgr.a (mgr.14388) 612 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:24.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:24 smithi027 bash[22610]: audit 2024-08-31T02:25:23.014292+0000 mgr.a (mgr.14388) 611 : audit [DBG] from='client.26769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:24.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:24 smithi027 bash[22610]: cluster 2024-08-31T02:25:23.166330+0000 mgr.a (mgr.14388) 612 : cluster [DBG] pgmap v423: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:26.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:26 smithi191 bash[24992]: cluster 2024-08-31T02:25:25.167201+0000 mgr.a (mgr.14388) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:25:26.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:26 smithi163 bash[24253]: cluster 2024-08-31T02:25:25.167201+0000 mgr.a (mgr.14388) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:25:26.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:26 smithi027 bash[22610]: cluster 2024-08-31T02:25:25.167201+0000 mgr.a (mgr.14388) 613 : cluster [DBG] pgmap v424: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:25:28.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:25:28.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:25:28.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:28.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:28 smithi191 bash[24992]: cluster 2024-08-31T02:25:27.167949+0000 mgr.a (mgr.14388) 614 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:25:28.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:28 smithi163 bash[24253]: cluster 2024-08-31T02:25:27.167949+0000 mgr.a (mgr.14388) 614 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:25:28.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:28 smithi027 bash[22610]: cluster 2024-08-31T02:25:27.167949+0000 mgr.a (mgr.14388) 614 : cluster [DBG] pgmap v425: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:25:29.196 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:29.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:29.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:29.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:29.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:29.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:29 smithi191 bash[24992]: audit 2024-08-31T02:25:28.778399+0000 mgr.a (mgr.14388) 615 : audit [DBG] from='client.26847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:29.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:29 smithi163 bash[24253]: audit 2024-08-31T02:25:28.778399+0000 mgr.a (mgr.14388) 615 : audit [DBG] from='client.26847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:29.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:29 smithi027 bash[22610]: audit 2024-08-31T02:25:28.778399+0000 mgr.a (mgr.14388) 615 : audit [DBG] from='client.26847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:30.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:30 smithi191 bash[24992]: cluster 2024-08-31T02:25:29.169926+0000 mgr.a (mgr.14388) 616 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:30.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:30 smithi163 bash[24253]: cluster 2024-08-31T02:25:29.169926+0000 mgr.a (mgr.14388) 616 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:30.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:30 smithi027 bash[22610]: cluster 2024-08-31T02:25:29.169926+0000 mgr.a (mgr.14388) 616 : cluster [DBG] pgmap v426: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:32.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:32 smithi191 bash[24992]: cluster 2024-08-31T02:25:31.170677+0000 mgr.a (mgr.14388) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:25:32.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:32 smithi163 bash[24253]: cluster 2024-08-31T02:25:31.170677+0000 mgr.a (mgr.14388) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:25:32.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:32 smithi027 bash[22610]: cluster 2024-08-31T02:25:31.170677+0000 mgr.a (mgr.14388) 617 : cluster [DBG] pgmap v427: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:25:34.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:25:34.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:25:34.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:34.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:34 smithi191 bash[24992]: cluster 2024-08-31T02:25:33.172575+0000 mgr.a (mgr.14388) 618 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:34.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:34 smithi163 bash[24253]: cluster 2024-08-31T02:25:33.172575+0000 mgr.a (mgr.14388) 618 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:34.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:34 smithi027 bash[22610]: cluster 2024-08-31T02:25:33.172575+0000 mgr.a (mgr.14388) 618 : cluster [DBG] pgmap v428: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:34.974 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:34.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:34.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:34.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:34.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:35.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:35 smithi191 bash[24992]: audit 2024-08-31T02:25:34.538667+0000 mgr.a (mgr.14388) 619 : audit [DBG] from='client.26925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:35.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:35 smithi163 bash[24253]: audit 2024-08-31T02:25:34.538667+0000 mgr.a (mgr.14388) 619 : audit [DBG] from='client.26925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:35.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:35 smithi027 bash[22610]: audit 2024-08-31T02:25:34.538667+0000 mgr.a (mgr.14388) 619 : audit [DBG] from='client.26925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:36.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:36 smithi191 bash[24992]: cluster 2024-08-31T02:25:35.173427+0000 mgr.a (mgr.14388) 620 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:36.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:36 smithi163 bash[24253]: cluster 2024-08-31T02:25:35.173427+0000 mgr.a (mgr.14388) 620 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:36.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:36 smithi027 bash[22610]: cluster 2024-08-31T02:25:35.173427+0000 mgr.a (mgr.14388) 620 : cluster [DBG] pgmap v429: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:38.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:38 smithi191 bash[24992]: cluster 2024-08-31T02:25:37.174164+0000 mgr.a (mgr.14388) 621 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:38.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:38 smithi163 bash[24253]: cluster 2024-08-31T02:25:37.174164+0000 mgr.a (mgr.14388) 621 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:38.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:38 smithi027 bash[22610]: cluster 2024-08-31T02:25:37.174164+0000 mgr.a (mgr.14388) 621 : cluster [DBG] pgmap v430: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:39.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:25:39.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:25:39.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:40.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:40 smithi163 bash[24253]: cluster 2024-08-31T02:25:39.176343+0000 mgr.a (mgr.14388) 622 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:40.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:40 smithi027 bash[22610]: cluster 2024-08-31T02:25:39.176343+0000 mgr.a (mgr.14388) 622 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:40.749 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:40.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:40.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:40.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:40.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:40.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:40 smithi191 bash[24992]: cluster 2024-08-31T02:25:39.176343+0000 mgr.a (mgr.14388) 622 : cluster [DBG] pgmap v431: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:41.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:41 smithi163 bash[24253]: audit 2024-08-31T02:25:40.321795+0000 mgr.a (mgr.14388) 623 : audit [DBG] from='client.26997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:41.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:41 smithi027 bash[22610]: audit 2024-08-31T02:25:40.321795+0000 mgr.a (mgr.14388) 623 : audit [DBG] from='client.26997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:41.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:41 smithi191 bash[24992]: audit 2024-08-31T02:25:40.321795+0000 mgr.a (mgr.14388) 623 : audit [DBG] from='client.26997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:42.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:42 smithi163 bash[24253]: cluster 2024-08-31T02:25:41.177184+0000 mgr.a (mgr.14388) 624 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:42.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:42 smithi027 bash[22610]: cluster 2024-08-31T02:25:41.177184+0000 mgr.a (mgr.14388) 624 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:42.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:42 smithi191 bash[24992]: cluster 2024-08-31T02:25:41.177184+0000 mgr.a (mgr.14388) 624 : cluster [DBG] pgmap v432: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:44.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:44 smithi163 bash[24253]: cluster 2024-08-31T02:25:43.179317+0000 mgr.a (mgr.14388) 625 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:44.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:44 smithi027 bash[22610]: cluster 2024-08-31T02:25:43.179317+0000 mgr.a (mgr.14388) 625 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:44.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:44 smithi191 bash[24992]: cluster 2024-08-31T02:25:43.179317+0000 mgr.a (mgr.14388) 625 : cluster [DBG] pgmap v433: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:45.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:25:45.751 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:25:45.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:46.489 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:46.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:46.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:46.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:46.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:46.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:46 smithi163 bash[24253]: cluster 2024-08-31T02:25:45.180001+0000 mgr.a (mgr.14388) 626 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:46.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:46 smithi027 bash[22610]: cluster 2024-08-31T02:25:45.180001+0000 mgr.a (mgr.14388) 626 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:46.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:46 smithi191 bash[24992]: cluster 2024-08-31T02:25:45.180001+0000 mgr.a (mgr.14388) 626 : cluster [DBG] pgmap v434: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:47.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:47 smithi163 bash[24253]: audit 2024-08-31T02:25:46.088256+0000 mgr.a (mgr.14388) 627 : audit [DBG] from='client.27075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:47.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:47 smithi027 bash[22610]: audit 2024-08-31T02:25:46.088256+0000 mgr.a (mgr.14388) 627 : audit [DBG] from='client.27075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:47.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:47 smithi191 bash[24992]: audit 2024-08-31T02:25:46.088256+0000 mgr.a (mgr.14388) 627 : audit [DBG] from='client.27075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:48.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:48 smithi163 bash[24253]: cluster 2024-08-31T02:25:47.180869+0000 mgr.a (mgr.14388) 628 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:48.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:48 smithi027 bash[22610]: cluster 2024-08-31T02:25:47.180869+0000 mgr.a (mgr.14388) 628 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:48.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:48 smithi191 bash[24992]: cluster 2024-08-31T02:25:47.180869+0000 mgr.a (mgr.14388) 628 : cluster [DBG] pgmap v435: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:50.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:50 smithi163 bash[24253]: cluster 2024-08-31T02:25:49.183119+0000 mgr.a (mgr.14388) 629 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:50.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:50 smithi027 bash[22610]: cluster 2024-08-31T02:25:49.183119+0000 mgr.a (mgr.14388) 629 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:50.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:50 smithi191 bash[24992]: cluster 2024-08-31T02:25:49.183119+0000 mgr.a (mgr.14388) 629 : cluster [DBG] pgmap v436: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:51.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:25:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:25:51.491 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:52.223 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:52.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:52.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:52.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:52.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:52.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:52 smithi163 bash[24253]: cluster 2024-08-31T02:25:51.183850+0000 mgr.a (mgr.14388) 630 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:52.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:52 smithi163 bash[24253]: audit 2024-08-31T02:25:51.826114+0000 mgr.a (mgr.14388) 631 : audit [DBG] from='client.27150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:52.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:52 smithi027 bash[22610]: cluster 2024-08-31T02:25:51.183850+0000 mgr.a (mgr.14388) 630 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:52.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:52 smithi027 bash[22610]: audit 2024-08-31T02:25:51.826114+0000 mgr.a (mgr.14388) 631 : audit [DBG] from='client.27150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:52.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:52 smithi191 bash[24992]: cluster 2024-08-31T02:25:51.183850+0000 mgr.a (mgr.14388) 630 : cluster [DBG] pgmap v437: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:52.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:52 smithi191 bash[24992]: audit 2024-08-31T02:25:51.826114+0000 mgr.a (mgr.14388) 631 : audit [DBG] from='client.27150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:54.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:54 smithi163 bash[24253]: cluster 2024-08-31T02:25:53.186074+0000 mgr.a (mgr.14388) 632 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:54.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:54 smithi163 bash[24253]: audit 2024-08-31T02:25:53.651466+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:25:54.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:54 smithi027 bash[22610]: cluster 2024-08-31T02:25:53.186074+0000 mgr.a (mgr.14388) 632 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:54.726 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:54 smithi027 bash[22610]: audit 2024-08-31T02:25:53.651466+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:25:54.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:54 smithi191 bash[24992]: cluster 2024-08-31T02:25:53.186074+0000 mgr.a (mgr.14388) 632 : cluster [DBG] pgmap v438: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:25:54.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:54 smithi191 bash[24992]: audit 2024-08-31T02:25:53.651466+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:25:55.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:55 smithi163 bash[24253]: audit 2024-08-31T02:25:54.500889+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:25:55.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:55 smithi163 bash[24253]: audit 2024-08-31T02:25:54.502868+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:25:55.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:55 smithi163 bash[24253]: audit 2024-08-31T02:25:54.513019+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:25:55.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:55 smithi163 bash[24253]: audit 2024-08-31T02:25:54.517933+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:25:55.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:55 smithi163 bash[24253]: audit 2024-08-31T02:25:54.520266+0000 mgr.a (mgr.14388) 633 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:25:55.727 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:25:55 smithi027 bash[22863]: debug 2024-08-31T02:25:55.231+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:25:55.727 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:25:55 smithi027 bash[22863]: debug 2024-08-31T02:25:55.231+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:25:55.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:55 smithi027 bash[22610]: audit 2024-08-31T02:25:54.500889+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:25:55.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:55 smithi027 bash[22610]: audit 2024-08-31T02:25:54.502868+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:25:55.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:55 smithi027 bash[22610]: audit 2024-08-31T02:25:54.513019+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:25:55.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:55 smithi027 bash[22610]: audit 2024-08-31T02:25:54.517933+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:25:55.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:55 smithi027 bash[22610]: audit 2024-08-31T02:25:54.520266+0000 mgr.a (mgr.14388) 633 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:25:55.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:55 smithi191 bash[24992]: audit 2024-08-31T02:25:54.500889+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:25:55.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:55 smithi191 bash[24992]: audit 2024-08-31T02:25:54.502868+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:25:55.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:55 smithi191 bash[24992]: audit 2024-08-31T02:25:54.513019+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:25:55.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:55 smithi191 bash[24992]: audit 2024-08-31T02:25:54.517933+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:25:55.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:55 smithi191 bash[24992]: audit 2024-08-31T02:25:54.520266+0000 mgr.a (mgr.14388) 633 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:25:56.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:56 smithi191 bash[24992]: cluster 2024-08-31T02:25:55.186541+0000 mgr.a (mgr.14388) 634 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:56.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:56 smithi191 bash[24992]: audit 2024-08-31T02:25:55.235443+0000 mgr.a (mgr.14388) 635 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:25:56.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:56 smithi191 bash[24992]: cephadm 2024-08-31T02:25:55.236604+0000 mgr.a (mgr.14388) 636 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:25:56.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:56 smithi163 bash[24253]: cluster 2024-08-31T02:25:55.186541+0000 mgr.a (mgr.14388) 634 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:56.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:56 smithi163 bash[24253]: audit 2024-08-31T02:25:55.235443+0000 mgr.a (mgr.14388) 635 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:25:56.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:56 smithi163 bash[24253]: cephadm 2024-08-31T02:25:55.236604+0000 mgr.a (mgr.14388) 636 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:25:56.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:56 smithi027 bash[22610]: cluster 2024-08-31T02:25:55.186541+0000 mgr.a (mgr.14388) 634 : cluster [DBG] pgmap v439: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:56.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:56 smithi027 bash[22610]: audit 2024-08-31T02:25:55.235443+0000 mgr.a (mgr.14388) 635 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:25:56.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:56 smithi027 bash[22610]: cephadm 2024-08-31T02:25:55.236604+0000 mgr.a (mgr.14388) 636 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:25:57.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:25:57.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:25:57.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:25:57.992 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:25:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:25:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:25:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:25:57.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:25:58.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:58 smithi191 bash[24992]: cluster 2024-08-31T02:25:57.187240+0000 mgr.a (mgr.14388) 637 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:58.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:25:58 smithi191 bash[24992]: audit 2024-08-31T02:25:57.566087+0000 mgr.a (mgr.14388) 638 : audit [DBG] from='client.27336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:58.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:58 smithi163 bash[24253]: cluster 2024-08-31T02:25:57.187240+0000 mgr.a (mgr.14388) 637 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:58.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:25:58 smithi163 bash[24253]: audit 2024-08-31T02:25:57.566087+0000 mgr.a (mgr.14388) 638 : audit [DBG] from='client.27336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:25:58.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:58 smithi027 bash[22610]: cluster 2024-08-31T02:25:57.187240+0000 mgr.a (mgr.14388) 637 : cluster [DBG] pgmap v440: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:25:58.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:25:58 smithi027 bash[22610]: audit 2024-08-31T02:25:57.566087+0000 mgr.a (mgr.14388) 638 : audit [DBG] from='client.27336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:00.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:00 smithi191 bash[24992]: cluster 2024-08-31T02:25:59.189572+0000 mgr.a (mgr.14388) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:26:00.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:00 smithi163 bash[24253]: cluster 2024-08-31T02:25:59.189572+0000 mgr.a (mgr.14388) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:26:00.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:00 smithi027 bash[22610]: cluster 2024-08-31T02:25:59.189572+0000 mgr.a (mgr.14388) 639 : cluster [DBG] pgmap v441: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:26:02.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:02 smithi191 bash[24992]: cluster 2024-08-31T02:26:01.190325+0000 mgr.a (mgr.14388) 640 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:26:02.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:02 smithi163 bash[24253]: cluster 2024-08-31T02:26:01.190325+0000 mgr.a (mgr.14388) 640 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:26:02.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:02 smithi027 bash[22610]: cluster 2024-08-31T02:26:01.190325+0000 mgr.a (mgr.14388) 640 : cluster [DBG] pgmap v442: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:26:02.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:26:02.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:26:02.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:26:03.764 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:26:03.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:26:03.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:26:03.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:26:03.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:26:04.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:04 smithi191 bash[24992]: cluster 2024-08-31T02:26:03.192232+0000 mgr.a (mgr.14388) 641 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:26:04.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:04 smithi191 bash[24992]: audit 2024-08-31T02:26:03.338482+0000 mgr.a (mgr.14388) 642 : audit [DBG] from='client.27411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:04.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:04 smithi163 bash[24253]: cluster 2024-08-31T02:26:03.192232+0000 mgr.a (mgr.14388) 641 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:26:04.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:04 smithi163 bash[24253]: audit 2024-08-31T02:26:03.338482+0000 mgr.a (mgr.14388) 642 : audit [DBG] from='client.27411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:04.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:04 smithi027 bash[22610]: cluster 2024-08-31T02:26:03.192232+0000 mgr.a (mgr.14388) 641 : cluster [DBG] pgmap v443: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:26:04.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:04 smithi027 bash[22610]: audit 2024-08-31T02:26:03.338482+0000 mgr.a (mgr.14388) 642 : audit [DBG] from='client.27411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:06.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:06 smithi191 bash[24992]: cluster 2024-08-31T02:26:05.193169+0000 mgr.a (mgr.14388) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:26:06.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:06 smithi163 bash[24253]: cluster 2024-08-31T02:26:05.193169+0000 mgr.a (mgr.14388) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:26:06.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:06 smithi027 bash[22610]: cluster 2024-08-31T02:26:05.193169+0000 mgr.a (mgr.14388) 643 : cluster [DBG] pgmap v444: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:26:08.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:26:08.767 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:26:08.767 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:26:08.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:08 smithi191 bash[24992]: cluster 2024-08-31T02:26:07.193952+0000 mgr.a (mgr.14388) 644 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:26:08.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:08 smithi163 bash[24253]: cluster 2024-08-31T02:26:07.193952+0000 mgr.a (mgr.14388) 644 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:26:08.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:08 smithi027 bash[22610]: cluster 2024-08-31T02:26:07.193952+0000 mgr.a (mgr.14388) 644 : cluster [DBG] pgmap v445: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:26:09.514 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:26:09.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:26:09.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:26:09.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:26:09.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:26:10.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:10 smithi163 bash[24253]: audit 2024-08-31T02:26:09.105372+0000 mgr.a (mgr.14388) 645 : audit [DBG] from='client.27486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:10.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:10 smithi163 bash[24253]: cluster 2024-08-31T02:26:09.195157+0000 mgr.a (mgr.14388) 646 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:26:10.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:10 smithi027 bash[22610]: audit 2024-08-31T02:26:09.105372+0000 mgr.a (mgr.14388) 645 : audit [DBG] from='client.27486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:10.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:10 smithi027 bash[22610]: cluster 2024-08-31T02:26:09.195157+0000 mgr.a (mgr.14388) 646 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:26:11.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:10 smithi191 bash[24992]: audit 2024-08-31T02:26:09.105372+0000 mgr.a (mgr.14388) 645 : audit [DBG] from='client.27486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:11.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:10 smithi191 bash[24992]: cluster 2024-08-31T02:26:09.195157+0000 mgr.a (mgr.14388) 646 : cluster [DBG] pgmap v446: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:26:12.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:12 smithi163 bash[24253]: cluster 2024-08-31T02:26:11.196024+0000 mgr.a (mgr.14388) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:26:12.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:12 smithi027 bash[22610]: cluster 2024-08-31T02:26:11.196024+0000 mgr.a (mgr.14388) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:26:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:12 smithi191 bash[24992]: cluster 2024-08-31T02:26:11.196024+0000 mgr.a (mgr.14388) 647 : cluster [DBG] pgmap v447: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:26:14.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:26:14.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:26:14.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:26:14.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:14 smithi163 bash[24253]: cluster 2024-08-31T02:26:13.198160+0000 mgr.a (mgr.14388) 648 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:26:14.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:14 smithi027 bash[22610]: cluster 2024-08-31T02:26:13.198160+0000 mgr.a (mgr.14388) 648 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:26:15.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:14 smithi191 bash[24992]: cluster 2024-08-31T02:26:13.198160+0000 mgr.a (mgr.14388) 648 : cluster [DBG] pgmap v448: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:26:15.284 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:26:15.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:26:15.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:26:15.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:26:15.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:26:15.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:15 smithi163 bash[24253]: audit 2024-08-31T02:26:14.854659+0000 mgr.a (mgr.14388) 649 : audit [DBG] from='client.27561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:15.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:15 smithi027 bash[22610]: audit 2024-08-31T02:26:14.854659+0000 mgr.a (mgr.14388) 649 : audit [DBG] from='client.27561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:16.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:15 smithi191 bash[24992]: audit 2024-08-31T02:26:14.854659+0000 mgr.a (mgr.14388) 649 : audit [DBG] from='client.27561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:16.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:16 smithi163 bash[24253]: cluster 2024-08-31T02:26:15.198714+0000 mgr.a (mgr.14388) 650 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:16.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:16 smithi027 bash[22610]: cluster 2024-08-31T02:26:15.198714+0000 mgr.a (mgr.14388) 650 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:17.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:16 smithi191 bash[24992]: cluster 2024-08-31T02:26:15.198714+0000 mgr.a (mgr.14388) 650 : cluster [DBG] pgmap v449: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:18.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:18 smithi163 bash[24253]: cluster 2024-08-31T02:26:17.199577+0000 mgr.a (mgr.14388) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:18.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:18 smithi027 bash[22610]: cluster 2024-08-31T02:26:17.199577+0000 mgr.a (mgr.14388) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:19.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:18 smithi191 bash[24992]: cluster 2024-08-31T02:26:17.199577+0000 mgr.a (mgr.14388) 651 : cluster [DBG] pgmap v450: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:20.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:26:20.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:26:20.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:26:20.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:20 smithi163 bash[24253]: cluster 2024-08-31T02:26:19.201800+0000 mgr.a (mgr.14388) 652 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:20.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:20 smithi027 bash[22610]: cluster 2024-08-31T02:26:19.201800+0000 mgr.a (mgr.14388) 652 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:20 smithi191 bash[24992]: cluster 2024-08-31T02:26:19.201800+0000 mgr.a (mgr.14388) 652 : cluster [DBG] pgmap v451: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:21.051 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:26:21.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:26:21.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:26:21.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:26:21.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:26:21.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:21 smithi163 bash[24253]: audit 2024-08-31T02:26:20.627470+0000 mgr.a (mgr.14388) 653 : audit [DBG] from='client.27639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:21.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:21 smithi027 bash[22610]: audit 2024-08-31T02:26:20.627470+0000 mgr.a (mgr.14388) 653 : audit [DBG] from='client.27639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:22.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:21 smithi191 bash[24992]: audit 2024-08-31T02:26:20.627470+0000 mgr.a (mgr.14388) 653 : audit [DBG] from='client.27639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:22.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:22 smithi163 bash[24253]: cluster 2024-08-31T02:26:21.202709+0000 mgr.a (mgr.14388) 654 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:22.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:22 smithi027 bash[22610]: cluster 2024-08-31T02:26:21.202709+0000 mgr.a (mgr.14388) 654 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:23.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:22 smithi191 bash[24992]: cluster 2024-08-31T02:26:21.202709+0000 mgr.a (mgr.14388) 654 : cluster [DBG] pgmap v452: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:24.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:24 smithi163 bash[24253]: cluster 2024-08-31T02:26:23.204924+0000 mgr.a (mgr.14388) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:24.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:24 smithi027 bash[22610]: cluster 2024-08-31T02:26:23.204924+0000 mgr.a (mgr.14388) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:25.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:24 smithi191 bash[24992]: cluster 2024-08-31T02:26:23.204924+0000 mgr.a (mgr.14388) 655 : cluster [DBG] pgmap v453: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:26.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:26:26.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:26:26.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:26:26.795 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:26:26.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:26:26.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:26:26.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:26:26.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:26:26.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:26 smithi163 bash[24253]: cluster 2024-08-31T02:26:25.205710+0000 mgr.a (mgr.14388) 656 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:26.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:26 smithi027 bash[22610]: cluster 2024-08-31T02:26:25.205710+0000 mgr.a (mgr.14388) 656 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:26 smithi191 bash[24992]: cluster 2024-08-31T02:26:25.205710+0000 mgr.a (mgr.14388) 656 : cluster [DBG] pgmap v454: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:27.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:27 smithi163 bash[24253]: audit 2024-08-31T02:26:26.392972+0000 mgr.a (mgr.14388) 657 : audit [DBG] from='client.27714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:27.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:27 smithi027 bash[22610]: audit 2024-08-31T02:26:26.392972+0000 mgr.a (mgr.14388) 657 : audit [DBG] from='client.27714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:28.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:27 smithi191 bash[24992]: audit 2024-08-31T02:26:26.392972+0000 mgr.a (mgr.14388) 657 : audit [DBG] from='client.27714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:28.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:28 smithi163 bash[24253]: cluster 2024-08-31T02:26:27.206583+0000 mgr.a (mgr.14388) 658 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:28.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:28 smithi027 bash[22610]: cluster 2024-08-31T02:26:27.206583+0000 mgr.a (mgr.14388) 658 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:29.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:28 smithi191 bash[24992]: cluster 2024-08-31T02:26:27.206583+0000 mgr.a (mgr.14388) 658 : cluster [DBG] pgmap v455: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:30.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:30 smithi163 bash[24253]: cluster 2024-08-31T02:26:29.208815+0000 mgr.a (mgr.14388) 659 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:30.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:30 smithi027 bash[22610]: cluster 2024-08-31T02:26:29.208815+0000 mgr.a (mgr.14388) 659 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:31.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:30 smithi191 bash[24992]: cluster 2024-08-31T02:26:29.208815+0000 mgr.a (mgr.14388) 659 : cluster [DBG] pgmap v456: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:31.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:26:31.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:26:31.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:26:32.571 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:26:32.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:26:32.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:26:32.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:26:32.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:26:32.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:32 smithi163 bash[24253]: cluster 2024-08-31T02:26:31.209584+0000 mgr.a (mgr.14388) 660 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:32.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:32 smithi027 bash[22610]: cluster 2024-08-31T02:26:31.209584+0000 mgr.a (mgr.14388) 660 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:33.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:32 smithi191 bash[24992]: cluster 2024-08-31T02:26:31.209584+0000 mgr.a (mgr.14388) 660 : cluster [DBG] pgmap v457: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:33.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:33 smithi163 bash[24253]: audit 2024-08-31T02:26:32.135763+0000 mgr.a (mgr.14388) 661 : audit [DBG] from='client.27792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:33.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:33 smithi027 bash[22610]: audit 2024-08-31T02:26:32.135763+0000 mgr.a (mgr.14388) 661 : audit [DBG] from='client.27792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:34.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:33 smithi191 bash[24992]: audit 2024-08-31T02:26:32.135763+0000 mgr.a (mgr.14388) 661 : audit [DBG] from='client.27792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:34.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:34 smithi163 bash[24253]: cluster 2024-08-31T02:26:33.211861+0000 mgr.a (mgr.14388) 662 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:34.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:34 smithi027 bash[22610]: cluster 2024-08-31T02:26:33.211861+0000 mgr.a (mgr.14388) 662 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:35.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:34 smithi191 bash[24992]: cluster 2024-08-31T02:26:33.211861+0000 mgr.a (mgr.14388) 662 : cluster [DBG] pgmap v458: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:36.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:36 smithi163 bash[24253]: cluster 2024-08-31T02:26:35.212686+0000 mgr.a (mgr.14388) 663 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:36.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:36 smithi027 bash[22610]: cluster 2024-08-31T02:26:35.212686+0000 mgr.a (mgr.14388) 663 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:37.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:36 smithi191 bash[24992]: cluster 2024-08-31T02:26:35.212686+0000 mgr.a (mgr.14388) 663 : cluster [DBG] pgmap v459: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:37.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:26:37.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:26:37.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:26:38.306 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:26:38.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:26:38.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:26:38.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:26:38.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:26:38.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:38 smithi163 bash[24253]: cluster 2024-08-31T02:26:37.213434+0000 mgr.a (mgr.14388) 664 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:38.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:38 smithi163 bash[24253]: audit 2024-08-31T02:26:37.912157+0000 mgr.a (mgr.14388) 665 : audit [DBG] from='client.27870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:38.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:38 smithi027 bash[22610]: cluster 2024-08-31T02:26:37.213434+0000 mgr.a (mgr.14388) 664 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:38.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:38 smithi027 bash[22610]: audit 2024-08-31T02:26:37.912157+0000 mgr.a (mgr.14388) 665 : audit [DBG] from='client.27870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:38 smithi191 bash[24992]: cluster 2024-08-31T02:26:37.213434+0000 mgr.a (mgr.14388) 664 : cluster [DBG] pgmap v460: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:38 smithi191 bash[24992]: audit 2024-08-31T02:26:37.912157+0000 mgr.a (mgr.14388) 665 : audit [DBG] from='client.27870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:40.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:40 smithi163 bash[24253]: cluster 2024-08-31T02:26:39.216178+0000 mgr.a (mgr.14388) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:40.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:40 smithi027 bash[22610]: cluster 2024-08-31T02:26:39.216178+0000 mgr.a (mgr.14388) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:41.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:40 smithi191 bash[24992]: cluster 2024-08-31T02:26:39.216178+0000 mgr.a (mgr.14388) 666 : cluster [DBG] pgmap v461: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:42.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:42 smithi163 bash[24253]: cluster 2024-08-31T02:26:41.216953+0000 mgr.a (mgr.14388) 667 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:26:42.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:42 smithi027 bash[22610]: cluster 2024-08-31T02:26:41.216953+0000 mgr.a (mgr.14388) 667 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:26:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:42 smithi191 bash[24992]: cluster 2024-08-31T02:26:41.216953+0000 mgr.a (mgr.14388) 667 : cluster [DBG] pgmap v462: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:26:43.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:26:43.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:26:43.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:26:44.047 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:26:44.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:26:44.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:26:44.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:26:44.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:26:44.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:44 smithi163 bash[24253]: cluster 2024-08-31T02:26:43.218884+0000 mgr.a (mgr.14388) 668 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:44.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:44 smithi163 bash[24253]: audit 2024-08-31T02:26:43.645963+0000 mgr.a (mgr.14388) 669 : audit [DBG] from='client.27948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:44.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:44 smithi027 bash[22610]: cluster 2024-08-31T02:26:43.218884+0000 mgr.a (mgr.14388) 668 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:44.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:44 smithi027 bash[22610]: audit 2024-08-31T02:26:43.645963+0000 mgr.a (mgr.14388) 669 : audit [DBG] from='client.27948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:45.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:44 smithi191 bash[24992]: cluster 2024-08-31T02:26:43.218884+0000 mgr.a (mgr.14388) 668 : cluster [DBG] pgmap v463: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:45.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:44 smithi191 bash[24992]: audit 2024-08-31T02:26:43.645963+0000 mgr.a (mgr.14388) 669 : audit [DBG] from='client.27948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:46.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:46 smithi163 bash[24253]: cluster 2024-08-31T02:26:45.219789+0000 mgr.a (mgr.14388) 670 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:26:46.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:46 smithi027 bash[22610]: cluster 2024-08-31T02:26:45.219789+0000 mgr.a (mgr.14388) 670 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:26:47.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:46 smithi191 bash[24992]: cluster 2024-08-31T02:26:45.219789+0000 mgr.a (mgr.14388) 670 : cluster [DBG] pgmap v464: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:26:48.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:48 smithi163 bash[24253]: cluster 2024-08-31T02:26:47.220583+0000 mgr.a (mgr.14388) 671 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:26:48.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:48 smithi027 bash[22610]: cluster 2024-08-31T02:26:47.220583+0000 mgr.a (mgr.14388) 671 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:26:49.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:48 smithi191 bash[24992]: cluster 2024-08-31T02:26:47.220583+0000 mgr.a (mgr.14388) 671 : cluster [DBG] pgmap v465: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:26:49.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:26:49.049 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:26:49.049 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:26:49.791 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:26:49.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:26:49.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:26:49.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:26:49.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:26:50.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:50 smithi163 bash[24253]: cluster 2024-08-31T02:26:49.222672+0000 mgr.a (mgr.14388) 672 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:50.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:50 smithi163 bash[24253]: audit 2024-08-31T02:26:49.388344+0000 mgr.a (mgr.14388) 673 : audit [DBG] from='client.28023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:50.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:50 smithi027 bash[22610]: cluster 2024-08-31T02:26:49.222672+0000 mgr.a (mgr.14388) 672 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:50.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:50 smithi027 bash[22610]: audit 2024-08-31T02:26:49.388344+0000 mgr.a (mgr.14388) 673 : audit [DBG] from='client.28023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:51.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:50 smithi191 bash[24992]: cluster 2024-08-31T02:26:49.222672+0000 mgr.a (mgr.14388) 672 : cluster [DBG] pgmap v466: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:51.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:50 smithi191 bash[24992]: audit 2024-08-31T02:26:49.388344+0000 mgr.a (mgr.14388) 673 : audit [DBG] from='client.28023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:52.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:52 smithi163 bash[24253]: cluster 2024-08-31T02:26:51.223642+0000 mgr.a (mgr.14388) 674 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:52.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:52 smithi027 bash[22610]: cluster 2024-08-31T02:26:51.223642+0000 mgr.a (mgr.14388) 674 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:52 smithi191 bash[24992]: cluster 2024-08-31T02:26:51.223642+0000 mgr.a (mgr.14388) 674 : cluster [DBG] pgmap v467: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:54.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:26:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:26:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:26:54.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:54 smithi163 bash[24253]: cluster 2024-08-31T02:26:53.225800+0000 mgr.a (mgr.14388) 675 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:54.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:54 smithi027 bash[22610]: cluster 2024-08-31T02:26:53.225800+0000 mgr.a (mgr.14388) 675 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:55.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:54 smithi191 bash[24992]: cluster 2024-08-31T02:26:53.225800+0000 mgr.a (mgr.14388) 675 : cluster [DBG] pgmap v468: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:26:55.564 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:26:55.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:26:55.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:26:55.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:26:55.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:26:55.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:55 smithi163 bash[24253]: audit 2024-08-31T02:26:55.286895+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:26:55.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:55 smithi027 bash[22610]: audit 2024-08-31T02:26:55.286895+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:26:56.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:55 smithi191 bash[24992]: audit 2024-08-31T02:26:55.286895+0000 mon.a (mon.0) 693 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:26:57.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:56 smithi163 bash[24253]: audit 2024-08-31T02:26:55.134959+0000 mgr.a (mgr.14388) 676 : audit [DBG] from='client.28095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:57.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:56 smithi163 bash[24253]: cluster 2024-08-31T02:26:55.226284+0000 mgr.a (mgr.14388) 677 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:57.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:56 smithi163 bash[24253]: audit 2024-08-31T02:26:55.861915+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:26:57.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:56 smithi163 bash[24253]: audit 2024-08-31T02:26:55.865921+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:26:57.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:56 smithi163 bash[24253]: audit 2024-08-31T02:26:56.621404+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:26:57.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:56 smithi163 bash[24253]: audit 2024-08-31T02:26:56.622906+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:26:57.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:56 smithi163 bash[24253]: audit 2024-08-31T02:26:56.632059+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:26:57.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:56 smithi163 bash[24253]: audit 2024-08-31T02:26:56.634362+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:26:57.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:56 smithi027 bash[22610]: audit 2024-08-31T02:26:55.134959+0000 mgr.a (mgr.14388) 676 : audit [DBG] from='client.28095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:57.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:56 smithi027 bash[22610]: cluster 2024-08-31T02:26:55.226284+0000 mgr.a (mgr.14388) 677 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:57.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:56 smithi027 bash[22610]: audit 2024-08-31T02:26:55.861915+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:26:57.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:56 smithi027 bash[22610]: audit 2024-08-31T02:26:55.865921+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:26:57.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:56 smithi027 bash[22610]: audit 2024-08-31T02:26:56.621404+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:26:57.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:56 smithi027 bash[22610]: audit 2024-08-31T02:26:56.622906+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:26:57.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:56 smithi027 bash[22610]: audit 2024-08-31T02:26:56.632059+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:26:57.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:56 smithi027 bash[22610]: audit 2024-08-31T02:26:56.634362+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:26:57.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:56 smithi191 bash[24992]: audit 2024-08-31T02:26:55.134959+0000 mgr.a (mgr.14388) 676 : audit [DBG] from='client.28095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:26:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:56 smithi191 bash[24992]: cluster 2024-08-31T02:26:55.226284+0000 mgr.a (mgr.14388) 677 : cluster [DBG] pgmap v469: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:56 smithi191 bash[24992]: audit 2024-08-31T02:26:55.861915+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:26:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:56 smithi191 bash[24992]: audit 2024-08-31T02:26:55.865921+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:26:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:56 smithi191 bash[24992]: audit 2024-08-31T02:26:56.621404+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:26:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:56 smithi191 bash[24992]: audit 2024-08-31T02:26:56.622906+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:26:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:56 smithi191 bash[24992]: audit 2024-08-31T02:26:56.632059+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:26:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:56 smithi191 bash[24992]: audit 2024-08-31T02:26:56.634362+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:26:57.727 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:26:57 smithi027 bash[22863]: debug 2024-08-31T02:26:57.337+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:26:57.727 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:26:57 smithi027 bash[22863]: debug 2024-08-31T02:26:57.337+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:26:58.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:57 smithi163 bash[24253]: audit 2024-08-31T02:26:56.635643+0000 mgr.a (mgr.14388) 678 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:26:58.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:57 smithi027 bash[22610]: audit 2024-08-31T02:26:56.635643+0000 mgr.a (mgr.14388) 678 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:26:58.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:57 smithi191 bash[24992]: audit 2024-08-31T02:26:56.635643+0000 mgr.a (mgr.14388) 678 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:26:59.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:58 smithi163 bash[24253]: cluster 2024-08-31T02:26:57.226717+0000 mgr.a (mgr.14388) 679 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:59.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:58 smithi163 bash[24253]: audit 2024-08-31T02:26:57.340312+0000 mgr.a (mgr.14388) 680 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:26:59.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:26:58 smithi163 bash[24253]: cephadm 2024-08-31T02:26:57.341424+0000 mgr.a (mgr.14388) 681 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:26:59.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:58 smithi027 bash[22610]: cluster 2024-08-31T02:26:57.226717+0000 mgr.a (mgr.14388) 679 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:59.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:58 smithi027 bash[22610]: audit 2024-08-31T02:26:57.340312+0000 mgr.a (mgr.14388) 680 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:26:59.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:26:58 smithi027 bash[22610]: cephadm 2024-08-31T02:26:57.341424+0000 mgr.a (mgr.14388) 681 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:26:59.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:58 smithi191 bash[24992]: cluster 2024-08-31T02:26:57.226717+0000 mgr.a (mgr.14388) 679 : cluster [DBG] pgmap v470: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:26:59.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:58 smithi191 bash[24992]: audit 2024-08-31T02:26:57.340312+0000 mgr.a (mgr.14388) 680 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:26:59.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:26:58 smithi191 bash[24992]: cephadm 2024-08-31T02:26:57.341424+0000 mgr.a (mgr.14388) 681 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:27:00.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:00.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:00.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:01.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:00 smithi163 bash[24253]: cluster 2024-08-31T02:26:59.228840+0000 mgr.a (mgr.14388) 682 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:01.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:00 smithi027 bash[22610]: cluster 2024-08-31T02:26:59.228840+0000 mgr.a (mgr.14388) 682 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:01.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:00 smithi191 bash[24992]: cluster 2024-08-31T02:26:59.228840+0000 mgr.a (mgr.14388) 682 : cluster [DBG] pgmap v471: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:01.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:01.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:01.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:01.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:01.332 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:02.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:01 smithi163 bash[24253]: audit 2024-08-31T02:27:00.906335+0000 mgr.a (mgr.14388) 683 : audit [DBG] from='client.28275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:02.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:01 smithi027 bash[22610]: audit 2024-08-31T02:27:00.906335+0000 mgr.a (mgr.14388) 683 : audit [DBG] from='client.28275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:02.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:01 smithi191 bash[24992]: audit 2024-08-31T02:27:00.906335+0000 mgr.a (mgr.14388) 683 : audit [DBG] from='client.28275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:03.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:02 smithi163 bash[24253]: cluster 2024-08-31T02:27:01.236297+0000 mgr.a (mgr.14388) 684 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:03.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:02 smithi027 bash[22610]: cluster 2024-08-31T02:27:01.236297+0000 mgr.a (mgr.14388) 684 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:03.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:02 smithi191 bash[24992]: cluster 2024-08-31T02:27:01.236297+0000 mgr.a (mgr.14388) 684 : cluster [DBG] pgmap v472: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:05.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:04 smithi163 bash[24253]: cluster 2024-08-31T02:27:03.238440+0000 mgr.a (mgr.14388) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:05.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:04 smithi027 bash[22610]: cluster 2024-08-31T02:27:03.238440+0000 mgr.a (mgr.14388) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:05.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:04 smithi191 bash[24992]: cluster 2024-08-31T02:27:03.238440+0000 mgr.a (mgr.14388) 685 : cluster [DBG] pgmap v473: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:06.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:06.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:06.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:06.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:06 smithi163 bash[24253]: cluster 2024-08-31T02:27:05.239219+0000 mgr.a (mgr.14388) 686 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:06.477 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:06 smithi027 bash[22610]: cluster 2024-08-31T02:27:05.239219+0000 mgr.a (mgr.14388) 686 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:06.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:06 smithi191 bash[24992]: cluster 2024-08-31T02:27:05.239219+0000 mgr.a (mgr.14388) 686 : cluster [DBG] pgmap v474: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:07.057 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:07.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:07.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:07.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:07.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:07.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:07 smithi163 bash[24253]: audit 2024-08-31T02:27:06.664958+0000 mgr.a (mgr.14388) 687 : audit [DBG] from='client.28347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:07.477 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:07 smithi027 bash[22610]: audit 2024-08-31T02:27:06.664958+0000 mgr.a (mgr.14388) 687 : audit [DBG] from='client.28347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:07.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:07 smithi191 bash[24992]: audit 2024-08-31T02:27:06.664958+0000 mgr.a (mgr.14388) 687 : audit [DBG] from='client.28347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:08.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:08 smithi163 bash[24253]: cluster 2024-08-31T02:27:07.240167+0000 mgr.a (mgr.14388) 688 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:08.477 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:08 smithi027 bash[22610]: cluster 2024-08-31T02:27:07.240167+0000 mgr.a (mgr.14388) 688 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:08.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:08 smithi191 bash[24992]: cluster 2024-08-31T02:27:07.240167+0000 mgr.a (mgr.14388) 688 : cluster [DBG] pgmap v475: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:10.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:10 smithi163 bash[24253]: cluster 2024-08-31T02:27:09.242360+0000 mgr.a (mgr.14388) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:10.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:10 smithi027 bash[22610]: cluster 2024-08-31T02:27:09.242360+0000 mgr.a (mgr.14388) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:10.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:10 smithi191 bash[24992]: cluster 2024-08-31T02:27:09.242360+0000 mgr.a (mgr.14388) 689 : cluster [DBG] pgmap v476: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:27:12.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:12.059 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:12.059 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:12.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:12 smithi163 bash[24253]: cluster 2024-08-31T02:27:11.243166+0000 mgr.a (mgr.14388) 690 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:12.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:12 smithi027 bash[22610]: cluster 2024-08-31T02:27:11.243166+0000 mgr.a (mgr.14388) 690 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:12.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:12 smithi191 bash[24992]: cluster 2024-08-31T02:27:11.243166+0000 mgr.a (mgr.14388) 690 : cluster [DBG] pgmap v477: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:12.794 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:12.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:12.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:12.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:12.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:13.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:13 smithi163 bash[24253]: audit 2024-08-31T02:27:12.394386+0000 mgr.a (mgr.14388) 691 : audit [DBG] from='client.28422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:13.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:13 smithi027 bash[22610]: audit 2024-08-31T02:27:12.394386+0000 mgr.a (mgr.14388) 691 : audit [DBG] from='client.28422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:13.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:13 smithi191 bash[24992]: audit 2024-08-31T02:27:12.394386+0000 mgr.a (mgr.14388) 691 : audit [DBG] from='client.28422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:14.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:14 smithi163 bash[24253]: cluster 2024-08-31T02:27:13.245433+0000 mgr.a (mgr.14388) 692 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:27:14.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:14 smithi027 bash[22610]: cluster 2024-08-31T02:27:13.245433+0000 mgr.a (mgr.14388) 692 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:27:14.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:14 smithi191 bash[24992]: cluster 2024-08-31T02:27:13.245433+0000 mgr.a (mgr.14388) 692 : cluster [DBG] pgmap v478: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:27:16.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:16 smithi163 bash[24253]: cluster 2024-08-31T02:27:15.246223+0000 mgr.a (mgr.14388) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:27:16.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:16 smithi027 bash[22610]: cluster 2024-08-31T02:27:15.246223+0000 mgr.a (mgr.14388) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:27:16.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:16 smithi191 bash[24992]: cluster 2024-08-31T02:27:15.246223+0000 mgr.a (mgr.14388) 693 : cluster [DBG] pgmap v479: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:27:17.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:17.796 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:17.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:18.572 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:18.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:18.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:18.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:18.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:18.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:18 smithi163 bash[24253]: cluster 2024-08-31T02:27:17.246996+0000 mgr.a (mgr.14388) 694 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:27:18.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:18 smithi027 bash[22610]: cluster 2024-08-31T02:27:17.246996+0000 mgr.a (mgr.14388) 694 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:27:18.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:18 smithi191 bash[24992]: cluster 2024-08-31T02:27:17.246996+0000 mgr.a (mgr.14388) 694 : cluster [DBG] pgmap v480: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:27:19.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:19 smithi163 bash[24253]: audit 2024-08-31T02:27:18.142907+0000 mgr.a (mgr.14388) 695 : audit [DBG] from='client.28500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:19.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:19 smithi027 bash[22610]: audit 2024-08-31T02:27:18.142907+0000 mgr.a (mgr.14388) 695 : audit [DBG] from='client.28500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:19.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:19 smithi191 bash[24992]: audit 2024-08-31T02:27:18.142907+0000 mgr.a (mgr.14388) 695 : audit [DBG] from='client.28500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:20.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:20 smithi163 bash[24253]: cluster 2024-08-31T02:27:19.249702+0000 mgr.a (mgr.14388) 696 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:20.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:20 smithi027 bash[22610]: cluster 2024-08-31T02:27:19.249702+0000 mgr.a (mgr.14388) 696 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:20.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:20 smithi191 bash[24992]: cluster 2024-08-31T02:27:19.249702+0000 mgr.a (mgr.14388) 696 : cluster [DBG] pgmap v481: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:22.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:22 smithi163 bash[24253]: cluster 2024-08-31T02:27:21.250482+0000 mgr.a (mgr.14388) 697 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:27:22.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:22 smithi027 bash[22610]: cluster 2024-08-31T02:27:21.250482+0000 mgr.a (mgr.14388) 697 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:27:22.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:22 smithi191 bash[24992]: cluster 2024-08-31T02:27:21.250482+0000 mgr.a (mgr.14388) 697 : cluster [DBG] pgmap v482: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:27:23.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:23.574 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:23.574 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:24.319 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:24.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:24.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:24.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:24.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:24.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:24 smithi163 bash[24253]: cluster 2024-08-31T02:27:23.252388+0000 mgr.a (mgr.14388) 698 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:24.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:24 smithi163 bash[24253]: audit 2024-08-31T02:27:23.911184+0000 mgr.a (mgr.14388) 699 : audit [DBG] from='client.28578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:24.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:24 smithi027 bash[22610]: cluster 2024-08-31T02:27:23.252388+0000 mgr.a (mgr.14388) 698 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:24.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:24 smithi027 bash[22610]: audit 2024-08-31T02:27:23.911184+0000 mgr.a (mgr.14388) 699 : audit [DBG] from='client.28578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:24.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:24 smithi191 bash[24992]: cluster 2024-08-31T02:27:23.252388+0000 mgr.a (mgr.14388) 698 : cluster [DBG] pgmap v483: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:24.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:24 smithi191 bash[24992]: audit 2024-08-31T02:27:23.911184+0000 mgr.a (mgr.14388) 699 : audit [DBG] from='client.28578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:26.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:26 smithi163 bash[24253]: cluster 2024-08-31T02:27:25.253330+0000 mgr.a (mgr.14388) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T02:27:26.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:26 smithi027 bash[22610]: cluster 2024-08-31T02:27:25.253330+0000 mgr.a (mgr.14388) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T02:27:26.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:26 smithi191 bash[24992]: cluster 2024-08-31T02:27:25.253330+0000 mgr.a (mgr.14388) 700 : cluster [DBG] pgmap v484: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T02:27:28.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:28 smithi163 bash[24253]: cluster 2024-08-31T02:27:27.254148+0000 mgr.a (mgr.14388) 701 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T02:27:28.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:28 smithi027 bash[22610]: cluster 2024-08-31T02:27:27.254148+0000 mgr.a (mgr.14388) 701 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T02:27:28.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:28 smithi191 bash[24992]: cluster 2024-08-31T02:27:27.254148+0000 mgr.a (mgr.14388) 701 : cluster [DBG] pgmap v485: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T02:27:29.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:29.322 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:29.322 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:30.062 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:30.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:30.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:30.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:30.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:30.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:30 smithi163 bash[24253]: cluster 2024-08-31T02:27:29.256397+0000 mgr.a (mgr.14388) 702 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:27:30.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:30 smithi163 bash[24253]: audit 2024-08-31T02:27:29.659431+0000 mgr.a (mgr.14388) 703 : audit [DBG] from='client.28656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:30.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:30 smithi027 bash[22610]: cluster 2024-08-31T02:27:29.256397+0000 mgr.a (mgr.14388) 702 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:27:30.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:30 smithi027 bash[22610]: audit 2024-08-31T02:27:29.659431+0000 mgr.a (mgr.14388) 703 : audit [DBG] from='client.28656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:30 smithi191 bash[24992]: cluster 2024-08-31T02:27:29.256397+0000 mgr.a (mgr.14388) 702 : cluster [DBG] pgmap v486: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:27:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:30 smithi191 bash[24992]: audit 2024-08-31T02:27:29.659431+0000 mgr.a (mgr.14388) 703 : audit [DBG] from='client.28656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:32.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:32 smithi163 bash[24253]: cluster 2024-08-31T02:27:31.257339+0000 mgr.a (mgr.14388) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:32.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:32 smithi027 bash[22610]: cluster 2024-08-31T02:27:31.257339+0000 mgr.a (mgr.14388) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:32.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:32 smithi191 bash[24992]: cluster 2024-08-31T02:27:31.257339+0000 mgr.a (mgr.14388) 704 : cluster [DBG] pgmap v487: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:34.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:34 smithi163 bash[24253]: cluster 2024-08-31T02:27:33.259499+0000 mgr.a (mgr.14388) 705 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:34.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:34 smithi027 bash[22610]: cluster 2024-08-31T02:27:33.259499+0000 mgr.a (mgr.14388) 705 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:34.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:34 smithi191 bash[24992]: cluster 2024-08-31T02:27:33.259499+0000 mgr.a (mgr.14388) 705 : cluster [DBG] pgmap v488: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:35.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:35.064 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:35.064 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:35.802 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:35.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:35.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:35.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:35.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:36.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:36 smithi163 bash[24253]: cluster 2024-08-31T02:27:35.260252+0000 mgr.a (mgr.14388) 706 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:36.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:36 smithi163 bash[24253]: audit 2024-08-31T02:27:35.404139+0000 mgr.a (mgr.14388) 707 : audit [DBG] from='client.28734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:36.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:36 smithi027 bash[22610]: cluster 2024-08-31T02:27:35.260252+0000 mgr.a (mgr.14388) 706 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:36.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:36 smithi027 bash[22610]: audit 2024-08-31T02:27:35.404139+0000 mgr.a (mgr.14388) 707 : audit [DBG] from='client.28734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:36.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:36 smithi191 bash[24992]: cluster 2024-08-31T02:27:35.260252+0000 mgr.a (mgr.14388) 706 : cluster [DBG] pgmap v489: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:36 smithi191 bash[24992]: audit 2024-08-31T02:27:35.404139+0000 mgr.a (mgr.14388) 707 : audit [DBG] from='client.28734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:38.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:38 smithi163 bash[24253]: cluster 2024-08-31T02:27:37.261149+0000 mgr.a (mgr.14388) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:38.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:38 smithi027 bash[22610]: cluster 2024-08-31T02:27:37.261149+0000 mgr.a (mgr.14388) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:38 smithi191 bash[24992]: cluster 2024-08-31T02:27:37.261149+0000 mgr.a (mgr.14388) 708 : cluster [DBG] pgmap v490: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:40.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:40 smithi163 bash[24253]: cluster 2024-08-31T02:27:39.263414+0000 mgr.a (mgr.14388) 709 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:40.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:40 smithi027 bash[22610]: cluster 2024-08-31T02:27:39.263414+0000 mgr.a (mgr.14388) 709 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:40.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:40 smithi191 bash[24992]: cluster 2024-08-31T02:27:39.263414+0000 mgr.a (mgr.14388) 709 : cluster [DBG] pgmap v491: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:40.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:40.804 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:40.804 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:41.579 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:41.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:41.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:41.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:41.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:42.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:42 smithi163 bash[24253]: audit 2024-08-31T02:27:41.144398+0000 mgr.a (mgr.14388) 710 : audit [DBG] from='client.28806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:42.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:42 smithi163 bash[24253]: cluster 2024-08-31T02:27:41.263926+0000 mgr.a (mgr.14388) 711 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:42.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:42 smithi027 bash[22610]: audit 2024-08-31T02:27:41.144398+0000 mgr.a (mgr.14388) 710 : audit [DBG] from='client.28806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:42.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:42 smithi027 bash[22610]: cluster 2024-08-31T02:27:41.263926+0000 mgr.a (mgr.14388) 711 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:42.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:42 smithi191 bash[24992]: audit 2024-08-31T02:27:41.144398+0000 mgr.a (mgr.14388) 710 : audit [DBG] from='client.28806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:42.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:42 smithi191 bash[24992]: cluster 2024-08-31T02:27:41.263926+0000 mgr.a (mgr.14388) 711 : cluster [DBG] pgmap v492: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:44.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:44 smithi163 bash[24253]: cluster 2024-08-31T02:27:43.266225+0000 mgr.a (mgr.14388) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:44.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:44 smithi027 bash[22610]: cluster 2024-08-31T02:27:43.266225+0000 mgr.a (mgr.14388) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:44.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:44 smithi191 bash[24992]: cluster 2024-08-31T02:27:43.266225+0000 mgr.a (mgr.14388) 712 : cluster [DBG] pgmap v493: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:46.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:46.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:46.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:46.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:46 smithi163 bash[24253]: cluster 2024-08-31T02:27:45.267163+0000 mgr.a (mgr.14388) 713 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:46.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:46 smithi027 bash[22610]: cluster 2024-08-31T02:27:45.267163+0000 mgr.a (mgr.14388) 713 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:46.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:46 smithi191 bash[24992]: cluster 2024-08-31T02:27:45.267163+0000 mgr.a (mgr.14388) 713 : cluster [DBG] pgmap v494: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:47.315 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:47.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:47 smithi163 bash[24253]: audit 2024-08-31T02:27:46.923833+0000 mgr.a (mgr.14388) 714 : audit [DBG] from='client.28884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:47.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:47 smithi027 bash[22610]: audit 2024-08-31T02:27:46.923833+0000 mgr.a (mgr.14388) 714 : audit [DBG] from='client.28884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:47.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:47 smithi191 bash[24992]: audit 2024-08-31T02:27:46.923833+0000 mgr.a (mgr.14388) 714 : audit [DBG] from='client.28884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:48.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:48 smithi163 bash[24253]: cluster 2024-08-31T02:27:47.267700+0000 mgr.a (mgr.14388) 715 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:48.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:48 smithi027 bash[22610]: cluster 2024-08-31T02:27:47.267700+0000 mgr.a (mgr.14388) 715 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:48.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:48 smithi191 bash[24992]: cluster 2024-08-31T02:27:47.267700+0000 mgr.a (mgr.14388) 715 : cluster [DBG] pgmap v495: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:50.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:50 smithi163 bash[24253]: cluster 2024-08-31T02:27:49.269896+0000 mgr.a (mgr.14388) 716 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:50.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:50 smithi027 bash[22610]: cluster 2024-08-31T02:27:49.269896+0000 mgr.a (mgr.14388) 716 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:50.853 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:50 smithi191 bash[24992]: cluster 2024-08-31T02:27:49.269896+0000 mgr.a (mgr.14388) 716 : cluster [DBG] pgmap v496: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:27:52.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:52.317 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:52.317 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:52.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:52 smithi163 bash[24253]: cluster 2024-08-31T02:27:51.270680+0000 mgr.a (mgr.14388) 717 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:52.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:52 smithi027 bash[22610]: cluster 2024-08-31T02:27:51.270680+0000 mgr.a (mgr.14388) 717 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:52.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:52 smithi191 bash[24992]: cluster 2024-08-31T02:27:51.270680+0000 mgr.a (mgr.14388) 717 : cluster [DBG] pgmap v497: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:27:53.047 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:53.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:53.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:53.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:53.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:53.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:53 smithi163 bash[24253]: audit 2024-08-31T02:27:52.656489+0000 mgr.a (mgr.14388) 718 : audit [DBG] from='client.28962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:53.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:53 smithi027 bash[22610]: audit 2024-08-31T02:27:52.656489+0000 mgr.a (mgr.14388) 718 : audit [DBG] from='client.28962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:53.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:53 smithi191 bash[24992]: audit 2024-08-31T02:27:52.656489+0000 mgr.a (mgr.14388) 718 : audit [DBG] from='client.28962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:54.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:54 smithi163 bash[24253]: cluster 2024-08-31T02:27:53.272991+0000 mgr.a (mgr.14388) 719 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:27:54.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:54 smithi027 bash[22610]: cluster 2024-08-31T02:27:53.272991+0000 mgr.a (mgr.14388) 719 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:27:54.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:54 smithi191 bash[24992]: cluster 2024-08-31T02:27:53.272991+0000 mgr.a (mgr.14388) 719 : cluster [DBG] pgmap v498: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:27:56.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:56 smithi163 bash[24253]: cluster 2024-08-31T02:27:55.273803+0000 mgr.a (mgr.14388) 720 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:27:56.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:56 smithi027 bash[22610]: cluster 2024-08-31T02:27:55.273803+0000 mgr.a (mgr.14388) 720 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:27:56.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:56 smithi191 bash[24992]: cluster 2024-08-31T02:27:55.273803+0000 mgr.a (mgr.14388) 720 : cluster [DBG] pgmap v499: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:27:57.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:57 smithi163 bash[24253]: audit 2024-08-31T02:27:57.394390+0000 mon.a (mon.0) 700 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:27:57.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:57 smithi027 bash[22610]: audit 2024-08-31T02:27:57.394390+0000 mon.a (mon.0) 700 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:27:57.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:57 smithi191 bash[24992]: audit 2024-08-31T02:27:57.394390+0000 mon.a (mon.0) 700 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:27:58.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:27:58.049 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:27:58.049 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:27:58.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:58 smithi163 bash[24253]: cluster 2024-08-31T02:27:57.274583+0000 mgr.a (mgr.14388) 721 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:27:58.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:58 smithi163 bash[24253]: audit 2024-08-31T02:27:57.999760+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:58 smithi163 bash[24253]: audit 2024-08-31T02:27:58.002436+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:58 smithi163 bash[24253]: audit 2024-08-31T02:27:58.007015+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:58 smithi163 bash[24253]: audit 2024-08-31T02:27:58.009912+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:58 smithi027 bash[22610]: cluster 2024-08-31T02:27:57.274583+0000 mgr.a (mgr.14388) 721 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:27:58.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:58 smithi027 bash[22610]: audit 2024-08-31T02:27:57.999760+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:58 smithi027 bash[22610]: audit 2024-08-31T02:27:58.002436+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:58 smithi027 bash[22610]: audit 2024-08-31T02:27:58.007015+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:58 smithi027 bash[22610]: audit 2024-08-31T02:27:58.009912+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:58 smithi191 bash[24992]: cluster 2024-08-31T02:27:57.274583+0000 mgr.a (mgr.14388) 721 : cluster [DBG] pgmap v500: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:27:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:58 smithi191 bash[24992]: audit 2024-08-31T02:27:57.999760+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:58 smithi191 bash[24992]: audit 2024-08-31T02:27:58.002436+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:58 smithi191 bash[24992]: audit 2024-08-31T02:27:58.007015+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:58 smithi191 bash[24992]: audit 2024-08-31T02:27:58.009912+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:58.818 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:27:58.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:27:58.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:27:58.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:27:58.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:27:59.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:59 smithi163 bash[24253]: audit 2024-08-31T02:27:58.379384+0000 mgr.a (mgr.14388) 722 : audit [DBG] from='client.29040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:59.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:59 smithi163 bash[24253]: audit 2024-08-31T02:27:58.663881+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:27:59.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:59 smithi163 bash[24253]: audit 2024-08-31T02:27:58.665342+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:27:59.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:59 smithi163 bash[24253]: audit 2024-08-31T02:27:58.672330+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:59.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:59 smithi163 bash[24253]: audit 2024-08-31T02:27:58.674471+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:27:59.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:27:59 smithi163 bash[24253]: audit 2024-08-31T02:27:58.675621+0000 mgr.a (mgr.14388) 723 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:27:59.727 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:27:59 smithi027 bash[22863]: debug 2024-08-31T02:27:59.487+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:27:59.727 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:27:59 smithi027 bash[22863]: debug 2024-08-31T02:27:59.487+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:27:59.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:59 smithi027 bash[22610]: audit 2024-08-31T02:27:58.379384+0000 mgr.a (mgr.14388) 722 : audit [DBG] from='client.29040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:59.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:59 smithi027 bash[22610]: audit 2024-08-31T02:27:58.663881+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:27:59.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:59 smithi027 bash[22610]: audit 2024-08-31T02:27:58.665342+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:27:59.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:59 smithi027 bash[22610]: audit 2024-08-31T02:27:58.672330+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:59.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:59 smithi027 bash[22610]: audit 2024-08-31T02:27:58.674471+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:27:59.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:27:59 smithi027 bash[22610]: audit 2024-08-31T02:27:58.675621+0000 mgr.a (mgr.14388) 723 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:27:59.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:59 smithi191 bash[24992]: audit 2024-08-31T02:27:58.379384+0000 mgr.a (mgr.14388) 722 : audit [DBG] from='client.29040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:27:59.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:59 smithi191 bash[24992]: audit 2024-08-31T02:27:58.663881+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:27:59.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:59 smithi191 bash[24992]: audit 2024-08-31T02:27:58.665342+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:27:59.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:59 smithi191 bash[24992]: audit 2024-08-31T02:27:58.672330+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:27:59.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:59 smithi191 bash[24992]: audit 2024-08-31T02:27:58.674471+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:27:59.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:27:59 smithi191 bash[24992]: audit 2024-08-31T02:27:58.675621+0000 mgr.a (mgr.14388) 723 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:28:00.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:00 smithi163 bash[24253]: cluster 2024-08-31T02:27:59.276019+0000 mgr.a (mgr.14388) 724 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:00.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:00 smithi163 bash[24253]: audit 2024-08-31T02:27:59.493438+0000 mgr.a (mgr.14388) 725 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:28:00.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:00 smithi163 bash[24253]: cephadm 2024-08-31T02:27:59.494645+0000 mgr.a (mgr.14388) 726 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:28:00.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:00 smithi027 bash[22610]: cluster 2024-08-31T02:27:59.276019+0000 mgr.a (mgr.14388) 724 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:00.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:00 smithi027 bash[22610]: audit 2024-08-31T02:27:59.493438+0000 mgr.a (mgr.14388) 725 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:28:00.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:00 smithi027 bash[22610]: cephadm 2024-08-31T02:27:59.494645+0000 mgr.a (mgr.14388) 726 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:28:01.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:00 smithi191 bash[24992]: cluster 2024-08-31T02:27:59.276019+0000 mgr.a (mgr.14388) 724 : cluster [DBG] pgmap v501: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:01.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:00 smithi191 bash[24992]: audit 2024-08-31T02:27:59.493438+0000 mgr.a (mgr.14388) 725 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:28:01.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:00 smithi191 bash[24992]: cephadm 2024-08-31T02:27:59.494645+0000 mgr.a (mgr.14388) 726 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:28:02.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:02 smithi163 bash[24253]: cluster 2024-08-31T02:28:01.276856+0000 mgr.a (mgr.14388) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:28:02.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:02 smithi027 bash[22610]: cluster 2024-08-31T02:28:01.276856+0000 mgr.a (mgr.14388) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:28:03.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:02 smithi191 bash[24992]: cluster 2024-08-31T02:28:01.276856+0000 mgr.a (mgr.14388) 727 : cluster [DBG] pgmap v502: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:28:03.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:28:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:28:03.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:28:04.559 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:28:04.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:28:04.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:28:04.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:28:04.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:28:04.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:04 smithi163 bash[24253]: cluster 2024-08-31T02:28:03.278969+0000 mgr.a (mgr.14388) 728 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:04.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:04 smithi027 bash[22610]: cluster 2024-08-31T02:28:03.278969+0000 mgr.a (mgr.14388) 728 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:05.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:04 smithi191 bash[24992]: cluster 2024-08-31T02:28:03.278969+0000 mgr.a (mgr.14388) 728 : cluster [DBG] pgmap v503: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:05.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:05 smithi163 bash[24253]: audit 2024-08-31T02:28:04.158313+0000 mgr.a (mgr.14388) 729 : audit [DBG] from='client.29223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:05.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:05 smithi027 bash[22610]: audit 2024-08-31T02:28:04.158313+0000 mgr.a (mgr.14388) 729 : audit [DBG] from='client.29223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:06.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:05 smithi191 bash[24992]: audit 2024-08-31T02:28:04.158313+0000 mgr.a (mgr.14388) 729 : audit [DBG] from='client.29223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:06.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:06 smithi163 bash[24253]: cluster 2024-08-31T02:28:05.279912+0000 mgr.a (mgr.14388) 730 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:28:06.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:06 smithi027 bash[22610]: cluster 2024-08-31T02:28:05.279912+0000 mgr.a (mgr.14388) 730 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:28:07.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:06 smithi191 bash[24992]: cluster 2024-08-31T02:28:05.279912+0000 mgr.a (mgr.14388) 730 : cluster [DBG] pgmap v504: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:28:08.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:08 smithi163 bash[24253]: cluster 2024-08-31T02:28:07.280719+0000 mgr.a (mgr.14388) 731 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:28:08.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:08 smithi027 bash[22610]: cluster 2024-08-31T02:28:07.280719+0000 mgr.a (mgr.14388) 731 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:28:09.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:08 smithi191 bash[24992]: cluster 2024-08-31T02:28:07.280719+0000 mgr.a (mgr.14388) 731 : cluster [DBG] pgmap v505: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:28:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:28:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:28:09.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:28:10.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:28:10.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:28:10.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:28:10.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:28:10.327 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:28:10.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:10 smithi027 bash[22610]: cluster 2024-08-31T02:28:09.282961+0000 mgr.a (mgr.14388) 732 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:10.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:10 smithi027 bash[22610]: audit 2024-08-31T02:28:09.901707+0000 mgr.a (mgr.14388) 733 : audit [DBG] from='client.29295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:11.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:10 smithi191 bash[24992]: cluster 2024-08-31T02:28:09.282961+0000 mgr.a (mgr.14388) 732 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:11.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:10 smithi191 bash[24992]: audit 2024-08-31T02:28:09.901707+0000 mgr.a (mgr.14388) 733 : audit [DBG] from='client.29295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:11.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:10 smithi163 bash[24253]: cluster 2024-08-31T02:28:09.282961+0000 mgr.a (mgr.14388) 732 : cluster [DBG] pgmap v506: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:11.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:10 smithi163 bash[24253]: audit 2024-08-31T02:28:09.901707+0000 mgr.a (mgr.14388) 733 : audit [DBG] from='client.29295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:12.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:12 smithi027 bash[22610]: cluster 2024-08-31T02:28:11.283845+0000 mgr.a (mgr.14388) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:12 smithi191 bash[24992]: cluster 2024-08-31T02:28:11.283845+0000 mgr.a (mgr.14388) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:13.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:12 smithi163 bash[24253]: cluster 2024-08-31T02:28:11.283845+0000 mgr.a (mgr.14388) 734 : cluster [DBG] pgmap v507: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:14.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:14 smithi027 bash[22610]: cluster 2024-08-31T02:28:13.285965+0000 mgr.a (mgr.14388) 735 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:15.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:14 smithi191 bash[24992]: cluster 2024-08-31T02:28:13.285965+0000 mgr.a (mgr.14388) 735 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:15.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:14 smithi163 bash[24253]: cluster 2024-08-31T02:28:13.285965+0000 mgr.a (mgr.14388) 735 : cluster [DBG] pgmap v508: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:28:15.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:28:15.329 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:28:15.329 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:28:16.077 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:28:16.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:28:16.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:28:16.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:28:16.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:28:16.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:16 smithi027 bash[22610]: cluster 2024-08-31T02:28:15.286889+0000 mgr.a (mgr.14388) 736 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:16.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:16 smithi027 bash[22610]: audit 2024-08-31T02:28:15.668874+0000 mgr.a (mgr.14388) 737 : audit [DBG] from='client.29370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:17.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:16 smithi191 bash[24992]: cluster 2024-08-31T02:28:15.286889+0000 mgr.a (mgr.14388) 736 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:17.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:16 smithi191 bash[24992]: audit 2024-08-31T02:28:15.668874+0000 mgr.a (mgr.14388) 737 : audit [DBG] from='client.29370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:17.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:16 smithi163 bash[24253]: cluster 2024-08-31T02:28:15.286889+0000 mgr.a (mgr.14388) 736 : cluster [DBG] pgmap v509: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:17.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:16 smithi163 bash[24253]: audit 2024-08-31T02:28:15.668874+0000 mgr.a (mgr.14388) 737 : audit [DBG] from='client.29370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:18.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:18 smithi027 bash[22610]: cluster 2024-08-31T02:28:17.287780+0000 mgr.a (mgr.14388) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:19.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:18 smithi191 bash[24992]: cluster 2024-08-31T02:28:17.287780+0000 mgr.a (mgr.14388) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:19.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:18 smithi163 bash[24253]: cluster 2024-08-31T02:28:17.287780+0000 mgr.a (mgr.14388) 738 : cluster [DBG] pgmap v510: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:20.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:20 smithi027 bash[22610]: cluster 2024-08-31T02:28:19.289991+0000 mgr.a (mgr.14388) 739 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:21.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:20 smithi191 bash[24992]: cluster 2024-08-31T02:28:19.289991+0000 mgr.a (mgr.14388) 739 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:21.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:28:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:28:21.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:28:21.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:20 smithi163 bash[24253]: cluster 2024-08-31T02:28:19.289991+0000 mgr.a (mgr.14388) 739 : cluster [DBG] pgmap v511: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:21.820 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:28:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:28:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:28:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:28:21.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:28:22.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:22 smithi027 bash[22610]: cluster 2024-08-31T02:28:21.290757+0000 mgr.a (mgr.14388) 740 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:22.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:22 smithi027 bash[22610]: audit 2024-08-31T02:28:21.414096+0000 mgr.a (mgr.14388) 741 : audit [DBG] from='client.29445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:23.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:22 smithi191 bash[24992]: cluster 2024-08-31T02:28:21.290757+0000 mgr.a (mgr.14388) 740 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:23.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:22 smithi191 bash[24992]: audit 2024-08-31T02:28:21.414096+0000 mgr.a (mgr.14388) 741 : audit [DBG] from='client.29445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:23.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:22 smithi163 bash[24253]: cluster 2024-08-31T02:28:21.290757+0000 mgr.a (mgr.14388) 740 : cluster [DBG] pgmap v512: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:23.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:22 smithi163 bash[24253]: audit 2024-08-31T02:28:21.414096+0000 mgr.a (mgr.14388) 741 : audit [DBG] from='client.29445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:24.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:24 smithi027 bash[22610]: cluster 2024-08-31T02:28:23.293051+0000 mgr.a (mgr.14388) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:25.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:24 smithi191 bash[24992]: cluster 2024-08-31T02:28:23.293051+0000 mgr.a (mgr.14388) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:25.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:24 smithi163 bash[24253]: cluster 2024-08-31T02:28:23.293051+0000 mgr.a (mgr.14388) 742 : cluster [DBG] pgmap v513: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:26.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:28:26.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:28:26.823 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:28:27.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:26 smithi191 bash[24992]: cluster 2024-08-31T02:28:25.293991+0000 mgr.a (mgr.14388) 743 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:27.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:26 smithi163 bash[24253]: cluster 2024-08-31T02:28:25.293991+0000 mgr.a (mgr.14388) 743 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:27.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:26 smithi027 bash[22610]: cluster 2024-08-31T02:28:25.293991+0000 mgr.a (mgr.14388) 743 : cluster [DBG] pgmap v514: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:27.556 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:28:27.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:28:27.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:28:27.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:28:27.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:28:29.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:28 smithi191 bash[24992]: audit 2024-08-31T02:28:27.155513+0000 mgr.a (mgr.14388) 744 : audit [DBG] from='client.29523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:29.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:28 smithi191 bash[24992]: cluster 2024-08-31T02:28:27.294607+0000 mgr.a (mgr.14388) 745 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:29.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:28 smithi163 bash[24253]: audit 2024-08-31T02:28:27.155513+0000 mgr.a (mgr.14388) 744 : audit [DBG] from='client.29523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:29.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:28 smithi163 bash[24253]: cluster 2024-08-31T02:28:27.294607+0000 mgr.a (mgr.14388) 745 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:29.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:28 smithi027 bash[22610]: audit 2024-08-31T02:28:27.155513+0000 mgr.a (mgr.14388) 744 : audit [DBG] from='client.29523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:29.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:28 smithi027 bash[22610]: cluster 2024-08-31T02:28:27.294607+0000 mgr.a (mgr.14388) 745 : cluster [DBG] pgmap v515: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:31.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:30 smithi191 bash[24992]: cluster 2024-08-31T02:28:29.296989+0000 mgr.a (mgr.14388) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:31.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:30 smithi163 bash[24253]: cluster 2024-08-31T02:28:29.296989+0000 mgr.a (mgr.14388) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:31.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:30 smithi027 bash[22610]: cluster 2024-08-31T02:28:29.296989+0000 mgr.a (mgr.14388) 746 : cluster [DBG] pgmap v516: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:32.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:28:32.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:28:32.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:28:33.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:32 smithi191 bash[24992]: cluster 2024-08-31T02:28:31.297953+0000 mgr.a (mgr.14388) 747 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:33.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:32 smithi163 bash[24253]: cluster 2024-08-31T02:28:31.297953+0000 mgr.a (mgr.14388) 747 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:33.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:32 smithi027 bash[22610]: cluster 2024-08-31T02:28:31.297953+0000 mgr.a (mgr.14388) 747 : cluster [DBG] pgmap v517: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:33.322 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:28:33.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:28:33.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:28:33.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:28:33.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:28:34.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:33 smithi191 bash[24992]: audit 2024-08-31T02:28:32.901828+0000 mgr.a (mgr.14388) 748 : audit [DBG] from='client.29601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:34.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:33 smithi163 bash[24253]: audit 2024-08-31T02:28:32.901828+0000 mgr.a (mgr.14388) 748 : audit [DBG] from='client.29601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:34.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:33 smithi027 bash[22610]: audit 2024-08-31T02:28:32.901828+0000 mgr.a (mgr.14388) 748 : audit [DBG] from='client.29601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:35.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:34 smithi191 bash[24992]: cluster 2024-08-31T02:28:33.299234+0000 mgr.a (mgr.14388) 749 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:35.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:34 smithi163 bash[24253]: cluster 2024-08-31T02:28:33.299234+0000 mgr.a (mgr.14388) 749 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:35.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:34 smithi027 bash[22610]: cluster 2024-08-31T02:28:33.299234+0000 mgr.a (mgr.14388) 749 : cluster [DBG] pgmap v518: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:37.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:36 smithi191 bash[24992]: cluster 2024-08-31T02:28:35.299963+0000 mgr.a (mgr.14388) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:28:37.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:36 smithi163 bash[24253]: cluster 2024-08-31T02:28:35.299963+0000 mgr.a (mgr.14388) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:28:37.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:36 smithi027 bash[22610]: cluster 2024-08-31T02:28:35.299963+0000 mgr.a (mgr.14388) 750 : cluster [DBG] pgmap v519: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:28:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:28:38.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:28:38.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:28:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:38 smithi191 bash[24992]: cluster 2024-08-31T02:28:37.300723+0000 mgr.a (mgr.14388) 751 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:28:39.074 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:28:39.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:28:39.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:28:39.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:28:39.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:28:39.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:38 smithi163 bash[24253]: cluster 2024-08-31T02:28:37.300723+0000 mgr.a (mgr.14388) 751 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:28:39.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:38 smithi027 bash[22610]: cluster 2024-08-31T02:28:37.300723+0000 mgr.a (mgr.14388) 751 : cluster [DBG] pgmap v520: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:28:40.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:39 smithi191 bash[24992]: audit 2024-08-31T02:28:38.663093+0000 mgr.a (mgr.14388) 752 : audit [DBG] from='client.29679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:39 smithi163 bash[24253]: audit 2024-08-31T02:28:38.663093+0000 mgr.a (mgr.14388) 752 : audit [DBG] from='client.29679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:40.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:39 smithi027 bash[22610]: audit 2024-08-31T02:28:38.663093+0000 mgr.a (mgr.14388) 752 : audit [DBG] from='client.29679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:41.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:40 smithi191 bash[24992]: cluster 2024-08-31T02:28:39.303395+0000 mgr.a (mgr.14388) 753 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:41.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:40 smithi163 bash[24253]: cluster 2024-08-31T02:28:39.303395+0000 mgr.a (mgr.14388) 753 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:41.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:40 smithi027 bash[22610]: cluster 2024-08-31T02:28:39.303395+0000 mgr.a (mgr.14388) 753 : cluster [DBG] pgmap v521: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:43.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:42 smithi191 bash[24992]: cluster 2024-08-31T02:28:41.304121+0000 mgr.a (mgr.14388) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:28:43.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:42 smithi163 bash[24253]: cluster 2024-08-31T02:28:41.304121+0000 mgr.a (mgr.14388) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:28:43.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:42 smithi027 bash[22610]: cluster 2024-08-31T02:28:41.304121+0000 mgr.a (mgr.14388) 754 : cluster [DBG] pgmap v522: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:28:44.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:28:44.076 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:28:44.076 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:28:44.815 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:28:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:28:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:28:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:28:44.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:28:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:44 smithi191 bash[24992]: cluster 2024-08-31T02:28:43.306064+0000 mgr.a (mgr.14388) 755 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:45.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:44 smithi163 bash[24253]: cluster 2024-08-31T02:28:43.306064+0000 mgr.a (mgr.14388) 755 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:45.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:44 smithi027 bash[22610]: cluster 2024-08-31T02:28:43.306064+0000 mgr.a (mgr.14388) 755 : cluster [DBG] pgmap v523: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:45 smithi163 bash[24253]: audit 2024-08-31T02:28:44.414296+0000 mgr.a (mgr.14388) 756 : audit [DBG] from='client.29757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:46.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:45 smithi027 bash[22610]: audit 2024-08-31T02:28:44.414296+0000 mgr.a (mgr.14388) 756 : audit [DBG] from='client.29757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:46.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:45 smithi191 bash[24992]: audit 2024-08-31T02:28:44.414296+0000 mgr.a (mgr.14388) 756 : audit [DBG] from='client.29757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:47.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:46 smithi163 bash[24253]: cluster 2024-08-31T02:28:45.306938+0000 mgr.a (mgr.14388) 757 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:46 smithi027 bash[22610]: cluster 2024-08-31T02:28:45.306938+0000 mgr.a (mgr.14388) 757 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:47.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:46 smithi191 bash[24992]: cluster 2024-08-31T02:28:45.306938+0000 mgr.a (mgr.14388) 757 : cluster [DBG] pgmap v524: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:49.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:48 smithi163 bash[24253]: cluster 2024-08-31T02:28:47.307709+0000 mgr.a (mgr.14388) 758 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:49.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:48 smithi027 bash[22610]: cluster 2024-08-31T02:28:47.307709+0000 mgr.a (mgr.14388) 758 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:49.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:48 smithi191 bash[24992]: cluster 2024-08-31T02:28:47.307709+0000 mgr.a (mgr.14388) 758 : cluster [DBG] pgmap v525: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:49.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:28:49.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:28:49.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:28:50.586 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:28:50.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:28:50.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:28:50.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:28:50.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:28:51.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:50 smithi163 bash[24253]: cluster 2024-08-31T02:28:49.309912+0000 mgr.a (mgr.14388) 759 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:51.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:50 smithi027 bash[22610]: cluster 2024-08-31T02:28:49.309912+0000 mgr.a (mgr.14388) 759 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:51.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:50 smithi191 bash[24992]: cluster 2024-08-31T02:28:49.309912+0000 mgr.a (mgr.14388) 759 : cluster [DBG] pgmap v526: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:52.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:51 smithi163 bash[24253]: audit 2024-08-31T02:28:50.158714+0000 mgr.a (mgr.14388) 760 : audit [DBG] from='client.29835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:52.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:51 smithi027 bash[22610]: audit 2024-08-31T02:28:50.158714+0000 mgr.a (mgr.14388) 760 : audit [DBG] from='client.29835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:52.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:51 smithi191 bash[24992]: audit 2024-08-31T02:28:50.158714+0000 mgr.a (mgr.14388) 760 : audit [DBG] from='client.29835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:53.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:52 smithi163 bash[24253]: cluster 2024-08-31T02:28:51.310937+0000 mgr.a (mgr.14388) 761 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:53.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:52 smithi027 bash[22610]: cluster 2024-08-31T02:28:51.310937+0000 mgr.a (mgr.14388) 761 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:53.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:52 smithi191 bash[24992]: cluster 2024-08-31T02:28:51.310937+0000 mgr.a (mgr.14388) 761 : cluster [DBG] pgmap v527: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:55.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:54 smithi163 bash[24253]: cluster 2024-08-31T02:28:53.313135+0000 mgr.a (mgr.14388) 762 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:55.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:54 smithi027 bash[22610]: cluster 2024-08-31T02:28:53.313135+0000 mgr.a (mgr.14388) 762 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:55.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:54 smithi191 bash[24992]: cluster 2024-08-31T02:28:53.313135+0000 mgr.a (mgr.14388) 762 : cluster [DBG] pgmap v528: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:28:55.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:28:55.588 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:28:55.588 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:28:56.324 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:28:56.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:28:56.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:28:56.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:28:56.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:28:57.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:56 smithi163 bash[24253]: cluster 2024-08-31T02:28:55.313887+0000 mgr.a (mgr.14388) 763 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:57.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:56 smithi163 bash[24253]: audit 2024-08-31T02:28:55.925558+0000 mgr.a (mgr.14388) 764 : audit [DBG] from='client.29913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:57.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:56 smithi027 bash[22610]: cluster 2024-08-31T02:28:55.313887+0000 mgr.a (mgr.14388) 763 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:57.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:56 smithi027 bash[22610]: audit 2024-08-31T02:28:55.925558+0000 mgr.a (mgr.14388) 764 : audit [DBG] from='client.29913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:56 smithi191 bash[24992]: cluster 2024-08-31T02:28:55.313887+0000 mgr.a (mgr.14388) 763 : cluster [DBG] pgmap v529: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:56 smithi191 bash[24992]: audit 2024-08-31T02:28:55.925558+0000 mgr.a (mgr.14388) 764 : audit [DBG] from='client.29913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:28:59.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:58 smithi163 bash[24253]: cluster 2024-08-31T02:28:57.314743+0000 mgr.a (mgr.14388) 765 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:59.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:58 smithi027 bash[22610]: cluster 2024-08-31T02:28:57.314743+0000 mgr.a (mgr.14388) 765 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:28:59.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:58 smithi191 bash[24992]: cluster 2024-08-31T02:28:57.314743+0000 mgr.a (mgr.14388) 765 : cluster [DBG] pgmap v530: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:28:59 smithi163 bash[24253]: audit 2024-08-31T02:28:59.545921+0000 mon.a (mon.0) 709 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:29:00.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:28:59 smithi027 bash[22610]: audit 2024-08-31T02:28:59.545921+0000 mon.a (mon.0) 709 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:29:00.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:28:59 smithi191 bash[24992]: audit 2024-08-31T02:28:59.545921+0000 mon.a (mon.0) 709 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:29:01.114 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:00 smithi027 bash[22610]: cluster 2024-08-31T02:28:59.316923+0000 mgr.a (mgr.14388) 766 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:01.114 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:00 smithi027 bash[22610]: audit 2024-08-31T02:29:00.397474+0000 mon.a (mon.0) 710 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:29:01.114 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:00 smithi027 bash[22610]: audit 2024-08-31T02:29:00.398953+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:29:01.115 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:00 smithi027 bash[22610]: audit 2024-08-31T02:29:00.406637+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:29:01.115 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:00 smithi027 bash[22610]: audit 2024-08-31T02:29:00.411494+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:29:01.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:00 smithi163 bash[24253]: cluster 2024-08-31T02:28:59.316923+0000 mgr.a (mgr.14388) 766 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:01.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:00 smithi163 bash[24253]: audit 2024-08-31T02:29:00.397474+0000 mon.a (mon.0) 710 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:29:01.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:00 smithi163 bash[24253]: audit 2024-08-31T02:29:00.398953+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:29:01.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:00 smithi163 bash[24253]: audit 2024-08-31T02:29:00.406637+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:29:01.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:00 smithi163 bash[24253]: audit 2024-08-31T02:29:00.411494+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:29:01.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:00 smithi191 bash[24992]: cluster 2024-08-31T02:28:59.316923+0000 mgr.a (mgr.14388) 766 : cluster [DBG] pgmap v531: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:01.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:00 smithi191 bash[24992]: audit 2024-08-31T02:29:00.397474+0000 mon.a (mon.0) 710 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:29:01.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:00 smithi191 bash[24992]: audit 2024-08-31T02:29:00.398953+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:29:01.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:00 smithi191 bash[24992]: audit 2024-08-31T02:29:00.406637+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:29:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:00 smithi191 bash[24992]: audit 2024-08-31T02:29:00.411494+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:29:01.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:01.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:01.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:01.477 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:29:01 smithi027 bash[22863]: debug 2024-08-31T02:29:01.118+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:29:01.477 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:29:01 smithi027 bash[22863]: debug 2024-08-31T02:29:01.118+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:29:02.058 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:02.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:02.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:02.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:02.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:29:02.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:01 smithi163 bash[24253]: audit 2024-08-31T02:29:00.412503+0000 mgr.a (mgr.14388) 767 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:29:02.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:01 smithi027 bash[22610]: audit 2024-08-31T02:29:00.412503+0000 mgr.a (mgr.14388) 767 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:29:02.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:01 smithi191 bash[24992]: audit 2024-08-31T02:29:00.412503+0000 mgr.a (mgr.14388) 767 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:29:03.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:02 smithi163 bash[24253]: audit 2024-08-31T02:29:01.120385+0000 mgr.a (mgr.14388) 768 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:29:03.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:02 smithi163 bash[24253]: cephadm 2024-08-31T02:29:01.121898+0000 mgr.a (mgr.14388) 769 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:29:03.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:02 smithi163 bash[24253]: cluster 2024-08-31T02:29:01.317761+0000 mgr.a (mgr.14388) 770 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:03.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:02 smithi163 bash[24253]: audit 2024-08-31T02:29:01.651880+0000 mgr.a (mgr.14388) 771 : audit [DBG] from='client.30096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:03.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:02 smithi027 bash[22610]: audit 2024-08-31T02:29:01.120385+0000 mgr.a (mgr.14388) 768 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:29:03.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:02 smithi027 bash[22610]: cephadm 2024-08-31T02:29:01.121898+0000 mgr.a (mgr.14388) 769 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:29:03.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:02 smithi027 bash[22610]: cluster 2024-08-31T02:29:01.317761+0000 mgr.a (mgr.14388) 770 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:03.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:02 smithi027 bash[22610]: audit 2024-08-31T02:29:01.651880+0000 mgr.a (mgr.14388) 771 : audit [DBG] from='client.30096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:03.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:02 smithi191 bash[24992]: audit 2024-08-31T02:29:01.120385+0000 mgr.a (mgr.14388) 768 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:29:03.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:02 smithi191 bash[24992]: cephadm 2024-08-31T02:29:01.121898+0000 mgr.a (mgr.14388) 769 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:29:03.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:02 smithi191 bash[24992]: cluster 2024-08-31T02:29:01.317761+0000 mgr.a (mgr.14388) 770 : cluster [DBG] pgmap v532: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:03.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:02 smithi191 bash[24992]: audit 2024-08-31T02:29:01.651880+0000 mgr.a (mgr.14388) 771 : audit [DBG] from='client.30096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:05.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:04 smithi163 bash[24253]: cluster 2024-08-31T02:29:03.319998+0000 mgr.a (mgr.14388) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:05.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:04 smithi027 bash[22610]: cluster 2024-08-31T02:29:03.319998+0000 mgr.a (mgr.14388) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:05.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:04 smithi191 bash[24992]: cluster 2024-08-31T02:29:03.319998+0000 mgr.a (mgr.14388) 772 : cluster [DBG] pgmap v533: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:06.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:06 smithi163 bash[24253]: cluster 2024-08-31T02:29:05.320783+0000 mgr.a (mgr.14388) 773 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:06.477 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:06 smithi027 bash[22610]: cluster 2024-08-31T02:29:05.320783+0000 mgr.a (mgr.14388) 773 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:06.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:06 smithi191 bash[24992]: cluster 2024-08-31T02:29:05.320783+0000 mgr.a (mgr.14388) 773 : cluster [DBG] pgmap v534: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:07.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:07.061 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:07.061 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:07.795 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:07.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:29:08.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:08 smithi163 bash[24253]: cluster 2024-08-31T02:29:07.321502+0000 mgr.a (mgr.14388) 774 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:08.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:08 smithi163 bash[24253]: audit 2024-08-31T02:29:07.397938+0000 mgr.a (mgr.14388) 775 : audit [DBG] from='client.30174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:08.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:08 smithi027 bash[22610]: cluster 2024-08-31T02:29:07.321502+0000 mgr.a (mgr.14388) 774 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:08.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:08 smithi027 bash[22610]: audit 2024-08-31T02:29:07.397938+0000 mgr.a (mgr.14388) 775 : audit [DBG] from='client.30174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:08.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:08 smithi191 bash[24992]: cluster 2024-08-31T02:29:07.321502+0000 mgr.a (mgr.14388) 774 : cluster [DBG] pgmap v535: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:08.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:08 smithi191 bash[24992]: audit 2024-08-31T02:29:07.397938+0000 mgr.a (mgr.14388) 775 : audit [DBG] from='client.30174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:10.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:10 smithi163 bash[24253]: cluster 2024-08-31T02:29:09.323839+0000 mgr.a (mgr.14388) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:10.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:10 smithi027 bash[22610]: cluster 2024-08-31T02:29:09.323839+0000 mgr.a (mgr.14388) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:10.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:10 smithi191 bash[24992]: cluster 2024-08-31T02:29:09.323839+0000 mgr.a (mgr.14388) 776 : cluster [DBG] pgmap v536: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:12.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:12 smithi163 bash[24253]: cluster 2024-08-31T02:29:11.324595+0000 mgr.a (mgr.14388) 777 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:12.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:12 smithi027 bash[22610]: cluster 2024-08-31T02:29:11.324595+0000 mgr.a (mgr.14388) 777 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:12 smithi191 bash[24992]: cluster 2024-08-31T02:29:11.324595+0000 mgr.a (mgr.14388) 777 : cluster [DBG] pgmap v537: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:12.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:12.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:12.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:13.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:13.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:13.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:13.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:29:13.569 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:14.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:14 smithi163 bash[24253]: audit 2024-08-31T02:29:13.137436+0000 mgr.a (mgr.14388) 778 : audit [DBG] from='client.30249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:14.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:14 smithi163 bash[24253]: cluster 2024-08-31T02:29:13.325938+0000 mgr.a (mgr.14388) 779 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:14.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:14 smithi027 bash[22610]: audit 2024-08-31T02:29:13.137436+0000 mgr.a (mgr.14388) 778 : audit [DBG] from='client.30249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:14.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:14 smithi027 bash[22610]: cluster 2024-08-31T02:29:13.325938+0000 mgr.a (mgr.14388) 779 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:14.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:14 smithi191 bash[24992]: audit 2024-08-31T02:29:13.137436+0000 mgr.a (mgr.14388) 778 : audit [DBG] from='client.30249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:14.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:14 smithi191 bash[24992]: cluster 2024-08-31T02:29:13.325938+0000 mgr.a (mgr.14388) 779 : cluster [DBG] pgmap v538: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:29:16.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:16 smithi163 bash[24253]: cluster 2024-08-31T02:29:15.326929+0000 mgr.a (mgr.14388) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:16.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:16 smithi027 bash[22610]: cluster 2024-08-31T02:29:15.326929+0000 mgr.a (mgr.14388) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:16.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:16 smithi191 bash[24992]: cluster 2024-08-31T02:29:15.326929+0000 mgr.a (mgr.14388) 780 : cluster [DBG] pgmap v539: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:18.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:18.570 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:18.570 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:18.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:18 smithi163 bash[24253]: cluster 2024-08-31T02:29:17.327874+0000 mgr.a (mgr.14388) 781 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:18.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:18 smithi027 bash[22610]: cluster 2024-08-31T02:29:17.327874+0000 mgr.a (mgr.14388) 781 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:18.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:18 smithi191 bash[24992]: cluster 2024-08-31T02:29:17.327874+0000 mgr.a (mgr.14388) 781 : cluster [DBG] pgmap v540: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:19.312 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:19.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:19.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:19.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:19.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:29:19.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:19 smithi163 bash[24253]: audit 2024-08-31T02:29:18.907863+0000 mgr.a (mgr.14388) 782 : audit [DBG] from='client.30321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:19.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:19 smithi027 bash[22610]: audit 2024-08-31T02:29:18.907863+0000 mgr.a (mgr.14388) 782 : audit [DBG] from='client.30321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:19.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:19 smithi191 bash[24992]: audit 2024-08-31T02:29:18.907863+0000 mgr.a (mgr.14388) 782 : audit [DBG] from='client.30321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:20.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:20 smithi163 bash[24253]: cluster 2024-08-31T02:29:19.329151+0000 mgr.a (mgr.14388) 783 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:20.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:20 smithi027 bash[22610]: cluster 2024-08-31T02:29:19.329151+0000 mgr.a (mgr.14388) 783 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:20.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:20 smithi191 bash[24992]: cluster 2024-08-31T02:29:19.329151+0000 mgr.a (mgr.14388) 783 : cluster [DBG] pgmap v541: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:22.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:22 smithi163 bash[24253]: cluster 2024-08-31T02:29:21.329876+0000 mgr.a (mgr.14388) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:22.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:22 smithi027 bash[22610]: cluster 2024-08-31T02:29:21.329876+0000 mgr.a (mgr.14388) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:22.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:22 smithi191 bash[24992]: cluster 2024-08-31T02:29:21.329876+0000 mgr.a (mgr.14388) 784 : cluster [DBG] pgmap v542: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:24.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:24.315 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:24.315 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:24.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:24 smithi163 bash[24253]: cluster 2024-08-31T02:29:23.331769+0000 mgr.a (mgr.14388) 785 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:24.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:24 smithi027 bash[22610]: cluster 2024-08-31T02:29:23.331769+0000 mgr.a (mgr.14388) 785 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:24.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:24 smithi191 bash[24992]: cluster 2024-08-31T02:29:23.331769+0000 mgr.a (mgr.14388) 785 : cluster [DBG] pgmap v543: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:25.083 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:25.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:29:25.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:25 smithi163 bash[24253]: audit 2024-08-31T02:29:24.653362+0000 mgr.a (mgr.14388) 786 : audit [DBG] from='client.30399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:25.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:25 smithi027 bash[22610]: audit 2024-08-31T02:29:24.653362+0000 mgr.a (mgr.14388) 786 : audit [DBG] from='client.30399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:25.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:25 smithi191 bash[24992]: audit 2024-08-31T02:29:24.653362+0000 mgr.a (mgr.14388) 786 : audit [DBG] from='client.30399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:26.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:26 smithi163 bash[24253]: cluster 2024-08-31T02:29:25.332632+0000 mgr.a (mgr.14388) 787 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:26.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:26 smithi027 bash[22610]: cluster 2024-08-31T02:29:25.332632+0000 mgr.a (mgr.14388) 787 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:26.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:26 smithi191 bash[24992]: cluster 2024-08-31T02:29:25.332632+0000 mgr.a (mgr.14388) 787 : cluster [DBG] pgmap v544: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:28.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:28 smithi163 bash[24253]: cluster 2024-08-31T02:29:27.333411+0000 mgr.a (mgr.14388) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:28.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:28 smithi027 bash[22610]: cluster 2024-08-31T02:29:27.333411+0000 mgr.a (mgr.14388) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:28.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:28 smithi191 bash[24992]: cluster 2024-08-31T02:29:27.333411+0000 mgr.a (mgr.14388) 788 : cluster [DBG] pgmap v545: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:30.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:30.085 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:30.085 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:30.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:30 smithi163 bash[24253]: cluster 2024-08-31T02:29:29.335639+0000 mgr.a (mgr.14388) 789 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:30.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:30 smithi027 bash[22610]: cluster 2024-08-31T02:29:29.335639+0000 mgr.a (mgr.14388) 789 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:30.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:30 smithi191 bash[24992]: cluster 2024-08-31T02:29:29.335639+0000 mgr.a (mgr.14388) 789 : cluster [DBG] pgmap v546: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:30.810 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:30.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:30.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:30.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:30.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:29:31.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:31 smithi163 bash[24253]: audit 2024-08-31T02:29:30.425740+0000 mgr.a (mgr.14388) 790 : audit [DBG] from='client.30477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:31.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:31 smithi027 bash[22610]: audit 2024-08-31T02:29:30.425740+0000 mgr.a (mgr.14388) 790 : audit [DBG] from='client.30477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:31.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:31 smithi191 bash[24992]: audit 2024-08-31T02:29:30.425740+0000 mgr.a (mgr.14388) 790 : audit [DBG] from='client.30477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:32.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:32 smithi163 bash[24253]: cluster 2024-08-31T02:29:31.336501+0000 mgr.a (mgr.14388) 791 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:32.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:32 smithi027 bash[22610]: cluster 2024-08-31T02:29:31.336501+0000 mgr.a (mgr.14388) 791 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:32.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:32 smithi191 bash[24992]: cluster 2024-08-31T02:29:31.336501+0000 mgr.a (mgr.14388) 791 : cluster [DBG] pgmap v547: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:34.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:34 smithi027 bash[22610]: cluster 2024-08-31T02:29:33.338617+0000 mgr.a (mgr.14388) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:34.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:34 smithi191 bash[24992]: cluster 2024-08-31T02:29:33.338617+0000 mgr.a (mgr.14388) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:34.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:34 smithi163 bash[24253]: cluster 2024-08-31T02:29:33.338617+0000 mgr.a (mgr.14388) 792 : cluster [DBG] pgmap v548: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:35.812 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:35.813 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:36.587 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:36.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:36.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:36.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:36.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:29:36.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:36 smithi027 bash[22610]: cluster 2024-08-31T02:29:35.339487+0000 mgr.a (mgr.14388) 793 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:36.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:36 smithi191 bash[24992]: cluster 2024-08-31T02:29:35.339487+0000 mgr.a (mgr.14388) 793 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:36.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:36 smithi163 bash[24253]: cluster 2024-08-31T02:29:35.339487+0000 mgr.a (mgr.14388) 793 : cluster [DBG] pgmap v549: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:37.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:37 smithi027 bash[22610]: audit 2024-08-31T02:29:36.157500+0000 mgr.a (mgr.14388) 794 : audit [DBG] from='client.30555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:37.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:37 smithi191 bash[24992]: audit 2024-08-31T02:29:36.157500+0000 mgr.a (mgr.14388) 794 : audit [DBG] from='client.30555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:37.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:37 smithi163 bash[24253]: audit 2024-08-31T02:29:36.157500+0000 mgr.a (mgr.14388) 794 : audit [DBG] from='client.30555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:38.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:38 smithi027 bash[22610]: cluster 2024-08-31T02:29:37.340382+0000 mgr.a (mgr.14388) 795 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:38 smithi191 bash[24992]: cluster 2024-08-31T02:29:37.340382+0000 mgr.a (mgr.14388) 795 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:38.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:38 smithi163 bash[24253]: cluster 2024-08-31T02:29:37.340382+0000 mgr.a (mgr.14388) 795 : cluster [DBG] pgmap v550: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:40.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:40 smithi027 bash[22610]: cluster 2024-08-31T02:29:39.342578+0000 mgr.a (mgr.14388) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:40.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:40 smithi191 bash[24992]: cluster 2024-08-31T02:29:39.342578+0000 mgr.a (mgr.14388) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:40.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:40 smithi163 bash[24253]: cluster 2024-08-31T02:29:39.342578+0000 mgr.a (mgr.14388) 796 : cluster [DBG] pgmap v551: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:41.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:41.590 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:41.590 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:42.338 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:42.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:42.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:42.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:42.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:29:42.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:42 smithi027 bash[22610]: cluster 2024-08-31T02:29:41.343382+0000 mgr.a (mgr.14388) 797 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:42.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:42 smithi027 bash[22610]: audit 2024-08-31T02:29:41.929912+0000 mgr.a (mgr.14388) 798 : audit [DBG] from='client.30630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:42.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:42 smithi191 bash[24992]: cluster 2024-08-31T02:29:41.343382+0000 mgr.a (mgr.14388) 797 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:42.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:42 smithi191 bash[24992]: audit 2024-08-31T02:29:41.929912+0000 mgr.a (mgr.14388) 798 : audit [DBG] from='client.30630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:42.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:42 smithi163 bash[24253]: cluster 2024-08-31T02:29:41.343382+0000 mgr.a (mgr.14388) 797 : cluster [DBG] pgmap v552: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:42.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:42 smithi163 bash[24253]: audit 2024-08-31T02:29:41.929912+0000 mgr.a (mgr.14388) 798 : audit [DBG] from='client.30630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:44.727 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:44 smithi027 bash[22610]: cluster 2024-08-31T02:29:43.345653+0000 mgr.a (mgr.14388) 799 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:44.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:44 smithi191 bash[24992]: cluster 2024-08-31T02:29:43.345653+0000 mgr.a (mgr.14388) 799 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:44.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:44 smithi163 bash[24253]: cluster 2024-08-31T02:29:43.345653+0000 mgr.a (mgr.14388) 799 : cluster [DBG] pgmap v553: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:29:46.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:46 smithi191 bash[24992]: cluster 2024-08-31T02:29:45.346427+0000 mgr.a (mgr.14388) 800 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:46.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:46 smithi163 bash[24253]: cluster 2024-08-31T02:29:45.346427+0000 mgr.a (mgr.14388) 800 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:46.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:46 smithi027 bash[22610]: cluster 2024-08-31T02:29:45.346427+0000 mgr.a (mgr.14388) 800 : cluster [DBG] pgmap v554: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:47.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:47.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:47.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:48.080 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:48.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:48.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:48.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:48.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:29:48.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:48 smithi191 bash[24992]: cluster 2024-08-31T02:29:47.347150+0000 mgr.a (mgr.14388) 801 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:48.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:48 smithi191 bash[24992]: audit 2024-08-31T02:29:47.678365+0000 mgr.a (mgr.14388) 802 : audit [DBG] from='client.30708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:48.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:48 smithi163 bash[24253]: cluster 2024-08-31T02:29:47.347150+0000 mgr.a (mgr.14388) 801 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:48.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:48 smithi163 bash[24253]: audit 2024-08-31T02:29:47.678365+0000 mgr.a (mgr.14388) 802 : audit [DBG] from='client.30708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:48.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:48 smithi027 bash[22610]: cluster 2024-08-31T02:29:47.347150+0000 mgr.a (mgr.14388) 801 : cluster [DBG] pgmap v555: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:48.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:48 smithi027 bash[22610]: audit 2024-08-31T02:29:47.678365+0000 mgr.a (mgr.14388) 802 : audit [DBG] from='client.30708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:50.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:50 smithi191 bash[24992]: cluster 2024-08-31T02:29:49.349513+0000 mgr.a (mgr.14388) 803 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:29:50.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:50 smithi163 bash[24253]: cluster 2024-08-31T02:29:49.349513+0000 mgr.a (mgr.14388) 803 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:29:50.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:50 smithi027 bash[22610]: cluster 2024-08-31T02:29:49.349513+0000 mgr.a (mgr.14388) 803 : cluster [DBG] pgmap v556: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:29:52.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:52 smithi191 bash[24992]: cluster 2024-08-31T02:29:51.350307+0000 mgr.a (mgr.14388) 804 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:29:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:52 smithi163 bash[24253]: cluster 2024-08-31T02:29:51.350307+0000 mgr.a (mgr.14388) 804 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:29:52.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:52 smithi027 bash[22610]: cluster 2024-08-31T02:29:51.350307+0000 mgr.a (mgr.14388) 804 : cluster [DBG] pgmap v557: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:29:53.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:53.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:53.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:53.854 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:53.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:29:54.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:54 smithi191 bash[24992]: cluster 2024-08-31T02:29:53.352211+0000 mgr.a (mgr.14388) 805 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:54.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:54 smithi191 bash[24992]: audit 2024-08-31T02:29:53.422324+0000 mgr.a (mgr.14388) 806 : audit [DBG] from='client.30786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:54.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:54 smithi163 bash[24253]: cluster 2024-08-31T02:29:53.352211+0000 mgr.a (mgr.14388) 805 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:54.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:54 smithi163 bash[24253]: audit 2024-08-31T02:29:53.422324+0000 mgr.a (mgr.14388) 806 : audit [DBG] from='client.30786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:54.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:54 smithi027 bash[22610]: cluster 2024-08-31T02:29:53.352211+0000 mgr.a (mgr.14388) 805 : cluster [DBG] pgmap v558: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:29:54.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:54 smithi027 bash[22610]: audit 2024-08-31T02:29:53.422324+0000 mgr.a (mgr.14388) 806 : audit [DBG] from='client.30786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:29:56.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:56 smithi191 bash[24992]: cluster 2024-08-31T02:29:55.353275+0000 mgr.a (mgr.14388) 807 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:29:56.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:56 smithi163 bash[24253]: cluster 2024-08-31T02:29:55.353275+0000 mgr.a (mgr.14388) 807 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:29:56.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:56 smithi027 bash[22610]: cluster 2024-08-31T02:29:55.353275+0000 mgr.a (mgr.14388) 807 : cluster [DBG] pgmap v559: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:29:58.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:29:58 smithi191 bash[24992]: cluster 2024-08-31T02:29:57.354200+0000 mgr.a (mgr.14388) 808 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:29:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:29:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:29:58.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:29:58 smithi163 bash[24253]: cluster 2024-08-31T02:29:57.354200+0000 mgr.a (mgr.14388) 808 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:58.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:29:58 smithi027 bash[22610]: cluster 2024-08-31T02:29:57.354200+0000 mgr.a (mgr.14388) 808 : cluster [DBG] pgmap v560: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:29:59.616 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:29:59.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:29:59.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:29:59.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:29:59.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:00.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:00 smithi191 bash[24992]: audit 2024-08-31T02:29:59.198646+0000 mgr.a (mgr.14388) 809 : audit [DBG] from='client.30861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:00.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:00 smithi191 bash[24992]: cluster 2024-08-31T02:29:59.355571+0000 mgr.a (mgr.14388) 810 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:00.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:00 smithi191 bash[24992]: cluster 2024-08-31T02:30:00.000155+0000 mon.a (mon.0) 714 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:30:00.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:00 smithi163 bash[24253]: audit 2024-08-31T02:29:59.198646+0000 mgr.a (mgr.14388) 809 : audit [DBG] from='client.30861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:00.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:00 smithi163 bash[24253]: cluster 2024-08-31T02:29:59.355571+0000 mgr.a (mgr.14388) 810 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:00.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:00 smithi163 bash[24253]: cluster 2024-08-31T02:30:00.000155+0000 mon.a (mon.0) 714 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:30:00.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:00 smithi027 bash[22610]: audit 2024-08-31T02:29:59.198646+0000 mgr.a (mgr.14388) 809 : audit [DBG] from='client.30861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:00.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:00 smithi027 bash[22610]: cluster 2024-08-31T02:29:59.355571+0000 mgr.a (mgr.14388) 810 : cluster [DBG] pgmap v561: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:00.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:00 smithi027 bash[22610]: cluster 2024-08-31T02:30:00.000155+0000 mon.a (mon.0) 714 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:30:01.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:01 smithi191 bash[24992]: audit 2024-08-31T02:30:01.173783+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:30:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:01 smithi163 bash[24253]: audit 2024-08-31T02:30:01.173783+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:30:01.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:01 smithi027 bash[22610]: audit 2024-08-31T02:30:01.173783+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:30:02.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:02 smithi191 bash[24992]: cluster 2024-08-31T02:30:01.356390+0000 mgr.a (mgr.14388) 811 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:30:02.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:02 smithi191 bash[24992]: audit 2024-08-31T02:30:02.020715+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:30:02.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:02 smithi191 bash[24992]: audit 2024-08-31T02:30:02.022415+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:30:02.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:02 smithi191 bash[24992]: audit 2024-08-31T02:30:02.032970+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:30:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:02 smithi191 bash[24992]: audit 2024-08-31T02:30:02.037907+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:30:02.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:02 smithi163 bash[24253]: cluster 2024-08-31T02:30:01.356390+0000 mgr.a (mgr.14388) 811 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:30:02.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:02 smithi163 bash[24253]: audit 2024-08-31T02:30:02.020715+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:30:02.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:02 smithi163 bash[24253]: audit 2024-08-31T02:30:02.022415+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:30:02.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:02 smithi163 bash[24253]: audit 2024-08-31T02:30:02.032970+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:30:02.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:02 smithi163 bash[24253]: audit 2024-08-31T02:30:02.037907+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:30:02.977 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:30:02 smithi027 bash[22863]: debug 2024-08-31T02:30:02.724+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:30:02.977 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:30:02 smithi027 bash[22863]: debug 2024-08-31T02:30:02.728+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:30:02.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:02 smithi027 bash[22610]: cluster 2024-08-31T02:30:01.356390+0000 mgr.a (mgr.14388) 811 : cluster [DBG] pgmap v562: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:30:02.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:02 smithi027 bash[22610]: audit 2024-08-31T02:30:02.020715+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:30:02.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:02 smithi027 bash[22610]: audit 2024-08-31T02:30:02.022415+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:30:02.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:02 smithi027 bash[22610]: audit 2024-08-31T02:30:02.032970+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:30:02.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:02 smithi027 bash[22610]: audit 2024-08-31T02:30:02.037907+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:30:03.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:03 smithi191 bash[24992]: audit 2024-08-31T02:30:02.039238+0000 mgr.a (mgr.14388) 812 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:30:03.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:03 smithi191 bash[24992]: audit 2024-08-31T02:30:02.730587+0000 mgr.a (mgr.14388) 813 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:30:03.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:03 smithi191 bash[24992]: cephadm 2024-08-31T02:30:02.731819+0000 mgr.a (mgr.14388) 814 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:30:03.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:03 smithi163 bash[24253]: audit 2024-08-31T02:30:02.039238+0000 mgr.a (mgr.14388) 812 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:30:03.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:03 smithi163 bash[24253]: audit 2024-08-31T02:30:02.730587+0000 mgr.a (mgr.14388) 813 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:30:03.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:03 smithi163 bash[24253]: cephadm 2024-08-31T02:30:02.731819+0000 mgr.a (mgr.14388) 814 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:30:03.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:03 smithi027 bash[22610]: audit 2024-08-31T02:30:02.039238+0000 mgr.a (mgr.14388) 812 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:30:03.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:03 smithi027 bash[22610]: audit 2024-08-31T02:30:02.730587+0000 mgr.a (mgr.14388) 813 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:30:03.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:03 smithi027 bash[22610]: cephadm 2024-08-31T02:30:02.731819+0000 mgr.a (mgr.14388) 814 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:30:04.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:30:04.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:30:04.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:30:04.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:04 smithi191 bash[24992]: cluster 2024-08-31T02:30:03.358667+0000 mgr.a (mgr.14388) 815 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:04.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:04 smithi163 bash[24253]: cluster 2024-08-31T02:30:03.358667+0000 mgr.a (mgr.14388) 815 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:04.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:04 smithi027 bash[22610]: cluster 2024-08-31T02:30:03.358667+0000 mgr.a (mgr.14388) 815 : cluster [DBG] pgmap v563: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.6 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:05.374 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:30:05.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:30:05.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:30:05.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:30:05.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:05.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:05 smithi191 bash[24992]: audit 2024-08-31T02:30:04.957931+0000 mgr.a (mgr.14388) 816 : audit [DBG] from='client.31044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:05.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:05 smithi163 bash[24253]: audit 2024-08-31T02:30:04.957931+0000 mgr.a (mgr.14388) 816 : audit [DBG] from='client.31044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:05.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:05 smithi027 bash[22610]: audit 2024-08-31T02:30:04.957931+0000 mgr.a (mgr.14388) 816 : audit [DBG] from='client.31044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:06.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:06 smithi163 bash[24253]: cluster 2024-08-31T02:30:05.359212+0000 mgr.a (mgr.14388) 817 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:06.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:06 smithi027 bash[22610]: cluster 2024-08-31T02:30:05.359212+0000 mgr.a (mgr.14388) 817 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:07.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:06 smithi191 bash[24992]: cluster 2024-08-31T02:30:05.359212+0000 mgr.a (mgr.14388) 817 : cluster [DBG] pgmap v564: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:08.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:08 smithi163 bash[24253]: cluster 2024-08-31T02:30:07.359947+0000 mgr.a (mgr.14388) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:08.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:08 smithi027 bash[22610]: cluster 2024-08-31T02:30:07.359947+0000 mgr.a (mgr.14388) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:09.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:08 smithi191 bash[24992]: cluster 2024-08-31T02:30:07.359947+0000 mgr.a (mgr.14388) 818 : cluster [DBG] pgmap v565: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:10.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:30:10.376 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:30:10.376 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:30:10.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:10 smithi163 bash[24253]: cluster 2024-08-31T02:30:09.362156+0000 mgr.a (mgr.14388) 819 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:10.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:10 smithi027 bash[22610]: cluster 2024-08-31T02:30:09.362156+0000 mgr.a (mgr.14388) 819 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:11.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:10 smithi191 bash[24992]: cluster 2024-08-31T02:30:09.362156+0000 mgr.a (mgr.14388) 819 : cluster [DBG] pgmap v566: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:11.135 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:30:11.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:30:11.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:30:11.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:30:11.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:11.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:11 smithi163 bash[24253]: audit 2024-08-31T02:30:10.713840+0000 mgr.a (mgr.14388) 820 : audit [DBG] from='client.31122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:11.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:11 smithi027 bash[22610]: audit 2024-08-31T02:30:10.713840+0000 mgr.a (mgr.14388) 820 : audit [DBG] from='client.31122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:12.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:11 smithi191 bash[24992]: audit 2024-08-31T02:30:10.713840+0000 mgr.a (mgr.14388) 820 : audit [DBG] from='client.31122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:12.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:12 smithi163 bash[24253]: cluster 2024-08-31T02:30:11.363257+0000 mgr.a (mgr.14388) 821 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:12.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:12 smithi027 bash[22610]: cluster 2024-08-31T02:30:11.363257+0000 mgr.a (mgr.14388) 821 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:12 smithi191 bash[24992]: cluster 2024-08-31T02:30:11.363257+0000 mgr.a (mgr.14388) 821 : cluster [DBG] pgmap v567: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:14.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:14 smithi163 bash[24253]: cluster 2024-08-31T02:30:13.365595+0000 mgr.a (mgr.14388) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:14.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:14 smithi027 bash[22610]: cluster 2024-08-31T02:30:13.365595+0000 mgr.a (mgr.14388) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:15.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:14 smithi191 bash[24992]: cluster 2024-08-31T02:30:13.365595+0000 mgr.a (mgr.14388) 822 : cluster [DBG] pgmap v568: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:30:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:30:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:30:16.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:30:16.876 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:30:16.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:30:16.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:30:16.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:30:16.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:16.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:16 smithi163 bash[24253]: cluster 2024-08-31T02:30:15.366533+0000 mgr.a (mgr.14388) 823 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:16.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:16 smithi027 bash[22610]: cluster 2024-08-31T02:30:15.366533+0000 mgr.a (mgr.14388) 823 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:17.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:16 smithi191 bash[24992]: cluster 2024-08-31T02:30:15.366533+0000 mgr.a (mgr.14388) 823 : cluster [DBG] pgmap v569: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:17.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:17 smithi163 bash[24253]: audit 2024-08-31T02:30:16.474059+0000 mgr.a (mgr.14388) 824 : audit [DBG] from='client.31200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:17.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:17 smithi027 bash[22610]: audit 2024-08-31T02:30:16.474059+0000 mgr.a (mgr.14388) 824 : audit [DBG] from='client.31200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:18.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:17 smithi191 bash[24992]: audit 2024-08-31T02:30:16.474059+0000 mgr.a (mgr.14388) 824 : audit [DBG] from='client.31200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:18.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:18 smithi163 bash[24253]: cluster 2024-08-31T02:30:17.367538+0000 mgr.a (mgr.14388) 825 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:18.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:18 smithi027 bash[22610]: cluster 2024-08-31T02:30:17.367538+0000 mgr.a (mgr.14388) 825 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:19.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:18 smithi191 bash[24992]: cluster 2024-08-31T02:30:17.367538+0000 mgr.a (mgr.14388) 825 : cluster [DBG] pgmap v570: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:20.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:20 smithi163 bash[24253]: cluster 2024-08-31T02:30:19.369773+0000 mgr.a (mgr.14388) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:20.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:20 smithi027 bash[22610]: cluster 2024-08-31T02:30:19.369773+0000 mgr.a (mgr.14388) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:21.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:20 smithi191 bash[24992]: cluster 2024-08-31T02:30:19.369773+0000 mgr.a (mgr.14388) 826 : cluster [DBG] pgmap v571: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:21.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:30:21.878 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:30:21.878 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:30:22.651 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:30:22.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:30:22.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:30:22.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:30:22.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:22.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:22 smithi163 bash[24253]: cluster 2024-08-31T02:30:21.370528+0000 mgr.a (mgr.14388) 827 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:22.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:22 smithi027 bash[22610]: cluster 2024-08-31T02:30:21.370528+0000 mgr.a (mgr.14388) 827 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:23.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:22 smithi191 bash[24992]: cluster 2024-08-31T02:30:21.370528+0000 mgr.a (mgr.14388) 827 : cluster [DBG] pgmap v572: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:23.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:23 smithi163 bash[24253]: audit 2024-08-31T02:30:22.218152+0000 mgr.a (mgr.14388) 828 : audit [DBG] from='client.31275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:23.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:23 smithi027 bash[22610]: audit 2024-08-31T02:30:22.218152+0000 mgr.a (mgr.14388) 828 : audit [DBG] from='client.31275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:24.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:23 smithi191 bash[24992]: audit 2024-08-31T02:30:22.218152+0000 mgr.a (mgr.14388) 828 : audit [DBG] from='client.31275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:24.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:24 smithi163 bash[24253]: cluster 2024-08-31T02:30:23.372853+0000 mgr.a (mgr.14388) 829 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:24.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:24 smithi027 bash[22610]: cluster 2024-08-31T02:30:23.372853+0000 mgr.a (mgr.14388) 829 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:25.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:24 smithi191 bash[24992]: cluster 2024-08-31T02:30:23.372853+0000 mgr.a (mgr.14388) 829 : cluster [DBG] pgmap v573: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:26.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:26 smithi163 bash[24253]: cluster 2024-08-31T02:30:25.373618+0000 mgr.a (mgr.14388) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:26.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:26 smithi027 bash[22610]: cluster 2024-08-31T02:30:25.373618+0000 mgr.a (mgr.14388) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:27.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:26 smithi191 bash[24992]: cluster 2024-08-31T02:30:25.373618+0000 mgr.a (mgr.14388) 830 : cluster [DBG] pgmap v574: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:27.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:30:27.654 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:30:27.654 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:30:28.387 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:30:28.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:30:28.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:30:28.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:30:28.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:28.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:28 smithi163 bash[24253]: cluster 2024-08-31T02:30:27.374374+0000 mgr.a (mgr.14388) 831 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:28.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:28 smithi163 bash[24253]: audit 2024-08-31T02:30:27.993249+0000 mgr.a (mgr.14388) 832 : audit [DBG] from='client.31350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:28.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:28 smithi027 bash[22610]: cluster 2024-08-31T02:30:27.374374+0000 mgr.a (mgr.14388) 831 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:28.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:28 smithi027 bash[22610]: audit 2024-08-31T02:30:27.993249+0000 mgr.a (mgr.14388) 832 : audit [DBG] from='client.31350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:29.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:28 smithi191 bash[24992]: cluster 2024-08-31T02:30:27.374374+0000 mgr.a (mgr.14388) 831 : cluster [DBG] pgmap v575: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:29.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:28 smithi191 bash[24992]: audit 2024-08-31T02:30:27.993249+0000 mgr.a (mgr.14388) 832 : audit [DBG] from='client.31350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:30.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:30 smithi163 bash[24253]: cluster 2024-08-31T02:30:29.377122+0000 mgr.a (mgr.14388) 833 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:30.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:30 smithi027 bash[22610]: cluster 2024-08-31T02:30:29.377122+0000 mgr.a (mgr.14388) 833 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:31.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:30 smithi191 bash[24992]: cluster 2024-08-31T02:30:29.377122+0000 mgr.a (mgr.14388) 833 : cluster [DBG] pgmap v576: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:32.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:32 smithi163 bash[24253]: cluster 2024-08-31T02:30:31.377942+0000 mgr.a (mgr.14388) 834 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:30:32.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:32 smithi027 bash[22610]: cluster 2024-08-31T02:30:31.377942+0000 mgr.a (mgr.14388) 834 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:30:33.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:32 smithi191 bash[24992]: cluster 2024-08-31T02:30:31.377942+0000 mgr.a (mgr.14388) 834 : cluster [DBG] pgmap v577: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:30:33.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:30:33.390 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:30:33.390 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:30:34.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:30:34.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:30:34.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:30:34.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:34.154 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:30:34.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:34 smithi163 bash[24253]: cluster 2024-08-31T02:30:33.379875+0000 mgr.a (mgr.14388) 835 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:34.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:34 smithi163 bash[24253]: audit 2024-08-31T02:30:33.733911+0000 mgr.a (mgr.14388) 836 : audit [DBG] from='client.31428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:34.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:34 smithi027 bash[22610]: cluster 2024-08-31T02:30:33.379875+0000 mgr.a (mgr.14388) 835 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:34.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:34 smithi027 bash[22610]: audit 2024-08-31T02:30:33.733911+0000 mgr.a (mgr.14388) 836 : audit [DBG] from='client.31428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:35.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:34 smithi191 bash[24992]: cluster 2024-08-31T02:30:33.379875+0000 mgr.a (mgr.14388) 835 : cluster [DBG] pgmap v578: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:35.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:34 smithi191 bash[24992]: audit 2024-08-31T02:30:33.733911+0000 mgr.a (mgr.14388) 836 : audit [DBG] from='client.31428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:36.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:36 smithi163 bash[24253]: cluster 2024-08-31T02:30:35.380780+0000 mgr.a (mgr.14388) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:30:36.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:36 smithi027 bash[22610]: cluster 2024-08-31T02:30:35.380780+0000 mgr.a (mgr.14388) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:30:37.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:36 smithi191 bash[24992]: cluster 2024-08-31T02:30:35.380780+0000 mgr.a (mgr.14388) 837 : cluster [DBG] pgmap v579: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:30:38.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:38 smithi163 bash[24253]: cluster 2024-08-31T02:30:37.381563+0000 mgr.a (mgr.14388) 838 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:30:38.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:38 smithi027 bash[22610]: cluster 2024-08-31T02:30:37.381563+0000 mgr.a (mgr.14388) 838 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:30:39.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:38 smithi191 bash[24992]: cluster 2024-08-31T02:30:37.381563+0000 mgr.a (mgr.14388) 838 : cluster [DBG] pgmap v580: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:30:39.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:30:39.156 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:30:39.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:30:39.912 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:30:39.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:30:39.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:30:39.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:30:39.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:40.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:40 smithi163 bash[24253]: cluster 2024-08-31T02:30:39.383725+0000 mgr.a (mgr.14388) 839 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:40.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:40 smithi163 bash[24253]: audit 2024-08-31T02:30:39.494784+0000 mgr.a (mgr.14388) 840 : audit [DBG] from='client.31506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:40.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:40 smithi027 bash[22610]: cluster 2024-08-31T02:30:39.383725+0000 mgr.a (mgr.14388) 839 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:40.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:40 smithi027 bash[22610]: audit 2024-08-31T02:30:39.494784+0000 mgr.a (mgr.14388) 840 : audit [DBG] from='client.31506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:41.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:40 smithi191 bash[24992]: cluster 2024-08-31T02:30:39.383725+0000 mgr.a (mgr.14388) 839 : cluster [DBG] pgmap v581: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:41.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:40 smithi191 bash[24992]: audit 2024-08-31T02:30:39.494784+0000 mgr.a (mgr.14388) 840 : audit [DBG] from='client.31506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:42.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:42 smithi163 bash[24253]: cluster 2024-08-31T02:30:41.384598+0000 mgr.a (mgr.14388) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:42.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:42 smithi027 bash[22610]: cluster 2024-08-31T02:30:41.384598+0000 mgr.a (mgr.14388) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:43.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:42 smithi191 bash[24992]: cluster 2024-08-31T02:30:41.384598+0000 mgr.a (mgr.14388) 841 : cluster [DBG] pgmap v582: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:44.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:30:44.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:30:44.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:30:44.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:44 smithi163 bash[24253]: cluster 2024-08-31T02:30:43.386741+0000 mgr.a (mgr.14388) 842 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:44.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:44 smithi027 bash[22610]: cluster 2024-08-31T02:30:43.386741+0000 mgr.a (mgr.14388) 842 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:44 smithi191 bash[24992]: cluster 2024-08-31T02:30:43.386741+0000 mgr.a (mgr.14388) 842 : cluster [DBG] pgmap v583: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:30:45.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:30:45.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:30:45.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:45.677 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:30:46.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:46 smithi163 bash[24253]: audit 2024-08-31T02:30:45.257530+0000 mgr.a (mgr.14388) 843 : audit [DBG] from='client.31581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:46.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:46 smithi163 bash[24253]: cluster 2024-08-31T02:30:45.392896+0000 mgr.a (mgr.14388) 844 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:46.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:46 smithi027 bash[22610]: audit 2024-08-31T02:30:45.257530+0000 mgr.a (mgr.14388) 843 : audit [DBG] from='client.31581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:46.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:46 smithi027 bash[22610]: cluster 2024-08-31T02:30:45.392896+0000 mgr.a (mgr.14388) 844 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:47.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:46 smithi191 bash[24992]: audit 2024-08-31T02:30:45.257530+0000 mgr.a (mgr.14388) 843 : audit [DBG] from='client.31581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:47.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:46 smithi191 bash[24992]: cluster 2024-08-31T02:30:45.392896+0000 mgr.a (mgr.14388) 844 : cluster [DBG] pgmap v584: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:48.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:48 smithi163 bash[24253]: cluster 2024-08-31T02:30:47.393776+0000 mgr.a (mgr.14388) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:48.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:48 smithi027 bash[22610]: cluster 2024-08-31T02:30:47.393776+0000 mgr.a (mgr.14388) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:49.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:48 smithi191 bash[24992]: cluster 2024-08-31T02:30:47.393776+0000 mgr.a (mgr.14388) 845 : cluster [DBG] pgmap v585: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:50.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:30:50.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:30:50.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:30:50.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:50 smithi163 bash[24253]: cluster 2024-08-31T02:30:49.396015+0000 mgr.a (mgr.14388) 846 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:50.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:50 smithi027 bash[22610]: cluster 2024-08-31T02:30:49.396015+0000 mgr.a (mgr.14388) 846 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:51.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:50 smithi191 bash[24992]: cluster 2024-08-31T02:30:49.396015+0000 mgr.a (mgr.14388) 846 : cluster [DBG] pgmap v586: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:51.438 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:30:51.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:30:51.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:30:51.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:30:51.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:52 smithi163 bash[24253]: audit 2024-08-31T02:30:51.018916+0000 mgr.a (mgr.14388) 847 : audit [DBG] from='client.31659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:52.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:52 smithi163 bash[24253]: cluster 2024-08-31T02:30:51.396527+0000 mgr.a (mgr.14388) 848 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:52.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:52 smithi027 bash[22610]: audit 2024-08-31T02:30:51.018916+0000 mgr.a (mgr.14388) 847 : audit [DBG] from='client.31659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:52.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:52 smithi027 bash[22610]: cluster 2024-08-31T02:30:51.396527+0000 mgr.a (mgr.14388) 848 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:53.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:52 smithi191 bash[24992]: audit 2024-08-31T02:30:51.018916+0000 mgr.a (mgr.14388) 847 : audit [DBG] from='client.31659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:53.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:52 smithi191 bash[24992]: cluster 2024-08-31T02:30:51.396527+0000 mgr.a (mgr.14388) 848 : cluster [DBG] pgmap v587: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:54.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:54 smithi163 bash[24253]: cluster 2024-08-31T02:30:53.398617+0000 mgr.a (mgr.14388) 849 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:54.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:54 smithi027 bash[22610]: cluster 2024-08-31T02:30:53.398617+0000 mgr.a (mgr.14388) 849 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:55.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:54 smithi191 bash[24992]: cluster 2024-08-31T02:30:53.398617+0000 mgr.a (mgr.14388) 849 : cluster [DBG] pgmap v588: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:30:56.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:30:56.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:30:56.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:30:56.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:56 smithi163 bash[24253]: cluster 2024-08-31T02:30:55.399400+0000 mgr.a (mgr.14388) 850 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:56.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:56 smithi027 bash[22610]: cluster 2024-08-31T02:30:55.399400+0000 mgr.a (mgr.14388) 850 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:57.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:56 smithi191 bash[24992]: cluster 2024-08-31T02:30:55.399400+0000 mgr.a (mgr.14388) 850 : cluster [DBG] pgmap v589: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:57.211 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:30:57.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:30:57.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:30:57.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:30:57.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:30:57.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:57 smithi163 bash[24253]: audit 2024-08-31T02:30:56.784679+0000 mgr.a (mgr.14388) 851 : audit [DBG] from='client.31737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:57.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:57 smithi027 bash[22610]: audit 2024-08-31T02:30:56.784679+0000 mgr.a (mgr.14388) 851 : audit [DBG] from='client.31737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:58.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:57 smithi191 bash[24992]: audit 2024-08-31T02:30:56.784679+0000 mgr.a (mgr.14388) 851 : audit [DBG] from='client.31737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:30:58.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:30:58 smithi163 bash[24253]: cluster 2024-08-31T02:30:57.400263+0000 mgr.a (mgr.14388) 852 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:58.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:30:58 smithi027 bash[22610]: cluster 2024-08-31T02:30:57.400263+0000 mgr.a (mgr.14388) 852 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:30:59.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:30:58 smithi191 bash[24992]: cluster 2024-08-31T02:30:57.400263+0000 mgr.a (mgr.14388) 852 : cluster [DBG] pgmap v590: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:00 smithi163 bash[24253]: cluster 2024-08-31T02:30:59.402507+0000 mgr.a (mgr.14388) 853 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:00.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:00 smithi027 bash[22610]: cluster 2024-08-31T02:30:59.402507+0000 mgr.a (mgr.14388) 853 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:01.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:00 smithi191 bash[24992]: cluster 2024-08-31T02:30:59.402507+0000 mgr.a (mgr.14388) 853 : cluster [DBG] pgmap v591: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:02.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:02.214 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:02.214 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:31:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:02 smithi163 bash[24253]: cluster 2024-08-31T02:31:01.403283+0000 mgr.a (mgr.14388) 854 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:02.948 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:31:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:31:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:31:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:31:02.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:31:02.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:02 smithi027 bash[22610]: cluster 2024-08-31T02:31:01.403283+0000 mgr.a (mgr.14388) 854 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:03.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:02 smithi191 bash[24992]: cluster 2024-08-31T02:31:01.403283+0000 mgr.a (mgr.14388) 854 : cluster [DBG] pgmap v592: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:03.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:03 smithi163 bash[24253]: audit 2024-08-31T02:31:02.551190+0000 mgr.a (mgr.14388) 855 : audit [DBG] from='client.31812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:03.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:03 smithi163 bash[24253]: audit 2024-08-31T02:31:02.781498+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:31:03.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:03 smithi163 bash[24253]: audit 2024-08-31T02:31:03.567409+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:31:03.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:03 smithi163 bash[24253]: audit 2024-08-31T02:31:03.568967+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:31:03.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:03 smithi163 bash[24253]: audit 2024-08-31T02:31:03.579404+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:31:03.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:03 smithi163 bash[24253]: audit 2024-08-31T02:31:03.584142+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:31:03.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:03 smithi027 bash[22610]: audit 2024-08-31T02:31:02.551190+0000 mgr.a (mgr.14388) 855 : audit [DBG] from='client.31812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:03.976 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:03 smithi027 bash[22610]: audit 2024-08-31T02:31:02.781498+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:31:03.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:03 smithi027 bash[22610]: audit 2024-08-31T02:31:03.567409+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:31:03.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:03 smithi027 bash[22610]: audit 2024-08-31T02:31:03.568967+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:31:03.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:03 smithi027 bash[22610]: audit 2024-08-31T02:31:03.579404+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:31:03.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:03 smithi027 bash[22610]: audit 2024-08-31T02:31:03.584142+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:31:04.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:03 smithi191 bash[24992]: audit 2024-08-31T02:31:02.551190+0000 mgr.a (mgr.14388) 855 : audit [DBG] from='client.31812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:04.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:03 smithi191 bash[24992]: audit 2024-08-31T02:31:02.781498+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:31:04.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:03 smithi191 bash[24992]: audit 2024-08-31T02:31:03.567409+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:31:04.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:03 smithi191 bash[24992]: audit 2024-08-31T02:31:03.568967+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:31:04.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:03 smithi191 bash[24992]: audit 2024-08-31T02:31:03.579404+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:31:04.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:03 smithi191 bash[24992]: audit 2024-08-31T02:31:03.584142+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:31:04.693 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:31:04 smithi027 bash[22863]: debug 2024-08-31T02:31:04.271+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:31:04.693 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:31:04 smithi027 bash[22863]: debug 2024-08-31T02:31:04.275+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:31:04.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:04 smithi163 bash[24253]: cluster 2024-08-31T02:31:03.405318+0000 mgr.a (mgr.14388) 856 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:31:04.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:04 smithi163 bash[24253]: audit 2024-08-31T02:31:03.586608+0000 mgr.a (mgr.14388) 857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:31:04.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:04 smithi027 bash[22610]: cluster 2024-08-31T02:31:03.405318+0000 mgr.a (mgr.14388) 856 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:31:04.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:04 smithi027 bash[22610]: audit 2024-08-31T02:31:03.586608+0000 mgr.a (mgr.14388) 857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:31:05.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:04 smithi191 bash[24992]: cluster 2024-08-31T02:31:03.405318+0000 mgr.a (mgr.14388) 856 : cluster [DBG] pgmap v593: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:31:05.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:04 smithi191 bash[24992]: audit 2024-08-31T02:31:03.586608+0000 mgr.a (mgr.14388) 857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:31:05.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:05 smithi027 bash[22610]: audit 2024-08-31T02:31:04.277492+0000 mgr.a (mgr.14388) 858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:31:05.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:05 smithi027 bash[22610]: cephadm 2024-08-31T02:31:04.278795+0000 mgr.a (mgr.14388) 859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:31:06.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:05 smithi191 bash[24992]: audit 2024-08-31T02:31:04.277492+0000 mgr.a (mgr.14388) 858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:31:06.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:05 smithi191 bash[24992]: cephadm 2024-08-31T02:31:04.278795+0000 mgr.a (mgr.14388) 859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:31:06.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:05 smithi163 bash[24253]: audit 2024-08-31T02:31:04.277492+0000 mgr.a (mgr.14388) 858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:31:06.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:05 smithi163 bash[24253]: cephadm 2024-08-31T02:31:04.278795+0000 mgr.a (mgr.14388) 859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:31:06.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:06 smithi027 bash[22610]: cluster 2024-08-31T02:31:05.406217+0000 mgr.a (mgr.14388) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:31:07.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:06 smithi191 bash[24992]: cluster 2024-08-31T02:31:05.406217+0000 mgr.a (mgr.14388) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:31:07.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:06 smithi163 bash[24253]: cluster 2024-08-31T02:31:05.406217+0000 mgr.a (mgr.14388) 860 : cluster [DBG] pgmap v594: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:31:07.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:07.951 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:07.951 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:31:08.700 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:31:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:31:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:31:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:31:08.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:31:08.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:08 smithi027 bash[22610]: cluster 2024-08-31T02:31:07.407010+0000 mgr.a (mgr.14388) 861 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:31:09.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:08 smithi191 bash[24992]: cluster 2024-08-31T02:31:07.407010+0000 mgr.a (mgr.14388) 861 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:31:09.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:08 smithi163 bash[24253]: cluster 2024-08-31T02:31:07.407010+0000 mgr.a (mgr.14388) 861 : cluster [DBG] pgmap v595: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:31:09.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:09 smithi027 bash[22610]: audit 2024-08-31T02:31:08.292744+0000 mgr.a (mgr.14388) 862 : audit [DBG] from='client.31998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:10.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:09 smithi191 bash[24992]: audit 2024-08-31T02:31:08.292744+0000 mgr.a (mgr.14388) 862 : audit [DBG] from='client.31998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:10.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:09 smithi163 bash[24253]: audit 2024-08-31T02:31:08.292744+0000 mgr.a (mgr.14388) 862 : audit [DBG] from='client.31998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:10.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:10 smithi027 bash[22610]: cluster 2024-08-31T02:31:09.409808+0000 mgr.a (mgr.14388) 863 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:31:11.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:10 smithi191 bash[24992]: cluster 2024-08-31T02:31:09.409808+0000 mgr.a (mgr.14388) 863 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:31:11.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:10 smithi163 bash[24253]: cluster 2024-08-31T02:31:09.409808+0000 mgr.a (mgr.14388) 863 : cluster [DBG] pgmap v596: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:31:12.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:12 smithi027 bash[22610]: cluster 2024-08-31T02:31:11.410585+0000 mgr.a (mgr.14388) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:31:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:12 smithi191 bash[24992]: cluster 2024-08-31T02:31:11.410585+0000 mgr.a (mgr.14388) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:31:13.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:12 smithi163 bash[24253]: cluster 2024-08-31T02:31:11.410585+0000 mgr.a (mgr.14388) 864 : cluster [DBG] pgmap v597: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:31:13.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:13.703 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:13.703 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:31:14.486 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:31:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:31:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:31:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:31:14.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:31:14.977 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:14 smithi027 bash[22610]: cluster 2024-08-31T02:31:13.412476+0000 mgr.a (mgr.14388) 865 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:31:15.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:14 smithi191 bash[24992]: cluster 2024-08-31T02:31:13.412476+0000 mgr.a (mgr.14388) 865 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:31:15.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:14 smithi163 bash[24253]: cluster 2024-08-31T02:31:13.412476+0000 mgr.a (mgr.14388) 865 : cluster [DBG] pgmap v598: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:31:16.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:15 smithi191 bash[24992]: audit 2024-08-31T02:31:14.048987+0000 mgr.a (mgr.14388) 866 : audit [DBG] from='client.32073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:16.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:15 smithi163 bash[24253]: audit 2024-08-31T02:31:14.048987+0000 mgr.a (mgr.14388) 866 : audit [DBG] from='client.32073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:16.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:15 smithi027 bash[22610]: audit 2024-08-31T02:31:14.048987+0000 mgr.a (mgr.14388) 866 : audit [DBG] from='client.32073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:17.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:16 smithi191 bash[24992]: cluster 2024-08-31T02:31:15.413553+0000 mgr.a (mgr.14388) 867 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:31:17.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:16 smithi163 bash[24253]: cluster 2024-08-31T02:31:15.413553+0000 mgr.a (mgr.14388) 867 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:31:17.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:16 smithi027 bash[22610]: cluster 2024-08-31T02:31:15.413553+0000 mgr.a (mgr.14388) 867 : cluster [DBG] pgmap v599: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:31:19.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:18 smithi191 bash[24992]: cluster 2024-08-31T02:31:17.414383+0000 mgr.a (mgr.14388) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:31:19.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:18 smithi163 bash[24253]: cluster 2024-08-31T02:31:17.414383+0000 mgr.a (mgr.14388) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:31:19.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:18 smithi027 bash[22610]: cluster 2024-08-31T02:31:17.414383+0000 mgr.a (mgr.14388) 868 : cluster [DBG] pgmap v600: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:31:19.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:19.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:19.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:31:20.251 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:31:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:31:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:31:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:31:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:31:21.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:20 smithi191 bash[24992]: cluster 2024-08-31T02:31:19.416649+0000 mgr.a (mgr.14388) 869 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:31:21.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:20 smithi191 bash[24992]: audit 2024-08-31T02:31:19.828339+0000 mgr.a (mgr.14388) 870 : audit [DBG] from='client.32148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:21.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:20 smithi163 bash[24253]: cluster 2024-08-31T02:31:19.416649+0000 mgr.a (mgr.14388) 869 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:31:21.248 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:20 smithi163 bash[24253]: audit 2024-08-31T02:31:19.828339+0000 mgr.a (mgr.14388) 870 : audit [DBG] from='client.32148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:21.249 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:20 smithi027 bash[22610]: cluster 2024-08-31T02:31:19.416649+0000 mgr.a (mgr.14388) 869 : cluster [DBG] pgmap v601: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:31:21.249 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:20 smithi027 bash[22610]: audit 2024-08-31T02:31:19.828339+0000 mgr.a (mgr.14388) 870 : audit [DBG] from='client.32148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:23.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:22 smithi191 bash[24992]: cluster 2024-08-31T02:31:21.417660+0000 mgr.a (mgr.14388) 871 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:23.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:22 smithi163 bash[24253]: cluster 2024-08-31T02:31:21.417660+0000 mgr.a (mgr.14388) 871 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:23.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:22 smithi027 bash[22610]: cluster 2024-08-31T02:31:21.417660+0000 mgr.a (mgr.14388) 871 : cluster [DBG] pgmap v602: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:25.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:24 smithi191 bash[24992]: cluster 2024-08-31T02:31:23.419844+0000 mgr.a (mgr.14388) 872 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:25.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:24 smithi163 bash[24253]: cluster 2024-08-31T02:31:23.419844+0000 mgr.a (mgr.14388) 872 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:25.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:24 smithi027 bash[22610]: cluster 2024-08-31T02:31:23.419844+0000 mgr.a (mgr.14388) 872 : cluster [DBG] pgmap v603: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:25.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:25.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:31:26.015 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:31:26.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:31:26.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:31:26.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:31:26.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:31:27.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:26 smithi191 bash[24992]: cluster 2024-08-31T02:31:25.420290+0000 mgr.a (mgr.14388) 873 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:27.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:26 smithi191 bash[24992]: audit 2024-08-31T02:31:25.593930+0000 mgr.a (mgr.14388) 874 : audit [DBG] from='client.32223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:27.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:26 smithi163 bash[24253]: cluster 2024-08-31T02:31:25.420290+0000 mgr.a (mgr.14388) 873 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:27.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:26 smithi163 bash[24253]: audit 2024-08-31T02:31:25.593930+0000 mgr.a (mgr.14388) 874 : audit [DBG] from='client.32223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:27.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:26 smithi027 bash[22610]: cluster 2024-08-31T02:31:25.420290+0000 mgr.a (mgr.14388) 873 : cluster [DBG] pgmap v604: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:27.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:26 smithi027 bash[22610]: audit 2024-08-31T02:31:25.593930+0000 mgr.a (mgr.14388) 874 : audit [DBG] from='client.32223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:29.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:28 smithi191 bash[24992]: cluster 2024-08-31T02:31:27.421241+0000 mgr.a (mgr.14388) 875 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:29.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:28 smithi163 bash[24253]: cluster 2024-08-31T02:31:27.421241+0000 mgr.a (mgr.14388) 875 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:29.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:28 smithi027 bash[22610]: cluster 2024-08-31T02:31:27.421241+0000 mgr.a (mgr.14388) 875 : cluster [DBG] pgmap v605: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:31.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:31.018 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:31:31.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:30 smithi191 bash[24992]: cluster 2024-08-31T02:31:29.423532+0000 mgr.a (mgr.14388) 876 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:31.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:30 smithi163 bash[24253]: cluster 2024-08-31T02:31:29.423532+0000 mgr.a (mgr.14388) 876 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:31.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:30 smithi027 bash[22610]: cluster 2024-08-31T02:31:29.423532+0000 mgr.a (mgr.14388) 876 : cluster [DBG] pgmap v606: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:31.791 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:31:31.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:31:31.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:31:31.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:31:31.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:31:33.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:32 smithi191 bash[24992]: audit 2024-08-31T02:31:31.361718+0000 mgr.a (mgr.14388) 877 : audit [DBG] from='client.32295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:33.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:32 smithi191 bash[24992]: cluster 2024-08-31T02:31:31.424137+0000 mgr.a (mgr.14388) 878 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:33.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:32 smithi163 bash[24253]: audit 2024-08-31T02:31:31.361718+0000 mgr.a (mgr.14388) 877 : audit [DBG] from='client.32295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:33.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:32 smithi163 bash[24253]: cluster 2024-08-31T02:31:31.424137+0000 mgr.a (mgr.14388) 878 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:33.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:32 smithi027 bash[22610]: audit 2024-08-31T02:31:31.361718+0000 mgr.a (mgr.14388) 877 : audit [DBG] from='client.32295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:33.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:32 smithi027 bash[22610]: cluster 2024-08-31T02:31:31.424137+0000 mgr.a (mgr.14388) 878 : cluster [DBG] pgmap v607: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:35.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:34 smithi191 bash[24992]: cluster 2024-08-31T02:31:33.426354+0000 mgr.a (mgr.14388) 879 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:35.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:34 smithi163 bash[24253]: cluster 2024-08-31T02:31:33.426354+0000 mgr.a (mgr.14388) 879 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:35.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:34 smithi027 bash[22610]: cluster 2024-08-31T02:31:33.426354+0000 mgr.a (mgr.14388) 879 : cluster [DBG] pgmap v608: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:36.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:36.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:36.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:31:37.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:36 smithi163 bash[24253]: cluster 2024-08-31T02:31:35.427158+0000 mgr.a (mgr.14388) 880 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:37.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:36 smithi027 bash[22610]: cluster 2024-08-31T02:31:35.427158+0000 mgr.a (mgr.14388) 880 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:37.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:36 smithi191 bash[24992]: cluster 2024-08-31T02:31:35.427158+0000 mgr.a (mgr.14388) 880 : cluster [DBG] pgmap v609: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:37.563 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:31:37.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:31:37.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:31:37.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:31:37.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:31:39.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:38 smithi163 bash[24253]: audit 2024-08-31T02:31:37.134372+0000 mgr.a (mgr.14388) 881 : audit [DBG] from='client.32373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:39.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:38 smithi163 bash[24253]: cluster 2024-08-31T02:31:37.427739+0000 mgr.a (mgr.14388) 882 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:39.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:38 smithi027 bash[22610]: audit 2024-08-31T02:31:37.134372+0000 mgr.a (mgr.14388) 881 : audit [DBG] from='client.32373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:39.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:38 smithi027 bash[22610]: cluster 2024-08-31T02:31:37.427739+0000 mgr.a (mgr.14388) 882 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:39.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:38 smithi191 bash[24992]: audit 2024-08-31T02:31:37.134372+0000 mgr.a (mgr.14388) 881 : audit [DBG] from='client.32373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:39.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:38 smithi191 bash[24992]: cluster 2024-08-31T02:31:37.427739+0000 mgr.a (mgr.14388) 882 : cluster [DBG] pgmap v610: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:41.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:40 smithi163 bash[24253]: cluster 2024-08-31T02:31:39.430063+0000 mgr.a (mgr.14388) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:41.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:40 smithi027 bash[22610]: cluster 2024-08-31T02:31:39.430063+0000 mgr.a (mgr.14388) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:41.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:40 smithi191 bash[24992]: cluster 2024-08-31T02:31:39.430063+0000 mgr.a (mgr.14388) 883 : cluster [DBG] pgmap v611: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:31:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:31:43.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:42 smithi163 bash[24253]: cluster 2024-08-31T02:31:41.430855+0000 mgr.a (mgr.14388) 884 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:43.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:42 smithi027 bash[22610]: cluster 2024-08-31T02:31:41.430855+0000 mgr.a (mgr.14388) 884 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:43.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:42 smithi191 bash[24992]: cluster 2024-08-31T02:31:41.430855+0000 mgr.a (mgr.14388) 884 : cluster [DBG] pgmap v612: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:43.312 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:31:43.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:31:43.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:31:43.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:31:43.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:31:44.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:43 smithi163 bash[24253]: audit 2024-08-31T02:31:42.900875+0000 mgr.a (mgr.14388) 885 : audit [DBG] from='client.32448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:44.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:43 smithi027 bash[22610]: audit 2024-08-31T02:31:42.900875+0000 mgr.a (mgr.14388) 885 : audit [DBG] from='client.32448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:44.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:43 smithi191 bash[24992]: audit 2024-08-31T02:31:42.900875+0000 mgr.a (mgr.14388) 885 : audit [DBG] from='client.32448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:45.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:44 smithi163 bash[24253]: cluster 2024-08-31T02:31:43.433587+0000 mgr.a (mgr.14388) 886 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:45.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:44 smithi027 bash[22610]: cluster 2024-08-31T02:31:43.433587+0000 mgr.a (mgr.14388) 886 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:45.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:44 smithi191 bash[24992]: cluster 2024-08-31T02:31:43.433587+0000 mgr.a (mgr.14388) 886 : cluster [DBG] pgmap v613: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:47.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:46 smithi163 bash[24253]: cluster 2024-08-31T02:31:45.434399+0000 mgr.a (mgr.14388) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:31:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:46 smithi027 bash[22610]: cluster 2024-08-31T02:31:45.434399+0000 mgr.a (mgr.14388) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:31:47.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:46 smithi191 bash[24992]: cluster 2024-08-31T02:31:45.434399+0000 mgr.a (mgr.14388) 887 : cluster [DBG] pgmap v614: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:31:48.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:48.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:48.315 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:31:49.066 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:31:49.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:31:49.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:31:49.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:31:49.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:31:49.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:48 smithi163 bash[24253]: cluster 2024-08-31T02:31:47.435210+0000 mgr.a (mgr.14388) 888 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:31:49.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:48 smithi027 bash[22610]: cluster 2024-08-31T02:31:47.435210+0000 mgr.a (mgr.14388) 888 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:31:49.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:48 smithi191 bash[24992]: cluster 2024-08-31T02:31:47.435210+0000 mgr.a (mgr.14388) 888 : cluster [DBG] pgmap v615: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:31:50.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:49 smithi163 bash[24253]: audit 2024-08-31T02:31:48.657528+0000 mgr.a (mgr.14388) 889 : audit [DBG] from='client.32526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:50.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:49 smithi027 bash[22610]: audit 2024-08-31T02:31:48.657528+0000 mgr.a (mgr.14388) 889 : audit [DBG] from='client.32526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:49 smithi191 bash[24992]: audit 2024-08-31T02:31:48.657528+0000 mgr.a (mgr.14388) 889 : audit [DBG] from='client.32526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:51.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:50 smithi163 bash[24253]: cluster 2024-08-31T02:31:49.437883+0000 mgr.a (mgr.14388) 890 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:51.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:50 smithi027 bash[22610]: cluster 2024-08-31T02:31:49.437883+0000 mgr.a (mgr.14388) 890 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:51.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:50 smithi191 bash[24992]: cluster 2024-08-31T02:31:49.437883+0000 mgr.a (mgr.14388) 890 : cluster [DBG] pgmap v616: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:53.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:52 smithi163 bash[24253]: cluster 2024-08-31T02:31:51.438672+0000 mgr.a (mgr.14388) 891 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:31:53.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:52 smithi027 bash[22610]: cluster 2024-08-31T02:31:51.438672+0000 mgr.a (mgr.14388) 891 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:31:53.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:52 smithi191 bash[24992]: cluster 2024-08-31T02:31:51.438672+0000 mgr.a (mgr.14388) 891 : cluster [DBG] pgmap v617: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:31:54.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:54.068 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:54.068 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:31:54.837 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:31:54.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:31:54.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:31:54.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:31:54.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:31:55.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:54 smithi163 bash[24253]: cluster 2024-08-31T02:31:53.440588+0000 mgr.a (mgr.14388) 892 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:55.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:54 smithi027 bash[22610]: cluster 2024-08-31T02:31:53.440588+0000 mgr.a (mgr.14388) 892 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:55.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:54 smithi191 bash[24992]: cluster 2024-08-31T02:31:53.440588+0000 mgr.a (mgr.14388) 892 : cluster [DBG] pgmap v618: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:56.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:55 smithi163 bash[24253]: audit 2024-08-31T02:31:54.409665+0000 mgr.a (mgr.14388) 893 : audit [DBG] from='client.32604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:56.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:55 smithi027 bash[22610]: audit 2024-08-31T02:31:54.409665+0000 mgr.a (mgr.14388) 893 : audit [DBG] from='client.32604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:56.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:55 smithi191 bash[24992]: audit 2024-08-31T02:31:54.409665+0000 mgr.a (mgr.14388) 893 : audit [DBG] from='client.32604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:31:57.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:56 smithi163 bash[24253]: cluster 2024-08-31T02:31:55.441504+0000 mgr.a (mgr.14388) 894 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:57.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:56 smithi027 bash[22610]: cluster 2024-08-31T02:31:55.441504+0000 mgr.a (mgr.14388) 894 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:57.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:56 smithi191 bash[24992]: cluster 2024-08-31T02:31:55.441504+0000 mgr.a (mgr.14388) 894 : cluster [DBG] pgmap v619: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:59.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:31:58 smithi163 bash[24253]: cluster 2024-08-31T02:31:57.442244+0000 mgr.a (mgr.14388) 895 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:59.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:31:58 smithi027 bash[22610]: cluster 2024-08-31T02:31:57.442244+0000 mgr.a (mgr.14388) 895 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:59.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:31:58 smithi191 bash[24992]: cluster 2024-08-31T02:31:57.442244+0000 mgr.a (mgr.14388) 895 : cluster [DBG] pgmap v620: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:31:59.839 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:31:59.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:31:59.840 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:00.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:00.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:00.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:00.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:00.584 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:01.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:00 smithi163 bash[24253]: cluster 2024-08-31T02:31:59.444411+0000 mgr.a (mgr.14388) 896 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:01.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:00 smithi027 bash[22610]: cluster 2024-08-31T02:31:59.444411+0000 mgr.a (mgr.14388) 896 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:01.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:00 smithi191 bash[24992]: cluster 2024-08-31T02:31:59.444411+0000 mgr.a (mgr.14388) 896 : cluster [DBG] pgmap v621: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:02.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:01 smithi163 bash[24253]: audit 2024-08-31T02:32:00.175979+0000 mgr.a (mgr.14388) 897 : audit [DBG] from='client.32682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:02.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:01 smithi027 bash[22610]: audit 2024-08-31T02:32:00.175979+0000 mgr.a (mgr.14388) 897 : audit [DBG] from='client.32682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:02.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:01 smithi191 bash[24992]: audit 2024-08-31T02:32:00.175979+0000 mgr.a (mgr.14388) 897 : audit [DBG] from='client.32682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:03.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:02 smithi163 bash[24253]: cluster 2024-08-31T02:32:01.445427+0000 mgr.a (mgr.14388) 898 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:03.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:02 smithi027 bash[22610]: cluster 2024-08-31T02:32:01.445427+0000 mgr.a (mgr.14388) 898 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:03.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:02 smithi191 bash[24992]: cluster 2024-08-31T02:32:01.445427+0000 mgr.a (mgr.14388) 898 : cluster [DBG] pgmap v622: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:05.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:04 smithi163 bash[24253]: cluster 2024-08-31T02:32:03.447756+0000 mgr.a (mgr.14388) 899 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:05.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:04 smithi163 bash[24253]: audit 2024-08-31T02:32:04.328871+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:32:05.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:04 smithi027 bash[22610]: cluster 2024-08-31T02:32:03.447756+0000 mgr.a (mgr.14388) 899 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:05.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:04 smithi027 bash[22610]: audit 2024-08-31T02:32:04.328871+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:32:05.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:04 smithi191 bash[24992]: cluster 2024-08-31T02:32:03.447756+0000 mgr.a (mgr.14388) 899 : cluster [DBG] pgmap v623: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:05.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:04 smithi191 bash[24992]: audit 2024-08-31T02:32:04.328871+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:32:05.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:32:05.585 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:32:05.585 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:06.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:05 smithi163 bash[24253]: audit 2024-08-31T02:32:05.177482+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:32:06.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:05 smithi163 bash[24253]: audit 2024-08-31T02:32:05.179114+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:32:06.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:05 smithi163 bash[24253]: audit 2024-08-31T02:32:05.189252+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:32:06.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:05 smithi163 bash[24253]: audit 2024-08-31T02:32:05.194145+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:32:06.227 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:32:05 smithi027 bash[22863]: debug 2024-08-31T02:32:05.884+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:32:06.227 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:32:05 smithi027 bash[22863]: debug 2024-08-31T02:32:05.888+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:32:06.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:05 smithi027 bash[22610]: audit 2024-08-31T02:32:05.177482+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:32:06.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:05 smithi027 bash[22610]: audit 2024-08-31T02:32:05.179114+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:32:06.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:05 smithi027 bash[22610]: audit 2024-08-31T02:32:05.189252+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:32:06.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:05 smithi027 bash[22610]: audit 2024-08-31T02:32:05.194145+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:32:06.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:05 smithi191 bash[24992]: audit 2024-08-31T02:32:05.177482+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:32:06.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:05 smithi191 bash[24992]: audit 2024-08-31T02:32:05.179114+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:32:06.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:05 smithi191 bash[24992]: audit 2024-08-31T02:32:05.189252+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:32:06.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:05 smithi191 bash[24992]: audit 2024-08-31T02:32:05.194145+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:32:06.305 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:06.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:06.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:06.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:06.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:07.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:06 smithi163 bash[24253]: audit 2024-08-31T02:32:05.196433+0000 mgr.a (mgr.14388) 900 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:32:07.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:06 smithi163 bash[24253]: cluster 2024-08-31T02:32:05.448307+0000 mgr.a (mgr.14388) 901 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:07.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:06 smithi163 bash[24253]: audit 2024-08-31T02:32:05.890650+0000 mgr.a (mgr.14388) 902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:32:07.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:06 smithi163 bash[24253]: cephadm 2024-08-31T02:32:05.891898+0000 mgr.a (mgr.14388) 903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:32:07.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:06 smithi163 bash[24253]: audit 2024-08-31T02:32:05.926584+0000 mgr.a (mgr.14388) 904 : audit [DBG] from='client.32850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:07.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:06 smithi027 bash[22610]: audit 2024-08-31T02:32:05.196433+0000 mgr.a (mgr.14388) 900 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:32:07.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:06 smithi027 bash[22610]: cluster 2024-08-31T02:32:05.448307+0000 mgr.a (mgr.14388) 901 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:07.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:06 smithi027 bash[22610]: audit 2024-08-31T02:32:05.890650+0000 mgr.a (mgr.14388) 902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:32:07.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:06 smithi027 bash[22610]: cephadm 2024-08-31T02:32:05.891898+0000 mgr.a (mgr.14388) 903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:32:07.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:06 smithi027 bash[22610]: audit 2024-08-31T02:32:05.926584+0000 mgr.a (mgr.14388) 904 : audit [DBG] from='client.32850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:07.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:06 smithi191 bash[24992]: audit 2024-08-31T02:32:05.196433+0000 mgr.a (mgr.14388) 900 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:32:07.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:06 smithi191 bash[24992]: cluster 2024-08-31T02:32:05.448307+0000 mgr.a (mgr.14388) 901 : cluster [DBG] pgmap v624: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:07.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:06 smithi191 bash[24992]: audit 2024-08-31T02:32:05.890650+0000 mgr.a (mgr.14388) 902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:32:07.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:06 smithi191 bash[24992]: cephadm 2024-08-31T02:32:05.891898+0000 mgr.a (mgr.14388) 903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:32:07.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:06 smithi191 bash[24992]: audit 2024-08-31T02:32:05.926584+0000 mgr.a (mgr.14388) 904 : audit [DBG] from='client.32850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:09.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:08 smithi163 bash[24253]: cluster 2024-08-31T02:32:07.449171+0000 mgr.a (mgr.14388) 905 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:09.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:08 smithi027 bash[22610]: cluster 2024-08-31T02:32:07.449171+0000 mgr.a (mgr.14388) 905 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:09.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:08 smithi191 bash[24992]: cluster 2024-08-31T02:32:07.449171+0000 mgr.a (mgr.14388) 905 : cluster [DBG] pgmap v625: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:11.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:10 smithi163 bash[24253]: cluster 2024-08-31T02:32:09.451409+0000 mgr.a (mgr.14388) 906 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:10 smithi027 bash[22610]: cluster 2024-08-31T02:32:09.451409+0000 mgr.a (mgr.14388) 906 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:11.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:10 smithi191 bash[24992]: cluster 2024-08-31T02:32:09.451409+0000 mgr.a (mgr.14388) 906 : cluster [DBG] pgmap v626: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:11.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:32:11.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:32:11.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:12.054 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:12.054 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:12.054 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:12.054 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:12.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:13.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:12 smithi163 bash[24253]: cluster 2024-08-31T02:32:11.451952+0000 mgr.a (mgr.14388) 907 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:13.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:12 smithi163 bash[24253]: audit 2024-08-31T02:32:11.645522+0000 mgr.a (mgr.14388) 908 : audit [DBG] from='client.32946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:13.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:12 smithi027 bash[22610]: cluster 2024-08-31T02:32:11.451952+0000 mgr.a (mgr.14388) 907 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:13.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:12 smithi027 bash[22610]: audit 2024-08-31T02:32:11.645522+0000 mgr.a (mgr.14388) 908 : audit [DBG] from='client.32946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:13.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:12 smithi191 bash[24992]: cluster 2024-08-31T02:32:11.451952+0000 mgr.a (mgr.14388) 907 : cluster [DBG] pgmap v627: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:13.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:12 smithi191 bash[24992]: audit 2024-08-31T02:32:11.645522+0000 mgr.a (mgr.14388) 908 : audit [DBG] from='client.32946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:15.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:14 smithi163 bash[24253]: cluster 2024-08-31T02:32:13.454178+0000 mgr.a (mgr.14388) 909 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:15.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:14 smithi027 bash[22610]: cluster 2024-08-31T02:32:13.454178+0000 mgr.a (mgr.14388) 909 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:15.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:14 smithi191 bash[24992]: cluster 2024-08-31T02:32:13.454178+0000 mgr.a (mgr.14388) 909 : cluster [DBG] pgmap v628: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:17.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:32:17.056 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:32:17.056 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:17.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:16 smithi163 bash[24253]: cluster 2024-08-31T02:32:15.454974+0000 mgr.a (mgr.14388) 910 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:17.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:16 smithi027 bash[22610]: cluster 2024-08-31T02:32:15.454974+0000 mgr.a (mgr.14388) 910 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:17.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:16 smithi191 bash[24992]: cluster 2024-08-31T02:32:15.454974+0000 mgr.a (mgr.14388) 910 : cluster [DBG] pgmap v629: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:17.808 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:17.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:17.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:17.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:17.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:19.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:18 smithi163 bash[24253]: audit 2024-08-31T02:32:17.397176+0000 mgr.a (mgr.14388) 911 : audit [DBG] from='client.33021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:19.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:18 smithi163 bash[24253]: cluster 2024-08-31T02:32:17.455472+0000 mgr.a (mgr.14388) 912 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:19.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:18 smithi027 bash[22610]: audit 2024-08-31T02:32:17.397176+0000 mgr.a (mgr.14388) 911 : audit [DBG] from='client.33021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:19.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:18 smithi027 bash[22610]: cluster 2024-08-31T02:32:17.455472+0000 mgr.a (mgr.14388) 912 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:19.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:18 smithi191 bash[24992]: audit 2024-08-31T02:32:17.397176+0000 mgr.a (mgr.14388) 911 : audit [DBG] from='client.33021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:19.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:18 smithi191 bash[24992]: cluster 2024-08-31T02:32:17.455472+0000 mgr.a (mgr.14388) 912 : cluster [DBG] pgmap v630: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:21.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:20 smithi163 bash[24253]: cluster 2024-08-31T02:32:19.457702+0000 mgr.a (mgr.14388) 913 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:21.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:20 smithi027 bash[22610]: cluster 2024-08-31T02:32:19.457702+0000 mgr.a (mgr.14388) 913 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:21.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:20 smithi191 bash[24992]: cluster 2024-08-31T02:32:19.457702+0000 mgr.a (mgr.14388) 913 : cluster [DBG] pgmap v631: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:32:22.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:32:22.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:32:22.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:23.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:22 smithi163 bash[24253]: cluster 2024-08-31T02:32:21.458486+0000 mgr.a (mgr.14388) 914 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:23.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:22 smithi027 bash[22610]: cluster 2024-08-31T02:32:21.458486+0000 mgr.a (mgr.14388) 914 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:23.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:22 smithi191 bash[24992]: cluster 2024-08-31T02:32:21.458486+0000 mgr.a (mgr.14388) 914 : cluster [DBG] pgmap v632: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:23.578 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:23.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:23.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:23.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:23.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:25.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:24 smithi163 bash[24253]: audit 2024-08-31T02:32:23.150964+0000 mgr.a (mgr.14388) 915 : audit [DBG] from='client.33099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:25.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:24 smithi163 bash[24253]: cluster 2024-08-31T02:32:23.459705+0000 mgr.a (mgr.14388) 916 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-08-31T02:32:25.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:24 smithi027 bash[22610]: audit 2024-08-31T02:32:23.150964+0000 mgr.a (mgr.14388) 915 : audit [DBG] from='client.33099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:25.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:24 smithi027 bash[22610]: cluster 2024-08-31T02:32:23.459705+0000 mgr.a (mgr.14388) 916 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-08-31T02:32:25.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:24 smithi191 bash[24992]: audit 2024-08-31T02:32:23.150964+0000 mgr.a (mgr.14388) 915 : audit [DBG] from='client.33099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:25.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:24 smithi191 bash[24992]: cluster 2024-08-31T02:32:23.459705+0000 mgr.a (mgr.14388) 916 : cluster [DBG] pgmap v633: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-08-31T02:32:27.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:26 smithi163 bash[24253]: cluster 2024-08-31T02:32:25.460542+0000 mgr.a (mgr.14388) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 98 op/s 2024-08-31T02:32:27.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:26 smithi027 bash[22610]: cluster 2024-08-31T02:32:25.460542+0000 mgr.a (mgr.14388) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 98 op/s 2024-08-31T02:32:27.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:26 smithi191 bash[24992]: cluster 2024-08-31T02:32:25.460542+0000 mgr.a (mgr.14388) 917 : cluster [DBG] pgmap v634: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 98 op/s 2024-08-31T02:32:28.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:32:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:32:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:29.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:28 smithi163 bash[24253]: cluster 2024-08-31T02:32:27.461455+0000 mgr.a (mgr.14388) 918 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 98 op/s 2024-08-31T02:32:29.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:28 smithi027 bash[22610]: cluster 2024-08-31T02:32:27.461455+0000 mgr.a (mgr.14388) 918 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 98 op/s 2024-08-31T02:32:29.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:28 smithi191 bash[24992]: cluster 2024-08-31T02:32:27.461455+0000 mgr.a (mgr.14388) 918 : cluster [DBG] pgmap v635: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 98 op/s 2024-08-31T02:32:29.343 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:29.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:29.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:29.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:29.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:30.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:29 smithi163 bash[24253]: audit 2024-08-31T02:32:28.919284+0000 mgr.a (mgr.14388) 919 : audit [DBG] from='client.33177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:30.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:29 smithi027 bash[22610]: audit 2024-08-31T02:32:28.919284+0000 mgr.a (mgr.14388) 919 : audit [DBG] from='client.33177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:30.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:29 smithi191 bash[24992]: audit 2024-08-31T02:32:28.919284+0000 mgr.a (mgr.14388) 919 : audit [DBG] from='client.33177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:31.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:30 smithi163 bash[24253]: cluster 2024-08-31T02:32:29.464202+0000 mgr.a (mgr.14388) 920 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-08-31T02:32:31.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:30 smithi027 bash[22610]: cluster 2024-08-31T02:32:29.464202+0000 mgr.a (mgr.14388) 920 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-08-31T02:32:31.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:30 smithi191 bash[24992]: cluster 2024-08-31T02:32:29.464202+0000 mgr.a (mgr.14388) 920 : cluster [DBG] pgmap v636: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-08-31T02:32:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:32 smithi027 bash[22610]: cluster 2024-08-31T02:32:31.465172+0000 mgr.a (mgr.14388) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 98 op/s 2024-08-31T02:32:33.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:32 smithi191 bash[24992]: cluster 2024-08-31T02:32:31.465172+0000 mgr.a (mgr.14388) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 98 op/s 2024-08-31T02:32:33.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:32 smithi163 bash[24253]: cluster 2024-08-31T02:32:31.465172+0000 mgr.a (mgr.14388) 921 : cluster [DBG] pgmap v637: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 59 KiB/s rd, 0 B/s wr, 98 op/s 2024-08-31T02:32:34.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:32:34.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:32:34.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:35.119 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:35.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:35.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:35.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:35.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:35.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:34 smithi027 bash[22610]: cluster 2024-08-31T02:32:33.467120+0000 mgr.a (mgr.14388) 922 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-08-31T02:32:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:34 smithi191 bash[24992]: cluster 2024-08-31T02:32:33.467120+0000 mgr.a (mgr.14388) 922 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-08-31T02:32:35.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:34 smithi163 bash[24253]: cluster 2024-08-31T02:32:33.467120+0000 mgr.a (mgr.14388) 922 : cluster [DBG] pgmap v638: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 60 KiB/s rd, 0 B/s wr, 99 op/s 2024-08-31T02:32:36.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:35 smithi027 bash[22610]: audit 2024-08-31T02:32:34.684797+0000 mgr.a (mgr.14388) 923 : audit [DBG] from='client.33249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:36.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:35 smithi191 bash[24992]: audit 2024-08-31T02:32:34.684797+0000 mgr.a (mgr.14388) 923 : audit [DBG] from='client.33249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:36.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:35 smithi163 bash[24253]: audit 2024-08-31T02:32:34.684797+0000 mgr.a (mgr.14388) 923 : audit [DBG] from='client.33249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:37.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:36 smithi027 bash[22610]: cluster 2024-08-31T02:32:35.468012+0000 mgr.a (mgr.14388) 924 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:37.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:36 smithi191 bash[24992]: cluster 2024-08-31T02:32:35.468012+0000 mgr.a (mgr.14388) 924 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:37.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:36 smithi163 bash[24253]: cluster 2024-08-31T02:32:35.468012+0000 mgr.a (mgr.14388) 924 : cluster [DBG] pgmap v639: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:39.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:38 smithi027 bash[22610]: cluster 2024-08-31T02:32:37.468795+0000 mgr.a (mgr.14388) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:39.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:38 smithi191 bash[24992]: cluster 2024-08-31T02:32:37.468795+0000 mgr.a (mgr.14388) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:39.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:38 smithi163 bash[24253]: cluster 2024-08-31T02:32:37.468795+0000 mgr.a (mgr.14388) 925 : cluster [DBG] pgmap v640: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:40.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:32:40.121 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:32:40.121 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:40.886 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:40.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:40.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:40.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:40.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:41.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:40 smithi027 bash[22610]: cluster 2024-08-31T02:32:39.470971+0000 mgr.a (mgr.14388) 926 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:41.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:40 smithi191 bash[24992]: cluster 2024-08-31T02:32:39.470971+0000 mgr.a (mgr.14388) 926 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:41.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:40 smithi163 bash[24253]: cluster 2024-08-31T02:32:39.470971+0000 mgr.a (mgr.14388) 926 : cluster [DBG] pgmap v641: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:42.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:41 smithi191 bash[24992]: audit 2024-08-31T02:32:40.456131+0000 mgr.a (mgr.14388) 927 : audit [DBG] from='client.33324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:42.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:41 smithi163 bash[24253]: audit 2024-08-31T02:32:40.456131+0000 mgr.a (mgr.14388) 927 : audit [DBG] from='client.33324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:42.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:41 smithi027 bash[22610]: audit 2024-08-31T02:32:40.456131+0000 mgr.a (mgr.14388) 927 : audit [DBG] from='client.33324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:43.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:42 smithi191 bash[24992]: cluster 2024-08-31T02:32:41.472000+0000 mgr.a (mgr.14388) 928 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:43.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:42 smithi163 bash[24253]: cluster 2024-08-31T02:32:41.472000+0000 mgr.a (mgr.14388) 928 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:43.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:42 smithi027 bash[22610]: cluster 2024-08-31T02:32:41.472000+0000 mgr.a (mgr.14388) 928 : cluster [DBG] pgmap v642: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:45.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:44 smithi191 bash[24992]: cluster 2024-08-31T02:32:43.474302+0000 mgr.a (mgr.14388) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:45.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:44 smithi163 bash[24253]: cluster 2024-08-31T02:32:43.474302+0000 mgr.a (mgr.14388) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:45.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:44 smithi027 bash[22610]: cluster 2024-08-31T02:32:43.474302+0000 mgr.a (mgr.14388) 929 : cluster [DBG] pgmap v643: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:32:45.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:32:45.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:46.669 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:46.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:46.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:46.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:46.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:47.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:46 smithi191 bash[24992]: cluster 2024-08-31T02:32:45.475251+0000 mgr.a (mgr.14388) 930 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:47.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:46 smithi163 bash[24253]: cluster 2024-08-31T02:32:45.475251+0000 mgr.a (mgr.14388) 930 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:47.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:46 smithi027 bash[22610]: cluster 2024-08-31T02:32:45.475251+0000 mgr.a (mgr.14388) 930 : cluster [DBG] pgmap v644: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:48.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:48 smithi191 bash[24992]: audit 2024-08-31T02:32:46.234624+0000 mgr.a (mgr.14388) 931 : audit [DBG] from='client.33402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:48.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:48 smithi163 bash[24253]: audit 2024-08-31T02:32:46.234624+0000 mgr.a (mgr.14388) 931 : audit [DBG] from='client.33402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:48.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:48 smithi027 bash[22610]: audit 2024-08-31T02:32:46.234624+0000 mgr.a (mgr.14388) 931 : audit [DBG] from='client.33402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:49.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:49 smithi191 bash[24992]: cluster 2024-08-31T02:32:47.476158+0000 mgr.a (mgr.14388) 932 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:49.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:49 smithi163 bash[24253]: cluster 2024-08-31T02:32:47.476158+0000 mgr.a (mgr.14388) 932 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:49.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:49 smithi027 bash[22610]: cluster 2024-08-31T02:32:47.476158+0000 mgr.a (mgr.14388) 932 : cluster [DBG] pgmap v645: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:51.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:51 smithi191 bash[24992]: cluster 2024-08-31T02:32:49.478355+0000 mgr.a (mgr.14388) 933 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:51.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:51 smithi163 bash[24253]: cluster 2024-08-31T02:32:49.478355+0000 mgr.a (mgr.14388) 933 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:51.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:51 smithi027 bash[22610]: cluster 2024-08-31T02:32:49.478355+0000 mgr.a (mgr.14388) 933 : cluster [DBG] pgmap v646: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:51.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:32:51.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:32:51.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:52.413 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:53.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:53 smithi191 bash[24992]: cluster 2024-08-31T02:32:51.479120+0000 mgr.a (mgr.14388) 934 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:53.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:53 smithi191 bash[24992]: audit 2024-08-31T02:32:52.007868+0000 mgr.a (mgr.14388) 935 : audit [DBG] from='client.33480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:53.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:53 smithi163 bash[24253]: cluster 2024-08-31T02:32:51.479120+0000 mgr.a (mgr.14388) 934 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:53.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:53 smithi163 bash[24253]: audit 2024-08-31T02:32:52.007868+0000 mgr.a (mgr.14388) 935 : audit [DBG] from='client.33480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:53.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:53 smithi027 bash[22610]: cluster 2024-08-31T02:32:51.479120+0000 mgr.a (mgr.14388) 934 : cluster [DBG] pgmap v647: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:53.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:53 smithi027 bash[22610]: audit 2024-08-31T02:32:52.007868+0000 mgr.a (mgr.14388) 935 : audit [DBG] from='client.33480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:55.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:55 smithi191 bash[24992]: cluster 2024-08-31T02:32:53.481455+0000 mgr.a (mgr.14388) 936 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:55.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:55 smithi163 bash[24253]: cluster 2024-08-31T02:32:53.481455+0000 mgr.a (mgr.14388) 936 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:55.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:55 smithi027 bash[22610]: cluster 2024-08-31T02:32:53.481455+0000 mgr.a (mgr.14388) 936 : cluster [DBG] pgmap v648: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:32:57.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:57 smithi191 bash[24992]: cluster 2024-08-31T02:32:55.482251+0000 mgr.a (mgr.14388) 937 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:57.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:32:57.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:32:57.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:32:57.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:57 smithi163 bash[24253]: cluster 2024-08-31T02:32:55.482251+0000 mgr.a (mgr.14388) 937 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:57.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:57 smithi027 bash[22610]: cluster 2024-08-31T02:32:55.482251+0000 mgr.a (mgr.14388) 937 : cluster [DBG] pgmap v649: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:58.159 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:32:58.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:32:58.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:32:58.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:32:58.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:32:59.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:59 smithi191 bash[24992]: cluster 2024-08-31T02:32:57.482948+0000 mgr.a (mgr.14388) 938 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:59.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:32:59 smithi191 bash[24992]: audit 2024-08-31T02:32:57.750572+0000 mgr.a (mgr.14388) 939 : audit [DBG] from='client.33555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:59.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:59 smithi163 bash[24253]: cluster 2024-08-31T02:32:57.482948+0000 mgr.a (mgr.14388) 938 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:59.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:32:59 smithi163 bash[24253]: audit 2024-08-31T02:32:57.750572+0000 mgr.a (mgr.14388) 939 : audit [DBG] from='client.33555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:32:59.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:59 smithi027 bash[22610]: cluster 2024-08-31T02:32:57.482948+0000 mgr.a (mgr.14388) 938 : cluster [DBG] pgmap v650: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:32:59.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:32:59 smithi027 bash[22610]: audit 2024-08-31T02:32:57.750572+0000 mgr.a (mgr.14388) 939 : audit [DBG] from='client.33555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:01.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:01 smithi191 bash[24992]: cluster 2024-08-31T02:32:59.485593+0000 mgr.a (mgr.14388) 940 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:33:01.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:01 smithi163 bash[24253]: cluster 2024-08-31T02:32:59.485593+0000 mgr.a (mgr.14388) 940 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:33:01.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:01 smithi027 bash[22610]: cluster 2024-08-31T02:32:59.485593+0000 mgr.a (mgr.14388) 940 : cluster [DBG] pgmap v651: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:33:03.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:33:03.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:33:03.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:33:03.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:03 smithi191 bash[24992]: cluster 2024-08-31T02:33:01.486378+0000 mgr.a (mgr.14388) 941 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:33:03.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:03 smithi163 bash[24253]: cluster 2024-08-31T02:33:01.486378+0000 mgr.a (mgr.14388) 941 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:33:03.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:03 smithi027 bash[22610]: cluster 2024-08-31T02:33:01.486378+0000 mgr.a (mgr.14388) 941 : cluster [DBG] pgmap v652: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:33:03.935 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:33:03.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:33:03.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:33:03.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:33:03.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:33:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:05 smithi163 bash[24253]: cluster 2024-08-31T02:33:03.488275+0000 mgr.a (mgr.14388) 942 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:05 smithi163 bash[24253]: audit 2024-08-31T02:33:03.498939+0000 mgr.a (mgr.14388) 943 : audit [DBG] from='client.33633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:05.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:05 smithi027 bash[22610]: cluster 2024-08-31T02:33:03.488275+0000 mgr.a (mgr.14388) 942 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:05.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:05 smithi027 bash[22610]: audit 2024-08-31T02:33:03.498939+0000 mgr.a (mgr.14388) 943 : audit [DBG] from='client.33633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:05 smithi191 bash[24992]: cluster 2024-08-31T02:33:03.488275+0000 mgr.a (mgr.14388) 942 : cluster [DBG] pgmap v653: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:05.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:05 smithi191 bash[24992]: audit 2024-08-31T02:33:03.498939+0000 mgr.a (mgr.14388) 943 : audit [DBG] from='client.33633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:06.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:06 smithi027 bash[22610]: cluster 2024-08-31T02:33:05.489137+0000 mgr.a (mgr.14388) 944 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:33:06.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:06 smithi027 bash[22610]: audit 2024-08-31T02:33:05.953068+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:33:06.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:06 smithi191 bash[24992]: cluster 2024-08-31T02:33:05.489137+0000 mgr.a (mgr.14388) 944 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:33:06.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:06 smithi191 bash[24992]: audit 2024-08-31T02:33:05.953068+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:33:06.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:06 smithi163 bash[24253]: cluster 2024-08-31T02:33:05.489137+0000 mgr.a (mgr.14388) 944 : cluster [DBG] pgmap v654: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:33:06.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:06 smithi163 bash[24253]: audit 2024-08-31T02:33:05.953068+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:33:08.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:33:08.937 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:33:08.937 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:33:08.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:08 smithi163 bash[24253]: cluster 2024-08-31T02:33:07.489948+0000 mgr.a (mgr.14388) 945 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:33:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:08 smithi027 bash[22610]: cluster 2024-08-31T02:33:07.489948+0000 mgr.a (mgr.14388) 945 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:33:09.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:08 smithi191 bash[24992]: cluster 2024-08-31T02:33:07.489948+0000 mgr.a (mgr.14388) 945 : cluster [DBG] pgmap v655: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:33:09.699 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:33:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:33:09.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:33:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:33:09.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:33:10.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:10 smithi163 bash[24253]: audit 2024-08-31T02:33:09.277821+0000 mgr.a (mgr.14388) 946 : audit [DBG] from='client.33711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:10.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:10 smithi163 bash[24253]: cluster 2024-08-31T02:33:09.491220+0000 mgr.a (mgr.14388) 947 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:10.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:10 smithi027 bash[22610]: audit 2024-08-31T02:33:09.277821+0000 mgr.a (mgr.14388) 946 : audit [DBG] from='client.33711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:10.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:10 smithi027 bash[22610]: cluster 2024-08-31T02:33:09.491220+0000 mgr.a (mgr.14388) 947 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:11.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:10 smithi191 bash[24992]: audit 2024-08-31T02:33:09.277821+0000 mgr.a (mgr.14388) 946 : audit [DBG] from='client.33711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:11.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:10 smithi191 bash[24992]: cluster 2024-08-31T02:33:09.491220+0000 mgr.a (mgr.14388) 947 : cluster [DBG] pgmap v656: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: audit 2024-08-31T02:33:11.296975+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: audit 2024-08-31T02:33:11.300606+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: audit 2024-08-31T02:33:11.304086+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: audit 2024-08-31T02:33:11.309902+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: audit 2024-08-31T02:33:11.331227+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: audit 2024-08-31T02:33:11.337270+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: cluster 2024-08-31T02:33:11.491999+0000 mgr.a (mgr.14388) 948 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:33:12.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: audit 2024-08-31T02:33:12.048396+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:33:12.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: audit 2024-08-31T02:33:12.049711+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:33:12.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: audit 2024-08-31T02:33:12.056320+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:12 smithi163 bash[24253]: audit 2024-08-31T02:33:12.058892+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:33:12.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: audit 2024-08-31T02:33:11.296975+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: audit 2024-08-31T02:33:11.300606+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: audit 2024-08-31T02:33:11.304086+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: audit 2024-08-31T02:33:11.309902+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: audit 2024-08-31T02:33:11.331227+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: audit 2024-08-31T02:33:11.337270+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: cluster 2024-08-31T02:33:11.491999+0000 mgr.a (mgr.14388) 948 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:33:12.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: audit 2024-08-31T02:33:12.048396+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:33:12.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: audit 2024-08-31T02:33:12.049711+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:33:12.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: audit 2024-08-31T02:33:12.056320+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22610]: audit 2024-08-31T02:33:12.058892+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: audit 2024-08-31T02:33:11.296975+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: audit 2024-08-31T02:33:11.300606+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: audit 2024-08-31T02:33:11.304086+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: audit 2024-08-31T02:33:11.309902+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: audit 2024-08-31T02:33:11.331227+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: audit 2024-08-31T02:33:11.337270+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: cluster 2024-08-31T02:33:11.491999+0000 mgr.a (mgr.14388) 948 : cluster [DBG] pgmap v657: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: audit 2024-08-31T02:33:12.048396+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: audit 2024-08-31T02:33:12.049711+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: audit 2024-08-31T02:33:12.056320+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:33:12.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:12 smithi191 bash[24992]: audit 2024-08-31T02:33:12.058892+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:33:13.228 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22863]: debug 2024-08-31T02:33:12.766+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:33:13.229 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:33:12 smithi027 bash[22863]: debug 2024-08-31T02:33:12.766+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:33:13.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:13 smithi163 bash[24253]: audit 2024-08-31T02:33:12.061305+0000 mgr.a (mgr.14388) 949 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:33:13.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:13 smithi163 bash[24253]: audit 2024-08-31T02:33:12.769432+0000 mgr.a (mgr.14388) 950 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:33:13.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:13 smithi163 bash[24253]: cephadm 2024-08-31T02:33:12.770542+0000 mgr.a (mgr.14388) 951 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:33:13.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:13 smithi027 bash[22610]: audit 2024-08-31T02:33:12.061305+0000 mgr.a (mgr.14388) 949 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:33:13.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:13 smithi027 bash[22610]: audit 2024-08-31T02:33:12.769432+0000 mgr.a (mgr.14388) 950 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:33:13.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:13 smithi027 bash[22610]: cephadm 2024-08-31T02:33:12.770542+0000 mgr.a (mgr.14388) 951 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:33:13.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:13 smithi191 bash[24992]: audit 2024-08-31T02:33:12.061305+0000 mgr.a (mgr.14388) 949 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:33:13.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:13 smithi191 bash[24992]: audit 2024-08-31T02:33:12.769432+0000 mgr.a (mgr.14388) 950 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:33:13.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:13 smithi191 bash[24992]: cephadm 2024-08-31T02:33:12.770542+0000 mgr.a (mgr.14388) 951 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:33:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:14 smithi163 bash[24253]: cluster 2024-08-31T02:33:13.494272+0000 mgr.a (mgr.14388) 952 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:14.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:33:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:33:14.701 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:33:14.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:14 smithi027 bash[22610]: cluster 2024-08-31T02:33:13.494272+0000 mgr.a (mgr.14388) 952 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:14.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:14 smithi191 bash[24992]: cluster 2024-08-31T02:33:13.494272+0000 mgr.a (mgr.14388) 952 : cluster [DBG] pgmap v658: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:15.445 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:33:15.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:33:15.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:33:15.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:33:15.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:33:15.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:15 smithi163 bash[24253]: audit 2024-08-31T02:33:15.043393+0000 mgr.a (mgr.14388) 953 : audit [DBG] from='client.33891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:15.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:15 smithi027 bash[22610]: audit 2024-08-31T02:33:15.043393+0000 mgr.a (mgr.14388) 953 : audit [DBG] from='client.33891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:15.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:15 smithi191 bash[24992]: audit 2024-08-31T02:33:15.043393+0000 mgr.a (mgr.14388) 953 : audit [DBG] from='client.33891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:16.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:16 smithi163 bash[24253]: cluster 2024-08-31T02:33:15.494952+0000 mgr.a (mgr.14388) 954 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:16.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:16 smithi027 bash[22610]: cluster 2024-08-31T02:33:15.494952+0000 mgr.a (mgr.14388) 954 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:16.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:16 smithi191 bash[24992]: cluster 2024-08-31T02:33:15.494952+0000 mgr.a (mgr.14388) 954 : cluster [DBG] pgmap v659: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:18.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:18 smithi163 bash[24253]: cluster 2024-08-31T02:33:17.495648+0000 mgr.a (mgr.14388) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:18.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:18 smithi027 bash[22610]: cluster 2024-08-31T02:33:17.495648+0000 mgr.a (mgr.14388) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:19.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:18 smithi191 bash[24992]: cluster 2024-08-31T02:33:17.495648+0000 mgr.a (mgr.14388) 955 : cluster [DBG] pgmap v660: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:20.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:33:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:33:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:33:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:20 smithi163 bash[24253]: cluster 2024-08-31T02:33:19.497875+0000 mgr.a (mgr.14388) 956 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:20.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:20 smithi027 bash[22610]: cluster 2024-08-31T02:33:19.497875+0000 mgr.a (mgr.14388) 956 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:20 smithi191 bash[24992]: cluster 2024-08-31T02:33:19.497875+0000 mgr.a (mgr.14388) 956 : cluster [DBG] pgmap v661: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:21.219 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:33:21.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:33:21.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:33:21.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:33:21.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:33:21.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:21 smithi163 bash[24253]: audit 2024-08-31T02:33:20.790469+0000 mgr.a (mgr.14388) 957 : audit [DBG] from='client.33963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:21.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:21 smithi027 bash[22610]: audit 2024-08-31T02:33:20.790469+0000 mgr.a (mgr.14388) 957 : audit [DBG] from='client.33963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:22.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:21 smithi191 bash[24992]: audit 2024-08-31T02:33:20.790469+0000 mgr.a (mgr.14388) 957 : audit [DBG] from='client.33963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:22.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:22 smithi163 bash[24253]: cluster 2024-08-31T02:33:21.498828+0000 mgr.a (mgr.14388) 958 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:22.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:22 smithi027 bash[22610]: cluster 2024-08-31T02:33:21.498828+0000 mgr.a (mgr.14388) 958 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:23.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:22 smithi191 bash[24992]: cluster 2024-08-31T02:33:21.498828+0000 mgr.a (mgr.14388) 958 : cluster [DBG] pgmap v662: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:24.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:24 smithi163 bash[24253]: cluster 2024-08-31T02:33:23.501103+0000 mgr.a (mgr.14388) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:24.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:24 smithi027 bash[22610]: cluster 2024-08-31T02:33:23.501103+0000 mgr.a (mgr.14388) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:25.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:24 smithi191 bash[24992]: cluster 2024-08-31T02:33:23.501103+0000 mgr.a (mgr.14388) 959 : cluster [DBG] pgmap v663: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:33:26.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:33:26.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:33:26.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:33:26.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:26 smithi163 bash[24253]: cluster 2024-08-31T02:33:25.502029+0000 mgr.a (mgr.14388) 960 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:26.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:26 smithi027 bash[22610]: cluster 2024-08-31T02:33:25.502029+0000 mgr.a (mgr.14388) 960 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:27.000 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:33:27.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:33:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:26 smithi191 bash[24992]: cluster 2024-08-31T02:33:25.502029+0000 mgr.a (mgr.14388) 960 : cluster [DBG] pgmap v664: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:27.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:27 smithi163 bash[24253]: audit 2024-08-31T02:33:26.567740+0000 mgr.a (mgr.14388) 961 : audit [DBG] from='client.34041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:27.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:27 smithi027 bash[22610]: audit 2024-08-31T02:33:26.567740+0000 mgr.a (mgr.14388) 961 : audit [DBG] from='client.34041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:28.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:27 smithi191 bash[24992]: audit 2024-08-31T02:33:26.567740+0000 mgr.a (mgr.14388) 961 : audit [DBG] from='client.34041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:28.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:28 smithi163 bash[24253]: cluster 2024-08-31T02:33:27.503030+0000 mgr.a (mgr.14388) 962 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:28.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:28 smithi027 bash[22610]: cluster 2024-08-31T02:33:27.503030+0000 mgr.a (mgr.14388) 962 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:29.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:28 smithi191 bash[24992]: cluster 2024-08-31T02:33:27.503030+0000 mgr.a (mgr.14388) 962 : cluster [DBG] pgmap v665: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:30.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:30 smithi163 bash[24253]: cluster 2024-08-31T02:33:29.505263+0000 mgr.a (mgr.14388) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:33:30.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:30 smithi027 bash[22610]: cluster 2024-08-31T02:33:29.505263+0000 mgr.a (mgr.14388) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:33:31.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:30 smithi191 bash[24992]: cluster 2024-08-31T02:33:29.505263+0000 mgr.a (mgr.14388) 963 : cluster [DBG] pgmap v666: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:33:32.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:33:32.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:33:32.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:33:32.774 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:33:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:33:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:33:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:33:32.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:33:32.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:32 smithi163 bash[24253]: cluster 2024-08-31T02:33:31.506052+0000 mgr.a (mgr.14388) 964 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:32.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:32 smithi027 bash[22610]: cluster 2024-08-31T02:33:31.506052+0000 mgr.a (mgr.14388) 964 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:33.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:32 smithi191 bash[24992]: cluster 2024-08-31T02:33:31.506052+0000 mgr.a (mgr.14388) 964 : cluster [DBG] pgmap v667: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:33.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:33 smithi163 bash[24253]: audit 2024-08-31T02:33:32.344563+0000 mgr.a (mgr.14388) 965 : audit [DBG] from='client.34116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:33.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:33 smithi027 bash[22610]: audit 2024-08-31T02:33:32.344563+0000 mgr.a (mgr.14388) 965 : audit [DBG] from='client.34116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:34.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:33 smithi191 bash[24992]: audit 2024-08-31T02:33:32.344563+0000 mgr.a (mgr.14388) 965 : audit [DBG] from='client.34116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:34.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:34 smithi163 bash[24253]: cluster 2024-08-31T02:33:33.508499+0000 mgr.a (mgr.14388) 966 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:33:34.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:34 smithi027 bash[22610]: cluster 2024-08-31T02:33:33.508499+0000 mgr.a (mgr.14388) 966 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:33:35.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:34 smithi191 bash[24992]: cluster 2024-08-31T02:33:33.508499+0000 mgr.a (mgr.14388) 966 : cluster [DBG] pgmap v668: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:33:36.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:36 smithi163 bash[24253]: cluster 2024-08-31T02:33:35.509454+0000 mgr.a (mgr.14388) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:36.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:36 smithi027 bash[22610]: cluster 2024-08-31T02:33:35.509454+0000 mgr.a (mgr.14388) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:37.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:36 smithi191 bash[24992]: cluster 2024-08-31T02:33:35.509454+0000 mgr.a (mgr.14388) 967 : cluster [DBG] pgmap v669: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:37.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:33:37.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:33:37.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:33:38.543 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:33:38.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:33:38.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:33:38.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:33:38.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:33:38.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:38 smithi163 bash[24253]: cluster 2024-08-31T02:33:37.510366+0000 mgr.a (mgr.14388) 968 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:38.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:38 smithi027 bash[22610]: cluster 2024-08-31T02:33:37.510366+0000 mgr.a (mgr.14388) 968 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:38 smithi191 bash[24992]: cluster 2024-08-31T02:33:37.510366+0000 mgr.a (mgr.14388) 968 : cluster [DBG] pgmap v670: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:39.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:39 smithi163 bash[24253]: audit 2024-08-31T02:33:38.115404+0000 mgr.a (mgr.14388) 969 : audit [DBG] from='client.34191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:39.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:39 smithi027 bash[22610]: audit 2024-08-31T02:33:38.115404+0000 mgr.a (mgr.14388) 969 : audit [DBG] from='client.34191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:40.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:39 smithi191 bash[24992]: audit 2024-08-31T02:33:38.115404+0000 mgr.a (mgr.14388) 969 : audit [DBG] from='client.34191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:40.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:40 smithi163 bash[24253]: cluster 2024-08-31T02:33:39.513097+0000 mgr.a (mgr.14388) 970 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:40.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:40 smithi027 bash[22610]: cluster 2024-08-31T02:33:39.513097+0000 mgr.a (mgr.14388) 970 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:41.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:40 smithi191 bash[24992]: cluster 2024-08-31T02:33:39.513097+0000 mgr.a (mgr.14388) 970 : cluster [DBG] pgmap v671: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:42.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:42 smithi163 bash[24253]: cluster 2024-08-31T02:33:41.513863+0000 mgr.a (mgr.14388) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:33:42.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:42 smithi027 bash[22610]: cluster 2024-08-31T02:33:41.513863+0000 mgr.a (mgr.14388) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:33:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:42 smithi191 bash[24992]: cluster 2024-08-31T02:33:41.513863+0000 mgr.a (mgr.14388) 971 : cluster [DBG] pgmap v672: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:33:43.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:33:43.545 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:33:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:33:44.285 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:33:44.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:33:44.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:33:44.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:33:44.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:33:44.957 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:44 smithi163 bash[24253]: cluster 2024-08-31T02:33:43.515809+0000 mgr.a (mgr.14388) 972 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:45.058 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:44 smithi163 bash[24253]: audit 2024-08-31T02:33:43.880491+0000 mgr.a (mgr.14388) 973 : audit [DBG] from='client.34269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:45.059 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:44 smithi191 bash[24992]: cluster 2024-08-31T02:33:43.515809+0000 mgr.a (mgr.14388) 972 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:45.059 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:44 smithi191 bash[24992]: audit 2024-08-31T02:33:43.880491+0000 mgr.a (mgr.14388) 973 : audit [DBG] from='client.34269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:45.059 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:44 smithi027 bash[22610]: cluster 2024-08-31T02:33:43.515809+0000 mgr.a (mgr.14388) 972 : cluster [DBG] pgmap v673: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:45.059 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:44 smithi027 bash[22610]: audit 2024-08-31T02:33:43.880491+0000 mgr.a (mgr.14388) 973 : audit [DBG] from='client.34269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:46.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:46 smithi163 bash[24253]: cluster 2024-08-31T02:33:45.516755+0000 mgr.a (mgr.14388) 974 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:33:46.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:46 smithi027 bash[22610]: cluster 2024-08-31T02:33:45.516755+0000 mgr.a (mgr.14388) 974 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:33:47.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:46 smithi191 bash[24992]: cluster 2024-08-31T02:33:45.516755+0000 mgr.a (mgr.14388) 974 : cluster [DBG] pgmap v674: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:33:48.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:48 smithi163 bash[24253]: cluster 2024-08-31T02:33:47.517529+0000 mgr.a (mgr.14388) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:33:48.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:48 smithi027 bash[22610]: cluster 2024-08-31T02:33:47.517529+0000 mgr.a (mgr.14388) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:33:49.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:48 smithi191 bash[24992]: cluster 2024-08-31T02:33:47.517529+0000 mgr.a (mgr.14388) 975 : cluster [DBG] pgmap v675: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:33:49.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:33:49.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:33:49.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:33:50.035 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:33:50.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:33:50.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:33:50.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:33:50.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:33:50.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:50 smithi163 bash[24253]: cluster 2024-08-31T02:33:49.519695+0000 mgr.a (mgr.14388) 976 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:50.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:50 smithi163 bash[24253]: audit 2024-08-31T02:33:49.630611+0000 mgr.a (mgr.14388) 977 : audit [DBG] from='client.34347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:50.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:50 smithi027 bash[22610]: cluster 2024-08-31T02:33:49.519695+0000 mgr.a (mgr.14388) 976 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:50.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:50 smithi027 bash[22610]: audit 2024-08-31T02:33:49.630611+0000 mgr.a (mgr.14388) 977 : audit [DBG] from='client.34347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:51.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:50 smithi191 bash[24992]: cluster 2024-08-31T02:33:49.519695+0000 mgr.a (mgr.14388) 976 : cluster [DBG] pgmap v676: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:51.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:50 smithi191 bash[24992]: audit 2024-08-31T02:33:49.630611+0000 mgr.a (mgr.14388) 977 : audit [DBG] from='client.34347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:52.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:52 smithi163 bash[24253]: cluster 2024-08-31T02:33:51.520645+0000 mgr.a (mgr.14388) 978 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:52.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:52 smithi027 bash[22610]: cluster 2024-08-31T02:33:51.520645+0000 mgr.a (mgr.14388) 978 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:52 smithi191 bash[24992]: cluster 2024-08-31T02:33:51.520645+0000 mgr.a (mgr.14388) 978 : cluster [DBG] pgmap v677: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:54.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:54 smithi163 bash[24253]: cluster 2024-08-31T02:33:53.522794+0000 mgr.a (mgr.14388) 979 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:33:54.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:54 smithi027 bash[22610]: cluster 2024-08-31T02:33:53.522794+0000 mgr.a (mgr.14388) 979 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:33:55.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:54 smithi191 bash[24992]: cluster 2024-08-31T02:33:53.522794+0000 mgr.a (mgr.14388) 979 : cluster [DBG] pgmap v678: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:33:55.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:33:55.037 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:33:55.037 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:33:55.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:33:55.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:33:55.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:33:55.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:33:55.785 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:33:56.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:56 smithi163 bash[24253]: audit 2024-08-31T02:33:55.371792+0000 mgr.a (mgr.14388) 980 : audit [DBG] from='client.34422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:56.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:56 smithi163 bash[24253]: cluster 2024-08-31T02:33:55.523311+0000 mgr.a (mgr.14388) 981 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:56.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:56 smithi027 bash[22610]: audit 2024-08-31T02:33:55.371792+0000 mgr.a (mgr.14388) 980 : audit [DBG] from='client.34422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:56.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:56 smithi027 bash[22610]: cluster 2024-08-31T02:33:55.523311+0000 mgr.a (mgr.14388) 981 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:57.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:56 smithi191 bash[24992]: audit 2024-08-31T02:33:55.371792+0000 mgr.a (mgr.14388) 980 : audit [DBG] from='client.34422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:33:57.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:56 smithi191 bash[24992]: cluster 2024-08-31T02:33:55.523311+0000 mgr.a (mgr.14388) 981 : cluster [DBG] pgmap v679: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:58.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:33:58 smithi163 bash[24253]: cluster 2024-08-31T02:33:57.524102+0000 mgr.a (mgr.14388) 982 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:58.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:33:58 smithi027 bash[22610]: cluster 2024-08-31T02:33:57.524102+0000 mgr.a (mgr.14388) 982 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:33:59.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:33:58 smithi191 bash[24992]: cluster 2024-08-31T02:33:57.524102+0000 mgr.a (mgr.14388) 982 : cluster [DBG] pgmap v680: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:00.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:00.787 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:00.788 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:00.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:00 smithi163 bash[24253]: cluster 2024-08-31T02:33:59.526397+0000 mgr.a (mgr.14388) 983 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:00.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:00 smithi027 bash[22610]: cluster 2024-08-31T02:33:59.526397+0000 mgr.a (mgr.14388) 983 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:01.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:00 smithi191 bash[24992]: cluster 2024-08-31T02:33:59.526397+0000 mgr.a (mgr.14388) 983 : cluster [DBG] pgmap v681: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:01.523 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:01.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:01.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:02.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:02 smithi163 bash[24253]: audit 2024-08-31T02:34:01.121898+0000 mgr.a (mgr.14388) 984 : audit [DBG] from='client.34500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:02.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:02 smithi163 bash[24253]: cluster 2024-08-31T02:34:01.526914+0000 mgr.a (mgr.14388) 985 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:02.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:02 smithi027 bash[22610]: audit 2024-08-31T02:34:01.121898+0000 mgr.a (mgr.14388) 984 : audit [DBG] from='client.34500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:02.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:02 smithi027 bash[22610]: cluster 2024-08-31T02:34:01.526914+0000 mgr.a (mgr.14388) 985 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:03.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:02 smithi191 bash[24992]: audit 2024-08-31T02:34:01.121898+0000 mgr.a (mgr.14388) 984 : audit [DBG] from='client.34500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:03.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:02 smithi191 bash[24992]: cluster 2024-08-31T02:34:01.526914+0000 mgr.a (mgr.14388) 985 : cluster [DBG] pgmap v682: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:04.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:04 smithi163 bash[24253]: cluster 2024-08-31T02:34:03.529008+0000 mgr.a (mgr.14388) 986 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:04.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:04 smithi027 bash[22610]: cluster 2024-08-31T02:34:03.529008+0000 mgr.a (mgr.14388) 986 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:05.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:04 smithi191 bash[24992]: cluster 2024-08-31T02:34:03.529008+0000 mgr.a (mgr.14388) 986 : cluster [DBG] pgmap v683: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:06.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:06.525 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:06.525 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:06.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:06 smithi163 bash[24253]: cluster 2024-08-31T02:34:05.529767+0000 mgr.a (mgr.14388) 987 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:06.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:06 smithi027 bash[22610]: cluster 2024-08-31T02:34:05.529767+0000 mgr.a (mgr.14388) 987 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:07.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:06 smithi191 bash[24992]: cluster 2024-08-31T02:34:05.529767+0000 mgr.a (mgr.14388) 987 : cluster [DBG] pgmap v684: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:07.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:07.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:07.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:07.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:07.260 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:07.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:07 smithi163 bash[24253]: audit 2024-08-31T02:34:06.859548+0000 mgr.a (mgr.14388) 988 : audit [DBG] from='client.34578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:07.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:07 smithi027 bash[22610]: audit 2024-08-31T02:34:06.859548+0000 mgr.a (mgr.14388) 988 : audit [DBG] from='client.34578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:08.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:07 smithi191 bash[24992]: audit 2024-08-31T02:34:06.859548+0000 mgr.a (mgr.14388) 988 : audit [DBG] from='client.34578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:08.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:08 smithi163 bash[24253]: cluster 2024-08-31T02:34:07.530712+0000 mgr.a (mgr.14388) 989 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:08 smithi027 bash[22610]: cluster 2024-08-31T02:34:07.530712+0000 mgr.a (mgr.14388) 989 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:09.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:08 smithi191 bash[24992]: cluster 2024-08-31T02:34:07.530712+0000 mgr.a (mgr.14388) 989 : cluster [DBG] pgmap v685: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:10.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:10 smithi163 bash[24253]: cluster 2024-08-31T02:34:09.532988+0000 mgr.a (mgr.14388) 990 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:10.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:10 smithi027 bash[22610]: cluster 2024-08-31T02:34:09.532988+0000 mgr.a (mgr.14388) 990 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:11.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:10 smithi191 bash[24992]: cluster 2024-08-31T02:34:09.532988+0000 mgr.a (mgr.14388) 990 : cluster [DBG] pgmap v686: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:12.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:12.262 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:12.262 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:12.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:12 smithi163 bash[24253]: cluster 2024-08-31T02:34:11.533774+0000 mgr.a (mgr.14388) 991 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:12.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:12 smithi027 bash[22610]: cluster 2024-08-31T02:34:11.533774+0000 mgr.a (mgr.14388) 991 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:13.028 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:12 smithi191 bash[24992]: cluster 2024-08-31T02:34:11.533774+0000 mgr.a (mgr.14388) 991 : cluster [DBG] pgmap v687: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:13.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:13 smithi027 bash[22610]: audit 2024-08-31T02:34:12.601315+0000 mgr.a (mgr.14388) 992 : audit [DBG] from='client.34656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:13.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:13 smithi027 bash[22610]: audit 2024-08-31T02:34:12.820686+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:34:13.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:13 smithi027 bash[22610]: audit 2024-08-31T02:34:13.618898+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:34:13.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:13 smithi027 bash[22610]: audit 2024-08-31T02:34:13.620452+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:34:13.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:13 smithi027 bash[22610]: audit 2024-08-31T02:34:13.629105+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:34:13.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:13 smithi027 bash[22610]: audit 2024-08-31T02:34:13.631689+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:34:14.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:13 smithi191 bash[24992]: audit 2024-08-31T02:34:12.601315+0000 mgr.a (mgr.14388) 992 : audit [DBG] from='client.34656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:14.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:13 smithi191 bash[24992]: audit 2024-08-31T02:34:12.820686+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:34:14.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:13 smithi191 bash[24992]: audit 2024-08-31T02:34:13.618898+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:34:14.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:13 smithi191 bash[24992]: audit 2024-08-31T02:34:13.620452+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:34:14.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:13 smithi191 bash[24992]: audit 2024-08-31T02:34:13.629105+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:34:14.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:13 smithi191 bash[24992]: audit 2024-08-31T02:34:13.631689+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:34:14.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:13 smithi163 bash[24253]: audit 2024-08-31T02:34:12.601315+0000 mgr.a (mgr.14388) 992 : audit [DBG] from='client.34656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:14.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:13 smithi163 bash[24253]: audit 2024-08-31T02:34:12.820686+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:34:14.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:13 smithi163 bash[24253]: audit 2024-08-31T02:34:13.618898+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:34:14.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:13 smithi163 bash[24253]: audit 2024-08-31T02:34:13.620452+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:34:14.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:13 smithi163 bash[24253]: audit 2024-08-31T02:34:13.629105+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:34:14.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:13 smithi163 bash[24253]: audit 2024-08-31T02:34:13.631689+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:34:14.704 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:34:14 smithi027 bash[22863]: debug 2024-08-31T02:34:14.352+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:34:14.704 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:34:14 smithi027 bash[22863]: debug 2024-08-31T02:34:14.356+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:34:14.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:14 smithi027 bash[22610]: cluster 2024-08-31T02:34:13.535924+0000 mgr.a (mgr.14388) 993 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:34:14.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:14 smithi027 bash[22610]: audit 2024-08-31T02:34:13.634221+0000 mgr.a (mgr.14388) 994 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:34:15.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:14 smithi191 bash[24992]: cluster 2024-08-31T02:34:13.535924+0000 mgr.a (mgr.14388) 993 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:34:15.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:14 smithi191 bash[24992]: audit 2024-08-31T02:34:13.634221+0000 mgr.a (mgr.14388) 994 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:34:15.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:14 smithi163 bash[24253]: cluster 2024-08-31T02:34:13.535924+0000 mgr.a (mgr.14388) 993 : cluster [DBG] pgmap v688: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:34:15.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:14 smithi163 bash[24253]: audit 2024-08-31T02:34:13.634221+0000 mgr.a (mgr.14388) 994 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:34:15.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:15 smithi027 bash[22610]: audit 2024-08-31T02:34:14.358315+0000 mgr.a (mgr.14388) 995 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:34:15.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:15 smithi027 bash[22610]: cephadm 2024-08-31T02:34:14.359916+0000 mgr.a (mgr.14388) 996 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:34:16.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:15 smithi191 bash[24992]: audit 2024-08-31T02:34:14.358315+0000 mgr.a (mgr.14388) 995 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:34:16.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:15 smithi191 bash[24992]: cephadm 2024-08-31T02:34:14.359916+0000 mgr.a (mgr.14388) 996 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:34:16.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:15 smithi163 bash[24253]: audit 2024-08-31T02:34:14.358315+0000 mgr.a (mgr.14388) 995 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:34:16.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:15 smithi163 bash[24253]: cephadm 2024-08-31T02:34:14.359916+0000 mgr.a (mgr.14388) 996 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:34:16.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:16 smithi027 bash[22610]: cluster 2024-08-31T02:34:15.536855+0000 mgr.a (mgr.14388) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:34:17.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:16 smithi191 bash[24992]: cluster 2024-08-31T02:34:15.536855+0000 mgr.a (mgr.14388) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:34:17.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:16 smithi163 bash[24253]: cluster 2024-08-31T02:34:15.536855+0000 mgr.a (mgr.14388) 997 : cluster [DBG] pgmap v689: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:34:18.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:18.030 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:18.030 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:18.803 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:18.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:18.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:18.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:18.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:18.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:18 smithi027 bash[22610]: cluster 2024-08-31T02:34:17.537631+0000 mgr.a (mgr.14388) 998 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:34:19.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:18 smithi191 bash[24992]: cluster 2024-08-31T02:34:17.537631+0000 mgr.a (mgr.14388) 998 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:34:19.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:18 smithi163 bash[24253]: cluster 2024-08-31T02:34:17.537631+0000 mgr.a (mgr.14388) 998 : cluster [DBG] pgmap v690: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:34:19.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:19 smithi027 bash[22610]: audit 2024-08-31T02:34:18.370863+0000 mgr.a (mgr.14388) 999 : audit [DBG] from='client.34842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:20.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:19 smithi191 bash[24992]: audit 2024-08-31T02:34:18.370863+0000 mgr.a (mgr.14388) 999 : audit [DBG] from='client.34842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:20.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:19 smithi163 bash[24253]: audit 2024-08-31T02:34:18.370863+0000 mgr.a (mgr.14388) 999 : audit [DBG] from='client.34842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:20 smithi191 bash[24992]: cluster 2024-08-31T02:34:19.540407+0000 mgr.a (mgr.14388) 1000 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:34:21.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:20 smithi163 bash[24253]: cluster 2024-08-31T02:34:19.540407+0000 mgr.a (mgr.14388) 1000 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:34:21.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:20 smithi027 bash[22610]: cluster 2024-08-31T02:34:19.540407+0000 mgr.a (mgr.14388) 1000 : cluster [DBG] pgmap v691: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:34:23.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:22 smithi191 bash[24992]: cluster 2024-08-31T02:34:21.541208+0000 mgr.a (mgr.14388) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:34:23.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:22 smithi163 bash[24253]: cluster 2024-08-31T02:34:21.541208+0000 mgr.a (mgr.14388) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:34:23.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:22 smithi027 bash[22610]: cluster 2024-08-31T02:34:21.541208+0000 mgr.a (mgr.14388) 1001 : cluster [DBG] pgmap v692: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:34:23.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:23.806 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:23.806 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:24.574 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:24.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:24.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:24.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:24.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:25.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:24 smithi191 bash[24992]: cluster 2024-08-31T02:34:23.543262+0000 mgr.a (mgr.14388) 1002 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:34:25.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:24 smithi163 bash[24253]: cluster 2024-08-31T02:34:23.543262+0000 mgr.a (mgr.14388) 1002 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:34:25.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:24 smithi027 bash[22610]: cluster 2024-08-31T02:34:23.543262+0000 mgr.a (mgr.14388) 1002 : cluster [DBG] pgmap v693: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:34:26.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:25 smithi191 bash[24992]: audit 2024-08-31T02:34:24.146160+0000 mgr.a (mgr.14388) 1003 : audit [DBG] from='client.34920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:26.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:25 smithi163 bash[24253]: audit 2024-08-31T02:34:24.146160+0000 mgr.a (mgr.14388) 1003 : audit [DBG] from='client.34920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:26.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:25 smithi027 bash[22610]: audit 2024-08-31T02:34:24.146160+0000 mgr.a (mgr.14388) 1003 : audit [DBG] from='client.34920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:26 smithi191 bash[24992]: cluster 2024-08-31T02:34:25.544182+0000 mgr.a (mgr.14388) 1004 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:34:27.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:26 smithi163 bash[24253]: cluster 2024-08-31T02:34:25.544182+0000 mgr.a (mgr.14388) 1004 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:34:27.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:26 smithi027 bash[22610]: cluster 2024-08-31T02:34:25.544182+0000 mgr.a (mgr.14388) 1004 : cluster [DBG] pgmap v694: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:34:29.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:28 smithi191 bash[24992]: cluster 2024-08-31T02:34:27.544922+0000 mgr.a (mgr.14388) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:34:29.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:28 smithi163 bash[24253]: cluster 2024-08-31T02:34:27.544922+0000 mgr.a (mgr.14388) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:34:29.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:28 smithi027 bash[22610]: cluster 2024-08-31T02:34:27.544922+0000 mgr.a (mgr.14388) 1005 : cluster [DBG] pgmap v695: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:34:29.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:29.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:29.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:30.336 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:30.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:30.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:30.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:30.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:31.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:30 smithi191 bash[24992]: cluster 2024-08-31T02:34:29.547141+0000 mgr.a (mgr.14388) 1006 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:34:31.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:30 smithi191 bash[24992]: audit 2024-08-31T02:34:29.917723+0000 mgr.a (mgr.14388) 1007 : audit [DBG] from='client.34998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:31.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:30 smithi163 bash[24253]: cluster 2024-08-31T02:34:29.547141+0000 mgr.a (mgr.14388) 1006 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:34:31.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:30 smithi163 bash[24253]: audit 2024-08-31T02:34:29.917723+0000 mgr.a (mgr.14388) 1007 : audit [DBG] from='client.34998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:31.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:30 smithi027 bash[22610]: cluster 2024-08-31T02:34:29.547141+0000 mgr.a (mgr.14388) 1006 : cluster [DBG] pgmap v696: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:34:31.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:30 smithi027 bash[22610]: audit 2024-08-31T02:34:29.917723+0000 mgr.a (mgr.14388) 1007 : audit [DBG] from='client.34998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:33.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:32 smithi191 bash[24992]: cluster 2024-08-31T02:34:31.548064+0000 mgr.a (mgr.14388) 1008 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:33.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:32 smithi163 bash[24253]: cluster 2024-08-31T02:34:31.548064+0000 mgr.a (mgr.14388) 1008 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:33.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:32 smithi027 bash[22610]: cluster 2024-08-31T02:34:31.548064+0000 mgr.a (mgr.14388) 1008 : cluster [DBG] pgmap v697: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:35.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:34 smithi191 bash[24992]: cluster 2024-08-31T02:34:33.550174+0000 mgr.a (mgr.14388) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:35.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:34 smithi163 bash[24253]: cluster 2024-08-31T02:34:33.550174+0000 mgr.a (mgr.14388) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:35.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:34 smithi027 bash[22610]: cluster 2024-08-31T02:34:33.550174+0000 mgr.a (mgr.14388) 1009 : cluster [DBG] pgmap v698: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:35.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:35.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:35.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:36.104 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:36.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:36.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:36.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:36.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:37.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:36 smithi191 bash[24992]: cluster 2024-08-31T02:34:35.550934+0000 mgr.a (mgr.14388) 1010 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:37.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:36 smithi191 bash[24992]: audit 2024-08-31T02:34:35.679306+0000 mgr.a (mgr.14388) 1011 : audit [DBG] from='client.35073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:37.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:36 smithi163 bash[24253]: cluster 2024-08-31T02:34:35.550934+0000 mgr.a (mgr.14388) 1010 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:37.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:36 smithi163 bash[24253]: audit 2024-08-31T02:34:35.679306+0000 mgr.a (mgr.14388) 1011 : audit [DBG] from='client.35073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:37.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:36 smithi027 bash[22610]: cluster 2024-08-31T02:34:35.550934+0000 mgr.a (mgr.14388) 1010 : cluster [DBG] pgmap v699: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:37.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:36 smithi027 bash[22610]: audit 2024-08-31T02:34:35.679306+0000 mgr.a (mgr.14388) 1011 : audit [DBG] from='client.35073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:39.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:38 smithi191 bash[24992]: cluster 2024-08-31T02:34:37.551824+0000 mgr.a (mgr.14388) 1012 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:39.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:38 smithi163 bash[24253]: cluster 2024-08-31T02:34:37.551824+0000 mgr.a (mgr.14388) 1012 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:39.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:38 smithi027 bash[22610]: cluster 2024-08-31T02:34:37.551824+0000 mgr.a (mgr.14388) 1012 : cluster [DBG] pgmap v700: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:41.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:40 smithi191 bash[24992]: cluster 2024-08-31T02:34:39.554165+0000 mgr.a (mgr.14388) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:41.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:41.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:41.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:41.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:40 smithi163 bash[24253]: cluster 2024-08-31T02:34:39.554165+0000 mgr.a (mgr.14388) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:41.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:40 smithi027 bash[22610]: cluster 2024-08-31T02:34:39.554165+0000 mgr.a (mgr.14388) 1013 : cluster [DBG] pgmap v701: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:41.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:41.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:41.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:41.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:41.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:42 smithi191 bash[24992]: audit 2024-08-31T02:34:41.447189+0000 mgr.a (mgr.14388) 1014 : audit [DBG] from='client.35148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:42 smithi191 bash[24992]: cluster 2024-08-31T02:34:41.554953+0000 mgr.a (mgr.14388) 1015 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:43.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:42 smithi163 bash[24253]: audit 2024-08-31T02:34:41.447189+0000 mgr.a (mgr.14388) 1014 : audit [DBG] from='client.35148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:43.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:42 smithi163 bash[24253]: cluster 2024-08-31T02:34:41.554953+0000 mgr.a (mgr.14388) 1015 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:43.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:42 smithi027 bash[22610]: audit 2024-08-31T02:34:41.447189+0000 mgr.a (mgr.14388) 1014 : audit [DBG] from='client.35148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:43.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:42 smithi027 bash[22610]: cluster 2024-08-31T02:34:41.554953+0000 mgr.a (mgr.14388) 1015 : cluster [DBG] pgmap v702: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:45.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:44 smithi163 bash[24253]: cluster 2024-08-31T02:34:43.557127+0000 mgr.a (mgr.14388) 1016 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:45.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:44 smithi027 bash[22610]: cluster 2024-08-31T02:34:43.557127+0000 mgr.a (mgr.14388) 1016 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:45.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:44 smithi191 bash[24992]: cluster 2024-08-31T02:34:43.557127+0000 mgr.a (mgr.14388) 1016 : cluster [DBG] pgmap v703: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:46.876 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:47.185 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:47.185 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:47.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:46 smithi163 bash[24253]: cluster 2024-08-31T02:34:45.557892+0000 mgr.a (mgr.14388) 1017 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:46 smithi027 bash[22610]: cluster 2024-08-31T02:34:45.557892+0000 mgr.a (mgr.14388) 1017 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:47.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:46 smithi191 bash[24992]: cluster 2024-08-31T02:34:45.557892+0000 mgr.a (mgr.14388) 1017 : cluster [DBG] pgmap v704: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:47.616 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:47.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:47.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:47.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:47.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:49.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:48 smithi163 bash[24253]: audit 2024-08-31T02:34:47.203222+0000 mgr.a (mgr.14388) 1018 : audit [DBG] from='client.35220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:49.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:48 smithi163 bash[24253]: cluster 2024-08-31T02:34:47.558425+0000 mgr.a (mgr.14388) 1019 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:49.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:48 smithi027 bash[22610]: audit 2024-08-31T02:34:47.203222+0000 mgr.a (mgr.14388) 1018 : audit [DBG] from='client.35220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:49.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:48 smithi027 bash[22610]: cluster 2024-08-31T02:34:47.558425+0000 mgr.a (mgr.14388) 1019 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:49.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:48 smithi191 bash[24992]: audit 2024-08-31T02:34:47.203222+0000 mgr.a (mgr.14388) 1018 : audit [DBG] from='client.35220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:49.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:48 smithi191 bash[24992]: cluster 2024-08-31T02:34:47.558425+0000 mgr.a (mgr.14388) 1019 : cluster [DBG] pgmap v705: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:51.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:50 smithi163 bash[24253]: cluster 2024-08-31T02:34:49.560764+0000 mgr.a (mgr.14388) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:51.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:50 smithi027 bash[22610]: cluster 2024-08-31T02:34:49.560764+0000 mgr.a (mgr.14388) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:51.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:50 smithi191 bash[24992]: cluster 2024-08-31T02:34:49.560764+0000 mgr.a (mgr.14388) 1020 : cluster [DBG] pgmap v706: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:34:52.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:52.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:52.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:53.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:52 smithi163 bash[24253]: cluster 2024-08-31T02:34:51.561549+0000 mgr.a (mgr.14388) 1021 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:53.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:52 smithi027 bash[22610]: cluster 2024-08-31T02:34:51.561549+0000 mgr.a (mgr.14388) 1021 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:53.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:52 smithi191 bash[24992]: cluster 2024-08-31T02:34:51.561549+0000 mgr.a (mgr.14388) 1021 : cluster [DBG] pgmap v707: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:53.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:53.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:53.378 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:54.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:53 smithi163 bash[24253]: audit 2024-08-31T02:34:52.959124+0000 mgr.a (mgr.14388) 1022 : audit [DBG] from='client.35298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:54.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:53 smithi027 bash[22610]: audit 2024-08-31T02:34:52.959124+0000 mgr.a (mgr.14388) 1022 : audit [DBG] from='client.35298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:54.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:53 smithi191 bash[24992]: audit 2024-08-31T02:34:52.959124+0000 mgr.a (mgr.14388) 1022 : audit [DBG] from='client.35298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:34:55.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:54 smithi163 bash[24253]: cluster 2024-08-31T02:34:53.564214+0000 mgr.a (mgr.14388) 1023 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:55.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:54 smithi027 bash[22610]: cluster 2024-08-31T02:34:53.564214+0000 mgr.a (mgr.14388) 1023 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:55.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:54 smithi191 bash[24992]: cluster 2024-08-31T02:34:53.564214+0000 mgr.a (mgr.14388) 1023 : cluster [DBG] pgmap v708: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:34:57.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:56 smithi163 bash[24253]: cluster 2024-08-31T02:34:55.565005+0000 mgr.a (mgr.14388) 1024 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:34:57.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:56 smithi027 bash[22610]: cluster 2024-08-31T02:34:55.565005+0000 mgr.a (mgr.14388) 1024 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:34:57.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:56 smithi191 bash[24992]: cluster 2024-08-31T02:34:55.565005+0000 mgr.a (mgr.14388) 1024 : cluster [DBG] pgmap v709: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:34:58.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:34:58.380 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:34:58.380 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:34:59.151 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:34:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:34:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:34:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:34:59.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:34:59.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:58 smithi163 bash[24253]: cluster 2024-08-31T02:34:57.565743+0000 mgr.a (mgr.14388) 1025 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:34:59.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:58 smithi027 bash[22610]: cluster 2024-08-31T02:34:57.565743+0000 mgr.a (mgr.14388) 1025 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:34:59.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:58 smithi191 bash[24992]: cluster 2024-08-31T02:34:57.565743+0000 mgr.a (mgr.14388) 1025 : cluster [DBG] pgmap v710: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:35:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:34:59 smithi163 bash[24253]: audit 2024-08-31T02:34:58.721407+0000 mgr.a (mgr.14388) 1026 : audit [DBG] from='client.35376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:00.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:34:59 smithi027 bash[22610]: audit 2024-08-31T02:34:58.721407+0000 mgr.a (mgr.14388) 1026 : audit [DBG] from='client.35376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:00.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:34:59 smithi191 bash[24992]: audit 2024-08-31T02:34:58.721407+0000 mgr.a (mgr.14388) 1026 : audit [DBG] from='client.35376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:01.137 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:00 smithi027 bash[22610]: cluster 2024-08-31T02:34:59.568514+0000 mgr.a (mgr.14388) 1027 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:01.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:00 smithi163 bash[24253]: cluster 2024-08-31T02:34:59.568514+0000 mgr.a (mgr.14388) 1027 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:01.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:00 smithi191 bash[24992]: cluster 2024-08-31T02:34:59.568514+0000 mgr.a (mgr.14388) 1027 : cluster [DBG] pgmap v711: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:03.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:02 smithi163 bash[24253]: cluster 2024-08-31T02:35:01.569337+0000 mgr.a (mgr.14388) 1028 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:35:03.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:02 smithi027 bash[22610]: cluster 2024-08-31T02:35:01.569337+0000 mgr.a (mgr.14388) 1028 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:35:03.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:02 smithi191 bash[24992]: cluster 2024-08-31T02:35:01.569337+0000 mgr.a (mgr.14388) 1028 : cluster [DBG] pgmap v712: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:35:04.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:35:04.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:35:04.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:35:04.892 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:35:04.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:35:04.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:35:04.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:35:04.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:35:05.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:04 smithi163 bash[24253]: cluster 2024-08-31T02:35:03.571283+0000 mgr.a (mgr.14388) 1029 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:05.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:04 smithi027 bash[22610]: cluster 2024-08-31T02:35:03.571283+0000 mgr.a (mgr.14388) 1029 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:05.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:04 smithi191 bash[24992]: cluster 2024-08-31T02:35:03.571283+0000 mgr.a (mgr.14388) 1029 : cluster [DBG] pgmap v713: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:06.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:05 smithi163 bash[24253]: audit 2024-08-31T02:35:04.488816+0000 mgr.a (mgr.14388) 1030 : audit [DBG] from='client.35451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:06.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:05 smithi027 bash[22610]: audit 2024-08-31T02:35:04.488816+0000 mgr.a (mgr.14388) 1030 : audit [DBG] from='client.35451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:06.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:05 smithi191 bash[24992]: audit 2024-08-31T02:35:04.488816+0000 mgr.a (mgr.14388) 1030 : audit [DBG] from='client.35451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:07.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:06 smithi163 bash[24253]: cluster 2024-08-31T02:35:05.572218+0000 mgr.a (mgr.14388) 1031 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:07.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:06 smithi027 bash[22610]: cluster 2024-08-31T02:35:05.572218+0000 mgr.a (mgr.14388) 1031 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:07.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:06 smithi191 bash[24992]: cluster 2024-08-31T02:35:05.572218+0000 mgr.a (mgr.14388) 1031 : cluster [DBG] pgmap v714: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:09.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:08 smithi163 bash[24253]: cluster 2024-08-31T02:35:07.573011+0000 mgr.a (mgr.14388) 1032 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:09.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:08 smithi027 bash[22610]: cluster 2024-08-31T02:35:07.573011+0000 mgr.a (mgr.14388) 1032 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:09.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:08 smithi191 bash[24992]: cluster 2024-08-31T02:35:07.573011+0000 mgr.a (mgr.14388) 1032 : cluster [DBG] pgmap v715: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:09.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:35:09.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:35:09.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:35:10.665 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:35:10.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:35:10.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:35:10.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:35:10.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:35:11.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:10 smithi163 bash[24253]: cluster 2024-08-31T02:35:09.575275+0000 mgr.a (mgr.14388) 1033 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:11.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:10 smithi027 bash[22610]: cluster 2024-08-31T02:35:09.575275+0000 mgr.a (mgr.14388) 1033 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:11.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:10 smithi191 bash[24992]: cluster 2024-08-31T02:35:09.575275+0000 mgr.a (mgr.14388) 1033 : cluster [DBG] pgmap v716: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:12.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:11 smithi163 bash[24253]: audit 2024-08-31T02:35:10.231720+0000 mgr.a (mgr.14388) 1034 : audit [DBG] from='client.35529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:12.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:11 smithi027 bash[22610]: audit 2024-08-31T02:35:10.231720+0000 mgr.a (mgr.14388) 1034 : audit [DBG] from='client.35529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:12.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:11 smithi191 bash[24992]: audit 2024-08-31T02:35:10.231720+0000 mgr.a (mgr.14388) 1034 : audit [DBG] from='client.35529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:13.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:12 smithi163 bash[24253]: cluster 2024-08-31T02:35:11.576177+0000 mgr.a (mgr.14388) 1035 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:13.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:12 smithi027 bash[22610]: cluster 2024-08-31T02:35:11.576177+0000 mgr.a (mgr.14388) 1035 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:13.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:12 smithi191 bash[24992]: cluster 2024-08-31T02:35:11.576177+0000 mgr.a (mgr.14388) 1035 : cluster [DBG] pgmap v717: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:15.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:14 smithi163 bash[24253]: cluster 2024-08-31T02:35:13.578358+0000 mgr.a (mgr.14388) 1036 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:15.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:14 smithi163 bash[24253]: audit 2024-08-31T02:35:14.411420+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:35:15.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:14 smithi027 bash[22610]: cluster 2024-08-31T02:35:13.578358+0000 mgr.a (mgr.14388) 1036 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:15.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:14 smithi027 bash[22610]: audit 2024-08-31T02:35:14.411420+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:35:15.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:14 smithi191 bash[24992]: cluster 2024-08-31T02:35:13.578358+0000 mgr.a (mgr.14388) 1036 : cluster [DBG] pgmap v718: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:15.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:14 smithi191 bash[24992]: audit 2024-08-31T02:35:14.411420+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:35:15.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:35:15.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:35:15.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:35:16.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:15 smithi163 bash[24253]: audit 2024-08-31T02:35:15.264102+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:35:16.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:15 smithi163 bash[24253]: audit 2024-08-31T02:35:15.265814+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:35:16.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:15 smithi163 bash[24253]: audit 2024-08-31T02:35:15.274440+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:35:16.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:15 smithi163 bash[24253]: audit 2024-08-31T02:35:15.279191+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:35:16.229 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:35:16 smithi027 bash[22863]: debug 2024-08-31T02:35:16.006+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:35:16.229 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:35:16 smithi027 bash[22863]: debug 2024-08-31T02:35:16.010+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:35:16.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:15 smithi027 bash[22610]: audit 2024-08-31T02:35:15.264102+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:35:16.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:15 smithi027 bash[22610]: audit 2024-08-31T02:35:15.265814+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:35:16.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:15 smithi027 bash[22610]: audit 2024-08-31T02:35:15.274440+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:35:16.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:15 smithi027 bash[22610]: audit 2024-08-31T02:35:15.279191+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:35:16.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:15 smithi191 bash[24992]: audit 2024-08-31T02:35:15.264102+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:35:16.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:15 smithi191 bash[24992]: audit 2024-08-31T02:35:15.265814+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:35:16.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:15 smithi191 bash[24992]: audit 2024-08-31T02:35:15.274440+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:35:16.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:15 smithi191 bash[24992]: audit 2024-08-31T02:35:15.279191+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:35:16.414 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:35:16.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:35:16.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:35:16.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:35:16.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:35:17.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:16 smithi163 bash[24253]: audit 2024-08-31T02:35:15.281408+0000 mgr.a (mgr.14388) 1037 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:35:17.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:16 smithi163 bash[24253]: cluster 2024-08-31T02:35:15.578916+0000 mgr.a (mgr.14388) 1038 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:17.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:16 smithi163 bash[24253]: audit 2024-08-31T02:35:16.014374+0000 mgr.a (mgr.14388) 1039 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:35:17.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:16 smithi163 bash[24253]: cephadm 2024-08-31T02:35:16.015620+0000 mgr.a (mgr.14388) 1040 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:35:17.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:16 smithi163 bash[24253]: audit 2024-08-31T02:35:16.025370+0000 mgr.a (mgr.14388) 1041 : audit [DBG] from='client.35679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:17.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:16 smithi027 bash[22610]: audit 2024-08-31T02:35:15.281408+0000 mgr.a (mgr.14388) 1037 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:35:17.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:16 smithi027 bash[22610]: cluster 2024-08-31T02:35:15.578916+0000 mgr.a (mgr.14388) 1038 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:17.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:16 smithi027 bash[22610]: audit 2024-08-31T02:35:16.014374+0000 mgr.a (mgr.14388) 1039 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:35:17.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:16 smithi027 bash[22610]: cephadm 2024-08-31T02:35:16.015620+0000 mgr.a (mgr.14388) 1040 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:35:17.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:16 smithi027 bash[22610]: audit 2024-08-31T02:35:16.025370+0000 mgr.a (mgr.14388) 1041 : audit [DBG] from='client.35679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:17.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:16 smithi191 bash[24992]: audit 2024-08-31T02:35:15.281408+0000 mgr.a (mgr.14388) 1037 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:35:17.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:16 smithi191 bash[24992]: cluster 2024-08-31T02:35:15.578916+0000 mgr.a (mgr.14388) 1038 : cluster [DBG] pgmap v719: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:17.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:16 smithi191 bash[24992]: audit 2024-08-31T02:35:16.014374+0000 mgr.a (mgr.14388) 1039 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:35:17.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:16 smithi191 bash[24992]: cephadm 2024-08-31T02:35:16.015620+0000 mgr.a (mgr.14388) 1040 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:35:17.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:16 smithi191 bash[24992]: audit 2024-08-31T02:35:16.025370+0000 mgr.a (mgr.14388) 1041 : audit [DBG] from='client.35679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:19.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:18 smithi163 bash[24253]: cluster 2024-08-31T02:35:17.579948+0000 mgr.a (mgr.14388) 1042 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:19.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:18 smithi027 bash[22610]: cluster 2024-08-31T02:35:17.579948+0000 mgr.a (mgr.14388) 1042 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:19.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:18 smithi191 bash[24992]: cluster 2024-08-31T02:35:17.579948+0000 mgr.a (mgr.14388) 1042 : cluster [DBG] pgmap v720: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:21.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:20 smithi163 bash[24253]: cluster 2024-08-31T02:35:19.582159+0000 mgr.a (mgr.14388) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:21.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:20 smithi027 bash[22610]: cluster 2024-08-31T02:35:19.582159+0000 mgr.a (mgr.14388) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:21.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:20 smithi191 bash[24992]: cluster 2024-08-31T02:35:19.582159+0000 mgr.a (mgr.14388) 1043 : cluster [DBG] pgmap v721: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:21.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:35:21.417 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:35:21.417 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:35:22.152 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:35:22.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:35:22.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:35:22.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:35:22.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:35:23.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:22 smithi163 bash[24253]: cluster 2024-08-31T02:35:21.583036+0000 mgr.a (mgr.14388) 1044 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:23.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:22 smithi163 bash[24253]: audit 2024-08-31T02:35:21.745164+0000 mgr.a (mgr.14388) 1045 : audit [DBG] from='client.35784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:23.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:22 smithi027 bash[22610]: cluster 2024-08-31T02:35:21.583036+0000 mgr.a (mgr.14388) 1044 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:23.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:22 smithi027 bash[22610]: audit 2024-08-31T02:35:21.745164+0000 mgr.a (mgr.14388) 1045 : audit [DBG] from='client.35784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:23.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:22 smithi191 bash[24992]: cluster 2024-08-31T02:35:21.583036+0000 mgr.a (mgr.14388) 1044 : cluster [DBG] pgmap v722: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:23.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:22 smithi191 bash[24992]: audit 2024-08-31T02:35:21.745164+0000 mgr.a (mgr.14388) 1045 : audit [DBG] from='client.35784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:25.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:24 smithi163 bash[24253]: cluster 2024-08-31T02:35:23.585296+0000 mgr.a (mgr.14388) 1046 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:25.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:24 smithi027 bash[22610]: cluster 2024-08-31T02:35:23.585296+0000 mgr.a (mgr.14388) 1046 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:25.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:24 smithi191 bash[24992]: cluster 2024-08-31T02:35:23.585296+0000 mgr.a (mgr.14388) 1046 : cluster [DBG] pgmap v723: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:27.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:35:27.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:35:27.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:35:27.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:26 smithi163 bash[24253]: cluster 2024-08-31T02:35:25.586085+0000 mgr.a (mgr.14388) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:27.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:26 smithi027 bash[22610]: cluster 2024-08-31T02:35:25.586085+0000 mgr.a (mgr.14388) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:27.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:26 smithi191 bash[24992]: cluster 2024-08-31T02:35:25.586085+0000 mgr.a (mgr.14388) 1047 : cluster [DBG] pgmap v724: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:27.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:35:27.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:35:27.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:35:27.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:35:27.901 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:35:29.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:28 smithi163 bash[24253]: audit 2024-08-31T02:35:27.489979+0000 mgr.a (mgr.14388) 1048 : audit [DBG] from='client.35862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:29.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:28 smithi163 bash[24253]: cluster 2024-08-31T02:35:27.586544+0000 mgr.a (mgr.14388) 1049 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:29.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:28 smithi027 bash[22610]: audit 2024-08-31T02:35:27.489979+0000 mgr.a (mgr.14388) 1048 : audit [DBG] from='client.35862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:29.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:28 smithi027 bash[22610]: cluster 2024-08-31T02:35:27.586544+0000 mgr.a (mgr.14388) 1049 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:29.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:28 smithi191 bash[24992]: audit 2024-08-31T02:35:27.489979+0000 mgr.a (mgr.14388) 1048 : audit [DBG] from='client.35862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:29.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:28 smithi191 bash[24992]: cluster 2024-08-31T02:35:27.586544+0000 mgr.a (mgr.14388) 1049 : cluster [DBG] pgmap v725: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:31.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:30 smithi163 bash[24253]: cluster 2024-08-31T02:35:29.588838+0000 mgr.a (mgr.14388) 1050 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:31.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:30 smithi027 bash[22610]: cluster 2024-08-31T02:35:29.588838+0000 mgr.a (mgr.14388) 1050 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:31.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:30 smithi191 bash[24992]: cluster 2024-08-31T02:35:29.588838+0000 mgr.a (mgr.14388) 1050 : cluster [DBG] pgmap v726: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:35:32.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:35:32.902 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:35:32.903 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:35:33.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:32 smithi163 bash[24253]: cluster 2024-08-31T02:35:31.589616+0000 mgr.a (mgr.14388) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:35:33.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:32 smithi027 bash[22610]: cluster 2024-08-31T02:35:31.589616+0000 mgr.a (mgr.14388) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:35:33.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:32 smithi191 bash[24992]: cluster 2024-08-31T02:35:31.589616+0000 mgr.a (mgr.14388) 1051 : cluster [DBG] pgmap v727: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:35:33.677 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:35:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:35:33.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:35:33.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:35:33.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:35:35.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:34 smithi163 bash[24253]: audit 2024-08-31T02:35:33.245222+0000 mgr.a (mgr.14388) 1052 : audit [DBG] from='client.35940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:35.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:34 smithi163 bash[24253]: cluster 2024-08-31T02:35:33.591324+0000 mgr.a (mgr.14388) 1053 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:35.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:34 smithi027 bash[22610]: audit 2024-08-31T02:35:33.245222+0000 mgr.a (mgr.14388) 1052 : audit [DBG] from='client.35940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:35.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:34 smithi027 bash[22610]: cluster 2024-08-31T02:35:33.591324+0000 mgr.a (mgr.14388) 1053 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:34 smithi191 bash[24992]: audit 2024-08-31T02:35:33.245222+0000 mgr.a (mgr.14388) 1052 : audit [DBG] from='client.35940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:34 smithi191 bash[24992]: cluster 2024-08-31T02:35:33.591324+0000 mgr.a (mgr.14388) 1053 : cluster [DBG] pgmap v728: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:37.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:36 smithi163 bash[24253]: cluster 2024-08-31T02:35:35.592100+0000 mgr.a (mgr.14388) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:35:37.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:36 smithi027 bash[22610]: cluster 2024-08-31T02:35:35.592100+0000 mgr.a (mgr.14388) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:35:37.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:36 smithi191 bash[24992]: cluster 2024-08-31T02:35:35.592100+0000 mgr.a (mgr.14388) 1054 : cluster [DBG] pgmap v729: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:35:38.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:35:38.680 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:35:38.680 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:35:39.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:38 smithi163 bash[24253]: cluster 2024-08-31T02:35:37.592986+0000 mgr.a (mgr.14388) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:35:39.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:38 smithi027 bash[22610]: cluster 2024-08-31T02:35:37.592986+0000 mgr.a (mgr.14388) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:35:39.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:38 smithi191 bash[24992]: cluster 2024-08-31T02:35:37.592986+0000 mgr.a (mgr.14388) 1055 : cluster [DBG] pgmap v730: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:35:39.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:35:39.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:35:39.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:35:39.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:35:39.447 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:35:40.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:39 smithi163 bash[24253]: audit 2024-08-31T02:35:39.022398+0000 mgr.a (mgr.14388) 1056 : audit [DBG] from='client.36018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:40.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:39 smithi027 bash[22610]: audit 2024-08-31T02:35:39.022398+0000 mgr.a (mgr.14388) 1056 : audit [DBG] from='client.36018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:40.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:39 smithi191 bash[24992]: audit 2024-08-31T02:35:39.022398+0000 mgr.a (mgr.14388) 1056 : audit [DBG] from='client.36018 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:41.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:40 smithi163 bash[24253]: cluster 2024-08-31T02:35:39.595658+0000 mgr.a (mgr.14388) 1057 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:41.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:40 smithi027 bash[22610]: cluster 2024-08-31T02:35:39.595658+0000 mgr.a (mgr.14388) 1057 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:41.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:40 smithi191 bash[24992]: cluster 2024-08-31T02:35:39.595658+0000 mgr.a (mgr.14388) 1057 : cluster [DBG] pgmap v731: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:43.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:42 smithi163 bash[24253]: cluster 2024-08-31T02:35:41.596432+0000 mgr.a (mgr.14388) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T02:35:43.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:42 smithi027 bash[22610]: cluster 2024-08-31T02:35:41.596432+0000 mgr.a (mgr.14388) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T02:35:43.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:42 smithi191 bash[24992]: cluster 2024-08-31T02:35:41.596432+0000 mgr.a (mgr.14388) 1058 : cluster [DBG] pgmap v732: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T02:35:44.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:35:44.448 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:35:44.449 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:35:45.218 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:35:45.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:35:45.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:35:45.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:35:45.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:35:45.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:44 smithi027 bash[22610]: cluster 2024-08-31T02:35:43.598326+0000 mgr.a (mgr.14388) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:35:45.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:44 smithi191 bash[24992]: cluster 2024-08-31T02:35:43.598326+0000 mgr.a (mgr.14388) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:35:45.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:44 smithi163 bash[24253]: cluster 2024-08-31T02:35:43.598326+0000 mgr.a (mgr.14388) 1059 : cluster [DBG] pgmap v733: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:35:46.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:45 smithi027 bash[22610]: audit 2024-08-31T02:35:44.783487+0000 mgr.a (mgr.14388) 1060 : audit [DBG] from='client.36096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:46.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:45 smithi191 bash[24992]: audit 2024-08-31T02:35:44.783487+0000 mgr.a (mgr.14388) 1060 : audit [DBG] from='client.36096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:46.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:45 smithi163 bash[24253]: audit 2024-08-31T02:35:44.783487+0000 mgr.a (mgr.14388) 1060 : audit [DBG] from='client.36096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:46 smithi027 bash[22610]: cluster 2024-08-31T02:35:45.599307+0000 mgr.a (mgr.14388) 1061 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:47.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:46 smithi191 bash[24992]: cluster 2024-08-31T02:35:45.599307+0000 mgr.a (mgr.14388) 1061 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:47.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:46 smithi163 bash[24253]: cluster 2024-08-31T02:35:45.599307+0000 mgr.a (mgr.14388) 1061 : cluster [DBG] pgmap v734: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:49.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:48 smithi027 bash[22610]: cluster 2024-08-31T02:35:47.600046+0000 mgr.a (mgr.14388) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:49.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:48 smithi191 bash[24992]: cluster 2024-08-31T02:35:47.600046+0000 mgr.a (mgr.14388) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:49.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:48 smithi163 bash[24253]: cluster 2024-08-31T02:35:47.600046+0000 mgr.a (mgr.14388) 1062 : cluster [DBG] pgmap v735: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:50.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:35:50.220 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:35:50.220 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:35:50.963 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:35:50.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:35:50.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:35:50.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:35:50.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:35:51.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:50 smithi027 bash[22610]: cluster 2024-08-31T02:35:49.602262+0000 mgr.a (mgr.14388) 1063 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:51.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:50 smithi191 bash[24992]: cluster 2024-08-31T02:35:49.602262+0000 mgr.a (mgr.14388) 1063 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:51.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:50 smithi163 bash[24253]: cluster 2024-08-31T02:35:49.602262+0000 mgr.a (mgr.14388) 1063 : cluster [DBG] pgmap v736: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:52.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:51 smithi027 bash[22610]: audit 2024-08-31T02:35:50.559049+0000 mgr.a (mgr.14388) 1064 : audit [DBG] from='client.36171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:52.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:51 smithi191 bash[24992]: audit 2024-08-31T02:35:50.559049+0000 mgr.a (mgr.14388) 1064 : audit [DBG] from='client.36171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:52.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:51 smithi163 bash[24253]: audit 2024-08-31T02:35:50.559049+0000 mgr.a (mgr.14388) 1064 : audit [DBG] from='client.36171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:53.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:52 smithi191 bash[24992]: cluster 2024-08-31T02:35:51.603179+0000 mgr.a (mgr.14388) 1065 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:53.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:52 smithi163 bash[24253]: cluster 2024-08-31T02:35:51.603179+0000 mgr.a (mgr.14388) 1065 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:53.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:52 smithi027 bash[22610]: cluster 2024-08-31T02:35:51.603179+0000 mgr.a (mgr.14388) 1065 : cluster [DBG] pgmap v737: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:55.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:54 smithi191 bash[24992]: cluster 2024-08-31T02:35:53.605303+0000 mgr.a (mgr.14388) 1066 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:55.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:54 smithi163 bash[24253]: cluster 2024-08-31T02:35:53.605303+0000 mgr.a (mgr.14388) 1066 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:55.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:54 smithi027 bash[22610]: cluster 2024-08-31T02:35:53.605303+0000 mgr.a (mgr.14388) 1066 : cluster [DBG] pgmap v738: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:35:55.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:35:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:35:55.966 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:35:56.742 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:35:56.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:35:56.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:35:56.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:35:56.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:35:57.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:56 smithi191 bash[24992]: cluster 2024-08-31T02:35:55.606054+0000 mgr.a (mgr.14388) 1067 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:57.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:56 smithi163 bash[24253]: cluster 2024-08-31T02:35:55.606054+0000 mgr.a (mgr.14388) 1067 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:57.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:56 smithi027 bash[22610]: cluster 2024-08-31T02:35:55.606054+0000 mgr.a (mgr.14388) 1067 : cluster [DBG] pgmap v739: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:58.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:58 smithi191 bash[24992]: audit 2024-08-31T02:35:56.308948+0000 mgr.a (mgr.14388) 1068 : audit [DBG] from='client.36249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:58.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:58 smithi163 bash[24253]: audit 2024-08-31T02:35:56.308948+0000 mgr.a (mgr.14388) 1068 : audit [DBG] from='client.36249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:58.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:58 smithi027 bash[22610]: audit 2024-08-31T02:35:56.308948+0000 mgr.a (mgr.14388) 1068 : audit [DBG] from='client.36249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:35:59.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:35:59 smithi191 bash[24992]: cluster 2024-08-31T02:35:57.606917+0000 mgr.a (mgr.14388) 1069 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:59.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:35:59 smithi163 bash[24253]: cluster 2024-08-31T02:35:57.606917+0000 mgr.a (mgr.14388) 1069 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:35:59.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:35:59 smithi027 bash[22610]: cluster 2024-08-31T02:35:57.606917+0000 mgr.a (mgr.14388) 1069 : cluster [DBG] pgmap v740: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:01.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:01 smithi191 bash[24992]: cluster 2024-08-31T02:35:59.609073+0000 mgr.a (mgr.14388) 1070 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:01.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:01 smithi163 bash[24253]: cluster 2024-08-31T02:35:59.609073+0000 mgr.a (mgr.14388) 1070 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:01.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:01 smithi027 bash[22610]: cluster 2024-08-31T02:35:59.609073+0000 mgr.a (mgr.14388) 1070 : cluster [DBG] pgmap v741: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:01.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:01.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:01.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:36:02.476 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:36:02.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:36:02.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:36:02.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:36:02.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:36:03.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:03 smithi191 bash[24992]: cluster 2024-08-31T02:36:01.609808+0000 mgr.a (mgr.14388) 1071 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:03.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:03 smithi191 bash[24992]: audit 2024-08-31T02:36:02.079484+0000 mgr.a (mgr.14388) 1072 : audit [DBG] from='client.36327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:03.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:03 smithi163 bash[24253]: cluster 2024-08-31T02:36:01.609808+0000 mgr.a (mgr.14388) 1071 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:03.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:03 smithi163 bash[24253]: audit 2024-08-31T02:36:02.079484+0000 mgr.a (mgr.14388) 1072 : audit [DBG] from='client.36327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:03.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:03 smithi027 bash[22610]: cluster 2024-08-31T02:36:01.609808+0000 mgr.a (mgr.14388) 1071 : cluster [DBG] pgmap v742: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:03.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:03 smithi027 bash[22610]: audit 2024-08-31T02:36:02.079484+0000 mgr.a (mgr.14388) 1072 : audit [DBG] from='client.36327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:05.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:05 smithi191 bash[24992]: cluster 2024-08-31T02:36:03.612061+0000 mgr.a (mgr.14388) 1073 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:05 smithi163 bash[24253]: cluster 2024-08-31T02:36:03.612061+0000 mgr.a (mgr.14388) 1073 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:05.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:05 smithi027 bash[22610]: cluster 2024-08-31T02:36:03.612061+0000 mgr.a (mgr.14388) 1073 : cluster [DBG] pgmap v743: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:07.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:07 smithi191 bash[24992]: cluster 2024-08-31T02:36:05.612876+0000 mgr.a (mgr.14388) 1074 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:07.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:07 smithi163 bash[24253]: cluster 2024-08-31T02:36:05.612876+0000 mgr.a (mgr.14388) 1074 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:07.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:07.478 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:07.478 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:36:07.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:07 smithi027 bash[22610]: cluster 2024-08-31T02:36:05.612876+0000 mgr.a (mgr.14388) 1074 : cluster [DBG] pgmap v744: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:08.247 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:36:08.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:36:08.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:36:08.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:36:08.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:36:09.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:09 smithi191 bash[24992]: cluster 2024-08-31T02:36:07.613438+0000 mgr.a (mgr.14388) 1075 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:09.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:09 smithi191 bash[24992]: audit 2024-08-31T02:36:07.822217+0000 mgr.a (mgr.14388) 1076 : audit [DBG] from='client.36402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:09.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:09 smithi163 bash[24253]: cluster 2024-08-31T02:36:07.613438+0000 mgr.a (mgr.14388) 1075 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:09.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:09 smithi163 bash[24253]: audit 2024-08-31T02:36:07.822217+0000 mgr.a (mgr.14388) 1076 : audit [DBG] from='client.36402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:09.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:09 smithi027 bash[22610]: cluster 2024-08-31T02:36:07.613438+0000 mgr.a (mgr.14388) 1075 : cluster [DBG] pgmap v745: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:09.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:09 smithi027 bash[22610]: audit 2024-08-31T02:36:07.822217+0000 mgr.a (mgr.14388) 1076 : audit [DBG] from='client.36402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:11.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:11 smithi191 bash[24992]: cluster 2024-08-31T02:36:09.616094+0000 mgr.a (mgr.14388) 1077 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:36:11.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:11 smithi163 bash[24253]: cluster 2024-08-31T02:36:09.616094+0000 mgr.a (mgr.14388) 1077 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:36:11.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:11 smithi027 bash[22610]: cluster 2024-08-31T02:36:09.616094+0000 mgr.a (mgr.14388) 1077 : cluster [DBG] pgmap v746: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:36:13.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:13.249 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:13.249 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:36:13.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:13 smithi191 bash[24992]: cluster 2024-08-31T02:36:11.616860+0000 mgr.a (mgr.14388) 1078 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:36:13.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:13 smithi163 bash[24253]: cluster 2024-08-31T02:36:11.616860+0000 mgr.a (mgr.14388) 1078 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:36:13.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:13 smithi027 bash[22610]: cluster 2024-08-31T02:36:11.616860+0000 mgr.a (mgr.14388) 1078 : cluster [DBG] pgmap v747: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:36:14.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:36:14.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:36:14.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:36:14.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:36:14.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:36:15.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:15 smithi191 bash[24992]: audit 2024-08-31T02:36:13.585734+0000 mgr.a (mgr.14388) 1079 : audit [DBG] from='client.36480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:15.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:15 smithi191 bash[24992]: cluster 2024-08-31T02:36:13.619804+0000 mgr.a (mgr.14388) 1080 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:15.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:15 smithi163 bash[24253]: audit 2024-08-31T02:36:13.585734+0000 mgr.a (mgr.14388) 1079 : audit [DBG] from='client.36480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:15.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:15 smithi163 bash[24253]: cluster 2024-08-31T02:36:13.619804+0000 mgr.a (mgr.14388) 1080 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:15.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:15 smithi027 bash[22610]: audit 2024-08-31T02:36:13.585734+0000 mgr.a (mgr.14388) 1079 : audit [DBG] from='client.36480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:15.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:15 smithi027 bash[22610]: cluster 2024-08-31T02:36:13.619804+0000 mgr.a (mgr.14388) 1080 : cluster [DBG] pgmap v748: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:17.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:17 smithi163 bash[24253]: cluster 2024-08-31T02:36:15.620693+0000 mgr.a (mgr.14388) 1081 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:36:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:17 smithi163 bash[24253]: audit 2024-08-31T02:36:16.082782+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:36:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:17 smithi163 bash[24253]: audit 2024-08-31T02:36:16.930656+0000 mon.a (mon.0) 752 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:36:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:17 smithi163 bash[24253]: audit 2024-08-31T02:36:16.932219+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:36:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:17 smithi163 bash[24253]: audit 2024-08-31T02:36:16.942535+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:36:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:17 smithi163 bash[24253]: audit 2024-08-31T02:36:16.945171+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:36:17.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:17 smithi027 bash[22610]: cluster 2024-08-31T02:36:15.620693+0000 mgr.a (mgr.14388) 1081 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:36:17.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:17 smithi027 bash[22610]: audit 2024-08-31T02:36:16.082782+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:36:17.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:17 smithi027 bash[22610]: audit 2024-08-31T02:36:16.930656+0000 mon.a (mon.0) 752 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:36:17.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:17 smithi027 bash[22610]: audit 2024-08-31T02:36:16.932219+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:36:17.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:17 smithi027 bash[22610]: audit 2024-08-31T02:36:16.942535+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:36:17.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:17 smithi027 bash[22610]: audit 2024-08-31T02:36:16.945171+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:36:17.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:17 smithi191 bash[24992]: cluster 2024-08-31T02:36:15.620693+0000 mgr.a (mgr.14388) 1081 : cluster [DBG] pgmap v749: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:36:17.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:17 smithi191 bash[24992]: audit 2024-08-31T02:36:16.082782+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:36:17.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:17 smithi191 bash[24992]: audit 2024-08-31T02:36:16.930656+0000 mon.a (mon.0) 752 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:36:17.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:17 smithi191 bash[24992]: audit 2024-08-31T02:36:16.932219+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:36:17.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:17 smithi191 bash[24992]: audit 2024-08-31T02:36:16.942535+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:36:17.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:17 smithi191 bash[24992]: audit 2024-08-31T02:36:16.945171+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:36:17.979 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:36:17 smithi027 bash[22863]: debug 2024-08-31T02:36:17.657+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:36:17.979 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:36:17 smithi027 bash[22863]: debug 2024-08-31T02:36:17.657+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:36:18.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:18 smithi163 bash[24253]: audit 2024-08-31T02:36:16.947514+0000 mgr.a (mgr.14388) 1082 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:36:18.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:18 smithi027 bash[22610]: audit 2024-08-31T02:36:16.947514+0000 mgr.a (mgr.14388) 1082 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:36:18.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:18 smithi191 bash[24992]: audit 2024-08-31T02:36:16.947514+0000 mgr.a (mgr.14388) 1082 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:36:19.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:19.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:19.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:36:19.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:19 smithi163 bash[24253]: cluster 2024-08-31T02:36:17.621257+0000 mgr.a (mgr.14388) 1083 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:36:19.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:19 smithi163 bash[24253]: audit 2024-08-31T02:36:17.660674+0000 mgr.a (mgr.14388) 1084 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:36:19.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:19 smithi163 bash[24253]: cephadm 2024-08-31T02:36:17.661991+0000 mgr.a (mgr.14388) 1085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:36:19.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:19 smithi027 bash[22610]: cluster 2024-08-31T02:36:17.621257+0000 mgr.a (mgr.14388) 1083 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:36:19.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:19 smithi027 bash[22610]: audit 2024-08-31T02:36:17.660674+0000 mgr.a (mgr.14388) 1084 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:36:19.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:19 smithi027 bash[22610]: cephadm 2024-08-31T02:36:17.661991+0000 mgr.a (mgr.14388) 1085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:36:19.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:19 smithi191 bash[24992]: cluster 2024-08-31T02:36:17.621257+0000 mgr.a (mgr.14388) 1083 : cluster [DBG] pgmap v750: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:36:19.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:19 smithi191 bash[24992]: audit 2024-08-31T02:36:17.660674+0000 mgr.a (mgr.14388) 1084 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:36:19.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:19 smithi191 bash[24992]: cephadm 2024-08-31T02:36:17.661991+0000 mgr.a (mgr.14388) 1085 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:36:19.757 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:36:19.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:36:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:36:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:36:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:36:21.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:21 smithi163 bash[24253]: audit 2024-08-31T02:36:19.353107+0000 mgr.a (mgr.14388) 1086 : audit [DBG] from='client.36663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:21.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:21 smithi163 bash[24253]: cluster 2024-08-31T02:36:19.623000+0000 mgr.a (mgr.14388) 1087 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:21.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:21 smithi027 bash[22610]: audit 2024-08-31T02:36:19.353107+0000 mgr.a (mgr.14388) 1086 : audit [DBG] from='client.36663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:21.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:21 smithi027 bash[22610]: cluster 2024-08-31T02:36:19.623000+0000 mgr.a (mgr.14388) 1087 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:21.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:21 smithi191 bash[24992]: audit 2024-08-31T02:36:19.353107+0000 mgr.a (mgr.14388) 1086 : audit [DBG] from='client.36663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:21.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:21 smithi191 bash[24992]: cluster 2024-08-31T02:36:19.623000+0000 mgr.a (mgr.14388) 1087 : cluster [DBG] pgmap v751: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:23.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:23 smithi163 bash[24253]: cluster 2024-08-31T02:36:21.623991+0000 mgr.a (mgr.14388) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:36:23.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:23 smithi027 bash[22610]: cluster 2024-08-31T02:36:21.623991+0000 mgr.a (mgr.14388) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:36:23.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:23 smithi191 bash[24992]: cluster 2024-08-31T02:36:21.623991+0000 mgr.a (mgr.14388) 1088 : cluster [DBG] pgmap v752: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:36:24.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:24.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:24.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:36:25.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:25 smithi163 bash[24253]: cluster 2024-08-31T02:36:23.626174+0000 mgr.a (mgr.14388) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:25.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:25 smithi027 bash[22610]: cluster 2024-08-31T02:36:23.626174+0000 mgr.a (mgr.14388) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:25.491 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:36:25.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:36:25.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:36:25.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:36:25.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:36:25.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:25 smithi191 bash[24992]: cluster 2024-08-31T02:36:23.626174+0000 mgr.a (mgr.14388) 1089 : cluster [DBG] pgmap v753: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:27.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:27 smithi163 bash[24253]: audit 2024-08-31T02:36:25.095692+0000 mgr.a (mgr.14388) 1090 : audit [DBG] from='client.36741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:27.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:27 smithi163 bash[24253]: cluster 2024-08-31T02:36:25.627062+0000 mgr.a (mgr.14388) 1091 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:27.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:27 smithi027 bash[22610]: audit 2024-08-31T02:36:25.095692+0000 mgr.a (mgr.14388) 1090 : audit [DBG] from='client.36741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:27.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:27 smithi027 bash[22610]: cluster 2024-08-31T02:36:25.627062+0000 mgr.a (mgr.14388) 1091 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:27.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:27 smithi191 bash[24992]: audit 2024-08-31T02:36:25.095692+0000 mgr.a (mgr.14388) 1090 : audit [DBG] from='client.36741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:27.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:27 smithi191 bash[24992]: cluster 2024-08-31T02:36:25.627062+0000 mgr.a (mgr.14388) 1091 : cluster [DBG] pgmap v754: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:29.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:29 smithi163 bash[24253]: cluster 2024-08-31T02:36:27.627796+0000 mgr.a (mgr.14388) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:29.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:29 smithi027 bash[22610]: cluster 2024-08-31T02:36:27.627796+0000 mgr.a (mgr.14388) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:29.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:29 smithi191 bash[24992]: cluster 2024-08-31T02:36:27.627796+0000 mgr.a (mgr.14388) 1092 : cluster [DBG] pgmap v755: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:30.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:36:31.264 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:36:31.264 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:36:31.264 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:36:31.264 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:36:31.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:36:31.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:31 smithi163 bash[24253]: cluster 2024-08-31T02:36:29.629979+0000 mgr.a (mgr.14388) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:31.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:31 smithi027 bash[22610]: cluster 2024-08-31T02:36:29.629979+0000 mgr.a (mgr.14388) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:31.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:31 smithi191 bash[24992]: cluster 2024-08-31T02:36:29.629979+0000 mgr.a (mgr.14388) 1093 : cluster [DBG] pgmap v756: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:36:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:32 smithi163 bash[24253]: audit 2024-08-31T02:36:30.838710+0000 mgr.a (mgr.14388) 1094 : audit [DBG] from='client.36813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:32.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:32 smithi027 bash[22610]: audit 2024-08-31T02:36:30.838710+0000 mgr.a (mgr.14388) 1094 : audit [DBG] from='client.36813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:32.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:32 smithi191 bash[24992]: audit 2024-08-31T02:36:30.838710+0000 mgr.a (mgr.14388) 1094 : audit [DBG] from='client.36813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:33.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:33 smithi163 bash[24253]: cluster 2024-08-31T02:36:31.630853+0000 mgr.a (mgr.14388) 1095 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:33.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:33 smithi027 bash[22610]: cluster 2024-08-31T02:36:31.630853+0000 mgr.a (mgr.14388) 1095 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:33.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:33 smithi191 bash[24992]: cluster 2024-08-31T02:36:31.630853+0000 mgr.a (mgr.14388) 1095 : cluster [DBG] pgmap v757: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:35.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:35 smithi163 bash[24253]: cluster 2024-08-31T02:36:33.632909+0000 mgr.a (mgr.14388) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:35.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:35 smithi027 bash[22610]: cluster 2024-08-31T02:36:33.632909+0000 mgr.a (mgr.14388) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:35.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:35 smithi191 bash[24992]: cluster 2024-08-31T02:36:33.632909+0000 mgr.a (mgr.14388) 1096 : cluster [DBG] pgmap v758: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:36.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:36.266 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:36.266 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:36:36.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:36 smithi163 bash[24253]: cluster 2024-08-31T02:36:35.633659+0000 mgr.a (mgr.14388) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:36.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:36 smithi027 bash[22610]: cluster 2024-08-31T02:36:35.633659+0000 mgr.a (mgr.14388) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:36.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:36 smithi191 bash[24992]: cluster 2024-08-31T02:36:35.633659+0000 mgr.a (mgr.14388) 1097 : cluster [DBG] pgmap v759: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:37.009 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:36:37.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:36:37.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:36:37.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:36:37.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:36:37.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:37 smithi163 bash[24253]: audit 2024-08-31T02:36:36.603699+0000 mgr.a (mgr.14388) 1098 : audit [DBG] from='client.36891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:37.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:37 smithi027 bash[22610]: audit 2024-08-31T02:36:36.603699+0000 mgr.a (mgr.14388) 1098 : audit [DBG] from='client.36891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:37.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:37 smithi191 bash[24992]: audit 2024-08-31T02:36:36.603699+0000 mgr.a (mgr.14388) 1098 : audit [DBG] from='client.36891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:38.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:38 smithi163 bash[24253]: cluster 2024-08-31T02:36:37.634555+0000 mgr.a (mgr.14388) 1099 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:38.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:38 smithi027 bash[22610]: cluster 2024-08-31T02:36:37.634555+0000 mgr.a (mgr.14388) 1099 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:38.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:38 smithi191 bash[24992]: cluster 2024-08-31T02:36:37.634555+0000 mgr.a (mgr.14388) 1099 : cluster [DBG] pgmap v760: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:40.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:40 smithi163 bash[24253]: cluster 2024-08-31T02:36:39.636756+0000 mgr.a (mgr.14388) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:40.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:40 smithi027 bash[22610]: cluster 2024-08-31T02:36:39.636756+0000 mgr.a (mgr.14388) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:41.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:40 smithi191 bash[24992]: cluster 2024-08-31T02:36:39.636756+0000 mgr.a (mgr.14388) 1100 : cluster [DBG] pgmap v761: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:42.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:42.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:42.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:36:42.777 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:36:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:36:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:36:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:36:42.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:36:42.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:42 smithi163 bash[24253]: cluster 2024-08-31T02:36:41.637521+0000 mgr.a (mgr.14388) 1101 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:42.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:42 smithi027 bash[22610]: cluster 2024-08-31T02:36:41.637521+0000 mgr.a (mgr.14388) 1101 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:43.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:42 smithi191 bash[24992]: cluster 2024-08-31T02:36:41.637521+0000 mgr.a (mgr.14388) 1101 : cluster [DBG] pgmap v762: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:43.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:43 smithi027 bash[22610]: audit 2024-08-31T02:36:42.355624+0000 mgr.a (mgr.14388) 1102 : audit [DBG] from='client.36969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:44.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:43 smithi191 bash[24992]: audit 2024-08-31T02:36:42.355624+0000 mgr.a (mgr.14388) 1102 : audit [DBG] from='client.36969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:44.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:43 smithi163 bash[24253]: audit 2024-08-31T02:36:42.355624+0000 mgr.a (mgr.14388) 1102 : audit [DBG] from='client.36969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:44.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:44 smithi027 bash[22610]: cluster 2024-08-31T02:36:43.639781+0000 mgr.a (mgr.14388) 1103 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:45.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:44 smithi191 bash[24992]: cluster 2024-08-31T02:36:43.639781+0000 mgr.a (mgr.14388) 1103 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:45.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:44 smithi163 bash[24253]: cluster 2024-08-31T02:36:43.639781+0000 mgr.a (mgr.14388) 1103 : cluster [DBG] pgmap v763: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:36:46.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:46 smithi027 bash[22610]: cluster 2024-08-31T02:36:45.640527+0000 mgr.a (mgr.14388) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:47.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:46 smithi191 bash[24992]: cluster 2024-08-31T02:36:45.640527+0000 mgr.a (mgr.14388) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:47.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:46 smithi163 bash[24253]: cluster 2024-08-31T02:36:45.640527+0000 mgr.a (mgr.14388) 1104 : cluster [DBG] pgmap v764: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:47.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:47.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:47.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:36:48.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:36:48.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:36:48.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:36:48.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:36:48.545 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:36:48.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:48 smithi027 bash[22610]: cluster 2024-08-31T02:36:47.641274+0000 mgr.a (mgr.14388) 1105 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:49.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:48 smithi191 bash[24992]: cluster 2024-08-31T02:36:47.641274+0000 mgr.a (mgr.14388) 1105 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:49.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:48 smithi163 bash[24253]: cluster 2024-08-31T02:36:47.641274+0000 mgr.a (mgr.14388) 1105 : cluster [DBG] pgmap v765: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:49.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:49 smithi027 bash[22610]: audit 2024-08-31T02:36:48.116408+0000 mgr.a (mgr.14388) 1106 : audit [DBG] from='client.37047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:50.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:49 smithi191 bash[24992]: audit 2024-08-31T02:36:48.116408+0000 mgr.a (mgr.14388) 1106 : audit [DBG] from='client.37047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:50.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:49 smithi163 bash[24253]: audit 2024-08-31T02:36:48.116408+0000 mgr.a (mgr.14388) 1106 : audit [DBG] from='client.37047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:50.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:50 smithi027 bash[22610]: cluster 2024-08-31T02:36:49.644078+0000 mgr.a (mgr.14388) 1107 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:51.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:50 smithi191 bash[24992]: cluster 2024-08-31T02:36:49.644078+0000 mgr.a (mgr.14388) 1107 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:51.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:50 smithi163 bash[24253]: cluster 2024-08-31T02:36:49.644078+0000 mgr.a (mgr.14388) 1107 : cluster [DBG] pgmap v766: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:53.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:52 smithi191 bash[24992]: cluster 2024-08-31T02:36:51.644881+0000 mgr.a (mgr.14388) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:36:53.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:52 smithi163 bash[24253]: cluster 2024-08-31T02:36:51.644881+0000 mgr.a (mgr.14388) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:36:53.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:52 smithi027 bash[22610]: cluster 2024-08-31T02:36:51.644881+0000 mgr.a (mgr.14388) 1108 : cluster [DBG] pgmap v767: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:36:53.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:53.547 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:53.547 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:36:54.287 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:36:54.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:36:54.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:36:54.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:36:54.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:36:55.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:54 smithi191 bash[24992]: cluster 2024-08-31T02:36:53.645927+0000 mgr.a (mgr.14388) 1109 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:55.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:54 smithi191 bash[24992]: audit 2024-08-31T02:36:53.885540+0000 mgr.a (mgr.14388) 1110 : audit [DBG] from='client.37119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:55.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:54 smithi163 bash[24253]: cluster 2024-08-31T02:36:53.645927+0000 mgr.a (mgr.14388) 1109 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:55.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:54 smithi163 bash[24253]: audit 2024-08-31T02:36:53.885540+0000 mgr.a (mgr.14388) 1110 : audit [DBG] from='client.37119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:55.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:54 smithi027 bash[22610]: cluster 2024-08-31T02:36:53.645927+0000 mgr.a (mgr.14388) 1109 : cluster [DBG] pgmap v768: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:36:55.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:54 smithi027 bash[22610]: audit 2024-08-31T02:36:53.885540+0000 mgr.a (mgr.14388) 1110 : audit [DBG] from='client.37119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:36:57.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:56 smithi191 bash[24992]: cluster 2024-08-31T02:36:55.646866+0000 mgr.a (mgr.14388) 1111 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:36:57.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:56 smithi163 bash[24253]: cluster 2024-08-31T02:36:55.646866+0000 mgr.a (mgr.14388) 1111 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:36:57.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:56 smithi027 bash[22610]: cluster 2024-08-31T02:36:55.646866+0000 mgr.a (mgr.14388) 1111 : cluster [DBG] pgmap v769: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:36:59.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:36:58 smithi191 bash[24992]: cluster 2024-08-31T02:36:57.647570+0000 mgr.a (mgr.14388) 1112 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:36:59.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:36:58 smithi163 bash[24253]: cluster 2024-08-31T02:36:57.647570+0000 mgr.a (mgr.14388) 1112 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:36:59.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:36:58 smithi027 bash[22610]: cluster 2024-08-31T02:36:57.647570+0000 mgr.a (mgr.14388) 1112 : cluster [DBG] pgmap v770: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:36:59.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:36:59.289 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:36:59.290 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:00.021 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:00.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:00.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:00.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:00.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:01.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:00 smithi191 bash[24992]: audit 2024-08-31T02:36:59.624769+0000 mgr.a (mgr.14388) 1113 : audit [DBG] from='client.37191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:01.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:00 smithi191 bash[24992]: cluster 2024-08-31T02:36:59.650309+0000 mgr.a (mgr.14388) 1114 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:01.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:00 smithi163 bash[24253]: audit 2024-08-31T02:36:59.624769+0000 mgr.a (mgr.14388) 1113 : audit [DBG] from='client.37191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:01.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:00 smithi163 bash[24253]: cluster 2024-08-31T02:36:59.650309+0000 mgr.a (mgr.14388) 1114 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:01.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:00 smithi027 bash[22610]: audit 2024-08-31T02:36:59.624769+0000 mgr.a (mgr.14388) 1113 : audit [DBG] from='client.37191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:01.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:00 smithi027 bash[22610]: cluster 2024-08-31T02:36:59.650309+0000 mgr.a (mgr.14388) 1114 : cluster [DBG] pgmap v771: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:03.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:02 smithi191 bash[24992]: cluster 2024-08-31T02:37:01.651316+0000 mgr.a (mgr.14388) 1115 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:03.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:02 smithi163 bash[24253]: cluster 2024-08-31T02:37:01.651316+0000 mgr.a (mgr.14388) 1115 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:03.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:02 smithi027 bash[22610]: cluster 2024-08-31T02:37:01.651316+0000 mgr.a (mgr.14388) 1115 : cluster [DBG] pgmap v772: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:05.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:37:05.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:37:05.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:05.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:04 smithi191 bash[24992]: cluster 2024-08-31T02:37:03.653458+0000 mgr.a (mgr.14388) 1116 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:05.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:04 smithi163 bash[24253]: cluster 2024-08-31T02:37:03.653458+0000 mgr.a (mgr.14388) 1116 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:05.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:04 smithi027 bash[22610]: cluster 2024-08-31T02:37:03.653458+0000 mgr.a (mgr.14388) 1116 : cluster [DBG] pgmap v773: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:05.766 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:05.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:05.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:05.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:05.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:06.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:06 smithi191 bash[24992]: audit 2024-08-31T02:37:05.365531+0000 mgr.a (mgr.14388) 1117 : audit [DBG] from='client.37269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:06.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:06 smithi191 bash[24992]: cluster 2024-08-31T02:37:05.653910+0000 mgr.a (mgr.14388) 1118 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:06.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:06 smithi163 bash[24253]: audit 2024-08-31T02:37:05.365531+0000 mgr.a (mgr.14388) 1117 : audit [DBG] from='client.37269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:06.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:06 smithi163 bash[24253]: cluster 2024-08-31T02:37:05.653910+0000 mgr.a (mgr.14388) 1118 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:06.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:06 smithi027 bash[22610]: audit 2024-08-31T02:37:05.365531+0000 mgr.a (mgr.14388) 1117 : audit [DBG] from='client.37269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:06.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:06 smithi027 bash[22610]: cluster 2024-08-31T02:37:05.653910+0000 mgr.a (mgr.14388) 1118 : cluster [DBG] pgmap v774: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:08.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:08 smithi027 bash[22610]: cluster 2024-08-31T02:37:07.654717+0000 mgr.a (mgr.14388) 1119 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:09.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:08 smithi191 bash[24992]: cluster 2024-08-31T02:37:07.654717+0000 mgr.a (mgr.14388) 1119 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:09.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:08 smithi163 bash[24253]: cluster 2024-08-31T02:37:07.654717+0000 mgr.a (mgr.14388) 1119 : cluster [DBG] pgmap v775: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:10.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:37:10.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:37:10.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:10.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:10 smithi027 bash[22610]: cluster 2024-08-31T02:37:09.656999+0000 mgr.a (mgr.14388) 1120 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:11.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:10 smithi191 bash[24992]: cluster 2024-08-31T02:37:09.656999+0000 mgr.a (mgr.14388) 1120 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:11.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:10 smithi163 bash[24253]: cluster 2024-08-31T02:37:09.656999+0000 mgr.a (mgr.14388) 1120 : cluster [DBG] pgmap v776: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:11.536 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:11.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:11.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:11.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:11.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:12.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:12 smithi027 bash[22610]: audit 2024-08-31T02:37:11.108159+0000 mgr.a (mgr.14388) 1121 : audit [DBG] from='client.37344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:12.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:12 smithi027 bash[22610]: cluster 2024-08-31T02:37:11.658125+0000 mgr.a (mgr.14388) 1122 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:12 smithi191 bash[24992]: audit 2024-08-31T02:37:11.108159+0000 mgr.a (mgr.14388) 1121 : audit [DBG] from='client.37344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:13.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:12 smithi191 bash[24992]: cluster 2024-08-31T02:37:11.658125+0000 mgr.a (mgr.14388) 1122 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:13.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:12 smithi163 bash[24253]: audit 2024-08-31T02:37:11.108159+0000 mgr.a (mgr.14388) 1121 : audit [DBG] from='client.37344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:13.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:12 smithi163 bash[24253]: cluster 2024-08-31T02:37:11.658125+0000 mgr.a (mgr.14388) 1122 : cluster [DBG] pgmap v777: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:14.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:14 smithi027 bash[22610]: cluster 2024-08-31T02:37:13.660514+0000 mgr.a (mgr.14388) 1123 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:15.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:14 smithi191 bash[24992]: cluster 2024-08-31T02:37:13.660514+0000 mgr.a (mgr.14388) 1123 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:15.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:14 smithi163 bash[24253]: cluster 2024-08-31T02:37:13.660514+0000 mgr.a (mgr.14388) 1123 : cluster [DBG] pgmap v778: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:16.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:37:16.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:37:16.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:16.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:16 smithi027 bash[22610]: cluster 2024-08-31T02:37:15.661430+0000 mgr.a (mgr.14388) 1124 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:17.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:16 smithi191 bash[24992]: cluster 2024-08-31T02:37:15.661430+0000 mgr.a (mgr.14388) 1124 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:17.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:16 smithi163 bash[24253]: cluster 2024-08-31T02:37:15.661430+0000 mgr.a (mgr.14388) 1124 : cluster [DBG] pgmap v779: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:17.277 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:17.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:17.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:17.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:17.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:18.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:17 smithi191 bash[24992]: audit 2024-08-31T02:37:16.876591+0000 mgr.a (mgr.14388) 1125 : audit [DBG] from='client.37422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:18.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:17 smithi191 bash[24992]: audit 2024-08-31T02:37:17.712206+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:37:18.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:17 smithi163 bash[24253]: audit 2024-08-31T02:37:16.876591+0000 mgr.a (mgr.14388) 1125 : audit [DBG] from='client.37422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:18.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:17 smithi163 bash[24253]: audit 2024-08-31T02:37:17.712206+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:37:18.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:17 smithi027 bash[22610]: audit 2024-08-31T02:37:16.876591+0000 mgr.a (mgr.14388) 1125 : audit [DBG] from='client.37422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:18.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:17 smithi027 bash[22610]: audit 2024-08-31T02:37:17.712206+0000 mon.a (mon.0) 756 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:37:19.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:18 smithi191 bash[24992]: cluster 2024-08-31T02:37:17.662417+0000 mgr.a (mgr.14388) 1126 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:19.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:18 smithi191 bash[24992]: audit 2024-08-31T02:37:18.338367+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:37:19.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:18 smithi191 bash[24992]: audit 2024-08-31T02:37:18.343136+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:37:19.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:18 smithi163 bash[24253]: cluster 2024-08-31T02:37:17.662417+0000 mgr.a (mgr.14388) 1126 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:19.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:18 smithi163 bash[24253]: audit 2024-08-31T02:37:18.338367+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:37:19.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:18 smithi163 bash[24253]: audit 2024-08-31T02:37:18.343136+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:37:19.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:18 smithi027 bash[22610]: cluster 2024-08-31T02:37:17.662417+0000 mgr.a (mgr.14388) 1126 : cluster [DBG] pgmap v780: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:19.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:18 smithi027 bash[22610]: audit 2024-08-31T02:37:18.338367+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:37:19.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:18 smithi027 bash[22610]: audit 2024-08-31T02:37:18.343136+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:37:20.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:19 smithi191 bash[24992]: audit 2024-08-31T02:37:19.106238+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:37:20.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:19 smithi191 bash[24992]: audit 2024-08-31T02:37:19.107832+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:37:20.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:19 smithi191 bash[24992]: audit 2024-08-31T02:37:19.117946+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:37:20.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:19 smithi191 bash[24992]: audit 2024-08-31T02:37:19.120229+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:37:20.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:19 smithi163 bash[24253]: audit 2024-08-31T02:37:19.106238+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:37:20.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:19 smithi163 bash[24253]: audit 2024-08-31T02:37:19.107832+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:37:20.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:19 smithi163 bash[24253]: audit 2024-08-31T02:37:19.117946+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:37:20.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:19 smithi163 bash[24253]: audit 2024-08-31T02:37:19.120229+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:37:20.229 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:37:19 smithi027 bash[22863]: debug 2024-08-31T02:37:19.819+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:37:20.229 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:37:19 smithi027 bash[22863]: debug 2024-08-31T02:37:19.819+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:37:20.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:19 smithi027 bash[22610]: audit 2024-08-31T02:37:19.106238+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:37:20.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:19 smithi027 bash[22610]: audit 2024-08-31T02:37:19.107832+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:37:20.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:19 smithi027 bash[22610]: audit 2024-08-31T02:37:19.117946+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:37:20.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:19 smithi027 bash[22610]: audit 2024-08-31T02:37:19.120229+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:37:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:20 smithi191 bash[24992]: audit 2024-08-31T02:37:19.122492+0000 mgr.a (mgr.14388) 1127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:37:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:20 smithi191 bash[24992]: cluster 2024-08-31T02:37:19.663757+0000 mgr.a (mgr.14388) 1128 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:21.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:20 smithi191 bash[24992]: audit 2024-08-31T02:37:19.823345+0000 mgr.a (mgr.14388) 1129 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:37:21.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:20 smithi191 bash[24992]: cephadm 2024-08-31T02:37:19.824669+0000 mgr.a (mgr.14388) 1130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:37:21.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:20 smithi163 bash[24253]: audit 2024-08-31T02:37:19.122492+0000 mgr.a (mgr.14388) 1127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:37:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:20 smithi163 bash[24253]: cluster 2024-08-31T02:37:19.663757+0000 mgr.a (mgr.14388) 1128 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:20 smithi163 bash[24253]: audit 2024-08-31T02:37:19.823345+0000 mgr.a (mgr.14388) 1129 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:37:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:20 smithi163 bash[24253]: cephadm 2024-08-31T02:37:19.824669+0000 mgr.a (mgr.14388) 1130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:37:21.239 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:20 smithi027 bash[22610]: audit 2024-08-31T02:37:19.122492+0000 mgr.a (mgr.14388) 1127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:37:21.239 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:20 smithi027 bash[22610]: cluster 2024-08-31T02:37:19.663757+0000 mgr.a (mgr.14388) 1128 : cluster [DBG] pgmap v781: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:21.239 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:20 smithi027 bash[22610]: audit 2024-08-31T02:37:19.823345+0000 mgr.a (mgr.14388) 1129 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:37:21.239 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:20 smithi027 bash[22610]: cephadm 2024-08-31T02:37:19.824669+0000 mgr.a (mgr.14388) 1130 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:37:22.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:37:22.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:37:22.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:23.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:22 smithi191 bash[24992]: cluster 2024-08-31T02:37:21.664506+0000 mgr.a (mgr.14388) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:23.060 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:23.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:23.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:22 smithi163 bash[24253]: cluster 2024-08-31T02:37:21.664506+0000 mgr.a (mgr.14388) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:23.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:22 smithi027 bash[22610]: cluster 2024-08-31T02:37:21.664506+0000 mgr.a (mgr.14388) 1131 : cluster [DBG] pgmap v782: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:24.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:23 smithi191 bash[24992]: audit 2024-08-31T02:37:22.623149+0000 mgr.a (mgr.14388) 1132 : audit [DBG] from='client.37605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:24.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:23 smithi163 bash[24253]: audit 2024-08-31T02:37:22.623149+0000 mgr.a (mgr.14388) 1132 : audit [DBG] from='client.37605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:24.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:23 smithi027 bash[22610]: audit 2024-08-31T02:37:22.623149+0000 mgr.a (mgr.14388) 1132 : audit [DBG] from='client.37605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:25.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:24 smithi191 bash[24992]: cluster 2024-08-31T02:37:23.666895+0000 mgr.a (mgr.14388) 1133 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:37:25.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:24 smithi163 bash[24253]: cluster 2024-08-31T02:37:23.666895+0000 mgr.a (mgr.14388) 1133 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:37:25.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:24 smithi027 bash[22610]: cluster 2024-08-31T02:37:23.666895+0000 mgr.a (mgr.14388) 1133 : cluster [DBG] pgmap v783: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:37:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:26 smithi191 bash[24992]: cluster 2024-08-31T02:37:25.667700+0000 mgr.a (mgr.14388) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:37:27.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:26 smithi163 bash[24253]: cluster 2024-08-31T02:37:25.667700+0000 mgr.a (mgr.14388) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:37:27.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:26 smithi027 bash[22610]: cluster 2024-08-31T02:37:25.667700+0000 mgr.a (mgr.14388) 1134 : cluster [DBG] pgmap v784: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:37:28.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:37:28.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:37:28.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:28.808 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:28.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:28.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:29.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:28 smithi191 bash[24992]: cluster 2024-08-31T02:37:27.668454+0000 mgr.a (mgr.14388) 1135 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:37:29.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:28 smithi163 bash[24253]: cluster 2024-08-31T02:37:27.668454+0000 mgr.a (mgr.14388) 1135 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:37:29.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:28 smithi027 bash[22610]: cluster 2024-08-31T02:37:27.668454+0000 mgr.a (mgr.14388) 1135 : cluster [DBG] pgmap v785: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:37:30.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:29 smithi191 bash[24992]: audit 2024-08-31T02:37:28.400586+0000 mgr.a (mgr.14388) 1136 : audit [DBG] from='client.37683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:30.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:29 smithi163 bash[24253]: audit 2024-08-31T02:37:28.400586+0000 mgr.a (mgr.14388) 1136 : audit [DBG] from='client.37683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:30.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:29 smithi027 bash[22610]: audit 2024-08-31T02:37:28.400586+0000 mgr.a (mgr.14388) 1136 : audit [DBG] from='client.37683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:31.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:30 smithi191 bash[24992]: cluster 2024-08-31T02:37:29.671193+0000 mgr.a (mgr.14388) 1137 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:37:31.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:30 smithi163 bash[24253]: cluster 2024-08-31T02:37:29.671193+0000 mgr.a (mgr.14388) 1137 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:37:31.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:30 smithi027 bash[22610]: cluster 2024-08-31T02:37:29.671193+0000 mgr.a (mgr.14388) 1137 : cluster [DBG] pgmap v786: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:37:33.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:32 smithi191 bash[24992]: cluster 2024-08-31T02:37:31.671990+0000 mgr.a (mgr.14388) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:37:33.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:32 smithi163 bash[24253]: cluster 2024-08-31T02:37:31.671990+0000 mgr.a (mgr.14388) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:37:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:32 smithi027 bash[22610]: cluster 2024-08-31T02:37:31.671990+0000 mgr.a (mgr.14388) 1138 : cluster [DBG] pgmap v787: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:37:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:37:33.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:37:33.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:34.546 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:34.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:34.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:34.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:34.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:35.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:34 smithi191 bash[24992]: cluster 2024-08-31T02:37:33.673883+0000 mgr.a (mgr.14388) 1139 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:37:35.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:34 smithi163 bash[24253]: cluster 2024-08-31T02:37:33.673883+0000 mgr.a (mgr.14388) 1139 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:37:35.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:34 smithi027 bash[22610]: cluster 2024-08-31T02:37:33.673883+0000 mgr.a (mgr.14388) 1139 : cluster [DBG] pgmap v788: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:37:36.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:35 smithi163 bash[24253]: audit 2024-08-31T02:37:34.143814+0000 mgr.a (mgr.14388) 1140 : audit [DBG] from='client.37755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:36.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:35 smithi027 bash[22610]: audit 2024-08-31T02:37:34.143814+0000 mgr.a (mgr.14388) 1140 : audit [DBG] from='client.37755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:36.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:35 smithi191 bash[24992]: audit 2024-08-31T02:37:34.143814+0000 mgr.a (mgr.14388) 1140 : audit [DBG] from='client.37755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:37.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:36 smithi163 bash[24253]: cluster 2024-08-31T02:37:35.674862+0000 mgr.a (mgr.14388) 1141 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:37:37.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:36 smithi027 bash[22610]: cluster 2024-08-31T02:37:35.674862+0000 mgr.a (mgr.14388) 1141 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:37:37.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:36 smithi191 bash[24992]: cluster 2024-08-31T02:37:35.674862+0000 mgr.a (mgr.14388) 1141 : cluster [DBG] pgmap v789: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:37:39.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:38 smithi163 bash[24253]: cluster 2024-08-31T02:37:37.675635+0000 mgr.a (mgr.14388) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:37:39.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:38 smithi027 bash[22610]: cluster 2024-08-31T02:37:37.675635+0000 mgr.a (mgr.14388) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:37:39.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:38 smithi191 bash[24992]: cluster 2024-08-31T02:37:37.675635+0000 mgr.a (mgr.14388) 1142 : cluster [DBG] pgmap v790: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:37:39.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:37:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:37:39.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:40.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:40.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:41.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:40 smithi163 bash[24253]: cluster 2024-08-31T02:37:39.676673+0000 mgr.a (mgr.14388) 1143 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:37:41.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:40 smithi163 bash[24253]: audit 2024-08-31T02:37:39.883345+0000 mgr.a (mgr.14388) 1144 : audit [DBG] from='client.37830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:41.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:40 smithi027 bash[22610]: cluster 2024-08-31T02:37:39.676673+0000 mgr.a (mgr.14388) 1143 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:37:41.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:40 smithi027 bash[22610]: audit 2024-08-31T02:37:39.883345+0000 mgr.a (mgr.14388) 1144 : audit [DBG] from='client.37830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:41.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:40 smithi191 bash[24992]: cluster 2024-08-31T02:37:39.676673+0000 mgr.a (mgr.14388) 1143 : cluster [DBG] pgmap v791: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:37:41.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:40 smithi191 bash[24992]: audit 2024-08-31T02:37:39.883345+0000 mgr.a (mgr.14388) 1144 : audit [DBG] from='client.37830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:43.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:42 smithi163 bash[24253]: cluster 2024-08-31T02:37:41.677597+0000 mgr.a (mgr.14388) 1145 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:43.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:42 smithi027 bash[22610]: cluster 2024-08-31T02:37:41.677597+0000 mgr.a (mgr.14388) 1145 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:43.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:42 smithi191 bash[24992]: cluster 2024-08-31T02:37:41.677597+0000 mgr.a (mgr.14388) 1145 : cluster [DBG] pgmap v792: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:45.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:44 smithi163 bash[24253]: cluster 2024-08-31T02:37:43.679765+0000 mgr.a (mgr.14388) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:45.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:44 smithi027 bash[22610]: cluster 2024-08-31T02:37:43.679765+0000 mgr.a (mgr.14388) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:45.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:44 smithi191 bash[24992]: cluster 2024-08-31T02:37:43.679765+0000 mgr.a (mgr.14388) 1146 : cluster [DBG] pgmap v793: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:45.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:37:45.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:37:45.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:46.037 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:46.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:46.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:46.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:46.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:47.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:46 smithi163 bash[24253]: audit 2024-08-31T02:37:45.629313+0000 mgr.a (mgr.14388) 1147 : audit [DBG] from='client.37905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:47.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:46 smithi163 bash[24253]: cluster 2024-08-31T02:37:45.680743+0000 mgr.a (mgr.14388) 1148 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:46 smithi027 bash[22610]: audit 2024-08-31T02:37:45.629313+0000 mgr.a (mgr.14388) 1147 : audit [DBG] from='client.37905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:46 smithi027 bash[22610]: cluster 2024-08-31T02:37:45.680743+0000 mgr.a (mgr.14388) 1148 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:47.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:46 smithi191 bash[24992]: audit 2024-08-31T02:37:45.629313+0000 mgr.a (mgr.14388) 1147 : audit [DBG] from='client.37905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:47.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:46 smithi191 bash[24992]: cluster 2024-08-31T02:37:45.680743+0000 mgr.a (mgr.14388) 1148 : cluster [DBG] pgmap v794: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:49.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:48 smithi163 bash[24253]: cluster 2024-08-31T02:37:47.681657+0000 mgr.a (mgr.14388) 1149 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:49.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:48 smithi027 bash[22610]: cluster 2024-08-31T02:37:47.681657+0000 mgr.a (mgr.14388) 1149 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:49.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:48 smithi191 bash[24992]: cluster 2024-08-31T02:37:47.681657+0000 mgr.a (mgr.14388) 1149 : cluster [DBG] pgmap v795: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:51.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:37:51.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:37:51.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:51.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:50 smithi163 bash[24253]: cluster 2024-08-31T02:37:49.683930+0000 mgr.a (mgr.14388) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:51.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:50 smithi027 bash[22610]: cluster 2024-08-31T02:37:49.683930+0000 mgr.a (mgr.14388) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:51.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:50 smithi191 bash[24992]: cluster 2024-08-31T02:37:49.683930+0000 mgr.a (mgr.14388) 1150 : cluster [DBG] pgmap v796: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:51.816 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:51.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:51.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:51.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:51.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:53.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:52 smithi163 bash[24253]: audit 2024-08-31T02:37:51.379646+0000 mgr.a (mgr.14388) 1151 : audit [DBG] from='client.37980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:53.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:52 smithi163 bash[24253]: cluster 2024-08-31T02:37:51.684603+0000 mgr.a (mgr.14388) 1152 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:53.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:52 smithi027 bash[22610]: audit 2024-08-31T02:37:51.379646+0000 mgr.a (mgr.14388) 1151 : audit [DBG] from='client.37980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:53.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:52 smithi027 bash[22610]: cluster 2024-08-31T02:37:51.684603+0000 mgr.a (mgr.14388) 1152 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:53.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:52 smithi191 bash[24992]: audit 2024-08-31T02:37:51.379646+0000 mgr.a (mgr.14388) 1151 : audit [DBG] from='client.37980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:53.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:52 smithi191 bash[24992]: cluster 2024-08-31T02:37:51.684603+0000 mgr.a (mgr.14388) 1152 : cluster [DBG] pgmap v797: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:55.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:54 smithi163 bash[24253]: cluster 2024-08-31T02:37:53.686819+0000 mgr.a (mgr.14388) 1153 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:55.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:54 smithi027 bash[22610]: cluster 2024-08-31T02:37:53.686819+0000 mgr.a (mgr.14388) 1153 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:55.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:54 smithi191 bash[24992]: cluster 2024-08-31T02:37:53.686819+0000 mgr.a (mgr.14388) 1153 : cluster [DBG] pgmap v798: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:37:56.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:37:56.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:37:56.819 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:37:57.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:56 smithi163 bash[24253]: cluster 2024-08-31T02:37:55.687596+0000 mgr.a (mgr.14388) 1154 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:57.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:56 smithi027 bash[22610]: cluster 2024-08-31T02:37:55.687596+0000 mgr.a (mgr.14388) 1154 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:57.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:56 smithi191 bash[24992]: cluster 2024-08-31T02:37:55.687596+0000 mgr.a (mgr.14388) 1154 : cluster [DBG] pgmap v799: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:57.551 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:37:57.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:37:57.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:37:57.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:37:57.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:37:59.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:58 smithi163 bash[24253]: audit 2024-08-31T02:37:57.155334+0000 mgr.a (mgr.14388) 1155 : audit [DBG] from='client.38055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:59.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:37:58 smithi163 bash[24253]: cluster 2024-08-31T02:37:57.688616+0000 mgr.a (mgr.14388) 1156 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:59.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:58 smithi027 bash[22610]: audit 2024-08-31T02:37:57.155334+0000 mgr.a (mgr.14388) 1155 : audit [DBG] from='client.38055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:59.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:37:58 smithi027 bash[22610]: cluster 2024-08-31T02:37:57.688616+0000 mgr.a (mgr.14388) 1156 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:37:59.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:58 smithi191 bash[24992]: audit 2024-08-31T02:37:57.155334+0000 mgr.a (mgr.14388) 1155 : audit [DBG] from='client.38055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:37:59.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:37:58 smithi191 bash[24992]: cluster 2024-08-31T02:37:57.688616+0000 mgr.a (mgr.14388) 1156 : cluster [DBG] pgmap v800: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:01.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:00 smithi163 bash[24253]: cluster 2024-08-31T02:37:59.690937+0000 mgr.a (mgr.14388) 1157 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:38:01.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:00 smithi027 bash[22610]: cluster 2024-08-31T02:37:59.690937+0000 mgr.a (mgr.14388) 1157 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:38:01.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:00 smithi191 bash[24992]: cluster 2024-08-31T02:37:59.690937+0000 mgr.a (mgr.14388) 1157 : cluster [DBG] pgmap v801: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:38:02.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:38:02.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:38:02.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:38:03.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:02 smithi163 bash[24253]: cluster 2024-08-31T02:38:01.691858+0000 mgr.a (mgr.14388) 1158 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:03.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:02 smithi027 bash[22610]: cluster 2024-08-31T02:38:01.691858+0000 mgr.a (mgr.14388) 1158 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:03.279 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:38:03.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:38:03.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:38:03.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:38:03.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:38:03.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:02 smithi191 bash[24992]: cluster 2024-08-31T02:38:01.691858+0000 mgr.a (mgr.14388) 1158 : cluster [DBG] pgmap v802: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:04.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:03 smithi163 bash[24253]: audit 2024-08-31T02:38:02.889138+0000 mgr.a (mgr.14388) 1159 : audit [DBG] from='client.38130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:04.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:03 smithi027 bash[22610]: audit 2024-08-31T02:38:02.889138+0000 mgr.a (mgr.14388) 1159 : audit [DBG] from='client.38130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:04.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:03 smithi191 bash[24992]: audit 2024-08-31T02:38:02.889138+0000 mgr.a (mgr.14388) 1159 : audit [DBG] from='client.38130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:05.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:04 smithi163 bash[24253]: cluster 2024-08-31T02:38:03.694569+0000 mgr.a (mgr.14388) 1160 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:38:05.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:04 smithi027 bash[22610]: cluster 2024-08-31T02:38:03.694569+0000 mgr.a (mgr.14388) 1160 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:38:05.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:04 smithi191 bash[24992]: cluster 2024-08-31T02:38:03.694569+0000 mgr.a (mgr.14388) 1160 : cluster [DBG] pgmap v803: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:38:06.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:06 smithi163 bash[24253]: cluster 2024-08-31T02:38:05.695363+0000 mgr.a (mgr.14388) 1161 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:38:06.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:06 smithi027 bash[22610]: cluster 2024-08-31T02:38:05.695363+0000 mgr.a (mgr.14388) 1161 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:38:06.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:06 smithi191 bash[24992]: cluster 2024-08-31T02:38:05.695363+0000 mgr.a (mgr.14388) 1161 : cluster [DBG] pgmap v804: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:38:08.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:38:08.282 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:38:08.282 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:38:09.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:08 smithi191 bash[24992]: cluster 2024-08-31T02:38:07.696111+0000 mgr.a (mgr.14388) 1162 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:38:09.064 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:38:09.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:38:09.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:38:09.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:38:09.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:38:09.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:08 smithi163 bash[24253]: cluster 2024-08-31T02:38:07.696111+0000 mgr.a (mgr.14388) 1162 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:38:09.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:08 smithi027 bash[22610]: cluster 2024-08-31T02:38:07.696111+0000 mgr.a (mgr.14388) 1162 : cluster [DBG] pgmap v805: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:38:10.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:09 smithi191 bash[24992]: audit 2024-08-31T02:38:08.624889+0000 mgr.a (mgr.14388) 1163 : audit [DBG] from='client.38208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:10.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:09 smithi163 bash[24253]: audit 2024-08-31T02:38:08.624889+0000 mgr.a (mgr.14388) 1163 : audit [DBG] from='client.38208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:10.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:09 smithi027 bash[22610]: audit 2024-08-31T02:38:08.624889+0000 mgr.a (mgr.14388) 1163 : audit [DBG] from='client.38208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:11.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:10 smithi191 bash[24992]: cluster 2024-08-31T02:38:09.698864+0000 mgr.a (mgr.14388) 1164 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:11.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:10 smithi163 bash[24253]: cluster 2024-08-31T02:38:09.698864+0000 mgr.a (mgr.14388) 1164 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:10 smithi027 bash[22610]: cluster 2024-08-31T02:38:09.698864+0000 mgr.a (mgr.14388) 1164 : cluster [DBG] pgmap v806: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:13.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:12 smithi191 bash[24992]: cluster 2024-08-31T02:38:11.699662+0000 mgr.a (mgr.14388) 1165 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:38:13.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:12 smithi163 bash[24253]: cluster 2024-08-31T02:38:11.699662+0000 mgr.a (mgr.14388) 1165 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:38:13.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:12 smithi027 bash[22610]: cluster 2024-08-31T02:38:11.699662+0000 mgr.a (mgr.14388) 1165 : cluster [DBG] pgmap v807: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:38:14.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:38:14.067 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:38:14.067 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:38:14.841 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:38:14.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:38:14.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:38:14.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:38:14.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:38:15.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:14 smithi191 bash[24992]: cluster 2024-08-31T02:38:13.701592+0000 mgr.a (mgr.14388) 1166 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:15.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:14 smithi163 bash[24253]: cluster 2024-08-31T02:38:13.701592+0000 mgr.a (mgr.14388) 1166 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:15.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:14 smithi027 bash[22610]: cluster 2024-08-31T02:38:13.701592+0000 mgr.a (mgr.14388) 1166 : cluster [DBG] pgmap v808: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:16.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:15 smithi191 bash[24992]: audit 2024-08-31T02:38:14.407458+0000 mgr.a (mgr.14388) 1167 : audit [DBG] from='client.38286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:16.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:15 smithi163 bash[24253]: audit 2024-08-31T02:38:14.407458+0000 mgr.a (mgr.14388) 1167 : audit [DBG] from='client.38286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:16.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:15 smithi027 bash[22610]: audit 2024-08-31T02:38:14.407458+0000 mgr.a (mgr.14388) 1167 : audit [DBG] from='client.38286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:17.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:16 smithi191 bash[24992]: cluster 2024-08-31T02:38:15.702542+0000 mgr.a (mgr.14388) 1168 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:38:17.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:16 smithi163 bash[24253]: cluster 2024-08-31T02:38:15.702542+0000 mgr.a (mgr.14388) 1168 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:38:17.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:16 smithi027 bash[22610]: cluster 2024-08-31T02:38:15.702542+0000 mgr.a (mgr.14388) 1168 : cluster [DBG] pgmap v809: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:38:19.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:18 smithi163 bash[24253]: cluster 2024-08-31T02:38:17.703321+0000 mgr.a (mgr.14388) 1169 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:38:19.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:18 smithi027 bash[22610]: cluster 2024-08-31T02:38:17.703321+0000 mgr.a (mgr.14388) 1169 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:38:19.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:18 smithi191 bash[24992]: cluster 2024-08-31T02:38:17.703321+0000 mgr.a (mgr.14388) 1169 : cluster [DBG] pgmap v810: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:38:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:38:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:38:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:38:20.609 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:38:20.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:38:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:38:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:38:20.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:38:21.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:20 smithi163 bash[24253]: cluster 2024-08-31T02:38:19.705540+0000 mgr.a (mgr.14388) 1170 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:38:21.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:20 smithi163 bash[24253]: audit 2024-08-31T02:38:19.876318+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:38:21.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:20 smithi163 bash[24253]: audit 2024-08-31T02:38:20.453180+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:20 smithi163 bash[24253]: audit 2024-08-31T02:38:20.457892+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:20 smithi163 bash[24253]: audit 2024-08-31T02:38:20.464676+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:20 smithi163 bash[24253]: audit 2024-08-31T02:38:20.468919+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:20 smithi027 bash[22610]: cluster 2024-08-31T02:38:19.705540+0000 mgr.a (mgr.14388) 1170 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:38:21.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:20 smithi027 bash[22610]: audit 2024-08-31T02:38:19.876318+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:38:21.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:20 smithi027 bash[22610]: audit 2024-08-31T02:38:20.453180+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:20 smithi027 bash[22610]: audit 2024-08-31T02:38:20.457892+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:20 smithi027 bash[22610]: audit 2024-08-31T02:38:20.464676+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:20 smithi027 bash[22610]: audit 2024-08-31T02:38:20.468919+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:20 smithi191 bash[24992]: cluster 2024-08-31T02:38:19.705540+0000 mgr.a (mgr.14388) 1170 : cluster [DBG] pgmap v811: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:38:21.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:20 smithi191 bash[24992]: audit 2024-08-31T02:38:19.876318+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:38:21.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:20 smithi191 bash[24992]: audit 2024-08-31T02:38:20.453180+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:20 smithi191 bash[24992]: audit 2024-08-31T02:38:20.457892+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:20 smithi191 bash[24992]: audit 2024-08-31T02:38:20.464676+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:21.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:20 smithi191 bash[24992]: audit 2024-08-31T02:38:20.468919+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:22.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:21 smithi163 bash[24253]: audit 2024-08-31T02:38:20.189908+0000 mgr.a (mgr.14388) 1171 : audit [DBG] from='client.38364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:22.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:21 smithi163 bash[24253]: audit 2024-08-31T02:38:21.104125+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:38:22.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:21 smithi163 bash[24253]: audit 2024-08-31T02:38:21.105879+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:38:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:21 smithi163 bash[24253]: audit 2024-08-31T02:38:21.116159+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:21 smithi163 bash[24253]: audit 2024-08-31T02:38:21.121218+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:38:22.228 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:38:21 smithi027 bash[22863]: debug 2024-08-31T02:38:21.810+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:38:22.229 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:38:21 smithi027 bash[22863]: debug 2024-08-31T02:38:21.814+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:38:22.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:21 smithi027 bash[22610]: audit 2024-08-31T02:38:20.189908+0000 mgr.a (mgr.14388) 1171 : audit [DBG] from='client.38364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:22.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:21 smithi027 bash[22610]: audit 2024-08-31T02:38:21.104125+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:38:22.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:21 smithi027 bash[22610]: audit 2024-08-31T02:38:21.105879+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:38:22.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:21 smithi027 bash[22610]: audit 2024-08-31T02:38:21.116159+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:22.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:21 smithi027 bash[22610]: audit 2024-08-31T02:38:21.121218+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:38:22.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:21 smithi191 bash[24992]: audit 2024-08-31T02:38:20.189908+0000 mgr.a (mgr.14388) 1171 : audit [DBG] from='client.38364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:22.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:21 smithi191 bash[24992]: audit 2024-08-31T02:38:21.104125+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:38:22.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:21 smithi191 bash[24992]: audit 2024-08-31T02:38:21.105879+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:38:22.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:21 smithi191 bash[24992]: audit 2024-08-31T02:38:21.116159+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:38:22.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:21 smithi191 bash[24992]: audit 2024-08-31T02:38:21.121218+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:38:23.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:23 smithi163 bash[24253]: audit 2024-08-31T02:38:21.123580+0000 mgr.a (mgr.14388) 1172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:38:23.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:23 smithi163 bash[24253]: cluster 2024-08-31T02:38:21.706227+0000 mgr.a (mgr.14388) 1173 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:23.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:23 smithi163 bash[24253]: audit 2024-08-31T02:38:21.814207+0000 mgr.a (mgr.14388) 1174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:38:23.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:23 smithi163 bash[24253]: cephadm 2024-08-31T02:38:21.815504+0000 mgr.a (mgr.14388) 1175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:38:23.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:23 smithi027 bash[22610]: audit 2024-08-31T02:38:21.123580+0000 mgr.a (mgr.14388) 1172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:38:23.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:23 smithi027 bash[22610]: cluster 2024-08-31T02:38:21.706227+0000 mgr.a (mgr.14388) 1173 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:23.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:23 smithi027 bash[22610]: audit 2024-08-31T02:38:21.814207+0000 mgr.a (mgr.14388) 1174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:38:23.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:23 smithi027 bash[22610]: cephadm 2024-08-31T02:38:21.815504+0000 mgr.a (mgr.14388) 1175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:38:23.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:23 smithi191 bash[24992]: audit 2024-08-31T02:38:21.123580+0000 mgr.a (mgr.14388) 1172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:38:23.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:23 smithi191 bash[24992]: cluster 2024-08-31T02:38:21.706227+0000 mgr.a (mgr.14388) 1173 : cluster [DBG] pgmap v812: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:23.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:23 smithi191 bash[24992]: audit 2024-08-31T02:38:21.814207+0000 mgr.a (mgr.14388) 1174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:38:23.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:23 smithi191 bash[24992]: cephadm 2024-08-31T02:38:21.815504+0000 mgr.a (mgr.14388) 1175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:38:24.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:24 smithi163 bash[24253]: cluster 2024-08-31T02:38:23.708355+0000 mgr.a (mgr.14388) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:24.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:24 smithi027 bash[22610]: cluster 2024-08-31T02:38:23.708355+0000 mgr.a (mgr.14388) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:24.536 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:24 smithi191 bash[24992]: cluster 2024-08-31T02:38:23.708355+0000 mgr.a (mgr.14388) 1176 : cluster [DBG] pgmap v813: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:25.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:38:25.612 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:38:25.612 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:38:26.372 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:38:26.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:38:26.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:38:26.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:38:26.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:38:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:26 smithi191 bash[24992]: cluster 2024-08-31T02:38:25.709114+0000 mgr.a (mgr.14388) 1177 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:27.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:26 smithi191 bash[24992]: audit 2024-08-31T02:38:25.947570+0000 mgr.a (mgr.14388) 1178 : audit [DBG] from='client.38550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:27.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:26 smithi163 bash[24253]: cluster 2024-08-31T02:38:25.709114+0000 mgr.a (mgr.14388) 1177 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:27.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:26 smithi163 bash[24253]: audit 2024-08-31T02:38:25.947570+0000 mgr.a (mgr.14388) 1178 : audit [DBG] from='client.38550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:27.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:26 smithi027 bash[22610]: cluster 2024-08-31T02:38:25.709114+0000 mgr.a (mgr.14388) 1177 : cluster [DBG] pgmap v814: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:27.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:26 smithi027 bash[22610]: audit 2024-08-31T02:38:25.947570+0000 mgr.a (mgr.14388) 1178 : audit [DBG] from='client.38550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:29.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:28 smithi191 bash[24992]: cluster 2024-08-31T02:38:27.710005+0000 mgr.a (mgr.14388) 1179 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:29.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:28 smithi163 bash[24253]: cluster 2024-08-31T02:38:27.710005+0000 mgr.a (mgr.14388) 1179 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:29.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:28 smithi027 bash[22610]: cluster 2024-08-31T02:38:27.710005+0000 mgr.a (mgr.14388) 1179 : cluster [DBG] pgmap v815: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:31.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:30 smithi191 bash[24992]: cluster 2024-08-31T02:38:29.712346+0000 mgr.a (mgr.14388) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:31.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:30 smithi163 bash[24253]: cluster 2024-08-31T02:38:29.712346+0000 mgr.a (mgr.14388) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:31.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:30 smithi027 bash[22610]: cluster 2024-08-31T02:38:29.712346+0000 mgr.a (mgr.14388) 1180 : cluster [DBG] pgmap v816: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:31.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:38:31.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:38:31.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:38:32.139 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:38:32.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:38:32.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:38:32.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:38:32.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:38:33.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:32 smithi191 bash[24992]: cluster 2024-08-31T02:38:31.713123+0000 mgr.a (mgr.14388) 1181 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:33.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:32 smithi191 bash[24992]: audit 2024-08-31T02:38:31.715817+0000 mgr.a (mgr.14388) 1182 : audit [DBG] from='client.38625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:33.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:32 smithi163 bash[24253]: cluster 2024-08-31T02:38:31.713123+0000 mgr.a (mgr.14388) 1181 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:33.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:32 smithi163 bash[24253]: audit 2024-08-31T02:38:31.715817+0000 mgr.a (mgr.14388) 1182 : audit [DBG] from='client.38625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:32 smithi027 bash[22610]: cluster 2024-08-31T02:38:31.713123+0000 mgr.a (mgr.14388) 1181 : cluster [DBG] pgmap v817: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:32 smithi027 bash[22610]: audit 2024-08-31T02:38:31.715817+0000 mgr.a (mgr.14388) 1182 : audit [DBG] from='client.38625 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:35.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:34 smithi191 bash[24992]: cluster 2024-08-31T02:38:33.715341+0000 mgr.a (mgr.14388) 1183 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:35.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:34 smithi163 bash[24253]: cluster 2024-08-31T02:38:33.715341+0000 mgr.a (mgr.14388) 1183 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:35.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:34 smithi027 bash[22610]: cluster 2024-08-31T02:38:33.715341+0000 mgr.a (mgr.14388) 1183 : cluster [DBG] pgmap v818: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:38:37.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:36 smithi191 bash[24992]: cluster 2024-08-31T02:38:35.716123+0000 mgr.a (mgr.14388) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:37.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:38:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:38:37.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:38:37.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:36 smithi163 bash[24253]: cluster 2024-08-31T02:38:35.716123+0000 mgr.a (mgr.14388) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:37.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:36 smithi027 bash[22610]: cluster 2024-08-31T02:38:35.716123+0000 mgr.a (mgr.14388) 1184 : cluster [DBG] pgmap v819: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:37.892 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:38:37.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:38:37.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:38:37.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:38:37.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:38:39.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:38 smithi163 bash[24253]: audit 2024-08-31T02:38:37.476920+0000 mgr.a (mgr.14388) 1185 : audit [DBG] from='client.38697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:39.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:38 smithi163 bash[24253]: cluster 2024-08-31T02:38:37.716713+0000 mgr.a (mgr.14388) 1186 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:39.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:38 smithi027 bash[22610]: audit 2024-08-31T02:38:37.476920+0000 mgr.a (mgr.14388) 1185 : audit [DBG] from='client.38697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:39.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:38 smithi027 bash[22610]: cluster 2024-08-31T02:38:37.716713+0000 mgr.a (mgr.14388) 1186 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:39.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:38 smithi191 bash[24992]: audit 2024-08-31T02:38:37.476920+0000 mgr.a (mgr.14388) 1185 : audit [DBG] from='client.38697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:39.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:38 smithi191 bash[24992]: cluster 2024-08-31T02:38:37.716713+0000 mgr.a (mgr.14388) 1186 : cluster [DBG] pgmap v820: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:41.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:40 smithi163 bash[24253]: cluster 2024-08-31T02:38:39.719049+0000 mgr.a (mgr.14388) 1187 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:38:41.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:40 smithi027 bash[22610]: cluster 2024-08-31T02:38:39.719049+0000 mgr.a (mgr.14388) 1187 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:38:41.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:40 smithi191 bash[24992]: cluster 2024-08-31T02:38:39.719049+0000 mgr.a (mgr.14388) 1187 : cluster [DBG] pgmap v821: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:38:42.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:38:42.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:38:42.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:38:43.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:42 smithi163 bash[24253]: cluster 2024-08-31T02:38:41.719839+0000 mgr.a (mgr.14388) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:43.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:42 smithi027 bash[22610]: cluster 2024-08-31T02:38:41.719839+0000 mgr.a (mgr.14388) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:43.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:42 smithi191 bash[24992]: cluster 2024-08-31T02:38:41.719839+0000 mgr.a (mgr.14388) 1188 : cluster [DBG] pgmap v822: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:43.663 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:38:43.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:38:43.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:38:43.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:38:43.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:38:45.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:44 smithi163 bash[24253]: audit 2024-08-31T02:38:43.235764+0000 mgr.a (mgr.14388) 1189 : audit [DBG] from='client.38775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:45.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:44 smithi163 bash[24253]: cluster 2024-08-31T02:38:43.721120+0000 mgr.a (mgr.14388) 1190 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:45.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:44 smithi027 bash[22610]: audit 2024-08-31T02:38:43.235764+0000 mgr.a (mgr.14388) 1189 : audit [DBG] from='client.38775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:45.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:44 smithi027 bash[22610]: cluster 2024-08-31T02:38:43.721120+0000 mgr.a (mgr.14388) 1190 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:45.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:44 smithi191 bash[24992]: audit 2024-08-31T02:38:43.235764+0000 mgr.a (mgr.14388) 1189 : audit [DBG] from='client.38775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:45.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:44 smithi191 bash[24992]: cluster 2024-08-31T02:38:43.721120+0000 mgr.a (mgr.14388) 1190 : cluster [DBG] pgmap v823: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:47.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:46 smithi163 bash[24253]: cluster 2024-08-31T02:38:45.721879+0000 mgr.a (mgr.14388) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:38:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:46 smithi027 bash[22610]: cluster 2024-08-31T02:38:45.721879+0000 mgr.a (mgr.14388) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:38:47.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:46 smithi191 bash[24992]: cluster 2024-08-31T02:38:45.721879+0000 mgr.a (mgr.14388) 1191 : cluster [DBG] pgmap v824: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:38:48.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:38:48.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:38:48.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:38:49.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:48 smithi163 bash[24253]: cluster 2024-08-31T02:38:47.722622+0000 mgr.a (mgr.14388) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:38:49.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:48 smithi027 bash[22610]: cluster 2024-08-31T02:38:47.722622+0000 mgr.a (mgr.14388) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:38:49.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:48 smithi191 bash[24992]: cluster 2024-08-31T02:38:47.722622+0000 mgr.a (mgr.14388) 1192 : cluster [DBG] pgmap v825: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:38:49.403 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:38:49.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:38:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:38:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:38:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:38:50.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:49 smithi163 bash[24253]: audit 2024-08-31T02:38:48.999671+0000 mgr.a (mgr.14388) 1193 : audit [DBG] from='client.38850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:50.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:49 smithi027 bash[22610]: audit 2024-08-31T02:38:48.999671+0000 mgr.a (mgr.14388) 1193 : audit [DBG] from='client.38850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:50.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:49 smithi191 bash[24992]: audit 2024-08-31T02:38:48.999671+0000 mgr.a (mgr.14388) 1193 : audit [DBG] from='client.38850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:51.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:50 smithi163 bash[24253]: cluster 2024-08-31T02:38:49.725340+0000 mgr.a (mgr.14388) 1194 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:51.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:50 smithi027 bash[22610]: cluster 2024-08-31T02:38:49.725340+0000 mgr.a (mgr.14388) 1194 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:51.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:50 smithi191 bash[24992]: cluster 2024-08-31T02:38:49.725340+0000 mgr.a (mgr.14388) 1194 : cluster [DBG] pgmap v826: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:53.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:52 smithi163 bash[24253]: cluster 2024-08-31T02:38:51.726254+0000 mgr.a (mgr.14388) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:38:53.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:52 smithi027 bash[22610]: cluster 2024-08-31T02:38:51.726254+0000 mgr.a (mgr.14388) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:38:53.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:52 smithi191 bash[24992]: cluster 2024-08-31T02:38:51.726254+0000 mgr.a (mgr.14388) 1195 : cluster [DBG] pgmap v827: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:38:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:38:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:38:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:38:55.147 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:38:55.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:38:55.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:38:55.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:38:55.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:38:55.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:54 smithi163 bash[24253]: cluster 2024-08-31T02:38:53.728335+0000 mgr.a (mgr.14388) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:55.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:54 smithi027 bash[22610]: cluster 2024-08-31T02:38:53.728335+0000 mgr.a (mgr.14388) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:55.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:54 smithi191 bash[24992]: cluster 2024-08-31T02:38:53.728335+0000 mgr.a (mgr.14388) 1196 : cluster [DBG] pgmap v828: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:56.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:55 smithi163 bash[24253]: audit 2024-08-31T02:38:54.741677+0000 mgr.a (mgr.14388) 1197 : audit [DBG] from='client.38925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:56.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:55 smithi027 bash[22610]: audit 2024-08-31T02:38:54.741677+0000 mgr.a (mgr.14388) 1197 : audit [DBG] from='client.38925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:56.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:55 smithi191 bash[24992]: audit 2024-08-31T02:38:54.741677+0000 mgr.a (mgr.14388) 1197 : audit [DBG] from='client.38925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:38:57.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:56 smithi163 bash[24253]: cluster 2024-08-31T02:38:55.729354+0000 mgr.a (mgr.14388) 1198 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:57.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:56 smithi027 bash[22610]: cluster 2024-08-31T02:38:55.729354+0000 mgr.a (mgr.14388) 1198 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:57.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:56 smithi191 bash[24992]: cluster 2024-08-31T02:38:55.729354+0000 mgr.a (mgr.14388) 1198 : cluster [DBG] pgmap v829: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:59.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:38:58 smithi163 bash[24253]: cluster 2024-08-31T02:38:57.730118+0000 mgr.a (mgr.14388) 1199 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:59.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:38:58 smithi027 bash[22610]: cluster 2024-08-31T02:38:57.730118+0000 mgr.a (mgr.14388) 1199 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:38:59.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:38:58 smithi191 bash[24992]: cluster 2024-08-31T02:38:57.730118+0000 mgr.a (mgr.14388) 1199 : cluster [DBG] pgmap v830: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:00.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:00.149 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:00.149 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:00.907 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:00.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:01.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:00 smithi163 bash[24253]: cluster 2024-08-31T02:38:59.732345+0000 mgr.a (mgr.14388) 1200 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:01.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:00 smithi027 bash[22610]: cluster 2024-08-31T02:38:59.732345+0000 mgr.a (mgr.14388) 1200 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:01.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:00 smithi191 bash[24992]: cluster 2024-08-31T02:38:59.732345+0000 mgr.a (mgr.14388) 1200 : cluster [DBG] pgmap v831: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:02.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:01 smithi163 bash[24253]: audit 2024-08-31T02:39:00.482304+0000 mgr.a (mgr.14388) 1201 : audit [DBG] from='client.39003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:02.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:01 smithi027 bash[22610]: audit 2024-08-31T02:39:00.482304+0000 mgr.a (mgr.14388) 1201 : audit [DBG] from='client.39003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:02.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:01 smithi191 bash[24992]: audit 2024-08-31T02:39:00.482304+0000 mgr.a (mgr.14388) 1201 : audit [DBG] from='client.39003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:03.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:02 smithi163 bash[24253]: cluster 2024-08-31T02:39:01.733240+0000 mgr.a (mgr.14388) 1202 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:03.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:02 smithi027 bash[22610]: cluster 2024-08-31T02:39:01.733240+0000 mgr.a (mgr.14388) 1202 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:03.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:02 smithi191 bash[24992]: cluster 2024-08-31T02:39:01.733240+0000 mgr.a (mgr.14388) 1202 : cluster [DBG] pgmap v832: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:05.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:04 smithi163 bash[24253]: cluster 2024-08-31T02:39:03.735370+0000 mgr.a (mgr.14388) 1203 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:05.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:04 smithi027 bash[22610]: cluster 2024-08-31T02:39:03.735370+0000 mgr.a (mgr.14388) 1203 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:05.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:04 smithi191 bash[24992]: cluster 2024-08-31T02:39:03.735370+0000 mgr.a (mgr.14388) 1203 : cluster [DBG] pgmap v833: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:06.651 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:06.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:06.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:06.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:06.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:07.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:06 smithi163 bash[24253]: cluster 2024-08-31T02:39:05.736131+0000 mgr.a (mgr.14388) 1204 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:07.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:06 smithi027 bash[22610]: cluster 2024-08-31T02:39:05.736131+0000 mgr.a (mgr.14388) 1204 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:07.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:06 smithi191 bash[24992]: cluster 2024-08-31T02:39:05.736131+0000 mgr.a (mgr.14388) 1204 : cluster [DBG] pgmap v834: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:08.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:07 smithi163 bash[24253]: audit 2024-08-31T02:39:06.244219+0000 mgr.a (mgr.14388) 1205 : audit [DBG] from='client.39078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:08.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:07 smithi027 bash[22610]: audit 2024-08-31T02:39:06.244219+0000 mgr.a (mgr.14388) 1205 : audit [DBG] from='client.39078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:08.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:07 smithi191 bash[24992]: audit 2024-08-31T02:39:06.244219+0000 mgr.a (mgr.14388) 1205 : audit [DBG] from='client.39078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:09.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:08 smithi163 bash[24253]: cluster 2024-08-31T02:39:07.737015+0000 mgr.a (mgr.14388) 1206 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:09.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:08 smithi027 bash[22610]: cluster 2024-08-31T02:39:07.737015+0000 mgr.a (mgr.14388) 1206 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:09.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:08 smithi191 bash[24992]: cluster 2024-08-31T02:39:07.737015+0000 mgr.a (mgr.14388) 1206 : cluster [DBG] pgmap v835: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:11.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:10 smithi163 bash[24253]: cluster 2024-08-31T02:39:09.739214+0000 mgr.a (mgr.14388) 1207 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:11.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:10 smithi027 bash[22610]: cluster 2024-08-31T02:39:09.739214+0000 mgr.a (mgr.14388) 1207 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:11.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:10 smithi191 bash[24992]: cluster 2024-08-31T02:39:09.739214+0000 mgr.a (mgr.14388) 1207 : cluster [DBG] pgmap v836: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:11.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:11.653 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:11.654 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:12.417 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:12.417 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:12.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:12.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:12.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:13.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:12 smithi163 bash[24253]: cluster 2024-08-31T02:39:11.739956+0000 mgr.a (mgr.14388) 1208 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:13.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:12 smithi163 bash[24253]: audit 2024-08-31T02:39:11.996060+0000 mgr.a (mgr.14388) 1209 : audit [DBG] from='client.39156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:13.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:12 smithi027 bash[22610]: cluster 2024-08-31T02:39:11.739956+0000 mgr.a (mgr.14388) 1208 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:13.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:12 smithi027 bash[22610]: audit 2024-08-31T02:39:11.996060+0000 mgr.a (mgr.14388) 1209 : audit [DBG] from='client.39156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:13.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:12 smithi191 bash[24992]: cluster 2024-08-31T02:39:11.739956+0000 mgr.a (mgr.14388) 1208 : cluster [DBG] pgmap v837: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:13.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:12 smithi191 bash[24992]: audit 2024-08-31T02:39:11.996060+0000 mgr.a (mgr.14388) 1209 : audit [DBG] from='client.39156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:15.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:14 smithi163 bash[24253]: cluster 2024-08-31T02:39:13.742189+0000 mgr.a (mgr.14388) 1210 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:15.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:14 smithi027 bash[22610]: cluster 2024-08-31T02:39:13.742189+0000 mgr.a (mgr.14388) 1210 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:15.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:14 smithi191 bash[24992]: cluster 2024-08-31T02:39:13.742189+0000 mgr.a (mgr.14388) 1210 : cluster [DBG] pgmap v838: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:16.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:16 smithi163 bash[24253]: cluster 2024-08-31T02:39:15.743013+0000 mgr.a (mgr.14388) 1211 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:16.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:16 smithi027 bash[22610]: cluster 2024-08-31T02:39:15.743013+0000 mgr.a (mgr.14388) 1211 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:16.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:16 smithi191 bash[24992]: cluster 2024-08-31T02:39:15.743013+0000 mgr.a (mgr.14388) 1211 : cluster [DBG] pgmap v839: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:17.419 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:18.188 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:19.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:18 smithi163 bash[24253]: cluster 2024-08-31T02:39:17.743753+0000 mgr.a (mgr.14388) 1212 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:19.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:18 smithi163 bash[24253]: audit 2024-08-31T02:39:17.763214+0000 mgr.a (mgr.14388) 1213 : audit [DBG] from='client.39234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:19.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:18 smithi027 bash[22610]: cluster 2024-08-31T02:39:17.743753+0000 mgr.a (mgr.14388) 1212 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:19.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:18 smithi027 bash[22610]: audit 2024-08-31T02:39:17.763214+0000 mgr.a (mgr.14388) 1213 : audit [DBG] from='client.39234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:19.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:18 smithi191 bash[24992]: cluster 2024-08-31T02:39:17.743753+0000 mgr.a (mgr.14388) 1212 : cluster [DBG] pgmap v840: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:19.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:18 smithi191 bash[24992]: audit 2024-08-31T02:39:17.763214+0000 mgr.a (mgr.14388) 1213 : audit [DBG] from='client.39234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:21.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:20 smithi163 bash[24253]: cluster 2024-08-31T02:39:19.746070+0000 mgr.a (mgr.14388) 1214 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:39:21.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:20 smithi027 bash[22610]: cluster 2024-08-31T02:39:19.746070+0000 mgr.a (mgr.14388) 1214 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:39:21.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:20 smithi191 bash[24992]: cluster 2024-08-31T02:39:19.746070+0000 mgr.a (mgr.14388) 1214 : cluster [DBG] pgmap v841: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:39:23.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:23.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:23.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:23.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:22 smithi163 bash[24253]: cluster 2024-08-31T02:39:21.746883+0000 mgr.a (mgr.14388) 1215 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:39:23.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:22 smithi163 bash[24253]: audit 2024-08-31T02:39:21.864195+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:39:23.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:22 smithi027 bash[22610]: cluster 2024-08-31T02:39:21.746883+0000 mgr.a (mgr.14388) 1215 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:39:23.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:22 smithi027 bash[22610]: audit 2024-08-31T02:39:21.864195+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:39:23.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:22 smithi191 bash[24992]: cluster 2024-08-31T02:39:21.746883+0000 mgr.a (mgr.14388) 1215 : cluster [DBG] pgmap v842: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:39:23.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:22 smithi191 bash[24992]: audit 2024-08-31T02:39:21.864195+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:39:23.901 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:23.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:23.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:23.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:25.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:24 smithi163 bash[24253]: audit 2024-08-31T02:39:23.503881+0000 mgr.a (mgr.14388) 1216 : audit [DBG] from='client.39309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:25.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:24 smithi163 bash[24253]: cluster 2024-08-31T02:39:23.748113+0000 mgr.a (mgr.14388) 1217 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:25.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:24 smithi027 bash[22610]: audit 2024-08-31T02:39:23.503881+0000 mgr.a (mgr.14388) 1216 : audit [DBG] from='client.39309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:25.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:24 smithi027 bash[22610]: cluster 2024-08-31T02:39:23.748113+0000 mgr.a (mgr.14388) 1217 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:25.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:24 smithi191 bash[24992]: audit 2024-08-31T02:39:23.503881+0000 mgr.a (mgr.14388) 1216 : audit [DBG] from='client.39309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:25.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:24 smithi191 bash[24992]: cluster 2024-08-31T02:39:23.748113+0000 mgr.a (mgr.14388) 1217 : cluster [DBG] pgmap v843: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:27.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:26 smithi163 bash[24253]: cluster 2024-08-31T02:39:25.748642+0000 mgr.a (mgr.14388) 1218 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:39:27.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:26 smithi027 bash[22610]: cluster 2024-08-31T02:39:25.748642+0000 mgr.a (mgr.14388) 1218 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:39:27.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:26 smithi191 bash[24992]: cluster 2024-08-31T02:39:25.748642+0000 mgr.a (mgr.14388) 1218 : cluster [DBG] pgmap v844: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:39:28.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:28.903 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:28.904 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:29.101 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:28 smithi027 bash[22610]: cluster 2024-08-31T02:39:27.749259+0000 mgr.a (mgr.14388) 1219 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:39:29.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:28 smithi163 bash[24253]: cluster 2024-08-31T02:39:27.749259+0000 mgr.a (mgr.14388) 1219 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:39:29.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:28 smithi191 bash[24992]: cluster 2024-08-31T02:39:27.749259+0000 mgr.a (mgr.14388) 1219 : cluster [DBG] pgmap v845: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:39:29.638 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:29.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:29.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:29.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:29.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:31.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:30 smithi163 bash[24253]: audit 2024-08-31T02:39:29.247942+0000 mgr.a (mgr.14388) 1220 : audit [DBG] from='client.39387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:31.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:30 smithi163 bash[24253]: cluster 2024-08-31T02:39:29.751937+0000 mgr.a (mgr.14388) 1221 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:31.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:30 smithi027 bash[22610]: audit 2024-08-31T02:39:29.247942+0000 mgr.a (mgr.14388) 1220 : audit [DBG] from='client.39387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:31.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:30 smithi027 bash[22610]: cluster 2024-08-31T02:39:29.751937+0000 mgr.a (mgr.14388) 1221 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:31.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:30 smithi191 bash[24992]: audit 2024-08-31T02:39:29.247942+0000 mgr.a (mgr.14388) 1220 : audit [DBG] from='client.39387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:31.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:30 smithi191 bash[24992]: cluster 2024-08-31T02:39:29.751937+0000 mgr.a (mgr.14388) 1221 : cluster [DBG] pgmap v846: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:33.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:32 smithi163 bash[24253]: cluster 2024-08-31T02:39:31.752731+0000 mgr.a (mgr.14388) 1222 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:39:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:32 smithi163 bash[24253]: audit 2024-08-31T02:39:32.688242+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:39:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:32 smithi163 bash[24253]: audit 2024-08-31T02:39:32.696288+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:39:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:32 smithi163 bash[24253]: audit 2024-08-31T02:39:32.698277+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:39:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:32 smithi163 bash[24253]: audit 2024-08-31T02:39:32.700305+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:39:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:32 smithi163 bash[24253]: audit 2024-08-31T02:39:32.710740+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:39:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:32 smithi163 bash[24253]: audit 2024-08-31T02:39:32.715684+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:39:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:32 smithi027 bash[22610]: cluster 2024-08-31T02:39:31.752731+0000 mgr.a (mgr.14388) 1222 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:39:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:32 smithi027 bash[22610]: audit 2024-08-31T02:39:32.688242+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:39:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:32 smithi027 bash[22610]: audit 2024-08-31T02:39:32.696288+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:39:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:32 smithi027 bash[22610]: audit 2024-08-31T02:39:32.698277+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:39:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:32 smithi027 bash[22610]: audit 2024-08-31T02:39:32.700305+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:39:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:32 smithi027 bash[22610]: audit 2024-08-31T02:39:32.710740+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:39:33.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:32 smithi027 bash[22610]: audit 2024-08-31T02:39:32.715684+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:39:33.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:32 smithi191 bash[24992]: cluster 2024-08-31T02:39:31.752731+0000 mgr.a (mgr.14388) 1222 : cluster [DBG] pgmap v847: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:39:33.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:32 smithi191 bash[24992]: audit 2024-08-31T02:39:32.688242+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:39:33.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:32 smithi191 bash[24992]: audit 2024-08-31T02:39:32.696288+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:39:33.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:32 smithi191 bash[24992]: audit 2024-08-31T02:39:32.698277+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:39:33.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:32 smithi191 bash[24992]: audit 2024-08-31T02:39:32.700305+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:39:33.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:32 smithi191 bash[24992]: audit 2024-08-31T02:39:32.710740+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:39:33.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:32 smithi191 bash[24992]: audit 2024-08-31T02:39:32.715684+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:39:33.728 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:39:33 smithi027 bash[22863]: debug 2024-08-31T02:39:33.464+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:39:33.728 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:39:33 smithi027 bash[22863]: debug 2024-08-31T02:39:33.468+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:39:34.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:33 smithi163 bash[24253]: audit 2024-08-31T02:39:32.717618+0000 mgr.a (mgr.14388) 1223 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:39:34.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:33 smithi027 bash[22610]: audit 2024-08-31T02:39:32.717618+0000 mgr.a (mgr.14388) 1223 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:39:34.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:33 smithi191 bash[24992]: audit 2024-08-31T02:39:32.717618+0000 mgr.a (mgr.14388) 1223 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:39:34.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:34.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:34.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:35.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:34 smithi163 bash[24253]: audit 2024-08-31T02:39:33.469876+0000 mgr.a (mgr.14388) 1224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:39:35.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:34 smithi163 bash[24253]: cephadm 2024-08-31T02:39:33.471133+0000 mgr.a (mgr.14388) 1225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:39:35.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:34 smithi163 bash[24253]: cluster 2024-08-31T02:39:33.755418+0000 mgr.a (mgr.14388) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T02:39:35.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:34 smithi027 bash[22610]: audit 2024-08-31T02:39:33.469876+0000 mgr.a (mgr.14388) 1224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:39:35.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:34 smithi027 bash[22610]: cephadm 2024-08-31T02:39:33.471133+0000 mgr.a (mgr.14388) 1225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:39:35.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:34 smithi027 bash[22610]: cluster 2024-08-31T02:39:33.755418+0000 mgr.a (mgr.14388) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T02:39:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:34 smithi191 bash[24992]: audit 2024-08-31T02:39:33.469876+0000 mgr.a (mgr.14388) 1224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:39:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:34 smithi191 bash[24992]: cephadm 2024-08-31T02:39:33.471133+0000 mgr.a (mgr.14388) 1225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:39:35.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:34 smithi191 bash[24992]: cluster 2024-08-31T02:39:33.755418+0000 mgr.a (mgr.14388) 1226 : cluster [DBG] pgmap v848: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T02:39:35.413 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:36.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:35 smithi163 bash[24253]: audit 2024-08-31T02:39:34.979884+0000 mgr.a (mgr.14388) 1227 : audit [DBG] from='client.39573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:36.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:35 smithi027 bash[22610]: audit 2024-08-31T02:39:34.979884+0000 mgr.a (mgr.14388) 1227 : audit [DBG] from='client.39573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:36.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:35 smithi191 bash[24992]: audit 2024-08-31T02:39:34.979884+0000 mgr.a (mgr.14388) 1227 : audit [DBG] from='client.39573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:37.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:36 smithi163 bash[24253]: cluster 2024-08-31T02:39:35.756398+0000 mgr.a (mgr.14388) 1228 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T02:39:37.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:36 smithi027 bash[22610]: cluster 2024-08-31T02:39:35.756398+0000 mgr.a (mgr.14388) 1228 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T02:39:37.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:36 smithi191 bash[24992]: cluster 2024-08-31T02:39:35.756398+0000 mgr.a (mgr.14388) 1228 : cluster [DBG] pgmap v849: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T02:39:39.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:38 smithi163 bash[24253]: cluster 2024-08-31T02:39:37.757180+0000 mgr.a (mgr.14388) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T02:39:39.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:38 smithi027 bash[22610]: cluster 2024-08-31T02:39:37.757180+0000 mgr.a (mgr.14388) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T02:39:39.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:38 smithi191 bash[24992]: cluster 2024-08-31T02:39:37.757180+0000 mgr.a (mgr.14388) 1229 : cluster [DBG] pgmap v850: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T02:39:40.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:40.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:40.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:41.190 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:41.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:41.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:41.191 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:41.191 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:41.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:40 smithi163 bash[24253]: cluster 2024-08-31T02:39:39.759368+0000 mgr.a (mgr.14388) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:39:41.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:40 smithi027 bash[22610]: cluster 2024-08-31T02:39:39.759368+0000 mgr.a (mgr.14388) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:39:41.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:40 smithi191 bash[24992]: cluster 2024-08-31T02:39:39.759368+0000 mgr.a (mgr.14388) 1230 : cluster [DBG] pgmap v851: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:39:42.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:41 smithi163 bash[24253]: audit 2024-08-31T02:39:40.760399+0000 mgr.a (mgr.14388) 1231 : audit [DBG] from='client.39651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:42.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:41 smithi027 bash[22610]: audit 2024-08-31T02:39:40.760399+0000 mgr.a (mgr.14388) 1231 : audit [DBG] from='client.39651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:42.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:41 smithi191 bash[24992]: audit 2024-08-31T02:39:40.760399+0000 mgr.a (mgr.14388) 1231 : audit [DBG] from='client.39651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:43.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:42 smithi163 bash[24253]: cluster 2024-08-31T02:39:41.760282+0000 mgr.a (mgr.14388) 1232 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:39:43.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:42 smithi027 bash[22610]: cluster 2024-08-31T02:39:41.760282+0000 mgr.a (mgr.14388) 1232 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:39:43.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:42 smithi191 bash[24992]: cluster 2024-08-31T02:39:41.760282+0000 mgr.a (mgr.14388) 1232 : cluster [DBG] pgmap v852: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:39:45.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:44 smithi163 bash[24253]: cluster 2024-08-31T02:39:43.762394+0000 mgr.a (mgr.14388) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:39:45.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:44 smithi027 bash[22610]: cluster 2024-08-31T02:39:43.762394+0000 mgr.a (mgr.14388) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:39:45.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:44 smithi191 bash[24992]: cluster 2024-08-31T02:39:43.762394+0000 mgr.a (mgr.14388) 1233 : cluster [DBG] pgmap v853: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:39:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:46.193 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:46.964 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:46.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:46.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:46.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:46.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:47.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:46 smithi163 bash[24253]: cluster 2024-08-31T02:39:45.763161+0000 mgr.a (mgr.14388) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T02:39:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:46 smithi027 bash[22610]: cluster 2024-08-31T02:39:45.763161+0000 mgr.a (mgr.14388) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T02:39:47.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:46 smithi191 bash[24992]: cluster 2024-08-31T02:39:45.763161+0000 mgr.a (mgr.14388) 1234 : cluster [DBG] pgmap v854: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T02:39:48.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:47 smithi163 bash[24253]: audit 2024-08-31T02:39:46.532428+0000 mgr.a (mgr.14388) 1235 : audit [DBG] from='client.39729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:48.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:47 smithi027 bash[22610]: audit 2024-08-31T02:39:46.532428+0000 mgr.a (mgr.14388) 1235 : audit [DBG] from='client.39729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:48.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:47 smithi191 bash[24992]: audit 2024-08-31T02:39:46.532428+0000 mgr.a (mgr.14388) 1235 : audit [DBG] from='client.39729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:49.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:48 smithi163 bash[24253]: cluster 2024-08-31T02:39:47.764038+0000 mgr.a (mgr.14388) 1236 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T02:39:49.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:48 smithi027 bash[22610]: cluster 2024-08-31T02:39:47.764038+0000 mgr.a (mgr.14388) 1236 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T02:39:49.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:48 smithi191 bash[24992]: cluster 2024-08-31T02:39:47.764038+0000 mgr.a (mgr.14388) 1236 : cluster [DBG] pgmap v855: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T02:39:51.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:50 smithi163 bash[24253]: cluster 2024-08-31T02:39:49.766209+0000 mgr.a (mgr.14388) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T02:39:51.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:50 smithi027 bash[22610]: cluster 2024-08-31T02:39:49.766209+0000 mgr.a (mgr.14388) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T02:39:51.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:50 smithi191 bash[24992]: cluster 2024-08-31T02:39:49.766209+0000 mgr.a (mgr.14388) 1237 : cluster [DBG] pgmap v856: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T02:39:51.966 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:51.966 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:51.966 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:52.702 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:52.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:52.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:52.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:52.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:53.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:52 smithi163 bash[24253]: cluster 2024-08-31T02:39:51.766994+0000 mgr.a (mgr.14388) 1238 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:53.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:52 smithi027 bash[22610]: cluster 2024-08-31T02:39:51.766994+0000 mgr.a (mgr.14388) 1238 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:53.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:52 smithi191 bash[24992]: cluster 2024-08-31T02:39:51.766994+0000 mgr.a (mgr.14388) 1238 : cluster [DBG] pgmap v857: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:54.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:53 smithi163 bash[24253]: audit 2024-08-31T02:39:52.299454+0000 mgr.a (mgr.14388) 1239 : audit [DBG] from='client.39807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:54.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:53 smithi027 bash[22610]: audit 2024-08-31T02:39:52.299454+0000 mgr.a (mgr.14388) 1239 : audit [DBG] from='client.39807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:54.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:53 smithi191 bash[24992]: audit 2024-08-31T02:39:52.299454+0000 mgr.a (mgr.14388) 1239 : audit [DBG] from='client.39807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:55.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:54 smithi163 bash[24253]: cluster 2024-08-31T02:39:53.769199+0000 mgr.a (mgr.14388) 1240 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:55.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:54 smithi027 bash[22610]: cluster 2024-08-31T02:39:53.769199+0000 mgr.a (mgr.14388) 1240 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:55.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:54 smithi191 bash[24992]: cluster 2024-08-31T02:39:53.769199+0000 mgr.a (mgr.14388) 1240 : cluster [DBG] pgmap v858: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:39:57.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:56 smithi163 bash[24253]: cluster 2024-08-31T02:39:55.769955+0000 mgr.a (mgr.14388) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:57.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:56 smithi027 bash[22610]: cluster 2024-08-31T02:39:55.769955+0000 mgr.a (mgr.14388) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:57.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:56 smithi191 bash[24992]: cluster 2024-08-31T02:39:55.769955+0000 mgr.a (mgr.14388) 1241 : cluster [DBG] pgmap v859: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:57.704 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:39:57.705 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:39:57.705 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:39:58.437 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:39:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:39:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:39:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:39:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:39:59.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:58 smithi163 bash[24253]: cluster 2024-08-31T02:39:57.770711+0000 mgr.a (mgr.14388) 1242 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:59.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:39:58 smithi163 bash[24253]: audit 2024-08-31T02:39:58.035182+0000 mgr.a (mgr.14388) 1243 : audit [DBG] from='client.39882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:59.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:58 smithi027 bash[22610]: cluster 2024-08-31T02:39:57.770711+0000 mgr.a (mgr.14388) 1242 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:59.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:39:58 smithi027 bash[22610]: audit 2024-08-31T02:39:58.035182+0000 mgr.a (mgr.14388) 1243 : audit [DBG] from='client.39882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:39:59.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:58 smithi191 bash[24992]: cluster 2024-08-31T02:39:57.770711+0000 mgr.a (mgr.14388) 1242 : cluster [DBG] pgmap v860: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:39:59.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:39:58 smithi191 bash[24992]: audit 2024-08-31T02:39:58.035182+0000 mgr.a (mgr.14388) 1243 : audit [DBG] from='client.39882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:01.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:00 smithi163 bash[24253]: cluster 2024-08-31T02:39:59.773378+0000 mgr.a (mgr.14388) 1244 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:01.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:00 smithi163 bash[24253]: cluster 2024-08-31T02:40:00.000147+0000 mon.a (mon.0) 779 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:40:01.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:00 smithi027 bash[22610]: cluster 2024-08-31T02:39:59.773378+0000 mgr.a (mgr.14388) 1244 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:01.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:00 smithi027 bash[22610]: cluster 2024-08-31T02:40:00.000147+0000 mon.a (mon.0) 779 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:40:01.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:00 smithi191 bash[24992]: cluster 2024-08-31T02:39:59.773378+0000 mgr.a (mgr.14388) 1244 : cluster [DBG] pgmap v861: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:01.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:00 smithi191 bash[24992]: cluster 2024-08-31T02:40:00.000147+0000 mon.a (mon.0) 779 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:40:03.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:02 smithi163 bash[24253]: cluster 2024-08-31T02:40:01.774163+0000 mgr.a (mgr.14388) 1245 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:03.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:02 smithi027 bash[22610]: cluster 2024-08-31T02:40:01.774163+0000 mgr.a (mgr.14388) 1245 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:03.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:02 smithi191 bash[24992]: cluster 2024-08-31T02:40:01.774163+0000 mgr.a (mgr.14388) 1245 : cluster [DBG] pgmap v862: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:03.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:40:03.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:40:03.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:40:04.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:40:04.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:40:04.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:40:04.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:40:04.189 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:40:05.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:04 smithi163 bash[24253]: cluster 2024-08-31T02:40:03.776031+0000 mgr.a (mgr.14388) 1246 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:05.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:04 smithi163 bash[24253]: audit 2024-08-31T02:40:03.776937+0000 mgr.a (mgr.14388) 1247 : audit [DBG] from='client.39954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:05.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:04 smithi027 bash[22610]: cluster 2024-08-31T02:40:03.776031+0000 mgr.a (mgr.14388) 1246 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:05.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:04 smithi027 bash[22610]: audit 2024-08-31T02:40:03.776937+0000 mgr.a (mgr.14388) 1247 : audit [DBG] from='client.39954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:05.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:04 smithi191 bash[24992]: cluster 2024-08-31T02:40:03.776031+0000 mgr.a (mgr.14388) 1246 : cluster [DBG] pgmap v863: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:05.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:04 smithi191 bash[24992]: audit 2024-08-31T02:40:03.776937+0000 mgr.a (mgr.14388) 1247 : audit [DBG] from='client.39954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:07.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:06 smithi163 bash[24253]: cluster 2024-08-31T02:40:05.776937+0000 mgr.a (mgr.14388) 1248 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:07.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:06 smithi027 bash[22610]: cluster 2024-08-31T02:40:05.776937+0000 mgr.a (mgr.14388) 1248 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:07.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:06 smithi191 bash[24992]: cluster 2024-08-31T02:40:05.776937+0000 mgr.a (mgr.14388) 1248 : cluster [DBG] pgmap v864: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:09.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:40:09.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:40:09.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:40:09.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:08 smithi163 bash[24253]: cluster 2024-08-31T02:40:07.777719+0000 mgr.a (mgr.14388) 1249 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:40:09.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:08 smithi027 bash[22610]: cluster 2024-08-31T02:40:07.777719+0000 mgr.a (mgr.14388) 1249 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:40:09.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:08 smithi191 bash[24992]: cluster 2024-08-31T02:40:07.777719+0000 mgr.a (mgr.14388) 1249 : cluster [DBG] pgmap v865: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:40:09.934 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:40:09.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:40:09.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:40:09.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:40:09.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:40:11.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:10 smithi163 bash[24253]: audit 2024-08-31T02:40:09.528645+0000 mgr.a (mgr.14388) 1250 : audit [DBG] from='client.40032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:11.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:10 smithi163 bash[24253]: cluster 2024-08-31T02:40:09.779083+0000 mgr.a (mgr.14388) 1251 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:10 smithi027 bash[22610]: audit 2024-08-31T02:40:09.528645+0000 mgr.a (mgr.14388) 1250 : audit [DBG] from='client.40032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:10 smithi027 bash[22610]: cluster 2024-08-31T02:40:09.779083+0000 mgr.a (mgr.14388) 1251 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:11.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:10 smithi191 bash[24992]: audit 2024-08-31T02:40:09.528645+0000 mgr.a (mgr.14388) 1250 : audit [DBG] from='client.40032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:11.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:10 smithi191 bash[24992]: cluster 2024-08-31T02:40:09.779083+0000 mgr.a (mgr.14388) 1251 : cluster [DBG] pgmap v866: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:13.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:12 smithi163 bash[24253]: cluster 2024-08-31T02:40:11.779928+0000 mgr.a (mgr.14388) 1252 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:13.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:12 smithi027 bash[22610]: cluster 2024-08-31T02:40:11.779928+0000 mgr.a (mgr.14388) 1252 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:13.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:12 smithi191 bash[24992]: cluster 2024-08-31T02:40:11.779928+0000 mgr.a (mgr.14388) 1252 : cluster [DBG] pgmap v867: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:14.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:40:14.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:40:14.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:40:15.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:14 smithi163 bash[24253]: cluster 2024-08-31T02:40:13.782061+0000 mgr.a (mgr.14388) 1253 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:15.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:14 smithi027 bash[22610]: cluster 2024-08-31T02:40:13.782061+0000 mgr.a (mgr.14388) 1253 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:15.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:14 smithi191 bash[24992]: cluster 2024-08-31T02:40:13.782061+0000 mgr.a (mgr.14388) 1253 : cluster [DBG] pgmap v868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:15.676 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:40:15.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:40:15.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:40:15.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:40:15.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:40:17.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:16 smithi027 bash[22610]: audit 2024-08-31T02:40:15.275098+0000 mgr.a (mgr.14388) 1254 : audit [DBG] from='client.40107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:17.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:16 smithi027 bash[22610]: cluster 2024-08-31T02:40:15.782620+0000 mgr.a (mgr.14388) 1255 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:17.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:16 smithi191 bash[24992]: audit 2024-08-31T02:40:15.275098+0000 mgr.a (mgr.14388) 1254 : audit [DBG] from='client.40107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:17.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:16 smithi191 bash[24992]: cluster 2024-08-31T02:40:15.782620+0000 mgr.a (mgr.14388) 1255 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:16 smithi163 bash[24253]: audit 2024-08-31T02:40:15.275098+0000 mgr.a (mgr.14388) 1254 : audit [DBG] from='client.40107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:16 smithi163 bash[24253]: cluster 2024-08-31T02:40:15.782620+0000 mgr.a (mgr.14388) 1255 : cluster [DBG] pgmap v869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:19.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:18 smithi027 bash[22610]: cluster 2024-08-31T02:40:17.783304+0000 mgr.a (mgr.14388) 1256 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:19.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:18 smithi191 bash[24992]: cluster 2024-08-31T02:40:17.783304+0000 mgr.a (mgr.14388) 1256 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:19.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:18 smithi163 bash[24253]: cluster 2024-08-31T02:40:17.783304+0000 mgr.a (mgr.14388) 1256 : cluster [DBG] pgmap v870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:20.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:40:20.678 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:40:20.678 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:40:21.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:20 smithi027 bash[22610]: cluster 2024-08-31T02:40:19.785464+0000 mgr.a (mgr.14388) 1257 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:21.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:20 smithi191 bash[24992]: cluster 2024-08-31T02:40:19.785464+0000 mgr.a (mgr.14388) 1257 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:21.414 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:40:21.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:40:21.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:40:21.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:40:21.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:40:21.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:20 smithi163 bash[24253]: cluster 2024-08-31T02:40:19.785464+0000 mgr.a (mgr.14388) 1257 : cluster [DBG] pgmap v871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:22.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:21 smithi027 bash[22610]: audit 2024-08-31T02:40:21.013220+0000 mgr.a (mgr.14388) 1258 : audit [DBG] from='client.40185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:22.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:21 smithi191 bash[24992]: audit 2024-08-31T02:40:21.013220+0000 mgr.a (mgr.14388) 1258 : audit [DBG] from='client.40185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:22.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:21 smithi163 bash[24253]: audit 2024-08-31T02:40:21.013220+0000 mgr.a (mgr.14388) 1258 : audit [DBG] from='client.40185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:23.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:22 smithi027 bash[22610]: cluster 2024-08-31T02:40:21.786306+0000 mgr.a (mgr.14388) 1259 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:23.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:22 smithi191 bash[24992]: cluster 2024-08-31T02:40:21.786306+0000 mgr.a (mgr.14388) 1259 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:23.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:22 smithi163 bash[24253]: cluster 2024-08-31T02:40:21.786306+0000 mgr.a (mgr.14388) 1259 : cluster [DBG] pgmap v872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:25.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:24 smithi027 bash[22610]: cluster 2024-08-31T02:40:23.788570+0000 mgr.a (mgr.14388) 1260 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:25.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:24 smithi191 bash[24992]: cluster 2024-08-31T02:40:23.788570+0000 mgr.a (mgr.14388) 1260 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:25.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:24 smithi163 bash[24253]: cluster 2024-08-31T02:40:23.788570+0000 mgr.a (mgr.14388) 1260 : cluster [DBG] pgmap v873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:26.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:40:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:40:26.417 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:40:27.165 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:40:27.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:40:27.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:40:27.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:40:27.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:40:27.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:26 smithi191 bash[24992]: cluster 2024-08-31T02:40:25.789354+0000 mgr.a (mgr.14388) 1261 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:27.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:26 smithi163 bash[24253]: cluster 2024-08-31T02:40:25.789354+0000 mgr.a (mgr.14388) 1261 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:27.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:26 smithi027 bash[22610]: cluster 2024-08-31T02:40:25.789354+0000 mgr.a (mgr.14388) 1261 : cluster [DBG] pgmap v874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:28.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:27 smithi191 bash[24992]: audit 2024-08-31T02:40:26.749407+0000 mgr.a (mgr.14388) 1262 : audit [DBG] from='client.40263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:28.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:27 smithi163 bash[24253]: audit 2024-08-31T02:40:26.749407+0000 mgr.a (mgr.14388) 1262 : audit [DBG] from='client.40263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:28.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:27 smithi027 bash[22610]: audit 2024-08-31T02:40:26.749407+0000 mgr.a (mgr.14388) 1262 : audit [DBG] from='client.40263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:29.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:28 smithi191 bash[24992]: cluster 2024-08-31T02:40:27.790307+0000 mgr.a (mgr.14388) 1263 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:29.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:28 smithi163 bash[24253]: cluster 2024-08-31T02:40:27.790307+0000 mgr.a (mgr.14388) 1263 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:29.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:28 smithi027 bash[22610]: cluster 2024-08-31T02:40:27.790307+0000 mgr.a (mgr.14388) 1263 : cluster [DBG] pgmap v875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:31.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:30 smithi191 bash[24992]: cluster 2024-08-31T02:40:29.792559+0000 mgr.a (mgr.14388) 1264 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:31.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:30 smithi163 bash[24253]: cluster 2024-08-31T02:40:29.792559+0000 mgr.a (mgr.14388) 1264 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:31.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:30 smithi027 bash[22610]: cluster 2024-08-31T02:40:29.792559+0000 mgr.a (mgr.14388) 1264 : cluster [DBG] pgmap v876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:32.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:40:32.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:40:32.168 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:40:32.919 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:40:32.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:40:32.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:40:32.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:40:32.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:40:33.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:33 smithi191 bash[24992]: cluster 2024-08-31T02:40:31.793345+0000 mgr.a (mgr.14388) 1265 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:33.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:33 smithi163 bash[24253]: cluster 2024-08-31T02:40:31.793345+0000 mgr.a (mgr.14388) 1265 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:33.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:33 smithi027 bash[22610]: cluster 2024-08-31T02:40:31.793345+0000 mgr.a (mgr.14388) 1265 : cluster [DBG] pgmap v877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:34.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:34 smithi191 bash[24992]: audit 2024-08-31T02:40:32.500283+0000 mgr.a (mgr.14388) 1266 : audit [DBG] from='client.40341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:34.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:34 smithi191 bash[24992]: audit 2024-08-31T02:40:33.551092+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:40:34.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:34 smithi163 bash[24253]: audit 2024-08-31T02:40:32.500283+0000 mgr.a (mgr.14388) 1266 : audit [DBG] from='client.40341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:34.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:34 smithi163 bash[24253]: audit 2024-08-31T02:40:33.551092+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:40:34.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:34 smithi027 bash[22610]: audit 2024-08-31T02:40:32.500283+0000 mgr.a (mgr.14388) 1266 : audit [DBG] from='client.40341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:34.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:34 smithi027 bash[22610]: audit 2024-08-31T02:40:33.551092+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:40:35.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:35 smithi191 bash[24992]: cluster 2024-08-31T02:40:33.795659+0000 mgr.a (mgr.14388) 1267 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:35.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:35 smithi163 bash[24253]: cluster 2024-08-31T02:40:33.795659+0000 mgr.a (mgr.14388) 1267 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:35.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:35 smithi027 bash[22610]: cluster 2024-08-31T02:40:33.795659+0000 mgr.a (mgr.14388) 1267 : cluster [DBG] pgmap v878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:40:37.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:37 smithi191 bash[24992]: cluster 2024-08-31T02:40:35.796471+0000 mgr.a (mgr.14388) 1268 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:37.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:37 smithi163 bash[24253]: cluster 2024-08-31T02:40:35.796471+0000 mgr.a (mgr.14388) 1268 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:37.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:37 smithi027 bash[22610]: cluster 2024-08-31T02:40:35.796471+0000 mgr.a (mgr.14388) 1268 : cluster [DBG] pgmap v879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:37.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:40:37.921 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:40:37.921 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:40:38.659 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:40:38.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:40:38.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:40:38.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:40:38.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:40:39.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:39 smithi191 bash[24992]: cluster 2024-08-31T02:40:37.797236+0000 mgr.a (mgr.14388) 1269 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:39.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:39 smithi163 bash[24253]: cluster 2024-08-31T02:40:37.797236+0000 mgr.a (mgr.14388) 1269 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:39.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:39 smithi027 bash[22610]: cluster 2024-08-31T02:40:37.797236+0000 mgr.a (mgr.14388) 1269 : cluster [DBG] pgmap v880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:40.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:40 smithi191 bash[24992]: audit 2024-08-31T02:40:38.257138+0000 mgr.a (mgr.14388) 1270 : audit [DBG] from='client.40419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:40.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:40 smithi163 bash[24253]: audit 2024-08-31T02:40:38.257138+0000 mgr.a (mgr.14388) 1270 : audit [DBG] from='client.40419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:40.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:40 smithi027 bash[22610]: audit 2024-08-31T02:40:38.257138+0000 mgr.a (mgr.14388) 1270 : audit [DBG] from='client.40419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:41.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:41 smithi191 bash[24992]: cluster 2024-08-31T02:40:39.799965+0000 mgr.a (mgr.14388) 1271 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:41.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:41 smithi163 bash[24253]: cluster 2024-08-31T02:40:39.799965+0000 mgr.a (mgr.14388) 1271 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:41.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:41 smithi027 bash[22610]: cluster 2024-08-31T02:40:39.799965+0000 mgr.a (mgr.14388) 1271 : cluster [DBG] pgmap v881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:43.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:43 smithi191 bash[24992]: cluster 2024-08-31T02:40:41.800758+0000 mgr.a (mgr.14388) 1272 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:43.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:43 smithi163 bash[24253]: cluster 2024-08-31T02:40:41.800758+0000 mgr.a (mgr.14388) 1272 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:43.478 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:43 smithi027 bash[22610]: cluster 2024-08-31T02:40:41.800758+0000 mgr.a (mgr.14388) 1272 : cluster [DBG] pgmap v882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:43.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:40:43.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:40:43.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:40:44.432 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:40:44.432 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:40:44.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:40:44.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:40:44.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:40:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:44 smithi163 bash[24253]: audit 2024-08-31T02:40:43.647603+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:44 smithi163 bash[24253]: audit 2024-08-31T02:40:43.657141+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:44 smithi163 bash[24253]: cluster 2024-08-31T02:40:43.802535+0000 mgr.a (mgr.14388) 1273 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:44 smithi163 bash[24253]: audit 2024-08-31T02:40:44.006532+0000 mgr.a (mgr.14388) 1274 : audit [DBG] from='client.40497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:44 smithi163 bash[24253]: audit 2024-08-31T02:40:44.425684+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:44 smithi163 bash[24253]: audit 2024-08-31T02:40:44.431901+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:44 smithi163 bash[24253]: audit 2024-08-31T02:40:44.433054+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:40:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:44 smithi163 bash[24253]: audit 2024-08-31T02:40:44.433934+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:40:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:44 smithi163 bash[24253]: audit 2024-08-31T02:40:44.441226+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:44 smithi163 bash[24253]: audit 2024-08-31T02:40:44.443506+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:40:44.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:44 smithi027 bash[22610]: audit 2024-08-31T02:40:43.647603+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:44.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:44 smithi027 bash[22610]: audit 2024-08-31T02:40:43.657141+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:44.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:44 smithi027 bash[22610]: cluster 2024-08-31T02:40:43.802535+0000 mgr.a (mgr.14388) 1273 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:44.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:44 smithi027 bash[22610]: audit 2024-08-31T02:40:44.006532+0000 mgr.a (mgr.14388) 1274 : audit [DBG] from='client.40497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:44.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:44 smithi027 bash[22610]: audit 2024-08-31T02:40:44.425684+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:44.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:44 smithi027 bash[22610]: audit 2024-08-31T02:40:44.431901+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:44.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:44 smithi027 bash[22610]: audit 2024-08-31T02:40:44.433054+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:40:44.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:44 smithi027 bash[22610]: audit 2024-08-31T02:40:44.433934+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:40:44.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:44 smithi027 bash[22610]: audit 2024-08-31T02:40:44.441226+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:44.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:44 smithi027 bash[22610]: audit 2024-08-31T02:40:44.443506+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:40:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:44 smithi191 bash[24992]: audit 2024-08-31T02:40:43.647603+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:44 smithi191 bash[24992]: audit 2024-08-31T02:40:43.657141+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:44 smithi191 bash[24992]: cluster 2024-08-31T02:40:43.802535+0000 mgr.a (mgr.14388) 1273 : cluster [DBG] pgmap v883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:40:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:44 smithi191 bash[24992]: audit 2024-08-31T02:40:44.006532+0000 mgr.a (mgr.14388) 1274 : audit [DBG] from='client.40497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:44 smithi191 bash[24992]: audit 2024-08-31T02:40:44.425684+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:44 smithi191 bash[24992]: audit 2024-08-31T02:40:44.431901+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:44 smithi191 bash[24992]: audit 2024-08-31T02:40:44.433054+0000 mon.a (mon.0) 785 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:40:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:44 smithi191 bash[24992]: audit 2024-08-31T02:40:44.433934+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:40:45.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:44 smithi191 bash[24992]: audit 2024-08-31T02:40:44.441226+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:40:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:44 smithi191 bash[24992]: audit 2024-08-31T02:40:44.443506+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:40:45.478 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:40:45 smithi027 bash[22863]: debug 2024-08-31T02:40:45.126+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:40:45.478 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:40:45 smithi027 bash[22863]: debug 2024-08-31T02:40:45.126+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:40:45.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:45 smithi163 bash[24253]: audit 2024-08-31T02:40:44.444505+0000 mgr.a (mgr.14388) 1275 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:40:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:45 smithi163 bash[24253]: audit 2024-08-31T02:40:45.128828+0000 mgr.a (mgr.14388) 1276 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:40:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:45 smithi163 bash[24253]: cephadm 2024-08-31T02:40:45.130087+0000 mgr.a (mgr.14388) 1277 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:40:45.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:45 smithi027 bash[22610]: audit 2024-08-31T02:40:44.444505+0000 mgr.a (mgr.14388) 1275 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:40:45.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:45 smithi027 bash[22610]: audit 2024-08-31T02:40:45.128828+0000 mgr.a (mgr.14388) 1276 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:40:45.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:45 smithi027 bash[22610]: cephadm 2024-08-31T02:40:45.130087+0000 mgr.a (mgr.14388) 1277 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:40:46.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:45 smithi191 bash[24992]: audit 2024-08-31T02:40:44.444505+0000 mgr.a (mgr.14388) 1275 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:40:46.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:45 smithi191 bash[24992]: audit 2024-08-31T02:40:45.128828+0000 mgr.a (mgr.14388) 1276 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:40:46.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:45 smithi191 bash[24992]: cephadm 2024-08-31T02:40:45.130087+0000 mgr.a (mgr.14388) 1277 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:40:46.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:46 smithi163 bash[24253]: cluster 2024-08-31T02:40:45.803463+0000 mgr.a (mgr.14388) 1278 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:46.979 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:46 smithi027 bash[22610]: cluster 2024-08-31T02:40:45.803463+0000 mgr.a (mgr.14388) 1278 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:47.037 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:46 smithi191 bash[24992]: cluster 2024-08-31T02:40:45.803463+0000 mgr.a (mgr.14388) 1278 : cluster [DBG] pgmap v884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:40:49.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:48 smithi163 bash[24253]: cluster 2024-08-31T02:40:47.804219+0000 mgr.a (mgr.14388) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:40:49.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:48 smithi027 bash[22610]: cluster 2024-08-31T02:40:47.804219+0000 mgr.a (mgr.14388) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:40:49.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:48 smithi191 bash[24992]: cluster 2024-08-31T02:40:47.804219+0000 mgr.a (mgr.14388) 1279 : cluster [DBG] pgmap v885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:40:49.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:40:49.434 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:40:49.434 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:40:50.203 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:40:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:40:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:40:50.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:40:50.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:40:51.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:50 smithi163 bash[24253]: audit 2024-08-31T02:40:49.777758+0000 mgr.a (mgr.14388) 1280 : audit [DBG] from='client.40680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:50 smithi163 bash[24253]: cluster 2024-08-31T02:40:49.806017+0000 mgr.a (mgr.14388) 1281 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:51.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:50 smithi027 bash[22610]: audit 2024-08-31T02:40:49.777758+0000 mgr.a (mgr.14388) 1280 : audit [DBG] from='client.40680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:51.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:50 smithi027 bash[22610]: cluster 2024-08-31T02:40:49.806017+0000 mgr.a (mgr.14388) 1281 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:51.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:50 smithi191 bash[24992]: audit 2024-08-31T02:40:49.777758+0000 mgr.a (mgr.14388) 1280 : audit [DBG] from='client.40680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:51.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:50 smithi191 bash[24992]: cluster 2024-08-31T02:40:49.806017+0000 mgr.a (mgr.14388) 1281 : cluster [DBG] pgmap v886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:53.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:52 smithi163 bash[24253]: cluster 2024-08-31T02:40:51.806991+0000 mgr.a (mgr.14388) 1282 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:53.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:52 smithi027 bash[22610]: cluster 2024-08-31T02:40:51.806991+0000 mgr.a (mgr.14388) 1282 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:53.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:52 smithi191 bash[24992]: cluster 2024-08-31T02:40:51.806991+0000 mgr.a (mgr.14388) 1282 : cluster [DBG] pgmap v887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:55.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:54 smithi163 bash[24253]: cluster 2024-08-31T02:40:53.809246+0000 mgr.a (mgr.14388) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:55.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:40:55.205 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:40:55.205 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:40:55.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:54 smithi027 bash[22610]: cluster 2024-08-31T02:40:53.809246+0000 mgr.a (mgr.14388) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:55.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:54 smithi191 bash[24992]: cluster 2024-08-31T02:40:53.809246+0000 mgr.a (mgr.14388) 1283 : cluster [DBG] pgmap v888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:55.941 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:40:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:40:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:40:55.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:40:55.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:40:57.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:56 smithi163 bash[24253]: audit 2024-08-31T02:40:55.532305+0000 mgr.a (mgr.14388) 1284 : audit [DBG] from='client.40758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:56 smithi163 bash[24253]: cluster 2024-08-31T02:40:55.809888+0000 mgr.a (mgr.14388) 1285 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:57.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:56 smithi027 bash[22610]: audit 2024-08-31T02:40:55.532305+0000 mgr.a (mgr.14388) 1284 : audit [DBG] from='client.40758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:57.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:56 smithi027 bash[22610]: cluster 2024-08-31T02:40:55.809888+0000 mgr.a (mgr.14388) 1285 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:57.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:56 smithi191 bash[24992]: audit 2024-08-31T02:40:55.532305+0000 mgr.a (mgr.14388) 1284 : audit [DBG] from='client.40758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:40:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:56 smithi191 bash[24992]: cluster 2024-08-31T02:40:55.809888+0000 mgr.a (mgr.14388) 1285 : cluster [DBG] pgmap v889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:59.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:40:58 smithi163 bash[24253]: cluster 2024-08-31T02:40:57.810705+0000 mgr.a (mgr.14388) 1286 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:59.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:40:58 smithi027 bash[22610]: cluster 2024-08-31T02:40:57.810705+0000 mgr.a (mgr.14388) 1286 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:40:59.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:40:58 smithi191 bash[24992]: cluster 2024-08-31T02:40:57.810705+0000 mgr.a (mgr.14388) 1286 : cluster [DBG] pgmap v890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:00.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:00.943 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:00.943 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:01.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:00 smithi163 bash[24253]: cluster 2024-08-31T02:40:59.812962+0000 mgr.a (mgr.14388) 1287 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:01.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:00 smithi027 bash[22610]: cluster 2024-08-31T02:40:59.812962+0000 mgr.a (mgr.14388) 1287 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:01.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:00 smithi191 bash[24992]: cluster 2024-08-31T02:40:59.812962+0000 mgr.a (mgr.14388) 1287 : cluster [DBG] pgmap v891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:01.692 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:01.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:01.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:01.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:01.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:03.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:02 smithi163 bash[24253]: audit 2024-08-31T02:41:01.278873+0000 mgr.a (mgr.14388) 1288 : audit [DBG] from='client.40833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:02 smithi163 bash[24253]: cluster 2024-08-31T02:41:01.814024+0000 mgr.a (mgr.14388) 1289 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:03.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:02 smithi027 bash[22610]: audit 2024-08-31T02:41:01.278873+0000 mgr.a (mgr.14388) 1288 : audit [DBG] from='client.40833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:03.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:02 smithi027 bash[22610]: cluster 2024-08-31T02:41:01.814024+0000 mgr.a (mgr.14388) 1289 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:03.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:02 smithi191 bash[24992]: audit 2024-08-31T02:41:01.278873+0000 mgr.a (mgr.14388) 1288 : audit [DBG] from='client.40833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:03.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:02 smithi191 bash[24992]: cluster 2024-08-31T02:41:01.814024+0000 mgr.a (mgr.14388) 1289 : cluster [DBG] pgmap v892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:05.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:04 smithi163 bash[24253]: cluster 2024-08-31T02:41:03.816352+0000 mgr.a (mgr.14388) 1290 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:05.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:04 smithi027 bash[22610]: cluster 2024-08-31T02:41:03.816352+0000 mgr.a (mgr.14388) 1290 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:05.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:04 smithi191 bash[24992]: cluster 2024-08-31T02:41:03.816352+0000 mgr.a (mgr.14388) 1290 : cluster [DBG] pgmap v893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:06.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:06.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:06.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:06.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:06 smithi163 bash[24253]: cluster 2024-08-31T02:41:05.817157+0000 mgr.a (mgr.14388) 1291 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:06.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:06 smithi027 bash[22610]: cluster 2024-08-31T02:41:05.817157+0000 mgr.a (mgr.14388) 1291 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:06.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:06 smithi191 bash[24992]: cluster 2024-08-31T02:41:05.817157+0000 mgr.a (mgr.14388) 1291 : cluster [DBG] pgmap v894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:07.452 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:07.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:07.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:07.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:07.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:07.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:07 smithi163 bash[24253]: audit 2024-08-31T02:41:07.033528+0000 mgr.a (mgr.14388) 1292 : audit [DBG] from='client.40911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:07.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:07 smithi027 bash[22610]: audit 2024-08-31T02:41:07.033528+0000 mgr.a (mgr.14388) 1292 : audit [DBG] from='client.40911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:07.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:07 smithi191 bash[24992]: audit 2024-08-31T02:41:07.033528+0000 mgr.a (mgr.14388) 1292 : audit [DBG] from='client.40911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:08.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:08 smithi163 bash[24253]: cluster 2024-08-31T02:41:07.818127+0000 mgr.a (mgr.14388) 1293 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:08.728 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:08 smithi027 bash[22610]: cluster 2024-08-31T02:41:07.818127+0000 mgr.a (mgr.14388) 1293 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:08.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:08 smithi191 bash[24992]: cluster 2024-08-31T02:41:07.818127+0000 mgr.a (mgr.14388) 1293 : cluster [DBG] pgmap v895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:11.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:10 smithi163 bash[24253]: cluster 2024-08-31T02:41:09.820420+0000 mgr.a (mgr.14388) 1294 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:11.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:10 smithi027 bash[22610]: cluster 2024-08-31T02:41:09.820420+0000 mgr.a (mgr.14388) 1294 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:11.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:10 smithi191 bash[24992]: cluster 2024-08-31T02:41:09.820420+0000 mgr.a (mgr.14388) 1294 : cluster [DBG] pgmap v896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:12.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:12.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:12.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:13.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:12 smithi163 bash[24253]: cluster 2024-08-31T02:41:11.821226+0000 mgr.a (mgr.14388) 1295 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:13.203 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:13.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:13.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:13.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:12 smithi027 bash[22610]: cluster 2024-08-31T02:41:11.821226+0000 mgr.a (mgr.14388) 1295 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:13.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:12 smithi191 bash[24992]: cluster 2024-08-31T02:41:11.821226+0000 mgr.a (mgr.14388) 1295 : cluster [DBG] pgmap v897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:14.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:13 smithi163 bash[24253]: audit 2024-08-31T02:41:12.793869+0000 mgr.a (mgr.14388) 1296 : audit [DBG] from='client.40986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:14.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:13 smithi027 bash[22610]: audit 2024-08-31T02:41:12.793869+0000 mgr.a (mgr.14388) 1296 : audit [DBG] from='client.40986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:14.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:13 smithi191 bash[24992]: audit 2024-08-31T02:41:12.793869+0000 mgr.a (mgr.14388) 1296 : audit [DBG] from='client.40986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:15.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:14 smithi163 bash[24253]: cluster 2024-08-31T02:41:13.823729+0000 mgr.a (mgr.14388) 1297 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:41:15.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:14 smithi027 bash[22610]: cluster 2024-08-31T02:41:13.823729+0000 mgr.a (mgr.14388) 1297 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:41:15.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:14 smithi191 bash[24992]: cluster 2024-08-31T02:41:13.823729+0000 mgr.a (mgr.14388) 1297 : cluster [DBG] pgmap v898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:41:17.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:16 smithi163 bash[24253]: cluster 2024-08-31T02:41:15.824688+0000 mgr.a (mgr.14388) 1298 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:41:17.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:16 smithi027 bash[22610]: cluster 2024-08-31T02:41:15.824688+0000 mgr.a (mgr.14388) 1298 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:41:17.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:16 smithi191 bash[24992]: cluster 2024-08-31T02:41:15.824688+0000 mgr.a (mgr.14388) 1298 : cluster [DBG] pgmap v899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:41:18.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:18.206 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:18.206 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:18.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:18.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:18.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:18.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:18.981 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:19.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:18 smithi163 bash[24253]: cluster 2024-08-31T02:41:17.825473+0000 mgr.a (mgr.14388) 1299 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:41:19.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:18 smithi027 bash[22610]: cluster 2024-08-31T02:41:17.825473+0000 mgr.a (mgr.14388) 1299 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:41:19.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:18 smithi191 bash[24992]: cluster 2024-08-31T02:41:17.825473+0000 mgr.a (mgr.14388) 1299 : cluster [DBG] pgmap v900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:41:20.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:19 smithi163 bash[24253]: audit 2024-08-31T02:41:18.546490+0000 mgr.a (mgr.14388) 1300 : audit [DBG] from='client.41064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:20.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:19 smithi027 bash[22610]: audit 2024-08-31T02:41:18.546490+0000 mgr.a (mgr.14388) 1300 : audit [DBG] from='client.41064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:20.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:19 smithi191 bash[24992]: audit 2024-08-31T02:41:18.546490+0000 mgr.a (mgr.14388) 1300 : audit [DBG] from='client.41064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:21.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:20 smithi163 bash[24253]: cluster 2024-08-31T02:41:19.828236+0000 mgr.a (mgr.14388) 1301 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:21.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:20 smithi027 bash[22610]: cluster 2024-08-31T02:41:19.828236+0000 mgr.a (mgr.14388) 1301 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:21.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:20 smithi191 bash[24992]: cluster 2024-08-31T02:41:19.828236+0000 mgr.a (mgr.14388) 1301 : cluster [DBG] pgmap v901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:23.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:22 smithi163 bash[24253]: cluster 2024-08-31T02:41:21.829030+0000 mgr.a (mgr.14388) 1302 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:41:23.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:22 smithi027 bash[22610]: cluster 2024-08-31T02:41:21.829030+0000 mgr.a (mgr.14388) 1302 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:41:23.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:22 smithi191 bash[24992]: cluster 2024-08-31T02:41:21.829030+0000 mgr.a (mgr.14388) 1302 : cluster [DBG] pgmap v902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:41:23.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:23.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:23.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:24.748 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:24.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:24.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:24.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:24.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:25.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:24 smithi163 bash[24253]: cluster 2024-08-31T02:41:23.830979+0000 mgr.a (mgr.14388) 1303 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:25.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:24 smithi027 bash[22610]: cluster 2024-08-31T02:41:23.830979+0000 mgr.a (mgr.14388) 1303 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:25.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:24 smithi191 bash[24992]: cluster 2024-08-31T02:41:23.830979+0000 mgr.a (mgr.14388) 1303 : cluster [DBG] pgmap v903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:26.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:25 smithi163 bash[24253]: audit 2024-08-31T02:41:24.323675+0000 mgr.a (mgr.14388) 1304 : audit [DBG] from='client.41142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:26.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:25 smithi027 bash[22610]: audit 2024-08-31T02:41:24.323675+0000 mgr.a (mgr.14388) 1304 : audit [DBG] from='client.41142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:26.286 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:25 smithi191 bash[24992]: audit 2024-08-31T02:41:24.323675+0000 mgr.a (mgr.14388) 1304 : audit [DBG] from='client.41142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:27.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:26 smithi163 bash[24253]: cluster 2024-08-31T02:41:25.831880+0000 mgr.a (mgr.14388) 1305 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:41:27.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:26 smithi027 bash[22610]: cluster 2024-08-31T02:41:25.831880+0000 mgr.a (mgr.14388) 1305 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:41:27.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:26 smithi191 bash[24992]: cluster 2024-08-31T02:41:25.831880+0000 mgr.a (mgr.14388) 1305 : cluster [DBG] pgmap v904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:41:29.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:28 smithi163 bash[24253]: cluster 2024-08-31T02:41:27.832633+0000 mgr.a (mgr.14388) 1306 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:41:29.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:28 smithi027 bash[22610]: cluster 2024-08-31T02:41:27.832633+0000 mgr.a (mgr.14388) 1306 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:41:29.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:28 smithi191 bash[24992]: cluster 2024-08-31T02:41:27.832633+0000 mgr.a (mgr.14388) 1306 : cluster [DBG] pgmap v905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T02:41:29.747 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:29.748 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:29.748 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:30.493 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:30.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:30.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:31.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:30 smithi163 bash[24253]: cluster 2024-08-31T02:41:29.834902+0000 mgr.a (mgr.14388) 1307 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T02:41:31.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:30 smithi163 bash[24253]: audit 2024-08-31T02:41:30.086756+0000 mgr.a (mgr.14388) 1308 : audit [DBG] from='client.41220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:31.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:30 smithi027 bash[22610]: cluster 2024-08-31T02:41:29.834902+0000 mgr.a (mgr.14388) 1307 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T02:41:31.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:30 smithi027 bash[22610]: audit 2024-08-31T02:41:30.086756+0000 mgr.a (mgr.14388) 1308 : audit [DBG] from='client.41220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:31.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:30 smithi191 bash[24992]: cluster 2024-08-31T02:41:29.834902+0000 mgr.a (mgr.14388) 1307 : cluster [DBG] pgmap v906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T02:41:31.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:30 smithi191 bash[24992]: audit 2024-08-31T02:41:30.086756+0000 mgr.a (mgr.14388) 1308 : audit [DBG] from='client.41220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:33.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:32 smithi163 bash[24253]: cluster 2024-08-31T02:41:31.835777+0000 mgr.a (mgr.14388) 1309 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:33.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:32 smithi027 bash[22610]: cluster 2024-08-31T02:41:31.835777+0000 mgr.a (mgr.14388) 1309 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:33.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:32 smithi191 bash[24992]: cluster 2024-08-31T02:41:31.835777+0000 mgr.a (mgr.14388) 1309 : cluster [DBG] pgmap v907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:35.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:34 smithi027 bash[22610]: cluster 2024-08-31T02:41:33.837893+0000 mgr.a (mgr.14388) 1310 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:35.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:34 smithi191 bash[24992]: cluster 2024-08-31T02:41:33.837893+0000 mgr.a (mgr.14388) 1310 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:35.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:34 smithi163 bash[24253]: cluster 2024-08-31T02:41:33.837893+0000 mgr.a (mgr.14388) 1310 : cluster [DBG] pgmap v908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:35.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:35.496 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:35.496 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:36.240 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:36.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:36.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:36.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:36.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:37.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:36 smithi027 bash[22610]: audit 2024-08-31T02:41:35.833575+0000 mgr.a (mgr.14388) 1311 : audit [DBG] from='client.41298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:37.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:36 smithi027 bash[22610]: cluster 2024-08-31T02:41:35.849822+0000 mgr.a (mgr.14388) 1312 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:37.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:36 smithi191 bash[24992]: audit 2024-08-31T02:41:35.833575+0000 mgr.a (mgr.14388) 1311 : audit [DBG] from='client.41298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:37.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:36 smithi191 bash[24992]: cluster 2024-08-31T02:41:35.849822+0000 mgr.a (mgr.14388) 1312 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:37.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:36 smithi163 bash[24253]: audit 2024-08-31T02:41:35.833575+0000 mgr.a (mgr.14388) 1311 : audit [DBG] from='client.41298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:36 smithi163 bash[24253]: cluster 2024-08-31T02:41:35.849822+0000 mgr.a (mgr.14388) 1312 : cluster [DBG] pgmap v909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:39.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:38 smithi027 bash[22610]: cluster 2024-08-31T02:41:37.850966+0000 mgr.a (mgr.14388) 1313 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:39.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:38 smithi191 bash[24992]: cluster 2024-08-31T02:41:37.850966+0000 mgr.a (mgr.14388) 1313 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:39.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:38 smithi163 bash[24253]: cluster 2024-08-31T02:41:37.850966+0000 mgr.a (mgr.14388) 1313 : cluster [DBG] pgmap v910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:41.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:40 smithi027 bash[22610]: cluster 2024-08-31T02:41:39.853307+0000 mgr.a (mgr.14388) 1314 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:41.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:41.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:41.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:41.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:40 smithi191 bash[24992]: cluster 2024-08-31T02:41:39.853307+0000 mgr.a (mgr.14388) 1314 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:41.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:40 smithi163 bash[24253]: cluster 2024-08-31T02:41:39.853307+0000 mgr.a (mgr.14388) 1314 : cluster [DBG] pgmap v911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:42.014 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:42.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:42.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:42.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:42.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:43.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:42 smithi027 bash[22610]: audit 2024-08-31T02:41:41.585825+0000 mgr.a (mgr.14388) 1315 : audit [DBG] from='client.41376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:43.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:42 smithi027 bash[22610]: cluster 2024-08-31T02:41:41.854442+0000 mgr.a (mgr.14388) 1316 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:43.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:42 smithi191 bash[24992]: audit 2024-08-31T02:41:41.585825+0000 mgr.a (mgr.14388) 1315 : audit [DBG] from='client.41376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:43.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:42 smithi191 bash[24992]: cluster 2024-08-31T02:41:41.854442+0000 mgr.a (mgr.14388) 1316 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:43.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:42 smithi163 bash[24253]: audit 2024-08-31T02:41:41.585825+0000 mgr.a (mgr.14388) 1315 : audit [DBG] from='client.41376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:42 smithi163 bash[24253]: cluster 2024-08-31T02:41:41.854442+0000 mgr.a (mgr.14388) 1316 : cluster [DBG] pgmap v912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:45.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:44 smithi027 bash[22610]: cluster 2024-08-31T02:41:43.856764+0000 mgr.a (mgr.14388) 1317 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:45.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:44 smithi191 bash[24992]: cluster 2024-08-31T02:41:43.856764+0000 mgr.a (mgr.14388) 1317 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:45.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:44 smithi163 bash[24253]: cluster 2024-08-31T02:41:43.856764+0000 mgr.a (mgr.14388) 1317 : cluster [DBG] pgmap v913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:41:46.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:45 smithi191 bash[24992]: audit 2024-08-31T02:41:45.193740+0000 mon.a (mon.0) 789 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:41:46.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:45 smithi163 bash[24253]: audit 2024-08-31T02:41:45.193740+0000 mon.a (mon.0) 789 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:41:46.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:45 smithi027 bash[22610]: audit 2024-08-31T02:41:45.193740+0000 mon.a (mon.0) 789 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:41:47.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:47.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:47.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:47.229 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:41:46 smithi027 bash[22863]: debug 2024-08-31T02:41:46.784+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:41:47.229 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:41:46 smithi027 bash[22863]: debug 2024-08-31T02:41:46.784+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:41:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:46 smithi027 bash[22610]: cluster 2024-08-31T02:41:45.857252+0000 mgr.a (mgr.14388) 1318 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:46 smithi027 bash[22610]: audit 2024-08-31T02:41:46.041676+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:41:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:46 smithi027 bash[22610]: audit 2024-08-31T02:41:46.043507+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:41:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:46 smithi027 bash[22610]: audit 2024-08-31T02:41:46.053889+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:41:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:46 smithi027 bash[22610]: audit 2024-08-31T02:41:46.058846+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:41:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:46 smithi027 bash[22610]: audit 2024-08-31T02:41:46.061117+0000 mgr.a (mgr.14388) 1319 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:41:47.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:46 smithi191 bash[24992]: cluster 2024-08-31T02:41:45.857252+0000 mgr.a (mgr.14388) 1318 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:47.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:46 smithi191 bash[24992]: audit 2024-08-31T02:41:46.041676+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:41:47.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:46 smithi191 bash[24992]: audit 2024-08-31T02:41:46.043507+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:41:47.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:46 smithi191 bash[24992]: audit 2024-08-31T02:41:46.053889+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:41:47.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:46 smithi191 bash[24992]: audit 2024-08-31T02:41:46.058846+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:41:47.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:46 smithi191 bash[24992]: audit 2024-08-31T02:41:46.061117+0000 mgr.a (mgr.14388) 1319 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:41:47.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:46 smithi163 bash[24253]: cluster 2024-08-31T02:41:45.857252+0000 mgr.a (mgr.14388) 1318 : cluster [DBG] pgmap v914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:46 smithi163 bash[24253]: audit 2024-08-31T02:41:46.041676+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:41:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:46 smithi163 bash[24253]: audit 2024-08-31T02:41:46.043507+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:41:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:46 smithi163 bash[24253]: audit 2024-08-31T02:41:46.053889+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:41:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:46 smithi163 bash[24253]: audit 2024-08-31T02:41:46.058846+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:41:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:46 smithi163 bash[24253]: audit 2024-08-31T02:41:46.061117+0000 mgr.a (mgr.14388) 1319 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:41:47.771 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:47.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:47.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:47.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:47.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:48.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:47 smithi191 bash[24992]: audit 2024-08-31T02:41:46.789096+0000 mgr.a (mgr.14388) 1320 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:41:48.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:47 smithi191 bash[24992]: cephadm 2024-08-31T02:41:46.790414+0000 mgr.a (mgr.14388) 1321 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:41:48.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:47 smithi163 bash[24253]: audit 2024-08-31T02:41:46.789096+0000 mgr.a (mgr.14388) 1320 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:41:48.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:47 smithi163 bash[24253]: cephadm 2024-08-31T02:41:46.790414+0000 mgr.a (mgr.14388) 1321 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:41:48.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:47 smithi027 bash[22610]: audit 2024-08-31T02:41:46.789096+0000 mgr.a (mgr.14388) 1320 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:41:48.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:47 smithi027 bash[22610]: cephadm 2024-08-31T02:41:46.790414+0000 mgr.a (mgr.14388) 1321 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:41:49.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:48 smithi191 bash[24992]: audit 2024-08-31T02:41:47.351878+0000 mgr.a (mgr.14388) 1322 : audit [DBG] from='client.41556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:49.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:48 smithi191 bash[24992]: cluster 2024-08-31T02:41:47.858157+0000 mgr.a (mgr.14388) 1323 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:49.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:48 smithi163 bash[24253]: audit 2024-08-31T02:41:47.351878+0000 mgr.a (mgr.14388) 1322 : audit [DBG] from='client.41556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:48 smithi163 bash[24253]: cluster 2024-08-31T02:41:47.858157+0000 mgr.a (mgr.14388) 1323 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:49.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:48 smithi027 bash[22610]: audit 2024-08-31T02:41:47.351878+0000 mgr.a (mgr.14388) 1322 : audit [DBG] from='client.41556 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:49.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:48 smithi027 bash[22610]: cluster 2024-08-31T02:41:47.858157+0000 mgr.a (mgr.14388) 1323 : cluster [DBG] pgmap v915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:41:51.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:51 smithi191 bash[24992]: cluster 2024-08-31T02:41:49.860387+0000 mgr.a (mgr.14388) 1324 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:51.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:50 smithi163 bash[24253]: cluster 2024-08-31T02:41:49.860387+0000 mgr.a (mgr.14388) 1324 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:51.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:51 smithi027 bash[22610]: cluster 2024-08-31T02:41:49.860387+0000 mgr.a (mgr.14388) 1324 : cluster [DBG] pgmap v916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:52.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:52.773 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:52.774 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:53.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:53 smithi191 bash[24992]: cluster 2024-08-31T02:41:51.861142+0000 mgr.a (mgr.14388) 1325 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:53.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:53 smithi163 bash[24253]: cluster 2024-08-31T02:41:51.861142+0000 mgr.a (mgr.14388) 1325 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:53.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:53 smithi027 bash[22610]: cluster 2024-08-31T02:41:51.861142+0000 mgr.a (mgr.14388) 1325 : cluster [DBG] pgmap v917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:53.542 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:54.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:54 smithi191 bash[24992]: audit 2024-08-31T02:41:53.113915+0000 mgr.a (mgr.14388) 1326 : audit [DBG] from='client.41631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:54.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:54 smithi163 bash[24253]: audit 2024-08-31T02:41:53.113915+0000 mgr.a (mgr.14388) 1326 : audit [DBG] from='client.41631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:54.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:54 smithi027 bash[22610]: audit 2024-08-31T02:41:53.113915+0000 mgr.a (mgr.14388) 1326 : audit [DBG] from='client.41631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:41:55.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:55 smithi191 bash[24992]: cluster 2024-08-31T02:41:53.863849+0000 mgr.a (mgr.14388) 1327 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:55.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:55 smithi163 bash[24253]: cluster 2024-08-31T02:41:53.863849+0000 mgr.a (mgr.14388) 1327 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:55.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:55 smithi027 bash[22610]: cluster 2024-08-31T02:41:53.863849+0000 mgr.a (mgr.14388) 1327 : cluster [DBG] pgmap v918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:41:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:57 smithi191 bash[24992]: cluster 2024-08-31T02:41:55.864645+0000 mgr.a (mgr.14388) 1328 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:41:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:57 smithi163 bash[24253]: cluster 2024-08-31T02:41:55.864645+0000 mgr.a (mgr.14388) 1328 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:41:57.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:57 smithi027 bash[22610]: cluster 2024-08-31T02:41:55.864645+0000 mgr.a (mgr.14388) 1328 : cluster [DBG] pgmap v919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:41:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:41:58.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:41:58.545 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:41:59.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:41:59 smithi191 bash[24992]: cluster 2024-08-31T02:41:57.866295+0000 mgr.a (mgr.14388) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:41:59.340 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:41:59.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:41:59.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:41:59.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:41:59.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:41:59.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:41:59 smithi163 bash[24253]: cluster 2024-08-31T02:41:57.866295+0000 mgr.a (mgr.14388) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:41:59.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:41:59 smithi027 bash[22610]: cluster 2024-08-31T02:41:57.866295+0000 mgr.a (mgr.14388) 1329 : cluster [DBG] pgmap v920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:42:00.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:00 smithi191 bash[24992]: audit 2024-08-31T02:41:58.905173+0000 mgr.a (mgr.14388) 1330 : audit [DBG] from='client.41703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:00.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:00 smithi163 bash[24253]: audit 2024-08-31T02:41:58.905173+0000 mgr.a (mgr.14388) 1330 : audit [DBG] from='client.41703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:00.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:00 smithi027 bash[22610]: audit 2024-08-31T02:41:58.905173+0000 mgr.a (mgr.14388) 1330 : audit [DBG] from='client.41703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:01.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:01 smithi191 bash[24992]: cluster 2024-08-31T02:41:59.868205+0000 mgr.a (mgr.14388) 1331 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:01.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:01 smithi163 bash[24253]: cluster 2024-08-31T02:41:59.868205+0000 mgr.a (mgr.14388) 1331 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:01.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:01 smithi027 bash[22610]: cluster 2024-08-31T02:41:59.868205+0000 mgr.a (mgr.14388) 1331 : cluster [DBG] pgmap v921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:03.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:03 smithi163 bash[24253]: cluster 2024-08-31T02:42:01.868990+0000 mgr.a (mgr.14388) 1332 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:42:03.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:03 smithi027 bash[22610]: cluster 2024-08-31T02:42:01.868990+0000 mgr.a (mgr.14388) 1332 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:42:03.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:03 smithi191 bash[24992]: cluster 2024-08-31T02:42:01.868990+0000 mgr.a (mgr.14388) 1332 : cluster [DBG] pgmap v922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:42:04.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:42:04.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:42:04.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:42:05.085 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:42:05.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:42:05.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:42:05.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:42:05.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:42:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:05 smithi163 bash[24253]: cluster 2024-08-31T02:42:03.871057+0000 mgr.a (mgr.14388) 1333 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:05.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:05 smithi027 bash[22610]: cluster 2024-08-31T02:42:03.871057+0000 mgr.a (mgr.14388) 1333 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:05.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:05 smithi191 bash[24992]: cluster 2024-08-31T02:42:03.871057+0000 mgr.a (mgr.14388) 1333 : cluster [DBG] pgmap v923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:06 smithi163 bash[24253]: audit 2024-08-31T02:42:04.676146+0000 mgr.a (mgr.14388) 1334 : audit [DBG] from='client.41775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:06.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:06 smithi027 bash[22610]: audit 2024-08-31T02:42:04.676146+0000 mgr.a (mgr.14388) 1334 : audit [DBG] from='client.41775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:06.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:06 smithi191 bash[24992]: audit 2024-08-31T02:42:04.676146+0000 mgr.a (mgr.14388) 1334 : audit [DBG] from='client.41775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:07.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:07 smithi163 bash[24253]: cluster 2024-08-31T02:42:05.872011+0000 mgr.a (mgr.14388) 1335 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:07.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:07 smithi027 bash[22610]: cluster 2024-08-31T02:42:05.872011+0000 mgr.a (mgr.14388) 1335 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:07.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:07 smithi191 bash[24992]: cluster 2024-08-31T02:42:05.872011+0000 mgr.a (mgr.14388) 1335 : cluster [DBG] pgmap v924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:09.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:09 smithi163 bash[24253]: cluster 2024-08-31T02:42:07.874531+0000 mgr.a (mgr.14388) 1336 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:42:09.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:09 smithi027 bash[22610]: cluster 2024-08-31T02:42:07.874531+0000 mgr.a (mgr.14388) 1336 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:42:09.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:09 smithi191 bash[24992]: cluster 2024-08-31T02:42:07.874531+0000 mgr.a (mgr.14388) 1336 : cluster [DBG] pgmap v925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:42:10.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:42:10.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:42:10.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:42:10.862 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:42:10.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:42:10.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:42:10.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:42:10.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:42:11.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:11 smithi163 bash[24253]: cluster 2024-08-31T02:42:09.875858+0000 mgr.a (mgr.14388) 1337 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:42:11.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:11 smithi027 bash[22610]: cluster 2024-08-31T02:42:09.875858+0000 mgr.a (mgr.14388) 1337 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:42:11.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:11 smithi191 bash[24992]: cluster 2024-08-31T02:42:09.875858+0000 mgr.a (mgr.14388) 1337 : cluster [DBG] pgmap v926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:42:12.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:12 smithi163 bash[24253]: audit 2024-08-31T02:42:10.429298+0000 mgr.a (mgr.14388) 1338 : audit [DBG] from='client.41853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:12.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:12 smithi027 bash[22610]: audit 2024-08-31T02:42:10.429298+0000 mgr.a (mgr.14388) 1338 : audit [DBG] from='client.41853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:12.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:12 smithi191 bash[24992]: audit 2024-08-31T02:42:10.429298+0000 mgr.a (mgr.14388) 1338 : audit [DBG] from='client.41853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:13.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:13 smithi163 bash[24253]: cluster 2024-08-31T02:42:11.876928+0000 mgr.a (mgr.14388) 1339 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:13.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:13 smithi027 bash[22610]: cluster 2024-08-31T02:42:11.876928+0000 mgr.a (mgr.14388) 1339 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:13.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:13 smithi191 bash[24992]: cluster 2024-08-31T02:42:11.876928+0000 mgr.a (mgr.14388) 1339 : cluster [DBG] pgmap v927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:15.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:15 smithi163 bash[24253]: cluster 2024-08-31T02:42:13.879190+0000 mgr.a (mgr.14388) 1340 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:42:15.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:15 smithi027 bash[22610]: cluster 2024-08-31T02:42:13.879190+0000 mgr.a (mgr.14388) 1340 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:42:15.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:15 smithi191 bash[24992]: cluster 2024-08-31T02:42:13.879190+0000 mgr.a (mgr.14388) 1340 : cluster [DBG] pgmap v928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:42:15.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:42:15.864 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:42:15.864 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:42:16.628 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:42:16.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:42:16.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:42:16.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:42:16.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:42:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:17 smithi163 bash[24253]: cluster 2024-08-31T02:42:15.879924+0000 mgr.a (mgr.14388) 1341 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:17.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:17 smithi027 bash[22610]: cluster 2024-08-31T02:42:15.879924+0000 mgr.a (mgr.14388) 1341 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:17.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:17 smithi191 bash[24992]: cluster 2024-08-31T02:42:15.879924+0000 mgr.a (mgr.14388) 1341 : cluster [DBG] pgmap v929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:18.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:18 smithi163 bash[24253]: audit 2024-08-31T02:42:16.204222+0000 mgr.a (mgr.14388) 1342 : audit [DBG] from='client.41931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:18.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:18 smithi027 bash[22610]: audit 2024-08-31T02:42:16.204222+0000 mgr.a (mgr.14388) 1342 : audit [DBG] from='client.41931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:18.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:18 smithi191 bash[24992]: audit 2024-08-31T02:42:16.204222+0000 mgr.a (mgr.14388) 1342 : audit [DBG] from='client.41931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:19.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:19 smithi163 bash[24253]: cluster 2024-08-31T02:42:17.881760+0000 mgr.a (mgr.14388) 1343 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:42:19.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:19 smithi027 bash[22610]: cluster 2024-08-31T02:42:17.881760+0000 mgr.a (mgr.14388) 1343 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:42:19.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:19 smithi191 bash[24992]: cluster 2024-08-31T02:42:17.881760+0000 mgr.a (mgr.14388) 1343 : cluster [DBG] pgmap v930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:42:21.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:21 smithi163 bash[24253]: cluster 2024-08-31T02:42:19.883059+0000 mgr.a (mgr.14388) 1344 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:42:21.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:21 smithi027 bash[22610]: cluster 2024-08-31T02:42:19.883059+0000 mgr.a (mgr.14388) 1344 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:42:21.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:21 smithi191 bash[24992]: cluster 2024-08-31T02:42:19.883059+0000 mgr.a (mgr.14388) 1344 : cluster [DBG] pgmap v931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:42:21.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:42:21.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:42:21.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:42:22.454 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:42:22.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:42:22.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:42:22.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:42:22.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:42:23.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:23 smithi163 bash[24253]: cluster 2024-08-31T02:42:21.883885+0000 mgr.a (mgr.14388) 1345 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:23 smithi163 bash[24253]: audit 2024-08-31T02:42:22.010683+0000 mgr.a (mgr.14388) 1346 : audit [DBG] from='client.42009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:23.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:23 smithi027 bash[22610]: cluster 2024-08-31T02:42:21.883885+0000 mgr.a (mgr.14388) 1345 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:23.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:23 smithi027 bash[22610]: audit 2024-08-31T02:42:22.010683+0000 mgr.a (mgr.14388) 1346 : audit [DBG] from='client.42009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:23.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:23 smithi191 bash[24992]: cluster 2024-08-31T02:42:21.883885+0000 mgr.a (mgr.14388) 1345 : cluster [DBG] pgmap v932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:23.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:23 smithi191 bash[24992]: audit 2024-08-31T02:42:22.010683+0000 mgr.a (mgr.14388) 1346 : audit [DBG] from='client.42009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:25.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:25 smithi163 bash[24253]: cluster 2024-08-31T02:42:23.886281+0000 mgr.a (mgr.14388) 1347 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:25.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:25 smithi027 bash[22610]: cluster 2024-08-31T02:42:23.886281+0000 mgr.a (mgr.14388) 1347 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:25.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:25 smithi191 bash[24992]: cluster 2024-08-31T02:42:23.886281+0000 mgr.a (mgr.14388) 1347 : cluster [DBG] pgmap v933: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:27 smithi163 bash[24253]: cluster 2024-08-31T02:42:25.887138+0000 mgr.a (mgr.14388) 1348 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:42:27.457 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:42:27.457 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:42:27.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:27 smithi027 bash[22610]: cluster 2024-08-31T02:42:25.887138+0000 mgr.a (mgr.14388) 1348 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:27.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:27 smithi191 bash[24992]: cluster 2024-08-31T02:42:25.887138+0000 mgr.a (mgr.14388) 1348 : cluster [DBG] pgmap v934: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:28.213 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:42:28.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:42:28.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:42:28.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:42:28.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:42:29.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:29 smithi163 bash[24253]: audit 2024-08-31T02:42:27.794262+0000 mgr.a (mgr.14388) 1349 : audit [DBG] from='client.42087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:29 smithi163 bash[24253]: cluster 2024-08-31T02:42:27.888145+0000 mgr.a (mgr.14388) 1350 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:29.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:29 smithi027 bash[22610]: audit 2024-08-31T02:42:27.794262+0000 mgr.a (mgr.14388) 1349 : audit [DBG] from='client.42087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:29.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:29 smithi027 bash[22610]: cluster 2024-08-31T02:42:27.888145+0000 mgr.a (mgr.14388) 1350 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:29.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:29 smithi191 bash[24992]: audit 2024-08-31T02:42:27.794262+0000 mgr.a (mgr.14388) 1349 : audit [DBG] from='client.42087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:29.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:29 smithi191 bash[24992]: cluster 2024-08-31T02:42:27.888145+0000 mgr.a (mgr.14388) 1350 : cluster [DBG] pgmap v935: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:31.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:31 smithi163 bash[24253]: cluster 2024-08-31T02:42:29.889789+0000 mgr.a (mgr.14388) 1351 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-08-31T02:42:31.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:31 smithi027 bash[22610]: cluster 2024-08-31T02:42:29.889789+0000 mgr.a (mgr.14388) 1351 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-08-31T02:42:31.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:31 smithi191 bash[24992]: cluster 2024-08-31T02:42:29.889789+0000 mgr.a (mgr.14388) 1351 : cluster [DBG] pgmap v936: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 73 op/s 2024-08-31T02:42:33.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:42:33.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:42:33.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:42:33.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:33 smithi163 bash[24253]: cluster 2024-08-31T02:42:31.890558+0000 mgr.a (mgr.14388) 1352 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 73 op/s 2024-08-31T02:42:33.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:33 smithi027 bash[22610]: cluster 2024-08-31T02:42:31.890558+0000 mgr.a (mgr.14388) 1352 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 73 op/s 2024-08-31T02:42:33.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:33 smithi191 bash[24992]: cluster 2024-08-31T02:42:31.890558+0000 mgr.a (mgr.14388) 1352 : cluster [DBG] pgmap v937: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 73 op/s 2024-08-31T02:42:33.981 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:42:33.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:42:33.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:42:33.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:42:33.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:42:35.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:35 smithi163 bash[24253]: audit 2024-08-31T02:42:33.551944+0000 mgr.a (mgr.14388) 1353 : audit [DBG] from='client.42165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:35 smithi163 bash[24253]: cluster 2024-08-31T02:42:33.892277+0000 mgr.a (mgr.14388) 1354 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:35.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:35 smithi027 bash[22610]: audit 2024-08-31T02:42:33.551944+0000 mgr.a (mgr.14388) 1353 : audit [DBG] from='client.42165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:35.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:35 smithi027 bash[22610]: cluster 2024-08-31T02:42:33.892277+0000 mgr.a (mgr.14388) 1354 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:35.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:35 smithi191 bash[24992]: audit 2024-08-31T02:42:33.551944+0000 mgr.a (mgr.14388) 1353 : audit [DBG] from='client.42165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:35.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:35 smithi191 bash[24992]: cluster 2024-08-31T02:42:33.892277+0000 mgr.a (mgr.14388) 1354 : cluster [DBG] pgmap v938: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T02:42:37.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:37 smithi163 bash[24253]: cluster 2024-08-31T02:42:35.893008+0000 mgr.a (mgr.14388) 1355 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:42:37.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:37 smithi027 bash[22610]: cluster 2024-08-31T02:42:35.893008+0000 mgr.a (mgr.14388) 1355 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:42:37.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:37 smithi191 bash[24992]: cluster 2024-08-31T02:42:35.893008+0000 mgr.a (mgr.14388) 1355 : cluster [DBG] pgmap v939: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:42:38.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:42:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:42:38.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:42:39.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:39 smithi163 bash[24253]: cluster 2024-08-31T02:42:37.894532+0000 mgr.a (mgr.14388) 1356 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:42:39.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:39 smithi027 bash[22610]: cluster 2024-08-31T02:42:37.894532+0000 mgr.a (mgr.14388) 1356 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:42:39.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:39 smithi191 bash[24992]: cluster 2024-08-31T02:42:37.894532+0000 mgr.a (mgr.14388) 1356 : cluster [DBG] pgmap v940: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:42:39.733 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:42:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:42:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:42:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:42:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:42:41.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:41 smithi163 bash[24253]: audit 2024-08-31T02:42:39.321120+0000 mgr.a (mgr.14388) 1357 : audit [DBG] from='client.42243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:41 smithi163 bash[24253]: cluster 2024-08-31T02:42:39.896297+0000 mgr.a (mgr.14388) 1358 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:41.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:41 smithi027 bash[22610]: audit 2024-08-31T02:42:39.321120+0000 mgr.a (mgr.14388) 1357 : audit [DBG] from='client.42243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:41.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:41 smithi027 bash[22610]: cluster 2024-08-31T02:42:39.896297+0000 mgr.a (mgr.14388) 1358 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:41.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:41 smithi191 bash[24992]: audit 2024-08-31T02:42:39.321120+0000 mgr.a (mgr.14388) 1357 : audit [DBG] from='client.42243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:41.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:41 smithi191 bash[24992]: cluster 2024-08-31T02:42:39.896297+0000 mgr.a (mgr.14388) 1358 : cluster [DBG] pgmap v941: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:43 smithi163 bash[24253]: cluster 2024-08-31T02:42:41.897087+0000 mgr.a (mgr.14388) 1359 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:43.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:43 smithi027 bash[22610]: cluster 2024-08-31T02:42:41.897087+0000 mgr.a (mgr.14388) 1359 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:43.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:43 smithi191 bash[24992]: cluster 2024-08-31T02:42:41.897087+0000 mgr.a (mgr.14388) 1359 : cluster [DBG] pgmap v942: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:42:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:42:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:42:45.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:45 smithi163 bash[24253]: cluster 2024-08-31T02:42:43.899146+0000 mgr.a (mgr.14388) 1360 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:42:45.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:45 smithi027 bash[22610]: cluster 2024-08-31T02:42:43.899146+0000 mgr.a (mgr.14388) 1360 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:42:45.501 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:42:45.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:42:45.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:42:45.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:42:45.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:42:45.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:45 smithi191 bash[24992]: cluster 2024-08-31T02:42:43.899146+0000 mgr.a (mgr.14388) 1360 : cluster [DBG] pgmap v943: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:42:46.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:46 smithi163 bash[24253]: audit 2024-08-31T02:42:45.076209+0000 mgr.a (mgr.14388) 1361 : audit [DBG] from='client.42318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:46.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:46 smithi027 bash[22610]: audit 2024-08-31T02:42:45.076209+0000 mgr.a (mgr.14388) 1361 : audit [DBG] from='client.42318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:46.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:46 smithi191 bash[24992]: audit 2024-08-31T02:42:45.076209+0000 mgr.a (mgr.14388) 1361 : audit [DBG] from='client.42318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:47.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:47 smithi163 bash[24253]: cluster 2024-08-31T02:42:45.900092+0000 mgr.a (mgr.14388) 1362 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:47.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:47 smithi163 bash[24253]: audit 2024-08-31T02:42:46.841993+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:42:47.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:47 smithi027 bash[22610]: cluster 2024-08-31T02:42:45.900092+0000 mgr.a (mgr.14388) 1362 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:47.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:47 smithi027 bash[22610]: audit 2024-08-31T02:42:46.841993+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:42:47.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:47 smithi191 bash[24992]: cluster 2024-08-31T02:42:45.900092+0000 mgr.a (mgr.14388) 1362 : cluster [DBG] pgmap v944: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:47.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:47 smithi191 bash[24992]: audit 2024-08-31T02:42:46.841993+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:42:49.167 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:42:48 smithi027 bash[22863]: debug 2024-08-31T02:42:48.914+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:42:49.167 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:42:48 smithi027 bash[22863]: debug 2024-08-31T02:42:48.914+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:42:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: cluster 2024-08-31T02:42:47.901807+0000 mgr.a (mgr.14388) 1363 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:42:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: audit 2024-08-31T02:42:48.193653+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: audit 2024-08-31T02:42:48.198824+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: audit 2024-08-31T02:42:48.201955+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: audit 2024-08-31T02:42:48.205348+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: audit 2024-08-31T02:42:48.208659+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: audit 2024-08-31T02:42:48.212050+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: audit 2024-08-31T02:42:48.213112+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:42:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: audit 2024-08-31T02:42:48.213955+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:42:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: audit 2024-08-31T02:42:48.219474+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:49 smithi163 bash[24253]: audit 2024-08-31T02:42:48.221525+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: cluster 2024-08-31T02:42:47.901807+0000 mgr.a (mgr.14388) 1363 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: audit 2024-08-31T02:42:48.193653+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: audit 2024-08-31T02:42:48.198824+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: audit 2024-08-31T02:42:48.201955+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: audit 2024-08-31T02:42:48.205348+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: audit 2024-08-31T02:42:48.208659+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: audit 2024-08-31T02:42:48.212050+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: audit 2024-08-31T02:42:48.213112+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: audit 2024-08-31T02:42:48.213955+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: audit 2024-08-31T02:42:48.219474+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:49 smithi027 bash[22610]: audit 2024-08-31T02:42:48.221525+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:42:49.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: cluster 2024-08-31T02:42:47.901807+0000 mgr.a (mgr.14388) 1363 : cluster [DBG] pgmap v945: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:42:49.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: audit 2024-08-31T02:42:48.193653+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: audit 2024-08-31T02:42:48.198824+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: audit 2024-08-31T02:42:48.201955+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: audit 2024-08-31T02:42:48.205348+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: audit 2024-08-31T02:42:48.208659+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: audit 2024-08-31T02:42:48.212050+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: audit 2024-08-31T02:42:48.213112+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:42:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: audit 2024-08-31T02:42:48.213955+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:42:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: audit 2024-08-31T02:42:48.219474+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:42:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:49 smithi191 bash[24992]: audit 2024-08-31T02:42:48.221525+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:42:50.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:50 smithi163 bash[24253]: audit 2024-08-31T02:42:48.222760+0000 mgr.a (mgr.14388) 1364 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:42:50.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:50 smithi163 bash[24253]: audit 2024-08-31T02:42:48.915030+0000 mgr.a (mgr.14388) 1365 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:42:50.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:50 smithi163 bash[24253]: cephadm 2024-08-31T02:42:48.916260+0000 mgr.a (mgr.14388) 1366 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:42:50.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:50 smithi027 bash[22610]: audit 2024-08-31T02:42:48.222760+0000 mgr.a (mgr.14388) 1364 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:42:50.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:50 smithi027 bash[22610]: audit 2024-08-31T02:42:48.915030+0000 mgr.a (mgr.14388) 1365 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:42:50.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:50 smithi027 bash[22610]: cephadm 2024-08-31T02:42:48.916260+0000 mgr.a (mgr.14388) 1366 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:42:50.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:42:50.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:42:50.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:42:50.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:50 smithi191 bash[24992]: audit 2024-08-31T02:42:48.222760+0000 mgr.a (mgr.14388) 1364 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:42:50.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:50 smithi191 bash[24992]: audit 2024-08-31T02:42:48.915030+0000 mgr.a (mgr.14388) 1365 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:42:50.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:50 smithi191 bash[24992]: cephadm 2024-08-31T02:42:48.916260+0000 mgr.a (mgr.14388) 1366 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:42:51.241 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:42:51.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:42:51.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:42:51.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:42:51.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:42:51.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:51 smithi163 bash[24253]: cluster 2024-08-31T02:42:49.903532+0000 mgr.a (mgr.14388) 1367 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:42:51.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:51 smithi163 bash[24253]: audit 2024-08-31T02:42:50.839907+0000 mgr.a (mgr.14388) 1368 : audit [DBG] from='client.42498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:51.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:51 smithi027 bash[22610]: cluster 2024-08-31T02:42:49.903532+0000 mgr.a (mgr.14388) 1367 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:42:51.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:51 smithi027 bash[22610]: audit 2024-08-31T02:42:50.839907+0000 mgr.a (mgr.14388) 1368 : audit [DBG] from='client.42498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:51.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:51 smithi191 bash[24992]: cluster 2024-08-31T02:42:49.903532+0000 mgr.a (mgr.14388) 1367 : cluster [DBG] pgmap v946: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:42:51.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:51 smithi191 bash[24992]: audit 2024-08-31T02:42:50.839907+0000 mgr.a (mgr.14388) 1368 : audit [DBG] from='client.42498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:52.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:52 smithi163 bash[24253]: cluster 2024-08-31T02:42:51.904420+0000 mgr.a (mgr.14388) 1369 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:52.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:52 smithi027 bash[22610]: cluster 2024-08-31T02:42:51.904420+0000 mgr.a (mgr.14388) 1369 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:52.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:52 smithi191 bash[24992]: cluster 2024-08-31T02:42:51.904420+0000 mgr.a (mgr.14388) 1369 : cluster [DBG] pgmap v947: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:42:55.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:54 smithi027 bash[22610]: cluster 2024-08-31T02:42:53.906535+0000 mgr.a (mgr.14388) 1370 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:55.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:54 smithi191 bash[24992]: cluster 2024-08-31T02:42:53.906535+0000 mgr.a (mgr.14388) 1370 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:55.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:54 smithi163 bash[24253]: cluster 2024-08-31T02:42:53.906535+0000 mgr.a (mgr.14388) 1370 : cluster [DBG] pgmap v948: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:56.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:42:56.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:42:56.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:42:57.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:42:57.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:42:57.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:42:57.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:42:57.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:42:57.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:56 smithi027 bash[22610]: cluster 2024-08-31T02:42:55.907302+0000 mgr.a (mgr.14388) 1371 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:57.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:56 smithi191 bash[24992]: cluster 2024-08-31T02:42:55.907302+0000 mgr.a (mgr.14388) 1371 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:57.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:56 smithi163 bash[24253]: cluster 2024-08-31T02:42:55.907302+0000 mgr.a (mgr.14388) 1371 : cluster [DBG] pgmap v949: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:58.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:57 smithi027 bash[22610]: audit 2024-08-31T02:42:56.585382+0000 mgr.a (mgr.14388) 1372 : audit [DBG] from='client.42573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:58.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:57 smithi191 bash[24992]: audit 2024-08-31T02:42:56.585382+0000 mgr.a (mgr.14388) 1372 : audit [DBG] from='client.42573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:58.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:57 smithi163 bash[24253]: audit 2024-08-31T02:42:56.585382+0000 mgr.a (mgr.14388) 1372 : audit [DBG] from='client.42573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:42:59.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:42:58 smithi027 bash[22610]: cluster 2024-08-31T02:42:57.909148+0000 mgr.a (mgr.14388) 1373 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:59.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:42:58 smithi191 bash[24992]: cluster 2024-08-31T02:42:57.909148+0000 mgr.a (mgr.14388) 1373 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:42:59.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:42:58 smithi163 bash[24253]: cluster 2024-08-31T02:42:57.909148+0000 mgr.a (mgr.14388) 1373 : cluster [DBG] pgmap v950: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:43:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:00 smithi027 bash[22610]: cluster 2024-08-31T02:42:59.910395+0000 mgr.a (mgr.14388) 1374 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:43:01.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:00 smithi191 bash[24992]: cluster 2024-08-31T02:42:59.910395+0000 mgr.a (mgr.14388) 1374 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:43:01.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:00 smithi163 bash[24253]: cluster 2024-08-31T02:42:59.910395+0000 mgr.a (mgr.14388) 1374 : cluster [DBG] pgmap v951: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:43:02.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:02.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:02.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:43:02.780 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:43:02.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:43:02.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:43:02.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:43:02.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:43:03.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:02 smithi191 bash[24992]: cluster 2024-08-31T02:43:01.911159+0000 mgr.a (mgr.14388) 1375 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:43:03.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:02 smithi163 bash[24253]: cluster 2024-08-31T02:43:01.911159+0000 mgr.a (mgr.14388) 1375 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:43:03.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:02 smithi027 bash[22610]: cluster 2024-08-31T02:43:01.911159+0000 mgr.a (mgr.14388) 1375 : cluster [DBG] pgmap v952: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:43:04.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:03 smithi191 bash[24992]: audit 2024-08-31T02:43:02.354770+0000 mgr.a (mgr.14388) 1376 : audit [DBG] from='client.42642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:04.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:03 smithi163 bash[24253]: audit 2024-08-31T02:43:02.354770+0000 mgr.a (mgr.14388) 1376 : audit [DBG] from='client.42642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:04.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:03 smithi027 bash[22610]: audit 2024-08-31T02:43:02.354770+0000 mgr.a (mgr.14388) 1376 : audit [DBG] from='client.42642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:05.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:04 smithi191 bash[24992]: cluster 2024-08-31T02:43:03.913459+0000 mgr.a (mgr.14388) 1377 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:43:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:04 smithi163 bash[24253]: cluster 2024-08-31T02:43:03.913459+0000 mgr.a (mgr.14388) 1377 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:43:05.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:04 smithi027 bash[22610]: cluster 2024-08-31T02:43:03.913459+0000 mgr.a (mgr.14388) 1377 : cluster [DBG] pgmap v953: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:43:07.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:07 smithi191 bash[24992]: cluster 2024-08-31T02:43:05.914193+0000 mgr.a (mgr.14388) 1378 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:07.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:07 smithi163 bash[24253]: cluster 2024-08-31T02:43:05.914193+0000 mgr.a (mgr.14388) 1378 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:07.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:07 smithi027 bash[22610]: cluster 2024-08-31T02:43:05.914193+0000 mgr.a (mgr.14388) 1378 : cluster [DBG] pgmap v954: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:07.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:07.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:07.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:43:08.550 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:43:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:43:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:43:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:43:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:43:09.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:09 smithi191 bash[24992]: cluster 2024-08-31T02:43:07.915717+0000 mgr.a (mgr.14388) 1379 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:09.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:09 smithi191 bash[24992]: audit 2024-08-31T02:43:08.119592+0000 mgr.a (mgr.14388) 1380 : audit [DBG] from='client.42720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:09.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:09 smithi163 bash[24253]: cluster 2024-08-31T02:43:07.915717+0000 mgr.a (mgr.14388) 1379 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:09 smithi163 bash[24253]: audit 2024-08-31T02:43:08.119592+0000 mgr.a (mgr.14388) 1380 : audit [DBG] from='client.42720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:09 smithi027 bash[22610]: cluster 2024-08-31T02:43:07.915717+0000 mgr.a (mgr.14388) 1379 : cluster [DBG] pgmap v955: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:09 smithi027 bash[22610]: audit 2024-08-31T02:43:08.119592+0000 mgr.a (mgr.14388) 1380 : audit [DBG] from='client.42720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:11.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:11 smithi191 bash[24992]: cluster 2024-08-31T02:43:09.917446+0000 mgr.a (mgr.14388) 1381 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:43:11.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:11 smithi163 bash[24253]: cluster 2024-08-31T02:43:09.917446+0000 mgr.a (mgr.14388) 1381 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:43:11.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:11 smithi027 bash[22610]: cluster 2024-08-31T02:43:09.917446+0000 mgr.a (mgr.14388) 1381 : cluster [DBG] pgmap v956: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:43:13.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:13 smithi191 bash[24992]: cluster 2024-08-31T02:43:11.918380+0000 mgr.a (mgr.14388) 1382 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:43:13.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:13 smithi163 bash[24253]: cluster 2024-08-31T02:43:11.918380+0000 mgr.a (mgr.14388) 1382 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:43:13.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:13 smithi027 bash[22610]: cluster 2024-08-31T02:43:11.918380+0000 mgr.a (mgr.14388) 1382 : cluster [DBG] pgmap v957: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:43:13.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:13.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:13.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:43:14.295 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:43:14.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:43:14.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:43:14.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:43:14.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:43:15.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:15 smithi191 bash[24992]: audit 2024-08-31T02:43:13.887649+0000 mgr.a (mgr.14388) 1383 : audit [DBG] from='client.42795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:15.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:15 smithi191 bash[24992]: cluster 2024-08-31T02:43:13.920401+0000 mgr.a (mgr.14388) 1384 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:15.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:15 smithi163 bash[24253]: audit 2024-08-31T02:43:13.887649+0000 mgr.a (mgr.14388) 1383 : audit [DBG] from='client.42795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:15 smithi163 bash[24253]: cluster 2024-08-31T02:43:13.920401+0000 mgr.a (mgr.14388) 1384 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:15.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:15 smithi027 bash[22610]: audit 2024-08-31T02:43:13.887649+0000 mgr.a (mgr.14388) 1383 : audit [DBG] from='client.42795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:15.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:15 smithi027 bash[22610]: cluster 2024-08-31T02:43:13.920401+0000 mgr.a (mgr.14388) 1384 : cluster [DBG] pgmap v958: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:17.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:17 smithi191 bash[24992]: cluster 2024-08-31T02:43:15.921246+0000 mgr.a (mgr.14388) 1385 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:43:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:17 smithi163 bash[24253]: cluster 2024-08-31T02:43:15.921246+0000 mgr.a (mgr.14388) 1385 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:43:17.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:17 smithi027 bash[22610]: cluster 2024-08-31T02:43:15.921246+0000 mgr.a (mgr.14388) 1385 : cluster [DBG] pgmap v959: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:43:19.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:19 smithi191 bash[24992]: cluster 2024-08-31T02:43:17.923050+0000 mgr.a (mgr.14388) 1386 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:43:19.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:19.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:19.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:43:19.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:19 smithi163 bash[24253]: cluster 2024-08-31T02:43:17.923050+0000 mgr.a (mgr.14388) 1386 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:43:19.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:19 smithi027 bash[22610]: cluster 2024-08-31T02:43:17.923050+0000 mgr.a (mgr.14388) 1386 : cluster [DBG] pgmap v960: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:43:20.042 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:43:20.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:43:20.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:43:20.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:43:20.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:43:21.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:21 smithi191 bash[24992]: audit 2024-08-31T02:43:19.631096+0000 mgr.a (mgr.14388) 1387 : audit [DBG] from='client.42873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:21.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:21 smithi191 bash[24992]: cluster 2024-08-31T02:43:19.923879+0000 mgr.a (mgr.14388) 1388 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:21.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:21 smithi163 bash[24253]: audit 2024-08-31T02:43:19.631096+0000 mgr.a (mgr.14388) 1387 : audit [DBG] from='client.42873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:21.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:21 smithi163 bash[24253]: cluster 2024-08-31T02:43:19.923879+0000 mgr.a (mgr.14388) 1388 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:21.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:21 smithi027 bash[22610]: audit 2024-08-31T02:43:19.631096+0000 mgr.a (mgr.14388) 1387 : audit [DBG] from='client.42873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:21.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:21 smithi027 bash[22610]: cluster 2024-08-31T02:43:19.923879+0000 mgr.a (mgr.14388) 1388 : cluster [DBG] pgmap v961: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:23.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:23 smithi191 bash[24992]: cluster 2024-08-31T02:43:21.924767+0000 mgr.a (mgr.14388) 1389 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:23.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:23 smithi163 bash[24253]: cluster 2024-08-31T02:43:21.924767+0000 mgr.a (mgr.14388) 1389 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:23.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:23 smithi027 bash[22610]: cluster 2024-08-31T02:43:21.924767+0000 mgr.a (mgr.14388) 1389 : cluster [DBG] pgmap v962: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:25.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:25.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:25.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:43:25.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:25 smithi191 bash[24992]: cluster 2024-08-31T02:43:23.927007+0000 mgr.a (mgr.14388) 1390 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:43:25.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:25 smithi163 bash[24253]: cluster 2024-08-31T02:43:23.927007+0000 mgr.a (mgr.14388) 1390 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:43:25.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:25 smithi027 bash[22610]: cluster 2024-08-31T02:43:23.927007+0000 mgr.a (mgr.14388) 1390 : cluster [DBG] pgmap v963: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:43:25.811 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:43:25.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:43:25.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:43:25.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:43:25.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:43:27.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:27 smithi163 bash[24253]: audit 2024-08-31T02:43:25.381153+0000 mgr.a (mgr.14388) 1391 : audit [DBG] from='client.42951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:27.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:27 smithi163 bash[24253]: cluster 2024-08-31T02:43:25.927966+0000 mgr.a (mgr.14388) 1392 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:27.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:27 smithi027 bash[22610]: audit 2024-08-31T02:43:25.381153+0000 mgr.a (mgr.14388) 1391 : audit [DBG] from='client.42951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:27.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:27 smithi027 bash[22610]: cluster 2024-08-31T02:43:25.927966+0000 mgr.a (mgr.14388) 1392 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:27.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:27 smithi191 bash[24992]: audit 2024-08-31T02:43:25.381153+0000 mgr.a (mgr.14388) 1391 : audit [DBG] from='client.42951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:27.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:27 smithi191 bash[24992]: cluster 2024-08-31T02:43:25.927966+0000 mgr.a (mgr.14388) 1392 : cluster [DBG] pgmap v964: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:29.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:29 smithi163 bash[24253]: cluster 2024-08-31T02:43:27.929716+0000 mgr.a (mgr.14388) 1393 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:43:29.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:29 smithi027 bash[22610]: cluster 2024-08-31T02:43:27.929716+0000 mgr.a (mgr.14388) 1393 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:43:29.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:29 smithi191 bash[24992]: cluster 2024-08-31T02:43:27.929716+0000 mgr.a (mgr.14388) 1393 : cluster [DBG] pgmap v965: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:43:30.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:30.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:30.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:43:31.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:31 smithi163 bash[24253]: cluster 2024-08-31T02:43:29.930975+0000 mgr.a (mgr.14388) 1394 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:43:31.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:31 smithi027 bash[22610]: cluster 2024-08-31T02:43:29.930975+0000 mgr.a (mgr.14388) 1394 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:43:31.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:31 smithi191 bash[24992]: cluster 2024-08-31T02:43:29.930975+0000 mgr.a (mgr.14388) 1394 : cluster [DBG] pgmap v966: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:43:31.583 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:43:31.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:43:31.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:43:31.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:43:31.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:43:32.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:32 smithi163 bash[24253]: audit 2024-08-31T02:43:31.150559+0000 mgr.a (mgr.14388) 1395 : audit [DBG] from='client.43023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:32.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:32 smithi027 bash[22610]: audit 2024-08-31T02:43:31.150559+0000 mgr.a (mgr.14388) 1395 : audit [DBG] from='client.43023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:32.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:32 smithi191 bash[24992]: audit 2024-08-31T02:43:31.150559+0000 mgr.a (mgr.14388) 1395 : audit [DBG] from='client.43023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:33.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:33 smithi163 bash[24253]: cluster 2024-08-31T02:43:31.931991+0000 mgr.a (mgr.14388) 1396 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:33.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:33 smithi027 bash[22610]: cluster 2024-08-31T02:43:31.931991+0000 mgr.a (mgr.14388) 1396 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:33.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:33 smithi191 bash[24992]: cluster 2024-08-31T02:43:31.931991+0000 mgr.a (mgr.14388) 1396 : cluster [DBG] pgmap v967: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:35.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:35 smithi163 bash[24253]: cluster 2024-08-31T02:43:33.934307+0000 mgr.a (mgr.14388) 1397 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:43:35.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:35 smithi027 bash[22610]: cluster 2024-08-31T02:43:33.934307+0000 mgr.a (mgr.14388) 1397 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:43:35.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:35 smithi191 bash[24992]: cluster 2024-08-31T02:43:33.934307+0000 mgr.a (mgr.14388) 1397 : cluster [DBG] pgmap v968: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:43:36.585 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:36.586 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:36.586 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:43:37.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:43:37.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:43:37.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:43:37.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:43:37.365 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:43:37.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:37 smithi163 bash[24253]: cluster 2024-08-31T02:43:35.935113+0000 mgr.a (mgr.14388) 1398 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:37.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:37 smithi027 bash[22610]: cluster 2024-08-31T02:43:35.935113+0000 mgr.a (mgr.14388) 1398 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:37.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:37 smithi191 bash[24992]: cluster 2024-08-31T02:43:35.935113+0000 mgr.a (mgr.14388) 1398 : cluster [DBG] pgmap v969: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:38.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:38 smithi163 bash[24253]: audit 2024-08-31T02:43:36.926920+0000 mgr.a (mgr.14388) 1399 : audit [DBG] from='client.43101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:38.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:38 smithi027 bash[22610]: audit 2024-08-31T02:43:36.926920+0000 mgr.a (mgr.14388) 1399 : audit [DBG] from='client.43101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:38.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:38 smithi191 bash[24992]: audit 2024-08-31T02:43:36.926920+0000 mgr.a (mgr.14388) 1399 : audit [DBG] from='client.43101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:39.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:39 smithi163 bash[24253]: cluster 2024-08-31T02:43:37.937008+0000 mgr.a (mgr.14388) 1400 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:43:39.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:39 smithi027 bash[22610]: cluster 2024-08-31T02:43:37.937008+0000 mgr.a (mgr.14388) 1400 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:43:39.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:39 smithi191 bash[24992]: cluster 2024-08-31T02:43:37.937008+0000 mgr.a (mgr.14388) 1400 : cluster [DBG] pgmap v970: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:43:41.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:41 smithi163 bash[24253]: cluster 2024-08-31T02:43:39.938322+0000 mgr.a (mgr.14388) 1401 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:43:41.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:41 smithi027 bash[22610]: cluster 2024-08-31T02:43:39.938322+0000 mgr.a (mgr.14388) 1401 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:43:41.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:41 smithi191 bash[24992]: cluster 2024-08-31T02:43:39.938322+0000 mgr.a (mgr.14388) 1401 : cluster [DBG] pgmap v971: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:43:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:42.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:42.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:43:43.136 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:43:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:43:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:43:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:43:43.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:43:43.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:43 smithi163 bash[24253]: cluster 2024-08-31T02:43:41.939128+0000 mgr.a (mgr.14388) 1402 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:43.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:43 smithi027 bash[22610]: cluster 2024-08-31T02:43:41.939128+0000 mgr.a (mgr.14388) 1402 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:43.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:43 smithi191 bash[24992]: cluster 2024-08-31T02:43:41.939128+0000 mgr.a (mgr.14388) 1402 : cluster [DBG] pgmap v972: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:44.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:44 smithi163 bash[24253]: audit 2024-08-31T02:43:42.705710+0000 mgr.a (mgr.14388) 1403 : audit [DBG] from='client.43179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:44.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:44 smithi027 bash[22610]: audit 2024-08-31T02:43:42.705710+0000 mgr.a (mgr.14388) 1403 : audit [DBG] from='client.43179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:44.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:44 smithi191 bash[24992]: audit 2024-08-31T02:43:42.705710+0000 mgr.a (mgr.14388) 1403 : audit [DBG] from='client.43179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:45.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:45 smithi163 bash[24253]: cluster 2024-08-31T02:43:43.941759+0000 mgr.a (mgr.14388) 1404 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:45.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:45 smithi027 bash[22610]: cluster 2024-08-31T02:43:43.941759+0000 mgr.a (mgr.14388) 1404 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:45.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:45 smithi191 bash[24992]: cluster 2024-08-31T02:43:43.941759+0000 mgr.a (mgr.14388) 1404 : cluster [DBG] pgmap v973: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:47.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:47 smithi163 bash[24253]: cluster 2024-08-31T02:43:45.942511+0000 mgr.a (mgr.14388) 1405 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:43:47.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:47 smithi027 bash[22610]: cluster 2024-08-31T02:43:45.942511+0000 mgr.a (mgr.14388) 1405 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:43:47.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:47 smithi191 bash[24992]: cluster 2024-08-31T02:43:45.942511+0000 mgr.a (mgr.14388) 1405 : cluster [DBG] pgmap v974: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:43:48.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:48.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:48.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:43:48.908 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:43:48.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:43:48.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:43:48.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:43:48.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:43:49.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:49 smithi163 bash[24253]: cluster 2024-08-31T02:43:47.944044+0000 mgr.a (mgr.14388) 1406 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:43:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:49 smithi163 bash[24253]: audit 2024-08-31T02:43:48.971597+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:43:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:49 smithi027 bash[22610]: cluster 2024-08-31T02:43:47.944044+0000 mgr.a (mgr.14388) 1406 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:43:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:49 smithi027 bash[22610]: audit 2024-08-31T02:43:48.971597+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:43:49.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:49 smithi191 bash[24992]: cluster 2024-08-31T02:43:47.944044+0000 mgr.a (mgr.14388) 1406 : cluster [DBG] pgmap v975: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:43:49.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:49 smithi191 bash[24992]: audit 2024-08-31T02:43:48.971597+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:43:50.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:50 smithi163 bash[24253]: audit 2024-08-31T02:43:48.476659+0000 mgr.a (mgr.14388) 1407 : audit [DBG] from='client.43257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:50.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:50 smithi027 bash[22610]: audit 2024-08-31T02:43:48.476659+0000 mgr.a (mgr.14388) 1407 : audit [DBG] from='client.43257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:50.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:50 smithi191 bash[24992]: audit 2024-08-31T02:43:48.476659+0000 mgr.a (mgr.14388) 1407 : audit [DBG] from='client.43257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:51.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:51 smithi163 bash[24253]: cluster 2024-08-31T02:43:49.945692+0000 mgr.a (mgr.14388) 1408 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:43:51.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:51 smithi027 bash[22610]: cluster 2024-08-31T02:43:49.945692+0000 mgr.a (mgr.14388) 1408 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:43:51.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:51 smithi191 bash[24992]: cluster 2024-08-31T02:43:49.945692+0000 mgr.a (mgr.14388) 1408 : cluster [DBG] pgmap v976: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:43:53.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:53 smithi163 bash[24253]: cluster 2024-08-31T02:43:51.946468+0000 mgr.a (mgr.14388) 1409 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:43:53.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:53 smithi027 bash[22610]: cluster 2024-08-31T02:43:51.946468+0000 mgr.a (mgr.14388) 1409 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:43:53.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:53 smithi191 bash[24992]: cluster 2024-08-31T02:43:51.946468+0000 mgr.a (mgr.14388) 1409 : cluster [DBG] pgmap v977: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:43:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:43:54.706 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:43:54.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:43:54.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:43:54.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:43:54.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:43:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: cluster 2024-08-31T02:43:53.947953+0000 mgr.a (mgr.14388) 1410 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: audit 2024-08-31T02:43:54.321215+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: audit 2024-08-31T02:43:54.325912+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: audit 2024-08-31T02:43:54.341328+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: audit 2024-08-31T02:43:54.345387+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: audit 2024-08-31T02:43:54.352226+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: audit 2024-08-31T02:43:54.358524+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: audit 2024-08-31T02:43:55.095464+0000 mon.a (mon.0) 812 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:43:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: audit 2024-08-31T02:43:55.097303+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:43:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: audit 2024-08-31T02:43:55.107085+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:55 smithi163 bash[24253]: audit 2024-08-31T02:43:55.111906+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: cluster 2024-08-31T02:43:53.947953+0000 mgr.a (mgr.14388) 1410 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: audit 2024-08-31T02:43:54.321215+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: audit 2024-08-31T02:43:54.325912+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: audit 2024-08-31T02:43:54.341328+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: audit 2024-08-31T02:43:54.345387+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: audit 2024-08-31T02:43:54.352226+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: audit 2024-08-31T02:43:54.358524+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: audit 2024-08-31T02:43:55.095464+0000 mon.a (mon.0) 812 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: audit 2024-08-31T02:43:55.097303+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: audit 2024-08-31T02:43:55.107085+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22610]: audit 2024-08-31T02:43:55.111906+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:43:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: cluster 2024-08-31T02:43:53.947953+0000 mgr.a (mgr.14388) 1410 : cluster [DBG] pgmap v978: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: audit 2024-08-31T02:43:54.321215+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: audit 2024-08-31T02:43:54.325912+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: audit 2024-08-31T02:43:54.341328+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: audit 2024-08-31T02:43:54.345387+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: audit 2024-08-31T02:43:54.352226+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: audit 2024-08-31T02:43:54.358524+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: audit 2024-08-31T02:43:55.095464+0000 mon.a (mon.0) 812 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:43:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: audit 2024-08-31T02:43:55.097303+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:43:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: audit 2024-08-31T02:43:55.107085+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:43:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:55 smithi191 bash[24992]: audit 2024-08-31T02:43:55.111906+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:43:56.136 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22863]: debug 2024-08-31T02:43:55.808+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:43:56.136 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:43:55 smithi027 bash[22863]: debug 2024-08-31T02:43:55.808+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:43:56.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:56 smithi163 bash[24253]: audit 2024-08-31T02:43:54.263309+0000 mgr.a (mgr.14388) 1411 : audit [DBG] from='client.43335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:56.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:56 smithi163 bash[24253]: audit 2024-08-31T02:43:55.113602+0000 mgr.a (mgr.14388) 1412 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:43:56.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:56 smithi027 bash[22610]: audit 2024-08-31T02:43:54.263309+0000 mgr.a (mgr.14388) 1411 : audit [DBG] from='client.43335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:56.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:56 smithi027 bash[22610]: audit 2024-08-31T02:43:55.113602+0000 mgr.a (mgr.14388) 1412 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:43:56.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:56 smithi191 bash[24992]: audit 2024-08-31T02:43:54.263309+0000 mgr.a (mgr.14388) 1411 : audit [DBG] from='client.43335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:43:56.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:56 smithi191 bash[24992]: audit 2024-08-31T02:43:55.113602+0000 mgr.a (mgr.14388) 1412 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:43:57.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:57 smithi163 bash[24253]: audit 2024-08-31T02:43:55.811311+0000 mgr.a (mgr.14388) 1413 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:43:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:57 smithi163 bash[24253]: cephadm 2024-08-31T02:43:55.812479+0000 mgr.a (mgr.14388) 1414 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:43:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:57 smithi163 bash[24253]: cluster 2024-08-31T02:43:55.948755+0000 mgr.a (mgr.14388) 1415 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:57.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:57 smithi027 bash[22610]: audit 2024-08-31T02:43:55.811311+0000 mgr.a (mgr.14388) 1413 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:43:57.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:57 smithi027 bash[22610]: cephadm 2024-08-31T02:43:55.812479+0000 mgr.a (mgr.14388) 1414 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:43:57.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:57 smithi027 bash[22610]: cluster 2024-08-31T02:43:55.948755+0000 mgr.a (mgr.14388) 1415 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:57.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:57 smithi191 bash[24992]: audit 2024-08-31T02:43:55.811311+0000 mgr.a (mgr.14388) 1413 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:43:57.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:57 smithi191 bash[24992]: cephadm 2024-08-31T02:43:55.812479+0000 mgr.a (mgr.14388) 1414 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:43:57.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:57 smithi191 bash[24992]: cluster 2024-08-31T02:43:55.948755+0000 mgr.a (mgr.14388) 1415 : cluster [DBG] pgmap v979: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:43:59.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:43:59 smithi163 bash[24253]: cluster 2024-08-31T02:43:57.950482+0000 mgr.a (mgr.14388) 1416 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:43:59.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:43:59 smithi027 bash[22610]: cluster 2024-08-31T02:43:57.950482+0000 mgr.a (mgr.14388) 1416 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:43:59.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:43:59 smithi191 bash[24992]: cluster 2024-08-31T02:43:57.950482+0000 mgr.a (mgr.14388) 1416 : cluster [DBG] pgmap v980: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:43:59.707 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:43:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:43:59.708 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:00.439 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:00.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:00.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:00.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:00.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:01.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:01 smithi163 bash[24253]: cluster 2024-08-31T02:43:59.951631+0000 mgr.a (mgr.14388) 1417 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:01.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:01 smithi163 bash[24253]: audit 2024-08-31T02:44:00.041553+0000 mgr.a (mgr.14388) 1418 : audit [DBG] from='client.43512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:01 smithi027 bash[22610]: cluster 2024-08-31T02:43:59.951631+0000 mgr.a (mgr.14388) 1417 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:01 smithi027 bash[22610]: audit 2024-08-31T02:44:00.041553+0000 mgr.a (mgr.14388) 1418 : audit [DBG] from='client.43512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:01.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:01 smithi191 bash[24992]: cluster 2024-08-31T02:43:59.951631+0000 mgr.a (mgr.14388) 1417 : cluster [DBG] pgmap v981: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:01.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:01 smithi191 bash[24992]: audit 2024-08-31T02:44:00.041553+0000 mgr.a (mgr.14388) 1418 : audit [DBG] from='client.43512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:03.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:03 smithi163 bash[24253]: cluster 2024-08-31T02:44:01.952498+0000 mgr.a (mgr.14388) 1419 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:03.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:03 smithi027 bash[22610]: cluster 2024-08-31T02:44:01.952498+0000 mgr.a (mgr.14388) 1419 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:03.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:03 smithi191 bash[24992]: cluster 2024-08-31T02:44:01.952498+0000 mgr.a (mgr.14388) 1419 : cluster [DBG] pgmap v982: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:05.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:44:05.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:44:05.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:05.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:05 smithi163 bash[24253]: cluster 2024-08-31T02:44:03.954826+0000 mgr.a (mgr.14388) 1420 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:05.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:05 smithi027 bash[22610]: cluster 2024-08-31T02:44:03.954826+0000 mgr.a (mgr.14388) 1420 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:05.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:05 smithi191 bash[24992]: cluster 2024-08-31T02:44:03.954826+0000 mgr.a (mgr.14388) 1420 : cluster [DBG] pgmap v983: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:06.221 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:06.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:07.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:07 smithi163 bash[24253]: audit 2024-08-31T02:44:05.783422+0000 mgr.a (mgr.14388) 1421 : audit [DBG] from='client.43587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:07 smithi163 bash[24253]: cluster 2024-08-31T02:44:05.955366+0000 mgr.a (mgr.14388) 1422 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:07.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:07 smithi027 bash[22610]: audit 2024-08-31T02:44:05.783422+0000 mgr.a (mgr.14388) 1421 : audit [DBG] from='client.43587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:07.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:07 smithi027 bash[22610]: cluster 2024-08-31T02:44:05.955366+0000 mgr.a (mgr.14388) 1422 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:07.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:07 smithi191 bash[24992]: audit 2024-08-31T02:44:05.783422+0000 mgr.a (mgr.14388) 1421 : audit [DBG] from='client.43587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:07.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:07 smithi191 bash[24992]: cluster 2024-08-31T02:44:05.955366+0000 mgr.a (mgr.14388) 1422 : cluster [DBG] pgmap v984: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:09 smithi163 bash[24253]: cluster 2024-08-31T02:44:07.957226+0000 mgr.a (mgr.14388) 1423 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:09 smithi027 bash[22610]: cluster 2024-08-31T02:44:07.957226+0000 mgr.a (mgr.14388) 1423 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:09.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:09 smithi191 bash[24992]: cluster 2024-08-31T02:44:07.957226+0000 mgr.a (mgr.14388) 1423 : cluster [DBG] pgmap v985: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:44:11.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:44:11.223 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:44:11.223 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:11.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:11 smithi163 bash[24253]: cluster 2024-08-31T02:44:09.958627+0000 mgr.a (mgr.14388) 1424 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 3 op/s 2024-08-31T02:44:11.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:11 smithi027 bash[22610]: cluster 2024-08-31T02:44:09.958627+0000 mgr.a (mgr.14388) 1424 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 3 op/s 2024-08-31T02:44:11.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:11 smithi191 bash[24992]: cluster 2024-08-31T02:44:09.958627+0000 mgr.a (mgr.14388) 1424 : cluster [DBG] pgmap v986: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 3 op/s 2024-08-31T02:44:12.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:12.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:12.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:12.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:12.000 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:13 smithi163 bash[24253]: audit 2024-08-31T02:44:11.560937+0000 mgr.a (mgr.14388) 1425 : audit [DBG] from='client.43662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:13 smithi163 bash[24253]: cluster 2024-08-31T02:44:11.959248+0000 mgr.a (mgr.14388) 1426 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:13.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:13 smithi027 bash[22610]: audit 2024-08-31T02:44:11.560937+0000 mgr.a (mgr.14388) 1425 : audit [DBG] from='client.43662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:13.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:13 smithi027 bash[22610]: cluster 2024-08-31T02:44:11.959248+0000 mgr.a (mgr.14388) 1426 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:13.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:13 smithi191 bash[24992]: audit 2024-08-31T02:44:11.560937+0000 mgr.a (mgr.14388) 1425 : audit [DBG] from='client.43662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:13 smithi191 bash[24992]: cluster 2024-08-31T02:44:11.959248+0000 mgr.a (mgr.14388) 1426 : cluster [DBG] pgmap v987: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:15.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:15 smithi163 bash[24253]: cluster 2024-08-31T02:44:13.961418+0000 mgr.a (mgr.14388) 1427 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:44:15.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:15 smithi027 bash[22610]: cluster 2024-08-31T02:44:13.961418+0000 mgr.a (mgr.14388) 1427 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:44:15.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:15 smithi191 bash[24992]: cluster 2024-08-31T02:44:13.961418+0000 mgr.a (mgr.14388) 1427 : cluster [DBG] pgmap v988: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:44:17.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:44:17.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:44:17.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:17 smithi163 bash[24253]: cluster 2024-08-31T02:44:15.962196+0000 mgr.a (mgr.14388) 1428 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:17.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:17 smithi027 bash[22610]: cluster 2024-08-31T02:44:15.962196+0000 mgr.a (mgr.14388) 1428 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:17.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:17 smithi191 bash[24992]: cluster 2024-08-31T02:44:15.962196+0000 mgr.a (mgr.14388) 1428 : cluster [DBG] pgmap v989: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:17.752 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:17.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:17.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:17.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:17.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:19 smithi163 bash[24253]: audit 2024-08-31T02:44:17.336607+0000 mgr.a (mgr.14388) 1429 : audit [DBG] from='client.43740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:19 smithi163 bash[24253]: cluster 2024-08-31T02:44:17.964063+0000 mgr.a (mgr.14388) 1430 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:44:19.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:19 smithi027 bash[22610]: audit 2024-08-31T02:44:17.336607+0000 mgr.a (mgr.14388) 1429 : audit [DBG] from='client.43740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:19.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:19 smithi027 bash[22610]: cluster 2024-08-31T02:44:17.964063+0000 mgr.a (mgr.14388) 1430 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:44:19.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:19 smithi191 bash[24992]: audit 2024-08-31T02:44:17.336607+0000 mgr.a (mgr.14388) 1429 : audit [DBG] from='client.43740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:19.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:19 smithi191 bash[24992]: cluster 2024-08-31T02:44:17.964063+0000 mgr.a (mgr.14388) 1430 : cluster [DBG] pgmap v990: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:44:20.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:20 smithi191 bash[24992]: cluster 2024-08-31T02:44:19.965305+0000 mgr.a (mgr.14388) 1431 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:44:20.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:20 smithi163 bash[24253]: cluster 2024-08-31T02:44:19.965305+0000 mgr.a (mgr.14388) 1431 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:44:20.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:20 smithi027 bash[22610]: cluster 2024-08-31T02:44:19.965305+0000 mgr.a (mgr.14388) 1431 : cluster [DBG] pgmap v991: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:44:22.753 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:44:22.754 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:44:22.754 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:23.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:23 smithi191 bash[24992]: cluster 2024-08-31T02:44:21.966061+0000 mgr.a (mgr.14388) 1432 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:23.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:23 smithi163 bash[24253]: cluster 2024-08-31T02:44:21.966061+0000 mgr.a (mgr.14388) 1432 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:23.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:23 smithi027 bash[22610]: cluster 2024-08-31T02:44:21.966061+0000 mgr.a (mgr.14388) 1432 : cluster [DBG] pgmap v992: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:23.506 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:23.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:23.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:23.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:23.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:24.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:24 smithi191 bash[24992]: audit 2024-08-31T02:44:23.090947+0000 mgr.a (mgr.14388) 1433 : audit [DBG] from='client.43818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:24.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:24 smithi163 bash[24253]: audit 2024-08-31T02:44:23.090947+0000 mgr.a (mgr.14388) 1433 : audit [DBG] from='client.43818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:24.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:24 smithi027 bash[22610]: audit 2024-08-31T02:44:23.090947+0000 mgr.a (mgr.14388) 1433 : audit [DBG] from='client.43818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:25.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:25 smithi191 bash[24992]: cluster 2024-08-31T02:44:23.968808+0000 mgr.a (mgr.14388) 1434 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:25.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:25 smithi163 bash[24253]: cluster 2024-08-31T02:44:23.968808+0000 mgr.a (mgr.14388) 1434 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:25.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:25 smithi027 bash[22610]: cluster 2024-08-31T02:44:23.968808+0000 mgr.a (mgr.14388) 1434 : cluster [DBG] pgmap v993: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:27.287 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:27 smithi191 bash[24992]: cluster 2024-08-31T02:44:25.969569+0000 mgr.a (mgr.14388) 1435 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:44:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:27 smithi163 bash[24253]: cluster 2024-08-31T02:44:25.969569+0000 mgr.a (mgr.14388) 1435 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:44:27.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:27 smithi027 bash[22610]: cluster 2024-08-31T02:44:25.969569+0000 mgr.a (mgr.14388) 1435 : cluster [DBG] pgmap v994: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:44:28.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:44:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:44:28.509 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:29.289 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:29.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:29.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:29.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:29.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:29.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:29 smithi163 bash[24253]: cluster 2024-08-31T02:44:27.971112+0000 mgr.a (mgr.14388) 1436 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:44:29.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:29 smithi027 bash[22610]: cluster 2024-08-31T02:44:27.971112+0000 mgr.a (mgr.14388) 1436 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:44:29.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:29 smithi191 bash[24992]: cluster 2024-08-31T02:44:27.971112+0000 mgr.a (mgr.14388) 1436 : cluster [DBG] pgmap v995: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:44:30.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:30 smithi163 bash[24253]: audit 2024-08-31T02:44:28.851315+0000 mgr.a (mgr.14388) 1437 : audit [DBG] from='client.43893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:30.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:30 smithi027 bash[22610]: audit 2024-08-31T02:44:28.851315+0000 mgr.a (mgr.14388) 1437 : audit [DBG] from='client.43893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:30.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:30 smithi191 bash[24992]: audit 2024-08-31T02:44:28.851315+0000 mgr.a (mgr.14388) 1437 : audit [DBG] from='client.43893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:31.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:31 smithi163 bash[24253]: cluster 2024-08-31T02:44:29.972955+0000 mgr.a (mgr.14388) 1438 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:44:31.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:31 smithi027 bash[22610]: cluster 2024-08-31T02:44:29.972955+0000 mgr.a (mgr.14388) 1438 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:44:31.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:31 smithi191 bash[24992]: cluster 2024-08-31T02:44:29.972955+0000 mgr.a (mgr.14388) 1438 : cluster [DBG] pgmap v996: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:44:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:33 smithi163 bash[24253]: cluster 2024-08-31T02:44:31.973761+0000 mgr.a (mgr.14388) 1439 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:44:33.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:33 smithi027 bash[22610]: cluster 2024-08-31T02:44:31.973761+0000 mgr.a (mgr.14388) 1439 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:44:33.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:33 smithi191 bash[24992]: cluster 2024-08-31T02:44:31.973761+0000 mgr.a (mgr.14388) 1439 : cluster [DBG] pgmap v997: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:44:34.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:44:34.292 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:44:34.292 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:35.033 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:35.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:35 smithi163 bash[24253]: cluster 2024-08-31T02:44:33.975775+0000 mgr.a (mgr.14388) 1440 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:35.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:35 smithi027 bash[22610]: cluster 2024-08-31T02:44:33.975775+0000 mgr.a (mgr.14388) 1440 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:35.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:35 smithi191 bash[24992]: cluster 2024-08-31T02:44:33.975775+0000 mgr.a (mgr.14388) 1440 : cluster [DBG] pgmap v998: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:36 smithi163 bash[24253]: audit 2024-08-31T02:44:34.622589+0000 mgr.a (mgr.14388) 1441 : audit [DBG] from='client.43968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:36.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:36 smithi027 bash[22610]: audit 2024-08-31T02:44:34.622589+0000 mgr.a (mgr.14388) 1441 : audit [DBG] from='client.43968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:36.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:36 smithi191 bash[24992]: audit 2024-08-31T02:44:34.622589+0000 mgr.a (mgr.14388) 1441 : audit [DBG] from='client.43968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:37.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:37 smithi163 bash[24253]: cluster 2024-08-31T02:44:35.976932+0000 mgr.a (mgr.14388) 1442 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:37.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:37 smithi027 bash[22610]: cluster 2024-08-31T02:44:35.976932+0000 mgr.a (mgr.14388) 1442 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:37.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:37 smithi191 bash[24992]: cluster 2024-08-31T02:44:35.976932+0000 mgr.a (mgr.14388) 1442 : cluster [DBG] pgmap v999: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:39.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:39 smithi163 bash[24253]: cluster 2024-08-31T02:44:37.978747+0000 mgr.a (mgr.14388) 1443 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:44:39.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:39 smithi027 bash[22610]: cluster 2024-08-31T02:44:37.978747+0000 mgr.a (mgr.14388) 1443 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:44:39.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:39 smithi191 bash[24992]: cluster 2024-08-31T02:44:37.978747+0000 mgr.a (mgr.14388) 1443 : cluster [DBG] pgmap v1000: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:44:40.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:44:40.035 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:44:40.035 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:40.799 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:40.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:40.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:40.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:40.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:41 smithi163 bash[24253]: cluster 2024-08-31T02:44:39.979972+0000 mgr.a (mgr.14388) 1444 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:44:41.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:41 smithi027 bash[22610]: cluster 2024-08-31T02:44:39.979972+0000 mgr.a (mgr.14388) 1444 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:44:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:41 smithi191 bash[24992]: cluster 2024-08-31T02:44:39.979972+0000 mgr.a (mgr.14388) 1444 : cluster [DBG] pgmap v1001: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:44:42.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:42 smithi163 bash[24253]: audit 2024-08-31T02:44:40.368780+0000 mgr.a (mgr.14388) 1445 : audit [DBG] from='client.44043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:42.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:42 smithi027 bash[22610]: audit 2024-08-31T02:44:40.368780+0000 mgr.a (mgr.14388) 1445 : audit [DBG] from='client.44043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:42.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:42 smithi191 bash[24992]: audit 2024-08-31T02:44:40.368780+0000 mgr.a (mgr.14388) 1445 : audit [DBG] from='client.44043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:43.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:43 smithi163 bash[24253]: cluster 2024-08-31T02:44:41.981086+0000 mgr.a (mgr.14388) 1446 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:43.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:43 smithi027 bash[22610]: cluster 2024-08-31T02:44:41.981086+0000 mgr.a (mgr.14388) 1446 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:43 smithi191 bash[24992]: cluster 2024-08-31T02:44:41.981086+0000 mgr.a (mgr.14388) 1446 : cluster [DBG] pgmap v1002: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:45.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:45 smithi163 bash[24253]: cluster 2024-08-31T02:44:43.983376+0000 mgr.a (mgr.14388) 1447 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:44:45.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:45 smithi027 bash[22610]: cluster 2024-08-31T02:44:43.983376+0000 mgr.a (mgr.14388) 1447 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:44:45.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:45 smithi191 bash[24992]: cluster 2024-08-31T02:44:43.983376+0000 mgr.a (mgr.14388) 1447 : cluster [DBG] pgmap v1003: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:44:45.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:44:45.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:44:45.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:46.573 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:47 smithi163 bash[24253]: cluster 2024-08-31T02:44:45.983915+0000 mgr.a (mgr.14388) 1448 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:47 smithi163 bash[24253]: audit 2024-08-31T02:44:46.144564+0000 mgr.a (mgr.14388) 1449 : audit [DBG] from='client.44121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:47.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:47 smithi027 bash[22610]: cluster 2024-08-31T02:44:45.983915+0000 mgr.a (mgr.14388) 1448 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:47.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:47 smithi027 bash[22610]: audit 2024-08-31T02:44:46.144564+0000 mgr.a (mgr.14388) 1449 : audit [DBG] from='client.44121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:47.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:47 smithi191 bash[24992]: cluster 2024-08-31T02:44:45.983915+0000 mgr.a (mgr.14388) 1448 : cluster [DBG] pgmap v1004: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:47 smithi191 bash[24992]: audit 2024-08-31T02:44:46.144564+0000 mgr.a (mgr.14388) 1449 : audit [DBG] from='client.44121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:49.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:49 smithi163 bash[24253]: cluster 2024-08-31T02:44:47.985915+0000 mgr.a (mgr.14388) 1450 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:44:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:49 smithi027 bash[22610]: cluster 2024-08-31T02:44:47.985915+0000 mgr.a (mgr.14388) 1450 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:44:49.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:49 smithi191 bash[24992]: cluster 2024-08-31T02:44:47.985915+0000 mgr.a (mgr.14388) 1450 : cluster [DBG] pgmap v1005: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:44:51.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:51 smithi163 bash[24253]: cluster 2024-08-31T02:44:49.987245+0000 mgr.a (mgr.14388) 1451 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:44:51.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:51 smithi027 bash[22610]: cluster 2024-08-31T02:44:49.987245+0000 mgr.a (mgr.14388) 1451 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:44:51.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:51 smithi191 bash[24992]: cluster 2024-08-31T02:44:49.987245+0000 mgr.a (mgr.14388) 1451 : cluster [DBG] pgmap v1006: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:44:51.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:44:51.575 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:44:51.575 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:52.351 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:52.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:52.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:52.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:52.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:53 smithi163 bash[24253]: audit 2024-08-31T02:44:51.908720+0000 mgr.a (mgr.14388) 1452 : audit [DBG] from='client.44199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:53 smithi163 bash[24253]: cluster 2024-08-31T02:44:51.987799+0000 mgr.a (mgr.14388) 1453 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:53.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:53 smithi027 bash[22610]: audit 2024-08-31T02:44:51.908720+0000 mgr.a (mgr.14388) 1452 : audit [DBG] from='client.44199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:53.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:53 smithi027 bash[22610]: cluster 2024-08-31T02:44:51.987799+0000 mgr.a (mgr.14388) 1453 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:53.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:53 smithi191 bash[24992]: audit 2024-08-31T02:44:51.908720+0000 mgr.a (mgr.14388) 1452 : audit [DBG] from='client.44199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:53 smithi191 bash[24992]: cluster 2024-08-31T02:44:51.987799+0000 mgr.a (mgr.14388) 1453 : cluster [DBG] pgmap v1007: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:55 smithi163 bash[24253]: cluster 2024-08-31T02:44:53.990044+0000 mgr.a (mgr.14388) 1454 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:44:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:55 smithi027 bash[22610]: cluster 2024-08-31T02:44:53.990044+0000 mgr.a (mgr.14388) 1454 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:44:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:55 smithi191 bash[24992]: cluster 2024-08-31T02:44:53.990044+0000 mgr.a (mgr.14388) 1454 : cluster [DBG] pgmap v1008: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:44:56.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:56 smithi163 bash[24253]: audit 2024-08-31T02:44:55.861529+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:44:56.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:56 smithi027 bash[22610]: audit 2024-08-31T02:44:55.861529+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:44:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:56 smithi191 bash[24992]: audit 2024-08-31T02:44:55.861529+0000 mon.a (mon.0) 816 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:44:57.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:44:57.353 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:44:57.353 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:44:57.416 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:57 smithi027 bash[22610]: cluster 2024-08-31T02:44:55.990927+0000 mgr.a (mgr.14388) 1455 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:57.416 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:57 smithi027 bash[22610]: audit 2024-08-31T02:44:56.697999+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:44:57.417 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:57 smithi027 bash[22610]: audit 2024-08-31T02:44:56.699326+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:44:57.417 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:57 smithi027 bash[22610]: audit 2024-08-31T02:44:56.708462+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:44:57.417 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:57 smithi027 bash[22610]: audit 2024-08-31T02:44:56.713789+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:44:57.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:57 smithi163 bash[24253]: cluster 2024-08-31T02:44:55.990927+0000 mgr.a (mgr.14388) 1455 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:57 smithi163 bash[24253]: audit 2024-08-31T02:44:56.697999+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:44:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:57 smithi163 bash[24253]: audit 2024-08-31T02:44:56.699326+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:44:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:57 smithi163 bash[24253]: audit 2024-08-31T02:44:56.708462+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:44:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:57 smithi163 bash[24253]: audit 2024-08-31T02:44:56.713789+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:44:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:57 smithi191 bash[24992]: cluster 2024-08-31T02:44:55.990927+0000 mgr.a (mgr.14388) 1455 : cluster [DBG] pgmap v1009: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:44:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:57 smithi191 bash[24992]: audit 2024-08-31T02:44:56.697999+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:44:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:57 smithi191 bash[24992]: audit 2024-08-31T02:44:56.699326+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:44:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:57 smithi191 bash[24992]: audit 2024-08-31T02:44:56.708462+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:44:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:57 smithi191 bash[24992]: audit 2024-08-31T02:44:56.713789+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:44:57.730 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:44:57 smithi027 bash[22863]: debug 2024-08-31T02:44:57.418+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:44:57.730 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:44:57 smithi027 bash[22863]: debug 2024-08-31T02:44:57.418+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:44:58.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:44:58.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:44:58.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:44:58.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:44:58.077 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:44:58.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:58 smithi163 bash[24253]: audit 2024-08-31T02:44:56.716091+0000 mgr.a (mgr.14388) 1456 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:44:58.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:58 smithi027 bash[22610]: audit 2024-08-31T02:44:56.716091+0000 mgr.a (mgr.14388) 1456 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:44:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:58 smithi191 bash[24992]: audit 2024-08-31T02:44:56.716091+0000 mgr.a (mgr.14388) 1456 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:44:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:59 smithi163 bash[24253]: audit 2024-08-31T02:44:57.419440+0000 mgr.a (mgr.14388) 1457 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:44:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:59 smithi163 bash[24253]: cephadm 2024-08-31T02:44:57.420629+0000 mgr.a (mgr.14388) 1458 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:44:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:59 smithi163 bash[24253]: audit 2024-08-31T02:44:57.678416+0000 mgr.a (mgr.14388) 1459 : audit [DBG] from='client.44385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:44:59 smithi163 bash[24253]: cluster 2024-08-31T02:44:57.991972+0000 mgr.a (mgr.14388) 1460 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:44:59.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:59 smithi027 bash[22610]: audit 2024-08-31T02:44:57.419440+0000 mgr.a (mgr.14388) 1457 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:44:59.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:59 smithi027 bash[22610]: cephadm 2024-08-31T02:44:57.420629+0000 mgr.a (mgr.14388) 1458 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:44:59.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:59 smithi027 bash[22610]: audit 2024-08-31T02:44:57.678416+0000 mgr.a (mgr.14388) 1459 : audit [DBG] from='client.44385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:44:59 smithi027 bash[22610]: cluster 2024-08-31T02:44:57.991972+0000 mgr.a (mgr.14388) 1460 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:44:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:59 smithi191 bash[24992]: audit 2024-08-31T02:44:57.419440+0000 mgr.a (mgr.14388) 1457 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:44:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:59 smithi191 bash[24992]: cephadm 2024-08-31T02:44:57.420629+0000 mgr.a (mgr.14388) 1458 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:44:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:59 smithi191 bash[24992]: audit 2024-08-31T02:44:57.678416+0000 mgr.a (mgr.14388) 1459 : audit [DBG] from='client.44385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:44:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:44:59 smithi191 bash[24992]: cluster 2024-08-31T02:44:57.991972+0000 mgr.a (mgr.14388) 1460 : cluster [DBG] pgmap v1010: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:45:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:01 smithi163 bash[24253]: cluster 2024-08-31T02:44:59.993179+0000 mgr.a (mgr.14388) 1461 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:01.457 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:01 smithi191 bash[24992]: cluster 2024-08-31T02:44:59.993179+0000 mgr.a (mgr.14388) 1461 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:01 smithi027 bash[22610]: cluster 2024-08-31T02:44:59.993179+0000 mgr.a (mgr.14388) 1461 : cluster [DBG] pgmap v1011: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:03.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:45:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:45:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:45:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:03 smithi163 bash[24253]: cluster 2024-08-31T02:45:01.993936+0000 mgr.a (mgr.14388) 1462 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:03.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:03 smithi027 bash[22610]: cluster 2024-08-31T02:45:01.993936+0000 mgr.a (mgr.14388) 1462 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:03 smithi191 bash[24992]: cluster 2024-08-31T02:45:01.993936+0000 mgr.a (mgr.14388) 1462 : cluster [DBG] pgmap v1012: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:03.808 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:45:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:45:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:45:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:45:03.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:45:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:05 smithi163 bash[24253]: audit 2024-08-31T02:45:03.410216+0000 mgr.a (mgr.14388) 1463 : audit [DBG] from='client.44463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:05 smithi163 bash[24253]: cluster 2024-08-31T02:45:03.996622+0000 mgr.a (mgr.14388) 1464 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:45:05.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:05 smithi027 bash[22610]: audit 2024-08-31T02:45:03.410216+0000 mgr.a (mgr.14388) 1463 : audit [DBG] from='client.44463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:05.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:05 smithi027 bash[22610]: cluster 2024-08-31T02:45:03.996622+0000 mgr.a (mgr.14388) 1464 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:45:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:05 smithi191 bash[24992]: audit 2024-08-31T02:45:03.410216+0000 mgr.a (mgr.14388) 1463 : audit [DBG] from='client.44463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:05 smithi191 bash[24992]: cluster 2024-08-31T02:45:03.996622+0000 mgr.a (mgr.14388) 1464 : cluster [DBG] pgmap v1013: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:45:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:06 smithi163 bash[24253]: cluster 2024-08-31T02:45:05.997409+0000 mgr.a (mgr.14388) 1465 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:06.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:06 smithi027 bash[22610]: cluster 2024-08-31T02:45:05.997409+0000 mgr.a (mgr.14388) 1465 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:06.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:06 smithi191 bash[24992]: cluster 2024-08-31T02:45:05.997409+0000 mgr.a (mgr.14388) 1465 : cluster [DBG] pgmap v1014: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:45:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:45:08.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:45:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:09 smithi163 bash[24253]: cluster 2024-08-31T02:45:07.998966+0000 mgr.a (mgr.14388) 1466 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:09 smithi027 bash[22610]: cluster 2024-08-31T02:45:07.998966+0000 mgr.a (mgr.14388) 1466 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:09.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:09 smithi191 bash[24992]: cluster 2024-08-31T02:45:07.998966+0000 mgr.a (mgr.14388) 1466 : cluster [DBG] pgmap v1015: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:45:09.572 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:45:09.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:45:09.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:45:09.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:45:09.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:45:10.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:10 smithi163 bash[24253]: audit 2024-08-31T02:45:09.147588+0000 mgr.a (mgr.14388) 1467 : audit [DBG] from='client.44538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:10.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:10 smithi027 bash[22610]: audit 2024-08-31T02:45:09.147588+0000 mgr.a (mgr.14388) 1467 : audit [DBG] from='client.44538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:10 smithi191 bash[24992]: audit 2024-08-31T02:45:09.147588+0000 mgr.a (mgr.14388) 1467 : audit [DBG] from='client.44538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:11 smithi163 bash[24253]: cluster 2024-08-31T02:45:10.000772+0000 mgr.a (mgr.14388) 1468 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T02:45:11.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:11 smithi027 bash[22610]: cluster 2024-08-31T02:45:10.000772+0000 mgr.a (mgr.14388) 1468 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T02:45:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:11 smithi191 bash[24992]: cluster 2024-08-31T02:45:10.000772+0000 mgr.a (mgr.14388) 1468 : cluster [DBG] pgmap v1016: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T02:45:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:13 smithi163 bash[24253]: cluster 2024-08-31T02:45:12.001540+0000 mgr.a (mgr.14388) 1469 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:45:13.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:13 smithi027 bash[22610]: cluster 2024-08-31T02:45:12.001540+0000 mgr.a (mgr.14388) 1469 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:45:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:13 smithi191 bash[24992]: cluster 2024-08-31T02:45:12.001540+0000 mgr.a (mgr.14388) 1469 : cluster [DBG] pgmap v1017: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:45:14.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:45:14.574 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:45:14.574 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:45:15.309 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:45:15.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:45:15.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:45:15.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:45:15.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:45:15.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:15 smithi163 bash[24253]: cluster 2024-08-31T02:45:14.003581+0000 mgr.a (mgr.14388) 1470 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:45:15.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:15 smithi027 bash[22610]: cluster 2024-08-31T02:45:14.003581+0000 mgr.a (mgr.14388) 1470 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:45:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:15 smithi191 bash[24992]: cluster 2024-08-31T02:45:14.003581+0000 mgr.a (mgr.14388) 1470 : cluster [DBG] pgmap v1018: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:45:16.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:16 smithi163 bash[24253]: audit 2024-08-31T02:45:14.908881+0000 mgr.a (mgr.14388) 1471 : audit [DBG] from='client.44613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:16.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:16 smithi027 bash[22610]: audit 2024-08-31T02:45:14.908881+0000 mgr.a (mgr.14388) 1471 : audit [DBG] from='client.44613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:16 smithi191 bash[24992]: audit 2024-08-31T02:45:14.908881+0000 mgr.a (mgr.14388) 1471 : audit [DBG] from='client.44613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:17.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:17 smithi163 bash[24253]: cluster 2024-08-31T02:45:16.004528+0000 mgr.a (mgr.14388) 1472 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:17.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:17 smithi027 bash[22610]: cluster 2024-08-31T02:45:16.004528+0000 mgr.a (mgr.14388) 1472 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:17.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:17 smithi191 bash[24992]: cluster 2024-08-31T02:45:16.004528+0000 mgr.a (mgr.14388) 1472 : cluster [DBG] pgmap v1019: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:19 smithi163 bash[24253]: cluster 2024-08-31T02:45:18.006302+0000 mgr.a (mgr.14388) 1473 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:45:19.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:19 smithi027 bash[22610]: cluster 2024-08-31T02:45:18.006302+0000 mgr.a (mgr.14388) 1473 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:45:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:19 smithi191 bash[24992]: cluster 2024-08-31T02:45:18.006302+0000 mgr.a (mgr.14388) 1473 : cluster [DBG] pgmap v1020: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:45:20.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:45:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:45:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:45:21.062 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:45:21.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:45:21.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:45:21.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:45:21.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:45:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:21 smithi163 bash[24253]: cluster 2024-08-31T02:45:20.007709+0000 mgr.a (mgr.14388) 1474 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:45:21.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:21 smithi027 bash[22610]: cluster 2024-08-31T02:45:20.007709+0000 mgr.a (mgr.14388) 1474 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:45:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:21 smithi191 bash[24992]: cluster 2024-08-31T02:45:20.007709+0000 mgr.a (mgr.14388) 1474 : cluster [DBG] pgmap v1021: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:45:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:22 smithi163 bash[24253]: audit 2024-08-31T02:45:20.643719+0000 mgr.a (mgr.14388) 1475 : audit [DBG] from='client.44691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:22.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:22 smithi027 bash[22610]: audit 2024-08-31T02:45:20.643719+0000 mgr.a (mgr.14388) 1475 : audit [DBG] from='client.44691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:22 smithi191 bash[24992]: audit 2024-08-31T02:45:20.643719+0000 mgr.a (mgr.14388) 1475 : audit [DBG] from='client.44691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:23.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:23 smithi163 bash[24253]: cluster 2024-08-31T02:45:22.008689+0000 mgr.a (mgr.14388) 1476 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:23.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:23 smithi027 bash[22610]: cluster 2024-08-31T02:45:22.008689+0000 mgr.a (mgr.14388) 1476 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:23 smithi191 bash[24992]: cluster 2024-08-31T02:45:22.008689+0000 mgr.a (mgr.14388) 1476 : cluster [DBG] pgmap v1022: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:25 smithi163 bash[24253]: cluster 2024-08-31T02:45:24.010911+0000 mgr.a (mgr.14388) 1477 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:25.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:25 smithi027 bash[22610]: cluster 2024-08-31T02:45:24.010911+0000 mgr.a (mgr.14388) 1477 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:25 smithi191 bash[24992]: cluster 2024-08-31T02:45:24.010911+0000 mgr.a (mgr.14388) 1477 : cluster [DBG] pgmap v1023: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:26.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:45:26.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:45:26.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:45:26.804 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:45:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:45:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:45:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:45:26.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:45:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:27 smithi163 bash[24253]: cluster 2024-08-31T02:45:26.011666+0000 mgr.a (mgr.14388) 1478 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:27.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:27 smithi027 bash[22610]: cluster 2024-08-31T02:45:26.011666+0000 mgr.a (mgr.14388) 1478 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:27 smithi191 bash[24992]: cluster 2024-08-31T02:45:26.011666+0000 mgr.a (mgr.14388) 1478 : cluster [DBG] pgmap v1024: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:28 smithi163 bash[24253]: audit 2024-08-31T02:45:26.402390+0000 mgr.a (mgr.14388) 1479 : audit [DBG] from='client.44769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:28.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:28 smithi027 bash[22610]: audit 2024-08-31T02:45:26.402390+0000 mgr.a (mgr.14388) 1479 : audit [DBG] from='client.44769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:28 smithi191 bash[24992]: audit 2024-08-31T02:45:26.402390+0000 mgr.a (mgr.14388) 1479 : audit [DBG] from='client.44769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:29 smithi163 bash[24253]: cluster 2024-08-31T02:45:28.014025+0000 mgr.a (mgr.14388) 1480 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:29.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:29 smithi027 bash[22610]: cluster 2024-08-31T02:45:28.014025+0000 mgr.a (mgr.14388) 1480 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:29 smithi191 bash[24992]: cluster 2024-08-31T02:45:28.014025+0000 mgr.a (mgr.14388) 1480 : cluster [DBG] pgmap v1025: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:31 smithi163 bash[24253]: cluster 2024-08-31T02:45:30.014844+0000 mgr.a (mgr.14388) 1481 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:45:31.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:31 smithi027 bash[22610]: cluster 2024-08-31T02:45:30.014844+0000 mgr.a (mgr.14388) 1481 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:45:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:31 smithi191 bash[24992]: cluster 2024-08-31T02:45:30.014844+0000 mgr.a (mgr.14388) 1481 : cluster [DBG] pgmap v1026: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:45:31.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:45:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:45:31.806 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:45:32.544 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:45:32.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:45:32.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:45:32.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:45:32.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:45:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:33 smithi163 bash[24253]: cluster 2024-08-31T02:45:32.015551+0000 mgr.a (mgr.14388) 1482 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:33 smithi163 bash[24253]: audit 2024-08-31T02:45:32.139093+0000 mgr.a (mgr.14388) 1483 : audit [DBG] from='client.44847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:33.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:33 smithi027 bash[22610]: cluster 2024-08-31T02:45:32.015551+0000 mgr.a (mgr.14388) 1482 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:33.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:33 smithi027 bash[22610]: audit 2024-08-31T02:45:32.139093+0000 mgr.a (mgr.14388) 1483 : audit [DBG] from='client.44847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:33 smithi191 bash[24992]: cluster 2024-08-31T02:45:32.015551+0000 mgr.a (mgr.14388) 1482 : cluster [DBG] pgmap v1027: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:33 smithi191 bash[24992]: audit 2024-08-31T02:45:32.139093+0000 mgr.a (mgr.14388) 1483 : audit [DBG] from='client.44847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:35 smithi163 bash[24253]: cluster 2024-08-31T02:45:34.017781+0000 mgr.a (mgr.14388) 1484 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:35.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:35 smithi027 bash[22610]: cluster 2024-08-31T02:45:34.017781+0000 mgr.a (mgr.14388) 1484 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:35 smithi191 bash[24992]: cluster 2024-08-31T02:45:34.017781+0000 mgr.a (mgr.14388) 1484 : cluster [DBG] pgmap v1028: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:37 smithi163 bash[24253]: cluster 2024-08-31T02:45:36.018566+0000 mgr.a (mgr.14388) 1485 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:37.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:37 smithi027 bash[22610]: cluster 2024-08-31T02:45:36.018566+0000 mgr.a (mgr.14388) 1485 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:37 smithi191 bash[24992]: cluster 2024-08-31T02:45:36.018566+0000 mgr.a (mgr.14388) 1485 : cluster [DBG] pgmap v1029: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:37.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:45:37.547 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:45:37.547 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:45:38.281 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:45:38.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:45:38.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:45:38.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:45:38.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:45:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:39 smithi163 bash[24253]: audit 2024-08-31T02:45:37.876478+0000 mgr.a (mgr.14388) 1486 : audit [DBG] from='client.44925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:39 smithi163 bash[24253]: cluster 2024-08-31T02:45:38.019631+0000 mgr.a (mgr.14388) 1487 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:39.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:39 smithi027 bash[22610]: audit 2024-08-31T02:45:37.876478+0000 mgr.a (mgr.14388) 1486 : audit [DBG] from='client.44925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:39.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:39 smithi027 bash[22610]: cluster 2024-08-31T02:45:38.019631+0000 mgr.a (mgr.14388) 1487 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:39 smithi191 bash[24992]: audit 2024-08-31T02:45:37.876478+0000 mgr.a (mgr.14388) 1486 : audit [DBG] from='client.44925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:39 smithi191 bash[24992]: cluster 2024-08-31T02:45:38.019631+0000 mgr.a (mgr.14388) 1487 : cluster [DBG] pgmap v1030: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:41 smithi163 bash[24253]: cluster 2024-08-31T02:45:40.020428+0000 mgr.a (mgr.14388) 1488 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:45:41.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:41 smithi027 bash[22610]: cluster 2024-08-31T02:45:40.020428+0000 mgr.a (mgr.14388) 1488 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:45:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:41 smithi191 bash[24992]: cluster 2024-08-31T02:45:40.020428+0000 mgr.a (mgr.14388) 1488 : cluster [DBG] pgmap v1031: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:45:43.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:45:43.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:45:43.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:45:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:43 smithi163 bash[24253]: cluster 2024-08-31T02:45:42.021213+0000 mgr.a (mgr.14388) 1489 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:45:43.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:43 smithi027 bash[22610]: cluster 2024-08-31T02:45:42.021213+0000 mgr.a (mgr.14388) 1489 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:45:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:43 smithi191 bash[24992]: cluster 2024-08-31T02:45:42.021213+0000 mgr.a (mgr.14388) 1489 : cluster [DBG] pgmap v1032: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:45:44.044 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:45:44.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:45:44.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:45:44.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:45:44.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:45:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:45 smithi163 bash[24253]: audit 2024-08-31T02:45:43.619418+0000 mgr.a (mgr.14388) 1490 : audit [DBG] from='client.45003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:45 smithi163 bash[24253]: cluster 2024-08-31T02:45:44.022387+0000 mgr.a (mgr.14388) 1491 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:45.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:45 smithi027 bash[22610]: audit 2024-08-31T02:45:43.619418+0000 mgr.a (mgr.14388) 1490 : audit [DBG] from='client.45003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:45.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:45 smithi027 bash[22610]: cluster 2024-08-31T02:45:44.022387+0000 mgr.a (mgr.14388) 1491 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:45 smithi191 bash[24992]: audit 2024-08-31T02:45:43.619418+0000 mgr.a (mgr.14388) 1490 : audit [DBG] from='client.45003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:45 smithi191 bash[24992]: cluster 2024-08-31T02:45:44.022387+0000 mgr.a (mgr.14388) 1491 : cluster [DBG] pgmap v1033: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:47 smithi163 bash[24253]: cluster 2024-08-31T02:45:46.023268+0000 mgr.a (mgr.14388) 1492 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:45:47.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:47 smithi027 bash[22610]: cluster 2024-08-31T02:45:46.023268+0000 mgr.a (mgr.14388) 1492 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:45:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:47 smithi191 bash[24992]: cluster 2024-08-31T02:45:46.023268+0000 mgr.a (mgr.14388) 1492 : cluster [DBG] pgmap v1034: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:45:49.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:45:49.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:45:49.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:45:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:49 smithi163 bash[24253]: cluster 2024-08-31T02:45:48.025310+0000 mgr.a (mgr.14388) 1493 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:49 smithi027 bash[22610]: cluster 2024-08-31T02:45:48.025310+0000 mgr.a (mgr.14388) 1493 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:49 smithi191 bash[24992]: cluster 2024-08-31T02:45:48.025310+0000 mgr.a (mgr.14388) 1493 : cluster [DBG] pgmap v1035: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:49.790 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:45:49.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:45:49.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:45:49.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:45:49.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:45:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:51 smithi163 bash[24253]: audit 2024-08-31T02:45:49.381190+0000 mgr.a (mgr.14388) 1494 : audit [DBG] from='client.45081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:51 smithi163 bash[24253]: cluster 2024-08-31T02:45:50.026312+0000 mgr.a (mgr.14388) 1495 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:51.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:51 smithi027 bash[22610]: audit 2024-08-31T02:45:49.381190+0000 mgr.a (mgr.14388) 1494 : audit [DBG] from='client.45081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:51.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:51 smithi027 bash[22610]: cluster 2024-08-31T02:45:50.026312+0000 mgr.a (mgr.14388) 1495 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:51 smithi191 bash[24992]: audit 2024-08-31T02:45:49.381190+0000 mgr.a (mgr.14388) 1494 : audit [DBG] from='client.45081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:51 smithi191 bash[24992]: cluster 2024-08-31T02:45:50.026312+0000 mgr.a (mgr.14388) 1495 : cluster [DBG] pgmap v1036: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:53 smithi163 bash[24253]: cluster 2024-08-31T02:45:52.027114+0000 mgr.a (mgr.14388) 1496 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:53.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:53 smithi027 bash[22610]: cluster 2024-08-31T02:45:52.027114+0000 mgr.a (mgr.14388) 1496 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:53 smithi191 bash[24992]: cluster 2024-08-31T02:45:52.027114+0000 mgr.a (mgr.14388) 1496 : cluster [DBG] pgmap v1037: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:54.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:45:54.792 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:45:54.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:45:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:55 smithi163 bash[24253]: cluster 2024-08-31T02:45:54.029345+0000 mgr.a (mgr.14388) 1497 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:55 smithi027 bash[22610]: cluster 2024-08-31T02:45:54.029345+0000 mgr.a (mgr.14388) 1497 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:55.537 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:45:55.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:45:55.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:45:55.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:45:55.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:45:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:55 smithi191 bash[24992]: cluster 2024-08-31T02:45:54.029345+0000 mgr.a (mgr.14388) 1497 : cluster [DBG] pgmap v1038: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:56.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:56 smithi163 bash[24253]: audit 2024-08-31T02:45:55.125480+0000 mgr.a (mgr.14388) 1498 : audit [DBG] from='client.45159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:56.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:56 smithi027 bash[22610]: audit 2024-08-31T02:45:55.125480+0000 mgr.a (mgr.14388) 1498 : audit [DBG] from='client.45159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:56 smithi191 bash[24992]: audit 2024-08-31T02:45:55.125480+0000 mgr.a (mgr.14388) 1498 : audit [DBG] from='client.45159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:45:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:57 smithi163 bash[24253]: cluster 2024-08-31T02:45:56.030309+0000 mgr.a (mgr.14388) 1499 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:57.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:57 smithi027 bash[22610]: cluster 2024-08-31T02:45:56.030309+0000 mgr.a (mgr.14388) 1499 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:57 smithi191 bash[24992]: cluster 2024-08-31T02:45:56.030309+0000 mgr.a (mgr.14388) 1499 : cluster [DBG] pgmap v1039: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:45:58.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:58 smithi027 bash[22610]: audit 2024-08-31T02:45:57.473889+0000 mon.a (mon.0) 821 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:45:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:58 smithi191 bash[24992]: audit 2024-08-31T02:45:57.473889+0000 mon.a (mon.0) 821 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:45:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:58 smithi163 bash[24253]: audit 2024-08-31T02:45:57.473889+0000 mon.a (mon.0) 821 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:45:59.480 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:45:59 smithi027 bash[22863]: debug 2024-08-31T02:45:59.064+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:45:59.481 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:45:59 smithi027 bash[22863]: debug 2024-08-31T02:45:59.064+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:45:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:59 smithi027 bash[22610]: cluster 2024-08-31T02:45:58.032361+0000 mgr.a (mgr.14388) 1500 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:59 smithi027 bash[22610]: audit 2024-08-31T02:45:58.333677+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:45:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:59 smithi027 bash[22610]: audit 2024-08-31T02:45:58.335217+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:45:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:59 smithi027 bash[22610]: audit 2024-08-31T02:45:58.347072+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:45:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:59 smithi027 bash[22610]: audit 2024-08-31T02:45:58.351749+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:45:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:59 smithi027 bash[22610]: audit 2024-08-31T02:45:58.353195+0000 mgr.a (mgr.14388) 1501 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:45:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:59 smithi027 bash[22610]: audit 2024-08-31T02:45:59.067597+0000 mgr.a (mgr.14388) 1502 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:45:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:45:59 smithi027 bash[22610]: cephadm 2024-08-31T02:45:59.069048+0000 mgr.a (mgr.14388) 1503 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:45:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:59 smithi191 bash[24992]: cluster 2024-08-31T02:45:58.032361+0000 mgr.a (mgr.14388) 1500 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:59.564 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:59 smithi191 bash[24992]: audit 2024-08-31T02:45:58.333677+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:45:59.564 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:59 smithi191 bash[24992]: audit 2024-08-31T02:45:58.335217+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:45:59.564 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:59 smithi191 bash[24992]: audit 2024-08-31T02:45:58.347072+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:45:59.564 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:59 smithi191 bash[24992]: audit 2024-08-31T02:45:58.351749+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:45:59.564 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:59 smithi191 bash[24992]: audit 2024-08-31T02:45:58.353195+0000 mgr.a (mgr.14388) 1501 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:45:59.565 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:59 smithi191 bash[24992]: audit 2024-08-31T02:45:59.067597+0000 mgr.a (mgr.14388) 1502 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:45:59.565 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:45:59 smithi191 bash[24992]: cephadm 2024-08-31T02:45:59.069048+0000 mgr.a (mgr.14388) 1503 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:45:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:59 smithi163 bash[24253]: cluster 2024-08-31T02:45:58.032361+0000 mgr.a (mgr.14388) 1500 : cluster [DBG] pgmap v1040: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:45:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:59 smithi163 bash[24253]: audit 2024-08-31T02:45:58.333677+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:45:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:59 smithi163 bash[24253]: audit 2024-08-31T02:45:58.335217+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:45:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:59 smithi163 bash[24253]: audit 2024-08-31T02:45:58.347072+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:45:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:59 smithi163 bash[24253]: audit 2024-08-31T02:45:58.351749+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:45:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:59 smithi163 bash[24253]: audit 2024-08-31T02:45:58.353195+0000 mgr.a (mgr.14388) 1501 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:45:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:59 smithi163 bash[24253]: audit 2024-08-31T02:45:59.067597+0000 mgr.a (mgr.14388) 1502 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:45:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:45:59 smithi163 bash[24253]: cephadm 2024-08-31T02:45:59.069048+0000 mgr.a (mgr.14388) 1503 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:46:00.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:00 smithi027 bash[22610]: cluster 2024-08-31T02:46:00.033231+0000 mgr.a (mgr.14388) 1504 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:00 smithi191 bash[24992]: cluster 2024-08-31T02:46:00.033231+0000 mgr.a (mgr.14388) 1504 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:00.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:00.539 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:00.539 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:00.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:00 smithi163 bash[24253]: cluster 2024-08-31T02:46:00.033231+0000 mgr.a (mgr.14388) 1504 : cluster [DBG] pgmap v1041: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:01.312 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:01.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:01.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:01.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:01.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:01 smithi027 bash[22610]: audit 2024-08-31T02:46:00.876787+0000 mgr.a (mgr.14388) 1505 : audit [DBG] from='client.45345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:01 smithi191 bash[24992]: audit 2024-08-31T02:46:00.876787+0000 mgr.a (mgr.14388) 1505 : audit [DBG] from='client.45345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:01 smithi163 bash[24253]: audit 2024-08-31T02:46:00.876787+0000 mgr.a (mgr.14388) 1505 : audit [DBG] from='client.45345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:02.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:02 smithi027 bash[22610]: cluster 2024-08-31T02:46:02.034184+0000 mgr.a (mgr.14388) 1506 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:02 smithi191 bash[24992]: cluster 2024-08-31T02:46:02.034184+0000 mgr.a (mgr.14388) 1506 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:02.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:02 smithi163 bash[24253]: cluster 2024-08-31T02:46:02.034184+0000 mgr.a (mgr.14388) 1506 : cluster [DBG] pgmap v1042: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:05 smithi163 bash[24253]: cluster 2024-08-31T02:46:04.036320+0000 mgr.a (mgr.14388) 1507 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:05.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:05 smithi027 bash[22610]: cluster 2024-08-31T02:46:04.036320+0000 mgr.a (mgr.14388) 1507 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:05 smithi191 bash[24992]: cluster 2024-08-31T02:46:04.036320+0000 mgr.a (mgr.14388) 1507 : cluster [DBG] pgmap v1043: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:06.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:06.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:06.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:07.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:07.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:07.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:07.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:07.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:07 smithi163 bash[24253]: cluster 2024-08-31T02:46:06.037094+0000 mgr.a (mgr.14388) 1508 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:07.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:07 smithi027 bash[22610]: cluster 2024-08-31T02:46:06.037094+0000 mgr.a (mgr.14388) 1508 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:07 smithi191 bash[24992]: cluster 2024-08-31T02:46:06.037094+0000 mgr.a (mgr.14388) 1508 : cluster [DBG] pgmap v1044: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:08 smithi163 bash[24253]: audit 2024-08-31T02:46:06.655079+0000 mgr.a (mgr.14388) 1509 : audit [DBG] from='client.45423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:08.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:08 smithi027 bash[22610]: audit 2024-08-31T02:46:06.655079+0000 mgr.a (mgr.14388) 1509 : audit [DBG] from='client.45423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:08 smithi191 bash[24992]: audit 2024-08-31T02:46:06.655079+0000 mgr.a (mgr.14388) 1509 : audit [DBG] from='client.45423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:09 smithi163 bash[24253]: cluster 2024-08-31T02:46:08.039455+0000 mgr.a (mgr.14388) 1510 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:09 smithi027 bash[22610]: cluster 2024-08-31T02:46:08.039455+0000 mgr.a (mgr.14388) 1510 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:09 smithi191 bash[24992]: cluster 2024-08-31T02:46:08.039455+0000 mgr.a (mgr.14388) 1510 : cluster [DBG] pgmap v1045: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:11 smithi163 bash[24253]: cluster 2024-08-31T02:46:10.040384+0000 mgr.a (mgr.14388) 1511 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:11.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:11 smithi027 bash[22610]: cluster 2024-08-31T02:46:10.040384+0000 mgr.a (mgr.14388) 1511 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:11 smithi191 bash[24992]: cluster 2024-08-31T02:46:10.040384+0000 mgr.a (mgr.14388) 1511 : cluster [DBG] pgmap v1046: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:12.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:12.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:12.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:12.838 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:12.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:12.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:12.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:12.839 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:13 smithi163 bash[24253]: cluster 2024-08-31T02:46:12.041307+0000 mgr.a (mgr.14388) 1512 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:13.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:13 smithi027 bash[22610]: cluster 2024-08-31T02:46:12.041307+0000 mgr.a (mgr.14388) 1512 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:13 smithi191 bash[24992]: cluster 2024-08-31T02:46:12.041307+0000 mgr.a (mgr.14388) 1512 : cluster [DBG] pgmap v1047: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:14 smithi163 bash[24253]: audit 2024-08-31T02:46:12.406575+0000 mgr.a (mgr.14388) 1513 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:14.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:14 smithi027 bash[22610]: audit 2024-08-31T02:46:12.406575+0000 mgr.a (mgr.14388) 1513 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:14 smithi191 bash[24992]: audit 2024-08-31T02:46:12.406575+0000 mgr.a (mgr.14388) 1513 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:15 smithi163 bash[24253]: cluster 2024-08-31T02:46:14.043635+0000 mgr.a (mgr.14388) 1514 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:15.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:15 smithi027 bash[22610]: cluster 2024-08-31T02:46:14.043635+0000 mgr.a (mgr.14388) 1514 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:15 smithi191 bash[24992]: cluster 2024-08-31T02:46:14.043635+0000 mgr.a (mgr.14388) 1514 : cluster [DBG] pgmap v1048: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:46:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:17 smithi163 bash[24253]: cluster 2024-08-31T02:46:16.044394+0000 mgr.a (mgr.14388) 1515 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:46:17.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:17 smithi027 bash[22610]: cluster 2024-08-31T02:46:16.044394+0000 mgr.a (mgr.14388) 1515 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:46:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:17 smithi191 bash[24992]: cluster 2024-08-31T02:46:16.044394+0000 mgr.a (mgr.14388) 1515 : cluster [DBG] pgmap v1049: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:46:17.839 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:17.840 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:17.840 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:18.587 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:18.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:18.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:18.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:18.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:19 smithi163 bash[24253]: cluster 2024-08-31T02:46:18.046227+0000 mgr.a (mgr.14388) 1516 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:19 smithi163 bash[24253]: audit 2024-08-31T02:46:18.174554+0000 mgr.a (mgr.14388) 1517 : audit [DBG] from='client.45576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:19.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:19 smithi027 bash[22610]: cluster 2024-08-31T02:46:18.046227+0000 mgr.a (mgr.14388) 1516 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:19.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:19 smithi027 bash[22610]: audit 2024-08-31T02:46:18.174554+0000 mgr.a (mgr.14388) 1517 : audit [DBG] from='client.45576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:19 smithi191 bash[24992]: cluster 2024-08-31T02:46:18.046227+0000 mgr.a (mgr.14388) 1516 : cluster [DBG] pgmap v1050: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:19 smithi191 bash[24992]: audit 2024-08-31T02:46:18.174554+0000 mgr.a (mgr.14388) 1517 : audit [DBG] from='client.45576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:21 smithi163 bash[24253]: cluster 2024-08-31T02:46:20.047232+0000 mgr.a (mgr.14388) 1518 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:46:21.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:21 smithi027 bash[22610]: cluster 2024-08-31T02:46:20.047232+0000 mgr.a (mgr.14388) 1518 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:46:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:21 smithi191 bash[24992]: cluster 2024-08-31T02:46:20.047232+0000 mgr.a (mgr.14388) 1518 : cluster [DBG] pgmap v1051: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:46:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:23 smithi163 bash[24253]: cluster 2024-08-31T02:46:22.048176+0000 mgr.a (mgr.14388) 1519 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:46:23.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:23 smithi027 bash[22610]: cluster 2024-08-31T02:46:22.048176+0000 mgr.a (mgr.14388) 1519 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:46:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:23 smithi191 bash[24992]: cluster 2024-08-31T02:46:22.048176+0000 mgr.a (mgr.14388) 1519 : cluster [DBG] pgmap v1052: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:46:23.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:23.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:23.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:24.334 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:24.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:24.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:25 smithi163 bash[24253]: audit 2024-08-31T02:46:23.923151+0000 mgr.a (mgr.14388) 1520 : audit [DBG] from='client.45651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:25 smithi163 bash[24253]: cluster 2024-08-31T02:46:24.049349+0000 mgr.a (mgr.14388) 1521 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:25.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:25 smithi027 bash[22610]: audit 2024-08-31T02:46:23.923151+0000 mgr.a (mgr.14388) 1520 : audit [DBG] from='client.45651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:25.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:25 smithi027 bash[22610]: cluster 2024-08-31T02:46:24.049349+0000 mgr.a (mgr.14388) 1521 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:25 smithi191 bash[24992]: audit 2024-08-31T02:46:23.923151+0000 mgr.a (mgr.14388) 1520 : audit [DBG] from='client.45651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:25 smithi191 bash[24992]: cluster 2024-08-31T02:46:24.049349+0000 mgr.a (mgr.14388) 1521 : cluster [DBG] pgmap v1053: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:27 smithi163 bash[24253]: cluster 2024-08-31T02:46:26.050195+0000 mgr.a (mgr.14388) 1522 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:46:27.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:27 smithi027 bash[22610]: cluster 2024-08-31T02:46:26.050195+0000 mgr.a (mgr.14388) 1522 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:46:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:27 smithi191 bash[24992]: cluster 2024-08-31T02:46:26.050195+0000 mgr.a (mgr.14388) 1522 : cluster [DBG] pgmap v1054: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:46:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:29.336 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:29 smithi163 bash[24253]: cluster 2024-08-31T02:46:28.052348+0000 mgr.a (mgr.14388) 1523 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:46:29.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:29 smithi027 bash[22610]: cluster 2024-08-31T02:46:28.052348+0000 mgr.a (mgr.14388) 1523 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:46:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:29 smithi191 bash[24992]: cluster 2024-08-31T02:46:28.052348+0000 mgr.a (mgr.14388) 1523 : cluster [DBG] pgmap v1055: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:46:30.073 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:30.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:30.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:30.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:30.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:31 smithi163 bash[24253]: audit 2024-08-31T02:46:29.671376+0000 mgr.a (mgr.14388) 1524 : audit [DBG] from='client.45726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:31 smithi163 bash[24253]: cluster 2024-08-31T02:46:30.052909+0000 mgr.a (mgr.14388) 1525 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:31.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:31 smithi027 bash[22610]: audit 2024-08-31T02:46:29.671376+0000 mgr.a (mgr.14388) 1524 : audit [DBG] from='client.45726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:31.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:31 smithi027 bash[22610]: cluster 2024-08-31T02:46:30.052909+0000 mgr.a (mgr.14388) 1525 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:31 smithi191 bash[24992]: audit 2024-08-31T02:46:29.671376+0000 mgr.a (mgr.14388) 1524 : audit [DBG] from='client.45726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:31 smithi191 bash[24992]: cluster 2024-08-31T02:46:30.052909+0000 mgr.a (mgr.14388) 1525 : cluster [DBG] pgmap v1056: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:33 smithi163 bash[24253]: cluster 2024-08-31T02:46:32.053669+0000 mgr.a (mgr.14388) 1526 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:33.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:33 smithi027 bash[22610]: cluster 2024-08-31T02:46:32.053669+0000 mgr.a (mgr.14388) 1526 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:33 smithi191 bash[24992]: cluster 2024-08-31T02:46:32.053669+0000 mgr.a (mgr.14388) 1526 : cluster [DBG] pgmap v1057: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:35.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:35.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:35.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:35 smithi163 bash[24253]: cluster 2024-08-31T02:46:34.055854+0000 mgr.a (mgr.14388) 1527 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:35.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:35 smithi027 bash[22610]: cluster 2024-08-31T02:46:34.055854+0000 mgr.a (mgr.14388) 1527 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:35 smithi191 bash[24992]: cluster 2024-08-31T02:46:34.055854+0000 mgr.a (mgr.14388) 1527 : cluster [DBG] pgmap v1058: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:35.844 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:37 smithi163 bash[24253]: audit 2024-08-31T02:46:35.414661+0000 mgr.a (mgr.14388) 1528 : audit [DBG] from='client.45804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:37 smithi163 bash[24253]: cluster 2024-08-31T02:46:36.056786+0000 mgr.a (mgr.14388) 1529 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:37.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:37 smithi027 bash[22610]: audit 2024-08-31T02:46:35.414661+0000 mgr.a (mgr.14388) 1528 : audit [DBG] from='client.45804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:37.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:37 smithi027 bash[22610]: cluster 2024-08-31T02:46:36.056786+0000 mgr.a (mgr.14388) 1529 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:37 smithi191 bash[24992]: audit 2024-08-31T02:46:35.414661+0000 mgr.a (mgr.14388) 1528 : audit [DBG] from='client.45804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:37 smithi191 bash[24992]: cluster 2024-08-31T02:46:36.056786+0000 mgr.a (mgr.14388) 1529 : cluster [DBG] pgmap v1059: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:39 smithi163 bash[24253]: cluster 2024-08-31T02:46:38.059136+0000 mgr.a (mgr.14388) 1530 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:39.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:39 smithi027 bash[22610]: cluster 2024-08-31T02:46:38.059136+0000 mgr.a (mgr.14388) 1530 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:39 smithi191 bash[24992]: cluster 2024-08-31T02:46:38.059136+0000 mgr.a (mgr.14388) 1530 : cluster [DBG] pgmap v1060: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:40.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:40.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:40.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:41 smithi163 bash[24253]: cluster 2024-08-31T02:46:40.060060+0000 mgr.a (mgr.14388) 1531 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:41.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:41 smithi027 bash[22610]: cluster 2024-08-31T02:46:40.060060+0000 mgr.a (mgr.14388) 1531 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:41 smithi191 bash[24992]: cluster 2024-08-31T02:46:40.060060+0000 mgr.a (mgr.14388) 1531 : cluster [DBG] pgmap v1061: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:41.581 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:41.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:41.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:41.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:41.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:42.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:42 smithi163 bash[24253]: audit 2024-08-31T02:46:41.178673+0000 mgr.a (mgr.14388) 1532 : audit [DBG] from='client.45882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:42.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:42 smithi027 bash[22610]: audit 2024-08-31T02:46:41.178673+0000 mgr.a (mgr.14388) 1532 : audit [DBG] from='client.45882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:42 smithi191 bash[24992]: audit 2024-08-31T02:46:41.178673+0000 mgr.a (mgr.14388) 1532 : audit [DBG] from='client.45882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:43 smithi163 bash[24253]: cluster 2024-08-31T02:46:42.060980+0000 mgr.a (mgr.14388) 1533 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:43.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:43 smithi027 bash[22610]: cluster 2024-08-31T02:46:42.060980+0000 mgr.a (mgr.14388) 1533 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:43 smithi191 bash[24992]: cluster 2024-08-31T02:46:42.060980+0000 mgr.a (mgr.14388) 1533 : cluster [DBG] pgmap v1062: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:45 smithi163 bash[24253]: cluster 2024-08-31T02:46:44.063173+0000 mgr.a (mgr.14388) 1534 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:45.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:45 smithi027 bash[22610]: cluster 2024-08-31T02:46:44.063173+0000 mgr.a (mgr.14388) 1534 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:45 smithi191 bash[24992]: cluster 2024-08-31T02:46:44.063173+0000 mgr.a (mgr.14388) 1534 : cluster [DBG] pgmap v1063: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:46.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:46.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:46.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:47.333 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:47.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:47.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:47.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:47.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:47 smithi163 bash[24253]: cluster 2024-08-31T02:46:46.063927+0000 mgr.a (mgr.14388) 1535 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:47.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:47 smithi027 bash[22610]: cluster 2024-08-31T02:46:46.063927+0000 mgr.a (mgr.14388) 1535 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:47 smithi191 bash[24992]: cluster 2024-08-31T02:46:46.063927+0000 mgr.a (mgr.14388) 1535 : cluster [DBG] pgmap v1064: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:48.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:48 smithi163 bash[24253]: audit 2024-08-31T02:46:46.919591+0000 mgr.a (mgr.14388) 1536 : audit [DBG] from='client.45960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:48.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:48 smithi027 bash[22610]: audit 2024-08-31T02:46:46.919591+0000 mgr.a (mgr.14388) 1536 : audit [DBG] from='client.45960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:48 smithi191 bash[24992]: audit 2024-08-31T02:46:46.919591+0000 mgr.a (mgr.14388) 1536 : audit [DBG] from='client.45960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:49 smithi027 bash[22610]: cluster 2024-08-31T02:46:48.066188+0000 mgr.a (mgr.14388) 1537 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:49 smithi191 bash[24992]: cluster 2024-08-31T02:46:48.066188+0000 mgr.a (mgr.14388) 1537 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:49 smithi163 bash[24253]: cluster 2024-08-31T02:46:48.066188+0000 mgr.a (mgr.14388) 1537 : cluster [DBG] pgmap v1065: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:46:51.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:51 smithi027 bash[22610]: cluster 2024-08-31T02:46:50.067016+0000 mgr.a (mgr.14388) 1538 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:51 smithi191 bash[24992]: cluster 2024-08-31T02:46:50.067016+0000 mgr.a (mgr.14388) 1538 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:51 smithi163 bash[24253]: cluster 2024-08-31T02:46:50.067016+0000 mgr.a (mgr.14388) 1538 : cluster [DBG] pgmap v1066: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:52.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:52.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:52.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:53.077 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:53.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:53.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:53.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:53.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:53.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:53 smithi027 bash[22610]: cluster 2024-08-31T02:46:52.067774+0000 mgr.a (mgr.14388) 1539 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:53 smithi191 bash[24992]: cluster 2024-08-31T02:46:52.067774+0000 mgr.a (mgr.14388) 1539 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:53 smithi163 bash[24253]: cluster 2024-08-31T02:46:52.067774+0000 mgr.a (mgr.14388) 1539 : cluster [DBG] pgmap v1067: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:54.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:54 smithi027 bash[22610]: audit 2024-08-31T02:46:52.667235+0000 mgr.a (mgr.14388) 1540 : audit [DBG] from='client.46035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:54 smithi191 bash[24992]: audit 2024-08-31T02:46:52.667235+0000 mgr.a (mgr.14388) 1540 : audit [DBG] from='client.46035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:54.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:54 smithi163 bash[24253]: audit 2024-08-31T02:46:52.667235+0000 mgr.a (mgr.14388) 1540 : audit [DBG] from='client.46035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:46:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:55 smithi027 bash[22610]: cluster 2024-08-31T02:46:54.070117+0000 mgr.a (mgr.14388) 1541 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:46:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:55 smithi191 bash[24992]: cluster 2024-08-31T02:46:54.070117+0000 mgr.a (mgr.14388) 1541 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:46:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:55 smithi163 bash[24253]: cluster 2024-08-31T02:46:54.070117+0000 mgr.a (mgr.14388) 1541 : cluster [DBG] pgmap v1068: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:46:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:56 smithi191 bash[24992]: cluster 2024-08-31T02:46:56.070926+0000 mgr.a (mgr.14388) 1542 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:46:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:56 smithi163 bash[24253]: cluster 2024-08-31T02:46:56.070926+0000 mgr.a (mgr.14388) 1542 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:46:56.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:56 smithi027 bash[22610]: cluster 2024-08-31T02:46:56.070926+0000 mgr.a (mgr.14388) 1542 : cluster [DBG] pgmap v1069: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:46:58.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:46:58.079 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:46:58.079 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:46:58.855 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:46:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:46:58.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:46:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:46:58.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:46:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:59 smithi163 bash[24253]: cluster 2024-08-31T02:46:58.072737+0000 mgr.a (mgr.14388) 1543 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:46:59 smithi163 bash[24253]: audit 2024-08-31T02:46:59.121961+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:46:59.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:59 smithi027 bash[22610]: cluster 2024-08-31T02:46:58.072737+0000 mgr.a (mgr.14388) 1543 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:59.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:46:59 smithi027 bash[22610]: audit 2024-08-31T02:46:59.121961+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:46:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:59 smithi191 bash[24992]: cluster 2024-08-31T02:46:58.072737+0000 mgr.a (mgr.14388) 1543 : cluster [DBG] pgmap v1070: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:46:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:46:59 smithi191 bash[24992]: audit 2024-08-31T02:46:59.121961+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:47:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:00 smithi163 bash[24253]: audit 2024-08-31T02:46:58.418403+0000 mgr.a (mgr.14388) 1544 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:00 smithi163 bash[24253]: audit 2024-08-31T02:46:59.939519+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:47:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:00 smithi163 bash[24253]: audit 2024-08-31T02:46:59.941022+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:47:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:00 smithi163 bash[24253]: audit 2024-08-31T02:46:59.949419+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:47:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:00 smithi163 bash[24253]: audit 2024-08-31T02:46:59.952610+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:47:00.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:00 smithi027 bash[22610]: audit 2024-08-31T02:46:58.418403+0000 mgr.a (mgr.14388) 1544 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:00.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:00 smithi027 bash[22610]: audit 2024-08-31T02:46:59.939519+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:47:00.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:00 smithi027 bash[22610]: audit 2024-08-31T02:46:59.941022+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:47:00.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:00 smithi027 bash[22610]: audit 2024-08-31T02:46:59.949419+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:47:00.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:00 smithi027 bash[22610]: audit 2024-08-31T02:46:59.952610+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:47:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:00 smithi191 bash[24992]: audit 2024-08-31T02:46:58.418403+0000 mgr.a (mgr.14388) 1544 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:00 smithi191 bash[24992]: audit 2024-08-31T02:46:59.939519+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:47:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:00 smithi191 bash[24992]: audit 2024-08-31T02:46:59.941022+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:47:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:00 smithi191 bash[24992]: audit 2024-08-31T02:46:59.949419+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:47:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:00 smithi191 bash[24992]: audit 2024-08-31T02:46:59.952610+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:47:00.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:47:00 smithi027 bash[22863]: debug 2024-08-31T02:47:00.691+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:47:00.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:47:00 smithi027 bash[22863]: debug 2024-08-31T02:47:00.695+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:47:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:01 smithi163 bash[24253]: audit 2024-08-31T02:46:59.954960+0000 mgr.a (mgr.14388) 1545 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:47:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:01 smithi163 bash[24253]: cluster 2024-08-31T02:47:00.073206+0000 mgr.a (mgr.14388) 1546 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:47:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:01 smithi027 bash[22610]: audit 2024-08-31T02:46:59.954960+0000 mgr.a (mgr.14388) 1545 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:47:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:01 smithi027 bash[22610]: cluster 2024-08-31T02:47:00.073206+0000 mgr.a (mgr.14388) 1546 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:47:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:01 smithi191 bash[24992]: audit 2024-08-31T02:46:59.954960+0000 mgr.a (mgr.14388) 1545 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:47:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:01 smithi191 bash[24992]: cluster 2024-08-31T02:47:00.073206+0000 mgr.a (mgr.14388) 1546 : cluster [DBG] pgmap v1071: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:47:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:02 smithi163 bash[24253]: audit 2024-08-31T02:47:00.698074+0000 mgr.a (mgr.14388) 1547 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:47:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:02 smithi163 bash[24253]: cephadm 2024-08-31T02:47:00.699526+0000 mgr.a (mgr.14388) 1548 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:47:02.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:02 smithi027 bash[22610]: audit 2024-08-31T02:47:00.698074+0000 mgr.a (mgr.14388) 1547 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:47:02.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:02 smithi027 bash[22610]: cephadm 2024-08-31T02:47:00.699526+0000 mgr.a (mgr.14388) 1548 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:47:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:02 smithi191 bash[24992]: audit 2024-08-31T02:47:00.698074+0000 mgr.a (mgr.14388) 1547 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:47:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:02 smithi191 bash[24992]: cephadm 2024-08-31T02:47:00.699526+0000 mgr.a (mgr.14388) 1548 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:47:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:03 smithi163 bash[24253]: cluster 2024-08-31T02:47:02.074053+0000 mgr.a (mgr.14388) 1549 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:47:03.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:03 smithi027 bash[22610]: cluster 2024-08-31T02:47:02.074053+0000 mgr.a (mgr.14388) 1549 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:47:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:03 smithi191 bash[24992]: cluster 2024-08-31T02:47:02.074053+0000 mgr.a (mgr.14388) 1549 : cluster [DBG] pgmap v1072: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:47:03.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:47:03.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:47:03.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:47:04.603 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:47:04.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:47:04.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:47:04.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:47:04.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:47:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:05 smithi163 bash[24253]: cluster 2024-08-31T02:47:04.076220+0000 mgr.a (mgr.14388) 1550 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:05 smithi163 bash[24253]: audit 2024-08-31T02:47:04.196710+0000 mgr.a (mgr.14388) 1551 : audit [DBG] from='client.46296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:05.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:05 smithi027 bash[22610]: cluster 2024-08-31T02:47:04.076220+0000 mgr.a (mgr.14388) 1550 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:05.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:05 smithi027 bash[22610]: audit 2024-08-31T02:47:04.196710+0000 mgr.a (mgr.14388) 1551 : audit [DBG] from='client.46296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:05 smithi191 bash[24992]: cluster 2024-08-31T02:47:04.076220+0000 mgr.a (mgr.14388) 1550 : cluster [DBG] pgmap v1073: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:05 smithi191 bash[24992]: audit 2024-08-31T02:47:04.196710+0000 mgr.a (mgr.14388) 1551 : audit [DBG] from='client.46296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:07 smithi163 bash[24253]: cluster 2024-08-31T02:47:06.077121+0000 mgr.a (mgr.14388) 1552 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:47:07.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:07 smithi027 bash[22610]: cluster 2024-08-31T02:47:06.077121+0000 mgr.a (mgr.14388) 1552 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:47:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:07 smithi191 bash[24992]: cluster 2024-08-31T02:47:06.077121+0000 mgr.a (mgr.14388) 1552 : cluster [DBG] pgmap v1074: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:47:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:09 smithi163 bash[24253]: cluster 2024-08-31T02:47:08.079398+0000 mgr.a (mgr.14388) 1553 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:09 smithi027 bash[22610]: cluster 2024-08-31T02:47:08.079398+0000 mgr.a (mgr.14388) 1553 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:09 smithi191 bash[24992]: cluster 2024-08-31T02:47:08.079398+0000 mgr.a (mgr.14388) 1553 : cluster [DBG] pgmap v1075: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:09.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:47:09.605 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:47:09.605 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:47:10.370 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:47:10.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:47:10.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:47:10.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:47:10.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:47:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:11 smithi163 bash[24253]: audit 2024-08-31T02:47:09.951414+0000 mgr.a (mgr.14388) 1554 : audit [DBG] from='client.46374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:11 smithi163 bash[24253]: cluster 2024-08-31T02:47:10.079955+0000 mgr.a (mgr.14388) 1555 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:11.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:11 smithi027 bash[22610]: audit 2024-08-31T02:47:09.951414+0000 mgr.a (mgr.14388) 1554 : audit [DBG] from='client.46374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:11.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:11 smithi027 bash[22610]: cluster 2024-08-31T02:47:10.079955+0000 mgr.a (mgr.14388) 1555 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:11 smithi191 bash[24992]: audit 2024-08-31T02:47:09.951414+0000 mgr.a (mgr.14388) 1554 : audit [DBG] from='client.46374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:11 smithi191 bash[24992]: cluster 2024-08-31T02:47:10.079955+0000 mgr.a (mgr.14388) 1555 : cluster [DBG] pgmap v1076: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:13 smithi163 bash[24253]: cluster 2024-08-31T02:47:12.080815+0000 mgr.a (mgr.14388) 1556 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:13.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:13 smithi027 bash[22610]: cluster 2024-08-31T02:47:12.080815+0000 mgr.a (mgr.14388) 1556 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:13 smithi191 bash[24992]: cluster 2024-08-31T02:47:12.080815+0000 mgr.a (mgr.14388) 1556 : cluster [DBG] pgmap v1077: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:15.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:47:15.372 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:47:15.373 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:47:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:15 smithi163 bash[24253]: cluster 2024-08-31T02:47:14.083051+0000 mgr.a (mgr.14388) 1557 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:15.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:15 smithi027 bash[22610]: cluster 2024-08-31T02:47:14.083051+0000 mgr.a (mgr.14388) 1557 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:15 smithi191 bash[24992]: cluster 2024-08-31T02:47:14.083051+0000 mgr.a (mgr.14388) 1557 : cluster [DBG] pgmap v1078: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:47:16.152 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:47:16.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:47:16.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:47:16.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:47:16.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:47:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:17 smithi163 bash[24253]: audit 2024-08-31T02:47:15.713600+0000 mgr.a (mgr.14388) 1558 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:17 smithi163 bash[24253]: cluster 2024-08-31T02:47:16.083579+0000 mgr.a (mgr.14388) 1559 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:17.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:17 smithi027 bash[22610]: audit 2024-08-31T02:47:15.713600+0000 mgr.a (mgr.14388) 1558 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:17.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:17 smithi027 bash[22610]: cluster 2024-08-31T02:47:16.083579+0000 mgr.a (mgr.14388) 1559 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:17 smithi191 bash[24992]: audit 2024-08-31T02:47:15.713600+0000 mgr.a (mgr.14388) 1558 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:17 smithi191 bash[24992]: cluster 2024-08-31T02:47:16.083579+0000 mgr.a (mgr.14388) 1559 : cluster [DBG] pgmap v1079: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:19 smithi163 bash[24253]: cluster 2024-08-31T02:47:18.085660+0000 mgr.a (mgr.14388) 1560 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:19.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:19 smithi027 bash[22610]: cluster 2024-08-31T02:47:18.085660+0000 mgr.a (mgr.14388) 1560 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:19 smithi191 bash[24992]: cluster 2024-08-31T02:47:18.085660+0000 mgr.a (mgr.14388) 1560 : cluster [DBG] pgmap v1080: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:21.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:47:21.155 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:47:21.155 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:47:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:21 smithi163 bash[24253]: cluster 2024-08-31T02:47:20.086414+0000 mgr.a (mgr.14388) 1561 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:21.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:21 smithi027 bash[22610]: cluster 2024-08-31T02:47:20.086414+0000 mgr.a (mgr.14388) 1561 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:21 smithi191 bash[24992]: cluster 2024-08-31T02:47:20.086414+0000 mgr.a (mgr.14388) 1561 : cluster [DBG] pgmap v1081: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:21.889 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:47:21.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:47:21.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:47:21.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:47:21.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:47:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:23 smithi163 bash[24253]: audit 2024-08-31T02:47:21.488326+0000 mgr.a (mgr.14388) 1562 : audit [DBG] from='client.46524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:23 smithi163 bash[24253]: cluster 2024-08-31T02:47:22.087384+0000 mgr.a (mgr.14388) 1563 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:23.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:23 smithi027 bash[22610]: audit 2024-08-31T02:47:21.488326+0000 mgr.a (mgr.14388) 1562 : audit [DBG] from='client.46524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:23.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:23 smithi027 bash[22610]: cluster 2024-08-31T02:47:22.087384+0000 mgr.a (mgr.14388) 1563 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:23 smithi191 bash[24992]: audit 2024-08-31T02:47:21.488326+0000 mgr.a (mgr.14388) 1562 : audit [DBG] from='client.46524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:23 smithi191 bash[24992]: cluster 2024-08-31T02:47:22.087384+0000 mgr.a (mgr.14388) 1563 : cluster [DBG] pgmap v1082: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:25 smithi163 bash[24253]: cluster 2024-08-31T02:47:24.089743+0000 mgr.a (mgr.14388) 1564 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:25.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:25 smithi027 bash[22610]: cluster 2024-08-31T02:47:24.089743+0000 mgr.a (mgr.14388) 1564 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:25 smithi191 bash[24992]: cluster 2024-08-31T02:47:24.089743+0000 mgr.a (mgr.14388) 1564 : cluster [DBG] pgmap v1083: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:26.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:47:26.891 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:47:26.891 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:47:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:27 smithi163 bash[24253]: cluster 2024-08-31T02:47:26.090655+0000 mgr.a (mgr.14388) 1565 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:27.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:27 smithi027 bash[22610]: cluster 2024-08-31T02:47:26.090655+0000 mgr.a (mgr.14388) 1565 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:27 smithi191 bash[24992]: cluster 2024-08-31T02:47:26.090655+0000 mgr.a (mgr.14388) 1565 : cluster [DBG] pgmap v1084: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:27.657 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:47:27.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:47:27.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:47:27.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:47:27.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:47:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:29 smithi163 bash[24253]: audit 2024-08-31T02:47:27.229019+0000 mgr.a (mgr.14388) 1566 : audit [DBG] from='client.46599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:29 smithi163 bash[24253]: cluster 2024-08-31T02:47:28.092907+0000 mgr.a (mgr.14388) 1567 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:29.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:29 smithi027 bash[22610]: audit 2024-08-31T02:47:27.229019+0000 mgr.a (mgr.14388) 1566 : audit [DBG] from='client.46599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:29.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:29 smithi027 bash[22610]: cluster 2024-08-31T02:47:28.092907+0000 mgr.a (mgr.14388) 1567 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:29 smithi191 bash[24992]: audit 2024-08-31T02:47:27.229019+0000 mgr.a (mgr.14388) 1566 : audit [DBG] from='client.46599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:29 smithi191 bash[24992]: cluster 2024-08-31T02:47:28.092907+0000 mgr.a (mgr.14388) 1567 : cluster [DBG] pgmap v1085: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:31.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:31 smithi027 bash[22610]: cluster 2024-08-31T02:47:30.093654+0000 mgr.a (mgr.14388) 1568 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:31 smithi191 bash[24992]: cluster 2024-08-31T02:47:30.093654+0000 mgr.a (mgr.14388) 1568 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:31 smithi163 bash[24253]: cluster 2024-08-31T02:47:30.093654+0000 mgr.a (mgr.14388) 1568 : cluster [DBG] pgmap v1086: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:32.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:47:32.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:47:32.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:47:33.448 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:47:33.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:47:33.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:47:33.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:47:33.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:47:33.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:33 smithi027 bash[22610]: cluster 2024-08-31T02:47:32.094409+0000 mgr.a (mgr.14388) 1569 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:33 smithi191 bash[24992]: cluster 2024-08-31T02:47:32.094409+0000 mgr.a (mgr.14388) 1569 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:33 smithi163 bash[24253]: cluster 2024-08-31T02:47:32.094409+0000 mgr.a (mgr.14388) 1569 : cluster [DBG] pgmap v1087: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:34.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:34 smithi027 bash[22610]: audit 2024-08-31T02:47:33.005122+0000 mgr.a (mgr.14388) 1570 : audit [DBG] from='client.46668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:34 smithi191 bash[24992]: audit 2024-08-31T02:47:33.005122+0000 mgr.a (mgr.14388) 1570 : audit [DBG] from='client.46668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:34 smithi163 bash[24253]: audit 2024-08-31T02:47:33.005122+0000 mgr.a (mgr.14388) 1570 : audit [DBG] from='client.46668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:35.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:35 smithi027 bash[22610]: cluster 2024-08-31T02:47:34.097069+0000 mgr.a (mgr.14388) 1571 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:35 smithi191 bash[24992]: cluster 2024-08-31T02:47:34.097069+0000 mgr.a (mgr.14388) 1571 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:35 smithi163 bash[24253]: cluster 2024-08-31T02:47:34.097069+0000 mgr.a (mgr.14388) 1571 : cluster [DBG] pgmap v1088: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:37.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:37 smithi027 bash[22610]: cluster 2024-08-31T02:47:36.097884+0000 mgr.a (mgr.14388) 1572 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:47:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:37 smithi191 bash[24992]: cluster 2024-08-31T02:47:36.097884+0000 mgr.a (mgr.14388) 1572 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:47:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:37 smithi163 bash[24253]: cluster 2024-08-31T02:47:36.097884+0000 mgr.a (mgr.14388) 1572 : cluster [DBG] pgmap v1089: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:47:38.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:47:38.451 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:47:38.451 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:47:39.201 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:47:39.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:47:39.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:47:39.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:47:39.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:47:39.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:39 smithi027 bash[22610]: cluster 2024-08-31T02:47:38.099831+0000 mgr.a (mgr.14388) 1573 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:39 smithi191 bash[24992]: cluster 2024-08-31T02:47:38.099831+0000 mgr.a (mgr.14388) 1573 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:39 smithi163 bash[24253]: cluster 2024-08-31T02:47:38.099831+0000 mgr.a (mgr.14388) 1573 : cluster [DBG] pgmap v1090: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:40.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:40 smithi027 bash[22610]: audit 2024-08-31T02:47:38.783283+0000 mgr.a (mgr.14388) 1574 : audit [DBG] from='client.46746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:40 smithi191 bash[24992]: audit 2024-08-31T02:47:38.783283+0000 mgr.a (mgr.14388) 1574 : audit [DBG] from='client.46746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:40 smithi163 bash[24253]: audit 2024-08-31T02:47:38.783283+0000 mgr.a (mgr.14388) 1574 : audit [DBG] from='client.46746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:41.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:41 smithi027 bash[22610]: cluster 2024-08-31T02:47:40.100838+0000 mgr.a (mgr.14388) 1575 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:47:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:41 smithi191 bash[24992]: cluster 2024-08-31T02:47:40.100838+0000 mgr.a (mgr.14388) 1575 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:47:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:41 smithi163 bash[24253]: cluster 2024-08-31T02:47:40.100838+0000 mgr.a (mgr.14388) 1575 : cluster [DBG] pgmap v1091: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:47:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:42 smithi191 bash[24992]: cluster 2024-08-31T02:47:42.101611+0000 mgr.a (mgr.14388) 1576 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:47:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:42 smithi163 bash[24253]: cluster 2024-08-31T02:47:42.101611+0000 mgr.a (mgr.14388) 1576 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:47:42.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:42 smithi027 bash[22610]: cluster 2024-08-31T02:47:42.101611+0000 mgr.a (mgr.14388) 1576 : cluster [DBG] pgmap v1092: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:47:44.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:47:44.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:47:44.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:47:44.974 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:47:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:47:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:47:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:47:44.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:47:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:45 smithi163 bash[24253]: cluster 2024-08-31T02:47:44.103800+0000 mgr.a (mgr.14388) 1577 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:45.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:45 smithi027 bash[22610]: cluster 2024-08-31T02:47:44.103800+0000 mgr.a (mgr.14388) 1577 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:45 smithi191 bash[24992]: cluster 2024-08-31T02:47:44.103800+0000 mgr.a (mgr.14388) 1577 : cluster [DBG] pgmap v1093: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:46 smithi163 bash[24253]: audit 2024-08-31T02:47:44.539790+0000 mgr.a (mgr.14388) 1578 : audit [DBG] from='client.46821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:46.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:46 smithi027 bash[22610]: audit 2024-08-31T02:47:44.539790+0000 mgr.a (mgr.14388) 1578 : audit [DBG] from='client.46821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:46 smithi191 bash[24992]: audit 2024-08-31T02:47:44.539790+0000 mgr.a (mgr.14388) 1578 : audit [DBG] from='client.46821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:47 smithi163 bash[24253]: cluster 2024-08-31T02:47:46.104750+0000 mgr.a (mgr.14388) 1579 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:47.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:47 smithi027 bash[22610]: cluster 2024-08-31T02:47:46.104750+0000 mgr.a (mgr.14388) 1579 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:47 smithi191 bash[24992]: cluster 2024-08-31T02:47:46.104750+0000 mgr.a (mgr.14388) 1579 : cluster [DBG] pgmap v1094: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:49 smithi163 bash[24253]: cluster 2024-08-31T02:47:48.106936+0000 mgr.a (mgr.14388) 1580 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:49 smithi027 bash[22610]: cluster 2024-08-31T02:47:48.106936+0000 mgr.a (mgr.14388) 1580 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:49 smithi191 bash[24992]: cluster 2024-08-31T02:47:48.106936+0000 mgr.a (mgr.14388) 1580 : cluster [DBG] pgmap v1095: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:49.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:47:49.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:47:49.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:47:50.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:47:50.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:47:50.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:47:50.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:47:50.736 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:47:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:51 smithi163 bash[24253]: cluster 2024-08-31T02:47:50.107373+0000 mgr.a (mgr.14388) 1581 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:51.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:51 smithi027 bash[22610]: cluster 2024-08-31T02:47:50.107373+0000 mgr.a (mgr.14388) 1581 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:51 smithi191 bash[24992]: cluster 2024-08-31T02:47:50.107373+0000 mgr.a (mgr.14388) 1581 : cluster [DBG] pgmap v1096: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:52 smithi163 bash[24253]: audit 2024-08-31T02:47:50.316247+0000 mgr.a (mgr.14388) 1582 : audit [DBG] from='client.46893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:52.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:52 smithi027 bash[22610]: audit 2024-08-31T02:47:50.316247+0000 mgr.a (mgr.14388) 1582 : audit [DBG] from='client.46893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:52 smithi191 bash[24992]: audit 2024-08-31T02:47:50.316247+0000 mgr.a (mgr.14388) 1582 : audit [DBG] from='client.46893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:53 smithi163 bash[24253]: cluster 2024-08-31T02:47:52.108288+0000 mgr.a (mgr.14388) 1583 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:53.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:53 smithi027 bash[22610]: cluster 2024-08-31T02:47:52.108288+0000 mgr.a (mgr.14388) 1583 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:53 smithi191 bash[24992]: cluster 2024-08-31T02:47:52.108288+0000 mgr.a (mgr.14388) 1583 : cluster [DBG] pgmap v1097: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:55 smithi163 bash[24253]: cluster 2024-08-31T02:47:54.110550+0000 mgr.a (mgr.14388) 1584 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:55.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:55 smithi027 bash[22610]: cluster 2024-08-31T02:47:54.110550+0000 mgr.a (mgr.14388) 1584 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:55 smithi191 bash[24992]: cluster 2024-08-31T02:47:54.110550+0000 mgr.a (mgr.14388) 1584 : cluster [DBG] pgmap v1098: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:55.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:47:55.737 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:47:55.738 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:47:56.510 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:47:56.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:47:56.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:47:56.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:47:56.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:47:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:57 smithi163 bash[24253]: audit 2024-08-31T02:47:56.079157+0000 mgr.a (mgr.14388) 1585 : audit [DBG] from='client.46962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:57 smithi163 bash[24253]: cluster 2024-08-31T02:47:56.111592+0000 mgr.a (mgr.14388) 1586 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:57.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:57 smithi027 bash[22610]: audit 2024-08-31T02:47:56.079157+0000 mgr.a (mgr.14388) 1585 : audit [DBG] from='client.46962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:57.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:57 smithi027 bash[22610]: cluster 2024-08-31T02:47:56.111592+0000 mgr.a (mgr.14388) 1586 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:57 smithi191 bash[24992]: audit 2024-08-31T02:47:56.079157+0000 mgr.a (mgr.14388) 1585 : audit [DBG] from='client.46962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:47:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:57 smithi191 bash[24992]: cluster 2024-08-31T02:47:56.111592+0000 mgr.a (mgr.14388) 1586 : cluster [DBG] pgmap v1099: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:47:59.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:47:59 smithi027 bash[22610]: cluster 2024-08-31T02:47:58.113817+0000 mgr.a (mgr.14388) 1587 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:47:59 smithi191 bash[24992]: cluster 2024-08-31T02:47:58.113817+0000 mgr.a (mgr.14388) 1587 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:47:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:47:59 smithi163 bash[24253]: cluster 2024-08-31T02:47:58.113817+0000 mgr.a (mgr.14388) 1587 : cluster [DBG] pgmap v1100: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:01 smithi027 bash[22610]: cluster 2024-08-31T02:48:00.114589+0000 mgr.a (mgr.14388) 1588 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:01 smithi027 bash[22610]: audit 2024-08-31T02:48:00.761144+0000 mon.a (mon.0) 831 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:48:01.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:01.512 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:01.512 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:01 smithi191 bash[24992]: cluster 2024-08-31T02:48:00.114589+0000 mgr.a (mgr.14388) 1588 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:01 smithi191 bash[24992]: audit 2024-08-31T02:48:00.761144+0000 mon.a (mon.0) 831 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:48:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:01 smithi163 bash[24253]: cluster 2024-08-31T02:48:00.114589+0000 mgr.a (mgr.14388) 1588 : cluster [DBG] pgmap v1101: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:01 smithi163 bash[24253]: audit 2024-08-31T02:48:00.761144+0000 mon.a (mon.0) 831 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:48:02.245 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:02.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:02.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:02.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:02.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:48:02.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:02 smithi163 bash[24253]: audit 2024-08-31T02:48:01.394937+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:48:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:02 smithi163 bash[24253]: audit 2024-08-31T02:48:01.399402+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:48:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:02 smithi163 bash[24253]: audit 2024-08-31T02:48:01.835848+0000 mgr.a (mgr.14388) 1589 : audit [DBG] from='client.47034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:02 smithi163 bash[24253]: cluster 2024-08-31T02:48:02.115098+0000 mgr.a (mgr.14388) 1590 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:02 smithi163 bash[24253]: audit 2024-08-31T02:48:02.143547+0000 mon.a (mon.0) 834 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:48:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:02 smithi163 bash[24253]: audit 2024-08-31T02:48:02.144398+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:48:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:02 smithi163 bash[24253]: audit 2024-08-31T02:48:02.159033+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:48:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:02 smithi163 bash[24253]: audit 2024-08-31T02:48:02.161606+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:48:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:02 smithi163 bash[24253]: audit 2024-08-31T02:48:02.162793+0000 mgr.a (mgr.14388) 1591 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:48:02.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22610]: audit 2024-08-31T02:48:01.394937+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:48:02.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22610]: audit 2024-08-31T02:48:01.399402+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:48:02.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22610]: audit 2024-08-31T02:48:01.835848+0000 mgr.a (mgr.14388) 1589 : audit [DBG] from='client.47034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:02.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22610]: cluster 2024-08-31T02:48:02.115098+0000 mgr.a (mgr.14388) 1590 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:02.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22610]: audit 2024-08-31T02:48:02.143547+0000 mon.a (mon.0) 834 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:48:02.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22610]: audit 2024-08-31T02:48:02.144398+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:48:02.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22610]: audit 2024-08-31T02:48:02.159033+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:48:02.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22610]: audit 2024-08-31T02:48:02.161606+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:48:02.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22610]: audit 2024-08-31T02:48:02.162793+0000 mgr.a (mgr.14388) 1591 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:48:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:02 smithi191 bash[24992]: audit 2024-08-31T02:48:01.394937+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:48:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:02 smithi191 bash[24992]: audit 2024-08-31T02:48:01.399402+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:48:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:02 smithi191 bash[24992]: audit 2024-08-31T02:48:01.835848+0000 mgr.a (mgr.14388) 1589 : audit [DBG] from='client.47034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:02 smithi191 bash[24992]: cluster 2024-08-31T02:48:02.115098+0000 mgr.a (mgr.14388) 1590 : cluster [DBG] pgmap v1102: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:02 smithi191 bash[24992]: audit 2024-08-31T02:48:02.143547+0000 mon.a (mon.0) 834 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:48:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:02 smithi191 bash[24992]: audit 2024-08-31T02:48:02.144398+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:48:02.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:02 smithi191 bash[24992]: audit 2024-08-31T02:48:02.159033+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:48:02.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:02 smithi191 bash[24992]: audit 2024-08-31T02:48:02.161606+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:48:02.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:02 smithi191 bash[24992]: audit 2024-08-31T02:48:02.162793+0000 mgr.a (mgr.14388) 1591 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:48:03.230 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22863]: debug 2024-08-31T02:48:02.917+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:48:03.230 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:48:02 smithi027 bash[22863]: debug 2024-08-31T02:48:02.917+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:48:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:03 smithi163 bash[24253]: audit 2024-08-31T02:48:02.918742+0000 mgr.a (mgr.14388) 1592 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:48:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:03 smithi163 bash[24253]: cephadm 2024-08-31T02:48:02.920048+0000 mgr.a (mgr.14388) 1593 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:48:03.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:03 smithi027 bash[22610]: audit 2024-08-31T02:48:02.918742+0000 mgr.a (mgr.14388) 1592 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:48:03.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:03 smithi027 bash[22610]: cephadm 2024-08-31T02:48:02.920048+0000 mgr.a (mgr.14388) 1593 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:48:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:03 smithi191 bash[24992]: audit 2024-08-31T02:48:02.918742+0000 mgr.a (mgr.14388) 1592 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:48:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:03 smithi191 bash[24992]: cephadm 2024-08-31T02:48:02.920048+0000 mgr.a (mgr.14388) 1593 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:48:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:04 smithi163 bash[24253]: cluster 2024-08-31T02:48:04.117369+0000 mgr.a (mgr.14388) 1594 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T02:48:04.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:04 smithi027 bash[22610]: cluster 2024-08-31T02:48:04.117369+0000 mgr.a (mgr.14388) 1594 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T02:48:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:04 smithi191 bash[24992]: cluster 2024-08-31T02:48:04.117369+0000 mgr.a (mgr.14388) 1594 : cluster [DBG] pgmap v1103: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T02:48:07.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:07.247 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:07.247 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:07 smithi163 bash[24253]: cluster 2024-08-31T02:48:06.118176+0000 mgr.a (mgr.14388) 1595 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T02:48:07.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:07 smithi027 bash[22610]: cluster 2024-08-31T02:48:06.118176+0000 mgr.a (mgr.14388) 1595 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T02:48:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:07 smithi191 bash[24992]: cluster 2024-08-31T02:48:06.118176+0000 mgr.a (mgr.14388) 1595 : cluster [DBG] pgmap v1104: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T02:48:08.019 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:08.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:48:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:09 smithi163 bash[24253]: audit 2024-08-31T02:48:07.589090+0000 mgr.a (mgr.14388) 1596 : audit [DBG] from='client.47214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:09 smithi163 bash[24253]: cluster 2024-08-31T02:48:08.120656+0000 mgr.a (mgr.14388) 1597 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:48:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:09 smithi027 bash[22610]: audit 2024-08-31T02:48:07.589090+0000 mgr.a (mgr.14388) 1596 : audit [DBG] from='client.47214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:09 smithi027 bash[22610]: cluster 2024-08-31T02:48:08.120656+0000 mgr.a (mgr.14388) 1597 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:48:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:09 smithi191 bash[24992]: audit 2024-08-31T02:48:07.589090+0000 mgr.a (mgr.14388) 1596 : audit [DBG] from='client.47214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:09 smithi191 bash[24992]: cluster 2024-08-31T02:48:08.120656+0000 mgr.a (mgr.14388) 1597 : cluster [DBG] pgmap v1105: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:48:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:11 smithi163 bash[24253]: cluster 2024-08-31T02:48:10.121516+0000 mgr.a (mgr.14388) 1598 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:48:11.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:11 smithi027 bash[22610]: cluster 2024-08-31T02:48:10.121516+0000 mgr.a (mgr.14388) 1598 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:48:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:11 smithi191 bash[24992]: cluster 2024-08-31T02:48:10.121516+0000 mgr.a (mgr.14388) 1598 : cluster [DBG] pgmap v1106: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:48:13.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:13.022 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:13.022 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:13 smithi163 bash[24253]: cluster 2024-08-31T02:48:12.122288+0000 mgr.a (mgr.14388) 1599 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:48:13.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:13 smithi027 bash[22610]: cluster 2024-08-31T02:48:12.122288+0000 mgr.a (mgr.14388) 1599 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:48:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:13 smithi191 bash[24992]: cluster 2024-08-31T02:48:12.122288+0000 mgr.a (mgr.14388) 1599 : cluster [DBG] pgmap v1107: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:48:13.767 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:13.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:48:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:15 smithi163 bash[24253]: audit 2024-08-31T02:48:13.355310+0000 mgr.a (mgr.14388) 1600 : audit [DBG] from='client.47292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:15 smithi163 bash[24253]: cluster 2024-08-31T02:48:14.125123+0000 mgr.a (mgr.14388) 1601 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:48:15.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:15 smithi027 bash[22610]: audit 2024-08-31T02:48:13.355310+0000 mgr.a (mgr.14388) 1600 : audit [DBG] from='client.47292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:15.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:15 smithi027 bash[22610]: cluster 2024-08-31T02:48:14.125123+0000 mgr.a (mgr.14388) 1601 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:48:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:15 smithi191 bash[24992]: audit 2024-08-31T02:48:13.355310+0000 mgr.a (mgr.14388) 1600 : audit [DBG] from='client.47292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:15 smithi191 bash[24992]: cluster 2024-08-31T02:48:14.125123+0000 mgr.a (mgr.14388) 1601 : cluster [DBG] pgmap v1108: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:48:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:17 smithi163 bash[24253]: cluster 2024-08-31T02:48:16.125982+0000 mgr.a (mgr.14388) 1602 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 170 B/s wr, 1 op/s 2024-08-31T02:48:17.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:17 smithi027 bash[22610]: cluster 2024-08-31T02:48:16.125982+0000 mgr.a (mgr.14388) 1602 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 170 B/s wr, 1 op/s 2024-08-31T02:48:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:17 smithi191 bash[24992]: cluster 2024-08-31T02:48:16.125982+0000 mgr.a (mgr.14388) 1602 : cluster [DBG] pgmap v1109: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 170 B/s wr, 1 op/s 2024-08-31T02:48:18.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:18.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:18.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:19 smithi163 bash[24253]: cluster 2024-08-31T02:48:18.127902+0000 mgr.a (mgr.14388) 1603 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T02:48:19.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:19 smithi027 bash[22610]: cluster 2024-08-31T02:48:18.127902+0000 mgr.a (mgr.14388) 1603 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T02:48:19.504 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:19.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:19.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:19.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:19.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:48:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:19 smithi191 bash[24992]: cluster 2024-08-31T02:48:18.127902+0000 mgr.a (mgr.14388) 1603 : cluster [DBG] pgmap v1110: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T02:48:20.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:20 smithi027 bash[22610]: audit 2024-08-31T02:48:19.105719+0000 mgr.a (mgr.14388) 1604 : audit [DBG] from='client.47367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:20 smithi191 bash[24992]: audit 2024-08-31T02:48:19.105719+0000 mgr.a (mgr.14388) 1604 : audit [DBG] from='client.47367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:20 smithi163 bash[24253]: audit 2024-08-31T02:48:19.105719+0000 mgr.a (mgr.14388) 1604 : audit [DBG] from='client.47367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:21.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:21 smithi027 bash[22610]: cluster 2024-08-31T02:48:20.128959+0000 mgr.a (mgr.14388) 1605 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:48:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:21 smithi191 bash[24992]: cluster 2024-08-31T02:48:20.128959+0000 mgr.a (mgr.14388) 1605 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:48:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:21 smithi163 bash[24253]: cluster 2024-08-31T02:48:20.128959+0000 mgr.a (mgr.14388) 1605 : cluster [DBG] pgmap v1111: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:48:23.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:23 smithi027 bash[22610]: cluster 2024-08-31T02:48:22.129799+0000 mgr.a (mgr.14388) 1606 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:48:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:23 smithi191 bash[24992]: cluster 2024-08-31T02:48:22.129799+0000 mgr.a (mgr.14388) 1606 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:48:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:23 smithi163 bash[24253]: cluster 2024-08-31T02:48:22.129799+0000 mgr.a (mgr.14388) 1606 : cluster [DBG] pgmap v1112: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T02:48:24.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:24.506 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:25.266 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:48:25.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:25 smithi027 bash[22610]: cluster 2024-08-31T02:48:24.131997+0000 mgr.a (mgr.14388) 1607 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:48:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:25 smithi191 bash[24992]: cluster 2024-08-31T02:48:24.131997+0000 mgr.a (mgr.14388) 1607 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:48:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:25 smithi163 bash[24253]: cluster 2024-08-31T02:48:24.131997+0000 mgr.a (mgr.14388) 1607 : cluster [DBG] pgmap v1113: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T02:48:26.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:26 smithi027 bash[22610]: audit 2024-08-31T02:48:24.843728+0000 mgr.a (mgr.14388) 1608 : audit [DBG] from='client.47445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:26 smithi191 bash[24992]: audit 2024-08-31T02:48:24.843728+0000 mgr.a (mgr.14388) 1608 : audit [DBG] from='client.47445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:26 smithi163 bash[24253]: audit 2024-08-31T02:48:24.843728+0000 mgr.a (mgr.14388) 1608 : audit [DBG] from='client.47445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:27.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:27 smithi027 bash[22610]: cluster 2024-08-31T02:48:26.132946+0000 mgr.a (mgr.14388) 1609 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:27 smithi191 bash[24992]: cluster 2024-08-31T02:48:26.132946+0000 mgr.a (mgr.14388) 1609 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:27 smithi163 bash[24253]: cluster 2024-08-31T02:48:26.132946+0000 mgr.a (mgr.14388) 1609 : cluster [DBG] pgmap v1114: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:29 smithi191 bash[24992]: cluster 2024-08-31T02:48:28.135113+0000 mgr.a (mgr.14388) 1610 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:29 smithi163 bash[24253]: cluster 2024-08-31T02:48:28.135113+0000 mgr.a (mgr.14388) 1610 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:29.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:29 smithi027 bash[22610]: cluster 2024-08-31T02:48:28.135113+0000 mgr.a (mgr.14388) 1610 : cluster [DBG] pgmap v1115: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:30.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:30.269 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:30.269 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:31.040 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:31.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:31.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:31.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:31.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:48:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:31 smithi191 bash[24992]: cluster 2024-08-31T02:48:30.135825+0000 mgr.a (mgr.14388) 1611 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:31 smithi163 bash[24253]: cluster 2024-08-31T02:48:30.135825+0000 mgr.a (mgr.14388) 1611 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:31.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:31 smithi027 bash[22610]: cluster 2024-08-31T02:48:30.135825+0000 mgr.a (mgr.14388) 1611 : cluster [DBG] pgmap v1116: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:32 smithi191 bash[24992]: audit 2024-08-31T02:48:30.607542+0000 mgr.a (mgr.14388) 1612 : audit [DBG] from='client.47520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:32 smithi191 bash[24992]: cluster 2024-08-31T02:48:32.136761+0000 mgr.a (mgr.14388) 1613 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:32 smithi163 bash[24253]: audit 2024-08-31T02:48:30.607542+0000 mgr.a (mgr.14388) 1612 : audit [DBG] from='client.47520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:32 smithi163 bash[24253]: cluster 2024-08-31T02:48:32.136761+0000 mgr.a (mgr.14388) 1613 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:32.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:32 smithi027 bash[22610]: audit 2024-08-31T02:48:30.607542+0000 mgr.a (mgr.14388) 1612 : audit [DBG] from='client.47520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:32.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:32 smithi027 bash[22610]: cluster 2024-08-31T02:48:32.136761+0000 mgr.a (mgr.14388) 1613 : cluster [DBG] pgmap v1117: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:35 smithi163 bash[24253]: cluster 2024-08-31T02:48:34.138998+0000 mgr.a (mgr.14388) 1614 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:35.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:35 smithi027 bash[22610]: cluster 2024-08-31T02:48:34.138998+0000 mgr.a (mgr.14388) 1614 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:35 smithi191 bash[24992]: cluster 2024-08-31T02:48:34.138998+0000 mgr.a (mgr.14388) 1614 : cluster [DBG] pgmap v1118: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:36.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:36.043 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:36.043 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:36.823 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:36.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:36.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:36.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:36.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:48:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:37 smithi163 bash[24253]: cluster 2024-08-31T02:48:36.139768+0000 mgr.a (mgr.14388) 1615 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:37.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:37 smithi027 bash[22610]: cluster 2024-08-31T02:48:36.139768+0000 mgr.a (mgr.14388) 1615 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:37 smithi191 bash[24992]: cluster 2024-08-31T02:48:36.139768+0000 mgr.a (mgr.14388) 1615 : cluster [DBG] pgmap v1119: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:38.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:38 smithi027 bash[22610]: audit 2024-08-31T02:48:36.384151+0000 mgr.a (mgr.14388) 1616 : audit [DBG] from='client.47595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:38.575 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:38 smithi191 bash[24992]: audit 2024-08-31T02:48:36.384151+0000 mgr.a (mgr.14388) 1616 : audit [DBG] from='client.47595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:38 smithi163 bash[24253]: audit 2024-08-31T02:48:36.384151+0000 mgr.a (mgr.14388) 1616 : audit [DBG] from='client.47595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:39.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:39 smithi027 bash[22610]: cluster 2024-08-31T02:48:38.142110+0000 mgr.a (mgr.14388) 1617 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:39 smithi191 bash[24992]: cluster 2024-08-31T02:48:38.142110+0000 mgr.a (mgr.14388) 1617 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:39 smithi163 bash[24253]: cluster 2024-08-31T02:48:38.142110+0000 mgr.a (mgr.14388) 1617 : cluster [DBG] pgmap v1120: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:41.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:41 smithi027 bash[22610]: cluster 2024-08-31T02:48:40.142946+0000 mgr.a (mgr.14388) 1618 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:41 smithi191 bash[24992]: cluster 2024-08-31T02:48:40.142946+0000 mgr.a (mgr.14388) 1618 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:41 smithi163 bash[24253]: cluster 2024-08-31T02:48:40.142946+0000 mgr.a (mgr.14388) 1618 : cluster [DBG] pgmap v1121: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:41.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:41.825 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:41.825 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:48:42.570 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:43.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:43 smithi027 bash[22610]: cluster 2024-08-31T02:48:42.143694+0000 mgr.a (mgr.14388) 1619 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:43.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:43 smithi027 bash[22610]: audit 2024-08-31T02:48:42.159359+0000 mgr.a (mgr.14388) 1620 : audit [DBG] from='client.47673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:43 smithi191 bash[24992]: cluster 2024-08-31T02:48:42.143694+0000 mgr.a (mgr.14388) 1619 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:43 smithi191 bash[24992]: audit 2024-08-31T02:48:42.159359+0000 mgr.a (mgr.14388) 1620 : audit [DBG] from='client.47673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:43 smithi163 bash[24253]: cluster 2024-08-31T02:48:42.143694+0000 mgr.a (mgr.14388) 1619 : cluster [DBG] pgmap v1122: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:43 smithi163 bash[24253]: audit 2024-08-31T02:48:42.159359+0000 mgr.a (mgr.14388) 1620 : audit [DBG] from='client.47673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:45.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:45 smithi027 bash[22610]: cluster 2024-08-31T02:48:44.146056+0000 mgr.a (mgr.14388) 1621 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:45 smithi191 bash[24992]: cluster 2024-08-31T02:48:44.146056+0000 mgr.a (mgr.14388) 1621 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:45 smithi163 bash[24253]: cluster 2024-08-31T02:48:44.146056+0000 mgr.a (mgr.14388) 1621 : cluster [DBG] pgmap v1123: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:48:47.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:47 smithi027 bash[22610]: cluster 2024-08-31T02:48:46.146861+0000 mgr.a (mgr.14388) 1622 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:47 smithi191 bash[24992]: cluster 2024-08-31T02:48:46.146861+0000 mgr.a (mgr.14388) 1622 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:47.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:47.572 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:47.572 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:47 smithi163 bash[24253]: cluster 2024-08-31T02:48:46.146861+0000 mgr.a (mgr.14388) 1622 : cluster [DBG] pgmap v1124: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:48.349 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:48.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:48.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:48.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:48.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:48:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:49 smithi027 bash[22610]: audit 2024-08-31T02:48:47.915053+0000 mgr.a (mgr.14388) 1623 : audit [DBG] from='client.47751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:49.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:49 smithi027 bash[22610]: cluster 2024-08-31T02:48:48.152511+0000 mgr.a (mgr.14388) 1624 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:49 smithi191 bash[24992]: audit 2024-08-31T02:48:47.915053+0000 mgr.a (mgr.14388) 1623 : audit [DBG] from='client.47751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:49 smithi191 bash[24992]: cluster 2024-08-31T02:48:48.152511+0000 mgr.a (mgr.14388) 1624 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:49 smithi163 bash[24253]: audit 2024-08-31T02:48:47.915053+0000 mgr.a (mgr.14388) 1623 : audit [DBG] from='client.47751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:49 smithi163 bash[24253]: cluster 2024-08-31T02:48:48.152511+0000 mgr.a (mgr.14388) 1624 : cluster [DBG] pgmap v1125: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:51 smithi191 bash[24992]: cluster 2024-08-31T02:48:50.153431+0000 mgr.a (mgr.14388) 1625 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:48:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:51 smithi163 bash[24253]: cluster 2024-08-31T02:48:50.153431+0000 mgr.a (mgr.14388) 1625 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:48:51.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:51 smithi027 bash[22610]: cluster 2024-08-31T02:48:50.153431+0000 mgr.a (mgr.14388) 1625 : cluster [DBG] pgmap v1126: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:48:53.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:53.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:53.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:53 smithi191 bash[24992]: cluster 2024-08-31T02:48:52.154253+0000 mgr.a (mgr.14388) 1626 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:48:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:53 smithi163 bash[24253]: cluster 2024-08-31T02:48:52.154253+0000 mgr.a (mgr.14388) 1626 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:48:53.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:53 smithi027 bash[22610]: cluster 2024-08-31T02:48:52.154253+0000 mgr.a (mgr.14388) 1626 : cluster [DBG] pgmap v1127: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:48:54.126 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:54.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:54.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:54.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:54.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:48:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:55 smithi191 bash[24992]: audit 2024-08-31T02:48:53.692147+0000 mgr.a (mgr.14388) 1627 : audit [DBG] from='client.47826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:55 smithi191 bash[24992]: cluster 2024-08-31T02:48:54.155656+0000 mgr.a (mgr.14388) 1628 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:55 smithi163 bash[24253]: audit 2024-08-31T02:48:53.692147+0000 mgr.a (mgr.14388) 1627 : audit [DBG] from='client.47826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:55 smithi163 bash[24253]: cluster 2024-08-31T02:48:54.155656+0000 mgr.a (mgr.14388) 1628 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:55.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:55 smithi027 bash[22610]: audit 2024-08-31T02:48:53.692147+0000 mgr.a (mgr.14388) 1627 : audit [DBG] from='client.47826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:48:55.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:55 smithi027 bash[22610]: cluster 2024-08-31T02:48:54.155656+0000 mgr.a (mgr.14388) 1628 : cluster [DBG] pgmap v1128: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:56 smithi163 bash[24253]: cluster 2024-08-31T02:48:56.156392+0000 mgr.a (mgr.14388) 1629 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:48:56.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:56 smithi027 bash[22610]: cluster 2024-08-31T02:48:56.156392+0000 mgr.a (mgr.14388) 1629 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:48:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:56 smithi191 bash[24992]: cluster 2024-08-31T02:48:56.156392+0000 mgr.a (mgr.14388) 1629 : cluster [DBG] pgmap v1129: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:48:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:48:59.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:48:59.129 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:48:59.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:48:59 smithi027 bash[22610]: cluster 2024-08-31T02:48:58.158284+0000 mgr.a (mgr.14388) 1630 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:48:59 smithi191 bash[24992]: cluster 2024-08-31T02:48:58.158284+0000 mgr.a (mgr.14388) 1630 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:48:59 smithi163 bash[24253]: cluster 2024-08-31T02:48:58.158284+0000 mgr.a (mgr.14388) 1630 : cluster [DBG] pgmap v1130: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:48:59.898 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:48:59.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:48:59.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:48:59.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:48:59.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:01 smithi027 bash[22610]: audit 2024-08-31T02:48:59.464324+0000 mgr.a (mgr.14388) 1631 : audit [DBG] from='client.47904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:01 smithi027 bash[22610]: cluster 2024-08-31T02:49:00.159419+0000 mgr.a (mgr.14388) 1632 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:01 smithi191 bash[24992]: audit 2024-08-31T02:48:59.464324+0000 mgr.a (mgr.14388) 1631 : audit [DBG] from='client.47904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:01 smithi191 bash[24992]: cluster 2024-08-31T02:49:00.159419+0000 mgr.a (mgr.14388) 1632 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:01 smithi163 bash[24253]: audit 2024-08-31T02:48:59.464324+0000 mgr.a (mgr.14388) 1631 : audit [DBG] from='client.47904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:01 smithi163 bash[24253]: cluster 2024-08-31T02:49:00.159419+0000 mgr.a (mgr.14388) 1632 : cluster [DBG] pgmap v1131: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:03.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:03 smithi027 bash[22610]: cluster 2024-08-31T02:49:02.160263+0000 mgr.a (mgr.14388) 1633 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:03.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:03 smithi027 bash[22610]: audit 2024-08-31T02:49:02.974528+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:49:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:03 smithi191 bash[24992]: cluster 2024-08-31T02:49:02.160263+0000 mgr.a (mgr.14388) 1633 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:03 smithi191 bash[24992]: audit 2024-08-31T02:49:02.974528+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:49:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:03 smithi163 bash[24253]: cluster 2024-08-31T02:49:02.160263+0000 mgr.a (mgr.14388) 1633 : cluster [DBG] pgmap v1132: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:03 smithi163 bash[24253]: audit 2024-08-31T02:49:02.974528+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:49:04.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:49:04.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:49:04.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:49:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:04 smithi163 bash[24253]: audit 2024-08-31T02:49:03.614193+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:04 smithi163 bash[24253]: audit 2024-08-31T02:49:03.619485+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:04 smithi163 bash[24253]: audit 2024-08-31T02:49:03.624720+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:04 smithi163 bash[24253]: audit 2024-08-31T02:49:03.630121+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:04 smithi163 bash[24253]: cluster 2024-08-31T02:49:04.162550+0000 mgr.a (mgr.14388) 1634 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:04 smithi163 bash[24253]: audit 2024-08-31T02:49:04.416527+0000 mon.a (mon.0) 843 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:49:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:04 smithi163 bash[24253]: audit 2024-08-31T02:49:04.418257+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:49:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:04 smithi163 bash[24253]: audit 2024-08-31T02:49:04.427365+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:04 smithi163 bash[24253]: audit 2024-08-31T02:49:04.432166+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:49:04.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:04 smithi027 bash[22610]: audit 2024-08-31T02:49:03.614193+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:04.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:04 smithi027 bash[22610]: audit 2024-08-31T02:49:03.619485+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:04.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:04 smithi027 bash[22610]: audit 2024-08-31T02:49:03.624720+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:04.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:04 smithi027 bash[22610]: audit 2024-08-31T02:49:03.630121+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:04.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:04 smithi027 bash[22610]: cluster 2024-08-31T02:49:04.162550+0000 mgr.a (mgr.14388) 1634 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:04.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:04 smithi027 bash[22610]: audit 2024-08-31T02:49:04.416527+0000 mon.a (mon.0) 843 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:49:04.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:04 smithi027 bash[22610]: audit 2024-08-31T02:49:04.418257+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:49:04.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:04 smithi027 bash[22610]: audit 2024-08-31T02:49:04.427365+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:04.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:04 smithi027 bash[22610]: audit 2024-08-31T02:49:04.432166+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:49:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:04 smithi191 bash[24992]: audit 2024-08-31T02:49:03.614193+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:04 smithi191 bash[24992]: audit 2024-08-31T02:49:03.619485+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:04 smithi191 bash[24992]: audit 2024-08-31T02:49:03.624720+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:04 smithi191 bash[24992]: audit 2024-08-31T02:49:03.630121+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:04 smithi191 bash[24992]: cluster 2024-08-31T02:49:04.162550+0000 mgr.a (mgr.14388) 1634 : cluster [DBG] pgmap v1133: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:04 smithi191 bash[24992]: audit 2024-08-31T02:49:04.416527+0000 mon.a (mon.0) 843 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:49:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:04 smithi191 bash[24992]: audit 2024-08-31T02:49:04.418257+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:49:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:04 smithi191 bash[24992]: audit 2024-08-31T02:49:04.427365+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:49:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:04 smithi191 bash[24992]: audit 2024-08-31T02:49:04.432166+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:49:05.480 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:49:05 smithi027 bash[22863]: debug 2024-08-31T02:49:05.176+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:49:05.480 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:49:05 smithi027 bash[22863]: debug 2024-08-31T02:49:05.180+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:49:05.647 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:49:05.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:49:05.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:49:05.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:49:05.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:05 smithi163 bash[24253]: audit 2024-08-31T02:49:04.434421+0000 mgr.a (mgr.14388) 1635 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:49:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:05 smithi163 bash[24253]: audit 2024-08-31T02:49:05.182384+0000 mgr.a (mgr.14388) 1636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:49:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:05 smithi163 bash[24253]: cephadm 2024-08-31T02:49:05.183626+0000 mgr.a (mgr.14388) 1637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:49:05.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:05 smithi027 bash[22610]: audit 2024-08-31T02:49:04.434421+0000 mgr.a (mgr.14388) 1635 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:49:05.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:05 smithi027 bash[22610]: audit 2024-08-31T02:49:05.182384+0000 mgr.a (mgr.14388) 1636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:49:05.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:05 smithi027 bash[22610]: cephadm 2024-08-31T02:49:05.183626+0000 mgr.a (mgr.14388) 1637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:49:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:05 smithi191 bash[24992]: audit 2024-08-31T02:49:04.434421+0000 mgr.a (mgr.14388) 1635 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:49:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:05 smithi191 bash[24992]: audit 2024-08-31T02:49:05.182384+0000 mgr.a (mgr.14388) 1636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:49:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:05 smithi191 bash[24992]: cephadm 2024-08-31T02:49:05.183626+0000 mgr.a (mgr.14388) 1637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:49:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:06 smithi163 bash[24253]: audit 2024-08-31T02:49:05.248820+0000 mgr.a (mgr.14388) 1638 : audit [DBG] from='client.48072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:06 smithi163 bash[24253]: cluster 2024-08-31T02:49:06.163588+0000 mgr.a (mgr.14388) 1639 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:06.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:06 smithi027 bash[22610]: audit 2024-08-31T02:49:05.248820+0000 mgr.a (mgr.14388) 1638 : audit [DBG] from='client.48072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:06.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:06 smithi027 bash[22610]: cluster 2024-08-31T02:49:06.163588+0000 mgr.a (mgr.14388) 1639 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:06 smithi191 bash[24992]: audit 2024-08-31T02:49:05.248820+0000 mgr.a (mgr.14388) 1638 : audit [DBG] from='client.48072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:06 smithi191 bash[24992]: cluster 2024-08-31T02:49:06.163588+0000 mgr.a (mgr.14388) 1639 : cluster [DBG] pgmap v1134: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:09.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:09 smithi027 bash[22610]: cluster 2024-08-31T02:49:08.165728+0000 mgr.a (mgr.14388) 1640 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:09 smithi191 bash[24992]: cluster 2024-08-31T02:49:08.165728+0000 mgr.a (mgr.14388) 1640 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:09 smithi163 bash[24253]: cluster 2024-08-31T02:49:08.165728+0000 mgr.a (mgr.14388) 1640 : cluster [DBG] pgmap v1135: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:10.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:49:10.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:49:10.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:49:11.392 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:49:11.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:49:11.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:49:11.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:49:11.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:11.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:11 smithi027 bash[22610]: cluster 2024-08-31T02:49:10.166481+0000 mgr.a (mgr.14388) 1641 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:11 smithi191 bash[24992]: cluster 2024-08-31T02:49:10.166481+0000 mgr.a (mgr.14388) 1641 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:11 smithi163 bash[24253]: cluster 2024-08-31T02:49:10.166481+0000 mgr.a (mgr.14388) 1641 : cluster [DBG] pgmap v1136: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:12.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:12 smithi027 bash[22610]: audit 2024-08-31T02:49:10.984268+0000 mgr.a (mgr.14388) 1642 : audit [DBG] from='client.48168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:12 smithi191 bash[24992]: audit 2024-08-31T02:49:10.984268+0000 mgr.a (mgr.14388) 1642 : audit [DBG] from='client.48168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:12 smithi163 bash[24253]: audit 2024-08-31T02:49:10.984268+0000 mgr.a (mgr.14388) 1642 : audit [DBG] from='client.48168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:13 smithi191 bash[24992]: cluster 2024-08-31T02:49:12.167450+0000 mgr.a (mgr.14388) 1643 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:13 smithi163 bash[24253]: cluster 2024-08-31T02:49:12.167450+0000 mgr.a (mgr.14388) 1643 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:13.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:13 smithi027 bash[22610]: cluster 2024-08-31T02:49:12.167450+0000 mgr.a (mgr.14388) 1643 : cluster [DBG] pgmap v1137: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:15 smithi191 bash[24992]: cluster 2024-08-31T02:49:14.169698+0000 mgr.a (mgr.14388) 1644 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:15 smithi163 bash[24253]: cluster 2024-08-31T02:49:14.169698+0000 mgr.a (mgr.14388) 1644 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:15.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:15 smithi027 bash[22610]: cluster 2024-08-31T02:49:14.169698+0000 mgr.a (mgr.14388) 1644 : cluster [DBG] pgmap v1138: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:16.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:49:16.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:49:16.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:49:17.167 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:49:17.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:49:17.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:49:17.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:49:17.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:17 smithi191 bash[24992]: cluster 2024-08-31T02:49:16.170482+0000 mgr.a (mgr.14388) 1645 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:17 smithi163 bash[24253]: cluster 2024-08-31T02:49:16.170482+0000 mgr.a (mgr.14388) 1645 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:17.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:17 smithi027 bash[22610]: cluster 2024-08-31T02:49:16.170482+0000 mgr.a (mgr.14388) 1645 : cluster [DBG] pgmap v1139: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:18 smithi191 bash[24992]: audit 2024-08-31T02:49:16.732368+0000 mgr.a (mgr.14388) 1646 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:18 smithi191 bash[24992]: cluster 2024-08-31T02:49:18.172723+0000 mgr.a (mgr.14388) 1647 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:18 smithi163 bash[24253]: audit 2024-08-31T02:49:16.732368+0000 mgr.a (mgr.14388) 1646 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:18 smithi163 bash[24253]: cluster 2024-08-31T02:49:18.172723+0000 mgr.a (mgr.14388) 1647 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:18.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:18 smithi027 bash[22610]: audit 2024-08-31T02:49:16.732368+0000 mgr.a (mgr.14388) 1646 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:18.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:18 smithi027 bash[22610]: cluster 2024-08-31T02:49:18.172723+0000 mgr.a (mgr.14388) 1647 : cluster [DBG] pgmap v1140: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:49:21.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:21 smithi027 bash[22610]: cluster 2024-08-31T02:49:20.173493+0000 mgr.a (mgr.14388) 1648 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:21 smithi191 bash[24992]: cluster 2024-08-31T02:49:20.173493+0000 mgr.a (mgr.14388) 1648 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:21 smithi163 bash[24253]: cluster 2024-08-31T02:49:20.173493+0000 mgr.a (mgr.14388) 1648 : cluster [DBG] pgmap v1141: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:49:22.170 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:49:22.170 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:49:22.906 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:49:22.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:49:22.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:49:22.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:49:22.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:23 smithi191 bash[24992]: cluster 2024-08-31T02:49:22.174354+0000 mgr.a (mgr.14388) 1649 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:23 smithi163 bash[24253]: cluster 2024-08-31T02:49:22.174354+0000 mgr.a (mgr.14388) 1649 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:23.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:23 smithi027 bash[22610]: cluster 2024-08-31T02:49:22.174354+0000 mgr.a (mgr.14388) 1649 : cluster [DBG] pgmap v1142: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:24 smithi191 bash[24992]: audit 2024-08-31T02:49:22.499555+0000 mgr.a (mgr.14388) 1650 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:24 smithi163 bash[24253]: audit 2024-08-31T02:49:22.499555+0000 mgr.a (mgr.14388) 1650 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:24.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:24 smithi027 bash[22610]: audit 2024-08-31T02:49:22.499555+0000 mgr.a (mgr.14388) 1650 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:25 smithi191 bash[24992]: cluster 2024-08-31T02:49:24.176628+0000 mgr.a (mgr.14388) 1651 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:49:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:25 smithi163 bash[24253]: cluster 2024-08-31T02:49:24.176628+0000 mgr.a (mgr.14388) 1651 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:49:25.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:25 smithi027 bash[22610]: cluster 2024-08-31T02:49:24.176628+0000 mgr.a (mgr.14388) 1651 : cluster [DBG] pgmap v1143: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:49:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:26 smithi191 bash[24992]: cluster 2024-08-31T02:49:26.177520+0000 mgr.a (mgr.14388) 1652 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:49:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:26 smithi163 bash[24253]: cluster 2024-08-31T02:49:26.177520+0000 mgr.a (mgr.14388) 1652 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:49:26.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:26 smithi027 bash[22610]: cluster 2024-08-31T02:49:26.177520+0000 mgr.a (mgr.14388) 1652 : cluster [DBG] pgmap v1144: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:49:27.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:49:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:49:27.908 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:49:28.677 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:49:28.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:49:28.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:49:28.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:49:28.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:29 smithi191 bash[24992]: cluster 2024-08-31T02:49:28.179480+0000 mgr.a (mgr.14388) 1653 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:29 smithi163 bash[24253]: cluster 2024-08-31T02:49:28.179480+0000 mgr.a (mgr.14388) 1653 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:29 smithi027 bash[22610]: cluster 2024-08-31T02:49:28.179480+0000 mgr.a (mgr.14388) 1653 : cluster [DBG] pgmap v1145: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:30 smithi191 bash[24992]: audit 2024-08-31T02:49:28.251253+0000 mgr.a (mgr.14388) 1654 : audit [DBG] from='client.48402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:30 smithi163 bash[24253]: audit 2024-08-31T02:49:28.251253+0000 mgr.a (mgr.14388) 1654 : audit [DBG] from='client.48402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:30.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:30 smithi027 bash[22610]: audit 2024-08-31T02:49:28.251253+0000 mgr.a (mgr.14388) 1654 : audit [DBG] from='client.48402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:31 smithi191 bash[24992]: cluster 2024-08-31T02:49:30.180369+0000 mgr.a (mgr.14388) 1655 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:49:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:31 smithi163 bash[24253]: cluster 2024-08-31T02:49:30.180369+0000 mgr.a (mgr.14388) 1655 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:49:31.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:31 smithi027 bash[22610]: cluster 2024-08-31T02:49:30.180369+0000 mgr.a (mgr.14388) 1655 : cluster [DBG] pgmap v1146: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:49:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:33 smithi191 bash[24992]: cluster 2024-08-31T02:49:32.181143+0000 mgr.a (mgr.14388) 1656 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:49:33.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:49:33.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:49:33.680 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:49:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:33 smithi163 bash[24253]: cluster 2024-08-31T02:49:32.181143+0000 mgr.a (mgr.14388) 1656 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:49:33.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:33 smithi027 bash[22610]: cluster 2024-08-31T02:49:32.181143+0000 mgr.a (mgr.14388) 1656 : cluster [DBG] pgmap v1147: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:49:34.437 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:49:34.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:49:34.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:49:34.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:49:34.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:34 smithi191 bash[24992]: audit 2024-08-31T02:49:34.017095+0000 mgr.a (mgr.14388) 1657 : audit [DBG] from='client.48480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:34 smithi191 bash[24992]: cluster 2024-08-31T02:49:34.182405+0000 mgr.a (mgr.14388) 1658 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:34 smithi163 bash[24253]: audit 2024-08-31T02:49:34.017095+0000 mgr.a (mgr.14388) 1657 : audit [DBG] from='client.48480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:34 smithi163 bash[24253]: cluster 2024-08-31T02:49:34.182405+0000 mgr.a (mgr.14388) 1658 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:34.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:34 smithi027 bash[22610]: audit 2024-08-31T02:49:34.017095+0000 mgr.a (mgr.14388) 1657 : audit [DBG] from='client.48480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:34.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:34 smithi027 bash[22610]: cluster 2024-08-31T02:49:34.182405+0000 mgr.a (mgr.14388) 1658 : cluster [DBG] pgmap v1148: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:37 smithi191 bash[24992]: cluster 2024-08-31T02:49:36.183264+0000 mgr.a (mgr.14388) 1659 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:49:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:37 smithi163 bash[24253]: cluster 2024-08-31T02:49:36.183264+0000 mgr.a (mgr.14388) 1659 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:49:37.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:37 smithi027 bash[22610]: cluster 2024-08-31T02:49:36.183264+0000 mgr.a (mgr.14388) 1659 : cluster [DBG] pgmap v1149: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:49:39.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:49:39.439 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:49:39.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:49:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:39 smithi191 bash[24992]: cluster 2024-08-31T02:49:38.185340+0000 mgr.a (mgr.14388) 1660 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:49:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:39 smithi163 bash[24253]: cluster 2024-08-31T02:49:38.185340+0000 mgr.a (mgr.14388) 1660 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:49:39.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:39 smithi027 bash[22610]: cluster 2024-08-31T02:49:38.185340+0000 mgr.a (mgr.14388) 1660 : cluster [DBG] pgmap v1150: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:49:40.204 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:49:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:49:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:49:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:49:40.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:41 smithi191 bash[24992]: audit 2024-08-31T02:49:39.778943+0000 mgr.a (mgr.14388) 1661 : audit [DBG] from='client.48552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:41 smithi191 bash[24992]: cluster 2024-08-31T02:49:40.185936+0000 mgr.a (mgr.14388) 1662 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:41 smithi163 bash[24253]: audit 2024-08-31T02:49:39.778943+0000 mgr.a (mgr.14388) 1661 : audit [DBG] from='client.48552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:41 smithi163 bash[24253]: cluster 2024-08-31T02:49:40.185936+0000 mgr.a (mgr.14388) 1662 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:41.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:41 smithi027 bash[22610]: audit 2024-08-31T02:49:39.778943+0000 mgr.a (mgr.14388) 1661 : audit [DBG] from='client.48552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:41.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:41 smithi027 bash[22610]: cluster 2024-08-31T02:49:40.185936+0000 mgr.a (mgr.14388) 1662 : cluster [DBG] pgmap v1151: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:43 smithi191 bash[24992]: cluster 2024-08-31T02:49:42.186692+0000 mgr.a (mgr.14388) 1663 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:43 smithi163 bash[24253]: cluster 2024-08-31T02:49:42.186692+0000 mgr.a (mgr.14388) 1663 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:43.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:43 smithi027 bash[22610]: cluster 2024-08-31T02:49:42.186692+0000 mgr.a (mgr.14388) 1663 : cluster [DBG] pgmap v1152: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:44 smithi163 bash[24253]: cluster 2024-08-31T02:49:44.188847+0000 mgr.a (mgr.14388) 1664 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:44.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:44 smithi027 bash[22610]: cluster 2024-08-31T02:49:44.188847+0000 mgr.a (mgr.14388) 1664 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:44 smithi191 bash[24992]: cluster 2024-08-31T02:49:44.188847+0000 mgr.a (mgr.14388) 1664 : cluster [DBG] pgmap v1153: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:45.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:49:45.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:49:45.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:49:45.996 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:49:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:49:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:49:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:49:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:47 smithi191 bash[24992]: audit 2024-08-31T02:49:45.548297+0000 mgr.a (mgr.14388) 1665 : audit [DBG] from='client.48624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:47 smithi191 bash[24992]: cluster 2024-08-31T02:49:46.189816+0000 mgr.a (mgr.14388) 1666 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:47 smithi163 bash[24253]: audit 2024-08-31T02:49:45.548297+0000 mgr.a (mgr.14388) 1665 : audit [DBG] from='client.48624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:47 smithi163 bash[24253]: cluster 2024-08-31T02:49:46.189816+0000 mgr.a (mgr.14388) 1666 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:47.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:47 smithi027 bash[22610]: audit 2024-08-31T02:49:45.548297+0000 mgr.a (mgr.14388) 1665 : audit [DBG] from='client.48624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:47.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:47 smithi027 bash[22610]: cluster 2024-08-31T02:49:46.189816+0000 mgr.a (mgr.14388) 1666 : cluster [DBG] pgmap v1154: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:49 smithi191 bash[24992]: cluster 2024-08-31T02:49:48.191999+0000 mgr.a (mgr.14388) 1667 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:49 smithi163 bash[24253]: cluster 2024-08-31T02:49:48.191999+0000 mgr.a (mgr.14388) 1667 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:49.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:49 smithi027 bash[22610]: cluster 2024-08-31T02:49:48.191999+0000 mgr.a (mgr.14388) 1667 : cluster [DBG] pgmap v1155: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:50 smithi163 bash[24253]: cluster 2024-08-31T02:49:50.192778+0000 mgr.a (mgr.14388) 1668 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:50.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:50 smithi027 bash[22610]: cluster 2024-08-31T02:49:50.192778+0000 mgr.a (mgr.14388) 1668 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:50 smithi191 bash[24992]: cluster 2024-08-31T02:49:50.192778+0000 mgr.a (mgr.14388) 1668 : cluster [DBG] pgmap v1156: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:50.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:49:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:49:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:49:51.746 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:49:51.747 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:49:51.747 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:49:51.747 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:49:51.747 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:53 smithi191 bash[24992]: audit 2024-08-31T02:49:51.330948+0000 mgr.a (mgr.14388) 1669 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:53 smithi191 bash[24992]: cluster 2024-08-31T02:49:52.193747+0000 mgr.a (mgr.14388) 1670 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:53 smithi163 bash[24253]: audit 2024-08-31T02:49:51.330948+0000 mgr.a (mgr.14388) 1669 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:53 smithi163 bash[24253]: cluster 2024-08-31T02:49:52.193747+0000 mgr.a (mgr.14388) 1670 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:53.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:53 smithi027 bash[22610]: audit 2024-08-31T02:49:51.330948+0000 mgr.a (mgr.14388) 1669 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:53.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:53 smithi027 bash[22610]: cluster 2024-08-31T02:49:52.193747+0000 mgr.a (mgr.14388) 1670 : cluster [DBG] pgmap v1157: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:55 smithi191 bash[24992]: cluster 2024-08-31T02:49:54.196024+0000 mgr.a (mgr.14388) 1671 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:55 smithi163 bash[24253]: cluster 2024-08-31T02:49:54.196024+0000 mgr.a (mgr.14388) 1671 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:55.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:55 smithi027 bash[22610]: cluster 2024-08-31T02:49:54.196024+0000 mgr.a (mgr.14388) 1671 : cluster [DBG] pgmap v1158: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:56 smithi191 bash[24992]: cluster 2024-08-31T02:49:56.196812+0000 mgr.a (mgr.14388) 1672 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:56 smithi163 bash[24253]: cluster 2024-08-31T02:49:56.196812+0000 mgr.a (mgr.14388) 1672 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:56.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:56 smithi027 bash[22610]: cluster 2024-08-31T02:49:56.196812+0000 mgr.a (mgr.14388) 1672 : cluster [DBG] pgmap v1159: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:49:56.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:49:56.749 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:49:56.749 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:49:57.495 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:49:57.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:49:57.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:49:57.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:49:57.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:49:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:57 smithi191 bash[24992]: audit 2024-08-31T02:49:57.086506+0000 mgr.a (mgr.14388) 1673 : audit [DBG] from='client.48774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:57 smithi163 bash[24253]: audit 2024-08-31T02:49:57.086506+0000 mgr.a (mgr.14388) 1673 : audit [DBG] from='client.48774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:57.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:57 smithi027 bash[22610]: audit 2024-08-31T02:49:57.086506+0000 mgr.a (mgr.14388) 1673 : audit [DBG] from='client.48774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:49:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:49:58 smithi191 bash[24992]: cluster 2024-08-31T02:49:58.199134+0000 mgr.a (mgr.14388) 1674 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:49:58 smithi163 bash[24253]: cluster 2024-08-31T02:49:58.199134+0000 mgr.a (mgr.14388) 1674 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:49:58.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:49:58 smithi027 bash[22610]: cluster 2024-08-31T02:49:58.199134+0000 mgr.a (mgr.14388) 1674 : cluster [DBG] pgmap v1160: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:00 smithi163 bash[24253]: cluster 2024-08-31T02:50:00.000153+0000 mon.a (mon.0) 847 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:50:00.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:00 smithi027 bash[22610]: cluster 2024-08-31T02:50:00.000153+0000 mon.a (mon.0) 847 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:50:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:00 smithi191 bash[24992]: cluster 2024-08-31T02:50:00.000153+0000 mon.a (mon.0) 847 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T02:50:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:01 smithi163 bash[24253]: cluster 2024-08-31T02:50:00.199667+0000 mgr.a (mgr.14388) 1675 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:01.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:01 smithi027 bash[22610]: cluster 2024-08-31T02:50:00.199667+0000 mgr.a (mgr.14388) 1675 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:01 smithi191 bash[24992]: cluster 2024-08-31T02:50:00.199667+0000 mgr.a (mgr.14388) 1675 : cluster [DBG] pgmap v1161: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:02.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:50:02.498 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:50:02.498 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:50:03.228 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:50:03.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:50:03.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:50:03.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:50:03.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:50:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:03 smithi191 bash[24992]: cluster 2024-08-31T02:50:02.200379+0000 mgr.a (mgr.14388) 1676 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:03 smithi163 bash[24253]: cluster 2024-08-31T02:50:02.200379+0000 mgr.a (mgr.14388) 1676 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:03.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:03 smithi027 bash[22610]: cluster 2024-08-31T02:50:02.200379+0000 mgr.a (mgr.14388) 1676 : cluster [DBG] pgmap v1162: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:04 smithi191 bash[24992]: audit 2024-08-31T02:50:02.835924+0000 mgr.a (mgr.14388) 1677 : audit [DBG] from='client.48849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:04 smithi191 bash[24992]: cluster 2024-08-31T02:50:04.203027+0000 mgr.a (mgr.14388) 1678 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:04 smithi163 bash[24253]: audit 2024-08-31T02:50:02.835924+0000 mgr.a (mgr.14388) 1677 : audit [DBG] from='client.48849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:04 smithi163 bash[24253]: cluster 2024-08-31T02:50:04.203027+0000 mgr.a (mgr.14388) 1678 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:04.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:04 smithi027 bash[22610]: audit 2024-08-31T02:50:02.835924+0000 mgr.a (mgr.14388) 1677 : audit [DBG] from='client.48849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:04.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:04 smithi027 bash[22610]: cluster 2024-08-31T02:50:04.203027+0000 mgr.a (mgr.14388) 1678 : cluster [DBG] pgmap v1163: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:05 smithi191 bash[24992]: audit 2024-08-31T02:50:05.237432+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:50:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:05 smithi163 bash[24253]: audit 2024-08-31T02:50:05.237432+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:50:05.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:05 smithi027 bash[22610]: audit 2024-08-31T02:50:05.237432+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:50:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:06 smithi191 bash[24992]: audit 2024-08-31T02:50:06.086682+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:50:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:06 smithi191 bash[24992]: audit 2024-08-31T02:50:06.088449+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:50:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:06 smithi191 bash[24992]: audit 2024-08-31T02:50:06.099354+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:50:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:06 smithi191 bash[24992]: audit 2024-08-31T02:50:06.102519+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:50:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:06 smithi191 bash[24992]: audit 2024-08-31T02:50:06.104767+0000 mgr.a (mgr.14388) 1679 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:50:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:06 smithi191 bash[24992]: cluster 2024-08-31T02:50:06.203566+0000 mgr.a (mgr.14388) 1680 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:50:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:06 smithi163 bash[24253]: audit 2024-08-31T02:50:06.086682+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:50:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:06 smithi163 bash[24253]: audit 2024-08-31T02:50:06.088449+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:50:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:06 smithi163 bash[24253]: audit 2024-08-31T02:50:06.099354+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:50:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:06 smithi163 bash[24253]: audit 2024-08-31T02:50:06.102519+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:50:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:06 smithi163 bash[24253]: audit 2024-08-31T02:50:06.104767+0000 mgr.a (mgr.14388) 1679 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:50:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:06 smithi163 bash[24253]: cluster 2024-08-31T02:50:06.203566+0000 mgr.a (mgr.14388) 1680 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:50:06.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:06 smithi027 bash[22610]: audit 2024-08-31T02:50:06.086682+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:50:06.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:06 smithi027 bash[22610]: audit 2024-08-31T02:50:06.088449+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:50:06.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:06 smithi027 bash[22610]: audit 2024-08-31T02:50:06.099354+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:50:06.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:06 smithi027 bash[22610]: audit 2024-08-31T02:50:06.102519+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:50:06.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:06 smithi027 bash[22610]: audit 2024-08-31T02:50:06.104767+0000 mgr.a (mgr.14388) 1679 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:50:06.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:06 smithi027 bash[22610]: cluster 2024-08-31T02:50:06.203566+0000 mgr.a (mgr.14388) 1680 : cluster [DBG] pgmap v1164: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:50:07.230 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:50:06 smithi027 bash[22863]: debug 2024-08-31T02:50:06.814+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:50:07.230 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:50:06 smithi027 bash[22863]: debug 2024-08-31T02:50:06.818+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:50:08.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:50:08.231 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:50:08.231 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:50:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:08 smithi163 bash[24253]: audit 2024-08-31T02:50:06.817590+0000 mgr.a (mgr.14388) 1681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:50:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:08 smithi163 bash[24253]: cephadm 2024-08-31T02:50:06.818925+0000 mgr.a (mgr.14388) 1682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:50:08.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:08 smithi027 bash[22610]: audit 2024-08-31T02:50:06.817590+0000 mgr.a (mgr.14388) 1681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:50:08.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:08 smithi027 bash[22610]: cephadm 2024-08-31T02:50:06.818925+0000 mgr.a (mgr.14388) 1682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:50:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:08 smithi191 bash[24992]: audit 2024-08-31T02:50:06.817590+0000 mgr.a (mgr.14388) 1681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:50:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:08 smithi191 bash[24992]: cephadm 2024-08-31T02:50:06.818925+0000 mgr.a (mgr.14388) 1682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:50:08.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:50:08.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:50:08.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:50:08.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:50:08.974 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:50:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:09 smithi163 bash[24253]: cluster 2024-08-31T02:50:08.205856+0000 mgr.a (mgr.14388) 1683 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:09.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:09 smithi027 bash[22610]: cluster 2024-08-31T02:50:08.205856+0000 mgr.a (mgr.14388) 1683 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:09 smithi191 bash[24992]: cluster 2024-08-31T02:50:08.205856+0000 mgr.a (mgr.14388) 1683 : cluster [DBG] pgmap v1165: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:10.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:10 smithi163 bash[24253]: audit 2024-08-31T02:50:08.569264+0000 mgr.a (mgr.14388) 1684 : audit [DBG] from='client.49032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:10.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:10 smithi027 bash[22610]: audit 2024-08-31T02:50:08.569264+0000 mgr.a (mgr.14388) 1684 : audit [DBG] from='client.49032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:10 smithi191 bash[24992]: audit 2024-08-31T02:50:08.569264+0000 mgr.a (mgr.14388) 1684 : audit [DBG] from='client.49032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:11 smithi163 bash[24253]: cluster 2024-08-31T02:50:10.206831+0000 mgr.a (mgr.14388) 1685 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:50:11.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:11 smithi027 bash[22610]: cluster 2024-08-31T02:50:10.206831+0000 mgr.a (mgr.14388) 1685 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:50:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:11 smithi191 bash[24992]: cluster 2024-08-31T02:50:10.206831+0000 mgr.a (mgr.14388) 1685 : cluster [DBG] pgmap v1166: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:50:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:12 smithi163 bash[24253]: cluster 2024-08-31T02:50:12.207617+0000 mgr.a (mgr.14388) 1686 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:50:12.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:12 smithi027 bash[22610]: cluster 2024-08-31T02:50:12.207617+0000 mgr.a (mgr.14388) 1686 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:50:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:12 smithi191 bash[24992]: cluster 2024-08-31T02:50:12.207617+0000 mgr.a (mgr.14388) 1686 : cluster [DBG] pgmap v1167: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:50:13.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:50:13.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:50:13.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:50:14.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:14 smithi163 bash[24253]: cluster 2024-08-31T02:50:14.209723+0000 mgr.a (mgr.14388) 1687 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:14.718 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:50:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:50:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:50:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:50:14.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:50:14.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:14 smithi027 bash[22610]: cluster 2024-08-31T02:50:14.209723+0000 mgr.a (mgr.14388) 1687 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:14 smithi191 bash[24992]: cluster 2024-08-31T02:50:14.209723+0000 mgr.a (mgr.14388) 1687 : cluster [DBG] pgmap v1168: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:15 smithi163 bash[24253]: audit 2024-08-31T02:50:14.307858+0000 mgr.a (mgr.14388) 1688 : audit [DBG] from='client.49110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:15.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:15 smithi027 bash[22610]: audit 2024-08-31T02:50:14.307858+0000 mgr.a (mgr.14388) 1688 : audit [DBG] from='client.49110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:15 smithi191 bash[24992]: audit 2024-08-31T02:50:14.307858+0000 mgr.a (mgr.14388) 1688 : audit [DBG] from='client.49110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:16 smithi163 bash[24253]: cluster 2024-08-31T02:50:16.210619+0000 mgr.a (mgr.14388) 1689 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:16.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:16 smithi027 bash[22610]: cluster 2024-08-31T02:50:16.210619+0000 mgr.a (mgr.14388) 1689 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:16 smithi191 bash[24992]: cluster 2024-08-31T02:50:16.210619+0000 mgr.a (mgr.14388) 1689 : cluster [DBG] pgmap v1169: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:18 smithi163 bash[24253]: cluster 2024-08-31T02:50:18.212684+0000 mgr.a (mgr.14388) 1690 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:18.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:18 smithi027 bash[22610]: cluster 2024-08-31T02:50:18.212684+0000 mgr.a (mgr.14388) 1690 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:18 smithi191 bash[24992]: cluster 2024-08-31T02:50:18.212684+0000 mgr.a (mgr.14388) 1690 : cluster [DBG] pgmap v1170: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:50:19.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:50:19.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:50:19.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:50:20.462 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:50:20.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:50:20.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:50:20.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:50:20.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:50:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:20 smithi163 bash[24253]: audit 2024-08-31T02:50:20.059561+0000 mgr.a (mgr.14388) 1691 : audit [DBG] from='client.49188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:20 smithi163 bash[24253]: cluster 2024-08-31T02:50:20.213213+0000 mgr.a (mgr.14388) 1692 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:20.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:20 smithi027 bash[22610]: audit 2024-08-31T02:50:20.059561+0000 mgr.a (mgr.14388) 1691 : audit [DBG] from='client.49188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:20.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:20 smithi027 bash[22610]: cluster 2024-08-31T02:50:20.213213+0000 mgr.a (mgr.14388) 1692 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:20 smithi191 bash[24992]: audit 2024-08-31T02:50:20.059561+0000 mgr.a (mgr.14388) 1691 : audit [DBG] from='client.49188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:20 smithi191 bash[24992]: cluster 2024-08-31T02:50:20.213213+0000 mgr.a (mgr.14388) 1692 : cluster [DBG] pgmap v1171: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:22 smithi163 bash[24253]: cluster 2024-08-31T02:50:22.214070+0000 mgr.a (mgr.14388) 1693 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:22.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:22 smithi027 bash[22610]: cluster 2024-08-31T02:50:22.214070+0000 mgr.a (mgr.14388) 1693 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:22 smithi191 bash[24992]: cluster 2024-08-31T02:50:22.214070+0000 mgr.a (mgr.14388) 1693 : cluster [DBG] pgmap v1172: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:24 smithi163 bash[24253]: cluster 2024-08-31T02:50:24.216260+0000 mgr.a (mgr.14388) 1694 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:24.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:24 smithi027 bash[22610]: cluster 2024-08-31T02:50:24.216260+0000 mgr.a (mgr.14388) 1694 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:24 smithi191 bash[24992]: cluster 2024-08-31T02:50:24.216260+0000 mgr.a (mgr.14388) 1694 : cluster [DBG] pgmap v1173: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:25.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:50:25.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:50:25.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:50:26.225 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:50:26.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:50:26.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:50:26.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:50:26.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:50:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:26 smithi163 bash[24253]: audit 2024-08-31T02:50:25.804380+0000 mgr.a (mgr.14388) 1695 : audit [DBG] from='client.49266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:26 smithi163 bash[24253]: cluster 2024-08-31T02:50:26.216728+0000 mgr.a (mgr.14388) 1696 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:26.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:26 smithi027 bash[22610]: audit 2024-08-31T02:50:25.804380+0000 mgr.a (mgr.14388) 1695 : audit [DBG] from='client.49266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:26.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:26 smithi027 bash[22610]: cluster 2024-08-31T02:50:26.216728+0000 mgr.a (mgr.14388) 1696 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:26 smithi191 bash[24992]: audit 2024-08-31T02:50:25.804380+0000 mgr.a (mgr.14388) 1695 : audit [DBG] from='client.49266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:26 smithi191 bash[24992]: cluster 2024-08-31T02:50:26.216728+0000 mgr.a (mgr.14388) 1696 : cluster [DBG] pgmap v1174: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:28 smithi163 bash[24253]: cluster 2024-08-31T02:50:28.218832+0000 mgr.a (mgr.14388) 1697 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:28.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:28 smithi027 bash[22610]: cluster 2024-08-31T02:50:28.218832+0000 mgr.a (mgr.14388) 1697 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:28 smithi191 bash[24992]: cluster 2024-08-31T02:50:28.218832+0000 mgr.a (mgr.14388) 1697 : cluster [DBG] pgmap v1175: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:30 smithi163 bash[24253]: cluster 2024-08-31T02:50:30.219609+0000 mgr.a (mgr.14388) 1698 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:30.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:30 smithi027 bash[22610]: cluster 2024-08-31T02:50:30.219609+0000 mgr.a (mgr.14388) 1698 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:30 smithi191 bash[24992]: cluster 2024-08-31T02:50:30.219609+0000 mgr.a (mgr.14388) 1698 : cluster [DBG] pgmap v1176: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:31.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:50:31.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:50:31.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:50:32.001 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:50:32.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:50:32.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:50:32.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:50:32.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:50:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:32 smithi163 bash[24253]: audit 2024-08-31T02:50:31.571815+0000 mgr.a (mgr.14388) 1699 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:32 smithi163 bash[24253]: cluster 2024-08-31T02:50:32.220554+0000 mgr.a (mgr.14388) 1700 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:32.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:32 smithi027 bash[22610]: audit 2024-08-31T02:50:31.571815+0000 mgr.a (mgr.14388) 1699 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:32.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:32 smithi027 bash[22610]: cluster 2024-08-31T02:50:32.220554+0000 mgr.a (mgr.14388) 1700 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:32 smithi191 bash[24992]: audit 2024-08-31T02:50:31.571815+0000 mgr.a (mgr.14388) 1699 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:32 smithi191 bash[24992]: cluster 2024-08-31T02:50:32.220554+0000 mgr.a (mgr.14388) 1700 : cluster [DBG] pgmap v1177: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:34 smithi163 bash[24253]: cluster 2024-08-31T02:50:34.222748+0000 mgr.a (mgr.14388) 1701 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:34.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:34 smithi027 bash[22610]: cluster 2024-08-31T02:50:34.222748+0000 mgr.a (mgr.14388) 1701 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:34 smithi191 bash[24992]: cluster 2024-08-31T02:50:34.222748+0000 mgr.a (mgr.14388) 1701 : cluster [DBG] pgmap v1178: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:36 smithi163 bash[24253]: cluster 2024-08-31T02:50:36.223507+0000 mgr.a (mgr.14388) 1702 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:36.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:36 smithi027 bash[22610]: cluster 2024-08-31T02:50:36.223507+0000 mgr.a (mgr.14388) 1702 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:36 smithi191 bash[24992]: cluster 2024-08-31T02:50:36.223507+0000 mgr.a (mgr.14388) 1702 : cluster [DBG] pgmap v1179: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:37.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:50:37.004 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:50:37.004 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:50:37.773 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:50:37.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:50:37.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:50:37.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:50:37.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:50:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:38 smithi163 bash[24253]: audit 2024-08-31T02:50:37.341168+0000 mgr.a (mgr.14388) 1703 : audit [DBG] from='client.49422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:38 smithi163 bash[24253]: cluster 2024-08-31T02:50:38.225689+0000 mgr.a (mgr.14388) 1704 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:38.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:38 smithi027 bash[22610]: audit 2024-08-31T02:50:37.341168+0000 mgr.a (mgr.14388) 1703 : audit [DBG] from='client.49422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:38.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:38 smithi027 bash[22610]: cluster 2024-08-31T02:50:38.225689+0000 mgr.a (mgr.14388) 1704 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:38 smithi191 bash[24992]: audit 2024-08-31T02:50:37.341168+0000 mgr.a (mgr.14388) 1703 : audit [DBG] from='client.49422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:38 smithi191 bash[24992]: cluster 2024-08-31T02:50:38.225689+0000 mgr.a (mgr.14388) 1704 : cluster [DBG] pgmap v1180: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:40 smithi163 bash[24253]: cluster 2024-08-31T02:50:40.226430+0000 mgr.a (mgr.14388) 1705 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:40.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:40 smithi027 bash[22610]: cluster 2024-08-31T02:50:40.226430+0000 mgr.a (mgr.14388) 1705 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:40 smithi191 bash[24992]: cluster 2024-08-31T02:50:40.226430+0000 mgr.a (mgr.14388) 1705 : cluster [DBG] pgmap v1181: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:42 smithi163 bash[24253]: cluster 2024-08-31T02:50:42.227205+0000 mgr.a (mgr.14388) 1706 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:42.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:42 smithi027 bash[22610]: cluster 2024-08-31T02:50:42.227205+0000 mgr.a (mgr.14388) 1706 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:42.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:50:42.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:50:42.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:50:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:42 smithi191 bash[24992]: cluster 2024-08-31T02:50:42.227205+0000 mgr.a (mgr.14388) 1706 : cluster [DBG] pgmap v1182: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:43.543 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:50:43.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:50:43.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:50:43.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:50:43.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:50:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:43 smithi163 bash[24253]: audit 2024-08-31T02:50:43.128751+0000 mgr.a (mgr.14388) 1707 : audit [DBG] from='client.49497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:43.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:43 smithi027 bash[22610]: audit 2024-08-31T02:50:43.128751+0000 mgr.a (mgr.14388) 1707 : audit [DBG] from='client.49497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:43 smithi191 bash[24992]: audit 2024-08-31T02:50:43.128751+0000 mgr.a (mgr.14388) 1707 : audit [DBG] from='client.49497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:44 smithi163 bash[24253]: cluster 2024-08-31T02:50:44.229840+0000 mgr.a (mgr.14388) 1708 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:44.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:44 smithi027 bash[22610]: cluster 2024-08-31T02:50:44.229840+0000 mgr.a (mgr.14388) 1708 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:44 smithi191 bash[24992]: cluster 2024-08-31T02:50:44.229840+0000 mgr.a (mgr.14388) 1708 : cluster [DBG] pgmap v1183: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:46 smithi163 bash[24253]: cluster 2024-08-31T02:50:46.230602+0000 mgr.a (mgr.14388) 1709 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:50:46.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:46 smithi027 bash[22610]: cluster 2024-08-31T02:50:46.230602+0000 mgr.a (mgr.14388) 1709 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:50:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:46 smithi191 bash[24992]: cluster 2024-08-31T02:50:46.230602+0000 mgr.a (mgr.14388) 1709 : cluster [DBG] pgmap v1184: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:50:48.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:50:48.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:50:48.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:50:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:48 smithi163 bash[24253]: cluster 2024-08-31T02:50:48.232448+0000 mgr.a (mgr.14388) 1710 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:48.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:48 smithi027 bash[22610]: cluster 2024-08-31T02:50:48.232448+0000 mgr.a (mgr.14388) 1710 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:48 smithi191 bash[24992]: cluster 2024-08-31T02:50:48.232448+0000 mgr.a (mgr.14388) 1710 : cluster [DBG] pgmap v1185: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:49.299 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:50:49.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:50:49.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:50:49.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:50:49.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:50:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:49 smithi163 bash[24253]: audit 2024-08-31T02:50:48.879312+0000 mgr.a (mgr.14388) 1711 : audit [DBG] from='client.49575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:49.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:49 smithi027 bash[22610]: audit 2024-08-31T02:50:48.879312+0000 mgr.a (mgr.14388) 1711 : audit [DBG] from='client.49575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:49 smithi191 bash[24992]: audit 2024-08-31T02:50:48.879312+0000 mgr.a (mgr.14388) 1711 : audit [DBG] from='client.49575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:50 smithi163 bash[24253]: cluster 2024-08-31T02:50:50.233356+0000 mgr.a (mgr.14388) 1712 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:50:50.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:50 smithi027 bash[22610]: cluster 2024-08-31T02:50:50.233356+0000 mgr.a (mgr.14388) 1712 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:50:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:50 smithi191 bash[24992]: cluster 2024-08-31T02:50:50.233356+0000 mgr.a (mgr.14388) 1712 : cluster [DBG] pgmap v1186: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:50:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:52 smithi163 bash[24253]: cluster 2024-08-31T02:50:52.234112+0000 mgr.a (mgr.14388) 1713 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:50:52.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:52 smithi027 bash[22610]: cluster 2024-08-31T02:50:52.234112+0000 mgr.a (mgr.14388) 1713 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:50:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:52 smithi191 bash[24992]: cluster 2024-08-31T02:50:52.234112+0000 mgr.a (mgr.14388) 1713 : cluster [DBG] pgmap v1187: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:50:54.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:50:54.301 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:50:54.302 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:50:54.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:54 smithi163 bash[24253]: cluster 2024-08-31T02:50:54.236275+0000 mgr.a (mgr.14388) 1714 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:54.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:54 smithi027 bash[22610]: cluster 2024-08-31T02:50:54.236275+0000 mgr.a (mgr.14388) 1714 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:54 smithi191 bash[24992]: cluster 2024-08-31T02:50:54.236275+0000 mgr.a (mgr.14388) 1714 : cluster [DBG] pgmap v1188: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:55.057 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:50:55.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:50:55.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:50:55.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:50:55.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:50:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:55 smithi163 bash[24253]: audit 2024-08-31T02:50:54.640006+0000 mgr.a (mgr.14388) 1715 : audit [DBG] from='client.49650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:55.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:55 smithi027 bash[22610]: audit 2024-08-31T02:50:54.640006+0000 mgr.a (mgr.14388) 1715 : audit [DBG] from='client.49650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:55 smithi191 bash[24992]: audit 2024-08-31T02:50:54.640006+0000 mgr.a (mgr.14388) 1715 : audit [DBG] from='client.49650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:50:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:56 smithi163 bash[24253]: cluster 2024-08-31T02:50:56.237181+0000 mgr.a (mgr.14388) 1716 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:56.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:56 smithi027 bash[22610]: cluster 2024-08-31T02:50:56.237181+0000 mgr.a (mgr.14388) 1716 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:56 smithi191 bash[24992]: cluster 2024-08-31T02:50:56.237181+0000 mgr.a (mgr.14388) 1716 : cluster [DBG] pgmap v1189: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:50:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:50:58 smithi163 bash[24253]: cluster 2024-08-31T02:50:58.239305+0000 mgr.a (mgr.14388) 1717 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:58.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:50:58 smithi027 bash[22610]: cluster 2024-08-31T02:50:58.239305+0000 mgr.a (mgr.14388) 1717 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:50:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:50:58 smithi191 bash[24992]: cluster 2024-08-31T02:50:58.239305+0000 mgr.a (mgr.14388) 1717 : cluster [DBG] pgmap v1190: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:00.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:00.059 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:00.060 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:00.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:00 smithi163 bash[24253]: cluster 2024-08-31T02:51:00.240022+0000 mgr.a (mgr.14388) 1718 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:00.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:00 smithi027 bash[22610]: cluster 2024-08-31T02:51:00.240022+0000 mgr.a (mgr.14388) 1718 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:00 smithi191 bash[24992]: cluster 2024-08-31T02:51:00.240022+0000 mgr.a (mgr.14388) 1718 : cluster [DBG] pgmap v1191: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:00.838 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:00.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:00.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:00.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:00.839 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:01 smithi163 bash[24253]: audit 2024-08-31T02:51:00.404031+0000 mgr.a (mgr.14388) 1719 : audit [DBG] from='client.49725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:01.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:01 smithi027 bash[22610]: audit 2024-08-31T02:51:00.404031+0000 mgr.a (mgr.14388) 1719 : audit [DBG] from='client.49725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:01 smithi191 bash[24992]: audit 2024-08-31T02:51:00.404031+0000 mgr.a (mgr.14388) 1719 : audit [DBG] from='client.49725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:02.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:02 smithi163 bash[24253]: cluster 2024-08-31T02:51:02.240874+0000 mgr.a (mgr.14388) 1720 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:02.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:02 smithi027 bash[22610]: cluster 2024-08-31T02:51:02.240874+0000 mgr.a (mgr.14388) 1720 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:02 smithi191 bash[24992]: cluster 2024-08-31T02:51:02.240874+0000 mgr.a (mgr.14388) 1720 : cluster [DBG] pgmap v1192: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:04 smithi163 bash[24253]: cluster 2024-08-31T02:51:04.243069+0000 mgr.a (mgr.14388) 1721 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:04.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:04 smithi027 bash[22610]: cluster 2024-08-31T02:51:04.243069+0000 mgr.a (mgr.14388) 1721 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:04 smithi191 bash[24992]: cluster 2024-08-31T02:51:04.243069+0000 mgr.a (mgr.14388) 1721 : cluster [DBG] pgmap v1193: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:05.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:06.600 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:06 smithi163 bash[24253]: audit 2024-08-31T02:51:06.179776+0000 mgr.a (mgr.14388) 1722 : audit [DBG] from='client.49803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:06 smithi163 bash[24253]: cluster 2024-08-31T02:51:06.243542+0000 mgr.a (mgr.14388) 1723 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:06 smithi027 bash[22610]: audit 2024-08-31T02:51:06.179776+0000 mgr.a (mgr.14388) 1722 : audit [DBG] from='client.49803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:06 smithi027 bash[22610]: cluster 2024-08-31T02:51:06.243542+0000 mgr.a (mgr.14388) 1723 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:06 smithi191 bash[24992]: audit 2024-08-31T02:51:06.179776+0000 mgr.a (mgr.14388) 1722 : audit [DBG] from='client.49803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:06 smithi191 bash[24992]: cluster 2024-08-31T02:51:06.243542+0000 mgr.a (mgr.14388) 1723 : cluster [DBG] pgmap v1194: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:07 smithi163 bash[24253]: audit 2024-08-31T02:51:06.869968+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:51:07.729 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:07 smithi027 bash[22610]: audit 2024-08-31T02:51:06.869968+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:51:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:07 smithi191 bash[24992]: audit 2024-08-31T02:51:06.869968+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:51:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:08 smithi163 bash[24253]: audit 2024-08-31T02:51:07.722970+0000 mon.a (mon.0) 854 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:51:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:08 smithi163 bash[24253]: audit 2024-08-31T02:51:07.724579+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:51:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:08 smithi163 bash[24253]: audit 2024-08-31T02:51:07.735180+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:51:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:08 smithi163 bash[24253]: audit 2024-08-31T02:51:07.740341+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:51:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:08 smithi163 bash[24253]: audit 2024-08-31T02:51:07.743041+0000 mgr.a (mgr.14388) 1724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:51:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:08 smithi163 bash[24253]: cluster 2024-08-31T02:51:08.247624+0000 mgr.a (mgr.14388) 1725 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 2 op/s 2024-08-31T02:51:08.730 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:51:08 smithi027 bash[22863]: debug 2024-08-31T02:51:08.449+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:51:08.731 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:51:08 smithi027 bash[22863]: debug 2024-08-31T02:51:08.449+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:51:08.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:08 smithi027 bash[22610]: audit 2024-08-31T02:51:07.722970+0000 mon.a (mon.0) 854 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:51:08.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:08 smithi027 bash[22610]: audit 2024-08-31T02:51:07.724579+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:51:08.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:08 smithi027 bash[22610]: audit 2024-08-31T02:51:07.735180+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:51:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:08 smithi027 bash[22610]: audit 2024-08-31T02:51:07.740341+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:51:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:08 smithi027 bash[22610]: audit 2024-08-31T02:51:07.743041+0000 mgr.a (mgr.14388) 1724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:51:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:08 smithi027 bash[22610]: cluster 2024-08-31T02:51:08.247624+0000 mgr.a (mgr.14388) 1725 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 2 op/s 2024-08-31T02:51:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:08 smithi191 bash[24992]: audit 2024-08-31T02:51:07.722970+0000 mon.a (mon.0) 854 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:51:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:08 smithi191 bash[24992]: audit 2024-08-31T02:51:07.724579+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:51:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:08 smithi191 bash[24992]: audit 2024-08-31T02:51:07.735180+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:51:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:08 smithi191 bash[24992]: audit 2024-08-31T02:51:07.740341+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:51:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:08 smithi191 bash[24992]: audit 2024-08-31T02:51:07.743041+0000 mgr.a (mgr.14388) 1724 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:51:08.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:08 smithi191 bash[24992]: cluster 2024-08-31T02:51:08.247624+0000 mgr.a (mgr.14388) 1725 : cluster [DBG] pgmap v1195: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 2 op/s 2024-08-31T02:51:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:09 smithi191 bash[24992]: audit 2024-08-31T02:51:08.451040+0000 mgr.a (mgr.14388) 1726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:51:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:09 smithi191 bash[24992]: cephadm 2024-08-31T02:51:08.452217+0000 mgr.a (mgr.14388) 1727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:51:10.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:09 smithi163 bash[24253]: audit 2024-08-31T02:51:08.451040+0000 mgr.a (mgr.14388) 1726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:51:10.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:09 smithi163 bash[24253]: cephadm 2024-08-31T02:51:08.452217+0000 mgr.a (mgr.14388) 1727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:51:10.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:09 smithi027 bash[22610]: audit 2024-08-31T02:51:08.451040+0000 mgr.a (mgr.14388) 1726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:51:10.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:09 smithi027 bash[22610]: cephadm 2024-08-31T02:51:08.452217+0000 mgr.a (mgr.14388) 1727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:51:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:10 smithi191 bash[24992]: cluster 2024-08-31T02:51:10.248463+0000 mgr.a (mgr.14388) 1728 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T02:51:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:10 smithi163 bash[24253]: cluster 2024-08-31T02:51:10.248463+0000 mgr.a (mgr.14388) 1728 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T02:51:11.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:10 smithi027 bash[22610]: cluster 2024-08-31T02:51:10.248463+0000 mgr.a (mgr.14388) 1728 : cluster [DBG] pgmap v1196: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T02:51:11.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:11.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:11.603 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:12.376 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:12.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:12.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:12.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:12.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:12 smithi163 bash[24253]: audit 2024-08-31T02:51:11.942106+0000 mgr.a (mgr.14388) 1729 : audit [DBG] from='client.49989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:12 smithi163 bash[24253]: cluster 2024-08-31T02:51:12.249071+0000 mgr.a (mgr.14388) 1730 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T02:51:12.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:12 smithi027 bash[22610]: audit 2024-08-31T02:51:11.942106+0000 mgr.a (mgr.14388) 1729 : audit [DBG] from='client.49989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:12.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:12 smithi027 bash[22610]: cluster 2024-08-31T02:51:12.249071+0000 mgr.a (mgr.14388) 1730 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T02:51:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:12 smithi191 bash[24992]: audit 2024-08-31T02:51:11.942106+0000 mgr.a (mgr.14388) 1729 : audit [DBG] from='client.49989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:12 smithi191 bash[24992]: cluster 2024-08-31T02:51:12.249071+0000 mgr.a (mgr.14388) 1730 : cluster [DBG] pgmap v1197: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T02:51:14.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:14 smithi163 bash[24253]: cluster 2024-08-31T02:51:14.251403+0000 mgr.a (mgr.14388) 1731 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:51:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:14 smithi027 bash[22610]: cluster 2024-08-31T02:51:14.251403+0000 mgr.a (mgr.14388) 1731 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:51:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:14 smithi191 bash[24992]: cluster 2024-08-31T02:51:14.251403+0000 mgr.a (mgr.14388) 1731 : cluster [DBG] pgmap v1198: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:51:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:16 smithi163 bash[24253]: cluster 2024-08-31T02:51:16.252189+0000 mgr.a (mgr.14388) 1732 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:51:16.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:16 smithi027 bash[22610]: cluster 2024-08-31T02:51:16.252189+0000 mgr.a (mgr.14388) 1732 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:51:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:16 smithi191 bash[24992]: cluster 2024-08-31T02:51:16.252189+0000 mgr.a (mgr.14388) 1732 : cluster [DBG] pgmap v1199: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:51:17.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:17.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:17.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:18.143 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:18.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:18.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:18.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:18.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:18 smithi163 bash[24253]: audit 2024-08-31T02:51:17.715348+0000 mgr.a (mgr.14388) 1733 : audit [DBG] from='client.50067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:18 smithi163 bash[24253]: cluster 2024-08-31T02:51:18.254537+0000 mgr.a (mgr.14388) 1734 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:51:18.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:18 smithi027 bash[22610]: audit 2024-08-31T02:51:17.715348+0000 mgr.a (mgr.14388) 1733 : audit [DBG] from='client.50067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:18.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:18 smithi027 bash[22610]: cluster 2024-08-31T02:51:18.254537+0000 mgr.a (mgr.14388) 1734 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:51:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:18 smithi191 bash[24992]: audit 2024-08-31T02:51:17.715348+0000 mgr.a (mgr.14388) 1733 : audit [DBG] from='client.50067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:18 smithi191 bash[24992]: cluster 2024-08-31T02:51:18.254537+0000 mgr.a (mgr.14388) 1734 : cluster [DBG] pgmap v1200: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:51:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:20 smithi163 bash[24253]: cluster 2024-08-31T02:51:20.255350+0000 mgr.a (mgr.14388) 1735 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:51:20.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:20 smithi027 bash[22610]: cluster 2024-08-31T02:51:20.255350+0000 mgr.a (mgr.14388) 1735 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:51:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:20 smithi191 bash[24992]: cluster 2024-08-31T02:51:20.255350+0000 mgr.a (mgr.14388) 1735 : cluster [DBG] pgmap v1201: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:51:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:22 smithi163 bash[24253]: cluster 2024-08-31T02:51:22.256108+0000 mgr.a (mgr.14388) 1736 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:51:22.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:22 smithi027 bash[22610]: cluster 2024-08-31T02:51:22.256108+0000 mgr.a (mgr.14388) 1736 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:51:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:22 smithi191 bash[24992]: cluster 2024-08-31T02:51:22.256108+0000 mgr.a (mgr.14388) 1736 : cluster [DBG] pgmap v1202: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:51:23.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:23.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:23.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:23.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:23.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:23.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:23.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:23.887 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:24 smithi163 bash[24253]: audit 2024-08-31T02:51:23.479257+0000 mgr.a (mgr.14388) 1737 : audit [DBG] from='client.50145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:24 smithi163 bash[24253]: cluster 2024-08-31T02:51:24.258818+0000 mgr.a (mgr.14388) 1738 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:51:24.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:24 smithi027 bash[22610]: audit 2024-08-31T02:51:23.479257+0000 mgr.a (mgr.14388) 1737 : audit [DBG] from='client.50145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:24.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:24 smithi027 bash[22610]: cluster 2024-08-31T02:51:24.258818+0000 mgr.a (mgr.14388) 1738 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:51:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:24 smithi191 bash[24992]: audit 2024-08-31T02:51:23.479257+0000 mgr.a (mgr.14388) 1737 : audit [DBG] from='client.50145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:24 smithi191 bash[24992]: cluster 2024-08-31T02:51:24.258818+0000 mgr.a (mgr.14388) 1738 : cluster [DBG] pgmap v1203: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:51:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:26 smithi163 bash[24253]: cluster 2024-08-31T02:51:26.259578+0000 mgr.a (mgr.14388) 1739 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:51:26.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:26 smithi027 bash[22610]: cluster 2024-08-31T02:51:26.259578+0000 mgr.a (mgr.14388) 1739 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:51:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:26 smithi191 bash[24992]: cluster 2024-08-31T02:51:26.259578+0000 mgr.a (mgr.14388) 1739 : cluster [DBG] pgmap v1204: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:51:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:28 smithi163 bash[24253]: cluster 2024-08-31T02:51:28.261429+0000 mgr.a (mgr.14388) 1740 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:28.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:28 smithi027 bash[22610]: cluster 2024-08-31T02:51:28.261429+0000 mgr.a (mgr.14388) 1740 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:28 smithi191 bash[24992]: cluster 2024-08-31T02:51:28.261429+0000 mgr.a (mgr.14388) 1740 : cluster [DBG] pgmap v1205: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:28.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:28.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:28.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:29.648 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:29.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:29.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:29.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:29.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:29 smithi163 bash[24253]: audit 2024-08-31T02:51:29.227191+0000 mgr.a (mgr.14388) 1741 : audit [DBG] from='client.50223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:29.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:29 smithi027 bash[22610]: audit 2024-08-31T02:51:29.227191+0000 mgr.a (mgr.14388) 1741 : audit [DBG] from='client.50223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:29 smithi191 bash[24992]: audit 2024-08-31T02:51:29.227191+0000 mgr.a (mgr.14388) 1741 : audit [DBG] from='client.50223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:30 smithi163 bash[24253]: cluster 2024-08-31T02:51:30.262396+0000 mgr.a (mgr.14388) 1742 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:51:30.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:30 smithi027 bash[22610]: cluster 2024-08-31T02:51:30.262396+0000 mgr.a (mgr.14388) 1742 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:51:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:30 smithi191 bash[24992]: cluster 2024-08-31T02:51:30.262396+0000 mgr.a (mgr.14388) 1742 : cluster [DBG] pgmap v1206: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:51:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:32 smithi163 bash[24253]: cluster 2024-08-31T02:51:32.263224+0000 mgr.a (mgr.14388) 1743 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:51:32.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:32 smithi027 bash[22610]: cluster 2024-08-31T02:51:32.263224+0000 mgr.a (mgr.14388) 1743 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:51:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:32 smithi191 bash[24992]: cluster 2024-08-31T02:51:32.263224+0000 mgr.a (mgr.14388) 1743 : cluster [DBG] pgmap v1207: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:51:34.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:34.650 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:34.650 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:34 smithi163 bash[24253]: cluster 2024-08-31T02:51:34.265377+0000 mgr.a (mgr.14388) 1744 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:51:34.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:34 smithi027 bash[22610]: cluster 2024-08-31T02:51:34.265377+0000 mgr.a (mgr.14388) 1744 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:51:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:34 smithi191 bash[24992]: cluster 2024-08-31T02:51:34.265377+0000 mgr.a (mgr.14388) 1744 : cluster [DBG] pgmap v1208: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:51:35.393 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:35.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:35.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:35.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:35.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:35 smithi163 bash[24253]: audit 2024-08-31T02:51:34.983305+0000 mgr.a (mgr.14388) 1745 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:35.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:35 smithi027 bash[22610]: audit 2024-08-31T02:51:34.983305+0000 mgr.a (mgr.14388) 1745 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:35 smithi191 bash[24992]: audit 2024-08-31T02:51:34.983305+0000 mgr.a (mgr.14388) 1745 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:36 smithi163 bash[24253]: cluster 2024-08-31T02:51:36.266339+0000 mgr.a (mgr.14388) 1746 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:36.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:36 smithi027 bash[22610]: cluster 2024-08-31T02:51:36.266339+0000 mgr.a (mgr.14388) 1746 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:36 smithi191 bash[24992]: cluster 2024-08-31T02:51:36.266339+0000 mgr.a (mgr.14388) 1746 : cluster [DBG] pgmap v1209: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:38 smithi163 bash[24253]: cluster 2024-08-31T02:51:38.268463+0000 mgr.a (mgr.14388) 1747 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:38.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:38 smithi027 bash[22610]: cluster 2024-08-31T02:51:38.268463+0000 mgr.a (mgr.14388) 1747 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:38 smithi191 bash[24992]: cluster 2024-08-31T02:51:38.268463+0000 mgr.a (mgr.14388) 1747 : cluster [DBG] pgmap v1210: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:40.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:40.395 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:40.395 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:40 smithi163 bash[24253]: cluster 2024-08-31T02:51:40.269363+0000 mgr.a (mgr.14388) 1748 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:40.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:40 smithi027 bash[22610]: cluster 2024-08-31T02:51:40.269363+0000 mgr.a (mgr.14388) 1748 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:40 smithi191 bash[24992]: cluster 2024-08-31T02:51:40.269363+0000 mgr.a (mgr.14388) 1748 : cluster [DBG] pgmap v1211: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:41.170 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:41.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:41.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:41.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:41.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:41 smithi163 bash[24253]: audit 2024-08-31T02:51:40.735250+0000 mgr.a (mgr.14388) 1749 : audit [DBG] from='client.50373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:41.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:41 smithi027 bash[22610]: audit 2024-08-31T02:51:40.735250+0000 mgr.a (mgr.14388) 1749 : audit [DBG] from='client.50373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:41 smithi191 bash[24992]: audit 2024-08-31T02:51:40.735250+0000 mgr.a (mgr.14388) 1749 : audit [DBG] from='client.50373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:42 smithi163 bash[24253]: cluster 2024-08-31T02:51:42.270279+0000 mgr.a (mgr.14388) 1750 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:42.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:42 smithi027 bash[22610]: cluster 2024-08-31T02:51:42.270279+0000 mgr.a (mgr.14388) 1750 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:42 smithi191 bash[24992]: cluster 2024-08-31T02:51:42.270279+0000 mgr.a (mgr.14388) 1750 : cluster [DBG] pgmap v1212: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:44 smithi163 bash[24253]: cluster 2024-08-31T02:51:44.272484+0000 mgr.a (mgr.14388) 1751 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:44.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:44 smithi027 bash[22610]: cluster 2024-08-31T02:51:44.272484+0000 mgr.a (mgr.14388) 1751 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:44 smithi191 bash[24992]: cluster 2024-08-31T02:51:44.272484+0000 mgr.a (mgr.14388) 1751 : cluster [DBG] pgmap v1213: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:46.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:46.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:46.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:46 smithi163 bash[24253]: cluster 2024-08-31T02:51:46.272975+0000 mgr.a (mgr.14388) 1752 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:46.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:46 smithi027 bash[22610]: cluster 2024-08-31T02:51:46.272975+0000 mgr.a (mgr.14388) 1752 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:46 smithi191 bash[24992]: cluster 2024-08-31T02:51:46.272975+0000 mgr.a (mgr.14388) 1752 : cluster [DBG] pgmap v1214: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:46.922 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:46.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:46.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:46.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:46.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:47 smithi163 bash[24253]: audit 2024-08-31T02:51:46.505085+0000 mgr.a (mgr.14388) 1753 : audit [DBG] from='client.50445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:47.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:47 smithi027 bash[22610]: audit 2024-08-31T02:51:46.505085+0000 mgr.a (mgr.14388) 1753 : audit [DBG] from='client.50445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:47 smithi191 bash[24992]: audit 2024-08-31T02:51:46.505085+0000 mgr.a (mgr.14388) 1753 : audit [DBG] from='client.50445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:48 smithi163 bash[24253]: cluster 2024-08-31T02:51:48.275246+0000 mgr.a (mgr.14388) 1754 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:48.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:48 smithi027 bash[22610]: cluster 2024-08-31T02:51:48.275246+0000 mgr.a (mgr.14388) 1754 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:48 smithi191 bash[24992]: cluster 2024-08-31T02:51:48.275246+0000 mgr.a (mgr.14388) 1754 : cluster [DBG] pgmap v1215: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:50 smithi163 bash[24253]: cluster 2024-08-31T02:51:50.276014+0000 mgr.a (mgr.14388) 1755 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:50.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:50 smithi027 bash[22610]: cluster 2024-08-31T02:51:50.276014+0000 mgr.a (mgr.14388) 1755 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:50 smithi191 bash[24992]: cluster 2024-08-31T02:51:50.276014+0000 mgr.a (mgr.14388) 1755 : cluster [DBG] pgmap v1216: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:51.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:51.924 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:51.924 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:52.694 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:52.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:52.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:52.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:52.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:52 smithi163 bash[24253]: audit 2024-08-31T02:51:52.262556+0000 mgr.a (mgr.14388) 1756 : audit [DBG] from='client.50520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:52 smithi163 bash[24253]: cluster 2024-08-31T02:51:52.281052+0000 mgr.a (mgr.14388) 1757 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:52.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:52 smithi027 bash[22610]: audit 2024-08-31T02:51:52.262556+0000 mgr.a (mgr.14388) 1756 : audit [DBG] from='client.50520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:52.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:52 smithi027 bash[22610]: cluster 2024-08-31T02:51:52.281052+0000 mgr.a (mgr.14388) 1757 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:52 smithi191 bash[24992]: audit 2024-08-31T02:51:52.262556+0000 mgr.a (mgr.14388) 1756 : audit [DBG] from='client.50520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:52 smithi191 bash[24992]: cluster 2024-08-31T02:51:52.281052+0000 mgr.a (mgr.14388) 1757 : cluster [DBG] pgmap v1217: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:55 smithi163 bash[24253]: cluster 2024-08-31T02:51:54.283436+0000 mgr.a (mgr.14388) 1758 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:55.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:55 smithi027 bash[22610]: cluster 2024-08-31T02:51:54.283436+0000 mgr.a (mgr.14388) 1758 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:55 smithi191 bash[24992]: cluster 2024-08-31T02:51:54.283436+0000 mgr.a (mgr.14388) 1758 : cluster [DBG] pgmap v1218: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:51:57.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:51:57.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:51:57.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:51:57.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:57 smithi163 bash[24253]: cluster 2024-08-31T02:51:56.284203+0000 mgr.a (mgr.14388) 1759 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:57.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:57 smithi027 bash[22610]: cluster 2024-08-31T02:51:56.284203+0000 mgr.a (mgr.14388) 1759 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:57 smithi191 bash[24992]: cluster 2024-08-31T02:51:56.284203+0000 mgr.a (mgr.14388) 1759 : cluster [DBG] pgmap v1219: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:58.433 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:51:58.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:51:58.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:51:58.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:51:58.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:51:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:58 smithi163 bash[24253]: audit 2024-08-31T02:51:58.028847+0000 mgr.a (mgr.14388) 1760 : audit [DBG] from='client.50595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:58.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:58 smithi027 bash[22610]: audit 2024-08-31T02:51:58.028847+0000 mgr.a (mgr.14388) 1760 : audit [DBG] from='client.50595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:58 smithi191 bash[24992]: audit 2024-08-31T02:51:58.028847+0000 mgr.a (mgr.14388) 1760 : audit [DBG] from='client.50595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:51:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:51:59 smithi163 bash[24253]: cluster 2024-08-31T02:51:58.285444+0000 mgr.a (mgr.14388) 1761 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:59.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:51:59 smithi027 bash[22610]: cluster 2024-08-31T02:51:58.285444+0000 mgr.a (mgr.14388) 1761 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:51:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:51:59 smithi191 bash[24992]: cluster 2024-08-31T02:51:58.285444+0000 mgr.a (mgr.14388) 1761 : cluster [DBG] pgmap v1220: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:01 smithi163 bash[24253]: cluster 2024-08-31T02:52:00.286258+0000 mgr.a (mgr.14388) 1762 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:01.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:01 smithi027 bash[22610]: cluster 2024-08-31T02:52:00.286258+0000 mgr.a (mgr.14388) 1762 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:01 smithi191 bash[24992]: cluster 2024-08-31T02:52:00.286258+0000 mgr.a (mgr.14388) 1762 : cluster [DBG] pgmap v1221: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:03.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:52:03.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:52:03.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:52:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:03 smithi163 bash[24253]: cluster 2024-08-31T02:52:02.287036+0000 mgr.a (mgr.14388) 1763 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:03.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:03 smithi027 bash[22610]: cluster 2024-08-31T02:52:02.287036+0000 mgr.a (mgr.14388) 1763 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:03 smithi191 bash[24992]: cluster 2024-08-31T02:52:02.287036+0000 mgr.a (mgr.14388) 1763 : cluster [DBG] pgmap v1222: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:04.210 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:52:04.210 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:52:04.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:52:04.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:52:04.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:52:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:04 smithi163 bash[24253]: audit 2024-08-31T02:52:03.775450+0000 mgr.a (mgr.14388) 1764 : audit [DBG] from='client.50673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:04.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:04 smithi027 bash[22610]: audit 2024-08-31T02:52:03.775450+0000 mgr.a (mgr.14388) 1764 : audit [DBG] from='client.50673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:04 smithi191 bash[24992]: audit 2024-08-31T02:52:03.775450+0000 mgr.a (mgr.14388) 1764 : audit [DBG] from='client.50673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:05 smithi163 bash[24253]: cluster 2024-08-31T02:52:04.288193+0000 mgr.a (mgr.14388) 1765 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:05.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:05 smithi027 bash[22610]: cluster 2024-08-31T02:52:04.288193+0000 mgr.a (mgr.14388) 1765 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:05 smithi191 bash[24992]: cluster 2024-08-31T02:52:04.288193+0000 mgr.a (mgr.14388) 1765 : cluster [DBG] pgmap v1223: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:07 smithi163 bash[24253]: cluster 2024-08-31T02:52:06.288915+0000 mgr.a (mgr.14388) 1766 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:52:07.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:07 smithi027 bash[22610]: cluster 2024-08-31T02:52:06.288915+0000 mgr.a (mgr.14388) 1766 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:52:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:07 smithi191 bash[24992]: cluster 2024-08-31T02:52:06.288915+0000 mgr.a (mgr.14388) 1766 : cluster [DBG] pgmap v1224: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:52:09.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:52:09.212 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:52:09.212 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:52:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:09 smithi163 bash[24253]: cluster 2024-08-31T02:52:08.290830+0000 mgr.a (mgr.14388) 1767 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:09 smithi163 bash[24253]: audit 2024-08-31T02:52:08.502627+0000 mon.a (mon.0) 858 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:52:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:09 smithi163 bash[24253]: audit 2024-08-31T02:52:09.344863+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:52:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:09 smithi163 bash[24253]: audit 2024-08-31T02:52:09.346003+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:52:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:09 smithi163 bash[24253]: audit 2024-08-31T02:52:09.354340+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:52:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:09 smithi163 bash[24253]: audit 2024-08-31T02:52:09.357251+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:52:09.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:09 smithi027 bash[22610]: cluster 2024-08-31T02:52:08.290830+0000 mgr.a (mgr.14388) 1767 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:09.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:09 smithi027 bash[22610]: audit 2024-08-31T02:52:08.502627+0000 mon.a (mon.0) 858 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:52:09.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:09 smithi027 bash[22610]: audit 2024-08-31T02:52:09.344863+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:52:09.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:09 smithi027 bash[22610]: audit 2024-08-31T02:52:09.346003+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:52:09.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:09 smithi027 bash[22610]: audit 2024-08-31T02:52:09.354340+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:52:09.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:09 smithi027 bash[22610]: audit 2024-08-31T02:52:09.357251+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:52:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:09 smithi191 bash[24992]: cluster 2024-08-31T02:52:08.290830+0000 mgr.a (mgr.14388) 1767 : cluster [DBG] pgmap v1225: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:09 smithi191 bash[24992]: audit 2024-08-31T02:52:08.502627+0000 mon.a (mon.0) 858 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:52:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:09 smithi191 bash[24992]: audit 2024-08-31T02:52:09.344863+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:52:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:09 smithi191 bash[24992]: audit 2024-08-31T02:52:09.346003+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:52:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:09 smithi191 bash[24992]: audit 2024-08-31T02:52:09.354340+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:52:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:09 smithi191 bash[24992]: audit 2024-08-31T02:52:09.357251+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:52:10.388 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:52:10 smithi027 bash[22863]: debug 2024-08-31T02:52:10.051+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:52:10.388 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:52:10 smithi027 bash[22863]: debug 2024-08-31T02:52:10.059+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:52:10.441 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:52:10.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:52:10.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:52:10.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:52:10.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:52:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:10 smithi163 bash[24253]: audit 2024-08-31T02:52:09.359521+0000 mgr.a (mgr.14388) 1768 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:52:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:10 smithi163 bash[24253]: audit 2024-08-31T02:52:09.559861+0000 mgr.a (mgr.14388) 1769 : audit [DBG] from='client.50742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:10 smithi163 bash[24253]: audit 2024-08-31T02:52:10.055091+0000 mgr.a (mgr.14388) 1770 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:52:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:10 smithi163 bash[24253]: cephadm 2024-08-31T02:52:10.065386+0000 mgr.a (mgr.14388) 1771 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:52:10.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:10 smithi027 bash[22610]: audit 2024-08-31T02:52:09.359521+0000 mgr.a (mgr.14388) 1768 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:52:10.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:10 smithi027 bash[22610]: audit 2024-08-31T02:52:09.559861+0000 mgr.a (mgr.14388) 1769 : audit [DBG] from='client.50742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:10.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:10 smithi027 bash[22610]: audit 2024-08-31T02:52:10.055091+0000 mgr.a (mgr.14388) 1770 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:52:10.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:10 smithi027 bash[22610]: cephadm 2024-08-31T02:52:10.065386+0000 mgr.a (mgr.14388) 1771 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:52:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:10 smithi191 bash[24992]: audit 2024-08-31T02:52:09.359521+0000 mgr.a (mgr.14388) 1768 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:52:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:10 smithi191 bash[24992]: audit 2024-08-31T02:52:09.559861+0000 mgr.a (mgr.14388) 1769 : audit [DBG] from='client.50742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:10 smithi191 bash[24992]: audit 2024-08-31T02:52:10.055091+0000 mgr.a (mgr.14388) 1770 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:52:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:10 smithi191 bash[24992]: cephadm 2024-08-31T02:52:10.065386+0000 mgr.a (mgr.14388) 1771 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:52:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:11 smithi163 bash[24253]: cluster 2024-08-31T02:52:10.291337+0000 mgr.a (mgr.14388) 1772 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:11.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:11 smithi027 bash[22610]: cluster 2024-08-31T02:52:10.291337+0000 mgr.a (mgr.14388) 1772 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:11 smithi191 bash[24992]: cluster 2024-08-31T02:52:10.291337+0000 mgr.a (mgr.14388) 1772 : cluster [DBG] pgmap v1226: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:13 smithi163 bash[24253]: cluster 2024-08-31T02:52:12.292502+0000 mgr.a (mgr.14388) 1773 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:13.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:13 smithi027 bash[22610]: cluster 2024-08-31T02:52:12.292502+0000 mgr.a (mgr.14388) 1773 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:13 smithi191 bash[24992]: cluster 2024-08-31T02:52:12.292502+0000 mgr.a (mgr.14388) 1773 : cluster [DBG] pgmap v1227: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:15.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:52:15.443 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:52:15.443 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:52:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:15 smithi163 bash[24253]: cluster 2024-08-31T02:52:14.294856+0000 mgr.a (mgr.14388) 1774 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:15.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:15 smithi027 bash[22610]: cluster 2024-08-31T02:52:14.294856+0000 mgr.a (mgr.14388) 1774 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:15 smithi191 bash[24992]: cluster 2024-08-31T02:52:14.294856+0000 mgr.a (mgr.14388) 1774 : cluster [DBG] pgmap v1228: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:16.180 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:52:16.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:52:16.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:52:16.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:52:16.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:52:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:16 smithi163 bash[24253]: audit 2024-08-31T02:52:15.774871+0000 mgr.a (mgr.14388) 1775 : audit [DBG] from='client.50925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:16.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:16 smithi027 bash[22610]: audit 2024-08-31T02:52:15.774871+0000 mgr.a (mgr.14388) 1775 : audit [DBG] from='client.50925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:16 smithi191 bash[24992]: audit 2024-08-31T02:52:15.774871+0000 mgr.a (mgr.14388) 1775 : audit [DBG] from='client.50925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:17.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:17 smithi163 bash[24253]: cluster 2024-08-31T02:52:16.295412+0000 mgr.a (mgr.14388) 1776 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:17.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:17 smithi027 bash[22610]: cluster 2024-08-31T02:52:16.295412+0000 mgr.a (mgr.14388) 1776 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:17 smithi191 bash[24992]: cluster 2024-08-31T02:52:16.295412+0000 mgr.a (mgr.14388) 1776 : cluster [DBG] pgmap v1229: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:19.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:19 smithi163 bash[24253]: cluster 2024-08-31T02:52:18.297452+0000 mgr.a (mgr.14388) 1777 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:19.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:19 smithi027 bash[22610]: cluster 2024-08-31T02:52:18.297452+0000 mgr.a (mgr.14388) 1777 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:19 smithi191 bash[24992]: cluster 2024-08-31T02:52:18.297452+0000 mgr.a (mgr.14388) 1777 : cluster [DBG] pgmap v1230: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:21.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:52:21.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:52:21.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:52:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:21 smithi163 bash[24253]: cluster 2024-08-31T02:52:20.298177+0000 mgr.a (mgr.14388) 1778 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:21.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:21 smithi027 bash[22610]: cluster 2024-08-31T02:52:20.298177+0000 mgr.a (mgr.14388) 1778 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:21 smithi191 bash[24992]: cluster 2024-08-31T02:52:20.298177+0000 mgr.a (mgr.14388) 1778 : cluster [DBG] pgmap v1231: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:21.931 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:52:21.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:52:21.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:52:21.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:52:21.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:52:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:22 smithi163 bash[24253]: audit 2024-08-31T02:52:21.516836+0000 mgr.a (mgr.14388) 1779 : audit [DBG] from='client.51000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:22.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:22 smithi027 bash[22610]: audit 2024-08-31T02:52:21.516836+0000 mgr.a (mgr.14388) 1779 : audit [DBG] from='client.51000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:22 smithi191 bash[24992]: audit 2024-08-31T02:52:21.516836+0000 mgr.a (mgr.14388) 1779 : audit [DBG] from='client.51000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:23 smithi163 bash[24253]: cluster 2024-08-31T02:52:22.299191+0000 mgr.a (mgr.14388) 1780 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:23.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:23 smithi027 bash[22610]: cluster 2024-08-31T02:52:22.299191+0000 mgr.a (mgr.14388) 1780 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:23 smithi191 bash[24992]: cluster 2024-08-31T02:52:22.299191+0000 mgr.a (mgr.14388) 1780 : cluster [DBG] pgmap v1232: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:52:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:25 smithi163 bash[24253]: cluster 2024-08-31T02:52:24.301546+0000 mgr.a (mgr.14388) 1781 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-08-31T02:52:25.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:25 smithi027 bash[22610]: cluster 2024-08-31T02:52:24.301546+0000 mgr.a (mgr.14388) 1781 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-08-31T02:52:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:25 smithi191 bash[24992]: cluster 2024-08-31T02:52:24.301546+0000 mgr.a (mgr.14388) 1781 : cluster [DBG] pgmap v1233: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-08-31T02:52:26.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:52:26.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:52:26.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:52:27.673 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:52:27.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:52:27.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:52:27.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:52:27.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:52:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:27 smithi163 bash[24253]: cluster 2024-08-31T02:52:26.302475+0000 mgr.a (mgr.14388) 1782 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:27 smithi163 bash[24253]: audit 2024-08-31T02:52:27.268908+0000 mgr.a (mgr.14388) 1783 : audit [DBG] from='client.51078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:27.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:27 smithi027 bash[22610]: cluster 2024-08-31T02:52:26.302475+0000 mgr.a (mgr.14388) 1782 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:27.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:27 smithi027 bash[22610]: audit 2024-08-31T02:52:27.268908+0000 mgr.a (mgr.14388) 1783 : audit [DBG] from='client.51078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:27 smithi191 bash[24992]: cluster 2024-08-31T02:52:26.302475+0000 mgr.a (mgr.14388) 1782 : cluster [DBG] pgmap v1234: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:27 smithi191 bash[24992]: audit 2024-08-31T02:52:27.268908+0000 mgr.a (mgr.14388) 1783 : audit [DBG] from='client.51078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:29 smithi163 bash[24253]: cluster 2024-08-31T02:52:28.304761+0000 mgr.a (mgr.14388) 1784 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-08-31T02:52:29.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:29 smithi027 bash[22610]: cluster 2024-08-31T02:52:28.304761+0000 mgr.a (mgr.14388) 1784 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-08-31T02:52:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:29 smithi191 bash[24992]: cluster 2024-08-31T02:52:28.304761+0000 mgr.a (mgr.14388) 1784 : cluster [DBG] pgmap v1235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 68 op/s 2024-08-31T02:52:31.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:31 smithi027 bash[22610]: cluster 2024-08-31T02:52:30.305579+0000 mgr.a (mgr.14388) 1785 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:31 smithi191 bash[24992]: cluster 2024-08-31T02:52:30.305579+0000 mgr.a (mgr.14388) 1785 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:31 smithi163 bash[24253]: cluster 2024-08-31T02:52:30.305579+0000 mgr.a (mgr.14388) 1785 : cluster [DBG] pgmap v1236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:32.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:52:32.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:52:32.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:52:33.430 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:52:33.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:52:33.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:52:33.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:52:33.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:52:33.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:33 smithi027 bash[22610]: cluster 2024-08-31T02:52:32.306382+0000 mgr.a (mgr.14388) 1786 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:33.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:33 smithi027 bash[22610]: audit 2024-08-31T02:52:33.013908+0000 mgr.a (mgr.14388) 1787 : audit [DBG] from='client.51156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:33 smithi191 bash[24992]: cluster 2024-08-31T02:52:32.306382+0000 mgr.a (mgr.14388) 1786 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:33 smithi191 bash[24992]: audit 2024-08-31T02:52:33.013908+0000 mgr.a (mgr.14388) 1787 : audit [DBG] from='client.51156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:33 smithi163 bash[24253]: cluster 2024-08-31T02:52:32.306382+0000 mgr.a (mgr.14388) 1786 : cluster [DBG] pgmap v1237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:33 smithi163 bash[24253]: audit 2024-08-31T02:52:33.013908+0000 mgr.a (mgr.14388) 1787 : audit [DBG] from='client.51156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:35.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:35 smithi027 bash[22610]: cluster 2024-08-31T02:52:34.309123+0000 mgr.a (mgr.14388) 1788 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:35 smithi191 bash[24992]: cluster 2024-08-31T02:52:34.309123+0000 mgr.a (mgr.14388) 1788 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:35.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:35 smithi163 bash[24253]: cluster 2024-08-31T02:52:34.309123+0000 mgr.a (mgr.14388) 1788 : cluster [DBG] pgmap v1238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T02:52:37.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:37 smithi027 bash[22610]: cluster 2024-08-31T02:52:36.310060+0000 mgr.a (mgr.14388) 1789 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:37 smithi191 bash[24992]: cluster 2024-08-31T02:52:36.310060+0000 mgr.a (mgr.14388) 1789 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:37 smithi163 bash[24253]: cluster 2024-08-31T02:52:36.310060+0000 mgr.a (mgr.14388) 1789 : cluster [DBG] pgmap v1239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:38.432 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:52:38.432 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:52:38.432 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:52:39.206 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:52:39.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:52:39.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:52:39.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:52:39.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:52:39.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:39 smithi027 bash[22610]: cluster 2024-08-31T02:52:38.312139+0000 mgr.a (mgr.14388) 1790 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:39.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:39 smithi027 bash[22610]: audit 2024-08-31T02:52:38.776507+0000 mgr.a (mgr.14388) 1791 : audit [DBG] from='client.51231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:39 smithi191 bash[24992]: cluster 2024-08-31T02:52:38.312139+0000 mgr.a (mgr.14388) 1790 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:39 smithi191 bash[24992]: audit 2024-08-31T02:52:38.776507+0000 mgr.a (mgr.14388) 1791 : audit [DBG] from='client.51231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:39 smithi163 bash[24253]: cluster 2024-08-31T02:52:38.312139+0000 mgr.a (mgr.14388) 1790 : cluster [DBG] pgmap v1240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:39 smithi163 bash[24253]: audit 2024-08-31T02:52:38.776507+0000 mgr.a (mgr.14388) 1791 : audit [DBG] from='client.51231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:41.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:41 smithi027 bash[22610]: cluster 2024-08-31T02:52:40.313070+0000 mgr.a (mgr.14388) 1792 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:41 smithi191 bash[24992]: cluster 2024-08-31T02:52:40.313070+0000 mgr.a (mgr.14388) 1792 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:41 smithi163 bash[24253]: cluster 2024-08-31T02:52:40.313070+0000 mgr.a (mgr.14388) 1792 : cluster [DBG] pgmap v1241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:52:43.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:43 smithi027 bash[22610]: cluster 2024-08-31T02:52:42.313828+0000 mgr.a (mgr.14388) 1793 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:52:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:43 smithi191 bash[24992]: cluster 2024-08-31T02:52:42.313828+0000 mgr.a (mgr.14388) 1793 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:52:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:43 smithi163 bash[24253]: cluster 2024-08-31T02:52:42.313828+0000 mgr.a (mgr.14388) 1793 : cluster [DBG] pgmap v1242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:52:44.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:52:44.209 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:52:44.209 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:52:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:52:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:52:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:52:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:52:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:52:45.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:45 smithi027 bash[22610]: cluster 2024-08-31T02:52:44.314811+0000 mgr.a (mgr.14388) 1794 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:45.730 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:45 smithi027 bash[22610]: audit 2024-08-31T02:52:44.540182+0000 mgr.a (mgr.14388) 1795 : audit [DBG] from='client.51306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:45 smithi191 bash[24992]: cluster 2024-08-31T02:52:44.314811+0000 mgr.a (mgr.14388) 1794 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:45 smithi191 bash[24992]: audit 2024-08-31T02:52:44.540182+0000 mgr.a (mgr.14388) 1795 : audit [DBG] from='client.51306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:45 smithi163 bash[24253]: cluster 2024-08-31T02:52:44.314811+0000 mgr.a (mgr.14388) 1794 : cluster [DBG] pgmap v1243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:45 smithi163 bash[24253]: audit 2024-08-31T02:52:44.540182+0000 mgr.a (mgr.14388) 1795 : audit [DBG] from='client.51306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:47 smithi191 bash[24992]: cluster 2024-08-31T02:52:46.315649+0000 mgr.a (mgr.14388) 1796 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:47 smithi163 bash[24253]: cluster 2024-08-31T02:52:46.315649+0000 mgr.a (mgr.14388) 1796 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:47.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:47 smithi027 bash[22610]: cluster 2024-08-31T02:52:46.315649+0000 mgr.a (mgr.14388) 1796 : cluster [DBG] pgmap v1244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:49 smithi191 bash[24992]: cluster 2024-08-31T02:52:48.317769+0000 mgr.a (mgr.14388) 1797 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:52:49.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:49 smithi163 bash[24253]: cluster 2024-08-31T02:52:48.317769+0000 mgr.a (mgr.14388) 1797 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:52:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:52:49.954 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:52:49.954 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:52:49.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:49 smithi027 bash[22610]: cluster 2024-08-31T02:52:48.317769+0000 mgr.a (mgr.14388) 1797 : cluster [DBG] pgmap v1245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:52:50.741 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:52:50.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:52:50.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:52:50.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:52:50.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:52:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:51 smithi191 bash[24992]: audit 2024-08-31T02:52:50.296381+0000 mgr.a (mgr.14388) 1798 : audit [DBG] from='client.51381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:51 smithi191 bash[24992]: cluster 2024-08-31T02:52:50.319086+0000 mgr.a (mgr.14388) 1799 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:51 smithi163 bash[24253]: audit 2024-08-31T02:52:50.296381+0000 mgr.a (mgr.14388) 1798 : audit [DBG] from='client.51381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:51 smithi163 bash[24253]: cluster 2024-08-31T02:52:50.319086+0000 mgr.a (mgr.14388) 1799 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:51.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:51 smithi027 bash[22610]: audit 2024-08-31T02:52:50.296381+0000 mgr.a (mgr.14388) 1798 : audit [DBG] from='client.51381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:51.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:51 smithi027 bash[22610]: cluster 2024-08-31T02:52:50.319086+0000 mgr.a (mgr.14388) 1799 : cluster [DBG] pgmap v1246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:53 smithi191 bash[24992]: cluster 2024-08-31T02:52:52.319977+0000 mgr.a (mgr.14388) 1800 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:53 smithi163 bash[24253]: cluster 2024-08-31T02:52:52.319977+0000 mgr.a (mgr.14388) 1800 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:53.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:53 smithi027 bash[22610]: cluster 2024-08-31T02:52:52.319977+0000 mgr.a (mgr.14388) 1800 : cluster [DBG] pgmap v1247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:55.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:52:55.743 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:52:55.743 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:52:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:55 smithi191 bash[24992]: cluster 2024-08-31T02:52:54.322187+0000 mgr.a (mgr.14388) 1801 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:52:55.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:55 smithi163 bash[24253]: cluster 2024-08-31T02:52:54.322187+0000 mgr.a (mgr.14388) 1801 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:52:55.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:55 smithi027 bash[22610]: cluster 2024-08-31T02:52:54.322187+0000 mgr.a (mgr.14388) 1801 : cluster [DBG] pgmap v1248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:52:56.511 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:52:56.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:52:56.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:52:56.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:52:56.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:52:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:56 smithi191 bash[24992]: audit 2024-08-31T02:52:56.086516+0000 mgr.a (mgr.14388) 1802 : audit [DBG] from='client.51456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:56 smithi163 bash[24253]: audit 2024-08-31T02:52:56.086516+0000 mgr.a (mgr.14388) 1802 : audit [DBG] from='client.51456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:56.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:56 smithi027 bash[22610]: audit 2024-08-31T02:52:56.086516+0000 mgr.a (mgr.14388) 1802 : audit [DBG] from='client.51456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:52:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:57 smithi191 bash[24992]: cluster 2024-08-31T02:52:56.322780+0000 mgr.a (mgr.14388) 1803 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:57 smithi163 bash[24253]: cluster 2024-08-31T02:52:56.322780+0000 mgr.a (mgr.14388) 1803 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:57.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:57 smithi027 bash[22610]: cluster 2024-08-31T02:52:56.322780+0000 mgr.a (mgr.14388) 1803 : cluster [DBG] pgmap v1249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:52:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:52:59 smithi191 bash[24992]: cluster 2024-08-31T02:52:58.324895+0000 mgr.a (mgr.14388) 1804 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:52:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:52:59 smithi163 bash[24253]: cluster 2024-08-31T02:52:58.324895+0000 mgr.a (mgr.14388) 1804 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:52:59.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:52:59 smithi027 bash[22610]: cluster 2024-08-31T02:52:58.324895+0000 mgr.a (mgr.14388) 1804 : cluster [DBG] pgmap v1250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:01.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:01.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:01.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:01 smithi191 bash[24992]: cluster 2024-08-31T02:53:00.325682+0000 mgr.a (mgr.14388) 1805 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:01 smithi163 bash[24253]: cluster 2024-08-31T02:53:00.325682+0000 mgr.a (mgr.14388) 1805 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:01.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:01 smithi027 bash[22610]: cluster 2024-08-31T02:53:00.325682+0000 mgr.a (mgr.14388) 1805 : cluster [DBG] pgmap v1251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:02.290 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:02.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:02.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:02.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:02.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:02 smithi191 bash[24992]: audit 2024-08-31T02:53:01.850666+0000 mgr.a (mgr.14388) 1806 : audit [DBG] from='client.51531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:02.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:02 smithi163 bash[24253]: audit 2024-08-31T02:53:01.850666+0000 mgr.a (mgr.14388) 1806 : audit [DBG] from='client.51531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:02.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:02 smithi027 bash[22610]: audit 2024-08-31T02:53:01.850666+0000 mgr.a (mgr.14388) 1806 : audit [DBG] from='client.51531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:03 smithi163 bash[24253]: cluster 2024-08-31T02:53:02.326416+0000 mgr.a (mgr.14388) 1807 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:03.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:03 smithi027 bash[22610]: cluster 2024-08-31T02:53:02.326416+0000 mgr.a (mgr.14388) 1807 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:03 smithi191 bash[24992]: cluster 2024-08-31T02:53:02.326416+0000 mgr.a (mgr.14388) 1807 : cluster [DBG] pgmap v1252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:05 smithi163 bash[24253]: cluster 2024-08-31T02:53:04.328561+0000 mgr.a (mgr.14388) 1808 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:05.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:05 smithi027 bash[22610]: cluster 2024-08-31T02:53:04.328561+0000 mgr.a (mgr.14388) 1808 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:05 smithi191 bash[24992]: cluster 2024-08-31T02:53:04.328561+0000 mgr.a (mgr.14388) 1808 : cluster [DBG] pgmap v1253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:07.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:07.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:07.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:07 smithi163 bash[24253]: cluster 2024-08-31T02:53:06.329322+0000 mgr.a (mgr.14388) 1809 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:07.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:07 smithi027 bash[22610]: cluster 2024-08-31T02:53:06.329322+0000 mgr.a (mgr.14388) 1809 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:08.034 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:08.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:08.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:08.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:08.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:07 smithi191 bash[24992]: cluster 2024-08-31T02:53:06.329322+0000 mgr.a (mgr.14388) 1809 : cluster [DBG] pgmap v1254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:08 smithi163 bash[24253]: audit 2024-08-31T02:53:07.623610+0000 mgr.a (mgr.14388) 1810 : audit [DBG] from='client.51606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:08 smithi027 bash[22610]: audit 2024-08-31T02:53:07.623610+0000 mgr.a (mgr.14388) 1810 : audit [DBG] from='client.51606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:08 smithi191 bash[24992]: audit 2024-08-31T02:53:07.623610+0000 mgr.a (mgr.14388) 1810 : audit [DBG] from='client.51606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:09 smithi163 bash[24253]: cluster 2024-08-31T02:53:08.331641+0000 mgr.a (mgr.14388) 1811 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:53:09.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:09 smithi027 bash[22610]: cluster 2024-08-31T02:53:08.331641+0000 mgr.a (mgr.14388) 1811 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:53:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:09 smithi191 bash[24992]: cluster 2024-08-31T02:53:08.331641+0000 mgr.a (mgr.14388) 1811 : cluster [DBG] pgmap v1255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:53:10.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:10 smithi163 bash[24253]: audit 2024-08-31T02:53:10.118951+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:53:10.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:10 smithi027 bash[22610]: audit 2024-08-31T02:53:10.118951+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:53:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:10 smithi191 bash[24992]: audit 2024-08-31T02:53:10.118951+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:53:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:11 smithi163 bash[24253]: cluster 2024-08-31T02:53:10.332370+0000 mgr.a (mgr.14388) 1812 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:53:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:11 smithi163 bash[24253]: audit 2024-08-31T02:53:10.963881+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:53:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:11 smithi163 bash[24253]: audit 2024-08-31T02:53:10.965605+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:53:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:11 smithi163 bash[24253]: audit 2024-08-31T02:53:10.976381+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:53:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:11 smithi163 bash[24253]: audit 2024-08-31T02:53:10.981220+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:53:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:11 smithi163 bash[24253]: audit 2024-08-31T02:53:10.983588+0000 mgr.a (mgr.14388) 1813 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:53:11.980 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:53:11 smithi027 bash[22863]: debug 2024-08-31T02:53:11.693+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:53:11.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:53:11 smithi027 bash[22863]: debug 2024-08-31T02:53:11.697+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:53:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:11 smithi027 bash[22610]: cluster 2024-08-31T02:53:10.332370+0000 mgr.a (mgr.14388) 1812 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:53:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:11 smithi027 bash[22610]: audit 2024-08-31T02:53:10.963881+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:53:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:11 smithi027 bash[22610]: audit 2024-08-31T02:53:10.965605+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:53:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:11 smithi027 bash[22610]: audit 2024-08-31T02:53:10.976381+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:53:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:11 smithi027 bash[22610]: audit 2024-08-31T02:53:10.981220+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:53:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:11 smithi027 bash[22610]: audit 2024-08-31T02:53:10.983588+0000 mgr.a (mgr.14388) 1813 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:53:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:11 smithi191 bash[24992]: cluster 2024-08-31T02:53:10.332370+0000 mgr.a (mgr.14388) 1812 : cluster [DBG] pgmap v1256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:53:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:11 smithi191 bash[24992]: audit 2024-08-31T02:53:10.963881+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:53:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:11 smithi191 bash[24992]: audit 2024-08-31T02:53:10.965605+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:53:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:11 smithi191 bash[24992]: audit 2024-08-31T02:53:10.976381+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:53:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:11 smithi191 bash[24992]: audit 2024-08-31T02:53:10.981220+0000 mon.a (mon.0) 867 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:53:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:11 smithi191 bash[24992]: audit 2024-08-31T02:53:10.983588+0000 mgr.a (mgr.14388) 1813 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:53:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:12 smithi163 bash[24253]: audit 2024-08-31T02:53:11.698322+0000 mgr.a (mgr.14388) 1814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:53:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:12 smithi163 bash[24253]: cephadm 2024-08-31T02:53:11.699544+0000 mgr.a (mgr.14388) 1815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:53:12.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:12 smithi027 bash[22610]: audit 2024-08-31T02:53:11.698322+0000 mgr.a (mgr.14388) 1814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:53:12.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:12 smithi027 bash[22610]: cephadm 2024-08-31T02:53:11.699544+0000 mgr.a (mgr.14388) 1815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:53:13.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:13.036 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:13.036 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:12 smithi191 bash[24992]: audit 2024-08-31T02:53:11.698322+0000 mgr.a (mgr.14388) 1814 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:53:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:12 smithi191 bash[24992]: cephadm 2024-08-31T02:53:11.699544+0000 mgr.a (mgr.14388) 1815 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:53:13.786 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:13.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:13.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:13.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:13.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:13.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:13 smithi163 bash[24253]: cluster 2024-08-31T02:53:12.333318+0000 mgr.a (mgr.14388) 1816 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:53:13.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:13 smithi027 bash[22610]: cluster 2024-08-31T02:53:12.333318+0000 mgr.a (mgr.14388) 1816 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:53:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:13 smithi191 bash[24992]: cluster 2024-08-31T02:53:12.333318+0000 mgr.a (mgr.14388) 1816 : cluster [DBG] pgmap v1257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:53:14.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:14 smithi163 bash[24253]: audit 2024-08-31T02:53:13.373404+0000 mgr.a (mgr.14388) 1817 : audit [DBG] from='client.51789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:14.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:14 smithi027 bash[22610]: audit 2024-08-31T02:53:13.373404+0000 mgr.a (mgr.14388) 1817 : audit [DBG] from='client.51789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:14 smithi191 bash[24992]: audit 2024-08-31T02:53:13.373404+0000 mgr.a (mgr.14388) 1817 : audit [DBG] from='client.51789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:15 smithi163 bash[24253]: cluster 2024-08-31T02:53:14.336052+0000 mgr.a (mgr.14388) 1818 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:53:15.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:15 smithi027 bash[22610]: cluster 2024-08-31T02:53:14.336052+0000 mgr.a (mgr.14388) 1818 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:53:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:15 smithi191 bash[24992]: cluster 2024-08-31T02:53:14.336052+0000 mgr.a (mgr.14388) 1818 : cluster [DBG] pgmap v1258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:53:17.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:17 smithi163 bash[24253]: cluster 2024-08-31T02:53:16.336841+0000 mgr.a (mgr.14388) 1819 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:53:17.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:17 smithi027 bash[22610]: cluster 2024-08-31T02:53:16.336841+0000 mgr.a (mgr.14388) 1819 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:53:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:17 smithi191 bash[24992]: cluster 2024-08-31T02:53:16.336841+0000 mgr.a (mgr.14388) 1819 : cluster [DBG] pgmap v1259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:53:18.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:18.788 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:18.788 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:19.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:19.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:19.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:19.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:19.560 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:19.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:19 smithi163 bash[24253]: cluster 2024-08-31T02:53:18.338736+0000 mgr.a (mgr.14388) 1820 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:53:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:19 smithi163 bash[24253]: audit 2024-08-31T02:53:19.126503+0000 mgr.a (mgr.14388) 1821 : audit [DBG] from='client.51867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:19.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:19 smithi027 bash[22610]: cluster 2024-08-31T02:53:18.338736+0000 mgr.a (mgr.14388) 1820 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:53:19.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:19 smithi027 bash[22610]: audit 2024-08-31T02:53:19.126503+0000 mgr.a (mgr.14388) 1821 : audit [DBG] from='client.51867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:19 smithi191 bash[24992]: cluster 2024-08-31T02:53:18.338736+0000 mgr.a (mgr.14388) 1820 : cluster [DBG] pgmap v1260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:53:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:19 smithi191 bash[24992]: audit 2024-08-31T02:53:19.126503+0000 mgr.a (mgr.14388) 1821 : audit [DBG] from='client.51867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:21 smithi163 bash[24253]: cluster 2024-08-31T02:53:20.339632+0000 mgr.a (mgr.14388) 1822 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:53:21.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:21 smithi027 bash[22610]: cluster 2024-08-31T02:53:20.339632+0000 mgr.a (mgr.14388) 1822 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:53:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:21 smithi191 bash[24992]: cluster 2024-08-31T02:53:20.339632+0000 mgr.a (mgr.14388) 1822 : cluster [DBG] pgmap v1261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:53:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:23 smithi163 bash[24253]: cluster 2024-08-31T02:53:22.340429+0000 mgr.a (mgr.14388) 1823 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:53:23.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:23 smithi027 bash[22610]: cluster 2024-08-31T02:53:22.340429+0000 mgr.a (mgr.14388) 1823 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:53:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:23 smithi191 bash[24992]: cluster 2024-08-31T02:53:22.340429+0000 mgr.a (mgr.14388) 1823 : cluster [DBG] pgmap v1262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:53:24.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:24.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:24.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:25.304 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:25.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:25.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:25.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:25.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:25 smithi163 bash[24253]: cluster 2024-08-31T02:53:24.342602+0000 mgr.a (mgr.14388) 1824 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:53:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:25 smithi163 bash[24253]: audit 2024-08-31T02:53:24.893459+0000 mgr.a (mgr.14388) 1825 : audit [DBG] from='client.51945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:25.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:25 smithi027 bash[22610]: cluster 2024-08-31T02:53:24.342602+0000 mgr.a (mgr.14388) 1824 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:53:25.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:25 smithi027 bash[22610]: audit 2024-08-31T02:53:24.893459+0000 mgr.a (mgr.14388) 1825 : audit [DBG] from='client.51945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:25 smithi191 bash[24992]: cluster 2024-08-31T02:53:24.342602+0000 mgr.a (mgr.14388) 1824 : cluster [DBG] pgmap v1263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:53:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:25 smithi191 bash[24992]: audit 2024-08-31T02:53:24.893459+0000 mgr.a (mgr.14388) 1825 : audit [DBG] from='client.51945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:27 smithi163 bash[24253]: cluster 2024-08-31T02:53:26.343469+0000 mgr.a (mgr.14388) 1826 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:27.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:27 smithi027 bash[22610]: cluster 2024-08-31T02:53:26.343469+0000 mgr.a (mgr.14388) 1826 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:27 smithi191 bash[24992]: cluster 2024-08-31T02:53:26.343469+0000 mgr.a (mgr.14388) 1826 : cluster [DBG] pgmap v1264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:29.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:29 smithi163 bash[24253]: cluster 2024-08-31T02:53:28.345723+0000 mgr.a (mgr.14388) 1827 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:29.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:29 smithi027 bash[22610]: cluster 2024-08-31T02:53:28.345723+0000 mgr.a (mgr.14388) 1827 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:29 smithi191 bash[24992]: cluster 2024-08-31T02:53:28.345723+0000 mgr.a (mgr.14388) 1827 : cluster [DBG] pgmap v1265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:30.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:30.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:30.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:31.081 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:31.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:31.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:31.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:31.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:31.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:31 smithi163 bash[24253]: cluster 2024-08-31T02:53:30.346314+0000 mgr.a (mgr.14388) 1828 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:31 smithi163 bash[24253]: audit 2024-08-31T02:53:30.645213+0000 mgr.a (mgr.14388) 1829 : audit [DBG] from='client.52020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:31.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:31 smithi027 bash[22610]: cluster 2024-08-31T02:53:30.346314+0000 mgr.a (mgr.14388) 1828 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:31.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:31 smithi027 bash[22610]: audit 2024-08-31T02:53:30.645213+0000 mgr.a (mgr.14388) 1829 : audit [DBG] from='client.52020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:31 smithi191 bash[24992]: cluster 2024-08-31T02:53:30.346314+0000 mgr.a (mgr.14388) 1828 : cluster [DBG] pgmap v1266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:31 smithi191 bash[24992]: audit 2024-08-31T02:53:30.645213+0000 mgr.a (mgr.14388) 1829 : audit [DBG] from='client.52020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:33.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:33 smithi163 bash[24253]: cluster 2024-08-31T02:53:32.347220+0000 mgr.a (mgr.14388) 1830 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:33.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:33 smithi027 bash[22610]: cluster 2024-08-31T02:53:32.347220+0000 mgr.a (mgr.14388) 1830 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:33 smithi191 bash[24992]: cluster 2024-08-31T02:53:32.347220+0000 mgr.a (mgr.14388) 1830 : cluster [DBG] pgmap v1267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:35 smithi163 bash[24253]: cluster 2024-08-31T02:53:34.349446+0000 mgr.a (mgr.14388) 1831 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:35.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:35 smithi027 bash[22610]: cluster 2024-08-31T02:53:34.349446+0000 mgr.a (mgr.14388) 1831 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:35 smithi191 bash[24992]: cluster 2024-08-31T02:53:34.349446+0000 mgr.a (mgr.14388) 1831 : cluster [DBG] pgmap v1268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:36.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:36.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:36.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:36.825 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:37.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:37 smithi163 bash[24253]: cluster 2024-08-31T02:53:36.350141+0000 mgr.a (mgr.14388) 1832 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:37 smithi163 bash[24253]: audit 2024-08-31T02:53:36.412781+0000 mgr.a (mgr.14388) 1833 : audit [DBG] from='client.52098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:37.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:37 smithi027 bash[22610]: cluster 2024-08-31T02:53:36.350141+0000 mgr.a (mgr.14388) 1832 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:37.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:37 smithi027 bash[22610]: audit 2024-08-31T02:53:36.412781+0000 mgr.a (mgr.14388) 1833 : audit [DBG] from='client.52098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:37 smithi191 bash[24992]: cluster 2024-08-31T02:53:36.350141+0000 mgr.a (mgr.14388) 1832 : cluster [DBG] pgmap v1269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:37 smithi191 bash[24992]: audit 2024-08-31T02:53:36.412781+0000 mgr.a (mgr.14388) 1833 : audit [DBG] from='client.52098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:39 smithi163 bash[24253]: cluster 2024-08-31T02:53:38.352367+0000 mgr.a (mgr.14388) 1834 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:39.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:39 smithi027 bash[22610]: cluster 2024-08-31T02:53:38.352367+0000 mgr.a (mgr.14388) 1834 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:39 smithi191 bash[24992]: cluster 2024-08-31T02:53:38.352367+0000 mgr.a (mgr.14388) 1834 : cluster [DBG] pgmap v1270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:41.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:41.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:41.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:41.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:41 smithi163 bash[24253]: cluster 2024-08-31T02:53:40.353151+0000 mgr.a (mgr.14388) 1835 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:41.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:41 smithi027 bash[22610]: cluster 2024-08-31T02:53:40.353151+0000 mgr.a (mgr.14388) 1835 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:41 smithi191 bash[24992]: cluster 2024-08-31T02:53:40.353151+0000 mgr.a (mgr.14388) 1835 : cluster [DBG] pgmap v1271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:42.598 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:42.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:42.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:42.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:42.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:42.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:42 smithi163 bash[24253]: audit 2024-08-31T02:53:42.165229+0000 mgr.a (mgr.14388) 1836 : audit [DBG] from='client.52170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:42.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:42 smithi027 bash[22610]: audit 2024-08-31T02:53:42.165229+0000 mgr.a (mgr.14388) 1836 : audit [DBG] from='client.52170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:42 smithi191 bash[24992]: audit 2024-08-31T02:53:42.165229+0000 mgr.a (mgr.14388) 1836 : audit [DBG] from='client.52170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:43 smithi163 bash[24253]: cluster 2024-08-31T02:53:42.353691+0000 mgr.a (mgr.14388) 1837 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:43.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:43 smithi027 bash[22610]: cluster 2024-08-31T02:53:42.353691+0000 mgr.a (mgr.14388) 1837 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:43 smithi191 bash[24992]: cluster 2024-08-31T02:53:42.353691+0000 mgr.a (mgr.14388) 1837 : cluster [DBG] pgmap v1272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:45.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:45 smithi163 bash[24253]: cluster 2024-08-31T02:53:44.355920+0000 mgr.a (mgr.14388) 1838 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:45.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:45 smithi027 bash[22610]: cluster 2024-08-31T02:53:44.355920+0000 mgr.a (mgr.14388) 1838 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:45 smithi191 bash[24992]: cluster 2024-08-31T02:53:44.355920+0000 mgr.a (mgr.14388) 1838 : cluster [DBG] pgmap v1273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:53:47.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:47.600 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:47.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:47 smithi163 bash[24253]: cluster 2024-08-31T02:53:46.356668+0000 mgr.a (mgr.14388) 1839 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:47.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:47 smithi027 bash[22610]: cluster 2024-08-31T02:53:46.356668+0000 mgr.a (mgr.14388) 1839 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:47 smithi191 bash[24992]: cluster 2024-08-31T02:53:46.356668+0000 mgr.a (mgr.14388) 1839 : cluster [DBG] pgmap v1274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:48.382 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:48.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:48.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:48.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:48.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:48.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:48 smithi163 bash[24253]: audit 2024-08-31T02:53:47.938484+0000 mgr.a (mgr.14388) 1840 : audit [DBG] from='client.52245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:48.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:48 smithi027 bash[22610]: audit 2024-08-31T02:53:47.938484+0000 mgr.a (mgr.14388) 1840 : audit [DBG] from='client.52245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:48 smithi191 bash[24992]: audit 2024-08-31T02:53:47.938484+0000 mgr.a (mgr.14388) 1840 : audit [DBG] from='client.52245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:49.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:49 smithi163 bash[24253]: cluster 2024-08-31T02:53:48.357883+0000 mgr.a (mgr.14388) 1841 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:49.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:49 smithi027 bash[22610]: cluster 2024-08-31T02:53:48.357883+0000 mgr.a (mgr.14388) 1841 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:49 smithi191 bash[24992]: cluster 2024-08-31T02:53:48.357883+0000 mgr.a (mgr.14388) 1841 : cluster [DBG] pgmap v1275: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:51.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:51 smithi163 bash[24253]: cluster 2024-08-31T02:53:50.358619+0000 mgr.a (mgr.14388) 1842 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:53:51.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:51 smithi027 bash[22610]: cluster 2024-08-31T02:53:50.358619+0000 mgr.a (mgr.14388) 1842 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:53:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:51 smithi191 bash[24992]: cluster 2024-08-31T02:53:50.358619+0000 mgr.a (mgr.14388) 1842 : cluster [DBG] pgmap v1276: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:53:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:53.384 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:53.385 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:53.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:53 smithi163 bash[24253]: cluster 2024-08-31T02:53:52.359361+0000 mgr.a (mgr.14388) 1843 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:53:53.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:53 smithi027 bash[22610]: cluster 2024-08-31T02:53:52.359361+0000 mgr.a (mgr.14388) 1843 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:53:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:53 smithi191 bash[24992]: cluster 2024-08-31T02:53:52.359361+0000 mgr.a (mgr.14388) 1843 : cluster [DBG] pgmap v1277: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:53:54.133 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:54.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:54.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:54.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:54.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:54.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:54 smithi163 bash[24253]: audit 2024-08-31T02:53:53.719876+0000 mgr.a (mgr.14388) 1844 : audit [DBG] from='client.52323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:54.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:54 smithi027 bash[22610]: audit 2024-08-31T02:53:53.719876+0000 mgr.a (mgr.14388) 1844 : audit [DBG] from='client.52323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:54 smithi191 bash[24992]: audit 2024-08-31T02:53:53.719876+0000 mgr.a (mgr.14388) 1844 : audit [DBG] from='client.52323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:53:55.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:55 smithi163 bash[24253]: cluster 2024-08-31T02:53:54.361979+0000 mgr.a (mgr.14388) 1845 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:55.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:55 smithi027 bash[22610]: cluster 2024-08-31T02:53:54.361979+0000 mgr.a (mgr.14388) 1845 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:55 smithi191 bash[24992]: cluster 2024-08-31T02:53:54.361979+0000 mgr.a (mgr.14388) 1845 : cluster [DBG] pgmap v1278: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:53:57.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:57 smithi027 bash[22610]: cluster 2024-08-31T02:53:56.362779+0000 mgr.a (mgr.14388) 1846 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:53:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:57 smithi191 bash[24992]: cluster 2024-08-31T02:53:56.362779+0000 mgr.a (mgr.14388) 1846 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:53:58.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:57 smithi163 bash[24253]: cluster 2024-08-31T02:53:56.362779+0000 mgr.a (mgr.14388) 1846 : cluster [DBG] pgmap v1279: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:53:59.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:53:59.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:53:59.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:53:59.878 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:53:59.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:53:59.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:53:59.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:53:59.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:53:59.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:53:59 smithi027 bash[22610]: cluster 2024-08-31T02:53:58.364663+0000 mgr.a (mgr.14388) 1847 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:53:59 smithi191 bash[24992]: cluster 2024-08-31T02:53:58.364663+0000 mgr.a (mgr.14388) 1847 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:53:59 smithi163 bash[24253]: cluster 2024-08-31T02:53:58.364663+0000 mgr.a (mgr.14388) 1847 : cluster [DBG] pgmap v1280: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:00.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:00 smithi027 bash[22610]: audit 2024-08-31T02:53:59.467667+0000 mgr.a (mgr.14388) 1848 : audit [DBG] from='client.52401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:00 smithi191 bash[24992]: audit 2024-08-31T02:53:59.467667+0000 mgr.a (mgr.14388) 1848 : audit [DBG] from='client.52401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:00 smithi163 bash[24253]: audit 2024-08-31T02:53:59.467667+0000 mgr.a (mgr.14388) 1848 : audit [DBG] from='client.52401 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:01.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:01 smithi027 bash[22610]: cluster 2024-08-31T02:54:00.365542+0000 mgr.a (mgr.14388) 1849 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:01 smithi191 bash[24992]: cluster 2024-08-31T02:54:00.365542+0000 mgr.a (mgr.14388) 1849 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:02.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:01 smithi163 bash[24253]: cluster 2024-08-31T02:54:00.365542+0000 mgr.a (mgr.14388) 1849 : cluster [DBG] pgmap v1281: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:03.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:03 smithi027 bash[22610]: cluster 2024-08-31T02:54:02.366336+0000 mgr.a (mgr.14388) 1850 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:03 smithi191 bash[24992]: cluster 2024-08-31T02:54:02.366336+0000 mgr.a (mgr.14388) 1850 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:04.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:03 smithi163 bash[24253]: cluster 2024-08-31T02:54:02.366336+0000 mgr.a (mgr.14388) 1850 : cluster [DBG] pgmap v1282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:04.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:54:04.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:54:04.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:54:05.653 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:54:05.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:54:05.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:54:05.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:54:05.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:54:05.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:05 smithi027 bash[22610]: cluster 2024-08-31T02:54:04.368525+0000 mgr.a (mgr.14388) 1851 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:05.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:05 smithi027 bash[22610]: audit 2024-08-31T02:54:05.218363+0000 mgr.a (mgr.14388) 1852 : audit [DBG] from='client.52476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:05 smithi191 bash[24992]: cluster 2024-08-31T02:54:04.368525+0000 mgr.a (mgr.14388) 1851 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:05 smithi191 bash[24992]: audit 2024-08-31T02:54:05.218363+0000 mgr.a (mgr.14388) 1852 : audit [DBG] from='client.52476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:06.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:05 smithi163 bash[24253]: cluster 2024-08-31T02:54:04.368525+0000 mgr.a (mgr.14388) 1851 : cluster [DBG] pgmap v1283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:06.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:05 smithi163 bash[24253]: audit 2024-08-31T02:54:05.218363+0000 mgr.a (mgr.14388) 1852 : audit [DBG] from='client.52476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:07 smithi191 bash[24992]: cluster 2024-08-31T02:54:06.369403+0000 mgr.a (mgr.14388) 1853 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:08.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:07 smithi163 bash[24253]: cluster 2024-08-31T02:54:06.369403+0000 mgr.a (mgr.14388) 1853 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:08.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:07 smithi027 bash[22610]: cluster 2024-08-31T02:54:06.369403+0000 mgr.a (mgr.14388) 1853 : cluster [DBG] pgmap v1284: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:09 smithi191 bash[24992]: cluster 2024-08-31T02:54:08.371527+0000 mgr.a (mgr.14388) 1854 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:10.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:09 smithi163 bash[24253]: cluster 2024-08-31T02:54:08.371527+0000 mgr.a (mgr.14388) 1854 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:10.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:09 smithi027 bash[22610]: cluster 2024-08-31T02:54:08.371527+0000 mgr.a (mgr.14388) 1854 : cluster [DBG] pgmap v1285: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:10.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:54:10.655 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:54:10.655 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:54:11.397 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:54:11.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:54:11.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:54:11.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:54:11.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:54:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:11 smithi191 bash[24992]: cluster 2024-08-31T02:54:10.372283+0000 mgr.a (mgr.14388) 1855 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:11 smithi191 bash[24992]: audit 2024-08-31T02:54:10.988063+0000 mgr.a (mgr.14388) 1856 : audit [DBG] from='client.52554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:12.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:11 smithi163 bash[24253]: cluster 2024-08-31T02:54:10.372283+0000 mgr.a (mgr.14388) 1855 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:12.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:11 smithi163 bash[24253]: audit 2024-08-31T02:54:10.988063+0000 mgr.a (mgr.14388) 1856 : audit [DBG] from='client.52554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:12.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:11 smithi027 bash[22610]: cluster 2024-08-31T02:54:10.372283+0000 mgr.a (mgr.14388) 1855 : cluster [DBG] pgmap v1286: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:12.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:11 smithi027 bash[22610]: audit 2024-08-31T02:54:10.988063+0000 mgr.a (mgr.14388) 1856 : audit [DBG] from='client.52554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:12 smithi191 bash[24992]: audit 2024-08-31T02:54:11.749508+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:54:13.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:12 smithi163 bash[24253]: audit 2024-08-31T02:54:11.749508+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:54:13.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:12 smithi027 bash[22610]: audit 2024-08-31T02:54:11.749508+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:54:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:13 smithi191 bash[24992]: cluster 2024-08-31T02:54:12.373114+0000 mgr.a (mgr.14388) 1857 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:14.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:13 smithi163 bash[24253]: cluster 2024-08-31T02:54:12.373114+0000 mgr.a (mgr.14388) 1857 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:14.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:13 smithi027 bash[22610]: cluster 2024-08-31T02:54:12.373114+0000 mgr.a (mgr.14388) 1857 : cluster [DBG] pgmap v1287: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:15 smithi191 bash[24992]: cluster 2024-08-31T02:54:14.375050+0000 mgr.a (mgr.14388) 1858 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:16.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:15 smithi163 bash[24253]: cluster 2024-08-31T02:54:14.375050+0000 mgr.a (mgr.14388) 1858 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:16.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:15 smithi027 bash[22610]: cluster 2024-08-31T02:54:14.375050+0000 mgr.a (mgr.14388) 1858 : cluster [DBG] pgmap v1288: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:16.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:54:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:54:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:54:17.198 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:54:17.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:54:17.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:54:17.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:54:17.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:54:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: cluster 2024-08-31T02:54:16.375686+0000 mgr.a (mgr.14388) 1859 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:16.738050+0000 mgr.a (mgr.14388) 1860 : audit [DBG] from='client.52629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:17.106271+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:17.109393+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:17.112946+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:17.118501+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:17.123780+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:17.126837+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:17.856375+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:54:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:17.858234+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:54:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:17.868390+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:18 smithi163 bash[24253]: audit 2024-08-31T02:54:17.873270+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:54:18.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: cluster 2024-08-31T02:54:16.375686+0000 mgr.a (mgr.14388) 1859 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:16.738050+0000 mgr.a (mgr.14388) 1860 : audit [DBG] from='client.52629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:17.106271+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:17.109393+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:17.112946+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:17.118501+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:17.123780+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:17.126837+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:17.856375+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:17.858234+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:17.868390+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22610]: audit 2024-08-31T02:54:17.873270+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:54:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: cluster 2024-08-31T02:54:16.375686+0000 mgr.a (mgr.14388) 1859 : cluster [DBG] pgmap v1289: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:16.738050+0000 mgr.a (mgr.14388) 1860 : audit [DBG] from='client.52629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:17.106271+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:17.109393+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:17.112946+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:17.118501+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:17.123780+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:17.126837+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:17.856375+0000 mon.a (mon.0) 875 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:17.858234+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:17.868390+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:18 smithi191 bash[24992]: audit 2024-08-31T02:54:17.873270+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:54:18.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22863]: debug 2024-08-31T02:54:18.583+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:54:18.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:54:18 smithi027 bash[22863]: debug 2024-08-31T02:54:18.587+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:54:19.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:19 smithi163 bash[24253]: audit 2024-08-31T02:54:17.875816+0000 mgr.a (mgr.14388) 1861 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:54:19.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:19 smithi027 bash[22610]: audit 2024-08-31T02:54:17.875816+0000 mgr.a (mgr.14388) 1861 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:54:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:19 smithi191 bash[24992]: audit 2024-08-31T02:54:17.875816+0000 mgr.a (mgr.14388) 1861 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:54:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:20 smithi163 bash[24253]: cluster 2024-08-31T02:54:18.385638+0000 mgr.a (mgr.14388) 1862 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T02:54:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:20 smithi163 bash[24253]: audit 2024-08-31T02:54:18.589626+0000 mgr.a (mgr.14388) 1863 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:54:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:20 smithi163 bash[24253]: cephadm 2024-08-31T02:54:18.591094+0000 mgr.a (mgr.14388) 1864 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:54:20.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:20 smithi027 bash[22610]: cluster 2024-08-31T02:54:18.385638+0000 mgr.a (mgr.14388) 1862 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T02:54:20.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:20 smithi027 bash[22610]: audit 2024-08-31T02:54:18.589626+0000 mgr.a (mgr.14388) 1863 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:54:20.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:20 smithi027 bash[22610]: cephadm 2024-08-31T02:54:18.591094+0000 mgr.a (mgr.14388) 1864 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:54:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:20 smithi191 bash[24992]: cluster 2024-08-31T02:54:18.385638+0000 mgr.a (mgr.14388) 1862 : cluster [DBG] pgmap v1290: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T02:54:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:20 smithi191 bash[24992]: audit 2024-08-31T02:54:18.589626+0000 mgr.a (mgr.14388) 1863 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:54:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:20 smithi191 bash[24992]: cephadm 2024-08-31T02:54:18.591094+0000 mgr.a (mgr.14388) 1864 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:54:22.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:54:22.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:54:22.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:54:22.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:22 smithi163 bash[24253]: cluster 2024-08-31T02:54:20.386404+0000 mgr.a (mgr.14388) 1865 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:54:22.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:22 smithi027 bash[22610]: cluster 2024-08-31T02:54:20.386404+0000 mgr.a (mgr.14388) 1865 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:54:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:22 smithi191 bash[24992]: cluster 2024-08-31T02:54:20.386404+0000 mgr.a (mgr.14388) 1865 : cluster [DBG] pgmap v1291: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:54:22.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:54:22.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:54:22.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:54:22.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:54:22.975 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:54:24.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:24 smithi163 bash[24253]: cluster 2024-08-31T02:54:22.387153+0000 mgr.a (mgr.14388) 1866 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:54:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:24 smithi163 bash[24253]: audit 2024-08-31T02:54:22.539468+0000 mgr.a (mgr.14388) 1867 : audit [DBG] from='client.52812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:24.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:24 smithi027 bash[22610]: cluster 2024-08-31T02:54:22.387153+0000 mgr.a (mgr.14388) 1866 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:54:24.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:24 smithi027 bash[22610]: audit 2024-08-31T02:54:22.539468+0000 mgr.a (mgr.14388) 1867 : audit [DBG] from='client.52812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:24 smithi191 bash[24992]: cluster 2024-08-31T02:54:22.387153+0000 mgr.a (mgr.14388) 1866 : cluster [DBG] pgmap v1292: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T02:54:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:24 smithi191 bash[24992]: audit 2024-08-31T02:54:22.539468+0000 mgr.a (mgr.14388) 1867 : audit [DBG] from='client.52812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:26.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:26 smithi163 bash[24253]: cluster 2024-08-31T02:54:24.389478+0000 mgr.a (mgr.14388) 1868 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:54:26.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:26 smithi027 bash[22610]: cluster 2024-08-31T02:54:24.389478+0000 mgr.a (mgr.14388) 1868 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:54:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:26 smithi191 bash[24992]: cluster 2024-08-31T02:54:24.389478+0000 mgr.a (mgr.14388) 1868 : cluster [DBG] pgmap v1293: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:54:27.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:54:27.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:54:27.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:54:28.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:28 smithi163 bash[24253]: cluster 2024-08-31T02:54:26.390255+0000 mgr.a (mgr.14388) 1869 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:54:28.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:28 smithi027 bash[22610]: cluster 2024-08-31T02:54:26.390255+0000 mgr.a (mgr.14388) 1869 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:54:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:28 smithi191 bash[24992]: cluster 2024-08-31T02:54:26.390255+0000 mgr.a (mgr.14388) 1869 : cluster [DBG] pgmap v1294: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:54:28.742 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:54:28.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:54:28.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:54:28.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:54:28.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:54:29.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:29 smithi163 bash[24253]: audit 2024-08-31T02:54:28.314106+0000 mgr.a (mgr.14388) 1870 : audit [DBG] from='client.52884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:29.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:29 smithi027 bash[22610]: audit 2024-08-31T02:54:28.314106+0000 mgr.a (mgr.14388) 1870 : audit [DBG] from='client.52884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:29 smithi191 bash[24992]: audit 2024-08-31T02:54:28.314106+0000 mgr.a (mgr.14388) 1870 : audit [DBG] from='client.52884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:30.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:30 smithi163 bash[24253]: cluster 2024-08-31T02:54:28.391909+0000 mgr.a (mgr.14388) 1871 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:54:30.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:30 smithi027 bash[22610]: cluster 2024-08-31T02:54:28.391909+0000 mgr.a (mgr.14388) 1871 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:54:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:30 smithi191 bash[24992]: cluster 2024-08-31T02:54:28.391909+0000 mgr.a (mgr.14388) 1871 : cluster [DBG] pgmap v1295: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:54:32.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:32 smithi163 bash[24253]: cluster 2024-08-31T02:54:30.392808+0000 mgr.a (mgr.14388) 1872 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:54:32.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:32 smithi027 bash[22610]: cluster 2024-08-31T02:54:30.392808+0000 mgr.a (mgr.14388) 1872 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:54:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:32 smithi191 bash[24992]: cluster 2024-08-31T02:54:30.392808+0000 mgr.a (mgr.14388) 1872 : cluster [DBG] pgmap v1296: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:54:33.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:54:33.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:54:33.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:54:34.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:34 smithi163 bash[24253]: cluster 2024-08-31T02:54:32.393625+0000 mgr.a (mgr.14388) 1873 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:54:34.476 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:54:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:54:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:54:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:54:34.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:54:34.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:34 smithi027 bash[22610]: cluster 2024-08-31T02:54:32.393625+0000 mgr.a (mgr.14388) 1873 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:54:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:34 smithi191 bash[24992]: cluster 2024-08-31T02:54:32.393625+0000 mgr.a (mgr.14388) 1873 : cluster [DBG] pgmap v1297: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T02:54:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:35 smithi163 bash[24253]: audit 2024-08-31T02:54:34.074929+0000 mgr.a (mgr.14388) 1874 : audit [DBG] from='client.52959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:35.480 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:35 smithi027 bash[22610]: audit 2024-08-31T02:54:34.074929+0000 mgr.a (mgr.14388) 1874 : audit [DBG] from='client.52959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:35 smithi191 bash[24992]: audit 2024-08-31T02:54:34.074929+0000 mgr.a (mgr.14388) 1874 : audit [DBG] from='client.52959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:36.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:36 smithi163 bash[24253]: cluster 2024-08-31T02:54:34.395346+0000 mgr.a (mgr.14388) 1875 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:54:36.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:36 smithi027 bash[22610]: cluster 2024-08-31T02:54:34.395346+0000 mgr.a (mgr.14388) 1875 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:54:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:36 smithi191 bash[24992]: cluster 2024-08-31T02:54:34.395346+0000 mgr.a (mgr.14388) 1875 : cluster [DBG] pgmap v1298: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:54:38.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:38 smithi163 bash[24253]: cluster 2024-08-31T02:54:36.396216+0000 mgr.a (mgr.14388) 1876 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:54:38.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:38 smithi027 bash[22610]: cluster 2024-08-31T02:54:36.396216+0000 mgr.a (mgr.14388) 1876 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:54:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:38 smithi191 bash[24992]: cluster 2024-08-31T02:54:36.396216+0000 mgr.a (mgr.14388) 1876 : cluster [DBG] pgmap v1299: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:54:39.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:54:39.479 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:54:39.479 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:54:40.222 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:54:40.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:54:40.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:54:40.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:54:40.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:54:40.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:40 smithi163 bash[24253]: cluster 2024-08-31T02:54:38.398345+0000 mgr.a (mgr.14388) 1877 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:54:40.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:40 smithi027 bash[22610]: cluster 2024-08-31T02:54:38.398345+0000 mgr.a (mgr.14388) 1877 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:54:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:40 smithi191 bash[24992]: cluster 2024-08-31T02:54:38.398345+0000 mgr.a (mgr.14388) 1877 : cluster [DBG] pgmap v1300: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:54:41.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:41 smithi163 bash[24253]: audit 2024-08-31T02:54:39.809007+0000 mgr.a (mgr.14388) 1878 : audit [DBG] from='client.53037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:41.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:41 smithi027 bash[22610]: audit 2024-08-31T02:54:39.809007+0000 mgr.a (mgr.14388) 1878 : audit [DBG] from='client.53037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:41 smithi191 bash[24992]: audit 2024-08-31T02:54:39.809007+0000 mgr.a (mgr.14388) 1878 : audit [DBG] from='client.53037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:42.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:42 smithi163 bash[24253]: cluster 2024-08-31T02:54:40.399209+0000 mgr.a (mgr.14388) 1879 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:42.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:42 smithi027 bash[22610]: cluster 2024-08-31T02:54:40.399209+0000 mgr.a (mgr.14388) 1879 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:42 smithi191 bash[24992]: cluster 2024-08-31T02:54:40.399209+0000 mgr.a (mgr.14388) 1879 : cluster [DBG] pgmap v1301: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:44.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:44 smithi163 bash[24253]: cluster 2024-08-31T02:54:42.400086+0000 mgr.a (mgr.14388) 1880 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:44.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:44 smithi027 bash[22610]: cluster 2024-08-31T02:54:42.400086+0000 mgr.a (mgr.14388) 1880 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:44 smithi191 bash[24992]: cluster 2024-08-31T02:54:42.400086+0000 mgr.a (mgr.14388) 1880 : cluster [DBG] pgmap v1302: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:45.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:54:45.224 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:54:45.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:54:45.996 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:54:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:54:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:54:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:54:45.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:54:46.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:46 smithi163 bash[24253]: cluster 2024-08-31T02:54:44.402423+0000 mgr.a (mgr.14388) 1881 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:46.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:46 smithi027 bash[22610]: cluster 2024-08-31T02:54:44.402423+0000 mgr.a (mgr.14388) 1881 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:46 smithi191 bash[24992]: cluster 2024-08-31T02:54:44.402423+0000 mgr.a (mgr.14388) 1881 : cluster [DBG] pgmap v1303: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:47.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:47 smithi027 bash[22610]: audit 2024-08-31T02:54:45.558493+0000 mgr.a (mgr.14388) 1882 : audit [DBG] from='client.53115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:47 smithi191 bash[24992]: audit 2024-08-31T02:54:45.558493+0000 mgr.a (mgr.14388) 1882 : audit [DBG] from='client.53115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:47.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:47 smithi163 bash[24253]: audit 2024-08-31T02:54:45.558493+0000 mgr.a (mgr.14388) 1882 : audit [DBG] from='client.53115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:48.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:48 smithi027 bash[22610]: cluster 2024-08-31T02:54:46.403350+0000 mgr.a (mgr.14388) 1883 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:48 smithi191 bash[24992]: cluster 2024-08-31T02:54:46.403350+0000 mgr.a (mgr.14388) 1883 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:48.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:48 smithi163 bash[24253]: cluster 2024-08-31T02:54:46.403350+0000 mgr.a (mgr.14388) 1883 : cluster [DBG] pgmap v1304: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:50.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:50 smithi027 bash[22610]: cluster 2024-08-31T02:54:48.405469+0000 mgr.a (mgr.14388) 1884 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:50 smithi191 bash[24992]: cluster 2024-08-31T02:54:48.405469+0000 mgr.a (mgr.14388) 1884 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:50.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:50 smithi163 bash[24253]: cluster 2024-08-31T02:54:48.405469+0000 mgr.a (mgr.14388) 1884 : cluster [DBG] pgmap v1305: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:54:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:54:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:54:51.736 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:54:51.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:54:51.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:54:51.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:54:51.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:54:52.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:52 smithi027 bash[22610]: cluster 2024-08-31T02:54:50.406236+0000 mgr.a (mgr.14388) 1885 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:52 smithi191 bash[24992]: cluster 2024-08-31T02:54:50.406236+0000 mgr.a (mgr.14388) 1885 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:52.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:52 smithi163 bash[24253]: cluster 2024-08-31T02:54:50.406236+0000 mgr.a (mgr.14388) 1885 : cluster [DBG] pgmap v1306: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:53.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:53 smithi027 bash[22610]: audit 2024-08-31T02:54:51.333628+0000 mgr.a (mgr.14388) 1886 : audit [DBG] from='client.53190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:53 smithi191 bash[24992]: audit 2024-08-31T02:54:51.333628+0000 mgr.a (mgr.14388) 1886 : audit [DBG] from='client.53190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:53.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:53 smithi163 bash[24253]: audit 2024-08-31T02:54:51.333628+0000 mgr.a (mgr.14388) 1886 : audit [DBG] from='client.53190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:54.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:54 smithi027 bash[22610]: cluster 2024-08-31T02:54:52.407365+0000 mgr.a (mgr.14388) 1887 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:54 smithi191 bash[24992]: cluster 2024-08-31T02:54:52.407365+0000 mgr.a (mgr.14388) 1887 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:54.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:54 smithi163 bash[24253]: cluster 2024-08-31T02:54:52.407365+0000 mgr.a (mgr.14388) 1887 : cluster [DBG] pgmap v1307: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:56.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:56 smithi027 bash[22610]: cluster 2024-08-31T02:54:54.409741+0000 mgr.a (mgr.14388) 1888 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:56 smithi191 bash[24992]: cluster 2024-08-31T02:54:54.409741+0000 mgr.a (mgr.14388) 1888 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:56.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:56 smithi163 bash[24253]: cluster 2024-08-31T02:54:54.409741+0000 mgr.a (mgr.14388) 1888 : cluster [DBG] pgmap v1308: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:54:56.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:54:56.738 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:54:56.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:54:57.481 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:54:57.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:54:57.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:54:57.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:54:57.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:54:58.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:58 smithi027 bash[22610]: cluster 2024-08-31T02:54:56.410701+0000 mgr.a (mgr.14388) 1889 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:58.512 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:54:58 smithi027 bash[22610]: audit 2024-08-31T02:54:57.069173+0000 mgr.a (mgr.14388) 1890 : audit [DBG] from='client.53265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:58 smithi191 bash[24992]: cluster 2024-08-31T02:54:56.410701+0000 mgr.a (mgr.14388) 1889 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:54:58 smithi191 bash[24992]: audit 2024-08-31T02:54:57.069173+0000 mgr.a (mgr.14388) 1890 : audit [DBG] from='client.53265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:54:58.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:58 smithi163 bash[24253]: cluster 2024-08-31T02:54:56.410701+0000 mgr.a (mgr.14388) 1889 : cluster [DBG] pgmap v1309: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:54:58.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:54:58 smithi163 bash[24253]: audit 2024-08-31T02:54:57.069173+0000 mgr.a (mgr.14388) 1890 : audit [DBG] from='client.53265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:00 smithi191 bash[24992]: cluster 2024-08-31T02:54:58.413038+0000 mgr.a (mgr.14388) 1891 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:55:00.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:00 smithi163 bash[24253]: cluster 2024-08-31T02:54:58.413038+0000 mgr.a (mgr.14388) 1891 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:55:00.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:00 smithi027 bash[22610]: cluster 2024-08-31T02:54:58.413038+0000 mgr.a (mgr.14388) 1891 : cluster [DBG] pgmap v1310: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:55:02.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:55:02.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:55:02.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:55:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:02 smithi191 bash[24992]: cluster 2024-08-31T02:55:00.413861+0000 mgr.a (mgr.14388) 1892 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:02.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:02 smithi163 bash[24253]: cluster 2024-08-31T02:55:00.413861+0000 mgr.a (mgr.14388) 1892 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:02.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:02 smithi027 bash[22610]: cluster 2024-08-31T02:55:00.413861+0000 mgr.a (mgr.14388) 1892 : cluster [DBG] pgmap v1311: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:03.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:55:03.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:55:03.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:55:03.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:55:03.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:55:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:04 smithi191 bash[24992]: cluster 2024-08-31T02:55:02.414635+0000 mgr.a (mgr.14388) 1893 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:04 smithi191 bash[24992]: audit 2024-08-31T02:55:02.826852+0000 mgr.a (mgr.14388) 1894 : audit [DBG] from='client.53343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:04.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:04 smithi163 bash[24253]: cluster 2024-08-31T02:55:02.414635+0000 mgr.a (mgr.14388) 1893 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:04 smithi163 bash[24253]: audit 2024-08-31T02:55:02.826852+0000 mgr.a (mgr.14388) 1894 : audit [DBG] from='client.53343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:04.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:04 smithi027 bash[22610]: cluster 2024-08-31T02:55:02.414635+0000 mgr.a (mgr.14388) 1893 : cluster [DBG] pgmap v1312: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:04.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:04 smithi027 bash[22610]: audit 2024-08-31T02:55:02.826852+0000 mgr.a (mgr.14388) 1894 : audit [DBG] from='client.53343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:06 smithi191 bash[24992]: cluster 2024-08-31T02:55:04.417364+0000 mgr.a (mgr.14388) 1895 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:55:06.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:06 smithi163 bash[24253]: cluster 2024-08-31T02:55:04.417364+0000 mgr.a (mgr.14388) 1895 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:55:06.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:06 smithi027 bash[22610]: cluster 2024-08-31T02:55:04.417364+0000 mgr.a (mgr.14388) 1895 : cluster [DBG] pgmap v1313: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:55:08.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:55:08.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:55:08.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:55:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:08 smithi191 bash[24992]: cluster 2024-08-31T02:55:06.418172+0000 mgr.a (mgr.14388) 1896 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:55:08.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:08 smithi163 bash[24253]: cluster 2024-08-31T02:55:06.418172+0000 mgr.a (mgr.14388) 1896 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:55:08.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:08 smithi027 bash[22610]: cluster 2024-08-31T02:55:06.418172+0000 mgr.a (mgr.14388) 1896 : cluster [DBG] pgmap v1314: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:55:09.015 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:55:09.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:55:09.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:55:09.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:55:09.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:55:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:10 smithi191 bash[24992]: cluster 2024-08-31T02:55:08.420127+0000 mgr.a (mgr.14388) 1897 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:10 smithi191 bash[24992]: audit 2024-08-31T02:55:08.593369+0000 mgr.a (mgr.14388) 1898 : audit [DBG] from='client.53418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:10.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:10 smithi163 bash[24253]: cluster 2024-08-31T02:55:08.420127+0000 mgr.a (mgr.14388) 1897 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:10.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:10 smithi163 bash[24253]: audit 2024-08-31T02:55:08.593369+0000 mgr.a (mgr.14388) 1898 : audit [DBG] from='client.53418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:10.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:10 smithi027 bash[22610]: cluster 2024-08-31T02:55:08.420127+0000 mgr.a (mgr.14388) 1897 : cluster [DBG] pgmap v1315: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:10.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:10 smithi027 bash[22610]: audit 2024-08-31T02:55:08.593369+0000 mgr.a (mgr.14388) 1898 : audit [DBG] from='client.53418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:12 smithi191 bash[24992]: cluster 2024-08-31T02:55:10.421271+0000 mgr.a (mgr.14388) 1899 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:55:12.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:12 smithi163 bash[24253]: cluster 2024-08-31T02:55:10.421271+0000 mgr.a (mgr.14388) 1899 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:55:12.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:12 smithi027 bash[22610]: cluster 2024-08-31T02:55:10.421271+0000 mgr.a (mgr.14388) 1899 : cluster [DBG] pgmap v1316: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:55:14.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:55:14.018 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:55:14.018 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:55:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:14 smithi191 bash[24992]: cluster 2024-08-31T02:55:12.422264+0000 mgr.a (mgr.14388) 1900 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:55:14.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:14 smithi163 bash[24253]: cluster 2024-08-31T02:55:12.422264+0000 mgr.a (mgr.14388) 1900 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:55:14.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:14 smithi027 bash[22610]: cluster 2024-08-31T02:55:12.422264+0000 mgr.a (mgr.14388) 1900 : cluster [DBG] pgmap v1317: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:55:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:55:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:55:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:55:14.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:55:14.777 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:55:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:16 smithi191 bash[24992]: audit 2024-08-31T02:55:14.358428+0000 mgr.a (mgr.14388) 1901 : audit [DBG] from='client.53496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:16 smithi191 bash[24992]: cluster 2024-08-31T02:55:14.423554+0000 mgr.a (mgr.14388) 1902 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:16.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:16 smithi163 bash[24253]: audit 2024-08-31T02:55:14.358428+0000 mgr.a (mgr.14388) 1901 : audit [DBG] from='client.53496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:16.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:16 smithi163 bash[24253]: cluster 2024-08-31T02:55:14.423554+0000 mgr.a (mgr.14388) 1902 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:16 smithi027 bash[22610]: audit 2024-08-31T02:55:14.358428+0000 mgr.a (mgr.14388) 1901 : audit [DBG] from='client.53496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:16 smithi027 bash[22610]: cluster 2024-08-31T02:55:14.423554+0000 mgr.a (mgr.14388) 1902 : cluster [DBG] pgmap v1318: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:18 smithi191 bash[24992]: cluster 2024-08-31T02:55:16.424389+0000 mgr.a (mgr.14388) 1903 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:55:18.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:18 smithi163 bash[24253]: cluster 2024-08-31T02:55:16.424389+0000 mgr.a (mgr.14388) 1903 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:55:18.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:18 smithi027 bash[22610]: cluster 2024-08-31T02:55:16.424389+0000 mgr.a (mgr.14388) 1903 : cluster [DBG] pgmap v1319: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T02:55:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:19 smithi191 bash[24992]: audit 2024-08-31T02:55:18.645591+0000 mon.a (mon.0) 879 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:55:19.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:19 smithi163 bash[24253]: audit 2024-08-31T02:55:18.645591+0000 mon.a (mon.0) 879 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:55:19.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:19 smithi027 bash[22610]: audit 2024-08-31T02:55:18.645591+0000 mon.a (mon.0) 879 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:55:19.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:55:19.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:55:19.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:55:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:20 smithi191 bash[24992]: cluster 2024-08-31T02:55:18.426766+0000 mgr.a (mgr.14388) 1904 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:55:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:20 smithi191 bash[24992]: audit 2024-08-31T02:55:19.494612+0000 mon.a (mon.0) 880 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:55:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:20 smithi191 bash[24992]: audit 2024-08-31T02:55:19.496286+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:55:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:20 smithi191 bash[24992]: audit 2024-08-31T02:55:19.506923+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:55:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:20 smithi191 bash[24992]: audit 2024-08-31T02:55:19.511812+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:55:20.647 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:55:20.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:55:20.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:55:20.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:55:20.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:55:20.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:20 smithi163 bash[24253]: cluster 2024-08-31T02:55:18.426766+0000 mgr.a (mgr.14388) 1904 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:55:20.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:20 smithi163 bash[24253]: audit 2024-08-31T02:55:19.494612+0000 mon.a (mon.0) 880 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:55:20.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:20 smithi163 bash[24253]: audit 2024-08-31T02:55:19.496286+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:55:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:20 smithi163 bash[24253]: audit 2024-08-31T02:55:19.506923+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:55:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:20 smithi163 bash[24253]: audit 2024-08-31T02:55:19.511812+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:55:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:20 smithi027 bash[22610]: cluster 2024-08-31T02:55:18.426766+0000 mgr.a (mgr.14388) 1904 : cluster [DBG] pgmap v1320: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T02:55:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:20 smithi027 bash[22610]: audit 2024-08-31T02:55:19.494612+0000 mon.a (mon.0) 880 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:55:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:20 smithi027 bash[22610]: audit 2024-08-31T02:55:19.496286+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:55:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:20 smithi027 bash[22610]: audit 2024-08-31T02:55:19.506923+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:55:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:20 smithi027 bash[22610]: audit 2024-08-31T02:55:19.511812+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:55:20.731 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:55:20 smithi027 bash[22863]: debug 2024-08-31T02:55:20.237+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:55:20.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:55:20 smithi027 bash[22863]: debug 2024-08-31T02:55:20.249+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:55:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:21 smithi191 bash[24992]: audit 2024-08-31T02:55:19.513190+0000 mgr.a (mgr.14388) 1905 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:55:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:21 smithi191 bash[24992]: audit 2024-08-31T02:55:20.117409+0000 mgr.a (mgr.14388) 1906 : audit [DBG] from='client.53628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:21 smithi191 bash[24992]: audit 2024-08-31T02:55:20.241238+0000 mgr.a (mgr.14388) 1907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:55:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:21 smithi191 bash[24992]: cephadm 2024-08-31T02:55:20.251994+0000 mgr.a (mgr.14388) 1908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:55:21.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:21 smithi163 bash[24253]: audit 2024-08-31T02:55:19.513190+0000 mgr.a (mgr.14388) 1905 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:55:21.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:21 smithi163 bash[24253]: audit 2024-08-31T02:55:20.117409+0000 mgr.a (mgr.14388) 1906 : audit [DBG] from='client.53628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:21.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:21 smithi163 bash[24253]: audit 2024-08-31T02:55:20.241238+0000 mgr.a (mgr.14388) 1907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:55:21.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:21 smithi163 bash[24253]: cephadm 2024-08-31T02:55:20.251994+0000 mgr.a (mgr.14388) 1908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:55:21.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:21 smithi027 bash[22610]: audit 2024-08-31T02:55:19.513190+0000 mgr.a (mgr.14388) 1905 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:55:21.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:21 smithi027 bash[22610]: audit 2024-08-31T02:55:20.117409+0000 mgr.a (mgr.14388) 1906 : audit [DBG] from='client.53628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:21.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:21 smithi027 bash[22610]: audit 2024-08-31T02:55:20.241238+0000 mgr.a (mgr.14388) 1907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:55:21.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:21 smithi027 bash[22610]: cephadm 2024-08-31T02:55:20.251994+0000 mgr.a (mgr.14388) 1908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:55:22.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:22 smithi163 bash[24253]: cluster 2024-08-31T02:55:20.427338+0000 mgr.a (mgr.14388) 1909 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:22.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:22 smithi027 bash[22610]: cluster 2024-08-31T02:55:20.427338+0000 mgr.a (mgr.14388) 1909 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:22 smithi191 bash[24992]: cluster 2024-08-31T02:55:20.427338+0000 mgr.a (mgr.14388) 1909 : cluster [DBG] pgmap v1321: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:24.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:24 smithi163 bash[24253]: cluster 2024-08-31T02:55:22.428340+0000 mgr.a (mgr.14388) 1910 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:24.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:24 smithi027 bash[22610]: cluster 2024-08-31T02:55:22.428340+0000 mgr.a (mgr.14388) 1910 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:24 smithi191 bash[24992]: cluster 2024-08-31T02:55:22.428340+0000 mgr.a (mgr.14388) 1910 : cluster [DBG] pgmap v1322: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:25.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:55:25.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:55:25.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:55:26.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:55:26.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:55:26.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:55:26.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:55:26.398 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:55:26.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:26 smithi163 bash[24253]: cluster 2024-08-31T02:55:24.430762+0000 mgr.a (mgr.14388) 1911 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:26.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:26 smithi027 bash[22610]: cluster 2024-08-31T02:55:24.430762+0000 mgr.a (mgr.14388) 1911 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:26 smithi191 bash[24992]: cluster 2024-08-31T02:55:24.430762+0000 mgr.a (mgr.14388) 1911 : cluster [DBG] pgmap v1323: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:27.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:27 smithi163 bash[24253]: audit 2024-08-31T02:55:25.981971+0000 mgr.a (mgr.14388) 1912 : audit [DBG] from='client.53757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:27.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:27 smithi027 bash[22610]: audit 2024-08-31T02:55:25.981971+0000 mgr.a (mgr.14388) 1912 : audit [DBG] from='client.53757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:27 smithi191 bash[24992]: audit 2024-08-31T02:55:25.981971+0000 mgr.a (mgr.14388) 1912 : audit [DBG] from='client.53757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:28.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:28 smithi163 bash[24253]: cluster 2024-08-31T02:55:26.431266+0000 mgr.a (mgr.14388) 1913 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:28.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:28 smithi027 bash[22610]: cluster 2024-08-31T02:55:26.431266+0000 mgr.a (mgr.14388) 1913 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:28 smithi191 bash[24992]: cluster 2024-08-31T02:55:26.431266+0000 mgr.a (mgr.14388) 1913 : cluster [DBG] pgmap v1324: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:30.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:30 smithi163 bash[24253]: cluster 2024-08-31T02:55:28.433379+0000 mgr.a (mgr.14388) 1914 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:30.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:30 smithi027 bash[22610]: cluster 2024-08-31T02:55:28.433379+0000 mgr.a (mgr.14388) 1914 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:30 smithi191 bash[24992]: cluster 2024-08-31T02:55:28.433379+0000 mgr.a (mgr.14388) 1914 : cluster [DBG] pgmap v1325: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:31.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:55:31.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:55:31.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:55:32.173 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:55:32.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:55:32.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:55:32.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:55:32.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:55:32.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:32 smithi163 bash[24253]: cluster 2024-08-31T02:55:30.434137+0000 mgr.a (mgr.14388) 1915 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:32.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:32 smithi027 bash[22610]: cluster 2024-08-31T02:55:30.434137+0000 mgr.a (mgr.14388) 1915 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:32 smithi191 bash[24992]: cluster 2024-08-31T02:55:30.434137+0000 mgr.a (mgr.14388) 1915 : cluster [DBG] pgmap v1326: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:33.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:33 smithi163 bash[24253]: audit 2024-08-31T02:55:31.734653+0000 mgr.a (mgr.14388) 1916 : audit [DBG] from='client.53835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:33.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:33 smithi027 bash[22610]: audit 2024-08-31T02:55:31.734653+0000 mgr.a (mgr.14388) 1916 : audit [DBG] from='client.53835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:33 smithi191 bash[24992]: audit 2024-08-31T02:55:31.734653+0000 mgr.a (mgr.14388) 1916 : audit [DBG] from='client.53835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:34.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:34 smithi163 bash[24253]: cluster 2024-08-31T02:55:32.435117+0000 mgr.a (mgr.14388) 1917 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:34.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:34 smithi027 bash[22610]: cluster 2024-08-31T02:55:32.435117+0000 mgr.a (mgr.14388) 1917 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:34 smithi191 bash[24992]: cluster 2024-08-31T02:55:32.435117+0000 mgr.a (mgr.14388) 1917 : cluster [DBG] pgmap v1327: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:36.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:36 smithi163 bash[24253]: cluster 2024-08-31T02:55:34.437338+0000 mgr.a (mgr.14388) 1918 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:36.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:36 smithi027 bash[22610]: cluster 2024-08-31T02:55:34.437338+0000 mgr.a (mgr.14388) 1918 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:36 smithi191 bash[24992]: cluster 2024-08-31T02:55:34.437338+0000 mgr.a (mgr.14388) 1918 : cluster [DBG] pgmap v1328: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:55:37.174 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:55:37.175 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:55:37.175 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:55:37.942 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:55:37.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:55:37.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:55:37.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:55:37.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:55:38.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:38 smithi163 bash[24253]: cluster 2024-08-31T02:55:36.438112+0000 mgr.a (mgr.14388) 1919 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:38.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:38 smithi027 bash[22610]: cluster 2024-08-31T02:55:36.438112+0000 mgr.a (mgr.14388) 1919 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:38 smithi191 bash[24992]: cluster 2024-08-31T02:55:36.438112+0000 mgr.a (mgr.14388) 1919 : cluster [DBG] pgmap v1329: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:39.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:39 smithi163 bash[24253]: audit 2024-08-31T02:55:37.511573+0000 mgr.a (mgr.14388) 1920 : audit [DBG] from='client.53913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:39.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:39 smithi163 bash[24253]: cluster 2024-08-31T02:55:38.440542+0000 mgr.a (mgr.14388) 1921 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:55:39.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:39 smithi027 bash[22610]: audit 2024-08-31T02:55:37.511573+0000 mgr.a (mgr.14388) 1920 : audit [DBG] from='client.53913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:39.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:39 smithi027 bash[22610]: cluster 2024-08-31T02:55:38.440542+0000 mgr.a (mgr.14388) 1921 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:55:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:39 smithi191 bash[24992]: audit 2024-08-31T02:55:37.511573+0000 mgr.a (mgr.14388) 1920 : audit [DBG] from='client.53913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:39 smithi191 bash[24992]: cluster 2024-08-31T02:55:38.440542+0000 mgr.a (mgr.14388) 1921 : cluster [DBG] pgmap v1330: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:55:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:41 smithi191 bash[24992]: cluster 2024-08-31T02:55:40.441324+0000 mgr.a (mgr.14388) 1922 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:41.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:41 smithi163 bash[24253]: cluster 2024-08-31T02:55:40.441324+0000 mgr.a (mgr.14388) 1922 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:41.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:41 smithi027 bash[22610]: cluster 2024-08-31T02:55:40.441324+0000 mgr.a (mgr.14388) 1922 : cluster [DBG] pgmap v1331: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:42.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:55:42.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:55:42.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:55:43.687 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:55:43.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:55:43.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:55:43.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:55:43.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:55:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:43 smithi191 bash[24992]: cluster 2024-08-31T02:55:42.442197+0000 mgr.a (mgr.14388) 1923 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:43 smithi191 bash[24992]: audit 2024-08-31T02:55:43.277564+0000 mgr.a (mgr.14388) 1924 : audit [DBG] from='client.53991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:43 smithi163 bash[24253]: cluster 2024-08-31T02:55:42.442197+0000 mgr.a (mgr.14388) 1923 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:43 smithi163 bash[24253]: audit 2024-08-31T02:55:43.277564+0000 mgr.a (mgr.14388) 1924 : audit [DBG] from='client.53991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:43.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:43 smithi027 bash[22610]: cluster 2024-08-31T02:55:42.442197+0000 mgr.a (mgr.14388) 1923 : cluster [DBG] pgmap v1332: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:43.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:43 smithi027 bash[22610]: audit 2024-08-31T02:55:43.277564+0000 mgr.a (mgr.14388) 1924 : audit [DBG] from='client.53991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:45 smithi191 bash[24992]: cluster 2024-08-31T02:55:44.445025+0000 mgr.a (mgr.14388) 1925 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:45.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:45 smithi163 bash[24253]: cluster 2024-08-31T02:55:44.445025+0000 mgr.a (mgr.14388) 1925 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:45.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:45 smithi027 bash[22610]: cluster 2024-08-31T02:55:44.445025+0000 mgr.a (mgr.14388) 1925 : cluster [DBG] pgmap v1333: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:47 smithi191 bash[24992]: cluster 2024-08-31T02:55:46.445812+0000 mgr.a (mgr.14388) 1926 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:55:47.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:47 smithi163 bash[24253]: cluster 2024-08-31T02:55:46.445812+0000 mgr.a (mgr.14388) 1926 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:55:47.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:47 smithi027 bash[22610]: cluster 2024-08-31T02:55:46.445812+0000 mgr.a (mgr.14388) 1926 : cluster [DBG] pgmap v1334: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:55:48.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:55:48.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:55:48.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:55:49.434 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:55:49.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:55:49.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:55:49.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:55:49.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:55:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:49 smithi191 bash[24992]: cluster 2024-08-31T02:55:48.447817+0000 mgr.a (mgr.14388) 1927 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:49 smithi191 bash[24992]: audit 2024-08-31T02:55:49.019637+0000 mgr.a (mgr.14388) 1928 : audit [DBG] from='client.54069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:49.959 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:49 smithi163 bash[24253]: cluster 2024-08-31T02:55:48.447817+0000 mgr.a (mgr.14388) 1927 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:49.960 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:49 smithi163 bash[24253]: audit 2024-08-31T02:55:49.019637+0000 mgr.a (mgr.14388) 1928 : audit [DBG] from='client.54069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:49.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:49 smithi027 bash[22610]: cluster 2024-08-31T02:55:48.447817+0000 mgr.a (mgr.14388) 1927 : cluster [DBG] pgmap v1335: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:49 smithi027 bash[22610]: audit 2024-08-31T02:55:49.019637+0000 mgr.a (mgr.14388) 1928 : audit [DBG] from='client.54069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:51 smithi191 bash[24992]: cluster 2024-08-31T02:55:50.448799+0000 mgr.a (mgr.14388) 1929 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:55:51.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:51 smithi163 bash[24253]: cluster 2024-08-31T02:55:50.448799+0000 mgr.a (mgr.14388) 1929 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:55:51.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:51 smithi027 bash[22610]: cluster 2024-08-31T02:55:50.448799+0000 mgr.a (mgr.14388) 1929 : cluster [DBG] pgmap v1336: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:55:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:53 smithi191 bash[24992]: cluster 2024-08-31T02:55:52.449566+0000 mgr.a (mgr.14388) 1930 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:55:53.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:53 smithi163 bash[24253]: cluster 2024-08-31T02:55:52.449566+0000 mgr.a (mgr.14388) 1930 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:55:53.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:53 smithi027 bash[22610]: cluster 2024-08-31T02:55:52.449566+0000 mgr.a (mgr.14388) 1930 : cluster [DBG] pgmap v1337: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:55:54.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:55:54.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:55:54.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:55:55.186 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:55:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:55:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:55:55.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:55:55.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:55:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:55 smithi191 bash[24992]: cluster 2024-08-31T02:55:54.451459+0000 mgr.a (mgr.14388) 1931 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:55 smithi191 bash[24992]: audit 2024-08-31T02:55:54.775885+0000 mgr.a (mgr.14388) 1932 : audit [DBG] from='client.54147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:55.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:55 smithi163 bash[24253]: cluster 2024-08-31T02:55:54.451459+0000 mgr.a (mgr.14388) 1931 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:55.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:55 smithi163 bash[24253]: audit 2024-08-31T02:55:54.775885+0000 mgr.a (mgr.14388) 1932 : audit [DBG] from='client.54147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:55.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:55 smithi027 bash[22610]: cluster 2024-08-31T02:55:54.451459+0000 mgr.a (mgr.14388) 1931 : cluster [DBG] pgmap v1338: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:55.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:55 smithi027 bash[22610]: audit 2024-08-31T02:55:54.775885+0000 mgr.a (mgr.14388) 1932 : audit [DBG] from='client.54147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:55:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:57 smithi191 bash[24992]: cluster 2024-08-31T02:55:56.452505+0000 mgr.a (mgr.14388) 1933 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:57.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:57 smithi163 bash[24253]: cluster 2024-08-31T02:55:56.452505+0000 mgr.a (mgr.14388) 1933 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:57 smithi027 bash[22610]: cluster 2024-08-31T02:55:56.452505+0000 mgr.a (mgr.14388) 1933 : cluster [DBG] pgmap v1339: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:55:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:55:59 smithi191 bash[24992]: cluster 2024-08-31T02:55:58.454788+0000 mgr.a (mgr.14388) 1934 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:55:59.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:55:59 smithi163 bash[24253]: cluster 2024-08-31T02:55:58.454788+0000 mgr.a (mgr.14388) 1934 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:55:59.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:55:59 smithi027 bash[22610]: cluster 2024-08-31T02:55:58.454788+0000 mgr.a (mgr.14388) 1934 : cluster [DBG] pgmap v1340: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:00.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:00.188 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:00.188 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:00.939 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:00.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:00.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:00.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:00.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:01.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:01 smithi163 bash[24253]: cluster 2024-08-31T02:56:00.455523+0000 mgr.a (mgr.14388) 1935 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:01.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:01 smithi163 bash[24253]: audit 2024-08-31T02:56:00.516322+0000 mgr.a (mgr.14388) 1936 : audit [DBG] from='client.54225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:01.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:01 smithi027 bash[22610]: cluster 2024-08-31T02:56:00.455523+0000 mgr.a (mgr.14388) 1935 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:01.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:01 smithi027 bash[22610]: audit 2024-08-31T02:56:00.516322+0000 mgr.a (mgr.14388) 1936 : audit [DBG] from='client.54225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:01 smithi191 bash[24992]: cluster 2024-08-31T02:56:00.455523+0000 mgr.a (mgr.14388) 1935 : cluster [DBG] pgmap v1341: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:01 smithi191 bash[24992]: audit 2024-08-31T02:56:00.516322+0000 mgr.a (mgr.14388) 1936 : audit [DBG] from='client.54225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:03.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:03 smithi163 bash[24253]: cluster 2024-08-31T02:56:02.456343+0000 mgr.a (mgr.14388) 1937 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:03.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:03 smithi027 bash[22610]: cluster 2024-08-31T02:56:02.456343+0000 mgr.a (mgr.14388) 1937 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:04.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:03 smithi191 bash[24992]: cluster 2024-08-31T02:56:02.456343+0000 mgr.a (mgr.14388) 1937 : cluster [DBG] pgmap v1342: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:05.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:05.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:05.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:05.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:05 smithi163 bash[24253]: cluster 2024-08-31T02:56:04.458544+0000 mgr.a (mgr.14388) 1938 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:05.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:05 smithi027 bash[22610]: cluster 2024-08-31T02:56:04.458544+0000 mgr.a (mgr.14388) 1938 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:05 smithi191 bash[24992]: cluster 2024-08-31T02:56:04.458544+0000 mgr.a (mgr.14388) 1938 : cluster [DBG] pgmap v1343: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:06.715 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:06.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:06.716 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:06.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:06 smithi163 bash[24253]: audit 2024-08-31T02:56:06.279044+0000 mgr.a (mgr.14388) 1939 : audit [DBG] from='client.54297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:06 smithi027 bash[22610]: audit 2024-08-31T02:56:06.279044+0000 mgr.a (mgr.14388) 1939 : audit [DBG] from='client.54297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:06 smithi191 bash[24992]: audit 2024-08-31T02:56:06.279044+0000 mgr.a (mgr.14388) 1939 : audit [DBG] from='client.54297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:07.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:07 smithi163 bash[24253]: cluster 2024-08-31T02:56:06.459109+0000 mgr.a (mgr.14388) 1940 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:07.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:07 smithi027 bash[22610]: cluster 2024-08-31T02:56:06.459109+0000 mgr.a (mgr.14388) 1940 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:07 smithi191 bash[24992]: cluster 2024-08-31T02:56:06.459109+0000 mgr.a (mgr.14388) 1940 : cluster [DBG] pgmap v1344: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:09.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:09 smithi163 bash[24253]: cluster 2024-08-31T02:56:08.461270+0000 mgr.a (mgr.14388) 1941 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:09.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:09 smithi027 bash[22610]: cluster 2024-08-31T02:56:08.461270+0000 mgr.a (mgr.14388) 1941 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:09 smithi191 bash[24992]: cluster 2024-08-31T02:56:08.461270+0000 mgr.a (mgr.14388) 1941 : cluster [DBG] pgmap v1345: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:11.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:11.718 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:11.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:11 smithi163 bash[24253]: cluster 2024-08-31T02:56:10.462049+0000 mgr.a (mgr.14388) 1942 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:11 smithi027 bash[22610]: cluster 2024-08-31T02:56:10.462049+0000 mgr.a (mgr.14388) 1942 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:11 smithi191 bash[24992]: cluster 2024-08-31T02:56:10.462049+0000 mgr.a (mgr.14388) 1942 : cluster [DBG] pgmap v1346: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:12.470 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:12.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:12.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:12.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:12.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:12.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:12 smithi163 bash[24253]: audit 2024-08-31T02:56:12.052806+0000 mgr.a (mgr.14388) 1943 : audit [DBG] from='client.54372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:12.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:12 smithi027 bash[22610]: audit 2024-08-31T02:56:12.052806+0000 mgr.a (mgr.14388) 1943 : audit [DBG] from='client.54372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:12 smithi191 bash[24992]: audit 2024-08-31T02:56:12.052806+0000 mgr.a (mgr.14388) 1943 : audit [DBG] from='client.54372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:13.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:13 smithi163 bash[24253]: cluster 2024-08-31T02:56:12.462586+0000 mgr.a (mgr.14388) 1944 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:13.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:13 smithi027 bash[22610]: cluster 2024-08-31T02:56:12.462586+0000 mgr.a (mgr.14388) 1944 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:13 smithi191 bash[24992]: cluster 2024-08-31T02:56:12.462586+0000 mgr.a (mgr.14388) 1944 : cluster [DBG] pgmap v1347: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:15 smithi163 bash[24253]: cluster 2024-08-31T02:56:14.464835+0000 mgr.a (mgr.14388) 1945 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:15.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:15 smithi027 bash[22610]: cluster 2024-08-31T02:56:14.464835+0000 mgr.a (mgr.14388) 1945 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:15 smithi191 bash[24992]: cluster 2024-08-31T02:56:14.464835+0000 mgr.a (mgr.14388) 1945 : cluster [DBG] pgmap v1348: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:17.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:17.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:17.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:17.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:17 smithi163 bash[24253]: cluster 2024-08-31T02:56:16.465615+0000 mgr.a (mgr.14388) 1946 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:17.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:17 smithi027 bash[22610]: cluster 2024-08-31T02:56:16.465615+0000 mgr.a (mgr.14388) 1946 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:17 smithi191 bash[24992]: cluster 2024-08-31T02:56:16.465615+0000 mgr.a (mgr.14388) 1946 : cluster [DBG] pgmap v1349: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:18.238 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:18.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:18.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:18.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:18.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:18.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:18 smithi163 bash[24253]: audit 2024-08-31T02:56:17.808267+0000 mgr.a (mgr.14388) 1947 : audit [DBG] from='client.54450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:18 smithi027 bash[22610]: audit 2024-08-31T02:56:17.808267+0000 mgr.a (mgr.14388) 1947 : audit [DBG] from='client.54450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:18 smithi191 bash[24992]: audit 2024-08-31T02:56:17.808267+0000 mgr.a (mgr.14388) 1947 : audit [DBG] from='client.54450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:19.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:19 smithi163 bash[24253]: cluster 2024-08-31T02:56:18.468045+0000 mgr.a (mgr.14388) 1948 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:56:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:19 smithi027 bash[22610]: cluster 2024-08-31T02:56:18.468045+0000 mgr.a (mgr.14388) 1948 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:56:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:19 smithi191 bash[24992]: cluster 2024-08-31T02:56:18.468045+0000 mgr.a (mgr.14388) 1948 : cluster [DBG] pgmap v1350: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:56:20.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:20 smithi163 bash[24253]: audit 2024-08-31T02:56:20.309820+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:56:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:20 smithi027 bash[22610]: audit 2024-08-31T02:56:20.309820+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:56:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:20 smithi191 bash[24992]: audit 2024-08-31T02:56:20.309820+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:56:21.887 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:21 smithi027 bash[22610]: cluster 2024-08-31T02:56:20.468804+0000 mgr.a (mgr.14388) 1949 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:56:21.887 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:21 smithi027 bash[22610]: audit 2024-08-31T02:56:21.159986+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:56:21.887 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:21 smithi027 bash[22610]: audit 2024-08-31T02:56:21.161708+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:56:21.887 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:21 smithi027 bash[22610]: audit 2024-08-31T02:56:21.172075+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:56:21.887 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:21 smithi027 bash[22610]: audit 2024-08-31T02:56:21.176993+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:56:21.888 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:21 smithi027 bash[22610]: audit 2024-08-31T02:56:21.179419+0000 mgr.a (mgr.14388) 1950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:56:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:21 smithi163 bash[24253]: cluster 2024-08-31T02:56:20.468804+0000 mgr.a (mgr.14388) 1949 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:56:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:21 smithi163 bash[24253]: audit 2024-08-31T02:56:21.159986+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:56:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:21 smithi163 bash[24253]: audit 2024-08-31T02:56:21.161708+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:56:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:21 smithi163 bash[24253]: audit 2024-08-31T02:56:21.172075+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:56:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:21 smithi163 bash[24253]: audit 2024-08-31T02:56:21.176993+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:56:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:21 smithi163 bash[24253]: audit 2024-08-31T02:56:21.179419+0000 mgr.a (mgr.14388) 1950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:56:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:21 smithi191 bash[24992]: cluster 2024-08-31T02:56:20.468804+0000 mgr.a (mgr.14388) 1949 : cluster [DBG] pgmap v1351: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:56:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:21 smithi191 bash[24992]: audit 2024-08-31T02:56:21.159986+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:56:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:21 smithi191 bash[24992]: audit 2024-08-31T02:56:21.161708+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:56:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:21 smithi191 bash[24992]: audit 2024-08-31T02:56:21.172075+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:56:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:21 smithi191 bash[24992]: audit 2024-08-31T02:56:21.176993+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:56:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:21 smithi191 bash[24992]: audit 2024-08-31T02:56:21.179419+0000 mgr.a (mgr.14388) 1950 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:56:22.231 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:56:21 smithi027 bash[22863]: debug 2024-08-31T02:56:21.883+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:56:22.231 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:56:21 smithi027 bash[22863]: debug 2024-08-31T02:56:21.883+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:56:22.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:22 smithi163 bash[24253]: audit 2024-08-31T02:56:21.888825+0000 mgr.a (mgr.14388) 1951 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:56:22.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:22 smithi163 bash[24253]: cephadm 2024-08-31T02:56:21.890078+0000 mgr.a (mgr.14388) 1952 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:56:22.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:22 smithi027 bash[22610]: audit 2024-08-31T02:56:21.888825+0000 mgr.a (mgr.14388) 1951 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:56:22.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:22 smithi027 bash[22610]: cephadm 2024-08-31T02:56:21.890078+0000 mgr.a (mgr.14388) 1952 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:56:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:22 smithi191 bash[24992]: audit 2024-08-31T02:56:21.888825+0000 mgr.a (mgr.14388) 1951 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:56:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:22 smithi191 bash[24992]: cephadm 2024-08-31T02:56:21.890078+0000 mgr.a (mgr.14388) 1952 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:56:23.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:23.240 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:23.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:23 smithi163 bash[24253]: cluster 2024-08-31T02:56:22.469728+0000 mgr.a (mgr.14388) 1953 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:56:23.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:23 smithi027 bash[22610]: cluster 2024-08-31T02:56:22.469728+0000 mgr.a (mgr.14388) 1953 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:56:24.002 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:24.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:24.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:24.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:24.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:23 smithi191 bash[24992]: cluster 2024-08-31T02:56:22.469728+0000 mgr.a (mgr.14388) 1953 : cluster [DBG] pgmap v1352: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T02:56:24.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:24 smithi163 bash[24253]: audit 2024-08-31T02:56:23.573295+0000 mgr.a (mgr.14388) 1954 : audit [DBG] from='client.54633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:24 smithi027 bash[22610]: audit 2024-08-31T02:56:23.573295+0000 mgr.a (mgr.14388) 1954 : audit [DBG] from='client.54633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:24 smithi191 bash[24992]: audit 2024-08-31T02:56:23.573295+0000 mgr.a (mgr.14388) 1954 : audit [DBG] from='client.54633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:25.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:25 smithi163 bash[24253]: cluster 2024-08-31T02:56:24.472493+0000 mgr.a (mgr.14388) 1955 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:56:25.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:25 smithi027 bash[22610]: cluster 2024-08-31T02:56:24.472493+0000 mgr.a (mgr.14388) 1955 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:56:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:25 smithi191 bash[24992]: cluster 2024-08-31T02:56:24.472493+0000 mgr.a (mgr.14388) 1955 : cluster [DBG] pgmap v1353: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:56:27.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:27 smithi163 bash[24253]: cluster 2024-08-31T02:56:26.473298+0000 mgr.a (mgr.14388) 1956 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:56:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:27 smithi027 bash[22610]: cluster 2024-08-31T02:56:26.473298+0000 mgr.a (mgr.14388) 1956 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:56:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:27 smithi191 bash[24992]: cluster 2024-08-31T02:56:26.473298+0000 mgr.a (mgr.14388) 1956 : cluster [DBG] pgmap v1354: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:56:29.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:29.004 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:29.004 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:29.781 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:29.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:29.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:29.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:29.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:29.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:29 smithi163 bash[24253]: cluster 2024-08-31T02:56:28.475264+0000 mgr.a (mgr.14388) 1957 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:56:29.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:29 smithi163 bash[24253]: audit 2024-08-31T02:56:29.332938+0000 mgr.a (mgr.14388) 1958 : audit [DBG] from='client.54708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:29.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:29 smithi027 bash[22610]: cluster 2024-08-31T02:56:28.475264+0000 mgr.a (mgr.14388) 1957 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:56:29.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:29 smithi027 bash[22610]: audit 2024-08-31T02:56:29.332938+0000 mgr.a (mgr.14388) 1958 : audit [DBG] from='client.54708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:29 smithi191 bash[24992]: cluster 2024-08-31T02:56:28.475264+0000 mgr.a (mgr.14388) 1957 : cluster [DBG] pgmap v1355: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:56:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:29 smithi191 bash[24992]: audit 2024-08-31T02:56:29.332938+0000 mgr.a (mgr.14388) 1958 : audit [DBG] from='client.54708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:31.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:31 smithi163 bash[24253]: cluster 2024-08-31T02:56:30.476259+0000 mgr.a (mgr.14388) 1959 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:56:31.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:31 smithi027 bash[22610]: cluster 2024-08-31T02:56:30.476259+0000 mgr.a (mgr.14388) 1959 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:56:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:31 smithi191 bash[24992]: cluster 2024-08-31T02:56:30.476259+0000 mgr.a (mgr.14388) 1959 : cluster [DBG] pgmap v1356: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:56:33.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:33 smithi163 bash[24253]: cluster 2024-08-31T02:56:32.477055+0000 mgr.a (mgr.14388) 1960 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:56:33.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:33 smithi027 bash[22610]: cluster 2024-08-31T02:56:32.477055+0000 mgr.a (mgr.14388) 1960 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:56:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:33 smithi191 bash[24992]: cluster 2024-08-31T02:56:32.477055+0000 mgr.a (mgr.14388) 1960 : cluster [DBG] pgmap v1357: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:56:34.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:34.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:34.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:35.523 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:35.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:35 smithi191 bash[24992]: cluster 2024-08-31T02:56:34.479278+0000 mgr.a (mgr.14388) 1961 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:56:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:35 smithi191 bash[24992]: audit 2024-08-31T02:56:35.114137+0000 mgr.a (mgr.14388) 1962 : audit [DBG] from='client.54786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:35.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:35 smithi163 bash[24253]: cluster 2024-08-31T02:56:34.479278+0000 mgr.a (mgr.14388) 1961 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:56:35.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:35 smithi163 bash[24253]: audit 2024-08-31T02:56:35.114137+0000 mgr.a (mgr.14388) 1962 : audit [DBG] from='client.54786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:35.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:35 smithi027 bash[22610]: cluster 2024-08-31T02:56:34.479278+0000 mgr.a (mgr.14388) 1961 : cluster [DBG] pgmap v1358: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:56:35.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:35 smithi027 bash[22610]: audit 2024-08-31T02:56:35.114137+0000 mgr.a (mgr.14388) 1962 : audit [DBG] from='client.54786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:37.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:37 smithi163 bash[24253]: cluster 2024-08-31T02:56:36.480172+0000 mgr.a (mgr.14388) 1963 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:37.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:37 smithi027 bash[22610]: cluster 2024-08-31T02:56:36.480172+0000 mgr.a (mgr.14388) 1963 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:37 smithi191 bash[24992]: cluster 2024-08-31T02:56:36.480172+0000 mgr.a (mgr.14388) 1963 : cluster [DBG] pgmap v1359: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:39.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:39 smithi163 bash[24253]: cluster 2024-08-31T02:56:38.482292+0000 mgr.a (mgr.14388) 1964 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:39.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:39 smithi027 bash[22610]: cluster 2024-08-31T02:56:38.482292+0000 mgr.a (mgr.14388) 1964 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:39 smithi191 bash[24992]: cluster 2024-08-31T02:56:38.482292+0000 mgr.a (mgr.14388) 1964 : cluster [DBG] pgmap v1360: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:40.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:40.525 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:40.525 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:41.294 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:41.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:41.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:41.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:41.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:41.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:41 smithi163 bash[24253]: cluster 2024-08-31T02:56:40.483090+0000 mgr.a (mgr.14388) 1965 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:41.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:41 smithi163 bash[24253]: audit 2024-08-31T02:56:40.867047+0000 mgr.a (mgr.14388) 1966 : audit [DBG] from='client.54864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:41 smithi027 bash[22610]: cluster 2024-08-31T02:56:40.483090+0000 mgr.a (mgr.14388) 1965 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:41 smithi027 bash[22610]: audit 2024-08-31T02:56:40.867047+0000 mgr.a (mgr.14388) 1966 : audit [DBG] from='client.54864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:41 smithi191 bash[24992]: cluster 2024-08-31T02:56:40.483090+0000 mgr.a (mgr.14388) 1965 : cluster [DBG] pgmap v1361: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:41 smithi191 bash[24992]: audit 2024-08-31T02:56:40.867047+0000 mgr.a (mgr.14388) 1966 : audit [DBG] from='client.54864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:43 smithi163 bash[24253]: cluster 2024-08-31T02:56:42.483926+0000 mgr.a (mgr.14388) 1967 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:43.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:43 smithi027 bash[22610]: cluster 2024-08-31T02:56:42.483926+0000 mgr.a (mgr.14388) 1967 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:43 smithi191 bash[24992]: cluster 2024-08-31T02:56:42.483926+0000 mgr.a (mgr.14388) 1967 : cluster [DBG] pgmap v1362: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:45.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:45 smithi163 bash[24253]: cluster 2024-08-31T02:56:44.486139+0000 mgr.a (mgr.14388) 1968 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:45.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:45 smithi027 bash[22610]: cluster 2024-08-31T02:56:44.486139+0000 mgr.a (mgr.14388) 1968 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:45 smithi191 bash[24992]: cluster 2024-08-31T02:56:44.486139+0000 mgr.a (mgr.14388) 1968 : cluster [DBG] pgmap v1363: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:46.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:46.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:46.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:47.038 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:47.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:47.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:47.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:47.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:47.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:47 smithi163 bash[24253]: cluster 2024-08-31T02:56:46.486908+0000 mgr.a (mgr.14388) 1969 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:47.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:47 smithi163 bash[24253]: audit 2024-08-31T02:56:46.632962+0000 mgr.a (mgr.14388) 1970 : audit [DBG] from='client.54942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:47.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:47 smithi027 bash[22610]: cluster 2024-08-31T02:56:46.486908+0000 mgr.a (mgr.14388) 1969 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:47.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:47 smithi027 bash[22610]: audit 2024-08-31T02:56:46.632962+0000 mgr.a (mgr.14388) 1970 : audit [DBG] from='client.54942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:47 smithi191 bash[24992]: cluster 2024-08-31T02:56:46.486908+0000 mgr.a (mgr.14388) 1969 : cluster [DBG] pgmap v1364: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:47 smithi191 bash[24992]: audit 2024-08-31T02:56:46.632962+0000 mgr.a (mgr.14388) 1970 : audit [DBG] from='client.54942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:49.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:49 smithi163 bash[24253]: cluster 2024-08-31T02:56:48.489119+0000 mgr.a (mgr.14388) 1971 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:49.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:49 smithi027 bash[22610]: cluster 2024-08-31T02:56:48.489119+0000 mgr.a (mgr.14388) 1971 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:49 smithi191 bash[24992]: cluster 2024-08-31T02:56:48.489119+0000 mgr.a (mgr.14388) 1971 : cluster [DBG] pgmap v1365: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:51.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:51 smithi027 bash[22610]: cluster 2024-08-31T02:56:50.489936+0000 mgr.a (mgr.14388) 1972 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:51 smithi191 bash[24992]: cluster 2024-08-31T02:56:50.489936+0000 mgr.a (mgr.14388) 1972 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:52.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:52.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:52.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:52.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:51 smithi163 bash[24253]: cluster 2024-08-31T02:56:50.489936+0000 mgr.a (mgr.14388) 1972 : cluster [DBG] pgmap v1366: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:52.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:52.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:52.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:52.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:52.791 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:53.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:53 smithi027 bash[22610]: audit 2024-08-31T02:56:52.370737+0000 mgr.a (mgr.14388) 1973 : audit [DBG] from='client.55020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:53.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:53 smithi027 bash[22610]: cluster 2024-08-31T02:56:52.490521+0000 mgr.a (mgr.14388) 1974 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:53 smithi191 bash[24992]: audit 2024-08-31T02:56:52.370737+0000 mgr.a (mgr.14388) 1973 : audit [DBG] from='client.55020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:53 smithi191 bash[24992]: cluster 2024-08-31T02:56:52.490521+0000 mgr.a (mgr.14388) 1974 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:54.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:53 smithi163 bash[24253]: audit 2024-08-31T02:56:52.370737+0000 mgr.a (mgr.14388) 1973 : audit [DBG] from='client.55020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:54.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:53 smithi163 bash[24253]: cluster 2024-08-31T02:56:52.490521+0000 mgr.a (mgr.14388) 1974 : cluster [DBG] pgmap v1367: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:55.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:55 smithi027 bash[22610]: cluster 2024-08-31T02:56:54.492926+0000 mgr.a (mgr.14388) 1975 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:55 smithi191 bash[24992]: cluster 2024-08-31T02:56:54.492926+0000 mgr.a (mgr.14388) 1975 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:56.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:55 smithi163 bash[24253]: cluster 2024-08-31T02:56:54.492926+0000 mgr.a (mgr.14388) 1975 : cluster [DBG] pgmap v1368: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:56:57.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:56:57.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:56:57.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:56:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:57 smithi027 bash[22610]: cluster 2024-08-31T02:56:56.493859+0000 mgr.a (mgr.14388) 1976 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:57 smithi191 bash[24992]: cluster 2024-08-31T02:56:56.493859+0000 mgr.a (mgr.14388) 1976 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:58.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:57 smithi163 bash[24253]: cluster 2024-08-31T02:56:56.493859+0000 mgr.a (mgr.14388) 1976 : cluster [DBG] pgmap v1369: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:56:58.549 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:56:58.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:56:58.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:56:58.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:56:58.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:56:58.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:58 smithi027 bash[22610]: audit 2024-08-31T02:56:58.126561+0000 mgr.a (mgr.14388) 1977 : audit [DBG] from='client.55098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:58 smithi191 bash[24992]: audit 2024-08-31T02:56:58.126561+0000 mgr.a (mgr.14388) 1977 : audit [DBG] from='client.55098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:59.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:58 smithi163 bash[24253]: audit 2024-08-31T02:56:58.126561+0000 mgr.a (mgr.14388) 1977 : audit [DBG] from='client.55098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:56:59.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:56:59 smithi027 bash[22610]: cluster 2024-08-31T02:56:58.495161+0000 mgr.a (mgr.14388) 1978 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:56:59 smithi191 bash[24992]: cluster 2024-08-31T02:56:58.495161+0000 mgr.a (mgr.14388) 1978 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:00.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:56:59 smithi163 bash[24253]: cluster 2024-08-31T02:56:58.495161+0000 mgr.a (mgr.14388) 1978 : cluster [DBG] pgmap v1370: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:01.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:01 smithi027 bash[22610]: cluster 2024-08-31T02:57:00.495845+0000 mgr.a (mgr.14388) 1979 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:02.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:01 smithi191 bash[24992]: cluster 2024-08-31T02:57:00.495845+0000 mgr.a (mgr.14388) 1979 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:02.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:01 smithi163 bash[24253]: cluster 2024-08-31T02:57:00.495845+0000 mgr.a (mgr.14388) 1979 : cluster [DBG] pgmap v1371: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:03.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:57:03.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:57:03.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:57:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:03 smithi191 bash[24992]: cluster 2024-08-31T02:57:02.496580+0000 mgr.a (mgr.14388) 1980 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:04.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:03 smithi163 bash[24253]: cluster 2024-08-31T02:57:02.496580+0000 mgr.a (mgr.14388) 1980 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:04.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:03 smithi027 bash[22610]: cluster 2024-08-31T02:57:02.496580+0000 mgr.a (mgr.14388) 1980 : cluster [DBG] pgmap v1372: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:04.298 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:57:04.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:57:04.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:57:04.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:57:04.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:57:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:04 smithi191 bash[24992]: audit 2024-08-31T02:57:03.883421+0000 mgr.a (mgr.14388) 1981 : audit [DBG] from='client.55176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:05.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:04 smithi163 bash[24253]: audit 2024-08-31T02:57:03.883421+0000 mgr.a (mgr.14388) 1981 : audit [DBG] from='client.55176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:04 smithi027 bash[22610]: audit 2024-08-31T02:57:03.883421+0000 mgr.a (mgr.14388) 1981 : audit [DBG] from='client.55176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:05 smithi191 bash[24992]: cluster 2024-08-31T02:57:04.499229+0000 mgr.a (mgr.14388) 1982 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:06.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:05 smithi163 bash[24253]: cluster 2024-08-31T02:57:04.499229+0000 mgr.a (mgr.14388) 1982 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:06.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:05 smithi027 bash[22610]: cluster 2024-08-31T02:57:04.499229+0000 mgr.a (mgr.14388) 1982 : cluster [DBG] pgmap v1373: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:07 smithi191 bash[24992]: cluster 2024-08-31T02:57:06.499997+0000 mgr.a (mgr.14388) 1983 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:57:08.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:07 smithi163 bash[24253]: cluster 2024-08-31T02:57:06.499997+0000 mgr.a (mgr.14388) 1983 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:57:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:07 smithi027 bash[22610]: cluster 2024-08-31T02:57:06.499997+0000 mgr.a (mgr.14388) 1983 : cluster [DBG] pgmap v1374: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:57:09.299 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:57:09.300 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:57:09.300 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:57:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:09 smithi191 bash[24992]: cluster 2024-08-31T02:57:08.501923+0000 mgr.a (mgr.14388) 1984 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:10.080 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:57:10.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:57:10.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:57:10.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:57:10.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:57:10.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:09 smithi163 bash[24253]: cluster 2024-08-31T02:57:08.501923+0000 mgr.a (mgr.14388) 1984 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:10.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:09 smithi027 bash[22610]: cluster 2024-08-31T02:57:08.501923+0000 mgr.a (mgr.14388) 1984 : cluster [DBG] pgmap v1375: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:10 smithi191 bash[24992]: audit 2024-08-31T02:57:09.642875+0000 mgr.a (mgr.14388) 1985 : audit [DBG] from='client.55251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:11.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:10 smithi163 bash[24253]: audit 2024-08-31T02:57:09.642875+0000 mgr.a (mgr.14388) 1985 : audit [DBG] from='client.55251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:11.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:10 smithi027 bash[22610]: audit 2024-08-31T02:57:09.642875+0000 mgr.a (mgr.14388) 1985 : audit [DBG] from='client.55251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:11 smithi191 bash[24992]: cluster 2024-08-31T02:57:10.502901+0000 mgr.a (mgr.14388) 1986 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:12.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:11 smithi163 bash[24253]: cluster 2024-08-31T02:57:10.502901+0000 mgr.a (mgr.14388) 1986 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:12.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:11 smithi027 bash[22610]: cluster 2024-08-31T02:57:10.502901+0000 mgr.a (mgr.14388) 1986 : cluster [DBG] pgmap v1376: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:13 smithi191 bash[24992]: cluster 2024-08-31T02:57:12.503615+0000 mgr.a (mgr.14388) 1987 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:14.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:13 smithi163 bash[24253]: cluster 2024-08-31T02:57:12.503615+0000 mgr.a (mgr.14388) 1987 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:14.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:13 smithi027 bash[22610]: cluster 2024-08-31T02:57:12.503615+0000 mgr.a (mgr.14388) 1987 : cluster [DBG] pgmap v1377: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:57:15.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:57:15.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:57:15.834 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:57:15.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:57:15.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:57:15.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:57:15.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:57:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:15 smithi191 bash[24992]: cluster 2024-08-31T02:57:14.505768+0000 mgr.a (mgr.14388) 1988 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:57:16.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:15 smithi163 bash[24253]: cluster 2024-08-31T02:57:14.505768+0000 mgr.a (mgr.14388) 1988 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:57:16.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:15 smithi027 bash[22610]: cluster 2024-08-31T02:57:14.505768+0000 mgr.a (mgr.14388) 1988 : cluster [DBG] pgmap v1378: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:57:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:16 smithi191 bash[24992]: audit 2024-08-31T02:57:15.420299+0000 mgr.a (mgr.14388) 1989 : audit [DBG] from='client.55326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:17.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:16 smithi163 bash[24253]: audit 2024-08-31T02:57:15.420299+0000 mgr.a (mgr.14388) 1989 : audit [DBG] from='client.55326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:17.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:16 smithi027 bash[22610]: audit 2024-08-31T02:57:15.420299+0000 mgr.a (mgr.14388) 1989 : audit [DBG] from='client.55326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:17 smithi191 bash[24992]: cluster 2024-08-31T02:57:16.506665+0000 mgr.a (mgr.14388) 1990 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:18.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:17 smithi163 bash[24253]: cluster 2024-08-31T02:57:16.506665+0000 mgr.a (mgr.14388) 1990 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:18.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:17 smithi027 bash[22610]: cluster 2024-08-31T02:57:16.506665+0000 mgr.a (mgr.14388) 1990 : cluster [DBG] pgmap v1379: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:20.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:19 smithi163 bash[24253]: cluster 2024-08-31T02:57:18.508892+0000 mgr.a (mgr.14388) 1991 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:57:20.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:19 smithi027 bash[22610]: cluster 2024-08-31T02:57:18.508892+0000 mgr.a (mgr.14388) 1991 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:57:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:19 smithi191 bash[24992]: cluster 2024-08-31T02:57:18.508892+0000 mgr.a (mgr.14388) 1991 : cluster [DBG] pgmap v1380: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:57:20.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:57:20.836 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:57:20.836 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:57:21.600 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:57:21.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:57:21.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:57:21.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:57:21.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:57:22.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:21 smithi163 bash[24253]: cluster 2024-08-31T02:57:20.509673+0000 mgr.a (mgr.14388) 1992 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:22.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:21 smithi163 bash[24253]: audit 2024-08-31T02:57:21.170629+0000 mgr.a (mgr.14388) 1993 : audit [DBG] from='client.55404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:22.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:21 smithi027 bash[22610]: cluster 2024-08-31T02:57:20.509673+0000 mgr.a (mgr.14388) 1992 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:22.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:21 smithi027 bash[22610]: audit 2024-08-31T02:57:21.170629+0000 mgr.a (mgr.14388) 1993 : audit [DBG] from='client.55404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:21 smithi191 bash[24992]: cluster 2024-08-31T02:57:20.509673+0000 mgr.a (mgr.14388) 1992 : cluster [DBG] pgmap v1381: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:21 smithi191 bash[24992]: audit 2024-08-31T02:57:21.170629+0000 mgr.a (mgr.14388) 1993 : audit [DBG] from='client.55404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:23.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:22 smithi163 bash[24253]: audit 2024-08-31T02:57:21.940895+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:57:23.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:22 smithi163 bash[24253]: audit 2024-08-31T02:57:22.780353+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:57:23.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:22 smithi163 bash[24253]: audit 2024-08-31T02:57:22.782145+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:57:23.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:22 smithi163 bash[24253]: audit 2024-08-31T02:57:22.792667+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:57:23.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:22 smithi027 bash[22610]: audit 2024-08-31T02:57:21.940895+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:57:23.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:22 smithi027 bash[22610]: audit 2024-08-31T02:57:22.780353+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:57:23.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:22 smithi027 bash[22610]: audit 2024-08-31T02:57:22.782145+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:57:23.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:22 smithi027 bash[22610]: audit 2024-08-31T02:57:22.792667+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:57:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:22 smithi191 bash[24992]: audit 2024-08-31T02:57:21.940895+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:57:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:22 smithi191 bash[24992]: audit 2024-08-31T02:57:22.780353+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:57:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:22 smithi191 bash[24992]: audit 2024-08-31T02:57:22.782145+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:57:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:22 smithi191 bash[24992]: audit 2024-08-31T02:57:22.792667+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:57:23.804 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:57:23 smithi027 bash[22863]: debug 2024-08-31T02:57:23.505+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:57:23.804 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:57:23 smithi027 bash[22863]: debug 2024-08-31T02:57:23.505+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:57:24.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:23 smithi163 bash[24253]: cluster 2024-08-31T02:57:22.510559+0000 mgr.a (mgr.14388) 1994 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:24.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:23 smithi163 bash[24253]: audit 2024-08-31T02:57:22.801538+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:57:24.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:23 smithi163 bash[24253]: audit 2024-08-31T02:57:22.804488+0000 mgr.a (mgr.14388) 1995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:57:24.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:23 smithi027 bash[22610]: cluster 2024-08-31T02:57:22.510559+0000 mgr.a (mgr.14388) 1994 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:24.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:23 smithi027 bash[22610]: audit 2024-08-31T02:57:22.801538+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:57:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:23 smithi027 bash[22610]: audit 2024-08-31T02:57:22.804488+0000 mgr.a (mgr.14388) 1995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:57:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:23 smithi191 bash[24992]: cluster 2024-08-31T02:57:22.510559+0000 mgr.a (mgr.14388) 1994 : cluster [DBG] pgmap v1382: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:23 smithi191 bash[24992]: audit 2024-08-31T02:57:22.801538+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:57:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:23 smithi191 bash[24992]: audit 2024-08-31T02:57:22.804488+0000 mgr.a (mgr.14388) 1995 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:57:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:24 smithi163 bash[24253]: audit 2024-08-31T02:57:23.509275+0000 mgr.a (mgr.14388) 1996 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:57:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:24 smithi163 bash[24253]: cephadm 2024-08-31T02:57:23.510496+0000 mgr.a (mgr.14388) 1997 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:57:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:24 smithi027 bash[22610]: audit 2024-08-31T02:57:23.509275+0000 mgr.a (mgr.14388) 1996 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:57:25.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:24 smithi027 bash[22610]: cephadm 2024-08-31T02:57:23.510496+0000 mgr.a (mgr.14388) 1997 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:57:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:24 smithi191 bash[24992]: audit 2024-08-31T02:57:23.509275+0000 mgr.a (mgr.14388) 1996 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:57:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:24 smithi191 bash[24992]: cephadm 2024-08-31T02:57:23.510496+0000 mgr.a (mgr.14388) 1997 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:57:26.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:25 smithi163 bash[24253]: cluster 2024-08-31T02:57:24.513172+0000 mgr.a (mgr.14388) 1998 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-08-31T02:57:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:25 smithi027 bash[22610]: cluster 2024-08-31T02:57:24.513172+0000 mgr.a (mgr.14388) 1998 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-08-31T02:57:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:25 smithi191 bash[24992]: cluster 2024-08-31T02:57:24.513172+0000 mgr.a (mgr.14388) 1998 : cluster [DBG] pgmap v1383: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-08-31T02:57:26.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:57:26.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:57:26.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:57:27.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:57:27.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:57:27.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:57:27.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:57:27.347 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:57:28.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:27 smithi163 bash[24253]: cluster 2024-08-31T02:57:26.513949+0000 mgr.a (mgr.14388) 1999 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:57:28.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:27 smithi163 bash[24253]: audit 2024-08-31T02:57:26.933364+0000 mgr.a (mgr.14388) 2000 : audit [DBG] from='client.55590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:28.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:27 smithi027 bash[22610]: cluster 2024-08-31T02:57:26.513949+0000 mgr.a (mgr.14388) 1999 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:57:28.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:27 smithi027 bash[22610]: audit 2024-08-31T02:57:26.933364+0000 mgr.a (mgr.14388) 2000 : audit [DBG] from='client.55590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:27 smithi191 bash[24992]: cluster 2024-08-31T02:57:26.513949+0000 mgr.a (mgr.14388) 1999 : cluster [DBG] pgmap v1384: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T02:57:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:27 smithi191 bash[24992]: audit 2024-08-31T02:57:26.933364+0000 mgr.a (mgr.14388) 2000 : audit [DBG] from='client.55590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:30.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:29 smithi163 bash[24253]: cluster 2024-08-31T02:57:28.516205+0000 mgr.a (mgr.14388) 2001 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:30.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:29 smithi027 bash[22610]: cluster 2024-08-31T02:57:28.516205+0000 mgr.a (mgr.14388) 2001 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:29 smithi191 bash[24992]: cluster 2024-08-31T02:57:28.516205+0000 mgr.a (mgr.14388) 2001 : cluster [DBG] pgmap v1385: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:32.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:31 smithi163 bash[24253]: cluster 2024-08-31T02:57:30.516986+0000 mgr.a (mgr.14388) 2002 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:32.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:31 smithi027 bash[22610]: cluster 2024-08-31T02:57:30.516986+0000 mgr.a (mgr.14388) 2002 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:31 smithi191 bash[24992]: cluster 2024-08-31T02:57:30.516986+0000 mgr.a (mgr.14388) 2002 : cluster [DBG] pgmap v1386: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:32.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:57:32.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:57:32.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:57:33.088 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:57:33.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:57:33.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:57:33.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:57:33.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:57:34.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:33 smithi163 bash[24253]: cluster 2024-08-31T02:57:32.517551+0000 mgr.a (mgr.14388) 2003 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:34.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:33 smithi163 bash[24253]: audit 2024-08-31T02:57:32.681293+0000 mgr.a (mgr.14388) 2004 : audit [DBG] from='client.55668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:34.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:33 smithi027 bash[22610]: cluster 2024-08-31T02:57:32.517551+0000 mgr.a (mgr.14388) 2003 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:33 smithi027 bash[22610]: audit 2024-08-31T02:57:32.681293+0000 mgr.a (mgr.14388) 2004 : audit [DBG] from='client.55668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:33 smithi191 bash[24992]: cluster 2024-08-31T02:57:32.517551+0000 mgr.a (mgr.14388) 2003 : cluster [DBG] pgmap v1387: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:33 smithi191 bash[24992]: audit 2024-08-31T02:57:32.681293+0000 mgr.a (mgr.14388) 2004 : audit [DBG] from='client.55668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:36.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:35 smithi163 bash[24253]: cluster 2024-08-31T02:57:34.520145+0000 mgr.a (mgr.14388) 2005 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:36.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:35 smithi027 bash[22610]: cluster 2024-08-31T02:57:34.520145+0000 mgr.a (mgr.14388) 2005 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:35 smithi191 bash[24992]: cluster 2024-08-31T02:57:34.520145+0000 mgr.a (mgr.14388) 2005 : cluster [DBG] pgmap v1388: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:57:38.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:57:38.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:57:38.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:57:38.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:37 smithi163 bash[24253]: cluster 2024-08-31T02:57:36.520910+0000 mgr.a (mgr.14388) 2006 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:57:38.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:37 smithi027 bash[22610]: cluster 2024-08-31T02:57:36.520910+0000 mgr.a (mgr.14388) 2006 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:57:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:37 smithi191 bash[24992]: cluster 2024-08-31T02:57:36.520910+0000 mgr.a (mgr.14388) 2006 : cluster [DBG] pgmap v1389: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:57:38.830 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:57:38.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:57:38.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:57:38.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:57:38.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:57:40.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:39 smithi163 bash[24253]: audit 2024-08-31T02:57:38.421194+0000 mgr.a (mgr.14388) 2007 : audit [DBG] from='client.55743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:40.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:39 smithi163 bash[24253]: cluster 2024-08-31T02:57:38.522120+0000 mgr.a (mgr.14388) 2008 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:57:40.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:39 smithi027 bash[22610]: audit 2024-08-31T02:57:38.421194+0000 mgr.a (mgr.14388) 2007 : audit [DBG] from='client.55743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:39 smithi027 bash[22610]: cluster 2024-08-31T02:57:38.522120+0000 mgr.a (mgr.14388) 2008 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:57:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:39 smithi191 bash[24992]: audit 2024-08-31T02:57:38.421194+0000 mgr.a (mgr.14388) 2007 : audit [DBG] from='client.55743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:39 smithi191 bash[24992]: cluster 2024-08-31T02:57:38.522120+0000 mgr.a (mgr.14388) 2008 : cluster [DBG] pgmap v1390: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:57:42.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:41 smithi163 bash[24253]: cluster 2024-08-31T02:57:40.522998+0000 mgr.a (mgr.14388) 2009 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:42.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:41 smithi027 bash[22610]: cluster 2024-08-31T02:57:40.522998+0000 mgr.a (mgr.14388) 2009 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:41 smithi191 bash[24992]: cluster 2024-08-31T02:57:40.522998+0000 mgr.a (mgr.14388) 2009 : cluster [DBG] pgmap v1391: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:43.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:57:43.832 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:57:43.832 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:57:44.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:43 smithi163 bash[24253]: cluster 2024-08-31T02:57:42.523721+0000 mgr.a (mgr.14388) 2010 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:44.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:43 smithi027 bash[22610]: cluster 2024-08-31T02:57:42.523721+0000 mgr.a (mgr.14388) 2010 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:43 smithi191 bash[24992]: cluster 2024-08-31T02:57:42.523721+0000 mgr.a (mgr.14388) 2010 : cluster [DBG] pgmap v1392: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:57:44.571 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:57:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:57:44.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:57:44.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:57:44.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:57:45.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:44 smithi163 bash[24253]: audit 2024-08-31T02:57:44.161875+0000 mgr.a (mgr.14388) 2011 : audit [DBG] from='client.55821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:44 smithi027 bash[22610]: audit 2024-08-31T02:57:44.161875+0000 mgr.a (mgr.14388) 2011 : audit [DBG] from='client.55821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:45.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:44 smithi191 bash[24992]: audit 2024-08-31T02:57:44.161875+0000 mgr.a (mgr.14388) 2011 : audit [DBG] from='client.55821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:46.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:45 smithi163 bash[24253]: cluster 2024-08-31T02:57:44.524972+0000 mgr.a (mgr.14388) 2012 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:46.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:45 smithi027 bash[22610]: cluster 2024-08-31T02:57:44.524972+0000 mgr.a (mgr.14388) 2012 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:45 smithi191 bash[24992]: cluster 2024-08-31T02:57:44.524972+0000 mgr.a (mgr.14388) 2012 : cluster [DBG] pgmap v1393: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:48.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:47 smithi163 bash[24253]: cluster 2024-08-31T02:57:46.525824+0000 mgr.a (mgr.14388) 2013 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:57:48.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:47 smithi027 bash[22610]: cluster 2024-08-31T02:57:46.525824+0000 mgr.a (mgr.14388) 2013 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:57:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:47 smithi191 bash[24992]: cluster 2024-08-31T02:57:46.525824+0000 mgr.a (mgr.14388) 2013 : cluster [DBG] pgmap v1394: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T02:57:49.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:57:49.574 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:57:49.574 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:57:50.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:49 smithi163 bash[24253]: cluster 2024-08-31T02:57:48.527921+0000 mgr.a (mgr.14388) 2014 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:57:50.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:49 smithi027 bash[22610]: cluster 2024-08-31T02:57:48.527921+0000 mgr.a (mgr.14388) 2014 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:57:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:49 smithi191 bash[24992]: cluster 2024-08-31T02:57:48.527921+0000 mgr.a (mgr.14388) 2014 : cluster [DBG] pgmap v1395: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T02:57:50.350 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:57:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:57:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:57:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:57:50.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:57:51.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:50 smithi163 bash[24253]: audit 2024-08-31T02:57:49.909836+0000 mgr.a (mgr.14388) 2015 : audit [DBG] from='client.55899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:51.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:50 smithi027 bash[22610]: audit 2024-08-31T02:57:49.909836+0000 mgr.a (mgr.14388) 2015 : audit [DBG] from='client.55899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:51.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:50 smithi191 bash[24992]: audit 2024-08-31T02:57:49.909836+0000 mgr.a (mgr.14388) 2015 : audit [DBG] from='client.55899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:52.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:51 smithi163 bash[24253]: cluster 2024-08-31T02:57:50.528846+0000 mgr.a (mgr.14388) 2016 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:52.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:51 smithi027 bash[22610]: cluster 2024-08-31T02:57:50.528846+0000 mgr.a (mgr.14388) 2016 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:52.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:51 smithi191 bash[24992]: cluster 2024-08-31T02:57:50.528846+0000 mgr.a (mgr.14388) 2016 : cluster [DBG] pgmap v1396: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:54.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:53 smithi163 bash[24253]: cluster 2024-08-31T02:57:52.529675+0000 mgr.a (mgr.14388) 2017 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:54.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:53 smithi027 bash[22610]: cluster 2024-08-31T02:57:52.529675+0000 mgr.a (mgr.14388) 2017 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:53 smithi191 bash[24992]: cluster 2024-08-31T02:57:52.529675+0000 mgr.a (mgr.14388) 2017 : cluster [DBG] pgmap v1397: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:55.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:57:55.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:57:55.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:57:56.129 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:57:56.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:57:56.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:57:56.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:57:56.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:57:56.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:55 smithi163 bash[24253]: cluster 2024-08-31T02:57:54.531882+0000 mgr.a (mgr.14388) 2018 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:57:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:55 smithi027 bash[22610]: cluster 2024-08-31T02:57:54.531882+0000 mgr.a (mgr.14388) 2018 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:57:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:55 smithi191 bash[24992]: cluster 2024-08-31T02:57:54.531882+0000 mgr.a (mgr.14388) 2018 : cluster [DBG] pgmap v1398: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:57:57.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:56 smithi163 bash[24253]: audit 2024-08-31T02:57:55.689570+0000 mgr.a (mgr.14388) 2019 : audit [DBG] from='client.55971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:56 smithi027 bash[22610]: audit 2024-08-31T02:57:55.689570+0000 mgr.a (mgr.14388) 2019 : audit [DBG] from='client.55971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:57.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:56 smithi191 bash[24992]: audit 2024-08-31T02:57:55.689570+0000 mgr.a (mgr.14388) 2019 : audit [DBG] from='client.55971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:57:58.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:57 smithi163 bash[24253]: cluster 2024-08-31T02:57:56.532752+0000 mgr.a (mgr.14388) 2020 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:58.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:57 smithi027 bash[22610]: cluster 2024-08-31T02:57:56.532752+0000 mgr.a (mgr.14388) 2020 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:57:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:57 smithi191 bash[24992]: cluster 2024-08-31T02:57:56.532752+0000 mgr.a (mgr.14388) 2020 : cluster [DBG] pgmap v1399: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:57:59 smithi163 bash[24253]: cluster 2024-08-31T02:57:58.535007+0000 mgr.a (mgr.14388) 2021 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:00.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:57:59 smithi027 bash[22610]: cluster 2024-08-31T02:57:58.535007+0000 mgr.a (mgr.14388) 2021 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:57:59 smithi191 bash[24992]: cluster 2024-08-31T02:57:58.535007+0000 mgr.a (mgr.14388) 2021 : cluster [DBG] pgmap v1400: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:58:01.914 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:02.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:01 smithi163 bash[24253]: cluster 2024-08-31T02:58:00.535705+0000 mgr.a (mgr.14388) 2022 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:02.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:01 smithi027 bash[22610]: cluster 2024-08-31T02:58:00.535705+0000 mgr.a (mgr.14388) 2022 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:01 smithi191 bash[24992]: cluster 2024-08-31T02:58:00.535705+0000 mgr.a (mgr.14388) 2022 : cluster [DBG] pgmap v1401: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:03.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:02 smithi163 bash[24253]: audit 2024-08-31T02:58:01.468512+0000 mgr.a (mgr.14388) 2023 : audit [DBG] from='client.56046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:03.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:02 smithi027 bash[22610]: audit 2024-08-31T02:58:01.468512+0000 mgr.a (mgr.14388) 2023 : audit [DBG] from='client.56046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:03.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:02 smithi191 bash[24992]: audit 2024-08-31T02:58:01.468512+0000 mgr.a (mgr.14388) 2023 : audit [DBG] from='client.56046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:04.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:03 smithi163 bash[24253]: cluster 2024-08-31T02:58:02.536585+0000 mgr.a (mgr.14388) 2024 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:04.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:03 smithi027 bash[22610]: cluster 2024-08-31T02:58:02.536585+0000 mgr.a (mgr.14388) 2024 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:03 smithi191 bash[24992]: cluster 2024-08-31T02:58:02.536585+0000 mgr.a (mgr.14388) 2024 : cluster [DBG] pgmap v1402: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:06.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:05 smithi163 bash[24253]: cluster 2024-08-31T02:58:04.538808+0000 mgr.a (mgr.14388) 2025 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:05 smithi027 bash[22610]: cluster 2024-08-31T02:58:04.538808+0000 mgr.a (mgr.14388) 2025 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:05 smithi191 bash[24992]: cluster 2024-08-31T02:58:04.538808+0000 mgr.a (mgr.14388) 2025 : cluster [DBG] pgmap v1403: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:06.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:06.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:06.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:07.657 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:07.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:58:08.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:07 smithi163 bash[24253]: cluster 2024-08-31T02:58:06.539591+0000 mgr.a (mgr.14388) 2026 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:08.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:07 smithi163 bash[24253]: audit 2024-08-31T02:58:07.247625+0000 mgr.a (mgr.14388) 2027 : audit [DBG] from='client.56124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:07 smithi027 bash[22610]: cluster 2024-08-31T02:58:06.539591+0000 mgr.a (mgr.14388) 2026 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:07 smithi027 bash[22610]: audit 2024-08-31T02:58:07.247625+0000 mgr.a (mgr.14388) 2027 : audit [DBG] from='client.56124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:07 smithi191 bash[24992]: cluster 2024-08-31T02:58:06.539591+0000 mgr.a (mgr.14388) 2026 : cluster [DBG] pgmap v1404: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:07 smithi191 bash[24992]: audit 2024-08-31T02:58:07.247625+0000 mgr.a (mgr.14388) 2027 : audit [DBG] from='client.56124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:10.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:09 smithi163 bash[24253]: cluster 2024-08-31T02:58:08.541822+0000 mgr.a (mgr.14388) 2028 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:10.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:09 smithi027 bash[22610]: cluster 2024-08-31T02:58:08.541822+0000 mgr.a (mgr.14388) 2028 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:09 smithi191 bash[24992]: cluster 2024-08-31T02:58:08.541822+0000 mgr.a (mgr.14388) 2028 : cluster [DBG] pgmap v1405: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:12.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:11 smithi163 bash[24253]: cluster 2024-08-31T02:58:10.542581+0000 mgr.a (mgr.14388) 2029 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:11 smithi027 bash[22610]: cluster 2024-08-31T02:58:10.542581+0000 mgr.a (mgr.14388) 2029 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:11 smithi191 bash[24992]: cluster 2024-08-31T02:58:10.542581+0000 mgr.a (mgr.14388) 2029 : cluster [DBG] pgmap v1406: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:12.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:12.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:12.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:13.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:13.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:13.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:13.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:58:13.406 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:14.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:13 smithi163 bash[24253]: cluster 2024-08-31T02:58:12.543319+0000 mgr.a (mgr.14388) 2030 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:14.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:13 smithi163 bash[24253]: audit 2024-08-31T02:58:12.996064+0000 mgr.a (mgr.14388) 2031 : audit [DBG] from='client.56202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:14.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:13 smithi027 bash[22610]: cluster 2024-08-31T02:58:12.543319+0000 mgr.a (mgr.14388) 2030 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:13 smithi027 bash[22610]: audit 2024-08-31T02:58:12.996064+0000 mgr.a (mgr.14388) 2031 : audit [DBG] from='client.56202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:13 smithi191 bash[24992]: cluster 2024-08-31T02:58:12.543319+0000 mgr.a (mgr.14388) 2030 : cluster [DBG] pgmap v1407: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:13 smithi191 bash[24992]: audit 2024-08-31T02:58:12.996064+0000 mgr.a (mgr.14388) 2031 : audit [DBG] from='client.56202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:16.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:15 smithi163 bash[24253]: cluster 2024-08-31T02:58:14.545919+0000 mgr.a (mgr.14388) 2032 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:15 smithi027 bash[22610]: cluster 2024-08-31T02:58:14.545919+0000 mgr.a (mgr.14388) 2032 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:15 smithi191 bash[24992]: cluster 2024-08-31T02:58:14.545919+0000 mgr.a (mgr.14388) 2032 : cluster [DBG] pgmap v1408: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:17 smithi027 bash[22610]: cluster 2024-08-31T02:58:16.546662+0000 mgr.a (mgr.14388) 2033 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:58:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:17 smithi191 bash[24992]: cluster 2024-08-31T02:58:16.546662+0000 mgr.a (mgr.14388) 2033 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:58:18.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:18.407 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:18.408 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:18.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:17 smithi163 bash[24253]: cluster 2024-08-31T02:58:16.546662+0000 mgr.a (mgr.14388) 2033 : cluster [DBG] pgmap v1409: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:58:19.183 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:19.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:19.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:19.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:19.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:58:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:19 smithi027 bash[22610]: cluster 2024-08-31T02:58:18.547612+0000 mgr.a (mgr.14388) 2034 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:19 smithi027 bash[22610]: audit 2024-08-31T02:58:18.744003+0000 mgr.a (mgr.14388) 2035 : audit [DBG] from='client.56280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:19 smithi191 bash[24992]: cluster 2024-08-31T02:58:18.547612+0000 mgr.a (mgr.14388) 2034 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:19 smithi191 bash[24992]: audit 2024-08-31T02:58:18.744003+0000 mgr.a (mgr.14388) 2035 : audit [DBG] from='client.56280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:20.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:19 smithi163 bash[24253]: cluster 2024-08-31T02:58:18.547612+0000 mgr.a (mgr.14388) 2034 : cluster [DBG] pgmap v1410: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:20.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:19 smithi163 bash[24253]: audit 2024-08-31T02:58:18.744003+0000 mgr.a (mgr.14388) 2035 : audit [DBG] from='client.56280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:21 smithi027 bash[22610]: cluster 2024-08-31T02:58:20.548498+0000 mgr.a (mgr.14388) 2036 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:58:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:21 smithi191 bash[24992]: cluster 2024-08-31T02:58:20.548498+0000 mgr.a (mgr.14388) 2036 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:58:22.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:21 smithi163 bash[24253]: cluster 2024-08-31T02:58:20.548498+0000 mgr.a (mgr.14388) 2036 : cluster [DBG] pgmap v1411: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:58:24.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:24.185 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:24.185 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:24.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:23 smithi027 bash[22610]: cluster 2024-08-31T02:58:22.549266+0000 mgr.a (mgr.14388) 2037 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:58:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:23 smithi027 bash[22610]: audit 2024-08-31T02:58:23.565131+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:58:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:23 smithi191 bash[24992]: cluster 2024-08-31T02:58:22.549266+0000 mgr.a (mgr.14388) 2037 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:58:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:23 smithi191 bash[24992]: audit 2024-08-31T02:58:23.565131+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:58:24.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:23 smithi163 bash[24253]: cluster 2024-08-31T02:58:22.549266+0000 mgr.a (mgr.14388) 2037 : cluster [DBG] pgmap v1412: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T02:58:24.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:23 smithi163 bash[24253]: audit 2024-08-31T02:58:23.565131+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:58:24.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:24.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:24.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:24.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:58:24.949 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:25.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:25 smithi163 bash[24253]: audit 2024-08-31T02:58:24.188003+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:58:25.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:25 smithi163 bash[24253]: audit 2024-08-31T02:58:24.191881+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:58:25.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:25 smithi163 bash[24253]: audit 2024-08-31T02:58:24.946821+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:58:25.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:25 smithi163 bash[24253]: audit 2024-08-31T02:58:24.947692+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:58:25.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:25 smithi163 bash[24253]: audit 2024-08-31T02:58:24.952975+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:58:25.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:25 smithi163 bash[24253]: audit 2024-08-31T02:58:24.954951+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:58:25.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:25 smithi027 bash[22610]: audit 2024-08-31T02:58:24.188003+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:58:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:25 smithi027 bash[22610]: audit 2024-08-31T02:58:24.191881+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:58:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:25 smithi027 bash[22610]: audit 2024-08-31T02:58:24.946821+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:58:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:25 smithi027 bash[22610]: audit 2024-08-31T02:58:24.947692+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:58:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:25 smithi027 bash[22610]: audit 2024-08-31T02:58:24.952975+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:58:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:25 smithi027 bash[22610]: audit 2024-08-31T02:58:24.954951+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:58:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:25 smithi191 bash[24992]: audit 2024-08-31T02:58:24.188003+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:58:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:25 smithi191 bash[24992]: audit 2024-08-31T02:58:24.191881+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:58:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:25 smithi191 bash[24992]: audit 2024-08-31T02:58:24.946821+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:58:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:25 smithi191 bash[24992]: audit 2024-08-31T02:58:24.947692+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:58:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:25 smithi191 bash[24992]: audit 2024-08-31T02:58:24.952975+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:58:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:25 smithi191 bash[24992]: audit 2024-08-31T02:58:24.954951+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:58:25.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:58:25 smithi027 bash[22863]: debug 2024-08-31T02:58:25.631+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:58:25.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:58:25 smithi027 bash[22863]: debug 2024-08-31T02:58:25.631+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:58:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:26 smithi163 bash[24253]: audit 2024-08-31T02:58:24.502174+0000 mgr.a (mgr.14388) 2038 : audit [DBG] from='client.56358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:26 smithi163 bash[24253]: cluster 2024-08-31T02:58:24.551042+0000 mgr.a (mgr.14388) 2039 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:26.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:26 smithi163 bash[24253]: audit 2024-08-31T02:58:24.955934+0000 mgr.a (mgr.14388) 2040 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:58:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:26 smithi027 bash[22610]: audit 2024-08-31T02:58:24.502174+0000 mgr.a (mgr.14388) 2038 : audit [DBG] from='client.56358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:26 smithi027 bash[22610]: cluster 2024-08-31T02:58:24.551042+0000 mgr.a (mgr.14388) 2039 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:26 smithi027 bash[22610]: audit 2024-08-31T02:58:24.955934+0000 mgr.a (mgr.14388) 2040 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:58:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:26 smithi191 bash[24992]: audit 2024-08-31T02:58:24.502174+0000 mgr.a (mgr.14388) 2038 : audit [DBG] from='client.56358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:26 smithi191 bash[24992]: cluster 2024-08-31T02:58:24.551042+0000 mgr.a (mgr.14388) 2039 : cluster [DBG] pgmap v1413: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:26 smithi191 bash[24992]: audit 2024-08-31T02:58:24.955934+0000 mgr.a (mgr.14388) 2040 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:58:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:27 smithi027 bash[22610]: audit 2024-08-31T02:58:25.635270+0000 mgr.a (mgr.14388) 2041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:58:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:27 smithi027 bash[22610]: cephadm 2024-08-31T02:58:25.636639+0000 mgr.a (mgr.14388) 2042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:58:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:27 smithi191 bash[24992]: audit 2024-08-31T02:58:25.635270+0000 mgr.a (mgr.14388) 2041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:58:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:27 smithi191 bash[24992]: cephadm 2024-08-31T02:58:25.636639+0000 mgr.a (mgr.14388) 2042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:58:27.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:27 smithi163 bash[24253]: audit 2024-08-31T02:58:25.635270+0000 mgr.a (mgr.14388) 2041 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:58:27.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:27 smithi163 bash[24253]: cephadm 2024-08-31T02:58:25.636639+0000 mgr.a (mgr.14388) 2042 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:58:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:28 smithi027 bash[22610]: cluster 2024-08-31T02:58:26.552097+0000 mgr.a (mgr.14388) 2043 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:28 smithi191 bash[24992]: cluster 2024-08-31T02:58:26.552097+0000 mgr.a (mgr.14388) 2043 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:28.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:28 smithi163 bash[24253]: cluster 2024-08-31T02:58:26.552097+0000 mgr.a (mgr.14388) 2043 : cluster [DBG] pgmap v1414: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:29.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:29.950 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:29.950 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:30.491 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:30 smithi027 bash[22610]: cluster 2024-08-31T02:58:28.554453+0000 mgr.a (mgr.14388) 2044 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:30 smithi191 bash[24992]: cluster 2024-08-31T02:58:28.554453+0000 mgr.a (mgr.14388) 2044 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:30.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:30 smithi163 bash[24253]: cluster 2024-08-31T02:58:28.554453+0000 mgr.a (mgr.14388) 2044 : cluster [DBG] pgmap v1415: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:30.718 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:30.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:58:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:31 smithi027 bash[22610]: audit 2024-08-31T02:58:30.287907+0000 mgr.a (mgr.14388) 2045 : audit [DBG] from='client.56535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:31 smithi191 bash[24992]: audit 2024-08-31T02:58:30.287907+0000 mgr.a (mgr.14388) 2045 : audit [DBG] from='client.56535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:31.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:31 smithi163 bash[24253]: audit 2024-08-31T02:58:30.287907+0000 mgr.a (mgr.14388) 2045 : audit [DBG] from='client.56535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:32 smithi027 bash[22610]: cluster 2024-08-31T02:58:30.555040+0000 mgr.a (mgr.14388) 2046 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:32 smithi191 bash[24992]: cluster 2024-08-31T02:58:30.555040+0000 mgr.a (mgr.14388) 2046 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:32.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:32 smithi163 bash[24253]: cluster 2024-08-31T02:58:30.555040+0000 mgr.a (mgr.14388) 2046 : cluster [DBG] pgmap v1416: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:34 smithi027 bash[22610]: cluster 2024-08-31T02:58:32.555863+0000 mgr.a (mgr.14388) 2047 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:34 smithi191 bash[24992]: cluster 2024-08-31T02:58:32.555863+0000 mgr.a (mgr.14388) 2047 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:34.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:34 smithi163 bash[24253]: cluster 2024-08-31T02:58:32.555863+0000 mgr.a (mgr.14388) 2047 : cluster [DBG] pgmap v1417: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:35.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:35.720 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:35.720 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:36.458 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:36.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:36.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:36.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:36.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:58:36.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:36 smithi027 bash[22610]: cluster 2024-08-31T02:58:34.558087+0000 mgr.a (mgr.14388) 2048 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:36 smithi191 bash[24992]: cluster 2024-08-31T02:58:34.558087+0000 mgr.a (mgr.14388) 2048 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:36.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:36 smithi163 bash[24253]: cluster 2024-08-31T02:58:34.558087+0000 mgr.a (mgr.14388) 2048 : cluster [DBG] pgmap v1418: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:37 smithi191 bash[24992]: audit 2024-08-31T02:58:36.052198+0000 mgr.a (mgr.14388) 2049 : audit [DBG] from='client.56613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:37.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:37 smithi163 bash[24253]: audit 2024-08-31T02:58:36.052198+0000 mgr.a (mgr.14388) 2049 : audit [DBG] from='client.56613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:37 smithi027 bash[22610]: audit 2024-08-31T02:58:36.052198+0000 mgr.a (mgr.14388) 2049 : audit [DBG] from='client.56613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:38 smithi191 bash[24992]: cluster 2024-08-31T02:58:36.559056+0000 mgr.a (mgr.14388) 2050 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:38.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:38 smithi163 bash[24253]: cluster 2024-08-31T02:58:36.559056+0000 mgr.a (mgr.14388) 2050 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:38 smithi027 bash[22610]: cluster 2024-08-31T02:58:36.559056+0000 mgr.a (mgr.14388) 2050 : cluster [DBG] pgmap v1419: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:40 smithi191 bash[24992]: cluster 2024-08-31T02:58:38.561151+0000 mgr.a (mgr.14388) 2051 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:40.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:40 smithi163 bash[24253]: cluster 2024-08-31T02:58:38.561151+0000 mgr.a (mgr.14388) 2051 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:40 smithi027 bash[22610]: cluster 2024-08-31T02:58:38.561151+0000 mgr.a (mgr.14388) 2051 : cluster [DBG] pgmap v1420: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:58:41.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:41.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:41.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:42.199 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:42.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:42.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:42.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:42.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:58:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:42 smithi191 bash[24992]: cluster 2024-08-31T02:58:40.561929+0000 mgr.a (mgr.14388) 2052 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:42.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:42 smithi163 bash[24253]: cluster 2024-08-31T02:58:40.561929+0000 mgr.a (mgr.14388) 2052 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:42 smithi027 bash[22610]: cluster 2024-08-31T02:58:40.561929+0000 mgr.a (mgr.14388) 2052 : cluster [DBG] pgmap v1421: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:43 smithi191 bash[24992]: audit 2024-08-31T02:58:41.791304+0000 mgr.a (mgr.14388) 2053 : audit [DBG] from='client.56685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:43.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:43 smithi163 bash[24253]: audit 2024-08-31T02:58:41.791304+0000 mgr.a (mgr.14388) 2053 : audit [DBG] from='client.56685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:43 smithi027 bash[22610]: audit 2024-08-31T02:58:41.791304+0000 mgr.a (mgr.14388) 2053 : audit [DBG] from='client.56685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:44 smithi191 bash[24992]: cluster 2024-08-31T02:58:42.562874+0000 mgr.a (mgr.14388) 2054 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:44.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:44 smithi163 bash[24253]: cluster 2024-08-31T02:58:42.562874+0000 mgr.a (mgr.14388) 2054 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:44 smithi027 bash[22610]: cluster 2024-08-31T02:58:42.562874+0000 mgr.a (mgr.14388) 2054 : cluster [DBG] pgmap v1422: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:46 smithi191 bash[24992]: cluster 2024-08-31T02:58:44.565092+0000 mgr.a (mgr.14388) 2055 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:46.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:46 smithi163 bash[24253]: cluster 2024-08-31T02:58:44.565092+0000 mgr.a (mgr.14388) 2055 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:46 smithi027 bash[22610]: cluster 2024-08-31T02:58:44.565092+0000 mgr.a (mgr.14388) 2055 : cluster [DBG] pgmap v1423: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:58:47.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:47.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:47.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:47.944 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:47.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:47.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:47.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:47.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:58:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:48 smithi191 bash[24992]: cluster 2024-08-31T02:58:46.565878+0000 mgr.a (mgr.14388) 2056 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:48.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:48 smithi163 bash[24253]: cluster 2024-08-31T02:58:46.565878+0000 mgr.a (mgr.14388) 2056 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:48 smithi027 bash[22610]: cluster 2024-08-31T02:58:46.565878+0000 mgr.a (mgr.14388) 2056 : cluster [DBG] pgmap v1424: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:49 smithi191 bash[24992]: audit 2024-08-31T02:58:47.534827+0000 mgr.a (mgr.14388) 2057 : audit [DBG] from='client.56763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:49.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:49 smithi163 bash[24253]: audit 2024-08-31T02:58:47.534827+0000 mgr.a (mgr.14388) 2057 : audit [DBG] from='client.56763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:49 smithi027 bash[22610]: audit 2024-08-31T02:58:47.534827+0000 mgr.a (mgr.14388) 2057 : audit [DBG] from='client.56763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:50 smithi191 bash[24992]: cluster 2024-08-31T02:58:48.568269+0000 mgr.a (mgr.14388) 2058 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T02:58:50.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:50 smithi163 bash[24253]: cluster 2024-08-31T02:58:48.568269+0000 mgr.a (mgr.14388) 2058 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T02:58:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:50 smithi027 bash[22610]: cluster 2024-08-31T02:58:48.568269+0000 mgr.a (mgr.14388) 2058 : cluster [DBG] pgmap v1425: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T02:58:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:52 smithi191 bash[24992]: cluster 2024-08-31T02:58:50.569063+0000 mgr.a (mgr.14388) 2059 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:58:52.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:52 smithi163 bash[24253]: cluster 2024-08-31T02:58:50.569063+0000 mgr.a (mgr.14388) 2059 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:58:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:52 smithi027 bash[22610]: cluster 2024-08-31T02:58:50.569063+0000 mgr.a (mgr.14388) 2059 : cluster [DBG] pgmap v1426: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:58:52.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:52.946 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:52.946 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:53.723 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:53.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:53.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:53.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:53.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:58:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:54 smithi191 bash[24992]: cluster 2024-08-31T02:58:52.569816+0000 mgr.a (mgr.14388) 2060 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:58:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:54 smithi191 bash[24992]: audit 2024-08-31T02:58:53.282615+0000 mgr.a (mgr.14388) 2061 : audit [DBG] from='client.56841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:54.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:54 smithi163 bash[24253]: cluster 2024-08-31T02:58:52.569816+0000 mgr.a (mgr.14388) 2060 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:58:54.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:54 smithi163 bash[24253]: audit 2024-08-31T02:58:53.282615+0000 mgr.a (mgr.14388) 2061 : audit [DBG] from='client.56841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:54 smithi027 bash[22610]: cluster 2024-08-31T02:58:52.569816+0000 mgr.a (mgr.14388) 2060 : cluster [DBG] pgmap v1427: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T02:58:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:54 smithi027 bash[22610]: audit 2024-08-31T02:58:53.282615+0000 mgr.a (mgr.14388) 2061 : audit [DBG] from='client.56841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:58:56.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:56 smithi163 bash[24253]: cluster 2024-08-31T02:58:54.572593+0000 mgr.a (mgr.14388) 2062 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:56 smithi027 bash[22610]: cluster 2024-08-31T02:58:54.572593+0000 mgr.a (mgr.14388) 2062 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:56 smithi191 bash[24992]: cluster 2024-08-31T02:58:54.572593+0000 mgr.a (mgr.14388) 2062 : cluster [DBG] pgmap v1428: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:58:58.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:58:58 smithi163 bash[24253]: cluster 2024-08-31T02:58:56.573392+0000 mgr.a (mgr.14388) 2063 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:58:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:58:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:58:58.725 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:58:58.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:58:58 smithi027 bash[22610]: cluster 2024-08-31T02:58:56.573392+0000 mgr.a (mgr.14388) 2063 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:58:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:58:58 smithi191 bash[24992]: cluster 2024-08-31T02:58:56.573392+0000 mgr.a (mgr.14388) 2063 : cluster [DBG] pgmap v1429: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T02:58:59.464 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:58:59.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:58:59.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:58:59.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:58:59.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:00.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:00 smithi163 bash[24253]: cluster 2024-08-31T02:58:58.575305+0000 mgr.a (mgr.14388) 2064 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:00.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:00 smithi163 bash[24253]: audit 2024-08-31T02:58:59.058678+0000 mgr.a (mgr.14388) 2065 : audit [DBG] from='client.56916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:00 smithi027 bash[22610]: cluster 2024-08-31T02:58:58.575305+0000 mgr.a (mgr.14388) 2064 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:00 smithi027 bash[22610]: audit 2024-08-31T02:58:59.058678+0000 mgr.a (mgr.14388) 2065 : audit [DBG] from='client.56916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:00 smithi191 bash[24992]: cluster 2024-08-31T02:58:58.575305+0000 mgr.a (mgr.14388) 2064 : cluster [DBG] pgmap v1430: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:00 smithi191 bash[24992]: audit 2024-08-31T02:58:59.058678+0000 mgr.a (mgr.14388) 2065 : audit [DBG] from='client.56916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:02.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:02 smithi163 bash[24253]: cluster 2024-08-31T02:59:00.576377+0000 mgr.a (mgr.14388) 2066 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:59:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:02 smithi027 bash[22610]: cluster 2024-08-31T02:59:00.576377+0000 mgr.a (mgr.14388) 2066 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:59:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:02 smithi191 bash[24992]: cluster 2024-08-31T02:59:00.576377+0000 mgr.a (mgr.14388) 2066 : cluster [DBG] pgmap v1431: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:59:04.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:59:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:59:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:59:04.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:04 smithi163 bash[24253]: cluster 2024-08-31T02:59:02.577365+0000 mgr.a (mgr.14388) 2067 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:59:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:04 smithi027 bash[22610]: cluster 2024-08-31T02:59:02.577365+0000 mgr.a (mgr.14388) 2067 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:59:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:04 smithi191 bash[24992]: cluster 2024-08-31T02:59:02.577365+0000 mgr.a (mgr.14388) 2067 : cluster [DBG] pgmap v1432: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T02:59:05.241 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:59:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:59:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:59:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:59:05.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:06.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:06 smithi163 bash[24253]: cluster 2024-08-31T02:59:04.578437+0000 mgr.a (mgr.14388) 2068 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:59:06.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:06 smithi163 bash[24253]: audit 2024-08-31T02:59:04.807031+0000 mgr.a (mgr.14388) 2069 : audit [DBG] from='client.56991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:06 smithi027 bash[22610]: cluster 2024-08-31T02:59:04.578437+0000 mgr.a (mgr.14388) 2068 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:59:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:06 smithi027 bash[22610]: audit 2024-08-31T02:59:04.807031+0000 mgr.a (mgr.14388) 2069 : audit [DBG] from='client.56991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:06 smithi191 bash[24992]: cluster 2024-08-31T02:59:04.578437+0000 mgr.a (mgr.14388) 2068 : cluster [DBG] pgmap v1433: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T02:59:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:06 smithi191 bash[24992]: audit 2024-08-31T02:59:04.807031+0000 mgr.a (mgr.14388) 2069 : audit [DBG] from='client.56991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:08.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:08 smithi163 bash[24253]: cluster 2024-08-31T02:59:06.579373+0000 mgr.a (mgr.14388) 2070 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:08 smithi027 bash[22610]: cluster 2024-08-31T02:59:06.579373+0000 mgr.a (mgr.14388) 2070 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:08 smithi191 bash[24992]: cluster 2024-08-31T02:59:06.579373+0000 mgr.a (mgr.14388) 2070 : cluster [DBG] pgmap v1434: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:10.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:59:10.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:59:10.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:59:10.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:10 smithi163 bash[24253]: cluster 2024-08-31T02:59:08.581599+0000 mgr.a (mgr.14388) 2071 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:10 smithi027 bash[22610]: cluster 2024-08-31T02:59:08.581599+0000 mgr.a (mgr.14388) 2071 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:10 smithi191 bash[24992]: cluster 2024-08-31T02:59:08.581599+0000 mgr.a (mgr.14388) 2071 : cluster [DBG] pgmap v1435: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:11.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:59:11.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:59:11.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:59:11.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:11.014 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:59:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:12 smithi163 bash[24253]: audit 2024-08-31T02:59:10.580239+0000 mgr.a (mgr.14388) 2072 : audit [DBG] from='client.57063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:12 smithi163 bash[24253]: cluster 2024-08-31T02:59:10.595108+0000 mgr.a (mgr.14388) 2073 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:12 smithi027 bash[22610]: audit 2024-08-31T02:59:10.580239+0000 mgr.a (mgr.14388) 2072 : audit [DBG] from='client.57063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:12 smithi027 bash[22610]: cluster 2024-08-31T02:59:10.595108+0000 mgr.a (mgr.14388) 2073 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:12 smithi191 bash[24992]: audit 2024-08-31T02:59:10.580239+0000 mgr.a (mgr.14388) 2072 : audit [DBG] from='client.57063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:12 smithi191 bash[24992]: cluster 2024-08-31T02:59:10.595108+0000 mgr.a (mgr.14388) 2073 : cluster [DBG] pgmap v1436: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:14 smithi163 bash[24253]: cluster 2024-08-31T02:59:12.596289+0000 mgr.a (mgr.14388) 2074 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:14 smithi027 bash[22610]: cluster 2024-08-31T02:59:12.596289+0000 mgr.a (mgr.14388) 2074 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:14 smithi191 bash[24992]: cluster 2024-08-31T02:59:12.596289+0000 mgr.a (mgr.14388) 2074 : cluster [DBG] pgmap v1437: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:16.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:59:16.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:59:16.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:59:16.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:16 smithi163 bash[24253]: cluster 2024-08-31T02:59:14.598493+0000 mgr.a (mgr.14388) 2075 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:16 smithi027 bash[22610]: cluster 2024-08-31T02:59:14.598493+0000 mgr.a (mgr.14388) 2075 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:16.787 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:59:16.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:59:16.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:59:16.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:59:16.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:16 smithi191 bash[24992]: cluster 2024-08-31T02:59:14.598493+0000 mgr.a (mgr.14388) 2075 : cluster [DBG] pgmap v1438: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:17.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:17 smithi163 bash[24253]: audit 2024-08-31T02:59:16.351099+0000 mgr.a (mgr.14388) 2076 : audit [DBG] from='client.57141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:17 smithi027 bash[22610]: audit 2024-08-31T02:59:16.351099+0000 mgr.a (mgr.14388) 2076 : audit [DBG] from='client.57141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:17 smithi191 bash[24992]: audit 2024-08-31T02:59:16.351099+0000 mgr.a (mgr.14388) 2076 : audit [DBG] from='client.57141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:18.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:18 smithi163 bash[24253]: cluster 2024-08-31T02:59:16.599041+0000 mgr.a (mgr.14388) 2077 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:18 smithi027 bash[22610]: cluster 2024-08-31T02:59:16.599041+0000 mgr.a (mgr.14388) 2077 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:18 smithi191 bash[24992]: cluster 2024-08-31T02:59:16.599041+0000 mgr.a (mgr.14388) 2077 : cluster [DBG] pgmap v1439: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:20.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:20 smithi163 bash[24253]: cluster 2024-08-31T02:59:18.602015+0000 mgr.a (mgr.14388) 2078 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:20 smithi027 bash[22610]: cluster 2024-08-31T02:59:18.602015+0000 mgr.a (mgr.14388) 2078 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:20 smithi191 bash[24992]: cluster 2024-08-31T02:59:18.602015+0000 mgr.a (mgr.14388) 2078 : cluster [DBG] pgmap v1440: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:21.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:59:21.789 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:59:21.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:59:22.535 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:59:22.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:59:22.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:59:22.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:59:22.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:22.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:22 smithi163 bash[24253]: cluster 2024-08-31T02:59:20.602794+0000 mgr.a (mgr.14388) 2079 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:22 smithi027 bash[22610]: cluster 2024-08-31T02:59:20.602794+0000 mgr.a (mgr.14388) 2079 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:22 smithi191 bash[24992]: cluster 2024-08-31T02:59:20.602794+0000 mgr.a (mgr.14388) 2079 : cluster [DBG] pgmap v1441: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:23.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:23 smithi163 bash[24253]: audit 2024-08-31T02:59:22.121752+0000 mgr.a (mgr.14388) 2080 : audit [DBG] from='client.57219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:23 smithi027 bash[22610]: audit 2024-08-31T02:59:22.121752+0000 mgr.a (mgr.14388) 2080 : audit [DBG] from='client.57219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:23 smithi191 bash[24992]: audit 2024-08-31T02:59:22.121752+0000 mgr.a (mgr.14388) 2080 : audit [DBG] from='client.57219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:24.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:24 smithi163 bash[24253]: cluster 2024-08-31T02:59:22.603302+0000 mgr.a (mgr.14388) 2081 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:24 smithi027 bash[22610]: cluster 2024-08-31T02:59:22.603302+0000 mgr.a (mgr.14388) 2081 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:24 smithi191 bash[24992]: cluster 2024-08-31T02:59:22.603302+0000 mgr.a (mgr.14388) 2081 : cluster [DBG] pgmap v1442: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:26.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:26 smithi163 bash[24253]: cluster 2024-08-31T02:59:24.605416+0000 mgr.a (mgr.14388) 2082 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:26.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:26 smithi163 bash[24253]: audit 2024-08-31T02:59:25.687569+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:59:26.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:26 smithi163 bash[24253]: audit 2024-08-31T02:59:26.296370+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:26 smithi163 bash[24253]: audit 2024-08-31T02:59:26.303685+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:26 smithi163 bash[24253]: audit 2024-08-31T02:59:26.309490+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:26 smithi163 bash[24253]: audit 2024-08-31T02:59:26.316729+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:26 smithi027 bash[22610]: cluster 2024-08-31T02:59:24.605416+0000 mgr.a (mgr.14388) 2082 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:26 smithi027 bash[22610]: audit 2024-08-31T02:59:25.687569+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:59:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:26 smithi027 bash[22610]: audit 2024-08-31T02:59:26.296370+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:26 smithi027 bash[22610]: audit 2024-08-31T02:59:26.303685+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:26 smithi027 bash[22610]: audit 2024-08-31T02:59:26.309490+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:26 smithi027 bash[22610]: audit 2024-08-31T02:59:26.316729+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:26 smithi191 bash[24992]: cluster 2024-08-31T02:59:24.605416+0000 mgr.a (mgr.14388) 2082 : cluster [DBG] pgmap v1443: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:26 smithi191 bash[24992]: audit 2024-08-31T02:59:25.687569+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T02:59:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:26 smithi191 bash[24992]: audit 2024-08-31T02:59:26.296370+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:26 smithi191 bash[24992]: audit 2024-08-31T02:59:26.303685+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:26 smithi191 bash[24992]: audit 2024-08-31T02:59:26.309490+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:26 smithi191 bash[24992]: audit 2024-08-31T02:59:26.316729+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:27.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:59:27.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:59:27.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:59:27.683 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:27 smithi027 bash[22610]: audit 2024-08-31T02:59:26.956724+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:59:27.684 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:27 smithi027 bash[22610]: audit 2024-08-31T02:59:26.958311+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:59:27.684 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:27 smithi027 bash[22610]: audit 2024-08-31T02:59:26.967618+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:27.684 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:27 smithi027 bash[22610]: audit 2024-08-31T02:59:26.971213+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:59:27.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:27 smithi163 bash[24253]: audit 2024-08-31T02:59:26.956724+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:59:27.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:27 smithi163 bash[24253]: audit 2024-08-31T02:59:26.958311+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:59:27.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:27 smithi163 bash[24253]: audit 2024-08-31T02:59:26.967618+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:27.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:27 smithi163 bash[24253]: audit 2024-08-31T02:59:26.971213+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:59:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:27 smithi191 bash[24992]: audit 2024-08-31T02:59:26.956724+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T02:59:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:27 smithi191 bash[24992]: audit 2024-08-31T02:59:26.958311+0000 mon.a (mon.0) 907 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T02:59:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:27 smithi191 bash[24992]: audit 2024-08-31T02:59:26.967618+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T02:59:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:27 smithi191 bash[24992]: audit 2024-08-31T02:59:26.971213+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:59:27.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:59:27 smithi027 bash[22863]: debug 2024-08-31T02:59:27.681+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:59:27.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 02:59:27 smithi027 bash[22863]: debug 2024-08-31T02:59:27.681+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:59:28.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:59:28.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:59:28.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:59:28.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:28.262 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:59:28.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:28 smithi163 bash[24253]: cluster 2024-08-31T02:59:26.606259+0000 mgr.a (mgr.14388) 2083 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:28.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:28 smithi163 bash[24253]: audit 2024-08-31T02:59:26.973437+0000 mgr.a (mgr.14388) 2084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:59:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:28 smithi027 bash[22610]: cluster 2024-08-31T02:59:26.606259+0000 mgr.a (mgr.14388) 2083 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:28 smithi027 bash[22610]: audit 2024-08-31T02:59:26.973437+0000 mgr.a (mgr.14388) 2084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:59:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:28 smithi191 bash[24992]: cluster 2024-08-31T02:59:26.606259+0000 mgr.a (mgr.14388) 2083 : cluster [DBG] pgmap v1444: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:28 smithi191 bash[24992]: audit 2024-08-31T02:59:26.973437+0000 mgr.a (mgr.14388) 2084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T02:59:29.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:29 smithi163 bash[24253]: audit 2024-08-31T02:59:27.684440+0000 mgr.a (mgr.14388) 2085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:59:29.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:29 smithi163 bash[24253]: cephadm 2024-08-31T02:59:27.685642+0000 mgr.a (mgr.14388) 2086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:59:29.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:29 smithi163 bash[24253]: audit 2024-08-31T02:59:27.855330+0000 mgr.a (mgr.14388) 2087 : audit [DBG] from='client.57402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:29 smithi027 bash[22610]: audit 2024-08-31T02:59:27.684440+0000 mgr.a (mgr.14388) 2085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:59:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:29 smithi027 bash[22610]: cephadm 2024-08-31T02:59:27.685642+0000 mgr.a (mgr.14388) 2086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:59:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:29 smithi027 bash[22610]: audit 2024-08-31T02:59:27.855330+0000 mgr.a (mgr.14388) 2087 : audit [DBG] from='client.57402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:29 smithi191 bash[24992]: audit 2024-08-31T02:59:27.684440+0000 mgr.a (mgr.14388) 2085 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T02:59:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:29 smithi191 bash[24992]: cephadm 2024-08-31T02:59:27.685642+0000 mgr.a (mgr.14388) 2086 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T02:59:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:29 smithi191 bash[24992]: audit 2024-08-31T02:59:27.855330+0000 mgr.a (mgr.14388) 2087 : audit [DBG] from='client.57402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:30.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:30 smithi163 bash[24253]: cluster 2024-08-31T02:59:28.608979+0000 mgr.a (mgr.14388) 2088 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:59:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:30 smithi027 bash[22610]: cluster 2024-08-31T02:59:28.608979+0000 mgr.a (mgr.14388) 2088 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:59:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:30 smithi191 bash[24992]: cluster 2024-08-31T02:59:28.608979+0000 mgr.a (mgr.14388) 2088 : cluster [DBG] pgmap v1445: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:59:31.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:31 smithi163 bash[24253]: cluster 2024-08-31T02:59:30.609768+0000 mgr.a (mgr.14388) 2089 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:59:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:31 smithi027 bash[22610]: cluster 2024-08-31T02:59:30.609768+0000 mgr.a (mgr.14388) 2089 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:59:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:31 smithi191 bash[24992]: cluster 2024-08-31T02:59:30.609768+0000 mgr.a (mgr.14388) 2089 : cluster [DBG] pgmap v1446: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:59:33.263 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:59:33.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:59:33.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:59:33.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:33 smithi163 bash[24253]: cluster 2024-08-31T02:59:32.610551+0000 mgr.a (mgr.14388) 2090 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:59:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:33 smithi027 bash[22610]: cluster 2024-08-31T02:59:32.610551+0000 mgr.a (mgr.14388) 2090 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:59:33.999 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:59:33.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:59:33.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:59:33.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:59:33.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:33 smithi191 bash[24992]: cluster 2024-08-31T02:59:32.610551+0000 mgr.a (mgr.14388) 2090 : cluster [DBG] pgmap v1447: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:59:34.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:34 smithi163 bash[24253]: audit 2024-08-31T02:59:33.593870+0000 mgr.a (mgr.14388) 2091 : audit [DBG] from='client.57480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:34 smithi027 bash[22610]: audit 2024-08-31T02:59:33.593870+0000 mgr.a (mgr.14388) 2091 : audit [DBG] from='client.57480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:34 smithi191 bash[24992]: audit 2024-08-31T02:59:33.593870+0000 mgr.a (mgr.14388) 2091 : audit [DBG] from='client.57480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:35.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:35 smithi163 bash[24253]: cluster 2024-08-31T02:59:34.613274+0000 mgr.a (mgr.14388) 2092 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:59:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:35 smithi027 bash[22610]: cluster 2024-08-31T02:59:34.613274+0000 mgr.a (mgr.14388) 2092 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:59:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:35 smithi191 bash[24992]: cluster 2024-08-31T02:59:34.613274+0000 mgr.a (mgr.14388) 2092 : cluster [DBG] pgmap v1448: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:59:37.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:37 smithi163 bash[24253]: cluster 2024-08-31T02:59:36.614075+0000 mgr.a (mgr.14388) 2093 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:59:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:37 smithi027 bash[22610]: cluster 2024-08-31T02:59:36.614075+0000 mgr.a (mgr.14388) 2093 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:59:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:37 smithi191 bash[24992]: cluster 2024-08-31T02:59:36.614075+0000 mgr.a (mgr.14388) 2093 : cluster [DBG] pgmap v1449: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T02:59:39.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:59:39.001 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:59:39.001 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:59:39.748 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:59:39.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:59:39.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:59:39.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:59:39.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:39.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:39 smithi163 bash[24253]: cluster 2024-08-31T02:59:38.616036+0000 mgr.a (mgr.14388) 2094 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:59:39.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:39 smithi163 bash[24253]: audit 2024-08-31T02:59:39.334567+0000 mgr.a (mgr.14388) 2095 : audit [DBG] from='client.57558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:39 smithi027 bash[22610]: cluster 2024-08-31T02:59:38.616036+0000 mgr.a (mgr.14388) 2094 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:59:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:39 smithi027 bash[22610]: audit 2024-08-31T02:59:39.334567+0000 mgr.a (mgr.14388) 2095 : audit [DBG] from='client.57558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:39 smithi191 bash[24992]: cluster 2024-08-31T02:59:38.616036+0000 mgr.a (mgr.14388) 2094 : cluster [DBG] pgmap v1450: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T02:59:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:39 smithi191 bash[24992]: audit 2024-08-31T02:59:39.334567+0000 mgr.a (mgr.14388) 2095 : audit [DBG] from='client.57558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:41.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:41 smithi163 bash[24253]: cluster 2024-08-31T02:59:40.617114+0000 mgr.a (mgr.14388) 2096 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:41 smithi027 bash[22610]: cluster 2024-08-31T02:59:40.617114+0000 mgr.a (mgr.14388) 2096 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:41 smithi191 bash[24992]: cluster 2024-08-31T02:59:40.617114+0000 mgr.a (mgr.14388) 2096 : cluster [DBG] pgmap v1451: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:43.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:43 smithi163 bash[24253]: cluster 2024-08-31T02:59:42.618078+0000 mgr.a (mgr.14388) 2097 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:43 smithi027 bash[22610]: cluster 2024-08-31T02:59:42.618078+0000 mgr.a (mgr.14388) 2097 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:43 smithi191 bash[24992]: cluster 2024-08-31T02:59:42.618078+0000 mgr.a (mgr.14388) 2097 : cluster [DBG] pgmap v1452: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:44.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:59:44.750 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:59:44.750 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:59:45.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:59:45.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:59:45.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:59:45.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:45.502 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:59:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:45 smithi027 bash[22610]: cluster 2024-08-31T02:59:44.620425+0000 mgr.a (mgr.14388) 2098 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:45 smithi027 bash[22610]: audit 2024-08-31T02:59:45.082507+0000 mgr.a (mgr.14388) 2099 : audit [DBG] from='client.57633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:45 smithi191 bash[24992]: cluster 2024-08-31T02:59:44.620425+0000 mgr.a (mgr.14388) 2098 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:45 smithi191 bash[24992]: audit 2024-08-31T02:59:45.082507+0000 mgr.a (mgr.14388) 2099 : audit [DBG] from='client.57633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:46.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:45 smithi163 bash[24253]: cluster 2024-08-31T02:59:44.620425+0000 mgr.a (mgr.14388) 2098 : cluster [DBG] pgmap v1453: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:46.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:45 smithi163 bash[24253]: audit 2024-08-31T02:59:45.082507+0000 mgr.a (mgr.14388) 2099 : audit [DBG] from='client.57633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:47 smithi027 bash[22610]: cluster 2024-08-31T02:59:46.621310+0000 mgr.a (mgr.14388) 2100 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:47 smithi191 bash[24992]: cluster 2024-08-31T02:59:46.621310+0000 mgr.a (mgr.14388) 2100 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:48.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:47 smithi163 bash[24253]: cluster 2024-08-31T02:59:46.621310+0000 mgr.a (mgr.14388) 2100 : cluster [DBG] pgmap v1454: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:49 smithi027 bash[22610]: cluster 2024-08-31T02:59:48.623510+0000 mgr.a (mgr.14388) 2101 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:49 smithi191 bash[24992]: cluster 2024-08-31T02:59:48.623510+0000 mgr.a (mgr.14388) 2101 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:50.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:49 smithi163 bash[24253]: cluster 2024-08-31T02:59:48.623510+0000 mgr.a (mgr.14388) 2101 : cluster [DBG] pgmap v1455: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:50.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:59:50.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:59:50.504 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:59:51.274 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:59:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:59:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:59:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:59:51.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:51 smithi027 bash[22610]: cluster 2024-08-31T02:59:50.623961+0000 mgr.a (mgr.14388) 2102 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:51 smithi027 bash[22610]: audit 2024-08-31T02:59:50.840409+0000 mgr.a (mgr.14388) 2103 : audit [DBG] from='client.57711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:51 smithi191 bash[24992]: cluster 2024-08-31T02:59:50.623961+0000 mgr.a (mgr.14388) 2102 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:51 smithi191 bash[24992]: audit 2024-08-31T02:59:50.840409+0000 mgr.a (mgr.14388) 2103 : audit [DBG] from='client.57711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:52.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:51 smithi163 bash[24253]: cluster 2024-08-31T02:59:50.623961+0000 mgr.a (mgr.14388) 2102 : cluster [DBG] pgmap v1456: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:52.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:51 smithi163 bash[24253]: audit 2024-08-31T02:59:50.840409+0000 mgr.a (mgr.14388) 2103 : audit [DBG] from='client.57711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:53 smithi027 bash[22610]: cluster 2024-08-31T02:59:52.624813+0000 mgr.a (mgr.14388) 2104 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:53 smithi191 bash[24992]: cluster 2024-08-31T02:59:52.624813+0000 mgr.a (mgr.14388) 2104 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:54.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:53 smithi163 bash[24253]: cluster 2024-08-31T02:59:52.624813+0000 mgr.a (mgr.14388) 2104 : cluster [DBG] pgmap v1457: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:55 smithi027 bash[22610]: cluster 2024-08-31T02:59:54.627075+0000 mgr.a (mgr.14388) 2105 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:55 smithi191 bash[24992]: cluster 2024-08-31T02:59:54.627075+0000 mgr.a (mgr.14388) 2105 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:56.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:55 smithi163 bash[24253]: cluster 2024-08-31T02:59:54.627075+0000 mgr.a (mgr.14388) 2105 : cluster [DBG] pgmap v1458: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T02:59:56.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T02:59:56.276 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T02:59:56.276 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T02:59:57.027 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T02:59:57.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T02:59:57.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T02:59:57.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T02:59:57.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T02:59:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:57 smithi027 bash[22610]: audit 2024-08-31T02:59:56.607557+0000 mgr.a (mgr.14388) 2106 : audit [DBG] from='client.57789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:57 smithi027 bash[22610]: cluster 2024-08-31T02:59:56.627801+0000 mgr.a (mgr.14388) 2107 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:57 smithi191 bash[24992]: audit 2024-08-31T02:59:56.607557+0000 mgr.a (mgr.14388) 2106 : audit [DBG] from='client.57789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:57 smithi191 bash[24992]: cluster 2024-08-31T02:59:56.627801+0000 mgr.a (mgr.14388) 2107 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:58.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:57 smithi163 bash[24253]: audit 2024-08-31T02:59:56.607557+0000 mgr.a (mgr.14388) 2106 : audit [DBG] from='client.57789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T02:59:58.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:57 smithi163 bash[24253]: cluster 2024-08-31T02:59:56.627801+0000 mgr.a (mgr.14388) 2107 : cluster [DBG] pgmap v1459: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T02:59:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 02:59:59 smithi027 bash[22610]: cluster 2024-08-31T02:59:58.630008+0000 mgr.a (mgr.14388) 2108 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 02:59:59 smithi191 bash[24992]: cluster 2024-08-31T02:59:58.630008+0000 mgr.a (mgr.14388) 2108 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 02:59:59 smithi163 bash[24253]: cluster 2024-08-31T02:59:58.630008+0000 mgr.a (mgr.14388) 2108 : cluster [DBG] pgmap v1460: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:00 smithi027 bash[22610]: cluster 2024-08-31T03:00:00.000146+0000 mon.a (mon.0) 910 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:00:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:00 smithi191 bash[24992]: cluster 2024-08-31T03:00:00.000146+0000 mon.a (mon.0) 910 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:00:01.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:00 smithi163 bash[24253]: cluster 2024-08-31T03:00:00.000146+0000 mon.a (mon.0) 910 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:00:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:01 smithi027 bash[22610]: cluster 2024-08-31T03:00:00.630826+0000 mgr.a (mgr.14388) 2109 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:02.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:02.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:02.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:00:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:01 smithi191 bash[24992]: cluster 2024-08-31T03:00:00.630826+0000 mgr.a (mgr.14388) 2109 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:02.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:01 smithi163 bash[24253]: cluster 2024-08-31T03:00:00.630826+0000 mgr.a (mgr.14388) 2109 : cluster [DBG] pgmap v1461: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:02.785 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:00:02.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:00:02.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:00:02.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:00:02.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:00:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:02 smithi191 bash[24992]: audit 2024-08-31T03:00:02.364268+0000 mgr.a (mgr.14388) 2110 : audit [DBG] from='client.57867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:03.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:02 smithi163 bash[24253]: audit 2024-08-31T03:00:02.364268+0000 mgr.a (mgr.14388) 2110 : audit [DBG] from='client.57867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:02 smithi027 bash[22610]: audit 2024-08-31T03:00:02.364268+0000 mgr.a (mgr.14388) 2110 : audit [DBG] from='client.57867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:03 smithi191 bash[24992]: cluster 2024-08-31T03:00:02.631434+0000 mgr.a (mgr.14388) 2111 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:04.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:03 smithi163 bash[24253]: cluster 2024-08-31T03:00:02.631434+0000 mgr.a (mgr.14388) 2111 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:03 smithi027 bash[22610]: cluster 2024-08-31T03:00:02.631434+0000 mgr.a (mgr.14388) 2111 : cluster [DBG] pgmap v1462: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:05 smithi191 bash[24992]: cluster 2024-08-31T03:00:04.633699+0000 mgr.a (mgr.14388) 2112 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:06.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:05 smithi163 bash[24253]: cluster 2024-08-31T03:00:04.633699+0000 mgr.a (mgr.14388) 2112 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:05 smithi027 bash[22610]: cluster 2024-08-31T03:00:04.633699+0000 mgr.a (mgr.14388) 2112 : cluster [DBG] pgmap v1463: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:07.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:07.787 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:07.787 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:00:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:07 smithi191 bash[24992]: cluster 2024-08-31T03:00:06.634449+0000 mgr.a (mgr.14388) 2113 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:08.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:07 smithi163 bash[24253]: cluster 2024-08-31T03:00:06.634449+0000 mgr.a (mgr.14388) 2113 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:07 smithi027 bash[22610]: cluster 2024-08-31T03:00:06.634449+0000 mgr.a (mgr.14388) 2113 : cluster [DBG] pgmap v1464: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:08.560 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:00:08.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:00:08.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:00:08.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:00:08.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:00:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:08 smithi191 bash[24992]: audit 2024-08-31T03:00:08.128889+0000 mgr.a (mgr.14388) 2114 : audit [DBG] from='client.57945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:09.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:08 smithi163 bash[24253]: audit 2024-08-31T03:00:08.128889+0000 mgr.a (mgr.14388) 2114 : audit [DBG] from='client.57945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:08 smithi027 bash[22610]: audit 2024-08-31T03:00:08.128889+0000 mgr.a (mgr.14388) 2114 : audit [DBG] from='client.57945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:09 smithi191 bash[24992]: cluster 2024-08-31T03:00:08.637920+0000 mgr.a (mgr.14388) 2115 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:10.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:09 smithi163 bash[24253]: cluster 2024-08-31T03:00:08.637920+0000 mgr.a (mgr.14388) 2115 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:09 smithi027 bash[22610]: cluster 2024-08-31T03:00:08.637920+0000 mgr.a (mgr.14388) 2115 : cluster [DBG] pgmap v1465: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:11 smithi191 bash[24992]: cluster 2024-08-31T03:00:10.638739+0000 mgr.a (mgr.14388) 2116 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:12.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:11 smithi163 bash[24253]: cluster 2024-08-31T03:00:10.638739+0000 mgr.a (mgr.14388) 2116 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:11 smithi027 bash[22610]: cluster 2024-08-31T03:00:10.638739+0000 mgr.a (mgr.14388) 2116 : cluster [DBG] pgmap v1466: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:13.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:13.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:13.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:00:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:13 smithi191 bash[24992]: cluster 2024-08-31T03:00:12.639538+0000 mgr.a (mgr.14388) 2117 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:14.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:13 smithi163 bash[24253]: cluster 2024-08-31T03:00:12.639538+0000 mgr.a (mgr.14388) 2117 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:13 smithi027 bash[22610]: cluster 2024-08-31T03:00:12.639538+0000 mgr.a (mgr.14388) 2117 : cluster [DBG] pgmap v1467: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:14.304 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:00:14.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:00:14.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:00:14.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:00:14.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:00:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:14 smithi191 bash[24992]: audit 2024-08-31T03:00:13.893439+0000 mgr.a (mgr.14388) 2118 : audit [DBG] from='client.58023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:15.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:14 smithi163 bash[24253]: audit 2024-08-31T03:00:13.893439+0000 mgr.a (mgr.14388) 2118 : audit [DBG] from='client.58023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:14 smithi027 bash[22610]: audit 2024-08-31T03:00:13.893439+0000 mgr.a (mgr.14388) 2118 : audit [DBG] from='client.58023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:16.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:15 smithi163 bash[24253]: cluster 2024-08-31T03:00:14.642188+0000 mgr.a (mgr.14388) 2119 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:15 smithi027 bash[22610]: cluster 2024-08-31T03:00:14.642188+0000 mgr.a (mgr.14388) 2119 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:15 smithi191 bash[24992]: cluster 2024-08-31T03:00:14.642188+0000 mgr.a (mgr.14388) 2119 : cluster [DBG] pgmap v1468: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:18.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:17 smithi163 bash[24253]: cluster 2024-08-31T03:00:16.642941+0000 mgr.a (mgr.14388) 2120 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:17 smithi027 bash[22610]: cluster 2024-08-31T03:00:16.642941+0000 mgr.a (mgr.14388) 2120 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:17 smithi191 bash[24992]: cluster 2024-08-31T03:00:16.642941+0000 mgr.a (mgr.14388) 2120 : cluster [DBG] pgmap v1469: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:19.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:19.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:19.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:00:20.074 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:00:20.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:00:20.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:00:20.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:00:20.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:00:20.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:19 smithi163 bash[24253]: cluster 2024-08-31T03:00:18.644886+0000 mgr.a (mgr.14388) 2121 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:19 smithi027 bash[22610]: cluster 2024-08-31T03:00:18.644886+0000 mgr.a (mgr.14388) 2121 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:19 smithi191 bash[24992]: cluster 2024-08-31T03:00:18.644886+0000 mgr.a (mgr.14388) 2121 : cluster [DBG] pgmap v1470: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:21.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:20 smithi163 bash[24253]: audit 2024-08-31T03:00:19.639359+0000 mgr.a (mgr.14388) 2122 : audit [DBG] from='client.58095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:20 smithi027 bash[22610]: audit 2024-08-31T03:00:19.639359+0000 mgr.a (mgr.14388) 2122 : audit [DBG] from='client.58095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:21.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:20 smithi191 bash[24992]: audit 2024-08-31T03:00:19.639359+0000 mgr.a (mgr.14388) 2122 : audit [DBG] from='client.58095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:22.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:21 smithi163 bash[24253]: cluster 2024-08-31T03:00:20.645880+0000 mgr.a (mgr.14388) 2123 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:21 smithi027 bash[22610]: cluster 2024-08-31T03:00:20.645880+0000 mgr.a (mgr.14388) 2123 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:21 smithi191 bash[24992]: cluster 2024-08-31T03:00:20.645880+0000 mgr.a (mgr.14388) 2123 : cluster [DBG] pgmap v1471: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:24.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:23 smithi163 bash[24253]: cluster 2024-08-31T03:00:22.646661+0000 mgr.a (mgr.14388) 2124 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:23 smithi027 bash[22610]: cluster 2024-08-31T03:00:22.646661+0000 mgr.a (mgr.14388) 2124 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:23 smithi191 bash[24992]: cluster 2024-08-31T03:00:22.646661+0000 mgr.a (mgr.14388) 2124 : cluster [DBG] pgmap v1472: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:25.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:25.076 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:00:25.819 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:00:25.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:00:25.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:00:25.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:00:25.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:00:26.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:25 smithi163 bash[24253]: cluster 2024-08-31T03:00:24.648838+0000 mgr.a (mgr.14388) 2125 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:25 smithi027 bash[22610]: cluster 2024-08-31T03:00:24.648838+0000 mgr.a (mgr.14388) 2125 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:25 smithi191 bash[24992]: cluster 2024-08-31T03:00:24.648838+0000 mgr.a (mgr.14388) 2125 : cluster [DBG] pgmap v1473: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:27.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:26 smithi163 bash[24253]: audit 2024-08-31T03:00:25.411597+0000 mgr.a (mgr.14388) 2126 : audit [DBG] from='client.58173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:26 smithi027 bash[22610]: audit 2024-08-31T03:00:25.411597+0000 mgr.a (mgr.14388) 2126 : audit [DBG] from='client.58173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:26 smithi191 bash[24992]: audit 2024-08-31T03:00:25.411597+0000 mgr.a (mgr.14388) 2126 : audit [DBG] from='client.58173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:28.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:27 smithi163 bash[24253]: cluster 2024-08-31T03:00:26.649727+0000 mgr.a (mgr.14388) 2127 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:28.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:27 smithi163 bash[24253]: audit 2024-08-31T03:00:27.734506+0000 mon.a (mon.0) 911 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:00:28.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:27 smithi027 bash[22610]: cluster 2024-08-31T03:00:26.649727+0000 mgr.a (mgr.14388) 2127 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:28.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:27 smithi027 bash[22610]: audit 2024-08-31T03:00:27.734506+0000 mon.a (mon.0) 911 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:00:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:27 smithi191 bash[24992]: cluster 2024-08-31T03:00:26.649727+0000 mgr.a (mgr.14388) 2127 : cluster [DBG] pgmap v1474: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:27 smithi191 bash[24992]: audit 2024-08-31T03:00:27.734506+0000 mon.a (mon.0) 911 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:00:29.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:28 smithi163 bash[24253]: audit 2024-08-31T03:00:28.577632+0000 mon.a (mon.0) 912 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:00:29.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:28 smithi163 bash[24253]: audit 2024-08-31T03:00:28.579184+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:00:29.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:28 smithi163 bash[24253]: audit 2024-08-31T03:00:28.586874+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:00:29.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:28 smithi163 bash[24253]: audit 2024-08-31T03:00:28.591695+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:00:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:28 smithi027 bash[22610]: audit 2024-08-31T03:00:28.577632+0000 mon.a (mon.0) 912 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:00:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:28 smithi027 bash[22610]: audit 2024-08-31T03:00:28.579184+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:00:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:28 smithi027 bash[22610]: audit 2024-08-31T03:00:28.586874+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:00:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:28 smithi027 bash[22610]: audit 2024-08-31T03:00:28.591695+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:00:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:28 smithi191 bash[24992]: audit 2024-08-31T03:00:28.577632+0000 mon.a (mon.0) 912 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:00:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:28 smithi191 bash[24992]: audit 2024-08-31T03:00:28.579184+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:00:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:28 smithi191 bash[24992]: audit 2024-08-31T03:00:28.586874+0000 mon.a (mon.0) 914 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:00:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:28 smithi191 bash[24992]: audit 2024-08-31T03:00:28.591695+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:00:29.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:00:29 smithi027 bash[22863]: debug 2024-08-31T03:00:29.296+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:00:29.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:00:29 smithi027 bash[22863]: debug 2024-08-31T03:00:29.300+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:00:30.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:29 smithi163 bash[24253]: audit 2024-08-31T03:00:28.593017+0000 mgr.a (mgr.14388) 2128 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:00:30.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:29 smithi163 bash[24253]: cluster 2024-08-31T03:00:28.652003+0000 mgr.a (mgr.14388) 2129 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:30.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:29 smithi163 bash[24253]: audit 2024-08-31T03:00:29.302093+0000 mgr.a (mgr.14388) 2130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:00:30.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:29 smithi163 bash[24253]: cephadm 2024-08-31T03:00:29.303372+0000 mgr.a (mgr.14388) 2131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:00:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:29 smithi027 bash[22610]: audit 2024-08-31T03:00:28.593017+0000 mgr.a (mgr.14388) 2128 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:00:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:29 smithi027 bash[22610]: cluster 2024-08-31T03:00:28.652003+0000 mgr.a (mgr.14388) 2129 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:29 smithi027 bash[22610]: audit 2024-08-31T03:00:29.302093+0000 mgr.a (mgr.14388) 2130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:00:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:29 smithi027 bash[22610]: cephadm 2024-08-31T03:00:29.303372+0000 mgr.a (mgr.14388) 2131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:00:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:29 smithi191 bash[24992]: audit 2024-08-31T03:00:28.593017+0000 mgr.a (mgr.14388) 2128 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:00:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:29 smithi191 bash[24992]: cluster 2024-08-31T03:00:28.652003+0000 mgr.a (mgr.14388) 2129 : cluster [DBG] pgmap v1475: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:00:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:29 smithi191 bash[24992]: audit 2024-08-31T03:00:29.302093+0000 mgr.a (mgr.14388) 2130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:00:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:29 smithi191 bash[24992]: cephadm 2024-08-31T03:00:29.303372+0000 mgr.a (mgr.14388) 2131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:00:30.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:30.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:30.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:00:31.592 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:00:31.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:00:31.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:00:31.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:00:31.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:00:32.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:31 smithi163 bash[24253]: cluster 2024-08-31T03:00:30.652928+0000 mgr.a (mgr.14388) 2132 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:32.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:31 smithi163 bash[24253]: audit 2024-08-31T03:00:31.161307+0000 mgr.a (mgr.14388) 2133 : audit [DBG] from='client.58359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:31 smithi027 bash[22610]: cluster 2024-08-31T03:00:30.652928+0000 mgr.a (mgr.14388) 2132 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:31 smithi027 bash[22610]: audit 2024-08-31T03:00:31.161307+0000 mgr.a (mgr.14388) 2133 : audit [DBG] from='client.58359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:31 smithi191 bash[24992]: cluster 2024-08-31T03:00:30.652928+0000 mgr.a (mgr.14388) 2132 : cluster [DBG] pgmap v1476: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:31 smithi191 bash[24992]: audit 2024-08-31T03:00:31.161307+0000 mgr.a (mgr.14388) 2133 : audit [DBG] from='client.58359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:34.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:33 smithi163 bash[24253]: cluster 2024-08-31T03:00:32.653887+0000 mgr.a (mgr.14388) 2134 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:33 smithi027 bash[22610]: cluster 2024-08-31T03:00:32.653887+0000 mgr.a (mgr.14388) 2134 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:33 smithi191 bash[24992]: cluster 2024-08-31T03:00:32.653887+0000 mgr.a (mgr.14388) 2134 : cluster [DBG] pgmap v1477: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:36.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:35 smithi163 bash[24253]: cluster 2024-08-31T03:00:34.656138+0000 mgr.a (mgr.14388) 2135 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:35 smithi027 bash[22610]: cluster 2024-08-31T03:00:34.656138+0000 mgr.a (mgr.14388) 2135 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:35 smithi191 bash[24992]: cluster 2024-08-31T03:00:34.656138+0000 mgr.a (mgr.14388) 2135 : cluster [DBG] pgmap v1478: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:36.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:36.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:36.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:00:37.364 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:00:37.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:00:37.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:00:37.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:00:37.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:00:38.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:37 smithi163 bash[24253]: cluster 2024-08-31T03:00:36.656878+0000 mgr.a (mgr.14388) 2136 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:38.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:37 smithi163 bash[24253]: audit 2024-08-31T03:00:36.926627+0000 mgr.a (mgr.14388) 2137 : audit [DBG] from='client.58437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:37 smithi027 bash[22610]: cluster 2024-08-31T03:00:36.656878+0000 mgr.a (mgr.14388) 2136 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:37 smithi027 bash[22610]: audit 2024-08-31T03:00:36.926627+0000 mgr.a (mgr.14388) 2137 : audit [DBG] from='client.58437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:37 smithi191 bash[24992]: cluster 2024-08-31T03:00:36.656878+0000 mgr.a (mgr.14388) 2136 : cluster [DBG] pgmap v1479: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:37 smithi191 bash[24992]: audit 2024-08-31T03:00:36.926627+0000 mgr.a (mgr.14388) 2137 : audit [DBG] from='client.58437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:40.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:39 smithi163 bash[24253]: cluster 2024-08-31T03:00:38.659111+0000 mgr.a (mgr.14388) 2138 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:39 smithi027 bash[22610]: cluster 2024-08-31T03:00:38.659111+0000 mgr.a (mgr.14388) 2138 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:39 smithi191 bash[24992]: cluster 2024-08-31T03:00:38.659111+0000 mgr.a (mgr.14388) 2138 : cluster [DBG] pgmap v1480: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:42.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:41 smithi163 bash[24253]: cluster 2024-08-31T03:00:40.659943+0000 mgr.a (mgr.14388) 2139 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:41 smithi027 bash[22610]: cluster 2024-08-31T03:00:40.659943+0000 mgr.a (mgr.14388) 2139 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:41 smithi191 bash[24992]: cluster 2024-08-31T03:00:40.659943+0000 mgr.a (mgr.14388) 2139 : cluster [DBG] pgmap v1481: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:00:43.145 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:00:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:00:43.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:00:43.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:00:43.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:00:44.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:43 smithi163 bash[24253]: cluster 2024-08-31T03:00:42.660712+0000 mgr.a (mgr.14388) 2140 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:44.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:43 smithi163 bash[24253]: audit 2024-08-31T03:00:42.705628+0000 mgr.a (mgr.14388) 2141 : audit [DBG] from='client.58515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:43 smithi027 bash[22610]: cluster 2024-08-31T03:00:42.660712+0000 mgr.a (mgr.14388) 2140 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:43 smithi027 bash[22610]: audit 2024-08-31T03:00:42.705628+0000 mgr.a (mgr.14388) 2141 : audit [DBG] from='client.58515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:43 smithi191 bash[24992]: cluster 2024-08-31T03:00:42.660712+0000 mgr.a (mgr.14388) 2140 : cluster [DBG] pgmap v1482: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:43 smithi191 bash[24992]: audit 2024-08-31T03:00:42.705628+0000 mgr.a (mgr.14388) 2141 : audit [DBG] from='client.58515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:46.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:45 smithi163 bash[24253]: cluster 2024-08-31T03:00:44.663430+0000 mgr.a (mgr.14388) 2142 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:45 smithi027 bash[22610]: cluster 2024-08-31T03:00:44.663430+0000 mgr.a (mgr.14388) 2142 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:45 smithi191 bash[24992]: cluster 2024-08-31T03:00:44.663430+0000 mgr.a (mgr.14388) 2142 : cluster [DBG] pgmap v1483: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:00:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:48.147 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:48.148 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:00:48.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:47 smithi163 bash[24253]: cluster 2024-08-31T03:00:46.664212+0000 mgr.a (mgr.14388) 2143 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:00:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:47 smithi027 bash[22610]: cluster 2024-08-31T03:00:46.664212+0000 mgr.a (mgr.14388) 2143 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:00:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:47 smithi191 bash[24992]: cluster 2024-08-31T03:00:46.664212+0000 mgr.a (mgr.14388) 2143 : cluster [DBG] pgmap v1484: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:00:48.915 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:00:48.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:00:48.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:00:48.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:00:48.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:00:50.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:49 smithi163 bash[24253]: audit 2024-08-31T03:00:48.479598+0000 mgr.a (mgr.14388) 2144 : audit [DBG] from='client.58590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:50.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:49 smithi163 bash[24253]: cluster 2024-08-31T03:00:48.665509+0000 mgr.a (mgr.14388) 2145 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:49 smithi027 bash[22610]: audit 2024-08-31T03:00:48.479598+0000 mgr.a (mgr.14388) 2144 : audit [DBG] from='client.58590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:49 smithi027 bash[22610]: cluster 2024-08-31T03:00:48.665509+0000 mgr.a (mgr.14388) 2145 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:49 smithi191 bash[24992]: audit 2024-08-31T03:00:48.479598+0000 mgr.a (mgr.14388) 2144 : audit [DBG] from='client.58590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:49 smithi191 bash[24992]: cluster 2024-08-31T03:00:48.665509+0000 mgr.a (mgr.14388) 2145 : cluster [DBG] pgmap v1485: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:52.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:51 smithi163 bash[24253]: cluster 2024-08-31T03:00:50.666371+0000 mgr.a (mgr.14388) 2146 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:51 smithi027 bash[22610]: cluster 2024-08-31T03:00:50.666371+0000 mgr.a (mgr.14388) 2146 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:52.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:51 smithi191 bash[24992]: cluster 2024-08-31T03:00:50.666371+0000 mgr.a (mgr.14388) 2146 : cluster [DBG] pgmap v1486: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:00:53.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:53.917 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:53.917 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:00:54.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:53 smithi163 bash[24253]: cluster 2024-08-31T03:00:52.667168+0000 mgr.a (mgr.14388) 2147 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:00:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:53 smithi027 bash[22610]: cluster 2024-08-31T03:00:52.667168+0000 mgr.a (mgr.14388) 2147 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:00:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:53 smithi191 bash[24992]: cluster 2024-08-31T03:00:52.667168+0000 mgr.a (mgr.14388) 2147 : cluster [DBG] pgmap v1487: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:00:54.656 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:00:54.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:00:54.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:00:54.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:00:54.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:00:55.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:54 smithi163 bash[24253]: audit 2024-08-31T03:00:54.246582+0000 mgr.a (mgr.14388) 2148 : audit [DBG] from='client.58668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:54 smithi027 bash[22610]: audit 2024-08-31T03:00:54.246582+0000 mgr.a (mgr.14388) 2148 : audit [DBG] from='client.58668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:55.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:54 smithi191 bash[24992]: audit 2024-08-31T03:00:54.246582+0000 mgr.a (mgr.14388) 2148 : audit [DBG] from='client.58668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:00:56.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:55 smithi163 bash[24253]: cluster 2024-08-31T03:00:54.668529+0000 mgr.a (mgr.14388) 2149 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:55 smithi027 bash[22610]: cluster 2024-08-31T03:00:54.668529+0000 mgr.a (mgr.14388) 2149 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:55 smithi191 bash[24992]: cluster 2024-08-31T03:00:54.668529+0000 mgr.a (mgr.14388) 2149 : cluster [DBG] pgmap v1488: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:00:58.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:57 smithi163 bash[24253]: cluster 2024-08-31T03:00:56.669286+0000 mgr.a (mgr.14388) 2150 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:00:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:57 smithi027 bash[22610]: cluster 2024-08-31T03:00:56.669286+0000 mgr.a (mgr.14388) 2150 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:00:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:57 smithi191 bash[24992]: cluster 2024-08-31T03:00:56.669286+0000 mgr.a (mgr.14388) 2150 : cluster [DBG] pgmap v1489: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:00:59.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:00:59.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:00:59.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:00:59 smithi163 bash[24253]: cluster 2024-08-31T03:00:58.671258+0000 mgr.a (mgr.14388) 2151 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:01:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:00:59 smithi027 bash[22610]: cluster 2024-08-31T03:00:58.671258+0000 mgr.a (mgr.14388) 2151 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:01:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:00:59 smithi191 bash[24992]: cluster 2024-08-31T03:00:58.671258+0000 mgr.a (mgr.14388) 2151 : cluster [DBG] pgmap v1490: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:01:00.429 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:00.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:00.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:00.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:00.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:01.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:00 smithi163 bash[24253]: audit 2024-08-31T03:00:59.999553+0000 mgr.a (mgr.14388) 2152 : audit [DBG] from='client.58746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:00 smithi027 bash[22610]: audit 2024-08-31T03:00:59.999553+0000 mgr.a (mgr.14388) 2152 : audit [DBG] from='client.58746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:00 smithi191 bash[24992]: audit 2024-08-31T03:00:59.999553+0000 mgr.a (mgr.14388) 2152 : audit [DBG] from='client.58746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:02.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:01 smithi163 bash[24253]: cluster 2024-08-31T03:01:00.672158+0000 mgr.a (mgr.14388) 2153 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:02.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:01 smithi027 bash[22610]: cluster 2024-08-31T03:01:00.672158+0000 mgr.a (mgr.14388) 2153 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:01 smithi191 bash[24992]: cluster 2024-08-31T03:01:00.672158+0000 mgr.a (mgr.14388) 2153 : cluster [DBG] pgmap v1491: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:04.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:03 smithi163 bash[24253]: cluster 2024-08-31T03:01:02.672919+0000 mgr.a (mgr.14388) 2154 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:03 smithi027 bash[22610]: cluster 2024-08-31T03:01:02.672919+0000 mgr.a (mgr.14388) 2154 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:03 smithi191 bash[24992]: cluster 2024-08-31T03:01:02.672919+0000 mgr.a (mgr.14388) 2154 : cluster [DBG] pgmap v1492: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:05.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:01:05.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:01:05.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:06.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:05 smithi163 bash[24253]: cluster 2024-08-31T03:01:04.675110+0000 mgr.a (mgr.14388) 2155 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:06.201 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:06.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:06.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:06.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:06.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:05 smithi027 bash[22610]: cluster 2024-08-31T03:01:04.675110+0000 mgr.a (mgr.14388) 2155 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:05 smithi191 bash[24992]: cluster 2024-08-31T03:01:04.675110+0000 mgr.a (mgr.14388) 2155 : cluster [DBG] pgmap v1493: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:07.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:06 smithi163 bash[24253]: audit 2024-08-31T03:01:05.768054+0000 mgr.a (mgr.14388) 2156 : audit [DBG] from='client.58824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:06 smithi027 bash[22610]: audit 2024-08-31T03:01:05.768054+0000 mgr.a (mgr.14388) 2156 : audit [DBG] from='client.58824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:06 smithi191 bash[24992]: audit 2024-08-31T03:01:05.768054+0000 mgr.a (mgr.14388) 2156 : audit [DBG] from='client.58824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:08.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:07 smithi163 bash[24253]: cluster 2024-08-31T03:01:06.675999+0000 mgr.a (mgr.14388) 2157 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:07 smithi027 bash[22610]: cluster 2024-08-31T03:01:06.675999+0000 mgr.a (mgr.14388) 2157 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:07 smithi191 bash[24992]: cluster 2024-08-31T03:01:06.675999+0000 mgr.a (mgr.14388) 2157 : cluster [DBG] pgmap v1494: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:10.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:09 smithi163 bash[24253]: cluster 2024-08-31T03:01:08.678187+0000 mgr.a (mgr.14388) 2158 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:09 smithi027 bash[22610]: cluster 2024-08-31T03:01:08.678187+0000 mgr.a (mgr.14388) 2158 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:09 smithi191 bash[24992]: cluster 2024-08-31T03:01:08.678187+0000 mgr.a (mgr.14388) 2158 : cluster [DBG] pgmap v1495: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:11.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:01:11.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:01:11.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:11.944 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:11.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:11.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:11.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:11.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:11 smithi027 bash[22610]: cluster 2024-08-31T03:01:10.678990+0000 mgr.a (mgr.14388) 2159 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:11 smithi191 bash[24992]: cluster 2024-08-31T03:01:10.678990+0000 mgr.a (mgr.14388) 2159 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:12.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:11 smithi163 bash[24253]: cluster 2024-08-31T03:01:10.678990+0000 mgr.a (mgr.14388) 2159 : cluster [DBG] pgmap v1496: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:12 smithi027 bash[22610]: audit 2024-08-31T03:01:11.535528+0000 mgr.a (mgr.14388) 2160 : audit [DBG] from='client.58896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:12 smithi191 bash[24992]: audit 2024-08-31T03:01:11.535528+0000 mgr.a (mgr.14388) 2160 : audit [DBG] from='client.58896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:13.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:12 smithi163 bash[24253]: audit 2024-08-31T03:01:11.535528+0000 mgr.a (mgr.14388) 2160 : audit [DBG] from='client.58896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:13 smithi027 bash[22610]: cluster 2024-08-31T03:01:12.679880+0000 mgr.a (mgr.14388) 2161 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:13 smithi191 bash[24992]: cluster 2024-08-31T03:01:12.679880+0000 mgr.a (mgr.14388) 2161 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:14.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:13 smithi163 bash[24253]: cluster 2024-08-31T03:01:12.679880+0000 mgr.a (mgr.14388) 2161 : cluster [DBG] pgmap v1497: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:15 smithi027 bash[22610]: cluster 2024-08-31T03:01:14.682079+0000 mgr.a (mgr.14388) 2162 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:15 smithi191 bash[24992]: cluster 2024-08-31T03:01:14.682079+0000 mgr.a (mgr.14388) 2162 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:16.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:15 smithi163 bash[24253]: cluster 2024-08-31T03:01:14.682079+0000 mgr.a (mgr.14388) 2162 : cluster [DBG] pgmap v1498: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:16.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:01:16.946 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:01:16.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:17.686 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:17.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:17.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:17.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:17.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:17 smithi027 bash[22610]: cluster 2024-08-31T03:01:16.682846+0000 mgr.a (mgr.14388) 2163 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:17 smithi027 bash[22610]: audit 2024-08-31T03:01:17.275172+0000 mgr.a (mgr.14388) 2164 : audit [DBG] from='client.58974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:17 smithi191 bash[24992]: cluster 2024-08-31T03:01:16.682846+0000 mgr.a (mgr.14388) 2163 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:17 smithi191 bash[24992]: audit 2024-08-31T03:01:17.275172+0000 mgr.a (mgr.14388) 2164 : audit [DBG] from='client.58974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:18.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:17 smithi163 bash[24253]: cluster 2024-08-31T03:01:16.682846+0000 mgr.a (mgr.14388) 2163 : cluster [DBG] pgmap v1499: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:18.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:17 smithi163 bash[24253]: audit 2024-08-31T03:01:17.275172+0000 mgr.a (mgr.14388) 2164 : audit [DBG] from='client.58974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:19 smithi027 bash[22610]: cluster 2024-08-31T03:01:18.685123+0000 mgr.a (mgr.14388) 2165 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:19 smithi191 bash[24992]: cluster 2024-08-31T03:01:18.685123+0000 mgr.a (mgr.14388) 2165 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:20.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:19 smithi163 bash[24253]: cluster 2024-08-31T03:01:18.685123+0000 mgr.a (mgr.14388) 2165 : cluster [DBG] pgmap v1500: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:21 smithi027 bash[22610]: cluster 2024-08-31T03:01:20.685872+0000 mgr.a (mgr.14388) 2166 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:21 smithi191 bash[24992]: cluster 2024-08-31T03:01:20.685872+0000 mgr.a (mgr.14388) 2166 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:22.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:21 smithi163 bash[24253]: cluster 2024-08-31T03:01:20.685872+0000 mgr.a (mgr.14388) 2166 : cluster [DBG] pgmap v1501: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:22.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:01:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:01:22.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:23.450 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:23 smithi027 bash[22610]: cluster 2024-08-31T03:01:22.686603+0000 mgr.a (mgr.14388) 2167 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:23 smithi027 bash[22610]: audit 2024-08-31T03:01:23.025400+0000 mgr.a (mgr.14388) 2168 : audit [DBG] from='client.59049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:23 smithi191 bash[24992]: cluster 2024-08-31T03:01:22.686603+0000 mgr.a (mgr.14388) 2167 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:23 smithi191 bash[24992]: audit 2024-08-31T03:01:23.025400+0000 mgr.a (mgr.14388) 2168 : audit [DBG] from='client.59049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:24.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:23 smithi163 bash[24253]: cluster 2024-08-31T03:01:22.686603+0000 mgr.a (mgr.14388) 2167 : cluster [DBG] pgmap v1502: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:24.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:23 smithi163 bash[24253]: audit 2024-08-31T03:01:23.025400+0000 mgr.a (mgr.14388) 2168 : audit [DBG] from='client.59049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:25 smithi191 bash[24992]: cluster 2024-08-31T03:01:24.689194+0000 mgr.a (mgr.14388) 2169 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:25 smithi163 bash[24253]: cluster 2024-08-31T03:01:24.689194+0000 mgr.a (mgr.14388) 2169 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:25 smithi027 bash[22610]: cluster 2024-08-31T03:01:24.689194+0000 mgr.a (mgr.14388) 2169 : cluster [DBG] pgmap v1503: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:27 smithi191 bash[24992]: cluster 2024-08-31T03:01:26.689959+0000 mgr.a (mgr.14388) 2170 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:01:28.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:27 smithi163 bash[24253]: cluster 2024-08-31T03:01:26.689959+0000 mgr.a (mgr.14388) 2170 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:01:28.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:01:28.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:01:28.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:27 smithi027 bash[22610]: cluster 2024-08-31T03:01:26.689959+0000 mgr.a (mgr.14388) 2170 : cluster [DBG] pgmap v1504: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:01:29.200 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:29.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:29.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:29.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:29.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:29 smithi191 bash[24992]: cluster 2024-08-31T03:01:28.691878+0000 mgr.a (mgr.14388) 2171 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:29 smithi191 bash[24992]: audit 2024-08-31T03:01:28.782612+0000 mgr.a (mgr.14388) 2172 : audit [DBG] from='client.59127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:29 smithi191 bash[24992]: audit 2024-08-31T03:01:29.354253+0000 mon.a (mon.0) 916 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:01:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:29 smithi163 bash[24253]: cluster 2024-08-31T03:01:28.691878+0000 mgr.a (mgr.14388) 2171 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:29 smithi163 bash[24253]: audit 2024-08-31T03:01:28.782612+0000 mgr.a (mgr.14388) 2172 : audit [DBG] from='client.59127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:29 smithi163 bash[24253]: audit 2024-08-31T03:01:29.354253+0000 mon.a (mon.0) 916 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:01:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:29 smithi027 bash[22610]: cluster 2024-08-31T03:01:28.691878+0000 mgr.a (mgr.14388) 2171 : cluster [DBG] pgmap v1505: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:29 smithi027 bash[22610]: audit 2024-08-31T03:01:28.782612+0000 mgr.a (mgr.14388) 2172 : audit [DBG] from='client.59127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:29 smithi027 bash[22610]: audit 2024-08-31T03:01:29.354253+0000 mon.a (mon.0) 916 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:01:31.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:01:30 smithi027 bash[22863]: debug 2024-08-31T03:01:30.906+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:01:31.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:01:30 smithi027 bash[22863]: debug 2024-08-31T03:01:30.906+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:01:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:30 smithi027 bash[22610]: audit 2024-08-31T03:01:30.181183+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:01:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:30 smithi027 bash[22610]: audit 2024-08-31T03:01:30.182487+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:01:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:30 smithi027 bash[22610]: audit 2024-08-31T03:01:30.191118+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:01:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:30 smithi027 bash[22610]: audit 2024-08-31T03:01:30.193556+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:01:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:30 smithi027 bash[22610]: audit 2024-08-31T03:01:30.196204+0000 mgr.a (mgr.14388) 2173 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:01:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:30 smithi191 bash[24992]: audit 2024-08-31T03:01:30.181183+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:01:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:30 smithi191 bash[24992]: audit 2024-08-31T03:01:30.182487+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:01:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:30 smithi191 bash[24992]: audit 2024-08-31T03:01:30.191118+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:01:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:30 smithi191 bash[24992]: audit 2024-08-31T03:01:30.193556+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:01:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:30 smithi191 bash[24992]: audit 2024-08-31T03:01:30.196204+0000 mgr.a (mgr.14388) 2173 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:01:31.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:30 smithi163 bash[24253]: audit 2024-08-31T03:01:30.181183+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:01:31.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:30 smithi163 bash[24253]: audit 2024-08-31T03:01:30.182487+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:01:31.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:30 smithi163 bash[24253]: audit 2024-08-31T03:01:30.191118+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:01:31.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:30 smithi163 bash[24253]: audit 2024-08-31T03:01:30.193556+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:01:31.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:30 smithi163 bash[24253]: audit 2024-08-31T03:01:30.196204+0000 mgr.a (mgr.14388) 2173 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:01:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:31 smithi191 bash[24992]: cluster 2024-08-31T03:01:30.692361+0000 mgr.a (mgr.14388) 2174 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:01:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:31 smithi191 bash[24992]: audit 2024-08-31T03:01:30.906862+0000 mgr.a (mgr.14388) 2175 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:01:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:31 smithi191 bash[24992]: cephadm 2024-08-31T03:01:30.908401+0000 mgr.a (mgr.14388) 2176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:01:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:31 smithi163 bash[24253]: cluster 2024-08-31T03:01:30.692361+0000 mgr.a (mgr.14388) 2174 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:01:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:31 smithi163 bash[24253]: audit 2024-08-31T03:01:30.906862+0000 mgr.a (mgr.14388) 2175 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:01:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:31 smithi163 bash[24253]: cephadm 2024-08-31T03:01:30.908401+0000 mgr.a (mgr.14388) 2176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:01:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:31 smithi027 bash[22610]: cluster 2024-08-31T03:01:30.692361+0000 mgr.a (mgr.14388) 2174 : cluster [DBG] pgmap v1506: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:01:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:31 smithi027 bash[22610]: audit 2024-08-31T03:01:30.906862+0000 mgr.a (mgr.14388) 2175 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:01:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:31 smithi027 bash[22610]: cephadm 2024-08-31T03:01:30.908401+0000 mgr.a (mgr.14388) 2176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:01:34.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:01:34.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:01:34.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:34 smithi191 bash[24992]: cluster 2024-08-31T03:01:32.693315+0000 mgr.a (mgr.14388) 2177 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:01:34.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:34 smithi163 bash[24253]: cluster 2024-08-31T03:01:32.693315+0000 mgr.a (mgr.14388) 2177 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:01:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:34 smithi027 bash[22610]: cluster 2024-08-31T03:01:32.693315+0000 mgr.a (mgr.14388) 2177 : cluster [DBG] pgmap v1507: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:01:34.969 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:34.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:34.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:34.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:34.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:36 smithi191 bash[24992]: audit 2024-08-31T03:01:34.542500+0000 mgr.a (mgr.14388) 2178 : audit [DBG] from='client.59310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:36 smithi191 bash[24992]: cluster 2024-08-31T03:01:34.694826+0000 mgr.a (mgr.14388) 2179 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:36.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:36 smithi163 bash[24253]: audit 2024-08-31T03:01:34.542500+0000 mgr.a (mgr.14388) 2178 : audit [DBG] from='client.59310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:36.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:36 smithi163 bash[24253]: cluster 2024-08-31T03:01:34.694826+0000 mgr.a (mgr.14388) 2179 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:36 smithi027 bash[22610]: audit 2024-08-31T03:01:34.542500+0000 mgr.a (mgr.14388) 2178 : audit [DBG] from='client.59310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:36 smithi027 bash[22610]: cluster 2024-08-31T03:01:34.694826+0000 mgr.a (mgr.14388) 2179 : cluster [DBG] pgmap v1508: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:38 smithi191 bash[24992]: cluster 2024-08-31T03:01:36.695686+0000 mgr.a (mgr.14388) 2180 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:38.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:38 smithi163 bash[24253]: cluster 2024-08-31T03:01:36.695686+0000 mgr.a (mgr.14388) 2180 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:38 smithi027 bash[22610]: cluster 2024-08-31T03:01:36.695686+0000 mgr.a (mgr.14388) 2180 : cluster [DBG] pgmap v1509: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:39.971 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:01:39.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:01:39.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:40 smithi191 bash[24992]: cluster 2024-08-31T03:01:38.697859+0000 mgr.a (mgr.14388) 2181 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:40.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:40 smithi163 bash[24253]: cluster 2024-08-31T03:01:38.697859+0000 mgr.a (mgr.14388) 2181 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:40 smithi027 bash[22610]: cluster 2024-08-31T03:01:38.697859+0000 mgr.a (mgr.14388) 2181 : cluster [DBG] pgmap v1510: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:40.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:40.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:40.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:40.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:40.745 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:41 smithi191 bash[24992]: audit 2024-08-31T03:01:40.309856+0000 mgr.a (mgr.14388) 2182 : audit [DBG] from='client.59388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:41.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:41 smithi163 bash[24253]: audit 2024-08-31T03:01:40.309856+0000 mgr.a (mgr.14388) 2182 : audit [DBG] from='client.59388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:41 smithi027 bash[22610]: audit 2024-08-31T03:01:40.309856+0000 mgr.a (mgr.14388) 2182 : audit [DBG] from='client.59388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:42 smithi191 bash[24992]: cluster 2024-08-31T03:01:40.698414+0000 mgr.a (mgr.14388) 2183 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:42.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:42 smithi163 bash[24253]: cluster 2024-08-31T03:01:40.698414+0000 mgr.a (mgr.14388) 2183 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:42 smithi027 bash[22610]: cluster 2024-08-31T03:01:40.698414+0000 mgr.a (mgr.14388) 2183 : cluster [DBG] pgmap v1511: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:44 smithi191 bash[24992]: cluster 2024-08-31T03:01:42.699168+0000 mgr.a (mgr.14388) 2184 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:44.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:44 smithi163 bash[24253]: cluster 2024-08-31T03:01:42.699168+0000 mgr.a (mgr.14388) 2184 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:44 smithi027 bash[22610]: cluster 2024-08-31T03:01:42.699168+0000 mgr.a (mgr.14388) 2184 : cluster [DBG] pgmap v1512: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:45.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:01:45.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:01:45.747 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:46 smithi191 bash[24992]: cluster 2024-08-31T03:01:44.701372+0000 mgr.a (mgr.14388) 2185 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:46.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:46 smithi163 bash[24253]: cluster 2024-08-31T03:01:44.701372+0000 mgr.a (mgr.14388) 2185 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:46 smithi027 bash[22610]: cluster 2024-08-31T03:01:44.701372+0000 mgr.a (mgr.14388) 2185 : cluster [DBG] pgmap v1513: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:01:46.506 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:46.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:46.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:46.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:46.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:47.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:47 smithi163 bash[24253]: audit 2024-08-31T03:01:46.083042+0000 mgr.a (mgr.14388) 2186 : audit [DBG] from='client.59466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:47 smithi027 bash[22610]: audit 2024-08-31T03:01:46.083042+0000 mgr.a (mgr.14388) 2186 : audit [DBG] from='client.59466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:47 smithi191 bash[24992]: audit 2024-08-31T03:01:46.083042+0000 mgr.a (mgr.14388) 2186 : audit [DBG] from='client.59466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:48.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:48 smithi163 bash[24253]: cluster 2024-08-31T03:01:46.702372+0000 mgr.a (mgr.14388) 2187 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:48 smithi027 bash[22610]: cluster 2024-08-31T03:01:46.702372+0000 mgr.a (mgr.14388) 2187 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:48 smithi191 bash[24992]: cluster 2024-08-31T03:01:46.702372+0000 mgr.a (mgr.14388) 2187 : cluster [DBG] pgmap v1514: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:50.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:50 smithi163 bash[24253]: cluster 2024-08-31T03:01:48.704562+0000 mgr.a (mgr.14388) 2188 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:50 smithi027 bash[22610]: cluster 2024-08-31T03:01:48.704562+0000 mgr.a (mgr.14388) 2188 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:50 smithi191 bash[24992]: cluster 2024-08-31T03:01:48.704562+0000 mgr.a (mgr.14388) 2188 : cluster [DBG] pgmap v1515: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:51.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:01:51.509 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:01:51.509 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:52.249 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:52.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:52.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:52.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:52.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:52.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:52 smithi163 bash[24253]: cluster 2024-08-31T03:01:50.705308+0000 mgr.a (mgr.14388) 2189 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:52 smithi027 bash[22610]: cluster 2024-08-31T03:01:50.705308+0000 mgr.a (mgr.14388) 2189 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:52 smithi191 bash[24992]: cluster 2024-08-31T03:01:50.705308+0000 mgr.a (mgr.14388) 2189 : cluster [DBG] pgmap v1516: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:53.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:53 smithi163 bash[24253]: audit 2024-08-31T03:01:51.838951+0000 mgr.a (mgr.14388) 2190 : audit [DBG] from='client.59544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:53 smithi027 bash[22610]: audit 2024-08-31T03:01:51.838951+0000 mgr.a (mgr.14388) 2190 : audit [DBG] from='client.59544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:53 smithi191 bash[24992]: audit 2024-08-31T03:01:51.838951+0000 mgr.a (mgr.14388) 2190 : audit [DBG] from='client.59544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:54.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:54 smithi163 bash[24253]: cluster 2024-08-31T03:01:52.706179+0000 mgr.a (mgr.14388) 2191 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:54 smithi027 bash[22610]: cluster 2024-08-31T03:01:52.706179+0000 mgr.a (mgr.14388) 2191 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:54 smithi191 bash[24992]: cluster 2024-08-31T03:01:52.706179+0000 mgr.a (mgr.14388) 2191 : cluster [DBG] pgmap v1517: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:56.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:56 smithi163 bash[24253]: cluster 2024-08-31T03:01:54.708763+0000 mgr.a (mgr.14388) 2192 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:56 smithi027 bash[22610]: cluster 2024-08-31T03:01:54.708763+0000 mgr.a (mgr.14388) 2192 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:56 smithi191 bash[24992]: cluster 2024-08-31T03:01:54.708763+0000 mgr.a (mgr.14388) 2192 : cluster [DBG] pgmap v1518: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:01:57.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:01:57.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:01:57.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:01:58.019 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:01:58.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:01:58.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:01:58.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:01:58.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:01:58.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:58 smithi163 bash[24253]: cluster 2024-08-31T03:01:56.709617+0000 mgr.a (mgr.14388) 2193 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:58 smithi027 bash[22610]: cluster 2024-08-31T03:01:56.709617+0000 mgr.a (mgr.14388) 2193 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:58 smithi191 bash[24992]: cluster 2024-08-31T03:01:56.709617+0000 mgr.a (mgr.14388) 2193 : cluster [DBG] pgmap v1519: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:01:59.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:01:59 smithi163 bash[24253]: audit 2024-08-31T03:01:57.588578+0000 mgr.a (mgr.14388) 2194 : audit [DBG] from='client.59619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:01:59 smithi027 bash[22610]: audit 2024-08-31T03:01:57.588578+0000 mgr.a (mgr.14388) 2194 : audit [DBG] from='client.59619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:01:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:01:59 smithi191 bash[24992]: audit 2024-08-31T03:01:57.588578+0000 mgr.a (mgr.14388) 2194 : audit [DBG] from='client.59619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:00.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:00 smithi163 bash[24253]: cluster 2024-08-31T03:01:58.712077+0000 mgr.a (mgr.14388) 2195 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:02:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:00 smithi027 bash[22610]: cluster 2024-08-31T03:01:58.712077+0000 mgr.a (mgr.14388) 2195 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:02:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:00 smithi191 bash[24992]: cluster 2024-08-31T03:01:58.712077+0000 mgr.a (mgr.14388) 2195 : cluster [DBG] pgmap v1520: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:02:02.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:02 smithi163 bash[24253]: cluster 2024-08-31T03:02:00.712850+0000 mgr.a (mgr.14388) 2196 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:02:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:02 smithi027 bash[22610]: cluster 2024-08-31T03:02:00.712850+0000 mgr.a (mgr.14388) 2196 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:02:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:02 smithi191 bash[24992]: cluster 2024-08-31T03:02:00.712850+0000 mgr.a (mgr.14388) 2196 : cluster [DBG] pgmap v1521: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:02:03.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:02:03.021 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:02:03.021 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:02:03.754 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:02:03.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:02:03.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:02:03.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:02:03.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:02:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:04 smithi163 bash[24253]: cluster 2024-08-31T03:02:02.713643+0000 mgr.a (mgr.14388) 2197 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:02:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:04 smithi163 bash[24253]: audit 2024-08-31T03:02:03.353236+0000 mgr.a (mgr.14388) 2198 : audit [DBG] from='client.59694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:04 smithi027 bash[22610]: cluster 2024-08-31T03:02:02.713643+0000 mgr.a (mgr.14388) 2197 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:02:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:04 smithi027 bash[22610]: audit 2024-08-31T03:02:03.353236+0000 mgr.a (mgr.14388) 2198 : audit [DBG] from='client.59694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:04 smithi191 bash[24992]: cluster 2024-08-31T03:02:02.713643+0000 mgr.a (mgr.14388) 2197 : cluster [DBG] pgmap v1522: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:02:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:04 smithi191 bash[24992]: audit 2024-08-31T03:02:03.353236+0000 mgr.a (mgr.14388) 2198 : audit [DBG] from='client.59694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:06.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:06 smithi163 bash[24253]: cluster 2024-08-31T03:02:04.716581+0000 mgr.a (mgr.14388) 2199 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:06 smithi027 bash[22610]: cluster 2024-08-31T03:02:04.716581+0000 mgr.a (mgr.14388) 2199 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:06 smithi191 bash[24992]: cluster 2024-08-31T03:02:04.716581+0000 mgr.a (mgr.14388) 2199 : cluster [DBG] pgmap v1523: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:08 smithi163 bash[24253]: cluster 2024-08-31T03:02:06.717561+0000 mgr.a (mgr.14388) 2200 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:02:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:08 smithi027 bash[22610]: cluster 2024-08-31T03:02:06.717561+0000 mgr.a (mgr.14388) 2200 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:02:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:08 smithi191 bash[24992]: cluster 2024-08-31T03:02:06.717561+0000 mgr.a (mgr.14388) 2200 : cluster [DBG] pgmap v1524: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:02:08.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:02:08.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:02:08.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:02:09.501 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:02:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:02:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:02:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:02:09.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:02:10.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:10 smithi163 bash[24253]: cluster 2024-08-31T03:02:08.719704+0000 mgr.a (mgr.14388) 2201 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:10.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:10 smithi163 bash[24253]: audit 2024-08-31T03:02:09.090329+0000 mgr.a (mgr.14388) 2202 : audit [DBG] from='client.59772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:10 smithi027 bash[22610]: cluster 2024-08-31T03:02:08.719704+0000 mgr.a (mgr.14388) 2201 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:10 smithi027 bash[22610]: audit 2024-08-31T03:02:09.090329+0000 mgr.a (mgr.14388) 2202 : audit [DBG] from='client.59772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:10 smithi191 bash[24992]: cluster 2024-08-31T03:02:08.719704+0000 mgr.a (mgr.14388) 2201 : cluster [DBG] pgmap v1525: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:10 smithi191 bash[24992]: audit 2024-08-31T03:02:09.090329+0000 mgr.a (mgr.14388) 2202 : audit [DBG] from='client.59772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:12.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:12 smithi163 bash[24253]: cluster 2024-08-31T03:02:10.720794+0000 mgr.a (mgr.14388) 2203 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:02:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:12 smithi027 bash[22610]: cluster 2024-08-31T03:02:10.720794+0000 mgr.a (mgr.14388) 2203 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:02:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:12 smithi191 bash[24992]: cluster 2024-08-31T03:02:10.720794+0000 mgr.a (mgr.14388) 2203 : cluster [DBG] pgmap v1526: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:02:14.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:14 smithi163 bash[24253]: cluster 2024-08-31T03:02:12.721602+0000 mgr.a (mgr.14388) 2204 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:02:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:14 smithi027 bash[22610]: cluster 2024-08-31T03:02:12.721602+0000 mgr.a (mgr.14388) 2204 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:02:14.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:02:14.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:02:14.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:02:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:14 smithi191 bash[24992]: cluster 2024-08-31T03:02:12.721602+0000 mgr.a (mgr.14388) 2204 : cluster [DBG] pgmap v1527: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:02:15.243 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:02:15.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:02:15.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:02:15.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:02:15.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:02:16.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:16 smithi163 bash[24253]: cluster 2024-08-31T03:02:14.723736+0000 mgr.a (mgr.14388) 2205 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:02:16.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:16 smithi163 bash[24253]: audit 2024-08-31T03:02:14.831645+0000 mgr.a (mgr.14388) 2206 : audit [DBG] from='client.59847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:16 smithi027 bash[22610]: cluster 2024-08-31T03:02:14.723736+0000 mgr.a (mgr.14388) 2205 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:02:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:16 smithi027 bash[22610]: audit 2024-08-31T03:02:14.831645+0000 mgr.a (mgr.14388) 2206 : audit [DBG] from='client.59847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:16.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:16 smithi191 bash[24992]: cluster 2024-08-31T03:02:14.723736+0000 mgr.a (mgr.14388) 2205 : cluster [DBG] pgmap v1528: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:02:16.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:16 smithi191 bash[24992]: audit 2024-08-31T03:02:14.831645+0000 mgr.a (mgr.14388) 2206 : audit [DBG] from='client.59847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:18.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:18 smithi163 bash[24253]: cluster 2024-08-31T03:02:16.724687+0000 mgr.a (mgr.14388) 2207 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:18 smithi027 bash[22610]: cluster 2024-08-31T03:02:16.724687+0000 mgr.a (mgr.14388) 2207 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:18 smithi191 bash[24992]: cluster 2024-08-31T03:02:16.724687+0000 mgr.a (mgr.14388) 2207 : cluster [DBG] pgmap v1529: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:20.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:02:20.245 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:02:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:02:20.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:20 smithi163 bash[24253]: cluster 2024-08-31T03:02:18.726961+0000 mgr.a (mgr.14388) 2208 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:02:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:20 smithi027 bash[22610]: cluster 2024-08-31T03:02:18.726961+0000 mgr.a (mgr.14388) 2208 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:02:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:20 smithi191 bash[24992]: cluster 2024-08-31T03:02:18.726961+0000 mgr.a (mgr.14388) 2208 : cluster [DBG] pgmap v1530: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:02:21.010 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:02:21.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:02:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:02:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:02:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:02:22.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:22 smithi163 bash[24253]: audit 2024-08-31T03:02:20.589271+0000 mgr.a (mgr.14388) 2209 : audit [DBG] from='client.59925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:22.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:22 smithi163 bash[24253]: cluster 2024-08-31T03:02:20.727703+0000 mgr.a (mgr.14388) 2210 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:22 smithi027 bash[22610]: audit 2024-08-31T03:02:20.589271+0000 mgr.a (mgr.14388) 2209 : audit [DBG] from='client.59925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:22 smithi027 bash[22610]: cluster 2024-08-31T03:02:20.727703+0000 mgr.a (mgr.14388) 2210 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:22 smithi191 bash[24992]: audit 2024-08-31T03:02:20.589271+0000 mgr.a (mgr.14388) 2209 : audit [DBG] from='client.59925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:22 smithi191 bash[24992]: cluster 2024-08-31T03:02:20.727703+0000 mgr.a (mgr.14388) 2210 : cluster [DBG] pgmap v1531: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:24.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:24 smithi163 bash[24253]: cluster 2024-08-31T03:02:22.728584+0000 mgr.a (mgr.14388) 2211 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:24 smithi027 bash[22610]: cluster 2024-08-31T03:02:22.728584+0000 mgr.a (mgr.14388) 2211 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:24 smithi191 bash[24992]: cluster 2024-08-31T03:02:22.728584+0000 mgr.a (mgr.14388) 2211 : cluster [DBG] pgmap v1532: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:26.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:02:26.012 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:02:26.012 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:02:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:26 smithi163 bash[24253]: cluster 2024-08-31T03:02:24.730831+0000 mgr.a (mgr.14388) 2212 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 22 op/s 2024-08-31T03:02:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:26 smithi027 bash[22610]: cluster 2024-08-31T03:02:24.730831+0000 mgr.a (mgr.14388) 2212 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 22 op/s 2024-08-31T03:02:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:26 smithi191 bash[24992]: cluster 2024-08-31T03:02:24.730831+0000 mgr.a (mgr.14388) 2212 : cluster [DBG] pgmap v1533: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 15 KiB/s rd, 0 B/s wr, 22 op/s 2024-08-31T03:02:26.790 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:02:26.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:02:26.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:02:26.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:02:26.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:02:27.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:27 smithi163 bash[24253]: audit 2024-08-31T03:02:26.350486+0000 mgr.a (mgr.14388) 2213 : audit [DBG] from='client.60000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:27 smithi027 bash[22610]: audit 2024-08-31T03:02:26.350486+0000 mgr.a (mgr.14388) 2213 : audit [DBG] from='client.60000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:27 smithi191 bash[24992]: audit 2024-08-31T03:02:26.350486+0000 mgr.a (mgr.14388) 2213 : audit [DBG] from='client.60000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:28.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:28 smithi163 bash[24253]: cluster 2024-08-31T03:02:26.731858+0000 mgr.a (mgr.14388) 2214 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 21 op/s 2024-08-31T03:02:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:28 smithi027 bash[22610]: cluster 2024-08-31T03:02:26.731858+0000 mgr.a (mgr.14388) 2214 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 21 op/s 2024-08-31T03:02:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:28 smithi191 bash[24992]: cluster 2024-08-31T03:02:26.731858+0000 mgr.a (mgr.14388) 2214 : cluster [DBG] pgmap v1534: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 14 KiB/s rd, 0 B/s wr, 21 op/s 2024-08-31T03:02:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:30 smithi163 bash[24253]: cluster 2024-08-31T03:02:28.734097+0000 mgr.a (mgr.14388) 2215 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:02:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:30 smithi027 bash[22610]: cluster 2024-08-31T03:02:28.734097+0000 mgr.a (mgr.14388) 2215 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:02:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:30 smithi191 bash[24992]: cluster 2024-08-31T03:02:28.734097+0000 mgr.a (mgr.14388) 2215 : cluster [DBG] pgmap v1535: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:02:31.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:31 smithi163 bash[24253]: audit 2024-08-31T03:02:30.959047+0000 mon.a (mon.0) 921 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:02:31.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:31 smithi027 bash[22610]: audit 2024-08-31T03:02:30.959047+0000 mon.a (mon.0) 921 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:02:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:31 smithi191 bash[24992]: audit 2024-08-31T03:02:30.959047+0000 mon.a (mon.0) 921 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:02:31.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:02:31.788 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:02:31.788 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:02:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:32 smithi163 bash[24253]: cluster 2024-08-31T03:02:30.734922+0000 mgr.a (mgr.14388) 2216 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:02:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:32 smithi163 bash[24253]: audit 2024-08-31T03:02:31.799349+0000 mon.a (mon.0) 922 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:02:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:32 smithi163 bash[24253]: audit 2024-08-31T03:02:31.800389+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:02:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:32 smithi163 bash[24253]: audit 2024-08-31T03:02:31.807219+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:02:32.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:32 smithi163 bash[24253]: audit 2024-08-31T03:02:31.809904+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:02:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:32 smithi027 bash[22610]: cluster 2024-08-31T03:02:30.734922+0000 mgr.a (mgr.14388) 2216 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:02:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:32 smithi027 bash[22610]: audit 2024-08-31T03:02:31.799349+0000 mon.a (mon.0) 922 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:02:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:32 smithi027 bash[22610]: audit 2024-08-31T03:02:31.800389+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:02:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:32 smithi027 bash[22610]: audit 2024-08-31T03:02:31.807219+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:02:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:32 smithi027 bash[22610]: audit 2024-08-31T03:02:31.809904+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:02:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:32 smithi191 bash[24992]: cluster 2024-08-31T03:02:30.734922+0000 mgr.a (mgr.14388) 2216 : cluster [DBG] pgmap v1536: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:02:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:32 smithi191 bash[24992]: audit 2024-08-31T03:02:31.799349+0000 mon.a (mon.0) 922 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:02:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:32 smithi191 bash[24992]: audit 2024-08-31T03:02:31.800389+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:02:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:32 smithi191 bash[24992]: audit 2024-08-31T03:02:31.807219+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:02:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:32 smithi191 bash[24992]: audit 2024-08-31T03:02:31.809904+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:02:32.920 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:02:32.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:02:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:02:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:02:32.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:02:32.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:02:32 smithi027 bash[22863]: debug 2024-08-31T03:02:32.524+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:02:32.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:02:32 smithi027 bash[22863]: debug 2024-08-31T03:02:32.536+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:02:33.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:33 smithi163 bash[24253]: audit 2024-08-31T03:02:31.811505+0000 mgr.a (mgr.14388) 2217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:02:33.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:33 smithi163 bash[24253]: audit 2024-08-31T03:02:32.146923+0000 mgr.a (mgr.14388) 2218 : audit [DBG] from='client.60084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:33 smithi027 bash[22610]: audit 2024-08-31T03:02:31.811505+0000 mgr.a (mgr.14388) 2217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:02:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:33 smithi027 bash[22610]: audit 2024-08-31T03:02:32.146923+0000 mgr.a (mgr.14388) 2218 : audit [DBG] from='client.60084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:33 smithi191 bash[24992]: audit 2024-08-31T03:02:31.811505+0000 mgr.a (mgr.14388) 2217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:02:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:33 smithi191 bash[24992]: audit 2024-08-31T03:02:32.146923+0000 mgr.a (mgr.14388) 2218 : audit [DBG] from='client.60084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:34.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:34 smithi163 bash[24253]: audit 2024-08-31T03:02:32.529889+0000 mgr.a (mgr.14388) 2219 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:02:34.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:34 smithi163 bash[24253]: cephadm 2024-08-31T03:02:32.541143+0000 mgr.a (mgr.14388) 2220 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:02:34.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:34 smithi163 bash[24253]: cluster 2024-08-31T03:02:32.735587+0000 mgr.a (mgr.14388) 2221 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:02:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:34 smithi027 bash[22610]: audit 2024-08-31T03:02:32.529889+0000 mgr.a (mgr.14388) 2219 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:02:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:34 smithi027 bash[22610]: cephadm 2024-08-31T03:02:32.541143+0000 mgr.a (mgr.14388) 2220 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:02:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:34 smithi027 bash[22610]: cluster 2024-08-31T03:02:32.735587+0000 mgr.a (mgr.14388) 2221 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:02:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:34 smithi191 bash[24992]: audit 2024-08-31T03:02:32.529889+0000 mgr.a (mgr.14388) 2219 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:02:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:34 smithi191 bash[24992]: cephadm 2024-08-31T03:02:32.541143+0000 mgr.a (mgr.14388) 2220 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:02:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:34 smithi191 bash[24992]: cluster 2024-08-31T03:02:32.735587+0000 mgr.a (mgr.14388) 2221 : cluster [DBG] pgmap v1537: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:02:36.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:36 smithi163 bash[24253]: cluster 2024-08-31T03:02:34.737794+0000 mgr.a (mgr.14388) 2222 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 51 KiB/s rd, 426 B/s wr, 80 op/s 2024-08-31T03:02:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:36 smithi027 bash[22610]: cluster 2024-08-31T03:02:34.737794+0000 mgr.a (mgr.14388) 2222 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 51 KiB/s rd, 426 B/s wr, 80 op/s 2024-08-31T03:02:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:36 smithi191 bash[24992]: cluster 2024-08-31T03:02:34.737794+0000 mgr.a (mgr.14388) 2222 : cluster [DBG] pgmap v1538: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 51 KiB/s rd, 426 B/s wr, 80 op/s 2024-08-31T03:02:37.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:02:37.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:02:37.923 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:02:38.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:38 smithi163 bash[24253]: cluster 2024-08-31T03:02:36.738575+0000 mgr.a (mgr.14388) 2223 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T03:02:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:38 smithi027 bash[22610]: cluster 2024-08-31T03:02:36.738575+0000 mgr.a (mgr.14388) 2223 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T03:02:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:38 smithi191 bash[24992]: cluster 2024-08-31T03:02:36.738575+0000 mgr.a (mgr.14388) 2223 : cluster [DBG] pgmap v1539: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T03:02:38.659 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:02:38.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:02:38.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:02:38.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:02:38.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:02:39.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:39 smithi163 bash[24253]: audit 2024-08-31T03:02:38.255692+0000 mgr.a (mgr.14388) 2224 : audit [DBG] from='client.60264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:39 smithi027 bash[22610]: audit 2024-08-31T03:02:38.255692+0000 mgr.a (mgr.14388) 2224 : audit [DBG] from='client.60264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:39 smithi191 bash[24992]: audit 2024-08-31T03:02:38.255692+0000 mgr.a (mgr.14388) 2224 : audit [DBG] from='client.60264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:40.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:40 smithi163 bash[24253]: cluster 2024-08-31T03:02:38.740678+0000 mgr.a (mgr.14388) 2225 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T03:02:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:40 smithi027 bash[22610]: cluster 2024-08-31T03:02:38.740678+0000 mgr.a (mgr.14388) 2225 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T03:02:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:40 smithi191 bash[24992]: cluster 2024-08-31T03:02:38.740678+0000 mgr.a (mgr.14388) 2225 : cluster [DBG] pgmap v1540: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T03:02:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:42 smithi027 bash[22610]: cluster 2024-08-31T03:02:40.741491+0000 mgr.a (mgr.14388) 2226 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:02:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:42 smithi191 bash[24992]: cluster 2024-08-31T03:02:40.741491+0000 mgr.a (mgr.14388) 2226 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:02:42.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:42 smithi163 bash[24253]: cluster 2024-08-31T03:02:40.741491+0000 mgr.a (mgr.14388) 2226 : cluster [DBG] pgmap v1541: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:02:43.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:02:43.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:02:43.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:02:44.409 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:02:44.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:02:44.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:02:44.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:02:44.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:02:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:44 smithi027 bash[22610]: cluster 2024-08-31T03:02:42.742273+0000 mgr.a (mgr.14388) 2227 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:02:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:44 smithi191 bash[24992]: cluster 2024-08-31T03:02:42.742273+0000 mgr.a (mgr.14388) 2227 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:02:44.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:44 smithi163 bash[24253]: cluster 2024-08-31T03:02:42.742273+0000 mgr.a (mgr.14388) 2227 : cluster [DBG] pgmap v1542: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:02:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:45 smithi027 bash[22610]: audit 2024-08-31T03:02:43.991468+0000 mgr.a (mgr.14388) 2228 : audit [DBG] from='client.60342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:45 smithi191 bash[24992]: audit 2024-08-31T03:02:43.991468+0000 mgr.a (mgr.14388) 2228 : audit [DBG] from='client.60342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:45.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:45 smithi163 bash[24253]: audit 2024-08-31T03:02:43.991468+0000 mgr.a (mgr.14388) 2228 : audit [DBG] from='client.60342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:46 smithi027 bash[22610]: cluster 2024-08-31T03:02:44.744980+0000 mgr.a (mgr.14388) 2229 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:02:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:46 smithi191 bash[24992]: cluster 2024-08-31T03:02:44.744980+0000 mgr.a (mgr.14388) 2229 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:02:46.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:46 smithi163 bash[24253]: cluster 2024-08-31T03:02:44.744980+0000 mgr.a (mgr.14388) 2229 : cluster [DBG] pgmap v1543: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:02:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:48 smithi027 bash[22610]: cluster 2024-08-31T03:02:46.745761+0000 mgr.a (mgr.14388) 2230 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:02:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:48 smithi191 bash[24992]: cluster 2024-08-31T03:02:46.745761+0000 mgr.a (mgr.14388) 2230 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:02:48.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:48 smithi163 bash[24253]: cluster 2024-08-31T03:02:46.745761+0000 mgr.a (mgr.14388) 2230 : cluster [DBG] pgmap v1544: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:02:49.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:02:49.411 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:02:49.411 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:02:50.179 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:02:50.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:02:50.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:02:50.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:02:50.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:02:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:50 smithi027 bash[22610]: cluster 2024-08-31T03:02:48.747779+0000 mgr.a (mgr.14388) 2231 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:02:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:50 smithi191 bash[24992]: cluster 2024-08-31T03:02:48.747779+0000 mgr.a (mgr.14388) 2231 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:02:50.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:50 smithi163 bash[24253]: cluster 2024-08-31T03:02:48.747779+0000 mgr.a (mgr.14388) 2231 : cluster [DBG] pgmap v1545: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:02:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:51 smithi027 bash[22610]: audit 2024-08-31T03:02:49.745538+0000 mgr.a (mgr.14388) 2232 : audit [DBG] from='client.60420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:51 smithi191 bash[24992]: audit 2024-08-31T03:02:49.745538+0000 mgr.a (mgr.14388) 2232 : audit [DBG] from='client.60420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:51.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:51 smithi163 bash[24253]: audit 2024-08-31T03:02:49.745538+0000 mgr.a (mgr.14388) 2232 : audit [DBG] from='client.60420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:52 smithi027 bash[22610]: cluster 2024-08-31T03:02:50.748741+0000 mgr.a (mgr.14388) 2233 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:52 smithi191 bash[24992]: cluster 2024-08-31T03:02:50.748741+0000 mgr.a (mgr.14388) 2233 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:52.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:52 smithi163 bash[24253]: cluster 2024-08-31T03:02:50.748741+0000 mgr.a (mgr.14388) 2233 : cluster [DBG] pgmap v1546: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:54 smithi191 bash[24992]: cluster 2024-08-31T03:02:52.749534+0000 mgr.a (mgr.14388) 2234 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:54.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:54 smithi163 bash[24253]: cluster 2024-08-31T03:02:52.749534+0000 mgr.a (mgr.14388) 2234 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:54 smithi027 bash[22610]: cluster 2024-08-31T03:02:52.749534+0000 mgr.a (mgr.14388) 2234 : cluster [DBG] pgmap v1547: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:55.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:02:55.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:02:55.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:02:55.945 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:02:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:02:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:02:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:02:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:02:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:56 smithi191 bash[24992]: cluster 2024-08-31T03:02:54.751760+0000 mgr.a (mgr.14388) 2235 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:02:56.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:56 smithi163 bash[24253]: cluster 2024-08-31T03:02:54.751760+0000 mgr.a (mgr.14388) 2235 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:02:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:56 smithi027 bash[22610]: cluster 2024-08-31T03:02:54.751760+0000 mgr.a (mgr.14388) 2235 : cluster [DBG] pgmap v1548: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:02:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:57 smithi191 bash[24992]: audit 2024-08-31T03:02:55.517420+0000 mgr.a (mgr.14388) 2236 : audit [DBG] from='client.60498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:57.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:57 smithi163 bash[24253]: audit 2024-08-31T03:02:55.517420+0000 mgr.a (mgr.14388) 2236 : audit [DBG] from='client.60498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:57 smithi027 bash[22610]: audit 2024-08-31T03:02:55.517420+0000 mgr.a (mgr.14388) 2236 : audit [DBG] from='client.60498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:02:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:02:58 smithi191 bash[24992]: cluster 2024-08-31T03:02:56.752716+0000 mgr.a (mgr.14388) 2237 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:58.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:02:58 smithi163 bash[24253]: cluster 2024-08-31T03:02:56.752716+0000 mgr.a (mgr.14388) 2237 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:02:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:02:58 smithi027 bash[22610]: cluster 2024-08-31T03:02:56.752716+0000 mgr.a (mgr.14388) 2237 : cluster [DBG] pgmap v1549: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:00 smithi191 bash[24992]: cluster 2024-08-31T03:02:58.754958+0000 mgr.a (mgr.14388) 2238 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:00.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:00 smithi163 bash[24253]: cluster 2024-08-31T03:02:58.754958+0000 mgr.a (mgr.14388) 2238 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:00 smithi027 bash[22610]: cluster 2024-08-31T03:02:58.754958+0000 mgr.a (mgr.14388) 2238 : cluster [DBG] pgmap v1550: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:00.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:00.948 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:00.948 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:01.682 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:01.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:01.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:01.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:01.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:03:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:02 smithi191 bash[24992]: cluster 2024-08-31T03:03:00.755714+0000 mgr.a (mgr.14388) 2239 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:02 smithi191 bash[24992]: audit 2024-08-31T03:03:01.280616+0000 mgr.a (mgr.14388) 2240 : audit [DBG] from='client.60573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:02.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:02 smithi163 bash[24253]: cluster 2024-08-31T03:03:00.755714+0000 mgr.a (mgr.14388) 2239 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:02.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:02 smithi163 bash[24253]: audit 2024-08-31T03:03:01.280616+0000 mgr.a (mgr.14388) 2240 : audit [DBG] from='client.60573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:02 smithi027 bash[22610]: cluster 2024-08-31T03:03:00.755714+0000 mgr.a (mgr.14388) 2239 : cluster [DBG] pgmap v1551: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:02 smithi027 bash[22610]: audit 2024-08-31T03:03:01.280616+0000 mgr.a (mgr.14388) 2240 : audit [DBG] from='client.60573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:04 smithi191 bash[24992]: cluster 2024-08-31T03:03:02.756651+0000 mgr.a (mgr.14388) 2241 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:04.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:04 smithi163 bash[24253]: cluster 2024-08-31T03:03:02.756651+0000 mgr.a (mgr.14388) 2241 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:04 smithi027 bash[22610]: cluster 2024-08-31T03:03:02.756651+0000 mgr.a (mgr.14388) 2241 : cluster [DBG] pgmap v1552: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:06 smithi191 bash[24992]: cluster 2024-08-31T03:03:04.758917+0000 mgr.a (mgr.14388) 2242 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:06.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:06.684 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:06.684 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:06.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:06 smithi163 bash[24253]: cluster 2024-08-31T03:03:04.758917+0000 mgr.a (mgr.14388) 2242 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:06 smithi027 bash[22610]: cluster 2024-08-31T03:03:04.758917+0000 mgr.a (mgr.14388) 2242 : cluster [DBG] pgmap v1553: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:07.425 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:07.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:07.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:07.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:07.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:03:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:08 smithi191 bash[24992]: cluster 2024-08-31T03:03:06.759461+0000 mgr.a (mgr.14388) 2243 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:08 smithi191 bash[24992]: audit 2024-08-31T03:03:07.014374+0000 mgr.a (mgr.14388) 2244 : audit [DBG] from='client.60651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:08.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:08 smithi163 bash[24253]: cluster 2024-08-31T03:03:06.759461+0000 mgr.a (mgr.14388) 2243 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:08.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:08 smithi163 bash[24253]: audit 2024-08-31T03:03:07.014374+0000 mgr.a (mgr.14388) 2244 : audit [DBG] from='client.60651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:08 smithi027 bash[22610]: cluster 2024-08-31T03:03:06.759461+0000 mgr.a (mgr.14388) 2243 : cluster [DBG] pgmap v1554: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:08 smithi027 bash[22610]: audit 2024-08-31T03:03:07.014374+0000 mgr.a (mgr.14388) 2244 : audit [DBG] from='client.60651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:10 smithi191 bash[24992]: cluster 2024-08-31T03:03:08.761660+0000 mgr.a (mgr.14388) 2245 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:10.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:10 smithi163 bash[24253]: cluster 2024-08-31T03:03:08.761660+0000 mgr.a (mgr.14388) 2245 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:10 smithi027 bash[22610]: cluster 2024-08-31T03:03:08.761660+0000 mgr.a (mgr.14388) 2245 : cluster [DBG] pgmap v1555: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:12.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:12.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:12.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:12 smithi191 bash[24992]: cluster 2024-08-31T03:03:10.762448+0000 mgr.a (mgr.14388) 2246 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:12 smithi163 bash[24253]: cluster 2024-08-31T03:03:10.762448+0000 mgr.a (mgr.14388) 2246 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:12 smithi027 bash[22610]: cluster 2024-08-31T03:03:10.762448+0000 mgr.a (mgr.14388) 2246 : cluster [DBG] pgmap v1556: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:13.192 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:13.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:13.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:13.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:13.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:03:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:14 smithi191 bash[24992]: cluster 2024-08-31T03:03:12.762956+0000 mgr.a (mgr.14388) 2247 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:14 smithi191 bash[24992]: audit 2024-08-31T03:03:12.770241+0000 mgr.a (mgr.14388) 2248 : audit [DBG] from='client.60726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:14 smithi163 bash[24253]: cluster 2024-08-31T03:03:12.762956+0000 mgr.a (mgr.14388) 2247 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:14 smithi163 bash[24253]: audit 2024-08-31T03:03:12.770241+0000 mgr.a (mgr.14388) 2248 : audit [DBG] from='client.60726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:14 smithi027 bash[22610]: cluster 2024-08-31T03:03:12.762956+0000 mgr.a (mgr.14388) 2247 : cluster [DBG] pgmap v1557: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:14 smithi027 bash[22610]: audit 2024-08-31T03:03:12.770241+0000 mgr.a (mgr.14388) 2248 : audit [DBG] from='client.60726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:16.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:16 smithi163 bash[24253]: cluster 2024-08-31T03:03:14.765572+0000 mgr.a (mgr.14388) 2249 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:03:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:16 smithi027 bash[22610]: cluster 2024-08-31T03:03:14.765572+0000 mgr.a (mgr.14388) 2249 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:03:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:16 smithi191 bash[24992]: cluster 2024-08-31T03:03:14.765572+0000 mgr.a (mgr.14388) 2249 : cluster [DBG] pgmap v1558: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:03:18.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:18.194 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:18.194 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:18.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:18 smithi163 bash[24253]: cluster 2024-08-31T03:03:16.766431+0000 mgr.a (mgr.14388) 2250 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:03:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:18 smithi027 bash[22610]: cluster 2024-08-31T03:03:16.766431+0000 mgr.a (mgr.14388) 2250 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:03:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:18 smithi191 bash[24992]: cluster 2024-08-31T03:03:16.766431+0000 mgr.a (mgr.14388) 2250 : cluster [DBG] pgmap v1559: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:03:18.973 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:18.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:18.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:18.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:18.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:03:20.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:20 smithi163 bash[24253]: audit 2024-08-31T03:03:18.534704+0000 mgr.a (mgr.14388) 2251 : audit [DBG] from='client.60801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:20.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:20 smithi163 bash[24253]: cluster 2024-08-31T03:03:18.775671+0000 mgr.a (mgr.14388) 2252 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:20 smithi027 bash[22610]: audit 2024-08-31T03:03:18.534704+0000 mgr.a (mgr.14388) 2251 : audit [DBG] from='client.60801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:20 smithi027 bash[22610]: cluster 2024-08-31T03:03:18.775671+0000 mgr.a (mgr.14388) 2252 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:20 smithi191 bash[24992]: audit 2024-08-31T03:03:18.534704+0000 mgr.a (mgr.14388) 2251 : audit [DBG] from='client.60801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:20 smithi191 bash[24992]: cluster 2024-08-31T03:03:18.775671+0000 mgr.a (mgr.14388) 2252 : cluster [DBG] pgmap v1560: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:22.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:22 smithi163 bash[24253]: cluster 2024-08-31T03:03:20.776592+0000 mgr.a (mgr.14388) 2253 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:03:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:22 smithi027 bash[22610]: cluster 2024-08-31T03:03:20.776592+0000 mgr.a (mgr.14388) 2253 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:03:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:22 smithi191 bash[24992]: cluster 2024-08-31T03:03:20.776592+0000 mgr.a (mgr.14388) 2253 : cluster [DBG] pgmap v1561: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:03:23.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:23.975 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:23.975 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:24.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:24 smithi163 bash[24253]: cluster 2024-08-31T03:03:22.777366+0000 mgr.a (mgr.14388) 2254 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:03:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:24 smithi027 bash[22610]: cluster 2024-08-31T03:03:22.777366+0000 mgr.a (mgr.14388) 2254 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:03:24.756 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:24.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:24.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:24.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:24.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:03:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:24 smithi191 bash[24992]: cluster 2024-08-31T03:03:22.777366+0000 mgr.a (mgr.14388) 2254 : cluster [DBG] pgmap v1562: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:03:25.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:25 smithi163 bash[24253]: audit 2024-08-31T03:03:24.315843+0000 mgr.a (mgr.14388) 2255 : audit [DBG] from='client.60879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:25 smithi027 bash[22610]: audit 2024-08-31T03:03:24.315843+0000 mgr.a (mgr.14388) 2255 : audit [DBG] from='client.60879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:25 smithi191 bash[24992]: audit 2024-08-31T03:03:24.315843+0000 mgr.a (mgr.14388) 2255 : audit [DBG] from='client.60879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:26.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:26 smithi163 bash[24253]: cluster 2024-08-31T03:03:24.778691+0000 mgr.a (mgr.14388) 2256 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:26 smithi027 bash[22610]: cluster 2024-08-31T03:03:24.778691+0000 mgr.a (mgr.14388) 2256 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:26 smithi191 bash[24992]: cluster 2024-08-31T03:03:24.778691+0000 mgr.a (mgr.14388) 2256 : cluster [DBG] pgmap v1563: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:28.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:28 smithi163 bash[24253]: cluster 2024-08-31T03:03:26.779416+0000 mgr.a (mgr.14388) 2257 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:03:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:28 smithi027 bash[22610]: cluster 2024-08-31T03:03:26.779416+0000 mgr.a (mgr.14388) 2257 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:03:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:28 smithi191 bash[24992]: cluster 2024-08-31T03:03:26.779416+0000 mgr.a (mgr.14388) 2257 : cluster [DBG] pgmap v1564: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:03:29.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:29.759 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:29.759 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:30.499 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:03:30.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:30 smithi163 bash[24253]: cluster 2024-08-31T03:03:28.781414+0000 mgr.a (mgr.14388) 2258 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:03:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:30 smithi027 bash[22610]: cluster 2024-08-31T03:03:28.781414+0000 mgr.a (mgr.14388) 2258 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:03:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:30 smithi191 bash[24992]: cluster 2024-08-31T03:03:28.781414+0000 mgr.a (mgr.14388) 2258 : cluster [DBG] pgmap v1565: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:03:31.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:31 smithi163 bash[24253]: audit 2024-08-31T03:03:30.093718+0000 mgr.a (mgr.14388) 2259 : audit [DBG] from='client.60951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:31 smithi027 bash[22610]: audit 2024-08-31T03:03:30.093718+0000 mgr.a (mgr.14388) 2259 : audit [DBG] from='client.60951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:31 smithi191 bash[24992]: audit 2024-08-31T03:03:30.093718+0000 mgr.a (mgr.14388) 2259 : audit [DBG] from='client.60951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:32.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:32 smithi163 bash[24253]: cluster 2024-08-31T03:03:30.782344+0000 mgr.a (mgr.14388) 2260 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:32 smithi027 bash[22610]: cluster 2024-08-31T03:03:30.782344+0000 mgr.a (mgr.14388) 2260 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:32 smithi191 bash[24992]: cluster 2024-08-31T03:03:30.782344+0000 mgr.a (mgr.14388) 2260 : cluster [DBG] pgmap v1566: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:33.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:33 smithi163 bash[24253]: audit 2024-08-31T03:03:32.594330+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:03:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:33 smithi027 bash[22610]: audit 2024-08-31T03:03:32.594330+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:03:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:33 smithi191 bash[24992]: audit 2024-08-31T03:03:32.594330+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:03:34.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:03:34 smithi027 bash[22863]: debug 2024-08-31T03:03:34.139+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:03:34.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:03:34 smithi027 bash[22863]: debug 2024-08-31T03:03:34.139+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:03:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:34 smithi027 bash[22610]: cluster 2024-08-31T03:03:32.783134+0000 mgr.a (mgr.14388) 2261 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:34 smithi027 bash[22610]: audit 2024-08-31T03:03:33.406096+0000 mon.a (mon.0) 927 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:03:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:34 smithi027 bash[22610]: audit 2024-08-31T03:03:33.407961+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:03:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:34 smithi027 bash[22610]: audit 2024-08-31T03:03:33.418856+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:03:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:34 smithi027 bash[22610]: audit 2024-08-31T03:03:33.423755+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:03:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:34 smithi027 bash[22610]: audit 2024-08-31T03:03:33.425974+0000 mgr.a (mgr.14388) 2262 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:03:34.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:34 smithi163 bash[24253]: cluster 2024-08-31T03:03:32.783134+0000 mgr.a (mgr.14388) 2261 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:34.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:34 smithi163 bash[24253]: audit 2024-08-31T03:03:33.406096+0000 mon.a (mon.0) 927 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:03:34.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:34 smithi163 bash[24253]: audit 2024-08-31T03:03:33.407961+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:03:34.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:34 smithi163 bash[24253]: audit 2024-08-31T03:03:33.418856+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:03:34.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:34 smithi163 bash[24253]: audit 2024-08-31T03:03:33.423755+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:03:34.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:34 smithi163 bash[24253]: audit 2024-08-31T03:03:33.425974+0000 mgr.a (mgr.14388) 2262 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:03:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:34 smithi191 bash[24992]: cluster 2024-08-31T03:03:32.783134+0000 mgr.a (mgr.14388) 2261 : cluster [DBG] pgmap v1567: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:34 smithi191 bash[24992]: audit 2024-08-31T03:03:33.406096+0000 mon.a (mon.0) 927 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:03:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:34 smithi191 bash[24992]: audit 2024-08-31T03:03:33.407961+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:03:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:34 smithi191 bash[24992]: audit 2024-08-31T03:03:33.418856+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:03:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:34 smithi191 bash[24992]: audit 2024-08-31T03:03:33.423755+0000 mon.a (mon.0) 930 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:03:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:34 smithi191 bash[24992]: audit 2024-08-31T03:03:33.425974+0000 mgr.a (mgr.14388) 2262 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:03:35.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:35.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:35 smithi163 bash[24253]: audit 2024-08-31T03:03:34.145342+0000 mgr.a (mgr.14388) 2263 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:03:35.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:35 smithi163 bash[24253]: cephadm 2024-08-31T03:03:34.146533+0000 mgr.a (mgr.14388) 2264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:03:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:35 smithi027 bash[22610]: audit 2024-08-31T03:03:34.145342+0000 mgr.a (mgr.14388) 2263 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:03:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:35 smithi027 bash[22610]: cephadm 2024-08-31T03:03:34.146533+0000 mgr.a (mgr.14388) 2264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:03:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:35 smithi191 bash[24992]: audit 2024-08-31T03:03:34.145342+0000 mgr.a (mgr.14388) 2263 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:03:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:35 smithi191 bash[24992]: cephadm 2024-08-31T03:03:34.146533+0000 mgr.a (mgr.14388) 2264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:03:36.244 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:36.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:36.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:36.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:36.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:03:36.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:36 smithi163 bash[24253]: cluster 2024-08-31T03:03:34.785783+0000 mgr.a (mgr.14388) 2265 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:36 smithi027 bash[22610]: cluster 2024-08-31T03:03:34.785783+0000 mgr.a (mgr.14388) 2265 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:36 smithi191 bash[24992]: cluster 2024-08-31T03:03:34.785783+0000 mgr.a (mgr.14388) 2265 : cluster [DBG] pgmap v1568: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:03:37.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:37 smithi163 bash[24253]: audit 2024-08-31T03:03:35.835076+0000 mgr.a (mgr.14388) 2266 : audit [DBG] from='client.61134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:37 smithi027 bash[22610]: audit 2024-08-31T03:03:35.835076+0000 mgr.a (mgr.14388) 2266 : audit [DBG] from='client.61134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:37 smithi191 bash[24992]: audit 2024-08-31T03:03:35.835076+0000 mgr.a (mgr.14388) 2266 : audit [DBG] from='client.61134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:38.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:38 smithi163 bash[24253]: cluster 2024-08-31T03:03:36.786756+0000 mgr.a (mgr.14388) 2267 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:38 smithi027 bash[22610]: cluster 2024-08-31T03:03:36.786756+0000 mgr.a (mgr.14388) 2267 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:38 smithi191 bash[24992]: cluster 2024-08-31T03:03:36.786756+0000 mgr.a (mgr.14388) 2267 : cluster [DBG] pgmap v1569: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:40.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:40 smithi163 bash[24253]: cluster 2024-08-31T03:03:38.788966+0000 mgr.a (mgr.14388) 2268 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:40 smithi027 bash[22610]: cluster 2024-08-31T03:03:38.788966+0000 mgr.a (mgr.14388) 2268 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:40 smithi191 bash[24992]: cluster 2024-08-31T03:03:38.788966+0000 mgr.a (mgr.14388) 2268 : cluster [DBG] pgmap v1570: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:41.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:41.247 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:41.247 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:42.022 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:42.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:42.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:42.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:42.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:03:42.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:42 smithi163 bash[24253]: cluster 2024-08-31T03:03:40.789737+0000 mgr.a (mgr.14388) 2269 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:42 smithi027 bash[22610]: cluster 2024-08-31T03:03:40.789737+0000 mgr.a (mgr.14388) 2269 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:42 smithi191 bash[24992]: cluster 2024-08-31T03:03:40.789737+0000 mgr.a (mgr.14388) 2269 : cluster [DBG] pgmap v1571: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:43.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:43 smithi163 bash[24253]: audit 2024-08-31T03:03:41.582179+0000 mgr.a (mgr.14388) 2270 : audit [DBG] from='client.61209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:43 smithi027 bash[22610]: audit 2024-08-31T03:03:41.582179+0000 mgr.a (mgr.14388) 2270 : audit [DBG] from='client.61209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:43 smithi191 bash[24992]: audit 2024-08-31T03:03:41.582179+0000 mgr.a (mgr.14388) 2270 : audit [DBG] from='client.61209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:44.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:44 smithi163 bash[24253]: cluster 2024-08-31T03:03:42.790659+0000 mgr.a (mgr.14388) 2271 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:44 smithi027 bash[22610]: cluster 2024-08-31T03:03:42.790659+0000 mgr.a (mgr.14388) 2271 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:44 smithi191 bash[24992]: cluster 2024-08-31T03:03:42.790659+0000 mgr.a (mgr.14388) 2271 : cluster [DBG] pgmap v1572: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:46.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:46 smithi163 bash[24253]: cluster 2024-08-31T03:03:44.792873+0000 mgr.a (mgr.14388) 2272 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:46 smithi027 bash[22610]: cluster 2024-08-31T03:03:44.792873+0000 mgr.a (mgr.14388) 2272 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:46 smithi191 bash[24992]: cluster 2024-08-31T03:03:44.792873+0000 mgr.a (mgr.14388) 2272 : cluster [DBG] pgmap v1573: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:47.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:47.024 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:47.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:47.799 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:47.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:47.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:47.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:47.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:03:48.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:48 smithi163 bash[24253]: cluster 2024-08-31T03:03:46.793642+0000 mgr.a (mgr.14388) 2273 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:48.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:48 smithi163 bash[24253]: audit 2024-08-31T03:03:47.363001+0000 mgr.a (mgr.14388) 2274 : audit [DBG] from='client.61284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:48 smithi027 bash[22610]: cluster 2024-08-31T03:03:46.793642+0000 mgr.a (mgr.14388) 2273 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:48 smithi027 bash[22610]: audit 2024-08-31T03:03:47.363001+0000 mgr.a (mgr.14388) 2274 : audit [DBG] from='client.61284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:48 smithi191 bash[24992]: cluster 2024-08-31T03:03:46.793642+0000 mgr.a (mgr.14388) 2273 : cluster [DBG] pgmap v1574: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:48 smithi191 bash[24992]: audit 2024-08-31T03:03:47.363001+0000 mgr.a (mgr.14388) 2274 : audit [DBG] from='client.61284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:50.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:50 smithi163 bash[24253]: cluster 2024-08-31T03:03:48.795978+0000 mgr.a (mgr.14388) 2275 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:50 smithi027 bash[22610]: cluster 2024-08-31T03:03:48.795978+0000 mgr.a (mgr.14388) 2275 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:50 smithi191 bash[24992]: cluster 2024-08-31T03:03:48.795978+0000 mgr.a (mgr.14388) 2275 : cluster [DBG] pgmap v1575: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:03:52.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:52 smithi163 bash[24253]: cluster 2024-08-31T03:03:50.796756+0000 mgr.a (mgr.14388) 2276 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:52 smithi027 bash[22610]: cluster 2024-08-31T03:03:50.796756+0000 mgr.a (mgr.14388) 2276 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:52 smithi191 bash[24992]: cluster 2024-08-31T03:03:50.796756+0000 mgr.a (mgr.14388) 2276 : cluster [DBG] pgmap v1576: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:52.801 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:52.802 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:52.802 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:53.582 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:53.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:53.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:53.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:53.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:03:54.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:54 smithi163 bash[24253]: cluster 2024-08-31T03:03:52.797523+0000 mgr.a (mgr.14388) 2277 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:54.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:54 smithi163 bash[24253]: audit 2024-08-31T03:03:53.139942+0000 mgr.a (mgr.14388) 2278 : audit [DBG] from='client.61359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:54 smithi027 bash[22610]: cluster 2024-08-31T03:03:52.797523+0000 mgr.a (mgr.14388) 2277 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:54 smithi027 bash[22610]: audit 2024-08-31T03:03:53.139942+0000 mgr.a (mgr.14388) 2278 : audit [DBG] from='client.61359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:54 smithi191 bash[24992]: cluster 2024-08-31T03:03:52.797523+0000 mgr.a (mgr.14388) 2277 : cluster [DBG] pgmap v1577: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:54 smithi191 bash[24992]: audit 2024-08-31T03:03:53.139942+0000 mgr.a (mgr.14388) 2278 : audit [DBG] from='client.61359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:03:56.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:56 smithi163 bash[24253]: cluster 2024-08-31T03:03:54.800154+0000 mgr.a (mgr.14388) 2279 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:56 smithi027 bash[22610]: cluster 2024-08-31T03:03:54.800154+0000 mgr.a (mgr.14388) 2279 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:56 smithi191 bash[24992]: cluster 2024-08-31T03:03:54.800154+0000 mgr.a (mgr.14388) 2279 : cluster [DBG] pgmap v1578: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:03:58.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:03:58.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:03:58.585 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:03:58.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:03:58 smithi163 bash[24253]: cluster 2024-08-31T03:03:56.800920+0000 mgr.a (mgr.14388) 2280 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:03:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:03:58 smithi027 bash[22610]: cluster 2024-08-31T03:03:56.800920+0000 mgr.a (mgr.14388) 2280 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:03:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:03:58 smithi191 bash[24992]: cluster 2024-08-31T03:03:56.800920+0000 mgr.a (mgr.14388) 2280 : cluster [DBG] pgmap v1579: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:03:59.363 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:03:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:03:59.363 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:03:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:03:59.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:00.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:00 smithi163 bash[24253]: cluster 2024-08-31T03:03:58.802903+0000 mgr.a (mgr.14388) 2281 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:00.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:00 smithi163 bash[24253]: audit 2024-08-31T03:03:58.923546+0000 mgr.a (mgr.14388) 2282 : audit [DBG] from='client.61437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:00 smithi027 bash[22610]: cluster 2024-08-31T03:03:58.802903+0000 mgr.a (mgr.14388) 2281 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:00 smithi027 bash[22610]: audit 2024-08-31T03:03:58.923546+0000 mgr.a (mgr.14388) 2282 : audit [DBG] from='client.61437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:00 smithi191 bash[24992]: cluster 2024-08-31T03:03:58.802903+0000 mgr.a (mgr.14388) 2281 : cluster [DBG] pgmap v1580: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:00 smithi191 bash[24992]: audit 2024-08-31T03:03:58.923546+0000 mgr.a (mgr.14388) 2282 : audit [DBG] from='client.61437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:02.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:02 smithi163 bash[24253]: cluster 2024-08-31T03:04:00.803820+0000 mgr.a (mgr.14388) 2283 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:04:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:02 smithi027 bash[22610]: cluster 2024-08-31T03:04:00.803820+0000 mgr.a (mgr.14388) 2283 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:04:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:02 smithi191 bash[24992]: cluster 2024-08-31T03:04:00.803820+0000 mgr.a (mgr.14388) 2283 : cluster [DBG] pgmap v1581: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:04:04.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:04:04.365 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:04:04.365 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:04:04.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:04 smithi163 bash[24253]: cluster 2024-08-31T03:04:02.804675+0000 mgr.a (mgr.14388) 2284 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:04:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:04 smithi027 bash[22610]: cluster 2024-08-31T03:04:02.804675+0000 mgr.a (mgr.14388) 2284 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:04:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:04 smithi191 bash[24992]: cluster 2024-08-31T03:04:02.804675+0000 mgr.a (mgr.14388) 2284 : cluster [DBG] pgmap v1582: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:04:05.139 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:04:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:04:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:04:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:04:05.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:06.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:06 smithi163 bash[24253]: audit 2024-08-31T03:04:04.701645+0000 mgr.a (mgr.14388) 2285 : audit [DBG] from='client.61515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:06.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:06 smithi163 bash[24253]: cluster 2024-08-31T03:04:04.805901+0000 mgr.a (mgr.14388) 2286 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:06 smithi027 bash[22610]: audit 2024-08-31T03:04:04.701645+0000 mgr.a (mgr.14388) 2285 : audit [DBG] from='client.61515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:06 smithi027 bash[22610]: cluster 2024-08-31T03:04:04.805901+0000 mgr.a (mgr.14388) 2286 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:06 smithi191 bash[24992]: audit 2024-08-31T03:04:04.701645+0000 mgr.a (mgr.14388) 2285 : audit [DBG] from='client.61515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:06 smithi191 bash[24992]: cluster 2024-08-31T03:04:04.805901+0000 mgr.a (mgr.14388) 2286 : cluster [DBG] pgmap v1583: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:08 smithi027 bash[22610]: cluster 2024-08-31T03:04:06.806688+0000 mgr.a (mgr.14388) 2287 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:08 smithi191 bash[24992]: cluster 2024-08-31T03:04:06.806688+0000 mgr.a (mgr.14388) 2287 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:08.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:08 smithi163 bash[24253]: cluster 2024-08-31T03:04:06.806688+0000 mgr.a (mgr.14388) 2287 : cluster [DBG] pgmap v1584: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:09 smithi191 bash[24992]: cluster 2024-08-31T03:04:08.808881+0000 mgr.a (mgr.14388) 2288 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:09.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:09 smithi163 bash[24253]: cluster 2024-08-31T03:04:08.808881+0000 mgr.a (mgr.14388) 2288 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:09 smithi027 bash[22610]: cluster 2024-08-31T03:04:08.808881+0000 mgr.a (mgr.14388) 2288 : cluster [DBG] pgmap v1585: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:10.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:04:10.142 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:04:10.142 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:04:10.919 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:04:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:04:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:04:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:04:10.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:12.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:11 smithi163 bash[24253]: audit 2024-08-31T03:04:10.486117+0000 mgr.a (mgr.14388) 2289 : audit [DBG] from='client.61590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:12.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:11 smithi163 bash[24253]: cluster 2024-08-31T03:04:10.809368+0000 mgr.a (mgr.14388) 2290 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:11 smithi027 bash[22610]: audit 2024-08-31T03:04:10.486117+0000 mgr.a (mgr.14388) 2289 : audit [DBG] from='client.61590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:11 smithi027 bash[22610]: cluster 2024-08-31T03:04:10.809368+0000 mgr.a (mgr.14388) 2290 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:11 smithi191 bash[24992]: audit 2024-08-31T03:04:10.486117+0000 mgr.a (mgr.14388) 2289 : audit [DBG] from='client.61590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:11 smithi191 bash[24992]: cluster 2024-08-31T03:04:10.809368+0000 mgr.a (mgr.14388) 2290 : cluster [DBG] pgmap v1586: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:14.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:13 smithi163 bash[24253]: cluster 2024-08-31T03:04:12.810212+0000 mgr.a (mgr.14388) 2291 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:13 smithi027 bash[22610]: cluster 2024-08-31T03:04:12.810212+0000 mgr.a (mgr.14388) 2291 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:13 smithi191 bash[24992]: cluster 2024-08-31T03:04:12.810212+0000 mgr.a (mgr.14388) 2291 : cluster [DBG] pgmap v1587: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:15.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:04:15.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:04:15.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:04:16.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:15 smithi163 bash[24253]: cluster 2024-08-31T03:04:14.812426+0000 mgr.a (mgr.14388) 2292 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:15 smithi027 bash[22610]: cluster 2024-08-31T03:04:14.812426+0000 mgr.a (mgr.14388) 2292 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:15 smithi191 bash[24992]: cluster 2024-08-31T03:04:14.812426+0000 mgr.a (mgr.14388) 2292 : cluster [DBG] pgmap v1588: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:16.676 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:04:16.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:04:16.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:04:16.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:04:16.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:17.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:16 smithi163 bash[24253]: audit 2024-08-31T03:04:16.257663+0000 mgr.a (mgr.14388) 2293 : audit [DBG] from='client.61665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:16 smithi027 bash[22610]: audit 2024-08-31T03:04:16.257663+0000 mgr.a (mgr.14388) 2293 : audit [DBG] from='client.61665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:16 smithi191 bash[24992]: audit 2024-08-31T03:04:16.257663+0000 mgr.a (mgr.14388) 2293 : audit [DBG] from='client.61665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:18.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:17 smithi163 bash[24253]: cluster 2024-08-31T03:04:16.813334+0000 mgr.a (mgr.14388) 2294 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:17 smithi027 bash[22610]: cluster 2024-08-31T03:04:16.813334+0000 mgr.a (mgr.14388) 2294 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:17 smithi191 bash[24992]: cluster 2024-08-31T03:04:16.813334+0000 mgr.a (mgr.14388) 2294 : cluster [DBG] pgmap v1589: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:20.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:19 smithi163 bash[24253]: cluster 2024-08-31T03:04:18.815565+0000 mgr.a (mgr.14388) 2295 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:19 smithi027 bash[22610]: cluster 2024-08-31T03:04:18.815565+0000 mgr.a (mgr.14388) 2295 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:19 smithi191 bash[24992]: cluster 2024-08-31T03:04:18.815565+0000 mgr.a (mgr.14388) 2295 : cluster [DBG] pgmap v1590: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:21.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:04:21.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:04:21.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:04:22.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:21 smithi163 bash[24253]: cluster 2024-08-31T03:04:20.816317+0000 mgr.a (mgr.14388) 2296 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:21 smithi027 bash[22610]: cluster 2024-08-31T03:04:20.816317+0000 mgr.a (mgr.14388) 2296 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:21 smithi191 bash[24992]: cluster 2024-08-31T03:04:20.816317+0000 mgr.a (mgr.14388) 2296 : cluster [DBG] pgmap v1591: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:22.433 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:04:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:04:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:04:22.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:04:22.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:23.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:22 smithi163 bash[24253]: audit 2024-08-31T03:04:22.012562+0000 mgr.a (mgr.14388) 2297 : audit [DBG] from='client.61743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:22 smithi027 bash[22610]: audit 2024-08-31T03:04:22.012562+0000 mgr.a (mgr.14388) 2297 : audit [DBG] from='client.61743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:22 smithi191 bash[24992]: audit 2024-08-31T03:04:22.012562+0000 mgr.a (mgr.14388) 2297 : audit [DBG] from='client.61743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:24.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:23 smithi163 bash[24253]: cluster 2024-08-31T03:04:22.817220+0000 mgr.a (mgr.14388) 2298 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:23 smithi027 bash[22610]: cluster 2024-08-31T03:04:22.817220+0000 mgr.a (mgr.14388) 2298 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:23 smithi191 bash[24992]: cluster 2024-08-31T03:04:22.817220+0000 mgr.a (mgr.14388) 2298 : cluster [DBG] pgmap v1592: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:26.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:25 smithi163 bash[24253]: cluster 2024-08-31T03:04:24.819425+0000 mgr.a (mgr.14388) 2299 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:25 smithi027 bash[22610]: cluster 2024-08-31T03:04:24.819425+0000 mgr.a (mgr.14388) 2299 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:25 smithi191 bash[24992]: cluster 2024-08-31T03:04:24.819425+0000 mgr.a (mgr.14388) 2299 : cluster [DBG] pgmap v1593: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:04:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:04:27.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:04:27.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:04:28.196 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:04:28.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:04:28.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:04:28.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:04:28.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:28.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:27 smithi163 bash[24253]: cluster 2024-08-31T03:04:26.820184+0000 mgr.a (mgr.14388) 2300 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:28.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:27 smithi027 bash[22610]: cluster 2024-08-31T03:04:26.820184+0000 mgr.a (mgr.14388) 2300 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:27 smithi191 bash[24992]: cluster 2024-08-31T03:04:26.820184+0000 mgr.a (mgr.14388) 2300 : cluster [DBG] pgmap v1594: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:29.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:28 smithi163 bash[24253]: audit 2024-08-31T03:04:27.775796+0000 mgr.a (mgr.14388) 2301 : audit [DBG] from='client.61821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:28 smithi027 bash[22610]: audit 2024-08-31T03:04:27.775796+0000 mgr.a (mgr.14388) 2301 : audit [DBG] from='client.61821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:28 smithi191 bash[24992]: audit 2024-08-31T03:04:27.775796+0000 mgr.a (mgr.14388) 2301 : audit [DBG] from='client.61821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:30.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:29 smithi163 bash[24253]: cluster 2024-08-31T03:04:28.822895+0000 mgr.a (mgr.14388) 2302 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:04:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:29 smithi027 bash[22610]: cluster 2024-08-31T03:04:28.822895+0000 mgr.a (mgr.14388) 2302 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:04:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:29 smithi191 bash[24992]: cluster 2024-08-31T03:04:28.822895+0000 mgr.a (mgr.14388) 2302 : cluster [DBG] pgmap v1595: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:04:32.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:31 smithi163 bash[24253]: cluster 2024-08-31T03:04:30.823627+0000 mgr.a (mgr.14388) 2303 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:04:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:31 smithi027 bash[22610]: cluster 2024-08-31T03:04:30.823627+0000 mgr.a (mgr.14388) 2303 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:04:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:31 smithi191 bash[24992]: cluster 2024-08-31T03:04:30.823627+0000 mgr.a (mgr.14388) 2303 : cluster [DBG] pgmap v1596: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:04:33.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:04:33.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:04:33.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:04:33.973 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:04:33.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:04:33.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:04:33.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:04:33.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:34.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:33 smithi163 bash[24253]: cluster 2024-08-31T03:04:32.824388+0000 mgr.a (mgr.14388) 2304 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:04:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:33 smithi027 bash[22610]: cluster 2024-08-31T03:04:32.824388+0000 mgr.a (mgr.14388) 2304 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:04:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:33 smithi191 bash[24992]: cluster 2024-08-31T03:04:32.824388+0000 mgr.a (mgr.14388) 2304 : cluster [DBG] pgmap v1597: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:04:35.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:34 smithi163 bash[24253]: audit 2024-08-31T03:04:33.533172+0000 mgr.a (mgr.14388) 2305 : audit [DBG] from='client.61899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:35.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:34 smithi163 bash[24253]: audit 2024-08-31T03:04:34.199275+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:04:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:34 smithi027 bash[22610]: audit 2024-08-31T03:04:33.533172+0000 mgr.a (mgr.14388) 2305 : audit [DBG] from='client.61899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:34 smithi027 bash[22610]: audit 2024-08-31T03:04:34.199275+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:04:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:34 smithi191 bash[24992]: audit 2024-08-31T03:04:33.533172+0000 mgr.a (mgr.14388) 2305 : audit [DBG] from='client.61899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:34 smithi191 bash[24992]: audit 2024-08-31T03:04:34.199275+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:04:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:35 smithi027 bash[22610]: cluster 2024-08-31T03:04:34.826040+0000 mgr.a (mgr.14388) 2306 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:35 smithi191 bash[24992]: cluster 2024-08-31T03:04:34.826040+0000 mgr.a (mgr.14388) 2306 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:36.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:35 smithi163 bash[24253]: cluster 2024-08-31T03:04:34.826040+0000 mgr.a (mgr.14388) 2306 : cluster [DBG] pgmap v1598: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:37 smithi027 bash[22610]: cluster 2024-08-31T03:04:36.826817+0000 mgr.a (mgr.14388) 2307 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:04:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:37 smithi191 bash[24992]: cluster 2024-08-31T03:04:36.826817+0000 mgr.a (mgr.14388) 2307 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:04:38.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:37 smithi163 bash[24253]: cluster 2024-08-31T03:04:36.826817+0000 mgr.a (mgr.14388) 2307 : cluster [DBG] pgmap v1599: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:04:38.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:04:38.975 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:04:38.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:04:39.733 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:04:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:04:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:04:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:04:39.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:39 smithi027 bash[22610]: cluster 2024-08-31T03:04:38.828762+0000 mgr.a (mgr.14388) 2308 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:39 smithi027 bash[22610]: audit 2024-08-31T03:04:39.310209+0000 mgr.a (mgr.14388) 2309 : audit [DBG] from='client.61974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:39 smithi027 bash[22610]: audit 2024-08-31T03:04:39.557679+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:39 smithi027 bash[22610]: audit 2024-08-31T03:04:39.563066+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:39 smithi027 bash[22610]: audit 2024-08-31T03:04:39.567647+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:39 smithi027 bash[22610]: audit 2024-08-31T03:04:39.571778+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:39 smithi027 bash[22610]: audit 2024-08-31T03:04:39.574688+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:39 smithi027 bash[22610]: audit 2024-08-31T03:04:39.578197+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:39 smithi191 bash[24992]: cluster 2024-08-31T03:04:38.828762+0000 mgr.a (mgr.14388) 2308 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:39 smithi191 bash[24992]: audit 2024-08-31T03:04:39.310209+0000 mgr.a (mgr.14388) 2309 : audit [DBG] from='client.61974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:39 smithi191 bash[24992]: audit 2024-08-31T03:04:39.557679+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:39 smithi191 bash[24992]: audit 2024-08-31T03:04:39.563066+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:39 smithi191 bash[24992]: audit 2024-08-31T03:04:39.567647+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:39 smithi191 bash[24992]: audit 2024-08-31T03:04:39.571778+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:39 smithi191 bash[24992]: audit 2024-08-31T03:04:39.574688+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:39 smithi191 bash[24992]: audit 2024-08-31T03:04:39.578197+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:39 smithi163 bash[24253]: cluster 2024-08-31T03:04:38.828762+0000 mgr.a (mgr.14388) 2308 : cluster [DBG] pgmap v1600: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:40.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:39 smithi163 bash[24253]: audit 2024-08-31T03:04:39.310209+0000 mgr.a (mgr.14388) 2309 : audit [DBG] from='client.61974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:40.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:39 smithi163 bash[24253]: audit 2024-08-31T03:04:39.557679+0000 mon.a (mon.0) 932 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:39 smithi163 bash[24253]: audit 2024-08-31T03:04:39.563066+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:39 smithi163 bash[24253]: audit 2024-08-31T03:04:39.567647+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:39 smithi163 bash[24253]: audit 2024-08-31T03:04:39.571778+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:39 smithi163 bash[24253]: audit 2024-08-31T03:04:39.574688+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:40.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:40 smithi163 bash[24253]: audit 2024-08-31T03:04:39.578197+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:41.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:04:41 smithi027 bash[22863]: debug 2024-08-31T03:04:41.029+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:04:41.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:04:41 smithi027 bash[22863]: debug 2024-08-31T03:04:41.029+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:04:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:40 smithi027 bash[22610]: audit 2024-08-31T03:04:40.313106+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:04:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:40 smithi027 bash[22610]: audit 2024-08-31T03:04:40.314394+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:04:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:40 smithi027 bash[22610]: audit 2024-08-31T03:04:40.322220+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:40 smithi027 bash[22610]: audit 2024-08-31T03:04:40.324569+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:04:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:40 smithi027 bash[22610]: audit 2024-08-31T03:04:40.325627+0000 mgr.a (mgr.14388) 2310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:04:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:40 smithi191 bash[24992]: audit 2024-08-31T03:04:40.313106+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:04:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:40 smithi191 bash[24992]: audit 2024-08-31T03:04:40.314394+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:04:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:40 smithi191 bash[24992]: audit 2024-08-31T03:04:40.322220+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:40 smithi191 bash[24992]: audit 2024-08-31T03:04:40.324569+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:04:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:40 smithi191 bash[24992]: audit 2024-08-31T03:04:40.325627+0000 mgr.a (mgr.14388) 2310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:04:41.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:40 smithi163 bash[24253]: audit 2024-08-31T03:04:40.313106+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:04:41.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:40 smithi163 bash[24253]: audit 2024-08-31T03:04:40.314394+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:04:41.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:40 smithi163 bash[24253]: audit 2024-08-31T03:04:40.322220+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:04:41.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:40 smithi163 bash[24253]: audit 2024-08-31T03:04:40.324569+0000 mon.a (mon.0) 941 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:04:41.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:40 smithi163 bash[24253]: audit 2024-08-31T03:04:40.325627+0000 mgr.a (mgr.14388) 2310 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:04:42.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:42 smithi163 bash[24253]: cluster 2024-08-31T03:04:40.829475+0000 mgr.a (mgr.14388) 2311 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:04:42.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:42 smithi163 bash[24253]: audit 2024-08-31T03:04:41.032264+0000 mgr.a (mgr.14388) 2312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:04:42.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:42 smithi163 bash[24253]: cephadm 2024-08-31T03:04:41.033661+0000 mgr.a (mgr.14388) 2313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:04:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:42 smithi027 bash[22610]: cluster 2024-08-31T03:04:40.829475+0000 mgr.a (mgr.14388) 2311 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:04:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:42 smithi027 bash[22610]: audit 2024-08-31T03:04:41.032264+0000 mgr.a (mgr.14388) 2312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:04:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:42 smithi027 bash[22610]: cephadm 2024-08-31T03:04:41.033661+0000 mgr.a (mgr.14388) 2313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:04:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:42 smithi191 bash[24992]: cluster 2024-08-31T03:04:40.829475+0000 mgr.a (mgr.14388) 2311 : cluster [DBG] pgmap v1601: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:04:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:42 smithi191 bash[24992]: audit 2024-08-31T03:04:41.032264+0000 mgr.a (mgr.14388) 2312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:04:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:42 smithi191 bash[24992]: cephadm 2024-08-31T03:04:41.033661+0000 mgr.a (mgr.14388) 2313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:04:44.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:44 smithi163 bash[24253]: cluster 2024-08-31T03:04:42.830232+0000 mgr.a (mgr.14388) 2314 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:04:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:44 smithi027 bash[22610]: cluster 2024-08-31T03:04:42.830232+0000 mgr.a (mgr.14388) 2314 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:04:44.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:04:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:04:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:04:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:44 smithi191 bash[24992]: cluster 2024-08-31T03:04:42.830232+0000 mgr.a (mgr.14388) 2314 : cluster [DBG] pgmap v1602: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:04:45.514 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:04:45.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:04:45.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:04:45.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:04:45.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:46.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:46 smithi163 bash[24253]: cluster 2024-08-31T03:04:44.832222+0000 mgr.a (mgr.14388) 2315 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:46.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:46 smithi163 bash[24253]: audit 2024-08-31T03:04:45.074871+0000 mgr.a (mgr.14388) 2316 : audit [DBG] from='client.62154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:46 smithi027 bash[22610]: cluster 2024-08-31T03:04:44.832222+0000 mgr.a (mgr.14388) 2315 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:46 smithi027 bash[22610]: audit 2024-08-31T03:04:45.074871+0000 mgr.a (mgr.14388) 2316 : audit [DBG] from='client.62154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:46 smithi191 bash[24992]: cluster 2024-08-31T03:04:44.832222+0000 mgr.a (mgr.14388) 2315 : cluster [DBG] pgmap v1603: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:46 smithi191 bash[24992]: audit 2024-08-31T03:04:45.074871+0000 mgr.a (mgr.14388) 2316 : audit [DBG] from='client.62154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:48.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:48 smithi163 bash[24253]: cluster 2024-08-31T03:04:46.833116+0000 mgr.a (mgr.14388) 2317 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:48 smithi027 bash[22610]: cluster 2024-08-31T03:04:46.833116+0000 mgr.a (mgr.14388) 2317 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:48 smithi191 bash[24992]: cluster 2024-08-31T03:04:46.833116+0000 mgr.a (mgr.14388) 2317 : cluster [DBG] pgmap v1604: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:50.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:04:50.517 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:04:50.517 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:04:50.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:50 smithi163 bash[24253]: cluster 2024-08-31T03:04:48.835344+0000 mgr.a (mgr.14388) 2318 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:50 smithi027 bash[22610]: cluster 2024-08-31T03:04:48.835344+0000 mgr.a (mgr.14388) 2318 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:50 smithi191 bash[24992]: cluster 2024-08-31T03:04:48.835344+0000 mgr.a (mgr.14388) 2318 : cluster [DBG] pgmap v1605: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:51.260 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:04:51.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:04:51.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:04:51.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:04:51.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:52.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:52 smithi163 bash[24253]: cluster 2024-08-31T03:04:50.836067+0000 mgr.a (mgr.14388) 2319 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:52.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:52 smithi163 bash[24253]: audit 2024-08-31T03:04:50.846931+0000 mgr.a (mgr.14388) 2320 : audit [DBG] from='client.62229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:52 smithi027 bash[22610]: cluster 2024-08-31T03:04:50.836067+0000 mgr.a (mgr.14388) 2319 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:52 smithi027 bash[22610]: audit 2024-08-31T03:04:50.846931+0000 mgr.a (mgr.14388) 2320 : audit [DBG] from='client.62229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:52 smithi191 bash[24992]: cluster 2024-08-31T03:04:50.836067+0000 mgr.a (mgr.14388) 2319 : cluster [DBG] pgmap v1606: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:52 smithi191 bash[24992]: audit 2024-08-31T03:04:50.846931+0000 mgr.a (mgr.14388) 2320 : audit [DBG] from='client.62229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:54.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:54 smithi163 bash[24253]: cluster 2024-08-31T03:04:52.837074+0000 mgr.a (mgr.14388) 2321 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:54 smithi027 bash[22610]: cluster 2024-08-31T03:04:52.837074+0000 mgr.a (mgr.14388) 2321 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:54 smithi191 bash[24992]: cluster 2024-08-31T03:04:52.837074+0000 mgr.a (mgr.14388) 2321 : cluster [DBG] pgmap v1607: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:56.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:04:56.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:04:56.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:04:56.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:56 smithi163 bash[24253]: cluster 2024-08-31T03:04:54.839369+0000 mgr.a (mgr.14388) 2322 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:56 smithi027 bash[22610]: cluster 2024-08-31T03:04:54.839369+0000 mgr.a (mgr.14388) 2322 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:56 smithi191 bash[24992]: cluster 2024-08-31T03:04:54.839369+0000 mgr.a (mgr.14388) 2322 : cluster [DBG] pgmap v1608: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:04:57.011 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:04:57.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:04:57.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:04:57.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:04:57.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:04:58.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:58 smithi163 bash[24253]: audit 2024-08-31T03:04:56.593319+0000 mgr.a (mgr.14388) 2323 : audit [DBG] from='client.62307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:58.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:04:58 smithi163 bash[24253]: cluster 2024-08-31T03:04:56.839894+0000 mgr.a (mgr.14388) 2324 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:58 smithi027 bash[22610]: audit 2024-08-31T03:04:56.593319+0000 mgr.a (mgr.14388) 2323 : audit [DBG] from='client.62307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:04:58 smithi027 bash[22610]: cluster 2024-08-31T03:04:56.839894+0000 mgr.a (mgr.14388) 2324 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:04:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:58 smithi191 bash[24992]: audit 2024-08-31T03:04:56.593319+0000 mgr.a (mgr.14388) 2323 : audit [DBG] from='client.62307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:04:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:04:58 smithi191 bash[24992]: cluster 2024-08-31T03:04:56.839894+0000 mgr.a (mgr.14388) 2324 : cluster [DBG] pgmap v1609: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:00.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:00 smithi163 bash[24253]: cluster 2024-08-31T03:04:58.842128+0000 mgr.a (mgr.14388) 2325 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:00 smithi027 bash[22610]: cluster 2024-08-31T03:04:58.842128+0000 mgr.a (mgr.14388) 2325 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:00 smithi191 bash[24992]: cluster 2024-08-31T03:04:58.842128+0000 mgr.a (mgr.14388) 2325 : cluster [DBG] pgmap v1610: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:02.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:02.014 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:02.014 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:05:02.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:02 smithi163 bash[24253]: cluster 2024-08-31T03:05:00.842921+0000 mgr.a (mgr.14388) 2326 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:02 smithi027 bash[22610]: cluster 2024-08-31T03:05:00.842921+0000 mgr.a (mgr.14388) 2326 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:05:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:05:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:05:02.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:05:02.751 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:05:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:02 smithi191 bash[24992]: cluster 2024-08-31T03:05:00.842921+0000 mgr.a (mgr.14388) 2326 : cluster [DBG] pgmap v1611: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:03.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:03 smithi163 bash[24253]: audit 2024-08-31T03:05:02.345052+0000 mgr.a (mgr.14388) 2327 : audit [DBG] from='client.62385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:03 smithi027 bash[22610]: audit 2024-08-31T03:05:02.345052+0000 mgr.a (mgr.14388) 2327 : audit [DBG] from='client.62385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:03 smithi191 bash[24992]: audit 2024-08-31T03:05:02.345052+0000 mgr.a (mgr.14388) 2327 : audit [DBG] from='client.62385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:04.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:04 smithi163 bash[24253]: cluster 2024-08-31T03:05:02.843811+0000 mgr.a (mgr.14388) 2328 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:04 smithi027 bash[22610]: cluster 2024-08-31T03:05:02.843811+0000 mgr.a (mgr.14388) 2328 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:04 smithi191 bash[24992]: cluster 2024-08-31T03:05:02.843811+0000 mgr.a (mgr.14388) 2328 : cluster [DBG] pgmap v1612: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:06.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:06 smithi163 bash[24253]: cluster 2024-08-31T03:05:04.846034+0000 mgr.a (mgr.14388) 2329 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:06 smithi027 bash[22610]: cluster 2024-08-31T03:05:04.846034+0000 mgr.a (mgr.14388) 2329 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:06 smithi191 bash[24992]: cluster 2024-08-31T03:05:04.846034+0000 mgr.a (mgr.14388) 2329 : cluster [DBG] pgmap v1613: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:05:08.486 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:05:08.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:05:08.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:05:08.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:05:08.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:05:08.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:08 smithi163 bash[24253]: cluster 2024-08-31T03:05:06.846902+0000 mgr.a (mgr.14388) 2330 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:08 smithi027 bash[22610]: cluster 2024-08-31T03:05:06.846902+0000 mgr.a (mgr.14388) 2330 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:08 smithi191 bash[24992]: cluster 2024-08-31T03:05:06.846902+0000 mgr.a (mgr.14388) 2330 : cluster [DBG] pgmap v1614: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:09.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:09 smithi163 bash[24253]: audit 2024-08-31T03:05:08.087305+0000 mgr.a (mgr.14388) 2331 : audit [DBG] from='client.62460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:09 smithi027 bash[22610]: audit 2024-08-31T03:05:08.087305+0000 mgr.a (mgr.14388) 2331 : audit [DBG] from='client.62460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:09 smithi191 bash[24992]: audit 2024-08-31T03:05:08.087305+0000 mgr.a (mgr.14388) 2331 : audit [DBG] from='client.62460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:10.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:10 smithi163 bash[24253]: cluster 2024-08-31T03:05:08.849398+0000 mgr.a (mgr.14388) 2332 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:10 smithi027 bash[22610]: cluster 2024-08-31T03:05:08.849398+0000 mgr.a (mgr.14388) 2332 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:10 smithi191 bash[24992]: cluster 2024-08-31T03:05:08.849398+0000 mgr.a (mgr.14388) 2332 : cluster [DBG] pgmap v1615: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:12 smithi163 bash[24253]: cluster 2024-08-31T03:05:10.850149+0000 mgr.a (mgr.14388) 2333 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:05:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:12 smithi027 bash[22610]: cluster 2024-08-31T03:05:10.850149+0000 mgr.a (mgr.14388) 2333 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:05:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:12 smithi191 bash[24992]: cluster 2024-08-31T03:05:10.850149+0000 mgr.a (mgr.14388) 2333 : cluster [DBG] pgmap v1616: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:05:13.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:13.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:05:14.230 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:05:14.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:05:14.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:05:14.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:05:14.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:05:14.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:14 smithi163 bash[24253]: cluster 2024-08-31T03:05:12.850912+0000 mgr.a (mgr.14388) 2334 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:05:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:14 smithi027 bash[22610]: cluster 2024-08-31T03:05:12.850912+0000 mgr.a (mgr.14388) 2334 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:05:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:14 smithi191 bash[24992]: cluster 2024-08-31T03:05:12.850912+0000 mgr.a (mgr.14388) 2334 : cluster [DBG] pgmap v1617: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:05:15.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:15 smithi163 bash[24253]: audit 2024-08-31T03:05:13.816875+0000 mgr.a (mgr.14388) 2335 : audit [DBG] from='client.62538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:15 smithi027 bash[22610]: audit 2024-08-31T03:05:13.816875+0000 mgr.a (mgr.14388) 2335 : audit [DBG] from='client.62538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:15 smithi191 bash[24992]: audit 2024-08-31T03:05:13.816875+0000 mgr.a (mgr.14388) 2335 : audit [DBG] from='client.62538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:16.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:16 smithi163 bash[24253]: cluster 2024-08-31T03:05:14.853569+0000 mgr.a (mgr.14388) 2336 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:16 smithi027 bash[22610]: cluster 2024-08-31T03:05:14.853569+0000 mgr.a (mgr.14388) 2336 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:16 smithi191 bash[24992]: cluster 2024-08-31T03:05:14.853569+0000 mgr.a (mgr.14388) 2336 : cluster [DBG] pgmap v1618: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:18.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:18 smithi163 bash[24253]: cluster 2024-08-31T03:05:16.854346+0000 mgr.a (mgr.14388) 2337 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:05:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:18 smithi027 bash[22610]: cluster 2024-08-31T03:05:16.854346+0000 mgr.a (mgr.14388) 2337 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:05:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:18 smithi191 bash[24992]: cluster 2024-08-31T03:05:16.854346+0000 mgr.a (mgr.14388) 2337 : cluster [DBG] pgmap v1619: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:05:19.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:19.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:19.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:05:20.015 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:05:20.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:05:20.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:05:20.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:05:20.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:05:20.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:20 smithi163 bash[24253]: cluster 2024-08-31T03:05:18.856354+0000 mgr.a (mgr.14388) 2338 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:20 smithi027 bash[22610]: cluster 2024-08-31T03:05:18.856354+0000 mgr.a (mgr.14388) 2338 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:20 smithi191 bash[24992]: cluster 2024-08-31T03:05:18.856354+0000 mgr.a (mgr.14388) 2338 : cluster [DBG] pgmap v1620: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:21.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:21 smithi163 bash[24253]: audit 2024-08-31T03:05:19.572681+0000 mgr.a (mgr.14388) 2339 : audit [DBG] from='client.62616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:21 smithi027 bash[22610]: audit 2024-08-31T03:05:19.572681+0000 mgr.a (mgr.14388) 2339 : audit [DBG] from='client.62616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:21 smithi191 bash[24992]: audit 2024-08-31T03:05:19.572681+0000 mgr.a (mgr.14388) 2339 : audit [DBG] from='client.62616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:22.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:22 smithi163 bash[24253]: cluster 2024-08-31T03:05:20.857192+0000 mgr.a (mgr.14388) 2340 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:22 smithi027 bash[22610]: cluster 2024-08-31T03:05:20.857192+0000 mgr.a (mgr.14388) 2340 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:22 smithi191 bash[24992]: cluster 2024-08-31T03:05:20.857192+0000 mgr.a (mgr.14388) 2340 : cluster [DBG] pgmap v1621: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:24.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:24 smithi163 bash[24253]: cluster 2024-08-31T03:05:22.857976+0000 mgr.a (mgr.14388) 2341 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:24 smithi027 bash[22610]: cluster 2024-08-31T03:05:22.857976+0000 mgr.a (mgr.14388) 2341 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:24 smithi191 bash[24992]: cluster 2024-08-31T03:05:22.857976+0000 mgr.a (mgr.14388) 2341 : cluster [DBG] pgmap v1622: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:25.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:25.018 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:25.018 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:05:25.764 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:05:25.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:05:25.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:05:25.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:05:25.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:05:26.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:26 smithi163 bash[24253]: cluster 2024-08-31T03:05:24.860179+0000 mgr.a (mgr.14388) 2342 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:26.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:26 smithi163 bash[24253]: audit 2024-08-31T03:05:25.351294+0000 mgr.a (mgr.14388) 2343 : audit [DBG] from='client.62694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:26 smithi027 bash[22610]: cluster 2024-08-31T03:05:24.860179+0000 mgr.a (mgr.14388) 2342 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:26 smithi027 bash[22610]: audit 2024-08-31T03:05:25.351294+0000 mgr.a (mgr.14388) 2343 : audit [DBG] from='client.62694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:26 smithi191 bash[24992]: cluster 2024-08-31T03:05:24.860179+0000 mgr.a (mgr.14388) 2342 : cluster [DBG] pgmap v1623: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:26 smithi191 bash[24992]: audit 2024-08-31T03:05:25.351294+0000 mgr.a (mgr.14388) 2343 : audit [DBG] from='client.62694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:28 smithi027 bash[22610]: cluster 2024-08-31T03:05:26.861044+0000 mgr.a (mgr.14388) 2344 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:28 smithi191 bash[24992]: cluster 2024-08-31T03:05:26.861044+0000 mgr.a (mgr.14388) 2344 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:28 smithi163 bash[24253]: cluster 2024-08-31T03:05:26.861044+0000 mgr.a (mgr.14388) 2344 : cluster [DBG] pgmap v1624: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:30 smithi027 bash[22610]: cluster 2024-08-31T03:05:28.863283+0000 mgr.a (mgr.14388) 2345 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:30.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:30.765 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:30.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:05:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:30 smithi191 bash[24992]: cluster 2024-08-31T03:05:28.863283+0000 mgr.a (mgr.14388) 2345 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:30.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:30 smithi163 bash[24253]: cluster 2024-08-31T03:05:28.863283+0000 mgr.a (mgr.14388) 2345 : cluster [DBG] pgmap v1625: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:31.511 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:05:31.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:05:31.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:05:31.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:05:31.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:05:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:32 smithi027 bash[22610]: cluster 2024-08-31T03:05:30.863690+0000 mgr.a (mgr.14388) 2346 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:32 smithi027 bash[22610]: audit 2024-08-31T03:05:31.100871+0000 mgr.a (mgr.14388) 2347 : audit [DBG] from='client.62772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:32 smithi191 bash[24992]: cluster 2024-08-31T03:05:30.863690+0000 mgr.a (mgr.14388) 2346 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:32 smithi191 bash[24992]: audit 2024-08-31T03:05:31.100871+0000 mgr.a (mgr.14388) 2347 : audit [DBG] from='client.62772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:32 smithi163 bash[24253]: cluster 2024-08-31T03:05:30.863690+0000 mgr.a (mgr.14388) 2346 : cluster [DBG] pgmap v1626: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:32.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:32 smithi163 bash[24253]: audit 2024-08-31T03:05:31.100871+0000 mgr.a (mgr.14388) 2347 : audit [DBG] from='client.62772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:34 smithi027 bash[22610]: cluster 2024-08-31T03:05:32.864490+0000 mgr.a (mgr.14388) 2348 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:34 smithi191 bash[24992]: cluster 2024-08-31T03:05:32.864490+0000 mgr.a (mgr.14388) 2348 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:34 smithi163 bash[24253]: cluster 2024-08-31T03:05:32.864490+0000 mgr.a (mgr.14388) 2348 : cluster [DBG] pgmap v1627: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:35 smithi191 bash[24992]: cluster 2024-08-31T03:05:34.866697+0000 mgr.a (mgr.14388) 2349 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:35.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:35 smithi163 bash[24253]: cluster 2024-08-31T03:05:34.866697+0000 mgr.a (mgr.14388) 2349 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:35 smithi027 bash[22610]: cluster 2024-08-31T03:05:34.866697+0000 mgr.a (mgr.14388) 2349 : cluster [DBG] pgmap v1628: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:36.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:36.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:36.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:05:37.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:05:37.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:05:37.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:05:37.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:05:37.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:05:38.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:37 smithi163 bash[24253]: audit 2024-08-31T03:05:36.855501+0000 mgr.a (mgr.14388) 2350 : audit [DBG] from='client.62850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:38.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:37 smithi163 bash[24253]: cluster 2024-08-31T03:05:36.868693+0000 mgr.a (mgr.14388) 2351 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:37 smithi027 bash[22610]: audit 2024-08-31T03:05:36.855501+0000 mgr.a (mgr.14388) 2350 : audit [DBG] from='client.62850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:37 smithi027 bash[22610]: cluster 2024-08-31T03:05:36.868693+0000 mgr.a (mgr.14388) 2351 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:37 smithi191 bash[24992]: audit 2024-08-31T03:05:36.855501+0000 mgr.a (mgr.14388) 2350 : audit [DBG] from='client.62850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:37 smithi191 bash[24992]: cluster 2024-08-31T03:05:36.868693+0000 mgr.a (mgr.14388) 2351 : cluster [DBG] pgmap v1629: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:40.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:39 smithi163 bash[24253]: cluster 2024-08-31T03:05:38.871198+0000 mgr.a (mgr.14388) 2352 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:39 smithi027 bash[22610]: cluster 2024-08-31T03:05:38.871198+0000 mgr.a (mgr.14388) 2352 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:39 smithi191 bash[24992]: cluster 2024-08-31T03:05:38.871198+0000 mgr.a (mgr.14388) 2352 : cluster [DBG] pgmap v1630: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:05:42.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:41 smithi163 bash[24253]: cluster 2024-08-31T03:05:40.871955+0000 mgr.a (mgr.14388) 2353 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:42.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:41 smithi163 bash[24253]: audit 2024-08-31T03:05:41.087120+0000 mon.a (mon.0) 942 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:05:42.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:41 smithi163 bash[24253]: audit 2024-08-31T03:05:41.918831+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:05:42.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:41 smithi163 bash[24253]: audit 2024-08-31T03:05:41.920424+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:05:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:41 smithi027 bash[22610]: cluster 2024-08-31T03:05:40.871955+0000 mgr.a (mgr.14388) 2353 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:41 smithi027 bash[22610]: audit 2024-08-31T03:05:41.087120+0000 mon.a (mon.0) 942 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:05:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:41 smithi027 bash[22610]: audit 2024-08-31T03:05:41.918831+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:05:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:41 smithi027 bash[22610]: audit 2024-08-31T03:05:41.920424+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:05:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:41 smithi191 bash[24992]: cluster 2024-08-31T03:05:40.871955+0000 mgr.a (mgr.14388) 2353 : cluster [DBG] pgmap v1631: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:05:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:41 smithi191 bash[24992]: audit 2024-08-31T03:05:41.087120+0000 mon.a (mon.0) 942 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:05:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:41 smithi191 bash[24992]: audit 2024-08-31T03:05:41.918831+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:05:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:41 smithi191 bash[24992]: audit 2024-08-31T03:05:41.920424+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:05:42.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:42.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:42.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:05:42.942 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:05:42 smithi027 bash[22863]: debug 2024-08-31T03:05:42.656+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:05:42.942 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:05:42 smithi027 bash[22863]: debug 2024-08-31T03:05:42.668+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:05:43.048 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:05:43.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:05:43.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:05:43.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:05:43.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:05:43.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:42 smithi163 bash[24253]: audit 2024-08-31T03:05:41.931978+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:05:43.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:42 smithi163 bash[24253]: audit 2024-08-31T03:05:41.940388+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:05:43.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:42 smithi163 bash[24253]: audit 2024-08-31T03:05:41.941533+0000 mgr.a (mgr.14388) 2354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:05:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:42 smithi027 bash[22610]: audit 2024-08-31T03:05:41.931978+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:05:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:42 smithi027 bash[22610]: audit 2024-08-31T03:05:41.940388+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:05:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:42 smithi027 bash[22610]: audit 2024-08-31T03:05:41.941533+0000 mgr.a (mgr.14388) 2354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:05:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:42 smithi191 bash[24992]: audit 2024-08-31T03:05:41.931978+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:05:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:42 smithi191 bash[24992]: audit 2024-08-31T03:05:41.940388+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:05:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:42 smithi191 bash[24992]: audit 2024-08-31T03:05:41.941533+0000 mgr.a (mgr.14388) 2354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:05:44.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:43 smithi163 bash[24253]: audit 2024-08-31T03:05:42.626869+0000 mgr.a (mgr.14388) 2355 : audit [DBG] from='client.63000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:44.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:43 smithi163 bash[24253]: audit 2024-08-31T03:05:42.661693+0000 mgr.a (mgr.14388) 2356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:05:44.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:43 smithi163 bash[24253]: cephadm 2024-08-31T03:05:42.672787+0000 mgr.a (mgr.14388) 2357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:05:44.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:43 smithi163 bash[24253]: cluster 2024-08-31T03:05:42.872724+0000 mgr.a (mgr.14388) 2358 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T03:05:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:43 smithi027 bash[22610]: audit 2024-08-31T03:05:42.626869+0000 mgr.a (mgr.14388) 2355 : audit [DBG] from='client.63000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:43 smithi027 bash[22610]: audit 2024-08-31T03:05:42.661693+0000 mgr.a (mgr.14388) 2356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:05:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:43 smithi027 bash[22610]: cephadm 2024-08-31T03:05:42.672787+0000 mgr.a (mgr.14388) 2357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:05:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:43 smithi027 bash[22610]: cluster 2024-08-31T03:05:42.872724+0000 mgr.a (mgr.14388) 2358 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T03:05:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:43 smithi191 bash[24992]: audit 2024-08-31T03:05:42.626869+0000 mgr.a (mgr.14388) 2355 : audit [DBG] from='client.63000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:43 smithi191 bash[24992]: audit 2024-08-31T03:05:42.661693+0000 mgr.a (mgr.14388) 2356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:05:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:43 smithi191 bash[24992]: cephadm 2024-08-31T03:05:42.672787+0000 mgr.a (mgr.14388) 2357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:05:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:43 smithi191 bash[24992]: cluster 2024-08-31T03:05:42.872724+0000 mgr.a (mgr.14388) 2358 : cluster [DBG] pgmap v1632: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T03:05:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:45 smithi027 bash[22610]: cluster 2024-08-31T03:05:44.874643+0000 mgr.a (mgr.14388) 2359 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:05:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:45 smithi191 bash[24992]: cluster 2024-08-31T03:05:44.874643+0000 mgr.a (mgr.14388) 2359 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:05:46.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:45 smithi163 bash[24253]: cluster 2024-08-31T03:05:44.874643+0000 mgr.a (mgr.14388) 2359 : cluster [DBG] pgmap v1633: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:05:48.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:48.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:48.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:05:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:47 smithi027 bash[22610]: cluster 2024-08-31T03:05:46.875590+0000 mgr.a (mgr.14388) 2360 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:05:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:47 smithi191 bash[24992]: cluster 2024-08-31T03:05:46.875590+0000 mgr.a (mgr.14388) 2360 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:05:48.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:47 smithi163 bash[24253]: cluster 2024-08-31T03:05:46.875590+0000 mgr.a (mgr.14388) 2360 : cluster [DBG] pgmap v1634: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:05:48.787 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:05:48.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:05:48.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:05:48.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:05:48.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:05:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:48 smithi027 bash[22610]: audit 2024-08-31T03:05:48.383628+0000 mgr.a (mgr.14388) 2361 : audit [DBG] from='client.63114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:49.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:48 smithi191 bash[24992]: audit 2024-08-31T03:05:48.383628+0000 mgr.a (mgr.14388) 2361 : audit [DBG] from='client.63114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:49.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:48 smithi163 bash[24253]: audit 2024-08-31T03:05:48.383628+0000 mgr.a (mgr.14388) 2361 : audit [DBG] from='client.63114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:49 smithi027 bash[22610]: cluster 2024-08-31T03:05:48.878335+0000 mgr.a (mgr.14388) 2362 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:05:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:49 smithi191 bash[24992]: cluster 2024-08-31T03:05:48.878335+0000 mgr.a (mgr.14388) 2362 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:05:50.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:49 smithi163 bash[24253]: cluster 2024-08-31T03:05:48.878335+0000 mgr.a (mgr.14388) 2362 : cluster [DBG] pgmap v1635: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:05:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:51 smithi027 bash[22610]: cluster 2024-08-31T03:05:50.879169+0000 mgr.a (mgr.14388) 2363 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:05:52.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:51 smithi191 bash[24992]: cluster 2024-08-31T03:05:50.879169+0000 mgr.a (mgr.14388) 2363 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:05:52.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:51 smithi163 bash[24253]: cluster 2024-08-31T03:05:50.879169+0000 mgr.a (mgr.14388) 2363 : cluster [DBG] pgmap v1636: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:05:53.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:53.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:53.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:05:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:53 smithi027 bash[22610]: cluster 2024-08-31T03:05:52.880676+0000 mgr.a (mgr.14388) 2364 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:05:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:53 smithi191 bash[24992]: cluster 2024-08-31T03:05:52.880676+0000 mgr.a (mgr.14388) 2364 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:05:54.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:53 smithi163 bash[24253]: cluster 2024-08-31T03:05:52.880676+0000 mgr.a (mgr.14388) 2364 : cluster [DBG] pgmap v1637: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:05:54.556 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:05:54.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:05:54.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:05:54.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:05:54.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:05:55.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:54 smithi191 bash[24992]: audit 2024-08-31T03:05:54.129627+0000 mgr.a (mgr.14388) 2365 : audit [DBG] from='client.63192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:55.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:54 smithi163 bash[24253]: audit 2024-08-31T03:05:54.129627+0000 mgr.a (mgr.14388) 2365 : audit [DBG] from='client.63192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:54 smithi027 bash[22610]: audit 2024-08-31T03:05:54.129627+0000 mgr.a (mgr.14388) 2365 : audit [DBG] from='client.63192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:05:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:55 smithi191 bash[24992]: cluster 2024-08-31T03:05:54.883101+0000 mgr.a (mgr.14388) 2366 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:05:56.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:55 smithi163 bash[24253]: cluster 2024-08-31T03:05:54.883101+0000 mgr.a (mgr.14388) 2366 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:05:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:55 smithi027 bash[22610]: cluster 2024-08-31T03:05:54.883101+0000 mgr.a (mgr.14388) 2366 : cluster [DBG] pgmap v1638: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:05:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:57 smithi191 bash[24992]: cluster 2024-08-31T03:05:56.883896+0000 mgr.a (mgr.14388) 2367 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:05:58.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:57 smithi163 bash[24253]: cluster 2024-08-31T03:05:56.883896+0000 mgr.a (mgr.14388) 2367 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:05:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:57 smithi027 bash[22610]: cluster 2024-08-31T03:05:56.883896+0000 mgr.a (mgr.14388) 2367 : cluster [DBG] pgmap v1639: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:05:59.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:05:59.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:05:59.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:05:59 smithi191 bash[24992]: cluster 2024-08-31T03:05:58.885870+0000 mgr.a (mgr.14388) 2368 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:00.337 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:00.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:00.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:00.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:00.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:00.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:05:59 smithi163 bash[24253]: cluster 2024-08-31T03:05:58.885870+0000 mgr.a (mgr.14388) 2368 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:05:59 smithi027 bash[22610]: cluster 2024-08-31T03:05:58.885870+0000 mgr.a (mgr.14388) 2368 : cluster [DBG] pgmap v1640: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:01 smithi191 bash[24992]: audit 2024-08-31T03:05:59.897049+0000 mgr.a (mgr.14388) 2369 : audit [DBG] from='client.63270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:01.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:01 smithi163 bash[24253]: audit 2024-08-31T03:05:59.897049+0000 mgr.a (mgr.14388) 2369 : audit [DBG] from='client.63270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:01 smithi027 bash[22610]: audit 2024-08-31T03:05:59.897049+0000 mgr.a (mgr.14388) 2369 : audit [DBG] from='client.63270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:02 smithi191 bash[24992]: cluster 2024-08-31T03:06:00.886849+0000 mgr.a (mgr.14388) 2370 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:02.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:02 smithi163 bash[24253]: cluster 2024-08-31T03:06:00.886849+0000 mgr.a (mgr.14388) 2370 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:02 smithi027 bash[22610]: cluster 2024-08-31T03:06:00.886849+0000 mgr.a (mgr.14388) 2370 : cluster [DBG] pgmap v1641: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:04 smithi191 bash[24992]: cluster 2024-08-31T03:06:02.888628+0000 mgr.a (mgr.14388) 2371 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:04.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:04 smithi163 bash[24253]: cluster 2024-08-31T03:06:02.888628+0000 mgr.a (mgr.14388) 2371 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:04 smithi027 bash[22610]: cluster 2024-08-31T03:06:02.888628+0000 mgr.a (mgr.14388) 2371 : cluster [DBG] pgmap v1642: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:05.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:06:05.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:06:05.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:06.084 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:06.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:06.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:06.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:06.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:06 smithi191 bash[24992]: cluster 2024-08-31T03:06:04.889885+0000 mgr.a (mgr.14388) 2372 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:06.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:06 smithi163 bash[24253]: cluster 2024-08-31T03:06:04.889885+0000 mgr.a (mgr.14388) 2372 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:06 smithi027 bash[22610]: cluster 2024-08-31T03:06:04.889885+0000 mgr.a (mgr.14388) 2372 : cluster [DBG] pgmap v1643: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:07 smithi191 bash[24992]: audit 2024-08-31T03:06:05.674907+0000 mgr.a (mgr.14388) 2373 : audit [DBG] from='client.63345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:07.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:07 smithi163 bash[24253]: audit 2024-08-31T03:06:05.674907+0000 mgr.a (mgr.14388) 2373 : audit [DBG] from='client.63345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:07 smithi027 bash[22610]: audit 2024-08-31T03:06:05.674907+0000 mgr.a (mgr.14388) 2373 : audit [DBG] from='client.63345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:08 smithi191 bash[24992]: cluster 2024-08-31T03:06:06.890865+0000 mgr.a (mgr.14388) 2374 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:08.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:08 smithi163 bash[24253]: cluster 2024-08-31T03:06:06.890865+0000 mgr.a (mgr.14388) 2374 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:08 smithi027 bash[22610]: cluster 2024-08-31T03:06:06.890865+0000 mgr.a (mgr.14388) 2374 : cluster [DBG] pgmap v1644: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:10 smithi191 bash[24992]: cluster 2024-08-31T03:06:08.893043+0000 mgr.a (mgr.14388) 2375 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:06:10.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:10 smithi163 bash[24253]: cluster 2024-08-31T03:06:08.893043+0000 mgr.a (mgr.14388) 2375 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:06:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:10 smithi027 bash[22610]: cluster 2024-08-31T03:06:08.893043+0000 mgr.a (mgr.14388) 2375 : cluster [DBG] pgmap v1645: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:06:11.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:06:11.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:06:11.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:11.864 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:11.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:11.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:11.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:11.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:12 smithi191 bash[24992]: cluster 2024-08-31T03:06:10.893820+0000 mgr.a (mgr.14388) 2376 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:12 smithi191 bash[24992]: audit 2024-08-31T03:06:11.428692+0000 mgr.a (mgr.14388) 2377 : audit [DBG] from='client.63423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:12.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:12 smithi163 bash[24253]: cluster 2024-08-31T03:06:10.893820+0000 mgr.a (mgr.14388) 2376 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:12.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:12 smithi163 bash[24253]: audit 2024-08-31T03:06:11.428692+0000 mgr.a (mgr.14388) 2377 : audit [DBG] from='client.63423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:12 smithi027 bash[22610]: cluster 2024-08-31T03:06:10.893820+0000 mgr.a (mgr.14388) 2376 : cluster [DBG] pgmap v1646: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:12 smithi027 bash[22610]: audit 2024-08-31T03:06:11.428692+0000 mgr.a (mgr.14388) 2377 : audit [DBG] from='client.63423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:14 smithi191 bash[24992]: cluster 2024-08-31T03:06:12.895738+0000 mgr.a (mgr.14388) 2378 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:14.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:14 smithi163 bash[24253]: cluster 2024-08-31T03:06:12.895738+0000 mgr.a (mgr.14388) 2378 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:14 smithi027 bash[22610]: cluster 2024-08-31T03:06:12.895738+0000 mgr.a (mgr.14388) 2378 : cluster [DBG] pgmap v1647: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:16.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:16 smithi163 bash[24253]: cluster 2024-08-31T03:06:14.897025+0000 mgr.a (mgr.14388) 2379 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:06:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:16 smithi027 bash[22610]: cluster 2024-08-31T03:06:14.897025+0000 mgr.a (mgr.14388) 2379 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:06:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:16 smithi191 bash[24992]: cluster 2024-08-31T03:06:14.897025+0000 mgr.a (mgr.14388) 2379 : cluster [DBG] pgmap v1648: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:06:16.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:06:16.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:06:16.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:17.637 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:17.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:17.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:17.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:17.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:18.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:18 smithi163 bash[24253]: cluster 2024-08-31T03:06:16.897822+0000 mgr.a (mgr.14388) 2380 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:18.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:18 smithi163 bash[24253]: audit 2024-08-31T03:06:17.203891+0000 mgr.a (mgr.14388) 2381 : audit [DBG] from='client.63501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:18 smithi027 bash[22610]: cluster 2024-08-31T03:06:16.897822+0000 mgr.a (mgr.14388) 2380 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:18 smithi027 bash[22610]: audit 2024-08-31T03:06:17.203891+0000 mgr.a (mgr.14388) 2381 : audit [DBG] from='client.63501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:18 smithi191 bash[24992]: cluster 2024-08-31T03:06:16.897822+0000 mgr.a (mgr.14388) 2380 : cluster [DBG] pgmap v1649: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:18 smithi191 bash[24992]: audit 2024-08-31T03:06:17.203891+0000 mgr.a (mgr.14388) 2381 : audit [DBG] from='client.63501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:20.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:20 smithi163 bash[24253]: cluster 2024-08-31T03:06:18.900216+0000 mgr.a (mgr.14388) 2382 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:06:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:20 smithi027 bash[22610]: cluster 2024-08-31T03:06:18.900216+0000 mgr.a (mgr.14388) 2382 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:06:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:20 smithi191 bash[24992]: cluster 2024-08-31T03:06:18.900216+0000 mgr.a (mgr.14388) 2382 : cluster [DBG] pgmap v1650: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:06:22.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:22 smithi163 bash[24253]: cluster 2024-08-31T03:06:20.900987+0000 mgr.a (mgr.14388) 2383 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:22 smithi027 bash[22610]: cluster 2024-08-31T03:06:20.900987+0000 mgr.a (mgr.14388) 2383 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:22 smithi191 bash[24992]: cluster 2024-08-31T03:06:20.900987+0000 mgr.a (mgr.14388) 2383 : cluster [DBG] pgmap v1651: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:22.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:06:22.639 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:06:22.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:23.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:23.412 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:24.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:24 smithi163 bash[24253]: cluster 2024-08-31T03:06:22.902418+0000 mgr.a (mgr.14388) 2384 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:24.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:24 smithi163 bash[24253]: audit 2024-08-31T03:06:22.981026+0000 mgr.a (mgr.14388) 2385 : audit [DBG] from='client.63567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:24 smithi027 bash[22610]: cluster 2024-08-31T03:06:22.902418+0000 mgr.a (mgr.14388) 2384 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:24 smithi027 bash[22610]: audit 2024-08-31T03:06:22.981026+0000 mgr.a (mgr.14388) 2385 : audit [DBG] from='client.63567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:24 smithi191 bash[24992]: cluster 2024-08-31T03:06:22.902418+0000 mgr.a (mgr.14388) 2384 : cluster [DBG] pgmap v1652: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:24 smithi191 bash[24992]: audit 2024-08-31T03:06:22.981026+0000 mgr.a (mgr.14388) 2385 : audit [DBG] from='client.63567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:26.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:26 smithi163 bash[24253]: cluster 2024-08-31T03:06:24.904116+0000 mgr.a (mgr.14388) 2386 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:06:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:26 smithi027 bash[22610]: cluster 2024-08-31T03:06:24.904116+0000 mgr.a (mgr.14388) 2386 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:06:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:26 smithi191 bash[24992]: cluster 2024-08-31T03:06:24.904116+0000 mgr.a (mgr.14388) 2386 : cluster [DBG] pgmap v1653: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:06:28.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:06:28.414 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:06:28.414 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:28.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:28 smithi163 bash[24253]: cluster 2024-08-31T03:06:26.904902+0000 mgr.a (mgr.14388) 2387 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:06:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:28 smithi027 bash[22610]: cluster 2024-08-31T03:06:26.904902+0000 mgr.a (mgr.14388) 2387 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:06:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:28 smithi191 bash[24992]: cluster 2024-08-31T03:06:26.904902+0000 mgr.a (mgr.14388) 2387 : cluster [DBG] pgmap v1654: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:06:29.166 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:29.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:29.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:29.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:29.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:30.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:30 smithi163 bash[24253]: audit 2024-08-31T03:06:28.747005+0000 mgr.a (mgr.14388) 2388 : audit [DBG] from='client.63642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:30 smithi163 bash[24253]: cluster 2024-08-31T03:06:28.907013+0000 mgr.a (mgr.14388) 2389 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:30 smithi027 bash[22610]: audit 2024-08-31T03:06:28.747005+0000 mgr.a (mgr.14388) 2388 : audit [DBG] from='client.63642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:30 smithi027 bash[22610]: cluster 2024-08-31T03:06:28.907013+0000 mgr.a (mgr.14388) 2389 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:30 smithi191 bash[24992]: audit 2024-08-31T03:06:28.747005+0000 mgr.a (mgr.14388) 2388 : audit [DBG] from='client.63642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:30 smithi191 bash[24992]: cluster 2024-08-31T03:06:28.907013+0000 mgr.a (mgr.14388) 2389 : cluster [DBG] pgmap v1655: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:32.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:32 smithi163 bash[24253]: cluster 2024-08-31T03:06:30.907882+0000 mgr.a (mgr.14388) 2390 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:06:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:32 smithi027 bash[22610]: cluster 2024-08-31T03:06:30.907882+0000 mgr.a (mgr.14388) 2390 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:06:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:32 smithi191 bash[24992]: cluster 2024-08-31T03:06:30.907882+0000 mgr.a (mgr.14388) 2390 : cluster [DBG] pgmap v1656: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:06:34.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:06:34.168 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:06:34.168 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:34.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:34 smithi163 bash[24253]: cluster 2024-08-31T03:06:32.909601+0000 mgr.a (mgr.14388) 2391 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:06:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:34 smithi027 bash[22610]: cluster 2024-08-31T03:06:32.909601+0000 mgr.a (mgr.14388) 2391 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:06:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:34 smithi191 bash[24992]: cluster 2024-08-31T03:06:32.909601+0000 mgr.a (mgr.14388) 2391 : cluster [DBG] pgmap v1657: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:06:34.907 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:34.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:34.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:34.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:34.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:36.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:36 smithi163 bash[24253]: audit 2024-08-31T03:06:34.503570+0000 mgr.a (mgr.14388) 2392 : audit [DBG] from='client.63720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:36.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:36 smithi163 bash[24253]: cluster 2024-08-31T03:06:34.910534+0000 mgr.a (mgr.14388) 2393 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:36 smithi027 bash[22610]: audit 2024-08-31T03:06:34.503570+0000 mgr.a (mgr.14388) 2392 : audit [DBG] from='client.63720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:36 smithi027 bash[22610]: cluster 2024-08-31T03:06:34.910534+0000 mgr.a (mgr.14388) 2393 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:36 smithi191 bash[24992]: audit 2024-08-31T03:06:34.503570+0000 mgr.a (mgr.14388) 2392 : audit [DBG] from='client.63720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:36 smithi191 bash[24992]: cluster 2024-08-31T03:06:34.910534+0000 mgr.a (mgr.14388) 2393 : cluster [DBG] pgmap v1658: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:38.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:38 smithi163 bash[24253]: cluster 2024-08-31T03:06:36.911289+0000 mgr.a (mgr.14388) 2394 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:38 smithi027 bash[22610]: cluster 2024-08-31T03:06:36.911289+0000 mgr.a (mgr.14388) 2394 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:38 smithi191 bash[24992]: cluster 2024-08-31T03:06:36.911289+0000 mgr.a (mgr.14388) 2394 : cluster [DBG] pgmap v1659: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:39.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:06:39.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:06:39.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:40.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:40 smithi163 bash[24253]: cluster 2024-08-31T03:06:38.913358+0000 mgr.a (mgr.14388) 2395 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:06:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:40 smithi027 bash[22610]: cluster 2024-08-31T03:06:38.913358+0000 mgr.a (mgr.14388) 2395 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:06:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:40 smithi191 bash[24992]: cluster 2024-08-31T03:06:38.913358+0000 mgr.a (mgr.14388) 2395 : cluster [DBG] pgmap v1660: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:06:40.654 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:40.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:40.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:40.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:40.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:41.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:41 smithi163 bash[24253]: audit 2024-08-31T03:06:40.242170+0000 mgr.a (mgr.14388) 2396 : audit [DBG] from='client.63798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:41 smithi027 bash[22610]: audit 2024-08-31T03:06:40.242170+0000 mgr.a (mgr.14388) 2396 : audit [DBG] from='client.63798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:41 smithi191 bash[24992]: audit 2024-08-31T03:06:40.242170+0000 mgr.a (mgr.14388) 2396 : audit [DBG] from='client.63798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:42.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:42 smithi163 bash[24253]: cluster 2024-08-31T03:06:40.914424+0000 mgr.a (mgr.14388) 2397 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:42 smithi027 bash[22610]: cluster 2024-08-31T03:06:40.914424+0000 mgr.a (mgr.14388) 2397 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:42 smithi191 bash[24992]: cluster 2024-08-31T03:06:40.914424+0000 mgr.a (mgr.14388) 2397 : cluster [DBG] pgmap v1661: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:43.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:43 smithi163 bash[24253]: audit 2024-08-31T03:06:42.725938+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:06:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:43 smithi027 bash[22610]: audit 2024-08-31T03:06:42.725938+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:06:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:43 smithi191 bash[24992]: audit 2024-08-31T03:06:42.725938+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:06:44.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:44 smithi163 bash[24253]: cluster 2024-08-31T03:06:42.916343+0000 mgr.a (mgr.14388) 2398 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:44.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:44 smithi163 bash[24253]: audit 2024-08-31T03:06:43.538050+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:06:44.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:44 smithi163 bash[24253]: audit 2024-08-31T03:06:43.539544+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:06:44.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:44 smithi163 bash[24253]: audit 2024-08-31T03:06:43.549879+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:06:44.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:44 smithi163 bash[24253]: audit 2024-08-31T03:06:43.555115+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:06:44.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:06:44 smithi027 bash[22863]: debug 2024-08-31T03:06:44.270+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:06:44.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:06:44 smithi027 bash[22863]: debug 2024-08-31T03:06:44.274+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:06:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:44 smithi027 bash[22610]: cluster 2024-08-31T03:06:42.916343+0000 mgr.a (mgr.14388) 2398 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:44 smithi027 bash[22610]: audit 2024-08-31T03:06:43.538050+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:06:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:44 smithi027 bash[22610]: audit 2024-08-31T03:06:43.539544+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:06:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:44 smithi027 bash[22610]: audit 2024-08-31T03:06:43.549879+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:06:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:44 smithi027 bash[22610]: audit 2024-08-31T03:06:43.555115+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:06:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:44 smithi191 bash[24992]: cluster 2024-08-31T03:06:42.916343+0000 mgr.a (mgr.14388) 2398 : cluster [DBG] pgmap v1662: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:06:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:44 smithi191 bash[24992]: audit 2024-08-31T03:06:43.538050+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:06:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:44 smithi191 bash[24992]: audit 2024-08-31T03:06:43.539544+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:06:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:44 smithi191 bash[24992]: audit 2024-08-31T03:06:43.549879+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:06:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:44 smithi191 bash[24992]: audit 2024-08-31T03:06:43.555115+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:06:45.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:45 smithi163 bash[24253]: audit 2024-08-31T03:06:43.557286+0000 mgr.a (mgr.14388) 2399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:06:45.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:45 smithi163 bash[24253]: audit 2024-08-31T03:06:44.274651+0000 mgr.a (mgr.14388) 2400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:06:45.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:45 smithi163 bash[24253]: cephadm 2024-08-31T03:06:44.275975+0000 mgr.a (mgr.14388) 2401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:06:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:45 smithi027 bash[22610]: audit 2024-08-31T03:06:43.557286+0000 mgr.a (mgr.14388) 2399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:06:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:45 smithi027 bash[22610]: audit 2024-08-31T03:06:44.274651+0000 mgr.a (mgr.14388) 2400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:06:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:45 smithi027 bash[22610]: cephadm 2024-08-31T03:06:44.275975+0000 mgr.a (mgr.14388) 2401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:06:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:45 smithi191 bash[24992]: audit 2024-08-31T03:06:43.557286+0000 mgr.a (mgr.14388) 2399 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:06:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:45 smithi191 bash[24992]: audit 2024-08-31T03:06:44.274651+0000 mgr.a (mgr.14388) 2400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:06:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:45 smithi191 bash[24992]: cephadm 2024-08-31T03:06:44.275975+0000 mgr.a (mgr.14388) 2401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:06:45.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:06:45.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:06:45.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:46.429 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:46.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:46.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:46.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:46.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:46.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:46 smithi163 bash[24253]: cluster 2024-08-31T03:06:44.918158+0000 mgr.a (mgr.14388) 2402 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:06:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:46 smithi027 bash[22610]: cluster 2024-08-31T03:06:44.918158+0000 mgr.a (mgr.14388) 2402 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:06:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:46 smithi191 bash[24992]: cluster 2024-08-31T03:06:44.918158+0000 mgr.a (mgr.14388) 2402 : cluster [DBG] pgmap v1663: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:06:47.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:47 smithi163 bash[24253]: audit 2024-08-31T03:06:45.991409+0000 mgr.a (mgr.14388) 2403 : audit [DBG] from='client.63984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:47 smithi027 bash[22610]: audit 2024-08-31T03:06:45.991409+0000 mgr.a (mgr.14388) 2403 : audit [DBG] from='client.63984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:47 smithi191 bash[24992]: audit 2024-08-31T03:06:45.991409+0000 mgr.a (mgr.14388) 2403 : audit [DBG] from='client.63984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:48.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:48 smithi163 bash[24253]: cluster 2024-08-31T03:06:46.919161+0000 mgr.a (mgr.14388) 2404 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:48 smithi027 bash[22610]: cluster 2024-08-31T03:06:46.919161+0000 mgr.a (mgr.14388) 2404 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:48 smithi191 bash[24992]: cluster 2024-08-31T03:06:46.919161+0000 mgr.a (mgr.14388) 2404 : cluster [DBG] pgmap v1664: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:06:50.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:50 smithi163 bash[24253]: cluster 2024-08-31T03:06:48.921394+0000 mgr.a (mgr.14388) 2405 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:50 smithi027 bash[22610]: cluster 2024-08-31T03:06:48.921394+0000 mgr.a (mgr.14388) 2405 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:50 smithi191 bash[24992]: cluster 2024-08-31T03:06:48.921394+0000 mgr.a (mgr.14388) 2405 : cluster [DBG] pgmap v1665: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:51.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:06:51.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:06:51.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:51 smithi027 bash[22610]: cluster 2024-08-31T03:06:50.922193+0000 mgr.a (mgr.14388) 2406 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:51 smithi191 bash[24992]: cluster 2024-08-31T03:06:50.922193+0000 mgr.a (mgr.14388) 2406 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:52.189 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:52.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:52.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:51 smithi163 bash[24253]: cluster 2024-08-31T03:06:50.922193+0000 mgr.a (mgr.14388) 2406 : cluster [DBG] pgmap v1666: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:52 smithi027 bash[22610]: audit 2024-08-31T03:06:51.769232+0000 mgr.a (mgr.14388) 2407 : audit [DBG] from='client.64062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:52 smithi191 bash[24992]: audit 2024-08-31T03:06:51.769232+0000 mgr.a (mgr.14388) 2407 : audit [DBG] from='client.64062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:53.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:52 smithi163 bash[24253]: audit 2024-08-31T03:06:51.769232+0000 mgr.a (mgr.14388) 2407 : audit [DBG] from='client.64062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:53 smithi027 bash[22610]: cluster 2024-08-31T03:06:52.924127+0000 mgr.a (mgr.14388) 2408 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:53 smithi191 bash[24992]: cluster 2024-08-31T03:06:52.924127+0000 mgr.a (mgr.14388) 2408 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:54.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:53 smithi163 bash[24253]: cluster 2024-08-31T03:06:52.924127+0000 mgr.a (mgr.14388) 2408 : cluster [DBG] pgmap v1667: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:55 smithi027 bash[22610]: cluster 2024-08-31T03:06:54.925454+0000 mgr.a (mgr.14388) 2409 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:55 smithi191 bash[24992]: cluster 2024-08-31T03:06:54.925454+0000 mgr.a (mgr.14388) 2409 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:56.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:55 smithi163 bash[24253]: cluster 2024-08-31T03:06:54.925454+0000 mgr.a (mgr.14388) 2409 : cluster [DBG] pgmap v1668: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:57.191 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:06:57.192 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:06:57.192 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:06:57.936 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:06:57.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:06:57.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:06:57.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:06:57.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:06:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:57 smithi191 bash[24992]: cluster 2024-08-31T03:06:56.926259+0000 mgr.a (mgr.14388) 2410 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:58.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:57 smithi163 bash[24253]: cluster 2024-08-31T03:06:56.926259+0000 mgr.a (mgr.14388) 2410 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:57 smithi027 bash[22610]: cluster 2024-08-31T03:06:56.926259+0000 mgr.a (mgr.14388) 2410 : cluster [DBG] pgmap v1669: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:06:59.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:58 smithi191 bash[24992]: audit 2024-08-31T03:06:57.522553+0000 mgr.a (mgr.14388) 2411 : audit [DBG] from='client.64140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:59.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:06:58 smithi163 bash[24253]: audit 2024-08-31T03:06:57.522553+0000 mgr.a (mgr.14388) 2411 : audit [DBG] from='client.64140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:06:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:58 smithi027 bash[22610]: audit 2024-08-31T03:06:57.522553+0000 mgr.a (mgr.14388) 2411 : audit [DBG] from='client.64140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:06:59 smithi191 bash[24992]: cluster 2024-08-31T03:06:58.928625+0000 mgr.a (mgr.14388) 2412 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:00.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:00 smithi163 bash[24253]: cluster 2024-08-31T03:06:58.928625+0000 mgr.a (mgr.14388) 2412 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:06:59 smithi027 bash[22610]: cluster 2024-08-31T03:06:58.928625+0000 mgr.a (mgr.14388) 2412 : cluster [DBG] pgmap v1670: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:02 smithi191 bash[24992]: cluster 2024-08-31T03:07:00.929392+0000 mgr.a (mgr.14388) 2413 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:07:02.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:02 smithi163 bash[24253]: cluster 2024-08-31T03:07:00.929392+0000 mgr.a (mgr.14388) 2413 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:07:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:02 smithi027 bash[22610]: cluster 2024-08-31T03:07:00.929392+0000 mgr.a (mgr.14388) 2413 : cluster [DBG] pgmap v1671: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:07:02.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:07:02.939 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:07:02.939 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:07:03.680 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:07:03.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:07:03.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:07:03.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:07:03.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:07:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:04 smithi191 bash[24992]: cluster 2024-08-31T03:07:02.930932+0000 mgr.a (mgr.14388) 2414 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:04 smithi191 bash[24992]: audit 2024-08-31T03:07:03.277276+0000 mgr.a (mgr.14388) 2415 : audit [DBG] from='client.64218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:04 smithi163 bash[24253]: cluster 2024-08-31T03:07:02.930932+0000 mgr.a (mgr.14388) 2414 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:04.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:04 smithi163 bash[24253]: audit 2024-08-31T03:07:03.277276+0000 mgr.a (mgr.14388) 2415 : audit [DBG] from='client.64218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:04 smithi027 bash[22610]: cluster 2024-08-31T03:07:02.930932+0000 mgr.a (mgr.14388) 2414 : cluster [DBG] pgmap v1672: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:04 smithi027 bash[22610]: audit 2024-08-31T03:07:03.277276+0000 mgr.a (mgr.14388) 2415 : audit [DBG] from='client.64218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:06 smithi191 bash[24992]: cluster 2024-08-31T03:07:04.932655+0000 mgr.a (mgr.14388) 2416 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:07:06.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:06 smithi163 bash[24253]: cluster 2024-08-31T03:07:04.932655+0000 mgr.a (mgr.14388) 2416 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:07:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:06 smithi027 bash[22610]: cluster 2024-08-31T03:07:04.932655+0000 mgr.a (mgr.14388) 2416 : cluster [DBG] pgmap v1673: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:07:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:08 smithi191 bash[24992]: cluster 2024-08-31T03:07:06.933448+0000 mgr.a (mgr.14388) 2417 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:07:08.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:08 smithi163 bash[24253]: cluster 2024-08-31T03:07:06.933448+0000 mgr.a (mgr.14388) 2417 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:07:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:08 smithi027 bash[22610]: cluster 2024-08-31T03:07:06.933448+0000 mgr.a (mgr.14388) 2417 : cluster [DBG] pgmap v1674: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:07:08.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:07:08.682 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:07:08.682 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:07:09.450 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:07:09.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:07:09.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:07:09.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:07:09.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:07:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:10 smithi191 bash[24992]: cluster 2024-08-31T03:07:08.935452+0000 mgr.a (mgr.14388) 2418 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:10 smithi191 bash[24992]: audit 2024-08-31T03:07:09.016515+0000 mgr.a (mgr.14388) 2419 : audit [DBG] from='client.64296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:10.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:10 smithi163 bash[24253]: cluster 2024-08-31T03:07:08.935452+0000 mgr.a (mgr.14388) 2418 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:10.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:10 smithi163 bash[24253]: audit 2024-08-31T03:07:09.016515+0000 mgr.a (mgr.14388) 2419 : audit [DBG] from='client.64296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:10 smithi027 bash[22610]: cluster 2024-08-31T03:07:08.935452+0000 mgr.a (mgr.14388) 2418 : cluster [DBG] pgmap v1675: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:10 smithi027 bash[22610]: audit 2024-08-31T03:07:09.016515+0000 mgr.a (mgr.14388) 2419 : audit [DBG] from='client.64296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:12 smithi191 bash[24992]: cluster 2024-08-31T03:07:10.936278+0000 mgr.a (mgr.14388) 2420 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:07:12.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:12 smithi163 bash[24253]: cluster 2024-08-31T03:07:10.936278+0000 mgr.a (mgr.14388) 2420 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:07:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:12 smithi027 bash[22610]: cluster 2024-08-31T03:07:10.936278+0000 mgr.a (mgr.14388) 2420 : cluster [DBG] pgmap v1676: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:07:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:14 smithi191 bash[24992]: cluster 2024-08-31T03:07:12.938014+0000 mgr.a (mgr.14388) 2421 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:07:14.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:14 smithi163 bash[24253]: cluster 2024-08-31T03:07:12.938014+0000 mgr.a (mgr.14388) 2421 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:07:14.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:07:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:07:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:07:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:14 smithi027 bash[22610]: cluster 2024-08-31T03:07:12.938014+0000 mgr.a (mgr.14388) 2421 : cluster [DBG] pgmap v1677: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:07:15.211 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:07:15.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:07:15.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:07:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:07:15.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:07:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:16 smithi191 bash[24992]: audit 2024-08-31T03:07:14.791859+0000 mgr.a (mgr.14388) 2422 : audit [DBG] from='client.64374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:16 smithi191 bash[24992]: cluster 2024-08-31T03:07:14.939001+0000 mgr.a (mgr.14388) 2423 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:16.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:16 smithi163 bash[24253]: audit 2024-08-31T03:07:14.791859+0000 mgr.a (mgr.14388) 2422 : audit [DBG] from='client.64374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:16.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:16 smithi163 bash[24253]: cluster 2024-08-31T03:07:14.939001+0000 mgr.a (mgr.14388) 2423 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:16 smithi027 bash[22610]: audit 2024-08-31T03:07:14.791859+0000 mgr.a (mgr.14388) 2422 : audit [DBG] from='client.64374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:16 smithi027 bash[22610]: cluster 2024-08-31T03:07:14.939001+0000 mgr.a (mgr.14388) 2423 : cluster [DBG] pgmap v1678: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:18.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:18 smithi163 bash[24253]: cluster 2024-08-31T03:07:16.939869+0000 mgr.a (mgr.14388) 2424 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:18 smithi027 bash[22610]: cluster 2024-08-31T03:07:16.939869+0000 mgr.a (mgr.14388) 2424 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:18 smithi191 bash[24992]: cluster 2024-08-31T03:07:16.939869+0000 mgr.a (mgr.14388) 2424 : cluster [DBG] pgmap v1679: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:20.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:07:20.213 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:07:20.213 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:07:20.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:20 smithi163 bash[24253]: cluster 2024-08-31T03:07:18.942086+0000 mgr.a (mgr.14388) 2425 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T03:07:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:20 smithi027 bash[22610]: cluster 2024-08-31T03:07:18.942086+0000 mgr.a (mgr.14388) 2425 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T03:07:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:20 smithi191 bash[24992]: cluster 2024-08-31T03:07:18.942086+0000 mgr.a (mgr.14388) 2425 : cluster [DBG] pgmap v1680: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T03:07:20.984 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:07:20.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:07:20.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:07:20.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:07:20.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:07:22.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:22 smithi163 bash[24253]: audit 2024-08-31T03:07:20.552231+0000 mgr.a (mgr.14388) 2426 : audit [DBG] from='client.64449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:22.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:22 smithi163 bash[24253]: cluster 2024-08-31T03:07:20.942777+0000 mgr.a (mgr.14388) 2427 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:07:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:22 smithi027 bash[22610]: audit 2024-08-31T03:07:20.552231+0000 mgr.a (mgr.14388) 2426 : audit [DBG] from='client.64449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:22 smithi027 bash[22610]: cluster 2024-08-31T03:07:20.942777+0000 mgr.a (mgr.14388) 2427 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:07:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:22 smithi191 bash[24992]: audit 2024-08-31T03:07:20.552231+0000 mgr.a (mgr.14388) 2426 : audit [DBG] from='client.64449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:22 smithi191 bash[24992]: cluster 2024-08-31T03:07:20.942777+0000 mgr.a (mgr.14388) 2427 : cluster [DBG] pgmap v1681: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:07:24.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:24 smithi163 bash[24253]: cluster 2024-08-31T03:07:22.944433+0000 mgr.a (mgr.14388) 2428 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-08-31T03:07:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:24 smithi027 bash[22610]: cluster 2024-08-31T03:07:22.944433+0000 mgr.a (mgr.14388) 2428 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-08-31T03:07:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:24 smithi191 bash[24992]: cluster 2024-08-31T03:07:22.944433+0000 mgr.a (mgr.14388) 2428 : cluster [DBG] pgmap v1682: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-08-31T03:07:25.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:07:25.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:07:25.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:07:26.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:26 smithi163 bash[24253]: cluster 2024-08-31T03:07:24.945714+0000 mgr.a (mgr.14388) 2429 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:07:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:26 smithi027 bash[22610]: cluster 2024-08-31T03:07:24.945714+0000 mgr.a (mgr.14388) 2429 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:07:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:26 smithi191 bash[24992]: cluster 2024-08-31T03:07:24.945714+0000 mgr.a (mgr.14388) 2429 : cluster [DBG] pgmap v1683: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:07:26.766 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:07:26.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:07:26.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:07:26.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:07:26.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:07:27.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:27 smithi163 bash[24253]: audit 2024-08-31T03:07:26.322308+0000 mgr.a (mgr.14388) 2430 : audit [DBG] from='client.64527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:27 smithi027 bash[22610]: audit 2024-08-31T03:07:26.322308+0000 mgr.a (mgr.14388) 2430 : audit [DBG] from='client.64527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:27 smithi191 bash[24992]: audit 2024-08-31T03:07:26.322308+0000 mgr.a (mgr.14388) 2430 : audit [DBG] from='client.64527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:28.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:28 smithi163 bash[24253]: cluster 2024-08-31T03:07:26.946683+0000 mgr.a (mgr.14388) 2431 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:07:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:28 smithi027 bash[22610]: cluster 2024-08-31T03:07:26.946683+0000 mgr.a (mgr.14388) 2431 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:07:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:28 smithi191 bash[24992]: cluster 2024-08-31T03:07:26.946683+0000 mgr.a (mgr.14388) 2431 : cluster [DBG] pgmap v1684: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:07:30.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:30 smithi163 bash[24253]: cluster 2024-08-31T03:07:28.948847+0000 mgr.a (mgr.14388) 2432 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T03:07:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:30 smithi027 bash[22610]: cluster 2024-08-31T03:07:28.948847+0000 mgr.a (mgr.14388) 2432 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T03:07:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:30 smithi191 bash[24992]: cluster 2024-08-31T03:07:28.948847+0000 mgr.a (mgr.14388) 2432 : cluster [DBG] pgmap v1685: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T03:07:31.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:07:31.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:07:31.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:07:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:32 smithi163 bash[24253]: cluster 2024-08-31T03:07:30.949647+0000 mgr.a (mgr.14388) 2433 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:32 smithi027 bash[22610]: cluster 2024-08-31T03:07:30.949647+0000 mgr.a (mgr.14388) 2433 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:32.537 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:07:32.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:07:32.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:07:32.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:07:32.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:07:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:32 smithi191 bash[24992]: cluster 2024-08-31T03:07:30.949647+0000 mgr.a (mgr.14388) 2433 : cluster [DBG] pgmap v1686: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:33.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:33 smithi163 bash[24253]: audit 2024-08-31T03:07:32.107507+0000 mgr.a (mgr.14388) 2434 : audit [DBG] from='client.64596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:33 smithi027 bash[22610]: audit 2024-08-31T03:07:32.107507+0000 mgr.a (mgr.14388) 2434 : audit [DBG] from='client.64596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:33 smithi191 bash[24992]: audit 2024-08-31T03:07:32.107507+0000 mgr.a (mgr.14388) 2434 : audit [DBG] from='client.64596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:34.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:34 smithi163 bash[24253]: cluster 2024-08-31T03:07:32.951516+0000 mgr.a (mgr.14388) 2435 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:07:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:34 smithi027 bash[22610]: cluster 2024-08-31T03:07:32.951516+0000 mgr.a (mgr.14388) 2435 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:07:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:34 smithi191 bash[24992]: cluster 2024-08-31T03:07:32.951516+0000 mgr.a (mgr.14388) 2435 : cluster [DBG] pgmap v1687: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:07:36.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:36 smithi163 bash[24253]: cluster 2024-08-31T03:07:34.952793+0000 mgr.a (mgr.14388) 2436 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:07:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:36 smithi027 bash[22610]: cluster 2024-08-31T03:07:34.952793+0000 mgr.a (mgr.14388) 2436 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:07:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:36 smithi191 bash[24992]: cluster 2024-08-31T03:07:34.952793+0000 mgr.a (mgr.14388) 2436 : cluster [DBG] pgmap v1688: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:07:37.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:07:37.539 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:07:37.539 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:07:38.315 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:07:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:07:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:07:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:07:38.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:07:38.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:38 smithi163 bash[24253]: cluster 2024-08-31T03:07:36.953686+0000 mgr.a (mgr.14388) 2437 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:38 smithi027 bash[22610]: cluster 2024-08-31T03:07:36.953686+0000 mgr.a (mgr.14388) 2437 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:38 smithi191 bash[24992]: cluster 2024-08-31T03:07:36.953686+0000 mgr.a (mgr.14388) 2437 : cluster [DBG] pgmap v1689: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:07:39.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:39 smithi163 bash[24253]: audit 2024-08-31T03:07:37.874775+0000 mgr.a (mgr.14388) 2438 : audit [DBG] from='client.64668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:39 smithi027 bash[22610]: audit 2024-08-31T03:07:37.874775+0000 mgr.a (mgr.14388) 2438 : audit [DBG] from='client.64668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:39 smithi191 bash[24992]: audit 2024-08-31T03:07:37.874775+0000 mgr.a (mgr.14388) 2438 : audit [DBG] from='client.64668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:40.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:40 smithi163 bash[24253]: cluster 2024-08-31T03:07:38.956496+0000 mgr.a (mgr.14388) 2439 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:07:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:40 smithi027 bash[22610]: cluster 2024-08-31T03:07:38.956496+0000 mgr.a (mgr.14388) 2439 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:07:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:40 smithi191 bash[24992]: cluster 2024-08-31T03:07:38.956496+0000 mgr.a (mgr.14388) 2439 : cluster [DBG] pgmap v1690: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:07:42.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:42 smithi163 bash[24253]: cluster 2024-08-31T03:07:40.957297+0000 mgr.a (mgr.14388) 2440 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:07:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:42 smithi027 bash[22610]: cluster 2024-08-31T03:07:40.957297+0000 mgr.a (mgr.14388) 2440 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:07:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:42 smithi191 bash[24992]: cluster 2024-08-31T03:07:40.957297+0000 mgr.a (mgr.14388) 2440 : cluster [DBG] pgmap v1691: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:07:43.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:07:43.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:07:43.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:07:44.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:07:44.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:07:44.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:07:44.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:07:44.079 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:07:44.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:44 smithi163 bash[24253]: cluster 2024-08-31T03:07:42.958813+0000 mgr.a (mgr.14388) 2441 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:07:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:44 smithi027 bash[22610]: cluster 2024-08-31T03:07:42.958813+0000 mgr.a (mgr.14388) 2441 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:07:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:44 smithi191 bash[24992]: cluster 2024-08-31T03:07:42.958813+0000 mgr.a (mgr.14388) 2441 : cluster [DBG] pgmap v1692: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:07:45.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:45 smithi163 bash[24253]: audit 2024-08-31T03:07:43.654110+0000 mgr.a (mgr.14388) 2442 : audit [DBG] from='client.64743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:45.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:45 smithi163 bash[24253]: audit 2024-08-31T03:07:44.326379+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:07:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:45 smithi027 bash[22610]: audit 2024-08-31T03:07:43.654110+0000 mgr.a (mgr.14388) 2442 : audit [DBG] from='client.64743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:45 smithi027 bash[22610]: audit 2024-08-31T03:07:44.326379+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:07:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:45 smithi191 bash[24992]: audit 2024-08-31T03:07:43.654110+0000 mgr.a (mgr.14388) 2442 : audit [DBG] from='client.64743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:45 smithi191 bash[24992]: audit 2024-08-31T03:07:44.326379+0000 mon.a (mon.0) 952 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:07:46.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:07:45 smithi027 bash[22863]: debug 2024-08-31T03:07:45.913+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:07:46.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:07:45 smithi027 bash[22863]: debug 2024-08-31T03:07:45.913+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:07:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:46 smithi027 bash[22610]: cluster 2024-08-31T03:07:44.959684+0000 mgr.a (mgr.14388) 2443 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:07:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:46 smithi027 bash[22610]: audit 2024-08-31T03:07:45.175256+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:07:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:46 smithi027 bash[22610]: audit 2024-08-31T03:07:45.176819+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:07:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:46 smithi027 bash[22610]: audit 2024-08-31T03:07:45.187287+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:07:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:46 smithi027 bash[22610]: audit 2024-08-31T03:07:45.192226+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:07:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:46 smithi027 bash[22610]: audit 2024-08-31T03:07:45.193757+0000 mgr.a (mgr.14388) 2444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:07:46.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:46 smithi163 bash[24253]: cluster 2024-08-31T03:07:44.959684+0000 mgr.a (mgr.14388) 2443 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:07:46.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:46 smithi163 bash[24253]: audit 2024-08-31T03:07:45.175256+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:07:46.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:46 smithi163 bash[24253]: audit 2024-08-31T03:07:45.176819+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:07:46.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:46 smithi163 bash[24253]: audit 2024-08-31T03:07:45.187287+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:07:46.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:46 smithi163 bash[24253]: audit 2024-08-31T03:07:45.192226+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:07:46.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:46 smithi163 bash[24253]: audit 2024-08-31T03:07:45.193757+0000 mgr.a (mgr.14388) 2444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:07:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:46 smithi191 bash[24992]: cluster 2024-08-31T03:07:44.959684+0000 mgr.a (mgr.14388) 2443 : cluster [DBG] pgmap v1693: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:07:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:46 smithi191 bash[24992]: audit 2024-08-31T03:07:45.175256+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:07:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:46 smithi191 bash[24992]: audit 2024-08-31T03:07:45.176819+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:07:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:46 smithi191 bash[24992]: audit 2024-08-31T03:07:45.187287+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:07:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:46 smithi191 bash[24992]: audit 2024-08-31T03:07:45.192226+0000 mon.a (mon.0) 956 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:07:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:46 smithi191 bash[24992]: audit 2024-08-31T03:07:45.193757+0000 mgr.a (mgr.14388) 2444 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:07:47.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:47 smithi163 bash[24253]: audit 2024-08-31T03:07:45.916216+0000 mgr.a (mgr.14388) 2445 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:07:47.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:47 smithi163 bash[24253]: cephadm 2024-08-31T03:07:45.917792+0000 mgr.a (mgr.14388) 2446 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:07:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:47 smithi027 bash[22610]: audit 2024-08-31T03:07:45.916216+0000 mgr.a (mgr.14388) 2445 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:07:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:47 smithi027 bash[22610]: cephadm 2024-08-31T03:07:45.917792+0000 mgr.a (mgr.14388) 2446 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:07:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:47 smithi191 bash[24992]: audit 2024-08-31T03:07:45.916216+0000 mgr.a (mgr.14388) 2445 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:07:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:47 smithi191 bash[24992]: cephadm 2024-08-31T03:07:45.917792+0000 mgr.a (mgr.14388) 2446 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:07:48.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:48 smithi163 bash[24253]: cluster 2024-08-31T03:07:46.960639+0000 mgr.a (mgr.14388) 2447 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:07:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:48 smithi027 bash[22610]: cluster 2024-08-31T03:07:46.960639+0000 mgr.a (mgr.14388) 2447 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:07:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:48 smithi191 bash[24992]: cluster 2024-08-31T03:07:46.960639+0000 mgr.a (mgr.14388) 2447 : cluster [DBG] pgmap v1694: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:07:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:07:49.081 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:07:49.081 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:07:49.831 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:07:49.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:07:49.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:07:49.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:07:49.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:07:50.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:50 smithi163 bash[24253]: cluster 2024-08-31T03:07:48.962937+0000 mgr.a (mgr.14388) 2448 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:50.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:50 smithi163 bash[24253]: audit 2024-08-31T03:07:49.412165+0000 mgr.a (mgr.14388) 2449 : audit [DBG] from='client.64926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:50 smithi027 bash[22610]: cluster 2024-08-31T03:07:48.962937+0000 mgr.a (mgr.14388) 2448 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:50 smithi027 bash[22610]: audit 2024-08-31T03:07:49.412165+0000 mgr.a (mgr.14388) 2449 : audit [DBG] from='client.64926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:50 smithi191 bash[24992]: cluster 2024-08-31T03:07:48.962937+0000 mgr.a (mgr.14388) 2448 : cluster [DBG] pgmap v1695: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:50 smithi191 bash[24992]: audit 2024-08-31T03:07:49.412165+0000 mgr.a (mgr.14388) 2449 : audit [DBG] from='client.64926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:52.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:52 smithi163 bash[24253]: cluster 2024-08-31T03:07:50.963811+0000 mgr.a (mgr.14388) 2450 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:07:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:52 smithi027 bash[22610]: cluster 2024-08-31T03:07:50.963811+0000 mgr.a (mgr.14388) 2450 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:07:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:52 smithi191 bash[24992]: cluster 2024-08-31T03:07:50.963811+0000 mgr.a (mgr.14388) 2450 : cluster [DBG] pgmap v1696: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:07:54.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:54 smithi163 bash[24253]: cluster 2024-08-31T03:07:52.965486+0000 mgr.a (mgr.14388) 2451 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:54 smithi027 bash[22610]: cluster 2024-08-31T03:07:52.965486+0000 mgr.a (mgr.14388) 2451 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:54 smithi191 bash[24992]: cluster 2024-08-31T03:07:52.965486+0000 mgr.a (mgr.14388) 2451 : cluster [DBG] pgmap v1697: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:54.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:07:54.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:07:54.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:07:55.568 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:07:55.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:07:55.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:07:55.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:07:55.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:07:56.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:56 smithi163 bash[24253]: cluster 2024-08-31T03:07:54.966209+0000 mgr.a (mgr.14388) 2452 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:56.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:56 smithi163 bash[24253]: audit 2024-08-31T03:07:55.162396+0000 mgr.a (mgr.14388) 2453 : audit [DBG] from='client.65004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:56 smithi027 bash[22610]: cluster 2024-08-31T03:07:54.966209+0000 mgr.a (mgr.14388) 2452 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:56 smithi027 bash[22610]: audit 2024-08-31T03:07:55.162396+0000 mgr.a (mgr.14388) 2453 : audit [DBG] from='client.65004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:56 smithi191 bash[24992]: cluster 2024-08-31T03:07:54.966209+0000 mgr.a (mgr.14388) 2452 : cluster [DBG] pgmap v1698: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:56 smithi191 bash[24992]: audit 2024-08-31T03:07:55.162396+0000 mgr.a (mgr.14388) 2453 : audit [DBG] from='client.65004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:07:58.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:07:58 smithi163 bash[24253]: cluster 2024-08-31T03:07:56.967102+0000 mgr.a (mgr.14388) 2454 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:07:58 smithi027 bash[22610]: cluster 2024-08-31T03:07:56.967102+0000 mgr.a (mgr.14388) 2454 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:07:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:07:58 smithi191 bash[24992]: cluster 2024-08-31T03:07:56.967102+0000 mgr.a (mgr.14388) 2454 : cluster [DBG] pgmap v1699: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:08:00.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:00 smithi163 bash[24253]: cluster 2024-08-31T03:07:58.969325+0000 mgr.a (mgr.14388) 2455 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:08:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:00 smithi027 bash[22610]: cluster 2024-08-31T03:07:58.969325+0000 mgr.a (mgr.14388) 2455 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:08:00.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:00 smithi191 bash[24992]: cluster 2024-08-31T03:07:58.969325+0000 mgr.a (mgr.14388) 2455 : cluster [DBG] pgmap v1700: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:08:00.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:00.570 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:01.319 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:01.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:01.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:01.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:01.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:02.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:02 smithi163 bash[24253]: audit 2024-08-31T03:08:00.902049+0000 mgr.a (mgr.14388) 2456 : audit [DBG] from='client.65079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:02.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:02 smithi163 bash[24253]: cluster 2024-08-31T03:08:00.970022+0000 mgr.a (mgr.14388) 2457 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:02 smithi027 bash[22610]: audit 2024-08-31T03:08:00.902049+0000 mgr.a (mgr.14388) 2456 : audit [DBG] from='client.65079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:02 smithi027 bash[22610]: cluster 2024-08-31T03:08:00.970022+0000 mgr.a (mgr.14388) 2457 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:02 smithi191 bash[24992]: audit 2024-08-31T03:08:00.902049+0000 mgr.a (mgr.14388) 2456 : audit [DBG] from='client.65079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:02 smithi191 bash[24992]: cluster 2024-08-31T03:08:00.970022+0000 mgr.a (mgr.14388) 2457 : cluster [DBG] pgmap v1701: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:04.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:04 smithi163 bash[24253]: cluster 2024-08-31T03:08:02.971829+0000 mgr.a (mgr.14388) 2458 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:04 smithi027 bash[22610]: cluster 2024-08-31T03:08:02.971829+0000 mgr.a (mgr.14388) 2458 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:04 smithi191 bash[24992]: cluster 2024-08-31T03:08:02.971829+0000 mgr.a (mgr.14388) 2458 : cluster [DBG] pgmap v1702: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:06.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:06.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:06.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:06 smithi163 bash[24253]: cluster 2024-08-31T03:08:04.973087+0000 mgr.a (mgr.14388) 2459 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:06 smithi027 bash[22610]: cluster 2024-08-31T03:08:04.973087+0000 mgr.a (mgr.14388) 2459 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:06 smithi191 bash[24992]: cluster 2024-08-31T03:08:04.973087+0000 mgr.a (mgr.14388) 2459 : cluster [DBG] pgmap v1703: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:07.090 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:07.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:07.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:07.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:07.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:08.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:08 smithi163 bash[24253]: audit 2024-08-31T03:08:06.665760+0000 mgr.a (mgr.14388) 2460 : audit [DBG] from='client.65157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:08.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:08 smithi163 bash[24253]: cluster 2024-08-31T03:08:06.973665+0000 mgr.a (mgr.14388) 2461 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:08 smithi027 bash[22610]: audit 2024-08-31T03:08:06.665760+0000 mgr.a (mgr.14388) 2460 : audit [DBG] from='client.65157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:08 smithi027 bash[22610]: cluster 2024-08-31T03:08:06.973665+0000 mgr.a (mgr.14388) 2461 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:08 smithi191 bash[24992]: audit 2024-08-31T03:08:06.665760+0000 mgr.a (mgr.14388) 2460 : audit [DBG] from='client.65157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:08 smithi191 bash[24992]: cluster 2024-08-31T03:08:06.973665+0000 mgr.a (mgr.14388) 2461 : cluster [DBG] pgmap v1704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:10.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:10 smithi163 bash[24253]: cluster 2024-08-31T03:08:08.975965+0000 mgr.a (mgr.14388) 2462 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:08:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:10 smithi027 bash[22610]: cluster 2024-08-31T03:08:08.975965+0000 mgr.a (mgr.14388) 2462 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:08:10.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:10 smithi191 bash[24992]: cluster 2024-08-31T03:08:08.975965+0000 mgr.a (mgr.14388) 2462 : cluster [DBG] pgmap v1705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:08:12.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:12.093 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:12 smithi027 bash[22610]: cluster 2024-08-31T03:08:10.976732+0000 mgr.a (mgr.14388) 2463 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:12 smithi191 bash[24992]: cluster 2024-08-31T03:08:10.976732+0000 mgr.a (mgr.14388) 2463 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:12 smithi163 bash[24253]: cluster 2024-08-31T03:08:10.976732+0000 mgr.a (mgr.14388) 2463 : cluster [DBG] pgmap v1706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:12.854 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:12.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:12.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:12.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:12.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:13 smithi027 bash[22610]: audit 2024-08-31T03:08:12.429716+0000 mgr.a (mgr.14388) 2464 : audit [DBG] from='client.65235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:13.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:13 smithi191 bash[24992]: audit 2024-08-31T03:08:12.429716+0000 mgr.a (mgr.14388) 2464 : audit [DBG] from='client.65235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:13.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:13 smithi163 bash[24253]: audit 2024-08-31T03:08:12.429716+0000 mgr.a (mgr.14388) 2464 : audit [DBG] from='client.65235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:14 smithi027 bash[22610]: cluster 2024-08-31T03:08:12.978574+0000 mgr.a (mgr.14388) 2465 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:14 smithi191 bash[24992]: cluster 2024-08-31T03:08:12.978574+0000 mgr.a (mgr.14388) 2465 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:14 smithi163 bash[24253]: cluster 2024-08-31T03:08:12.978574+0000 mgr.a (mgr.14388) 2465 : cluster [DBG] pgmap v1707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:16 smithi027 bash[22610]: cluster 2024-08-31T03:08:14.979840+0000 mgr.a (mgr.14388) 2466 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:16.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:16 smithi191 bash[24992]: cluster 2024-08-31T03:08:14.979840+0000 mgr.a (mgr.14388) 2466 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:16.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:16 smithi163 bash[24253]: cluster 2024-08-31T03:08:14.979840+0000 mgr.a (mgr.14388) 2466 : cluster [DBG] pgmap v1708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:17.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:17.856 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:17.856 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:18 smithi027 bash[22610]: cluster 2024-08-31T03:08:16.980593+0000 mgr.a (mgr.14388) 2467 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:18 smithi191 bash[24992]: cluster 2024-08-31T03:08:16.980593+0000 mgr.a (mgr.14388) 2467 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:18.596 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:18.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:18.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:18.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:18.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:18.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:18 smithi163 bash[24253]: cluster 2024-08-31T03:08:16.980593+0000 mgr.a (mgr.14388) 2467 : cluster [DBG] pgmap v1709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:19 smithi027 bash[22610]: audit 2024-08-31T03:08:18.188903+0000 mgr.a (mgr.14388) 2468 : audit [DBG] from='client.65310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:19 smithi191 bash[24992]: audit 2024-08-31T03:08:18.188903+0000 mgr.a (mgr.14388) 2468 : audit [DBG] from='client.65310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:19.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:19 smithi163 bash[24253]: audit 2024-08-31T03:08:18.188903+0000 mgr.a (mgr.14388) 2468 : audit [DBG] from='client.65310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:20 smithi191 bash[24992]: cluster 2024-08-31T03:08:18.983237+0000 mgr.a (mgr.14388) 2469 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:20.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:20 smithi163 bash[24253]: cluster 2024-08-31T03:08:18.983237+0000 mgr.a (mgr.14388) 2469 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:20 smithi027 bash[22610]: cluster 2024-08-31T03:08:18.983237+0000 mgr.a (mgr.14388) 2469 : cluster [DBG] pgmap v1710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:22 smithi191 bash[24992]: cluster 2024-08-31T03:08:20.984014+0000 mgr.a (mgr.14388) 2470 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:08:22.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:22 smithi163 bash[24253]: cluster 2024-08-31T03:08:20.984014+0000 mgr.a (mgr.14388) 2470 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:08:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:22 smithi027 bash[22610]: cluster 2024-08-31T03:08:20.984014+0000 mgr.a (mgr.14388) 2470 : cluster [DBG] pgmap v1711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:08:23.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:23.598 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:23.598 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:24.353 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:24.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:24.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:24.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:24.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:24 smithi191 bash[24992]: cluster 2024-08-31T03:08:22.985709+0000 mgr.a (mgr.14388) 2471 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:08:24.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:24 smithi163 bash[24253]: cluster 2024-08-31T03:08:22.985709+0000 mgr.a (mgr.14388) 2471 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:08:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:24 smithi027 bash[22610]: cluster 2024-08-31T03:08:22.985709+0000 mgr.a (mgr.14388) 2471 : cluster [DBG] pgmap v1712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:08:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:25 smithi191 bash[24992]: audit 2024-08-31T03:08:23.932484+0000 mgr.a (mgr.14388) 2472 : audit [DBG] from='client.65385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:25.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:25 smithi163 bash[24253]: audit 2024-08-31T03:08:23.932484+0000 mgr.a (mgr.14388) 2472 : audit [DBG] from='client.65385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:25 smithi027 bash[22610]: audit 2024-08-31T03:08:23.932484+0000 mgr.a (mgr.14388) 2472 : audit [DBG] from='client.65385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:26 smithi191 bash[24992]: cluster 2024-08-31T03:08:24.987465+0000 mgr.a (mgr.14388) 2473 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:08:26.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:26 smithi163 bash[24253]: cluster 2024-08-31T03:08:24.987465+0000 mgr.a (mgr.14388) 2473 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:08:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:26 smithi027 bash[22610]: cluster 2024-08-31T03:08:24.987465+0000 mgr.a (mgr.14388) 2473 : cluster [DBG] pgmap v1713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:08:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:28 smithi191 bash[24992]: cluster 2024-08-31T03:08:26.988220+0000 mgr.a (mgr.14388) 2474 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:08:28.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:28 smithi163 bash[24253]: cluster 2024-08-31T03:08:26.988220+0000 mgr.a (mgr.14388) 2474 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:08:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:28 smithi027 bash[22610]: cluster 2024-08-31T03:08:26.988220+0000 mgr.a (mgr.14388) 2474 : cluster [DBG] pgmap v1714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:08:29.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:29.355 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:29.355 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:30.123 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:30.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:30.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:30.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:30.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:30 smithi191 bash[24992]: cluster 2024-08-31T03:08:28.990268+0000 mgr.a (mgr.14388) 2475 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:30.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:30 smithi163 bash[24253]: cluster 2024-08-31T03:08:28.990268+0000 mgr.a (mgr.14388) 2475 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:30 smithi027 bash[22610]: cluster 2024-08-31T03:08:28.990268+0000 mgr.a (mgr.14388) 2475 : cluster [DBG] pgmap v1715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:31 smithi191 bash[24992]: audit 2024-08-31T03:08:29.693842+0000 mgr.a (mgr.14388) 2476 : audit [DBG] from='client.65460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:31.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:31 smithi163 bash[24253]: audit 2024-08-31T03:08:29.693842+0000 mgr.a (mgr.14388) 2476 : audit [DBG] from='client.65460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:31 smithi027 bash[22610]: audit 2024-08-31T03:08:29.693842+0000 mgr.a (mgr.14388) 2476 : audit [DBG] from='client.65460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:32.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:32 smithi163 bash[24253]: cluster 2024-08-31T03:08:30.991300+0000 mgr.a (mgr.14388) 2477 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:32 smithi027 bash[22610]: cluster 2024-08-31T03:08:30.991300+0000 mgr.a (mgr.14388) 2477 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:32 smithi191 bash[24992]: cluster 2024-08-31T03:08:30.991300+0000 mgr.a (mgr.14388) 2477 : cluster [DBG] pgmap v1716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:34 smithi191 bash[24992]: cluster 2024-08-31T03:08:32.993147+0000 mgr.a (mgr.14388) 2478 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:34.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:34 smithi163 bash[24253]: cluster 2024-08-31T03:08:32.993147+0000 mgr.a (mgr.14388) 2478 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:34 smithi027 bash[22610]: cluster 2024-08-31T03:08:32.993147+0000 mgr.a (mgr.14388) 2478 : cluster [DBG] pgmap v1717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:35.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:35.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:35.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:35.899 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:35.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:35.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:35.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:35.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:36 smithi191 bash[24992]: cluster 2024-08-31T03:08:34.994552+0000 mgr.a (mgr.14388) 2479 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:36 smithi191 bash[24992]: audit 2024-08-31T03:08:35.460722+0000 mgr.a (mgr.14388) 2480 : audit [DBG] from='client.65538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:36.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:36 smithi163 bash[24253]: cluster 2024-08-31T03:08:34.994552+0000 mgr.a (mgr.14388) 2479 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:36.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:36 smithi163 bash[24253]: audit 2024-08-31T03:08:35.460722+0000 mgr.a (mgr.14388) 2480 : audit [DBG] from='client.65538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:36 smithi027 bash[22610]: cluster 2024-08-31T03:08:34.994552+0000 mgr.a (mgr.14388) 2479 : cluster [DBG] pgmap v1718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:36 smithi027 bash[22610]: audit 2024-08-31T03:08:35.460722+0000 mgr.a (mgr.14388) 2480 : audit [DBG] from='client.65538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:38.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:38 smithi163 bash[24253]: cluster 2024-08-31T03:08:36.995566+0000 mgr.a (mgr.14388) 2481 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:38 smithi027 bash[22610]: cluster 2024-08-31T03:08:36.995566+0000 mgr.a (mgr.14388) 2481 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:38 smithi191 bash[24992]: cluster 2024-08-31T03:08:36.995566+0000 mgr.a (mgr.14388) 2481 : cluster [DBG] pgmap v1719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:40.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:40 smithi163 bash[24253]: cluster 2024-08-31T03:08:38.997912+0000 mgr.a (mgr.14388) 2482 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:08:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:40 smithi027 bash[22610]: cluster 2024-08-31T03:08:38.997912+0000 mgr.a (mgr.14388) 2482 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:08:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:40 smithi191 bash[24992]: cluster 2024-08-31T03:08:38.997912+0000 mgr.a (mgr.14388) 2482 : cluster [DBG] pgmap v1720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:08:40.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:40.902 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:40.902 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:41.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:41.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:41.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:41.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:41.660 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:42.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:42 smithi163 bash[24253]: cluster 2024-08-31T03:08:40.998711+0000 mgr.a (mgr.14388) 2483 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:42.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:42 smithi163 bash[24253]: audit 2024-08-31T03:08:41.237540+0000 mgr.a (mgr.14388) 2484 : audit [DBG] from='client.65616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:42 smithi027 bash[22610]: cluster 2024-08-31T03:08:40.998711+0000 mgr.a (mgr.14388) 2483 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:42 smithi027 bash[22610]: audit 2024-08-31T03:08:41.237540+0000 mgr.a (mgr.14388) 2484 : audit [DBG] from='client.65616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:42 smithi191 bash[24992]: cluster 2024-08-31T03:08:40.998711+0000 mgr.a (mgr.14388) 2483 : cluster [DBG] pgmap v1721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:42 smithi191 bash[24992]: audit 2024-08-31T03:08:41.237540+0000 mgr.a (mgr.14388) 2484 : audit [DBG] from='client.65616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:44.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:44 smithi163 bash[24253]: cluster 2024-08-31T03:08:43.000498+0000 mgr.a (mgr.14388) 2485 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:44 smithi027 bash[22610]: cluster 2024-08-31T03:08:43.000498+0000 mgr.a (mgr.14388) 2485 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:44 smithi191 bash[24992]: cluster 2024-08-31T03:08:43.000498+0000 mgr.a (mgr.14388) 2485 : cluster [DBG] pgmap v1722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:08:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:46.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:46.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:46 smithi163 bash[24253]: cluster 2024-08-31T03:08:45.001735+0000 mgr.a (mgr.14388) 2486 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:46.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:46 smithi163 bash[24253]: audit 2024-08-31T03:08:45.968975+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:08:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:46 smithi027 bash[22610]: cluster 2024-08-31T03:08:45.001735+0000 mgr.a (mgr.14388) 2486 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:46 smithi027 bash[22610]: audit 2024-08-31T03:08:45.968975+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:08:46.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:46 smithi191 bash[24992]: cluster 2024-08-31T03:08:45.001735+0000 mgr.a (mgr.14388) 2486 : cluster [DBG] pgmap v1723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:08:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:46 smithi191 bash[24992]: audit 2024-08-31T03:08:45.968975+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:08:47.395 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:47.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:47.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:47.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:47.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:47.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:47 smithi163 bash[24253]: audit 2024-08-31T03:08:46.590636+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:08:47.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:47 smithi163 bash[24253]: audit 2024-08-31T03:08:46.594230+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:08:47.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:47 smithi163 bash[24253]: audit 2024-08-31T03:08:46.985179+0000 mgr.a (mgr.14388) 2487 : audit [DBG] from='client.65694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:47.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:47 smithi163 bash[24253]: cluster 2024-08-31T03:08:47.002695+0000 mgr.a (mgr.14388) 2488 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:47.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:47 smithi163 bash[24253]: audit 2024-08-31T03:08:47.373659+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:08:47.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:47 smithi163 bash[24253]: audit 2024-08-31T03:08:47.374659+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:08:47.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:47 smithi163 bash[24253]: audit 2024-08-31T03:08:47.380521+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:08:47.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:47 smithi163 bash[24253]: audit 2024-08-31T03:08:47.383183+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:08:47.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:47 smithi163 bash[24253]: audit 2024-08-31T03:08:47.384504+0000 mgr.a (mgr.14388) 2489 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:08:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:47 smithi027 bash[22610]: audit 2024-08-31T03:08:46.590636+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:08:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:47 smithi027 bash[22610]: audit 2024-08-31T03:08:46.594230+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:08:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:47 smithi027 bash[22610]: audit 2024-08-31T03:08:46.985179+0000 mgr.a (mgr.14388) 2487 : audit [DBG] from='client.65694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:47 smithi027 bash[22610]: cluster 2024-08-31T03:08:47.002695+0000 mgr.a (mgr.14388) 2488 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:47 smithi027 bash[22610]: audit 2024-08-31T03:08:47.373659+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:08:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:47 smithi027 bash[22610]: audit 2024-08-31T03:08:47.374659+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:08:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:47 smithi027 bash[22610]: audit 2024-08-31T03:08:47.380521+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:08:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:47 smithi027 bash[22610]: audit 2024-08-31T03:08:47.383183+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:08:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:47 smithi027 bash[22610]: audit 2024-08-31T03:08:47.384504+0000 mgr.a (mgr.14388) 2489 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:08:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:47 smithi191 bash[24992]: audit 2024-08-31T03:08:46.590636+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:08:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:47 smithi191 bash[24992]: audit 2024-08-31T03:08:46.594230+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:08:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:47 smithi191 bash[24992]: audit 2024-08-31T03:08:46.985179+0000 mgr.a (mgr.14388) 2487 : audit [DBG] from='client.65694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:47 smithi191 bash[24992]: cluster 2024-08-31T03:08:47.002695+0000 mgr.a (mgr.14388) 2488 : cluster [DBG] pgmap v1724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:08:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:47 smithi191 bash[24992]: audit 2024-08-31T03:08:47.373659+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:08:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:47 smithi191 bash[24992]: audit 2024-08-31T03:08:47.374659+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:08:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:47 smithi191 bash[24992]: audit 2024-08-31T03:08:47.380521+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:08:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:47 smithi191 bash[24992]: audit 2024-08-31T03:08:47.383183+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:08:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:47 smithi191 bash[24992]: audit 2024-08-31T03:08:47.384504+0000 mgr.a (mgr.14388) 2489 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:08:48.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:08:48 smithi027 bash[22863]: debug 2024-08-31T03:08:48.063+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:08:48.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:08:48 smithi027 bash[22863]: debug 2024-08-31T03:08:48.063+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:08:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:48 smithi163 bash[24253]: audit 2024-08-31T03:08:48.068744+0000 mgr.a (mgr.14388) 2490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:08:48.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:48 smithi163 bash[24253]: cephadm 2024-08-31T03:08:48.070070+0000 mgr.a (mgr.14388) 2491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:08:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:48 smithi027 bash[22610]: audit 2024-08-31T03:08:48.068744+0000 mgr.a (mgr.14388) 2490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:08:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:48 smithi027 bash[22610]: cephadm 2024-08-31T03:08:48.070070+0000 mgr.a (mgr.14388) 2491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:08:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:48 smithi191 bash[24992]: audit 2024-08-31T03:08:48.068744+0000 mgr.a (mgr.14388) 2490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:08:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:48 smithi191 bash[24992]: cephadm 2024-08-31T03:08:48.070070+0000 mgr.a (mgr.14388) 2491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:08:49.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:49 smithi163 bash[24253]: cluster 2024-08-31T03:08:49.004997+0000 mgr.a (mgr.14388) 2492 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T03:08:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:49 smithi027 bash[22610]: cluster 2024-08-31T03:08:49.004997+0000 mgr.a (mgr.14388) 2492 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T03:08:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:49 smithi191 bash[24992]: cluster 2024-08-31T03:08:49.004997+0000 mgr.a (mgr.14388) 2492 : cluster [DBG] pgmap v1725: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T03:08:52.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:52.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:52.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:52.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:52 smithi163 bash[24253]: cluster 2024-08-31T03:08:51.005732+0000 mgr.a (mgr.14388) 2493 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T03:08:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:52 smithi027 bash[22610]: cluster 2024-08-31T03:08:51.005732+0000 mgr.a (mgr.14388) 2493 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T03:08:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:52 smithi191 bash[24992]: cluster 2024-08-31T03:08:51.005732+0000 mgr.a (mgr.14388) 2493 : cluster [DBG] pgmap v1726: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T03:08:53.140 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:53.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:53.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:53.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:53.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:54.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:54 smithi163 bash[24253]: audit 2024-08-31T03:08:52.725499+0000 mgr.a (mgr.14388) 2494 : audit [DBG] from='client.65880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:54.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:54 smithi163 bash[24253]: cluster 2024-08-31T03:08:53.006969+0000 mgr.a (mgr.14388) 2495 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:08:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:54 smithi027 bash[22610]: audit 2024-08-31T03:08:52.725499+0000 mgr.a (mgr.14388) 2494 : audit [DBG] from='client.65880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:54 smithi027 bash[22610]: cluster 2024-08-31T03:08:53.006969+0000 mgr.a (mgr.14388) 2495 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:08:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:54 smithi191 bash[24992]: audit 2024-08-31T03:08:52.725499+0000 mgr.a (mgr.14388) 2494 : audit [DBG] from='client.65880 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:54 smithi191 bash[24992]: cluster 2024-08-31T03:08:53.006969+0000 mgr.a (mgr.14388) 2495 : cluster [DBG] pgmap v1727: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:08:56.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:56 smithi163 bash[24253]: cluster 2024-08-31T03:08:55.008434+0000 mgr.a (mgr.14388) 2496 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:08:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:56 smithi027 bash[22610]: cluster 2024-08-31T03:08:55.008434+0000 mgr.a (mgr.14388) 2496 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:08:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:56 smithi191 bash[24992]: cluster 2024-08-31T03:08:55.008434+0000 mgr.a (mgr.14388) 2496 : cluster [DBG] pgmap v1728: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:08:58.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:08:58.143 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:08:58.143 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:08:58.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:58 smithi163 bash[24253]: cluster 2024-08-31T03:08:57.009195+0000 mgr.a (mgr.14388) 2497 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:08:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:58 smithi027 bash[22610]: cluster 2024-08-31T03:08:57.009195+0000 mgr.a (mgr.14388) 2497 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:08:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:58 smithi191 bash[24992]: cluster 2024-08-31T03:08:57.009195+0000 mgr.a (mgr.14388) 2497 : cluster [DBG] pgmap v1729: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:08:58.892 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:08:58.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:08:58.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:08:58.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:08:58.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:08:59.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:08:59 smithi163 bash[24253]: audit 2024-08-31T03:08:58.477127+0000 mgr.a (mgr.14388) 2498 : audit [DBG] from='client.65955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:08:59 smithi027 bash[22610]: audit 2024-08-31T03:08:58.477127+0000 mgr.a (mgr.14388) 2498 : audit [DBG] from='client.65955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:08:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:08:59 smithi191 bash[24992]: audit 2024-08-31T03:08:58.477127+0000 mgr.a (mgr.14388) 2498 : audit [DBG] from='client.65955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:00.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:00 smithi163 bash[24253]: cluster 2024-08-31T03:08:59.011866+0000 mgr.a (mgr.14388) 2499 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:09:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:00 smithi027 bash[22610]: cluster 2024-08-31T03:08:59.011866+0000 mgr.a (mgr.14388) 2499 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:09:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:00 smithi191 bash[24992]: cluster 2024-08-31T03:08:59.011866+0000 mgr.a (mgr.14388) 2499 : cluster [DBG] pgmap v1730: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:09:02.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:02 smithi163 bash[24253]: cluster 2024-08-31T03:09:01.012861+0000 mgr.a (mgr.14388) 2500 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T03:09:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:02 smithi027 bash[22610]: cluster 2024-08-31T03:09:01.012861+0000 mgr.a (mgr.14388) 2500 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T03:09:02.537 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:02 smithi191 bash[24992]: cluster 2024-08-31T03:09:01.012861+0000 mgr.a (mgr.14388) 2500 : cluster [DBG] pgmap v1731: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T03:09:03.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:09:03.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:09:03.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:09:04.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:04 smithi163 bash[24253]: cluster 2024-08-31T03:09:03.014501+0000 mgr.a (mgr.14388) 2501 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T03:09:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:04 smithi027 bash[22610]: cluster 2024-08-31T03:09:03.014501+0000 mgr.a (mgr.14388) 2501 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T03:09:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:04 smithi191 bash[24992]: cluster 2024-08-31T03:09:03.014501+0000 mgr.a (mgr.14388) 2501 : cluster [DBG] pgmap v1732: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T03:09:04.673 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:09:04.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:09:04.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:09:04.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:09:04.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:09:05.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:05 smithi163 bash[24253]: audit 2024-08-31T03:09:04.234231+0000 mgr.a (mgr.14388) 2502 : audit [DBG] from='client.66030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:05 smithi027 bash[22610]: audit 2024-08-31T03:09:04.234231+0000 mgr.a (mgr.14388) 2502 : audit [DBG] from='client.66030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:05 smithi191 bash[24992]: audit 2024-08-31T03:09:04.234231+0000 mgr.a (mgr.14388) 2502 : audit [DBG] from='client.66030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:06.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:06 smithi163 bash[24253]: cluster 2024-08-31T03:09:05.016187+0000 mgr.a (mgr.14388) 2503 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:06 smithi027 bash[22610]: cluster 2024-08-31T03:09:05.016187+0000 mgr.a (mgr.14388) 2503 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:06 smithi191 bash[24992]: cluster 2024-08-31T03:09:05.016187+0000 mgr.a (mgr.14388) 2503 : cluster [DBG] pgmap v1733: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:08.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:08 smithi163 bash[24253]: cluster 2024-08-31T03:09:07.016957+0000 mgr.a (mgr.14388) 2504 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:09:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:08 smithi027 bash[22610]: cluster 2024-08-31T03:09:07.016957+0000 mgr.a (mgr.14388) 2504 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:09:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:08 smithi191 bash[24992]: cluster 2024-08-31T03:09:07.016957+0000 mgr.a (mgr.14388) 2504 : cluster [DBG] pgmap v1734: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:09:09.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:09:09.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:09:09.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:09:10.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:09:10.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:09:10.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:09:10.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:09:10.435 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:09:10.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:10 smithi163 bash[24253]: cluster 2024-08-31T03:09:09.019006+0000 mgr.a (mgr.14388) 2505 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:10.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:10 smithi027 bash[22610]: cluster 2024-08-31T03:09:09.019006+0000 mgr.a (mgr.14388) 2505 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:10 smithi191 bash[24992]: cluster 2024-08-31T03:09:09.019006+0000 mgr.a (mgr.14388) 2505 : cluster [DBG] pgmap v1735: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:11.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:11 smithi163 bash[24253]: audit 2024-08-31T03:09:10.012229+0000 mgr.a (mgr.14388) 2506 : audit [DBG] from='client.66108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:11 smithi027 bash[22610]: audit 2024-08-31T03:09:10.012229+0000 mgr.a (mgr.14388) 2506 : audit [DBG] from='client.66108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:11 smithi191 bash[24992]: audit 2024-08-31T03:09:10.012229+0000 mgr.a (mgr.14388) 2506 : audit [DBG] from='client.66108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:12.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:12 smithi163 bash[24253]: cluster 2024-08-31T03:09:11.019960+0000 mgr.a (mgr.14388) 2507 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:12 smithi027 bash[22610]: cluster 2024-08-31T03:09:11.019960+0000 mgr.a (mgr.14388) 2507 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:12 smithi191 bash[24992]: cluster 2024-08-31T03:09:11.019960+0000 mgr.a (mgr.14388) 2507 : cluster [DBG] pgmap v1736: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:14.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:14 smithi163 bash[24253]: cluster 2024-08-31T03:09:13.021700+0000 mgr.a (mgr.14388) 2508 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:14 smithi027 bash[22610]: cluster 2024-08-31T03:09:13.021700+0000 mgr.a (mgr.14388) 2508 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:14 smithi191 bash[24992]: cluster 2024-08-31T03:09:13.021700+0000 mgr.a (mgr.14388) 2508 : cluster [DBG] pgmap v1737: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:15.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:09:15.437 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:09:15.437 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:09:16.191 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:09:16.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:09:16.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:09:16.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:09:16.192 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:09:16.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:16 smithi163 bash[24253]: cluster 2024-08-31T03:09:15.022975+0000 mgr.a (mgr.14388) 2509 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:09:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:16 smithi027 bash[22610]: cluster 2024-08-31T03:09:15.022975+0000 mgr.a (mgr.14388) 2509 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:09:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:16 smithi191 bash[24992]: cluster 2024-08-31T03:09:15.022975+0000 mgr.a (mgr.14388) 2509 : cluster [DBG] pgmap v1738: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:09:17.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:17 smithi163 bash[24253]: audit 2024-08-31T03:09:15.770538+0000 mgr.a (mgr.14388) 2510 : audit [DBG] from='client.66186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:17 smithi027 bash[22610]: audit 2024-08-31T03:09:15.770538+0000 mgr.a (mgr.14388) 2510 : audit [DBG] from='client.66186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:17 smithi191 bash[24992]: audit 2024-08-31T03:09:15.770538+0000 mgr.a (mgr.14388) 2510 : audit [DBG] from='client.66186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:18.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:18 smithi163 bash[24253]: cluster 2024-08-31T03:09:17.023919+0000 mgr.a (mgr.14388) 2511 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:18 smithi027 bash[22610]: cluster 2024-08-31T03:09:17.023919+0000 mgr.a (mgr.14388) 2511 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:18 smithi191 bash[24992]: cluster 2024-08-31T03:09:17.023919+0000 mgr.a (mgr.14388) 2511 : cluster [DBG] pgmap v1739: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:20.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:20 smithi163 bash[24253]: cluster 2024-08-31T03:09:19.026202+0000 mgr.a (mgr.14388) 2512 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:09:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:20 smithi027 bash[22610]: cluster 2024-08-31T03:09:19.026202+0000 mgr.a (mgr.14388) 2512 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:09:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:20 smithi191 bash[24992]: cluster 2024-08-31T03:09:19.026202+0000 mgr.a (mgr.14388) 2512 : cluster [DBG] pgmap v1740: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:09:21.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:09:21.194 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:09:21.194 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:09:21.943 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:09:21.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:09:21.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:09:21.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:09:21.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:09:22.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:22 smithi163 bash[24253]: cluster 2024-08-31T03:09:21.027033+0000 mgr.a (mgr.14388) 2513 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:22 smithi027 bash[22610]: cluster 2024-08-31T03:09:21.027033+0000 mgr.a (mgr.14388) 2513 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:22 smithi191 bash[24992]: cluster 2024-08-31T03:09:21.027033+0000 mgr.a (mgr.14388) 2513 : cluster [DBG] pgmap v1741: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:23.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:23 smithi163 bash[24253]: audit 2024-08-31T03:09:21.518651+0000 mgr.a (mgr.14388) 2514 : audit [DBG] from='client.66264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:23 smithi027 bash[22610]: audit 2024-08-31T03:09:21.518651+0000 mgr.a (mgr.14388) 2514 : audit [DBG] from='client.66264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:23 smithi191 bash[24992]: audit 2024-08-31T03:09:21.518651+0000 mgr.a (mgr.14388) 2514 : audit [DBG] from='client.66264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:24.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:24 smithi163 bash[24253]: cluster 2024-08-31T03:09:23.029031+0000 mgr.a (mgr.14388) 2515 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:24 smithi027 bash[22610]: cluster 2024-08-31T03:09:23.029031+0000 mgr.a (mgr.14388) 2515 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:24 smithi191 bash[24992]: cluster 2024-08-31T03:09:23.029031+0000 mgr.a (mgr.14388) 2515 : cluster [DBG] pgmap v1742: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:26.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:26 smithi163 bash[24253]: cluster 2024-08-31T03:09:25.030439+0000 mgr.a (mgr.14388) 2516 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:09:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:26 smithi027 bash[22610]: cluster 2024-08-31T03:09:25.030439+0000 mgr.a (mgr.14388) 2516 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:09:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:26 smithi191 bash[24992]: cluster 2024-08-31T03:09:25.030439+0000 mgr.a (mgr.14388) 2516 : cluster [DBG] pgmap v1743: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:09:26.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:09:26.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:09:26.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:09:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:09:27.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:09:27.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:09:27.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:09:27.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:09:28.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:28 smithi163 bash[24253]: cluster 2024-08-31T03:09:27.031368+0000 mgr.a (mgr.14388) 2517 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:28.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:28 smithi163 bash[24253]: audit 2024-08-31T03:09:27.284576+0000 mgr.a (mgr.14388) 2518 : audit [DBG] from='client.66339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:28 smithi027 bash[22610]: cluster 2024-08-31T03:09:27.031368+0000 mgr.a (mgr.14388) 2517 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:28 smithi027 bash[22610]: audit 2024-08-31T03:09:27.284576+0000 mgr.a (mgr.14388) 2518 : audit [DBG] from='client.66339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:28 smithi191 bash[24992]: cluster 2024-08-31T03:09:27.031368+0000 mgr.a (mgr.14388) 2517 : cluster [DBG] pgmap v1744: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:28 smithi191 bash[24992]: audit 2024-08-31T03:09:27.284576+0000 mgr.a (mgr.14388) 2518 : audit [DBG] from='client.66339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:30 smithi163 bash[24253]: cluster 2024-08-31T03:09:29.033927+0000 mgr.a (mgr.14388) 2519 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:09:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:30 smithi027 bash[22610]: cluster 2024-08-31T03:09:29.033927+0000 mgr.a (mgr.14388) 2519 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:09:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:30 smithi191 bash[24992]: cluster 2024-08-31T03:09:29.033927+0000 mgr.a (mgr.14388) 2519 : cluster [DBG] pgmap v1745: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:09:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:32 smithi163 bash[24253]: cluster 2024-08-31T03:09:31.034907+0000 mgr.a (mgr.14388) 2520 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:32 smithi027 bash[22610]: cluster 2024-08-31T03:09:31.034907+0000 mgr.a (mgr.14388) 2520 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:32 smithi191 bash[24992]: cluster 2024-08-31T03:09:31.034907+0000 mgr.a (mgr.14388) 2520 : cluster [DBG] pgmap v1746: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:32.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:09:32.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:09:32.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:09:33.493 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:09:33.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:09:33.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:09:33.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:09:33.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:09:34.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:34 smithi163 bash[24253]: cluster 2024-08-31T03:09:33.036589+0000 mgr.a (mgr.14388) 2521 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:34.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:34 smithi163 bash[24253]: audit 2024-08-31T03:09:33.064543+0000 mgr.a (mgr.14388) 2522 : audit [DBG] from='client.66414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:34 smithi027 bash[22610]: cluster 2024-08-31T03:09:33.036589+0000 mgr.a (mgr.14388) 2521 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:34 smithi027 bash[22610]: audit 2024-08-31T03:09:33.064543+0000 mgr.a (mgr.14388) 2522 : audit [DBG] from='client.66414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:34 smithi191 bash[24992]: cluster 2024-08-31T03:09:33.036589+0000 mgr.a (mgr.14388) 2521 : cluster [DBG] pgmap v1747: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:34 smithi191 bash[24992]: audit 2024-08-31T03:09:33.064543+0000 mgr.a (mgr.14388) 2522 : audit [DBG] from='client.66414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:36.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:36 smithi163 bash[24253]: cluster 2024-08-31T03:09:35.038456+0000 mgr.a (mgr.14388) 2523 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:09:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:36 smithi027 bash[22610]: cluster 2024-08-31T03:09:35.038456+0000 mgr.a (mgr.14388) 2523 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:09:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:36 smithi191 bash[24992]: cluster 2024-08-31T03:09:35.038456+0000 mgr.a (mgr.14388) 2523 : cluster [DBG] pgmap v1748: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:09:38.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:38 smithi163 bash[24253]: cluster 2024-08-31T03:09:37.039268+0000 mgr.a (mgr.14388) 2524 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:09:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:38 smithi027 bash[22610]: cluster 2024-08-31T03:09:37.039268+0000 mgr.a (mgr.14388) 2524 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:09:38.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:09:38.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:09:38.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:09:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:38 smithi191 bash[24992]: cluster 2024-08-31T03:09:37.039268+0000 mgr.a (mgr.14388) 2524 : cluster [DBG] pgmap v1749: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:09:39.271 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:09:39.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:09:39.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:09:39.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:09:39.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:09:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:40 smithi027 bash[22610]: audit 2024-08-31T03:09:38.834736+0000 mgr.a (mgr.14388) 2525 : audit [DBG] from='client.66489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:40 smithi027 bash[22610]: cluster 2024-08-31T03:09:39.040636+0000 mgr.a (mgr.14388) 2526 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:40 smithi191 bash[24992]: audit 2024-08-31T03:09:38.834736+0000 mgr.a (mgr.14388) 2525 : audit [DBG] from='client.66489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:40 smithi191 bash[24992]: cluster 2024-08-31T03:09:39.040636+0000 mgr.a (mgr.14388) 2526 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:40.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:40 smithi163 bash[24253]: audit 2024-08-31T03:09:38.834736+0000 mgr.a (mgr.14388) 2525 : audit [DBG] from='client.66489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:40.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:40 smithi163 bash[24253]: cluster 2024-08-31T03:09:39.040636+0000 mgr.a (mgr.14388) 2526 : cluster [DBG] pgmap v1750: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:42 smithi027 bash[22610]: cluster 2024-08-31T03:09:41.041535+0000 mgr.a (mgr.14388) 2527 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:09:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:42 smithi191 bash[24992]: cluster 2024-08-31T03:09:41.041535+0000 mgr.a (mgr.14388) 2527 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:09:42.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:42 smithi163 bash[24253]: cluster 2024-08-31T03:09:41.041535+0000 mgr.a (mgr.14388) 2527 : cluster [DBG] pgmap v1751: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:09:44.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:09:44.274 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:09:44.274 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:09:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:44 smithi027 bash[22610]: cluster 2024-08-31T03:09:43.043260+0000 mgr.a (mgr.14388) 2528 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:09:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:44 smithi191 bash[24992]: cluster 2024-08-31T03:09:43.043260+0000 mgr.a (mgr.14388) 2528 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:09:44.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:44 smithi163 bash[24253]: cluster 2024-08-31T03:09:43.043260+0000 mgr.a (mgr.14388) 2528 : cluster [DBG] pgmap v1752: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:09:45.039 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:09:45.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:09:45.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:09:45.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:09:45.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:09:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:46 smithi027 bash[22610]: audit 2024-08-31T03:09:44.613371+0000 mgr.a (mgr.14388) 2529 : audit [DBG] from='client.66564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:46 smithi027 bash[22610]: cluster 2024-08-31T03:09:45.044099+0000 mgr.a (mgr.14388) 2530 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:46 smithi191 bash[24992]: audit 2024-08-31T03:09:44.613371+0000 mgr.a (mgr.14388) 2529 : audit [DBG] from='client.66564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:46 smithi191 bash[24992]: cluster 2024-08-31T03:09:45.044099+0000 mgr.a (mgr.14388) 2530 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:46.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:46 smithi163 bash[24253]: audit 2024-08-31T03:09:44.613371+0000 mgr.a (mgr.14388) 2529 : audit [DBG] from='client.66564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:46.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:46 smithi163 bash[24253]: cluster 2024-08-31T03:09:45.044099+0000 mgr.a (mgr.14388) 2530 : cluster [DBG] pgmap v1753: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:48 smithi027 bash[22610]: cluster 2024-08-31T03:09:47.044839+0000 mgr.a (mgr.14388) 2531 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:48 smithi027 bash[22610]: audit 2024-08-31T03:09:48.124133+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:09:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:48 smithi191 bash[24992]: cluster 2024-08-31T03:09:47.044839+0000 mgr.a (mgr.14388) 2531 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:48 smithi191 bash[24992]: audit 2024-08-31T03:09:48.124133+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:09:48.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:48 smithi163 bash[24253]: cluster 2024-08-31T03:09:47.044839+0000 mgr.a (mgr.14388) 2531 : cluster [DBG] pgmap v1754: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:48.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:48 smithi163 bash[24253]: audit 2024-08-31T03:09:48.124133+0000 mon.a (mon.0) 964 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:09:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:49 smithi191 bash[24992]: audit 2024-08-31T03:09:48.741520+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:49 smithi191 bash[24992]: audit 2024-08-31T03:09:48.749400+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:49 smithi191 bash[24992]: audit 2024-08-31T03:09:48.756016+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:49 smithi191 bash[24992]: audit 2024-08-31T03:09:48.763436+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:49 smithi191 bash[24992]: cluster 2024-08-31T03:09:49.046811+0000 mgr.a (mgr.14388) 2532 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:09:50.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:09:50.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:09:50.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:09:50.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:49 smithi163 bash[24253]: audit 2024-08-31T03:09:48.741520+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:49 smithi163 bash[24253]: audit 2024-08-31T03:09:48.749400+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:49 smithi163 bash[24253]: audit 2024-08-31T03:09:48.756016+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:49 smithi163 bash[24253]: audit 2024-08-31T03:09:48.763436+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:49 smithi163 bash[24253]: cluster 2024-08-31T03:09:49.046811+0000 mgr.a (mgr.14388) 2532 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:09:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:49 smithi027 bash[22610]: audit 2024-08-31T03:09:48.741520+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:49 smithi027 bash[22610]: audit 2024-08-31T03:09:48.749400+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:49 smithi027 bash[22610]: audit 2024-08-31T03:09:48.756016+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:49 smithi027 bash[22610]: audit 2024-08-31T03:09:48.763436+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:49 smithi027 bash[22610]: cluster 2024-08-31T03:09:49.046811+0000 mgr.a (mgr.14388) 2532 : cluster [DBG] pgmap v1755: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:09:50.776 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:09:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:09:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:09:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:09:50.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:09:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:50 smithi191 bash[24992]: audit 2024-08-31T03:09:50.374250+0000 mgr.a (mgr.14388) 2533 : audit [DBG] from='client.66642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:51.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:50 smithi163 bash[24253]: audit 2024-08-31T03:09:50.374250+0000 mgr.a (mgr.14388) 2533 : audit [DBG] from='client.66642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:50 smithi027 bash[22610]: audit 2024-08-31T03:09:50.374250+0000 mgr.a (mgr.14388) 2533 : audit [DBG] from='client.66642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:51 smithi191 bash[24992]: cluster 2024-08-31T03:09:51.047713+0000 mgr.a (mgr.14388) 2534 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:52.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:51 smithi163 bash[24253]: cluster 2024-08-31T03:09:51.047713+0000 mgr.a (mgr.14388) 2534 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:51 smithi027 bash[22610]: cluster 2024-08-31T03:09:51.047713+0000 mgr.a (mgr.14388) 2534 : cluster [DBG] pgmap v1756: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:54.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:54 smithi163 bash[24253]: cluster 2024-08-31T03:09:53.049378+0000 mgr.a (mgr.14388) 2535 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:54 smithi027 bash[22610]: cluster 2024-08-31T03:09:53.049378+0000 mgr.a (mgr.14388) 2535 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:54 smithi191 bash[24992]: cluster 2024-08-31T03:09:53.049378+0000 mgr.a (mgr.14388) 2535 : cluster [DBG] pgmap v1757: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:09:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:09:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:09:55.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:09:56.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:56 smithi163 bash[24253]: cluster 2024-08-31T03:09:55.050646+0000 mgr.a (mgr.14388) 2536 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:09:56.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:56 smithi027 bash[22610]: cluster 2024-08-31T03:09:55.050646+0000 mgr.a (mgr.14388) 2536 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:09:56.508 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:09:56.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:09:56.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:09:56.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:09:56.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:09:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:56 smithi191 bash[24992]: cluster 2024-08-31T03:09:55.050646+0000 mgr.a (mgr.14388) 2536 : cluster [DBG] pgmap v1758: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:09:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:57 smithi027 bash[22610]: audit 2024-08-31T03:09:56.111022+0000 mgr.a (mgr.14388) 2537 : audit [DBG] from='client.66717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:57.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:57 smithi163 bash[24253]: audit 2024-08-31T03:09:56.111022+0000 mgr.a (mgr.14388) 2537 : audit [DBG] from='client.66717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:57 smithi191 bash[24992]: audit 2024-08-31T03:09:56.111022+0000 mgr.a (mgr.14388) 2537 : audit [DBG] from='client.66717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:09:58.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:58 smithi163 bash[24253]: cluster 2024-08-31T03:09:57.051578+0000 mgr.a (mgr.14388) 2538 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:58 smithi027 bash[22610]: cluster 2024-08-31T03:09:57.051578+0000 mgr.a (mgr.14388) 2538 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:58 smithi191 bash[24992]: cluster 2024-08-31T03:09:57.051578+0000 mgr.a (mgr.14388) 2538 : cluster [DBG] pgmap v1759: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:09:59.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:09:59 smithi027 bash[22863]: debug 2024-08-31T03:09:59.565+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:09:59.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:09:59 smithi027 bash[22863]: debug 2024-08-31T03:09:59.565+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:09:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:59 smithi027 bash[22610]: audit 2024-08-31T03:09:58.788194+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:59 smithi027 bash[22610]: audit 2024-08-31T03:09:58.796457+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:59 smithi027 bash[22610]: audit 2024-08-31T03:09:58.798906+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:09:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:59 smithi027 bash[22610]: audit 2024-08-31T03:09:58.800882+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:09:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:59 smithi027 bash[22610]: audit 2024-08-31T03:09:58.811708+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:09:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:59 smithi027 bash[22610]: audit 2024-08-31T03:09:58.816740+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:09:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:59 smithi027 bash[22610]: audit 2024-08-31T03:09:58.818479+0000 mgr.a (mgr.14388) 2539 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:09:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:09:59 smithi027 bash[22610]: cluster 2024-08-31T03:09:59.053318+0000 mgr.a (mgr.14388) 2540 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:10:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:59 smithi191 bash[24992]: audit 2024-08-31T03:09:58.788194+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:10:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:59 smithi191 bash[24992]: audit 2024-08-31T03:09:58.796457+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:10:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:59 smithi191 bash[24992]: audit 2024-08-31T03:09:58.798906+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:10:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:59 smithi191 bash[24992]: audit 2024-08-31T03:09:58.800882+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:10:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:59 smithi191 bash[24992]: audit 2024-08-31T03:09:58.811708+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:10:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:59 smithi191 bash[24992]: audit 2024-08-31T03:09:58.816740+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:10:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:59 smithi191 bash[24992]: audit 2024-08-31T03:09:58.818479+0000 mgr.a (mgr.14388) 2539 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:10:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:09:59 smithi191 bash[24992]: cluster 2024-08-31T03:09:59.053318+0000 mgr.a (mgr.14388) 2540 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:10:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:59 smithi163 bash[24253]: audit 2024-08-31T03:09:58.788194+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:10:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:59 smithi163 bash[24253]: audit 2024-08-31T03:09:58.796457+0000 mon.a (mon.0) 970 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:10:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:59 smithi163 bash[24253]: audit 2024-08-31T03:09:58.798906+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:10:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:59 smithi163 bash[24253]: audit 2024-08-31T03:09:58.800882+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:10:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:59 smithi163 bash[24253]: audit 2024-08-31T03:09:58.811708+0000 mon.a (mon.0) 973 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:10:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:59 smithi163 bash[24253]: audit 2024-08-31T03:09:58.816740+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:10:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:59 smithi163 bash[24253]: audit 2024-08-31T03:09:58.818479+0000 mgr.a (mgr.14388) 2539 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:10:00.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:09:59 smithi163 bash[24253]: cluster 2024-08-31T03:09:59.053318+0000 mgr.a (mgr.14388) 2540 : cluster [DBG] pgmap v1760: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:10:01.180 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:00 smithi027 bash[22610]: audit 2024-08-31T03:09:59.567680+0000 mgr.a (mgr.14388) 2541 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:10:01.181 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:00 smithi027 bash[22610]: cephadm 2024-08-31T03:09:59.568981+0000 mgr.a (mgr.14388) 2542 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:10:01.181 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:00 smithi027 bash[22610]: cluster 2024-08-31T03:10:00.000149+0000 mon.a (mon.0) 975 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:10:01.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:00 smithi163 bash[24253]: audit 2024-08-31T03:09:59.567680+0000 mgr.a (mgr.14388) 2541 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:10:01.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:00 smithi163 bash[24253]: cephadm 2024-08-31T03:09:59.568981+0000 mgr.a (mgr.14388) 2542 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:10:01.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:00 smithi163 bash[24253]: cluster 2024-08-31T03:10:00.000149+0000 mon.a (mon.0) 975 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:10:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:00 smithi191 bash[24992]: audit 2024-08-31T03:09:59.567680+0000 mgr.a (mgr.14388) 2541 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:10:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:00 smithi191 bash[24992]: cephadm 2024-08-31T03:09:59.568981+0000 mgr.a (mgr.14388) 2542 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:10:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:00 smithi191 bash[24992]: cluster 2024-08-31T03:10:00.000149+0000 mon.a (mon.0) 975 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:10:01.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:01.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:01.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:02.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:01 smithi163 bash[24253]: cluster 2024-08-31T03:10:01.054184+0000 mgr.a (mgr.14388) 2543 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:02.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:01 smithi027 bash[22610]: cluster 2024-08-31T03:10:01.054184+0000 mgr.a (mgr.14388) 2543 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:02.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:02.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:02.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:02.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:02.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:10:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:01 smithi191 bash[24992]: cluster 2024-08-31T03:10:01.054184+0000 mgr.a (mgr.14388) 2543 : cluster [DBG] pgmap v1761: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:03.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:02 smithi163 bash[24253]: audit 2024-08-31T03:10:01.842675+0000 mgr.a (mgr.14388) 2544 : audit [DBG] from='client.66903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:02 smithi027 bash[22610]: audit 2024-08-31T03:10:01.842675+0000 mgr.a (mgr.14388) 2544 : audit [DBG] from='client.66903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:03.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:02 smithi191 bash[24992]: audit 2024-08-31T03:10:01.842675+0000 mgr.a (mgr.14388) 2544 : audit [DBG] from='client.66903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:04.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:03 smithi163 bash[24253]: cluster 2024-08-31T03:10:03.056099+0000 mgr.a (mgr.14388) 2545 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:10:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:03 smithi027 bash[22610]: cluster 2024-08-31T03:10:03.056099+0000 mgr.a (mgr.14388) 2545 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:10:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:03 smithi191 bash[24992]: cluster 2024-08-31T03:10:03.056099+0000 mgr.a (mgr.14388) 2545 : cluster [DBG] pgmap v1762: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:10:06.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:06 smithi163 bash[24253]: cluster 2024-08-31T03:10:05.057360+0000 mgr.a (mgr.14388) 2546 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:06 smithi027 bash[22610]: cluster 2024-08-31T03:10:05.057360+0000 mgr.a (mgr.14388) 2546 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:06 smithi191 bash[24992]: cluster 2024-08-31T03:10:05.057360+0000 mgr.a (mgr.14388) 2546 : cluster [DBG] pgmap v1763: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:07.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:07.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:07.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:08.000 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:08.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:08.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:08.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:08.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:10:08.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:08 smithi163 bash[24253]: cluster 2024-08-31T03:10:07.058129+0000 mgr.a (mgr.14388) 2547 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:08 smithi027 bash[22610]: cluster 2024-08-31T03:10:07.058129+0000 mgr.a (mgr.14388) 2547 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:08 smithi191 bash[24992]: cluster 2024-08-31T03:10:07.058129+0000 mgr.a (mgr.14388) 2547 : cluster [DBG] pgmap v1764: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:09 smithi163 bash[24253]: audit 2024-08-31T03:10:07.583754+0000 mgr.a (mgr.14388) 2548 : audit [DBG] from='client.66981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:09 smithi027 bash[22610]: audit 2024-08-31T03:10:07.583754+0000 mgr.a (mgr.14388) 2548 : audit [DBG] from='client.66981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:09 smithi191 bash[24992]: audit 2024-08-31T03:10:07.583754+0000 mgr.a (mgr.14388) 2548 : audit [DBG] from='client.66981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:10.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:10 smithi163 bash[24253]: cluster 2024-08-31T03:10:09.060506+0000 mgr.a (mgr.14388) 2549 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:10 smithi027 bash[22610]: cluster 2024-08-31T03:10:09.060506+0000 mgr.a (mgr.14388) 2549 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:10 smithi191 bash[24992]: cluster 2024-08-31T03:10:09.060506+0000 mgr.a (mgr.14388) 2549 : cluster [DBG] pgmap v1765: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:12.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:12 smithi163 bash[24253]: cluster 2024-08-31T03:10:11.061297+0000 mgr.a (mgr.14388) 2550 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:10:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:12 smithi027 bash[22610]: cluster 2024-08-31T03:10:11.061297+0000 mgr.a (mgr.14388) 2550 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:10:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:12 smithi191 bash[24992]: cluster 2024-08-31T03:10:11.061297+0000 mgr.a (mgr.14388) 2550 : cluster [DBG] pgmap v1766: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:10:13.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:13.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:13.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:13.755 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:13.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:13.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:13.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:13.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:10:14.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:14 smithi163 bash[24253]: cluster 2024-08-31T03:10:13.062894+0000 mgr.a (mgr.14388) 2551 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:14.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:14 smithi163 bash[24253]: audit 2024-08-31T03:10:13.335320+0000 mgr.a (mgr.14388) 2552 : audit [DBG] from='client.67059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:14 smithi027 bash[22610]: cluster 2024-08-31T03:10:13.062894+0000 mgr.a (mgr.14388) 2551 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:14 smithi027 bash[22610]: audit 2024-08-31T03:10:13.335320+0000 mgr.a (mgr.14388) 2552 : audit [DBG] from='client.67059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:14 smithi191 bash[24992]: cluster 2024-08-31T03:10:13.062894+0000 mgr.a (mgr.14388) 2551 : cluster [DBG] pgmap v1767: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:10:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:14 smithi191 bash[24992]: audit 2024-08-31T03:10:13.335320+0000 mgr.a (mgr.14388) 2552 : audit [DBG] from='client.67059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:16.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:16 smithi163 bash[24253]: cluster 2024-08-31T03:10:15.064613+0000 mgr.a (mgr.14388) 2553 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-08-31T03:10:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:16 smithi027 bash[22610]: cluster 2024-08-31T03:10:15.064613+0000 mgr.a (mgr.14388) 2553 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-08-31T03:10:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:16 smithi191 bash[24992]: cluster 2024-08-31T03:10:15.064613+0000 mgr.a (mgr.14388) 2553 : cluster [DBG] pgmap v1768: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 2 op/s 2024-08-31T03:10:18.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:18 smithi163 bash[24253]: cluster 2024-08-31T03:10:17.065384+0000 mgr.a (mgr.14388) 2554 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:10:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:18 smithi027 bash[22610]: cluster 2024-08-31T03:10:17.065384+0000 mgr.a (mgr.14388) 2554 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:10:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:18 smithi191 bash[24992]: cluster 2024-08-31T03:10:17.065384+0000 mgr.a (mgr.14388) 2554 : cluster [DBG] pgmap v1769: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:10:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:18.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:19.492 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:19.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:19.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:19.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:19.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:10:20.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:20 smithi163 bash[24253]: cluster 2024-08-31T03:10:19.067347+0000 mgr.a (mgr.14388) 2555 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:20.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:20 smithi163 bash[24253]: audit 2024-08-31T03:10:19.080862+0000 mgr.a (mgr.14388) 2556 : audit [DBG] from='client.67137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:20 smithi027 bash[22610]: cluster 2024-08-31T03:10:19.067347+0000 mgr.a (mgr.14388) 2555 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:20 smithi027 bash[22610]: audit 2024-08-31T03:10:19.080862+0000 mgr.a (mgr.14388) 2556 : audit [DBG] from='client.67137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:20 smithi191 bash[24992]: cluster 2024-08-31T03:10:19.067347+0000 mgr.a (mgr.14388) 2555 : cluster [DBG] pgmap v1770: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:20 smithi191 bash[24992]: audit 2024-08-31T03:10:19.080862+0000 mgr.a (mgr.14388) 2556 : audit [DBG] from='client.67137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:22.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:22 smithi163 bash[24253]: cluster 2024-08-31T03:10:21.068232+0000 mgr.a (mgr.14388) 2557 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:10:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:22 smithi027 bash[22610]: cluster 2024-08-31T03:10:21.068232+0000 mgr.a (mgr.14388) 2557 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:10:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:22 smithi191 bash[24992]: cluster 2024-08-31T03:10:21.068232+0000 mgr.a (mgr.14388) 2557 : cluster [DBG] pgmap v1771: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:10:24.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:24 smithi163 bash[24253]: cluster 2024-08-31T03:10:23.069951+0000 mgr.a (mgr.14388) 2558 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:10:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:24 smithi027 bash[22610]: cluster 2024-08-31T03:10:23.069951+0000 mgr.a (mgr.14388) 2558 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:10:24.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:24.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:24.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:24 smithi191 bash[24992]: cluster 2024-08-31T03:10:23.069951+0000 mgr.a (mgr.14388) 2558 : cluster [DBG] pgmap v1772: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:10:25.266 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:25.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:10:26.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:26 smithi163 bash[24253]: audit 2024-08-31T03:10:24.833664+0000 mgr.a (mgr.14388) 2559 : audit [DBG] from='client.67209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:26.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:26 smithi163 bash[24253]: cluster 2024-08-31T03:10:25.071037+0000 mgr.a (mgr.14388) 2560 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:26 smithi027 bash[22610]: audit 2024-08-31T03:10:24.833664+0000 mgr.a (mgr.14388) 2559 : audit [DBG] from='client.67209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:26 smithi027 bash[22610]: cluster 2024-08-31T03:10:25.071037+0000 mgr.a (mgr.14388) 2560 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:26 smithi191 bash[24992]: audit 2024-08-31T03:10:24.833664+0000 mgr.a (mgr.14388) 2559 : audit [DBG] from='client.67209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:26 smithi191 bash[24992]: cluster 2024-08-31T03:10:25.071037+0000 mgr.a (mgr.14388) 2560 : cluster [DBG] pgmap v1773: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:28.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:28 smithi163 bash[24253]: cluster 2024-08-31T03:10:27.071939+0000 mgr.a (mgr.14388) 2561 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:28 smithi027 bash[22610]: cluster 2024-08-31T03:10:27.071939+0000 mgr.a (mgr.14388) 2561 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:28 smithi191 bash[24992]: cluster 2024-08-31T03:10:27.071939+0000 mgr.a (mgr.14388) 2561 : cluster [DBG] pgmap v1774: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:30.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:30.269 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:30.269 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:30.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:30 smithi163 bash[24253]: cluster 2024-08-31T03:10:29.074195+0000 mgr.a (mgr.14388) 2562 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:10:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:30 smithi027 bash[22610]: cluster 2024-08-31T03:10:29.074195+0000 mgr.a (mgr.14388) 2562 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:10:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:30 smithi191 bash[24992]: cluster 2024-08-31T03:10:29.074195+0000 mgr.a (mgr.14388) 2562 : cluster [DBG] pgmap v1775: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:10:31.049 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:31.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:31.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:31.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:10:32.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:32 smithi163 bash[24253]: audit 2024-08-31T03:10:30.612966+0000 mgr.a (mgr.14388) 2563 : audit [DBG] from='client.67287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:32.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:32 smithi163 bash[24253]: cluster 2024-08-31T03:10:31.074975+0000 mgr.a (mgr.14388) 2564 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:32 smithi027 bash[22610]: audit 2024-08-31T03:10:30.612966+0000 mgr.a (mgr.14388) 2563 : audit [DBG] from='client.67287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:32 smithi027 bash[22610]: cluster 2024-08-31T03:10:31.074975+0000 mgr.a (mgr.14388) 2564 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:32 smithi191 bash[24992]: audit 2024-08-31T03:10:30.612966+0000 mgr.a (mgr.14388) 2563 : audit [DBG] from='client.67287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:32 smithi191 bash[24992]: cluster 2024-08-31T03:10:31.074975+0000 mgr.a (mgr.14388) 2564 : cluster [DBG] pgmap v1776: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:34.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:34 smithi163 bash[24253]: cluster 2024-08-31T03:10:33.076653+0000 mgr.a (mgr.14388) 2565 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:10:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:34 smithi027 bash[22610]: cluster 2024-08-31T03:10:33.076653+0000 mgr.a (mgr.14388) 2565 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:10:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:34 smithi191 bash[24992]: cluster 2024-08-31T03:10:33.076653+0000 mgr.a (mgr.14388) 2565 : cluster [DBG] pgmap v1777: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:10:36.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:36.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:36.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:36.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:36 smithi163 bash[24253]: cluster 2024-08-31T03:10:35.077921+0000 mgr.a (mgr.14388) 2566 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:10:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:36 smithi027 bash[22610]: cluster 2024-08-31T03:10:35.077921+0000 mgr.a (mgr.14388) 2566 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:10:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:36 smithi191 bash[24992]: cluster 2024-08-31T03:10:35.077921+0000 mgr.a (mgr.14388) 2566 : cluster [DBG] pgmap v1778: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:10:36.832 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:36.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:36.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:36.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:36.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:10:37.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:37 smithi163 bash[24253]: audit 2024-08-31T03:10:36.388620+0000 mgr.a (mgr.14388) 2567 : audit [DBG] from='client.67365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:37 smithi027 bash[22610]: audit 2024-08-31T03:10:36.388620+0000 mgr.a (mgr.14388) 2567 : audit [DBG] from='client.67365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:37 smithi191 bash[24992]: audit 2024-08-31T03:10:36.388620+0000 mgr.a (mgr.14388) 2567 : audit [DBG] from='client.67365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:38.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:38 smithi163 bash[24253]: cluster 2024-08-31T03:10:37.078872+0000 mgr.a (mgr.14388) 2568 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:38 smithi027 bash[22610]: cluster 2024-08-31T03:10:37.078872+0000 mgr.a (mgr.14388) 2568 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:38 smithi191 bash[24992]: cluster 2024-08-31T03:10:37.078872+0000 mgr.a (mgr.14388) 2568 : cluster [DBG] pgmap v1779: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:40 smithi027 bash[22610]: cluster 2024-08-31T03:10:39.081115+0000 mgr.a (mgr.14388) 2569 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:10:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:40 smithi191 bash[24992]: cluster 2024-08-31T03:10:39.081115+0000 mgr.a (mgr.14388) 2569 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:10:40.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:40 smithi163 bash[24253]: cluster 2024-08-31T03:10:39.081115+0000 mgr.a (mgr.14388) 2569 : cluster [DBG] pgmap v1780: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:10:41.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:41.835 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:41.835 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:42 smithi027 bash[22610]: cluster 2024-08-31T03:10:41.081876+0000 mgr.a (mgr.14388) 2570 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:42 smithi191 bash[24992]: cluster 2024-08-31T03:10:41.081876+0000 mgr.a (mgr.14388) 2570 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:42.612 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:42.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:10:42.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:42 smithi163 bash[24253]: cluster 2024-08-31T03:10:41.081876+0000 mgr.a (mgr.14388) 2570 : cluster [DBG] pgmap v1781: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:43 smithi027 bash[22610]: audit 2024-08-31T03:10:42.170532+0000 mgr.a (mgr.14388) 2571 : audit [DBG] from='client.67443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:43 smithi191 bash[24992]: audit 2024-08-31T03:10:42.170532+0000 mgr.a (mgr.14388) 2571 : audit [DBG] from='client.67443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:43.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:43 smithi163 bash[24253]: audit 2024-08-31T03:10:42.170532+0000 mgr.a (mgr.14388) 2571 : audit [DBG] from='client.67443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:44 smithi027 bash[22610]: cluster 2024-08-31T03:10:43.083774+0000 mgr.a (mgr.14388) 2572 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:10:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:44 smithi191 bash[24992]: cluster 2024-08-31T03:10:43.083774+0000 mgr.a (mgr.14388) 2572 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:10:44.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:44 smithi163 bash[24253]: cluster 2024-08-31T03:10:43.083774+0000 mgr.a (mgr.14388) 2572 : cluster [DBG] pgmap v1782: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:10:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:46 smithi027 bash[22610]: cluster 2024-08-31T03:10:45.085048+0000 mgr.a (mgr.14388) 2573 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:10:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:46 smithi191 bash[24992]: cluster 2024-08-31T03:10:45.085048+0000 mgr.a (mgr.14388) 2573 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:10:46.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:46 smithi163 bash[24253]: cluster 2024-08-31T03:10:45.085048+0000 mgr.a (mgr.14388) 2573 : cluster [DBG] pgmap v1783: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:10:47.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:47.614 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:47.614 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:48.391 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:48.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:48.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:48.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:48.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:10:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:48 smithi027 bash[22610]: cluster 2024-08-31T03:10:47.085849+0000 mgr.a (mgr.14388) 2574 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:48 smithi191 bash[24992]: cluster 2024-08-31T03:10:47.085849+0000 mgr.a (mgr.14388) 2574 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:48.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:48 smithi163 bash[24253]: cluster 2024-08-31T03:10:47.085849+0000 mgr.a (mgr.14388) 2574 : cluster [DBG] pgmap v1784: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:49 smithi191 bash[24992]: audit 2024-08-31T03:10:47.948132+0000 mgr.a (mgr.14388) 2575 : audit [DBG] from='client.67518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:49.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:49 smithi163 bash[24253]: audit 2024-08-31T03:10:47.948132+0000 mgr.a (mgr.14388) 2575 : audit [DBG] from='client.67518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:49 smithi027 bash[22610]: audit 2024-08-31T03:10:47.948132+0000 mgr.a (mgr.14388) 2575 : audit [DBG] from='client.67518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:50 smithi191 bash[24992]: cluster 2024-08-31T03:10:49.088669+0000 mgr.a (mgr.14388) 2576 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:50.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:50 smithi163 bash[24253]: cluster 2024-08-31T03:10:49.088669+0000 mgr.a (mgr.14388) 2576 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:50 smithi027 bash[22610]: cluster 2024-08-31T03:10:49.088669+0000 mgr.a (mgr.14388) 2576 : cluster [DBG] pgmap v1785: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:10:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:52 smithi191 bash[24992]: cluster 2024-08-31T03:10:51.089449+0000 mgr.a (mgr.14388) 2577 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:10:52.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:52 smithi163 bash[24253]: cluster 2024-08-31T03:10:51.089449+0000 mgr.a (mgr.14388) 2577 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:10:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:52 smithi027 bash[22610]: cluster 2024-08-31T03:10:51.089449+0000 mgr.a (mgr.14388) 2577 : cluster [DBG] pgmap v1786: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:10:53.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:53.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:53.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:54.135 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:54.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:54.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:54.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:54.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:10:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:54 smithi191 bash[24992]: cluster 2024-08-31T03:10:53.090995+0000 mgr.a (mgr.14388) 2578 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:10:54.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:54 smithi163 bash[24253]: cluster 2024-08-31T03:10:53.090995+0000 mgr.a (mgr.14388) 2578 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:10:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:54 smithi027 bash[22610]: cluster 2024-08-31T03:10:53.090995+0000 mgr.a (mgr.14388) 2578 : cluster [DBG] pgmap v1787: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:10:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:55 smithi191 bash[24992]: audit 2024-08-31T03:10:53.726989+0000 mgr.a (mgr.14388) 2579 : audit [DBG] from='client.67593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:55.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:55 smithi163 bash[24253]: audit 2024-08-31T03:10:53.726989+0000 mgr.a (mgr.14388) 2579 : audit [DBG] from='client.67593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:55 smithi027 bash[22610]: audit 2024-08-31T03:10:53.726989+0000 mgr.a (mgr.14388) 2579 : audit [DBG] from='client.67593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:10:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:56 smithi191 bash[24992]: cluster 2024-08-31T03:10:55.092727+0000 mgr.a (mgr.14388) 2580 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:10:56.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:56 smithi163 bash[24253]: cluster 2024-08-31T03:10:55.092727+0000 mgr.a (mgr.14388) 2580 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:10:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:56 smithi027 bash[22610]: cluster 2024-08-31T03:10:55.092727+0000 mgr.a (mgr.14388) 2580 : cluster [DBG] pgmap v1788: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:10:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:10:58 smithi191 bash[24992]: cluster 2024-08-31T03:10:57.093533+0000 mgr.a (mgr.14388) 2581 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:10:58.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:10:58 smithi163 bash[24253]: cluster 2024-08-31T03:10:57.093533+0000 mgr.a (mgr.14388) 2581 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:10:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:10:58 smithi027 bash[22610]: cluster 2024-08-31T03:10:57.093533+0000 mgr.a (mgr.14388) 2581 : cluster [DBG] pgmap v1789: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:10:59.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:10:59.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:10:59.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:10:59.920 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:10:59.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:10:59.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:10:59.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:10:59.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:00 smithi191 bash[24992]: cluster 2024-08-31T03:10:59.095602+0000 mgr.a (mgr.14388) 2582 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:00 smithi191 bash[24992]: audit 2024-08-31T03:10:59.476626+0000 mgr.a (mgr.14388) 2583 : audit [DBG] from='client.67671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:00 smithi191 bash[24992]: audit 2024-08-31T03:10:59.622450+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:11:00.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:00 smithi163 bash[24253]: cluster 2024-08-31T03:10:59.095602+0000 mgr.a (mgr.14388) 2582 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:00.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:00 smithi163 bash[24253]: audit 2024-08-31T03:10:59.476626+0000 mgr.a (mgr.14388) 2583 : audit [DBG] from='client.67671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:00.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:00 smithi163 bash[24253]: audit 2024-08-31T03:10:59.622450+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:11:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:00 smithi027 bash[22610]: cluster 2024-08-31T03:10:59.095602+0000 mgr.a (mgr.14388) 2582 : cluster [DBG] pgmap v1790: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:00 smithi027 bash[22610]: audit 2024-08-31T03:10:59.476626+0000 mgr.a (mgr.14388) 2583 : audit [DBG] from='client.67671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:00 smithi027 bash[22610]: audit 2024-08-31T03:10:59.622450+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:11:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:02 smithi191 bash[24992]: cluster 2024-08-31T03:11:01.096494+0000 mgr.a (mgr.14388) 2584 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:02.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:02 smithi163 bash[24253]: cluster 2024-08-31T03:11:01.096494+0000 mgr.a (mgr.14388) 2584 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:02 smithi027 bash[22610]: cluster 2024-08-31T03:11:01.096494+0000 mgr.a (mgr.14388) 2584 : cluster [DBG] pgmap v1791: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:04 smithi191 bash[24992]: cluster 2024-08-31T03:11:03.098231+0000 mgr.a (mgr.14388) 2585 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:11:04.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:04 smithi163 bash[24253]: cluster 2024-08-31T03:11:03.098231+0000 mgr.a (mgr.14388) 2585 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:11:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:04 smithi027 bash[22610]: cluster 2024-08-31T03:11:03.098231+0000 mgr.a (mgr.14388) 2585 : cluster [DBG] pgmap v1792: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:11:04.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:11:04.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:11:04.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:11:05.694 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:11:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:11:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:11:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:11:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:06 smithi191 bash[24992]: cluster 2024-08-31T03:11:05.099459+0000 mgr.a (mgr.14388) 2586 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:11:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:06 smithi191 bash[24992]: audit 2024-08-31T03:11:05.263098+0000 mgr.a (mgr.14388) 2587 : audit [DBG] from='client.67749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:06.578 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:06 smithi163 bash[24253]: cluster 2024-08-31T03:11:05.099459+0000 mgr.a (mgr.14388) 2586 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:11:06.578 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:06 smithi163 bash[24253]: audit 2024-08-31T03:11:05.263098+0000 mgr.a (mgr.14388) 2587 : audit [DBG] from='client.67749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:06 smithi027 bash[22610]: cluster 2024-08-31T03:11:05.099459+0000 mgr.a (mgr.14388) 2586 : cluster [DBG] pgmap v1793: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:11:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:06 smithi027 bash[22610]: audit 2024-08-31T03:11:05.263098+0000 mgr.a (mgr.14388) 2587 : audit [DBG] from='client.67749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:08 smithi191 bash[24992]: cluster 2024-08-31T03:11:07.100351+0000 mgr.a (mgr.14388) 2588 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:08.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:08 smithi163 bash[24253]: cluster 2024-08-31T03:11:07.100351+0000 mgr.a (mgr.14388) 2588 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:08 smithi027 bash[22610]: cluster 2024-08-31T03:11:07.100351+0000 mgr.a (mgr.14388) 2588 : cluster [DBG] pgmap v1794: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:10.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:11:10.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:11:10.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:11:10.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:10 smithi163 bash[24253]: cluster 2024-08-31T03:11:09.102582+0000 mgr.a (mgr.14388) 2589 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:11:10.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:10 smithi163 bash[24253]: audit 2024-08-31T03:11:09.790801+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:10.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:10 smithi163 bash[24253]: audit 2024-08-31T03:11:09.798903+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:10.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:10 smithi027 bash[22610]: cluster 2024-08-31T03:11:09.102582+0000 mgr.a (mgr.14388) 2589 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:11:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:10 smithi027 bash[22610]: audit 2024-08-31T03:11:09.790801+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:10 smithi027 bash[22610]: audit 2024-08-31T03:11:09.798903+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:10 smithi191 bash[24992]: cluster 2024-08-31T03:11:09.102582+0000 mgr.a (mgr.14388) 2589 : cluster [DBG] pgmap v1795: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:11:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:10 smithi191 bash[24992]: audit 2024-08-31T03:11:09.790801+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:10 smithi191 bash[24992]: audit 2024-08-31T03:11:09.798903+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:11.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:11:11 smithi027 bash[22863]: debug 2024-08-31T03:11:11.083+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:11:11.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:11:11 smithi027 bash[22863]: debug 2024-08-31T03:11:11.091+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:11:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:11 smithi027 bash[22610]: audit 2024-08-31T03:11:10.293703+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:11 smithi027 bash[22610]: audit 2024-08-31T03:11:10.309677+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:11 smithi027 bash[22610]: audit 2024-08-31T03:11:10.312006+0000 mon.a (mon.0) 981 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:11:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:11 smithi027 bash[22610]: audit 2024-08-31T03:11:10.313900+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:11:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:11 smithi027 bash[22610]: audit 2024-08-31T03:11:10.324293+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:11 smithi027 bash[22610]: audit 2024-08-31T03:11:10.329595+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:11:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:11 smithi027 bash[22610]: audit 2024-08-31T03:11:10.331944+0000 mgr.a (mgr.14388) 2590 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:11:11.492 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:11:11.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:11:11.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:11:11.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:11:11.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:11.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:11 smithi163 bash[24253]: audit 2024-08-31T03:11:10.293703+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:11.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:11 smithi163 bash[24253]: audit 2024-08-31T03:11:10.309677+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:11.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:11 smithi163 bash[24253]: audit 2024-08-31T03:11:10.312006+0000 mon.a (mon.0) 981 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:11:11.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:11 smithi163 bash[24253]: audit 2024-08-31T03:11:10.313900+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:11:11.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:11 smithi163 bash[24253]: audit 2024-08-31T03:11:10.324293+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:11.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:11 smithi163 bash[24253]: audit 2024-08-31T03:11:10.329595+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:11:11.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:11 smithi163 bash[24253]: audit 2024-08-31T03:11:10.331944+0000 mgr.a (mgr.14388) 2590 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:11:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:11 smithi191 bash[24992]: audit 2024-08-31T03:11:10.293703+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:11 smithi191 bash[24992]: audit 2024-08-31T03:11:10.309677+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:11 smithi191 bash[24992]: audit 2024-08-31T03:11:10.312006+0000 mon.a (mon.0) 981 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:11:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:11 smithi191 bash[24992]: audit 2024-08-31T03:11:10.313900+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:11:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:11 smithi191 bash[24992]: audit 2024-08-31T03:11:10.324293+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:11:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:11 smithi191 bash[24992]: audit 2024-08-31T03:11:10.329595+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:11:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:11 smithi191 bash[24992]: audit 2024-08-31T03:11:10.331944+0000 mgr.a (mgr.14388) 2590 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:11:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:12 smithi163 bash[24253]: audit 2024-08-31T03:11:11.030596+0000 mgr.a (mgr.14388) 2591 : audit [DBG] from='client.67893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:12 smithi163 bash[24253]: audit 2024-08-31T03:11:11.088500+0000 mgr.a (mgr.14388) 2592 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:11:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:12 smithi163 bash[24253]: cephadm 2024-08-31T03:11:11.098624+0000 mgr.a (mgr.14388) 2593 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:11:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:12 smithi163 bash[24253]: cluster 2024-08-31T03:11:11.103217+0000 mgr.a (mgr.14388) 2594 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:12 smithi027 bash[22610]: audit 2024-08-31T03:11:11.030596+0000 mgr.a (mgr.14388) 2591 : audit [DBG] from='client.67893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:12 smithi027 bash[22610]: audit 2024-08-31T03:11:11.088500+0000 mgr.a (mgr.14388) 2592 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:11:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:12 smithi027 bash[22610]: cephadm 2024-08-31T03:11:11.098624+0000 mgr.a (mgr.14388) 2593 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:11:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:12 smithi027 bash[22610]: cluster 2024-08-31T03:11:11.103217+0000 mgr.a (mgr.14388) 2594 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:12 smithi191 bash[24992]: audit 2024-08-31T03:11:11.030596+0000 mgr.a (mgr.14388) 2591 : audit [DBG] from='client.67893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:12 smithi191 bash[24992]: audit 2024-08-31T03:11:11.088500+0000 mgr.a (mgr.14388) 2592 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:11:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:12 smithi191 bash[24992]: cephadm 2024-08-31T03:11:11.098624+0000 mgr.a (mgr.14388) 2593 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:11:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:12 smithi191 bash[24992]: cluster 2024-08-31T03:11:11.103217+0000 mgr.a (mgr.14388) 2594 : cluster [DBG] pgmap v1796: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:14.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:14 smithi163 bash[24253]: cluster 2024-08-31T03:11:13.105020+0000 mgr.a (mgr.14388) 2595 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:11:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:14 smithi027 bash[22610]: cluster 2024-08-31T03:11:13.105020+0000 mgr.a (mgr.14388) 2595 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:11:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:14 smithi191 bash[24992]: cluster 2024-08-31T03:11:13.105020+0000 mgr.a (mgr.14388) 2595 : cluster [DBG] pgmap v1797: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:11:16.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:11:16.494 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:11:16.494 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:11:16.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:16 smithi163 bash[24253]: cluster 2024-08-31T03:11:15.106333+0000 mgr.a (mgr.14388) 2596 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:16 smithi027 bash[22610]: cluster 2024-08-31T03:11:15.106333+0000 mgr.a (mgr.14388) 2596 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:16 smithi191 bash[24992]: cluster 2024-08-31T03:11:15.106333+0000 mgr.a (mgr.14388) 2596 : cluster [DBG] pgmap v1798: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:17.231 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:11:17.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:11:17.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:11:17.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:11:17.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:18.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:18 smithi163 bash[24253]: audit 2024-08-31T03:11:16.826231+0000 mgr.a (mgr.14388) 2597 : audit [DBG] from='client.68007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:18.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:18 smithi163 bash[24253]: cluster 2024-08-31T03:11:17.106861+0000 mgr.a (mgr.14388) 2598 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:18 smithi027 bash[22610]: audit 2024-08-31T03:11:16.826231+0000 mgr.a (mgr.14388) 2597 : audit [DBG] from='client.68007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:18 smithi027 bash[22610]: cluster 2024-08-31T03:11:17.106861+0000 mgr.a (mgr.14388) 2598 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:18 smithi191 bash[24992]: audit 2024-08-31T03:11:16.826231+0000 mgr.a (mgr.14388) 2597 : audit [DBG] from='client.68007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:18 smithi191 bash[24992]: cluster 2024-08-31T03:11:17.106861+0000 mgr.a (mgr.14388) 2598 : cluster [DBG] pgmap v1799: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:20.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:20 smithi163 bash[24253]: cluster 2024-08-31T03:11:19.109111+0000 mgr.a (mgr.14388) 2599 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:20 smithi027 bash[22610]: cluster 2024-08-31T03:11:19.109111+0000 mgr.a (mgr.14388) 2599 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:20 smithi191 bash[24992]: cluster 2024-08-31T03:11:19.109111+0000 mgr.a (mgr.14388) 2599 : cluster [DBG] pgmap v1800: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:22.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:11:22.233 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:11:22.233 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:11:22.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:22 smithi163 bash[24253]: cluster 2024-08-31T03:11:21.109860+0000 mgr.a (mgr.14388) 2600 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:22 smithi027 bash[22610]: cluster 2024-08-31T03:11:21.109860+0000 mgr.a (mgr.14388) 2600 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:22 smithi191 bash[24992]: cluster 2024-08-31T03:11:21.109860+0000 mgr.a (mgr.14388) 2600 : cluster [DBG] pgmap v1801: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:22.986 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:11:22.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:11:22.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:11:22.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:11:22.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:24.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:24 smithi163 bash[24253]: audit 2024-08-31T03:11:22.568345+0000 mgr.a (mgr.14388) 2601 : audit [DBG] from='client.68082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:24.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:24 smithi163 bash[24253]: cluster 2024-08-31T03:11:23.111771+0000 mgr.a (mgr.14388) 2602 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:24 smithi027 bash[22610]: audit 2024-08-31T03:11:22.568345+0000 mgr.a (mgr.14388) 2601 : audit [DBG] from='client.68082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:24 smithi027 bash[22610]: cluster 2024-08-31T03:11:23.111771+0000 mgr.a (mgr.14388) 2602 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:24 smithi191 bash[24992]: audit 2024-08-31T03:11:22.568345+0000 mgr.a (mgr.14388) 2601 : audit [DBG] from='client.68082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:24 smithi191 bash[24992]: cluster 2024-08-31T03:11:23.111771+0000 mgr.a (mgr.14388) 2602 : cluster [DBG] pgmap v1802: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:11:26.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:26 smithi163 bash[24253]: cluster 2024-08-31T03:11:25.113083+0000 mgr.a (mgr.14388) 2603 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T03:11:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:26 smithi027 bash[22610]: cluster 2024-08-31T03:11:25.113083+0000 mgr.a (mgr.14388) 2603 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T03:11:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:26 smithi191 bash[24992]: cluster 2024-08-31T03:11:25.113083+0000 mgr.a (mgr.14388) 2603 : cluster [DBG] pgmap v1803: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T03:11:27.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:11:27.988 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:11:27.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:11:28.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:28 smithi163 bash[24253]: cluster 2024-08-31T03:11:27.114000+0000 mgr.a (mgr.14388) 2604 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:11:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:28 smithi027 bash[22610]: cluster 2024-08-31T03:11:27.114000+0000 mgr.a (mgr.14388) 2604 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:11:28.765 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:11:28.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:11:28.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:11:28.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:11:28.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:28 smithi191 bash[24992]: cluster 2024-08-31T03:11:27.114000+0000 mgr.a (mgr.14388) 2604 : cluster [DBG] pgmap v1804: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:11:29.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:29 smithi163 bash[24253]: audit 2024-08-31T03:11:28.326418+0000 mgr.a (mgr.14388) 2605 : audit [DBG] from='client.68160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:29 smithi027 bash[22610]: audit 2024-08-31T03:11:28.326418+0000 mgr.a (mgr.14388) 2605 : audit [DBG] from='client.68160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:29 smithi191 bash[24992]: audit 2024-08-31T03:11:28.326418+0000 mgr.a (mgr.14388) 2605 : audit [DBG] from='client.68160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:30.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:30 smithi163 bash[24253]: cluster 2024-08-31T03:11:29.116981+0000 mgr.a (mgr.14388) 2606 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:30 smithi027 bash[22610]: cluster 2024-08-31T03:11:29.116981+0000 mgr.a (mgr.14388) 2606 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:30 smithi191 bash[24992]: cluster 2024-08-31T03:11:29.116981+0000 mgr.a (mgr.14388) 2606 : cluster [DBG] pgmap v1805: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:32.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:32 smithi163 bash[24253]: cluster 2024-08-31T03:11:31.117816+0000 mgr.a (mgr.14388) 2607 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:11:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:32 smithi027 bash[22610]: cluster 2024-08-31T03:11:31.117816+0000 mgr.a (mgr.14388) 2607 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:11:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:32 smithi191 bash[24992]: cluster 2024-08-31T03:11:31.117816+0000 mgr.a (mgr.14388) 2607 : cluster [DBG] pgmap v1806: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:11:33.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:11:33.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:11:33.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:11:34.517 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:11:34.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:11:34.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:11:34.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:11:34.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:34.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:34 smithi163 bash[24253]: cluster 2024-08-31T03:11:33.119367+0000 mgr.a (mgr.14388) 2608 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:11:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:34 smithi027 bash[22610]: cluster 2024-08-31T03:11:33.119367+0000 mgr.a (mgr.14388) 2608 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:11:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:34 smithi191 bash[24992]: cluster 2024-08-31T03:11:33.119367+0000 mgr.a (mgr.14388) 2608 : cluster [DBG] pgmap v1807: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:11:35.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:35 smithi163 bash[24253]: audit 2024-08-31T03:11:34.100691+0000 mgr.a (mgr.14388) 2609 : audit [DBG] from='client.68238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:35 smithi027 bash[22610]: audit 2024-08-31T03:11:34.100691+0000 mgr.a (mgr.14388) 2609 : audit [DBG] from='client.68238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:35 smithi191 bash[24992]: audit 2024-08-31T03:11:34.100691+0000 mgr.a (mgr.14388) 2609 : audit [DBG] from='client.68238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:36.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:36 smithi163 bash[24253]: cluster 2024-08-31T03:11:35.121070+0000 mgr.a (mgr.14388) 2610 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:11:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:36 smithi027 bash[22610]: cluster 2024-08-31T03:11:35.121070+0000 mgr.a (mgr.14388) 2610 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:11:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:36 smithi191 bash[24992]: cluster 2024-08-31T03:11:35.121070+0000 mgr.a (mgr.14388) 2610 : cluster [DBG] pgmap v1808: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:11:38.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:38 smithi163 bash[24253]: cluster 2024-08-31T03:11:37.121866+0000 mgr.a (mgr.14388) 2611 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:11:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:38 smithi027 bash[22610]: cluster 2024-08-31T03:11:37.121866+0000 mgr.a (mgr.14388) 2611 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:11:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:38 smithi191 bash[24992]: cluster 2024-08-31T03:11:37.121866+0000 mgr.a (mgr.14388) 2611 : cluster [DBG] pgmap v1809: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T03:11:39.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:11:39.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:11:39.520 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:11:40.284 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:11:40.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:11:40.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:11:40.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:11:40.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:40.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:40 smithi163 bash[24253]: cluster 2024-08-31T03:11:39.123961+0000 mgr.a (mgr.14388) 2612 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:11:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:40 smithi027 bash[22610]: cluster 2024-08-31T03:11:39.123961+0000 mgr.a (mgr.14388) 2612 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:11:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:40 smithi191 bash[24992]: cluster 2024-08-31T03:11:39.123961+0000 mgr.a (mgr.14388) 2612 : cluster [DBG] pgmap v1810: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:11:41.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:41 smithi163 bash[24253]: audit 2024-08-31T03:11:39.854839+0000 mgr.a (mgr.14388) 2613 : audit [DBG] from='client.68313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:41 smithi027 bash[22610]: audit 2024-08-31T03:11:39.854839+0000 mgr.a (mgr.14388) 2613 : audit [DBG] from='client.68313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:41 smithi191 bash[24992]: audit 2024-08-31T03:11:39.854839+0000 mgr.a (mgr.14388) 2613 : audit [DBG] from='client.68313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:42.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:42 smithi163 bash[24253]: cluster 2024-08-31T03:11:41.124849+0000 mgr.a (mgr.14388) 2614 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:42 smithi027 bash[22610]: cluster 2024-08-31T03:11:41.124849+0000 mgr.a (mgr.14388) 2614 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:42 smithi191 bash[24992]: cluster 2024-08-31T03:11:41.124849+0000 mgr.a (mgr.14388) 2614 : cluster [DBG] pgmap v1811: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:44.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:44 smithi163 bash[24253]: cluster 2024-08-31T03:11:43.126616+0000 mgr.a (mgr.14388) 2615 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:11:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:44 smithi027 bash[22610]: cluster 2024-08-31T03:11:43.126616+0000 mgr.a (mgr.14388) 2615 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:11:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:44 smithi191 bash[24992]: cluster 2024-08-31T03:11:43.126616+0000 mgr.a (mgr.14388) 2615 : cluster [DBG] pgmap v1812: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:11:45.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:11:45.286 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:11:45.286 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:11:46.036 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:11:46.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:11:46.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:11:46.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:11:46.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:46.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:46 smithi163 bash[24253]: cluster 2024-08-31T03:11:45.127931+0000 mgr.a (mgr.14388) 2616 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:11:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:46 smithi027 bash[22610]: cluster 2024-08-31T03:11:45.127931+0000 mgr.a (mgr.14388) 2616 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:11:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:46 smithi191 bash[24992]: cluster 2024-08-31T03:11:45.127931+0000 mgr.a (mgr.14388) 2616 : cluster [DBG] pgmap v1813: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:11:47.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:47 smithi163 bash[24253]: audit 2024-08-31T03:11:45.622411+0000 mgr.a (mgr.14388) 2617 : audit [DBG] from='client.68391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:47 smithi027 bash[22610]: audit 2024-08-31T03:11:45.622411+0000 mgr.a (mgr.14388) 2617 : audit [DBG] from='client.68391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:47 smithi191 bash[24992]: audit 2024-08-31T03:11:45.622411+0000 mgr.a (mgr.14388) 2617 : audit [DBG] from='client.68391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:48.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:48 smithi163 bash[24253]: cluster 2024-08-31T03:11:47.128836+0000 mgr.a (mgr.14388) 2618 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:48 smithi027 bash[22610]: cluster 2024-08-31T03:11:47.128836+0000 mgr.a (mgr.14388) 2618 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:48 smithi191 bash[24992]: cluster 2024-08-31T03:11:47.128836+0000 mgr.a (mgr.14388) 2618 : cluster [DBG] pgmap v1814: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:50.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:50 smithi163 bash[24253]: cluster 2024-08-31T03:11:49.131067+0000 mgr.a (mgr.14388) 2619 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:11:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:50 smithi027 bash[22610]: cluster 2024-08-31T03:11:49.131067+0000 mgr.a (mgr.14388) 2619 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:11:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:50 smithi191 bash[24992]: cluster 2024-08-31T03:11:49.131067+0000 mgr.a (mgr.14388) 2619 : cluster [DBG] pgmap v1815: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:11:51.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:11:51.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:11:51.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:11:51.774 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:11:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:11:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:11:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:11:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:52.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:52 smithi163 bash[24253]: cluster 2024-08-31T03:11:51.131891+0000 mgr.a (mgr.14388) 2620 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:52.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:52 smithi163 bash[24253]: audit 2024-08-31T03:11:51.369297+0000 mgr.a (mgr.14388) 2621 : audit [DBG] from='client.68466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:52 smithi027 bash[22610]: cluster 2024-08-31T03:11:51.131891+0000 mgr.a (mgr.14388) 2620 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:52 smithi027 bash[22610]: audit 2024-08-31T03:11:51.369297+0000 mgr.a (mgr.14388) 2621 : audit [DBG] from='client.68466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:52 smithi191 bash[24992]: cluster 2024-08-31T03:11:51.131891+0000 mgr.a (mgr.14388) 2620 : cluster [DBG] pgmap v1816: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:52 smithi191 bash[24992]: audit 2024-08-31T03:11:51.369297+0000 mgr.a (mgr.14388) 2621 : audit [DBG] from='client.68466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:54.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:54 smithi163 bash[24253]: cluster 2024-08-31T03:11:53.133653+0000 mgr.a (mgr.14388) 2622 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:11:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:54 smithi027 bash[22610]: cluster 2024-08-31T03:11:53.133653+0000 mgr.a (mgr.14388) 2622 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:11:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:54 smithi191 bash[24992]: cluster 2024-08-31T03:11:53.133653+0000 mgr.a (mgr.14388) 2622 : cluster [DBG] pgmap v1817: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:11:56.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:56 smithi163 bash[24253]: cluster 2024-08-31T03:11:55.135039+0000 mgr.a (mgr.14388) 2623 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:11:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:56 smithi027 bash[22610]: cluster 2024-08-31T03:11:55.135039+0000 mgr.a (mgr.14388) 2623 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:11:56.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:11:56.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:11:56.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:11:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:56 smithi191 bash[24992]: cluster 2024-08-31T03:11:55.135039+0000 mgr.a (mgr.14388) 2623 : cluster [DBG] pgmap v1818: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T03:11:57.520 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:11:57.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:11:57.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:11:57.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:11:57.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:11:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:58 smithi027 bash[22610]: audit 2024-08-31T03:11:57.110601+0000 mgr.a (mgr.14388) 2624 : audit [DBG] from='client.68544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:11:58 smithi027 bash[22610]: cluster 2024-08-31T03:11:57.136246+0000 mgr.a (mgr.14388) 2625 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:58 smithi191 bash[24992]: audit 2024-08-31T03:11:57.110601+0000 mgr.a (mgr.14388) 2624 : audit [DBG] from='client.68544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:11:58 smithi191 bash[24992]: cluster 2024-08-31T03:11:57.136246+0000 mgr.a (mgr.14388) 2625 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:11:58.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:58 smithi163 bash[24253]: audit 2024-08-31T03:11:57.110601+0000 mgr.a (mgr.14388) 2624 : audit [DBG] from='client.68544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:11:58.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:11:58 smithi163 bash[24253]: cluster 2024-08-31T03:11:57.136246+0000 mgr.a (mgr.14388) 2625 : cluster [DBG] pgmap v1819: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:00 smithi027 bash[22610]: cluster 2024-08-31T03:11:59.138544+0000 mgr.a (mgr.14388) 2626 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:12:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:00 smithi191 bash[24992]: cluster 2024-08-31T03:11:59.138544+0000 mgr.a (mgr.14388) 2626 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:12:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:00 smithi163 bash[24253]: cluster 2024-08-31T03:11:59.138544+0000 mgr.a (mgr.14388) 2626 : cluster [DBG] pgmap v1820: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:12:02.521 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:12:02.522 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:12:02.522 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:12:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:02 smithi027 bash[22610]: cluster 2024-08-31T03:12:01.139312+0000 mgr.a (mgr.14388) 2627 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:02 smithi191 bash[24992]: cluster 2024-08-31T03:12:01.139312+0000 mgr.a (mgr.14388) 2627 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:02 smithi163 bash[24253]: cluster 2024-08-31T03:12:01.139312+0000 mgr.a (mgr.14388) 2627 : cluster [DBG] pgmap v1821: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:03.302 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:12:03.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:12:03.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:12:03.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:12:03.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:12:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:04 smithi027 bash[22610]: audit 2024-08-31T03:12:02.865497+0000 mgr.a (mgr.14388) 2628 : audit [DBG] from='client.68619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:04 smithi027 bash[22610]: cluster 2024-08-31T03:12:03.140590+0000 mgr.a (mgr.14388) 2629 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:04 smithi191 bash[24992]: audit 2024-08-31T03:12:02.865497+0000 mgr.a (mgr.14388) 2628 : audit [DBG] from='client.68619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:04 smithi191 bash[24992]: cluster 2024-08-31T03:12:03.140590+0000 mgr.a (mgr.14388) 2629 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:04.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:04 smithi163 bash[24253]: audit 2024-08-31T03:12:02.865497+0000 mgr.a (mgr.14388) 2628 : audit [DBG] from='client.68619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:04.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:04 smithi163 bash[24253]: cluster 2024-08-31T03:12:03.140590+0000 mgr.a (mgr.14388) 2629 : cluster [DBG] pgmap v1822: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:06 smithi027 bash[22610]: cluster 2024-08-31T03:12:05.141449+0000 mgr.a (mgr.14388) 2630 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:12:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:06 smithi191 bash[24992]: cluster 2024-08-31T03:12:05.141449+0000 mgr.a (mgr.14388) 2630 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:12:06.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:06 smithi163 bash[24253]: cluster 2024-08-31T03:12:05.141449+0000 mgr.a (mgr.14388) 2630 : cluster [DBG] pgmap v1823: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:12:08.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:12:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:12:08.304 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:12:08.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:08 smithi027 bash[22610]: cluster 2024-08-31T03:12:07.142215+0000 mgr.a (mgr.14388) 2631 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:12:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:08 smithi191 bash[24992]: cluster 2024-08-31T03:12:07.142215+0000 mgr.a (mgr.14388) 2631 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:12:08.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:08 smithi163 bash[24253]: cluster 2024-08-31T03:12:07.142215+0000 mgr.a (mgr.14388) 2631 : cluster [DBG] pgmap v1824: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:12:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:12:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:12:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:12:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:12:09.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:12:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:10 smithi027 bash[22610]: audit 2024-08-31T03:12:08.634653+0000 mgr.a (mgr.14388) 2632 : audit [DBG] from='client.68691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:10 smithi027 bash[22610]: cluster 2024-08-31T03:12:09.144969+0000 mgr.a (mgr.14388) 2633 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:10 smithi191 bash[24992]: audit 2024-08-31T03:12:08.634653+0000 mgr.a (mgr.14388) 2632 : audit [DBG] from='client.68691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:10 smithi191 bash[24992]: cluster 2024-08-31T03:12:09.144969+0000 mgr.a (mgr.14388) 2633 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:10.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:10 smithi163 bash[24253]: audit 2024-08-31T03:12:08.634653+0000 mgr.a (mgr.14388) 2632 : audit [DBG] from='client.68691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:10.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:10 smithi163 bash[24253]: cluster 2024-08-31T03:12:09.144969+0000 mgr.a (mgr.14388) 2633 : cluster [DBG] pgmap v1825: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:11 smithi027 bash[22610]: audit 2024-08-31T03:12:11.159422+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:12:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:11 smithi191 bash[24992]: audit 2024-08-31T03:12:11.159422+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:12:11.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:11 smithi163 bash[24253]: audit 2024-08-31T03:12:11.159422+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:12:12.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:12 smithi027 bash[22610]: cluster 2024-08-31T03:12:11.145765+0000 mgr.a (mgr.14388) 2634 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:12:12.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:12 smithi027 bash[22610]: audit 2024-08-31T03:12:12.010117+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:12:12.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:12 smithi027 bash[22610]: audit 2024-08-31T03:12:12.011774+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:12:12.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:12 smithi027 bash[22610]: audit 2024-08-31T03:12:12.022251+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:12:12.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:12 smithi027 bash[22610]: audit 2024-08-31T03:12:12.027337+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:12:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:12 smithi191 bash[24992]: cluster 2024-08-31T03:12:11.145765+0000 mgr.a (mgr.14388) 2634 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:12:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:12 smithi191 bash[24992]: audit 2024-08-31T03:12:12.010117+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:12:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:12 smithi191 bash[24992]: audit 2024-08-31T03:12:12.011774+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:12:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:12 smithi191 bash[24992]: audit 2024-08-31T03:12:12.022251+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:12:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:12 smithi191 bash[24992]: audit 2024-08-31T03:12:12.027337+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:12:12.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:12 smithi163 bash[24253]: cluster 2024-08-31T03:12:11.145765+0000 mgr.a (mgr.14388) 2634 : cluster [DBG] pgmap v1826: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:12:12.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:12 smithi163 bash[24253]: audit 2024-08-31T03:12:12.010117+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:12:12.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:12 smithi163 bash[24253]: audit 2024-08-31T03:12:12.011774+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:12:12.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:12 smithi163 bash[24253]: audit 2024-08-31T03:12:12.022251+0000 mon.a (mon.0) 988 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:12:12.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:12 smithi163 bash[24253]: audit 2024-08-31T03:12:12.027337+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:12:13.244 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:12:12 smithi027 bash[22863]: debug 2024-08-31T03:12:12.734+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:12:13.244 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:12:12 smithi027 bash[22863]: debug 2024-08-31T03:12:12.734+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:12:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:13 smithi191 bash[24992]: audit 2024-08-31T03:12:12.029761+0000 mgr.a (mgr.14388) 2635 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:12:13.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:13 smithi163 bash[24253]: audit 2024-08-31T03:12:12.029761+0000 mgr.a (mgr.14388) 2635 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:12:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:13 smithi027 bash[22610]: audit 2024-08-31T03:12:12.029761+0000 mgr.a (mgr.14388) 2635 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:12:14.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:12:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:12:14.048 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:12:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:14 smithi191 bash[24992]: audit 2024-08-31T03:12:12.737114+0000 mgr.a (mgr.14388) 2636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:12:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:14 smithi191 bash[24992]: cephadm 2024-08-31T03:12:12.738445+0000 mgr.a (mgr.14388) 2637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:12:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:14 smithi191 bash[24992]: cluster 2024-08-31T03:12:13.148031+0000 mgr.a (mgr.14388) 2638 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:14.799 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:12:14.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:12:14.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:12:14.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:12:14.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:12:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:14 smithi163 bash[24253]: audit 2024-08-31T03:12:12.737114+0000 mgr.a (mgr.14388) 2636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:12:14.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:14 smithi163 bash[24253]: cephadm 2024-08-31T03:12:12.738445+0000 mgr.a (mgr.14388) 2637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:12:14.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:14 smithi163 bash[24253]: cluster 2024-08-31T03:12:13.148031+0000 mgr.a (mgr.14388) 2638 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:14 smithi027 bash[22610]: audit 2024-08-31T03:12:12.737114+0000 mgr.a (mgr.14388) 2636 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:12:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:14 smithi027 bash[22610]: cephadm 2024-08-31T03:12:12.738445+0000 mgr.a (mgr.14388) 2637 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:12:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:14 smithi027 bash[22610]: cluster 2024-08-31T03:12:13.148031+0000 mgr.a (mgr.14388) 2638 : cluster [DBG] pgmap v1827: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:15 smithi191 bash[24992]: audit 2024-08-31T03:12:14.379019+0000 mgr.a (mgr.14388) 2639 : audit [DBG] from='client.68877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:15.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:15 smithi163 bash[24253]: audit 2024-08-31T03:12:14.379019+0000 mgr.a (mgr.14388) 2639 : audit [DBG] from='client.68877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:15 smithi027 bash[22610]: audit 2024-08-31T03:12:14.379019+0000 mgr.a (mgr.14388) 2639 : audit [DBG] from='client.68877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:16 smithi191 bash[24992]: cluster 2024-08-31T03:12:15.148927+0000 mgr.a (mgr.14388) 2640 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:16 smithi163 bash[24253]: cluster 2024-08-31T03:12:15.148927+0000 mgr.a (mgr.14388) 2640 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:16 smithi027 bash[22610]: cluster 2024-08-31T03:12:15.148927+0000 mgr.a (mgr.14388) 2640 : cluster [DBG] pgmap v1828: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:18 smithi191 bash[24992]: cluster 2024-08-31T03:12:17.149710+0000 mgr.a (mgr.14388) 2641 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:18 smithi163 bash[24253]: cluster 2024-08-31T03:12:17.149710+0000 mgr.a (mgr.14388) 2641 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:18 smithi027 bash[22610]: cluster 2024-08-31T03:12:17.149710+0000 mgr.a (mgr.14388) 2641 : cluster [DBG] pgmap v1829: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:19.801 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:12:19.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:12:19.802 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:12:20.581 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:12:20.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:12:20.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:12:20.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:12:20.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:12:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:20 smithi191 bash[24992]: cluster 2024-08-31T03:12:19.151923+0000 mgr.a (mgr.14388) 2642 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:20.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:20 smithi163 bash[24253]: cluster 2024-08-31T03:12:19.151923+0000 mgr.a (mgr.14388) 2642 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:20 smithi027 bash[22610]: cluster 2024-08-31T03:12:19.151923+0000 mgr.a (mgr.14388) 2642 : cluster [DBG] pgmap v1830: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:21 smithi191 bash[24992]: audit 2024-08-31T03:12:20.159726+0000 mgr.a (mgr.14388) 2643 : audit [DBG] from='client.68955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:21.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:21 smithi163 bash[24253]: audit 2024-08-31T03:12:20.159726+0000 mgr.a (mgr.14388) 2643 : audit [DBG] from='client.68955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:21 smithi027 bash[22610]: audit 2024-08-31T03:12:20.159726+0000 mgr.a (mgr.14388) 2643 : audit [DBG] from='client.68955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:22 smithi191 bash[24992]: cluster 2024-08-31T03:12:21.152952+0000 mgr.a (mgr.14388) 2644 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:22 smithi163 bash[24253]: cluster 2024-08-31T03:12:21.152952+0000 mgr.a (mgr.14388) 2644 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:22 smithi027 bash[22610]: cluster 2024-08-31T03:12:21.152952+0000 mgr.a (mgr.14388) 2644 : cluster [DBG] pgmap v1831: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:12:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:24 smithi191 bash[24992]: cluster 2024-08-31T03:12:23.155282+0000 mgr.a (mgr.14388) 2645 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 426 B/s wr, 42 op/s 2024-08-31T03:12:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:24 smithi163 bash[24253]: cluster 2024-08-31T03:12:23.155282+0000 mgr.a (mgr.14388) 2645 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 426 B/s wr, 42 op/s 2024-08-31T03:12:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:24 smithi027 bash[22610]: cluster 2024-08-31T03:12:23.155282+0000 mgr.a (mgr.14388) 2645 : cluster [DBG] pgmap v1832: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 426 B/s wr, 42 op/s 2024-08-31T03:12:25.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:12:25.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:12:25.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:12:26.365 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:12:26.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:12:26.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:12:26.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:12:26.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:12:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:26 smithi191 bash[24992]: cluster 2024-08-31T03:12:25.156227+0000 mgr.a (mgr.14388) 2646 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 36 op/s 2024-08-31T03:12:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:26 smithi163 bash[24253]: cluster 2024-08-31T03:12:25.156227+0000 mgr.a (mgr.14388) 2646 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 36 op/s 2024-08-31T03:12:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:26 smithi027 bash[22610]: cluster 2024-08-31T03:12:25.156227+0000 mgr.a (mgr.14388) 2646 : cluster [DBG] pgmap v1833: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 36 op/s 2024-08-31T03:12:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:27 smithi163 bash[24253]: audit 2024-08-31T03:12:25.920237+0000 mgr.a (mgr.14388) 2647 : audit [DBG] from='client.69030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:27 smithi027 bash[22610]: audit 2024-08-31T03:12:25.920237+0000 mgr.a (mgr.14388) 2647 : audit [DBG] from='client.69030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:27 smithi191 bash[24992]: audit 2024-08-31T03:12:25.920237+0000 mgr.a (mgr.14388) 2647 : audit [DBG] from='client.69030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:28 smithi163 bash[24253]: cluster 2024-08-31T03:12:27.157288+0000 mgr.a (mgr.14388) 2648 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 36 op/s 2024-08-31T03:12:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:28 smithi027 bash[22610]: cluster 2024-08-31T03:12:27.157288+0000 mgr.a (mgr.14388) 2648 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 36 op/s 2024-08-31T03:12:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:28 smithi191 bash[24992]: cluster 2024-08-31T03:12:27.157288+0000 mgr.a (mgr.14388) 2648 : cluster [DBG] pgmap v1834: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 36 op/s 2024-08-31T03:12:29.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:29 smithi163 bash[24253]: cluster 2024-08-31T03:12:29.159649+0000 mgr.a (mgr.14388) 2649 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 109 op/s 2024-08-31T03:12:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:29 smithi027 bash[22610]: cluster 2024-08-31T03:12:29.159649+0000 mgr.a (mgr.14388) 2649 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 109 op/s 2024-08-31T03:12:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:29 smithi191 bash[24992]: cluster 2024-08-31T03:12:29.159649+0000 mgr.a (mgr.14388) 2649 : cluster [DBG] pgmap v1835: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 109 op/s 2024-08-31T03:12:31.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:12:31.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:12:31.368 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:12:32.133 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:12:32.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:12:32.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:12:32.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:12:32.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:12:32.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:31 smithi163 bash[24253]: cluster 2024-08-31T03:12:31.160555+0000 mgr.a (mgr.14388) 2650 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 109 op/s 2024-08-31T03:12:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:31 smithi027 bash[22610]: cluster 2024-08-31T03:12:31.160555+0000 mgr.a (mgr.14388) 2650 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 109 op/s 2024-08-31T03:12:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:31 smithi191 bash[24992]: cluster 2024-08-31T03:12:31.160555+0000 mgr.a (mgr.14388) 2650 : cluster [DBG] pgmap v1836: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 66 KiB/s rd, 0 B/s wr, 109 op/s 2024-08-31T03:12:33.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:32 smithi163 bash[24253]: audit 2024-08-31T03:12:31.701461+0000 mgr.a (mgr.14388) 2651 : audit [DBG] from='client.69105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:32 smithi027 bash[22610]: audit 2024-08-31T03:12:31.701461+0000 mgr.a (mgr.14388) 2651 : audit [DBG] from='client.69105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:32 smithi191 bash[24992]: audit 2024-08-31T03:12:31.701461+0000 mgr.a (mgr.14388) 2651 : audit [DBG] from='client.69105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:34.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:33 smithi163 bash[24253]: cluster 2024-08-31T03:12:33.162835+0000 mgr.a (mgr.14388) 2652 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 109 op/s 2024-08-31T03:12:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:33 smithi027 bash[22610]: cluster 2024-08-31T03:12:33.162835+0000 mgr.a (mgr.14388) 2652 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 109 op/s 2024-08-31T03:12:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:33 smithi191 bash[24992]: cluster 2024-08-31T03:12:33.162835+0000 mgr.a (mgr.14388) 2652 : cluster [DBG] pgmap v1837: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 67 KiB/s rd, 0 B/s wr, 109 op/s 2024-08-31T03:12:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:36 smithi027 bash[22610]: cluster 2024-08-31T03:12:35.163609+0000 mgr.a (mgr.14388) 2653 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:12:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:36 smithi191 bash[24992]: cluster 2024-08-31T03:12:35.163609+0000 mgr.a (mgr.14388) 2653 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:12:36.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:36 smithi163 bash[24253]: cluster 2024-08-31T03:12:35.163609+0000 mgr.a (mgr.14388) 2653 : cluster [DBG] pgmap v1838: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:12:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:12:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:12:37.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:12:37.896 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:12:37.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:12:37.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:12:37.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:12:37.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:12:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:38 smithi027 bash[22610]: cluster 2024-08-31T03:12:37.164405+0000 mgr.a (mgr.14388) 2654 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:12:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:38 smithi027 bash[22610]: audit 2024-08-31T03:12:37.471666+0000 mgr.a (mgr.14388) 2655 : audit [DBG] from='client.69183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:38 smithi191 bash[24992]: cluster 2024-08-31T03:12:37.164405+0000 mgr.a (mgr.14388) 2654 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:12:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:38 smithi191 bash[24992]: audit 2024-08-31T03:12:37.471666+0000 mgr.a (mgr.14388) 2655 : audit [DBG] from='client.69183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:38.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:38 smithi163 bash[24253]: cluster 2024-08-31T03:12:37.164405+0000 mgr.a (mgr.14388) 2654 : cluster [DBG] pgmap v1839: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:12:38.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:38 smithi163 bash[24253]: audit 2024-08-31T03:12:37.471666+0000 mgr.a (mgr.14388) 2655 : audit [DBG] from='client.69183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:40 smithi027 bash[22610]: cluster 2024-08-31T03:12:39.166905+0000 mgr.a (mgr.14388) 2656 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:12:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:40 smithi191 bash[24992]: cluster 2024-08-31T03:12:39.166905+0000 mgr.a (mgr.14388) 2656 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:12:40.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:40 smithi163 bash[24253]: cluster 2024-08-31T03:12:39.166905+0000 mgr.a (mgr.14388) 2656 : cluster [DBG] pgmap v1840: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 0 B/s wr, 74 op/s 2024-08-31T03:12:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:42 smithi027 bash[22610]: cluster 2024-08-31T03:12:41.167711+0000 mgr.a (mgr.14388) 2657 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:12:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:42 smithi191 bash[24992]: cluster 2024-08-31T03:12:41.167711+0000 mgr.a (mgr.14388) 2657 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:12:42.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:42 smithi163 bash[24253]: cluster 2024-08-31T03:12:41.167711+0000 mgr.a (mgr.14388) 2657 : cluster [DBG] pgmap v1841: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:12:42.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:12:42.899 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:12:42.899 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:12:43.672 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:12:43.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:12:43.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:12:43.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:12:43.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:12:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:44 smithi191 bash[24992]: cluster 2024-08-31T03:12:43.169637+0000 mgr.a (mgr.14388) 2658 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:44 smithi191 bash[24992]: audit 2024-08-31T03:12:43.234736+0000 mgr.a (mgr.14388) 2659 : audit [DBG] from='client.69261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:44.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:44 smithi163 bash[24253]: cluster 2024-08-31T03:12:43.169637+0000 mgr.a (mgr.14388) 2658 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:44.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:44 smithi163 bash[24253]: audit 2024-08-31T03:12:43.234736+0000 mgr.a (mgr.14388) 2659 : audit [DBG] from='client.69261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:44 smithi027 bash[22610]: cluster 2024-08-31T03:12:43.169637+0000 mgr.a (mgr.14388) 2658 : cluster [DBG] pgmap v1842: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:44 smithi027 bash[22610]: audit 2024-08-31T03:12:43.234736+0000 mgr.a (mgr.14388) 2659 : audit [DBG] from='client.69261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:46 smithi191 bash[24992]: cluster 2024-08-31T03:12:45.170575+0000 mgr.a (mgr.14388) 2660 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:12:46.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:46 smithi163 bash[24253]: cluster 2024-08-31T03:12:45.170575+0000 mgr.a (mgr.14388) 2660 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:12:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:46 smithi027 bash[22610]: cluster 2024-08-31T03:12:45.170575+0000 mgr.a (mgr.14388) 2660 : cluster [DBG] pgmap v1843: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:12:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:48 smithi191 bash[24992]: cluster 2024-08-31T03:12:47.171377+0000 mgr.a (mgr.14388) 2661 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:12:48.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:12:48.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:12:48.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:12:48.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:48 smithi163 bash[24253]: cluster 2024-08-31T03:12:47.171377+0000 mgr.a (mgr.14388) 2661 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:12:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:48 smithi027 bash[22610]: cluster 2024-08-31T03:12:47.171377+0000 mgr.a (mgr.14388) 2661 : cluster [DBG] pgmap v1844: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:12:49.421 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:12:49.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:12:49.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:12:49.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:12:49.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:12:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:50 smithi191 bash[24992]: audit 2024-08-31T03:12:48.999775+0000 mgr.a (mgr.14388) 2662 : audit [DBG] from='client.69336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:50 smithi191 bash[24992]: cluster 2024-08-31T03:12:49.173299+0000 mgr.a (mgr.14388) 2663 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:50.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:50 smithi163 bash[24253]: audit 2024-08-31T03:12:48.999775+0000 mgr.a (mgr.14388) 2662 : audit [DBG] from='client.69336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:50.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:50 smithi163 bash[24253]: cluster 2024-08-31T03:12:49.173299+0000 mgr.a (mgr.14388) 2663 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:50 smithi027 bash[22610]: audit 2024-08-31T03:12:48.999775+0000 mgr.a (mgr.14388) 2662 : audit [DBG] from='client.69336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:50 smithi027 bash[22610]: cluster 2024-08-31T03:12:49.173299+0000 mgr.a (mgr.14388) 2663 : cluster [DBG] pgmap v1845: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:52 smithi191 bash[24992]: cluster 2024-08-31T03:12:51.174264+0000 mgr.a (mgr.14388) 2664 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T03:12:52.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:52 smithi163 bash[24253]: cluster 2024-08-31T03:12:51.174264+0000 mgr.a (mgr.14388) 2664 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T03:12:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:52 smithi027 bash[22610]: cluster 2024-08-31T03:12:51.174264+0000 mgr.a (mgr.14388) 2664 : cluster [DBG] pgmap v1846: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T03:12:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:12:54.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:12:54.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:12:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:54 smithi191 bash[24992]: cluster 2024-08-31T03:12:53.176383+0000 mgr.a (mgr.14388) 2665 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T03:12:54.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:54 smithi163 bash[24253]: cluster 2024-08-31T03:12:53.176383+0000 mgr.a (mgr.14388) 2665 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T03:12:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:54 smithi027 bash[22610]: cluster 2024-08-31T03:12:53.176383+0000 mgr.a (mgr.14388) 2665 : cluster [DBG] pgmap v1847: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T03:12:55.201 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:12:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:12:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:12:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:12:55.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:12:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:56 smithi191 bash[24992]: audit 2024-08-31T03:12:54.760892+0000 mgr.a (mgr.14388) 2666 : audit [DBG] from='client.69414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:56 smithi191 bash[24992]: cluster 2024-08-31T03:12:55.176853+0000 mgr.a (mgr.14388) 2667 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:56.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:56 smithi163 bash[24253]: audit 2024-08-31T03:12:54.760892+0000 mgr.a (mgr.14388) 2666 : audit [DBG] from='client.69414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:56.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:56 smithi163 bash[24253]: cluster 2024-08-31T03:12:55.176853+0000 mgr.a (mgr.14388) 2667 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:56 smithi027 bash[22610]: audit 2024-08-31T03:12:54.760892+0000 mgr.a (mgr.14388) 2666 : audit [DBG] from='client.69414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:12:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:56 smithi027 bash[22610]: cluster 2024-08-31T03:12:55.176853+0000 mgr.a (mgr.14388) 2667 : cluster [DBG] pgmap v1848: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:12:58 smithi191 bash[24992]: cluster 2024-08-31T03:12:57.177562+0000 mgr.a (mgr.14388) 2668 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:58.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:12:58 smithi163 bash[24253]: cluster 2024-08-31T03:12:57.177562+0000 mgr.a (mgr.14388) 2668 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:12:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:12:58 smithi027 bash[22610]: cluster 2024-08-31T03:12:57.177562+0000 mgr.a (mgr.14388) 2668 : cluster [DBG] pgmap v1849: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:00.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:00.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:00.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:00 smithi191 bash[24992]: cluster 2024-08-31T03:12:59.179832+0000 mgr.a (mgr.14388) 2669 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:00.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:00 smithi163 bash[24253]: cluster 2024-08-31T03:12:59.179832+0000 mgr.a (mgr.14388) 2669 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:00 smithi027 bash[22610]: cluster 2024-08-31T03:12:59.179832+0000 mgr.a (mgr.14388) 2669 : cluster [DBG] pgmap v1850: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:00.963 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:00.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:00.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:01 smithi191 bash[24992]: audit 2024-08-31T03:13:00.538788+0000 mgr.a (mgr.14388) 2670 : audit [DBG] from='client.69492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:01.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:01 smithi163 bash[24253]: audit 2024-08-31T03:13:00.538788+0000 mgr.a (mgr.14388) 2670 : audit [DBG] from='client.69492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:01 smithi027 bash[22610]: audit 2024-08-31T03:13:00.538788+0000 mgr.a (mgr.14388) 2670 : audit [DBG] from='client.69492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:02 smithi191 bash[24992]: cluster 2024-08-31T03:13:01.180802+0000 mgr.a (mgr.14388) 2671 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:02.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:02 smithi163 bash[24253]: cluster 2024-08-31T03:13:01.180802+0000 mgr.a (mgr.14388) 2671 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:02 smithi027 bash[22610]: cluster 2024-08-31T03:13:01.180802+0000 mgr.a (mgr.14388) 2671 : cluster [DBG] pgmap v1851: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:04 smithi191 bash[24992]: cluster 2024-08-31T03:13:03.182945+0000 mgr.a (mgr.14388) 2672 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:04.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:04 smithi163 bash[24253]: cluster 2024-08-31T03:13:03.182945+0000 mgr.a (mgr.14388) 2672 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:04 smithi027 bash[22610]: cluster 2024-08-31T03:13:03.182945+0000 mgr.a (mgr.14388) 2672 : cluster [DBG] pgmap v1852: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:05.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:05.966 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:05.966 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:06.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:06 smithi163 bash[24253]: cluster 2024-08-31T03:13:05.183705+0000 mgr.a (mgr.14388) 2673 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:06.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:06 smithi027 bash[22610]: cluster 2024-08-31T03:13:05.183705+0000 mgr.a (mgr.14388) 2673 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:06.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:06.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:06.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:06.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:06.740 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:06 smithi191 bash[24992]: cluster 2024-08-31T03:13:05.183705+0000 mgr.a (mgr.14388) 2673 : cluster [DBG] pgmap v1853: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:07.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:07 smithi163 bash[24253]: audit 2024-08-31T03:13:06.301947+0000 mgr.a (mgr.14388) 2674 : audit [DBG] from='client.69570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:07 smithi027 bash[22610]: audit 2024-08-31T03:13:06.301947+0000 mgr.a (mgr.14388) 2674 : audit [DBG] from='client.69570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:07 smithi191 bash[24992]: audit 2024-08-31T03:13:06.301947+0000 mgr.a (mgr.14388) 2674 : audit [DBG] from='client.69570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:08.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:08 smithi163 bash[24253]: cluster 2024-08-31T03:13:07.184644+0000 mgr.a (mgr.14388) 2675 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:08 smithi027 bash[22610]: cluster 2024-08-31T03:13:07.184644+0000 mgr.a (mgr.14388) 2675 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:08 smithi191 bash[24992]: cluster 2024-08-31T03:13:07.184644+0000 mgr.a (mgr.14388) 2675 : cluster [DBG] pgmap v1854: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:10.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:10 smithi163 bash[24253]: cluster 2024-08-31T03:13:09.186937+0000 mgr.a (mgr.14388) 2676 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:10 smithi027 bash[22610]: cluster 2024-08-31T03:13:09.186937+0000 mgr.a (mgr.14388) 2676 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:10 smithi191 bash[24992]: cluster 2024-08-31T03:13:09.186937+0000 mgr.a (mgr.14388) 2676 : cluster [DBG] pgmap v1855: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:11.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:11.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:11.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:12.520 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:12.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:12.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:12.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:12.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:12 smithi163 bash[24253]: cluster 2024-08-31T03:13:11.187718+0000 mgr.a (mgr.14388) 2677 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:12 smithi027 bash[22610]: cluster 2024-08-31T03:13:11.187718+0000 mgr.a (mgr.14388) 2677 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:12 smithi191 bash[24992]: cluster 2024-08-31T03:13:11.187718+0000 mgr.a (mgr.14388) 2677 : cluster [DBG] pgmap v1856: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:13.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:13 smithi163 bash[24253]: audit 2024-08-31T03:13:12.080779+0000 mgr.a (mgr.14388) 2678 : audit [DBG] from='client.69645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:13.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:13 smithi163 bash[24253]: audit 2024-08-31T03:13:12.789381+0000 mon.a (mon.0) 990 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:13:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:13 smithi027 bash[22610]: audit 2024-08-31T03:13:12.080779+0000 mgr.a (mgr.14388) 2678 : audit [DBG] from='client.69645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:13 smithi027 bash[22610]: audit 2024-08-31T03:13:12.789381+0000 mon.a (mon.0) 990 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:13:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:13 smithi191 bash[24992]: audit 2024-08-31T03:13:12.080779+0000 mgr.a (mgr.14388) 2678 : audit [DBG] from='client.69645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:13 smithi191 bash[24992]: audit 2024-08-31T03:13:12.789381+0000 mon.a (mon.0) 990 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:13:14.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: cluster 2024-08-31T03:13:13.189997+0000 mgr.a (mgr.14388) 2679 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: audit 2024-08-31T03:13:14.123405+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: audit 2024-08-31T03:13:14.128260+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: audit 2024-08-31T03:13:14.133347+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: audit 2024-08-31T03:13:14.138033+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: audit 2024-08-31T03:13:14.142195+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: audit 2024-08-31T03:13:14.147274+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: audit 2024-08-31T03:13:14.148401+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:13:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: audit 2024-08-31T03:13:14.149209+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:13:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: audit 2024-08-31T03:13:14.155266+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:14 smithi163 bash[24253]: audit 2024-08-31T03:13:14.157961+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:13:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: cluster 2024-08-31T03:13:13.189997+0000 mgr.a (mgr.14388) 2679 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: audit 2024-08-31T03:13:14.123405+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: audit 2024-08-31T03:13:14.128260+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: audit 2024-08-31T03:13:14.133347+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: audit 2024-08-31T03:13:14.138033+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: audit 2024-08-31T03:13:14.142195+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: audit 2024-08-31T03:13:14.147274+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: audit 2024-08-31T03:13:14.148401+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:13:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: audit 2024-08-31T03:13:14.149209+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:13:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: audit 2024-08-31T03:13:14.155266+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22610]: audit 2024-08-31T03:13:14.157961+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:13:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: cluster 2024-08-31T03:13:13.189997+0000 mgr.a (mgr.14388) 2679 : cluster [DBG] pgmap v1857: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: audit 2024-08-31T03:13:14.123405+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: audit 2024-08-31T03:13:14.128260+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: audit 2024-08-31T03:13:14.133347+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: audit 2024-08-31T03:13:14.138033+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: audit 2024-08-31T03:13:14.142195+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: audit 2024-08-31T03:13:14.147274+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: audit 2024-08-31T03:13:14.148401+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:13:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: audit 2024-08-31T03:13:14.149209+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:13:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: audit 2024-08-31T03:13:14.155266+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:13:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:14 smithi191 bash[24992]: audit 2024-08-31T03:13:14.157961+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:13:15.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22863]: debug 2024-08-31T03:13:14.852+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:13:15.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:13:14 smithi027 bash[22863]: debug 2024-08-31T03:13:14.852+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:13:15.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:15 smithi163 bash[24253]: audit 2024-08-31T03:13:14.158867+0000 mgr.a (mgr.14388) 2680 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:13:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:15 smithi027 bash[22610]: audit 2024-08-31T03:13:14.158867+0000 mgr.a (mgr.14388) 2680 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:13:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:15 smithi191 bash[24992]: audit 2024-08-31T03:13:14.158867+0000 mgr.a (mgr.14388) 2680 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:13:16.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:16 smithi163 bash[24253]: audit 2024-08-31T03:13:14.856648+0000 mgr.a (mgr.14388) 2681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:13:16.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:16 smithi163 bash[24253]: cephadm 2024-08-31T03:13:14.858022+0000 mgr.a (mgr.14388) 2682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:13:16.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:16 smithi163 bash[24253]: cluster 2024-08-31T03:13:15.190958+0000 mgr.a (mgr.14388) 2683 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:16 smithi027 bash[22610]: audit 2024-08-31T03:13:14.856648+0000 mgr.a (mgr.14388) 2681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:13:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:16 smithi027 bash[22610]: cephadm 2024-08-31T03:13:14.858022+0000 mgr.a (mgr.14388) 2682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:13:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:16 smithi027 bash[22610]: cluster 2024-08-31T03:13:15.190958+0000 mgr.a (mgr.14388) 2683 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:16 smithi191 bash[24992]: audit 2024-08-31T03:13:14.856648+0000 mgr.a (mgr.14388) 2681 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:13:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:16 smithi191 bash[24992]: cephadm 2024-08-31T03:13:14.858022+0000 mgr.a (mgr.14388) 2682 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:13:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:16 smithi191 bash[24992]: cluster 2024-08-31T03:13:15.190958+0000 mgr.a (mgr.14388) 2683 : cluster [DBG] pgmap v1858: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:17.521 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:17.522 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:17.522 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:18.297 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:18.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:18.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:18.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:18.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:18.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:18 smithi163 bash[24253]: cluster 2024-08-31T03:13:17.191879+0000 mgr.a (mgr.14388) 2684 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:18 smithi027 bash[22610]: cluster 2024-08-31T03:13:17.191879+0000 mgr.a (mgr.14388) 2684 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:18 smithi191 bash[24992]: cluster 2024-08-31T03:13:17.191879+0000 mgr.a (mgr.14388) 2684 : cluster [DBG] pgmap v1859: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:19.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:19 smithi163 bash[24253]: audit 2024-08-31T03:13:17.858552+0000 mgr.a (mgr.14388) 2685 : audit [DBG] from='client.69828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:19 smithi027 bash[22610]: audit 2024-08-31T03:13:17.858552+0000 mgr.a (mgr.14388) 2685 : audit [DBG] from='client.69828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:19 smithi191 bash[24992]: audit 2024-08-31T03:13:17.858552+0000 mgr.a (mgr.14388) 2685 : audit [DBG] from='client.69828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:20.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:20 smithi163 bash[24253]: cluster 2024-08-31T03:13:19.194782+0000 mgr.a (mgr.14388) 2686 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:13:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:20 smithi027 bash[22610]: cluster 2024-08-31T03:13:19.194782+0000 mgr.a (mgr.14388) 2686 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:13:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:20 smithi191 bash[24992]: cluster 2024-08-31T03:13:19.194782+0000 mgr.a (mgr.14388) 2686 : cluster [DBG] pgmap v1860: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:13:22.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:22 smithi163 bash[24253]: cluster 2024-08-31T03:13:21.195764+0000 mgr.a (mgr.14388) 2687 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:13:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:22 smithi027 bash[22610]: cluster 2024-08-31T03:13:21.195764+0000 mgr.a (mgr.14388) 2687 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:13:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:22 smithi191 bash[24992]: cluster 2024-08-31T03:13:21.195764+0000 mgr.a (mgr.14388) 2687 : cluster [DBG] pgmap v1861: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:13:23.299 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:23.300 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:23.300 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:24.042 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:24.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:24 smithi163 bash[24253]: cluster 2024-08-31T03:13:23.197833+0000 mgr.a (mgr.14388) 2688 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:13:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:24 smithi027 bash[22610]: cluster 2024-08-31T03:13:23.197833+0000 mgr.a (mgr.14388) 2688 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:13:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:24 smithi191 bash[24992]: cluster 2024-08-31T03:13:23.197833+0000 mgr.a (mgr.14388) 2688 : cluster [DBG] pgmap v1862: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:13:25.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:25 smithi163 bash[24253]: audit 2024-08-31T03:13:23.631768+0000 mgr.a (mgr.14388) 2689 : audit [DBG] from='client.69906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:25 smithi027 bash[22610]: audit 2024-08-31T03:13:23.631768+0000 mgr.a (mgr.14388) 2689 : audit [DBG] from='client.69906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:25 smithi191 bash[24992]: audit 2024-08-31T03:13:23.631768+0000 mgr.a (mgr.14388) 2689 : audit [DBG] from='client.69906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:26.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:26 smithi163 bash[24253]: cluster 2024-08-31T03:13:25.198871+0000 mgr.a (mgr.14388) 2690 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:13:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:26 smithi027 bash[22610]: cluster 2024-08-31T03:13:25.198871+0000 mgr.a (mgr.14388) 2690 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:13:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:26 smithi191 bash[24992]: cluster 2024-08-31T03:13:25.198871+0000 mgr.a (mgr.14388) 2690 : cluster [DBG] pgmap v1863: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:13:28.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:28 smithi163 bash[24253]: cluster 2024-08-31T03:13:27.199627+0000 mgr.a (mgr.14388) 2691 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:13:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:28 smithi027 bash[22610]: cluster 2024-08-31T03:13:27.199627+0000 mgr.a (mgr.14388) 2691 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:13:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:28 smithi191 bash[24992]: cluster 2024-08-31T03:13:27.199627+0000 mgr.a (mgr.14388) 2691 : cluster [DBG] pgmap v1864: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:13:29.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:29.044 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:29.044 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:29.812 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:29.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:29.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:29.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:29.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:30.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:30 smithi163 bash[24253]: cluster 2024-08-31T03:13:29.201751+0000 mgr.a (mgr.14388) 2692 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:13:30.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:30 smithi163 bash[24253]: audit 2024-08-31T03:13:29.384580+0000 mgr.a (mgr.14388) 2693 : audit [DBG] from='client.69984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:30 smithi027 bash[22610]: cluster 2024-08-31T03:13:29.201751+0000 mgr.a (mgr.14388) 2692 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:13:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:30 smithi027 bash[22610]: audit 2024-08-31T03:13:29.384580+0000 mgr.a (mgr.14388) 2693 : audit [DBG] from='client.69984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:30 smithi191 bash[24992]: cluster 2024-08-31T03:13:29.201751+0000 mgr.a (mgr.14388) 2692 : cluster [DBG] pgmap v1865: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:13:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:30 smithi191 bash[24992]: audit 2024-08-31T03:13:29.384580+0000 mgr.a (mgr.14388) 2693 : audit [DBG] from='client.69984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:32.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:32 smithi163 bash[24253]: cluster 2024-08-31T03:13:31.202737+0000 mgr.a (mgr.14388) 2694 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:32 smithi027 bash[22610]: cluster 2024-08-31T03:13:31.202737+0000 mgr.a (mgr.14388) 2694 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:32 smithi191 bash[24992]: cluster 2024-08-31T03:13:31.202737+0000 mgr.a (mgr.14388) 2694 : cluster [DBG] pgmap v1866: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:34.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:34 smithi163 bash[24253]: cluster 2024-08-31T03:13:33.204881+0000 mgr.a (mgr.14388) 2695 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:34 smithi027 bash[22610]: cluster 2024-08-31T03:13:33.204881+0000 mgr.a (mgr.14388) 2695 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:34 smithi191 bash[24992]: cluster 2024-08-31T03:13:33.204881+0000 mgr.a (mgr.14388) 2695 : cluster [DBG] pgmap v1867: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:34.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:34.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:34.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:35.584 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:35.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:35.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:35.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:35.585 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:36.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:36 smithi163 bash[24253]: audit 2024-08-31T03:13:35.151611+0000 mgr.a (mgr.14388) 2696 : audit [DBG] from='client.70062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:36.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:36 smithi163 bash[24253]: cluster 2024-08-31T03:13:35.205929+0000 mgr.a (mgr.14388) 2697 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:36 smithi027 bash[22610]: audit 2024-08-31T03:13:35.151611+0000 mgr.a (mgr.14388) 2696 : audit [DBG] from='client.70062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:36 smithi027 bash[22610]: cluster 2024-08-31T03:13:35.205929+0000 mgr.a (mgr.14388) 2697 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:36 smithi191 bash[24992]: audit 2024-08-31T03:13:35.151611+0000 mgr.a (mgr.14388) 2696 : audit [DBG] from='client.70062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:36 smithi191 bash[24992]: cluster 2024-08-31T03:13:35.205929+0000 mgr.a (mgr.14388) 2697 : cluster [DBG] pgmap v1868: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:38.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:38 smithi163 bash[24253]: cluster 2024-08-31T03:13:37.206904+0000 mgr.a (mgr.14388) 2698 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:38 smithi027 bash[22610]: cluster 2024-08-31T03:13:37.206904+0000 mgr.a (mgr.14388) 2698 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:38 smithi191 bash[24992]: cluster 2024-08-31T03:13:37.206904+0000 mgr.a (mgr.14388) 2698 : cluster [DBG] pgmap v1869: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:40.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:40.587 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:40.587 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:40.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:40 smithi163 bash[24253]: cluster 2024-08-31T03:13:39.209138+0000 mgr.a (mgr.14388) 2699 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:40 smithi027 bash[22610]: cluster 2024-08-31T03:13:39.209138+0000 mgr.a (mgr.14388) 2699 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:40 smithi191 bash[24992]: cluster 2024-08-31T03:13:39.209138+0000 mgr.a (mgr.14388) 2699 : cluster [DBG] pgmap v1870: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:41.328 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:41.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:41.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:41.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:41.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:42.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:42 smithi163 bash[24253]: audit 2024-08-31T03:13:40.920889+0000 mgr.a (mgr.14388) 2700 : audit [DBG] from='client.70140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:42.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:42 smithi163 bash[24253]: cluster 2024-08-31T03:13:41.209670+0000 mgr.a (mgr.14388) 2701 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:42 smithi027 bash[22610]: audit 2024-08-31T03:13:40.920889+0000 mgr.a (mgr.14388) 2700 : audit [DBG] from='client.70140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:42 smithi027 bash[22610]: cluster 2024-08-31T03:13:41.209670+0000 mgr.a (mgr.14388) 2701 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:42 smithi191 bash[24992]: audit 2024-08-31T03:13:40.920889+0000 mgr.a (mgr.14388) 2700 : audit [DBG] from='client.70140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:42 smithi191 bash[24992]: cluster 2024-08-31T03:13:41.209670+0000 mgr.a (mgr.14388) 2701 : cluster [DBG] pgmap v1871: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:44.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:44 smithi163 bash[24253]: cluster 2024-08-31T03:13:43.211832+0000 mgr.a (mgr.14388) 2702 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:44 smithi027 bash[22610]: cluster 2024-08-31T03:13:43.211832+0000 mgr.a (mgr.14388) 2702 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:44 smithi191 bash[24992]: cluster 2024-08-31T03:13:43.211832+0000 mgr.a (mgr.14388) 2702 : cluster [DBG] pgmap v1872: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:46.330 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:46.333 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:46.333 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:46.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:46 smithi163 bash[24253]: cluster 2024-08-31T03:13:45.212592+0000 mgr.a (mgr.14388) 2703 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:46 smithi027 bash[22610]: cluster 2024-08-31T03:13:45.212592+0000 mgr.a (mgr.14388) 2703 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:46 smithi191 bash[24992]: cluster 2024-08-31T03:13:45.212592+0000 mgr.a (mgr.14388) 2703 : cluster [DBG] pgmap v1873: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:47.085 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:47.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:47.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:47.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:47.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:48.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:48 smithi163 bash[24253]: audit 2024-08-31T03:13:46.665235+0000 mgr.a (mgr.14388) 2704 : audit [DBG] from='client.70218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:48.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:48 smithi163 bash[24253]: cluster 2024-08-31T03:13:47.213528+0000 mgr.a (mgr.14388) 2705 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:48 smithi027 bash[22610]: audit 2024-08-31T03:13:46.665235+0000 mgr.a (mgr.14388) 2704 : audit [DBG] from='client.70218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:48 smithi027 bash[22610]: cluster 2024-08-31T03:13:47.213528+0000 mgr.a (mgr.14388) 2705 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:48 smithi191 bash[24992]: audit 2024-08-31T03:13:46.665235+0000 mgr.a (mgr.14388) 2704 : audit [DBG] from='client.70218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:48 smithi191 bash[24992]: cluster 2024-08-31T03:13:47.213528+0000 mgr.a (mgr.14388) 2705 : cluster [DBG] pgmap v1874: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:50.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:50 smithi163 bash[24253]: cluster 2024-08-31T03:13:49.215859+0000 mgr.a (mgr.14388) 2706 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:50 smithi027 bash[22610]: cluster 2024-08-31T03:13:49.215859+0000 mgr.a (mgr.14388) 2706 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:50 smithi191 bash[24992]: cluster 2024-08-31T03:13:49.215859+0000 mgr.a (mgr.14388) 2706 : cluster [DBG] pgmap v1875: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:13:52.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:52.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:52.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:52.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:52 smithi163 bash[24253]: cluster 2024-08-31T03:13:51.216801+0000 mgr.a (mgr.14388) 2707 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:52 smithi027 bash[22610]: cluster 2024-08-31T03:13:51.216801+0000 mgr.a (mgr.14388) 2707 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:52 smithi191 bash[24992]: cluster 2024-08-31T03:13:51.216801+0000 mgr.a (mgr.14388) 2707 : cluster [DBG] pgmap v1876: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:13:52.820 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:52.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:52.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:52.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:52.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:53.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:53 smithi163 bash[24253]: audit 2024-08-31T03:13:52.418602+0000 mgr.a (mgr.14388) 2708 : audit [DBG] from='client.70296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:53 smithi027 bash[22610]: audit 2024-08-31T03:13:52.418602+0000 mgr.a (mgr.14388) 2708 : audit [DBG] from='client.70296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:53 smithi191 bash[24992]: audit 2024-08-31T03:13:52.418602+0000 mgr.a (mgr.14388) 2708 : audit [DBG] from='client.70296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:54.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:54 smithi163 bash[24253]: cluster 2024-08-31T03:13:53.219153+0000 mgr.a (mgr.14388) 2709 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:13:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:54 smithi027 bash[22610]: cluster 2024-08-31T03:13:53.219153+0000 mgr.a (mgr.14388) 2709 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:13:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:54 smithi191 bash[24992]: cluster 2024-08-31T03:13:53.219153+0000 mgr.a (mgr.14388) 2709 : cluster [DBG] pgmap v1877: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:13:56.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:56 smithi163 bash[24253]: cluster 2024-08-31T03:13:55.219930+0000 mgr.a (mgr.14388) 2710 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:13:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:56 smithi027 bash[22610]: cluster 2024-08-31T03:13:55.219930+0000 mgr.a (mgr.14388) 2710 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:13:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:56 smithi191 bash[24992]: cluster 2024-08-31T03:13:55.219930+0000 mgr.a (mgr.14388) 2710 : cluster [DBG] pgmap v1878: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:13:57.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:13:57.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:13:57.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:13:58.595 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:13:58.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:13:58.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:13:58.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:13:58.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:13:58.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:58 smithi163 bash[24253]: cluster 2024-08-31T03:13:57.220681+0000 mgr.a (mgr.14388) 2711 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:13:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:58 smithi027 bash[22610]: cluster 2024-08-31T03:13:57.220681+0000 mgr.a (mgr.14388) 2711 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:13:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:58 smithi191 bash[24992]: cluster 2024-08-31T03:13:57.220681+0000 mgr.a (mgr.14388) 2711 : cluster [DBG] pgmap v1879: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:13:59.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:13:59 smithi163 bash[24253]: audit 2024-08-31T03:13:58.158010+0000 mgr.a (mgr.14388) 2712 : audit [DBG] from='client.70368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:13:59 smithi027 bash[22610]: audit 2024-08-31T03:13:58.158010+0000 mgr.a (mgr.14388) 2712 : audit [DBG] from='client.70368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:13:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:13:59 smithi191 bash[24992]: audit 2024-08-31T03:13:58.158010+0000 mgr.a (mgr.14388) 2712 : audit [DBG] from='client.70368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:00 smithi027 bash[22610]: cluster 2024-08-31T03:13:59.223317+0000 mgr.a (mgr.14388) 2713 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:00 smithi191 bash[24992]: cluster 2024-08-31T03:13:59.223317+0000 mgr.a (mgr.14388) 2713 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:00 smithi163 bash[24253]: cluster 2024-08-31T03:13:59.223317+0000 mgr.a (mgr.14388) 2713 : cluster [DBG] pgmap v1880: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:02 smithi027 bash[22610]: cluster 2024-08-31T03:14:01.224099+0000 mgr.a (mgr.14388) 2714 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:14:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:02 smithi191 bash[24992]: cluster 2024-08-31T03:14:01.224099+0000 mgr.a (mgr.14388) 2714 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:14:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:02 smithi163 bash[24253]: cluster 2024-08-31T03:14:01.224099+0000 mgr.a (mgr.14388) 2714 : cluster [DBG] pgmap v1881: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:14:03.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:14:03.597 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:14:03.597 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:14:04.328 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:14:04.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:14:04.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:14:04.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:14:04.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:14:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:04 smithi027 bash[22610]: cluster 2024-08-31T03:14:03.226121+0000 mgr.a (mgr.14388) 2715 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:04 smithi191 bash[24992]: cluster 2024-08-31T03:14:03.226121+0000 mgr.a (mgr.14388) 2715 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:04.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:04 smithi163 bash[24253]: cluster 2024-08-31T03:14:03.226121+0000 mgr.a (mgr.14388) 2715 : cluster [DBG] pgmap v1882: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:05 smithi027 bash[22610]: audit 2024-08-31T03:14:03.927933+0000 mgr.a (mgr.14388) 2716 : audit [DBG] from='client.70440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:05 smithi191 bash[24992]: audit 2024-08-31T03:14:03.927933+0000 mgr.a (mgr.14388) 2716 : audit [DBG] from='client.70440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:05.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:05 smithi163 bash[24253]: audit 2024-08-31T03:14:03.927933+0000 mgr.a (mgr.14388) 2716 : audit [DBG] from='client.70440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:06 smithi027 bash[22610]: cluster 2024-08-31T03:14:05.227248+0000 mgr.a (mgr.14388) 2717 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:14:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:06 smithi191 bash[24992]: cluster 2024-08-31T03:14:05.227248+0000 mgr.a (mgr.14388) 2717 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:14:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:06 smithi163 bash[24253]: cluster 2024-08-31T03:14:05.227248+0000 mgr.a (mgr.14388) 2717 : cluster [DBG] pgmap v1883: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:14:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:08 smithi027 bash[22610]: cluster 2024-08-31T03:14:07.228091+0000 mgr.a (mgr.14388) 2718 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:14:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:08 smithi191 bash[24992]: cluster 2024-08-31T03:14:07.228091+0000 mgr.a (mgr.14388) 2718 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:14:08.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:08 smithi163 bash[24253]: cluster 2024-08-31T03:14:07.228091+0000 mgr.a (mgr.14388) 2718 : cluster [DBG] pgmap v1884: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:14:09.330 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:14:09.330 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:14:09.331 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:14:10.067 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:14:10.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:14:10.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:14:10.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:14:10.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:14:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:10 smithi191 bash[24992]: cluster 2024-08-31T03:14:09.230291+0000 mgr.a (mgr.14388) 2719 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:14:10.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:10 smithi163 bash[24253]: cluster 2024-08-31T03:14:09.230291+0000 mgr.a (mgr.14388) 2719 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:14:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:10 smithi027 bash[22610]: cluster 2024-08-31T03:14:09.230291+0000 mgr.a (mgr.14388) 2719 : cluster [DBG] pgmap v1885: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:14:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:11 smithi191 bash[24992]: audit 2024-08-31T03:14:09.661389+0000 mgr.a (mgr.14388) 2720 : audit [DBG] from='client.70518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:11.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:11 smithi163 bash[24253]: audit 2024-08-31T03:14:09.661389+0000 mgr.a (mgr.14388) 2720 : audit [DBG] from='client.70518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:11 smithi027 bash[22610]: audit 2024-08-31T03:14:09.661389+0000 mgr.a (mgr.14388) 2720 : audit [DBG] from='client.70518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:12 smithi191 bash[24992]: cluster 2024-08-31T03:14:11.231217+0000 mgr.a (mgr.14388) 2721 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:12.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:12 smithi163 bash[24253]: cluster 2024-08-31T03:14:11.231217+0000 mgr.a (mgr.14388) 2721 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:12 smithi027 bash[22610]: cluster 2024-08-31T03:14:11.231217+0000 mgr.a (mgr.14388) 2721 : cluster [DBG] pgmap v1886: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:14 smithi191 bash[24992]: cluster 2024-08-31T03:14:13.233314+0000 mgr.a (mgr.14388) 2722 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:14:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:14 smithi163 bash[24253]: cluster 2024-08-31T03:14:13.233314+0000 mgr.a (mgr.14388) 2722 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:14:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:14 smithi027 bash[22610]: cluster 2024-08-31T03:14:13.233314+0000 mgr.a (mgr.14388) 2722 : cluster [DBG] pgmap v1887: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:14:15.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:14:15.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:14:15.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:14:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:15 smithi191 bash[24992]: audit 2024-08-31T03:14:14.914099+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:14:15.840 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:14:15.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:14:15.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:14:15.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:14:15.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:14:15.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:15 smithi163 bash[24253]: audit 2024-08-31T03:14:14.914099+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:14:15.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:15 smithi027 bash[22610]: audit 2024-08-31T03:14:14.914099+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:14:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:16 smithi191 bash[24992]: cluster 2024-08-31T03:14:15.233885+0000 mgr.a (mgr.14388) 2723 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:16 smithi191 bash[24992]: audit 2024-08-31T03:14:15.401260+0000 mgr.a (mgr.14388) 2724 : audit [DBG] from='client.70596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:16 smithi191 bash[24992]: audit 2024-08-31T03:14:15.756592+0000 mon.a (mon.0) 1002 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:14:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:16 smithi191 bash[24992]: audit 2024-08-31T03:14:15.757440+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:14:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:16 smithi191 bash[24992]: audit 2024-08-31T03:14:15.762850+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:14:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:16 smithi191 bash[24992]: audit 2024-08-31T03:14:15.764918+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:14:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:16 smithi163 bash[24253]: cluster 2024-08-31T03:14:15.233885+0000 mgr.a (mgr.14388) 2723 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:16 smithi163 bash[24253]: audit 2024-08-31T03:14:15.401260+0000 mgr.a (mgr.14388) 2724 : audit [DBG] from='client.70596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:16 smithi163 bash[24253]: audit 2024-08-31T03:14:15.756592+0000 mon.a (mon.0) 1002 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:14:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:16 smithi163 bash[24253]: audit 2024-08-31T03:14:15.757440+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:14:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:16 smithi163 bash[24253]: audit 2024-08-31T03:14:15.762850+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:14:16.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:16 smithi163 bash[24253]: audit 2024-08-31T03:14:15.764918+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:14:16.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:14:16 smithi027 bash[22863]: debug 2024-08-31T03:14:16.515+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:14:16.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:14:16 smithi027 bash[22863]: debug 2024-08-31T03:14:16.515+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:14:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:16 smithi027 bash[22610]: cluster 2024-08-31T03:14:15.233885+0000 mgr.a (mgr.14388) 2723 : cluster [DBG] pgmap v1888: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:16 smithi027 bash[22610]: audit 2024-08-31T03:14:15.401260+0000 mgr.a (mgr.14388) 2724 : audit [DBG] from='client.70596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:16 smithi027 bash[22610]: audit 2024-08-31T03:14:15.756592+0000 mon.a (mon.0) 1002 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:14:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:16 smithi027 bash[22610]: audit 2024-08-31T03:14:15.757440+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:14:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:16 smithi027 bash[22610]: audit 2024-08-31T03:14:15.762850+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:14:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:16 smithi027 bash[22610]: audit 2024-08-31T03:14:15.764918+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:14:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:17 smithi191 bash[24992]: audit 2024-08-31T03:14:15.766056+0000 mgr.a (mgr.14388) 2725 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:14:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:17 smithi191 bash[24992]: audit 2024-08-31T03:14:16.521073+0000 mgr.a (mgr.14388) 2726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:14:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:17 smithi191 bash[24992]: cephadm 2024-08-31T03:14:16.522133+0000 mgr.a (mgr.14388) 2727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:14:17.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:17 smithi163 bash[24253]: audit 2024-08-31T03:14:15.766056+0000 mgr.a (mgr.14388) 2725 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:14:17.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:17 smithi163 bash[24253]: audit 2024-08-31T03:14:16.521073+0000 mgr.a (mgr.14388) 2726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:14:17.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:17 smithi163 bash[24253]: cephadm 2024-08-31T03:14:16.522133+0000 mgr.a (mgr.14388) 2727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:14:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:17 smithi027 bash[22610]: audit 2024-08-31T03:14:15.766056+0000 mgr.a (mgr.14388) 2725 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:14:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:17 smithi027 bash[22610]: audit 2024-08-31T03:14:16.521073+0000 mgr.a (mgr.14388) 2726 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:14:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:17 smithi027 bash[22610]: cephadm 2024-08-31T03:14:16.522133+0000 mgr.a (mgr.14388) 2727 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:14:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:18 smithi191 bash[24992]: cluster 2024-08-31T03:14:17.234812+0000 mgr.a (mgr.14388) 2728 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:18 smithi163 bash[24253]: cluster 2024-08-31T03:14:17.234812+0000 mgr.a (mgr.14388) 2728 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:18 smithi027 bash[22610]: cluster 2024-08-31T03:14:17.234812+0000 mgr.a (mgr.14388) 2728 : cluster [DBG] pgmap v1889: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:20 smithi191 bash[24992]: cluster 2024-08-31T03:14:19.237117+0000 mgr.a (mgr.14388) 2729 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:20.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:14:20.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:14:20.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:14:20.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:20 smithi163 bash[24253]: cluster 2024-08-31T03:14:19.237117+0000 mgr.a (mgr.14388) 2729 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:20 smithi027 bash[22610]: cluster 2024-08-31T03:14:19.237117+0000 mgr.a (mgr.14388) 2729 : cluster [DBG] pgmap v1890: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:21.608 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:14:21.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:14:21.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:14:21.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:14:21.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:14:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:22 smithi191 bash[24992]: audit 2024-08-31T03:14:21.180450+0000 mgr.a (mgr.14388) 2730 : audit [DBG] from='client.70779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:22 smithi191 bash[24992]: cluster 2024-08-31T03:14:21.238002+0000 mgr.a (mgr.14388) 2731 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:22 smithi163 bash[24253]: audit 2024-08-31T03:14:21.180450+0000 mgr.a (mgr.14388) 2730 : audit [DBG] from='client.70779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:22 smithi163 bash[24253]: cluster 2024-08-31T03:14:21.238002+0000 mgr.a (mgr.14388) 2731 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:22 smithi027 bash[22610]: audit 2024-08-31T03:14:21.180450+0000 mgr.a (mgr.14388) 2730 : audit [DBG] from='client.70779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:22 smithi027 bash[22610]: cluster 2024-08-31T03:14:21.238002+0000 mgr.a (mgr.14388) 2731 : cluster [DBG] pgmap v1891: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:24 smithi191 bash[24992]: cluster 2024-08-31T03:14:23.240275+0000 mgr.a (mgr.14388) 2732 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:24 smithi163 bash[24253]: cluster 2024-08-31T03:14:23.240275+0000 mgr.a (mgr.14388) 2732 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:24 smithi027 bash[22610]: cluster 2024-08-31T03:14:23.240275+0000 mgr.a (mgr.14388) 2732 : cluster [DBG] pgmap v1892: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:14:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:14:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:14:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:26 smithi163 bash[24253]: cluster 2024-08-31T03:14:25.241080+0000 mgr.a (mgr.14388) 2733 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:26 smithi027 bash[22610]: cluster 2024-08-31T03:14:25.241080+0000 mgr.a (mgr.14388) 2733 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:26 smithi191 bash[24992]: cluster 2024-08-31T03:14:25.241080+0000 mgr.a (mgr.14388) 2733 : cluster [DBG] pgmap v1893: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:27.376 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:14:27.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:14:27.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:14:27.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:14:27.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:14:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:28 smithi163 bash[24253]: audit 2024-08-31T03:14:26.948382+0000 mgr.a (mgr.14388) 2734 : audit [DBG] from='client.70854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:28 smithi163 bash[24253]: cluster 2024-08-31T03:14:27.241611+0000 mgr.a (mgr.14388) 2735 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:28 smithi027 bash[22610]: audit 2024-08-31T03:14:26.948382+0000 mgr.a (mgr.14388) 2734 : audit [DBG] from='client.70854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:28 smithi027 bash[22610]: cluster 2024-08-31T03:14:27.241611+0000 mgr.a (mgr.14388) 2735 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:28 smithi191 bash[24992]: audit 2024-08-31T03:14:26.948382+0000 mgr.a (mgr.14388) 2734 : audit [DBG] from='client.70854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:28 smithi191 bash[24992]: cluster 2024-08-31T03:14:27.241611+0000 mgr.a (mgr.14388) 2735 : cluster [DBG] pgmap v1894: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:30.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:30 smithi163 bash[24253]: cluster 2024-08-31T03:14:29.243915+0000 mgr.a (mgr.14388) 2736 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:30 smithi027 bash[22610]: cluster 2024-08-31T03:14:29.243915+0000 mgr.a (mgr.14388) 2736 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:30 smithi191 bash[24992]: cluster 2024-08-31T03:14:29.243915+0000 mgr.a (mgr.14388) 2736 : cluster [DBG] pgmap v1895: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:14:32.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:14:32.381 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:14:32.381 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:14:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:32 smithi163 bash[24253]: cluster 2024-08-31T03:14:31.244713+0000 mgr.a (mgr.14388) 2737 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:32.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:32 smithi027 bash[22610]: cluster 2024-08-31T03:14:31.244713+0000 mgr.a (mgr.14388) 2737 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:32 smithi191 bash[24992]: cluster 2024-08-31T03:14:31.244713+0000 mgr.a (mgr.14388) 2737 : cluster [DBG] pgmap v1896: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:33.146 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:14:33.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:14:33.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:14:33.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:14:33.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:14:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:34 smithi163 bash[24253]: audit 2024-08-31T03:14:32.716507+0000 mgr.a (mgr.14388) 2738 : audit [DBG] from='client.70929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:34 smithi163 bash[24253]: cluster 2024-08-31T03:14:33.247427+0000 mgr.a (mgr.14388) 2739 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:34 smithi027 bash[22610]: audit 2024-08-31T03:14:32.716507+0000 mgr.a (mgr.14388) 2738 : audit [DBG] from='client.70929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:34 smithi027 bash[22610]: cluster 2024-08-31T03:14:33.247427+0000 mgr.a (mgr.14388) 2739 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:35.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:34 smithi191 bash[24992]: audit 2024-08-31T03:14:32.716507+0000 mgr.a (mgr.14388) 2738 : audit [DBG] from='client.70929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:35.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:34 smithi191 bash[24992]: cluster 2024-08-31T03:14:33.247427+0000 mgr.a (mgr.14388) 2739 : cluster [DBG] pgmap v1897: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:36 smithi163 bash[24253]: cluster 2024-08-31T03:14:35.248194+0000 mgr.a (mgr.14388) 2740 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:14:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:36 smithi027 bash[22610]: cluster 2024-08-31T03:14:35.248194+0000 mgr.a (mgr.14388) 2740 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:14:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:36 smithi191 bash[24992]: cluster 2024-08-31T03:14:35.248194+0000 mgr.a (mgr.14388) 2740 : cluster [DBG] pgmap v1898: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:14:37.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:37 smithi163 bash[24253]: cluster 2024-08-31T03:14:37.248957+0000 mgr.a (mgr.14388) 2741 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:14:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:37 smithi027 bash[22610]: cluster 2024-08-31T03:14:37.248957+0000 mgr.a (mgr.14388) 2741 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:14:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:37 smithi191 bash[24992]: cluster 2024-08-31T03:14:37.248957+0000 mgr.a (mgr.14388) 2741 : cluster [DBG] pgmap v1899: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:14:38.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:14:38.149 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:14:38.150 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:14:38.897 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:14:38.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:14:38.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:14:38.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:14:38.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:14:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:38 smithi163 bash[24253]: audit 2024-08-31T03:14:38.482380+0000 mgr.a (mgr.14388) 2742 : audit [DBG] from='client.71007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:38 smithi027 bash[22610]: audit 2024-08-31T03:14:38.482380+0000 mgr.a (mgr.14388) 2742 : audit [DBG] from='client.71007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:38 smithi191 bash[24992]: audit 2024-08-31T03:14:38.482380+0000 mgr.a (mgr.14388) 2742 : audit [DBG] from='client.71007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:39.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:39 smithi163 bash[24253]: cluster 2024-08-31T03:14:39.251793+0000 mgr.a (mgr.14388) 2743 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:39 smithi027 bash[22610]: cluster 2024-08-31T03:14:39.251793+0000 mgr.a (mgr.14388) 2743 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:39 smithi191 bash[24992]: cluster 2024-08-31T03:14:39.251793+0000 mgr.a (mgr.14388) 2743 : cluster [DBG] pgmap v1900: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:42.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:42 smithi163 bash[24253]: cluster 2024-08-31T03:14:41.252605+0000 mgr.a (mgr.14388) 2744 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:14:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:42 smithi027 bash[22610]: cluster 2024-08-31T03:14:41.252605+0000 mgr.a (mgr.14388) 2744 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:14:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:42 smithi191 bash[24992]: cluster 2024-08-31T03:14:41.252605+0000 mgr.a (mgr.14388) 2744 : cluster [DBG] pgmap v1901: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:14:43.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:14:43.899 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:14:43.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:14:44.647 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:14:44.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:14:44.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:14:44.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:14:44.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:14:44.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:44 smithi163 bash[24253]: cluster 2024-08-31T03:14:43.254486+0000 mgr.a (mgr.14388) 2745 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:44 smithi027 bash[22610]: cluster 2024-08-31T03:14:43.254486+0000 mgr.a (mgr.14388) 2745 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:44 smithi191 bash[24992]: cluster 2024-08-31T03:14:43.254486+0000 mgr.a (mgr.14388) 2745 : cluster [DBG] pgmap v1902: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:45.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:45 smithi163 bash[24253]: audit 2024-08-31T03:14:44.229556+0000 mgr.a (mgr.14388) 2746 : audit [DBG] from='client.71085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:45 smithi027 bash[22610]: audit 2024-08-31T03:14:44.229556+0000 mgr.a (mgr.14388) 2746 : audit [DBG] from='client.71085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:45 smithi191 bash[24992]: audit 2024-08-31T03:14:44.229556+0000 mgr.a (mgr.14388) 2746 : audit [DBG] from='client.71085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:46.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:46 smithi163 bash[24253]: cluster 2024-08-31T03:14:45.255468+0000 mgr.a (mgr.14388) 2747 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:46 smithi027 bash[22610]: cluster 2024-08-31T03:14:45.255468+0000 mgr.a (mgr.14388) 2747 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:46 smithi191 bash[24992]: cluster 2024-08-31T03:14:45.255468+0000 mgr.a (mgr.14388) 2747 : cluster [DBG] pgmap v1903: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:48.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:48 smithi163 bash[24253]: cluster 2024-08-31T03:14:47.256196+0000 mgr.a (mgr.14388) 2748 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:48 smithi027 bash[22610]: cluster 2024-08-31T03:14:47.256196+0000 mgr.a (mgr.14388) 2748 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:48 smithi191 bash[24992]: cluster 2024-08-31T03:14:47.256196+0000 mgr.a (mgr.14388) 2748 : cluster [DBG] pgmap v1904: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:49.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:14:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:14:49.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:14:50.420 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:14:50.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:14:50.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:14:50.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:14:50.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:14:50.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:50 smithi163 bash[24253]: cluster 2024-08-31T03:14:49.258367+0000 mgr.a (mgr.14388) 2749 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:14:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:50 smithi027 bash[22610]: cluster 2024-08-31T03:14:49.258367+0000 mgr.a (mgr.14388) 2749 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:14:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:50 smithi191 bash[24992]: cluster 2024-08-31T03:14:49.258367+0000 mgr.a (mgr.14388) 2749 : cluster [DBG] pgmap v1905: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:14:51.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:51 smithi163 bash[24253]: audit 2024-08-31T03:14:49.985732+0000 mgr.a (mgr.14388) 2750 : audit [DBG] from='client.71163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:51 smithi027 bash[22610]: audit 2024-08-31T03:14:49.985732+0000 mgr.a (mgr.14388) 2750 : audit [DBG] from='client.71163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:51 smithi191 bash[24992]: audit 2024-08-31T03:14:49.985732+0000 mgr.a (mgr.14388) 2750 : audit [DBG] from='client.71163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:52.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:52 smithi163 bash[24253]: cluster 2024-08-31T03:14:51.259279+0000 mgr.a (mgr.14388) 2751 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:52 smithi027 bash[22610]: cluster 2024-08-31T03:14:51.259279+0000 mgr.a (mgr.14388) 2751 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:52 smithi191 bash[24992]: cluster 2024-08-31T03:14:51.259279+0000 mgr.a (mgr.14388) 2751 : cluster [DBG] pgmap v1906: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:54.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:54 smithi163 bash[24253]: cluster 2024-08-31T03:14:53.261459+0000 mgr.a (mgr.14388) 2752 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:14:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:54 smithi027 bash[22610]: cluster 2024-08-31T03:14:53.261459+0000 mgr.a (mgr.14388) 2752 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:14:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:54 smithi191 bash[24992]: cluster 2024-08-31T03:14:53.261459+0000 mgr.a (mgr.14388) 2752 : cluster [DBG] pgmap v1907: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:14:55.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:14:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:14:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:14:56.186 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:14:56.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:14:56.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:14:56.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:14:56.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:14:56.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:56 smithi163 bash[24253]: cluster 2024-08-31T03:14:55.262244+0000 mgr.a (mgr.14388) 2753 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:56 smithi027 bash[22610]: cluster 2024-08-31T03:14:55.262244+0000 mgr.a (mgr.14388) 2753 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:56 smithi191 bash[24992]: cluster 2024-08-31T03:14:55.262244+0000 mgr.a (mgr.14388) 2753 : cluster [DBG] pgmap v1908: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:57.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:57 smithi163 bash[24253]: audit 2024-08-31T03:14:55.763357+0000 mgr.a (mgr.14388) 2754 : audit [DBG] from='client.71238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:57.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:57 smithi027 bash[22610]: audit 2024-08-31T03:14:55.763357+0000 mgr.a (mgr.14388) 2754 : audit [DBG] from='client.71238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:57 smithi191 bash[24992]: audit 2024-08-31T03:14:55.763357+0000 mgr.a (mgr.14388) 2754 : audit [DBG] from='client.71238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:14:58.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:14:58 smithi163 bash[24253]: cluster 2024-08-31T03:14:57.263129+0000 mgr.a (mgr.14388) 2755 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:58.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:14:58 smithi027 bash[22610]: cluster 2024-08-31T03:14:57.263129+0000 mgr.a (mgr.14388) 2755 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:14:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:14:58 smithi191 bash[24992]: cluster 2024-08-31T03:14:57.263129+0000 mgr.a (mgr.14388) 2755 : cluster [DBG] pgmap v1909: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:00.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:00 smithi163 bash[24253]: cluster 2024-08-31T03:14:59.265280+0000 mgr.a (mgr.14388) 2756 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:00 smithi027 bash[22610]: cluster 2024-08-31T03:14:59.265280+0000 mgr.a (mgr.14388) 2756 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:00 smithi191 bash[24992]: cluster 2024-08-31T03:14:59.265280+0000 mgr.a (mgr.14388) 2756 : cluster [DBG] pgmap v1910: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:01.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:01.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:01.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:01.933 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:01.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:01.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:01.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:01.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:15:02.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:02 smithi163 bash[24253]: cluster 2024-08-31T03:15:01.266035+0000 mgr.a (mgr.14388) 2757 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:02.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:02 smithi163 bash[24253]: audit 2024-08-31T03:15:01.518809+0000 mgr.a (mgr.14388) 2758 : audit [DBG] from='client.71316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:02 smithi027 bash[22610]: cluster 2024-08-31T03:15:01.266035+0000 mgr.a (mgr.14388) 2757 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:02 smithi027 bash[22610]: audit 2024-08-31T03:15:01.518809+0000 mgr.a (mgr.14388) 2758 : audit [DBG] from='client.71316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:02 smithi191 bash[24992]: cluster 2024-08-31T03:15:01.266035+0000 mgr.a (mgr.14388) 2757 : cluster [DBG] pgmap v1911: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:02 smithi191 bash[24992]: audit 2024-08-31T03:15:01.518809+0000 mgr.a (mgr.14388) 2758 : audit [DBG] from='client.71316 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:04.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:04 smithi163 bash[24253]: cluster 2024-08-31T03:15:03.268267+0000 mgr.a (mgr.14388) 2759 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:04 smithi027 bash[22610]: cluster 2024-08-31T03:15:03.268267+0000 mgr.a (mgr.14388) 2759 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:04 smithi191 bash[24992]: cluster 2024-08-31T03:15:03.268267+0000 mgr.a (mgr.14388) 2759 : cluster [DBG] pgmap v1912: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:06.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:06 smithi163 bash[24253]: cluster 2024-08-31T03:15:05.268978+0000 mgr.a (mgr.14388) 2760 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:06 smithi027 bash[22610]: cluster 2024-08-31T03:15:05.268978+0000 mgr.a (mgr.14388) 2760 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:06 smithi191 bash[24992]: cluster 2024-08-31T03:15:05.268978+0000 mgr.a (mgr.14388) 2760 : cluster [DBG] pgmap v1913: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:06.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:06.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:06.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:07.678 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:07.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:07.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:07.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:07.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:15:08.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:08 smithi163 bash[24253]: audit 2024-08-31T03:15:07.267169+0000 mgr.a (mgr.14388) 2761 : audit [DBG] from='client.71394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:08.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:08 smithi163 bash[24253]: cluster 2024-08-31T03:15:07.283790+0000 mgr.a (mgr.14388) 2762 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:08 smithi027 bash[22610]: audit 2024-08-31T03:15:07.267169+0000 mgr.a (mgr.14388) 2761 : audit [DBG] from='client.71394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:08 smithi027 bash[22610]: cluster 2024-08-31T03:15:07.283790+0000 mgr.a (mgr.14388) 2762 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:08 smithi191 bash[24992]: audit 2024-08-31T03:15:07.267169+0000 mgr.a (mgr.14388) 2761 : audit [DBG] from='client.71394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:08 smithi191 bash[24992]: cluster 2024-08-31T03:15:07.283790+0000 mgr.a (mgr.14388) 2762 : cluster [DBG] pgmap v1914: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:10.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:10 smithi163 bash[24253]: cluster 2024-08-31T03:15:09.286136+0000 mgr.a (mgr.14388) 2763 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:10 smithi027 bash[22610]: cluster 2024-08-31T03:15:09.286136+0000 mgr.a (mgr.14388) 2763 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:10 smithi191 bash[24992]: cluster 2024-08-31T03:15:09.286136+0000 mgr.a (mgr.14388) 2763 : cluster [DBG] pgmap v1915: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:12.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:12.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:12.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:12.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:12 smithi163 bash[24253]: cluster 2024-08-31T03:15:11.286898+0000 mgr.a (mgr.14388) 2764 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:12 smithi027 bash[22610]: cluster 2024-08-31T03:15:11.286898+0000 mgr.a (mgr.14388) 2764 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:12 smithi191 bash[24992]: cluster 2024-08-31T03:15:11.286898+0000 mgr.a (mgr.14388) 2764 : cluster [DBG] pgmap v1916: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:13.440 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:13.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:13.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:13.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:13.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:15:14.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:14 smithi163 bash[24253]: audit 2024-08-31T03:15:13.018222+0000 mgr.a (mgr.14388) 2765 : audit [DBG] from='client.71472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:14.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:14 smithi163 bash[24253]: cluster 2024-08-31T03:15:13.288151+0000 mgr.a (mgr.14388) 2766 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:14 smithi027 bash[22610]: audit 2024-08-31T03:15:13.018222+0000 mgr.a (mgr.14388) 2765 : audit [DBG] from='client.71472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:14 smithi027 bash[22610]: cluster 2024-08-31T03:15:13.288151+0000 mgr.a (mgr.14388) 2766 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:14 smithi191 bash[24992]: audit 2024-08-31T03:15:13.018222+0000 mgr.a (mgr.14388) 2765 : audit [DBG] from='client.71472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:14 smithi191 bash[24992]: cluster 2024-08-31T03:15:13.288151+0000 mgr.a (mgr.14388) 2766 : cluster [DBG] pgmap v1917: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:16.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:16 smithi163 bash[24253]: cluster 2024-08-31T03:15:15.289012+0000 mgr.a (mgr.14388) 2767 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T03:15:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:16 smithi027 bash[22610]: cluster 2024-08-31T03:15:15.289012+0000 mgr.a (mgr.14388) 2767 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T03:15:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:16 smithi191 bash[24992]: cluster 2024-08-31T03:15:15.289012+0000 mgr.a (mgr.14388) 2767 : cluster [DBG] pgmap v1918: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T03:15:17.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:17 smithi163 bash[24253]: audit 2024-08-31T03:15:16.571944+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:15:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:17 smithi027 bash[22610]: audit 2024-08-31T03:15:16.571944+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:15:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:17 smithi191 bash[24992]: audit 2024-08-31T03:15:16.571944+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:15:18.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:18.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:18.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:18.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:18 smithi163 bash[24253]: cluster 2024-08-31T03:15:17.289713+0000 mgr.a (mgr.14388) 2768 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:15:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:18 smithi027 bash[22610]: cluster 2024-08-31T03:15:17.289713+0000 mgr.a (mgr.14388) 2768 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:15:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:18 smithi191 bash[24992]: cluster 2024-08-31T03:15:17.289713+0000 mgr.a (mgr.14388) 2768 : cluster [DBG] pgmap v1919: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:15:19.178 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:19.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:19.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:19.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:19.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:15:20.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:20 smithi163 bash[24253]: audit 2024-08-31T03:15:18.774493+0000 mgr.a (mgr.14388) 2769 : audit [DBG] from='client.71547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:20.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:20 smithi163 bash[24253]: cluster 2024-08-31T03:15:19.292389+0000 mgr.a (mgr.14388) 2770 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:20 smithi027 bash[22610]: audit 2024-08-31T03:15:18.774493+0000 mgr.a (mgr.14388) 2769 : audit [DBG] from='client.71547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:20 smithi027 bash[22610]: cluster 2024-08-31T03:15:19.292389+0000 mgr.a (mgr.14388) 2770 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:20 smithi191 bash[24992]: audit 2024-08-31T03:15:18.774493+0000 mgr.a (mgr.14388) 2769 : audit [DBG] from='client.71547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:20 smithi191 bash[24992]: cluster 2024-08-31T03:15:19.292389+0000 mgr.a (mgr.14388) 2770 : cluster [DBG] pgmap v1920: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:22.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:22 smithi163 bash[24253]: cluster 2024-08-31T03:15:21.293177+0000 mgr.a (mgr.14388) 2771 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:15:22.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:22 smithi163 bash[24253]: audit 2024-08-31T03:15:21.924665+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:22 smithi163 bash[24253]: audit 2024-08-31T03:15:21.929209+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:22 smithi163 bash[24253]: audit 2024-08-31T03:15:21.944650+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:22 smithi163 bash[24253]: audit 2024-08-31T03:15:21.948022+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:22 smithi163 bash[24253]: audit 2024-08-31T03:15:21.951613+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:22 smithi163 bash[24253]: audit 2024-08-31T03:15:21.954713+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:22 smithi027 bash[22610]: cluster 2024-08-31T03:15:21.293177+0000 mgr.a (mgr.14388) 2771 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:15:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:22 smithi027 bash[22610]: audit 2024-08-31T03:15:21.924665+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:22 smithi027 bash[22610]: audit 2024-08-31T03:15:21.929209+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:22 smithi027 bash[22610]: audit 2024-08-31T03:15:21.944650+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:22 smithi027 bash[22610]: audit 2024-08-31T03:15:21.948022+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:22 smithi027 bash[22610]: audit 2024-08-31T03:15:21.951613+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:22 smithi027 bash[22610]: audit 2024-08-31T03:15:21.954713+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:22 smithi191 bash[24992]: cluster 2024-08-31T03:15:21.293177+0000 mgr.a (mgr.14388) 2771 : cluster [DBG] pgmap v1921: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:15:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:22 smithi191 bash[24992]: audit 2024-08-31T03:15:21.924665+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:22 smithi191 bash[24992]: audit 2024-08-31T03:15:21.929209+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:22 smithi191 bash[24992]: audit 2024-08-31T03:15:21.944650+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:22 smithi191 bash[24992]: audit 2024-08-31T03:15:21.948022+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:22 smithi191 bash[24992]: audit 2024-08-31T03:15:21.951613+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:22 smithi191 bash[24992]: audit 2024-08-31T03:15:21.954713+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:23.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:23 smithi163 bash[24253]: audit 2024-08-31T03:15:22.704872+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:15:23.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:23 smithi163 bash[24253]: audit 2024-08-31T03:15:22.706511+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:15:23.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:23 smithi163 bash[24253]: audit 2024-08-31T03:15:22.716548+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:23.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:23 smithi163 bash[24253]: audit 2024-08-31T03:15:22.721460+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:15:23.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:15:23 smithi027 bash[22863]: debug 2024-08-31T03:15:23.425+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:15:23.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:15:23 smithi027 bash[22863]: debug 2024-08-31T03:15:23.429+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:15:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:23 smithi027 bash[22610]: audit 2024-08-31T03:15:22.704872+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:15:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:23 smithi027 bash[22610]: audit 2024-08-31T03:15:22.706511+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:15:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:23 smithi027 bash[22610]: audit 2024-08-31T03:15:22.716548+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:23 smithi027 bash[22610]: audit 2024-08-31T03:15:22.721460+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:15:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:23 smithi191 bash[24992]: audit 2024-08-31T03:15:22.704872+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:15:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:23 smithi191 bash[24992]: audit 2024-08-31T03:15:22.706511+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:15:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:23 smithi191 bash[24992]: audit 2024-08-31T03:15:22.716548+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:15:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:23 smithi191 bash[24992]: audit 2024-08-31T03:15:22.721460+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:15:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:24.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:24 smithi163 bash[24253]: audit 2024-08-31T03:15:22.723832+0000 mgr.a (mgr.14388) 2772 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:15:24.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:24 smithi163 bash[24253]: cluster 2024-08-31T03:15:23.294496+0000 mgr.a (mgr.14388) 2773 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:15:24.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:24 smithi163 bash[24253]: audit 2024-08-31T03:15:23.430007+0000 mgr.a (mgr.14388) 2774 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:15:24.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:24 smithi163 bash[24253]: cephadm 2024-08-31T03:15:23.431032+0000 mgr.a (mgr.14388) 2775 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:15:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:24 smithi027 bash[22610]: audit 2024-08-31T03:15:22.723832+0000 mgr.a (mgr.14388) 2772 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:15:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:24 smithi027 bash[22610]: cluster 2024-08-31T03:15:23.294496+0000 mgr.a (mgr.14388) 2773 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:15:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:24 smithi027 bash[22610]: audit 2024-08-31T03:15:23.430007+0000 mgr.a (mgr.14388) 2774 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:15:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:24 smithi027 bash[22610]: cephadm 2024-08-31T03:15:23.431032+0000 mgr.a (mgr.14388) 2775 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:15:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:24 smithi191 bash[24992]: audit 2024-08-31T03:15:22.723832+0000 mgr.a (mgr.14388) 2772 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:15:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:24 smithi191 bash[24992]: cluster 2024-08-31T03:15:23.294496+0000 mgr.a (mgr.14388) 2773 : cluster [DBG] pgmap v1922: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:15:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:24 smithi191 bash[24992]: audit 2024-08-31T03:15:23.430007+0000 mgr.a (mgr.14388) 2774 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:15:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:24 smithi191 bash[24992]: cephadm 2024-08-31T03:15:23.431032+0000 mgr.a (mgr.14388) 2775 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:15:24.921 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:24.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:24.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:24.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:15:25.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:25 smithi163 bash[24253]: audit 2024-08-31T03:15:24.504638+0000 mgr.a (mgr.14388) 2776 : audit [DBG] from='client.71733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:25 smithi027 bash[22610]: audit 2024-08-31T03:15:24.504638+0000 mgr.a (mgr.14388) 2776 : audit [DBG] from='client.71733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:25 smithi191 bash[24992]: audit 2024-08-31T03:15:24.504638+0000 mgr.a (mgr.14388) 2776 : audit [DBG] from='client.71733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:26.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:26 smithi163 bash[24253]: cluster 2024-08-31T03:15:25.295439+0000 mgr.a (mgr.14388) 2777 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:15:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:26 smithi027 bash[22610]: cluster 2024-08-31T03:15:25.295439+0000 mgr.a (mgr.14388) 2777 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:15:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:26 smithi191 bash[24992]: cluster 2024-08-31T03:15:25.295439+0000 mgr.a (mgr.14388) 2777 : cluster [DBG] pgmap v1923: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:15:28.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:28 smithi163 bash[24253]: cluster 2024-08-31T03:15:27.296246+0000 mgr.a (mgr.14388) 2778 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:15:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:28 smithi027 bash[22610]: cluster 2024-08-31T03:15:27.296246+0000 mgr.a (mgr.14388) 2778 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:15:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:28 smithi191 bash[24992]: cluster 2024-08-31T03:15:27.296246+0000 mgr.a (mgr.14388) 2778 : cluster [DBG] pgmap v1924: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:15:29.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:29.923 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:29.924 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:30.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:30 smithi163 bash[24253]: cluster 2024-08-31T03:15:29.298398+0000 mgr.a (mgr.14388) 2779 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:30.704 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:30.704 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:30.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:30.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:30.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:15:30.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:30 smithi027 bash[22610]: cluster 2024-08-31T03:15:29.298398+0000 mgr.a (mgr.14388) 2779 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:30 smithi191 bash[24992]: cluster 2024-08-31T03:15:29.298398+0000 mgr.a (mgr.14388) 2779 : cluster [DBG] pgmap v1925: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:31 smithi027 bash[22610]: audit 2024-08-31T03:15:30.257777+0000 mgr.a (mgr.14388) 2780 : audit [DBG] from='client.71811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:31 smithi191 bash[24992]: audit 2024-08-31T03:15:30.257777+0000 mgr.a (mgr.14388) 2780 : audit [DBG] from='client.71811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:31 smithi163 bash[24253]: audit 2024-08-31T03:15:30.257777+0000 mgr.a (mgr.14388) 2780 : audit [DBG] from='client.71811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:32 smithi027 bash[22610]: cluster 2024-08-31T03:15:31.299310+0000 mgr.a (mgr.14388) 2781 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:32 smithi191 bash[24992]: cluster 2024-08-31T03:15:31.299310+0000 mgr.a (mgr.14388) 2781 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:32 smithi163 bash[24253]: cluster 2024-08-31T03:15:31.299310+0000 mgr.a (mgr.14388) 2781 : cluster [DBG] pgmap v1926: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:34 smithi027 bash[22610]: cluster 2024-08-31T03:15:33.301453+0000 mgr.a (mgr.14388) 2782 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:34 smithi191 bash[24992]: cluster 2024-08-31T03:15:33.301453+0000 mgr.a (mgr.14388) 2782 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:34 smithi163 bash[24253]: cluster 2024-08-31T03:15:33.301453+0000 mgr.a (mgr.14388) 2782 : cluster [DBG] pgmap v1927: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:35.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:35.707 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:35.707 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:36.476 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:15:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:36 smithi027 bash[22610]: cluster 2024-08-31T03:15:35.302238+0000 mgr.a (mgr.14388) 2783 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:15:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:36 smithi191 bash[24992]: cluster 2024-08-31T03:15:35.302238+0000 mgr.a (mgr.14388) 2783 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:15:36.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:36 smithi163 bash[24253]: cluster 2024-08-31T03:15:35.302238+0000 mgr.a (mgr.14388) 2783 : cluster [DBG] pgmap v1928: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:15:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:37 smithi027 bash[22610]: audit 2024-08-31T03:15:36.048740+0000 mgr.a (mgr.14388) 2784 : audit [DBG] from='client.71886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:37 smithi191 bash[24992]: audit 2024-08-31T03:15:36.048740+0000 mgr.a (mgr.14388) 2784 : audit [DBG] from='client.71886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:37.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:37 smithi163 bash[24253]: audit 2024-08-31T03:15:36.048740+0000 mgr.a (mgr.14388) 2784 : audit [DBG] from='client.71886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:38 smithi027 bash[22610]: cluster 2024-08-31T03:15:37.303180+0000 mgr.a (mgr.14388) 2785 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:15:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:38 smithi191 bash[24992]: cluster 2024-08-31T03:15:37.303180+0000 mgr.a (mgr.14388) 2785 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:15:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:38 smithi163 bash[24253]: cluster 2024-08-31T03:15:37.303180+0000 mgr.a (mgr.14388) 2785 : cluster [DBG] pgmap v1929: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:15:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:40 smithi027 bash[22610]: cluster 2024-08-31T03:15:39.305356+0000 mgr.a (mgr.14388) 2786 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:40 smithi191 bash[24992]: cluster 2024-08-31T03:15:39.305356+0000 mgr.a (mgr.14388) 2786 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:40 smithi163 bash[24253]: cluster 2024-08-31T03:15:39.305356+0000 mgr.a (mgr.14388) 2786 : cluster [DBG] pgmap v1930: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:15:41.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:41.478 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:41.479 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:42.224 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:42.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:42.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:42.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:42.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:15:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:42 smithi191 bash[24992]: cluster 2024-08-31T03:15:41.306052+0000 mgr.a (mgr.14388) 2787 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:42.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:42 smithi163 bash[24253]: cluster 2024-08-31T03:15:41.306052+0000 mgr.a (mgr.14388) 2787 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:42 smithi027 bash[22610]: cluster 2024-08-31T03:15:41.306052+0000 mgr.a (mgr.14388) 2787 : cluster [DBG] pgmap v1931: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:43 smithi191 bash[24992]: audit 2024-08-31T03:15:41.806208+0000 mgr.a (mgr.14388) 2788 : audit [DBG] from='client.71964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:43.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:43 smithi163 bash[24253]: audit 2024-08-31T03:15:41.806208+0000 mgr.a (mgr.14388) 2788 : audit [DBG] from='client.71964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:43 smithi027 bash[22610]: audit 2024-08-31T03:15:41.806208+0000 mgr.a (mgr.14388) 2788 : audit [DBG] from='client.71964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:44 smithi191 bash[24992]: cluster 2024-08-31T03:15:43.308278+0000 mgr.a (mgr.14388) 2789 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:44.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:44 smithi163 bash[24253]: cluster 2024-08-31T03:15:43.308278+0000 mgr.a (mgr.14388) 2789 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:44 smithi027 bash[22610]: cluster 2024-08-31T03:15:43.308278+0000 mgr.a (mgr.14388) 2789 : cluster [DBG] pgmap v1932: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:15:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:46 smithi191 bash[24992]: cluster 2024-08-31T03:15:45.309042+0000 mgr.a (mgr.14388) 2790 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:46.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:46 smithi163 bash[24253]: cluster 2024-08-31T03:15:45.309042+0000 mgr.a (mgr.14388) 2790 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:46 smithi027 bash[22610]: cluster 2024-08-31T03:15:45.309042+0000 mgr.a (mgr.14388) 2790 : cluster [DBG] pgmap v1933: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:47.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:47.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:47.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:47.985 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:47.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:47.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:47.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:47.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:15:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:48 smithi191 bash[24992]: cluster 2024-08-31T03:15:47.309583+0000 mgr.a (mgr.14388) 2791 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:48 smithi191 bash[24992]: audit 2024-08-31T03:15:47.562990+0000 mgr.a (mgr.14388) 2792 : audit [DBG] from='client.72039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:48 smithi163 bash[24253]: cluster 2024-08-31T03:15:47.309583+0000 mgr.a (mgr.14388) 2791 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:48 smithi163 bash[24253]: audit 2024-08-31T03:15:47.562990+0000 mgr.a (mgr.14388) 2792 : audit [DBG] from='client.72039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:48 smithi027 bash[22610]: cluster 2024-08-31T03:15:47.309583+0000 mgr.a (mgr.14388) 2791 : cluster [DBG] pgmap v1934: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:48 smithi027 bash[22610]: audit 2024-08-31T03:15:47.562990+0000 mgr.a (mgr.14388) 2792 : audit [DBG] from='client.72039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:50 smithi191 bash[24992]: cluster 2024-08-31T03:15:49.311977+0000 mgr.a (mgr.14388) 2793 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:15:50.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:50 smithi163 bash[24253]: cluster 2024-08-31T03:15:49.311977+0000 mgr.a (mgr.14388) 2793 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:15:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:50 smithi027 bash[22610]: cluster 2024-08-31T03:15:49.311977+0000 mgr.a (mgr.14388) 2793 : cluster [DBG] pgmap v1935: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:15:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:52 smithi191 bash[24992]: cluster 2024-08-31T03:15:51.312918+0000 mgr.a (mgr.14388) 2794 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:15:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:52 smithi163 bash[24253]: cluster 2024-08-31T03:15:51.312918+0000 mgr.a (mgr.14388) 2794 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:15:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:52 smithi027 bash[22610]: cluster 2024-08-31T03:15:51.312918+0000 mgr.a (mgr.14388) 2794 : cluster [DBG] pgmap v1936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:15:52.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:52.988 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:52.988 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:53.728 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:53.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:53.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:53.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:53.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:15:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:54 smithi191 bash[24992]: cluster 2024-08-31T03:15:53.314852+0000 mgr.a (mgr.14388) 2795 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:54 smithi191 bash[24992]: audit 2024-08-31T03:15:53.321487+0000 mgr.a (mgr.14388) 2796 : audit [DBG] from='client.72114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:54.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:54 smithi163 bash[24253]: cluster 2024-08-31T03:15:53.314852+0000 mgr.a (mgr.14388) 2795 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:54.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:54 smithi163 bash[24253]: audit 2024-08-31T03:15:53.321487+0000 mgr.a (mgr.14388) 2796 : audit [DBG] from='client.72114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:54 smithi027 bash[22610]: cluster 2024-08-31T03:15:53.314852+0000 mgr.a (mgr.14388) 2795 : cluster [DBG] pgmap v1937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:15:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:54 smithi027 bash[22610]: audit 2024-08-31T03:15:53.321487+0000 mgr.a (mgr.14388) 2796 : audit [DBG] from='client.72114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:15:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:56 smithi191 bash[24992]: cluster 2024-08-31T03:15:55.315713+0000 mgr.a (mgr.14388) 2797 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:15:56.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:56 smithi163 bash[24253]: cluster 2024-08-31T03:15:55.315713+0000 mgr.a (mgr.14388) 2797 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:15:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:56 smithi027 bash[22610]: cluster 2024-08-31T03:15:55.315713+0000 mgr.a (mgr.14388) 2797 : cluster [DBG] pgmap v1938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:15:58.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:15:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:15:58.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:15:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:15:58 smithi191 bash[24992]: cluster 2024-08-31T03:15:57.316485+0000 mgr.a (mgr.14388) 2798 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:15:58.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:15:58 smithi163 bash[24253]: cluster 2024-08-31T03:15:57.316485+0000 mgr.a (mgr.14388) 2798 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:15:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:15:58 smithi027 bash[22610]: cluster 2024-08-31T03:15:57.316485+0000 mgr.a (mgr.14388) 2798 : cluster [DBG] pgmap v1939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:15:59.477 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:15:59.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:15:59.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:15:59.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:15:59.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:00 smithi191 bash[24992]: audit 2024-08-31T03:15:59.065531+0000 mgr.a (mgr.14388) 2799 : audit [DBG] from='client.72192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:00 smithi191 bash[24992]: cluster 2024-08-31T03:15:59.317763+0000 mgr.a (mgr.14388) 2800 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:00 smithi163 bash[24253]: audit 2024-08-31T03:15:59.065531+0000 mgr.a (mgr.14388) 2799 : audit [DBG] from='client.72192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:00 smithi163 bash[24253]: cluster 2024-08-31T03:15:59.317763+0000 mgr.a (mgr.14388) 2800 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:00 smithi027 bash[22610]: audit 2024-08-31T03:15:59.065531+0000 mgr.a (mgr.14388) 2799 : audit [DBG] from='client.72192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:00 smithi027 bash[22610]: cluster 2024-08-31T03:15:59.317763+0000 mgr.a (mgr.14388) 2800 : cluster [DBG] pgmap v1940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:02 smithi191 bash[24992]: cluster 2024-08-31T03:16:01.318608+0000 mgr.a (mgr.14388) 2801 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T03:16:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:02 smithi163 bash[24253]: cluster 2024-08-31T03:16:01.318608+0000 mgr.a (mgr.14388) 2801 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T03:16:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:02 smithi027 bash[22610]: cluster 2024-08-31T03:16:01.318608+0000 mgr.a (mgr.14388) 2801 : cluster [DBG] pgmap v1941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T03:16:04.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:16:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:16:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:16:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:04 smithi191 bash[24992]: cluster 2024-08-31T03:16:03.320748+0000 mgr.a (mgr.14388) 2802 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T03:16:04.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:04 smithi163 bash[24253]: cluster 2024-08-31T03:16:03.320748+0000 mgr.a (mgr.14388) 2802 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T03:16:04.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:04 smithi027 bash[22610]: cluster 2024-08-31T03:16:03.320748+0000 mgr.a (mgr.14388) 2802 : cluster [DBG] pgmap v1942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T03:16:05.228 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:16:05.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:16:05.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:16:05.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:16:05.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:06.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:06 smithi163 bash[24253]: audit 2024-08-31T03:16:04.815291+0000 mgr.a (mgr.14388) 2803 : audit [DBG] from='client.72267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:06.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:06 smithi163 bash[24253]: cluster 2024-08-31T03:16:05.321634+0000 mgr.a (mgr.14388) 2804 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:06 smithi027 bash[22610]: audit 2024-08-31T03:16:04.815291+0000 mgr.a (mgr.14388) 2803 : audit [DBG] from='client.72267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:06 smithi027 bash[22610]: cluster 2024-08-31T03:16:05.321634+0000 mgr.a (mgr.14388) 2804 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:06 smithi191 bash[24992]: audit 2024-08-31T03:16:04.815291+0000 mgr.a (mgr.14388) 2803 : audit [DBG] from='client.72267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:06 smithi191 bash[24992]: cluster 2024-08-31T03:16:05.321634+0000 mgr.a (mgr.14388) 2804 : cluster [DBG] pgmap v1943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:08.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:08 smithi163 bash[24253]: cluster 2024-08-31T03:16:07.322408+0000 mgr.a (mgr.14388) 2805 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:08 smithi027 bash[22610]: cluster 2024-08-31T03:16:07.322408+0000 mgr.a (mgr.14388) 2805 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:08 smithi191 bash[24992]: cluster 2024-08-31T03:16:07.322408+0000 mgr.a (mgr.14388) 2805 : cluster [DBG] pgmap v1944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:10.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:16:10.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:16:10.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:16:10.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:10 smithi163 bash[24253]: cluster 2024-08-31T03:16:09.324579+0000 mgr.a (mgr.14388) 2806 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:10.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:10 smithi027 bash[22610]: cluster 2024-08-31T03:16:09.324579+0000 mgr.a (mgr.14388) 2806 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:10.993 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:16:10.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:16:10.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:16:10.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:16:10.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:10 smithi191 bash[24992]: cluster 2024-08-31T03:16:09.324579+0000 mgr.a (mgr.14388) 2806 : cluster [DBG] pgmap v1945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:11.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:11 smithi163 bash[24253]: audit 2024-08-31T03:16:10.569612+0000 mgr.a (mgr.14388) 2807 : audit [DBG] from='client.72345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:11 smithi027 bash[22610]: audit 2024-08-31T03:16:10.569612+0000 mgr.a (mgr.14388) 2807 : audit [DBG] from='client.72345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:11 smithi191 bash[24992]: audit 2024-08-31T03:16:10.569612+0000 mgr.a (mgr.14388) 2807 : audit [DBG] from='client.72345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:12.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:12 smithi163 bash[24253]: cluster 2024-08-31T03:16:11.325457+0000 mgr.a (mgr.14388) 2808 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:12 smithi027 bash[22610]: cluster 2024-08-31T03:16:11.325457+0000 mgr.a (mgr.14388) 2808 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:12 smithi191 bash[24992]: cluster 2024-08-31T03:16:11.325457+0000 mgr.a (mgr.14388) 2808 : cluster [DBG] pgmap v1946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:14 smithi163 bash[24253]: cluster 2024-08-31T03:16:13.327609+0000 mgr.a (mgr.14388) 2809 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:14 smithi027 bash[22610]: cluster 2024-08-31T03:16:13.327609+0000 mgr.a (mgr.14388) 2809 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:14 smithi191 bash[24992]: cluster 2024-08-31T03:16:13.327609+0000 mgr.a (mgr.14388) 2809 : cluster [DBG] pgmap v1947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:15.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:16:15.996 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:16:15.996 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:16:16.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:16:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:16:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:16:16.769 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:16.769 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:16:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:16 smithi163 bash[24253]: cluster 2024-08-31T03:16:15.328353+0000 mgr.a (mgr.14388) 2810 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:16 smithi027 bash[22610]: cluster 2024-08-31T03:16:15.328353+0000 mgr.a (mgr.14388) 2810 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:16 smithi191 bash[24992]: cluster 2024-08-31T03:16:15.328353+0000 mgr.a (mgr.14388) 2810 : cluster [DBG] pgmap v1948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:17.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:17 smithi163 bash[24253]: audit 2024-08-31T03:16:16.332171+0000 mgr.a (mgr.14388) 2811 : audit [DBG] from='client.72420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:17 smithi027 bash[22610]: audit 2024-08-31T03:16:16.332171+0000 mgr.a (mgr.14388) 2811 : audit [DBG] from='client.72420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:17 smithi191 bash[24992]: audit 2024-08-31T03:16:16.332171+0000 mgr.a (mgr.14388) 2811 : audit [DBG] from='client.72420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:18.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:18 smithi163 bash[24253]: cluster 2024-08-31T03:16:17.329230+0000 mgr.a (mgr.14388) 2812 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:18 smithi027 bash[22610]: cluster 2024-08-31T03:16:17.329230+0000 mgr.a (mgr.14388) 2812 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:18 smithi191 bash[24992]: cluster 2024-08-31T03:16:17.329230+0000 mgr.a (mgr.14388) 2812 : cluster [DBG] pgmap v1949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:20.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:20 smithi163 bash[24253]: cluster 2024-08-31T03:16:19.331575+0000 mgr.a (mgr.14388) 2813 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:20 smithi027 bash[22610]: cluster 2024-08-31T03:16:19.331575+0000 mgr.a (mgr.14388) 2813 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:20 smithi191 bash[24992]: cluster 2024-08-31T03:16:19.331575+0000 mgr.a (mgr.14388) 2813 : cluster [DBG] pgmap v1950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:21.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:16:21.771 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:16:21.771 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:16:22.541 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:16:22.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:16:22.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:16:22.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:16:22.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:22.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:22 smithi163 bash[24253]: cluster 2024-08-31T03:16:21.332415+0000 mgr.a (mgr.14388) 2814 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:22 smithi027 bash[22610]: cluster 2024-08-31T03:16:21.332415+0000 mgr.a (mgr.14388) 2814 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:22 smithi191 bash[24992]: cluster 2024-08-31T03:16:21.332415+0000 mgr.a (mgr.14388) 2814 : cluster [DBG] pgmap v1951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:23.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:23 smithi163 bash[24253]: audit 2024-08-31T03:16:22.105836+0000 mgr.a (mgr.14388) 2815 : audit [DBG] from='client.72498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:23.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:23 smithi163 bash[24253]: audit 2024-08-31T03:16:23.481401+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:16:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:23 smithi027 bash[22610]: audit 2024-08-31T03:16:22.105836+0000 mgr.a (mgr.14388) 2815 : audit [DBG] from='client.72498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:23 smithi027 bash[22610]: audit 2024-08-31T03:16:23.481401+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:16:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:23 smithi191 bash[24992]: audit 2024-08-31T03:16:22.105836+0000 mgr.a (mgr.14388) 2815 : audit [DBG] from='client.72498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:23 smithi191 bash[24992]: audit 2024-08-31T03:16:23.481401+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:16:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:24 smithi163 bash[24253]: cluster 2024-08-31T03:16:23.334643+0000 mgr.a (mgr.14388) 2816 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:24 smithi163 bash[24253]: audit 2024-08-31T03:16:24.338286+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:16:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:24 smithi163 bash[24253]: audit 2024-08-31T03:16:24.339889+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:16:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:24 smithi163 bash[24253]: audit 2024-08-31T03:16:24.349547+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:16:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:24 smithi163 bash[24253]: audit 2024-08-31T03:16:24.352626+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:16:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:24 smithi163 bash[24253]: audit 2024-08-31T03:16:24.354921+0000 mgr.a (mgr.14388) 2817 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:16:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:24 smithi027 bash[22610]: cluster 2024-08-31T03:16:23.334643+0000 mgr.a (mgr.14388) 2816 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:24 smithi027 bash[22610]: audit 2024-08-31T03:16:24.338286+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:16:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:24 smithi027 bash[22610]: audit 2024-08-31T03:16:24.339889+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:16:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:24 smithi027 bash[22610]: audit 2024-08-31T03:16:24.349547+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:16:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:24 smithi027 bash[22610]: audit 2024-08-31T03:16:24.352626+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:16:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:24 smithi027 bash[22610]: audit 2024-08-31T03:16:24.354921+0000 mgr.a (mgr.14388) 2817 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:16:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:24 smithi191 bash[24992]: cluster 2024-08-31T03:16:23.334643+0000 mgr.a (mgr.14388) 2816 : cluster [DBG] pgmap v1952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:24 smithi191 bash[24992]: audit 2024-08-31T03:16:24.338286+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:16:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:24 smithi191 bash[24992]: audit 2024-08-31T03:16:24.339889+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:16:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:24 smithi191 bash[24992]: audit 2024-08-31T03:16:24.349547+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:16:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:24 smithi191 bash[24992]: audit 2024-08-31T03:16:24.352626+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:16:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:24 smithi191 bash[24992]: audit 2024-08-31T03:16:24.354921+0000 mgr.a (mgr.14388) 2817 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:16:25.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:16:25 smithi027 bash[22863]: debug 2024-08-31T03:16:25.075+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:16:25.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:16:25 smithi027 bash[22863]: debug 2024-08-31T03:16:25.075+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:16:25.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:25 smithi163 bash[24253]: audit 2024-08-31T03:16:25.080241+0000 mgr.a (mgr.14388) 2818 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:16:25.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:25 smithi163 bash[24253]: cephadm 2024-08-31T03:16:25.081602+0000 mgr.a (mgr.14388) 2819 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:16:25.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:25 smithi163 bash[24253]: cluster 2024-08-31T03:16:25.335620+0000 mgr.a (mgr.14388) 2820 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:25 smithi027 bash[22610]: audit 2024-08-31T03:16:25.080241+0000 mgr.a (mgr.14388) 2818 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:16:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:25 smithi027 bash[22610]: cephadm 2024-08-31T03:16:25.081602+0000 mgr.a (mgr.14388) 2819 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:16:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:25 smithi027 bash[22610]: cluster 2024-08-31T03:16:25.335620+0000 mgr.a (mgr.14388) 2820 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:25 smithi191 bash[24992]: audit 2024-08-31T03:16:25.080241+0000 mgr.a (mgr.14388) 2818 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:16:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:25 smithi191 bash[24992]: cephadm 2024-08-31T03:16:25.081602+0000 mgr.a (mgr.14388) 2819 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:16:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:25 smithi191 bash[24992]: cluster 2024-08-31T03:16:25.335620+0000 mgr.a (mgr.14388) 2820 : cluster [DBG] pgmap v1953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:27.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:16:27.543 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:16:27.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:16:28.306 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:16:28.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:16:28.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:16:28.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:16:28.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:28.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:28 smithi163 bash[24253]: cluster 2024-08-31T03:16:27.336435+0000 mgr.a (mgr.14388) 2821 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:28 smithi027 bash[22610]: cluster 2024-08-31T03:16:27.336435+0000 mgr.a (mgr.14388) 2821 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:28 smithi191 bash[24992]: cluster 2024-08-31T03:16:27.336435+0000 mgr.a (mgr.14388) 2821 : cluster [DBG] pgmap v1954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:29.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:29 smithi163 bash[24253]: audit 2024-08-31T03:16:27.879223+0000 mgr.a (mgr.14388) 2822 : audit [DBG] from='client.72684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:29 smithi027 bash[22610]: audit 2024-08-31T03:16:27.879223+0000 mgr.a (mgr.14388) 2822 : audit [DBG] from='client.72684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:29 smithi191 bash[24992]: audit 2024-08-31T03:16:27.879223+0000 mgr.a (mgr.14388) 2822 : audit [DBG] from='client.72684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:30.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:30 smithi163 bash[24253]: cluster 2024-08-31T03:16:29.339164+0000 mgr.a (mgr.14388) 2823 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:16:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:30 smithi027 bash[22610]: cluster 2024-08-31T03:16:29.339164+0000 mgr.a (mgr.14388) 2823 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:16:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:30 smithi191 bash[24992]: cluster 2024-08-31T03:16:29.339164+0000 mgr.a (mgr.14388) 2823 : cluster [DBG] pgmap v1955: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:16:32.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:32 smithi163 bash[24253]: cluster 2024-08-31T03:16:31.339964+0000 mgr.a (mgr.14388) 2824 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:16:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:32 smithi027 bash[22610]: cluster 2024-08-31T03:16:31.339964+0000 mgr.a (mgr.14388) 2824 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:16:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:32 smithi191 bash[24992]: cluster 2024-08-31T03:16:31.339964+0000 mgr.a (mgr.14388) 2824 : cluster [DBG] pgmap v1956: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:16:33.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:16:33.309 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:16:33.309 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:16:34.058 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:16:34.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:16:34.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:16:34.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:16:34.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:34.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:34 smithi163 bash[24253]: cluster 2024-08-31T03:16:33.341746+0000 mgr.a (mgr.14388) 2825 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:16:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:34 smithi027 bash[22610]: cluster 2024-08-31T03:16:33.341746+0000 mgr.a (mgr.14388) 2825 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:16:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:34 smithi191 bash[24992]: cluster 2024-08-31T03:16:33.341746+0000 mgr.a (mgr.14388) 2825 : cluster [DBG] pgmap v1957: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:16:35.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:35 smithi163 bash[24253]: audit 2024-08-31T03:16:33.645492+0000 mgr.a (mgr.14388) 2826 : audit [DBG] from='client.72762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:35 smithi027 bash[22610]: audit 2024-08-31T03:16:33.645492+0000 mgr.a (mgr.14388) 2826 : audit [DBG] from='client.72762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:35 smithi191 bash[24992]: audit 2024-08-31T03:16:33.645492+0000 mgr.a (mgr.14388) 2826 : audit [DBG] from='client.72762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:36.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:36 smithi163 bash[24253]: cluster 2024-08-31T03:16:35.342787+0000 mgr.a (mgr.14388) 2827 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:16:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:36 smithi027 bash[22610]: cluster 2024-08-31T03:16:35.342787+0000 mgr.a (mgr.14388) 2827 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:16:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:36 smithi191 bash[24992]: cluster 2024-08-31T03:16:35.342787+0000 mgr.a (mgr.14388) 2827 : cluster [DBG] pgmap v1958: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:16:38.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:38 smithi163 bash[24253]: cluster 2024-08-31T03:16:37.343763+0000 mgr.a (mgr.14388) 2828 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:16:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:38 smithi027 bash[22610]: cluster 2024-08-31T03:16:37.343763+0000 mgr.a (mgr.14388) 2828 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:16:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:38 smithi191 bash[24992]: cluster 2024-08-31T03:16:37.343763+0000 mgr.a (mgr.14388) 2828 : cluster [DBG] pgmap v1959: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:16:39.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:16:39.060 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:16:39.060 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:16:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:16:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:16:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:16:39.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:39.809 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:16:40.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:40 smithi163 bash[24253]: cluster 2024-08-31T03:16:39.345989+0000 mgr.a (mgr.14388) 2829 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:16:40.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:40 smithi163 bash[24253]: audit 2024-08-31T03:16:39.398688+0000 mgr.a (mgr.14388) 2830 : audit [DBG] from='client.72840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:40 smithi027 bash[22610]: cluster 2024-08-31T03:16:39.345989+0000 mgr.a (mgr.14388) 2829 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:16:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:40 smithi027 bash[22610]: audit 2024-08-31T03:16:39.398688+0000 mgr.a (mgr.14388) 2830 : audit [DBG] from='client.72840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:40 smithi191 bash[24992]: cluster 2024-08-31T03:16:39.345989+0000 mgr.a (mgr.14388) 2829 : cluster [DBG] pgmap v1960: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:16:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:40 smithi191 bash[24992]: audit 2024-08-31T03:16:39.398688+0000 mgr.a (mgr.14388) 2830 : audit [DBG] from='client.72840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:42.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:42 smithi163 bash[24253]: cluster 2024-08-31T03:16:41.346972+0000 mgr.a (mgr.14388) 2831 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:42 smithi027 bash[22610]: cluster 2024-08-31T03:16:41.346972+0000 mgr.a (mgr.14388) 2831 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:42 smithi191 bash[24992]: cluster 2024-08-31T03:16:41.346972+0000 mgr.a (mgr.14388) 2831 : cluster [DBG] pgmap v1961: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:44.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:44 smithi163 bash[24253]: cluster 2024-08-31T03:16:43.349163+0000 mgr.a (mgr.14388) 2832 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:44 smithi027 bash[22610]: cluster 2024-08-31T03:16:43.349163+0000 mgr.a (mgr.14388) 2832 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:44 smithi191 bash[24992]: cluster 2024-08-31T03:16:43.349163+0000 mgr.a (mgr.14388) 2832 : cluster [DBG] pgmap v1962: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:44.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:16:44.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:16:44.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:16:45.560 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:16:45.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:16:45.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:16:45.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:16:45.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:46.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:46 smithi163 bash[24253]: audit 2024-08-31T03:16:45.145294+0000 mgr.a (mgr.14388) 2833 : audit [DBG] from='client.72918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:46.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:46 smithi163 bash[24253]: cluster 2024-08-31T03:16:45.349673+0000 mgr.a (mgr.14388) 2834 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:46 smithi027 bash[22610]: audit 2024-08-31T03:16:45.145294+0000 mgr.a (mgr.14388) 2833 : audit [DBG] from='client.72918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:46 smithi027 bash[22610]: cluster 2024-08-31T03:16:45.349673+0000 mgr.a (mgr.14388) 2834 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:46 smithi191 bash[24992]: audit 2024-08-31T03:16:45.145294+0000 mgr.a (mgr.14388) 2833 : audit [DBG] from='client.72918 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:46 smithi191 bash[24992]: cluster 2024-08-31T03:16:45.349673+0000 mgr.a (mgr.14388) 2834 : cluster [DBG] pgmap v1963: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:48 smithi027 bash[22610]: cluster 2024-08-31T03:16:47.350549+0000 mgr.a (mgr.14388) 2835 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:48 smithi191 bash[24992]: cluster 2024-08-31T03:16:47.350549+0000 mgr.a (mgr.14388) 2835 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:48.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:48 smithi163 bash[24253]: cluster 2024-08-31T03:16:47.350549+0000 mgr.a (mgr.14388) 2835 : cluster [DBG] pgmap v1964: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:50.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:16:50.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:16:50.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:16:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:50 smithi027 bash[22610]: cluster 2024-08-31T03:16:49.352784+0000 mgr.a (mgr.14388) 2836 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:50 smithi191 bash[24992]: cluster 2024-08-31T03:16:49.352784+0000 mgr.a (mgr.14388) 2836 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:50.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:50 smithi163 bash[24253]: cluster 2024-08-31T03:16:49.352784+0000 mgr.a (mgr.14388) 2836 : cluster [DBG] pgmap v1965: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:51.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:16:51.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:16:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:16:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:16:51.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:52 smithi027 bash[22610]: audit 2024-08-31T03:16:50.894138+0000 mgr.a (mgr.14388) 2837 : audit [DBG] from='client.72993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:52 smithi027 bash[22610]: cluster 2024-08-31T03:16:51.353662+0000 mgr.a (mgr.14388) 2838 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:52 smithi191 bash[24992]: audit 2024-08-31T03:16:50.894138+0000 mgr.a (mgr.14388) 2837 : audit [DBG] from='client.72993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:52 smithi191 bash[24992]: cluster 2024-08-31T03:16:51.353662+0000 mgr.a (mgr.14388) 2838 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:52.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:52 smithi163 bash[24253]: audit 2024-08-31T03:16:50.894138+0000 mgr.a (mgr.14388) 2837 : audit [DBG] from='client.72993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:52.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:52 smithi163 bash[24253]: cluster 2024-08-31T03:16:51.353662+0000 mgr.a (mgr.14388) 2838 : cluster [DBG] pgmap v1966: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:54 smithi027 bash[22610]: cluster 2024-08-31T03:16:53.356015+0000 mgr.a (mgr.14388) 2839 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:54 smithi191 bash[24992]: cluster 2024-08-31T03:16:53.356015+0000 mgr.a (mgr.14388) 2839 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:54.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:54 smithi163 bash[24253]: cluster 2024-08-31T03:16:53.356015+0000 mgr.a (mgr.14388) 2839 : cluster [DBG] pgmap v1967: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:16:56.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:16:56.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:16:56.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:16:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:56 smithi027 bash[22610]: cluster 2024-08-31T03:16:55.356979+0000 mgr.a (mgr.14388) 2840 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:56 smithi191 bash[24992]: cluster 2024-08-31T03:16:55.356979+0000 mgr.a (mgr.14388) 2840 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:56.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:56 smithi163 bash[24253]: cluster 2024-08-31T03:16:55.356979+0000 mgr.a (mgr.14388) 2840 : cluster [DBG] pgmap v1968: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:57.069 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:16:57.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:16:57.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:16:57.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:16:57.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:16:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:58 smithi027 bash[22610]: audit 2024-08-31T03:16:56.633464+0000 mgr.a (mgr.14388) 2841 : audit [DBG] from='client.73068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:16:58 smithi027 bash[22610]: cluster 2024-08-31T03:16:57.357923+0000 mgr.a (mgr.14388) 2842 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:58 smithi191 bash[24992]: audit 2024-08-31T03:16:56.633464+0000 mgr.a (mgr.14388) 2841 : audit [DBG] from='client.73068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:16:58 smithi191 bash[24992]: cluster 2024-08-31T03:16:57.357923+0000 mgr.a (mgr.14388) 2842 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:16:58.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:58 smithi163 bash[24253]: audit 2024-08-31T03:16:56.633464+0000 mgr.a (mgr.14388) 2841 : audit [DBG] from='client.73068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:16:58.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:16:58 smithi163 bash[24253]: cluster 2024-08-31T03:16:57.357923+0000 mgr.a (mgr.14388) 2842 : cluster [DBG] pgmap v1969: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:00 smithi027 bash[22610]: cluster 2024-08-31T03:16:59.360113+0000 mgr.a (mgr.14388) 2843 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:17:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:00 smithi191 bash[24992]: cluster 2024-08-31T03:16:59.360113+0000 mgr.a (mgr.14388) 2843 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:17:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:00 smithi163 bash[24253]: cluster 2024-08-31T03:16:59.360113+0000 mgr.a (mgr.14388) 2843 : cluster [DBG] pgmap v1970: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:17:02.071 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:02.072 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:17:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:02 smithi027 bash[22610]: cluster 2024-08-31T03:17:01.360908+0000 mgr.a (mgr.14388) 2844 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:02 smithi191 bash[24992]: cluster 2024-08-31T03:17:01.360908+0000 mgr.a (mgr.14388) 2844 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:02.804 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:17:02.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:17:02.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:17:02.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:17:02.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:17:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:02 smithi163 bash[24253]: cluster 2024-08-31T03:17:01.360908+0000 mgr.a (mgr.14388) 2844 : cluster [DBG] pgmap v1971: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:03 smithi027 bash[22610]: audit 2024-08-31T03:17:02.403407+0000 mgr.a (mgr.14388) 2845 : audit [DBG] from='client.73143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:03 smithi191 bash[24992]: audit 2024-08-31T03:17:02.403407+0000 mgr.a (mgr.14388) 2845 : audit [DBG] from='client.73143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:03.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:03 smithi163 bash[24253]: audit 2024-08-31T03:17:02.403407+0000 mgr.a (mgr.14388) 2845 : audit [DBG] from='client.73143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:04 smithi191 bash[24992]: cluster 2024-08-31T03:17:03.363276+0000 mgr.a (mgr.14388) 2846 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:17:04.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:04 smithi163 bash[24253]: cluster 2024-08-31T03:17:03.363276+0000 mgr.a (mgr.14388) 2846 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:17:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:04 smithi027 bash[22610]: cluster 2024-08-31T03:17:03.363276+0000 mgr.a (mgr.14388) 2846 : cluster [DBG] pgmap v1972: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:17:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:06 smithi191 bash[24992]: cluster 2024-08-31T03:17:05.364044+0000 mgr.a (mgr.14388) 2847 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:06.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:06 smithi163 bash[24253]: cluster 2024-08-31T03:17:05.364044+0000 mgr.a (mgr.14388) 2847 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:06 smithi027 bash[22610]: cluster 2024-08-31T03:17:05.364044+0000 mgr.a (mgr.14388) 2847 : cluster [DBG] pgmap v1973: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:07.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:07.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:07.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:17:08.564 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:17:08.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:17:08.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:17:08.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:17:08.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:17:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:08 smithi191 bash[24992]: cluster 2024-08-31T03:17:07.364781+0000 mgr.a (mgr.14388) 2848 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:08.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:08 smithi163 bash[24253]: cluster 2024-08-31T03:17:07.364781+0000 mgr.a (mgr.14388) 2848 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:08 smithi027 bash[22610]: cluster 2024-08-31T03:17:07.364781+0000 mgr.a (mgr.14388) 2848 : cluster [DBG] pgmap v1974: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:09 smithi191 bash[24992]: audit 2024-08-31T03:17:08.143501+0000 mgr.a (mgr.14388) 2849 : audit [DBG] from='client.73212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:09.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:09 smithi163 bash[24253]: audit 2024-08-31T03:17:08.143501+0000 mgr.a (mgr.14388) 2849 : audit [DBG] from='client.73212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:09 smithi027 bash[22610]: audit 2024-08-31T03:17:08.143501+0000 mgr.a (mgr.14388) 2849 : audit [DBG] from='client.73212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:10 smithi191 bash[24992]: cluster 2024-08-31T03:17:09.367530+0000 mgr.a (mgr.14388) 2850 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:10.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:10 smithi163 bash[24253]: cluster 2024-08-31T03:17:09.367530+0000 mgr.a (mgr.14388) 2850 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:10 smithi027 bash[22610]: cluster 2024-08-31T03:17:09.367530+0000 mgr.a (mgr.14388) 2850 : cluster [DBG] pgmap v1975: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:12 smithi191 bash[24992]: cluster 2024-08-31T03:17:11.368303+0000 mgr.a (mgr.14388) 2851 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:17:12.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:12 smithi163 bash[24253]: cluster 2024-08-31T03:17:11.368303+0000 mgr.a (mgr.14388) 2851 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:17:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:12 smithi027 bash[22610]: cluster 2024-08-31T03:17:11.368303+0000 mgr.a (mgr.14388) 2851 : cluster [DBG] pgmap v1976: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:17:13.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:13.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:13.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:17:14.320 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:17:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:17:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:17:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:17:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:17:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:14 smithi191 bash[24992]: cluster 2024-08-31T03:17:13.370267+0000 mgr.a (mgr.14388) 2852 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:14 smithi163 bash[24253]: cluster 2024-08-31T03:17:13.370267+0000 mgr.a (mgr.14388) 2852 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:14 smithi027 bash[22610]: cluster 2024-08-31T03:17:13.370267+0000 mgr.a (mgr.14388) 2852 : cluster [DBG] pgmap v1977: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:15 smithi191 bash[24992]: audit 2024-08-31T03:17:13.903489+0000 mgr.a (mgr.14388) 2853 : audit [DBG] from='client.73287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:15.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:15 smithi163 bash[24253]: audit 2024-08-31T03:17:13.903489+0000 mgr.a (mgr.14388) 2853 : audit [DBG] from='client.73287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:15 smithi027 bash[22610]: audit 2024-08-31T03:17:13.903489+0000 mgr.a (mgr.14388) 2853 : audit [DBG] from='client.73287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:16 smithi191 bash[24992]: cluster 2024-08-31T03:17:15.371271+0000 mgr.a (mgr.14388) 2854 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:17:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:16 smithi163 bash[24253]: cluster 2024-08-31T03:17:15.371271+0000 mgr.a (mgr.14388) 2854 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:17:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:16 smithi027 bash[22610]: cluster 2024-08-31T03:17:15.371271+0000 mgr.a (mgr.14388) 2854 : cluster [DBG] pgmap v1978: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:17:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:18 smithi191 bash[24992]: cluster 2024-08-31T03:17:17.372060+0000 mgr.a (mgr.14388) 2855 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:17:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:18 smithi163 bash[24253]: cluster 2024-08-31T03:17:17.372060+0000 mgr.a (mgr.14388) 2855 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:17:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:18 smithi027 bash[22610]: cluster 2024-08-31T03:17:17.372060+0000 mgr.a (mgr.14388) 2855 : cluster [DBG] pgmap v1979: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:17:19.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:19.322 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:19.323 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:17:20.104 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:17:20.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:17:20.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:17:20.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:17:20.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:17:20.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:20 smithi163 bash[24253]: cluster 2024-08-31T03:17:19.374127+0000 mgr.a (mgr.14388) 2856 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:20 smithi027 bash[22610]: cluster 2024-08-31T03:17:19.374127+0000 mgr.a (mgr.14388) 2856 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:20 smithi191 bash[24992]: cluster 2024-08-31T03:17:19.374127+0000 mgr.a (mgr.14388) 2856 : cluster [DBG] pgmap v1980: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:21.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:21 smithi163 bash[24253]: audit 2024-08-31T03:17:19.664406+0000 mgr.a (mgr.14388) 2857 : audit [DBG] from='client.73365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:21 smithi027 bash[22610]: audit 2024-08-31T03:17:19.664406+0000 mgr.a (mgr.14388) 2857 : audit [DBG] from='client.73365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:21 smithi191 bash[24992]: audit 2024-08-31T03:17:19.664406+0000 mgr.a (mgr.14388) 2857 : audit [DBG] from='client.73365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:22 smithi163 bash[24253]: cluster 2024-08-31T03:17:21.375124+0000 mgr.a (mgr.14388) 2858 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:22 smithi027 bash[22610]: cluster 2024-08-31T03:17:21.375124+0000 mgr.a (mgr.14388) 2858 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:22 smithi191 bash[24992]: cluster 2024-08-31T03:17:21.375124+0000 mgr.a (mgr.14388) 2858 : cluster [DBG] pgmap v1981: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:24 smithi163 bash[24253]: cluster 2024-08-31T03:17:23.377296+0000 mgr.a (mgr.14388) 2859 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:17:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:24 smithi027 bash[22610]: cluster 2024-08-31T03:17:23.377296+0000 mgr.a (mgr.14388) 2859 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:17:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:24 smithi191 bash[24992]: cluster 2024-08-31T03:17:23.377296+0000 mgr.a (mgr.14388) 2859 : cluster [DBG] pgmap v1982: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:17:25.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:25.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:25.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:17:25.862 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:17:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:17:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:17:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:17:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:17:25.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:25 smithi163 bash[24253]: audit 2024-08-31T03:17:25.133701+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:17:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:25 smithi027 bash[22610]: audit 2024-08-31T03:17:25.133701+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:17:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:25 smithi191 bash[24992]: audit 2024-08-31T03:17:25.133701+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:17:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:26 smithi163 bash[24253]: cluster 2024-08-31T03:17:25.378052+0000 mgr.a (mgr.14388) 2860 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:26 smithi163 bash[24253]: audit 2024-08-31T03:17:25.443571+0000 mgr.a (mgr.14388) 2861 : audit [DBG] from='client.73437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:26 smithi163 bash[24253]: audit 2024-08-31T03:17:25.951513+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:17:26.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:26 smithi163 bash[24253]: audit 2024-08-31T03:17:25.953923+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:17:26.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:26 smithi163 bash[24253]: audit 2024-08-31T03:17:25.964367+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:17:26.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:26 smithi163 bash[24253]: audit 2024-08-31T03:17:25.969405+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:17:26.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:17:26 smithi027 bash[22863]: debug 2024-08-31T03:17:26.666+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:17:26.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:17:26 smithi027 bash[22863]: debug 2024-08-31T03:17:26.666+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:17:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:26 smithi027 bash[22610]: cluster 2024-08-31T03:17:25.378052+0000 mgr.a (mgr.14388) 2860 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:26 smithi027 bash[22610]: audit 2024-08-31T03:17:25.443571+0000 mgr.a (mgr.14388) 2861 : audit [DBG] from='client.73437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:26 smithi027 bash[22610]: audit 2024-08-31T03:17:25.951513+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:17:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:26 smithi027 bash[22610]: audit 2024-08-31T03:17:25.953923+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:17:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:26 smithi027 bash[22610]: audit 2024-08-31T03:17:25.964367+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:17:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:26 smithi027 bash[22610]: audit 2024-08-31T03:17:25.969405+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:17:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:26 smithi191 bash[24992]: cluster 2024-08-31T03:17:25.378052+0000 mgr.a (mgr.14388) 2860 : cluster [DBG] pgmap v1983: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:26 smithi191 bash[24992]: audit 2024-08-31T03:17:25.443571+0000 mgr.a (mgr.14388) 2861 : audit [DBG] from='client.73437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:26 smithi191 bash[24992]: audit 2024-08-31T03:17:25.951513+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:17:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:26 smithi191 bash[24992]: audit 2024-08-31T03:17:25.953923+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:17:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:26 smithi191 bash[24992]: audit 2024-08-31T03:17:25.964367+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:17:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:26 smithi191 bash[24992]: audit 2024-08-31T03:17:25.969405+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:17:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:27 smithi163 bash[24253]: audit 2024-08-31T03:17:25.972102+0000 mgr.a (mgr.14388) 2862 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:17:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:27 smithi027 bash[22610]: audit 2024-08-31T03:17:25.972102+0000 mgr.a (mgr.14388) 2862 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:17:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:27 smithi191 bash[24992]: audit 2024-08-31T03:17:25.972102+0000 mgr.a (mgr.14388) 2862 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:17:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:28 smithi163 bash[24253]: audit 2024-08-31T03:17:26.667552+0000 mgr.a (mgr.14388) 2863 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:17:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:28 smithi163 bash[24253]: cephadm 2024-08-31T03:17:26.668909+0000 mgr.a (mgr.14388) 2864 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:17:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:28 smithi163 bash[24253]: cluster 2024-08-31T03:17:27.379155+0000 mgr.a (mgr.14388) 2865 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:28 smithi027 bash[22610]: audit 2024-08-31T03:17:26.667552+0000 mgr.a (mgr.14388) 2863 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:17:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:28 smithi027 bash[22610]: cephadm 2024-08-31T03:17:26.668909+0000 mgr.a (mgr.14388) 2864 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:17:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:28 smithi027 bash[22610]: cluster 2024-08-31T03:17:27.379155+0000 mgr.a (mgr.14388) 2865 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:28 smithi191 bash[24992]: audit 2024-08-31T03:17:26.667552+0000 mgr.a (mgr.14388) 2863 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:17:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:28 smithi191 bash[24992]: cephadm 2024-08-31T03:17:26.668909+0000 mgr.a (mgr.14388) 2864 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:17:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:28 smithi191 bash[24992]: cluster 2024-08-31T03:17:27.379155+0000 mgr.a (mgr.14388) 2865 : cluster [DBG] pgmap v1984: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:30.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:30.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:30.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:17:30.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:30 smithi163 bash[24253]: cluster 2024-08-31T03:17:29.381379+0000 mgr.a (mgr.14388) 2866 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:30 smithi027 bash[22610]: cluster 2024-08-31T03:17:29.381379+0000 mgr.a (mgr.14388) 2866 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:30 smithi191 bash[24992]: cluster 2024-08-31T03:17:29.381379+0000 mgr.a (mgr.14388) 2866 : cluster [DBG] pgmap v1985: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:31.611 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:17:31.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:17:31.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:17:31.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:17:31.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:17:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:32 smithi163 bash[24253]: audit 2024-08-31T03:17:31.192707+0000 mgr.a (mgr.14388) 2867 : audit [DBG] from='client.73623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:32 smithi163 bash[24253]: cluster 2024-08-31T03:17:31.381941+0000 mgr.a (mgr.14388) 2868 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:32 smithi027 bash[22610]: audit 2024-08-31T03:17:31.192707+0000 mgr.a (mgr.14388) 2867 : audit [DBG] from='client.73623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:32 smithi027 bash[22610]: cluster 2024-08-31T03:17:31.381941+0000 mgr.a (mgr.14388) 2868 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:32 smithi191 bash[24992]: audit 2024-08-31T03:17:31.192707+0000 mgr.a (mgr.14388) 2867 : audit [DBG] from='client.73623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:32 smithi191 bash[24992]: cluster 2024-08-31T03:17:31.381941+0000 mgr.a (mgr.14388) 2868 : cluster [DBG] pgmap v1986: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:34 smithi163 bash[24253]: cluster 2024-08-31T03:17:33.384146+0000 mgr.a (mgr.14388) 2869 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:34 smithi027 bash[22610]: cluster 2024-08-31T03:17:33.384146+0000 mgr.a (mgr.14388) 2869 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:34 smithi191 bash[24992]: cluster 2024-08-31T03:17:33.384146+0000 mgr.a (mgr.14388) 2869 : cluster [DBG] pgmap v1987: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:36.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:36.614 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:36.614 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:17:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:36 smithi163 bash[24253]: cluster 2024-08-31T03:17:35.384922+0000 mgr.a (mgr.14388) 2870 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:36 smithi027 bash[22610]: cluster 2024-08-31T03:17:35.384922+0000 mgr.a (mgr.14388) 2870 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:36 smithi191 bash[24992]: cluster 2024-08-31T03:17:35.384922+0000 mgr.a (mgr.14388) 2870 : cluster [DBG] pgmap v1988: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:37.380 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:17:37.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:17:37.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:17:37.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:17:37.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:17:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:38 smithi163 bash[24253]: audit 2024-08-31T03:17:36.944059+0000 mgr.a (mgr.14388) 2871 : audit [DBG] from='client.73695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:38 smithi163 bash[24253]: cluster 2024-08-31T03:17:37.385512+0000 mgr.a (mgr.14388) 2872 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:38 smithi027 bash[22610]: audit 2024-08-31T03:17:36.944059+0000 mgr.a (mgr.14388) 2871 : audit [DBG] from='client.73695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:38 smithi027 bash[22610]: cluster 2024-08-31T03:17:37.385512+0000 mgr.a (mgr.14388) 2872 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:38 smithi191 bash[24992]: audit 2024-08-31T03:17:36.944059+0000 mgr.a (mgr.14388) 2871 : audit [DBG] from='client.73695 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:38 smithi191 bash[24992]: cluster 2024-08-31T03:17:37.385512+0000 mgr.a (mgr.14388) 2872 : cluster [DBG] pgmap v1989: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:40 smithi163 bash[24253]: cluster 2024-08-31T03:17:39.387825+0000 mgr.a (mgr.14388) 2873 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:40 smithi027 bash[22610]: cluster 2024-08-31T03:17:39.387825+0000 mgr.a (mgr.14388) 2873 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:40 smithi191 bash[24992]: cluster 2024-08-31T03:17:39.387825+0000 mgr.a (mgr.14388) 2873 : cluster [DBG] pgmap v1990: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:17:42.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:42.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:42.383 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:17:42.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:42 smithi163 bash[24253]: cluster 2024-08-31T03:17:41.388778+0000 mgr.a (mgr.14388) 2874 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:42 smithi027 bash[22610]: cluster 2024-08-31T03:17:41.388778+0000 mgr.a (mgr.14388) 2874 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:42 smithi191 bash[24992]: cluster 2024-08-31T03:17:41.388778+0000 mgr.a (mgr.14388) 2874 : cluster [DBG] pgmap v1991: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:43.158 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:17:43.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:17:43.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:17:43.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:17:43.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:17:43.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:43 smithi163 bash[24253]: audit 2024-08-31T03:17:42.721786+0000 mgr.a (mgr.14388) 2875 : audit [DBG] from='client.73773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:43.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:43 smithi163 bash[24253]: cluster 2024-08-31T03:17:43.391499+0000 mgr.a (mgr.14388) 2876 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:17:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:43 smithi027 bash[22610]: audit 2024-08-31T03:17:42.721786+0000 mgr.a (mgr.14388) 2875 : audit [DBG] from='client.73773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:43 smithi027 bash[22610]: cluster 2024-08-31T03:17:43.391499+0000 mgr.a (mgr.14388) 2876 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:17:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:43 smithi191 bash[24992]: audit 2024-08-31T03:17:42.721786+0000 mgr.a (mgr.14388) 2875 : audit [DBG] from='client.73773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:43 smithi191 bash[24992]: cluster 2024-08-31T03:17:43.391499+0000 mgr.a (mgr.14388) 2876 : cluster [DBG] pgmap v1992: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:17:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:46 smithi027 bash[22610]: cluster 2024-08-31T03:17:45.392265+0000 mgr.a (mgr.14388) 2877 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:17:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:46 smithi191 bash[24992]: cluster 2024-08-31T03:17:45.392265+0000 mgr.a (mgr.14388) 2877 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:17:46.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:46 smithi163 bash[24253]: cluster 2024-08-31T03:17:45.392265+0000 mgr.a (mgr.14388) 2877 : cluster [DBG] pgmap v1993: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:17:48.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:48.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:48.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:17:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:48 smithi027 bash[22610]: cluster 2024-08-31T03:17:47.393031+0000 mgr.a (mgr.14388) 2878 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:17:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:48 smithi191 bash[24992]: cluster 2024-08-31T03:17:47.393031+0000 mgr.a (mgr.14388) 2878 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:17:48.908 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:17:48.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:17:48.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:17:48.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:17:48.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:17:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:48 smithi163 bash[24253]: cluster 2024-08-31T03:17:47.393031+0000 mgr.a (mgr.14388) 2878 : cluster [DBG] pgmap v1994: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:17:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:49 smithi027 bash[22610]: audit 2024-08-31T03:17:48.486964+0000 mgr.a (mgr.14388) 2879 : audit [DBG] from='client.73845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:49 smithi191 bash[24992]: audit 2024-08-31T03:17:48.486964+0000 mgr.a (mgr.14388) 2879 : audit [DBG] from='client.73845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:49.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:49 smithi163 bash[24253]: audit 2024-08-31T03:17:48.486964+0000 mgr.a (mgr.14388) 2879 : audit [DBG] from='client.73845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:50 smithi027 bash[22610]: cluster 2024-08-31T03:17:49.395809+0000 mgr.a (mgr.14388) 2880 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:50 smithi191 bash[24992]: cluster 2024-08-31T03:17:49.395809+0000 mgr.a (mgr.14388) 2880 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:50.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:50 smithi163 bash[24253]: cluster 2024-08-31T03:17:49.395809+0000 mgr.a (mgr.14388) 2880 : cluster [DBG] pgmap v1995: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:52 smithi027 bash[22610]: cluster 2024-08-31T03:17:51.396612+0000 mgr.a (mgr.14388) 2881 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:17:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:52 smithi191 bash[24992]: cluster 2024-08-31T03:17:51.396612+0000 mgr.a (mgr.14388) 2881 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:17:52.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:52 smithi163 bash[24253]: cluster 2024-08-31T03:17:51.396612+0000 mgr.a (mgr.14388) 2881 : cluster [DBG] pgmap v1996: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:17:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:17:54.677 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:17:54.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:17:54.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:17:54.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:17:54.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:17:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:54 smithi027 bash[22610]: cluster 2024-08-31T03:17:53.398526+0000 mgr.a (mgr.14388) 2882 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:54 smithi191 bash[24992]: cluster 2024-08-31T03:17:53.398526+0000 mgr.a (mgr.14388) 2882 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:54.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:54 smithi163 bash[24253]: cluster 2024-08-31T03:17:53.398526+0000 mgr.a (mgr.14388) 2882 : cluster [DBG] pgmap v1997: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:17:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:55 smithi027 bash[22610]: audit 2024-08-31T03:17:54.241521+0000 mgr.a (mgr.14388) 2883 : audit [DBG] from='client.73923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:55 smithi191 bash[24992]: audit 2024-08-31T03:17:54.241521+0000 mgr.a (mgr.14388) 2883 : audit [DBG] from='client.73923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:55.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:55 smithi163 bash[24253]: audit 2024-08-31T03:17:54.241521+0000 mgr.a (mgr.14388) 2883 : audit [DBG] from='client.73923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:17:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:56 smithi191 bash[24992]: cluster 2024-08-31T03:17:55.399541+0000 mgr.a (mgr.14388) 2884 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:17:56.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:56 smithi163 bash[24253]: cluster 2024-08-31T03:17:55.399541+0000 mgr.a (mgr.14388) 2884 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:17:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:56 smithi027 bash[22610]: cluster 2024-08-31T03:17:55.399541+0000 mgr.a (mgr.14388) 2884 : cluster [DBG] pgmap v1998: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:17:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:17:58 smithi191 bash[24992]: cluster 2024-08-31T03:17:57.400314+0000 mgr.a (mgr.14388) 2885 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:17:58.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:17:58 smithi163 bash[24253]: cluster 2024-08-31T03:17:57.400314+0000 mgr.a (mgr.14388) 2885 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:17:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:17:58 smithi027 bash[22610]: cluster 2024-08-31T03:17:57.400314+0000 mgr.a (mgr.14388) 2885 : cluster [DBG] pgmap v1999: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:17:59.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:17:59.680 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:17:59.680 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:00.444 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:00.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:00.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:00.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:00.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:00 smithi191 bash[24992]: cluster 2024-08-31T03:17:59.402464+0000 mgr.a (mgr.14388) 2886 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:00 smithi163 bash[24253]: cluster 2024-08-31T03:17:59.402464+0000 mgr.a (mgr.14388) 2886 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:00 smithi027 bash[22610]: cluster 2024-08-31T03:17:59.402464+0000 mgr.a (mgr.14388) 2886 : cluster [DBG] pgmap v2000: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:01 smithi191 bash[24992]: audit 2024-08-31T03:18:00.015094+0000 mgr.a (mgr.14388) 2887 : audit [DBG] from='client.73998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:01.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:01 smithi163 bash[24253]: audit 2024-08-31T03:18:00.015094+0000 mgr.a (mgr.14388) 2887 : audit [DBG] from='client.73998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:01 smithi027 bash[22610]: audit 2024-08-31T03:18:00.015094+0000 mgr.a (mgr.14388) 2887 : audit [DBG] from='client.73998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:02 smithi191 bash[24992]: cluster 2024-08-31T03:18:01.403378+0000 mgr.a (mgr.14388) 2888 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:02 smithi163 bash[24253]: cluster 2024-08-31T03:18:01.403378+0000 mgr.a (mgr.14388) 2888 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:02 smithi027 bash[22610]: cluster 2024-08-31T03:18:01.403378+0000 mgr.a (mgr.14388) 2888 : cluster [DBG] pgmap v2001: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:04 smithi191 bash[24992]: cluster 2024-08-31T03:18:03.405524+0000 mgr.a (mgr.14388) 2889 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:04.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:04 smithi163 bash[24253]: cluster 2024-08-31T03:18:03.405524+0000 mgr.a (mgr.14388) 2889 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:04 smithi027 bash[22610]: cluster 2024-08-31T03:18:03.405524+0000 mgr.a (mgr.14388) 2889 : cluster [DBG] pgmap v2002: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:05.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:18:05.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:18:05.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:06.219 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:06.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:06 smithi191 bash[24992]: cluster 2024-08-31T03:18:05.406296+0000 mgr.a (mgr.14388) 2890 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:06.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:06 smithi163 bash[24253]: cluster 2024-08-31T03:18:05.406296+0000 mgr.a (mgr.14388) 2890 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:06 smithi027 bash[22610]: cluster 2024-08-31T03:18:05.406296+0000 mgr.a (mgr.14388) 2890 : cluster [DBG] pgmap v2003: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:07 smithi191 bash[24992]: audit 2024-08-31T03:18:05.784317+0000 mgr.a (mgr.14388) 2891 : audit [DBG] from='client.74070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:07.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:07 smithi163 bash[24253]: audit 2024-08-31T03:18:05.784317+0000 mgr.a (mgr.14388) 2891 : audit [DBG] from='client.74070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:07 smithi027 bash[22610]: audit 2024-08-31T03:18:05.784317+0000 mgr.a (mgr.14388) 2891 : audit [DBG] from='client.74070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:08 smithi191 bash[24992]: cluster 2024-08-31T03:18:07.407217+0000 mgr.a (mgr.14388) 2892 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:08.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:08 smithi163 bash[24253]: cluster 2024-08-31T03:18:07.407217+0000 mgr.a (mgr.14388) 2892 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:08 smithi027 bash[22610]: cluster 2024-08-31T03:18:07.407217+0000 mgr.a (mgr.14388) 2892 : cluster [DBG] pgmap v2004: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:10 smithi191 bash[24992]: cluster 2024-08-31T03:18:09.409430+0000 mgr.a (mgr.14388) 2893 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:10.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:10 smithi163 bash[24253]: cluster 2024-08-31T03:18:09.409430+0000 mgr.a (mgr.14388) 2893 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:10 smithi027 bash[22610]: cluster 2024-08-31T03:18:09.409430+0000 mgr.a (mgr.14388) 2893 : cluster [DBG] pgmap v2005: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:11.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:18:11.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:18:11.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:11.985 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:11.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:11.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:11.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:11.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:12.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:12 smithi163 bash[24253]: cluster 2024-08-31T03:18:11.410136+0000 mgr.a (mgr.14388) 2894 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:12.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:12 smithi163 bash[24253]: audit 2024-08-31T03:18:11.555453+0000 mgr.a (mgr.14388) 2895 : audit [DBG] from='client.74148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:12 smithi027 bash[22610]: cluster 2024-08-31T03:18:11.410136+0000 mgr.a (mgr.14388) 2894 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:12 smithi027 bash[22610]: audit 2024-08-31T03:18:11.555453+0000 mgr.a (mgr.14388) 2895 : audit [DBG] from='client.74148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:12 smithi191 bash[24992]: cluster 2024-08-31T03:18:11.410136+0000 mgr.a (mgr.14388) 2894 : cluster [DBG] pgmap v2006: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:12 smithi191 bash[24992]: audit 2024-08-31T03:18:11.555453+0000 mgr.a (mgr.14388) 2895 : audit [DBG] from='client.74148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:14 smithi163 bash[24253]: cluster 2024-08-31T03:18:13.412346+0000 mgr.a (mgr.14388) 2896 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:14 smithi027 bash[22610]: cluster 2024-08-31T03:18:13.412346+0000 mgr.a (mgr.14388) 2896 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:14 smithi191 bash[24992]: cluster 2024-08-31T03:18:13.412346+0000 mgr.a (mgr.14388) 2896 : cluster [DBG] pgmap v2007: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:16 smithi163 bash[24253]: cluster 2024-08-31T03:18:15.413116+0000 mgr.a (mgr.14388) 2897 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:16 smithi027 bash[22610]: cluster 2024-08-31T03:18:15.413116+0000 mgr.a (mgr.14388) 2897 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:16.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:18:16.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:18:16.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:16 smithi191 bash[24992]: cluster 2024-08-31T03:18:15.413116+0000 mgr.a (mgr.14388) 2897 : cluster [DBG] pgmap v2008: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:17.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:17.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:17.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:17.747 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:17.747 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:18 smithi163 bash[24253]: audit 2024-08-31T03:18:17.319897+0000 mgr.a (mgr.14388) 2898 : audit [DBG] from='client.74226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:18 smithi163 bash[24253]: cluster 2024-08-31T03:18:17.413635+0000 mgr.a (mgr.14388) 2899 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:18 smithi027 bash[22610]: audit 2024-08-31T03:18:17.319897+0000 mgr.a (mgr.14388) 2898 : audit [DBG] from='client.74226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:18 smithi027 bash[22610]: cluster 2024-08-31T03:18:17.413635+0000 mgr.a (mgr.14388) 2899 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:18 smithi191 bash[24992]: audit 2024-08-31T03:18:17.319897+0000 mgr.a (mgr.14388) 2898 : audit [DBG] from='client.74226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:19.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:18 smithi191 bash[24992]: cluster 2024-08-31T03:18:17.413635+0000 mgr.a (mgr.14388) 2899 : cluster [DBG] pgmap v2009: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:20.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:20 smithi163 bash[24253]: cluster 2024-08-31T03:18:19.415938+0000 mgr.a (mgr.14388) 2900 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:20 smithi027 bash[22610]: cluster 2024-08-31T03:18:19.415938+0000 mgr.a (mgr.14388) 2900 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:20 smithi191 bash[24992]: cluster 2024-08-31T03:18:19.415938+0000 mgr.a (mgr.14388) 2900 : cluster [DBG] pgmap v2010: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:22.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:18:22.749 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:18:22.749 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:22 smithi163 bash[24253]: cluster 2024-08-31T03:18:21.416716+0000 mgr.a (mgr.14388) 2901 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:22 smithi027 bash[22610]: cluster 2024-08-31T03:18:21.416716+0000 mgr.a (mgr.14388) 2901 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:22 smithi191 bash[24992]: cluster 2024-08-31T03:18:21.416716+0000 mgr.a (mgr.14388) 2901 : cluster [DBG] pgmap v2011: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:23.519 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:23.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:23.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:23.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:23.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:24 smithi163 bash[24253]: audit 2024-08-31T03:18:23.085011+0000 mgr.a (mgr.14388) 2902 : audit [DBG] from='client.74304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:24 smithi163 bash[24253]: cluster 2024-08-31T03:18:23.418437+0000 mgr.a (mgr.14388) 2903 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:24 smithi027 bash[22610]: audit 2024-08-31T03:18:23.085011+0000 mgr.a (mgr.14388) 2902 : audit [DBG] from='client.74304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:24 smithi027 bash[22610]: cluster 2024-08-31T03:18:23.418437+0000 mgr.a (mgr.14388) 2903 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:24 smithi191 bash[24992]: audit 2024-08-31T03:18:23.085011+0000 mgr.a (mgr.14388) 2902 : audit [DBG] from='client.74304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:24 smithi191 bash[24992]: cluster 2024-08-31T03:18:23.418437+0000 mgr.a (mgr.14388) 2903 : cluster [DBG] pgmap v2012: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:26 smithi163 bash[24253]: cluster 2024-08-31T03:18:25.419206+0000 mgr.a (mgr.14388) 2904 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:18:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:26 smithi027 bash[22610]: cluster 2024-08-31T03:18:25.419206+0000 mgr.a (mgr.14388) 2904 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:18:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:26 smithi191 bash[24992]: cluster 2024-08-31T03:18:25.419206+0000 mgr.a (mgr.14388) 2904 : cluster [DBG] pgmap v2013: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:18:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:27 smithi163 bash[24253]: audit 2024-08-31T03:18:26.719913+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:18:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:27 smithi163 bash[24253]: audit 2024-08-31T03:18:27.555697+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:18:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:27 smithi163 bash[24253]: audit 2024-08-31T03:18:27.557642+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:18:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:27 smithi163 bash[24253]: audit 2024-08-31T03:18:27.568405+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:18:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:27 smithi027 bash[22610]: audit 2024-08-31T03:18:26.719913+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:18:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:27 smithi027 bash[22610]: audit 2024-08-31T03:18:27.555697+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:18:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:27 smithi027 bash[22610]: audit 2024-08-31T03:18:27.557642+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:18:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:27 smithi027 bash[22610]: audit 2024-08-31T03:18:27.568405+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:18:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:27 smithi191 bash[24992]: audit 2024-08-31T03:18:26.719913+0000 mon.a (mon.0) 1027 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:18:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:27 smithi191 bash[24992]: audit 2024-08-31T03:18:27.555697+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:18:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:27 smithi191 bash[24992]: audit 2024-08-31T03:18:27.557642+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:18:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:27 smithi191 bash[24992]: audit 2024-08-31T03:18:27.568405+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:18:28.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:18:28.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:18:28.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:28.579 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:18:28 smithi027 bash[22863]: debug 2024-08-31T03:18:28.296+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:18:28.579 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:18:28 smithi027 bash[22863]: debug 2024-08-31T03:18:28.296+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:18:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:28 smithi163 bash[24253]: cluster 2024-08-31T03:18:27.419591+0000 mgr.a (mgr.14388) 2905 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:18:28.974 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:28 smithi163 bash[24253]: audit 2024-08-31T03:18:27.575248+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:18:28.974 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:28 smithi163 bash[24253]: audit 2024-08-31T03:18:27.577965+0000 mgr.a (mgr.14388) 2906 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:18:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:28 smithi027 bash[22610]: cluster 2024-08-31T03:18:27.419591+0000 mgr.a (mgr.14388) 2905 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:18:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:28 smithi027 bash[22610]: audit 2024-08-31T03:18:27.575248+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:18:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:28 smithi027 bash[22610]: audit 2024-08-31T03:18:27.577965+0000 mgr.a (mgr.14388) 2906 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:18:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:28 smithi191 bash[24992]: cluster 2024-08-31T03:18:27.419591+0000 mgr.a (mgr.14388) 2905 : cluster [DBG] pgmap v2014: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:18:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:28 smithi191 bash[24992]: audit 2024-08-31T03:18:27.575248+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:18:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:28 smithi191 bash[24992]: audit 2024-08-31T03:18:27.577965+0000 mgr.a (mgr.14388) 2906 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:18:29.262 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:29.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:29.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:29.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:29.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:29.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:29 smithi163 bash[24253]: audit 2024-08-31T03:18:28.300271+0000 mgr.a (mgr.14388) 2907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:18:29.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:29 smithi163 bash[24253]: cephadm 2024-08-31T03:18:28.301593+0000 mgr.a (mgr.14388) 2908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:18:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:29 smithi027 bash[22610]: audit 2024-08-31T03:18:28.300271+0000 mgr.a (mgr.14388) 2907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:18:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:29 smithi027 bash[22610]: cephadm 2024-08-31T03:18:28.301593+0000 mgr.a (mgr.14388) 2908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:18:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:29 smithi191 bash[24992]: audit 2024-08-31T03:18:28.300271+0000 mgr.a (mgr.14388) 2907 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:18:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:29 smithi191 bash[24992]: cephadm 2024-08-31T03:18:28.301593+0000 mgr.a (mgr.14388) 2908 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:18:30.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:30 smithi163 bash[24253]: audit 2024-08-31T03:18:28.849878+0000 mgr.a (mgr.14388) 2909 : audit [DBG] from='client.74478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:30.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:30 smithi163 bash[24253]: cluster 2024-08-31T03:18:29.422365+0000 mgr.a (mgr.14388) 2910 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T03:18:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:30 smithi027 bash[22610]: audit 2024-08-31T03:18:28.849878+0000 mgr.a (mgr.14388) 2909 : audit [DBG] from='client.74478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:30 smithi027 bash[22610]: cluster 2024-08-31T03:18:29.422365+0000 mgr.a (mgr.14388) 2910 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T03:18:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:30 smithi191 bash[24992]: audit 2024-08-31T03:18:28.849878+0000 mgr.a (mgr.14388) 2909 : audit [DBG] from='client.74478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:30 smithi191 bash[24992]: cluster 2024-08-31T03:18:29.422365+0000 mgr.a (mgr.14388) 2910 : cluster [DBG] pgmap v2015: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T03:18:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:32 smithi163 bash[24253]: cluster 2024-08-31T03:18:31.423380+0000 mgr.a (mgr.14388) 2911 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T03:18:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:32 smithi027 bash[22610]: cluster 2024-08-31T03:18:31.423380+0000 mgr.a (mgr.14388) 2911 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T03:18:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:32 smithi191 bash[24992]: cluster 2024-08-31T03:18:31.423380+0000 mgr.a (mgr.14388) 2911 : cluster [DBG] pgmap v2016: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T03:18:34.263 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:18:34.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:18:34.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:34 smithi163 bash[24253]: cluster 2024-08-31T03:18:33.425518+0000 mgr.a (mgr.14388) 2912 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:34 smithi027 bash[22610]: cluster 2024-08-31T03:18:33.425518+0000 mgr.a (mgr.14388) 2912 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:35.001 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:35.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:35.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:35.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:35.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:34 smithi191 bash[24992]: cluster 2024-08-31T03:18:33.425518+0000 mgr.a (mgr.14388) 2912 : cluster [DBG] pgmap v2017: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:35.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:35 smithi163 bash[24253]: audit 2024-08-31T03:18:34.591737+0000 mgr.a (mgr.14388) 2913 : audit [DBG] from='client.74553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:35 smithi027 bash[22610]: audit 2024-08-31T03:18:34.591737+0000 mgr.a (mgr.14388) 2913 : audit [DBG] from='client.74553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:35 smithi191 bash[24992]: audit 2024-08-31T03:18:34.591737+0000 mgr.a (mgr.14388) 2913 : audit [DBG] from='client.74553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:36 smithi163 bash[24253]: cluster 2024-08-31T03:18:35.426496+0000 mgr.a (mgr.14388) 2914 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:36 smithi027 bash[22610]: cluster 2024-08-31T03:18:35.426496+0000 mgr.a (mgr.14388) 2914 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:36 smithi191 bash[24992]: cluster 2024-08-31T03:18:35.426496+0000 mgr.a (mgr.14388) 2914 : cluster [DBG] pgmap v2018: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:38 smithi163 bash[24253]: cluster 2024-08-31T03:18:37.427287+0000 mgr.a (mgr.14388) 2915 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:38 smithi027 bash[22610]: cluster 2024-08-31T03:18:37.427287+0000 mgr.a (mgr.14388) 2915 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:38 smithi191 bash[24992]: cluster 2024-08-31T03:18:37.427287+0000 mgr.a (mgr.14388) 2915 : cluster [DBG] pgmap v2019: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:39.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:39 smithi163 bash[24253]: cluster 2024-08-31T03:18:39.429480+0000 mgr.a (mgr.14388) 2916 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:39 smithi027 bash[22610]: cluster 2024-08-31T03:18:39.429480+0000 mgr.a (mgr.14388) 2916 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:40.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:18:40.003 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:18:40.003 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:39 smithi191 bash[24992]: cluster 2024-08-31T03:18:39.429480+0000 mgr.a (mgr.14388) 2916 : cluster [DBG] pgmap v2020: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:18:40.774 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:40.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:40.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:40.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:40.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:40 smithi163 bash[24253]: audit 2024-08-31T03:18:40.338707+0000 mgr.a (mgr.14388) 2917 : audit [DBG] from='client.74628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:40 smithi027 bash[22610]: audit 2024-08-31T03:18:40.338707+0000 mgr.a (mgr.14388) 2917 : audit [DBG] from='client.74628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:40 smithi191 bash[24992]: audit 2024-08-31T03:18:40.338707+0000 mgr.a (mgr.14388) 2917 : audit [DBG] from='client.74628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:41.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:41 smithi163 bash[24253]: cluster 2024-08-31T03:18:41.430435+0000 mgr.a (mgr.14388) 2918 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T03:18:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:41 smithi027 bash[22610]: cluster 2024-08-31T03:18:41.430435+0000 mgr.a (mgr.14388) 2918 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T03:18:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:41 smithi191 bash[24992]: cluster 2024-08-31T03:18:41.430435+0000 mgr.a (mgr.14388) 2918 : cluster [DBG] pgmap v2021: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T03:18:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:44 smithi191 bash[24992]: cluster 2024-08-31T03:18:43.432557+0000 mgr.a (mgr.14388) 2919 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T03:18:44.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:44 smithi163 bash[24253]: cluster 2024-08-31T03:18:43.432557+0000 mgr.a (mgr.14388) 2919 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T03:18:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:44 smithi027 bash[22610]: cluster 2024-08-31T03:18:43.432557+0000 mgr.a (mgr.14388) 2919 : cluster [DBG] pgmap v2022: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T03:18:45.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:18:45.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:18:45.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:46.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:46.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:46.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:46.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:46.521 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:46 smithi191 bash[24992]: cluster 2024-08-31T03:18:45.433333+0000 mgr.a (mgr.14388) 2920 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:46.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:46 smithi163 bash[24253]: cluster 2024-08-31T03:18:45.433333+0000 mgr.a (mgr.14388) 2920 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:46 smithi027 bash[22610]: cluster 2024-08-31T03:18:45.433333+0000 mgr.a (mgr.14388) 2920 : cluster [DBG] pgmap v2023: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:47 smithi191 bash[24992]: audit 2024-08-31T03:18:46.107676+0000 mgr.a (mgr.14388) 2921 : audit [DBG] from='client.74703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:47.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:47 smithi163 bash[24253]: audit 2024-08-31T03:18:46.107676+0000 mgr.a (mgr.14388) 2921 : audit [DBG] from='client.74703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:47 smithi027 bash[22610]: audit 2024-08-31T03:18:46.107676+0000 mgr.a (mgr.14388) 2921 : audit [DBG] from='client.74703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:48 smithi191 bash[24992]: cluster 2024-08-31T03:18:47.434248+0000 mgr.a (mgr.14388) 2922 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:48 smithi163 bash[24253]: cluster 2024-08-31T03:18:47.434248+0000 mgr.a (mgr.14388) 2922 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:48 smithi027 bash[22610]: cluster 2024-08-31T03:18:47.434248+0000 mgr.a (mgr.14388) 2922 : cluster [DBG] pgmap v2024: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:50 smithi191 bash[24992]: cluster 2024-08-31T03:18:49.436486+0000 mgr.a (mgr.14388) 2923 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:50.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:50 smithi163 bash[24253]: cluster 2024-08-31T03:18:49.436486+0000 mgr.a (mgr.14388) 2923 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:50 smithi027 bash[22610]: cluster 2024-08-31T03:18:49.436486+0000 mgr.a (mgr.14388) 2923 : cluster [DBG] pgmap v2025: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:51.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:18:51.524 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:18:51.524 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:52.271 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:52.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:52.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:52.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:52.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:52 smithi191 bash[24992]: cluster 2024-08-31T03:18:51.437311+0000 mgr.a (mgr.14388) 2924 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:52.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:52 smithi163 bash[24253]: cluster 2024-08-31T03:18:51.437311+0000 mgr.a (mgr.14388) 2924 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:52 smithi027 bash[22610]: cluster 2024-08-31T03:18:51.437311+0000 mgr.a (mgr.14388) 2924 : cluster [DBG] pgmap v2026: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:53 smithi191 bash[24992]: audit 2024-08-31T03:18:51.856158+0000 mgr.a (mgr.14388) 2925 : audit [DBG] from='client.74781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:53.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:53 smithi163 bash[24253]: audit 2024-08-31T03:18:51.856158+0000 mgr.a (mgr.14388) 2925 : audit [DBG] from='client.74781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:53 smithi027 bash[22610]: audit 2024-08-31T03:18:51.856158+0000 mgr.a (mgr.14388) 2925 : audit [DBG] from='client.74781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:54 smithi191 bash[24992]: cluster 2024-08-31T03:18:53.439579+0000 mgr.a (mgr.14388) 2926 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:54.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:54 smithi163 bash[24253]: cluster 2024-08-31T03:18:53.439579+0000 mgr.a (mgr.14388) 2926 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:54 smithi027 bash[22610]: cluster 2024-08-31T03:18:53.439579+0000 mgr.a (mgr.14388) 2926 : cluster [DBG] pgmap v2027: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:18:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:56 smithi191 bash[24992]: cluster 2024-08-31T03:18:55.440359+0000 mgr.a (mgr.14388) 2927 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:56.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:56 smithi163 bash[24253]: cluster 2024-08-31T03:18:55.440359+0000 mgr.a (mgr.14388) 2927 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:56 smithi027 bash[22610]: cluster 2024-08-31T03:18:55.440359+0000 mgr.a (mgr.14388) 2927 : cluster [DBG] pgmap v2028: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:57.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:18:57.274 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:18:57.274 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:18:58.004 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:18:58.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:18:58.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:18:58.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:18:58.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:18:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:58 smithi191 bash[24992]: cluster 2024-08-31T03:18:57.440885+0000 mgr.a (mgr.14388) 2928 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:18:58 smithi191 bash[24992]: audit 2024-08-31T03:18:57.603215+0000 mgr.a (mgr.14388) 2929 : audit [DBG] from='client.74859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:58.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:58 smithi163 bash[24253]: cluster 2024-08-31T03:18:57.440885+0000 mgr.a (mgr.14388) 2928 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:58.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:18:58 smithi163 bash[24253]: audit 2024-08-31T03:18:57.603215+0000 mgr.a (mgr.14388) 2929 : audit [DBG] from='client.74859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:18:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:58 smithi027 bash[22610]: cluster 2024-08-31T03:18:57.440885+0000 mgr.a (mgr.14388) 2928 : cluster [DBG] pgmap v2029: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:18:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:18:58 smithi027 bash[22610]: audit 2024-08-31T03:18:57.603215+0000 mgr.a (mgr.14388) 2929 : audit [DBG] from='client.74859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:00 smithi191 bash[24992]: cluster 2024-08-31T03:18:59.443258+0000 mgr.a (mgr.14388) 2930 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:19:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:00 smithi163 bash[24253]: cluster 2024-08-31T03:18:59.443258+0000 mgr.a (mgr.14388) 2930 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:19:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:00 smithi027 bash[22610]: cluster 2024-08-31T03:18:59.443258+0000 mgr.a (mgr.14388) 2930 : cluster [DBG] pgmap v2030: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:19:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:02 smithi163 bash[24253]: cluster 2024-08-31T03:19:01.444056+0000 mgr.a (mgr.14388) 2931 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:19:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:02 smithi027 bash[22610]: cluster 2024-08-31T03:19:01.444056+0000 mgr.a (mgr.14388) 2931 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:19:03.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:19:03.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:19:03.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:19:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:02 smithi191 bash[24992]: cluster 2024-08-31T03:19:01.444056+0000 mgr.a (mgr.14388) 2931 : cluster [DBG] pgmap v2031: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:19:03.786 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:19:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:19:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:19:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:19:03.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:19:04.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:04 smithi163 bash[24253]: audit 2024-08-31T03:19:03.345521+0000 mgr.a (mgr.14388) 2932 : audit [DBG] from='client.74937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:04.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:04 smithi163 bash[24253]: cluster 2024-08-31T03:19:03.445329+0000 mgr.a (mgr.14388) 2933 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:04 smithi027 bash[22610]: audit 2024-08-31T03:19:03.345521+0000 mgr.a (mgr.14388) 2932 : audit [DBG] from='client.74937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:04 smithi027 bash[22610]: cluster 2024-08-31T03:19:03.445329+0000 mgr.a (mgr.14388) 2933 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:04 smithi191 bash[24992]: audit 2024-08-31T03:19:03.345521+0000 mgr.a (mgr.14388) 2932 : audit [DBG] from='client.74937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:04 smithi191 bash[24992]: cluster 2024-08-31T03:19:03.445329+0000 mgr.a (mgr.14388) 2933 : cluster [DBG] pgmap v2032: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:06.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:06 smithi163 bash[24253]: cluster 2024-08-31T03:19:05.446196+0000 mgr.a (mgr.14388) 2934 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:19:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:06 smithi027 bash[22610]: cluster 2024-08-31T03:19:05.446196+0000 mgr.a (mgr.14388) 2934 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:19:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:06 smithi191 bash[24992]: cluster 2024-08-31T03:19:05.446196+0000 mgr.a (mgr.14388) 2934 : cluster [DBG] pgmap v2033: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:19:08.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:19:08.789 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:19:08.789 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:19:08.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:08 smithi163 bash[24253]: cluster 2024-08-31T03:19:07.447005+0000 mgr.a (mgr.14388) 2935 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:19:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:08 smithi027 bash[22610]: cluster 2024-08-31T03:19:07.447005+0000 mgr.a (mgr.14388) 2935 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:19:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:08 smithi191 bash[24992]: cluster 2024-08-31T03:19:07.447005+0000 mgr.a (mgr.14388) 2935 : cluster [DBG] pgmap v2034: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:19:09.531 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:19:09.531 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:19:09.531 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:19:09.532 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:19:09.532 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:19:10.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:10 smithi163 bash[24253]: audit 2024-08-31T03:19:09.121053+0000 mgr.a (mgr.14388) 2936 : audit [DBG] from='client.75012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:10.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:10 smithi163 bash[24253]: cluster 2024-08-31T03:19:09.448240+0000 mgr.a (mgr.14388) 2937 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:10 smithi027 bash[22610]: audit 2024-08-31T03:19:09.121053+0000 mgr.a (mgr.14388) 2936 : audit [DBG] from='client.75012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:10 smithi027 bash[22610]: cluster 2024-08-31T03:19:09.448240+0000 mgr.a (mgr.14388) 2937 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:10 smithi191 bash[24992]: audit 2024-08-31T03:19:09.121053+0000 mgr.a (mgr.14388) 2936 : audit [DBG] from='client.75012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:10 smithi191 bash[24992]: cluster 2024-08-31T03:19:09.448240+0000 mgr.a (mgr.14388) 2937 : cluster [DBG] pgmap v2035: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:12.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:12 smithi163 bash[24253]: cluster 2024-08-31T03:19:11.448976+0000 mgr.a (mgr.14388) 2938 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T03:19:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:12 smithi027 bash[22610]: cluster 2024-08-31T03:19:11.448976+0000 mgr.a (mgr.14388) 2938 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T03:19:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:12 smithi191 bash[24992]: cluster 2024-08-31T03:19:11.448976+0000 mgr.a (mgr.14388) 2938 : cluster [DBG] pgmap v2036: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T03:19:14.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:19:14.534 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:19:14.534 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:19:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:14 smithi163 bash[24253]: cluster 2024-08-31T03:19:13.451018+0000 mgr.a (mgr.14388) 2939 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T03:19:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:14 smithi027 bash[22610]: cluster 2024-08-31T03:19:13.451018+0000 mgr.a (mgr.14388) 2939 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T03:19:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:14 smithi191 bash[24992]: cluster 2024-08-31T03:19:13.451018+0000 mgr.a (mgr.14388) 2939 : cluster [DBG] pgmap v2037: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T03:19:15.305 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:19:15.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:19:15.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:19:15.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:19:15.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:19:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:16 smithi163 bash[24253]: audit 2024-08-31T03:19:14.869414+0000 mgr.a (mgr.14388) 2940 : audit [DBG] from='client.75090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:16 smithi163 bash[24253]: cluster 2024-08-31T03:19:15.451985+0000 mgr.a (mgr.14388) 2941 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:16 smithi027 bash[22610]: audit 2024-08-31T03:19:14.869414+0000 mgr.a (mgr.14388) 2940 : audit [DBG] from='client.75090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:16 smithi027 bash[22610]: cluster 2024-08-31T03:19:15.451985+0000 mgr.a (mgr.14388) 2941 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:16 smithi191 bash[24992]: audit 2024-08-31T03:19:14.869414+0000 mgr.a (mgr.14388) 2940 : audit [DBG] from='client.75090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:16 smithi191 bash[24992]: cluster 2024-08-31T03:19:15.451985+0000 mgr.a (mgr.14388) 2941 : cluster [DBG] pgmap v2038: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:18 smithi163 bash[24253]: cluster 2024-08-31T03:19:17.452787+0000 mgr.a (mgr.14388) 2942 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:18 smithi027 bash[22610]: cluster 2024-08-31T03:19:17.452787+0000 mgr.a (mgr.14388) 2942 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:18 smithi191 bash[24992]: cluster 2024-08-31T03:19:17.452787+0000 mgr.a (mgr.14388) 2942 : cluster [DBG] pgmap v2039: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:20.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:19:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:19:20.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:19:20.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:20 smithi163 bash[24253]: cluster 2024-08-31T03:19:19.455124+0000 mgr.a (mgr.14388) 2943 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:20 smithi027 bash[22610]: cluster 2024-08-31T03:19:19.455124+0000 mgr.a (mgr.14388) 2943 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:20 smithi191 bash[24992]: cluster 2024-08-31T03:19:19.455124+0000 mgr.a (mgr.14388) 2943 : cluster [DBG] pgmap v2040: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:21.056 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:19:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:19:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:19:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:19:21.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:19:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:22 smithi163 bash[24253]: audit 2024-08-31T03:19:20.639072+0000 mgr.a (mgr.14388) 2944 : audit [DBG] from='client.75168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:22 smithi163 bash[24253]: cluster 2024-08-31T03:19:21.455923+0000 mgr.a (mgr.14388) 2945 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:22 smithi027 bash[22610]: audit 2024-08-31T03:19:20.639072+0000 mgr.a (mgr.14388) 2944 : audit [DBG] from='client.75168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:22 smithi027 bash[22610]: cluster 2024-08-31T03:19:21.455923+0000 mgr.a (mgr.14388) 2945 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:22 smithi191 bash[24992]: audit 2024-08-31T03:19:20.639072+0000 mgr.a (mgr.14388) 2944 : audit [DBG] from='client.75168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:22 smithi191 bash[24992]: cluster 2024-08-31T03:19:21.455923+0000 mgr.a (mgr.14388) 2945 : cluster [DBG] pgmap v2041: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:24 smithi163 bash[24253]: cluster 2024-08-31T03:19:23.457998+0000 mgr.a (mgr.14388) 2946 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:24 smithi027 bash[22610]: cluster 2024-08-31T03:19:23.457998+0000 mgr.a (mgr.14388) 2946 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:24 smithi191 bash[24992]: cluster 2024-08-31T03:19:23.457998+0000 mgr.a (mgr.14388) 2946 : cluster [DBG] pgmap v2042: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:26.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:19:26.058 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:19:26.058 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:19:26.810 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:19:26.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:19:26.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:19:26.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:19:26.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:19:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:26 smithi163 bash[24253]: cluster 2024-08-31T03:19:25.458773+0000 mgr.a (mgr.14388) 2947 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:26 smithi027 bash[22610]: cluster 2024-08-31T03:19:25.458773+0000 mgr.a (mgr.14388) 2947 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:26 smithi191 bash[24992]: cluster 2024-08-31T03:19:25.458773+0000 mgr.a (mgr.14388) 2947 : cluster [DBG] pgmap v2043: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:27 smithi163 bash[24253]: audit 2024-08-31T03:19:26.385952+0000 mgr.a (mgr.14388) 2948 : audit [DBG] from='client.75246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:27 smithi027 bash[22610]: audit 2024-08-31T03:19:26.385952+0000 mgr.a (mgr.14388) 2948 : audit [DBG] from='client.75246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:27 smithi191 bash[24992]: audit 2024-08-31T03:19:26.385952+0000 mgr.a (mgr.14388) 2948 : audit [DBG] from='client.75246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:28 smithi163 bash[24253]: cluster 2024-08-31T03:19:27.459669+0000 mgr.a (mgr.14388) 2949 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:28 smithi163 bash[24253]: audit 2024-08-31T03:19:28.351847+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:19:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:28 smithi027 bash[22610]: cluster 2024-08-31T03:19:27.459669+0000 mgr.a (mgr.14388) 2949 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:28 smithi027 bash[22610]: audit 2024-08-31T03:19:28.351847+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:19:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:28 smithi191 bash[24992]: cluster 2024-08-31T03:19:27.459669+0000 mgr.a (mgr.14388) 2949 : cluster [DBG] pgmap v2044: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:28 smithi191 bash[24992]: audit 2024-08-31T03:19:28.351847+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:19:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:29 smithi027 bash[22610]: audit 2024-08-31T03:19:28.979366+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:19:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:29 smithi027 bash[22610]: audit 2024-08-31T03:19:28.988611+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:19:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:29 smithi027 bash[22610]: cluster 2024-08-31T03:19:29.461766+0000 mgr.a (mgr.14388) 2950 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:29 smithi027 bash[22610]: audit 2024-08-31T03:19:29.742362+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:19:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:29 smithi027 bash[22610]: audit 2024-08-31T03:19:29.744070+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:19:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:29 smithi027 bash[22610]: audit 2024-08-31T03:19:29.754091+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:19:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:29 smithi027 bash[22610]: audit 2024-08-31T03:19:29.757640+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:19:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:29 smithi191 bash[24992]: audit 2024-08-31T03:19:28.979366+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:19:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:29 smithi191 bash[24992]: audit 2024-08-31T03:19:28.988611+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:19:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:29 smithi191 bash[24992]: cluster 2024-08-31T03:19:29.461766+0000 mgr.a (mgr.14388) 2950 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:29 smithi191 bash[24992]: audit 2024-08-31T03:19:29.742362+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:19:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:29 smithi191 bash[24992]: audit 2024-08-31T03:19:29.744070+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:19:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:29 smithi191 bash[24992]: audit 2024-08-31T03:19:29.754091+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:19:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:29 smithi191 bash[24992]: audit 2024-08-31T03:19:29.757640+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:19:30.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:29 smithi163 bash[24253]: audit 2024-08-31T03:19:28.979366+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:19:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:29 smithi163 bash[24253]: audit 2024-08-31T03:19:28.988611+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:19:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:29 smithi163 bash[24253]: cluster 2024-08-31T03:19:29.461766+0000 mgr.a (mgr.14388) 2950 : cluster [DBG] pgmap v2045: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:29 smithi163 bash[24253]: audit 2024-08-31T03:19:29.742362+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:19:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:29 smithi163 bash[24253]: audit 2024-08-31T03:19:29.744070+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:19:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:29 smithi163 bash[24253]: audit 2024-08-31T03:19:29.754091+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:19:30.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:29 smithi163 bash[24253]: audit 2024-08-31T03:19:29.757640+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:19:30.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:19:30 smithi027 bash[22863]: debug 2024-08-31T03:19:30.458+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:19:30.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:19:30 smithi027 bash[22863]: debug 2024-08-31T03:19:30.458+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:19:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:30 smithi191 bash[24992]: audit 2024-08-31T03:19:29.760007+0000 mgr.a (mgr.14388) 2951 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:19:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:30 smithi191 bash[24992]: audit 2024-08-31T03:19:30.460365+0000 mgr.a (mgr.14388) 2952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:19:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:30 smithi191 bash[24992]: cephadm 2024-08-31T03:19:30.461664+0000 mgr.a (mgr.14388) 2953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:19:31.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:30 smithi163 bash[24253]: audit 2024-08-31T03:19:29.760007+0000 mgr.a (mgr.14388) 2951 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:19:31.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:30 smithi163 bash[24253]: audit 2024-08-31T03:19:30.460365+0000 mgr.a (mgr.14388) 2952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:19:31.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:30 smithi163 bash[24253]: cephadm 2024-08-31T03:19:30.461664+0000 mgr.a (mgr.14388) 2953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:19:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:30 smithi027 bash[22610]: audit 2024-08-31T03:19:29.760007+0000 mgr.a (mgr.14388) 2951 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:19:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:30 smithi027 bash[22610]: audit 2024-08-31T03:19:30.460365+0000 mgr.a (mgr.14388) 2952 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:19:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:30 smithi027 bash[22610]: cephadm 2024-08-31T03:19:30.461664+0000 mgr.a (mgr.14388) 2953 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:19:31.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:19:31.812 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:19:31.813 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:19:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:31 smithi191 bash[24992]: cluster 2024-08-31T03:19:31.462827+0000 mgr.a (mgr.14388) 2954 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:32.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:32 smithi163 bash[24253]: cluster 2024-08-31T03:19:31.462827+0000 mgr.a (mgr.14388) 2954 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:31 smithi027 bash[22610]: cluster 2024-08-31T03:19:31.462827+0000 mgr.a (mgr.14388) 2954 : cluster [DBG] pgmap v2046: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:32.559 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:19:32.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:19:32.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:19:32.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:19:32.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:19:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:33 smithi191 bash[24992]: audit 2024-08-31T03:19:32.148516+0000 mgr.a (mgr.14388) 2955 : audit [DBG] from='client.75432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:33.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:33 smithi163 bash[24253]: audit 2024-08-31T03:19:32.148516+0000 mgr.a (mgr.14388) 2955 : audit [DBG] from='client.75432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:33 smithi027 bash[22610]: audit 2024-08-31T03:19:32.148516+0000 mgr.a (mgr.14388) 2955 : audit [DBG] from='client.75432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:34 smithi191 bash[24992]: cluster 2024-08-31T03:19:33.465052+0000 mgr.a (mgr.14388) 2956 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:34.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:34 smithi163 bash[24253]: cluster 2024-08-31T03:19:33.465052+0000 mgr.a (mgr.14388) 2956 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:34 smithi027 bash[22610]: cluster 2024-08-31T03:19:33.465052+0000 mgr.a (mgr.14388) 2956 : cluster [DBG] pgmap v2047: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:36 smithi191 bash[24992]: cluster 2024-08-31T03:19:35.465932+0000 mgr.a (mgr.14388) 2957 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:36 smithi163 bash[24253]: cluster 2024-08-31T03:19:35.465932+0000 mgr.a (mgr.14388) 2957 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:36 smithi027 bash[22610]: cluster 2024-08-31T03:19:35.465932+0000 mgr.a (mgr.14388) 2957 : cluster [DBG] pgmap v2048: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:37.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:19:37.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:19:37.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:19:38.322 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:19:38.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:19:38.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:19:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:19:38.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:19:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:38 smithi191 bash[24992]: cluster 2024-08-31T03:19:37.466904+0000 mgr.a (mgr.14388) 2958 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:38 smithi163 bash[24253]: cluster 2024-08-31T03:19:37.466904+0000 mgr.a (mgr.14388) 2958 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:38 smithi027 bash[22610]: cluster 2024-08-31T03:19:37.466904+0000 mgr.a (mgr.14388) 2958 : cluster [DBG] pgmap v2049: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:39 smithi191 bash[24992]: audit 2024-08-31T03:19:37.897849+0000 mgr.a (mgr.14388) 2959 : audit [DBG] from='client.75510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:39.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:39 smithi163 bash[24253]: audit 2024-08-31T03:19:37.897849+0000 mgr.a (mgr.14388) 2959 : audit [DBG] from='client.75510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:39 smithi027 bash[22610]: audit 2024-08-31T03:19:37.897849+0000 mgr.a (mgr.14388) 2959 : audit [DBG] from='client.75510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:40 smithi163 bash[24253]: cluster 2024-08-31T03:19:39.469646+0000 mgr.a (mgr.14388) 2960 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:40 smithi027 bash[22610]: cluster 2024-08-31T03:19:39.469646+0000 mgr.a (mgr.14388) 2960 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:40 smithi191 bash[24992]: cluster 2024-08-31T03:19:39.469646+0000 mgr.a (mgr.14388) 2960 : cluster [DBG] pgmap v2050: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:42.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:42 smithi163 bash[24253]: cluster 2024-08-31T03:19:41.470600+0000 mgr.a (mgr.14388) 2961 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:19:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:42 smithi027 bash[22610]: cluster 2024-08-31T03:19:41.470600+0000 mgr.a (mgr.14388) 2961 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:19:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:42 smithi191 bash[24992]: cluster 2024-08-31T03:19:41.470600+0000 mgr.a (mgr.14388) 2961 : cluster [DBG] pgmap v2051: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:19:43.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:19:43.325 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:19:43.325 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:19:44.096 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:19:44.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:19:44.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:19:44.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:19:44.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:19:44.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:44 smithi163 bash[24253]: cluster 2024-08-31T03:19:43.471829+0000 mgr.a (mgr.14388) 2962 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:44 smithi027 bash[22610]: cluster 2024-08-31T03:19:43.471829+0000 mgr.a (mgr.14388) 2962 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:44 smithi191 bash[24992]: cluster 2024-08-31T03:19:43.471829+0000 mgr.a (mgr.14388) 2962 : cluster [DBG] pgmap v2052: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:19:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:45 smithi163 bash[24253]: audit 2024-08-31T03:19:43.660032+0000 mgr.a (mgr.14388) 2963 : audit [DBG] from='client.75585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:45 smithi027 bash[22610]: audit 2024-08-31T03:19:43.660032+0000 mgr.a (mgr.14388) 2963 : audit [DBG] from='client.75585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:45 smithi191 bash[24992]: audit 2024-08-31T03:19:43.660032+0000 mgr.a (mgr.14388) 2963 : audit [DBG] from='client.75585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:46.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:46 smithi163 bash[24253]: cluster 2024-08-31T03:19:45.472674+0000 mgr.a (mgr.14388) 2964 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:19:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:46 smithi027 bash[22610]: cluster 2024-08-31T03:19:45.472674+0000 mgr.a (mgr.14388) 2964 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:19:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:46 smithi191 bash[24992]: cluster 2024-08-31T03:19:45.472674+0000 mgr.a (mgr.14388) 2964 : cluster [DBG] pgmap v2053: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:19:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:48 smithi163 bash[24253]: cluster 2024-08-31T03:19:47.473416+0000 mgr.a (mgr.14388) 2965 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:19:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:48 smithi027 bash[22610]: cluster 2024-08-31T03:19:47.473416+0000 mgr.a (mgr.14388) 2965 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:19:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:48 smithi191 bash[24992]: cluster 2024-08-31T03:19:47.473416+0000 mgr.a (mgr.14388) 2965 : cluster [DBG] pgmap v2054: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:19:49.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:19:49.098 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:19:49.098 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:19:49.847 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:19:49.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:19:49.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:19:49.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:19:49.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:19:50.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:50 smithi163 bash[24253]: audit 2024-08-31T03:19:49.428908+0000 mgr.a (mgr.14388) 2966 : audit [DBG] from='client.75660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:50.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:50 smithi163 bash[24253]: cluster 2024-08-31T03:19:49.476333+0000 mgr.a (mgr.14388) 2967 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:50 smithi027 bash[22610]: audit 2024-08-31T03:19:49.428908+0000 mgr.a (mgr.14388) 2966 : audit [DBG] from='client.75660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:50 smithi027 bash[22610]: cluster 2024-08-31T03:19:49.476333+0000 mgr.a (mgr.14388) 2967 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:50 smithi191 bash[24992]: audit 2024-08-31T03:19:49.428908+0000 mgr.a (mgr.14388) 2966 : audit [DBG] from='client.75660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:50 smithi191 bash[24992]: cluster 2024-08-31T03:19:49.476333+0000 mgr.a (mgr.14388) 2967 : cluster [DBG] pgmap v2055: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:52.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:52 smithi163 bash[24253]: cluster 2024-08-31T03:19:51.477211+0000 mgr.a (mgr.14388) 2968 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:52 smithi027 bash[22610]: cluster 2024-08-31T03:19:51.477211+0000 mgr.a (mgr.14388) 2968 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:52 smithi191 bash[24992]: cluster 2024-08-31T03:19:51.477211+0000 mgr.a (mgr.14388) 2968 : cluster [DBG] pgmap v2056: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:19:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:19:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:19:54.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:54 smithi163 bash[24253]: cluster 2024-08-31T03:19:53.479311+0000 mgr.a (mgr.14388) 2969 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:54 smithi027 bash[22610]: cluster 2024-08-31T03:19:53.479311+0000 mgr.a (mgr.14388) 2969 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:54 smithi191 bash[24992]: cluster 2024-08-31T03:19:53.479311+0000 mgr.a (mgr.14388) 2969 : cluster [DBG] pgmap v2057: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:19:55.626 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:19:55.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:19:55.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:19:55.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:19:55.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:19:56.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:56 smithi163 bash[24253]: audit 2024-08-31T03:19:55.189829+0000 mgr.a (mgr.14388) 2970 : audit [DBG] from='client.75738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:56.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:56 smithi163 bash[24253]: cluster 2024-08-31T03:19:55.479864+0000 mgr.a (mgr.14388) 2971 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:56 smithi027 bash[22610]: audit 2024-08-31T03:19:55.189829+0000 mgr.a (mgr.14388) 2970 : audit [DBG] from='client.75738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:56 smithi027 bash[22610]: cluster 2024-08-31T03:19:55.479864+0000 mgr.a (mgr.14388) 2971 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:56 smithi191 bash[24992]: audit 2024-08-31T03:19:55.189829+0000 mgr.a (mgr.14388) 2970 : audit [DBG] from='client.75738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:19:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:56 smithi191 bash[24992]: cluster 2024-08-31T03:19:55.479864+0000 mgr.a (mgr.14388) 2971 : cluster [DBG] pgmap v2058: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:58.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:19:58 smithi163 bash[24253]: cluster 2024-08-31T03:19:57.480834+0000 mgr.a (mgr.14388) 2972 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:19:58 smithi027 bash[22610]: cluster 2024-08-31T03:19:57.480834+0000 mgr.a (mgr.14388) 2972 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:19:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:19:58 smithi191 bash[24992]: cluster 2024-08-31T03:19:57.480834+0000 mgr.a (mgr.14388) 2972 : cluster [DBG] pgmap v2059: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:00.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:00.628 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:00.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:00 smithi163 bash[24253]: cluster 2024-08-31T03:19:59.483060+0000 mgr.a (mgr.14388) 2973 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:00.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:00 smithi163 bash[24253]: cluster 2024-08-31T03:20:00.000085+0000 mon.a (mon.0) 1039 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:20:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:00 smithi027 bash[22610]: cluster 2024-08-31T03:19:59.483060+0000 mgr.a (mgr.14388) 2973 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:00 smithi027 bash[22610]: cluster 2024-08-31T03:20:00.000085+0000 mon.a (mon.0) 1039 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:20:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:00 smithi191 bash[24992]: cluster 2024-08-31T03:19:59.483060+0000 mgr.a (mgr.14388) 2973 : cluster [DBG] pgmap v2060: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:00 smithi191 bash[24992]: cluster 2024-08-31T03:20:00.000085+0000 mon.a (mon.0) 1039 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:20:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:01.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:01.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:01.373 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:02 smithi163 bash[24253]: audit 2024-08-31T03:20:00.959149+0000 mgr.a (mgr.14388) 2974 : audit [DBG] from='client.75813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:02 smithi163 bash[24253]: cluster 2024-08-31T03:20:01.484007+0000 mgr.a (mgr.14388) 2975 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:02 smithi027 bash[22610]: audit 2024-08-31T03:20:00.959149+0000 mgr.a (mgr.14388) 2974 : audit [DBG] from='client.75813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:02 smithi027 bash[22610]: cluster 2024-08-31T03:20:01.484007+0000 mgr.a (mgr.14388) 2975 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:02 smithi191 bash[24992]: audit 2024-08-31T03:20:00.959149+0000 mgr.a (mgr.14388) 2974 : audit [DBG] from='client.75813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:02 smithi191 bash[24992]: cluster 2024-08-31T03:20:01.484007+0000 mgr.a (mgr.14388) 2975 : cluster [DBG] pgmap v2061: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:04.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:04 smithi163 bash[24253]: cluster 2024-08-31T03:20:03.486127+0000 mgr.a (mgr.14388) 2976 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:04 smithi027 bash[22610]: cluster 2024-08-31T03:20:03.486127+0000 mgr.a (mgr.14388) 2976 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:04 smithi191 bash[24992]: cluster 2024-08-31T03:20:03.486127+0000 mgr.a (mgr.14388) 2976 : cluster [DBG] pgmap v2062: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:06.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:06.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:06.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:06.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:06 smithi163 bash[24253]: cluster 2024-08-31T03:20:05.486929+0000 mgr.a (mgr.14388) 2977 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:06 smithi027 bash[22610]: cluster 2024-08-31T03:20:05.486929+0000 mgr.a (mgr.14388) 2977 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:06 smithi191 bash[24992]: cluster 2024-08-31T03:20:05.486929+0000 mgr.a (mgr.14388) 2977 : cluster [DBG] pgmap v2063: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:07.155 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:07.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:07.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:07.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:07.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:08.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:08 smithi163 bash[24253]: audit 2024-08-31T03:20:06.715084+0000 mgr.a (mgr.14388) 2978 : audit [DBG] from='client.75891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:08.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:08 smithi163 bash[24253]: cluster 2024-08-31T03:20:07.487869+0000 mgr.a (mgr.14388) 2979 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:08 smithi027 bash[22610]: audit 2024-08-31T03:20:06.715084+0000 mgr.a (mgr.14388) 2978 : audit [DBG] from='client.75891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:08 smithi027 bash[22610]: cluster 2024-08-31T03:20:07.487869+0000 mgr.a (mgr.14388) 2979 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:08 smithi191 bash[24992]: audit 2024-08-31T03:20:06.715084+0000 mgr.a (mgr.14388) 2978 : audit [DBG] from='client.75891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:08 smithi191 bash[24992]: cluster 2024-08-31T03:20:07.487869+0000 mgr.a (mgr.14388) 2979 : cluster [DBG] pgmap v2064: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:10.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:10 smithi163 bash[24253]: cluster 2024-08-31T03:20:09.490103+0000 mgr.a (mgr.14388) 2980 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:10 smithi027 bash[22610]: cluster 2024-08-31T03:20:09.490103+0000 mgr.a (mgr.14388) 2980 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:10 smithi191 bash[24992]: cluster 2024-08-31T03:20:09.490103+0000 mgr.a (mgr.14388) 2980 : cluster [DBG] pgmap v2065: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:12.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:12.158 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:12.158 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:12.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:12.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:12.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:12.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:12.931 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:12.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:12 smithi163 bash[24253]: cluster 2024-08-31T03:20:11.490923+0000 mgr.a (mgr.14388) 2981 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:12 smithi027 bash[22610]: cluster 2024-08-31T03:20:11.490923+0000 mgr.a (mgr.14388) 2981 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:12 smithi191 bash[24992]: cluster 2024-08-31T03:20:11.490923+0000 mgr.a (mgr.14388) 2981 : cluster [DBG] pgmap v2066: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:13.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:13 smithi163 bash[24253]: audit 2024-08-31T03:20:12.495385+0000 mgr.a (mgr.14388) 2982 : audit [DBG] from='client.75963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:13 smithi027 bash[22610]: audit 2024-08-31T03:20:12.495385+0000 mgr.a (mgr.14388) 2982 : audit [DBG] from='client.75963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:13 smithi191 bash[24992]: audit 2024-08-31T03:20:12.495385+0000 mgr.a (mgr.14388) 2982 : audit [DBG] from='client.75963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:14 smithi163 bash[24253]: cluster 2024-08-31T03:20:13.493270+0000 mgr.a (mgr.14388) 2983 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:20:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:14 smithi027 bash[22610]: cluster 2024-08-31T03:20:13.493270+0000 mgr.a (mgr.14388) 2983 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:20:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:14 smithi191 bash[24992]: cluster 2024-08-31T03:20:13.493270+0000 mgr.a (mgr.14388) 2983 : cluster [DBG] pgmap v2067: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:20:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:16 smithi163 bash[24253]: cluster 2024-08-31T03:20:15.494098+0000 mgr.a (mgr.14388) 2984 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:20:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:16 smithi027 bash[22610]: cluster 2024-08-31T03:20:15.494098+0000 mgr.a (mgr.14388) 2984 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:20:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:16 smithi191 bash[24992]: cluster 2024-08-31T03:20:15.494098+0000 mgr.a (mgr.14388) 2984 : cluster [DBG] pgmap v2068: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:20:17.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:17.932 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:17.932 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:18.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:18.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:18 smithi163 bash[24253]: cluster 2024-08-31T03:20:17.494899+0000 mgr.a (mgr.14388) 2985 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:20:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:18 smithi027 bash[22610]: cluster 2024-08-31T03:20:17.494899+0000 mgr.a (mgr.14388) 2985 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:20:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:18 smithi191 bash[24992]: cluster 2024-08-31T03:20:17.494899+0000 mgr.a (mgr.14388) 2985 : cluster [DBG] pgmap v2069: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:20:19.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:19 smithi163 bash[24253]: audit 2024-08-31T03:20:18.260122+0000 mgr.a (mgr.14388) 2986 : audit [DBG] from='client.76041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:19 smithi027 bash[22610]: audit 2024-08-31T03:20:18.260122+0000 mgr.a (mgr.14388) 2986 : audit [DBG] from='client.76041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:19 smithi191 bash[24992]: audit 2024-08-31T03:20:18.260122+0000 mgr.a (mgr.14388) 2986 : audit [DBG] from='client.76041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:20.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:20 smithi163 bash[24253]: cluster 2024-08-31T03:20:19.497681+0000 mgr.a (mgr.14388) 2987 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:20 smithi027 bash[22610]: cluster 2024-08-31T03:20:19.497681+0000 mgr.a (mgr.14388) 2987 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:20 smithi191 bash[24992]: cluster 2024-08-31T03:20:19.497681+0000 mgr.a (mgr.14388) 2987 : cluster [DBG] pgmap v2070: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:21.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:21 smithi163 bash[24253]: cluster 2024-08-31T03:20:21.498514+0000 mgr.a (mgr.14388) 2988 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:20:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:21 smithi027 bash[22610]: cluster 2024-08-31T03:20:21.498514+0000 mgr.a (mgr.14388) 2988 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:20:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:21 smithi191 bash[24992]: cluster 2024-08-31T03:20:21.498514+0000 mgr.a (mgr.14388) 2988 : cluster [DBG] pgmap v2071: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:20:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:24.439 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:24.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:24.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:24.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:24.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:24 smithi163 bash[24253]: cluster 2024-08-31T03:20:23.500457+0000 mgr.a (mgr.14388) 2989 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:24 smithi027 bash[22610]: cluster 2024-08-31T03:20:23.500457+0000 mgr.a (mgr.14388) 2989 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:24 smithi191 bash[24992]: cluster 2024-08-31T03:20:23.500457+0000 mgr.a (mgr.14388) 2989 : cluster [DBG] pgmap v2072: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:25.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:25 smithi163 bash[24253]: audit 2024-08-31T03:20:24.027324+0000 mgr.a (mgr.14388) 2990 : audit [DBG] from='client.76119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:25 smithi027 bash[22610]: audit 2024-08-31T03:20:24.027324+0000 mgr.a (mgr.14388) 2990 : audit [DBG] from='client.76119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:25 smithi191 bash[24992]: audit 2024-08-31T03:20:24.027324+0000 mgr.a (mgr.14388) 2990 : audit [DBG] from='client.76119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:26 smithi163 bash[24253]: cluster 2024-08-31T03:20:25.501450+0000 mgr.a (mgr.14388) 2991 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:20:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:26 smithi027 bash[22610]: cluster 2024-08-31T03:20:25.501450+0000 mgr.a (mgr.14388) 2991 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:20:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:26 smithi191 bash[24992]: cluster 2024-08-31T03:20:25.501450+0000 mgr.a (mgr.14388) 2991 : cluster [DBG] pgmap v2073: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:20:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:28 smithi163 bash[24253]: cluster 2024-08-31T03:20:27.502225+0000 mgr.a (mgr.14388) 2992 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:20:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:28 smithi027 bash[22610]: cluster 2024-08-31T03:20:27.502225+0000 mgr.a (mgr.14388) 2992 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:20:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:28 smithi191 bash[24992]: cluster 2024-08-31T03:20:27.502225+0000 mgr.a (mgr.14388) 2992 : cluster [DBG] pgmap v2074: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:20:29.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:29.441 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:29.441 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:30.224 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:30.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:30.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:30.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:30.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:30.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:30 smithi163 bash[24253]: cluster 2024-08-31T03:20:29.504509+0000 mgr.a (mgr.14388) 2993 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:20:30.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:30 smithi163 bash[24253]: audit 2024-08-31T03:20:30.513258+0000 mon.a (mon.0) 1040 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:20:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:30 smithi027 bash[22610]: cluster 2024-08-31T03:20:29.504509+0000 mgr.a (mgr.14388) 2993 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:20:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:30 smithi027 bash[22610]: audit 2024-08-31T03:20:30.513258+0000 mon.a (mon.0) 1040 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:20:31.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:30 smithi191 bash[24992]: cluster 2024-08-31T03:20:29.504509+0000 mgr.a (mgr.14388) 2993 : cluster [DBG] pgmap v2075: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:20:31.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:30 smithi191 bash[24992]: audit 2024-08-31T03:20:30.513258+0000 mon.a (mon.0) 1040 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:20:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:31 smithi163 bash[24253]: audit 2024-08-31T03:20:29.779881+0000 mgr.a (mgr.14388) 2994 : audit [DBG] from='client.76197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:31 smithi163 bash[24253]: audit 2024-08-31T03:20:31.127746+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:31 smithi163 bash[24253]: audit 2024-08-31T03:20:31.133969+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:31 smithi163 bash[24253]: audit 2024-08-31T03:20:31.139678+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:31 smithi163 bash[24253]: audit 2024-08-31T03:20:31.146285+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:31 smithi027 bash[22610]: audit 2024-08-31T03:20:29.779881+0000 mgr.a (mgr.14388) 2994 : audit [DBG] from='client.76197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:31 smithi027 bash[22610]: audit 2024-08-31T03:20:31.127746+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:31 smithi027 bash[22610]: audit 2024-08-31T03:20:31.133969+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:31 smithi027 bash[22610]: audit 2024-08-31T03:20:31.139678+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:31.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:31 smithi027 bash[22610]: audit 2024-08-31T03:20:31.146285+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:31 smithi191 bash[24992]: audit 2024-08-31T03:20:29.779881+0000 mgr.a (mgr.14388) 2994 : audit [DBG] from='client.76197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:31 smithi191 bash[24992]: audit 2024-08-31T03:20:31.127746+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:31 smithi191 bash[24992]: audit 2024-08-31T03:20:31.133969+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:31 smithi191 bash[24992]: audit 2024-08-31T03:20:31.139678+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:31 smithi191 bash[24992]: audit 2024-08-31T03:20:31.146285+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:32 smithi163 bash[24253]: cluster 2024-08-31T03:20:31.505441+0000 mgr.a (mgr.14388) 2995 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:32 smithi163 bash[24253]: audit 2024-08-31T03:20:31.958118+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:20:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:32 smithi163 bash[24253]: audit 2024-08-31T03:20:31.959774+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:20:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:32 smithi163 bash[24253]: audit 2024-08-31T03:20:31.969891+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:32.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:32 smithi163 bash[24253]: audit 2024-08-31T03:20:31.974608+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:20:32.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:20:32 smithi027 bash[22863]: debug 2024-08-31T03:20:32.676+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:20:32.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:20:32 smithi027 bash[22863]: debug 2024-08-31T03:20:32.676+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:20:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:32 smithi027 bash[22610]: cluster 2024-08-31T03:20:31.505441+0000 mgr.a (mgr.14388) 2995 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:32 smithi027 bash[22610]: audit 2024-08-31T03:20:31.958118+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:20:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:32 smithi027 bash[22610]: audit 2024-08-31T03:20:31.959774+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:20:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:32 smithi027 bash[22610]: audit 2024-08-31T03:20:31.969891+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:32 smithi027 bash[22610]: audit 2024-08-31T03:20:31.974608+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:20:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:32 smithi191 bash[24992]: cluster 2024-08-31T03:20:31.505441+0000 mgr.a (mgr.14388) 2995 : cluster [DBG] pgmap v2076: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:32 smithi191 bash[24992]: audit 2024-08-31T03:20:31.958118+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:20:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:32 smithi191 bash[24992]: audit 2024-08-31T03:20:31.959774+0000 mon.a (mon.0) 1046 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:20:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:32 smithi191 bash[24992]: audit 2024-08-31T03:20:31.969891+0000 mon.a (mon.0) 1047 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:20:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:32 smithi191 bash[24992]: audit 2024-08-31T03:20:31.974608+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:20:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:33 smithi163 bash[24253]: audit 2024-08-31T03:20:31.976950+0000 mgr.a (mgr.14388) 2996 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:20:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:33 smithi027 bash[22610]: audit 2024-08-31T03:20:31.976950+0000 mgr.a (mgr.14388) 2996 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:20:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:33 smithi191 bash[24992]: audit 2024-08-31T03:20:31.976950+0000 mgr.a (mgr.14388) 2996 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:20:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:34 smithi163 bash[24253]: audit 2024-08-31T03:20:32.680054+0000 mgr.a (mgr.14388) 2997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:20:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:34 smithi163 bash[24253]: cephadm 2024-08-31T03:20:32.681295+0000 mgr.a (mgr.14388) 2998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:20:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:34 smithi163 bash[24253]: cluster 2024-08-31T03:20:33.507777+0000 mgr.a (mgr.14388) 2999 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:34 smithi027 bash[22610]: audit 2024-08-31T03:20:32.680054+0000 mgr.a (mgr.14388) 2997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:20:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:34 smithi027 bash[22610]: cephadm 2024-08-31T03:20:32.681295+0000 mgr.a (mgr.14388) 2998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:20:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:34 smithi027 bash[22610]: cluster 2024-08-31T03:20:33.507777+0000 mgr.a (mgr.14388) 2999 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:34 smithi191 bash[24992]: audit 2024-08-31T03:20:32.680054+0000 mgr.a (mgr.14388) 2997 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:20:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:34 smithi191 bash[24992]: cephadm 2024-08-31T03:20:32.681295+0000 mgr.a (mgr.14388) 2998 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:20:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:34 smithi191 bash[24992]: cluster 2024-08-31T03:20:33.507777+0000 mgr.a (mgr.14388) 2999 : cluster [DBG] pgmap v2077: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:35.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:35.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:35.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:35.974 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:35.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:35.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:35.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:35.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:36 smithi163 bash[24253]: cluster 2024-08-31T03:20:35.508571+0000 mgr.a (mgr.14388) 3000 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:36 smithi163 bash[24253]: audit 2024-08-31T03:20:35.553442+0000 mgr.a (mgr.14388) 3001 : audit [DBG] from='client.76380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:36.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:36 smithi027 bash[22610]: cluster 2024-08-31T03:20:35.508571+0000 mgr.a (mgr.14388) 3000 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:36.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:36 smithi027 bash[22610]: audit 2024-08-31T03:20:35.553442+0000 mgr.a (mgr.14388) 3001 : audit [DBG] from='client.76380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:36 smithi191 bash[24992]: cluster 2024-08-31T03:20:35.508571+0000 mgr.a (mgr.14388) 3000 : cluster [DBG] pgmap v2078: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:36 smithi191 bash[24992]: audit 2024-08-31T03:20:35.553442+0000 mgr.a (mgr.14388) 3001 : audit [DBG] from='client.76380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:38 smithi163 bash[24253]: cluster 2024-08-31T03:20:37.509457+0000 mgr.a (mgr.14388) 3002 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:38 smithi027 bash[22610]: cluster 2024-08-31T03:20:37.509457+0000 mgr.a (mgr.14388) 3002 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:38 smithi191 bash[24992]: cluster 2024-08-31T03:20:37.509457+0000 mgr.a (mgr.14388) 3002 : cluster [DBG] pgmap v2079: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:40 smithi163 bash[24253]: cluster 2024-08-31T03:20:39.511694+0000 mgr.a (mgr.14388) 3003 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:40.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:40.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:40.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:40 smithi027 bash[22610]: cluster 2024-08-31T03:20:39.511694+0000 mgr.a (mgr.14388) 3003 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:40 smithi191 bash[24992]: cluster 2024-08-31T03:20:39.511694+0000 mgr.a (mgr.14388) 3003 : cluster [DBG] pgmap v2080: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:41.745 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:41.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:42.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:42 smithi163 bash[24253]: audit 2024-08-31T03:20:41.312712+0000 mgr.a (mgr.14388) 3004 : audit [DBG] from='client.76458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:42.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:42 smithi163 bash[24253]: cluster 2024-08-31T03:20:41.512291+0000 mgr.a (mgr.14388) 3005 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:42 smithi027 bash[22610]: audit 2024-08-31T03:20:41.312712+0000 mgr.a (mgr.14388) 3004 : audit [DBG] from='client.76458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:42 smithi027 bash[22610]: cluster 2024-08-31T03:20:41.512291+0000 mgr.a (mgr.14388) 3005 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:42 smithi191 bash[24992]: audit 2024-08-31T03:20:41.312712+0000 mgr.a (mgr.14388) 3004 : audit [DBG] from='client.76458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:42 smithi191 bash[24992]: cluster 2024-08-31T03:20:41.512291+0000 mgr.a (mgr.14388) 3005 : cluster [DBG] pgmap v2081: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:44.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:44 smithi163 bash[24253]: cluster 2024-08-31T03:20:43.514621+0000 mgr.a (mgr.14388) 3006 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:44 smithi027 bash[22610]: cluster 2024-08-31T03:20:43.514621+0000 mgr.a (mgr.14388) 3006 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:44 smithi191 bash[24992]: cluster 2024-08-31T03:20:43.514621+0000 mgr.a (mgr.14388) 3006 : cluster [DBG] pgmap v2082: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:20:46.747 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:46.747 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:46.748 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:46.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:46 smithi163 bash[24253]: cluster 2024-08-31T03:20:45.515470+0000 mgr.a (mgr.14388) 3007 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:46 smithi027 bash[22610]: cluster 2024-08-31T03:20:45.515470+0000 mgr.a (mgr.14388) 3007 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:46 smithi191 bash[24992]: cluster 2024-08-31T03:20:45.515470+0000 mgr.a (mgr.14388) 3007 : cluster [DBG] pgmap v2083: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:47.483 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:48 smithi163 bash[24253]: audit 2024-08-31T03:20:47.075989+0000 mgr.a (mgr.14388) 3008 : audit [DBG] from='client.76536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:48 smithi163 bash[24253]: cluster 2024-08-31T03:20:47.516080+0000 mgr.a (mgr.14388) 3009 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:48 smithi027 bash[22610]: audit 2024-08-31T03:20:47.075989+0000 mgr.a (mgr.14388) 3008 : audit [DBG] from='client.76536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:48 smithi027 bash[22610]: cluster 2024-08-31T03:20:47.516080+0000 mgr.a (mgr.14388) 3009 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:48 smithi191 bash[24992]: audit 2024-08-31T03:20:47.075989+0000 mgr.a (mgr.14388) 3008 : audit [DBG] from='client.76536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:48 smithi191 bash[24992]: cluster 2024-08-31T03:20:47.516080+0000 mgr.a (mgr.14388) 3009 : cluster [DBG] pgmap v2084: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:50.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:50 smithi163 bash[24253]: cluster 2024-08-31T03:20:49.518215+0000 mgr.a (mgr.14388) 3010 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:50 smithi027 bash[22610]: cluster 2024-08-31T03:20:49.518215+0000 mgr.a (mgr.14388) 3010 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:50 smithi191 bash[24992]: cluster 2024-08-31T03:20:49.518215+0000 mgr.a (mgr.14388) 3010 : cluster [DBG] pgmap v2085: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:20:52.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:52.486 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:52.486 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:52.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:52 smithi163 bash[24253]: cluster 2024-08-31T03:20:51.519060+0000 mgr.a (mgr.14388) 3011 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:52 smithi027 bash[22610]: cluster 2024-08-31T03:20:51.519060+0000 mgr.a (mgr.14388) 3011 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:52 smithi191 bash[24992]: cluster 2024-08-31T03:20:51.519060+0000 mgr.a (mgr.14388) 3011 : cluster [DBG] pgmap v2086: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:53.238 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:53.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:53.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:53.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:53.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:54.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:54 smithi163 bash[24253]: audit 2024-08-31T03:20:52.817130+0000 mgr.a (mgr.14388) 3012 : audit [DBG] from='client.76614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:54.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:54 smithi163 bash[24253]: cluster 2024-08-31T03:20:53.521765+0000 mgr.a (mgr.14388) 3013 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:54 smithi027 bash[22610]: audit 2024-08-31T03:20:52.817130+0000 mgr.a (mgr.14388) 3012 : audit [DBG] from='client.76614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:54 smithi027 bash[22610]: cluster 2024-08-31T03:20:53.521765+0000 mgr.a (mgr.14388) 3013 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:54 smithi191 bash[24992]: audit 2024-08-31T03:20:52.817130+0000 mgr.a (mgr.14388) 3012 : audit [DBG] from='client.76614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:54 smithi191 bash[24992]: cluster 2024-08-31T03:20:53.521765+0000 mgr.a (mgr.14388) 3013 : cluster [DBG] pgmap v2087: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:20:56.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:56 smithi163 bash[24253]: cluster 2024-08-31T03:20:55.522569+0000 mgr.a (mgr.14388) 3014 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:20:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:56 smithi027 bash[22610]: cluster 2024-08-31T03:20:55.522569+0000 mgr.a (mgr.14388) 3014 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:20:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:56 smithi191 bash[24992]: cluster 2024-08-31T03:20:55.522569+0000 mgr.a (mgr.14388) 3014 : cluster [DBG] pgmap v2088: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:20:58.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:20:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:20:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:20:58.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:58 smithi163 bash[24253]: cluster 2024-08-31T03:20:57.523323+0000 mgr.a (mgr.14388) 3015 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:20:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:58 smithi027 bash[22610]: cluster 2024-08-31T03:20:57.523323+0000 mgr.a (mgr.14388) 3015 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:20:59.037 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:20:59.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:20:59.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:20:59.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:20:59.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:20:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:58 smithi191 bash[24992]: cluster 2024-08-31T03:20:57.523323+0000 mgr.a (mgr.14388) 3015 : cluster [DBG] pgmap v2089: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:20:59.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:20:59 smithi163 bash[24253]: audit 2024-08-31T03:20:58.579825+0000 mgr.a (mgr.14388) 3016 : audit [DBG] from='client.76692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:20:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:20:59 smithi027 bash[22610]: audit 2024-08-31T03:20:58.579825+0000 mgr.a (mgr.14388) 3016 : audit [DBG] from='client.76692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:20:59 smithi191 bash[24992]: audit 2024-08-31T03:20:58.579825+0000 mgr.a (mgr.14388) 3016 : audit [DBG] from='client.76692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:00 smithi163 bash[24253]: cluster 2024-08-31T03:20:59.526052+0000 mgr.a (mgr.14388) 3017 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:00 smithi027 bash[22610]: cluster 2024-08-31T03:20:59.526052+0000 mgr.a (mgr.14388) 3017 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:00 smithi191 bash[24992]: cluster 2024-08-31T03:20:59.526052+0000 mgr.a (mgr.14388) 3017 : cluster [DBG] pgmap v2090: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:02 smithi163 bash[24253]: cluster 2024-08-31T03:21:01.526872+0000 mgr.a (mgr.14388) 3018 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:21:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:02 smithi027 bash[22610]: cluster 2024-08-31T03:21:01.526872+0000 mgr.a (mgr.14388) 3018 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:21:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:02 smithi191 bash[24992]: cluster 2024-08-31T03:21:01.526872+0000 mgr.a (mgr.14388) 3018 : cluster [DBG] pgmap v2091: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:21:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:03 smithi027 bash[22610]: cluster 2024-08-31T03:21:03.528788+0000 mgr.a (mgr.14388) 3019 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:04.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:03 smithi191 bash[24992]: cluster 2024-08-31T03:21:03.528788+0000 mgr.a (mgr.14388) 3019 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:04.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:21:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:21:04.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:21:04.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:03 smithi163 bash[24253]: cluster 2024-08-31T03:21:03.528788+0000 mgr.a (mgr.14388) 3019 : cluster [DBG] pgmap v2092: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:04.795 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:21:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:21:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:21:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:21:04.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:21:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:04 smithi027 bash[22610]: audit 2024-08-31T03:21:04.372795+0000 mgr.a (mgr.14388) 3020 : audit [DBG] from='client.76767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:04 smithi191 bash[24992]: audit 2024-08-31T03:21:04.372795+0000 mgr.a (mgr.14388) 3020 : audit [DBG] from='client.76767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:05.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:04 smithi163 bash[24253]: audit 2024-08-31T03:21:04.372795+0000 mgr.a (mgr.14388) 3020 : audit [DBG] from='client.76767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:05 smithi027 bash[22610]: cluster 2024-08-31T03:21:05.529781+0000 mgr.a (mgr.14388) 3021 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:05 smithi191 bash[24992]: cluster 2024-08-31T03:21:05.529781+0000 mgr.a (mgr.14388) 3021 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:06.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:05 smithi163 bash[24253]: cluster 2024-08-31T03:21:05.529781+0000 mgr.a (mgr.14388) 3021 : cluster [DBG] pgmap v2093: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:08.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:08 smithi163 bash[24253]: cluster 2024-08-31T03:21:07.530548+0000 mgr.a (mgr.14388) 3022 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:08 smithi027 bash[22610]: cluster 2024-08-31T03:21:07.530548+0000 mgr.a (mgr.14388) 3022 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:08 smithi191 bash[24992]: cluster 2024-08-31T03:21:07.530548+0000 mgr.a (mgr.14388) 3022 : cluster [DBG] pgmap v2094: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:09.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:21:09.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:21:09.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:21:10.552 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:21:10.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:21:10.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:21:10.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:21:10.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:21:10.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:10 smithi163 bash[24253]: cluster 2024-08-31T03:21:09.532744+0000 mgr.a (mgr.14388) 3023 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:10 smithi027 bash[22610]: cluster 2024-08-31T03:21:09.532744+0000 mgr.a (mgr.14388) 3023 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:10 smithi191 bash[24992]: cluster 2024-08-31T03:21:09.532744+0000 mgr.a (mgr.14388) 3023 : cluster [DBG] pgmap v2095: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:11.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:11 smithi163 bash[24253]: audit 2024-08-31T03:21:10.128195+0000 mgr.a (mgr.14388) 3024 : audit [DBG] from='client.76845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:11 smithi027 bash[22610]: audit 2024-08-31T03:21:10.128195+0000 mgr.a (mgr.14388) 3024 : audit [DBG] from='client.76845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:11 smithi191 bash[24992]: audit 2024-08-31T03:21:10.128195+0000 mgr.a (mgr.14388) 3024 : audit [DBG] from='client.76845 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:12.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:12 smithi163 bash[24253]: cluster 2024-08-31T03:21:11.533704+0000 mgr.a (mgr.14388) 3025 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:12 smithi027 bash[22610]: cluster 2024-08-31T03:21:11.533704+0000 mgr.a (mgr.14388) 3025 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:12 smithi191 bash[24992]: cluster 2024-08-31T03:21:11.533704+0000 mgr.a (mgr.14388) 3025 : cluster [DBG] pgmap v2096: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:14 smithi163 bash[24253]: cluster 2024-08-31T03:21:13.535819+0000 mgr.a (mgr.14388) 3026 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:14 smithi027 bash[22610]: cluster 2024-08-31T03:21:13.535819+0000 mgr.a (mgr.14388) 3026 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:14 smithi191 bash[24992]: cluster 2024-08-31T03:21:13.535819+0000 mgr.a (mgr.14388) 3026 : cluster [DBG] pgmap v2097: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:15.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:21:15.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:21:15.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:21:16.295 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:21:16.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:21:16.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:21:16.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:21:16.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:21:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:16 smithi163 bash[24253]: cluster 2024-08-31T03:21:15.536597+0000 mgr.a (mgr.14388) 3027 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:16 smithi027 bash[22610]: cluster 2024-08-31T03:21:15.536597+0000 mgr.a (mgr.14388) 3027 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:16 smithi191 bash[24992]: cluster 2024-08-31T03:21:15.536597+0000 mgr.a (mgr.14388) 3027 : cluster [DBG] pgmap v2098: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:17.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:17 smithi163 bash[24253]: audit 2024-08-31T03:21:15.890454+0000 mgr.a (mgr.14388) 3028 : audit [DBG] from='client.76920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:17 smithi027 bash[22610]: audit 2024-08-31T03:21:15.890454+0000 mgr.a (mgr.14388) 3028 : audit [DBG] from='client.76920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:17 smithi191 bash[24992]: audit 2024-08-31T03:21:15.890454+0000 mgr.a (mgr.14388) 3028 : audit [DBG] from='client.76920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:18 smithi163 bash[24253]: cluster 2024-08-31T03:21:17.537489+0000 mgr.a (mgr.14388) 3029 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:18 smithi027 bash[22610]: cluster 2024-08-31T03:21:17.537489+0000 mgr.a (mgr.14388) 3029 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:18 smithi191 bash[24992]: cluster 2024-08-31T03:21:17.537489+0000 mgr.a (mgr.14388) 3029 : cluster [DBG] pgmap v2099: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:20.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:20 smithi163 bash[24253]: cluster 2024-08-31T03:21:19.539691+0000 mgr.a (mgr.14388) 3030 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:20 smithi027 bash[22610]: cluster 2024-08-31T03:21:19.539691+0000 mgr.a (mgr.14388) 3030 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:21.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:20 smithi191 bash[24992]: cluster 2024-08-31T03:21:19.539691+0000 mgr.a (mgr.14388) 3030 : cluster [DBG] pgmap v2100: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:21:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:21:21.298 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:21:22.077 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:21:22.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:21:22.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:21:22.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:21:22.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:21:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:22 smithi163 bash[24253]: cluster 2024-08-31T03:21:21.540441+0000 mgr.a (mgr.14388) 3031 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:22 smithi163 bash[24253]: audit 2024-08-31T03:21:21.632553+0000 mgr.a (mgr.14388) 3032 : audit [DBG] from='client.76998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:22 smithi027 bash[22610]: cluster 2024-08-31T03:21:21.540441+0000 mgr.a (mgr.14388) 3031 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:22 smithi027 bash[22610]: audit 2024-08-31T03:21:21.632553+0000 mgr.a (mgr.14388) 3032 : audit [DBG] from='client.76998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:22 smithi191 bash[24992]: cluster 2024-08-31T03:21:21.540441+0000 mgr.a (mgr.14388) 3031 : cluster [DBG] pgmap v2101: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:22 smithi191 bash[24992]: audit 2024-08-31T03:21:21.632553+0000 mgr.a (mgr.14388) 3032 : audit [DBG] from='client.76998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:24 smithi163 bash[24253]: cluster 2024-08-31T03:21:23.542624+0000 mgr.a (mgr.14388) 3033 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:24 smithi027 bash[22610]: cluster 2024-08-31T03:21:23.542624+0000 mgr.a (mgr.14388) 3033 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:24 smithi191 bash[24992]: cluster 2024-08-31T03:21:23.542624+0000 mgr.a (mgr.14388) 3033 : cluster [DBG] pgmap v2102: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:26 smithi163 bash[24253]: cluster 2024-08-31T03:21:25.543390+0000 mgr.a (mgr.14388) 3034 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:26 smithi027 bash[22610]: cluster 2024-08-31T03:21:25.543390+0000 mgr.a (mgr.14388) 3034 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:26 smithi191 bash[24992]: cluster 2024-08-31T03:21:25.543390+0000 mgr.a (mgr.14388) 3034 : cluster [DBG] pgmap v2103: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:27.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:21:27.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:21:27.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:21:27.852 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:21:27.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:21:27.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:21:27.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:21:27.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:21:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:28 smithi163 bash[24253]: audit 2024-08-31T03:21:27.415710+0000 mgr.a (mgr.14388) 3035 : audit [DBG] from='client.77076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:28 smithi163 bash[24253]: cluster 2024-08-31T03:21:27.553163+0000 mgr.a (mgr.14388) 3036 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:28 smithi027 bash[22610]: audit 2024-08-31T03:21:27.415710+0000 mgr.a (mgr.14388) 3035 : audit [DBG] from='client.77076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:28 smithi027 bash[22610]: cluster 2024-08-31T03:21:27.553163+0000 mgr.a (mgr.14388) 3036 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:28 smithi191 bash[24992]: audit 2024-08-31T03:21:27.415710+0000 mgr.a (mgr.14388) 3035 : audit [DBG] from='client.77076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:28 smithi191 bash[24992]: cluster 2024-08-31T03:21:27.553163+0000 mgr.a (mgr.14388) 3036 : cluster [DBG] pgmap v2104: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:30.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:30 smithi163 bash[24253]: cluster 2024-08-31T03:21:29.555578+0000 mgr.a (mgr.14388) 3037 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:30 smithi027 bash[22610]: cluster 2024-08-31T03:21:29.555578+0000 mgr.a (mgr.14388) 3037 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:30 smithi191 bash[24992]: cluster 2024-08-31T03:21:29.555578+0000 mgr.a (mgr.14388) 3037 : cluster [DBG] pgmap v2105: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:32.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:21:32.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:21:32.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:21:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:32 smithi163 bash[24253]: cluster 2024-08-31T03:21:31.556352+0000 mgr.a (mgr.14388) 3038 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:32 smithi027 bash[22610]: cluster 2024-08-31T03:21:31.556352+0000 mgr.a (mgr.14388) 3038 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:32 smithi191 bash[24992]: cluster 2024-08-31T03:21:31.556352+0000 mgr.a (mgr.14388) 3038 : cluster [DBG] pgmap v2106: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:33.617 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:21:33.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:21:33.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:21:33.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:21:33.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:21:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:33 smithi163 bash[24253]: audit 2024-08-31T03:21:32.734280+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:21:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:33 smithi163 bash[24253]: audit 2024-08-31T03:21:33.587955+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:21:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:33 smithi163 bash[24253]: audit 2024-08-31T03:21:33.588839+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:21:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:33 smithi163 bash[24253]: audit 2024-08-31T03:21:33.595498+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:21:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:33 smithi163 bash[24253]: audit 2024-08-31T03:21:33.597654+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:21:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:33 smithi027 bash[22610]: audit 2024-08-31T03:21:32.734280+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:21:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:33 smithi027 bash[22610]: audit 2024-08-31T03:21:33.587955+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:21:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:33 smithi027 bash[22610]: audit 2024-08-31T03:21:33.588839+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:21:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:33 smithi027 bash[22610]: audit 2024-08-31T03:21:33.595498+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:21:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:33 smithi027 bash[22610]: audit 2024-08-31T03:21:33.597654+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:21:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:33 smithi191 bash[24992]: audit 2024-08-31T03:21:32.734280+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:21:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:33 smithi191 bash[24992]: audit 2024-08-31T03:21:33.587955+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:21:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:33 smithi191 bash[24992]: audit 2024-08-31T03:21:33.588839+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:21:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:33 smithi191 bash[24992]: audit 2024-08-31T03:21:33.595498+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:21:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:33 smithi191 bash[24992]: audit 2024-08-31T03:21:33.597654+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:21:34.660 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:21:34 smithi027 bash[22863]: debug 2024-08-31T03:21:34.275+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:21:34.660 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:21:34 smithi027 bash[22863]: debug 2024-08-31T03:21:34.275+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:21:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:34 smithi163 bash[24253]: audit 2024-08-31T03:21:33.185326+0000 mgr.a (mgr.14388) 3039 : audit [DBG] from='client.77154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:34 smithi163 bash[24253]: cluster 2024-08-31T03:21:33.557638+0000 mgr.a (mgr.14388) 3040 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:34 smithi163 bash[24253]: audit 2024-08-31T03:21:33.598654+0000 mgr.a (mgr.14388) 3041 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:21:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:34 smithi163 bash[24253]: audit 2024-08-31T03:21:34.280349+0000 mgr.a (mgr.14388) 3042 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:21:34.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:34 smithi163 bash[24253]: cephadm 2024-08-31T03:21:34.281555+0000 mgr.a (mgr.14388) 3043 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:21:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:34 smithi027 bash[22610]: audit 2024-08-31T03:21:33.185326+0000 mgr.a (mgr.14388) 3039 : audit [DBG] from='client.77154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:34 smithi027 bash[22610]: cluster 2024-08-31T03:21:33.557638+0000 mgr.a (mgr.14388) 3040 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:34 smithi027 bash[22610]: audit 2024-08-31T03:21:33.598654+0000 mgr.a (mgr.14388) 3041 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:21:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:34 smithi027 bash[22610]: audit 2024-08-31T03:21:34.280349+0000 mgr.a (mgr.14388) 3042 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:21:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:34 smithi027 bash[22610]: cephadm 2024-08-31T03:21:34.281555+0000 mgr.a (mgr.14388) 3043 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:21:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:34 smithi191 bash[24992]: audit 2024-08-31T03:21:33.185326+0000 mgr.a (mgr.14388) 3039 : audit [DBG] from='client.77154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:34 smithi191 bash[24992]: cluster 2024-08-31T03:21:33.557638+0000 mgr.a (mgr.14388) 3040 : cluster [DBG] pgmap v2107: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:34 smithi191 bash[24992]: audit 2024-08-31T03:21:33.598654+0000 mgr.a (mgr.14388) 3041 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:21:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:34 smithi191 bash[24992]: audit 2024-08-31T03:21:34.280349+0000 mgr.a (mgr.14388) 3042 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:21:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:34 smithi191 bash[24992]: cephadm 2024-08-31T03:21:34.281555+0000 mgr.a (mgr.14388) 3043 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:21:35.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:35 smithi163 bash[24253]: cluster 2024-08-31T03:21:35.558472+0000 mgr.a (mgr.14388) 3044 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:21:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:35 smithi027 bash[22610]: cluster 2024-08-31T03:21:35.558472+0000 mgr.a (mgr.14388) 3044 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:21:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:35 smithi191 bash[24992]: cluster 2024-08-31T03:21:35.558472+0000 mgr.a (mgr.14388) 3044 : cluster [DBG] pgmap v2108: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:21:38.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:21:38.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:21:38.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:21:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:38 smithi163 bash[24253]: cluster 2024-08-31T03:21:37.559261+0000 mgr.a (mgr.14388) 3045 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:21:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:38 smithi027 bash[22610]: cluster 2024-08-31T03:21:37.559261+0000 mgr.a (mgr.14388) 3045 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:21:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:38 smithi191 bash[24992]: cluster 2024-08-31T03:21:37.559261+0000 mgr.a (mgr.14388) 3045 : cluster [DBG] pgmap v2109: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:21:39.379 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:21:39.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:21:39.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:21:39.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:21:39.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:21:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:40 smithi163 bash[24253]: audit 2024-08-31T03:21:38.956269+0000 mgr.a (mgr.14388) 3046 : audit [DBG] from='client.77337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:40 smithi163 bash[24253]: cluster 2024-08-31T03:21:39.561898+0000 mgr.a (mgr.14388) 3047 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:40 smithi027 bash[22610]: audit 2024-08-31T03:21:38.956269+0000 mgr.a (mgr.14388) 3046 : audit [DBG] from='client.77337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:40 smithi027 bash[22610]: cluster 2024-08-31T03:21:39.561898+0000 mgr.a (mgr.14388) 3047 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:40 smithi191 bash[24992]: audit 2024-08-31T03:21:38.956269+0000 mgr.a (mgr.14388) 3046 : audit [DBG] from='client.77337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:40 smithi191 bash[24992]: cluster 2024-08-31T03:21:39.561898+0000 mgr.a (mgr.14388) 3047 : cluster [DBG] pgmap v2110: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:42.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:42 smithi163 bash[24253]: cluster 2024-08-31T03:21:41.562669+0000 mgr.a (mgr.14388) 3048 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:21:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:42 smithi027 bash[22610]: cluster 2024-08-31T03:21:41.562669+0000 mgr.a (mgr.14388) 3048 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:21:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:42 smithi191 bash[24992]: cluster 2024-08-31T03:21:41.562669+0000 mgr.a (mgr.14388) 3048 : cluster [DBG] pgmap v2111: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:21:44.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:21:44.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:21:44.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:21:44.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:44 smithi163 bash[24253]: cluster 2024-08-31T03:21:43.564572+0000 mgr.a (mgr.14388) 3049 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:44 smithi027 bash[22610]: cluster 2024-08-31T03:21:43.564572+0000 mgr.a (mgr.14388) 3049 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:44 smithi191 bash[24992]: cluster 2024-08-31T03:21:43.564572+0000 mgr.a (mgr.14388) 3049 : cluster [DBG] pgmap v2112: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:45.131 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:21:45.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:21:45.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:21:45.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:21:45.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:21:46.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:46 smithi163 bash[24253]: audit 2024-08-31T03:21:44.719288+0000 mgr.a (mgr.14388) 3050 : audit [DBG] from='client.77412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:46.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:46 smithi163 bash[24253]: cluster 2024-08-31T03:21:45.565511+0000 mgr.a (mgr.14388) 3051 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:46 smithi027 bash[22610]: audit 2024-08-31T03:21:44.719288+0000 mgr.a (mgr.14388) 3050 : audit [DBG] from='client.77412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:46 smithi027 bash[22610]: cluster 2024-08-31T03:21:45.565511+0000 mgr.a (mgr.14388) 3051 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:46 smithi191 bash[24992]: audit 2024-08-31T03:21:44.719288+0000 mgr.a (mgr.14388) 3050 : audit [DBG] from='client.77412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:46 smithi191 bash[24992]: cluster 2024-08-31T03:21:45.565511+0000 mgr.a (mgr.14388) 3051 : cluster [DBG] pgmap v2113: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:48 smithi163 bash[24253]: cluster 2024-08-31T03:21:47.566308+0000 mgr.a (mgr.14388) 3052 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:48 smithi027 bash[22610]: cluster 2024-08-31T03:21:47.566308+0000 mgr.a (mgr.14388) 3052 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:48 smithi191 bash[24992]: cluster 2024-08-31T03:21:47.566308+0000 mgr.a (mgr.14388) 3052 : cluster [DBG] pgmap v2114: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:50.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:21:50.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:21:50.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:21:50.908 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:21:50.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:21:50.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:21:50.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:21:50.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:21:50.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:50 smithi163 bash[24253]: cluster 2024-08-31T03:21:49.568495+0000 mgr.a (mgr.14388) 3053 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:50 smithi027 bash[22610]: cluster 2024-08-31T03:21:49.568495+0000 mgr.a (mgr.14388) 3053 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:50 smithi191 bash[24992]: cluster 2024-08-31T03:21:49.568495+0000 mgr.a (mgr.14388) 3053 : cluster [DBG] pgmap v2115: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:21:51.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:51 smithi163 bash[24253]: audit 2024-08-31T03:21:50.472838+0000 mgr.a (mgr.14388) 3054 : audit [DBG] from='client.77490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:51 smithi027 bash[22610]: audit 2024-08-31T03:21:50.472838+0000 mgr.a (mgr.14388) 3054 : audit [DBG] from='client.77490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:51 smithi191 bash[24992]: audit 2024-08-31T03:21:50.472838+0000 mgr.a (mgr.14388) 3054 : audit [DBG] from='client.77490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:52.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:52 smithi163 bash[24253]: cluster 2024-08-31T03:21:51.569460+0000 mgr.a (mgr.14388) 3055 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:52 smithi027 bash[22610]: cluster 2024-08-31T03:21:51.569460+0000 mgr.a (mgr.14388) 3055 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:52 smithi191 bash[24992]: cluster 2024-08-31T03:21:51.569460+0000 mgr.a (mgr.14388) 3055 : cluster [DBG] pgmap v2116: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:54.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:54 smithi163 bash[24253]: cluster 2024-08-31T03:21:53.571582+0000 mgr.a (mgr.14388) 3056 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:54 smithi027 bash[22610]: cluster 2024-08-31T03:21:53.571582+0000 mgr.a (mgr.14388) 3056 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:54 smithi191 bash[24992]: cluster 2024-08-31T03:21:53.571582+0000 mgr.a (mgr.14388) 3056 : cluster [DBG] pgmap v2117: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:21:55.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:21:55.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:21:55.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:21:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:55 smithi027 bash[22610]: cluster 2024-08-31T03:21:55.572332+0000 mgr.a (mgr.14388) 3057 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:55 smithi191 bash[24992]: cluster 2024-08-31T03:21:55.572332+0000 mgr.a (mgr.14388) 3057 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:56.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:55 smithi163 bash[24253]: cluster 2024-08-31T03:21:55.572332+0000 mgr.a (mgr.14388) 3057 : cluster [DBG] pgmap v2118: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:56.699 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:21:56.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:21:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:21:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:21:56.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:21:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:56 smithi027 bash[22610]: audit 2024-08-31T03:21:56.252033+0000 mgr.a (mgr.14388) 3058 : audit [DBG] from='client.77565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:56 smithi191 bash[24992]: audit 2024-08-31T03:21:56.252033+0000 mgr.a (mgr.14388) 3058 : audit [DBG] from='client.77565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:57.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:56 smithi163 bash[24253]: audit 2024-08-31T03:21:56.252033+0000 mgr.a (mgr.14388) 3058 : audit [DBG] from='client.77565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:21:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:21:57 smithi027 bash[22610]: cluster 2024-08-31T03:21:57.573166+0000 mgr.a (mgr.14388) 3059 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:21:57 smithi191 bash[24992]: cluster 2024-08-31T03:21:57.573166+0000 mgr.a (mgr.14388) 3059 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:21:58.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:21:57 smithi163 bash[24253]: cluster 2024-08-31T03:21:57.573166+0000 mgr.a (mgr.14388) 3059 : cluster [DBG] pgmap v2119: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:00 smithi163 bash[24253]: cluster 2024-08-31T03:21:59.575371+0000 mgr.a (mgr.14388) 3060 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:22:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:00 smithi027 bash[22610]: cluster 2024-08-31T03:21:59.575371+0000 mgr.a (mgr.14388) 3060 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:22:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:00 smithi191 bash[24992]: cluster 2024-08-31T03:21:59.575371+0000 mgr.a (mgr.14388) 3060 : cluster [DBG] pgmap v2120: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:22:01.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:01.701 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:01.701 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:22:02.473 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:22:02.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:22:02.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:22:02.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:22:02.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:22:02.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:02 smithi163 bash[24253]: cluster 2024-08-31T03:22:01.576142+0000 mgr.a (mgr.14388) 3061 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:02 smithi027 bash[22610]: cluster 2024-08-31T03:22:01.576142+0000 mgr.a (mgr.14388) 3061 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:02 smithi191 bash[24992]: cluster 2024-08-31T03:22:01.576142+0000 mgr.a (mgr.14388) 3061 : cluster [DBG] pgmap v2121: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:03.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:03 smithi163 bash[24253]: audit 2024-08-31T03:22:02.037626+0000 mgr.a (mgr.14388) 3062 : audit [DBG] from='client.77643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:03 smithi027 bash[22610]: audit 2024-08-31T03:22:02.037626+0000 mgr.a (mgr.14388) 3062 : audit [DBG] from='client.77643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:03 smithi191 bash[24992]: audit 2024-08-31T03:22:02.037626+0000 mgr.a (mgr.14388) 3062 : audit [DBG] from='client.77643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:04.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:04 smithi163 bash[24253]: cluster 2024-08-31T03:22:03.578332+0000 mgr.a (mgr.14388) 3063 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:22:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:04 smithi027 bash[22610]: cluster 2024-08-31T03:22:03.578332+0000 mgr.a (mgr.14388) 3063 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:22:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:04 smithi191 bash[24992]: cluster 2024-08-31T03:22:03.578332+0000 mgr.a (mgr.14388) 3063 : cluster [DBG] pgmap v2122: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:22:06.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:06 smithi163 bash[24253]: cluster 2024-08-31T03:22:05.579139+0000 mgr.a (mgr.14388) 3064 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:06 smithi027 bash[22610]: cluster 2024-08-31T03:22:05.579139+0000 mgr.a (mgr.14388) 3064 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:06 smithi191 bash[24992]: cluster 2024-08-31T03:22:05.579139+0000 mgr.a (mgr.14388) 3064 : cluster [DBG] pgmap v2123: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:07.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:07.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:07.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:22:08.232 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:22:08.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:22:08.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:22:08.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:22:08.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:22:08.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:08 smithi163 bash[24253]: cluster 2024-08-31T03:22:07.579534+0000 mgr.a (mgr.14388) 3065 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:08 smithi027 bash[22610]: cluster 2024-08-31T03:22:07.579534+0000 mgr.a (mgr.14388) 3065 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:08 smithi191 bash[24992]: cluster 2024-08-31T03:22:07.579534+0000 mgr.a (mgr.14388) 3065 : cluster [DBG] pgmap v2124: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:09.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:09 smithi163 bash[24253]: audit 2024-08-31T03:22:07.809613+0000 mgr.a (mgr.14388) 3066 : audit [DBG] from='client.77718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:09 smithi027 bash[22610]: audit 2024-08-31T03:22:07.809613+0000 mgr.a (mgr.14388) 3066 : audit [DBG] from='client.77718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:09 smithi191 bash[24992]: audit 2024-08-31T03:22:07.809613+0000 mgr.a (mgr.14388) 3066 : audit [DBG] from='client.77718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:10.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:10 smithi163 bash[24253]: cluster 2024-08-31T03:22:09.582072+0000 mgr.a (mgr.14388) 3067 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:10 smithi027 bash[22610]: cluster 2024-08-31T03:22:09.582072+0000 mgr.a (mgr.14388) 3067 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:10 smithi191 bash[24992]: cluster 2024-08-31T03:22:09.582072+0000 mgr.a (mgr.14388) 3067 : cluster [DBG] pgmap v2125: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:11.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:11 smithi163 bash[24253]: cluster 2024-08-31T03:22:11.582903+0000 mgr.a (mgr.14388) 3068 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:11 smithi027 bash[22610]: cluster 2024-08-31T03:22:11.582903+0000 mgr.a (mgr.14388) 3068 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:11 smithi191 bash[24992]: cluster 2024-08-31T03:22:11.582903+0000 mgr.a (mgr.14388) 3068 : cluster [DBG] pgmap v2126: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:13.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:13.234 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:13.234 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:22:13.982 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:22:13.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:22:13.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:22:13.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:22:13.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:22:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:14 smithi163 bash[24253]: audit 2024-08-31T03:22:13.568836+0000 mgr.a (mgr.14388) 3069 : audit [DBG] from='client.77796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:14.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:14 smithi163 bash[24253]: cluster 2024-08-31T03:22:13.586914+0000 mgr.a (mgr.14388) 3070 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:14 smithi027 bash[22610]: audit 2024-08-31T03:22:13.568836+0000 mgr.a (mgr.14388) 3069 : audit [DBG] from='client.77796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:14 smithi027 bash[22610]: cluster 2024-08-31T03:22:13.586914+0000 mgr.a (mgr.14388) 3070 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:14 smithi191 bash[24992]: audit 2024-08-31T03:22:13.568836+0000 mgr.a (mgr.14388) 3069 : audit [DBG] from='client.77796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:14 smithi191 bash[24992]: cluster 2024-08-31T03:22:13.586914+0000 mgr.a (mgr.14388) 3070 : cluster [DBG] pgmap v2127: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:16.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:16 smithi163 bash[24253]: cluster 2024-08-31T03:22:15.587839+0000 mgr.a (mgr.14388) 3071 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:16 smithi027 bash[22610]: cluster 2024-08-31T03:22:15.587839+0000 mgr.a (mgr.14388) 3071 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:16 smithi191 bash[24992]: cluster 2024-08-31T03:22:15.587839+0000 mgr.a (mgr.14388) 3071 : cluster [DBG] pgmap v2128: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:18.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:18 smithi163 bash[24253]: cluster 2024-08-31T03:22:17.588595+0000 mgr.a (mgr.14388) 3072 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:18 smithi027 bash[22610]: cluster 2024-08-31T03:22:17.588595+0000 mgr.a (mgr.14388) 3072 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:18.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:18.985 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:18.985 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:22:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:18 smithi191 bash[24992]: cluster 2024-08-31T03:22:17.588595+0000 mgr.a (mgr.14388) 3072 : cluster [DBG] pgmap v2129: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:19.757 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:22:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:22:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:22:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:22:19.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:22:20.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:20 smithi163 bash[24253]: audit 2024-08-31T03:22:19.323562+0000 mgr.a (mgr.14388) 3073 : audit [DBG] from='client.77874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:20.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:20 smithi163 bash[24253]: cluster 2024-08-31T03:22:19.589936+0000 mgr.a (mgr.14388) 3074 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:20 smithi027 bash[22610]: audit 2024-08-31T03:22:19.323562+0000 mgr.a (mgr.14388) 3073 : audit [DBG] from='client.77874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:20 smithi027 bash[22610]: cluster 2024-08-31T03:22:19.589936+0000 mgr.a (mgr.14388) 3074 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:20 smithi191 bash[24992]: audit 2024-08-31T03:22:19.323562+0000 mgr.a (mgr.14388) 3073 : audit [DBG] from='client.77874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:20 smithi191 bash[24992]: cluster 2024-08-31T03:22:19.589936+0000 mgr.a (mgr.14388) 3074 : cluster [DBG] pgmap v2130: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:22 smithi163 bash[24253]: cluster 2024-08-31T03:22:21.590802+0000 mgr.a (mgr.14388) 3075 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:22 smithi027 bash[22610]: cluster 2024-08-31T03:22:21.590802+0000 mgr.a (mgr.14388) 3075 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:22 smithi191 bash[24992]: cluster 2024-08-31T03:22:21.590802+0000 mgr.a (mgr.14388) 3075 : cluster [DBG] pgmap v2131: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:24.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:24.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:24.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:22:24.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:24 smithi163 bash[24253]: cluster 2024-08-31T03:22:23.592902+0000 mgr.a (mgr.14388) 3076 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T03:22:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:24 smithi027 bash[22610]: cluster 2024-08-31T03:22:23.592902+0000 mgr.a (mgr.14388) 3076 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T03:22:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:24 smithi191 bash[24992]: cluster 2024-08-31T03:22:23.592902+0000 mgr.a (mgr.14388) 3076 : cluster [DBG] pgmap v2132: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T03:22:25.558 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:22:25.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:22:25.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:22:25.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:22:25.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:22:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:26 smithi163 bash[24253]: audit 2024-08-31T03:22:25.119185+0000 mgr.a (mgr.14388) 3077 : audit [DBG] from='client.77949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:26.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:26 smithi163 bash[24253]: cluster 2024-08-31T03:22:25.593653+0000 mgr.a (mgr.14388) 3078 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:22:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:26 smithi027 bash[22610]: audit 2024-08-31T03:22:25.119185+0000 mgr.a (mgr.14388) 3077 : audit [DBG] from='client.77949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:26 smithi027 bash[22610]: cluster 2024-08-31T03:22:25.593653+0000 mgr.a (mgr.14388) 3078 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:22:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:26 smithi191 bash[24992]: audit 2024-08-31T03:22:25.119185+0000 mgr.a (mgr.14388) 3077 : audit [DBG] from='client.77949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:26 smithi191 bash[24992]: cluster 2024-08-31T03:22:25.593653+0000 mgr.a (mgr.14388) 3078 : cluster [DBG] pgmap v2133: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:22:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:27 smithi163 bash[24253]: cluster 2024-08-31T03:22:27.594421+0000 mgr.a (mgr.14388) 3079 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:22:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:27 smithi027 bash[22610]: cluster 2024-08-31T03:22:27.594421+0000 mgr.a (mgr.14388) 3079 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:22:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:27 smithi191 bash[24992]: cluster 2024-08-31T03:22:27.594421+0000 mgr.a (mgr.14388) 3079 : cluster [DBG] pgmap v2134: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:22:30.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:30.560 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:30.560 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:22:30.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:30 smithi163 bash[24253]: cluster 2024-08-31T03:22:29.596593+0000 mgr.a (mgr.14388) 3080 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T03:22:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:30 smithi027 bash[22610]: cluster 2024-08-31T03:22:29.596593+0000 mgr.a (mgr.14388) 3080 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T03:22:31.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:30 smithi191 bash[24992]: cluster 2024-08-31T03:22:29.596593+0000 mgr.a (mgr.14388) 3080 : cluster [DBG] pgmap v2135: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T03:22:31.297 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:22:31.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:22:31.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:22:31.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:22:31.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:22:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:32 smithi163 bash[24253]: audit 2024-08-31T03:22:30.894617+0000 mgr.a (mgr.14388) 3081 : audit [DBG] from='client.78027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:32 smithi163 bash[24253]: cluster 2024-08-31T03:22:31.597508+0000 mgr.a (mgr.14388) 3082 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 66 op/s 2024-08-31T03:22:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:32 smithi027 bash[22610]: audit 2024-08-31T03:22:30.894617+0000 mgr.a (mgr.14388) 3081 : audit [DBG] from='client.78027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:32 smithi027 bash[22610]: cluster 2024-08-31T03:22:31.597508+0000 mgr.a (mgr.14388) 3082 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 66 op/s 2024-08-31T03:22:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:32 smithi191 bash[24992]: audit 2024-08-31T03:22:30.894617+0000 mgr.a (mgr.14388) 3081 : audit [DBG] from='client.78027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:32 smithi191 bash[24992]: cluster 2024-08-31T03:22:31.597508+0000 mgr.a (mgr.14388) 3082 : cluster [DBG] pgmap v2136: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 66 op/s 2024-08-31T03:22:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:34 smithi163 bash[24253]: cluster 2024-08-31T03:22:33.599619+0000 mgr.a (mgr.14388) 3083 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T03:22:34.985 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:34 smithi163 bash[24253]: audit 2024-08-31T03:22:34.333351+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:22:34.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:34 smithi027 bash[22610]: cluster 2024-08-31T03:22:33.599619+0000 mgr.a (mgr.14388) 3083 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T03:22:34.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:34 smithi027 bash[22610]: audit 2024-08-31T03:22:34.333351+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:22:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:34 smithi191 bash[24992]: cluster 2024-08-31T03:22:33.599619+0000 mgr.a (mgr.14388) 3083 : cluster [DBG] pgmap v2137: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 42 KiB/s rd, 0 B/s wr, 67 op/s 2024-08-31T03:22:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:34 smithi191 bash[24992]: audit 2024-08-31T03:22:34.333351+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:22:35.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:35 smithi027 bash[22610]: audit 2024-08-31T03:22:35.180814+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:22:35.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:35 smithi027 bash[22610]: audit 2024-08-31T03:22:35.182308+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:22:35.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:35 smithi027 bash[22610]: audit 2024-08-31T03:22:35.192250+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:22:35.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:35 smithi027 bash[22610]: audit 2024-08-31T03:22:35.194831+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:22:35.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:35 smithi163 bash[24253]: audit 2024-08-31T03:22:35.180814+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:22:35.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:35 smithi163 bash[24253]: audit 2024-08-31T03:22:35.182308+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:22:35.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:35 smithi163 bash[24253]: audit 2024-08-31T03:22:35.192250+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:22:35.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:35 smithi163 bash[24253]: audit 2024-08-31T03:22:35.194831+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:22:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:35 smithi191 bash[24992]: audit 2024-08-31T03:22:35.180814+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:22:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:35 smithi191 bash[24992]: audit 2024-08-31T03:22:35.182308+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:22:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:35 smithi191 bash[24992]: audit 2024-08-31T03:22:35.192250+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:22:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:35 smithi191 bash[24992]: audit 2024-08-31T03:22:35.194831+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:22:36.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:22:35 smithi027 bash[22863]: debug 2024-08-31T03:22:35.913+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:22:36.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:22:35 smithi027 bash[22863]: debug 2024-08-31T03:22:35.917+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:22:36.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:36.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:36.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:22:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:36 smithi163 bash[24253]: audit 2024-08-31T03:22:35.197009+0000 mgr.a (mgr.14388) 3084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:22:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:36 smithi163 bash[24253]: cluster 2024-08-31T03:22:35.600228+0000 mgr.a (mgr.14388) 3085 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-08-31T03:22:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:36 smithi027 bash[22610]: audit 2024-08-31T03:22:35.197009+0000 mgr.a (mgr.14388) 3084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:22:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:36 smithi027 bash[22610]: cluster 2024-08-31T03:22:35.600228+0000 mgr.a (mgr.14388) 3085 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-08-31T03:22:37.017 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:22:37.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:22:37.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:22:37.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:22:37.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:22:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:36 smithi191 bash[24992]: audit 2024-08-31T03:22:35.197009+0000 mgr.a (mgr.14388) 3084 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:22:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:36 smithi191 bash[24992]: cluster 2024-08-31T03:22:35.600228+0000 mgr.a (mgr.14388) 3085 : cluster [DBG] pgmap v2138: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-08-31T03:22:37.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:37 smithi163 bash[24253]: audit 2024-08-31T03:22:35.917556+0000 mgr.a (mgr.14388) 3086 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:22:37.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:37 smithi163 bash[24253]: cephadm 2024-08-31T03:22:35.918842+0000 mgr.a (mgr.14388) 3087 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:22:37.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:37 smithi163 bash[24253]: audit 2024-08-31T03:22:36.620265+0000 mgr.a (mgr.14388) 3088 : audit [DBG] from='client.78213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:37 smithi027 bash[22610]: audit 2024-08-31T03:22:35.917556+0000 mgr.a (mgr.14388) 3086 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:22:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:37 smithi027 bash[22610]: cephadm 2024-08-31T03:22:35.918842+0000 mgr.a (mgr.14388) 3087 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:22:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:37 smithi027 bash[22610]: audit 2024-08-31T03:22:36.620265+0000 mgr.a (mgr.14388) 3088 : audit [DBG] from='client.78213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:37 smithi191 bash[24992]: audit 2024-08-31T03:22:35.917556+0000 mgr.a (mgr.14388) 3086 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:22:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:37 smithi191 bash[24992]: cephadm 2024-08-31T03:22:35.918842+0000 mgr.a (mgr.14388) 3087 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:22:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:37 smithi191 bash[24992]: audit 2024-08-31T03:22:36.620265+0000 mgr.a (mgr.14388) 3088 : audit [DBG] from='client.78213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:38 smithi163 bash[24253]: cluster 2024-08-31T03:22:37.601231+0000 mgr.a (mgr.14388) 3089 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-08-31T03:22:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:38 smithi027 bash[22610]: cluster 2024-08-31T03:22:37.601231+0000 mgr.a (mgr.14388) 3089 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-08-31T03:22:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:38 smithi191 bash[24992]: cluster 2024-08-31T03:22:37.601231+0000 mgr.a (mgr.14388) 3089 : cluster [DBG] pgmap v2139: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-08-31T03:22:39.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:39 smithi163 bash[24253]: cluster 2024-08-31T03:22:39.603495+0000 mgr.a (mgr.14388) 3090 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 66 op/s 2024-08-31T03:22:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:39 smithi027 bash[22610]: cluster 2024-08-31T03:22:39.603495+0000 mgr.a (mgr.14388) 3090 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 66 op/s 2024-08-31T03:22:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:39 smithi191 bash[24992]: cluster 2024-08-31T03:22:39.603495+0000 mgr.a (mgr.14388) 3090 : cluster [DBG] pgmap v2140: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 66 op/s 2024-08-31T03:22:42.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:42.019 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:42.019 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:22:42.806 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:22:42.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:22:42.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:22:42.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:22:42.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:22:42.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:42 smithi163 bash[24253]: cluster 2024-08-31T03:22:41.604246+0000 mgr.a (mgr.14388) 3091 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:42 smithi027 bash[22610]: cluster 2024-08-31T03:22:41.604246+0000 mgr.a (mgr.14388) 3091 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:42 smithi191 bash[24992]: cluster 2024-08-31T03:22:41.604246+0000 mgr.a (mgr.14388) 3091 : cluster [DBG] pgmap v2141: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:43.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:43 smithi163 bash[24253]: audit 2024-08-31T03:22:42.360829+0000 mgr.a (mgr.14388) 3092 : audit [DBG] from='client.78291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:43 smithi027 bash[22610]: audit 2024-08-31T03:22:42.360829+0000 mgr.a (mgr.14388) 3092 : audit [DBG] from='client.78291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:43 smithi191 bash[24992]: audit 2024-08-31T03:22:42.360829+0000 mgr.a (mgr.14388) 3092 : audit [DBG] from='client.78291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:44.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:44 smithi163 bash[24253]: cluster 2024-08-31T03:22:43.606573+0000 mgr.a (mgr.14388) 3093 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:44 smithi027 bash[22610]: cluster 2024-08-31T03:22:43.606573+0000 mgr.a (mgr.14388) 3093 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:44 smithi191 bash[24992]: cluster 2024-08-31T03:22:43.606573+0000 mgr.a (mgr.14388) 3093 : cluster [DBG] pgmap v2142: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:45 smithi163 bash[24253]: cluster 2024-08-31T03:22:45.607431+0000 mgr.a (mgr.14388) 3094 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:45 smithi027 bash[22610]: cluster 2024-08-31T03:22:45.607431+0000 mgr.a (mgr.14388) 3094 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:45 smithi191 bash[24992]: cluster 2024-08-31T03:22:45.607431+0000 mgr.a (mgr.14388) 3094 : cluster [DBG] pgmap v2143: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:47.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:47.808 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:47.808 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:22:48.544 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:22:48.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:22:48.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:22:48.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:22:48.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:22:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:48 smithi163 bash[24253]: cluster 2024-08-31T03:22:47.608301+0000 mgr.a (mgr.14388) 3095 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:48 smithi027 bash[22610]: cluster 2024-08-31T03:22:47.608301+0000 mgr.a (mgr.14388) 3095 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:48 smithi191 bash[24992]: cluster 2024-08-31T03:22:47.608301+0000 mgr.a (mgr.14388) 3095 : cluster [DBG] pgmap v2144: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:49.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:49 smithi163 bash[24253]: audit 2024-08-31T03:22:48.139692+0000 mgr.a (mgr.14388) 3096 : audit [DBG] from='client.78369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:49 smithi027 bash[22610]: audit 2024-08-31T03:22:48.139692+0000 mgr.a (mgr.14388) 3096 : audit [DBG] from='client.78369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:49 smithi191 bash[24992]: audit 2024-08-31T03:22:48.139692+0000 mgr.a (mgr.14388) 3096 : audit [DBG] from='client.78369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:50.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:50 smithi163 bash[24253]: cluster 2024-08-31T03:22:49.610957+0000 mgr.a (mgr.14388) 3097 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:50 smithi027 bash[22610]: cluster 2024-08-31T03:22:49.610957+0000 mgr.a (mgr.14388) 3097 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:50 smithi191 bash[24992]: cluster 2024-08-31T03:22:49.610957+0000 mgr.a (mgr.14388) 3097 : cluster [DBG] pgmap v2145: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:22:51.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:51 smithi163 bash[24253]: cluster 2024-08-31T03:22:51.611734+0000 mgr.a (mgr.14388) 3098 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:51 smithi027 bash[22610]: cluster 2024-08-31T03:22:51.611734+0000 mgr.a (mgr.14388) 3098 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:51 smithi191 bash[24992]: cluster 2024-08-31T03:22:51.611734+0000 mgr.a (mgr.14388) 3098 : cluster [DBG] pgmap v2146: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:53.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:53.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:53.547 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:22:54.335 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:22:54.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:22:54.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:22:54.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:22:54.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:22:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:54 smithi163 bash[24253]: cluster 2024-08-31T03:22:53.613696+0000 mgr.a (mgr.14388) 3099 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:54 smithi027 bash[22610]: cluster 2024-08-31T03:22:53.613696+0000 mgr.a (mgr.14388) 3099 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:54 smithi191 bash[24992]: cluster 2024-08-31T03:22:53.613696+0000 mgr.a (mgr.14388) 3099 : cluster [DBG] pgmap v2147: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:22:55.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:55 smithi163 bash[24253]: audit 2024-08-31T03:22:53.884952+0000 mgr.a (mgr.14388) 3100 : audit [DBG] from='client.78444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:55 smithi027 bash[22610]: audit 2024-08-31T03:22:53.884952+0000 mgr.a (mgr.14388) 3100 : audit [DBG] from='client.78444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:55 smithi191 bash[24992]: audit 2024-08-31T03:22:53.884952+0000 mgr.a (mgr.14388) 3100 : audit [DBG] from='client.78444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:22:56.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:56 smithi163 bash[24253]: cluster 2024-08-31T03:22:55.614576+0000 mgr.a (mgr.14388) 3101 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:56 smithi027 bash[22610]: cluster 2024-08-31T03:22:55.614576+0000 mgr.a (mgr.14388) 3101 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:56 smithi191 bash[24992]: cluster 2024-08-31T03:22:55.614576+0000 mgr.a (mgr.14388) 3101 : cluster [DBG] pgmap v2148: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:22:57.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:22:57 smithi163 bash[24253]: cluster 2024-08-31T03:22:57.615312+0000 mgr.a (mgr.14388) 3102 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:22:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:22:57 smithi027 bash[22610]: cluster 2024-08-31T03:22:57.615312+0000 mgr.a (mgr.14388) 3102 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:22:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:22:57 smithi191 bash[24992]: cluster 2024-08-31T03:22:57.615312+0000 mgr.a (mgr.14388) 3102 : cluster [DBG] pgmap v2149: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:22:59.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:22:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:22:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:00.104 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:00.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:00.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:00.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:00 smithi163 bash[24253]: cluster 2024-08-31T03:22:59.617411+0000 mgr.a (mgr.14388) 3103 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:00 smithi027 bash[22610]: cluster 2024-08-31T03:22:59.617411+0000 mgr.a (mgr.14388) 3103 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:00 smithi191 bash[24992]: cluster 2024-08-31T03:22:59.617411+0000 mgr.a (mgr.14388) 3103 : cluster [DBG] pgmap v2150: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:01.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:01 smithi163 bash[24253]: audit 2024-08-31T03:22:59.673056+0000 mgr.a (mgr.14388) 3104 : audit [DBG] from='client.78516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:01.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:01 smithi163 bash[24253]: cluster 2024-08-31T03:23:01.618301+0000 mgr.a (mgr.14388) 3105 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:01 smithi027 bash[22610]: audit 2024-08-31T03:22:59.673056+0000 mgr.a (mgr.14388) 3104 : audit [DBG] from='client.78516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:01 smithi027 bash[22610]: cluster 2024-08-31T03:23:01.618301+0000 mgr.a (mgr.14388) 3105 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:01 smithi191 bash[24992]: audit 2024-08-31T03:22:59.673056+0000 mgr.a (mgr.14388) 3104 : audit [DBG] from='client.78516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:01 smithi191 bash[24992]: cluster 2024-08-31T03:23:01.618301+0000 mgr.a (mgr.14388) 3105 : cluster [DBG] pgmap v2151: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:03 smithi027 bash[22610]: cluster 2024-08-31T03:23:03.620406+0000 mgr.a (mgr.14388) 3106 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:03 smithi191 bash[24992]: cluster 2024-08-31T03:23:03.620406+0000 mgr.a (mgr.14388) 3106 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:04.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:03 smithi163 bash[24253]: cluster 2024-08-31T03:23:03.620406+0000 mgr.a (mgr.14388) 3106 : cluster [DBG] pgmap v2152: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:05.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:23:05.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:23:05.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:05.868 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:05.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:05.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:05.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:05.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:06.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:06 smithi163 bash[24253]: audit 2024-08-31T03:23:05.442877+0000 mgr.a (mgr.14388) 3107 : audit [DBG] from='client.78591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:06.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:06 smithi163 bash[24253]: cluster 2024-08-31T03:23:05.620932+0000 mgr.a (mgr.14388) 3108 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:06 smithi027 bash[22610]: audit 2024-08-31T03:23:05.442877+0000 mgr.a (mgr.14388) 3107 : audit [DBG] from='client.78591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:06 smithi027 bash[22610]: cluster 2024-08-31T03:23:05.620932+0000 mgr.a (mgr.14388) 3108 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:06 smithi191 bash[24992]: audit 2024-08-31T03:23:05.442877+0000 mgr.a (mgr.14388) 3107 : audit [DBG] from='client.78591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:06 smithi191 bash[24992]: cluster 2024-08-31T03:23:05.620932+0000 mgr.a (mgr.14388) 3108 : cluster [DBG] pgmap v2153: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:07.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:07 smithi163 bash[24253]: cluster 2024-08-31T03:23:07.621918+0000 mgr.a (mgr.14388) 3109 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:07 smithi027 bash[22610]: cluster 2024-08-31T03:23:07.621918+0000 mgr.a (mgr.14388) 3109 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:07 smithi191 bash[24992]: cluster 2024-08-31T03:23:07.621918+0000 mgr.a (mgr.14388) 3109 : cluster [DBG] pgmap v2154: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:09 smithi027 bash[22610]: cluster 2024-08-31T03:23:09.624275+0000 mgr.a (mgr.14388) 3110 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:09 smithi191 bash[24992]: cluster 2024-08-31T03:23:09.624275+0000 mgr.a (mgr.14388) 3110 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:10.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:09 smithi163 bash[24253]: cluster 2024-08-31T03:23:09.624275+0000 mgr.a (mgr.14388) 3110 : cluster [DBG] pgmap v2155: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:10.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:23:10.870 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:23:10.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:11.609 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:11.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:11.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:11.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:11.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:11 smithi027 bash[22610]: audit 2024-08-31T03:23:11.198584+0000 mgr.a (mgr.14388) 3111 : audit [DBG] from='client.78666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:11 smithi027 bash[22610]: cluster 2024-08-31T03:23:11.624969+0000 mgr.a (mgr.14388) 3112 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:11 smithi191 bash[24992]: audit 2024-08-31T03:23:11.198584+0000 mgr.a (mgr.14388) 3111 : audit [DBG] from='client.78666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:11 smithi191 bash[24992]: cluster 2024-08-31T03:23:11.624969+0000 mgr.a (mgr.14388) 3112 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:12.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:11 smithi163 bash[24253]: audit 2024-08-31T03:23:11.198584+0000 mgr.a (mgr.14388) 3111 : audit [DBG] from='client.78666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:12.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:11 smithi163 bash[24253]: cluster 2024-08-31T03:23:11.624969+0000 mgr.a (mgr.14388) 3112 : cluster [DBG] pgmap v2156: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:13 smithi027 bash[22610]: cluster 2024-08-31T03:23:13.627044+0000 mgr.a (mgr.14388) 3113 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:13 smithi191 bash[24992]: cluster 2024-08-31T03:23:13.627044+0000 mgr.a (mgr.14388) 3113 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:14.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:13 smithi163 bash[24253]: cluster 2024-08-31T03:23:13.627044+0000 mgr.a (mgr.14388) 3113 : cluster [DBG] pgmap v2157: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:15 smithi027 bash[22610]: cluster 2024-08-31T03:23:15.627795+0000 mgr.a (mgr.14388) 3114 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:15 smithi191 bash[24992]: cluster 2024-08-31T03:23:15.627795+0000 mgr.a (mgr.14388) 3114 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:16.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:15 smithi163 bash[24253]: cluster 2024-08-31T03:23:15.627795+0000 mgr.a (mgr.14388) 3114 : cluster [DBG] pgmap v2158: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:16.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:23:16.612 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:23:16.612 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:17.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:17.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:17.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:17.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:17.380 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:17 smithi027 bash[22610]: audit 2024-08-31T03:23:16.948005+0000 mgr.a (mgr.14388) 3115 : audit [DBG] from='client.78741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:17 smithi027 bash[22610]: cluster 2024-08-31T03:23:17.628631+0000 mgr.a (mgr.14388) 3116 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:17 smithi191 bash[24992]: audit 2024-08-31T03:23:16.948005+0000 mgr.a (mgr.14388) 3115 : audit [DBG] from='client.78741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:17 smithi191 bash[24992]: cluster 2024-08-31T03:23:17.628631+0000 mgr.a (mgr.14388) 3116 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:18.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:17 smithi163 bash[24253]: audit 2024-08-31T03:23:16.948005+0000 mgr.a (mgr.14388) 3115 : audit [DBG] from='client.78741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:18.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:17 smithi163 bash[24253]: cluster 2024-08-31T03:23:17.628631+0000 mgr.a (mgr.14388) 3116 : cluster [DBG] pgmap v2159: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:19 smithi027 bash[22610]: cluster 2024-08-31T03:23:19.630851+0000 mgr.a (mgr.14388) 3117 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:19 smithi191 bash[24992]: cluster 2024-08-31T03:23:19.630851+0000 mgr.a (mgr.14388) 3117 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:20.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:19 smithi163 bash[24253]: cluster 2024-08-31T03:23:19.630851+0000 mgr.a (mgr.14388) 3117 : cluster [DBG] pgmap v2160: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:21 smithi027 bash[22610]: cluster 2024-08-31T03:23:21.631578+0000 mgr.a (mgr.14388) 3118 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:21 smithi191 bash[24992]: cluster 2024-08-31T03:23:21.631578+0000 mgr.a (mgr.14388) 3118 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:22.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:21 smithi163 bash[24253]: cluster 2024-08-31T03:23:21.631578+0000 mgr.a (mgr.14388) 3118 : cluster [DBG] pgmap v2161: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:22.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:23:22.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:23:22.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:23.162 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:23.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:23.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:23.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:23.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:23 smithi027 bash[22610]: audit 2024-08-31T03:23:22.724131+0000 mgr.a (mgr.14388) 3119 : audit [DBG] from='client.78816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:23 smithi027 bash[22610]: cluster 2024-08-31T03:23:23.633980+0000 mgr.a (mgr.14388) 3120 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:23:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:23 smithi191 bash[24992]: audit 2024-08-31T03:23:22.724131+0000 mgr.a (mgr.14388) 3119 : audit [DBG] from='client.78816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:23 smithi191 bash[24992]: cluster 2024-08-31T03:23:23.633980+0000 mgr.a (mgr.14388) 3120 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:23:24.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:23 smithi163 bash[24253]: audit 2024-08-31T03:23:22.724131+0000 mgr.a (mgr.14388) 3119 : audit [DBG] from='client.78816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:24.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:23 smithi163 bash[24253]: cluster 2024-08-31T03:23:23.633980+0000 mgr.a (mgr.14388) 3120 : cluster [DBG] pgmap v2162: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:23:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:25 smithi027 bash[22610]: cluster 2024-08-31T03:23:25.634901+0000 mgr.a (mgr.14388) 3121 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:23:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:25 smithi191 bash[24992]: cluster 2024-08-31T03:23:25.634901+0000 mgr.a (mgr.14388) 3121 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:23:26.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:25 smithi163 bash[24253]: cluster 2024-08-31T03:23:25.634901+0000 mgr.a (mgr.14388) 3121 : cluster [DBG] pgmap v2163: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:23:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:27 smithi027 bash[22610]: cluster 2024-08-31T03:23:27.635662+0000 mgr.a (mgr.14388) 3122 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:23:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:27 smithi191 bash[24992]: cluster 2024-08-31T03:23:27.635662+0000 mgr.a (mgr.14388) 3122 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:23:28.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:23:28.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:23:28.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:28.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:27 smithi163 bash[24253]: cluster 2024-08-31T03:23:27.635662+0000 mgr.a (mgr.14388) 3122 : cluster [DBG] pgmap v2164: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:23:28.942 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:28 smithi027 bash[22610]: audit 2024-08-31T03:23:28.500056+0000 mgr.a (mgr.14388) 3123 : audit [DBG] from='client.78894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:28 smithi191 bash[24992]: audit 2024-08-31T03:23:28.500056+0000 mgr.a (mgr.14388) 3123 : audit [DBG] from='client.78894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:29.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:28 smithi163 bash[24253]: audit 2024-08-31T03:23:28.500056+0000 mgr.a (mgr.14388) 3123 : audit [DBG] from='client.78894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:29 smithi191 bash[24992]: cluster 2024-08-31T03:23:29.638299+0000 mgr.a (mgr.14388) 3124 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:30.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:29 smithi163 bash[24253]: cluster 2024-08-31T03:23:29.638299+0000 mgr.a (mgr.14388) 3124 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:29 smithi027 bash[22610]: cluster 2024-08-31T03:23:29.638299+0000 mgr.a (mgr.14388) 3124 : cluster [DBG] pgmap v2165: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:31 smithi027 bash[22610]: cluster 2024-08-31T03:23:31.639108+0000 mgr.a (mgr.14388) 3125 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:23:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:31 smithi191 bash[24992]: cluster 2024-08-31T03:23:31.639108+0000 mgr.a (mgr.14388) 3125 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:23:32.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:31 smithi163 bash[24253]: cluster 2024-08-31T03:23:31.639108+0000 mgr.a (mgr.14388) 3125 : cluster [DBG] pgmap v2166: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:23:33.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:23:33.944 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:23:33.944 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:33 smithi027 bash[22610]: cluster 2024-08-31T03:23:33.640987+0000 mgr.a (mgr.14388) 3126 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:33 smithi191 bash[24992]: cluster 2024-08-31T03:23:33.640987+0000 mgr.a (mgr.14388) 3126 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:34.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:33 smithi163 bash[24253]: cluster 2024-08-31T03:23:33.640987+0000 mgr.a (mgr.14388) 3126 : cluster [DBG] pgmap v2167: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:34.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:34.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:34.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:34.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:34.696 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:34 smithi191 bash[24992]: audit 2024-08-31T03:23:34.275818+0000 mgr.a (mgr.14388) 3127 : audit [DBG] from='client.78972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:35.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:34 smithi163 bash[24253]: audit 2024-08-31T03:23:34.275818+0000 mgr.a (mgr.14388) 3127 : audit [DBG] from='client.78972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:34 smithi027 bash[22610]: audit 2024-08-31T03:23:34.275818+0000 mgr.a (mgr.14388) 3127 : audit [DBG] from='client.78972 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:35 smithi191 bash[24992]: cluster 2024-08-31T03:23:35.641916+0000 mgr.a (mgr.14388) 3128 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:23:36.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:35 smithi163 bash[24253]: cluster 2024-08-31T03:23:35.641916+0000 mgr.a (mgr.14388) 3128 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:23:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:35 smithi027 bash[22610]: cluster 2024-08-31T03:23:35.641916+0000 mgr.a (mgr.14388) 3128 : cluster [DBG] pgmap v2168: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:23:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:36 smithi191 bash[24992]: audit 2024-08-31T03:23:35.971850+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:23:37.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:36 smithi163 bash[24253]: audit 2024-08-31T03:23:35.971850+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:23:37.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:36 smithi027 bash[22610]: audit 2024-08-31T03:23:35.971850+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:23:37.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:23:37 smithi027 bash[22863]: debug 2024-08-31T03:23:37.544+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:23:37.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:23:37 smithi027 bash[22863]: debug 2024-08-31T03:23:37.548+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:23:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:37 smithi027 bash[22610]: audit 2024-08-31T03:23:36.822872+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:23:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:37 smithi027 bash[22610]: audit 2024-08-31T03:23:36.824388+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:23:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:37 smithi027 bash[22610]: audit 2024-08-31T03:23:36.834676+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:23:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:37 smithi027 bash[22610]: audit 2024-08-31T03:23:36.839471+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:23:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:37 smithi027 bash[22610]: audit 2024-08-31T03:23:36.841826+0000 mgr.a (mgr.14388) 3129 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:23:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:37 smithi027 bash[22610]: audit 2024-08-31T03:23:37.550368+0000 mgr.a (mgr.14388) 3130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:23:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:37 smithi027 bash[22610]: cephadm 2024-08-31T03:23:37.551670+0000 mgr.a (mgr.14388) 3131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:23:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:37 smithi027 bash[22610]: cluster 2024-08-31T03:23:37.642542+0000 mgr.a (mgr.14388) 3132 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:23:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:37 smithi191 bash[24992]: audit 2024-08-31T03:23:36.822872+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:23:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:37 smithi191 bash[24992]: audit 2024-08-31T03:23:36.824388+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:23:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:37 smithi191 bash[24992]: audit 2024-08-31T03:23:36.834676+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:23:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:37 smithi191 bash[24992]: audit 2024-08-31T03:23:36.839471+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:23:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:37 smithi191 bash[24992]: audit 2024-08-31T03:23:36.841826+0000 mgr.a (mgr.14388) 3129 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:23:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:37 smithi191 bash[24992]: audit 2024-08-31T03:23:37.550368+0000 mgr.a (mgr.14388) 3130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:23:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:37 smithi191 bash[24992]: cephadm 2024-08-31T03:23:37.551670+0000 mgr.a (mgr.14388) 3131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:23:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:37 smithi191 bash[24992]: cluster 2024-08-31T03:23:37.642542+0000 mgr.a (mgr.14388) 3132 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:23:38.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:37 smithi163 bash[24253]: audit 2024-08-31T03:23:36.822872+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:23:38.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:37 smithi163 bash[24253]: audit 2024-08-31T03:23:36.824388+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:23:38.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:37 smithi163 bash[24253]: audit 2024-08-31T03:23:36.834676+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:23:38.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:37 smithi163 bash[24253]: audit 2024-08-31T03:23:36.839471+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:23:38.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:37 smithi163 bash[24253]: audit 2024-08-31T03:23:36.841826+0000 mgr.a (mgr.14388) 3129 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:23:38.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:37 smithi163 bash[24253]: audit 2024-08-31T03:23:37.550368+0000 mgr.a (mgr.14388) 3130 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:23:38.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:37 smithi163 bash[24253]: cephadm 2024-08-31T03:23:37.551670+0000 mgr.a (mgr.14388) 3131 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:23:38.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:37 smithi163 bash[24253]: cluster 2024-08-31T03:23:37.642542+0000 mgr.a (mgr.14388) 3132 : cluster [DBG] pgmap v2169: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:23:39.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:23:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:23:39.698 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:39 smithi027 bash[22610]: cluster 2024-08-31T03:23:39.644855+0000 mgr.a (mgr.14388) 3133 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:39 smithi191 bash[24992]: cluster 2024-08-31T03:23:39.644855+0000 mgr.a (mgr.14388) 3133 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:40.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:39 smithi163 bash[24253]: cluster 2024-08-31T03:23:39.644855+0000 mgr.a (mgr.14388) 3133 : cluster [DBG] pgmap v2170: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:40.477 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:40.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:40 smithi191 bash[24992]: audit 2024-08-31T03:23:40.035768+0000 mgr.a (mgr.14388) 3134 : audit [DBG] from='client.79158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:41.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:40 smithi163 bash[24253]: audit 2024-08-31T03:23:40.035768+0000 mgr.a (mgr.14388) 3134 : audit [DBG] from='client.79158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:41.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:40 smithi027 bash[22610]: audit 2024-08-31T03:23:40.035768+0000 mgr.a (mgr.14388) 3134 : audit [DBG] from='client.79158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:41 smithi027 bash[22610]: cluster 2024-08-31T03:23:41.645826+0000 mgr.a (mgr.14388) 3135 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:41 smithi191 bash[24992]: cluster 2024-08-31T03:23:41.645826+0000 mgr.a (mgr.14388) 3135 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:42.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:41 smithi163 bash[24253]: cluster 2024-08-31T03:23:41.645826+0000 mgr.a (mgr.14388) 3135 : cluster [DBG] pgmap v2171: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:43 smithi191 bash[24992]: cluster 2024-08-31T03:23:43.648091+0000 mgr.a (mgr.14388) 3136 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:44.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:43 smithi163 bash[24253]: cluster 2024-08-31T03:23:43.648091+0000 mgr.a (mgr.14388) 3136 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:43 smithi027 bash[22610]: cluster 2024-08-31T03:23:43.648091+0000 mgr.a (mgr.14388) 3136 : cluster [DBG] pgmap v2172: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:45.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:23:45.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:23:45.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:45 smithi191 bash[24992]: cluster 2024-08-31T03:23:45.648752+0000 mgr.a (mgr.14388) 3137 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:46.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:45 smithi163 bash[24253]: cluster 2024-08-31T03:23:45.648752+0000 mgr.a (mgr.14388) 3137 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:46.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:46.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:46.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:46.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:46.208 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:45 smithi027 bash[22610]: cluster 2024-08-31T03:23:45.648752+0000 mgr.a (mgr.14388) 3137 : cluster [DBG] pgmap v2173: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:46 smithi191 bash[24992]: audit 2024-08-31T03:23:45.810126+0000 mgr.a (mgr.14388) 3138 : audit [DBG] from='client.79236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:47.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:46 smithi163 bash[24253]: audit 2024-08-31T03:23:45.810126+0000 mgr.a (mgr.14388) 3138 : audit [DBG] from='client.79236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:46 smithi027 bash[22610]: audit 2024-08-31T03:23:45.810126+0000 mgr.a (mgr.14388) 3138 : audit [DBG] from='client.79236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:47 smithi191 bash[24992]: cluster 2024-08-31T03:23:47.649696+0000 mgr.a (mgr.14388) 3139 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:48.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:47 smithi163 bash[24253]: cluster 2024-08-31T03:23:47.649696+0000 mgr.a (mgr.14388) 3139 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:47 smithi027 bash[22610]: cluster 2024-08-31T03:23:47.649696+0000 mgr.a (mgr.14388) 3139 : cluster [DBG] pgmap v2174: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:49 smithi191 bash[24992]: cluster 2024-08-31T03:23:49.651951+0000 mgr.a (mgr.14388) 3140 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:50.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:49 smithi163 bash[24253]: cluster 2024-08-31T03:23:49.651951+0000 mgr.a (mgr.14388) 3140 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:49 smithi027 bash[22610]: cluster 2024-08-31T03:23:49.651951+0000 mgr.a (mgr.14388) 3140 : cluster [DBG] pgmap v2175: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:23:51.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:23:51.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:23:51.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:51.952 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:51.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:51.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:51.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:51.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:51 smithi191 bash[24992]: audit 2024-08-31T03:23:51.542772+0000 mgr.a (mgr.14388) 3141 : audit [DBG] from='client.79314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:51 smithi191 bash[24992]: cluster 2024-08-31T03:23:51.652437+0000 mgr.a (mgr.14388) 3142 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:52.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:51 smithi163 bash[24253]: audit 2024-08-31T03:23:51.542772+0000 mgr.a (mgr.14388) 3141 : audit [DBG] from='client.79314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:52.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:51 smithi163 bash[24253]: cluster 2024-08-31T03:23:51.652437+0000 mgr.a (mgr.14388) 3142 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:51 smithi027 bash[22610]: audit 2024-08-31T03:23:51.542772+0000 mgr.a (mgr.14388) 3141 : audit [DBG] from='client.79314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:51 smithi027 bash[22610]: cluster 2024-08-31T03:23:51.652437+0000 mgr.a (mgr.14388) 3142 : cluster [DBG] pgmap v2176: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:53 smithi191 bash[24992]: cluster 2024-08-31T03:23:53.654658+0000 mgr.a (mgr.14388) 3143 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:54.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:53 smithi163 bash[24253]: cluster 2024-08-31T03:23:53.654658+0000 mgr.a (mgr.14388) 3143 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:53 smithi027 bash[22610]: cluster 2024-08-31T03:23:53.654658+0000 mgr.a (mgr.14388) 3143 : cluster [DBG] pgmap v2177: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:23:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:55 smithi191 bash[24992]: cluster 2024-08-31T03:23:55.655504+0000 mgr.a (mgr.14388) 3144 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:56.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:55 smithi163 bash[24253]: cluster 2024-08-31T03:23:55.655504+0000 mgr.a (mgr.14388) 3144 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:55 smithi027 bash[22610]: cluster 2024-08-31T03:23:55.655504+0000 mgr.a (mgr.14388) 3144 : cluster [DBG] pgmap v2178: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:56.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:23:56.955 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:23:56.955 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:23:57.689 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:23:57.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:23:57.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:23:57.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:23:57.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:23:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:57 smithi191 bash[24992]: audit 2024-08-31T03:23:57.285079+0000 mgr.a (mgr.14388) 3145 : audit [DBG] from='client.79389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:57 smithi191 bash[24992]: cluster 2024-08-31T03:23:57.656092+0000 mgr.a (mgr.14388) 3146 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:58.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:57 smithi163 bash[24253]: audit 2024-08-31T03:23:57.285079+0000 mgr.a (mgr.14388) 3145 : audit [DBG] from='client.79389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:58.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:57 smithi163 bash[24253]: cluster 2024-08-31T03:23:57.656092+0000 mgr.a (mgr.14388) 3146 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:23:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:57 smithi027 bash[22610]: audit 2024-08-31T03:23:57.285079+0000 mgr.a (mgr.14388) 3145 : audit [DBG] from='client.79389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:23:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:57 smithi027 bash[22610]: cluster 2024-08-31T03:23:57.656092+0000 mgr.a (mgr.14388) 3146 : cluster [DBG] pgmap v2179: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:23:59 smithi191 bash[24992]: cluster 2024-08-31T03:23:59.658366+0000 mgr.a (mgr.14388) 3147 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:00.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:23:59 smithi163 bash[24253]: cluster 2024-08-31T03:23:59.658366+0000 mgr.a (mgr.14388) 3147 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:23:59 smithi027 bash[22610]: cluster 2024-08-31T03:23:59.658366+0000 mgr.a (mgr.14388) 3147 : cluster [DBG] pgmap v2180: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:01 smithi191 bash[24992]: cluster 2024-08-31T03:24:01.659359+0000 mgr.a (mgr.14388) 3148 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:02.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:01 smithi163 bash[24253]: cluster 2024-08-31T03:24:01.659359+0000 mgr.a (mgr.14388) 3148 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:02.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:01 smithi027 bash[22610]: cluster 2024-08-31T03:24:01.659359+0000 mgr.a (mgr.14388) 3148 : cluster [DBG] pgmap v2181: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:02.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:24:02.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:24:02.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:24:03.443 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:24:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:24:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:24:03.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:24:03.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:24:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:03 smithi191 bash[24992]: audit 2024-08-31T03:24:03.028292+0000 mgr.a (mgr.14388) 3149 : audit [DBG] from='client.79467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:03 smithi191 bash[24992]: cluster 2024-08-31T03:24:03.662028+0000 mgr.a (mgr.14388) 3150 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:04.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:03 smithi163 bash[24253]: audit 2024-08-31T03:24:03.028292+0000 mgr.a (mgr.14388) 3149 : audit [DBG] from='client.79467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:04.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:03 smithi163 bash[24253]: cluster 2024-08-31T03:24:03.662028+0000 mgr.a (mgr.14388) 3150 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:03 smithi027 bash[22610]: audit 2024-08-31T03:24:03.028292+0000 mgr.a (mgr.14388) 3149 : audit [DBG] from='client.79467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:03 smithi027 bash[22610]: cluster 2024-08-31T03:24:03.662028+0000 mgr.a (mgr.14388) 3150 : cluster [DBG] pgmap v2182: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:05 smithi191 bash[24992]: cluster 2024-08-31T03:24:05.662865+0000 mgr.a (mgr.14388) 3151 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:24:06.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:05 smithi163 bash[24253]: cluster 2024-08-31T03:24:05.662865+0000 mgr.a (mgr.14388) 3151 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:24:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:05 smithi027 bash[22610]: cluster 2024-08-31T03:24:05.662865+0000 mgr.a (mgr.14388) 3151 : cluster [DBG] pgmap v2183: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:24:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:07 smithi191 bash[24992]: cluster 2024-08-31T03:24:07.663644+0000 mgr.a (mgr.14388) 3152 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:24:08.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:07 smithi163 bash[24253]: cluster 2024-08-31T03:24:07.663644+0000 mgr.a (mgr.14388) 3152 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:24:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:07 smithi027 bash[22610]: cluster 2024-08-31T03:24:07.663644+0000 mgr.a (mgr.14388) 3152 : cluster [DBG] pgmap v2184: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:24:08.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:24:08.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:24:08.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:24:09.217 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:24:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:24:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:24:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:24:09.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:24:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:09 smithi191 bash[24992]: audit 2024-08-31T03:24:08.784879+0000 mgr.a (mgr.14388) 3153 : audit [DBG] from='client.79545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:09 smithi191 bash[24992]: cluster 2024-08-31T03:24:09.666452+0000 mgr.a (mgr.14388) 3154 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:10.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:09 smithi163 bash[24253]: audit 2024-08-31T03:24:08.784879+0000 mgr.a (mgr.14388) 3153 : audit [DBG] from='client.79545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:10.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:09 smithi163 bash[24253]: cluster 2024-08-31T03:24:09.666452+0000 mgr.a (mgr.14388) 3154 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:09 smithi027 bash[22610]: audit 2024-08-31T03:24:08.784879+0000 mgr.a (mgr.14388) 3153 : audit [DBG] from='client.79545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:09 smithi027 bash[22610]: cluster 2024-08-31T03:24:09.666452+0000 mgr.a (mgr.14388) 3154 : cluster [DBG] pgmap v2185: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:11 smithi191 bash[24992]: cluster 2024-08-31T03:24:11.667281+0000 mgr.a (mgr.14388) 3155 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:24:12.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:11 smithi163 bash[24253]: cluster 2024-08-31T03:24:11.667281+0000 mgr.a (mgr.14388) 3155 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:24:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:11 smithi027 bash[22610]: cluster 2024-08-31T03:24:11.667281+0000 mgr.a (mgr.14388) 3155 : cluster [DBG] pgmap v2186: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:24:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:13 smithi191 bash[24992]: cluster 2024-08-31T03:24:13.669141+0000 mgr.a (mgr.14388) 3156 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:14.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:13 smithi163 bash[24253]: cluster 2024-08-31T03:24:13.669141+0000 mgr.a (mgr.14388) 3156 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:14.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:24:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:24:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:24:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:13 smithi027 bash[22610]: cluster 2024-08-31T03:24:13.669141+0000 mgr.a (mgr.14388) 3156 : cluster [DBG] pgmap v2187: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:14.981 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:24:14.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:24:14.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:24:14.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:24:14.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:24:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:14 smithi191 bash[24992]: audit 2024-08-31T03:24:14.554825+0000 mgr.a (mgr.14388) 3157 : audit [DBG] from='client.79620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:15.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:14 smithi163 bash[24253]: audit 2024-08-31T03:24:14.554825+0000 mgr.a (mgr.14388) 3157 : audit [DBG] from='client.79620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:14 smithi027 bash[22610]: audit 2024-08-31T03:24:14.554825+0000 mgr.a (mgr.14388) 3157 : audit [DBG] from='client.79620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:15 smithi191 bash[24992]: cluster 2024-08-31T03:24:15.670118+0000 mgr.a (mgr.14388) 3158 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:16.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:15 smithi163 bash[24253]: cluster 2024-08-31T03:24:15.670118+0000 mgr.a (mgr.14388) 3158 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:15 smithi027 bash[22610]: cluster 2024-08-31T03:24:15.670118+0000 mgr.a (mgr.14388) 3158 : cluster [DBG] pgmap v2188: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:17 smithi191 bash[24992]: cluster 2024-08-31T03:24:17.670948+0000 mgr.a (mgr.14388) 3159 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:18.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:17 smithi163 bash[24253]: cluster 2024-08-31T03:24:17.670948+0000 mgr.a (mgr.14388) 3159 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:17 smithi027 bash[22610]: cluster 2024-08-31T03:24:17.670948+0000 mgr.a (mgr.14388) 3159 : cluster [DBG] pgmap v2189: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:19.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:24:19.984 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:24:19.984 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:24:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:19 smithi191 bash[24992]: cluster 2024-08-31T03:24:19.673103+0000 mgr.a (mgr.14388) 3160 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:20.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:19 smithi163 bash[24253]: cluster 2024-08-31T03:24:19.673103+0000 mgr.a (mgr.14388) 3160 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:19 smithi027 bash[22610]: cluster 2024-08-31T03:24:19.673103+0000 mgr.a (mgr.14388) 3160 : cluster [DBG] pgmap v2190: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:20.736 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:24:20.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:24:20.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:24:20.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:24:20.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:24:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:20 smithi191 bash[24992]: audit 2024-08-31T03:24:20.320888+0000 mgr.a (mgr.14388) 3161 : audit [DBG] from='client.79698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:21.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:20 smithi163 bash[24253]: audit 2024-08-31T03:24:20.320888+0000 mgr.a (mgr.14388) 3161 : audit [DBG] from='client.79698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:20 smithi027 bash[22610]: audit 2024-08-31T03:24:20.320888+0000 mgr.a (mgr.14388) 3161 : audit [DBG] from='client.79698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:21 smithi191 bash[24992]: cluster 2024-08-31T03:24:21.674070+0000 mgr.a (mgr.14388) 3162 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:22.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:21 smithi163 bash[24253]: cluster 2024-08-31T03:24:21.674070+0000 mgr.a (mgr.14388) 3162 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:21 smithi027 bash[22610]: cluster 2024-08-31T03:24:21.674070+0000 mgr.a (mgr.14388) 3162 : cluster [DBG] pgmap v2191: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:23 smithi191 bash[24992]: cluster 2024-08-31T03:24:23.676225+0000 mgr.a (mgr.14388) 3163 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:24.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:23 smithi163 bash[24253]: cluster 2024-08-31T03:24:23.676225+0000 mgr.a (mgr.14388) 3163 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:23 smithi027 bash[22610]: cluster 2024-08-31T03:24:23.676225+0000 mgr.a (mgr.14388) 3163 : cluster [DBG] pgmap v2192: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:25.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:24:25.738 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:24:25.738 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:24:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:25 smithi191 bash[24992]: cluster 2024-08-31T03:24:25.676998+0000 mgr.a (mgr.14388) 3164 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:26.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:25 smithi163 bash[24253]: cluster 2024-08-31T03:24:25.676998+0000 mgr.a (mgr.14388) 3164 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:25 smithi027 bash[22610]: cluster 2024-08-31T03:24:25.676998+0000 mgr.a (mgr.14388) 3164 : cluster [DBG] pgmap v2193: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:26.513 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:24:26.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:24:26.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:24:26.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:24:26.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:24:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:26 smithi191 bash[24992]: audit 2024-08-31T03:24:26.074894+0000 mgr.a (mgr.14388) 3165 : audit [DBG] from='client.79776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:27.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:26 smithi163 bash[24253]: audit 2024-08-31T03:24:26.074894+0000 mgr.a (mgr.14388) 3165 : audit [DBG] from='client.79776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:26 smithi027 bash[22610]: audit 2024-08-31T03:24:26.074894+0000 mgr.a (mgr.14388) 3165 : audit [DBG] from='client.79776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:27 smithi191 bash[24992]: cluster 2024-08-31T03:24:27.678107+0000 mgr.a (mgr.14388) 3166 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:28.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:27 smithi163 bash[24253]: cluster 2024-08-31T03:24:27.678107+0000 mgr.a (mgr.14388) 3166 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:28.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:27 smithi027 bash[22610]: cluster 2024-08-31T03:24:27.678107+0000 mgr.a (mgr.14388) 3166 : cluster [DBG] pgmap v2194: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:29 smithi191 bash[24992]: cluster 2024-08-31T03:24:29.680464+0000 mgr.a (mgr.14388) 3167 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:30.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:29 smithi163 bash[24253]: cluster 2024-08-31T03:24:29.680464+0000 mgr.a (mgr.14388) 3167 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:29 smithi027 bash[22610]: cluster 2024-08-31T03:24:29.680464+0000 mgr.a (mgr.14388) 3167 : cluster [DBG] pgmap v2195: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:31.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:24:31.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:24:31.516 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:24:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:31 smithi191 bash[24992]: cluster 2024-08-31T03:24:31.681069+0000 mgr.a (mgr.14388) 3168 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:32.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:31 smithi163 bash[24253]: cluster 2024-08-31T03:24:31.681069+0000 mgr.a (mgr.14388) 3168 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:31 smithi027 bash[22610]: cluster 2024-08-31T03:24:31.681069+0000 mgr.a (mgr.14388) 3168 : cluster [DBG] pgmap v2196: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:32.295 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:24:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:24:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:24:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:24:32.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:24:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:32 smithi191 bash[24992]: audit 2024-08-31T03:24:31.851015+0000 mgr.a (mgr.14388) 3169 : audit [DBG] from='client.79851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:33.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:32 smithi163 bash[24253]: audit 2024-08-31T03:24:31.851015+0000 mgr.a (mgr.14388) 3169 : audit [DBG] from='client.79851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:32 smithi027 bash[22610]: audit 2024-08-31T03:24:31.851015+0000 mgr.a (mgr.14388) 3169 : audit [DBG] from='client.79851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:33 smithi191 bash[24992]: cluster 2024-08-31T03:24:33.683330+0000 mgr.a (mgr.14388) 3170 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:34.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:33 smithi163 bash[24253]: cluster 2024-08-31T03:24:33.683330+0000 mgr.a (mgr.14388) 3170 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:33 smithi027 bash[22610]: cluster 2024-08-31T03:24:33.683330+0000 mgr.a (mgr.14388) 3170 : cluster [DBG] pgmap v2197: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:24:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:35 smithi191 bash[24992]: cluster 2024-08-31T03:24:35.684054+0000 mgr.a (mgr.14388) 3171 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:36.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:35 smithi163 bash[24253]: cluster 2024-08-31T03:24:35.684054+0000 mgr.a (mgr.14388) 3171 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:35 smithi027 bash[22610]: cluster 2024-08-31T03:24:35.684054+0000 mgr.a (mgr.14388) 3171 : cluster [DBG] pgmap v2198: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:37.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:24:37.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:24:37.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:24:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:37 smithi163 bash[24253]: audit 2024-08-31T03:24:37.601893+0000 mon.a (mon.0) 1064 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:24:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:37 smithi027 bash[22610]: audit 2024-08-31T03:24:37.601893+0000 mon.a (mon.0) 1064 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:24:38.049 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:37 smithi191 bash[24992]: audit 2024-08-31T03:24:37.601893+0000 mon.a (mon.0) 1064 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:24:38.051 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:24:38.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:24:38.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:24:38.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:24:38.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:24:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:38 smithi163 bash[24253]: audit 2024-08-31T03:24:37.627041+0000 mgr.a (mgr.14388) 3172 : audit [DBG] from='client.79920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:38 smithi163 bash[24253]: cluster 2024-08-31T03:24:37.685176+0000 mgr.a (mgr.14388) 3173 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:38 smithi163 bash[24253]: audit 2024-08-31T03:24:38.422192+0000 mon.a (mon.0) 1065 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:24:38.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:38 smithi163 bash[24253]: audit 2024-08-31T03:24:38.424104+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:24:38.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:38 smithi163 bash[24253]: audit 2024-08-31T03:24:38.434532+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:24:38.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:38 smithi163 bash[24253]: audit 2024-08-31T03:24:38.437038+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:24:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:38 smithi027 bash[22610]: audit 2024-08-31T03:24:37.627041+0000 mgr.a (mgr.14388) 3172 : audit [DBG] from='client.79920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:38 smithi027 bash[22610]: cluster 2024-08-31T03:24:37.685176+0000 mgr.a (mgr.14388) 3173 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:38 smithi027 bash[22610]: audit 2024-08-31T03:24:38.422192+0000 mon.a (mon.0) 1065 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:24:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:38 smithi027 bash[22610]: audit 2024-08-31T03:24:38.424104+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:24:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:38 smithi027 bash[22610]: audit 2024-08-31T03:24:38.434532+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:24:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:38 smithi027 bash[22610]: audit 2024-08-31T03:24:38.437038+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:24:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:38 smithi191 bash[24992]: audit 2024-08-31T03:24:37.627041+0000 mgr.a (mgr.14388) 3172 : audit [DBG] from='client.79920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:38 smithi191 bash[24992]: cluster 2024-08-31T03:24:37.685176+0000 mgr.a (mgr.14388) 3173 : cluster [DBG] pgmap v2199: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:38 smithi191 bash[24992]: audit 2024-08-31T03:24:38.422192+0000 mon.a (mon.0) 1065 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:24:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:38 smithi191 bash[24992]: audit 2024-08-31T03:24:38.424104+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:24:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:38 smithi191 bash[24992]: audit 2024-08-31T03:24:38.434532+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:24:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:38 smithi191 bash[24992]: audit 2024-08-31T03:24:38.437038+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:24:39.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:24:39 smithi027 bash[22863]: debug 2024-08-31T03:24:39.138+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:24:39.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:24:39 smithi027 bash[22863]: debug 2024-08-31T03:24:39.138+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:24:39.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:39 smithi163 bash[24253]: audit 2024-08-31T03:24:38.438345+0000 mgr.a (mgr.14388) 3174 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:24:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:39 smithi027 bash[22610]: audit 2024-08-31T03:24:38.438345+0000 mgr.a (mgr.14388) 3174 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:24:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:39 smithi191 bash[24992]: audit 2024-08-31T03:24:38.438345+0000 mgr.a (mgr.14388) 3174 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:24:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:40 smithi163 bash[24253]: audit 2024-08-31T03:24:39.140872+0000 mgr.a (mgr.14388) 3175 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:24:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:40 smithi163 bash[24253]: cephadm 2024-08-31T03:24:39.142217+0000 mgr.a (mgr.14388) 3176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:24:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:40 smithi163 bash[24253]: cluster 2024-08-31T03:24:39.688014+0000 mgr.a (mgr.14388) 3177 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:24:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:40 smithi027 bash[22610]: audit 2024-08-31T03:24:39.140872+0000 mgr.a (mgr.14388) 3175 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:24:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:40 smithi027 bash[22610]: cephadm 2024-08-31T03:24:39.142217+0000 mgr.a (mgr.14388) 3176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:24:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:40 smithi027 bash[22610]: cluster 2024-08-31T03:24:39.688014+0000 mgr.a (mgr.14388) 3177 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:24:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:40 smithi191 bash[24992]: audit 2024-08-31T03:24:39.140872+0000 mgr.a (mgr.14388) 3175 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:24:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:40 smithi191 bash[24992]: cephadm 2024-08-31T03:24:39.142217+0000 mgr.a (mgr.14388) 3176 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:24:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:40 smithi191 bash[24992]: cluster 2024-08-31T03:24:39.688014+0000 mgr.a (mgr.14388) 3177 : cluster [DBG] pgmap v2200: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:24:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:41 smithi191 bash[24992]: cluster 2024-08-31T03:24:41.688806+0000 mgr.a (mgr.14388) 3178 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:24:42.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:41 smithi163 bash[24253]: cluster 2024-08-31T03:24:41.688806+0000 mgr.a (mgr.14388) 3178 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:24:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:41 smithi027 bash[22610]: cluster 2024-08-31T03:24:41.688806+0000 mgr.a (mgr.14388) 3178 : cluster [DBG] pgmap v2201: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:24:43.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:24:43.054 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:24:43.054 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:24:43.830 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:24:43.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:24:43.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:24:43.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:24:43.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:24:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:43 smithi191 bash[24992]: audit 2024-08-31T03:24:43.389864+0000 mgr.a (mgr.14388) 3179 : audit [DBG] from='client.80106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:43 smithi191 bash[24992]: cluster 2024-08-31T03:24:43.690144+0000 mgr.a (mgr.14388) 3180 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:24:44.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:43 smithi163 bash[24253]: audit 2024-08-31T03:24:43.389864+0000 mgr.a (mgr.14388) 3179 : audit [DBG] from='client.80106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:44.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:43 smithi163 bash[24253]: cluster 2024-08-31T03:24:43.690144+0000 mgr.a (mgr.14388) 3180 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:24:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:43 smithi027 bash[22610]: audit 2024-08-31T03:24:43.389864+0000 mgr.a (mgr.14388) 3179 : audit [DBG] from='client.80106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:43 smithi027 bash[22610]: cluster 2024-08-31T03:24:43.690144+0000 mgr.a (mgr.14388) 3180 : cluster [DBG] pgmap v2202: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:24:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:45 smithi191 bash[24992]: cluster 2024-08-31T03:24:45.691029+0000 mgr.a (mgr.14388) 3181 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:24:46.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:45 smithi163 bash[24253]: cluster 2024-08-31T03:24:45.691029+0000 mgr.a (mgr.14388) 3181 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:24:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:45 smithi027 bash[22610]: cluster 2024-08-31T03:24:45.691029+0000 mgr.a (mgr.14388) 3181 : cluster [DBG] pgmap v2203: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:24:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:47 smithi191 bash[24992]: cluster 2024-08-31T03:24:47.691811+0000 mgr.a (mgr.14388) 3182 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:24:48.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:47 smithi163 bash[24253]: cluster 2024-08-31T03:24:47.691811+0000 mgr.a (mgr.14388) 3182 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:24:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:47 smithi027 bash[22610]: cluster 2024-08-31T03:24:47.691811+0000 mgr.a (mgr.14388) 3182 : cluster [DBG] pgmap v2204: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:24:48.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:24:48.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:24:48.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:24:49.613 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:24:49.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:24:49.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:24:49.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:24:49.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:24:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:49 smithi191 bash[24992]: audit 2024-08-31T03:24:49.170274+0000 mgr.a (mgr.14388) 3183 : audit [DBG] from='client.80184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:49 smithi191 bash[24992]: cluster 2024-08-31T03:24:49.693195+0000 mgr.a (mgr.14388) 3184 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:24:50.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:49 smithi163 bash[24253]: audit 2024-08-31T03:24:49.170274+0000 mgr.a (mgr.14388) 3183 : audit [DBG] from='client.80184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:50.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:49 smithi163 bash[24253]: cluster 2024-08-31T03:24:49.693195+0000 mgr.a (mgr.14388) 3184 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:24:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:49 smithi027 bash[22610]: audit 2024-08-31T03:24:49.170274+0000 mgr.a (mgr.14388) 3183 : audit [DBG] from='client.80184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:49 smithi027 bash[22610]: cluster 2024-08-31T03:24:49.693195+0000 mgr.a (mgr.14388) 3184 : cluster [DBG] pgmap v2205: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:24:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:51 smithi191 bash[24992]: cluster 2024-08-31T03:24:51.693912+0000 mgr.a (mgr.14388) 3185 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:24:52.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:51 smithi163 bash[24253]: cluster 2024-08-31T03:24:51.693912+0000 mgr.a (mgr.14388) 3185 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:24:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:51 smithi027 bash[22610]: cluster 2024-08-31T03:24:51.693912+0000 mgr.a (mgr.14388) 3185 : cluster [DBG] pgmap v2206: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:24:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:24:54.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:24:54.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:24:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:54 smithi191 bash[24992]: cluster 2024-08-31T03:24:53.695872+0000 mgr.a (mgr.14388) 3186 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:24:55.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:54 smithi163 bash[24253]: cluster 2024-08-31T03:24:53.695872+0000 mgr.a (mgr.14388) 3186 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:24:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:54 smithi027 bash[22610]: cluster 2024-08-31T03:24:53.695872+0000 mgr.a (mgr.14388) 3186 : cluster [DBG] pgmap v2207: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:24:55.386 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:24:55.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:24:55.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:24:55.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:24:55.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:24:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:55 smithi191 bash[24992]: audit 2024-08-31T03:24:54.952614+0000 mgr.a (mgr.14388) 3187 : audit [DBG] from='client.80259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:56.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:55 smithi163 bash[24253]: audit 2024-08-31T03:24:54.952614+0000 mgr.a (mgr.14388) 3187 : audit [DBG] from='client.80259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:55 smithi027 bash[22610]: audit 2024-08-31T03:24:54.952614+0000 mgr.a (mgr.14388) 3187 : audit [DBG] from='client.80259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:24:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:56 smithi191 bash[24992]: cluster 2024-08-31T03:24:55.696912+0000 mgr.a (mgr.14388) 3188 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:57.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:56 smithi163 bash[24253]: cluster 2024-08-31T03:24:55.696912+0000 mgr.a (mgr.14388) 3188 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:56 smithi027 bash[22610]: cluster 2024-08-31T03:24:55.696912+0000 mgr.a (mgr.14388) 3188 : cluster [DBG] pgmap v2208: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:24:58 smithi191 bash[24992]: cluster 2024-08-31T03:24:57.697668+0000 mgr.a (mgr.14388) 3189 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:59.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:24:58 smithi163 bash[24253]: cluster 2024-08-31T03:24:57.697668+0000 mgr.a (mgr.14388) 3189 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:24:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:24:58 smithi027 bash[22610]: cluster 2024-08-31T03:24:57.697668+0000 mgr.a (mgr.14388) 3189 : cluster [DBG] pgmap v2209: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:00.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:00.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:00.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:00 smithi191 bash[24992]: cluster 2024-08-31T03:24:59.699836+0000 mgr.a (mgr.14388) 3190 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:01.166 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:01.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:01.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:00 smithi163 bash[24253]: cluster 2024-08-31T03:24:59.699836+0000 mgr.a (mgr.14388) 3190 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:01.204 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:00 smithi027 bash[22610]: cluster 2024-08-31T03:24:59.699836+0000 mgr.a (mgr.14388) 3190 : cluster [DBG] pgmap v2210: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:01 smithi191 bash[24992]: audit 2024-08-31T03:25:00.727819+0000 mgr.a (mgr.14388) 3191 : audit [DBG] from='client.80337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:02.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:01 smithi163 bash[24253]: audit 2024-08-31T03:25:00.727819+0000 mgr.a (mgr.14388) 3191 : audit [DBG] from='client.80337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:02.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:01 smithi027 bash[22610]: audit 2024-08-31T03:25:00.727819+0000 mgr.a (mgr.14388) 3191 : audit [DBG] from='client.80337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:02 smithi191 bash[24992]: cluster 2024-08-31T03:25:01.700813+0000 mgr.a (mgr.14388) 3192 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:03.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:02 smithi163 bash[24253]: cluster 2024-08-31T03:25:01.700813+0000 mgr.a (mgr.14388) 3192 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:02 smithi027 bash[22610]: cluster 2024-08-31T03:25:01.700813+0000 mgr.a (mgr.14388) 3192 : cluster [DBG] pgmap v2211: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:04 smithi191 bash[24992]: cluster 2024-08-31T03:25:03.703004+0000 mgr.a (mgr.14388) 3193 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:05.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:04 smithi163 bash[24253]: cluster 2024-08-31T03:25:03.703004+0000 mgr.a (mgr.14388) 3193 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:04 smithi027 bash[22610]: cluster 2024-08-31T03:25:03.703004+0000 mgr.a (mgr.14388) 3193 : cluster [DBG] pgmap v2212: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:06.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:06.168 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:06.168 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:06.911 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:06.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:06 smithi027 bash[22610]: cluster 2024-08-31T03:25:05.703717+0000 mgr.a (mgr.14388) 3194 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:06 smithi027 bash[22610]: audit 2024-08-31T03:25:06.498406+0000 mgr.a (mgr.14388) 3195 : audit [DBG] from='client.80415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:06 smithi191 bash[24992]: cluster 2024-08-31T03:25:05.703717+0000 mgr.a (mgr.14388) 3194 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:06 smithi191 bash[24992]: audit 2024-08-31T03:25:06.498406+0000 mgr.a (mgr.14388) 3195 : audit [DBG] from='client.80415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:07.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:06 smithi163 bash[24253]: cluster 2024-08-31T03:25:05.703717+0000 mgr.a (mgr.14388) 3194 : cluster [DBG] pgmap v2213: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:07.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:06 smithi163 bash[24253]: audit 2024-08-31T03:25:06.498406+0000 mgr.a (mgr.14388) 3195 : audit [DBG] from='client.80415 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:08 smithi027 bash[22610]: cluster 2024-08-31T03:25:07.704669+0000 mgr.a (mgr.14388) 3196 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:08 smithi191 bash[24992]: cluster 2024-08-31T03:25:07.704669+0000 mgr.a (mgr.14388) 3196 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:09.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:08 smithi163 bash[24253]: cluster 2024-08-31T03:25:07.704669+0000 mgr.a (mgr.14388) 3196 : cluster [DBG] pgmap v2214: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:10 smithi027 bash[22610]: cluster 2024-08-31T03:25:09.706894+0000 mgr.a (mgr.14388) 3197 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:10 smithi191 bash[24992]: cluster 2024-08-31T03:25:09.706894+0000 mgr.a (mgr.14388) 3197 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:11.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:10 smithi163 bash[24253]: cluster 2024-08-31T03:25:09.706894+0000 mgr.a (mgr.14388) 3197 : cluster [DBG] pgmap v2215: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:11.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:11.913 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:11.913 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:12.688 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:12.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:12.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:12.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:12.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:12 smithi027 bash[22610]: cluster 2024-08-31T03:25:11.707644+0000 mgr.a (mgr.14388) 3198 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:12 smithi027 bash[22610]: audit 2024-08-31T03:25:12.250834+0000 mgr.a (mgr.14388) 3199 : audit [DBG] from='client.80493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:12 smithi191 bash[24992]: cluster 2024-08-31T03:25:11.707644+0000 mgr.a (mgr.14388) 3198 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:12 smithi191 bash[24992]: audit 2024-08-31T03:25:12.250834+0000 mgr.a (mgr.14388) 3199 : audit [DBG] from='client.80493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:13.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:12 smithi163 bash[24253]: cluster 2024-08-31T03:25:11.707644+0000 mgr.a (mgr.14388) 3198 : cluster [DBG] pgmap v2216: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:13.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:12 smithi163 bash[24253]: audit 2024-08-31T03:25:12.250834+0000 mgr.a (mgr.14388) 3199 : audit [DBG] from='client.80493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:14 smithi191 bash[24992]: cluster 2024-08-31T03:25:13.709771+0000 mgr.a (mgr.14388) 3200 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:15.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:14 smithi163 bash[24253]: cluster 2024-08-31T03:25:13.709771+0000 mgr.a (mgr.14388) 3200 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:14 smithi027 bash[22610]: cluster 2024-08-31T03:25:13.709771+0000 mgr.a (mgr.14388) 3200 : cluster [DBG] pgmap v2217: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:16 smithi191 bash[24992]: cluster 2024-08-31T03:25:15.710554+0000 mgr.a (mgr.14388) 3201 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:17.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:16 smithi163 bash[24253]: cluster 2024-08-31T03:25:15.710554+0000 mgr.a (mgr.14388) 3201 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:16 smithi027 bash[22610]: cluster 2024-08-31T03:25:15.710554+0000 mgr.a (mgr.14388) 3201 : cluster [DBG] pgmap v2218: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:17.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:17.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:17.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:18.452 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:18.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:18.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:18.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:18.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:18 smithi191 bash[24992]: cluster 2024-08-31T03:25:17.711113+0000 mgr.a (mgr.14388) 3202 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:18 smithi191 bash[24992]: audit 2024-08-31T03:25:18.028937+0000 mgr.a (mgr.14388) 3203 : audit [DBG] from='client.80571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:19.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:18 smithi163 bash[24253]: cluster 2024-08-31T03:25:17.711113+0000 mgr.a (mgr.14388) 3202 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:19.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:18 smithi163 bash[24253]: audit 2024-08-31T03:25:18.028937+0000 mgr.a (mgr.14388) 3203 : audit [DBG] from='client.80571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:18 smithi027 bash[22610]: cluster 2024-08-31T03:25:17.711113+0000 mgr.a (mgr.14388) 3202 : cluster [DBG] pgmap v2219: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:18 smithi027 bash[22610]: audit 2024-08-31T03:25:18.028937+0000 mgr.a (mgr.14388) 3203 : audit [DBG] from='client.80571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:21 smithi191 bash[24992]: cluster 2024-08-31T03:25:19.713694+0000 mgr.a (mgr.14388) 3204 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:21.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:21 smithi163 bash[24253]: cluster 2024-08-31T03:25:19.713694+0000 mgr.a (mgr.14388) 3204 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:21 smithi027 bash[22610]: cluster 2024-08-31T03:25:19.713694+0000 mgr.a (mgr.14388) 3204 : cluster [DBG] pgmap v2220: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:23 smithi191 bash[24992]: cluster 2024-08-31T03:25:21.714474+0000 mgr.a (mgr.14388) 3205 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:25:23.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:23 smithi163 bash[24253]: cluster 2024-08-31T03:25:21.714474+0000 mgr.a (mgr.14388) 3205 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:25:23.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:23.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:23.455 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:23 smithi027 bash[22610]: cluster 2024-08-31T03:25:21.714474+0000 mgr.a (mgr.14388) 3205 : cluster [DBG] pgmap v2221: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:25:24.214 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:25 smithi191 bash[24992]: cluster 2024-08-31T03:25:23.716324+0000 mgr.a (mgr.14388) 3206 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:25 smithi191 bash[24992]: audit 2024-08-31T03:25:23.792733+0000 mgr.a (mgr.14388) 3207 : audit [DBG] from='client.80643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:25.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:25 smithi163 bash[24253]: cluster 2024-08-31T03:25:23.716324+0000 mgr.a (mgr.14388) 3206 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:25.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:25 smithi163 bash[24253]: audit 2024-08-31T03:25:23.792733+0000 mgr.a (mgr.14388) 3207 : audit [DBG] from='client.80643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:25 smithi027 bash[22610]: cluster 2024-08-31T03:25:23.716324+0000 mgr.a (mgr.14388) 3206 : cluster [DBG] pgmap v2222: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:25 smithi027 bash[22610]: audit 2024-08-31T03:25:23.792733+0000 mgr.a (mgr.14388) 3207 : audit [DBG] from='client.80643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:27 smithi191 bash[24992]: cluster 2024-08-31T03:25:25.717183+0000 mgr.a (mgr.14388) 3208 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:25:27.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:27 smithi163 bash[24253]: cluster 2024-08-31T03:25:25.717183+0000 mgr.a (mgr.14388) 3208 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:25:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:27 smithi027 bash[22610]: cluster 2024-08-31T03:25:25.717183+0000 mgr.a (mgr.14388) 3208 : cluster [DBG] pgmap v2223: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:25:29.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:29.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:29.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:29 smithi191 bash[24992]: cluster 2024-08-31T03:25:27.717957+0000 mgr.a (mgr.14388) 3209 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:25:29.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:29 smithi163 bash[24253]: cluster 2024-08-31T03:25:27.717957+0000 mgr.a (mgr.14388) 3209 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:25:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:29 smithi027 bash[22610]: cluster 2024-08-31T03:25:27.717957+0000 mgr.a (mgr.14388) 3209 : cluster [DBG] pgmap v2224: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:25:29.987 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:29.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:29.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:29.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:29.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:30 smithi191 bash[24992]: audit 2024-08-31T03:25:29.549721+0000 mgr.a (mgr.14388) 3210 : audit [DBG] from='client.80721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:30.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:30 smithi163 bash[24253]: audit 2024-08-31T03:25:29.549721+0000 mgr.a (mgr.14388) 3210 : audit [DBG] from='client.80721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:30 smithi027 bash[22610]: audit 2024-08-31T03:25:29.549721+0000 mgr.a (mgr.14388) 3210 : audit [DBG] from='client.80721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:31 smithi191 bash[24992]: cluster 2024-08-31T03:25:29.720712+0000 mgr.a (mgr.14388) 3211 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:31.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:31 smithi163 bash[24253]: cluster 2024-08-31T03:25:29.720712+0000 mgr.a (mgr.14388) 3211 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:31 smithi027 bash[22610]: cluster 2024-08-31T03:25:29.720712+0000 mgr.a (mgr.14388) 3211 : cluster [DBG] pgmap v2225: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:33 smithi191 bash[24992]: cluster 2024-08-31T03:25:31.721612+0000 mgr.a (mgr.14388) 3212 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:33.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:33 smithi163 bash[24253]: cluster 2024-08-31T03:25:31.721612+0000 mgr.a (mgr.14388) 3212 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:33 smithi027 bash[22610]: cluster 2024-08-31T03:25:31.721612+0000 mgr.a (mgr.14388) 3212 : cluster [DBG] pgmap v2226: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:34.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:34.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:34.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:35.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:35 smithi163 bash[24253]: cluster 2024-08-31T03:25:33.723757+0000 mgr.a (mgr.14388) 3213 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:35 smithi027 bash[22610]: cluster 2024-08-31T03:25:33.723757+0000 mgr.a (mgr.14388) 3213 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:35 smithi191 bash[24992]: cluster 2024-08-31T03:25:33.723757+0000 mgr.a (mgr.14388) 3213 : cluster [DBG] pgmap v2227: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:35.726 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:35.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:35.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:35.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:35.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:36.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:36 smithi163 bash[24253]: audit 2024-08-31T03:25:35.322952+0000 mgr.a (mgr.14388) 3214 : audit [DBG] from='client.80796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:36 smithi027 bash[22610]: audit 2024-08-31T03:25:35.322952+0000 mgr.a (mgr.14388) 3214 : audit [DBG] from='client.80796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:36 smithi191 bash[24992]: audit 2024-08-31T03:25:35.322952+0000 mgr.a (mgr.14388) 3214 : audit [DBG] from='client.80796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:37.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:37 smithi163 bash[24253]: cluster 2024-08-31T03:25:35.724227+0000 mgr.a (mgr.14388) 3215 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:37 smithi027 bash[22610]: cluster 2024-08-31T03:25:35.724227+0000 mgr.a (mgr.14388) 3215 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:37 smithi191 bash[24992]: cluster 2024-08-31T03:25:35.724227+0000 mgr.a (mgr.14388) 3215 : cluster [DBG] pgmap v2228: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:39.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:39 smithi163 bash[24253]: cluster 2024-08-31T03:25:37.724947+0000 mgr.a (mgr.14388) 3216 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:39 smithi027 bash[22610]: cluster 2024-08-31T03:25:37.724947+0000 mgr.a (mgr.14388) 3216 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:39 smithi191 bash[24992]: cluster 2024-08-31T03:25:37.724947+0000 mgr.a (mgr.14388) 3216 : cluster [DBG] pgmap v2229: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:40.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:40 smithi163 bash[24253]: audit 2024-08-31T03:25:39.193589+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:25:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:40 smithi027 bash[22610]: audit 2024-08-31T03:25:39.193589+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:25:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:40 smithi191 bash[24992]: audit 2024-08-31T03:25:39.193589+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:25:40.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:40.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:40.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:41.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:41 smithi163 bash[24253]: cluster 2024-08-31T03:25:39.727049+0000 mgr.a (mgr.14388) 3217 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:41.460 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:41.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:41.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:41.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:41.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:41 smithi027 bash[22610]: cluster 2024-08-31T03:25:39.727049+0000 mgr.a (mgr.14388) 3217 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:41 smithi191 bash[24992]: cluster 2024-08-31T03:25:39.727049+0000 mgr.a (mgr.14388) 3217 : cluster [DBG] pgmap v2230: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:42.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:42 smithi163 bash[24253]: audit 2024-08-31T03:25:41.053909+0000 mgr.a (mgr.14388) 3218 : audit [DBG] from='client.80874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:42 smithi027 bash[22610]: audit 2024-08-31T03:25:41.053909+0000 mgr.a (mgr.14388) 3218 : audit [DBG] from='client.80874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:42 smithi191 bash[24992]: audit 2024-08-31T03:25:41.053909+0000 mgr.a (mgr.14388) 3218 : audit [DBG] from='client.80874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:43.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:43 smithi163 bash[24253]: cluster 2024-08-31T03:25:41.727979+0000 mgr.a (mgr.14388) 3219 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:43 smithi027 bash[22610]: cluster 2024-08-31T03:25:41.727979+0000 mgr.a (mgr.14388) 3219 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:43 smithi191 bash[24992]: cluster 2024-08-31T03:25:41.727979+0000 mgr.a (mgr.14388) 3219 : cluster [DBG] pgmap v2231: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: cluster 2024-08-31T03:25:43.730161+0000 mgr.a (mgr.14388) 3220 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: audit 2024-08-31T03:25:44.531139+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: audit 2024-08-31T03:25:44.537957+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: audit 2024-08-31T03:25:44.580246+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: audit 2024-08-31T03:25:44.587100+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: audit 2024-08-31T03:25:44.590510+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: audit 2024-08-31T03:25:44.594224+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: audit 2024-08-31T03:25:45.308813+0000 mon.a (mon.0) 1076 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:25:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: audit 2024-08-31T03:25:45.310300+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:25:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: audit 2024-08-31T03:25:45.319937+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:45 smithi191 bash[24992]: audit 2024-08-31T03:25:45.324899+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:25:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: cluster 2024-08-31T03:25:43.730161+0000 mgr.a (mgr.14388) 3220 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: audit 2024-08-31T03:25:44.531139+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: audit 2024-08-31T03:25:44.537957+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: audit 2024-08-31T03:25:44.580246+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: audit 2024-08-31T03:25:44.587100+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: audit 2024-08-31T03:25:44.590510+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: audit 2024-08-31T03:25:44.594224+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: audit 2024-08-31T03:25:45.308813+0000 mon.a (mon.0) 1076 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:25:45.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: audit 2024-08-31T03:25:45.310300+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:25:45.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: audit 2024-08-31T03:25:45.319937+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:45 smithi163 bash[24253]: audit 2024-08-31T03:25:45.324899+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:25:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: cluster 2024-08-31T03:25:43.730161+0000 mgr.a (mgr.14388) 3220 : cluster [DBG] pgmap v2232: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:25:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: audit 2024-08-31T03:25:44.531139+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: audit 2024-08-31T03:25:44.537957+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: audit 2024-08-31T03:25:44.580246+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: audit 2024-08-31T03:25:44.587100+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: audit 2024-08-31T03:25:44.590510+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: audit 2024-08-31T03:25:44.594224+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: audit 2024-08-31T03:25:45.308813+0000 mon.a (mon.0) 1076 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:25:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: audit 2024-08-31T03:25:45.310300+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:25:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: audit 2024-08-31T03:25:45.319937+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:25:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:45 smithi027 bash[22610]: audit 2024-08-31T03:25:45.324899+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:25:46.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:46.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:46.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:46.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:25:46 smithi027 bash[22863]: debug 2024-08-31T03:25:46.053+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:25:46.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:25:46 smithi027 bash[22863]: debug 2024-08-31T03:25:46.053+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:25:46.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:46 smithi163 bash[24253]: audit 2024-08-31T03:25:45.325990+0000 mgr.a (mgr.14388) 3221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:25:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:46 smithi027 bash[22610]: audit 2024-08-31T03:25:45.325990+0000 mgr.a (mgr.14388) 3221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:25:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:46 smithi191 bash[24992]: audit 2024-08-31T03:25:45.325990+0000 mgr.a (mgr.14388) 3221 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:25:47.212 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:47.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:47.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:47.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:47.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:47 smithi163 bash[24253]: cluster 2024-08-31T03:25:45.730674+0000 mgr.a (mgr.14388) 3222 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:47 smithi163 bash[24253]: audit 2024-08-31T03:25:46.055191+0000 mgr.a (mgr.14388) 3223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:25:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:47 smithi163 bash[24253]: cephadm 2024-08-31T03:25:46.056295+0000 mgr.a (mgr.14388) 3224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:25:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:47 smithi027 bash[22610]: cluster 2024-08-31T03:25:45.730674+0000 mgr.a (mgr.14388) 3222 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:47 smithi027 bash[22610]: audit 2024-08-31T03:25:46.055191+0000 mgr.a (mgr.14388) 3223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:25:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:47 smithi027 bash[22610]: cephadm 2024-08-31T03:25:46.056295+0000 mgr.a (mgr.14388) 3224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:25:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:47 smithi191 bash[24992]: cluster 2024-08-31T03:25:45.730674+0000 mgr.a (mgr.14388) 3222 : cluster [DBG] pgmap v2233: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:47 smithi191 bash[24992]: audit 2024-08-31T03:25:46.055191+0000 mgr.a (mgr.14388) 3223 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:25:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:47 smithi191 bash[24992]: cephadm 2024-08-31T03:25:46.056295+0000 mgr.a (mgr.14388) 3224 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:25:48.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:48 smithi163 bash[24253]: audit 2024-08-31T03:25:46.784807+0000 mgr.a (mgr.14388) 3225 : audit [DBG] from='client.81057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:48 smithi027 bash[22610]: audit 2024-08-31T03:25:46.784807+0000 mgr.a (mgr.14388) 3225 : audit [DBG] from='client.81057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:48 smithi191 bash[24992]: audit 2024-08-31T03:25:46.784807+0000 mgr.a (mgr.14388) 3225 : audit [DBG] from='client.81057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:49.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:49 smithi163 bash[24253]: cluster 2024-08-31T03:25:47.731592+0000 mgr.a (mgr.14388) 3226 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:49 smithi027 bash[22610]: cluster 2024-08-31T03:25:47.731592+0000 mgr.a (mgr.14388) 3226 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:49 smithi191 bash[24992]: cluster 2024-08-31T03:25:47.731592+0000 mgr.a (mgr.14388) 3226 : cluster [DBG] pgmap v2234: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:25:51.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:51 smithi163 bash[24253]: cluster 2024-08-31T03:25:49.733838+0000 mgr.a (mgr.14388) 3227 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:51 smithi027 bash[22610]: cluster 2024-08-31T03:25:49.733838+0000 mgr.a (mgr.14388) 3227 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:51 smithi191 bash[24992]: cluster 2024-08-31T03:25:49.733838+0000 mgr.a (mgr.14388) 3227 : cluster [DBG] pgmap v2235: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:52.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:52.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:52.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:52.959 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:52.959 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:52.959 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:52.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:52.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:53.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:53 smithi163 bash[24253]: cluster 2024-08-31T03:25:51.734637+0000 mgr.a (mgr.14388) 3228 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:53.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:53 smithi163 bash[24253]: audit 2024-08-31T03:25:52.544963+0000 mgr.a (mgr.14388) 3229 : audit [DBG] from='client.81135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:53 smithi027 bash[22610]: cluster 2024-08-31T03:25:51.734637+0000 mgr.a (mgr.14388) 3228 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:53 smithi027 bash[22610]: audit 2024-08-31T03:25:52.544963+0000 mgr.a (mgr.14388) 3229 : audit [DBG] from='client.81135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:53 smithi191 bash[24992]: cluster 2024-08-31T03:25:51.734637+0000 mgr.a (mgr.14388) 3228 : cluster [DBG] pgmap v2236: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:53 smithi191 bash[24992]: audit 2024-08-31T03:25:52.544963+0000 mgr.a (mgr.14388) 3229 : audit [DBG] from='client.81135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:55.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:55 smithi163 bash[24253]: cluster 2024-08-31T03:25:53.737025+0000 mgr.a (mgr.14388) 3230 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:55 smithi027 bash[22610]: cluster 2024-08-31T03:25:53.737025+0000 mgr.a (mgr.14388) 3230 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:55 smithi191 bash[24992]: cluster 2024-08-31T03:25:53.737025+0000 mgr.a (mgr.14388) 3230 : cluster [DBG] pgmap v2237: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:57.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:57 smithi163 bash[24253]: cluster 2024-08-31T03:25:55.737792+0000 mgr.a (mgr.14388) 3231 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:57.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:25:57.961 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:25:57.961 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:25:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:57 smithi027 bash[22610]: cluster 2024-08-31T03:25:55.737792+0000 mgr.a (mgr.14388) 3231 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:57 smithi191 bash[24992]: cluster 2024-08-31T03:25:55.737792+0000 mgr.a (mgr.14388) 3231 : cluster [DBG] pgmap v2238: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:58.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:25:58.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:25:58.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:25:58.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:25:58.717 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:25:59.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:59 smithi163 bash[24253]: cluster 2024-08-31T03:25:57.738533+0000 mgr.a (mgr.14388) 3232 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:59.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:25:59 smithi163 bash[24253]: audit 2024-08-31T03:25:58.292316+0000 mgr.a (mgr.14388) 3233 : audit [DBG] from='client.81210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:25:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:59 smithi027 bash[22610]: cluster 2024-08-31T03:25:57.738533+0000 mgr.a (mgr.14388) 3232 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:25:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:25:59 smithi027 bash[22610]: audit 2024-08-31T03:25:58.292316+0000 mgr.a (mgr.14388) 3233 : audit [DBG] from='client.81210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:59 smithi191 bash[24992]: cluster 2024-08-31T03:25:57.738533+0000 mgr.a (mgr.14388) 3232 : cluster [DBG] pgmap v2239: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:25:59 smithi191 bash[24992]: audit 2024-08-31T03:25:58.292316+0000 mgr.a (mgr.14388) 3233 : audit [DBG] from='client.81210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:01 smithi163 bash[24253]: cluster 2024-08-31T03:25:59.741150+0000 mgr.a (mgr.14388) 3234 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:01 smithi027 bash[22610]: cluster 2024-08-31T03:25:59.741150+0000 mgr.a (mgr.14388) 3234 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:01 smithi191 bash[24992]: cluster 2024-08-31T03:25:59.741150+0000 mgr.a (mgr.14388) 3234 : cluster [DBG] pgmap v2240: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:03.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:26:03.719 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:26:03.719 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:26:03.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:03 smithi163 bash[24253]: cluster 2024-08-31T03:26:01.741934+0000 mgr.a (mgr.14388) 3235 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:26:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:03 smithi027 bash[22610]: cluster 2024-08-31T03:26:01.741934+0000 mgr.a (mgr.14388) 3235 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:26:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:03 smithi191 bash[24992]: cluster 2024-08-31T03:26:01.741934+0000 mgr.a (mgr.14388) 3235 : cluster [DBG] pgmap v2241: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:26:04.456 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:26:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:26:04.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:26:04.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:26:04.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:26:05.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:05 smithi163 bash[24253]: cluster 2024-08-31T03:26:03.743500+0000 mgr.a (mgr.14388) 3236 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:05.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:05 smithi163 bash[24253]: audit 2024-08-31T03:26:04.054213+0000 mgr.a (mgr.14388) 3237 : audit [DBG] from='client.81288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:05 smithi027 bash[22610]: cluster 2024-08-31T03:26:03.743500+0000 mgr.a (mgr.14388) 3236 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:05 smithi027 bash[22610]: audit 2024-08-31T03:26:04.054213+0000 mgr.a (mgr.14388) 3237 : audit [DBG] from='client.81288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:05 smithi191 bash[24992]: cluster 2024-08-31T03:26:03.743500+0000 mgr.a (mgr.14388) 3236 : cluster [DBG] pgmap v2242: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:05 smithi191 bash[24992]: audit 2024-08-31T03:26:04.054213+0000 mgr.a (mgr.14388) 3237 : audit [DBG] from='client.81288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:07.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:07 smithi163 bash[24253]: cluster 2024-08-31T03:26:05.744359+0000 mgr.a (mgr.14388) 3238 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:26:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:07 smithi027 bash[22610]: cluster 2024-08-31T03:26:05.744359+0000 mgr.a (mgr.14388) 3238 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:26:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:07 smithi191 bash[24992]: cluster 2024-08-31T03:26:05.744359+0000 mgr.a (mgr.14388) 3238 : cluster [DBG] pgmap v2243: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:26:09.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:26:09.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:26:09.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:26:09.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:09 smithi163 bash[24253]: cluster 2024-08-31T03:26:07.745133+0000 mgr.a (mgr.14388) 3239 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:26:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:09 smithi027 bash[22610]: cluster 2024-08-31T03:26:07.745133+0000 mgr.a (mgr.14388) 3239 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:26:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:09 smithi191 bash[24992]: cluster 2024-08-31T03:26:07.745133+0000 mgr.a (mgr.14388) 3239 : cluster [DBG] pgmap v2244: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:26:10.202 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:26:10.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:26:10.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:26:10.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:26:10.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:26:11.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:11 smithi163 bash[24253]: cluster 2024-08-31T03:26:09.747242+0000 mgr.a (mgr.14388) 3240 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:11.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:11 smithi163 bash[24253]: audit 2024-08-31T03:26:09.791265+0000 mgr.a (mgr.14388) 3241 : audit [DBG] from='client.81363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:11 smithi027 bash[22610]: cluster 2024-08-31T03:26:09.747242+0000 mgr.a (mgr.14388) 3240 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:11 smithi027 bash[22610]: audit 2024-08-31T03:26:09.791265+0000 mgr.a (mgr.14388) 3241 : audit [DBG] from='client.81363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:11 smithi191 bash[24992]: cluster 2024-08-31T03:26:09.747242+0000 mgr.a (mgr.14388) 3240 : cluster [DBG] pgmap v2245: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:11 smithi191 bash[24992]: audit 2024-08-31T03:26:09.791265+0000 mgr.a (mgr.14388) 3241 : audit [DBG] from='client.81363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:13.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:13 smithi163 bash[24253]: cluster 2024-08-31T03:26:11.748134+0000 mgr.a (mgr.14388) 3242 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:13 smithi027 bash[22610]: cluster 2024-08-31T03:26:11.748134+0000 mgr.a (mgr.14388) 3242 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:13 smithi191 bash[24992]: cluster 2024-08-31T03:26:11.748134+0000 mgr.a (mgr.14388) 3242 : cluster [DBG] pgmap v2246: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:15.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:26:15.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:26:15.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:26:15.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:15 smithi163 bash[24253]: cluster 2024-08-31T03:26:13.750411+0000 mgr.a (mgr.14388) 3243 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:15.975 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:26:15.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:26:15.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:26:15.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:26:15.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:26:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:15 smithi027 bash[22610]: cluster 2024-08-31T03:26:13.750411+0000 mgr.a (mgr.14388) 3243 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:15 smithi191 bash[24992]: cluster 2024-08-31T03:26:13.750411+0000 mgr.a (mgr.14388) 3243 : cluster [DBG] pgmap v2247: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:16.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:16 smithi163 bash[24253]: audit 2024-08-31T03:26:15.544335+0000 mgr.a (mgr.14388) 3244 : audit [DBG] from='client.81441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:16 smithi027 bash[22610]: audit 2024-08-31T03:26:15.544335+0000 mgr.a (mgr.14388) 3244 : audit [DBG] from='client.81441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:16 smithi191 bash[24992]: audit 2024-08-31T03:26:15.544335+0000 mgr.a (mgr.14388) 3244 : audit [DBG] from='client.81441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:17.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:17 smithi163 bash[24253]: cluster 2024-08-31T03:26:15.751082+0000 mgr.a (mgr.14388) 3245 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:17 smithi027 bash[22610]: cluster 2024-08-31T03:26:15.751082+0000 mgr.a (mgr.14388) 3245 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:17 smithi191 bash[24992]: cluster 2024-08-31T03:26:15.751082+0000 mgr.a (mgr.14388) 3245 : cluster [DBG] pgmap v2248: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:19.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:19 smithi163 bash[24253]: cluster 2024-08-31T03:26:17.752010+0000 mgr.a (mgr.14388) 3246 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:19 smithi027 bash[22610]: cluster 2024-08-31T03:26:17.752010+0000 mgr.a (mgr.14388) 3246 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:19 smithi191 bash[24992]: cluster 2024-08-31T03:26:17.752010+0000 mgr.a (mgr.14388) 3246 : cluster [DBG] pgmap v2249: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:20.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:26:20.978 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:26:20.978 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:26:21.741 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:26:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:26:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:26:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:26:21.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:26:21.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:21 smithi163 bash[24253]: cluster 2024-08-31T03:26:19.754369+0000 mgr.a (mgr.14388) 3247 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:21 smithi027 bash[22610]: cluster 2024-08-31T03:26:19.754369+0000 mgr.a (mgr.14388) 3247 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:21 smithi191 bash[24992]: cluster 2024-08-31T03:26:19.754369+0000 mgr.a (mgr.14388) 3247 : cluster [DBG] pgmap v2250: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:22.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:22 smithi163 bash[24253]: audit 2024-08-31T03:26:21.317708+0000 mgr.a (mgr.14388) 3248 : audit [DBG] from='client.81516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:22 smithi027 bash[22610]: audit 2024-08-31T03:26:21.317708+0000 mgr.a (mgr.14388) 3248 : audit [DBG] from='client.81516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:22 smithi191 bash[24992]: audit 2024-08-31T03:26:21.317708+0000 mgr.a (mgr.14388) 3248 : audit [DBG] from='client.81516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:23.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:23 smithi163 bash[24253]: cluster 2024-08-31T03:26:21.755171+0000 mgr.a (mgr.14388) 3249 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:23 smithi027 bash[22610]: cluster 2024-08-31T03:26:21.755171+0000 mgr.a (mgr.14388) 3249 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:23 smithi191 bash[24992]: cluster 2024-08-31T03:26:21.755171+0000 mgr.a (mgr.14388) 3249 : cluster [DBG] pgmap v2251: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:25.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:25 smithi163 bash[24253]: cluster 2024-08-31T03:26:23.757277+0000 mgr.a (mgr.14388) 3250 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:25 smithi027 bash[22610]: cluster 2024-08-31T03:26:23.757277+0000 mgr.a (mgr.14388) 3250 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:25 smithi191 bash[24992]: cluster 2024-08-31T03:26:23.757277+0000 mgr.a (mgr.14388) 3250 : cluster [DBG] pgmap v2252: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:26.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:26:26.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:26:26.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:26:27.489 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:26:27.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:26:27.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:26:27.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:26:27.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:26:27.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:27 smithi163 bash[24253]: cluster 2024-08-31T03:26:25.758037+0000 mgr.a (mgr.14388) 3251 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:27 smithi027 bash[22610]: cluster 2024-08-31T03:26:25.758037+0000 mgr.a (mgr.14388) 3251 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:27 smithi191 bash[24992]: cluster 2024-08-31T03:26:25.758037+0000 mgr.a (mgr.14388) 3251 : cluster [DBG] pgmap v2253: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:28.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:28 smithi163 bash[24253]: audit 2024-08-31T03:26:27.075331+0000 mgr.a (mgr.14388) 3252 : audit [DBG] from='client.81594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:28 smithi027 bash[22610]: audit 2024-08-31T03:26:27.075331+0000 mgr.a (mgr.14388) 3252 : audit [DBG] from='client.81594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:28 smithi191 bash[24992]: audit 2024-08-31T03:26:27.075331+0000 mgr.a (mgr.14388) 3252 : audit [DBG] from='client.81594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:29.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:29 smithi163 bash[24253]: cluster 2024-08-31T03:26:27.758902+0000 mgr.a (mgr.14388) 3253 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:29 smithi027 bash[22610]: cluster 2024-08-31T03:26:27.758902+0000 mgr.a (mgr.14388) 3253 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:29 smithi191 bash[24992]: cluster 2024-08-31T03:26:27.758902+0000 mgr.a (mgr.14388) 3253 : cluster [DBG] pgmap v2254: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:31.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:31 smithi163 bash[24253]: cluster 2024-08-31T03:26:29.761093+0000 mgr.a (mgr.14388) 3254 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:31 smithi027 bash[22610]: cluster 2024-08-31T03:26:29.761093+0000 mgr.a (mgr.14388) 3254 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:31 smithi191 bash[24992]: cluster 2024-08-31T03:26:29.761093+0000 mgr.a (mgr.14388) 3254 : cluster [DBG] pgmap v2255: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:26:32.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:26:32.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:26:32.491 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:26:33.236 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:26:33.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:26:33.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:26:33.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:26:33.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:26:33.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:33 smithi163 bash[24253]: cluster 2024-08-31T03:26:31.761882+0000 mgr.a (mgr.14388) 3255 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:33 smithi027 bash[22610]: cluster 2024-08-31T03:26:31.761882+0000 mgr.a (mgr.14388) 3255 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:33 smithi191 bash[24992]: cluster 2024-08-31T03:26:31.761882+0000 mgr.a (mgr.14388) 3255 : cluster [DBG] pgmap v2256: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:34.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:34 smithi163 bash[24253]: audit 2024-08-31T03:26:32.829290+0000 mgr.a (mgr.14388) 3256 : audit [DBG] from='client.81672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:34 smithi027 bash[22610]: audit 2024-08-31T03:26:32.829290+0000 mgr.a (mgr.14388) 3256 : audit [DBG] from='client.81672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:34 smithi191 bash[24992]: audit 2024-08-31T03:26:32.829290+0000 mgr.a (mgr.14388) 3256 : audit [DBG] from='client.81672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:35.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:35 smithi163 bash[24253]: cluster 2024-08-31T03:26:33.764262+0000 mgr.a (mgr.14388) 3257 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:26:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:35 smithi027 bash[22610]: cluster 2024-08-31T03:26:33.764262+0000 mgr.a (mgr.14388) 3257 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:26:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:35 smithi191 bash[24992]: cluster 2024-08-31T03:26:33.764262+0000 mgr.a (mgr.14388) 3257 : cluster [DBG] pgmap v2257: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T03:26:37.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:37 smithi163 bash[24253]: cluster 2024-08-31T03:26:35.765031+0000 mgr.a (mgr.14388) 3258 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:26:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:37 smithi027 bash[22610]: cluster 2024-08-31T03:26:35.765031+0000 mgr.a (mgr.14388) 3258 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:26:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:37 smithi191 bash[24992]: cluster 2024-08-31T03:26:35.765031+0000 mgr.a (mgr.14388) 3258 : cluster [DBG] pgmap v2258: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:26:38.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:26:38.238 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:26:38.239 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:26:38.979 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:26:38.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:26:38.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:26:38.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:26:38.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:26:39.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:39 smithi163 bash[24253]: cluster 2024-08-31T03:26:37.765794+0000 mgr.a (mgr.14388) 3259 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:26:39.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:39 smithi163 bash[24253]: audit 2024-08-31T03:26:38.570108+0000 mgr.a (mgr.14388) 3260 : audit [DBG] from='client.81750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:39 smithi027 bash[22610]: cluster 2024-08-31T03:26:37.765794+0000 mgr.a (mgr.14388) 3259 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:26:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:39 smithi027 bash[22610]: audit 2024-08-31T03:26:38.570108+0000 mgr.a (mgr.14388) 3260 : audit [DBG] from='client.81750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:39 smithi191 bash[24992]: cluster 2024-08-31T03:26:37.765794+0000 mgr.a (mgr.14388) 3259 : cluster [DBG] pgmap v2259: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T03:26:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:39 smithi191 bash[24992]: audit 2024-08-31T03:26:38.570108+0000 mgr.a (mgr.14388) 3260 : audit [DBG] from='client.81750 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:41 smithi163 bash[24253]: cluster 2024-08-31T03:26:39.768456+0000 mgr.a (mgr.14388) 3261 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:41 smithi027 bash[22610]: cluster 2024-08-31T03:26:39.768456+0000 mgr.a (mgr.14388) 3261 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:41 smithi191 bash[24992]: cluster 2024-08-31T03:26:39.768456+0000 mgr.a (mgr.14388) 3261 : cluster [DBG] pgmap v2260: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:43.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:43 smithi163 bash[24253]: cluster 2024-08-31T03:26:41.769247+0000 mgr.a (mgr.14388) 3262 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:26:43.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:26:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:26:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:26:43.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:43 smithi027 bash[22610]: cluster 2024-08-31T03:26:41.769247+0000 mgr.a (mgr.14388) 3262 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:26:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:43 smithi191 bash[24992]: cluster 2024-08-31T03:26:41.769247+0000 mgr.a (mgr.14388) 3262 : cluster [DBG] pgmap v2261: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:26:44.726 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:26:44.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:26:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:26:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:26:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:26:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:45 smithi027 bash[22610]: cluster 2024-08-31T03:26:43.771203+0000 mgr.a (mgr.14388) 3263 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:45 smithi027 bash[22610]: audit 2024-08-31T03:26:44.314134+0000 mgr.a (mgr.14388) 3264 : audit [DBG] from='client.81825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:45 smithi191 bash[24992]: cluster 2024-08-31T03:26:43.771203+0000 mgr.a (mgr.14388) 3263 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:45 smithi191 bash[24992]: audit 2024-08-31T03:26:44.314134+0000 mgr.a (mgr.14388) 3264 : audit [DBG] from='client.81825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:46.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:45 smithi163 bash[24253]: cluster 2024-08-31T03:26:43.771203+0000 mgr.a (mgr.14388) 3263 : cluster [DBG] pgmap v2262: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:26:46.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:45 smithi163 bash[24253]: audit 2024-08-31T03:26:44.314134+0000 mgr.a (mgr.14388) 3264 : audit [DBG] from='client.81825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:46 smithi027 bash[22610]: audit 2024-08-31T03:26:46.106519+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:26:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:46 smithi191 bash[24992]: audit 2024-08-31T03:26:46.106519+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:26:47.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:46 smithi163 bash[24253]: audit 2024-08-31T03:26:46.106519+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:26:47.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:26:47 smithi027 bash[22863]: debug 2024-08-31T03:26:47.675+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:26:47.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:26:47 smithi027 bash[22863]: debug 2024-08-31T03:26:47.679+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:26:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:47 smithi027 bash[22610]: cluster 2024-08-31T03:26:45.772081+0000 mgr.a (mgr.14388) 3265 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:26:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:47 smithi027 bash[22610]: audit 2024-08-31T03:26:46.951761+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:26:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:47 smithi027 bash[22610]: audit 2024-08-31T03:26:46.953433+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:26:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:47 smithi027 bash[22610]: audit 2024-08-31T03:26:46.964308+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:26:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:47 smithi027 bash[22610]: audit 2024-08-31T03:26:46.969342+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:26:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:47 smithi191 bash[24992]: cluster 2024-08-31T03:26:45.772081+0000 mgr.a (mgr.14388) 3265 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:26:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:47 smithi191 bash[24992]: audit 2024-08-31T03:26:46.951761+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:26:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:47 smithi191 bash[24992]: audit 2024-08-31T03:26:46.953433+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:26:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:47 smithi191 bash[24992]: audit 2024-08-31T03:26:46.964308+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:26:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:47 smithi191 bash[24992]: audit 2024-08-31T03:26:46.969342+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:26:48.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:47 smithi163 bash[24253]: cluster 2024-08-31T03:26:45.772081+0000 mgr.a (mgr.14388) 3265 : cluster [DBG] pgmap v2263: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:26:48.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:47 smithi163 bash[24253]: audit 2024-08-31T03:26:46.951761+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:26:48.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:47 smithi163 bash[24253]: audit 2024-08-31T03:26:46.953433+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:26:48.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:47 smithi163 bash[24253]: audit 2024-08-31T03:26:46.964308+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:26:48.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:47 smithi163 bash[24253]: audit 2024-08-31T03:26:46.969342+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:26:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:48 smithi027 bash[22610]: audit 2024-08-31T03:26:46.971770+0000 mgr.a (mgr.14388) 3266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:26:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:48 smithi027 bash[22610]: audit 2024-08-31T03:26:47.682321+0000 mgr.a (mgr.14388) 3267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:26:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:48 smithi027 bash[22610]: cephadm 2024-08-31T03:26:47.683676+0000 mgr.a (mgr.14388) 3268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:26:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:48 smithi191 bash[24992]: audit 2024-08-31T03:26:46.971770+0000 mgr.a (mgr.14388) 3266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:26:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:48 smithi191 bash[24992]: audit 2024-08-31T03:26:47.682321+0000 mgr.a (mgr.14388) 3267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:26:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:48 smithi191 bash[24992]: cephadm 2024-08-31T03:26:47.683676+0000 mgr.a (mgr.14388) 3268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:26:49.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:48 smithi163 bash[24253]: audit 2024-08-31T03:26:46.971770+0000 mgr.a (mgr.14388) 3266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:26:49.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:48 smithi163 bash[24253]: audit 2024-08-31T03:26:47.682321+0000 mgr.a (mgr.14388) 3267 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:26:49.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:48 smithi163 bash[24253]: cephadm 2024-08-31T03:26:47.683676+0000 mgr.a (mgr.14388) 3268 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:26:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:26:49.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:26:49.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:26:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:49 smithi027 bash[22610]: cluster 2024-08-31T03:26:47.772914+0000 mgr.a (mgr.14388) 3269 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:26:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:49 smithi191 bash[24992]: cluster 2024-08-31T03:26:47.772914+0000 mgr.a (mgr.14388) 3269 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:26:50.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:49 smithi163 bash[24253]: cluster 2024-08-31T03:26:47.772914+0000 mgr.a (mgr.14388) 3269 : cluster [DBG] pgmap v2264: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:26:50.503 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:26:50.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:26:50.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:26:50.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:26:50.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:26:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:50 smithi191 bash[24992]: cluster 2024-08-31T03:26:49.775143+0000 mgr.a (mgr.14388) 3270 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:50 smithi191 bash[24992]: audit 2024-08-31T03:26:50.061468+0000 mgr.a (mgr.14388) 3271 : audit [DBG] from='client.82005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:51.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:50 smithi163 bash[24253]: cluster 2024-08-31T03:26:49.775143+0000 mgr.a (mgr.14388) 3270 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:51.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:50 smithi163 bash[24253]: audit 2024-08-31T03:26:50.061468+0000 mgr.a (mgr.14388) 3271 : audit [DBG] from='client.82005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:50 smithi027 bash[22610]: cluster 2024-08-31T03:26:49.775143+0000 mgr.a (mgr.14388) 3270 : cluster [DBG] pgmap v2265: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:50 smithi027 bash[22610]: audit 2024-08-31T03:26:50.061468+0000 mgr.a (mgr.14388) 3271 : audit [DBG] from='client.82005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:53.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:52 smithi163 bash[24253]: cluster 2024-08-31T03:26:51.776197+0000 mgr.a (mgr.14388) 3272 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:52 smithi027 bash[22610]: cluster 2024-08-31T03:26:51.776197+0000 mgr.a (mgr.14388) 3272 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:53.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:52 smithi191 bash[24992]: cluster 2024-08-31T03:26:51.776197+0000 mgr.a (mgr.14388) 3272 : cluster [DBG] pgmap v2266: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:55.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:54 smithi163 bash[24253]: cluster 2024-08-31T03:26:53.778346+0000 mgr.a (mgr.14388) 3273 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:54 smithi027 bash[22610]: cluster 2024-08-31T03:26:53.778346+0000 mgr.a (mgr.14388) 3273 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:54 smithi191 bash[24992]: cluster 2024-08-31T03:26:53.778346+0000 mgr.a (mgr.14388) 3273 : cluster [DBG] pgmap v2267: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:55.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:26:55.505 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:26:55.506 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:26:56.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:26:56.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:26:56.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:26:56.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:26:56.283 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:26:57.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:56 smithi163 bash[24253]: cluster 2024-08-31T03:26:55.779113+0000 mgr.a (mgr.14388) 3274 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:57.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:56 smithi163 bash[24253]: audit 2024-08-31T03:26:55.843676+0000 mgr.a (mgr.14388) 3275 : audit [DBG] from='client.82083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:56 smithi027 bash[22610]: cluster 2024-08-31T03:26:55.779113+0000 mgr.a (mgr.14388) 3274 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:56 smithi027 bash[22610]: audit 2024-08-31T03:26:55.843676+0000 mgr.a (mgr.14388) 3275 : audit [DBG] from='client.82083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:57.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:56 smithi191 bash[24992]: cluster 2024-08-31T03:26:55.779113+0000 mgr.a (mgr.14388) 3274 : cluster [DBG] pgmap v2268: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:56 smithi191 bash[24992]: audit 2024-08-31T03:26:55.843676+0000 mgr.a (mgr.14388) 3275 : audit [DBG] from='client.82083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:26:59.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:26:58 smithi163 bash[24253]: cluster 2024-08-31T03:26:57.781224+0000 mgr.a (mgr.14388) 3276 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:26:58 smithi027 bash[22610]: cluster 2024-08-31T03:26:57.781224+0000 mgr.a (mgr.14388) 3276 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:26:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:26:58 smithi191 bash[24992]: cluster 2024-08-31T03:26:57.781224+0000 mgr.a (mgr.14388) 3276 : cluster [DBG] pgmap v2269: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:27:01.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:00 smithi163 bash[24253]: cluster 2024-08-31T03:26:59.782043+0000 mgr.a (mgr.14388) 3277 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:27:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:00 smithi027 bash[22610]: cluster 2024-08-31T03:26:59.782043+0000 mgr.a (mgr.14388) 3277 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:27:01.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:01.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:01.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:00 smithi191 bash[24992]: cluster 2024-08-31T03:26:59.782043+0000 mgr.a (mgr.14388) 3277 : cluster [DBG] pgmap v2270: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:27:02.061 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:02.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:02.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:02.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:02.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:27:02.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:01 smithi163 bash[24253]: audit 2024-08-31T03:27:01.626340+0000 mgr.a (mgr.14388) 3278 : audit [DBG] from='client.82161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:02.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:01 smithi027 bash[22610]: audit 2024-08-31T03:27:01.626340+0000 mgr.a (mgr.14388) 3278 : audit [DBG] from='client.82161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:01 smithi191 bash[24992]: audit 2024-08-31T03:27:01.626340+0000 mgr.a (mgr.14388) 3278 : audit [DBG] from='client.82161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:03.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:02 smithi163 bash[24253]: cluster 2024-08-31T03:27:01.782641+0000 mgr.a (mgr.14388) 3279 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:02 smithi027 bash[22610]: cluster 2024-08-31T03:27:01.782641+0000 mgr.a (mgr.14388) 3279 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:02 smithi191 bash[24992]: cluster 2024-08-31T03:27:01.782641+0000 mgr.a (mgr.14388) 3279 : cluster [DBG] pgmap v2271: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:05.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:04 smithi163 bash[24253]: cluster 2024-08-31T03:27:03.784848+0000 mgr.a (mgr.14388) 3280 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:04 smithi027 bash[22610]: cluster 2024-08-31T03:27:03.784848+0000 mgr.a (mgr.14388) 3280 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:04 smithi191 bash[24992]: cluster 2024-08-31T03:27:03.784848+0000 mgr.a (mgr.14388) 3280 : cluster [DBG] pgmap v2272: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:07.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:07.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:07.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:07.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:06 smithi163 bash[24253]: cluster 2024-08-31T03:27:05.785637+0000 mgr.a (mgr.14388) 3281 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:06 smithi027 bash[22610]: cluster 2024-08-31T03:27:05.785637+0000 mgr.a (mgr.14388) 3281 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:06 smithi191 bash[24992]: cluster 2024-08-31T03:27:05.785637+0000 mgr.a (mgr.14388) 3281 : cluster [DBG] pgmap v2273: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:07.811 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:07.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:07.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:07.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:07.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:27:08.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:07 smithi163 bash[24253]: audit 2024-08-31T03:27:07.396128+0000 mgr.a (mgr.14388) 3282 : audit [DBG] from='client.82239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:07 smithi027 bash[22610]: audit 2024-08-31T03:27:07.396128+0000 mgr.a (mgr.14388) 3282 : audit [DBG] from='client.82239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:07 smithi191 bash[24992]: audit 2024-08-31T03:27:07.396128+0000 mgr.a (mgr.14388) 3282 : audit [DBG] from='client.82239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:09.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:08 smithi163 bash[24253]: cluster 2024-08-31T03:27:07.786605+0000 mgr.a (mgr.14388) 3283 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:27:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:08 smithi027 bash[22610]: cluster 2024-08-31T03:27:07.786605+0000 mgr.a (mgr.14388) 3283 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:27:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:08 smithi191 bash[24992]: cluster 2024-08-31T03:27:07.786605+0000 mgr.a (mgr.14388) 3283 : cluster [DBG] pgmap v2274: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:27:11.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:10 smithi163 bash[24253]: cluster 2024-08-31T03:27:09.787348+0000 mgr.a (mgr.14388) 3284 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:27:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:10 smithi027 bash[22610]: cluster 2024-08-31T03:27:09.787348+0000 mgr.a (mgr.14388) 3284 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:27:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:10 smithi191 bash[24992]: cluster 2024-08-31T03:27:09.787348+0000 mgr.a (mgr.14388) 3284 : cluster [DBG] pgmap v2275: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:27:12.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:12.813 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:12.813 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:13.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:12 smithi163 bash[24253]: cluster 2024-08-31T03:27:11.788148+0000 mgr.a (mgr.14388) 3285 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:27:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:12 smithi027 bash[22610]: cluster 2024-08-31T03:27:11.788148+0000 mgr.a (mgr.14388) 3285 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:27:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:12 smithi191 bash[24992]: cluster 2024-08-31T03:27:11.788148+0000 mgr.a (mgr.14388) 3285 : cluster [DBG] pgmap v2276: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:27:13.589 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:13.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:13.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:13.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:13.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:27:14.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:13 smithi163 bash[24253]: audit 2024-08-31T03:27:13.147528+0000 mgr.a (mgr.14388) 3286 : audit [DBG] from='client.82317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:13 smithi027 bash[22610]: audit 2024-08-31T03:27:13.147528+0000 mgr.a (mgr.14388) 3286 : audit [DBG] from='client.82317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:13 smithi191 bash[24992]: audit 2024-08-31T03:27:13.147528+0000 mgr.a (mgr.14388) 3286 : audit [DBG] from='client.82317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:15.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:14 smithi163 bash[24253]: cluster 2024-08-31T03:27:13.790905+0000 mgr.a (mgr.14388) 3287 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:14 smithi027 bash[22610]: cluster 2024-08-31T03:27:13.790905+0000 mgr.a (mgr.14388) 3287 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:14 smithi191 bash[24992]: cluster 2024-08-31T03:27:13.790905+0000 mgr.a (mgr.14388) 3287 : cluster [DBG] pgmap v2277: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:17.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:16 smithi163 bash[24253]: cluster 2024-08-31T03:27:15.791688+0000 mgr.a (mgr.14388) 3288 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:27:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:16 smithi027 bash[22610]: cluster 2024-08-31T03:27:15.791688+0000 mgr.a (mgr.14388) 3288 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:27:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:16 smithi191 bash[24992]: cluster 2024-08-31T03:27:15.791688+0000 mgr.a (mgr.14388) 3288 : cluster [DBG] pgmap v2278: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:27:18.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:18.592 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:18.592 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:19.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:18 smithi163 bash[24253]: cluster 2024-08-31T03:27:17.793602+0000 mgr.a (mgr.14388) 3289 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:18 smithi027 bash[22610]: cluster 2024-08-31T03:27:17.793602+0000 mgr.a (mgr.14388) 3289 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:19.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:18 smithi191 bash[24992]: cluster 2024-08-31T03:27:17.793602+0000 mgr.a (mgr.14388) 3289 : cluster [DBG] pgmap v2279: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:19.364 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:19.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:19.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:19.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:19.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:27:20.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:19 smithi163 bash[24253]: audit 2024-08-31T03:27:18.929009+0000 mgr.a (mgr.14388) 3290 : audit [DBG] from='client.82395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:19 smithi027 bash[22610]: audit 2024-08-31T03:27:18.929009+0000 mgr.a (mgr.14388) 3290 : audit [DBG] from='client.82395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:19 smithi191 bash[24992]: audit 2024-08-31T03:27:18.929009+0000 mgr.a (mgr.14388) 3290 : audit [DBG] from='client.82395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:21.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:20 smithi163 bash[24253]: cluster 2024-08-31T03:27:19.794711+0000 mgr.a (mgr.14388) 3291 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:27:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:20 smithi027 bash[22610]: cluster 2024-08-31T03:27:19.794711+0000 mgr.a (mgr.14388) 3291 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:27:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:20 smithi191 bash[24992]: cluster 2024-08-31T03:27:19.794711+0000 mgr.a (mgr.14388) 3291 : cluster [DBG] pgmap v2280: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:27:23.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:22 smithi163 bash[24253]: cluster 2024-08-31T03:27:21.795694+0000 mgr.a (mgr.14388) 3292 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:27:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:22 smithi027 bash[22610]: cluster 2024-08-31T03:27:21.795694+0000 mgr.a (mgr.14388) 3292 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:27:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:22 smithi191 bash[24992]: cluster 2024-08-31T03:27:21.795694+0000 mgr.a (mgr.14388) 3292 : cluster [DBG] pgmap v2281: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:27:24.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:24.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:24.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:25.114 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:25.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:25.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:25.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:25.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:27:25.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:24 smithi163 bash[24253]: cluster 2024-08-31T03:27:23.798062+0000 mgr.a (mgr.14388) 3293 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:27:25.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:24 smithi163 bash[24253]: audit 2024-08-31T03:27:24.698419+0000 mgr.a (mgr.14388) 3294 : audit [DBG] from='client.82473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:25.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:24 smithi027 bash[22610]: cluster 2024-08-31T03:27:23.798062+0000 mgr.a (mgr.14388) 3293 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:27:25.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:24 smithi027 bash[22610]: audit 2024-08-31T03:27:24.698419+0000 mgr.a (mgr.14388) 3294 : audit [DBG] from='client.82473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:24 smithi191 bash[24992]: cluster 2024-08-31T03:27:23.798062+0000 mgr.a (mgr.14388) 3293 : cluster [DBG] pgmap v2282: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:27:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:24 smithi191 bash[24992]: audit 2024-08-31T03:27:24.698419+0000 mgr.a (mgr.14388) 3294 : audit [DBG] from='client.82473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:27.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:26 smithi163 bash[24253]: cluster 2024-08-31T03:27:25.799082+0000 mgr.a (mgr.14388) 3295 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:26 smithi027 bash[22610]: cluster 2024-08-31T03:27:25.799082+0000 mgr.a (mgr.14388) 3295 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:26 smithi191 bash[24992]: cluster 2024-08-31T03:27:25.799082+0000 mgr.a (mgr.14388) 3295 : cluster [DBG] pgmap v2283: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:29.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:28 smithi163 bash[24253]: cluster 2024-08-31T03:27:27.801177+0000 mgr.a (mgr.14388) 3296 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:28 smithi027 bash[22610]: cluster 2024-08-31T03:27:27.801177+0000 mgr.a (mgr.14388) 3296 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:28 smithi191 bash[24992]: cluster 2024-08-31T03:27:27.801177+0000 mgr.a (mgr.14388) 3296 : cluster [DBG] pgmap v2284: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:30.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:30.859 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:30.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:30.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:30.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:30.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:27:31.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:30 smithi163 bash[24253]: cluster 2024-08-31T03:27:29.802086+0000 mgr.a (mgr.14388) 3297 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:31.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:30 smithi163 bash[24253]: audit 2024-08-31T03:27:30.449430+0000 mgr.a (mgr.14388) 3298 : audit [DBG] from='client.82551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:30 smithi027 bash[22610]: cluster 2024-08-31T03:27:29.802086+0000 mgr.a (mgr.14388) 3297 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:30 smithi027 bash[22610]: audit 2024-08-31T03:27:30.449430+0000 mgr.a (mgr.14388) 3298 : audit [DBG] from='client.82551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:30 smithi191 bash[24992]: cluster 2024-08-31T03:27:29.802086+0000 mgr.a (mgr.14388) 3297 : cluster [DBG] pgmap v2285: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:30 smithi191 bash[24992]: audit 2024-08-31T03:27:30.449430+0000 mgr.a (mgr.14388) 3298 : audit [DBG] from='client.82551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:33 smithi191 bash[24992]: cluster 2024-08-31T03:27:31.803141+0000 mgr.a (mgr.14388) 3299 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:33.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:33 smithi163 bash[24253]: cluster 2024-08-31T03:27:31.803141+0000 mgr.a (mgr.14388) 3299 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:33 smithi027 bash[22610]: cluster 2024-08-31T03:27:31.803141+0000 mgr.a (mgr.14388) 3299 : cluster [DBG] pgmap v2286: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:35 smithi191 bash[24992]: cluster 2024-08-31T03:27:33.805337+0000 mgr.a (mgr.14388) 3300 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:35.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:35 smithi163 bash[24253]: cluster 2024-08-31T03:27:33.805337+0000 mgr.a (mgr.14388) 3300 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:35 smithi027 bash[22610]: cluster 2024-08-31T03:27:33.805337+0000 mgr.a (mgr.14388) 3300 : cluster [DBG] pgmap v2287: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:35.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:36.605 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:36.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:36.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:36.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:36.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:27:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:37 smithi191 bash[24992]: cluster 2024-08-31T03:27:35.806102+0000 mgr.a (mgr.14388) 3301 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:37 smithi191 bash[24992]: audit 2024-08-31T03:27:36.191949+0000 mgr.a (mgr.14388) 3302 : audit [DBG] from='client.82626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:37.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:37 smithi163 bash[24253]: cluster 2024-08-31T03:27:35.806102+0000 mgr.a (mgr.14388) 3301 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:37.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:37 smithi163 bash[24253]: audit 2024-08-31T03:27:36.191949+0000 mgr.a (mgr.14388) 3302 : audit [DBG] from='client.82626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:37 smithi027 bash[22610]: cluster 2024-08-31T03:27:35.806102+0000 mgr.a (mgr.14388) 3301 : cluster [DBG] pgmap v2288: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:37 smithi027 bash[22610]: audit 2024-08-31T03:27:36.191949+0000 mgr.a (mgr.14388) 3302 : audit [DBG] from='client.82626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:39 smithi191 bash[24992]: cluster 2024-08-31T03:27:37.808401+0000 mgr.a (mgr.14388) 3303 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:39.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:39 smithi163 bash[24253]: cluster 2024-08-31T03:27:37.808401+0000 mgr.a (mgr.14388) 3303 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:39 smithi027 bash[22610]: cluster 2024-08-31T03:27:37.808401+0000 mgr.a (mgr.14388) 3303 : cluster [DBG] pgmap v2289: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:41 smithi191 bash[24992]: cluster 2024-08-31T03:27:39.809194+0000 mgr.a (mgr.14388) 3304 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:41.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:41 smithi163 bash[24253]: cluster 2024-08-31T03:27:39.809194+0000 mgr.a (mgr.14388) 3304 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:41 smithi027 bash[22610]: cluster 2024-08-31T03:27:39.809194+0000 mgr.a (mgr.14388) 3304 : cluster [DBG] pgmap v2290: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:41.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:41.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:41.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:42.366 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:42.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:42.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:42.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:27:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:43 smithi191 bash[24992]: cluster 2024-08-31T03:27:41.810083+0000 mgr.a (mgr.14388) 3305 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:43 smithi191 bash[24992]: audit 2024-08-31T03:27:41.942055+0000 mgr.a (mgr.14388) 3306 : audit [DBG] from='client.82704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:43.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:43 smithi163 bash[24253]: cluster 2024-08-31T03:27:41.810083+0000 mgr.a (mgr.14388) 3305 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:43.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:43 smithi163 bash[24253]: audit 2024-08-31T03:27:41.942055+0000 mgr.a (mgr.14388) 3306 : audit [DBG] from='client.82704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:43 smithi027 bash[22610]: cluster 2024-08-31T03:27:41.810083+0000 mgr.a (mgr.14388) 3305 : cluster [DBG] pgmap v2291: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:43 smithi027 bash[22610]: audit 2024-08-31T03:27:41.942055+0000 mgr.a (mgr.14388) 3306 : audit [DBG] from='client.82704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:45 smithi191 bash[24992]: cluster 2024-08-31T03:27:43.812511+0000 mgr.a (mgr.14388) 3307 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:45.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:45 smithi163 bash[24253]: cluster 2024-08-31T03:27:43.812511+0000 mgr.a (mgr.14388) 3307 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:45 smithi027 bash[22610]: cluster 2024-08-31T03:27:43.812511+0000 mgr.a (mgr.14388) 3307 : cluster [DBG] pgmap v2292: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:27:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:47 smithi191 bash[24992]: cluster 2024-08-31T03:27:45.813334+0000 mgr.a (mgr.14388) 3308 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:47.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:47.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:47 smithi163 bash[24253]: cluster 2024-08-31T03:27:45.813334+0000 mgr.a (mgr.14388) 3308 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:47 smithi027 bash[22610]: cluster 2024-08-31T03:27:45.813334+0000 mgr.a (mgr.14388) 3308 : cluster [DBG] pgmap v2293: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:48.135 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:48.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:27:48.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:48 smithi163 bash[24253]: audit 2024-08-31T03:27:47.704574+0000 mgr.a (mgr.14388) 3309 : audit [DBG] from='client.82782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:48.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:48 smithi163 bash[24253]: audit 2024-08-31T03:27:47.734244+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:27:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:48 smithi027 bash[22610]: audit 2024-08-31T03:27:47.704574+0000 mgr.a (mgr.14388) 3309 : audit [DBG] from='client.82782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:48 smithi027 bash[22610]: audit 2024-08-31T03:27:47.734244+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:27:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:48 smithi191 bash[24992]: audit 2024-08-31T03:27:47.704574+0000 mgr.a (mgr.14388) 3309 : audit [DBG] from='client.82782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:48 smithi191 bash[24992]: audit 2024-08-31T03:27:47.734244+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:27:49.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:49 smithi163 bash[24253]: cluster 2024-08-31T03:27:47.814413+0000 mgr.a (mgr.14388) 3310 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:49.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:49 smithi163 bash[24253]: audit 2024-08-31T03:27:48.521296+0000 mon.a (mon.0) 1086 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:27:49.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:49 smithi163 bash[24253]: audit 2024-08-31T03:27:48.523226+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:27:49.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:49 smithi163 bash[24253]: audit 2024-08-31T03:27:48.534208+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:27:49.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:49 smithi163 bash[24253]: audit 2024-08-31T03:27:48.539002+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:27:49.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:49 smithi163 bash[24253]: audit 2024-08-31T03:27:48.541334+0000 mgr.a (mgr.14388) 3311 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:27:49.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:27:49 smithi027 bash[22863]: debug 2024-08-31T03:27:49.253+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:27:49.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:27:49 smithi027 bash[22863]: debug 2024-08-31T03:27:49.253+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:27:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:49 smithi027 bash[22610]: cluster 2024-08-31T03:27:47.814413+0000 mgr.a (mgr.14388) 3310 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:49 smithi027 bash[22610]: audit 2024-08-31T03:27:48.521296+0000 mon.a (mon.0) 1086 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:27:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:49 smithi027 bash[22610]: audit 2024-08-31T03:27:48.523226+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:27:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:49 smithi027 bash[22610]: audit 2024-08-31T03:27:48.534208+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:27:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:49 smithi027 bash[22610]: audit 2024-08-31T03:27:48.539002+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:27:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:49 smithi027 bash[22610]: audit 2024-08-31T03:27:48.541334+0000 mgr.a (mgr.14388) 3311 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:27:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:49 smithi191 bash[24992]: cluster 2024-08-31T03:27:47.814413+0000 mgr.a (mgr.14388) 3310 : cluster [DBG] pgmap v2294: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:27:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:49 smithi191 bash[24992]: audit 2024-08-31T03:27:48.521296+0000 mon.a (mon.0) 1086 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:27:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:49 smithi191 bash[24992]: audit 2024-08-31T03:27:48.523226+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:27:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:49 smithi191 bash[24992]: audit 2024-08-31T03:27:48.534208+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:27:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:49 smithi191 bash[24992]: audit 2024-08-31T03:27:48.539002+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:27:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:49 smithi191 bash[24992]: audit 2024-08-31T03:27:48.541334+0000 mgr.a (mgr.14388) 3311 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:27:50.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:50 smithi163 bash[24253]: audit 2024-08-31T03:27:49.255596+0000 mgr.a (mgr.14388) 3312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:27:50.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:50 smithi163 bash[24253]: cephadm 2024-08-31T03:27:49.256787+0000 mgr.a (mgr.14388) 3313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:27:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:50 smithi027 bash[22610]: audit 2024-08-31T03:27:49.255596+0000 mgr.a (mgr.14388) 3312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:27:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:50 smithi027 bash[22610]: cephadm 2024-08-31T03:27:49.256787+0000 mgr.a (mgr.14388) 3313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:27:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:50 smithi191 bash[24992]: audit 2024-08-31T03:27:49.255596+0000 mgr.a (mgr.14388) 3312 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:27:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:50 smithi191 bash[24992]: cephadm 2024-08-31T03:27:49.256787+0000 mgr.a (mgr.14388) 3313 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:27:51.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:51 smithi163 bash[24253]: cluster 2024-08-31T03:27:49.815350+0000 mgr.a (mgr.14388) 3314 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:27:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:51 smithi027 bash[22610]: cluster 2024-08-31T03:27:49.815350+0000 mgr.a (mgr.14388) 3314 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:27:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:51 smithi191 bash[24992]: cluster 2024-08-31T03:27:49.815350+0000 mgr.a (mgr.14388) 3314 : cluster [DBG] pgmap v2295: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:27:53.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:53.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:53.139 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:53.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:53 smithi163 bash[24253]: cluster 2024-08-31T03:27:51.816275+0000 mgr.a (mgr.14388) 3315 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:27:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:53 smithi027 bash[22610]: cluster 2024-08-31T03:27:51.816275+0000 mgr.a (mgr.14388) 3315 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:27:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:53 smithi191 bash[24992]: cluster 2024-08-31T03:27:51.816275+0000 mgr.a (mgr.14388) 3315 : cluster [DBG] pgmap v2296: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:27:53.883 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:53.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:27:54.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:54 smithi163 bash[24253]: audit 2024-08-31T03:27:53.469252+0000 mgr.a (mgr.14388) 3316 : audit [DBG] from='client.82965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:54 smithi027 bash[22610]: audit 2024-08-31T03:27:53.469252+0000 mgr.a (mgr.14388) 3316 : audit [DBG] from='client.82965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:54 smithi191 bash[24992]: audit 2024-08-31T03:27:53.469252+0000 mgr.a (mgr.14388) 3316 : audit [DBG] from='client.82965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:27:55.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:55 smithi163 bash[24253]: cluster 2024-08-31T03:27:53.818907+0000 mgr.a (mgr.14388) 3317 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:27:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:55 smithi027 bash[22610]: cluster 2024-08-31T03:27:53.818907+0000 mgr.a (mgr.14388) 3317 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:27:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:55 smithi191 bash[24992]: cluster 2024-08-31T03:27:53.818907+0000 mgr.a (mgr.14388) 3317 : cluster [DBG] pgmap v2297: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:27:57.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:57 smithi163 bash[24253]: cluster 2024-08-31T03:27:55.819721+0000 mgr.a (mgr.14388) 3318 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:27:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:57 smithi027 bash[22610]: cluster 2024-08-31T03:27:55.819721+0000 mgr.a (mgr.14388) 3318 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:27:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:57 smithi191 bash[24992]: cluster 2024-08-31T03:27:55.819721+0000 mgr.a (mgr.14388) 3318 : cluster [DBG] pgmap v2298: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:27:58.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:27:58.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:27:58.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:27:59.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:27:59 smithi163 bash[24253]: cluster 2024-08-31T03:27:57.821659+0000 mgr.a (mgr.14388) 3319 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:27:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:27:59 smithi027 bash[22610]: cluster 2024-08-31T03:27:57.821659+0000 mgr.a (mgr.14388) 3319 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:27:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:27:59 smithi191 bash[24992]: cluster 2024-08-31T03:27:57.821659+0000 mgr.a (mgr.14388) 3319 : cluster [DBG] pgmap v2299: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:27:59.626 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:27:59.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:27:59.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:27:59.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:27:59.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:00.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:00 smithi163 bash[24253]: audit 2024-08-31T03:27:59.214131+0000 mgr.a (mgr.14388) 3320 : audit [DBG] from='client.83043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:00 smithi027 bash[22610]: audit 2024-08-31T03:27:59.214131+0000 mgr.a (mgr.14388) 3320 : audit [DBG] from='client.83043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:00 smithi191 bash[24992]: audit 2024-08-31T03:27:59.214131+0000 mgr.a (mgr.14388) 3320 : audit [DBG] from='client.83043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:01.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:01 smithi163 bash[24253]: cluster 2024-08-31T03:27:59.822582+0000 mgr.a (mgr.14388) 3321 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:01 smithi027 bash[22610]: cluster 2024-08-31T03:27:59.822582+0000 mgr.a (mgr.14388) 3321 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:01 smithi191 bash[24992]: cluster 2024-08-31T03:27:59.822582+0000 mgr.a (mgr.14388) 3321 : cluster [DBG] pgmap v2300: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:03.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:03 smithi163 bash[24253]: cluster 2024-08-31T03:28:01.823387+0000 mgr.a (mgr.14388) 3322 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:03 smithi027 bash[22610]: cluster 2024-08-31T03:28:01.823387+0000 mgr.a (mgr.14388) 3322 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:03 smithi191 bash[24992]: cluster 2024-08-31T03:28:01.823387+0000 mgr.a (mgr.14388) 3322 : cluster [DBG] pgmap v2301: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:04.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:28:04.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:28:04.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:28:05.395 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:28:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:28:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:28:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:28:05.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:05.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:05 smithi163 bash[24253]: cluster 2024-08-31T03:28:03.825566+0000 mgr.a (mgr.14388) 3323 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:05 smithi027 bash[22610]: cluster 2024-08-31T03:28:03.825566+0000 mgr.a (mgr.14388) 3323 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:05 smithi191 bash[24992]: cluster 2024-08-31T03:28:03.825566+0000 mgr.a (mgr.14388) 3323 : cluster [DBG] pgmap v2302: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:06.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:06 smithi163 bash[24253]: audit 2024-08-31T03:28:04.970321+0000 mgr.a (mgr.14388) 3324 : audit [DBG] from='client.83115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:06 smithi027 bash[22610]: audit 2024-08-31T03:28:04.970321+0000 mgr.a (mgr.14388) 3324 : audit [DBG] from='client.83115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:06 smithi191 bash[24992]: audit 2024-08-31T03:28:04.970321+0000 mgr.a (mgr.14388) 3324 : audit [DBG] from='client.83115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:07.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:07 smithi163 bash[24253]: cluster 2024-08-31T03:28:05.826492+0000 mgr.a (mgr.14388) 3325 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:07 smithi027 bash[22610]: cluster 2024-08-31T03:28:05.826492+0000 mgr.a (mgr.14388) 3325 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:07 smithi191 bash[24992]: cluster 2024-08-31T03:28:05.826492+0000 mgr.a (mgr.14388) 3325 : cluster [DBG] pgmap v2303: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:09.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:09 smithi163 bash[24253]: cluster 2024-08-31T03:28:07.828643+0000 mgr.a (mgr.14388) 3326 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:09 smithi027 bash[22610]: cluster 2024-08-31T03:28:07.828643+0000 mgr.a (mgr.14388) 3326 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:09 smithi191 bash[24992]: cluster 2024-08-31T03:28:07.828643+0000 mgr.a (mgr.14388) 3326 : cluster [DBG] pgmap v2304: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:10.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:28:10.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:28:10.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:28:11.173 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:28:11.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:28:11.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:28:11.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:28:11.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:11.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:11 smithi163 bash[24253]: cluster 2024-08-31T03:28:09.829402+0000 mgr.a (mgr.14388) 3327 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:11.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:11 smithi163 bash[24253]: audit 2024-08-31T03:28:10.728447+0000 mgr.a (mgr.14388) 3328 : audit [DBG] from='client.83190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:11 smithi027 bash[22610]: cluster 2024-08-31T03:28:09.829402+0000 mgr.a (mgr.14388) 3327 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:11 smithi027 bash[22610]: audit 2024-08-31T03:28:10.728447+0000 mgr.a (mgr.14388) 3328 : audit [DBG] from='client.83190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:11 smithi191 bash[24992]: cluster 2024-08-31T03:28:09.829402+0000 mgr.a (mgr.14388) 3327 : cluster [DBG] pgmap v2305: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:11 smithi191 bash[24992]: audit 2024-08-31T03:28:10.728447+0000 mgr.a (mgr.14388) 3328 : audit [DBG] from='client.83190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:13.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:13 smithi163 bash[24253]: cluster 2024-08-31T03:28:11.830370+0000 mgr.a (mgr.14388) 3329 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:13 smithi027 bash[22610]: cluster 2024-08-31T03:28:11.830370+0000 mgr.a (mgr.14388) 3329 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:13 smithi191 bash[24992]: cluster 2024-08-31T03:28:11.830370+0000 mgr.a (mgr.14388) 3329 : cluster [DBG] pgmap v2306: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:15.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:15 smithi163 bash[24253]: cluster 2024-08-31T03:28:13.832601+0000 mgr.a (mgr.14388) 3330 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:15 smithi027 bash[22610]: cluster 2024-08-31T03:28:13.832601+0000 mgr.a (mgr.14388) 3330 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:15 smithi191 bash[24992]: cluster 2024-08-31T03:28:13.832601+0000 mgr.a (mgr.14388) 3330 : cluster [DBG] pgmap v2307: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:16.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:28:16.176 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:28:16.176 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:28:16.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:28:16.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:28:16.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:28:16.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:16.928 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:28:17.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:17 smithi163 bash[24253]: cluster 2024-08-31T03:28:15.833384+0000 mgr.a (mgr.14388) 3331 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:17.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:17 smithi163 bash[24253]: audit 2024-08-31T03:28:16.510281+0000 mgr.a (mgr.14388) 3332 : audit [DBG] from='client.83268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:17 smithi027 bash[22610]: cluster 2024-08-31T03:28:15.833384+0000 mgr.a (mgr.14388) 3331 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:17 smithi027 bash[22610]: audit 2024-08-31T03:28:16.510281+0000 mgr.a (mgr.14388) 3332 : audit [DBG] from='client.83268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:17 smithi191 bash[24992]: cluster 2024-08-31T03:28:15.833384+0000 mgr.a (mgr.14388) 3331 : cluster [DBG] pgmap v2308: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:17 smithi191 bash[24992]: audit 2024-08-31T03:28:16.510281+0000 mgr.a (mgr.14388) 3332 : audit [DBG] from='client.83268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:19.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:19 smithi163 bash[24253]: cluster 2024-08-31T03:28:17.835670+0000 mgr.a (mgr.14388) 3333 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:19 smithi027 bash[22610]: cluster 2024-08-31T03:28:17.835670+0000 mgr.a (mgr.14388) 3333 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:19 smithi191 bash[24992]: cluster 2024-08-31T03:28:17.835670+0000 mgr.a (mgr.14388) 3333 : cluster [DBG] pgmap v2309: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:21.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:21 smithi163 bash[24253]: cluster 2024-08-31T03:28:19.836458+0000 mgr.a (mgr.14388) 3334 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:21 smithi027 bash[22610]: cluster 2024-08-31T03:28:19.836458+0000 mgr.a (mgr.14388) 3334 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:21 smithi191 bash[24992]: cluster 2024-08-31T03:28:19.836458+0000 mgr.a (mgr.14388) 3334 : cluster [DBG] pgmap v2310: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:21.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:28:21.930 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:28:21.930 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:28:22.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:28:22.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:28:22.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:28:22.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:22.676 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:28:23.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:23 smithi163 bash[24253]: cluster 2024-08-31T03:28:21.837245+0000 mgr.a (mgr.14388) 3335 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:23.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:23 smithi163 bash[24253]: audit 2024-08-31T03:28:22.266777+0000 mgr.a (mgr.14388) 3336 : audit [DBG] from='client.83343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:23 smithi027 bash[22610]: cluster 2024-08-31T03:28:21.837245+0000 mgr.a (mgr.14388) 3335 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:23 smithi027 bash[22610]: audit 2024-08-31T03:28:22.266777+0000 mgr.a (mgr.14388) 3336 : audit [DBG] from='client.83343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:23 smithi191 bash[24992]: cluster 2024-08-31T03:28:21.837245+0000 mgr.a (mgr.14388) 3335 : cluster [DBG] pgmap v2311: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:23 smithi191 bash[24992]: audit 2024-08-31T03:28:22.266777+0000 mgr.a (mgr.14388) 3336 : audit [DBG] from='client.83343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:25.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:25 smithi163 bash[24253]: cluster 2024-08-31T03:28:23.839568+0000 mgr.a (mgr.14388) 3337 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:25 smithi027 bash[22610]: cluster 2024-08-31T03:28:23.839568+0000 mgr.a (mgr.14388) 3337 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:25 smithi191 bash[24992]: cluster 2024-08-31T03:28:23.839568+0000 mgr.a (mgr.14388) 3337 : cluster [DBG] pgmap v2312: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:27.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:27 smithi163 bash[24253]: cluster 2024-08-31T03:28:25.840384+0000 mgr.a (mgr.14388) 3338 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:27 smithi027 bash[22610]: cluster 2024-08-31T03:28:25.840384+0000 mgr.a (mgr.14388) 3338 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:27 smithi191 bash[24992]: cluster 2024-08-31T03:28:25.840384+0000 mgr.a (mgr.14388) 3338 : cluster [DBG] pgmap v2313: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:28:27.678 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:28:27.678 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:28:28.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:28:28.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:28:28.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:28:28.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:28.445 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:28:29.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:29 smithi163 bash[24253]: cluster 2024-08-31T03:28:27.842311+0000 mgr.a (mgr.14388) 3339 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:29.446 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:29 smithi163 bash[24253]: audit 2024-08-31T03:28:28.017726+0000 mgr.a (mgr.14388) 3340 : audit [DBG] from='client.83421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:29 smithi027 bash[22610]: cluster 2024-08-31T03:28:27.842311+0000 mgr.a (mgr.14388) 3339 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:29 smithi027 bash[22610]: audit 2024-08-31T03:28:28.017726+0000 mgr.a (mgr.14388) 3340 : audit [DBG] from='client.83421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:29 smithi191 bash[24992]: cluster 2024-08-31T03:28:27.842311+0000 mgr.a (mgr.14388) 3339 : cluster [DBG] pgmap v2314: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:29 smithi191 bash[24992]: audit 2024-08-31T03:28:28.017726+0000 mgr.a (mgr.14388) 3340 : audit [DBG] from='client.83421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:31.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:31 smithi163 bash[24253]: cluster 2024-08-31T03:28:29.843250+0000 mgr.a (mgr.14388) 3341 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:28:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:31 smithi027 bash[22610]: cluster 2024-08-31T03:28:29.843250+0000 mgr.a (mgr.14388) 3341 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:28:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:31 smithi191 bash[24992]: cluster 2024-08-31T03:28:29.843250+0000 mgr.a (mgr.14388) 3341 : cluster [DBG] pgmap v2315: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:28:33.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:33 smithi163 bash[24253]: cluster 2024-08-31T03:28:31.844046+0000 mgr.a (mgr.14388) 3342 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:28:33.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:28:33.447 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:28:33.447 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:28:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:33 smithi027 bash[22610]: cluster 2024-08-31T03:28:31.844046+0000 mgr.a (mgr.14388) 3342 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:28:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:33 smithi191 bash[24992]: cluster 2024-08-31T03:28:31.844046+0000 mgr.a (mgr.14388) 3342 : cluster [DBG] pgmap v2316: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:28:34.169 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:28:34.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:28:34.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:28:34.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:28:34.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:35.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:35 smithi163 bash[24253]: audit 2024-08-31T03:28:33.767758+0000 mgr.a (mgr.14388) 3343 : audit [DBG] from='client.83499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:35.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:35 smithi163 bash[24253]: cluster 2024-08-31T03:28:33.845332+0000 mgr.a (mgr.14388) 3344 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:35 smithi027 bash[22610]: audit 2024-08-31T03:28:33.767758+0000 mgr.a (mgr.14388) 3343 : audit [DBG] from='client.83499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:35 smithi027 bash[22610]: cluster 2024-08-31T03:28:33.845332+0000 mgr.a (mgr.14388) 3344 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:35 smithi191 bash[24992]: audit 2024-08-31T03:28:33.767758+0000 mgr.a (mgr.14388) 3343 : audit [DBG] from='client.83499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:35 smithi191 bash[24992]: cluster 2024-08-31T03:28:33.845332+0000 mgr.a (mgr.14388) 3344 : cluster [DBG] pgmap v2317: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:37.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:37 smithi163 bash[24253]: cluster 2024-08-31T03:28:35.846188+0000 mgr.a (mgr.14388) 3345 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:28:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:37 smithi027 bash[22610]: cluster 2024-08-31T03:28:35.846188+0000 mgr.a (mgr.14388) 3345 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:28:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:37 smithi191 bash[24992]: cluster 2024-08-31T03:28:35.846188+0000 mgr.a (mgr.14388) 3345 : cluster [DBG] pgmap v2318: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:28:39.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:28:39.171 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:28:39.171 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:28:39.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:39 smithi163 bash[24253]: cluster 2024-08-31T03:28:37.848319+0000 mgr.a (mgr.14388) 3346 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:39 smithi027 bash[22610]: cluster 2024-08-31T03:28:37.848319+0000 mgr.a (mgr.14388) 3346 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:39 smithi191 bash[24992]: cluster 2024-08-31T03:28:37.848319+0000 mgr.a (mgr.14388) 3346 : cluster [DBG] pgmap v2319: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:39.942 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:28:39.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:28:39.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:28:39.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:28:39.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:40.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:40 smithi163 bash[24253]: audit 2024-08-31T03:28:39.508834+0000 mgr.a (mgr.14388) 3347 : audit [DBG] from='client.83574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:40 smithi027 bash[22610]: audit 2024-08-31T03:28:39.508834+0000 mgr.a (mgr.14388) 3347 : audit [DBG] from='client.83574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:40 smithi191 bash[24992]: audit 2024-08-31T03:28:39.508834+0000 mgr.a (mgr.14388) 3347 : audit [DBG] from='client.83574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:41 smithi027 bash[22610]: cluster 2024-08-31T03:28:39.849060+0000 mgr.a (mgr.14388) 3348 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:41 smithi191 bash[24992]: cluster 2024-08-31T03:28:39.849060+0000 mgr.a (mgr.14388) 3348 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:41.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:41 smithi163 bash[24253]: cluster 2024-08-31T03:28:39.849060+0000 mgr.a (mgr.14388) 3348 : cluster [DBG] pgmap v2320: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:43 smithi027 bash[22610]: cluster 2024-08-31T03:28:41.849825+0000 mgr.a (mgr.14388) 3349 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:43 smithi191 bash[24992]: cluster 2024-08-31T03:28:41.849825+0000 mgr.a (mgr.14388) 3349 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:43.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:43 smithi163 bash[24253]: cluster 2024-08-31T03:28:41.849825+0000 mgr.a (mgr.14388) 3349 : cluster [DBG] pgmap v2321: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:44.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:28:44.944 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:28:44.944 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:28:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:45 smithi027 bash[22610]: cluster 2024-08-31T03:28:43.852056+0000 mgr.a (mgr.14388) 3350 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:45 smithi191 bash[24992]: cluster 2024-08-31T03:28:43.852056+0000 mgr.a (mgr.14388) 3350 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:45.689 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:28:45.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:28:45.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:28:45.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:28:45.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:45.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:45 smithi163 bash[24253]: cluster 2024-08-31T03:28:43.852056+0000 mgr.a (mgr.14388) 3350 : cluster [DBG] pgmap v2322: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:46 smithi027 bash[22610]: audit 2024-08-31T03:28:45.275150+0000 mgr.a (mgr.14388) 3351 : audit [DBG] from='client.83652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:46 smithi191 bash[24992]: audit 2024-08-31T03:28:45.275150+0000 mgr.a (mgr.14388) 3351 : audit [DBG] from='client.83652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:46.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:46 smithi163 bash[24253]: audit 2024-08-31T03:28:45.275150+0000 mgr.a (mgr.14388) 3351 : audit [DBG] from='client.83652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:47 smithi027 bash[22610]: cluster 2024-08-31T03:28:45.852985+0000 mgr.a (mgr.14388) 3352 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:47 smithi191 bash[24992]: cluster 2024-08-31T03:28:45.852985+0000 mgr.a (mgr.14388) 3352 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:47.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:47 smithi163 bash[24253]: cluster 2024-08-31T03:28:45.852985+0000 mgr.a (mgr.14388) 3352 : cluster [DBG] pgmap v2323: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:49 smithi027 bash[22610]: cluster 2024-08-31T03:28:47.855113+0000 mgr.a (mgr.14388) 3353 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:49 smithi191 bash[24992]: cluster 2024-08-31T03:28:47.855113+0000 mgr.a (mgr.14388) 3353 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:49.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:49 smithi163 bash[24253]: cluster 2024-08-31T03:28:47.855113+0000 mgr.a (mgr.14388) 3353 : cluster [DBG] pgmap v2324: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:28:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:50 smithi027 bash[22610]: audit 2024-08-31T03:28:49.306282+0000 mon.a (mon.0) 1090 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:28:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:50 smithi027 bash[22610]: audit 2024-08-31T03:28:50.136880+0000 mon.a (mon.0) 1091 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:28:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:50 smithi027 bash[22610]: audit 2024-08-31T03:28:50.138304+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:28:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:50 smithi027 bash[22610]: audit 2024-08-31T03:28:50.145809+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:28:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:50 smithi027 bash[22610]: audit 2024-08-31T03:28:50.150380+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:28:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:50 smithi191 bash[24992]: audit 2024-08-31T03:28:49.306282+0000 mon.a (mon.0) 1090 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:28:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:50 smithi191 bash[24992]: audit 2024-08-31T03:28:50.136880+0000 mon.a (mon.0) 1091 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:28:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:50 smithi191 bash[24992]: audit 2024-08-31T03:28:50.138304+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:28:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:50 smithi191 bash[24992]: audit 2024-08-31T03:28:50.145809+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:28:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:50 smithi191 bash[24992]: audit 2024-08-31T03:28:50.150380+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:28:50.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:28:50.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:28:50.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:28:50.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:50 smithi163 bash[24253]: audit 2024-08-31T03:28:49.306282+0000 mon.a (mon.0) 1090 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:28:50.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:50 smithi163 bash[24253]: audit 2024-08-31T03:28:50.136880+0000 mon.a (mon.0) 1091 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:28:50.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:50 smithi163 bash[24253]: audit 2024-08-31T03:28:50.138304+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:28:50.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:50 smithi163 bash[24253]: audit 2024-08-31T03:28:50.145809+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:28:50.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:50 smithi163 bash[24253]: audit 2024-08-31T03:28:50.150380+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:28:51.227 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:28:50 smithi027 bash[22863]: debug 2024-08-31T03:28:50.844+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:28:51.227 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:28:50 smithi027 bash[22863]: debug 2024-08-31T03:28:50.848+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:28:51.420 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:28:51.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:28:51.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:28:51.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:28:51.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:51 smithi027 bash[22610]: cluster 2024-08-31T03:28:49.855791+0000 mgr.a (mgr.14388) 3354 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:51 smithi027 bash[22610]: audit 2024-08-31T03:28:50.152624+0000 mgr.a (mgr.14388) 3355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:28:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:51 smithi191 bash[24992]: cluster 2024-08-31T03:28:49.855791+0000 mgr.a (mgr.14388) 3354 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:51 smithi191 bash[24992]: audit 2024-08-31T03:28:50.152624+0000 mgr.a (mgr.14388) 3355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:28:51.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:51 smithi163 bash[24253]: cluster 2024-08-31T03:28:49.855791+0000 mgr.a (mgr.14388) 3354 : cluster [DBG] pgmap v2325: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:51.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:51 smithi163 bash[24253]: audit 2024-08-31T03:28:50.152624+0000 mgr.a (mgr.14388) 3355 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:28:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:52 smithi191 bash[24992]: audit 2024-08-31T03:28:50.850526+0000 mgr.a (mgr.14388) 3356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:28:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:52 smithi191 bash[24992]: cephadm 2024-08-31T03:28:50.851709+0000 mgr.a (mgr.14388) 3357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:28:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:52 smithi191 bash[24992]: audit 2024-08-31T03:28:51.014480+0000 mgr.a (mgr.14388) 3358 : audit [DBG] from='client.83832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:52.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:52 smithi163 bash[24253]: audit 2024-08-31T03:28:50.850526+0000 mgr.a (mgr.14388) 3356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:28:52.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:52 smithi163 bash[24253]: cephadm 2024-08-31T03:28:50.851709+0000 mgr.a (mgr.14388) 3357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:28:52.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:52 smithi163 bash[24253]: audit 2024-08-31T03:28:51.014480+0000 mgr.a (mgr.14388) 3358 : audit [DBG] from='client.83832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:52 smithi027 bash[22610]: audit 2024-08-31T03:28:50.850526+0000 mgr.a (mgr.14388) 3356 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:28:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:52 smithi027 bash[22610]: cephadm 2024-08-31T03:28:50.851709+0000 mgr.a (mgr.14388) 3357 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:28:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:52 smithi027 bash[22610]: audit 2024-08-31T03:28:51.014480+0000 mgr.a (mgr.14388) 3358 : audit [DBG] from='client.83832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:53 smithi191 bash[24992]: cluster 2024-08-31T03:28:51.856726+0000 mgr.a (mgr.14388) 3359 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:53.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:53 smithi163 bash[24253]: cluster 2024-08-31T03:28:51.856726+0000 mgr.a (mgr.14388) 3359 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:53 smithi027 bash[22610]: cluster 2024-08-31T03:28:51.856726+0000 mgr.a (mgr.14388) 3359 : cluster [DBG] pgmap v2326: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:28:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:55 smithi191 bash[24992]: cluster 2024-08-31T03:28:53.858941+0000 mgr.a (mgr.14388) 3360 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:55.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:55 smithi163 bash[24253]: cluster 2024-08-31T03:28:53.858941+0000 mgr.a (mgr.14388) 3360 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:55 smithi027 bash[22610]: cluster 2024-08-31T03:28:53.858941+0000 mgr.a (mgr.14388) 3360 : cluster [DBG] pgmap v2327: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:56.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:28:56.422 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:28:56.422 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:28:57.168 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:28:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:28:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:28:57.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:28:57.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:28:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:57 smithi191 bash[24992]: cluster 2024-08-31T03:28:55.859766+0000 mgr.a (mgr.14388) 3361 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:57.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:57 smithi163 bash[24253]: cluster 2024-08-31T03:28:55.859766+0000 mgr.a (mgr.14388) 3361 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:57 smithi027 bash[22610]: cluster 2024-08-31T03:28:55.859766+0000 mgr.a (mgr.14388) 3361 : cluster [DBG] pgmap v2328: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:58 smithi191 bash[24992]: audit 2024-08-31T03:28:56.756729+0000 mgr.a (mgr.14388) 3362 : audit [DBG] from='client.83910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:58.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:58 smithi163 bash[24253]: audit 2024-08-31T03:28:56.756729+0000 mgr.a (mgr.14388) 3362 : audit [DBG] from='client.83910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:58 smithi027 bash[22610]: audit 2024-08-31T03:28:56.756729+0000 mgr.a (mgr.14388) 3362 : audit [DBG] from='client.83910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:28:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:28:59 smithi191 bash[24992]: cluster 2024-08-31T03:28:57.862000+0000 mgr.a (mgr.14388) 3363 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:59.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:28:59 smithi163 bash[24253]: cluster 2024-08-31T03:28:57.862000+0000 mgr.a (mgr.14388) 3363 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:28:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:28:59 smithi027 bash[22610]: cluster 2024-08-31T03:28:57.862000+0000 mgr.a (mgr.14388) 3363 : cluster [DBG] pgmap v2329: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:01 smithi191 bash[24992]: cluster 2024-08-31T03:28:59.862828+0000 mgr.a (mgr.14388) 3364 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:01.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:01 smithi163 bash[24253]: cluster 2024-08-31T03:28:59.862828+0000 mgr.a (mgr.14388) 3364 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:01 smithi027 bash[22610]: cluster 2024-08-31T03:28:59.862828+0000 mgr.a (mgr.14388) 3364 : cluster [DBG] pgmap v2330: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:02.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:02.170 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:02.171 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:02.920 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:29:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:29:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:29:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:29:02.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:29:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:03 smithi191 bash[24992]: cluster 2024-08-31T03:29:01.863536+0000 mgr.a (mgr.14388) 3365 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:03 smithi191 bash[24992]: audit 2024-08-31T03:29:02.500457+0000 mgr.a (mgr.14388) 3366 : audit [DBG] from='client.83988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:03.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:03 smithi163 bash[24253]: cluster 2024-08-31T03:29:01.863536+0000 mgr.a (mgr.14388) 3365 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:03.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:03 smithi163 bash[24253]: audit 2024-08-31T03:29:02.500457+0000 mgr.a (mgr.14388) 3366 : audit [DBG] from='client.83988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:03 smithi027 bash[22610]: cluster 2024-08-31T03:29:01.863536+0000 mgr.a (mgr.14388) 3365 : cluster [DBG] pgmap v2331: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:03 smithi027 bash[22610]: audit 2024-08-31T03:29:02.500457+0000 mgr.a (mgr.14388) 3366 : audit [DBG] from='client.83988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:05 smithi191 bash[24992]: cluster 2024-08-31T03:29:03.866176+0000 mgr.a (mgr.14388) 3367 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:05.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:05 smithi163 bash[24253]: cluster 2024-08-31T03:29:03.866176+0000 mgr.a (mgr.14388) 3367 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:05 smithi027 bash[22610]: cluster 2024-08-31T03:29:03.866176+0000 mgr.a (mgr.14388) 3367 : cluster [DBG] pgmap v2332: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:07.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:07 smithi163 bash[24253]: cluster 2024-08-31T03:29:05.867014+0000 mgr.a (mgr.14388) 3368 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:29:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:07 smithi027 bash[22610]: cluster 2024-08-31T03:29:05.867014+0000 mgr.a (mgr.14388) 3368 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:29:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:07 smithi191 bash[24992]: cluster 2024-08-31T03:29:05.867014+0000 mgr.a (mgr.14388) 3368 : cluster [DBG] pgmap v2333: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:29:07.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:07.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:07.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:08.665 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:29:08.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:29:08.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:29:08.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:29:08.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:29:09.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:09 smithi163 bash[24253]: cluster 2024-08-31T03:29:07.868893+0000 mgr.a (mgr.14388) 3369 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:09.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:09 smithi163 bash[24253]: audit 2024-08-31T03:29:08.255361+0000 mgr.a (mgr.14388) 3370 : audit [DBG] from='client.84063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:09 smithi027 bash[22610]: cluster 2024-08-31T03:29:07.868893+0000 mgr.a (mgr.14388) 3369 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:09 smithi027 bash[22610]: audit 2024-08-31T03:29:08.255361+0000 mgr.a (mgr.14388) 3370 : audit [DBG] from='client.84063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:09 smithi191 bash[24992]: cluster 2024-08-31T03:29:07.868893+0000 mgr.a (mgr.14388) 3369 : cluster [DBG] pgmap v2334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:09 smithi191 bash[24992]: audit 2024-08-31T03:29:08.255361+0000 mgr.a (mgr.14388) 3370 : audit [DBG] from='client.84063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:11.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:11 smithi163 bash[24253]: cluster 2024-08-31T03:29:09.869765+0000 mgr.a (mgr.14388) 3371 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:29:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:11 smithi027 bash[22610]: cluster 2024-08-31T03:29:09.869765+0000 mgr.a (mgr.14388) 3371 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:29:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:11 smithi191 bash[24992]: cluster 2024-08-31T03:29:09.869765+0000 mgr.a (mgr.14388) 3371 : cluster [DBG] pgmap v2335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:29:13.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:13.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:13.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:13.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:13 smithi163 bash[24253]: cluster 2024-08-31T03:29:11.870494+0000 mgr.a (mgr.14388) 3372 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:29:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:13 smithi027 bash[22610]: cluster 2024-08-31T03:29:11.870494+0000 mgr.a (mgr.14388) 3372 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:29:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:13 smithi191 bash[24992]: cluster 2024-08-31T03:29:11.870494+0000 mgr.a (mgr.14388) 3372 : cluster [DBG] pgmap v2336: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:29:14.413 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:29:14.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:29:14.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:29:14.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:29:14.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:29:15.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:15 smithi163 bash[24253]: cluster 2024-08-31T03:29:13.872750+0000 mgr.a (mgr.14388) 3373 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:15.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:15 smithi163 bash[24253]: audit 2024-08-31T03:29:14.002924+0000 mgr.a (mgr.14388) 3374 : audit [DBG] from='client.84135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:15 smithi027 bash[22610]: cluster 2024-08-31T03:29:13.872750+0000 mgr.a (mgr.14388) 3373 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:15 smithi027 bash[22610]: audit 2024-08-31T03:29:14.002924+0000 mgr.a (mgr.14388) 3374 : audit [DBG] from='client.84135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:15 smithi191 bash[24992]: cluster 2024-08-31T03:29:13.872750+0000 mgr.a (mgr.14388) 3373 : cluster [DBG] pgmap v2337: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:15 smithi191 bash[24992]: audit 2024-08-31T03:29:14.002924+0000 mgr.a (mgr.14388) 3374 : audit [DBG] from='client.84135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:17.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:17 smithi163 bash[24253]: cluster 2024-08-31T03:29:15.873677+0000 mgr.a (mgr.14388) 3375 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:29:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:17 smithi027 bash[22610]: cluster 2024-08-31T03:29:15.873677+0000 mgr.a (mgr.14388) 3375 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:29:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:17 smithi191 bash[24992]: cluster 2024-08-31T03:29:15.873677+0000 mgr.a (mgr.14388) 3375 : cluster [DBG] pgmap v2338: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:29:19.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:19.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:19.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:19.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:19 smithi163 bash[24253]: cluster 2024-08-31T03:29:17.875784+0000 mgr.a (mgr.14388) 3376 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:29:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:19 smithi027 bash[22610]: cluster 2024-08-31T03:29:17.875784+0000 mgr.a (mgr.14388) 3376 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:29:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:19 smithi191 bash[24992]: cluster 2024-08-31T03:29:17.875784+0000 mgr.a (mgr.14388) 3376 : cluster [DBG] pgmap v2339: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:29:20.199 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:29:20.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:29:20.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:29:20.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:29:20.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:29:20.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:20 smithi163 bash[24253]: audit 2024-08-31T03:29:19.754867+0000 mgr.a (mgr.14388) 3377 : audit [DBG] from='client.84213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:20 smithi027 bash[22610]: audit 2024-08-31T03:29:19.754867+0000 mgr.a (mgr.14388) 3377 : audit [DBG] from='client.84213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:20 smithi191 bash[24992]: audit 2024-08-31T03:29:19.754867+0000 mgr.a (mgr.14388) 3377 : audit [DBG] from='client.84213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:21.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:21 smithi163 bash[24253]: cluster 2024-08-31T03:29:19.876344+0000 mgr.a (mgr.14388) 3378 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:21 smithi027 bash[22610]: cluster 2024-08-31T03:29:19.876344+0000 mgr.a (mgr.14388) 3378 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:21 smithi191 bash[24992]: cluster 2024-08-31T03:29:19.876344+0000 mgr.a (mgr.14388) 3378 : cluster [DBG] pgmap v2340: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:23.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:23 smithi163 bash[24253]: cluster 2024-08-31T03:29:21.877237+0000 mgr.a (mgr.14388) 3379 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:23 smithi027 bash[22610]: cluster 2024-08-31T03:29:21.877237+0000 mgr.a (mgr.14388) 3379 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:23 smithi191 bash[24992]: cluster 2024-08-31T03:29:21.877237+0000 mgr.a (mgr.14388) 3379 : cluster [DBG] pgmap v2341: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:25.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:25.201 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:25.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:25.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:25 smithi163 bash[24253]: cluster 2024-08-31T03:29:23.879481+0000 mgr.a (mgr.14388) 3380 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:25 smithi027 bash[22610]: cluster 2024-08-31T03:29:23.879481+0000 mgr.a (mgr.14388) 3380 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:25 smithi191 bash[24992]: cluster 2024-08-31T03:29:23.879481+0000 mgr.a (mgr.14388) 3380 : cluster [DBG] pgmap v2342: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:25.969 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:29:25.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:29:25.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:29:25.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:29:25.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:29:26.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:26 smithi163 bash[24253]: audit 2024-08-31T03:29:25.543372+0000 mgr.a (mgr.14388) 3381 : audit [DBG] from='client.84291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:26 smithi027 bash[22610]: audit 2024-08-31T03:29:25.543372+0000 mgr.a (mgr.14388) 3381 : audit [DBG] from='client.84291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:26 smithi191 bash[24992]: audit 2024-08-31T03:29:25.543372+0000 mgr.a (mgr.14388) 3381 : audit [DBG] from='client.84291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:27.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:27 smithi163 bash[24253]: cluster 2024-08-31T03:29:25.880016+0000 mgr.a (mgr.14388) 3382 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:27 smithi027 bash[22610]: cluster 2024-08-31T03:29:25.880016+0000 mgr.a (mgr.14388) 3382 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:27 smithi191 bash[24992]: cluster 2024-08-31T03:29:25.880016+0000 mgr.a (mgr.14388) 3382 : cluster [DBG] pgmap v2343: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:29.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:29 smithi163 bash[24253]: cluster 2024-08-31T03:29:27.882120+0000 mgr.a (mgr.14388) 3383 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:29 smithi027 bash[22610]: cluster 2024-08-31T03:29:27.882120+0000 mgr.a (mgr.14388) 3383 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:29 smithi191 bash[24992]: cluster 2024-08-31T03:29:27.882120+0000 mgr.a (mgr.14388) 3383 : cluster [DBG] pgmap v2344: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:30.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:30.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:30.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:31.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:31 smithi163 bash[24253]: cluster 2024-08-31T03:29:29.882901+0000 mgr.a (mgr.14388) 3384 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:31.725 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:29:31.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:29:31.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:29:31.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:29:31.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:29:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:31 smithi027 bash[22610]: cluster 2024-08-31T03:29:29.882901+0000 mgr.a (mgr.14388) 3384 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:31 smithi191 bash[24992]: cluster 2024-08-31T03:29:29.882901+0000 mgr.a (mgr.14388) 3384 : cluster [DBG] pgmap v2345: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:32.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:32 smithi163 bash[24253]: audit 2024-08-31T03:29:31.308822+0000 mgr.a (mgr.14388) 3385 : audit [DBG] from='client.84369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:32 smithi027 bash[22610]: audit 2024-08-31T03:29:31.308822+0000 mgr.a (mgr.14388) 3385 : audit [DBG] from='client.84369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:32 smithi191 bash[24992]: audit 2024-08-31T03:29:31.308822+0000 mgr.a (mgr.14388) 3385 : audit [DBG] from='client.84369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:33.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:33 smithi163 bash[24253]: cluster 2024-08-31T03:29:31.883808+0000 mgr.a (mgr.14388) 3386 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:33 smithi027 bash[22610]: cluster 2024-08-31T03:29:31.883808+0000 mgr.a (mgr.14388) 3386 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:33 smithi191 bash[24992]: cluster 2024-08-31T03:29:31.883808+0000 mgr.a (mgr.14388) 3386 : cluster [DBG] pgmap v2346: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:35.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:35 smithi163 bash[24253]: cluster 2024-08-31T03:29:33.886154+0000 mgr.a (mgr.14388) 3387 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:35 smithi027 bash[22610]: cluster 2024-08-31T03:29:33.886154+0000 mgr.a (mgr.14388) 3387 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:35 smithi191 bash[24992]: cluster 2024-08-31T03:29:33.886154+0000 mgr.a (mgr.14388) 3387 : cluster [DBG] pgmap v2347: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:36.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:36.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:36.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:37.492 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:29:37.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:29:37.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:29:37.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:29:37.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:29:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:37 smithi163 bash[24253]: cluster 2024-08-31T03:29:35.887104+0000 mgr.a (mgr.14388) 3388 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:37 smithi027 bash[22610]: cluster 2024-08-31T03:29:35.887104+0000 mgr.a (mgr.14388) 3388 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:37 smithi191 bash[24992]: cluster 2024-08-31T03:29:35.887104+0000 mgr.a (mgr.14388) 3388 : cluster [DBG] pgmap v2348: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:38.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:38 smithi163 bash[24253]: audit 2024-08-31T03:29:37.061105+0000 mgr.a (mgr.14388) 3389 : audit [DBG] from='client.84444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:38 smithi027 bash[22610]: audit 2024-08-31T03:29:37.061105+0000 mgr.a (mgr.14388) 3389 : audit [DBG] from='client.84444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:38 smithi191 bash[24992]: audit 2024-08-31T03:29:37.061105+0000 mgr.a (mgr.14388) 3389 : audit [DBG] from='client.84444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:39.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:39 smithi163 bash[24253]: cluster 2024-08-31T03:29:37.889355+0000 mgr.a (mgr.14388) 3390 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:39 smithi027 bash[22610]: cluster 2024-08-31T03:29:37.889355+0000 mgr.a (mgr.14388) 3390 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:39 smithi191 bash[24992]: cluster 2024-08-31T03:29:37.889355+0000 mgr.a (mgr.14388) 3390 : cluster [DBG] pgmap v2349: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:29:41.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:41 smithi163 bash[24253]: cluster 2024-08-31T03:29:39.890113+0000 mgr.a (mgr.14388) 3391 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:41 smithi027 bash[22610]: cluster 2024-08-31T03:29:39.890113+0000 mgr.a (mgr.14388) 3391 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:41 smithi191 bash[24992]: cluster 2024-08-31T03:29:39.890113+0000 mgr.a (mgr.14388) 3391 : cluster [DBG] pgmap v2350: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:42.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:42.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:42.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:43.277 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:29:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:29:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:29:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:29:43.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:29:43.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:43 smithi163 bash[24253]: cluster 2024-08-31T03:29:41.890912+0000 mgr.a (mgr.14388) 3392 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:43 smithi027 bash[22610]: cluster 2024-08-31T03:29:41.890912+0000 mgr.a (mgr.14388) 3392 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:43 smithi191 bash[24992]: cluster 2024-08-31T03:29:41.890912+0000 mgr.a (mgr.14388) 3392 : cluster [DBG] pgmap v2351: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:44.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:44 smithi163 bash[24253]: audit 2024-08-31T03:29:42.844083+0000 mgr.a (mgr.14388) 3393 : audit [DBG] from='client.84522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:44 smithi027 bash[22610]: audit 2024-08-31T03:29:42.844083+0000 mgr.a (mgr.14388) 3393 : audit [DBG] from='client.84522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:44 smithi191 bash[24992]: audit 2024-08-31T03:29:42.844083+0000 mgr.a (mgr.14388) 3393 : audit [DBG] from='client.84522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:45.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:45 smithi163 bash[24253]: cluster 2024-08-31T03:29:43.893543+0000 mgr.a (mgr.14388) 3394 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:45 smithi027 bash[22610]: cluster 2024-08-31T03:29:43.893543+0000 mgr.a (mgr.14388) 3394 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:45 smithi191 bash[24992]: cluster 2024-08-31T03:29:43.893543+0000 mgr.a (mgr.14388) 3394 : cluster [DBG] pgmap v2352: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:47.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:47 smithi163 bash[24253]: cluster 2024-08-31T03:29:45.894322+0000 mgr.a (mgr.14388) 3395 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:29:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:47 smithi027 bash[22610]: cluster 2024-08-31T03:29:45.894322+0000 mgr.a (mgr.14388) 3395 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:29:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:47 smithi191 bash[24992]: cluster 2024-08-31T03:29:45.894322+0000 mgr.a (mgr.14388) 3395 : cluster [DBG] pgmap v2353: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:29:48.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:48.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:48.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:49.056 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:29:49.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:29:49.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:29:49.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:29:49.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:29:49.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:49 smithi163 bash[24253]: cluster 2024-08-31T03:29:47.896213+0000 mgr.a (mgr.14388) 3396 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:49.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:49 smithi163 bash[24253]: audit 2024-08-31T03:29:48.619921+0000 mgr.a (mgr.14388) 3397 : audit [DBG] from='client.84600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:49 smithi027 bash[22610]: cluster 2024-08-31T03:29:47.896213+0000 mgr.a (mgr.14388) 3396 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:49 smithi027 bash[22610]: audit 2024-08-31T03:29:48.619921+0000 mgr.a (mgr.14388) 3397 : audit [DBG] from='client.84600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:49 smithi191 bash[24992]: cluster 2024-08-31T03:29:47.896213+0000 mgr.a (mgr.14388) 3396 : cluster [DBG] pgmap v2354: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:29:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:49 smithi191 bash[24992]: audit 2024-08-31T03:29:48.619921+0000 mgr.a (mgr.14388) 3397 : audit [DBG] from='client.84600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:51.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:51 smithi163 bash[24253]: cluster 2024-08-31T03:29:49.897091+0000 mgr.a (mgr.14388) 3398 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:29:51.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:51 smithi163 bash[24253]: audit 2024-08-31T03:29:50.904943+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:29:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:51 smithi027 bash[22610]: cluster 2024-08-31T03:29:49.897091+0000 mgr.a (mgr.14388) 3398 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:29:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:51 smithi027 bash[22610]: audit 2024-08-31T03:29:50.904943+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:29:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:51 smithi191 bash[24992]: cluster 2024-08-31T03:29:49.897091+0000 mgr.a (mgr.14388) 3398 : cluster [DBG] pgmap v2355: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:29:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:51 smithi191 bash[24992]: audit 2024-08-31T03:29:50.904943+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:29:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:52 smithi191 bash[24992]: audit 2024-08-31T03:29:51.536674+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:29:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:52 smithi191 bash[24992]: audit 2024-08-31T03:29:51.541493+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:29:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:52 smithi191 bash[24992]: audit 2024-08-31T03:29:52.315749+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:29:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:52 smithi191 bash[24992]: audit 2024-08-31T03:29:52.317447+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:29:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:52 smithi191 bash[24992]: audit 2024-08-31T03:29:52.327800+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:29:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:52 smithi191 bash[24992]: audit 2024-08-31T03:29:52.332571+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:29:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:52 smithi163 bash[24253]: audit 2024-08-31T03:29:51.536674+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:29:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:52 smithi163 bash[24253]: audit 2024-08-31T03:29:51.541493+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:29:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:52 smithi163 bash[24253]: audit 2024-08-31T03:29:52.315749+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:29:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:52 smithi163 bash[24253]: audit 2024-08-31T03:29:52.317447+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:29:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:52 smithi163 bash[24253]: audit 2024-08-31T03:29:52.327800+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:29:52.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:52 smithi163 bash[24253]: audit 2024-08-31T03:29:52.332571+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:29:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:52 smithi027 bash[22610]: audit 2024-08-31T03:29:51.536674+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:29:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:52 smithi027 bash[22610]: audit 2024-08-31T03:29:51.541493+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:29:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:52 smithi027 bash[22610]: audit 2024-08-31T03:29:52.315749+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:29:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:52 smithi027 bash[22610]: audit 2024-08-31T03:29:52.317447+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:29:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:52 smithi027 bash[22610]: audit 2024-08-31T03:29:52.327800+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:29:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:52 smithi027 bash[22610]: audit 2024-08-31T03:29:52.332571+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:29:53.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:29:53 smithi027 bash[22863]: debug 2024-08-31T03:29:53.054+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:29:53.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:29:53 smithi027 bash[22863]: debug 2024-08-31T03:29:53.058+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:29:53.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:53 smithi163 bash[24253]: cluster 2024-08-31T03:29:51.897825+0000 mgr.a (mgr.14388) 3399 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:29:53.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:53 smithi163 bash[24253]: audit 2024-08-31T03:29:52.334983+0000 mgr.a (mgr.14388) 3400 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:29:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:53 smithi027 bash[22610]: cluster 2024-08-31T03:29:51.897825+0000 mgr.a (mgr.14388) 3399 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:29:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:53 smithi027 bash[22610]: audit 2024-08-31T03:29:52.334983+0000 mgr.a (mgr.14388) 3400 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:29:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:53 smithi191 bash[24992]: cluster 2024-08-31T03:29:51.897825+0000 mgr.a (mgr.14388) 3399 : cluster [DBG] pgmap v2356: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:29:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:53 smithi191 bash[24992]: audit 2024-08-31T03:29:52.334983+0000 mgr.a (mgr.14388) 3400 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:29:54.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:54.058 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:54.059 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:54.796 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:29:54.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:29:54.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:29:54.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:29:54.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:29:54.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:54 smithi163 bash[24253]: audit 2024-08-31T03:29:53.058149+0000 mgr.a (mgr.14388) 3401 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:29:54.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:54 smithi163 bash[24253]: cephadm 2024-08-31T03:29:53.059662+0000 mgr.a (mgr.14388) 3402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:29:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:54 smithi027 bash[22610]: audit 2024-08-31T03:29:53.058149+0000 mgr.a (mgr.14388) 3401 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:29:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:54 smithi027 bash[22610]: cephadm 2024-08-31T03:29:53.059662+0000 mgr.a (mgr.14388) 3402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:29:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:54 smithi191 bash[24992]: audit 2024-08-31T03:29:53.058149+0000 mgr.a (mgr.14388) 3401 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:29:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:54 smithi191 bash[24992]: cephadm 2024-08-31T03:29:53.059662+0000 mgr.a (mgr.14388) 3402 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:29:55.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:55 smithi163 bash[24253]: cluster 2024-08-31T03:29:53.900435+0000 mgr.a (mgr.14388) 3403 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T03:29:55.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:55 smithi163 bash[24253]: audit 2024-08-31T03:29:54.391039+0000 mgr.a (mgr.14388) 3404 : audit [DBG] from='client.84786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:55 smithi027 bash[22610]: cluster 2024-08-31T03:29:53.900435+0000 mgr.a (mgr.14388) 3403 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T03:29:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:55 smithi027 bash[22610]: audit 2024-08-31T03:29:54.391039+0000 mgr.a (mgr.14388) 3404 : audit [DBG] from='client.84786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:55 smithi191 bash[24992]: cluster 2024-08-31T03:29:53.900435+0000 mgr.a (mgr.14388) 3403 : cluster [DBG] pgmap v2357: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T03:29:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:55 smithi191 bash[24992]: audit 2024-08-31T03:29:54.391039+0000 mgr.a (mgr.14388) 3404 : audit [DBG] from='client.84786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:29:57.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:57 smithi163 bash[24253]: cluster 2024-08-31T03:29:55.901248+0000 mgr.a (mgr.14388) 3405 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T03:29:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:57 smithi027 bash[22610]: cluster 2024-08-31T03:29:55.901248+0000 mgr.a (mgr.14388) 3405 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T03:29:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:57 smithi191 bash[24992]: cluster 2024-08-31T03:29:55.901248+0000 mgr.a (mgr.14388) 3405 : cluster [DBG] pgmap v2358: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T03:29:59.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:29:59.798 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:29:59.798 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:29:59.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:29:59 smithi163 bash[24253]: cluster 2024-08-31T03:29:57.903378+0000 mgr.a (mgr.14388) 3406 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:29:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:29:59 smithi027 bash[22610]: cluster 2024-08-31T03:29:57.903378+0000 mgr.a (mgr.14388) 3406 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:29:59 smithi191 bash[24992]: cluster 2024-08-31T03:29:57.903378+0000 mgr.a (mgr.14388) 3406 : cluster [DBG] pgmap v2359: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:00.536 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:00.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:00.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:00.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:00.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:00.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:00 smithi163 bash[24253]: cluster 2024-08-31T03:30:00.000163+0000 mon.a (mon.0) 1102 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:30:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:00 smithi027 bash[22610]: cluster 2024-08-31T03:30:00.000163+0000 mon.a (mon.0) 1102 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:30:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:00 smithi191 bash[24992]: cluster 2024-08-31T03:30:00.000163+0000 mon.a (mon.0) 1102 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:30:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:01 smithi163 bash[24253]: cluster 2024-08-31T03:29:59.903860+0000 mgr.a (mgr.14388) 3407 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:01 smithi163 bash[24253]: audit 2024-08-31T03:30:00.133934+0000 mgr.a (mgr.14388) 3408 : audit [DBG] from='client.84864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:01 smithi027 bash[22610]: cluster 2024-08-31T03:29:59.903860+0000 mgr.a (mgr.14388) 3407 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:01 smithi027 bash[22610]: audit 2024-08-31T03:30:00.133934+0000 mgr.a (mgr.14388) 3408 : audit [DBG] from='client.84864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:01 smithi191 bash[24992]: cluster 2024-08-31T03:29:59.903860+0000 mgr.a (mgr.14388) 3407 : cluster [DBG] pgmap v2360: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:01 smithi191 bash[24992]: audit 2024-08-31T03:30:00.133934+0000 mgr.a (mgr.14388) 3408 : audit [DBG] from='client.84864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:03.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:03 smithi163 bash[24253]: cluster 2024-08-31T03:30:01.904840+0000 mgr.a (mgr.14388) 3409 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:03 smithi027 bash[22610]: cluster 2024-08-31T03:30:01.904840+0000 mgr.a (mgr.14388) 3409 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:03 smithi191 bash[24992]: cluster 2024-08-31T03:30:01.904840+0000 mgr.a (mgr.14388) 3409 : cluster [DBG] pgmap v2361: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:05.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:30:05.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:30:05.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:30:05.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:05 smithi163 bash[24253]: cluster 2024-08-31T03:30:03.907229+0000 mgr.a (mgr.14388) 3410 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:05 smithi027 bash[22610]: cluster 2024-08-31T03:30:03.907229+0000 mgr.a (mgr.14388) 3410 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:05 smithi191 bash[24992]: cluster 2024-08-31T03:30:03.907229+0000 mgr.a (mgr.14388) 3410 : cluster [DBG] pgmap v2362: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:30:06.285 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:07.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:07 smithi163 bash[24253]: audit 2024-08-31T03:30:05.874909+0000 mgr.a (mgr.14388) 3411 : audit [DBG] from='client.84939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:07.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:07 smithi163 bash[24253]: cluster 2024-08-31T03:30:05.907972+0000 mgr.a (mgr.14388) 3412 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T03:30:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:07 smithi027 bash[22610]: audit 2024-08-31T03:30:05.874909+0000 mgr.a (mgr.14388) 3411 : audit [DBG] from='client.84939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:07 smithi027 bash[22610]: cluster 2024-08-31T03:30:05.907972+0000 mgr.a (mgr.14388) 3412 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T03:30:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:07 smithi191 bash[24992]: audit 2024-08-31T03:30:05.874909+0000 mgr.a (mgr.14388) 3411 : audit [DBG] from='client.84939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:07 smithi191 bash[24992]: cluster 2024-08-31T03:30:05.907972+0000 mgr.a (mgr.14388) 3412 : cluster [DBG] pgmap v2363: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T03:30:09.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:09 smithi163 bash[24253]: cluster 2024-08-31T03:30:07.910271+0000 mgr.a (mgr.14388) 3413 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T03:30:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:09 smithi027 bash[22610]: cluster 2024-08-31T03:30:07.910271+0000 mgr.a (mgr.14388) 3413 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T03:30:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:09 smithi191 bash[24992]: cluster 2024-08-31T03:30:07.910271+0000 mgr.a (mgr.14388) 3413 : cluster [DBG] pgmap v2364: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T03:30:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:30:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:30:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:30:11.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:11 smithi163 bash[24253]: cluster 2024-08-31T03:30:09.911232+0000 mgr.a (mgr.14388) 3414 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:11 smithi027 bash[22610]: cluster 2024-08-31T03:30:09.911232+0000 mgr.a (mgr.14388) 3414 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:11 smithi191 bash[24992]: cluster 2024-08-31T03:30:09.911232+0000 mgr.a (mgr.14388) 3414 : cluster [DBG] pgmap v2365: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:12.050 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:12.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:12.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:12.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:12.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:12.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:12 smithi163 bash[24253]: audit 2024-08-31T03:30:11.625164+0000 mgr.a (mgr.14388) 3415 : audit [DBG] from='client.85017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:12 smithi027 bash[22610]: audit 2024-08-31T03:30:11.625164+0000 mgr.a (mgr.14388) 3415 : audit [DBG] from='client.85017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:12 smithi191 bash[24992]: audit 2024-08-31T03:30:11.625164+0000 mgr.a (mgr.14388) 3415 : audit [DBG] from='client.85017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:13.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:13 smithi163 bash[24253]: cluster 2024-08-31T03:30:11.911854+0000 mgr.a (mgr.14388) 3416 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:13 smithi027 bash[22610]: cluster 2024-08-31T03:30:11.911854+0000 mgr.a (mgr.14388) 3416 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:13 smithi191 bash[24992]: cluster 2024-08-31T03:30:11.911854+0000 mgr.a (mgr.14388) 3416 : cluster [DBG] pgmap v2366: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:15.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:15 smithi163 bash[24253]: cluster 2024-08-31T03:30:13.914148+0000 mgr.a (mgr.14388) 3417 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:15 smithi027 bash[22610]: cluster 2024-08-31T03:30:13.914148+0000 mgr.a (mgr.14388) 3417 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:15 smithi191 bash[24992]: cluster 2024-08-31T03:30:13.914148+0000 mgr.a (mgr.14388) 3417 : cluster [DBG] pgmap v2367: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:17.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:30:17.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:30:17.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:30:17.832 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:17.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:17.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:17.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:17.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:17.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:17 smithi163 bash[24253]: cluster 2024-08-31T03:30:15.914927+0000 mgr.a (mgr.14388) 3418 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:17 smithi027 bash[22610]: cluster 2024-08-31T03:30:15.914927+0000 mgr.a (mgr.14388) 3418 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:17 smithi191 bash[24992]: cluster 2024-08-31T03:30:15.914927+0000 mgr.a (mgr.14388) 3418 : cluster [DBG] pgmap v2368: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:18.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:18 smithi163 bash[24253]: audit 2024-08-31T03:30:17.389299+0000 mgr.a (mgr.14388) 3419 : audit [DBG] from='client.85092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:18 smithi027 bash[22610]: audit 2024-08-31T03:30:17.389299+0000 mgr.a (mgr.14388) 3419 : audit [DBG] from='client.85092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:18 smithi191 bash[24992]: audit 2024-08-31T03:30:17.389299+0000 mgr.a (mgr.14388) 3419 : audit [DBG] from='client.85092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:19.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:19 smithi163 bash[24253]: cluster 2024-08-31T03:30:17.915937+0000 mgr.a (mgr.14388) 3420 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:30:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:19 smithi027 bash[22610]: cluster 2024-08-31T03:30:17.915937+0000 mgr.a (mgr.14388) 3420 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:30:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:19 smithi191 bash[24992]: cluster 2024-08-31T03:30:17.915937+0000 mgr.a (mgr.14388) 3420 : cluster [DBG] pgmap v2369: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:30:21.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:21 smithi163 bash[24253]: cluster 2024-08-31T03:30:19.916636+0000 mgr.a (mgr.14388) 3421 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:30:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:21 smithi027 bash[22610]: cluster 2024-08-31T03:30:19.916636+0000 mgr.a (mgr.14388) 3421 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:30:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:21 smithi191 bash[24992]: cluster 2024-08-31T03:30:19.916636+0000 mgr.a (mgr.14388) 3421 : cluster [DBG] pgmap v2370: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:30:22.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:30:22.834 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:30:22.834 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:30:23.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:23.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:23.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:23.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:23.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:23.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:23 smithi163 bash[24253]: cluster 2024-08-31T03:30:21.917558+0000 mgr.a (mgr.14388) 3422 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:30:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:23 smithi027 bash[22610]: cluster 2024-08-31T03:30:21.917558+0000 mgr.a (mgr.14388) 3422 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:30:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:23 smithi191 bash[24992]: cluster 2024-08-31T03:30:21.917558+0000 mgr.a (mgr.14388) 3422 : cluster [DBG] pgmap v2371: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:30:24.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:24 smithi163 bash[24253]: audit 2024-08-31T03:30:23.172583+0000 mgr.a (mgr.14388) 3423 : audit [DBG] from='client.85170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:24 smithi027 bash[22610]: audit 2024-08-31T03:30:23.172583+0000 mgr.a (mgr.14388) 3423 : audit [DBG] from='client.85170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:24 smithi191 bash[24992]: audit 2024-08-31T03:30:23.172583+0000 mgr.a (mgr.14388) 3423 : audit [DBG] from='client.85170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:25.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:25 smithi163 bash[24253]: cluster 2024-08-31T03:30:23.920241+0000 mgr.a (mgr.14388) 3424 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:25 smithi027 bash[22610]: cluster 2024-08-31T03:30:23.920241+0000 mgr.a (mgr.14388) 3424 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:25 smithi191 bash[24992]: cluster 2024-08-31T03:30:23.920241+0000 mgr.a (mgr.14388) 3424 : cluster [DBG] pgmap v2372: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:27.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:27 smithi163 bash[24253]: cluster 2024-08-31T03:30:25.921189+0000 mgr.a (mgr.14388) 3425 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:30:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:27 smithi027 bash[22610]: cluster 2024-08-31T03:30:25.921189+0000 mgr.a (mgr.14388) 3425 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:30:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:27 smithi191 bash[24992]: cluster 2024-08-31T03:30:25.921189+0000 mgr.a (mgr.14388) 3425 : cluster [DBG] pgmap v2373: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:30:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:30:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:30:28.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:30:29.360 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:29.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:29.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:29.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:29.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:29.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:29 smithi163 bash[24253]: cluster 2024-08-31T03:30:27.923271+0000 mgr.a (mgr.14388) 3426 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:29 smithi027 bash[22610]: cluster 2024-08-31T03:30:27.923271+0000 mgr.a (mgr.14388) 3426 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:29 smithi191 bash[24992]: cluster 2024-08-31T03:30:27.923271+0000 mgr.a (mgr.14388) 3426 : cluster [DBG] pgmap v2374: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:30.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:30 smithi163 bash[24253]: audit 2024-08-31T03:30:28.938985+0000 mgr.a (mgr.14388) 3427 : audit [DBG] from='client.85245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:30 smithi027 bash[22610]: audit 2024-08-31T03:30:28.938985+0000 mgr.a (mgr.14388) 3427 : audit [DBG] from='client.85245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:30 smithi191 bash[24992]: audit 2024-08-31T03:30:28.938985+0000 mgr.a (mgr.14388) 3427 : audit [DBG] from='client.85245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:31.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:31 smithi163 bash[24253]: cluster 2024-08-31T03:30:29.924217+0000 mgr.a (mgr.14388) 3428 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:30:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:31 smithi027 bash[22610]: cluster 2024-08-31T03:30:29.924217+0000 mgr.a (mgr.14388) 3428 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:30:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:31 smithi191 bash[24992]: cluster 2024-08-31T03:30:29.924217+0000 mgr.a (mgr.14388) 3428 : cluster [DBG] pgmap v2375: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:30:33.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:33 smithi163 bash[24253]: cluster 2024-08-31T03:30:31.925001+0000 mgr.a (mgr.14388) 3429 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:30:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:33 smithi027 bash[22610]: cluster 2024-08-31T03:30:31.925001+0000 mgr.a (mgr.14388) 3429 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:30:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:33 smithi191 bash[24992]: cluster 2024-08-31T03:30:31.925001+0000 mgr.a (mgr.14388) 3429 : cluster [DBG] pgmap v2376: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:30:34.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:30:34.362 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:30:34.363 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:30:35.143 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:35.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:35.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:35.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:35.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:35.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:35 smithi163 bash[24253]: cluster 2024-08-31T03:30:33.927192+0000 mgr.a (mgr.14388) 3430 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:30:35.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:35 smithi163 bash[24253]: audit 2024-08-31T03:30:34.708181+0000 mgr.a (mgr.14388) 3431 : audit [DBG] from='client.85323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:35 smithi027 bash[22610]: cluster 2024-08-31T03:30:33.927192+0000 mgr.a (mgr.14388) 3430 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:30:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:35 smithi027 bash[22610]: audit 2024-08-31T03:30:34.708181+0000 mgr.a (mgr.14388) 3431 : audit [DBG] from='client.85323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:35 smithi191 bash[24992]: cluster 2024-08-31T03:30:33.927192+0000 mgr.a (mgr.14388) 3430 : cluster [DBG] pgmap v2377: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:30:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:35 smithi191 bash[24992]: audit 2024-08-31T03:30:34.708181+0000 mgr.a (mgr.14388) 3431 : audit [DBG] from='client.85323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:37.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:37 smithi163 bash[24253]: cluster 2024-08-31T03:30:35.928067+0000 mgr.a (mgr.14388) 3432 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:37 smithi027 bash[22610]: cluster 2024-08-31T03:30:35.928067+0000 mgr.a (mgr.14388) 3432 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:37 smithi191 bash[24992]: cluster 2024-08-31T03:30:35.928067+0000 mgr.a (mgr.14388) 3432 : cluster [DBG] pgmap v2378: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:39.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:39 smithi163 bash[24253]: cluster 2024-08-31T03:30:37.930158+0000 mgr.a (mgr.14388) 3433 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:39 smithi027 bash[22610]: cluster 2024-08-31T03:30:37.930158+0000 mgr.a (mgr.14388) 3433 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:39 smithi191 bash[24992]: cluster 2024-08-31T03:30:37.930158+0000 mgr.a (mgr.14388) 3433 : cluster [DBG] pgmap v2379: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:40.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:30:40.145 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:30:40.145 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:30:40.889 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:40.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:40.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:40.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:40.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:41 smithi163 bash[24253]: cluster 2024-08-31T03:30:39.930958+0000 mgr.a (mgr.14388) 3434 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:41 smithi163 bash[24253]: audit 2024-08-31T03:30:40.470775+0000 mgr.a (mgr.14388) 3435 : audit [DBG] from='client.85398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:41 smithi027 bash[22610]: cluster 2024-08-31T03:30:39.930958+0000 mgr.a (mgr.14388) 3434 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:41 smithi027 bash[22610]: audit 2024-08-31T03:30:40.470775+0000 mgr.a (mgr.14388) 3435 : audit [DBG] from='client.85398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:41 smithi191 bash[24992]: cluster 2024-08-31T03:30:39.930958+0000 mgr.a (mgr.14388) 3434 : cluster [DBG] pgmap v2380: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:41 smithi191 bash[24992]: audit 2024-08-31T03:30:40.470775+0000 mgr.a (mgr.14388) 3435 : audit [DBG] from='client.85398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:43.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:43 smithi163 bash[24253]: cluster 2024-08-31T03:30:41.931830+0000 mgr.a (mgr.14388) 3436 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:43 smithi027 bash[22610]: cluster 2024-08-31T03:30:41.931830+0000 mgr.a (mgr.14388) 3436 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:43 smithi191 bash[24992]: cluster 2024-08-31T03:30:41.931830+0000 mgr.a (mgr.14388) 3436 : cluster [DBG] pgmap v2381: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:45.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:30:45.891 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:30:45.891 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:30:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:45 smithi027 bash[22610]: cluster 2024-08-31T03:30:43.934023+0000 mgr.a (mgr.14388) 3437 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:45 smithi191 bash[24992]: cluster 2024-08-31T03:30:43.934023+0000 mgr.a (mgr.14388) 3437 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:46.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:45 smithi163 bash[24253]: cluster 2024-08-31T03:30:43.934023+0000 mgr.a (mgr.14388) 3437 : cluster [DBG] pgmap v2382: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:46.643 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:46.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:46.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:46.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:46.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:47 smithi027 bash[22610]: cluster 2024-08-31T03:30:45.934697+0000 mgr.a (mgr.14388) 3438 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:47 smithi027 bash[22610]: audit 2024-08-31T03:30:46.223780+0000 mgr.a (mgr.14388) 3439 : audit [DBG] from='client.85473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:47 smithi191 bash[24992]: cluster 2024-08-31T03:30:45.934697+0000 mgr.a (mgr.14388) 3438 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:47 smithi191 bash[24992]: audit 2024-08-31T03:30:46.223780+0000 mgr.a (mgr.14388) 3439 : audit [DBG] from='client.85473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:48.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:47 smithi163 bash[24253]: cluster 2024-08-31T03:30:45.934697+0000 mgr.a (mgr.14388) 3438 : cluster [DBG] pgmap v2383: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:48.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:47 smithi163 bash[24253]: audit 2024-08-31T03:30:46.223780+0000 mgr.a (mgr.14388) 3439 : audit [DBG] from='client.85473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:49 smithi027 bash[22610]: cluster 2024-08-31T03:30:47.936902+0000 mgr.a (mgr.14388) 3440 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:49 smithi191 bash[24992]: cluster 2024-08-31T03:30:47.936902+0000 mgr.a (mgr.14388) 3440 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:50.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:49 smithi163 bash[24253]: cluster 2024-08-31T03:30:47.936902+0000 mgr.a (mgr.14388) 3440 : cluster [DBG] pgmap v2384: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:30:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:30:51.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:30:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:51 smithi027 bash[22610]: cluster 2024-08-31T03:30:49.937685+0000 mgr.a (mgr.14388) 3441 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:51 smithi191 bash[24992]: cluster 2024-08-31T03:30:49.937685+0000 mgr.a (mgr.14388) 3441 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:52.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:51 smithi163 bash[24253]: cluster 2024-08-31T03:30:49.937685+0000 mgr.a (mgr.14388) 3441 : cluster [DBG] pgmap v2385: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:52.375 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:52.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:52.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:52.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:52.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:53 smithi027 bash[22610]: cluster 2024-08-31T03:30:51.938401+0000 mgr.a (mgr.14388) 3442 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:53 smithi027 bash[22610]: audit 2024-08-31T03:30:51.974640+0000 mgr.a (mgr.14388) 3443 : audit [DBG] from='client.85551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:53 smithi027 bash[22610]: audit 2024-08-31T03:30:53.118616+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:30:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:53 smithi191 bash[24992]: cluster 2024-08-31T03:30:51.938401+0000 mgr.a (mgr.14388) 3442 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:53 smithi191 bash[24992]: audit 2024-08-31T03:30:51.974640+0000 mgr.a (mgr.14388) 3443 : audit [DBG] from='client.85551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:53 smithi191 bash[24992]: audit 2024-08-31T03:30:53.118616+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:30:54.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:53 smithi163 bash[24253]: cluster 2024-08-31T03:30:51.938401+0000 mgr.a (mgr.14388) 3442 : cluster [DBG] pgmap v2386: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:54.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:53 smithi163 bash[24253]: audit 2024-08-31T03:30:51.974640+0000 mgr.a (mgr.14388) 3443 : audit [DBG] from='client.85551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:54.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:53 smithi163 bash[24253]: audit 2024-08-31T03:30:53.118616+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:30:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:54 smithi027 bash[22610]: audit 2024-08-31T03:30:53.731816+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:54 smithi027 bash[22610]: audit 2024-08-31T03:30:53.734754+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:54 smithi027 bash[22610]: audit 2024-08-31T03:30:53.737930+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:54 smithi027 bash[22610]: audit 2024-08-31T03:30:53.742472+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:54 smithi027 bash[22610]: audit 2024-08-31T03:30:54.564675+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:30:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:54 smithi027 bash[22610]: audit 2024-08-31T03:30:54.566060+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:30:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:54 smithi027 bash[22610]: audit 2024-08-31T03:30:54.575370+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:54 smithi027 bash[22610]: audit 2024-08-31T03:30:54.578758+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:30:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:54 smithi191 bash[24992]: audit 2024-08-31T03:30:53.731816+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:54 smithi191 bash[24992]: audit 2024-08-31T03:30:53.734754+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:54 smithi191 bash[24992]: audit 2024-08-31T03:30:53.737930+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:54 smithi191 bash[24992]: audit 2024-08-31T03:30:53.742472+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:55.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:54 smithi191 bash[24992]: audit 2024-08-31T03:30:54.564675+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:30:55.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:54 smithi191 bash[24992]: audit 2024-08-31T03:30:54.566060+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:30:55.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:54 smithi191 bash[24992]: audit 2024-08-31T03:30:54.575370+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:55.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:54 smithi191 bash[24992]: audit 2024-08-31T03:30:54.578758+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:30:55.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:54 smithi163 bash[24253]: audit 2024-08-31T03:30:53.731816+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:55.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:54 smithi163 bash[24253]: audit 2024-08-31T03:30:53.734754+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:55.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:54 smithi163 bash[24253]: audit 2024-08-31T03:30:53.737930+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:55.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:54 smithi163 bash[24253]: audit 2024-08-31T03:30:53.742472+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:55.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:54 smithi163 bash[24253]: audit 2024-08-31T03:30:54.564675+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:30:55.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:54 smithi163 bash[24253]: audit 2024-08-31T03:30:54.566060+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:30:55.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:54 smithi163 bash[24253]: audit 2024-08-31T03:30:54.575370+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:30:55.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:54 smithi163 bash[24253]: audit 2024-08-31T03:30:54.578758+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:30:55.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:30:55 smithi027 bash[22863]: debug 2024-08-31T03:30:55.296+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:30:55.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:30:55 smithi027 bash[22863]: debug 2024-08-31T03:30:55.300+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:30:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:55 smithi191 bash[24992]: cluster 2024-08-31T03:30:53.940688+0000 mgr.a (mgr.14388) 3444 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:55 smithi191 bash[24992]: audit 2024-08-31T03:30:54.580976+0000 mgr.a (mgr.14388) 3445 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:30:56.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:55 smithi163 bash[24253]: cluster 2024-08-31T03:30:53.940688+0000 mgr.a (mgr.14388) 3444 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:56.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:55 smithi163 bash[24253]: audit 2024-08-31T03:30:54.580976+0000 mgr.a (mgr.14388) 3445 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:30:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:55 smithi027 bash[22610]: cluster 2024-08-31T03:30:53.940688+0000 mgr.a (mgr.14388) 3444 : cluster [DBG] pgmap v2387: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:30:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:55 smithi027 bash[22610]: audit 2024-08-31T03:30:54.580976+0000 mgr.a (mgr.14388) 3445 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:30:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:56 smithi191 bash[24992]: audit 2024-08-31T03:30:55.301316+0000 mgr.a (mgr.14388) 3446 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:30:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:56 smithi191 bash[24992]: cephadm 2024-08-31T03:30:55.302736+0000 mgr.a (mgr.14388) 3447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:30:57.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:56 smithi163 bash[24253]: audit 2024-08-31T03:30:55.301316+0000 mgr.a (mgr.14388) 3446 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:30:57.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:56 smithi163 bash[24253]: cephadm 2024-08-31T03:30:55.302736+0000 mgr.a (mgr.14388) 3447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:30:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:56 smithi027 bash[22610]: audit 2024-08-31T03:30:55.301316+0000 mgr.a (mgr.14388) 3446 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:30:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:56 smithi027 bash[22610]: cephadm 2024-08-31T03:30:55.302736+0000 mgr.a (mgr.14388) 3447 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:30:57.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:30:57.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:30:57.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:30:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:57 smithi191 bash[24992]: cluster 2024-08-31T03:30:55.941609+0000 mgr.a (mgr.14388) 3448 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:58.128 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:30:58.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:30:58.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:30:58.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:30:58.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:30:58.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:57 smithi163 bash[24253]: cluster 2024-08-31T03:30:55.941609+0000 mgr.a (mgr.14388) 3448 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:57 smithi027 bash[22610]: cluster 2024-08-31T03:30:55.941609+0000 mgr.a (mgr.14388) 3448 : cluster [DBG] pgmap v2388: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:30:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:58 smithi191 bash[24992]: audit 2024-08-31T03:30:57.714589+0000 mgr.a (mgr.14388) 3449 : audit [DBG] from='client.85725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:59.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:58 smithi163 bash[24253]: audit 2024-08-31T03:30:57.714589+0000 mgr.a (mgr.14388) 3449 : audit [DBG] from='client.85725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:30:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:58 smithi027 bash[22610]: audit 2024-08-31T03:30:57.714589+0000 mgr.a (mgr.14388) 3449 : audit [DBG] from='client.85725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:30:59 smithi191 bash[24992]: cluster 2024-08-31T03:30:57.944930+0000 mgr.a (mgr.14388) 3450 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:00.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:30:59 smithi163 bash[24253]: cluster 2024-08-31T03:30:57.944930+0000 mgr.a (mgr.14388) 3450 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:30:59 smithi027 bash[22610]: cluster 2024-08-31T03:30:57.944930+0000 mgr.a (mgr.14388) 3450 : cluster [DBG] pgmap v2389: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:01 smithi191 bash[24992]: cluster 2024-08-31T03:30:59.945797+0000 mgr.a (mgr.14388) 3451 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:31:02.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:01 smithi163 bash[24253]: cluster 2024-08-31T03:30:59.945797+0000 mgr.a (mgr.14388) 3451 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:31:02.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:01 smithi027 bash[22610]: cluster 2024-08-31T03:30:59.945797+0000 mgr.a (mgr.14388) 3451 : cluster [DBG] pgmap v2390: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:31:03.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:31:03.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:31:03.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:31:03.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:31:03.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:31:03.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:31:03.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:31:03.905 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:31:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:03 smithi191 bash[24992]: cluster 2024-08-31T03:31:01.946593+0000 mgr.a (mgr.14388) 3452 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:31:04.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:03 smithi163 bash[24253]: cluster 2024-08-31T03:31:01.946593+0000 mgr.a (mgr.14388) 3452 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:31:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:03 smithi027 bash[22610]: cluster 2024-08-31T03:31:01.946593+0000 mgr.a (mgr.14388) 3452 : cluster [DBG] pgmap v2391: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:31:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:04 smithi191 bash[24992]: audit 2024-08-31T03:31:03.465492+0000 mgr.a (mgr.14388) 3453 : audit [DBG] from='client.85803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:05.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:04 smithi163 bash[24253]: audit 2024-08-31T03:31:03.465492+0000 mgr.a (mgr.14388) 3453 : audit [DBG] from='client.85803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:04 smithi027 bash[22610]: audit 2024-08-31T03:31:03.465492+0000 mgr.a (mgr.14388) 3453 : audit [DBG] from='client.85803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:05 smithi191 bash[24992]: cluster 2024-08-31T03:31:03.947938+0000 mgr.a (mgr.14388) 3454 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:06.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:05 smithi163 bash[24253]: cluster 2024-08-31T03:31:03.947938+0000 mgr.a (mgr.14388) 3454 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:05 smithi027 bash[22610]: cluster 2024-08-31T03:31:03.947938+0000 mgr.a (mgr.14388) 3454 : cluster [DBG] pgmap v2392: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:08.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:07 smithi163 bash[24253]: cluster 2024-08-31T03:31:05.948691+0000 mgr.a (mgr.14388) 3455 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:31:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:07 smithi027 bash[22610]: cluster 2024-08-31T03:31:05.948691+0000 mgr.a (mgr.14388) 3455 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:31:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:07 smithi191 bash[24992]: cluster 2024-08-31T03:31:05.948691+0000 mgr.a (mgr.14388) 3455 : cluster [DBG] pgmap v2393: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:31:08.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:31:08.907 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:31:08.907 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:31:09.637 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:31:09.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:31:09.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:31:09.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:31:09.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:31:10.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:09 smithi163 bash[24253]: cluster 2024-08-31T03:31:07.950624+0000 mgr.a (mgr.14388) 3456 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:09 smithi027 bash[22610]: cluster 2024-08-31T03:31:07.950624+0000 mgr.a (mgr.14388) 3456 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:09 smithi191 bash[24992]: cluster 2024-08-31T03:31:07.950624+0000 mgr.a (mgr.14388) 3456 : cluster [DBG] pgmap v2394: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:11.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:10 smithi163 bash[24253]: audit 2024-08-31T03:31:09.236061+0000 mgr.a (mgr.14388) 3457 : audit [DBG] from='client.85878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:10 smithi027 bash[22610]: audit 2024-08-31T03:31:09.236061+0000 mgr.a (mgr.14388) 3457 : audit [DBG] from='client.85878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:10 smithi191 bash[24992]: audit 2024-08-31T03:31:09.236061+0000 mgr.a (mgr.14388) 3457 : audit [DBG] from='client.85878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:12.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:11 smithi163 bash[24253]: cluster 2024-08-31T03:31:09.951598+0000 mgr.a (mgr.14388) 3458 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:11 smithi027 bash[22610]: cluster 2024-08-31T03:31:09.951598+0000 mgr.a (mgr.14388) 3458 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:11 smithi191 bash[24992]: cluster 2024-08-31T03:31:09.951598+0000 mgr.a (mgr.14388) 3458 : cluster [DBG] pgmap v2395: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:13.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:12 smithi163 bash[24253]: cluster 2024-08-31T03:31:11.952392+0000 mgr.a (mgr.14388) 3459 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:12 smithi027 bash[22610]: cluster 2024-08-31T03:31:11.952392+0000 mgr.a (mgr.14388) 3459 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:12 smithi191 bash[24992]: cluster 2024-08-31T03:31:11.952392+0000 mgr.a (mgr.14388) 3459 : cluster [DBG] pgmap v2396: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:14.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:31:14.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:31:14.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:31:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:15 smithi191 bash[24992]: cluster 2024-08-31T03:31:13.954543+0000 mgr.a (mgr.14388) 3460 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:15.389 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:31:15.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:31:15.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:31:15.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:31:15.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:31:15.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:15 smithi163 bash[24253]: cluster 2024-08-31T03:31:13.954543+0000 mgr.a (mgr.14388) 3460 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:15 smithi027 bash[22610]: cluster 2024-08-31T03:31:13.954543+0000 mgr.a (mgr.14388) 3460 : cluster [DBG] pgmap v2397: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:16 smithi191 bash[24992]: audit 2024-08-31T03:31:14.973302+0000 mgr.a (mgr.14388) 3461 : audit [DBG] from='client.85953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:16.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:16 smithi163 bash[24253]: audit 2024-08-31T03:31:14.973302+0000 mgr.a (mgr.14388) 3461 : audit [DBG] from='client.85953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:16 smithi027 bash[22610]: audit 2024-08-31T03:31:14.973302+0000 mgr.a (mgr.14388) 3461 : audit [DBG] from='client.85953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:17 smithi191 bash[24992]: cluster 2024-08-31T03:31:15.955657+0000 mgr.a (mgr.14388) 3462 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:17.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:17 smithi163 bash[24253]: cluster 2024-08-31T03:31:15.955657+0000 mgr.a (mgr.14388) 3462 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:17 smithi027 bash[22610]: cluster 2024-08-31T03:31:15.955657+0000 mgr.a (mgr.14388) 3462 : cluster [DBG] pgmap v2398: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:19 smithi191 bash[24992]: cluster 2024-08-31T03:31:17.957784+0000 mgr.a (mgr.14388) 3463 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:19.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:19 smithi163 bash[24253]: cluster 2024-08-31T03:31:17.957784+0000 mgr.a (mgr.14388) 3463 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:19 smithi027 bash[22610]: cluster 2024-08-31T03:31:17.957784+0000 mgr.a (mgr.14388) 3463 : cluster [DBG] pgmap v2399: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:20.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:31:20.392 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:31:20.392 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:31:21.125 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:31:21.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:31:21.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:31:21.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:31:21.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:31:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:21 smithi191 bash[24992]: cluster 2024-08-31T03:31:19.958678+0000 mgr.a (mgr.14388) 3464 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:21 smithi191 bash[24992]: audit 2024-08-31T03:31:20.723431+0000 mgr.a (mgr.14388) 3465 : audit [DBG] from='client.86031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:21.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:21 smithi163 bash[24253]: cluster 2024-08-31T03:31:19.958678+0000 mgr.a (mgr.14388) 3464 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:21.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:21 smithi163 bash[24253]: audit 2024-08-31T03:31:20.723431+0000 mgr.a (mgr.14388) 3465 : audit [DBG] from='client.86031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:21 smithi027 bash[22610]: cluster 2024-08-31T03:31:19.958678+0000 mgr.a (mgr.14388) 3464 : cluster [DBG] pgmap v2400: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:21 smithi027 bash[22610]: audit 2024-08-31T03:31:20.723431+0000 mgr.a (mgr.14388) 3465 : audit [DBG] from='client.86031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:23 smithi191 bash[24992]: cluster 2024-08-31T03:31:21.959636+0000 mgr.a (mgr.14388) 3466 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:23.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:23 smithi163 bash[24253]: cluster 2024-08-31T03:31:21.959636+0000 mgr.a (mgr.14388) 3466 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:23 smithi027 bash[22610]: cluster 2024-08-31T03:31:21.959636+0000 mgr.a (mgr.14388) 3466 : cluster [DBG] pgmap v2401: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:25.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:25 smithi163 bash[24253]: cluster 2024-08-31T03:31:23.961860+0000 mgr.a (mgr.14388) 3467 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:25 smithi027 bash[22610]: cluster 2024-08-31T03:31:23.961860+0000 mgr.a (mgr.14388) 3467 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:25 smithi191 bash[24992]: cluster 2024-08-31T03:31:23.961860+0000 mgr.a (mgr.14388) 3467 : cluster [DBG] pgmap v2402: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:26.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:31:26.129 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:31:26.129 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:31:26.869 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:31:26.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:31:26.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:31:26.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:31:26.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:31:27.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:27 smithi163 bash[24253]: cluster 2024-08-31T03:31:25.962772+0000 mgr.a (mgr.14388) 3468 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:27.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:27 smithi163 bash[24253]: audit 2024-08-31T03:31:26.460385+0000 mgr.a (mgr.14388) 3469 : audit [DBG] from='client.86106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:27 smithi027 bash[22610]: cluster 2024-08-31T03:31:25.962772+0000 mgr.a (mgr.14388) 3468 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:27 smithi027 bash[22610]: audit 2024-08-31T03:31:26.460385+0000 mgr.a (mgr.14388) 3469 : audit [DBG] from='client.86106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:27 smithi191 bash[24992]: cluster 2024-08-31T03:31:25.962772+0000 mgr.a (mgr.14388) 3468 : cluster [DBG] pgmap v2403: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:27 smithi191 bash[24992]: audit 2024-08-31T03:31:26.460385+0000 mgr.a (mgr.14388) 3469 : audit [DBG] from='client.86106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:29.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:29 smithi163 bash[24253]: cluster 2024-08-31T03:31:27.965053+0000 mgr.a (mgr.14388) 3470 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:29 smithi027 bash[22610]: cluster 2024-08-31T03:31:27.965053+0000 mgr.a (mgr.14388) 3470 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:29 smithi191 bash[24992]: cluster 2024-08-31T03:31:27.965053+0000 mgr.a (mgr.14388) 3470 : cluster [DBG] pgmap v2404: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:31.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:31 smithi163 bash[24253]: cluster 2024-08-31T03:31:29.965846+0000 mgr.a (mgr.14388) 3471 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:31 smithi027 bash[22610]: cluster 2024-08-31T03:31:29.965846+0000 mgr.a (mgr.14388) 3471 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:31 smithi191 bash[24992]: cluster 2024-08-31T03:31:29.965846+0000 mgr.a (mgr.14388) 3471 : cluster [DBG] pgmap v2405: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:31:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:31:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:31:32.633 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:31:32.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:31:32.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:31:32.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:31:32.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:31:33.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:33 smithi163 bash[24253]: cluster 2024-08-31T03:31:31.966394+0000 mgr.a (mgr.14388) 3472 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:33.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:33 smithi163 bash[24253]: audit 2024-08-31T03:31:32.209525+0000 mgr.a (mgr.14388) 3473 : audit [DBG] from='client.86184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:33 smithi027 bash[22610]: cluster 2024-08-31T03:31:31.966394+0000 mgr.a (mgr.14388) 3472 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:33 smithi027 bash[22610]: audit 2024-08-31T03:31:32.209525+0000 mgr.a (mgr.14388) 3473 : audit [DBG] from='client.86184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:33 smithi191 bash[24992]: cluster 2024-08-31T03:31:31.966394+0000 mgr.a (mgr.14388) 3472 : cluster [DBG] pgmap v2406: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:33 smithi191 bash[24992]: audit 2024-08-31T03:31:32.209525+0000 mgr.a (mgr.14388) 3473 : audit [DBG] from='client.86184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:35.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:35 smithi163 bash[24253]: cluster 2024-08-31T03:31:33.968720+0000 mgr.a (mgr.14388) 3474 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:35 smithi027 bash[22610]: cluster 2024-08-31T03:31:33.968720+0000 mgr.a (mgr.14388) 3474 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:35 smithi191 bash[24992]: cluster 2024-08-31T03:31:33.968720+0000 mgr.a (mgr.14388) 3474 : cluster [DBG] pgmap v2407: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:37.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:37 smithi163 bash[24253]: cluster 2024-08-31T03:31:35.969525+0000 mgr.a (mgr.14388) 3475 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:37 smithi027 bash[22610]: cluster 2024-08-31T03:31:35.969525+0000 mgr.a (mgr.14388) 3475 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:37 smithi191 bash[24992]: cluster 2024-08-31T03:31:35.969525+0000 mgr.a (mgr.14388) 3475 : cluster [DBG] pgmap v2408: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:37.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:31:37.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:31:37.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:31:38.412 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:31:38.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:31:38.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:31:38.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:31:38.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:31:39.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:39 smithi163 bash[24253]: audit 2024-08-31T03:31:37.970897+0000 mgr.a (mgr.14388) 3476 : audit [DBG] from='client.86262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:39.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:39 smithi163 bash[24253]: cluster 2024-08-31T03:31:37.971685+0000 mgr.a (mgr.14388) 3477 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:39 smithi027 bash[22610]: audit 2024-08-31T03:31:37.970897+0000 mgr.a (mgr.14388) 3476 : audit [DBG] from='client.86262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:39 smithi027 bash[22610]: cluster 2024-08-31T03:31:37.971685+0000 mgr.a (mgr.14388) 3477 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:39 smithi191 bash[24992]: audit 2024-08-31T03:31:37.970897+0000 mgr.a (mgr.14388) 3476 : audit [DBG] from='client.86262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:39 smithi191 bash[24992]: cluster 2024-08-31T03:31:37.971685+0000 mgr.a (mgr.14388) 3477 : cluster [DBG] pgmap v2409: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:41.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:41 smithi163 bash[24253]: cluster 2024-08-31T03:31:39.972530+0000 mgr.a (mgr.14388) 3478 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:31:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:41 smithi027 bash[22610]: cluster 2024-08-31T03:31:39.972530+0000 mgr.a (mgr.14388) 3478 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:31:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:41 smithi191 bash[24992]: cluster 2024-08-31T03:31:39.972530+0000 mgr.a (mgr.14388) 3478 : cluster [DBG] pgmap v2410: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:31:43.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:31:43.414 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:31:43.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:31:43.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:43 smithi163 bash[24253]: cluster 2024-08-31T03:31:41.973313+0000 mgr.a (mgr.14388) 3479 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:31:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:43 smithi027 bash[22610]: cluster 2024-08-31T03:31:41.973313+0000 mgr.a (mgr.14388) 3479 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:31:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:43 smithi191 bash[24992]: cluster 2024-08-31T03:31:41.973313+0000 mgr.a (mgr.14388) 3479 : cluster [DBG] pgmap v2411: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:31:44.185 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:31:44.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:31:44.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:31:44.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:31:44.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:31:44.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:44 smithi163 bash[24253]: audit 2024-08-31T03:31:43.750527+0000 mgr.a (mgr.14388) 3480 : audit [DBG] from='client.86334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:44 smithi027 bash[22610]: audit 2024-08-31T03:31:43.750527+0000 mgr.a (mgr.14388) 3480 : audit [DBG] from='client.86334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:44 smithi191 bash[24992]: audit 2024-08-31T03:31:43.750527+0000 mgr.a (mgr.14388) 3480 : audit [DBG] from='client.86334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:45.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:45 smithi163 bash[24253]: cluster 2024-08-31T03:31:43.974534+0000 mgr.a (mgr.14388) 3481 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:45 smithi027 bash[22610]: cluster 2024-08-31T03:31:43.974534+0000 mgr.a (mgr.14388) 3481 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:45 smithi191 bash[24992]: cluster 2024-08-31T03:31:43.974534+0000 mgr.a (mgr.14388) 3481 : cluster [DBG] pgmap v2412: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:47.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:47 smithi163 bash[24253]: cluster 2024-08-31T03:31:45.975397+0000 mgr.a (mgr.14388) 3482 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:31:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:47 smithi027 bash[22610]: cluster 2024-08-31T03:31:45.975397+0000 mgr.a (mgr.14388) 3482 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:31:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:47 smithi191 bash[24992]: cluster 2024-08-31T03:31:45.975397+0000 mgr.a (mgr.14388) 3482 : cluster [DBG] pgmap v2413: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:31:49.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:31:49.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:31:49.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:31:49.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:49 smithi163 bash[24253]: cluster 2024-08-31T03:31:47.977515+0000 mgr.a (mgr.14388) 3483 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:49 smithi027 bash[22610]: cluster 2024-08-31T03:31:47.977515+0000 mgr.a (mgr.14388) 3483 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:49 smithi191 bash[24992]: cluster 2024-08-31T03:31:47.977515+0000 mgr.a (mgr.14388) 3483 : cluster [DBG] pgmap v2414: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:49.945 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:31:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:31:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:31:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:31:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:31:50.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:50 smithi163 bash[24253]: audit 2024-08-31T03:31:49.522796+0000 mgr.a (mgr.14388) 3484 : audit [DBG] from='client.86409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:50 smithi027 bash[22610]: audit 2024-08-31T03:31:49.522796+0000 mgr.a (mgr.14388) 3484 : audit [DBG] from='client.86409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:50 smithi191 bash[24992]: audit 2024-08-31T03:31:49.522796+0000 mgr.a (mgr.14388) 3484 : audit [DBG] from='client.86409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:51.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:51 smithi163 bash[24253]: cluster 2024-08-31T03:31:49.978144+0000 mgr.a (mgr.14388) 3485 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:51 smithi027 bash[22610]: cluster 2024-08-31T03:31:49.978144+0000 mgr.a (mgr.14388) 3485 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:51 smithi191 bash[24992]: cluster 2024-08-31T03:31:49.978144+0000 mgr.a (mgr.14388) 3485 : cluster [DBG] pgmap v2415: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:53.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:53 smithi163 bash[24253]: cluster 2024-08-31T03:31:51.978932+0000 mgr.a (mgr.14388) 3486 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:53 smithi027 bash[22610]: cluster 2024-08-31T03:31:51.978932+0000 mgr.a (mgr.14388) 3486 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:53 smithi191 bash[24992]: cluster 2024-08-31T03:31:51.978932+0000 mgr.a (mgr.14388) 3486 : cluster [DBG] pgmap v2416: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:31:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:31:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:31:55.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:55 smithi163 bash[24253]: cluster 2024-08-31T03:31:53.981122+0000 mgr.a (mgr.14388) 3487 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:55 smithi027 bash[22610]: cluster 2024-08-31T03:31:53.981122+0000 mgr.a (mgr.14388) 3487 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:55 smithi191 bash[24992]: cluster 2024-08-31T03:31:53.981122+0000 mgr.a (mgr.14388) 3487 : cluster [DBG] pgmap v2417: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:31:55.714 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:31:55.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:31:55.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:31:55.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:31:55.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:31:56.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:56 smithi163 bash[24253]: audit 2024-08-31T03:31:55.283309+0000 mgr.a (mgr.14388) 3488 : audit [DBG] from='client.86484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:56.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:56 smithi163 bash[24253]: audit 2024-08-31T03:31:55.354211+0000 mon.a (mon.0) 1112 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:31:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:56 smithi027 bash[22610]: audit 2024-08-31T03:31:55.283309+0000 mgr.a (mgr.14388) 3488 : audit [DBG] from='client.86484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:56 smithi027 bash[22610]: audit 2024-08-31T03:31:55.354211+0000 mon.a (mon.0) 1112 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:31:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:56 smithi191 bash[24992]: audit 2024-08-31T03:31:55.283309+0000 mgr.a (mgr.14388) 3488 : audit [DBG] from='client.86484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:31:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:56 smithi191 bash[24992]: audit 2024-08-31T03:31:55.354211+0000 mon.a (mon.0) 1112 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:31:57.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:31:56 smithi027 bash[22863]: debug 2024-08-31T03:31:56.907+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:31:57.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:31:56 smithi027 bash[22863]: debug 2024-08-31T03:31:56.911+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:31:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:57 smithi027 bash[22610]: cluster 2024-08-31T03:31:55.981810+0000 mgr.a (mgr.14388) 3489 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:57 smithi027 bash[22610]: audit 2024-08-31T03:31:56.158779+0000 mon.a (mon.0) 1113 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:31:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:57 smithi027 bash[22610]: audit 2024-08-31T03:31:56.160364+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:31:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:57 smithi027 bash[22610]: audit 2024-08-31T03:31:56.169728+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:31:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:57 smithi027 bash[22610]: audit 2024-08-31T03:31:56.172958+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:31:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:57 smithi027 bash[22610]: audit 2024-08-31T03:31:56.175590+0000 mgr.a (mgr.14388) 3490 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:31:57.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:57 smithi163 bash[24253]: cluster 2024-08-31T03:31:55.981810+0000 mgr.a (mgr.14388) 3489 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:57.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:57 smithi163 bash[24253]: audit 2024-08-31T03:31:56.158779+0000 mon.a (mon.0) 1113 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:31:57.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:57 smithi163 bash[24253]: audit 2024-08-31T03:31:56.160364+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:31:57.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:57 smithi163 bash[24253]: audit 2024-08-31T03:31:56.169728+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:31:57.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:57 smithi163 bash[24253]: audit 2024-08-31T03:31:56.172958+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:31:57.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:57 smithi163 bash[24253]: audit 2024-08-31T03:31:56.175590+0000 mgr.a (mgr.14388) 3490 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:31:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:57 smithi191 bash[24992]: cluster 2024-08-31T03:31:55.981810+0000 mgr.a (mgr.14388) 3489 : cluster [DBG] pgmap v2418: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:31:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:57 smithi191 bash[24992]: audit 2024-08-31T03:31:56.158779+0000 mon.a (mon.0) 1113 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:31:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:57 smithi191 bash[24992]: audit 2024-08-31T03:31:56.160364+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:31:57.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:57 smithi191 bash[24992]: audit 2024-08-31T03:31:56.169728+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:31:57.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:57 smithi191 bash[24992]: audit 2024-08-31T03:31:56.172958+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:31:57.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:57 smithi191 bash[24992]: audit 2024-08-31T03:31:56.175590+0000 mgr.a (mgr.14388) 3490 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:31:58.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:58 smithi163 bash[24253]: audit 2024-08-31T03:31:56.914388+0000 mgr.a (mgr.14388) 3491 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:31:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:58 smithi163 bash[24253]: cephadm 2024-08-31T03:31:56.915594+0000 mgr.a (mgr.14388) 3492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:31:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:58 smithi027 bash[22610]: audit 2024-08-31T03:31:56.914388+0000 mgr.a (mgr.14388) 3491 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:31:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:58 smithi027 bash[22610]: cephadm 2024-08-31T03:31:56.915594+0000 mgr.a (mgr.14388) 3492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:31:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:58 smithi191 bash[24992]: audit 2024-08-31T03:31:56.914388+0000 mgr.a (mgr.14388) 3491 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:31:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:58 smithi191 bash[24992]: cephadm 2024-08-31T03:31:56.915594+0000 mgr.a (mgr.14388) 3492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:31:59.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:31:59 smithi163 bash[24253]: cluster 2024-08-31T03:31:57.984038+0000 mgr.a (mgr.14388) 3493 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:31:59 smithi027 bash[22610]: cluster 2024-08-31T03:31:57.984038+0000 mgr.a (mgr.14388) 3493 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:31:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:31:59 smithi191 bash[24992]: cluster 2024-08-31T03:31:57.984038+0000 mgr.a (mgr.14388) 3493 : cluster [DBG] pgmap v2419: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:00.717 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:00.717 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:01.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:01 smithi163 bash[24253]: cluster 2024-08-31T03:31:59.984803+0000 mgr.a (mgr.14388) 3494 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:01 smithi027 bash[22610]: cluster 2024-08-31T03:31:59.984803+0000 mgr.a (mgr.14388) 3494 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:01.494 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:01.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:01.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:01.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:01.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:01 smithi191 bash[24992]: cluster 2024-08-31T03:31:59.984803+0000 mgr.a (mgr.14388) 3494 : cluster [DBG] pgmap v2420: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:02.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:02 smithi163 bash[24253]: audit 2024-08-31T03:32:01.052519+0000 mgr.a (mgr.14388) 3495 : audit [DBG] from='client.86667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:02 smithi027 bash[22610]: audit 2024-08-31T03:32:01.052519+0000 mgr.a (mgr.14388) 3495 : audit [DBG] from='client.86667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:02 smithi191 bash[24992]: audit 2024-08-31T03:32:01.052519+0000 mgr.a (mgr.14388) 3495 : audit [DBG] from='client.86667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:03.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:03 smithi163 bash[24253]: cluster 2024-08-31T03:32:01.985771+0000 mgr.a (mgr.14388) 3496 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:03 smithi027 bash[22610]: cluster 2024-08-31T03:32:01.985771+0000 mgr.a (mgr.14388) 3496 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:03 smithi191 bash[24992]: cluster 2024-08-31T03:32:01.985771+0000 mgr.a (mgr.14388) 3496 : cluster [DBG] pgmap v2421: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:05.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:05 smithi163 bash[24253]: cluster 2024-08-31T03:32:03.987983+0000 mgr.a (mgr.14388) 3497 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:05 smithi027 bash[22610]: cluster 2024-08-31T03:32:03.987983+0000 mgr.a (mgr.14388) 3497 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:05 smithi191 bash[24992]: cluster 2024-08-31T03:32:03.987983+0000 mgr.a (mgr.14388) 3497 : cluster [DBG] pgmap v2422: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:06.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:06.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:06.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:07.237 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:07.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:07.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:07 smithi163 bash[24253]: cluster 2024-08-31T03:32:05.988748+0000 mgr.a (mgr.14388) 3498 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:07 smithi027 bash[22610]: cluster 2024-08-31T03:32:05.988748+0000 mgr.a (mgr.14388) 3498 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:07 smithi191 bash[24992]: cluster 2024-08-31T03:32:05.988748+0000 mgr.a (mgr.14388) 3498 : cluster [DBG] pgmap v2423: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:08.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:08 smithi163 bash[24253]: audit 2024-08-31T03:32:06.829766+0000 mgr.a (mgr.14388) 3499 : audit [DBG] from='client.86745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:08 smithi027 bash[22610]: audit 2024-08-31T03:32:06.829766+0000 mgr.a (mgr.14388) 3499 : audit [DBG] from='client.86745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:08 smithi191 bash[24992]: audit 2024-08-31T03:32:06.829766+0000 mgr.a (mgr.14388) 3499 : audit [DBG] from='client.86745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:09.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:09 smithi163 bash[24253]: cluster 2024-08-31T03:32:07.991054+0000 mgr.a (mgr.14388) 3500 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:09 smithi027 bash[22610]: cluster 2024-08-31T03:32:07.991054+0000 mgr.a (mgr.14388) 3500 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:09 smithi191 bash[24992]: cluster 2024-08-31T03:32:07.991054+0000 mgr.a (mgr.14388) 3500 : cluster [DBG] pgmap v2424: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:32:11.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:11 smithi163 bash[24253]: cluster 2024-08-31T03:32:09.991831+0000 mgr.a (mgr.14388) 3501 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:11 smithi027 bash[22610]: cluster 2024-08-31T03:32:09.991831+0000 mgr.a (mgr.14388) 3501 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:11 smithi191 bash[24992]: cluster 2024-08-31T03:32:09.991831+0000 mgr.a (mgr.14388) 3501 : cluster [DBG] pgmap v2425: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:12.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:12.239 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:12.239 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:13.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:13.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:13.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:13.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:13.015 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:13.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:13 smithi163 bash[24253]: cluster 2024-08-31T03:32:11.992613+0000 mgr.a (mgr.14388) 3502 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:13.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:13 smithi163 bash[24253]: audit 2024-08-31T03:32:12.583856+0000 mgr.a (mgr.14388) 3503 : audit [DBG] from='client.86820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:13 smithi027 bash[22610]: cluster 2024-08-31T03:32:11.992613+0000 mgr.a (mgr.14388) 3502 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:13 smithi027 bash[22610]: audit 2024-08-31T03:32:12.583856+0000 mgr.a (mgr.14388) 3503 : audit [DBG] from='client.86820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:13 smithi191 bash[24992]: cluster 2024-08-31T03:32:11.992613+0000 mgr.a (mgr.14388) 3502 : cluster [DBG] pgmap v2426: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:13 smithi191 bash[24992]: audit 2024-08-31T03:32:12.583856+0000 mgr.a (mgr.14388) 3503 : audit [DBG] from='client.86820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:15.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:15 smithi163 bash[24253]: cluster 2024-08-31T03:32:13.995345+0000 mgr.a (mgr.14388) 3504 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:32:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:15 smithi027 bash[22610]: cluster 2024-08-31T03:32:13.995345+0000 mgr.a (mgr.14388) 3504 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:32:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:15 smithi191 bash[24992]: cluster 2024-08-31T03:32:13.995345+0000 mgr.a (mgr.14388) 3504 : cluster [DBG] pgmap v2427: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:32:17.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:17 smithi163 bash[24253]: cluster 2024-08-31T03:32:15.996168+0000 mgr.a (mgr.14388) 3505 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:32:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:17 smithi027 bash[22610]: cluster 2024-08-31T03:32:15.996168+0000 mgr.a (mgr.14388) 3505 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:32:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:17 smithi191 bash[24992]: cluster 2024-08-31T03:32:15.996168+0000 mgr.a (mgr.14388) 3505 : cluster [DBG] pgmap v2428: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:32:18.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:18.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:18.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:18.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:19.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:19 smithi163 bash[24253]: cluster 2024-08-31T03:32:17.998113+0000 mgr.a (mgr.14388) 3506 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:19.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:19 smithi163 bash[24253]: audit 2024-08-31T03:32:18.348688+0000 mgr.a (mgr.14388) 3507 : audit [DBG] from='client.86898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:19 smithi027 bash[22610]: cluster 2024-08-31T03:32:17.998113+0000 mgr.a (mgr.14388) 3506 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:19 smithi027 bash[22610]: audit 2024-08-31T03:32:18.348688+0000 mgr.a (mgr.14388) 3507 : audit [DBG] from='client.86898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:19 smithi191 bash[24992]: cluster 2024-08-31T03:32:17.998113+0000 mgr.a (mgr.14388) 3506 : cluster [DBG] pgmap v2429: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:19 smithi191 bash[24992]: audit 2024-08-31T03:32:18.348688+0000 mgr.a (mgr.14388) 3507 : audit [DBG] from='client.86898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:21 smithi027 bash[22610]: cluster 2024-08-31T03:32:19.999067+0000 mgr.a (mgr.14388) 3508 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:32:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:21 smithi191 bash[24992]: cluster 2024-08-31T03:32:19.999067+0000 mgr.a (mgr.14388) 3508 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:32:21.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:21 smithi163 bash[24253]: cluster 2024-08-31T03:32:19.999067+0000 mgr.a (mgr.14388) 3508 : cluster [DBG] pgmap v2430: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:32:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:23 smithi027 bash[22610]: cluster 2024-08-31T03:32:21.999843+0000 mgr.a (mgr.14388) 3509 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:32:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:23 smithi191 bash[24992]: cluster 2024-08-31T03:32:21.999843+0000 mgr.a (mgr.14388) 3509 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:32:23.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:23 smithi163 bash[24253]: cluster 2024-08-31T03:32:21.999843+0000 mgr.a (mgr.14388) 3509 : cluster [DBG] pgmap v2431: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:32:23.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:23.758 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:23.758 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:24.493 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:24.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:24.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:24.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:24.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:25 smithi027 bash[22610]: cluster 2024-08-31T03:32:24.001932+0000 mgr.a (mgr.14388) 3510 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:32:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:25 smithi027 bash[22610]: audit 2024-08-31T03:32:24.088127+0000 mgr.a (mgr.14388) 3511 : audit [DBG] from='client.86970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:25 smithi191 bash[24992]: cluster 2024-08-31T03:32:24.001932+0000 mgr.a (mgr.14388) 3510 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:32:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:25 smithi191 bash[24992]: audit 2024-08-31T03:32:24.088127+0000 mgr.a (mgr.14388) 3511 : audit [DBG] from='client.86970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:25.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:25 smithi163 bash[24253]: cluster 2024-08-31T03:32:24.001932+0000 mgr.a (mgr.14388) 3510 : cluster [DBG] pgmap v2432: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:32:25.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:25 smithi163 bash[24253]: audit 2024-08-31T03:32:24.088127+0000 mgr.a (mgr.14388) 3511 : audit [DBG] from='client.86970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:27 smithi027 bash[22610]: cluster 2024-08-31T03:32:26.002830+0000 mgr.a (mgr.14388) 3512 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:32:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:27 smithi191 bash[24992]: cluster 2024-08-31T03:32:26.002830+0000 mgr.a (mgr.14388) 3512 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:32:27.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:27 smithi163 bash[24253]: cluster 2024-08-31T03:32:26.002830+0000 mgr.a (mgr.14388) 3512 : cluster [DBG] pgmap v2433: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:32:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:29 smithi027 bash[22610]: cluster 2024-08-31T03:32:28.004952+0000 mgr.a (mgr.14388) 3513 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-08-31T03:32:29.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:29.496 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:29.496 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:29 smithi191 bash[24992]: cluster 2024-08-31T03:32:28.004952+0000 mgr.a (mgr.14388) 3513 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-08-31T03:32:29.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:29 smithi163 bash[24253]: cluster 2024-08-31T03:32:28.004952+0000 mgr.a (mgr.14388) 3513 : cluster [DBG] pgmap v2434: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-08-31T03:32:30.273 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:30.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:31 smithi027 bash[22610]: audit 2024-08-31T03:32:29.833794+0000 mgr.a (mgr.14388) 3514 : audit [DBG] from='client.87048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:31 smithi027 bash[22610]: cluster 2024-08-31T03:32:30.005507+0000 mgr.a (mgr.14388) 3515 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T03:32:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:31 smithi191 bash[24992]: audit 2024-08-31T03:32:29.833794+0000 mgr.a (mgr.14388) 3514 : audit [DBG] from='client.87048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:31 smithi191 bash[24992]: cluster 2024-08-31T03:32:30.005507+0000 mgr.a (mgr.14388) 3515 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T03:32:31.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:31 smithi163 bash[24253]: audit 2024-08-31T03:32:29.833794+0000 mgr.a (mgr.14388) 3514 : audit [DBG] from='client.87048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:31.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:31 smithi163 bash[24253]: cluster 2024-08-31T03:32:30.005507+0000 mgr.a (mgr.14388) 3515 : cluster [DBG] pgmap v2435: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T03:32:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:33 smithi027 bash[22610]: cluster 2024-08-31T03:32:32.006387+0000 mgr.a (mgr.14388) 3516 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T03:32:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:33 smithi191 bash[24992]: cluster 2024-08-31T03:32:32.006387+0000 mgr.a (mgr.14388) 3516 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T03:32:33.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:33 smithi163 bash[24253]: cluster 2024-08-31T03:32:32.006387+0000 mgr.a (mgr.14388) 3516 : cluster [DBG] pgmap v2436: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T03:32:35.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:35.275 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:35.275 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:35 smithi191 bash[24992]: cluster 2024-08-31T03:32:34.008602+0000 mgr.a (mgr.14388) 3517 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 65 op/s 2024-08-31T03:32:35.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:35 smithi163 bash[24253]: cluster 2024-08-31T03:32:34.008602+0000 mgr.a (mgr.14388) 3517 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 65 op/s 2024-08-31T03:32:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:35 smithi027 bash[22610]: cluster 2024-08-31T03:32:34.008602+0000 mgr.a (mgr.14388) 3517 : cluster [DBG] pgmap v2437: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 0 B/s wr, 65 op/s 2024-08-31T03:32:36.048 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:36.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:36.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:36.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:36.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:36 smithi191 bash[24992]: audit 2024-08-31T03:32:35.612906+0000 mgr.a (mgr.14388) 3518 : audit [DBG] from='client.87126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:36.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:36 smithi163 bash[24253]: audit 2024-08-31T03:32:35.612906+0000 mgr.a (mgr.14388) 3518 : audit [DBG] from='client.87126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:36 smithi027 bash[22610]: audit 2024-08-31T03:32:35.612906+0000 mgr.a (mgr.14388) 3518 : audit [DBG] from='client.87126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:37 smithi191 bash[24992]: cluster 2024-08-31T03:32:36.009236+0000 mgr.a (mgr.14388) 3519 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-08-31T03:32:37.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:37 smithi163 bash[24253]: cluster 2024-08-31T03:32:36.009236+0000 mgr.a (mgr.14388) 3519 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-08-31T03:32:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:37 smithi027 bash[22610]: cluster 2024-08-31T03:32:36.009236+0000 mgr.a (mgr.14388) 3519 : cluster [DBG] pgmap v2438: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-08-31T03:32:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:39 smithi191 bash[24992]: cluster 2024-08-31T03:32:38.011407+0000 mgr.a (mgr.14388) 3520 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-08-31T03:32:39.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:39 smithi163 bash[24253]: cluster 2024-08-31T03:32:38.011407+0000 mgr.a (mgr.14388) 3520 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-08-31T03:32:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:39 smithi027 bash[22610]: cluster 2024-08-31T03:32:38.011407+0000 mgr.a (mgr.14388) 3520 : cluster [DBG] pgmap v2439: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 59 op/s 2024-08-31T03:32:41.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:41.050 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:41.050 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:41 smithi191 bash[24992]: cluster 2024-08-31T03:32:40.012173+0000 mgr.a (mgr.14388) 3521 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:41.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:41 smithi163 bash[24253]: cluster 2024-08-31T03:32:40.012173+0000 mgr.a (mgr.14388) 3521 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:41 smithi027 bash[22610]: cluster 2024-08-31T03:32:40.012173+0000 mgr.a (mgr.14388) 3521 : cluster [DBG] pgmap v2440: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:41.791 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:41.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:41.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:41.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:41.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:42 smithi191 bash[24992]: audit 2024-08-31T03:32:41.382148+0000 mgr.a (mgr.14388) 3522 : audit [DBG] from='client.87204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:42.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:42 smithi163 bash[24253]: audit 2024-08-31T03:32:41.382148+0000 mgr.a (mgr.14388) 3522 : audit [DBG] from='client.87204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:42 smithi027 bash[22610]: audit 2024-08-31T03:32:41.382148+0000 mgr.a (mgr.14388) 3522 : audit [DBG] from='client.87204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:43 smithi191 bash[24992]: cluster 2024-08-31T03:32:42.013106+0000 mgr.a (mgr.14388) 3523 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:43.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:43 smithi163 bash[24253]: cluster 2024-08-31T03:32:42.013106+0000 mgr.a (mgr.14388) 3523 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:43 smithi027 bash[22610]: cluster 2024-08-31T03:32:42.013106+0000 mgr.a (mgr.14388) 3523 : cluster [DBG] pgmap v2441: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:45 smithi191 bash[24992]: cluster 2024-08-31T03:32:44.015364+0000 mgr.a (mgr.14388) 3524 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:32:45.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:45 smithi163 bash[24253]: cluster 2024-08-31T03:32:44.015364+0000 mgr.a (mgr.14388) 3524 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:32:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:45 smithi027 bash[22610]: cluster 2024-08-31T03:32:44.015364+0000 mgr.a (mgr.14388) 3524 : cluster [DBG] pgmap v2442: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:32:46.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:47 smithi191 bash[24992]: cluster 2024-08-31T03:32:46.016115+0000 mgr.a (mgr.14388) 3525 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:47.540 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:47.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:47.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:47.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:47.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:47.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:47 smithi163 bash[24253]: cluster 2024-08-31T03:32:46.016115+0000 mgr.a (mgr.14388) 3525 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:47 smithi027 bash[22610]: cluster 2024-08-31T03:32:46.016115+0000 mgr.a (mgr.14388) 3525 : cluster [DBG] pgmap v2443: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:48 smithi191 bash[24992]: audit 2024-08-31T03:32:47.124240+0000 mgr.a (mgr.14388) 3526 : audit [DBG] from='client.87282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:48.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:48 smithi163 bash[24253]: audit 2024-08-31T03:32:47.124240+0000 mgr.a (mgr.14388) 3526 : audit [DBG] from='client.87282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:48 smithi027 bash[22610]: audit 2024-08-31T03:32:47.124240+0000 mgr.a (mgr.14388) 3526 : audit [DBG] from='client.87282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:49 smithi191 bash[24992]: cluster 2024-08-31T03:32:48.018455+0000 mgr.a (mgr.14388) 3527 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:32:49.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:49 smithi163 bash[24253]: cluster 2024-08-31T03:32:48.018455+0000 mgr.a (mgr.14388) 3527 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:32:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:49 smithi027 bash[22610]: cluster 2024-08-31T03:32:48.018455+0000 mgr.a (mgr.14388) 3527 : cluster [DBG] pgmap v2444: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:32:51.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:51 smithi163 bash[24253]: cluster 2024-08-31T03:32:50.019262+0000 mgr.a (mgr.14388) 3528 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:51 smithi027 bash[22610]: cluster 2024-08-31T03:32:50.019262+0000 mgr.a (mgr.14388) 3528 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:51 smithi191 bash[24992]: cluster 2024-08-31T03:32:50.019262+0000 mgr.a (mgr.14388) 3528 : cluster [DBG] pgmap v2445: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:52.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:52.543 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:52.543 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:53.293 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:53.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:53.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:53.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:53.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:53.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:53 smithi163 bash[24253]: cluster 2024-08-31T03:32:52.020039+0000 mgr.a (mgr.14388) 3529 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:53 smithi027 bash[22610]: cluster 2024-08-31T03:32:52.020039+0000 mgr.a (mgr.14388) 3529 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:53 smithi191 bash[24992]: cluster 2024-08-31T03:32:52.020039+0000 mgr.a (mgr.14388) 3529 : cluster [DBG] pgmap v2446: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:54.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:54 smithi163 bash[24253]: audit 2024-08-31T03:32:52.874558+0000 mgr.a (mgr.14388) 3530 : audit [DBG] from='client.87357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:54 smithi027 bash[22610]: audit 2024-08-31T03:32:52.874558+0000 mgr.a (mgr.14388) 3530 : audit [DBG] from='client.87357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:54 smithi191 bash[24992]: audit 2024-08-31T03:32:52.874558+0000 mgr.a (mgr.14388) 3530 : audit [DBG] from='client.87357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:55.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:55 smithi163 bash[24253]: cluster 2024-08-31T03:32:54.022641+0000 mgr.a (mgr.14388) 3531 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:55 smithi027 bash[22610]: cluster 2024-08-31T03:32:54.022641+0000 mgr.a (mgr.14388) 3531 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:55 smithi191 bash[24992]: cluster 2024-08-31T03:32:54.022641+0000 mgr.a (mgr.14388) 3531 : cluster [DBG] pgmap v2447: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:57.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:57 smithi163 bash[24253]: cluster 2024-08-31T03:32:56.023472+0000 mgr.a (mgr.14388) 3532 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:32:57.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:57 smithi163 bash[24253]: audit 2024-08-31T03:32:56.969440+0000 mon.a (mon.0) 1117 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:32:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:57 smithi027 bash[22610]: cluster 2024-08-31T03:32:56.023472+0000 mgr.a (mgr.14388) 3532 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:32:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:57 smithi027 bash[22610]: audit 2024-08-31T03:32:56.969440+0000 mon.a (mon.0) 1117 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:32:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:57 smithi191 bash[24992]: cluster 2024-08-31T03:32:56.023472+0000 mgr.a (mgr.14388) 3532 : cluster [DBG] pgmap v2448: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:32:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:57 smithi191 bash[24992]: audit 2024-08-31T03:32:56.969440+0000 mon.a (mon.0) 1117 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:32:58.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:32:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:32:58.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:32:58.563 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:58 smithi027 bash[22610]: audit 2024-08-31T03:32:57.831483+0000 mon.a (mon.0) 1118 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:32:58.563 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:58 smithi027 bash[22610]: audit 2024-08-31T03:32:57.833166+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:32:58.563 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:58 smithi027 bash[22610]: audit 2024-08-31T03:32:57.843536+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:32:58.563 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:58 smithi027 bash[22610]: audit 2024-08-31T03:32:57.847139+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:32:58.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:58 smithi163 bash[24253]: audit 2024-08-31T03:32:57.831483+0000 mon.a (mon.0) 1118 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:32:58.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:58 smithi163 bash[24253]: audit 2024-08-31T03:32:57.833166+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:32:58.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:58 smithi163 bash[24253]: audit 2024-08-31T03:32:57.843536+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:32:58.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:58 smithi163 bash[24253]: audit 2024-08-31T03:32:57.847139+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:32:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:58 smithi191 bash[24992]: audit 2024-08-31T03:32:57.831483+0000 mon.a (mon.0) 1118 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:32:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:58 smithi191 bash[24992]: audit 2024-08-31T03:32:57.833166+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:32:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:58 smithi191 bash[24992]: audit 2024-08-31T03:32:57.843536+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:32:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:58 smithi191 bash[24992]: audit 2024-08-31T03:32:57.847139+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:32:58.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:32:58 smithi027 bash[22863]: debug 2024-08-31T03:32:58.561+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:32:58.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:32:58 smithi027 bash[22863]: debug 2024-08-31T03:32:58.561+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:32:59.018 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:32:59.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:32:59.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:32:59.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:32:59.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:32:59.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:59 smithi163 bash[24253]: audit 2024-08-31T03:32:57.849365+0000 mgr.a (mgr.14388) 3533 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:32:59.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:59 smithi163 bash[24253]: cluster 2024-08-31T03:32:58.025542+0000 mgr.a (mgr.14388) 3534 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:59.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:59 smithi163 bash[24253]: audit 2024-08-31T03:32:58.563550+0000 mgr.a (mgr.14388) 3535 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:32:59.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:59 smithi163 bash[24253]: cephadm 2024-08-31T03:32:58.564714+0000 mgr.a (mgr.14388) 3536 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:32:59.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:32:59 smithi163 bash[24253]: audit 2024-08-31T03:32:58.629980+0000 mgr.a (mgr.14388) 3537 : audit [DBG] from='client.87522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:59 smithi027 bash[22610]: audit 2024-08-31T03:32:57.849365+0000 mgr.a (mgr.14388) 3533 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:32:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:59 smithi027 bash[22610]: cluster 2024-08-31T03:32:58.025542+0000 mgr.a (mgr.14388) 3534 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:59 smithi027 bash[22610]: audit 2024-08-31T03:32:58.563550+0000 mgr.a (mgr.14388) 3535 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:32:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:59 smithi027 bash[22610]: cephadm 2024-08-31T03:32:58.564714+0000 mgr.a (mgr.14388) 3536 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:32:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:32:59 smithi027 bash[22610]: audit 2024-08-31T03:32:58.629980+0000 mgr.a (mgr.14388) 3537 : audit [DBG] from='client.87522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:32:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:59 smithi191 bash[24992]: audit 2024-08-31T03:32:57.849365+0000 mgr.a (mgr.14388) 3533 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:32:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:59 smithi191 bash[24992]: cluster 2024-08-31T03:32:58.025542+0000 mgr.a (mgr.14388) 3534 : cluster [DBG] pgmap v2449: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:32:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:59 smithi191 bash[24992]: audit 2024-08-31T03:32:58.563550+0000 mgr.a (mgr.14388) 3535 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:32:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:59 smithi191 bash[24992]: cephadm 2024-08-31T03:32:58.564714+0000 mgr.a (mgr.14388) 3536 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:32:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:32:59 smithi191 bash[24992]: audit 2024-08-31T03:32:58.629980+0000 mgr.a (mgr.14388) 3537 : audit [DBG] from='client.87522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:01.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:01 smithi163 bash[24253]: cluster 2024-08-31T03:33:00.026531+0000 mgr.a (mgr.14388) 3538 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:33:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:01 smithi027 bash[22610]: cluster 2024-08-31T03:33:00.026531+0000 mgr.a (mgr.14388) 3538 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:33:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:01 smithi191 bash[24992]: cluster 2024-08-31T03:33:00.026531+0000 mgr.a (mgr.14388) 3538 : cluster [DBG] pgmap v2450: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:33:03.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:03 smithi163 bash[24253]: cluster 2024-08-31T03:33:02.027490+0000 mgr.a (mgr.14388) 3539 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:33:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:03 smithi027 bash[22610]: cluster 2024-08-31T03:33:02.027490+0000 mgr.a (mgr.14388) 3539 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:33:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:03 smithi191 bash[24992]: cluster 2024-08-31T03:33:02.027490+0000 mgr.a (mgr.14388) 3539 : cluster [DBG] pgmap v2451: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:33:04.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:33:04.020 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:33:04.020 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:33:04.794 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:33:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:33:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:33:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:33:04.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:33:05.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:05 smithi163 bash[24253]: cluster 2024-08-31T03:33:04.028875+0000 mgr.a (mgr.14388) 3540 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:05.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:05 smithi163 bash[24253]: audit 2024-08-31T03:33:04.357959+0000 mgr.a (mgr.14388) 3541 : audit [DBG] from='client.87618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:05 smithi027 bash[22610]: cluster 2024-08-31T03:33:04.028875+0000 mgr.a (mgr.14388) 3540 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:05 smithi027 bash[22610]: audit 2024-08-31T03:33:04.357959+0000 mgr.a (mgr.14388) 3541 : audit [DBG] from='client.87618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:05 smithi191 bash[24992]: cluster 2024-08-31T03:33:04.028875+0000 mgr.a (mgr.14388) 3540 : cluster [DBG] pgmap v2452: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:05 smithi191 bash[24992]: audit 2024-08-31T03:33:04.357959+0000 mgr.a (mgr.14388) 3541 : audit [DBG] from='client.87618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:07.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:07 smithi163 bash[24253]: cluster 2024-08-31T03:33:06.029892+0000 mgr.a (mgr.14388) 3542 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:07 smithi027 bash[22610]: cluster 2024-08-31T03:33:06.029892+0000 mgr.a (mgr.14388) 3542 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:07 smithi191 bash[24992]: cluster 2024-08-31T03:33:06.029892+0000 mgr.a (mgr.14388) 3542 : cluster [DBG] pgmap v2453: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:09.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:09 smithi163 bash[24253]: cluster 2024-08-31T03:33:08.032206+0000 mgr.a (mgr.14388) 3543 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:09 smithi027 bash[22610]: cluster 2024-08-31T03:33:08.032206+0000 mgr.a (mgr.14388) 3543 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:09 smithi191 bash[24992]: cluster 2024-08-31T03:33:08.032206+0000 mgr.a (mgr.14388) 3543 : cluster [DBG] pgmap v2454: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:09.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:33:09.796 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:33:09.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:33:10.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:33:10.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:33:10.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:33:10.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:33:10.571 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:33:11.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:11 smithi163 bash[24253]: cluster 2024-08-31T03:33:10.032986+0000 mgr.a (mgr.14388) 3544 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:11.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:11 smithi163 bash[24253]: audit 2024-08-31T03:33:10.136603+0000 mgr.a (mgr.14388) 3545 : audit [DBG] from='client.87696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:11 smithi027 bash[22610]: cluster 2024-08-31T03:33:10.032986+0000 mgr.a (mgr.14388) 3544 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:11 smithi027 bash[22610]: audit 2024-08-31T03:33:10.136603+0000 mgr.a (mgr.14388) 3545 : audit [DBG] from='client.87696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:11 smithi191 bash[24992]: cluster 2024-08-31T03:33:10.032986+0000 mgr.a (mgr.14388) 3544 : cluster [DBG] pgmap v2455: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:11 smithi191 bash[24992]: audit 2024-08-31T03:33:10.136603+0000 mgr.a (mgr.14388) 3545 : audit [DBG] from='client.87696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:13.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:13 smithi163 bash[24253]: cluster 2024-08-31T03:33:12.033860+0000 mgr.a (mgr.14388) 3546 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:13 smithi027 bash[22610]: cluster 2024-08-31T03:33:12.033860+0000 mgr.a (mgr.14388) 3546 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:13 smithi191 bash[24992]: cluster 2024-08-31T03:33:12.033860+0000 mgr.a (mgr.14388) 3546 : cluster [DBG] pgmap v2456: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:15.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:33:15.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:33:15.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:33:15.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:15 smithi163 bash[24253]: cluster 2024-08-31T03:33:14.036059+0000 mgr.a (mgr.14388) 3547 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:15 smithi027 bash[22610]: cluster 2024-08-31T03:33:14.036059+0000 mgr.a (mgr.14388) 3547 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:15 smithi191 bash[24992]: cluster 2024-08-31T03:33:14.036059+0000 mgr.a (mgr.14388) 3547 : cluster [DBG] pgmap v2457: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:33:16.312 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:33:16.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:33:16.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:33:16.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:33:16.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:33:17.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:17 smithi163 bash[24253]: audit 2024-08-31T03:33:15.896940+0000 mgr.a (mgr.14388) 3548 : audit [DBG] from='client.87771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:17.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:17 smithi163 bash[24253]: cluster 2024-08-31T03:33:16.036689+0000 mgr.a (mgr.14388) 3549 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:17 smithi027 bash[22610]: audit 2024-08-31T03:33:15.896940+0000 mgr.a (mgr.14388) 3548 : audit [DBG] from='client.87771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:17 smithi027 bash[22610]: cluster 2024-08-31T03:33:16.036689+0000 mgr.a (mgr.14388) 3549 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:17 smithi191 bash[24992]: audit 2024-08-31T03:33:15.896940+0000 mgr.a (mgr.14388) 3548 : audit [DBG] from='client.87771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:17 smithi191 bash[24992]: cluster 2024-08-31T03:33:16.036689+0000 mgr.a (mgr.14388) 3549 : cluster [DBG] pgmap v2458: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:19.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:19 smithi163 bash[24253]: cluster 2024-08-31T03:33:18.038937+0000 mgr.a (mgr.14388) 3550 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:19 smithi027 bash[22610]: cluster 2024-08-31T03:33:18.038937+0000 mgr.a (mgr.14388) 3550 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:19 smithi191 bash[24992]: cluster 2024-08-31T03:33:18.038937+0000 mgr.a (mgr.14388) 3550 : cluster [DBG] pgmap v2459: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:21.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:33:21.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:33:21.315 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:33:21.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:21 smithi163 bash[24253]: cluster 2024-08-31T03:33:20.039719+0000 mgr.a (mgr.14388) 3551 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:21 smithi027 bash[22610]: cluster 2024-08-31T03:33:20.039719+0000 mgr.a (mgr.14388) 3551 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:21 smithi191 bash[24992]: cluster 2024-08-31T03:33:20.039719+0000 mgr.a (mgr.14388) 3551 : cluster [DBG] pgmap v2460: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:22.068 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:33:22.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:33:22.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:33:22.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:33:22.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:33:22.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:22 smithi163 bash[24253]: audit 2024-08-31T03:33:21.653591+0000 mgr.a (mgr.14388) 3552 : audit [DBG] from='client.87849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:22 smithi027 bash[22610]: audit 2024-08-31T03:33:21.653591+0000 mgr.a (mgr.14388) 3552 : audit [DBG] from='client.87849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:22 smithi191 bash[24992]: audit 2024-08-31T03:33:21.653591+0000 mgr.a (mgr.14388) 3552 : audit [DBG] from='client.87849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:23.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:23 smithi163 bash[24253]: cluster 2024-08-31T03:33:22.040239+0000 mgr.a (mgr.14388) 3553 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:23 smithi027 bash[22610]: cluster 2024-08-31T03:33:22.040239+0000 mgr.a (mgr.14388) 3553 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:23 smithi191 bash[24992]: cluster 2024-08-31T03:33:22.040239+0000 mgr.a (mgr.14388) 3553 : cluster [DBG] pgmap v2461: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:25.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:25 smithi163 bash[24253]: cluster 2024-08-31T03:33:24.042398+0000 mgr.a (mgr.14388) 3554 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:25 smithi027 bash[22610]: cluster 2024-08-31T03:33:24.042398+0000 mgr.a (mgr.14388) 3554 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:25 smithi191 bash[24992]: cluster 2024-08-31T03:33:24.042398+0000 mgr.a (mgr.14388) 3554 : cluster [DBG] pgmap v2462: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:27.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:33:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:33:27.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:33:27.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:27 smithi163 bash[24253]: cluster 2024-08-31T03:33:26.043223+0000 mgr.a (mgr.14388) 3555 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:27 smithi027 bash[22610]: cluster 2024-08-31T03:33:26.043223+0000 mgr.a (mgr.14388) 3555 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:27 smithi191 bash[24992]: cluster 2024-08-31T03:33:26.043223+0000 mgr.a (mgr.14388) 3555 : cluster [DBG] pgmap v2463: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:27.816 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:33:27.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:33:27.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:33:27.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:33:27.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:33:28.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:28 smithi163 bash[24253]: audit 2024-08-31T03:33:27.400920+0000 mgr.a (mgr.14388) 3556 : audit [DBG] from='client.87921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:28 smithi027 bash[22610]: audit 2024-08-31T03:33:27.400920+0000 mgr.a (mgr.14388) 3556 : audit [DBG] from='client.87921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:28 smithi191 bash[24992]: audit 2024-08-31T03:33:27.400920+0000 mgr.a (mgr.14388) 3556 : audit [DBG] from='client.87921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:29.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:29 smithi163 bash[24253]: cluster 2024-08-31T03:33:28.045837+0000 mgr.a (mgr.14388) 3557 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:29 smithi027 bash[22610]: cluster 2024-08-31T03:33:28.045837+0000 mgr.a (mgr.14388) 3557 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:29 smithi191 bash[24992]: cluster 2024-08-31T03:33:28.045837+0000 mgr.a (mgr.14388) 3557 : cluster [DBG] pgmap v2464: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:31.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:31 smithi163 bash[24253]: cluster 2024-08-31T03:33:30.046639+0000 mgr.a (mgr.14388) 3558 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:31 smithi027 bash[22610]: cluster 2024-08-31T03:33:30.046639+0000 mgr.a (mgr.14388) 3558 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:31 smithi191 bash[24992]: cluster 2024-08-31T03:33:30.046639+0000 mgr.a (mgr.14388) 3558 : cluster [DBG] pgmap v2465: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:32.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:33:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:33:32.819 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:33:33.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:33:33.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:33:33.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:33:33.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:33:33.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:33:33.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:33 smithi163 bash[24253]: cluster 2024-08-31T03:33:32.047425+0000 mgr.a (mgr.14388) 3559 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:33 smithi027 bash[22610]: cluster 2024-08-31T03:33:32.047425+0000 mgr.a (mgr.14388) 3559 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:33 smithi191 bash[24992]: cluster 2024-08-31T03:33:32.047425+0000 mgr.a (mgr.14388) 3559 : cluster [DBG] pgmap v2466: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:34.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:34 smithi163 bash[24253]: audit 2024-08-31T03:33:33.159475+0000 mgr.a (mgr.14388) 3560 : audit [DBG] from='client.87996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:34 smithi027 bash[22610]: audit 2024-08-31T03:33:33.159475+0000 mgr.a (mgr.14388) 3560 : audit [DBG] from='client.87996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:34 smithi191 bash[24992]: audit 2024-08-31T03:33:33.159475+0000 mgr.a (mgr.14388) 3560 : audit [DBG] from='client.87996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:35.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:35 smithi163 bash[24253]: cluster 2024-08-31T03:33:34.050120+0000 mgr.a (mgr.14388) 3561 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:35 smithi027 bash[22610]: cluster 2024-08-31T03:33:34.050120+0000 mgr.a (mgr.14388) 3561 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:35 smithi191 bash[24992]: cluster 2024-08-31T03:33:34.050120+0000 mgr.a (mgr.14388) 3561 : cluster [DBG] pgmap v2467: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:37 smithi163 bash[24253]: cluster 2024-08-31T03:33:36.051049+0000 mgr.a (mgr.14388) 3562 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:33:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:37 smithi027 bash[22610]: cluster 2024-08-31T03:33:36.051049+0000 mgr.a (mgr.14388) 3562 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:33:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:37 smithi191 bash[24992]: cluster 2024-08-31T03:33:36.051049+0000 mgr.a (mgr.14388) 3562 : cluster [DBG] pgmap v2468: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:33:38.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:33:38.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:33:38.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:33:39.345 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:33:39.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:33:39.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:33:39.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:33:39.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:33:39.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:39 smithi163 bash[24253]: cluster 2024-08-31T03:33:38.053105+0000 mgr.a (mgr.14388) 3563 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:39 smithi027 bash[22610]: cluster 2024-08-31T03:33:38.053105+0000 mgr.a (mgr.14388) 3563 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:39 smithi191 bash[24992]: cluster 2024-08-31T03:33:38.053105+0000 mgr.a (mgr.14388) 3563 : cluster [DBG] pgmap v2469: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:40.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:40 smithi163 bash[24253]: audit 2024-08-31T03:33:38.934121+0000 mgr.a (mgr.14388) 3564 : audit [DBG] from='client.88071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:40 smithi027 bash[22610]: audit 2024-08-31T03:33:38.934121+0000 mgr.a (mgr.14388) 3564 : audit [DBG] from='client.88071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:40 smithi191 bash[24992]: audit 2024-08-31T03:33:38.934121+0000 mgr.a (mgr.14388) 3564 : audit [DBG] from='client.88071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:41.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:41 smithi163 bash[24253]: cluster 2024-08-31T03:33:40.054017+0000 mgr.a (mgr.14388) 3565 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:33:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:41 smithi027 bash[22610]: cluster 2024-08-31T03:33:40.054017+0000 mgr.a (mgr.14388) 3565 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:33:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:41 smithi191 bash[24992]: cluster 2024-08-31T03:33:40.054017+0000 mgr.a (mgr.14388) 3565 : cluster [DBG] pgmap v2470: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:33:43.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:43 smithi163 bash[24253]: cluster 2024-08-31T03:33:42.054781+0000 mgr.a (mgr.14388) 3566 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:33:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:43 smithi027 bash[22610]: cluster 2024-08-31T03:33:42.054781+0000 mgr.a (mgr.14388) 3566 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:33:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:43 smithi191 bash[24992]: cluster 2024-08-31T03:33:42.054781+0000 mgr.a (mgr.14388) 3566 : cluster [DBG] pgmap v2471: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:33:44.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:33:44.348 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:33:44.348 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:33:45.081 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:33:45.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:33:45.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:33:45.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:33:45.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:33:45.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:45 smithi163 bash[24253]: cluster 2024-08-31T03:33:44.056895+0000 mgr.a (mgr.14388) 3567 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:45.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:45 smithi163 bash[24253]: audit 2024-08-31T03:33:44.679720+0000 mgr.a (mgr.14388) 3568 : audit [DBG] from='client.88149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:45 smithi027 bash[22610]: cluster 2024-08-31T03:33:44.056895+0000 mgr.a (mgr.14388) 3567 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:45 smithi027 bash[22610]: audit 2024-08-31T03:33:44.679720+0000 mgr.a (mgr.14388) 3568 : audit [DBG] from='client.88149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:45 smithi191 bash[24992]: cluster 2024-08-31T03:33:44.056895+0000 mgr.a (mgr.14388) 3567 : cluster [DBG] pgmap v2472: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:45 smithi191 bash[24992]: audit 2024-08-31T03:33:44.679720+0000 mgr.a (mgr.14388) 3568 : audit [DBG] from='client.88149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:47 smithi027 bash[22610]: cluster 2024-08-31T03:33:46.057758+0000 mgr.a (mgr.14388) 3569 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:47 smithi191 bash[24992]: cluster 2024-08-31T03:33:46.057758+0000 mgr.a (mgr.14388) 3569 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:47.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:47 smithi163 bash[24253]: cluster 2024-08-31T03:33:46.057758+0000 mgr.a (mgr.14388) 3569 : cluster [DBG] pgmap v2473: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:49 smithi027 bash[22610]: cluster 2024-08-31T03:33:48.059880+0000 mgr.a (mgr.14388) 3570 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:49 smithi191 bash[24992]: cluster 2024-08-31T03:33:48.059880+0000 mgr.a (mgr.14388) 3570 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:49.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:49 smithi163 bash[24253]: cluster 2024-08-31T03:33:48.059880+0000 mgr.a (mgr.14388) 3570 : cluster [DBG] pgmap v2474: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:33:50.084 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:33:50.084 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:33:50.829 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:33:50.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:33:50.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:33:50.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:33:50.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:33:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:51 smithi027 bash[22610]: cluster 2024-08-31T03:33:50.060622+0000 mgr.a (mgr.14388) 3571 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:51 smithi027 bash[22610]: audit 2024-08-31T03:33:50.416439+0000 mgr.a (mgr.14388) 3572 : audit [DBG] from='client.88224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:51 smithi191 bash[24992]: cluster 2024-08-31T03:33:50.060622+0000 mgr.a (mgr.14388) 3571 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:51 smithi191 bash[24992]: audit 2024-08-31T03:33:50.416439+0000 mgr.a (mgr.14388) 3572 : audit [DBG] from='client.88224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:51.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:51 smithi163 bash[24253]: cluster 2024-08-31T03:33:50.060622+0000 mgr.a (mgr.14388) 3571 : cluster [DBG] pgmap v2475: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:51.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:51 smithi163 bash[24253]: audit 2024-08-31T03:33:50.416439+0000 mgr.a (mgr.14388) 3572 : audit [DBG] from='client.88224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:53 smithi027 bash[22610]: cluster 2024-08-31T03:33:52.061482+0000 mgr.a (mgr.14388) 3573 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:53 smithi191 bash[24992]: cluster 2024-08-31T03:33:52.061482+0000 mgr.a (mgr.14388) 3573 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:53.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:53 smithi163 bash[24253]: cluster 2024-08-31T03:33:52.061482+0000 mgr.a (mgr.14388) 3573 : cluster [DBG] pgmap v2476: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:55 smithi027 bash[22610]: cluster 2024-08-31T03:33:54.063699+0000 mgr.a (mgr.14388) 3574 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:55 smithi191 bash[24992]: cluster 2024-08-31T03:33:54.063699+0000 mgr.a (mgr.14388) 3574 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:55.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:33:55.831 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:33:55.831 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:33:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:55 smithi163 bash[24253]: cluster 2024-08-31T03:33:54.063699+0000 mgr.a (mgr.14388) 3574 : cluster [DBG] pgmap v2477: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:56.596 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:33:56.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:33:56.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:33:56.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:33:56.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:33:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:57 smithi027 bash[22610]: cluster 2024-08-31T03:33:56.064435+0000 mgr.a (mgr.14388) 3575 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:57 smithi027 bash[22610]: audit 2024-08-31T03:33:56.166453+0000 mgr.a (mgr.14388) 3576 : audit [DBG] from='client.88302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:57 smithi191 bash[24992]: cluster 2024-08-31T03:33:56.064435+0000 mgr.a (mgr.14388) 3575 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:57 smithi191 bash[24992]: audit 2024-08-31T03:33:56.166453+0000 mgr.a (mgr.14388) 3576 : audit [DBG] from='client.88302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:57.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:57 smithi163 bash[24253]: cluster 2024-08-31T03:33:56.064435+0000 mgr.a (mgr.14388) 3575 : cluster [DBG] pgmap v2478: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:33:57.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:57 smithi163 bash[24253]: audit 2024-08-31T03:33:56.166453+0000 mgr.a (mgr.14388) 3576 : audit [DBG] from='client.88302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:33:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:59 smithi027 bash[22610]: cluster 2024-08-31T03:33:58.066618+0000 mgr.a (mgr.14388) 3577 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:59 smithi027 bash[22610]: audit 2024-08-31T03:33:58.622604+0000 mon.a (mon.0) 1122 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:33:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:59 smithi027 bash[22610]: audit 2024-08-31T03:33:59.456718+0000 mon.a (mon.0) 1123 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:33:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:59 smithi027 bash[22610]: audit 2024-08-31T03:33:59.458468+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:33:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:33:59 smithi027 bash[22610]: audit 2024-08-31T03:33:59.467766+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:33:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:59 smithi191 bash[24992]: cluster 2024-08-31T03:33:58.066618+0000 mgr.a (mgr.14388) 3577 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:59 smithi191 bash[24992]: audit 2024-08-31T03:33:58.622604+0000 mon.a (mon.0) 1122 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:33:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:59 smithi191 bash[24992]: audit 2024-08-31T03:33:59.456718+0000 mon.a (mon.0) 1123 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:33:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:59 smithi191 bash[24992]: audit 2024-08-31T03:33:59.458468+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:33:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:33:59 smithi191 bash[24992]: audit 2024-08-31T03:33:59.467766+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:33:59.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:59 smithi163 bash[24253]: cluster 2024-08-31T03:33:58.066618+0000 mgr.a (mgr.14388) 3577 : cluster [DBG] pgmap v2479: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:33:59.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:59 smithi163 bash[24253]: audit 2024-08-31T03:33:58.622604+0000 mon.a (mon.0) 1122 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:33:59.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:59 smithi163 bash[24253]: audit 2024-08-31T03:33:59.456718+0000 mon.a (mon.0) 1123 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:33:59.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:59 smithi163 bash[24253]: audit 2024-08-31T03:33:59.458468+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:33:59.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:33:59 smithi163 bash[24253]: audit 2024-08-31T03:33:59.467766+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:34:00.480 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:34:00 smithi027 bash[22863]: debug 2024-08-31T03:34:00.195+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:34:00.481 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:34:00 smithi027 bash[22863]: debug 2024-08-31T03:34:00.195+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:34:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:00 smithi027 bash[22610]: audit 2024-08-31T03:33:59.477014+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:34:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:00 smithi027 bash[22610]: audit 2024-08-31T03:33:59.478557+0000 mgr.a (mgr.14388) 3578 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:34:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:00 smithi191 bash[24992]: audit 2024-08-31T03:33:59.477014+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:34:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:00 smithi191 bash[24992]: audit 2024-08-31T03:33:59.478557+0000 mgr.a (mgr.14388) 3578 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:34:00.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:00 smithi163 bash[24253]: audit 2024-08-31T03:33:59.477014+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:34:00.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:00 smithi163 bash[24253]: audit 2024-08-31T03:33:59.478557+0000 mgr.a (mgr.14388) 3578 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:34:01.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:01.599 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:01.599 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:01 smithi191 bash[24992]: cluster 2024-08-31T03:34:00.067146+0000 mgr.a (mgr.14388) 3579 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:01 smithi191 bash[24992]: audit 2024-08-31T03:34:00.201275+0000 mgr.a (mgr.14388) 3580 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:34:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:01 smithi191 bash[24992]: cephadm 2024-08-31T03:34:00.202679+0000 mgr.a (mgr.14388) 3581 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:34:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:01 smithi163 bash[24253]: cluster 2024-08-31T03:34:00.067146+0000 mgr.a (mgr.14388) 3579 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:01 smithi163 bash[24253]: audit 2024-08-31T03:34:00.201275+0000 mgr.a (mgr.14388) 3580 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:34:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:01 smithi163 bash[24253]: cephadm 2024-08-31T03:34:00.202679+0000 mgr.a (mgr.14388) 3581 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:34:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:01 smithi027 bash[22610]: cluster 2024-08-31T03:34:00.067146+0000 mgr.a (mgr.14388) 3579 : cluster [DBG] pgmap v2480: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:01 smithi027 bash[22610]: audit 2024-08-31T03:34:00.201275+0000 mgr.a (mgr.14388) 3580 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:34:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:01 smithi027 bash[22610]: cephadm 2024-08-31T03:34:00.202679+0000 mgr.a (mgr.14388) 3581 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:34:02.358 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:02.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:02.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:02.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:02.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:03 smithi191 bash[24992]: audit 2024-08-31T03:34:01.936514+0000 mgr.a (mgr.14388) 3582 : audit [DBG] from='client.88485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:03 smithi191 bash[24992]: cluster 2024-08-31T03:34:02.067623+0000 mgr.a (mgr.14388) 3583 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:03.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:03 smithi163 bash[24253]: audit 2024-08-31T03:34:01.936514+0000 mgr.a (mgr.14388) 3582 : audit [DBG] from='client.88485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:03.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:03 smithi163 bash[24253]: cluster 2024-08-31T03:34:02.067623+0000 mgr.a (mgr.14388) 3583 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:03 smithi027 bash[22610]: audit 2024-08-31T03:34:01.936514+0000 mgr.a (mgr.14388) 3582 : audit [DBG] from='client.88485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:03 smithi027 bash[22610]: cluster 2024-08-31T03:34:02.067623+0000 mgr.a (mgr.14388) 3583 : cluster [DBG] pgmap v2481: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:05 smithi191 bash[24992]: cluster 2024-08-31T03:34:04.069802+0000 mgr.a (mgr.14388) 3584 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:05.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:05 smithi163 bash[24253]: cluster 2024-08-31T03:34:04.069802+0000 mgr.a (mgr.14388) 3584 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:05 smithi027 bash[22610]: cluster 2024-08-31T03:34:04.069802+0000 mgr.a (mgr.14388) 3584 : cluster [DBG] pgmap v2482: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:07.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:07.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:07.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:07 smithi191 bash[24992]: cluster 2024-08-31T03:34:06.070547+0000 mgr.a (mgr.14388) 3585 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:07.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:07 smithi163 bash[24253]: cluster 2024-08-31T03:34:06.070547+0000 mgr.a (mgr.14388) 3585 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:07 smithi027 bash[22610]: cluster 2024-08-31T03:34:06.070547+0000 mgr.a (mgr.14388) 3585 : cluster [DBG] pgmap v2483: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:08.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:08.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:08 smithi191 bash[24992]: audit 2024-08-31T03:34:07.686076+0000 mgr.a (mgr.14388) 3586 : audit [DBG] from='client.88563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:08.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:08 smithi163 bash[24253]: audit 2024-08-31T03:34:07.686076+0000 mgr.a (mgr.14388) 3586 : audit [DBG] from='client.88563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:08 smithi027 bash[22610]: audit 2024-08-31T03:34:07.686076+0000 mgr.a (mgr.14388) 3586 : audit [DBG] from='client.88563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:09 smithi191 bash[24992]: cluster 2024-08-31T03:34:08.072041+0000 mgr.a (mgr.14388) 3587 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:09.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:09 smithi163 bash[24253]: cluster 2024-08-31T03:34:08.072041+0000 mgr.a (mgr.14388) 3587 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:09 smithi027 bash[22610]: cluster 2024-08-31T03:34:08.072041+0000 mgr.a (mgr.14388) 3587 : cluster [DBG] pgmap v2484: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:11 smithi191 bash[24992]: cluster 2024-08-31T03:34:10.072768+0000 mgr.a (mgr.14388) 3588 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:34:11.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:11 smithi163 bash[24253]: cluster 2024-08-31T03:34:10.072768+0000 mgr.a (mgr.14388) 3588 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:34:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:11 smithi027 bash[22610]: cluster 2024-08-31T03:34:10.072768+0000 mgr.a (mgr.14388) 3588 : cluster [DBG] pgmap v2485: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:34:13.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:13.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:13.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:13 smithi191 bash[24992]: cluster 2024-08-31T03:34:12.073648+0000 mgr.a (mgr.14388) 3589 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:34:13.864 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:13.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:13.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:13.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:13 smithi163 bash[24253]: cluster 2024-08-31T03:34:12.073648+0000 mgr.a (mgr.14388) 3589 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:34:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:13 smithi027 bash[22610]: cluster 2024-08-31T03:34:12.073648+0000 mgr.a (mgr.14388) 3589 : cluster [DBG] pgmap v2486: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:34:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:14 smithi191 bash[24992]: audit 2024-08-31T03:34:13.435132+0000 mgr.a (mgr.14388) 3590 : audit [DBG] from='client.88641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:14.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:14 smithi163 bash[24253]: audit 2024-08-31T03:34:13.435132+0000 mgr.a (mgr.14388) 3590 : audit [DBG] from='client.88641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:14 smithi027 bash[22610]: audit 2024-08-31T03:34:13.435132+0000 mgr.a (mgr.14388) 3590 : audit [DBG] from='client.88641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:15 smithi191 bash[24992]: cluster 2024-08-31T03:34:14.076281+0000 mgr.a (mgr.14388) 3591 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:15.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:15 smithi163 bash[24253]: cluster 2024-08-31T03:34:14.076281+0000 mgr.a (mgr.14388) 3591 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:15 smithi027 bash[22610]: cluster 2024-08-31T03:34:14.076281+0000 mgr.a (mgr.14388) 3591 : cluster [DBG] pgmap v2487: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:34:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:17 smithi191 bash[24992]: cluster 2024-08-31T03:34:16.077048+0000 mgr.a (mgr.14388) 3592 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:17.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:17 smithi163 bash[24253]: cluster 2024-08-31T03:34:16.077048+0000 mgr.a (mgr.14388) 3592 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:17 smithi027 bash[22610]: cluster 2024-08-31T03:34:16.077048+0000 mgr.a (mgr.14388) 3592 : cluster [DBG] pgmap v2488: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:18.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:18.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:18.867 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:19.603 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:19.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:19.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:19.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:19.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:19 smithi191 bash[24992]: cluster 2024-08-31T03:34:18.078963+0000 mgr.a (mgr.14388) 3593 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:19.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:19 smithi163 bash[24253]: cluster 2024-08-31T03:34:18.078963+0000 mgr.a (mgr.14388) 3593 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:19 smithi027 bash[22610]: cluster 2024-08-31T03:34:18.078963+0000 mgr.a (mgr.14388) 3593 : cluster [DBG] pgmap v2489: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:20.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:20 smithi163 bash[24253]: audit 2024-08-31T03:34:19.199439+0000 mgr.a (mgr.14388) 3594 : audit [DBG] from='client.88719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:20 smithi027 bash[22610]: audit 2024-08-31T03:34:19.199439+0000 mgr.a (mgr.14388) 3594 : audit [DBG] from='client.88719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:20 smithi191 bash[24992]: audit 2024-08-31T03:34:19.199439+0000 mgr.a (mgr.14388) 3594 : audit [DBG] from='client.88719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:21.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:21 smithi163 bash[24253]: cluster 2024-08-31T03:34:20.079814+0000 mgr.a (mgr.14388) 3595 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:21 smithi027 bash[22610]: cluster 2024-08-31T03:34:20.079814+0000 mgr.a (mgr.14388) 3595 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:21 smithi191 bash[24992]: cluster 2024-08-31T03:34:20.079814+0000 mgr.a (mgr.14388) 3595 : cluster [DBG] pgmap v2490: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:23.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:23 smithi163 bash[24253]: cluster 2024-08-31T03:34:22.080600+0000 mgr.a (mgr.14388) 3596 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:23 smithi027 bash[22610]: cluster 2024-08-31T03:34:22.080600+0000 mgr.a (mgr.14388) 3596 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:23 smithi191 bash[24992]: cluster 2024-08-31T03:34:22.080600+0000 mgr.a (mgr.14388) 3596 : cluster [DBG] pgmap v2491: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:24.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:24.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:24.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:25.345 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:25.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:25.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:25.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:25.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:25.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:25 smithi163 bash[24253]: cluster 2024-08-31T03:34:24.082829+0000 mgr.a (mgr.14388) 3597 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:25 smithi027 bash[22610]: cluster 2024-08-31T03:34:24.082829+0000 mgr.a (mgr.14388) 3597 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:25 smithi191 bash[24992]: cluster 2024-08-31T03:34:24.082829+0000 mgr.a (mgr.14388) 3597 : cluster [DBG] pgmap v2492: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:26.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:26 smithi163 bash[24253]: audit 2024-08-31T03:34:24.938193+0000 mgr.a (mgr.14388) 3598 : audit [DBG] from='client.88794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:26 smithi027 bash[22610]: audit 2024-08-31T03:34:24.938193+0000 mgr.a (mgr.14388) 3598 : audit [DBG] from='client.88794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:26 smithi191 bash[24992]: audit 2024-08-31T03:34:24.938193+0000 mgr.a (mgr.14388) 3598 : audit [DBG] from='client.88794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:27.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:27 smithi163 bash[24253]: cluster 2024-08-31T03:34:26.083760+0000 mgr.a (mgr.14388) 3599 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:27 smithi027 bash[22610]: cluster 2024-08-31T03:34:26.083760+0000 mgr.a (mgr.14388) 3599 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:27 smithi191 bash[24992]: cluster 2024-08-31T03:34:26.083760+0000 mgr.a (mgr.14388) 3599 : cluster [DBG] pgmap v2493: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:29.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:29 smithi163 bash[24253]: cluster 2024-08-31T03:34:28.085889+0000 mgr.a (mgr.14388) 3600 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:29 smithi027 bash[22610]: cluster 2024-08-31T03:34:28.085889+0000 mgr.a (mgr.14388) 3600 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:29 smithi191 bash[24992]: cluster 2024-08-31T03:34:28.085889+0000 mgr.a (mgr.14388) 3600 : cluster [DBG] pgmap v2494: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:30.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:30.347 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:30.348 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:31.120 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:31.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:31.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:31.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:31.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:31.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:31 smithi163 bash[24253]: cluster 2024-08-31T03:34:30.086657+0000 mgr.a (mgr.14388) 3601 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:31.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:31 smithi163 bash[24253]: audit 2024-08-31T03:34:30.686682+0000 mgr.a (mgr.14388) 3602 : audit [DBG] from='client.88872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:31.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:31 smithi027 bash[22610]: cluster 2024-08-31T03:34:30.086657+0000 mgr.a (mgr.14388) 3601 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:31.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:31 smithi027 bash[22610]: audit 2024-08-31T03:34:30.686682+0000 mgr.a (mgr.14388) 3602 : audit [DBG] from='client.88872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:31 smithi191 bash[24992]: cluster 2024-08-31T03:34:30.086657+0000 mgr.a (mgr.14388) 3601 : cluster [DBG] pgmap v2495: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:31 smithi191 bash[24992]: audit 2024-08-31T03:34:30.686682+0000 mgr.a (mgr.14388) 3602 : audit [DBG] from='client.88872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:33.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:33 smithi163 bash[24253]: cluster 2024-08-31T03:34:32.087617+0000 mgr.a (mgr.14388) 3603 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:33 smithi027 bash[22610]: cluster 2024-08-31T03:34:32.087617+0000 mgr.a (mgr.14388) 3603 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:33 smithi191 bash[24992]: cluster 2024-08-31T03:34:32.087617+0000 mgr.a (mgr.14388) 3603 : cluster [DBG] pgmap v2496: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:35.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:35 smithi163 bash[24253]: cluster 2024-08-31T03:34:34.089817+0000 mgr.a (mgr.14388) 3604 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:35 smithi027 bash[22610]: cluster 2024-08-31T03:34:34.089817+0000 mgr.a (mgr.14388) 3604 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:35 smithi191 bash[24992]: cluster 2024-08-31T03:34:34.089817+0000 mgr.a (mgr.14388) 3604 : cluster [DBG] pgmap v2497: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:36.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:36.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:36.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:36.868 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:36.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:36.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:36.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:36.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:37.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:37 smithi163 bash[24253]: cluster 2024-08-31T03:34:36.090592+0000 mgr.a (mgr.14388) 3605 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:37.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:37 smithi163 bash[24253]: audit 2024-08-31T03:34:36.451954+0000 mgr.a (mgr.14388) 3606 : audit [DBG] from='client.88950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:37 smithi027 bash[22610]: cluster 2024-08-31T03:34:36.090592+0000 mgr.a (mgr.14388) 3605 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:37 smithi027 bash[22610]: audit 2024-08-31T03:34:36.451954+0000 mgr.a (mgr.14388) 3606 : audit [DBG] from='client.88950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:37 smithi191 bash[24992]: cluster 2024-08-31T03:34:36.090592+0000 mgr.a (mgr.14388) 3605 : cluster [DBG] pgmap v2498: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:37 smithi191 bash[24992]: audit 2024-08-31T03:34:36.451954+0000 mgr.a (mgr.14388) 3606 : audit [DBG] from='client.88950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:39.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:39 smithi163 bash[24253]: cluster 2024-08-31T03:34:38.092864+0000 mgr.a (mgr.14388) 3607 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:39 smithi027 bash[22610]: cluster 2024-08-31T03:34:38.092864+0000 mgr.a (mgr.14388) 3607 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:39 smithi191 bash[24992]: cluster 2024-08-31T03:34:38.092864+0000 mgr.a (mgr.14388) 3607 : cluster [DBG] pgmap v2499: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:41.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:41.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:41.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:41.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:41 smithi163 bash[24253]: cluster 2024-08-31T03:34:40.093681+0000 mgr.a (mgr.14388) 3608 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:41 smithi027 bash[22610]: cluster 2024-08-31T03:34:40.093681+0000 mgr.a (mgr.14388) 3608 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:41 smithi191 bash[24992]: cluster 2024-08-31T03:34:40.093681+0000 mgr.a (mgr.14388) 3608 : cluster [DBG] pgmap v2500: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:42.648 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:42.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:42.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:42.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:42.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:43.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:43 smithi163 bash[24253]: cluster 2024-08-31T03:34:42.094476+0000 mgr.a (mgr.14388) 3609 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:43.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:43 smithi163 bash[24253]: audit 2024-08-31T03:34:42.207072+0000 mgr.a (mgr.14388) 3610 : audit [DBG] from='client.89028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:43 smithi027 bash[22610]: cluster 2024-08-31T03:34:42.094476+0000 mgr.a (mgr.14388) 3609 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:43 smithi027 bash[22610]: audit 2024-08-31T03:34:42.207072+0000 mgr.a (mgr.14388) 3610 : audit [DBG] from='client.89028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:43 smithi191 bash[24992]: cluster 2024-08-31T03:34:42.094476+0000 mgr.a (mgr.14388) 3609 : cluster [DBG] pgmap v2501: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:43 smithi191 bash[24992]: audit 2024-08-31T03:34:42.207072+0000 mgr.a (mgr.14388) 3610 : audit [DBG] from='client.89028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:45.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:45 smithi163 bash[24253]: cluster 2024-08-31T03:34:44.096842+0000 mgr.a (mgr.14388) 3611 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:45 smithi027 bash[22610]: cluster 2024-08-31T03:34:44.096842+0000 mgr.a (mgr.14388) 3611 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:45 smithi191 bash[24992]: cluster 2024-08-31T03:34:44.096842+0000 mgr.a (mgr.14388) 3611 : cluster [DBG] pgmap v2502: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:34:47.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:47.650 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:47.650 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:47.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:47 smithi163 bash[24253]: cluster 2024-08-31T03:34:46.097662+0000 mgr.a (mgr.14388) 3612 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:47 smithi027 bash[22610]: cluster 2024-08-31T03:34:46.097662+0000 mgr.a (mgr.14388) 3612 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:47 smithi191 bash[24992]: cluster 2024-08-31T03:34:46.097662+0000 mgr.a (mgr.14388) 3612 : cluster [DBG] pgmap v2503: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:48.385 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:48.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:48.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:48.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:48.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:49.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:49 smithi163 bash[24253]: audit 2024-08-31T03:34:47.980497+0000 mgr.a (mgr.14388) 3613 : audit [DBG] from='client.89106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:49.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:49 smithi163 bash[24253]: cluster 2024-08-31T03:34:48.107339+0000 mgr.a (mgr.14388) 3614 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:49 smithi027 bash[22610]: audit 2024-08-31T03:34:47.980497+0000 mgr.a (mgr.14388) 3613 : audit [DBG] from='client.89106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:49 smithi027 bash[22610]: cluster 2024-08-31T03:34:48.107339+0000 mgr.a (mgr.14388) 3614 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:49 smithi191 bash[24992]: audit 2024-08-31T03:34:47.980497+0000 mgr.a (mgr.14388) 3613 : audit [DBG] from='client.89106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:49 smithi191 bash[24992]: cluster 2024-08-31T03:34:48.107339+0000 mgr.a (mgr.14388) 3614 : cluster [DBG] pgmap v2504: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:51.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:51 smithi163 bash[24253]: cluster 2024-08-31T03:34:50.108198+0000 mgr.a (mgr.14388) 3615 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:51 smithi027 bash[22610]: cluster 2024-08-31T03:34:50.108198+0000 mgr.a (mgr.14388) 3615 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:51 smithi191 bash[24992]: cluster 2024-08-31T03:34:50.108198+0000 mgr.a (mgr.14388) 3615 : cluster [DBG] pgmap v2505: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:53.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:53.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:53.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:53.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:53 smithi163 bash[24253]: cluster 2024-08-31T03:34:52.108979+0000 mgr.a (mgr.14388) 3616 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:53 smithi027 bash[22610]: cluster 2024-08-31T03:34:52.108979+0000 mgr.a (mgr.14388) 3616 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:53 smithi191 bash[24992]: cluster 2024-08-31T03:34:52.108979+0000 mgr.a (mgr.14388) 3616 : cluster [DBG] pgmap v2506: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:54.141 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:54.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:54.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:54.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:54.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:54.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:54 smithi163 bash[24253]: audit 2024-08-31T03:34:53.717845+0000 mgr.a (mgr.14388) 3617 : audit [DBG] from='client.89184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:54 smithi027 bash[22610]: audit 2024-08-31T03:34:53.717845+0000 mgr.a (mgr.14388) 3617 : audit [DBG] from='client.89184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:54 smithi191 bash[24992]: audit 2024-08-31T03:34:53.717845+0000 mgr.a (mgr.14388) 3617 : audit [DBG] from='client.89184 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:34:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:55 smithi163 bash[24253]: cluster 2024-08-31T03:34:54.110322+0000 mgr.a (mgr.14388) 3618 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:55 smithi027 bash[22610]: cluster 2024-08-31T03:34:54.110322+0000 mgr.a (mgr.14388) 3618 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:55 smithi191 bash[24992]: cluster 2024-08-31T03:34:54.110322+0000 mgr.a (mgr.14388) 3618 : cluster [DBG] pgmap v2507: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:57.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:57 smithi163 bash[24253]: cluster 2024-08-31T03:34:56.111065+0000 mgr.a (mgr.14388) 3619 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:57 smithi027 bash[22610]: cluster 2024-08-31T03:34:56.111065+0000 mgr.a (mgr.14388) 3619 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:57 smithi191 bash[24992]: cluster 2024-08-31T03:34:56.111065+0000 mgr.a (mgr.14388) 3619 : cluster [DBG] pgmap v2508: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:34:59.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:34:59.143 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:34:59.143 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:34:59.920 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:34:59.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:34:59.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:34:59.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:34:59.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:34:59.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:34:59 smithi163 bash[24253]: cluster 2024-08-31T03:34:58.112885+0000 mgr.a (mgr.14388) 3620 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:34:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:34:59 smithi027 bash[22610]: cluster 2024-08-31T03:34:58.112885+0000 mgr.a (mgr.14388) 3620 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:34:59 smithi191 bash[24992]: cluster 2024-08-31T03:34:58.112885+0000 mgr.a (mgr.14388) 3620 : cluster [DBG] pgmap v2509: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:00.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:00 smithi163 bash[24253]: audit 2024-08-31T03:34:59.480429+0000 mgr.a (mgr.14388) 3621 : audit [DBG] from='client.89259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:00.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:00 smithi163 bash[24253]: audit 2024-08-31T03:35:00.262035+0000 mon.a (mon.0) 1127 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:35:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:00 smithi027 bash[22610]: audit 2024-08-31T03:34:59.480429+0000 mgr.a (mgr.14388) 3621 : audit [DBG] from='client.89259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:00 smithi027 bash[22610]: audit 2024-08-31T03:35:00.262035+0000 mon.a (mon.0) 1127 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:35:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:00 smithi191 bash[24992]: audit 2024-08-31T03:34:59.480429+0000 mgr.a (mgr.14388) 3621 : audit [DBG] from='client.89259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:00 smithi191 bash[24992]: audit 2024-08-31T03:35:00.262035+0000 mon.a (mon.0) 1127 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:35:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:01 smithi191 bash[24992]: cluster 2024-08-31T03:35:00.113825+0000 mgr.a (mgr.14388) 3622 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:01 smithi191 bash[24992]: audit 2024-08-31T03:35:01.094399+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:35:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:01 smithi191 bash[24992]: audit 2024-08-31T03:35:01.096088+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:35:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:01 smithi191 bash[24992]: audit 2024-08-31T03:35:01.106632+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:35:01.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:01 smithi191 bash[24992]: audit 2024-08-31T03:35:01.111761+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:35:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:01 smithi163 bash[24253]: cluster 2024-08-31T03:35:00.113825+0000 mgr.a (mgr.14388) 3622 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:01 smithi163 bash[24253]: audit 2024-08-31T03:35:01.094399+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:35:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:01 smithi163 bash[24253]: audit 2024-08-31T03:35:01.096088+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:35:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:01 smithi163 bash[24253]: audit 2024-08-31T03:35:01.106632+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:35:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:01 smithi163 bash[24253]: audit 2024-08-31T03:35:01.111761+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:35:01.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:35:01 smithi027 bash[22863]: debug 2024-08-31T03:35:01.826+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:35:01.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:35:01 smithi027 bash[22863]: debug 2024-08-31T03:35:01.830+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:35:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:01 smithi027 bash[22610]: cluster 2024-08-31T03:35:00.113825+0000 mgr.a (mgr.14388) 3622 : cluster [DBG] pgmap v2510: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:01 smithi027 bash[22610]: audit 2024-08-31T03:35:01.094399+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:35:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:01 smithi027 bash[22610]: audit 2024-08-31T03:35:01.096088+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:35:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:01 smithi027 bash[22610]: audit 2024-08-31T03:35:01.106632+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:35:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:01 smithi027 bash[22610]: audit 2024-08-31T03:35:01.111761+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:35:02.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:02 smithi163 bash[24253]: audit 2024-08-31T03:35:01.114085+0000 mgr.a (mgr.14388) 3623 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:35:02.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:02 smithi163 bash[24253]: audit 2024-08-31T03:35:01.830691+0000 mgr.a (mgr.14388) 3624 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:35:02.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:02 smithi163 bash[24253]: cephadm 2024-08-31T03:35:01.832124+0000 mgr.a (mgr.14388) 3625 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:35:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:02 smithi027 bash[22610]: audit 2024-08-31T03:35:01.114085+0000 mgr.a (mgr.14388) 3623 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:35:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:02 smithi027 bash[22610]: audit 2024-08-31T03:35:01.830691+0000 mgr.a (mgr.14388) 3624 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:35:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:02 smithi027 bash[22610]: cephadm 2024-08-31T03:35:01.832124+0000 mgr.a (mgr.14388) 3625 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:35:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:02 smithi191 bash[24992]: audit 2024-08-31T03:35:01.114085+0000 mgr.a (mgr.14388) 3623 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:35:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:02 smithi191 bash[24992]: audit 2024-08-31T03:35:01.830691+0000 mgr.a (mgr.14388) 3624 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:35:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:02 smithi191 bash[24992]: cephadm 2024-08-31T03:35:01.832124+0000 mgr.a (mgr.14388) 3625 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:35:03.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:03 smithi163 bash[24253]: cluster 2024-08-31T03:35:02.114903+0000 mgr.a (mgr.14388) 3626 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:03 smithi027 bash[22610]: cluster 2024-08-31T03:35:02.114903+0000 mgr.a (mgr.14388) 3626 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:03 smithi191 bash[24992]: cluster 2024-08-31T03:35:02.114903+0000 mgr.a (mgr.14388) 3626 : cluster [DBG] pgmap v2511: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:04.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:35:04.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:35:04.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:35:05.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:35:05.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:35:05.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:35:05.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:35:05.669 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:35:05.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:05 smithi163 bash[24253]: cluster 2024-08-31T03:35:04.117129+0000 mgr.a (mgr.14388) 3627 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:05 smithi027 bash[22610]: cluster 2024-08-31T03:35:04.117129+0000 mgr.a (mgr.14388) 3627 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:05 smithi191 bash[24992]: cluster 2024-08-31T03:35:04.117129+0000 mgr.a (mgr.14388) 3627 : cluster [DBG] pgmap v2512: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:06.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:06 smithi163 bash[24253]: audit 2024-08-31T03:35:05.252969+0000 mgr.a (mgr.14388) 3628 : audit [DBG] from='client.89445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:06 smithi027 bash[22610]: audit 2024-08-31T03:35:05.252969+0000 mgr.a (mgr.14388) 3628 : audit [DBG] from='client.89445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:07.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:06 smithi191 bash[24992]: audit 2024-08-31T03:35:05.252969+0000 mgr.a (mgr.14388) 3628 : audit [DBG] from='client.89445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:07.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:07 smithi163 bash[24253]: cluster 2024-08-31T03:35:06.118209+0000 mgr.a (mgr.14388) 3629 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:07 smithi027 bash[22610]: cluster 2024-08-31T03:35:06.118209+0000 mgr.a (mgr.14388) 3629 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:07 smithi191 bash[24992]: cluster 2024-08-31T03:35:06.118209+0000 mgr.a (mgr.14388) 3629 : cluster [DBG] pgmap v2513: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:09.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:09 smithi163 bash[24253]: cluster 2024-08-31T03:35:08.120389+0000 mgr.a (mgr.14388) 3630 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:09 smithi027 bash[22610]: cluster 2024-08-31T03:35:08.120389+0000 mgr.a (mgr.14388) 3630 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:09 smithi191 bash[24992]: cluster 2024-08-31T03:35:08.120389+0000 mgr.a (mgr.14388) 3630 : cluster [DBG] pgmap v2514: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:10.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:35:10.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:35:10.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:35:11.440 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:35:11.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:35:11.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:35:11.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:35:11.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:35:11.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:11 smithi163 bash[24253]: cluster 2024-08-31T03:35:10.121298+0000 mgr.a (mgr.14388) 3631 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:11 smithi027 bash[22610]: cluster 2024-08-31T03:35:10.121298+0000 mgr.a (mgr.14388) 3631 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:11 smithi191 bash[24992]: cluster 2024-08-31T03:35:10.121298+0000 mgr.a (mgr.14388) 3631 : cluster [DBG] pgmap v2515: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:12 smithi027 bash[22610]: audit 2024-08-31T03:35:11.005457+0000 mgr.a (mgr.14388) 3632 : audit [DBG] from='client.89523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:12 smithi191 bash[24992]: audit 2024-08-31T03:35:11.005457+0000 mgr.a (mgr.14388) 3632 : audit [DBG] from='client.89523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:13.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:12 smithi163 bash[24253]: audit 2024-08-31T03:35:11.005457+0000 mgr.a (mgr.14388) 3632 : audit [DBG] from='client.89523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:13 smithi027 bash[22610]: cluster 2024-08-31T03:35:12.122269+0000 mgr.a (mgr.14388) 3633 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:13 smithi191 bash[24992]: cluster 2024-08-31T03:35:12.122269+0000 mgr.a (mgr.14388) 3633 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:14.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:13 smithi163 bash[24253]: cluster 2024-08-31T03:35:12.122269+0000 mgr.a (mgr.14388) 3633 : cluster [DBG] pgmap v2516: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:15 smithi027 bash[22610]: cluster 2024-08-31T03:35:14.124471+0000 mgr.a (mgr.14388) 3634 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:15 smithi191 bash[24992]: cluster 2024-08-31T03:35:14.124471+0000 mgr.a (mgr.14388) 3634 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:16.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:15 smithi163 bash[24253]: cluster 2024-08-31T03:35:14.124471+0000 mgr.a (mgr.14388) 3634 : cluster [DBG] pgmap v2517: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:35:16.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:35:16.443 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:35:16.443 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:35:17.218 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:35:17.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:35:17.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:35:17.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:35:17.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:35:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:17 smithi027 bash[22610]: cluster 2024-08-31T03:35:16.125246+0000 mgr.a (mgr.14388) 3635 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:17 smithi027 bash[22610]: audit 2024-08-31T03:35:16.780981+0000 mgr.a (mgr.14388) 3636 : audit [DBG] from='client.89601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:17 smithi191 bash[24992]: cluster 2024-08-31T03:35:16.125246+0000 mgr.a (mgr.14388) 3635 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:17 smithi191 bash[24992]: audit 2024-08-31T03:35:16.780981+0000 mgr.a (mgr.14388) 3636 : audit [DBG] from='client.89601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:18.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:17 smithi163 bash[24253]: cluster 2024-08-31T03:35:16.125246+0000 mgr.a (mgr.14388) 3635 : cluster [DBG] pgmap v2518: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:18.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:17 smithi163 bash[24253]: audit 2024-08-31T03:35:16.780981+0000 mgr.a (mgr.14388) 3636 : audit [DBG] from='client.89601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:19 smithi027 bash[22610]: cluster 2024-08-31T03:35:18.127528+0000 mgr.a (mgr.14388) 3637 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:19 smithi191 bash[24992]: cluster 2024-08-31T03:35:18.127528+0000 mgr.a (mgr.14388) 3637 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:20.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:19 smithi163 bash[24253]: cluster 2024-08-31T03:35:18.127528+0000 mgr.a (mgr.14388) 3637 : cluster [DBG] pgmap v2519: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:21 smithi027 bash[22610]: cluster 2024-08-31T03:35:20.128302+0000 mgr.a (mgr.14388) 3638 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:21 smithi191 bash[24992]: cluster 2024-08-31T03:35:20.128302+0000 mgr.a (mgr.14388) 3638 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:22.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:21 smithi163 bash[24253]: cluster 2024-08-31T03:35:20.128302+0000 mgr.a (mgr.14388) 3638 : cluster [DBG] pgmap v2520: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:22.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:35:22.221 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:35:22.221 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:35:22.988 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:35:22.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:35:22.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:35:22.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:35:22.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:35:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:23 smithi027 bash[22610]: cluster 2024-08-31T03:35:22.129082+0000 mgr.a (mgr.14388) 3639 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:23 smithi027 bash[22610]: audit 2024-08-31T03:35:22.560576+0000 mgr.a (mgr.14388) 3640 : audit [DBG] from='client.89679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:23 smithi191 bash[24992]: cluster 2024-08-31T03:35:22.129082+0000 mgr.a (mgr.14388) 3639 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:23 smithi191 bash[24992]: audit 2024-08-31T03:35:22.560576+0000 mgr.a (mgr.14388) 3640 : audit [DBG] from='client.89679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:24.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:23 smithi163 bash[24253]: cluster 2024-08-31T03:35:22.129082+0000 mgr.a (mgr.14388) 3639 : cluster [DBG] pgmap v2521: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:24.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:23 smithi163 bash[24253]: audit 2024-08-31T03:35:22.560576+0000 mgr.a (mgr.14388) 3640 : audit [DBG] from='client.89679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:25 smithi027 bash[22610]: cluster 2024-08-31T03:35:24.131838+0000 mgr.a (mgr.14388) 3641 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:35:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:25 smithi191 bash[24992]: cluster 2024-08-31T03:35:24.131838+0000 mgr.a (mgr.14388) 3641 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:35:26.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:25 smithi163 bash[24253]: cluster 2024-08-31T03:35:24.131838+0000 mgr.a (mgr.14388) 3641 : cluster [DBG] pgmap v2522: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:35:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:27 smithi027 bash[22610]: cluster 2024-08-31T03:35:26.132630+0000 mgr.a (mgr.14388) 3642 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:35:27.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:35:27.990 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:35:27.990 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:35:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:27 smithi191 bash[24992]: cluster 2024-08-31T03:35:26.132630+0000 mgr.a (mgr.14388) 3642 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:35:28.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:27 smithi163 bash[24253]: cluster 2024-08-31T03:35:26.132630+0000 mgr.a (mgr.14388) 3642 : cluster [DBG] pgmap v2523: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:35:28.736 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:35:28.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:35:28.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:35:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:35:28.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:35:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:29 smithi027 bash[22610]: cluster 2024-08-31T03:35:28.133595+0000 mgr.a (mgr.14388) 3643 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:29 smithi027 bash[22610]: audit 2024-08-31T03:35:28.319361+0000 mgr.a (mgr.14388) 3644 : audit [DBG] from='client.89757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:29 smithi191 bash[24992]: cluster 2024-08-31T03:35:28.133595+0000 mgr.a (mgr.14388) 3643 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:29 smithi191 bash[24992]: audit 2024-08-31T03:35:28.319361+0000 mgr.a (mgr.14388) 3644 : audit [DBG] from='client.89757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:30.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:29 smithi163 bash[24253]: cluster 2024-08-31T03:35:28.133595+0000 mgr.a (mgr.14388) 3643 : cluster [DBG] pgmap v2524: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:30.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:29 smithi163 bash[24253]: audit 2024-08-31T03:35:28.319361+0000 mgr.a (mgr.14388) 3644 : audit [DBG] from='client.89757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:31 smithi191 bash[24992]: cluster 2024-08-31T03:35:30.134439+0000 mgr.a (mgr.14388) 3645 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:35:32.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:31 smithi163 bash[24253]: cluster 2024-08-31T03:35:30.134439+0000 mgr.a (mgr.14388) 3645 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:35:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:31 smithi027 bash[22610]: cluster 2024-08-31T03:35:30.134439+0000 mgr.a (mgr.14388) 3645 : cluster [DBG] pgmap v2525: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:35:33.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:35:33.738 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:35:33.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:35:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:33 smithi191 bash[24992]: cluster 2024-08-31T03:35:32.135238+0000 mgr.a (mgr.14388) 3646 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:35:34.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:33 smithi163 bash[24253]: cluster 2024-08-31T03:35:32.135238+0000 mgr.a (mgr.14388) 3646 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:35:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:33 smithi027 bash[22610]: cluster 2024-08-31T03:35:32.135238+0000 mgr.a (mgr.14388) 3646 : cluster [DBG] pgmap v2526: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:35:34.478 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:35:34.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:35:34.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:35:34.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:35:34.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:35:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:35 smithi191 bash[24992]: audit 2024-08-31T03:35:34.067970+0000 mgr.a (mgr.14388) 3647 : audit [DBG] from='client.89835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:35 smithi191 bash[24992]: cluster 2024-08-31T03:35:34.136688+0000 mgr.a (mgr.14388) 3648 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:36.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:35 smithi163 bash[24253]: audit 2024-08-31T03:35:34.067970+0000 mgr.a (mgr.14388) 3647 : audit [DBG] from='client.89835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:36.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:35 smithi163 bash[24253]: cluster 2024-08-31T03:35:34.136688+0000 mgr.a (mgr.14388) 3648 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:35 smithi027 bash[22610]: audit 2024-08-31T03:35:34.067970+0000 mgr.a (mgr.14388) 3647 : audit [DBG] from='client.89835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:35 smithi027 bash[22610]: cluster 2024-08-31T03:35:34.136688+0000 mgr.a (mgr.14388) 3648 : cluster [DBG] pgmap v2527: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:37 smithi191 bash[24992]: cluster 2024-08-31T03:35:36.137487+0000 mgr.a (mgr.14388) 3649 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:35:38.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:37 smithi163 bash[24253]: cluster 2024-08-31T03:35:36.137487+0000 mgr.a (mgr.14388) 3649 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:35:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:37 smithi027 bash[22610]: cluster 2024-08-31T03:35:36.137487+0000 mgr.a (mgr.14388) 3649 : cluster [DBG] pgmap v2528: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:35:39.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:35:39.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:35:39.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:35:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:39 smithi191 bash[24992]: cluster 2024-08-31T03:35:38.139617+0000 mgr.a (mgr.14388) 3650 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:35:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:39 smithi163 bash[24253]: cluster 2024-08-31T03:35:38.139617+0000 mgr.a (mgr.14388) 3650 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:35:40.216 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:35:40.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:35:40.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:35:40.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:35:40.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:35:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:39 smithi027 bash[22610]: cluster 2024-08-31T03:35:38.139617+0000 mgr.a (mgr.14388) 3650 : cluster [DBG] pgmap v2529: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:35:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:40 smithi191 bash[24992]: audit 2024-08-31T03:35:39.814038+0000 mgr.a (mgr.14388) 3651 : audit [DBG] from='client.89913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:41.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:40 smithi163 bash[24253]: audit 2024-08-31T03:35:39.814038+0000 mgr.a (mgr.14388) 3651 : audit [DBG] from='client.89913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:40 smithi027 bash[22610]: audit 2024-08-31T03:35:39.814038+0000 mgr.a (mgr.14388) 3651 : audit [DBG] from='client.89913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:41 smithi191 bash[24992]: cluster 2024-08-31T03:35:40.140157+0000 mgr.a (mgr.14388) 3652 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:42.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:41 smithi163 bash[24253]: cluster 2024-08-31T03:35:40.140157+0000 mgr.a (mgr.14388) 3652 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:41 smithi027 bash[22610]: cluster 2024-08-31T03:35:40.140157+0000 mgr.a (mgr.14388) 3652 : cluster [DBG] pgmap v2530: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:43 smithi191 bash[24992]: cluster 2024-08-31T03:35:42.141031+0000 mgr.a (mgr.14388) 3653 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:44.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:43 smithi163 bash[24253]: cluster 2024-08-31T03:35:42.141031+0000 mgr.a (mgr.14388) 3653 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:43 smithi027 bash[22610]: cluster 2024-08-31T03:35:42.141031+0000 mgr.a (mgr.14388) 3653 : cluster [DBG] pgmap v2531: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:45.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:35:45.218 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:35:45.219 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:35:46.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:35:46.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:35:46.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:35:46.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:35:46.003 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:35:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:45 smithi191 bash[24992]: cluster 2024-08-31T03:35:44.143429+0000 mgr.a (mgr.14388) 3654 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:45 smithi163 bash[24253]: cluster 2024-08-31T03:35:44.143429+0000 mgr.a (mgr.14388) 3654 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:45 smithi027 bash[22610]: cluster 2024-08-31T03:35:44.143429+0000 mgr.a (mgr.14388) 3654 : cluster [DBG] pgmap v2532: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:46 smithi191 bash[24992]: audit 2024-08-31T03:35:45.557555+0000 mgr.a (mgr.14388) 3655 : audit [DBG] from='client.89991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:47.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:46 smithi163 bash[24253]: audit 2024-08-31T03:35:45.557555+0000 mgr.a (mgr.14388) 3655 : audit [DBG] from='client.89991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:46 smithi027 bash[22610]: audit 2024-08-31T03:35:45.557555+0000 mgr.a (mgr.14388) 3655 : audit [DBG] from='client.89991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:47 smithi191 bash[24992]: cluster 2024-08-31T03:35:46.144376+0000 mgr.a (mgr.14388) 3656 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:48.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:47 smithi163 bash[24253]: cluster 2024-08-31T03:35:46.144376+0000 mgr.a (mgr.14388) 3656 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:47 smithi027 bash[22610]: cluster 2024-08-31T03:35:46.144376+0000 mgr.a (mgr.14388) 3656 : cluster [DBG] pgmap v2533: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:49 smithi191 bash[24992]: cluster 2024-08-31T03:35:48.146504+0000 mgr.a (mgr.14388) 3657 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:50.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:49 smithi163 bash[24253]: cluster 2024-08-31T03:35:48.146504+0000 mgr.a (mgr.14388) 3657 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:49 smithi027 bash[22610]: cluster 2024-08-31T03:35:48.146504+0000 mgr.a (mgr.14388) 3657 : cluster [DBG] pgmap v2534: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:51.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:35:51.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:35:51.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:35:51.755 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:35:51.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:35:51.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:35:51.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:35:51.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:35:52.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:51 smithi163 bash[24253]: cluster 2024-08-31T03:35:50.147279+0000 mgr.a (mgr.14388) 3658 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:51 smithi027 bash[22610]: cluster 2024-08-31T03:35:50.147279+0000 mgr.a (mgr.14388) 3658 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:51 smithi191 bash[24992]: cluster 2024-08-31T03:35:50.147279+0000 mgr.a (mgr.14388) 3658 : cluster [DBG] pgmap v2535: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:53.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:52 smithi163 bash[24253]: audit 2024-08-31T03:35:51.335785+0000 mgr.a (mgr.14388) 3659 : audit [DBG] from='client.90069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:52 smithi027 bash[22610]: audit 2024-08-31T03:35:51.335785+0000 mgr.a (mgr.14388) 3659 : audit [DBG] from='client.90069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:52 smithi191 bash[24992]: audit 2024-08-31T03:35:51.335785+0000 mgr.a (mgr.14388) 3659 : audit [DBG] from='client.90069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:54.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:53 smithi163 bash[24253]: cluster 2024-08-31T03:35:52.148187+0000 mgr.a (mgr.14388) 3660 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:53 smithi027 bash[22610]: cluster 2024-08-31T03:35:52.148187+0000 mgr.a (mgr.14388) 3660 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:53 smithi191 bash[24992]: cluster 2024-08-31T03:35:52.148187+0000 mgr.a (mgr.14388) 3660 : cluster [DBG] pgmap v2536: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:56.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:55 smithi163 bash[24253]: cluster 2024-08-31T03:35:54.150373+0000 mgr.a (mgr.14388) 3661 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:55 smithi027 bash[22610]: cluster 2024-08-31T03:35:54.150373+0000 mgr.a (mgr.14388) 3661 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:55 smithi191 bash[24992]: cluster 2024-08-31T03:35:54.150373+0000 mgr.a (mgr.14388) 3661 : cluster [DBG] pgmap v2537: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:35:56.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:35:56.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:35:56.758 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:35:57.500 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:35:57.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:35:57.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:35:57.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:35:57.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:35:58.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:57 smithi163 bash[24253]: cluster 2024-08-31T03:35:56.151183+0000 mgr.a (mgr.14388) 3662 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:57 smithi027 bash[22610]: cluster 2024-08-31T03:35:56.151183+0000 mgr.a (mgr.14388) 3662 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:57 smithi191 bash[24992]: cluster 2024-08-31T03:35:56.151183+0000 mgr.a (mgr.14388) 3662 : cluster [DBG] pgmap v2538: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:35:59.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:58 smithi163 bash[24253]: audit 2024-08-31T03:35:57.087891+0000 mgr.a (mgr.14388) 3663 : audit [DBG] from='client.90144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:58 smithi027 bash[22610]: audit 2024-08-31T03:35:57.087891+0000 mgr.a (mgr.14388) 3663 : audit [DBG] from='client.90144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:35:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:58 smithi191 bash[24992]: audit 2024-08-31T03:35:57.087891+0000 mgr.a (mgr.14388) 3663 : audit [DBG] from='client.90144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:00.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:35:59 smithi163 bash[24253]: cluster 2024-08-31T03:35:58.153450+0000 mgr.a (mgr.14388) 3664 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:35:59 smithi027 bash[22610]: cluster 2024-08-31T03:35:58.153450+0000 mgr.a (mgr.14388) 3664 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:35:59 smithi191 bash[24992]: cluster 2024-08-31T03:35:58.153450+0000 mgr.a (mgr.14388) 3664 : cluster [DBG] pgmap v2539: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:02.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:01 smithi163 bash[24253]: cluster 2024-08-31T03:36:00.154224+0000 mgr.a (mgr.14388) 3665 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:02.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:01 smithi027 bash[22610]: cluster 2024-08-31T03:36:00.154224+0000 mgr.a (mgr.14388) 3665 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:01 smithi191 bash[24992]: cluster 2024-08-31T03:36:00.154224+0000 mgr.a (mgr.14388) 3665 : cluster [DBG] pgmap v2540: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:02.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:36:02.501 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:36:02.501 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:36:03.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:02 smithi163 bash[24253]: audit 2024-08-31T03:36:01.887384+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:36:03.202 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:36:03.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:36:03.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:36:03.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:36:03.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:36:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:02 smithi027 bash[22610]: audit 2024-08-31T03:36:01.887384+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:36:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:02 smithi191 bash[24992]: audit 2024-08-31T03:36:01.887384+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:36:04.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:03 smithi163 bash[24253]: cluster 2024-08-31T03:36:02.154966+0000 mgr.a (mgr.14388) 3666 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:04.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:03 smithi163 bash[24253]: audit 2024-08-31T03:36:02.804820+0000 mgr.a (mgr.14388) 3667 : audit [DBG] from='client.90219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:03 smithi027 bash[22610]: cluster 2024-08-31T03:36:02.154966+0000 mgr.a (mgr.14388) 3666 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:03 smithi027 bash[22610]: audit 2024-08-31T03:36:02.804820+0000 mgr.a (mgr.14388) 3667 : audit [DBG] from='client.90219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:03 smithi191 bash[24992]: cluster 2024-08-31T03:36:02.154966+0000 mgr.a (mgr.14388) 3666 : cluster [DBG] pgmap v2541: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:03 smithi191 bash[24992]: audit 2024-08-31T03:36:02.804820+0000 mgr.a (mgr.14388) 3667 : audit [DBG] from='client.90219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:06.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:05 smithi163 bash[24253]: cluster 2024-08-31T03:36:04.157584+0000 mgr.a (mgr.14388) 3668 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:05 smithi027 bash[22610]: cluster 2024-08-31T03:36:04.157584+0000 mgr.a (mgr.14388) 3668 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:05 smithi191 bash[24992]: cluster 2024-08-31T03:36:04.157584+0000 mgr.a (mgr.14388) 3668 : cluster [DBG] pgmap v2542: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:08.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:07 smithi163 bash[24253]: cluster 2024-08-31T03:36:06.158374+0000 mgr.a (mgr.14388) 3669 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:08.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:07 smithi163 bash[24253]: audit 2024-08-31T03:36:07.231564+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:07 smithi163 bash[24253]: audit 2024-08-31T03:36:07.235874+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:07 smithi163 bash[24253]: audit 2024-08-31T03:36:07.259251+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:07 smithi163 bash[24253]: audit 2024-08-31T03:36:07.270873+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:07 smithi163 bash[24253]: audit 2024-08-31T03:36:07.276133+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:07 smithi163 bash[24253]: audit 2024-08-31T03:36:07.282118+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:36:08.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:36:08.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:36:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:07 smithi027 bash[22610]: cluster 2024-08-31T03:36:06.158374+0000 mgr.a (mgr.14388) 3669 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:07 smithi027 bash[22610]: audit 2024-08-31T03:36:07.231564+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:07 smithi027 bash[22610]: audit 2024-08-31T03:36:07.235874+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:07 smithi027 bash[22610]: audit 2024-08-31T03:36:07.259251+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:07 smithi027 bash[22610]: audit 2024-08-31T03:36:07.270873+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:07 smithi027 bash[22610]: audit 2024-08-31T03:36:07.276133+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:07 smithi027 bash[22610]: audit 2024-08-31T03:36:07.282118+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:07 smithi191 bash[24992]: cluster 2024-08-31T03:36:06.158374+0000 mgr.a (mgr.14388) 3669 : cluster [DBG] pgmap v2543: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:07 smithi191 bash[24992]: audit 2024-08-31T03:36:07.231564+0000 mon.a (mon.0) 1133 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:07 smithi191 bash[24992]: audit 2024-08-31T03:36:07.235874+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:07 smithi191 bash[24992]: audit 2024-08-31T03:36:07.259251+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:07 smithi191 bash[24992]: audit 2024-08-31T03:36:07.270873+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:07 smithi191 bash[24992]: audit 2024-08-31T03:36:07.276133+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:07 smithi191 bash[24992]: audit 2024-08-31T03:36:07.282118+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:09.134 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:36:09.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:36:09.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:36:09.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:36:09.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:36:09.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:08 smithi163 bash[24253]: audit 2024-08-31T03:36:07.982223+0000 mon.a (mon.0) 1139 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:36:09.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:08 smithi163 bash[24253]: audit 2024-08-31T03:36:07.984013+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:36:09.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:08 smithi163 bash[24253]: audit 2024-08-31T03:36:07.995486+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:09.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:08 smithi163 bash[24253]: audit 2024-08-31T03:36:08.000431+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:36:09.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:36:08 smithi027 bash[22863]: debug 2024-08-31T03:36:08.740+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:36:09.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:36:08 smithi027 bash[22863]: debug 2024-08-31T03:36:08.748+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:36:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:08 smithi027 bash[22610]: audit 2024-08-31T03:36:07.982223+0000 mon.a (mon.0) 1139 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:36:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:08 smithi027 bash[22610]: audit 2024-08-31T03:36:07.984013+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:36:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:08 smithi027 bash[22610]: audit 2024-08-31T03:36:07.995486+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:08 smithi027 bash[22610]: audit 2024-08-31T03:36:08.000431+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:36:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:08 smithi191 bash[24992]: audit 2024-08-31T03:36:07.982223+0000 mon.a (mon.0) 1139 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:36:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:08 smithi191 bash[24992]: audit 2024-08-31T03:36:07.984013+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:36:09.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:08 smithi191 bash[24992]: audit 2024-08-31T03:36:07.995486+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:36:09.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:08 smithi191 bash[24992]: audit 2024-08-31T03:36:08.000431+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:36:10.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:09 smithi163 bash[24253]: audit 2024-08-31T03:36:08.002667+0000 mgr.a (mgr.14388) 3670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:36:10.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:09 smithi163 bash[24253]: cluster 2024-08-31T03:36:08.159770+0000 mgr.a (mgr.14388) 3671 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:10.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:09 smithi163 bash[24253]: audit 2024-08-31T03:36:08.539562+0000 mgr.a (mgr.14388) 3672 : audit [DBG] from='client.90336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:10.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:09 smithi163 bash[24253]: audit 2024-08-31T03:36:08.742794+0000 mgr.a (mgr.14388) 3673 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:36:10.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:09 smithi163 bash[24253]: cephadm 2024-08-31T03:36:08.752869+0000 mgr.a (mgr.14388) 3674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:36:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:09 smithi027 bash[22610]: audit 2024-08-31T03:36:08.002667+0000 mgr.a (mgr.14388) 3670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:36:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:09 smithi027 bash[22610]: cluster 2024-08-31T03:36:08.159770+0000 mgr.a (mgr.14388) 3671 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:09 smithi027 bash[22610]: audit 2024-08-31T03:36:08.539562+0000 mgr.a (mgr.14388) 3672 : audit [DBG] from='client.90336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:09 smithi027 bash[22610]: audit 2024-08-31T03:36:08.742794+0000 mgr.a (mgr.14388) 3673 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:36:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:09 smithi027 bash[22610]: cephadm 2024-08-31T03:36:08.752869+0000 mgr.a (mgr.14388) 3674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:36:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:09 smithi191 bash[24992]: audit 2024-08-31T03:36:08.002667+0000 mgr.a (mgr.14388) 3670 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:36:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:09 smithi191 bash[24992]: cluster 2024-08-31T03:36:08.159770+0000 mgr.a (mgr.14388) 3671 : cluster [DBG] pgmap v2544: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:09 smithi191 bash[24992]: audit 2024-08-31T03:36:08.539562+0000 mgr.a (mgr.14388) 3672 : audit [DBG] from='client.90336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:09 smithi191 bash[24992]: audit 2024-08-31T03:36:08.742794+0000 mgr.a (mgr.14388) 3673 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:36:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:09 smithi191 bash[24992]: cephadm 2024-08-31T03:36:08.752869+0000 mgr.a (mgr.14388) 3674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:36:12.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:11 smithi163 bash[24253]: cluster 2024-08-31T03:36:10.160752+0000 mgr.a (mgr.14388) 3675 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:11 smithi027 bash[22610]: cluster 2024-08-31T03:36:10.160752+0000 mgr.a (mgr.14388) 3675 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:12.292 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:11 smithi191 bash[24992]: cluster 2024-08-31T03:36:10.160752+0000 mgr.a (mgr.14388) 3675 : cluster [DBG] pgmap v2545: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:14.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:36:14.136 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:36:14.136 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:36:14.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:13 smithi163 bash[24253]: cluster 2024-08-31T03:36:12.161579+0000 mgr.a (mgr.14388) 3676 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:36:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:13 smithi027 bash[22610]: cluster 2024-08-31T03:36:12.161579+0000 mgr.a (mgr.14388) 3676 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:36:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:13 smithi191 bash[24992]: cluster 2024-08-31T03:36:12.161579+0000 mgr.a (mgr.14388) 3676 : cluster [DBG] pgmap v2546: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:36:14.907 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:36:14.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:36:14.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:36:14.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:36:14.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:36:15.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:14 smithi163 bash[24253]: cluster 2024-08-31T03:36:14.163903+0000 mgr.a (mgr.14388) 3677 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:15.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:14 smithi163 bash[24253]: audit 2024-08-31T03:36:14.474788+0000 mgr.a (mgr.14388) 3678 : audit [DBG] from='client.90483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:14 smithi027 bash[22610]: cluster 2024-08-31T03:36:14.163903+0000 mgr.a (mgr.14388) 3677 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:14 smithi027 bash[22610]: audit 2024-08-31T03:36:14.474788+0000 mgr.a (mgr.14388) 3678 : audit [DBG] from='client.90483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:14 smithi191 bash[24992]: cluster 2024-08-31T03:36:14.163903+0000 mgr.a (mgr.14388) 3677 : cluster [DBG] pgmap v2547: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:14 smithi191 bash[24992]: audit 2024-08-31T03:36:14.474788+0000 mgr.a (mgr.14388) 3678 : audit [DBG] from='client.90483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:17 smithi027 bash[22610]: cluster 2024-08-31T03:36:16.164814+0000 mgr.a (mgr.14388) 3679 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:17 smithi191 bash[24992]: cluster 2024-08-31T03:36:16.164814+0000 mgr.a (mgr.14388) 3679 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:17.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:17 smithi163 bash[24253]: cluster 2024-08-31T03:36:16.164814+0000 mgr.a (mgr.14388) 3679 : cluster [DBG] pgmap v2548: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:19 smithi027 bash[22610]: cluster 2024-08-31T03:36:18.166979+0000 mgr.a (mgr.14388) 3680 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:19 smithi191 bash[24992]: cluster 2024-08-31T03:36:18.166979+0000 mgr.a (mgr.14388) 3680 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:19.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:19 smithi163 bash[24253]: cluster 2024-08-31T03:36:18.166979+0000 mgr.a (mgr.14388) 3680 : cluster [DBG] pgmap v2549: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:19.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:36:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:36:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:36:20.661 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:36:20.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:36:20.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:36:20.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:36:20.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:36:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:21 smithi027 bash[22610]: cluster 2024-08-31T03:36:20.167488+0000 mgr.a (mgr.14388) 3681 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:21 smithi027 bash[22610]: audit 2024-08-31T03:36:20.242025+0000 mgr.a (mgr.14388) 3682 : audit [DBG] from='client.90558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:21 smithi191 bash[24992]: cluster 2024-08-31T03:36:20.167488+0000 mgr.a (mgr.14388) 3681 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:21 smithi191 bash[24992]: audit 2024-08-31T03:36:20.242025+0000 mgr.a (mgr.14388) 3682 : audit [DBG] from='client.90558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:21.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:21 smithi163 bash[24253]: cluster 2024-08-31T03:36:20.167488+0000 mgr.a (mgr.14388) 3681 : cluster [DBG] pgmap v2550: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:21.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:21 smithi163 bash[24253]: audit 2024-08-31T03:36:20.242025+0000 mgr.a (mgr.14388) 3682 : audit [DBG] from='client.90558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:23 smithi191 bash[24992]: cluster 2024-08-31T03:36:22.168458+0000 mgr.a (mgr.14388) 3683 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:23.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:23 smithi163 bash[24253]: cluster 2024-08-31T03:36:22.168458+0000 mgr.a (mgr.14388) 3683 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:23 smithi027 bash[22610]: cluster 2024-08-31T03:36:22.168458+0000 mgr.a (mgr.14388) 3683 : cluster [DBG] pgmap v2551: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:25 smithi191 bash[24992]: cluster 2024-08-31T03:36:24.170816+0000 mgr.a (mgr.14388) 3684 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:36:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:36:25.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:36:25.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:25 smithi163 bash[24253]: cluster 2024-08-31T03:36:24.170816+0000 mgr.a (mgr.14388) 3684 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:25 smithi027 bash[22610]: cluster 2024-08-31T03:36:24.170816+0000 mgr.a (mgr.14388) 3684 : cluster [DBG] pgmap v2552: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:36:26.406 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:36:26.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:36:26.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:36:26.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:36:26.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:36:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:27 smithi191 bash[24992]: audit 2024-08-31T03:36:25.991824+0000 mgr.a (mgr.14388) 3685 : audit [DBG] from='client.90636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:27 smithi191 bash[24992]: cluster 2024-08-31T03:36:26.171362+0000 mgr.a (mgr.14388) 3686 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:27.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:27 smithi163 bash[24253]: audit 2024-08-31T03:36:25.991824+0000 mgr.a (mgr.14388) 3685 : audit [DBG] from='client.90636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:27.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:27 smithi163 bash[24253]: cluster 2024-08-31T03:36:26.171362+0000 mgr.a (mgr.14388) 3686 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:27 smithi027 bash[22610]: audit 2024-08-31T03:36:25.991824+0000 mgr.a (mgr.14388) 3685 : audit [DBG] from='client.90636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:27 smithi027 bash[22610]: cluster 2024-08-31T03:36:26.171362+0000 mgr.a (mgr.14388) 3686 : cluster [DBG] pgmap v2553: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:29 smithi191 bash[24992]: cluster 2024-08-31T03:36:28.173655+0000 mgr.a (mgr.14388) 3687 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:29.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:29 smithi163 bash[24253]: cluster 2024-08-31T03:36:28.173655+0000 mgr.a (mgr.14388) 3687 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:29 smithi027 bash[22610]: cluster 2024-08-31T03:36:28.173655+0000 mgr.a (mgr.14388) 3687 : cluster [DBG] pgmap v2554: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:31.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:36:31.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:36:31.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:36:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:31 smithi191 bash[24992]: cluster 2024-08-31T03:36:30.174609+0000 mgr.a (mgr.14388) 3688 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:31.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:31 smithi163 bash[24253]: cluster 2024-08-31T03:36:30.174609+0000 mgr.a (mgr.14388) 3688 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:31 smithi027 bash[22610]: cluster 2024-08-31T03:36:30.174609+0000 mgr.a (mgr.14388) 3688 : cluster [DBG] pgmap v2555: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:32.145 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:36:32.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:36:32.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:36:32.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:36:32.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:36:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:32 smithi191 bash[24992]: audit 2024-08-31T03:36:31.736717+0000 mgr.a (mgr.14388) 3689 : audit [DBG] from='client.90714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:32.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:32 smithi163 bash[24253]: audit 2024-08-31T03:36:31.736717+0000 mgr.a (mgr.14388) 3689 : audit [DBG] from='client.90714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:32 smithi027 bash[22610]: audit 2024-08-31T03:36:31.736717+0000 mgr.a (mgr.14388) 3689 : audit [DBG] from='client.90714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:33 smithi191 bash[24992]: cluster 2024-08-31T03:36:32.175163+0000 mgr.a (mgr.14388) 3690 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:33.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:33 smithi163 bash[24253]: cluster 2024-08-31T03:36:32.175163+0000 mgr.a (mgr.14388) 3690 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:33 smithi027 bash[22610]: cluster 2024-08-31T03:36:32.175163+0000 mgr.a (mgr.14388) 3690 : cluster [DBG] pgmap v2556: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:35 smithi191 bash[24992]: cluster 2024-08-31T03:36:34.177329+0000 mgr.a (mgr.14388) 3691 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:35.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:35 smithi163 bash[24253]: cluster 2024-08-31T03:36:34.177329+0000 mgr.a (mgr.14388) 3691 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:35 smithi027 bash[22610]: cluster 2024-08-31T03:36:34.177329+0000 mgr.a (mgr.14388) 3691 : cluster [DBG] pgmap v2557: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:37.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:36:37.147 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:36:37.148 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:36:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:37 smithi191 bash[24992]: cluster 2024-08-31T03:36:36.178096+0000 mgr.a (mgr.14388) 3692 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:37.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:37 smithi163 bash[24253]: cluster 2024-08-31T03:36:36.178096+0000 mgr.a (mgr.14388) 3692 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:37 smithi027 bash[22610]: cluster 2024-08-31T03:36:36.178096+0000 mgr.a (mgr.14388) 3692 : cluster [DBG] pgmap v2558: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:37.872 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:36:37.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:36:37.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:36:37.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:36:37.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:36:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:38 smithi191 bash[24992]: audit 2024-08-31T03:36:37.473525+0000 mgr.a (mgr.14388) 3693 : audit [DBG] from='client.90792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:38.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:38 smithi163 bash[24253]: audit 2024-08-31T03:36:37.473525+0000 mgr.a (mgr.14388) 3693 : audit [DBG] from='client.90792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:38 smithi027 bash[22610]: audit 2024-08-31T03:36:37.473525+0000 mgr.a (mgr.14388) 3693 : audit [DBG] from='client.90792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:39 smithi191 bash[24992]: cluster 2024-08-31T03:36:38.180337+0000 mgr.a (mgr.14388) 3694 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:39.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:39 smithi163 bash[24253]: cluster 2024-08-31T03:36:38.180337+0000 mgr.a (mgr.14388) 3694 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:39 smithi027 bash[22610]: cluster 2024-08-31T03:36:38.180337+0000 mgr.a (mgr.14388) 3694 : cluster [DBG] pgmap v2559: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:41 smithi191 bash[24992]: cluster 2024-08-31T03:36:40.181103+0000 mgr.a (mgr.14388) 3695 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:41.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:41 smithi163 bash[24253]: cluster 2024-08-31T03:36:40.181103+0000 mgr.a (mgr.14388) 3695 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:41 smithi027 bash[22610]: cluster 2024-08-31T03:36:40.181103+0000 mgr.a (mgr.14388) 3695 : cluster [DBG] pgmap v2560: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:42.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:36:42.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:36:42.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:36:43.646 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:36:43.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:36:43.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:36:43.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:36:43.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:36:43.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:43 smithi163 bash[24253]: cluster 2024-08-31T03:36:42.181876+0000 mgr.a (mgr.14388) 3696 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:43 smithi027 bash[22610]: cluster 2024-08-31T03:36:42.181876+0000 mgr.a (mgr.14388) 3696 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:43 smithi191 bash[24992]: cluster 2024-08-31T03:36:42.181876+0000 mgr.a (mgr.14388) 3696 : cluster [DBG] pgmap v2561: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:44.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:44 smithi163 bash[24253]: audit 2024-08-31T03:36:43.212736+0000 mgr.a (mgr.14388) 3697 : audit [DBG] from='client.90870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:44 smithi027 bash[22610]: audit 2024-08-31T03:36:43.212736+0000 mgr.a (mgr.14388) 3697 : audit [DBG] from='client.90870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:44 smithi191 bash[24992]: audit 2024-08-31T03:36:43.212736+0000 mgr.a (mgr.14388) 3697 : audit [DBG] from='client.90870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:45.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:45 smithi163 bash[24253]: cluster 2024-08-31T03:36:44.184554+0000 mgr.a (mgr.14388) 3698 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:45 smithi027 bash[22610]: cluster 2024-08-31T03:36:44.184554+0000 mgr.a (mgr.14388) 3698 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:45 smithi191 bash[24992]: cluster 2024-08-31T03:36:44.184554+0000 mgr.a (mgr.14388) 3698 : cluster [DBG] pgmap v2562: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:47.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:47 smithi163 bash[24253]: cluster 2024-08-31T03:36:46.185310+0000 mgr.a (mgr.14388) 3699 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:47 smithi027 bash[22610]: cluster 2024-08-31T03:36:46.185310+0000 mgr.a (mgr.14388) 3699 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:47 smithi191 bash[24992]: cluster 2024-08-31T03:36:46.185310+0000 mgr.a (mgr.14388) 3699 : cluster [DBG] pgmap v2563: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:48.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:36:48.648 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:36:48.648 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:36:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:36:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:36:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:36:49.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:36:49.385 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:36:49.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:49 smithi163 bash[24253]: cluster 2024-08-31T03:36:48.187224+0000 mgr.a (mgr.14388) 3700 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:49 smithi027 bash[22610]: cluster 2024-08-31T03:36:48.187224+0000 mgr.a (mgr.14388) 3700 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:49 smithi191 bash[24992]: cluster 2024-08-31T03:36:48.187224+0000 mgr.a (mgr.14388) 3700 : cluster [DBG] pgmap v2564: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:50.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:50 smithi163 bash[24253]: audit 2024-08-31T03:36:48.978077+0000 mgr.a (mgr.14388) 3701 : audit [DBG] from='client.90948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:50 smithi027 bash[22610]: audit 2024-08-31T03:36:48.978077+0000 mgr.a (mgr.14388) 3701 : audit [DBG] from='client.90948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:50 smithi191 bash[24992]: audit 2024-08-31T03:36:48.978077+0000 mgr.a (mgr.14388) 3701 : audit [DBG] from='client.90948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:51.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:51 smithi163 bash[24253]: cluster 2024-08-31T03:36:50.188184+0000 mgr.a (mgr.14388) 3702 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:51 smithi027 bash[22610]: cluster 2024-08-31T03:36:50.188184+0000 mgr.a (mgr.14388) 3702 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:51 smithi191 bash[24992]: cluster 2024-08-31T03:36:50.188184+0000 mgr.a (mgr.14388) 3702 : cluster [DBG] pgmap v2565: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:36:53.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:53 smithi163 bash[24253]: cluster 2024-08-31T03:36:52.189105+0000 mgr.a (mgr.14388) 3703 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:36:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:53 smithi027 bash[22610]: cluster 2024-08-31T03:36:52.189105+0000 mgr.a (mgr.14388) 3703 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:36:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:53 smithi191 bash[24992]: cluster 2024-08-31T03:36:52.189105+0000 mgr.a (mgr.14388) 3703 : cluster [DBG] pgmap v2566: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:36:54.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:36:54.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:36:54.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:36:55.134 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:36:55.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:36:55.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:36:55.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:36:55.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:36:55.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:55 smithi163 bash[24253]: cluster 2024-08-31T03:36:54.191504+0000 mgr.a (mgr.14388) 3704 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:55.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:55 smithi163 bash[24253]: audit 2024-08-31T03:36:54.722061+0000 mgr.a (mgr.14388) 3705 : audit [DBG] from='client.91023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:55 smithi027 bash[22610]: cluster 2024-08-31T03:36:54.191504+0000 mgr.a (mgr.14388) 3704 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:55 smithi027 bash[22610]: audit 2024-08-31T03:36:54.722061+0000 mgr.a (mgr.14388) 3705 : audit [DBG] from='client.91023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:55 smithi191 bash[24992]: cluster 2024-08-31T03:36:54.191504+0000 mgr.a (mgr.14388) 3704 : cluster [DBG] pgmap v2567: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:55 smithi191 bash[24992]: audit 2024-08-31T03:36:54.722061+0000 mgr.a (mgr.14388) 3705 : audit [DBG] from='client.91023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:36:57.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:57 smithi163 bash[24253]: cluster 2024-08-31T03:36:56.192355+0000 mgr.a (mgr.14388) 3706 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:57 smithi027 bash[22610]: cluster 2024-08-31T03:36:56.192355+0000 mgr.a (mgr.14388) 3706 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:57 smithi191 bash[24992]: cluster 2024-08-31T03:36:56.192355+0000 mgr.a (mgr.14388) 3706 : cluster [DBG] pgmap v2568: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:36:59.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:36:59 smithi163 bash[24253]: cluster 2024-08-31T03:36:58.194446+0000 mgr.a (mgr.14388) 3707 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:36:59 smithi027 bash[22610]: cluster 2024-08-31T03:36:58.194446+0000 mgr.a (mgr.14388) 3707 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:36:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:36:59 smithi191 bash[24992]: cluster 2024-08-31T03:36:58.194446+0000 mgr.a (mgr.14388) 3707 : cluster [DBG] pgmap v2569: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:00.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:00.136 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:00.136 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:00.906 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:00.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:00.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:00.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:00.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:37:01.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:01 smithi163 bash[24253]: cluster 2024-08-31T03:37:00.195173+0000 mgr.a (mgr.14388) 3708 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:01.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:01 smithi163 bash[24253]: audit 2024-08-31T03:37:00.472539+0000 mgr.a (mgr.14388) 3709 : audit [DBG] from='client.91095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:01 smithi027 bash[22610]: cluster 2024-08-31T03:37:00.195173+0000 mgr.a (mgr.14388) 3708 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:01 smithi027 bash[22610]: audit 2024-08-31T03:37:00.472539+0000 mgr.a (mgr.14388) 3709 : audit [DBG] from='client.91095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:01 smithi191 bash[24992]: cluster 2024-08-31T03:37:00.195173+0000 mgr.a (mgr.14388) 3708 : cluster [DBG] pgmap v2570: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:01 smithi191 bash[24992]: audit 2024-08-31T03:37:00.472539+0000 mgr.a (mgr.14388) 3709 : audit [DBG] from='client.91095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:03.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:03 smithi163 bash[24253]: cluster 2024-08-31T03:37:02.196125+0000 mgr.a (mgr.14388) 3710 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:03 smithi027 bash[22610]: cluster 2024-08-31T03:37:02.196125+0000 mgr.a (mgr.14388) 3710 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:03 smithi191 bash[24992]: cluster 2024-08-31T03:37:02.196125+0000 mgr.a (mgr.14388) 3710 : cluster [DBG] pgmap v2571: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:05.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:05 smithi163 bash[24253]: cluster 2024-08-31T03:37:04.198342+0000 mgr.a (mgr.14388) 3711 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:05 smithi027 bash[22610]: cluster 2024-08-31T03:37:04.198342+0000 mgr.a (mgr.14388) 3711 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:05 smithi191 bash[24992]: cluster 2024-08-31T03:37:04.198342+0000 mgr.a (mgr.14388) 3711 : cluster [DBG] pgmap v2572: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:05.908 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:05.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:06.678 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:06.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:06.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:06.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:06.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:37:07.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:07 smithi163 bash[24253]: cluster 2024-08-31T03:37:06.199070+0000 mgr.a (mgr.14388) 3712 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:07.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:07 smithi163 bash[24253]: audit 2024-08-31T03:37:06.241143+0000 mgr.a (mgr.14388) 3713 : audit [DBG] from='client.91173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:07 smithi027 bash[22610]: cluster 2024-08-31T03:37:06.199070+0000 mgr.a (mgr.14388) 3712 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:07 smithi027 bash[22610]: audit 2024-08-31T03:37:06.241143+0000 mgr.a (mgr.14388) 3713 : audit [DBG] from='client.91173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:07 smithi191 bash[24992]: cluster 2024-08-31T03:37:06.199070+0000 mgr.a (mgr.14388) 3712 : cluster [DBG] pgmap v2573: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:07 smithi191 bash[24992]: audit 2024-08-31T03:37:06.241143+0000 mgr.a (mgr.14388) 3713 : audit [DBG] from='client.91173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:09 smithi191 bash[24992]: cluster 2024-08-31T03:37:08.201204+0000 mgr.a (mgr.14388) 3714 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:09 smithi191 bash[24992]: audit 2024-08-31T03:37:08.805539+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:37:09.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:09 smithi163 bash[24253]: cluster 2024-08-31T03:37:08.201204+0000 mgr.a (mgr.14388) 3714 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:09.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:09 smithi163 bash[24253]: audit 2024-08-31T03:37:08.805539+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:37:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:09 smithi027 bash[22610]: cluster 2024-08-31T03:37:08.201204+0000 mgr.a (mgr.14388) 3714 : cluster [DBG] pgmap v2574: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:09 smithi027 bash[22610]: audit 2024-08-31T03:37:08.805539+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:37:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:10 smithi191 bash[24992]: audit 2024-08-31T03:37:09.628446+0000 mon.a (mon.0) 1144 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:37:10.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:10 smithi191 bash[24992]: audit 2024-08-31T03:37:09.629830+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:37:10.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:10 smithi191 bash[24992]: audit 2024-08-31T03:37:09.638855+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:37:10.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:10 smithi191 bash[24992]: audit 2024-08-31T03:37:09.641607+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:37:10.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:10 smithi191 bash[24992]: audit 2024-08-31T03:37:09.643871+0000 mgr.a (mgr.14388) 3715 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:37:10.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:10 smithi163 bash[24253]: audit 2024-08-31T03:37:09.628446+0000 mon.a (mon.0) 1144 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:37:10.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:10 smithi163 bash[24253]: audit 2024-08-31T03:37:09.629830+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:37:10.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:10 smithi163 bash[24253]: audit 2024-08-31T03:37:09.638855+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:37:10.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:10 smithi163 bash[24253]: audit 2024-08-31T03:37:09.641607+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:37:10.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:10 smithi163 bash[24253]: audit 2024-08-31T03:37:09.643871+0000 mgr.a (mgr.14388) 3715 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:37:10.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:37:10 smithi027 bash[22863]: debug 2024-08-31T03:37:10.354+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:37:10.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:37:10 smithi027 bash[22863]: debug 2024-08-31T03:37:10.358+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:37:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:10 smithi027 bash[22610]: audit 2024-08-31T03:37:09.628446+0000 mon.a (mon.0) 1144 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:37:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:10 smithi027 bash[22610]: audit 2024-08-31T03:37:09.629830+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:37:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:10 smithi027 bash[22610]: audit 2024-08-31T03:37:09.638855+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:37:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:10 smithi027 bash[22610]: audit 2024-08-31T03:37:09.641607+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:37:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:10 smithi027 bash[22610]: audit 2024-08-31T03:37:09.643871+0000 mgr.a (mgr.14388) 3715 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:37:11.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:11.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:11.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:11.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:11 smithi163 bash[24253]: cluster 2024-08-31T03:37:10.201745+0000 mgr.a (mgr.14388) 3716 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:11.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:11 smithi163 bash[24253]: audit 2024-08-31T03:37:10.358503+0000 mgr.a (mgr.14388) 3717 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:37:11.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:11 smithi163 bash[24253]: cephadm 2024-08-31T03:37:10.359753+0000 mgr.a (mgr.14388) 3718 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:37:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:11 smithi027 bash[22610]: cluster 2024-08-31T03:37:10.201745+0000 mgr.a (mgr.14388) 3716 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:11 smithi027 bash[22610]: audit 2024-08-31T03:37:10.358503+0000 mgr.a (mgr.14388) 3717 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:37:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:11 smithi027 bash[22610]: cephadm 2024-08-31T03:37:10.359753+0000 mgr.a (mgr.14388) 3718 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:37:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:11 smithi191 bash[24992]: cluster 2024-08-31T03:37:10.201745+0000 mgr.a (mgr.14388) 3716 : cluster [DBG] pgmap v2575: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:11 smithi191 bash[24992]: audit 2024-08-31T03:37:10.358503+0000 mgr.a (mgr.14388) 3717 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:37:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:11 smithi191 bash[24992]: cephadm 2024-08-31T03:37:10.359753+0000 mgr.a (mgr.14388) 3718 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:37:12.423 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:12.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:12.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:12.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:12.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:37:13.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:13 smithi163 bash[24253]: audit 2024-08-31T03:37:12.008869+0000 mgr.a (mgr.14388) 3719 : audit [DBG] from='client.91353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:13.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:13 smithi163 bash[24253]: cluster 2024-08-31T03:37:12.202307+0000 mgr.a (mgr.14388) 3720 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:13 smithi027 bash[22610]: audit 2024-08-31T03:37:12.008869+0000 mgr.a (mgr.14388) 3719 : audit [DBG] from='client.91353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:13 smithi027 bash[22610]: cluster 2024-08-31T03:37:12.202307+0000 mgr.a (mgr.14388) 3720 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:14.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:13 smithi191 bash[24992]: audit 2024-08-31T03:37:12.008869+0000 mgr.a (mgr.14388) 3719 : audit [DBG] from='client.91353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:14.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:13 smithi191 bash[24992]: cluster 2024-08-31T03:37:12.202307+0000 mgr.a (mgr.14388) 3720 : cluster [DBG] pgmap v2576: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:15.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:15 smithi163 bash[24253]: cluster 2024-08-31T03:37:14.204565+0000 mgr.a (mgr.14388) 3721 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:15 smithi027 bash[22610]: cluster 2024-08-31T03:37:14.204565+0000 mgr.a (mgr.14388) 3721 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:15 smithi191 bash[24992]: cluster 2024-08-31T03:37:14.204565+0000 mgr.a (mgr.14388) 3721 : cluster [DBG] pgmap v2577: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:17.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:17.425 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:17.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:17.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:17 smithi163 bash[24253]: cluster 2024-08-31T03:37:16.205385+0000 mgr.a (mgr.14388) 3722 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:17 smithi027 bash[22610]: cluster 2024-08-31T03:37:16.205385+0000 mgr.a (mgr.14388) 3722 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:17 smithi191 bash[24992]: cluster 2024-08-31T03:37:16.205385+0000 mgr.a (mgr.14388) 3722 : cluster [DBG] pgmap v2578: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:18.197 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:18.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:18.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:18.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:18.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:37:18.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:18 smithi163 bash[24253]: audit 2024-08-31T03:37:17.760878+0000 mgr.a (mgr.14388) 3723 : audit [DBG] from='client.91428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:18 smithi027 bash[22610]: audit 2024-08-31T03:37:17.760878+0000 mgr.a (mgr.14388) 3723 : audit [DBG] from='client.91428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:18 smithi191 bash[24992]: audit 2024-08-31T03:37:17.760878+0000 mgr.a (mgr.14388) 3723 : audit [DBG] from='client.91428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:19.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:19 smithi163 bash[24253]: cluster 2024-08-31T03:37:18.206928+0000 mgr.a (mgr.14388) 3724 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:19 smithi027 bash[22610]: cluster 2024-08-31T03:37:18.206928+0000 mgr.a (mgr.14388) 3724 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:19 smithi191 bash[24992]: cluster 2024-08-31T03:37:18.206928+0000 mgr.a (mgr.14388) 3724 : cluster [DBG] pgmap v2579: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:21.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:21 smithi163 bash[24253]: cluster 2024-08-31T03:37:20.207618+0000 mgr.a (mgr.14388) 3725 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:37:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:21 smithi027 bash[22610]: cluster 2024-08-31T03:37:20.207618+0000 mgr.a (mgr.14388) 3725 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:37:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:21 smithi191 bash[24992]: cluster 2024-08-31T03:37:20.207618+0000 mgr.a (mgr.14388) 3725 : cluster [DBG] pgmap v2580: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:37:23.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:23.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:23.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:23.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:23 smithi163 bash[24253]: cluster 2024-08-31T03:37:22.208364+0000 mgr.a (mgr.14388) 3726 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:37:23.954 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:23.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:23.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:23.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:23.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:37:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:23 smithi027 bash[22610]: cluster 2024-08-31T03:37:22.208364+0000 mgr.a (mgr.14388) 3726 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:37:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:23 smithi191 bash[24992]: cluster 2024-08-31T03:37:22.208364+0000 mgr.a (mgr.14388) 3726 : cluster [DBG] pgmap v2581: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:37:24.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:24 smithi163 bash[24253]: audit 2024-08-31T03:37:23.535947+0000 mgr.a (mgr.14388) 3727 : audit [DBG] from='client.91503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:24 smithi027 bash[22610]: audit 2024-08-31T03:37:23.535947+0000 mgr.a (mgr.14388) 3727 : audit [DBG] from='client.91503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:24 smithi191 bash[24992]: audit 2024-08-31T03:37:23.535947+0000 mgr.a (mgr.14388) 3727 : audit [DBG] from='client.91503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:25.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:25 smithi163 bash[24253]: cluster 2024-08-31T03:37:24.210948+0000 mgr.a (mgr.14388) 3728 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:25 smithi027 bash[22610]: cluster 2024-08-31T03:37:24.210948+0000 mgr.a (mgr.14388) 3728 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:25 smithi191 bash[24992]: cluster 2024-08-31T03:37:24.210948+0000 mgr.a (mgr.14388) 3728 : cluster [DBG] pgmap v2582: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:37:27.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:27 smithi163 bash[24253]: cluster 2024-08-31T03:37:26.211711+0000 mgr.a (mgr.14388) 3729 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:37:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:27 smithi027 bash[22610]: cluster 2024-08-31T03:37:26.211711+0000 mgr.a (mgr.14388) 3729 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:37:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:27 smithi191 bash[24992]: cluster 2024-08-31T03:37:26.211711+0000 mgr.a (mgr.14388) 3729 : cluster [DBG] pgmap v2583: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:37:28.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:28.957 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:28.957 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:29.727 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:29.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:37:29.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:29 smithi163 bash[24253]: cluster 2024-08-31T03:37:28.213627+0000 mgr.a (mgr.14388) 3730 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:29 smithi027 bash[22610]: cluster 2024-08-31T03:37:28.213627+0000 mgr.a (mgr.14388) 3730 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:29 smithi191 bash[24992]: cluster 2024-08-31T03:37:28.213627+0000 mgr.a (mgr.14388) 3730 : cluster [DBG] pgmap v2584: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:30 smithi027 bash[22610]: audit 2024-08-31T03:37:29.291705+0000 mgr.a (mgr.14388) 3731 : audit [DBG] from='client.91581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:30 smithi191 bash[24992]: audit 2024-08-31T03:37:29.291705+0000 mgr.a (mgr.14388) 3731 : audit [DBG] from='client.91581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:31.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:30 smithi163 bash[24253]: audit 2024-08-31T03:37:29.291705+0000 mgr.a (mgr.14388) 3731 : audit [DBG] from='client.91581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:31 smithi027 bash[22610]: cluster 2024-08-31T03:37:30.214486+0000 mgr.a (mgr.14388) 3732 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:31 smithi191 bash[24992]: cluster 2024-08-31T03:37:30.214486+0000 mgr.a (mgr.14388) 3732 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:32.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:31 smithi163 bash[24253]: cluster 2024-08-31T03:37:30.214486+0000 mgr.a (mgr.14388) 3732 : cluster [DBG] pgmap v2585: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:33 smithi027 bash[22610]: cluster 2024-08-31T03:37:32.215306+0000 mgr.a (mgr.14388) 3733 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:33 smithi191 bash[24992]: cluster 2024-08-31T03:37:32.215306+0000 mgr.a (mgr.14388) 3733 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:34.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:33 smithi163 bash[24253]: cluster 2024-08-31T03:37:32.215306+0000 mgr.a (mgr.14388) 3733 : cluster [DBG] pgmap v2586: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:34.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:34.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:34.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:35.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:35.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:35.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:35.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:35.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:37:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:35 smithi027 bash[22610]: cluster 2024-08-31T03:37:34.217469+0000 mgr.a (mgr.14388) 3734 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:35 smithi191 bash[24992]: cluster 2024-08-31T03:37:34.217469+0000 mgr.a (mgr.14388) 3734 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:36.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:35 smithi163 bash[24253]: cluster 2024-08-31T03:37:34.217469+0000 mgr.a (mgr.14388) 3734 : cluster [DBG] pgmap v2587: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:36 smithi027 bash[22610]: audit 2024-08-31T03:37:35.063298+0000 mgr.a (mgr.14388) 3735 : audit [DBG] from='client.91659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:36 smithi191 bash[24992]: audit 2024-08-31T03:37:35.063298+0000 mgr.a (mgr.14388) 3735 : audit [DBG] from='client.91659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:37.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:36 smithi163 bash[24253]: audit 2024-08-31T03:37:35.063298+0000 mgr.a (mgr.14388) 3735 : audit [DBG] from='client.91659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:37 smithi027 bash[22610]: cluster 2024-08-31T03:37:36.218310+0000 mgr.a (mgr.14388) 3736 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:37 smithi191 bash[24992]: cluster 2024-08-31T03:37:36.218310+0000 mgr.a (mgr.14388) 3736 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:38.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:37 smithi163 bash[24253]: cluster 2024-08-31T03:37:36.218310+0000 mgr.a (mgr.14388) 3736 : cluster [DBG] pgmap v2588: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:39 smithi027 bash[22610]: cluster 2024-08-31T03:37:38.220445+0000 mgr.a (mgr.14388) 3737 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:39 smithi191 bash[24992]: cluster 2024-08-31T03:37:38.220445+0000 mgr.a (mgr.14388) 3737 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:39 smithi163 bash[24253]: cluster 2024-08-31T03:37:38.220445+0000 mgr.a (mgr.14388) 3737 : cluster [DBG] pgmap v2589: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:40.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:40.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:40.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:41.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:41.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:41.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:41.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:37:41.236 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:41 smithi027 bash[22610]: cluster 2024-08-31T03:37:40.221178+0000 mgr.a (mgr.14388) 3738 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:41 smithi027 bash[22610]: audit 2024-08-31T03:37:40.822142+0000 mgr.a (mgr.14388) 3739 : audit [DBG] from='client.91734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:41 smithi191 bash[24992]: cluster 2024-08-31T03:37:40.221178+0000 mgr.a (mgr.14388) 3738 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:41 smithi191 bash[24992]: audit 2024-08-31T03:37:40.822142+0000 mgr.a (mgr.14388) 3739 : audit [DBG] from='client.91734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:42.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:41 smithi163 bash[24253]: cluster 2024-08-31T03:37:40.221178+0000 mgr.a (mgr.14388) 3738 : cluster [DBG] pgmap v2590: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:42.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:41 smithi163 bash[24253]: audit 2024-08-31T03:37:40.822142+0000 mgr.a (mgr.14388) 3739 : audit [DBG] from='client.91734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:43 smithi191 bash[24992]: cluster 2024-08-31T03:37:42.222042+0000 mgr.a (mgr.14388) 3740 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:44.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:43 smithi163 bash[24253]: cluster 2024-08-31T03:37:42.222042+0000 mgr.a (mgr.14388) 3740 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:43 smithi027 bash[22610]: cluster 2024-08-31T03:37:42.222042+0000 mgr.a (mgr.14388) 3740 : cluster [DBG] pgmap v2591: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:45 smithi191 bash[24992]: cluster 2024-08-31T03:37:44.224280+0000 mgr.a (mgr.14388) 3741 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:45 smithi163 bash[24253]: cluster 2024-08-31T03:37:44.224280+0000 mgr.a (mgr.14388) 3741 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:45 smithi027 bash[22610]: cluster 2024-08-31T03:37:44.224280+0000 mgr.a (mgr.14388) 3741 : cluster [DBG] pgmap v2592: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:46.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:46.238 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:46.238 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:47.007 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:47.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:47.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:47.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:47.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:37:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:47 smithi191 bash[24992]: cluster 2024-08-31T03:37:46.225031+0000 mgr.a (mgr.14388) 3742 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:47 smithi191 bash[24992]: audit 2024-08-31T03:37:46.573816+0000 mgr.a (mgr.14388) 3743 : audit [DBG] from='client.91812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:48.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:47 smithi163 bash[24253]: cluster 2024-08-31T03:37:46.225031+0000 mgr.a (mgr.14388) 3742 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:48.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:47 smithi163 bash[24253]: audit 2024-08-31T03:37:46.573816+0000 mgr.a (mgr.14388) 3743 : audit [DBG] from='client.91812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:47 smithi027 bash[22610]: cluster 2024-08-31T03:37:46.225031+0000 mgr.a (mgr.14388) 3742 : cluster [DBG] pgmap v2593: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:47 smithi027 bash[22610]: audit 2024-08-31T03:37:46.573816+0000 mgr.a (mgr.14388) 3743 : audit [DBG] from='client.91812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:49 smithi191 bash[24992]: cluster 2024-08-31T03:37:48.227271+0000 mgr.a (mgr.14388) 3744 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:50.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:49 smithi163 bash[24253]: cluster 2024-08-31T03:37:48.227271+0000 mgr.a (mgr.14388) 3744 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:49 smithi027 bash[22610]: cluster 2024-08-31T03:37:48.227271+0000 mgr.a (mgr.14388) 3744 : cluster [DBG] pgmap v2594: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:52.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:52.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:52.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:51 smithi191 bash[24992]: cluster 2024-08-31T03:37:50.228040+0000 mgr.a (mgr.14388) 3745 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:52.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:51 smithi163 bash[24253]: cluster 2024-08-31T03:37:50.228040+0000 mgr.a (mgr.14388) 3745 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:51 smithi027 bash[22610]: cluster 2024-08-31T03:37:50.228040+0000 mgr.a (mgr.14388) 3745 : cluster [DBG] pgmap v2595: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:52.788 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:52.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:52.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:52.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:52.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:37:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:53 smithi191 bash[24992]: cluster 2024-08-31T03:37:52.228756+0000 mgr.a (mgr.14388) 3746 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:53 smithi191 bash[24992]: audit 2024-08-31T03:37:52.348678+0000 mgr.a (mgr.14388) 3747 : audit [DBG] from='client.91887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:54.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:53 smithi163 bash[24253]: cluster 2024-08-31T03:37:52.228756+0000 mgr.a (mgr.14388) 3746 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:54.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:53 smithi163 bash[24253]: audit 2024-08-31T03:37:52.348678+0000 mgr.a (mgr.14388) 3747 : audit [DBG] from='client.91887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:53 smithi027 bash[22610]: cluster 2024-08-31T03:37:52.228756+0000 mgr.a (mgr.14388) 3746 : cluster [DBG] pgmap v2596: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:53 smithi027 bash[22610]: audit 2024-08-31T03:37:52.348678+0000 mgr.a (mgr.14388) 3747 : audit [DBG] from='client.91887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:37:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:55 smithi191 bash[24992]: cluster 2024-08-31T03:37:54.231147+0000 mgr.a (mgr.14388) 3748 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:56.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:55 smithi163 bash[24253]: cluster 2024-08-31T03:37:54.231147+0000 mgr.a (mgr.14388) 3748 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:55 smithi027 bash[22610]: cluster 2024-08-31T03:37:54.231147+0000 mgr.a (mgr.14388) 3748 : cluster [DBG] pgmap v2597: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:37:57.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:37:57.791 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:37:57.791 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:37:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:57 smithi191 bash[24992]: cluster 2024-08-31T03:37:56.231946+0000 mgr.a (mgr.14388) 3749 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:58.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:57 smithi163 bash[24253]: cluster 2024-08-31T03:37:56.231946+0000 mgr.a (mgr.14388) 3749 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:57 smithi027 bash[22610]: cluster 2024-08-31T03:37:56.231946+0000 mgr.a (mgr.14388) 3749 : cluster [DBG] pgmap v2598: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:37:58.557 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:37:58.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:37:58.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:37:58.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:37:58.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:59 smithi191 bash[24992]: audit 2024-08-31T03:37:58.126645+0000 mgr.a (mgr.14388) 3750 : audit [DBG] from='client.91965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:37:59 smithi191 bash[24992]: cluster 2024-08-31T03:37:58.233210+0000 mgr.a (mgr.14388) 3751 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:59 smithi163 bash[24253]: audit 2024-08-31T03:37:58.126645+0000 mgr.a (mgr.14388) 3750 : audit [DBG] from='client.91965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:00.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:37:59 smithi163 bash[24253]: cluster 2024-08-31T03:37:58.233210+0000 mgr.a (mgr.14388) 3751 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:59 smithi027 bash[22610]: audit 2024-08-31T03:37:58.126645+0000 mgr.a (mgr.14388) 3750 : audit [DBG] from='client.91965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:37:59 smithi027 bash[22610]: cluster 2024-08-31T03:37:58.233210+0000 mgr.a (mgr.14388) 3751 : cluster [DBG] pgmap v2599: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:01 smithi191 bash[24992]: cluster 2024-08-31T03:38:00.234167+0000 mgr.a (mgr.14388) 3752 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:02.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:01 smithi163 bash[24253]: cluster 2024-08-31T03:38:00.234167+0000 mgr.a (mgr.14388) 3752 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:01 smithi027 bash[22610]: cluster 2024-08-31T03:38:00.234167+0000 mgr.a (mgr.14388) 3752 : cluster [DBG] pgmap v2600: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:03.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:38:03.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:38:03.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:38:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:03 smithi191 bash[24992]: cluster 2024-08-31T03:38:02.235019+0000 mgr.a (mgr.14388) 3753 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:04.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:03 smithi163 bash[24253]: cluster 2024-08-31T03:38:02.235019+0000 mgr.a (mgr.14388) 3753 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:03 smithi027 bash[22610]: cluster 2024-08-31T03:38:02.235019+0000 mgr.a (mgr.14388) 3753 : cluster [DBG] pgmap v2601: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:04.309 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:38:04.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:38:04.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:38:04.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:38:04.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:05 smithi191 bash[24992]: audit 2024-08-31T03:38:03.891923+0000 mgr.a (mgr.14388) 3754 : audit [DBG] from='client.92037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:05 smithi191 bash[24992]: cluster 2024-08-31T03:38:04.236712+0000 mgr.a (mgr.14388) 3755 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:06.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:05 smithi163 bash[24253]: audit 2024-08-31T03:38:03.891923+0000 mgr.a (mgr.14388) 3754 : audit [DBG] from='client.92037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:06.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:05 smithi163 bash[24253]: cluster 2024-08-31T03:38:04.236712+0000 mgr.a (mgr.14388) 3755 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:05 smithi027 bash[22610]: audit 2024-08-31T03:38:03.891923+0000 mgr.a (mgr.14388) 3754 : audit [DBG] from='client.92037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:05 smithi027 bash[22610]: cluster 2024-08-31T03:38:04.236712+0000 mgr.a (mgr.14388) 3755 : cluster [DBG] pgmap v2602: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:07 smithi191 bash[24992]: cluster 2024-08-31T03:38:06.237482+0000 mgr.a (mgr.14388) 3756 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:08.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:07 smithi163 bash[24253]: cluster 2024-08-31T03:38:06.237482+0000 mgr.a (mgr.14388) 3756 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:07 smithi027 bash[22610]: cluster 2024-08-31T03:38:06.237482+0000 mgr.a (mgr.14388) 3756 : cluster [DBG] pgmap v2603: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:09.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:38:09.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:38:09.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:38:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:09 smithi191 bash[24992]: cluster 2024-08-31T03:38:08.239397+0000 mgr.a (mgr.14388) 3757 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:10.045 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:38:10.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:38:10.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:38:10.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:38:10.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:10.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:09 smithi163 bash[24253]: cluster 2024-08-31T03:38:08.239397+0000 mgr.a (mgr.14388) 3757 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:09 smithi027 bash[22610]: cluster 2024-08-31T03:38:08.239397+0000 mgr.a (mgr.14388) 3757 : cluster [DBG] pgmap v2604: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:11.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:10 smithi163 bash[24253]: audit 2024-08-31T03:38:09.640989+0000 mgr.a (mgr.14388) 3758 : audit [DBG] from='client.92112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:11.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:10 smithi163 bash[24253]: audit 2024-08-31T03:38:10.412441+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:38:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:10 smithi027 bash[22610]: audit 2024-08-31T03:38:09.640989+0000 mgr.a (mgr.14388) 3758 : audit [DBG] from='client.92112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:10 smithi027 bash[22610]: audit 2024-08-31T03:38:10.412441+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:38:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:10 smithi191 bash[24992]: audit 2024-08-31T03:38:09.640989+0000 mgr.a (mgr.14388) 3758 : audit [DBG] from='client.92112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:10 smithi191 bash[24992]: audit 2024-08-31T03:38:10.412441+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:38:12.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:11 smithi163 bash[24253]: cluster 2024-08-31T03:38:10.240503+0000 mgr.a (mgr.14388) 3759 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:12.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:11 smithi163 bash[24253]: audit 2024-08-31T03:38:11.249649+0000 mon.a (mon.0) 1149 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:38:12.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:11 smithi163 bash[24253]: audit 2024-08-31T03:38:11.251303+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:38:12.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:11 smithi163 bash[24253]: audit 2024-08-31T03:38:11.261955+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:38:12.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:11 smithi163 bash[24253]: audit 2024-08-31T03:38:11.266962+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:38:12.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:38:11 smithi027 bash[22863]: debug 2024-08-31T03:38:11.981+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:38:12.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:38:11 smithi027 bash[22863]: debug 2024-08-31T03:38:11.985+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:38:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:11 smithi027 bash[22610]: cluster 2024-08-31T03:38:10.240503+0000 mgr.a (mgr.14388) 3759 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:11 smithi027 bash[22610]: audit 2024-08-31T03:38:11.249649+0000 mon.a (mon.0) 1149 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:38:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:11 smithi027 bash[22610]: audit 2024-08-31T03:38:11.251303+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:38:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:11 smithi027 bash[22610]: audit 2024-08-31T03:38:11.261955+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:38:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:11 smithi027 bash[22610]: audit 2024-08-31T03:38:11.266962+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:38:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:11 smithi191 bash[24992]: cluster 2024-08-31T03:38:10.240503+0000 mgr.a (mgr.14388) 3759 : cluster [DBG] pgmap v2605: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:11 smithi191 bash[24992]: audit 2024-08-31T03:38:11.249649+0000 mon.a (mon.0) 1149 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:38:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:11 smithi191 bash[24992]: audit 2024-08-31T03:38:11.251303+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:38:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:11 smithi191 bash[24992]: audit 2024-08-31T03:38:11.261955+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:38:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:11 smithi191 bash[24992]: audit 2024-08-31T03:38:11.266962+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:38:13.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:12 smithi163 bash[24253]: audit 2024-08-31T03:38:11.269316+0000 mgr.a (mgr.14388) 3760 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:38:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:12 smithi027 bash[22610]: audit 2024-08-31T03:38:11.269316+0000 mgr.a (mgr.14388) 3760 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:38:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:12 smithi191 bash[24992]: audit 2024-08-31T03:38:11.269316+0000 mgr.a (mgr.14388) 3760 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:38:14.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:13 smithi163 bash[24253]: audit 2024-08-31T03:38:11.986203+0000 mgr.a (mgr.14388) 3761 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:38:14.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:13 smithi163 bash[24253]: cephadm 2024-08-31T03:38:11.987402+0000 mgr.a (mgr.14388) 3762 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:38:14.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:13 smithi163 bash[24253]: cluster 2024-08-31T03:38:12.241468+0000 mgr.a (mgr.14388) 3763 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:13 smithi027 bash[22610]: audit 2024-08-31T03:38:11.986203+0000 mgr.a (mgr.14388) 3761 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:38:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:13 smithi027 bash[22610]: cephadm 2024-08-31T03:38:11.987402+0000 mgr.a (mgr.14388) 3762 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:38:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:13 smithi027 bash[22610]: cluster 2024-08-31T03:38:12.241468+0000 mgr.a (mgr.14388) 3763 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:13 smithi191 bash[24992]: audit 2024-08-31T03:38:11.986203+0000 mgr.a (mgr.14388) 3761 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:38:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:13 smithi191 bash[24992]: cephadm 2024-08-31T03:38:11.987402+0000 mgr.a (mgr.14388) 3762 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:38:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:13 smithi191 bash[24992]: cluster 2024-08-31T03:38:12.241468+0000 mgr.a (mgr.14388) 3763 : cluster [DBG] pgmap v2606: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:15.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:38:15.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:38:15.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:38:15.792 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:38:15.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:38:15.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:38:15.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:38:15.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:16.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:15 smithi163 bash[24253]: cluster 2024-08-31T03:38:14.243668+0000 mgr.a (mgr.14388) 3764 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:15 smithi027 bash[22610]: cluster 2024-08-31T03:38:14.243668+0000 mgr.a (mgr.14388) 3764 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:15 smithi191 bash[24992]: cluster 2024-08-31T03:38:14.243668+0000 mgr.a (mgr.14388) 3764 : cluster [DBG] pgmap v2607: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:17.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:16 smithi163 bash[24253]: audit 2024-08-31T03:38:15.376652+0000 mgr.a (mgr.14388) 3765 : audit [DBG] from='client.92295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:16 smithi027 bash[22610]: audit 2024-08-31T03:38:15.376652+0000 mgr.a (mgr.14388) 3765 : audit [DBG] from='client.92295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:16 smithi191 bash[24992]: audit 2024-08-31T03:38:15.376652+0000 mgr.a (mgr.14388) 3765 : audit [DBG] from='client.92295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:18.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:17 smithi163 bash[24253]: cluster 2024-08-31T03:38:16.244642+0000 mgr.a (mgr.14388) 3766 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:17 smithi027 bash[22610]: cluster 2024-08-31T03:38:16.244642+0000 mgr.a (mgr.14388) 3766 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:17 smithi191 bash[24992]: cluster 2024-08-31T03:38:16.244642+0000 mgr.a (mgr.14388) 3766 : cluster [DBG] pgmap v2608: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:20.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:19 smithi163 bash[24253]: cluster 2024-08-31T03:38:18.246774+0000 mgr.a (mgr.14388) 3767 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:19 smithi027 bash[22610]: cluster 2024-08-31T03:38:18.246774+0000 mgr.a (mgr.14388) 3767 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:19 smithi191 bash[24992]: cluster 2024-08-31T03:38:18.246774+0000 mgr.a (mgr.14388) 3767 : cluster [DBG] pgmap v2609: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:20.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:38:20.795 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:38:20.795 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:38:21.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:38:21.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:38:21.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:38:21.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:21.564 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:38:22.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:21 smithi163 bash[24253]: cluster 2024-08-31T03:38:20.247502+0000 mgr.a (mgr.14388) 3768 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:21 smithi027 bash[22610]: cluster 2024-08-31T03:38:20.247502+0000 mgr.a (mgr.14388) 3768 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:21 smithi191 bash[24992]: cluster 2024-08-31T03:38:20.247502+0000 mgr.a (mgr.14388) 3768 : cluster [DBG] pgmap v2610: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:23.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:22 smithi163 bash[24253]: audit 2024-08-31T03:38:21.130380+0000 mgr.a (mgr.14388) 3769 : audit [DBG] from='client.92373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:22 smithi027 bash[22610]: audit 2024-08-31T03:38:21.130380+0000 mgr.a (mgr.14388) 3769 : audit [DBG] from='client.92373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:22 smithi191 bash[24992]: audit 2024-08-31T03:38:21.130380+0000 mgr.a (mgr.14388) 3769 : audit [DBG] from='client.92373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:24.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:23 smithi163 bash[24253]: cluster 2024-08-31T03:38:22.248447+0000 mgr.a (mgr.14388) 3770 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:23 smithi027 bash[22610]: cluster 2024-08-31T03:38:22.248447+0000 mgr.a (mgr.14388) 3770 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:23 smithi191 bash[24992]: cluster 2024-08-31T03:38:22.248447+0000 mgr.a (mgr.14388) 3770 : cluster [DBG] pgmap v2611: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:26.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:25 smithi163 bash[24253]: cluster 2024-08-31T03:38:24.250670+0000 mgr.a (mgr.14388) 3771 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:25 smithi027 bash[22610]: cluster 2024-08-31T03:38:24.250670+0000 mgr.a (mgr.14388) 3771 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:25 smithi191 bash[24992]: cluster 2024-08-31T03:38:24.250670+0000 mgr.a (mgr.14388) 3771 : cluster [DBG] pgmap v2612: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:38:26.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:38:26.565 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:38:26.565 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:38:27.336 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:38:27.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:38:27.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:38:27.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:38:27.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:28.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:27 smithi163 bash[24253]: cluster 2024-08-31T03:38:26.251443+0000 mgr.a (mgr.14388) 3772 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:27 smithi027 bash[22610]: cluster 2024-08-31T03:38:26.251443+0000 mgr.a (mgr.14388) 3772 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:27 smithi191 bash[24992]: cluster 2024-08-31T03:38:26.251443+0000 mgr.a (mgr.14388) 3772 : cluster [DBG] pgmap v2613: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:29.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:28 smithi163 bash[24253]: audit 2024-08-31T03:38:26.901862+0000 mgr.a (mgr.14388) 3773 : audit [DBG] from='client.92451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:29.465 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:28 smithi191 bash[24992]: audit 2024-08-31T03:38:26.901862+0000 mgr.a (mgr.14388) 3773 : audit [DBG] from='client.92451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:29.465 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:28 smithi027 bash[22610]: audit 2024-08-31T03:38:26.901862+0000 mgr.a (mgr.14388) 3773 : audit [DBG] from='client.92451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:30.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:29 smithi163 bash[24253]: cluster 2024-08-31T03:38:28.253708+0000 mgr.a (mgr.14388) 3774 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:38:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:29 smithi027 bash[22610]: cluster 2024-08-31T03:38:28.253708+0000 mgr.a (mgr.14388) 3774 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:38:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:29 smithi191 bash[24992]: cluster 2024-08-31T03:38:28.253708+0000 mgr.a (mgr.14388) 3774 : cluster [DBG] pgmap v2614: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:38:32.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:31 smithi163 bash[24253]: cluster 2024-08-31T03:38:30.254488+0000 mgr.a (mgr.14388) 3775 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:31 smithi027 bash[22610]: cluster 2024-08-31T03:38:30.254488+0000 mgr.a (mgr.14388) 3775 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:31 smithi191 bash[24992]: cluster 2024-08-31T03:38:30.254488+0000 mgr.a (mgr.14388) 3775 : cluster [DBG] pgmap v2615: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:32.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:38:32.339 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:38:32.339 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:38:33.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:38:33.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:38:33.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:38:33.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:33.114 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:38:34.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:33 smithi163 bash[24253]: cluster 2024-08-31T03:38:32.255274+0000 mgr.a (mgr.14388) 3776 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:34.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:33 smithi163 bash[24253]: audit 2024-08-31T03:38:32.675749+0000 mgr.a (mgr.14388) 3777 : audit [DBG] from='client.92529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:33 smithi027 bash[22610]: cluster 2024-08-31T03:38:32.255274+0000 mgr.a (mgr.14388) 3776 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:34.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:33 smithi027 bash[22610]: audit 2024-08-31T03:38:32.675749+0000 mgr.a (mgr.14388) 3777 : audit [DBG] from='client.92529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:33 smithi191 bash[24992]: cluster 2024-08-31T03:38:32.255274+0000 mgr.a (mgr.14388) 3776 : cluster [DBG] pgmap v2616: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:33 smithi191 bash[24992]: audit 2024-08-31T03:38:32.675749+0000 mgr.a (mgr.14388) 3777 : audit [DBG] from='client.92529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:36.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:35 smithi163 bash[24253]: cluster 2024-08-31T03:38:34.258020+0000 mgr.a (mgr.14388) 3778 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:38:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:35 smithi027 bash[22610]: cluster 2024-08-31T03:38:34.258020+0000 mgr.a (mgr.14388) 3778 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:38:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:35 smithi191 bash[24992]: cluster 2024-08-31T03:38:34.258020+0000 mgr.a (mgr.14388) 3778 : cluster [DBG] pgmap v2617: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:38:38.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:38:38.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:38:38.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:38:38.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:37 smithi163 bash[24253]: cluster 2024-08-31T03:38:36.258891+0000 mgr.a (mgr.14388) 3779 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:38:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:37 smithi027 bash[22610]: cluster 2024-08-31T03:38:36.258891+0000 mgr.a (mgr.14388) 3779 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:38:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:37 smithi191 bash[24992]: cluster 2024-08-31T03:38:36.258891+0000 mgr.a (mgr.14388) 3779 : cluster [DBG] pgmap v2618: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:38:38.855 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:38:38.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:38:38.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:38:38.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:38:38.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:39 smithi163 bash[24253]: cluster 2024-08-31T03:38:38.259894+0000 mgr.a (mgr.14388) 3780 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:39 smithi163 bash[24253]: audit 2024-08-31T03:38:38.441497+0000 mgr.a (mgr.14388) 3781 : audit [DBG] from='client.92604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:39 smithi027 bash[22610]: cluster 2024-08-31T03:38:38.259894+0000 mgr.a (mgr.14388) 3780 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:39 smithi027 bash[22610]: audit 2024-08-31T03:38:38.441497+0000 mgr.a (mgr.14388) 3781 : audit [DBG] from='client.92604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:39 smithi191 bash[24992]: cluster 2024-08-31T03:38:38.259894+0000 mgr.a (mgr.14388) 3780 : cluster [DBG] pgmap v2619: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:39 smithi191 bash[24992]: audit 2024-08-31T03:38:38.441497+0000 mgr.a (mgr.14388) 3781 : audit [DBG] from='client.92604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:42.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:41 smithi163 bash[24253]: cluster 2024-08-31T03:38:40.260970+0000 mgr.a (mgr.14388) 3782 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:41 smithi027 bash[22610]: cluster 2024-08-31T03:38:40.260970+0000 mgr.a (mgr.14388) 3782 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:41 smithi191 bash[24992]: cluster 2024-08-31T03:38:40.260970+0000 mgr.a (mgr.14388) 3782 : cluster [DBG] pgmap v2620: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:43.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:38:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:38:43.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:38:44.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:43 smithi163 bash[24253]: cluster 2024-08-31T03:38:42.261932+0000 mgr.a (mgr.14388) 3783 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:43 smithi027 bash[22610]: cluster 2024-08-31T03:38:42.261932+0000 mgr.a (mgr.14388) 3783 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:43 smithi191 bash[24992]: cluster 2024-08-31T03:38:42.261932+0000 mgr.a (mgr.14388) 3783 : cluster [DBG] pgmap v2621: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:38:44.603 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:38:44.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:38:44.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:38:44.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:38:44.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:45.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:44 smithi163 bash[24253]: audit 2024-08-31T03:38:44.192224+0000 mgr.a (mgr.14388) 3784 : audit [DBG] from='client.92682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:45.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:44 smithi163 bash[24253]: cluster 2024-08-31T03:38:44.263290+0000 mgr.a (mgr.14388) 3785 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:44 smithi027 bash[22610]: audit 2024-08-31T03:38:44.192224+0000 mgr.a (mgr.14388) 3784 : audit [DBG] from='client.92682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:44 smithi027 bash[22610]: cluster 2024-08-31T03:38:44.263290+0000 mgr.a (mgr.14388) 3785 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:44 smithi191 bash[24992]: audit 2024-08-31T03:38:44.192224+0000 mgr.a (mgr.14388) 3784 : audit [DBG] from='client.92682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:44 smithi191 bash[24992]: cluster 2024-08-31T03:38:44.263290+0000 mgr.a (mgr.14388) 3785 : cluster [DBG] pgmap v2622: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:47.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:47 smithi163 bash[24253]: cluster 2024-08-31T03:38:46.264142+0000 mgr.a (mgr.14388) 3786 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:38:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:47 smithi027 bash[22610]: cluster 2024-08-31T03:38:46.264142+0000 mgr.a (mgr.14388) 3786 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:38:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:47 smithi191 bash[24992]: cluster 2024-08-31T03:38:46.264142+0000 mgr.a (mgr.14388) 3786 : cluster [DBG] pgmap v2623: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:38:49.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:38:49.605 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:38:49.605 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:38:49.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:49 smithi163 bash[24253]: cluster 2024-08-31T03:38:48.266232+0000 mgr.a (mgr.14388) 3787 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:38:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:49 smithi027 bash[22610]: cluster 2024-08-31T03:38:48.266232+0000 mgr.a (mgr.14388) 3787 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:38:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:49 smithi191 bash[24992]: cluster 2024-08-31T03:38:48.266232+0000 mgr.a (mgr.14388) 3787 : cluster [DBG] pgmap v2624: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:38:50.361 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:38:50.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:38:50.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:38:50.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:38:50.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:51.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:51 smithi163 bash[24253]: audit 2024-08-31T03:38:49.936707+0000 mgr.a (mgr.14388) 3788 : audit [DBG] from='client.92760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:51.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:51 smithi163 bash[24253]: cluster 2024-08-31T03:38:50.266806+0000 mgr.a (mgr.14388) 3789 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:51 smithi027 bash[22610]: audit 2024-08-31T03:38:49.936707+0000 mgr.a (mgr.14388) 3788 : audit [DBG] from='client.92760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:51 smithi027 bash[22610]: cluster 2024-08-31T03:38:50.266806+0000 mgr.a (mgr.14388) 3789 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:51 smithi191 bash[24992]: audit 2024-08-31T03:38:49.936707+0000 mgr.a (mgr.14388) 3788 : audit [DBG] from='client.92760 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:51 smithi191 bash[24992]: cluster 2024-08-31T03:38:50.266806+0000 mgr.a (mgr.14388) 3789 : cluster [DBG] pgmap v2625: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:53.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:53 smithi163 bash[24253]: cluster 2024-08-31T03:38:52.267539+0000 mgr.a (mgr.14388) 3790 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:53 smithi027 bash[22610]: cluster 2024-08-31T03:38:52.267539+0000 mgr.a (mgr.14388) 3790 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:53 smithi191 bash[24992]: cluster 2024-08-31T03:38:52.267539+0000 mgr.a (mgr.14388) 3790 : cluster [DBG] pgmap v2626: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:55.363 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:38:55.364 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:38:55.364 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:38:55.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:55 smithi163 bash[24253]: cluster 2024-08-31T03:38:54.269740+0000 mgr.a (mgr.14388) 3791 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:38:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:55 smithi027 bash[22610]: cluster 2024-08-31T03:38:54.269740+0000 mgr.a (mgr.14388) 3791 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:38:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:55 smithi191 bash[24992]: cluster 2024-08-31T03:38:54.269740+0000 mgr.a (mgr.14388) 3791 : cluster [DBG] pgmap v2627: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:38:56.144 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:38:56.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:38:56.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:38:56.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:38:56.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:38:56.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:56 smithi163 bash[24253]: audit 2024-08-31T03:38:55.700217+0000 mgr.a (mgr.14388) 3792 : audit [DBG] from='client.92838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:56 smithi027 bash[22610]: audit 2024-08-31T03:38:55.700217+0000 mgr.a (mgr.14388) 3792 : audit [DBG] from='client.92838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:56 smithi191 bash[24992]: audit 2024-08-31T03:38:55.700217+0000 mgr.a (mgr.14388) 3792 : audit [DBG] from='client.92838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:38:57.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:57 smithi163 bash[24253]: cluster 2024-08-31T03:38:56.270629+0000 mgr.a (mgr.14388) 3793 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:57 smithi027 bash[22610]: cluster 2024-08-31T03:38:56.270629+0000 mgr.a (mgr.14388) 3793 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:57 smithi191 bash[24992]: cluster 2024-08-31T03:38:56.270629+0000 mgr.a (mgr.14388) 3793 : cluster [DBG] pgmap v2628: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:38:59.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:38:59 smithi163 bash[24253]: cluster 2024-08-31T03:38:58.272759+0000 mgr.a (mgr.14388) 3794 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:38:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:38:59 smithi027 bash[22610]: cluster 2024-08-31T03:38:58.272759+0000 mgr.a (mgr.14388) 3794 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:38:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:38:59 smithi191 bash[24992]: cluster 2024-08-31T03:38:58.272759+0000 mgr.a (mgr.14388) 3794 : cluster [DBG] pgmap v2629: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:01.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:01.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:01.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:01 smithi163 bash[24253]: cluster 2024-08-31T03:39:00.273539+0000 mgr.a (mgr.14388) 3795 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:01 smithi027 bash[22610]: cluster 2024-08-31T03:39:00.273539+0000 mgr.a (mgr.14388) 3795 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:01 smithi191 bash[24992]: cluster 2024-08-31T03:39:00.273539+0000 mgr.a (mgr.14388) 3795 : cluster [DBG] pgmap v2630: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:01.917 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:39:01.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:39:01.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:39:01.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:39:01.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:39:02.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:02 smithi163 bash[24253]: audit 2024-08-31T03:39:01.482359+0000 mgr.a (mgr.14388) 3796 : audit [DBG] from='client.92913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:02 smithi027 bash[22610]: audit 2024-08-31T03:39:01.482359+0000 mgr.a (mgr.14388) 3796 : audit [DBG] from='client.92913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:02 smithi191 bash[24992]: audit 2024-08-31T03:39:01.482359+0000 mgr.a (mgr.14388) 3796 : audit [DBG] from='client.92913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:03.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:03 smithi163 bash[24253]: cluster 2024-08-31T03:39:02.274502+0000 mgr.a (mgr.14388) 3797 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:03 smithi027 bash[22610]: cluster 2024-08-31T03:39:02.274502+0000 mgr.a (mgr.14388) 3797 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:03 smithi191 bash[24992]: cluster 2024-08-31T03:39:02.274502+0000 mgr.a (mgr.14388) 3797 : cluster [DBG] pgmap v2631: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:05.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:05 smithi163 bash[24253]: cluster 2024-08-31T03:39:04.276758+0000 mgr.a (mgr.14388) 3798 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:05 smithi027 bash[22610]: cluster 2024-08-31T03:39:04.276758+0000 mgr.a (mgr.14388) 3798 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:05 smithi191 bash[24992]: cluster 2024-08-31T03:39:04.276758+0000 mgr.a (mgr.14388) 3798 : cluster [DBG] pgmap v2632: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:06.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:06.920 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:06.920 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:07.672 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:39:07.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:39:07.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:39:07.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:39:07.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:39:07.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:07 smithi163 bash[24253]: cluster 2024-08-31T03:39:06.277521+0000 mgr.a (mgr.14388) 3799 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:07 smithi027 bash[22610]: cluster 2024-08-31T03:39:06.277521+0000 mgr.a (mgr.14388) 3799 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:07 smithi191 bash[24992]: cluster 2024-08-31T03:39:06.277521+0000 mgr.a (mgr.14388) 3799 : cluster [DBG] pgmap v2633: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:08.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:08 smithi163 bash[24253]: audit 2024-08-31T03:39:07.251866+0000 mgr.a (mgr.14388) 3800 : audit [DBG] from='client.92988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:08 smithi027 bash[22610]: audit 2024-08-31T03:39:07.251866+0000 mgr.a (mgr.14388) 3800 : audit [DBG] from='client.92988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:08 smithi191 bash[24992]: audit 2024-08-31T03:39:07.251866+0000 mgr.a (mgr.14388) 3800 : audit [DBG] from='client.92988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:09.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:09 smithi163 bash[24253]: cluster 2024-08-31T03:39:08.279830+0000 mgr.a (mgr.14388) 3801 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:09 smithi027 bash[22610]: cluster 2024-08-31T03:39:08.279830+0000 mgr.a (mgr.14388) 3801 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:09 smithi191 bash[24992]: cluster 2024-08-31T03:39:08.279830+0000 mgr.a (mgr.14388) 3801 : cluster [DBG] pgmap v2634: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:11.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:11 smithi163 bash[24253]: cluster 2024-08-31T03:39:10.280609+0000 mgr.a (mgr.14388) 3802 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:11 smithi027 bash[22610]: cluster 2024-08-31T03:39:10.280609+0000 mgr.a (mgr.14388) 3802 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:11 smithi191 bash[24992]: cluster 2024-08-31T03:39:10.280609+0000 mgr.a (mgr.14388) 3802 : cluster [DBG] pgmap v2635: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:12.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:12.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:12.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:12.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:12 smithi163 bash[24253]: audit 2024-08-31T03:39:12.038120+0000 mon.a (mon.0) 1153 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:39:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:12 smithi027 bash[22610]: audit 2024-08-31T03:39:12.038120+0000 mon.a (mon.0) 1153 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:39:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:12 smithi191 bash[24992]: audit 2024-08-31T03:39:12.038120+0000 mon.a (mon.0) 1153 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:39:13.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:13 smithi163 bash[24253]: cluster 2024-08-31T03:39:12.281346+0000 mgr.a (mgr.14388) 3803 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:13.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:13 smithi163 bash[24253]: audit 2024-08-31T03:39:12.869532+0000 mon.a (mon.0) 1154 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:39:13.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:13 smithi163 bash[24253]: audit 2024-08-31T03:39:12.870879+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:39:13.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:13 smithi163 bash[24253]: audit 2024-08-31T03:39:12.879542+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:39:13.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:13 smithi163 bash[24253]: audit 2024-08-31T03:39:12.882285+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:39:13.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:13 smithi163 bash[24253]: audit 2024-08-31T03:39:12.883391+0000 mgr.a (mgr.14388) 3804 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:39:13.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:39:13 smithi027 bash[22863]: debug 2024-08-31T03:39:13.587+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:39:13.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:39:13 smithi027 bash[22863]: debug 2024-08-31T03:39:13.599+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:39:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:13 smithi027 bash[22610]: cluster 2024-08-31T03:39:12.281346+0000 mgr.a (mgr.14388) 3803 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:13 smithi027 bash[22610]: audit 2024-08-31T03:39:12.869532+0000 mon.a (mon.0) 1154 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:39:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:13 smithi027 bash[22610]: audit 2024-08-31T03:39:12.870879+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:39:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:13 smithi027 bash[22610]: audit 2024-08-31T03:39:12.879542+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:39:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:13 smithi027 bash[22610]: audit 2024-08-31T03:39:12.882285+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:39:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:13 smithi027 bash[22610]: audit 2024-08-31T03:39:12.883391+0000 mgr.a (mgr.14388) 3804 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:39:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:13 smithi191 bash[24992]: cluster 2024-08-31T03:39:12.281346+0000 mgr.a (mgr.14388) 3803 : cluster [DBG] pgmap v2636: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:13 smithi191 bash[24992]: audit 2024-08-31T03:39:12.869532+0000 mon.a (mon.0) 1154 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:39:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:13 smithi191 bash[24992]: audit 2024-08-31T03:39:12.870879+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:39:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:13 smithi191 bash[24992]: audit 2024-08-31T03:39:12.879542+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:39:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:13 smithi191 bash[24992]: audit 2024-08-31T03:39:12.882285+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:39:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:13 smithi191 bash[24992]: audit 2024-08-31T03:39:12.883391+0000 mgr.a (mgr.14388) 3804 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:39:14.007 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:39:14.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:39:14.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:39:14.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:39:14.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:39:14.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:14 smithi163 bash[24253]: audit 2024-08-31T03:39:12.994062+0000 mgr.a (mgr.14388) 3805 : audit [DBG] from='client.93066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:14.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:14 smithi163 bash[24253]: audit 2024-08-31T03:39:13.590782+0000 mgr.a (mgr.14388) 3806 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:39:14.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:14 smithi163 bash[24253]: cephadm 2024-08-31T03:39:13.602858+0000 mgr.a (mgr.14388) 3807 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:39:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:14 smithi027 bash[22610]: audit 2024-08-31T03:39:12.994062+0000 mgr.a (mgr.14388) 3805 : audit [DBG] from='client.93066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:14 smithi027 bash[22610]: audit 2024-08-31T03:39:13.590782+0000 mgr.a (mgr.14388) 3806 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:39:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:14 smithi027 bash[22610]: cephadm 2024-08-31T03:39:13.602858+0000 mgr.a (mgr.14388) 3807 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:39:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:14 smithi191 bash[24992]: audit 2024-08-31T03:39:12.994062+0000 mgr.a (mgr.14388) 3805 : audit [DBG] from='client.93066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:14 smithi191 bash[24992]: audit 2024-08-31T03:39:13.590782+0000 mgr.a (mgr.14388) 3806 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:39:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:14 smithi191 bash[24992]: cephadm 2024-08-31T03:39:13.602858+0000 mgr.a (mgr.14388) 3807 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:39:15.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:15 smithi163 bash[24253]: cluster 2024-08-31T03:39:14.284086+0000 mgr.a (mgr.14388) 3808 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:15 smithi027 bash[22610]: cluster 2024-08-31T03:39:14.284086+0000 mgr.a (mgr.14388) 3808 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:15 smithi191 bash[24992]: cluster 2024-08-31T03:39:14.284086+0000 mgr.a (mgr.14388) 3808 : cluster [DBG] pgmap v2637: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:17.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:17 smithi163 bash[24253]: cluster 2024-08-31T03:39:16.284868+0000 mgr.a (mgr.14388) 3809 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:39:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:17 smithi027 bash[22610]: cluster 2024-08-31T03:39:16.284868+0000 mgr.a (mgr.14388) 3809 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:39:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:17 smithi191 bash[24992]: cluster 2024-08-31T03:39:16.284868+0000 mgr.a (mgr.14388) 3809 : cluster [DBG] pgmap v2638: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:39:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:19.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:19.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:19.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:19 smithi163 bash[24253]: cluster 2024-08-31T03:39:18.286798+0000 mgr.a (mgr.14388) 3810 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:19 smithi027 bash[22610]: cluster 2024-08-31T03:39:18.286798+0000 mgr.a (mgr.14388) 3810 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:19 smithi191 bash[24992]: cluster 2024-08-31T03:39:18.286798+0000 mgr.a (mgr.14388) 3810 : cluster [DBG] pgmap v2639: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:19.799 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:39:19.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:39:19.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:39:19.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:39:19.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:39:20.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:20 smithi163 bash[24253]: audit 2024-08-31T03:39:19.347557+0000 mgr.a (mgr.14388) 3811 : audit [DBG] from='client.93243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:20 smithi027 bash[22610]: audit 2024-08-31T03:39:19.347557+0000 mgr.a (mgr.14388) 3811 : audit [DBG] from='client.93243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:20 smithi191 bash[24992]: audit 2024-08-31T03:39:19.347557+0000 mgr.a (mgr.14388) 3811 : audit [DBG] from='client.93243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:21.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:21 smithi163 bash[24253]: cluster 2024-08-31T03:39:20.287847+0000 mgr.a (mgr.14388) 3812 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:39:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:21 smithi027 bash[22610]: cluster 2024-08-31T03:39:20.287847+0000 mgr.a (mgr.14388) 3812 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:39:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:21 smithi191 bash[24992]: cluster 2024-08-31T03:39:20.287847+0000 mgr.a (mgr.14388) 3812 : cluster [DBG] pgmap v2640: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:39:23.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:23 smithi163 bash[24253]: cluster 2024-08-31T03:39:22.288803+0000 mgr.a (mgr.14388) 3813 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:39:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:23 smithi027 bash[22610]: cluster 2024-08-31T03:39:22.288803+0000 mgr.a (mgr.14388) 3813 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:39:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:23 smithi191 bash[24992]: cluster 2024-08-31T03:39:22.288803+0000 mgr.a (mgr.14388) 3813 : cluster [DBG] pgmap v2641: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:39:24.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:24.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:24.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:25.582 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:39:25.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:39:25.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:39:25.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:39:25.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:39:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:25 smithi027 bash[22610]: cluster 2024-08-31T03:39:24.291027+0000 mgr.a (mgr.14388) 3814 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:25 smithi191 bash[24992]: cluster 2024-08-31T03:39:24.291027+0000 mgr.a (mgr.14388) 3814 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:25.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:25 smithi163 bash[24253]: cluster 2024-08-31T03:39:24.291027+0000 mgr.a (mgr.14388) 3814 : cluster [DBG] pgmap v2642: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:26 smithi027 bash[22610]: audit 2024-08-31T03:39:25.138385+0000 mgr.a (mgr.14388) 3815 : audit [DBG] from='client.93318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:26 smithi191 bash[24992]: audit 2024-08-31T03:39:25.138385+0000 mgr.a (mgr.14388) 3815 : audit [DBG] from='client.93318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:26.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:26 smithi163 bash[24253]: audit 2024-08-31T03:39:25.138385+0000 mgr.a (mgr.14388) 3815 : audit [DBG] from='client.93318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:27 smithi027 bash[22610]: cluster 2024-08-31T03:39:26.292168+0000 mgr.a (mgr.14388) 3816 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:27 smithi191 bash[24992]: cluster 2024-08-31T03:39:26.292168+0000 mgr.a (mgr.14388) 3816 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:27.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:27 smithi163 bash[24253]: cluster 2024-08-31T03:39:26.292168+0000 mgr.a (mgr.14388) 3816 : cluster [DBG] pgmap v2643: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:29 smithi027 bash[22610]: cluster 2024-08-31T03:39:28.294362+0000 mgr.a (mgr.14388) 3817 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:29 smithi191 bash[24992]: cluster 2024-08-31T03:39:28.294362+0000 mgr.a (mgr.14388) 3817 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:29.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:29 smithi163 bash[24253]: cluster 2024-08-31T03:39:28.294362+0000 mgr.a (mgr.14388) 3817 : cluster [DBG] pgmap v2644: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:39:30.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:30.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:30.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:31.355 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:39:31.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:39:31.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:39:31.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:39:31.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:39:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:31 smithi027 bash[22610]: cluster 2024-08-31T03:39:30.295327+0000 mgr.a (mgr.14388) 3818 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:31 smithi191 bash[24992]: cluster 2024-08-31T03:39:30.295327+0000 mgr.a (mgr.14388) 3818 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:31.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:31 smithi163 bash[24253]: cluster 2024-08-31T03:39:30.295327+0000 mgr.a (mgr.14388) 3818 : cluster [DBG] pgmap v2645: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:32 smithi027 bash[22610]: audit 2024-08-31T03:39:30.918582+0000 mgr.a (mgr.14388) 3819 : audit [DBG] from='client.93396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:32 smithi191 bash[24992]: audit 2024-08-31T03:39:30.918582+0000 mgr.a (mgr.14388) 3819 : audit [DBG] from='client.93396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:32.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:32 smithi163 bash[24253]: audit 2024-08-31T03:39:30.918582+0000 mgr.a (mgr.14388) 3819 : audit [DBG] from='client.93396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:33 smithi027 bash[22610]: cluster 2024-08-31T03:39:32.296287+0000 mgr.a (mgr.14388) 3820 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:33 smithi191 bash[24992]: cluster 2024-08-31T03:39:32.296287+0000 mgr.a (mgr.14388) 3820 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:33.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:33 smithi163 bash[24253]: cluster 2024-08-31T03:39:32.296287+0000 mgr.a (mgr.14388) 3820 : cluster [DBG] pgmap v2646: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:35 smithi027 bash[22610]: cluster 2024-08-31T03:39:34.298475+0000 mgr.a (mgr.14388) 3821 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:35 smithi191 bash[24992]: cluster 2024-08-31T03:39:34.298475+0000 mgr.a (mgr.14388) 3821 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:35.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:35 smithi163 bash[24253]: cluster 2024-08-31T03:39:34.298475+0000 mgr.a (mgr.14388) 3821 : cluster [DBG] pgmap v2647: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:36.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:36.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:36.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:37.092 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:39:37.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:39:37.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:39:37.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:39:37.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:39:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:37 smithi191 bash[24992]: cluster 2024-08-31T03:39:36.299279+0000 mgr.a (mgr.14388) 3822 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:37 smithi191 bash[24992]: audit 2024-08-31T03:39:36.688435+0000 mgr.a (mgr.14388) 3823 : audit [DBG] from='client.93471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:37.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:37 smithi163 bash[24253]: cluster 2024-08-31T03:39:36.299279+0000 mgr.a (mgr.14388) 3822 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:37.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:37 smithi163 bash[24253]: audit 2024-08-31T03:39:36.688435+0000 mgr.a (mgr.14388) 3823 : audit [DBG] from='client.93471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:37 smithi027 bash[22610]: cluster 2024-08-31T03:39:36.299279+0000 mgr.a (mgr.14388) 3822 : cluster [DBG] pgmap v2648: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:37 smithi027 bash[22610]: audit 2024-08-31T03:39:36.688435+0000 mgr.a (mgr.14388) 3823 : audit [DBG] from='client.93471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:39 smithi191 bash[24992]: cluster 2024-08-31T03:39:38.301474+0000 mgr.a (mgr.14388) 3824 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:39.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:39 smithi163 bash[24253]: cluster 2024-08-31T03:39:38.301474+0000 mgr.a (mgr.14388) 3824 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:39 smithi027 bash[22610]: cluster 2024-08-31T03:39:38.301474+0000 mgr.a (mgr.14388) 3824 : cluster [DBG] pgmap v2649: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:41 smithi191 bash[24992]: cluster 2024-08-31T03:39:40.302260+0000 mgr.a (mgr.14388) 3825 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:41 smithi163 bash[24253]: cluster 2024-08-31T03:39:40.302260+0000 mgr.a (mgr.14388) 3825 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:41 smithi027 bash[22610]: cluster 2024-08-31T03:39:40.302260+0000 mgr.a (mgr.14388) 3825 : cluster [DBG] pgmap v2650: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:42.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:42.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:42.095 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:42.864 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:39:42.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:39:42.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:39:42.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:39:42.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:39:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:43 smithi191 bash[24992]: cluster 2024-08-31T03:39:42.302827+0000 mgr.a (mgr.14388) 3826 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:43 smithi191 bash[24992]: audit 2024-08-31T03:39:42.428851+0000 mgr.a (mgr.14388) 3827 : audit [DBG] from='client.93549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:43.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:43 smithi163 bash[24253]: cluster 2024-08-31T03:39:42.302827+0000 mgr.a (mgr.14388) 3826 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:43.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:43 smithi163 bash[24253]: audit 2024-08-31T03:39:42.428851+0000 mgr.a (mgr.14388) 3827 : audit [DBG] from='client.93549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:43 smithi027 bash[22610]: cluster 2024-08-31T03:39:42.302827+0000 mgr.a (mgr.14388) 3826 : cluster [DBG] pgmap v2651: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:43 smithi027 bash[22610]: audit 2024-08-31T03:39:42.428851+0000 mgr.a (mgr.14388) 3827 : audit [DBG] from='client.93549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:45 smithi191 bash[24992]: cluster 2024-08-31T03:39:44.305107+0000 mgr.a (mgr.14388) 3828 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:45.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:45 smithi163 bash[24253]: cluster 2024-08-31T03:39:44.305107+0000 mgr.a (mgr.14388) 3828 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:45 smithi027 bash[22610]: cluster 2024-08-31T03:39:44.305107+0000 mgr.a (mgr.14388) 3828 : cluster [DBG] pgmap v2652: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:39:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:47 smithi191 bash[24992]: cluster 2024-08-31T03:39:46.305926+0000 mgr.a (mgr.14388) 3829 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:47.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:47.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:47 smithi163 bash[24253]: cluster 2024-08-31T03:39:46.305926+0000 mgr.a (mgr.14388) 3829 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:47 smithi027 bash[22610]: cluster 2024-08-31T03:39:46.305926+0000 mgr.a (mgr.14388) 3829 : cluster [DBG] pgmap v2653: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:48.647 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:39:48.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:39:48.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:39:48.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:39:48.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:39:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:49 smithi191 bash[24992]: audit 2024-08-31T03:39:48.203339+0000 mgr.a (mgr.14388) 3830 : audit [DBG] from='client.93627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:49 smithi191 bash[24992]: cluster 2024-08-31T03:39:48.307286+0000 mgr.a (mgr.14388) 3831 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:49.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:49 smithi163 bash[24253]: audit 2024-08-31T03:39:48.203339+0000 mgr.a (mgr.14388) 3830 : audit [DBG] from='client.93627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:49.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:49 smithi163 bash[24253]: cluster 2024-08-31T03:39:48.307286+0000 mgr.a (mgr.14388) 3831 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:49 smithi027 bash[22610]: audit 2024-08-31T03:39:48.203339+0000 mgr.a (mgr.14388) 3830 : audit [DBG] from='client.93627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:49 smithi027 bash[22610]: cluster 2024-08-31T03:39:48.307286+0000 mgr.a (mgr.14388) 3831 : cluster [DBG] pgmap v2654: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:51 smithi191 bash[24992]: cluster 2024-08-31T03:39:50.308150+0000 mgr.a (mgr.14388) 3832 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:39:51.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:51 smithi163 bash[24253]: cluster 2024-08-31T03:39:50.308150+0000 mgr.a (mgr.14388) 3832 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:39:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:51 smithi027 bash[22610]: cluster 2024-08-31T03:39:50.308150+0000 mgr.a (mgr.14388) 3832 : cluster [DBG] pgmap v2655: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:39:53.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:53.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:53.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:53 smithi191 bash[24992]: cluster 2024-08-31T03:39:52.308953+0000 mgr.a (mgr.14388) 3833 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:39:53.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:53 smithi163 bash[24253]: cluster 2024-08-31T03:39:52.308953+0000 mgr.a (mgr.14388) 3833 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:39:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:53 smithi027 bash[22610]: cluster 2024-08-31T03:39:52.308953+0000 mgr.a (mgr.14388) 3833 : cluster [DBG] pgmap v2656: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:39:54.391 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:39:54.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:39:54.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:39:54.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:39:54.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:39:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:55 smithi191 bash[24992]: audit 2024-08-31T03:39:53.981092+0000 mgr.a (mgr.14388) 3834 : audit [DBG] from='client.93702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:55 smithi191 bash[24992]: cluster 2024-08-31T03:39:54.310659+0000 mgr.a (mgr.14388) 3835 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:55 smithi163 bash[24253]: audit 2024-08-31T03:39:53.981092+0000 mgr.a (mgr.14388) 3834 : audit [DBG] from='client.93702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:55.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:55 smithi163 bash[24253]: cluster 2024-08-31T03:39:54.310659+0000 mgr.a (mgr.14388) 3835 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:55 smithi027 bash[22610]: audit 2024-08-31T03:39:53.981092+0000 mgr.a (mgr.14388) 3834 : audit [DBG] from='client.93702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:39:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:55 smithi027 bash[22610]: cluster 2024-08-31T03:39:54.310659+0000 mgr.a (mgr.14388) 3835 : cluster [DBG] pgmap v2657: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:57 smithi191 bash[24992]: cluster 2024-08-31T03:39:56.311432+0000 mgr.a (mgr.14388) 3836 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:39:57.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:57 smithi163 bash[24253]: cluster 2024-08-31T03:39:56.311432+0000 mgr.a (mgr.14388) 3836 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:39:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:57 smithi027 bash[22610]: cluster 2024-08-31T03:39:56.311432+0000 mgr.a (mgr.14388) 3836 : cluster [DBG] pgmap v2658: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:39:59.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:39:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:39:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:39:59.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:39:59 smithi163 bash[24253]: cluster 2024-08-31T03:39:58.313354+0000 mgr.a (mgr.14388) 3837 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:39:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:39:59 smithi027 bash[22610]: cluster 2024-08-31T03:39:58.313354+0000 mgr.a (mgr.14388) 3837 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:39:59 smithi191 bash[24992]: cluster 2024-08-31T03:39:58.313354+0000 mgr.a (mgr.14388) 3837 : cluster [DBG] pgmap v2659: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:00.148 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:00.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:00.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:00.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:00.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:00.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:00 smithi163 bash[24253]: audit 2024-08-31T03:39:59.725864+0000 mgr.a (mgr.14388) 3838 : audit [DBG] from='client.93780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:00.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:00 smithi163 bash[24253]: cluster 2024-08-31T03:40:00.000120+0000 mon.a (mon.0) 1158 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:40:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:00 smithi027 bash[22610]: audit 2024-08-31T03:39:59.725864+0000 mgr.a (mgr.14388) 3838 : audit [DBG] from='client.93780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:00 smithi027 bash[22610]: cluster 2024-08-31T03:40:00.000120+0000 mon.a (mon.0) 1158 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:40:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:00 smithi191 bash[24992]: audit 2024-08-31T03:39:59.725864+0000 mgr.a (mgr.14388) 3838 : audit [DBG] from='client.93780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:00 smithi191 bash[24992]: cluster 2024-08-31T03:40:00.000120+0000 mon.a (mon.0) 1158 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:40:01.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:01 smithi163 bash[24253]: cluster 2024-08-31T03:40:00.314495+0000 mgr.a (mgr.14388) 3839 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:01 smithi027 bash[22610]: cluster 2024-08-31T03:40:00.314495+0000 mgr.a (mgr.14388) 3839 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:01 smithi191 bash[24992]: cluster 2024-08-31T03:40:00.314495+0000 mgr.a (mgr.14388) 3839 : cluster [DBG] pgmap v2660: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:03.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:03 smithi163 bash[24253]: cluster 2024-08-31T03:40:02.315469+0000 mgr.a (mgr.14388) 3840 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:03 smithi027 bash[22610]: cluster 2024-08-31T03:40:02.315469+0000 mgr.a (mgr.14388) 3840 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:03 smithi191 bash[24992]: cluster 2024-08-31T03:40:02.315469+0000 mgr.a (mgr.14388) 3840 : cluster [DBG] pgmap v2661: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:05.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:40:05.151 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:40:05.151 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:40:05.910 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:05.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:05.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:05.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:05.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:05.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:05 smithi163 bash[24253]: cluster 2024-08-31T03:40:04.317779+0000 mgr.a (mgr.14388) 3841 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:05 smithi027 bash[22610]: cluster 2024-08-31T03:40:04.317779+0000 mgr.a (mgr.14388) 3841 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:05 smithi191 bash[24992]: cluster 2024-08-31T03:40:04.317779+0000 mgr.a (mgr.14388) 3841 : cluster [DBG] pgmap v2662: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:06.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:06 smithi163 bash[24253]: audit 2024-08-31T03:40:05.480737+0000 mgr.a (mgr.14388) 3842 : audit [DBG] from='client.93858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:06 smithi027 bash[22610]: audit 2024-08-31T03:40:05.480737+0000 mgr.a (mgr.14388) 3842 : audit [DBG] from='client.93858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:06 smithi191 bash[24992]: audit 2024-08-31T03:40:05.480737+0000 mgr.a (mgr.14388) 3842 : audit [DBG] from='client.93858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:07.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:07 smithi163 bash[24253]: cluster 2024-08-31T03:40:06.318915+0000 mgr.a (mgr.14388) 3843 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:07 smithi027 bash[22610]: cluster 2024-08-31T03:40:06.318915+0000 mgr.a (mgr.14388) 3843 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:07 smithi191 bash[24992]: cluster 2024-08-31T03:40:06.318915+0000 mgr.a (mgr.14388) 3843 : cluster [DBG] pgmap v2663: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:09.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:09 smithi163 bash[24253]: cluster 2024-08-31T03:40:08.321078+0000 mgr.a (mgr.14388) 3844 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:09 smithi027 bash[22610]: cluster 2024-08-31T03:40:08.321078+0000 mgr.a (mgr.14388) 3844 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:09 smithi191 bash[24992]: cluster 2024-08-31T03:40:08.321078+0000 mgr.a (mgr.14388) 3844 : cluster [DBG] pgmap v2664: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:10.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:40:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:40:10.912 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:40:11.688 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:11.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:11.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:11.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:11.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:11.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:11 smithi163 bash[24253]: cluster 2024-08-31T03:40:10.321853+0000 mgr.a (mgr.14388) 3845 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:11 smithi027 bash[22610]: cluster 2024-08-31T03:40:10.321853+0000 mgr.a (mgr.14388) 3845 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:11 smithi191 bash[24992]: cluster 2024-08-31T03:40:10.321853+0000 mgr.a (mgr.14388) 3845 : cluster [DBG] pgmap v2665: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:12.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:12 smithi163 bash[24253]: audit 2024-08-31T03:40:11.248145+0000 mgr.a (mgr.14388) 3846 : audit [DBG] from='client.93933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:12 smithi027 bash[22610]: audit 2024-08-31T03:40:11.248145+0000 mgr.a (mgr.14388) 3846 : audit [DBG] from='client.93933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:12 smithi191 bash[24992]: audit 2024-08-31T03:40:11.248145+0000 mgr.a (mgr.14388) 3846 : audit [DBG] from='client.93933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:13.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:13 smithi163 bash[24253]: cluster 2024-08-31T03:40:12.322944+0000 mgr.a (mgr.14388) 3847 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:13 smithi027 bash[22610]: cluster 2024-08-31T03:40:12.322944+0000 mgr.a (mgr.14388) 3847 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:13 smithi191 bash[24992]: cluster 2024-08-31T03:40:12.322944+0000 mgr.a (mgr.14388) 3847 : cluster [DBG] pgmap v2666: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:14.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:14 smithi163 bash[24253]: audit 2024-08-31T03:40:13.669000+0000 mon.a (mon.0) 1159 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:40:14.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:14 smithi163 bash[24253]: audit 2024-08-31T03:40:14.274278+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:14.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:14 smithi163 bash[24253]: audit 2024-08-31T03:40:14.277756+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:14 smithi027 bash[22610]: audit 2024-08-31T03:40:13.669000+0000 mon.a (mon.0) 1159 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:40:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:14 smithi027 bash[22610]: audit 2024-08-31T03:40:14.274278+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:14 smithi027 bash[22610]: audit 2024-08-31T03:40:14.277756+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:14 smithi191 bash[24992]: audit 2024-08-31T03:40:13.669000+0000 mon.a (mon.0) 1159 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:40:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:14 smithi191 bash[24992]: audit 2024-08-31T03:40:14.274278+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:14 smithi191 bash[24992]: audit 2024-08-31T03:40:14.277756+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:15.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:15 smithi163 bash[24253]: cluster 2024-08-31T03:40:14.324621+0000 mgr.a (mgr.14388) 3848 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:15 smithi027 bash[22610]: cluster 2024-08-31T03:40:14.324621+0000 mgr.a (mgr.14388) 3848 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:15 smithi191 bash[24992]: cluster 2024-08-31T03:40:14.324621+0000 mgr.a (mgr.14388) 3848 : cluster [DBG] pgmap v2667: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:16.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:40:16.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:40:16.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:40:17.423 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:17.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:17.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:17.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:17 smithi163 bash[24253]: cluster 2024-08-31T03:40:16.325386+0000 mgr.a (mgr.14388) 3849 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:17 smithi027 bash[22610]: cluster 2024-08-31T03:40:16.325386+0000 mgr.a (mgr.14388) 3849 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:17 smithi191 bash[24992]: cluster 2024-08-31T03:40:16.325386+0000 mgr.a (mgr.14388) 3849 : cluster [DBG] pgmap v2668: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:18.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:18 smithi163 bash[24253]: audit 2024-08-31T03:40:17.024155+0000 mgr.a (mgr.14388) 3850 : audit [DBG] from='client.94008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:18 smithi027 bash[22610]: audit 2024-08-31T03:40:17.024155+0000 mgr.a (mgr.14388) 3850 : audit [DBG] from='client.94008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:18 smithi191 bash[24992]: audit 2024-08-31T03:40:17.024155+0000 mgr.a (mgr.14388) 3850 : audit [DBG] from='client.94008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:19.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:19 smithi163 bash[24253]: cluster 2024-08-31T03:40:18.327649+0000 mgr.a (mgr.14388) 3851 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:19 smithi027 bash[22610]: cluster 2024-08-31T03:40:18.327649+0000 mgr.a (mgr.14388) 3851 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:19 smithi191 bash[24992]: cluster 2024-08-31T03:40:18.327649+0000 mgr.a (mgr.14388) 3851 : cluster [DBG] pgmap v2669: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:21 smithi027 bash[22610]: cluster 2024-08-31T03:40:20.328487+0000 mgr.a (mgr.14388) 3852 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:21.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:21 smithi163 bash[24253]: cluster 2024-08-31T03:40:20.328487+0000 mgr.a (mgr.14388) 3852 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:21 smithi191 bash[24992]: cluster 2024-08-31T03:40:20.328487+0000 mgr.a (mgr.14388) 3852 : cluster [DBG] pgmap v2670: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:22.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:40:22.425 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:40:22.425 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:40:23.208 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:23.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:23 smithi163 bash[24253]: cluster 2024-08-31T03:40:22.329218+0000 mgr.a (mgr.14388) 3853 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:23.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:23 smithi163 bash[24253]: audit 2024-08-31T03:40:22.762270+0000 mgr.a (mgr.14388) 3854 : audit [DBG] from='client.94083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:23.971 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:23 smithi027 bash[22610]: cluster 2024-08-31T03:40:22.329218+0000 mgr.a (mgr.14388) 3853 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:23.971 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:23 smithi027 bash[22610]: audit 2024-08-31T03:40:22.762270+0000 mgr.a (mgr.14388) 3854 : audit [DBG] from='client.94083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:23 smithi191 bash[24992]: cluster 2024-08-31T03:40:22.329218+0000 mgr.a (mgr.14388) 3853 : cluster [DBG] pgmap v2671: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:23 smithi191 bash[24992]: audit 2024-08-31T03:40:22.762270+0000 mgr.a (mgr.14388) 3854 : audit [DBG] from='client.94083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:25.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:40:25 smithi027 bash[22863]: debug 2024-08-31T03:40:25.513+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:40:25.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:40:25 smithi027 bash[22863]: debug 2024-08-31T03:40:25.517+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:40:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:25 smithi027 bash[22610]: cluster 2024-08-31T03:40:24.331903+0000 mgr.a (mgr.14388) 3855 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:25 smithi027 bash[22610]: audit 2024-08-31T03:40:24.717535+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:25 smithi027 bash[22610]: audit 2024-08-31T03:40:24.726067+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:25 smithi027 bash[22610]: audit 2024-08-31T03:40:24.728379+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:40:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:25 smithi027 bash[22610]: audit 2024-08-31T03:40:24.730079+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:40:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:25 smithi027 bash[22610]: audit 2024-08-31T03:40:24.740225+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:25 smithi027 bash[22610]: audit 2024-08-31T03:40:24.745520+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:40:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:25 smithi027 bash[22610]: audit 2024-08-31T03:40:24.748012+0000 mgr.a (mgr.14388) 3856 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:40:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:25 smithi191 bash[24992]: cluster 2024-08-31T03:40:24.331903+0000 mgr.a (mgr.14388) 3855 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:25 smithi191 bash[24992]: audit 2024-08-31T03:40:24.717535+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:25 smithi191 bash[24992]: audit 2024-08-31T03:40:24.726067+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:25 smithi191 bash[24992]: audit 2024-08-31T03:40:24.728379+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:40:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:25 smithi191 bash[24992]: audit 2024-08-31T03:40:24.730079+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:40:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:25 smithi191 bash[24992]: audit 2024-08-31T03:40:24.740225+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:25 smithi191 bash[24992]: audit 2024-08-31T03:40:24.745520+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:40:26.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:25 smithi191 bash[24992]: audit 2024-08-31T03:40:24.748012+0000 mgr.a (mgr.14388) 3856 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:40:26.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:25 smithi163 bash[24253]: cluster 2024-08-31T03:40:24.331903+0000 mgr.a (mgr.14388) 3855 : cluster [DBG] pgmap v2672: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:26.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:25 smithi163 bash[24253]: audit 2024-08-31T03:40:24.717535+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:26.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:25 smithi163 bash[24253]: audit 2024-08-31T03:40:24.726067+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:26.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:25 smithi163 bash[24253]: audit 2024-08-31T03:40:24.728379+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:40:26.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:25 smithi163 bash[24253]: audit 2024-08-31T03:40:24.730079+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:40:26.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:25 smithi163 bash[24253]: audit 2024-08-31T03:40:24.740225+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:40:26.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:25 smithi163 bash[24253]: audit 2024-08-31T03:40:24.745520+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:40:26.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:25 smithi163 bash[24253]: audit 2024-08-31T03:40:24.748012+0000 mgr.a (mgr.14388) 3856 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:40:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:26 smithi027 bash[22610]: audit 2024-08-31T03:40:25.517552+0000 mgr.a (mgr.14388) 3857 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:40:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:26 smithi027 bash[22610]: cephadm 2024-08-31T03:40:25.519151+0000 mgr.a (mgr.14388) 3858 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:40:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:26 smithi191 bash[24992]: audit 2024-08-31T03:40:25.517552+0000 mgr.a (mgr.14388) 3857 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:40:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:26 smithi191 bash[24992]: cephadm 2024-08-31T03:40:25.519151+0000 mgr.a (mgr.14388) 3858 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:40:27.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:26 smithi163 bash[24253]: audit 2024-08-31T03:40:25.517552+0000 mgr.a (mgr.14388) 3857 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:40:27.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:26 smithi163 bash[24253]: cephadm 2024-08-31T03:40:25.519151+0000 mgr.a (mgr.14388) 3858 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:40:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:27 smithi027 bash[22610]: cluster 2024-08-31T03:40:26.332785+0000 mgr.a (mgr.14388) 3859 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:40:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:27 smithi191 bash[24992]: cluster 2024-08-31T03:40:26.332785+0000 mgr.a (mgr.14388) 3859 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:40:28.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:27 smithi163 bash[24253]: cluster 2024-08-31T03:40:26.332785+0000 mgr.a (mgr.14388) 3859 : cluster [DBG] pgmap v2673: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:40:28.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:40:28.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:40:28.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:40:28.950 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:28.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:28.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:28.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:28.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:29 smithi027 bash[22610]: cluster 2024-08-31T03:40:28.333864+0000 mgr.a (mgr.14388) 3860 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:29 smithi027 bash[22610]: audit 2024-08-31T03:40:28.543242+0000 mgr.a (mgr.14388) 3861 : audit [DBG] from='client.94263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:29 smithi191 bash[24992]: cluster 2024-08-31T03:40:28.333864+0000 mgr.a (mgr.14388) 3860 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:29 smithi191 bash[24992]: audit 2024-08-31T03:40:28.543242+0000 mgr.a (mgr.14388) 3861 : audit [DBG] from='client.94263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:30.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:29 smithi163 bash[24253]: cluster 2024-08-31T03:40:28.333864+0000 mgr.a (mgr.14388) 3860 : cluster [DBG] pgmap v2674: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:30.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:29 smithi163 bash[24253]: audit 2024-08-31T03:40:28.543242+0000 mgr.a (mgr.14388) 3861 : audit [DBG] from='client.94263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:31 smithi191 bash[24992]: cluster 2024-08-31T03:40:30.334707+0000 mgr.a (mgr.14388) 3862 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:40:32.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:31 smithi163 bash[24253]: cluster 2024-08-31T03:40:30.334707+0000 mgr.a (mgr.14388) 3862 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:40:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:31 smithi027 bash[22610]: cluster 2024-08-31T03:40:30.334707+0000 mgr.a (mgr.14388) 3862 : cluster [DBG] pgmap v2675: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:40:33.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:40:33.953 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:40:33.953 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:40:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:33 smithi191 bash[24992]: cluster 2024-08-31T03:40:32.335520+0000 mgr.a (mgr.14388) 3863 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:40:34.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:33 smithi163 bash[24253]: cluster 2024-08-31T03:40:32.335520+0000 mgr.a (mgr.14388) 3863 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:40:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:33 smithi027 bash[22610]: cluster 2024-08-31T03:40:32.335520+0000 mgr.a (mgr.14388) 3863 : cluster [DBG] pgmap v2676: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:40:34.727 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:34.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:34.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:34.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:34.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:35 smithi191 bash[24992]: audit 2024-08-31T03:40:34.287228+0000 mgr.a (mgr.14388) 3864 : audit [DBG] from='client.94341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:35 smithi191 bash[24992]: cluster 2024-08-31T03:40:34.338461+0000 mgr.a (mgr.14388) 3865 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:36.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:35 smithi163 bash[24253]: audit 2024-08-31T03:40:34.287228+0000 mgr.a (mgr.14388) 3864 : audit [DBG] from='client.94341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:36.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:35 smithi163 bash[24253]: cluster 2024-08-31T03:40:34.338461+0000 mgr.a (mgr.14388) 3865 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:35 smithi027 bash[22610]: audit 2024-08-31T03:40:34.287228+0000 mgr.a (mgr.14388) 3864 : audit [DBG] from='client.94341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:35 smithi027 bash[22610]: cluster 2024-08-31T03:40:34.338461+0000 mgr.a (mgr.14388) 3865 : cluster [DBG] pgmap v2677: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:37 smithi191 bash[24992]: cluster 2024-08-31T03:40:36.339515+0000 mgr.a (mgr.14388) 3866 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:38.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:37 smithi163 bash[24253]: cluster 2024-08-31T03:40:36.339515+0000 mgr.a (mgr.14388) 3866 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:37 smithi027 bash[22610]: cluster 2024-08-31T03:40:36.339515+0000 mgr.a (mgr.14388) 3866 : cluster [DBG] pgmap v2678: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:39.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:40:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:40:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:40:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:39 smithi191 bash[24992]: cluster 2024-08-31T03:40:38.341689+0000 mgr.a (mgr.14388) 3867 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:39 smithi163 bash[24253]: cluster 2024-08-31T03:40:38.341689+0000 mgr.a (mgr.14388) 3867 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:39 smithi027 bash[22610]: cluster 2024-08-31T03:40:38.341689+0000 mgr.a (mgr.14388) 3867 : cluster [DBG] pgmap v2679: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:40:40.496 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:40.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:40.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:40.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:40.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:41 smithi191 bash[24992]: audit 2024-08-31T03:40:40.063128+0000 mgr.a (mgr.14388) 3868 : audit [DBG] from='client.94419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:41 smithi191 bash[24992]: cluster 2024-08-31T03:40:40.342230+0000 mgr.a (mgr.14388) 3869 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:42.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:41 smithi163 bash[24253]: audit 2024-08-31T03:40:40.063128+0000 mgr.a (mgr.14388) 3868 : audit [DBG] from='client.94419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:42.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:41 smithi163 bash[24253]: cluster 2024-08-31T03:40:40.342230+0000 mgr.a (mgr.14388) 3869 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:41 smithi027 bash[22610]: audit 2024-08-31T03:40:40.063128+0000 mgr.a (mgr.14388) 3868 : audit [DBG] from='client.94419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:41 smithi027 bash[22610]: cluster 2024-08-31T03:40:40.342230+0000 mgr.a (mgr.14388) 3869 : cluster [DBG] pgmap v2680: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:43 smithi191 bash[24992]: cluster 2024-08-31T03:40:42.343197+0000 mgr.a (mgr.14388) 3870 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:44.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:43 smithi163 bash[24253]: cluster 2024-08-31T03:40:42.343197+0000 mgr.a (mgr.14388) 3870 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:43 smithi027 bash[22610]: cluster 2024-08-31T03:40:42.343197+0000 mgr.a (mgr.14388) 3870 : cluster [DBG] pgmap v2681: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:45.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:40:45.498 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:40:45.498 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:40:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:45 smithi191 bash[24992]: cluster 2024-08-31T03:40:44.345449+0000 mgr.a (mgr.14388) 3871 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:45 smithi163 bash[24253]: cluster 2024-08-31T03:40:44.345449+0000 mgr.a (mgr.14388) 3871 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:45 smithi027 bash[22610]: cluster 2024-08-31T03:40:44.345449+0000 mgr.a (mgr.14388) 3871 : cluster [DBG] pgmap v2682: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:46.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:46.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:46 smithi191 bash[24992]: audit 2024-08-31T03:40:45.828587+0000 mgr.a (mgr.14388) 3872 : audit [DBG] from='client.94497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:47.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:46 smithi163 bash[24253]: audit 2024-08-31T03:40:45.828587+0000 mgr.a (mgr.14388) 3872 : audit [DBG] from='client.94497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:46 smithi027 bash[22610]: audit 2024-08-31T03:40:45.828587+0000 mgr.a (mgr.14388) 3872 : audit [DBG] from='client.94497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:47 smithi191 bash[24992]: cluster 2024-08-31T03:40:46.346391+0000 mgr.a (mgr.14388) 3873 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:48.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:47 smithi163 bash[24253]: cluster 2024-08-31T03:40:46.346391+0000 mgr.a (mgr.14388) 3873 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:47 smithi027 bash[22610]: cluster 2024-08-31T03:40:46.346391+0000 mgr.a (mgr.14388) 3873 : cluster [DBG] pgmap v2683: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:49 smithi191 bash[24992]: cluster 2024-08-31T03:40:48.348587+0000 mgr.a (mgr.14388) 3874 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:50.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:49 smithi163 bash[24253]: cluster 2024-08-31T03:40:48.348587+0000 mgr.a (mgr.14388) 3874 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:49 smithi027 bash[22610]: cluster 2024-08-31T03:40:48.348587+0000 mgr.a (mgr.14388) 3874 : cluster [DBG] pgmap v2684: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:51.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:40:51.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:40:51.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:40:51.989 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:51 smithi191 bash[24992]: cluster 2024-08-31T03:40:50.349347+0000 mgr.a (mgr.14388) 3875 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:52.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:51 smithi163 bash[24253]: cluster 2024-08-31T03:40:50.349347+0000 mgr.a (mgr.14388) 3875 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:51 smithi027 bash[22610]: cluster 2024-08-31T03:40:50.349347+0000 mgr.a (mgr.14388) 3875 : cluster [DBG] pgmap v2685: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:52 smithi191 bash[24992]: audit 2024-08-31T03:40:51.584242+0000 mgr.a (mgr.14388) 3876 : audit [DBG] from='client.94575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:53.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:52 smithi163 bash[24253]: audit 2024-08-31T03:40:51.584242+0000 mgr.a (mgr.14388) 3876 : audit [DBG] from='client.94575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:52 smithi027 bash[22610]: audit 2024-08-31T03:40:51.584242+0000 mgr.a (mgr.14388) 3876 : audit [DBG] from='client.94575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:54.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:53 smithi163 bash[24253]: cluster 2024-08-31T03:40:52.350343+0000 mgr.a (mgr.14388) 3877 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:53 smithi027 bash[22610]: cluster 2024-08-31T03:40:52.350343+0000 mgr.a (mgr.14388) 3877 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:53 smithi191 bash[24992]: cluster 2024-08-31T03:40:52.350343+0000 mgr.a (mgr.14388) 3877 : cluster [DBG] pgmap v2686: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:56.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:55 smithi163 bash[24253]: cluster 2024-08-31T03:40:54.352698+0000 mgr.a (mgr.14388) 3878 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:55 smithi027 bash[22610]: cluster 2024-08-31T03:40:54.352698+0000 mgr.a (mgr.14388) 3878 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:55 smithi191 bash[24992]: cluster 2024-08-31T03:40:54.352698+0000 mgr.a (mgr.14388) 3878 : cluster [DBG] pgmap v2687: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:40:56.990 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:40:56.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:40:56.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:40:57.769 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:40:57.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:40:57.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:40:57.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:40:57.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:40:58.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:57 smithi163 bash[24253]: cluster 2024-08-31T03:40:56.353648+0000 mgr.a (mgr.14388) 3879 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:57 smithi027 bash[22610]: cluster 2024-08-31T03:40:56.353648+0000 mgr.a (mgr.14388) 3879 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:57 smithi191 bash[24992]: cluster 2024-08-31T03:40:56.353648+0000 mgr.a (mgr.14388) 3879 : cluster [DBG] pgmap v2688: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:40:59.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:58 smithi163 bash[24253]: audit 2024-08-31T03:40:57.327480+0000 mgr.a (mgr.14388) 3880 : audit [DBG] from='client.94650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:58 smithi027 bash[22610]: audit 2024-08-31T03:40:57.327480+0000 mgr.a (mgr.14388) 3880 : audit [DBG] from='client.94650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:40:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:58 smithi191 bash[24992]: audit 2024-08-31T03:40:57.327480+0000 mgr.a (mgr.14388) 3880 : audit [DBG] from='client.94650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:40:59 smithi163 bash[24253]: cluster 2024-08-31T03:40:58.356030+0000 mgr.a (mgr.14388) 3881 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:40:59 smithi027 bash[22610]: cluster 2024-08-31T03:40:58.356030+0000 mgr.a (mgr.14388) 3881 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:40:59 smithi191 bash[24992]: cluster 2024-08-31T03:40:58.356030+0000 mgr.a (mgr.14388) 3881 : cluster [DBG] pgmap v2689: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:02.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:01 smithi163 bash[24253]: cluster 2024-08-31T03:41:00.356973+0000 mgr.a (mgr.14388) 3882 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:01 smithi027 bash[22610]: cluster 2024-08-31T03:41:00.356973+0000 mgr.a (mgr.14388) 3882 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:01 smithi191 bash[24992]: cluster 2024-08-31T03:41:00.356973+0000 mgr.a (mgr.14388) 3882 : cluster [DBG] pgmap v2690: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:02.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:41:02.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:41:02.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:41:03.547 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:41:03.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:41:03.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:41:03.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:41:03.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:41:04.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:03 smithi163 bash[24253]: cluster 2024-08-31T03:41:02.357886+0000 mgr.a (mgr.14388) 3883 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:03 smithi027 bash[22610]: cluster 2024-08-31T03:41:02.357886+0000 mgr.a (mgr.14388) 3883 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:03 smithi191 bash[24992]: cluster 2024-08-31T03:41:02.357886+0000 mgr.a (mgr.14388) 3883 : cluster [DBG] pgmap v2691: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:05.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:04 smithi163 bash[24253]: audit 2024-08-31T03:41:03.111529+0000 mgr.a (mgr.14388) 3884 : audit [DBG] from='client.94728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:04 smithi027 bash[22610]: audit 2024-08-31T03:41:03.111529+0000 mgr.a (mgr.14388) 3884 : audit [DBG] from='client.94728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:04 smithi191 bash[24992]: audit 2024-08-31T03:41:03.111529+0000 mgr.a (mgr.14388) 3884 : audit [DBG] from='client.94728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:06.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:05 smithi163 bash[24253]: cluster 2024-08-31T03:41:04.360579+0000 mgr.a (mgr.14388) 3885 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:05 smithi027 bash[22610]: cluster 2024-08-31T03:41:04.360579+0000 mgr.a (mgr.14388) 3885 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:05 smithi191 bash[24992]: cluster 2024-08-31T03:41:04.360579+0000 mgr.a (mgr.14388) 3885 : cluster [DBG] pgmap v2692: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:07 smithi027 bash[22610]: cluster 2024-08-31T03:41:06.361385+0000 mgr.a (mgr.14388) 3886 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:41:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:07 smithi191 bash[24992]: cluster 2024-08-31T03:41:06.361385+0000 mgr.a (mgr.14388) 3886 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:41:07.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:07 smithi163 bash[24253]: cluster 2024-08-31T03:41:06.361385+0000 mgr.a (mgr.14388) 3886 : cluster [DBG] pgmap v2693: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:41:08.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:41:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:41:08.550 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:41:09.319 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:41:09.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:41:09.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:41:09.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:41:09.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:41:09.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:09 smithi163 bash[24253]: cluster 2024-08-31T03:41:08.363329+0000 mgr.a (mgr.14388) 3887 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:09.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:09 smithi163 bash[24253]: audit 2024-08-31T03:41:08.888928+0000 mgr.a (mgr.14388) 3888 : audit [DBG] from='client.94803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:09 smithi027 bash[22610]: cluster 2024-08-31T03:41:08.363329+0000 mgr.a (mgr.14388) 3887 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:09 smithi027 bash[22610]: audit 2024-08-31T03:41:08.888928+0000 mgr.a (mgr.14388) 3888 : audit [DBG] from='client.94803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:09 smithi191 bash[24992]: cluster 2024-08-31T03:41:08.363329+0000 mgr.a (mgr.14388) 3887 : cluster [DBG] pgmap v2694: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:09.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:09 smithi191 bash[24992]: audit 2024-08-31T03:41:08.888928+0000 mgr.a (mgr.14388) 3888 : audit [DBG] from='client.94803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:11.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:11 smithi163 bash[24253]: cluster 2024-08-31T03:41:10.364237+0000 mgr.a (mgr.14388) 3889 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:41:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:11 smithi027 bash[22610]: cluster 2024-08-31T03:41:10.364237+0000 mgr.a (mgr.14388) 3889 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:41:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:11 smithi191 bash[24992]: cluster 2024-08-31T03:41:10.364237+0000 mgr.a (mgr.14388) 3889 : cluster [DBG] pgmap v2695: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:41:13.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:13 smithi163 bash[24253]: cluster 2024-08-31T03:41:12.365029+0000 mgr.a (mgr.14388) 3890 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:41:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:13 smithi027 bash[22610]: cluster 2024-08-31T03:41:12.365029+0000 mgr.a (mgr.14388) 3890 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:41:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:13 smithi191 bash[24992]: cluster 2024-08-31T03:41:12.365029+0000 mgr.a (mgr.14388) 3890 : cluster [DBG] pgmap v2696: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:41:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:41:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:41:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:41:15.094 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:41:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:41:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:41:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:41:15.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:41:15.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:15 smithi163 bash[24253]: cluster 2024-08-31T03:41:14.367261+0000 mgr.a (mgr.14388) 3891 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:15.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:15 smithi163 bash[24253]: audit 2024-08-31T03:41:14.658363+0000 mgr.a (mgr.14388) 3892 : audit [DBG] from='client.94875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:15 smithi027 bash[22610]: cluster 2024-08-31T03:41:14.367261+0000 mgr.a (mgr.14388) 3891 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:15 smithi027 bash[22610]: audit 2024-08-31T03:41:14.658363+0000 mgr.a (mgr.14388) 3892 : audit [DBG] from='client.94875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:15 smithi191 bash[24992]: cluster 2024-08-31T03:41:14.367261+0000 mgr.a (mgr.14388) 3891 : cluster [DBG] pgmap v2697: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:15 smithi191 bash[24992]: audit 2024-08-31T03:41:14.658363+0000 mgr.a (mgr.14388) 3892 : audit [DBG] from='client.94875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:17 smithi027 bash[22610]: cluster 2024-08-31T03:41:16.368110+0000 mgr.a (mgr.14388) 3893 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:17 smithi191 bash[24992]: cluster 2024-08-31T03:41:16.368110+0000 mgr.a (mgr.14388) 3893 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:17.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:17 smithi163 bash[24253]: cluster 2024-08-31T03:41:16.368110+0000 mgr.a (mgr.14388) 3893 : cluster [DBG] pgmap v2698: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:19.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:19 smithi163 bash[24253]: cluster 2024-08-31T03:41:18.370235+0000 mgr.a (mgr.14388) 3894 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:19 smithi027 bash[22610]: cluster 2024-08-31T03:41:18.370235+0000 mgr.a (mgr.14388) 3894 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:19 smithi191 bash[24992]: cluster 2024-08-31T03:41:18.370235+0000 mgr.a (mgr.14388) 3894 : cluster [DBG] pgmap v2699: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:20.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:41:20.096 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:41:20.096 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:41:20.850 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:41:20.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:41:20.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:41:20.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:41:20.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:41:21.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:21 smithi163 bash[24253]: cluster 2024-08-31T03:41:20.370965+0000 mgr.a (mgr.14388) 3895 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:21.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:21 smithi163 bash[24253]: audit 2024-08-31T03:41:20.429374+0000 mgr.a (mgr.14388) 3896 : audit [DBG] from='client.94953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:21 smithi027 bash[22610]: cluster 2024-08-31T03:41:20.370965+0000 mgr.a (mgr.14388) 3895 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:21 smithi027 bash[22610]: audit 2024-08-31T03:41:20.429374+0000 mgr.a (mgr.14388) 3896 : audit [DBG] from='client.94953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:21 smithi191 bash[24992]: cluster 2024-08-31T03:41:20.370965+0000 mgr.a (mgr.14388) 3895 : cluster [DBG] pgmap v2700: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:21 smithi191 bash[24992]: audit 2024-08-31T03:41:20.429374+0000 mgr.a (mgr.14388) 3896 : audit [DBG] from='client.94953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:23.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:23 smithi163 bash[24253]: cluster 2024-08-31T03:41:22.371863+0000 mgr.a (mgr.14388) 3897 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:23 smithi027 bash[22610]: cluster 2024-08-31T03:41:22.371863+0000 mgr.a (mgr.14388) 3897 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:23 smithi191 bash[24992]: cluster 2024-08-31T03:41:22.371863+0000 mgr.a (mgr.14388) 3897 : cluster [DBG] pgmap v2701: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:25.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:25 smithi163 bash[24253]: cluster 2024-08-31T03:41:24.374070+0000 mgr.a (mgr.14388) 3898 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:25 smithi027 bash[22610]: cluster 2024-08-31T03:41:24.374070+0000 mgr.a (mgr.14388) 3898 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:25 smithi191 bash[24992]: cluster 2024-08-31T03:41:24.374070+0000 mgr.a (mgr.14388) 3898 : cluster [DBG] pgmap v2702: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:25.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:41:25.852 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:41:25.852 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:41:26.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:41:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:41:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:41:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:41:26.633 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:41:26.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:26 smithi163 bash[24253]: audit 2024-08-31T03:41:25.593025+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:41:26.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:26 smithi163 bash[24253]: audit 2024-08-31T03:41:26.216324+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:26 smithi163 bash[24253]: audit 2024-08-31T03:41:26.220273+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:26 smithi163 bash[24253]: audit 2024-08-31T03:41:26.223777+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:26 smithi163 bash[24253]: audit 2024-08-31T03:41:26.230713+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:26 smithi027 bash[22610]: audit 2024-08-31T03:41:25.593025+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:41:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:26 smithi027 bash[22610]: audit 2024-08-31T03:41:26.216324+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:26 smithi027 bash[22610]: audit 2024-08-31T03:41:26.220273+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:26 smithi027 bash[22610]: audit 2024-08-31T03:41:26.223777+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:26 smithi027 bash[22610]: audit 2024-08-31T03:41:26.230713+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:26 smithi191 bash[24992]: audit 2024-08-31T03:41:25.593025+0000 mon.a (mon.0) 1168 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:41:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:26 smithi191 bash[24992]: audit 2024-08-31T03:41:26.216324+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:26 smithi191 bash[24992]: audit 2024-08-31T03:41:26.220273+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:26 smithi191 bash[24992]: audit 2024-08-31T03:41:26.223777+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:26 smithi191 bash[24992]: audit 2024-08-31T03:41:26.230713+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:27 smithi027 bash[22610]: audit 2024-08-31T03:41:26.188009+0000 mgr.a (mgr.14388) 3899 : audit [DBG] from='client.95031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:27 smithi027 bash[22610]: cluster 2024-08-31T03:41:26.374595+0000 mgr.a (mgr.14388) 3900 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:27 smithi191 bash[24992]: audit 2024-08-31T03:41:26.188009+0000 mgr.a (mgr.14388) 3899 : audit [DBG] from='client.95031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:27 smithi191 bash[24992]: cluster 2024-08-31T03:41:26.374595+0000 mgr.a (mgr.14388) 3900 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:27.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:27 smithi163 bash[24253]: audit 2024-08-31T03:41:26.188009+0000 mgr.a (mgr.14388) 3899 : audit [DBG] from='client.95031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:27.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:27 smithi163 bash[24253]: cluster 2024-08-31T03:41:26.374595+0000 mgr.a (mgr.14388) 3900 : cluster [DBG] pgmap v2703: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:29 smithi027 bash[22610]: cluster 2024-08-31T03:41:28.376906+0000 mgr.a (mgr.14388) 3901 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:29 smithi191 bash[24992]: cluster 2024-08-31T03:41:28.376906+0000 mgr.a (mgr.14388) 3901 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:29.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:29 smithi163 bash[24253]: cluster 2024-08-31T03:41:28.376906+0000 mgr.a (mgr.14388) 3901 : cluster [DBG] pgmap v2704: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:31.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:41:31.635 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:41:31.635 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:41:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:31 smithi027 bash[22610]: cluster 2024-08-31T03:41:30.377856+0000 mgr.a (mgr.14388) 3902 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:31 smithi191 bash[24992]: cluster 2024-08-31T03:41:30.377856+0000 mgr.a (mgr.14388) 3902 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:31.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:31 smithi163 bash[24253]: cluster 2024-08-31T03:41:30.377856+0000 mgr.a (mgr.14388) 3902 : cluster [DBG] pgmap v2705: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:32.372 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:41:32.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:41:32.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:41:32.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:41:32.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:41:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:33 smithi191 bash[24992]: audit 2024-08-31T03:41:31.969866+0000 mgr.a (mgr.14388) 3903 : audit [DBG] from='client.95109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:33 smithi191 bash[24992]: cluster 2024-08-31T03:41:32.378633+0000 mgr.a (mgr.14388) 3904 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:33 smithi027 bash[22610]: audit 2024-08-31T03:41:31.969866+0000 mgr.a (mgr.14388) 3903 : audit [DBG] from='client.95109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:33 smithi027 bash[22610]: cluster 2024-08-31T03:41:32.378633+0000 mgr.a (mgr.14388) 3904 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:33.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:33 smithi163 bash[24253]: audit 2024-08-31T03:41:31.969866+0000 mgr.a (mgr.14388) 3903 : audit [DBG] from='client.95109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:33.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:33 smithi163 bash[24253]: cluster 2024-08-31T03:41:32.378633+0000 mgr.a (mgr.14388) 3904 : cluster [DBG] pgmap v2706: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:35.716 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:35 smithi191 bash[24992]: cluster 2024-08-31T03:41:34.380787+0000 mgr.a (mgr.14388) 3905 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:35 smithi027 bash[22610]: cluster 2024-08-31T03:41:34.380787+0000 mgr.a (mgr.14388) 3905 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:35.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:35 smithi163 bash[24253]: cluster 2024-08-31T03:41:34.380787+0000 mgr.a (mgr.14388) 3905 : cluster [DBG] pgmap v2707: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:37.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:41:37.374 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:41:37.374 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:41:37.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:37 smithi163 bash[24253]: cluster 2024-08-31T03:41:36.381550+0000 mgr.a (mgr.14388) 3906 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:37 smithi163 bash[24253]: audit 2024-08-31T03:41:36.407864+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:37 smithi163 bash[24253]: audit 2024-08-31T03:41:36.416177+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:37 smithi163 bash[24253]: audit 2024-08-31T03:41:36.814559+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:37 smithi163 bash[24253]: audit 2024-08-31T03:41:36.823087+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:37 smithi163 bash[24253]: audit 2024-08-31T03:41:36.825149+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:41:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:37 smithi163 bash[24253]: audit 2024-08-31T03:41:36.827270+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:41:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:37 smithi163 bash[24253]: audit 2024-08-31T03:41:36.838109+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:37 smithi163 bash[24253]: audit 2024-08-31T03:41:36.843760+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:41:37.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:37 smithi163 bash[24253]: audit 2024-08-31T03:41:36.846033+0000 mgr.a (mgr.14388) 3907 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:41:37.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22863]: debug 2024-08-31T03:41:37.595+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:41:37.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22863]: debug 2024-08-31T03:41:37.595+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:41:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22610]: cluster 2024-08-31T03:41:36.381550+0000 mgr.a (mgr.14388) 3906 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22610]: audit 2024-08-31T03:41:36.407864+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22610]: audit 2024-08-31T03:41:36.416177+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22610]: audit 2024-08-31T03:41:36.814559+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22610]: audit 2024-08-31T03:41:36.823087+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22610]: audit 2024-08-31T03:41:36.825149+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:41:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22610]: audit 2024-08-31T03:41:36.827270+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:41:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22610]: audit 2024-08-31T03:41:36.838109+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22610]: audit 2024-08-31T03:41:36.843760+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:41:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:37 smithi027 bash[22610]: audit 2024-08-31T03:41:36.846033+0000 mgr.a (mgr.14388) 3907 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:41:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:37 smithi191 bash[24992]: cluster 2024-08-31T03:41:36.381550+0000 mgr.a (mgr.14388) 3906 : cluster [DBG] pgmap v2708: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:37 smithi191 bash[24992]: audit 2024-08-31T03:41:36.407864+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:37 smithi191 bash[24992]: audit 2024-08-31T03:41:36.416177+0000 mon.a (mon.0) 1174 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:37 smithi191 bash[24992]: audit 2024-08-31T03:41:36.814559+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:37 smithi191 bash[24992]: audit 2024-08-31T03:41:36.823087+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:37 smithi191 bash[24992]: audit 2024-08-31T03:41:36.825149+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:41:37.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:37 smithi191 bash[24992]: audit 2024-08-31T03:41:36.827270+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:41:37.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:37 smithi191 bash[24992]: audit 2024-08-31T03:41:36.838109+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:41:37.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:37 smithi191 bash[24992]: audit 2024-08-31T03:41:36.843760+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:41:37.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:37 smithi191 bash[24992]: audit 2024-08-31T03:41:36.846033+0000 mgr.a (mgr.14388) 3907 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:41:38.100 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:41:38.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:41:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:41:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:41:38.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:41:38.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:38 smithi163 bash[24253]: audit 2024-08-31T03:41:37.600241+0000 mgr.a (mgr.14388) 3908 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:41:38.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:38 smithi163 bash[24253]: cephadm 2024-08-31T03:41:37.601332+0000 mgr.a (mgr.14388) 3909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:41:38.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:38 smithi163 bash[24253]: audit 2024-08-31T03:41:37.698612+0000 mgr.a (mgr.14388) 3910 : audit [DBG] from='client.95280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:38 smithi027 bash[22610]: audit 2024-08-31T03:41:37.600241+0000 mgr.a (mgr.14388) 3908 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:41:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:38 smithi027 bash[22610]: cephadm 2024-08-31T03:41:37.601332+0000 mgr.a (mgr.14388) 3909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:41:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:38 smithi027 bash[22610]: audit 2024-08-31T03:41:37.698612+0000 mgr.a (mgr.14388) 3910 : audit [DBG] from='client.95280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:38 smithi191 bash[24992]: audit 2024-08-31T03:41:37.600241+0000 mgr.a (mgr.14388) 3908 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:41:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:38 smithi191 bash[24992]: cephadm 2024-08-31T03:41:37.601332+0000 mgr.a (mgr.14388) 3909 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:41:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:38 smithi191 bash[24992]: audit 2024-08-31T03:41:37.698612+0000 mgr.a (mgr.14388) 3910 : audit [DBG] from='client.95280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:39.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:39 smithi163 bash[24253]: cluster 2024-08-31T03:41:38.384241+0000 mgr.a (mgr.14388) 3911 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:41:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:39 smithi027 bash[22610]: cluster 2024-08-31T03:41:38.384241+0000 mgr.a (mgr.14388) 3911 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:41:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:39 smithi191 bash[24992]: cluster 2024-08-31T03:41:38.384241+0000 mgr.a (mgr.14388) 3911 : cluster [DBG] pgmap v2709: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:41:41.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:41 smithi163 bash[24253]: cluster 2024-08-31T03:41:40.385020+0000 mgr.a (mgr.14388) 3912 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:41:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:41 smithi027 bash[22610]: cluster 2024-08-31T03:41:40.385020+0000 mgr.a (mgr.14388) 3912 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:41:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:41 smithi191 bash[24992]: cluster 2024-08-31T03:41:40.385020+0000 mgr.a (mgr.14388) 3912 : cluster [DBG] pgmap v2710: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:41:43.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:41:43.102 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:41:43.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:41:43.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:43 smithi163 bash[24253]: cluster 2024-08-31T03:41:42.385785+0000 mgr.a (mgr.14388) 3913 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:41:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:43 smithi027 bash[22610]: cluster 2024-08-31T03:41:42.385785+0000 mgr.a (mgr.14388) 3913 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:41:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:43 smithi191 bash[24992]: cluster 2024-08-31T03:41:42.385785+0000 mgr.a (mgr.14388) 3913 : cluster [DBG] pgmap v2711: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:41:43.837 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:41:43.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:41:43.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:41:43.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:41:43.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:41:44.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:44 smithi163 bash[24253]: audit 2024-08-31T03:41:43.432499+0000 mgr.a (mgr.14388) 3914 : audit [DBG] from='client.95373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:44 smithi027 bash[22610]: audit 2024-08-31T03:41:43.432499+0000 mgr.a (mgr.14388) 3914 : audit [DBG] from='client.95373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:44 smithi191 bash[24992]: audit 2024-08-31T03:41:43.432499+0000 mgr.a (mgr.14388) 3914 : audit [DBG] from='client.95373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:45.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:45 smithi163 bash[24253]: cluster 2024-08-31T03:41:44.388568+0000 mgr.a (mgr.14388) 3915 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:41:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:45 smithi027 bash[22610]: cluster 2024-08-31T03:41:44.388568+0000 mgr.a (mgr.14388) 3915 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:41:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:45 smithi191 bash[24992]: cluster 2024-08-31T03:41:44.388568+0000 mgr.a (mgr.14388) 3915 : cluster [DBG] pgmap v2712: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:41:47.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:47 smithi163 bash[24253]: cluster 2024-08-31T03:41:46.389358+0000 mgr.a (mgr.14388) 3916 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:41:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:47 smithi027 bash[22610]: cluster 2024-08-31T03:41:46.389358+0000 mgr.a (mgr.14388) 3916 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:41:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:47 smithi191 bash[24992]: cluster 2024-08-31T03:41:46.389358+0000 mgr.a (mgr.14388) 3916 : cluster [DBG] pgmap v2713: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:41:48.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:41:48.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:41:48.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:41:49.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:41:49.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:41:49.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:41:49.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:41:49.613 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:41:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:49 smithi027 bash[22610]: cluster 2024-08-31T03:41:48.391283+0000 mgr.a (mgr.14388) 3917 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:41:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:49 smithi191 bash[24992]: cluster 2024-08-31T03:41:48.391283+0000 mgr.a (mgr.14388) 3917 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:41:49.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:49 smithi163 bash[24253]: cluster 2024-08-31T03:41:48.391283+0000 mgr.a (mgr.14388) 3917 : cluster [DBG] pgmap v2714: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:41:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:50 smithi027 bash[22610]: audit 2024-08-31T03:41:49.176979+0000 mgr.a (mgr.14388) 3918 : audit [DBG] from='client.95451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:50 smithi191 bash[24992]: audit 2024-08-31T03:41:49.176979+0000 mgr.a (mgr.14388) 3918 : audit [DBG] from='client.95451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:50.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:50 smithi163 bash[24253]: audit 2024-08-31T03:41:49.176979+0000 mgr.a (mgr.14388) 3918 : audit [DBG] from='client.95451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:51 smithi027 bash[22610]: cluster 2024-08-31T03:41:50.392246+0000 mgr.a (mgr.14388) 3919 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:41:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:51 smithi191 bash[24992]: cluster 2024-08-31T03:41:50.392246+0000 mgr.a (mgr.14388) 3919 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:41:51.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:51 smithi163 bash[24253]: cluster 2024-08-31T03:41:50.392246+0000 mgr.a (mgr.14388) 3919 : cluster [DBG] pgmap v2715: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:41:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:53 smithi027 bash[22610]: cluster 2024-08-31T03:41:52.393021+0000 mgr.a (mgr.14388) 3920 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:41:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:53 smithi191 bash[24992]: cluster 2024-08-31T03:41:52.393021+0000 mgr.a (mgr.14388) 3920 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:41:53.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:53 smithi163 bash[24253]: cluster 2024-08-31T03:41:52.393021+0000 mgr.a (mgr.14388) 3920 : cluster [DBG] pgmap v2716: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:41:54.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:41:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:41:54.615 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:41:55.373 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:41:55.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:41:55.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:41:55.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:41:55.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:41:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:55 smithi027 bash[22610]: cluster 2024-08-31T03:41:54.395208+0000 mgr.a (mgr.14388) 3921 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:41:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:55 smithi191 bash[24992]: cluster 2024-08-31T03:41:54.395208+0000 mgr.a (mgr.14388) 3921 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:41:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:55 smithi163 bash[24253]: cluster 2024-08-31T03:41:54.395208+0000 mgr.a (mgr.14388) 3921 : cluster [DBG] pgmap v2717: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:41:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:56 smithi027 bash[22610]: audit 2024-08-31T03:41:54.949607+0000 mgr.a (mgr.14388) 3922 : audit [DBG] from='client.95529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:56 smithi191 bash[24992]: audit 2024-08-31T03:41:54.949607+0000 mgr.a (mgr.14388) 3922 : audit [DBG] from='client.95529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:56.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:56 smithi163 bash[24253]: audit 2024-08-31T03:41:54.949607+0000 mgr.a (mgr.14388) 3922 : audit [DBG] from='client.95529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:41:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:57 smithi027 bash[22610]: cluster 2024-08-31T03:41:56.396138+0000 mgr.a (mgr.14388) 3923 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:57 smithi191 bash[24992]: cluster 2024-08-31T03:41:56.396138+0000 mgr.a (mgr.14388) 3923 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:57.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:57 smithi163 bash[24253]: cluster 2024-08-31T03:41:56.396138+0000 mgr.a (mgr.14388) 3923 : cluster [DBG] pgmap v2718: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:41:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:41:59 smithi027 bash[22610]: cluster 2024-08-31T03:41:58.398248+0000 mgr.a (mgr.14388) 3924 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:41:59 smithi191 bash[24992]: cluster 2024-08-31T03:41:58.398248+0000 mgr.a (mgr.14388) 3924 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:41:59.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:41:59 smithi163 bash[24253]: cluster 2024-08-31T03:41:58.398248+0000 mgr.a (mgr.14388) 3924 : cluster [DBG] pgmap v2719: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:42:00.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:00.376 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:00.376 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:01.127 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:01.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:01.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:01.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:01.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:01 smithi191 bash[24992]: cluster 2024-08-31T03:42:00.399057+0000 mgr.a (mgr.14388) 3925 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:01.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:01 smithi191 bash[24992]: audit 2024-08-31T03:42:00.709371+0000 mgr.a (mgr.14388) 3926 : audit [DBG] from='client.95601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:01.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:01 smithi163 bash[24253]: cluster 2024-08-31T03:42:00.399057+0000 mgr.a (mgr.14388) 3925 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:01.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:01 smithi163 bash[24253]: audit 2024-08-31T03:42:00.709371+0000 mgr.a (mgr.14388) 3926 : audit [DBG] from='client.95601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:01 smithi027 bash[22610]: cluster 2024-08-31T03:42:00.399057+0000 mgr.a (mgr.14388) 3925 : cluster [DBG] pgmap v2720: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:01 smithi027 bash[22610]: audit 2024-08-31T03:42:00.709371+0000 mgr.a (mgr.14388) 3926 : audit [DBG] from='client.95601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:03 smithi191 bash[24992]: cluster 2024-08-31T03:42:02.400013+0000 mgr.a (mgr.14388) 3927 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:03.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:03 smithi163 bash[24253]: cluster 2024-08-31T03:42:02.400013+0000 mgr.a (mgr.14388) 3927 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:03 smithi027 bash[22610]: cluster 2024-08-31T03:42:02.400013+0000 mgr.a (mgr.14388) 3927 : cluster [DBG] pgmap v2721: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:05 smithi191 bash[24992]: cluster 2024-08-31T03:42:04.402212+0000 mgr.a (mgr.14388) 3928 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:42:05.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:05 smithi163 bash[24253]: cluster 2024-08-31T03:42:04.402212+0000 mgr.a (mgr.14388) 3928 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:42:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:05 smithi027 bash[22610]: cluster 2024-08-31T03:42:04.402212+0000 mgr.a (mgr.14388) 3928 : cluster [DBG] pgmap v2722: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:42:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:06.129 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:06.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:06.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:06.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:06.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:06.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:07 smithi191 bash[24992]: cluster 2024-08-31T03:42:06.402958+0000 mgr.a (mgr.14388) 3929 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:07 smithi191 bash[24992]: audit 2024-08-31T03:42:06.462055+0000 mgr.a (mgr.14388) 3930 : audit [DBG] from='client.95679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:07.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:07 smithi163 bash[24253]: cluster 2024-08-31T03:42:06.402958+0000 mgr.a (mgr.14388) 3929 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:07.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:07 smithi163 bash[24253]: audit 2024-08-31T03:42:06.462055+0000 mgr.a (mgr.14388) 3930 : audit [DBG] from='client.95679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:07 smithi027 bash[22610]: cluster 2024-08-31T03:42:06.402958+0000 mgr.a (mgr.14388) 3929 : cluster [DBG] pgmap v2723: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:07 smithi027 bash[22610]: audit 2024-08-31T03:42:06.462055+0000 mgr.a (mgr.14388) 3930 : audit [DBG] from='client.95679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:09 smithi191 bash[24992]: cluster 2024-08-31T03:42:08.405168+0000 mgr.a (mgr.14388) 3931 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:42:09.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:09 smithi163 bash[24253]: cluster 2024-08-31T03:42:08.405168+0000 mgr.a (mgr.14388) 3931 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:42:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:09 smithi027 bash[22610]: cluster 2024-08-31T03:42:08.405168+0000 mgr.a (mgr.14388) 3931 : cluster [DBG] pgmap v2724: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:42:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:11 smithi191 bash[24992]: cluster 2024-08-31T03:42:10.405957+0000 mgr.a (mgr.14388) 3932 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:11.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:11.876 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:11.876 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:11.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:11 smithi163 bash[24253]: cluster 2024-08-31T03:42:10.405957+0000 mgr.a (mgr.14388) 3932 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:11 smithi027 bash[22610]: cluster 2024-08-31T03:42:10.405957+0000 mgr.a (mgr.14388) 3932 : cluster [DBG] pgmap v2725: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:12.647 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:12.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:12.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:12.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:12.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:13 smithi191 bash[24992]: audit 2024-08-31T03:42:12.209144+0000 mgr.a (mgr.14388) 3933 : audit [DBG] from='client.95757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:13 smithi191 bash[24992]: cluster 2024-08-31T03:42:12.406578+0000 mgr.a (mgr.14388) 3934 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:13.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:13 smithi163 bash[24253]: audit 2024-08-31T03:42:12.209144+0000 mgr.a (mgr.14388) 3933 : audit [DBG] from='client.95757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:13.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:13 smithi163 bash[24253]: cluster 2024-08-31T03:42:12.406578+0000 mgr.a (mgr.14388) 3934 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:13 smithi027 bash[22610]: audit 2024-08-31T03:42:12.209144+0000 mgr.a (mgr.14388) 3933 : audit [DBG] from='client.95757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:13 smithi027 bash[22610]: cluster 2024-08-31T03:42:12.406578+0000 mgr.a (mgr.14388) 3934 : cluster [DBG] pgmap v2726: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:15 smithi191 bash[24992]: cluster 2024-08-31T03:42:14.408838+0000 mgr.a (mgr.14388) 3935 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:42:15.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:15 smithi163 bash[24253]: cluster 2024-08-31T03:42:14.408838+0000 mgr.a (mgr.14388) 3935 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:42:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:15 smithi027 bash[22610]: cluster 2024-08-31T03:42:14.408838+0000 mgr.a (mgr.14388) 3935 : cluster [DBG] pgmap v2727: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:42:17.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:17.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:17.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:17 smithi191 bash[24992]: cluster 2024-08-31T03:42:16.409623+0000 mgr.a (mgr.14388) 3936 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:17.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:17 smithi163 bash[24253]: cluster 2024-08-31T03:42:16.409623+0000 mgr.a (mgr.14388) 3936 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:17 smithi027 bash[22610]: cluster 2024-08-31T03:42:16.409623+0000 mgr.a (mgr.14388) 3936 : cluster [DBG] pgmap v2728: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:18.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:18.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:18.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:18.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:18.394 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:19 smithi191 bash[24992]: audit 2024-08-31T03:42:17.978045+0000 mgr.a (mgr.14388) 3937 : audit [DBG] from='client.95835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:19 smithi191 bash[24992]: cluster 2024-08-31T03:42:18.411099+0000 mgr.a (mgr.14388) 3938 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:19.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:19 smithi163 bash[24253]: audit 2024-08-31T03:42:17.978045+0000 mgr.a (mgr.14388) 3937 : audit [DBG] from='client.95835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:19.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:19 smithi163 bash[24253]: cluster 2024-08-31T03:42:18.411099+0000 mgr.a (mgr.14388) 3938 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:19 smithi027 bash[22610]: audit 2024-08-31T03:42:17.978045+0000 mgr.a (mgr.14388) 3937 : audit [DBG] from='client.95835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:19 smithi027 bash[22610]: cluster 2024-08-31T03:42:18.411099+0000 mgr.a (mgr.14388) 3938 : cluster [DBG] pgmap v2729: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:21 smithi191 bash[24992]: cluster 2024-08-31T03:42:20.411842+0000 mgr.a (mgr.14388) 3939 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:42:21.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:21 smithi163 bash[24253]: cluster 2024-08-31T03:42:20.411842+0000 mgr.a (mgr.14388) 3939 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:42:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:21 smithi027 bash[22610]: cluster 2024-08-31T03:42:20.411842+0000 mgr.a (mgr.14388) 3939 : cluster [DBG] pgmap v2730: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:42:23.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:23.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:23.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:23 smithi191 bash[24992]: cluster 2024-08-31T03:42:22.412620+0000 mgr.a (mgr.14388) 3940 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:42:23.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:23 smithi163 bash[24253]: cluster 2024-08-31T03:42:22.412620+0000 mgr.a (mgr.14388) 3940 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:42:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:23 smithi027 bash[22610]: cluster 2024-08-31T03:42:22.412620+0000 mgr.a (mgr.14388) 3940 : cluster [DBG] pgmap v2731: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:42:24.133 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:24.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:24.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:24 smithi163 bash[24253]: audit 2024-08-31T03:42:23.727630+0000 mgr.a (mgr.14388) 3941 : audit [DBG] from='client.95910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:24 smithi027 bash[22610]: audit 2024-08-31T03:42:23.727630+0000 mgr.a (mgr.14388) 3941 : audit [DBG] from='client.95910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:24 smithi191 bash[24992]: audit 2024-08-31T03:42:23.727630+0000 mgr.a (mgr.14388) 3941 : audit [DBG] from='client.95910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:25.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:25 smithi163 bash[24253]: cluster 2024-08-31T03:42:24.415311+0000 mgr.a (mgr.14388) 3942 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:42:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:25 smithi027 bash[22610]: cluster 2024-08-31T03:42:24.415311+0000 mgr.a (mgr.14388) 3942 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:42:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:25 smithi191 bash[24992]: cluster 2024-08-31T03:42:24.415311+0000 mgr.a (mgr.14388) 3942 : cluster [DBG] pgmap v2732: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:42:27.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:27 smithi163 bash[24253]: cluster 2024-08-31T03:42:26.416143+0000 mgr.a (mgr.14388) 3943 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T03:42:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:27 smithi027 bash[22610]: cluster 2024-08-31T03:42:26.416143+0000 mgr.a (mgr.14388) 3943 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T03:42:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:27 smithi191 bash[24992]: cluster 2024-08-31T03:42:26.416143+0000 mgr.a (mgr.14388) 3943 : cluster [DBG] pgmap v2733: 225 pgs: 225 active+clean; 589 KiB data, 87 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T03:42:29.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:29.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:29.136 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:29.900 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:29.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:29.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:29.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:29.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:29.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:29 smithi163 bash[24253]: cluster 2024-08-31T03:42:28.418107+0000 mgr.a (mgr.14388) 3944 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-08-31T03:42:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:29 smithi027 bash[22610]: cluster 2024-08-31T03:42:28.418107+0000 mgr.a (mgr.14388) 3944 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-08-31T03:42:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:29 smithi191 bash[24992]: cluster 2024-08-31T03:42:28.418107+0000 mgr.a (mgr.14388) 3944 : cluster [DBG] pgmap v2734: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-08-31T03:42:30.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:30 smithi163 bash[24253]: audit 2024-08-31T03:42:29.469079+0000 mgr.a (mgr.14388) 3945 : audit [DBG] from='client.95988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:30 smithi027 bash[22610]: audit 2024-08-31T03:42:29.469079+0000 mgr.a (mgr.14388) 3945 : audit [DBG] from='client.95988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:30 smithi191 bash[24992]: audit 2024-08-31T03:42:29.469079+0000 mgr.a (mgr.14388) 3945 : audit [DBG] from='client.95988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:31.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:31 smithi163 bash[24253]: cluster 2024-08-31T03:42:30.419256+0000 mgr.a (mgr.14388) 3946 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-08-31T03:42:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:31 smithi027 bash[22610]: cluster 2024-08-31T03:42:30.419256+0000 mgr.a (mgr.14388) 3946 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-08-31T03:42:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:31 smithi191 bash[24992]: cluster 2024-08-31T03:42:30.419256+0000 mgr.a (mgr.14388) 3946 : cluster [DBG] pgmap v2735: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-08-31T03:42:33.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:33 smithi163 bash[24253]: cluster 2024-08-31T03:42:32.420226+0000 mgr.a (mgr.14388) 3947 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-08-31T03:42:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:33 smithi027 bash[22610]: cluster 2024-08-31T03:42:32.420226+0000 mgr.a (mgr.14388) 3947 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-08-31T03:42:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:33 smithi191 bash[24992]: cluster 2024-08-31T03:42:32.420226+0000 mgr.a (mgr.14388) 3947 : cluster [DBG] pgmap v2736: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 0 B/s wr, 78 op/s 2024-08-31T03:42:34.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:34.903 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:34.903 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:35.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:35.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:35.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:35.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:35.666 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:35.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:35 smithi163 bash[24253]: cluster 2024-08-31T03:42:34.422476+0000 mgr.a (mgr.14388) 3948 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 0 B/s wr, 79 op/s 2024-08-31T03:42:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:35 smithi027 bash[22610]: cluster 2024-08-31T03:42:34.422476+0000 mgr.a (mgr.14388) 3948 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 0 B/s wr, 79 op/s 2024-08-31T03:42:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:35 smithi191 bash[24992]: cluster 2024-08-31T03:42:34.422476+0000 mgr.a (mgr.14388) 3948 : cluster [DBG] pgmap v2737: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 49 KiB/s rd, 0 B/s wr, 79 op/s 2024-08-31T03:42:36.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:36 smithi163 bash[24253]: audit 2024-08-31T03:42:35.239915+0000 mgr.a (mgr.14388) 3949 : audit [DBG] from='client.96066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:36 smithi027 bash[22610]: audit 2024-08-31T03:42:35.239915+0000 mgr.a (mgr.14388) 3949 : audit [DBG] from='client.96066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:36 smithi191 bash[24992]: audit 2024-08-31T03:42:35.239915+0000 mgr.a (mgr.14388) 3949 : audit [DBG] from='client.96066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:37.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:37 smithi163 bash[24253]: cluster 2024-08-31T03:42:36.423471+0000 mgr.a (mgr.14388) 3950 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 72 op/s 2024-08-31T03:42:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:37 smithi027 bash[22610]: cluster 2024-08-31T03:42:36.423471+0000 mgr.a (mgr.14388) 3950 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 72 op/s 2024-08-31T03:42:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:37 smithi191 bash[24992]: cluster 2024-08-31T03:42:36.423471+0000 mgr.a (mgr.14388) 3950 : cluster [DBG] pgmap v2738: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 72 op/s 2024-08-31T03:42:38.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:38 smithi163 bash[24253]: audit 2024-08-31T03:42:37.651681+0000 mon.a (mon.0) 1181 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:42:38.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:38 smithi163 bash[24253]: audit 2024-08-31T03:42:38.505821+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:42:38.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:38 smithi163 bash[24253]: audit 2024-08-31T03:42:38.507366+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:42:38.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:38 smithi163 bash[24253]: audit 2024-08-31T03:42:38.517274+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:42:38.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:38 smithi163 bash[24253]: audit 2024-08-31T03:42:38.522292+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:42:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:38 smithi027 bash[22610]: audit 2024-08-31T03:42:37.651681+0000 mon.a (mon.0) 1181 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:42:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:38 smithi027 bash[22610]: audit 2024-08-31T03:42:38.505821+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:42:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:38 smithi027 bash[22610]: audit 2024-08-31T03:42:38.507366+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:42:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:38 smithi027 bash[22610]: audit 2024-08-31T03:42:38.517274+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:42:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:38 smithi027 bash[22610]: audit 2024-08-31T03:42:38.522292+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:38 smithi191 bash[24992]: audit 2024-08-31T03:42:37.651681+0000 mon.a (mon.0) 1181 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:38 smithi191 bash[24992]: audit 2024-08-31T03:42:38.505821+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:38 smithi191 bash[24992]: audit 2024-08-31T03:42:38.507366+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:38 smithi191 bash[24992]: audit 2024-08-31T03:42:38.517274+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:38 smithi191 bash[24992]: audit 2024-08-31T03:42:38.522292+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:42:39.595 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:42:39 smithi027 bash[22863]: debug 2024-08-31T03:42:39.245+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:42:39.595 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:42:39 smithi027 bash[22863]: debug 2024-08-31T03:42:39.245+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:42:39.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:39 smithi163 bash[24253]: cluster 2024-08-31T03:42:38.424833+0000 mgr.a (mgr.14388) 3951 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 72 op/s 2024-08-31T03:42:39.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:39 smithi163 bash[24253]: audit 2024-08-31T03:42:38.524634+0000 mgr.a (mgr.14388) 3952 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:42:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:39 smithi027 bash[22610]: cluster 2024-08-31T03:42:38.424833+0000 mgr.a (mgr.14388) 3951 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 72 op/s 2024-08-31T03:42:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:39 smithi027 bash[22610]: audit 2024-08-31T03:42:38.524634+0000 mgr.a (mgr.14388) 3952 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:42:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:39 smithi191 bash[24992]: cluster 2024-08-31T03:42:38.424833+0000 mgr.a (mgr.14388) 3951 : cluster [DBG] pgmap v2739: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 45 KiB/s rd, 0 B/s wr, 72 op/s 2024-08-31T03:42:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:39 smithi191 bash[24992]: audit 2024-08-31T03:42:38.524634+0000 mgr.a (mgr.14388) 3952 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:42:40.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:40.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:40.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:40.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:40 smithi163 bash[24253]: audit 2024-08-31T03:42:39.246870+0000 mgr.a (mgr.14388) 3953 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:42:40.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:40 smithi163 bash[24253]: cephadm 2024-08-31T03:42:39.248031+0000 mgr.a (mgr.14388) 3954 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:42:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:40 smithi027 bash[22610]: audit 2024-08-31T03:42:39.246870+0000 mgr.a (mgr.14388) 3953 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:42:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:40 smithi027 bash[22610]: cephadm 2024-08-31T03:42:39.248031+0000 mgr.a (mgr.14388) 3954 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:42:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:40 smithi191 bash[24992]: audit 2024-08-31T03:42:39.246870+0000 mgr.a (mgr.14388) 3953 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:42:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:40 smithi191 bash[24992]: cephadm 2024-08-31T03:42:39.248031+0000 mgr.a (mgr.14388) 3954 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:42:41.433 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:41.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:41.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:41.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:41.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:41.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:41 smithi163 bash[24253]: cluster 2024-08-31T03:42:40.425715+0000 mgr.a (mgr.14388) 3955 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:41 smithi027 bash[22610]: cluster 2024-08-31T03:42:40.425715+0000 mgr.a (mgr.14388) 3955 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:41 smithi191 bash[24992]: cluster 2024-08-31T03:42:40.425715+0000 mgr.a (mgr.14388) 3955 : cluster [DBG] pgmap v2740: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:42.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:42 smithi163 bash[24253]: audit 2024-08-31T03:42:41.002145+0000 mgr.a (mgr.14388) 3956 : audit [DBG] from='client.96252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:42 smithi027 bash[22610]: audit 2024-08-31T03:42:41.002145+0000 mgr.a (mgr.14388) 3956 : audit [DBG] from='client.96252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:42 smithi191 bash[24992]: audit 2024-08-31T03:42:41.002145+0000 mgr.a (mgr.14388) 3956 : audit [DBG] from='client.96252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:43.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:43 smithi163 bash[24253]: cluster 2024-08-31T03:42:42.426737+0000 mgr.a (mgr.14388) 3957 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:43 smithi027 bash[22610]: cluster 2024-08-31T03:42:42.426737+0000 mgr.a (mgr.14388) 3957 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:43 smithi191 bash[24992]: cluster 2024-08-31T03:42:42.426737+0000 mgr.a (mgr.14388) 3957 : cluster [DBG] pgmap v2741: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:45.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:45 smithi163 bash[24253]: cluster 2024-08-31T03:42:44.428951+0000 mgr.a (mgr.14388) 3958 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:45 smithi027 bash[22610]: cluster 2024-08-31T03:42:44.428951+0000 mgr.a (mgr.14388) 3958 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:45 smithi191 bash[24992]: cluster 2024-08-31T03:42:44.428951+0000 mgr.a (mgr.14388) 3958 : cluster [DBG] pgmap v2742: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:46.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:46.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:46.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:47.222 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:47.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:47.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:47.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:47.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:47.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:47 smithi163 bash[24253]: cluster 2024-08-31T03:42:46.429747+0000 mgr.a (mgr.14388) 3959 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:47.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:47 smithi163 bash[24253]: audit 2024-08-31T03:42:46.775673+0000 mgr.a (mgr.14388) 3960 : audit [DBG] from='client.96330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:47 smithi027 bash[22610]: cluster 2024-08-31T03:42:46.429747+0000 mgr.a (mgr.14388) 3959 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:47 smithi027 bash[22610]: audit 2024-08-31T03:42:46.775673+0000 mgr.a (mgr.14388) 3960 : audit [DBG] from='client.96330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:47 smithi191 bash[24992]: cluster 2024-08-31T03:42:46.429747+0000 mgr.a (mgr.14388) 3959 : cluster [DBG] pgmap v2743: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:47 smithi191 bash[24992]: audit 2024-08-31T03:42:46.775673+0000 mgr.a (mgr.14388) 3960 : audit [DBG] from='client.96330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:49.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:49 smithi163 bash[24253]: cluster 2024-08-31T03:42:48.432003+0000 mgr.a (mgr.14388) 3961 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:49 smithi027 bash[22610]: cluster 2024-08-31T03:42:48.432003+0000 mgr.a (mgr.14388) 3961 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:49 smithi191 bash[24992]: cluster 2024-08-31T03:42:48.432003+0000 mgr.a (mgr.14388) 3961 : cluster [DBG] pgmap v2744: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:51.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:51 smithi163 bash[24253]: cluster 2024-08-31T03:42:50.432839+0000 mgr.a (mgr.14388) 3962 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:51 smithi027 bash[22610]: cluster 2024-08-31T03:42:50.432839+0000 mgr.a (mgr.14388) 3962 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:51 smithi191 bash[24992]: cluster 2024-08-31T03:42:50.432839+0000 mgr.a (mgr.14388) 3962 : cluster [DBG] pgmap v2745: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:52.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:52.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:52.995 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:52.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:52.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:52.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:52.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:53.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:53 smithi163 bash[24253]: cluster 2024-08-31T03:42:52.433615+0000 mgr.a (mgr.14388) 3963 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:53.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:53 smithi163 bash[24253]: audit 2024-08-31T03:42:52.563942+0000 mgr.a (mgr.14388) 3964 : audit [DBG] from='client.96408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:53 smithi027 bash[22610]: cluster 2024-08-31T03:42:52.433615+0000 mgr.a (mgr.14388) 3963 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:53 smithi027 bash[22610]: audit 2024-08-31T03:42:52.563942+0000 mgr.a (mgr.14388) 3964 : audit [DBG] from='client.96408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:53 smithi191 bash[24992]: cluster 2024-08-31T03:42:52.433615+0000 mgr.a (mgr.14388) 3963 : cluster [DBG] pgmap v2746: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:53 smithi191 bash[24992]: audit 2024-08-31T03:42:52.563942+0000 mgr.a (mgr.14388) 3964 : audit [DBG] from='client.96408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:55 smithi163 bash[24253]: cluster 2024-08-31T03:42:54.436002+0000 mgr.a (mgr.14388) 3965 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:55 smithi027 bash[22610]: cluster 2024-08-31T03:42:54.436002+0000 mgr.a (mgr.14388) 3965 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:55 smithi191 bash[24992]: cluster 2024-08-31T03:42:54.436002+0000 mgr.a (mgr.14388) 3965 : cluster [DBG] pgmap v2747: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:42:57.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:57 smithi163 bash[24253]: cluster 2024-08-31T03:42:56.436818+0000 mgr.a (mgr.14388) 3966 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:42:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:57 smithi027 bash[22610]: cluster 2024-08-31T03:42:56.436818+0000 mgr.a (mgr.14388) 3966 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:42:57.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:42:57.998 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:42:57.998 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:42:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:57 smithi191 bash[24992]: cluster 2024-08-31T03:42:56.436818+0000 mgr.a (mgr.14388) 3966 : cluster [DBG] pgmap v2748: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:42:58.755 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:42:58.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:42:58.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:42:58.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:42:58.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:42:59.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:59 smithi163 bash[24253]: audit 2024-08-31T03:42:58.332570+0000 mgr.a (mgr.14388) 3967 : audit [DBG] from='client.96483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:59.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:42:59 smithi163 bash[24253]: cluster 2024-08-31T03:42:58.438191+0000 mgr.a (mgr.14388) 3968 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:42:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:59 smithi027 bash[22610]: audit 2024-08-31T03:42:58.332570+0000 mgr.a (mgr.14388) 3967 : audit [DBG] from='client.96483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:42:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:42:59 smithi027 bash[22610]: cluster 2024-08-31T03:42:58.438191+0000 mgr.a (mgr.14388) 3968 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:59 smithi191 bash[24992]: audit 2024-08-31T03:42:58.332570+0000 mgr.a (mgr.14388) 3967 : audit [DBG] from='client.96483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:42:59 smithi191 bash[24992]: cluster 2024-08-31T03:42:58.438191+0000 mgr.a (mgr.14388) 3968 : cluster [DBG] pgmap v2749: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:01.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:01 smithi163 bash[24253]: cluster 2024-08-31T03:43:00.439194+0000 mgr.a (mgr.14388) 3969 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:01 smithi027 bash[22610]: cluster 2024-08-31T03:43:00.439194+0000 mgr.a (mgr.14388) 3969 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:01 smithi191 bash[24992]: cluster 2024-08-31T03:43:00.439194+0000 mgr.a (mgr.14388) 3969 : cluster [DBG] pgmap v2750: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:03.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:43:03.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:43:03.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:43:03.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:03 smithi163 bash[24253]: cluster 2024-08-31T03:43:02.440018+0000 mgr.a (mgr.14388) 3970 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:03 smithi027 bash[22610]: cluster 2024-08-31T03:43:02.440018+0000 mgr.a (mgr.14388) 3970 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:03 smithi191 bash[24992]: cluster 2024-08-31T03:43:02.440018+0000 mgr.a (mgr.14388) 3970 : cluster [DBG] pgmap v2751: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:04.534 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:43:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:43:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:43:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:43:04.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:43:05.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:05 smithi163 bash[24253]: audit 2024-08-31T03:43:04.093571+0000 mgr.a (mgr.14388) 3971 : audit [DBG] from='client.96558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:05.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:05 smithi163 bash[24253]: cluster 2024-08-31T03:43:04.441391+0000 mgr.a (mgr.14388) 3972 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:05 smithi027 bash[22610]: audit 2024-08-31T03:43:04.093571+0000 mgr.a (mgr.14388) 3971 : audit [DBG] from='client.96558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:05 smithi027 bash[22610]: cluster 2024-08-31T03:43:04.441391+0000 mgr.a (mgr.14388) 3972 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:05 smithi191 bash[24992]: audit 2024-08-31T03:43:04.093571+0000 mgr.a (mgr.14388) 3971 : audit [DBG] from='client.96558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:05 smithi191 bash[24992]: cluster 2024-08-31T03:43:04.441391+0000 mgr.a (mgr.14388) 3972 : cluster [DBG] pgmap v2752: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:07.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:07 smithi163 bash[24253]: cluster 2024-08-31T03:43:06.442131+0000 mgr.a (mgr.14388) 3973 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:43:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:07 smithi027 bash[22610]: cluster 2024-08-31T03:43:06.442131+0000 mgr.a (mgr.14388) 3973 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:43:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:07 smithi191 bash[24992]: cluster 2024-08-31T03:43:06.442131+0000 mgr.a (mgr.14388) 3973 : cluster [DBG] pgmap v2753: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:43:09.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:43:09.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:43:09.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:43:09.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:09 smithi163 bash[24253]: cluster 2024-08-31T03:43:08.444094+0000 mgr.a (mgr.14388) 3974 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:43:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:09 smithi027 bash[22610]: cluster 2024-08-31T03:43:08.444094+0000 mgr.a (mgr.14388) 3974 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:43:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:09 smithi191 bash[24992]: cluster 2024-08-31T03:43:08.444094+0000 mgr.a (mgr.14388) 3974 : cluster [DBG] pgmap v2754: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:43:10.294 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:43:10.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:43:10.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:43:10.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:43:10.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:43:10.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:10 smithi163 bash[24253]: audit 2024-08-31T03:43:09.872652+0000 mgr.a (mgr.14388) 3975 : audit [DBG] from='client.96636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:10 smithi027 bash[22610]: audit 2024-08-31T03:43:09.872652+0000 mgr.a (mgr.14388) 3975 : audit [DBG] from='client.96636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:10 smithi191 bash[24992]: audit 2024-08-31T03:43:09.872652+0000 mgr.a (mgr.14388) 3975 : audit [DBG] from='client.96636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:11.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:11 smithi163 bash[24253]: cluster 2024-08-31T03:43:10.445210+0000 mgr.a (mgr.14388) 3976 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:11 smithi027 bash[22610]: cluster 2024-08-31T03:43:10.445210+0000 mgr.a (mgr.14388) 3976 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:11 smithi191 bash[24992]: cluster 2024-08-31T03:43:10.445210+0000 mgr.a (mgr.14388) 3976 : cluster [DBG] pgmap v2755: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:13.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:13 smithi163 bash[24253]: cluster 2024-08-31T03:43:12.446065+0000 mgr.a (mgr.14388) 3977 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:13 smithi027 bash[22610]: cluster 2024-08-31T03:43:12.446065+0000 mgr.a (mgr.14388) 3977 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:13 smithi191 bash[24992]: cluster 2024-08-31T03:43:12.446065+0000 mgr.a (mgr.14388) 3977 : cluster [DBG] pgmap v2756: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:15.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:43:15.296 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:43:15.296 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:43:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:15 smithi027 bash[22610]: cluster 2024-08-31T03:43:14.448298+0000 mgr.a (mgr.14388) 3978 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:15 smithi191 bash[24992]: cluster 2024-08-31T03:43:14.448298+0000 mgr.a (mgr.14388) 3978 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:16.069 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:43:16.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:43:16.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:43:16.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:43:16.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:43:16.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:15 smithi163 bash[24253]: cluster 2024-08-31T03:43:14.448298+0000 mgr.a (mgr.14388) 3978 : cluster [DBG] pgmap v2757: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:16 smithi027 bash[22610]: audit 2024-08-31T03:43:15.626187+0000 mgr.a (mgr.14388) 3979 : audit [DBG] from='client.96708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:16 smithi191 bash[24992]: audit 2024-08-31T03:43:15.626187+0000 mgr.a (mgr.14388) 3979 : audit [DBG] from='client.96708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:17.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:16 smithi163 bash[24253]: audit 2024-08-31T03:43:15.626187+0000 mgr.a (mgr.14388) 3979 : audit [DBG] from='client.96708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:17 smithi027 bash[22610]: cluster 2024-08-31T03:43:16.449272+0000 mgr.a (mgr.14388) 3980 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:17 smithi191 bash[24992]: cluster 2024-08-31T03:43:16.449272+0000 mgr.a (mgr.14388) 3980 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:18.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:17 smithi163 bash[24253]: cluster 2024-08-31T03:43:16.449272+0000 mgr.a (mgr.14388) 3980 : cluster [DBG] pgmap v2758: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:19 smithi027 bash[22610]: cluster 2024-08-31T03:43:18.451433+0000 mgr.a (mgr.14388) 3981 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:20.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:19 smithi191 bash[24992]: cluster 2024-08-31T03:43:18.451433+0000 mgr.a (mgr.14388) 3981 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:20.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:19 smithi163 bash[24253]: cluster 2024-08-31T03:43:18.451433+0000 mgr.a (mgr.14388) 3981 : cluster [DBG] pgmap v2759: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:43:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:43:21.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:43:21.825 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:43:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:43:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:43:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:43:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:43:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:21 smithi027 bash[22610]: cluster 2024-08-31T03:43:20.452193+0000 mgr.a (mgr.14388) 3982 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:21 smithi191 bash[24992]: cluster 2024-08-31T03:43:20.452193+0000 mgr.a (mgr.14388) 3982 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:22.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:21 smithi163 bash[24253]: cluster 2024-08-31T03:43:20.452193+0000 mgr.a (mgr.14388) 3982 : cluster [DBG] pgmap v2760: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:22 smithi027 bash[22610]: audit 2024-08-31T03:43:21.401753+0000 mgr.a (mgr.14388) 3983 : audit [DBG] from='client.96786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:22 smithi191 bash[24992]: audit 2024-08-31T03:43:21.401753+0000 mgr.a (mgr.14388) 3983 : audit [DBG] from='client.96786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:23.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:22 smithi163 bash[24253]: audit 2024-08-31T03:43:21.401753+0000 mgr.a (mgr.14388) 3983 : audit [DBG] from='client.96786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:23 smithi027 bash[22610]: cluster 2024-08-31T03:43:22.453816+0000 mgr.a (mgr.14388) 3984 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:23 smithi191 bash[24992]: cluster 2024-08-31T03:43:22.453816+0000 mgr.a (mgr.14388) 3984 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:24.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:23 smithi163 bash[24253]: cluster 2024-08-31T03:43:22.453816+0000 mgr.a (mgr.14388) 3984 : cluster [DBG] pgmap v2761: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:25 smithi191 bash[24992]: cluster 2024-08-31T03:43:24.456226+0000 mgr.a (mgr.14388) 3985 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:26.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:25 smithi163 bash[24253]: cluster 2024-08-31T03:43:24.456226+0000 mgr.a (mgr.14388) 3985 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:25 smithi027 bash[22610]: cluster 2024-08-31T03:43:24.456226+0000 mgr.a (mgr.14388) 3985 : cluster [DBG] pgmap v2762: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:26.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:43:26.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:43:26.828 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:43:27.568 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:43:27.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:43:27.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:43:27.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:43:27.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:43:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:27 smithi191 bash[24992]: cluster 2024-08-31T03:43:26.457169+0000 mgr.a (mgr.14388) 3986 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:28.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:27 smithi163 bash[24253]: cluster 2024-08-31T03:43:26.457169+0000 mgr.a (mgr.14388) 3986 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:27 smithi027 bash[22610]: cluster 2024-08-31T03:43:26.457169+0000 mgr.a (mgr.14388) 3986 : cluster [DBG] pgmap v2763: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:28 smithi191 bash[24992]: audit 2024-08-31T03:43:27.157408+0000 mgr.a (mgr.14388) 3987 : audit [DBG] from='client.96864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:29.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:28 smithi163 bash[24253]: audit 2024-08-31T03:43:27.157408+0000 mgr.a (mgr.14388) 3987 : audit [DBG] from='client.96864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:28 smithi027 bash[22610]: audit 2024-08-31T03:43:27.157408+0000 mgr.a (mgr.14388) 3987 : audit [DBG] from='client.96864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:29 smithi191 bash[24992]: cluster 2024-08-31T03:43:28.459491+0000 mgr.a (mgr.14388) 3988 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:30.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:29 smithi163 bash[24253]: cluster 2024-08-31T03:43:28.459491+0000 mgr.a (mgr.14388) 3988 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:29 smithi027 bash[22610]: cluster 2024-08-31T03:43:28.459491+0000 mgr.a (mgr.14388) 3988 : cluster [DBG] pgmap v2764: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:31 smithi191 bash[24992]: cluster 2024-08-31T03:43:30.460216+0000 mgr.a (mgr.14388) 3989 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:32.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:31 smithi163 bash[24253]: cluster 2024-08-31T03:43:30.460216+0000 mgr.a (mgr.14388) 3989 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:31 smithi027 bash[22610]: cluster 2024-08-31T03:43:30.460216+0000 mgr.a (mgr.14388) 3989 : cluster [DBG] pgmap v2765: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:32.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:43:32.570 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:43:32.571 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:43:33.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:43:33.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:43:33.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:43:33.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:43:33.341 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:43:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:33 smithi191 bash[24992]: cluster 2024-08-31T03:43:32.460960+0000 mgr.a (mgr.14388) 3990 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:33 smithi191 bash[24992]: audit 2024-08-31T03:43:32.911541+0000 mgr.a (mgr.14388) 3991 : audit [DBG] from='client.96939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:34.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:33 smithi163 bash[24253]: cluster 2024-08-31T03:43:32.460960+0000 mgr.a (mgr.14388) 3990 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:34.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:33 smithi163 bash[24253]: audit 2024-08-31T03:43:32.911541+0000 mgr.a (mgr.14388) 3991 : audit [DBG] from='client.96939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:33 smithi027 bash[22610]: cluster 2024-08-31T03:43:32.460960+0000 mgr.a (mgr.14388) 3990 : cluster [DBG] pgmap v2766: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:33 smithi027 bash[22610]: audit 2024-08-31T03:43:32.911541+0000 mgr.a (mgr.14388) 3991 : audit [DBG] from='client.96939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:35 smithi191 bash[24992]: cluster 2024-08-31T03:43:34.463629+0000 mgr.a (mgr.14388) 3992 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:36.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:35 smithi163 bash[24253]: cluster 2024-08-31T03:43:34.463629+0000 mgr.a (mgr.14388) 3992 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:35 smithi027 bash[22610]: cluster 2024-08-31T03:43:34.463629+0000 mgr.a (mgr.14388) 3992 : cluster [DBG] pgmap v2767: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:37 smithi191 bash[24992]: cluster 2024-08-31T03:43:36.464394+0000 mgr.a (mgr.14388) 3993 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:43:38.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:37 smithi163 bash[24253]: cluster 2024-08-31T03:43:36.464394+0000 mgr.a (mgr.14388) 3993 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:43:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:37 smithi027 bash[22610]: cluster 2024-08-31T03:43:36.464394+0000 mgr.a (mgr.14388) 3993 : cluster [DBG] pgmap v2768: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:43:38.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:43:38.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:43:38.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:43:39.121 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:43:39.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:43:39.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:43:39.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:43:39.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:43:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:39 smithi191 bash[24992]: cluster 2024-08-31T03:43:38.465413+0000 mgr.a (mgr.14388) 3994 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:39 smithi191 bash[24992]: audit 2024-08-31T03:43:38.683020+0000 mgr.a (mgr.14388) 3995 : audit [DBG] from='client.97014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:39 smithi191 bash[24992]: audit 2024-08-31T03:43:39.300165+0000 mon.a (mon.0) 1186 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:43:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:39 smithi163 bash[24253]: cluster 2024-08-31T03:43:38.465413+0000 mgr.a (mgr.14388) 3994 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:39 smithi163 bash[24253]: audit 2024-08-31T03:43:38.683020+0000 mgr.a (mgr.14388) 3995 : audit [DBG] from='client.97014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:39 smithi163 bash[24253]: audit 2024-08-31T03:43:39.300165+0000 mon.a (mon.0) 1186 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:43:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:39 smithi027 bash[22610]: cluster 2024-08-31T03:43:38.465413+0000 mgr.a (mgr.14388) 3994 : cluster [DBG] pgmap v2769: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:39 smithi027 bash[22610]: audit 2024-08-31T03:43:38.683020+0000 mgr.a (mgr.14388) 3995 : audit [DBG] from='client.97014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:39 smithi027 bash[22610]: audit 2024-08-31T03:43:39.300165+0000 mon.a (mon.0) 1186 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:43:41.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22863]: debug 2024-08-31T03:43:41.392+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:43:41.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22863]: debug 2024-08-31T03:43:41.392+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:43:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: cluster 2024-08-31T03:43:40.466212+0000 mgr.a (mgr.14388) 3996 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.634436+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.641925+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.656447+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.662852+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.684469+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.689991+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.691063+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:43:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.691879+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:43:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.696625+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.699113+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:43:41.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:41 smithi027 bash[22610]: audit 2024-08-31T03:43:40.700016+0000 mgr.a (mgr.14388) 3997 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:43:41.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: cluster 2024-08-31T03:43:40.466212+0000 mgr.a (mgr.14388) 3996 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.634436+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.641925+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.656447+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.662852+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.684469+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.689991+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.691063+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.691879+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.696625+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.699113+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:43:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:41 smithi163 bash[24253]: audit 2024-08-31T03:43:40.700016+0000 mgr.a (mgr.14388) 3997 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:43:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: cluster 2024-08-31T03:43:40.466212+0000 mgr.a (mgr.14388) 3996 : cluster [DBG] pgmap v2770: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.634436+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.641925+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.656447+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.662852+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:42.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.684469+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:42.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.689991+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:42.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.691063+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:43:42.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.691879+0000 mon.a (mon.0) 1194 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:43:42.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.696625+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:43:42.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.699113+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:43:42.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:41 smithi191 bash[24992]: audit 2024-08-31T03:43:40.700016+0000 mgr.a (mgr.14388) 3997 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:43:42.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:42 smithi163 bash[24253]: audit 2024-08-31T03:43:41.396515+0000 mgr.a (mgr.14388) 3998 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:43:42.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:42 smithi163 bash[24253]: cephadm 2024-08-31T03:43:41.397724+0000 mgr.a (mgr.14388) 3999 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:43:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:42 smithi027 bash[22610]: audit 2024-08-31T03:43:41.396515+0000 mgr.a (mgr.14388) 3998 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:43:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:42 smithi027 bash[22610]: cephadm 2024-08-31T03:43:41.397724+0000 mgr.a (mgr.14388) 3999 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:43:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:42 smithi191 bash[24992]: audit 2024-08-31T03:43:41.396515+0000 mgr.a (mgr.14388) 3998 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:43:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:42 smithi191 bash[24992]: cephadm 2024-08-31T03:43:41.397724+0000 mgr.a (mgr.14388) 3999 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:43:43.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:43 smithi163 bash[24253]: cluster 2024-08-31T03:43:42.467204+0000 mgr.a (mgr.14388) 4000 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:43 smithi027 bash[22610]: cluster 2024-08-31T03:43:42.467204+0000 mgr.a (mgr.14388) 4000 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:43 smithi191 bash[24992]: cluster 2024-08-31T03:43:42.467204+0000 mgr.a (mgr.14388) 4000 : cluster [DBG] pgmap v2771: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:43:44.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:43:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:43:44.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:43:44.889 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:43:44.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:43:44.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:43:44.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:43:44.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:43:45.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:45 smithi163 bash[24253]: audit 2024-08-31T03:43:44.461246+0000 mgr.a (mgr.14388) 4001 : audit [DBG] from='client.97200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:45.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:45 smithi163 bash[24253]: cluster 2024-08-31T03:43:44.479863+0000 mgr.a (mgr.14388) 4002 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:45 smithi027 bash[22610]: audit 2024-08-31T03:43:44.461246+0000 mgr.a (mgr.14388) 4001 : audit [DBG] from='client.97200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:45 smithi027 bash[22610]: cluster 2024-08-31T03:43:44.479863+0000 mgr.a (mgr.14388) 4002 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:45 smithi191 bash[24992]: audit 2024-08-31T03:43:44.461246+0000 mgr.a (mgr.14388) 4001 : audit [DBG] from='client.97200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:45 smithi191 bash[24992]: cluster 2024-08-31T03:43:44.479863+0000 mgr.a (mgr.14388) 4002 : cluster [DBG] pgmap v2772: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:47.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:47 smithi163 bash[24253]: cluster 2024-08-31T03:43:46.480950+0000 mgr.a (mgr.14388) 4003 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T03:43:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:47 smithi027 bash[22610]: cluster 2024-08-31T03:43:46.480950+0000 mgr.a (mgr.14388) 4003 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T03:43:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:47 smithi191 bash[24992]: cluster 2024-08-31T03:43:46.480950+0000 mgr.a (mgr.14388) 4003 : cluster [DBG] pgmap v2773: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T03:43:49.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:43:49.891 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:43:49.891 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:43:49.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:49 smithi163 bash[24253]: cluster 2024-08-31T03:43:48.483178+0000 mgr.a (mgr.14388) 4004 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:49 smithi027 bash[22610]: cluster 2024-08-31T03:43:48.483178+0000 mgr.a (mgr.14388) 4004 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:49 smithi191 bash[24992]: cluster 2024-08-31T03:43:48.483178+0000 mgr.a (mgr.14388) 4004 : cluster [DBG] pgmap v2774: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:50.672 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:43:50.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:43:50.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:43:50.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:43:50.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:43:51.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:51 smithi163 bash[24253]: audit 2024-08-31T03:43:50.233290+0000 mgr.a (mgr.14388) 4005 : audit [DBG] from='client.97278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:51.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:51 smithi163 bash[24253]: cluster 2024-08-31T03:43:50.483774+0000 mgr.a (mgr.14388) 4006 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T03:43:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:51 smithi027 bash[22610]: audit 2024-08-31T03:43:50.233290+0000 mgr.a (mgr.14388) 4005 : audit [DBG] from='client.97278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:51 smithi027 bash[22610]: cluster 2024-08-31T03:43:50.483774+0000 mgr.a (mgr.14388) 4006 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T03:43:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:51 smithi191 bash[24992]: audit 2024-08-31T03:43:50.233290+0000 mgr.a (mgr.14388) 4005 : audit [DBG] from='client.97278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:51 smithi191 bash[24992]: cluster 2024-08-31T03:43:50.483774+0000 mgr.a (mgr.14388) 4006 : cluster [DBG] pgmap v2775: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T03:43:53.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:53 smithi163 bash[24253]: cluster 2024-08-31T03:43:52.484813+0000 mgr.a (mgr.14388) 4007 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:53 smithi027 bash[22610]: cluster 2024-08-31T03:43:52.484813+0000 mgr.a (mgr.14388) 4007 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:53 smithi191 bash[24992]: cluster 2024-08-31T03:43:52.484813+0000 mgr.a (mgr.14388) 4007 : cluster [DBG] pgmap v2776: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:55.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:43:55.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:43:55.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:43:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:55 smithi163 bash[24253]: cluster 2024-08-31T03:43:54.487048+0000 mgr.a (mgr.14388) 4008 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:55 smithi027 bash[22610]: cluster 2024-08-31T03:43:54.487048+0000 mgr.a (mgr.14388) 4008 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:55 smithi191 bash[24992]: cluster 2024-08-31T03:43:54.487048+0000 mgr.a (mgr.14388) 4008 : cluster [DBG] pgmap v2777: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:43:56.431 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:43:56.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:43:56.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:43:56.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:43:56.432 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:43:57.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:57 smithi163 bash[24253]: audit 2024-08-31T03:43:56.008677+0000 mgr.a (mgr.14388) 4009 : audit [DBG] from='client.97356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:57.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:57 smithi163 bash[24253]: cluster 2024-08-31T03:43:56.487634+0000 mgr.a (mgr.14388) 4010 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:57 smithi027 bash[22610]: audit 2024-08-31T03:43:56.008677+0000 mgr.a (mgr.14388) 4009 : audit [DBG] from='client.97356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:57 smithi027 bash[22610]: cluster 2024-08-31T03:43:56.487634+0000 mgr.a (mgr.14388) 4010 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:57 smithi191 bash[24992]: audit 2024-08-31T03:43:56.008677+0000 mgr.a (mgr.14388) 4009 : audit [DBG] from='client.97356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:43:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:57 smithi191 bash[24992]: cluster 2024-08-31T03:43:56.487634+0000 mgr.a (mgr.14388) 4010 : cluster [DBG] pgmap v2778: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:43:59.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:43:59 smithi163 bash[24253]: cluster 2024-08-31T03:43:58.489690+0000 mgr.a (mgr.14388) 4011 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:43:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:43:59 smithi027 bash[22610]: cluster 2024-08-31T03:43:58.489690+0000 mgr.a (mgr.14388) 4011 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:43:59 smithi191 bash[24992]: cluster 2024-08-31T03:43:58.489690+0000 mgr.a (mgr.14388) 4011 : cluster [DBG] pgmap v2779: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:01.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:01.433 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:01.434 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:01.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:01 smithi163 bash[24253]: cluster 2024-08-31T03:44:00.490445+0000 mgr.a (mgr.14388) 4012 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:01 smithi027 bash[22610]: cluster 2024-08-31T03:44:00.490445+0000 mgr.a (mgr.14388) 4012 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:01 smithi191 bash[24992]: cluster 2024-08-31T03:44:00.490445+0000 mgr.a (mgr.14388) 4012 : cluster [DBG] pgmap v2780: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:02.170 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:02.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:02.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:02.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:02.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:02.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:02 smithi163 bash[24253]: audit 2024-08-31T03:44:01.763718+0000 mgr.a (mgr.14388) 4013 : audit [DBG] from='client.97431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:02 smithi027 bash[22610]: audit 2024-08-31T03:44:01.763718+0000 mgr.a (mgr.14388) 4013 : audit [DBG] from='client.97431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:02 smithi191 bash[24992]: audit 2024-08-31T03:44:01.763718+0000 mgr.a (mgr.14388) 4013 : audit [DBG] from='client.97431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:03 smithi027 bash[22610]: cluster 2024-08-31T03:44:02.491548+0000 mgr.a (mgr.14388) 4014 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:03 smithi191 bash[24992]: cluster 2024-08-31T03:44:02.491548+0000 mgr.a (mgr.14388) 4014 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:04.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:03 smithi163 bash[24253]: cluster 2024-08-31T03:44:02.491548+0000 mgr.a (mgr.14388) 4014 : cluster [DBG] pgmap v2781: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:05 smithi027 bash[22610]: cluster 2024-08-31T03:44:04.493932+0000 mgr.a (mgr.14388) 4015 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:05 smithi191 bash[24992]: cluster 2024-08-31T03:44:04.493932+0000 mgr.a (mgr.14388) 4015 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:06.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:05 smithi163 bash[24253]: cluster 2024-08-31T03:44:04.493932+0000 mgr.a (mgr.14388) 4015 : cluster [DBG] pgmap v2782: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:07.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:07.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:07.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:07 smithi191 bash[24992]: cluster 2024-08-31T03:44:06.494905+0000 mgr.a (mgr.14388) 4016 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:07.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:07 smithi163 bash[24253]: cluster 2024-08-31T03:44:06.494905+0000 mgr.a (mgr.14388) 4016 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:07 smithi027 bash[22610]: cluster 2024-08-31T03:44:06.494905+0000 mgr.a (mgr.14388) 4016 : cluster [DBG] pgmap v2783: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:07.936 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:08 smithi191 bash[24992]: audit 2024-08-31T03:44:07.509242+0000 mgr.a (mgr.14388) 4017 : audit [DBG] from='client.97509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:08.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:08 smithi163 bash[24253]: audit 2024-08-31T03:44:07.509242+0000 mgr.a (mgr.14388) 4017 : audit [DBG] from='client.97509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:08 smithi027 bash[22610]: audit 2024-08-31T03:44:07.509242+0000 mgr.a (mgr.14388) 4017 : audit [DBG] from='client.97509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:09 smithi191 bash[24992]: cluster 2024-08-31T03:44:08.497275+0000 mgr.a (mgr.14388) 4018 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:44:09.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:09 smithi163 bash[24253]: cluster 2024-08-31T03:44:08.497275+0000 mgr.a (mgr.14388) 4018 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:44:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:09 smithi027 bash[22610]: cluster 2024-08-31T03:44:08.497275+0000 mgr.a (mgr.14388) 4018 : cluster [DBG] pgmap v2784: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:44:11.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:11 smithi163 bash[24253]: cluster 2024-08-31T03:44:10.498093+0000 mgr.a (mgr.14388) 4019 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:44:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:11 smithi027 bash[22610]: cluster 2024-08-31T03:44:10.498093+0000 mgr.a (mgr.14388) 4019 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:44:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:11 smithi191 bash[24992]: cluster 2024-08-31T03:44:10.498093+0000 mgr.a (mgr.14388) 4019 : cluster [DBG] pgmap v2785: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:44:12.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:12.938 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:12.938 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:13.725 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:13.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:13.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:13.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:13.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:13.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:13 smithi163 bash[24253]: cluster 2024-08-31T03:44:12.498840+0000 mgr.a (mgr.14388) 4020 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:44:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:13 smithi027 bash[22610]: cluster 2024-08-31T03:44:12.498840+0000 mgr.a (mgr.14388) 4020 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:44:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:13 smithi191 bash[24992]: cluster 2024-08-31T03:44:12.498840+0000 mgr.a (mgr.14388) 4020 : cluster [DBG] pgmap v2786: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:44:14.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:14 smithi163 bash[24253]: audit 2024-08-31T03:44:13.279348+0000 mgr.a (mgr.14388) 4021 : audit [DBG] from='client.97587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:14 smithi027 bash[22610]: audit 2024-08-31T03:44:13.279348+0000 mgr.a (mgr.14388) 4021 : audit [DBG] from='client.97587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:14 smithi191 bash[24992]: audit 2024-08-31T03:44:13.279348+0000 mgr.a (mgr.14388) 4021 : audit [DBG] from='client.97587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:15.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:15 smithi163 bash[24253]: cluster 2024-08-31T03:44:14.501496+0000 mgr.a (mgr.14388) 4022 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:15 smithi027 bash[22610]: cluster 2024-08-31T03:44:14.501496+0000 mgr.a (mgr.14388) 4022 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:15 smithi191 bash[24992]: cluster 2024-08-31T03:44:14.501496+0000 mgr.a (mgr.14388) 4022 : cluster [DBG] pgmap v2787: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:17.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:17 smithi163 bash[24253]: cluster 2024-08-31T03:44:16.502289+0000 mgr.a (mgr.14388) 4023 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:44:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:17 smithi027 bash[22610]: cluster 2024-08-31T03:44:16.502289+0000 mgr.a (mgr.14388) 4023 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:44:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:17 smithi191 bash[24992]: cluster 2024-08-31T03:44:16.502289+0000 mgr.a (mgr.14388) 4023 : cluster [DBG] pgmap v2788: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:44:18.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:18.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:18.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:19.514 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:19.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:19.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:19.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:19.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:19.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:19 smithi163 bash[24253]: cluster 2024-08-31T03:44:18.504272+0000 mgr.a (mgr.14388) 4024 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:19 smithi027 bash[22610]: cluster 2024-08-31T03:44:18.504272+0000 mgr.a (mgr.14388) 4024 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:19 smithi191 bash[24992]: cluster 2024-08-31T03:44:18.504272+0000 mgr.a (mgr.14388) 4024 : cluster [DBG] pgmap v2789: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:20.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:20 smithi163 bash[24253]: audit 2024-08-31T03:44:19.068375+0000 mgr.a (mgr.14388) 4025 : audit [DBG] from='client.97665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:20 smithi027 bash[22610]: audit 2024-08-31T03:44:19.068375+0000 mgr.a (mgr.14388) 4025 : audit [DBG] from='client.97665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:20 smithi191 bash[24992]: audit 2024-08-31T03:44:19.068375+0000 mgr.a (mgr.14388) 4025 : audit [DBG] from='client.97665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:21.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:21 smithi163 bash[24253]: cluster 2024-08-31T03:44:20.505154+0000 mgr.a (mgr.14388) 4026 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:44:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:21 smithi027 bash[22610]: cluster 2024-08-31T03:44:20.505154+0000 mgr.a (mgr.14388) 4026 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:44:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:21 smithi191 bash[24992]: cluster 2024-08-31T03:44:20.505154+0000 mgr.a (mgr.14388) 4026 : cluster [DBG] pgmap v2790: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:44:23.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:23 smithi163 bash[24253]: cluster 2024-08-31T03:44:22.505912+0000 mgr.a (mgr.14388) 4027 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:44:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:23 smithi027 bash[22610]: cluster 2024-08-31T03:44:22.505912+0000 mgr.a (mgr.14388) 4027 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:44:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:23 smithi191 bash[24992]: cluster 2024-08-31T03:44:22.505912+0000 mgr.a (mgr.14388) 4027 : cluster [DBG] pgmap v2791: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:44:24.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:24.517 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:24.517 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:25.285 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:25.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:25.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:25.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:25.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:25.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:25 smithi163 bash[24253]: cluster 2024-08-31T03:44:24.508103+0000 mgr.a (mgr.14388) 4028 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:44:25.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:25 smithi163 bash[24253]: audit 2024-08-31T03:44:24.856342+0000 mgr.a (mgr.14388) 4029 : audit [DBG] from='client.97740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:25 smithi027 bash[22610]: cluster 2024-08-31T03:44:24.508103+0000 mgr.a (mgr.14388) 4028 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:44:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:25 smithi027 bash[22610]: audit 2024-08-31T03:44:24.856342+0000 mgr.a (mgr.14388) 4029 : audit [DBG] from='client.97740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:25 smithi191 bash[24992]: cluster 2024-08-31T03:44:24.508103+0000 mgr.a (mgr.14388) 4028 : cluster [DBG] pgmap v2792: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:44:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:25 smithi191 bash[24992]: audit 2024-08-31T03:44:24.856342+0000 mgr.a (mgr.14388) 4029 : audit [DBG] from='client.97740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:27.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:27 smithi163 bash[24253]: cluster 2024-08-31T03:44:26.508970+0000 mgr.a (mgr.14388) 4030 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:27 smithi027 bash[22610]: cluster 2024-08-31T03:44:26.508970+0000 mgr.a (mgr.14388) 4030 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:27 smithi191 bash[24992]: cluster 2024-08-31T03:44:26.508970+0000 mgr.a (mgr.14388) 4030 : cluster [DBG] pgmap v2793: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:29.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:29 smithi163 bash[24253]: cluster 2024-08-31T03:44:28.511170+0000 mgr.a (mgr.14388) 4031 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:29 smithi027 bash[22610]: cluster 2024-08-31T03:44:28.511170+0000 mgr.a (mgr.14388) 4031 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:29 smithi191 bash[24992]: cluster 2024-08-31T03:44:28.511170+0000 mgr.a (mgr.14388) 4031 : cluster [DBG] pgmap v2794: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:30.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:30.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:30.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:31.057 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:31.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:31.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:31 smithi163 bash[24253]: cluster 2024-08-31T03:44:30.512073+0000 mgr.a (mgr.14388) 4032 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:31.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:31 smithi163 bash[24253]: audit 2024-08-31T03:44:30.625916+0000 mgr.a (mgr.14388) 4033 : audit [DBG] from='client.97818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:31 smithi027 bash[22610]: cluster 2024-08-31T03:44:30.512073+0000 mgr.a (mgr.14388) 4032 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:31 smithi027 bash[22610]: audit 2024-08-31T03:44:30.625916+0000 mgr.a (mgr.14388) 4033 : audit [DBG] from='client.97818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:31 smithi191 bash[24992]: cluster 2024-08-31T03:44:30.512073+0000 mgr.a (mgr.14388) 4032 : cluster [DBG] pgmap v2795: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:31 smithi191 bash[24992]: audit 2024-08-31T03:44:30.625916+0000 mgr.a (mgr.14388) 4033 : audit [DBG] from='client.97818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:33.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:33 smithi163 bash[24253]: cluster 2024-08-31T03:44:32.512950+0000 mgr.a (mgr.14388) 4034 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:33 smithi027 bash[22610]: cluster 2024-08-31T03:44:32.512950+0000 mgr.a (mgr.14388) 4034 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:33 smithi191 bash[24992]: cluster 2024-08-31T03:44:32.512950+0000 mgr.a (mgr.14388) 4034 : cluster [DBG] pgmap v2796: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:35.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:35 smithi163 bash[24253]: cluster 2024-08-31T03:44:34.515182+0000 mgr.a (mgr.14388) 4035 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:35 smithi027 bash[22610]: cluster 2024-08-31T03:44:34.515182+0000 mgr.a (mgr.14388) 4035 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:35 smithi191 bash[24992]: cluster 2024-08-31T03:44:34.515182+0000 mgr.a (mgr.14388) 4035 : cluster [DBG] pgmap v2797: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:36.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:36.060 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:36.060 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:36.825 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:36.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:37.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:37 smithi163 bash[24253]: audit 2024-08-31T03:44:36.394232+0000 mgr.a (mgr.14388) 4036 : audit [DBG] from='client.97896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:37.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:37 smithi163 bash[24253]: cluster 2024-08-31T03:44:36.515724+0000 mgr.a (mgr.14388) 4037 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:37 smithi027 bash[22610]: audit 2024-08-31T03:44:36.394232+0000 mgr.a (mgr.14388) 4036 : audit [DBG] from='client.97896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:37 smithi027 bash[22610]: cluster 2024-08-31T03:44:36.515724+0000 mgr.a (mgr.14388) 4037 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:37 smithi191 bash[24992]: audit 2024-08-31T03:44:36.394232+0000 mgr.a (mgr.14388) 4036 : audit [DBG] from='client.97896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:37 smithi191 bash[24992]: cluster 2024-08-31T03:44:36.515724+0000 mgr.a (mgr.14388) 4037 : cluster [DBG] pgmap v2798: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:39.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:39 smithi163 bash[24253]: cluster 2024-08-31T03:44:38.517885+0000 mgr.a (mgr.14388) 4038 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:39 smithi027 bash[22610]: cluster 2024-08-31T03:44:38.517885+0000 mgr.a (mgr.14388) 4038 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:39 smithi191 bash[24992]: cluster 2024-08-31T03:44:38.517885+0000 mgr.a (mgr.14388) 4038 : cluster [DBG] pgmap v2799: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:41.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:41.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:41.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:41.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:41 smithi163 bash[24253]: cluster 2024-08-31T03:44:40.518662+0000 mgr.a (mgr.14388) 4039 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:41.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:41 smithi163 bash[24253]: audit 2024-08-31T03:44:41.449961+0000 mon.a (mon.0) 1197 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:44:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:41 smithi027 bash[22610]: cluster 2024-08-31T03:44:40.518662+0000 mgr.a (mgr.14388) 4039 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:41 smithi027 bash[22610]: audit 2024-08-31T03:44:41.449961+0000 mon.a (mon.0) 1197 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:44:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:41 smithi191 bash[24992]: cluster 2024-08-31T03:44:40.518662+0000 mgr.a (mgr.14388) 4039 : cluster [DBG] pgmap v2800: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:41 smithi191 bash[24992]: audit 2024-08-31T03:44:41.449961+0000 mon.a (mon.0) 1197 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:44:42.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:42.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:42.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:42.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:42.607 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:42.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:42 smithi163 bash[24253]: audit 2024-08-31T03:44:42.308567+0000 mon.a (mon.0) 1198 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:44:42.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:42 smithi163 bash[24253]: audit 2024-08-31T03:44:42.309523+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:44:42.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:42 smithi163 bash[24253]: audit 2024-08-31T03:44:42.315081+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:44:42.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:42 smithi163 bash[24253]: audit 2024-08-31T03:44:42.328617+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:44:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:42 smithi027 bash[22610]: audit 2024-08-31T03:44:42.308567+0000 mon.a (mon.0) 1198 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:44:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:42 smithi027 bash[22610]: audit 2024-08-31T03:44:42.309523+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:44:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:42 smithi027 bash[22610]: audit 2024-08-31T03:44:42.315081+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:44:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:42 smithi027 bash[22610]: audit 2024-08-31T03:44:42.328617+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:44:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:42 smithi191 bash[24992]: audit 2024-08-31T03:44:42.308567+0000 mon.a (mon.0) 1198 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:44:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:42 smithi191 bash[24992]: audit 2024-08-31T03:44:42.309523+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:44:43.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:42 smithi191 bash[24992]: audit 2024-08-31T03:44:42.315081+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:44:43.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:42 smithi191 bash[24992]: audit 2024-08-31T03:44:42.328617+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:44:43.638 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:44:43 smithi027 bash[22863]: debug 2024-08-31T03:44:43.294+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:44:43.638 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:44:43 smithi027 bash[22863]: debug 2024-08-31T03:44:43.294+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:44:43.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:43 smithi163 bash[24253]: audit 2024-08-31T03:44:42.174489+0000 mgr.a (mgr.14388) 4040 : audit [DBG] from='client.97974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:43.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:43 smithi163 bash[24253]: audit 2024-08-31T03:44:42.329628+0000 mgr.a (mgr.14388) 4041 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:44:43.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:43 smithi163 bash[24253]: cluster 2024-08-31T03:44:42.519203+0000 mgr.a (mgr.14388) 4042 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:43 smithi027 bash[22610]: audit 2024-08-31T03:44:42.174489+0000 mgr.a (mgr.14388) 4040 : audit [DBG] from='client.97974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:43 smithi027 bash[22610]: audit 2024-08-31T03:44:42.329628+0000 mgr.a (mgr.14388) 4041 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:44:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:43 smithi027 bash[22610]: cluster 2024-08-31T03:44:42.519203+0000 mgr.a (mgr.14388) 4042 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:43 smithi191 bash[24992]: audit 2024-08-31T03:44:42.174489+0000 mgr.a (mgr.14388) 4040 : audit [DBG] from='client.97974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:43 smithi191 bash[24992]: audit 2024-08-31T03:44:42.329628+0000 mgr.a (mgr.14388) 4041 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:44:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:43 smithi191 bash[24992]: cluster 2024-08-31T03:44:42.519203+0000 mgr.a (mgr.14388) 4042 : cluster [DBG] pgmap v2801: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:44:44.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:44 smithi163 bash[24253]: audit 2024-08-31T03:44:43.295392+0000 mgr.a (mgr.14388) 4043 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:44:44.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:44 smithi163 bash[24253]: cephadm 2024-08-31T03:44:43.296868+0000 mgr.a (mgr.14388) 4044 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:44:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:44 smithi027 bash[22610]: audit 2024-08-31T03:44:43.295392+0000 mgr.a (mgr.14388) 4043 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:44:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:44 smithi027 bash[22610]: cephadm 2024-08-31T03:44:43.296868+0000 mgr.a (mgr.14388) 4044 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:44:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:44 smithi191 bash[24992]: audit 2024-08-31T03:44:43.295392+0000 mgr.a (mgr.14388) 4043 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:44:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:44 smithi191 bash[24992]: cephadm 2024-08-31T03:44:43.296868+0000 mgr.a (mgr.14388) 4044 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:44:45.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:45 smithi163 bash[24253]: cluster 2024-08-31T03:44:44.521731+0000 mgr.a (mgr.14388) 4045 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T03:44:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:45 smithi027 bash[22610]: cluster 2024-08-31T03:44:44.521731+0000 mgr.a (mgr.14388) 4045 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T03:44:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:45 smithi191 bash[24992]: cluster 2024-08-31T03:44:44.521731+0000 mgr.a (mgr.14388) 4045 : cluster [DBG] pgmap v2802: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-08-31T03:44:47.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:47.609 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:47.609 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:47.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:47 smithi163 bash[24253]: cluster 2024-08-31T03:44:46.522448+0000 mgr.a (mgr.14388) 4046 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:47 smithi027 bash[22610]: cluster 2024-08-31T03:44:46.522448+0000 mgr.a (mgr.14388) 4046 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:47 smithi191 bash[24992]: cluster 2024-08-31T03:44:46.522448+0000 mgr.a (mgr.14388) 4046 : cluster [DBG] pgmap v2803: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:44:48.393 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:48.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:48.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:48.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:48.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:48.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:48 smithi163 bash[24253]: audit 2024-08-31T03:44:47.950223+0000 mgr.a (mgr.14388) 4047 : audit [DBG] from='client.98160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:48 smithi027 bash[22610]: audit 2024-08-31T03:44:47.950223+0000 mgr.a (mgr.14388) 4047 : audit [DBG] from='client.98160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:48 smithi191 bash[24992]: audit 2024-08-31T03:44:47.950223+0000 mgr.a (mgr.14388) 4047 : audit [DBG] from='client.98160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:49.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:49 smithi163 bash[24253]: cluster 2024-08-31T03:44:48.525050+0000 mgr.a (mgr.14388) 4048 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:44:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:49 smithi027 bash[22610]: cluster 2024-08-31T03:44:48.525050+0000 mgr.a (mgr.14388) 4048 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:44:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:49 smithi191 bash[24992]: cluster 2024-08-31T03:44:48.525050+0000 mgr.a (mgr.14388) 4048 : cluster [DBG] pgmap v2804: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:44:51.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:51 smithi163 bash[24253]: cluster 2024-08-31T03:44:50.525854+0000 mgr.a (mgr.14388) 4049 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:44:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:51 smithi027 bash[22610]: cluster 2024-08-31T03:44:50.525854+0000 mgr.a (mgr.14388) 4049 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:44:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:51 smithi191 bash[24992]: cluster 2024-08-31T03:44:50.525854+0000 mgr.a (mgr.14388) 4049 : cluster [DBG] pgmap v2805: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:44:53.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:53.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:53.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:53.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:53 smithi163 bash[24253]: cluster 2024-08-31T03:44:52.526633+0000 mgr.a (mgr.14388) 4050 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:44:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:53 smithi027 bash[22610]: cluster 2024-08-31T03:44:52.526633+0000 mgr.a (mgr.14388) 4050 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:44:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:53 smithi191 bash[24992]: cluster 2024-08-31T03:44:52.526633+0000 mgr.a (mgr.14388) 4050 : cluster [DBG] pgmap v2806: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:44:54.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:54.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:54.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:54.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:54.165 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:54.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:54 smithi163 bash[24253]: audit 2024-08-31T03:44:53.734239+0000 mgr.a (mgr.14388) 4051 : audit [DBG] from='client.98235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:54 smithi027 bash[22610]: audit 2024-08-31T03:44:53.734239+0000 mgr.a (mgr.14388) 4051 : audit [DBG] from='client.98235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:54 smithi191 bash[24992]: audit 2024-08-31T03:44:53.734239+0000 mgr.a (mgr.14388) 4051 : audit [DBG] from='client.98235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:44:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:55 smithi163 bash[24253]: cluster 2024-08-31T03:44:54.529314+0000 mgr.a (mgr.14388) 4052 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:44:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:55 smithi027 bash[22610]: cluster 2024-08-31T03:44:54.529314+0000 mgr.a (mgr.14388) 4052 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:44:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:55 smithi191 bash[24992]: cluster 2024-08-31T03:44:54.529314+0000 mgr.a (mgr.14388) 4052 : cluster [DBG] pgmap v2807: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:44:57.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:57 smithi163 bash[24253]: cluster 2024-08-31T03:44:56.530078+0000 mgr.a (mgr.14388) 4053 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:44:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:57 smithi027 bash[22610]: cluster 2024-08-31T03:44:56.530078+0000 mgr.a (mgr.14388) 4053 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:44:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:57 smithi191 bash[24992]: cluster 2024-08-31T03:44:56.530078+0000 mgr.a (mgr.14388) 4053 : cluster [DBG] pgmap v2808: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:44:59.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:44:59.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:44:59.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:44:59.926 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:44:59.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:44:59.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:44:59.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:44:59.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:44:59.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:44:59 smithi163 bash[24253]: cluster 2024-08-31T03:44:58.532052+0000 mgr.a (mgr.14388) 4054 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:44:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:44:59 smithi027 bash[22610]: cluster 2024-08-31T03:44:58.532052+0000 mgr.a (mgr.14388) 4054 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:45:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:44:59 smithi191 bash[24992]: cluster 2024-08-31T03:44:58.532052+0000 mgr.a (mgr.14388) 4054 : cluster [DBG] pgmap v2809: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:45:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:00 smithi027 bash[22610]: audit 2024-08-31T03:44:59.498077+0000 mgr.a (mgr.14388) 4055 : audit [DBG] from='client.98307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:00 smithi191 bash[24992]: audit 2024-08-31T03:44:59.498077+0000 mgr.a (mgr.14388) 4055 : audit [DBG] from='client.98307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:01.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:00 smithi163 bash[24253]: audit 2024-08-31T03:44:59.498077+0000 mgr.a (mgr.14388) 4055 : audit [DBG] from='client.98307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:01 smithi191 bash[24992]: cluster 2024-08-31T03:45:00.532907+0000 mgr.a (mgr.14388) 4056 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:01.978 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:01 smithi163 bash[24253]: cluster 2024-08-31T03:45:00.532907+0000 mgr.a (mgr.14388) 4056 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:01 smithi027 bash[22610]: cluster 2024-08-31T03:45:00.532907+0000 mgr.a (mgr.14388) 4056 : cluster [DBG] pgmap v2810: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:03 smithi027 bash[22610]: cluster 2024-08-31T03:45:02.533663+0000 mgr.a (mgr.14388) 4057 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:03 smithi191 bash[24992]: cluster 2024-08-31T03:45:02.533663+0000 mgr.a (mgr.14388) 4057 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:04.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:03 smithi163 bash[24253]: cluster 2024-08-31T03:45:02.533663+0000 mgr.a (mgr.14388) 4057 : cluster [DBG] pgmap v2811: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:04.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:45:04.928 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:45:04.928 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:45:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:45:05.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:45:05.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:45:05.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:45:05.703 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:45:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:05 smithi027 bash[22610]: cluster 2024-08-31T03:45:04.535860+0000 mgr.a (mgr.14388) 4058 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:05 smithi191 bash[24992]: cluster 2024-08-31T03:45:04.535860+0000 mgr.a (mgr.14388) 4058 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:06.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:05 smithi163 bash[24253]: cluster 2024-08-31T03:45:04.535860+0000 mgr.a (mgr.14388) 4058 : cluster [DBG] pgmap v2812: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:06 smithi027 bash[22610]: audit 2024-08-31T03:45:05.260899+0000 mgr.a (mgr.14388) 4059 : audit [DBG] from='client.98385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:06 smithi191 bash[24992]: audit 2024-08-31T03:45:05.260899+0000 mgr.a (mgr.14388) 4059 : audit [DBG] from='client.98385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:07.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:06 smithi163 bash[24253]: audit 2024-08-31T03:45:05.260899+0000 mgr.a (mgr.14388) 4059 : audit [DBG] from='client.98385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:07 smithi027 bash[22610]: cluster 2024-08-31T03:45:06.536818+0000 mgr.a (mgr.14388) 4060 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:07 smithi191 bash[24992]: cluster 2024-08-31T03:45:06.536818+0000 mgr.a (mgr.14388) 4060 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:08.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:07 smithi163 bash[24253]: cluster 2024-08-31T03:45:06.536818+0000 mgr.a (mgr.14388) 4060 : cluster [DBG] pgmap v2813: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:09 smithi027 bash[22610]: cluster 2024-08-31T03:45:08.539057+0000 mgr.a (mgr.14388) 4061 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:09 smithi191 bash[24992]: cluster 2024-08-31T03:45:08.539057+0000 mgr.a (mgr.14388) 4061 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:10.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:09 smithi163 bash[24253]: cluster 2024-08-31T03:45:08.539057+0000 mgr.a (mgr.14388) 4061 : cluster [DBG] pgmap v2814: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:10.704 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:45:10.705 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:45:10.705 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:45:11.468 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:45:11.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:45:11.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:45:11.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:45:11.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:45:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:11 smithi027 bash[22610]: cluster 2024-08-31T03:45:10.539834+0000 mgr.a (mgr.14388) 4062 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:11 smithi191 bash[24992]: cluster 2024-08-31T03:45:10.539834+0000 mgr.a (mgr.14388) 4062 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:12.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:11 smithi163 bash[24253]: cluster 2024-08-31T03:45:10.539834+0000 mgr.a (mgr.14388) 4062 : cluster [DBG] pgmap v2815: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:12 smithi191 bash[24992]: audit 2024-08-31T03:45:11.041021+0000 mgr.a (mgr.14388) 4063 : audit [DBG] from='client.98460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:13.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:12 smithi163 bash[24253]: audit 2024-08-31T03:45:11.041021+0000 mgr.a (mgr.14388) 4063 : audit [DBG] from='client.98460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:12 smithi027 bash[22610]: audit 2024-08-31T03:45:11.041021+0000 mgr.a (mgr.14388) 4063 : audit [DBG] from='client.98460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:13 smithi191 bash[24992]: cluster 2024-08-31T03:45:12.540767+0000 mgr.a (mgr.14388) 4064 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:14.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:13 smithi163 bash[24253]: cluster 2024-08-31T03:45:12.540767+0000 mgr.a (mgr.14388) 4064 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:13 smithi027 bash[22610]: cluster 2024-08-31T03:45:12.540767+0000 mgr.a (mgr.14388) 4064 : cluster [DBG] pgmap v2816: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:15 smithi191 bash[24992]: cluster 2024-08-31T03:45:14.543022+0000 mgr.a (mgr.14388) 4065 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:16.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:15 smithi163 bash[24253]: cluster 2024-08-31T03:45:14.543022+0000 mgr.a (mgr.14388) 4065 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:15 smithi027 bash[22610]: cluster 2024-08-31T03:45:14.543022+0000 mgr.a (mgr.14388) 4065 : cluster [DBG] pgmap v2817: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:16.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:45:16.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:45:16.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:45:17.235 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:45:17.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:45:17.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:45:17.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:45:17.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:45:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:17 smithi191 bash[24992]: cluster 2024-08-31T03:45:16.543575+0000 mgr.a (mgr.14388) 4066 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:17 smithi191 bash[24992]: audit 2024-08-31T03:45:16.804083+0000 mgr.a (mgr.14388) 4067 : audit [DBG] from='client.98538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:18.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:17 smithi163 bash[24253]: cluster 2024-08-31T03:45:16.543575+0000 mgr.a (mgr.14388) 4066 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:18.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:17 smithi163 bash[24253]: audit 2024-08-31T03:45:16.804083+0000 mgr.a (mgr.14388) 4067 : audit [DBG] from='client.98538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:17 smithi027 bash[22610]: cluster 2024-08-31T03:45:16.543575+0000 mgr.a (mgr.14388) 4066 : cluster [DBG] pgmap v2818: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:17 smithi027 bash[22610]: audit 2024-08-31T03:45:16.804083+0000 mgr.a (mgr.14388) 4067 : audit [DBG] from='client.98538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:19 smithi191 bash[24992]: cluster 2024-08-31T03:45:18.545900+0000 mgr.a (mgr.14388) 4068 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:20.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:19 smithi163 bash[24253]: cluster 2024-08-31T03:45:18.545900+0000 mgr.a (mgr.14388) 4068 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:19 smithi027 bash[22610]: cluster 2024-08-31T03:45:18.545900+0000 mgr.a (mgr.14388) 4068 : cluster [DBG] pgmap v2819: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:21 smithi191 bash[24992]: cluster 2024-08-31T03:45:20.546682+0000 mgr.a (mgr.14388) 4069 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:22.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:21 smithi163 bash[24253]: cluster 2024-08-31T03:45:20.546682+0000 mgr.a (mgr.14388) 4069 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:21 smithi027 bash[22610]: cluster 2024-08-31T03:45:20.546682+0000 mgr.a (mgr.14388) 4069 : cluster [DBG] pgmap v2820: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:22.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:45:22.238 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:45:22.238 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:45:23.000 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:45:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:45:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:45:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:45:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:45:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:23 smithi191 bash[24992]: cluster 2024-08-31T03:45:22.547424+0000 mgr.a (mgr.14388) 4070 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:23 smithi191 bash[24992]: audit 2024-08-31T03:45:22.570715+0000 mgr.a (mgr.14388) 4071 : audit [DBG] from='client.98613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:24.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:23 smithi163 bash[24253]: cluster 2024-08-31T03:45:22.547424+0000 mgr.a (mgr.14388) 4070 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:24.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:23 smithi163 bash[24253]: audit 2024-08-31T03:45:22.570715+0000 mgr.a (mgr.14388) 4071 : audit [DBG] from='client.98613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:23 smithi027 bash[22610]: cluster 2024-08-31T03:45:22.547424+0000 mgr.a (mgr.14388) 4070 : cluster [DBG] pgmap v2821: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:23 smithi027 bash[22610]: audit 2024-08-31T03:45:22.570715+0000 mgr.a (mgr.14388) 4071 : audit [DBG] from='client.98613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:25 smithi191 bash[24992]: cluster 2024-08-31T03:45:24.549798+0000 mgr.a (mgr.14388) 4072 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:45:26.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:25 smithi163 bash[24253]: cluster 2024-08-31T03:45:24.549798+0000 mgr.a (mgr.14388) 4072 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:45:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:25 smithi027 bash[22610]: cluster 2024-08-31T03:45:24.549798+0000 mgr.a (mgr.14388) 4072 : cluster [DBG] pgmap v2822: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:45:28.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:45:28.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:45:28.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:45:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:27 smithi191 bash[24992]: cluster 2024-08-31T03:45:26.550606+0000 mgr.a (mgr.14388) 4073 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:45:28.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:27 smithi163 bash[24253]: cluster 2024-08-31T03:45:26.550606+0000 mgr.a (mgr.14388) 4073 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:45:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:27 smithi027 bash[22610]: cluster 2024-08-31T03:45:26.550606+0000 mgr.a (mgr.14388) 4073 : cluster [DBG] pgmap v2823: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:45:28.786 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:45:28.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:45:28.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:45:28.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:45:28.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:45:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:29 smithi191 bash[24992]: audit 2024-08-31T03:45:28.345358+0000 mgr.a (mgr.14388) 4074 : audit [DBG] from='client.98688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:29 smithi191 bash[24992]: cluster 2024-08-31T03:45:28.552048+0000 mgr.a (mgr.14388) 4075 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:30.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:29 smithi163 bash[24253]: audit 2024-08-31T03:45:28.345358+0000 mgr.a (mgr.14388) 4074 : audit [DBG] from='client.98688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:30.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:29 smithi163 bash[24253]: cluster 2024-08-31T03:45:28.552048+0000 mgr.a (mgr.14388) 4075 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:29 smithi027 bash[22610]: audit 2024-08-31T03:45:28.345358+0000 mgr.a (mgr.14388) 4074 : audit [DBG] from='client.98688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:29 smithi027 bash[22610]: cluster 2024-08-31T03:45:28.552048+0000 mgr.a (mgr.14388) 4075 : cluster [DBG] pgmap v2824: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:31 smithi191 bash[24992]: cluster 2024-08-31T03:45:30.552939+0000 mgr.a (mgr.14388) 4076 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:45:32.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:31 smithi163 bash[24253]: cluster 2024-08-31T03:45:30.552939+0000 mgr.a (mgr.14388) 4076 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:45:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:31 smithi027 bash[22610]: cluster 2024-08-31T03:45:30.552939+0000 mgr.a (mgr.14388) 4076 : cluster [DBG] pgmap v2825: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:45:33.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:45:33.788 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:45:33.788 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:45:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:33 smithi191 bash[24992]: cluster 2024-08-31T03:45:32.553722+0000 mgr.a (mgr.14388) 4077 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:45:34.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:33 smithi163 bash[24253]: cluster 2024-08-31T03:45:32.553722+0000 mgr.a (mgr.14388) 4077 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:45:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:33 smithi027 bash[22610]: cluster 2024-08-31T03:45:32.553722+0000 mgr.a (mgr.14388) 4077 : cluster [DBG] pgmap v2826: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:45:34.569 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:45:34.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:45:34.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:45:34.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:45:34.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:45:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:35 smithi191 bash[24992]: audit 2024-08-31T03:45:34.125435+0000 mgr.a (mgr.14388) 4078 : audit [DBG] from='client.98766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:35 smithi191 bash[24992]: cluster 2024-08-31T03:45:34.554911+0000 mgr.a (mgr.14388) 4079 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:36.196 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:35 smithi163 bash[24253]: audit 2024-08-31T03:45:34.125435+0000 mgr.a (mgr.14388) 4078 : audit [DBG] from='client.98766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:36.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:35 smithi163 bash[24253]: cluster 2024-08-31T03:45:34.554911+0000 mgr.a (mgr.14388) 4079 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:35 smithi027 bash[22610]: audit 2024-08-31T03:45:34.125435+0000 mgr.a (mgr.14388) 4078 : audit [DBG] from='client.98766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:35 smithi027 bash[22610]: cluster 2024-08-31T03:45:34.554911+0000 mgr.a (mgr.14388) 4079 : cluster [DBG] pgmap v2827: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:38.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:37 smithi163 bash[24253]: cluster 2024-08-31T03:45:36.555662+0000 mgr.a (mgr.14388) 4080 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:45:38.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:37 smithi027 bash[22610]: cluster 2024-08-31T03:45:36.555662+0000 mgr.a (mgr.14388) 4080 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:45:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:37 smithi191 bash[24992]: cluster 2024-08-31T03:45:36.555662+0000 mgr.a (mgr.14388) 4080 : cluster [DBG] pgmap v2828: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:45:39.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:45:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:45:39.571 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:45:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:39 smithi163 bash[24253]: cluster 2024-08-31T03:45:38.557764+0000 mgr.a (mgr.14388) 4081 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:45:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:39 smithi027 bash[22610]: cluster 2024-08-31T03:45:38.557764+0000 mgr.a (mgr.14388) 4081 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:45:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:39 smithi191 bash[24992]: cluster 2024-08-31T03:45:38.557764+0000 mgr.a (mgr.14388) 4081 : cluster [DBG] pgmap v2829: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:45:40.347 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:45:40.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:45:40.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:45:40.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:45:40.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:45:41.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:40 smithi163 bash[24253]: audit 2024-08-31T03:45:39.907946+0000 mgr.a (mgr.14388) 4082 : audit [DBG] from='client.98841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:40 smithi027 bash[22610]: audit 2024-08-31T03:45:39.907946+0000 mgr.a (mgr.14388) 4082 : audit [DBG] from='client.98841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:40 smithi191 bash[24992]: audit 2024-08-31T03:45:39.907946+0000 mgr.a (mgr.14388) 4082 : audit [DBG] from='client.98841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:42.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:41 smithi163 bash[24253]: cluster 2024-08-31T03:45:40.558924+0000 mgr.a (mgr.14388) 4083 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:41 smithi027 bash[22610]: cluster 2024-08-31T03:45:40.558924+0000 mgr.a (mgr.14388) 4083 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:41 smithi191 bash[24992]: cluster 2024-08-31T03:45:40.558924+0000 mgr.a (mgr.14388) 4083 : cluster [DBG] pgmap v2830: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:44.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:43 smithi163 bash[24253]: cluster 2024-08-31T03:45:42.559775+0000 mgr.a (mgr.14388) 4084 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:44.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:43 smithi163 bash[24253]: audit 2024-08-31T03:45:43.349464+0000 mon.a (mon.0) 1202 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:45:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:43 smithi027 bash[22610]: cluster 2024-08-31T03:45:42.559775+0000 mgr.a (mgr.14388) 4084 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:43 smithi027 bash[22610]: audit 2024-08-31T03:45:43.349464+0000 mon.a (mon.0) 1202 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:45:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:43 smithi191 bash[24992]: cluster 2024-08-31T03:45:42.559775+0000 mgr.a (mgr.14388) 4084 : cluster [DBG] pgmap v2831: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:44.308 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:43 smithi191 bash[24992]: audit 2024-08-31T03:45:43.349464+0000 mon.a (mon.0) 1202 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:45:45.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:44 smithi163 bash[24253]: audit 2024-08-31T03:45:44.194670+0000 mon.a (mon.0) 1203 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:45:45.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:44 smithi163 bash[24253]: audit 2024-08-31T03:45:44.195997+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:45:45.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:44 smithi163 bash[24253]: audit 2024-08-31T03:45:44.205612+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:45:45.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:44 smithi163 bash[24253]: audit 2024-08-31T03:45:44.210623+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:45:45.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:45:44 smithi027 bash[22863]: debug 2024-08-31T03:45:44.941+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:45:45.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:45:44 smithi027 bash[22863]: debug 2024-08-31T03:45:44.941+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:45:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:44 smithi027 bash[22610]: audit 2024-08-31T03:45:44.194670+0000 mon.a (mon.0) 1203 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:45:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:44 smithi027 bash[22610]: audit 2024-08-31T03:45:44.195997+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:45:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:44 smithi027 bash[22610]: audit 2024-08-31T03:45:44.205612+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:45:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:44 smithi027 bash[22610]: audit 2024-08-31T03:45:44.210623+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:45:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:44 smithi191 bash[24992]: audit 2024-08-31T03:45:44.194670+0000 mon.a (mon.0) 1203 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:45:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:44 smithi191 bash[24992]: audit 2024-08-31T03:45:44.195997+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:45:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:44 smithi191 bash[24992]: audit 2024-08-31T03:45:44.205612+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:45:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:44 smithi191 bash[24992]: audit 2024-08-31T03:45:44.210623+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:45:45.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:45:45.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:45:45.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:45:46.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:45:46.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:45:46.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:45:46.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:45:46.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:45:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:45 smithi163 bash[24253]: audit 2024-08-31T03:45:44.212859+0000 mgr.a (mgr.14388) 4085 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:45:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:45 smithi163 bash[24253]: cluster 2024-08-31T03:45:44.561156+0000 mgr.a (mgr.14388) 4086 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:45 smithi163 bash[24253]: audit 2024-08-31T03:45:44.944298+0000 mgr.a (mgr.14388) 4087 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:45:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:45 smithi163 bash[24253]: cephadm 2024-08-31T03:45:44.945418+0000 mgr.a (mgr.14388) 4088 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:45:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:45 smithi027 bash[22610]: audit 2024-08-31T03:45:44.212859+0000 mgr.a (mgr.14388) 4085 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:45:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:45 smithi027 bash[22610]: cluster 2024-08-31T03:45:44.561156+0000 mgr.a (mgr.14388) 4086 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:45 smithi027 bash[22610]: audit 2024-08-31T03:45:44.944298+0000 mgr.a (mgr.14388) 4087 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:45:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:45 smithi027 bash[22610]: cephadm 2024-08-31T03:45:44.945418+0000 mgr.a (mgr.14388) 4088 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:45:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:45 smithi191 bash[24992]: audit 2024-08-31T03:45:44.212859+0000 mgr.a (mgr.14388) 4085 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:45:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:45 smithi191 bash[24992]: cluster 2024-08-31T03:45:44.561156+0000 mgr.a (mgr.14388) 4086 : cluster [DBG] pgmap v2832: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:45:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:45 smithi191 bash[24992]: audit 2024-08-31T03:45:44.944298+0000 mgr.a (mgr.14388) 4087 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:45:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:45 smithi191 bash[24992]: cephadm 2024-08-31T03:45:44.945418+0000 mgr.a (mgr.14388) 4088 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:45:47.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:46 smithi163 bash[24253]: audit 2024-08-31T03:45:45.679362+0000 mgr.a (mgr.14388) 4089 : audit [DBG] from='client.99027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:46 smithi027 bash[22610]: audit 2024-08-31T03:45:45.679362+0000 mgr.a (mgr.14388) 4089 : audit [DBG] from='client.99027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:46 smithi191 bash[24992]: audit 2024-08-31T03:45:45.679362+0000 mgr.a (mgr.14388) 4089 : audit [DBG] from='client.99027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:48.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:47 smithi163 bash[24253]: cluster 2024-08-31T03:45:46.562141+0000 mgr.a (mgr.14388) 4090 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:47 smithi027 bash[22610]: cluster 2024-08-31T03:45:46.562141+0000 mgr.a (mgr.14388) 4090 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:47 smithi191 bash[24992]: cluster 2024-08-31T03:45:46.562141+0000 mgr.a (mgr.14388) 4090 : cluster [DBG] pgmap v2833: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:45:50.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:49 smithi163 bash[24253]: cluster 2024-08-31T03:45:48.564394+0000 mgr.a (mgr.14388) 4091 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:49 smithi027 bash[22610]: cluster 2024-08-31T03:45:48.564394+0000 mgr.a (mgr.14388) 4091 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:49 smithi191 bash[24992]: cluster 2024-08-31T03:45:48.564394+0000 mgr.a (mgr.14388) 4091 : cluster [DBG] pgmap v2834: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:51.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:45:51.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:45:51.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:45:51.855 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:45:51.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:45:51.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:45:51.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:45:51.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:45:52.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:51 smithi163 bash[24253]: cluster 2024-08-31T03:45:50.565169+0000 mgr.a (mgr.14388) 4092 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:51 smithi027 bash[22610]: cluster 2024-08-31T03:45:50.565169+0000 mgr.a (mgr.14388) 4092 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:51 smithi191 bash[24992]: cluster 2024-08-31T03:45:50.565169+0000 mgr.a (mgr.14388) 4092 : cluster [DBG] pgmap v2835: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:53.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:52 smithi163 bash[24253]: audit 2024-08-31T03:45:51.439012+0000 mgr.a (mgr.14388) 4093 : audit [DBG] from='client.99105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:52 smithi027 bash[22610]: audit 2024-08-31T03:45:51.439012+0000 mgr.a (mgr.14388) 4093 : audit [DBG] from='client.99105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:52 smithi191 bash[24992]: audit 2024-08-31T03:45:51.439012+0000 mgr.a (mgr.14388) 4093 : audit [DBG] from='client.99105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:54.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:53 smithi163 bash[24253]: cluster 2024-08-31T03:45:52.566116+0000 mgr.a (mgr.14388) 4094 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:53 smithi027 bash[22610]: cluster 2024-08-31T03:45:52.566116+0000 mgr.a (mgr.14388) 4094 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:53 smithi191 bash[24992]: cluster 2024-08-31T03:45:52.566116+0000 mgr.a (mgr.14388) 4094 : cluster [DBG] pgmap v2836: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:56.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:55 smithi163 bash[24253]: cluster 2024-08-31T03:45:54.568366+0000 mgr.a (mgr.14388) 4095 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:55 smithi027 bash[22610]: cluster 2024-08-31T03:45:54.568366+0000 mgr.a (mgr.14388) 4095 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:55 smithi191 bash[24992]: cluster 2024-08-31T03:45:54.568366+0000 mgr.a (mgr.14388) 4095 : cluster [DBG] pgmap v2837: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:56.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:45:56.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:45:56.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:45:57.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:45:57.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:45:57.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:45:57.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:45:57.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:45:58.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:57 smithi163 bash[24253]: cluster 2024-08-31T03:45:56.569136+0000 mgr.a (mgr.14388) 4096 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:57 smithi027 bash[22610]: cluster 2024-08-31T03:45:56.569136+0000 mgr.a (mgr.14388) 4096 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:57 smithi191 bash[24992]: cluster 2024-08-31T03:45:56.569136+0000 mgr.a (mgr.14388) 4096 : cluster [DBG] pgmap v2838: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:45:59.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:58 smithi163 bash[24253]: audit 2024-08-31T03:45:57.189025+0000 mgr.a (mgr.14388) 4097 : audit [DBG] from='client.99180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:58 smithi027 bash[22610]: audit 2024-08-31T03:45:57.189025+0000 mgr.a (mgr.14388) 4097 : audit [DBG] from='client.99180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:45:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:58 smithi191 bash[24992]: audit 2024-08-31T03:45:57.189025+0000 mgr.a (mgr.14388) 4097 : audit [DBG] from='client.99180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:45:59 smithi163 bash[24253]: cluster 2024-08-31T03:45:58.571559+0000 mgr.a (mgr.14388) 4098 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:46:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:45:59 smithi027 bash[22610]: cluster 2024-08-31T03:45:58.571559+0000 mgr.a (mgr.14388) 4098 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:46:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:45:59 smithi191 bash[24992]: cluster 2024-08-31T03:45:58.571559+0000 mgr.a (mgr.14388) 4098 : cluster [DBG] pgmap v2839: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:46:02.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:01 smithi163 bash[24253]: cluster 2024-08-31T03:46:00.572350+0000 mgr.a (mgr.14388) 4099 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:01 smithi027 bash[22610]: cluster 2024-08-31T03:46:00.572350+0000 mgr.a (mgr.14388) 4099 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:01 smithi191 bash[24992]: cluster 2024-08-31T03:46:00.572350+0000 mgr.a (mgr.14388) 4099 : cluster [DBG] pgmap v2840: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:02.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:46:02.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:46:02.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:46:03.342 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:46:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:46:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:46:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:46:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:46:04.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:03 smithi163 bash[24253]: cluster 2024-08-31T03:46:02.573127+0000 mgr.a (mgr.14388) 4100 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:04.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:03 smithi163 bash[24253]: audit 2024-08-31T03:46:02.930323+0000 mgr.a (mgr.14388) 4101 : audit [DBG] from='client.99255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:03 smithi027 bash[22610]: cluster 2024-08-31T03:46:02.573127+0000 mgr.a (mgr.14388) 4100 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:03 smithi027 bash[22610]: audit 2024-08-31T03:46:02.930323+0000 mgr.a (mgr.14388) 4101 : audit [DBG] from='client.99255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:03 smithi191 bash[24992]: cluster 2024-08-31T03:46:02.573127+0000 mgr.a (mgr.14388) 4100 : cluster [DBG] pgmap v2841: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:03 smithi191 bash[24992]: audit 2024-08-31T03:46:02.930323+0000 mgr.a (mgr.14388) 4101 : audit [DBG] from='client.99255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:06.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:05 smithi163 bash[24253]: cluster 2024-08-31T03:46:04.575876+0000 mgr.a (mgr.14388) 4102 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:05 smithi027 bash[22610]: cluster 2024-08-31T03:46:04.575876+0000 mgr.a (mgr.14388) 4102 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:05 smithi191 bash[24992]: cluster 2024-08-31T03:46:04.575876+0000 mgr.a (mgr.14388) 4102 : cluster [DBG] pgmap v2842: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:08.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:07 smithi163 bash[24253]: cluster 2024-08-31T03:46:06.576663+0000 mgr.a (mgr.14388) 4103 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:46:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:07 smithi027 bash[22610]: cluster 2024-08-31T03:46:06.576663+0000 mgr.a (mgr.14388) 4103 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:46:08.293 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:07 smithi191 bash[24992]: cluster 2024-08-31T03:46:06.576663+0000 mgr.a (mgr.14388) 4103 : cluster [DBG] pgmap v2843: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:46:08.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:46:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:46:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:46:09.105 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:46:09.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:46:09.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:46:09.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:46:09.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:46:10.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:09 smithi163 bash[24253]: cluster 2024-08-31T03:46:08.578584+0000 mgr.a (mgr.14388) 4104 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:10.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:09 smithi163 bash[24253]: audit 2024-08-31T03:46:08.676764+0000 mgr.a (mgr.14388) 4105 : audit [DBG] from='client.99333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:09 smithi027 bash[22610]: cluster 2024-08-31T03:46:08.578584+0000 mgr.a (mgr.14388) 4104 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:09 smithi027 bash[22610]: audit 2024-08-31T03:46:08.676764+0000 mgr.a (mgr.14388) 4105 : audit [DBG] from='client.99333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:09 smithi191 bash[24992]: cluster 2024-08-31T03:46:08.578584+0000 mgr.a (mgr.14388) 4104 : cluster [DBG] pgmap v2844: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:09 smithi191 bash[24992]: audit 2024-08-31T03:46:08.676764+0000 mgr.a (mgr.14388) 4105 : audit [DBG] from='client.99333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:12.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:11 smithi163 bash[24253]: cluster 2024-08-31T03:46:10.579491+0000 mgr.a (mgr.14388) 4106 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:46:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:11 smithi027 bash[22610]: cluster 2024-08-31T03:46:10.579491+0000 mgr.a (mgr.14388) 4106 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:46:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:11 smithi191 bash[24992]: cluster 2024-08-31T03:46:10.579491+0000 mgr.a (mgr.14388) 4106 : cluster [DBG] pgmap v2845: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:46:14.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:46:14.108 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:46:14.108 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:46:14.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:13 smithi163 bash[24253]: cluster 2024-08-31T03:46:12.580265+0000 mgr.a (mgr.14388) 4107 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:46:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:13 smithi027 bash[22610]: cluster 2024-08-31T03:46:12.580265+0000 mgr.a (mgr.14388) 4107 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:46:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:13 smithi191 bash[24992]: cluster 2024-08-31T03:46:12.580265+0000 mgr.a (mgr.14388) 4107 : cluster [DBG] pgmap v2846: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:46:14.851 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:46:14.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:46:14.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:46:14.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:46:14.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:46:16.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:15 smithi163 bash[24253]: audit 2024-08-31T03:46:14.437574+0000 mgr.a (mgr.14388) 4108 : audit [DBG] from='client.99408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:16.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:15 smithi163 bash[24253]: cluster 2024-08-31T03:46:14.581566+0000 mgr.a (mgr.14388) 4109 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:15 smithi027 bash[22610]: audit 2024-08-31T03:46:14.437574+0000 mgr.a (mgr.14388) 4108 : audit [DBG] from='client.99408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:15 smithi027 bash[22610]: cluster 2024-08-31T03:46:14.581566+0000 mgr.a (mgr.14388) 4109 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:15 smithi191 bash[24992]: audit 2024-08-31T03:46:14.437574+0000 mgr.a (mgr.14388) 4108 : audit [DBG] from='client.99408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:15 smithi191 bash[24992]: cluster 2024-08-31T03:46:14.581566+0000 mgr.a (mgr.14388) 4109 : cluster [DBG] pgmap v2847: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:18.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:17 smithi163 bash[24253]: cluster 2024-08-31T03:46:16.582414+0000 mgr.a (mgr.14388) 4110 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:17 smithi027 bash[22610]: cluster 2024-08-31T03:46:16.582414+0000 mgr.a (mgr.14388) 4110 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:17 smithi191 bash[24992]: cluster 2024-08-31T03:46:16.582414+0000 mgr.a (mgr.14388) 4110 : cluster [DBG] pgmap v2848: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:46:19.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:46:19.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:46:20.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:19 smithi163 bash[24253]: cluster 2024-08-31T03:46:18.584692+0000 mgr.a (mgr.14388) 4111 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:19 smithi027 bash[22610]: cluster 2024-08-31T03:46:18.584692+0000 mgr.a (mgr.14388) 4111 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:19 smithi191 bash[24992]: cluster 2024-08-31T03:46:18.584692+0000 mgr.a (mgr.14388) 4111 : cluster [DBG] pgmap v2849: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:20.633 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:46:20.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:46:20.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:46:20.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:46:20.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:46:22.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:21 smithi163 bash[24253]: audit 2024-08-31T03:46:20.186764+0000 mgr.a (mgr.14388) 4112 : audit [DBG] from='client.99486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:22.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:21 smithi163 bash[24253]: cluster 2024-08-31T03:46:20.585248+0000 mgr.a (mgr.14388) 4113 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:21 smithi027 bash[22610]: audit 2024-08-31T03:46:20.186764+0000 mgr.a (mgr.14388) 4112 : audit [DBG] from='client.99486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:21 smithi027 bash[22610]: cluster 2024-08-31T03:46:20.585248+0000 mgr.a (mgr.14388) 4113 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:21 smithi191 bash[24992]: audit 2024-08-31T03:46:20.186764+0000 mgr.a (mgr.14388) 4112 : audit [DBG] from='client.99486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:21 smithi191 bash[24992]: cluster 2024-08-31T03:46:20.585248+0000 mgr.a (mgr.14388) 4113 : cluster [DBG] pgmap v2850: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:24.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:23 smithi163 bash[24253]: cluster 2024-08-31T03:46:22.586131+0000 mgr.a (mgr.14388) 4114 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:23 smithi027 bash[22610]: cluster 2024-08-31T03:46:22.586131+0000 mgr.a (mgr.14388) 4114 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:23 smithi191 bash[24992]: cluster 2024-08-31T03:46:22.586131+0000 mgr.a (mgr.14388) 4114 : cluster [DBG] pgmap v2851: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:25.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:46:25.635 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:46:25.635 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:46:26.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:25 smithi163 bash[24253]: cluster 2024-08-31T03:46:24.588498+0000 mgr.a (mgr.14388) 4115 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:25 smithi027 bash[22610]: cluster 2024-08-31T03:46:24.588498+0000 mgr.a (mgr.14388) 4115 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:25 smithi191 bash[24992]: cluster 2024-08-31T03:46:24.588498+0000 mgr.a (mgr.14388) 4115 : cluster [DBG] pgmap v2852: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:26.379 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:46:26.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:46:26.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:46:26.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:46:26.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:46:27.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:26 smithi163 bash[24253]: audit 2024-08-31T03:46:25.966546+0000 mgr.a (mgr.14388) 4116 : audit [DBG] from='client.99564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:26 smithi027 bash[22610]: audit 2024-08-31T03:46:25.966546+0000 mgr.a (mgr.14388) 4116 : audit [DBG] from='client.99564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:26 smithi191 bash[24992]: audit 2024-08-31T03:46:25.966546+0000 mgr.a (mgr.14388) 4116 : audit [DBG] from='client.99564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:28.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:27 smithi163 bash[24253]: cluster 2024-08-31T03:46:26.589468+0000 mgr.a (mgr.14388) 4117 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:27 smithi027 bash[22610]: cluster 2024-08-31T03:46:26.589468+0000 mgr.a (mgr.14388) 4117 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:27 smithi191 bash[24992]: cluster 2024-08-31T03:46:26.589468+0000 mgr.a (mgr.14388) 4117 : cluster [DBG] pgmap v2853: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:30.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:29 smithi163 bash[24253]: cluster 2024-08-31T03:46:28.591704+0000 mgr.a (mgr.14388) 4118 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:29 smithi027 bash[22610]: cluster 2024-08-31T03:46:28.591704+0000 mgr.a (mgr.14388) 4118 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:29 smithi191 bash[24992]: cluster 2024-08-31T03:46:28.591704+0000 mgr.a (mgr.14388) 4118 : cluster [DBG] pgmap v2854: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:31.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:46:31.381 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:46:31.381 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:46:32.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:46:32.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:46:32.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:46:32.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:46:32.121 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:46:32.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:31 smithi163 bash[24253]: cluster 2024-08-31T03:46:30.592478+0000 mgr.a (mgr.14388) 4119 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:31 smithi027 bash[22610]: cluster 2024-08-31T03:46:30.592478+0000 mgr.a (mgr.14388) 4119 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:31 smithi191 bash[24992]: cluster 2024-08-31T03:46:30.592478+0000 mgr.a (mgr.14388) 4119 : cluster [DBG] pgmap v2855: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:33.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:32 smithi163 bash[24253]: audit 2024-08-31T03:46:31.710703+0000 mgr.a (mgr.14388) 4120 : audit [DBG] from='client.99642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:32 smithi027 bash[22610]: audit 2024-08-31T03:46:31.710703+0000 mgr.a (mgr.14388) 4120 : audit [DBG] from='client.99642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:32 smithi191 bash[24992]: audit 2024-08-31T03:46:31.710703+0000 mgr.a (mgr.14388) 4120 : audit [DBG] from='client.99642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:34.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:33 smithi163 bash[24253]: cluster 2024-08-31T03:46:32.593419+0000 mgr.a (mgr.14388) 4121 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:33 smithi027 bash[22610]: cluster 2024-08-31T03:46:32.593419+0000 mgr.a (mgr.14388) 4121 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:33 smithi191 bash[24992]: cluster 2024-08-31T03:46:32.593419+0000 mgr.a (mgr.14388) 4121 : cluster [DBG] pgmap v2856: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:36.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:35 smithi163 bash[24253]: cluster 2024-08-31T03:46:34.595651+0000 mgr.a (mgr.14388) 4122 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:35 smithi027 bash[22610]: cluster 2024-08-31T03:46:34.595651+0000 mgr.a (mgr.14388) 4122 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:35 smithi191 bash[24992]: cluster 2024-08-31T03:46:34.595651+0000 mgr.a (mgr.14388) 4122 : cluster [DBG] pgmap v2857: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:46:37.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:46:37.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:46:37.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:46:37.872 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:46:37.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:46:37.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:46:37.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:46:37.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:46:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:37 smithi027 bash[22610]: cluster 2024-08-31T03:46:36.596572+0000 mgr.a (mgr.14388) 4123 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:37 smithi191 bash[24992]: cluster 2024-08-31T03:46:36.596572+0000 mgr.a (mgr.14388) 4123 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:38.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:37 smithi163 bash[24253]: cluster 2024-08-31T03:46:36.596572+0000 mgr.a (mgr.14388) 4123 : cluster [DBG] pgmap v2858: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:38 smithi027 bash[22610]: audit 2024-08-31T03:46:37.455905+0000 mgr.a (mgr.14388) 4124 : audit [DBG] from='client.99720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:38 smithi191 bash[24992]: audit 2024-08-31T03:46:37.455905+0000 mgr.a (mgr.14388) 4124 : audit [DBG] from='client.99720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:39.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:38 smithi163 bash[24253]: audit 2024-08-31T03:46:37.455905+0000 mgr.a (mgr.14388) 4124 : audit [DBG] from='client.99720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:40.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:39 smithi027 bash[22610]: cluster 2024-08-31T03:46:38.598975+0000 mgr.a (mgr.14388) 4125 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T03:46:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:39 smithi191 bash[24992]: cluster 2024-08-31T03:46:38.598975+0000 mgr.a (mgr.14388) 4125 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T03:46:40.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:39 smithi163 bash[24253]: cluster 2024-08-31T03:46:38.598975+0000 mgr.a (mgr.14388) 4125 : cluster [DBG] pgmap v2859: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T03:46:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:41 smithi027 bash[22610]: cluster 2024-08-31T03:46:40.599750+0000 mgr.a (mgr.14388) 4126 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:46:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:41 smithi191 bash[24992]: cluster 2024-08-31T03:46:40.599750+0000 mgr.a (mgr.14388) 4126 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:46:42.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:41 smithi163 bash[24253]: cluster 2024-08-31T03:46:40.599750+0000 mgr.a (mgr.14388) 4126 : cluster [DBG] pgmap v2860: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:46:42.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:46:42.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:46:42.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:46:43.617 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:46:43.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:46:43.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:46:43.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:46:43.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:46:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:43 smithi027 bash[22610]: cluster 2024-08-31T03:46:42.600524+0000 mgr.a (mgr.14388) 4127 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:46:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:43 smithi191 bash[24992]: cluster 2024-08-31T03:46:42.600524+0000 mgr.a (mgr.14388) 4127 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:46:44.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:43 smithi163 bash[24253]: cluster 2024-08-31T03:46:42.600524+0000 mgr.a (mgr.14388) 4127 : cluster [DBG] pgmap v2861: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:46:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:44 smithi027 bash[22610]: audit 2024-08-31T03:46:43.203994+0000 mgr.a (mgr.14388) 4128 : audit [DBG] from='client.99798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:44 smithi191 bash[24992]: audit 2024-08-31T03:46:43.203994+0000 mgr.a (mgr.14388) 4128 : audit [DBG] from='client.99798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:45.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:44 smithi163 bash[24253]: audit 2024-08-31T03:46:43.203994+0000 mgr.a (mgr.14388) 4128 : audit [DBG] from='client.99798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:45 smithi027 bash[22610]: cluster 2024-08-31T03:46:44.603194+0000 mgr.a (mgr.14388) 4129 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:45 smithi027 bash[22610]: audit 2024-08-31T03:46:44.996272+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:46:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:45 smithi191 bash[24992]: cluster 2024-08-31T03:46:44.603194+0000 mgr.a (mgr.14388) 4129 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:45 smithi191 bash[24992]: audit 2024-08-31T03:46:44.996272+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:46:46.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:45 smithi163 bash[24253]: cluster 2024-08-31T03:46:44.603194+0000 mgr.a (mgr.14388) 4129 : cluster [DBG] pgmap v2862: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:46.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:45 smithi163 bash[24253]: audit 2024-08-31T03:46:44.996272+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:46:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:47 smithi027 bash[22610]: cluster 2024-08-31T03:46:46.603988+0000 mgr.a (mgr.14388) 4130 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:46:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:47 smithi191 bash[24992]: cluster 2024-08-31T03:46:46.603988+0000 mgr.a (mgr.14388) 4130 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:46:48.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:47 smithi163 bash[24253]: cluster 2024-08-31T03:46:46.603988+0000 mgr.a (mgr.14388) 4130 : cluster [DBG] pgmap v2863: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:46:48.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:46:48.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:46:48.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:46:49.351 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:46:49.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:46:49.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:46:49.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:46:49.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:46:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:49 smithi191 bash[24992]: cluster 2024-08-31T03:46:48.606059+0000 mgr.a (mgr.14388) 4131 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:50.293 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:49 smithi191 bash[24992]: audit 2024-08-31T03:46:48.941597+0000 mgr.a (mgr.14388) 4132 : audit [DBG] from='client.99876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:50.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:49 smithi163 bash[24253]: cluster 2024-08-31T03:46:48.606059+0000 mgr.a (mgr.14388) 4131 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:50.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:49 smithi163 bash[24253]: audit 2024-08-31T03:46:48.941597+0000 mgr.a (mgr.14388) 4132 : audit [DBG] from='client.99876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:49 smithi027 bash[22610]: cluster 2024-08-31T03:46:48.606059+0000 mgr.a (mgr.14388) 4131 : cluster [DBG] pgmap v2864: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:46:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:49 smithi027 bash[22610]: audit 2024-08-31T03:46:48.941597+0000 mgr.a (mgr.14388) 4132 : audit [DBG] from='client.99876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:51.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: audit 2024-08-31T03:46:50.329769+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: audit 2024-08-31T03:46:50.335884+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: audit 2024-08-31T03:46:50.363857+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: audit 2024-08-31T03:46:50.370215+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: audit 2024-08-31T03:46:50.380530+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: audit 2024-08-31T03:46:50.384911+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: cluster 2024-08-31T03:46:50.606931+0000 mgr.a (mgr.14388) 4133 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T03:46:51.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: audit 2024-08-31T03:46:51.077252+0000 mon.a (mon.0) 1214 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:46:51.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: audit 2024-08-31T03:46:51.078934+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:46:51.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: audit 2024-08-31T03:46:51.088964+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:51 smithi163 bash[24253]: audit 2024-08-31T03:46:51.093783+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:46:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: audit 2024-08-31T03:46:50.329769+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: audit 2024-08-31T03:46:50.335884+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: audit 2024-08-31T03:46:50.363857+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: audit 2024-08-31T03:46:50.370215+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: audit 2024-08-31T03:46:50.380530+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: audit 2024-08-31T03:46:50.384911+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: cluster 2024-08-31T03:46:50.606931+0000 mgr.a (mgr.14388) 4133 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T03:46:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: audit 2024-08-31T03:46:51.077252+0000 mon.a (mon.0) 1214 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:46:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: audit 2024-08-31T03:46:51.078934+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:46:51.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: audit 2024-08-31T03:46:51.088964+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22610]: audit 2024-08-31T03:46:51.093783+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:46:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: audit 2024-08-31T03:46:50.329769+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: audit 2024-08-31T03:46:50.335884+0000 mon.a (mon.0) 1209 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: audit 2024-08-31T03:46:50.363857+0000 mon.a (mon.0) 1210 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: audit 2024-08-31T03:46:50.370215+0000 mon.a (mon.0) 1211 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: audit 2024-08-31T03:46:50.380530+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: audit 2024-08-31T03:46:50.384911+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: cluster 2024-08-31T03:46:50.606931+0000 mgr.a (mgr.14388) 4133 : cluster [DBG] pgmap v2865: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T03:46:51.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: audit 2024-08-31T03:46:51.077252+0000 mon.a (mon.0) 1214 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:46:51.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: audit 2024-08-31T03:46:51.078934+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:46:51.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: audit 2024-08-31T03:46:51.088964+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:46:51.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:51 smithi191 bash[24992]: audit 2024-08-31T03:46:51.093783+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:46:52.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22863]: debug 2024-08-31T03:46:51.823+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:46:52.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:46:51 smithi027 bash[22863]: debug 2024-08-31T03:46:51.823+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:46:52.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:52 smithi163 bash[24253]: audit 2024-08-31T03:46:51.096194+0000 mgr.a (mgr.14388) 4134 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:46:52.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:52 smithi163 bash[24253]: audit 2024-08-31T03:46:51.827015+0000 mgr.a (mgr.14388) 4135 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:46:52.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:52 smithi163 bash[24253]: cephadm 2024-08-31T03:46:51.828323+0000 mgr.a (mgr.14388) 4136 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:46:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:52 smithi027 bash[22610]: audit 2024-08-31T03:46:51.096194+0000 mgr.a (mgr.14388) 4134 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:46:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:52 smithi027 bash[22610]: audit 2024-08-31T03:46:51.827015+0000 mgr.a (mgr.14388) 4135 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:46:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:52 smithi027 bash[22610]: cephadm 2024-08-31T03:46:51.828323+0000 mgr.a (mgr.14388) 4136 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:46:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:52 smithi191 bash[24992]: audit 2024-08-31T03:46:51.096194+0000 mgr.a (mgr.14388) 4134 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:46:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:52 smithi191 bash[24992]: audit 2024-08-31T03:46:51.827015+0000 mgr.a (mgr.14388) 4135 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:46:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:52 smithi191 bash[24992]: cephadm 2024-08-31T03:46:51.828323+0000 mgr.a (mgr.14388) 4136 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:46:53.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:53 smithi163 bash[24253]: cluster 2024-08-31T03:46:52.607831+0000 mgr.a (mgr.14388) 4137 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T03:46:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:53 smithi027 bash[22610]: cluster 2024-08-31T03:46:52.607831+0000 mgr.a (mgr.14388) 4137 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T03:46:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:53 smithi191 bash[24992]: cluster 2024-08-31T03:46:52.607831+0000 mgr.a (mgr.14388) 4137 : cluster [DBG] pgmap v2866: 225 pgs: 225 active+clean; 589 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T03:46:54.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:46:54.353 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:46:54.353 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:46:55.108 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:46:55.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:46:55.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:46:55.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:46:55.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:46:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:55 smithi163 bash[24253]: cluster 2024-08-31T03:46:54.609154+0000 mgr.a (mgr.14388) 4138 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:46:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:55 smithi163 bash[24253]: audit 2024-08-31T03:46:54.690848+0000 mgr.a (mgr.14388) 4139 : audit [DBG] from='client.100059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:55 smithi027 bash[22610]: cluster 2024-08-31T03:46:54.609154+0000 mgr.a (mgr.14388) 4138 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:46:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:55 smithi027 bash[22610]: audit 2024-08-31T03:46:54.690848+0000 mgr.a (mgr.14388) 4139 : audit [DBG] from='client.100059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:55 smithi191 bash[24992]: cluster 2024-08-31T03:46:54.609154+0000 mgr.a (mgr.14388) 4138 : cluster [DBG] pgmap v2867: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:46:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:55 smithi191 bash[24992]: audit 2024-08-31T03:46:54.690848+0000 mgr.a (mgr.14388) 4139 : audit [DBG] from='client.100059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:46:57.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:57 smithi163 bash[24253]: cluster 2024-08-31T03:46:56.610034+0000 mgr.a (mgr.14388) 4140 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:46:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:57 smithi027 bash[22610]: cluster 2024-08-31T03:46:56.610034+0000 mgr.a (mgr.14388) 4140 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:46:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:57 smithi191 bash[24992]: cluster 2024-08-31T03:46:56.610034+0000 mgr.a (mgr.14388) 4140 : cluster [DBG] pgmap v2868: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:46:59.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:46:59 smithi163 bash[24253]: cluster 2024-08-31T03:46:58.612278+0000 mgr.a (mgr.14388) 4141 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:46:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:46:59 smithi027 bash[22610]: cluster 2024-08-31T03:46:58.612278+0000 mgr.a (mgr.14388) 4141 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:46:59 smithi191 bash[24992]: cluster 2024-08-31T03:46:58.612278+0000 mgr.a (mgr.14388) 4141 : cluster [DBG] pgmap v2869: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:00.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:00.880 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:00.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:00.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:00.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:00.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:47:01.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:01 smithi163 bash[24253]: audit 2024-08-31T03:47:00.438354+0000 mgr.a (mgr.14388) 4142 : audit [DBG] from='client.100134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:01.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:01 smithi163 bash[24253]: cluster 2024-08-31T03:47:00.612862+0000 mgr.a (mgr.14388) 4143 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:01 smithi027 bash[22610]: audit 2024-08-31T03:47:00.438354+0000 mgr.a (mgr.14388) 4142 : audit [DBG] from='client.100134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:01 smithi027 bash[22610]: cluster 2024-08-31T03:47:00.612862+0000 mgr.a (mgr.14388) 4143 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:01 smithi191 bash[24992]: audit 2024-08-31T03:47:00.438354+0000 mgr.a (mgr.14388) 4142 : audit [DBG] from='client.100134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:01 smithi191 bash[24992]: cluster 2024-08-31T03:47:00.612862+0000 mgr.a (mgr.14388) 4143 : cluster [DBG] pgmap v2870: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:03.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:03 smithi163 bash[24253]: cluster 2024-08-31T03:47:02.613737+0000 mgr.a (mgr.14388) 4144 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:03 smithi027 bash[22610]: cluster 2024-08-31T03:47:02.613737+0000 mgr.a (mgr.14388) 4144 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:03 smithi191 bash[24992]: cluster 2024-08-31T03:47:02.613737+0000 mgr.a (mgr.14388) 4144 : cluster [DBG] pgmap v2871: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:05.882 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:05.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:05.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:05 smithi163 bash[24253]: cluster 2024-08-31T03:47:04.615950+0000 mgr.a (mgr.14388) 4145 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:05 smithi027 bash[22610]: cluster 2024-08-31T03:47:04.615950+0000 mgr.a (mgr.14388) 4145 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:05 smithi191 bash[24992]: cluster 2024-08-31T03:47:04.615950+0000 mgr.a (mgr.14388) 4145 : cluster [DBG] pgmap v2872: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:47:06.648 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:06.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:06.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:06.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:06.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:47:07.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:07 smithi163 bash[24253]: audit 2024-08-31T03:47:06.216114+0000 mgr.a (mgr.14388) 4146 : audit [DBG] from='client.100209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:07.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:07 smithi163 bash[24253]: cluster 2024-08-31T03:47:06.616469+0000 mgr.a (mgr.14388) 4147 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:07 smithi027 bash[22610]: audit 2024-08-31T03:47:06.216114+0000 mgr.a (mgr.14388) 4146 : audit [DBG] from='client.100209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:07 smithi027 bash[22610]: cluster 2024-08-31T03:47:06.616469+0000 mgr.a (mgr.14388) 4147 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:07 smithi191 bash[24992]: audit 2024-08-31T03:47:06.216114+0000 mgr.a (mgr.14388) 4146 : audit [DBG] from='client.100209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:07 smithi191 bash[24992]: cluster 2024-08-31T03:47:06.616469+0000 mgr.a (mgr.14388) 4147 : cluster [DBG] pgmap v2873: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:09.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:09 smithi163 bash[24253]: cluster 2024-08-31T03:47:08.618596+0000 mgr.a (mgr.14388) 4148 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:09 smithi027 bash[22610]: cluster 2024-08-31T03:47:08.618596+0000 mgr.a (mgr.14388) 4148 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:09 smithi191 bash[24992]: cluster 2024-08-31T03:47:08.618596+0000 mgr.a (mgr.14388) 4148 : cluster [DBG] pgmap v2874: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:11.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:11.650 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:11.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:11 smithi027 bash[22610]: cluster 2024-08-31T03:47:10.619478+0000 mgr.a (mgr.14388) 4149 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:11 smithi191 bash[24992]: cluster 2024-08-31T03:47:10.619478+0000 mgr.a (mgr.14388) 4149 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:12.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:11 smithi163 bash[24253]: cluster 2024-08-31T03:47:10.619478+0000 mgr.a (mgr.14388) 4149 : cluster [DBG] pgmap v2875: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:12.401 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:12.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:47:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:12 smithi027 bash[22610]: audit 2024-08-31T03:47:11.983764+0000 mgr.a (mgr.14388) 4150 : audit [DBG] from='client.100287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:12 smithi191 bash[24992]: audit 2024-08-31T03:47:11.983764+0000 mgr.a (mgr.14388) 4150 : audit [DBG] from='client.100287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:13.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:12 smithi163 bash[24253]: audit 2024-08-31T03:47:11.983764+0000 mgr.a (mgr.14388) 4150 : audit [DBG] from='client.100287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:13 smithi027 bash[22610]: cluster 2024-08-31T03:47:12.620567+0000 mgr.a (mgr.14388) 4151 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:13 smithi191 bash[24992]: cluster 2024-08-31T03:47:12.620567+0000 mgr.a (mgr.14388) 4151 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:14.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:13 smithi163 bash[24253]: cluster 2024-08-31T03:47:12.620567+0000 mgr.a (mgr.14388) 4151 : cluster [DBG] pgmap v2876: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:15 smithi027 bash[22610]: cluster 2024-08-31T03:47:14.622855+0000 mgr.a (mgr.14388) 4152 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:15 smithi191 bash[24992]: cluster 2024-08-31T03:47:14.622855+0000 mgr.a (mgr.14388) 4152 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:16.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:15 smithi163 bash[24253]: cluster 2024-08-31T03:47:14.622855+0000 mgr.a (mgr.14388) 4152 : cluster [DBG] pgmap v2877: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:17.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:17.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:17.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:17 smithi027 bash[22610]: cluster 2024-08-31T03:47:16.623600+0000 mgr.a (mgr.14388) 4153 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:17 smithi191 bash[24992]: cluster 2024-08-31T03:47:16.623600+0000 mgr.a (mgr.14388) 4153 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:18.169 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:18.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:18.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:18.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:18.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:47:18.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:17 smithi163 bash[24253]: cluster 2024-08-31T03:47:16.623600+0000 mgr.a (mgr.14388) 4153 : cluster [DBG] pgmap v2878: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:18 smithi027 bash[22610]: audit 2024-08-31T03:47:17.740712+0000 mgr.a (mgr.14388) 4154 : audit [DBG] from='client.100362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:18 smithi191 bash[24992]: audit 2024-08-31T03:47:17.740712+0000 mgr.a (mgr.14388) 4154 : audit [DBG] from='client.100362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:19.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:18 smithi163 bash[24253]: audit 2024-08-31T03:47:17.740712+0000 mgr.a (mgr.14388) 4154 : audit [DBG] from='client.100362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:19 smithi027 bash[22610]: cluster 2024-08-31T03:47:18.626306+0000 mgr.a (mgr.14388) 4155 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:19 smithi191 bash[24992]: cluster 2024-08-31T03:47:18.626306+0000 mgr.a (mgr.14388) 4155 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:20.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:19 smithi163 bash[24253]: cluster 2024-08-31T03:47:18.626306+0000 mgr.a (mgr.14388) 4155 : cluster [DBG] pgmap v2879: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:21 smithi027 bash[22610]: cluster 2024-08-31T03:47:20.627115+0000 mgr.a (mgr.14388) 4156 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:47:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:21 smithi191 bash[24992]: cluster 2024-08-31T03:47:20.627115+0000 mgr.a (mgr.14388) 4156 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:47:22.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:21 smithi163 bash[24253]: cluster 2024-08-31T03:47:20.627115+0000 mgr.a (mgr.14388) 4156 : cluster [DBG] pgmap v2880: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:47:23.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:23.171 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:23.171 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:23.914 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:23.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:23.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:23.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:23.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:47:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:23 smithi191 bash[24992]: cluster 2024-08-31T03:47:22.627863+0000 mgr.a (mgr.14388) 4157 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:47:24.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:23 smithi163 bash[24253]: cluster 2024-08-31T03:47:22.627863+0000 mgr.a (mgr.14388) 4157 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:47:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:23 smithi027 bash[22610]: cluster 2024-08-31T03:47:22.627863+0000 mgr.a (mgr.14388) 4157 : cluster [DBG] pgmap v2881: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:47:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:24 smithi191 bash[24992]: audit 2024-08-31T03:47:23.494517+0000 mgr.a (mgr.14388) 4158 : audit [DBG] from='client.100434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:25.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:24 smithi163 bash[24253]: audit 2024-08-31T03:47:23.494517+0000 mgr.a (mgr.14388) 4158 : audit [DBG] from='client.100434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:24 smithi027 bash[22610]: audit 2024-08-31T03:47:23.494517+0000 mgr.a (mgr.14388) 4158 : audit [DBG] from='client.100434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:25 smithi191 bash[24992]: cluster 2024-08-31T03:47:24.630522+0000 mgr.a (mgr.14388) 4159 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:26.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:25 smithi163 bash[24253]: cluster 2024-08-31T03:47:24.630522+0000 mgr.a (mgr.14388) 4159 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:25 smithi027 bash[22610]: cluster 2024-08-31T03:47:24.630522+0000 mgr.a (mgr.14388) 4159 : cluster [DBG] pgmap v2882: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:27 smithi191 bash[24992]: cluster 2024-08-31T03:47:26.631295+0000 mgr.a (mgr.14388) 4160 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:47:28.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:27 smithi163 bash[24253]: cluster 2024-08-31T03:47:26.631295+0000 mgr.a (mgr.14388) 4160 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:47:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:27 smithi027 bash[22610]: cluster 2024-08-31T03:47:26.631295+0000 mgr.a (mgr.14388) 4160 : cluster [DBG] pgmap v2883: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:47:28.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:28.917 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:28.917 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:29.679 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:29.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:29.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:29.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:29.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:47:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:29 smithi191 bash[24992]: cluster 2024-08-31T03:47:28.633248+0000 mgr.a (mgr.14388) 4161 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:30.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:29 smithi163 bash[24253]: cluster 2024-08-31T03:47:28.633248+0000 mgr.a (mgr.14388) 4161 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:29 smithi027 bash[22610]: cluster 2024-08-31T03:47:28.633248+0000 mgr.a (mgr.14388) 4161 : cluster [DBG] pgmap v2884: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:30 smithi191 bash[24992]: audit 2024-08-31T03:47:29.250269+0000 mgr.a (mgr.14388) 4162 : audit [DBG] from='client.100512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:31.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:30 smithi163 bash[24253]: audit 2024-08-31T03:47:29.250269+0000 mgr.a (mgr.14388) 4162 : audit [DBG] from='client.100512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:30 smithi027 bash[22610]: audit 2024-08-31T03:47:29.250269+0000 mgr.a (mgr.14388) 4162 : audit [DBG] from='client.100512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:31 smithi191 bash[24992]: cluster 2024-08-31T03:47:30.634104+0000 mgr.a (mgr.14388) 4163 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:32.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:31 smithi163 bash[24253]: cluster 2024-08-31T03:47:30.634104+0000 mgr.a (mgr.14388) 4163 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:31 smithi027 bash[22610]: cluster 2024-08-31T03:47:30.634104+0000 mgr.a (mgr.14388) 4163 : cluster [DBG] pgmap v2885: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:33 smithi191 bash[24992]: cluster 2024-08-31T03:47:32.634927+0000 mgr.a (mgr.14388) 4164 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:34.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:33 smithi163 bash[24253]: cluster 2024-08-31T03:47:32.634927+0000 mgr.a (mgr.14388) 4164 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:33 smithi027 bash[22610]: cluster 2024-08-31T03:47:32.634927+0000 mgr.a (mgr.14388) 4164 : cluster [DBG] pgmap v2886: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:34.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:34.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:34.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:35.445 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:35.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:35.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:35.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:35.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:47:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:35 smithi191 bash[24992]: cluster 2024-08-31T03:47:34.637088+0000 mgr.a (mgr.14388) 4165 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:36.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:35 smithi163 bash[24253]: cluster 2024-08-31T03:47:34.637088+0000 mgr.a (mgr.14388) 4165 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:35 smithi027 bash[22610]: cluster 2024-08-31T03:47:34.637088+0000 mgr.a (mgr.14388) 4165 : cluster [DBG] pgmap v2887: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:36 smithi191 bash[24992]: audit 2024-08-31T03:47:35.015854+0000 mgr.a (mgr.14388) 4166 : audit [DBG] from='client.100587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:37.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:36 smithi163 bash[24253]: audit 2024-08-31T03:47:35.015854+0000 mgr.a (mgr.14388) 4166 : audit [DBG] from='client.100587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:36 smithi027 bash[22610]: audit 2024-08-31T03:47:35.015854+0000 mgr.a (mgr.14388) 4166 : audit [DBG] from='client.100587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:37 smithi191 bash[24992]: cluster 2024-08-31T03:47:36.637941+0000 mgr.a (mgr.14388) 4167 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:38.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:37 smithi163 bash[24253]: cluster 2024-08-31T03:47:36.637941+0000 mgr.a (mgr.14388) 4167 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:37 smithi027 bash[22610]: cluster 2024-08-31T03:47:36.637941+0000 mgr.a (mgr.14388) 4167 : cluster [DBG] pgmap v2888: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:39 smithi163 bash[24253]: cluster 2024-08-31T03:47:38.640153+0000 mgr.a (mgr.14388) 4168 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:39 smithi027 bash[22610]: cluster 2024-08-31T03:47:38.640153+0000 mgr.a (mgr.14388) 4168 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:39 smithi191 bash[24992]: cluster 2024-08-31T03:47:38.640153+0000 mgr.a (mgr.14388) 4168 : cluster [DBG] pgmap v2889: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:40.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:40.447 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:40.447 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:41.221 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:41.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:41.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:41.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:41.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:47:42.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:41 smithi163 bash[24253]: cluster 2024-08-31T03:47:40.640686+0000 mgr.a (mgr.14388) 4169 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:42.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:41 smithi163 bash[24253]: audit 2024-08-31T03:47:40.787018+0000 mgr.a (mgr.14388) 4170 : audit [DBG] from='client.100665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:41 smithi027 bash[22610]: cluster 2024-08-31T03:47:40.640686+0000 mgr.a (mgr.14388) 4169 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:41 smithi027 bash[22610]: audit 2024-08-31T03:47:40.787018+0000 mgr.a (mgr.14388) 4170 : audit [DBG] from='client.100665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:41 smithi191 bash[24992]: cluster 2024-08-31T03:47:40.640686+0000 mgr.a (mgr.14388) 4169 : cluster [DBG] pgmap v2890: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:41 smithi191 bash[24992]: audit 2024-08-31T03:47:40.787018+0000 mgr.a (mgr.14388) 4170 : audit [DBG] from='client.100665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:44.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:43 smithi163 bash[24253]: cluster 2024-08-31T03:47:42.641531+0000 mgr.a (mgr.14388) 4171 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:43 smithi027 bash[22610]: cluster 2024-08-31T03:47:42.641531+0000 mgr.a (mgr.14388) 4171 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:43 smithi191 bash[24992]: cluster 2024-08-31T03:47:42.641531+0000 mgr.a (mgr.14388) 4171 : cluster [DBG] pgmap v2891: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:45 smithi163 bash[24253]: cluster 2024-08-31T03:47:44.643716+0000 mgr.a (mgr.14388) 4172 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:46.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:46.223 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:46.223 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:45 smithi027 bash[22610]: cluster 2024-08-31T03:47:44.643716+0000 mgr.a (mgr.14388) 4172 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:45 smithi191 bash[24992]: cluster 2024-08-31T03:47:44.643716+0000 mgr.a (mgr.14388) 4172 : cluster [DBG] pgmap v2892: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:46.963 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:46.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:47:48.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:47 smithi163 bash[24253]: audit 2024-08-31T03:47:46.556400+0000 mgr.a (mgr.14388) 4173 : audit [DBG] from='client.100743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:48.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:47 smithi163 bash[24253]: cluster 2024-08-31T03:47:46.644219+0000 mgr.a (mgr.14388) 4174 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:47 smithi027 bash[22610]: audit 2024-08-31T03:47:46.556400+0000 mgr.a (mgr.14388) 4173 : audit [DBG] from='client.100743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:47 smithi027 bash[22610]: cluster 2024-08-31T03:47:46.644219+0000 mgr.a (mgr.14388) 4174 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:47 smithi191 bash[24992]: audit 2024-08-31T03:47:46.556400+0000 mgr.a (mgr.14388) 4173 : audit [DBG] from='client.100743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:47 smithi191 bash[24992]: cluster 2024-08-31T03:47:46.644219+0000 mgr.a (mgr.14388) 4174 : cluster [DBG] pgmap v2893: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:50.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:49 smithi163 bash[24253]: cluster 2024-08-31T03:47:48.646457+0000 mgr.a (mgr.14388) 4175 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:49 smithi027 bash[22610]: cluster 2024-08-31T03:47:48.646457+0000 mgr.a (mgr.14388) 4175 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:49 smithi191 bash[24992]: cluster 2024-08-31T03:47:48.646457+0000 mgr.a (mgr.14388) 4175 : cluster [DBG] pgmap v2894: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:47:51.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:51.965 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:51.965 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:52.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:51 smithi163 bash[24253]: cluster 2024-08-31T03:47:50.647262+0000 mgr.a (mgr.14388) 4176 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:51 smithi027 bash[22610]: cluster 2024-08-31T03:47:50.647262+0000 mgr.a (mgr.14388) 4176 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:51 smithi191 bash[24992]: cluster 2024-08-31T03:47:50.647262+0000 mgr.a (mgr.14388) 4176 : cluster [DBG] pgmap v2895: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:52.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:52.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:52.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:52.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:47:52.847 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:53.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:52 smithi163 bash[24253]: audit 2024-08-31T03:47:51.881439+0000 mon.a (mon.0) 1218 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:47:53.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:52 smithi163 bash[24253]: audit 2024-08-31T03:47:52.748889+0000 mon.a (mon.0) 1219 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:47:53.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:52 smithi163 bash[24253]: audit 2024-08-31T03:47:52.749912+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:47:53.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:52 smithi163 bash[24253]: audit 2024-08-31T03:47:52.755264+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:47:53.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:52 smithi163 bash[24253]: audit 2024-08-31T03:47:52.757412+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:47:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:52 smithi027 bash[22610]: audit 2024-08-31T03:47:51.881439+0000 mon.a (mon.0) 1218 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:47:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:52 smithi027 bash[22610]: audit 2024-08-31T03:47:52.748889+0000 mon.a (mon.0) 1219 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:47:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:52 smithi027 bash[22610]: audit 2024-08-31T03:47:52.749912+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:47:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:52 smithi027 bash[22610]: audit 2024-08-31T03:47:52.755264+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:47:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:52 smithi027 bash[22610]: audit 2024-08-31T03:47:52.757412+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:47:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:52 smithi191 bash[24992]: audit 2024-08-31T03:47:51.881439+0000 mon.a (mon.0) 1218 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:47:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:52 smithi191 bash[24992]: audit 2024-08-31T03:47:52.748889+0000 mon.a (mon.0) 1219 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:47:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:52 smithi191 bash[24992]: audit 2024-08-31T03:47:52.749912+0000 mon.a (mon.0) 1220 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:47:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:52 smithi191 bash[24992]: audit 2024-08-31T03:47:52.755264+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:47:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:52 smithi191 bash[24992]: audit 2024-08-31T03:47:52.757412+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:47:53.824 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:47:53 smithi027 bash[22863]: debug 2024-08-31T03:47:53.513+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:47:53.825 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:47:53 smithi027 bash[22863]: debug 2024-08-31T03:47:53.513+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:47:54.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:53 smithi163 bash[24253]: audit 2024-08-31T03:47:52.378154+0000 mgr.a (mgr.14388) 4177 : audit [DBG] from='client.100818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:54.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:53 smithi163 bash[24253]: cluster 2024-08-31T03:47:52.647898+0000 mgr.a (mgr.14388) 4178 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:54.195 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:53 smithi163 bash[24253]: audit 2024-08-31T03:47:52.758556+0000 mgr.a (mgr.14388) 4179 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:47:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:53 smithi027 bash[22610]: audit 2024-08-31T03:47:52.378154+0000 mgr.a (mgr.14388) 4177 : audit [DBG] from='client.100818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:53 smithi027 bash[22610]: cluster 2024-08-31T03:47:52.647898+0000 mgr.a (mgr.14388) 4178 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:53 smithi027 bash[22610]: audit 2024-08-31T03:47:52.758556+0000 mgr.a (mgr.14388) 4179 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:47:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:53 smithi191 bash[24992]: audit 2024-08-31T03:47:52.378154+0000 mgr.a (mgr.14388) 4177 : audit [DBG] from='client.100818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:47:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:53 smithi191 bash[24992]: cluster 2024-08-31T03:47:52.647898+0000 mgr.a (mgr.14388) 4178 : cluster [DBG] pgmap v2896: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:47:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:53 smithi191 bash[24992]: audit 2024-08-31T03:47:52.758556+0000 mgr.a (mgr.14388) 4179 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:47:55.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:54 smithi163 bash[24253]: audit 2024-08-31T03:47:53.515938+0000 mgr.a (mgr.14388) 4180 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:47:55.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:54 smithi163 bash[24253]: cephadm 2024-08-31T03:47:53.517072+0000 mgr.a (mgr.14388) 4181 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:47:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:54 smithi027 bash[22610]: audit 2024-08-31T03:47:53.515938+0000 mgr.a (mgr.14388) 4180 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:47:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:54 smithi027 bash[22610]: cephadm 2024-08-31T03:47:53.517072+0000 mgr.a (mgr.14388) 4181 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:47:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:54 smithi191 bash[24992]: audit 2024-08-31T03:47:53.515938+0000 mgr.a (mgr.14388) 4180 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:47:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:54 smithi191 bash[24992]: cephadm 2024-08-31T03:47:53.517072+0000 mgr.a (mgr.14388) 4181 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:47:56.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:55 smithi163 bash[24253]: cluster 2024-08-31T03:47:54.650489+0000 mgr.a (mgr.14388) 4182 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T03:47:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:55 smithi027 bash[22610]: cluster 2024-08-31T03:47:54.650489+0000 mgr.a (mgr.14388) 4182 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T03:47:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:55 smithi191 bash[24992]: cluster 2024-08-31T03:47:54.650489+0000 mgr.a (mgr.14388) 4182 : cluster [DBG] pgmap v2897: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T03:47:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:47:57.848 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:47:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:47:58.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:57 smithi163 bash[24253]: cluster 2024-08-31T03:47:56.651293+0000 mgr.a (mgr.14388) 4183 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:47:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:57 smithi027 bash[22610]: cluster 2024-08-31T03:47:56.651293+0000 mgr.a (mgr.14388) 4183 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:47:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:57 smithi191 bash[24992]: cluster 2024-08-31T03:47:56.651293+0000 mgr.a (mgr.14388) 4183 : cluster [DBG] pgmap v2898: 225 pgs: 225 active+clean; 589 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:47:58.586 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:47:58.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:47:58.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:47:58.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:47:58.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:59 smithi163 bash[24253]: audit 2024-08-31T03:47:58.177540+0000 mgr.a (mgr.14388) 4184 : audit [DBG] from='client.101001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:47:59 smithi163 bash[24253]: cluster 2024-08-31T03:47:58.652510+0000 mgr.a (mgr.14388) 4185 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:48:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:59 smithi027 bash[22610]: audit 2024-08-31T03:47:58.177540+0000 mgr.a (mgr.14388) 4184 : audit [DBG] from='client.101001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:47:59 smithi027 bash[22610]: cluster 2024-08-31T03:47:58.652510+0000 mgr.a (mgr.14388) 4185 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:48:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:59 smithi191 bash[24992]: audit 2024-08-31T03:47:58.177540+0000 mgr.a (mgr.14388) 4184 : audit [DBG] from='client.101001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:47:59 smithi191 bash[24992]: cluster 2024-08-31T03:47:58.652510+0000 mgr.a (mgr.14388) 4185 : cluster [DBG] pgmap v2899: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:48:02.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:01 smithi163 bash[24253]: cluster 2024-08-31T03:48:00.653235+0000 mgr.a (mgr.14388) 4186 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:48:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:01 smithi027 bash[22610]: cluster 2024-08-31T03:48:00.653235+0000 mgr.a (mgr.14388) 4186 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:48:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:01 smithi191 bash[24992]: cluster 2024-08-31T03:48:00.653235+0000 mgr.a (mgr.14388) 4186 : cluster [DBG] pgmap v2900: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:48:03.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:48:03.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:48:03.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:48:04.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:03 smithi163 bash[24253]: cluster 2024-08-31T03:48:02.653999+0000 mgr.a (mgr.14388) 4187 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:48:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:03 smithi027 bash[22610]: cluster 2024-08-31T03:48:02.653999+0000 mgr.a (mgr.14388) 4187 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:48:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:03 smithi191 bash[24992]: cluster 2024-08-31T03:48:02.653999+0000 mgr.a (mgr.14388) 4187 : cluster [DBG] pgmap v2901: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:48:04.323 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:48:04.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:48:04.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:48:04.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:48:04.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:05.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:04 smithi163 bash[24253]: audit 2024-08-31T03:48:03.920480+0000 mgr.a (mgr.14388) 4188 : audit [DBG] from='client.101073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:04 smithi027 bash[22610]: audit 2024-08-31T03:48:03.920480+0000 mgr.a (mgr.14388) 4188 : audit [DBG] from='client.101073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:04 smithi191 bash[24992]: audit 2024-08-31T03:48:03.920480+0000 mgr.a (mgr.14388) 4188 : audit [DBG] from='client.101073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:06.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:05 smithi163 bash[24253]: cluster 2024-08-31T03:48:04.656579+0000 mgr.a (mgr.14388) 4189 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:48:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:05 smithi027 bash[22610]: cluster 2024-08-31T03:48:04.656579+0000 mgr.a (mgr.14388) 4189 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:48:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:05 smithi191 bash[24992]: cluster 2024-08-31T03:48:04.656579+0000 mgr.a (mgr.14388) 4189 : cluster [DBG] pgmap v2902: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:48:07.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:07 smithi163 bash[24253]: cluster 2024-08-31T03:48:06.657342+0000 mgr.a (mgr.14388) 4190 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:48:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:07 smithi027 bash[22610]: cluster 2024-08-31T03:48:06.657342+0000 mgr.a (mgr.14388) 4190 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:48:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:07 smithi191 bash[24992]: cluster 2024-08-31T03:48:06.657342+0000 mgr.a (mgr.14388) 4190 : cluster [DBG] pgmap v2903: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T03:48:09.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:48:09.325 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:48:09.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:48:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:09 smithi027 bash[22610]: cluster 2024-08-31T03:48:08.659454+0000 mgr.a (mgr.14388) 4191 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:48:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:09 smithi191 bash[24992]: cluster 2024-08-31T03:48:08.659454+0000 mgr.a (mgr.14388) 4191 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:48:10.102 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:48:10.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:48:10.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:48:10.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:48:10.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:10.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:09 smithi163 bash[24253]: cluster 2024-08-31T03:48:08.659454+0000 mgr.a (mgr.14388) 4191 : cluster [DBG] pgmap v2904: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:48:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:10 smithi027 bash[22610]: audit 2024-08-31T03:48:09.658183+0000 mgr.a (mgr.14388) 4192 : audit [DBG] from='client.101151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:10 smithi191 bash[24992]: audit 2024-08-31T03:48:09.658183+0000 mgr.a (mgr.14388) 4192 : audit [DBG] from='client.101151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:11.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:10 smithi163 bash[24253]: audit 2024-08-31T03:48:09.658183+0000 mgr.a (mgr.14388) 4192 : audit [DBG] from='client.101151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:11 smithi027 bash[22610]: cluster 2024-08-31T03:48:10.660510+0000 mgr.a (mgr.14388) 4193 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:11 smithi191 bash[24992]: cluster 2024-08-31T03:48:10.660510+0000 mgr.a (mgr.14388) 4193 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:12.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:11 smithi163 bash[24253]: cluster 2024-08-31T03:48:10.660510+0000 mgr.a (mgr.14388) 4193 : cluster [DBG] pgmap v2905: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:13 smithi027 bash[22610]: cluster 2024-08-31T03:48:12.661440+0000 mgr.a (mgr.14388) 4194 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:13 smithi191 bash[24992]: cluster 2024-08-31T03:48:12.661440+0000 mgr.a (mgr.14388) 4194 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:14.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:13 smithi163 bash[24253]: cluster 2024-08-31T03:48:12.661440+0000 mgr.a (mgr.14388) 4194 : cluster [DBG] pgmap v2906: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:15.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:48:15.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:48:15.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:48:15.869 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:48:15.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:48:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:48:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:48:15.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:15 smithi191 bash[24992]: cluster 2024-08-31T03:48:14.663633+0000 mgr.a (mgr.14388) 4195 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:16.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:15 smithi163 bash[24253]: cluster 2024-08-31T03:48:14.663633+0000 mgr.a (mgr.14388) 4195 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:15 smithi027 bash[22610]: cluster 2024-08-31T03:48:14.663633+0000 mgr.a (mgr.14388) 4195 : cluster [DBG] pgmap v2907: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:16 smithi191 bash[24992]: audit 2024-08-31T03:48:15.434800+0000 mgr.a (mgr.14388) 4196 : audit [DBG] from='client.101226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:17.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:16 smithi163 bash[24253]: audit 2024-08-31T03:48:15.434800+0000 mgr.a (mgr.14388) 4196 : audit [DBG] from='client.101226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:16 smithi027 bash[22610]: audit 2024-08-31T03:48:15.434800+0000 mgr.a (mgr.14388) 4196 : audit [DBG] from='client.101226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:17 smithi191 bash[24992]: cluster 2024-08-31T03:48:16.664454+0000 mgr.a (mgr.14388) 4197 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:18.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:17 smithi163 bash[24253]: cluster 2024-08-31T03:48:16.664454+0000 mgr.a (mgr.14388) 4197 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:17 smithi027 bash[22610]: cluster 2024-08-31T03:48:16.664454+0000 mgr.a (mgr.14388) 4197 : cluster [DBG] pgmap v2908: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:19 smithi191 bash[24992]: cluster 2024-08-31T03:48:18.666596+0000 mgr.a (mgr.14388) 4198 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:20.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:19 smithi163 bash[24253]: cluster 2024-08-31T03:48:18.666596+0000 mgr.a (mgr.14388) 4198 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:19 smithi027 bash[22610]: cluster 2024-08-31T03:48:18.666596+0000 mgr.a (mgr.14388) 4198 : cluster [DBG] pgmap v2909: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:20.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:48:20.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:48:20.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:48:21.647 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:48:21.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:48:21.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:48:21.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:48:21.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:21 smithi191 bash[24992]: cluster 2024-08-31T03:48:20.667348+0000 mgr.a (mgr.14388) 4199 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:22.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:21 smithi163 bash[24253]: cluster 2024-08-31T03:48:20.667348+0000 mgr.a (mgr.14388) 4199 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:21 smithi027 bash[22610]: cluster 2024-08-31T03:48:20.667348+0000 mgr.a (mgr.14388) 4199 : cluster [DBG] pgmap v2910: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:22 smithi191 bash[24992]: audit 2024-08-31T03:48:21.211580+0000 mgr.a (mgr.14388) 4200 : audit [DBG] from='client.101301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:23.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:22 smithi163 bash[24253]: audit 2024-08-31T03:48:21.211580+0000 mgr.a (mgr.14388) 4200 : audit [DBG] from='client.101301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:22 smithi027 bash[22610]: audit 2024-08-31T03:48:21.211580+0000 mgr.a (mgr.14388) 4200 : audit [DBG] from='client.101301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:23 smithi191 bash[24992]: cluster 2024-08-31T03:48:22.668359+0000 mgr.a (mgr.14388) 4201 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:24.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:23 smithi163 bash[24253]: cluster 2024-08-31T03:48:22.668359+0000 mgr.a (mgr.14388) 4201 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:23 smithi027 bash[22610]: cluster 2024-08-31T03:48:22.668359+0000 mgr.a (mgr.14388) 4201 : cluster [DBG] pgmap v2911: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:25 smithi191 bash[24992]: cluster 2024-08-31T03:48:24.670684+0000 mgr.a (mgr.14388) 4202 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:26.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:25 smithi163 bash[24253]: cluster 2024-08-31T03:48:24.670684+0000 mgr.a (mgr.14388) 4202 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:25 smithi027 bash[22610]: cluster 2024-08-31T03:48:24.670684+0000 mgr.a (mgr.14388) 4202 : cluster [DBG] pgmap v2912: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:26.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:48:26.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:48:26.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:48:27.421 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:48:27.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:48:27.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:48:27.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:48:27.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:27 smithi191 bash[24992]: cluster 2024-08-31T03:48:26.671398+0000 mgr.a (mgr.14388) 4203 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:27 smithi191 bash[24992]: audit 2024-08-31T03:48:26.988694+0000 mgr.a (mgr.14388) 4204 : audit [DBG] from='client.101379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:28.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:27 smithi163 bash[24253]: cluster 2024-08-31T03:48:26.671398+0000 mgr.a (mgr.14388) 4203 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:28.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:27 smithi163 bash[24253]: audit 2024-08-31T03:48:26.988694+0000 mgr.a (mgr.14388) 4204 : audit [DBG] from='client.101379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:27 smithi027 bash[22610]: cluster 2024-08-31T03:48:26.671398+0000 mgr.a (mgr.14388) 4203 : cluster [DBG] pgmap v2913: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:27 smithi027 bash[22610]: audit 2024-08-31T03:48:26.988694+0000 mgr.a (mgr.14388) 4204 : audit [DBG] from='client.101379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:29 smithi191 bash[24992]: cluster 2024-08-31T03:48:28.673611+0000 mgr.a (mgr.14388) 4205 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:30.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:29 smithi163 bash[24253]: cluster 2024-08-31T03:48:28.673611+0000 mgr.a (mgr.14388) 4205 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:29 smithi027 bash[22610]: cluster 2024-08-31T03:48:28.673611+0000 mgr.a (mgr.14388) 4205 : cluster [DBG] pgmap v2914: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:31 smithi191 bash[24992]: cluster 2024-08-31T03:48:30.674359+0000 mgr.a (mgr.14388) 4206 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:32.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:31 smithi163 bash[24253]: cluster 2024-08-31T03:48:30.674359+0000 mgr.a (mgr.14388) 4206 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:31 smithi027 bash[22610]: cluster 2024-08-31T03:48:30.674359+0000 mgr.a (mgr.14388) 4206 : cluster [DBG] pgmap v2915: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:32.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:48:32.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:48:32.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:48:33.183 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:48:33.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:48:33.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:48:33.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:48:33.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:33 smithi191 bash[24992]: cluster 2024-08-31T03:48:32.675085+0000 mgr.a (mgr.14388) 4207 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:33 smithi191 bash[24992]: audit 2024-08-31T03:48:32.757842+0000 mgr.a (mgr.14388) 4208 : audit [DBG] from='client.101457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:34.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:33 smithi163 bash[24253]: cluster 2024-08-31T03:48:32.675085+0000 mgr.a (mgr.14388) 4207 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:34.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:33 smithi163 bash[24253]: audit 2024-08-31T03:48:32.757842+0000 mgr.a (mgr.14388) 4208 : audit [DBG] from='client.101457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:33 smithi027 bash[22610]: cluster 2024-08-31T03:48:32.675085+0000 mgr.a (mgr.14388) 4207 : cluster [DBG] pgmap v2916: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:33 smithi027 bash[22610]: audit 2024-08-31T03:48:32.757842+0000 mgr.a (mgr.14388) 4208 : audit [DBG] from='client.101457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:36.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:35 smithi163 bash[24253]: cluster 2024-08-31T03:48:34.677629+0000 mgr.a (mgr.14388) 4209 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:35 smithi027 bash[22610]: cluster 2024-08-31T03:48:34.677629+0000 mgr.a (mgr.14388) 4209 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:35 smithi191 bash[24992]: cluster 2024-08-31T03:48:34.677629+0000 mgr.a (mgr.14388) 4209 : cluster [DBG] pgmap v2917: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:38.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:48:38.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:48:38.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:48:38.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:37 smithi163 bash[24253]: cluster 2024-08-31T03:48:36.678373+0000 mgr.a (mgr.14388) 4210 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:48:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:37 smithi027 bash[22610]: cluster 2024-08-31T03:48:36.678373+0000 mgr.a (mgr.14388) 4210 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:48:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:37 smithi191 bash[24992]: cluster 2024-08-31T03:48:36.678373+0000 mgr.a (mgr.14388) 4210 : cluster [DBG] pgmap v2918: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:48:38.961 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:48:38.962 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:48:38.962 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:48:38.962 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:48:38.962 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:39 smithi163 bash[24253]: audit 2024-08-31T03:48:38.519531+0000 mgr.a (mgr.14388) 4211 : audit [DBG] from='client.101532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:40.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:39 smithi163 bash[24253]: cluster 2024-08-31T03:48:38.679628+0000 mgr.a (mgr.14388) 4212 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:39 smithi027 bash[22610]: audit 2024-08-31T03:48:38.519531+0000 mgr.a (mgr.14388) 4211 : audit [DBG] from='client.101532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:39 smithi027 bash[22610]: cluster 2024-08-31T03:48:38.679628+0000 mgr.a (mgr.14388) 4212 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:39 smithi191 bash[24992]: audit 2024-08-31T03:48:38.519531+0000 mgr.a (mgr.14388) 4211 : audit [DBG] from='client.101532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:39 smithi191 bash[24992]: cluster 2024-08-31T03:48:38.679628+0000 mgr.a (mgr.14388) 4212 : cluster [DBG] pgmap v2919: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:42.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:41 smithi163 bash[24253]: cluster 2024-08-31T03:48:40.680544+0000 mgr.a (mgr.14388) 4213 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:48:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:41 smithi027 bash[22610]: cluster 2024-08-31T03:48:40.680544+0000 mgr.a (mgr.14388) 4213 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:48:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:41 smithi191 bash[24992]: cluster 2024-08-31T03:48:40.680544+0000 mgr.a (mgr.14388) 4213 : cluster [DBG] pgmap v2920: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:48:43.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:48:43.964 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:48:43.964 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:48:44.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:43 smithi163 bash[24253]: cluster 2024-08-31T03:48:42.681331+0000 mgr.a (mgr.14388) 4214 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:48:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:43 smithi027 bash[22610]: cluster 2024-08-31T03:48:42.681331+0000 mgr.a (mgr.14388) 4214 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:48:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:43 smithi191 bash[24992]: cluster 2024-08-31T03:48:42.681331+0000 mgr.a (mgr.14388) 4214 : cluster [DBG] pgmap v2921: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:48:44.740 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:48:44.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:48:44.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:48:44.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:48:44.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:46.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:45 smithi163 bash[24253]: audit 2024-08-31T03:48:44.296968+0000 mgr.a (mgr.14388) 4215 : audit [DBG] from='client.101610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:46.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:45 smithi163 bash[24253]: cluster 2024-08-31T03:48:44.682783+0000 mgr.a (mgr.14388) 4216 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:45 smithi027 bash[22610]: audit 2024-08-31T03:48:44.296968+0000 mgr.a (mgr.14388) 4215 : audit [DBG] from='client.101610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:45 smithi027 bash[22610]: cluster 2024-08-31T03:48:44.682783+0000 mgr.a (mgr.14388) 4216 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:45 smithi191 bash[24992]: audit 2024-08-31T03:48:44.296968+0000 mgr.a (mgr.14388) 4215 : audit [DBG] from='client.101610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:45 smithi191 bash[24992]: cluster 2024-08-31T03:48:44.682783+0000 mgr.a (mgr.14388) 4216 : cluster [DBG] pgmap v2922: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:48.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:47 smithi163 bash[24253]: cluster 2024-08-31T03:48:46.683497+0000 mgr.a (mgr.14388) 4217 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:47 smithi027 bash[22610]: cluster 2024-08-31T03:48:46.683497+0000 mgr.a (mgr.14388) 4217 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:47 smithi191 bash[24992]: cluster 2024-08-31T03:48:46.683497+0000 mgr.a (mgr.14388) 4217 : cluster [DBG] pgmap v2923: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:49.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:48:49.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:48:49.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:48:50.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:49 smithi163 bash[24253]: cluster 2024-08-31T03:48:48.685453+0000 mgr.a (mgr.14388) 4218 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:49 smithi027 bash[22610]: cluster 2024-08-31T03:48:48.685453+0000 mgr.a (mgr.14388) 4218 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:49 smithi191 bash[24992]: cluster 2024-08-31T03:48:48.685453+0000 mgr.a (mgr.14388) 4218 : cluster [DBG] pgmap v2924: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:50.516 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:48:50.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:48:50.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:48:50.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:48:50.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:52.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:51 smithi163 bash[24253]: audit 2024-08-31T03:48:50.077008+0000 mgr.a (mgr.14388) 4219 : audit [DBG] from='client.101685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:52.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:51 smithi163 bash[24253]: cluster 2024-08-31T03:48:50.686369+0000 mgr.a (mgr.14388) 4220 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:51 smithi027 bash[22610]: audit 2024-08-31T03:48:50.077008+0000 mgr.a (mgr.14388) 4219 : audit [DBG] from='client.101685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:51 smithi027 bash[22610]: cluster 2024-08-31T03:48:50.686369+0000 mgr.a (mgr.14388) 4220 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:51 smithi191 bash[24992]: audit 2024-08-31T03:48:50.077008+0000 mgr.a (mgr.14388) 4219 : audit [DBG] from='client.101685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:51 smithi191 bash[24992]: cluster 2024-08-31T03:48:50.686369+0000 mgr.a (mgr.14388) 4220 : cluster [DBG] pgmap v2925: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:54.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:53 smithi163 bash[24253]: cluster 2024-08-31T03:48:52.687184+0000 mgr.a (mgr.14388) 4221 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:54.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:53 smithi163 bash[24253]: audit 2024-08-31T03:48:53.569209+0000 mon.a (mon.0) 1223 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:48:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:53 smithi027 bash[22610]: cluster 2024-08-31T03:48:52.687184+0000 mgr.a (mgr.14388) 4221 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:53 smithi027 bash[22610]: audit 2024-08-31T03:48:53.569209+0000 mon.a (mon.0) 1223 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:48:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:53 smithi191 bash[24992]: cluster 2024-08-31T03:48:52.687184+0000 mgr.a (mgr.14388) 4221 : cluster [DBG] pgmap v2926: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:53 smithi191 bash[24992]: audit 2024-08-31T03:48:53.569209+0000 mon.a (mon.0) 1223 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:48:55.140 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:54 smithi027 bash[22610]: audit 2024-08-31T03:48:54.393776+0000 mon.a (mon.0) 1224 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:48:55.140 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:54 smithi027 bash[22610]: audit 2024-08-31T03:48:54.395391+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:48:55.141 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:54 smithi027 bash[22610]: audit 2024-08-31T03:48:54.405383+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:48:55.141 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:54 smithi027 bash[22610]: audit 2024-08-31T03:48:54.410032+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:48:55.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:54 smithi163 bash[24253]: audit 2024-08-31T03:48:54.393776+0000 mon.a (mon.0) 1224 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:48:55.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:54 smithi163 bash[24253]: audit 2024-08-31T03:48:54.395391+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:48:55.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:54 smithi163 bash[24253]: audit 2024-08-31T03:48:54.405383+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:48:55.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:54 smithi163 bash[24253]: audit 2024-08-31T03:48:54.410032+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:48:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:54 smithi191 bash[24992]: audit 2024-08-31T03:48:54.393776+0000 mon.a (mon.0) 1224 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:48:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:54 smithi191 bash[24992]: audit 2024-08-31T03:48:54.395391+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:48:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:54 smithi191 bash[24992]: audit 2024-08-31T03:48:54.405383+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:48:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:54 smithi191 bash[24992]: audit 2024-08-31T03:48:54.410032+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:48:55.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:48:55 smithi027 bash[22863]: debug 2024-08-31T03:48:55.136+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:48:55.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:48:55 smithi027 bash[22863]: debug 2024-08-31T03:48:55.136+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:48:55.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:48:55.518 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:48:55.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:48:56.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:55 smithi163 bash[24253]: audit 2024-08-31T03:48:54.412320+0000 mgr.a (mgr.14388) 4222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:48:56.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:55 smithi163 bash[24253]: cluster 2024-08-31T03:48:54.688538+0000 mgr.a (mgr.14388) 4223 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:55 smithi027 bash[22610]: audit 2024-08-31T03:48:54.412320+0000 mgr.a (mgr.14388) 4222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:48:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:55 smithi027 bash[22610]: cluster 2024-08-31T03:48:54.688538+0000 mgr.a (mgr.14388) 4223 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:56.287 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:48:56.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:48:56.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:48:56.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:48:56.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:48:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:55 smithi191 bash[24992]: audit 2024-08-31T03:48:54.412320+0000 mgr.a (mgr.14388) 4222 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:48:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:55 smithi191 bash[24992]: cluster 2024-08-31T03:48:54.688538+0000 mgr.a (mgr.14388) 4223 : cluster [DBG] pgmap v2927: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:48:57.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:56 smithi163 bash[24253]: audit 2024-08-31T03:48:55.140563+0000 mgr.a (mgr.14388) 4224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:48:57.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:56 smithi163 bash[24253]: cephadm 2024-08-31T03:48:55.142055+0000 mgr.a (mgr.14388) 4225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:48:57.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:56 smithi163 bash[24253]: audit 2024-08-31T03:48:55.857093+0000 mgr.a (mgr.14388) 4226 : audit [DBG] from='client.101868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:56 smithi027 bash[22610]: audit 2024-08-31T03:48:55.140563+0000 mgr.a (mgr.14388) 4224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:48:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:56 smithi027 bash[22610]: cephadm 2024-08-31T03:48:55.142055+0000 mgr.a (mgr.14388) 4225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:48:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:56 smithi027 bash[22610]: audit 2024-08-31T03:48:55.857093+0000 mgr.a (mgr.14388) 4226 : audit [DBG] from='client.101868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:56 smithi191 bash[24992]: audit 2024-08-31T03:48:55.140563+0000 mgr.a (mgr.14388) 4224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:48:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:56 smithi191 bash[24992]: cephadm 2024-08-31T03:48:55.142055+0000 mgr.a (mgr.14388) 4225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:48:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:56 smithi191 bash[24992]: audit 2024-08-31T03:48:55.857093+0000 mgr.a (mgr.14388) 4226 : audit [DBG] from='client.101868 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:48:58.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:57 smithi163 bash[24253]: cluster 2024-08-31T03:48:56.689444+0000 mgr.a (mgr.14388) 4227 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:57 smithi027 bash[22610]: cluster 2024-08-31T03:48:56.689444+0000 mgr.a (mgr.14388) 4227 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:48:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:57 smithi191 bash[24992]: cluster 2024-08-31T03:48:56.689444+0000 mgr.a (mgr.14388) 4227 : cluster [DBG] pgmap v2928: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:48:59 smithi163 bash[24253]: cluster 2024-08-31T03:48:58.691615+0000 mgr.a (mgr.14388) 4228 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:48:59 smithi027 bash[22610]: cluster 2024-08-31T03:48:58.691615+0000 mgr.a (mgr.14388) 4228 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:48:59 smithi191 bash[24992]: cluster 2024-08-31T03:48:58.691615+0000 mgr.a (mgr.14388) 4228 : cluster [DBG] pgmap v2929: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:01.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:01.290 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:01.290 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:02.072 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:02.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:02.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:02.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:02.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:49:02.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:01 smithi163 bash[24253]: cluster 2024-08-31T03:49:00.692420+0000 mgr.a (mgr.14388) 4229 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:01 smithi027 bash[22610]: cluster 2024-08-31T03:49:00.692420+0000 mgr.a (mgr.14388) 4229 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:01 smithi191 bash[24992]: cluster 2024-08-31T03:49:00.692420+0000 mgr.a (mgr.14388) 4229 : cluster [DBG] pgmap v2930: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:03.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:02 smithi163 bash[24253]: audit 2024-08-31T03:49:01.630584+0000 mgr.a (mgr.14388) 4230 : audit [DBG] from='client.101943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:02 smithi027 bash[22610]: audit 2024-08-31T03:49:01.630584+0000 mgr.a (mgr.14388) 4230 : audit [DBG] from='client.101943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:02 smithi191 bash[24992]: audit 2024-08-31T03:49:01.630584+0000 mgr.a (mgr.14388) 4230 : audit [DBG] from='client.101943 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:04.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:03 smithi163 bash[24253]: cluster 2024-08-31T03:49:02.693405+0000 mgr.a (mgr.14388) 4231 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:03 smithi027 bash[22610]: cluster 2024-08-31T03:49:02.693405+0000 mgr.a (mgr.14388) 4231 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:03 smithi191 bash[24992]: cluster 2024-08-31T03:49:02.693405+0000 mgr.a (mgr.14388) 4231 : cluster [DBG] pgmap v2931: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:06.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:05 smithi163 bash[24253]: cluster 2024-08-31T03:49:04.695680+0000 mgr.a (mgr.14388) 4232 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:05 smithi027 bash[22610]: cluster 2024-08-31T03:49:04.695680+0000 mgr.a (mgr.14388) 4232 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:05 smithi191 bash[24992]: cluster 2024-08-31T03:49:04.695680+0000 mgr.a (mgr.14388) 4232 : cluster [DBG] pgmap v2932: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:07.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:07.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:07.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:07.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:07 smithi163 bash[24253]: cluster 2024-08-31T03:49:06.696455+0000 mgr.a (mgr.14388) 4233 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:07 smithi027 bash[22610]: cluster 2024-08-31T03:49:06.696455+0000 mgr.a (mgr.14388) 4233 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:07 smithi191 bash[24992]: cluster 2024-08-31T03:49:06.696455+0000 mgr.a (mgr.14388) 4233 : cluster [DBG] pgmap v2933: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:07.816 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:07.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:07.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:07.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:07.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:49:08.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:08 smithi163 bash[24253]: audit 2024-08-31T03:49:07.407533+0000 mgr.a (mgr.14388) 4234 : audit [DBG] from='client.102021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:08 smithi027 bash[22610]: audit 2024-08-31T03:49:07.407533+0000 mgr.a (mgr.14388) 4234 : audit [DBG] from='client.102021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:08 smithi191 bash[24992]: audit 2024-08-31T03:49:07.407533+0000 mgr.a (mgr.14388) 4234 : audit [DBG] from='client.102021 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:09.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:09 smithi163 bash[24253]: cluster 2024-08-31T03:49:08.698953+0000 mgr.a (mgr.14388) 4235 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:09 smithi027 bash[22610]: cluster 2024-08-31T03:49:08.698953+0000 mgr.a (mgr.14388) 4235 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:09 smithi191 bash[24992]: cluster 2024-08-31T03:49:08.698953+0000 mgr.a (mgr.14388) 4235 : cluster [DBG] pgmap v2934: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:49:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:11 smithi191 bash[24992]: cluster 2024-08-31T03:49:10.699912+0000 mgr.a (mgr.14388) 4236 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:12.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:11 smithi163 bash[24253]: cluster 2024-08-31T03:49:10.699912+0000 mgr.a (mgr.14388) 4236 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:11 smithi027 bash[22610]: cluster 2024-08-31T03:49:10.699912+0000 mgr.a (mgr.14388) 4236 : cluster [DBG] pgmap v2935: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:12.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:12.821 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:12.821 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:13.568 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:13.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:13.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:13.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:13.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:49:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:13 smithi191 bash[24992]: cluster 2024-08-31T03:49:12.700842+0000 mgr.a (mgr.14388) 4237 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:14.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:13 smithi163 bash[24253]: cluster 2024-08-31T03:49:12.700842+0000 mgr.a (mgr.14388) 4237 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:13 smithi027 bash[22610]: cluster 2024-08-31T03:49:12.700842+0000 mgr.a (mgr.14388) 4237 : cluster [DBG] pgmap v2936: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:14 smithi191 bash[24992]: audit 2024-08-31T03:49:13.149797+0000 mgr.a (mgr.14388) 4238 : audit [DBG] from='client.102099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:15.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:14 smithi163 bash[24253]: audit 2024-08-31T03:49:13.149797+0000 mgr.a (mgr.14388) 4238 : audit [DBG] from='client.102099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:14 smithi027 bash[22610]: audit 2024-08-31T03:49:13.149797+0000 mgr.a (mgr.14388) 4238 : audit [DBG] from='client.102099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:15 smithi191 bash[24992]: cluster 2024-08-31T03:49:14.703654+0000 mgr.a (mgr.14388) 4239 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:16.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:15 smithi163 bash[24253]: cluster 2024-08-31T03:49:14.703654+0000 mgr.a (mgr.14388) 4239 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:15 smithi027 bash[22610]: cluster 2024-08-31T03:49:14.703654+0000 mgr.a (mgr.14388) 4239 : cluster [DBG] pgmap v2937: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:17 smithi191 bash[24992]: cluster 2024-08-31T03:49:16.704432+0000 mgr.a (mgr.14388) 4240 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:49:18.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:17 smithi163 bash[24253]: cluster 2024-08-31T03:49:16.704432+0000 mgr.a (mgr.14388) 4240 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:49:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:17 smithi027 bash[22610]: cluster 2024-08-31T03:49:16.704432+0000 mgr.a (mgr.14388) 4240 : cluster [DBG] pgmap v2938: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:49:18.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:18.570 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:18.571 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:19.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:19.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:19.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:19.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:49:19.305 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:19 smithi191 bash[24992]: cluster 2024-08-31T03:49:18.705414+0000 mgr.a (mgr.14388) 4241 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:19 smithi191 bash[24992]: audit 2024-08-31T03:49:18.898588+0000 mgr.a (mgr.14388) 4242 : audit [DBG] from='client.102177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:20.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:19 smithi163 bash[24253]: cluster 2024-08-31T03:49:18.705414+0000 mgr.a (mgr.14388) 4241 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:20.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:19 smithi163 bash[24253]: audit 2024-08-31T03:49:18.898588+0000 mgr.a (mgr.14388) 4242 : audit [DBG] from='client.102177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:19 smithi027 bash[22610]: cluster 2024-08-31T03:49:18.705414+0000 mgr.a (mgr.14388) 4241 : cluster [DBG] pgmap v2939: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:19 smithi027 bash[22610]: audit 2024-08-31T03:49:18.898588+0000 mgr.a (mgr.14388) 4242 : audit [DBG] from='client.102177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:21 smithi191 bash[24992]: cluster 2024-08-31T03:49:20.706339+0000 mgr.a (mgr.14388) 4243 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:49:22.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:21 smithi163 bash[24253]: cluster 2024-08-31T03:49:20.706339+0000 mgr.a (mgr.14388) 4243 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:49:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:21 smithi027 bash[22610]: cluster 2024-08-31T03:49:20.706339+0000 mgr.a (mgr.14388) 4243 : cluster [DBG] pgmap v2940: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:49:24.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:23 smithi163 bash[24253]: cluster 2024-08-31T03:49:22.707179+0000 mgr.a (mgr.14388) 4244 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:49:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:23 smithi027 bash[22610]: cluster 2024-08-31T03:49:22.707179+0000 mgr.a (mgr.14388) 4244 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:49:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:23 smithi191 bash[24992]: cluster 2024-08-31T03:49:22.707179+0000 mgr.a (mgr.14388) 4244 : cluster [DBG] pgmap v2941: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:49:24.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:24.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:24.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:25.065 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:49:26.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:25 smithi163 bash[24253]: audit 2024-08-31T03:49:24.645135+0000 mgr.a (mgr.14388) 4245 : audit [DBG] from='client.102255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:26.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:25 smithi163 bash[24253]: cluster 2024-08-31T03:49:24.708547+0000 mgr.a (mgr.14388) 4246 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:25 smithi027 bash[22610]: audit 2024-08-31T03:49:24.645135+0000 mgr.a (mgr.14388) 4245 : audit [DBG] from='client.102255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:25 smithi027 bash[22610]: cluster 2024-08-31T03:49:24.708547+0000 mgr.a (mgr.14388) 4246 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:25 smithi191 bash[24992]: audit 2024-08-31T03:49:24.645135+0000 mgr.a (mgr.14388) 4245 : audit [DBG] from='client.102255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:25 smithi191 bash[24992]: cluster 2024-08-31T03:49:24.708547+0000 mgr.a (mgr.14388) 4246 : cluster [DBG] pgmap v2942: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:28.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:27 smithi163 bash[24253]: cluster 2024-08-31T03:49:26.709440+0000 mgr.a (mgr.14388) 4247 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:27 smithi027 bash[22610]: cluster 2024-08-31T03:49:26.709440+0000 mgr.a (mgr.14388) 4247 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:27 smithi191 bash[24992]: cluster 2024-08-31T03:49:26.709440+0000 mgr.a (mgr.14388) 4247 : cluster [DBG] pgmap v2943: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:30.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:30.067 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:30.067 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:30.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:29 smithi163 bash[24253]: cluster 2024-08-31T03:49:28.711626+0000 mgr.a (mgr.14388) 4248 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:29 smithi027 bash[22610]: cluster 2024-08-31T03:49:28.711626+0000 mgr.a (mgr.14388) 4248 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:29 smithi191 bash[24992]: cluster 2024-08-31T03:49:28.711626+0000 mgr.a (mgr.14388) 4248 : cluster [DBG] pgmap v2944: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:30.818 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:30.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:30.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:30.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:30.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:49:32.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:31 smithi163 bash[24253]: audit 2024-08-31T03:49:30.396785+0000 mgr.a (mgr.14388) 4249 : audit [DBG] from='client.102333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:32.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:31 smithi163 bash[24253]: cluster 2024-08-31T03:49:30.719409+0000 mgr.a (mgr.14388) 4250 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:31 smithi027 bash[22610]: audit 2024-08-31T03:49:30.396785+0000 mgr.a (mgr.14388) 4249 : audit [DBG] from='client.102333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:31 smithi027 bash[22610]: cluster 2024-08-31T03:49:30.719409+0000 mgr.a (mgr.14388) 4250 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:31 smithi191 bash[24992]: audit 2024-08-31T03:49:30.396785+0000 mgr.a (mgr.14388) 4249 : audit [DBG] from='client.102333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:31 smithi191 bash[24992]: cluster 2024-08-31T03:49:30.719409+0000 mgr.a (mgr.14388) 4250 : cluster [DBG] pgmap v2945: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:34.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:33 smithi163 bash[24253]: cluster 2024-08-31T03:49:32.720182+0000 mgr.a (mgr.14388) 4251 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:33 smithi027 bash[22610]: cluster 2024-08-31T03:49:32.720182+0000 mgr.a (mgr.14388) 4251 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:33 smithi191 bash[24992]: cluster 2024-08-31T03:49:32.720182+0000 mgr.a (mgr.14388) 4251 : cluster [DBG] pgmap v2946: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:35.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:35.821 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:35.821 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:36.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:35 smithi163 bash[24253]: cluster 2024-08-31T03:49:34.722406+0000 mgr.a (mgr.14388) 4252 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:35 smithi027 bash[22610]: cluster 2024-08-31T03:49:34.722406+0000 mgr.a (mgr.14388) 4252 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:35 smithi191 bash[24992]: cluster 2024-08-31T03:49:34.722406+0000 mgr.a (mgr.14388) 4252 : cluster [DBG] pgmap v2947: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:36.556 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:36.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:36.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:36.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:36.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:49:38.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:37 smithi163 bash[24253]: audit 2024-08-31T03:49:36.153284+0000 mgr.a (mgr.14388) 4253 : audit [DBG] from='client.102408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:38.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:37 smithi163 bash[24253]: cluster 2024-08-31T03:49:36.723401+0000 mgr.a (mgr.14388) 4254 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:37 smithi027 bash[22610]: audit 2024-08-31T03:49:36.153284+0000 mgr.a (mgr.14388) 4253 : audit [DBG] from='client.102408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:37 smithi027 bash[22610]: cluster 2024-08-31T03:49:36.723401+0000 mgr.a (mgr.14388) 4254 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:37 smithi191 bash[24992]: audit 2024-08-31T03:49:36.153284+0000 mgr.a (mgr.14388) 4253 : audit [DBG] from='client.102408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:37 smithi191 bash[24992]: cluster 2024-08-31T03:49:36.723401+0000 mgr.a (mgr.14388) 4254 : cluster [DBG] pgmap v2948: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:40.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:39 smithi163 bash[24253]: cluster 2024-08-31T03:49:38.725706+0000 mgr.a (mgr.14388) 4255 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:39 smithi027 bash[22610]: cluster 2024-08-31T03:49:38.725706+0000 mgr.a (mgr.14388) 4255 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:39 smithi191 bash[24992]: cluster 2024-08-31T03:49:38.725706+0000 mgr.a (mgr.14388) 4255 : cluster [DBG] pgmap v2949: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:41.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:41.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:41.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:42.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:41 smithi163 bash[24253]: cluster 2024-08-31T03:49:40.726535+0000 mgr.a (mgr.14388) 4256 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:41 smithi027 bash[22610]: cluster 2024-08-31T03:49:40.726535+0000 mgr.a (mgr.14388) 4256 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:41 smithi191 bash[24992]: cluster 2024-08-31T03:49:40.726535+0000 mgr.a (mgr.14388) 4256 : cluster [DBG] pgmap v2950: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:42.326 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:42.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:42.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:42.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:42.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:49:43.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:42 smithi163 bash[24253]: audit 2024-08-31T03:49:41.893368+0000 mgr.a (mgr.14388) 4257 : audit [DBG] from='client.102486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:42 smithi027 bash[22610]: audit 2024-08-31T03:49:41.893368+0000 mgr.a (mgr.14388) 4257 : audit [DBG] from='client.102486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:42 smithi191 bash[24992]: audit 2024-08-31T03:49:41.893368+0000 mgr.a (mgr.14388) 4257 : audit [DBG] from='client.102486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:44.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:43 smithi163 bash[24253]: cluster 2024-08-31T03:49:42.727481+0000 mgr.a (mgr.14388) 4258 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:43 smithi027 bash[22610]: cluster 2024-08-31T03:49:42.727481+0000 mgr.a (mgr.14388) 4258 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:43 smithi191 bash[24992]: cluster 2024-08-31T03:49:42.727481+0000 mgr.a (mgr.14388) 4258 : cluster [DBG] pgmap v2951: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:46.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:45 smithi163 bash[24253]: cluster 2024-08-31T03:49:44.729719+0000 mgr.a (mgr.14388) 4259 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:45 smithi027 bash[22610]: cluster 2024-08-31T03:49:44.729719+0000 mgr.a (mgr.14388) 4259 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:45 smithi191 bash[24992]: cluster 2024-08-31T03:49:44.729719+0000 mgr.a (mgr.14388) 4259 : cluster [DBG] pgmap v2952: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:49:47.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:47.329 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:47.329 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:48.061 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:48.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:48.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:48.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:48.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:49:48.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:47 smithi163 bash[24253]: cluster 2024-08-31T03:49:46.730521+0000 mgr.a (mgr.14388) 4260 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:47 smithi027 bash[22610]: cluster 2024-08-31T03:49:46.730521+0000 mgr.a (mgr.14388) 4260 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:47 smithi191 bash[24992]: cluster 2024-08-31T03:49:46.730521+0000 mgr.a (mgr.14388) 4260 : cluster [DBG] pgmap v2953: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:49.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:48 smithi163 bash[24253]: audit 2024-08-31T03:49:47.657409+0000 mgr.a (mgr.14388) 4261 : audit [DBG] from='client.102564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:48 smithi027 bash[22610]: audit 2024-08-31T03:49:47.657409+0000 mgr.a (mgr.14388) 4261 : audit [DBG] from='client.102564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:48 smithi191 bash[24992]: audit 2024-08-31T03:49:47.657409+0000 mgr.a (mgr.14388) 4261 : audit [DBG] from='client.102564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:50.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:49 smithi163 bash[24253]: cluster 2024-08-31T03:49:48.733087+0000 mgr.a (mgr.14388) 4262 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:49:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:49 smithi027 bash[22610]: cluster 2024-08-31T03:49:48.733087+0000 mgr.a (mgr.14388) 4262 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:49:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:49 smithi191 bash[24992]: cluster 2024-08-31T03:49:48.733087+0000 mgr.a (mgr.14388) 4262 : cluster [DBG] pgmap v2954: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:49:52.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:51 smithi163 bash[24253]: cluster 2024-08-31T03:49:50.734039+0000 mgr.a (mgr.14388) 4263 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:49:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:51 smithi027 bash[22610]: cluster 2024-08-31T03:49:50.734039+0000 mgr.a (mgr.14388) 4263 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:49:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:51 smithi191 bash[24992]: cluster 2024-08-31T03:49:50.734039+0000 mgr.a (mgr.14388) 4263 : cluster [DBG] pgmap v2955: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:49:53.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:53.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:53.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:53.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:53.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:49:53.812 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:54.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:53 smithi163 bash[24253]: cluster 2024-08-31T03:49:52.734873+0000 mgr.a (mgr.14388) 4264 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:49:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:53 smithi027 bash[22610]: cluster 2024-08-31T03:49:52.734873+0000 mgr.a (mgr.14388) 4264 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:49:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:53 smithi191 bash[24992]: cluster 2024-08-31T03:49:52.734873+0000 mgr.a (mgr.14388) 4264 : cluster [DBG] pgmap v2956: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:49:55.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:54 smithi163 bash[24253]: audit 2024-08-31T03:49:53.394117+0000 mgr.a (mgr.14388) 4265 : audit [DBG] from='client.102636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:55.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:54 smithi027 bash[22610]: audit 2024-08-31T03:49:53.394117+0000 mgr.a (mgr.14388) 4265 : audit [DBG] from='client.102636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:54 smithi191 bash[24992]: audit 2024-08-31T03:49:53.394117+0000 mgr.a (mgr.14388) 4265 : audit [DBG] from='client.102636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:49:56.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:55 smithi163 bash[24253]: cluster 2024-08-31T03:49:54.737709+0000 mgr.a (mgr.14388) 4266 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:56.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:55 smithi163 bash[24253]: audit 2024-08-31T03:49:55.206080+0000 mon.a (mon.0) 1228 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:49:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:55 smithi027 bash[22610]: cluster 2024-08-31T03:49:54.737709+0000 mgr.a (mgr.14388) 4266 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:55 smithi027 bash[22610]: audit 2024-08-31T03:49:55.206080+0000 mon.a (mon.0) 1228 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:49:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:55 smithi191 bash[24992]: cluster 2024-08-31T03:49:54.737709+0000 mgr.a (mgr.14388) 4266 : cluster [DBG] pgmap v2957: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:49:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:55 smithi191 bash[24992]: audit 2024-08-31T03:49:55.206080+0000 mon.a (mon.0) 1228 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:49:57.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:56 smithi163 bash[24253]: audit 2024-08-31T03:49:56.062445+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:49:57.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:56 smithi163 bash[24253]: audit 2024-08-31T03:49:56.064196+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:49:57.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:56 smithi163 bash[24253]: audit 2024-08-31T03:49:56.074935+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:49:57.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:56 smithi163 bash[24253]: audit 2024-08-31T03:49:56.079853+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:49:57.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:49:56 smithi027 bash[22863]: debug 2024-08-31T03:49:56.806+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:49:57.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:49:56 smithi027 bash[22863]: debug 2024-08-31T03:49:56.806+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:49:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:56 smithi027 bash[22610]: audit 2024-08-31T03:49:56.062445+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:49:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:56 smithi027 bash[22610]: audit 2024-08-31T03:49:56.064196+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:49:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:56 smithi027 bash[22610]: audit 2024-08-31T03:49:56.074935+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:49:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:56 smithi027 bash[22610]: audit 2024-08-31T03:49:56.079853+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:49:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:56 smithi191 bash[24992]: audit 2024-08-31T03:49:56.062445+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:49:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:56 smithi191 bash[24992]: audit 2024-08-31T03:49:56.064196+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:49:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:56 smithi191 bash[24992]: audit 2024-08-31T03:49:56.074935+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:49:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:56 smithi191 bash[24992]: audit 2024-08-31T03:49:56.079853+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:49:58.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:57 smithi163 bash[24253]: audit 2024-08-31T03:49:56.082174+0000 mgr.a (mgr.14388) 4267 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:49:58.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:57 smithi163 bash[24253]: cluster 2024-08-31T03:49:56.738458+0000 mgr.a (mgr.14388) 4268 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:49:58.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:57 smithi163 bash[24253]: audit 2024-08-31T03:49:56.808435+0000 mgr.a (mgr.14388) 4269 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:49:58.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:57 smithi163 bash[24253]: cephadm 2024-08-31T03:49:56.809801+0000 mgr.a (mgr.14388) 4270 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:49:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:57 smithi027 bash[22610]: audit 2024-08-31T03:49:56.082174+0000 mgr.a (mgr.14388) 4267 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:49:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:57 smithi027 bash[22610]: cluster 2024-08-31T03:49:56.738458+0000 mgr.a (mgr.14388) 4268 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:49:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:57 smithi027 bash[22610]: audit 2024-08-31T03:49:56.808435+0000 mgr.a (mgr.14388) 4269 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:49:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:57 smithi027 bash[22610]: cephadm 2024-08-31T03:49:56.809801+0000 mgr.a (mgr.14388) 4270 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:49:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:57 smithi191 bash[24992]: audit 2024-08-31T03:49:56.082174+0000 mgr.a (mgr.14388) 4267 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:49:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:57 smithi191 bash[24992]: cluster 2024-08-31T03:49:56.738458+0000 mgr.a (mgr.14388) 4268 : cluster [DBG] pgmap v2958: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:49:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:57 smithi191 bash[24992]: audit 2024-08-31T03:49:56.808435+0000 mgr.a (mgr.14388) 4269 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:49:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:57 smithi191 bash[24992]: cephadm 2024-08-31T03:49:56.809801+0000 mgr.a (mgr.14388) 4270 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:49:58.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:49:58.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:49:58.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:49:59.573 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:49:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:49:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:49:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:49:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:00.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:49:59 smithi163 bash[24253]: cluster 2024-08-31T03:49:58.740602+0000 mgr.a (mgr.14388) 4271 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:49:59 smithi027 bash[22610]: cluster 2024-08-31T03:49:58.740602+0000 mgr.a (mgr.14388) 4271 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:49:59 smithi191 bash[24992]: cluster 2024-08-31T03:49:58.740602+0000 mgr.a (mgr.14388) 4271 : cluster [DBG] pgmap v2959: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:01.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:00 smithi163 bash[24253]: audit 2024-08-31T03:49:59.149638+0000 mgr.a (mgr.14388) 4272 : audit [DBG] from='client.102822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:01.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:00 smithi163 bash[24253]: cluster 2024-08-31T03:50:00.000145+0000 mon.a (mon.0) 1233 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:50:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:00 smithi027 bash[22610]: audit 2024-08-31T03:49:59.149638+0000 mgr.a (mgr.14388) 4272 : audit [DBG] from='client.102822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:00 smithi027 bash[22610]: cluster 2024-08-31T03:50:00.000145+0000 mon.a (mon.0) 1233 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:50:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:00 smithi191 bash[24992]: audit 2024-08-31T03:49:59.149638+0000 mgr.a (mgr.14388) 4272 : audit [DBG] from='client.102822 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:00 smithi191 bash[24992]: cluster 2024-08-31T03:50:00.000145+0000 mon.a (mon.0) 1233 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T03:50:02.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:01 smithi163 bash[24253]: cluster 2024-08-31T03:50:00.741499+0000 mgr.a (mgr.14388) 4273 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:50:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:01 smithi027 bash[22610]: cluster 2024-08-31T03:50:00.741499+0000 mgr.a (mgr.14388) 4273 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:50:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:01 smithi191 bash[24992]: cluster 2024-08-31T03:50:00.741499+0000 mgr.a (mgr.14388) 4273 : cluster [DBG] pgmap v2960: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:50:04.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:03 smithi163 bash[24253]: cluster 2024-08-31T03:50:02.742438+0000 mgr.a (mgr.14388) 4274 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:50:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:03 smithi027 bash[22610]: cluster 2024-08-31T03:50:02.742438+0000 mgr.a (mgr.14388) 4274 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:50:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:03 smithi191 bash[24992]: cluster 2024-08-31T03:50:02.742438+0000 mgr.a (mgr.14388) 4274 : cluster [DBG] pgmap v2961: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:50:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:50:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:50:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:50:05.337 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:50:05.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:50:05.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:50:05.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:50:05.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:06.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:05 smithi163 bash[24253]: cluster 2024-08-31T03:50:04.744207+0000 mgr.a (mgr.14388) 4275 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:06.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:05 smithi163 bash[24253]: audit 2024-08-31T03:50:04.914914+0000 mgr.a (mgr.14388) 4276 : audit [DBG] from='client.102900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:05 smithi027 bash[22610]: cluster 2024-08-31T03:50:04.744207+0000 mgr.a (mgr.14388) 4275 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:05 smithi027 bash[22610]: audit 2024-08-31T03:50:04.914914+0000 mgr.a (mgr.14388) 4276 : audit [DBG] from='client.102900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:05 smithi191 bash[24992]: cluster 2024-08-31T03:50:04.744207+0000 mgr.a (mgr.14388) 4275 : cluster [DBG] pgmap v2962: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:05 smithi191 bash[24992]: audit 2024-08-31T03:50:04.914914+0000 mgr.a (mgr.14388) 4276 : audit [DBG] from='client.102900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:08.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:07 smithi163 bash[24253]: cluster 2024-08-31T03:50:06.745260+0000 mgr.a (mgr.14388) 4277 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:07 smithi027 bash[22610]: cluster 2024-08-31T03:50:06.745260+0000 mgr.a (mgr.14388) 4277 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:07 smithi191 bash[24992]: cluster 2024-08-31T03:50:06.745260+0000 mgr.a (mgr.14388) 4277 : cluster [DBG] pgmap v2963: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:10.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:09 smithi163 bash[24253]: cluster 2024-08-31T03:50:08.747620+0000 mgr.a (mgr.14388) 4278 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:09 smithi027 bash[22610]: cluster 2024-08-31T03:50:08.747620+0000 mgr.a (mgr.14388) 4278 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:09 smithi191 bash[24992]: cluster 2024-08-31T03:50:08.747620+0000 mgr.a (mgr.14388) 4278 : cluster [DBG] pgmap v2964: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:50:10.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:50:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:50:10.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:50:11.087 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:50:11.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:50:11.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:50:11.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:50:11.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:12.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:11 smithi163 bash[24253]: audit 2024-08-31T03:50:10.670546+0000 mgr.a (mgr.14388) 4279 : audit [DBG] from='client.102978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:12.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:11 smithi163 bash[24253]: cluster 2024-08-31T03:50:10.748179+0000 mgr.a (mgr.14388) 4280 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:11 smithi027 bash[22610]: audit 2024-08-31T03:50:10.670546+0000 mgr.a (mgr.14388) 4279 : audit [DBG] from='client.102978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:11 smithi027 bash[22610]: cluster 2024-08-31T03:50:10.748179+0000 mgr.a (mgr.14388) 4280 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:11 smithi191 bash[24992]: audit 2024-08-31T03:50:10.670546+0000 mgr.a (mgr.14388) 4279 : audit [DBG] from='client.102978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:11 smithi191 bash[24992]: cluster 2024-08-31T03:50:10.748179+0000 mgr.a (mgr.14388) 4280 : cluster [DBG] pgmap v2965: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:14.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:13 smithi163 bash[24253]: cluster 2024-08-31T03:50:12.749017+0000 mgr.a (mgr.14388) 4281 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:13 smithi027 bash[22610]: cluster 2024-08-31T03:50:12.749017+0000 mgr.a (mgr.14388) 4281 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:13 smithi191 bash[24992]: cluster 2024-08-31T03:50:12.749017+0000 mgr.a (mgr.14388) 4281 : cluster [DBG] pgmap v2966: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:16.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:50:16.089 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:50:16.089 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:50:16.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:15 smithi163 bash[24253]: cluster 2024-08-31T03:50:14.751384+0000 mgr.a (mgr.14388) 4282 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:15 smithi027 bash[22610]: cluster 2024-08-31T03:50:14.751384+0000 mgr.a (mgr.14388) 4282 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:15 smithi191 bash[24992]: cluster 2024-08-31T03:50:14.751384+0000 mgr.a (mgr.14388) 4282 : cluster [DBG] pgmap v2967: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:16.844 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:50:16.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:50:16.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:50:16.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:50:16.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:18.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:17 smithi163 bash[24253]: audit 2024-08-31T03:50:16.422974+0000 mgr.a (mgr.14388) 4283 : audit [DBG] from='client.103056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:18.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:17 smithi163 bash[24253]: cluster 2024-08-31T03:50:16.751973+0000 mgr.a (mgr.14388) 4284 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:17 smithi027 bash[22610]: audit 2024-08-31T03:50:16.422974+0000 mgr.a (mgr.14388) 4283 : audit [DBG] from='client.103056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:17 smithi027 bash[22610]: cluster 2024-08-31T03:50:16.751973+0000 mgr.a (mgr.14388) 4284 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:17 smithi191 bash[24992]: audit 2024-08-31T03:50:16.422974+0000 mgr.a (mgr.14388) 4283 : audit [DBG] from='client.103056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:17 smithi191 bash[24992]: cluster 2024-08-31T03:50:16.751973+0000 mgr.a (mgr.14388) 4284 : cluster [DBG] pgmap v2968: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:20.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:19 smithi163 bash[24253]: cluster 2024-08-31T03:50:18.754083+0000 mgr.a (mgr.14388) 4285 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:19 smithi027 bash[22610]: cluster 2024-08-31T03:50:18.754083+0000 mgr.a (mgr.14388) 4285 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:19 smithi191 bash[24992]: cluster 2024-08-31T03:50:18.754083+0000 mgr.a (mgr.14388) 4285 : cluster [DBG] pgmap v2969: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:50:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:50:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:50:22.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:21 smithi163 bash[24253]: cluster 2024-08-31T03:50:20.754876+0000 mgr.a (mgr.14388) 4286 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:21 smithi027 bash[22610]: cluster 2024-08-31T03:50:20.754876+0000 mgr.a (mgr.14388) 4286 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:21 smithi191 bash[24992]: cluster 2024-08-31T03:50:20.754876+0000 mgr.a (mgr.14388) 4286 : cluster [DBG] pgmap v2970: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:22.630 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:50:22.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:50:22.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:50:22.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:50:22.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:23 smithi027 bash[22610]: audit 2024-08-31T03:50:22.189099+0000 mgr.a (mgr.14388) 4287 : audit [DBG] from='client.103131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:23 smithi027 bash[22610]: cluster 2024-08-31T03:50:22.755772+0000 mgr.a (mgr.14388) 4288 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:23 smithi191 bash[24992]: audit 2024-08-31T03:50:22.189099+0000 mgr.a (mgr.14388) 4287 : audit [DBG] from='client.103131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:23 smithi191 bash[24992]: cluster 2024-08-31T03:50:22.755772+0000 mgr.a (mgr.14388) 4288 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:24.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:23 smithi163 bash[24253]: audit 2024-08-31T03:50:22.189099+0000 mgr.a (mgr.14388) 4287 : audit [DBG] from='client.103131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:24.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:23 smithi163 bash[24253]: cluster 2024-08-31T03:50:22.755772+0000 mgr.a (mgr.14388) 4288 : cluster [DBG] pgmap v2971: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:25 smithi027 bash[22610]: cluster 2024-08-31T03:50:24.758035+0000 mgr.a (mgr.14388) 4289 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:25 smithi191 bash[24992]: cluster 2024-08-31T03:50:24.758035+0000 mgr.a (mgr.14388) 4289 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:26.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:25 smithi163 bash[24253]: cluster 2024-08-31T03:50:24.758035+0000 mgr.a (mgr.14388) 4289 : cluster [DBG] pgmap v2972: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:27.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:50:27.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:50:27.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:50:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:27 smithi027 bash[22610]: cluster 2024-08-31T03:50:26.758815+0000 mgr.a (mgr.14388) 4290 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:27 smithi191 bash[24992]: cluster 2024-08-31T03:50:26.758815+0000 mgr.a (mgr.14388) 4290 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:28.372 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:50:28.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:50:28.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:50:28.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:50:28.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:28.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:27 smithi163 bash[24253]: cluster 2024-08-31T03:50:26.758815+0000 mgr.a (mgr.14388) 4290 : cluster [DBG] pgmap v2973: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:28 smithi027 bash[22610]: audit 2024-08-31T03:50:27.966084+0000 mgr.a (mgr.14388) 4291 : audit [DBG] from='client.103206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:28 smithi191 bash[24992]: audit 2024-08-31T03:50:27.966084+0000 mgr.a (mgr.14388) 4291 : audit [DBG] from='client.103206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:29.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:28 smithi163 bash[24253]: audit 2024-08-31T03:50:27.966084+0000 mgr.a (mgr.14388) 4291 : audit [DBG] from='client.103206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:29 smithi027 bash[22610]: cluster 2024-08-31T03:50:28.761699+0000 mgr.a (mgr.14388) 4292 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:29 smithi191 bash[24992]: cluster 2024-08-31T03:50:28.761699+0000 mgr.a (mgr.14388) 4292 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:30.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:29 smithi163 bash[24253]: cluster 2024-08-31T03:50:28.761699+0000 mgr.a (mgr.14388) 4292 : cluster [DBG] pgmap v2974: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:31 smithi191 bash[24992]: cluster 2024-08-31T03:50:30.762531+0000 mgr.a (mgr.14388) 4293 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:50:32.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:31 smithi163 bash[24253]: cluster 2024-08-31T03:50:30.762531+0000 mgr.a (mgr.14388) 4293 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:50:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:31 smithi027 bash[22610]: cluster 2024-08-31T03:50:30.762531+0000 mgr.a (mgr.14388) 4293 : cluster [DBG] pgmap v2975: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:50:33.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:50:33.374 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:50:33.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:50:34.139 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:50:34.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:50:34.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:50:34.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:50:34.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:33 smithi191 bash[24992]: cluster 2024-08-31T03:50:32.763305+0000 mgr.a (mgr.14388) 4294 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:50:34.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:33 smithi163 bash[24253]: cluster 2024-08-31T03:50:32.763305+0000 mgr.a (mgr.14388) 4294 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:50:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:33 smithi027 bash[22610]: cluster 2024-08-31T03:50:32.763305+0000 mgr.a (mgr.14388) 4294 : cluster [DBG] pgmap v2976: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:50:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:34 smithi191 bash[24992]: audit 2024-08-31T03:50:33.708755+0000 mgr.a (mgr.14388) 4295 : audit [DBG] from='client.103284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:35.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:34 smithi163 bash[24253]: audit 2024-08-31T03:50:33.708755+0000 mgr.a (mgr.14388) 4295 : audit [DBG] from='client.103284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:34 smithi027 bash[22610]: audit 2024-08-31T03:50:33.708755+0000 mgr.a (mgr.14388) 4295 : audit [DBG] from='client.103284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:36 smithi191 bash[24992]: cluster 2024-08-31T03:50:34.766036+0000 mgr.a (mgr.14388) 4296 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:36.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:36 smithi163 bash[24253]: cluster 2024-08-31T03:50:34.766036+0000 mgr.a (mgr.14388) 4296 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:36 smithi027 bash[22610]: cluster 2024-08-31T03:50:34.766036+0000 mgr.a (mgr.14388) 4296 : cluster [DBG] pgmap v2977: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:38 smithi191 bash[24992]: cluster 2024-08-31T03:50:36.766851+0000 mgr.a (mgr.14388) 4297 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:50:38.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:38 smithi163 bash[24253]: cluster 2024-08-31T03:50:36.766851+0000 mgr.a (mgr.14388) 4297 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:50:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:38 smithi027 bash[22610]: cluster 2024-08-31T03:50:36.766851+0000 mgr.a (mgr.14388) 4297 : cluster [DBG] pgmap v2978: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:50:39.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:50:39.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:50:39.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:50:39.889 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:50:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:50:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:50:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:50:39.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:40 smithi191 bash[24992]: cluster 2024-08-31T03:50:38.769823+0000 mgr.a (mgr.14388) 4298 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:40.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:40 smithi163 bash[24253]: cluster 2024-08-31T03:50:38.769823+0000 mgr.a (mgr.14388) 4298 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:40 smithi027 bash[22610]: cluster 2024-08-31T03:50:38.769823+0000 mgr.a (mgr.14388) 4298 : cluster [DBG] pgmap v2979: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:41 smithi191 bash[24992]: audit 2024-08-31T03:50:39.471691+0000 mgr.a (mgr.14388) 4299 : audit [DBG] from='client.103362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:41.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:41 smithi163 bash[24253]: audit 2024-08-31T03:50:39.471691+0000 mgr.a (mgr.14388) 4299 : audit [DBG] from='client.103362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:41 smithi027 bash[22610]: audit 2024-08-31T03:50:39.471691+0000 mgr.a (mgr.14388) 4299 : audit [DBG] from='client.103362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:42 smithi191 bash[24992]: cluster 2024-08-31T03:50:40.770791+0000 mgr.a (mgr.14388) 4300 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:42.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:42 smithi163 bash[24253]: cluster 2024-08-31T03:50:40.770791+0000 mgr.a (mgr.14388) 4300 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:42 smithi027 bash[22610]: cluster 2024-08-31T03:50:40.770791+0000 mgr.a (mgr.14388) 4300 : cluster [DBG] pgmap v2980: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:44 smithi191 bash[24992]: cluster 2024-08-31T03:50:42.771574+0000 mgr.a (mgr.14388) 4301 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:44.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:44 smithi163 bash[24253]: cluster 2024-08-31T03:50:42.771574+0000 mgr.a (mgr.14388) 4301 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:44 smithi027 bash[22610]: cluster 2024-08-31T03:50:42.771574+0000 mgr.a (mgr.14388) 4301 : cluster [DBG] pgmap v2981: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:44.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:50:44.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:50:44.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:50:45.634 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:50:45.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:50:45.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:50:45.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:50:45.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:46 smithi191 bash[24992]: cluster 2024-08-31T03:50:44.773816+0000 mgr.a (mgr.14388) 4302 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:46.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:46 smithi163 bash[24253]: cluster 2024-08-31T03:50:44.773816+0000 mgr.a (mgr.14388) 4302 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:46 smithi027 bash[22610]: cluster 2024-08-31T03:50:44.773816+0000 mgr.a (mgr.14388) 4302 : cluster [DBG] pgmap v2982: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:47 smithi191 bash[24992]: audit 2024-08-31T03:50:45.218823+0000 mgr.a (mgr.14388) 4303 : audit [DBG] from='client.103440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:47.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:47 smithi163 bash[24253]: audit 2024-08-31T03:50:45.218823+0000 mgr.a (mgr.14388) 4303 : audit [DBG] from='client.103440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:47 smithi027 bash[22610]: audit 2024-08-31T03:50:45.218823+0000 mgr.a (mgr.14388) 4303 : audit [DBG] from='client.103440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:48.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:48 smithi163 bash[24253]: cluster 2024-08-31T03:50:46.774673+0000 mgr.a (mgr.14388) 4304 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:48 smithi027 bash[22610]: cluster 2024-08-31T03:50:46.774673+0000 mgr.a (mgr.14388) 4304 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:48 smithi191 bash[24992]: cluster 2024-08-31T03:50:46.774673+0000 mgr.a (mgr.14388) 4304 : cluster [DBG] pgmap v2983: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:50.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:50 smithi163 bash[24253]: cluster 2024-08-31T03:50:48.776859+0000 mgr.a (mgr.14388) 4305 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:50 smithi027 bash[22610]: cluster 2024-08-31T03:50:48.776859+0000 mgr.a (mgr.14388) 4305 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:50 smithi191 bash[24992]: cluster 2024-08-31T03:50:48.776859+0000 mgr.a (mgr.14388) 4305 : cluster [DBG] pgmap v2984: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:50.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:50:50.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:50:50.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:50:51.376 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:50:51.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:50:51.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:50:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:50:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:52.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:52 smithi163 bash[24253]: cluster 2024-08-31T03:50:50.777454+0000 mgr.a (mgr.14388) 4306 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:52.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:52 smithi163 bash[24253]: audit 2024-08-31T03:50:50.965914+0000 mgr.a (mgr.14388) 4307 : audit [DBG] from='client.103518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:52 smithi027 bash[22610]: cluster 2024-08-31T03:50:50.777454+0000 mgr.a (mgr.14388) 4306 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:52 smithi027 bash[22610]: audit 2024-08-31T03:50:50.965914+0000 mgr.a (mgr.14388) 4307 : audit [DBG] from='client.103518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:52 smithi191 bash[24992]: cluster 2024-08-31T03:50:50.777454+0000 mgr.a (mgr.14388) 4306 : cluster [DBG] pgmap v2985: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:52 smithi191 bash[24992]: audit 2024-08-31T03:50:50.965914+0000 mgr.a (mgr.14388) 4307 : audit [DBG] from='client.103518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:54.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:54 smithi163 bash[24253]: cluster 2024-08-31T03:50:52.778279+0000 mgr.a (mgr.14388) 4308 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:54 smithi027 bash[22610]: cluster 2024-08-31T03:50:52.778279+0000 mgr.a (mgr.14388) 4308 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:54 smithi191 bash[24992]: cluster 2024-08-31T03:50:52.778279+0000 mgr.a (mgr.14388) 4308 : cluster [DBG] pgmap v2986: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:55.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:55 smithi163 bash[24253]: cluster 2024-08-31T03:50:54.780545+0000 mgr.a (mgr.14388) 4309 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:55 smithi027 bash[22610]: cluster 2024-08-31T03:50:54.780545+0000 mgr.a (mgr.14388) 4309 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:55 smithi191 bash[24992]: cluster 2024-08-31T03:50:54.780545+0000 mgr.a (mgr.14388) 4309 : cluster [DBG] pgmap v2987: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:50:56.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:50:56.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:50:56.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:50:57.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:50:57.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:50:57.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:50:57.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:50:57.165 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:50:58.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:57 smithi163 bash[24253]: audit 2024-08-31T03:50:56.717640+0000 mgr.a (mgr.14388) 4310 : audit [DBG] from='client.103596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:58.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:57 smithi163 bash[24253]: cluster 2024-08-31T03:50:56.781083+0000 mgr.a (mgr.14388) 4311 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:58.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:57 smithi163 bash[24253]: audit 2024-08-31T03:50:56.861875+0000 mon.a (mon.0) 1234 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:50:58.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:57 smithi163 bash[24253]: audit 2024-08-31T03:50:57.439539+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:50:58.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:57 smithi163 bash[24253]: audit 2024-08-31T03:50:57.445375+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:50:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:57 smithi027 bash[22610]: audit 2024-08-31T03:50:56.717640+0000 mgr.a (mgr.14388) 4310 : audit [DBG] from='client.103596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:57 smithi027 bash[22610]: cluster 2024-08-31T03:50:56.781083+0000 mgr.a (mgr.14388) 4311 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:57 smithi027 bash[22610]: audit 2024-08-31T03:50:56.861875+0000 mon.a (mon.0) 1234 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:50:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:57 smithi027 bash[22610]: audit 2024-08-31T03:50:57.439539+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:50:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:57 smithi027 bash[22610]: audit 2024-08-31T03:50:57.445375+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:50:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:57 smithi191 bash[24992]: audit 2024-08-31T03:50:56.717640+0000 mgr.a (mgr.14388) 4310 : audit [DBG] from='client.103596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:50:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:57 smithi191 bash[24992]: cluster 2024-08-31T03:50:56.781083+0000 mgr.a (mgr.14388) 4311 : cluster [DBG] pgmap v2988: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:50:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:57 smithi191 bash[24992]: audit 2024-08-31T03:50:56.861875+0000 mon.a (mon.0) 1234 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:50:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:57 smithi191 bash[24992]: audit 2024-08-31T03:50:57.439539+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:50:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:57 smithi191 bash[24992]: audit 2024-08-31T03:50:57.445375+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:50:59.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:58 smithi163 bash[24253]: audit 2024-08-31T03:50:58.196336+0000 mon.a (mon.0) 1237 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:50:59.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:58 smithi163 bash[24253]: audit 2024-08-31T03:50:58.198200+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:50:59.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:58 smithi163 bash[24253]: audit 2024-08-31T03:50:58.210172+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:50:59.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:58 smithi163 bash[24253]: audit 2024-08-31T03:50:58.214972+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:50:59.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:50:58 smithi027 bash[22863]: debug 2024-08-31T03:50:58.916+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:50:59.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:50:58 smithi027 bash[22863]: debug 2024-08-31T03:50:58.916+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:50:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:58 smithi027 bash[22610]: audit 2024-08-31T03:50:58.196336+0000 mon.a (mon.0) 1237 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:50:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:58 smithi027 bash[22610]: audit 2024-08-31T03:50:58.198200+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:50:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:58 smithi027 bash[22610]: audit 2024-08-31T03:50:58.210172+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:50:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:58 smithi027 bash[22610]: audit 2024-08-31T03:50:58.214972+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:50:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:58 smithi191 bash[24992]: audit 2024-08-31T03:50:58.196336+0000 mon.a (mon.0) 1237 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:50:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:58 smithi191 bash[24992]: audit 2024-08-31T03:50:58.198200+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:50:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:58 smithi191 bash[24992]: audit 2024-08-31T03:50:58.210172+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:50:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:58 smithi191 bash[24992]: audit 2024-08-31T03:50:58.214972+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:51:00.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:59 smithi163 bash[24253]: audit 2024-08-31T03:50:58.216326+0000 mgr.a (mgr.14388) 4312 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:51:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:59 smithi163 bash[24253]: cluster 2024-08-31T03:50:58.782218+0000 mgr.a (mgr.14388) 4313 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:59 smithi163 bash[24253]: audit 2024-08-31T03:50:58.920095+0000 mgr.a (mgr.14388) 4314 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:51:00.194 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:50:59 smithi163 bash[24253]: cephadm 2024-08-31T03:50:58.921637+0000 mgr.a (mgr.14388) 4315 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:51:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:59 smithi027 bash[22610]: audit 2024-08-31T03:50:58.216326+0000 mgr.a (mgr.14388) 4312 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:51:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:59 smithi027 bash[22610]: cluster 2024-08-31T03:50:58.782218+0000 mgr.a (mgr.14388) 4313 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:59 smithi027 bash[22610]: audit 2024-08-31T03:50:58.920095+0000 mgr.a (mgr.14388) 4314 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:51:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:50:59 smithi027 bash[22610]: cephadm 2024-08-31T03:50:58.921637+0000 mgr.a (mgr.14388) 4315 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:51:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:59 smithi191 bash[24992]: audit 2024-08-31T03:50:58.216326+0000 mgr.a (mgr.14388) 4312 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:51:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:59 smithi191 bash[24992]: cluster 2024-08-31T03:50:58.782218+0000 mgr.a (mgr.14388) 4313 : cluster [DBG] pgmap v2989: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:59 smithi191 bash[24992]: audit 2024-08-31T03:50:58.920095+0000 mgr.a (mgr.14388) 4314 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:51:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:50:59 smithi191 bash[24992]: cephadm 2024-08-31T03:50:58.921637+0000 mgr.a (mgr.14388) 4315 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:51:02.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:02.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:02.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:51:02.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:01 smithi163 bash[24253]: cluster 2024-08-31T03:51:00.782973+0000 mgr.a (mgr.14388) 4316 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:01 smithi027 bash[22610]: cluster 2024-08-31T03:51:00.782973+0000 mgr.a (mgr.14388) 4316 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:01 smithi191 bash[24992]: cluster 2024-08-31T03:51:00.782973+0000 mgr.a (mgr.14388) 4316 : cluster [DBG] pgmap v2990: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:02.910 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:51:02.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:51:02.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:51:02.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:51:02.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:51:04.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:03 smithi163 bash[24253]: audit 2024-08-31T03:51:02.501697+0000 mgr.a (mgr.14388) 4317 : audit [DBG] from='client.103779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:04.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:03 smithi163 bash[24253]: cluster 2024-08-31T03:51:02.783511+0000 mgr.a (mgr.14388) 4318 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:03 smithi027 bash[22610]: audit 2024-08-31T03:51:02.501697+0000 mgr.a (mgr.14388) 4317 : audit [DBG] from='client.103779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:03 smithi027 bash[22610]: cluster 2024-08-31T03:51:02.783511+0000 mgr.a (mgr.14388) 4318 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:03 smithi191 bash[24992]: audit 2024-08-31T03:51:02.501697+0000 mgr.a (mgr.14388) 4317 : audit [DBG] from='client.103779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:03 smithi191 bash[24992]: cluster 2024-08-31T03:51:02.783511+0000 mgr.a (mgr.14388) 4318 : cluster [DBG] pgmap v2991: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:06.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:05 smithi163 bash[24253]: cluster 2024-08-31T03:51:04.785814+0000 mgr.a (mgr.14388) 4319 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:05 smithi027 bash[22610]: cluster 2024-08-31T03:51:04.785814+0000 mgr.a (mgr.14388) 4319 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:05 smithi191 bash[24992]: cluster 2024-08-31T03:51:04.785814+0000 mgr.a (mgr.14388) 4319 : cluster [DBG] pgmap v2992: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:07.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:07.913 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:07.913 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:51:08.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:07 smithi163 bash[24253]: cluster 2024-08-31T03:51:06.786712+0000 mgr.a (mgr.14388) 4320 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:07 smithi027 bash[22610]: cluster 2024-08-31T03:51:06.786712+0000 mgr.a (mgr.14388) 4320 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:07 smithi191 bash[24992]: cluster 2024-08-31T03:51:06.786712+0000 mgr.a (mgr.14388) 4320 : cluster [DBG] pgmap v2993: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:08.661 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:51:08.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:51:08.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:51:08.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:51:08.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:51:10.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:09 smithi163 bash[24253]: audit 2024-08-31T03:51:08.238484+0000 mgr.a (mgr.14388) 4321 : audit [DBG] from='client.103851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:10.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:09 smithi163 bash[24253]: cluster 2024-08-31T03:51:08.789397+0000 mgr.a (mgr.14388) 4322 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:09 smithi027 bash[22610]: audit 2024-08-31T03:51:08.238484+0000 mgr.a (mgr.14388) 4321 : audit [DBG] from='client.103851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:09 smithi027 bash[22610]: cluster 2024-08-31T03:51:08.789397+0000 mgr.a (mgr.14388) 4322 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:09 smithi191 bash[24992]: audit 2024-08-31T03:51:08.238484+0000 mgr.a (mgr.14388) 4321 : audit [DBG] from='client.103851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:09 smithi191 bash[24992]: cluster 2024-08-31T03:51:08.789397+0000 mgr.a (mgr.14388) 4322 : cluster [DBG] pgmap v2994: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:12.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:11 smithi163 bash[24253]: cluster 2024-08-31T03:51:10.790202+0000 mgr.a (mgr.14388) 4323 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:51:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:11 smithi027 bash[22610]: cluster 2024-08-31T03:51:10.790202+0000 mgr.a (mgr.14388) 4323 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:51:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:11 smithi191 bash[24992]: cluster 2024-08-31T03:51:10.790202+0000 mgr.a (mgr.14388) 4323 : cluster [DBG] pgmap v2995: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:51:13.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:13.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:13.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:51:14.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:13 smithi163 bash[24253]: cluster 2024-08-31T03:51:12.790967+0000 mgr.a (mgr.14388) 4324 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:51:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:13 smithi027 bash[22610]: cluster 2024-08-31T03:51:12.790967+0000 mgr.a (mgr.14388) 4324 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:51:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:13 smithi191 bash[24992]: cluster 2024-08-31T03:51:12.790967+0000 mgr.a (mgr.14388) 4324 : cluster [DBG] pgmap v2996: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:51:14.452 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:51:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:51:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:51:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:51:14.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:51:15.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:14 smithi163 bash[24253]: audit 2024-08-31T03:51:14.007882+0000 mgr.a (mgr.14388) 4325 : audit [DBG] from='client.103926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:14 smithi027 bash[22610]: audit 2024-08-31T03:51:14.007882+0000 mgr.a (mgr.14388) 4325 : audit [DBG] from='client.103926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:14 smithi191 bash[24992]: audit 2024-08-31T03:51:14.007882+0000 mgr.a (mgr.14388) 4325 : audit [DBG] from='client.103926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:16.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:15 smithi163 bash[24253]: cluster 2024-08-31T03:51:14.793762+0000 mgr.a (mgr.14388) 4326 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:15 smithi027 bash[22610]: cluster 2024-08-31T03:51:14.793762+0000 mgr.a (mgr.14388) 4326 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:15 smithi191 bash[24992]: cluster 2024-08-31T03:51:14.793762+0000 mgr.a (mgr.14388) 4326 : cluster [DBG] pgmap v2997: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:51:18.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:17 smithi163 bash[24253]: cluster 2024-08-31T03:51:16.794553+0000 mgr.a (mgr.14388) 4327 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:17 smithi027 bash[22610]: cluster 2024-08-31T03:51:16.794553+0000 mgr.a (mgr.14388) 4327 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:17 smithi191 bash[24992]: cluster 2024-08-31T03:51:16.794553+0000 mgr.a (mgr.14388) 4327 : cluster [DBG] pgmap v2998: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:19.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:19.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:19.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:51:20.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:19 smithi163 bash[24253]: cluster 2024-08-31T03:51:18.796508+0000 mgr.a (mgr.14388) 4328 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:20.207 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:51:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:51:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:51:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:51:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:51:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:19 smithi027 bash[22610]: cluster 2024-08-31T03:51:18.796508+0000 mgr.a (mgr.14388) 4328 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:19 smithi191 bash[24992]: cluster 2024-08-31T03:51:18.796508+0000 mgr.a (mgr.14388) 4328 : cluster [DBG] pgmap v2999: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:21.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:20 smithi163 bash[24253]: audit 2024-08-31T03:51:19.786877+0000 mgr.a (mgr.14388) 4329 : audit [DBG] from='client.104001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:20 smithi027 bash[22610]: audit 2024-08-31T03:51:19.786877+0000 mgr.a (mgr.14388) 4329 : audit [DBG] from='client.104001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:20 smithi191 bash[24992]: audit 2024-08-31T03:51:19.786877+0000 mgr.a (mgr.14388) 4329 : audit [DBG] from='client.104001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:22.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:21 smithi163 bash[24253]: cluster 2024-08-31T03:51:20.797392+0000 mgr.a (mgr.14388) 4330 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:21 smithi027 bash[22610]: cluster 2024-08-31T03:51:20.797392+0000 mgr.a (mgr.14388) 4330 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:21 smithi191 bash[24992]: cluster 2024-08-31T03:51:20.797392+0000 mgr.a (mgr.14388) 4330 : cluster [DBG] pgmap v3000: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:24.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:23 smithi163 bash[24253]: cluster 2024-08-31T03:51:22.798176+0000 mgr.a (mgr.14388) 4331 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:23 smithi027 bash[22610]: cluster 2024-08-31T03:51:22.798176+0000 mgr.a (mgr.14388) 4331 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:23 smithi191 bash[24992]: cluster 2024-08-31T03:51:22.798176+0000 mgr.a (mgr.14388) 4331 : cluster [DBG] pgmap v3001: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:25.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:25.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:25.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:51:25.956 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:51:25.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:51:25.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:51:25.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:51:25.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:51:26.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:25 smithi163 bash[24253]: cluster 2024-08-31T03:51:24.800427+0000 mgr.a (mgr.14388) 4332 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:25 smithi027 bash[22610]: cluster 2024-08-31T03:51:24.800427+0000 mgr.a (mgr.14388) 4332 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:25 smithi191 bash[24992]: cluster 2024-08-31T03:51:24.800427+0000 mgr.a (mgr.14388) 4332 : cluster [DBG] pgmap v3002: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:27.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:26 smithi163 bash[24253]: audit 2024-08-31T03:51:25.539298+0000 mgr.a (mgr.14388) 4333 : audit [DBG] from='client.104079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:26 smithi027 bash[22610]: audit 2024-08-31T03:51:25.539298+0000 mgr.a (mgr.14388) 4333 : audit [DBG] from='client.104079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:26 smithi191 bash[24992]: audit 2024-08-31T03:51:25.539298+0000 mgr.a (mgr.14388) 4333 : audit [DBG] from='client.104079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:28.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:27 smithi163 bash[24253]: cluster 2024-08-31T03:51:26.801329+0000 mgr.a (mgr.14388) 4334 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:27 smithi027 bash[22610]: cluster 2024-08-31T03:51:26.801329+0000 mgr.a (mgr.14388) 4334 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:27 smithi191 bash[24992]: cluster 2024-08-31T03:51:26.801329+0000 mgr.a (mgr.14388) 4334 : cluster [DBG] pgmap v3003: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:30.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:29 smithi163 bash[24253]: cluster 2024-08-31T03:51:28.803513+0000 mgr.a (mgr.14388) 4335 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:29 smithi027 bash[22610]: cluster 2024-08-31T03:51:28.803513+0000 mgr.a (mgr.14388) 4335 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:29 smithi191 bash[24992]: cluster 2024-08-31T03:51:28.803513+0000 mgr.a (mgr.14388) 4335 : cluster [DBG] pgmap v3004: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:30.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:30.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:30.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:51:31.708 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:51:31.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:51:31.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:51:31.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:51:31.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:51:32.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:31 smithi163 bash[24253]: cluster 2024-08-31T03:51:30.804275+0000 mgr.a (mgr.14388) 4336 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:31 smithi027 bash[22610]: cluster 2024-08-31T03:51:30.804275+0000 mgr.a (mgr.14388) 4336 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:31 smithi191 bash[24992]: cluster 2024-08-31T03:51:30.804275+0000 mgr.a (mgr.14388) 4336 : cluster [DBG] pgmap v3005: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:33.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:32 smithi163 bash[24253]: audit 2024-08-31T03:51:31.287286+0000 mgr.a (mgr.14388) 4337 : audit [DBG] from='client.104154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:32 smithi027 bash[22610]: audit 2024-08-31T03:51:31.287286+0000 mgr.a (mgr.14388) 4337 : audit [DBG] from='client.104154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:32 smithi191 bash[24992]: audit 2024-08-31T03:51:31.287286+0000 mgr.a (mgr.14388) 4337 : audit [DBG] from='client.104154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:34.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:33 smithi163 bash[24253]: cluster 2024-08-31T03:51:32.805150+0000 mgr.a (mgr.14388) 4338 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:33 smithi027 bash[22610]: cluster 2024-08-31T03:51:32.805150+0000 mgr.a (mgr.14388) 4338 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:33 smithi191 bash[24992]: cluster 2024-08-31T03:51:32.805150+0000 mgr.a (mgr.14388) 4338 : cluster [DBG] pgmap v3006: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:35 smithi027 bash[22610]: cluster 2024-08-31T03:51:34.807353+0000 mgr.a (mgr.14388) 4339 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:35 smithi191 bash[24992]: cluster 2024-08-31T03:51:34.807353+0000 mgr.a (mgr.14388) 4339 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:36.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:35 smithi163 bash[24253]: cluster 2024-08-31T03:51:34.807353+0000 mgr.a (mgr.14388) 4339 : cluster [DBG] pgmap v3007: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:36.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:36.711 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:36.711 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:51:37.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:51:37.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:51:37.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:51:37.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:51:37.491 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:51:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:37 smithi027 bash[22610]: cluster 2024-08-31T03:51:36.807986+0000 mgr.a (mgr.14388) 4340 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:37 smithi027 bash[22610]: audit 2024-08-31T03:51:37.046575+0000 mgr.a (mgr.14388) 4341 : audit [DBG] from='client.104229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:37 smithi191 bash[24992]: cluster 2024-08-31T03:51:36.807986+0000 mgr.a (mgr.14388) 4340 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:37 smithi191 bash[24992]: audit 2024-08-31T03:51:37.046575+0000 mgr.a (mgr.14388) 4341 : audit [DBG] from='client.104229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:38.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:37 smithi163 bash[24253]: cluster 2024-08-31T03:51:36.807986+0000 mgr.a (mgr.14388) 4340 : cluster [DBG] pgmap v3008: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:38.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:37 smithi163 bash[24253]: audit 2024-08-31T03:51:37.046575+0000 mgr.a (mgr.14388) 4341 : audit [DBG] from='client.104229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:39 smithi027 bash[22610]: cluster 2024-08-31T03:51:38.810227+0000 mgr.a (mgr.14388) 4342 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:39 smithi191 bash[24992]: cluster 2024-08-31T03:51:38.810227+0000 mgr.a (mgr.14388) 4342 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:40.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:39 smithi163 bash[24253]: cluster 2024-08-31T03:51:38.810227+0000 mgr.a (mgr.14388) 4342 : cluster [DBG] pgmap v3009: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:51:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:41 smithi027 bash[22610]: cluster 2024-08-31T03:51:40.811013+0000 mgr.a (mgr.14388) 4343 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:41 smithi191 bash[24992]: cluster 2024-08-31T03:51:40.811013+0000 mgr.a (mgr.14388) 4343 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:42.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:41 smithi163 bash[24253]: cluster 2024-08-31T03:51:40.811013+0000 mgr.a (mgr.14388) 4343 : cluster [DBG] pgmap v3010: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:42.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:51:43.278 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:51:43.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:51:43.279 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:51:43.279 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:51:43.279 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:51:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:43 smithi027 bash[22610]: cluster 2024-08-31T03:51:42.811691+0000 mgr.a (mgr.14388) 4344 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:43 smithi027 bash[22610]: audit 2024-08-31T03:51:42.834619+0000 mgr.a (mgr.14388) 4345 : audit [DBG] from='client.104301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:43 smithi191 bash[24992]: cluster 2024-08-31T03:51:42.811691+0000 mgr.a (mgr.14388) 4344 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:43 smithi191 bash[24992]: audit 2024-08-31T03:51:42.834619+0000 mgr.a (mgr.14388) 4345 : audit [DBG] from='client.104301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:44.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:43 smithi163 bash[24253]: cluster 2024-08-31T03:51:42.811691+0000 mgr.a (mgr.14388) 4344 : cluster [DBG] pgmap v3011: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:44.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:43 smithi163 bash[24253]: audit 2024-08-31T03:51:42.834619+0000 mgr.a (mgr.14388) 4345 : audit [DBG] from='client.104301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:45 smithi027 bash[22610]: cluster 2024-08-31T03:51:44.814867+0000 mgr.a (mgr.14388) 4346 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:45 smithi191 bash[24992]: cluster 2024-08-31T03:51:44.814867+0000 mgr.a (mgr.14388) 4346 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:46.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:45 smithi163 bash[24253]: cluster 2024-08-31T03:51:44.814867+0000 mgr.a (mgr.14388) 4346 : cluster [DBG] pgmap v3012: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:47 smithi027 bash[22610]: cluster 2024-08-31T03:51:46.815691+0000 mgr.a (mgr.14388) 4347 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:48.280 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:48.281 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:51:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:47 smithi191 bash[24992]: cluster 2024-08-31T03:51:46.815691+0000 mgr.a (mgr.14388) 4347 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:48.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:47 smithi163 bash[24253]: cluster 2024-08-31T03:51:46.815691+0000 mgr.a (mgr.14388) 4347 : cluster [DBG] pgmap v3013: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:49.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:51:49.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:51:49.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:51:49.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:51:49.015 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:51:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:49 smithi027 bash[22610]: audit 2024-08-31T03:51:48.610862+0000 mgr.a (mgr.14388) 4348 : audit [DBG] from='client.104379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:49 smithi027 bash[22610]: cluster 2024-08-31T03:51:48.825367+0000 mgr.a (mgr.14388) 4349 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:49 smithi191 bash[24992]: audit 2024-08-31T03:51:48.610862+0000 mgr.a (mgr.14388) 4348 : audit [DBG] from='client.104379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:49 smithi191 bash[24992]: cluster 2024-08-31T03:51:48.825367+0000 mgr.a (mgr.14388) 4349 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:50.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:49 smithi163 bash[24253]: audit 2024-08-31T03:51:48.610862+0000 mgr.a (mgr.14388) 4348 : audit [DBG] from='client.104379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:50.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:49 smithi163 bash[24253]: cluster 2024-08-31T03:51:48.825367+0000 mgr.a (mgr.14388) 4349 : cluster [DBG] pgmap v3014: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:51 smithi027 bash[22610]: cluster 2024-08-31T03:51:50.826228+0000 mgr.a (mgr.14388) 4350 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:51 smithi191 bash[24992]: cluster 2024-08-31T03:51:50.826228+0000 mgr.a (mgr.14388) 4350 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:52.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:51 smithi163 bash[24253]: cluster 2024-08-31T03:51:50.826228+0000 mgr.a (mgr.14388) 4350 : cluster [DBG] pgmap v3015: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:54.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:54.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:54.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:51:54.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:53 smithi027 bash[22610]: cluster 2024-08-31T03:51:52.827010+0000 mgr.a (mgr.14388) 4351 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:53 smithi191 bash[24992]: cluster 2024-08-31T03:51:52.827010+0000 mgr.a (mgr.14388) 4351 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:54.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:53 smithi163 bash[24253]: cluster 2024-08-31T03:51:52.827010+0000 mgr.a (mgr.14388) 4351 : cluster [DBG] pgmap v3016: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:51:54.753 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:51:54.753 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:51:54.753 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:51:54.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:51:54.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:51:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:55 smithi191 bash[24992]: audit 2024-08-31T03:51:54.347304+0000 mgr.a (mgr.14388) 4352 : audit [DBG] from='client.104454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:55 smithi191 bash[24992]: cluster 2024-08-31T03:51:54.828183+0000 mgr.a (mgr.14388) 4353 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:56.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:55 smithi163 bash[24253]: audit 2024-08-31T03:51:54.347304+0000 mgr.a (mgr.14388) 4352 : audit [DBG] from='client.104454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:56.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:55 smithi163 bash[24253]: cluster 2024-08-31T03:51:54.828183+0000 mgr.a (mgr.14388) 4353 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:55 smithi027 bash[22610]: audit 2024-08-31T03:51:54.347304+0000 mgr.a (mgr.14388) 4352 : audit [DBG] from='client.104454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:51:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:55 smithi027 bash[22610]: cluster 2024-08-31T03:51:54.828183+0000 mgr.a (mgr.14388) 4353 : cluster [DBG] pgmap v3017: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:57 smithi191 bash[24992]: cluster 2024-08-31T03:51:56.828880+0000 mgr.a (mgr.14388) 4354 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:58.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:57 smithi163 bash[24253]: cluster 2024-08-31T03:51:56.828880+0000 mgr.a (mgr.14388) 4354 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:57 smithi027 bash[22610]: cluster 2024-08-31T03:51:56.828880+0000 mgr.a (mgr.14388) 4354 : cluster [DBG] pgmap v3018: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:51:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:51:59 smithi191 bash[24992]: audit 2024-08-31T03:51:58.981199+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:51:59.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:51:59 smithi163 bash[24253]: audit 2024-08-31T03:51:58.981199+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:51:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:51:59 smithi027 bash[22610]: audit 2024-08-31T03:51:58.981199+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:51:59.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:51:59.755 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:51:59.755 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:00 smithi191 bash[24992]: cluster 2024-08-31T03:51:58.830816+0000 mgr.a (mgr.14388) 4355 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:00 smithi191 bash[24992]: audit 2024-08-31T03:51:59.626122+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:00 smithi191 bash[24992]: audit 2024-08-31T03:51:59.631791+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:00 smithi191 bash[24992]: audit 2024-08-31T03:51:59.640019+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:00 smithi191 bash[24992]: audit 2024-08-31T03:51:59.644905+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:00 smithi163 bash[24253]: cluster 2024-08-31T03:51:58.830816+0000 mgr.a (mgr.14388) 4355 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:00.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:00 smithi163 bash[24253]: audit 2024-08-31T03:51:59.626122+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:00 smithi163 bash[24253]: audit 2024-08-31T03:51:59.631791+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:00 smithi163 bash[24253]: audit 2024-08-31T03:51:59.640019+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:00 smithi163 bash[24253]: audit 2024-08-31T03:51:59.644905+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:00 smithi027 bash[22610]: cluster 2024-08-31T03:51:58.830816+0000 mgr.a (mgr.14388) 4355 : cluster [DBG] pgmap v3019: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:00 smithi027 bash[22610]: audit 2024-08-31T03:51:59.626122+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:00 smithi027 bash[22610]: audit 2024-08-31T03:51:59.631791+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:00 smithi027 bash[22610]: audit 2024-08-31T03:51:59.640019+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:00 smithi027 bash[22610]: audit 2024-08-31T03:51:59.644905+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:00.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:00.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:00.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:00.484 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:01 smithi191 bash[24992]: audit 2024-08-31T03:52:00.422711+0000 mon.a (mon.0) 1246 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:52:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:01 smithi191 bash[24992]: audit 2024-08-31T03:52:00.423706+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:52:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:01 smithi191 bash[24992]: audit 2024-08-31T03:52:00.431033+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:01 smithi191 bash[24992]: audit 2024-08-31T03:52:00.433290+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:52:01.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:01 smithi163 bash[24253]: audit 2024-08-31T03:52:00.422711+0000 mon.a (mon.0) 1246 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:52:01.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:01 smithi163 bash[24253]: audit 2024-08-31T03:52:00.423706+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:52:01.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:01 smithi163 bash[24253]: audit 2024-08-31T03:52:00.431033+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:01.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:01 smithi163 bash[24253]: audit 2024-08-31T03:52:00.433290+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:52:01.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:52:01 smithi027 bash[22863]: debug 2024-08-31T03:52:01.159+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:52:01.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:52:01 smithi027 bash[22863]: debug 2024-08-31T03:52:01.159+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:52:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:01 smithi027 bash[22610]: audit 2024-08-31T03:52:00.422711+0000 mon.a (mon.0) 1246 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:52:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:01 smithi027 bash[22610]: audit 2024-08-31T03:52:00.423706+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:52:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:01 smithi027 bash[22610]: audit 2024-08-31T03:52:00.431033+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:52:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:01 smithi027 bash[22610]: audit 2024-08-31T03:52:00.433290+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:52:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:02 smithi191 bash[24992]: audit 2024-08-31T03:52:00.068034+0000 mgr.a (mgr.14388) 4356 : audit [DBG] from='client.104532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:02 smithi191 bash[24992]: audit 2024-08-31T03:52:00.434500+0000 mgr.a (mgr.14388) 4357 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:52:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:02 smithi191 bash[24992]: cluster 2024-08-31T03:52:00.831357+0000 mgr.a (mgr.14388) 4358 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:02.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:02 smithi163 bash[24253]: audit 2024-08-31T03:52:00.068034+0000 mgr.a (mgr.14388) 4356 : audit [DBG] from='client.104532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:02.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:02 smithi163 bash[24253]: audit 2024-08-31T03:52:00.434500+0000 mgr.a (mgr.14388) 4357 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:52:02.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:02 smithi163 bash[24253]: cluster 2024-08-31T03:52:00.831357+0000 mgr.a (mgr.14388) 4358 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:02 smithi027 bash[22610]: audit 2024-08-31T03:52:00.068034+0000 mgr.a (mgr.14388) 4356 : audit [DBG] from='client.104532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:02 smithi027 bash[22610]: audit 2024-08-31T03:52:00.434500+0000 mgr.a (mgr.14388) 4357 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:52:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:02 smithi027 bash[22610]: cluster 2024-08-31T03:52:00.831357+0000 mgr.a (mgr.14388) 4358 : cluster [DBG] pgmap v3020: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:03 smithi191 bash[24992]: audit 2024-08-31T03:52:01.162980+0000 mgr.a (mgr.14388) 4359 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:52:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:03 smithi191 bash[24992]: cephadm 2024-08-31T03:52:01.164117+0000 mgr.a (mgr.14388) 4360 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:52:03.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:03 smithi163 bash[24253]: audit 2024-08-31T03:52:01.162980+0000 mgr.a (mgr.14388) 4359 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:52:03.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:03 smithi163 bash[24253]: cephadm 2024-08-31T03:52:01.164117+0000 mgr.a (mgr.14388) 4360 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:52:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:03 smithi027 bash[22610]: audit 2024-08-31T03:52:01.162980+0000 mgr.a (mgr.14388) 4359 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:52:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:03 smithi027 bash[22610]: cephadm 2024-08-31T03:52:01.164117+0000 mgr.a (mgr.14388) 4360 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:52:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:04 smithi191 bash[24992]: cluster 2024-08-31T03:52:02.832334+0000 mgr.a (mgr.14388) 4361 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:04.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:04 smithi163 bash[24253]: cluster 2024-08-31T03:52:02.832334+0000 mgr.a (mgr.14388) 4361 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:04 smithi027 bash[22610]: cluster 2024-08-31T03:52:02.832334+0000 mgr.a (mgr.14388) 4361 : cluster [DBG] pgmap v3021: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:52:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:52:05.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:06.260 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:06.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:06.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:06.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:06.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:06 smithi191 bash[24992]: cluster 2024-08-31T03:52:04.834556+0000 mgr.a (mgr.14388) 4362 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:06.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:06 smithi163 bash[24253]: cluster 2024-08-31T03:52:04.834556+0000 mgr.a (mgr.14388) 4362 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:06 smithi027 bash[22610]: cluster 2024-08-31T03:52:04.834556+0000 mgr.a (mgr.14388) 4362 : cluster [DBG] pgmap v3022: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:07 smithi191 bash[24992]: audit 2024-08-31T03:52:05.818555+0000 mgr.a (mgr.14388) 4363 : audit [DBG] from='client.104706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:07.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:07 smithi163 bash[24253]: audit 2024-08-31T03:52:05.818555+0000 mgr.a (mgr.14388) 4363 : audit [DBG] from='client.104706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:07 smithi027 bash[22610]: audit 2024-08-31T03:52:05.818555+0000 mgr.a (mgr.14388) 4363 : audit [DBG] from='client.104706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:08 smithi191 bash[24992]: cluster 2024-08-31T03:52:06.835588+0000 mgr.a (mgr.14388) 4364 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:08.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:08 smithi163 bash[24253]: cluster 2024-08-31T03:52:06.835588+0000 mgr.a (mgr.14388) 4364 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:08 smithi027 bash[22610]: cluster 2024-08-31T03:52:06.835588+0000 mgr.a (mgr.14388) 4364 : cluster [DBG] pgmap v3023: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:10 smithi191 bash[24992]: cluster 2024-08-31T03:52:08.837813+0000 mgr.a (mgr.14388) 4365 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:10.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:10 smithi163 bash[24253]: cluster 2024-08-31T03:52:08.837813+0000 mgr.a (mgr.14388) 4365 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:10 smithi027 bash[22610]: cluster 2024-08-31T03:52:08.837813+0000 mgr.a (mgr.14388) 4365 : cluster [DBG] pgmap v3024: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:11.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:52:11.262 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:52:11.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:12.023 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:12.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:12.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:12.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:12.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:12.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:12 smithi163 bash[24253]: cluster 2024-08-31T03:52:10.838575+0000 mgr.a (mgr.14388) 4366 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:12 smithi027 bash[22610]: cluster 2024-08-31T03:52:10.838575+0000 mgr.a (mgr.14388) 4366 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:12 smithi191 bash[24992]: cluster 2024-08-31T03:52:10.838575+0000 mgr.a (mgr.14388) 4366 : cluster [DBG] pgmap v3025: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:13.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:13 smithi163 bash[24253]: audit 2024-08-31T03:52:11.598958+0000 mgr.a (mgr.14388) 4367 : audit [DBG] from='client.104784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:13 smithi027 bash[22610]: audit 2024-08-31T03:52:11.598958+0000 mgr.a (mgr.14388) 4367 : audit [DBG] from='client.104784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:13 smithi191 bash[24992]: audit 2024-08-31T03:52:11.598958+0000 mgr.a (mgr.14388) 4367 : audit [DBG] from='client.104784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:14.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:14 smithi163 bash[24253]: cluster 2024-08-31T03:52:12.839465+0000 mgr.a (mgr.14388) 4368 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:14 smithi027 bash[22610]: cluster 2024-08-31T03:52:12.839465+0000 mgr.a (mgr.14388) 4368 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:14 smithi191 bash[24992]: cluster 2024-08-31T03:52:12.839465+0000 mgr.a (mgr.14388) 4368 : cluster [DBG] pgmap v3026: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:16.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:16 smithi163 bash[24253]: cluster 2024-08-31T03:52:14.841628+0000 mgr.a (mgr.14388) 4369 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:16 smithi027 bash[22610]: cluster 2024-08-31T03:52:14.841628+0000 mgr.a (mgr.14388) 4369 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:16 smithi191 bash[24992]: cluster 2024-08-31T03:52:14.841628+0000 mgr.a (mgr.14388) 4369 : cluster [DBG] pgmap v3027: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:52:17.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:52:17.026 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:52:17.026 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:17.770 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:17.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:17.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:17.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:17.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:18.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:18 smithi163 bash[24253]: cluster 2024-08-31T03:52:16.842390+0000 mgr.a (mgr.14388) 4370 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:18 smithi027 bash[22610]: cluster 2024-08-31T03:52:16.842390+0000 mgr.a (mgr.14388) 4370 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:18 smithi191 bash[24992]: cluster 2024-08-31T03:52:16.842390+0000 mgr.a (mgr.14388) 4370 : cluster [DBG] pgmap v3028: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:19.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:19 smithi163 bash[24253]: audit 2024-08-31T03:52:17.359100+0000 mgr.a (mgr.14388) 4371 : audit [DBG] from='client.104862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:19 smithi027 bash[22610]: audit 2024-08-31T03:52:17.359100+0000 mgr.a (mgr.14388) 4371 : audit [DBG] from='client.104862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:19 smithi191 bash[24992]: audit 2024-08-31T03:52:17.359100+0000 mgr.a (mgr.14388) 4371 : audit [DBG] from='client.104862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:20.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:20 smithi163 bash[24253]: cluster 2024-08-31T03:52:18.844771+0000 mgr.a (mgr.14388) 4372 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:20 smithi027 bash[22610]: cluster 2024-08-31T03:52:18.844771+0000 mgr.a (mgr.14388) 4372 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:20 smithi191 bash[24992]: cluster 2024-08-31T03:52:18.844771+0000 mgr.a (mgr.14388) 4372 : cluster [DBG] pgmap v3029: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:21.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:21 smithi163 bash[24253]: cluster 2024-08-31T03:52:20.845563+0000 mgr.a (mgr.14388) 4373 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:21 smithi027 bash[22610]: cluster 2024-08-31T03:52:20.845563+0000 mgr.a (mgr.14388) 4373 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:21 smithi191 bash[24992]: cluster 2024-08-31T03:52:20.845563+0000 mgr.a (mgr.14388) 4373 : cluster [DBG] pgmap v3030: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:22.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:52:22.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:52:22.773 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:23.511 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:23.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:23.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:23.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:23.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:24.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:23 smithi163 bash[24253]: cluster 2024-08-31T03:52:22.846283+0000 mgr.a (mgr.14388) 4374 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:23 smithi027 bash[22610]: cluster 2024-08-31T03:52:22.846283+0000 mgr.a (mgr.14388) 4374 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:23 smithi191 bash[24992]: cluster 2024-08-31T03:52:22.846283+0000 mgr.a (mgr.14388) 4374 : cluster [DBG] pgmap v3031: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:25.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:24 smithi163 bash[24253]: audit 2024-08-31T03:52:23.104726+0000 mgr.a (mgr.14388) 4375 : audit [DBG] from='client.104937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:25.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:24 smithi027 bash[22610]: audit 2024-08-31T03:52:23.104726+0000 mgr.a (mgr.14388) 4375 : audit [DBG] from='client.104937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:24 smithi191 bash[24992]: audit 2024-08-31T03:52:23.104726+0000 mgr.a (mgr.14388) 4375 : audit [DBG] from='client.104937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:26.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:25 smithi163 bash[24253]: cluster 2024-08-31T03:52:24.849070+0000 mgr.a (mgr.14388) 4376 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:52:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:25 smithi027 bash[22610]: cluster 2024-08-31T03:52:24.849070+0000 mgr.a (mgr.14388) 4376 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:52:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:25 smithi191 bash[24992]: cluster 2024-08-31T03:52:24.849070+0000 mgr.a (mgr.14388) 4376 : cluster [DBG] pgmap v3032: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T03:52:28.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:27 smithi163 bash[24253]: cluster 2024-08-31T03:52:26.849851+0000 mgr.a (mgr.14388) 4377 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T03:52:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:27 smithi027 bash[22610]: cluster 2024-08-31T03:52:26.849851+0000 mgr.a (mgr.14388) 4377 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T03:52:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:27 smithi191 bash[24992]: cluster 2024-08-31T03:52:26.849851+0000 mgr.a (mgr.14388) 4377 : cluster [DBG] pgmap v3033: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T03:52:28.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:52:28.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:52:28.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:29.291 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:29.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:29.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:29.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:29.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:30.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:29 smithi163 bash[24253]: audit 2024-08-31T03:52:28.848199+0000 mgr.a (mgr.14388) 4378 : audit [DBG] from='client.105015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:30.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:29 smithi163 bash[24253]: cluster 2024-08-31T03:52:28.868197+0000 mgr.a (mgr.14388) 4379 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-08-31T03:52:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:29 smithi027 bash[22610]: audit 2024-08-31T03:52:28.848199+0000 mgr.a (mgr.14388) 4378 : audit [DBG] from='client.105015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:29 smithi027 bash[22610]: cluster 2024-08-31T03:52:28.868197+0000 mgr.a (mgr.14388) 4379 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-08-31T03:52:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:29 smithi191 bash[24992]: audit 2024-08-31T03:52:28.848199+0000 mgr.a (mgr.14388) 4378 : audit [DBG] from='client.105015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:29 smithi191 bash[24992]: cluster 2024-08-31T03:52:28.868197+0000 mgr.a (mgr.14388) 4379 : cluster [DBG] pgmap v3034: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-08-31T03:52:32.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:31 smithi163 bash[24253]: cluster 2024-08-31T03:52:30.869148+0000 mgr.a (mgr.14388) 4380 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-08-31T03:52:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:31 smithi027 bash[22610]: cluster 2024-08-31T03:52:30.869148+0000 mgr.a (mgr.14388) 4380 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-08-31T03:52:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:31 smithi191 bash[24992]: cluster 2024-08-31T03:52:30.869148+0000 mgr.a (mgr.14388) 4380 : cluster [DBG] pgmap v3035: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-08-31T03:52:34.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:33 smithi163 bash[24253]: cluster 2024-08-31T03:52:32.869935+0000 mgr.a (mgr.14388) 4381 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-08-31T03:52:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:33 smithi027 bash[22610]: cluster 2024-08-31T03:52:32.869935+0000 mgr.a (mgr.14388) 4381 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-08-31T03:52:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:33 smithi191 bash[24992]: cluster 2024-08-31T03:52:32.869935+0000 mgr.a (mgr.14388) 4381 : cluster [DBG] pgmap v3036: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-08-31T03:52:34.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:52:34.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:52:34.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:35.050 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:35.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:35.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:35.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:35.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:36.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:35 smithi163 bash[24253]: audit 2024-08-31T03:52:34.626363+0000 mgr.a (mgr.14388) 4382 : audit [DBG] from='client.105090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:36.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:35 smithi163 bash[24253]: cluster 2024-08-31T03:52:34.871287+0000 mgr.a (mgr.14388) 4383 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-08-31T03:52:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:35 smithi027 bash[22610]: audit 2024-08-31T03:52:34.626363+0000 mgr.a (mgr.14388) 4382 : audit [DBG] from='client.105090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:35 smithi027 bash[22610]: cluster 2024-08-31T03:52:34.871287+0000 mgr.a (mgr.14388) 4383 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-08-31T03:52:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:35 smithi191 bash[24992]: audit 2024-08-31T03:52:34.626363+0000 mgr.a (mgr.14388) 4382 : audit [DBG] from='client.105090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:35 smithi191 bash[24992]: cluster 2024-08-31T03:52:34.871287+0000 mgr.a (mgr.14388) 4383 : cluster [DBG] pgmap v3037: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-08-31T03:52:38.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:37 smithi163 bash[24253]: cluster 2024-08-31T03:52:36.872159+0000 mgr.a (mgr.14388) 4384 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T03:52:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:37 smithi027 bash[22610]: cluster 2024-08-31T03:52:36.872159+0000 mgr.a (mgr.14388) 4384 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T03:52:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:37 smithi191 bash[24992]: cluster 2024-08-31T03:52:36.872159+0000 mgr.a (mgr.14388) 4384 : cluster [DBG] pgmap v3038: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T03:52:40.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:52:40.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:52:40.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:40.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:39 smithi163 bash[24253]: cluster 2024-08-31T03:52:38.874358+0000 mgr.a (mgr.14388) 4385 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T03:52:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:39 smithi027 bash[22610]: cluster 2024-08-31T03:52:38.874358+0000 mgr.a (mgr.14388) 4385 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T03:52:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:39 smithi191 bash[24992]: cluster 2024-08-31T03:52:38.874358+0000 mgr.a (mgr.14388) 4385 : cluster [DBG] pgmap v3039: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T03:52:40.824 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:40.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:40.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:40.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:40.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:41 smithi027 bash[22610]: audit 2024-08-31T03:52:40.386171+0000 mgr.a (mgr.14388) 4386 : audit [DBG] from='client.105168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:41 smithi027 bash[22610]: cluster 2024-08-31T03:52:40.875064+0000 mgr.a (mgr.14388) 4387 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:41 smithi191 bash[24992]: audit 2024-08-31T03:52:40.386171+0000 mgr.a (mgr.14388) 4386 : audit [DBG] from='client.105168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:41 smithi191 bash[24992]: cluster 2024-08-31T03:52:40.875064+0000 mgr.a (mgr.14388) 4387 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:42.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:41 smithi163 bash[24253]: audit 2024-08-31T03:52:40.386171+0000 mgr.a (mgr.14388) 4386 : audit [DBG] from='client.105168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:42.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:41 smithi163 bash[24253]: cluster 2024-08-31T03:52:40.875064+0000 mgr.a (mgr.14388) 4387 : cluster [DBG] pgmap v3040: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:43 smithi027 bash[22610]: cluster 2024-08-31T03:52:42.875800+0000 mgr.a (mgr.14388) 4388 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:43 smithi191 bash[24992]: cluster 2024-08-31T03:52:42.875800+0000 mgr.a (mgr.14388) 4388 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:44.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:43 smithi163 bash[24253]: cluster 2024-08-31T03:52:42.875800+0000 mgr.a (mgr.14388) 4388 : cluster [DBG] pgmap v3041: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:45.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:52:45.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:52:45.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:45 smithi027 bash[22610]: cluster 2024-08-31T03:52:44.878008+0000 mgr.a (mgr.14388) 4389 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:45 smithi191 bash[24992]: cluster 2024-08-31T03:52:44.878008+0000 mgr.a (mgr.14388) 4389 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:46.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:45 smithi163 bash[24253]: cluster 2024-08-31T03:52:44.878008+0000 mgr.a (mgr.14388) 4389 : cluster [DBG] pgmap v3042: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:46.573 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:46.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:46.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:46.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:46.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:47 smithi027 bash[22610]: audit 2024-08-31T03:52:46.160644+0000 mgr.a (mgr.14388) 4390 : audit [DBG] from='client.105243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:47 smithi027 bash[22610]: cluster 2024-08-31T03:52:46.878959+0000 mgr.a (mgr.14388) 4391 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:47 smithi191 bash[24992]: audit 2024-08-31T03:52:46.160644+0000 mgr.a (mgr.14388) 4390 : audit [DBG] from='client.105243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:47 smithi191 bash[24992]: cluster 2024-08-31T03:52:46.878959+0000 mgr.a (mgr.14388) 4391 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:48.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:47 smithi163 bash[24253]: audit 2024-08-31T03:52:46.160644+0000 mgr.a (mgr.14388) 4390 : audit [DBG] from='client.105243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:48.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:47 smithi163 bash[24253]: cluster 2024-08-31T03:52:46.878959+0000 mgr.a (mgr.14388) 4391 : cluster [DBG] pgmap v3043: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:49 smithi027 bash[22610]: cluster 2024-08-31T03:52:48.881158+0000 mgr.a (mgr.14388) 4392 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:49 smithi191 bash[24992]: cluster 2024-08-31T03:52:48.881158+0000 mgr.a (mgr.14388) 4392 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:50.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:49 smithi163 bash[24253]: cluster 2024-08-31T03:52:48.881158+0000 mgr.a (mgr.14388) 4392 : cluster [DBG] pgmap v3044: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:51.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:52:51.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:52:51.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:51 smithi027 bash[22610]: cluster 2024-08-31T03:52:50.881918+0000 mgr.a (mgr.14388) 4393 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:51 smithi191 bash[24992]: cluster 2024-08-31T03:52:50.881918+0000 mgr.a (mgr.14388) 4393 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:52.320 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:52.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:52.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:52.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:52.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:52.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:51 smithi163 bash[24253]: cluster 2024-08-31T03:52:50.881918+0000 mgr.a (mgr.14388) 4393 : cluster [DBG] pgmap v3045: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:52 smithi027 bash[22610]: audit 2024-08-31T03:52:51.901742+0000 mgr.a (mgr.14388) 4394 : audit [DBG] from='client.105321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:53.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:52 smithi191 bash[24992]: audit 2024-08-31T03:52:51.901742+0000 mgr.a (mgr.14388) 4394 : audit [DBG] from='client.105321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:53.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:52 smithi163 bash[24253]: audit 2024-08-31T03:52:51.901742+0000 mgr.a (mgr.14388) 4394 : audit [DBG] from='client.105321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:53 smithi027 bash[22610]: cluster 2024-08-31T03:52:52.882868+0000 mgr.a (mgr.14388) 4395 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:53 smithi191 bash[24992]: cluster 2024-08-31T03:52:52.882868+0000 mgr.a (mgr.14388) 4395 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:54.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:53 smithi163 bash[24253]: cluster 2024-08-31T03:52:52.882868+0000 mgr.a (mgr.14388) 4395 : cluster [DBG] pgmap v3046: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:55 smithi191 bash[24992]: cluster 2024-08-31T03:52:54.885098+0000 mgr.a (mgr.14388) 4396 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:56.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:55 smithi163 bash[24253]: cluster 2024-08-31T03:52:54.885098+0000 mgr.a (mgr.14388) 4396 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:55 smithi027 bash[22610]: cluster 2024-08-31T03:52:54.885098+0000 mgr.a (mgr.14388) 4396 : cluster [DBG] pgmap v3047: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:52:57.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:52:57.323 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:52:57.323 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:52:58.090 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:52:58.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:52:58.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:52:58.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:52:58.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:52:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:57 smithi191 bash[24992]: cluster 2024-08-31T03:52:56.885879+0000 mgr.a (mgr.14388) 4397 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:58.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:57 smithi163 bash[24253]: cluster 2024-08-31T03:52:56.885879+0000 mgr.a (mgr.14388) 4397 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:57 smithi027 bash[22610]: cluster 2024-08-31T03:52:56.885879+0000 mgr.a (mgr.14388) 4397 : cluster [DBG] pgmap v3048: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:52:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:52:58 smithi191 bash[24992]: audit 2024-08-31T03:52:57.659456+0000 mgr.a (mgr.14388) 4398 : audit [DBG] from='client.105399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:59.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:52:58 smithi163 bash[24253]: audit 2024-08-31T03:52:57.659456+0000 mgr.a (mgr.14388) 4398 : audit [DBG] from='client.105399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:52:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:52:58 smithi027 bash[22610]: audit 2024-08-31T03:52:57.659456+0000 mgr.a (mgr.14388) 4398 : audit [DBG] from='client.105399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:00 smithi191 bash[24992]: cluster 2024-08-31T03:52:58.888317+0000 mgr.a (mgr.14388) 4399 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:53:00.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:00 smithi163 bash[24253]: cluster 2024-08-31T03:52:58.888317+0000 mgr.a (mgr.14388) 4399 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:53:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:00 smithi027 bash[22610]: cluster 2024-08-31T03:52:58.888317+0000 mgr.a (mgr.14388) 4399 : cluster [DBG] pgmap v3049: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:53:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:02 smithi191 bash[24992]: cluster 2024-08-31T03:53:00.889086+0000 mgr.a (mgr.14388) 4400 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:53:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:02 smithi191 bash[24992]: audit 2024-08-31T03:53:01.212897+0000 mon.a (mon.0) 1250 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:53:02.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:02 smithi163 bash[24253]: cluster 2024-08-31T03:53:00.889086+0000 mgr.a (mgr.14388) 4400 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:53:02.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:02 smithi163 bash[24253]: audit 2024-08-31T03:53:01.212897+0000 mon.a (mon.0) 1250 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:53:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:02 smithi027 bash[22610]: cluster 2024-08-31T03:53:00.889086+0000 mgr.a (mgr.14388) 4400 : cluster [DBG] pgmap v3050: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:53:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:02 smithi027 bash[22610]: audit 2024-08-31T03:53:01.212897+0000 mon.a (mon.0) 1250 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:53:03.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:53:03.093 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:53:03.093 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:53:03.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:53:02 smithi027 bash[22863]: debug 2024-08-31T03:53:02.781+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:53:03.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:53:02 smithi027 bash[22863]: debug 2024-08-31T03:53:02.785+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:53:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:03 smithi027 bash[22610]: audit 2024-08-31T03:53:02.055599+0000 mon.a (mon.0) 1251 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:53:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:03 smithi027 bash[22610]: audit 2024-08-31T03:53:02.057015+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:53:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:03 smithi027 bash[22610]: audit 2024-08-31T03:53:02.066921+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:53:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:03 smithi027 bash[22610]: audit 2024-08-31T03:53:02.071855+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:53:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:03 smithi027 bash[22610]: audit 2024-08-31T03:53:02.073270+0000 mgr.a (mgr.14388) 4401 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:53:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:03 smithi191 bash[24992]: audit 2024-08-31T03:53:02.055599+0000 mon.a (mon.0) 1251 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:53:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:03 smithi191 bash[24992]: audit 2024-08-31T03:53:02.057015+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:53:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:03 smithi191 bash[24992]: audit 2024-08-31T03:53:02.066921+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:53:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:03 smithi191 bash[24992]: audit 2024-08-31T03:53:02.071855+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:53:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:03 smithi191 bash[24992]: audit 2024-08-31T03:53:02.073270+0000 mgr.a (mgr.14388) 4401 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:53:03.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:03 smithi163 bash[24253]: audit 2024-08-31T03:53:02.055599+0000 mon.a (mon.0) 1251 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:53:03.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:03 smithi163 bash[24253]: audit 2024-08-31T03:53:02.057015+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:53:03.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:03 smithi163 bash[24253]: audit 2024-08-31T03:53:02.066921+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:53:03.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:03 smithi163 bash[24253]: audit 2024-08-31T03:53:02.071855+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:53:03.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:03 smithi163 bash[24253]: audit 2024-08-31T03:53:02.073270+0000 mgr.a (mgr.14388) 4401 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:53:03.826 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:53:03.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:53:03.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:53:03.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:53:03.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:53:04.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:04 smithi163 bash[24253]: audit 2024-08-31T03:53:02.785559+0000 mgr.a (mgr.14388) 4402 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:53:04.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:04 smithi163 bash[24253]: cephadm 2024-08-31T03:53:02.786948+0000 mgr.a (mgr.14388) 4403 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:53:04.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:04 smithi163 bash[24253]: cluster 2024-08-31T03:53:02.889957+0000 mgr.a (mgr.14388) 4404 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:53:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:04 smithi027 bash[22610]: audit 2024-08-31T03:53:02.785559+0000 mgr.a (mgr.14388) 4402 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:53:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:04 smithi027 bash[22610]: cephadm 2024-08-31T03:53:02.786948+0000 mgr.a (mgr.14388) 4403 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:53:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:04 smithi027 bash[22610]: cluster 2024-08-31T03:53:02.889957+0000 mgr.a (mgr.14388) 4404 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:53:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:04 smithi191 bash[24992]: audit 2024-08-31T03:53:02.785559+0000 mgr.a (mgr.14388) 4402 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:53:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:04 smithi191 bash[24992]: cephadm 2024-08-31T03:53:02.786948+0000 mgr.a (mgr.14388) 4403 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:53:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:04 smithi191 bash[24992]: cluster 2024-08-31T03:53:02.889957+0000 mgr.a (mgr.14388) 4404 : cluster [DBG] pgmap v3051: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:53:05.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:05 smithi163 bash[24253]: audit 2024-08-31T03:53:03.414656+0000 mgr.a (mgr.14388) 4405 : audit [DBG] from='client.105585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:05 smithi027 bash[22610]: audit 2024-08-31T03:53:03.414656+0000 mgr.a (mgr.14388) 4405 : audit [DBG] from='client.105585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:05 smithi191 bash[24992]: audit 2024-08-31T03:53:03.414656+0000 mgr.a (mgr.14388) 4405 : audit [DBG] from='client.105585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:06.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:06 smithi163 bash[24253]: cluster 2024-08-31T03:53:04.892741+0000 mgr.a (mgr.14388) 4406 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:53:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:06 smithi027 bash[22610]: cluster 2024-08-31T03:53:04.892741+0000 mgr.a (mgr.14388) 4406 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:53:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:06 smithi191 bash[24992]: cluster 2024-08-31T03:53:04.892741+0000 mgr.a (mgr.14388) 4406 : cluster [DBG] pgmap v3052: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:53:07.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:07 smithi163 bash[24253]: cluster 2024-08-31T03:53:06.893663+0000 mgr.a (mgr.14388) 4407 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:53:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:07 smithi027 bash[22610]: cluster 2024-08-31T03:53:06.893663+0000 mgr.a (mgr.14388) 4407 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:53:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:07 smithi191 bash[24992]: cluster 2024-08-31T03:53:06.893663+0000 mgr.a (mgr.14388) 4407 : cluster [DBG] pgmap v3053: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:53:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:53:08.828 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:53:08.828 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:53:09.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:53:09.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:53:09.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:53:09.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:53:09.592 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:53:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:09 smithi027 bash[22610]: cluster 2024-08-31T03:53:08.895279+0000 mgr.a (mgr.14388) 4408 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:53:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:09 smithi191 bash[24992]: cluster 2024-08-31T03:53:08.895279+0000 mgr.a (mgr.14388) 4408 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:53:10.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:09 smithi163 bash[24253]: cluster 2024-08-31T03:53:08.895279+0000 mgr.a (mgr.14388) 4408 : cluster [DBG] pgmap v3054: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:53:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:10 smithi027 bash[22610]: audit 2024-08-31T03:53:09.165299+0000 mgr.a (mgr.14388) 4409 : audit [DBG] from='client.105660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:10 smithi191 bash[24992]: audit 2024-08-31T03:53:09.165299+0000 mgr.a (mgr.14388) 4409 : audit [DBG] from='client.105660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:11.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:10 smithi163 bash[24253]: audit 2024-08-31T03:53:09.165299+0000 mgr.a (mgr.14388) 4409 : audit [DBG] from='client.105660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:11 smithi027 bash[22610]: cluster 2024-08-31T03:53:10.896195+0000 mgr.a (mgr.14388) 4410 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:53:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:11 smithi191 bash[24992]: cluster 2024-08-31T03:53:10.896195+0000 mgr.a (mgr.14388) 4410 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:53:12.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:11 smithi163 bash[24253]: cluster 2024-08-31T03:53:10.896195+0000 mgr.a (mgr.14388) 4410 : cluster [DBG] pgmap v3055: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:53:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:13 smithi027 bash[22610]: cluster 2024-08-31T03:53:12.896976+0000 mgr.a (mgr.14388) 4411 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:53:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:13 smithi191 bash[24992]: cluster 2024-08-31T03:53:12.896976+0000 mgr.a (mgr.14388) 4411 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:53:14.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:13 smithi163 bash[24253]: cluster 2024-08-31T03:53:12.896976+0000 mgr.a (mgr.14388) 4411 : cluster [DBG] pgmap v3056: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:53:14.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:53:14.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:53:14.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:53:15.374 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:53:15.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:53:15.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:53:15.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:53:15.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:53:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:15 smithi027 bash[22610]: cluster 2024-08-31T03:53:14.899096+0000 mgr.a (mgr.14388) 4412 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:53:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:15 smithi027 bash[22610]: audit 2024-08-31T03:53:14.935328+0000 mgr.a (mgr.14388) 4413 : audit [DBG] from='client.105735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:15 smithi191 bash[24992]: cluster 2024-08-31T03:53:14.899096+0000 mgr.a (mgr.14388) 4412 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:53:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:15 smithi191 bash[24992]: audit 2024-08-31T03:53:14.935328+0000 mgr.a (mgr.14388) 4413 : audit [DBG] from='client.105735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:16.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:15 smithi163 bash[24253]: cluster 2024-08-31T03:53:14.899096+0000 mgr.a (mgr.14388) 4412 : cluster [DBG] pgmap v3057: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:53:16.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:15 smithi163 bash[24253]: audit 2024-08-31T03:53:14.935328+0000 mgr.a (mgr.14388) 4413 : audit [DBG] from='client.105735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:17 smithi027 bash[22610]: cluster 2024-08-31T03:53:16.899997+0000 mgr.a (mgr.14388) 4414 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:17 smithi191 bash[24992]: cluster 2024-08-31T03:53:16.899997+0000 mgr.a (mgr.14388) 4414 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:18.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:17 smithi163 bash[24253]: cluster 2024-08-31T03:53:16.899997+0000 mgr.a (mgr.14388) 4414 : cluster [DBG] pgmap v3058: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:19 smithi027 bash[22610]: cluster 2024-08-31T03:53:18.902214+0000 mgr.a (mgr.14388) 4415 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:19 smithi191 bash[24992]: cluster 2024-08-31T03:53:18.902214+0000 mgr.a (mgr.14388) 4415 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:20.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:53:20.376 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:53:20.376 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:53:20.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:19 smithi163 bash[24253]: cluster 2024-08-31T03:53:18.902214+0000 mgr.a (mgr.14388) 4415 : cluster [DBG] pgmap v3059: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:21.118 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:53:21.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:53:21.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:53:21.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:53:21.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:53:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:21 smithi191 bash[24992]: audit 2024-08-31T03:53:20.703223+0000 mgr.a (mgr.14388) 4416 : audit [DBG] from='client.105810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:21 smithi191 bash[24992]: cluster 2024-08-31T03:53:20.902680+0000 mgr.a (mgr.14388) 4417 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:22.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:21 smithi163 bash[24253]: audit 2024-08-31T03:53:20.703223+0000 mgr.a (mgr.14388) 4416 : audit [DBG] from='client.105810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:22.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:21 smithi163 bash[24253]: cluster 2024-08-31T03:53:20.902680+0000 mgr.a (mgr.14388) 4417 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:21 smithi027 bash[22610]: audit 2024-08-31T03:53:20.703223+0000 mgr.a (mgr.14388) 4416 : audit [DBG] from='client.105810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:21 smithi027 bash[22610]: cluster 2024-08-31T03:53:20.902680+0000 mgr.a (mgr.14388) 4417 : cluster [DBG] pgmap v3060: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:23 smithi191 bash[24992]: cluster 2024-08-31T03:53:22.903525+0000 mgr.a (mgr.14388) 4418 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:24.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:23 smithi163 bash[24253]: cluster 2024-08-31T03:53:22.903525+0000 mgr.a (mgr.14388) 4418 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:23 smithi027 bash[22610]: cluster 2024-08-31T03:53:22.903525+0000 mgr.a (mgr.14388) 4418 : cluster [DBG] pgmap v3061: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:26.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:53:26.120 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:53:26.121 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:53:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:25 smithi191 bash[24992]: cluster 2024-08-31T03:53:24.905707+0000 mgr.a (mgr.14388) 4419 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:26.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:25 smithi163 bash[24253]: cluster 2024-08-31T03:53:24.905707+0000 mgr.a (mgr.14388) 4419 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:25 smithi027 bash[22610]: cluster 2024-08-31T03:53:24.905707+0000 mgr.a (mgr.14388) 4419 : cluster [DBG] pgmap v3062: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:26.864 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:53:26.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:53:26.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:53:26.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:53:26.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:53:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:27 smithi191 bash[24992]: audit 2024-08-31T03:53:26.448093+0000 mgr.a (mgr.14388) 4420 : audit [DBG] from='client.105888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:27 smithi191 bash[24992]: cluster 2024-08-31T03:53:26.906220+0000 mgr.a (mgr.14388) 4421 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:28.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:28 smithi163 bash[24253]: audit 2024-08-31T03:53:26.448093+0000 mgr.a (mgr.14388) 4420 : audit [DBG] from='client.105888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:28.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:28 smithi163 bash[24253]: cluster 2024-08-31T03:53:26.906220+0000 mgr.a (mgr.14388) 4421 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:27 smithi027 bash[22610]: audit 2024-08-31T03:53:26.448093+0000 mgr.a (mgr.14388) 4420 : audit [DBG] from='client.105888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:27 smithi027 bash[22610]: cluster 2024-08-31T03:53:26.906220+0000 mgr.a (mgr.14388) 4421 : cluster [DBG] pgmap v3063: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:30 smithi191 bash[24992]: cluster 2024-08-31T03:53:28.908356+0000 mgr.a (mgr.14388) 4422 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:30.753 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:30 smithi027 bash[22610]: cluster 2024-08-31T03:53:28.908356+0000 mgr.a (mgr.14388) 4422 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:30.753 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:30 smithi163 bash[24253]: cluster 2024-08-31T03:53:28.908356+0000 mgr.a (mgr.14388) 4422 : cluster [DBG] pgmap v3064: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:53:31.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:53:31.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:53:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:32 smithi191 bash[24992]: cluster 2024-08-31T03:53:30.909166+0000 mgr.a (mgr.14388) 4423 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:32.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:32 smithi163 bash[24253]: cluster 2024-08-31T03:53:30.909166+0000 mgr.a (mgr.14388) 4423 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:32 smithi027 bash[22610]: cluster 2024-08-31T03:53:30.909166+0000 mgr.a (mgr.14388) 4423 : cluster [DBG] pgmap v3065: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:32.602 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:53:32.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:53:32.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:53:32.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:53:32.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:53:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:34 smithi191 bash[24992]: audit 2024-08-31T03:53:32.194692+0000 mgr.a (mgr.14388) 4424 : audit [DBG] from='client.105966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:34 smithi191 bash[24992]: cluster 2024-08-31T03:53:32.910058+0000 mgr.a (mgr.14388) 4425 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:34.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:34 smithi163 bash[24253]: audit 2024-08-31T03:53:32.194692+0000 mgr.a (mgr.14388) 4424 : audit [DBG] from='client.105966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:34.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:34 smithi163 bash[24253]: cluster 2024-08-31T03:53:32.910058+0000 mgr.a (mgr.14388) 4425 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:34 smithi027 bash[22610]: audit 2024-08-31T03:53:32.194692+0000 mgr.a (mgr.14388) 4424 : audit [DBG] from='client.105966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:34 smithi027 bash[22610]: cluster 2024-08-31T03:53:32.910058+0000 mgr.a (mgr.14388) 4425 : cluster [DBG] pgmap v3066: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:36 smithi191 bash[24992]: cluster 2024-08-31T03:53:34.912349+0000 mgr.a (mgr.14388) 4426 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:36.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:36 smithi163 bash[24253]: cluster 2024-08-31T03:53:34.912349+0000 mgr.a (mgr.14388) 4426 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:36 smithi027 bash[22610]: cluster 2024-08-31T03:53:34.912349+0000 mgr.a (mgr.14388) 4426 : cluster [DBG] pgmap v3067: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:37.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:53:37.604 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:53:37.604 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:53:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:38 smithi191 bash[24992]: cluster 2024-08-31T03:53:36.913114+0000 mgr.a (mgr.14388) 4427 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:38.340 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:53:38.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:53:38.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:53:38.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:53:38.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:53:38.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:38 smithi163 bash[24253]: cluster 2024-08-31T03:53:36.913114+0000 mgr.a (mgr.14388) 4427 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:38 smithi027 bash[22610]: cluster 2024-08-31T03:53:36.913114+0000 mgr.a (mgr.14388) 4427 : cluster [DBG] pgmap v3068: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:39 smithi191 bash[24992]: audit 2024-08-31T03:53:37.935473+0000 mgr.a (mgr.14388) 4428 : audit [DBG] from='client.106044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:39.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:39 smithi163 bash[24253]: audit 2024-08-31T03:53:37.935473+0000 mgr.a (mgr.14388) 4428 : audit [DBG] from='client.106044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:39 smithi027 bash[22610]: audit 2024-08-31T03:53:37.935473+0000 mgr.a (mgr.14388) 4428 : audit [DBG] from='client.106044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:40 smithi191 bash[24992]: cluster 2024-08-31T03:53:38.915902+0000 mgr.a (mgr.14388) 4429 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:40.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:40 smithi163 bash[24253]: cluster 2024-08-31T03:53:38.915902+0000 mgr.a (mgr.14388) 4429 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:40 smithi027 bash[22610]: cluster 2024-08-31T03:53:38.915902+0000 mgr.a (mgr.14388) 4429 : cluster [DBG] pgmap v3069: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:42 smithi191 bash[24992]: cluster 2024-08-31T03:53:40.916723+0000 mgr.a (mgr.14388) 4430 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:53:42.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:42 smithi163 bash[24253]: cluster 2024-08-31T03:53:40.916723+0000 mgr.a (mgr.14388) 4430 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:53:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:42 smithi027 bash[22610]: cluster 2024-08-31T03:53:40.916723+0000 mgr.a (mgr.14388) 4430 : cluster [DBG] pgmap v3070: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:53:43.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:53:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:53:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:53:44.085 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:53:44.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:53:44.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:53:44.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:53:44.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:53:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:44 smithi191 bash[24992]: cluster 2024-08-31T03:53:42.917479+0000 mgr.a (mgr.14388) 4431 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:53:44.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:44 smithi163 bash[24253]: cluster 2024-08-31T03:53:42.917479+0000 mgr.a (mgr.14388) 4431 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:53:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:44 smithi027 bash[22610]: cluster 2024-08-31T03:53:42.917479+0000 mgr.a (mgr.14388) 4431 : cluster [DBG] pgmap v3071: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:53:45.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:45 smithi163 bash[24253]: audit 2024-08-31T03:53:43.667227+0000 mgr.a (mgr.14388) 4432 : audit [DBG] from='client.106122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:45 smithi027 bash[22610]: audit 2024-08-31T03:53:43.667227+0000 mgr.a (mgr.14388) 4432 : audit [DBG] from='client.106122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:45 smithi191 bash[24992]: audit 2024-08-31T03:53:43.667227+0000 mgr.a (mgr.14388) 4432 : audit [DBG] from='client.106122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:46.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:46 smithi163 bash[24253]: cluster 2024-08-31T03:53:44.920236+0000 mgr.a (mgr.14388) 4433 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:46 smithi027 bash[22610]: cluster 2024-08-31T03:53:44.920236+0000 mgr.a (mgr.14388) 4433 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:46 smithi191 bash[24992]: cluster 2024-08-31T03:53:44.920236+0000 mgr.a (mgr.14388) 4433 : cluster [DBG] pgmap v3072: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:48.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:48 smithi163 bash[24253]: cluster 2024-08-31T03:53:46.921022+0000 mgr.a (mgr.14388) 4434 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:53:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:48 smithi027 bash[22610]: cluster 2024-08-31T03:53:46.921022+0000 mgr.a (mgr.14388) 4434 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:53:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:48 smithi191 bash[24992]: cluster 2024-08-31T03:53:46.921022+0000 mgr.a (mgr.14388) 4434 : cluster [DBG] pgmap v3073: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:53:49.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:53:49.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:53:49.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:53:49.861 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:53:49.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:53:49.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:53:49.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:53:49.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:53:50.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:50 smithi163 bash[24253]: cluster 2024-08-31T03:53:48.923006+0000 mgr.a (mgr.14388) 4435 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:50 smithi027 bash[22610]: cluster 2024-08-31T03:53:48.923006+0000 mgr.a (mgr.14388) 4435 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:50 smithi191 bash[24992]: cluster 2024-08-31T03:53:48.923006+0000 mgr.a (mgr.14388) 4435 : cluster [DBG] pgmap v3074: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:51.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:51 smithi163 bash[24253]: audit 2024-08-31T03:53:49.423759+0000 mgr.a (mgr.14388) 4436 : audit [DBG] from='client.106197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:51 smithi027 bash[22610]: audit 2024-08-31T03:53:49.423759+0000 mgr.a (mgr.14388) 4436 : audit [DBG] from='client.106197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:51 smithi191 bash[24992]: audit 2024-08-31T03:53:49.423759+0000 mgr.a (mgr.14388) 4436 : audit [DBG] from='client.106197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:52.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:52 smithi163 bash[24253]: cluster 2024-08-31T03:53:50.923891+0000 mgr.a (mgr.14388) 4437 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:52 smithi027 bash[22610]: cluster 2024-08-31T03:53:50.923891+0000 mgr.a (mgr.14388) 4437 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:52 smithi191 bash[24992]: cluster 2024-08-31T03:53:50.923891+0000 mgr.a (mgr.14388) 4437 : cluster [DBG] pgmap v3075: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:54.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:54 smithi163 bash[24253]: cluster 2024-08-31T03:53:52.924674+0000 mgr.a (mgr.14388) 4438 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:54 smithi027 bash[22610]: cluster 2024-08-31T03:53:52.924674+0000 mgr.a (mgr.14388) 4438 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:54 smithi191 bash[24992]: cluster 2024-08-31T03:53:52.924674+0000 mgr.a (mgr.14388) 4438 : cluster [DBG] pgmap v3076: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:54.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:53:54.863 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:53:54.863 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:53:55.603 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:53:55.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:53:55.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:53:55.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:53:55.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:53:56.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:56 smithi163 bash[24253]: cluster 2024-08-31T03:53:54.926847+0000 mgr.a (mgr.14388) 4439 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:56 smithi027 bash[22610]: cluster 2024-08-31T03:53:54.926847+0000 mgr.a (mgr.14388) 4439 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:56 smithi191 bash[24992]: cluster 2024-08-31T03:53:54.926847+0000 mgr.a (mgr.14388) 4439 : cluster [DBG] pgmap v3077: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:53:57.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:57 smithi163 bash[24253]: audit 2024-08-31T03:53:55.193997+0000 mgr.a (mgr.14388) 4440 : audit [DBG] from='client.106275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:57 smithi027 bash[22610]: audit 2024-08-31T03:53:55.193997+0000 mgr.a (mgr.14388) 4440 : audit [DBG] from='client.106275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:57 smithi191 bash[24992]: audit 2024-08-31T03:53:55.193997+0000 mgr.a (mgr.14388) 4440 : audit [DBG] from='client.106275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:53:58.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:53:58 smithi163 bash[24253]: cluster 2024-08-31T03:53:56.927854+0000 mgr.a (mgr.14388) 4441 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:53:58 smithi027 bash[22610]: cluster 2024-08-31T03:53:56.927854+0000 mgr.a (mgr.14388) 4441 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:53:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:53:58 smithi191 bash[24992]: cluster 2024-08-31T03:53:56.927854+0000 mgr.a (mgr.14388) 4441 : cluster [DBG] pgmap v3078: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:00.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:00 smithi163 bash[24253]: cluster 2024-08-31T03:53:58.930074+0000 mgr.a (mgr.14388) 4442 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:00 smithi027 bash[22610]: cluster 2024-08-31T03:53:58.930074+0000 mgr.a (mgr.14388) 4442 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:00 smithi191 bash[24992]: cluster 2024-08-31T03:53:58.930074+0000 mgr.a (mgr.14388) 4442 : cluster [DBG] pgmap v3079: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:00.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:00.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:00.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:01.347 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:01.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:01.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:01.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:01.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:54:01.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:01 smithi163 bash[24253]: cluster 2024-08-31T03:54:00.930797+0000 mgr.a (mgr.14388) 4443 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:01.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:01 smithi163 bash[24253]: audit 2024-08-31T03:54:00.938305+0000 mgr.a (mgr.14388) 4444 : audit [DBG] from='client.106350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:01 smithi027 bash[22610]: cluster 2024-08-31T03:54:00.930797+0000 mgr.a (mgr.14388) 4443 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:01 smithi027 bash[22610]: audit 2024-08-31T03:54:00.938305+0000 mgr.a (mgr.14388) 4444 : audit [DBG] from='client.106350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:01 smithi191 bash[24992]: cluster 2024-08-31T03:54:00.930797+0000 mgr.a (mgr.14388) 4443 : cluster [DBG] pgmap v3080: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:01 smithi191 bash[24992]: audit 2024-08-31T03:54:00.938305+0000 mgr.a (mgr.14388) 4444 : audit [DBG] from='client.106350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:03.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:02 smithi163 bash[24253]: audit 2024-08-31T03:54:02.839393+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:54:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:02 smithi027 bash[22610]: audit 2024-08-31T03:54:02.839393+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:54:03.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:02 smithi191 bash[24992]: audit 2024-08-31T03:54:02.839393+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:54:04.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:03 smithi163 bash[24253]: cluster 2024-08-31T03:54:02.931370+0000 mgr.a (mgr.14388) 4445 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:04.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:03 smithi163 bash[24253]: audit 2024-08-31T03:54:03.665093+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:54:04.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:03 smithi163 bash[24253]: audit 2024-08-31T03:54:03.666998+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:54:04.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:03 smithi163 bash[24253]: audit 2024-08-31T03:54:03.677683+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:54:04.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:03 smithi163 bash[24253]: audit 2024-08-31T03:54:03.680819+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:54:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:03 smithi027 bash[22610]: cluster 2024-08-31T03:54:02.931370+0000 mgr.a (mgr.14388) 4445 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:03 smithi027 bash[22610]: audit 2024-08-31T03:54:03.665093+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:54:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:03 smithi027 bash[22610]: audit 2024-08-31T03:54:03.666998+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:54:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:03 smithi027 bash[22610]: audit 2024-08-31T03:54:03.677683+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:54:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:03 smithi027 bash[22610]: audit 2024-08-31T03:54:03.680819+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:54:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:03 smithi191 bash[24992]: cluster 2024-08-31T03:54:02.931370+0000 mgr.a (mgr.14388) 4445 : cluster [DBG] pgmap v3081: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:03 smithi191 bash[24992]: audit 2024-08-31T03:54:03.665093+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:54:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:03 smithi191 bash[24992]: audit 2024-08-31T03:54:03.666998+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:54:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:03 smithi191 bash[24992]: audit 2024-08-31T03:54:03.677683+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:54:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:03 smithi191 bash[24992]: audit 2024-08-31T03:54:03.680819+0000 mon.a (mon.0) 1259 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:54:04.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:54:04 smithi027 bash[22863]: debug 2024-08-31T03:54:04.408+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:54:04.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:54:04 smithi027 bash[22863]: debug 2024-08-31T03:54:04.408+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:54:05.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:04 smithi163 bash[24253]: audit 2024-08-31T03:54:03.683142+0000 mgr.a (mgr.14388) 4446 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:54:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:04 smithi027 bash[22610]: audit 2024-08-31T03:54:03.683142+0000 mgr.a (mgr.14388) 4446 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:54:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:04 smithi191 bash[24992]: audit 2024-08-31T03:54:03.683142+0000 mgr.a (mgr.14388) 4446 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:54:06.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:05 smithi163 bash[24253]: audit 2024-08-31T03:54:04.412691+0000 mgr.a (mgr.14388) 4447 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:54:06.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:05 smithi163 bash[24253]: cephadm 2024-08-31T03:54:04.414152+0000 mgr.a (mgr.14388) 4448 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:54:06.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:05 smithi163 bash[24253]: cluster 2024-08-31T03:54:04.934074+0000 mgr.a (mgr.14388) 4449 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:05 smithi027 bash[22610]: audit 2024-08-31T03:54:04.412691+0000 mgr.a (mgr.14388) 4447 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:54:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:05 smithi027 bash[22610]: cephadm 2024-08-31T03:54:04.414152+0000 mgr.a (mgr.14388) 4448 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:54:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:05 smithi027 bash[22610]: cluster 2024-08-31T03:54:04.934074+0000 mgr.a (mgr.14388) 4449 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:05 smithi191 bash[24992]: audit 2024-08-31T03:54:04.412691+0000 mgr.a (mgr.14388) 4447 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:54:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:05 smithi191 bash[24992]: cephadm 2024-08-31T03:54:04.414152+0000 mgr.a (mgr.14388) 4448 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:54:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:05 smithi191 bash[24992]: cluster 2024-08-31T03:54:04.934074+0000 mgr.a (mgr.14388) 4449 : cluster [DBG] pgmap v3082: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:06.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:06.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:06.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:07.133 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:07.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:07.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:07.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:07.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:54:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:07 smithi191 bash[24992]: audit 2024-08-31T03:54:06.686102+0000 mgr.a (mgr.14388) 4450 : audit [DBG] from='client.106536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:07 smithi191 bash[24992]: cluster 2024-08-31T03:54:06.934691+0000 mgr.a (mgr.14388) 4451 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:08.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:07 smithi163 bash[24253]: audit 2024-08-31T03:54:06.686102+0000 mgr.a (mgr.14388) 4450 : audit [DBG] from='client.106536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:08.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:07 smithi163 bash[24253]: cluster 2024-08-31T03:54:06.934691+0000 mgr.a (mgr.14388) 4451 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:07 smithi027 bash[22610]: audit 2024-08-31T03:54:06.686102+0000 mgr.a (mgr.14388) 4450 : audit [DBG] from='client.106536 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:07 smithi027 bash[22610]: cluster 2024-08-31T03:54:06.934691+0000 mgr.a (mgr.14388) 4451 : cluster [DBG] pgmap v3083: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:09 smithi191 bash[24992]: cluster 2024-08-31T03:54:08.936928+0000 mgr.a (mgr.14388) 4452 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:10.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:10 smithi163 bash[24253]: cluster 2024-08-31T03:54:08.936928+0000 mgr.a (mgr.14388) 4452 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:09 smithi027 bash[22610]: cluster 2024-08-31T03:54:08.936928+0000 mgr.a (mgr.14388) 4452 : cluster [DBG] pgmap v3084: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:12.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:12.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:12.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:11 smithi191 bash[24992]: cluster 2024-08-31T03:54:10.937824+0000 mgr.a (mgr.14388) 4453 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:12.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:12 smithi163 bash[24253]: cluster 2024-08-31T03:54:10.937824+0000 mgr.a (mgr.14388) 4453 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:11 smithi027 bash[22610]: cluster 2024-08-31T03:54:10.937824+0000 mgr.a (mgr.14388) 4453 : cluster [DBG] pgmap v3085: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:12.887 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:12.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:12.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:12.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:12.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:54:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:14 smithi191 bash[24992]: audit 2024-08-31T03:54:12.465661+0000 mgr.a (mgr.14388) 4454 : audit [DBG] from='client.106614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:14 smithi191 bash[24992]: cluster 2024-08-31T03:54:12.938592+0000 mgr.a (mgr.14388) 4455 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:14.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:14 smithi163 bash[24253]: audit 2024-08-31T03:54:12.465661+0000 mgr.a (mgr.14388) 4454 : audit [DBG] from='client.106614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:14.445 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:14 smithi163 bash[24253]: cluster 2024-08-31T03:54:12.938592+0000 mgr.a (mgr.14388) 4455 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:14 smithi027 bash[22610]: audit 2024-08-31T03:54:12.465661+0000 mgr.a (mgr.14388) 4454 : audit [DBG] from='client.106614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:14 smithi027 bash[22610]: cluster 2024-08-31T03:54:12.938592+0000 mgr.a (mgr.14388) 4455 : cluster [DBG] pgmap v3086: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:16 smithi191 bash[24992]: cluster 2024-08-31T03:54:14.940270+0000 mgr.a (mgr.14388) 4456 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:16.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:16 smithi163 bash[24253]: cluster 2024-08-31T03:54:14.940270+0000 mgr.a (mgr.14388) 4456 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:16 smithi027 bash[22610]: cluster 2024-08-31T03:54:14.940270+0000 mgr.a (mgr.14388) 4456 : cluster [DBG] pgmap v3087: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:17.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:17.890 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:17.890 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:18 smithi191 bash[24992]: cluster 2024-08-31T03:54:16.941068+0000 mgr.a (mgr.14388) 4457 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:18.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:18 smithi163 bash[24253]: cluster 2024-08-31T03:54:16.941068+0000 mgr.a (mgr.14388) 4457 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:18 smithi027 bash[22610]: cluster 2024-08-31T03:54:16.941068+0000 mgr.a (mgr.14388) 4457 : cluster [DBG] pgmap v3088: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:18.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:18.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:18.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:18.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:54:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:20 smithi191 bash[24992]: audit 2024-08-31T03:54:18.221068+0000 mgr.a (mgr.14388) 4458 : audit [DBG] from='client.106689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:20 smithi191 bash[24992]: cluster 2024-08-31T03:54:18.943796+0000 mgr.a (mgr.14388) 4459 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:20.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:20 smithi163 bash[24253]: audit 2024-08-31T03:54:18.221068+0000 mgr.a (mgr.14388) 4458 : audit [DBG] from='client.106689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:20.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:20 smithi163 bash[24253]: cluster 2024-08-31T03:54:18.943796+0000 mgr.a (mgr.14388) 4459 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:20 smithi027 bash[22610]: audit 2024-08-31T03:54:18.221068+0000 mgr.a (mgr.14388) 4458 : audit [DBG] from='client.106689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:20 smithi027 bash[22610]: cluster 2024-08-31T03:54:18.943796+0000 mgr.a (mgr.14388) 4459 : cluster [DBG] pgmap v3089: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:54:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:22 smithi191 bash[24992]: cluster 2024-08-31T03:54:20.944593+0000 mgr.a (mgr.14388) 4460 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:54:22.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:22 smithi163 bash[24253]: cluster 2024-08-31T03:54:20.944593+0000 mgr.a (mgr.14388) 4460 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:54:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:22 smithi027 bash[22610]: cluster 2024-08-31T03:54:20.944593+0000 mgr.a (mgr.14388) 4460 : cluster [DBG] pgmap v3090: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:54:23.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:23.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:23.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:24 smithi191 bash[24992]: cluster 2024-08-31T03:54:22.946068+0000 mgr.a (mgr.14388) 4461 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:54:24.386 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:24.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:24.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:24.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:24.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:54:24.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:24 smithi163 bash[24253]: cluster 2024-08-31T03:54:22.946068+0000 mgr.a (mgr.14388) 4461 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:54:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:24 smithi027 bash[22610]: cluster 2024-08-31T03:54:22.946068+0000 mgr.a (mgr.14388) 4461 : cluster [DBG] pgmap v3091: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:54:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:25 smithi191 bash[24992]: audit 2024-08-31T03:54:23.971429+0000 mgr.a (mgr.14388) 4462 : audit [DBG] from='client.106764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:25.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:25 smithi163 bash[24253]: audit 2024-08-31T03:54:23.971429+0000 mgr.a (mgr.14388) 4462 : audit [DBG] from='client.106764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:25 smithi027 bash[22610]: audit 2024-08-31T03:54:23.971429+0000 mgr.a (mgr.14388) 4462 : audit [DBG] from='client.106764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:26 smithi191 bash[24992]: cluster 2024-08-31T03:54:24.947870+0000 mgr.a (mgr.14388) 4463 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:54:26.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:26 smithi163 bash[24253]: cluster 2024-08-31T03:54:24.947870+0000 mgr.a (mgr.14388) 4463 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:54:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:26 smithi027 bash[22610]: cluster 2024-08-31T03:54:24.947870+0000 mgr.a (mgr.14388) 4463 : cluster [DBG] pgmap v3092: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:54:28.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:28 smithi163 bash[24253]: cluster 2024-08-31T03:54:26.948659+0000 mgr.a (mgr.14388) 4464 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:54:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:28 smithi027 bash[22610]: cluster 2024-08-31T03:54:26.948659+0000 mgr.a (mgr.14388) 4464 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:54:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:28 smithi191 bash[24992]: cluster 2024-08-31T03:54:26.948659+0000 mgr.a (mgr.14388) 4464 : cluster [DBG] pgmap v3093: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:54:29.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:29.389 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:29.389 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:30.151 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:30.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:30.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:30.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:30.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:54:30.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:30 smithi163 bash[24253]: cluster 2024-08-31T03:54:28.950652+0000 mgr.a (mgr.14388) 4465 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:30 smithi027 bash[22610]: cluster 2024-08-31T03:54:28.950652+0000 mgr.a (mgr.14388) 4465 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:30 smithi191 bash[24992]: cluster 2024-08-31T03:54:28.950652+0000 mgr.a (mgr.14388) 4465 : cluster [DBG] pgmap v3094: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:31.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:31 smithi163 bash[24253]: audit 2024-08-31T03:54:29.724104+0000 mgr.a (mgr.14388) 4466 : audit [DBG] from='client.106842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:31 smithi027 bash[22610]: audit 2024-08-31T03:54:29.724104+0000 mgr.a (mgr.14388) 4466 : audit [DBG] from='client.106842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:31 smithi191 bash[24992]: audit 2024-08-31T03:54:29.724104+0000 mgr.a (mgr.14388) 4466 : audit [DBG] from='client.106842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:32.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:32 smithi163 bash[24253]: cluster 2024-08-31T03:54:30.951659+0000 mgr.a (mgr.14388) 4467 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:32 smithi027 bash[22610]: cluster 2024-08-31T03:54:30.951659+0000 mgr.a (mgr.14388) 4467 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:32 smithi191 bash[24992]: cluster 2024-08-31T03:54:30.951659+0000 mgr.a (mgr.14388) 4467 : cluster [DBG] pgmap v3095: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:34.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:34 smithi163 bash[24253]: cluster 2024-08-31T03:54:32.953565+0000 mgr.a (mgr.14388) 4468 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:54:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:34 smithi027 bash[22610]: cluster 2024-08-31T03:54:32.953565+0000 mgr.a (mgr.14388) 4468 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:54:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:34 smithi191 bash[24992]: cluster 2024-08-31T03:54:32.953565+0000 mgr.a (mgr.14388) 4468 : cluster [DBG] pgmap v3096: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:54:35.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:35.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:35.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:35.932 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:35.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:35.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:35.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:35.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:54:36.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:36 smithi163 bash[24253]: cluster 2024-08-31T03:54:34.954876+0000 mgr.a (mgr.14388) 4469 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:54:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:36 smithi027 bash[22610]: cluster 2024-08-31T03:54:34.954876+0000 mgr.a (mgr.14388) 4469 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:54:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:36 smithi191 bash[24992]: cluster 2024-08-31T03:54:34.954876+0000 mgr.a (mgr.14388) 4469 : cluster [DBG] pgmap v3097: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:54:37.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:37 smithi163 bash[24253]: audit 2024-08-31T03:54:35.491549+0000 mgr.a (mgr.14388) 4470 : audit [DBG] from='client.106920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:37 smithi027 bash[22610]: audit 2024-08-31T03:54:35.491549+0000 mgr.a (mgr.14388) 4470 : audit [DBG] from='client.106920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:37 smithi191 bash[24992]: audit 2024-08-31T03:54:35.491549+0000 mgr.a (mgr.14388) 4470 : audit [DBG] from='client.106920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:38.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:38 smithi163 bash[24253]: cluster 2024-08-31T03:54:36.955753+0000 mgr.a (mgr.14388) 4471 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:38 smithi027 bash[22610]: cluster 2024-08-31T03:54:36.955753+0000 mgr.a (mgr.14388) 4471 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:38 smithi191 bash[24992]: cluster 2024-08-31T03:54:36.955753+0000 mgr.a (mgr.14388) 4471 : cluster [DBG] pgmap v3098: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:40.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:40 smithi163 bash[24253]: cluster 2024-08-31T03:54:38.957975+0000 mgr.a (mgr.14388) 4472 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:40 smithi027 bash[22610]: cluster 2024-08-31T03:54:38.957975+0000 mgr.a (mgr.14388) 4472 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:40 smithi191 bash[24992]: cluster 2024-08-31T03:54:38.957975+0000 mgr.a (mgr.14388) 4472 : cluster [DBG] pgmap v3099: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:40.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:40.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:40.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:41.673 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:41.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:41.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:41.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:41.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:54:42.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:42 smithi163 bash[24253]: cluster 2024-08-31T03:54:40.958628+0000 mgr.a (mgr.14388) 4473 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:42 smithi027 bash[22610]: cluster 2024-08-31T03:54:40.958628+0000 mgr.a (mgr.14388) 4473 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:42 smithi191 bash[24992]: cluster 2024-08-31T03:54:40.958628+0000 mgr.a (mgr.14388) 4473 : cluster [DBG] pgmap v3100: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:43.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:43 smithi163 bash[24253]: audit 2024-08-31T03:54:41.269010+0000 mgr.a (mgr.14388) 4474 : audit [DBG] from='client.106998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:43 smithi027 bash[22610]: audit 2024-08-31T03:54:41.269010+0000 mgr.a (mgr.14388) 4474 : audit [DBG] from='client.106998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:43 smithi191 bash[24992]: audit 2024-08-31T03:54:41.269010+0000 mgr.a (mgr.14388) 4474 : audit [DBG] from='client.106998 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:44.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:44 smithi163 bash[24253]: cluster 2024-08-31T03:54:42.960421+0000 mgr.a (mgr.14388) 4475 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:54:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:44 smithi027 bash[22610]: cluster 2024-08-31T03:54:42.960421+0000 mgr.a (mgr.14388) 4475 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:54:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:44 smithi191 bash[24992]: cluster 2024-08-31T03:54:42.960421+0000 mgr.a (mgr.14388) 4475 : cluster [DBG] pgmap v3101: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:54:46.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:46 smithi163 bash[24253]: cluster 2024-08-31T03:54:44.961674+0000 mgr.a (mgr.14388) 4476 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:54:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:46 smithi027 bash[22610]: cluster 2024-08-31T03:54:44.961674+0000 mgr.a (mgr.14388) 4476 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:54:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:46 smithi191 bash[24992]: cluster 2024-08-31T03:54:44.961674+0000 mgr.a (mgr.14388) 4476 : cluster [DBG] pgmap v3102: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:54:46.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:46.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:46.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:47.428 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:47.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:47.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:47.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:47.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:54:48.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:48 smithi163 bash[24253]: cluster 2024-08-31T03:54:46.962406+0000 mgr.a (mgr.14388) 4477 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:48.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:48 smithi163 bash[24253]: audit 2024-08-31T03:54:47.008339+0000 mgr.a (mgr.14388) 4478 : audit [DBG] from='client.107076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:48 smithi027 bash[22610]: cluster 2024-08-31T03:54:46.962406+0000 mgr.a (mgr.14388) 4477 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:48 smithi027 bash[22610]: audit 2024-08-31T03:54:47.008339+0000 mgr.a (mgr.14388) 4478 : audit [DBG] from='client.107076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:48 smithi191 bash[24992]: cluster 2024-08-31T03:54:46.962406+0000 mgr.a (mgr.14388) 4477 : cluster [DBG] pgmap v3103: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:48 smithi191 bash[24992]: audit 2024-08-31T03:54:47.008339+0000 mgr.a (mgr.14388) 4478 : audit [DBG] from='client.107076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:50.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:50 smithi163 bash[24253]: cluster 2024-08-31T03:54:48.964651+0000 mgr.a (mgr.14388) 4479 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:50 smithi027 bash[22610]: cluster 2024-08-31T03:54:48.964651+0000 mgr.a (mgr.14388) 4479 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:50 smithi191 bash[24992]: cluster 2024-08-31T03:54:48.964651+0000 mgr.a (mgr.14388) 4479 : cluster [DBG] pgmap v3104: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:54:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:52.430 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:52.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:52.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:52 smithi163 bash[24253]: cluster 2024-08-31T03:54:50.965569+0000 mgr.a (mgr.14388) 4480 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:52 smithi027 bash[22610]: cluster 2024-08-31T03:54:50.965569+0000 mgr.a (mgr.14388) 4480 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:52 smithi191 bash[24992]: cluster 2024-08-31T03:54:50.965569+0000 mgr.a (mgr.14388) 4480 : cluster [DBG] pgmap v3105: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:53.167 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:53.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:53.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:53.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:53.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:54:54.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:54 smithi163 bash[24253]: audit 2024-08-31T03:54:52.763064+0000 mgr.a (mgr.14388) 4481 : audit [DBG] from='client.107154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:54.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:54 smithi163 bash[24253]: cluster 2024-08-31T03:54:52.966504+0000 mgr.a (mgr.14388) 4482 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:54 smithi027 bash[22610]: audit 2024-08-31T03:54:52.763064+0000 mgr.a (mgr.14388) 4481 : audit [DBG] from='client.107154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:54 smithi027 bash[22610]: cluster 2024-08-31T03:54:52.966504+0000 mgr.a (mgr.14388) 4482 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:54 smithi191 bash[24992]: audit 2024-08-31T03:54:52.763064+0000 mgr.a (mgr.14388) 4481 : audit [DBG] from='client.107154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:54:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:54 smithi191 bash[24992]: cluster 2024-08-31T03:54:52.966504+0000 mgr.a (mgr.14388) 4482 : cluster [DBG] pgmap v3106: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:54:55.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:55 smithi163 bash[24253]: cluster 2024-08-31T03:54:54.968034+0000 mgr.a (mgr.14388) 4483 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:54:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:55 smithi027 bash[22610]: cluster 2024-08-31T03:54:54.968034+0000 mgr.a (mgr.14388) 4483 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:54:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:55 smithi191 bash[24992]: cluster 2024-08-31T03:54:54.968034+0000 mgr.a (mgr.14388) 4483 : cluster [DBG] pgmap v3107: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:54:58.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:54:58.169 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:54:58.169 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:54:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:54:58 smithi191 bash[24992]: cluster 2024-08-31T03:54:56.968793+0000 mgr.a (mgr.14388) 4484 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:54:58.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:54:58 smithi163 bash[24253]: cluster 2024-08-31T03:54:56.968793+0000 mgr.a (mgr.14388) 4484 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:54:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:54:58 smithi027 bash[22610]: cluster 2024-08-31T03:54:56.968793+0000 mgr.a (mgr.14388) 4484 : cluster [DBG] pgmap v3108: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:54:58.920 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:54:58.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:54:58.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:54:58.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:54:58.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:00 smithi191 bash[24992]: audit 2024-08-31T03:54:58.501812+0000 mgr.a (mgr.14388) 4485 : audit [DBG] from='client.107232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:00 smithi191 bash[24992]: cluster 2024-08-31T03:54:58.969983+0000 mgr.a (mgr.14388) 4486 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:00.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:00 smithi163 bash[24253]: audit 2024-08-31T03:54:58.501812+0000 mgr.a (mgr.14388) 4485 : audit [DBG] from='client.107232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:00.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:00 smithi163 bash[24253]: cluster 2024-08-31T03:54:58.969983+0000 mgr.a (mgr.14388) 4486 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:00 smithi027 bash[22610]: audit 2024-08-31T03:54:58.501812+0000 mgr.a (mgr.14388) 4485 : audit [DBG] from='client.107232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:00 smithi027 bash[22610]: cluster 2024-08-31T03:54:58.969983+0000 mgr.a (mgr.14388) 4486 : cluster [DBG] pgmap v3109: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:02 smithi191 bash[24992]: cluster 2024-08-31T03:55:00.970866+0000 mgr.a (mgr.14388) 4487 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:55:02.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:02 smithi163 bash[24253]: cluster 2024-08-31T03:55:00.970866+0000 mgr.a (mgr.14388) 4487 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:55:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:02 smithi027 bash[22610]: cluster 2024-08-31T03:55:00.970866+0000 mgr.a (mgr.14388) 4487 : cluster [DBG] pgmap v3110: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:55:03.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:55:03.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:55:03.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:55:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:04 smithi191 bash[24992]: cluster 2024-08-31T03:55:02.972449+0000 mgr.a (mgr.14388) 4488 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:55:04.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:04 smithi163 bash[24253]: cluster 2024-08-31T03:55:02.972449+0000 mgr.a (mgr.14388) 4488 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:55:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:04 smithi027 bash[22610]: cluster 2024-08-31T03:55:02.972449+0000 mgr.a (mgr.14388) 4488 : cluster [DBG] pgmap v3111: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:55:04.716 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:55:04.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:55:04.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:55:04.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:55:04.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:05.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:05 smithi163 bash[24253]: audit 2024-08-31T03:55:04.466663+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:55:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:05 smithi027 bash[22610]: audit 2024-08-31T03:55:04.466663+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:55:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:05 smithi191 bash[24992]: audit 2024-08-31T03:55:04.466663+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:55:06.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:06 smithi163 bash[24253]: audit 2024-08-31T03:55:04.266216+0000 mgr.a (mgr.14388) 4489 : audit [DBG] from='client.107310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:06.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:06 smithi163 bash[24253]: cluster 2024-08-31T03:55:04.974203+0000 mgr.a (mgr.14388) 4490 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:06.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:06 smithi163 bash[24253]: audit 2024-08-31T03:55:05.280670+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:55:06.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:06 smithi163 bash[24253]: audit 2024-08-31T03:55:05.282084+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:55:06.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:06 smithi163 bash[24253]: audit 2024-08-31T03:55:05.290309+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:55:06.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:06 smithi163 bash[24253]: audit 2024-08-31T03:55:05.295705+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:55:06.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:55:06 smithi027 bash[22863]: debug 2024-08-31T03:55:06.014+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:55:06.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:55:06 smithi027 bash[22863]: debug 2024-08-31T03:55:06.014+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:55:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:06 smithi027 bash[22610]: audit 2024-08-31T03:55:04.266216+0000 mgr.a (mgr.14388) 4489 : audit [DBG] from='client.107310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:06 smithi027 bash[22610]: cluster 2024-08-31T03:55:04.974203+0000 mgr.a (mgr.14388) 4490 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:06 smithi027 bash[22610]: audit 2024-08-31T03:55:05.280670+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:55:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:06 smithi027 bash[22610]: audit 2024-08-31T03:55:05.282084+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:55:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:06 smithi027 bash[22610]: audit 2024-08-31T03:55:05.290309+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:55:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:06 smithi027 bash[22610]: audit 2024-08-31T03:55:05.295705+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:55:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:06 smithi191 bash[24992]: audit 2024-08-31T03:55:04.266216+0000 mgr.a (mgr.14388) 4489 : audit [DBG] from='client.107310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:06 smithi191 bash[24992]: cluster 2024-08-31T03:55:04.974203+0000 mgr.a (mgr.14388) 4490 : cluster [DBG] pgmap v3112: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:06.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:06 smithi191 bash[24992]: audit 2024-08-31T03:55:05.280670+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:55:06.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:06 smithi191 bash[24992]: audit 2024-08-31T03:55:05.282084+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:55:06.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:06 smithi191 bash[24992]: audit 2024-08-31T03:55:05.290309+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:55:06.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:06 smithi191 bash[24992]: audit 2024-08-31T03:55:05.295705+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:55:07.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:07 smithi163 bash[24253]: audit 2024-08-31T03:55:05.297281+0000 mgr.a (mgr.14388) 4491 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:55:07.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:07 smithi163 bash[24253]: audit 2024-08-31T03:55:06.015931+0000 mgr.a (mgr.14388) 4492 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:55:07.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:07 smithi163 bash[24253]: cephadm 2024-08-31T03:55:06.017114+0000 mgr.a (mgr.14388) 4493 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:55:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:07 smithi027 bash[22610]: audit 2024-08-31T03:55:05.297281+0000 mgr.a (mgr.14388) 4491 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:55:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:07 smithi027 bash[22610]: audit 2024-08-31T03:55:06.015931+0000 mgr.a (mgr.14388) 4492 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:55:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:07 smithi027 bash[22610]: cephadm 2024-08-31T03:55:06.017114+0000 mgr.a (mgr.14388) 4493 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:55:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:07 smithi191 bash[24992]: audit 2024-08-31T03:55:05.297281+0000 mgr.a (mgr.14388) 4491 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:55:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:07 smithi191 bash[24992]: audit 2024-08-31T03:55:06.015931+0000 mgr.a (mgr.14388) 4492 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:55:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:07 smithi191 bash[24992]: cephadm 2024-08-31T03:55:06.017114+0000 mgr.a (mgr.14388) 4493 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:55:08.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:08 smithi163 bash[24253]: cluster 2024-08-31T03:55:06.975169+0000 mgr.a (mgr.14388) 4494 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:55:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:08 smithi027 bash[22610]: cluster 2024-08-31T03:55:06.975169+0000 mgr.a (mgr.14388) 4494 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:55:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:08 smithi191 bash[24992]: cluster 2024-08-31T03:55:06.975169+0000 mgr.a (mgr.14388) 4494 : cluster [DBG] pgmap v3113: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:55:09.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:55:09.719 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:55:09.719 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:55:10.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:10 smithi163 bash[24253]: cluster 2024-08-31T03:55:08.977394+0000 mgr.a (mgr.14388) 4495 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:10.461 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:55:10.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:55:10.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:55:10.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:55:10.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:10 smithi027 bash[22610]: cluster 2024-08-31T03:55:08.977394+0000 mgr.a (mgr.14388) 4495 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:10 smithi191 bash[24992]: cluster 2024-08-31T03:55:08.977394+0000 mgr.a (mgr.14388) 4495 : cluster [DBG] pgmap v3114: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:11.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:11 smithi163 bash[24253]: audit 2024-08-31T03:55:10.054214+0000 mgr.a (mgr.14388) 4496 : audit [DBG] from='client.107490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:11 smithi027 bash[22610]: audit 2024-08-31T03:55:10.054214+0000 mgr.a (mgr.14388) 4496 : audit [DBG] from='client.107490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:11 smithi191 bash[24992]: audit 2024-08-31T03:55:10.054214+0000 mgr.a (mgr.14388) 4496 : audit [DBG] from='client.107490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:12.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:12 smithi163 bash[24253]: cluster 2024-08-31T03:55:10.978441+0000 mgr.a (mgr.14388) 4497 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:12 smithi027 bash[22610]: cluster 2024-08-31T03:55:10.978441+0000 mgr.a (mgr.14388) 4497 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:12.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:12 smithi191 bash[24992]: cluster 2024-08-31T03:55:10.978441+0000 mgr.a (mgr.14388) 4497 : cluster [DBG] pgmap v3115: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:14.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:14 smithi163 bash[24253]: cluster 2024-08-31T03:55:12.980372+0000 mgr.a (mgr.14388) 4498 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:14 smithi027 bash[22610]: cluster 2024-08-31T03:55:12.980372+0000 mgr.a (mgr.14388) 4498 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:14 smithi191 bash[24992]: cluster 2024-08-31T03:55:12.980372+0000 mgr.a (mgr.14388) 4498 : cluster [DBG] pgmap v3116: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:15.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:55:15.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:55:15.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:55:16.240 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:55:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:55:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:55:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:55:16.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:16.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:16 smithi163 bash[24253]: cluster 2024-08-31T03:55:14.981661+0000 mgr.a (mgr.14388) 4499 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:16 smithi027 bash[22610]: cluster 2024-08-31T03:55:14.981661+0000 mgr.a (mgr.14388) 4499 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:16 smithi191 bash[24992]: cluster 2024-08-31T03:55:14.981661+0000 mgr.a (mgr.14388) 4499 : cluster [DBG] pgmap v3117: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:17.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:17 smithi163 bash[24253]: audit 2024-08-31T03:55:15.800761+0000 mgr.a (mgr.14388) 4500 : audit [DBG] from='client.107568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:17 smithi027 bash[22610]: audit 2024-08-31T03:55:15.800761+0000 mgr.a (mgr.14388) 4500 : audit [DBG] from='client.107568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:17 smithi191 bash[24992]: audit 2024-08-31T03:55:15.800761+0000 mgr.a (mgr.14388) 4500 : audit [DBG] from='client.107568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:18.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:18 smithi163 bash[24253]: cluster 2024-08-31T03:55:16.982548+0000 mgr.a (mgr.14388) 4501 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:18 smithi027 bash[22610]: cluster 2024-08-31T03:55:16.982548+0000 mgr.a (mgr.14388) 4501 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:18 smithi191 bash[24992]: cluster 2024-08-31T03:55:16.982548+0000 mgr.a (mgr.14388) 4501 : cluster [DBG] pgmap v3118: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:20.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:20 smithi163 bash[24253]: cluster 2024-08-31T03:55:18.984724+0000 mgr.a (mgr.14388) 4502 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:20 smithi027 bash[22610]: cluster 2024-08-31T03:55:18.984724+0000 mgr.a (mgr.14388) 4502 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:20 smithi191 bash[24992]: cluster 2024-08-31T03:55:18.984724+0000 mgr.a (mgr.14388) 4502 : cluster [DBG] pgmap v3119: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:55:21.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:55:21.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:55:21.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:55:22.029 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:55:22.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:55:22.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:55:22.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:55:22.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:22.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:22 smithi163 bash[24253]: cluster 2024-08-31T03:55:20.985488+0000 mgr.a (mgr.14388) 4503 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:22 smithi027 bash[22610]: cluster 2024-08-31T03:55:20.985488+0000 mgr.a (mgr.14388) 4503 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:22 smithi191 bash[24992]: cluster 2024-08-31T03:55:20.985488+0000 mgr.a (mgr.14388) 4503 : cluster [DBG] pgmap v3120: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:23.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:23 smithi163 bash[24253]: audit 2024-08-31T03:55:21.580730+0000 mgr.a (mgr.14388) 4504 : audit [DBG] from='client.107640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:23 smithi027 bash[22610]: audit 2024-08-31T03:55:21.580730+0000 mgr.a (mgr.14388) 4504 : audit [DBG] from='client.107640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:23 smithi191 bash[24992]: audit 2024-08-31T03:55:21.580730+0000 mgr.a (mgr.14388) 4504 : audit [DBG] from='client.107640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:24.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:24 smithi163 bash[24253]: cluster 2024-08-31T03:55:22.987472+0000 mgr.a (mgr.14388) 4505 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:55:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:24 smithi027 bash[22610]: cluster 2024-08-31T03:55:22.987472+0000 mgr.a (mgr.14388) 4505 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:55:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:24 smithi191 bash[24992]: cluster 2024-08-31T03:55:22.987472+0000 mgr.a (mgr.14388) 4505 : cluster [DBG] pgmap v3121: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:55:26.444 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:26 smithi163 bash[24253]: cluster 2024-08-31T03:55:24.988885+0000 mgr.a (mgr.14388) 4506 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:55:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:26 smithi027 bash[22610]: cluster 2024-08-31T03:55:24.988885+0000 mgr.a (mgr.14388) 4506 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:55:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:26 smithi191 bash[24992]: cluster 2024-08-31T03:55:24.988885+0000 mgr.a (mgr.14388) 4506 : cluster [DBG] pgmap v3122: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:55:27.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:55:27.032 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:55:27.032 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:55:27.811 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:55:27.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:55:27.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:55:27.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:55:27.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:28.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:28 smithi163 bash[24253]: cluster 2024-08-31T03:55:26.989820+0000 mgr.a (mgr.14388) 4507 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:28 smithi027 bash[22610]: cluster 2024-08-31T03:55:26.989820+0000 mgr.a (mgr.14388) 4507 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:28 smithi191 bash[24992]: cluster 2024-08-31T03:55:26.989820+0000 mgr.a (mgr.14388) 4507 : cluster [DBG] pgmap v3123: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:29.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:29 smithi163 bash[24253]: audit 2024-08-31T03:55:27.361415+0000 mgr.a (mgr.14388) 4508 : audit [DBG] from='client.107715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:29 smithi027 bash[22610]: audit 2024-08-31T03:55:27.361415+0000 mgr.a (mgr.14388) 4508 : audit [DBG] from='client.107715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:29 smithi191 bash[24992]: audit 2024-08-31T03:55:27.361415+0000 mgr.a (mgr.14388) 4508 : audit [DBG] from='client.107715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:30.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:30 smithi163 bash[24253]: cluster 2024-08-31T03:55:28.992147+0000 mgr.a (mgr.14388) 4509 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:55:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:30 smithi027 bash[22610]: cluster 2024-08-31T03:55:28.992147+0000 mgr.a (mgr.14388) 4509 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:55:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:30 smithi191 bash[24992]: cluster 2024-08-31T03:55:28.992147+0000 mgr.a (mgr.14388) 4509 : cluster [DBG] pgmap v3124: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:55:31.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:31 smithi163 bash[24253]: cluster 2024-08-31T03:55:30.992909+0000 mgr.a (mgr.14388) 4510 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:31 smithi027 bash[22610]: cluster 2024-08-31T03:55:30.992909+0000 mgr.a (mgr.14388) 4510 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:31 smithi191 bash[24992]: cluster 2024-08-31T03:55:30.992909+0000 mgr.a (mgr.14388) 4510 : cluster [DBG] pgmap v3125: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:32.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:55:32.813 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:55:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:55:33.590 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:55:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:55:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:55:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:55:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:34.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:34 smithi163 bash[24253]: cluster 2024-08-31T03:55:32.994436+0000 mgr.a (mgr.14388) 4511 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:34 smithi027 bash[22610]: cluster 2024-08-31T03:55:32.994436+0000 mgr.a (mgr.14388) 4511 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:34 smithi191 bash[24992]: cluster 2024-08-31T03:55:32.994436+0000 mgr.a (mgr.14388) 4511 : cluster [DBG] pgmap v3126: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:35.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:35 smithi163 bash[24253]: audit 2024-08-31T03:55:33.149926+0000 mgr.a (mgr.14388) 4512 : audit [DBG] from='client.107793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:35 smithi027 bash[22610]: audit 2024-08-31T03:55:33.149926+0000 mgr.a (mgr.14388) 4512 : audit [DBG] from='client.107793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:35 smithi191 bash[24992]: audit 2024-08-31T03:55:33.149926+0000 mgr.a (mgr.14388) 4512 : audit [DBG] from='client.107793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:36.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:36 smithi163 bash[24253]: cluster 2024-08-31T03:55:34.996137+0000 mgr.a (mgr.14388) 4513 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:55:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:36 smithi027 bash[22610]: cluster 2024-08-31T03:55:34.996137+0000 mgr.a (mgr.14388) 4513 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:55:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:36 smithi191 bash[24992]: cluster 2024-08-31T03:55:34.996137+0000 mgr.a (mgr.14388) 4513 : cluster [DBG] pgmap v3127: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:55:38.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:38 smithi163 bash[24253]: cluster 2024-08-31T03:55:36.996919+0000 mgr.a (mgr.14388) 4514 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:55:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:38 smithi027 bash[22610]: cluster 2024-08-31T03:55:36.996919+0000 mgr.a (mgr.14388) 4514 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:55:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:38 smithi191 bash[24992]: cluster 2024-08-31T03:55:36.996919+0000 mgr.a (mgr.14388) 4514 : cluster [DBG] pgmap v3128: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:55:38.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:55:38.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:55:38.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:55:39.334 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:55:39.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:55:39.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:55:39.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:55:39.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:40.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:40 smithi163 bash[24253]: audit 2024-08-31T03:55:38.926589+0000 mgr.a (mgr.14388) 4515 : audit [DBG] from='client.107865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:40.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:40 smithi163 bash[24253]: cluster 2024-08-31T03:55:38.998470+0000 mgr.a (mgr.14388) 4516 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:40 smithi027 bash[22610]: audit 2024-08-31T03:55:38.926589+0000 mgr.a (mgr.14388) 4515 : audit [DBG] from='client.107865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:40 smithi027 bash[22610]: cluster 2024-08-31T03:55:38.998470+0000 mgr.a (mgr.14388) 4516 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:40 smithi191 bash[24992]: audit 2024-08-31T03:55:38.926589+0000 mgr.a (mgr.14388) 4515 : audit [DBG] from='client.107865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:40 smithi191 bash[24992]: cluster 2024-08-31T03:55:38.998470+0000 mgr.a (mgr.14388) 4516 : cluster [DBG] pgmap v3129: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:42.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:42 smithi163 bash[24253]: cluster 2024-08-31T03:55:40.999364+0000 mgr.a (mgr.14388) 4517 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:55:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:42 smithi027 bash[22610]: cluster 2024-08-31T03:55:40.999364+0000 mgr.a (mgr.14388) 4517 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:55:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:42 smithi191 bash[24992]: cluster 2024-08-31T03:55:40.999364+0000 mgr.a (mgr.14388) 4517 : cluster [DBG] pgmap v3130: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:55:44.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:55:44.337 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:55:44.337 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:55:44.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:44 smithi163 bash[24253]: cluster 2024-08-31T03:55:43.001107+0000 mgr.a (mgr.14388) 4518 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:55:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:44 smithi027 bash[22610]: cluster 2024-08-31T03:55:43.001107+0000 mgr.a (mgr.14388) 4518 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:55:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:44 smithi191 bash[24992]: cluster 2024-08-31T03:55:43.001107+0000 mgr.a (mgr.14388) 4518 : cluster [DBG] pgmap v3131: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:55:45.113 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:55:45.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:55:45.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:55:45.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:55:45.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:46.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:46 smithi163 bash[24253]: audit 2024-08-31T03:55:44.673256+0000 mgr.a (mgr.14388) 4519 : audit [DBG] from='client.107940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:46.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:46 smithi163 bash[24253]: cluster 2024-08-31T03:55:45.002095+0000 mgr.a (mgr.14388) 4520 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:46 smithi027 bash[22610]: audit 2024-08-31T03:55:44.673256+0000 mgr.a (mgr.14388) 4519 : audit [DBG] from='client.107940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:46 smithi027 bash[22610]: cluster 2024-08-31T03:55:45.002095+0000 mgr.a (mgr.14388) 4520 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:46 smithi191 bash[24992]: audit 2024-08-31T03:55:44.673256+0000 mgr.a (mgr.14388) 4519 : audit [DBG] from='client.107940 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:46 smithi191 bash[24992]: cluster 2024-08-31T03:55:45.002095+0000 mgr.a (mgr.14388) 4520 : cluster [DBG] pgmap v3132: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:48.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:48 smithi163 bash[24253]: cluster 2024-08-31T03:55:47.002908+0000 mgr.a (mgr.14388) 4521 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:48 smithi027 bash[22610]: cluster 2024-08-31T03:55:47.002908+0000 mgr.a (mgr.14388) 4521 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:48 smithi191 bash[24992]: cluster 2024-08-31T03:55:47.002908+0000 mgr.a (mgr.14388) 4521 : cluster [DBG] pgmap v3133: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:50.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:55:50.116 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:55:50.116 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:55:50.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:50 smithi163 bash[24253]: cluster 2024-08-31T03:55:49.005174+0000 mgr.a (mgr.14388) 4522 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:55:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:50 smithi027 bash[22610]: cluster 2024-08-31T03:55:49.005174+0000 mgr.a (mgr.14388) 4522 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:55:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:50 smithi191 bash[24992]: cluster 2024-08-31T03:55:49.005174+0000 mgr.a (mgr.14388) 4522 : cluster [DBG] pgmap v3134: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:55:50.898 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:55:50.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:55:50.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:55:50.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:55:50.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:52.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:52 smithi163 bash[24253]: audit 2024-08-31T03:55:50.452021+0000 mgr.a (mgr.14388) 4523 : audit [DBG] from='client.108012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:52.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:52 smithi163 bash[24253]: cluster 2024-08-31T03:55:51.006019+0000 mgr.a (mgr.14388) 4524 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:52 smithi027 bash[22610]: audit 2024-08-31T03:55:50.452021+0000 mgr.a (mgr.14388) 4523 : audit [DBG] from='client.108012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:52 smithi027 bash[22610]: cluster 2024-08-31T03:55:51.006019+0000 mgr.a (mgr.14388) 4524 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:52 smithi191 bash[24992]: audit 2024-08-31T03:55:50.452021+0000 mgr.a (mgr.14388) 4523 : audit [DBG] from='client.108012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:52 smithi191 bash[24992]: cluster 2024-08-31T03:55:51.006019+0000 mgr.a (mgr.14388) 4524 : cluster [DBG] pgmap v3135: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:54.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:54 smithi163 bash[24253]: cluster 2024-08-31T03:55:53.007803+0000 mgr.a (mgr.14388) 4525 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:55:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:54 smithi027 bash[22610]: cluster 2024-08-31T03:55:53.007803+0000 mgr.a (mgr.14388) 4525 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:55:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:54 smithi191 bash[24992]: cluster 2024-08-31T03:55:53.007803+0000 mgr.a (mgr.14388) 4525 : cluster [DBG] pgmap v3136: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:55:55.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:55:55.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:55:55.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:55:56.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:56 smithi163 bash[24253]: cluster 2024-08-31T03:55:55.009095+0000 mgr.a (mgr.14388) 4526 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:55:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:56 smithi027 bash[22610]: cluster 2024-08-31T03:55:55.009095+0000 mgr.a (mgr.14388) 4526 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:55:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:56 smithi191 bash[24992]: cluster 2024-08-31T03:55:55.009095+0000 mgr.a (mgr.14388) 4526 : cluster [DBG] pgmap v3137: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:55:56.628 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:55:56.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:55:56.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:55:56.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:55:56.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:55:58.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:58 smithi163 bash[24253]: audit 2024-08-31T03:55:56.227096+0000 mgr.a (mgr.14388) 4527 : audit [DBG] from='client.108087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:58.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:55:58 smithi163 bash[24253]: cluster 2024-08-31T03:55:57.010025+0000 mgr.a (mgr.14388) 4528 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:58 smithi027 bash[22610]: audit 2024-08-31T03:55:56.227096+0000 mgr.a (mgr.14388) 4527 : audit [DBG] from='client.108087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:55:58 smithi027 bash[22610]: cluster 2024-08-31T03:55:57.010025+0000 mgr.a (mgr.14388) 4528 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:55:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:58 smithi191 bash[24992]: audit 2024-08-31T03:55:56.227096+0000 mgr.a (mgr.14388) 4527 : audit [DBG] from='client.108087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:55:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:55:58 smithi191 bash[24992]: cluster 2024-08-31T03:55:57.010025+0000 mgr.a (mgr.14388) 4528 : cluster [DBG] pgmap v3138: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:00.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:00 smithi163 bash[24253]: cluster 2024-08-31T03:55:59.012243+0000 mgr.a (mgr.14388) 4529 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:56:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:00 smithi027 bash[22610]: cluster 2024-08-31T03:55:59.012243+0000 mgr.a (mgr.14388) 4529 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:56:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:00 smithi191 bash[24992]: cluster 2024-08-31T03:55:59.012243+0000 mgr.a (mgr.14388) 4529 : cluster [DBG] pgmap v3139: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:56:01.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:01.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:01.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:56:02.401 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:56:02.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:56:02.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:56:02.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:56:02.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:56:02.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:02 smithi163 bash[24253]: cluster 2024-08-31T03:56:01.012981+0000 mgr.a (mgr.14388) 4530 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:02 smithi027 bash[22610]: cluster 2024-08-31T03:56:01.012981+0000 mgr.a (mgr.14388) 4530 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:02 smithi191 bash[24992]: cluster 2024-08-31T03:56:01.012981+0000 mgr.a (mgr.14388) 4530 : cluster [DBG] pgmap v3140: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:03.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:03 smithi163 bash[24253]: audit 2024-08-31T03:56:01.966297+0000 mgr.a (mgr.14388) 4531 : audit [DBG] from='client.108162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:03 smithi027 bash[22610]: audit 2024-08-31T03:56:01.966297+0000 mgr.a (mgr.14388) 4531 : audit [DBG] from='client.108162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:03 smithi191 bash[24992]: audit 2024-08-31T03:56:01.966297+0000 mgr.a (mgr.14388) 4531 : audit [DBG] from='client.108162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:04.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:04 smithi163 bash[24253]: cluster 2024-08-31T03:56:03.015035+0000 mgr.a (mgr.14388) 4532 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:56:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:04 smithi027 bash[22610]: cluster 2024-08-31T03:56:03.015035+0000 mgr.a (mgr.14388) 4532 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:56:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:04 smithi191 bash[24992]: cluster 2024-08-31T03:56:03.015035+0000 mgr.a (mgr.14388) 4532 : cluster [DBG] pgmap v3141: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:56:05.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:05 smithi163 bash[24253]: cluster 2024-08-31T03:56:05.016346+0000 mgr.a (mgr.14388) 4533 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:56:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:05 smithi027 bash[22610]: cluster 2024-08-31T03:56:05.016346+0000 mgr.a (mgr.14388) 4533 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:56:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:05 smithi191 bash[24992]: cluster 2024-08-31T03:56:05.016346+0000 mgr.a (mgr.14388) 4533 : cluster [DBG] pgmap v3142: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:56:06.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:06 smithi163 bash[24253]: audit 2024-08-31T03:56:06.067194+0000 mon.a (mon.0) 1265 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:56:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:06 smithi027 bash[22610]: audit 2024-08-31T03:56:06.067194+0000 mon.a (mon.0) 1265 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:56:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:06 smithi191 bash[24992]: audit 2024-08-31T03:56:06.067194+0000 mon.a (mon.0) 1265 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:56:07.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:07.402 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:07.403 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:56:07.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:07 smithi163 bash[24253]: audit 2024-08-31T03:56:06.902094+0000 mon.a (mon.0) 1266 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:56:07.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:07 smithi163 bash[24253]: audit 2024-08-31T03:56:06.903914+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:56:07.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:07 smithi163 bash[24253]: audit 2024-08-31T03:56:06.912486+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:56:07.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:07 smithi163 bash[24253]: audit 2024-08-31T03:56:06.917169+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:56:07.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:07 smithi163 bash[24253]: audit 2024-08-31T03:56:06.919375+0000 mgr.a (mgr.14388) 4534 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:56:07.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:07 smithi163 bash[24253]: cluster 2024-08-31T03:56:07.016862+0000 mgr.a (mgr.14388) 4535 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:07 smithi027 bash[22610]: audit 2024-08-31T03:56:06.902094+0000 mon.a (mon.0) 1266 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:56:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:07 smithi027 bash[22610]: audit 2024-08-31T03:56:06.903914+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:56:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:07 smithi027 bash[22610]: audit 2024-08-31T03:56:06.912486+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:56:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:07 smithi027 bash[22610]: audit 2024-08-31T03:56:06.917169+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:56:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:07 smithi027 bash[22610]: audit 2024-08-31T03:56:06.919375+0000 mgr.a (mgr.14388) 4534 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:56:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:07 smithi027 bash[22610]: cluster 2024-08-31T03:56:07.016862+0000 mgr.a (mgr.14388) 4535 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:07 smithi191 bash[24992]: audit 2024-08-31T03:56:06.902094+0000 mon.a (mon.0) 1266 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:56:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:07 smithi191 bash[24992]: audit 2024-08-31T03:56:06.903914+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:56:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:07 smithi191 bash[24992]: audit 2024-08-31T03:56:06.912486+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:56:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:07 smithi191 bash[24992]: audit 2024-08-31T03:56:06.917169+0000 mon.a (mon.0) 1269 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:56:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:07 smithi191 bash[24992]: audit 2024-08-31T03:56:06.919375+0000 mgr.a (mgr.14388) 4534 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:56:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:07 smithi191 bash[24992]: cluster 2024-08-31T03:56:07.016862+0000 mgr.a (mgr.14388) 4535 : cluster [DBG] pgmap v3143: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:07.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:56:07 smithi027 bash[22863]: debug 2024-08-31T03:56:07.632+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:56:07.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:56:07 smithi027 bash[22863]: debug 2024-08-31T03:56:07.632+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:56:08.134 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:56:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:56:08.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:56:08.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:56:08.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:56:09.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:08 smithi163 bash[24253]: audit 2024-08-31T03:56:07.637511+0000 mgr.a (mgr.14388) 4536 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:56:09.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:08 smithi163 bash[24253]: cephadm 2024-08-31T03:56:07.638712+0000 mgr.a (mgr.14388) 4537 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:56:09.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:08 smithi163 bash[24253]: audit 2024-08-31T03:56:07.719928+0000 mgr.a (mgr.14388) 4538 : audit [DBG] from='client.108327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:08 smithi027 bash[22610]: audit 2024-08-31T03:56:07.637511+0000 mgr.a (mgr.14388) 4536 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:56:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:08 smithi027 bash[22610]: cephadm 2024-08-31T03:56:07.638712+0000 mgr.a (mgr.14388) 4537 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:56:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:08 smithi027 bash[22610]: audit 2024-08-31T03:56:07.719928+0000 mgr.a (mgr.14388) 4538 : audit [DBG] from='client.108327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:08 smithi191 bash[24992]: audit 2024-08-31T03:56:07.637511+0000 mgr.a (mgr.14388) 4536 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:56:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:08 smithi191 bash[24992]: cephadm 2024-08-31T03:56:07.638712+0000 mgr.a (mgr.14388) 4537 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:56:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:08 smithi191 bash[24992]: audit 2024-08-31T03:56:07.719928+0000 mgr.a (mgr.14388) 4538 : audit [DBG] from='client.108327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:10.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:09 smithi163 bash[24253]: cluster 2024-08-31T03:56:09.019253+0000 mgr.a (mgr.14388) 4539 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:56:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:09 smithi027 bash[22610]: cluster 2024-08-31T03:56:09.019253+0000 mgr.a (mgr.14388) 4539 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:56:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:09 smithi191 bash[24992]: cluster 2024-08-31T03:56:09.019253+0000 mgr.a (mgr.14388) 4539 : cluster [DBG] pgmap v3144: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:56:12.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:12 smithi163 bash[24253]: cluster 2024-08-31T03:56:11.020040+0000 mgr.a (mgr.14388) 4540 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:56:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:12 smithi027 bash[22610]: cluster 2024-08-31T03:56:11.020040+0000 mgr.a (mgr.14388) 4540 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:56:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:12 smithi191 bash[24992]: cluster 2024-08-31T03:56:11.020040+0000 mgr.a (mgr.14388) 4540 : cluster [DBG] pgmap v3145: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:56:13.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:13.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:13.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:56:13.921 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:56:13.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:56:13.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:56:13.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:56:13.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:56:14.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:14 smithi163 bash[24253]: cluster 2024-08-31T03:56:13.021567+0000 mgr.a (mgr.14388) 4541 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:56:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:14 smithi027 bash[22610]: cluster 2024-08-31T03:56:13.021567+0000 mgr.a (mgr.14388) 4541 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:56:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:14 smithi191 bash[24992]: cluster 2024-08-31T03:56:13.021567+0000 mgr.a (mgr.14388) 4541 : cluster [DBG] pgmap v3146: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:56:15.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:15 smithi163 bash[24253]: audit 2024-08-31T03:56:13.475548+0000 mgr.a (mgr.14388) 4542 : audit [DBG] from='client.108417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:15 smithi027 bash[22610]: audit 2024-08-31T03:56:13.475548+0000 mgr.a (mgr.14388) 4542 : audit [DBG] from='client.108417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:15 smithi191 bash[24992]: audit 2024-08-31T03:56:13.475548+0000 mgr.a (mgr.14388) 4542 : audit [DBG] from='client.108417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:16.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:16 smithi163 bash[24253]: cluster 2024-08-31T03:56:15.023390+0000 mgr.a (mgr.14388) 4543 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:56:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:16 smithi027 bash[22610]: cluster 2024-08-31T03:56:15.023390+0000 mgr.a (mgr.14388) 4543 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:56:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:16 smithi191 bash[24992]: cluster 2024-08-31T03:56:15.023390+0000 mgr.a (mgr.14388) 4543 : cluster [DBG] pgmap v3147: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:56:18.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:18 smithi163 bash[24253]: cluster 2024-08-31T03:56:17.024202+0000 mgr.a (mgr.14388) 4544 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:56:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:18 smithi027 bash[22610]: cluster 2024-08-31T03:56:17.024202+0000 mgr.a (mgr.14388) 4544 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:56:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:18 smithi191 bash[24992]: cluster 2024-08-31T03:56:17.024202+0000 mgr.a (mgr.14388) 4544 : cluster [DBG] pgmap v3148: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:56:18.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:18.924 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:56:19.702 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:56:19.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:56:19.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:56:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:56:19.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:56:20.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:20 smithi163 bash[24253]: cluster 2024-08-31T03:56:19.025337+0000 mgr.a (mgr.14388) 4545 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:56:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:20 smithi027 bash[22610]: cluster 2024-08-31T03:56:19.025337+0000 mgr.a (mgr.14388) 4545 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:56:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:20 smithi191 bash[24992]: cluster 2024-08-31T03:56:19.025337+0000 mgr.a (mgr.14388) 4545 : cluster [DBG] pgmap v3149: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:56:21.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:21 smithi163 bash[24253]: audit 2024-08-31T03:56:19.262145+0000 mgr.a (mgr.14388) 4546 : audit [DBG] from='client.108492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:21 smithi027 bash[22610]: audit 2024-08-31T03:56:19.262145+0000 mgr.a (mgr.14388) 4546 : audit [DBG] from='client.108492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:21 smithi191 bash[24992]: audit 2024-08-31T03:56:19.262145+0000 mgr.a (mgr.14388) 4546 : audit [DBG] from='client.108492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:22.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:22 smithi163 bash[24253]: cluster 2024-08-31T03:56:21.026350+0000 mgr.a (mgr.14388) 4547 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:56:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:22 smithi027 bash[22610]: cluster 2024-08-31T03:56:21.026350+0000 mgr.a (mgr.14388) 4547 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:56:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:22 smithi191 bash[24992]: cluster 2024-08-31T03:56:21.026350+0000 mgr.a (mgr.14388) 4547 : cluster [DBG] pgmap v3150: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:56:24.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:24 smithi163 bash[24253]: cluster 2024-08-31T03:56:23.028158+0000 mgr.a (mgr.14388) 4548 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:56:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:24 smithi027 bash[22610]: cluster 2024-08-31T03:56:23.028158+0000 mgr.a (mgr.14388) 4548 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:56:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:24 smithi191 bash[24992]: cluster 2024-08-31T03:56:23.028158+0000 mgr.a (mgr.14388) 4548 : cluster [DBG] pgmap v3151: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T03:56:24.704 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:24.705 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:56:25.456 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:56:25.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:56:25.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:56:25.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:56:25.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:56:26.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:26 smithi163 bash[24253]: cluster 2024-08-31T03:56:25.029314+0000 mgr.a (mgr.14388) 4549 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:26.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:26 smithi163 bash[24253]: audit 2024-08-31T03:56:25.032296+0000 mgr.a (mgr.14388) 4550 : audit [DBG] from='client.108564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:26 smithi027 bash[22610]: cluster 2024-08-31T03:56:25.029314+0000 mgr.a (mgr.14388) 4549 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:26 smithi027 bash[22610]: audit 2024-08-31T03:56:25.032296+0000 mgr.a (mgr.14388) 4550 : audit [DBG] from='client.108564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:26 smithi191 bash[24992]: cluster 2024-08-31T03:56:25.029314+0000 mgr.a (mgr.14388) 4549 : cluster [DBG] pgmap v3152: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:26 smithi191 bash[24992]: audit 2024-08-31T03:56:25.032296+0000 mgr.a (mgr.14388) 4550 : audit [DBG] from='client.108564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:28.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:28 smithi163 bash[24253]: cluster 2024-08-31T03:56:27.030231+0000 mgr.a (mgr.14388) 4551 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:28 smithi027 bash[22610]: cluster 2024-08-31T03:56:27.030231+0000 mgr.a (mgr.14388) 4551 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:28 smithi191 bash[24992]: cluster 2024-08-31T03:56:27.030231+0000 mgr.a (mgr.14388) 4551 : cluster [DBG] pgmap v3153: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:30.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:30 smithi163 bash[24253]: cluster 2024-08-31T03:56:29.032414+0000 mgr.a (mgr.14388) 4552 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:56:30.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:30.458 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:30.458 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:56:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:30 smithi027 bash[22610]: cluster 2024-08-31T03:56:29.032414+0000 mgr.a (mgr.14388) 4552 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:56:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:30 smithi191 bash[24992]: cluster 2024-08-31T03:56:29.032414+0000 mgr.a (mgr.14388) 4552 : cluster [DBG] pgmap v3154: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:56:31.215 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:56:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:56:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:56:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:56:31.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:56:31.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:31 smithi163 bash[24253]: audit 2024-08-31T03:56:30.796915+0000 mgr.a (mgr.14388) 4553 : audit [DBG] from='client.108642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:31.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:31 smithi163 bash[24253]: cluster 2024-08-31T03:56:31.032982+0000 mgr.a (mgr.14388) 4554 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:31 smithi027 bash[22610]: audit 2024-08-31T03:56:30.796915+0000 mgr.a (mgr.14388) 4553 : audit [DBG] from='client.108642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:31 smithi027 bash[22610]: cluster 2024-08-31T03:56:31.032982+0000 mgr.a (mgr.14388) 4554 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:31 smithi191 bash[24992]: audit 2024-08-31T03:56:30.796915+0000 mgr.a (mgr.14388) 4553 : audit [DBG] from='client.108642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:31 smithi191 bash[24992]: cluster 2024-08-31T03:56:31.032982+0000 mgr.a (mgr.14388) 4554 : cluster [DBG] pgmap v3155: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:34.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:34 smithi163 bash[24253]: cluster 2024-08-31T03:56:33.034842+0000 mgr.a (mgr.14388) 4555 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:56:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:34 smithi027 bash[22610]: cluster 2024-08-31T03:56:33.034842+0000 mgr.a (mgr.14388) 4555 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:56:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:34 smithi191 bash[24992]: cluster 2024-08-31T03:56:33.034842+0000 mgr.a (mgr.14388) 4555 : cluster [DBG] pgmap v3156: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:56:36.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:36.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:36.218 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:56:36.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:36 smithi163 bash[24253]: cluster 2024-08-31T03:56:35.036075+0000 mgr.a (mgr.14388) 4556 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:56:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:36 smithi027 bash[22610]: cluster 2024-08-31T03:56:35.036075+0000 mgr.a (mgr.14388) 4556 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:56:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:36 smithi191 bash[24992]: cluster 2024-08-31T03:56:35.036075+0000 mgr.a (mgr.14388) 4556 : cluster [DBG] pgmap v3157: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:56:36.999 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:56:36.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:56:36.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:56:36.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:56:36.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:56:38.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:38 smithi163 bash[24253]: audit 2024-08-31T03:56:36.556210+0000 mgr.a (mgr.14388) 4557 : audit [DBG] from='client.108720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:38.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:38 smithi163 bash[24253]: cluster 2024-08-31T03:56:37.036900+0000 mgr.a (mgr.14388) 4558 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:38 smithi027 bash[22610]: audit 2024-08-31T03:56:36.556210+0000 mgr.a (mgr.14388) 4557 : audit [DBG] from='client.108720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:38 smithi027 bash[22610]: cluster 2024-08-31T03:56:37.036900+0000 mgr.a (mgr.14388) 4558 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:38 smithi191 bash[24992]: audit 2024-08-31T03:56:36.556210+0000 mgr.a (mgr.14388) 4557 : audit [DBG] from='client.108720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:38 smithi191 bash[24992]: cluster 2024-08-31T03:56:37.036900+0000 mgr.a (mgr.14388) 4558 : cluster [DBG] pgmap v3158: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:40.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:40 smithi163 bash[24253]: cluster 2024-08-31T03:56:39.039060+0000 mgr.a (mgr.14388) 4559 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:56:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:40 smithi027 bash[22610]: cluster 2024-08-31T03:56:39.039060+0000 mgr.a (mgr.14388) 4559 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:56:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:40 smithi191 bash[24992]: cluster 2024-08-31T03:56:39.039060+0000 mgr.a (mgr.14388) 4559 : cluster [DBG] pgmap v3159: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:56:42.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:42.001 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:42.001 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:56:42.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:42 smithi163 bash[24253]: cluster 2024-08-31T03:56:41.039859+0000 mgr.a (mgr.14388) 4560 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:42 smithi027 bash[22610]: cluster 2024-08-31T03:56:41.039859+0000 mgr.a (mgr.14388) 4560 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:42 smithi191 bash[24992]: cluster 2024-08-31T03:56:41.039859+0000 mgr.a (mgr.14388) 4560 : cluster [DBG] pgmap v3160: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:42.773 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:56:42.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:56:42.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:56:42.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:56:42.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:56:44.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:44 smithi163 bash[24253]: audit 2024-08-31T03:56:42.339798+0000 mgr.a (mgr.14388) 4561 : audit [DBG] from='client.108798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:44.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:44 smithi163 bash[24253]: cluster 2024-08-31T03:56:43.041841+0000 mgr.a (mgr.14388) 4562 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:56:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:44 smithi027 bash[22610]: audit 2024-08-31T03:56:42.339798+0000 mgr.a (mgr.14388) 4561 : audit [DBG] from='client.108798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:44 smithi027 bash[22610]: cluster 2024-08-31T03:56:43.041841+0000 mgr.a (mgr.14388) 4562 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:56:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:44 smithi191 bash[24992]: audit 2024-08-31T03:56:42.339798+0000 mgr.a (mgr.14388) 4561 : audit [DBG] from='client.108798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:44 smithi191 bash[24992]: cluster 2024-08-31T03:56:43.041841+0000 mgr.a (mgr.14388) 4562 : cluster [DBG] pgmap v3161: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T03:56:46.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:46 smithi163 bash[24253]: cluster 2024-08-31T03:56:45.043169+0000 mgr.a (mgr.14388) 4563 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:56:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:46 smithi027 bash[22610]: cluster 2024-08-31T03:56:45.043169+0000 mgr.a (mgr.14388) 4563 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:56:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:46 smithi191 bash[24992]: cluster 2024-08-31T03:56:45.043169+0000 mgr.a (mgr.14388) 4563 : cluster [DBG] pgmap v3162: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:56:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:47.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:47.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:56:48.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:48 smithi163 bash[24253]: cluster 2024-08-31T03:56:47.043955+0000 mgr.a (mgr.14388) 4564 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:48 smithi027 bash[22610]: cluster 2024-08-31T03:56:47.043955+0000 mgr.a (mgr.14388) 4564 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:48 smithi191 bash[24992]: cluster 2024-08-31T03:56:47.043955+0000 mgr.a (mgr.14388) 4564 : cluster [DBG] pgmap v3163: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:48.559 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:56:48.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:56:48.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:56:48.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:56:48.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:56:49.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:49 smithi163 bash[24253]: audit 2024-08-31T03:56:48.115135+0000 mgr.a (mgr.14388) 4565 : audit [DBG] from='client.108876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:49 smithi027 bash[22610]: audit 2024-08-31T03:56:48.115135+0000 mgr.a (mgr.14388) 4565 : audit [DBG] from='client.108876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:49 smithi191 bash[24992]: audit 2024-08-31T03:56:48.115135+0000 mgr.a (mgr.14388) 4565 : audit [DBG] from='client.108876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:50.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:50 smithi163 bash[24253]: cluster 2024-08-31T03:56:49.046780+0000 mgr.a (mgr.14388) 4566 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:50 smithi027 bash[22610]: cluster 2024-08-31T03:56:49.046780+0000 mgr.a (mgr.14388) 4566 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:50 smithi191 bash[24992]: cluster 2024-08-31T03:56:49.046780+0000 mgr.a (mgr.14388) 4566 : cluster [DBG] pgmap v3164: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:56:51.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:51 smithi163 bash[24253]: cluster 2024-08-31T03:56:51.047610+0000 mgr.a (mgr.14388) 4567 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:56:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:51 smithi027 bash[22610]: cluster 2024-08-31T03:56:51.047610+0000 mgr.a (mgr.14388) 4567 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:56:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:51 smithi191 bash[24992]: cluster 2024-08-31T03:56:51.047610+0000 mgr.a (mgr.14388) 4567 : cluster [DBG] pgmap v3165: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:56:53.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:53.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:53.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:56:54.332 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:56:54.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:56:54.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:56:54.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:56:54.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:56:54.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:54 smithi163 bash[24253]: cluster 2024-08-31T03:56:53.049154+0000 mgr.a (mgr.14388) 4568 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:56:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:54 smithi027 bash[22610]: cluster 2024-08-31T03:56:53.049154+0000 mgr.a (mgr.14388) 4568 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:56:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:54 smithi191 bash[24992]: cluster 2024-08-31T03:56:53.049154+0000 mgr.a (mgr.14388) 4568 : cluster [DBG] pgmap v3166: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T03:56:55.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:55 smithi163 bash[24253]: audit 2024-08-31T03:56:53.893367+0000 mgr.a (mgr.14388) 4569 : audit [DBG] from='client.108951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:55 smithi027 bash[22610]: audit 2024-08-31T03:56:53.893367+0000 mgr.a (mgr.14388) 4569 : audit [DBG] from='client.108951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:55 smithi191 bash[24992]: audit 2024-08-31T03:56:53.893367+0000 mgr.a (mgr.14388) 4569 : audit [DBG] from='client.108951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:56:56.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:56 smithi163 bash[24253]: cluster 2024-08-31T03:56:55.051043+0000 mgr.a (mgr.14388) 4570 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:56:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:56 smithi027 bash[22610]: cluster 2024-08-31T03:56:55.051043+0000 mgr.a (mgr.14388) 4570 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:56:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:56 smithi191 bash[24992]: cluster 2024-08-31T03:56:55.051043+0000 mgr.a (mgr.14388) 4570 : cluster [DBG] pgmap v3167: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T03:56:58.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:56:58 smithi163 bash[24253]: cluster 2024-08-31T03:56:57.051842+0000 mgr.a (mgr.14388) 4571 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:56:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:56:58 smithi027 bash[22610]: cluster 2024-08-31T03:56:57.051842+0000 mgr.a (mgr.14388) 4571 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:56:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:56:58 smithi191 bash[24992]: cluster 2024-08-31T03:56:57.051842+0000 mgr.a (mgr.14388) 4571 : cluster [DBG] pgmap v3168: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:56:59.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:56:59.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:56:59.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:00.080 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:00.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:00.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:00.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:00.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:00.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:00 smithi163 bash[24253]: cluster 2024-08-31T03:56:59.053888+0000 mgr.a (mgr.14388) 4572 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:00 smithi027 bash[22610]: cluster 2024-08-31T03:56:59.053888+0000 mgr.a (mgr.14388) 4572 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:00 smithi191 bash[24992]: cluster 2024-08-31T03:56:59.053888+0000 mgr.a (mgr.14388) 4572 : cluster [DBG] pgmap v3169: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:01.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:01 smithi163 bash[24253]: audit 2024-08-31T03:56:59.662804+0000 mgr.a (mgr.14388) 4573 : audit [DBG] from='client.109026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:01 smithi027 bash[22610]: audit 2024-08-31T03:56:59.662804+0000 mgr.a (mgr.14388) 4573 : audit [DBG] from='client.109026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:01 smithi191 bash[24992]: audit 2024-08-31T03:56:59.662804+0000 mgr.a (mgr.14388) 4573 : audit [DBG] from='client.109026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:02.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:02 smithi163 bash[24253]: cluster 2024-08-31T03:57:01.054843+0000 mgr.a (mgr.14388) 4574 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:02 smithi027 bash[22610]: cluster 2024-08-31T03:57:01.054843+0000 mgr.a (mgr.14388) 4574 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:02 smithi191 bash[24992]: cluster 2024-08-31T03:57:01.054843+0000 mgr.a (mgr.14388) 4574 : cluster [DBG] pgmap v3170: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:03.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:03 smithi163 bash[24253]: cluster 2024-08-31T03:57:03.056992+0000 mgr.a (mgr.14388) 4575 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:03 smithi027 bash[22610]: cluster 2024-08-31T03:57:03.056992+0000 mgr.a (mgr.14388) 4575 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:03 smithi191 bash[24992]: cluster 2024-08-31T03:57:03.056992+0000 mgr.a (mgr.14388) 4575 : cluster [DBG] pgmap v3171: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:05.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:57:05.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:57:05.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:05.843 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:06.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:06 smithi163 bash[24253]: cluster 2024-08-31T03:57:05.057789+0000 mgr.a (mgr.14388) 4576 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:57:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:06 smithi027 bash[22610]: cluster 2024-08-31T03:57:05.057789+0000 mgr.a (mgr.14388) 4576 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:57:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:06 smithi191 bash[24992]: cluster 2024-08-31T03:57:05.057789+0000 mgr.a (mgr.14388) 4576 : cluster [DBG] pgmap v3172: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:57:07.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:07 smithi163 bash[24253]: audit 2024-08-31T03:57:05.413865+0000 mgr.a (mgr.14388) 4577 : audit [DBG] from='client.109104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:07 smithi027 bash[22610]: audit 2024-08-31T03:57:05.413865+0000 mgr.a (mgr.14388) 4577 : audit [DBG] from='client.109104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:07 smithi191 bash[24992]: audit 2024-08-31T03:57:05.413865+0000 mgr.a (mgr.14388) 4577 : audit [DBG] from='client.109104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:08.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:08 smithi163 bash[24253]: cluster 2024-08-31T03:57:07.058878+0000 mgr.a (mgr.14388) 4578 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:08.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:08 smithi163 bash[24253]: audit 2024-08-31T03:57:07.691398+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:57:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:08 smithi027 bash[22610]: cluster 2024-08-31T03:57:07.058878+0000 mgr.a (mgr.14388) 4578 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:08 smithi027 bash[22610]: audit 2024-08-31T03:57:07.691398+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:57:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:08 smithi191 bash[24992]: cluster 2024-08-31T03:57:07.058878+0000 mgr.a (mgr.14388) 4578 : cluster [DBG] pgmap v3173: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:08 smithi191 bash[24992]: audit 2024-08-31T03:57:07.691398+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:57:10.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:10 smithi163 bash[24253]: cluster 2024-08-31T03:57:09.061158+0000 mgr.a (mgr.14388) 4579 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:10 smithi027 bash[22610]: cluster 2024-08-31T03:57:09.061158+0000 mgr.a (mgr.14388) 4579 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:10 smithi191 bash[24992]: cluster 2024-08-31T03:57:09.061158+0000 mgr.a (mgr.14388) 4579 : cluster [DBG] pgmap v3174: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:57:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:57:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:11.576 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:11.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:11.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:11.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:11.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:12.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:12 smithi163 bash[24253]: cluster 2024-08-31T03:57:11.061681+0000 mgr.a (mgr.14388) 4580 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:12 smithi027 bash[22610]: cluster 2024-08-31T03:57:11.061681+0000 mgr.a (mgr.14388) 4580 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:12 smithi191 bash[24992]: cluster 2024-08-31T03:57:11.061681+0000 mgr.a (mgr.14388) 4580 : cluster [DBG] pgmap v3175: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:13.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:13 smithi163 bash[24253]: audit 2024-08-31T03:57:11.164501+0000 mgr.a (mgr.14388) 4581 : audit [DBG] from='client.109179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:13.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:13 smithi163 bash[24253]: audit 2024-08-31T03:57:13.024015+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:13 smithi163 bash[24253]: audit 2024-08-31T03:57:13.028307+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:13 smithi163 bash[24253]: audit 2024-08-31T03:57:13.065840+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:13 smithi163 bash[24253]: audit 2024-08-31T03:57:13.068773+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:13 smithi163 bash[24253]: audit 2024-08-31T03:57:13.074150+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:13 smithi163 bash[24253]: audit 2024-08-31T03:57:13.076884+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:13 smithi027 bash[22610]: audit 2024-08-31T03:57:11.164501+0000 mgr.a (mgr.14388) 4581 : audit [DBG] from='client.109179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:13 smithi027 bash[22610]: audit 2024-08-31T03:57:13.024015+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:13 smithi027 bash[22610]: audit 2024-08-31T03:57:13.028307+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:13 smithi027 bash[22610]: audit 2024-08-31T03:57:13.065840+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:13 smithi027 bash[22610]: audit 2024-08-31T03:57:13.068773+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:13 smithi027 bash[22610]: audit 2024-08-31T03:57:13.074150+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:13 smithi027 bash[22610]: audit 2024-08-31T03:57:13.076884+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:13 smithi191 bash[24992]: audit 2024-08-31T03:57:11.164501+0000 mgr.a (mgr.14388) 4581 : audit [DBG] from='client.109179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:13 smithi191 bash[24992]: audit 2024-08-31T03:57:13.024015+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:13 smithi191 bash[24992]: audit 2024-08-31T03:57:13.028307+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:13 smithi191 bash[24992]: audit 2024-08-31T03:57:13.065840+0000 mon.a (mon.0) 1273 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:13 smithi191 bash[24992]: audit 2024-08-31T03:57:13.068773+0000 mon.a (mon.0) 1274 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:13 smithi191 bash[24992]: audit 2024-08-31T03:57:13.074150+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:13 smithi191 bash[24992]: audit 2024-08-31T03:57:13.076884+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:14.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:14 smithi163 bash[24253]: cluster 2024-08-31T03:57:13.062662+0000 mgr.a (mgr.14388) 4582 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:14.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:14 smithi163 bash[24253]: audit 2024-08-31T03:57:13.810544+0000 mon.a (mon.0) 1277 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:57:14.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:14 smithi163 bash[24253]: audit 2024-08-31T03:57:13.812126+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:57:14.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:14 smithi163 bash[24253]: audit 2024-08-31T03:57:13.822173+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:14.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:14 smithi163 bash[24253]: audit 2024-08-31T03:57:13.825159+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:57:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:14 smithi027 bash[22610]: cluster 2024-08-31T03:57:13.062662+0000 mgr.a (mgr.14388) 4582 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:14 smithi027 bash[22610]: audit 2024-08-31T03:57:13.810544+0000 mon.a (mon.0) 1277 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:57:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:14 smithi027 bash[22610]: audit 2024-08-31T03:57:13.812126+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:57:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:14 smithi027 bash[22610]: audit 2024-08-31T03:57:13.822173+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:14 smithi027 bash[22610]: audit 2024-08-31T03:57:13.825159+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:57:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:14 smithi191 bash[24992]: cluster 2024-08-31T03:57:13.062662+0000 mgr.a (mgr.14388) 4582 : cluster [DBG] pgmap v3176: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:14 smithi191 bash[24992]: audit 2024-08-31T03:57:13.810544+0000 mon.a (mon.0) 1277 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:57:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:14 smithi191 bash[24992]: audit 2024-08-31T03:57:13.812126+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:57:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:14 smithi191 bash[24992]: audit 2024-08-31T03:57:13.822173+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:57:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:14 smithi191 bash[24992]: audit 2024-08-31T03:57:13.825159+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:57:14.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:57:14 smithi027 bash[22863]: debug 2024-08-31T03:57:14.551+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:57:14.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:57:14 smithi027 bash[22863]: debug 2024-08-31T03:57:14.551+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:57:15.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:15 smithi163 bash[24253]: audit 2024-08-31T03:57:13.827405+0000 mgr.a (mgr.14388) 4583 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:57:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:15 smithi027 bash[22610]: audit 2024-08-31T03:57:13.827405+0000 mgr.a (mgr.14388) 4583 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:57:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:15 smithi191 bash[24992]: audit 2024-08-31T03:57:13.827405+0000 mgr.a (mgr.14388) 4583 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:57:16.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:16 smithi163 bash[24253]: audit 2024-08-31T03:57:14.556486+0000 mgr.a (mgr.14388) 4584 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:57:16.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:16 smithi163 bash[24253]: cephadm 2024-08-31T03:57:14.558038+0000 mgr.a (mgr.14388) 4585 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:57:16.443 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:16 smithi163 bash[24253]: cluster 2024-08-31T03:57:15.063539+0000 mgr.a (mgr.14388) 4586 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:16 smithi027 bash[22610]: audit 2024-08-31T03:57:14.556486+0000 mgr.a (mgr.14388) 4584 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:57:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:16 smithi027 bash[22610]: cephadm 2024-08-31T03:57:14.558038+0000 mgr.a (mgr.14388) 4585 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:57:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:16 smithi027 bash[22610]: cluster 2024-08-31T03:57:15.063539+0000 mgr.a (mgr.14388) 4586 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:16 smithi191 bash[24992]: audit 2024-08-31T03:57:14.556486+0000 mgr.a (mgr.14388) 4584 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:57:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:16 smithi191 bash[24992]: cephadm 2024-08-31T03:57:14.558038+0000 mgr.a (mgr.14388) 4585 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:57:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:16 smithi191 bash[24992]: cluster 2024-08-31T03:57:15.063539+0000 mgr.a (mgr.14388) 4586 : cluster [DBG] pgmap v3177: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:16.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:57:16.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:57:16.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:17.335 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:17.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:17.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:17.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:17.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:17 smithi027 bash[22610]: audit 2024-08-31T03:57:16.912532+0000 mgr.a (mgr.14388) 4587 : audit [DBG] from='client.109359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:17 smithi027 bash[22610]: cluster 2024-08-31T03:57:17.064083+0000 mgr.a (mgr.14388) 4588 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:17 smithi191 bash[24992]: audit 2024-08-31T03:57:16.912532+0000 mgr.a (mgr.14388) 4587 : audit [DBG] from='client.109359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:17 smithi191 bash[24992]: cluster 2024-08-31T03:57:17.064083+0000 mgr.a (mgr.14388) 4588 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:17 smithi163 bash[24253]: audit 2024-08-31T03:57:16.912532+0000 mgr.a (mgr.14388) 4587 : audit [DBG] from='client.109359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:17 smithi163 bash[24253]: cluster 2024-08-31T03:57:17.064083+0000 mgr.a (mgr.14388) 4588 : cluster [DBG] pgmap v3178: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:20.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:20 smithi163 bash[24253]: cluster 2024-08-31T03:57:19.066478+0000 mgr.a (mgr.14388) 4589 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:20 smithi027 bash[22610]: cluster 2024-08-31T03:57:19.066478+0000 mgr.a (mgr.14388) 4589 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:20 smithi191 bash[24992]: cluster 2024-08-31T03:57:19.066478+0000 mgr.a (mgr.14388) 4589 : cluster [DBG] pgmap v3179: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:22.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:57:22.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:57:22.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:22.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:22 smithi163 bash[24253]: cluster 2024-08-31T03:57:21.067432+0000 mgr.a (mgr.14388) 4590 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:22 smithi027 bash[22610]: cluster 2024-08-31T03:57:21.067432+0000 mgr.a (mgr.14388) 4590 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:22 smithi191 bash[24992]: cluster 2024-08-31T03:57:21.067432+0000 mgr.a (mgr.14388) 4590 : cluster [DBG] pgmap v3180: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:23.087 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:23.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:23.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:23.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:23.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:24.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:24 smithi163 bash[24253]: audit 2024-08-31T03:57:22.667448+0000 mgr.a (mgr.14388) 4591 : audit [DBG] from='client.109437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:24.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:24 smithi163 bash[24253]: cluster 2024-08-31T03:57:23.068927+0000 mgr.a (mgr.14388) 4592 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:24 smithi027 bash[22610]: audit 2024-08-31T03:57:22.667448+0000 mgr.a (mgr.14388) 4591 : audit [DBG] from='client.109437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:24 smithi027 bash[22610]: cluster 2024-08-31T03:57:23.068927+0000 mgr.a (mgr.14388) 4592 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:24 smithi191 bash[24992]: audit 2024-08-31T03:57:22.667448+0000 mgr.a (mgr.14388) 4591 : audit [DBG] from='client.109437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:24 smithi191 bash[24992]: cluster 2024-08-31T03:57:23.068927+0000 mgr.a (mgr.14388) 4592 : cluster [DBG] pgmap v3181: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:26.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:26 smithi163 bash[24253]: cluster 2024-08-31T03:57:25.069675+0000 mgr.a (mgr.14388) 4593 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:57:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:26 smithi027 bash[22610]: cluster 2024-08-31T03:57:25.069675+0000 mgr.a (mgr.14388) 4593 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:57:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:26 smithi191 bash[24992]: cluster 2024-08-31T03:57:25.069675+0000 mgr.a (mgr.14388) 4593 : cluster [DBG] pgmap v3182: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:57:28.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:57:28.090 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:57:28.090 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:28.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:28 smithi163 bash[24253]: cluster 2024-08-31T03:57:27.070465+0000 mgr.a (mgr.14388) 4594 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:57:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:28 smithi027 bash[22610]: cluster 2024-08-31T03:57:27.070465+0000 mgr.a (mgr.14388) 4594 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:57:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:28 smithi191 bash[24992]: cluster 2024-08-31T03:57:27.070465+0000 mgr.a (mgr.14388) 4594 : cluster [DBG] pgmap v3183: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:57:28.854 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:28.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:28.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:28.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:28.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:30.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:30 smithi163 bash[24253]: audit 2024-08-31T03:57:28.424886+0000 mgr.a (mgr.14388) 4595 : audit [DBG] from='client.109512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:30.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:30 smithi163 bash[24253]: cluster 2024-08-31T03:57:29.073128+0000 mgr.a (mgr.14388) 4596 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:30 smithi027 bash[22610]: audit 2024-08-31T03:57:28.424886+0000 mgr.a (mgr.14388) 4595 : audit [DBG] from='client.109512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:30 smithi027 bash[22610]: cluster 2024-08-31T03:57:29.073128+0000 mgr.a (mgr.14388) 4596 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:30 smithi191 bash[24992]: audit 2024-08-31T03:57:28.424886+0000 mgr.a (mgr.14388) 4595 : audit [DBG] from='client.109512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:30 smithi191 bash[24992]: cluster 2024-08-31T03:57:29.073128+0000 mgr.a (mgr.14388) 4596 : cluster [DBG] pgmap v3184: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:57:31.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:31 smithi163 bash[24253]: cluster 2024-08-31T03:57:31.074042+0000 mgr.a (mgr.14388) 4597 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:57:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:31 smithi027 bash[22610]: cluster 2024-08-31T03:57:31.074042+0000 mgr.a (mgr.14388) 4597 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:57:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:31 smithi191 bash[24992]: cluster 2024-08-31T03:57:31.074042+0000 mgr.a (mgr.14388) 4597 : cluster [DBG] pgmap v3185: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T03:57:33.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:57:33.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:57:33.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:34.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:34 smithi163 bash[24253]: cluster 2024-08-31T03:57:33.075993+0000 mgr.a (mgr.14388) 4598 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:34 smithi027 bash[22610]: cluster 2024-08-31T03:57:33.075993+0000 mgr.a (mgr.14388) 4598 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:34 smithi191 bash[24992]: cluster 2024-08-31T03:57:33.075993+0000 mgr.a (mgr.14388) 4598 : cluster [DBG] pgmap v3186: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:34.634 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:36.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:36 smithi163 bash[24253]: audit 2024-08-31T03:57:34.193816+0000 mgr.a (mgr.14388) 4599 : audit [DBG] from='client.109587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:36.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:36 smithi163 bash[24253]: cluster 2024-08-31T03:57:35.076930+0000 mgr.a (mgr.14388) 4600 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:36 smithi027 bash[22610]: audit 2024-08-31T03:57:34.193816+0000 mgr.a (mgr.14388) 4599 : audit [DBG] from='client.109587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:36 smithi027 bash[22610]: cluster 2024-08-31T03:57:35.076930+0000 mgr.a (mgr.14388) 4600 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:36 smithi191 bash[24992]: audit 2024-08-31T03:57:34.193816+0000 mgr.a (mgr.14388) 4599 : audit [DBG] from='client.109587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:36 smithi191 bash[24992]: cluster 2024-08-31T03:57:35.076930+0000 mgr.a (mgr.14388) 4600 : cluster [DBG] pgmap v3187: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:38.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:38 smithi163 bash[24253]: cluster 2024-08-31T03:57:37.077776+0000 mgr.a (mgr.14388) 4601 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:38 smithi027 bash[22610]: cluster 2024-08-31T03:57:37.077776+0000 mgr.a (mgr.14388) 4601 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:38 smithi191 bash[24992]: cluster 2024-08-31T03:57:37.077776+0000 mgr.a (mgr.14388) 4601 : cluster [DBG] pgmap v3188: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:39.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:57:39.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:57:39.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:40.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:40.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:40.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:40.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:40.375 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:40.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:40 smithi163 bash[24253]: cluster 2024-08-31T03:57:39.080090+0000 mgr.a (mgr.14388) 4602 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:40 smithi027 bash[22610]: cluster 2024-08-31T03:57:39.080090+0000 mgr.a (mgr.14388) 4602 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:40 smithi191 bash[24992]: cluster 2024-08-31T03:57:39.080090+0000 mgr.a (mgr.14388) 4602 : cluster [DBG] pgmap v3189: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:41.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:41 smithi163 bash[24253]: audit 2024-08-31T03:57:39.959715+0000 mgr.a (mgr.14388) 4603 : audit [DBG] from='client.109665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:41 smithi027 bash[22610]: audit 2024-08-31T03:57:39.959715+0000 mgr.a (mgr.14388) 4603 : audit [DBG] from='client.109665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:41 smithi191 bash[24992]: audit 2024-08-31T03:57:39.959715+0000 mgr.a (mgr.14388) 4603 : audit [DBG] from='client.109665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:42.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:42 smithi163 bash[24253]: cluster 2024-08-31T03:57:41.081051+0000 mgr.a (mgr.14388) 4604 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:42 smithi027 bash[22610]: cluster 2024-08-31T03:57:41.081051+0000 mgr.a (mgr.14388) 4604 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:42 smithi191 bash[24992]: cluster 2024-08-31T03:57:41.081051+0000 mgr.a (mgr.14388) 4604 : cluster [DBG] pgmap v3190: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:43.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:43 smithi163 bash[24253]: cluster 2024-08-31T03:57:43.083251+0000 mgr.a (mgr.14388) 4605 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:43 smithi027 bash[22610]: cluster 2024-08-31T03:57:43.083251+0000 mgr.a (mgr.14388) 4605 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:43 smithi191 bash[24992]: cluster 2024-08-31T03:57:43.083251+0000 mgr.a (mgr.14388) 4605 : cluster [DBG] pgmap v3191: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:45.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:57:45.377 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:57:45.377 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:46.152 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:46.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:46.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:46.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:46.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:46.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:46 smithi163 bash[24253]: cluster 2024-08-31T03:57:45.084049+0000 mgr.a (mgr.14388) 4606 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:46 smithi027 bash[22610]: cluster 2024-08-31T03:57:45.084049+0000 mgr.a (mgr.14388) 4606 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:46 smithi191 bash[24992]: cluster 2024-08-31T03:57:45.084049+0000 mgr.a (mgr.14388) 4606 : cluster [DBG] pgmap v3192: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:47.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:47 smithi163 bash[24253]: audit 2024-08-31T03:57:45.713750+0000 mgr.a (mgr.14388) 4607 : audit [DBG] from='client.109740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:47 smithi027 bash[22610]: audit 2024-08-31T03:57:45.713750+0000 mgr.a (mgr.14388) 4607 : audit [DBG] from='client.109740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:47 smithi191 bash[24992]: audit 2024-08-31T03:57:45.713750+0000 mgr.a (mgr.14388) 4607 : audit [DBG] from='client.109740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:48.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:48 smithi163 bash[24253]: cluster 2024-08-31T03:57:47.084995+0000 mgr.a (mgr.14388) 4608 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:48 smithi027 bash[22610]: cluster 2024-08-31T03:57:47.084995+0000 mgr.a (mgr.14388) 4608 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:48 smithi191 bash[24992]: cluster 2024-08-31T03:57:47.084995+0000 mgr.a (mgr.14388) 4608 : cluster [DBG] pgmap v3193: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:49.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:49 smithi163 bash[24253]: cluster 2024-08-31T03:57:49.087317+0000 mgr.a (mgr.14388) 4609 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:49 smithi027 bash[22610]: cluster 2024-08-31T03:57:49.087317+0000 mgr.a (mgr.14388) 4609 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:49 smithi191 bash[24992]: cluster 2024-08-31T03:57:49.087317+0000 mgr.a (mgr.14388) 4609 : cluster [DBG] pgmap v3194: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:51.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:57:51.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:57:51.155 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:51.936 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:51.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:51.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:51.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:51.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:52.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:52 smithi163 bash[24253]: cluster 2024-08-31T03:57:51.088116+0000 mgr.a (mgr.14388) 4610 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:52 smithi027 bash[22610]: cluster 2024-08-31T03:57:51.088116+0000 mgr.a (mgr.14388) 4610 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:52 smithi191 bash[24992]: cluster 2024-08-31T03:57:51.088116+0000 mgr.a (mgr.14388) 4610 : cluster [DBG] pgmap v3195: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:53.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:53 smithi163 bash[24253]: audit 2024-08-31T03:57:51.491997+0000 mgr.a (mgr.14388) 4611 : audit [DBG] from='client.109818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:53 smithi027 bash[22610]: audit 2024-08-31T03:57:51.491997+0000 mgr.a (mgr.14388) 4611 : audit [DBG] from='client.109818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:53 smithi191 bash[24992]: audit 2024-08-31T03:57:51.491997+0000 mgr.a (mgr.14388) 4611 : audit [DBG] from='client.109818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:54.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:54 smithi163 bash[24253]: cluster 2024-08-31T03:57:53.090307+0000 mgr.a (mgr.14388) 4612 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:54 smithi027 bash[22610]: cluster 2024-08-31T03:57:53.090307+0000 mgr.a (mgr.14388) 4612 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:54 smithi191 bash[24992]: cluster 2024-08-31T03:57:53.090307+0000 mgr.a (mgr.14388) 4612 : cluster [DBG] pgmap v3196: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:57:55.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:55 smithi163 bash[24253]: cluster 2024-08-31T03:57:55.091088+0000 mgr.a (mgr.14388) 4613 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:55 smithi027 bash[22610]: cluster 2024-08-31T03:57:55.091088+0000 mgr.a (mgr.14388) 4613 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:55 smithi191 bash[24992]: cluster 2024-08-31T03:57:55.091088+0000 mgr.a (mgr.14388) 4613 : cluster [DBG] pgmap v3197: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:56.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:57:56.938 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:57:56.938 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:57:57.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:57:57.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:57:57.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:57:57.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:57:57.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:57:58.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:58 smithi163 bash[24253]: cluster 2024-08-31T03:57:57.091615+0000 mgr.a (mgr.14388) 4614 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:58 smithi027 bash[22610]: cluster 2024-08-31T03:57:57.091615+0000 mgr.a (mgr.14388) 4614 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:58 smithi191 bash[24992]: cluster 2024-08-31T03:57:57.091615+0000 mgr.a (mgr.14388) 4614 : cluster [DBG] pgmap v3198: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:57:59.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:57:59 smithi163 bash[24253]: audit 2024-08-31T03:57:57.275187+0000 mgr.a (mgr.14388) 4615 : audit [DBG] from='client.109890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:57:59 smithi027 bash[22610]: audit 2024-08-31T03:57:57.275187+0000 mgr.a (mgr.14388) 4615 : audit [DBG] from='client.109890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:57:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:57:59 smithi191 bash[24992]: audit 2024-08-31T03:57:57.275187+0000 mgr.a (mgr.14388) 4615 : audit [DBG] from='client.109890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:00.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:00 smithi163 bash[24253]: cluster 2024-08-31T03:57:59.093997+0000 mgr.a (mgr.14388) 4616 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:58:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:00 smithi027 bash[22610]: cluster 2024-08-31T03:57:59.093997+0000 mgr.a (mgr.14388) 4616 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:58:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:00 smithi191 bash[24992]: cluster 2024-08-31T03:57:59.093997+0000 mgr.a (mgr.14388) 4616 : cluster [DBG] pgmap v3199: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:58:01.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:01 smithi163 bash[24253]: cluster 2024-08-31T03:58:01.094774+0000 mgr.a (mgr.14388) 4617 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:01 smithi027 bash[22610]: cluster 2024-08-31T03:58:01.094774+0000 mgr.a (mgr.14388) 4617 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:01 smithi191 bash[24992]: cluster 2024-08-31T03:58:01.094774+0000 mgr.a (mgr.14388) 4617 : cluster [DBG] pgmap v3200: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:58:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:58:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:58:03.449 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:58:03.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:58:03.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:58:03.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:58:03.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:58:04.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:04 smithi163 bash[24253]: audit 2024-08-31T03:58:03.047819+0000 mgr.a (mgr.14388) 4618 : audit [DBG] from='client.109965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:04.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:04 smithi163 bash[24253]: cluster 2024-08-31T03:58:03.096041+0000 mgr.a (mgr.14388) 4619 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:04 smithi027 bash[22610]: audit 2024-08-31T03:58:03.047819+0000 mgr.a (mgr.14388) 4618 : audit [DBG] from='client.109965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:04 smithi027 bash[22610]: cluster 2024-08-31T03:58:03.096041+0000 mgr.a (mgr.14388) 4619 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:04 smithi191 bash[24992]: audit 2024-08-31T03:58:03.047819+0000 mgr.a (mgr.14388) 4618 : audit [DBG] from='client.109965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:04 smithi191 bash[24992]: cluster 2024-08-31T03:58:03.096041+0000 mgr.a (mgr.14388) 4619 : cluster [DBG] pgmap v3201: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:05 smithi027 bash[22610]: cluster 2024-08-31T03:58:05.097029+0000 mgr.a (mgr.14388) 4620 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:05 smithi191 bash[24992]: cluster 2024-08-31T03:58:05.097029+0000 mgr.a (mgr.14388) 4620 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:05.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:05 smithi163 bash[24253]: cluster 2024-08-31T03:58:05.097029+0000 mgr.a (mgr.14388) 4620 : cluster [DBG] pgmap v3202: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:07 smithi027 bash[22610]: cluster 2024-08-31T03:58:07.097994+0000 mgr.a (mgr.14388) 4621 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:07 smithi191 bash[24992]: cluster 2024-08-31T03:58:07.097994+0000 mgr.a (mgr.14388) 4621 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:07.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:07 smithi163 bash[24253]: cluster 2024-08-31T03:58:07.097994+0000 mgr.a (mgr.14388) 4621 : cluster [DBG] pgmap v3203: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:08.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:58:08.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:58:08.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:58:09.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:58:09.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:58:09.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:58:09.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:58:09.211 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:58:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:09 smithi027 bash[22610]: audit 2024-08-31T03:58:08.785020+0000 mgr.a (mgr.14388) 4622 : audit [DBG] from='client.110043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:09 smithi027 bash[22610]: cluster 2024-08-31T03:58:09.099413+0000 mgr.a (mgr.14388) 4623 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:09 smithi191 bash[24992]: audit 2024-08-31T03:58:08.785020+0000 mgr.a (mgr.14388) 4622 : audit [DBG] from='client.110043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:09 smithi191 bash[24992]: cluster 2024-08-31T03:58:09.099413+0000 mgr.a (mgr.14388) 4623 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:09.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:09 smithi163 bash[24253]: audit 2024-08-31T03:58:08.785020+0000 mgr.a (mgr.14388) 4622 : audit [DBG] from='client.110043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:09.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:09 smithi163 bash[24253]: cluster 2024-08-31T03:58:09.099413+0000 mgr.a (mgr.14388) 4623 : cluster [DBG] pgmap v3204: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:11 smithi027 bash[22610]: cluster 2024-08-31T03:58:11.100283+0000 mgr.a (mgr.14388) 4624 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:11 smithi191 bash[24992]: cluster 2024-08-31T03:58:11.100283+0000 mgr.a (mgr.14388) 4624 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:11.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:11 smithi163 bash[24253]: cluster 2024-08-31T03:58:11.100283+0000 mgr.a (mgr.14388) 4624 : cluster [DBG] pgmap v3205: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:13 smithi027 bash[22610]: cluster 2024-08-31T03:58:13.102360+0000 mgr.a (mgr.14388) 4625 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:13 smithi191 bash[24992]: cluster 2024-08-31T03:58:13.102360+0000 mgr.a (mgr.14388) 4625 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:13.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:13 smithi163 bash[24253]: cluster 2024-08-31T03:58:13.102360+0000 mgr.a (mgr.14388) 4625 : cluster [DBG] pgmap v3206: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:14.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:58:14.213 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:58:14.213 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:58:14.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:14 smithi163 bash[24253]: audit 2024-08-31T03:58:14.608847+0000 mon.a (mon.0) 1281 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:58:14.976 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:58:14.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:58:14.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:58:14.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:58:14.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:58:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:14 smithi027 bash[22610]: audit 2024-08-31T03:58:14.608847+0000 mon.a (mon.0) 1281 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:58:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:14 smithi191 bash[24992]: audit 2024-08-31T03:58:14.608847+0000 mon.a (mon.0) 1281 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:58:15.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:15 smithi163 bash[24253]: audit 2024-08-31T03:58:14.544408+0000 mgr.a (mgr.14388) 4626 : audit [DBG] from='client.110121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:15.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:15 smithi163 bash[24253]: cluster 2024-08-31T03:58:15.103406+0000 mgr.a (mgr.14388) 4627 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:15.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:15 smithi163 bash[24253]: audit 2024-08-31T03:58:15.393922+0000 mon.a (mon.0) 1282 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:58:15.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:15 smithi163 bash[24253]: audit 2024-08-31T03:58:15.395455+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:58:15.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:15 smithi163 bash[24253]: audit 2024-08-31T03:58:15.404431+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:58:15.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:15 smithi163 bash[24253]: audit 2024-08-31T03:58:15.407098+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:58:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:15 smithi027 bash[22610]: audit 2024-08-31T03:58:14.544408+0000 mgr.a (mgr.14388) 4626 : audit [DBG] from='client.110121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:15 smithi027 bash[22610]: cluster 2024-08-31T03:58:15.103406+0000 mgr.a (mgr.14388) 4627 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:15 smithi027 bash[22610]: audit 2024-08-31T03:58:15.393922+0000 mon.a (mon.0) 1282 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:58:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:15 smithi027 bash[22610]: audit 2024-08-31T03:58:15.395455+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:58:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:15 smithi027 bash[22610]: audit 2024-08-31T03:58:15.404431+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:58:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:15 smithi027 bash[22610]: audit 2024-08-31T03:58:15.407098+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:58:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:15 smithi191 bash[24992]: audit 2024-08-31T03:58:14.544408+0000 mgr.a (mgr.14388) 4626 : audit [DBG] from='client.110121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:15 smithi191 bash[24992]: cluster 2024-08-31T03:58:15.103406+0000 mgr.a (mgr.14388) 4627 : cluster [DBG] pgmap v3207: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:15 smithi191 bash[24992]: audit 2024-08-31T03:58:15.393922+0000 mon.a (mon.0) 1282 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:58:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:15 smithi191 bash[24992]: audit 2024-08-31T03:58:15.395455+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:58:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:15 smithi191 bash[24992]: audit 2024-08-31T03:58:15.404431+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:58:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:15 smithi191 bash[24992]: audit 2024-08-31T03:58:15.407098+0000 mon.a (mon.0) 1285 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:58:16.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:58:16 smithi027 bash[22863]: debug 2024-08-31T03:58:16.109+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:58:16.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:58:16 smithi027 bash[22863]: debug 2024-08-31T03:58:16.109+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:58:16.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:16 smithi163 bash[24253]: audit 2024-08-31T03:58:15.409644+0000 mgr.a (mgr.14388) 4628 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:58:16.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:16 smithi163 bash[24253]: audit 2024-08-31T03:58:16.113250+0000 mgr.a (mgr.14388) 4629 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:58:16.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:16 smithi163 bash[24253]: cephadm 2024-08-31T03:58:16.114686+0000 mgr.a (mgr.14388) 4630 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:58:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:16 smithi027 bash[22610]: audit 2024-08-31T03:58:15.409644+0000 mgr.a (mgr.14388) 4628 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:58:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:16 smithi027 bash[22610]: audit 2024-08-31T03:58:16.113250+0000 mgr.a (mgr.14388) 4629 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:58:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:16 smithi027 bash[22610]: cephadm 2024-08-31T03:58:16.114686+0000 mgr.a (mgr.14388) 4630 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:58:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:16 smithi191 bash[24992]: audit 2024-08-31T03:58:15.409644+0000 mgr.a (mgr.14388) 4628 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:58:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:16 smithi191 bash[24992]: audit 2024-08-31T03:58:16.113250+0000 mgr.a (mgr.14388) 4629 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:58:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:16 smithi191 bash[24992]: cephadm 2024-08-31T03:58:16.114686+0000 mgr.a (mgr.14388) 4630 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:58:17.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:17 smithi163 bash[24253]: cluster 2024-08-31T03:58:17.104317+0000 mgr.a (mgr.14388) 4631 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:17 smithi027 bash[22610]: cluster 2024-08-31T03:58:17.104317+0000 mgr.a (mgr.14388) 4631 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:17 smithi191 bash[24992]: cluster 2024-08-31T03:58:17.104317+0000 mgr.a (mgr.14388) 4631 : cluster [DBG] pgmap v3208: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:19 smithi027 bash[22610]: cluster 2024-08-31T03:58:19.106507+0000 mgr.a (mgr.14388) 4632 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:19 smithi191 bash[24992]: cluster 2024-08-31T03:58:19.106507+0000 mgr.a (mgr.14388) 4632 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:19.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:19 smithi163 bash[24253]: cluster 2024-08-31T03:58:19.106507+0000 mgr.a (mgr.14388) 4632 : cluster [DBG] pgmap v3209: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:19.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:58:19.979 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:58:19.979 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:58:20.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:58:20.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:58:20.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:58:20.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:58:20.737 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:58:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:21 smithi027 bash[22610]: audit 2024-08-31T03:58:20.315384+0000 mgr.a (mgr.14388) 4633 : audit [DBG] from='client.110307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:21 smithi027 bash[22610]: cluster 2024-08-31T03:58:21.107585+0000 mgr.a (mgr.14388) 4634 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:21 smithi191 bash[24992]: audit 2024-08-31T03:58:20.315384+0000 mgr.a (mgr.14388) 4633 : audit [DBG] from='client.110307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:21 smithi191 bash[24992]: cluster 2024-08-31T03:58:21.107585+0000 mgr.a (mgr.14388) 4634 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:21 smithi163 bash[24253]: audit 2024-08-31T03:58:20.315384+0000 mgr.a (mgr.14388) 4633 : audit [DBG] from='client.110307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:21 smithi163 bash[24253]: cluster 2024-08-31T03:58:21.107585+0000 mgr.a (mgr.14388) 4634 : cluster [DBG] pgmap v3210: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:23 smithi027 bash[22610]: cluster 2024-08-31T03:58:23.109845+0000 mgr.a (mgr.14388) 4635 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:23 smithi191 bash[24992]: cluster 2024-08-31T03:58:23.109845+0000 mgr.a (mgr.14388) 4635 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:23 smithi163 bash[24253]: cluster 2024-08-31T03:58:23.109845+0000 mgr.a (mgr.14388) 4635 : cluster [DBG] pgmap v3211: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:25 smithi027 bash[22610]: cluster 2024-08-31T03:58:25.110624+0000 mgr.a (mgr.14388) 4636 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:25 smithi191 bash[24992]: cluster 2024-08-31T03:58:25.110624+0000 mgr.a (mgr.14388) 4636 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:25.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:25 smithi163 bash[24253]: cluster 2024-08-31T03:58:25.110624+0000 mgr.a (mgr.14388) 4636 : cluster [DBG] pgmap v3212: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:25.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:58:25.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:58:25.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:58:26.480 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:58:26.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:58:26.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:58:26.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:58:26.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:58:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:26 smithi027 bash[22610]: audit 2024-08-31T03:58:26.071001+0000 mgr.a (mgr.14388) 4637 : audit [DBG] from='client.110382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:26 smithi191 bash[24992]: audit 2024-08-31T03:58:26.071001+0000 mgr.a (mgr.14388) 4637 : audit [DBG] from='client.110382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:26.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:26 smithi163 bash[24253]: audit 2024-08-31T03:58:26.071001+0000 mgr.a (mgr.14388) 4637 : audit [DBG] from='client.110382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:27 smithi027 bash[22610]: cluster 2024-08-31T03:58:27.111517+0000 mgr.a (mgr.14388) 4638 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:27 smithi191 bash[24992]: cluster 2024-08-31T03:58:27.111517+0000 mgr.a (mgr.14388) 4638 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:27.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:27 smithi163 bash[24253]: cluster 2024-08-31T03:58:27.111517+0000 mgr.a (mgr.14388) 4638 : cluster [DBG] pgmap v3213: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:29 smithi027 bash[22610]: cluster 2024-08-31T03:58:29.113675+0000 mgr.a (mgr.14388) 4639 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:29 smithi191 bash[24992]: cluster 2024-08-31T03:58:29.113675+0000 mgr.a (mgr.14388) 4639 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:29.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:29 smithi163 bash[24253]: cluster 2024-08-31T03:58:29.113675+0000 mgr.a (mgr.14388) 4639 : cluster [DBG] pgmap v3214: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:58:31.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:58:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:31 smithi027 bash[22610]: cluster 2024-08-31T03:58:31.114438+0000 mgr.a (mgr.14388) 4640 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:31.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:58:31.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:58:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:31 smithi191 bash[24992]: cluster 2024-08-31T03:58:31.114438+0000 mgr.a (mgr.14388) 4640 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:31.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:31 smithi163 bash[24253]: cluster 2024-08-31T03:58:31.114438+0000 mgr.a (mgr.14388) 4640 : cluster [DBG] pgmap v3215: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:32.259 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:58:32.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:58:32.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:58:32.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:58:32.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:58:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:32 smithi027 bash[22610]: audit 2024-08-31T03:58:31.817560+0000 mgr.a (mgr.14388) 4641 : audit [DBG] from='client.110460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:32 smithi191 bash[24992]: audit 2024-08-31T03:58:31.817560+0000 mgr.a (mgr.14388) 4641 : audit [DBG] from='client.110460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:32.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:32 smithi163 bash[24253]: audit 2024-08-31T03:58:31.817560+0000 mgr.a (mgr.14388) 4641 : audit [DBG] from='client.110460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:33 smithi027 bash[22610]: cluster 2024-08-31T03:58:33.116644+0000 mgr.a (mgr.14388) 4642 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:58:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:33 smithi191 bash[24992]: cluster 2024-08-31T03:58:33.116644+0000 mgr.a (mgr.14388) 4642 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:58:33.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:33 smithi163 bash[24253]: cluster 2024-08-31T03:58:33.116644+0000 mgr.a (mgr.14388) 4642 : cluster [DBG] pgmap v3216: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:58:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:35 smithi027 bash[22610]: cluster 2024-08-31T03:58:35.117400+0000 mgr.a (mgr.14388) 4643 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:35 smithi191 bash[24992]: cluster 2024-08-31T03:58:35.117400+0000 mgr.a (mgr.14388) 4643 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:35.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:35 smithi163 bash[24253]: cluster 2024-08-31T03:58:35.117400+0000 mgr.a (mgr.14388) 4643 : cluster [DBG] pgmap v3217: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:37.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:58:37.260 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:58:37.261 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:58:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:37 smithi027 bash[22610]: cluster 2024-08-31T03:58:37.118139+0000 mgr.a (mgr.14388) 4644 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:37 smithi191 bash[24992]: cluster 2024-08-31T03:58:37.118139+0000 mgr.a (mgr.14388) 4644 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:37.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:37 smithi163 bash[24253]: cluster 2024-08-31T03:58:37.118139+0000 mgr.a (mgr.14388) 4644 : cluster [DBG] pgmap v3218: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:37.999 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:58:38.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:58:38.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:58:38.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:58:38.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:58:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:38 smithi027 bash[22610]: audit 2024-08-31T03:58:37.591287+0000 mgr.a (mgr.14388) 4645 : audit [DBG] from='client.110538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:38.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:38 smithi191 bash[24992]: audit 2024-08-31T03:58:37.591287+0000 mgr.a (mgr.14388) 4645 : audit [DBG] from='client.110538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:38.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:38 smithi163 bash[24253]: audit 2024-08-31T03:58:37.591287+0000 mgr.a (mgr.14388) 4645 : audit [DBG] from='client.110538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:39 smithi027 bash[22610]: cluster 2024-08-31T03:58:39.120778+0000 mgr.a (mgr.14388) 4646 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:58:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:39 smithi191 bash[24992]: cluster 2024-08-31T03:58:39.120778+0000 mgr.a (mgr.14388) 4646 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:58:39.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:39 smithi163 bash[24253]: cluster 2024-08-31T03:58:39.120778+0000 mgr.a (mgr.14388) 4646 : cluster [DBG] pgmap v3219: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T03:58:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:41 smithi027 bash[22610]: cluster 2024-08-31T03:58:41.121543+0000 mgr.a (mgr.14388) 4647 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:58:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:41 smithi191 bash[24992]: cluster 2024-08-31T03:58:41.121543+0000 mgr.a (mgr.14388) 4647 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:58:41.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:41 smithi163 bash[24253]: cluster 2024-08-31T03:58:41.121543+0000 mgr.a (mgr.14388) 4647 : cluster [DBG] pgmap v3220: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:58:43.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:58:43.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:58:43.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:58:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:43 smithi027 bash[22610]: cluster 2024-08-31T03:58:43.122494+0000 mgr.a (mgr.14388) 4648 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:43 smithi191 bash[24992]: cluster 2024-08-31T03:58:43.122494+0000 mgr.a (mgr.14388) 4648 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:43.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:43 smithi163 bash[24253]: cluster 2024-08-31T03:58:43.122494+0000 mgr.a (mgr.14388) 4648 : cluster [DBG] pgmap v3221: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:43.758 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:58:43.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:58:43.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:58:43.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:58:43.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:58:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:44 smithi027 bash[22610]: audit 2024-08-31T03:58:43.338530+0000 mgr.a (mgr.14388) 4649 : audit [DBG] from='client.110613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:44 smithi191 bash[24992]: audit 2024-08-31T03:58:43.338530+0000 mgr.a (mgr.14388) 4649 : audit [DBG] from='client.110613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:44.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:44 smithi163 bash[24253]: audit 2024-08-31T03:58:43.338530+0000 mgr.a (mgr.14388) 4649 : audit [DBG] from='client.110613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:45 smithi027 bash[22610]: cluster 2024-08-31T03:58:45.123339+0000 mgr.a (mgr.14388) 4650 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:45 smithi191 bash[24992]: cluster 2024-08-31T03:58:45.123339+0000 mgr.a (mgr.14388) 4650 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:45.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:45 smithi163 bash[24253]: cluster 2024-08-31T03:58:45.123339+0000 mgr.a (mgr.14388) 4650 : cluster [DBG] pgmap v3222: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:47 smithi027 bash[22610]: cluster 2024-08-31T03:58:47.124108+0000 mgr.a (mgr.14388) 4651 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:47 smithi191 bash[24992]: cluster 2024-08-31T03:58:47.124108+0000 mgr.a (mgr.14388) 4651 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:47.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:47 smithi163 bash[24253]: cluster 2024-08-31T03:58:47.124108+0000 mgr.a (mgr.14388) 4651 : cluster [DBG] pgmap v3223: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T03:58:48.760 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:58:48.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:58:48.761 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:58:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:49 smithi027 bash[22610]: audit 2024-08-31T03:58:49.099905+0000 mgr.a (mgr.14388) 4652 : audit [DBG] from='client.110691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:49 smithi027 bash[22610]: cluster 2024-08-31T03:58:49.126223+0000 mgr.a (mgr.14388) 4653 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:49.533 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:58:49.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:58:49.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:58:49.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:58:49.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:58:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:49 smithi191 bash[24992]: audit 2024-08-31T03:58:49.099905+0000 mgr.a (mgr.14388) 4652 : audit [DBG] from='client.110691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:49 smithi191 bash[24992]: cluster 2024-08-31T03:58:49.126223+0000 mgr.a (mgr.14388) 4653 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:49.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:49 smithi163 bash[24253]: audit 2024-08-31T03:58:49.099905+0000 mgr.a (mgr.14388) 4652 : audit [DBG] from='client.110691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:49.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:49 smithi163 bash[24253]: cluster 2024-08-31T03:58:49.126223+0000 mgr.a (mgr.14388) 4653 : cluster [DBG] pgmap v3224: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:51 smithi027 bash[22610]: cluster 2024-08-31T03:58:51.127062+0000 mgr.a (mgr.14388) 4654 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:58:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:51 smithi191 bash[24992]: cluster 2024-08-31T03:58:51.127062+0000 mgr.a (mgr.14388) 4654 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:58:51.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:51 smithi163 bash[24253]: cluster 2024-08-31T03:58:51.127062+0000 mgr.a (mgr.14388) 4654 : cluster [DBG] pgmap v3225: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T03:58:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:53 smithi027 bash[22610]: cluster 2024-08-31T03:58:53.129110+0000 mgr.a (mgr.14388) 4655 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:58:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:53 smithi191 bash[24992]: cluster 2024-08-31T03:58:53.129110+0000 mgr.a (mgr.14388) 4655 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:58:53.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:53 smithi163 bash[24253]: cluster 2024-08-31T03:58:53.129110+0000 mgr.a (mgr.14388) 4655 : cluster [DBG] pgmap v3226: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T03:58:54.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:58:54.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:58:54.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:58:55.274 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:58:55.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:58:55.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:58:55.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:58:55.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:58:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:55 smithi027 bash[22610]: audit 2024-08-31T03:58:54.868804+0000 mgr.a (mgr.14388) 4656 : audit [DBG] from='client.110766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:55 smithi027 bash[22610]: cluster 2024-08-31T03:58:55.129626+0000 mgr.a (mgr.14388) 4657 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:55 smithi191 bash[24992]: audit 2024-08-31T03:58:54.868804+0000 mgr.a (mgr.14388) 4656 : audit [DBG] from='client.110766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:55 smithi191 bash[24992]: cluster 2024-08-31T03:58:55.129626+0000 mgr.a (mgr.14388) 4657 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:55.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:55 smithi163 bash[24253]: audit 2024-08-31T03:58:54.868804+0000 mgr.a (mgr.14388) 4656 : audit [DBG] from='client.110766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:58:55.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:55 smithi163 bash[24253]: cluster 2024-08-31T03:58:55.129626+0000 mgr.a (mgr.14388) 4657 : cluster [DBG] pgmap v3227: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:57 smithi027 bash[22610]: cluster 2024-08-31T03:58:57.130540+0000 mgr.a (mgr.14388) 4658 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:57 smithi191 bash[24992]: cluster 2024-08-31T03:58:57.130540+0000 mgr.a (mgr.14388) 4658 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:57.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:57 smithi163 bash[24253]: cluster 2024-08-31T03:58:57.130540+0000 mgr.a (mgr.14388) 4658 : cluster [DBG] pgmap v3228: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:58:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:58:59 smithi027 bash[22610]: cluster 2024-08-31T03:58:59.132904+0000 mgr.a (mgr.14388) 4659 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:58:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:58:59 smithi191 bash[24992]: cluster 2024-08-31T03:58:59.132904+0000 mgr.a (mgr.14388) 4659 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:58:59.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:58:59 smithi163 bash[24253]: cluster 2024-08-31T03:58:59.132904+0000 mgr.a (mgr.14388) 4659 : cluster [DBG] pgmap v3229: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:00.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:00.276 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:00.277 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:01.023 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:01.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:01.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:01.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:01.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:01 smithi027 bash[22610]: audit 2024-08-31T03:59:00.607435+0000 mgr.a (mgr.14388) 4660 : audit [DBG] from='client.110844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:01 smithi027 bash[22610]: cluster 2024-08-31T03:59:01.133846+0000 mgr.a (mgr.14388) 4661 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:01 smithi191 bash[24992]: audit 2024-08-31T03:59:00.607435+0000 mgr.a (mgr.14388) 4660 : audit [DBG] from='client.110844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:01 smithi191 bash[24992]: cluster 2024-08-31T03:59:01.133846+0000 mgr.a (mgr.14388) 4661 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:01.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:01 smithi163 bash[24253]: audit 2024-08-31T03:59:00.607435+0000 mgr.a (mgr.14388) 4660 : audit [DBG] from='client.110844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:01.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:01 smithi163 bash[24253]: cluster 2024-08-31T03:59:01.133846+0000 mgr.a (mgr.14388) 4661 : cluster [DBG] pgmap v3230: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:03 smithi027 bash[22610]: cluster 2024-08-31T03:59:03.136155+0000 mgr.a (mgr.14388) 4662 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:03 smithi191 bash[24992]: cluster 2024-08-31T03:59:03.136155+0000 mgr.a (mgr.14388) 4662 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:03.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:03 smithi163 bash[24253]: cluster 2024-08-31T03:59:03.136155+0000 mgr.a (mgr.14388) 4662 : cluster [DBG] pgmap v3231: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:05 smithi027 bash[22610]: cluster 2024-08-31T03:59:05.137075+0000 mgr.a (mgr.14388) 4663 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:05 smithi191 bash[24992]: cluster 2024-08-31T03:59:05.137075+0000 mgr.a (mgr.14388) 4663 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:05.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:05 smithi163 bash[24253]: cluster 2024-08-31T03:59:05.137075+0000 mgr.a (mgr.14388) 4663 : cluster [DBG] pgmap v3232: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:06.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:06.026 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:06.798 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:06.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:06.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:06.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:06.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:07 smithi027 bash[22610]: audit 2024-08-31T03:59:06.361398+0000 mgr.a (mgr.14388) 4664 : audit [DBG] from='client.110922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:07 smithi027 bash[22610]: cluster 2024-08-31T03:59:07.137961+0000 mgr.a (mgr.14388) 4665 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:07 smithi191 bash[24992]: audit 2024-08-31T03:59:06.361398+0000 mgr.a (mgr.14388) 4664 : audit [DBG] from='client.110922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:07 smithi191 bash[24992]: cluster 2024-08-31T03:59:07.137961+0000 mgr.a (mgr.14388) 4665 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:07.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:07 smithi163 bash[24253]: audit 2024-08-31T03:59:06.361398+0000 mgr.a (mgr.14388) 4664 : audit [DBG] from='client.110922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:07.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:07 smithi163 bash[24253]: cluster 2024-08-31T03:59:07.137961+0000 mgr.a (mgr.14388) 4665 : cluster [DBG] pgmap v3233: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:09 smithi027 bash[22610]: cluster 2024-08-31T03:59:09.140121+0000 mgr.a (mgr.14388) 4666 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:09 smithi191 bash[24992]: cluster 2024-08-31T03:59:09.140121+0000 mgr.a (mgr.14388) 4666 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:09.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:09 smithi163 bash[24253]: cluster 2024-08-31T03:59:09.140121+0000 mgr.a (mgr.14388) 4666 : cluster [DBG] pgmap v3234: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:11 smithi027 bash[22610]: cluster 2024-08-31T03:59:11.140859+0000 mgr.a (mgr.14388) 4667 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:11 smithi191 bash[24992]: cluster 2024-08-31T03:59:11.140859+0000 mgr.a (mgr.14388) 4667 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:11.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:11 smithi163 bash[24253]: cluster 2024-08-31T03:59:11.140859+0000 mgr.a (mgr.14388) 4667 : cluster [DBG] pgmap v3235: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:11.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:11.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:11.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:12 smithi027 bash[22610]: audit 2024-08-31T03:59:12.137637+0000 mgr.a (mgr.14388) 4668 : audit [DBG] from='client.110997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:12 smithi191 bash[24992]: audit 2024-08-31T03:59:12.137637+0000 mgr.a (mgr.14388) 4668 : audit [DBG] from='client.110997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:12.582 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:12.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:12.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:12.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:12.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:12.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:12 smithi163 bash[24253]: audit 2024-08-31T03:59:12.137637+0000 mgr.a (mgr.14388) 4668 : audit [DBG] from='client.110997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:13 smithi027 bash[22610]: cluster 2024-08-31T03:59:13.143114+0000 mgr.a (mgr.14388) 4669 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:13 smithi191 bash[24992]: cluster 2024-08-31T03:59:13.143114+0000 mgr.a (mgr.14388) 4669 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:13.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:13 smithi163 bash[24253]: cluster 2024-08-31T03:59:13.143114+0000 mgr.a (mgr.14388) 4669 : cluster [DBG] pgmap v3236: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:15 smithi027 bash[22610]: cluster 2024-08-31T03:59:15.143878+0000 mgr.a (mgr.14388) 4670 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:15 smithi191 bash[24992]: cluster 2024-08-31T03:59:15.143878+0000 mgr.a (mgr.14388) 4670 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:15.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:15 smithi163 bash[24253]: cluster 2024-08-31T03:59:15.143878+0000 mgr.a (mgr.14388) 4670 : cluster [DBG] pgmap v3237: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:16 smithi027 bash[22610]: audit 2024-08-31T03:59:16.165323+0000 mon.a (mon.0) 1286 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:59:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:16 smithi191 bash[24992]: audit 2024-08-31T03:59:16.165323+0000 mon.a (mon.0) 1286 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:59:16.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:16 smithi163 bash[24253]: audit 2024-08-31T03:59:16.165323+0000 mon.a (mon.0) 1286 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T03:59:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:17 smithi027 bash[22610]: audit 2024-08-31T03:59:17.003465+0000 mon.a (mon.0) 1287 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:59:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:17 smithi027 bash[22610]: audit 2024-08-31T03:59:17.005513+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:59:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:17 smithi027 bash[22610]: audit 2024-08-31T03:59:17.016902+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:59:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:17 smithi027 bash[22610]: audit 2024-08-31T03:59:17.021882+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:59:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:17 smithi027 bash[22610]: audit 2024-08-31T03:59:17.024194+0000 mgr.a (mgr.14388) 4671 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:59:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:17 smithi027 bash[22610]: cluster 2024-08-31T03:59:17.144747+0000 mgr.a (mgr.14388) 4672 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:17 smithi191 bash[24992]: audit 2024-08-31T03:59:17.003465+0000 mon.a (mon.0) 1287 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:59:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:17 smithi191 bash[24992]: audit 2024-08-31T03:59:17.005513+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:59:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:17 smithi191 bash[24992]: audit 2024-08-31T03:59:17.016902+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:59:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:17 smithi191 bash[24992]: audit 2024-08-31T03:59:17.021882+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:59:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:17 smithi191 bash[24992]: audit 2024-08-31T03:59:17.024194+0000 mgr.a (mgr.14388) 4671 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:59:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:17 smithi191 bash[24992]: cluster 2024-08-31T03:59:17.144747+0000 mgr.a (mgr.14388) 4672 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:17.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:17.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:17.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:17 smithi163 bash[24253]: audit 2024-08-31T03:59:17.003465+0000 mon.a (mon.0) 1287 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T03:59:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:17 smithi163 bash[24253]: audit 2024-08-31T03:59:17.005513+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T03:59:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:17 smithi163 bash[24253]: audit 2024-08-31T03:59:17.016902+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T03:59:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:17 smithi163 bash[24253]: audit 2024-08-31T03:59:17.021882+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:59:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:17 smithi163 bash[24253]: audit 2024-08-31T03:59:17.024194+0000 mgr.a (mgr.14388) 4671 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T03:59:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:17 smithi163 bash[24253]: cluster 2024-08-31T03:59:17.144747+0000 mgr.a (mgr.14388) 4672 : cluster [DBG] pgmap v3238: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:18.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:59:17 smithi027 bash[22863]: debug 2024-08-31T03:59:17.740+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:59:18.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 03:59:17 smithi027 bash[22863]: debug 2024-08-31T03:59:17.744+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:59:18.308 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:18.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:18.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:18.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:18.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:19 smithi191 bash[24992]: audit 2024-08-31T03:59:17.746668+0000 mgr.a (mgr.14388) 4673 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:59:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:19 smithi191 bash[24992]: cephadm 2024-08-31T03:59:17.747762+0000 mgr.a (mgr.14388) 4674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:59:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:19 smithi191 bash[24992]: audit 2024-08-31T03:59:17.900386+0000 mgr.a (mgr.14388) 4675 : audit [DBG] from='client.111180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:19.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:19 smithi163 bash[24253]: audit 2024-08-31T03:59:17.746668+0000 mgr.a (mgr.14388) 4673 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:59:19.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:19 smithi163 bash[24253]: cephadm 2024-08-31T03:59:17.747762+0000 mgr.a (mgr.14388) 4674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:59:19.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:19 smithi163 bash[24253]: audit 2024-08-31T03:59:17.900386+0000 mgr.a (mgr.14388) 4675 : audit [DBG] from='client.111180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:19 smithi027 bash[22610]: audit 2024-08-31T03:59:17.746668+0000 mgr.a (mgr.14388) 4673 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T03:59:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:19 smithi027 bash[22610]: cephadm 2024-08-31T03:59:17.747762+0000 mgr.a (mgr.14388) 4674 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T03:59:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:19 smithi027 bash[22610]: audit 2024-08-31T03:59:17.900386+0000 mgr.a (mgr.14388) 4675 : audit [DBG] from='client.111180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:20 smithi191 bash[24992]: cluster 2024-08-31T03:59:19.147364+0000 mgr.a (mgr.14388) 4676 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:59:20.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:20 smithi163 bash[24253]: cluster 2024-08-31T03:59:19.147364+0000 mgr.a (mgr.14388) 4676 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:59:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:20 smithi027 bash[22610]: cluster 2024-08-31T03:59:19.147364+0000 mgr.a (mgr.14388) 4676 : cluster [DBG] pgmap v3239: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:59:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:21 smithi027 bash[22610]: cluster 2024-08-31T03:59:21.148142+0000 mgr.a (mgr.14388) 4677 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:59:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:21 smithi191 bash[24992]: cluster 2024-08-31T03:59:21.148142+0000 mgr.a (mgr.14388) 4677 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:59:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:21 smithi163 bash[24253]: cluster 2024-08-31T03:59:21.148142+0000 mgr.a (mgr.14388) 4677 : cluster [DBG] pgmap v3240: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:59:23.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:23.310 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:23.310 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:23 smithi027 bash[22610]: cluster 2024-08-31T03:59:23.150018+0000 mgr.a (mgr.14388) 4678 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:59:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:23 smithi191 bash[24992]: cluster 2024-08-31T03:59:23.150018+0000 mgr.a (mgr.14388) 4678 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:59:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:23 smithi163 bash[24253]: cluster 2024-08-31T03:59:23.150018+0000 mgr.a (mgr.14388) 4678 : cluster [DBG] pgmap v3241: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:59:24.087 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:24.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:24.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:24.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:24.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:24 smithi027 bash[22610]: audit 2024-08-31T03:59:23.643803+0000 mgr.a (mgr.14388) 4679 : audit [DBG] from='client.111258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:24 smithi191 bash[24992]: audit 2024-08-31T03:59:23.643803+0000 mgr.a (mgr.14388) 4679 : audit [DBG] from='client.111258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:24.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:24 smithi163 bash[24253]: audit 2024-08-31T03:59:23.643803+0000 mgr.a (mgr.14388) 4679 : audit [DBG] from='client.111258 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:25 smithi027 bash[22610]: cluster 2024-08-31T03:59:25.150933+0000 mgr.a (mgr.14388) 4680 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:59:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:25 smithi191 bash[24992]: cluster 2024-08-31T03:59:25.150933+0000 mgr.a (mgr.14388) 4680 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:59:25.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:25 smithi163 bash[24253]: cluster 2024-08-31T03:59:25.150933+0000 mgr.a (mgr.14388) 4680 : cluster [DBG] pgmap v3242: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:59:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:27 smithi027 bash[22610]: cluster 2024-08-31T03:59:27.151838+0000 mgr.a (mgr.14388) 4681 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:59:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:27 smithi191 bash[24992]: cluster 2024-08-31T03:59:27.151838+0000 mgr.a (mgr.14388) 4681 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:59:27.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:27 smithi163 bash[24253]: cluster 2024-08-31T03:59:27.151838+0000 mgr.a (mgr.14388) 4681 : cluster [DBG] pgmap v3243: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T03:59:29.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:29.090 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:29.090 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:29 smithi027 bash[22610]: cluster 2024-08-31T03:59:29.153294+0000 mgr.a (mgr.14388) 4682 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:59:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:29 smithi191 bash[24992]: cluster 2024-08-31T03:59:29.153294+0000 mgr.a (mgr.14388) 4682 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:59:29.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:29 smithi163 bash[24253]: cluster 2024-08-31T03:59:29.153294+0000 mgr.a (mgr.14388) 4682 : cluster [DBG] pgmap v3244: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T03:59:29.843 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:29.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:29.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:29.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:29.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:30 smithi027 bash[22610]: audit 2024-08-31T03:59:29.422450+0000 mgr.a (mgr.14388) 4683 : audit [DBG] from='client.111336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:30 smithi191 bash[24992]: audit 2024-08-31T03:59:29.422450+0000 mgr.a (mgr.14388) 4683 : audit [DBG] from='client.111336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:30.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:30 smithi163 bash[24253]: audit 2024-08-31T03:59:29.422450+0000 mgr.a (mgr.14388) 4683 : audit [DBG] from='client.111336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:31 smithi027 bash[22610]: cluster 2024-08-31T03:59:31.154206+0000 mgr.a (mgr.14388) 4684 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:31 smithi191 bash[24992]: cluster 2024-08-31T03:59:31.154206+0000 mgr.a (mgr.14388) 4684 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:31.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:31 smithi163 bash[24253]: cluster 2024-08-31T03:59:31.154206+0000 mgr.a (mgr.14388) 4684 : cluster [DBG] pgmap v3245: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:33 smithi027 bash[22610]: cluster 2024-08-31T03:59:33.156432+0000 mgr.a (mgr.14388) 4685 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:33 smithi191 bash[24992]: cluster 2024-08-31T03:59:33.156432+0000 mgr.a (mgr.14388) 4685 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:33.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:33 smithi163 bash[24253]: cluster 2024-08-31T03:59:33.156432+0000 mgr.a (mgr.14388) 4685 : cluster [DBG] pgmap v3246: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:34.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:34.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:34.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:35 smithi027 bash[22610]: cluster 2024-08-31T03:59:35.156987+0000 mgr.a (mgr.14388) 4686 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:35 smithi191 bash[24992]: cluster 2024-08-31T03:59:35.156987+0000 mgr.a (mgr.14388) 4686 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:35.621 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:35.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:35.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:35.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:35.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:35.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:35 smithi163 bash[24253]: cluster 2024-08-31T03:59:35.156987+0000 mgr.a (mgr.14388) 4686 : cluster [DBG] pgmap v3247: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:36 smithi027 bash[22610]: audit 2024-08-31T03:59:35.183856+0000 mgr.a (mgr.14388) 4687 : audit [DBG] from='client.111414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:36 smithi191 bash[24992]: audit 2024-08-31T03:59:35.183856+0000 mgr.a (mgr.14388) 4687 : audit [DBG] from='client.111414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:36.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:36 smithi163 bash[24253]: audit 2024-08-31T03:59:35.183856+0000 mgr.a (mgr.14388) 4687 : audit [DBG] from='client.111414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:37 smithi027 bash[22610]: cluster 2024-08-31T03:59:37.158069+0000 mgr.a (mgr.14388) 4688 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:37 smithi191 bash[24992]: cluster 2024-08-31T03:59:37.158069+0000 mgr.a (mgr.14388) 4688 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:37.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:37 smithi163 bash[24253]: cluster 2024-08-31T03:59:37.158069+0000 mgr.a (mgr.14388) 4688 : cluster [DBG] pgmap v3248: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:39 smithi027 bash[22610]: cluster 2024-08-31T03:59:39.160284+0000 mgr.a (mgr.14388) 4689 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:39 smithi191 bash[24992]: cluster 2024-08-31T03:59:39.160284+0000 mgr.a (mgr.14388) 4689 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:39.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:39 smithi163 bash[24253]: cluster 2024-08-31T03:59:39.160284+0000 mgr.a (mgr.14388) 4689 : cluster [DBG] pgmap v3249: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:40.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:40.624 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:40.624 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:41.405 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:41.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:41.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:41.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:41.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:41 smithi027 bash[22610]: audit 2024-08-31T03:59:40.959630+0000 mgr.a (mgr.14388) 4690 : audit [DBG] from='client.111492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:41 smithi027 bash[22610]: cluster 2024-08-31T03:59:41.160997+0000 mgr.a (mgr.14388) 4691 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:41 smithi191 bash[24992]: audit 2024-08-31T03:59:40.959630+0000 mgr.a (mgr.14388) 4690 : audit [DBG] from='client.111492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:41 smithi191 bash[24992]: cluster 2024-08-31T03:59:41.160997+0000 mgr.a (mgr.14388) 4691 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:41.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:41 smithi163 bash[24253]: audit 2024-08-31T03:59:40.959630+0000 mgr.a (mgr.14388) 4690 : audit [DBG] from='client.111492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:41.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:41 smithi163 bash[24253]: cluster 2024-08-31T03:59:41.160997+0000 mgr.a (mgr.14388) 4691 : cluster [DBG] pgmap v3250: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:43 smithi027 bash[22610]: cluster 2024-08-31T03:59:43.163196+0000 mgr.a (mgr.14388) 4692 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:43 smithi191 bash[24992]: cluster 2024-08-31T03:59:43.163196+0000 mgr.a (mgr.14388) 4692 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:43.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:43 smithi163 bash[24253]: cluster 2024-08-31T03:59:43.163196+0000 mgr.a (mgr.14388) 4692 : cluster [DBG] pgmap v3251: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:45 smithi027 bash[22610]: cluster 2024-08-31T03:59:45.164012+0000 mgr.a (mgr.14388) 4693 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:45 smithi191 bash[24992]: cluster 2024-08-31T03:59:45.164012+0000 mgr.a (mgr.14388) 4693 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:45.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:45 smithi163 bash[24253]: cluster 2024-08-31T03:59:45.164012+0000 mgr.a (mgr.14388) 4693 : cluster [DBG] pgmap v3252: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:46.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:46.407 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:46.407 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:47.152 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:47.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:47 smithi027 bash[22610]: audit 2024-08-31T03:59:46.739629+0000 mgr.a (mgr.14388) 4694 : audit [DBG] from='client.111570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:47 smithi027 bash[22610]: cluster 2024-08-31T03:59:47.164725+0000 mgr.a (mgr.14388) 4695 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:47 smithi191 bash[24992]: audit 2024-08-31T03:59:46.739629+0000 mgr.a (mgr.14388) 4694 : audit [DBG] from='client.111570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:47 smithi191 bash[24992]: cluster 2024-08-31T03:59:47.164725+0000 mgr.a (mgr.14388) 4695 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:47.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:47 smithi163 bash[24253]: audit 2024-08-31T03:59:46.739629+0000 mgr.a (mgr.14388) 4694 : audit [DBG] from='client.111570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:47.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:47 smithi163 bash[24253]: cluster 2024-08-31T03:59:47.164725+0000 mgr.a (mgr.14388) 4695 : cluster [DBG] pgmap v3253: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:49 smithi027 bash[22610]: cluster 2024-08-31T03:59:49.166819+0000 mgr.a (mgr.14388) 4696 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:49 smithi191 bash[24992]: cluster 2024-08-31T03:59:49.166819+0000 mgr.a (mgr.14388) 4696 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:49.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:49 smithi163 bash[24253]: cluster 2024-08-31T03:59:49.166819+0000 mgr.a (mgr.14388) 4696 : cluster [DBG] pgmap v3254: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T03:59:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:51 smithi027 bash[22610]: cluster 2024-08-31T03:59:51.167565+0000 mgr.a (mgr.14388) 4697 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:51 smithi191 bash[24992]: cluster 2024-08-31T03:59:51.167565+0000 mgr.a (mgr.14388) 4697 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:51.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:51 smithi163 bash[24253]: cluster 2024-08-31T03:59:51.167565+0000 mgr.a (mgr.14388) 4697 : cluster [DBG] pgmap v3255: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T03:59:52.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:52.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:52.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:52.921 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:52.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:52.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:52.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:52.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:53 smithi027 bash[22610]: audit 2024-08-31T03:59:52.491041+0000 mgr.a (mgr.14388) 4698 : audit [DBG] from='client.111645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:53 smithi027 bash[22610]: cluster 2024-08-31T03:59:53.170336+0000 mgr.a (mgr.14388) 4699 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:59:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:53 smithi191 bash[24992]: audit 2024-08-31T03:59:52.491041+0000 mgr.a (mgr.14388) 4698 : audit [DBG] from='client.111645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:53 smithi191 bash[24992]: cluster 2024-08-31T03:59:53.170336+0000 mgr.a (mgr.14388) 4699 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:59:53.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:53 smithi163 bash[24253]: audit 2024-08-31T03:59:52.491041+0000 mgr.a (mgr.14388) 4698 : audit [DBG] from='client.111645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:53.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:53 smithi163 bash[24253]: cluster 2024-08-31T03:59:53.170336+0000 mgr.a (mgr.14388) 4699 : cluster [DBG] pgmap v3256: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T03:59:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:55 smithi191 bash[24992]: cluster 2024-08-31T03:59:55.171327+0000 mgr.a (mgr.14388) 4700 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:59:55.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:55 smithi163 bash[24253]: cluster 2024-08-31T03:59:55.171327+0000 mgr.a (mgr.14388) 4700 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:59:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:55 smithi027 bash[22610]: cluster 2024-08-31T03:59:55.171327+0000 mgr.a (mgr.14388) 4700 : cluster [DBG] pgmap v3257: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:59:57.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T03:59:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T03:59:57.923 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T03:59:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:58 smithi027 bash[22610]: cluster 2024-08-31T03:59:57.172278+0000 mgr.a (mgr.14388) 4701 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:59:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:58 smithi191 bash[24992]: cluster 2024-08-31T03:59:57.172278+0000 mgr.a (mgr.14388) 4701 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:59:58.665 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T03:59:58.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T03:59:58.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T03:59:58.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T03:59:58.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T03:59:58.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:58 smithi163 bash[24253]: cluster 2024-08-31T03:59:57.172278+0000 mgr.a (mgr.14388) 4701 : cluster [DBG] pgmap v3258: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T03:59:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 03:59:59 smithi191 bash[24992]: audit 2024-08-31T03:59:58.256019+0000 mgr.a (mgr.14388) 4702 : audit [DBG] from='client.111723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:59.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 03:59:59 smithi163 bash[24253]: audit 2024-08-31T03:59:58.256019+0000 mgr.a (mgr.14388) 4702 : audit [DBG] from='client.111723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T03:59:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 03:59:59 smithi027 bash[22610]: audit 2024-08-31T03:59:58.256019+0000 mgr.a (mgr.14388) 4702 : audit [DBG] from='client.111723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:00 smithi191 bash[24992]: cluster 2024-08-31T03:59:59.175953+0000 mgr.a (mgr.14388) 4703 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:00 smithi191 bash[24992]: cluster 2024-08-31T04:00:00.000149+0000 mon.a (mon.0) 1291 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:00:00.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:00 smithi163 bash[24253]: cluster 2024-08-31T03:59:59.175953+0000 mgr.a (mgr.14388) 4703 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:00.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:00 smithi163 bash[24253]: cluster 2024-08-31T04:00:00.000149+0000 mon.a (mon.0) 1291 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:00:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:00 smithi027 bash[22610]: cluster 2024-08-31T03:59:59.175953+0000 mgr.a (mgr.14388) 4703 : cluster [DBG] pgmap v3259: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:00 smithi027 bash[22610]: cluster 2024-08-31T04:00:00.000149+0000 mon.a (mon.0) 1291 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:00:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:02 smithi191 bash[24992]: cluster 2024-08-31T04:00:01.176781+0000 mgr.a (mgr.14388) 4704 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:00:02.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:02 smithi163 bash[24253]: cluster 2024-08-31T04:00:01.176781+0000 mgr.a (mgr.14388) 4704 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:00:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:02 smithi027 bash[22610]: cluster 2024-08-31T04:00:01.176781+0000 mgr.a (mgr.14388) 4704 : cluster [DBG] pgmap v3260: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:00:03.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:00:03.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:00:03.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:00:04.439 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:00:04.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:00:04.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:00:04.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:00:04.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:00:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:04 smithi191 bash[24992]: cluster 2024-08-31T04:00:03.178647+0000 mgr.a (mgr.14388) 4705 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:04 smithi191 bash[24992]: audit 2024-08-31T04:00:04.002965+0000 mgr.a (mgr.14388) 4706 : audit [DBG] from='client.111801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:04.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:04 smithi163 bash[24253]: cluster 2024-08-31T04:00:03.178647+0000 mgr.a (mgr.14388) 4705 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:04.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:04 smithi163 bash[24253]: audit 2024-08-31T04:00:04.002965+0000 mgr.a (mgr.14388) 4706 : audit [DBG] from='client.111801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:04 smithi027 bash[22610]: cluster 2024-08-31T04:00:03.178647+0000 mgr.a (mgr.14388) 4705 : cluster [DBG] pgmap v3261: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:04 smithi027 bash[22610]: audit 2024-08-31T04:00:04.002965+0000 mgr.a (mgr.14388) 4706 : audit [DBG] from='client.111801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:06 smithi191 bash[24992]: cluster 2024-08-31T04:00:05.179641+0000 mgr.a (mgr.14388) 4707 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:00:06.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:06 smithi163 bash[24253]: cluster 2024-08-31T04:00:05.179641+0000 mgr.a (mgr.14388) 4707 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:00:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:06 smithi027 bash[22610]: cluster 2024-08-31T04:00:05.179641+0000 mgr.a (mgr.14388) 4707 : cluster [DBG] pgmap v3262: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:00:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:08 smithi191 bash[24992]: cluster 2024-08-31T04:00:07.180440+0000 mgr.a (mgr.14388) 4708 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:00:08.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:08 smithi163 bash[24253]: cluster 2024-08-31T04:00:07.180440+0000 mgr.a (mgr.14388) 4708 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:00:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:08 smithi027 bash[22610]: cluster 2024-08-31T04:00:07.180440+0000 mgr.a (mgr.14388) 4708 : cluster [DBG] pgmap v3263: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:00:09.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:00:09.441 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:00:09.441 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:00:10.189 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:00:10.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:00:10.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:00:10.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:00:10.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:00:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:10 smithi191 bash[24992]: cluster 2024-08-31T04:00:09.182682+0000 mgr.a (mgr.14388) 4709 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T04:00:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:10 smithi191 bash[24992]: audit 2024-08-31T04:00:09.776023+0000 mgr.a (mgr.14388) 4710 : audit [DBG] from='client.111876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:10.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:10 smithi163 bash[24253]: cluster 2024-08-31T04:00:09.182682+0000 mgr.a (mgr.14388) 4709 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T04:00:10.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:10 smithi163 bash[24253]: audit 2024-08-31T04:00:09.776023+0000 mgr.a (mgr.14388) 4710 : audit [DBG] from='client.111876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:10 smithi027 bash[22610]: cluster 2024-08-31T04:00:09.182682+0000 mgr.a (mgr.14388) 4709 : cluster [DBG] pgmap v3264: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T04:00:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:10 smithi027 bash[22610]: audit 2024-08-31T04:00:09.776023+0000 mgr.a (mgr.14388) 4710 : audit [DBG] from='client.111876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:12 smithi191 bash[24992]: cluster 2024-08-31T04:00:11.183706+0000 mgr.a (mgr.14388) 4711 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:12.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:12 smithi163 bash[24253]: cluster 2024-08-31T04:00:11.183706+0000 mgr.a (mgr.14388) 4711 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:12 smithi027 bash[22610]: cluster 2024-08-31T04:00:11.183706+0000 mgr.a (mgr.14388) 4711 : cluster [DBG] pgmap v3265: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:14 smithi191 bash[24992]: cluster 2024-08-31T04:00:13.185831+0000 mgr.a (mgr.14388) 4712 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:14.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:14 smithi163 bash[24253]: cluster 2024-08-31T04:00:13.185831+0000 mgr.a (mgr.14388) 4712 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:14 smithi027 bash[22610]: cluster 2024-08-31T04:00:13.185831+0000 mgr.a (mgr.14388) 4712 : cluster [DBG] pgmap v3266: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:15.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:00:15.191 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:00:15.191 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:00:15.946 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:00:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:00:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:00:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:00:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:00:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:16 smithi191 bash[24992]: cluster 2024-08-31T04:00:15.186621+0000 mgr.a (mgr.14388) 4713 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:16 smithi191 bash[24992]: audit 2024-08-31T04:00:15.521504+0000 mgr.a (mgr.14388) 4714 : audit [DBG] from='client.111951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:16.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:16 smithi163 bash[24253]: cluster 2024-08-31T04:00:15.186621+0000 mgr.a (mgr.14388) 4713 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:16.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:16 smithi163 bash[24253]: audit 2024-08-31T04:00:15.521504+0000 mgr.a (mgr.14388) 4714 : audit [DBG] from='client.111951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:16 smithi027 bash[22610]: cluster 2024-08-31T04:00:15.186621+0000 mgr.a (mgr.14388) 4713 : cluster [DBG] pgmap v3267: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:16 smithi027 bash[22610]: audit 2024-08-31T04:00:15.521504+0000 mgr.a (mgr.14388) 4714 : audit [DBG] from='client.111951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:18 smithi191 bash[24992]: cluster 2024-08-31T04:00:17.187588+0000 mgr.a (mgr.14388) 4715 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:18 smithi191 bash[24992]: audit 2024-08-31T04:00:17.801445+0000 mon.a (mon.0) 1292 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:00:18.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:18 smithi163 bash[24253]: cluster 2024-08-31T04:00:17.187588+0000 mgr.a (mgr.14388) 4715 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:18.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:18 smithi163 bash[24253]: audit 2024-08-31T04:00:17.801445+0000 mon.a (mon.0) 1292 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:00:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:18 smithi027 bash[22610]: cluster 2024-08-31T04:00:17.187588+0000 mgr.a (mgr.14388) 4715 : cluster [DBG] pgmap v3268: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:18 smithi027 bash[22610]: audit 2024-08-31T04:00:17.801445+0000 mon.a (mon.0) 1292 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:00:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:19 smithi191 bash[24992]: audit 2024-08-31T04:00:18.636557+0000 mon.a (mon.0) 1293 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:00:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:19 smithi191 bash[24992]: audit 2024-08-31T04:00:18.638485+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:00:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:19 smithi191 bash[24992]: audit 2024-08-31T04:00:18.649054+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:00:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:19 smithi191 bash[24992]: audit 2024-08-31T04:00:18.652249+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:00:19.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:19 smithi191 bash[24992]: audit 2024-08-31T04:00:18.654570+0000 mgr.a (mgr.14388) 4716 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:00:19.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:19 smithi163 bash[24253]: audit 2024-08-31T04:00:18.636557+0000 mon.a (mon.0) 1293 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:00:19.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:19 smithi163 bash[24253]: audit 2024-08-31T04:00:18.638485+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:00:19.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:19 smithi163 bash[24253]: audit 2024-08-31T04:00:18.649054+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:00:19.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:19 smithi163 bash[24253]: audit 2024-08-31T04:00:18.652249+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:00:19.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:19 smithi163 bash[24253]: audit 2024-08-31T04:00:18.654570+0000 mgr.a (mgr.14388) 4716 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:00:19.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:00:19 smithi027 bash[22863]: debug 2024-08-31T04:00:19.374+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:00:19.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:00:19 smithi027 bash[22863]: debug 2024-08-31T04:00:19.378+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:00:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:19 smithi027 bash[22610]: audit 2024-08-31T04:00:18.636557+0000 mon.a (mon.0) 1293 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:00:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:19 smithi027 bash[22610]: audit 2024-08-31T04:00:18.638485+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:00:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:19 smithi027 bash[22610]: audit 2024-08-31T04:00:18.649054+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:00:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:19 smithi027 bash[22610]: audit 2024-08-31T04:00:18.652249+0000 mon.a (mon.0) 1296 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:00:19.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:19 smithi027 bash[22610]: audit 2024-08-31T04:00:18.654570+0000 mgr.a (mgr.14388) 4716 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:00:20.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:20 smithi163 bash[24253]: cluster 2024-08-31T04:00:19.188863+0000 mgr.a (mgr.14388) 4717 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:20.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:20 smithi163 bash[24253]: audit 2024-08-31T04:00:19.378329+0000 mgr.a (mgr.14388) 4718 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:00:20.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:20 smithi163 bash[24253]: cephadm 2024-08-31T04:00:19.379717+0000 mgr.a (mgr.14388) 4719 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:00:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:00:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:00:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:00:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:20 smithi027 bash[22610]: cluster 2024-08-31T04:00:19.188863+0000 mgr.a (mgr.14388) 4717 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:20 smithi027 bash[22610]: audit 2024-08-31T04:00:19.378329+0000 mgr.a (mgr.14388) 4718 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:00:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:20 smithi027 bash[22610]: cephadm 2024-08-31T04:00:19.379717+0000 mgr.a (mgr.14388) 4719 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:00:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:20 smithi191 bash[24992]: cluster 2024-08-31T04:00:19.188863+0000 mgr.a (mgr.14388) 4717 : cluster [DBG] pgmap v3269: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:20 smithi191 bash[24992]: audit 2024-08-31T04:00:19.378329+0000 mgr.a (mgr.14388) 4718 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:00:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:20 smithi191 bash[24992]: cephadm 2024-08-31T04:00:19.379717+0000 mgr.a (mgr.14388) 4719 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:00:21.690 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:00:21.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:00:21.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:00:21.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:00:21.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:00:22.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:22 smithi163 bash[24253]: cluster 2024-08-31T04:00:21.189555+0000 mgr.a (mgr.14388) 4720 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:22.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:22 smithi163 bash[24253]: audit 2024-08-31T04:00:21.279810+0000 mgr.a (mgr.14388) 4721 : audit [DBG] from='client.112137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:22 smithi027 bash[22610]: cluster 2024-08-31T04:00:21.189555+0000 mgr.a (mgr.14388) 4720 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:22 smithi027 bash[22610]: audit 2024-08-31T04:00:21.279810+0000 mgr.a (mgr.14388) 4721 : audit [DBG] from='client.112137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:22 smithi191 bash[24992]: cluster 2024-08-31T04:00:21.189555+0000 mgr.a (mgr.14388) 4720 : cluster [DBG] pgmap v3270: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:22 smithi191 bash[24992]: audit 2024-08-31T04:00:21.279810+0000 mgr.a (mgr.14388) 4721 : audit [DBG] from='client.112137 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:24.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:24 smithi163 bash[24253]: cluster 2024-08-31T04:00:23.191837+0000 mgr.a (mgr.14388) 4722 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:24 smithi027 bash[22610]: cluster 2024-08-31T04:00:23.191837+0000 mgr.a (mgr.14388) 4722 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:24 smithi191 bash[24992]: cluster 2024-08-31T04:00:23.191837+0000 mgr.a (mgr.14388) 4722 : cluster [DBG] pgmap v3271: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:26.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:00:26.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:00:26.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:00:26.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:26 smithi163 bash[24253]: cluster 2024-08-31T04:00:25.192615+0000 mgr.a (mgr.14388) 4723 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:26 smithi027 bash[22610]: cluster 2024-08-31T04:00:25.192615+0000 mgr.a (mgr.14388) 4723 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:26 smithi191 bash[24992]: cluster 2024-08-31T04:00:25.192615+0000 mgr.a (mgr.14388) 4723 : cluster [DBG] pgmap v3272: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:27.455 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:00:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:00:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:00:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:00:27.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:00:27.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:27 smithi163 bash[24253]: audit 2024-08-31T04:00:27.031463+0000 mgr.a (mgr.14388) 4724 : audit [DBG] from='client.112215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:27 smithi027 bash[22610]: audit 2024-08-31T04:00:27.031463+0000 mgr.a (mgr.14388) 4724 : audit [DBG] from='client.112215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:27 smithi191 bash[24992]: audit 2024-08-31T04:00:27.031463+0000 mgr.a (mgr.14388) 4724 : audit [DBG] from='client.112215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:28.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:28 smithi163 bash[24253]: cluster 2024-08-31T04:00:27.193162+0000 mgr.a (mgr.14388) 4725 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:28 smithi027 bash[22610]: cluster 2024-08-31T04:00:27.193162+0000 mgr.a (mgr.14388) 4725 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:28 smithi191 bash[24992]: cluster 2024-08-31T04:00:27.193162+0000 mgr.a (mgr.14388) 4725 : cluster [DBG] pgmap v3273: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:30.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:30 smithi163 bash[24253]: cluster 2024-08-31T04:00:29.195470+0000 mgr.a (mgr.14388) 4726 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:30 smithi027 bash[22610]: cluster 2024-08-31T04:00:29.195470+0000 mgr.a (mgr.14388) 4726 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:30 smithi191 bash[24992]: cluster 2024-08-31T04:00:29.195470+0000 mgr.a (mgr.14388) 4726 : cluster [DBG] pgmap v3274: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:32.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:00:32.458 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:00:32.458 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:00:32.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:32 smithi163 bash[24253]: cluster 2024-08-31T04:00:31.196189+0000 mgr.a (mgr.14388) 4727 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:32 smithi027 bash[22610]: cluster 2024-08-31T04:00:31.196189+0000 mgr.a (mgr.14388) 4727 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:32 smithi191 bash[24992]: cluster 2024-08-31T04:00:31.196189+0000 mgr.a (mgr.14388) 4727 : cluster [DBG] pgmap v3275: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:33.198 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:00:33.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:00:33.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:00:33.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:00:33.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:00:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:33 smithi027 bash[22610]: audit 2024-08-31T04:00:32.791645+0000 mgr.a (mgr.14388) 4728 : audit [DBG] from='client.112290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:33 smithi191 bash[24992]: audit 2024-08-31T04:00:32.791645+0000 mgr.a (mgr.14388) 4728 : audit [DBG] from='client.112290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:34.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:33 smithi163 bash[24253]: audit 2024-08-31T04:00:32.791645+0000 mgr.a (mgr.14388) 4728 : audit [DBG] from='client.112290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:34 smithi027 bash[22610]: cluster 2024-08-31T04:00:33.197401+0000 mgr.a (mgr.14388) 4729 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:34 smithi191 bash[24992]: cluster 2024-08-31T04:00:33.197401+0000 mgr.a (mgr.14388) 4729 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:35.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:34 smithi163 bash[24253]: cluster 2024-08-31T04:00:33.197401+0000 mgr.a (mgr.14388) 4729 : cluster [DBG] pgmap v3276: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:00:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:36 smithi027 bash[22610]: cluster 2024-08-31T04:00:35.198166+0000 mgr.a (mgr.14388) 4730 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:00:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:36 smithi191 bash[24992]: cluster 2024-08-31T04:00:35.198166+0000 mgr.a (mgr.14388) 4730 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:00:37.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:36 smithi163 bash[24253]: cluster 2024-08-31T04:00:35.198166+0000 mgr.a (mgr.14388) 4730 : cluster [DBG] pgmap v3277: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:00:38.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:00:38.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:00:38.201 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:00:38.954 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:00:38.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:00:38.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:00:38.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:00:38.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:00:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:38 smithi027 bash[22610]: cluster 2024-08-31T04:00:37.198956+0000 mgr.a (mgr.14388) 4731 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:00:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:38 smithi191 bash[24992]: cluster 2024-08-31T04:00:37.198956+0000 mgr.a (mgr.14388) 4731 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:00:39.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:38 smithi163 bash[24253]: cluster 2024-08-31T04:00:37.198956+0000 mgr.a (mgr.14388) 4731 : cluster [DBG] pgmap v3278: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:00:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:39 smithi027 bash[22610]: audit 2024-08-31T04:00:38.532161+0000 mgr.a (mgr.14388) 4732 : audit [DBG] from='client.112365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:39 smithi191 bash[24992]: audit 2024-08-31T04:00:38.532161+0000 mgr.a (mgr.14388) 4732 : audit [DBG] from='client.112365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:40.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:39 smithi163 bash[24253]: audit 2024-08-31T04:00:38.532161+0000 mgr.a (mgr.14388) 4732 : audit [DBG] from='client.112365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:40 smithi027 bash[22610]: cluster 2024-08-31T04:00:39.201594+0000 mgr.a (mgr.14388) 4733 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:40 smithi191 bash[24992]: cluster 2024-08-31T04:00:39.201594+0000 mgr.a (mgr.14388) 4733 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:41.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:40 smithi163 bash[24253]: cluster 2024-08-31T04:00:39.201594+0000 mgr.a (mgr.14388) 4733 : cluster [DBG] pgmap v3279: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:42 smithi027 bash[22610]: cluster 2024-08-31T04:00:41.202393+0000 mgr.a (mgr.14388) 4734 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:00:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:42 smithi191 bash[24992]: cluster 2024-08-31T04:00:41.202393+0000 mgr.a (mgr.14388) 4734 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:00:43.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:42 smithi163 bash[24253]: cluster 2024-08-31T04:00:41.202393+0000 mgr.a (mgr.14388) 4734 : cluster [DBG] pgmap v3280: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:00:43.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:00:43.957 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:00:43.957 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:00:44.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:00:44.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:00:44.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:00:44.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:00:44.724 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:00:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:44 smithi027 bash[22610]: cluster 2024-08-31T04:00:43.204311+0000 mgr.a (mgr.14388) 4735 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:44 smithi191 bash[24992]: cluster 2024-08-31T04:00:43.204311+0000 mgr.a (mgr.14388) 4735 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:45.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:44 smithi163 bash[24253]: cluster 2024-08-31T04:00:43.204311+0000 mgr.a (mgr.14388) 4735 : cluster [DBG] pgmap v3281: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:45 smithi027 bash[22610]: audit 2024-08-31T04:00:44.296225+0000 mgr.a (mgr.14388) 4736 : audit [DBG] from='client.112443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:45 smithi191 bash[24992]: audit 2024-08-31T04:00:44.296225+0000 mgr.a (mgr.14388) 4736 : audit [DBG] from='client.112443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:46.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:45 smithi163 bash[24253]: audit 2024-08-31T04:00:44.296225+0000 mgr.a (mgr.14388) 4736 : audit [DBG] from='client.112443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:46 smithi191 bash[24992]: cluster 2024-08-31T04:00:45.205255+0000 mgr.a (mgr.14388) 4737 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:47.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:46 smithi163 bash[24253]: cluster 2024-08-31T04:00:45.205255+0000 mgr.a (mgr.14388) 4737 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:46 smithi027 bash[22610]: cluster 2024-08-31T04:00:45.205255+0000 mgr.a (mgr.14388) 4737 : cluster [DBG] pgmap v3282: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:48 smithi191 bash[24992]: cluster 2024-08-31T04:00:47.206031+0000 mgr.a (mgr.14388) 4738 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:49.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:48 smithi163 bash[24253]: cluster 2024-08-31T04:00:47.206031+0000 mgr.a (mgr.14388) 4738 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:48 smithi027 bash[22610]: cluster 2024-08-31T04:00:47.206031+0000 mgr.a (mgr.14388) 4738 : cluster [DBG] pgmap v3283: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:49.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:00:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:00:49.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:00:50.472 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:00:50.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:00:50.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:00:50.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:00:50.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:00:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:50 smithi191 bash[24992]: cluster 2024-08-31T04:00:49.208243+0000 mgr.a (mgr.14388) 4739 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:50 smithi191 bash[24992]: audit 2024-08-31T04:00:50.054921+0000 mgr.a (mgr.14388) 4740 : audit [DBG] from='client.112518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:51.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:50 smithi163 bash[24253]: cluster 2024-08-31T04:00:49.208243+0000 mgr.a (mgr.14388) 4739 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:51.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:50 smithi163 bash[24253]: audit 2024-08-31T04:00:50.054921+0000 mgr.a (mgr.14388) 4740 : audit [DBG] from='client.112518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:50 smithi027 bash[22610]: cluster 2024-08-31T04:00:49.208243+0000 mgr.a (mgr.14388) 4739 : cluster [DBG] pgmap v3284: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:50 smithi027 bash[22610]: audit 2024-08-31T04:00:50.054921+0000 mgr.a (mgr.14388) 4740 : audit [DBG] from='client.112518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:52 smithi191 bash[24992]: cluster 2024-08-31T04:00:51.209309+0000 mgr.a (mgr.14388) 4741 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:53.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:52 smithi163 bash[24253]: cluster 2024-08-31T04:00:51.209309+0000 mgr.a (mgr.14388) 4741 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:52 smithi027 bash[22610]: cluster 2024-08-31T04:00:51.209309+0000 mgr.a (mgr.14388) 4741 : cluster [DBG] pgmap v3285: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:54 smithi191 bash[24992]: cluster 2024-08-31T04:00:53.211463+0000 mgr.a (mgr.14388) 4742 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:55.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:54 smithi163 bash[24253]: cluster 2024-08-31T04:00:53.211463+0000 mgr.a (mgr.14388) 4742 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:54 smithi027 bash[22610]: cluster 2024-08-31T04:00:53.211463+0000 mgr.a (mgr.14388) 4742 : cluster [DBG] pgmap v3286: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:00:55.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:00:55.474 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:00:55.474 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:00:56.250 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:00:56.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:00:56.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:00:56.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:00:56.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:00:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:56 smithi191 bash[24992]: cluster 2024-08-31T04:00:55.212212+0000 mgr.a (mgr.14388) 4743 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:56 smithi191 bash[24992]: audit 2024-08-31T04:00:55.806587+0000 mgr.a (mgr.14388) 4744 : audit [DBG] from='client.112596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:57.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:56 smithi163 bash[24253]: cluster 2024-08-31T04:00:55.212212+0000 mgr.a (mgr.14388) 4743 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:57.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:56 smithi163 bash[24253]: audit 2024-08-31T04:00:55.806587+0000 mgr.a (mgr.14388) 4744 : audit [DBG] from='client.112596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:56 smithi027 bash[22610]: cluster 2024-08-31T04:00:55.212212+0000 mgr.a (mgr.14388) 4743 : cluster [DBG] pgmap v3287: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:56 smithi027 bash[22610]: audit 2024-08-31T04:00:55.806587+0000 mgr.a (mgr.14388) 4744 : audit [DBG] from='client.112596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:00:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:00:58 smithi191 bash[24992]: cluster 2024-08-31T04:00:57.213148+0000 mgr.a (mgr.14388) 4745 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:59.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:00:58 smithi163 bash[24253]: cluster 2024-08-31T04:00:57.213148+0000 mgr.a (mgr.14388) 4745 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:00:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:00:58 smithi027 bash[22610]: cluster 2024-08-31T04:00:57.213148+0000 mgr.a (mgr.14388) 4745 : cluster [DBG] pgmap v3288: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:00 smithi191 bash[24992]: cluster 2024-08-31T04:00:59.216054+0000 mgr.a (mgr.14388) 4746 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:01.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:00 smithi163 bash[24253]: cluster 2024-08-31T04:00:59.216054+0000 mgr.a (mgr.14388) 4746 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:00 smithi027 bash[22610]: cluster 2024-08-31T04:00:59.216054+0000 mgr.a (mgr.14388) 4746 : cluster [DBG] pgmap v3289: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:01.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:01.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:01.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:02.021 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:02.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:02.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:02.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:02.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:01:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:02 smithi191 bash[24992]: cluster 2024-08-31T04:01:01.216863+0000 mgr.a (mgr.14388) 4747 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:02 smithi191 bash[24992]: audit 2024-08-31T04:01:01.587239+0000 mgr.a (mgr.14388) 4748 : audit [DBG] from='client.112674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:03.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:02 smithi163 bash[24253]: cluster 2024-08-31T04:01:01.216863+0000 mgr.a (mgr.14388) 4747 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:03.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:02 smithi163 bash[24253]: audit 2024-08-31T04:01:01.587239+0000 mgr.a (mgr.14388) 4748 : audit [DBG] from='client.112674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:02 smithi027 bash[22610]: cluster 2024-08-31T04:01:01.216863+0000 mgr.a (mgr.14388) 4747 : cluster [DBG] pgmap v3290: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:02 smithi027 bash[22610]: audit 2024-08-31T04:01:01.587239+0000 mgr.a (mgr.14388) 4748 : audit [DBG] from='client.112674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:04 smithi191 bash[24992]: cluster 2024-08-31T04:01:03.219089+0000 mgr.a (mgr.14388) 4749 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:05.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:04 smithi163 bash[24253]: cluster 2024-08-31T04:01:03.219089+0000 mgr.a (mgr.14388) 4749 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:04 smithi027 bash[22610]: cluster 2024-08-31T04:01:03.219089+0000 mgr.a (mgr.14388) 4749 : cluster [DBG] pgmap v3291: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:07.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:07.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:07.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:06 smithi191 bash[24992]: cluster 2024-08-31T04:01:05.219853+0000 mgr.a (mgr.14388) 4750 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:07.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:06 smithi163 bash[24253]: cluster 2024-08-31T04:01:05.219853+0000 mgr.a (mgr.14388) 4750 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:06 smithi027 bash[22610]: cluster 2024-08-31T04:01:05.219853+0000 mgr.a (mgr.14388) 4750 : cluster [DBG] pgmap v3292: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:07.775 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:07.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:07.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:07.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:07.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:01:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:08 smithi191 bash[24992]: cluster 2024-08-31T04:01:07.220569+0000 mgr.a (mgr.14388) 4751 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:08 smithi191 bash[24992]: audit 2024-08-31T04:01:07.359533+0000 mgr.a (mgr.14388) 4752 : audit [DBG] from='client.112752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:09.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:08 smithi163 bash[24253]: cluster 2024-08-31T04:01:07.220569+0000 mgr.a (mgr.14388) 4751 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:09.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:08 smithi163 bash[24253]: audit 2024-08-31T04:01:07.359533+0000 mgr.a (mgr.14388) 4752 : audit [DBG] from='client.112752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:08 smithi027 bash[22610]: cluster 2024-08-31T04:01:07.220569+0000 mgr.a (mgr.14388) 4751 : cluster [DBG] pgmap v3293: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:08 smithi027 bash[22610]: audit 2024-08-31T04:01:07.359533+0000 mgr.a (mgr.14388) 4752 : audit [DBG] from='client.112752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:11.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:10 smithi163 bash[24253]: cluster 2024-08-31T04:01:09.222909+0000 mgr.a (mgr.14388) 4753 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:10 smithi027 bash[22610]: cluster 2024-08-31T04:01:09.222909+0000 mgr.a (mgr.14388) 4753 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:10 smithi191 bash[24992]: cluster 2024-08-31T04:01:09.222909+0000 mgr.a (mgr.14388) 4753 : cluster [DBG] pgmap v3294: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:12.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:12.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:12.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:13.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:12 smithi163 bash[24253]: cluster 2024-08-31T04:01:11.223674+0000 mgr.a (mgr.14388) 4754 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:12 smithi027 bash[22610]: cluster 2024-08-31T04:01:11.223674+0000 mgr.a (mgr.14388) 4754 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:12 smithi191 bash[24992]: cluster 2024-08-31T04:01:11.223674+0000 mgr.a (mgr.14388) 4754 : cluster [DBG] pgmap v3295: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:13.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:13.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:13.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:13.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:01:13.557 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:14.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:13 smithi163 bash[24253]: audit 2024-08-31T04:01:13.114458+0000 mgr.a (mgr.14388) 4755 : audit [DBG] from='client.112830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:13 smithi027 bash[22610]: audit 2024-08-31T04:01:13.114458+0000 mgr.a (mgr.14388) 4755 : audit [DBG] from='client.112830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:13 smithi191 bash[24992]: audit 2024-08-31T04:01:13.114458+0000 mgr.a (mgr.14388) 4755 : audit [DBG] from='client.112830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:15.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:14 smithi163 bash[24253]: cluster 2024-08-31T04:01:13.224926+0000 mgr.a (mgr.14388) 4756 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:14 smithi027 bash[22610]: cluster 2024-08-31T04:01:13.224926+0000 mgr.a (mgr.14388) 4756 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:14 smithi191 bash[24992]: cluster 2024-08-31T04:01:13.224926+0000 mgr.a (mgr.14388) 4756 : cluster [DBG] pgmap v3296: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:17.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:16 smithi163 bash[24253]: cluster 2024-08-31T04:01:15.225749+0000 mgr.a (mgr.14388) 4757 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:01:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:16 smithi027 bash[22610]: cluster 2024-08-31T04:01:15.225749+0000 mgr.a (mgr.14388) 4757 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:01:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:16 smithi191 bash[24992]: cluster 2024-08-31T04:01:15.225749+0000 mgr.a (mgr.14388) 4757 : cluster [DBG] pgmap v3297: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:01:18.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:18.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:18.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:19.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:18 smithi163 bash[24253]: cluster 2024-08-31T04:01:17.226537+0000 mgr.a (mgr.14388) 4758 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:01:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:18 smithi027 bash[22610]: cluster 2024-08-31T04:01:17.226537+0000 mgr.a (mgr.14388) 4758 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:01:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:18 smithi191 bash[24992]: cluster 2024-08-31T04:01:17.226537+0000 mgr.a (mgr.14388) 4758 : cluster [DBG] pgmap v3298: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:01:19.333 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:19.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:19.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:19.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:19.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:01:20.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:19 smithi163 bash[24253]: audit 2024-08-31T04:01:18.900377+0000 mgr.a (mgr.14388) 4759 : audit [DBG] from='client.112899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:20.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:19 smithi163 bash[24253]: audit 2024-08-31T04:01:19.431115+0000 mon.a (mon.0) 1297 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:01:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:19 smithi027 bash[22610]: audit 2024-08-31T04:01:18.900377+0000 mgr.a (mgr.14388) 4759 : audit [DBG] from='client.112899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:19 smithi027 bash[22610]: audit 2024-08-31T04:01:19.431115+0000 mon.a (mon.0) 1297 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:01:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:19 smithi191 bash[24992]: audit 2024-08-31T04:01:18.900377+0000 mgr.a (mgr.14388) 4759 : audit [DBG] from='client.112899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:19 smithi191 bash[24992]: audit 2024-08-31T04:01:19.431115+0000 mon.a (mon.0) 1297 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:01:21.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:21 smithi027 bash[22610]: cluster 2024-08-31T04:01:19.233056+0000 mgr.a (mgr.14388) 4760 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:21.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:21 smithi027 bash[22610]: audit 2024-08-31T04:01:20.048349+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:01:21.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:21 smithi027 bash[22610]: audit 2024-08-31T04:01:20.052538+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:01:21.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:21 smithi027 bash[22610]: audit 2024-08-31T04:01:20.642382+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:01:21.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:21 smithi027 bash[22610]: audit 2024-08-31T04:01:20.643561+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:01:21.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:21 smithi027 bash[22610]: audit 2024-08-31T04:01:20.649947+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:01:21.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:21 smithi027 bash[22610]: audit 2024-08-31T04:01:20.652623+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:01:21.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:21 smithi163 bash[24253]: cluster 2024-08-31T04:01:19.233056+0000 mgr.a (mgr.14388) 4760 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:21.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:21 smithi163 bash[24253]: audit 2024-08-31T04:01:20.048349+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:01:21.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:21 smithi163 bash[24253]: audit 2024-08-31T04:01:20.052538+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:01:21.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:21 smithi163 bash[24253]: audit 2024-08-31T04:01:20.642382+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:01:21.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:21 smithi163 bash[24253]: audit 2024-08-31T04:01:20.643561+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:01:21.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:21 smithi163 bash[24253]: audit 2024-08-31T04:01:20.649947+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:01:21.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:21 smithi163 bash[24253]: audit 2024-08-31T04:01:20.652623+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:01:21.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:21 smithi191 bash[24992]: cluster 2024-08-31T04:01:19.233056+0000 mgr.a (mgr.14388) 4760 : cluster [DBG] pgmap v3299: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:21.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:21 smithi191 bash[24992]: audit 2024-08-31T04:01:20.048349+0000 mon.a (mon.0) 1298 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:01:21.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:21 smithi191 bash[24992]: audit 2024-08-31T04:01:20.052538+0000 mon.a (mon.0) 1299 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:01:21.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:21 smithi191 bash[24992]: audit 2024-08-31T04:01:20.642382+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:01:21.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:21 smithi191 bash[24992]: audit 2024-08-31T04:01:20.643561+0000 mon.a (mon.0) 1301 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:01:21.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:21 smithi191 bash[24992]: audit 2024-08-31T04:01:20.649947+0000 mon.a (mon.0) 1302 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:01:21.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:21 smithi191 bash[24992]: audit 2024-08-31T04:01:20.652623+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:01:21.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:01:21 smithi027 bash[22863]: debug 2024-08-31T04:01:21.364+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:01:21.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:01:21 smithi027 bash[22863]: debug 2024-08-31T04:01:21.364+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:01:22.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:22 smithi163 bash[24253]: audit 2024-08-31T04:01:20.654954+0000 mgr.a (mgr.14388) 4761 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:01:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:22 smithi027 bash[22610]: audit 2024-08-31T04:01:20.654954+0000 mgr.a (mgr.14388) 4761 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:01:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:22 smithi191 bash[24992]: audit 2024-08-31T04:01:20.654954+0000 mgr.a (mgr.14388) 4761 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:01:23.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:23 smithi163 bash[24253]: cluster 2024-08-31T04:01:21.233528+0000 mgr.a (mgr.14388) 4762 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:01:23.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:23 smithi163 bash[24253]: audit 2024-08-31T04:01:21.367153+0000 mgr.a (mgr.14388) 4763 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:01:23.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:23 smithi163 bash[24253]: cephadm 2024-08-31T04:01:21.368383+0000 mgr.a (mgr.14388) 4764 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:01:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:23 smithi027 bash[22610]: cluster 2024-08-31T04:01:21.233528+0000 mgr.a (mgr.14388) 4762 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:01:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:23 smithi027 bash[22610]: audit 2024-08-31T04:01:21.367153+0000 mgr.a (mgr.14388) 4763 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:01:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:23 smithi027 bash[22610]: cephadm 2024-08-31T04:01:21.368383+0000 mgr.a (mgr.14388) 4764 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:01:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:23 smithi191 bash[24992]: cluster 2024-08-31T04:01:21.233528+0000 mgr.a (mgr.14388) 4762 : cluster [DBG] pgmap v3300: 225 pgs: 225 active+clean; 589 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:01:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:23 smithi191 bash[24992]: audit 2024-08-31T04:01:21.367153+0000 mgr.a (mgr.14388) 4763 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:01:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:23 smithi191 bash[24992]: cephadm 2024-08-31T04:01:21.368383+0000 mgr.a (mgr.14388) 4764 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:01:24.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:24.336 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:25.081 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:01:25.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:25 smithi163 bash[24253]: cluster 2024-08-31T04:01:23.235792+0000 mgr.a (mgr.14388) 4765 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:25 smithi027 bash[22610]: cluster 2024-08-31T04:01:23.235792+0000 mgr.a (mgr.14388) 4765 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:25 smithi191 bash[24992]: cluster 2024-08-31T04:01:23.235792+0000 mgr.a (mgr.14388) 4765 : cluster [DBG] pgmap v3301: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:26.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:26 smithi163 bash[24253]: audit 2024-08-31T04:01:24.668853+0000 mgr.a (mgr.14388) 4766 : audit [DBG] from='client.113085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:26 smithi027 bash[22610]: audit 2024-08-31T04:01:24.668853+0000 mgr.a (mgr.14388) 4766 : audit [DBG] from='client.113085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:26 smithi191 bash[24992]: audit 2024-08-31T04:01:24.668853+0000 mgr.a (mgr.14388) 4766 : audit [DBG] from='client.113085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:27.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:27 smithi163 bash[24253]: cluster 2024-08-31T04:01:25.236756+0000 mgr.a (mgr.14388) 4767 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:27 smithi027 bash[22610]: cluster 2024-08-31T04:01:25.236756+0000 mgr.a (mgr.14388) 4767 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:27 smithi191 bash[24992]: cluster 2024-08-31T04:01:25.236756+0000 mgr.a (mgr.14388) 4767 : cluster [DBG] pgmap v3302: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:29.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:29 smithi163 bash[24253]: cluster 2024-08-31T04:01:27.237552+0000 mgr.a (mgr.14388) 4768 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:29 smithi027 bash[22610]: cluster 2024-08-31T04:01:27.237552+0000 mgr.a (mgr.14388) 4768 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:29 smithi191 bash[24992]: cluster 2024-08-31T04:01:27.237552+0000 mgr.a (mgr.14388) 4768 : cluster [DBG] pgmap v3303: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:30.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:30.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:30.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:30.820 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:30.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:30.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:30.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:30.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:01:31.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:31 smithi163 bash[24253]: cluster 2024-08-31T04:01:29.239755+0000 mgr.a (mgr.14388) 4769 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:31 smithi027 bash[22610]: cluster 2024-08-31T04:01:29.239755+0000 mgr.a (mgr.14388) 4769 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:31 smithi191 bash[24992]: cluster 2024-08-31T04:01:29.239755+0000 mgr.a (mgr.14388) 4769 : cluster [DBG] pgmap v3304: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:32.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:32 smithi163 bash[24253]: audit 2024-08-31T04:01:30.414412+0000 mgr.a (mgr.14388) 4770 : audit [DBG] from='client.113163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:32 smithi027 bash[22610]: audit 2024-08-31T04:01:30.414412+0000 mgr.a (mgr.14388) 4770 : audit [DBG] from='client.113163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:32 smithi191 bash[24992]: audit 2024-08-31T04:01:30.414412+0000 mgr.a (mgr.14388) 4770 : audit [DBG] from='client.113163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:33.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:33 smithi163 bash[24253]: cluster 2024-08-31T04:01:31.240700+0000 mgr.a (mgr.14388) 4771 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:33 smithi027 bash[22610]: cluster 2024-08-31T04:01:31.240700+0000 mgr.a (mgr.14388) 4771 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:33 smithi191 bash[24992]: cluster 2024-08-31T04:01:31.240700+0000 mgr.a (mgr.14388) 4771 : cluster [DBG] pgmap v3305: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:35.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:35 smithi163 bash[24253]: cluster 2024-08-31T04:01:33.242849+0000 mgr.a (mgr.14388) 4772 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:35 smithi027 bash[22610]: cluster 2024-08-31T04:01:33.242849+0000 mgr.a (mgr.14388) 4772 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:35 smithi191 bash[24992]: cluster 2024-08-31T04:01:33.242849+0000 mgr.a (mgr.14388) 4772 : cluster [DBG] pgmap v3306: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:01:35.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:35.823 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:35.823 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:36.571 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:36.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:36.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:36.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:36.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:01:37.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:37 smithi163 bash[24253]: cluster 2024-08-31T04:01:35.243750+0000 mgr.a (mgr.14388) 4773 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:37.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:37 smithi163 bash[24253]: audit 2024-08-31T04:01:36.156047+0000 mgr.a (mgr.14388) 4774 : audit [DBG] from='client.113238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:37 smithi027 bash[22610]: cluster 2024-08-31T04:01:35.243750+0000 mgr.a (mgr.14388) 4773 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:37 smithi027 bash[22610]: audit 2024-08-31T04:01:36.156047+0000 mgr.a (mgr.14388) 4774 : audit [DBG] from='client.113238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:37 smithi191 bash[24992]: cluster 2024-08-31T04:01:35.243750+0000 mgr.a (mgr.14388) 4773 : cluster [DBG] pgmap v3307: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:37 smithi191 bash[24992]: audit 2024-08-31T04:01:36.156047+0000 mgr.a (mgr.14388) 4774 : audit [DBG] from='client.113238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:39.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:39 smithi163 bash[24253]: cluster 2024-08-31T04:01:37.244659+0000 mgr.a (mgr.14388) 4775 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:39 smithi027 bash[22610]: cluster 2024-08-31T04:01:37.244659+0000 mgr.a (mgr.14388) 4775 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:39 smithi191 bash[24992]: cluster 2024-08-31T04:01:37.244659+0000 mgr.a (mgr.14388) 4775 : cluster [DBG] pgmap v3308: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:41.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:41 smithi163 bash[24253]: cluster 2024-08-31T04:01:39.246907+0000 mgr.a (mgr.14388) 4776 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:41 smithi027 bash[22610]: cluster 2024-08-31T04:01:39.246907+0000 mgr.a (mgr.14388) 4776 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:41 smithi191 bash[24992]: cluster 2024-08-31T04:01:39.246907+0000 mgr.a (mgr.14388) 4776 : cluster [DBG] pgmap v3309: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:41.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:41.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:41.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:42.341 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:42.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:42.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:42.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:42.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:01:43.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:43 smithi163 bash[24253]: cluster 2024-08-31T04:01:41.247683+0000 mgr.a (mgr.14388) 4777 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:43.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:43 smithi163 bash[24253]: audit 2024-08-31T04:01:41.907874+0000 mgr.a (mgr.14388) 4778 : audit [DBG] from='client.113310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:43 smithi027 bash[22610]: cluster 2024-08-31T04:01:41.247683+0000 mgr.a (mgr.14388) 4777 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:43 smithi027 bash[22610]: audit 2024-08-31T04:01:41.907874+0000 mgr.a (mgr.14388) 4778 : audit [DBG] from='client.113310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:43 smithi191 bash[24992]: cluster 2024-08-31T04:01:41.247683+0000 mgr.a (mgr.14388) 4777 : cluster [DBG] pgmap v3310: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:43 smithi191 bash[24992]: audit 2024-08-31T04:01:41.907874+0000 mgr.a (mgr.14388) 4778 : audit [DBG] from='client.113310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:45.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:45 smithi163 bash[24253]: cluster 2024-08-31T04:01:43.250041+0000 mgr.a (mgr.14388) 4779 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:45 smithi027 bash[22610]: cluster 2024-08-31T04:01:43.250041+0000 mgr.a (mgr.14388) 4779 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:45 smithi191 bash[24992]: cluster 2024-08-31T04:01:43.250041+0000 mgr.a (mgr.14388) 4779 : cluster [DBG] pgmap v3311: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:01:47.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:47.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:47.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:47.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:47 smithi163 bash[24253]: cluster 2024-08-31T04:01:45.250872+0000 mgr.a (mgr.14388) 4780 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:47 smithi027 bash[22610]: cluster 2024-08-31T04:01:45.250872+0000 mgr.a (mgr.14388) 4780 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:47 smithi191 bash[24992]: cluster 2024-08-31T04:01:45.250872+0000 mgr.a (mgr.14388) 4780 : cluster [DBG] pgmap v3312: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:48.121 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:48.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:48.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:48.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:48.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:01:49.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:49 smithi163 bash[24253]: cluster 2024-08-31T04:01:47.251574+0000 mgr.a (mgr.14388) 4781 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:49.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:49 smithi163 bash[24253]: audit 2024-08-31T04:01:47.674732+0000 mgr.a (mgr.14388) 4782 : audit [DBG] from='client.113382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:49 smithi027 bash[22610]: cluster 2024-08-31T04:01:47.251574+0000 mgr.a (mgr.14388) 4781 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:49 smithi027 bash[22610]: audit 2024-08-31T04:01:47.674732+0000 mgr.a (mgr.14388) 4782 : audit [DBG] from='client.113382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:49 smithi191 bash[24992]: cluster 2024-08-31T04:01:47.251574+0000 mgr.a (mgr.14388) 4781 : cluster [DBG] pgmap v3313: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:49 smithi191 bash[24992]: audit 2024-08-31T04:01:47.674732+0000 mgr.a (mgr.14388) 4782 : audit [DBG] from='client.113382 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:51.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:51 smithi163 bash[24253]: cluster 2024-08-31T04:01:49.254183+0000 mgr.a (mgr.14388) 4783 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:51 smithi027 bash[22610]: cluster 2024-08-31T04:01:49.254183+0000 mgr.a (mgr.14388) 4783 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:51 smithi191 bash[24992]: cluster 2024-08-31T04:01:49.254183+0000 mgr.a (mgr.14388) 4783 : cluster [DBG] pgmap v3314: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:53.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:53.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:53.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:53.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:53 smithi163 bash[24253]: cluster 2024-08-31T04:01:51.254982+0000 mgr.a (mgr.14388) 4784 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:01:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:53 smithi027 bash[22610]: cluster 2024-08-31T04:01:51.254982+0000 mgr.a (mgr.14388) 4784 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:01:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:53 smithi191 bash[24992]: cluster 2024-08-31T04:01:51.254982+0000 mgr.a (mgr.14388) 4784 : cluster [DBG] pgmap v3315: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:01:53.879 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:53.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:53.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:53.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:53.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:01:55.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:55 smithi163 bash[24253]: cluster 2024-08-31T04:01:53.256249+0000 mgr.a (mgr.14388) 4785 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:55.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:55 smithi163 bash[24253]: audit 2024-08-31T04:01:53.461933+0000 mgr.a (mgr.14388) 4786 : audit [DBG] from='client.113460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:55 smithi027 bash[22610]: cluster 2024-08-31T04:01:53.256249+0000 mgr.a (mgr.14388) 4785 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:55 smithi027 bash[22610]: audit 2024-08-31T04:01:53.461933+0000 mgr.a (mgr.14388) 4786 : audit [DBG] from='client.113460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:55 smithi191 bash[24992]: cluster 2024-08-31T04:01:53.256249+0000 mgr.a (mgr.14388) 4785 : cluster [DBG] pgmap v3316: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:01:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:55 smithi191 bash[24992]: audit 2024-08-31T04:01:53.461933+0000 mgr.a (mgr.14388) 4786 : audit [DBG] from='client.113460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:01:57.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:57 smithi163 bash[24253]: cluster 2024-08-31T04:01:55.257241+0000 mgr.a (mgr.14388) 4787 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:01:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:57 smithi027 bash[22610]: cluster 2024-08-31T04:01:55.257241+0000 mgr.a (mgr.14388) 4787 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:01:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:57 smithi191 bash[24992]: cluster 2024-08-31T04:01:55.257241+0000 mgr.a (mgr.14388) 4787 : cluster [DBG] pgmap v3317: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:01:58.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:01:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:01:58.882 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:01:59.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:01:59 smithi163 bash[24253]: cluster 2024-08-31T04:01:57.258060+0000 mgr.a (mgr.14388) 4788 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:01:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:01:59 smithi027 bash[22610]: cluster 2024-08-31T04:01:57.258060+0000 mgr.a (mgr.14388) 4788 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:01:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:01:59 smithi191 bash[24992]: cluster 2024-08-31T04:01:57.258060+0000 mgr.a (mgr.14388) 4788 : cluster [DBG] pgmap v3318: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:01:59.631 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:01:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:01:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:01:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:01:59.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:01.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:01 smithi163 bash[24253]: audit 2024-08-31T04:01:59.211812+0000 mgr.a (mgr.14388) 4789 : audit [DBG] from='client.113538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:01.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:01 smithi163 bash[24253]: cluster 2024-08-31T04:01:59.260059+0000 mgr.a (mgr.14388) 4790 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:01 smithi027 bash[22610]: audit 2024-08-31T04:01:59.211812+0000 mgr.a (mgr.14388) 4789 : audit [DBG] from='client.113538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:01 smithi027 bash[22610]: cluster 2024-08-31T04:01:59.260059+0000 mgr.a (mgr.14388) 4790 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:01 smithi191 bash[24992]: audit 2024-08-31T04:01:59.211812+0000 mgr.a (mgr.14388) 4789 : audit [DBG] from='client.113538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:01 smithi191 bash[24992]: cluster 2024-08-31T04:01:59.260059+0000 mgr.a (mgr.14388) 4790 : cluster [DBG] pgmap v3319: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:03 smithi163 bash[24253]: cluster 2024-08-31T04:02:01.260952+0000 mgr.a (mgr.14388) 4791 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:03 smithi027 bash[22610]: cluster 2024-08-31T04:02:01.260952+0000 mgr.a (mgr.14388) 4791 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:03 smithi191 bash[24992]: cluster 2024-08-31T04:02:01.260952+0000 mgr.a (mgr.14388) 4791 : cluster [DBG] pgmap v3320: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:04.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:02:04.632 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:02:04.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:02:05.375 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:02:05.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:02:05.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:02:05.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:02:05.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:05.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:05 smithi163 bash[24253]: cluster 2024-08-31T04:02:03.263138+0000 mgr.a (mgr.14388) 4792 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:05 smithi027 bash[22610]: cluster 2024-08-31T04:02:03.263138+0000 mgr.a (mgr.14388) 4792 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:05 smithi191 bash[24992]: cluster 2024-08-31T04:02:03.263138+0000 mgr.a (mgr.14388) 4792 : cluster [DBG] pgmap v3321: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:06.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:06 smithi163 bash[24253]: audit 2024-08-31T04:02:04.962655+0000 mgr.a (mgr.14388) 4793 : audit [DBG] from='client.113616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:06 smithi027 bash[22610]: audit 2024-08-31T04:02:04.962655+0000 mgr.a (mgr.14388) 4793 : audit [DBG] from='client.113616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:06 smithi191 bash[24992]: audit 2024-08-31T04:02:04.962655+0000 mgr.a (mgr.14388) 4793 : audit [DBG] from='client.113616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:07.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:07 smithi163 bash[24253]: cluster 2024-08-31T04:02:05.263744+0000 mgr.a (mgr.14388) 4794 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:07 smithi027 bash[22610]: cluster 2024-08-31T04:02:05.263744+0000 mgr.a (mgr.14388) 4794 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:07 smithi191 bash[24992]: cluster 2024-08-31T04:02:05.263744+0000 mgr.a (mgr.14388) 4794 : cluster [DBG] pgmap v3322: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:09 smithi163 bash[24253]: cluster 2024-08-31T04:02:07.264602+0000 mgr.a (mgr.14388) 4795 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:09 smithi027 bash[22610]: cluster 2024-08-31T04:02:07.264602+0000 mgr.a (mgr.14388) 4795 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:09 smithi191 bash[24992]: cluster 2024-08-31T04:02:07.264602+0000 mgr.a (mgr.14388) 4795 : cluster [DBG] pgmap v3323: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:10.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:02:10.377 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:02:10.377 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:02:11.155 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:02:11.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:02:11.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:02:11.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:02:11.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:11 smithi163 bash[24253]: cluster 2024-08-31T04:02:09.266843+0000 mgr.a (mgr.14388) 4796 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:11 smithi027 bash[22610]: cluster 2024-08-31T04:02:09.266843+0000 mgr.a (mgr.14388) 4796 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:11 smithi191 bash[24992]: cluster 2024-08-31T04:02:09.266843+0000 mgr.a (mgr.14388) 4796 : cluster [DBG] pgmap v3324: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:12 smithi027 bash[22610]: audit 2024-08-31T04:02:10.721745+0000 mgr.a (mgr.14388) 4797 : audit [DBG] from='client.113694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:12 smithi191 bash[24992]: audit 2024-08-31T04:02:10.721745+0000 mgr.a (mgr.14388) 4797 : audit [DBG] from='client.113694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:12.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:12 smithi163 bash[24253]: audit 2024-08-31T04:02:10.721745+0000 mgr.a (mgr.14388) 4797 : audit [DBG] from='client.113694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:13 smithi027 bash[22610]: cluster 2024-08-31T04:02:11.267759+0000 mgr.a (mgr.14388) 4798 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:13 smithi191 bash[24992]: cluster 2024-08-31T04:02:11.267759+0000 mgr.a (mgr.14388) 4798 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:13.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:13 smithi163 bash[24253]: cluster 2024-08-31T04:02:11.267759+0000 mgr.a (mgr.14388) 4798 : cluster [DBG] pgmap v3325: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:15 smithi027 bash[22610]: cluster 2024-08-31T04:02:13.269922+0000 mgr.a (mgr.14388) 4799 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:15 smithi191 bash[24992]: cluster 2024-08-31T04:02:13.269922+0000 mgr.a (mgr.14388) 4799 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:15.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:15 smithi163 bash[24253]: cluster 2024-08-31T04:02:13.269922+0000 mgr.a (mgr.14388) 4799 : cluster [DBG] pgmap v3326: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:16.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:02:16.158 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:02:16.158 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:02:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:16 smithi191 bash[24992]: cluster 2024-08-31T04:02:15.270679+0000 mgr.a (mgr.14388) 4800 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:16.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:16 smithi163 bash[24253]: cluster 2024-08-31T04:02:15.270679+0000 mgr.a (mgr.14388) 4800 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:16 smithi027 bash[22610]: cluster 2024-08-31T04:02:15.270679+0000 mgr.a (mgr.14388) 4800 : cluster [DBG] pgmap v3327: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:16.901 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:02:16.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:02:16.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:02:16.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:02:16.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:17 smithi191 bash[24992]: audit 2024-08-31T04:02:16.491141+0000 mgr.a (mgr.14388) 4801 : audit [DBG] from='client.113772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:17.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:17 smithi163 bash[24253]: audit 2024-08-31T04:02:16.491141+0000 mgr.a (mgr.14388) 4801 : audit [DBG] from='client.113772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:17 smithi027 bash[22610]: audit 2024-08-31T04:02:16.491141+0000 mgr.a (mgr.14388) 4801 : audit [DBG] from='client.113772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:18.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:18 smithi191 bash[24992]: cluster 2024-08-31T04:02:17.271679+0000 mgr.a (mgr.14388) 4802 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:18.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:18 smithi163 bash[24253]: cluster 2024-08-31T04:02:17.271679+0000 mgr.a (mgr.14388) 4802 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:18 smithi027 bash[22610]: cluster 2024-08-31T04:02:17.271679+0000 mgr.a (mgr.14388) 4802 : cluster [DBG] pgmap v3328: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:20.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:20 smithi163 bash[24253]: cluster 2024-08-31T04:02:19.273915+0000 mgr.a (mgr.14388) 4803 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:20 smithi027 bash[22610]: cluster 2024-08-31T04:02:19.273915+0000 mgr.a (mgr.14388) 4803 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:20 smithi191 bash[24992]: cluster 2024-08-31T04:02:19.273915+0000 mgr.a (mgr.14388) 4803 : cluster [DBG] pgmap v3329: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:02:21.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:02:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:02:21.904 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:02:22.675 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:02:22.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:02:22.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:02:22.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:02:22.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:22 smithi163 bash[24253]: cluster 2024-08-31T04:02:21.274649+0000 mgr.a (mgr.14388) 4804 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:22 smithi163 bash[24253]: audit 2024-08-31T04:02:21.420455+0000 mon.a (mon.0) 1304 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:02:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:22 smithi163 bash[24253]: audit 2024-08-31T04:02:22.031194+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:22 smithi163 bash[24253]: audit 2024-08-31T04:02:22.035091+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:22 smithi163 bash[24253]: audit 2024-08-31T04:02:22.041423+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:22 smithi163 bash[24253]: audit 2024-08-31T04:02:22.046115+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:22 smithi027 bash[22610]: cluster 2024-08-31T04:02:21.274649+0000 mgr.a (mgr.14388) 4804 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:22 smithi027 bash[22610]: audit 2024-08-31T04:02:21.420455+0000 mon.a (mon.0) 1304 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:02:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:22 smithi027 bash[22610]: audit 2024-08-31T04:02:22.031194+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:22 smithi027 bash[22610]: audit 2024-08-31T04:02:22.035091+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:22 smithi027 bash[22610]: audit 2024-08-31T04:02:22.041423+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:22 smithi027 bash[22610]: audit 2024-08-31T04:02:22.046115+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:22 smithi191 bash[24992]: cluster 2024-08-31T04:02:21.274649+0000 mgr.a (mgr.14388) 4804 : cluster [DBG] pgmap v3330: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:22 smithi191 bash[24992]: audit 2024-08-31T04:02:21.420455+0000 mon.a (mon.0) 1304 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:02:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:22 smithi191 bash[24992]: audit 2024-08-31T04:02:22.031194+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:22 smithi191 bash[24992]: audit 2024-08-31T04:02:22.035091+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:22 smithi191 bash[24992]: audit 2024-08-31T04:02:22.041423+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:22 smithi191 bash[24992]: audit 2024-08-31T04:02:22.046115+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:23.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:23 smithi163 bash[24253]: audit 2024-08-31T04:02:22.260795+0000 mgr.a (mgr.14388) 4805 : audit [DBG] from='client.113850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:23 smithi163 bash[24253]: audit 2024-08-31T04:02:22.735082+0000 mon.a (mon.0) 1309 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:02:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:23 smithi163 bash[24253]: audit 2024-08-31T04:02:22.736335+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:02:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:23 smithi163 bash[24253]: audit 2024-08-31T04:02:22.742045+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:23 smithi163 bash[24253]: audit 2024-08-31T04:02:22.744176+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:02:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:23 smithi163 bash[24253]: audit 2024-08-31T04:02:22.746760+0000 mgr.a (mgr.14388) 4806 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:02:23.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:02:23 smithi027 bash[22863]: debug 2024-08-31T04:02:23.431+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:02:23.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:02:23 smithi027 bash[22863]: debug 2024-08-31T04:02:23.431+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:02:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:23 smithi027 bash[22610]: audit 2024-08-31T04:02:22.260795+0000 mgr.a (mgr.14388) 4805 : audit [DBG] from='client.113850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:23 smithi027 bash[22610]: audit 2024-08-31T04:02:22.735082+0000 mon.a (mon.0) 1309 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:02:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:23 smithi027 bash[22610]: audit 2024-08-31T04:02:22.736335+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:02:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:23 smithi027 bash[22610]: audit 2024-08-31T04:02:22.742045+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:23 smithi027 bash[22610]: audit 2024-08-31T04:02:22.744176+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:02:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:23 smithi027 bash[22610]: audit 2024-08-31T04:02:22.746760+0000 mgr.a (mgr.14388) 4806 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:02:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:23 smithi191 bash[24992]: audit 2024-08-31T04:02:22.260795+0000 mgr.a (mgr.14388) 4805 : audit [DBG] from='client.113850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:23 smithi191 bash[24992]: audit 2024-08-31T04:02:22.735082+0000 mon.a (mon.0) 1309 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:02:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:23 smithi191 bash[24992]: audit 2024-08-31T04:02:22.736335+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:02:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:23 smithi191 bash[24992]: audit 2024-08-31T04:02:22.742045+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:02:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:23 smithi191 bash[24992]: audit 2024-08-31T04:02:22.744176+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:02:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:23 smithi191 bash[24992]: audit 2024-08-31T04:02:22.746760+0000 mgr.a (mgr.14388) 4806 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:02:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:24 smithi191 bash[24992]: cluster 2024-08-31T04:02:23.275899+0000 mgr.a (mgr.14388) 4807 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-31T04:02:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:24 smithi191 bash[24992]: audit 2024-08-31T04:02:23.436636+0000 mgr.a (mgr.14388) 4808 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:02:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:24 smithi191 bash[24992]: cephadm 2024-08-31T04:02:23.437966+0000 mgr.a (mgr.14388) 4809 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:02:25.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:24 smithi163 bash[24253]: cluster 2024-08-31T04:02:23.275899+0000 mgr.a (mgr.14388) 4807 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-31T04:02:25.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:24 smithi163 bash[24253]: audit 2024-08-31T04:02:23.436636+0000 mgr.a (mgr.14388) 4808 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:02:25.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:24 smithi163 bash[24253]: cephadm 2024-08-31T04:02:23.437966+0000 mgr.a (mgr.14388) 4809 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:02:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:24 smithi027 bash[22610]: cluster 2024-08-31T04:02:23.275899+0000 mgr.a (mgr.14388) 4807 : cluster [DBG] pgmap v3331: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-31T04:02:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:24 smithi027 bash[22610]: audit 2024-08-31T04:02:23.436636+0000 mgr.a (mgr.14388) 4808 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:02:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:24 smithi027 bash[22610]: cephadm 2024-08-31T04:02:23.437966+0000 mgr.a (mgr.14388) 4809 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:02:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:26 smithi191 bash[24992]: cluster 2024-08-31T04:02:25.276630+0000 mgr.a (mgr.14388) 4810 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-31T04:02:27.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:26 smithi163 bash[24253]: cluster 2024-08-31T04:02:25.276630+0000 mgr.a (mgr.14388) 4810 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-31T04:02:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:26 smithi027 bash[22610]: cluster 2024-08-31T04:02:25.276630+0000 mgr.a (mgr.14388) 4810 : cluster [DBG] pgmap v3332: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-31T04:02:27.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:02:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:02:27.677 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:02:28.451 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:02:28.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:02:28.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:02:28.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:02:28.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:28 smithi191 bash[24992]: cluster 2024-08-31T04:02:27.277437+0000 mgr.a (mgr.14388) 4811 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-31T04:02:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:28 smithi191 bash[24992]: audit 2024-08-31T04:02:28.015160+0000 mgr.a (mgr.14388) 4812 : audit [DBG] from='client.114027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:29.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:28 smithi163 bash[24253]: cluster 2024-08-31T04:02:27.277437+0000 mgr.a (mgr.14388) 4811 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-31T04:02:29.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:28 smithi163 bash[24253]: audit 2024-08-31T04:02:28.015160+0000 mgr.a (mgr.14388) 4812 : audit [DBG] from='client.114027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:28 smithi027 bash[22610]: cluster 2024-08-31T04:02:27.277437+0000 mgr.a (mgr.14388) 4811 : cluster [DBG] pgmap v3333: 225 pgs: 225 active+clean; 589 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-31T04:02:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:28 smithi027 bash[22610]: audit 2024-08-31T04:02:28.015160+0000 mgr.a (mgr.14388) 4812 : audit [DBG] from='client.114027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:30 smithi191 bash[24992]: cluster 2024-08-31T04:02:29.280103+0000 mgr.a (mgr.14388) 4813 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 426 B/s wr, 88 op/s 2024-08-31T04:02:31.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:30 smithi163 bash[24253]: cluster 2024-08-31T04:02:29.280103+0000 mgr.a (mgr.14388) 4813 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 426 B/s wr, 88 op/s 2024-08-31T04:02:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:30 smithi027 bash[22610]: cluster 2024-08-31T04:02:29.280103+0000 mgr.a (mgr.14388) 4813 : cluster [DBG] pgmap v3334: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 426 B/s wr, 88 op/s 2024-08-31T04:02:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:32 smithi191 bash[24992]: cluster 2024-08-31T04:02:31.280905+0000 mgr.a (mgr.14388) 4814 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 426 B/s wr, 87 op/s 2024-08-31T04:02:33.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:32 smithi163 bash[24253]: cluster 2024-08-31T04:02:31.280905+0000 mgr.a (mgr.14388) 4814 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 426 B/s wr, 87 op/s 2024-08-31T04:02:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:32 smithi027 bash[22610]: cluster 2024-08-31T04:02:31.280905+0000 mgr.a (mgr.14388) 4814 : cluster [DBG] pgmap v3335: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 426 B/s wr, 87 op/s 2024-08-31T04:02:33.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:02:33.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:02:33.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:02:34.200 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:02:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:02:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:02:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:02:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:34 smithi191 bash[24992]: cluster 2024-08-31T04:02:33.282828+0000 mgr.a (mgr.14388) 4815 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 426 B/s wr, 88 op/s 2024-08-31T04:02:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:34 smithi191 bash[24992]: audit 2024-08-31T04:02:33.783923+0000 mgr.a (mgr.14388) 4816 : audit [DBG] from='client.114105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:35.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:34 smithi163 bash[24253]: cluster 2024-08-31T04:02:33.282828+0000 mgr.a (mgr.14388) 4815 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 426 B/s wr, 88 op/s 2024-08-31T04:02:35.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:34 smithi163 bash[24253]: audit 2024-08-31T04:02:33.783923+0000 mgr.a (mgr.14388) 4816 : audit [DBG] from='client.114105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:34 smithi027 bash[22610]: cluster 2024-08-31T04:02:33.282828+0000 mgr.a (mgr.14388) 4815 : cluster [DBG] pgmap v3336: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 56 KiB/s rd, 426 B/s wr, 88 op/s 2024-08-31T04:02:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:34 smithi027 bash[22610]: audit 2024-08-31T04:02:33.783923+0000 mgr.a (mgr.14388) 4816 : audit [DBG] from='client.114105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:36 smithi191 bash[24992]: cluster 2024-08-31T04:02:35.283693+0000 mgr.a (mgr.14388) 4817 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-08-31T04:02:37.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:36 smithi163 bash[24253]: cluster 2024-08-31T04:02:35.283693+0000 mgr.a (mgr.14388) 4817 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-08-31T04:02:37.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:36 smithi027 bash[22610]: cluster 2024-08-31T04:02:35.283693+0000 mgr.a (mgr.14388) 4817 : cluster [DBG] pgmap v3337: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-08-31T04:02:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:38 smithi191 bash[24992]: cluster 2024-08-31T04:02:37.284484+0000 mgr.a (mgr.14388) 4818 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-08-31T04:02:39.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:38 smithi163 bash[24253]: cluster 2024-08-31T04:02:37.284484+0000 mgr.a (mgr.14388) 4818 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-08-31T04:02:39.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:02:39.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:02:39.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:02:39.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:38 smithi027 bash[22610]: cluster 2024-08-31T04:02:37.284484+0000 mgr.a (mgr.14388) 4818 : cluster [DBG] pgmap v3338: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 47 KiB/s rd, 426 B/s wr, 73 op/s 2024-08-31T04:02:39.951 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:02:39.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:02:39.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:02:39.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:02:39.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:40 smithi191 bash[24992]: cluster 2024-08-31T04:02:39.286592+0000 mgr.a (mgr.14388) 4819 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-08-31T04:02:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:40 smithi191 bash[24992]: audit 2024-08-31T04:02:39.530945+0000 mgr.a (mgr.14388) 4820 : audit [DBG] from='client.114183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:41.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:40 smithi163 bash[24253]: cluster 2024-08-31T04:02:39.286592+0000 mgr.a (mgr.14388) 4819 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-08-31T04:02:41.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:40 smithi163 bash[24253]: audit 2024-08-31T04:02:39.530945+0000 mgr.a (mgr.14388) 4820 : audit [DBG] from='client.114183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:40 smithi027 bash[22610]: cluster 2024-08-31T04:02:39.286592+0000 mgr.a (mgr.14388) 4819 : cluster [DBG] pgmap v3339: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 48 KiB/s rd, 426 B/s wr, 74 op/s 2024-08-31T04:02:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:40 smithi027 bash[22610]: audit 2024-08-31T04:02:39.530945+0000 mgr.a (mgr.14388) 4820 : audit [DBG] from='client.114183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:42 smithi191 bash[24992]: cluster 2024-08-31T04:02:41.287494+0000 mgr.a (mgr.14388) 4821 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:43.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:42 smithi163 bash[24253]: cluster 2024-08-31T04:02:41.287494+0000 mgr.a (mgr.14388) 4821 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:42 smithi027 bash[22610]: cluster 2024-08-31T04:02:41.287494+0000 mgr.a (mgr.14388) 4821 : cluster [DBG] pgmap v3340: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:44.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:02:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:02:44.954 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:02:45.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:44 smithi163 bash[24253]: cluster 2024-08-31T04:02:43.289581+0000 mgr.a (mgr.14388) 4822 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:02:45.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:44 smithi027 bash[22610]: cluster 2024-08-31T04:02:43.289581+0000 mgr.a (mgr.14388) 4822 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:02:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:44 smithi191 bash[24992]: cluster 2024-08-31T04:02:43.289581+0000 mgr.a (mgr.14388) 4822 : cluster [DBG] pgmap v3341: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:02:45.725 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:02:45.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:02:45.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:02:45.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:02:45.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:47.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:46 smithi163 bash[24253]: audit 2024-08-31T04:02:45.287937+0000 mgr.a (mgr.14388) 4823 : audit [DBG] from='client.114261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:47.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:46 smithi163 bash[24253]: cluster 2024-08-31T04:02:45.302828+0000 mgr.a (mgr.14388) 4824 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:02:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:46 smithi027 bash[22610]: audit 2024-08-31T04:02:45.287937+0000 mgr.a (mgr.14388) 4823 : audit [DBG] from='client.114261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:46 smithi027 bash[22610]: cluster 2024-08-31T04:02:45.302828+0000 mgr.a (mgr.14388) 4824 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:02:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:46 smithi191 bash[24992]: audit 2024-08-31T04:02:45.287937+0000 mgr.a (mgr.14388) 4823 : audit [DBG] from='client.114261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:46 smithi191 bash[24992]: cluster 2024-08-31T04:02:45.302828+0000 mgr.a (mgr.14388) 4824 : cluster [DBG] pgmap v3342: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:02:49.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:48 smithi163 bash[24253]: cluster 2024-08-31T04:02:47.303862+0000 mgr.a (mgr.14388) 4825 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:02:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:48 smithi027 bash[22610]: cluster 2024-08-31T04:02:47.303862+0000 mgr.a (mgr.14388) 4825 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:02:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:48 smithi191 bash[24992]: cluster 2024-08-31T04:02:47.303862+0000 mgr.a (mgr.14388) 4825 : cluster [DBG] pgmap v3343: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:02:50.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:02:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:02:50.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:02:51.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:50 smithi163 bash[24253]: cluster 2024-08-31T04:02:49.306069+0000 mgr.a (mgr.14388) 4826 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:02:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:50 smithi027 bash[22610]: cluster 2024-08-31T04:02:49.306069+0000 mgr.a (mgr.14388) 4826 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:02:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:50 smithi191 bash[24992]: cluster 2024-08-31T04:02:49.306069+0000 mgr.a (mgr.14388) 4826 : cluster [DBG] pgmap v3344: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:02:51.501 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:02:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:02:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:02:51.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:02:51.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:52.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:51 smithi163 bash[24253]: audit 2024-08-31T04:02:51.067941+0000 mgr.a (mgr.14388) 4827 : audit [DBG] from='client.114339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:51 smithi027 bash[22610]: audit 2024-08-31T04:02:51.067941+0000 mgr.a (mgr.14388) 4827 : audit [DBG] from='client.114339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:51 smithi191 bash[24992]: audit 2024-08-31T04:02:51.067941+0000 mgr.a (mgr.14388) 4827 : audit [DBG] from='client.114339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:53.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:52 smithi163 bash[24253]: cluster 2024-08-31T04:02:51.307672+0000 mgr.a (mgr.14388) 4828 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:02:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:52 smithi027 bash[22610]: cluster 2024-08-31T04:02:51.307672+0000 mgr.a (mgr.14388) 4828 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:02:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:52 smithi191 bash[24992]: cluster 2024-08-31T04:02:51.307672+0000 mgr.a (mgr.14388) 4828 : cluster [DBG] pgmap v3345: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:02:55.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:54 smithi163 bash[24253]: cluster 2024-08-31T04:02:53.309911+0000 mgr.a (mgr.14388) 4829 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:02:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:54 smithi027 bash[22610]: cluster 2024-08-31T04:02:53.309911+0000 mgr.a (mgr.14388) 4829 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:02:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:54 smithi191 bash[24992]: cluster 2024-08-31T04:02:53.309911+0000 mgr.a (mgr.14388) 4829 : cluster [DBG] pgmap v3346: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:02:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:02:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:02:56.504 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:02:57.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:56 smithi163 bash[24253]: cluster 2024-08-31T04:02:55.310665+0000 mgr.a (mgr.14388) 4830 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:56 smithi027 bash[22610]: cluster 2024-08-31T04:02:55.310665+0000 mgr.a (mgr.14388) 4830 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:57.245 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:02:57.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:02:57.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:02:57.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:02:57.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:02:57.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:56 smithi191 bash[24992]: cluster 2024-08-31T04:02:55.310665+0000 mgr.a (mgr.14388) 4830 : cluster [DBG] pgmap v3347: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:58.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:57 smithi163 bash[24253]: audit 2024-08-31T04:02:56.832318+0000 mgr.a (mgr.14388) 4831 : audit [DBG] from='client.114417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:57 smithi027 bash[22610]: audit 2024-08-31T04:02:56.832318+0000 mgr.a (mgr.14388) 4831 : audit [DBG] from='client.114417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:57 smithi191 bash[24992]: audit 2024-08-31T04:02:56.832318+0000 mgr.a (mgr.14388) 4831 : audit [DBG] from='client.114417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:02:59.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:02:58 smithi163 bash[24253]: cluster 2024-08-31T04:02:57.311233+0000 mgr.a (mgr.14388) 4832 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:02:58 smithi027 bash[22610]: cluster 2024-08-31T04:02:57.311233+0000 mgr.a (mgr.14388) 4832 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:02:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:02:58 smithi191 bash[24992]: cluster 2024-08-31T04:02:57.311233+0000 mgr.a (mgr.14388) 4832 : cluster [DBG] pgmap v3348: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:01.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:00 smithi163 bash[24253]: cluster 2024-08-31T04:02:59.313399+0000 mgr.a (mgr.14388) 4833 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:03:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:00 smithi027 bash[22610]: cluster 2024-08-31T04:02:59.313399+0000 mgr.a (mgr.14388) 4833 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:03:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:00 smithi191 bash[24992]: cluster 2024-08-31T04:02:59.313399+0000 mgr.a (mgr.14388) 4833 : cluster [DBG] pgmap v3349: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:03:02.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:02.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:02.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:03:03.017 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:03:03.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:03:03.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:03:03.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:03:03.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:03:03.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:02 smithi163 bash[24253]: cluster 2024-08-31T04:03:01.314148+0000 mgr.a (mgr.14388) 4834 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:02 smithi027 bash[22610]: cluster 2024-08-31T04:03:01.314148+0000 mgr.a (mgr.14388) 4834 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:02 smithi191 bash[24992]: cluster 2024-08-31T04:03:01.314148+0000 mgr.a (mgr.14388) 4834 : cluster [DBG] pgmap v3350: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:04.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:03 smithi163 bash[24253]: audit 2024-08-31T04:03:02.584220+0000 mgr.a (mgr.14388) 4835 : audit [DBG] from='client.114492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:03 smithi027 bash[22610]: audit 2024-08-31T04:03:02.584220+0000 mgr.a (mgr.14388) 4835 : audit [DBG] from='client.114492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:03 smithi191 bash[24992]: audit 2024-08-31T04:03:02.584220+0000 mgr.a (mgr.14388) 4835 : audit [DBG] from='client.114492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:05.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:04 smithi163 bash[24253]: cluster 2024-08-31T04:03:03.316785+0000 mgr.a (mgr.14388) 4836 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:03:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:04 smithi027 bash[22610]: cluster 2024-08-31T04:03:03.316785+0000 mgr.a (mgr.14388) 4836 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:03:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:04 smithi191 bash[24992]: cluster 2024-08-31T04:03:03.316785+0000 mgr.a (mgr.14388) 4836 : cluster [DBG] pgmap v3351: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:03:07.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:06 smithi163 bash[24253]: cluster 2024-08-31T04:03:05.317570+0000 mgr.a (mgr.14388) 4837 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:03:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:06 smithi027 bash[22610]: cluster 2024-08-31T04:03:05.317570+0000 mgr.a (mgr.14388) 4837 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:03:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:06 smithi191 bash[24992]: cluster 2024-08-31T04:03:05.317570+0000 mgr.a (mgr.14388) 4837 : cluster [DBG] pgmap v3352: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:03:08.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:03:08.798 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:03:08.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:03:08.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:03:08.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:03:08.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:03:09.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:08 smithi163 bash[24253]: cluster 2024-08-31T04:03:07.318299+0000 mgr.a (mgr.14388) 4838 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:03:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:08 smithi027 bash[22610]: cluster 2024-08-31T04:03:07.318299+0000 mgr.a (mgr.14388) 4838 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:03:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:08 smithi191 bash[24992]: cluster 2024-08-31T04:03:07.318299+0000 mgr.a (mgr.14388) 4838 : cluster [DBG] pgmap v3353: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:03:10.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:09 smithi163 bash[24253]: audit 2024-08-31T04:03:08.356525+0000 mgr.a (mgr.14388) 4839 : audit [DBG] from='client.114570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:09 smithi027 bash[22610]: audit 2024-08-31T04:03:08.356525+0000 mgr.a (mgr.14388) 4839 : audit [DBG] from='client.114570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:09 smithi191 bash[24992]: audit 2024-08-31T04:03:08.356525+0000 mgr.a (mgr.14388) 4839 : audit [DBG] from='client.114570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:11.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:10 smithi163 bash[24253]: cluster 2024-08-31T04:03:09.321015+0000 mgr.a (mgr.14388) 4840 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:10 smithi027 bash[22610]: cluster 2024-08-31T04:03:09.321015+0000 mgr.a (mgr.14388) 4840 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:10 smithi191 bash[24992]: cluster 2024-08-31T04:03:09.321015+0000 mgr.a (mgr.14388) 4840 : cluster [DBG] pgmap v3354: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:13.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:12 smithi163 bash[24253]: cluster 2024-08-31T04:03:11.321957+0000 mgr.a (mgr.14388) 4841 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:03:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:12 smithi027 bash[22610]: cluster 2024-08-31T04:03:11.321957+0000 mgr.a (mgr.14388) 4841 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:03:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:12 smithi191 bash[24992]: cluster 2024-08-31T04:03:11.321957+0000 mgr.a (mgr.14388) 4841 : cluster [DBG] pgmap v3355: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:03:13.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:13.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:13.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:03:14.568 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:03:14.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:03:14.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:03:14.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:03:14.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:03:15.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:14 smithi163 bash[24253]: cluster 2024-08-31T04:03:13.323898+0000 mgr.a (mgr.14388) 4842 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:15.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:14 smithi163 bash[24253]: audit 2024-08-31T04:03:14.140079+0000 mgr.a (mgr.14388) 4843 : audit [DBG] from='client.114648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:14 smithi027 bash[22610]: cluster 2024-08-31T04:03:13.323898+0000 mgr.a (mgr.14388) 4842 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:14 smithi027 bash[22610]: audit 2024-08-31T04:03:14.140079+0000 mgr.a (mgr.14388) 4843 : audit [DBG] from='client.114648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:14 smithi191 bash[24992]: cluster 2024-08-31T04:03:13.323898+0000 mgr.a (mgr.14388) 4842 : cluster [DBG] pgmap v3356: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:14 smithi191 bash[24992]: audit 2024-08-31T04:03:14.140079+0000 mgr.a (mgr.14388) 4843 : audit [DBG] from='client.114648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:17.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:16 smithi163 bash[24253]: cluster 2024-08-31T04:03:15.324864+0000 mgr.a (mgr.14388) 4844 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:03:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:16 smithi027 bash[22610]: cluster 2024-08-31T04:03:15.324864+0000 mgr.a (mgr.14388) 4844 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:03:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:16 smithi191 bash[24992]: cluster 2024-08-31T04:03:15.324864+0000 mgr.a (mgr.14388) 4844 : cluster [DBG] pgmap v3357: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:03:19.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:18 smithi163 bash[24253]: cluster 2024-08-31T04:03:17.325652+0000 mgr.a (mgr.14388) 4845 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:03:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:18 smithi027 bash[22610]: cluster 2024-08-31T04:03:17.325652+0000 mgr.a (mgr.14388) 4845 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:03:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:18 smithi191 bash[24992]: cluster 2024-08-31T04:03:17.325652+0000 mgr.a (mgr.14388) 4845 : cluster [DBG] pgmap v3358: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:03:19.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:19.570 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:19.570 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:03:20.350 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:03:20.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:03:20.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:03:20.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:03:20.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:03:21.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:20 smithi163 bash[24253]: cluster 2024-08-31T04:03:19.327880+0000 mgr.a (mgr.14388) 4846 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:03:21.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:20 smithi163 bash[24253]: audit 2024-08-31T04:03:19.906028+0000 mgr.a (mgr.14388) 4847 : audit [DBG] from='client.114726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:20 smithi027 bash[22610]: cluster 2024-08-31T04:03:19.327880+0000 mgr.a (mgr.14388) 4846 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:03:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:20 smithi027 bash[22610]: audit 2024-08-31T04:03:19.906028+0000 mgr.a (mgr.14388) 4847 : audit [DBG] from='client.114726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:20 smithi191 bash[24992]: cluster 2024-08-31T04:03:19.327880+0000 mgr.a (mgr.14388) 4846 : cluster [DBG] pgmap v3359: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:03:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:20 smithi191 bash[24992]: audit 2024-08-31T04:03:19.906028+0000 mgr.a (mgr.14388) 4847 : audit [DBG] from='client.114726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:23.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:22 smithi163 bash[24253]: cluster 2024-08-31T04:03:21.328803+0000 mgr.a (mgr.14388) 4848 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:22 smithi027 bash[22610]: cluster 2024-08-31T04:03:21.328803+0000 mgr.a (mgr.14388) 4848 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:22 smithi191 bash[24992]: cluster 2024-08-31T04:03:21.328803+0000 mgr.a (mgr.14388) 4848 : cluster [DBG] pgmap v3360: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:24.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:23 smithi163 bash[24253]: audit 2024-08-31T04:03:23.488604+0000 mon.a (mon.0) 1313 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:03:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:23 smithi027 bash[22610]: audit 2024-08-31T04:03:23.488604+0000 mon.a (mon.0) 1313 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:03:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:23 smithi191 bash[24992]: audit 2024-08-31T04:03:23.488604+0000 mon.a (mon.0) 1313 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:03:25.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:24 smithi163 bash[24253]: cluster 2024-08-31T04:03:23.331011+0000 mgr.a (mgr.14388) 4849 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:03:25.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:24 smithi163 bash[24253]: audit 2024-08-31T04:03:24.332952+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:03:25.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:24 smithi163 bash[24253]: audit 2024-08-31T04:03:24.334267+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:03:25.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:24 smithi163 bash[24253]: audit 2024-08-31T04:03:24.344177+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:03:25.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:24 smithi163 bash[24253]: audit 2024-08-31T04:03:24.349396+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:03:25.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:03:25 smithi027 bash[22863]: debug 2024-08-31T04:03:25.069+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:03:25.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:03:25 smithi027 bash[22863]: debug 2024-08-31T04:03:25.073+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:03:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:24 smithi027 bash[22610]: cluster 2024-08-31T04:03:23.331011+0000 mgr.a (mgr.14388) 4849 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:03:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:24 smithi027 bash[22610]: audit 2024-08-31T04:03:24.332952+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:03:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:24 smithi027 bash[22610]: audit 2024-08-31T04:03:24.334267+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:03:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:24 smithi027 bash[22610]: audit 2024-08-31T04:03:24.344177+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:03:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:24 smithi027 bash[22610]: audit 2024-08-31T04:03:24.349396+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:03:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:24 smithi191 bash[24992]: cluster 2024-08-31T04:03:23.331011+0000 mgr.a (mgr.14388) 4849 : cluster [DBG] pgmap v3361: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:03:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:24 smithi191 bash[24992]: audit 2024-08-31T04:03:24.332952+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:03:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:24 smithi191 bash[24992]: audit 2024-08-31T04:03:24.334267+0000 mon.a (mon.0) 1315 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:03:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:24 smithi191 bash[24992]: audit 2024-08-31T04:03:24.344177+0000 mon.a (mon.0) 1316 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:03:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:24 smithi191 bash[24992]: audit 2024-08-31T04:03:24.349396+0000 mon.a (mon.0) 1317 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:03:25.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:25.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:25.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:03:26.100 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:03:26.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:03:26.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:03:26.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:03:26.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:03:26.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:25 smithi163 bash[24253]: audit 2024-08-31T04:03:24.351591+0000 mgr.a (mgr.14388) 4850 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:03:26.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:25 smithi163 bash[24253]: audit 2024-08-31T04:03:25.074027+0000 mgr.a (mgr.14388) 4851 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:03:26.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:25 smithi163 bash[24253]: cephadm 2024-08-31T04:03:25.075108+0000 mgr.a (mgr.14388) 4852 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:03:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:25 smithi027 bash[22610]: audit 2024-08-31T04:03:24.351591+0000 mgr.a (mgr.14388) 4850 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:03:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:25 smithi027 bash[22610]: audit 2024-08-31T04:03:25.074027+0000 mgr.a (mgr.14388) 4851 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:03:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:25 smithi027 bash[22610]: cephadm 2024-08-31T04:03:25.075108+0000 mgr.a (mgr.14388) 4852 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:03:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:25 smithi191 bash[24992]: audit 2024-08-31T04:03:24.351591+0000 mgr.a (mgr.14388) 4850 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:03:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:25 smithi191 bash[24992]: audit 2024-08-31T04:03:25.074027+0000 mgr.a (mgr.14388) 4851 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:03:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:25 smithi191 bash[24992]: cephadm 2024-08-31T04:03:25.075108+0000 mgr.a (mgr.14388) 4852 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:03:27.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:26 smithi163 bash[24253]: cluster 2024-08-31T04:03:25.331894+0000 mgr.a (mgr.14388) 4853 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:27.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:26 smithi163 bash[24253]: audit 2024-08-31T04:03:25.684907+0000 mgr.a (mgr.14388) 4854 : audit [DBG] from='client.114906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:26 smithi027 bash[22610]: cluster 2024-08-31T04:03:25.331894+0000 mgr.a (mgr.14388) 4853 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:26 smithi027 bash[22610]: audit 2024-08-31T04:03:25.684907+0000 mgr.a (mgr.14388) 4854 : audit [DBG] from='client.114906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:26 smithi191 bash[24992]: cluster 2024-08-31T04:03:25.331894+0000 mgr.a (mgr.14388) 4853 : cluster [DBG] pgmap v3362: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:26 smithi191 bash[24992]: audit 2024-08-31T04:03:25.684907+0000 mgr.a (mgr.14388) 4854 : audit [DBG] from='client.114906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:29.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:28 smithi163 bash[24253]: cluster 2024-08-31T04:03:27.332964+0000 mgr.a (mgr.14388) 4855 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:28 smithi027 bash[22610]: cluster 2024-08-31T04:03:27.332964+0000 mgr.a (mgr.14388) 4855 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:28 smithi191 bash[24992]: cluster 2024-08-31T04:03:27.332964+0000 mgr.a (mgr.14388) 4855 : cluster [DBG] pgmap v3363: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:31.105 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:31.105 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:03:31.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:30 smithi163 bash[24253]: cluster 2024-08-31T04:03:29.335347+0000 mgr.a (mgr.14388) 4856 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:30 smithi027 bash[22610]: cluster 2024-08-31T04:03:29.335347+0000 mgr.a (mgr.14388) 4856 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:30 smithi191 bash[24992]: cluster 2024-08-31T04:03:29.335347+0000 mgr.a (mgr.14388) 4856 : cluster [DBG] pgmap v3364: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:31.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:03:31.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:03:31.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:03:31.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:03:31.881 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:03:33.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:32 smithi163 bash[24253]: cluster 2024-08-31T04:03:31.336125+0000 mgr.a (mgr.14388) 4857 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:33.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:32 smithi163 bash[24253]: audit 2024-08-31T04:03:31.444613+0000 mgr.a (mgr.14388) 4858 : audit [DBG] from='client.114984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:32 smithi027 bash[22610]: cluster 2024-08-31T04:03:31.336125+0000 mgr.a (mgr.14388) 4857 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:32 smithi027 bash[22610]: audit 2024-08-31T04:03:31.444613+0000 mgr.a (mgr.14388) 4858 : audit [DBG] from='client.114984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:32 smithi191 bash[24992]: cluster 2024-08-31T04:03:31.336125+0000 mgr.a (mgr.14388) 4857 : cluster [DBG] pgmap v3365: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:32 smithi191 bash[24992]: audit 2024-08-31T04:03:31.444613+0000 mgr.a (mgr.14388) 4858 : audit [DBG] from='client.114984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:35.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:34 smithi163 bash[24253]: cluster 2024-08-31T04:03:33.338456+0000 mgr.a (mgr.14388) 4859 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:34 smithi027 bash[22610]: cluster 2024-08-31T04:03:33.338456+0000 mgr.a (mgr.14388) 4859 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:34 smithi191 bash[24992]: cluster 2024-08-31T04:03:33.338456+0000 mgr.a (mgr.14388) 4859 : cluster [DBG] pgmap v3366: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:36.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:36.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:36.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:03:37.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:36 smithi027 bash[22610]: cluster 2024-08-31T04:03:35.339270+0000 mgr.a (mgr.14388) 4860 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:36 smithi191 bash[24992]: cluster 2024-08-31T04:03:35.339270+0000 mgr.a (mgr.14388) 4860 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:37.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:36 smithi163 bash[24253]: cluster 2024-08-31T04:03:35.339270+0000 mgr.a (mgr.14388) 4860 : cluster [DBG] pgmap v3367: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:37.646 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:03:37.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:03:37.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:03:37.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:03:37.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:03:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:37 smithi027 bash[22610]: audit 2024-08-31T04:03:37.216324+0000 mgr.a (mgr.14388) 4861 : audit [DBG] from='client.115059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:37 smithi191 bash[24992]: audit 2024-08-31T04:03:37.216324+0000 mgr.a (mgr.14388) 4861 : audit [DBG] from='client.115059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:38.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:37 smithi163 bash[24253]: audit 2024-08-31T04:03:37.216324+0000 mgr.a (mgr.14388) 4861 : audit [DBG] from='client.115059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:38 smithi027 bash[22610]: cluster 2024-08-31T04:03:37.339779+0000 mgr.a (mgr.14388) 4862 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:38 smithi191 bash[24992]: cluster 2024-08-31T04:03:37.339779+0000 mgr.a (mgr.14388) 4862 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:39.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:38 smithi163 bash[24253]: cluster 2024-08-31T04:03:37.339779+0000 mgr.a (mgr.14388) 4862 : cluster [DBG] pgmap v3368: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:41.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:40 smithi027 bash[22610]: cluster 2024-08-31T04:03:39.342047+0000 mgr.a (mgr.14388) 4863 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:40 smithi191 bash[24992]: cluster 2024-08-31T04:03:39.342047+0000 mgr.a (mgr.14388) 4863 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:41.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:40 smithi163 bash[24253]: cluster 2024-08-31T04:03:39.342047+0000 mgr.a (mgr.14388) 4863 : cluster [DBG] pgmap v3369: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:03:42.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:42.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:42.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:03:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:42 smithi027 bash[22610]: cluster 2024-08-31T04:03:41.342858+0000 mgr.a (mgr.14388) 4864 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:42 smithi191 bash[24992]: cluster 2024-08-31T04:03:41.342858+0000 mgr.a (mgr.14388) 4864 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:43.385 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:03:43.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:03:43.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:03:43.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:03:43.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:03:43.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:42 smithi163 bash[24253]: cluster 2024-08-31T04:03:41.342858+0000 mgr.a (mgr.14388) 4864 : cluster [DBG] pgmap v3370: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:43 smithi027 bash[22610]: audit 2024-08-31T04:03:42.985247+0000 mgr.a (mgr.14388) 4865 : audit [DBG] from='client.115134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:43 smithi191 bash[24992]: audit 2024-08-31T04:03:42.985247+0000 mgr.a (mgr.14388) 4865 : audit [DBG] from='client.115134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:44.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:43 smithi163 bash[24253]: audit 2024-08-31T04:03:42.985247+0000 mgr.a (mgr.14388) 4865 : audit [DBG] from='client.115134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:44 smithi027 bash[22610]: cluster 2024-08-31T04:03:43.344102+0000 mgr.a (mgr.14388) 4866 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:44 smithi191 bash[24992]: cluster 2024-08-31T04:03:43.344102+0000 mgr.a (mgr.14388) 4866 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:45.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:44 smithi163 bash[24253]: cluster 2024-08-31T04:03:43.344102+0000 mgr.a (mgr.14388) 4866 : cluster [DBG] pgmap v3371: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:46 smithi027 bash[22610]: cluster 2024-08-31T04:03:45.344844+0000 mgr.a (mgr.14388) 4867 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:03:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:46 smithi191 bash[24992]: cluster 2024-08-31T04:03:45.344844+0000 mgr.a (mgr.14388) 4867 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:03:47.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:46 smithi163 bash[24253]: cluster 2024-08-31T04:03:45.344844+0000 mgr.a (mgr.14388) 4867 : cluster [DBG] pgmap v3372: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:03:48.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:48.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:48.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:03:49.165 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:03:49.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:03:49.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:03:49.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:03:49.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:03:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:48 smithi191 bash[24992]: cluster 2024-08-31T04:03:47.345590+0000 mgr.a (mgr.14388) 4868 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:03:49.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:48 smithi163 bash[24253]: cluster 2024-08-31T04:03:47.345590+0000 mgr.a (mgr.14388) 4868 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:03:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:48 smithi027 bash[22610]: cluster 2024-08-31T04:03:47.345590+0000 mgr.a (mgr.14388) 4868 : cluster [DBG] pgmap v3373: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:03:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:49 smithi191 bash[24992]: audit 2024-08-31T04:03:48.720846+0000 mgr.a (mgr.14388) 4869 : audit [DBG] from='client.115212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:50.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:50 smithi163 bash[24253]: audit 2024-08-31T04:03:48.720846+0000 mgr.a (mgr.14388) 4869 : audit [DBG] from='client.115212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:49 smithi027 bash[22610]: audit 2024-08-31T04:03:48.720846+0000 mgr.a (mgr.14388) 4869 : audit [DBG] from='client.115212 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:50 smithi191 bash[24992]: cluster 2024-08-31T04:03:49.348313+0000 mgr.a (mgr.14388) 4870 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:51.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:51 smithi163 bash[24253]: cluster 2024-08-31T04:03:49.348313+0000 mgr.a (mgr.14388) 4870 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:50 smithi027 bash[22610]: cluster 2024-08-31T04:03:49.348313+0000 mgr.a (mgr.14388) 4870 : cluster [DBG] pgmap v3374: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:53 smithi191 bash[24992]: cluster 2024-08-31T04:03:51.349105+0000 mgr.a (mgr.14388) 4871 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:03:53.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:53 smithi163 bash[24253]: cluster 2024-08-31T04:03:51.349105+0000 mgr.a (mgr.14388) 4871 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:03:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:53 smithi027 bash[22610]: cluster 2024-08-31T04:03:51.349105+0000 mgr.a (mgr.14388) 4871 : cluster [DBG] pgmap v3375: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:03:54.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:54.168 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:54.168 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:03:54.940 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:03:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:03:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:03:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:03:54.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:03:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:55 smithi191 bash[24992]: cluster 2024-08-31T04:03:53.351095+0000 mgr.a (mgr.14388) 4872 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:55.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:55 smithi163 bash[24253]: cluster 2024-08-31T04:03:53.351095+0000 mgr.a (mgr.14388) 4872 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:55 smithi027 bash[22610]: cluster 2024-08-31T04:03:53.351095+0000 mgr.a (mgr.14388) 4872 : cluster [DBG] pgmap v3376: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:56 smithi191 bash[24992]: audit 2024-08-31T04:03:54.502474+0000 mgr.a (mgr.14388) 4873 : audit [DBG] from='client.115287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:56.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:56 smithi163 bash[24253]: audit 2024-08-31T04:03:54.502474+0000 mgr.a (mgr.14388) 4873 : audit [DBG] from='client.115287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:56 smithi027 bash[22610]: audit 2024-08-31T04:03:54.502474+0000 mgr.a (mgr.14388) 4873 : audit [DBG] from='client.115287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:03:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:57 smithi191 bash[24992]: cluster 2024-08-31T04:03:55.352027+0000 mgr.a (mgr.14388) 4874 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:57.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:57 smithi163 bash[24253]: cluster 2024-08-31T04:03:55.352027+0000 mgr.a (mgr.14388) 4874 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:57 smithi027 bash[22610]: cluster 2024-08-31T04:03:55.352027+0000 mgr.a (mgr.14388) 4874 : cluster [DBG] pgmap v3377: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:03:59 smithi191 bash[24992]: cluster 2024-08-31T04:03:57.352799+0000 mgr.a (mgr.14388) 4875 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:59.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:03:59 smithi163 bash[24253]: cluster 2024-08-31T04:03:57.352799+0000 mgr.a (mgr.14388) 4875 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:03:59 smithi027 bash[22610]: cluster 2024-08-31T04:03:57.352799+0000 mgr.a (mgr.14388) 4875 : cluster [DBG] pgmap v3378: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:03:59.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:03:59.942 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:03:59.943 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:00.707 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:00.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:00.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:00.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:00.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:01 smithi191 bash[24992]: cluster 2024-08-31T04:03:59.354991+0000 mgr.a (mgr.14388) 4876 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:01.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:01 smithi163 bash[24253]: cluster 2024-08-31T04:03:59.354991+0000 mgr.a (mgr.14388) 4876 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:01 smithi027 bash[22610]: cluster 2024-08-31T04:03:59.354991+0000 mgr.a (mgr.14388) 4876 : cluster [DBG] pgmap v3379: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:02 smithi191 bash[24992]: audit 2024-08-31T04:04:00.294371+0000 mgr.a (mgr.14388) 4877 : audit [DBG] from='client.115362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:02.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:02 smithi163 bash[24253]: audit 2024-08-31T04:04:00.294371+0000 mgr.a (mgr.14388) 4877 : audit [DBG] from='client.115362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:02 smithi027 bash[22610]: audit 2024-08-31T04:04:00.294371+0000 mgr.a (mgr.14388) 4877 : audit [DBG] from='client.115362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:03 smithi191 bash[24992]: cluster 2024-08-31T04:04:01.355930+0000 mgr.a (mgr.14388) 4878 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:03 smithi163 bash[24253]: cluster 2024-08-31T04:04:01.355930+0000 mgr.a (mgr.14388) 4878 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:03 smithi027 bash[22610]: cluster 2024-08-31T04:04:01.355930+0000 mgr.a (mgr.14388) 4878 : cluster [DBG] pgmap v3380: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:05.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:05 smithi163 bash[24253]: cluster 2024-08-31T04:04:03.358102+0000 mgr.a (mgr.14388) 4879 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:05 smithi027 bash[22610]: cluster 2024-08-31T04:04:03.358102+0000 mgr.a (mgr.14388) 4879 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:05 smithi191 bash[24992]: cluster 2024-08-31T04:04:03.358102+0000 mgr.a (mgr.14388) 4879 : cluster [DBG] pgmap v3381: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:05.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:04:05.710 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:04:05.710 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:06.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:06.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:07.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:07 smithi163 bash[24253]: cluster 2024-08-31T04:04:05.358898+0000 mgr.a (mgr.14388) 4880 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:07.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:07 smithi163 bash[24253]: audit 2024-08-31T04:04:06.049738+0000 mgr.a (mgr.14388) 4881 : audit [DBG] from='client.115440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:07 smithi027 bash[22610]: cluster 2024-08-31T04:04:05.358898+0000 mgr.a (mgr.14388) 4880 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:07 smithi027 bash[22610]: audit 2024-08-31T04:04:06.049738+0000 mgr.a (mgr.14388) 4881 : audit [DBG] from='client.115440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:07 smithi191 bash[24992]: cluster 2024-08-31T04:04:05.358898+0000 mgr.a (mgr.14388) 4880 : cluster [DBG] pgmap v3382: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:07 smithi191 bash[24992]: audit 2024-08-31T04:04:06.049738+0000 mgr.a (mgr.14388) 4881 : audit [DBG] from='client.115440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:09 smithi163 bash[24253]: cluster 2024-08-31T04:04:07.359822+0000 mgr.a (mgr.14388) 4882 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:09 smithi027 bash[22610]: cluster 2024-08-31T04:04:07.359822+0000 mgr.a (mgr.14388) 4882 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:09 smithi191 bash[24992]: cluster 2024-08-31T04:04:07.359822+0000 mgr.a (mgr.14388) 4882 : cluster [DBG] pgmap v3383: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:11 smithi163 bash[24253]: cluster 2024-08-31T04:04:09.362024+0000 mgr.a (mgr.14388) 4883 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:11.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:04:11.477 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:04:11.477 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:11 smithi027 bash[22610]: cluster 2024-08-31T04:04:09.362024+0000 mgr.a (mgr.14388) 4883 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:11 smithi191 bash[24992]: cluster 2024-08-31T04:04:09.362024+0000 mgr.a (mgr.14388) 4883 : cluster [DBG] pgmap v3384: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:12.244 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:12.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:12.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:12.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:12.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:13.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:13 smithi163 bash[24253]: cluster 2024-08-31T04:04:11.362837+0000 mgr.a (mgr.14388) 4884 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:13.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:13 smithi163 bash[24253]: audit 2024-08-31T04:04:11.813376+0000 mgr.a (mgr.14388) 4885 : audit [DBG] from='client.115515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:13 smithi027 bash[22610]: cluster 2024-08-31T04:04:11.362837+0000 mgr.a (mgr.14388) 4884 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:13 smithi027 bash[22610]: audit 2024-08-31T04:04:11.813376+0000 mgr.a (mgr.14388) 4885 : audit [DBG] from='client.115515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:13 smithi191 bash[24992]: cluster 2024-08-31T04:04:11.362837+0000 mgr.a (mgr.14388) 4884 : cluster [DBG] pgmap v3385: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:13 smithi191 bash[24992]: audit 2024-08-31T04:04:11.813376+0000 mgr.a (mgr.14388) 4885 : audit [DBG] from='client.115515 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:15.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:15 smithi163 bash[24253]: cluster 2024-08-31T04:04:13.365087+0000 mgr.a (mgr.14388) 4886 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:15 smithi027 bash[22610]: cluster 2024-08-31T04:04:13.365087+0000 mgr.a (mgr.14388) 4886 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:15 smithi191 bash[24992]: cluster 2024-08-31T04:04:13.365087+0000 mgr.a (mgr.14388) 4886 : cluster [DBG] pgmap v3386: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:17.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:04:17.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:04:17.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:17.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:17 smithi163 bash[24253]: cluster 2024-08-31T04:04:15.365874+0000 mgr.a (mgr.14388) 4887 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:17 smithi027 bash[22610]: cluster 2024-08-31T04:04:15.365874+0000 mgr.a (mgr.14388) 4887 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:17 smithi191 bash[24992]: cluster 2024-08-31T04:04:15.365874+0000 mgr.a (mgr.14388) 4887 : cluster [DBG] pgmap v3387: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:18.016 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:18.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:18.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:18.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:18.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:19.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:19 smithi163 bash[24253]: cluster 2024-08-31T04:04:17.366347+0000 mgr.a (mgr.14388) 4888 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:19.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:19 smithi163 bash[24253]: audit 2024-08-31T04:04:17.582958+0000 mgr.a (mgr.14388) 4889 : audit [DBG] from='client.115590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:19 smithi027 bash[22610]: cluster 2024-08-31T04:04:17.366347+0000 mgr.a (mgr.14388) 4888 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:19 smithi027 bash[22610]: audit 2024-08-31T04:04:17.582958+0000 mgr.a (mgr.14388) 4889 : audit [DBG] from='client.115590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:19 smithi191 bash[24992]: cluster 2024-08-31T04:04:17.366347+0000 mgr.a (mgr.14388) 4888 : cluster [DBG] pgmap v3388: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:19 smithi191 bash[24992]: audit 2024-08-31T04:04:17.582958+0000 mgr.a (mgr.14388) 4889 : audit [DBG] from='client.115590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:21.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:21 smithi163 bash[24253]: cluster 2024-08-31T04:04:19.369088+0000 mgr.a (mgr.14388) 4890 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:04:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:21 smithi027 bash[22610]: cluster 2024-08-31T04:04:19.369088+0000 mgr.a (mgr.14388) 4890 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:04:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:21 smithi191 bash[24992]: cluster 2024-08-31T04:04:19.369088+0000 mgr.a (mgr.14388) 4890 : cluster [DBG] pgmap v3389: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:04:23.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:04:23.018 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:04:23.018 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:23.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:23 smithi163 bash[24253]: cluster 2024-08-31T04:04:21.369907+0000 mgr.a (mgr.14388) 4891 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:04:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:23 smithi027 bash[22610]: cluster 2024-08-31T04:04:21.369907+0000 mgr.a (mgr.14388) 4891 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:04:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:23 smithi191 bash[24992]: cluster 2024-08-31T04:04:21.369907+0000 mgr.a (mgr.14388) 4891 : cluster [DBG] pgmap v3390: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:04:23.795 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:23.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:23.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:23.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:23.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:25.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:25 smithi163 bash[24253]: audit 2024-08-31T04:04:23.356000+0000 mgr.a (mgr.14388) 4892 : audit [DBG] from='client.115662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:25.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:25 smithi163 bash[24253]: cluster 2024-08-31T04:04:23.372871+0000 mgr.a (mgr.14388) 4893 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:25 smithi027 bash[22610]: audit 2024-08-31T04:04:23.356000+0000 mgr.a (mgr.14388) 4892 : audit [DBG] from='client.115662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:25 smithi027 bash[22610]: cluster 2024-08-31T04:04:23.372871+0000 mgr.a (mgr.14388) 4893 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:25 smithi191 bash[24992]: audit 2024-08-31T04:04:23.356000+0000 mgr.a (mgr.14388) 4892 : audit [DBG] from='client.115662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:25 smithi191 bash[24992]: cluster 2024-08-31T04:04:23.372871+0000 mgr.a (mgr.14388) 4893 : cluster [DBG] pgmap v3391: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:26.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:26 smithi163 bash[24253]: audit 2024-08-31T04:04:25.123764+0000 mon.a (mon.0) 1318 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:04:26.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:26 smithi163 bash[24253]: audit 2024-08-31T04:04:25.967399+0000 mon.a (mon.0) 1319 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:04:26.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:26 smithi163 bash[24253]: audit 2024-08-31T04:04:25.969112+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:04:26.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:26 smithi163 bash[24253]: audit 2024-08-31T04:04:25.979976+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:04:26.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:26 smithi163 bash[24253]: audit 2024-08-31T04:04:25.983313+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:04:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:26 smithi027 bash[22610]: audit 2024-08-31T04:04:25.123764+0000 mon.a (mon.0) 1318 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:04:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:26 smithi027 bash[22610]: audit 2024-08-31T04:04:25.967399+0000 mon.a (mon.0) 1319 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:04:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:26 smithi027 bash[22610]: audit 2024-08-31T04:04:25.969112+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:04:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:26 smithi027 bash[22610]: audit 2024-08-31T04:04:25.979976+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:04:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:26 smithi027 bash[22610]: audit 2024-08-31T04:04:25.983313+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:04:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:26 smithi191 bash[24992]: audit 2024-08-31T04:04:25.123764+0000 mon.a (mon.0) 1318 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:04:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:26 smithi191 bash[24992]: audit 2024-08-31T04:04:25.967399+0000 mon.a (mon.0) 1319 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:04:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:26 smithi191 bash[24992]: audit 2024-08-31T04:04:25.969112+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:04:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:26 smithi191 bash[24992]: audit 2024-08-31T04:04:25.979976+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:04:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:26 smithi191 bash[24992]: audit 2024-08-31T04:04:25.983313+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:04:26.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:04:26 smithi027 bash[22863]: debug 2024-08-31T04:04:26.716+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:04:26.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:04:26 smithi027 bash[22863]: debug 2024-08-31T04:04:26.716+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:04:27.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:27 smithi163 bash[24253]: cluster 2024-08-31T04:04:25.373795+0000 mgr.a (mgr.14388) 4894 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:04:27.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:27 smithi163 bash[24253]: audit 2024-08-31T04:04:25.984898+0000 mgr.a (mgr.14388) 4895 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:04:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:27 smithi027 bash[22610]: cluster 2024-08-31T04:04:25.373795+0000 mgr.a (mgr.14388) 4894 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:04:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:27 smithi027 bash[22610]: audit 2024-08-31T04:04:25.984898+0000 mgr.a (mgr.14388) 4895 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:04:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:27 smithi191 bash[24992]: cluster 2024-08-31T04:04:25.373795+0000 mgr.a (mgr.14388) 4894 : cluster [DBG] pgmap v3392: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:04:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:27 smithi191 bash[24992]: audit 2024-08-31T04:04:25.984898+0000 mgr.a (mgr.14388) 4895 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:04:28.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:28 smithi163 bash[24253]: audit 2024-08-31T04:04:26.720968+0000 mgr.a (mgr.14388) 4896 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:04:28.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:28 smithi163 bash[24253]: cephadm 2024-08-31T04:04:26.722249+0000 mgr.a (mgr.14388) 4897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:04:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:28 smithi027 bash[22610]: audit 2024-08-31T04:04:26.720968+0000 mgr.a (mgr.14388) 4896 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:04:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:28 smithi027 bash[22610]: cephadm 2024-08-31T04:04:26.722249+0000 mgr.a (mgr.14388) 4897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:04:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:28 smithi191 bash[24992]: audit 2024-08-31T04:04:26.720968+0000 mgr.a (mgr.14388) 4896 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:04:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:28 smithi191 bash[24992]: cephadm 2024-08-31T04:04:26.722249+0000 mgr.a (mgr.14388) 4897 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:04:28.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:04:28.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:04:28.798 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:29.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:29 smithi163 bash[24253]: cluster 2024-08-31T04:04:27.374754+0000 mgr.a (mgr.14388) 4898 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:04:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:29 smithi027 bash[22610]: cluster 2024-08-31T04:04:27.374754+0000 mgr.a (mgr.14388) 4898 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:04:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:29 smithi191 bash[24992]: cluster 2024-08-31T04:04:27.374754+0000 mgr.a (mgr.14388) 4898 : cluster [DBG] pgmap v3393: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:04:29.552 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:29.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:29.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:29.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:29.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:30.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:30 smithi163 bash[24253]: audit 2024-08-31T04:04:29.131895+0000 mgr.a (mgr.14388) 4899 : audit [DBG] from='client.115842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:30 smithi027 bash[22610]: audit 2024-08-31T04:04:29.131895+0000 mgr.a (mgr.14388) 4899 : audit [DBG] from='client.115842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:30 smithi191 bash[24992]: audit 2024-08-31T04:04:29.131895+0000 mgr.a (mgr.14388) 4899 : audit [DBG] from='client.115842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:31.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:31 smithi163 bash[24253]: cluster 2024-08-31T04:04:29.376399+0000 mgr.a (mgr.14388) 4900 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:31 smithi027 bash[22610]: cluster 2024-08-31T04:04:29.376399+0000 mgr.a (mgr.14388) 4900 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:31 smithi191 bash[24992]: cluster 2024-08-31T04:04:29.376399+0000 mgr.a (mgr.14388) 4900 : cluster [DBG] pgmap v3394: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:33.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:33 smithi163 bash[24253]: cluster 2024-08-31T04:04:31.377285+0000 mgr.a (mgr.14388) 4901 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:04:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:33 smithi027 bash[22610]: cluster 2024-08-31T04:04:31.377285+0000 mgr.a (mgr.14388) 4901 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:04:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:33 smithi191 bash[24992]: cluster 2024-08-31T04:04:31.377285+0000 mgr.a (mgr.14388) 4901 : cluster [DBG] pgmap v3395: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:04:34.554 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:04:34.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:04:34.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:35.324 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:35.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:35.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:35.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:35.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:35.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:35 smithi163 bash[24253]: cluster 2024-08-31T04:04:33.379484+0000 mgr.a (mgr.14388) 4902 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:35 smithi027 bash[22610]: cluster 2024-08-31T04:04:33.379484+0000 mgr.a (mgr.14388) 4902 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:35 smithi191 bash[24992]: cluster 2024-08-31T04:04:33.379484+0000 mgr.a (mgr.14388) 4902 : cluster [DBG] pgmap v3396: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:36.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:36 smithi163 bash[24253]: audit 2024-08-31T04:04:34.890924+0000 mgr.a (mgr.14388) 4903 : audit [DBG] from='client.115920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:36 smithi027 bash[22610]: audit 2024-08-31T04:04:34.890924+0000 mgr.a (mgr.14388) 4903 : audit [DBG] from='client.115920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:36 smithi191 bash[24992]: audit 2024-08-31T04:04:34.890924+0000 mgr.a (mgr.14388) 4903 : audit [DBG] from='client.115920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:37.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:37 smithi163 bash[24253]: cluster 2024-08-31T04:04:35.380539+0000 mgr.a (mgr.14388) 4904 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:37 smithi027 bash[22610]: cluster 2024-08-31T04:04:35.380539+0000 mgr.a (mgr.14388) 4904 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:37 smithi191 bash[24992]: cluster 2024-08-31T04:04:35.380539+0000 mgr.a (mgr.14388) 4904 : cluster [DBG] pgmap v3397: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:39.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:39 smithi163 bash[24253]: cluster 2024-08-31T04:04:37.381484+0000 mgr.a (mgr.14388) 4905 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:39 smithi027 bash[22610]: cluster 2024-08-31T04:04:37.381484+0000 mgr.a (mgr.14388) 4905 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:39 smithi191 bash[24992]: cluster 2024-08-31T04:04:37.381484+0000 mgr.a (mgr.14388) 4905 : cluster [DBG] pgmap v3398: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:40.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:04:40.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:04:40.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:41.068 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:41.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:41.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:41.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:41.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:41.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:41 smithi163 bash[24253]: cluster 2024-08-31T04:04:39.383865+0000 mgr.a (mgr.14388) 4906 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:41 smithi027 bash[22610]: cluster 2024-08-31T04:04:39.383865+0000 mgr.a (mgr.14388) 4906 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:41 smithi191 bash[24992]: cluster 2024-08-31T04:04:39.383865+0000 mgr.a (mgr.14388) 4906 : cluster [DBG] pgmap v3399: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:04:42.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:42 smithi163 bash[24253]: audit 2024-08-31T04:04:40.653041+0000 mgr.a (mgr.14388) 4907 : audit [DBG] from='client.115992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:42 smithi027 bash[22610]: audit 2024-08-31T04:04:40.653041+0000 mgr.a (mgr.14388) 4907 : audit [DBG] from='client.115992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:42 smithi191 bash[24992]: audit 2024-08-31T04:04:40.653041+0000 mgr.a (mgr.14388) 4907 : audit [DBG] from='client.115992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:43.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:43 smithi163 bash[24253]: cluster 2024-08-31T04:04:41.384775+0000 mgr.a (mgr.14388) 4908 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:43 smithi027 bash[22610]: cluster 2024-08-31T04:04:41.384775+0000 mgr.a (mgr.14388) 4908 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:43 smithi191 bash[24992]: cluster 2024-08-31T04:04:41.384775+0000 mgr.a (mgr.14388) 4908 : cluster [DBG] pgmap v3400: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:45.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:45 smithi163 bash[24253]: cluster 2024-08-31T04:04:43.387015+0000 mgr.a (mgr.14388) 4909 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:45 smithi027 bash[22610]: cluster 2024-08-31T04:04:43.387015+0000 mgr.a (mgr.14388) 4909 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:45 smithi191 bash[24992]: cluster 2024-08-31T04:04:43.387015+0000 mgr.a (mgr.14388) 4909 : cluster [DBG] pgmap v3401: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:46.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:04:46.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:04:46.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:46.854 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:46.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:46.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:46.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:46.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:47.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:47 smithi163 bash[24253]: cluster 2024-08-31T04:04:45.387825+0000 mgr.a (mgr.14388) 4910 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:47 smithi027 bash[22610]: cluster 2024-08-31T04:04:45.387825+0000 mgr.a (mgr.14388) 4910 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:47 smithi191 bash[24992]: cluster 2024-08-31T04:04:45.387825+0000 mgr.a (mgr.14388) 4910 : cluster [DBG] pgmap v3402: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:48.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:48 smithi163 bash[24253]: audit 2024-08-31T04:04:46.410601+0000 mgr.a (mgr.14388) 4911 : audit [DBG] from='client.116070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:48 smithi027 bash[22610]: audit 2024-08-31T04:04:46.410601+0000 mgr.a (mgr.14388) 4911 : audit [DBG] from='client.116070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:48 smithi191 bash[24992]: audit 2024-08-31T04:04:46.410601+0000 mgr.a (mgr.14388) 4911 : audit [DBG] from='client.116070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:49.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:49 smithi163 bash[24253]: cluster 2024-08-31T04:04:47.388800+0000 mgr.a (mgr.14388) 4912 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:49 smithi027 bash[22610]: cluster 2024-08-31T04:04:47.388800+0000 mgr.a (mgr.14388) 4912 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:49 smithi191 bash[24992]: cluster 2024-08-31T04:04:47.388800+0000 mgr.a (mgr.14388) 4912 : cluster [DBG] pgmap v3403: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:51.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:51 smithi163 bash[24253]: cluster 2024-08-31T04:04:49.391047+0000 mgr.a (mgr.14388) 4913 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:51 smithi027 bash[22610]: cluster 2024-08-31T04:04:49.391047+0000 mgr.a (mgr.14388) 4913 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:51 smithi191 bash[24992]: cluster 2024-08-31T04:04:49.391047+0000 mgr.a (mgr.14388) 4913 : cluster [DBG] pgmap v3404: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:51.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:04:51.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:04:51.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:52.607 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:52.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:52.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:52.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:52.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:53.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:53 smithi163 bash[24253]: cluster 2024-08-31T04:04:51.391765+0000 mgr.a (mgr.14388) 4914 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:53.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:53 smithi163 bash[24253]: audit 2024-08-31T04:04:52.187988+0000 mgr.a (mgr.14388) 4915 : audit [DBG] from='client.116148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:53 smithi027 bash[22610]: cluster 2024-08-31T04:04:51.391765+0000 mgr.a (mgr.14388) 4914 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:53 smithi027 bash[22610]: audit 2024-08-31T04:04:52.187988+0000 mgr.a (mgr.14388) 4915 : audit [DBG] from='client.116148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:53 smithi191 bash[24992]: cluster 2024-08-31T04:04:51.391765+0000 mgr.a (mgr.14388) 4914 : cluster [DBG] pgmap v3405: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:53 smithi191 bash[24992]: audit 2024-08-31T04:04:52.187988+0000 mgr.a (mgr.14388) 4915 : audit [DBG] from='client.116148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:55 smithi027 bash[22610]: cluster 2024-08-31T04:04:53.394087+0000 mgr.a (mgr.14388) 4916 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:55 smithi191 bash[24992]: cluster 2024-08-31T04:04:53.394087+0000 mgr.a (mgr.14388) 4916 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:55.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:55 smithi163 bash[24253]: cluster 2024-08-31T04:04:53.394087+0000 mgr.a (mgr.14388) 4916 : cluster [DBG] pgmap v3406: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:04:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:57 smithi027 bash[22610]: cluster 2024-08-31T04:04:55.394921+0000 mgr.a (mgr.14388) 4917 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:57 smithi191 bash[24992]: cluster 2024-08-31T04:04:55.394921+0000 mgr.a (mgr.14388) 4917 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:57.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:04:57.609 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:04:57.609 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:04:57.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:57 smithi163 bash[24253]: cluster 2024-08-31T04:04:55.394921+0000 mgr.a (mgr.14388) 4917 : cluster [DBG] pgmap v3407: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:58.353 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:04:58.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:04:58.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:04:58.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:04:58.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:04:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:59 smithi027 bash[22610]: cluster 2024-08-31T04:04:57.395653+0000 mgr.a (mgr.14388) 4918 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:04:59 smithi027 bash[22610]: audit 2024-08-31T04:04:57.939299+0000 mgr.a (mgr.14388) 4919 : audit [DBG] from='client.116226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:59 smithi191 bash[24992]: cluster 2024-08-31T04:04:57.395653+0000 mgr.a (mgr.14388) 4918 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:04:59 smithi191 bash[24992]: audit 2024-08-31T04:04:57.939299+0000 mgr.a (mgr.14388) 4919 : audit [DBG] from='client.116226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:04:59.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:59 smithi163 bash[24253]: cluster 2024-08-31T04:04:57.395653+0000 mgr.a (mgr.14388) 4918 : cluster [DBG] pgmap v3408: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:04:59.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:04:59 smithi163 bash[24253]: audit 2024-08-31T04:04:57.939299+0000 mgr.a (mgr.14388) 4919 : audit [DBG] from='client.116226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:01 smithi027 bash[22610]: cluster 2024-08-31T04:04:59.398249+0000 mgr.a (mgr.14388) 4920 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:01 smithi191 bash[24992]: cluster 2024-08-31T04:04:59.398249+0000 mgr.a (mgr.14388) 4920 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:01.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:01 smithi163 bash[24253]: cluster 2024-08-31T04:04:59.398249+0000 mgr.a (mgr.14388) 4920 : cluster [DBG] pgmap v3409: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:03.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:05:03.356 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:05:03.356 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:05:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:03 smithi027 bash[22610]: cluster 2024-08-31T04:05:01.399061+0000 mgr.a (mgr.14388) 4921 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:05:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:03 smithi191 bash[24992]: cluster 2024-08-31T04:05:01.399061+0000 mgr.a (mgr.14388) 4921 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:05:03.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:03 smithi163 bash[24253]: cluster 2024-08-31T04:05:01.399061+0000 mgr.a (mgr.14388) 4921 : cluster [DBG] pgmap v3410: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:05:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:05:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:05:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:05:04.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:05:04.089 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:05:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:05 smithi027 bash[22610]: cluster 2024-08-31T04:05:03.401080+0000 mgr.a (mgr.14388) 4922 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:05 smithi027 bash[22610]: audit 2024-08-31T04:05:03.679047+0000 mgr.a (mgr.14388) 4923 : audit [DBG] from='client.116304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:05 smithi191 bash[24992]: cluster 2024-08-31T04:05:03.401080+0000 mgr.a (mgr.14388) 4922 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:05 smithi191 bash[24992]: audit 2024-08-31T04:05:03.679047+0000 mgr.a (mgr.14388) 4923 : audit [DBG] from='client.116304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:05.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:05 smithi163 bash[24253]: cluster 2024-08-31T04:05:03.401080+0000 mgr.a (mgr.14388) 4922 : cluster [DBG] pgmap v3411: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:05.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:05 smithi163 bash[24253]: audit 2024-08-31T04:05:03.679047+0000 mgr.a (mgr.14388) 4923 : audit [DBG] from='client.116304 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:07 smithi027 bash[22610]: cluster 2024-08-31T04:05:05.401967+0000 mgr.a (mgr.14388) 4924 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:05:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:07 smithi191 bash[24992]: cluster 2024-08-31T04:05:05.401967+0000 mgr.a (mgr.14388) 4924 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:05:07.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:07 smithi163 bash[24253]: cluster 2024-08-31T04:05:05.401967+0000 mgr.a (mgr.14388) 4924 : cluster [DBG] pgmap v3412: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:05:09.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:05:09.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:05:09.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:05:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:09 smithi027 bash[22610]: cluster 2024-08-31T04:05:07.402768+0000 mgr.a (mgr.14388) 4925 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:05:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:09 smithi191 bash[24992]: cluster 2024-08-31T04:05:07.402768+0000 mgr.a (mgr.14388) 4925 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:05:09.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:09 smithi163 bash[24253]: cluster 2024-08-31T04:05:07.402768+0000 mgr.a (mgr.14388) 4925 : cluster [DBG] pgmap v3413: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:05:09.845 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:05:09.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:05:09.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:05:09.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:05:09.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:05:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:11 smithi027 bash[22610]: cluster 2024-08-31T04:05:09.404846+0000 mgr.a (mgr.14388) 4926 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:11 smithi027 bash[22610]: audit 2024-08-31T04:05:09.425032+0000 mgr.a (mgr.14388) 4927 : audit [DBG] from='client.116376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:11 smithi191 bash[24992]: cluster 2024-08-31T04:05:09.404846+0000 mgr.a (mgr.14388) 4926 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:11 smithi191 bash[24992]: audit 2024-08-31T04:05:09.425032+0000 mgr.a (mgr.14388) 4927 : audit [DBG] from='client.116376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:11.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:11 smithi163 bash[24253]: cluster 2024-08-31T04:05:09.404846+0000 mgr.a (mgr.14388) 4926 : cluster [DBG] pgmap v3414: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:11.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:11 smithi163 bash[24253]: audit 2024-08-31T04:05:09.425032+0000 mgr.a (mgr.14388) 4927 : audit [DBG] from='client.116376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:13 smithi027 bash[22610]: cluster 2024-08-31T04:05:11.405744+0000 mgr.a (mgr.14388) 4928 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:13 smithi191 bash[24992]: cluster 2024-08-31T04:05:11.405744+0000 mgr.a (mgr.14388) 4928 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:13.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:13 smithi163 bash[24253]: cluster 2024-08-31T04:05:11.405744+0000 mgr.a (mgr.14388) 4928 : cluster [DBG] pgmap v3415: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:14.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:05:14.847 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:05:14.847 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:05:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:15 smithi191 bash[24992]: cluster 2024-08-31T04:05:13.407960+0000 mgr.a (mgr.14388) 4929 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:15.619 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:05:15.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:05:15.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:05:15.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:05:15.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:05:15.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:15 smithi163 bash[24253]: cluster 2024-08-31T04:05:13.407960+0000 mgr.a (mgr.14388) 4929 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:15 smithi027 bash[22610]: cluster 2024-08-31T04:05:13.407960+0000 mgr.a (mgr.14388) 4929 : cluster [DBG] pgmap v3416: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:16 smithi191 bash[24992]: audit 2024-08-31T04:05:15.183784+0000 mgr.a (mgr.14388) 4930 : audit [DBG] from='client.116451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:16.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:16 smithi163 bash[24253]: audit 2024-08-31T04:05:15.183784+0000 mgr.a (mgr.14388) 4930 : audit [DBG] from='client.116451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:16 smithi027 bash[22610]: audit 2024-08-31T04:05:15.183784+0000 mgr.a (mgr.14388) 4930 : audit [DBG] from='client.116451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:17 smithi191 bash[24992]: cluster 2024-08-31T04:05:15.408514+0000 mgr.a (mgr.14388) 4931 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:17.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:17 smithi163 bash[24253]: cluster 2024-08-31T04:05:15.408514+0000 mgr.a (mgr.14388) 4931 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:17 smithi027 bash[22610]: cluster 2024-08-31T04:05:15.408514+0000 mgr.a (mgr.14388) 4931 : cluster [DBG] pgmap v3417: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:19 smithi191 bash[24992]: cluster 2024-08-31T04:05:17.409364+0000 mgr.a (mgr.14388) 4932 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:19.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:19 smithi163 bash[24253]: cluster 2024-08-31T04:05:17.409364+0000 mgr.a (mgr.14388) 4932 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:19 smithi027 bash[22610]: cluster 2024-08-31T04:05:17.409364+0000 mgr.a (mgr.14388) 4932 : cluster [DBG] pgmap v3418: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:20.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:05:20.621 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:05:20.621 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:05:21.357 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:05:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:05:21.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:05:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:05:21.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:05:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:21 smithi191 bash[24992]: cluster 2024-08-31T04:05:19.411570+0000 mgr.a (mgr.14388) 4933 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:21.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:21 smithi163 bash[24253]: cluster 2024-08-31T04:05:19.411570+0000 mgr.a (mgr.14388) 4933 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:21 smithi027 bash[22610]: cluster 2024-08-31T04:05:19.411570+0000 mgr.a (mgr.14388) 4933 : cluster [DBG] pgmap v3419: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:22 smithi191 bash[24992]: audit 2024-08-31T04:05:20.948728+0000 mgr.a (mgr.14388) 4934 : audit [DBG] from='client.116529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:22 smithi191 bash[24992]: cluster 2024-08-31T04:05:21.412233+0000 mgr.a (mgr.14388) 4935 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:22 smithi163 bash[24253]: audit 2024-08-31T04:05:20.948728+0000 mgr.a (mgr.14388) 4934 : audit [DBG] from='client.116529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:22 smithi163 bash[24253]: cluster 2024-08-31T04:05:21.412233+0000 mgr.a (mgr.14388) 4935 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:22 smithi027 bash[22610]: audit 2024-08-31T04:05:20.948728+0000 mgr.a (mgr.14388) 4934 : audit [DBG] from='client.116529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:22 smithi027 bash[22610]: cluster 2024-08-31T04:05:21.412233+0000 mgr.a (mgr.14388) 4935 : cluster [DBG] pgmap v3420: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:24 smithi027 bash[22610]: cluster 2024-08-31T04:05:23.414324+0000 mgr.a (mgr.14388) 4936 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:24 smithi191 bash[24992]: cluster 2024-08-31T04:05:23.414324+0000 mgr.a (mgr.14388) 4936 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:24.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:24 smithi163 bash[24253]: cluster 2024-08-31T04:05:23.414324+0000 mgr.a (mgr.14388) 4936 : cluster [DBG] pgmap v3421: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:26.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:05:26.359 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:05:26.360 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:05:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:26 smithi027 bash[22610]: cluster 2024-08-31T04:05:25.415102+0000 mgr.a (mgr.14388) 4937 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:26 smithi191 bash[24992]: cluster 2024-08-31T04:05:25.415102+0000 mgr.a (mgr.14388) 4937 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:26.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:26 smithi163 bash[24253]: cluster 2024-08-31T04:05:25.415102+0000 mgr.a (mgr.14388) 4937 : cluster [DBG] pgmap v3422: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:27.109 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:05:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:05:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:05:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:05:27.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:05:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:27 smithi027 bash[22610]: audit 2024-08-31T04:05:26.692812+0000 mgr.a (mgr.14388) 4938 : audit [DBG] from='client.116607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:27 smithi027 bash[22610]: audit 2024-08-31T04:05:26.780833+0000 mon.a (mon.0) 1323 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:05:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:27 smithi191 bash[24992]: audit 2024-08-31T04:05:26.692812+0000 mgr.a (mgr.14388) 4938 : audit [DBG] from='client.116607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:27 smithi191 bash[24992]: audit 2024-08-31T04:05:26.780833+0000 mon.a (mon.0) 1323 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:05:27.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:27 smithi163 bash[24253]: audit 2024-08-31T04:05:26.692812+0000 mgr.a (mgr.14388) 4938 : audit [DBG] from='client.116607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:27.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:27 smithi163 bash[24253]: audit 2024-08-31T04:05:26.780833+0000 mon.a (mon.0) 1323 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:05:28.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:05:28 smithi027 bash[22863]: debug 2024-08-31T04:05:28.318+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:05:28.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:05:28 smithi027 bash[22863]: debug 2024-08-31T04:05:28.318+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:05:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:28 smithi027 bash[22610]: cluster 2024-08-31T04:05:27.415590+0000 mgr.a (mgr.14388) 4939 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:28 smithi027 bash[22610]: audit 2024-08-31T04:05:27.584045+0000 mon.a (mon.0) 1324 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:05:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:28 smithi027 bash[22610]: audit 2024-08-31T04:05:27.585921+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:05:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:28 smithi027 bash[22610]: audit 2024-08-31T04:05:27.597539+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:05:28.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:28 smithi027 bash[22610]: audit 2024-08-31T04:05:27.600462+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:05:28.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:28 smithi027 bash[22610]: audit 2024-08-31T04:05:27.603121+0000 mgr.a (mgr.14388) 4940 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:05:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:28 smithi191 bash[24992]: cluster 2024-08-31T04:05:27.415590+0000 mgr.a (mgr.14388) 4939 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:28 smithi191 bash[24992]: audit 2024-08-31T04:05:27.584045+0000 mon.a (mon.0) 1324 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:05:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:28 smithi191 bash[24992]: audit 2024-08-31T04:05:27.585921+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:05:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:28 smithi191 bash[24992]: audit 2024-08-31T04:05:27.597539+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:05:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:28 smithi191 bash[24992]: audit 2024-08-31T04:05:27.600462+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:05:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:28 smithi191 bash[24992]: audit 2024-08-31T04:05:27.603121+0000 mgr.a (mgr.14388) 4940 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:05:28.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:28 smithi163 bash[24253]: cluster 2024-08-31T04:05:27.415590+0000 mgr.a (mgr.14388) 4939 : cluster [DBG] pgmap v3423: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:28.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:28 smithi163 bash[24253]: audit 2024-08-31T04:05:27.584045+0000 mon.a (mon.0) 1324 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:05:28.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:28 smithi163 bash[24253]: audit 2024-08-31T04:05:27.585921+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:05:28.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:28 smithi163 bash[24253]: audit 2024-08-31T04:05:27.597539+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:05:28.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:28 smithi163 bash[24253]: audit 2024-08-31T04:05:27.600462+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:05:28.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:28 smithi163 bash[24253]: audit 2024-08-31T04:05:27.603121+0000 mgr.a (mgr.14388) 4940 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:05:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:29 smithi191 bash[24992]: audit 2024-08-31T04:05:28.319859+0000 mgr.a (mgr.14388) 4941 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:05:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:29 smithi191 bash[24992]: cephadm 2024-08-31T04:05:28.321757+0000 mgr.a (mgr.14388) 4942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:05:29.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:29 smithi163 bash[24253]: audit 2024-08-31T04:05:28.319859+0000 mgr.a (mgr.14388) 4941 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:05:29.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:29 smithi163 bash[24253]: cephadm 2024-08-31T04:05:28.321757+0000 mgr.a (mgr.14388) 4942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:05:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:29 smithi027 bash[22610]: audit 2024-08-31T04:05:28.319859+0000 mgr.a (mgr.14388) 4941 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:05:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:29 smithi027 bash[22610]: cephadm 2024-08-31T04:05:28.321757+0000 mgr.a (mgr.14388) 4942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:05:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:30 smithi191 bash[24992]: cluster 2024-08-31T04:05:29.418125+0000 mgr.a (mgr.14388) 4943 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-08-31T04:05:30.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:30 smithi163 bash[24253]: cluster 2024-08-31T04:05:29.418125+0000 mgr.a (mgr.14388) 4943 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-08-31T04:05:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:30 smithi027 bash[22610]: cluster 2024-08-31T04:05:29.418125+0000 mgr.a (mgr.14388) 4943 : cluster [DBG] pgmap v3424: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-08-31T04:05:32.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:05:32.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:05:32.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:05:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:32 smithi191 bash[24992]: cluster 2024-08-31T04:05:31.418916+0000 mgr.a (mgr.14388) 4944 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:05:32.879 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:05:32.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:05:32.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:05:32.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:05:32.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:05:32.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:32 smithi163 bash[24253]: cluster 2024-08-31T04:05:31.418916+0000 mgr.a (mgr.14388) 4944 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:05:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:32 smithi027 bash[22610]: cluster 2024-08-31T04:05:31.418916+0000 mgr.a (mgr.14388) 4944 : cluster [DBG] pgmap v3425: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:05:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:33 smithi191 bash[24992]: audit 2024-08-31T04:05:32.446193+0000 mgr.a (mgr.14388) 4945 : audit [DBG] from='client.116793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:33.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:33 smithi163 bash[24253]: audit 2024-08-31T04:05:32.446193+0000 mgr.a (mgr.14388) 4945 : audit [DBG] from='client.116793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:33 smithi027 bash[22610]: audit 2024-08-31T04:05:32.446193+0000 mgr.a (mgr.14388) 4945 : audit [DBG] from='client.116793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:34 smithi191 bash[24992]: cluster 2024-08-31T04:05:33.421166+0000 mgr.a (mgr.14388) 4946 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:34.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:34 smithi163 bash[24253]: cluster 2024-08-31T04:05:33.421166+0000 mgr.a (mgr.14388) 4946 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:34 smithi027 bash[22610]: cluster 2024-08-31T04:05:33.421166+0000 mgr.a (mgr.14388) 4946 : cluster [DBG] pgmap v3426: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:36 smithi191 bash[24992]: cluster 2024-08-31T04:05:35.421918+0000 mgr.a (mgr.14388) 4947 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:36.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:36 smithi163 bash[24253]: cluster 2024-08-31T04:05:35.421918+0000 mgr.a (mgr.14388) 4947 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:36 smithi027 bash[22610]: cluster 2024-08-31T04:05:35.421918+0000 mgr.a (mgr.14388) 4947 : cluster [DBG] pgmap v3427: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:37.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:05:37.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:05:37.882 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:05:38.645 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:05:38.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:05:38.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:05:38.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:05:38.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:05:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:38 smithi191 bash[24992]: cluster 2024-08-31T04:05:37.422686+0000 mgr.a (mgr.14388) 4948 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:38 smithi191 bash[24992]: audit 2024-08-31T04:05:38.218529+0000 mgr.a (mgr.14388) 4949 : audit [DBG] from='client.116871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:38.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:38 smithi163 bash[24253]: cluster 2024-08-31T04:05:37.422686+0000 mgr.a (mgr.14388) 4948 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:38.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:38 smithi163 bash[24253]: audit 2024-08-31T04:05:38.218529+0000 mgr.a (mgr.14388) 4949 : audit [DBG] from='client.116871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:38 smithi027 bash[22610]: cluster 2024-08-31T04:05:37.422686+0000 mgr.a (mgr.14388) 4948 : cluster [DBG] pgmap v3428: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:38 smithi027 bash[22610]: audit 2024-08-31T04:05:38.218529+0000 mgr.a (mgr.14388) 4949 : audit [DBG] from='client.116871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:40 smithi191 bash[24992]: cluster 2024-08-31T04:05:39.425438+0000 mgr.a (mgr.14388) 4950 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:40.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:40 smithi163 bash[24253]: cluster 2024-08-31T04:05:39.425438+0000 mgr.a (mgr.14388) 4950 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:40 smithi027 bash[22610]: cluster 2024-08-31T04:05:39.425438+0000 mgr.a (mgr.14388) 4950 : cluster [DBG] pgmap v3429: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:05:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:42 smithi191 bash[24992]: cluster 2024-08-31T04:05:41.426400+0000 mgr.a (mgr.14388) 4951 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:05:42.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:42 smithi163 bash[24253]: cluster 2024-08-31T04:05:41.426400+0000 mgr.a (mgr.14388) 4951 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:05:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:42 smithi027 bash[22610]: cluster 2024-08-31T04:05:41.426400+0000 mgr.a (mgr.14388) 4951 : cluster [DBG] pgmap v3430: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:05:43.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:05:43.647 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:05:43.647 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:05:44.434 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:05:44.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:05:44.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:05:44.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:05:44.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:05:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:44 smithi191 bash[24992]: cluster 2024-08-31T04:05:43.428471+0000 mgr.a (mgr.14388) 4952 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:05:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:44 smithi191 bash[24992]: audit 2024-08-31T04:05:43.989621+0000 mgr.a (mgr.14388) 4953 : audit [DBG] from='client.116949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:44.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:44 smithi163 bash[24253]: cluster 2024-08-31T04:05:43.428471+0000 mgr.a (mgr.14388) 4952 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:05:44.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:44 smithi163 bash[24253]: audit 2024-08-31T04:05:43.989621+0000 mgr.a (mgr.14388) 4953 : audit [DBG] from='client.116949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:44 smithi027 bash[22610]: cluster 2024-08-31T04:05:43.428471+0000 mgr.a (mgr.14388) 4952 : cluster [DBG] pgmap v3431: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:05:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:44 smithi027 bash[22610]: audit 2024-08-31T04:05:43.989621+0000 mgr.a (mgr.14388) 4953 : audit [DBG] from='client.116949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:46 smithi191 bash[24992]: cluster 2024-08-31T04:05:45.429399+0000 mgr.a (mgr.14388) 4954 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:05:46.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:46 smithi163 bash[24253]: cluster 2024-08-31T04:05:45.429399+0000 mgr.a (mgr.14388) 4954 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:05:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:46 smithi027 bash[22610]: cluster 2024-08-31T04:05:45.429399+0000 mgr.a (mgr.14388) 4954 : cluster [DBG] pgmap v3432: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:05:48.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:48 smithi163 bash[24253]: cluster 2024-08-31T04:05:47.430179+0000 mgr.a (mgr.14388) 4955 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:05:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:48 smithi027 bash[22610]: cluster 2024-08-31T04:05:47.430179+0000 mgr.a (mgr.14388) 4955 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:05:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:48 smithi191 bash[24992]: cluster 2024-08-31T04:05:47.430179+0000 mgr.a (mgr.14388) 4955 : cluster [DBG] pgmap v3433: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:05:49.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:05:49.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:05:49.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:05:50.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:05:50.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:05:50.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:05:50.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:05:50.199 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:05:50.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:50 smithi163 bash[24253]: cluster 2024-08-31T04:05:49.432366+0000 mgr.a (mgr.14388) 4956 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:50.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:50 smithi163 bash[24253]: audit 2024-08-31T04:05:49.770238+0000 mgr.a (mgr.14388) 4957 : audit [DBG] from='client.117027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:50 smithi027 bash[22610]: cluster 2024-08-31T04:05:49.432366+0000 mgr.a (mgr.14388) 4956 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:50 smithi027 bash[22610]: audit 2024-08-31T04:05:49.770238+0000 mgr.a (mgr.14388) 4957 : audit [DBG] from='client.117027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:50 smithi191 bash[24992]: cluster 2024-08-31T04:05:49.432366+0000 mgr.a (mgr.14388) 4956 : cluster [DBG] pgmap v3434: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:50 smithi191 bash[24992]: audit 2024-08-31T04:05:49.770238+0000 mgr.a (mgr.14388) 4957 : audit [DBG] from='client.117027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:52.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:52 smithi163 bash[24253]: cluster 2024-08-31T04:05:51.433229+0000 mgr.a (mgr.14388) 4958 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:52 smithi027 bash[22610]: cluster 2024-08-31T04:05:51.433229+0000 mgr.a (mgr.14388) 4958 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:52 smithi191 bash[24992]: cluster 2024-08-31T04:05:51.433229+0000 mgr.a (mgr.14388) 4958 : cluster [DBG] pgmap v3435: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:54.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:54 smithi163 bash[24253]: cluster 2024-08-31T04:05:53.435375+0000 mgr.a (mgr.14388) 4959 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:54 smithi027 bash[22610]: cluster 2024-08-31T04:05:53.435375+0000 mgr.a (mgr.14388) 4959 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:54 smithi191 bash[24992]: cluster 2024-08-31T04:05:53.435375+0000 mgr.a (mgr.14388) 4959 : cluster [DBG] pgmap v3436: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:05:55.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:05:55.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:05:55.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:05:55.939 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:05:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:05:56.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:56 smithi163 bash[24253]: cluster 2024-08-31T04:05:55.436105+0000 mgr.a (mgr.14388) 4960 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:56.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:56 smithi163 bash[24253]: audit 2024-08-31T04:05:55.531683+0000 mgr.a (mgr.14388) 4961 : audit [DBG] from='client.117105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:56 smithi027 bash[22610]: cluster 2024-08-31T04:05:55.436105+0000 mgr.a (mgr.14388) 4960 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:56 smithi027 bash[22610]: audit 2024-08-31T04:05:55.531683+0000 mgr.a (mgr.14388) 4961 : audit [DBG] from='client.117105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:56 smithi191 bash[24992]: cluster 2024-08-31T04:05:55.436105+0000 mgr.a (mgr.14388) 4960 : cluster [DBG] pgmap v3437: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:56 smithi191 bash[24992]: audit 2024-08-31T04:05:55.531683+0000 mgr.a (mgr.14388) 4961 : audit [DBG] from='client.117105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:05:58.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:05:58 smithi163 bash[24253]: cluster 2024-08-31T04:05:57.436961+0000 mgr.a (mgr.14388) 4962 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:05:58 smithi027 bash[22610]: cluster 2024-08-31T04:05:57.436961+0000 mgr.a (mgr.14388) 4962 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:05:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:05:58 smithi191 bash[24992]: cluster 2024-08-31T04:05:57.436961+0000 mgr.a (mgr.14388) 4962 : cluster [DBG] pgmap v3438: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:00.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:00 smithi163 bash[24253]: cluster 2024-08-31T04:05:59.439139+0000 mgr.a (mgr.14388) 4963 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:00 smithi027 bash[22610]: cluster 2024-08-31T04:05:59.439139+0000 mgr.a (mgr.14388) 4963 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:00 smithi191 bash[24992]: cluster 2024-08-31T04:05:59.439139+0000 mgr.a (mgr.14388) 4963 : cluster [DBG] pgmap v3439: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:01.721 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:01.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:01.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:01.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:01.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:02.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:02 smithi163 bash[24253]: audit 2024-08-31T04:06:01.282734+0000 mgr.a (mgr.14388) 4964 : audit [DBG] from='client.117183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:02.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:02 smithi163 bash[24253]: cluster 2024-08-31T04:06:01.439669+0000 mgr.a (mgr.14388) 4965 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:02 smithi027 bash[22610]: audit 2024-08-31T04:06:01.282734+0000 mgr.a (mgr.14388) 4964 : audit [DBG] from='client.117183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:02 smithi027 bash[22610]: cluster 2024-08-31T04:06:01.439669+0000 mgr.a (mgr.14388) 4965 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:02 smithi191 bash[24992]: audit 2024-08-31T04:06:01.282734+0000 mgr.a (mgr.14388) 4964 : audit [DBG] from='client.117183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:02 smithi191 bash[24992]: cluster 2024-08-31T04:06:01.439669+0000 mgr.a (mgr.14388) 4965 : cluster [DBG] pgmap v3440: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:04.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:04 smithi163 bash[24253]: cluster 2024-08-31T04:06:03.441883+0000 mgr.a (mgr.14388) 4966 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:04 smithi027 bash[22610]: cluster 2024-08-31T04:06:03.441883+0000 mgr.a (mgr.14388) 4966 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:04 smithi191 bash[24992]: cluster 2024-08-31T04:06:03.441883+0000 mgr.a (mgr.14388) 4966 : cluster [DBG] pgmap v3441: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:06.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:06.724 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:06.724 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:06.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:06 smithi163 bash[24253]: cluster 2024-08-31T04:06:05.442647+0000 mgr.a (mgr.14388) 4967 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:06 smithi027 bash[22610]: cluster 2024-08-31T04:06:05.442647+0000 mgr.a (mgr.14388) 4967 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:06 smithi191 bash[24992]: cluster 2024-08-31T04:06:05.442647+0000 mgr.a (mgr.14388) 4967 : cluster [DBG] pgmap v3442: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:07.486 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:07.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:07.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:07.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:07.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:07.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:07 smithi163 bash[24253]: audit 2024-08-31T04:06:07.058351+0000 mgr.a (mgr.14388) 4968 : audit [DBG] from='client.117255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:07 smithi027 bash[22610]: audit 2024-08-31T04:06:07.058351+0000 mgr.a (mgr.14388) 4968 : audit [DBG] from='client.117255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:07 smithi191 bash[24992]: audit 2024-08-31T04:06:07.058351+0000 mgr.a (mgr.14388) 4968 : audit [DBG] from='client.117255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:08.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:08 smithi163 bash[24253]: cluster 2024-08-31T04:06:07.443234+0000 mgr.a (mgr.14388) 4969 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:08 smithi027 bash[22610]: cluster 2024-08-31T04:06:07.443234+0000 mgr.a (mgr.14388) 4969 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:08 smithi191 bash[24992]: cluster 2024-08-31T04:06:07.443234+0000 mgr.a (mgr.14388) 4969 : cluster [DBG] pgmap v3443: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:10.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:10 smithi163 bash[24253]: cluster 2024-08-31T04:06:09.445519+0000 mgr.a (mgr.14388) 4970 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:10 smithi027 bash[22610]: cluster 2024-08-31T04:06:09.445519+0000 mgr.a (mgr.14388) 4970 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:10 smithi191 bash[24992]: cluster 2024-08-31T04:06:09.445519+0000 mgr.a (mgr.14388) 4970 : cluster [DBG] pgmap v3444: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:12.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:12.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:12.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:12.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:12 smithi163 bash[24253]: cluster 2024-08-31T04:06:11.446421+0000 mgr.a (mgr.14388) 4971 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:12 smithi027 bash[22610]: cluster 2024-08-31T04:06:11.446421+0000 mgr.a (mgr.14388) 4971 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:12 smithi191 bash[24992]: cluster 2024-08-31T04:06:11.446421+0000 mgr.a (mgr.14388) 4971 : cluster [DBG] pgmap v3445: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:13.277 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:13.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:13.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:13.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:13.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:13.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:13 smithi163 bash[24253]: audit 2024-08-31T04:06:12.827817+0000 mgr.a (mgr.14388) 4972 : audit [DBG] from='client.117330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:13 smithi027 bash[22610]: audit 2024-08-31T04:06:12.827817+0000 mgr.a (mgr.14388) 4972 : audit [DBG] from='client.117330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:13 smithi191 bash[24992]: audit 2024-08-31T04:06:12.827817+0000 mgr.a (mgr.14388) 4972 : audit [DBG] from='client.117330 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:14.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:14 smithi163 bash[24253]: cluster 2024-08-31T04:06:13.449075+0000 mgr.a (mgr.14388) 4973 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:14 smithi027 bash[22610]: cluster 2024-08-31T04:06:13.449075+0000 mgr.a (mgr.14388) 4973 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:14 smithi191 bash[24992]: cluster 2024-08-31T04:06:13.449075+0000 mgr.a (mgr.14388) 4973 : cluster [DBG] pgmap v3446: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:16.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:16 smithi163 bash[24253]: cluster 2024-08-31T04:06:15.449847+0000 mgr.a (mgr.14388) 4974 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:06:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:16 smithi027 bash[22610]: cluster 2024-08-31T04:06:15.449847+0000 mgr.a (mgr.14388) 4974 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:06:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:16 smithi191 bash[24992]: cluster 2024-08-31T04:06:15.449847+0000 mgr.a (mgr.14388) 4974 : cluster [DBG] pgmap v3447: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:06:18.279 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:18.280 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:18.280 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:18.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:18 smithi163 bash[24253]: cluster 2024-08-31T04:06:17.450765+0000 mgr.a (mgr.14388) 4975 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:06:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:18 smithi027 bash[22610]: cluster 2024-08-31T04:06:17.450765+0000 mgr.a (mgr.14388) 4975 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:06:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:18 smithi191 bash[24992]: cluster 2024-08-31T04:06:17.450765+0000 mgr.a (mgr.14388) 4975 : cluster [DBG] pgmap v3448: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:06:19.065 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:19.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:19.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:19.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:19.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:19.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:19 smithi163 bash[24253]: audit 2024-08-31T04:06:18.624647+0000 mgr.a (mgr.14388) 4976 : audit [DBG] from='client.117408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:19 smithi027 bash[22610]: audit 2024-08-31T04:06:18.624647+0000 mgr.a (mgr.14388) 4976 : audit [DBG] from='client.117408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:19 smithi191 bash[24992]: audit 2024-08-31T04:06:18.624647+0000 mgr.a (mgr.14388) 4976 : audit [DBG] from='client.117408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:20.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:20 smithi163 bash[24253]: cluster 2024-08-31T04:06:19.453438+0000 mgr.a (mgr.14388) 4977 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:20 smithi027 bash[22610]: cluster 2024-08-31T04:06:19.453438+0000 mgr.a (mgr.14388) 4977 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:20 smithi191 bash[24992]: cluster 2024-08-31T04:06:19.453438+0000 mgr.a (mgr.14388) 4977 : cluster [DBG] pgmap v3449: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:22.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:22 smithi163 bash[24253]: cluster 2024-08-31T04:06:21.454345+0000 mgr.a (mgr.14388) 4978 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:06:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:22 smithi027 bash[22610]: cluster 2024-08-31T04:06:21.454345+0000 mgr.a (mgr.14388) 4978 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:06:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:22 smithi191 bash[24992]: cluster 2024-08-31T04:06:21.454345+0000 mgr.a (mgr.14388) 4978 : cluster [DBG] pgmap v3450: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:06:24.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:24.068 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:24.068 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:24.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:24.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:24.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:24.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:24.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:24 smithi163 bash[24253]: cluster 2024-08-31T04:06:23.456316+0000 mgr.a (mgr.14388) 4979 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:24 smithi027 bash[22610]: cluster 2024-08-31T04:06:23.456316+0000 mgr.a (mgr.14388) 4979 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:24 smithi191 bash[24992]: cluster 2024-08-31T04:06:23.456316+0000 mgr.a (mgr.14388) 4979 : cluster [DBG] pgmap v3451: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:25.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:25 smithi163 bash[24253]: audit 2024-08-31T04:06:24.405597+0000 mgr.a (mgr.14388) 4980 : audit [DBG] from='client.117486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:25 smithi027 bash[22610]: audit 2024-08-31T04:06:24.405597+0000 mgr.a (mgr.14388) 4980 : audit [DBG] from='client.117486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:25 smithi191 bash[24992]: audit 2024-08-31T04:06:24.405597+0000 mgr.a (mgr.14388) 4980 : audit [DBG] from='client.117486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:26.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:26 smithi163 bash[24253]: cluster 2024-08-31T04:06:25.457323+0000 mgr.a (mgr.14388) 4981 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:26 smithi027 bash[22610]: cluster 2024-08-31T04:06:25.457323+0000 mgr.a (mgr.14388) 4981 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:26 smithi191 bash[24992]: cluster 2024-08-31T04:06:25.457323+0000 mgr.a (mgr.14388) 4981 : cluster [DBG] pgmap v3452: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:28.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:28 smithi163 bash[24253]: cluster 2024-08-31T04:06:27.458133+0000 mgr.a (mgr.14388) 4982 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:28.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:28 smithi163 bash[24253]: audit 2024-08-31T04:06:28.374283+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:06:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:28 smithi027 bash[22610]: cluster 2024-08-31T04:06:27.458133+0000 mgr.a (mgr.14388) 4982 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:28 smithi027 bash[22610]: audit 2024-08-31T04:06:28.374283+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:06:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:28 smithi191 bash[24992]: cluster 2024-08-31T04:06:27.458133+0000 mgr.a (mgr.14388) 4982 : cluster [DBG] pgmap v3453: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:28 smithi191 bash[24992]: audit 2024-08-31T04:06:28.374283+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:06:29.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:29.835 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:29.835 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:29.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:29 smithi163 bash[24253]: audit 2024-08-31T04:06:29.204309+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:06:29.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:29 smithi163 bash[24253]: audit 2024-08-31T04:06:29.206019+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:06:29.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:29 smithi163 bash[24253]: audit 2024-08-31T04:06:29.215105+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:06:29.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:29 smithi163 bash[24253]: audit 2024-08-31T04:06:29.220066+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:06:29.941 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:29 smithi163 bash[24253]: audit 2024-08-31T04:06:29.222403+0000 mgr.a (mgr.14388) 4983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:06:29.947 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:29 smithi027 bash[22610]: audit 2024-08-31T04:06:29.204309+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:06:29.947 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:29 smithi027 bash[22610]: audit 2024-08-31T04:06:29.206019+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:06:29.947 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:29 smithi027 bash[22610]: audit 2024-08-31T04:06:29.215105+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:06:29.947 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:29 smithi027 bash[22610]: audit 2024-08-31T04:06:29.220066+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:06:29.947 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:29 smithi027 bash[22610]: audit 2024-08-31T04:06:29.222403+0000 mgr.a (mgr.14388) 4983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:06:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:29 smithi191 bash[24992]: audit 2024-08-31T04:06:29.204309+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:06:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:29 smithi191 bash[24992]: audit 2024-08-31T04:06:29.206019+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:06:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:29 smithi191 bash[24992]: audit 2024-08-31T04:06:29.215105+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:06:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:29 smithi191 bash[24992]: audit 2024-08-31T04:06:29.220066+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:06:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:29 smithi191 bash[24992]: audit 2024-08-31T04:06:29.222403+0000 mgr.a (mgr.14388) 4983 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:06:30.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:06:29 smithi027 bash[22863]: debug 2024-08-31T04:06:29.945+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:06:30.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:06:29 smithi027 bash[22863]: debug 2024-08-31T04:06:29.945+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:06:30.572 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:30.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:30.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:30.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:30.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:31 smithi027 bash[22610]: cluster 2024-08-31T04:06:29.459522+0000 mgr.a (mgr.14388) 4984 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:31 smithi027 bash[22610]: audit 2024-08-31T04:06:29.947929+0000 mgr.a (mgr.14388) 4985 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:06:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:31 smithi027 bash[22610]: cephadm 2024-08-31T04:06:29.949075+0000 mgr.a (mgr.14388) 4986 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:06:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:31 smithi027 bash[22610]: audit 2024-08-31T04:06:30.162457+0000 mgr.a (mgr.14388) 4987 : audit [DBG] from='client.117669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:31 smithi191 bash[24992]: cluster 2024-08-31T04:06:29.459522+0000 mgr.a (mgr.14388) 4984 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:31 smithi191 bash[24992]: audit 2024-08-31T04:06:29.947929+0000 mgr.a (mgr.14388) 4985 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:06:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:31 smithi191 bash[24992]: cephadm 2024-08-31T04:06:29.949075+0000 mgr.a (mgr.14388) 4986 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:06:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:31 smithi191 bash[24992]: audit 2024-08-31T04:06:30.162457+0000 mgr.a (mgr.14388) 4987 : audit [DBG] from='client.117669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:31.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:31 smithi163 bash[24253]: cluster 2024-08-31T04:06:29.459522+0000 mgr.a (mgr.14388) 4984 : cluster [DBG] pgmap v3454: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:31.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:31 smithi163 bash[24253]: audit 2024-08-31T04:06:29.947929+0000 mgr.a (mgr.14388) 4985 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:06:31.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:31 smithi163 bash[24253]: cephadm 2024-08-31T04:06:29.949075+0000 mgr.a (mgr.14388) 4986 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:06:31.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:31 smithi163 bash[24253]: audit 2024-08-31T04:06:30.162457+0000 mgr.a (mgr.14388) 4987 : audit [DBG] from='client.117669 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:33 smithi027 bash[22610]: cluster 2024-08-31T04:06:31.460361+0000 mgr.a (mgr.14388) 4988 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:33 smithi191 bash[24992]: cluster 2024-08-31T04:06:31.460361+0000 mgr.a (mgr.14388) 4988 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:33.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:33 smithi163 bash[24253]: cluster 2024-08-31T04:06:31.460361+0000 mgr.a (mgr.14388) 4988 : cluster [DBG] pgmap v3455: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:35 smithi027 bash[22610]: cluster 2024-08-31T04:06:33.462511+0000 mgr.a (mgr.14388) 4989 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:35 smithi191 bash[24992]: cluster 2024-08-31T04:06:33.462511+0000 mgr.a (mgr.14388) 4989 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:35.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:35.574 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:35.574 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:35.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:35 smithi163 bash[24253]: cluster 2024-08-31T04:06:33.462511+0000 mgr.a (mgr.14388) 4989 : cluster [DBG] pgmap v3456: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:36.334 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:36.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:36.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:36.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:36.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:37 smithi027 bash[22610]: cluster 2024-08-31T04:06:35.463280+0000 mgr.a (mgr.14388) 4990 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:37 smithi027 bash[22610]: audit 2024-08-31T04:06:35.904248+0000 mgr.a (mgr.14388) 4991 : audit [DBG] from='client.117747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:37 smithi191 bash[24992]: cluster 2024-08-31T04:06:35.463280+0000 mgr.a (mgr.14388) 4990 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:37 smithi191 bash[24992]: audit 2024-08-31T04:06:35.904248+0000 mgr.a (mgr.14388) 4991 : audit [DBG] from='client.117747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:37.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:37 smithi163 bash[24253]: cluster 2024-08-31T04:06:35.463280+0000 mgr.a (mgr.14388) 4990 : cluster [DBG] pgmap v3457: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:37.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:37 smithi163 bash[24253]: audit 2024-08-31T04:06:35.904248+0000 mgr.a (mgr.14388) 4991 : audit [DBG] from='client.117747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:39 smithi027 bash[22610]: cluster 2024-08-31T04:06:37.464218+0000 mgr.a (mgr.14388) 4992 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:39 smithi191 bash[24992]: cluster 2024-08-31T04:06:37.464218+0000 mgr.a (mgr.14388) 4992 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:39.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:39 smithi163 bash[24253]: cluster 2024-08-31T04:06:37.464218+0000 mgr.a (mgr.14388) 4992 : cluster [DBG] pgmap v3458: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:41.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:41.336 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:41.336 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:41 smithi191 bash[24992]: cluster 2024-08-31T04:06:39.466427+0000 mgr.a (mgr.14388) 4993 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:41.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:41 smithi163 bash[24253]: cluster 2024-08-31T04:06:39.466427+0000 mgr.a (mgr.14388) 4993 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:41 smithi027 bash[22610]: cluster 2024-08-31T04:06:39.466427+0000 mgr.a (mgr.14388) 4993 : cluster [DBG] pgmap v3459: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:42.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:42.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:42.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:42.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:42.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:43 smithi191 bash[24992]: cluster 2024-08-31T04:06:41.466900+0000 mgr.a (mgr.14388) 4994 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:43 smithi191 bash[24992]: audit 2024-08-31T04:06:41.673969+0000 mgr.a (mgr.14388) 4995 : audit [DBG] from='client.117825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:43.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:43 smithi163 bash[24253]: cluster 2024-08-31T04:06:41.466900+0000 mgr.a (mgr.14388) 4994 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:43.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:43 smithi163 bash[24253]: audit 2024-08-31T04:06:41.673969+0000 mgr.a (mgr.14388) 4995 : audit [DBG] from='client.117825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:43 smithi027 bash[22610]: cluster 2024-08-31T04:06:41.466900+0000 mgr.a (mgr.14388) 4994 : cluster [DBG] pgmap v3460: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:43 smithi027 bash[22610]: audit 2024-08-31T04:06:41.673969+0000 mgr.a (mgr.14388) 4995 : audit [DBG] from='client.117825 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:45 smithi191 bash[24992]: cluster 2024-08-31T04:06:43.469185+0000 mgr.a (mgr.14388) 4996 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:45.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:45 smithi163 bash[24253]: cluster 2024-08-31T04:06:43.469185+0000 mgr.a (mgr.14388) 4996 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:45 smithi027 bash[22610]: cluster 2024-08-31T04:06:43.469185+0000 mgr.a (mgr.14388) 4996 : cluster [DBG] pgmap v3461: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:06:47.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:47.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:47.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:47 smithi191 bash[24992]: cluster 2024-08-31T04:06:45.469985+0000 mgr.a (mgr.14388) 4997 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:47.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:47 smithi163 bash[24253]: cluster 2024-08-31T04:06:45.469985+0000 mgr.a (mgr.14388) 4997 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:47 smithi027 bash[22610]: cluster 2024-08-31T04:06:45.469985+0000 mgr.a (mgr.14388) 4997 : cluster [DBG] pgmap v3462: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:47.851 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:47.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:49 smithi191 bash[24992]: audit 2024-08-31T04:06:47.436920+0000 mgr.a (mgr.14388) 4998 : audit [DBG] from='client.117903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:49 smithi191 bash[24992]: cluster 2024-08-31T04:06:47.471018+0000 mgr.a (mgr.14388) 4999 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:49.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:49 smithi163 bash[24253]: audit 2024-08-31T04:06:47.436920+0000 mgr.a (mgr.14388) 4998 : audit [DBG] from='client.117903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:49.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:49 smithi163 bash[24253]: cluster 2024-08-31T04:06:47.471018+0000 mgr.a (mgr.14388) 4999 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:49 smithi027 bash[22610]: audit 2024-08-31T04:06:47.436920+0000 mgr.a (mgr.14388) 4998 : audit [DBG] from='client.117903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:49 smithi027 bash[22610]: cluster 2024-08-31T04:06:47.471018+0000 mgr.a (mgr.14388) 4999 : cluster [DBG] pgmap v3463: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:51 smithi191 bash[24992]: cluster 2024-08-31T04:06:49.473408+0000 mgr.a (mgr.14388) 5000 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:51.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:51 smithi163 bash[24253]: cluster 2024-08-31T04:06:49.473408+0000 mgr.a (mgr.14388) 5000 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:51 smithi027 bash[22610]: cluster 2024-08-31T04:06:49.473408+0000 mgr.a (mgr.14388) 5000 : cluster [DBG] pgmap v3464: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:06:52.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:52.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:52.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:53 smithi191 bash[24992]: cluster 2024-08-31T04:06:51.474203+0000 mgr.a (mgr.14388) 5001 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:53.590 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:53.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:53.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:53.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:53.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:53.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:53 smithi163 bash[24253]: cluster 2024-08-31T04:06:51.474203+0000 mgr.a (mgr.14388) 5001 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:53 smithi027 bash[22610]: cluster 2024-08-31T04:06:51.474203+0000 mgr.a (mgr.14388) 5001 : cluster [DBG] pgmap v3465: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:54 smithi191 bash[24992]: audit 2024-08-31T04:06:53.172964+0000 mgr.a (mgr.14388) 5002 : audit [DBG] from='client.117981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:54.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:54 smithi163 bash[24253]: audit 2024-08-31T04:06:53.172964+0000 mgr.a (mgr.14388) 5002 : audit [DBG] from='client.117981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:54 smithi027 bash[22610]: audit 2024-08-31T04:06:53.172964+0000 mgr.a (mgr.14388) 5002 : audit [DBG] from='client.117981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:55 smithi191 bash[24992]: cluster 2024-08-31T04:06:53.475509+0000 mgr.a (mgr.14388) 5003 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:55.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:55 smithi163 bash[24253]: cluster 2024-08-31T04:06:53.475509+0000 mgr.a (mgr.14388) 5003 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:55 smithi027 bash[22610]: cluster 2024-08-31T04:06:53.475509+0000 mgr.a (mgr.14388) 5003 : cluster [DBG] pgmap v3466: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:06:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:56 smithi191 bash[24992]: cluster 2024-08-31T04:06:55.476391+0000 mgr.a (mgr.14388) 5004 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:06:56.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:56 smithi163 bash[24253]: cluster 2024-08-31T04:06:55.476391+0000 mgr.a (mgr.14388) 5004 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:06:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:56 smithi027 bash[22610]: cluster 2024-08-31T04:06:55.476391+0000 mgr.a (mgr.14388) 5004 : cluster [DBG] pgmap v3467: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:06:58.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:06:58.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:06:58.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:06:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:58 smithi191 bash[24992]: cluster 2024-08-31T04:06:57.477166+0000 mgr.a (mgr.14388) 5005 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:06:58.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:58 smithi163 bash[24253]: cluster 2024-08-31T04:06:57.477166+0000 mgr.a (mgr.14388) 5005 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:06:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:58 smithi027 bash[22610]: cluster 2024-08-31T04:06:57.477166+0000 mgr.a (mgr.14388) 5005 : cluster [DBG] pgmap v3468: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:06:59.371 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:06:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:06:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:06:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:06:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:06:59.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:06:59 smithi163 bash[24253]: audit 2024-08-31T04:06:58.932089+0000 mgr.a (mgr.14388) 5006 : audit [DBG] from='client.118056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:06:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:06:59 smithi027 bash[22610]: audit 2024-08-31T04:06:58.932089+0000 mgr.a (mgr.14388) 5006 : audit [DBG] from='client.118056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:06:59 smithi191 bash[24992]: audit 2024-08-31T04:06:58.932089+0000 mgr.a (mgr.14388) 5006 : audit [DBG] from='client.118056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:00.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:00 smithi163 bash[24253]: cluster 2024-08-31T04:06:59.479863+0000 mgr.a (mgr.14388) 5007 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:00 smithi027 bash[22610]: cluster 2024-08-31T04:06:59.479863+0000 mgr.a (mgr.14388) 5007 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:00 smithi191 bash[24992]: cluster 2024-08-31T04:06:59.479863+0000 mgr.a (mgr.14388) 5007 : cluster [DBG] pgmap v3469: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:02.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:02 smithi163 bash[24253]: cluster 2024-08-31T04:07:01.480649+0000 mgr.a (mgr.14388) 5008 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:02 smithi027 bash[22610]: cluster 2024-08-31T04:07:01.480649+0000 mgr.a (mgr.14388) 5008 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:02 smithi191 bash[24992]: cluster 2024-08-31T04:07:01.480649+0000 mgr.a (mgr.14388) 5008 : cluster [DBG] pgmap v3470: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:04.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:07:04.373 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:07:04.373 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:07:04.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:04 smithi163 bash[24253]: cluster 2024-08-31T04:07:03.482681+0000 mgr.a (mgr.14388) 5009 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:04 smithi027 bash[22610]: cluster 2024-08-31T04:07:03.482681+0000 mgr.a (mgr.14388) 5009 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:04 smithi191 bash[24992]: cluster 2024-08-31T04:07:03.482681+0000 mgr.a (mgr.14388) 5009 : cluster [DBG] pgmap v3471: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:05.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:07:05.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:07:05.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:07:05.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:07:05.118 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:07:05.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:05 smithi163 bash[24253]: audit 2024-08-31T04:07:04.703272+0000 mgr.a (mgr.14388) 5010 : audit [DBG] from='client.118131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:05 smithi027 bash[22610]: audit 2024-08-31T04:07:04.703272+0000 mgr.a (mgr.14388) 5010 : audit [DBG] from='client.118131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:05 smithi191 bash[24992]: audit 2024-08-31T04:07:04.703272+0000 mgr.a (mgr.14388) 5010 : audit [DBG] from='client.118131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:06.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:06 smithi163 bash[24253]: cluster 2024-08-31T04:07:05.483610+0000 mgr.a (mgr.14388) 5011 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:06 smithi027 bash[22610]: cluster 2024-08-31T04:07:05.483610+0000 mgr.a (mgr.14388) 5011 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:06 smithi191 bash[24992]: cluster 2024-08-31T04:07:05.483610+0000 mgr.a (mgr.14388) 5011 : cluster [DBG] pgmap v3472: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:08.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:08 smithi163 bash[24253]: cluster 2024-08-31T04:07:07.484451+0000 mgr.a (mgr.14388) 5012 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:08 smithi027 bash[22610]: cluster 2024-08-31T04:07:07.484451+0000 mgr.a (mgr.14388) 5012 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:08 smithi191 bash[24992]: cluster 2024-08-31T04:07:07.484451+0000 mgr.a (mgr.14388) 5012 : cluster [DBG] pgmap v3473: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:10.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:07:10.120 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:07:10.120 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:07:10.857 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:07:10.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:07:10.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:07:10.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:07:10.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:07:10.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:10 smithi163 bash[24253]: cluster 2024-08-31T04:07:09.486629+0000 mgr.a (mgr.14388) 5013 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:10 smithi027 bash[22610]: cluster 2024-08-31T04:07:09.486629+0000 mgr.a (mgr.14388) 5013 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:10 smithi191 bash[24992]: cluster 2024-08-31T04:07:09.486629+0000 mgr.a (mgr.14388) 5013 : cluster [DBG] pgmap v3474: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:11.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:11 smithi163 bash[24253]: audit 2024-08-31T04:07:10.450699+0000 mgr.a (mgr.14388) 5014 : audit [DBG] from='client.118209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:11 smithi027 bash[22610]: audit 2024-08-31T04:07:10.450699+0000 mgr.a (mgr.14388) 5014 : audit [DBG] from='client.118209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:11 smithi191 bash[24992]: audit 2024-08-31T04:07:10.450699+0000 mgr.a (mgr.14388) 5014 : audit [DBG] from='client.118209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:12.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:12 smithi163 bash[24253]: cluster 2024-08-31T04:07:11.487756+0000 mgr.a (mgr.14388) 5015 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:12 smithi027 bash[22610]: cluster 2024-08-31T04:07:11.487756+0000 mgr.a (mgr.14388) 5015 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:12 smithi191 bash[24992]: cluster 2024-08-31T04:07:11.487756+0000 mgr.a (mgr.14388) 5015 : cluster [DBG] pgmap v3475: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:14.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:14 smithi163 bash[24253]: cluster 2024-08-31T04:07:13.490029+0000 mgr.a (mgr.14388) 5016 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:14 smithi027 bash[22610]: cluster 2024-08-31T04:07:13.490029+0000 mgr.a (mgr.14388) 5016 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:14 smithi191 bash[24992]: cluster 2024-08-31T04:07:13.490029+0000 mgr.a (mgr.14388) 5016 : cluster [DBG] pgmap v3476: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:15.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:07:15.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:07:15.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:07:16.612 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:07:16.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:07:16.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:07:16.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:07:16.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:07:16.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:16 smithi163 bash[24253]: cluster 2024-08-31T04:07:15.490983+0000 mgr.a (mgr.14388) 5017 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:16.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:16 smithi163 bash[24253]: audit 2024-08-31T04:07:16.191055+0000 mgr.a (mgr.14388) 5018 : audit [DBG] from='client.118287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:16 smithi027 bash[22610]: cluster 2024-08-31T04:07:15.490983+0000 mgr.a (mgr.14388) 5017 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:16 smithi027 bash[22610]: audit 2024-08-31T04:07:16.191055+0000 mgr.a (mgr.14388) 5018 : audit [DBG] from='client.118287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:16 smithi191 bash[24992]: cluster 2024-08-31T04:07:15.490983+0000 mgr.a (mgr.14388) 5017 : cluster [DBG] pgmap v3477: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:16 smithi191 bash[24992]: audit 2024-08-31T04:07:16.191055+0000 mgr.a (mgr.14388) 5018 : audit [DBG] from='client.118287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:18.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:18 smithi163 bash[24253]: cluster 2024-08-31T04:07:17.492102+0000 mgr.a (mgr.14388) 5019 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:18 smithi027 bash[22610]: cluster 2024-08-31T04:07:17.492102+0000 mgr.a (mgr.14388) 5019 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:18 smithi191 bash[24992]: cluster 2024-08-31T04:07:17.492102+0000 mgr.a (mgr.14388) 5019 : cluster [DBG] pgmap v3478: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:20.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:20 smithi163 bash[24253]: cluster 2024-08-31T04:07:19.494385+0000 mgr.a (mgr.14388) 5020 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:20 smithi027 bash[22610]: cluster 2024-08-31T04:07:19.494385+0000 mgr.a (mgr.14388) 5020 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:20 smithi191 bash[24992]: cluster 2024-08-31T04:07:19.494385+0000 mgr.a (mgr.14388) 5020 : cluster [DBG] pgmap v3479: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:21.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:07:21.614 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:07:21.614 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:07:22.393 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:07:22.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:07:22.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:07:22.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:07:22.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:07:22.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:22 smithi163 bash[24253]: cluster 2024-08-31T04:07:21.495257+0000 mgr.a (mgr.14388) 5021 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:22.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:22 smithi163 bash[24253]: audit 2024-08-31T04:07:21.950895+0000 mgr.a (mgr.14388) 5022 : audit [DBG] from='client.118365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:22 smithi027 bash[22610]: cluster 2024-08-31T04:07:21.495257+0000 mgr.a (mgr.14388) 5021 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:22 smithi027 bash[22610]: audit 2024-08-31T04:07:21.950895+0000 mgr.a (mgr.14388) 5022 : audit [DBG] from='client.118365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:22 smithi191 bash[24992]: cluster 2024-08-31T04:07:21.495257+0000 mgr.a (mgr.14388) 5021 : cluster [DBG] pgmap v3480: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:22 smithi191 bash[24992]: audit 2024-08-31T04:07:21.950895+0000 mgr.a (mgr.14388) 5022 : audit [DBG] from='client.118365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:24.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:24 smithi163 bash[24253]: cluster 2024-08-31T04:07:23.497580+0000 mgr.a (mgr.14388) 5023 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:24 smithi027 bash[22610]: cluster 2024-08-31T04:07:23.497580+0000 mgr.a (mgr.14388) 5023 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:24 smithi191 bash[24992]: cluster 2024-08-31T04:07:23.497580+0000 mgr.a (mgr.14388) 5023 : cluster [DBG] pgmap v3481: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:26.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:26 smithi163 bash[24253]: cluster 2024-08-31T04:07:25.498377+0000 mgr.a (mgr.14388) 5024 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:26 smithi027 bash[22610]: cluster 2024-08-31T04:07:25.498377+0000 mgr.a (mgr.14388) 5024 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:26 smithi191 bash[24992]: cluster 2024-08-31T04:07:25.498377+0000 mgr.a (mgr.14388) 5024 : cluster [DBG] pgmap v3482: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:27.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:07:27.395 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:07:27.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:07:28.142 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:07:28.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:07:28.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:07:28.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:07:28.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:07:28.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:28 smithi163 bash[24253]: cluster 2024-08-31T04:07:27.498848+0000 mgr.a (mgr.14388) 5025 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:28.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:28 smithi163 bash[24253]: audit 2024-08-31T04:07:27.730757+0000 mgr.a (mgr.14388) 5026 : audit [DBG] from='client.118443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:28 smithi027 bash[22610]: cluster 2024-08-31T04:07:27.498848+0000 mgr.a (mgr.14388) 5025 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:28 smithi027 bash[22610]: audit 2024-08-31T04:07:27.730757+0000 mgr.a (mgr.14388) 5026 : audit [DBG] from='client.118443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:28 smithi191 bash[24992]: cluster 2024-08-31T04:07:27.498848+0000 mgr.a (mgr.14388) 5025 : cluster [DBG] pgmap v3483: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:28 smithi191 bash[24992]: audit 2024-08-31T04:07:27.730757+0000 mgr.a (mgr.14388) 5026 : audit [DBG] from='client.118443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:30.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:30 smithi163 bash[24253]: cluster 2024-08-31T04:07:29.501429+0000 mgr.a (mgr.14388) 5027 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:30.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:30 smithi163 bash[24253]: audit 2024-08-31T04:07:30.003026+0000 mon.a (mon.0) 1333 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:07:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:30 smithi027 bash[22610]: cluster 2024-08-31T04:07:29.501429+0000 mgr.a (mgr.14388) 5027 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:30 smithi027 bash[22610]: audit 2024-08-31T04:07:30.003026+0000 mon.a (mon.0) 1333 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:07:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:30 smithi191 bash[24992]: cluster 2024-08-31T04:07:29.501429+0000 mgr.a (mgr.14388) 5027 : cluster [DBG] pgmap v3484: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:30 smithi191 bash[24992]: audit 2024-08-31T04:07:30.003026+0000 mon.a (mon.0) 1333 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:07:32.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:32 smithi163 bash[24253]: cluster 2024-08-31T04:07:31.502210+0000 mgr.a (mgr.14388) 5028 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:32 smithi027 bash[22610]: cluster 2024-08-31T04:07:31.502210+0000 mgr.a (mgr.14388) 5028 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:32 smithi191 bash[24992]: cluster 2024-08-31T04:07:31.502210+0000 mgr.a (mgr.14388) 5028 : cluster [DBG] pgmap v3485: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:33.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:07:33.144 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:07:33.144 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:07:33.877 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:07:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:07:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:07:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:07:33.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:07:34.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:34 smithi163 bash[24253]: audit 2024-08-31T04:07:33.462244+0000 mgr.a (mgr.14388) 5029 : audit [DBG] from='client.118518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:34.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:34 smithi163 bash[24253]: cluster 2024-08-31T04:07:33.505255+0000 mgr.a (mgr.14388) 5030 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:34 smithi027 bash[22610]: audit 2024-08-31T04:07:33.462244+0000 mgr.a (mgr.14388) 5029 : audit [DBG] from='client.118518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:34 smithi027 bash[22610]: cluster 2024-08-31T04:07:33.505255+0000 mgr.a (mgr.14388) 5030 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:35.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:34 smithi191 bash[24992]: audit 2024-08-31T04:07:33.462244+0000 mgr.a (mgr.14388) 5029 : audit [DBG] from='client.118518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:35.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:34 smithi191 bash[24992]: cluster 2024-08-31T04:07:33.505255+0000 mgr.a (mgr.14388) 5030 : cluster [DBG] pgmap v3486: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:35.350939+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:35.355436+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:35.360960+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:35.366165+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:35.382972+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:35.387698+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: cluster 2024-08-31T04:07:35.506187+0000 mgr.a (mgr.14388) 5031 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:36.111902+0000 mon.a (mon.0) 1340 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:07:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:36.113654+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:07:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:36.123590+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:36.128297+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:07:36.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:36 smithi163 bash[24253]: audit 2024-08-31T04:07:36.129507+0000 mgr.a (mgr.14388) 5032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:07:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:35.350939+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:35.355436+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:35.360960+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:35.366165+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:35.382972+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:35.387698+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: cluster 2024-08-31T04:07:35.506187+0000 mgr.a (mgr.14388) 5031 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:36.111902+0000 mon.a (mon.0) 1340 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:36.113654+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:36.123590+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:36.128297+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22610]: audit 2024-08-31T04:07:36.129507+0000 mgr.a (mgr.14388) 5032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:07:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:35.350939+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:35.355436+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:35.360960+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:35.366165+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:35.382972+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:35.387698+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: cluster 2024-08-31T04:07:35.506187+0000 mgr.a (mgr.14388) 5031 : cluster [DBG] pgmap v3487: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:36.111902+0000 mon.a (mon.0) 1340 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:07:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:36.113654+0000 mon.a (mon.0) 1341 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:07:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:36.123590+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:07:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:36.128297+0000 mon.a (mon.0) 1343 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:07:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:36 smithi191 bash[24992]: audit 2024-08-31T04:07:36.129507+0000 mgr.a (mgr.14388) 5032 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:07:37.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22863]: debug 2024-08-31T04:07:36.863+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:07:37.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:07:36 smithi027 bash[22863]: debug 2024-08-31T04:07:36.867+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:07:37.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:37 smithi163 bash[24253]: audit 2024-08-31T04:07:36.869635+0000 mgr.a (mgr.14388) 5033 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:07:37.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:37 smithi163 bash[24253]: cephadm 2024-08-31T04:07:36.870865+0000 mgr.a (mgr.14388) 5034 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:07:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:37 smithi027 bash[22610]: audit 2024-08-31T04:07:36.869635+0000 mgr.a (mgr.14388) 5033 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:07:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:37 smithi027 bash[22610]: cephadm 2024-08-31T04:07:36.870865+0000 mgr.a (mgr.14388) 5034 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:07:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:37 smithi191 bash[24992]: audit 2024-08-31T04:07:36.869635+0000 mgr.a (mgr.14388) 5033 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:07:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:37 smithi191 bash[24992]: cephadm 2024-08-31T04:07:36.870865+0000 mgr.a (mgr.14388) 5034 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:07:38.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:38 smithi163 bash[24253]: cluster 2024-08-31T04:07:37.507145+0000 mgr.a (mgr.14388) 5035 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:38 smithi027 bash[22610]: cluster 2024-08-31T04:07:37.507145+0000 mgr.a (mgr.14388) 5035 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:38 smithi191 bash[24992]: cluster 2024-08-31T04:07:37.507145+0000 mgr.a (mgr.14388) 5035 : cluster [DBG] pgmap v3488: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:07:38.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:07:38.880 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:07:38.880 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:07:39.636 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:07:39.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:07:39.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:07:39.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:07:39.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:07:39.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:39 smithi163 bash[24253]: audit 2024-08-31T04:07:39.216722+0000 mgr.a (mgr.14388) 5036 : audit [DBG] from='client.118701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:39 smithi027 bash[22610]: audit 2024-08-31T04:07:39.216722+0000 mgr.a (mgr.14388) 5036 : audit [DBG] from='client.118701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:39 smithi191 bash[24992]: audit 2024-08-31T04:07:39.216722+0000 mgr.a (mgr.14388) 5036 : audit [DBG] from='client.118701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:40.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:40 smithi163 bash[24253]: cluster 2024-08-31T04:07:39.508637+0000 mgr.a (mgr.14388) 5037 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:40 smithi027 bash[22610]: cluster 2024-08-31T04:07:39.508637+0000 mgr.a (mgr.14388) 5037 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:40 smithi191 bash[24992]: cluster 2024-08-31T04:07:39.508637+0000 mgr.a (mgr.14388) 5037 : cluster [DBG] pgmap v3489: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:42.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:42 smithi163 bash[24253]: cluster 2024-08-31T04:07:41.509628+0000 mgr.a (mgr.14388) 5038 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:42 smithi027 bash[22610]: cluster 2024-08-31T04:07:41.509628+0000 mgr.a (mgr.14388) 5038 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:42 smithi191 bash[24992]: cluster 2024-08-31T04:07:41.509628+0000 mgr.a (mgr.14388) 5038 : cluster [DBG] pgmap v3490: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:44.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:07:44.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:07:44.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:07:44.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:44 smithi163 bash[24253]: cluster 2024-08-31T04:07:43.511821+0000 mgr.a (mgr.14388) 5039 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:44 smithi027 bash[22610]: cluster 2024-08-31T04:07:43.511821+0000 mgr.a (mgr.14388) 5039 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:44 smithi191 bash[24992]: cluster 2024-08-31T04:07:43.511821+0000 mgr.a (mgr.14388) 5039 : cluster [DBG] pgmap v3491: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:45.413 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:07:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:07:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:07:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:07:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:07:45.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:45 smithi163 bash[24253]: audit 2024-08-31T04:07:44.978856+0000 mgr.a (mgr.14388) 5040 : audit [DBG] from='client.118779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:45 smithi027 bash[22610]: audit 2024-08-31T04:07:44.978856+0000 mgr.a (mgr.14388) 5040 : audit [DBG] from='client.118779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:45 smithi191 bash[24992]: audit 2024-08-31T04:07:44.978856+0000 mgr.a (mgr.14388) 5040 : audit [DBG] from='client.118779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:46.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:46 smithi163 bash[24253]: cluster 2024-08-31T04:07:45.512806+0000 mgr.a (mgr.14388) 5041 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:46 smithi027 bash[22610]: cluster 2024-08-31T04:07:45.512806+0000 mgr.a (mgr.14388) 5041 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:46 smithi191 bash[24992]: cluster 2024-08-31T04:07:45.512806+0000 mgr.a (mgr.14388) 5041 : cluster [DBG] pgmap v3492: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:48.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:48 smithi163 bash[24253]: cluster 2024-08-31T04:07:47.513784+0000 mgr.a (mgr.14388) 5042 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:48 smithi027 bash[22610]: cluster 2024-08-31T04:07:47.513784+0000 mgr.a (mgr.14388) 5042 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:48 smithi191 bash[24992]: cluster 2024-08-31T04:07:47.513784+0000 mgr.a (mgr.14388) 5042 : cluster [DBG] pgmap v3493: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:50.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:07:50.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:07:50.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:07:50.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:50 smithi163 bash[24253]: cluster 2024-08-31T04:07:49.516057+0000 mgr.a (mgr.14388) 5043 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:50 smithi027 bash[22610]: cluster 2024-08-31T04:07:49.516057+0000 mgr.a (mgr.14388) 5043 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:50 smithi191 bash[24992]: cluster 2024-08-31T04:07:49.516057+0000 mgr.a (mgr.14388) 5043 : cluster [DBG] pgmap v3494: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:07:51.184 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:07:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:07:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:07:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:07:51.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:07:51.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:51 smithi163 bash[24253]: audit 2024-08-31T04:07:50.752956+0000 mgr.a (mgr.14388) 5044 : audit [DBG] from='client.118857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:51 smithi027 bash[22610]: audit 2024-08-31T04:07:50.752956+0000 mgr.a (mgr.14388) 5044 : audit [DBG] from='client.118857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:51 smithi191 bash[24992]: audit 2024-08-31T04:07:50.752956+0000 mgr.a (mgr.14388) 5044 : audit [DBG] from='client.118857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:52.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:52 smithi163 bash[24253]: cluster 2024-08-31T04:07:51.516978+0000 mgr.a (mgr.14388) 5045 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:52 smithi027 bash[22610]: cluster 2024-08-31T04:07:51.516978+0000 mgr.a (mgr.14388) 5045 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:52 smithi191 bash[24992]: cluster 2024-08-31T04:07:51.516978+0000 mgr.a (mgr.14388) 5045 : cluster [DBG] pgmap v3495: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:54.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:54 smithi163 bash[24253]: cluster 2024-08-31T04:07:53.519114+0000 mgr.a (mgr.14388) 5046 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:54 smithi027 bash[22610]: cluster 2024-08-31T04:07:53.519114+0000 mgr.a (mgr.14388) 5046 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:54 smithi191 bash[24992]: cluster 2024-08-31T04:07:53.519114+0000 mgr.a (mgr.14388) 5046 : cluster [DBG] pgmap v3496: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:07:56.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:07:56.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:07:56.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:07:56.928 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:07:56.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:07:56.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:07:56.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:07:56.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:07:56.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:56 smithi163 bash[24253]: cluster 2024-08-31T04:07:55.519894+0000 mgr.a (mgr.14388) 5047 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:56 smithi027 bash[22610]: cluster 2024-08-31T04:07:55.519894+0000 mgr.a (mgr.14388) 5047 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:56 smithi191 bash[24992]: cluster 2024-08-31T04:07:55.519894+0000 mgr.a (mgr.14388) 5047 : cluster [DBG] pgmap v3497: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:57.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:57 smithi163 bash[24253]: audit 2024-08-31T04:07:56.517767+0000 mgr.a (mgr.14388) 5048 : audit [DBG] from='client.118932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:57 smithi027 bash[22610]: audit 2024-08-31T04:07:56.517767+0000 mgr.a (mgr.14388) 5048 : audit [DBG] from='client.118932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:57 smithi191 bash[24992]: audit 2024-08-31T04:07:56.517767+0000 mgr.a (mgr.14388) 5048 : audit [DBG] from='client.118932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:07:58.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:07:58 smithi163 bash[24253]: cluster 2024-08-31T04:07:57.520961+0000 mgr.a (mgr.14388) 5049 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:07:58 smithi027 bash[22610]: cluster 2024-08-31T04:07:57.520961+0000 mgr.a (mgr.14388) 5049 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:07:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:07:58 smithi191 bash[24992]: cluster 2024-08-31T04:07:57.520961+0000 mgr.a (mgr.14388) 5049 : cluster [DBG] pgmap v3498: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:00.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:00 smithi163 bash[24253]: cluster 2024-08-31T04:07:59.523405+0000 mgr.a (mgr.14388) 5050 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:00 smithi027 bash[22610]: cluster 2024-08-31T04:07:59.523405+0000 mgr.a (mgr.14388) 5050 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:00 smithi191 bash[24992]: cluster 2024-08-31T04:07:59.523405+0000 mgr.a (mgr.14388) 5050 : cluster [DBG] pgmap v3499: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:01.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:01.930 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:01.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:08:02.702 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:08:02.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:08:02.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:08:02.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:08:02.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:08:02.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:02 smithi163 bash[24253]: cluster 2024-08-31T04:08:01.524353+0000 mgr.a (mgr.14388) 5051 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:02.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:02 smithi163 bash[24253]: audit 2024-08-31T04:08:02.267236+0000 mgr.a (mgr.14388) 5052 : audit [DBG] from='client.119010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:02 smithi027 bash[22610]: cluster 2024-08-31T04:08:01.524353+0000 mgr.a (mgr.14388) 5051 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:02 smithi027 bash[22610]: audit 2024-08-31T04:08:02.267236+0000 mgr.a (mgr.14388) 5052 : audit [DBG] from='client.119010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:02 smithi191 bash[24992]: cluster 2024-08-31T04:08:01.524353+0000 mgr.a (mgr.14388) 5051 : cluster [DBG] pgmap v3500: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:02 smithi191 bash[24992]: audit 2024-08-31T04:08:02.267236+0000 mgr.a (mgr.14388) 5052 : audit [DBG] from='client.119010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:04.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:04 smithi163 bash[24253]: cluster 2024-08-31T04:08:03.526695+0000 mgr.a (mgr.14388) 5053 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:04 smithi027 bash[22610]: cluster 2024-08-31T04:08:03.526695+0000 mgr.a (mgr.14388) 5053 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:04 smithi191 bash[24992]: cluster 2024-08-31T04:08:03.526695+0000 mgr.a (mgr.14388) 5053 : cluster [DBG] pgmap v3501: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:06.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:06 smithi163 bash[24253]: cluster 2024-08-31T04:08:05.527506+0000 mgr.a (mgr.14388) 5054 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:06 smithi027 bash[22610]: cluster 2024-08-31T04:08:05.527506+0000 mgr.a (mgr.14388) 5054 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:06 smithi191 bash[24992]: cluster 2024-08-31T04:08:05.527506+0000 mgr.a (mgr.14388) 5054 : cluster [DBG] pgmap v3502: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:07.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:07.704 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:07.705 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:08:08.440 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:08:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:08:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:08:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:08:08.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:08:08.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:08 smithi163 bash[24253]: cluster 2024-08-31T04:08:07.528272+0000 mgr.a (mgr.14388) 5055 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:08.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:08 smithi163 bash[24253]: audit 2024-08-31T04:08:08.033618+0000 mgr.a (mgr.14388) 5056 : audit [DBG] from='client.119088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:08 smithi027 bash[22610]: cluster 2024-08-31T04:08:07.528272+0000 mgr.a (mgr.14388) 5055 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:08 smithi027 bash[22610]: audit 2024-08-31T04:08:08.033618+0000 mgr.a (mgr.14388) 5056 : audit [DBG] from='client.119088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:08 smithi191 bash[24992]: cluster 2024-08-31T04:08:07.528272+0000 mgr.a (mgr.14388) 5055 : cluster [DBG] pgmap v3503: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:08 smithi191 bash[24992]: audit 2024-08-31T04:08:08.033618+0000 mgr.a (mgr.14388) 5056 : audit [DBG] from='client.119088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:10.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:10 smithi163 bash[24253]: cluster 2024-08-31T04:08:09.530956+0000 mgr.a (mgr.14388) 5057 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:10 smithi027 bash[22610]: cluster 2024-08-31T04:08:09.530956+0000 mgr.a (mgr.14388) 5057 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:10 smithi191 bash[24992]: cluster 2024-08-31T04:08:09.530956+0000 mgr.a (mgr.14388) 5057 : cluster [DBG] pgmap v3504: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:12.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:12 smithi163 bash[24253]: cluster 2024-08-31T04:08:11.531700+0000 mgr.a (mgr.14388) 5058 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:08:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:12 smithi027 bash[22610]: cluster 2024-08-31T04:08:11.531700+0000 mgr.a (mgr.14388) 5058 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:08:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:12 smithi191 bash[24992]: cluster 2024-08-31T04:08:11.531700+0000 mgr.a (mgr.14388) 5058 : cluster [DBG] pgmap v3505: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:08:13.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:13.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:08:14.215 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:08:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:08:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:08:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:08:14.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:08:14.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:14 smithi163 bash[24253]: cluster 2024-08-31T04:08:13.534252+0000 mgr.a (mgr.14388) 5059 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:14.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:14 smithi163 bash[24253]: audit 2024-08-31T04:08:13.784388+0000 mgr.a (mgr.14388) 5060 : audit [DBG] from='client.119163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:14 smithi027 bash[22610]: cluster 2024-08-31T04:08:13.534252+0000 mgr.a (mgr.14388) 5059 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:14 smithi027 bash[22610]: audit 2024-08-31T04:08:13.784388+0000 mgr.a (mgr.14388) 5060 : audit [DBG] from='client.119163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:14 smithi191 bash[24992]: cluster 2024-08-31T04:08:13.534252+0000 mgr.a (mgr.14388) 5059 : cluster [DBG] pgmap v3506: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:14 smithi191 bash[24992]: audit 2024-08-31T04:08:13.784388+0000 mgr.a (mgr.14388) 5060 : audit [DBG] from='client.119163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:16.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:16 smithi163 bash[24253]: cluster 2024-08-31T04:08:15.535196+0000 mgr.a (mgr.14388) 5061 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:08:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:16 smithi027 bash[22610]: cluster 2024-08-31T04:08:15.535196+0000 mgr.a (mgr.14388) 5061 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:08:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:16 smithi191 bash[24992]: cluster 2024-08-31T04:08:15.535196+0000 mgr.a (mgr.14388) 5061 : cluster [DBG] pgmap v3507: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:08:18.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:18 smithi163 bash[24253]: cluster 2024-08-31T04:08:17.535990+0000 mgr.a (mgr.14388) 5062 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:08:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:18 smithi027 bash[22610]: cluster 2024-08-31T04:08:17.535990+0000 mgr.a (mgr.14388) 5062 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:08:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:18 smithi191 bash[24992]: cluster 2024-08-31T04:08:17.535990+0000 mgr.a (mgr.14388) 5062 : cluster [DBG] pgmap v3508: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:08:19.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:19.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:19.218 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:08:19.984 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:08:19.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:08:19.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:08:19.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:08:19.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:08:20.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:20 smithi163 bash[24253]: cluster 2024-08-31T04:08:19.538174+0000 mgr.a (mgr.14388) 5063 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:20.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:20 smithi163 bash[24253]: audit 2024-08-31T04:08:19.551495+0000 mgr.a (mgr.14388) 5064 : audit [DBG] from='client.119235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:20 smithi027 bash[22610]: cluster 2024-08-31T04:08:19.538174+0000 mgr.a (mgr.14388) 5063 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:20 smithi027 bash[22610]: audit 2024-08-31T04:08:19.551495+0000 mgr.a (mgr.14388) 5064 : audit [DBG] from='client.119235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:20 smithi191 bash[24992]: cluster 2024-08-31T04:08:19.538174+0000 mgr.a (mgr.14388) 5063 : cluster [DBG] pgmap v3509: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:20 smithi191 bash[24992]: audit 2024-08-31T04:08:19.551495+0000 mgr.a (mgr.14388) 5064 : audit [DBG] from='client.119235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:22.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:22 smithi163 bash[24253]: cluster 2024-08-31T04:08:21.539155+0000 mgr.a (mgr.14388) 5065 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:22 smithi027 bash[22610]: cluster 2024-08-31T04:08:21.539155+0000 mgr.a (mgr.14388) 5065 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:22 smithi191 bash[24992]: cluster 2024-08-31T04:08:21.539155+0000 mgr.a (mgr.14388) 5065 : cluster [DBG] pgmap v3510: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:24.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:24 smithi163 bash[24253]: cluster 2024-08-31T04:08:23.541258+0000 mgr.a (mgr.14388) 5066 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:24 smithi027 bash[22610]: cluster 2024-08-31T04:08:23.541258+0000 mgr.a (mgr.14388) 5066 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:24.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:24.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:24.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:08:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:24 smithi191 bash[24992]: cluster 2024-08-31T04:08:23.541258+0000 mgr.a (mgr.14388) 5066 : cluster [DBG] pgmap v3511: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:25.759 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:08:25.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:08:25.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:08:25.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:08:25.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:08:26.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:26 smithi163 bash[24253]: audit 2024-08-31T04:08:25.323442+0000 mgr.a (mgr.14388) 5067 : audit [DBG] from='client.119313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:26.940 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:26 smithi163 bash[24253]: cluster 2024-08-31T04:08:25.541883+0000 mgr.a (mgr.14388) 5068 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:26 smithi027 bash[22610]: audit 2024-08-31T04:08:25.323442+0000 mgr.a (mgr.14388) 5067 : audit [DBG] from='client.119313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:26 smithi027 bash[22610]: cluster 2024-08-31T04:08:25.541883+0000 mgr.a (mgr.14388) 5068 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:26 smithi191 bash[24992]: audit 2024-08-31T04:08:25.323442+0000 mgr.a (mgr.14388) 5067 : audit [DBG] from='client.119313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:26 smithi191 bash[24992]: cluster 2024-08-31T04:08:25.541883+0000 mgr.a (mgr.14388) 5068 : cluster [DBG] pgmap v3512: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:28 smithi027 bash[22610]: cluster 2024-08-31T04:08:27.542912+0000 mgr.a (mgr.14388) 5069 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:28 smithi191 bash[24992]: cluster 2024-08-31T04:08:27.542912+0000 mgr.a (mgr.14388) 5069 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:29.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:28 smithi163 bash[24253]: cluster 2024-08-31T04:08:27.542912+0000 mgr.a (mgr.14388) 5069 : cluster [DBG] pgmap v3513: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:30.761 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:30.762 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:30.762 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:08:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:30 smithi027 bash[22610]: cluster 2024-08-31T04:08:29.545187+0000 mgr.a (mgr.14388) 5070 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:30 smithi191 bash[24992]: cluster 2024-08-31T04:08:29.545187+0000 mgr.a (mgr.14388) 5070 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:31.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:30 smithi163 bash[24253]: cluster 2024-08-31T04:08:29.545187+0000 mgr.a (mgr.14388) 5070 : cluster [DBG] pgmap v3514: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:31.540 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:08:31.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:08:31.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:08:31.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:08:31.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:08:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:31 smithi027 bash[22610]: audit 2024-08-31T04:08:31.099718+0000 mgr.a (mgr.14388) 5071 : audit [DBG] from='client.119391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:31 smithi191 bash[24992]: audit 2024-08-31T04:08:31.099718+0000 mgr.a (mgr.14388) 5071 : audit [DBG] from='client.119391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:32.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:31 smithi163 bash[24253]: audit 2024-08-31T04:08:31.099718+0000 mgr.a (mgr.14388) 5071 : audit [DBG] from='client.119391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:32 smithi027 bash[22610]: cluster 2024-08-31T04:08:31.545840+0000 mgr.a (mgr.14388) 5072 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:32 smithi191 bash[24992]: cluster 2024-08-31T04:08:31.545840+0000 mgr.a (mgr.14388) 5072 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:33.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:32 smithi163 bash[24253]: cluster 2024-08-31T04:08:31.545840+0000 mgr.a (mgr.14388) 5072 : cluster [DBG] pgmap v3515: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:34 smithi027 bash[22610]: cluster 2024-08-31T04:08:33.547975+0000 mgr.a (mgr.14388) 5073 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:34 smithi191 bash[24992]: cluster 2024-08-31T04:08:33.547975+0000 mgr.a (mgr.14388) 5073 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:35.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:34 smithi163 bash[24253]: cluster 2024-08-31T04:08:33.547975+0000 mgr.a (mgr.14388) 5073 : cluster [DBG] pgmap v3516: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:08:36.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:36.542 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:36.542 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:08:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:36 smithi027 bash[22610]: cluster 2024-08-31T04:08:35.548722+0000 mgr.a (mgr.14388) 5074 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:36 smithi191 bash[24992]: cluster 2024-08-31T04:08:35.548722+0000 mgr.a (mgr.14388) 5074 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:37.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:36 smithi163 bash[24253]: cluster 2024-08-31T04:08:35.548722+0000 mgr.a (mgr.14388) 5074 : cluster [DBG] pgmap v3517: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:37.336 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:08:37.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:08:37.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:08:37.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:08:37.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:08:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:37 smithi027 bash[22610]: audit 2024-08-31T04:08:36.876731+0000 mgr.a (mgr.14388) 5075 : audit [DBG] from='client.119469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:37 smithi027 bash[22610]: audit 2024-08-31T04:08:36.921869+0000 mon.a (mon.0) 1344 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:08:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:37 smithi191 bash[24992]: audit 2024-08-31T04:08:36.876731+0000 mgr.a (mgr.14388) 5075 : audit [DBG] from='client.119469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:37 smithi191 bash[24992]: audit 2024-08-31T04:08:36.921869+0000 mon.a (mon.0) 1344 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:08:38.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:37 smithi163 bash[24253]: audit 2024-08-31T04:08:36.876731+0000 mgr.a (mgr.14388) 5075 : audit [DBG] from='client.119469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:38.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:37 smithi163 bash[24253]: audit 2024-08-31T04:08:36.921869+0000 mon.a (mon.0) 1344 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:08:38.730 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:08:38 smithi027 bash[22863]: debug 2024-08-31T04:08:38.473+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:08:38.730 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:08:38 smithi027 bash[22863]: debug 2024-08-31T04:08:38.473+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:08:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:38 smithi027 bash[22610]: cluster 2024-08-31T04:08:37.549342+0000 mgr.a (mgr.14388) 5076 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:38 smithi027 bash[22610]: audit 2024-08-31T04:08:37.734673+0000 mon.a (mon.0) 1345 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:08:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:38 smithi027 bash[22610]: audit 2024-08-31T04:08:37.736441+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:08:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:38 smithi027 bash[22610]: audit 2024-08-31T04:08:37.746360+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:08:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:38 smithi027 bash[22610]: audit 2024-08-31T04:08:37.751100+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:08:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:38 smithi027 bash[22610]: audit 2024-08-31T04:08:37.752176+0000 mgr.a (mgr.14388) 5077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:08:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:38 smithi191 bash[24992]: cluster 2024-08-31T04:08:37.549342+0000 mgr.a (mgr.14388) 5076 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:38 smithi191 bash[24992]: audit 2024-08-31T04:08:37.734673+0000 mon.a (mon.0) 1345 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:08:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:38 smithi191 bash[24992]: audit 2024-08-31T04:08:37.736441+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:08:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:38 smithi191 bash[24992]: audit 2024-08-31T04:08:37.746360+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:08:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:38 smithi191 bash[24992]: audit 2024-08-31T04:08:37.751100+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:08:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:38 smithi191 bash[24992]: audit 2024-08-31T04:08:37.752176+0000 mgr.a (mgr.14388) 5077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:08:39.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:38 smithi163 bash[24253]: cluster 2024-08-31T04:08:37.549342+0000 mgr.a (mgr.14388) 5076 : cluster [DBG] pgmap v3518: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:08:39.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:38 smithi163 bash[24253]: audit 2024-08-31T04:08:37.734673+0000 mon.a (mon.0) 1345 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:08:39.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:38 smithi163 bash[24253]: audit 2024-08-31T04:08:37.736441+0000 mon.a (mon.0) 1346 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:08:39.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:38 smithi163 bash[24253]: audit 2024-08-31T04:08:37.746360+0000 mon.a (mon.0) 1347 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:08:39.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:38 smithi163 bash[24253]: audit 2024-08-31T04:08:37.751100+0000 mon.a (mon.0) 1348 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:08:39.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:38 smithi163 bash[24253]: audit 2024-08-31T04:08:37.752176+0000 mgr.a (mgr.14388) 5077 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:08:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:39 smithi191 bash[24992]: audit 2024-08-31T04:08:38.476925+0000 mgr.a (mgr.14388) 5078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:08:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:39 smithi191 bash[24992]: cephadm 2024-08-31T04:08:38.478273+0000 mgr.a (mgr.14388) 5079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:08:40.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:39 smithi163 bash[24253]: audit 2024-08-31T04:08:38.476925+0000 mgr.a (mgr.14388) 5078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:08:40.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:39 smithi163 bash[24253]: cephadm 2024-08-31T04:08:38.478273+0000 mgr.a (mgr.14388) 5079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:08:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:39 smithi027 bash[22610]: audit 2024-08-31T04:08:38.476925+0000 mgr.a (mgr.14388) 5078 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:08:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:39 smithi027 bash[22610]: cephadm 2024-08-31T04:08:38.478273+0000 mgr.a (mgr.14388) 5079 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:08:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:40 smithi191 bash[24992]: cluster 2024-08-31T04:08:39.551949+0000 mgr.a (mgr.14388) 5080 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:08:41.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:40 smithi163 bash[24253]: cluster 2024-08-31T04:08:39.551949+0000 mgr.a (mgr.14388) 5080 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:08:41.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:40 smithi027 bash[22610]: cluster 2024-08-31T04:08:39.551949+0000 mgr.a (mgr.14388) 5080 : cluster [DBG] pgmap v3519: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T04:08:42.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:42.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:42.339 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:08:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:42 smithi191 bash[24992]: cluster 2024-08-31T04:08:41.552853+0000 mgr.a (mgr.14388) 5081 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:08:43.080 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:08:43.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:08:43.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:08:43.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:08:43.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:08:43.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:42 smithi163 bash[24253]: cluster 2024-08-31T04:08:41.552853+0000 mgr.a (mgr.14388) 5081 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:08:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:42 smithi027 bash[22610]: cluster 2024-08-31T04:08:41.552853+0000 mgr.a (mgr.14388) 5081 : cluster [DBG] pgmap v3520: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:08:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:43 smithi191 bash[24992]: audit 2024-08-31T04:08:42.660668+0000 mgr.a (mgr.14388) 5082 : audit [DBG] from='client.119655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:44.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:43 smithi163 bash[24253]: audit 2024-08-31T04:08:42.660668+0000 mgr.a (mgr.14388) 5082 : audit [DBG] from='client.119655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:43 smithi027 bash[22610]: audit 2024-08-31T04:08:42.660668+0000 mgr.a (mgr.14388) 5082 : audit [DBG] from='client.119655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:44 smithi191 bash[24992]: cluster 2024-08-31T04:08:43.555582+0000 mgr.a (mgr.14388) 5083 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:08:45.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:44 smithi163 bash[24253]: cluster 2024-08-31T04:08:43.555582+0000 mgr.a (mgr.14388) 5083 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:08:45.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:44 smithi027 bash[22610]: cluster 2024-08-31T04:08:43.555582+0000 mgr.a (mgr.14388) 5083 : cluster [DBG] pgmap v3521: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:08:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:46 smithi191 bash[24992]: cluster 2024-08-31T04:08:45.556361+0000 mgr.a (mgr.14388) 5084 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:08:47.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:46 smithi163 bash[24253]: cluster 2024-08-31T04:08:45.556361+0000 mgr.a (mgr.14388) 5084 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:08:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:46 smithi027 bash[22610]: cluster 2024-08-31T04:08:45.556361+0000 mgr.a (mgr.14388) 5084 : cluster [DBG] pgmap v3522: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:08:48.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:48.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:48.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:08:48.848 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:08:48.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:08:48.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:08:48.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:08:48.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:08:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:48 smithi191 bash[24992]: cluster 2024-08-31T04:08:47.557124+0000 mgr.a (mgr.14388) 5085 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:08:49.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:48 smithi163 bash[24253]: cluster 2024-08-31T04:08:47.557124+0000 mgr.a (mgr.14388) 5085 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:08:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:48 smithi027 bash[22610]: cluster 2024-08-31T04:08:47.557124+0000 mgr.a (mgr.14388) 5085 : cluster [DBG] pgmap v3523: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:08:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:49 smithi191 bash[24992]: audit 2024-08-31T04:08:48.419505+0000 mgr.a (mgr.14388) 5086 : audit [DBG] from='client.119733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:50.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:49 smithi163 bash[24253]: audit 2024-08-31T04:08:48.419505+0000 mgr.a (mgr.14388) 5086 : audit [DBG] from='client.119733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:49 smithi027 bash[22610]: audit 2024-08-31T04:08:48.419505+0000 mgr.a (mgr.14388) 5086 : audit [DBG] from='client.119733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:50 smithi191 bash[24992]: cluster 2024-08-31T04:08:49.559770+0000 mgr.a (mgr.14388) 5087 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:08:51.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:50 smithi163 bash[24253]: cluster 2024-08-31T04:08:49.559770+0000 mgr.a (mgr.14388) 5087 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:08:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:50 smithi027 bash[22610]: cluster 2024-08-31T04:08:49.559770+0000 mgr.a (mgr.14388) 5087 : cluster [DBG] pgmap v3524: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:08:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:52 smithi191 bash[24992]: cluster 2024-08-31T04:08:51.560567+0000 mgr.a (mgr.14388) 5088 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:08:53.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:52 smithi163 bash[24253]: cluster 2024-08-31T04:08:51.560567+0000 mgr.a (mgr.14388) 5088 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:08:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:52 smithi027 bash[22610]: cluster 2024-08-31T04:08:51.560567+0000 mgr.a (mgr.14388) 5088 : cluster [DBG] pgmap v3525: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T04:08:53.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:53.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:08:54.631 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:08:54.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:08:54.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:08:54.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:08:54.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:08:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:54 smithi191 bash[24992]: cluster 2024-08-31T04:08:53.562438+0000 mgr.a (mgr.14388) 5089 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:08:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:54 smithi191 bash[24992]: audit 2024-08-31T04:08:54.187871+0000 mgr.a (mgr.14388) 5090 : audit [DBG] from='client.119811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:55.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:54 smithi163 bash[24253]: cluster 2024-08-31T04:08:53.562438+0000 mgr.a (mgr.14388) 5089 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:08:55.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:54 smithi163 bash[24253]: audit 2024-08-31T04:08:54.187871+0000 mgr.a (mgr.14388) 5090 : audit [DBG] from='client.119811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:54 smithi027 bash[22610]: cluster 2024-08-31T04:08:53.562438+0000 mgr.a (mgr.14388) 5089 : cluster [DBG] pgmap v3526: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:08:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:54 smithi027 bash[22610]: audit 2024-08-31T04:08:54.187871+0000 mgr.a (mgr.14388) 5090 : audit [DBG] from='client.119811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:08:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:56 smithi191 bash[24992]: cluster 2024-08-31T04:08:55.563331+0000 mgr.a (mgr.14388) 5091 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:08:57.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:56 smithi163 bash[24253]: cluster 2024-08-31T04:08:55.563331+0000 mgr.a (mgr.14388) 5091 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:08:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:56 smithi027 bash[22610]: cluster 2024-08-31T04:08:55.563331+0000 mgr.a (mgr.14388) 5091 : cluster [DBG] pgmap v3527: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:08:59.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:08:58 smithi163 bash[24253]: cluster 2024-08-31T04:08:57.564095+0000 mgr.a (mgr.14388) 5092 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:08:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:08:58 smithi027 bash[22610]: cluster 2024-08-31T04:08:57.564095+0000 mgr.a (mgr.14388) 5092 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:08:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:08:58 smithi191 bash[24992]: cluster 2024-08-31T04:08:57.564095+0000 mgr.a (mgr.14388) 5092 : cluster [DBG] pgmap v3528: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:08:59.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:08:59.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:08:59.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:00.378 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:00.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:00.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:00.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:00.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:01.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:00 smithi163 bash[24253]: cluster 2024-08-31T04:08:59.566263+0000 mgr.a (mgr.14388) 5093 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:09:01.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:00 smithi163 bash[24253]: audit 2024-08-31T04:08:59.962299+0000 mgr.a (mgr.14388) 5094 : audit [DBG] from='client.119889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:00 smithi027 bash[22610]: cluster 2024-08-31T04:08:59.566263+0000 mgr.a (mgr.14388) 5093 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:09:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:00 smithi027 bash[22610]: audit 2024-08-31T04:08:59.962299+0000 mgr.a (mgr.14388) 5094 : audit [DBG] from='client.119889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:00 smithi191 bash[24992]: cluster 2024-08-31T04:08:59.566263+0000 mgr.a (mgr.14388) 5093 : cluster [DBG] pgmap v3529: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:09:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:00 smithi191 bash[24992]: audit 2024-08-31T04:08:59.962299+0000 mgr.a (mgr.14388) 5094 : audit [DBG] from='client.119889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:03.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:02 smithi163 bash[24253]: cluster 2024-08-31T04:09:01.567148+0000 mgr.a (mgr.14388) 5095 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:02 smithi027 bash[22610]: cluster 2024-08-31T04:09:01.567148+0000 mgr.a (mgr.14388) 5095 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:02 smithi191 bash[24992]: cluster 2024-08-31T04:09:01.567148+0000 mgr.a (mgr.14388) 5095 : cluster [DBG] pgmap v3530: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:05.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:04 smithi163 bash[24253]: cluster 2024-08-31T04:09:03.569275+0000 mgr.a (mgr.14388) 5096 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:04 smithi027 bash[22610]: cluster 2024-08-31T04:09:03.569275+0000 mgr.a (mgr.14388) 5096 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:04 smithi191 bash[24992]: cluster 2024-08-31T04:09:03.569275+0000 mgr.a (mgr.14388) 5096 : cluster [DBG] pgmap v3531: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:05.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:09:05.380 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:09:05.380 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:06.158 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:06.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:06.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:07.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:06 smithi163 bash[24253]: cluster 2024-08-31T04:09:05.570014+0000 mgr.a (mgr.14388) 5097 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:07.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:06 smithi163 bash[24253]: audit 2024-08-31T04:09:05.716002+0000 mgr.a (mgr.14388) 5098 : audit [DBG] from='client.119964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:06 smithi027 bash[22610]: cluster 2024-08-31T04:09:05.570014+0000 mgr.a (mgr.14388) 5097 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:06 smithi027 bash[22610]: audit 2024-08-31T04:09:05.716002+0000 mgr.a (mgr.14388) 5098 : audit [DBG] from='client.119964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:06 smithi191 bash[24992]: cluster 2024-08-31T04:09:05.570014+0000 mgr.a (mgr.14388) 5097 : cluster [DBG] pgmap v3532: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:06 smithi191 bash[24992]: audit 2024-08-31T04:09:05.716002+0000 mgr.a (mgr.14388) 5098 : audit [DBG] from='client.119964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:09.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:08 smithi163 bash[24253]: cluster 2024-08-31T04:09:07.570924+0000 mgr.a (mgr.14388) 5099 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:08 smithi027 bash[22610]: cluster 2024-08-31T04:09:07.570924+0000 mgr.a (mgr.14388) 5099 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:08 smithi191 bash[24992]: cluster 2024-08-31T04:09:07.570924+0000 mgr.a (mgr.14388) 5099 : cluster [DBG] pgmap v3533: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:11.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:09:11.160 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:09:11.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:11.189 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:10 smithi163 bash[24253]: cluster 2024-08-31T04:09:09.573176+0000 mgr.a (mgr.14388) 5100 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:10 smithi027 bash[22610]: cluster 2024-08-31T04:09:09.573176+0000 mgr.a (mgr.14388) 5100 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:10 smithi191 bash[24992]: cluster 2024-08-31T04:09:09.573176+0000 mgr.a (mgr.14388) 5100 : cluster [DBG] pgmap v3534: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:11.940 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:11.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:11.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:11.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:11.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:13.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:12 smithi163 bash[24253]: audit 2024-08-31T04:09:11.492769+0000 mgr.a (mgr.14388) 5101 : audit [DBG] from='client.120039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:13.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:12 smithi163 bash[24253]: cluster 2024-08-31T04:09:11.573798+0000 mgr.a (mgr.14388) 5102 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:12 smithi027 bash[22610]: audit 2024-08-31T04:09:11.492769+0000 mgr.a (mgr.14388) 5101 : audit [DBG] from='client.120039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:12 smithi027 bash[22610]: cluster 2024-08-31T04:09:11.573798+0000 mgr.a (mgr.14388) 5102 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:12 smithi191 bash[24992]: audit 2024-08-31T04:09:11.492769+0000 mgr.a (mgr.14388) 5101 : audit [DBG] from='client.120039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:12 smithi191 bash[24992]: cluster 2024-08-31T04:09:11.573798+0000 mgr.a (mgr.14388) 5102 : cluster [DBG] pgmap v3535: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:15.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:14 smithi163 bash[24253]: cluster 2024-08-31T04:09:13.576064+0000 mgr.a (mgr.14388) 5103 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:14 smithi027 bash[22610]: cluster 2024-08-31T04:09:13.576064+0000 mgr.a (mgr.14388) 5103 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:14 smithi191 bash[24992]: cluster 2024-08-31T04:09:13.576064+0000 mgr.a (mgr.14388) 5103 : cluster [DBG] pgmap v3536: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:16.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:09:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:17.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:16 smithi163 bash[24253]: cluster 2024-08-31T04:09:15.576842+0000 mgr.a (mgr.14388) 5104 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:16 smithi027 bash[22610]: cluster 2024-08-31T04:09:15.576842+0000 mgr.a (mgr.14388) 5104 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:16 smithi191 bash[24992]: cluster 2024-08-31T04:09:15.576842+0000 mgr.a (mgr.14388) 5104 : cluster [DBG] pgmap v3537: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:17.708 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:17.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:17.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:17.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:17.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:18.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:17 smithi163 bash[24253]: audit 2024-08-31T04:09:17.278961+0000 mgr.a (mgr.14388) 5105 : audit [DBG] from='client.120117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:17 smithi027 bash[22610]: audit 2024-08-31T04:09:17.278961+0000 mgr.a (mgr.14388) 5105 : audit [DBG] from='client.120117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:17 smithi191 bash[24992]: audit 2024-08-31T04:09:17.278961+0000 mgr.a (mgr.14388) 5105 : audit [DBG] from='client.120117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:19.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:18 smithi163 bash[24253]: cluster 2024-08-31T04:09:17.577330+0000 mgr.a (mgr.14388) 5106 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:18 smithi027 bash[22610]: cluster 2024-08-31T04:09:17.577330+0000 mgr.a (mgr.14388) 5106 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:18 smithi191 bash[24992]: cluster 2024-08-31T04:09:17.577330+0000 mgr.a (mgr.14388) 5106 : cluster [DBG] pgmap v3538: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:21.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:20 smithi163 bash[24253]: cluster 2024-08-31T04:09:19.579620+0000 mgr.a (mgr.14388) 5107 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:20 smithi027 bash[22610]: cluster 2024-08-31T04:09:19.579620+0000 mgr.a (mgr.14388) 5107 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:20 smithi191 bash[24992]: cluster 2024-08-31T04:09:19.579620+0000 mgr.a (mgr.14388) 5107 : cluster [DBG] pgmap v3539: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:22.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:09:22.711 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:09:22.711 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:23.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:22 smithi163 bash[24253]: cluster 2024-08-31T04:09:21.580406+0000 mgr.a (mgr.14388) 5108 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:22 smithi027 bash[22610]: cluster 2024-08-31T04:09:21.580406+0000 mgr.a (mgr.14388) 5108 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:22 smithi191 bash[24992]: cluster 2024-08-31T04:09:21.580406+0000 mgr.a (mgr.14388) 5108 : cluster [DBG] pgmap v3540: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:23.450 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:24.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:23 smithi163 bash[24253]: audit 2024-08-31T04:09:23.045961+0000 mgr.a (mgr.14388) 5109 : audit [DBG] from='client.120192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:23 smithi027 bash[22610]: audit 2024-08-31T04:09:23.045961+0000 mgr.a (mgr.14388) 5109 : audit [DBG] from='client.120192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:23 smithi191 bash[24992]: audit 2024-08-31T04:09:23.045961+0000 mgr.a (mgr.14388) 5109 : audit [DBG] from='client.120192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:25.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:24 smithi163 bash[24253]: cluster 2024-08-31T04:09:23.583135+0000 mgr.a (mgr.14388) 5110 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:25.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:24 smithi027 bash[22610]: cluster 2024-08-31T04:09:23.583135+0000 mgr.a (mgr.14388) 5110 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:24 smithi191 bash[24992]: cluster 2024-08-31T04:09:23.583135+0000 mgr.a (mgr.14388) 5110 : cluster [DBG] pgmap v3541: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:27.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:26 smithi163 bash[24253]: cluster 2024-08-31T04:09:25.583906+0000 mgr.a (mgr.14388) 5111 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:09:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:26 smithi027 bash[22610]: cluster 2024-08-31T04:09:25.583906+0000 mgr.a (mgr.14388) 5111 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:09:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:26 smithi191 bash[24992]: cluster 2024-08-31T04:09:25.583906+0000 mgr.a (mgr.14388) 5111 : cluster [DBG] pgmap v3542: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:09:28.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:09:28.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:09:28.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:29.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:28 smithi163 bash[24253]: cluster 2024-08-31T04:09:27.584875+0000 mgr.a (mgr.14388) 5112 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:09:29.199 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:29.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:29.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:29.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:29.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:28 smithi027 bash[22610]: cluster 2024-08-31T04:09:27.584875+0000 mgr.a (mgr.14388) 5112 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:09:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:28 smithi191 bash[24992]: cluster 2024-08-31T04:09:27.584875+0000 mgr.a (mgr.14388) 5112 : cluster [DBG] pgmap v3543: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:09:30.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:29 smithi163 bash[24253]: audit 2024-08-31T04:09:28.783154+0000 mgr.a (mgr.14388) 5113 : audit [DBG] from='client.120270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:29 smithi027 bash[22610]: audit 2024-08-31T04:09:28.783154+0000 mgr.a (mgr.14388) 5113 : audit [DBG] from='client.120270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:29 smithi191 bash[24992]: audit 2024-08-31T04:09:28.783154+0000 mgr.a (mgr.14388) 5113 : audit [DBG] from='client.120270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:31.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:30 smithi163 bash[24253]: cluster 2024-08-31T04:09:29.587537+0000 mgr.a (mgr.14388) 5114 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:30 smithi027 bash[22610]: cluster 2024-08-31T04:09:29.587537+0000 mgr.a (mgr.14388) 5114 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:30 smithi191 bash[24992]: cluster 2024-08-31T04:09:29.587537+0000 mgr.a (mgr.14388) 5114 : cluster [DBG] pgmap v3544: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:33.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:32 smithi163 bash[24253]: cluster 2024-08-31T04:09:31.588303+0000 mgr.a (mgr.14388) 5115 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:09:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:32 smithi027 bash[22610]: cluster 2024-08-31T04:09:31.588303+0000 mgr.a (mgr.14388) 5115 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:09:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:32 smithi191 bash[24992]: cluster 2024-08-31T04:09:31.588303+0000 mgr.a (mgr.14388) 5115 : cluster [DBG] pgmap v3545: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:09:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:09:34.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:09:34.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:34.943 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:34.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:34.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:34.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:34.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:35.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:34 smithi163 bash[24253]: cluster 2024-08-31T04:09:33.590215+0000 mgr.a (mgr.14388) 5116 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:34 smithi027 bash[22610]: cluster 2024-08-31T04:09:33.590215+0000 mgr.a (mgr.14388) 5116 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:34 smithi191 bash[24992]: cluster 2024-08-31T04:09:33.590215+0000 mgr.a (mgr.14388) 5116 : cluster [DBG] pgmap v3546: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:36.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:35 smithi163 bash[24253]: audit 2024-08-31T04:09:34.533357+0000 mgr.a (mgr.14388) 5117 : audit [DBG] from='client.120345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:35 smithi027 bash[22610]: audit 2024-08-31T04:09:34.533357+0000 mgr.a (mgr.14388) 5117 : audit [DBG] from='client.120345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:35 smithi191 bash[24992]: audit 2024-08-31T04:09:34.533357+0000 mgr.a (mgr.14388) 5117 : audit [DBG] from='client.120345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:37.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:36 smithi163 bash[24253]: cluster 2024-08-31T04:09:35.591101+0000 mgr.a (mgr.14388) 5118 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:37.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:36 smithi027 bash[22610]: cluster 2024-08-31T04:09:35.591101+0000 mgr.a (mgr.14388) 5118 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:36 smithi191 bash[24992]: cluster 2024-08-31T04:09:35.591101+0000 mgr.a (mgr.14388) 5118 : cluster [DBG] pgmap v3547: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:39.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:38 smithi163 bash[24253]: cluster 2024-08-31T04:09:37.591849+0000 mgr.a (mgr.14388) 5119 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:39.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:38 smithi163 bash[24253]: audit 2024-08-31T04:09:38.529537+0000 mon.a (mon.0) 1349 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:09:39.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:38 smithi027 bash[22610]: cluster 2024-08-31T04:09:37.591849+0000 mgr.a (mgr.14388) 5119 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:39.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:38 smithi027 bash[22610]: audit 2024-08-31T04:09:38.529537+0000 mon.a (mon.0) 1349 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:09:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:38 smithi191 bash[24992]: cluster 2024-08-31T04:09:37.591849+0000 mgr.a (mgr.14388) 5119 : cluster [DBG] pgmap v3548: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:38 smithi191 bash[24992]: audit 2024-08-31T04:09:38.529537+0000 mon.a (mon.0) 1349 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:09:39.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:09:39.944 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:09:39.944 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:40.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:39 smithi163 bash[24253]: audit 2024-08-31T04:09:39.373915+0000 mon.a (mon.0) 1350 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:09:40.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:39 smithi163 bash[24253]: audit 2024-08-31T04:09:39.375419+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:09:40.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:39 smithi163 bash[24253]: audit 2024-08-31T04:09:39.385165+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:09:40.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:39 smithi163 bash[24253]: audit 2024-08-31T04:09:39.390078+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:09:40.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:09:40 smithi027 bash[22863]: debug 2024-08-31T04:09:40.116+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:09:40.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:09:40 smithi027 bash[22863]: debug 2024-08-31T04:09:40.120+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:09:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:39 smithi027 bash[22610]: audit 2024-08-31T04:09:39.373915+0000 mon.a (mon.0) 1350 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:09:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:39 smithi027 bash[22610]: audit 2024-08-31T04:09:39.375419+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:09:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:39 smithi027 bash[22610]: audit 2024-08-31T04:09:39.385165+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:09:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:39 smithi027 bash[22610]: audit 2024-08-31T04:09:39.390078+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:09:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:39 smithi191 bash[24992]: audit 2024-08-31T04:09:39.373915+0000 mon.a (mon.0) 1350 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:09:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:39 smithi191 bash[24992]: audit 2024-08-31T04:09:39.375419+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:09:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:39 smithi191 bash[24992]: audit 2024-08-31T04:09:39.385165+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:09:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:39 smithi191 bash[24992]: audit 2024-08-31T04:09:39.390078+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:09:40.667 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:40.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:40.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:40.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:40.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:41.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:40 smithi163 bash[24253]: audit 2024-08-31T04:09:39.392432+0000 mgr.a (mgr.14388) 5120 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:09:41.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:40 smithi163 bash[24253]: cluster 2024-08-31T04:09:39.593094+0000 mgr.a (mgr.14388) 5121 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:41.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:40 smithi163 bash[24253]: audit 2024-08-31T04:09:40.122655+0000 mgr.a (mgr.14388) 5122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:09:41.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:40 smithi163 bash[24253]: cephadm 2024-08-31T04:09:40.124007+0000 mgr.a (mgr.14388) 5123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:09:41.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:40 smithi163 bash[24253]: audit 2024-08-31T04:09:40.260294+0000 mgr.a (mgr.14388) 5124 : audit [DBG] from='client.120528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:41.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:40 smithi027 bash[22610]: audit 2024-08-31T04:09:39.392432+0000 mgr.a (mgr.14388) 5120 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:09:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:40 smithi027 bash[22610]: cluster 2024-08-31T04:09:39.593094+0000 mgr.a (mgr.14388) 5121 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:40 smithi027 bash[22610]: audit 2024-08-31T04:09:40.122655+0000 mgr.a (mgr.14388) 5122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:09:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:40 smithi027 bash[22610]: cephadm 2024-08-31T04:09:40.124007+0000 mgr.a (mgr.14388) 5123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:09:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:40 smithi027 bash[22610]: audit 2024-08-31T04:09:40.260294+0000 mgr.a (mgr.14388) 5124 : audit [DBG] from='client.120528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:40 smithi191 bash[24992]: audit 2024-08-31T04:09:39.392432+0000 mgr.a (mgr.14388) 5120 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:09:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:40 smithi191 bash[24992]: cluster 2024-08-31T04:09:39.593094+0000 mgr.a (mgr.14388) 5121 : cluster [DBG] pgmap v3549: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:09:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:40 smithi191 bash[24992]: audit 2024-08-31T04:09:40.122655+0000 mgr.a (mgr.14388) 5122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:09:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:40 smithi191 bash[24992]: cephadm 2024-08-31T04:09:40.124007+0000 mgr.a (mgr.14388) 5123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:09:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:40 smithi191 bash[24992]: audit 2024-08-31T04:09:40.260294+0000 mgr.a (mgr.14388) 5124 : audit [DBG] from='client.120528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:43.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:42 smithi163 bash[24253]: cluster 2024-08-31T04:09:41.593909+0000 mgr.a (mgr.14388) 5125 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:42 smithi027 bash[22610]: cluster 2024-08-31T04:09:41.593909+0000 mgr.a (mgr.14388) 5125 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:42 smithi191 bash[24992]: cluster 2024-08-31T04:09:41.593909+0000 mgr.a (mgr.14388) 5125 : cluster [DBG] pgmap v3550: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:45.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:44 smithi163 bash[24253]: cluster 2024-08-31T04:09:43.596147+0000 mgr.a (mgr.14388) 5126 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:45.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:44 smithi027 bash[22610]: cluster 2024-08-31T04:09:43.596147+0000 mgr.a (mgr.14388) 5126 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:44 smithi191 bash[24992]: cluster 2024-08-31T04:09:43.596147+0000 mgr.a (mgr.14388) 5126 : cluster [DBG] pgmap v3551: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:45.668 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:09:45.669 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:09:45.669 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:46.438 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:46.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:46.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:46.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:46.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:47.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:46 smithi163 bash[24253]: cluster 2024-08-31T04:09:45.596915+0000 mgr.a (mgr.14388) 5127 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:47.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:46 smithi163 bash[24253]: audit 2024-08-31T04:09:46.005393+0000 mgr.a (mgr.14388) 5128 : audit [DBG] from='client.120606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:46 smithi027 bash[22610]: cluster 2024-08-31T04:09:45.596915+0000 mgr.a (mgr.14388) 5127 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:46 smithi027 bash[22610]: audit 2024-08-31T04:09:46.005393+0000 mgr.a (mgr.14388) 5128 : audit [DBG] from='client.120606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:46 smithi191 bash[24992]: cluster 2024-08-31T04:09:45.596915+0000 mgr.a (mgr.14388) 5127 : cluster [DBG] pgmap v3552: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:46 smithi191 bash[24992]: audit 2024-08-31T04:09:46.005393+0000 mgr.a (mgr.14388) 5128 : audit [DBG] from='client.120606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:49.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:48 smithi163 bash[24253]: cluster 2024-08-31T04:09:47.597843+0000 mgr.a (mgr.14388) 5129 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:48 smithi027 bash[22610]: cluster 2024-08-31T04:09:47.597843+0000 mgr.a (mgr.14388) 5129 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:48 smithi191 bash[24992]: cluster 2024-08-31T04:09:47.597843+0000 mgr.a (mgr.14388) 5129 : cluster [DBG] pgmap v3553: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:51.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:50 smithi163 bash[24253]: cluster 2024-08-31T04:09:49.600102+0000 mgr.a (mgr.14388) 5130 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:50 smithi027 bash[22610]: cluster 2024-08-31T04:09:49.600102+0000 mgr.a (mgr.14388) 5130 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:50 smithi191 bash[24992]: cluster 2024-08-31T04:09:49.600102+0000 mgr.a (mgr.14388) 5130 : cluster [DBG] pgmap v3554: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:51.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:09:51.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:09:51.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:52.223 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:52.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:53.189 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:52 smithi163 bash[24253]: cluster 2024-08-31T04:09:51.600583+0000 mgr.a (mgr.14388) 5131 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:53.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:52 smithi163 bash[24253]: audit 2024-08-31T04:09:51.773877+0000 mgr.a (mgr.14388) 5132 : audit [DBG] from='client.120684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:52 smithi027 bash[22610]: cluster 2024-08-31T04:09:51.600583+0000 mgr.a (mgr.14388) 5131 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:52 smithi027 bash[22610]: audit 2024-08-31T04:09:51.773877+0000 mgr.a (mgr.14388) 5132 : audit [DBG] from='client.120684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:52 smithi191 bash[24992]: cluster 2024-08-31T04:09:51.600583+0000 mgr.a (mgr.14388) 5131 : cluster [DBG] pgmap v3555: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:52 smithi191 bash[24992]: audit 2024-08-31T04:09:51.773877+0000 mgr.a (mgr.14388) 5132 : audit [DBG] from='client.120684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:54 smithi027 bash[22610]: cluster 2024-08-31T04:09:53.602814+0000 mgr.a (mgr.14388) 5133 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:54 smithi191 bash[24992]: cluster 2024-08-31T04:09:53.602814+0000 mgr.a (mgr.14388) 5133 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:55.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:54 smithi163 bash[24253]: cluster 2024-08-31T04:09:53.602814+0000 mgr.a (mgr.14388) 5133 : cluster [DBG] pgmap v3556: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:09:57.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:09:57.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:09:57.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:09:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:56 smithi027 bash[22610]: cluster 2024-08-31T04:09:55.603601+0000 mgr.a (mgr.14388) 5134 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:56 smithi191 bash[24992]: cluster 2024-08-31T04:09:55.603601+0000 mgr.a (mgr.14388) 5134 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:57.439 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:56 smithi163 bash[24253]: cluster 2024-08-31T04:09:55.603601+0000 mgr.a (mgr.14388) 5134 : cluster [DBG] pgmap v3557: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:58.000 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:09:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:09:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:09:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:09:58.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:09:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:58 smithi027 bash[22610]: audit 2024-08-31T04:09:57.567414+0000 mgr.a (mgr.14388) 5135 : audit [DBG] from='client.120759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:09:58 smithi027 bash[22610]: cluster 2024-08-31T04:09:57.604338+0000 mgr.a (mgr.14388) 5136 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:58 smithi191 bash[24992]: audit 2024-08-31T04:09:57.567414+0000 mgr.a (mgr.14388) 5135 : audit [DBG] from='client.120759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:09:58 smithi191 bash[24992]: cluster 2024-08-31T04:09:57.604338+0000 mgr.a (mgr.14388) 5136 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:09:59.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:58 smithi163 bash[24253]: audit 2024-08-31T04:09:57.567414+0000 mgr.a (mgr.14388) 5135 : audit [DBG] from='client.120759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:09:59.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:09:58 smithi163 bash[24253]: cluster 2024-08-31T04:09:57.604338+0000 mgr.a (mgr.14388) 5136 : cluster [DBG] pgmap v3558: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:00 smithi027 bash[22610]: cluster 2024-08-31T04:09:59.606633+0000 mgr.a (mgr.14388) 5137 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:10:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:00 smithi027 bash[22610]: cluster 2024-08-31T04:10:00.000149+0000 mon.a (mon.0) 1354 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:10:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:00 smithi191 bash[24992]: cluster 2024-08-31T04:09:59.606633+0000 mgr.a (mgr.14388) 5137 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:10:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:00 smithi191 bash[24992]: cluster 2024-08-31T04:10:00.000149+0000 mon.a (mon.0) 1354 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:10:01.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:00 smithi163 bash[24253]: cluster 2024-08-31T04:09:59.606633+0000 mgr.a (mgr.14388) 5137 : cluster [DBG] pgmap v3559: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:10:01.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:00 smithi163 bash[24253]: cluster 2024-08-31T04:10:00.000149+0000 mon.a (mon.0) 1354 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:10:03.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:10:03.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:10:03.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:10:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:02 smithi027 bash[22610]: cluster 2024-08-31T04:10:01.607435+0000 mgr.a (mgr.14388) 5138 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:10:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:02 smithi191 bash[24992]: cluster 2024-08-31T04:10:01.607435+0000 mgr.a (mgr.14388) 5138 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:10:03.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:02 smithi163 bash[24253]: cluster 2024-08-31T04:10:01.607435+0000 mgr.a (mgr.14388) 5138 : cluster [DBG] pgmap v3560: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:10:03.766 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:10:03.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:10:03.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:10:03.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:10:03.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:10:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:04 smithi027 bash[22610]: audit 2024-08-31T04:10:03.336863+0000 mgr.a (mgr.14388) 5139 : audit [DBG] from='client.120831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:04 smithi027 bash[22610]: cluster 2024-08-31T04:10:03.609783+0000 mgr.a (mgr.14388) 5140 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:04 smithi191 bash[24992]: audit 2024-08-31T04:10:03.336863+0000 mgr.a (mgr.14388) 5139 : audit [DBG] from='client.120831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:04 smithi191 bash[24992]: cluster 2024-08-31T04:10:03.609783+0000 mgr.a (mgr.14388) 5140 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:05.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:04 smithi163 bash[24253]: audit 2024-08-31T04:10:03.336863+0000 mgr.a (mgr.14388) 5139 : audit [DBG] from='client.120831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:05.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:04 smithi163 bash[24253]: cluster 2024-08-31T04:10:03.609783+0000 mgr.a (mgr.14388) 5140 : cluster [DBG] pgmap v3561: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:06 smithi027 bash[22610]: cluster 2024-08-31T04:10:05.610691+0000 mgr.a (mgr.14388) 5141 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:10:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:06 smithi191 bash[24992]: cluster 2024-08-31T04:10:05.610691+0000 mgr.a (mgr.14388) 5141 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:10:07.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:06 smithi163 bash[24253]: cluster 2024-08-31T04:10:05.610691+0000 mgr.a (mgr.14388) 5141 : cluster [DBG] pgmap v3562: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:10:08.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:10:08.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:10:08.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:10:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:08 smithi027 bash[22610]: cluster 2024-08-31T04:10:07.611491+0000 mgr.a (mgr.14388) 5142 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:10:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:08 smithi191 bash[24992]: cluster 2024-08-31T04:10:07.611491+0000 mgr.a (mgr.14388) 5142 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:10:09.439 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:08 smithi163 bash[24253]: cluster 2024-08-31T04:10:07.611491+0000 mgr.a (mgr.14388) 5142 : cluster [DBG] pgmap v3563: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:10:09.552 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:10:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:10:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:10:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:10:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:10:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:09 smithi027 bash[22610]: audit 2024-08-31T04:10:09.106096+0000 mgr.a (mgr.14388) 5143 : audit [DBG] from='client.120906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:09 smithi191 bash[24992]: audit 2024-08-31T04:10:09.106096+0000 mgr.a (mgr.14388) 5143 : audit [DBG] from='client.120906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:10.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:09 smithi163 bash[24253]: audit 2024-08-31T04:10:09.106096+0000 mgr.a (mgr.14388) 5143 : audit [DBG] from='client.120906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:10 smithi191 bash[24992]: cluster 2024-08-31T04:10:09.612950+0000 mgr.a (mgr.14388) 5144 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:11.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:10 smithi163 bash[24253]: cluster 2024-08-31T04:10:09.612950+0000 mgr.a (mgr.14388) 5144 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:10 smithi027 bash[22610]: cluster 2024-08-31T04:10:09.612950+0000 mgr.a (mgr.14388) 5144 : cluster [DBG] pgmap v3564: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:12 smithi191 bash[24992]: cluster 2024-08-31T04:10:11.613678+0000 mgr.a (mgr.14388) 5145 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:10:13.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:12 smithi163 bash[24253]: cluster 2024-08-31T04:10:11.613678+0000 mgr.a (mgr.14388) 5145 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:10:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:12 smithi027 bash[22610]: cluster 2024-08-31T04:10:11.613678+0000 mgr.a (mgr.14388) 5145 : cluster [DBG] pgmap v3565: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:10:14.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:10:14.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:10:14.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:10:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:14 smithi191 bash[24992]: cluster 2024-08-31T04:10:13.615646+0000 mgr.a (mgr.14388) 5146 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:10:15.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:10:15.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:10:15.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:10:15.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:10:15.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:10:15.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:15 smithi163 bash[24253]: cluster 2024-08-31T04:10:13.615646+0000 mgr.a (mgr.14388) 5146 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:10:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:14 smithi027 bash[22610]: cluster 2024-08-31T04:10:13.615646+0000 mgr.a (mgr.14388) 5146 : cluster [DBG] pgmap v3566: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:10:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:16 smithi191 bash[24992]: audit 2024-08-31T04:10:14.886915+0000 mgr.a (mgr.14388) 5147 : audit [DBG] from='client.120981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:16.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:16 smithi163 bash[24253]: audit 2024-08-31T04:10:14.886915+0000 mgr.a (mgr.14388) 5147 : audit [DBG] from='client.120981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:16 smithi027 bash[22610]: audit 2024-08-31T04:10:14.886915+0000 mgr.a (mgr.14388) 5147 : audit [DBG] from='client.120981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:17 smithi191 bash[24992]: cluster 2024-08-31T04:10:15.616620+0000 mgr.a (mgr.14388) 5148 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:17.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:17 smithi163 bash[24253]: cluster 2024-08-31T04:10:15.616620+0000 mgr.a (mgr.14388) 5148 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:17 smithi027 bash[22610]: cluster 2024-08-31T04:10:15.616620+0000 mgr.a (mgr.14388) 5148 : cluster [DBG] pgmap v3567: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:19 smithi191 bash[24992]: cluster 2024-08-31T04:10:17.617385+0000 mgr.a (mgr.14388) 5149 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:19.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:19 smithi163 bash[24253]: cluster 2024-08-31T04:10:17.617385+0000 mgr.a (mgr.14388) 5149 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:19 smithi027 bash[22610]: cluster 2024-08-31T04:10:17.617385+0000 mgr.a (mgr.14388) 5149 : cluster [DBG] pgmap v3568: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:20.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:10:20.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:10:20.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:10:21.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:10:21.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:10:21.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:10:21.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:10:21.049 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:10:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:21 smithi191 bash[24992]: cluster 2024-08-31T04:10:19.619644+0000 mgr.a (mgr.14388) 5150 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:21.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:21 smithi163 bash[24253]: cluster 2024-08-31T04:10:19.619644+0000 mgr.a (mgr.14388) 5150 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:21 smithi027 bash[22610]: cluster 2024-08-31T04:10:19.619644+0000 mgr.a (mgr.14388) 5150 : cluster [DBG] pgmap v3569: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:22 smithi191 bash[24992]: audit 2024-08-31T04:10:20.628388+0000 mgr.a (mgr.14388) 5151 : audit [DBG] from='client.121056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:22.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:22 smithi163 bash[24253]: audit 2024-08-31T04:10:20.628388+0000 mgr.a (mgr.14388) 5151 : audit [DBG] from='client.121056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:22 smithi027 bash[22610]: audit 2024-08-31T04:10:20.628388+0000 mgr.a (mgr.14388) 5151 : audit [DBG] from='client.121056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:23 smithi191 bash[24992]: cluster 2024-08-31T04:10:21.620804+0000 mgr.a (mgr.14388) 5152 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:23.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:23 smithi163 bash[24253]: cluster 2024-08-31T04:10:21.620804+0000 mgr.a (mgr.14388) 5152 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:23 smithi027 bash[22610]: cluster 2024-08-31T04:10:21.620804+0000 mgr.a (mgr.14388) 5152 : cluster [DBG] pgmap v3570: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:25 smithi191 bash[24992]: cluster 2024-08-31T04:10:23.623087+0000 mgr.a (mgr.14388) 5153 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:25.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:25 smithi163 bash[24253]: cluster 2024-08-31T04:10:23.623087+0000 mgr.a (mgr.14388) 5153 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:25 smithi027 bash[22610]: cluster 2024-08-31T04:10:23.623087+0000 mgr.a (mgr.14388) 5153 : cluster [DBG] pgmap v3571: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:26.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:10:26.050 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:10:26.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:10:26.818 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:10:26.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:10:26.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:10:26.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:10:26.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:10:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:27 smithi191 bash[24992]: cluster 2024-08-31T04:10:25.623836+0000 mgr.a (mgr.14388) 5154 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:27.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:27 smithi163 bash[24253]: cluster 2024-08-31T04:10:25.623836+0000 mgr.a (mgr.14388) 5154 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:27 smithi027 bash[22610]: cluster 2024-08-31T04:10:25.623836+0000 mgr.a (mgr.14388) 5154 : cluster [DBG] pgmap v3572: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:28.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:28 smithi163 bash[24253]: audit 2024-08-31T04:10:26.395427+0000 mgr.a (mgr.14388) 5155 : audit [DBG] from='client.121134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:28 smithi027 bash[22610]: audit 2024-08-31T04:10:26.395427+0000 mgr.a (mgr.14388) 5155 : audit [DBG] from='client.121134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:28 smithi191 bash[24992]: audit 2024-08-31T04:10:26.395427+0000 mgr.a (mgr.14388) 5155 : audit [DBG] from='client.121134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:29.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:29 smithi163 bash[24253]: cluster 2024-08-31T04:10:27.624795+0000 mgr.a (mgr.14388) 5156 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:29 smithi027 bash[22610]: cluster 2024-08-31T04:10:27.624795+0000 mgr.a (mgr.14388) 5156 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:29 smithi191 bash[24992]: cluster 2024-08-31T04:10:27.624795+0000 mgr.a (mgr.14388) 5156 : cluster [DBG] pgmap v3573: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:31.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:31 smithi163 bash[24253]: cluster 2024-08-31T04:10:29.627054+0000 mgr.a (mgr.14388) 5157 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:31 smithi027 bash[22610]: cluster 2024-08-31T04:10:29.627054+0000 mgr.a (mgr.14388) 5157 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:31 smithi191 bash[24992]: cluster 2024-08-31T04:10:29.627054+0000 mgr.a (mgr.14388) 5157 : cluster [DBG] pgmap v3574: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:31.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:10:31.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:10:31.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:10:32.559 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:10:32.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:10:32.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:10:32.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:10:32.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:10:33.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:33 smithi163 bash[24253]: cluster 2024-08-31T04:10:31.627816+0000 mgr.a (mgr.14388) 5158 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:33.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:33 smithi163 bash[24253]: audit 2024-08-31T04:10:32.145214+0000 mgr.a (mgr.14388) 5159 : audit [DBG] from='client.121209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:33 smithi027 bash[22610]: cluster 2024-08-31T04:10:31.627816+0000 mgr.a (mgr.14388) 5158 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:33 smithi027 bash[22610]: audit 2024-08-31T04:10:32.145214+0000 mgr.a (mgr.14388) 5159 : audit [DBG] from='client.121209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:33 smithi191 bash[24992]: cluster 2024-08-31T04:10:31.627816+0000 mgr.a (mgr.14388) 5158 : cluster [DBG] pgmap v3575: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:33 smithi191 bash[24992]: audit 2024-08-31T04:10:32.145214+0000 mgr.a (mgr.14388) 5159 : audit [DBG] from='client.121209 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:35.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:35 smithi163 bash[24253]: cluster 2024-08-31T04:10:33.630143+0000 mgr.a (mgr.14388) 5160 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:35 smithi027 bash[22610]: cluster 2024-08-31T04:10:33.630143+0000 mgr.a (mgr.14388) 5160 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:35 smithi191 bash[24992]: cluster 2024-08-31T04:10:33.630143+0000 mgr.a (mgr.14388) 5160 : cluster [DBG] pgmap v3576: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:10:37.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:37 smithi163 bash[24253]: cluster 2024-08-31T04:10:35.630947+0000 mgr.a (mgr.14388) 5161 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:37 smithi027 bash[22610]: cluster 2024-08-31T04:10:35.630947+0000 mgr.a (mgr.14388) 5161 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:37 smithi191 bash[24992]: cluster 2024-08-31T04:10:35.630947+0000 mgr.a (mgr.14388) 5161 : cluster [DBG] pgmap v3577: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:37.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:10:37.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:10:37.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:10:38.311 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:10:38.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:10:38.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:10:38.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:10:38.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:10:39.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:39 smithi163 bash[24253]: cluster 2024-08-31T04:10:37.631663+0000 mgr.a (mgr.14388) 5162 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:39.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:39 smithi163 bash[24253]: audit 2024-08-31T04:10:37.896078+0000 mgr.a (mgr.14388) 5163 : audit [DBG] from='client.121287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:39 smithi027 bash[22610]: cluster 2024-08-31T04:10:37.631663+0000 mgr.a (mgr.14388) 5162 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:39 smithi027 bash[22610]: audit 2024-08-31T04:10:37.896078+0000 mgr.a (mgr.14388) 5163 : audit [DBG] from='client.121287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:39 smithi191 bash[24992]: cluster 2024-08-31T04:10:37.631663+0000 mgr.a (mgr.14388) 5162 : cluster [DBG] pgmap v3578: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:39 smithi191 bash[24992]: audit 2024-08-31T04:10:37.896078+0000 mgr.a (mgr.14388) 5163 : audit [DBG] from='client.121287 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:41.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:41 smithi163 bash[24253]: cluster 2024-08-31T04:10:39.634420+0000 mgr.a (mgr.14388) 5164 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:41.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:41 smithi163 bash[24253]: audit 2024-08-31T04:10:40.172946+0000 mon.a (mon.0) 1355 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:10:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:41 smithi027 bash[22610]: cluster 2024-08-31T04:10:39.634420+0000 mgr.a (mgr.14388) 5164 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:41 smithi027 bash[22610]: audit 2024-08-31T04:10:40.172946+0000 mon.a (mon.0) 1355 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:10:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:41 smithi191 bash[24992]: cluster 2024-08-31T04:10:39.634420+0000 mgr.a (mgr.14388) 5164 : cluster [DBG] pgmap v3579: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:41 smithi191 bash[24992]: audit 2024-08-31T04:10:40.172946+0000 mon.a (mon.0) 1355 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:10:43.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:10:43.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:10:43.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:10:43.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:43 smithi163 bash[24253]: cluster 2024-08-31T04:10:41.635201+0000 mgr.a (mgr.14388) 5165 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:10:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:43 smithi027 bash[22610]: cluster 2024-08-31T04:10:41.635201+0000 mgr.a (mgr.14388) 5165 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:10:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:43 smithi191 bash[24992]: cluster 2024-08-31T04:10:41.635201+0000 mgr.a (mgr.14388) 5165 : cluster [DBG] pgmap v3580: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:10:44.052 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:10:44.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:10:44.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:10:44.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:10:44.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:10:45.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:45 smithi163 bash[24253]: cluster 2024-08-31T04:10:43.637068+0000 mgr.a (mgr.14388) 5166 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:45.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:45 smithi163 bash[24253]: audit 2024-08-31T04:10:43.642148+0000 mgr.a (mgr.14388) 5167 : audit [DBG] from='client.121365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:45 smithi027 bash[22610]: cluster 2024-08-31T04:10:43.637068+0000 mgr.a (mgr.14388) 5166 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:45 smithi027 bash[22610]: audit 2024-08-31T04:10:43.642148+0000 mgr.a (mgr.14388) 5167 : audit [DBG] from='client.121365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:45 smithi191 bash[24992]: cluster 2024-08-31T04:10:43.637068+0000 mgr.a (mgr.14388) 5166 : cluster [DBG] pgmap v3581: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:45 smithi191 bash[24992]: audit 2024-08-31T04:10:43.642148+0000 mgr.a (mgr.14388) 5167 : audit [DBG] from='client.121365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:47.370 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:47 smithi027 bash[22610]: cluster 2024-08-31T04:10:45.638023+0000 mgr.a (mgr.14388) 5168 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:10:47.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:47 smithi163 bash[24253]: cluster 2024-08-31T04:10:45.638023+0000 mgr.a (mgr.14388) 5168 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:10:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:47 smithi191 bash[24992]: cluster 2024-08-31T04:10:45.638023+0000 mgr.a (mgr.14388) 5168 : cluster [DBG] pgmap v3582: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:10:49.054 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:10:49.055 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:10:49.055 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:10:49.350 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:49 smithi027 bash[22610]: cluster 2024-08-31T04:10:47.638889+0000 mgr.a (mgr.14388) 5169 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:10:49.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:49 smithi163 bash[24253]: cluster 2024-08-31T04:10:47.638889+0000 mgr.a (mgr.14388) 5169 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:10:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:49 smithi191 bash[24992]: cluster 2024-08-31T04:10:47.638889+0000 mgr.a (mgr.14388) 5169 : cluster [DBG] pgmap v3583: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:10:49.797 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:10:49.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:10:49.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:10:49.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:10:49.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:10:51.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:51 smithi163 bash[24253]: audit 2024-08-31T04:10:49.395129+0000 mgr.a (mgr.14388) 5170 : audit [DBG] from='client.121443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:51.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:51 smithi163 bash[24253]: cluster 2024-08-31T04:10:49.640195+0000 mgr.a (mgr.14388) 5171 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:51.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:51 smithi163 bash[24253]: audit 2024-08-31T04:10:50.955640+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:10:51.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:51 smithi163 bash[24253]: audit 2024-08-31T04:10:50.963758+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:10:51.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:51 smithi163 bash[24253]: audit 2024-08-31T04:10:50.965944+0000 mon.a (mon.0) 1358 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:10:51.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:51 smithi163 bash[24253]: audit 2024-08-31T04:10:50.968002+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:10:51.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:51 smithi163 bash[24253]: audit 2024-08-31T04:10:50.979149+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:10:51.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:51 smithi163 bash[24253]: audit 2024-08-31T04:10:50.983698+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:10:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:51 smithi027 bash[22610]: audit 2024-08-31T04:10:49.395129+0000 mgr.a (mgr.14388) 5170 : audit [DBG] from='client.121443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:51 smithi027 bash[22610]: cluster 2024-08-31T04:10:49.640195+0000 mgr.a (mgr.14388) 5171 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:51 smithi027 bash[22610]: audit 2024-08-31T04:10:50.955640+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:10:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:51 smithi027 bash[22610]: audit 2024-08-31T04:10:50.963758+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:10:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:51 smithi027 bash[22610]: audit 2024-08-31T04:10:50.965944+0000 mon.a (mon.0) 1358 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:10:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:51 smithi027 bash[22610]: audit 2024-08-31T04:10:50.968002+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:10:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:51 smithi027 bash[22610]: audit 2024-08-31T04:10:50.979149+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:10:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:51 smithi027 bash[22610]: audit 2024-08-31T04:10:50.983698+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:10:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:51 smithi191 bash[24992]: audit 2024-08-31T04:10:49.395129+0000 mgr.a (mgr.14388) 5170 : audit [DBG] from='client.121443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:51 smithi191 bash[24992]: cluster 2024-08-31T04:10:49.640195+0000 mgr.a (mgr.14388) 5171 : cluster [DBG] pgmap v3584: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:51 smithi191 bash[24992]: audit 2024-08-31T04:10:50.955640+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:10:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:51 smithi191 bash[24992]: audit 2024-08-31T04:10:50.963758+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:10:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:51 smithi191 bash[24992]: audit 2024-08-31T04:10:50.965944+0000 mon.a (mon.0) 1358 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:10:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:51 smithi191 bash[24992]: audit 2024-08-31T04:10:50.968002+0000 mon.a (mon.0) 1359 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:10:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:51 smithi191 bash[24992]: audit 2024-08-31T04:10:50.979149+0000 mon.a (mon.0) 1360 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:10:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:51 smithi191 bash[24992]: audit 2024-08-31T04:10:50.983698+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:10:52.096 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:10:51 smithi027 bash[22863]: debug 2024-08-31T04:10:51.738+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:10:52.096 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:10:51 smithi027 bash[22863]: debug 2024-08-31T04:10:51.738+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:10:52.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:52 smithi163 bash[24253]: audit 2024-08-31T04:10:50.986209+0000 mgr.a (mgr.14388) 5172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:10:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:52 smithi027 bash[22610]: audit 2024-08-31T04:10:50.986209+0000 mgr.a (mgr.14388) 5172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:10:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:52 smithi191 bash[24992]: audit 2024-08-31T04:10:50.986209+0000 mgr.a (mgr.14388) 5172 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:10:53.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:53 smithi163 bash[24253]: cluster 2024-08-31T04:10:51.640646+0000 mgr.a (mgr.14388) 5173 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:53.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:53 smithi163 bash[24253]: audit 2024-08-31T04:10:51.738925+0000 mgr.a (mgr.14388) 5174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:10:53.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:53 smithi163 bash[24253]: cephadm 2024-08-31T04:10:51.740379+0000 mgr.a (mgr.14388) 5175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:10:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:53 smithi027 bash[22610]: cluster 2024-08-31T04:10:51.640646+0000 mgr.a (mgr.14388) 5173 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:53 smithi027 bash[22610]: audit 2024-08-31T04:10:51.738925+0000 mgr.a (mgr.14388) 5174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:10:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:53 smithi027 bash[22610]: cephadm 2024-08-31T04:10:51.740379+0000 mgr.a (mgr.14388) 5175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:10:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:53 smithi191 bash[24992]: cluster 2024-08-31T04:10:51.640646+0000 mgr.a (mgr.14388) 5173 : cluster [DBG] pgmap v3585: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:10:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:53 smithi191 bash[24992]: audit 2024-08-31T04:10:51.738925+0000 mgr.a (mgr.14388) 5174 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:10:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:53 smithi191 bash[24992]: cephadm 2024-08-31T04:10:51.740379+0000 mgr.a (mgr.14388) 5175 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:10:54.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:10:54.799 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:10:54.799 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:10:55.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:55 smithi163 bash[24253]: cluster 2024-08-31T04:10:53.642827+0000 mgr.a (mgr.14388) 5176 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:10:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:55 smithi027 bash[22610]: cluster 2024-08-31T04:10:53.642827+0000 mgr.a (mgr.14388) 5176 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:10:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:55 smithi191 bash[24992]: cluster 2024-08-31T04:10:53.642827+0000 mgr.a (mgr.14388) 5176 : cluster [DBG] pgmap v3586: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:10:55.559 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:10:55.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:10:55.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:10:55.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:10:55.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:10:56.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:56 smithi163 bash[24253]: audit 2024-08-31T04:10:55.133184+0000 mgr.a (mgr.14388) 5177 : audit [DBG] from='client.121629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:56 smithi027 bash[22610]: audit 2024-08-31T04:10:55.133184+0000 mgr.a (mgr.14388) 5177 : audit [DBG] from='client.121629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:56 smithi191 bash[24992]: audit 2024-08-31T04:10:55.133184+0000 mgr.a (mgr.14388) 5177 : audit [DBG] from='client.121629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:10:57.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:57 smithi163 bash[24253]: cluster 2024-08-31T04:10:55.643725+0000 mgr.a (mgr.14388) 5178 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:10:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:57 smithi027 bash[22610]: cluster 2024-08-31T04:10:55.643725+0000 mgr.a (mgr.14388) 5178 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:10:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:57 smithi191 bash[24992]: cluster 2024-08-31T04:10:55.643725+0000 mgr.a (mgr.14388) 5178 : cluster [DBG] pgmap v3587: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:10:59.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:10:59 smithi163 bash[24253]: cluster 2024-08-31T04:10:57.644534+0000 mgr.a (mgr.14388) 5179 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:10:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:10:59 smithi027 bash[22610]: cluster 2024-08-31T04:10:57.644534+0000 mgr.a (mgr.14388) 5179 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:10:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:10:59 smithi191 bash[24992]: cluster 2024-08-31T04:10:57.644534+0000 mgr.a (mgr.14388) 5179 : cluster [DBG] pgmap v3588: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:11:00.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:00.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:00.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:01.341 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:01.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:01.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:01.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:01.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:01.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:01 smithi163 bash[24253]: cluster 2024-08-31T04:10:59.646743+0000 mgr.a (mgr.14388) 5180 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:11:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:01 smithi027 bash[22610]: cluster 2024-08-31T04:10:59.646743+0000 mgr.a (mgr.14388) 5180 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:11:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:01 smithi191 bash[24992]: cluster 2024-08-31T04:10:59.646743+0000 mgr.a (mgr.14388) 5180 : cluster [DBG] pgmap v3589: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:11:02.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:02 smithi163 bash[24253]: audit 2024-08-31T04:11:00.898283+0000 mgr.a (mgr.14388) 5181 : audit [DBG] from='client.121704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:02 smithi027 bash[22610]: audit 2024-08-31T04:11:00.898283+0000 mgr.a (mgr.14388) 5181 : audit [DBG] from='client.121704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:02 smithi191 bash[24992]: audit 2024-08-31T04:11:00.898283+0000 mgr.a (mgr.14388) 5181 : audit [DBG] from='client.121704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:03.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:03 smithi163 bash[24253]: cluster 2024-08-31T04:11:01.647680+0000 mgr.a (mgr.14388) 5182 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:11:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:03 smithi027 bash[22610]: cluster 2024-08-31T04:11:01.647680+0000 mgr.a (mgr.14388) 5182 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:11:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:03 smithi191 bash[24992]: cluster 2024-08-31T04:11:01.647680+0000 mgr.a (mgr.14388) 5182 : cluster [DBG] pgmap v3590: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:11:05.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:05 smithi163 bash[24253]: cluster 2024-08-31T04:11:03.649893+0000 mgr.a (mgr.14388) 5183 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:11:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:05 smithi027 bash[22610]: cluster 2024-08-31T04:11:03.649893+0000 mgr.a (mgr.14388) 5183 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:11:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:05 smithi191 bash[24992]: cluster 2024-08-31T04:11:03.649893+0000 mgr.a (mgr.14388) 5183 : cluster [DBG] pgmap v3591: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:11:06.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:06.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:06.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:07.130 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:07.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:07.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:07.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:07.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:07.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:07 smithi163 bash[24253]: cluster 2024-08-31T04:11:05.650677+0000 mgr.a (mgr.14388) 5184 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:07 smithi027 bash[22610]: cluster 2024-08-31T04:11:05.650677+0000 mgr.a (mgr.14388) 5184 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:07 smithi191 bash[24992]: cluster 2024-08-31T04:11:05.650677+0000 mgr.a (mgr.14388) 5184 : cluster [DBG] pgmap v3592: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:08.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:08 smithi163 bash[24253]: audit 2024-08-31T04:11:06.686475+0000 mgr.a (mgr.14388) 5185 : audit [DBG] from='client.121782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:08 smithi027 bash[22610]: audit 2024-08-31T04:11:06.686475+0000 mgr.a (mgr.14388) 5185 : audit [DBG] from='client.121782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:08 smithi191 bash[24992]: audit 2024-08-31T04:11:06.686475+0000 mgr.a (mgr.14388) 5185 : audit [DBG] from='client.121782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:09.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:09 smithi163 bash[24253]: cluster 2024-08-31T04:11:07.651657+0000 mgr.a (mgr.14388) 5186 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:09 smithi027 bash[22610]: cluster 2024-08-31T04:11:07.651657+0000 mgr.a (mgr.14388) 5186 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:09 smithi191 bash[24992]: cluster 2024-08-31T04:11:07.651657+0000 mgr.a (mgr.14388) 5186 : cluster [DBG] pgmap v3593: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:11.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:11 smithi163 bash[24253]: cluster 2024-08-31T04:11:09.653941+0000 mgr.a (mgr.14388) 5187 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:11 smithi027 bash[22610]: cluster 2024-08-31T04:11:09.653941+0000 mgr.a (mgr.14388) 5187 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:11 smithi191 bash[24992]: cluster 2024-08-31T04:11:09.653941+0000 mgr.a (mgr.14388) 5187 : cluster [DBG] pgmap v3594: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:12.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:12.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:12.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:12.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:12.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:12.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:12.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:12.881 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:13.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:13 smithi163 bash[24253]: cluster 2024-08-31T04:11:11.654783+0000 mgr.a (mgr.14388) 5188 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:13 smithi027 bash[22610]: cluster 2024-08-31T04:11:11.654783+0000 mgr.a (mgr.14388) 5188 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:13 smithi191 bash[24992]: cluster 2024-08-31T04:11:11.654783+0000 mgr.a (mgr.14388) 5188 : cluster [DBG] pgmap v3595: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:14.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:14 smithi163 bash[24253]: audit 2024-08-31T04:11:12.466960+0000 mgr.a (mgr.14388) 5189 : audit [DBG] from='client.121857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:14 smithi027 bash[22610]: audit 2024-08-31T04:11:12.466960+0000 mgr.a (mgr.14388) 5189 : audit [DBG] from='client.121857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:14 smithi191 bash[24992]: audit 2024-08-31T04:11:12.466960+0000 mgr.a (mgr.14388) 5189 : audit [DBG] from='client.121857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:15.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:15 smithi163 bash[24253]: cluster 2024-08-31T04:11:13.657141+0000 mgr.a (mgr.14388) 5190 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:15 smithi027 bash[22610]: cluster 2024-08-31T04:11:13.657141+0000 mgr.a (mgr.14388) 5190 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:15 smithi191 bash[24992]: cluster 2024-08-31T04:11:13.657141+0000 mgr.a (mgr.14388) 5190 : cluster [DBG] pgmap v3596: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:17.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:17 smithi163 bash[24253]: cluster 2024-08-31T04:11:15.657921+0000 mgr.a (mgr.14388) 5191 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:17 smithi027 bash[22610]: cluster 2024-08-31T04:11:15.657921+0000 mgr.a (mgr.14388) 5191 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:17 smithi191 bash[24992]: cluster 2024-08-31T04:11:15.657921+0000 mgr.a (mgr.14388) 5191 : cluster [DBG] pgmap v3597: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:17.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:17.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:17.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:18.622 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:18.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:18.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:18.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:18.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:19.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:19 smithi163 bash[24253]: cluster 2024-08-31T04:11:17.658692+0000 mgr.a (mgr.14388) 5192 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:19.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:19 smithi163 bash[24253]: audit 2024-08-31T04:11:18.209975+0000 mgr.a (mgr.14388) 5193 : audit [DBG] from='client.121935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:19 smithi027 bash[22610]: cluster 2024-08-31T04:11:17.658692+0000 mgr.a (mgr.14388) 5192 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:19 smithi027 bash[22610]: audit 2024-08-31T04:11:18.209975+0000 mgr.a (mgr.14388) 5193 : audit [DBG] from='client.121935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:19 smithi191 bash[24992]: cluster 2024-08-31T04:11:17.658692+0000 mgr.a (mgr.14388) 5192 : cluster [DBG] pgmap v3598: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:19 smithi191 bash[24992]: audit 2024-08-31T04:11:18.209975+0000 mgr.a (mgr.14388) 5193 : audit [DBG] from='client.121935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:21 smithi027 bash[22610]: cluster 2024-08-31T04:11:19.661633+0000 mgr.a (mgr.14388) 5194 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:21 smithi191 bash[24992]: cluster 2024-08-31T04:11:19.661633+0000 mgr.a (mgr.14388) 5194 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:21.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:21 smithi163 bash[24253]: cluster 2024-08-31T04:11:19.661633+0000 mgr.a (mgr.14388) 5194 : cluster [DBG] pgmap v3599: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:23 smithi027 bash[22610]: cluster 2024-08-31T04:11:21.662477+0000 mgr.a (mgr.14388) 5195 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:11:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:23 smithi191 bash[24992]: cluster 2024-08-31T04:11:21.662477+0000 mgr.a (mgr.14388) 5195 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:11:23.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:23.625 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:23.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:23 smithi163 bash[24253]: cluster 2024-08-31T04:11:21.662477+0000 mgr.a (mgr.14388) 5195 : cluster [DBG] pgmap v3600: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:11:24.359 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:24.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:24.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:24.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:24.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:25 smithi027 bash[22610]: cluster 2024-08-31T04:11:23.664471+0000 mgr.a (mgr.14388) 5196 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:25 smithi027 bash[22610]: audit 2024-08-31T04:11:23.956146+0000 mgr.a (mgr.14388) 5197 : audit [DBG] from='client.122010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:25 smithi191 bash[24992]: cluster 2024-08-31T04:11:23.664471+0000 mgr.a (mgr.14388) 5196 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:25 smithi191 bash[24992]: audit 2024-08-31T04:11:23.956146+0000 mgr.a (mgr.14388) 5197 : audit [DBG] from='client.122010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:25.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:25 smithi163 bash[24253]: cluster 2024-08-31T04:11:23.664471+0000 mgr.a (mgr.14388) 5196 : cluster [DBG] pgmap v3601: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:25.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:25 smithi163 bash[24253]: audit 2024-08-31T04:11:23.956146+0000 mgr.a (mgr.14388) 5197 : audit [DBG] from='client.122010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:27 smithi027 bash[22610]: cluster 2024-08-31T04:11:25.665357+0000 mgr.a (mgr.14388) 5198 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:11:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:27 smithi191 bash[24992]: cluster 2024-08-31T04:11:25.665357+0000 mgr.a (mgr.14388) 5198 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:11:27.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:27 smithi163 bash[24253]: cluster 2024-08-31T04:11:25.665357+0000 mgr.a (mgr.14388) 5198 : cluster [DBG] pgmap v3602: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:11:29.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:29.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:29.362 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:29 smithi027 bash[22610]: cluster 2024-08-31T04:11:27.666180+0000 mgr.a (mgr.14388) 5199 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:11:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:29 smithi191 bash[24992]: cluster 2024-08-31T04:11:27.666180+0000 mgr.a (mgr.14388) 5199 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:11:29.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:29 smithi163 bash[24253]: cluster 2024-08-31T04:11:27.666180+0000 mgr.a (mgr.14388) 5199 : cluster [DBG] pgmap v3603: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:11:30.104 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:30.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:30.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:30.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:30.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:31 smithi027 bash[22610]: cluster 2024-08-31T04:11:29.668333+0000 mgr.a (mgr.14388) 5200 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:31 smithi027 bash[22610]: audit 2024-08-31T04:11:29.694706+0000 mgr.a (mgr.14388) 5201 : audit [DBG] from='client.122088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:31 smithi191 bash[24992]: cluster 2024-08-31T04:11:29.668333+0000 mgr.a (mgr.14388) 5200 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:31 smithi191 bash[24992]: audit 2024-08-31T04:11:29.694706+0000 mgr.a (mgr.14388) 5201 : audit [DBG] from='client.122088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:31.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:31 smithi163 bash[24253]: cluster 2024-08-31T04:11:29.668333+0000 mgr.a (mgr.14388) 5200 : cluster [DBG] pgmap v3604: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:31.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:31 smithi163 bash[24253]: audit 2024-08-31T04:11:29.694706+0000 mgr.a (mgr.14388) 5201 : audit [DBG] from='client.122088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:33 smithi027 bash[22610]: cluster 2024-08-31T04:11:31.669259+0000 mgr.a (mgr.14388) 5202 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:33 smithi191 bash[24992]: cluster 2024-08-31T04:11:31.669259+0000 mgr.a (mgr.14388) 5202 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:33.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:33 smithi163 bash[24253]: cluster 2024-08-31T04:11:31.669259+0000 mgr.a (mgr.14388) 5202 : cluster [DBG] pgmap v3605: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:35.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:35.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:35 smithi027 bash[22610]: cluster 2024-08-31T04:11:33.671498+0000 mgr.a (mgr.14388) 5203 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:35 smithi191 bash[24992]: cluster 2024-08-31T04:11:33.671498+0000 mgr.a (mgr.14388) 5203 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:35.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:35 smithi163 bash[24253]: cluster 2024-08-31T04:11:33.671498+0000 mgr.a (mgr.14388) 5203 : cluster [DBG] pgmap v3606: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:35.851 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:35.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:35.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:37 smithi027 bash[22610]: audit 2024-08-31T04:11:35.437631+0000 mgr.a (mgr.14388) 5204 : audit [DBG] from='client.122166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:37 smithi027 bash[22610]: cluster 2024-08-31T04:11:35.672044+0000 mgr.a (mgr.14388) 5205 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:37 smithi191 bash[24992]: audit 2024-08-31T04:11:35.437631+0000 mgr.a (mgr.14388) 5204 : audit [DBG] from='client.122166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:37 smithi191 bash[24992]: cluster 2024-08-31T04:11:35.672044+0000 mgr.a (mgr.14388) 5205 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:37.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:37 smithi163 bash[24253]: audit 2024-08-31T04:11:35.437631+0000 mgr.a (mgr.14388) 5204 : audit [DBG] from='client.122166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:37.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:37 smithi163 bash[24253]: cluster 2024-08-31T04:11:35.672044+0000 mgr.a (mgr.14388) 5205 : cluster [DBG] pgmap v3607: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:39 smithi027 bash[22610]: cluster 2024-08-31T04:11:37.672901+0000 mgr.a (mgr.14388) 5206 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:39 smithi191 bash[24992]: cluster 2024-08-31T04:11:37.672901+0000 mgr.a (mgr.14388) 5206 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:39.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:39 smithi163 bash[24253]: cluster 2024-08-31T04:11:37.672901+0000 mgr.a (mgr.14388) 5206 : cluster [DBG] pgmap v3608: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:40.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:40.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:40.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:41 smithi191 bash[24992]: cluster 2024-08-31T04:11:39.675208+0000 mgr.a (mgr.14388) 5207 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:41.625 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:41.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:41.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:41.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:41.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:41.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:41 smithi163 bash[24253]: cluster 2024-08-31T04:11:39.675208+0000 mgr.a (mgr.14388) 5207 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:41 smithi027 bash[22610]: cluster 2024-08-31T04:11:39.675208+0000 mgr.a (mgr.14388) 5207 : cluster [DBG] pgmap v3609: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:42 smithi191 bash[24992]: audit 2024-08-31T04:11:41.188913+0000 mgr.a (mgr.14388) 5208 : audit [DBG] from='client.122244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:42.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:42 smithi163 bash[24253]: audit 2024-08-31T04:11:41.188913+0000 mgr.a (mgr.14388) 5208 : audit [DBG] from='client.122244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:42 smithi027 bash[22610]: audit 2024-08-31T04:11:41.188913+0000 mgr.a (mgr.14388) 5208 : audit [DBG] from='client.122244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:43 smithi191 bash[24992]: cluster 2024-08-31T04:11:41.675872+0000 mgr.a (mgr.14388) 5209 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:43.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:43 smithi163 bash[24253]: cluster 2024-08-31T04:11:41.675872+0000 mgr.a (mgr.14388) 5209 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:43 smithi027 bash[22610]: cluster 2024-08-31T04:11:41.675872+0000 mgr.a (mgr.14388) 5209 : cluster [DBG] pgmap v3610: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:45 smithi191 bash[24992]: cluster 2024-08-31T04:11:43.678111+0000 mgr.a (mgr.14388) 5210 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:45.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:45 smithi163 bash[24253]: cluster 2024-08-31T04:11:43.678111+0000 mgr.a (mgr.14388) 5210 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:45 smithi027 bash[22610]: cluster 2024-08-31T04:11:43.678111+0000 mgr.a (mgr.14388) 5210 : cluster [DBG] pgmap v3611: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:46.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:46.627 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:46.627 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:47.414 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:47.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:47.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:47.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:47.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:47 smithi191 bash[24992]: cluster 2024-08-31T04:11:45.678962+0000 mgr.a (mgr.14388) 5211 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:47.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:47 smithi163 bash[24253]: cluster 2024-08-31T04:11:45.678962+0000 mgr.a (mgr.14388) 5211 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:47 smithi027 bash[22610]: cluster 2024-08-31T04:11:45.678962+0000 mgr.a (mgr.14388) 5211 : cluster [DBG] pgmap v3612: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:48 smithi191 bash[24992]: audit 2024-08-31T04:11:46.965418+0000 mgr.a (mgr.14388) 5212 : audit [DBG] from='client.122322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:48.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:48 smithi163 bash[24253]: audit 2024-08-31T04:11:46.965418+0000 mgr.a (mgr.14388) 5212 : audit [DBG] from='client.122322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:48 smithi027 bash[22610]: audit 2024-08-31T04:11:46.965418+0000 mgr.a (mgr.14388) 5212 : audit [DBG] from='client.122322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:49 smithi191 bash[24992]: cluster 2024-08-31T04:11:47.679991+0000 mgr.a (mgr.14388) 5213 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:49.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:49 smithi163 bash[24253]: cluster 2024-08-31T04:11:47.679991+0000 mgr.a (mgr.14388) 5213 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:49 smithi027 bash[22610]: cluster 2024-08-31T04:11:47.679991+0000 mgr.a (mgr.14388) 5213 : cluster [DBG] pgmap v3613: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:51 smithi191 bash[24992]: cluster 2024-08-31T04:11:49.682239+0000 mgr.a (mgr.14388) 5214 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:51.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:51 smithi163 bash[24253]: cluster 2024-08-31T04:11:49.682239+0000 mgr.a (mgr.14388) 5214 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:51 smithi027 bash[22610]: cluster 2024-08-31T04:11:49.682239+0000 mgr.a (mgr.14388) 5214 : cluster [DBG] pgmap v3614: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:11:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:52 smithi191 bash[24992]: audit 2024-08-31T04:11:51.802769+0000 mon.a (mon.0) 1362 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:11:52.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:52 smithi163 bash[24253]: audit 2024-08-31T04:11:51.802769+0000 mon.a (mon.0) 1362 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:11:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:52 smithi027 bash[22610]: audit 2024-08-31T04:11:51.802769+0000 mon.a (mon.0) 1362 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:11:53.201 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:53.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:53.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:53.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:53.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:53 smithi191 bash[24992]: cluster 2024-08-31T04:11:51.683056+0000 mgr.a (mgr.14388) 5215 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:53 smithi191 bash[24992]: audit 2024-08-31T04:11:52.431737+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:11:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:53 smithi191 bash[24992]: audit 2024-08-31T04:11:52.437619+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:11:53.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:53 smithi163 bash[24253]: cluster 2024-08-31T04:11:51.683056+0000 mgr.a (mgr.14388) 5215 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:53.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:53 smithi163 bash[24253]: audit 2024-08-31T04:11:52.431737+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:11:53.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:53 smithi163 bash[24253]: audit 2024-08-31T04:11:52.437619+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:11:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:53 smithi027 bash[22610]: cluster 2024-08-31T04:11:51.683056+0000 mgr.a (mgr.14388) 5215 : cluster [DBG] pgmap v3615: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:11:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:53 smithi027 bash[22610]: audit 2024-08-31T04:11:52.431737+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:11:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:53 smithi027 bash[22610]: audit 2024-08-31T04:11:52.437619+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:11:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:54 smithi191 bash[24992]: audit 2024-08-31T04:11:52.765818+0000 mgr.a (mgr.14388) 5216 : audit [DBG] from='client.122400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:54.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:54 smithi163 bash[24253]: audit 2024-08-31T04:11:52.765818+0000 mgr.a (mgr.14388) 5216 : audit [DBG] from='client.122400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:54 smithi027 bash[22610]: audit 2024-08-31T04:11:52.765818+0000 mgr.a (mgr.14388) 5216 : audit [DBG] from='client.122400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:11:55.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:55 smithi163 bash[24253]: cluster 2024-08-31T04:11:53.685788+0000 mgr.a (mgr.14388) 5217 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:11:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:55 smithi027 bash[22610]: cluster 2024-08-31T04:11:53.685788+0000 mgr.a (mgr.14388) 5217 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:11:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:55 smithi191 bash[24992]: cluster 2024-08-31T04:11:53.685788+0000 mgr.a (mgr.14388) 5217 : cluster [DBG] pgmap v3616: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:11:57.683 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:57 smithi191 bash[24992]: cluster 2024-08-31T04:11:55.686578+0000 mgr.a (mgr.14388) 5218 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:11:57.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:57 smithi163 bash[24253]: cluster 2024-08-31T04:11:55.686578+0000 mgr.a (mgr.14388) 5218 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:11:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:57 smithi027 bash[22610]: cluster 2024-08-31T04:11:55.686578+0000 mgr.a (mgr.14388) 5218 : cluster [DBG] pgmap v3617: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:11:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:11:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:11:58.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:11:58.946 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:11:58.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:11:58.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:11:58.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:11:58.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:11:59.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:11:59 smithi163 bash[24253]: cluster 2024-08-31T04:11:57.687358+0000 mgr.a (mgr.14388) 5219 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:11:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:11:59 smithi027 bash[22610]: cluster 2024-08-31T04:11:57.687358+0000 mgr.a (mgr.14388) 5219 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:11:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:11:59 smithi191 bash[24992]: cluster 2024-08-31T04:11:57.687358+0000 mgr.a (mgr.14388) 5219 : cluster [DBG] pgmap v3618: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:12:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:00 smithi191 bash[24992]: audit 2024-08-31T04:11:58.536072+0000 mgr.a (mgr.14388) 5220 : audit [DBG] from='client.122475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:00.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:00 smithi163 bash[24253]: audit 2024-08-31T04:11:58.536072+0000 mgr.a (mgr.14388) 5220 : audit [DBG] from='client.122475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:00 smithi027 bash[22610]: audit 2024-08-31T04:11:58.536072+0000 mgr.a (mgr.14388) 5220 : audit [DBG] from='client.122475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:01.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:01 smithi191 bash[24992]: cluster 2024-08-31T04:11:59.690074+0000 mgr.a (mgr.14388) 5221 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:01.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:01 smithi163 bash[24253]: cluster 2024-08-31T04:11:59.690074+0000 mgr.a (mgr.14388) 5221 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:01 smithi027 bash[22610]: cluster 2024-08-31T04:11:59.690074+0000 mgr.a (mgr.14388) 5221 : cluster [DBG] pgmap v3619: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:03.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:03 smithi163 bash[24253]: cluster 2024-08-31T04:12:01.690921+0000 mgr.a (mgr.14388) 5222 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:12:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:03 smithi163 bash[24253]: audit 2024-08-31T04:12:02.105556+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:03 smithi163 bash[24253]: audit 2024-08-31T04:12:02.114018+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:03 smithi163 bash[24253]: audit 2024-08-31T04:12:02.669137+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:03 smithi163 bash[24253]: audit 2024-08-31T04:12:02.678075+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:03 smithi163 bash[24253]: audit 2024-08-31T04:12:02.680535+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:12:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:03 smithi163 bash[24253]: audit 2024-08-31T04:12:02.682636+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:12:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:03 smithi163 bash[24253]: audit 2024-08-31T04:12:02.693755+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:03 smithi163 bash[24253]: audit 2024-08-31T04:12:02.699020+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:12:03.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22610]: cluster 2024-08-31T04:12:01.690921+0000 mgr.a (mgr.14388) 5222 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:12:03.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22610]: audit 2024-08-31T04:12:02.105556+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22610]: audit 2024-08-31T04:12:02.114018+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22610]: audit 2024-08-31T04:12:02.669137+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22610]: audit 2024-08-31T04:12:02.678075+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22610]: audit 2024-08-31T04:12:02.680535+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:12:03.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22610]: audit 2024-08-31T04:12:02.682636+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:12:03.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22610]: audit 2024-08-31T04:12:02.693755+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.450 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22610]: audit 2024-08-31T04:12:02.699020+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:12:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:03 smithi191 bash[24992]: cluster 2024-08-31T04:12:01.690921+0000 mgr.a (mgr.14388) 5222 : cluster [DBG] pgmap v3620: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:12:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:03 smithi191 bash[24992]: audit 2024-08-31T04:12:02.105556+0000 mon.a (mon.0) 1365 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:03 smithi191 bash[24992]: audit 2024-08-31T04:12:02.114018+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:03 smithi191 bash[24992]: audit 2024-08-31T04:12:02.669137+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:03 smithi191 bash[24992]: audit 2024-08-31T04:12:02.678075+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:03 smithi191 bash[24992]: audit 2024-08-31T04:12:02.680535+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:12:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:03 smithi191 bash[24992]: audit 2024-08-31T04:12:02.682636+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:12:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:03 smithi191 bash[24992]: audit 2024-08-31T04:12:02.693755+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:12:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:03 smithi191 bash[24992]: audit 2024-08-31T04:12:02.699020+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:12:03.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22863]: debug 2024-08-31T04:12:03.448+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:12:03.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:12:03 smithi027 bash[22863]: debug 2024-08-31T04:12:03.448+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:12:03.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:12:03.949 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:12:03.949 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:12:04.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:04 smithi163 bash[24253]: audit 2024-08-31T04:12:02.701381+0000 mgr.a (mgr.14388) 5223 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:12:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:04 smithi027 bash[22610]: audit 2024-08-31T04:12:02.701381+0000 mgr.a (mgr.14388) 5223 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:04 smithi191 bash[24992]: audit 2024-08-31T04:12:02.701381+0000 mgr.a (mgr.14388) 5223 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:12:04.726 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:12:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:12:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:12:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:12:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:12:05.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:05 smithi163 bash[24253]: audit 2024-08-31T04:12:03.450979+0000 mgr.a (mgr.14388) 5224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:12:05.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:05 smithi163 bash[24253]: cephadm 2024-08-31T04:12:03.452111+0000 mgr.a (mgr.14388) 5225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:12:05.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:05 smithi163 bash[24253]: cluster 2024-08-31T04:12:03.693678+0000 mgr.a (mgr.14388) 5226 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:12:05.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:05 smithi163 bash[24253]: audit 2024-08-31T04:12:04.289246+0000 mgr.a (mgr.14388) 5227 : audit [DBG] from='client.122658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:05 smithi027 bash[22610]: audit 2024-08-31T04:12:03.450979+0000 mgr.a (mgr.14388) 5224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:05 smithi027 bash[22610]: cephadm 2024-08-31T04:12:03.452111+0000 mgr.a (mgr.14388) 5225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:05 smithi027 bash[22610]: cluster 2024-08-31T04:12:03.693678+0000 mgr.a (mgr.14388) 5226 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:12:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:05 smithi027 bash[22610]: audit 2024-08-31T04:12:04.289246+0000 mgr.a (mgr.14388) 5227 : audit [DBG] from='client.122658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:05 smithi191 bash[24992]: audit 2024-08-31T04:12:03.450979+0000 mgr.a (mgr.14388) 5224 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:12:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:05 smithi191 bash[24992]: cephadm 2024-08-31T04:12:03.452111+0000 mgr.a (mgr.14388) 5225 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:12:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:05 smithi191 bash[24992]: cluster 2024-08-31T04:12:03.693678+0000 mgr.a (mgr.14388) 5226 : cluster [DBG] pgmap v3621: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:12:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:05 smithi191 bash[24992]: audit 2024-08-31T04:12:04.289246+0000 mgr.a (mgr.14388) 5227 : audit [DBG] from='client.122658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:07.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:07 smithi163 bash[24253]: cluster 2024-08-31T04:12:05.694606+0000 mgr.a (mgr.14388) 5228 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:12:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:07 smithi027 bash[22610]: cluster 2024-08-31T04:12:05.694606+0000 mgr.a (mgr.14388) 5228 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:12:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:07 smithi191 bash[24992]: cluster 2024-08-31T04:12:05.694606+0000 mgr.a (mgr.14388) 5228 : cluster [DBG] pgmap v3622: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:12:09.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:09 smithi163 bash[24253]: cluster 2024-08-31T04:12:07.695386+0000 mgr.a (mgr.14388) 5229 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:12:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:09 smithi027 bash[22610]: cluster 2024-08-31T04:12:07.695386+0000 mgr.a (mgr.14388) 5229 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:12:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:09 smithi191 bash[24992]: cluster 2024-08-31T04:12:07.695386+0000 mgr.a (mgr.14388) 5229 : cluster [DBG] pgmap v3623: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:12:09.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:12:09.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:12:09.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:12:10.503 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:12:10.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:12:10.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:12:10.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:12:10.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:12:11.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:11 smithi163 bash[24253]: cluster 2024-08-31T04:12:09.697603+0000 mgr.a (mgr.14388) 5230 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:11.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:11 smithi163 bash[24253]: audit 2024-08-31T04:12:10.063996+0000 mgr.a (mgr.14388) 5231 : audit [DBG] from='client.122736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:11 smithi027 bash[22610]: cluster 2024-08-31T04:12:09.697603+0000 mgr.a (mgr.14388) 5230 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:11 smithi027 bash[22610]: audit 2024-08-31T04:12:10.063996+0000 mgr.a (mgr.14388) 5231 : audit [DBG] from='client.122736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:11 smithi191 bash[24992]: cluster 2024-08-31T04:12:09.697603+0000 mgr.a (mgr.14388) 5230 : cluster [DBG] pgmap v3624: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:11 smithi191 bash[24992]: audit 2024-08-31T04:12:10.063996+0000 mgr.a (mgr.14388) 5231 : audit [DBG] from='client.122736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:13.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:13 smithi163 bash[24253]: cluster 2024-08-31T04:12:11.698518+0000 mgr.a (mgr.14388) 5232 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:13 smithi027 bash[22610]: cluster 2024-08-31T04:12:11.698518+0000 mgr.a (mgr.14388) 5232 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:13 smithi191 bash[24992]: cluster 2024-08-31T04:12:11.698518+0000 mgr.a (mgr.14388) 5232 : cluster [DBG] pgmap v3625: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:15.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:15 smithi163 bash[24253]: cluster 2024-08-31T04:12:13.700737+0000 mgr.a (mgr.14388) 5233 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:15 smithi027 bash[22610]: cluster 2024-08-31T04:12:13.700737+0000 mgr.a (mgr.14388) 5233 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:15.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:12:15.505 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:12:15.506 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:12:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:15 smithi191 bash[24992]: cluster 2024-08-31T04:12:13.700737+0000 mgr.a (mgr.14388) 5233 : cluster [DBG] pgmap v3626: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:16.251 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:12:16.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:12:16.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:12:16.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:12:16.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:12:17.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:17 smithi163 bash[24253]: cluster 2024-08-31T04:12:15.701497+0000 mgr.a (mgr.14388) 5234 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:12:17.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:17 smithi163 bash[24253]: audit 2024-08-31T04:12:15.834910+0000 mgr.a (mgr.14388) 5235 : audit [DBG] from='client.122808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:17 smithi027 bash[22610]: cluster 2024-08-31T04:12:15.701497+0000 mgr.a (mgr.14388) 5234 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:12:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:17 smithi027 bash[22610]: audit 2024-08-31T04:12:15.834910+0000 mgr.a (mgr.14388) 5235 : audit [DBG] from='client.122808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:17 smithi191 bash[24992]: cluster 2024-08-31T04:12:15.701497+0000 mgr.a (mgr.14388) 5234 : cluster [DBG] pgmap v3627: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:12:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:17 smithi191 bash[24992]: audit 2024-08-31T04:12:15.834910+0000 mgr.a (mgr.14388) 5235 : audit [DBG] from='client.122808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:19.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:19 smithi163 bash[24253]: cluster 2024-08-31T04:12:17.702389+0000 mgr.a (mgr.14388) 5236 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:12:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:19 smithi027 bash[22610]: cluster 2024-08-31T04:12:17.702389+0000 mgr.a (mgr.14388) 5236 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:12:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:19 smithi191 bash[24992]: cluster 2024-08-31T04:12:17.702389+0000 mgr.a (mgr.14388) 5236 : cluster [DBG] pgmap v3628: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:12:21.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:12:21.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:12:21.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:12:21.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:21 smithi163 bash[24253]: cluster 2024-08-31T04:12:19.704614+0000 mgr.a (mgr.14388) 5237 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:21 smithi027 bash[22610]: cluster 2024-08-31T04:12:19.704614+0000 mgr.a (mgr.14388) 5237 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:21 smithi191 bash[24992]: cluster 2024-08-31T04:12:19.704614+0000 mgr.a (mgr.14388) 5237 : cluster [DBG] pgmap v3629: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:12:22.028 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:12:22.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:12:22.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:12:22.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:12:22.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:12:23.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:23 smithi163 bash[24253]: audit 2024-08-31T04:12:21.589415+0000 mgr.a (mgr.14388) 5238 : audit [DBG] from='client.122886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:23.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:23 smithi163 bash[24253]: cluster 2024-08-31T04:12:21.705110+0000 mgr.a (mgr.14388) 5239 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:23 smithi027 bash[22610]: audit 2024-08-31T04:12:21.589415+0000 mgr.a (mgr.14388) 5238 : audit [DBG] from='client.122886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:23 smithi027 bash[22610]: cluster 2024-08-31T04:12:21.705110+0000 mgr.a (mgr.14388) 5239 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:23 smithi191 bash[24992]: audit 2024-08-31T04:12:21.589415+0000 mgr.a (mgr.14388) 5238 : audit [DBG] from='client.122886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:23 smithi191 bash[24992]: cluster 2024-08-31T04:12:21.705110+0000 mgr.a (mgr.14388) 5239 : cluster [DBG] pgmap v3630: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:25.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:25 smithi163 bash[24253]: cluster 2024-08-31T04:12:23.707398+0000 mgr.a (mgr.14388) 5240 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 0 B/s wr, 42 op/s 2024-08-31T04:12:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:25 smithi027 bash[22610]: cluster 2024-08-31T04:12:23.707398+0000 mgr.a (mgr.14388) 5240 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 0 B/s wr, 42 op/s 2024-08-31T04:12:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:25 smithi191 bash[24992]: cluster 2024-08-31T04:12:23.707398+0000 mgr.a (mgr.14388) 5240 : cluster [DBG] pgmap v3631: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 0 B/s wr, 42 op/s 2024-08-31T04:12:27.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:12:27.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:12:27.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:12:27.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:27 smithi163 bash[24253]: cluster 2024-08-31T04:12:25.708218+0000 mgr.a (mgr.14388) 5241 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 0 B/s wr, 41 op/s 2024-08-31T04:12:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:27 smithi027 bash[22610]: cluster 2024-08-31T04:12:25.708218+0000 mgr.a (mgr.14388) 5241 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 0 B/s wr, 41 op/s 2024-08-31T04:12:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:27 smithi191 bash[24992]: cluster 2024-08-31T04:12:25.708218+0000 mgr.a (mgr.14388) 5241 : cluster [DBG] pgmap v3632: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 0 B/s wr, 41 op/s 2024-08-31T04:12:27.801 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:12:27.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:12:27.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:12:27.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:12:27.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:12:29.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:29 smithi163 bash[24253]: audit 2024-08-31T04:12:27.365396+0000 mgr.a (mgr.14388) 5242 : audit [DBG] from='client.122961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:29.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:29 smithi163 bash[24253]: cluster 2024-08-31T04:12:27.708819+0000 mgr.a (mgr.14388) 5243 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 0 B/s wr, 41 op/s 2024-08-31T04:12:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:29 smithi027 bash[22610]: audit 2024-08-31T04:12:27.365396+0000 mgr.a (mgr.14388) 5242 : audit [DBG] from='client.122961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:29 smithi027 bash[22610]: cluster 2024-08-31T04:12:27.708819+0000 mgr.a (mgr.14388) 5243 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 0 B/s wr, 41 op/s 2024-08-31T04:12:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:29 smithi191 bash[24992]: audit 2024-08-31T04:12:27.365396+0000 mgr.a (mgr.14388) 5242 : audit [DBG] from='client.122961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:29 smithi191 bash[24992]: cluster 2024-08-31T04:12:27.708819+0000 mgr.a (mgr.14388) 5243 : cluster [DBG] pgmap v3633: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 0 B/s wr, 41 op/s 2024-08-31T04:12:31.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:31 smithi163 bash[24253]: cluster 2024-08-31T04:12:29.711052+0000 mgr.a (mgr.14388) 5244 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T04:12:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:31 smithi027 bash[22610]: cluster 2024-08-31T04:12:29.711052+0000 mgr.a (mgr.14388) 5244 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T04:12:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:31 smithi191 bash[24992]: cluster 2024-08-31T04:12:29.711052+0000 mgr.a (mgr.14388) 5244 : cluster [DBG] pgmap v3634: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T04:12:32.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:12:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:12:32.804 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:12:33.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:33 smithi163 bash[24253]: cluster 2024-08-31T04:12:31.711874+0000 mgr.a (mgr.14388) 5245 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T04:12:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:33 smithi027 bash[22610]: cluster 2024-08-31T04:12:31.711874+0000 mgr.a (mgr.14388) 5245 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T04:12:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:33 smithi191 bash[24992]: cluster 2024-08-31T04:12:31.711874+0000 mgr.a (mgr.14388) 5245 : cluster [DBG] pgmap v3635: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T04:12:33.557 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:12:33.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:12:33.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:12:33.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:12:33.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:12:34.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:34 smithi163 bash[24253]: audit 2024-08-31T04:12:33.139714+0000 mgr.a (mgr.14388) 5246 : audit [DBG] from='client.123039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:34 smithi027 bash[22610]: audit 2024-08-31T04:12:33.139714+0000 mgr.a (mgr.14388) 5246 : audit [DBG] from='client.123039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:34 smithi191 bash[24992]: audit 2024-08-31T04:12:33.139714+0000 mgr.a (mgr.14388) 5246 : audit [DBG] from='client.123039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:35 smithi027 bash[22610]: cluster 2024-08-31T04:12:33.714647+0000 mgr.a (mgr.14388) 5247 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 95 op/s 2024-08-31T04:12:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:35 smithi191 bash[24992]: cluster 2024-08-31T04:12:33.714647+0000 mgr.a (mgr.14388) 5247 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 95 op/s 2024-08-31T04:12:35.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:35 smithi163 bash[24253]: cluster 2024-08-31T04:12:33.714647+0000 mgr.a (mgr.14388) 5247 : cluster [DBG] pgmap v3636: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 0 B/s wr, 95 op/s 2024-08-31T04:12:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:37 smithi027 bash[22610]: cluster 2024-08-31T04:12:35.715469+0000 mgr.a (mgr.14388) 5248 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:12:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:37 smithi191 bash[24992]: cluster 2024-08-31T04:12:35.715469+0000 mgr.a (mgr.14388) 5248 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:12:37.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:37 smithi163 bash[24253]: cluster 2024-08-31T04:12:35.715469+0000 mgr.a (mgr.14388) 5248 : cluster [DBG] pgmap v3637: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:12:38.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:12:38.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:12:38.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:12:39.314 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:12:39.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:12:39.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:12:39.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:12:39.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:12:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:39 smithi027 bash[22610]: cluster 2024-08-31T04:12:37.716272+0000 mgr.a (mgr.14388) 5249 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:12:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:39 smithi191 bash[24992]: cluster 2024-08-31T04:12:37.716272+0000 mgr.a (mgr.14388) 5249 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:12:39.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:39 smithi163 bash[24253]: cluster 2024-08-31T04:12:37.716272+0000 mgr.a (mgr.14388) 5249 : cluster [DBG] pgmap v3638: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:12:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:40 smithi027 bash[22610]: audit 2024-08-31T04:12:38.895263+0000 mgr.a (mgr.14388) 5250 : audit [DBG] from='client.123114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:40 smithi191 bash[24992]: audit 2024-08-31T04:12:38.895263+0000 mgr.a (mgr.14388) 5250 : audit [DBG] from='client.123114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:40.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:40 smithi163 bash[24253]: audit 2024-08-31T04:12:38.895263+0000 mgr.a (mgr.14388) 5250 : audit [DBG] from='client.123114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:41 smithi027 bash[22610]: cluster 2024-08-31T04:12:39.719114+0000 mgr.a (mgr.14388) 5251 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T04:12:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:41 smithi191 bash[24992]: cluster 2024-08-31T04:12:39.719114+0000 mgr.a (mgr.14388) 5251 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T04:12:41.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:41 smithi163 bash[24253]: cluster 2024-08-31T04:12:39.719114+0000 mgr.a (mgr.14388) 5251 : cluster [DBG] pgmap v3639: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T04:12:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:43 smithi027 bash[22610]: cluster 2024-08-31T04:12:41.719920+0000 mgr.a (mgr.14388) 5252 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 0 B/s wr, 46 op/s 2024-08-31T04:12:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:43 smithi191 bash[24992]: cluster 2024-08-31T04:12:41.719920+0000 mgr.a (mgr.14388) 5252 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 0 B/s wr, 46 op/s 2024-08-31T04:12:43.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:43 smithi163 bash[24253]: cluster 2024-08-31T04:12:41.719920+0000 mgr.a (mgr.14388) 5252 : cluster [DBG] pgmap v3640: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 0 B/s wr, 46 op/s 2024-08-31T04:12:44.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:12:44.317 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:12:44.317 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:12:45.100 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:12:45.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:12:45.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:12:45.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:12:45.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:12:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:45 smithi027 bash[22610]: cluster 2024-08-31T04:12:43.722011+0000 mgr.a (mgr.14388) 5253 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 0 B/s wr, 47 op/s 2024-08-31T04:12:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:45 smithi191 bash[24992]: cluster 2024-08-31T04:12:43.722011+0000 mgr.a (mgr.14388) 5253 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 0 B/s wr, 47 op/s 2024-08-31T04:12:45.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:45 smithi163 bash[24253]: cluster 2024-08-31T04:12:43.722011+0000 mgr.a (mgr.14388) 5253 : cluster [DBG] pgmap v3641: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 0 B/s wr, 47 op/s 2024-08-31T04:12:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:46 smithi027 bash[22610]: audit 2024-08-31T04:12:44.654316+0000 mgr.a (mgr.14388) 5254 : audit [DBG] from='client.123192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:46 smithi191 bash[24992]: audit 2024-08-31T04:12:44.654316+0000 mgr.a (mgr.14388) 5254 : audit [DBG] from='client.123192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:46.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:46 smithi163 bash[24253]: audit 2024-08-31T04:12:44.654316+0000 mgr.a (mgr.14388) 5254 : audit [DBG] from='client.123192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:47 smithi191 bash[24992]: cluster 2024-08-31T04:12:45.722992+0000 mgr.a (mgr.14388) 5255 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:47.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:47 smithi163 bash[24253]: cluster 2024-08-31T04:12:45.722992+0000 mgr.a (mgr.14388) 5255 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:47 smithi027 bash[22610]: cluster 2024-08-31T04:12:45.722992+0000 mgr.a (mgr.14388) 5255 : cluster [DBG] pgmap v3642: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:49 smithi191 bash[24992]: cluster 2024-08-31T04:12:47.723758+0000 mgr.a (mgr.14388) 5256 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:49.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:49 smithi163 bash[24253]: cluster 2024-08-31T04:12:47.723758+0000 mgr.a (mgr.14388) 5256 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:49 smithi027 bash[22610]: cluster 2024-08-31T04:12:47.723758+0000 mgr.a (mgr.14388) 5256 : cluster [DBG] pgmap v3643: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:50.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:12:50.102 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:12:50.102 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:12:50.868 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:12:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:12:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:12:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:12:50.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:12:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:51 smithi191 bash[24992]: cluster 2024-08-31T04:12:49.725971+0000 mgr.a (mgr.14388) 5257 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:12:51.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:51 smithi163 bash[24253]: cluster 2024-08-31T04:12:49.725971+0000 mgr.a (mgr.14388) 5257 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:12:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:51 smithi027 bash[22610]: cluster 2024-08-31T04:12:49.725971+0000 mgr.a (mgr.14388) 5257 : cluster [DBG] pgmap v3644: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:12:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:52 smithi191 bash[24992]: audit 2024-08-31T04:12:50.439979+0000 mgr.a (mgr.14388) 5258 : audit [DBG] from='client.123270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:52.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:52 smithi163 bash[24253]: audit 2024-08-31T04:12:50.439979+0000 mgr.a (mgr.14388) 5258 : audit [DBG] from='client.123270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:52 smithi027 bash[22610]: audit 2024-08-31T04:12:50.439979+0000 mgr.a (mgr.14388) 5258 : audit [DBG] from='client.123270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:53 smithi191 bash[24992]: cluster 2024-08-31T04:12:51.727051+0000 mgr.a (mgr.14388) 5259 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:53.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:53 smithi163 bash[24253]: cluster 2024-08-31T04:12:51.727051+0000 mgr.a (mgr.14388) 5259 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:53 smithi027 bash[22610]: cluster 2024-08-31T04:12:51.727051+0000 mgr.a (mgr.14388) 5259 : cluster [DBG] pgmap v3645: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:55 smithi191 bash[24992]: cluster 2024-08-31T04:12:53.729419+0000 mgr.a (mgr.14388) 5260 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:12:55.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:55 smithi163 bash[24253]: cluster 2024-08-31T04:12:53.729419+0000 mgr.a (mgr.14388) 5260 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:12:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:55 smithi027 bash[22610]: cluster 2024-08-31T04:12:53.729419+0000 mgr.a (mgr.14388) 5260 : cluster [DBG] pgmap v3646: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:12:55.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:12:55.870 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:12:55.870 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:12:56.608 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:12:56.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:12:56.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:12:56.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:12:56.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:12:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:57 smithi191 bash[24992]: cluster 2024-08-31T04:12:55.730369+0000 mgr.a (mgr.14388) 5261 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:57 smithi191 bash[24992]: audit 2024-08-31T04:12:56.203631+0000 mgr.a (mgr.14388) 5262 : audit [DBG] from='client.123345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:57.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:57 smithi163 bash[24253]: cluster 2024-08-31T04:12:55.730369+0000 mgr.a (mgr.14388) 5261 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:57.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:57 smithi163 bash[24253]: audit 2024-08-31T04:12:56.203631+0000 mgr.a (mgr.14388) 5262 : audit [DBG] from='client.123345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:57 smithi027 bash[22610]: cluster 2024-08-31T04:12:55.730369+0000 mgr.a (mgr.14388) 5261 : cluster [DBG] pgmap v3647: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:57 smithi027 bash[22610]: audit 2024-08-31T04:12:56.203631+0000 mgr.a (mgr.14388) 5262 : audit [DBG] from='client.123345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:12:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:12:59 smithi191 bash[24992]: cluster 2024-08-31T04:12:57.731309+0000 mgr.a (mgr.14388) 5263 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:59.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:12:59 smithi163 bash[24253]: cluster 2024-08-31T04:12:57.731309+0000 mgr.a (mgr.14388) 5263 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:12:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:12:59 smithi027 bash[22610]: cluster 2024-08-31T04:12:57.731309+0000 mgr.a (mgr.14388) 5263 : cluster [DBG] pgmap v3648: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:01 smithi191 bash[24992]: cluster 2024-08-31T04:12:59.733571+0000 mgr.a (mgr.14388) 5264 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:01.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:01.611 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:01.611 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:01.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:01 smithi163 bash[24253]: cluster 2024-08-31T04:12:59.733571+0000 mgr.a (mgr.14388) 5264 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:01 smithi027 bash[22610]: cluster 2024-08-31T04:12:59.733571+0000 mgr.a (mgr.14388) 5264 : cluster [DBG] pgmap v3649: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:02.351 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:02.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:02.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:02.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:02.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:13:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:03 smithi191 bash[24992]: cluster 2024-08-31T04:13:01.734024+0000 mgr.a (mgr.14388) 5265 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:03 smithi191 bash[24992]: audit 2024-08-31T04:13:01.944364+0000 mgr.a (mgr.14388) 5266 : audit [DBG] from='client.123423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:03.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:03 smithi163 bash[24253]: cluster 2024-08-31T04:13:01.734024+0000 mgr.a (mgr.14388) 5265 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:03.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:03 smithi163 bash[24253]: audit 2024-08-31T04:13:01.944364+0000 mgr.a (mgr.14388) 5266 : audit [DBG] from='client.123423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:03 smithi027 bash[22610]: cluster 2024-08-31T04:13:01.734024+0000 mgr.a (mgr.14388) 5265 : cluster [DBG] pgmap v3650: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:03 smithi027 bash[22610]: audit 2024-08-31T04:13:01.944364+0000 mgr.a (mgr.14388) 5266 : audit [DBG] from='client.123423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:04 smithi191 bash[24992]: audit 2024-08-31T04:13:03.508468+0000 mon.a (mon.0) 1373 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:13:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:04 smithi191 bash[24992]: audit 2024-08-31T04:13:04.124284+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:04 smithi191 bash[24992]: audit 2024-08-31T04:13:04.129289+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:04 smithi191 bash[24992]: audit 2024-08-31T04:13:04.134433+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:04 smithi191 bash[24992]: audit 2024-08-31T04:13:04.139665+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:04 smithi163 bash[24253]: audit 2024-08-31T04:13:03.508468+0000 mon.a (mon.0) 1373 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:13:04.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:04 smithi163 bash[24253]: audit 2024-08-31T04:13:04.124284+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:04 smithi163 bash[24253]: audit 2024-08-31T04:13:04.129289+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:04 smithi163 bash[24253]: audit 2024-08-31T04:13:04.134433+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:04 smithi163 bash[24253]: audit 2024-08-31T04:13:04.139665+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:04 smithi027 bash[22610]: audit 2024-08-31T04:13:03.508468+0000 mon.a (mon.0) 1373 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:13:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:04 smithi027 bash[22610]: audit 2024-08-31T04:13:04.124284+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:04 smithi027 bash[22610]: audit 2024-08-31T04:13:04.129289+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:04 smithi027 bash[22610]: audit 2024-08-31T04:13:04.134433+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:04 smithi027 bash[22610]: audit 2024-08-31T04:13:04.139665+0000 mon.a (mon.0) 1377 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:05 smithi191 bash[24992]: cluster 2024-08-31T04:13:03.736358+0000 mgr.a (mgr.14388) 5267 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:05 smithi191 bash[24992]: audit 2024-08-31T04:13:04.810676+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:13:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:05 smithi191 bash[24992]: audit 2024-08-31T04:13:04.812163+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:13:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:05 smithi191 bash[24992]: audit 2024-08-31T04:13:04.822298+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:05 smithi191 bash[24992]: audit 2024-08-31T04:13:04.827571+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:13:05.552 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:05 smithi027 bash[22610]: cluster 2024-08-31T04:13:03.736358+0000 mgr.a (mgr.14388) 5267 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:05.552 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:05 smithi027 bash[22610]: audit 2024-08-31T04:13:04.810676+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:13:05.552 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:05 smithi027 bash[22610]: audit 2024-08-31T04:13:04.812163+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:13:05.552 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:05 smithi027 bash[22610]: audit 2024-08-31T04:13:04.822298+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:05.552 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:05 smithi027 bash[22610]: audit 2024-08-31T04:13:04.827571+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:13:05.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:05 smithi163 bash[24253]: cluster 2024-08-31T04:13:03.736358+0000 mgr.a (mgr.14388) 5267 : cluster [DBG] pgmap v3651: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:05.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:05 smithi163 bash[24253]: audit 2024-08-31T04:13:04.810676+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:13:05.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:05 smithi163 bash[24253]: audit 2024-08-31T04:13:04.812163+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:13:05.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:05 smithi163 bash[24253]: audit 2024-08-31T04:13:04.822298+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:13:05.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:05 smithi163 bash[24253]: audit 2024-08-31T04:13:04.827571+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:13:05.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:13:05 smithi027 bash[22863]: debug 2024-08-31T04:13:05.547+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:13:05.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:13:05 smithi027 bash[22863]: debug 2024-08-31T04:13:05.547+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:13:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:06 smithi191 bash[24992]: audit 2024-08-31T04:13:04.829789+0000 mgr.a (mgr.14388) 5268 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:13:06.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:06 smithi163 bash[24253]: audit 2024-08-31T04:13:04.829789+0000 mgr.a (mgr.14388) 5268 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:13:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:06 smithi027 bash[22610]: audit 2024-08-31T04:13:04.829789+0000 mgr.a (mgr.14388) 5268 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:13:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:07.354 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:07.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:07 smithi163 bash[24253]: audit 2024-08-31T04:13:05.553074+0000 mgr.a (mgr.14388) 5269 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:13:07.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:07 smithi163 bash[24253]: cephadm 2024-08-31T04:13:05.554344+0000 mgr.a (mgr.14388) 5270 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:13:07.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:07 smithi163 bash[24253]: cluster 2024-08-31T04:13:05.737287+0000 mgr.a (mgr.14388) 5271 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:07 smithi027 bash[22610]: audit 2024-08-31T04:13:05.553074+0000 mgr.a (mgr.14388) 5269 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:13:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:07 smithi027 bash[22610]: cephadm 2024-08-31T04:13:05.554344+0000 mgr.a (mgr.14388) 5270 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:13:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:07 smithi027 bash[22610]: cluster 2024-08-31T04:13:05.737287+0000 mgr.a (mgr.14388) 5271 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:07 smithi191 bash[24992]: audit 2024-08-31T04:13:05.553074+0000 mgr.a (mgr.14388) 5269 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:13:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:07 smithi191 bash[24992]: cephadm 2024-08-31T04:13:05.554344+0000 mgr.a (mgr.14388) 5270 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:13:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:07 smithi191 bash[24992]: cluster 2024-08-31T04:13:05.737287+0000 mgr.a (mgr.14388) 5271 : cluster [DBG] pgmap v3652: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:08.105 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:08.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:08.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:08.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:08.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:13:09.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:09 smithi163 bash[24253]: audit 2024-08-31T04:13:07.685250+0000 mgr.a (mgr.14388) 5272 : audit [DBG] from='client.123606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:09.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:09 smithi163 bash[24253]: cluster 2024-08-31T04:13:07.738436+0000 mgr.a (mgr.14388) 5273 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:09 smithi027 bash[22610]: audit 2024-08-31T04:13:07.685250+0000 mgr.a (mgr.14388) 5272 : audit [DBG] from='client.123606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:09 smithi027 bash[22610]: cluster 2024-08-31T04:13:07.738436+0000 mgr.a (mgr.14388) 5273 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:09 smithi191 bash[24992]: audit 2024-08-31T04:13:07.685250+0000 mgr.a (mgr.14388) 5272 : audit [DBG] from='client.123606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:09 smithi191 bash[24992]: cluster 2024-08-31T04:13:07.738436+0000 mgr.a (mgr.14388) 5273 : cluster [DBG] pgmap v3653: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:11.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:11 smithi163 bash[24253]: cluster 2024-08-31T04:13:09.741265+0000 mgr.a (mgr.14388) 5274 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:13:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:11 smithi027 bash[22610]: cluster 2024-08-31T04:13:09.741265+0000 mgr.a (mgr.14388) 5274 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:13:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:11 smithi191 bash[24992]: cluster 2024-08-31T04:13:09.741265+0000 mgr.a (mgr.14388) 5274 : cluster [DBG] pgmap v3654: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:13:13.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:13.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:13.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:13.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:13 smithi163 bash[24253]: cluster 2024-08-31T04:13:11.742065+0000 mgr.a (mgr.14388) 5275 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:13:13.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:13 smithi027 bash[22610]: cluster 2024-08-31T04:13:11.742065+0000 mgr.a (mgr.14388) 5275 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:13:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:13 smithi191 bash[24992]: cluster 2024-08-31T04:13:11.742065+0000 mgr.a (mgr.14388) 5275 : cluster [DBG] pgmap v3655: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:13:13.894 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:13.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:13.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:13.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:13.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:13:15.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:15 smithi163 bash[24253]: audit 2024-08-31T04:13:13.449934+0000 mgr.a (mgr.14388) 5276 : audit [DBG] from='client.123678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:15.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:15 smithi163 bash[24253]: cluster 2024-08-31T04:13:13.743398+0000 mgr.a (mgr.14388) 5277 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:13:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:15 smithi027 bash[22610]: audit 2024-08-31T04:13:13.449934+0000 mgr.a (mgr.14388) 5276 : audit [DBG] from='client.123678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:15 smithi027 bash[22610]: cluster 2024-08-31T04:13:13.743398+0000 mgr.a (mgr.14388) 5277 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:13:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:15 smithi191 bash[24992]: audit 2024-08-31T04:13:13.449934+0000 mgr.a (mgr.14388) 5276 : audit [DBG] from='client.123678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:15 smithi191 bash[24992]: cluster 2024-08-31T04:13:13.743398+0000 mgr.a (mgr.14388) 5277 : cluster [DBG] pgmap v3656: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:13:17.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:17 smithi163 bash[24253]: cluster 2024-08-31T04:13:15.744255+0000 mgr.a (mgr.14388) 5278 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:13:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:17 smithi027 bash[22610]: cluster 2024-08-31T04:13:15.744255+0000 mgr.a (mgr.14388) 5278 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:13:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:17 smithi191 bash[24992]: cluster 2024-08-31T04:13:15.744255+0000 mgr.a (mgr.14388) 5278 : cluster [DBG] pgmap v3657: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:13:18.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:18.896 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:18.896 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:19.631 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:19.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:19.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:19.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:19.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:13:19.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:19 smithi163 bash[24253]: cluster 2024-08-31T04:13:17.745034+0000 mgr.a (mgr.14388) 5279 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:13:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:19 smithi027 bash[22610]: cluster 2024-08-31T04:13:17.745034+0000 mgr.a (mgr.14388) 5279 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:13:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:19 smithi191 bash[24992]: cluster 2024-08-31T04:13:17.745034+0000 mgr.a (mgr.14388) 5279 : cluster [DBG] pgmap v3658: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:13:20.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:20 smithi163 bash[24253]: audit 2024-08-31T04:13:19.225067+0000 mgr.a (mgr.14388) 5280 : audit [DBG] from='client.123756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:20 smithi027 bash[22610]: audit 2024-08-31T04:13:19.225067+0000 mgr.a (mgr.14388) 5280 : audit [DBG] from='client.123756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:20 smithi191 bash[24992]: audit 2024-08-31T04:13:19.225067+0000 mgr.a (mgr.14388) 5280 : audit [DBG] from='client.123756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:21.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:21 smithi163 bash[24253]: cluster 2024-08-31T04:13:19.747728+0000 mgr.a (mgr.14388) 5281 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:13:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:21 smithi027 bash[22610]: cluster 2024-08-31T04:13:19.747728+0000 mgr.a (mgr.14388) 5281 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:13:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:21 smithi191 bash[24992]: cluster 2024-08-31T04:13:19.747728+0000 mgr.a (mgr.14388) 5281 : cluster [DBG] pgmap v3659: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:13:23.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:23 smithi163 bash[24253]: cluster 2024-08-31T04:13:21.748571+0000 mgr.a (mgr.14388) 5282 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:13:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:23 smithi027 bash[22610]: cluster 2024-08-31T04:13:21.748571+0000 mgr.a (mgr.14388) 5282 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:13:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:23 smithi191 bash[24992]: cluster 2024-08-31T04:13:21.748571+0000 mgr.a (mgr.14388) 5282 : cluster [DBG] pgmap v3660: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:13:24.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:24.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:24.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:25.384 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:25.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:25.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:25.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:25.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:13:25.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:25 smithi163 bash[24253]: cluster 2024-08-31T04:13:23.750508+0000 mgr.a (mgr.14388) 5283 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:25 smithi027 bash[22610]: cluster 2024-08-31T04:13:23.750508+0000 mgr.a (mgr.14388) 5283 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:25 smithi191 bash[24992]: cluster 2024-08-31T04:13:23.750508+0000 mgr.a (mgr.14388) 5283 : cluster [DBG] pgmap v3661: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:26.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:26 smithi163 bash[24253]: audit 2024-08-31T04:13:24.964377+0000 mgr.a (mgr.14388) 5284 : audit [DBG] from='client.123834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:26 smithi027 bash[22610]: audit 2024-08-31T04:13:24.964377+0000 mgr.a (mgr.14388) 5284 : audit [DBG] from='client.123834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:26 smithi191 bash[24992]: audit 2024-08-31T04:13:24.964377+0000 mgr.a (mgr.14388) 5284 : audit [DBG] from='client.123834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:27.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:27 smithi163 bash[24253]: cluster 2024-08-31T04:13:25.751379+0000 mgr.a (mgr.14388) 5285 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:27 smithi027 bash[22610]: cluster 2024-08-31T04:13:25.751379+0000 mgr.a (mgr.14388) 5285 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:27 smithi191 bash[24992]: cluster 2024-08-31T04:13:25.751379+0000 mgr.a (mgr.14388) 5285 : cluster [DBG] pgmap v3662: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:28.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:28 smithi163 bash[24253]: cluster 2024-08-31T04:13:27.752077+0000 mgr.a (mgr.14388) 5286 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:28 smithi027 bash[22610]: cluster 2024-08-31T04:13:27.752077+0000 mgr.a (mgr.14388) 5286 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:28 smithi191 bash[24992]: cluster 2024-08-31T04:13:27.752077+0000 mgr.a (mgr.14388) 5286 : cluster [DBG] pgmap v3663: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:30.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:30.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:30.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:31.143 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:31.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:31.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:31.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:31.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:13:31.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:30 smithi163 bash[24253]: cluster 2024-08-31T04:13:29.754248+0000 mgr.a (mgr.14388) 5287 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:30 smithi027 bash[22610]: cluster 2024-08-31T04:13:29.754248+0000 mgr.a (mgr.14388) 5287 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:30 smithi191 bash[24992]: cluster 2024-08-31T04:13:29.754248+0000 mgr.a (mgr.14388) 5287 : cluster [DBG] pgmap v3664: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:32.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:31 smithi163 bash[24253]: audit 2024-08-31T04:13:30.720383+0000 mgr.a (mgr.14388) 5288 : audit [DBG] from='client.123909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:31 smithi027 bash[22610]: audit 2024-08-31T04:13:30.720383+0000 mgr.a (mgr.14388) 5288 : audit [DBG] from='client.123909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:31 smithi191 bash[24992]: audit 2024-08-31T04:13:30.720383+0000 mgr.a (mgr.14388) 5288 : audit [DBG] from='client.123909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:33.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:32 smithi163 bash[24253]: cluster 2024-08-31T04:13:31.755146+0000 mgr.a (mgr.14388) 5289 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:32 smithi027 bash[22610]: cluster 2024-08-31T04:13:31.755146+0000 mgr.a (mgr.14388) 5289 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:32 smithi191 bash[24992]: cluster 2024-08-31T04:13:31.755146+0000 mgr.a (mgr.14388) 5289 : cluster [DBG] pgmap v3665: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:35.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:34 smithi163 bash[24253]: cluster 2024-08-31T04:13:33.757320+0000 mgr.a (mgr.14388) 5290 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:34 smithi027 bash[22610]: cluster 2024-08-31T04:13:33.757320+0000 mgr.a (mgr.14388) 5290 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:34 smithi191 bash[24992]: cluster 2024-08-31T04:13:33.757320+0000 mgr.a (mgr.14388) 5290 : cluster [DBG] pgmap v3666: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:36.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:36.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:36.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:36.904 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:36.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:36.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:36.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:36.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:13:37.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:36 smithi163 bash[24253]: cluster 2024-08-31T04:13:35.758081+0000 mgr.a (mgr.14388) 5291 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:37.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:36 smithi027 bash[22610]: cluster 2024-08-31T04:13:35.758081+0000 mgr.a (mgr.14388) 5291 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:36 smithi191 bash[24992]: cluster 2024-08-31T04:13:35.758081+0000 mgr.a (mgr.14388) 5291 : cluster [DBG] pgmap v3667: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:38.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:37 smithi163 bash[24253]: audit 2024-08-31T04:13:36.479343+0000 mgr.a (mgr.14388) 5292 : audit [DBG] from='client.123987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:37 smithi027 bash[22610]: audit 2024-08-31T04:13:36.479343+0000 mgr.a (mgr.14388) 5292 : audit [DBG] from='client.123987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:37 smithi191 bash[24992]: audit 2024-08-31T04:13:36.479343+0000 mgr.a (mgr.14388) 5292 : audit [DBG] from='client.123987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:39.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:38 smithi163 bash[24253]: cluster 2024-08-31T04:13:37.759008+0000 mgr.a (mgr.14388) 5293 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:39.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:38 smithi027 bash[22610]: cluster 2024-08-31T04:13:37.759008+0000 mgr.a (mgr.14388) 5293 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:38 smithi191 bash[24992]: cluster 2024-08-31T04:13:37.759008+0000 mgr.a (mgr.14388) 5293 : cluster [DBG] pgmap v3668: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:41.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:40 smithi163 bash[24253]: cluster 2024-08-31T04:13:39.761236+0000 mgr.a (mgr.14388) 5294 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:41.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:40 smithi027 bash[22610]: cluster 2024-08-31T04:13:39.761236+0000 mgr.a (mgr.14388) 5294 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:40 smithi191 bash[24992]: cluster 2024-08-31T04:13:39.761236+0000 mgr.a (mgr.14388) 5294 : cluster [DBG] pgmap v3669: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:41.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:41.907 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:42.675 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:42.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:42.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:42.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:42.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:13:43.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:42 smithi163 bash[24253]: cluster 2024-08-31T04:13:41.762058+0000 mgr.a (mgr.14388) 5295 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:43.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:42 smithi163 bash[24253]: audit 2024-08-31T04:13:42.243352+0000 mgr.a (mgr.14388) 5296 : audit [DBG] from='client.124065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:42 smithi027 bash[22610]: cluster 2024-08-31T04:13:41.762058+0000 mgr.a (mgr.14388) 5295 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:42 smithi027 bash[22610]: audit 2024-08-31T04:13:42.243352+0000 mgr.a (mgr.14388) 5296 : audit [DBG] from='client.124065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:42 smithi191 bash[24992]: cluster 2024-08-31T04:13:41.762058+0000 mgr.a (mgr.14388) 5295 : cluster [DBG] pgmap v3670: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:42 smithi191 bash[24992]: audit 2024-08-31T04:13:42.243352+0000 mgr.a (mgr.14388) 5296 : audit [DBG] from='client.124065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:45.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:44 smithi163 bash[24253]: cluster 2024-08-31T04:13:43.764368+0000 mgr.a (mgr.14388) 5297 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:45.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:44 smithi027 bash[22610]: cluster 2024-08-31T04:13:43.764368+0000 mgr.a (mgr.14388) 5297 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:44 smithi191 bash[24992]: cluster 2024-08-31T04:13:43.764368+0000 mgr.a (mgr.14388) 5297 : cluster [DBG] pgmap v3671: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:13:47.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:46 smithi163 bash[24253]: cluster 2024-08-31T04:13:45.765123+0000 mgr.a (mgr.14388) 5298 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:46 smithi027 bash[22610]: cluster 2024-08-31T04:13:45.765123+0000 mgr.a (mgr.14388) 5298 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:46 smithi191 bash[24992]: cluster 2024-08-31T04:13:45.765123+0000 mgr.a (mgr.14388) 5298 : cluster [DBG] pgmap v3672: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:47.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:47.678 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:47.678 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:48.425 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:48.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:48.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:48.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:48.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:13:49.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:48 smithi163 bash[24253]: cluster 2024-08-31T04:13:47.765852+0000 mgr.a (mgr.14388) 5299 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:49.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:48 smithi163 bash[24253]: audit 2024-08-31T04:13:48.007609+0000 mgr.a (mgr.14388) 5300 : audit [DBG] from='client.124140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:48 smithi027 bash[22610]: cluster 2024-08-31T04:13:47.765852+0000 mgr.a (mgr.14388) 5299 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:48 smithi027 bash[22610]: audit 2024-08-31T04:13:48.007609+0000 mgr.a (mgr.14388) 5300 : audit [DBG] from='client.124140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:48 smithi191 bash[24992]: cluster 2024-08-31T04:13:47.765852+0000 mgr.a (mgr.14388) 5299 : cluster [DBG] pgmap v3673: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:48 smithi191 bash[24992]: audit 2024-08-31T04:13:48.007609+0000 mgr.a (mgr.14388) 5300 : audit [DBG] from='client.124140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:51.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:50 smithi163 bash[24253]: cluster 2024-08-31T04:13:49.768633+0000 mgr.a (mgr.14388) 5301 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:50 smithi027 bash[22610]: cluster 2024-08-31T04:13:49.768633+0000 mgr.a (mgr.14388) 5301 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:50 smithi191 bash[24992]: cluster 2024-08-31T04:13:49.768633+0000 mgr.a (mgr.14388) 5301 : cluster [DBG] pgmap v3674: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:53.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:52 smithi163 bash[24253]: cluster 2024-08-31T04:13:51.769440+0000 mgr.a (mgr.14388) 5302 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:13:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:52 smithi027 bash[22610]: cluster 2024-08-31T04:13:51.769440+0000 mgr.a (mgr.14388) 5302 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:13:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:52 smithi191 bash[24992]: cluster 2024-08-31T04:13:51.769440+0000 mgr.a (mgr.14388) 5302 : cluster [DBG] pgmap v3675: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:13:53.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:53.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:54.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:13:54.215 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:55.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:54 smithi163 bash[24253]: audit 2024-08-31T04:13:53.770429+0000 mgr.a (mgr.14388) 5303 : audit [DBG] from='client.124215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:55.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:54 smithi163 bash[24253]: cluster 2024-08-31T04:13:53.786011+0000 mgr.a (mgr.14388) 5304 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:54 smithi027 bash[22610]: audit 2024-08-31T04:13:53.770429+0000 mgr.a (mgr.14388) 5303 : audit [DBG] from='client.124215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:54 smithi027 bash[22610]: cluster 2024-08-31T04:13:53.786011+0000 mgr.a (mgr.14388) 5304 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:54 smithi191 bash[24992]: audit 2024-08-31T04:13:53.770429+0000 mgr.a (mgr.14388) 5303 : audit [DBG] from='client.124215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:13:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:54 smithi191 bash[24992]: cluster 2024-08-31T04:13:53.786011+0000 mgr.a (mgr.14388) 5304 : cluster [DBG] pgmap v3676: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:13:57.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:56 smithi163 bash[24253]: cluster 2024-08-31T04:13:55.787101+0000 mgr.a (mgr.14388) 5305 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T04:13:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:56 smithi027 bash[22610]: cluster 2024-08-31T04:13:55.787101+0000 mgr.a (mgr.14388) 5305 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T04:13:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:56 smithi191 bash[24992]: cluster 2024-08-31T04:13:55.787101+0000 mgr.a (mgr.14388) 5305 : cluster [DBG] pgmap v3677: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T04:13:59.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:13:58 smithi163 bash[24253]: cluster 2024-08-31T04:13:57.788425+0000 mgr.a (mgr.14388) 5306 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:13:59.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:13:59.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:13:59.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:13:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:13:58 smithi027 bash[22610]: cluster 2024-08-31T04:13:57.788425+0000 mgr.a (mgr.14388) 5306 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:13:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:13:58 smithi191 bash[24992]: cluster 2024-08-31T04:13:57.788425+0000 mgr.a (mgr.14388) 5306 : cluster [DBG] pgmap v3678: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:13:59.991 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:13:59.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:13:59.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:13:59.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:13:59.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:01.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:00 smithi163 bash[24253]: audit 2024-08-31T04:13:59.554183+0000 mgr.a (mgr.14388) 5307 : audit [DBG] from='client.124293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:01.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:00 smithi163 bash[24253]: cluster 2024-08-31T04:13:59.790149+0000 mgr.a (mgr.14388) 5308 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:00 smithi027 bash[22610]: audit 2024-08-31T04:13:59.554183+0000 mgr.a (mgr.14388) 5307 : audit [DBG] from='client.124293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:00 smithi027 bash[22610]: cluster 2024-08-31T04:13:59.790149+0000 mgr.a (mgr.14388) 5308 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:00 smithi191 bash[24992]: audit 2024-08-31T04:13:59.554183+0000 mgr.a (mgr.14388) 5307 : audit [DBG] from='client.124293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:00 smithi191 bash[24992]: cluster 2024-08-31T04:13:59.790149+0000 mgr.a (mgr.14388) 5308 : cluster [DBG] pgmap v3679: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:03.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:02 smithi163 bash[24253]: cluster 2024-08-31T04:14:01.791041+0000 mgr.a (mgr.14388) 5309 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:02 smithi027 bash[22610]: cluster 2024-08-31T04:14:01.791041+0000 mgr.a (mgr.14388) 5309 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:02 smithi191 bash[24992]: cluster 2024-08-31T04:14:01.791041+0000 mgr.a (mgr.14388) 5309 : cluster [DBG] pgmap v3680: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:04.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:14:04.993 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:14:04.993 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:14:05.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:04 smithi163 bash[24253]: cluster 2024-08-31T04:14:03.793362+0000 mgr.a (mgr.14388) 5310 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:04 smithi027 bash[22610]: cluster 2024-08-31T04:14:03.793362+0000 mgr.a (mgr.14388) 5310 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:04 smithi191 bash[24992]: cluster 2024-08-31T04:14:03.793362+0000 mgr.a (mgr.14388) 5310 : cluster [DBG] pgmap v3681: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:05.763 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:14:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:14:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:14:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:14:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:06.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:05 smithi163 bash[24253]: audit 2024-08-31T04:14:05.328364+0000 mgr.a (mgr.14388) 5311 : audit [DBG] from='client.124371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:06.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:05 smithi163 bash[24253]: audit 2024-08-31T04:14:05.604111+0000 mon.a (mon.0) 1382 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:14:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:05 smithi027 bash[22610]: audit 2024-08-31T04:14:05.328364+0000 mgr.a (mgr.14388) 5311 : audit [DBG] from='client.124371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:05 smithi027 bash[22610]: audit 2024-08-31T04:14:05.604111+0000 mon.a (mon.0) 1382 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:14:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:05 smithi191 bash[24992]: audit 2024-08-31T04:14:05.328364+0000 mgr.a (mgr.14388) 5311 : audit [DBG] from='client.124371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:05 smithi191 bash[24992]: audit 2024-08-31T04:14:05.604111+0000 mon.a (mon.0) 1382 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:14:07.190 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:06 smithi163 bash[24253]: cluster 2024-08-31T04:14:05.793902+0000 mgr.a (mgr.14388) 5312 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:06 smithi027 bash[22610]: cluster 2024-08-31T04:14:05.793902+0000 mgr.a (mgr.14388) 5312 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:06 smithi191 bash[24992]: cluster 2024-08-31T04:14:05.793902+0000 mgr.a (mgr.14388) 5312 : cluster [DBG] pgmap v3682: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:07.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22863]: debug 2024-08-31T04:14:07.657+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:14:07.933 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22863]: debug 2024-08-31T04:14:07.657+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:14:08.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.933628+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.938227+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.942095+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.947969+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.952717+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.958689+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.959807+0000 mon.a (mon.0) 1389 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:14:08.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.960762+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:14:08.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.966096+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.968616+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:14:08.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:07 smithi163 bash[24253]: audit 2024-08-31T04:14:06.969810+0000 mgr.a (mgr.14388) 5313 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:14:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.933628+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.938227+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.942095+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.947969+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.952717+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.958689+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.959807+0000 mon.a (mon.0) 1389 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:14:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.960762+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:14:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.966096+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.968616+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:14:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:07 smithi027 bash[22610]: audit 2024-08-31T04:14:06.969810+0000 mgr.a (mgr.14388) 5313 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:14:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.933628+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.938227+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.942095+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.947969+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.952717+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.958689+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.959807+0000 mon.a (mon.0) 1389 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:14:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.960762+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:14:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.966096+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:14:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.968616+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:14:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:07 smithi191 bash[24992]: audit 2024-08-31T04:14:06.969810+0000 mgr.a (mgr.14388) 5313 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:14:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:08 smithi027 bash[22610]: audit 2024-08-31T04:14:07.660900+0000 mgr.a (mgr.14388) 5314 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:14:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:08 smithi027 bash[22610]: cephadm 2024-08-31T04:14:07.662326+0000 mgr.a (mgr.14388) 5315 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:14:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:08 smithi027 bash[22610]: cluster 2024-08-31T04:14:07.795537+0000 mgr.a (mgr.14388) 5316 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 3 op/s 2024-08-31T04:14:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:08 smithi191 bash[24992]: audit 2024-08-31T04:14:07.660900+0000 mgr.a (mgr.14388) 5314 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:14:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:08 smithi191 bash[24992]: cephadm 2024-08-31T04:14:07.662326+0000 mgr.a (mgr.14388) 5315 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:14:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:08 smithi191 bash[24992]: cluster 2024-08-31T04:14:07.795537+0000 mgr.a (mgr.14388) 5316 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 3 op/s 2024-08-31T04:14:09.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:08 smithi163 bash[24253]: audit 2024-08-31T04:14:07.660900+0000 mgr.a (mgr.14388) 5314 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:14:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:08 smithi163 bash[24253]: cephadm 2024-08-31T04:14:07.662326+0000 mgr.a (mgr.14388) 5315 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:14:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:08 smithi163 bash[24253]: cluster 2024-08-31T04:14:07.795537+0000 mgr.a (mgr.14388) 5316 : cluster [DBG] pgmap v3683: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 3 op/s 2024-08-31T04:14:10.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:14:10.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:14:10.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:14:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:10 smithi027 bash[22610]: cluster 2024-08-31T04:14:09.797246+0000 mgr.a (mgr.14388) 5317 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:10 smithi191 bash[24992]: cluster 2024-08-31T04:14:09.797246+0000 mgr.a (mgr.14388) 5317 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:10 smithi163 bash[24253]: cluster 2024-08-31T04:14:09.797246+0000 mgr.a (mgr.14388) 5317 : cluster [DBG] pgmap v3684: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:11.541 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:14:11.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:14:11.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:14:11.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:14:11.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:11 smithi027 bash[22610]: audit 2024-08-31T04:14:11.106691+0000 mgr.a (mgr.14388) 5318 : audit [DBG] from='client.124554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:11 smithi191 bash[24992]: audit 2024-08-31T04:14:11.106691+0000 mgr.a (mgr.14388) 5318 : audit [DBG] from='client.124554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:12.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:11 smithi163 bash[24253]: audit 2024-08-31T04:14:11.106691+0000 mgr.a (mgr.14388) 5318 : audit [DBG] from='client.124554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:12 smithi191 bash[24992]: cluster 2024-08-31T04:14:11.798197+0000 mgr.a (mgr.14388) 5319 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:13.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:12 smithi163 bash[24253]: cluster 2024-08-31T04:14:11.798197+0000 mgr.a (mgr.14388) 5319 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:12 smithi027 bash[22610]: cluster 2024-08-31T04:14:11.798197+0000 mgr.a (mgr.14388) 5319 : cluster [DBG] pgmap v3685: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:14 smithi191 bash[24992]: cluster 2024-08-31T04:14:13.800391+0000 mgr.a (mgr.14388) 5320 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:15.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:14 smithi163 bash[24253]: cluster 2024-08-31T04:14:13.800391+0000 mgr.a (mgr.14388) 5320 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:14 smithi027 bash[22610]: cluster 2024-08-31T04:14:13.800391+0000 mgr.a (mgr.14388) 5320 : cluster [DBG] pgmap v3686: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:16.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:14:16.543 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:14:16.543 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:14:17.282 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:14:17.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:14:17.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:14:17.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:14:17.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:16 smithi191 bash[24992]: cluster 2024-08-31T04:14:15.801183+0000 mgr.a (mgr.14388) 5321 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:17.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:17 smithi163 bash[24253]: cluster 2024-08-31T04:14:15.801183+0000 mgr.a (mgr.14388) 5321 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:16 smithi027 bash[22610]: cluster 2024-08-31T04:14:15.801183+0000 mgr.a (mgr.14388) 5321 : cluster [DBG] pgmap v3687: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:17 smithi191 bash[24992]: audit 2024-08-31T04:14:16.874382+0000 mgr.a (mgr.14388) 5322 : audit [DBG] from='client.124629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:18.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:18 smithi163 bash[24253]: audit 2024-08-31T04:14:16.874382+0000 mgr.a (mgr.14388) 5322 : audit [DBG] from='client.124629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:17 smithi027 bash[22610]: audit 2024-08-31T04:14:16.874382+0000 mgr.a (mgr.14388) 5322 : audit [DBG] from='client.124629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:19 smithi191 bash[24992]: cluster 2024-08-31T04:14:17.803147+0000 mgr.a (mgr.14388) 5323 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:19.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:19 smithi163 bash[24253]: cluster 2024-08-31T04:14:17.803147+0000 mgr.a (mgr.14388) 5323 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:19 smithi027 bash[22610]: cluster 2024-08-31T04:14:17.803147+0000 mgr.a (mgr.14388) 5323 : cluster [DBG] pgmap v3688: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:14:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:21 smithi191 bash[24992]: cluster 2024-08-31T04:14:19.804369+0000 mgr.a (mgr.14388) 5324 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:14:21.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:21 smithi163 bash[24253]: cluster 2024-08-31T04:14:19.804369+0000 mgr.a (mgr.14388) 5324 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:14:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:21 smithi027 bash[22610]: cluster 2024-08-31T04:14:19.804369+0000 mgr.a (mgr.14388) 5324 : cluster [DBG] pgmap v3689: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:14:22.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:14:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:14:22.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:14:23.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:14:23.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:14:23.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:14:23.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:14:23.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:23 smithi191 bash[24992]: cluster 2024-08-31T04:14:21.805142+0000 mgr.a (mgr.14388) 5325 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:23.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:23 smithi163 bash[24253]: cluster 2024-08-31T04:14:21.805142+0000 mgr.a (mgr.14388) 5325 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:23 smithi027 bash[22610]: cluster 2024-08-31T04:14:21.805142+0000 mgr.a (mgr.14388) 5325 : cluster [DBG] pgmap v3690: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:24 smithi191 bash[24992]: audit 2024-08-31T04:14:22.626130+0000 mgr.a (mgr.14388) 5326 : audit [DBG] from='client.124707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:24.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:24 smithi163 bash[24253]: audit 2024-08-31T04:14:22.626130+0000 mgr.a (mgr.14388) 5326 : audit [DBG] from='client.124707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:24 smithi027 bash[22610]: audit 2024-08-31T04:14:22.626130+0000 mgr.a (mgr.14388) 5326 : audit [DBG] from='client.124707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:25 smithi191 bash[24992]: cluster 2024-08-31T04:14:23.807610+0000 mgr.a (mgr.14388) 5327 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:14:25.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:25 smithi163 bash[24253]: cluster 2024-08-31T04:14:23.807610+0000 mgr.a (mgr.14388) 5327 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:14:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:25 smithi027 bash[22610]: cluster 2024-08-31T04:14:23.807610+0000 mgr.a (mgr.14388) 5327 : cluster [DBG] pgmap v3691: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:14:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:27 smithi191 bash[24992]: cluster 2024-08-31T04:14:25.808432+0000 mgr.a (mgr.14388) 5328 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:14:27.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:27 smithi163 bash[24253]: cluster 2024-08-31T04:14:25.808432+0000 mgr.a (mgr.14388) 5328 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:14:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:27 smithi027 bash[22610]: cluster 2024-08-31T04:14:25.808432+0000 mgr.a (mgr.14388) 5328 : cluster [DBG] pgmap v3692: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:14:28.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:14:28.066 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:14:28.066 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:14:28.850 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:14:28.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:14:28.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:14:28.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:14:28.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:29 smithi191 bash[24992]: cluster 2024-08-31T04:14:27.810112+0000 mgr.a (mgr.14388) 5329 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:29.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:29 smithi163 bash[24253]: cluster 2024-08-31T04:14:27.810112+0000 mgr.a (mgr.14388) 5329 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:29 smithi027 bash[22610]: cluster 2024-08-31T04:14:27.810112+0000 mgr.a (mgr.14388) 5329 : cluster [DBG] pgmap v3693: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:30.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:30 smithi163 bash[24253]: audit 2024-08-31T04:14:28.405310+0000 mgr.a (mgr.14388) 5330 : audit [DBG] from='client.124779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:30 smithi027 bash[22610]: audit 2024-08-31T04:14:28.405310+0000 mgr.a (mgr.14388) 5330 : audit [DBG] from='client.124779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:30 smithi191 bash[24992]: audit 2024-08-31T04:14:28.405310+0000 mgr.a (mgr.14388) 5330 : audit [DBG] from='client.124779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:31.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:31 smithi163 bash[24253]: cluster 2024-08-31T04:14:29.811879+0000 mgr.a (mgr.14388) 5331 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:14:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:31 smithi027 bash[22610]: cluster 2024-08-31T04:14:29.811879+0000 mgr.a (mgr.14388) 5331 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:14:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:31 smithi191 bash[24992]: cluster 2024-08-31T04:14:29.811879+0000 mgr.a (mgr.14388) 5331 : cluster [DBG] pgmap v3694: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:14:33.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:33 smithi163 bash[24253]: cluster 2024-08-31T04:14:31.812665+0000 mgr.a (mgr.14388) 5332 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:14:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:33 smithi027 bash[22610]: cluster 2024-08-31T04:14:31.812665+0000 mgr.a (mgr.14388) 5332 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:14:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:33 smithi191 bash[24992]: cluster 2024-08-31T04:14:31.812665+0000 mgr.a (mgr.14388) 5332 : cluster [DBG] pgmap v3695: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:14:33.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:14:33.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:14:33.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:14:34.627 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:14:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:14:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:14:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:14:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:35.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:35 smithi163 bash[24253]: cluster 2024-08-31T04:14:33.814713+0000 mgr.a (mgr.14388) 5333 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:35.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:35 smithi163 bash[24253]: audit 2024-08-31T04:14:34.187000+0000 mgr.a (mgr.14388) 5334 : audit [DBG] from='client.124854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:35 smithi027 bash[22610]: cluster 2024-08-31T04:14:33.814713+0000 mgr.a (mgr.14388) 5333 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:35 smithi027 bash[22610]: audit 2024-08-31T04:14:34.187000+0000 mgr.a (mgr.14388) 5334 : audit [DBG] from='client.124854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:35 smithi191 bash[24992]: cluster 2024-08-31T04:14:33.814713+0000 mgr.a (mgr.14388) 5333 : cluster [DBG] pgmap v3696: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:35 smithi191 bash[24992]: audit 2024-08-31T04:14:34.187000+0000 mgr.a (mgr.14388) 5334 : audit [DBG] from='client.124854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:37.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:37 smithi163 bash[24253]: cluster 2024-08-31T04:14:35.815736+0000 mgr.a (mgr.14388) 5335 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:14:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:37 smithi027 bash[22610]: cluster 2024-08-31T04:14:35.815736+0000 mgr.a (mgr.14388) 5335 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:14:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:37 smithi191 bash[24992]: cluster 2024-08-31T04:14:35.815736+0000 mgr.a (mgr.14388) 5335 : cluster [DBG] pgmap v3697: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:14:39.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:39 smithi163 bash[24253]: cluster 2024-08-31T04:14:37.817479+0000 mgr.a (mgr.14388) 5336 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T04:14:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:39 smithi027 bash[22610]: cluster 2024-08-31T04:14:37.817479+0000 mgr.a (mgr.14388) 5336 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T04:14:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:39 smithi191 bash[24992]: cluster 2024-08-31T04:14:37.817479+0000 mgr.a (mgr.14388) 5336 : cluster [DBG] pgmap v3698: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T04:14:39.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:14:39.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:14:39.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:14:40.385 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:14:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:14:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:14:40.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:14:40.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:41.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:41 smithi163 bash[24253]: cluster 2024-08-31T04:14:39.818430+0000 mgr.a (mgr.14388) 5337 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:41.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:41 smithi163 bash[24253]: audit 2024-08-31T04:14:39.965942+0000 mgr.a (mgr.14388) 5338 : audit [DBG] from='client.124929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:41 smithi027 bash[22610]: cluster 2024-08-31T04:14:39.818430+0000 mgr.a (mgr.14388) 5337 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:41 smithi027 bash[22610]: audit 2024-08-31T04:14:39.965942+0000 mgr.a (mgr.14388) 5338 : audit [DBG] from='client.124929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:41 smithi191 bash[24992]: cluster 2024-08-31T04:14:39.818430+0000 mgr.a (mgr.14388) 5337 : cluster [DBG] pgmap v3699: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:41 smithi191 bash[24992]: audit 2024-08-31T04:14:39.965942+0000 mgr.a (mgr.14388) 5338 : audit [DBG] from='client.124929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:43.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:43 smithi163 bash[24253]: cluster 2024-08-31T04:14:41.819379+0000 mgr.a (mgr.14388) 5339 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:43 smithi027 bash[22610]: cluster 2024-08-31T04:14:41.819379+0000 mgr.a (mgr.14388) 5339 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:43 smithi191 bash[24992]: cluster 2024-08-31T04:14:41.819379+0000 mgr.a (mgr.14388) 5339 : cluster [DBG] pgmap v3700: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:45.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:14:45.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:14:45.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:14:45.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:45 smithi163 bash[24253]: cluster 2024-08-31T04:14:43.821662+0000 mgr.a (mgr.14388) 5340 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:45 smithi027 bash[22610]: cluster 2024-08-31T04:14:43.821662+0000 mgr.a (mgr.14388) 5340 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:45 smithi191 bash[24992]: cluster 2024-08-31T04:14:43.821662+0000 mgr.a (mgr.14388) 5340 : cluster [DBG] pgmap v3701: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:46.155 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:14:46.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:14:46.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:14:46.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:14:46.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:47.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:47 smithi163 bash[24253]: audit 2024-08-31T04:14:45.727110+0000 mgr.a (mgr.14388) 5341 : audit [DBG] from='client.125004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:47.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:47 smithi163 bash[24253]: cluster 2024-08-31T04:14:45.822221+0000 mgr.a (mgr.14388) 5342 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:47 smithi027 bash[22610]: audit 2024-08-31T04:14:45.727110+0000 mgr.a (mgr.14388) 5341 : audit [DBG] from='client.125004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:47 smithi027 bash[22610]: cluster 2024-08-31T04:14:45.822221+0000 mgr.a (mgr.14388) 5342 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:47 smithi191 bash[24992]: audit 2024-08-31T04:14:45.727110+0000 mgr.a (mgr.14388) 5341 : audit [DBG] from='client.125004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:47 smithi191 bash[24992]: cluster 2024-08-31T04:14:45.822221+0000 mgr.a (mgr.14388) 5342 : cluster [DBG] pgmap v3702: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:49.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:49 smithi163 bash[24253]: cluster 2024-08-31T04:14:47.824060+0000 mgr.a (mgr.14388) 5343 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:49 smithi027 bash[22610]: cluster 2024-08-31T04:14:47.824060+0000 mgr.a (mgr.14388) 5343 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:49 smithi191 bash[24992]: cluster 2024-08-31T04:14:47.824060+0000 mgr.a (mgr.14388) 5343 : cluster [DBG] pgmap v3703: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:51.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:14:51.158 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:14:51.158 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:14:51.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:51 smithi163 bash[24253]: cluster 2024-08-31T04:14:49.825279+0000 mgr.a (mgr.14388) 5344 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:14:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:51 smithi027 bash[22610]: cluster 2024-08-31T04:14:49.825279+0000 mgr.a (mgr.14388) 5344 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:14:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:51 smithi191 bash[24992]: cluster 2024-08-31T04:14:49.825279+0000 mgr.a (mgr.14388) 5344 : cluster [DBG] pgmap v3704: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:14:51.927 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:14:51.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:14:51.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:14:51.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:14:51.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:53.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:53 smithi163 bash[24253]: audit 2024-08-31T04:14:51.498399+0000 mgr.a (mgr.14388) 5345 : audit [DBG] from='client.125079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:53.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:53 smithi163 bash[24253]: cluster 2024-08-31T04:14:51.829313+0000 mgr.a (mgr.14388) 5346 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:53 smithi027 bash[22610]: audit 2024-08-31T04:14:51.498399+0000 mgr.a (mgr.14388) 5345 : audit [DBG] from='client.125079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:53 smithi027 bash[22610]: cluster 2024-08-31T04:14:51.829313+0000 mgr.a (mgr.14388) 5346 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:53 smithi191 bash[24992]: audit 2024-08-31T04:14:51.498399+0000 mgr.a (mgr.14388) 5345 : audit [DBG] from='client.125079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:53 smithi191 bash[24992]: cluster 2024-08-31T04:14:51.829313+0000 mgr.a (mgr.14388) 5346 : cluster [DBG] pgmap v3705: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:55.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:55 smithi163 bash[24253]: cluster 2024-08-31T04:14:53.831577+0000 mgr.a (mgr.14388) 5347 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:55 smithi027 bash[22610]: cluster 2024-08-31T04:14:53.831577+0000 mgr.a (mgr.14388) 5347 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:55 smithi191 bash[24992]: cluster 2024-08-31T04:14:53.831577+0000 mgr.a (mgr.14388) 5347 : cluster [DBG] pgmap v3706: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:56.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:14:56.929 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:14:56.930 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:14:57.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:57 smithi163 bash[24253]: cluster 2024-08-31T04:14:55.832329+0000 mgr.a (mgr.14388) 5348 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:57 smithi027 bash[22610]: cluster 2024-08-31T04:14:55.832329+0000 mgr.a (mgr.14388) 5348 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:57 smithi191 bash[24992]: cluster 2024-08-31T04:14:55.832329+0000 mgr.a (mgr.14388) 5348 : cluster [DBG] pgmap v3707: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:14:57.684 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:14:57.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:14:57.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:14:57.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:14:57.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:14:58.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:58 smithi163 bash[24253]: audit 2024-08-31T04:14:57.269521+0000 mgr.a (mgr.14388) 5349 : audit [DBG] from='client.125157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:58 smithi027 bash[22610]: audit 2024-08-31T04:14:57.269521+0000 mgr.a (mgr.14388) 5349 : audit [DBG] from='client.125157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:58 smithi191 bash[24992]: audit 2024-08-31T04:14:57.269521+0000 mgr.a (mgr.14388) 5349 : audit [DBG] from='client.125157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:14:59.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:14:59 smithi163 bash[24253]: cluster 2024-08-31T04:14:57.834226+0000 mgr.a (mgr.14388) 5350 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:14:59 smithi027 bash[22610]: cluster 2024-08-31T04:14:57.834226+0000 mgr.a (mgr.14388) 5350 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:14:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:14:59 smithi191 bash[24992]: cluster 2024-08-31T04:14:57.834226+0000 mgr.a (mgr.14388) 5350 : cluster [DBG] pgmap v3708: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:01.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:01 smithi163 bash[24253]: cluster 2024-08-31T04:14:59.835451+0000 mgr.a (mgr.14388) 5351 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:15:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:01 smithi027 bash[22610]: cluster 2024-08-31T04:14:59.835451+0000 mgr.a (mgr.14388) 5351 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:15:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:01 smithi191 bash[24992]: cluster 2024-08-31T04:14:59.835451+0000 mgr.a (mgr.14388) 5351 : cluster [DBG] pgmap v3709: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:15:02.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:15:02.686 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:15:02.687 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:15:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:03 smithi163 bash[24253]: cluster 2024-08-31T04:15:01.836224+0000 mgr.a (mgr.14388) 5352 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:03.461 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:15:03.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:15:03.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:15:03.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:15:03.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:15:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:03 smithi027 bash[22610]: cluster 2024-08-31T04:15:01.836224+0000 mgr.a (mgr.14388) 5352 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:03 smithi191 bash[24992]: cluster 2024-08-31T04:15:01.836224+0000 mgr.a (mgr.14388) 5352 : cluster [DBG] pgmap v3710: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:04.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:04 smithi163 bash[24253]: audit 2024-08-31T04:15:03.023574+0000 mgr.a (mgr.14388) 5353 : audit [DBG] from='client.125235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:04 smithi027 bash[22610]: audit 2024-08-31T04:15:03.023574+0000 mgr.a (mgr.14388) 5353 : audit [DBG] from='client.125235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:04 smithi191 bash[24992]: audit 2024-08-31T04:15:03.023574+0000 mgr.a (mgr.14388) 5353 : audit [DBG] from='client.125235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:05.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:05 smithi163 bash[24253]: cluster 2024-08-31T04:15:03.839015+0000 mgr.a (mgr.14388) 5354 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:05 smithi027 bash[22610]: cluster 2024-08-31T04:15:03.839015+0000 mgr.a (mgr.14388) 5354 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:05 smithi191 bash[24992]: cluster 2024-08-31T04:15:03.839015+0000 mgr.a (mgr.14388) 5354 : cluster [DBG] pgmap v3711: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:07.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:07 smithi163 bash[24253]: cluster 2024-08-31T04:15:05.839810+0000 mgr.a (mgr.14388) 5355 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:15:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:07 smithi027 bash[22610]: cluster 2024-08-31T04:15:05.839810+0000 mgr.a (mgr.14388) 5355 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:15:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:07 smithi191 bash[24992]: cluster 2024-08-31T04:15:05.839810+0000 mgr.a (mgr.14388) 5355 : cluster [DBG] pgmap v3712: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:15:08.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:08 smithi163 bash[24253]: audit 2024-08-31T04:15:07.726661+0000 mon.a (mon.0) 1393 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:15:08.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:15:08.462 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:15:08.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:15:08.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:08 smithi027 bash[22610]: audit 2024-08-31T04:15:07.726661+0000 mon.a (mon.0) 1393 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:15:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:08 smithi191 bash[24992]: audit 2024-08-31T04:15:07.726661+0000 mon.a (mon.0) 1393 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:15:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:09 smithi163 bash[24253]: cluster 2024-08-31T04:15:07.840754+0000 mgr.a (mgr.14388) 5356 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:15:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:09 smithi163 bash[24253]: audit 2024-08-31T04:15:08.547189+0000 mon.a (mon.0) 1394 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:15:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:09 smithi163 bash[24253]: audit 2024-08-31T04:15:08.547975+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:15:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:09 smithi163 bash[24253]: audit 2024-08-31T04:15:08.554292+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:15:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:09 smithi163 bash[24253]: audit 2024-08-31T04:15:08.561252+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:15:09.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:15:09 smithi027 bash[22863]: debug 2024-08-31T04:15:09.252+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:15:09.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:15:09 smithi027 bash[22863]: debug 2024-08-31T04:15:09.264+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:15:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:09 smithi027 bash[22610]: cluster 2024-08-31T04:15:07.840754+0000 mgr.a (mgr.14388) 5356 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:15:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:09 smithi027 bash[22610]: audit 2024-08-31T04:15:08.547189+0000 mon.a (mon.0) 1394 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:15:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:09 smithi027 bash[22610]: audit 2024-08-31T04:15:08.547975+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:15:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:09 smithi027 bash[22610]: audit 2024-08-31T04:15:08.554292+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:15:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:09 smithi027 bash[22610]: audit 2024-08-31T04:15:08.561252+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:15:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:09 smithi191 bash[24992]: cluster 2024-08-31T04:15:07.840754+0000 mgr.a (mgr.14388) 5356 : cluster [DBG] pgmap v3713: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:15:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:09 smithi191 bash[24992]: audit 2024-08-31T04:15:08.547189+0000 mon.a (mon.0) 1394 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:15:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:09 smithi191 bash[24992]: audit 2024-08-31T04:15:08.547975+0000 mon.a (mon.0) 1395 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:15:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:09 smithi191 bash[24992]: audit 2024-08-31T04:15:08.554292+0000 mon.a (mon.0) 1396 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:15:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:09 smithi191 bash[24992]: audit 2024-08-31T04:15:08.561252+0000 mon.a (mon.0) 1397 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:15:09.652 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:15:09.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:15:09.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:15:09.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:15:09.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:15:10.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:10 smithi163 bash[24253]: audit 2024-08-31T04:15:08.562311+0000 mgr.a (mgr.14388) 5357 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:15:10.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:10 smithi163 bash[24253]: audit 2024-08-31T04:15:08.798533+0000 mgr.a (mgr.14388) 5358 : audit [DBG] from='client.125313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:10.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:10 smithi163 bash[24253]: audit 2024-08-31T04:15:09.255730+0000 mgr.a (mgr.14388) 5359 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:15:10.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:10 smithi163 bash[24253]: cephadm 2024-08-31T04:15:09.266753+0000 mgr.a (mgr.14388) 5360 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:15:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:10 smithi027 bash[22610]: audit 2024-08-31T04:15:08.562311+0000 mgr.a (mgr.14388) 5357 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:15:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:10 smithi027 bash[22610]: audit 2024-08-31T04:15:08.798533+0000 mgr.a (mgr.14388) 5358 : audit [DBG] from='client.125313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:10 smithi027 bash[22610]: audit 2024-08-31T04:15:09.255730+0000 mgr.a (mgr.14388) 5359 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:15:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:10 smithi027 bash[22610]: cephadm 2024-08-31T04:15:09.266753+0000 mgr.a (mgr.14388) 5360 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:15:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:10 smithi191 bash[24992]: audit 2024-08-31T04:15:08.562311+0000 mgr.a (mgr.14388) 5357 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:15:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:10 smithi191 bash[24992]: audit 2024-08-31T04:15:08.798533+0000 mgr.a (mgr.14388) 5358 : audit [DBG] from='client.125313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:10 smithi191 bash[24992]: audit 2024-08-31T04:15:09.255730+0000 mgr.a (mgr.14388) 5359 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:15:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:10 smithi191 bash[24992]: cephadm 2024-08-31T04:15:09.266753+0000 mgr.a (mgr.14388) 5360 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:15:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:11 smithi163 bash[24253]: cluster 2024-08-31T04:15:09.842457+0000 mgr.a (mgr.14388) 5361 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:15:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:11 smithi027 bash[22610]: cluster 2024-08-31T04:15:09.842457+0000 mgr.a (mgr.14388) 5361 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:15:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:11 smithi191 bash[24992]: cluster 2024-08-31T04:15:09.842457+0000 mgr.a (mgr.14388) 5361 : cluster [DBG] pgmap v3714: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:15:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:13 smithi027 bash[22610]: cluster 2024-08-31T04:15:11.843275+0000 mgr.a (mgr.14388) 5362 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:15:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:13 smithi191 bash[24992]: cluster 2024-08-31T04:15:11.843275+0000 mgr.a (mgr.14388) 5362 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:15:13.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:13 smithi163 bash[24253]: cluster 2024-08-31T04:15:11.843275+0000 mgr.a (mgr.14388) 5362 : cluster [DBG] pgmap v3715: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:15:14.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:15:14.654 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:15:14.655 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:15:15.434 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:15:15.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:15:15.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:15:15.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:15:15.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:15:15.440 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:15 smithi163 bash[24253]: cluster 2024-08-31T04:15:13.845349+0000 mgr.a (mgr.14388) 5363 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:15 smithi027 bash[22610]: cluster 2024-08-31T04:15:13.845349+0000 mgr.a (mgr.14388) 5363 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:15 smithi191 bash[24992]: cluster 2024-08-31T04:15:13.845349+0000 mgr.a (mgr.14388) 5363 : cluster [DBG] pgmap v3716: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:16.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:16 smithi163 bash[24253]: audit 2024-08-31T04:15:14.991327+0000 mgr.a (mgr.14388) 5364 : audit [DBG] from='client.125499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:16 smithi027 bash[22610]: audit 2024-08-31T04:15:14.991327+0000 mgr.a (mgr.14388) 5364 : audit [DBG] from='client.125499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:16 smithi191 bash[24992]: audit 2024-08-31T04:15:14.991327+0000 mgr.a (mgr.14388) 5364 : audit [DBG] from='client.125499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:17.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:17 smithi163 bash[24253]: cluster 2024-08-31T04:15:15.846460+0000 mgr.a (mgr.14388) 5365 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:17 smithi027 bash[22610]: cluster 2024-08-31T04:15:15.846460+0000 mgr.a (mgr.14388) 5365 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:17 smithi191 bash[24992]: cluster 2024-08-31T04:15:15.846460+0000 mgr.a (mgr.14388) 5365 : cluster [DBG] pgmap v3717: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:19.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:19 smithi163 bash[24253]: cluster 2024-08-31T04:15:17.848279+0000 mgr.a (mgr.14388) 5366 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:19 smithi027 bash[22610]: cluster 2024-08-31T04:15:17.848279+0000 mgr.a (mgr.14388) 5366 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:19 smithi191 bash[24992]: cluster 2024-08-31T04:15:17.848279+0000 mgr.a (mgr.14388) 5366 : cluster [DBG] pgmap v3718: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:20.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:15:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:15:20.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:15:21.178 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:15:21.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:15:21.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:15:21.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:15:21.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:15:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:21 smithi027 bash[22610]: cluster 2024-08-31T04:15:19.849526+0000 mgr.a (mgr.14388) 5367 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:21 smithi191 bash[24992]: cluster 2024-08-31T04:15:19.849526+0000 mgr.a (mgr.14388) 5367 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:21.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:21 smithi163 bash[24253]: cluster 2024-08-31T04:15:19.849526+0000 mgr.a (mgr.14388) 5367 : cluster [DBG] pgmap v3719: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:22 smithi027 bash[22610]: audit 2024-08-31T04:15:20.769033+0000 mgr.a (mgr.14388) 5368 : audit [DBG] from='client.125574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:22 smithi191 bash[24992]: audit 2024-08-31T04:15:20.769033+0000 mgr.a (mgr.14388) 5368 : audit [DBG] from='client.125574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:22 smithi163 bash[24253]: audit 2024-08-31T04:15:20.769033+0000 mgr.a (mgr.14388) 5368 : audit [DBG] from='client.125574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:23 smithi027 bash[22610]: cluster 2024-08-31T04:15:21.850506+0000 mgr.a (mgr.14388) 5369 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:23 smithi191 bash[24992]: cluster 2024-08-31T04:15:21.850506+0000 mgr.a (mgr.14388) 5369 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:23.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:23 smithi163 bash[24253]: cluster 2024-08-31T04:15:21.850506+0000 mgr.a (mgr.14388) 5369 : cluster [DBG] pgmap v3720: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:25 smithi027 bash[22610]: cluster 2024-08-31T04:15:23.852784+0000 mgr.a (mgr.14388) 5370 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:25 smithi191 bash[24992]: cluster 2024-08-31T04:15:23.852784+0000 mgr.a (mgr.14388) 5370 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:25.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:25 smithi163 bash[24253]: cluster 2024-08-31T04:15:23.852784+0000 mgr.a (mgr.14388) 5370 : cluster [DBG] pgmap v3721: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:15:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:15:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:15:26.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:15:26.951 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:15:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:15:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:15:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:15:26.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:15:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:27 smithi027 bash[22610]: cluster 2024-08-31T04:15:25.853530+0000 mgr.a (mgr.14388) 5371 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:27 smithi191 bash[24992]: cluster 2024-08-31T04:15:25.853530+0000 mgr.a (mgr.14388) 5371 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:27.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:27 smithi163 bash[24253]: cluster 2024-08-31T04:15:25.853530+0000 mgr.a (mgr.14388) 5371 : cluster [DBG] pgmap v3722: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:28 smithi027 bash[22610]: audit 2024-08-31T04:15:26.525880+0000 mgr.a (mgr.14388) 5372 : audit [DBG] from='client.125652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:28 smithi191 bash[24992]: audit 2024-08-31T04:15:26.525880+0000 mgr.a (mgr.14388) 5372 : audit [DBG] from='client.125652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:28.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:28 smithi163 bash[24253]: audit 2024-08-31T04:15:26.525880+0000 mgr.a (mgr.14388) 5372 : audit [DBG] from='client.125652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:29 smithi027 bash[22610]: cluster 2024-08-31T04:15:27.855512+0000 mgr.a (mgr.14388) 5373 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:29 smithi191 bash[24992]: cluster 2024-08-31T04:15:27.855512+0000 mgr.a (mgr.14388) 5373 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:29.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:29 smithi163 bash[24253]: cluster 2024-08-31T04:15:27.855512+0000 mgr.a (mgr.14388) 5373 : cluster [DBG] pgmap v3723: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:31 smithi027 bash[22610]: cluster 2024-08-31T04:15:29.856742+0000 mgr.a (mgr.14388) 5374 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:15:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:31 smithi191 bash[24992]: cluster 2024-08-31T04:15:29.856742+0000 mgr.a (mgr.14388) 5374 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:15:31.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:31 smithi163 bash[24253]: cluster 2024-08-31T04:15:29.856742+0000 mgr.a (mgr.14388) 5374 : cluster [DBG] pgmap v3724: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:15:31.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:15:31.953 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:15:31.954 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:15:32.686 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:15:32.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:15:32.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:15:32.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:15:32.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:15:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:33 smithi191 bash[24992]: cluster 2024-08-31T04:15:31.857531+0000 mgr.a (mgr.14388) 5375 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:33 smithi191 bash[24992]: audit 2024-08-31T04:15:32.284811+0000 mgr.a (mgr.14388) 5376 : audit [DBG] from='client.125727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:33.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:33 smithi163 bash[24253]: cluster 2024-08-31T04:15:31.857531+0000 mgr.a (mgr.14388) 5375 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:33.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:33 smithi163 bash[24253]: audit 2024-08-31T04:15:32.284811+0000 mgr.a (mgr.14388) 5376 : audit [DBG] from='client.125727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:33 smithi027 bash[22610]: cluster 2024-08-31T04:15:31.857531+0000 mgr.a (mgr.14388) 5375 : cluster [DBG] pgmap v3725: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:33 smithi027 bash[22610]: audit 2024-08-31T04:15:32.284811+0000 mgr.a (mgr.14388) 5376 : audit [DBG] from='client.125727 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:35 smithi191 bash[24992]: cluster 2024-08-31T04:15:33.859882+0000 mgr.a (mgr.14388) 5377 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:35.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:35 smithi163 bash[24253]: cluster 2024-08-31T04:15:33.859882+0000 mgr.a (mgr.14388) 5377 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:35 smithi027 bash[22610]: cluster 2024-08-31T04:15:33.859882+0000 mgr.a (mgr.14388) 5377 : cluster [DBG] pgmap v3726: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:37 smithi191 bash[24992]: cluster 2024-08-31T04:15:35.860655+0000 mgr.a (mgr.14388) 5378 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:37.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:15:37.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:15:37.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:15:37.690 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:37 smithi163 bash[24253]: cluster 2024-08-31T04:15:35.860655+0000 mgr.a (mgr.14388) 5378 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:37 smithi027 bash[22610]: cluster 2024-08-31T04:15:35.860655+0000 mgr.a (mgr.14388) 5378 : cluster [DBG] pgmap v3727: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:38.459 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:15:38.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:15:38.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:15:38.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:15:38.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:15:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:39 smithi191 bash[24992]: cluster 2024-08-31T04:15:37.861836+0000 mgr.a (mgr.14388) 5379 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:39 smithi191 bash[24992]: audit 2024-08-31T04:15:38.026991+0000 mgr.a (mgr.14388) 5380 : audit [DBG] from='client.125805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:39.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:39 smithi163 bash[24253]: cluster 2024-08-31T04:15:37.861836+0000 mgr.a (mgr.14388) 5379 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:39.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:39 smithi163 bash[24253]: audit 2024-08-31T04:15:38.026991+0000 mgr.a (mgr.14388) 5380 : audit [DBG] from='client.125805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:39 smithi027 bash[22610]: cluster 2024-08-31T04:15:37.861836+0000 mgr.a (mgr.14388) 5379 : cluster [DBG] pgmap v3728: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:39 smithi027 bash[22610]: audit 2024-08-31T04:15:38.026991+0000 mgr.a (mgr.14388) 5380 : audit [DBG] from='client.125805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:41 smithi191 bash[24992]: cluster 2024-08-31T04:15:39.863531+0000 mgr.a (mgr.14388) 5381 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:15:41.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:41 smithi163 bash[24253]: cluster 2024-08-31T04:15:39.863531+0000 mgr.a (mgr.14388) 5381 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:15:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:41 smithi027 bash[22610]: cluster 2024-08-31T04:15:39.863531+0000 mgr.a (mgr.14388) 5381 : cluster [DBG] pgmap v3729: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:15:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:42 smithi027 bash[22610]: cluster 2024-08-31T04:15:41.864354+0000 mgr.a (mgr.14388) 5382 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:15:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:42 smithi191 bash[24992]: cluster 2024-08-31T04:15:41.864354+0000 mgr.a (mgr.14388) 5382 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:15:43.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:42 smithi163 bash[24253]: cluster 2024-08-31T04:15:41.864354+0000 mgr.a (mgr.14388) 5382 : cluster [DBG] pgmap v3730: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:15:43.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:15:43.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:15:43.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:15:44.199 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:15:44.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:15:44.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:15:44.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:15:44.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:15:45.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:44 smithi163 bash[24253]: audit 2024-08-31T04:15:43.792185+0000 mgr.a (mgr.14388) 5383 : audit [DBG] from='client.125883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:45.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:44 smithi163 bash[24253]: cluster 2024-08-31T04:15:43.865653+0000 mgr.a (mgr.14388) 5384 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:45.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:44 smithi027 bash[22610]: audit 2024-08-31T04:15:43.792185+0000 mgr.a (mgr.14388) 5383 : audit [DBG] from='client.125883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:45.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:44 smithi027 bash[22610]: cluster 2024-08-31T04:15:43.865653+0000 mgr.a (mgr.14388) 5384 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:44 smithi191 bash[24992]: audit 2024-08-31T04:15:43.792185+0000 mgr.a (mgr.14388) 5383 : audit [DBG] from='client.125883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:44 smithi191 bash[24992]: cluster 2024-08-31T04:15:43.865653+0000 mgr.a (mgr.14388) 5384 : cluster [DBG] pgmap v3731: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:47.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:46 smithi163 bash[24253]: cluster 2024-08-31T04:15:45.866489+0000 mgr.a (mgr.14388) 5385 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:15:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:46 smithi027 bash[22610]: cluster 2024-08-31T04:15:45.866489+0000 mgr.a (mgr.14388) 5385 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:15:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:46 smithi191 bash[24992]: cluster 2024-08-31T04:15:45.866489+0000 mgr.a (mgr.14388) 5385 : cluster [DBG] pgmap v3732: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:15:49.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:48 smithi163 bash[24253]: cluster 2024-08-31T04:15:47.868246+0000 mgr.a (mgr.14388) 5386 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:15:49.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:15:49.201 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:15:49.201 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:15:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:48 smithi027 bash[22610]: cluster 2024-08-31T04:15:47.868246+0000 mgr.a (mgr.14388) 5386 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:15:49.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:48 smithi191 bash[24992]: cluster 2024-08-31T04:15:47.868246+0000 mgr.a (mgr.14388) 5386 : cluster [DBG] pgmap v3733: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:15:49.979 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:15:49.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:15:49.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:15:49.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:15:49.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:15:51.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:50 smithi163 bash[24253]: audit 2024-08-31T04:15:49.540577+0000 mgr.a (mgr.14388) 5387 : audit [DBG] from='client.125961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:51.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:50 smithi163 bash[24253]: cluster 2024-08-31T04:15:49.869115+0000 mgr.a (mgr.14388) 5388 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:50 smithi027 bash[22610]: audit 2024-08-31T04:15:49.540577+0000 mgr.a (mgr.14388) 5387 : audit [DBG] from='client.125961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:50 smithi027 bash[22610]: cluster 2024-08-31T04:15:49.869115+0000 mgr.a (mgr.14388) 5388 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:50 smithi191 bash[24992]: audit 2024-08-31T04:15:49.540577+0000 mgr.a (mgr.14388) 5387 : audit [DBG] from='client.125961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:50 smithi191 bash[24992]: cluster 2024-08-31T04:15:49.869115+0000 mgr.a (mgr.14388) 5388 : cluster [DBG] pgmap v3734: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:53.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:52 smithi163 bash[24253]: cluster 2024-08-31T04:15:51.869912+0000 mgr.a (mgr.14388) 5389 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:52 smithi027 bash[22610]: cluster 2024-08-31T04:15:51.869912+0000 mgr.a (mgr.14388) 5389 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:53.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:52 smithi191 bash[24992]: cluster 2024-08-31T04:15:51.869912+0000 mgr.a (mgr.14388) 5389 : cluster [DBG] pgmap v3735: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:54.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:15:54.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:15:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:54 smithi027 bash[22610]: cluster 2024-08-31T04:15:53.872203+0000 mgr.a (mgr.14388) 5390 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:55.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:54 smithi191 bash[24992]: cluster 2024-08-31T04:15:53.872203+0000 mgr.a (mgr.14388) 5390 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:55.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:54 smithi163 bash[24253]: cluster 2024-08-31T04:15:53.872203+0000 mgr.a (mgr.14388) 5390 : cluster [DBG] pgmap v3736: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:55.750 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:15:55.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:15:55.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:15:55.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:15:55.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:15:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:55 smithi027 bash[22610]: audit 2024-08-31T04:15:55.313453+0000 mgr.a (mgr.14388) 5391 : audit [DBG] from='client.126036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:55 smithi191 bash[24992]: audit 2024-08-31T04:15:55.313453+0000 mgr.a (mgr.14388) 5391 : audit [DBG] from='client.126036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:56.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:55 smithi163 bash[24253]: audit 2024-08-31T04:15:55.313453+0000 mgr.a (mgr.14388) 5391 : audit [DBG] from='client.126036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:15:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:56 smithi027 bash[22610]: cluster 2024-08-31T04:15:55.873136+0000 mgr.a (mgr.14388) 5392 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:56 smithi191 bash[24992]: cluster 2024-08-31T04:15:55.873136+0000 mgr.a (mgr.14388) 5392 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:57.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:56 smithi163 bash[24253]: cluster 2024-08-31T04:15:55.873136+0000 mgr.a (mgr.14388) 5392 : cluster [DBG] pgmap v3737: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:15:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:15:58 smithi027 bash[22610]: cluster 2024-08-31T04:15:57.874911+0000 mgr.a (mgr.14388) 5393 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:15:58 smithi191 bash[24992]: cluster 2024-08-31T04:15:57.874911+0000 mgr.a (mgr.14388) 5393 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:15:59.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:15:58 smithi163 bash[24253]: cluster 2024-08-31T04:15:57.874911+0000 mgr.a (mgr.14388) 5393 : cluster [DBG] pgmap v3738: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:00.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:00.753 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:00 smithi027 bash[22610]: cluster 2024-08-31T04:15:59.876116+0000 mgr.a (mgr.14388) 5394 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:00 smithi191 bash[24992]: cluster 2024-08-31T04:15:59.876116+0000 mgr.a (mgr.14388) 5394 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:01.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:00 smithi163 bash[24253]: cluster 2024-08-31T04:15:59.876116+0000 mgr.a (mgr.14388) 5394 : cluster [DBG] pgmap v3739: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:01.539 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:01.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:01.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:01.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:01.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:02.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:01 smithi027 bash[22610]: audit 2024-08-31T04:16:01.101815+0000 mgr.a (mgr.14388) 5395 : audit [DBG] from='client.126111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:01 smithi191 bash[24992]: audit 2024-08-31T04:16:01.101815+0000 mgr.a (mgr.14388) 5395 : audit [DBG] from='client.126111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:02.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:01 smithi163 bash[24253]: audit 2024-08-31T04:16:01.101815+0000 mgr.a (mgr.14388) 5395 : audit [DBG] from='client.126111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:02 smithi027 bash[22610]: cluster 2024-08-31T04:16:01.877252+0000 mgr.a (mgr.14388) 5396 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:03.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:02 smithi191 bash[24992]: cluster 2024-08-31T04:16:01.877252+0000 mgr.a (mgr.14388) 5396 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:02 smithi163 bash[24253]: cluster 2024-08-31T04:16:01.877252+0000 mgr.a (mgr.14388) 5396 : cluster [DBG] pgmap v3740: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:04 smithi027 bash[22610]: cluster 2024-08-31T04:16:03.879541+0000 mgr.a (mgr.14388) 5397 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:04 smithi191 bash[24992]: cluster 2024-08-31T04:16:03.879541+0000 mgr.a (mgr.14388) 5397 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:05.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:04 smithi163 bash[24253]: cluster 2024-08-31T04:16:03.879541+0000 mgr.a (mgr.14388) 5397 : cluster [DBG] pgmap v3741: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:06.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:06.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:06.542 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:06 smithi027 bash[22610]: cluster 2024-08-31T04:16:05.880315+0000 mgr.a (mgr.14388) 5398 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:07.286 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:07.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:07.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:07.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:07.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:06 smithi191 bash[24992]: cluster 2024-08-31T04:16:05.880315+0000 mgr.a (mgr.14388) 5398 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:07.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:06 smithi163 bash[24253]: cluster 2024-08-31T04:16:05.880315+0000 mgr.a (mgr.14388) 5398 : cluster [DBG] pgmap v3742: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:07 smithi191 bash[24992]: audit 2024-08-31T04:16:06.877021+0000 mgr.a (mgr.14388) 5399 : audit [DBG] from='client.126186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:08.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:08 smithi163 bash[24253]: audit 2024-08-31T04:16:06.877021+0000 mgr.a (mgr.14388) 5399 : audit [DBG] from='client.126186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:07 smithi027 bash[22610]: audit 2024-08-31T04:16:06.877021+0000 mgr.a (mgr.14388) 5399 : audit [DBG] from='client.126186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:08 smithi191 bash[24992]: cluster 2024-08-31T04:16:07.882174+0000 mgr.a (mgr.14388) 5400 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:09 smithi163 bash[24253]: cluster 2024-08-31T04:16:07.882174+0000 mgr.a (mgr.14388) 5400 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:08 smithi027 bash[22610]: cluster 2024-08-31T04:16:07.882174+0000 mgr.a (mgr.14388) 5400 : cluster [DBG] pgmap v3743: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:10 smithi191 bash[24992]: audit 2024-08-31T04:16:09.326874+0000 mon.a (mon.0) 1398 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:16:10.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:10 smithi163 bash[24253]: audit 2024-08-31T04:16:09.326874+0000 mon.a (mon.0) 1398 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:16:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:10 smithi027 bash[22610]: audit 2024-08-31T04:16:09.326874+0000 mon.a (mon.0) 1398 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:16:11.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:16:10 smithi027 bash[22863]: debug 2024-08-31T04:16:10.922+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:16:11.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:16:10 smithi027 bash[22863]: debug 2024-08-31T04:16:10.926+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:16:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:11 smithi027 bash[22610]: cluster 2024-08-31T04:16:09.883143+0000 mgr.a (mgr.14388) 5401 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:11 smithi027 bash[22610]: audit 2024-08-31T04:16:10.168349+0000 mon.a (mon.0) 1399 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:16:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:11 smithi027 bash[22610]: audit 2024-08-31T04:16:10.170199+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:16:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:11 smithi027 bash[22610]: audit 2024-08-31T04:16:10.182169+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:16:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:11 smithi027 bash[22610]: audit 2024-08-31T04:16:10.187623+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:16:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:11 smithi027 bash[22610]: audit 2024-08-31T04:16:10.189119+0000 mgr.a (mgr.14388) 5402 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:16:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:11 smithi191 bash[24992]: cluster 2024-08-31T04:16:09.883143+0000 mgr.a (mgr.14388) 5401 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:11 smithi191 bash[24992]: audit 2024-08-31T04:16:10.168349+0000 mon.a (mon.0) 1399 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:16:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:11 smithi191 bash[24992]: audit 2024-08-31T04:16:10.170199+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:16:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:11 smithi191 bash[24992]: audit 2024-08-31T04:16:10.182169+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:16:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:11 smithi191 bash[24992]: audit 2024-08-31T04:16:10.187623+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:16:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:11 smithi191 bash[24992]: audit 2024-08-31T04:16:10.189119+0000 mgr.a (mgr.14388) 5402 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:16:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:11 smithi163 bash[24253]: cluster 2024-08-31T04:16:09.883143+0000 mgr.a (mgr.14388) 5401 : cluster [DBG] pgmap v3744: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:11 smithi163 bash[24253]: audit 2024-08-31T04:16:10.168349+0000 mon.a (mon.0) 1399 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:16:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:11 smithi163 bash[24253]: audit 2024-08-31T04:16:10.170199+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:16:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:11 smithi163 bash[24253]: audit 2024-08-31T04:16:10.182169+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:16:11.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:11 smithi163 bash[24253]: audit 2024-08-31T04:16:10.187623+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:16:11.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:11 smithi163 bash[24253]: audit 2024-08-31T04:16:10.189119+0000 mgr.a (mgr.14388) 5402 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:16:12.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:12 smithi191 bash[24992]: audit 2024-08-31T04:16:10.925804+0000 mgr.a (mgr.14388) 5403 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:16:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:12 smithi191 bash[24992]: cephadm 2024-08-31T04:16:10.927048+0000 mgr.a (mgr.14388) 5404 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:16:12.289 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:12.289 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:12.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:12 smithi163 bash[24253]: audit 2024-08-31T04:16:10.925804+0000 mgr.a (mgr.14388) 5403 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:16:12.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:12 smithi163 bash[24253]: cephadm 2024-08-31T04:16:10.927048+0000 mgr.a (mgr.14388) 5404 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:16:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:12 smithi027 bash[22610]: audit 2024-08-31T04:16:10.925804+0000 mgr.a (mgr.14388) 5403 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:16:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:12 smithi027 bash[22610]: cephadm 2024-08-31T04:16:10.927048+0000 mgr.a (mgr.14388) 5404 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:16:13.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:13.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:13.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:13.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:13.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:13 smithi191 bash[24992]: cluster 2024-08-31T04:16:11.883997+0000 mgr.a (mgr.14388) 5405 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:13.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:13 smithi163 bash[24253]: cluster 2024-08-31T04:16:11.883997+0000 mgr.a (mgr.14388) 5405 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:13 smithi027 bash[22610]: cluster 2024-08-31T04:16:11.883997+0000 mgr.a (mgr.14388) 5405 : cluster [DBG] pgmap v3745: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:14 smithi191 bash[24992]: audit 2024-08-31T04:16:12.629440+0000 mgr.a (mgr.14388) 5406 : audit [DBG] from='client.126372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:14.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:14 smithi163 bash[24253]: audit 2024-08-31T04:16:12.629440+0000 mgr.a (mgr.14388) 5406 : audit [DBG] from='client.126372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:14 smithi027 bash[22610]: audit 2024-08-31T04:16:12.629440+0000 mgr.a (mgr.14388) 5406 : audit [DBG] from='client.126372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:15 smithi191 bash[24992]: cluster 2024-08-31T04:16:13.886356+0000 mgr.a (mgr.14388) 5407 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:16:15.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:15 smithi163 bash[24253]: cluster 2024-08-31T04:16:13.886356+0000 mgr.a (mgr.14388) 5407 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:16:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:15 smithi027 bash[22610]: cluster 2024-08-31T04:16:13.886356+0000 mgr.a (mgr.14388) 5407 : cluster [DBG] pgmap v3746: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:16:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:17 smithi191 bash[24992]: cluster 2024-08-31T04:16:15.887131+0000 mgr.a (mgr.14388) 5408 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:16:17.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:17 smithi163 bash[24253]: cluster 2024-08-31T04:16:15.887131+0000 mgr.a (mgr.14388) 5408 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:16:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:17 smithi027 bash[22610]: cluster 2024-08-31T04:16:15.887131+0000 mgr.a (mgr.14388) 5408 : cluster [DBG] pgmap v3747: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:16:18.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:18.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:18.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:18.810 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:18.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:18.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:18.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:18.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:19 smithi191 bash[24992]: cluster 2024-08-31T04:16:17.888671+0000 mgr.a (mgr.14388) 5409 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:16:19.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:19 smithi163 bash[24253]: cluster 2024-08-31T04:16:17.888671+0000 mgr.a (mgr.14388) 5409 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:16:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:19 smithi027 bash[22610]: cluster 2024-08-31T04:16:17.888671+0000 mgr.a (mgr.14388) 5409 : cluster [DBG] pgmap v3748: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:16:20.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:20 smithi163 bash[24253]: audit 2024-08-31T04:16:18.397775+0000 mgr.a (mgr.14388) 5410 : audit [DBG] from='client.126450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:20 smithi027 bash[22610]: audit 2024-08-31T04:16:18.397775+0000 mgr.a (mgr.14388) 5410 : audit [DBG] from='client.126450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:20 smithi191 bash[24992]: audit 2024-08-31T04:16:18.397775+0000 mgr.a (mgr.14388) 5410 : audit [DBG] from='client.126450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:21.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:21 smithi163 bash[24253]: cluster 2024-08-31T04:16:19.890312+0000 mgr.a (mgr.14388) 5411 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:16:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:21 smithi027 bash[22610]: cluster 2024-08-31T04:16:19.890312+0000 mgr.a (mgr.14388) 5411 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:16:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:21 smithi191 bash[24992]: cluster 2024-08-31T04:16:19.890312+0000 mgr.a (mgr.14388) 5411 : cluster [DBG] pgmap v3749: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:16:23.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:23 smithi163 bash[24253]: cluster 2024-08-31T04:16:21.891120+0000 mgr.a (mgr.14388) 5412 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:16:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:23 smithi027 bash[22610]: cluster 2024-08-31T04:16:21.891120+0000 mgr.a (mgr.14388) 5412 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:16:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:23 smithi191 bash[24992]: cluster 2024-08-31T04:16:21.891120+0000 mgr.a (mgr.14388) 5412 : cluster [DBG] pgmap v3750: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:16:23.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:23.812 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:23.812 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:24.581 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:24.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:24.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:24.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:24.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:25.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:25 smithi163 bash[24253]: cluster 2024-08-31T04:16:23.893041+0000 mgr.a (mgr.14388) 5413 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:16:25.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:25 smithi163 bash[24253]: audit 2024-08-31T04:16:24.147731+0000 mgr.a (mgr.14388) 5414 : audit [DBG] from='client.126528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:25 smithi027 bash[22610]: cluster 2024-08-31T04:16:23.893041+0000 mgr.a (mgr.14388) 5413 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:16:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:25 smithi027 bash[22610]: audit 2024-08-31T04:16:24.147731+0000 mgr.a (mgr.14388) 5414 : audit [DBG] from='client.126528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:25 smithi191 bash[24992]: cluster 2024-08-31T04:16:23.893041+0000 mgr.a (mgr.14388) 5413 : cluster [DBG] pgmap v3751: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:16:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:25 smithi191 bash[24992]: audit 2024-08-31T04:16:24.147731+0000 mgr.a (mgr.14388) 5414 : audit [DBG] from='client.126528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:27.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:27 smithi163 bash[24253]: cluster 2024-08-31T04:16:25.893932+0000 mgr.a (mgr.14388) 5415 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:16:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:27 smithi027 bash[22610]: cluster 2024-08-31T04:16:25.893932+0000 mgr.a (mgr.14388) 5415 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:16:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:27 smithi191 bash[24992]: cluster 2024-08-31T04:16:25.893932+0000 mgr.a (mgr.14388) 5415 : cluster [DBG] pgmap v3752: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:16:29.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:29 smithi163 bash[24253]: cluster 2024-08-31T04:16:27.895686+0000 mgr.a (mgr.14388) 5416 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T04:16:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:29 smithi027 bash[22610]: cluster 2024-08-31T04:16:27.895686+0000 mgr.a (mgr.14388) 5416 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T04:16:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:29 smithi191 bash[24992]: cluster 2024-08-31T04:16:27.895686+0000 mgr.a (mgr.14388) 5416 : cluster [DBG] pgmap v3753: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T04:16:29.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:29.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:29.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:30.342 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:30.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:31.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:31 smithi163 bash[24253]: cluster 2024-08-31T04:16:29.896849+0000 mgr.a (mgr.14388) 5417 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:31.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:31 smithi163 bash[24253]: audit 2024-08-31T04:16:29.920651+0000 mgr.a (mgr.14388) 5418 : audit [DBG] from='client.126606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:31 smithi027 bash[22610]: cluster 2024-08-31T04:16:29.896849+0000 mgr.a (mgr.14388) 5417 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:31 smithi027 bash[22610]: audit 2024-08-31T04:16:29.920651+0000 mgr.a (mgr.14388) 5418 : audit [DBG] from='client.126606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:31 smithi191 bash[24992]: cluster 2024-08-31T04:16:29.896849+0000 mgr.a (mgr.14388) 5417 : cluster [DBG] pgmap v3754: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:31 smithi191 bash[24992]: audit 2024-08-31T04:16:29.920651+0000 mgr.a (mgr.14388) 5418 : audit [DBG] from='client.126606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:33.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:33 smithi163 bash[24253]: cluster 2024-08-31T04:16:31.897736+0000 mgr.a (mgr.14388) 5419 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:33 smithi027 bash[22610]: cluster 2024-08-31T04:16:31.897736+0000 mgr.a (mgr.14388) 5419 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:33 smithi191 bash[24992]: cluster 2024-08-31T04:16:31.897736+0000 mgr.a (mgr.14388) 5419 : cluster [DBG] pgmap v3755: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:35.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:35 smithi163 bash[24253]: cluster 2024-08-31T04:16:33.899986+0000 mgr.a (mgr.14388) 5420 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:35 smithi027 bash[22610]: cluster 2024-08-31T04:16:33.899986+0000 mgr.a (mgr.14388) 5420 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:35 smithi191 bash[24992]: cluster 2024-08-31T04:16:33.899986+0000 mgr.a (mgr.14388) 5420 : cluster [DBG] pgmap v3756: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:36.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:36.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:36.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:36.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:36.128 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:37.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:37 smithi163 bash[24253]: audit 2024-08-31T04:16:35.677548+0000 mgr.a (mgr.14388) 5421 : audit [DBG] from='client.126684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:37.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:37 smithi163 bash[24253]: cluster 2024-08-31T04:16:35.900599+0000 mgr.a (mgr.14388) 5422 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:37 smithi027 bash[22610]: audit 2024-08-31T04:16:35.677548+0000 mgr.a (mgr.14388) 5421 : audit [DBG] from='client.126684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:37 smithi027 bash[22610]: cluster 2024-08-31T04:16:35.900599+0000 mgr.a (mgr.14388) 5422 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:37 smithi191 bash[24992]: audit 2024-08-31T04:16:35.677548+0000 mgr.a (mgr.14388) 5421 : audit [DBG] from='client.126684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:37 smithi191 bash[24992]: cluster 2024-08-31T04:16:35.900599+0000 mgr.a (mgr.14388) 5422 : cluster [DBG] pgmap v3757: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:39.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:39 smithi163 bash[24253]: cluster 2024-08-31T04:16:37.902425+0000 mgr.a (mgr.14388) 5423 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:39 smithi027 bash[22610]: cluster 2024-08-31T04:16:37.902425+0000 mgr.a (mgr.14388) 5423 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:39 smithi191 bash[24992]: cluster 2024-08-31T04:16:37.902425+0000 mgr.a (mgr.14388) 5423 : cluster [DBG] pgmap v3758: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:41.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:41.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:41.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:41.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:41 smithi163 bash[24253]: cluster 2024-08-31T04:16:39.903641+0000 mgr.a (mgr.14388) 5424 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:41 smithi027 bash[22610]: cluster 2024-08-31T04:16:39.903641+0000 mgr.a (mgr.14388) 5424 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:41 smithi191 bash[24992]: cluster 2024-08-31T04:16:39.903641+0000 mgr.a (mgr.14388) 5424 : cluster [DBG] pgmap v3759: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:41.899 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:41.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:43.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:43 smithi163 bash[24253]: audit 2024-08-31T04:16:41.472242+0000 mgr.a (mgr.14388) 5425 : audit [DBG] from='client.126759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:43.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:43 smithi163 bash[24253]: cluster 2024-08-31T04:16:41.904447+0000 mgr.a (mgr.14388) 5426 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:43 smithi027 bash[22610]: audit 2024-08-31T04:16:41.472242+0000 mgr.a (mgr.14388) 5425 : audit [DBG] from='client.126759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:43 smithi027 bash[22610]: cluster 2024-08-31T04:16:41.904447+0000 mgr.a (mgr.14388) 5426 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:43 smithi191 bash[24992]: audit 2024-08-31T04:16:41.472242+0000 mgr.a (mgr.14388) 5425 : audit [DBG] from='client.126759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:43 smithi191 bash[24992]: cluster 2024-08-31T04:16:41.904447+0000 mgr.a (mgr.14388) 5426 : cluster [DBG] pgmap v3760: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:45.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:45 smithi163 bash[24253]: cluster 2024-08-31T04:16:43.906660+0000 mgr.a (mgr.14388) 5427 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:45 smithi027 bash[22610]: cluster 2024-08-31T04:16:43.906660+0000 mgr.a (mgr.14388) 5427 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:45 smithi191 bash[24992]: cluster 2024-08-31T04:16:43.906660+0000 mgr.a (mgr.14388) 5427 : cluster [DBG] pgmap v3761: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:46.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:47.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:47 smithi163 bash[24253]: cluster 2024-08-31T04:16:45.907431+0000 mgr.a (mgr.14388) 5428 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:47 smithi027 bash[22610]: cluster 2024-08-31T04:16:45.907431+0000 mgr.a (mgr.14388) 5428 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:47 smithi191 bash[24992]: cluster 2024-08-31T04:16:45.907431+0000 mgr.a (mgr.14388) 5428 : cluster [DBG] pgmap v3762: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:47.663 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:47.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:47.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:47.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:47.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:48.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:48 smithi163 bash[24253]: audit 2024-08-31T04:16:47.238591+0000 mgr.a (mgr.14388) 5429 : audit [DBG] from='client.126831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:48 smithi027 bash[22610]: audit 2024-08-31T04:16:47.238591+0000 mgr.a (mgr.14388) 5429 : audit [DBG] from='client.126831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:48 smithi191 bash[24992]: audit 2024-08-31T04:16:47.238591+0000 mgr.a (mgr.14388) 5429 : audit [DBG] from='client.126831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:49.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:49 smithi163 bash[24253]: cluster 2024-08-31T04:16:47.909224+0000 mgr.a (mgr.14388) 5430 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:49 smithi027 bash[22610]: cluster 2024-08-31T04:16:47.909224+0000 mgr.a (mgr.14388) 5430 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:49 smithi191 bash[24992]: cluster 2024-08-31T04:16:47.909224+0000 mgr.a (mgr.14388) 5430 : cluster [DBG] pgmap v3763: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:16:51.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:51 smithi163 bash[24253]: cluster 2024-08-31T04:16:49.910429+0000 mgr.a (mgr.14388) 5431 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:51 smithi027 bash[22610]: cluster 2024-08-31T04:16:49.910429+0000 mgr.a (mgr.14388) 5431 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:51 smithi191 bash[24992]: cluster 2024-08-31T04:16:49.910429+0000 mgr.a (mgr.14388) 5431 : cluster [DBG] pgmap v3764: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:16:52.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:52.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:52.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:53.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:53 smithi163 bash[24253]: cluster 2024-08-31T04:16:51.911200+0000 mgr.a (mgr.14388) 5432 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:53.442 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:53.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:53.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:53.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:53.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:53.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:53 smithi027 bash[22610]: cluster 2024-08-31T04:16:51.911200+0000 mgr.a (mgr.14388) 5432 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:53 smithi191 bash[24992]: cluster 2024-08-31T04:16:51.911200+0000 mgr.a (mgr.14388) 5432 : cluster [DBG] pgmap v3765: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:54.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:54 smithi163 bash[24253]: audit 2024-08-31T04:16:53.003348+0000 mgr.a (mgr.14388) 5433 : audit [DBG] from='client.126909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:54 smithi027 bash[22610]: audit 2024-08-31T04:16:53.003348+0000 mgr.a (mgr.14388) 5433 : audit [DBG] from='client.126909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:54 smithi191 bash[24992]: audit 2024-08-31T04:16:53.003348+0000 mgr.a (mgr.14388) 5433 : audit [DBG] from='client.126909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:16:55.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:55 smithi163 bash[24253]: cluster 2024-08-31T04:16:53.913821+0000 mgr.a (mgr.14388) 5434 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:55 smithi027 bash[22610]: cluster 2024-08-31T04:16:53.913821+0000 mgr.a (mgr.14388) 5434 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:55 smithi191 bash[24992]: cluster 2024-08-31T04:16:53.913821+0000 mgr.a (mgr.14388) 5434 : cluster [DBG] pgmap v3766: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:16:57.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:57 smithi163 bash[24253]: cluster 2024-08-31T04:16:55.914595+0000 mgr.a (mgr.14388) 5435 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:16:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:57 smithi027 bash[22610]: cluster 2024-08-31T04:16:55.914595+0000 mgr.a (mgr.14388) 5435 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:16:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:57 smithi191 bash[24992]: cluster 2024-08-31T04:16:55.914595+0000 mgr.a (mgr.14388) 5435 : cluster [DBG] pgmap v3767: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:16:58.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:16:58.444 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:16:58.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:16:59.192 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:16:59.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:16:59.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:16:59.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:16:59.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:16:59.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:16:59 smithi163 bash[24253]: cluster 2024-08-31T04:16:57.916119+0000 mgr.a (mgr.14388) 5436 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:16:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:16:59 smithi027 bash[22610]: cluster 2024-08-31T04:16:57.916119+0000 mgr.a (mgr.14388) 5436 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:16:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:16:59 smithi191 bash[24992]: cluster 2024-08-31T04:16:57.916119+0000 mgr.a (mgr.14388) 5436 : cluster [DBG] pgmap v3768: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:17:00.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:00 smithi163 bash[24253]: audit 2024-08-31T04:16:58.776948+0000 mgr.a (mgr.14388) 5437 : audit [DBG] from='client.126984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:00 smithi027 bash[22610]: audit 2024-08-31T04:16:58.776948+0000 mgr.a (mgr.14388) 5437 : audit [DBG] from='client.126984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:00 smithi191 bash[24992]: audit 2024-08-31T04:16:58.776948+0000 mgr.a (mgr.14388) 5437 : audit [DBG] from='client.126984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:01.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:01 smithi163 bash[24253]: cluster 2024-08-31T04:16:59.917715+0000 mgr.a (mgr.14388) 5438 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:17:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:01 smithi027 bash[22610]: cluster 2024-08-31T04:16:59.917715+0000 mgr.a (mgr.14388) 5438 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:17:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:01 smithi191 bash[24992]: cluster 2024-08-31T04:16:59.917715+0000 mgr.a (mgr.14388) 5438 : cluster [DBG] pgmap v3769: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:17:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:03 smithi163 bash[24253]: cluster 2024-08-31T04:17:01.918482+0000 mgr.a (mgr.14388) 5439 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:17:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:03 smithi027 bash[22610]: cluster 2024-08-31T04:17:01.918482+0000 mgr.a (mgr.14388) 5439 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:17:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:03 smithi191 bash[24992]: cluster 2024-08-31T04:17:01.918482+0000 mgr.a (mgr.14388) 5439 : cluster [DBG] pgmap v3770: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:17:04.194 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:17:04.195 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:17:04.195 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:17:04.979 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:17:04.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:17:04.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:17:04.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:17:04.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:17:05.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:05 smithi163 bash[24253]: cluster 2024-08-31T04:17:03.920507+0000 mgr.a (mgr.14388) 5440 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:05 smithi027 bash[22610]: cluster 2024-08-31T04:17:03.920507+0000 mgr.a (mgr.14388) 5440 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:05 smithi191 bash[24992]: cluster 2024-08-31T04:17:03.920507+0000 mgr.a (mgr.14388) 5440 : cluster [DBG] pgmap v3771: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:06.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:06 smithi163 bash[24253]: audit 2024-08-31T04:17:04.533736+0000 mgr.a (mgr.14388) 5441 : audit [DBG] from='client.127059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:06 smithi027 bash[22610]: audit 2024-08-31T04:17:04.533736+0000 mgr.a (mgr.14388) 5441 : audit [DBG] from='client.127059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:06 smithi191 bash[24992]: audit 2024-08-31T04:17:04.533736+0000 mgr.a (mgr.14388) 5441 : audit [DBG] from='client.127059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:07.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:07 smithi163 bash[24253]: cluster 2024-08-31T04:17:05.921378+0000 mgr.a (mgr.14388) 5442 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:07 smithi027 bash[22610]: cluster 2024-08-31T04:17:05.921378+0000 mgr.a (mgr.14388) 5442 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:07 smithi191 bash[24992]: cluster 2024-08-31T04:17:05.921378+0000 mgr.a (mgr.14388) 5442 : cluster [DBG] pgmap v3772: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:09 smithi163 bash[24253]: cluster 2024-08-31T04:17:07.923151+0000 mgr.a (mgr.14388) 5443 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:09 smithi027 bash[22610]: cluster 2024-08-31T04:17:07.923151+0000 mgr.a (mgr.14388) 5443 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:09 smithi191 bash[24992]: cluster 2024-08-31T04:17:07.923151+0000 mgr.a (mgr.14388) 5443 : cluster [DBG] pgmap v3773: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:09.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:17:09.982 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:17:09.982 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:17:10.757 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:17:10.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:17:10.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:17:10.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:17:10.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:17:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:11 smithi163 bash[24253]: cluster 2024-08-31T04:17:09.924375+0000 mgr.a (mgr.14388) 5444 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:17:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:11 smithi163 bash[24253]: audit 2024-08-31T04:17:10.320095+0000 mgr.a (mgr.14388) 5445 : audit [DBG] from='client.127134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:11 smithi163 bash[24253]: audit 2024-08-31T04:17:10.980991+0000 mon.a (mon.0) 1403 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:17:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:11 smithi027 bash[22610]: cluster 2024-08-31T04:17:09.924375+0000 mgr.a (mgr.14388) 5444 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:17:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:11 smithi027 bash[22610]: audit 2024-08-31T04:17:10.320095+0000 mgr.a (mgr.14388) 5445 : audit [DBG] from='client.127134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:11 smithi027 bash[22610]: audit 2024-08-31T04:17:10.980991+0000 mon.a (mon.0) 1403 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:17:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:11 smithi191 bash[24992]: cluster 2024-08-31T04:17:09.924375+0000 mgr.a (mgr.14388) 5444 : cluster [DBG] pgmap v3774: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:17:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:11 smithi191 bash[24992]: audit 2024-08-31T04:17:10.320095+0000 mgr.a (mgr.14388) 5445 : audit [DBG] from='client.127134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:11 smithi191 bash[24992]: audit 2024-08-31T04:17:10.980991+0000 mon.a (mon.0) 1403 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:17:12.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:12 smithi163 bash[24253]: audit 2024-08-31T04:17:11.778707+0000 mon.a (mon.0) 1404 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:17:12.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:12 smithi163 bash[24253]: audit 2024-08-31T04:17:11.780124+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:17:12.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:12 smithi163 bash[24253]: audit 2024-08-31T04:17:11.790063+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:17:12.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:12 smithi163 bash[24253]: audit 2024-08-31T04:17:11.794847+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:17:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:12 smithi027 bash[22610]: audit 2024-08-31T04:17:11.778707+0000 mon.a (mon.0) 1404 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:17:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:12 smithi027 bash[22610]: audit 2024-08-31T04:17:11.780124+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:17:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:12 smithi027 bash[22610]: audit 2024-08-31T04:17:11.790063+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:17:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:12 smithi027 bash[22610]: audit 2024-08-31T04:17:11.794847+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:17:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:12 smithi191 bash[24992]: audit 2024-08-31T04:17:11.778707+0000 mon.a (mon.0) 1404 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:17:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:12 smithi191 bash[24992]: audit 2024-08-31T04:17:11.780124+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:17:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:12 smithi191 bash[24992]: audit 2024-08-31T04:17:11.790063+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:17:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:12 smithi191 bash[24992]: audit 2024-08-31T04:17:11.794847+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:17:12.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:17:12 smithi027 bash[22863]: debug 2024-08-31T04:17:12.504+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:17:12.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:17:12 smithi027 bash[22863]: debug 2024-08-31T04:17:12.504+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:17:13.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:13 smithi163 bash[24253]: audit 2024-08-31T04:17:11.797519+0000 mgr.a (mgr.14388) 5446 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:17:13.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:13 smithi163 bash[24253]: cluster 2024-08-31T04:17:11.924910+0000 mgr.a (mgr.14388) 5447 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:13 smithi027 bash[22610]: audit 2024-08-31T04:17:11.797519+0000 mgr.a (mgr.14388) 5446 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:17:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:13 smithi027 bash[22610]: cluster 2024-08-31T04:17:11.924910+0000 mgr.a (mgr.14388) 5447 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:13 smithi191 bash[24992]: audit 2024-08-31T04:17:11.797519+0000 mgr.a (mgr.14388) 5446 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:17:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:13 smithi191 bash[24992]: cluster 2024-08-31T04:17:11.924910+0000 mgr.a (mgr.14388) 5447 : cluster [DBG] pgmap v3775: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:14 smithi027 bash[22610]: audit 2024-08-31T04:17:12.508669+0000 mgr.a (mgr.14388) 5448 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:17:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:14 smithi027 bash[22610]: cephadm 2024-08-31T04:17:12.509802+0000 mgr.a (mgr.14388) 5449 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:17:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:14 smithi191 bash[24992]: audit 2024-08-31T04:17:12.508669+0000 mgr.a (mgr.14388) 5448 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:17:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:14 smithi191 bash[24992]: cephadm 2024-08-31T04:17:12.509802+0000 mgr.a (mgr.14388) 5449 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:17:14.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:14 smithi163 bash[24253]: audit 2024-08-31T04:17:12.508669+0000 mgr.a (mgr.14388) 5448 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:17:14.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:14 smithi163 bash[24253]: cephadm 2024-08-31T04:17:12.509802+0000 mgr.a (mgr.14388) 5449 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:17:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:15 smithi027 bash[22610]: cluster 2024-08-31T04:17:13.927303+0000 mgr.a (mgr.14388) 5450 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:15.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:15 smithi191 bash[24992]: cluster 2024-08-31T04:17:13.927303+0000 mgr.a (mgr.14388) 5450 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:15.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:15 smithi163 bash[24253]: cluster 2024-08-31T04:17:13.927303+0000 mgr.a (mgr.14388) 5450 : cluster [DBG] pgmap v3776: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:15.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:17:15.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:17:15.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:17:16.543 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:17:16.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:17:16.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:17:16.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:17:16.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:17:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:17 smithi027 bash[22610]: cluster 2024-08-31T04:17:15.928163+0000 mgr.a (mgr.14388) 5451 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:17 smithi027 bash[22610]: audit 2024-08-31T04:17:16.097002+0000 mgr.a (mgr.14388) 5452 : audit [DBG] from='client.127320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:17 smithi191 bash[24992]: cluster 2024-08-31T04:17:15.928163+0000 mgr.a (mgr.14388) 5451 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:17 smithi191 bash[24992]: audit 2024-08-31T04:17:16.097002+0000 mgr.a (mgr.14388) 5452 : audit [DBG] from='client.127320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:17.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:17 smithi163 bash[24253]: cluster 2024-08-31T04:17:15.928163+0000 mgr.a (mgr.14388) 5451 : cluster [DBG] pgmap v3777: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:17.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:17 smithi163 bash[24253]: audit 2024-08-31T04:17:16.097002+0000 mgr.a (mgr.14388) 5452 : audit [DBG] from='client.127320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:19 smithi027 bash[22610]: cluster 2024-08-31T04:17:17.930051+0000 mgr.a (mgr.14388) 5453 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:19 smithi191 bash[24992]: cluster 2024-08-31T04:17:17.930051+0000 mgr.a (mgr.14388) 5453 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:19.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:19 smithi163 bash[24253]: cluster 2024-08-31T04:17:17.930051+0000 mgr.a (mgr.14388) 5453 : cluster [DBG] pgmap v3778: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:21 smithi027 bash[22610]: cluster 2024-08-31T04:17:19.931294+0000 mgr.a (mgr.14388) 5454 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:21 smithi191 bash[24992]: cluster 2024-08-31T04:17:19.931294+0000 mgr.a (mgr.14388) 5454 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:21.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:17:21.545 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:17:21.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:17:21.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:21 smithi163 bash[24253]: cluster 2024-08-31T04:17:19.931294+0000 mgr.a (mgr.14388) 5454 : cluster [DBG] pgmap v3779: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:22.307 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:17:22.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:17:22.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:17:22.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:17:22.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:17:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:23 smithi027 bash[22610]: audit 2024-08-31T04:17:21.876903+0000 mgr.a (mgr.14388) 5455 : audit [DBG] from='client.127398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:23 smithi027 bash[22610]: cluster 2024-08-31T04:17:21.932194+0000 mgr.a (mgr.14388) 5456 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:23 smithi191 bash[24992]: audit 2024-08-31T04:17:21.876903+0000 mgr.a (mgr.14388) 5455 : audit [DBG] from='client.127398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:23 smithi191 bash[24992]: cluster 2024-08-31T04:17:21.932194+0000 mgr.a (mgr.14388) 5456 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:23.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:23 smithi163 bash[24253]: audit 2024-08-31T04:17:21.876903+0000 mgr.a (mgr.14388) 5455 : audit [DBG] from='client.127398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:23.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:23 smithi163 bash[24253]: cluster 2024-08-31T04:17:21.932194+0000 mgr.a (mgr.14388) 5456 : cluster [DBG] pgmap v3780: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:25 smithi027 bash[22610]: cluster 2024-08-31T04:17:23.934628+0000 mgr.a (mgr.14388) 5457 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:25 smithi191 bash[24992]: cluster 2024-08-31T04:17:23.934628+0000 mgr.a (mgr.14388) 5457 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:25.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:25 smithi163 bash[24253]: cluster 2024-08-31T04:17:23.934628+0000 mgr.a (mgr.14388) 5457 : cluster [DBG] pgmap v3781: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:17:27.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:17:27.309 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:17:27.309 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:17:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:27 smithi027 bash[22610]: cluster 2024-08-31T04:17:25.935406+0000 mgr.a (mgr.14388) 5458 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:27 smithi191 bash[24992]: cluster 2024-08-31T04:17:25.935406+0000 mgr.a (mgr.14388) 5458 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:27.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:27 smithi163 bash[24253]: cluster 2024-08-31T04:17:25.935406+0000 mgr.a (mgr.14388) 5458 : cluster [DBG] pgmap v3782: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:28.050 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:17:28.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:17:28.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:17:28.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:17:28.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:17:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:29 smithi027 bash[22610]: audit 2024-08-31T04:17:27.641594+0000 mgr.a (mgr.14388) 5459 : audit [DBG] from='client.127473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:29 smithi027 bash[22610]: cluster 2024-08-31T04:17:27.936420+0000 mgr.a (mgr.14388) 5460 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:29 smithi191 bash[24992]: audit 2024-08-31T04:17:27.641594+0000 mgr.a (mgr.14388) 5459 : audit [DBG] from='client.127473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:29 smithi191 bash[24992]: cluster 2024-08-31T04:17:27.936420+0000 mgr.a (mgr.14388) 5460 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:29.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:29 smithi163 bash[24253]: audit 2024-08-31T04:17:27.641594+0000 mgr.a (mgr.14388) 5459 : audit [DBG] from='client.127473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:29.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:29 smithi163 bash[24253]: cluster 2024-08-31T04:17:27.936420+0000 mgr.a (mgr.14388) 5460 : cluster [DBG] pgmap v3783: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:31 smithi027 bash[22610]: cluster 2024-08-31T04:17:29.937881+0000 mgr.a (mgr.14388) 5461 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T04:17:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:31 smithi191 bash[24992]: cluster 2024-08-31T04:17:29.937881+0000 mgr.a (mgr.14388) 5461 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T04:17:31.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:31 smithi163 bash[24253]: cluster 2024-08-31T04:17:29.937881+0000 mgr.a (mgr.14388) 5461 : cluster [DBG] pgmap v3784: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T04:17:33.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:17:33.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:17:33.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:17:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:33 smithi191 bash[24992]: cluster 2024-08-31T04:17:31.938666+0000 mgr.a (mgr.14388) 5462 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:17:33.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:33 smithi163 bash[24253]: cluster 2024-08-31T04:17:31.938666+0000 mgr.a (mgr.14388) 5462 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:17:33.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:33 smithi027 bash[22610]: cluster 2024-08-31T04:17:31.938666+0000 mgr.a (mgr.14388) 5462 : cluster [DBG] pgmap v3785: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:17:33.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:17:33.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:17:33.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:17:33.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:17:33.792 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:17:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:34 smithi191 bash[24992]: audit 2024-08-31T04:17:33.383322+0000 mgr.a (mgr.14388) 5463 : audit [DBG] from='client.127551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:34.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:34 smithi163 bash[24253]: audit 2024-08-31T04:17:33.383322+0000 mgr.a (mgr.14388) 5463 : audit [DBG] from='client.127551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:34 smithi027 bash[22610]: audit 2024-08-31T04:17:33.383322+0000 mgr.a (mgr.14388) 5463 : audit [DBG] from='client.127551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:35 smithi191 bash[24992]: cluster 2024-08-31T04:17:33.941363+0000 mgr.a (mgr.14388) 5464 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:35.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:35 smithi163 bash[24253]: cluster 2024-08-31T04:17:33.941363+0000 mgr.a (mgr.14388) 5464 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:35 smithi027 bash[22610]: cluster 2024-08-31T04:17:33.941363+0000 mgr.a (mgr.14388) 5464 : cluster [DBG] pgmap v3786: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:37 smithi191 bash[24992]: cluster 2024-08-31T04:17:35.942291+0000 mgr.a (mgr.14388) 5465 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:17:37.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:37 smithi163 bash[24253]: cluster 2024-08-31T04:17:35.942291+0000 mgr.a (mgr.14388) 5465 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:17:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:37 smithi027 bash[22610]: cluster 2024-08-31T04:17:35.942291+0000 mgr.a (mgr.14388) 5465 : cluster [DBG] pgmap v3787: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:17:38.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:17:38.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:17:38.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:17:39.536 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:17:39.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:17:39.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:17:39.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:17:39.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:17:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:39 smithi191 bash[24992]: cluster 2024-08-31T04:17:37.943889+0000 mgr.a (mgr.14388) 5466 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:17:39.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:39 smithi163 bash[24253]: cluster 2024-08-31T04:17:37.943889+0000 mgr.a (mgr.14388) 5466 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:17:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:39 smithi027 bash[22610]: cluster 2024-08-31T04:17:37.943889+0000 mgr.a (mgr.14388) 5466 : cluster [DBG] pgmap v3788: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:17:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:40 smithi191 bash[24992]: audit 2024-08-31T04:17:39.127621+0000 mgr.a (mgr.14388) 5467 : audit [DBG] from='client.127629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:40.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:40 smithi163 bash[24253]: audit 2024-08-31T04:17:39.127621+0000 mgr.a (mgr.14388) 5467 : audit [DBG] from='client.127629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:40 smithi027 bash[22610]: audit 2024-08-31T04:17:39.127621+0000 mgr.a (mgr.14388) 5467 : audit [DBG] from='client.127629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:41 smithi191 bash[24992]: cluster 2024-08-31T04:17:39.945634+0000 mgr.a (mgr.14388) 5468 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:41.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:41 smithi163 bash[24253]: cluster 2024-08-31T04:17:39.945634+0000 mgr.a (mgr.14388) 5468 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:41 smithi027 bash[22610]: cluster 2024-08-31T04:17:39.945634+0000 mgr.a (mgr.14388) 5468 : cluster [DBG] pgmap v3789: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:43 smithi191 bash[24992]: cluster 2024-08-31T04:17:41.946446+0000 mgr.a (mgr.14388) 5469 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:17:43.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:43 smithi163 bash[24253]: cluster 2024-08-31T04:17:41.946446+0000 mgr.a (mgr.14388) 5469 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:17:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:43 smithi027 bash[22610]: cluster 2024-08-31T04:17:41.946446+0000 mgr.a (mgr.14388) 5469 : cluster [DBG] pgmap v3790: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:17:44.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:17:44.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:17:44.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:17:45.318 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:17:45.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:17:45.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:17:45.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:17:45.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:17:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:45 smithi191 bash[24992]: cluster 2024-08-31T04:17:43.948528+0000 mgr.a (mgr.14388) 5470 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:45.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:45 smithi163 bash[24253]: cluster 2024-08-31T04:17:43.948528+0000 mgr.a (mgr.14388) 5470 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:45 smithi027 bash[22610]: cluster 2024-08-31T04:17:43.948528+0000 mgr.a (mgr.14388) 5470 : cluster [DBG] pgmap v3791: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:46 smithi191 bash[24992]: audit 2024-08-31T04:17:44.874834+0000 mgr.a (mgr.14388) 5471 : audit [DBG] from='client.127704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:46.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:46 smithi163 bash[24253]: audit 2024-08-31T04:17:44.874834+0000 mgr.a (mgr.14388) 5471 : audit [DBG] from='client.127704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:46 smithi027 bash[22610]: audit 2024-08-31T04:17:44.874834+0000 mgr.a (mgr.14388) 5471 : audit [DBG] from='client.127704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:47 smithi191 bash[24992]: cluster 2024-08-31T04:17:45.949495+0000 mgr.a (mgr.14388) 5472 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:47.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:47 smithi163 bash[24253]: cluster 2024-08-31T04:17:45.949495+0000 mgr.a (mgr.14388) 5472 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:47 smithi027 bash[22610]: cluster 2024-08-31T04:17:45.949495+0000 mgr.a (mgr.14388) 5472 : cluster [DBG] pgmap v3792: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:49.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:49 smithi163 bash[24253]: cluster 2024-08-31T04:17:47.951298+0000 mgr.a (mgr.14388) 5473 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:49 smithi027 bash[22610]: cluster 2024-08-31T04:17:47.951298+0000 mgr.a (mgr.14388) 5473 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:49 smithi191 bash[24992]: cluster 2024-08-31T04:17:47.951298+0000 mgr.a (mgr.14388) 5473 : cluster [DBG] pgmap v3793: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:17:50.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:17:50.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:17:51.068 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:17:51.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:17:51.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:17:51.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:17:51.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:17:51.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:51 smithi163 bash[24253]: cluster 2024-08-31T04:17:49.952491+0000 mgr.a (mgr.14388) 5474 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:17:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:51 smithi027 bash[22610]: cluster 2024-08-31T04:17:49.952491+0000 mgr.a (mgr.14388) 5474 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:17:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:51 smithi191 bash[24992]: cluster 2024-08-31T04:17:49.952491+0000 mgr.a (mgr.14388) 5474 : cluster [DBG] pgmap v3794: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:17:52.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:52 smithi163 bash[24253]: audit 2024-08-31T04:17:50.651228+0000 mgr.a (mgr.14388) 5475 : audit [DBG] from='client.127782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:52 smithi027 bash[22610]: audit 2024-08-31T04:17:50.651228+0000 mgr.a (mgr.14388) 5475 : audit [DBG] from='client.127782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:52 smithi191 bash[24992]: audit 2024-08-31T04:17:50.651228+0000 mgr.a (mgr.14388) 5475 : audit [DBG] from='client.127782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:53.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:53 smithi163 bash[24253]: cluster 2024-08-31T04:17:51.953434+0000 mgr.a (mgr.14388) 5476 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:53 smithi027 bash[22610]: cluster 2024-08-31T04:17:51.953434+0000 mgr.a (mgr.14388) 5476 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:53 smithi191 bash[24992]: cluster 2024-08-31T04:17:51.953434+0000 mgr.a (mgr.14388) 5476 : cluster [DBG] pgmap v3795: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:55.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:55 smithi163 bash[24253]: cluster 2024-08-31T04:17:53.955702+0000 mgr.a (mgr.14388) 5477 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:55 smithi027 bash[22610]: cluster 2024-08-31T04:17:53.955702+0000 mgr.a (mgr.14388) 5477 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:55 smithi191 bash[24992]: cluster 2024-08-31T04:17:53.955702+0000 mgr.a (mgr.14388) 5477 : cluster [DBG] pgmap v3796: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:56.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:17:56.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:17:56.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:17:56.849 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:17:56.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:17:56.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:17:56.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:17:56.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:17:57.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:57 smithi163 bash[24253]: cluster 2024-08-31T04:17:55.956455+0000 mgr.a (mgr.14388) 5478 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:57.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:57 smithi163 bash[24253]: audit 2024-08-31T04:17:56.410472+0000 mgr.a (mgr.14388) 5479 : audit [DBG] from='client.127860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:57 smithi027 bash[22610]: cluster 2024-08-31T04:17:55.956455+0000 mgr.a (mgr.14388) 5478 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:57 smithi027 bash[22610]: audit 2024-08-31T04:17:56.410472+0000 mgr.a (mgr.14388) 5479 : audit [DBG] from='client.127860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:57 smithi191 bash[24992]: cluster 2024-08-31T04:17:55.956455+0000 mgr.a (mgr.14388) 5478 : cluster [DBG] pgmap v3797: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:17:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:57 smithi191 bash[24992]: audit 2024-08-31T04:17:56.410472+0000 mgr.a (mgr.14388) 5479 : audit [DBG] from='client.127860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:17:59.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:17:59 smithi163 bash[24253]: cluster 2024-08-31T04:17:57.958333+0000 mgr.a (mgr.14388) 5480 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:17:59 smithi027 bash[22610]: cluster 2024-08-31T04:17:57.958333+0000 mgr.a (mgr.14388) 5480 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:17:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:17:59 smithi191 bash[24992]: cluster 2024-08-31T04:17:57.958333+0000 mgr.a (mgr.14388) 5480 : cluster [DBG] pgmap v3798: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:18:01.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:01 smithi163 bash[24253]: cluster 2024-08-31T04:17:59.959532+0000 mgr.a (mgr.14388) 5481 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:18:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:01 smithi027 bash[22610]: cluster 2024-08-31T04:17:59.959532+0000 mgr.a (mgr.14388) 5481 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:18:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:01 smithi191 bash[24992]: cluster 2024-08-31T04:17:59.959532+0000 mgr.a (mgr.14388) 5481 : cluster [DBG] pgmap v3799: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:18:01.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:01.851 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:01.852 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:18:02.622 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:18:02.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:18:02.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:18:02.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:18:02.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:18:03.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:03 smithi163 bash[24253]: cluster 2024-08-31T04:18:01.960004+0000 mgr.a (mgr.14388) 5482 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:03.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:03 smithi163 bash[24253]: audit 2024-08-31T04:18:02.185747+0000 mgr.a (mgr.14388) 5483 : audit [DBG] from='client.127938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:03 smithi027 bash[22610]: cluster 2024-08-31T04:18:01.960004+0000 mgr.a (mgr.14388) 5482 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:03 smithi027 bash[22610]: audit 2024-08-31T04:18:02.185747+0000 mgr.a (mgr.14388) 5483 : audit [DBG] from='client.127938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:03 smithi191 bash[24992]: cluster 2024-08-31T04:18:01.960004+0000 mgr.a (mgr.14388) 5482 : cluster [DBG] pgmap v3800: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:03 smithi191 bash[24992]: audit 2024-08-31T04:18:02.185747+0000 mgr.a (mgr.14388) 5483 : audit [DBG] from='client.127938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:05.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:05 smithi163 bash[24253]: cluster 2024-08-31T04:18:03.962331+0000 mgr.a (mgr.14388) 5484 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:18:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:05 smithi027 bash[22610]: cluster 2024-08-31T04:18:03.962331+0000 mgr.a (mgr.14388) 5484 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:18:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:05 smithi191 bash[24992]: cluster 2024-08-31T04:18:03.962331+0000 mgr.a (mgr.14388) 5484 : cluster [DBG] pgmap v3801: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:18:07.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:07.625 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:07.625 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:18:07.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:07 smithi163 bash[24253]: cluster 2024-08-31T04:18:05.963298+0000 mgr.a (mgr.14388) 5485 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:07.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:07 smithi027 bash[22610]: cluster 2024-08-31T04:18:05.963298+0000 mgr.a (mgr.14388) 5485 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:07 smithi191 bash[24992]: cluster 2024-08-31T04:18:05.963298+0000 mgr.a (mgr.14388) 5485 : cluster [DBG] pgmap v3802: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:08.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:18:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:18:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:18:08.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:18:08.406 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:18:09.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:09 smithi163 bash[24253]: audit 2024-08-31T04:18:07.961525+0000 mgr.a (mgr.14388) 5486 : audit [DBG] from='client.128010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:09.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:09 smithi163 bash[24253]: cluster 2024-08-31T04:18:07.978504+0000 mgr.a (mgr.14388) 5487 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:09 smithi027 bash[22610]: audit 2024-08-31T04:18:07.961525+0000 mgr.a (mgr.14388) 5486 : audit [DBG] from='client.128010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:09 smithi027 bash[22610]: cluster 2024-08-31T04:18:07.978504+0000 mgr.a (mgr.14388) 5487 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:09 smithi191 bash[24992]: audit 2024-08-31T04:18:07.961525+0000 mgr.a (mgr.14388) 5486 : audit [DBG] from='client.128010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:09 smithi191 bash[24992]: cluster 2024-08-31T04:18:07.978504+0000 mgr.a (mgr.14388) 5487 : cluster [DBG] pgmap v3803: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:11.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:11 smithi163 bash[24253]: cluster 2024-08-31T04:18:09.980231+0000 mgr.a (mgr.14388) 5488 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-08-31T04:18:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:11 smithi027 bash[22610]: cluster 2024-08-31T04:18:09.980231+0000 mgr.a (mgr.14388) 5488 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-08-31T04:18:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:11 smithi191 bash[24992]: cluster 2024-08-31T04:18:09.980231+0000 mgr.a (mgr.14388) 5488 : cluster [DBG] pgmap v3804: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1022 B/s rd, 0 op/s 2024-08-31T04:18:13.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:13.408 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:13.408 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:18:13.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:13 smithi163 bash[24253]: cluster 2024-08-31T04:18:11.981037+0000 mgr.a (mgr.14388) 5489 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T04:18:13.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:13 smithi163 bash[24253]: audit 2024-08-31T04:18:12.560576+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:18:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:13 smithi027 bash[22610]: cluster 2024-08-31T04:18:11.981037+0000 mgr.a (mgr.14388) 5489 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T04:18:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:13 smithi027 bash[22610]: audit 2024-08-31T04:18:12.560576+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:18:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:13 smithi191 bash[24992]: cluster 2024-08-31T04:18:11.981037+0000 mgr.a (mgr.14388) 5489 : cluster [DBG] pgmap v3805: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T04:18:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:13 smithi191 bash[24992]: audit 2024-08-31T04:18:12.560576+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:18:14.172 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:18:14.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:18:14.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:18:14.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:18:14.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:18:15.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:15 smithi163 bash[24253]: audit 2024-08-31T04:18:13.743922+0000 mgr.a (mgr.14388) 5490 : audit [DBG] from='client.128085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:15.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:15 smithi163 bash[24253]: cluster 2024-08-31T04:18:13.982486+0000 mgr.a (mgr.14388) 5491 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:15 smithi027 bash[22610]: audit 2024-08-31T04:18:13.743922+0000 mgr.a (mgr.14388) 5490 : audit [DBG] from='client.128085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:15 smithi027 bash[22610]: cluster 2024-08-31T04:18:13.982486+0000 mgr.a (mgr.14388) 5491 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:15 smithi191 bash[24992]: audit 2024-08-31T04:18:13.743922+0000 mgr.a (mgr.14388) 5490 : audit [DBG] from='client.128085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:15 smithi191 bash[24992]: cluster 2024-08-31T04:18:13.982486+0000 mgr.a (mgr.14388) 5491 : cluster [DBG] pgmap v3806: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:17.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:17 smithi163 bash[24253]: cluster 2024-08-31T04:18:15.983533+0000 mgr.a (mgr.14388) 5492 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T04:18:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:17 smithi027 bash[22610]: cluster 2024-08-31T04:18:15.983533+0000 mgr.a (mgr.14388) 5492 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T04:18:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:17 smithi191 bash[24992]: cluster 2024-08-31T04:18:15.983533+0000 mgr.a (mgr.14388) 5492 : cluster [DBG] pgmap v3807: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T04:18:19.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:19.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:19.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:18:19.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: audit 2024-08-31T04:18:17.919572+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: audit 2024-08-31T04:18:17.922227+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.191 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: audit 2024-08-31T04:18:17.927777+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: audit 2024-08-31T04:18:17.933473+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: audit 2024-08-31T04:18:17.938461+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: audit 2024-08-31T04:18:17.942268+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: cluster 2024-08-31T04:18:17.984491+0000 mgr.a (mgr.14388) 5493 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:18:19.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: audit 2024-08-31T04:18:18.689519+0000 mon.a (mon.0) 1415 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:18:19.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: audit 2024-08-31T04:18:18.691053+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:18:19.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: audit 2024-08-31T04:18:18.699704+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.192 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:18 smithi163 bash[24253]: audit 2024-08-31T04:18:18.702472+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:18:19.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: audit 2024-08-31T04:18:17.919572+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: audit 2024-08-31T04:18:17.922227+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: audit 2024-08-31T04:18:17.927777+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: audit 2024-08-31T04:18:17.933473+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: audit 2024-08-31T04:18:17.938461+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: audit 2024-08-31T04:18:17.942268+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: cluster 2024-08-31T04:18:17.984491+0000 mgr.a (mgr.14388) 5493 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:18:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: audit 2024-08-31T04:18:18.689519+0000 mon.a (mon.0) 1415 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:18:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: audit 2024-08-31T04:18:18.691053+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:18:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: audit 2024-08-31T04:18:18.699704+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:18 smithi027 bash[22610]: audit 2024-08-31T04:18:18.702472+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:18:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: audit 2024-08-31T04:18:17.919572+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: audit 2024-08-31T04:18:17.922227+0000 mon.a (mon.0) 1410 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: audit 2024-08-31T04:18:17.927777+0000 mon.a (mon.0) 1411 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: audit 2024-08-31T04:18:17.933473+0000 mon.a (mon.0) 1412 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: audit 2024-08-31T04:18:17.938461+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: audit 2024-08-31T04:18:17.942268+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: cluster 2024-08-31T04:18:17.984491+0000 mgr.a (mgr.14388) 5493 : cluster [DBG] pgmap v3808: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:18:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: audit 2024-08-31T04:18:18.689519+0000 mon.a (mon.0) 1415 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:18:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: audit 2024-08-31T04:18:18.691053+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:18:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: audit 2024-08-31T04:18:18.699704+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:18:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:18 smithi191 bash[24992]: audit 2024-08-31T04:18:18.702472+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:18:19.731 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:18:19 smithi027 bash[22863]: debug 2024-08-31T04:18:19.419+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:18:19.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:18:19 smithi027 bash[22863]: debug 2024-08-31T04:18:19.419+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:18:19.909 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:18:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:18:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:18:19.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:18:19.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:18:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:19 smithi027 bash[22610]: audit 2024-08-31T04:18:18.704711+0000 mgr.a (mgr.14388) 5494 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:18:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:19 smithi027 bash[22610]: audit 2024-08-31T04:18:19.422942+0000 mgr.a (mgr.14388) 5495 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:18:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:19 smithi027 bash[22610]: cephadm 2024-08-31T04:18:19.424134+0000 mgr.a (mgr.14388) 5496 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:18:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:19 smithi191 bash[24992]: audit 2024-08-31T04:18:18.704711+0000 mgr.a (mgr.14388) 5494 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:18:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:19 smithi191 bash[24992]: audit 2024-08-31T04:18:19.422942+0000 mgr.a (mgr.14388) 5495 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:18:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:19 smithi191 bash[24992]: cephadm 2024-08-31T04:18:19.424134+0000 mgr.a (mgr.14388) 5496 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:18:20.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:19 smithi163 bash[24253]: audit 2024-08-31T04:18:18.704711+0000 mgr.a (mgr.14388) 5494 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:18:20.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:19 smithi163 bash[24253]: audit 2024-08-31T04:18:19.422942+0000 mgr.a (mgr.14388) 5495 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:18:20.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:19 smithi163 bash[24253]: cephadm 2024-08-31T04:18:19.424134+0000 mgr.a (mgr.14388) 5496 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:18:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:20 smithi027 bash[22610]: audit 2024-08-31T04:18:19.504881+0000 mgr.a (mgr.14388) 5497 : audit [DBG] from='client.128250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:20 smithi027 bash[22610]: cluster 2024-08-31T04:18:19.985389+0000 mgr.a (mgr.14388) 5498 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:20 smithi191 bash[24992]: audit 2024-08-31T04:18:19.504881+0000 mgr.a (mgr.14388) 5497 : audit [DBG] from='client.128250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:20 smithi191 bash[24992]: cluster 2024-08-31T04:18:19.985389+0000 mgr.a (mgr.14388) 5498 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:21.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:20 smithi163 bash[24253]: audit 2024-08-31T04:18:19.504881+0000 mgr.a (mgr.14388) 5497 : audit [DBG] from='client.128250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:21.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:20 smithi163 bash[24253]: cluster 2024-08-31T04:18:19.985389+0000 mgr.a (mgr.14388) 5498 : cluster [DBG] pgmap v3809: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:23.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:23 smithi163 bash[24253]: cluster 2024-08-31T04:18:21.986051+0000 mgr.a (mgr.14388) 5499 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:23 smithi027 bash[22610]: cluster 2024-08-31T04:18:21.986051+0000 mgr.a (mgr.14388) 5499 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:23 smithi191 bash[24992]: cluster 2024-08-31T04:18:21.986051+0000 mgr.a (mgr.14388) 5499 : cluster [DBG] pgmap v3810: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:24.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:24.912 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:24.912 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:18:25.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:25 smithi163 bash[24253]: cluster 2024-08-31T04:18:23.988076+0000 mgr.a (mgr.14388) 5500 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:25.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:25 smithi027 bash[22610]: cluster 2024-08-31T04:18:23.988076+0000 mgr.a (mgr.14388) 5500 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:25 smithi191 bash[24992]: cluster 2024-08-31T04:18:23.988076+0000 mgr.a (mgr.14388) 5500 : cluster [DBG] pgmap v3811: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:25.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:18:25.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:18:25.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:18:25.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:18:25.690 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:18:26.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:26 smithi163 bash[24253]: audit 2024-08-31T04:18:25.247419+0000 mgr.a (mgr.14388) 5501 : audit [DBG] from='client.128346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:26 smithi027 bash[22610]: audit 2024-08-31T04:18:25.247419+0000 mgr.a (mgr.14388) 5501 : audit [DBG] from='client.128346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:26 smithi191 bash[24992]: audit 2024-08-31T04:18:25.247419+0000 mgr.a (mgr.14388) 5501 : audit [DBG] from='client.128346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:27.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:27 smithi163 bash[24253]: cluster 2024-08-31T04:18:25.988683+0000 mgr.a (mgr.14388) 5502 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:27 smithi027 bash[22610]: cluster 2024-08-31T04:18:25.988683+0000 mgr.a (mgr.14388) 5502 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:27 smithi191 bash[24992]: cluster 2024-08-31T04:18:25.988683+0000 mgr.a (mgr.14388) 5502 : cluster [DBG] pgmap v3812: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:29.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:29 smithi163 bash[24253]: cluster 2024-08-31T04:18:27.990434+0000 mgr.a (mgr.14388) 5503 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:29 smithi027 bash[22610]: cluster 2024-08-31T04:18:27.990434+0000 mgr.a (mgr.14388) 5503 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:29 smithi191 bash[24992]: cluster 2024-08-31T04:18:27.990434+0000 mgr.a (mgr.14388) 5503 : cluster [DBG] pgmap v3813: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:30.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:30.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:30.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:18:31.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:31 smithi163 bash[24253]: cluster 2024-08-31T04:18:29.991662+0000 mgr.a (mgr.14388) 5504 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:31.463 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:18:31.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:18:31.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:18:31.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:18:31.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:18:31.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:31 smithi027 bash[22610]: cluster 2024-08-31T04:18:29.991662+0000 mgr.a (mgr.14388) 5504 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:31 smithi191 bash[24992]: cluster 2024-08-31T04:18:29.991662+0000 mgr.a (mgr.14388) 5504 : cluster [DBG] pgmap v3814: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:32.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:32 smithi163 bash[24253]: audit 2024-08-31T04:18:31.030798+0000 mgr.a (mgr.14388) 5505 : audit [DBG] from='client.128424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:32 smithi027 bash[22610]: audit 2024-08-31T04:18:31.030798+0000 mgr.a (mgr.14388) 5505 : audit [DBG] from='client.128424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:32 smithi191 bash[24992]: audit 2024-08-31T04:18:31.030798+0000 mgr.a (mgr.14388) 5505 : audit [DBG] from='client.128424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:33.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:33 smithi163 bash[24253]: cluster 2024-08-31T04:18:31.992640+0000 mgr.a (mgr.14388) 5506 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:33 smithi027 bash[22610]: cluster 2024-08-31T04:18:31.992640+0000 mgr.a (mgr.14388) 5506 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:33 smithi191 bash[24992]: cluster 2024-08-31T04:18:31.992640+0000 mgr.a (mgr.14388) 5506 : cluster [DBG] pgmap v3815: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:35.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:35 smithi163 bash[24253]: cluster 2024-08-31T04:18:33.995010+0000 mgr.a (mgr.14388) 5507 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:35 smithi027 bash[22610]: cluster 2024-08-31T04:18:33.995010+0000 mgr.a (mgr.14388) 5507 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:35 smithi191 bash[24992]: cluster 2024-08-31T04:18:33.995010+0000 mgr.a (mgr.14388) 5507 : cluster [DBG] pgmap v3816: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:18:36.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:36.465 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:36.466 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:18:37.213 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:18:37.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:18:37.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:18:37.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:18:37.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:18:37.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:37 smithi163 bash[24253]: cluster 2024-08-31T04:18:35.995958+0000 mgr.a (mgr.14388) 5508 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:37 smithi027 bash[22610]: cluster 2024-08-31T04:18:35.995958+0000 mgr.a (mgr.14388) 5508 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:37 smithi191 bash[24992]: cluster 2024-08-31T04:18:35.995958+0000 mgr.a (mgr.14388) 5508 : cluster [DBG] pgmap v3817: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:38.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:38 smithi163 bash[24253]: audit 2024-08-31T04:18:36.799222+0000 mgr.a (mgr.14388) 5509 : audit [DBG] from='client.128499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:38 smithi027 bash[22610]: audit 2024-08-31T04:18:36.799222+0000 mgr.a (mgr.14388) 5509 : audit [DBG] from='client.128499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:38 smithi191 bash[24992]: audit 2024-08-31T04:18:36.799222+0000 mgr.a (mgr.14388) 5509 : audit [DBG] from='client.128499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:39.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:39 smithi163 bash[24253]: cluster 2024-08-31T04:18:37.998018+0000 mgr.a (mgr.14388) 5510 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:18:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:39 smithi027 bash[22610]: cluster 2024-08-31T04:18:37.998018+0000 mgr.a (mgr.14388) 5510 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:18:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:39 smithi191 bash[24992]: cluster 2024-08-31T04:18:37.998018+0000 mgr.a (mgr.14388) 5510 : cluster [DBG] pgmap v3818: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:18:41.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:41 smithi163 bash[24253]: cluster 2024-08-31T04:18:39.999317+0000 mgr.a (mgr.14388) 5511 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:18:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:41 smithi027 bash[22610]: cluster 2024-08-31T04:18:39.999317+0000 mgr.a (mgr.14388) 5511 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:18:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:41 smithi191 bash[24992]: cluster 2024-08-31T04:18:39.999317+0000 mgr.a (mgr.14388) 5511 : cluster [DBG] pgmap v3819: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:18:42.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:42.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:42.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:18:42.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:18:42.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:18:42.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:18:42.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:18:42.993 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:18:43.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:43 smithi163 bash[24253]: cluster 2024-08-31T04:18:42.000222+0000 mgr.a (mgr.14388) 5512 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:43 smithi027 bash[22610]: cluster 2024-08-31T04:18:42.000222+0000 mgr.a (mgr.14388) 5512 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:43 smithi191 bash[24992]: cluster 2024-08-31T04:18:42.000222+0000 mgr.a (mgr.14388) 5512 : cluster [DBG] pgmap v3820: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:44.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:44 smithi163 bash[24253]: audit 2024-08-31T04:18:42.553820+0000 mgr.a (mgr.14388) 5513 : audit [DBG] from='client.128577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:44 smithi027 bash[22610]: audit 2024-08-31T04:18:42.553820+0000 mgr.a (mgr.14388) 5513 : audit [DBG] from='client.128577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:44 smithi191 bash[24992]: audit 2024-08-31T04:18:42.553820+0000 mgr.a (mgr.14388) 5513 : audit [DBG] from='client.128577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:45.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:45 smithi163 bash[24253]: cluster 2024-08-31T04:18:44.002685+0000 mgr.a (mgr.14388) 5514 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:18:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:45 smithi027 bash[22610]: cluster 2024-08-31T04:18:44.002685+0000 mgr.a (mgr.14388) 5514 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:18:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:45 smithi191 bash[24992]: cluster 2024-08-31T04:18:44.002685+0000 mgr.a (mgr.14388) 5514 : cluster [DBG] pgmap v3821: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:18:47.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:47 smithi163 bash[24253]: cluster 2024-08-31T04:18:46.003497+0000 mgr.a (mgr.14388) 5515 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:18:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:47 smithi027 bash[22610]: cluster 2024-08-31T04:18:46.003497+0000 mgr.a (mgr.14388) 5515 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:18:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:47 smithi191 bash[24992]: cluster 2024-08-31T04:18:46.003497+0000 mgr.a (mgr.14388) 5515 : cluster [DBG] pgmap v3822: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:18:47.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:47.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:47.996 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:18:48.770 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:18:48.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:18:48.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:18:48.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:18:48.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:18:49.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:49 smithi163 bash[24253]: cluster 2024-08-31T04:18:48.005065+0000 mgr.a (mgr.14388) 5516 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:49.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:49 smithi163 bash[24253]: audit 2024-08-31T04:18:48.337362+0000 mgr.a (mgr.14388) 5517 : audit [DBG] from='client.128652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:49 smithi027 bash[22610]: cluster 2024-08-31T04:18:48.005065+0000 mgr.a (mgr.14388) 5516 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:49 smithi027 bash[22610]: audit 2024-08-31T04:18:48.337362+0000 mgr.a (mgr.14388) 5517 : audit [DBG] from='client.128652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:49 smithi191 bash[24992]: cluster 2024-08-31T04:18:48.005065+0000 mgr.a (mgr.14388) 5516 : cluster [DBG] pgmap v3823: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:49 smithi191 bash[24992]: audit 2024-08-31T04:18:48.337362+0000 mgr.a (mgr.14388) 5517 : audit [DBG] from='client.128652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:51.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:51 smithi163 bash[24253]: cluster 2024-08-31T04:18:50.006782+0000 mgr.a (mgr.14388) 5518 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:18:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:51 smithi027 bash[22610]: cluster 2024-08-31T04:18:50.006782+0000 mgr.a (mgr.14388) 5518 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:18:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:51 smithi191 bash[24992]: cluster 2024-08-31T04:18:50.006782+0000 mgr.a (mgr.14388) 5518 : cluster [DBG] pgmap v3824: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:18:53.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:53 smithi163 bash[24253]: cluster 2024-08-31T04:18:52.007584+0000 mgr.a (mgr.14388) 5519 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:18:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:53 smithi027 bash[22610]: cluster 2024-08-31T04:18:52.007584+0000 mgr.a (mgr.14388) 5519 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:18:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:53 smithi191 bash[24992]: cluster 2024-08-31T04:18:52.007584+0000 mgr.a (mgr.14388) 5519 : cluster [DBG] pgmap v3825: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:18:53.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:53.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:53.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:18:54.549 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:18:54.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:18:54.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:18:54.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:18:54.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:18:55.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:55 smithi163 bash[24253]: cluster 2024-08-31T04:18:54.009570+0000 mgr.a (mgr.14388) 5520 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:55.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:55 smithi163 bash[24253]: audit 2024-08-31T04:18:54.109587+0000 mgr.a (mgr.14388) 5521 : audit [DBG] from='client.128730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:55 smithi027 bash[22610]: cluster 2024-08-31T04:18:54.009570+0000 mgr.a (mgr.14388) 5520 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:55 smithi027 bash[22610]: audit 2024-08-31T04:18:54.109587+0000 mgr.a (mgr.14388) 5521 : audit [DBG] from='client.128730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:55 smithi191 bash[24992]: cluster 2024-08-31T04:18:54.009570+0000 mgr.a (mgr.14388) 5520 : cluster [DBG] pgmap v3826: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:18:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:55 smithi191 bash[24992]: audit 2024-08-31T04:18:54.109587+0000 mgr.a (mgr.14388) 5521 : audit [DBG] from='client.128730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:18:57.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:57 smithi163 bash[24253]: cluster 2024-08-31T04:18:56.010456+0000 mgr.a (mgr.14388) 5522 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:18:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:57 smithi027 bash[22610]: cluster 2024-08-31T04:18:56.010456+0000 mgr.a (mgr.14388) 5522 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:18:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:57 smithi191 bash[24992]: cluster 2024-08-31T04:18:56.010456+0000 mgr.a (mgr.14388) 5522 : cluster [DBG] pgmap v3827: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:18:59.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:18:59 smithi163 bash[24253]: cluster 2024-08-31T04:18:58.012221+0000 mgr.a (mgr.14388) 5523 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:18:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:18:59 smithi027 bash[22610]: cluster 2024-08-31T04:18:58.012221+0000 mgr.a (mgr.14388) 5523 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:18:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:18:59 smithi191 bash[24992]: cluster 2024-08-31T04:18:58.012221+0000 mgr.a (mgr.14388) 5523 : cluster [DBG] pgmap v3828: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:18:59.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:18:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:18:59.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:00.315 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:00.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:00.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:00.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:00.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:01.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:01 smithi163 bash[24253]: audit 2024-08-31T04:18:59.886964+0000 mgr.a (mgr.14388) 5524 : audit [DBG] from='client.128805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:01.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:01 smithi163 bash[24253]: cluster 2024-08-31T04:19:00.013253+0000 mgr.a (mgr.14388) 5525 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:01 smithi027 bash[22610]: audit 2024-08-31T04:18:59.886964+0000 mgr.a (mgr.14388) 5524 : audit [DBG] from='client.128805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:01 smithi027 bash[22610]: cluster 2024-08-31T04:19:00.013253+0000 mgr.a (mgr.14388) 5525 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:01 smithi191 bash[24992]: audit 2024-08-31T04:18:59.886964+0000 mgr.a (mgr.14388) 5524 : audit [DBG] from='client.128805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:01 smithi191 bash[24992]: cluster 2024-08-31T04:19:00.013253+0000 mgr.a (mgr.14388) 5525 : cluster [DBG] pgmap v3829: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:03.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:03 smithi163 bash[24253]: cluster 2024-08-31T04:19:02.014040+0000 mgr.a (mgr.14388) 5526 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:03 smithi027 bash[22610]: cluster 2024-08-31T04:19:02.014040+0000 mgr.a (mgr.14388) 5526 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:03 smithi191 bash[24992]: cluster 2024-08-31T04:19:02.014040+0000 mgr.a (mgr.14388) 5526 : cluster [DBG] pgmap v3830: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:19:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:19:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:05.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:05 smithi163 bash[24253]: cluster 2024-08-31T04:19:04.016257+0000 mgr.a (mgr.14388) 5527 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:05 smithi027 bash[22610]: cluster 2024-08-31T04:19:04.016257+0000 mgr.a (mgr.14388) 5527 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:05 smithi191 bash[24992]: cluster 2024-08-31T04:19:04.016257+0000 mgr.a (mgr.14388) 5527 : cluster [DBG] pgmap v3831: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:06.089 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:06.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:06.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:06.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:06.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:07.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:07 smithi163 bash[24253]: audit 2024-08-31T04:19:05.655112+0000 mgr.a (mgr.14388) 5528 : audit [DBG] from='client.128877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:07.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:07 smithi163 bash[24253]: cluster 2024-08-31T04:19:06.016803+0000 mgr.a (mgr.14388) 5529 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:07 smithi027 bash[22610]: audit 2024-08-31T04:19:05.655112+0000 mgr.a (mgr.14388) 5528 : audit [DBG] from='client.128877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:07 smithi027 bash[22610]: cluster 2024-08-31T04:19:06.016803+0000 mgr.a (mgr.14388) 5529 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:07 smithi191 bash[24992]: audit 2024-08-31T04:19:05.655112+0000 mgr.a (mgr.14388) 5528 : audit [DBG] from='client.128877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:07 smithi191 bash[24992]: cluster 2024-08-31T04:19:06.016803+0000 mgr.a (mgr.14388) 5529 : cluster [DBG] pgmap v3832: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:09.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:09 smithi163 bash[24253]: cluster 2024-08-31T04:19:08.018542+0000 mgr.a (mgr.14388) 5530 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:09 smithi027 bash[22610]: cluster 2024-08-31T04:19:08.018542+0000 mgr.a (mgr.14388) 5530 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:09 smithi191 bash[24992]: cluster 2024-08-31T04:19:08.018542+0000 mgr.a (mgr.14388) 5530 : cluster [DBG] pgmap v3833: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:11.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:19:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:19:11.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:11.441 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:11 smithi163 bash[24253]: cluster 2024-08-31T04:19:10.019911+0000 mgr.a (mgr.14388) 5531 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:11 smithi027 bash[22610]: cluster 2024-08-31T04:19:10.019911+0000 mgr.a (mgr.14388) 5531 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:11 smithi191 bash[24992]: cluster 2024-08-31T04:19:10.019911+0000 mgr.a (mgr.14388) 5531 : cluster [DBG] pgmap v3834: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:11.856 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:11.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:11.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:11.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:11.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:12 smithi027 bash[22610]: audit 2024-08-31T04:19:11.427638+0000 mgr.a (mgr.14388) 5532 : audit [DBG] from='client.128949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:12 smithi191 bash[24992]: audit 2024-08-31T04:19:11.427638+0000 mgr.a (mgr.14388) 5532 : audit [DBG] from='client.128949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:12.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:12 smithi163 bash[24253]: audit 2024-08-31T04:19:11.427638+0000 mgr.a (mgr.14388) 5532 : audit [DBG] from='client.128949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:13 smithi027 bash[22610]: cluster 2024-08-31T04:19:12.020896+0000 mgr.a (mgr.14388) 5533 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:13 smithi191 bash[24992]: cluster 2024-08-31T04:19:12.020896+0000 mgr.a (mgr.14388) 5533 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:13.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:13 smithi163 bash[24253]: cluster 2024-08-31T04:19:12.020896+0000 mgr.a (mgr.14388) 5533 : cluster [DBG] pgmap v3835: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:15 smithi027 bash[22610]: cluster 2024-08-31T04:19:14.023141+0000 mgr.a (mgr.14388) 5534 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:15 smithi191 bash[24992]: cluster 2024-08-31T04:19:14.023141+0000 mgr.a (mgr.14388) 5534 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:15.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:15 smithi163 bash[24253]: cluster 2024-08-31T04:19:14.023141+0000 mgr.a (mgr.14388) 5534 : cluster [DBG] pgmap v3836: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:16.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:19:16.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:19:16.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:17 smithi027 bash[22610]: cluster 2024-08-31T04:19:16.023914+0000 mgr.a (mgr.14388) 5535 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:17 smithi191 bash[24992]: cluster 2024-08-31T04:19:16.023914+0000 mgr.a (mgr.14388) 5535 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:17.631 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:17.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:17.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:17.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:17.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:17.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:17 smithi163 bash[24253]: cluster 2024-08-31T04:19:16.023914+0000 mgr.a (mgr.14388) 5535 : cluster [DBG] pgmap v3837: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:18 smithi027 bash[22610]: audit 2024-08-31T04:19:17.199406+0000 mgr.a (mgr.14388) 5536 : audit [DBG] from='client.129027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:18 smithi191 bash[24992]: audit 2024-08-31T04:19:17.199406+0000 mgr.a (mgr.14388) 5536 : audit [DBG] from='client.129027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:18.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:18 smithi163 bash[24253]: audit 2024-08-31T04:19:17.199406+0000 mgr.a (mgr.14388) 5536 : audit [DBG] from='client.129027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:19 smithi027 bash[22610]: cluster 2024-08-31T04:19:18.025848+0000 mgr.a (mgr.14388) 5537 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:19 smithi191 bash[24992]: cluster 2024-08-31T04:19:18.025848+0000 mgr.a (mgr.14388) 5537 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:19.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:19 smithi163 bash[24253]: cluster 2024-08-31T04:19:18.025848+0000 mgr.a (mgr.14388) 5537 : cluster [DBG] pgmap v3838: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:20 smithi027 bash[22610]: audit 2024-08-31T04:19:19.474045+0000 mon.a (mon.0) 1419 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:19:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:20 smithi191 bash[24992]: audit 2024-08-31T04:19:19.474045+0000 mon.a (mon.0) 1419 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:19:20.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:20 smithi163 bash[24253]: audit 2024-08-31T04:19:19.474045+0000 mon.a (mon.0) 1419 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:19:21.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:19:21 smithi027 bash[22863]: debug 2024-08-31T04:19:21.073+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:19:21.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:19:21 smithi027 bash[22863]: debug 2024-08-31T04:19:21.073+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:19:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:21 smithi027 bash[22610]: cluster 2024-08-31T04:19:20.027057+0000 mgr.a (mgr.14388) 5538 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:21 smithi027 bash[22610]: audit 2024-08-31T04:19:20.336417+0000 mon.a (mon.0) 1420 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:19:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:21 smithi027 bash[22610]: audit 2024-08-31T04:19:20.338191+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:19:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:21 smithi027 bash[22610]: audit 2024-08-31T04:19:20.348556+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:19:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:21 smithi027 bash[22610]: audit 2024-08-31T04:19:20.351739+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:19:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:21 smithi027 bash[22610]: audit 2024-08-31T04:19:20.352844+0000 mgr.a (mgr.14388) 5539 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:19:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:21 smithi191 bash[24992]: cluster 2024-08-31T04:19:20.027057+0000 mgr.a (mgr.14388) 5538 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:21 smithi191 bash[24992]: audit 2024-08-31T04:19:20.336417+0000 mon.a (mon.0) 1420 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:19:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:21 smithi191 bash[24992]: audit 2024-08-31T04:19:20.338191+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:19:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:21 smithi191 bash[24992]: audit 2024-08-31T04:19:20.348556+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:19:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:21 smithi191 bash[24992]: audit 2024-08-31T04:19:20.351739+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:19:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:21 smithi191 bash[24992]: audit 2024-08-31T04:19:20.352844+0000 mgr.a (mgr.14388) 5539 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:19:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:21 smithi163 bash[24253]: cluster 2024-08-31T04:19:20.027057+0000 mgr.a (mgr.14388) 5538 : cluster [DBG] pgmap v3839: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:21 smithi163 bash[24253]: audit 2024-08-31T04:19:20.336417+0000 mon.a (mon.0) 1420 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:19:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:21 smithi163 bash[24253]: audit 2024-08-31T04:19:20.338191+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:19:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:21 smithi163 bash[24253]: audit 2024-08-31T04:19:20.348556+0000 mon.a (mon.0) 1422 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:19:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:21 smithi163 bash[24253]: audit 2024-08-31T04:19:20.351739+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:19:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:21 smithi163 bash[24253]: audit 2024-08-31T04:19:20.352844+0000 mgr.a (mgr.14388) 5539 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:19:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:22 smithi027 bash[22610]: audit 2024-08-31T04:19:21.077404+0000 mgr.a (mgr.14388) 5540 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:19:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:22 smithi027 bash[22610]: cephadm 2024-08-31T04:19:21.078571+0000 mgr.a (mgr.14388) 5541 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:19:22.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:22 smithi191 bash[24992]: audit 2024-08-31T04:19:21.077404+0000 mgr.a (mgr.14388) 5540 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:19:22.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:22 smithi191 bash[24992]: cephadm 2024-08-31T04:19:21.078571+0000 mgr.a (mgr.14388) 5541 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:19:22.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:19:22.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:19:22.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:22 smithi163 bash[24253]: audit 2024-08-31T04:19:21.077404+0000 mgr.a (mgr.14388) 5540 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:19:22.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:22 smithi163 bash[24253]: cephadm 2024-08-31T04:19:21.078571+0000 mgr.a (mgr.14388) 5541 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:19:23.374 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:23.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:23.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:23.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:23.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:23 smithi027 bash[22610]: cluster 2024-08-31T04:19:22.027934+0000 mgr.a (mgr.14388) 5542 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:23 smithi191 bash[24992]: cluster 2024-08-31T04:19:22.027934+0000 mgr.a (mgr.14388) 5542 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:23.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:23 smithi163 bash[24253]: cluster 2024-08-31T04:19:22.027934+0000 mgr.a (mgr.14388) 5542 : cluster [DBG] pgmap v3840: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:24 smithi191 bash[24992]: audit 2024-08-31T04:19:22.967721+0000 mgr.a (mgr.14388) 5543 : audit [DBG] from='client.129213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:24.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:24 smithi163 bash[24253]: audit 2024-08-31T04:19:22.967721+0000 mgr.a (mgr.14388) 5543 : audit [DBG] from='client.129213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:24 smithi027 bash[22610]: audit 2024-08-31T04:19:22.967721+0000 mgr.a (mgr.14388) 5543 : audit [DBG] from='client.129213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:25 smithi191 bash[24992]: cluster 2024-08-31T04:19:24.030830+0000 mgr.a (mgr.14388) 5544 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:19:25.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:25 smithi163 bash[24253]: cluster 2024-08-31T04:19:24.030830+0000 mgr.a (mgr.14388) 5544 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:19:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:25 smithi027 bash[22610]: cluster 2024-08-31T04:19:24.030830+0000 mgr.a (mgr.14388) 5544 : cluster [DBG] pgmap v3841: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:19:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:27 smithi191 bash[24992]: cluster 2024-08-31T04:19:26.031773+0000 mgr.a (mgr.14388) 5545 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:27.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:27 smithi163 bash[24253]: cluster 2024-08-31T04:19:26.031773+0000 mgr.a (mgr.14388) 5545 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:27.758 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:27 smithi027 bash[22610]: cluster 2024-08-31T04:19:26.031773+0000 mgr.a (mgr.14388) 5545 : cluster [DBG] pgmap v3842: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:28.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:19:28.376 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:19:28.376 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:29.122 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:29.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:29.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:29.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:29.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:29 smithi191 bash[24992]: cluster 2024-08-31T04:19:28.033539+0000 mgr.a (mgr.14388) 5546 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:29.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:29 smithi163 bash[24253]: cluster 2024-08-31T04:19:28.033539+0000 mgr.a (mgr.14388) 5546 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:29 smithi027 bash[22610]: cluster 2024-08-31T04:19:28.033539+0000 mgr.a (mgr.14388) 5546 : cluster [DBG] pgmap v3843: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:30 smithi191 bash[24992]: audit 2024-08-31T04:19:28.707138+0000 mgr.a (mgr.14388) 5547 : audit [DBG] from='client.129291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:30.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:30 smithi163 bash[24253]: audit 2024-08-31T04:19:28.707138+0000 mgr.a (mgr.14388) 5547 : audit [DBG] from='client.129291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:30 smithi027 bash[22610]: audit 2024-08-31T04:19:28.707138+0000 mgr.a (mgr.14388) 5547 : audit [DBG] from='client.129291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:31 smithi191 bash[24992]: cluster 2024-08-31T04:19:30.035281+0000 mgr.a (mgr.14388) 5548 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:31.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:31 smithi163 bash[24253]: cluster 2024-08-31T04:19:30.035281+0000 mgr.a (mgr.14388) 5548 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:31 smithi027 bash[22610]: cluster 2024-08-31T04:19:30.035281+0000 mgr.a (mgr.14388) 5548 : cluster [DBG] pgmap v3844: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:33 smithi191 bash[24992]: cluster 2024-08-31T04:19:32.036103+0000 mgr.a (mgr.14388) 5549 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:33.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:33 smithi163 bash[24253]: cluster 2024-08-31T04:19:32.036103+0000 mgr.a (mgr.14388) 5549 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:33 smithi027 bash[22610]: cluster 2024-08-31T04:19:32.036103+0000 mgr.a (mgr.14388) 5549 : cluster [DBG] pgmap v3845: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:19:34.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:19:34.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:19:34.125 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:34.880 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:35 smithi191 bash[24992]: cluster 2024-08-31T04:19:34.038146+0000 mgr.a (mgr.14388) 5550 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:19:35.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:35 smithi163 bash[24253]: cluster 2024-08-31T04:19:34.038146+0000 mgr.a (mgr.14388) 5550 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:19:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:35 smithi027 bash[22610]: cluster 2024-08-31T04:19:34.038146+0000 mgr.a (mgr.14388) 5550 : cluster [DBG] pgmap v3846: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:19:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:36 smithi191 bash[24992]: audit 2024-08-31T04:19:34.458820+0000 mgr.a (mgr.14388) 5551 : audit [DBG] from='client.129369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:36.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:36 smithi163 bash[24253]: audit 2024-08-31T04:19:34.458820+0000 mgr.a (mgr.14388) 5551 : audit [DBG] from='client.129369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:36 smithi027 bash[22610]: audit 2024-08-31T04:19:34.458820+0000 mgr.a (mgr.14388) 5551 : audit [DBG] from='client.129369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:37 smithi191 bash[24992]: cluster 2024-08-31T04:19:36.039054+0000 mgr.a (mgr.14388) 5552 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:37.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:37 smithi163 bash[24253]: cluster 2024-08-31T04:19:36.039054+0000 mgr.a (mgr.14388) 5552 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:37 smithi027 bash[22610]: cluster 2024-08-31T04:19:36.039054+0000 mgr.a (mgr.14388) 5552 : cluster [DBG] pgmap v3847: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:39 smithi191 bash[24992]: cluster 2024-08-31T04:19:38.040889+0000 mgr.a (mgr.14388) 5553 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:39.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:39 smithi163 bash[24253]: cluster 2024-08-31T04:19:38.040889+0000 mgr.a (mgr.14388) 5553 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:39 smithi027 bash[22610]: cluster 2024-08-31T04:19:38.040889+0000 mgr.a (mgr.14388) 5553 : cluster [DBG] pgmap v3848: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:39.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:19:39.882 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:19:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:40.655 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:40.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:40.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:40.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:40.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:41 smithi191 bash[24992]: cluster 2024-08-31T04:19:40.041627+0000 mgr.a (mgr.14388) 5554 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:41 smithi191 bash[24992]: audit 2024-08-31T04:19:40.217558+0000 mgr.a (mgr.14388) 5555 : audit [DBG] from='client.129444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:41.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:41 smithi163 bash[24253]: cluster 2024-08-31T04:19:40.041627+0000 mgr.a (mgr.14388) 5554 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:41.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:41 smithi163 bash[24253]: audit 2024-08-31T04:19:40.217558+0000 mgr.a (mgr.14388) 5555 : audit [DBG] from='client.129444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:41 smithi027 bash[22610]: cluster 2024-08-31T04:19:40.041627+0000 mgr.a (mgr.14388) 5554 : cluster [DBG] pgmap v3849: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:41 smithi027 bash[22610]: audit 2024-08-31T04:19:40.217558+0000 mgr.a (mgr.14388) 5555 : audit [DBG] from='client.129444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:43 smithi191 bash[24992]: cluster 2024-08-31T04:19:42.042484+0000 mgr.a (mgr.14388) 5556 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:43.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:43 smithi163 bash[24253]: cluster 2024-08-31T04:19:42.042484+0000 mgr.a (mgr.14388) 5556 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:43 smithi027 bash[22610]: cluster 2024-08-31T04:19:42.042484+0000 mgr.a (mgr.14388) 5556 : cluster [DBG] pgmap v3850: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:45.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:19:45.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:19:45.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:45.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:45 smithi163 bash[24253]: cluster 2024-08-31T04:19:44.044732+0000 mgr.a (mgr.14388) 5557 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:45 smithi027 bash[22610]: cluster 2024-08-31T04:19:44.044732+0000 mgr.a (mgr.14388) 5557 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:45 smithi191 bash[24992]: cluster 2024-08-31T04:19:44.044732+0000 mgr.a (mgr.14388) 5557 : cluster [DBG] pgmap v3851: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:46.403 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:46.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:46.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:46.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:46.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:47.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:47 smithi163 bash[24253]: audit 2024-08-31T04:19:45.988580+0000 mgr.a (mgr.14388) 5558 : audit [DBG] from='client.129522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:47.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:47 smithi163 bash[24253]: cluster 2024-08-31T04:19:46.045398+0000 mgr.a (mgr.14388) 5559 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:47 smithi027 bash[22610]: audit 2024-08-31T04:19:45.988580+0000 mgr.a (mgr.14388) 5558 : audit [DBG] from='client.129522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:47 smithi027 bash[22610]: cluster 2024-08-31T04:19:46.045398+0000 mgr.a (mgr.14388) 5559 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:47 smithi191 bash[24992]: audit 2024-08-31T04:19:45.988580+0000 mgr.a (mgr.14388) 5558 : audit [DBG] from='client.129522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:47 smithi191 bash[24992]: cluster 2024-08-31T04:19:46.045398+0000 mgr.a (mgr.14388) 5559 : cluster [DBG] pgmap v3852: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:49.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:49 smithi163 bash[24253]: cluster 2024-08-31T04:19:48.047285+0000 mgr.a (mgr.14388) 5560 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:49 smithi027 bash[22610]: cluster 2024-08-31T04:19:48.047285+0000 mgr.a (mgr.14388) 5560 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:49 smithi191 bash[24992]: cluster 2024-08-31T04:19:48.047285+0000 mgr.a (mgr.14388) 5560 : cluster [DBG] pgmap v3853: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:51.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:19:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:19:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:51.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:51 smithi163 bash[24253]: cluster 2024-08-31T04:19:50.048504+0000 mgr.a (mgr.14388) 5561 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:51 smithi027 bash[22610]: cluster 2024-08-31T04:19:50.048504+0000 mgr.a (mgr.14388) 5561 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:51 smithi191 bash[24992]: cluster 2024-08-31T04:19:50.048504+0000 mgr.a (mgr.14388) 5561 : cluster [DBG] pgmap v3854: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:19:52.181 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:52.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:52.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:52.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:52.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:53.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:53 smithi163 bash[24253]: audit 2024-08-31T04:19:51.745175+0000 mgr.a (mgr.14388) 5562 : audit [DBG] from='client.129600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:53.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:53 smithi163 bash[24253]: cluster 2024-08-31T04:19:52.049107+0000 mgr.a (mgr.14388) 5563 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:53 smithi027 bash[22610]: audit 2024-08-31T04:19:51.745175+0000 mgr.a (mgr.14388) 5562 : audit [DBG] from='client.129600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:53 smithi027 bash[22610]: cluster 2024-08-31T04:19:52.049107+0000 mgr.a (mgr.14388) 5563 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:53 smithi191 bash[24992]: audit 2024-08-31T04:19:51.745175+0000 mgr.a (mgr.14388) 5562 : audit [DBG] from='client.129600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:53 smithi191 bash[24992]: cluster 2024-08-31T04:19:52.049107+0000 mgr.a (mgr.14388) 5563 : cluster [DBG] pgmap v3855: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:55.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:55 smithi163 bash[24253]: cluster 2024-08-31T04:19:54.051446+0000 mgr.a (mgr.14388) 5564 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:55 smithi027 bash[22610]: cluster 2024-08-31T04:19:54.051446+0000 mgr.a (mgr.14388) 5564 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:55 smithi191 bash[24992]: cluster 2024-08-31T04:19:54.051446+0000 mgr.a (mgr.14388) 5564 : cluster [DBG] pgmap v3856: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:19:57.182 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:19:57.183 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:19:57.183 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:19:57.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:57 smithi163 bash[24253]: cluster 2024-08-31T04:19:56.052196+0000 mgr.a (mgr.14388) 5565 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:57.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:57 smithi027 bash[22610]: cluster 2024-08-31T04:19:56.052196+0000 mgr.a (mgr.14388) 5565 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:57 smithi191 bash[24992]: cluster 2024-08-31T04:19:56.052196+0000 mgr.a (mgr.14388) 5565 : cluster [DBG] pgmap v3857: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:19:57.972 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:19:57.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:19:57.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:19:57.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:19:57.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:19:59.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:59 smithi163 bash[24253]: audit 2024-08-31T04:19:57.524624+0000 mgr.a (mgr.14388) 5566 : audit [DBG] from='client.129678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:59.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:19:59 smithi163 bash[24253]: cluster 2024-08-31T04:19:58.053599+0000 mgr.a (mgr.14388) 5567 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:19:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:59 smithi027 bash[22610]: audit 2024-08-31T04:19:57.524624+0000 mgr.a (mgr.14388) 5566 : audit [DBG] from='client.129678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:19:59 smithi027 bash[22610]: cluster 2024-08-31T04:19:58.053599+0000 mgr.a (mgr.14388) 5567 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:19:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:59 smithi191 bash[24992]: audit 2024-08-31T04:19:57.524624+0000 mgr.a (mgr.14388) 5566 : audit [DBG] from='client.129678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:19:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:19:59 smithi191 bash[24992]: cluster 2024-08-31T04:19:58.053599+0000 mgr.a (mgr.14388) 5567 : cluster [DBG] pgmap v3858: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:20:00.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:00 smithi163 bash[24253]: cluster 2024-08-31T04:20:00.000147+0000 mon.a (mon.0) 1424 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:20:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:00 smithi027 bash[22610]: cluster 2024-08-31T04:20:00.000147+0000 mon.a (mon.0) 1424 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:20:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:00 smithi191 bash[24992]: cluster 2024-08-31T04:20:00.000147+0000 mon.a (mon.0) 1424 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:20:01.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:01 smithi163 bash[24253]: cluster 2024-08-31T04:20:00.054849+0000 mgr.a (mgr.14388) 5568 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:20:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:01 smithi027 bash[22610]: cluster 2024-08-31T04:20:00.054849+0000 mgr.a (mgr.14388) 5568 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:20:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:01 smithi191 bash[24992]: cluster 2024-08-31T04:20:00.054849+0000 mgr.a (mgr.14388) 5568 : cluster [DBG] pgmap v3859: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:20:02.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:20:02.974 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:20:02.975 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:20:03.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:03 smithi163 bash[24253]: cluster 2024-08-31T04:20:02.055606+0000 mgr.a (mgr.14388) 5569 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:20:03.720 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:20:03.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:20:03.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:20:03.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:20:03.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:20:03.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:03 smithi027 bash[22610]: cluster 2024-08-31T04:20:02.055606+0000 mgr.a (mgr.14388) 5569 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:20:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:03 smithi191 bash[24992]: cluster 2024-08-31T04:20:02.055606+0000 mgr.a (mgr.14388) 5569 : cluster [DBG] pgmap v3860: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:20:04.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:04 smithi163 bash[24253]: audit 2024-08-31T04:20:03.303489+0000 mgr.a (mgr.14388) 5570 : audit [DBG] from='client.129756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:04 smithi027 bash[22610]: audit 2024-08-31T04:20:03.303489+0000 mgr.a (mgr.14388) 5570 : audit [DBG] from='client.129756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:04 smithi191 bash[24992]: audit 2024-08-31T04:20:03.303489+0000 mgr.a (mgr.14388) 5570 : audit [DBG] from='client.129756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:05.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:05 smithi163 bash[24253]: cluster 2024-08-31T04:20:04.058327+0000 mgr.a (mgr.14388) 5571 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:05 smithi027 bash[22610]: cluster 2024-08-31T04:20:04.058327+0000 mgr.a (mgr.14388) 5571 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:05 smithi191 bash[24992]: cluster 2024-08-31T04:20:04.058327+0000 mgr.a (mgr.14388) 5571 : cluster [DBG] pgmap v3861: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:07.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:07 smithi163 bash[24253]: cluster 2024-08-31T04:20:06.059171+0000 mgr.a (mgr.14388) 5572 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:20:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:07 smithi027 bash[22610]: cluster 2024-08-31T04:20:06.059171+0000 mgr.a (mgr.14388) 5572 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:20:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:07 smithi191 bash[24992]: cluster 2024-08-31T04:20:06.059171+0000 mgr.a (mgr.14388) 5572 : cluster [DBG] pgmap v3862: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:20:08.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:20:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:20:08.723 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:20:09.471 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:20:09.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:20:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:20:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:20:09.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:20:09.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:09 smithi163 bash[24253]: cluster 2024-08-31T04:20:08.060722+0000 mgr.a (mgr.14388) 5573 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:20:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:09 smithi027 bash[22610]: cluster 2024-08-31T04:20:08.060722+0000 mgr.a (mgr.14388) 5573 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:20:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:09 smithi191 bash[24992]: cluster 2024-08-31T04:20:08.060722+0000 mgr.a (mgr.14388) 5573 : cluster [DBG] pgmap v3863: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:20:10.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:10 smithi163 bash[24253]: audit 2024-08-31T04:20:09.061027+0000 mgr.a (mgr.14388) 5574 : audit [DBG] from='client.129834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:10 smithi027 bash[22610]: audit 2024-08-31T04:20:09.061027+0000 mgr.a (mgr.14388) 5574 : audit [DBG] from='client.129834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:10 smithi191 bash[24992]: audit 2024-08-31T04:20:09.061027+0000 mgr.a (mgr.14388) 5574 : audit [DBG] from='client.129834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:11.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:11 smithi163 bash[24253]: cluster 2024-08-31T04:20:10.062384+0000 mgr.a (mgr.14388) 5575 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:20:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:11 smithi027 bash[22610]: cluster 2024-08-31T04:20:10.062384+0000 mgr.a (mgr.14388) 5575 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:20:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:11 smithi191 bash[24992]: cluster 2024-08-31T04:20:10.062384+0000 mgr.a (mgr.14388) 5575 : cluster [DBG] pgmap v3864: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:20:13.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:13 smithi163 bash[24253]: cluster 2024-08-31T04:20:12.063192+0000 mgr.a (mgr.14388) 5576 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:20:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:13 smithi027 bash[22610]: cluster 2024-08-31T04:20:12.063192+0000 mgr.a (mgr.14388) 5576 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:20:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:13 smithi191 bash[24992]: cluster 2024-08-31T04:20:12.063192+0000 mgr.a (mgr.14388) 5576 : cluster [DBG] pgmap v3865: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:20:14.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:20:14.474 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:20:14.474 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:20:15.250 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:20:15.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:20:15.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:20:15.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:20:15.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:20:15.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:15 smithi163 bash[24253]: cluster 2024-08-31T04:20:14.065197+0000 mgr.a (mgr.14388) 5577 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:20:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:15 smithi027 bash[22610]: cluster 2024-08-31T04:20:14.065197+0000 mgr.a (mgr.14388) 5577 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:20:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:15 smithi191 bash[24992]: cluster 2024-08-31T04:20:14.065197+0000 mgr.a (mgr.14388) 5577 : cluster [DBG] pgmap v3866: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:20:16.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:16 smithi163 bash[24253]: audit 2024-08-31T04:20:14.812350+0000 mgr.a (mgr.14388) 5578 : audit [DBG] from='client.129909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:16 smithi027 bash[22610]: audit 2024-08-31T04:20:14.812350+0000 mgr.a (mgr.14388) 5578 : audit [DBG] from='client.129909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:16 smithi191 bash[24992]: audit 2024-08-31T04:20:14.812350+0000 mgr.a (mgr.14388) 5578 : audit [DBG] from='client.129909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:17 smithi163 bash[24253]: cluster 2024-08-31T04:20:16.066072+0000 mgr.a (mgr.14388) 5579 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:17 smithi027 bash[22610]: cluster 2024-08-31T04:20:16.066072+0000 mgr.a (mgr.14388) 5579 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:17 smithi191 bash[24992]: cluster 2024-08-31T04:20:16.066072+0000 mgr.a (mgr.14388) 5579 : cluster [DBG] pgmap v3867: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:19.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:19 smithi163 bash[24253]: cluster 2024-08-31T04:20:18.067859+0000 mgr.a (mgr.14388) 5580 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:20:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:19 smithi027 bash[22610]: cluster 2024-08-31T04:20:18.067859+0000 mgr.a (mgr.14388) 5580 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:20:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:19 smithi191 bash[24992]: cluster 2024-08-31T04:20:18.067859+0000 mgr.a (mgr.14388) 5580 : cluster [DBG] pgmap v3868: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:20:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:20:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:20:20.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:20:21.003 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:20:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:20:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:20:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:20:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:20:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:21 smithi163 bash[24253]: cluster 2024-08-31T04:20:20.069075+0000 mgr.a (mgr.14388) 5581 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:20:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:21 smithi163 bash[24253]: audit 2024-08-31T04:20:21.127964+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:20:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:21 smithi027 bash[22610]: cluster 2024-08-31T04:20:20.069075+0000 mgr.a (mgr.14388) 5581 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:20:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:21 smithi027 bash[22610]: audit 2024-08-31T04:20:21.127964+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:20:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:21 smithi191 bash[24992]: cluster 2024-08-31T04:20:20.069075+0000 mgr.a (mgr.14388) 5581 : cluster [DBG] pgmap v3869: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:20:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:21 smithi191 bash[24992]: audit 2024-08-31T04:20:21.127964+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:20:22.680 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:22 smithi027 bash[22610]: audit 2024-08-31T04:20:20.587960+0000 mgr.a (mgr.14388) 5582 : audit [DBG] from='client.129987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:22.680 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:22 smithi027 bash[22610]: audit 2024-08-31T04:20:21.947832+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:20:22.680 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:22 smithi027 bash[22610]: audit 2024-08-31T04:20:21.949459+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:20:22.681 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:22 smithi027 bash[22610]: audit 2024-08-31T04:20:21.959960+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:20:22.681 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:22 smithi027 bash[22610]: audit 2024-08-31T04:20:21.964588+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:20:22.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:22 smithi163 bash[24253]: audit 2024-08-31T04:20:20.587960+0000 mgr.a (mgr.14388) 5582 : audit [DBG] from='client.129987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:22.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:22 smithi163 bash[24253]: audit 2024-08-31T04:20:21.947832+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:20:22.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:22 smithi163 bash[24253]: audit 2024-08-31T04:20:21.949459+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:20:22.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:22 smithi163 bash[24253]: audit 2024-08-31T04:20:21.959960+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:20:22.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:22 smithi163 bash[24253]: audit 2024-08-31T04:20:21.964588+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:20:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:22 smithi191 bash[24992]: audit 2024-08-31T04:20:20.587960+0000 mgr.a (mgr.14388) 5582 : audit [DBG] from='client.129987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:22 smithi191 bash[24992]: audit 2024-08-31T04:20:21.947832+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:20:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:22 smithi191 bash[24992]: audit 2024-08-31T04:20:21.949459+0000 mon.a (mon.0) 1427 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:20:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:22 smithi191 bash[24992]: audit 2024-08-31T04:20:21.959960+0000 mon.a (mon.0) 1428 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:20:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:22 smithi191 bash[24992]: audit 2024-08-31T04:20:21.964588+0000 mon.a (mon.0) 1429 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:20:22.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:20:22 smithi027 bash[22863]: debug 2024-08-31T04:20:22.675+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:20:22.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:20:22 smithi027 bash[22863]: debug 2024-08-31T04:20:22.679+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:20:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:23 smithi163 bash[24253]: audit 2024-08-31T04:20:21.967013+0000 mgr.a (mgr.14388) 5583 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:20:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:23 smithi163 bash[24253]: cluster 2024-08-31T04:20:22.069674+0000 mgr.a (mgr.14388) 5584 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:23 smithi027 bash[22610]: audit 2024-08-31T04:20:21.967013+0000 mgr.a (mgr.14388) 5583 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:20:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:23 smithi027 bash[22610]: cluster 2024-08-31T04:20:22.069674+0000 mgr.a (mgr.14388) 5584 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:23 smithi191 bash[24992]: audit 2024-08-31T04:20:21.967013+0000 mgr.a (mgr.14388) 5583 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:20:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:23 smithi191 bash[24992]: cluster 2024-08-31T04:20:22.069674+0000 mgr.a (mgr.14388) 5584 : cluster [DBG] pgmap v3870: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:24.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:24 smithi163 bash[24253]: audit 2024-08-31T04:20:22.681691+0000 mgr.a (mgr.14388) 5585 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:20:24.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:24 smithi163 bash[24253]: cephadm 2024-08-31T04:20:22.683020+0000 mgr.a (mgr.14388) 5586 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:20:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:24 smithi027 bash[22610]: audit 2024-08-31T04:20:22.681691+0000 mgr.a (mgr.14388) 5585 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:20:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:24 smithi027 bash[22610]: cephadm 2024-08-31T04:20:22.683020+0000 mgr.a (mgr.14388) 5586 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:20:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:24 smithi191 bash[24992]: audit 2024-08-31T04:20:22.681691+0000 mgr.a (mgr.14388) 5585 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:20:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:24 smithi191 bash[24992]: cephadm 2024-08-31T04:20:22.683020+0000 mgr.a (mgr.14388) 5586 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:20:25.691 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:25 smithi163 bash[24253]: cluster 2024-08-31T04:20:24.071951+0000 mgr.a (mgr.14388) 5587 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:25 smithi027 bash[22610]: cluster 2024-08-31T04:20:24.071951+0000 mgr.a (mgr.14388) 5587 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:25 smithi191 bash[24992]: cluster 2024-08-31T04:20:24.071951+0000 mgr.a (mgr.14388) 5587 : cluster [DBG] pgmap v3871: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:26.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:20:26.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:20:26.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:20:26.743 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:20:26.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:20:26.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:20:26.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:20:26.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:20:27.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:27 smithi163 bash[24253]: cluster 2024-08-31T04:20:26.072653+0000 mgr.a (mgr.14388) 5588 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:27.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:27 smithi163 bash[24253]: audit 2024-08-31T04:20:26.333202+0000 mgr.a (mgr.14388) 5589 : audit [DBG] from='client.130170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:27 smithi027 bash[22610]: cluster 2024-08-31T04:20:26.072653+0000 mgr.a (mgr.14388) 5588 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:27 smithi027 bash[22610]: audit 2024-08-31T04:20:26.333202+0000 mgr.a (mgr.14388) 5589 : audit [DBG] from='client.130170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:27 smithi191 bash[24992]: cluster 2024-08-31T04:20:26.072653+0000 mgr.a (mgr.14388) 5588 : cluster [DBG] pgmap v3872: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:27 smithi191 bash[24992]: audit 2024-08-31T04:20:26.333202+0000 mgr.a (mgr.14388) 5589 : audit [DBG] from='client.130170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:29.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:29 smithi163 bash[24253]: cluster 2024-08-31T04:20:28.074535+0000 mgr.a (mgr.14388) 5590 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:29 smithi027 bash[22610]: cluster 2024-08-31T04:20:28.074535+0000 mgr.a (mgr.14388) 5590 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:29 smithi191 bash[24992]: cluster 2024-08-31T04:20:28.074535+0000 mgr.a (mgr.14388) 5590 : cluster [DBG] pgmap v3873: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:31.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:31 smithi163 bash[24253]: cluster 2024-08-31T04:20:30.075762+0000 mgr.a (mgr.14388) 5591 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:31 smithi027 bash[22610]: cluster 2024-08-31T04:20:30.075762+0000 mgr.a (mgr.14388) 5591 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:31.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:20:31.745 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:20:31.745 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:20:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:31 smithi191 bash[24992]: cluster 2024-08-31T04:20:30.075762+0000 mgr.a (mgr.14388) 5591 : cluster [DBG] pgmap v3874: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:32.495 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:20:32.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:20:32.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:20:32.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:20:32.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:20:33.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:33 smithi163 bash[24253]: cluster 2024-08-31T04:20:32.076470+0000 mgr.a (mgr.14388) 5592 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:33.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:33 smithi163 bash[24253]: audit 2024-08-31T04:20:32.078907+0000 mgr.a (mgr.14388) 5593 : audit [DBG] from='client.130248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:33 smithi027 bash[22610]: cluster 2024-08-31T04:20:32.076470+0000 mgr.a (mgr.14388) 5592 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:33 smithi027 bash[22610]: audit 2024-08-31T04:20:32.078907+0000 mgr.a (mgr.14388) 5593 : audit [DBG] from='client.130248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:33 smithi191 bash[24992]: cluster 2024-08-31T04:20:32.076470+0000 mgr.a (mgr.14388) 5592 : cluster [DBG] pgmap v3875: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:33 smithi191 bash[24992]: audit 2024-08-31T04:20:32.078907+0000 mgr.a (mgr.14388) 5593 : audit [DBG] from='client.130248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:35.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:35 smithi163 bash[24253]: cluster 2024-08-31T04:20:34.078786+0000 mgr.a (mgr.14388) 5594 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:35 smithi027 bash[22610]: cluster 2024-08-31T04:20:34.078786+0000 mgr.a (mgr.14388) 5594 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:35 smithi191 bash[24992]: cluster 2024-08-31T04:20:34.078786+0000 mgr.a (mgr.14388) 5594 : cluster [DBG] pgmap v3876: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:20:37.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:20:37.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:20:37.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:20:37.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:37 smithi163 bash[24253]: cluster 2024-08-31T04:20:36.079547+0000 mgr.a (mgr.14388) 5595 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:37 smithi027 bash[22610]: cluster 2024-08-31T04:20:36.079547+0000 mgr.a (mgr.14388) 5595 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:37 smithi191 bash[24992]: cluster 2024-08-31T04:20:36.079547+0000 mgr.a (mgr.14388) 5595 : cluster [DBG] pgmap v3877: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:38.237 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:20:38.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:20:38.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:20:38.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:20:38.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:20:39.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:39 smithi163 bash[24253]: audit 2024-08-31T04:20:37.829220+0000 mgr.a (mgr.14388) 5596 : audit [DBG] from='client.130326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:39.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:39 smithi163 bash[24253]: cluster 2024-08-31T04:20:38.081779+0000 mgr.a (mgr.14388) 5597 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:39 smithi027 bash[22610]: audit 2024-08-31T04:20:37.829220+0000 mgr.a (mgr.14388) 5596 : audit [DBG] from='client.130326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:39 smithi027 bash[22610]: cluster 2024-08-31T04:20:38.081779+0000 mgr.a (mgr.14388) 5597 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:39 smithi191 bash[24992]: audit 2024-08-31T04:20:37.829220+0000 mgr.a (mgr.14388) 5596 : audit [DBG] from='client.130326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:39 smithi191 bash[24992]: cluster 2024-08-31T04:20:38.081779+0000 mgr.a (mgr.14388) 5597 : cluster [DBG] pgmap v3878: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:41 smithi027 bash[22610]: cluster 2024-08-31T04:20:40.083480+0000 mgr.a (mgr.14388) 5598 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:20:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:41 smithi191 bash[24992]: cluster 2024-08-31T04:20:40.083480+0000 mgr.a (mgr.14388) 5598 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:20:41.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:41 smithi163 bash[24253]: cluster 2024-08-31T04:20:40.083480+0000 mgr.a (mgr.14388) 5598 : cluster [DBG] pgmap v3879: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:20:43.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:20:43.239 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:20:43.239 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:20:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:43 smithi027 bash[22610]: cluster 2024-08-31T04:20:42.084259+0000 mgr.a (mgr.14388) 5599 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:20:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:43 smithi191 bash[24992]: cluster 2024-08-31T04:20:42.084259+0000 mgr.a (mgr.14388) 5599 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:20:43.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:43 smithi163 bash[24253]: cluster 2024-08-31T04:20:42.084259+0000 mgr.a (mgr.14388) 5599 : cluster [DBG] pgmap v3880: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:20:43.990 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:20:43.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:20:43.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:20:43.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:20:43.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:20:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:45 smithi027 bash[22610]: audit 2024-08-31T04:20:43.572761+0000 mgr.a (mgr.14388) 5600 : audit [DBG] from='client.130404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:45 smithi027 bash[22610]: cluster 2024-08-31T04:20:44.086901+0000 mgr.a (mgr.14388) 5601 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:45 smithi191 bash[24992]: audit 2024-08-31T04:20:43.572761+0000 mgr.a (mgr.14388) 5600 : audit [DBG] from='client.130404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:45 smithi191 bash[24992]: cluster 2024-08-31T04:20:44.086901+0000 mgr.a (mgr.14388) 5601 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:45.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:45 smithi163 bash[24253]: audit 2024-08-31T04:20:43.572761+0000 mgr.a (mgr.14388) 5600 : audit [DBG] from='client.130404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:45.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:45 smithi163 bash[24253]: cluster 2024-08-31T04:20:44.086901+0000 mgr.a (mgr.14388) 5601 : cluster [DBG] pgmap v3881: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:47 smithi027 bash[22610]: cluster 2024-08-31T04:20:46.087666+0000 mgr.a (mgr.14388) 5602 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:20:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:47 smithi191 bash[24992]: cluster 2024-08-31T04:20:46.087666+0000 mgr.a (mgr.14388) 5602 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:20:47.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:47 smithi163 bash[24253]: cluster 2024-08-31T04:20:46.087666+0000 mgr.a (mgr.14388) 5602 : cluster [DBG] pgmap v3882: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:20:48.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:20:48.993 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:20:48.993 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:20:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:49 smithi027 bash[22610]: cluster 2024-08-31T04:20:48.089241+0000 mgr.a (mgr.14388) 5603 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:20:49.764 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:20:49.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:20:49.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:20:49.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:20:49.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:20:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:49 smithi191 bash[24992]: cluster 2024-08-31T04:20:48.089241+0000 mgr.a (mgr.14388) 5603 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:20:49.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:49 smithi163 bash[24253]: cluster 2024-08-31T04:20:48.089241+0000 mgr.a (mgr.14388) 5603 : cluster [DBG] pgmap v3883: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:20:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:50 smithi027 bash[22610]: audit 2024-08-31T04:20:49.328780+0000 mgr.a (mgr.14388) 5604 : audit [DBG] from='client.130479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:50 smithi191 bash[24992]: audit 2024-08-31T04:20:49.328780+0000 mgr.a (mgr.14388) 5604 : audit [DBG] from='client.130479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:50.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:50 smithi163 bash[24253]: audit 2024-08-31T04:20:49.328780+0000 mgr.a (mgr.14388) 5604 : audit [DBG] from='client.130479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:51 smithi027 bash[22610]: cluster 2024-08-31T04:20:50.090935+0000 mgr.a (mgr.14388) 5605 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:51 smithi191 bash[24992]: cluster 2024-08-31T04:20:50.090935+0000 mgr.a (mgr.14388) 5605 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:51.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:51 smithi163 bash[24253]: cluster 2024-08-31T04:20:50.090935+0000 mgr.a (mgr.14388) 5605 : cluster [DBG] pgmap v3884: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:53 smithi027 bash[22610]: cluster 2024-08-31T04:20:52.091743+0000 mgr.a (mgr.14388) 5606 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:53 smithi191 bash[24992]: cluster 2024-08-31T04:20:52.091743+0000 mgr.a (mgr.14388) 5606 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:53.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:53 smithi163 bash[24253]: cluster 2024-08-31T04:20:52.091743+0000 mgr.a (mgr.14388) 5606 : cluster [DBG] pgmap v3885: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:54.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:20:54.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:20:54.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:20:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:54 smithi191 bash[24992]: cluster 2024-08-31T04:20:54.093768+0000 mgr.a (mgr.14388) 5607 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:20:54.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:54 smithi163 bash[24253]: cluster 2024-08-31T04:20:54.093768+0000 mgr.a (mgr.14388) 5607 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:20:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:54 smithi027 bash[22610]: cluster 2024-08-31T04:20:54.093768+0000 mgr.a (mgr.14388) 5607 : cluster [DBG] pgmap v3886: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:20:55.507 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:20:55.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:20:55.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:20:55.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:20:55.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:20:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:55 smithi191 bash[24992]: audit 2024-08-31T04:20:55.099467+0000 mgr.a (mgr.14388) 5608 : audit [DBG] from='client.130554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:55.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:55 smithi163 bash[24253]: audit 2024-08-31T04:20:55.099467+0000 mgr.a (mgr.14388) 5608 : audit [DBG] from='client.130554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:55 smithi027 bash[22610]: audit 2024-08-31T04:20:55.099467+0000 mgr.a (mgr.14388) 5608 : audit [DBG] from='client.130554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:20:56.942 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:56 smithi163 bash[24253]: cluster 2024-08-31T04:20:56.094631+0000 mgr.a (mgr.14388) 5609 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:56 smithi027 bash[22610]: cluster 2024-08-31T04:20:56.094631+0000 mgr.a (mgr.14388) 5609 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:56 smithi191 bash[24992]: cluster 2024-08-31T04:20:56.094631+0000 mgr.a (mgr.14388) 5609 : cluster [DBG] pgmap v3887: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:20:59.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:20:59 smithi163 bash[24253]: cluster 2024-08-31T04:20:58.096607+0000 mgr.a (mgr.14388) 5610 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:20:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:20:59 smithi027 bash[22610]: cluster 2024-08-31T04:20:58.096607+0000 mgr.a (mgr.14388) 5610 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:20:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:20:59 smithi191 bash[24992]: cluster 2024-08-31T04:20:58.096607+0000 mgr.a (mgr.14388) 5610 : cluster [DBG] pgmap v3888: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:00.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:00.509 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:00.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:01.300 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:01.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:01.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:01.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:01.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:01.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:01 smithi163 bash[24253]: cluster 2024-08-31T04:21:00.097597+0000 mgr.a (mgr.14388) 5611 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:21:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:01 smithi027 bash[22610]: cluster 2024-08-31T04:21:00.097597+0000 mgr.a (mgr.14388) 5611 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:21:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:01 smithi191 bash[24992]: cluster 2024-08-31T04:21:00.097597+0000 mgr.a (mgr.14388) 5611 : cluster [DBG] pgmap v3889: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:21:02.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:02 smithi163 bash[24253]: audit 2024-08-31T04:21:00.852822+0000 mgr.a (mgr.14388) 5612 : audit [DBG] from='client.130629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:02 smithi027 bash[22610]: audit 2024-08-31T04:21:00.852822+0000 mgr.a (mgr.14388) 5612 : audit [DBG] from='client.130629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:02 smithi191 bash[24992]: audit 2024-08-31T04:21:00.852822+0000 mgr.a (mgr.14388) 5612 : audit [DBG] from='client.130629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:03.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:03 smithi163 bash[24253]: cluster 2024-08-31T04:21:02.098535+0000 mgr.a (mgr.14388) 5613 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:03 smithi027 bash[22610]: cluster 2024-08-31T04:21:02.098535+0000 mgr.a (mgr.14388) 5613 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:03 smithi191 bash[24992]: cluster 2024-08-31T04:21:02.098535+0000 mgr.a (mgr.14388) 5613 : cluster [DBG] pgmap v3890: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:05.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:05 smithi163 bash[24253]: cluster 2024-08-31T04:21:04.100759+0000 mgr.a (mgr.14388) 5614 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:05 smithi027 bash[22610]: cluster 2024-08-31T04:21:04.100759+0000 mgr.a (mgr.14388) 5614 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:05 smithi191 bash[24992]: cluster 2024-08-31T04:21:04.100759+0000 mgr.a (mgr.14388) 5614 : cluster [DBG] pgmap v3891: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:06.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:06.302 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:06.302 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:07.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:07.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:07.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:07.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:07.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:07.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:07 smithi163 bash[24253]: cluster 2024-08-31T04:21:06.101543+0000 mgr.a (mgr.14388) 5615 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:07 smithi027 bash[22610]: cluster 2024-08-31T04:21:06.101543+0000 mgr.a (mgr.14388) 5615 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:07 smithi191 bash[24992]: cluster 2024-08-31T04:21:06.101543+0000 mgr.a (mgr.14388) 5615 : cluster [DBG] pgmap v3892: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:08.442 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:08 smithi163 bash[24253]: audit 2024-08-31T04:21:06.638009+0000 mgr.a (mgr.14388) 5616 : audit [DBG] from='client.130704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:08 smithi027 bash[22610]: audit 2024-08-31T04:21:06.638009+0000 mgr.a (mgr.14388) 5616 : audit [DBG] from='client.130704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:08 smithi191 bash[24992]: audit 2024-08-31T04:21:06.638009+0000 mgr.a (mgr.14388) 5616 : audit [DBG] from='client.130704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:09 smithi027 bash[22610]: cluster 2024-08-31T04:21:08.103470+0000 mgr.a (mgr.14388) 5617 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:09 smithi191 bash[24992]: cluster 2024-08-31T04:21:08.103470+0000 mgr.a (mgr.14388) 5617 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:09.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:09 smithi163 bash[24253]: cluster 2024-08-31T04:21:08.103470+0000 mgr.a (mgr.14388) 5617 : cluster [DBG] pgmap v3893: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:11 smithi027 bash[22610]: cluster 2024-08-31T04:21:10.104729+0000 mgr.a (mgr.14388) 5618 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:21:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:11 smithi191 bash[24992]: cluster 2024-08-31T04:21:10.104729+0000 mgr.a (mgr.14388) 5618 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:21:11.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:11 smithi163 bash[24253]: cluster 2024-08-31T04:21:10.104729+0000 mgr.a (mgr.14388) 5618 : cluster [DBG] pgmap v3894: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T04:21:12.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:12.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:12.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:12.846 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:13 smithi027 bash[22610]: cluster 2024-08-31T04:21:12.105400+0000 mgr.a (mgr.14388) 5619 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:13 smithi027 bash[22610]: audit 2024-08-31T04:21:12.402793+0000 mgr.a (mgr.14388) 5620 : audit [DBG] from='client.130782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:13.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:13 smithi191 bash[24992]: cluster 2024-08-31T04:21:12.105400+0000 mgr.a (mgr.14388) 5619 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:13.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:13 smithi191 bash[24992]: audit 2024-08-31T04:21:12.402793+0000 mgr.a (mgr.14388) 5620 : audit [DBG] from='client.130782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:13.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:13 smithi163 bash[24253]: cluster 2024-08-31T04:21:12.105400+0000 mgr.a (mgr.14388) 5619 : cluster [DBG] pgmap v3895: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:13.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:13 smithi163 bash[24253]: audit 2024-08-31T04:21:12.402793+0000 mgr.a (mgr.14388) 5620 : audit [DBG] from='client.130782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:15 smithi027 bash[22610]: cluster 2024-08-31T04:21:14.107819+0000 mgr.a (mgr.14388) 5621 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:15 smithi191 bash[24992]: cluster 2024-08-31T04:21:14.107819+0000 mgr.a (mgr.14388) 5621 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:15.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:15 smithi163 bash[24253]: cluster 2024-08-31T04:21:14.107819+0000 mgr.a (mgr.14388) 5621 : cluster [DBG] pgmap v3896: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:17 smithi027 bash[22610]: cluster 2024-08-31T04:21:16.108606+0000 mgr.a (mgr.14388) 5622 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:17 smithi191 bash[24992]: cluster 2024-08-31T04:21:16.108606+0000 mgr.a (mgr.14388) 5622 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:17 smithi163 bash[24253]: cluster 2024-08-31T04:21:16.108606+0000 mgr.a (mgr.14388) 5622 : cluster [DBG] pgmap v3897: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:17.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:17.848 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:17.848 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:18.602 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:18.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:18.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:18.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:18.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:19 smithi027 bash[22610]: cluster 2024-08-31T04:21:18.110103+0000 mgr.a (mgr.14388) 5623 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:19 smithi027 bash[22610]: audit 2024-08-31T04:21:18.180434+0000 mgr.a (mgr.14388) 5624 : audit [DBG] from='client.130857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:19 smithi191 bash[24992]: cluster 2024-08-31T04:21:18.110103+0000 mgr.a (mgr.14388) 5623 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:19 smithi191 bash[24992]: audit 2024-08-31T04:21:18.180434+0000 mgr.a (mgr.14388) 5624 : audit [DBG] from='client.130857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:19.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:19 smithi163 bash[24253]: cluster 2024-08-31T04:21:18.110103+0000 mgr.a (mgr.14388) 5623 : cluster [DBG] pgmap v3898: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:19.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:19 smithi163 bash[24253]: audit 2024-08-31T04:21:18.180434+0000 mgr.a (mgr.14388) 5624 : audit [DBG] from='client.130857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:21 smithi027 bash[22610]: cluster 2024-08-31T04:21:20.111951+0000 mgr.a (mgr.14388) 5625 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:21:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:21 smithi191 bash[24992]: cluster 2024-08-31T04:21:20.111951+0000 mgr.a (mgr.14388) 5625 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:21:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:21 smithi163 bash[24253]: cluster 2024-08-31T04:21:20.111951+0000 mgr.a (mgr.14388) 5625 : cluster [DBG] pgmap v3899: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T04:21:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:23 smithi027 bash[22610]: cluster 2024-08-31T04:21:22.112748+0000 mgr.a (mgr.14388) 5626 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:21:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:23 smithi027 bash[22610]: audit 2024-08-31T04:21:22.735053+0000 mon.a (mon.0) 1430 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:21:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:23 smithi191 bash[24992]: cluster 2024-08-31T04:21:22.112748+0000 mgr.a (mgr.14388) 5626 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:21:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:23 smithi191 bash[24992]: audit 2024-08-31T04:21:22.735053+0000 mon.a (mon.0) 1430 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:21:23.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:23.604 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:23.604 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:23 smithi163 bash[24253]: cluster 2024-08-31T04:21:22.112748+0000 mgr.a (mgr.14388) 5626 : cluster [DBG] pgmap v3900: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:21:23.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:23 smithi163 bash[24253]: audit 2024-08-31T04:21:22.735053+0000 mon.a (mon.0) 1430 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:21:24.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:21:24 smithi027 bash[22863]: debug 2024-08-31T04:21:24.306+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:21:24.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:21:24 smithi027 bash[22863]: debug 2024-08-31T04:21:24.318+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:21:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:24 smithi027 bash[22610]: audit 2024-08-31T04:21:23.582001+0000 mon.a (mon.0) 1431 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:21:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:24 smithi027 bash[22610]: audit 2024-08-31T04:21:23.583531+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:21:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:24 smithi027 bash[22610]: audit 2024-08-31T04:21:23.592513+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:21:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:24 smithi027 bash[22610]: audit 2024-08-31T04:21:23.595151+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:21:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:24 smithi191 bash[24992]: audit 2024-08-31T04:21:23.582001+0000 mon.a (mon.0) 1431 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:21:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:24 smithi191 bash[24992]: audit 2024-08-31T04:21:23.583531+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:21:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:24 smithi191 bash[24992]: audit 2024-08-31T04:21:23.592513+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:21:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:24 smithi191 bash[24992]: audit 2024-08-31T04:21:23.595151+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:21:24.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:24 smithi163 bash[24253]: audit 2024-08-31T04:21:23.582001+0000 mon.a (mon.0) 1431 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:21:24.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:24 smithi163 bash[24253]: audit 2024-08-31T04:21:23.583531+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:21:24.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:24 smithi163 bash[24253]: audit 2024-08-31T04:21:23.592513+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:21:24.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:24 smithi163 bash[24253]: audit 2024-08-31T04:21:23.595151+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:21:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:24.707 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:25 smithi027 bash[22610]: audit 2024-08-31T04:21:23.597383+0000 mgr.a (mgr.14388) 5627 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:21:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:25 smithi027 bash[22610]: audit 2024-08-31T04:21:23.942631+0000 mgr.a (mgr.14388) 5628 : audit [DBG] from='client.130947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:25 smithi027 bash[22610]: cluster 2024-08-31T04:21:24.114427+0000 mgr.a (mgr.14388) 5629 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:25 smithi027 bash[22610]: audit 2024-08-31T04:21:24.308750+0000 mgr.a (mgr.14388) 5630 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:21:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:25 smithi027 bash[22610]: cephadm 2024-08-31T04:21:24.319702+0000 mgr.a (mgr.14388) 5631 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:21:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:25 smithi191 bash[24992]: audit 2024-08-31T04:21:23.597383+0000 mgr.a (mgr.14388) 5627 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:21:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:25 smithi191 bash[24992]: audit 2024-08-31T04:21:23.942631+0000 mgr.a (mgr.14388) 5628 : audit [DBG] from='client.130947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:25 smithi191 bash[24992]: cluster 2024-08-31T04:21:24.114427+0000 mgr.a (mgr.14388) 5629 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:25 smithi191 bash[24992]: audit 2024-08-31T04:21:24.308750+0000 mgr.a (mgr.14388) 5630 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:21:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:25 smithi191 bash[24992]: cephadm 2024-08-31T04:21:24.319702+0000 mgr.a (mgr.14388) 5631 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:21:25.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:25 smithi163 bash[24253]: audit 2024-08-31T04:21:23.597383+0000 mgr.a (mgr.14388) 5627 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:21:25.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:25 smithi163 bash[24253]: audit 2024-08-31T04:21:23.942631+0000 mgr.a (mgr.14388) 5628 : audit [DBG] from='client.130947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:25.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:25 smithi163 bash[24253]: cluster 2024-08-31T04:21:24.114427+0000 mgr.a (mgr.14388) 5629 : cluster [DBG] pgmap v3901: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:25.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:25 smithi163 bash[24253]: audit 2024-08-31T04:21:24.308750+0000 mgr.a (mgr.14388) 5630 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:21:25.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:25 smithi163 bash[24253]: cephadm 2024-08-31T04:21:24.319702+0000 mgr.a (mgr.14388) 5631 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:21:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:27 smithi027 bash[22610]: cluster 2024-08-31T04:21:26.115374+0000 mgr.a (mgr.14388) 5632 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:21:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:27 smithi191 bash[24992]: cluster 2024-08-31T04:21:26.115374+0000 mgr.a (mgr.14388) 5632 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:21:27.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:27 smithi163 bash[24253]: cluster 2024-08-31T04:21:26.115374+0000 mgr.a (mgr.14388) 5632 : cluster [DBG] pgmap v3902: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:21:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:29 smithi191 bash[24992]: cluster 2024-08-31T04:21:28.117485+0000 mgr.a (mgr.14388) 5633 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:29.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:29 smithi163 bash[24253]: cluster 2024-08-31T04:21:28.117485+0000 mgr.a (mgr.14388) 5633 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:29.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:29.709 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:29.709 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:29.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:29 smithi027 bash[22610]: cluster 2024-08-31T04:21:28.117485+0000 mgr.a (mgr.14388) 5633 : cluster [DBG] pgmap v3903: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:30.500 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:30.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:30.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:30.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:31 smithi191 bash[24992]: audit 2024-08-31T04:21:30.049742+0000 mgr.a (mgr.14388) 5634 : audit [DBG] from='client.131109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:31 smithi191 bash[24992]: cluster 2024-08-31T04:21:30.118080+0000 mgr.a (mgr.14388) 5635 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:31.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:31 smithi163 bash[24253]: audit 2024-08-31T04:21:30.049742+0000 mgr.a (mgr.14388) 5634 : audit [DBG] from='client.131109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:31.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:31 smithi163 bash[24253]: cluster 2024-08-31T04:21:30.118080+0000 mgr.a (mgr.14388) 5635 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:31 smithi027 bash[22610]: audit 2024-08-31T04:21:30.049742+0000 mgr.a (mgr.14388) 5634 : audit [DBG] from='client.131109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:31 smithi027 bash[22610]: cluster 2024-08-31T04:21:30.118080+0000 mgr.a (mgr.14388) 5635 : cluster [DBG] pgmap v3904: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:33 smithi191 bash[24992]: cluster 2024-08-31T04:21:32.118978+0000 mgr.a (mgr.14388) 5636 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:33.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:33 smithi163 bash[24253]: cluster 2024-08-31T04:21:32.118978+0000 mgr.a (mgr.14388) 5636 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:33 smithi027 bash[22610]: cluster 2024-08-31T04:21:32.118978+0000 mgr.a (mgr.14388) 5636 : cluster [DBG] pgmap v3905: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:35.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:35.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:35 smithi191 bash[24992]: cluster 2024-08-31T04:21:34.121254+0000 mgr.a (mgr.14388) 5637 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:35.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:35 smithi163 bash[24253]: cluster 2024-08-31T04:21:34.121254+0000 mgr.a (mgr.14388) 5637 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:35 smithi027 bash[22610]: cluster 2024-08-31T04:21:34.121254+0000 mgr.a (mgr.14388) 5637 : cluster [DBG] pgmap v3906: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:36.277 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:36.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:36.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:36.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:36.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:37 smithi191 bash[24992]: audit 2024-08-31T04:21:35.842344+0000 mgr.a (mgr.14388) 5638 : audit [DBG] from='client.131187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:37 smithi191 bash[24992]: cluster 2024-08-31T04:21:36.121790+0000 mgr.a (mgr.14388) 5639 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:37.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:37 smithi163 bash[24253]: audit 2024-08-31T04:21:35.842344+0000 mgr.a (mgr.14388) 5638 : audit [DBG] from='client.131187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:37.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:37 smithi163 bash[24253]: cluster 2024-08-31T04:21:36.121790+0000 mgr.a (mgr.14388) 5639 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:37 smithi027 bash[22610]: audit 2024-08-31T04:21:35.842344+0000 mgr.a (mgr.14388) 5638 : audit [DBG] from='client.131187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:37 smithi027 bash[22610]: cluster 2024-08-31T04:21:36.121790+0000 mgr.a (mgr.14388) 5639 : cluster [DBG] pgmap v3907: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:39 smithi191 bash[24992]: cluster 2024-08-31T04:21:38.124018+0000 mgr.a (mgr.14388) 5640 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:39.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:39 smithi163 bash[24253]: cluster 2024-08-31T04:21:38.124018+0000 mgr.a (mgr.14388) 5640 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:39 smithi027 bash[22610]: cluster 2024-08-31T04:21:38.124018+0000 mgr.a (mgr.14388) 5640 : cluster [DBG] pgmap v3908: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:21:41.279 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:41.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:41.280 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:41 smithi191 bash[24992]: cluster 2024-08-31T04:21:40.124852+0000 mgr.a (mgr.14388) 5641 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:41.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:41 smithi163 bash[24253]: cluster 2024-08-31T04:21:40.124852+0000 mgr.a (mgr.14388) 5641 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:41.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:41 smithi027 bash[22610]: cluster 2024-08-31T04:21:40.124852+0000 mgr.a (mgr.14388) 5641 : cluster [DBG] pgmap v3909: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:42.023 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:42.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:42.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:42.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:42.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:43 smithi191 bash[24992]: audit 2024-08-31T04:21:41.608967+0000 mgr.a (mgr.14388) 5642 : audit [DBG] from='client.131262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:43 smithi191 bash[24992]: cluster 2024-08-31T04:21:42.126002+0000 mgr.a (mgr.14388) 5643 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:43.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:43 smithi163 bash[24253]: audit 2024-08-31T04:21:41.608967+0000 mgr.a (mgr.14388) 5642 : audit [DBG] from='client.131262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:43.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:43 smithi163 bash[24253]: cluster 2024-08-31T04:21:42.126002+0000 mgr.a (mgr.14388) 5643 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:43 smithi027 bash[22610]: audit 2024-08-31T04:21:41.608967+0000 mgr.a (mgr.14388) 5642 : audit [DBG] from='client.131262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:43 smithi027 bash[22610]: cluster 2024-08-31T04:21:42.126002+0000 mgr.a (mgr.14388) 5643 : cluster [DBG] pgmap v3910: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:45 smithi191 bash[24992]: cluster 2024-08-31T04:21:44.128424+0000 mgr.a (mgr.14388) 5644 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:45.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:45 smithi163 bash[24253]: cluster 2024-08-31T04:21:44.128424+0000 mgr.a (mgr.14388) 5644 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:45 smithi027 bash[22610]: cluster 2024-08-31T04:21:44.128424+0000 mgr.a (mgr.14388) 5644 : cluster [DBG] pgmap v3911: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:47.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:47.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:47.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:47 smithi191 bash[24992]: cluster 2024-08-31T04:21:46.129210+0000 mgr.a (mgr.14388) 5645 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:47.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:47 smithi163 bash[24253]: cluster 2024-08-31T04:21:46.129210+0000 mgr.a (mgr.14388) 5645 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:47 smithi027 bash[22610]: cluster 2024-08-31T04:21:46.129210+0000 mgr.a (mgr.14388) 5645 : cluster [DBG] pgmap v3912: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:47.799 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:47.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:47.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:47.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:47.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:48 smithi191 bash[24992]: audit 2024-08-31T04:21:47.363159+0000 mgr.a (mgr.14388) 5646 : audit [DBG] from='client.131340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:48.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:48 smithi163 bash[24253]: audit 2024-08-31T04:21:47.363159+0000 mgr.a (mgr.14388) 5646 : audit [DBG] from='client.131340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:48 smithi027 bash[22610]: audit 2024-08-31T04:21:47.363159+0000 mgr.a (mgr.14388) 5646 : audit [DBG] from='client.131340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:49 smithi191 bash[24992]: cluster 2024-08-31T04:21:48.131472+0000 mgr.a (mgr.14388) 5647 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:49.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:49 smithi163 bash[24253]: cluster 2024-08-31T04:21:48.131472+0000 mgr.a (mgr.14388) 5647 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:49 smithi027 bash[22610]: cluster 2024-08-31T04:21:48.131472+0000 mgr.a (mgr.14388) 5647 : cluster [DBG] pgmap v3913: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:21:51.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:51 smithi163 bash[24253]: cluster 2024-08-31T04:21:50.132274+0000 mgr.a (mgr.14388) 5648 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:51 smithi027 bash[22610]: cluster 2024-08-31T04:21:50.132274+0000 mgr.a (mgr.14388) 5648 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:51 smithi191 bash[24992]: cluster 2024-08-31T04:21:50.132274+0000 mgr.a (mgr.14388) 5648 : cluster [DBG] pgmap v3914: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:52.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:52.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:52.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:53.546 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:53.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:53.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:53.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:53.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:53.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:53 smithi163 bash[24253]: cluster 2024-08-31T04:21:52.133058+0000 mgr.a (mgr.14388) 5649 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:53 smithi027 bash[22610]: cluster 2024-08-31T04:21:52.133058+0000 mgr.a (mgr.14388) 5649 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:53 smithi191 bash[24992]: cluster 2024-08-31T04:21:52.133058+0000 mgr.a (mgr.14388) 5649 : cluster [DBG] pgmap v3915: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:54.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:54 smithi163 bash[24253]: audit 2024-08-31T04:21:53.136976+0000 mgr.a (mgr.14388) 5650 : audit [DBG] from='client.131418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:54 smithi027 bash[22610]: audit 2024-08-31T04:21:53.136976+0000 mgr.a (mgr.14388) 5650 : audit [DBG] from='client.131418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:54 smithi191 bash[24992]: audit 2024-08-31T04:21:53.136976+0000 mgr.a (mgr.14388) 5650 : audit [DBG] from='client.131418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:21:55.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:55 smithi163 bash[24253]: cluster 2024-08-31T04:21:54.135931+0000 mgr.a (mgr.14388) 5651 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:55 smithi027 bash[22610]: cluster 2024-08-31T04:21:54.135931+0000 mgr.a (mgr.14388) 5651 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:55 smithi191 bash[24992]: cluster 2024-08-31T04:21:54.135931+0000 mgr.a (mgr.14388) 5651 : cluster [DBG] pgmap v3916: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:57.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:57 smithi163 bash[24253]: cluster 2024-08-31T04:21:56.136703+0000 mgr.a (mgr.14388) 5652 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:21:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:57 smithi027 bash[22610]: cluster 2024-08-31T04:21:56.136703+0000 mgr.a (mgr.14388) 5652 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:21:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:57 smithi191 bash[24992]: cluster 2024-08-31T04:21:56.136703+0000 mgr.a (mgr.14388) 5652 : cluster [DBG] pgmap v3917: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:21:58.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:21:58.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:21:58.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:21:59.325 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:21:59.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:21:59.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:21:59.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:21:59.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:21:59.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:21:59 smithi163 bash[24253]: cluster 2024-08-31T04:21:58.138595+0000 mgr.a (mgr.14388) 5653 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:21:59 smithi027 bash[22610]: cluster 2024-08-31T04:21:58.138595+0000 mgr.a (mgr.14388) 5653 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:21:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:21:59 smithi191 bash[24992]: cluster 2024-08-31T04:21:58.138595+0000 mgr.a (mgr.14388) 5653 : cluster [DBG] pgmap v3918: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:00.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:00 smithi163 bash[24253]: audit 2024-08-31T04:21:58.886372+0000 mgr.a (mgr.14388) 5654 : audit [DBG] from='client.131493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:00 smithi027 bash[22610]: audit 2024-08-31T04:21:58.886372+0000 mgr.a (mgr.14388) 5654 : audit [DBG] from='client.131493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:00 smithi191 bash[24992]: audit 2024-08-31T04:21:58.886372+0000 mgr.a (mgr.14388) 5654 : audit [DBG] from='client.131493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:01.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:01 smithi163 bash[24253]: cluster 2024-08-31T04:22:00.139221+0000 mgr.a (mgr.14388) 5655 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:22:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:01 smithi027 bash[22610]: cluster 2024-08-31T04:22:00.139221+0000 mgr.a (mgr.14388) 5655 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:22:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:01 smithi191 bash[24992]: cluster 2024-08-31T04:22:00.139221+0000 mgr.a (mgr.14388) 5655 : cluster [DBG] pgmap v3919: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:22:03.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:03 smithi163 bash[24253]: cluster 2024-08-31T04:22:02.139961+0000 mgr.a (mgr.14388) 5656 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:22:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:03 smithi027 bash[22610]: cluster 2024-08-31T04:22:02.139961+0000 mgr.a (mgr.14388) 5656 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:22:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:03 smithi191 bash[24992]: cluster 2024-08-31T04:22:02.139961+0000 mgr.a (mgr.14388) 5656 : cluster [DBG] pgmap v3920: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:22:04.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:22:04.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:22:04.328 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:22:05.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:22:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:22:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:22:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:22:05.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:22:05.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:05 smithi163 bash[24253]: cluster 2024-08-31T04:22:04.142161+0000 mgr.a (mgr.14388) 5657 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:05 smithi027 bash[22610]: cluster 2024-08-31T04:22:04.142161+0000 mgr.a (mgr.14388) 5657 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:05 smithi191 bash[24992]: cluster 2024-08-31T04:22:04.142161+0000 mgr.a (mgr.14388) 5657 : cluster [DBG] pgmap v3921: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:06.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:06 smithi163 bash[24253]: audit 2024-08-31T04:22:04.663876+0000 mgr.a (mgr.14388) 5658 : audit [DBG] from='client.131571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:06 smithi027 bash[22610]: audit 2024-08-31T04:22:04.663876+0000 mgr.a (mgr.14388) 5658 : audit [DBG] from='client.131571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:06 smithi191 bash[24992]: audit 2024-08-31T04:22:04.663876+0000 mgr.a (mgr.14388) 5658 : audit [DBG] from='client.131571 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:07.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:07 smithi163 bash[24253]: cluster 2024-08-31T04:22:06.143124+0000 mgr.a (mgr.14388) 5659 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:07 smithi027 bash[22610]: cluster 2024-08-31T04:22:06.143124+0000 mgr.a (mgr.14388) 5659 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:07 smithi191 bash[24992]: cluster 2024-08-31T04:22:06.143124+0000 mgr.a (mgr.14388) 5659 : cluster [DBG] pgmap v3922: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:09.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:09 smithi163 bash[24253]: cluster 2024-08-31T04:22:08.145273+0000 mgr.a (mgr.14388) 5660 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:09 smithi027 bash[22610]: cluster 2024-08-31T04:22:08.145273+0000 mgr.a (mgr.14388) 5660 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:09 smithi191 bash[24992]: cluster 2024-08-31T04:22:08.145273+0000 mgr.a (mgr.14388) 5660 : cluster [DBG] pgmap v3923: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:10.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:22:10.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:22:10.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:22:10.885 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:22:10.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:22:10.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:22:10.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:22:10.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:22:11.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:11 smithi163 bash[24253]: cluster 2024-08-31T04:22:10.146029+0000 mgr.a (mgr.14388) 5661 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:11.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:11 smithi163 bash[24253]: audit 2024-08-31T04:22:10.443330+0000 mgr.a (mgr.14388) 5662 : audit [DBG] from='client.131643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:11 smithi027 bash[22610]: cluster 2024-08-31T04:22:10.146029+0000 mgr.a (mgr.14388) 5661 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:11 smithi027 bash[22610]: audit 2024-08-31T04:22:10.443330+0000 mgr.a (mgr.14388) 5662 : audit [DBG] from='client.131643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:11 smithi191 bash[24992]: cluster 2024-08-31T04:22:10.146029+0000 mgr.a (mgr.14388) 5661 : cluster [DBG] pgmap v3924: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:11 smithi191 bash[24992]: audit 2024-08-31T04:22:10.443330+0000 mgr.a (mgr.14388) 5662 : audit [DBG] from='client.131643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:13.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:13 smithi163 bash[24253]: cluster 2024-08-31T04:22:12.146952+0000 mgr.a (mgr.14388) 5663 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:13 smithi027 bash[22610]: cluster 2024-08-31T04:22:12.146952+0000 mgr.a (mgr.14388) 5663 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:13 smithi191 bash[24992]: cluster 2024-08-31T04:22:12.146952+0000 mgr.a (mgr.14388) 5663 : cluster [DBG] pgmap v3925: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:15.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:15 smithi163 bash[24253]: cluster 2024-08-31T04:22:14.149179+0000 mgr.a (mgr.14388) 5664 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:15 smithi027 bash[22610]: cluster 2024-08-31T04:22:14.149179+0000 mgr.a (mgr.14388) 5664 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:15 smithi191 bash[24992]: cluster 2024-08-31T04:22:14.149179+0000 mgr.a (mgr.14388) 5664 : cluster [DBG] pgmap v3926: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:15.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:22:15.887 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:22:15.887 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:22:16.618 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:22:16.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:22:16.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:22:16.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:22:16.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:22:17.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:17 smithi163 bash[24253]: cluster 2024-08-31T04:22:16.149911+0000 mgr.a (mgr.14388) 5665 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:17.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:17 smithi163 bash[24253]: audit 2024-08-31T04:22:16.217365+0000 mgr.a (mgr.14388) 5666 : audit [DBG] from='client.131718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:17 smithi027 bash[22610]: cluster 2024-08-31T04:22:16.149911+0000 mgr.a (mgr.14388) 5665 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:17 smithi027 bash[22610]: audit 2024-08-31T04:22:16.217365+0000 mgr.a (mgr.14388) 5666 : audit [DBG] from='client.131718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:17 smithi191 bash[24992]: cluster 2024-08-31T04:22:16.149911+0000 mgr.a (mgr.14388) 5665 : cluster [DBG] pgmap v3927: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:17 smithi191 bash[24992]: audit 2024-08-31T04:22:16.217365+0000 mgr.a (mgr.14388) 5666 : audit [DBG] from='client.131718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:19.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:19 smithi163 bash[24253]: cluster 2024-08-31T04:22:18.152116+0000 mgr.a (mgr.14388) 5667 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:19 smithi027 bash[22610]: cluster 2024-08-31T04:22:18.152116+0000 mgr.a (mgr.14388) 5667 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:19 smithi191 bash[24992]: cluster 2024-08-31T04:22:18.152116+0000 mgr.a (mgr.14388) 5667 : cluster [DBG] pgmap v3928: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:21.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:22:21.620 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:22:21.620 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:22:21.692 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:21 smithi163 bash[24253]: cluster 2024-08-31T04:22:20.152903+0000 mgr.a (mgr.14388) 5668 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:21 smithi027 bash[22610]: cluster 2024-08-31T04:22:20.152903+0000 mgr.a (mgr.14388) 5668 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:21 smithi191 bash[24992]: cluster 2024-08-31T04:22:20.152903+0000 mgr.a (mgr.14388) 5668 : cluster [DBG] pgmap v3929: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:22.404 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:22:22.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:22:22.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:22:22.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:22:22.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:22:23.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:23 smithi163 bash[24253]: audit 2024-08-31T04:22:21.959754+0000 mgr.a (mgr.14388) 5669 : audit [DBG] from='client.131790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:23.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:23 smithi163 bash[24253]: cluster 2024-08-31T04:22:22.153528+0000 mgr.a (mgr.14388) 5670 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:23 smithi027 bash[22610]: audit 2024-08-31T04:22:21.959754+0000 mgr.a (mgr.14388) 5669 : audit [DBG] from='client.131790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:23 smithi027 bash[22610]: cluster 2024-08-31T04:22:22.153528+0000 mgr.a (mgr.14388) 5670 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:23 smithi191 bash[24992]: audit 2024-08-31T04:22:21.959754+0000 mgr.a (mgr.14388) 5669 : audit [DBG] from='client.131790 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:23 smithi191 bash[24992]: cluster 2024-08-31T04:22:22.153528+0000 mgr.a (mgr.14388) 5670 : cluster [DBG] pgmap v3930: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:24.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:24 smithi163 bash[24253]: audit 2024-08-31T04:22:24.371783+0000 mon.a (mon.0) 1435 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:22:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:24 smithi027 bash[22610]: audit 2024-08-31T04:22:24.371783+0000 mon.a (mon.0) 1435 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:22:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:24 smithi191 bash[24992]: audit 2024-08-31T04:22:24.371783+0000 mon.a (mon.0) 1435 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:22:25.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:25 smithi163 bash[24253]: cluster 2024-08-31T04:22:24.155866+0000 mgr.a (mgr.14388) 5671 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:22:25.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:25 smithi163 bash[24253]: audit 2024-08-31T04:22:24.997509+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:22:25.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:25 smithi163 bash[24253]: audit 2024-08-31T04:22:25.002802+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:22:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:25 smithi027 bash[22610]: cluster 2024-08-31T04:22:24.155866+0000 mgr.a (mgr.14388) 5671 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:22:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:25 smithi027 bash[22610]: audit 2024-08-31T04:22:24.997509+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:22:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:25 smithi027 bash[22610]: audit 2024-08-31T04:22:25.002802+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:22:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:25 smithi191 bash[24992]: cluster 2024-08-31T04:22:24.155866+0000 mgr.a (mgr.14388) 5671 : cluster [DBG] pgmap v3931: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:22:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:25 smithi191 bash[24992]: audit 2024-08-31T04:22:24.997509+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:22:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:25 smithi191 bash[24992]: audit 2024-08-31T04:22:25.002802+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:22:26.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:26 smithi163 bash[24253]: audit 2024-08-31T04:22:25.787665+0000 mon.a (mon.0) 1438 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:22:26.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:26 smithi163 bash[24253]: audit 2024-08-31T04:22:25.788801+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:22:26.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:26 smithi163 bash[24253]: audit 2024-08-31T04:22:25.797471+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:22:26.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:26 smithi163 bash[24253]: audit 2024-08-31T04:22:25.802276+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:22:26.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:22:26 smithi027 bash[22863]: debug 2024-08-31T04:22:26.500+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:22:26.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:22:26 smithi027 bash[22863]: debug 2024-08-31T04:22:26.504+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:22:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:26 smithi027 bash[22610]: audit 2024-08-31T04:22:25.787665+0000 mon.a (mon.0) 1438 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:22:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:26 smithi027 bash[22610]: audit 2024-08-31T04:22:25.788801+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:22:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:26 smithi027 bash[22610]: audit 2024-08-31T04:22:25.797471+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:22:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:26 smithi027 bash[22610]: audit 2024-08-31T04:22:25.802276+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:22:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:26 smithi191 bash[24992]: audit 2024-08-31T04:22:25.787665+0000 mon.a (mon.0) 1438 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:22:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:26 smithi191 bash[24992]: audit 2024-08-31T04:22:25.788801+0000 mon.a (mon.0) 1439 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:22:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:26 smithi191 bash[24992]: audit 2024-08-31T04:22:25.797471+0000 mon.a (mon.0) 1440 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:22:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:26 smithi191 bash[24992]: audit 2024-08-31T04:22:25.802276+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:22:27.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:22:27.407 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:22:27.407 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:22:27.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:27 smithi163 bash[24253]: audit 2024-08-31T04:22:25.803366+0000 mgr.a (mgr.14388) 5672 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:22:27.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:27 smithi163 bash[24253]: cluster 2024-08-31T04:22:26.156463+0000 mgr.a (mgr.14388) 5673 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:22:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:27 smithi027 bash[22610]: audit 2024-08-31T04:22:25.803366+0000 mgr.a (mgr.14388) 5672 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:22:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:27 smithi027 bash[22610]: cluster 2024-08-31T04:22:26.156463+0000 mgr.a (mgr.14388) 5673 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:22:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:27 smithi191 bash[24992]: audit 2024-08-31T04:22:25.803366+0000 mgr.a (mgr.14388) 5672 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:22:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:27 smithi191 bash[24992]: cluster 2024-08-31T04:22:26.156463+0000 mgr.a (mgr.14388) 5673 : cluster [DBG] pgmap v3932: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:22:28.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:22:28.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:22:28.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:22:28.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:22:28.144 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:22:28.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:28 smithi163 bash[24253]: audit 2024-08-31T04:22:26.505926+0000 mgr.a (mgr.14388) 5674 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:22:28.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:28 smithi163 bash[24253]: cephadm 2024-08-31T04:22:26.507224+0000 mgr.a (mgr.14388) 5675 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:22:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:28 smithi027 bash[22610]: audit 2024-08-31T04:22:26.505926+0000 mgr.a (mgr.14388) 5674 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:22:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:28 smithi027 bash[22610]: cephadm 2024-08-31T04:22:26.507224+0000 mgr.a (mgr.14388) 5675 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:22:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:28 smithi191 bash[24992]: audit 2024-08-31T04:22:26.505926+0000 mgr.a (mgr.14388) 5674 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:22:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:28 smithi191 bash[24992]: cephadm 2024-08-31T04:22:26.507224+0000 mgr.a (mgr.14388) 5675 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:22:29.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:29 smithi163 bash[24253]: audit 2024-08-31T04:22:27.734907+0000 mgr.a (mgr.14388) 5676 : audit [DBG] from='client.131973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:29.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:29 smithi163 bash[24253]: cluster 2024-08-31T04:22:28.157723+0000 mgr.a (mgr.14388) 5677 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T04:22:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:29 smithi027 bash[22610]: audit 2024-08-31T04:22:27.734907+0000 mgr.a (mgr.14388) 5676 : audit [DBG] from='client.131973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:29 smithi027 bash[22610]: cluster 2024-08-31T04:22:28.157723+0000 mgr.a (mgr.14388) 5677 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T04:22:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:29 smithi191 bash[24992]: audit 2024-08-31T04:22:27.734907+0000 mgr.a (mgr.14388) 5676 : audit [DBG] from='client.131973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:29 smithi191 bash[24992]: cluster 2024-08-31T04:22:28.157723+0000 mgr.a (mgr.14388) 5677 : cluster [DBG] pgmap v3933: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T04:22:31.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:31 smithi163 bash[24253]: cluster 2024-08-31T04:22:30.158483+0000 mgr.a (mgr.14388) 5678 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T04:22:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:31 smithi027 bash[22610]: cluster 2024-08-31T04:22:30.158483+0000 mgr.a (mgr.14388) 5678 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T04:22:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:31 smithi191 bash[24992]: cluster 2024-08-31T04:22:30.158483+0000 mgr.a (mgr.14388) 5678 : cluster [DBG] pgmap v3934: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T04:22:33.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:22:33.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:22:33.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:22:33.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:32 smithi163 bash[24253]: cluster 2024-08-31T04:22:32.159322+0000 mgr.a (mgr.14388) 5679 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T04:22:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:32 smithi027 bash[22610]: cluster 2024-08-31T04:22:32.159322+0000 mgr.a (mgr.14388) 5679 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T04:22:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:32 smithi191 bash[24992]: cluster 2024-08-31T04:22:32.159322+0000 mgr.a (mgr.14388) 5679 : cluster [DBG] pgmap v3935: 225 pgs: 225 active+clean; 589 KiB data, 107 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T04:22:33.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:22:33.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:22:33.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:22:33.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:22:33.896 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:22:34.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:33 smithi163 bash[24253]: audit 2024-08-31T04:22:33.479447+0000 mgr.a (mgr.14388) 5680 : audit [DBG] from='client.132048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:33 smithi027 bash[22610]: audit 2024-08-31T04:22:33.479447+0000 mgr.a (mgr.14388) 5680 : audit [DBG] from='client.132048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:33 smithi191 bash[24992]: audit 2024-08-31T04:22:33.479447+0000 mgr.a (mgr.14388) 5680 : audit [DBG] from='client.132048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:35.193 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:34 smithi163 bash[24253]: cluster 2024-08-31T04:22:34.161995+0000 mgr.a (mgr.14388) 5681 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 66 op/s 2024-08-31T04:22:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:34 smithi027 bash[22610]: cluster 2024-08-31T04:22:34.161995+0000 mgr.a (mgr.14388) 5681 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 66 op/s 2024-08-31T04:22:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:34 smithi191 bash[24992]: cluster 2024-08-31T04:22:34.161995+0000 mgr.a (mgr.14388) 5681 : cluster [DBG] pgmap v3936: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 66 op/s 2024-08-31T04:22:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:37 smithi027 bash[22610]: cluster 2024-08-31T04:22:36.162784+0000 mgr.a (mgr.14388) 5682 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T04:22:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:37 smithi191 bash[24992]: cluster 2024-08-31T04:22:36.162784+0000 mgr.a (mgr.14388) 5682 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T04:22:37.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:37 smithi163 bash[24253]: cluster 2024-08-31T04:22:36.162784+0000 mgr.a (mgr.14388) 5682 : cluster [DBG] pgmap v3937: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T04:22:38.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:22:38.898 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:22:38.898 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:22:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:39 smithi027 bash[22610]: cluster 2024-08-31T04:22:38.164690+0000 mgr.a (mgr.14388) 5683 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T04:22:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:39 smithi191 bash[24992]: cluster 2024-08-31T04:22:38.164690+0000 mgr.a (mgr.14388) 5683 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T04:22:39.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:22:39.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:22:39.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:22:39.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:22:39.673 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:22:39.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:39 smithi163 bash[24253]: cluster 2024-08-31T04:22:38.164690+0000 mgr.a (mgr.14388) 5683 : cluster [DBG] pgmap v3938: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T04:22:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:40 smithi027 bash[22610]: audit 2024-08-31T04:22:39.235548+0000 mgr.a (mgr.14388) 5684 : audit [DBG] from='client.132126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:40 smithi191 bash[24992]: audit 2024-08-31T04:22:39.235548+0000 mgr.a (mgr.14388) 5684 : audit [DBG] from='client.132126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:40.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:40 smithi163 bash[24253]: audit 2024-08-31T04:22:39.235548+0000 mgr.a (mgr.14388) 5684 : audit [DBG] from='client.132126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:41 smithi191 bash[24992]: cluster 2024-08-31T04:22:40.165842+0000 mgr.a (mgr.14388) 5685 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:22:41.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:41 smithi163 bash[24253]: cluster 2024-08-31T04:22:40.165842+0000 mgr.a (mgr.14388) 5685 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:22:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:41 smithi027 bash[22610]: cluster 2024-08-31T04:22:40.165842+0000 mgr.a (mgr.14388) 5685 : cluster [DBG] pgmap v3939: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:22:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:43 smithi191 bash[24992]: cluster 2024-08-31T04:22:42.166693+0000 mgr.a (mgr.14388) 5686 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:22:43.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:43 smithi163 bash[24253]: cluster 2024-08-31T04:22:42.166693+0000 mgr.a (mgr.14388) 5686 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:22:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:43 smithi027 bash[22610]: cluster 2024-08-31T04:22:42.166693+0000 mgr.a (mgr.14388) 5686 : cluster [DBG] pgmap v3940: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:22:44.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:22:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:22:44.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:22:45.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:22:45.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:22:45.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:22:45.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:22:45.431 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:22:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:45 smithi191 bash[24992]: cluster 2024-08-31T04:22:44.168909+0000 mgr.a (mgr.14388) 5687 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T04:22:45.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:45 smithi163 bash[24253]: cluster 2024-08-31T04:22:44.168909+0000 mgr.a (mgr.14388) 5687 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T04:22:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:45 smithi027 bash[22610]: cluster 2024-08-31T04:22:44.168909+0000 mgr.a (mgr.14388) 5687 : cluster [DBG] pgmap v3941: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T04:22:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:46 smithi191 bash[24992]: audit 2024-08-31T04:22:45.008082+0000 mgr.a (mgr.14388) 5688 : audit [DBG] from='client.132204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:46.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:46 smithi163 bash[24253]: audit 2024-08-31T04:22:45.008082+0000 mgr.a (mgr.14388) 5688 : audit [DBG] from='client.132204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:46 smithi027 bash[22610]: audit 2024-08-31T04:22:45.008082+0000 mgr.a (mgr.14388) 5688 : audit [DBG] from='client.132204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:47 smithi191 bash[24992]: cluster 2024-08-31T04:22:46.169864+0000 mgr.a (mgr.14388) 5689 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:47.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:47 smithi163 bash[24253]: cluster 2024-08-31T04:22:46.169864+0000 mgr.a (mgr.14388) 5689 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:47 smithi027 bash[22610]: cluster 2024-08-31T04:22:46.169864+0000 mgr.a (mgr.14388) 5689 : cluster [DBG] pgmap v3942: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:49 smithi191 bash[24992]: cluster 2024-08-31T04:22:48.172019+0000 mgr.a (mgr.14388) 5690 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:49.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:49 smithi163 bash[24253]: cluster 2024-08-31T04:22:48.172019+0000 mgr.a (mgr.14388) 5690 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:49 smithi027 bash[22610]: cluster 2024-08-31T04:22:48.172019+0000 mgr.a (mgr.14388) 5690 : cluster [DBG] pgmap v3943: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:50.432 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:22:50.432 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:22:50.433 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:22:51.172 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:22:51.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:22:51.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:22:51.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:22:51.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:22:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:51 smithi191 bash[24992]: cluster 2024-08-31T04:22:50.172811+0000 mgr.a (mgr.14388) 5691 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:51.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:51 smithi163 bash[24253]: cluster 2024-08-31T04:22:50.172811+0000 mgr.a (mgr.14388) 5691 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:51 smithi027 bash[22610]: cluster 2024-08-31T04:22:50.172811+0000 mgr.a (mgr.14388) 5691 : cluster [DBG] pgmap v3944: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:52 smithi191 bash[24992]: audit 2024-08-31T04:22:50.763773+0000 mgr.a (mgr.14388) 5692 : audit [DBG] from='client.132279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:52.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:52 smithi163 bash[24253]: audit 2024-08-31T04:22:50.763773+0000 mgr.a (mgr.14388) 5692 : audit [DBG] from='client.132279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:52 smithi027 bash[22610]: audit 2024-08-31T04:22:50.763773+0000 mgr.a (mgr.14388) 5692 : audit [DBG] from='client.132279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:53 smithi191 bash[24992]: cluster 2024-08-31T04:22:52.173864+0000 mgr.a (mgr.14388) 5693 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:53.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:53 smithi163 bash[24253]: cluster 2024-08-31T04:22:52.173864+0000 mgr.a (mgr.14388) 5693 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:53 smithi027 bash[22610]: cluster 2024-08-31T04:22:52.173864+0000 mgr.a (mgr.14388) 5693 : cluster [DBG] pgmap v3945: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:55.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:55 smithi163 bash[24253]: cluster 2024-08-31T04:22:54.176145+0000 mgr.a (mgr.14388) 5694 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:55 smithi027 bash[22610]: cluster 2024-08-31T04:22:54.176145+0000 mgr.a (mgr.14388) 5694 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:55 smithi191 bash[24992]: cluster 2024-08-31T04:22:54.176145+0000 mgr.a (mgr.14388) 5694 : cluster [DBG] pgmap v3946: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:56.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:22:56.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:22:56.175 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:22:56.911 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:22:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:22:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:22:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:22:56.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:22:57.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:57 smithi163 bash[24253]: cluster 2024-08-31T04:22:56.176848+0000 mgr.a (mgr.14388) 5695 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:57 smithi027 bash[22610]: cluster 2024-08-31T04:22:56.176848+0000 mgr.a (mgr.14388) 5695 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:57 smithi191 bash[24992]: cluster 2024-08-31T04:22:56.176848+0000 mgr.a (mgr.14388) 5695 : cluster [DBG] pgmap v3947: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:22:58.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:58 smithi163 bash[24253]: audit 2024-08-31T04:22:56.508034+0000 mgr.a (mgr.14388) 5696 : audit [DBG] from='client.132354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:58 smithi027 bash[22610]: audit 2024-08-31T04:22:56.508034+0000 mgr.a (mgr.14388) 5696 : audit [DBG] from='client.132354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:58 smithi191 bash[24992]: audit 2024-08-31T04:22:56.508034+0000 mgr.a (mgr.14388) 5696 : audit [DBG] from='client.132354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:22:59.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:22:59 smithi163 bash[24253]: cluster 2024-08-31T04:22:58.179040+0000 mgr.a (mgr.14388) 5697 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:22:59 smithi027 bash[22610]: cluster 2024-08-31T04:22:58.179040+0000 mgr.a (mgr.14388) 5697 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:22:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:22:59 smithi191 bash[24992]: cluster 2024-08-31T04:22:58.179040+0000 mgr.a (mgr.14388) 5697 : cluster [DBG] pgmap v3948: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:23:01.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:01 smithi163 bash[24253]: cluster 2024-08-31T04:23:00.179796+0000 mgr.a (mgr.14388) 5698 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:01 smithi027 bash[22610]: cluster 2024-08-31T04:23:00.179796+0000 mgr.a (mgr.14388) 5698 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:01 smithi191 bash[24992]: cluster 2024-08-31T04:23:00.179796+0000 mgr.a (mgr.14388) 5698 : cluster [DBG] pgmap v3949: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:01.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:02.669 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:23:02.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:23:02.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:23:02.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:23:02.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:23:03.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:03 smithi163 bash[24253]: cluster 2024-08-31T04:23:02.180522+0000 mgr.a (mgr.14388) 5699 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:03.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:03 smithi163 bash[24253]: audit 2024-08-31T04:23:02.247361+0000 mgr.a (mgr.14388) 5700 : audit [DBG] from='client.132432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:03 smithi027 bash[22610]: cluster 2024-08-31T04:23:02.180522+0000 mgr.a (mgr.14388) 5699 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:03 smithi027 bash[22610]: audit 2024-08-31T04:23:02.247361+0000 mgr.a (mgr.14388) 5700 : audit [DBG] from='client.132432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:03 smithi191 bash[24992]: cluster 2024-08-31T04:23:02.180522+0000 mgr.a (mgr.14388) 5699 : cluster [DBG] pgmap v3950: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:03 smithi191 bash[24992]: audit 2024-08-31T04:23:02.247361+0000 mgr.a (mgr.14388) 5700 : audit [DBG] from='client.132432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:05.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:05 smithi163 bash[24253]: cluster 2024-08-31T04:23:04.182864+0000 mgr.a (mgr.14388) 5701 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:23:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:05 smithi027 bash[22610]: cluster 2024-08-31T04:23:04.182864+0000 mgr.a (mgr.14388) 5701 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:23:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:05 smithi191 bash[24992]: cluster 2024-08-31T04:23:04.182864+0000 mgr.a (mgr.14388) 5701 : cluster [DBG] pgmap v3951: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:23:07.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:07.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:07.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:07.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:07 smithi163 bash[24253]: cluster 2024-08-31T04:23:06.183605+0000 mgr.a (mgr.14388) 5702 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:07 smithi027 bash[22610]: cluster 2024-08-31T04:23:06.183605+0000 mgr.a (mgr.14388) 5702 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:07 smithi191 bash[24992]: cluster 2024-08-31T04:23:06.183605+0000 mgr.a (mgr.14388) 5702 : cluster [DBG] pgmap v3952: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:08.442 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:23:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:23:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:23:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:23:08.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:23:09.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:09 smithi163 bash[24253]: audit 2024-08-31T04:23:08.012661+0000 mgr.a (mgr.14388) 5703 : audit [DBG] from='client.132510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:09.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:09 smithi163 bash[24253]: cluster 2024-08-31T04:23:08.184970+0000 mgr.a (mgr.14388) 5704 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:09 smithi027 bash[22610]: audit 2024-08-31T04:23:08.012661+0000 mgr.a (mgr.14388) 5703 : audit [DBG] from='client.132510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:09 smithi027 bash[22610]: cluster 2024-08-31T04:23:08.184970+0000 mgr.a (mgr.14388) 5704 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:09 smithi191 bash[24992]: audit 2024-08-31T04:23:08.012661+0000 mgr.a (mgr.14388) 5703 : audit [DBG] from='client.132510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:09 smithi191 bash[24992]: cluster 2024-08-31T04:23:08.184970+0000 mgr.a (mgr.14388) 5704 : cluster [DBG] pgmap v3953: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:11.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:11 smithi163 bash[24253]: cluster 2024-08-31T04:23:10.185859+0000 mgr.a (mgr.14388) 5705 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:11 smithi027 bash[22610]: cluster 2024-08-31T04:23:10.185859+0000 mgr.a (mgr.14388) 5705 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:11 smithi191 bash[24992]: cluster 2024-08-31T04:23:10.185859+0000 mgr.a (mgr.14388) 5705 : cluster [DBG] pgmap v3954: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:13.444 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:13.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:13 smithi163 bash[24253]: cluster 2024-08-31T04:23:12.186778+0000 mgr.a (mgr.14388) 5706 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:13 smithi027 bash[22610]: cluster 2024-08-31T04:23:12.186778+0000 mgr.a (mgr.14388) 5706 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:13 smithi191 bash[24992]: cluster 2024-08-31T04:23:12.186778+0000 mgr.a (mgr.14388) 5706 : cluster [DBG] pgmap v3955: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:14.208 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:23:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:23:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:23:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:23:14.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:23:15.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:15 smithi163 bash[24253]: audit 2024-08-31T04:23:13.781908+0000 mgr.a (mgr.14388) 5707 : audit [DBG] from='client.132588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:15.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:15 smithi163 bash[24253]: cluster 2024-08-31T04:23:14.188003+0000 mgr.a (mgr.14388) 5708 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:15 smithi027 bash[22610]: audit 2024-08-31T04:23:13.781908+0000 mgr.a (mgr.14388) 5707 : audit [DBG] from='client.132588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:15 smithi027 bash[22610]: cluster 2024-08-31T04:23:14.188003+0000 mgr.a (mgr.14388) 5708 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:15 smithi191 bash[24992]: audit 2024-08-31T04:23:13.781908+0000 mgr.a (mgr.14388) 5707 : audit [DBG] from='client.132588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:15 smithi191 bash[24992]: cluster 2024-08-31T04:23:14.188003+0000 mgr.a (mgr.14388) 5708 : cluster [DBG] pgmap v3956: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:17.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:17 smithi163 bash[24253]: cluster 2024-08-31T04:23:16.188734+0000 mgr.a (mgr.14388) 5709 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:17 smithi027 bash[22610]: cluster 2024-08-31T04:23:16.188734+0000 mgr.a (mgr.14388) 5709 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:17 smithi191 bash[24992]: cluster 2024-08-31T04:23:16.188734+0000 mgr.a (mgr.14388) 5709 : cluster [DBG] pgmap v3957: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:19.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:19.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:19.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:19.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:19 smithi163 bash[24253]: cluster 2024-08-31T04:23:18.190649+0000 mgr.a (mgr.14388) 5710 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:19 smithi027 bash[22610]: cluster 2024-08-31T04:23:18.190649+0000 mgr.a (mgr.14388) 5710 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:19 smithi191 bash[24992]: cluster 2024-08-31T04:23:18.190649+0000 mgr.a (mgr.14388) 5710 : cluster [DBG] pgmap v3958: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:19.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:23:19.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:23:19.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:23:19.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:23:19.988 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:23:21.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:21 smithi163 bash[24253]: audit 2024-08-31T04:23:19.548752+0000 mgr.a (mgr.14388) 5711 : audit [DBG] from='client.132666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:21.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:21 smithi163 bash[24253]: cluster 2024-08-31T04:23:20.191532+0000 mgr.a (mgr.14388) 5712 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:21 smithi027 bash[22610]: audit 2024-08-31T04:23:19.548752+0000 mgr.a (mgr.14388) 5711 : audit [DBG] from='client.132666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:21 smithi027 bash[22610]: cluster 2024-08-31T04:23:20.191532+0000 mgr.a (mgr.14388) 5712 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:21 smithi191 bash[24992]: audit 2024-08-31T04:23:19.548752+0000 mgr.a (mgr.14388) 5711 : audit [DBG] from='client.132666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:21 smithi191 bash[24992]: cluster 2024-08-31T04:23:20.191532+0000 mgr.a (mgr.14388) 5712 : cluster [DBG] pgmap v3959: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:23.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:23 smithi163 bash[24253]: cluster 2024-08-31T04:23:22.192347+0000 mgr.a (mgr.14388) 5713 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:23 smithi027 bash[22610]: cluster 2024-08-31T04:23:22.192347+0000 mgr.a (mgr.14388) 5713 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:23 smithi191 bash[24992]: cluster 2024-08-31T04:23:22.192347+0000 mgr.a (mgr.14388) 5713 : cluster [DBG] pgmap v3960: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:24.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:24.990 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:24.990 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:25.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:25 smithi163 bash[24253]: cluster 2024-08-31T04:23:24.194584+0000 mgr.a (mgr.14388) 5714 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:23:25.731 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:23:25.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:23:25.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:23:25.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:23:25.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:23:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:25 smithi027 bash[22610]: cluster 2024-08-31T04:23:24.194584+0000 mgr.a (mgr.14388) 5714 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:23:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:25 smithi191 bash[24992]: cluster 2024-08-31T04:23:24.194584+0000 mgr.a (mgr.14388) 5714 : cluster [DBG] pgmap v3961: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:23:26.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:26 smithi163 bash[24253]: audit 2024-08-31T04:23:25.319592+0000 mgr.a (mgr.14388) 5715 : audit [DBG] from='client.132744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:26 smithi027 bash[22610]: audit 2024-08-31T04:23:25.319592+0000 mgr.a (mgr.14388) 5715 : audit [DBG] from='client.132744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:26 smithi191 bash[24992]: audit 2024-08-31T04:23:25.319592+0000 mgr.a (mgr.14388) 5715 : audit [DBG] from='client.132744 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:27.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:27 smithi163 bash[24253]: cluster 2024-08-31T04:23:26.195509+0000 mgr.a (mgr.14388) 5716 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:27.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:27 smithi163 bash[24253]: audit 2024-08-31T04:23:26.557717+0000 mon.a (mon.0) 1442 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:23:27.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:27 smithi163 bash[24253]: audit 2024-08-31T04:23:27.170760+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:27 smithi163 bash[24253]: audit 2024-08-31T04:23:27.173828+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:27 smithi163 bash[24253]: audit 2024-08-31T04:23:27.179159+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:27 smithi163 bash[24253]: audit 2024-08-31T04:23:27.185567+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:27 smithi027 bash[22610]: cluster 2024-08-31T04:23:26.195509+0000 mgr.a (mgr.14388) 5716 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:27 smithi027 bash[22610]: audit 2024-08-31T04:23:26.557717+0000 mon.a (mon.0) 1442 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:23:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:27 smithi027 bash[22610]: audit 2024-08-31T04:23:27.170760+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:27 smithi027 bash[22610]: audit 2024-08-31T04:23:27.173828+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:27 smithi027 bash[22610]: audit 2024-08-31T04:23:27.179159+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:27 smithi027 bash[22610]: audit 2024-08-31T04:23:27.185567+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:27 smithi191 bash[24992]: cluster 2024-08-31T04:23:26.195509+0000 mgr.a (mgr.14388) 5716 : cluster [DBG] pgmap v3962: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:27 smithi191 bash[24992]: audit 2024-08-31T04:23:26.557717+0000 mon.a (mon.0) 1442 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:23:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:27 smithi191 bash[24992]: audit 2024-08-31T04:23:27.170760+0000 mon.a (mon.0) 1443 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:27 smithi191 bash[24992]: audit 2024-08-31T04:23:27.173828+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:27 smithi191 bash[24992]: audit 2024-08-31T04:23:27.179159+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:27 smithi191 bash[24992]: audit 2024-08-31T04:23:27.185567+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:28.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:28 smithi163 bash[24253]: audit 2024-08-31T04:23:28.011120+0000 mon.a (mon.0) 1447 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:23:28.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:28 smithi163 bash[24253]: audit 2024-08-31T04:23:28.013092+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:23:28.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:28 smithi163 bash[24253]: audit 2024-08-31T04:23:28.023736+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:28.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:28 smithi163 bash[24253]: audit 2024-08-31T04:23:28.028607+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:23:28.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:28 smithi027 bash[22610]: audit 2024-08-31T04:23:28.011120+0000 mon.a (mon.0) 1447 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:23:28.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:28 smithi027 bash[22610]: audit 2024-08-31T04:23:28.013092+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:23:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:28 smithi027 bash[22610]: audit 2024-08-31T04:23:28.023736+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:28 smithi027 bash[22610]: audit 2024-08-31T04:23:28.028607+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:23:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:28 smithi191 bash[24992]: audit 2024-08-31T04:23:28.011120+0000 mon.a (mon.0) 1447 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:23:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:28 smithi191 bash[24992]: audit 2024-08-31T04:23:28.013092+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:23:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:28 smithi191 bash[24992]: audit 2024-08-31T04:23:28.023736+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:23:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:28 smithi191 bash[24992]: audit 2024-08-31T04:23:28.028607+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:23:29.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:23:28 smithi027 bash[22863]: debug 2024-08-31T04:23:28.759+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:23:29.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:23:28 smithi027 bash[22863]: debug 2024-08-31T04:23:28.759+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:23:29.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:29 smithi163 bash[24253]: audit 2024-08-31T04:23:28.030938+0000 mgr.a (mgr.14388) 5717 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:23:29.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:29 smithi163 bash[24253]: cluster 2024-08-31T04:23:28.196832+0000 mgr.a (mgr.14388) 5718 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:23:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:29 smithi027 bash[22610]: audit 2024-08-31T04:23:28.030938+0000 mgr.a (mgr.14388) 5717 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:23:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:29 smithi027 bash[22610]: cluster 2024-08-31T04:23:28.196832+0000 mgr.a (mgr.14388) 5718 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:23:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:29 smithi191 bash[24992]: audit 2024-08-31T04:23:28.030938+0000 mgr.a (mgr.14388) 5717 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:23:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:29 smithi191 bash[24992]: cluster 2024-08-31T04:23:28.196832+0000 mgr.a (mgr.14388) 5718 : cluster [DBG] pgmap v3963: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:23:30.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:30 smithi163 bash[24253]: audit 2024-08-31T04:23:28.764931+0000 mgr.a (mgr.14388) 5719 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:23:30.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:30 smithi163 bash[24253]: cephadm 2024-08-31T04:23:28.766293+0000 mgr.a (mgr.14388) 5720 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:23:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:30 smithi027 bash[22610]: audit 2024-08-31T04:23:28.764931+0000 mgr.a (mgr.14388) 5719 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:23:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:30 smithi027 bash[22610]: cephadm 2024-08-31T04:23:28.766293+0000 mgr.a (mgr.14388) 5720 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:23:30.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:30.733 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:30.734 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:30 smithi191 bash[24992]: audit 2024-08-31T04:23:28.764931+0000 mgr.a (mgr.14388) 5719 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:23:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:30 smithi191 bash[24992]: cephadm 2024-08-31T04:23:28.766293+0000 mgr.a (mgr.14388) 5720 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:23:31.487 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:23:31.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:23:31.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:23:31.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:23:31.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:23:31.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:31 smithi163 bash[24253]: cluster 2024-08-31T04:23:30.197708+0000 mgr.a (mgr.14388) 5721 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:31 smithi027 bash[22610]: cluster 2024-08-31T04:23:30.197708+0000 mgr.a (mgr.14388) 5721 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:31 smithi191 bash[24992]: cluster 2024-08-31T04:23:30.197708+0000 mgr.a (mgr.14388) 5721 : cluster [DBG] pgmap v3964: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:32.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:32 smithi163 bash[24253]: audit 2024-08-31T04:23:31.062471+0000 mgr.a (mgr.14388) 5722 : audit [DBG] from='client.132930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:32 smithi027 bash[22610]: audit 2024-08-31T04:23:31.062471+0000 mgr.a (mgr.14388) 5722 : audit [DBG] from='client.132930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:32 smithi191 bash[24992]: audit 2024-08-31T04:23:31.062471+0000 mgr.a (mgr.14388) 5722 : audit [DBG] from='client.132930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:33.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:33 smithi163 bash[24253]: cluster 2024-08-31T04:23:32.198630+0000 mgr.a (mgr.14388) 5723 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:33 smithi027 bash[22610]: cluster 2024-08-31T04:23:32.198630+0000 mgr.a (mgr.14388) 5723 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:33 smithi191 bash[24992]: cluster 2024-08-31T04:23:32.198630+0000 mgr.a (mgr.14388) 5723 : cluster [DBG] pgmap v3965: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:35.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:35 smithi163 bash[24253]: cluster 2024-08-31T04:23:34.200945+0000 mgr.a (mgr.14388) 5724 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:35 smithi027 bash[22610]: cluster 2024-08-31T04:23:34.200945+0000 mgr.a (mgr.14388) 5724 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:35 smithi191 bash[24992]: cluster 2024-08-31T04:23:34.200945+0000 mgr.a (mgr.14388) 5724 : cluster [DBG] pgmap v3966: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:36.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:36.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:36.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:37.264 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:23:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:23:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:23:37.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:23:37.265 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:23:37.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:37 smithi163 bash[24253]: cluster 2024-08-31T04:23:36.201902+0000 mgr.a (mgr.14388) 5725 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:37 smithi027 bash[22610]: cluster 2024-08-31T04:23:36.201902+0000 mgr.a (mgr.14388) 5725 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:37 smithi191 bash[24992]: cluster 2024-08-31T04:23:36.201902+0000 mgr.a (mgr.14388) 5725 : cluster [DBG] pgmap v3967: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:38.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:38 smithi163 bash[24253]: audit 2024-08-31T04:23:36.825470+0000 mgr.a (mgr.14388) 5726 : audit [DBG] from='client.133008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:38 smithi027 bash[22610]: audit 2024-08-31T04:23:36.825470+0000 mgr.a (mgr.14388) 5726 : audit [DBG] from='client.133008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:38 smithi191 bash[24992]: audit 2024-08-31T04:23:36.825470+0000 mgr.a (mgr.14388) 5726 : audit [DBG] from='client.133008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:39.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:39 smithi163 bash[24253]: cluster 2024-08-31T04:23:38.204352+0000 mgr.a (mgr.14388) 5727 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:39 smithi027 bash[22610]: cluster 2024-08-31T04:23:38.204352+0000 mgr.a (mgr.14388) 5727 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:39 smithi191 bash[24992]: cluster 2024-08-31T04:23:38.204352+0000 mgr.a (mgr.14388) 5727 : cluster [DBG] pgmap v3968: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:41.693 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:41 smithi163 bash[24253]: cluster 2024-08-31T04:23:40.205172+0000 mgr.a (mgr.14388) 5728 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:41 smithi027 bash[22610]: cluster 2024-08-31T04:23:40.205172+0000 mgr.a (mgr.14388) 5728 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:41 smithi191 bash[24992]: cluster 2024-08-31T04:23:40.205172+0000 mgr.a (mgr.14388) 5728 : cluster [DBG] pgmap v3969: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:42.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:42.267 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:42.267 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:43.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:23:43.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:23:43.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:23:43.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:23:43.021 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:23:43.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:43 smithi163 bash[24253]: cluster 2024-08-31T04:23:42.205958+0000 mgr.a (mgr.14388) 5729 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:43 smithi027 bash[22610]: cluster 2024-08-31T04:23:42.205958+0000 mgr.a (mgr.14388) 5729 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:43 smithi191 bash[24992]: cluster 2024-08-31T04:23:42.205958+0000 mgr.a (mgr.14388) 5729 : cluster [DBG] pgmap v3970: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:44 smithi027 bash[22610]: audit 2024-08-31T04:23:42.600612+0000 mgr.a (mgr.14388) 5730 : audit [DBG] from='client.133083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:44 smithi191 bash[24992]: audit 2024-08-31T04:23:42.600612+0000 mgr.a (mgr.14388) 5730 : audit [DBG] from='client.133083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:44.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:44 smithi163 bash[24253]: audit 2024-08-31T04:23:42.600612+0000 mgr.a (mgr.14388) 5730 : audit [DBG] from='client.133083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:45 smithi027 bash[22610]: cluster 2024-08-31T04:23:44.208294+0000 mgr.a (mgr.14388) 5731 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:45 smithi191 bash[24992]: cluster 2024-08-31T04:23:44.208294+0000 mgr.a (mgr.14388) 5731 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:45.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:45 smithi163 bash[24253]: cluster 2024-08-31T04:23:44.208294+0000 mgr.a (mgr.14388) 5731 : cluster [DBG] pgmap v3971: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:23:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:47 smithi027 bash[22610]: cluster 2024-08-31T04:23:46.209070+0000 mgr.a (mgr.14388) 5732 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:23:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:47 smithi191 bash[24992]: cluster 2024-08-31T04:23:46.209070+0000 mgr.a (mgr.14388) 5732 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:23:47.943 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:47 smithi163 bash[24253]: cluster 2024-08-31T04:23:46.209070+0000 mgr.a (mgr.14388) 5732 : cluster [DBG] pgmap v3972: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:23:48.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:48.022 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:48.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:23:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:23:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:23:48.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:23:48.765 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:23:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:49 smithi027 bash[22610]: cluster 2024-08-31T04:23:48.210316+0000 mgr.a (mgr.14388) 5733 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:49 smithi027 bash[22610]: audit 2024-08-31T04:23:48.353073+0000 mgr.a (mgr.14388) 5734 : audit [DBG] from='client.133152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:49 smithi191 bash[24992]: cluster 2024-08-31T04:23:48.210316+0000 mgr.a (mgr.14388) 5733 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:49 smithi191 bash[24992]: audit 2024-08-31T04:23:48.353073+0000 mgr.a (mgr.14388) 5734 : audit [DBG] from='client.133152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:49.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:49 smithi163 bash[24253]: cluster 2024-08-31T04:23:48.210316+0000 mgr.a (mgr.14388) 5733 : cluster [DBG] pgmap v3973: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:49.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:49 smithi163 bash[24253]: audit 2024-08-31T04:23:48.353073+0000 mgr.a (mgr.14388) 5734 : audit [DBG] from='client.133152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:51 smithi027 bash[22610]: cluster 2024-08-31T04:23:50.211198+0000 mgr.a (mgr.14388) 5735 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:51 smithi191 bash[24992]: cluster 2024-08-31T04:23:50.211198+0000 mgr.a (mgr.14388) 5735 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:51.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:51 smithi163 bash[24253]: cluster 2024-08-31T04:23:50.211198+0000 mgr.a (mgr.14388) 5735 : cluster [DBG] pgmap v3974: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:53 smithi027 bash[22610]: cluster 2024-08-31T04:23:52.211991+0000 mgr.a (mgr.14388) 5736 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:53.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:53.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:53.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:53 smithi191 bash[24992]: cluster 2024-08-31T04:23:52.211991+0000 mgr.a (mgr.14388) 5736 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:53.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:53 smithi163 bash[24253]: cluster 2024-08-31T04:23:52.211991+0000 mgr.a (mgr.14388) 5736 : cluster [DBG] pgmap v3975: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:23:54.543 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:23:54.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:23:54.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:23:54.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:23:54.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:23:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:55 smithi027 bash[22610]: audit 2024-08-31T04:23:54.103364+0000 mgr.a (mgr.14388) 5737 : audit [DBG] from='client.133227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:55 smithi027 bash[22610]: cluster 2024-08-31T04:23:54.213682+0000 mgr.a (mgr.14388) 5738 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:55 smithi191 bash[24992]: audit 2024-08-31T04:23:54.103364+0000 mgr.a (mgr.14388) 5737 : audit [DBG] from='client.133227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:55 smithi191 bash[24992]: cluster 2024-08-31T04:23:54.213682+0000 mgr.a (mgr.14388) 5738 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:55 smithi163 bash[24253]: audit 2024-08-31T04:23:54.103364+0000 mgr.a (mgr.14388) 5737 : audit [DBG] from='client.133227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:23:55.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:55 smithi163 bash[24253]: cluster 2024-08-31T04:23:54.213682+0000 mgr.a (mgr.14388) 5738 : cluster [DBG] pgmap v3976: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:23:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:57 smithi027 bash[22610]: cluster 2024-08-31T04:23:56.214514+0000 mgr.a (mgr.14388) 5739 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:23:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:57 smithi191 bash[24992]: cluster 2024-08-31T04:23:56.214514+0000 mgr.a (mgr.14388) 5739 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:23:57.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:57 smithi163 bash[24253]: cluster 2024-08-31T04:23:56.214514+0000 mgr.a (mgr.14388) 5739 : cluster [DBG] pgmap v3977: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:23:59.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:23:59.545 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:23:59.545 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:23:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:23:59 smithi027 bash[22610]: cluster 2024-08-31T04:23:58.216640+0000 mgr.a (mgr.14388) 5740 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:23:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:23:59 smithi191 bash[24992]: cluster 2024-08-31T04:23:58.216640+0000 mgr.a (mgr.14388) 5740 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:23:59.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:23:59 smithi163 bash[24253]: cluster 2024-08-31T04:23:58.216640+0000 mgr.a (mgr.14388) 5740 : cluster [DBG] pgmap v3978: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:24:00.280 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:00.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:00.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:00.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:00.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:01 smithi027 bash[22610]: audit 2024-08-31T04:23:59.878667+0000 mgr.a (mgr.14388) 5741 : audit [DBG] from='client.133302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:01 smithi027 bash[22610]: cluster 2024-08-31T04:24:00.217304+0000 mgr.a (mgr.14388) 5742 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:01 smithi191 bash[24992]: audit 2024-08-31T04:23:59.878667+0000 mgr.a (mgr.14388) 5741 : audit [DBG] from='client.133302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:01 smithi191 bash[24992]: cluster 2024-08-31T04:24:00.217304+0000 mgr.a (mgr.14388) 5742 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:01.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:01 smithi163 bash[24253]: audit 2024-08-31T04:23:59.878667+0000 mgr.a (mgr.14388) 5741 : audit [DBG] from='client.133302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:01.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:01 smithi163 bash[24253]: cluster 2024-08-31T04:24:00.217304+0000 mgr.a (mgr.14388) 5742 : cluster [DBG] pgmap v3979: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:03 smithi191 bash[24992]: cluster 2024-08-31T04:24:02.218099+0000 mgr.a (mgr.14388) 5743 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:03.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:03 smithi163 bash[24253]: cluster 2024-08-31T04:24:02.218099+0000 mgr.a (mgr.14388) 5743 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:03 smithi027 bash[22610]: cluster 2024-08-31T04:24:02.218099+0000 mgr.a (mgr.14388) 5743 : cluster [DBG] pgmap v3980: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:05.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:24:05.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:24:05.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:24:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:05 smithi191 bash[24992]: cluster 2024-08-31T04:24:04.220290+0000 mgr.a (mgr.14388) 5744 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:05.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:05 smithi163 bash[24253]: cluster 2024-08-31T04:24:04.220290+0000 mgr.a (mgr.14388) 5744 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:05.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:05 smithi027 bash[22610]: cluster 2024-08-31T04:24:04.220290+0000 mgr.a (mgr.14388) 5744 : cluster [DBG] pgmap v3981: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:06.061 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:06.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:06.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:06.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:06.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:07 smithi191 bash[24992]: audit 2024-08-31T04:24:05.621899+0000 mgr.a (mgr.14388) 5745 : audit [DBG] from='client.133374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:07 smithi191 bash[24992]: cluster 2024-08-31T04:24:06.221164+0000 mgr.a (mgr.14388) 5746 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:07.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:07 smithi163 bash[24253]: audit 2024-08-31T04:24:05.621899+0000 mgr.a (mgr.14388) 5745 : audit [DBG] from='client.133374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:07.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:07 smithi163 bash[24253]: cluster 2024-08-31T04:24:06.221164+0000 mgr.a (mgr.14388) 5746 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:07 smithi027 bash[22610]: audit 2024-08-31T04:24:05.621899+0000 mgr.a (mgr.14388) 5745 : audit [DBG] from='client.133374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:07 smithi027 bash[22610]: cluster 2024-08-31T04:24:06.221164+0000 mgr.a (mgr.14388) 5746 : cluster [DBG] pgmap v3982: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:09 smithi191 bash[24992]: cluster 2024-08-31T04:24:08.223726+0000 mgr.a (mgr.14388) 5747 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:09.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:09 smithi163 bash[24253]: cluster 2024-08-31T04:24:08.223726+0000 mgr.a (mgr.14388) 5747 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:09 smithi027 bash[22610]: cluster 2024-08-31T04:24:08.223726+0000 mgr.a (mgr.14388) 5747 : cluster [DBG] pgmap v3983: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:11.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:24:11.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:24:11.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:24:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:11 smithi191 bash[24992]: cluster 2024-08-31T04:24:10.224554+0000 mgr.a (mgr.14388) 5748 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:11.830 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:11.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:11.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:11.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:11.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:11.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:11 smithi163 bash[24253]: cluster 2024-08-31T04:24:10.224554+0000 mgr.a (mgr.14388) 5748 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:11 smithi027 bash[22610]: cluster 2024-08-31T04:24:10.224554+0000 mgr.a (mgr.14388) 5748 : cluster [DBG] pgmap v3984: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:12 smithi191 bash[24992]: audit 2024-08-31T04:24:11.402638+0000 mgr.a (mgr.14388) 5749 : audit [DBG] from='client.133452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:12.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:12 smithi163 bash[24253]: audit 2024-08-31T04:24:11.402638+0000 mgr.a (mgr.14388) 5749 : audit [DBG] from='client.133452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:12 smithi027 bash[22610]: audit 2024-08-31T04:24:11.402638+0000 mgr.a (mgr.14388) 5749 : audit [DBG] from='client.133452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:13 smithi191 bash[24992]: cluster 2024-08-31T04:24:12.225556+0000 mgr.a (mgr.14388) 5750 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:13.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:13 smithi163 bash[24253]: cluster 2024-08-31T04:24:12.225556+0000 mgr.a (mgr.14388) 5750 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:13 smithi027 bash[22610]: cluster 2024-08-31T04:24:12.225556+0000 mgr.a (mgr.14388) 5750 : cluster [DBG] pgmap v3985: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:14.944 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:14 smithi163 bash[24253]: cluster 2024-08-31T04:24:14.227999+0000 mgr.a (mgr.14388) 5751 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:14 smithi027 bash[22610]: cluster 2024-08-31T04:24:14.227999+0000 mgr.a (mgr.14388) 5751 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:14 smithi191 bash[24992]: cluster 2024-08-31T04:24:14.227999+0000 mgr.a (mgr.14388) 5751 : cluster [DBG] pgmap v3986: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:16.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:24:16.832 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:24:16.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:24:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:17 smithi191 bash[24992]: cluster 2024-08-31T04:24:16.228883+0000 mgr.a (mgr.14388) 5752 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:17.576 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:17.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:17.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:17.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:17.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:17.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:17 smithi163 bash[24253]: cluster 2024-08-31T04:24:16.228883+0000 mgr.a (mgr.14388) 5752 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:17 smithi027 bash[22610]: cluster 2024-08-31T04:24:16.228883+0000 mgr.a (mgr.14388) 5752 : cluster [DBG] pgmap v3987: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:18.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:18 smithi163 bash[24253]: audit 2024-08-31T04:24:17.160691+0000 mgr.a (mgr.14388) 5753 : audit [DBG] from='client.133530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:18 smithi027 bash[22610]: audit 2024-08-31T04:24:17.160691+0000 mgr.a (mgr.14388) 5753 : audit [DBG] from='client.133530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:18 smithi191 bash[24992]: audit 2024-08-31T04:24:17.160691+0000 mgr.a (mgr.14388) 5753 : audit [DBG] from='client.133530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:19.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:19 smithi163 bash[24253]: cluster 2024-08-31T04:24:18.231180+0000 mgr.a (mgr.14388) 5754 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:19 smithi027 bash[22610]: cluster 2024-08-31T04:24:18.231180+0000 mgr.a (mgr.14388) 5754 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:19 smithi191 bash[24992]: cluster 2024-08-31T04:24:18.231180+0000 mgr.a (mgr.14388) 5754 : cluster [DBG] pgmap v3988: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:21.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:21 smithi163 bash[24253]: cluster 2024-08-31T04:24:20.231946+0000 mgr.a (mgr.14388) 5755 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:21 smithi027 bash[22610]: cluster 2024-08-31T04:24:20.231946+0000 mgr.a (mgr.14388) 5755 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:21 smithi191 bash[24992]: cluster 2024-08-31T04:24:20.231946+0000 mgr.a (mgr.14388) 5755 : cluster [DBG] pgmap v3989: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:22.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:24:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:24:22.578 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:24:23.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:23.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:23.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:23.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:23.342 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:23.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:23 smithi163 bash[24253]: cluster 2024-08-31T04:24:22.232645+0000 mgr.a (mgr.14388) 5756 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:23 smithi027 bash[22610]: cluster 2024-08-31T04:24:22.232645+0000 mgr.a (mgr.14388) 5756 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:23 smithi191 bash[24992]: cluster 2024-08-31T04:24:22.232645+0000 mgr.a (mgr.14388) 5756 : cluster [DBG] pgmap v3990: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:24.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:24 smithi163 bash[24253]: audit 2024-08-31T04:24:22.920664+0000 mgr.a (mgr.14388) 5757 : audit [DBG] from='client.133608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:24 smithi027 bash[22610]: audit 2024-08-31T04:24:22.920664+0000 mgr.a (mgr.14388) 5757 : audit [DBG] from='client.133608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:24 smithi191 bash[24992]: audit 2024-08-31T04:24:22.920664+0000 mgr.a (mgr.14388) 5757 : audit [DBG] from='client.133608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:25.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:25 smithi163 bash[24253]: cluster 2024-08-31T04:24:24.235255+0000 mgr.a (mgr.14388) 5758 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:25 smithi027 bash[22610]: cluster 2024-08-31T04:24:24.235255+0000 mgr.a (mgr.14388) 5758 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:25 smithi191 bash[24992]: cluster 2024-08-31T04:24:24.235255+0000 mgr.a (mgr.14388) 5758 : cluster [DBG] pgmap v3991: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:27.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:27 smithi163 bash[24253]: cluster 2024-08-31T04:24:26.236015+0000 mgr.a (mgr.14388) 5759 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:24:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:27 smithi027 bash[22610]: cluster 2024-08-31T04:24:26.236015+0000 mgr.a (mgr.14388) 5759 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:24:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:27 smithi191 bash[24992]: cluster 2024-08-31T04:24:26.236015+0000 mgr.a (mgr.14388) 5759 : cluster [DBG] pgmap v3992: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:24:28.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:24:28.344 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:24:28.344 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:24:29.126 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:29.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:29.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:29.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:29.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:29.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:29 smithi163 bash[24253]: cluster 2024-08-31T04:24:28.237899+0000 mgr.a (mgr.14388) 5760 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:29.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:29 smithi163 bash[24253]: audit 2024-08-31T04:24:28.823863+0000 mon.a (mon.0) 1451 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:24:29.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:29 smithi027 bash[22610]: cluster 2024-08-31T04:24:28.237899+0000 mgr.a (mgr.14388) 5760 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:29 smithi027 bash[22610]: audit 2024-08-31T04:24:28.823863+0000 mon.a (mon.0) 1451 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:24:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:29 smithi191 bash[24992]: cluster 2024-08-31T04:24:28.237899+0000 mgr.a (mgr.14388) 5760 : cluster [DBG] pgmap v3993: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:29 smithi191 bash[24992]: audit 2024-08-31T04:24:28.823863+0000 mon.a (mon.0) 1451 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:24:30.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:30 smithi163 bash[24253]: audit 2024-08-31T04:24:28.678911+0000 mgr.a (mgr.14388) 5761 : audit [DBG] from='client.133686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:30.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:30 smithi163 bash[24253]: audit 2024-08-31T04:24:29.601665+0000 mon.a (mon.0) 1452 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:24:30.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:30 smithi163 bash[24253]: audit 2024-08-31T04:24:29.603526+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:24:30.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:30 smithi163 bash[24253]: audit 2024-08-31T04:24:29.614305+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:24:30.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:30 smithi163 bash[24253]: audit 2024-08-31T04:24:29.617199+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:24:30.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:24:30 smithi027 bash[22863]: debug 2024-08-31T04:24:30.333+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:24:30.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:24:30 smithi027 bash[22863]: debug 2024-08-31T04:24:30.337+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:24:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:30 smithi027 bash[22610]: audit 2024-08-31T04:24:28.678911+0000 mgr.a (mgr.14388) 5761 : audit [DBG] from='client.133686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:30 smithi027 bash[22610]: audit 2024-08-31T04:24:29.601665+0000 mon.a (mon.0) 1452 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:24:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:30 smithi027 bash[22610]: audit 2024-08-31T04:24:29.603526+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:24:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:30 smithi027 bash[22610]: audit 2024-08-31T04:24:29.614305+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:24:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:30 smithi027 bash[22610]: audit 2024-08-31T04:24:29.617199+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:24:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:30 smithi191 bash[24992]: audit 2024-08-31T04:24:28.678911+0000 mgr.a (mgr.14388) 5761 : audit [DBG] from='client.133686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:30 smithi191 bash[24992]: audit 2024-08-31T04:24:29.601665+0000 mon.a (mon.0) 1452 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:24:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:30 smithi191 bash[24992]: audit 2024-08-31T04:24:29.603526+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:24:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:30 smithi191 bash[24992]: audit 2024-08-31T04:24:29.614305+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:24:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:30 smithi191 bash[24992]: audit 2024-08-31T04:24:29.617199+0000 mon.a (mon.0) 1455 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:24:31.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:31 smithi163 bash[24253]: audit 2024-08-31T04:24:29.618528+0000 mgr.a (mgr.14388) 5762 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:24:31.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:31 smithi163 bash[24253]: cluster 2024-08-31T04:24:30.238392+0000 mgr.a (mgr.14388) 5763 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:24:31.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:31 smithi163 bash[24253]: audit 2024-08-31T04:24:30.337795+0000 mgr.a (mgr.14388) 5764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:24:31.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:31 smithi163 bash[24253]: cephadm 2024-08-31T04:24:30.338957+0000 mgr.a (mgr.14388) 5765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:24:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:31 smithi027 bash[22610]: audit 2024-08-31T04:24:29.618528+0000 mgr.a (mgr.14388) 5762 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:24:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:31 smithi027 bash[22610]: cluster 2024-08-31T04:24:30.238392+0000 mgr.a (mgr.14388) 5763 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:24:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:31 smithi027 bash[22610]: audit 2024-08-31T04:24:30.337795+0000 mgr.a (mgr.14388) 5764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:24:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:31 smithi027 bash[22610]: cephadm 2024-08-31T04:24:30.338957+0000 mgr.a (mgr.14388) 5765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:24:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:31 smithi191 bash[24992]: audit 2024-08-31T04:24:29.618528+0000 mgr.a (mgr.14388) 5762 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:24:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:31 smithi191 bash[24992]: cluster 2024-08-31T04:24:30.238392+0000 mgr.a (mgr.14388) 5763 : cluster [DBG] pgmap v3994: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:24:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:31 smithi191 bash[24992]: audit 2024-08-31T04:24:30.337795+0000 mgr.a (mgr.14388) 5764 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:24:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:31 smithi191 bash[24992]: cephadm 2024-08-31T04:24:30.338957+0000 mgr.a (mgr.14388) 5765 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:24:33.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:33 smithi163 bash[24253]: cluster 2024-08-31T04:24:32.239270+0000 mgr.a (mgr.14388) 5766 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:24:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:33 smithi027 bash[22610]: cluster 2024-08-31T04:24:32.239270+0000 mgr.a (mgr.14388) 5766 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:24:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:33 smithi191 bash[24992]: cluster 2024-08-31T04:24:32.239270+0000 mgr.a (mgr.14388) 5766 : cluster [DBG] pgmap v3995: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:24:34.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:24:34.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:24:34.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:24:34.881 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:34.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:35.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:35 smithi163 bash[24253]: cluster 2024-08-31T04:24:34.240417+0000 mgr.a (mgr.14388) 5767 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:35.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:35 smithi163 bash[24253]: audit 2024-08-31T04:24:34.461449+0000 mgr.a (mgr.14388) 5768 : audit [DBG] from='client.133872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:35 smithi027 bash[22610]: cluster 2024-08-31T04:24:34.240417+0000 mgr.a (mgr.14388) 5767 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:35 smithi027 bash[22610]: audit 2024-08-31T04:24:34.461449+0000 mgr.a (mgr.14388) 5768 : audit [DBG] from='client.133872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:35 smithi191 bash[24992]: cluster 2024-08-31T04:24:34.240417+0000 mgr.a (mgr.14388) 5767 : cluster [DBG] pgmap v3996: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:35 smithi191 bash[24992]: audit 2024-08-31T04:24:34.461449+0000 mgr.a (mgr.14388) 5768 : audit [DBG] from='client.133872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:37.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:37 smithi163 bash[24253]: cluster 2024-08-31T04:24:36.241345+0000 mgr.a (mgr.14388) 5769 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:37.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:37 smithi027 bash[22610]: cluster 2024-08-31T04:24:36.241345+0000 mgr.a (mgr.14388) 5769 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:37 smithi191 bash[24992]: cluster 2024-08-31T04:24:36.241345+0000 mgr.a (mgr.14388) 5769 : cluster [DBG] pgmap v3997: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:39.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:39 smithi163 bash[24253]: cluster 2024-08-31T04:24:38.243514+0000 mgr.a (mgr.14388) 5770 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:39 smithi027 bash[22610]: cluster 2024-08-31T04:24:38.243514+0000 mgr.a (mgr.14388) 5770 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:39 smithi191 bash[24992]: cluster 2024-08-31T04:24:38.243514+0000 mgr.a (mgr.14388) 5770 : cluster [DBG] pgmap v3998: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:24:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:24:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:24:40.661 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:40.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:40.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:40.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:40.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:41.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:41 smithi163 bash[24253]: audit 2024-08-31T04:24:40.220366+0000 mgr.a (mgr.14388) 5771 : audit [DBG] from='client.133944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:41.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:41 smithi163 bash[24253]: cluster 2024-08-31T04:24:40.244413+0000 mgr.a (mgr.14388) 5772 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:41 smithi027 bash[22610]: audit 2024-08-31T04:24:40.220366+0000 mgr.a (mgr.14388) 5771 : audit [DBG] from='client.133944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:41 smithi027 bash[22610]: cluster 2024-08-31T04:24:40.244413+0000 mgr.a (mgr.14388) 5772 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:41 smithi191 bash[24992]: audit 2024-08-31T04:24:40.220366+0000 mgr.a (mgr.14388) 5771 : audit [DBG] from='client.133944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:41 smithi191 bash[24992]: cluster 2024-08-31T04:24:40.244413+0000 mgr.a (mgr.14388) 5772 : cluster [DBG] pgmap v3999: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:43.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:43 smithi163 bash[24253]: cluster 2024-08-31T04:24:42.245401+0000 mgr.a (mgr.14388) 5773 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:43.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:43 smithi027 bash[22610]: cluster 2024-08-31T04:24:42.245401+0000 mgr.a (mgr.14388) 5773 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:43 smithi191 bash[24992]: cluster 2024-08-31T04:24:42.245401+0000 mgr.a (mgr.14388) 5773 : cluster [DBG] pgmap v4000: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:45.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:24:45.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:24:45.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:24:45.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:45 smithi163 bash[24253]: cluster 2024-08-31T04:24:44.247650+0000 mgr.a (mgr.14388) 5774 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:45.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:45 smithi027 bash[22610]: cluster 2024-08-31T04:24:44.247650+0000 mgr.a (mgr.14388) 5774 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:45 smithi191 bash[24992]: cluster 2024-08-31T04:24:44.247650+0000 mgr.a (mgr.14388) 5774 : cluster [DBG] pgmap v4001: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:46.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:46.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:47.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:47 smithi163 bash[24253]: audit 2024-08-31T04:24:45.992443+0000 mgr.a (mgr.14388) 5775 : audit [DBG] from='client.134019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:47.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:47 smithi163 bash[24253]: cluster 2024-08-31T04:24:46.248223+0000 mgr.a (mgr.14388) 5776 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:47 smithi027 bash[22610]: audit 2024-08-31T04:24:45.992443+0000 mgr.a (mgr.14388) 5775 : audit [DBG] from='client.134019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:47 smithi027 bash[22610]: cluster 2024-08-31T04:24:46.248223+0000 mgr.a (mgr.14388) 5776 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:47 smithi191 bash[24992]: audit 2024-08-31T04:24:45.992443+0000 mgr.a (mgr.14388) 5775 : audit [DBG] from='client.134019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:47 smithi191 bash[24992]: cluster 2024-08-31T04:24:46.248223+0000 mgr.a (mgr.14388) 5776 : cluster [DBG] pgmap v4002: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:49.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:49 smithi163 bash[24253]: cluster 2024-08-31T04:24:48.250551+0000 mgr.a (mgr.14388) 5777 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:49.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:49 smithi027 bash[22610]: cluster 2024-08-31T04:24:48.250551+0000 mgr.a (mgr.14388) 5777 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:49 smithi191 bash[24992]: cluster 2024-08-31T04:24:48.250551+0000 mgr.a (mgr.14388) 5777 : cluster [DBG] pgmap v4003: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:51.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:24:51.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:24:51.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:24:51.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:51 smithi163 bash[24253]: cluster 2024-08-31T04:24:50.251514+0000 mgr.a (mgr.14388) 5778 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:51.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:51 smithi027 bash[22610]: cluster 2024-08-31T04:24:50.251514+0000 mgr.a (mgr.14388) 5778 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:51 smithi191 bash[24992]: cluster 2024-08-31T04:24:50.251514+0000 mgr.a (mgr.14388) 5778 : cluster [DBG] pgmap v4004: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:52.153 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:52.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:52.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:52.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:52.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:53.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:53 smithi163 bash[24253]: audit 2024-08-31T04:24:51.734434+0000 mgr.a (mgr.14388) 5779 : audit [DBG] from='client.134097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:53.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:53 smithi163 bash[24253]: cluster 2024-08-31T04:24:52.252492+0000 mgr.a (mgr.14388) 5780 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:53 smithi027 bash[22610]: audit 2024-08-31T04:24:51.734434+0000 mgr.a (mgr.14388) 5779 : audit [DBG] from='client.134097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:53 smithi027 bash[22610]: cluster 2024-08-31T04:24:52.252492+0000 mgr.a (mgr.14388) 5780 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:53 smithi191 bash[24992]: audit 2024-08-31T04:24:51.734434+0000 mgr.a (mgr.14388) 5779 : audit [DBG] from='client.134097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:53 smithi191 bash[24992]: cluster 2024-08-31T04:24:52.252492+0000 mgr.a (mgr.14388) 5780 : cluster [DBG] pgmap v4005: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:55.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:55 smithi163 bash[24253]: cluster 2024-08-31T04:24:54.254767+0000 mgr.a (mgr.14388) 5781 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:55 smithi027 bash[22610]: cluster 2024-08-31T04:24:54.254767+0000 mgr.a (mgr.14388) 5781 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:55 smithi191 bash[24992]: cluster 2024-08-31T04:24:54.254767+0000 mgr.a (mgr.14388) 5781 : cluster [DBG] pgmap v4006: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:57.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:24:57.155 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:24:57.155 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:24:57.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:57 smithi163 bash[24253]: cluster 2024-08-31T04:24:56.255485+0000 mgr.a (mgr.14388) 5782 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:57.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:57 smithi027 bash[22610]: cluster 2024-08-31T04:24:56.255485+0000 mgr.a (mgr.14388) 5782 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:57 smithi191 bash[24992]: cluster 2024-08-31T04:24:56.255485+0000 mgr.a (mgr.14388) 5782 : cluster [DBG] pgmap v4007: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:24:57.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:24:58.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:58 smithi163 bash[24253]: audit 2024-08-31T04:24:57.484891+0000 mgr.a (mgr.14388) 5783 : audit [DBG] from='client.134172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:58 smithi027 bash[22610]: audit 2024-08-31T04:24:57.484891+0000 mgr.a (mgr.14388) 5783 : audit [DBG] from='client.134172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:58 smithi191 bash[24992]: audit 2024-08-31T04:24:57.484891+0000 mgr.a (mgr.14388) 5783 : audit [DBG] from='client.134172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:24:59.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:24:59 smithi163 bash[24253]: cluster 2024-08-31T04:24:58.257775+0000 mgr.a (mgr.14388) 5784 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:24:59 smithi027 bash[22610]: cluster 2024-08-31T04:24:58.257775+0000 mgr.a (mgr.14388) 5784 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:24:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:24:59 smithi191 bash[24992]: cluster 2024-08-31T04:24:58.257775+0000 mgr.a (mgr.14388) 5784 : cluster [DBG] pgmap v4008: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:01.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:01 smithi163 bash[24253]: cluster 2024-08-31T04:25:00.258579+0000 mgr.a (mgr.14388) 5785 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:01 smithi027 bash[22610]: cluster 2024-08-31T04:25:00.258579+0000 mgr.a (mgr.14388) 5785 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:01 smithi191 bash[24992]: cluster 2024-08-31T04:25:00.258579+0000 mgr.a (mgr.14388) 5785 : cluster [DBG] pgmap v4009: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:25:02.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:25:02.901 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:25:03.663 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:25:03.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:25:03.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:25:03.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:25:03.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:25:03.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:03 smithi163 bash[24253]: cluster 2024-08-31T04:25:02.259354+0000 mgr.a (mgr.14388) 5786 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:03 smithi027 bash[22610]: cluster 2024-08-31T04:25:02.259354+0000 mgr.a (mgr.14388) 5786 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:03 smithi191 bash[24992]: cluster 2024-08-31T04:25:02.259354+0000 mgr.a (mgr.14388) 5786 : cluster [DBG] pgmap v4010: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:04.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:04 smithi163 bash[24253]: audit 2024-08-31T04:25:03.233272+0000 mgr.a (mgr.14388) 5787 : audit [DBG] from='client.134250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:04 smithi027 bash[22610]: audit 2024-08-31T04:25:03.233272+0000 mgr.a (mgr.14388) 5787 : audit [DBG] from='client.134250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:04 smithi191 bash[24992]: audit 2024-08-31T04:25:03.233272+0000 mgr.a (mgr.14388) 5787 : audit [DBG] from='client.134250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:05.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:05 smithi163 bash[24253]: cluster 2024-08-31T04:25:04.262186+0000 mgr.a (mgr.14388) 5788 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:05 smithi027 bash[22610]: cluster 2024-08-31T04:25:04.262186+0000 mgr.a (mgr.14388) 5788 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:05 smithi191 bash[24992]: cluster 2024-08-31T04:25:04.262186+0000 mgr.a (mgr.14388) 5788 : cluster [DBG] pgmap v4011: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:07.694 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:07 smithi163 bash[24253]: cluster 2024-08-31T04:25:06.263014+0000 mgr.a (mgr.14388) 5789 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:25:07.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:07 smithi027 bash[22610]: cluster 2024-08-31T04:25:06.263014+0000 mgr.a (mgr.14388) 5789 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:25:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:07 smithi191 bash[24992]: cluster 2024-08-31T04:25:06.263014+0000 mgr.a (mgr.14388) 5789 : cluster [DBG] pgmap v4012: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:25:08.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:25:08.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:25:08.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:25:09.436 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:25:09.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:25:09.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:25:09.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:25:09.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:25:09.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:09 smithi163 bash[24253]: cluster 2024-08-31T04:25:08.264920+0000 mgr.a (mgr.14388) 5790 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:09 smithi027 bash[22610]: cluster 2024-08-31T04:25:08.264920+0000 mgr.a (mgr.14388) 5790 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:09 smithi191 bash[24992]: cluster 2024-08-31T04:25:08.264920+0000 mgr.a (mgr.14388) 5790 : cluster [DBG] pgmap v4013: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:10.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:10 smithi163 bash[24253]: audit 2024-08-31T04:25:09.003963+0000 mgr.a (mgr.14388) 5791 : audit [DBG] from='client.134328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:10 smithi027 bash[22610]: audit 2024-08-31T04:25:09.003963+0000 mgr.a (mgr.14388) 5791 : audit [DBG] from='client.134328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:10 smithi191 bash[24992]: audit 2024-08-31T04:25:09.003963+0000 mgr.a (mgr.14388) 5791 : audit [DBG] from='client.134328 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:11.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:11 smithi163 bash[24253]: cluster 2024-08-31T04:25:10.265907+0000 mgr.a (mgr.14388) 5792 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:25:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:11 smithi027 bash[22610]: cluster 2024-08-31T04:25:10.265907+0000 mgr.a (mgr.14388) 5792 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:25:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:11 smithi191 bash[24992]: cluster 2024-08-31T04:25:10.265907+0000 mgr.a (mgr.14388) 5792 : cluster [DBG] pgmap v4014: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:25:13.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:13 smithi163 bash[24253]: cluster 2024-08-31T04:25:12.266739+0000 mgr.a (mgr.14388) 5793 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:25:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:13 smithi027 bash[22610]: cluster 2024-08-31T04:25:12.266739+0000 mgr.a (mgr.14388) 5793 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:25:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:13 smithi191 bash[24992]: cluster 2024-08-31T04:25:12.266739+0000 mgr.a (mgr.14388) 5793 : cluster [DBG] pgmap v4015: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:25:14.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:25:14.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:25:14.439 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:25:15.217 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:25:15.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:25:15.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:25:15.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:25:15.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:25:15.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:15 smithi163 bash[24253]: cluster 2024-08-31T04:25:14.268930+0000 mgr.a (mgr.14388) 5794 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:15 smithi027 bash[22610]: cluster 2024-08-31T04:25:14.268930+0000 mgr.a (mgr.14388) 5794 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:15 smithi191 bash[24992]: cluster 2024-08-31T04:25:14.268930+0000 mgr.a (mgr.14388) 5794 : cluster [DBG] pgmap v4016: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:16 smithi027 bash[22610]: audit 2024-08-31T04:25:14.776947+0000 mgr.a (mgr.14388) 5795 : audit [DBG] from='client.134406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:16 smithi191 bash[24992]: audit 2024-08-31T04:25:14.776947+0000 mgr.a (mgr.14388) 5795 : audit [DBG] from='client.134406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:16.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:16 smithi163 bash[24253]: audit 2024-08-31T04:25:14.776947+0000 mgr.a (mgr.14388) 5795 : audit [DBG] from='client.134406 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:17 smithi027 bash[22610]: cluster 2024-08-31T04:25:16.269902+0000 mgr.a (mgr.14388) 5796 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:17 smithi191 bash[24992]: cluster 2024-08-31T04:25:16.269902+0000 mgr.a (mgr.14388) 5796 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:17.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:17 smithi163 bash[24253]: cluster 2024-08-31T04:25:16.269902+0000 mgr.a (mgr.14388) 5796 : cluster [DBG] pgmap v4017: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:19 smithi027 bash[22610]: cluster 2024-08-31T04:25:18.272058+0000 mgr.a (mgr.14388) 5797 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:19 smithi191 bash[24992]: cluster 2024-08-31T04:25:18.272058+0000 mgr.a (mgr.14388) 5797 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:19.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:19 smithi163 bash[24253]: cluster 2024-08-31T04:25:18.272058+0000 mgr.a (mgr.14388) 5797 : cluster [DBG] pgmap v4018: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:20.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:25:20.219 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:25:20.219 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:25:20.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:25:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:21 smithi027 bash[22610]: cluster 2024-08-31T04:25:20.272820+0000 mgr.a (mgr.14388) 5798 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:21 smithi191 bash[24992]: cluster 2024-08-31T04:25:20.272820+0000 mgr.a (mgr.14388) 5798 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:21.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:21 smithi163 bash[24253]: cluster 2024-08-31T04:25:20.272820+0000 mgr.a (mgr.14388) 5798 : cluster [DBG] pgmap v4019: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:22 smithi027 bash[22610]: audit 2024-08-31T04:25:20.556416+0000 mgr.a (mgr.14388) 5799 : audit [DBG] from='client.134484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:22 smithi191 bash[24992]: audit 2024-08-31T04:25:20.556416+0000 mgr.a (mgr.14388) 5799 : audit [DBG] from='client.134484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:22.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:22 smithi163 bash[24253]: audit 2024-08-31T04:25:20.556416+0000 mgr.a (mgr.14388) 5799 : audit [DBG] from='client.134484 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:23 smithi027 bash[22610]: cluster 2024-08-31T04:25:22.273788+0000 mgr.a (mgr.14388) 5800 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:23 smithi191 bash[24992]: cluster 2024-08-31T04:25:22.273788+0000 mgr.a (mgr.14388) 5800 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:23.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:23 smithi163 bash[24253]: cluster 2024-08-31T04:25:22.273788+0000 mgr.a (mgr.14388) 5800 : cluster [DBG] pgmap v4020: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:25 smithi027 bash[22610]: cluster 2024-08-31T04:25:24.276041+0000 mgr.a (mgr.14388) 5801 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:25 smithi191 bash[24992]: cluster 2024-08-31T04:25:24.276041+0000 mgr.a (mgr.14388) 5801 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:25.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:25 smithi163 bash[24253]: cluster 2024-08-31T04:25:24.276041+0000 mgr.a (mgr.14388) 5801 : cluster [DBG] pgmap v4021: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:25.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:25:26.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:25:26.790 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:25:26.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:25:26.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:25:26.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:25:26.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:25:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:27 smithi027 bash[22610]: cluster 2024-08-31T04:25:26.276766+0000 mgr.a (mgr.14388) 5802 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:27 smithi027 bash[22610]: audit 2024-08-31T04:25:26.338547+0000 mgr.a (mgr.14388) 5803 : audit [DBG] from='client.134559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:27 smithi191 bash[24992]: cluster 2024-08-31T04:25:26.276766+0000 mgr.a (mgr.14388) 5802 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:27 smithi191 bash[24992]: audit 2024-08-31T04:25:26.338547+0000 mgr.a (mgr.14388) 5803 : audit [DBG] from='client.134559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:27.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:27 smithi163 bash[24253]: cluster 2024-08-31T04:25:26.276766+0000 mgr.a (mgr.14388) 5802 : cluster [DBG] pgmap v4022: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:27.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:27 smithi163 bash[24253]: audit 2024-08-31T04:25:26.338547+0000 mgr.a (mgr.14388) 5803 : audit [DBG] from='client.134559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:29 smithi191 bash[24992]: cluster 2024-08-31T04:25:28.279053+0000 mgr.a (mgr.14388) 5804 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:29.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:29 smithi163 bash[24253]: cluster 2024-08-31T04:25:28.279053+0000 mgr.a (mgr.14388) 5804 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:29 smithi027 bash[22610]: cluster 2024-08-31T04:25:28.279053+0000 mgr.a (mgr.14388) 5804 : cluster [DBG] pgmap v4023: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:30 smithi191 bash[24992]: audit 2024-08-31T04:25:30.388524+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:25:30.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:30 smithi163 bash[24253]: audit 2024-08-31T04:25:30.388524+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:25:30.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:30 smithi027 bash[22610]: audit 2024-08-31T04:25:30.388524+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:25:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:31 smithi191 bash[24992]: cluster 2024-08-31T04:25:30.279844+0000 mgr.a (mgr.14388) 5805 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:31 smithi191 bash[24992]: audit 2024-08-31T04:25:31.237599+0000 mon.a (mon.0) 1457 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:25:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:31 smithi191 bash[24992]: audit 2024-08-31T04:25:31.239094+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:25:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:31 smithi191 bash[24992]: audit 2024-08-31T04:25:31.249277+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:25:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:31 smithi191 bash[24992]: audit 2024-08-31T04:25:31.254431+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:25:31.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:25:31.791 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:25:31.791 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:25:31.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:31 smithi163 bash[24253]: cluster 2024-08-31T04:25:30.279844+0000 mgr.a (mgr.14388) 5805 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:31.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:31 smithi163 bash[24253]: audit 2024-08-31T04:25:31.237599+0000 mon.a (mon.0) 1457 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:25:31.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:31 smithi163 bash[24253]: audit 2024-08-31T04:25:31.239094+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:25:31.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:31 smithi163 bash[24253]: audit 2024-08-31T04:25:31.249277+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:25:31.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:31 smithi163 bash[24253]: audit 2024-08-31T04:25:31.254431+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:25:31.972 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:31 smithi027 bash[22610]: cluster 2024-08-31T04:25:30.279844+0000 mgr.a (mgr.14388) 5805 : cluster [DBG] pgmap v4024: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:31.972 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:31 smithi027 bash[22610]: audit 2024-08-31T04:25:31.237599+0000 mon.a (mon.0) 1457 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:25:31.972 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:31 smithi027 bash[22610]: audit 2024-08-31T04:25:31.239094+0000 mon.a (mon.0) 1458 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:25:31.972 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:31 smithi027 bash[22610]: audit 2024-08-31T04:25:31.249277+0000 mon.a (mon.0) 1459 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:25:31.972 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:31 smithi027 bash[22610]: audit 2024-08-31T04:25:31.254431+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:25:32.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:25:31 smithi027 bash[22863]: debug 2024-08-31T04:25:31.968+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:25:32.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:25:31 smithi027 bash[22863]: debug 2024-08-31T04:25:31.972+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:25:32.527 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:25:32.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:25:32.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:25:32.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:25:32.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:25:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:32 smithi191 bash[24992]: audit 2024-08-31T04:25:31.255729+0000 mgr.a (mgr.14388) 5806 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:25:32.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:32 smithi163 bash[24253]: audit 2024-08-31T04:25:31.255729+0000 mgr.a (mgr.14388) 5806 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:25:32.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:32 smithi027 bash[22610]: audit 2024-08-31T04:25:31.255729+0000 mgr.a (mgr.14388) 5806 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:25:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:33 smithi191 bash[24992]: audit 2024-08-31T04:25:31.973925+0000 mgr.a (mgr.14388) 5807 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:25:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:33 smithi191 bash[24992]: cephadm 2024-08-31T04:25:31.975069+0000 mgr.a (mgr.14388) 5808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:25:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:33 smithi191 bash[24992]: audit 2024-08-31T04:25:32.114563+0000 mgr.a (mgr.14388) 5809 : audit [DBG] from='client.134742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:33 smithi191 bash[24992]: cluster 2024-08-31T04:25:32.280452+0000 mgr.a (mgr.14388) 5810 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:33.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:33 smithi163 bash[24253]: audit 2024-08-31T04:25:31.973925+0000 mgr.a (mgr.14388) 5807 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:25:33.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:33 smithi163 bash[24253]: cephadm 2024-08-31T04:25:31.975069+0000 mgr.a (mgr.14388) 5808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:25:33.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:33 smithi163 bash[24253]: audit 2024-08-31T04:25:32.114563+0000 mgr.a (mgr.14388) 5809 : audit [DBG] from='client.134742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:33.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:33 smithi163 bash[24253]: cluster 2024-08-31T04:25:32.280452+0000 mgr.a (mgr.14388) 5810 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:33 smithi027 bash[22610]: audit 2024-08-31T04:25:31.973925+0000 mgr.a (mgr.14388) 5807 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:25:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:33 smithi027 bash[22610]: cephadm 2024-08-31T04:25:31.975069+0000 mgr.a (mgr.14388) 5808 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:25:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:33 smithi027 bash[22610]: audit 2024-08-31T04:25:32.114563+0000 mgr.a (mgr.14388) 5809 : audit [DBG] from='client.134742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:33 smithi027 bash[22610]: cluster 2024-08-31T04:25:32.280452+0000 mgr.a (mgr.14388) 5810 : cluster [DBG] pgmap v4025: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:35 smithi191 bash[24992]: cluster 2024-08-31T04:25:34.282811+0000 mgr.a (mgr.14388) 5811 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:35.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:35 smithi163 bash[24253]: cluster 2024-08-31T04:25:34.282811+0000 mgr.a (mgr.14388) 5811 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:35 smithi027 bash[22610]: cluster 2024-08-31T04:25:34.282811+0000 mgr.a (mgr.14388) 5811 : cluster [DBG] pgmap v4026: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:37.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:25:37.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:25:37.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:25:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:37 smithi191 bash[24992]: cluster 2024-08-31T04:25:36.283605+0000 mgr.a (mgr.14388) 5812 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:37.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:37 smithi163 bash[24253]: cluster 2024-08-31T04:25:36.283605+0000 mgr.a (mgr.14388) 5812 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:37.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:37 smithi027 bash[22610]: cluster 2024-08-31T04:25:36.283605+0000 mgr.a (mgr.14388) 5812 : cluster [DBG] pgmap v4027: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:38.265 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:25:38.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:25:38.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:25:38.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:25:38.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:25:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:39 smithi191 bash[24992]: audit 2024-08-31T04:25:37.860989+0000 mgr.a (mgr.14388) 5813 : audit [DBG] from='client.134820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:39 smithi191 bash[24992]: cluster 2024-08-31T04:25:38.284661+0000 mgr.a (mgr.14388) 5814 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:39.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:39 smithi163 bash[24253]: audit 2024-08-31T04:25:37.860989+0000 mgr.a (mgr.14388) 5813 : audit [DBG] from='client.134820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:39.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:39 smithi163 bash[24253]: cluster 2024-08-31T04:25:38.284661+0000 mgr.a (mgr.14388) 5814 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:39 smithi027 bash[22610]: audit 2024-08-31T04:25:37.860989+0000 mgr.a (mgr.14388) 5813 : audit [DBG] from='client.134820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:39 smithi027 bash[22610]: cluster 2024-08-31T04:25:38.284661+0000 mgr.a (mgr.14388) 5814 : cluster [DBG] pgmap v4028: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:41 smithi191 bash[24992]: cluster 2024-08-31T04:25:40.285405+0000 mgr.a (mgr.14388) 5815 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:25:41.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:41 smithi163 bash[24253]: cluster 2024-08-31T04:25:40.285405+0000 mgr.a (mgr.14388) 5815 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:25:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:41 smithi027 bash[22610]: cluster 2024-08-31T04:25:40.285405+0000 mgr.a (mgr.14388) 5815 : cluster [DBG] pgmap v4029: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:25:43.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:25:43.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:25:43.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:25:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:43 smithi191 bash[24992]: cluster 2024-08-31T04:25:42.286193+0000 mgr.a (mgr.14388) 5816 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:25:43.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:43 smithi163 bash[24253]: cluster 2024-08-31T04:25:42.286193+0000 mgr.a (mgr.14388) 5816 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:25:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:43 smithi027 bash[22610]: cluster 2024-08-31T04:25:42.286193+0000 mgr.a (mgr.14388) 5816 : cluster [DBG] pgmap v4030: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:25:44.036 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:25:44.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:25:44.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:25:44.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:25:44.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:25:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:45 smithi191 bash[24992]: audit 2024-08-31T04:25:43.605287+0000 mgr.a (mgr.14388) 5817 : audit [DBG] from='client.134895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:45 smithi191 bash[24992]: cluster 2024-08-31T04:25:44.288940+0000 mgr.a (mgr.14388) 5818 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:45.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:45 smithi163 bash[24253]: audit 2024-08-31T04:25:43.605287+0000 mgr.a (mgr.14388) 5817 : audit [DBG] from='client.134895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:45.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:45 smithi163 bash[24253]: cluster 2024-08-31T04:25:44.288940+0000 mgr.a (mgr.14388) 5818 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:45.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:45 smithi027 bash[22610]: audit 2024-08-31T04:25:43.605287+0000 mgr.a (mgr.14388) 5817 : audit [DBG] from='client.134895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:45 smithi027 bash[22610]: cluster 2024-08-31T04:25:44.288940+0000 mgr.a (mgr.14388) 5818 : cluster [DBG] pgmap v4031: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:25:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:47 smithi191 bash[24992]: cluster 2024-08-31T04:25:46.289871+0000 mgr.a (mgr.14388) 5819 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:25:47.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:47 smithi163 bash[24253]: cluster 2024-08-31T04:25:46.289871+0000 mgr.a (mgr.14388) 5819 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:25:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:47 smithi027 bash[22610]: cluster 2024-08-31T04:25:46.289871+0000 mgr.a (mgr.14388) 5819 : cluster [DBG] pgmap v4032: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:25:48.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:48 smithi163 bash[24253]: cluster 2024-08-31T04:25:48.291830+0000 mgr.a (mgr.14388) 5820 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:48 smithi027 bash[22610]: cluster 2024-08-31T04:25:48.291830+0000 mgr.a (mgr.14388) 5820 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:49.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:25:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:48 smithi191 bash[24992]: cluster 2024-08-31T04:25:48.291830+0000 mgr.a (mgr.14388) 5820 : cluster [DBG] pgmap v4033: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:49.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:25:49.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:25:49.807 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:25:49.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:25:49.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:25:49.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:25:49.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:25:49.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:49 smithi163 bash[24253]: audit 2024-08-31T04:25:49.371882+0000 mgr.a (mgr.14388) 5821 : audit [DBG] from='client.134973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:49 smithi027 bash[22610]: audit 2024-08-31T04:25:49.371882+0000 mgr.a (mgr.14388) 5821 : audit [DBG] from='client.134973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:49 smithi191 bash[24992]: audit 2024-08-31T04:25:49.371882+0000 mgr.a (mgr.14388) 5821 : audit [DBG] from='client.134973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:50.945 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:50 smithi163 bash[24253]: cluster 2024-08-31T04:25:50.292836+0000 mgr.a (mgr.14388) 5822 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:25:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:50 smithi027 bash[22610]: cluster 2024-08-31T04:25:50.292836+0000 mgr.a (mgr.14388) 5822 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:25:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:50 smithi191 bash[24992]: cluster 2024-08-31T04:25:50.292836+0000 mgr.a (mgr.14388) 5822 : cluster [DBG] pgmap v4034: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:25:53.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:53 smithi163 bash[24253]: cluster 2024-08-31T04:25:52.293703+0000 mgr.a (mgr.14388) 5823 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:25:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:53 smithi027 bash[22610]: cluster 2024-08-31T04:25:52.293703+0000 mgr.a (mgr.14388) 5823 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:25:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:53 smithi191 bash[24992]: cluster 2024-08-31T04:25:52.293703+0000 mgr.a (mgr.14388) 5823 : cluster [DBG] pgmap v4035: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T04:25:54.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:25:54.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:25:54.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:25:55.597 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:25:55.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:25:55.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:25:55.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:25:55.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:25:55.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:55 smithi163 bash[24253]: cluster 2024-08-31T04:25:54.295938+0000 mgr.a (mgr.14388) 5824 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:55.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:55 smithi027 bash[22610]: cluster 2024-08-31T04:25:54.295938+0000 mgr.a (mgr.14388) 5824 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:55 smithi191 bash[24992]: cluster 2024-08-31T04:25:54.295938+0000 mgr.a (mgr.14388) 5824 : cluster [DBG] pgmap v4036: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:56.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:56 smithi163 bash[24253]: audit 2024-08-31T04:25:55.150267+0000 mgr.a (mgr.14388) 5825 : audit [DBG] from='client.135045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:56.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:56 smithi027 bash[22610]: audit 2024-08-31T04:25:55.150267+0000 mgr.a (mgr.14388) 5825 : audit [DBG] from='client.135045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:56 smithi191 bash[24992]: audit 2024-08-31T04:25:55.150267+0000 mgr.a (mgr.14388) 5825 : audit [DBG] from='client.135045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:25:57.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:57 smithi163 bash[24253]: cluster 2024-08-31T04:25:56.296915+0000 mgr.a (mgr.14388) 5826 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:57 smithi027 bash[22610]: cluster 2024-08-31T04:25:56.296915+0000 mgr.a (mgr.14388) 5826 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:57 smithi191 bash[24992]: cluster 2024-08-31T04:25:56.296915+0000 mgr.a (mgr.14388) 5826 : cluster [DBG] pgmap v4037: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:25:59.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:25:59 smithi163 bash[24253]: cluster 2024-08-31T04:25:58.299075+0000 mgr.a (mgr.14388) 5827 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:25:59 smithi027 bash[22610]: cluster 2024-08-31T04:25:58.299075+0000 mgr.a (mgr.14388) 5827 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:25:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:25:59 smithi191 bash[24992]: cluster 2024-08-31T04:25:58.299075+0000 mgr.a (mgr.14388) 5827 : cluster [DBG] pgmap v4038: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:26:00.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:00.599 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:01.357 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:01.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:01.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:01.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:01.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:01.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:01 smithi163 bash[24253]: cluster 2024-08-31T04:26:00.299839+0000 mgr.a (mgr.14388) 5828 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:01 smithi027 bash[22610]: cluster 2024-08-31T04:26:00.299839+0000 mgr.a (mgr.14388) 5828 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:01 smithi191 bash[24992]: cluster 2024-08-31T04:26:00.299839+0000 mgr.a (mgr.14388) 5828 : cluster [DBG] pgmap v4039: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:02.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:02 smithi163 bash[24253]: audit 2024-08-31T04:26:00.934475+0000 mgr.a (mgr.14388) 5829 : audit [DBG] from='client.135123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:02 smithi027 bash[22610]: audit 2024-08-31T04:26:00.934475+0000 mgr.a (mgr.14388) 5829 : audit [DBG] from='client.135123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:02 smithi191 bash[24992]: audit 2024-08-31T04:26:00.934475+0000 mgr.a (mgr.14388) 5829 : audit [DBG] from='client.135123 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:03.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:03 smithi163 bash[24253]: cluster 2024-08-31T04:26:02.300818+0000 mgr.a (mgr.14388) 5830 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:03 smithi027 bash[22610]: cluster 2024-08-31T04:26:02.300818+0000 mgr.a (mgr.14388) 5830 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:03 smithi191 bash[24992]: cluster 2024-08-31T04:26:02.300818+0000 mgr.a (mgr.14388) 5830 : cluster [DBG] pgmap v4040: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:05.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:05 smithi163 bash[24253]: cluster 2024-08-31T04:26:04.303120+0000 mgr.a (mgr.14388) 5831 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:26:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:05 smithi027 bash[22610]: cluster 2024-08-31T04:26:04.303120+0000 mgr.a (mgr.14388) 5831 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:26:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:05 smithi191 bash[24992]: cluster 2024-08-31T04:26:04.303120+0000 mgr.a (mgr.14388) 5831 : cluster [DBG] pgmap v4041: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:26:06.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:06.360 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:06.360 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:07.099 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:07.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:07.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:07.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:07.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:07.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:07 smithi163 bash[24253]: cluster 2024-08-31T04:26:06.303908+0000 mgr.a (mgr.14388) 5832 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:07.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:07 smithi027 bash[22610]: cluster 2024-08-31T04:26:06.303908+0000 mgr.a (mgr.14388) 5832 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:07 smithi191 bash[24992]: cluster 2024-08-31T04:26:06.303908+0000 mgr.a (mgr.14388) 5832 : cluster [DBG] pgmap v4042: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:08.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:08 smithi163 bash[24253]: audit 2024-08-31T04:26:06.692912+0000 mgr.a (mgr.14388) 5833 : audit [DBG] from='client.135201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:08 smithi027 bash[22610]: audit 2024-08-31T04:26:06.692912+0000 mgr.a (mgr.14388) 5833 : audit [DBG] from='client.135201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:08 smithi191 bash[24992]: audit 2024-08-31T04:26:06.692912+0000 mgr.a (mgr.14388) 5833 : audit [DBG] from='client.135201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:09.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:09 smithi163 bash[24253]: cluster 2024-08-31T04:26:08.306308+0000 mgr.a (mgr.14388) 5834 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:26:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:09 smithi027 bash[22610]: cluster 2024-08-31T04:26:08.306308+0000 mgr.a (mgr.14388) 5834 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:26:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:09 smithi191 bash[24992]: cluster 2024-08-31T04:26:08.306308+0000 mgr.a (mgr.14388) 5834 : cluster [DBG] pgmap v4043: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:26:11.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:11 smithi163 bash[24253]: cluster 2024-08-31T04:26:10.307130+0000 mgr.a (mgr.14388) 5835 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:11 smithi027 bash[22610]: cluster 2024-08-31T04:26:10.307130+0000 mgr.a (mgr.14388) 5835 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:11 smithi191 bash[24992]: cluster 2024-08-31T04:26:10.307130+0000 mgr.a (mgr.14388) 5835 : cluster [DBG] pgmap v4044: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:12.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:12.101 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:12.101 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:12.847 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:12.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:13.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:13 smithi163 bash[24253]: cluster 2024-08-31T04:26:12.307928+0000 mgr.a (mgr.14388) 5836 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:13.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:13 smithi163 bash[24253]: audit 2024-08-31T04:26:12.432432+0000 mgr.a (mgr.14388) 5837 : audit [DBG] from='client.135276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:13 smithi027 bash[22610]: cluster 2024-08-31T04:26:12.307928+0000 mgr.a (mgr.14388) 5836 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:13 smithi027 bash[22610]: audit 2024-08-31T04:26:12.432432+0000 mgr.a (mgr.14388) 5837 : audit [DBG] from='client.135276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:13 smithi191 bash[24992]: cluster 2024-08-31T04:26:12.307928+0000 mgr.a (mgr.14388) 5836 : cluster [DBG] pgmap v4045: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:13 smithi191 bash[24992]: audit 2024-08-31T04:26:12.432432+0000 mgr.a (mgr.14388) 5837 : audit [DBG] from='client.135276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:15.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:15 smithi163 bash[24253]: cluster 2024-08-31T04:26:14.310275+0000 mgr.a (mgr.14388) 5838 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:26:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:15 smithi027 bash[22610]: cluster 2024-08-31T04:26:14.310275+0000 mgr.a (mgr.14388) 5838 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:26:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:15 smithi191 bash[24992]: cluster 2024-08-31T04:26:14.310275+0000 mgr.a (mgr.14388) 5838 : cluster [DBG] pgmap v4046: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:26:17.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:17 smithi163 bash[24253]: cluster 2024-08-31T04:26:16.311063+0000 mgr.a (mgr.14388) 5839 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:17 smithi027 bash[22610]: cluster 2024-08-31T04:26:16.311063+0000 mgr.a (mgr.14388) 5839 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:17.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:17 smithi191 bash[24992]: cluster 2024-08-31T04:26:16.311063+0000 mgr.a (mgr.14388) 5839 : cluster [DBG] pgmap v4047: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:17.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:17.849 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:17.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:18.586 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:18.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:18.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:18.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:18.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:19.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:19 smithi163 bash[24253]: audit 2024-08-31T04:26:18.182104+0000 mgr.a (mgr.14388) 5840 : audit [DBG] from='client.135351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:19.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:19 smithi163 bash[24253]: cluster 2024-08-31T04:26:18.312891+0000 mgr.a (mgr.14388) 5841 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:19 smithi027 bash[22610]: audit 2024-08-31T04:26:18.182104+0000 mgr.a (mgr.14388) 5840 : audit [DBG] from='client.135351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:19 smithi027 bash[22610]: cluster 2024-08-31T04:26:18.312891+0000 mgr.a (mgr.14388) 5841 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:19 smithi191 bash[24992]: audit 2024-08-31T04:26:18.182104+0000 mgr.a (mgr.14388) 5840 : audit [DBG] from='client.135351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:19 smithi191 bash[24992]: cluster 2024-08-31T04:26:18.312891+0000 mgr.a (mgr.14388) 5841 : cluster [DBG] pgmap v4048: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:21.695 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:21 smithi163 bash[24253]: cluster 2024-08-31T04:26:20.313802+0000 mgr.a (mgr.14388) 5842 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:26:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:21 smithi027 bash[22610]: cluster 2024-08-31T04:26:20.313802+0000 mgr.a (mgr.14388) 5842 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:26:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:21 smithi191 bash[24992]: cluster 2024-08-31T04:26:20.313802+0000 mgr.a (mgr.14388) 5842 : cluster [DBG] pgmap v4049: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:26:23.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:23.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:23.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:23 smithi027 bash[22610]: cluster 2024-08-31T04:26:22.314599+0000 mgr.a (mgr.14388) 5843 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:26:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:23 smithi191 bash[24992]: cluster 2024-08-31T04:26:22.314599+0000 mgr.a (mgr.14388) 5843 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:26:23.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:23 smithi163 bash[24253]: cluster 2024-08-31T04:26:22.314599+0000 mgr.a (mgr.14388) 5843 : cluster [DBG] pgmap v4050: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:26:24.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:24.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:24.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:24.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:24.333 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:25 smithi027 bash[22610]: audit 2024-08-31T04:26:23.919212+0000 mgr.a (mgr.14388) 5844 : audit [DBG] from='client.135423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:25 smithi027 bash[22610]: cluster 2024-08-31T04:26:24.315968+0000 mgr.a (mgr.14388) 5845 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:25 smithi191 bash[24992]: audit 2024-08-31T04:26:23.919212+0000 mgr.a (mgr.14388) 5844 : audit [DBG] from='client.135423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:25 smithi191 bash[24992]: cluster 2024-08-31T04:26:24.315968+0000 mgr.a (mgr.14388) 5845 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:25.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:25 smithi163 bash[24253]: audit 2024-08-31T04:26:23.919212+0000 mgr.a (mgr.14388) 5844 : audit [DBG] from='client.135423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:25.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:25 smithi163 bash[24253]: cluster 2024-08-31T04:26:24.315968+0000 mgr.a (mgr.14388) 5845 : cluster [DBG] pgmap v4051: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:27 smithi027 bash[22610]: cluster 2024-08-31T04:26:26.316737+0000 mgr.a (mgr.14388) 5846 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:26:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:27 smithi191 bash[24992]: cluster 2024-08-31T04:26:26.316737+0000 mgr.a (mgr.14388) 5846 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:26:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:27 smithi163 bash[24253]: cluster 2024-08-31T04:26:26.316737+0000 mgr.a (mgr.14388) 5846 : cluster [DBG] pgmap v4052: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:26:29.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:29.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:29.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:29.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:29 smithi027 bash[22610]: cluster 2024-08-31T04:26:28.318612+0000 mgr.a (mgr.14388) 5847 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:29 smithi191 bash[24992]: cluster 2024-08-31T04:26:28.318612+0000 mgr.a (mgr.14388) 5847 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:29.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:29 smithi163 bash[24253]: cluster 2024-08-31T04:26:28.318612+0000 mgr.a (mgr.14388) 5847 : cluster [DBG] pgmap v4053: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:30.087 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:30.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:30.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:30.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:30.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:31 smithi027 bash[22610]: audit 2024-08-31T04:26:29.665584+0000 mgr.a (mgr.14388) 5848 : audit [DBG] from='client.135501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:31 smithi027 bash[22610]: cluster 2024-08-31T04:26:30.319575+0000 mgr.a (mgr.14388) 5849 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:31 smithi191 bash[24992]: audit 2024-08-31T04:26:29.665584+0000 mgr.a (mgr.14388) 5848 : audit [DBG] from='client.135501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:31 smithi191 bash[24992]: cluster 2024-08-31T04:26:30.319575+0000 mgr.a (mgr.14388) 5849 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:31 smithi163 bash[24253]: audit 2024-08-31T04:26:29.665584+0000 mgr.a (mgr.14388) 5848 : audit [DBG] from='client.135501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:31 smithi163 bash[24253]: cluster 2024-08-31T04:26:30.319575+0000 mgr.a (mgr.14388) 5849 : cluster [DBG] pgmap v4054: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:32 smithi027 bash[22610]: audit 2024-08-31T04:26:32.024411+0000 mon.a (mon.0) 1461 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:26:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:32 smithi191 bash[24992]: audit 2024-08-31T04:26:32.024411+0000 mon.a (mon.0) 1461 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:26:32.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:32 smithi163 bash[24253]: audit 2024-08-31T04:26:32.024411+0000 mon.a (mon.0) 1461 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:26:33.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:26:33 smithi027 bash[22863]: debug 2024-08-31T04:26:33.606+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:26:33.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:26:33 smithi027 bash[22863]: debug 2024-08-31T04:26:33.610+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:26:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:33 smithi027 bash[22610]: cluster 2024-08-31T04:26:32.320348+0000 mgr.a (mgr.14388) 5850 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:33 smithi027 bash[22610]: audit 2024-08-31T04:26:32.853587+0000 mon.a (mon.0) 1462 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:26:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:33 smithi027 bash[22610]: audit 2024-08-31T04:26:32.854901+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:26:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:33 smithi027 bash[22610]: audit 2024-08-31T04:26:32.865037+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:26:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:33 smithi027 bash[22610]: audit 2024-08-31T04:26:32.869626+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:26:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:33 smithi191 bash[24992]: cluster 2024-08-31T04:26:32.320348+0000 mgr.a (mgr.14388) 5850 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:33 smithi191 bash[24992]: audit 2024-08-31T04:26:32.853587+0000 mon.a (mon.0) 1462 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:26:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:33 smithi191 bash[24992]: audit 2024-08-31T04:26:32.854901+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:26:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:33 smithi191 bash[24992]: audit 2024-08-31T04:26:32.865037+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:26:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:33 smithi191 bash[24992]: audit 2024-08-31T04:26:32.869626+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:26:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:33 smithi163 bash[24253]: cluster 2024-08-31T04:26:32.320348+0000 mgr.a (mgr.14388) 5850 : cluster [DBG] pgmap v4055: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:33 smithi163 bash[24253]: audit 2024-08-31T04:26:32.853587+0000 mon.a (mon.0) 1462 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:26:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:33 smithi163 bash[24253]: audit 2024-08-31T04:26:32.854901+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:26:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:33 smithi163 bash[24253]: audit 2024-08-31T04:26:32.865037+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:26:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:33 smithi163 bash[24253]: audit 2024-08-31T04:26:32.869626+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:26:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:34 smithi027 bash[22610]: audit 2024-08-31T04:26:32.871985+0000 mgr.a (mgr.14388) 5851 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:26:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:34 smithi191 bash[24992]: audit 2024-08-31T04:26:32.871985+0000 mgr.a (mgr.14388) 5851 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:26:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:34 smithi163 bash[24253]: audit 2024-08-31T04:26:32.871985+0000 mgr.a (mgr.14388) 5851 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:26:35.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:35.090 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:35 smithi191 bash[24992]: audit 2024-08-31T04:26:33.610026+0000 mgr.a (mgr.14388) 5852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:26:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:35 smithi191 bash[24992]: cephadm 2024-08-31T04:26:33.611278+0000 mgr.a (mgr.14388) 5853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:26:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:35 smithi191 bash[24992]: cluster 2024-08-31T04:26:34.323157+0000 mgr.a (mgr.14388) 5854 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T04:26:35.862 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:35.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:35 smithi163 bash[24253]: audit 2024-08-31T04:26:33.610026+0000 mgr.a (mgr.14388) 5852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:26:35.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:35 smithi163 bash[24253]: cephadm 2024-08-31T04:26:33.611278+0000 mgr.a (mgr.14388) 5853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:26:35.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:35 smithi163 bash[24253]: cluster 2024-08-31T04:26:34.323157+0000 mgr.a (mgr.14388) 5854 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T04:26:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:35 smithi027 bash[22610]: audit 2024-08-31T04:26:33.610026+0000 mgr.a (mgr.14388) 5852 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:26:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:35 smithi027 bash[22610]: cephadm 2024-08-31T04:26:33.611278+0000 mgr.a (mgr.14388) 5853 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:26:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:35 smithi027 bash[22610]: cluster 2024-08-31T04:26:34.323157+0000 mgr.a (mgr.14388) 5854 : cluster [DBG] pgmap v4056: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T04:26:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:36 smithi191 bash[24992]: audit 2024-08-31T04:26:35.429496+0000 mgr.a (mgr.14388) 5855 : audit [DBG] from='client.135684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:36 smithi163 bash[24253]: audit 2024-08-31T04:26:35.429496+0000 mgr.a (mgr.14388) 5855 : audit [DBG] from='client.135684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:36 smithi027 bash[22610]: audit 2024-08-31T04:26:35.429496+0000 mgr.a (mgr.14388) 5855 : audit [DBG] from='client.135684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:37 smithi191 bash[24992]: cluster 2024-08-31T04:26:36.324328+0000 mgr.a (mgr.14388) 5856 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T04:26:37.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:37 smithi163 bash[24253]: cluster 2024-08-31T04:26:36.324328+0000 mgr.a (mgr.14388) 5856 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T04:26:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:37 smithi027 bash[22610]: cluster 2024-08-31T04:26:36.324328+0000 mgr.a (mgr.14388) 5856 : cluster [DBG] pgmap v4057: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T04:26:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:39 smithi191 bash[24992]: cluster 2024-08-31T04:26:38.326641+0000 mgr.a (mgr.14388) 5857 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:39.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:39 smithi163 bash[24253]: cluster 2024-08-31T04:26:38.326641+0000 mgr.a (mgr.14388) 5857 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:39 smithi027 bash[22610]: cluster 2024-08-31T04:26:38.326641+0000 mgr.a (mgr.14388) 5857 : cluster [DBG] pgmap v4058: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:40.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:40.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:40.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:41.605 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:41.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:41.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:41.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:41.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:41 smithi191 bash[24992]: cluster 2024-08-31T04:26:40.327622+0000 mgr.a (mgr.14388) 5858 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:41.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:41 smithi163 bash[24253]: cluster 2024-08-31T04:26:40.327622+0000 mgr.a (mgr.14388) 5858 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:41.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:41 smithi027 bash[22610]: cluster 2024-08-31T04:26:40.327622+0000 mgr.a (mgr.14388) 5858 : cluster [DBG] pgmap v4059: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:42 smithi191 bash[24992]: audit 2024-08-31T04:26:41.195085+0000 mgr.a (mgr.14388) 5859 : audit [DBG] from='client.135759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:42.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:42 smithi163 bash[24253]: audit 2024-08-31T04:26:41.195085+0000 mgr.a (mgr.14388) 5859 : audit [DBG] from='client.135759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:42 smithi027 bash[22610]: audit 2024-08-31T04:26:41.195085+0000 mgr.a (mgr.14388) 5859 : audit [DBG] from='client.135759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:43 smithi191 bash[24992]: cluster 2024-08-31T04:26:42.328587+0000 mgr.a (mgr.14388) 5860 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:43.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:43 smithi163 bash[24253]: cluster 2024-08-31T04:26:42.328587+0000 mgr.a (mgr.14388) 5860 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:43.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:43 smithi027 bash[22610]: cluster 2024-08-31T04:26:42.328587+0000 mgr.a (mgr.14388) 5860 : cluster [DBG] pgmap v4060: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:45 smithi191 bash[24992]: cluster 2024-08-31T04:26:44.330858+0000 mgr.a (mgr.14388) 5861 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:45.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:45 smithi163 bash[24253]: cluster 2024-08-31T04:26:44.330858+0000 mgr.a (mgr.14388) 5861 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:45 smithi027 bash[22610]: cluster 2024-08-31T04:26:44.330858+0000 mgr.a (mgr.14388) 5861 : cluster [DBG] pgmap v4061: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:26:46.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:46.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:46.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:47.384 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:47.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:47.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:47.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:47.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:47 smithi191 bash[24992]: cluster 2024-08-31T04:26:46.331576+0000 mgr.a (mgr.14388) 5862 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:26:47.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:47 smithi163 bash[24253]: cluster 2024-08-31T04:26:46.331576+0000 mgr.a (mgr.14388) 5862 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:26:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:47 smithi027 bash[22610]: cluster 2024-08-31T04:26:46.331576+0000 mgr.a (mgr.14388) 5862 : cluster [DBG] pgmap v4062: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 5.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:26:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:48 smithi191 bash[24992]: audit 2024-08-31T04:26:46.947296+0000 mgr.a (mgr.14388) 5863 : audit [DBG] from='client.135831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:48.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:48 smithi163 bash[24253]: audit 2024-08-31T04:26:46.947296+0000 mgr.a (mgr.14388) 5863 : audit [DBG] from='client.135831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:48 smithi027 bash[22610]: audit 2024-08-31T04:26:46.947296+0000 mgr.a (mgr.14388) 5863 : audit [DBG] from='client.135831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:49 smithi191 bash[24992]: cluster 2024-08-31T04:26:48.333966+0000 mgr.a (mgr.14388) 5864 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T04:26:49.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:49 smithi163 bash[24253]: cluster 2024-08-31T04:26:48.333966+0000 mgr.a (mgr.14388) 5864 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T04:26:49.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:49 smithi027 bash[22610]: cluster 2024-08-31T04:26:48.333966+0000 mgr.a (mgr.14388) 5864 : cluster [DBG] pgmap v4063: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T04:26:51.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:51 smithi163 bash[24253]: cluster 2024-08-31T04:26:50.334748+0000 mgr.a (mgr.14388) 5865 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:51 smithi027 bash[22610]: cluster 2024-08-31T04:26:50.334748+0000 mgr.a (mgr.14388) 5865 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:51 smithi191 bash[24992]: cluster 2024-08-31T04:26:50.334748+0000 mgr.a (mgr.14388) 5865 : cluster [DBG] pgmap v4064: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:52.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:52.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:52.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:53.140 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:53.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:53.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:53.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:53.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:53.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:53 smithi163 bash[24253]: cluster 2024-08-31T04:26:52.335509+0000 mgr.a (mgr.14388) 5866 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:53 smithi027 bash[22610]: cluster 2024-08-31T04:26:52.335509+0000 mgr.a (mgr.14388) 5866 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:53 smithi191 bash[24992]: cluster 2024-08-31T04:26:52.335509+0000 mgr.a (mgr.14388) 5866 : cluster [DBG] pgmap v4065: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:54.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:54 smithi163 bash[24253]: audit 2024-08-31T04:26:52.724578+0000 mgr.a (mgr.14388) 5867 : audit [DBG] from='client.135903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:54 smithi027 bash[22610]: audit 2024-08-31T04:26:52.724578+0000 mgr.a (mgr.14388) 5867 : audit [DBG] from='client.135903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:54 smithi191 bash[24992]: audit 2024-08-31T04:26:52.724578+0000 mgr.a (mgr.14388) 5867 : audit [DBG] from='client.135903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:55.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:55 smithi163 bash[24253]: cluster 2024-08-31T04:26:54.337880+0000 mgr.a (mgr.14388) 5868 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:26:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:55 smithi027 bash[22610]: cluster 2024-08-31T04:26:54.337880+0000 mgr.a (mgr.14388) 5868 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:26:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:55 smithi191 bash[24992]: cluster 2024-08-31T04:26:54.337880+0000 mgr.a (mgr.14388) 5868 : cluster [DBG] pgmap v4066: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:26:56.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:56 smithi163 bash[24253]: cluster 2024-08-31T04:26:56.338692+0000 mgr.a (mgr.14388) 5869 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:26:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:56 smithi027 bash[22610]: cluster 2024-08-31T04:26:56.338692+0000 mgr.a (mgr.14388) 5869 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:26:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:56 smithi191 bash[24992]: cluster 2024-08-31T04:26:56.338692+0000 mgr.a (mgr.14388) 5869 : cluster [DBG] pgmap v4067: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:26:58.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:26:58.142 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:26:58.142 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:26:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:26:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:26:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:26:58.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:26:58.883 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:26:59.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:59 smithi163 bash[24253]: cluster 2024-08-31T04:26:58.340623+0000 mgr.a (mgr.14388) 5870 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:59.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:26:59 smithi163 bash[24253]: audit 2024-08-31T04:26:58.478321+0000 mgr.a (mgr.14388) 5871 : audit [DBG] from='client.135981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:59 smithi027 bash[22610]: cluster 2024-08-31T04:26:58.340623+0000 mgr.a (mgr.14388) 5870 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:26:59 smithi027 bash[22610]: audit 2024-08-31T04:26:58.478321+0000 mgr.a (mgr.14388) 5871 : audit [DBG] from='client.135981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:26:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:59 smithi191 bash[24992]: cluster 2024-08-31T04:26:58.340623+0000 mgr.a (mgr.14388) 5870 : cluster [DBG] pgmap v4068: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:26:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:26:59 smithi191 bash[24992]: audit 2024-08-31T04:26:58.478321+0000 mgr.a (mgr.14388) 5871 : audit [DBG] from='client.135981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:01.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:01 smithi163 bash[24253]: cluster 2024-08-31T04:27:00.341539+0000 mgr.a (mgr.14388) 5872 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:27:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:01 smithi027 bash[22610]: cluster 2024-08-31T04:27:00.341539+0000 mgr.a (mgr.14388) 5872 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:27:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:01 smithi191 bash[24992]: cluster 2024-08-31T04:27:00.341539+0000 mgr.a (mgr.14388) 5872 : cluster [DBG] pgmap v4069: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:27:03.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:03 smithi163 bash[24253]: cluster 2024-08-31T04:27:02.342252+0000 mgr.a (mgr.14388) 5873 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:27:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:03 smithi027 bash[22610]: cluster 2024-08-31T04:27:02.342252+0000 mgr.a (mgr.14388) 5873 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:27:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:03 smithi191 bash[24992]: cluster 2024-08-31T04:27:02.342252+0000 mgr.a (mgr.14388) 5873 : cluster [DBG] pgmap v4070: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:27:03.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:27:03.885 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:27:03.885 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:27:04.632 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:27:04.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:27:04.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:27:04.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:27:04.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:27:05.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:05 smithi163 bash[24253]: audit 2024-08-31T04:27:04.215300+0000 mgr.a (mgr.14388) 5874 : audit [DBG] from='client.136056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:05.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:05 smithi163 bash[24253]: cluster 2024-08-31T04:27:04.346667+0000 mgr.a (mgr.14388) 5875 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:05 smithi027 bash[22610]: audit 2024-08-31T04:27:04.215300+0000 mgr.a (mgr.14388) 5874 : audit [DBG] from='client.136056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:05 smithi027 bash[22610]: cluster 2024-08-31T04:27:04.346667+0000 mgr.a (mgr.14388) 5875 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:05 smithi191 bash[24992]: audit 2024-08-31T04:27:04.215300+0000 mgr.a (mgr.14388) 5874 : audit [DBG] from='client.136056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:05 smithi191 bash[24992]: cluster 2024-08-31T04:27:04.346667+0000 mgr.a (mgr.14388) 5875 : cluster [DBG] pgmap v4071: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:07.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:07 smithi163 bash[24253]: cluster 2024-08-31T04:27:06.347698+0000 mgr.a (mgr.14388) 5876 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:27:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:07 smithi027 bash[22610]: cluster 2024-08-31T04:27:06.347698+0000 mgr.a (mgr.14388) 5876 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:27:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:07 smithi191 bash[24992]: cluster 2024-08-31T04:27:06.347698+0000 mgr.a (mgr.14388) 5876 : cluster [DBG] pgmap v4072: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-08-31T04:27:09.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:27:09.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:27:09.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:27:09.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:09 smithi163 bash[24253]: cluster 2024-08-31T04:27:08.349852+0000 mgr.a (mgr.14388) 5877 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T04:27:09.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:09 smithi027 bash[22610]: cluster 2024-08-31T04:27:08.349852+0000 mgr.a (mgr.14388) 5877 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T04:27:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:09 smithi191 bash[24992]: cluster 2024-08-31T04:27:08.349852+0000 mgr.a (mgr.14388) 5877 : cluster [DBG] pgmap v4073: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-08-31T04:27:10.373 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:27:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:27:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:27:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:27:10.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:27:11.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:11 smithi163 bash[24253]: audit 2024-08-31T04:27:09.966980+0000 mgr.a (mgr.14388) 5878 : audit [DBG] from='client.136131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:11.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:11 smithi163 bash[24253]: cluster 2024-08-31T04:27:10.350327+0000 mgr.a (mgr.14388) 5879 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:11 smithi027 bash[22610]: audit 2024-08-31T04:27:09.966980+0000 mgr.a (mgr.14388) 5878 : audit [DBG] from='client.136131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:11 smithi027 bash[22610]: cluster 2024-08-31T04:27:10.350327+0000 mgr.a (mgr.14388) 5879 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:11 smithi191 bash[24992]: audit 2024-08-31T04:27:09.966980+0000 mgr.a (mgr.14388) 5878 : audit [DBG] from='client.136131 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:11 smithi191 bash[24992]: cluster 2024-08-31T04:27:10.350327+0000 mgr.a (mgr.14388) 5879 : cluster [DBG] pgmap v4074: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:13.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:13 smithi163 bash[24253]: cluster 2024-08-31T04:27:12.351080+0000 mgr.a (mgr.14388) 5880 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:13 smithi027 bash[22610]: cluster 2024-08-31T04:27:12.351080+0000 mgr.a (mgr.14388) 5880 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:13 smithi191 bash[24992]: cluster 2024-08-31T04:27:12.351080+0000 mgr.a (mgr.14388) 5880 : cluster [DBG] pgmap v4075: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:15.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:27:15.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:27:15.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:27:15.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:15 smithi163 bash[24253]: cluster 2024-08-31T04:27:14.353293+0000 mgr.a (mgr.14388) 5881 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:15.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:15 smithi027 bash[22610]: cluster 2024-08-31T04:27:14.353293+0000 mgr.a (mgr.14388) 5881 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:15 smithi191 bash[24992]: cluster 2024-08-31T04:27:14.353293+0000 mgr.a (mgr.14388) 5881 : cluster [DBG] pgmap v4076: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:16.147 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:27:16.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:27:16.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:27:16.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:27:16.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:27:17.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:17 smithi163 bash[24253]: audit 2024-08-31T04:27:15.711679+0000 mgr.a (mgr.14388) 5882 : audit [DBG] from='client.136206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:17.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:17 smithi163 bash[24253]: cluster 2024-08-31T04:27:16.354241+0000 mgr.a (mgr.14388) 5883 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:17 smithi027 bash[22610]: audit 2024-08-31T04:27:15.711679+0000 mgr.a (mgr.14388) 5882 : audit [DBG] from='client.136206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:17 smithi027 bash[22610]: cluster 2024-08-31T04:27:16.354241+0000 mgr.a (mgr.14388) 5883 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:17 smithi191 bash[24992]: audit 2024-08-31T04:27:15.711679+0000 mgr.a (mgr.14388) 5882 : audit [DBG] from='client.136206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:17 smithi191 bash[24992]: cluster 2024-08-31T04:27:16.354241+0000 mgr.a (mgr.14388) 5883 : cluster [DBG] pgmap v4077: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:19.697 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:19 smithi163 bash[24253]: cluster 2024-08-31T04:27:18.356390+0000 mgr.a (mgr.14388) 5884 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:19 smithi027 bash[22610]: cluster 2024-08-31T04:27:18.356390+0000 mgr.a (mgr.14388) 5884 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:19 smithi191 bash[24992]: cluster 2024-08-31T04:27:18.356390+0000 mgr.a (mgr.14388) 5884 : cluster [DBG] pgmap v4078: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:21.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:27:21.150 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:27:21.150 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:27:21.696 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:21 smithi163 bash[24253]: cluster 2024-08-31T04:27:20.357176+0000 mgr.a (mgr.14388) 5885 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:21.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:21 smithi027 bash[22610]: cluster 2024-08-31T04:27:20.357176+0000 mgr.a (mgr.14388) 5885 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:21 smithi191 bash[24992]: cluster 2024-08-31T04:27:20.357176+0000 mgr.a (mgr.14388) 5885 : cluster [DBG] pgmap v4079: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:21.923 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:27:21.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:27:21.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:27:21.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:27:21.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:27:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:22 smithi027 bash[22610]: audit 2024-08-31T04:27:21.484792+0000 mgr.a (mgr.14388) 5886 : audit [DBG] from='client.136281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:22 smithi191 bash[24992]: audit 2024-08-31T04:27:21.484792+0000 mgr.a (mgr.14388) 5886 : audit [DBG] from='client.136281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:22.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:22 smithi163 bash[24253]: audit 2024-08-31T04:27:21.484792+0000 mgr.a (mgr.14388) 5886 : audit [DBG] from='client.136281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:23 smithi027 bash[22610]: cluster 2024-08-31T04:27:22.358112+0000 mgr.a (mgr.14388) 5887 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:23 smithi191 bash[24992]: cluster 2024-08-31T04:27:22.358112+0000 mgr.a (mgr.14388) 5887 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:23.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:23 smithi163 bash[24253]: cluster 2024-08-31T04:27:22.358112+0000 mgr.a (mgr.14388) 5887 : cluster [DBG] pgmap v4080: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:25 smithi027 bash[22610]: cluster 2024-08-31T04:27:24.360468+0000 mgr.a (mgr.14388) 5888 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:25 smithi191 bash[24992]: cluster 2024-08-31T04:27:24.360468+0000 mgr.a (mgr.14388) 5888 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:25.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:25 smithi163 bash[24253]: cluster 2024-08-31T04:27:24.360468+0000 mgr.a (mgr.14388) 5888 : cluster [DBG] pgmap v4081: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:26.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:27:26.926 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:27:26.926 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:27:27.680 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:27:27.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:27:27.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:27:27.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:27:27.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:27:27.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:27 smithi027 bash[22610]: cluster 2024-08-31T04:27:26.361257+0000 mgr.a (mgr.14388) 5889 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:27 smithi191 bash[24992]: cluster 2024-08-31T04:27:26.361257+0000 mgr.a (mgr.14388) 5889 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:27.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:27 smithi163 bash[24253]: cluster 2024-08-31T04:27:26.361257+0000 mgr.a (mgr.14388) 5889 : cluster [DBG] pgmap v4082: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:28 smithi027 bash[22610]: audit 2024-08-31T04:27:27.253282+0000 mgr.a (mgr.14388) 5890 : audit [DBG] from='client.136359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:28 smithi191 bash[24992]: audit 2024-08-31T04:27:27.253282+0000 mgr.a (mgr.14388) 5890 : audit [DBG] from='client.136359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:28.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:28 smithi163 bash[24253]: audit 2024-08-31T04:27:27.253282+0000 mgr.a (mgr.14388) 5890 : audit [DBG] from='client.136359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:29 smithi027 bash[22610]: cluster 2024-08-31T04:27:28.363521+0000 mgr.a (mgr.14388) 5891 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:29 smithi191 bash[24992]: cluster 2024-08-31T04:27:28.363521+0000 mgr.a (mgr.14388) 5891 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:29.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:29 smithi163 bash[24253]: cluster 2024-08-31T04:27:28.363521+0000 mgr.a (mgr.14388) 5891 : cluster [DBG] pgmap v4083: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:31 smithi027 bash[22610]: cluster 2024-08-31T04:27:30.364293+0000 mgr.a (mgr.14388) 5892 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:31 smithi191 bash[24992]: cluster 2024-08-31T04:27:30.364293+0000 mgr.a (mgr.14388) 5892 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:31.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:31 smithi163 bash[24253]: cluster 2024-08-31T04:27:30.364293+0000 mgr.a (mgr.14388) 5892 : cluster [DBG] pgmap v4084: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:32.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:27:32.683 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:27:32.683 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:27:33.469 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:27:33.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:27:33.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:27:33.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:27:33.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:27:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:33 smithi191 bash[24992]: cluster 2024-08-31T04:27:32.365054+0000 mgr.a (mgr.14388) 5893 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:33.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:33 smithi163 bash[24253]: cluster 2024-08-31T04:27:32.365054+0000 mgr.a (mgr.14388) 5893 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:33.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:33 smithi027 bash[22610]: cluster 2024-08-31T04:27:32.365054+0000 mgr.a (mgr.14388) 5893 : cluster [DBG] pgmap v4085: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:34 smithi191 bash[24992]: audit 2024-08-31T04:27:33.022960+0000 mgr.a (mgr.14388) 5894 : audit [DBG] from='client.136434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:34 smithi191 bash[24992]: audit 2024-08-31T04:27:33.663870+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:27:34.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:34 smithi163 bash[24253]: audit 2024-08-31T04:27:33.022960+0000 mgr.a (mgr.14388) 5894 : audit [DBG] from='client.136434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:34.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:34 smithi163 bash[24253]: audit 2024-08-31T04:27:33.663870+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:27:34.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:34 smithi027 bash[22610]: audit 2024-08-31T04:27:33.022960+0000 mgr.a (mgr.14388) 5894 : audit [DBG] from='client.136434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:34 smithi027 bash[22610]: audit 2024-08-31T04:27:33.663870+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:27:35.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:27:35 smithi027 bash[22863]: debug 2024-08-31T04:27:35.252+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:27:35.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:27:35 smithi027 bash[22863]: debug 2024-08-31T04:27:35.256+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:27:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:35 smithi027 bash[22610]: cluster 2024-08-31T04:27:34.367357+0000 mgr.a (mgr.14388) 5895 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:35 smithi027 bash[22610]: audit 2024-08-31T04:27:34.508150+0000 mon.a (mon.0) 1467 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:27:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:35 smithi027 bash[22610]: audit 2024-08-31T04:27:34.509309+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:27:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:35 smithi027 bash[22610]: audit 2024-08-31T04:27:34.517757+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:27:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:35 smithi027 bash[22610]: audit 2024-08-31T04:27:34.520692+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:27:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:35 smithi027 bash[22610]: audit 2024-08-31T04:27:34.522246+0000 mgr.a (mgr.14388) 5896 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:27:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:35 smithi191 bash[24992]: cluster 2024-08-31T04:27:34.367357+0000 mgr.a (mgr.14388) 5895 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:35 smithi191 bash[24992]: audit 2024-08-31T04:27:34.508150+0000 mon.a (mon.0) 1467 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:27:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:35 smithi191 bash[24992]: audit 2024-08-31T04:27:34.509309+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:27:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:35 smithi191 bash[24992]: audit 2024-08-31T04:27:34.517757+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:27:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:35 smithi191 bash[24992]: audit 2024-08-31T04:27:34.520692+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:27:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:35 smithi191 bash[24992]: audit 2024-08-31T04:27:34.522246+0000 mgr.a (mgr.14388) 5896 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:27:35.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:35 smithi163 bash[24253]: cluster 2024-08-31T04:27:34.367357+0000 mgr.a (mgr.14388) 5895 : cluster [DBG] pgmap v4086: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:35.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:35 smithi163 bash[24253]: audit 2024-08-31T04:27:34.508150+0000 mon.a (mon.0) 1467 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:27:35.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:35 smithi163 bash[24253]: audit 2024-08-31T04:27:34.509309+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:27:35.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:35 smithi163 bash[24253]: audit 2024-08-31T04:27:34.517757+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:27:35.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:35 smithi163 bash[24253]: audit 2024-08-31T04:27:34.520692+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:27:35.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:35 smithi163 bash[24253]: audit 2024-08-31T04:27:34.522246+0000 mgr.a (mgr.14388) 5896 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:27:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:36 smithi191 bash[24992]: audit 2024-08-31T04:27:35.257497+0000 mgr.a (mgr.14388) 5897 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:27:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:36 smithi191 bash[24992]: cephadm 2024-08-31T04:27:35.258895+0000 mgr.a (mgr.14388) 5898 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:27:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:36 smithi163 bash[24253]: audit 2024-08-31T04:27:35.257497+0000 mgr.a (mgr.14388) 5897 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:27:36.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:36 smithi163 bash[24253]: cephadm 2024-08-31T04:27:35.258895+0000 mgr.a (mgr.14388) 5898 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:27:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:36 smithi027 bash[22610]: audit 2024-08-31T04:27:35.257497+0000 mgr.a (mgr.14388) 5897 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:27:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:36 smithi027 bash[22610]: cephadm 2024-08-31T04:27:35.258895+0000 mgr.a (mgr.14388) 5898 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:27:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:37 smithi191 bash[24992]: cluster 2024-08-31T04:27:36.368255+0000 mgr.a (mgr.14388) 5899 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:27:37.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:37 smithi163 bash[24253]: cluster 2024-08-31T04:27:36.368255+0000 mgr.a (mgr.14388) 5899 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:27:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:37 smithi027 bash[22610]: cluster 2024-08-31T04:27:36.368255+0000 mgr.a (mgr.14388) 5899 : cluster [DBG] pgmap v4087: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:27:38.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:27:38.471 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:27:38.471 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:27:39.206 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:27:39.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:27:39.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:27:39.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:27:39.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:27:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:39 smithi191 bash[24992]: cluster 2024-08-31T04:27:38.370429+0000 mgr.a (mgr.14388) 5900 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:39.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:39 smithi163 bash[24253]: cluster 2024-08-31T04:27:38.370429+0000 mgr.a (mgr.14388) 5900 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:39 smithi027 bash[22610]: cluster 2024-08-31T04:27:38.370429+0000 mgr.a (mgr.14388) 5900 : cluster [DBG] pgmap v4088: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:40 smithi191 bash[24992]: audit 2024-08-31T04:27:38.805342+0000 mgr.a (mgr.14388) 5901 : audit [DBG] from='client.136611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:40.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:40 smithi163 bash[24253]: audit 2024-08-31T04:27:38.805342+0000 mgr.a (mgr.14388) 5901 : audit [DBG] from='client.136611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:40 smithi027 bash[22610]: audit 2024-08-31T04:27:38.805342+0000 mgr.a (mgr.14388) 5901 : audit [DBG] from='client.136611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:41 smithi191 bash[24992]: cluster 2024-08-31T04:27:40.371321+0000 mgr.a (mgr.14388) 5902 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:27:41.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:41 smithi163 bash[24253]: cluster 2024-08-31T04:27:40.371321+0000 mgr.a (mgr.14388) 5902 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:27:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:41 smithi027 bash[22610]: cluster 2024-08-31T04:27:40.371321+0000 mgr.a (mgr.14388) 5902 : cluster [DBG] pgmap v4089: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:27:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:43 smithi191 bash[24992]: cluster 2024-08-31T04:27:42.372125+0000 mgr.a (mgr.14388) 5903 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:27:43.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:43 smithi163 bash[24253]: cluster 2024-08-31T04:27:42.372125+0000 mgr.a (mgr.14388) 5903 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:27:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:43 smithi027 bash[22610]: cluster 2024-08-31T04:27:42.372125+0000 mgr.a (mgr.14388) 5903 : cluster [DBG] pgmap v4090: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:27:44.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:27:44.209 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:27:44.209 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:27:44.984 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:27:44.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:27:44.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:27:44.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:27:44.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:27:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:45 smithi191 bash[24992]: cluster 2024-08-31T04:27:44.374295+0000 mgr.a (mgr.14388) 5904 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:45 smithi191 bash[24992]: audit 2024-08-31T04:27:44.544545+0000 mgr.a (mgr.14388) 5905 : audit [DBG] from='client.136689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:45.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:45 smithi163 bash[24253]: cluster 2024-08-31T04:27:44.374295+0000 mgr.a (mgr.14388) 5904 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:45.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:45 smithi163 bash[24253]: audit 2024-08-31T04:27:44.544545+0000 mgr.a (mgr.14388) 5905 : audit [DBG] from='client.136689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:45 smithi027 bash[22610]: cluster 2024-08-31T04:27:44.374295+0000 mgr.a (mgr.14388) 5904 : cluster [DBG] pgmap v4091: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:45 smithi027 bash[22610]: audit 2024-08-31T04:27:44.544545+0000 mgr.a (mgr.14388) 5905 : audit [DBG] from='client.136689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:47 smithi191 bash[24992]: cluster 2024-08-31T04:27:46.375253+0000 mgr.a (mgr.14388) 5906 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:47.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:47 smithi163 bash[24253]: cluster 2024-08-31T04:27:46.375253+0000 mgr.a (mgr.14388) 5906 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:47 smithi027 bash[22610]: cluster 2024-08-31T04:27:46.375253+0000 mgr.a (mgr.14388) 5906 : cluster [DBG] pgmap v4092: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:49.946 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:49 smithi163 bash[24253]: cluster 2024-08-31T04:27:48.377388+0000 mgr.a (mgr.14388) 5907 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:49 smithi027 bash[22610]: cluster 2024-08-31T04:27:48.377388+0000 mgr.a (mgr.14388) 5907 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:50.116 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:49 smithi191 bash[24992]: cluster 2024-08-31T04:27:48.377388+0000 mgr.a (mgr.14388) 5907 : cluster [DBG] pgmap v4093: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:27:50.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:27:50.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:27:50.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:27:50.729 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:27:50.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:27:50.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:27:50.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:27:50.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:27:51.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:51 smithi163 bash[24253]: audit 2024-08-31T04:27:50.317627+0000 mgr.a (mgr.14388) 5908 : audit [DBG] from='client.136761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:51.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:51 smithi163 bash[24253]: cluster 2024-08-31T04:27:50.377955+0000 mgr.a (mgr.14388) 5909 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:51 smithi027 bash[22610]: audit 2024-08-31T04:27:50.317627+0000 mgr.a (mgr.14388) 5908 : audit [DBG] from='client.136761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:51 smithi027 bash[22610]: cluster 2024-08-31T04:27:50.377955+0000 mgr.a (mgr.14388) 5909 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:51 smithi191 bash[24992]: audit 2024-08-31T04:27:50.317627+0000 mgr.a (mgr.14388) 5908 : audit [DBG] from='client.136761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:51 smithi191 bash[24992]: cluster 2024-08-31T04:27:50.377955+0000 mgr.a (mgr.14388) 5909 : cluster [DBG] pgmap v4094: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:53.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:53 smithi163 bash[24253]: cluster 2024-08-31T04:27:52.378871+0000 mgr.a (mgr.14388) 5910 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:53 smithi027 bash[22610]: cluster 2024-08-31T04:27:52.378871+0000 mgr.a (mgr.14388) 5910 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:53 smithi191 bash[24992]: cluster 2024-08-31T04:27:52.378871+0000 mgr.a (mgr.14388) 5910 : cluster [DBG] pgmap v4095: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:55.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:27:55.731 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:27:55.731 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:27:55.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:55 smithi163 bash[24253]: cluster 2024-08-31T04:27:54.381037+0000 mgr.a (mgr.14388) 5911 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:55 smithi027 bash[22610]: cluster 2024-08-31T04:27:54.381037+0000 mgr.a (mgr.14388) 5911 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:55 smithi191 bash[24992]: cluster 2024-08-31T04:27:54.381037+0000 mgr.a (mgr.14388) 5911 : cluster [DBG] pgmap v4096: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:56.489 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:27:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:27:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:27:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:27:56.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:27:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:57 smithi163 bash[24253]: audit 2024-08-31T04:27:56.062092+0000 mgr.a (mgr.14388) 5912 : audit [DBG] from='client.136839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:57 smithi163 bash[24253]: cluster 2024-08-31T04:27:56.390275+0000 mgr.a (mgr.14388) 5913 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:57 smithi027 bash[22610]: audit 2024-08-31T04:27:56.062092+0000 mgr.a (mgr.14388) 5912 : audit [DBG] from='client.136839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:57 smithi027 bash[22610]: cluster 2024-08-31T04:27:56.390275+0000 mgr.a (mgr.14388) 5913 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:57 smithi191 bash[24992]: audit 2024-08-31T04:27:56.062092+0000 mgr.a (mgr.14388) 5912 : audit [DBG] from='client.136839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:27:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:57 smithi191 bash[24992]: cluster 2024-08-31T04:27:56.390275+0000 mgr.a (mgr.14388) 5913 : cluster [DBG] pgmap v4097: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:27:58.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:27:58 smithi163 bash[24253]: cluster 2024-08-31T04:27:58.392682+0000 mgr.a (mgr.14388) 5914 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:27:58 smithi027 bash[22610]: cluster 2024-08-31T04:27:58.392682+0000 mgr.a (mgr.14388) 5914 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:27:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:27:58 smithi191 bash[24992]: cluster 2024-08-31T04:27:58.392682+0000 mgr.a (mgr.14388) 5914 : cluster [DBG] pgmap v4098: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:01.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:01.492 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:01.492 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:01 smithi027 bash[22610]: cluster 2024-08-31T04:28:00.393475+0000 mgr.a (mgr.14388) 5915 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:01 smithi191 bash[24992]: cluster 2024-08-31T04:28:00.393475+0000 mgr.a (mgr.14388) 5915 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:01.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:01 smithi163 bash[24253]: cluster 2024-08-31T04:28:00.393475+0000 mgr.a (mgr.14388) 5915 : cluster [DBG] pgmap v4099: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:02.260 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:02.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:02.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:02.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:02.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:03 smithi027 bash[22610]: audit 2024-08-31T04:28:01.825661+0000 mgr.a (mgr.14388) 5916 : audit [DBG] from='client.136917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:03 smithi027 bash[22610]: cluster 2024-08-31T04:28:02.394346+0000 mgr.a (mgr.14388) 5917 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:03 smithi191 bash[24992]: audit 2024-08-31T04:28:01.825661+0000 mgr.a (mgr.14388) 5916 : audit [DBG] from='client.136917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:03 smithi191 bash[24992]: cluster 2024-08-31T04:28:02.394346+0000 mgr.a (mgr.14388) 5917 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:03.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:03 smithi163 bash[24253]: audit 2024-08-31T04:28:01.825661+0000 mgr.a (mgr.14388) 5916 : audit [DBG] from='client.136917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:03.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:03 smithi163 bash[24253]: cluster 2024-08-31T04:28:02.394346+0000 mgr.a (mgr.14388) 5917 : cluster [DBG] pgmap v4100: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:05 smithi027 bash[22610]: cluster 2024-08-31T04:28:04.396570+0000 mgr.a (mgr.14388) 5918 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:05 smithi191 bash[24992]: cluster 2024-08-31T04:28:04.396570+0000 mgr.a (mgr.14388) 5918 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:05.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:05 smithi163 bash[24253]: cluster 2024-08-31T04:28:04.396570+0000 mgr.a (mgr.14388) 5918 : cluster [DBG] pgmap v4101: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:07.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:07.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:07.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:07.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:07 smithi027 bash[22610]: cluster 2024-08-31T04:28:06.397359+0000 mgr.a (mgr.14388) 5919 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:07 smithi191 bash[24992]: cluster 2024-08-31T04:28:06.397359+0000 mgr.a (mgr.14388) 5919 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:07.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:07 smithi163 bash[24253]: cluster 2024-08-31T04:28:06.397359+0000 mgr.a (mgr.14388) 5919 : cluster [DBG] pgmap v4102: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:08.026 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:08.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:09 smithi027 bash[22610]: audit 2024-08-31T04:28:07.599972+0000 mgr.a (mgr.14388) 5920 : audit [DBG] from='client.136992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:09 smithi027 bash[22610]: cluster 2024-08-31T04:28:08.399814+0000 mgr.a (mgr.14388) 5921 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:28:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:09 smithi191 bash[24992]: audit 2024-08-31T04:28:07.599972+0000 mgr.a (mgr.14388) 5920 : audit [DBG] from='client.136992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:09 smithi191 bash[24992]: cluster 2024-08-31T04:28:08.399814+0000 mgr.a (mgr.14388) 5921 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:28:09.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:09 smithi163 bash[24253]: audit 2024-08-31T04:28:07.599972+0000 mgr.a (mgr.14388) 5920 : audit [DBG] from='client.136992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:09.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:09 smithi163 bash[24253]: cluster 2024-08-31T04:28:08.399814+0000 mgr.a (mgr.14388) 5921 : cluster [DBG] pgmap v4103: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:28:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:11 smithi027 bash[22610]: cluster 2024-08-31T04:28:10.400614+0000 mgr.a (mgr.14388) 5922 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:28:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:11 smithi191 bash[24992]: cluster 2024-08-31T04:28:10.400614+0000 mgr.a (mgr.14388) 5922 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:28:11.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:11 smithi163 bash[24253]: cluster 2024-08-31T04:28:10.400614+0000 mgr.a (mgr.14388) 5922 : cluster [DBG] pgmap v4104: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:28:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:13.028 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:13.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:13.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:13 smithi027 bash[22610]: cluster 2024-08-31T04:28:12.401386+0000 mgr.a (mgr.14388) 5923 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:28:13.784 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:13.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:13.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:13.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:13.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:13 smithi191 bash[24992]: cluster 2024-08-31T04:28:12.401386+0000 mgr.a (mgr.14388) 5923 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:28:13.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:13 smithi163 bash[24253]: cluster 2024-08-31T04:28:12.401386+0000 mgr.a (mgr.14388) 5923 : cluster [DBG] pgmap v4105: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:28:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:14 smithi027 bash[22610]: audit 2024-08-31T04:28:13.362576+0000 mgr.a (mgr.14388) 5924 : audit [DBG] from='client.137067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:14 smithi191 bash[24992]: audit 2024-08-31T04:28:13.362576+0000 mgr.a (mgr.14388) 5924 : audit [DBG] from='client.137067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:14.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:14 smithi163 bash[24253]: audit 2024-08-31T04:28:13.362576+0000 mgr.a (mgr.14388) 5924 : audit [DBG] from='client.137067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:15 smithi191 bash[24992]: cluster 2024-08-31T04:28:14.404257+0000 mgr.a (mgr.14388) 5925 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:15.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:15 smithi163 bash[24253]: cluster 2024-08-31T04:28:14.404257+0000 mgr.a (mgr.14388) 5925 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:15 smithi027 bash[22610]: cluster 2024-08-31T04:28:14.404257+0000 mgr.a (mgr.14388) 5925 : cluster [DBG] pgmap v4106: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:17 smithi191 bash[24992]: cluster 2024-08-31T04:28:16.405200+0000 mgr.a (mgr.14388) 5926 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:28:17.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:17 smithi163 bash[24253]: cluster 2024-08-31T04:28:16.405200+0000 mgr.a (mgr.14388) 5926 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:28:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:17 smithi027 bash[22610]: cluster 2024-08-31T04:28:16.405200+0000 mgr.a (mgr.14388) 5926 : cluster [DBG] pgmap v4107: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:28:18.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:18.788 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:18.788 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:19.542 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:19.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:19.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:19.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:19.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:19 smithi191 bash[24992]: cluster 2024-08-31T04:28:18.407200+0000 mgr.a (mgr.14388) 5927 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:19.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:19 smithi163 bash[24253]: cluster 2024-08-31T04:28:18.407200+0000 mgr.a (mgr.14388) 5927 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:19 smithi027 bash[22610]: cluster 2024-08-31T04:28:18.407200+0000 mgr.a (mgr.14388) 5927 : cluster [DBG] pgmap v4108: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:20 smithi191 bash[24992]: audit 2024-08-31T04:28:19.125210+0000 mgr.a (mgr.14388) 5928 : audit [DBG] from='client.137145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:20.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:20 smithi163 bash[24253]: audit 2024-08-31T04:28:19.125210+0000 mgr.a (mgr.14388) 5928 : audit [DBG] from='client.137145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:20 smithi027 bash[22610]: audit 2024-08-31T04:28:19.125210+0000 mgr.a (mgr.14388) 5928 : audit [DBG] from='client.137145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:21 smithi191 bash[24992]: cluster 2024-08-31T04:28:20.408204+0000 mgr.a (mgr.14388) 5929 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:28:21.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:21 smithi163 bash[24253]: cluster 2024-08-31T04:28:20.408204+0000 mgr.a (mgr.14388) 5929 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:28:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:21 smithi027 bash[22610]: cluster 2024-08-31T04:28:20.408204+0000 mgr.a (mgr.14388) 5929 : cluster [DBG] pgmap v4109: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:28:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:23 smithi191 bash[24992]: cluster 2024-08-31T04:28:22.408977+0000 mgr.a (mgr.14388) 5930 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:28:23.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:23 smithi163 bash[24253]: cluster 2024-08-31T04:28:22.408977+0000 mgr.a (mgr.14388) 5930 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:28:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:23 smithi027 bash[22610]: cluster 2024-08-31T04:28:22.408977+0000 mgr.a (mgr.14388) 5930 : cluster [DBG] pgmap v4110: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:28:24.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:24.545 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:24.545 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:25.316 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:25.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:25.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:25.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:25.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:25 smithi191 bash[24992]: cluster 2024-08-31T04:28:24.411210+0000 mgr.a (mgr.14388) 5931 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:28:25.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:25 smithi163 bash[24253]: cluster 2024-08-31T04:28:24.411210+0000 mgr.a (mgr.14388) 5931 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:28:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:25 smithi027 bash[22610]: cluster 2024-08-31T04:28:24.411210+0000 mgr.a (mgr.14388) 5931 : cluster [DBG] pgmap v4111: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:28:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:26 smithi191 bash[24992]: audit 2024-08-31T04:28:24.882224+0000 mgr.a (mgr.14388) 5932 : audit [DBG] from='client.137223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:26.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:26 smithi163 bash[24253]: audit 2024-08-31T04:28:24.882224+0000 mgr.a (mgr.14388) 5932 : audit [DBG] from='client.137223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:26 smithi027 bash[22610]: audit 2024-08-31T04:28:24.882224+0000 mgr.a (mgr.14388) 5932 : audit [DBG] from='client.137223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:27 smithi191 bash[24992]: cluster 2024-08-31T04:28:26.412167+0000 mgr.a (mgr.14388) 5933 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:27.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:27 smithi163 bash[24253]: cluster 2024-08-31T04:28:26.412167+0000 mgr.a (mgr.14388) 5933 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:27 smithi027 bash[22610]: cluster 2024-08-31T04:28:26.412167+0000 mgr.a (mgr.14388) 5933 : cluster [DBG] pgmap v4112: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:29 smithi191 bash[24992]: cluster 2024-08-31T04:28:28.414356+0000 mgr.a (mgr.14388) 5934 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:29.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:29 smithi163 bash[24253]: cluster 2024-08-31T04:28:28.414356+0000 mgr.a (mgr.14388) 5934 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:29 smithi027 bash[22610]: cluster 2024-08-31T04:28:28.414356+0000 mgr.a (mgr.14388) 5934 : cluster [DBG] pgmap v4113: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:30.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:30.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:30.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:31.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:31.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:31 smithi191 bash[24992]: cluster 2024-08-31T04:28:30.414854+0000 mgr.a (mgr.14388) 5935 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:31.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:31 smithi163 bash[24253]: cluster 2024-08-31T04:28:30.414854+0000 mgr.a (mgr.14388) 5935 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:31 smithi027 bash[22610]: cluster 2024-08-31T04:28:30.414854+0000 mgr.a (mgr.14388) 5935 : cluster [DBG] pgmap v4114: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:32.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:32 smithi163 bash[24253]: audit 2024-08-31T04:28:30.649465+0000 mgr.a (mgr.14388) 5936 : audit [DBG] from='client.137295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:32.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:32 smithi027 bash[22610]: audit 2024-08-31T04:28:30.649465+0000 mgr.a (mgr.14388) 5936 : audit [DBG] from='client.137295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:32 smithi191 bash[24992]: audit 2024-08-31T04:28:30.649465+0000 mgr.a (mgr.14388) 5936 : audit [DBG] from='client.137295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:33.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:33 smithi163 bash[24253]: cluster 2024-08-31T04:28:32.415733+0000 mgr.a (mgr.14388) 5937 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:33 smithi027 bash[22610]: cluster 2024-08-31T04:28:32.415733+0000 mgr.a (mgr.14388) 5937 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:33 smithi191 bash[24992]: cluster 2024-08-31T04:28:32.415733+0000 mgr.a (mgr.14388) 5937 : cluster [DBG] pgmap v4115: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:35.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:35 smithi163 bash[24253]: cluster 2024-08-31T04:28:34.417950+0000 mgr.a (mgr.14388) 5938 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:35.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:35 smithi163 bash[24253]: audit 2024-08-31T04:28:35.311503+0000 mon.a (mon.0) 1471 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:28:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:35 smithi027 bash[22610]: cluster 2024-08-31T04:28:34.417950+0000 mgr.a (mgr.14388) 5938 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:35 smithi027 bash[22610]: audit 2024-08-31T04:28:35.311503+0000 mon.a (mon.0) 1471 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:28:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:35 smithi191 bash[24992]: cluster 2024-08-31T04:28:34.417950+0000 mgr.a (mgr.14388) 5938 : cluster [DBG] pgmap v4116: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:35 smithi191 bash[24992]: audit 2024-08-31T04:28:35.311503+0000 mon.a (mon.0) 1471 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:28:36.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:36.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:36.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:36.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:36.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:36.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:36.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:36.821 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:37.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:37 smithi163 bash[24253]: audit 2024-08-31T04:28:36.398053+0000 mgr.a (mgr.14388) 5939 : audit [DBG] from='client.137373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:37.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:37 smithi163 bash[24253]: cluster 2024-08-31T04:28:36.418757+0000 mgr.a (mgr.14388) 5940 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:37 smithi027 bash[22610]: audit 2024-08-31T04:28:36.398053+0000 mgr.a (mgr.14388) 5939 : audit [DBG] from='client.137373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:37 smithi027 bash[22610]: cluster 2024-08-31T04:28:36.418757+0000 mgr.a (mgr.14388) 5940 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:37 smithi191 bash[24992]: audit 2024-08-31T04:28:36.398053+0000 mgr.a (mgr.14388) 5939 : audit [DBG] from='client.137373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:37 smithi191 bash[24992]: cluster 2024-08-31T04:28:36.418757+0000 mgr.a (mgr.14388) 5940 : cluster [DBG] pgmap v4117: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:39.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:39 smithi163 bash[24253]: cluster 2024-08-31T04:28:38.419997+0000 mgr.a (mgr.14388) 5941 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:39 smithi027 bash[22610]: cluster 2024-08-31T04:28:38.419997+0000 mgr.a (mgr.14388) 5941 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:39 smithi191 bash[24992]: cluster 2024-08-31T04:28:38.419997+0000 mgr.a (mgr.14388) 5941 : cluster [DBG] pgmap v4118: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:28:41.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:41.828 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:41.829 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: cluster 2024-08-31T04:28:40.420756+0000 mgr.a (mgr.14388) 5942 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: audit 2024-08-31T04:28:40.675196+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: audit 2024-08-31T04:28:40.681674+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: audit 2024-08-31T04:28:40.686645+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: audit 2024-08-31T04:28:40.696359+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: audit 2024-08-31T04:28:40.699456+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: audit 2024-08-31T04:28:40.705020+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: audit 2024-08-31T04:28:41.445885+0000 mon.a (mon.0) 1478 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:28:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: audit 2024-08-31T04:28:41.447310+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:28:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: audit 2024-08-31T04:28:41.456260+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:41 smithi163 bash[24253]: audit 2024-08-31T04:28:41.459153+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:28:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: cluster 2024-08-31T04:28:40.420756+0000 mgr.a (mgr.14388) 5942 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: audit 2024-08-31T04:28:40.675196+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: audit 2024-08-31T04:28:40.681674+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: audit 2024-08-31T04:28:40.686645+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: audit 2024-08-31T04:28:40.696359+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: audit 2024-08-31T04:28:40.699456+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: audit 2024-08-31T04:28:40.705020+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: audit 2024-08-31T04:28:41.445885+0000 mon.a (mon.0) 1478 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:28:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: audit 2024-08-31T04:28:41.447310+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:28:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: audit 2024-08-31T04:28:41.456260+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:41 smithi027 bash[22610]: audit 2024-08-31T04:28:41.459153+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:28:42.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: cluster 2024-08-31T04:28:40.420756+0000 mgr.a (mgr.14388) 5942 : cluster [DBG] pgmap v4119: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:42.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: audit 2024-08-31T04:28:40.675196+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:42.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: audit 2024-08-31T04:28:40.681674+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:42.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: audit 2024-08-31T04:28:40.686645+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:42.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: audit 2024-08-31T04:28:40.696359+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:42.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: audit 2024-08-31T04:28:40.699456+0000 mon.a (mon.0) 1476 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:42.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: audit 2024-08-31T04:28:40.705020+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:42.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: audit 2024-08-31T04:28:41.445885+0000 mon.a (mon.0) 1478 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:28:42.042 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: audit 2024-08-31T04:28:41.447310+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:28:42.042 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: audit 2024-08-31T04:28:41.456260+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:28:42.042 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:41 smithi191 bash[24992]: audit 2024-08-31T04:28:41.459153+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:28:42.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:28:42 smithi027 bash[22863]: debug 2024-08-31T04:28:42.167+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:28:42.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:28:42 smithi027 bash[22863]: debug 2024-08-31T04:28:42.179+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:28:42.565 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:42.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:42 smithi163 bash[24253]: audit 2024-08-31T04:28:41.461451+0000 mgr.a (mgr.14388) 5943 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:28:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:42 smithi027 bash[22610]: audit 2024-08-31T04:28:41.461451+0000 mgr.a (mgr.14388) 5943 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:28:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:42 smithi191 bash[24992]: audit 2024-08-31T04:28:41.461451+0000 mgr.a (mgr.14388) 5943 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:28:43.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:43 smithi163 bash[24253]: audit 2024-08-31T04:28:42.150879+0000 mgr.a (mgr.14388) 5944 : audit [DBG] from='client.137520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:43.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:43 smithi163 bash[24253]: audit 2024-08-31T04:28:42.172620+0000 mgr.a (mgr.14388) 5945 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:28:43.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:43 smithi163 bash[24253]: cephadm 2024-08-31T04:28:42.183437+0000 mgr.a (mgr.14388) 5946 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:28:43.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:43 smithi163 bash[24253]: cluster 2024-08-31T04:28:42.421246+0000 mgr.a (mgr.14388) 5947 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:43 smithi027 bash[22610]: audit 2024-08-31T04:28:42.150879+0000 mgr.a (mgr.14388) 5944 : audit [DBG] from='client.137520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:43 smithi027 bash[22610]: audit 2024-08-31T04:28:42.172620+0000 mgr.a (mgr.14388) 5945 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:28:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:43 smithi027 bash[22610]: cephadm 2024-08-31T04:28:42.183437+0000 mgr.a (mgr.14388) 5946 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:28:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:43 smithi027 bash[22610]: cluster 2024-08-31T04:28:42.421246+0000 mgr.a (mgr.14388) 5947 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:43 smithi191 bash[24992]: audit 2024-08-31T04:28:42.150879+0000 mgr.a (mgr.14388) 5944 : audit [DBG] from='client.137520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:43 smithi191 bash[24992]: audit 2024-08-31T04:28:42.172620+0000 mgr.a (mgr.14388) 5945 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:28:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:43 smithi191 bash[24992]: cephadm 2024-08-31T04:28:42.183437+0000 mgr.a (mgr.14388) 5946 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:28:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:43 smithi191 bash[24992]: cluster 2024-08-31T04:28:42.421246+0000 mgr.a (mgr.14388) 5947 : cluster [DBG] pgmap v4120: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:44.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:44 smithi163 bash[24253]: cluster 2024-08-31T04:28:44.423530+0000 mgr.a (mgr.14388) 5948 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:44.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:44 smithi027 bash[22610]: cluster 2024-08-31T04:28:44.423530+0000 mgr.a (mgr.14388) 5948 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:44 smithi191 bash[24992]: cluster 2024-08-31T04:28:44.423530+0000 mgr.a (mgr.14388) 5948 : cluster [DBG] pgmap v4121: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:47.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:47.568 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:47.568 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:47 smithi027 bash[22610]: cluster 2024-08-31T04:28:46.424317+0000 mgr.a (mgr.14388) 5949 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:47 smithi191 bash[24992]: cluster 2024-08-31T04:28:46.424317+0000 mgr.a (mgr.14388) 5949 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:47.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:47 smithi163 bash[24253]: cluster 2024-08-31T04:28:46.424317+0000 mgr.a (mgr.14388) 5949 : cluster [DBG] pgmap v4122: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:48.346 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:48.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:49 smithi191 bash[24992]: audit 2024-08-31T04:28:47.906407+0000 mgr.a (mgr.14388) 5950 : audit [DBG] from='client.137631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:49 smithi191 bash[24992]: cluster 2024-08-31T04:28:48.427148+0000 mgr.a (mgr.14388) 5951 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:49.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:49 smithi163 bash[24253]: audit 2024-08-31T04:28:47.906407+0000 mgr.a (mgr.14388) 5950 : audit [DBG] from='client.137631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:49.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:49 smithi163 bash[24253]: cluster 2024-08-31T04:28:48.427148+0000 mgr.a (mgr.14388) 5951 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:49 smithi027 bash[22610]: audit 2024-08-31T04:28:47.906407+0000 mgr.a (mgr.14388) 5950 : audit [DBG] from='client.137631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:49 smithi027 bash[22610]: cluster 2024-08-31T04:28:48.427148+0000 mgr.a (mgr.14388) 5951 : cluster [DBG] pgmap v4123: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:51 smithi191 bash[24992]: cluster 2024-08-31T04:28:50.427882+0000 mgr.a (mgr.14388) 5952 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:28:51.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:51 smithi163 bash[24253]: cluster 2024-08-31T04:28:50.427882+0000 mgr.a (mgr.14388) 5952 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:28:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:51 smithi027 bash[22610]: cluster 2024-08-31T04:28:50.427882+0000 mgr.a (mgr.14388) 5952 : cluster [DBG] pgmap v4124: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:28:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:53.348 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:53 smithi191 bash[24992]: cluster 2024-08-31T04:28:52.428662+0000 mgr.a (mgr.14388) 5953 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:28:53.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:53 smithi163 bash[24253]: cluster 2024-08-31T04:28:52.428662+0000 mgr.a (mgr.14388) 5953 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:28:53.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:53 smithi027 bash[22610]: cluster 2024-08-31T04:28:52.428662+0000 mgr.a (mgr.14388) 5953 : cluster [DBG] pgmap v4125: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:28:54.095 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:54.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:54.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:54.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:54.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:55 smithi191 bash[24992]: audit 2024-08-31T04:28:53.679346+0000 mgr.a (mgr.14388) 5954 : audit [DBG] from='client.137709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:55 smithi191 bash[24992]: cluster 2024-08-31T04:28:54.431326+0000 mgr.a (mgr.14388) 5955 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:55.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:55 smithi163 bash[24253]: audit 2024-08-31T04:28:53.679346+0000 mgr.a (mgr.14388) 5954 : audit [DBG] from='client.137709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:55.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:55 smithi163 bash[24253]: cluster 2024-08-31T04:28:54.431326+0000 mgr.a (mgr.14388) 5955 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:55 smithi027 bash[22610]: audit 2024-08-31T04:28:53.679346+0000 mgr.a (mgr.14388) 5954 : audit [DBG] from='client.137709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:28:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:55 smithi027 bash[22610]: cluster 2024-08-31T04:28:54.431326+0000 mgr.a (mgr.14388) 5955 : cluster [DBG] pgmap v4126: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:28:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:57 smithi191 bash[24992]: cluster 2024-08-31T04:28:56.432152+0000 mgr.a (mgr.14388) 5956 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:28:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:57 smithi163 bash[24253]: cluster 2024-08-31T04:28:56.432152+0000 mgr.a (mgr.14388) 5956 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:28:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:57 smithi027 bash[22610]: cluster 2024-08-31T04:28:56.432152+0000 mgr.a (mgr.14388) 5956 : cluster [DBG] pgmap v4127: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:28:59.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:28:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:28:59.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:28:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:28:59 smithi191 bash[24992]: cluster 2024-08-31T04:28:58.434051+0000 mgr.a (mgr.14388) 5957 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:59.881 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:28:59.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:28:59.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:28:59.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:28:59.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:28:59.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:28:59 smithi163 bash[24253]: cluster 2024-08-31T04:28:58.434051+0000 mgr.a (mgr.14388) 5957 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:28:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:28:59 smithi027 bash[22610]: cluster 2024-08-31T04:28:58.434051+0000 mgr.a (mgr.14388) 5957 : cluster [DBG] pgmap v4128: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:00 smithi191 bash[24992]: audit 2024-08-31T04:28:59.435280+0000 mgr.a (mgr.14388) 5958 : audit [DBG] from='client.137784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:00.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:00 smithi163 bash[24253]: audit 2024-08-31T04:28:59.435280+0000 mgr.a (mgr.14388) 5958 : audit [DBG] from='client.137784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:00 smithi027 bash[22610]: audit 2024-08-31T04:28:59.435280+0000 mgr.a (mgr.14388) 5958 : audit [DBG] from='client.137784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:01 smithi191 bash[24992]: cluster 2024-08-31T04:29:00.435041+0000 mgr.a (mgr.14388) 5959 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:01.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:01 smithi163 bash[24253]: cluster 2024-08-31T04:29:00.435041+0000 mgr.a (mgr.14388) 5959 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:01 smithi027 bash[22610]: cluster 2024-08-31T04:29:00.435041+0000 mgr.a (mgr.14388) 5959 : cluster [DBG] pgmap v4129: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:03 smithi191 bash[24992]: cluster 2024-08-31T04:29:02.435822+0000 mgr.a (mgr.14388) 5960 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:03.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:03 smithi163 bash[24253]: cluster 2024-08-31T04:29:02.435822+0000 mgr.a (mgr.14388) 5960 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:03 smithi027 bash[22610]: cluster 2024-08-31T04:29:02.435822+0000 mgr.a (mgr.14388) 5960 : cluster [DBG] pgmap v4130: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:04.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:29:04.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:29:04.884 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:29:05.656 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:29:05.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:29:05.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:29:05.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:29:05.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:29:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:05 smithi191 bash[24992]: cluster 2024-08-31T04:29:04.438006+0000 mgr.a (mgr.14388) 5961 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:05.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:05 smithi163 bash[24253]: cluster 2024-08-31T04:29:04.438006+0000 mgr.a (mgr.14388) 5961 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:05 smithi027 bash[22610]: cluster 2024-08-31T04:29:04.438006+0000 mgr.a (mgr.14388) 5961 : cluster [DBG] pgmap v4131: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:06 smithi191 bash[24992]: audit 2024-08-31T04:29:05.218708+0000 mgr.a (mgr.14388) 5962 : audit [DBG] from='client.137859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:06.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:06 smithi163 bash[24253]: audit 2024-08-31T04:29:05.218708+0000 mgr.a (mgr.14388) 5962 : audit [DBG] from='client.137859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:06 smithi027 bash[22610]: audit 2024-08-31T04:29:05.218708+0000 mgr.a (mgr.14388) 5962 : audit [DBG] from='client.137859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:07 smithi191 bash[24992]: cluster 2024-08-31T04:29:06.438988+0000 mgr.a (mgr.14388) 5963 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:07.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:07 smithi163 bash[24253]: cluster 2024-08-31T04:29:06.438988+0000 mgr.a (mgr.14388) 5963 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:07 smithi027 bash[22610]: cluster 2024-08-31T04:29:06.438988+0000 mgr.a (mgr.14388) 5963 : cluster [DBG] pgmap v4132: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:09.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:09 smithi163 bash[24253]: cluster 2024-08-31T04:29:08.441108+0000 mgr.a (mgr.14388) 5964 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:09 smithi027 bash[22610]: cluster 2024-08-31T04:29:08.441108+0000 mgr.a (mgr.14388) 5964 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:09 smithi191 bash[24992]: cluster 2024-08-31T04:29:08.441108+0000 mgr.a (mgr.14388) 5964 : cluster [DBG] pgmap v4133: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:10.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:29:10.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:29:10.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:29:11.415 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:29:11.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:29:11.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:29:11.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:29:11.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:29:11.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:11 smithi163 bash[24253]: cluster 2024-08-31T04:29:10.441870+0000 mgr.a (mgr.14388) 5965 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:11 smithi027 bash[22610]: cluster 2024-08-31T04:29:10.441870+0000 mgr.a (mgr.14388) 5965 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:11 smithi191 bash[24992]: cluster 2024-08-31T04:29:10.441870+0000 mgr.a (mgr.14388) 5965 : cluster [DBG] pgmap v4134: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:12.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:12 smithi163 bash[24253]: audit 2024-08-31T04:29:10.991724+0000 mgr.a (mgr.14388) 5966 : audit [DBG] from='client.137937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:12 smithi027 bash[22610]: audit 2024-08-31T04:29:10.991724+0000 mgr.a (mgr.14388) 5966 : audit [DBG] from='client.137937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:12 smithi191 bash[24992]: audit 2024-08-31T04:29:10.991724+0000 mgr.a (mgr.14388) 5966 : audit [DBG] from='client.137937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:13.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:13 smithi163 bash[24253]: cluster 2024-08-31T04:29:12.443007+0000 mgr.a (mgr.14388) 5967 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:13 smithi027 bash[22610]: cluster 2024-08-31T04:29:12.443007+0000 mgr.a (mgr.14388) 5967 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:13 smithi191 bash[24992]: cluster 2024-08-31T04:29:12.443007+0000 mgr.a (mgr.14388) 5967 : cluster [DBG] pgmap v4135: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:15.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:15 smithi163 bash[24253]: cluster 2024-08-31T04:29:14.445322+0000 mgr.a (mgr.14388) 5968 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:15 smithi027 bash[22610]: cluster 2024-08-31T04:29:14.445322+0000 mgr.a (mgr.14388) 5968 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:15 smithi191 bash[24992]: cluster 2024-08-31T04:29:14.445322+0000 mgr.a (mgr.14388) 5968 : cluster [DBG] pgmap v4136: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:16.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:29:16.417 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:29:16.417 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:29:17.201 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:29:17.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:29:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:29:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:29:17.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:29:17.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:17 smithi163 bash[24253]: cluster 2024-08-31T04:29:16.445979+0000 mgr.a (mgr.14388) 5969 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:17 smithi027 bash[22610]: cluster 2024-08-31T04:29:16.445979+0000 mgr.a (mgr.14388) 5969 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:17 smithi191 bash[24992]: cluster 2024-08-31T04:29:16.445979+0000 mgr.a (mgr.14388) 5969 : cluster [DBG] pgmap v4137: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:18.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:18 smithi163 bash[24253]: audit 2024-08-31T04:29:16.759127+0000 mgr.a (mgr.14388) 5970 : audit [DBG] from='client.138009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:18 smithi027 bash[22610]: audit 2024-08-31T04:29:16.759127+0000 mgr.a (mgr.14388) 5970 : audit [DBG] from='client.138009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:18 smithi191 bash[24992]: audit 2024-08-31T04:29:16.759127+0000 mgr.a (mgr.14388) 5970 : audit [DBG] from='client.138009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:19.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:19 smithi163 bash[24253]: cluster 2024-08-31T04:29:18.448247+0000 mgr.a (mgr.14388) 5971 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:19 smithi027 bash[22610]: cluster 2024-08-31T04:29:18.448247+0000 mgr.a (mgr.14388) 5971 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:19 smithi191 bash[24992]: cluster 2024-08-31T04:29:18.448247+0000 mgr.a (mgr.14388) 5971 : cluster [DBG] pgmap v4138: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:21.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:21 smithi163 bash[24253]: cluster 2024-08-31T04:29:20.449065+0000 mgr.a (mgr.14388) 5972 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:21 smithi027 bash[22610]: cluster 2024-08-31T04:29:20.449065+0000 mgr.a (mgr.14388) 5972 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:21 smithi191 bash[24992]: cluster 2024-08-31T04:29:20.449065+0000 mgr.a (mgr.14388) 5972 : cluster [DBG] pgmap v4139: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:22.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:29:22.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:29:22.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:29:22.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:29:22.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:29:22.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:29:22.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:29:22.948 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:29:23.197 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:22 smithi163 bash[24253]: cluster 2024-08-31T04:29:22.449786+0000 mgr.a (mgr.14388) 5973 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:23.198 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:22 smithi163 bash[24253]: audit 2024-08-31T04:29:22.533425+0000 mgr.a (mgr.14388) 5974 : audit [DBG] from='client.138087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:22 smithi027 bash[22610]: cluster 2024-08-31T04:29:22.449786+0000 mgr.a (mgr.14388) 5973 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:22 smithi027 bash[22610]: audit 2024-08-31T04:29:22.533425+0000 mgr.a (mgr.14388) 5974 : audit [DBG] from='client.138087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:22 smithi191 bash[24992]: cluster 2024-08-31T04:29:22.449786+0000 mgr.a (mgr.14388) 5973 : cluster [DBG] pgmap v4140: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:22 smithi191 bash[24992]: audit 2024-08-31T04:29:22.533425+0000 mgr.a (mgr.14388) 5974 : audit [DBG] from='client.138087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:25 smithi191 bash[24992]: cluster 2024-08-31T04:29:24.452123+0000 mgr.a (mgr.14388) 5975 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:29:25.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:25 smithi163 bash[24253]: cluster 2024-08-31T04:29:24.452123+0000 mgr.a (mgr.14388) 5975 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:29:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:25 smithi027 bash[22610]: cluster 2024-08-31T04:29:24.452123+0000 mgr.a (mgr.14388) 5975 : cluster [DBG] pgmap v4141: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:29:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:27 smithi191 bash[24992]: cluster 2024-08-31T04:29:26.452915+0000 mgr.a (mgr.14388) 5976 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:29:27.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:27 smithi163 bash[24253]: cluster 2024-08-31T04:29:26.452915+0000 mgr.a (mgr.14388) 5976 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:29:27.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:29:27.949 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:29:27.950 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:29:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:27 smithi027 bash[22610]: cluster 2024-08-31T04:29:26.452915+0000 mgr.a (mgr.14388) 5976 : cluster [DBG] pgmap v4142: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:29:28.721 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:29:28.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:29:28.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:29:28.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:29:28.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:29:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:29 smithi191 bash[24992]: audit 2024-08-31T04:29:28.286418+0000 mgr.a (mgr.14388) 5977 : audit [DBG] from='client.138162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:29 smithi191 bash[24992]: cluster 2024-08-31T04:29:28.455730+0000 mgr.a (mgr.14388) 5978 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:29.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:29 smithi163 bash[24253]: audit 2024-08-31T04:29:28.286418+0000 mgr.a (mgr.14388) 5977 : audit [DBG] from='client.138162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:29.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:29 smithi163 bash[24253]: cluster 2024-08-31T04:29:28.455730+0000 mgr.a (mgr.14388) 5978 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:29 smithi027 bash[22610]: audit 2024-08-31T04:29:28.286418+0000 mgr.a (mgr.14388) 5977 : audit [DBG] from='client.138162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:29 smithi027 bash[22610]: cluster 2024-08-31T04:29:28.455730+0000 mgr.a (mgr.14388) 5978 : cluster [DBG] pgmap v4143: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:31 smithi191 bash[24992]: cluster 2024-08-31T04:29:30.456642+0000 mgr.a (mgr.14388) 5979 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:29:31.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:31 smithi163 bash[24253]: cluster 2024-08-31T04:29:30.456642+0000 mgr.a (mgr.14388) 5979 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:29:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:31 smithi027 bash[22610]: cluster 2024-08-31T04:29:30.456642+0000 mgr.a (mgr.14388) 5979 : cluster [DBG] pgmap v4144: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:29:33.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:29:33.723 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:29:33.724 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:29:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:33 smithi191 bash[24992]: cluster 2024-08-31T04:29:32.457411+0000 mgr.a (mgr.14388) 5980 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:29:33.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:33 smithi163 bash[24253]: cluster 2024-08-31T04:29:32.457411+0000 mgr.a (mgr.14388) 5980 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:29:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:33 smithi027 bash[22610]: cluster 2024-08-31T04:29:32.457411+0000 mgr.a (mgr.14388) 5980 : cluster [DBG] pgmap v4145: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:29:34.495 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:29:34.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:29:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:29:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:29:34.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:29:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:35 smithi191 bash[24992]: audit 2024-08-31T04:29:34.060010+0000 mgr.a (mgr.14388) 5981 : audit [DBG] from='client.138240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:35 smithi191 bash[24992]: cluster 2024-08-31T04:29:34.458988+0000 mgr.a (mgr.14388) 5982 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:35.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:35 smithi163 bash[24253]: audit 2024-08-31T04:29:34.060010+0000 mgr.a (mgr.14388) 5981 : audit [DBG] from='client.138240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:35.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:35 smithi163 bash[24253]: cluster 2024-08-31T04:29:34.458988+0000 mgr.a (mgr.14388) 5982 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:35 smithi027 bash[22610]: audit 2024-08-31T04:29:34.060010+0000 mgr.a (mgr.14388) 5981 : audit [DBG] from='client.138240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:35 smithi027 bash[22610]: cluster 2024-08-31T04:29:34.458988+0000 mgr.a (mgr.14388) 5982 : cluster [DBG] pgmap v4146: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:37 smithi191 bash[24992]: cluster 2024-08-31T04:29:36.459727+0000 mgr.a (mgr.14388) 5983 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:29:37.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:37 smithi163 bash[24253]: cluster 2024-08-31T04:29:36.459727+0000 mgr.a (mgr.14388) 5983 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:29:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:37 smithi027 bash[22610]: cluster 2024-08-31T04:29:36.459727+0000 mgr.a (mgr.14388) 5983 : cluster [DBG] pgmap v4147: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:29:39.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:29:39.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:29:39.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:29:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:39 smithi191 bash[24992]: cluster 2024-08-31T04:29:38.461666+0000 mgr.a (mgr.14388) 5984 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:29:39.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:39 smithi163 bash[24253]: cluster 2024-08-31T04:29:38.461666+0000 mgr.a (mgr.14388) 5984 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:29:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:39 smithi027 bash[22610]: cluster 2024-08-31T04:29:38.461666+0000 mgr.a (mgr.14388) 5984 : cluster [DBG] pgmap v4148: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:29:40.276 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:29:40.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:29:40.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:29:40.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:29:40.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:29:41.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:41 smithi163 bash[24253]: audit 2024-08-31T04:29:39.836980+0000 mgr.a (mgr.14388) 5985 : audit [DBG] from='client.138318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:41.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:41 smithi163 bash[24253]: cluster 2024-08-31T04:29:40.462606+0000 mgr.a (mgr.14388) 5986 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:41 smithi027 bash[22610]: audit 2024-08-31T04:29:39.836980+0000 mgr.a (mgr.14388) 5985 : audit [DBG] from='client.138318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:41 smithi027 bash[22610]: cluster 2024-08-31T04:29:40.462606+0000 mgr.a (mgr.14388) 5986 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:41 smithi191 bash[24992]: audit 2024-08-31T04:29:39.836980+0000 mgr.a (mgr.14388) 5985 : audit [DBG] from='client.138318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:41 smithi191 bash[24992]: cluster 2024-08-31T04:29:40.462606+0000 mgr.a (mgr.14388) 5986 : cluster [DBG] pgmap v4149: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:42.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:42 smithi163 bash[24253]: audit 2024-08-31T04:29:42.237190+0000 mon.a (mon.0) 1482 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:29:42.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:42 smithi027 bash[22610]: audit 2024-08-31T04:29:42.237190+0000 mon.a (mon.0) 1482 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:29:43.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:42 smithi191 bash[24992]: audit 2024-08-31T04:29:42.237190+0000 mon.a (mon.0) 1482 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:29:43.814 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:43 smithi027 bash[22610]: cluster 2024-08-31T04:29:42.463332+0000 mgr.a (mgr.14388) 5987 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:43.814 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:43 smithi027 bash[22610]: audit 2024-08-31T04:29:43.081861+0000 mon.a (mon.0) 1483 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:29:43.814 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:43 smithi027 bash[22610]: audit 2024-08-31T04:29:43.083320+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:29:43.814 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:43 smithi027 bash[22610]: audit 2024-08-31T04:29:43.093169+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:29:43.814 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:43 smithi027 bash[22610]: audit 2024-08-31T04:29:43.097916+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:29:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:43 smithi163 bash[24253]: cluster 2024-08-31T04:29:42.463332+0000 mgr.a (mgr.14388) 5987 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:43 smithi163 bash[24253]: audit 2024-08-31T04:29:43.081861+0000 mon.a (mon.0) 1483 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:29:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:43 smithi163 bash[24253]: audit 2024-08-31T04:29:43.083320+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:29:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:43 smithi163 bash[24253]: audit 2024-08-31T04:29:43.093169+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:29:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:43 smithi163 bash[24253]: audit 2024-08-31T04:29:43.097916+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:29:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:43 smithi191 bash[24992]: cluster 2024-08-31T04:29:42.463332+0000 mgr.a (mgr.14388) 5987 : cluster [DBG] pgmap v4150: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:43 smithi191 bash[24992]: audit 2024-08-31T04:29:43.081861+0000 mon.a (mon.0) 1483 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:29:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:43 smithi191 bash[24992]: audit 2024-08-31T04:29:43.083320+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:29:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:43 smithi191 bash[24992]: audit 2024-08-31T04:29:43.093169+0000 mon.a (mon.0) 1485 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:29:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:43 smithi191 bash[24992]: audit 2024-08-31T04:29:43.097916+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:29:44.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:29:43 smithi027 bash[22863]: debug 2024-08-31T04:29:43.813+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:29:44.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:29:43 smithi027 bash[22863]: debug 2024-08-31T04:29:43.813+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:29:44.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:44 smithi163 bash[24253]: audit 2024-08-31T04:29:43.098918+0000 mgr.a (mgr.14388) 5988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:29:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:44 smithi027 bash[22610]: audit 2024-08-31T04:29:43.098918+0000 mgr.a (mgr.14388) 5988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:29:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:44 smithi191 bash[24992]: audit 2024-08-31T04:29:43.098918+0000 mgr.a (mgr.14388) 5988 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:29:45.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:29:45.278 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:29:45.278 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:29:45.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:45 smithi163 bash[24253]: audit 2024-08-31T04:29:43.815112+0000 mgr.a (mgr.14388) 5989 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:29:45.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:45 smithi163 bash[24253]: cephadm 2024-08-31T04:29:43.816369+0000 mgr.a (mgr.14388) 5990 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:29:45.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:45 smithi163 bash[24253]: cluster 2024-08-31T04:29:44.466050+0000 mgr.a (mgr.14388) 5991 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:45 smithi027 bash[22610]: audit 2024-08-31T04:29:43.815112+0000 mgr.a (mgr.14388) 5989 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:29:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:45 smithi027 bash[22610]: cephadm 2024-08-31T04:29:43.816369+0000 mgr.a (mgr.14388) 5990 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:29:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:45 smithi027 bash[22610]: cluster 2024-08-31T04:29:44.466050+0000 mgr.a (mgr.14388) 5991 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:46.035 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:29:46.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:29:46.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:29:46.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:29:46.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:29:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:45 smithi191 bash[24992]: audit 2024-08-31T04:29:43.815112+0000 mgr.a (mgr.14388) 5989 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:29:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:45 smithi191 bash[24992]: cephadm 2024-08-31T04:29:43.816369+0000 mgr.a (mgr.14388) 5990 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:29:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:45 smithi191 bash[24992]: cluster 2024-08-31T04:29:44.466050+0000 mgr.a (mgr.14388) 5991 : cluster [DBG] pgmap v4151: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:29:47.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:47 smithi163 bash[24253]: audit 2024-08-31T04:29:45.613581+0000 mgr.a (mgr.14388) 5992 : audit [DBG] from='client.138504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:47.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:47 smithi163 bash[24253]: cluster 2024-08-31T04:29:46.467106+0000 mgr.a (mgr.14388) 5993 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:47 smithi027 bash[22610]: audit 2024-08-31T04:29:45.613581+0000 mgr.a (mgr.14388) 5992 : audit [DBG] from='client.138504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:47 smithi027 bash[22610]: cluster 2024-08-31T04:29:46.467106+0000 mgr.a (mgr.14388) 5993 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:47 smithi191 bash[24992]: audit 2024-08-31T04:29:45.613581+0000 mgr.a (mgr.14388) 5992 : audit [DBG] from='client.138504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:47 smithi191 bash[24992]: cluster 2024-08-31T04:29:46.467106+0000 mgr.a (mgr.14388) 5993 : cluster [DBG] pgmap v4152: 225 pgs: 225 active+clean; 589 KiB data, 111 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:29:49.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:49 smithi163 bash[24253]: cluster 2024-08-31T04:29:48.469254+0000 mgr.a (mgr.14388) 5994 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:49 smithi027 bash[22610]: cluster 2024-08-31T04:29:48.469254+0000 mgr.a (mgr.14388) 5994 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:49 smithi191 bash[24992]: cluster 2024-08-31T04:29:48.469254+0000 mgr.a (mgr.14388) 5994 : cluster [DBG] pgmap v4153: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:51.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:29:51.037 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:29:51.037 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:29:51.808 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:29:51.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:29:51.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:29:51.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:29:51.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:29:51.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:51 smithi163 bash[24253]: cluster 2024-08-31T04:29:50.470040+0000 mgr.a (mgr.14388) 5995 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:51 smithi027 bash[22610]: cluster 2024-08-31T04:29:50.470040+0000 mgr.a (mgr.14388) 5995 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:51 smithi191 bash[24992]: cluster 2024-08-31T04:29:50.470040+0000 mgr.a (mgr.14388) 5995 : cluster [DBG] pgmap v4154: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:52.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:52 smithi163 bash[24253]: audit 2024-08-31T04:29:51.367233+0000 mgr.a (mgr.14388) 5996 : audit [DBG] from='client.138579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:52 smithi027 bash[22610]: audit 2024-08-31T04:29:51.367233+0000 mgr.a (mgr.14388) 5996 : audit [DBG] from='client.138579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:52 smithi191 bash[24992]: audit 2024-08-31T04:29:51.367233+0000 mgr.a (mgr.14388) 5996 : audit [DBG] from='client.138579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:53.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:53 smithi163 bash[24253]: cluster 2024-08-31T04:29:52.471017+0000 mgr.a (mgr.14388) 5997 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:53 smithi027 bash[22610]: cluster 2024-08-31T04:29:52.471017+0000 mgr.a (mgr.14388) 5997 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:53 smithi191 bash[24992]: cluster 2024-08-31T04:29:52.471017+0000 mgr.a (mgr.14388) 5997 : cluster [DBG] pgmap v4155: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:55.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:55 smithi163 bash[24253]: cluster 2024-08-31T04:29:54.473343+0000 mgr.a (mgr.14388) 5998 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:55 smithi027 bash[22610]: cluster 2024-08-31T04:29:54.473343+0000 mgr.a (mgr.14388) 5998 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:55 smithi191 bash[24992]: cluster 2024-08-31T04:29:54.473343+0000 mgr.a (mgr.14388) 5998 : cluster [DBG] pgmap v4156: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:56.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:29:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:29:56.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:29:56.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:56 smithi163 bash[24253]: cluster 2024-08-31T04:29:56.474266+0000 mgr.a (mgr.14388) 5999 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:56 smithi027 bash[22610]: cluster 2024-08-31T04:29:56.474266+0000 mgr.a (mgr.14388) 5999 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:56 smithi191 bash[24992]: cluster 2024-08-31T04:29:56.474266+0000 mgr.a (mgr.14388) 5999 : cluster [DBG] pgmap v4157: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:57.565 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:29:57.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:29:57.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:29:57.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:29:57.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:29:57.947 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:57 smithi163 bash[24253]: audit 2024-08-31T04:29:57.144872+0000 mgr.a (mgr.14388) 6000 : audit [DBG] from='client.138657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:57 smithi027 bash[22610]: audit 2024-08-31T04:29:57.144872+0000 mgr.a (mgr.14388) 6000 : audit [DBG] from='client.138657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:57 smithi191 bash[24992]: audit 2024-08-31T04:29:57.144872+0000 mgr.a (mgr.14388) 6000 : audit [DBG] from='client.138657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:29:58.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:29:58 smithi163 bash[24253]: cluster 2024-08-31T04:29:58.476533+0000 mgr.a (mgr.14388) 6001 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:29:58 smithi027 bash[22610]: cluster 2024-08-31T04:29:58.476533+0000 mgr.a (mgr.14388) 6001 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:29:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:29:58 smithi191 bash[24992]: cluster 2024-08-31T04:29:58.476533+0000 mgr.a (mgr.14388) 6001 : cluster [DBG] pgmap v4158: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:00.447 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:00 smithi163 bash[24253]: cluster 2024-08-31T04:30:00.000163+0000 mon.a (mon.0) 1487 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:30:00.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:00 smithi027 bash[22610]: cluster 2024-08-31T04:30:00.000163+0000 mon.a (mon.0) 1487 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:30:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:00 smithi191 bash[24992]: cluster 2024-08-31T04:30:00.000163+0000 mon.a (mon.0) 1487 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:30:01.448 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:01 smithi163 bash[24253]: cluster 2024-08-31T04:30:00.477292+0000 mgr.a (mgr.14388) 6002 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:01 smithi027 bash[22610]: cluster 2024-08-31T04:30:00.477292+0000 mgr.a (mgr.14388) 6002 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:01 smithi191 bash[24992]: cluster 2024-08-31T04:30:00.477292+0000 mgr.a (mgr.14388) 6002 : cluster [DBG] pgmap v4159: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:02.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:30:02.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:30:02.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:30:03.343 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:30:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:30:03.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:30:03.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:30:03.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:30:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:03 smithi191 bash[24992]: cluster 2024-08-31T04:30:02.478031+0000 mgr.a (mgr.14388) 6003 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:03.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:03 smithi163 bash[24253]: cluster 2024-08-31T04:30:02.478031+0000 mgr.a (mgr.14388) 6003 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:03 smithi027 bash[22610]: cluster 2024-08-31T04:30:02.478031+0000 mgr.a (mgr.14388) 6003 : cluster [DBG] pgmap v4160: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:04.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:04 smithi163 bash[24253]: audit 2024-08-31T04:30:02.908253+0000 mgr.a (mgr.14388) 6004 : audit [DBG] from='client.138735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:04 smithi027 bash[22610]: audit 2024-08-31T04:30:02.908253+0000 mgr.a (mgr.14388) 6004 : audit [DBG] from='client.138735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:04 smithi191 bash[24992]: audit 2024-08-31T04:30:02.908253+0000 mgr.a (mgr.14388) 6004 : audit [DBG] from='client.138735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:05.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:05 smithi163 bash[24253]: cluster 2024-08-31T04:30:04.480836+0000 mgr.a (mgr.14388) 6005 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:05 smithi027 bash[22610]: cluster 2024-08-31T04:30:04.480836+0000 mgr.a (mgr.14388) 6005 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:05 smithi191 bash[24992]: cluster 2024-08-31T04:30:04.480836+0000 mgr.a (mgr.14388) 6005 : cluster [DBG] pgmap v4161: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:07.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:07 smithi163 bash[24253]: cluster 2024-08-31T04:30:06.481638+0000 mgr.a (mgr.14388) 6006 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:30:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:07 smithi027 bash[22610]: cluster 2024-08-31T04:30:06.481638+0000 mgr.a (mgr.14388) 6006 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:30:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:07 smithi191 bash[24992]: cluster 2024-08-31T04:30:06.481638+0000 mgr.a (mgr.14388) 6006 : cluster [DBG] pgmap v4162: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:30:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:30:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:30:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:30:09.098 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:30:09.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:30:09.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:30:09.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:30:09.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:30:09.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:09 smithi163 bash[24253]: cluster 2024-08-31T04:30:08.483310+0000 mgr.a (mgr.14388) 6007 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:09 smithi027 bash[22610]: cluster 2024-08-31T04:30:08.483310+0000 mgr.a (mgr.14388) 6007 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:10.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:09 smithi191 bash[24992]: cluster 2024-08-31T04:30:08.483310+0000 mgr.a (mgr.14388) 6007 : cluster [DBG] pgmap v4163: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:10.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:10 smithi163 bash[24253]: audit 2024-08-31T04:30:08.672039+0000 mgr.a (mgr.14388) 6008 : audit [DBG] from='client.138813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:10 smithi027 bash[22610]: audit 2024-08-31T04:30:08.672039+0000 mgr.a (mgr.14388) 6008 : audit [DBG] from='client.138813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:10 smithi191 bash[24992]: audit 2024-08-31T04:30:08.672039+0000 mgr.a (mgr.14388) 6008 : audit [DBG] from='client.138813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:11.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:11 smithi163 bash[24253]: cluster 2024-08-31T04:30:10.484206+0000 mgr.a (mgr.14388) 6009 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:30:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:11 smithi027 bash[22610]: cluster 2024-08-31T04:30:10.484206+0000 mgr.a (mgr.14388) 6009 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:30:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:11 smithi191 bash[24992]: cluster 2024-08-31T04:30:10.484206+0000 mgr.a (mgr.14388) 6009 : cluster [DBG] pgmap v4164: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:30:13.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:13 smithi163 bash[24253]: cluster 2024-08-31T04:30:12.484962+0000 mgr.a (mgr.14388) 6010 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:30:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:13 smithi027 bash[22610]: cluster 2024-08-31T04:30:12.484962+0000 mgr.a (mgr.14388) 6010 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:30:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:13 smithi191 bash[24992]: cluster 2024-08-31T04:30:12.484962+0000 mgr.a (mgr.14388) 6010 : cluster [DBG] pgmap v4165: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:30:14.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:30:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:30:14.101 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:30:14.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:30:14.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:30:14.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:30:14.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:30:14.864 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:30:15.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:15 smithi163 bash[24253]: audit 2024-08-31T04:30:14.437322+0000 mgr.a (mgr.14388) 6011 : audit [DBG] from='client.138885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:15.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:15 smithi163 bash[24253]: cluster 2024-08-31T04:30:14.487902+0000 mgr.a (mgr.14388) 6012 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:15 smithi027 bash[22610]: audit 2024-08-31T04:30:14.437322+0000 mgr.a (mgr.14388) 6011 : audit [DBG] from='client.138885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:15 smithi027 bash[22610]: cluster 2024-08-31T04:30:14.487902+0000 mgr.a (mgr.14388) 6012 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:15 smithi191 bash[24992]: audit 2024-08-31T04:30:14.437322+0000 mgr.a (mgr.14388) 6011 : audit [DBG] from='client.138885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:15 smithi191 bash[24992]: cluster 2024-08-31T04:30:14.487902+0000 mgr.a (mgr.14388) 6012 : cluster [DBG] pgmap v4166: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:17.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:17 smithi163 bash[24253]: cluster 2024-08-31T04:30:16.488841+0000 mgr.a (mgr.14388) 6013 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:17 smithi027 bash[22610]: cluster 2024-08-31T04:30:16.488841+0000 mgr.a (mgr.14388) 6013 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:17 smithi191 bash[24992]: cluster 2024-08-31T04:30:16.488841+0000 mgr.a (mgr.14388) 6013 : cluster [DBG] pgmap v4167: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:30:19.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:30:19.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:30:19.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:19 smithi163 bash[24253]: cluster 2024-08-31T04:30:18.490963+0000 mgr.a (mgr.14388) 6014 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:19 smithi027 bash[22610]: cluster 2024-08-31T04:30:18.490963+0000 mgr.a (mgr.14388) 6014 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:19 smithi191 bash[24992]: cluster 2024-08-31T04:30:18.490963+0000 mgr.a (mgr.14388) 6014 : cluster [DBG] pgmap v4168: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:20.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:30:20.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:30:20.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:30:20.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:30:20.640 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:30:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:21 smithi163 bash[24253]: audit 2024-08-31T04:30:20.207311+0000 mgr.a (mgr.14388) 6015 : audit [DBG] from='client.138963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:21 smithi163 bash[24253]: cluster 2024-08-31T04:30:20.491480+0000 mgr.a (mgr.14388) 6016 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:21 smithi027 bash[22610]: audit 2024-08-31T04:30:20.207311+0000 mgr.a (mgr.14388) 6015 : audit [DBG] from='client.138963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:21 smithi027 bash[22610]: cluster 2024-08-31T04:30:20.491480+0000 mgr.a (mgr.14388) 6016 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:21 smithi191 bash[24992]: audit 2024-08-31T04:30:20.207311+0000 mgr.a (mgr.14388) 6015 : audit [DBG] from='client.138963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:21 smithi191 bash[24992]: cluster 2024-08-31T04:30:20.491480+0000 mgr.a (mgr.14388) 6016 : cluster [DBG] pgmap v4169: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:23.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:23 smithi163 bash[24253]: cluster 2024-08-31T04:30:22.492325+0000 mgr.a (mgr.14388) 6017 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:23 smithi027 bash[22610]: cluster 2024-08-31T04:30:22.492325+0000 mgr.a (mgr.14388) 6017 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:23 smithi191 bash[24992]: cluster 2024-08-31T04:30:22.492325+0000 mgr.a (mgr.14388) 6017 : cluster [DBG] pgmap v4170: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:24.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:24 smithi163 bash[24253]: cluster 2024-08-31T04:30:24.494552+0000 mgr.a (mgr.14388) 6018 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:24 smithi027 bash[22610]: cluster 2024-08-31T04:30:24.494552+0000 mgr.a (mgr.14388) 6018 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:24 smithi191 bash[24992]: cluster 2024-08-31T04:30:24.494552+0000 mgr.a (mgr.14388) 6018 : cluster [DBG] pgmap v4171: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:25.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:30:25.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:30:25.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:30:26.381 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:30:26.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:30:26.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:30:26.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:30:26.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:30:27.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:27 smithi163 bash[24253]: audit 2024-08-31T04:30:25.971386+0000 mgr.a (mgr.14388) 6019 : audit [DBG] from='client.139041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:27.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:27 smithi163 bash[24253]: cluster 2024-08-31T04:30:26.495487+0000 mgr.a (mgr.14388) 6020 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:27 smithi027 bash[22610]: audit 2024-08-31T04:30:25.971386+0000 mgr.a (mgr.14388) 6019 : audit [DBG] from='client.139041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:27 smithi027 bash[22610]: cluster 2024-08-31T04:30:26.495487+0000 mgr.a (mgr.14388) 6020 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:27 smithi191 bash[24992]: audit 2024-08-31T04:30:25.971386+0000 mgr.a (mgr.14388) 6019 : audit [DBG] from='client.139041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:27 smithi191 bash[24992]: cluster 2024-08-31T04:30:26.495487+0000 mgr.a (mgr.14388) 6020 : cluster [DBG] pgmap v4172: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:29.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:29 smithi163 bash[24253]: cluster 2024-08-31T04:30:28.497535+0000 mgr.a (mgr.14388) 6021 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:29 smithi027 bash[22610]: cluster 2024-08-31T04:30:28.497535+0000 mgr.a (mgr.14388) 6021 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:29 smithi191 bash[24992]: cluster 2024-08-31T04:30:28.497535+0000 mgr.a (mgr.14388) 6021 : cluster [DBG] pgmap v4173: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:31.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:30:31.383 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:30:31.383 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:30:31.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:31 smithi163 bash[24253]: cluster 2024-08-31T04:30:30.498311+0000 mgr.a (mgr.14388) 6022 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:31.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:31 smithi027 bash[22610]: cluster 2024-08-31T04:30:30.498311+0000 mgr.a (mgr.14388) 6022 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:31 smithi191 bash[24992]: cluster 2024-08-31T04:30:30.498311+0000 mgr.a (mgr.14388) 6022 : cluster [DBG] pgmap v4174: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:32.130 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:30:32.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:30:32.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:30:32.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:30:32.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:30:33.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:33 smithi163 bash[24253]: audit 2024-08-31T04:30:31.717275+0000 mgr.a (mgr.14388) 6023 : audit [DBG] from='client.139119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:33.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:33 smithi163 bash[24253]: cluster 2024-08-31T04:30:32.499253+0000 mgr.a (mgr.14388) 6024 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:33 smithi027 bash[22610]: audit 2024-08-31T04:30:31.717275+0000 mgr.a (mgr.14388) 6023 : audit [DBG] from='client.139119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:33 smithi027 bash[22610]: cluster 2024-08-31T04:30:32.499253+0000 mgr.a (mgr.14388) 6024 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:33 smithi191 bash[24992]: audit 2024-08-31T04:30:31.717275+0000 mgr.a (mgr.14388) 6023 : audit [DBG] from='client.139119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:33 smithi191 bash[24992]: cluster 2024-08-31T04:30:32.499253+0000 mgr.a (mgr.14388) 6024 : cluster [DBG] pgmap v4175: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:35.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:35 smithi163 bash[24253]: cluster 2024-08-31T04:30:34.501455+0000 mgr.a (mgr.14388) 6025 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:35 smithi027 bash[22610]: cluster 2024-08-31T04:30:34.501455+0000 mgr.a (mgr.14388) 6025 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:35 smithi191 bash[24992]: cluster 2024-08-31T04:30:34.501455+0000 mgr.a (mgr.14388) 6025 : cluster [DBG] pgmap v4176: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:30:37.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:30:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:30:37.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:30:37.915 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:30:37.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:30:37.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:30:37.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:30:37.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:30:37.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:37 smithi163 bash[24253]: cluster 2024-08-31T04:30:36.502213+0000 mgr.a (mgr.14388) 6026 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:37.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:37 smithi027 bash[22610]: cluster 2024-08-31T04:30:36.502213+0000 mgr.a (mgr.14388) 6026 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:37 smithi191 bash[24992]: cluster 2024-08-31T04:30:36.502213+0000 mgr.a (mgr.14388) 6026 : cluster [DBG] pgmap v4177: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:38.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:38 smithi163 bash[24253]: audit 2024-08-31T04:30:37.467954+0000 mgr.a (mgr.14388) 6027 : audit [DBG] from='client.139194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:38 smithi027 bash[22610]: audit 2024-08-31T04:30:37.467954+0000 mgr.a (mgr.14388) 6027 : audit [DBG] from='client.139194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:38 smithi191 bash[24992]: audit 2024-08-31T04:30:37.467954+0000 mgr.a (mgr.14388) 6027 : audit [DBG] from='client.139194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:39.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:39 smithi163 bash[24253]: cluster 2024-08-31T04:30:38.504510+0000 mgr.a (mgr.14388) 6028 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:30:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:39 smithi027 bash[22610]: cluster 2024-08-31T04:30:38.504510+0000 mgr.a (mgr.14388) 6028 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:30:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:39 smithi191 bash[24992]: cluster 2024-08-31T04:30:38.504510+0000 mgr.a (mgr.14388) 6028 : cluster [DBG] pgmap v4178: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:30:41.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:41 smithi163 bash[24253]: cluster 2024-08-31T04:30:40.505279+0000 mgr.a (mgr.14388) 6029 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:30:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:41 smithi027 bash[22610]: cluster 2024-08-31T04:30:40.505279+0000 mgr.a (mgr.14388) 6029 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:30:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:41 smithi191 bash[24992]: cluster 2024-08-31T04:30:40.505279+0000 mgr.a (mgr.14388) 6029 : cluster [DBG] pgmap v4179: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:30:42.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:30:42.918 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:30:42.918 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:30:43.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:30:43.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:30:43.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:30:43.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:30:43.681 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:30:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:43 smithi163 bash[24253]: cluster 2024-08-31T04:30:42.506051+0000 mgr.a (mgr.14388) 6030 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:30:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:43 smithi027 bash[22610]: cluster 2024-08-31T04:30:42.506051+0000 mgr.a (mgr.14388) 6030 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:30:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:43 smithi191 bash[24992]: cluster 2024-08-31T04:30:42.506051+0000 mgr.a (mgr.14388) 6030 : cluster [DBG] pgmap v4180: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:30:44.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:44 smithi163 bash[24253]: audit 2024-08-31T04:30:43.253857+0000 mgr.a (mgr.14388) 6031 : audit [DBG] from='client.139269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:44.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:44 smithi163 bash[24253]: audit 2024-08-31T04:30:43.867810+0000 mon.a (mon.0) 1488 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:30:44.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:44 smithi027 bash[22610]: audit 2024-08-31T04:30:43.253857+0000 mgr.a (mgr.14388) 6031 : audit [DBG] from='client.139269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:44 smithi027 bash[22610]: audit 2024-08-31T04:30:43.867810+0000 mon.a (mon.0) 1488 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:30:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:44 smithi191 bash[24992]: audit 2024-08-31T04:30:43.253857+0000 mgr.a (mgr.14388) 6031 : audit [DBG] from='client.139269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:44 smithi191 bash[24992]: audit 2024-08-31T04:30:43.867810+0000 mon.a (mon.0) 1488 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:30:45.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:30:45 smithi027 bash[22863]: debug 2024-08-31T04:30:45.415+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:30:45.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:30:45 smithi027 bash[22863]: debug 2024-08-31T04:30:45.419+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:30:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:45 smithi027 bash[22610]: cluster 2024-08-31T04:30:44.507206+0000 mgr.a (mgr.14388) 6032 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:45 smithi027 bash[22610]: audit 2024-08-31T04:30:44.687867+0000 mon.a (mon.0) 1489 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:30:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:45 smithi027 bash[22610]: audit 2024-08-31T04:30:44.689628+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:30:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:45 smithi027 bash[22610]: audit 2024-08-31T04:30:44.700139+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:30:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:45 smithi027 bash[22610]: audit 2024-08-31T04:30:44.705057+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:30:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:45 smithi027 bash[22610]: audit 2024-08-31T04:30:44.707554+0000 mgr.a (mgr.14388) 6033 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:30:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:45 smithi027 bash[22610]: audit 2024-08-31T04:30:45.421715+0000 mgr.a (mgr.14388) 6034 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:30:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:45 smithi027 bash[22610]: cephadm 2024-08-31T04:30:45.423143+0000 mgr.a (mgr.14388) 6035 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:30:45.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:45 smithi163 bash[24253]: cluster 2024-08-31T04:30:44.507206+0000 mgr.a (mgr.14388) 6032 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:45 smithi163 bash[24253]: audit 2024-08-31T04:30:44.687867+0000 mon.a (mon.0) 1489 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:30:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:45 smithi163 bash[24253]: audit 2024-08-31T04:30:44.689628+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:30:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:45 smithi163 bash[24253]: audit 2024-08-31T04:30:44.700139+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:30:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:45 smithi163 bash[24253]: audit 2024-08-31T04:30:44.705057+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:30:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:45 smithi163 bash[24253]: audit 2024-08-31T04:30:44.707554+0000 mgr.a (mgr.14388) 6033 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:30:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:45 smithi163 bash[24253]: audit 2024-08-31T04:30:45.421715+0000 mgr.a (mgr.14388) 6034 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:30:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:45 smithi163 bash[24253]: cephadm 2024-08-31T04:30:45.423143+0000 mgr.a (mgr.14388) 6035 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:30:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:45 smithi191 bash[24992]: cluster 2024-08-31T04:30:44.507206+0000 mgr.a (mgr.14388) 6032 : cluster [DBG] pgmap v4181: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:30:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:45 smithi191 bash[24992]: audit 2024-08-31T04:30:44.687867+0000 mon.a (mon.0) 1489 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:30:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:45 smithi191 bash[24992]: audit 2024-08-31T04:30:44.689628+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:30:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:45 smithi191 bash[24992]: audit 2024-08-31T04:30:44.700139+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:30:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:45 smithi191 bash[24992]: audit 2024-08-31T04:30:44.705057+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:30:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:45 smithi191 bash[24992]: audit 2024-08-31T04:30:44.707554+0000 mgr.a (mgr.14388) 6033 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:30:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:45 smithi191 bash[24992]: audit 2024-08-31T04:30:45.421715+0000 mgr.a (mgr.14388) 6034 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:30:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:45 smithi191 bash[24992]: cephadm 2024-08-31T04:30:45.423143+0000 mgr.a (mgr.14388) 6035 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:30:46.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:46 smithi163 bash[24253]: cluster 2024-08-31T04:30:46.508062+0000 mgr.a (mgr.14388) 6036 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:30:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:46 smithi027 bash[22610]: cluster 2024-08-31T04:30:46.508062+0000 mgr.a (mgr.14388) 6036 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:30:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:46 smithi191 bash[24992]: cluster 2024-08-31T04:30:46.508062+0000 mgr.a (mgr.14388) 6036 : cluster [DBG] pgmap v4182: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:30:48.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:30:48.683 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:30:48.683 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:30:49.442 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:30:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:30:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:30:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:30:49.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:30:49.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:49 smithi163 bash[24253]: cluster 2024-08-31T04:30:48.510220+0000 mgr.a (mgr.14388) 6037 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:49 smithi027 bash[22610]: cluster 2024-08-31T04:30:48.510220+0000 mgr.a (mgr.14388) 6037 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:49 smithi191 bash[24992]: cluster 2024-08-31T04:30:48.510220+0000 mgr.a (mgr.14388) 6037 : cluster [DBG] pgmap v4183: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:50.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:50 smithi163 bash[24253]: audit 2024-08-31T04:30:49.019779+0000 mgr.a (mgr.14388) 6038 : audit [DBG] from='client.139449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:50 smithi027 bash[22610]: audit 2024-08-31T04:30:49.019779+0000 mgr.a (mgr.14388) 6038 : audit [DBG] from='client.139449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:50 smithi191 bash[24992]: audit 2024-08-31T04:30:49.019779+0000 mgr.a (mgr.14388) 6038 : audit [DBG] from='client.139449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:51.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:51 smithi163 bash[24253]: cluster 2024-08-31T04:30:50.511166+0000 mgr.a (mgr.14388) 6039 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:30:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:51 smithi027 bash[22610]: cluster 2024-08-31T04:30:50.511166+0000 mgr.a (mgr.14388) 6039 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:30:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:51 smithi191 bash[24992]: cluster 2024-08-31T04:30:50.511166+0000 mgr.a (mgr.14388) 6039 : cluster [DBG] pgmap v4184: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:30:53.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:53 smithi163 bash[24253]: cluster 2024-08-31T04:30:52.511932+0000 mgr.a (mgr.14388) 6040 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:30:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:53 smithi027 bash[22610]: cluster 2024-08-31T04:30:52.511932+0000 mgr.a (mgr.14388) 6040 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:30:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:53 smithi191 bash[24992]: cluster 2024-08-31T04:30:52.511932+0000 mgr.a (mgr.14388) 6040 : cluster [DBG] pgmap v4185: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:30:54.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:30:54.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:30:54.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:30:55.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:30:55.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:30:55.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:30:55.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:30:55.223 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:30:55.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:55 smithi163 bash[24253]: cluster 2024-08-31T04:30:54.514072+0000 mgr.a (mgr.14388) 6041 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:55 smithi027 bash[22610]: cluster 2024-08-31T04:30:54.514072+0000 mgr.a (mgr.14388) 6041 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:55 smithi191 bash[24992]: cluster 2024-08-31T04:30:54.514072+0000 mgr.a (mgr.14388) 6041 : cluster [DBG] pgmap v4186: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:56.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:56 smithi163 bash[24253]: audit 2024-08-31T04:30:54.787147+0000 mgr.a (mgr.14388) 6042 : audit [DBG] from='client.139527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:56 smithi027 bash[22610]: audit 2024-08-31T04:30:54.787147+0000 mgr.a (mgr.14388) 6042 : audit [DBG] from='client.139527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:56 smithi191 bash[24992]: audit 2024-08-31T04:30:54.787147+0000 mgr.a (mgr.14388) 6042 : audit [DBG] from='client.139527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:30:57.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:57 smithi163 bash[24253]: cluster 2024-08-31T04:30:56.515012+0000 mgr.a (mgr.14388) 6043 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:57 smithi027 bash[22610]: cluster 2024-08-31T04:30:56.515012+0000 mgr.a (mgr.14388) 6043 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:57 smithi191 bash[24992]: cluster 2024-08-31T04:30:56.515012+0000 mgr.a (mgr.14388) 6043 : cluster [DBG] pgmap v4187: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:58.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:30:58 smithi163 bash[24253]: cluster 2024-08-31T04:30:58.517180+0000 mgr.a (mgr.14388) 6044 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:30:58 smithi027 bash[22610]: cluster 2024-08-31T04:30:58.517180+0000 mgr.a (mgr.14388) 6044 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:30:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:30:58 smithi191 bash[24992]: cluster 2024-08-31T04:30:58.517180+0000 mgr.a (mgr.14388) 6044 : cluster [DBG] pgmap v4188: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:00.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:00.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:00.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:00.993 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:00.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:00.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:00.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:00.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:01.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:01 smithi163 bash[24253]: cluster 2024-08-31T04:31:00.517709+0000 mgr.a (mgr.14388) 6045 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:01.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:01 smithi163 bash[24253]: audit 2024-08-31T04:31:00.554680+0000 mgr.a (mgr.14388) 6046 : audit [DBG] from='client.139605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:01 smithi027 bash[22610]: cluster 2024-08-31T04:31:00.517709+0000 mgr.a (mgr.14388) 6045 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:01 smithi027 bash[22610]: audit 2024-08-31T04:31:00.554680+0000 mgr.a (mgr.14388) 6046 : audit [DBG] from='client.139605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:01 smithi191 bash[24992]: cluster 2024-08-31T04:31:00.517709+0000 mgr.a (mgr.14388) 6045 : cluster [DBG] pgmap v4189: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:01 smithi191 bash[24992]: audit 2024-08-31T04:31:00.554680+0000 mgr.a (mgr.14388) 6046 : audit [DBG] from='client.139605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:03.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:03 smithi163 bash[24253]: cluster 2024-08-31T04:31:02.518539+0000 mgr.a (mgr.14388) 6047 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:03 smithi027 bash[22610]: cluster 2024-08-31T04:31:02.518539+0000 mgr.a (mgr.14388) 6047 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:03 smithi191 bash[24992]: cluster 2024-08-31T04:31:02.518539+0000 mgr.a (mgr.14388) 6047 : cluster [DBG] pgmap v4190: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:05.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:05 smithi163 bash[24253]: cluster 2024-08-31T04:31:04.520729+0000 mgr.a (mgr.14388) 6048 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:05 smithi027 bash[22610]: cluster 2024-08-31T04:31:04.520729+0000 mgr.a (mgr.14388) 6048 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:05.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:05.996 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:05.996 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:05 smithi191 bash[24992]: cluster 2024-08-31T04:31:04.520729+0000 mgr.a (mgr.14388) 6048 : cluster [DBG] pgmap v4191: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:06.770 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:07.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:07 smithi163 bash[24253]: audit 2024-08-31T04:31:06.333700+0000 mgr.a (mgr.14388) 6049 : audit [DBG] from='client.139680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:07.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:07 smithi163 bash[24253]: cluster 2024-08-31T04:31:06.521252+0000 mgr.a (mgr.14388) 6050 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:07 smithi027 bash[22610]: audit 2024-08-31T04:31:06.333700+0000 mgr.a (mgr.14388) 6049 : audit [DBG] from='client.139680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:07 smithi027 bash[22610]: cluster 2024-08-31T04:31:06.521252+0000 mgr.a (mgr.14388) 6050 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:07 smithi191 bash[24992]: audit 2024-08-31T04:31:06.333700+0000 mgr.a (mgr.14388) 6049 : audit [DBG] from='client.139680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:07 smithi191 bash[24992]: cluster 2024-08-31T04:31:06.521252+0000 mgr.a (mgr.14388) 6050 : cluster [DBG] pgmap v4192: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:09.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:09 smithi163 bash[24253]: cluster 2024-08-31T04:31:08.523590+0000 mgr.a (mgr.14388) 6051 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:09 smithi027 bash[22610]: cluster 2024-08-31T04:31:08.523590+0000 mgr.a (mgr.14388) 6051 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:09 smithi191 bash[24992]: cluster 2024-08-31T04:31:08.523590+0000 mgr.a (mgr.14388) 6051 : cluster [DBG] pgmap v4193: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:11.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:11.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:11.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:11.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:11 smithi163 bash[24253]: cluster 2024-08-31T04:31:10.524518+0000 mgr.a (mgr.14388) 6052 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:11 smithi027 bash[22610]: cluster 2024-08-31T04:31:10.524518+0000 mgr.a (mgr.14388) 6052 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:11 smithi191 bash[24992]: cluster 2024-08-31T04:31:10.524518+0000 mgr.a (mgr.14388) 6052 : cluster [DBG] pgmap v4194: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:12.552 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:12.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:12.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:12.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:12.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:13.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:13 smithi163 bash[24253]: audit 2024-08-31T04:31:12.113755+0000 mgr.a (mgr.14388) 6053 : audit [DBG] from='client.139755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:13.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:13 smithi163 bash[24253]: cluster 2024-08-31T04:31:12.525016+0000 mgr.a (mgr.14388) 6054 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:13 smithi027 bash[22610]: audit 2024-08-31T04:31:12.113755+0000 mgr.a (mgr.14388) 6053 : audit [DBG] from='client.139755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:13 smithi027 bash[22610]: cluster 2024-08-31T04:31:12.525016+0000 mgr.a (mgr.14388) 6054 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:13 smithi191 bash[24992]: audit 2024-08-31T04:31:12.113755+0000 mgr.a (mgr.14388) 6053 : audit [DBG] from='client.139755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:13 smithi191 bash[24992]: cluster 2024-08-31T04:31:12.525016+0000 mgr.a (mgr.14388) 6054 : cluster [DBG] pgmap v4195: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:14.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:14 smithi163 bash[24253]: cluster 2024-08-31T04:31:14.527226+0000 mgr.a (mgr.14388) 6055 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:14 smithi027 bash[22610]: cluster 2024-08-31T04:31:14.527226+0000 mgr.a (mgr.14388) 6055 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:14 smithi191 bash[24992]: cluster 2024-08-31T04:31:14.527226+0000 mgr.a (mgr.14388) 6055 : cluster [DBG] pgmap v4196: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:17.554 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:17.555 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:17.555 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:17.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:17 smithi163 bash[24253]: cluster 2024-08-31T04:31:16.527973+0000 mgr.a (mgr.14388) 6056 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:17.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:17 smithi027 bash[22610]: cluster 2024-08-31T04:31:16.527973+0000 mgr.a (mgr.14388) 6056 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:17 smithi191 bash[24992]: cluster 2024-08-31T04:31:16.527973+0000 mgr.a (mgr.14388) 6056 : cluster [DBG] pgmap v4197: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:18.326 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:18.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:18.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:18.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:18.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:19.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:19 smithi163 bash[24253]: audit 2024-08-31T04:31:17.893296+0000 mgr.a (mgr.14388) 6057 : audit [DBG] from='client.139833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:19.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:19 smithi163 bash[24253]: cluster 2024-08-31T04:31:18.530505+0000 mgr.a (mgr.14388) 6058 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:19 smithi027 bash[22610]: audit 2024-08-31T04:31:17.893296+0000 mgr.a (mgr.14388) 6057 : audit [DBG] from='client.139833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:19 smithi027 bash[22610]: cluster 2024-08-31T04:31:18.530505+0000 mgr.a (mgr.14388) 6058 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:19 smithi191 bash[24992]: audit 2024-08-31T04:31:17.893296+0000 mgr.a (mgr.14388) 6057 : audit [DBG] from='client.139833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:19 smithi191 bash[24992]: cluster 2024-08-31T04:31:18.530505+0000 mgr.a (mgr.14388) 6058 : cluster [DBG] pgmap v4198: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:21.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:21 smithi163 bash[24253]: cluster 2024-08-31T04:31:20.531288+0000 mgr.a (mgr.14388) 6059 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:31:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:21 smithi027 bash[22610]: cluster 2024-08-31T04:31:20.531288+0000 mgr.a (mgr.14388) 6059 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:31:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:21 smithi191 bash[24992]: cluster 2024-08-31T04:31:20.531288+0000 mgr.a (mgr.14388) 6059 : cluster [DBG] pgmap v4199: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:31:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:23.328 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:23.328 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:23.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:23 smithi163 bash[24253]: cluster 2024-08-31T04:31:22.532057+0000 mgr.a (mgr.14388) 6060 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:31:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:23 smithi027 bash[22610]: cluster 2024-08-31T04:31:22.532057+0000 mgr.a (mgr.14388) 6060 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:31:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:23 smithi191 bash[24992]: cluster 2024-08-31T04:31:22.532057+0000 mgr.a (mgr.14388) 6060 : cluster [DBG] pgmap v4200: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:31:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:24.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:24.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:24.097 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:24.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:24 smithi163 bash[24253]: audit 2024-08-31T04:31:23.665925+0000 mgr.a (mgr.14388) 6061 : audit [DBG] from='client.139911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:24.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:24 smithi163 bash[24253]: cluster 2024-08-31T04:31:24.534689+0000 mgr.a (mgr.14388) 6062 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:24 smithi027 bash[22610]: audit 2024-08-31T04:31:23.665925+0000 mgr.a (mgr.14388) 6061 : audit [DBG] from='client.139911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:24 smithi027 bash[22610]: cluster 2024-08-31T04:31:24.534689+0000 mgr.a (mgr.14388) 6062 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:24 smithi191 bash[24992]: audit 2024-08-31T04:31:23.665925+0000 mgr.a (mgr.14388) 6061 : audit [DBG] from='client.139911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:24 smithi191 bash[24992]: cluster 2024-08-31T04:31:24.534689+0000 mgr.a (mgr.14388) 6062 : cluster [DBG] pgmap v4201: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:27.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:27 smithi163 bash[24253]: cluster 2024-08-31T04:31:26.535482+0000 mgr.a (mgr.14388) 6063 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:31:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:27 smithi027 bash[22610]: cluster 2024-08-31T04:31:26.535482+0000 mgr.a (mgr.14388) 6063 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:31:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:27 smithi191 bash[24992]: cluster 2024-08-31T04:31:26.535482+0000 mgr.a (mgr.14388) 6063 : cluster [DBG] pgmap v4202: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:31:29.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:29.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:29.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:29.876 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:29.876 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:29.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:29.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:29.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:29.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:29 smithi163 bash[24253]: cluster 2024-08-31T04:31:28.537359+0000 mgr.a (mgr.14388) 6064 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:29.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:29 smithi027 bash[22610]: cluster 2024-08-31T04:31:28.537359+0000 mgr.a (mgr.14388) 6064 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:29 smithi191 bash[24992]: cluster 2024-08-31T04:31:28.537359+0000 mgr.a (mgr.14388) 6064 : cluster [DBG] pgmap v4203: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:30.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:30 smithi163 bash[24253]: audit 2024-08-31T04:31:29.434587+0000 mgr.a (mgr.14388) 6065 : audit [DBG] from='client.139989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:30 smithi027 bash[22610]: audit 2024-08-31T04:31:29.434587+0000 mgr.a (mgr.14388) 6065 : audit [DBG] from='client.139989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:30 smithi191 bash[24992]: audit 2024-08-31T04:31:29.434587+0000 mgr.a (mgr.14388) 6065 : audit [DBG] from='client.139989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:31.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:31 smithi163 bash[24253]: cluster 2024-08-31T04:31:30.538236+0000 mgr.a (mgr.14388) 6066 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:31 smithi027 bash[22610]: cluster 2024-08-31T04:31:30.538236+0000 mgr.a (mgr.14388) 6066 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:31 smithi191 bash[24992]: cluster 2024-08-31T04:31:30.538236+0000 mgr.a (mgr.14388) 6066 : cluster [DBG] pgmap v4204: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:32.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:32 smithi163 bash[24253]: cluster 2024-08-31T04:31:32.539012+0000 mgr.a (mgr.14388) 6067 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:32 smithi027 bash[22610]: cluster 2024-08-31T04:31:32.539012+0000 mgr.a (mgr.14388) 6067 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:32 smithi191 bash[24992]: cluster 2024-08-31T04:31:32.539012+0000 mgr.a (mgr.14388) 6067 : cluster [DBG] pgmap v4205: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:34.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:34.878 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:34.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:35.618 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:35.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:35.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:35.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:35.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:35.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:35 smithi163 bash[24253]: cluster 2024-08-31T04:31:34.541180+0000 mgr.a (mgr.14388) 6068 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:35.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:35 smithi027 bash[22610]: cluster 2024-08-31T04:31:34.541180+0000 mgr.a (mgr.14388) 6068 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:35 smithi191 bash[24992]: cluster 2024-08-31T04:31:34.541180+0000 mgr.a (mgr.14388) 6068 : cluster [DBG] pgmap v4206: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:36.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:36 smithi163 bash[24253]: audit 2024-08-31T04:31:35.204303+0000 mgr.a (mgr.14388) 6069 : audit [DBG] from='client.140064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:36.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:36 smithi027 bash[22610]: audit 2024-08-31T04:31:35.204303+0000 mgr.a (mgr.14388) 6069 : audit [DBG] from='client.140064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:36 smithi191 bash[24992]: audit 2024-08-31T04:31:35.204303+0000 mgr.a (mgr.14388) 6069 : audit [DBG] from='client.140064 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:37.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:37 smithi163 bash[24253]: cluster 2024-08-31T04:31:36.542039+0000 mgr.a (mgr.14388) 6070 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:37 smithi027 bash[22610]: cluster 2024-08-31T04:31:36.542039+0000 mgr.a (mgr.14388) 6070 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:37 smithi191 bash[24992]: cluster 2024-08-31T04:31:36.542039+0000 mgr.a (mgr.14388) 6070 : cluster [DBG] pgmap v4207: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:38.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:38 smithi163 bash[24253]: cluster 2024-08-31T04:31:38.544213+0000 mgr.a (mgr.14388) 6071 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:38 smithi027 bash[22610]: cluster 2024-08-31T04:31:38.544213+0000 mgr.a (mgr.14388) 6071 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:38 smithi191 bash[24992]: cluster 2024-08-31T04:31:38.544213+0000 mgr.a (mgr.14388) 6071 : cluster [DBG] pgmap v4208: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:40.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:40.621 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:40.621 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:41.390 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:41.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:41.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:41.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:41.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:41.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:41 smithi163 bash[24253]: cluster 2024-08-31T04:31:40.544977+0000 mgr.a (mgr.14388) 6072 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:41.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:41 smithi027 bash[22610]: cluster 2024-08-31T04:31:40.544977+0000 mgr.a (mgr.14388) 6072 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:41 smithi191 bash[24992]: cluster 2024-08-31T04:31:40.544977+0000 mgr.a (mgr.14388) 6072 : cluster [DBG] pgmap v4209: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:42.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:42 smithi163 bash[24253]: audit 2024-08-31T04:31:40.954178+0000 mgr.a (mgr.14388) 6073 : audit [DBG] from='client.140139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:42 smithi027 bash[22610]: audit 2024-08-31T04:31:40.954178+0000 mgr.a (mgr.14388) 6073 : audit [DBG] from='client.140139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:42 smithi191 bash[24992]: audit 2024-08-31T04:31:40.954178+0000 mgr.a (mgr.14388) 6073 : audit [DBG] from='client.140139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:43.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:43 smithi163 bash[24253]: cluster 2024-08-31T04:31:42.545879+0000 mgr.a (mgr.14388) 6074 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:43 smithi027 bash[22610]: cluster 2024-08-31T04:31:42.545879+0000 mgr.a (mgr.14388) 6074 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:43 smithi191 bash[24992]: cluster 2024-08-31T04:31:42.545879+0000 mgr.a (mgr.14388) 6074 : cluster [DBG] pgmap v4210: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:44.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:44 smithi163 bash[24253]: cluster 2024-08-31T04:31:44.548134+0000 mgr.a (mgr.14388) 6075 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:44 smithi027 bash[22610]: cluster 2024-08-31T04:31:44.548134+0000 mgr.a (mgr.14388) 6075 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:44 smithi191 bash[24992]: cluster 2024-08-31T04:31:44.548134+0000 mgr.a (mgr.14388) 6075 : cluster [DBG] pgmap v4211: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:31:45.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:45 smithi163 bash[24253]: audit 2024-08-31T04:31:45.476569+0000 mon.a (mon.0) 1493 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:31:45.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:45 smithi027 bash[22610]: audit 2024-08-31T04:31:45.476569+0000 mon.a (mon.0) 1493 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:31:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:45 smithi191 bash[24992]: audit 2024-08-31T04:31:45.476569+0000 mon.a (mon.0) 1493 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:31:46.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:46.393 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:46 smithi163 bash[24253]: audit 2024-08-31T04:31:46.322956+0000 mon.a (mon.0) 1494 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:31:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:46 smithi163 bash[24253]: audit 2024-08-31T04:31:46.324365+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:31:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:46 smithi163 bash[24253]: audit 2024-08-31T04:31:46.334241+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:31:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:46 smithi163 bash[24253]: audit 2024-08-31T04:31:46.338932+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:31:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:46 smithi163 bash[24253]: audit 2024-08-31T04:31:46.340013+0000 mgr.a (mgr.14388) 6076 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:31:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:46 smithi163 bash[24253]: cluster 2024-08-31T04:31:46.548665+0000 mgr.a (mgr.14388) 6077 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:46.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:46 smithi027 bash[22610]: audit 2024-08-31T04:31:46.322956+0000 mon.a (mon.0) 1494 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:31:46.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:46 smithi027 bash[22610]: audit 2024-08-31T04:31:46.324365+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:31:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:46 smithi027 bash[22610]: audit 2024-08-31T04:31:46.334241+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:31:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:46 smithi027 bash[22610]: audit 2024-08-31T04:31:46.338932+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:31:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:46 smithi027 bash[22610]: audit 2024-08-31T04:31:46.340013+0000 mgr.a (mgr.14388) 6076 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:31:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:46 smithi027 bash[22610]: cluster 2024-08-31T04:31:46.548665+0000 mgr.a (mgr.14388) 6077 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:46 smithi191 bash[24992]: audit 2024-08-31T04:31:46.322956+0000 mon.a (mon.0) 1494 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:31:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:46 smithi191 bash[24992]: audit 2024-08-31T04:31:46.324365+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:31:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:46 smithi191 bash[24992]: audit 2024-08-31T04:31:46.334241+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:31:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:46 smithi191 bash[24992]: audit 2024-08-31T04:31:46.338932+0000 mon.a (mon.0) 1497 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:31:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:46 smithi191 bash[24992]: audit 2024-08-31T04:31:46.340013+0000 mgr.a (mgr.14388) 6076 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:31:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:46 smithi191 bash[24992]: cluster 2024-08-31T04:31:46.548665+0000 mgr.a (mgr.14388) 6077 : cluster [DBG] pgmap v4212: 225 pgs: 225 active+clean; 589 KiB data, 115 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:31:47.481 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:31:47 smithi027 bash[22863]: debug 2024-08-31T04:31:47.110+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:31:47.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:31:47 smithi027 bash[22863]: debug 2024-08-31T04:31:47.126+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:31:47.524 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:47.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:48 smithi163 bash[24253]: audit 2024-08-31T04:31:46.814005+0000 mgr.a (mgr.14388) 6078 : audit [DBG] from='client.140232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:48 smithi163 bash[24253]: audit 2024-08-31T04:31:47.112990+0000 mgr.a (mgr.14388) 6079 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:31:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:48 smithi163 bash[24253]: cephadm 2024-08-31T04:31:47.127961+0000 mgr.a (mgr.14388) 6080 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:31:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:48 smithi027 bash[22610]: audit 2024-08-31T04:31:46.814005+0000 mgr.a (mgr.14388) 6078 : audit [DBG] from='client.140232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:48 smithi027 bash[22610]: audit 2024-08-31T04:31:47.112990+0000 mgr.a (mgr.14388) 6079 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:31:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:48 smithi027 bash[22610]: cephadm 2024-08-31T04:31:47.127961+0000 mgr.a (mgr.14388) 6080 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:31:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:48 smithi191 bash[24992]: audit 2024-08-31T04:31:46.814005+0000 mgr.a (mgr.14388) 6078 : audit [DBG] from='client.140232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:48 smithi191 bash[24992]: audit 2024-08-31T04:31:47.112990+0000 mgr.a (mgr.14388) 6079 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:31:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:48 smithi191 bash[24992]: cephadm 2024-08-31T04:31:47.127961+0000 mgr.a (mgr.14388) 6080 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:31:49.698 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:49 smithi163 bash[24253]: cluster 2024-08-31T04:31:48.551023+0000 mgr.a (mgr.14388) 6081 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:49 smithi027 bash[22610]: cluster 2024-08-31T04:31:48.551023+0000 mgr.a (mgr.14388) 6081 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:49 smithi191 bash[24992]: cluster 2024-08-31T04:31:48.551023+0000 mgr.a (mgr.14388) 6081 : cluster [DBG] pgmap v4213: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:50.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:50 smithi163 bash[24253]: cluster 2024-08-31T04:31:50.551824+0000 mgr.a (mgr.14388) 6082 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:50 smithi027 bash[22610]: cluster 2024-08-31T04:31:50.551824+0000 mgr.a (mgr.14388) 6082 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:50 smithi191 bash[24992]: cluster 2024-08-31T04:31:50.551824+0000 mgr.a (mgr.14388) 6082 : cluster [DBG] pgmap v4214: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:52.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:52.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:52.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:52.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:52 smithi163 bash[24253]: cluster 2024-08-31T04:31:52.552633+0000 mgr.a (mgr.14388) 6083 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:52.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:52 smithi027 bash[22610]: cluster 2024-08-31T04:31:52.552633+0000 mgr.a (mgr.14388) 6083 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:52 smithi191 bash[24992]: cluster 2024-08-31T04:31:52.552633+0000 mgr.a (mgr.14388) 6083 : cluster [DBG] pgmap v4215: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:53.287 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:53.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:53.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:53.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:53.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:53.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:53 smithi163 bash[24253]: audit 2024-08-31T04:31:52.860790+0000 mgr.a (mgr.14388) 6084 : audit [DBG] from='client.140397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:53 smithi027 bash[22610]: audit 2024-08-31T04:31:52.860790+0000 mgr.a (mgr.14388) 6084 : audit [DBG] from='client.140397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:53 smithi191 bash[24992]: audit 2024-08-31T04:31:52.860790+0000 mgr.a (mgr.14388) 6084 : audit [DBG] from='client.140397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:54.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:54 smithi163 bash[24253]: cluster 2024-08-31T04:31:54.555501+0000 mgr.a (mgr.14388) 6085 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:54 smithi027 bash[22610]: cluster 2024-08-31T04:31:54.555501+0000 mgr.a (mgr.14388) 6085 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:54 smithi191 bash[24992]: cluster 2024-08-31T04:31:54.555501+0000 mgr.a (mgr.14388) 6085 : cluster [DBG] pgmap v4216: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:56.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:56 smithi163 bash[24253]: cluster 2024-08-31T04:31:56.556307+0000 mgr.a (mgr.14388) 6086 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:31:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:56 smithi027 bash[22610]: cluster 2024-08-31T04:31:56.556307+0000 mgr.a (mgr.14388) 6086 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:31:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:56 smithi191 bash[24992]: cluster 2024-08-31T04:31:56.556307+0000 mgr.a (mgr.14388) 6086 : cluster [DBG] pgmap v4217: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:31:58.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:31:58.289 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:31:58.289 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:31:58.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:58 smithi163 bash[24253]: cluster 2024-08-31T04:31:58.558347+0000 mgr.a (mgr.14388) 6087 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:58.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:58 smithi027 bash[22610]: cluster 2024-08-31T04:31:58.558347+0000 mgr.a (mgr.14388) 6087 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:58 smithi191 bash[24992]: cluster 2024-08-31T04:31:58.558347+0000 mgr.a (mgr.14388) 6087 : cluster [DBG] pgmap v4218: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:31:59.075 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:31:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:31:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:31:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:31:59.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:31:59.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:31:59 smithi163 bash[24253]: audit 2024-08-31T04:31:58.629549+0000 mgr.a (mgr.14388) 6088 : audit [DBG] from='client.140475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:31:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:31:59 smithi027 bash[22610]: audit 2024-08-31T04:31:58.629549+0000 mgr.a (mgr.14388) 6088 : audit [DBG] from='client.140475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:31:59 smithi191 bash[24992]: audit 2024-08-31T04:31:58.629549+0000 mgr.a (mgr.14388) 6088 : audit [DBG] from='client.140475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:00.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:00 smithi163 bash[24253]: cluster 2024-08-31T04:32:00.559256+0000 mgr.a (mgr.14388) 6089 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:32:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:00 smithi027 bash[22610]: cluster 2024-08-31T04:32:00.559256+0000 mgr.a (mgr.14388) 6089 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:32:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:00 smithi191 bash[24992]: cluster 2024-08-31T04:32:00.559256+0000 mgr.a (mgr.14388) 6089 : cluster [DBG] pgmap v4219: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:32:02.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:02 smithi163 bash[24253]: cluster 2024-08-31T04:32:02.560015+0000 mgr.a (mgr.14388) 6090 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:32:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:02 smithi027 bash[22610]: cluster 2024-08-31T04:32:02.560015+0000 mgr.a (mgr.14388) 6090 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:32:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:02 smithi191 bash[24992]: cluster 2024-08-31T04:32:02.560015+0000 mgr.a (mgr.14388) 6090 : cluster [DBG] pgmap v4220: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:32:04.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:32:04.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:32:04.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:32:04.821 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:32:04.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:32:04.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:32:04.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:32:04.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:32:04.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:04 smithi163 bash[24253]: audit 2024-08-31T04:32:04.410920+0000 mgr.a (mgr.14388) 6091 : audit [DBG] from='client.140553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:04 smithi163 bash[24253]: cluster 2024-08-31T04:32:04.561337+0000 mgr.a (mgr.14388) 6092 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:04.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:04 smithi027 bash[22610]: audit 2024-08-31T04:32:04.410920+0000 mgr.a (mgr.14388) 6091 : audit [DBG] from='client.140553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:04.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:04 smithi027 bash[22610]: cluster 2024-08-31T04:32:04.561337+0000 mgr.a (mgr.14388) 6092 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:04 smithi191 bash[24992]: audit 2024-08-31T04:32:04.410920+0000 mgr.a (mgr.14388) 6091 : audit [DBG] from='client.140553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:04 smithi191 bash[24992]: cluster 2024-08-31T04:32:04.561337+0000 mgr.a (mgr.14388) 6092 : cluster [DBG] pgmap v4221: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:06 smithi163 bash[24253]: cluster 2024-08-31T04:32:06.562207+0000 mgr.a (mgr.14388) 6093 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:06 smithi027 bash[22610]: cluster 2024-08-31T04:32:06.562207+0000 mgr.a (mgr.14388) 6093 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:07.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:06 smithi191 bash[24992]: cluster 2024-08-31T04:32:06.562207+0000 mgr.a (mgr.14388) 6093 : cluster [DBG] pgmap v4222: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:08.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:08 smithi163 bash[24253]: cluster 2024-08-31T04:32:08.564410+0000 mgr.a (mgr.14388) 6094 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:08 smithi027 bash[22610]: cluster 2024-08-31T04:32:08.564410+0000 mgr.a (mgr.14388) 6094 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:08 smithi191 bash[24992]: cluster 2024-08-31T04:32:08.564410+0000 mgr.a (mgr.14388) 6094 : cluster [DBG] pgmap v4223: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:09.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:32:09.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:32:09.823 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:32:10.574 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:32:10.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:32:10.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:32:10.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:32:10.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:32:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:10 smithi163 bash[24253]: audit 2024-08-31T04:32:10.154008+0000 mgr.a (mgr.14388) 6095 : audit [DBG] from='client.140631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:10 smithi163 bash[24253]: cluster 2024-08-31T04:32:10.564973+0000 mgr.a (mgr.14388) 6096 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:10 smithi027 bash[22610]: audit 2024-08-31T04:32:10.154008+0000 mgr.a (mgr.14388) 6095 : audit [DBG] from='client.140631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:10 smithi027 bash[22610]: cluster 2024-08-31T04:32:10.564973+0000 mgr.a (mgr.14388) 6096 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:10 smithi191 bash[24992]: audit 2024-08-31T04:32:10.154008+0000 mgr.a (mgr.14388) 6095 : audit [DBG] from='client.140631 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:10 smithi191 bash[24992]: cluster 2024-08-31T04:32:10.564973+0000 mgr.a (mgr.14388) 6096 : cluster [DBG] pgmap v4224: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:12.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:12 smithi163 bash[24253]: cluster 2024-08-31T04:32:12.565717+0000 mgr.a (mgr.14388) 6097 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:12 smithi027 bash[22610]: cluster 2024-08-31T04:32:12.565717+0000 mgr.a (mgr.14388) 6097 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:12 smithi191 bash[24992]: cluster 2024-08-31T04:32:12.565717+0000 mgr.a (mgr.14388) 6097 : cluster [DBG] pgmap v4225: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:14.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:14 smithi163 bash[24253]: cluster 2024-08-31T04:32:14.567929+0000 mgr.a (mgr.14388) 6098 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:14 smithi027 bash[22610]: cluster 2024-08-31T04:32:14.567929+0000 mgr.a (mgr.14388) 6098 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:14 smithi191 bash[24992]: cluster 2024-08-31T04:32:14.567929+0000 mgr.a (mgr.14388) 6098 : cluster [DBG] pgmap v4226: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:15.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:32:15.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:32:15.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:32:16.349 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:32:16.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:32:16.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:32:16.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:32:16.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:32:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:16 smithi163 bash[24253]: audit 2024-08-31T04:32:15.912467+0000 mgr.a (mgr.14388) 6099 : audit [DBG] from='client.140709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:16 smithi163 bash[24253]: cluster 2024-08-31T04:32:16.568868+0000 mgr.a (mgr.14388) 6100 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:16 smithi027 bash[22610]: audit 2024-08-31T04:32:15.912467+0000 mgr.a (mgr.14388) 6099 : audit [DBG] from='client.140709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:17.004 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:16 smithi027 bash[22610]: cluster 2024-08-31T04:32:16.568868+0000 mgr.a (mgr.14388) 6100 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:16 smithi191 bash[24992]: audit 2024-08-31T04:32:15.912467+0000 mgr.a (mgr.14388) 6099 : audit [DBG] from='client.140709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:16 smithi191 bash[24992]: cluster 2024-08-31T04:32:16.568868+0000 mgr.a (mgr.14388) 6100 : cluster [DBG] pgmap v4227: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:18.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:18 smithi163 bash[24253]: cluster 2024-08-31T04:32:18.571042+0000 mgr.a (mgr.14388) 6101 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:18 smithi027 bash[22610]: cluster 2024-08-31T04:32:18.571042+0000 mgr.a (mgr.14388) 6101 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:18 smithi191 bash[24992]: cluster 2024-08-31T04:32:18.571042+0000 mgr.a (mgr.14388) 6101 : cluster [DBG] pgmap v4228: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:20.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:20 smithi163 bash[24253]: cluster 2024-08-31T04:32:20.571809+0000 mgr.a (mgr.14388) 6102 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:20 smithi027 bash[22610]: cluster 2024-08-31T04:32:20.571809+0000 mgr.a (mgr.14388) 6102 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:20 smithi191 bash[24992]: cluster 2024-08-31T04:32:20.571809+0000 mgr.a (mgr.14388) 6102 : cluster [DBG] pgmap v4229: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:21.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:32:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:32:21.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:32:22.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:32:22.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:32:22.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:32:22.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:32:22.136 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:32:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:22 smithi163 bash[24253]: audit 2024-08-31T04:32:21.686149+0000 mgr.a (mgr.14388) 6103 : audit [DBG] from='client.140784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:22 smithi163 bash[24253]: cluster 2024-08-31T04:32:22.572756+0000 mgr.a (mgr.14388) 6104 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:22 smithi027 bash[22610]: audit 2024-08-31T04:32:21.686149+0000 mgr.a (mgr.14388) 6103 : audit [DBG] from='client.140784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:22 smithi027 bash[22610]: cluster 2024-08-31T04:32:22.572756+0000 mgr.a (mgr.14388) 6104 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:22 smithi191 bash[24992]: audit 2024-08-31T04:32:21.686149+0000 mgr.a (mgr.14388) 6103 : audit [DBG] from='client.140784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:22 smithi191 bash[24992]: cluster 2024-08-31T04:32:22.572756+0000 mgr.a (mgr.14388) 6104 : cluster [DBG] pgmap v4230: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:24 smithi163 bash[24253]: cluster 2024-08-31T04:32:24.574986+0000 mgr.a (mgr.14388) 6105 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:32:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:24 smithi027 bash[22610]: cluster 2024-08-31T04:32:24.574986+0000 mgr.a (mgr.14388) 6105 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:32:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:24 smithi191 bash[24992]: cluster 2024-08-31T04:32:24.574986+0000 mgr.a (mgr.14388) 6105 : cluster [DBG] pgmap v4231: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:32:26.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:26 smithi163 bash[24253]: cluster 2024-08-31T04:32:26.575756+0000 mgr.a (mgr.14388) 6106 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:26 smithi027 bash[22610]: cluster 2024-08-31T04:32:26.575756+0000 mgr.a (mgr.14388) 6106 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:26 smithi191 bash[24992]: cluster 2024-08-31T04:32:26.575756+0000 mgr.a (mgr.14388) 6106 : cluster [DBG] pgmap v4232: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:27.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:32:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:32:27.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:32:27.880 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:32:27.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:32:27.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:32:27.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:32:27.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:32:27.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:27 smithi163 bash[24253]: audit 2024-08-31T04:32:27.467451+0000 mgr.a (mgr.14388) 6107 : audit [DBG] from='client.140862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:27 smithi027 bash[22610]: audit 2024-08-31T04:32:27.467451+0000 mgr.a (mgr.14388) 6107 : audit [DBG] from='client.140862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:27 smithi191 bash[24992]: audit 2024-08-31T04:32:27.467451+0000 mgr.a (mgr.14388) 6107 : audit [DBG] from='client.140862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:28.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:28 smithi163 bash[24253]: cluster 2024-08-31T04:32:28.578062+0000 mgr.a (mgr.14388) 6108 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:28.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:28 smithi027 bash[22610]: cluster 2024-08-31T04:32:28.578062+0000 mgr.a (mgr.14388) 6108 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:28 smithi191 bash[24992]: cluster 2024-08-31T04:32:28.578062+0000 mgr.a (mgr.14388) 6108 : cluster [DBG] pgmap v4233: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:30 smithi163 bash[24253]: cluster 2024-08-31T04:32:30.578993+0000 mgr.a (mgr.14388) 6109 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:30 smithi027 bash[22610]: cluster 2024-08-31T04:32:30.578993+0000 mgr.a (mgr.14388) 6109 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:30 smithi191 bash[24992]: cluster 2024-08-31T04:32:30.578993+0000 mgr.a (mgr.14388) 6109 : cluster [DBG] pgmap v4234: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:32.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:32:32.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:32:32.882 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:32:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:32 smithi163 bash[24253]: cluster 2024-08-31T04:32:32.579798+0000 mgr.a (mgr.14388) 6110 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:32.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:32 smithi027 bash[22610]: cluster 2024-08-31T04:32:32.579798+0000 mgr.a (mgr.14388) 6110 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:32 smithi191 bash[24992]: cluster 2024-08-31T04:32:32.579798+0000 mgr.a (mgr.14388) 6110 : cluster [DBG] pgmap v4235: 225 pgs: 225 active+clean; 589 KiB data, 119 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:32:33.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:32:33.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:32:33.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:32:33.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:32:33.663 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:32:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:33 smithi163 bash[24253]: audit 2024-08-31T04:32:33.220833+0000 mgr.a (mgr.14388) 6111 : audit [DBG] from='client.140937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:33 smithi027 bash[22610]: audit 2024-08-31T04:32:33.220833+0000 mgr.a (mgr.14388) 6111 : audit [DBG] from='client.140937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:33 smithi191 bash[24992]: audit 2024-08-31T04:32:33.220833+0000 mgr.a (mgr.14388) 6111 : audit [DBG] from='client.140937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:34.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:34 smithi163 bash[24253]: cluster 2024-08-31T04:32:34.582588+0000 mgr.a (mgr.14388) 6112 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-08-31T04:32:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:34 smithi027 bash[22610]: cluster 2024-08-31T04:32:34.582588+0000 mgr.a (mgr.14388) 6112 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-08-31T04:32:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:34 smithi191 bash[24992]: cluster 2024-08-31T04:32:34.582588+0000 mgr.a (mgr.14388) 6112 : cluster [DBG] pgmap v4236: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 0 B/s wr, 71 op/s 2024-08-31T04:32:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:36 smithi163 bash[24253]: cluster 2024-08-31T04:32:36.583389+0000 mgr.a (mgr.14388) 6113 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:36.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:36 smithi027 bash[22610]: cluster 2024-08-31T04:32:36.583389+0000 mgr.a (mgr.14388) 6113 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:36 smithi191 bash[24992]: cluster 2024-08-31T04:32:36.583389+0000 mgr.a (mgr.14388) 6113 : cluster [DBG] pgmap v4237: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:38.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:32:38.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:32:38.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:32:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:38 smithi163 bash[24253]: cluster 2024-08-31T04:32:38.585283+0000 mgr.a (mgr.14388) 6114 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:38 smithi027 bash[22610]: cluster 2024-08-31T04:32:38.585283+0000 mgr.a (mgr.14388) 6114 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:38 smithi191 bash[24992]: cluster 2024-08-31T04:32:38.585283+0000 mgr.a (mgr.14388) 6114 : cluster [DBG] pgmap v4238: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:39.440 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:32:39.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:32:39.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:32:39.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:32:39.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:32:39.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:39 smithi163 bash[24253]: audit 2024-08-31T04:32:39.003547+0000 mgr.a (mgr.14388) 6115 : audit [DBG] from='client.141015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:39 smithi027 bash[22610]: audit 2024-08-31T04:32:39.003547+0000 mgr.a (mgr.14388) 6115 : audit [DBG] from='client.141015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:39 smithi191 bash[24992]: audit 2024-08-31T04:32:39.003547+0000 mgr.a (mgr.14388) 6115 : audit [DBG] from='client.141015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:40 smithi163 bash[24253]: cluster 2024-08-31T04:32:40.586251+0000 mgr.a (mgr.14388) 6116 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:40 smithi027 bash[22610]: cluster 2024-08-31T04:32:40.586251+0000 mgr.a (mgr.14388) 6116 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:40 smithi191 bash[24992]: cluster 2024-08-31T04:32:40.586251+0000 mgr.a (mgr.14388) 6116 : cluster [DBG] pgmap v4239: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:42 smithi163 bash[24253]: cluster 2024-08-31T04:32:42.587054+0000 mgr.a (mgr.14388) 6117 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:42 smithi027 bash[22610]: cluster 2024-08-31T04:32:42.587054+0000 mgr.a (mgr.14388) 6117 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:42 smithi191 bash[24992]: cluster 2024-08-31T04:32:42.587054+0000 mgr.a (mgr.14388) 6117 : cluster [DBG] pgmap v4240: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 0 B/s wr, 64 op/s 2024-08-31T04:32:44.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:32:44.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:32:44.443 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:32:44.948 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:44 smithi163 bash[24253]: cluster 2024-08-31T04:32:44.588441+0000 mgr.a (mgr.14388) 6118 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-08-31T04:32:44.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:44 smithi027 bash[22610]: cluster 2024-08-31T04:32:44.588441+0000 mgr.a (mgr.14388) 6118 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-08-31T04:32:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:44 smithi191 bash[24992]: cluster 2024-08-31T04:32:44.588441+0000 mgr.a (mgr.14388) 6118 : cluster [DBG] pgmap v4241: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 0 B/s wr, 65 op/s 2024-08-31T04:32:45.226 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:32:45.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:32:45.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:32:45.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:32:45.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:32:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:45 smithi163 bash[24253]: audit 2024-08-31T04:32:44.787267+0000 mgr.a (mgr.14388) 6119 : audit [DBG] from='client.141090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:45 smithi027 bash[22610]: audit 2024-08-31T04:32:44.787267+0000 mgr.a (mgr.14388) 6119 : audit [DBG] from='client.141090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:45 smithi191 bash[24992]: audit 2024-08-31T04:32:44.787267+0000 mgr.a (mgr.14388) 6119 : audit [DBG] from='client.141090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:46 smithi163 bash[24253]: cluster 2024-08-31T04:32:46.589323+0000 mgr.a (mgr.14388) 6120 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:46 smithi027 bash[22610]: cluster 2024-08-31T04:32:46.589323+0000 mgr.a (mgr.14388) 6120 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:46 smithi191 bash[24992]: cluster 2024-08-31T04:32:46.589323+0000 mgr.a (mgr.14388) 6120 : cluster [DBG] pgmap v4242: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:47 smithi163 bash[24253]: audit 2024-08-31T04:32:47.182339+0000 mon.a (mon.0) 1498 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:32:47.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:47 smithi027 bash[22610]: audit 2024-08-31T04:32:47.182339+0000 mon.a (mon.0) 1498 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:32:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:47 smithi191 bash[24992]: audit 2024-08-31T04:32:47.182339+0000 mon.a (mon.0) 1498 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:32:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:48 smithi163 bash[24253]: audit 2024-08-31T04:32:47.808736+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:32:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:48 smithi163 bash[24253]: audit 2024-08-31T04:32:47.813221+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:32:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:48 smithi163 bash[24253]: cluster 2024-08-31T04:32:48.591056+0000 mgr.a (mgr.14388) 6121 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:48 smithi163 bash[24253]: audit 2024-08-31T04:32:48.625720+0000 mon.a (mon.0) 1501 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:32:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:48 smithi163 bash[24253]: audit 2024-08-31T04:32:48.627310+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:32:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:48 smithi163 bash[24253]: audit 2024-08-31T04:32:48.637473+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:32:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:48 smithi163 bash[24253]: audit 2024-08-31T04:32:48.642237+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:32:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:48 smithi027 bash[22610]: audit 2024-08-31T04:32:47.808736+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:32:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:48 smithi027 bash[22610]: audit 2024-08-31T04:32:47.813221+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:32:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:48 smithi027 bash[22610]: cluster 2024-08-31T04:32:48.591056+0000 mgr.a (mgr.14388) 6121 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:48 smithi027 bash[22610]: audit 2024-08-31T04:32:48.625720+0000 mon.a (mon.0) 1501 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:32:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:48 smithi027 bash[22610]: audit 2024-08-31T04:32:48.627310+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:32:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:48 smithi027 bash[22610]: audit 2024-08-31T04:32:48.637473+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:32:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:48 smithi027 bash[22610]: audit 2024-08-31T04:32:48.642237+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:32:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:48 smithi191 bash[24992]: audit 2024-08-31T04:32:47.808736+0000 mon.a (mon.0) 1499 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:32:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:48 smithi191 bash[24992]: audit 2024-08-31T04:32:47.813221+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:32:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:48 smithi191 bash[24992]: cluster 2024-08-31T04:32:48.591056+0000 mgr.a (mgr.14388) 6121 : cluster [DBG] pgmap v4243: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:32:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:48 smithi191 bash[24992]: audit 2024-08-31T04:32:48.625720+0000 mon.a (mon.0) 1501 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:32:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:48 smithi191 bash[24992]: audit 2024-08-31T04:32:48.627310+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:32:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:48 smithi191 bash[24992]: audit 2024-08-31T04:32:48.637473+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:32:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:48 smithi191 bash[24992]: audit 2024-08-31T04:32:48.642237+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:32:49.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:32:49 smithi027 bash[22863]: debug 2024-08-31T04:32:49.372+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:32:49.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:32:49 smithi027 bash[22863]: debug 2024-08-31T04:32:49.372+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:32:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:49 smithi163 bash[24253]: audit 2024-08-31T04:32:48.643885+0000 mgr.a (mgr.14388) 6122 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:32:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:49 smithi163 bash[24253]: audit 2024-08-31T04:32:49.376087+0000 mgr.a (mgr.14388) 6123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:32:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:49 smithi163 bash[24253]: cephadm 2024-08-31T04:32:49.377370+0000 mgr.a (mgr.14388) 6124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:32:50.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:32:50.229 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:32:50.229 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:32:50.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:49 smithi027 bash[22610]: audit 2024-08-31T04:32:48.643885+0000 mgr.a (mgr.14388) 6122 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:32:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:49 smithi027 bash[22610]: audit 2024-08-31T04:32:49.376087+0000 mgr.a (mgr.14388) 6123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:32:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:49 smithi027 bash[22610]: cephadm 2024-08-31T04:32:49.377370+0000 mgr.a (mgr.14388) 6124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:32:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:49 smithi191 bash[24992]: audit 2024-08-31T04:32:48.643885+0000 mgr.a (mgr.14388) 6122 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:32:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:49 smithi191 bash[24992]: audit 2024-08-31T04:32:49.376087+0000 mgr.a (mgr.14388) 6123 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:32:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:49 smithi191 bash[24992]: cephadm 2024-08-31T04:32:49.377370+0000 mgr.a (mgr.14388) 6124 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:32:51.000 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:32:51.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:32:51.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:32:51.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:32:51.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:32:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:50 smithi163 bash[24253]: audit 2024-08-31T04:32:50.564775+0000 mgr.a (mgr.14388) 6125 : audit [DBG] from='client.141276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:50 smithi163 bash[24253]: cluster 2024-08-31T04:32:50.592068+0000 mgr.a (mgr.14388) 6126 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:50 smithi027 bash[22610]: audit 2024-08-31T04:32:50.564775+0000 mgr.a (mgr.14388) 6125 : audit [DBG] from='client.141276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:50 smithi027 bash[22610]: cluster 2024-08-31T04:32:50.592068+0000 mgr.a (mgr.14388) 6126 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:50 smithi191 bash[24992]: audit 2024-08-31T04:32:50.564775+0000 mgr.a (mgr.14388) 6125 : audit [DBG] from='client.141276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:50 smithi191 bash[24992]: cluster 2024-08-31T04:32:50.592068+0000 mgr.a (mgr.14388) 6126 : cluster [DBG] pgmap v4244: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:52 smithi163 bash[24253]: cluster 2024-08-31T04:32:52.593008+0000 mgr.a (mgr.14388) 6127 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:52 smithi027 bash[22610]: cluster 2024-08-31T04:32:52.593008+0000 mgr.a (mgr.14388) 6127 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:52 smithi191 bash[24992]: cluster 2024-08-31T04:32:52.593008+0000 mgr.a (mgr.14388) 6127 : cluster [DBG] pgmap v4245: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:32:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:54 smithi163 bash[24253]: cluster 2024-08-31T04:32:54.595180+0000 mgr.a (mgr.14388) 6128 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:32:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:54 smithi027 bash[22610]: cluster 2024-08-31T04:32:54.595180+0000 mgr.a (mgr.14388) 6128 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:32:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:54 smithi191 bash[24992]: cluster 2024-08-31T04:32:54.595180+0000 mgr.a (mgr.14388) 6128 : cluster [DBG] pgmap v4246: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:32:56.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:32:56.003 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:32:56.003 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:32:56.752 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:32:56.753 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:32:56.753 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:32:56.753 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:32:56.753 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:32:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:56 smithi163 bash[24253]: audit 2024-08-31T04:32:56.332941+0000 mgr.a (mgr.14388) 6129 : audit [DBG] from='client.141354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:56 smithi163 bash[24253]: cluster 2024-08-31T04:32:56.595784+0000 mgr.a (mgr.14388) 6130 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:32:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:56 smithi027 bash[22610]: audit 2024-08-31T04:32:56.332941+0000 mgr.a (mgr.14388) 6129 : audit [DBG] from='client.141354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:56 smithi027 bash[22610]: cluster 2024-08-31T04:32:56.595784+0000 mgr.a (mgr.14388) 6130 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:32:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:56 smithi191 bash[24992]: audit 2024-08-31T04:32:56.332941+0000 mgr.a (mgr.14388) 6129 : audit [DBG] from='client.141354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:32:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:56 smithi191 bash[24992]: cluster 2024-08-31T04:32:56.595784+0000 mgr.a (mgr.14388) 6130 : cluster [DBG] pgmap v4247: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:32:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:32:58 smithi163 bash[24253]: cluster 2024-08-31T04:32:58.598091+0000 mgr.a (mgr.14388) 6131 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:32:58.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:32:58 smithi027 bash[22610]: cluster 2024-08-31T04:32:58.598091+0000 mgr.a (mgr.14388) 6131 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:32:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:32:58 smithi191 bash[24992]: cluster 2024-08-31T04:32:58.598091+0000 mgr.a (mgr.14388) 6131 : cluster [DBG] pgmap v4248: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:00 smithi163 bash[24253]: cluster 2024-08-31T04:33:00.599054+0000 mgr.a (mgr.14388) 6132 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:00 smithi027 bash[22610]: cluster 2024-08-31T04:33:00.599054+0000 mgr.a (mgr.14388) 6132 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:01.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:00 smithi191 bash[24992]: cluster 2024-08-31T04:33:00.599054+0000 mgr.a (mgr.14388) 6132 : cluster [DBG] pgmap v4249: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:01.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:01.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:01.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:33:02.502 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:33:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:33:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:33:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:33:02.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:33:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:02 smithi163 bash[24253]: audit 2024-08-31T04:33:02.089388+0000 mgr.a (mgr.14388) 6133 : audit [DBG] from='client.141432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:02 smithi163 bash[24253]: cluster 2024-08-31T04:33:02.600011+0000 mgr.a (mgr.14388) 6134 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:02 smithi027 bash[22610]: audit 2024-08-31T04:33:02.089388+0000 mgr.a (mgr.14388) 6133 : audit [DBG] from='client.141432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:02 smithi027 bash[22610]: cluster 2024-08-31T04:33:02.600011+0000 mgr.a (mgr.14388) 6134 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:02 smithi191 bash[24992]: audit 2024-08-31T04:33:02.089388+0000 mgr.a (mgr.14388) 6133 : audit [DBG] from='client.141432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:02 smithi191 bash[24992]: cluster 2024-08-31T04:33:02.600011+0000 mgr.a (mgr.14388) 6134 : cluster [DBG] pgmap v4250: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:04 smithi163 bash[24253]: cluster 2024-08-31T04:33:04.602217+0000 mgr.a (mgr.14388) 6135 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:04 smithi027 bash[22610]: cluster 2024-08-31T04:33:04.602217+0000 mgr.a (mgr.14388) 6135 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:04 smithi191 bash[24992]: cluster 2024-08-31T04:33:04.602217+0000 mgr.a (mgr.14388) 6135 : cluster [DBG] pgmap v4251: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:06 smithi163 bash[24253]: cluster 2024-08-31T04:33:06.602982+0000 mgr.a (mgr.14388) 6136 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:06 smithi027 bash[22610]: cluster 2024-08-31T04:33:06.602982+0000 mgr.a (mgr.14388) 6136 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:06 smithi191 bash[24992]: cluster 2024-08-31T04:33:06.602982+0000 mgr.a (mgr.14388) 6136 : cluster [DBG] pgmap v4252: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:07.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:07.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:07.504 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:33:08.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:33:08.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:33:08.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:33:08.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:33:08.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:33:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:08 smithi163 bash[24253]: audit 2024-08-31T04:33:07.835872+0000 mgr.a (mgr.14388) 6137 : audit [DBG] from='client.141510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:08 smithi163 bash[24253]: cluster 2024-08-31T04:33:08.605639+0000 mgr.a (mgr.14388) 6138 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:33:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:08 smithi027 bash[22610]: audit 2024-08-31T04:33:07.835872+0000 mgr.a (mgr.14388) 6137 : audit [DBG] from='client.141510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:08 smithi027 bash[22610]: cluster 2024-08-31T04:33:08.605639+0000 mgr.a (mgr.14388) 6138 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:33:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:08 smithi191 bash[24992]: audit 2024-08-31T04:33:07.835872+0000 mgr.a (mgr.14388) 6137 : audit [DBG] from='client.141510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:08 smithi191 bash[24992]: cluster 2024-08-31T04:33:08.605639+0000 mgr.a (mgr.14388) 6138 : cluster [DBG] pgmap v4253: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:33:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:10 smithi163 bash[24253]: cluster 2024-08-31T04:33:10.606429+0000 mgr.a (mgr.14388) 6139 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:33:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:10 smithi027 bash[22610]: cluster 2024-08-31T04:33:10.606429+0000 mgr.a (mgr.14388) 6139 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:33:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:10 smithi191 bash[24992]: cluster 2024-08-31T04:33:10.606429+0000 mgr.a (mgr.14388) 6139 : cluster [DBG] pgmap v4254: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:33:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:12 smithi163 bash[24253]: cluster 2024-08-31T04:33:12.607239+0000 mgr.a (mgr.14388) 6140 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:33:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:12 smithi027 bash[22610]: cluster 2024-08-31T04:33:12.607239+0000 mgr.a (mgr.14388) 6140 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:33:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:12 smithi191 bash[24992]: cluster 2024-08-31T04:33:12.607239+0000 mgr.a (mgr.14388) 6140 : cluster [DBG] pgmap v4255: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:33:13.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:13.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:13.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:33:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:13 smithi163 bash[24253]: audit 2024-08-31T04:33:13.584313+0000 mgr.a (mgr.14388) 6141 : audit [DBG] from='client.141585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:13.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:13 smithi027 bash[22610]: audit 2024-08-31T04:33:13.584313+0000 mgr.a (mgr.14388) 6141 : audit [DBG] from='client.141585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:14.006 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:33:14.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:33:14.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:33:14.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:33:14.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:33:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:13 smithi191 bash[24992]: audit 2024-08-31T04:33:13.584313+0000 mgr.a (mgr.14388) 6141 : audit [DBG] from='client.141585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:14.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:14 smithi163 bash[24253]: cluster 2024-08-31T04:33:14.610009+0000 mgr.a (mgr.14388) 6142 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:14 smithi027 bash[22610]: cluster 2024-08-31T04:33:14.610009+0000 mgr.a (mgr.14388) 6142 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:14 smithi191 bash[24992]: cluster 2024-08-31T04:33:14.610009+0000 mgr.a (mgr.14388) 6142 : cluster [DBG] pgmap v4256: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:16 smithi163 bash[24253]: cluster 2024-08-31T04:33:16.610870+0000 mgr.a (mgr.14388) 6143 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:33:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:16 smithi027 bash[22610]: cluster 2024-08-31T04:33:16.610870+0000 mgr.a (mgr.14388) 6143 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:33:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:16 smithi191 bash[24992]: cluster 2024-08-31T04:33:16.610870+0000 mgr.a (mgr.14388) 6143 : cluster [DBG] pgmap v4257: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:33:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:18 smithi163 bash[24253]: cluster 2024-08-31T04:33:18.612785+0000 mgr.a (mgr.14388) 6144 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:18 smithi027 bash[22610]: cluster 2024-08-31T04:33:18.612785+0000 mgr.a (mgr.14388) 6144 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:19.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:19.009 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:33:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:18 smithi191 bash[24992]: cluster 2024-08-31T04:33:18.612785+0000 mgr.a (mgr.14388) 6144 : cluster [DBG] pgmap v4258: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:19.780 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:33:19.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:33:19.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:33:19.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:33:19.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:33:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:19 smithi163 bash[24253]: audit 2024-08-31T04:33:19.349690+0000 mgr.a (mgr.14388) 6145 : audit [DBG] from='client.141660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:19 smithi027 bash[22610]: audit 2024-08-31T04:33:19.349690+0000 mgr.a (mgr.14388) 6145 : audit [DBG] from='client.141660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:19 smithi191 bash[24992]: audit 2024-08-31T04:33:19.349690+0000 mgr.a (mgr.14388) 6145 : audit [DBG] from='client.141660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:20 smithi163 bash[24253]: cluster 2024-08-31T04:33:20.613786+0000 mgr.a (mgr.14388) 6146 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:33:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:20 smithi027 bash[22610]: cluster 2024-08-31T04:33:20.613786+0000 mgr.a (mgr.14388) 6146 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:33:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:20 smithi191 bash[24992]: cluster 2024-08-31T04:33:20.613786+0000 mgr.a (mgr.14388) 6146 : cluster [DBG] pgmap v4259: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:33:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:22 smithi163 bash[24253]: cluster 2024-08-31T04:33:22.614570+0000 mgr.a (mgr.14388) 6147 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:33:22.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:22 smithi027 bash[22610]: cluster 2024-08-31T04:33:22.614570+0000 mgr.a (mgr.14388) 6147 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:33:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:22 smithi191 bash[24992]: cluster 2024-08-31T04:33:22.614570+0000 mgr.a (mgr.14388) 6147 : cluster [DBG] pgmap v4260: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:33:24.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:24.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:24.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:33:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:24 smithi163 bash[24253]: cluster 2024-08-31T04:33:24.616711+0000 mgr.a (mgr.14388) 6148 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:33:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:24 smithi027 bash[22610]: cluster 2024-08-31T04:33:24.616711+0000 mgr.a (mgr.14388) 6148 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:33:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:24 smithi191 bash[24992]: cluster 2024-08-31T04:33:24.616711+0000 mgr.a (mgr.14388) 6148 : cluster [DBG] pgmap v4261: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:33:25.524 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:33:25.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:33:25.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:33:25.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:33:25.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:33:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:25 smithi163 bash[24253]: audit 2024-08-31T04:33:25.108107+0000 mgr.a (mgr.14388) 6149 : audit [DBG] from='client.141735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:25 smithi027 bash[22610]: audit 2024-08-31T04:33:25.108107+0000 mgr.a (mgr.14388) 6149 : audit [DBG] from='client.141735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:25 smithi191 bash[24992]: audit 2024-08-31T04:33:25.108107+0000 mgr.a (mgr.14388) 6149 : audit [DBG] from='client.141735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:26 smithi163 bash[24253]: cluster 2024-08-31T04:33:26.617607+0000 mgr.a (mgr.14388) 6150 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:26 smithi027 bash[22610]: cluster 2024-08-31T04:33:26.617607+0000 mgr.a (mgr.14388) 6150 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:26 smithi191 bash[24992]: cluster 2024-08-31T04:33:26.617607+0000 mgr.a (mgr.14388) 6150 : cluster [DBG] pgmap v4262: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:28 smithi163 bash[24253]: cluster 2024-08-31T04:33:28.619868+0000 mgr.a (mgr.14388) 6151 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:28 smithi027 bash[22610]: cluster 2024-08-31T04:33:28.619868+0000 mgr.a (mgr.14388) 6151 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:28 smithi191 bash[24992]: cluster 2024-08-31T04:33:28.619868+0000 mgr.a (mgr.14388) 6151 : cluster [DBG] pgmap v4263: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:30.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:30.526 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:30.526 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:33:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:30 smithi163 bash[24253]: cluster 2024-08-31T04:33:30.620500+0000 mgr.a (mgr.14388) 6152 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:30.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:30 smithi027 bash[22610]: cluster 2024-08-31T04:33:30.620500+0000 mgr.a (mgr.14388) 6152 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:30 smithi191 bash[24992]: cluster 2024-08-31T04:33:30.620500+0000 mgr.a (mgr.14388) 6152 : cluster [DBG] pgmap v4264: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:31.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:33:31.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:33:31.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:33:31.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:33:31.312 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:33:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:31 smithi163 bash[24253]: audit 2024-08-31T04:33:30.868315+0000 mgr.a (mgr.14388) 6153 : audit [DBG] from='client.141813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:31 smithi027 bash[22610]: audit 2024-08-31T04:33:30.868315+0000 mgr.a (mgr.14388) 6153 : audit [DBG] from='client.141813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:31 smithi191 bash[24992]: audit 2024-08-31T04:33:30.868315+0000 mgr.a (mgr.14388) 6153 : audit [DBG] from='client.141813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:32 smithi027 bash[22610]: cluster 2024-08-31T04:33:32.621395+0000 mgr.a (mgr.14388) 6154 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:32 smithi191 bash[24992]: cluster 2024-08-31T04:33:32.621395+0000 mgr.a (mgr.14388) 6154 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:32 smithi163 bash[24253]: cluster 2024-08-31T04:33:32.621395+0000 mgr.a (mgr.14388) 6154 : cluster [DBG] pgmap v4265: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:34 smithi163 bash[24253]: cluster 2024-08-31T04:33:34.623584+0000 mgr.a (mgr.14388) 6155 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:34 smithi027 bash[22610]: cluster 2024-08-31T04:33:34.623584+0000 mgr.a (mgr.14388) 6155 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:34 smithi191 bash[24992]: cluster 2024-08-31T04:33:34.623584+0000 mgr.a (mgr.14388) 6155 : cluster [DBG] pgmap v4266: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:36.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:36.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:36.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:33:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:36 smithi163 bash[24253]: cluster 2024-08-31T04:33:36.624125+0000 mgr.a (mgr.14388) 6156 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:36.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:36 smithi027 bash[22610]: cluster 2024-08-31T04:33:36.624125+0000 mgr.a (mgr.14388) 6156 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:36 smithi191 bash[24992]: cluster 2024-08-31T04:33:36.624125+0000 mgr.a (mgr.14388) 6156 : cluster [DBG] pgmap v4267: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:37.105 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:33:37.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:33:37.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:33:37.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:33:37.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:33:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:37 smithi163 bash[24253]: audit 2024-08-31T04:33:36.651055+0000 mgr.a (mgr.14388) 6157 : audit [DBG] from='client.141888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:37 smithi027 bash[22610]: audit 2024-08-31T04:33:36.651055+0000 mgr.a (mgr.14388) 6157 : audit [DBG] from='client.141888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:37 smithi191 bash[24992]: audit 2024-08-31T04:33:36.651055+0000 mgr.a (mgr.14388) 6157 : audit [DBG] from='client.141888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:39 smithi163 bash[24253]: cluster 2024-08-31T04:33:38.626314+0000 mgr.a (mgr.14388) 6158 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:39 smithi027 bash[22610]: cluster 2024-08-31T04:33:38.626314+0000 mgr.a (mgr.14388) 6158 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:39 smithi191 bash[24992]: cluster 2024-08-31T04:33:38.626314+0000 mgr.a (mgr.14388) 6158 : cluster [DBG] pgmap v4268: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:41 smithi163 bash[24253]: cluster 2024-08-31T04:33:40.627096+0000 mgr.a (mgr.14388) 6159 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:41 smithi027 bash[22610]: cluster 2024-08-31T04:33:40.627096+0000 mgr.a (mgr.14388) 6159 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:41 smithi191 bash[24992]: cluster 2024-08-31T04:33:40.627096+0000 mgr.a (mgr.14388) 6159 : cluster [DBG] pgmap v4269: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:42.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:42.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:42.108 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:33:42.860 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:33:42.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:33:42.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:33:42.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:33:42.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:33:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:42 smithi027 bash[22610]: audit 2024-08-31T04:33:42.431850+0000 mgr.a (mgr.14388) 6160 : audit [DBG] from='client.141963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:42 smithi191 bash[24992]: audit 2024-08-31T04:33:42.431850+0000 mgr.a (mgr.14388) 6160 : audit [DBG] from='client.141963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:42 smithi163 bash[24253]: audit 2024-08-31T04:33:42.431850+0000 mgr.a (mgr.14388) 6160 : audit [DBG] from='client.141963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:43 smithi027 bash[22610]: cluster 2024-08-31T04:33:42.627644+0000 mgr.a (mgr.14388) 6161 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:43 smithi191 bash[24992]: cluster 2024-08-31T04:33:42.627644+0000 mgr.a (mgr.14388) 6161 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:43 smithi163 bash[24253]: cluster 2024-08-31T04:33:42.627644+0000 mgr.a (mgr.14388) 6161 : cluster [DBG] pgmap v4270: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:45 smithi027 bash[22610]: cluster 2024-08-31T04:33:44.629900+0000 mgr.a (mgr.14388) 6162 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:45 smithi191 bash[24992]: cluster 2024-08-31T04:33:44.629900+0000 mgr.a (mgr.14388) 6162 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:46.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:45 smithi163 bash[24253]: cluster 2024-08-31T04:33:44.629900+0000 mgr.a (mgr.14388) 6162 : cluster [DBG] pgmap v4271: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:33:47.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:47.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:47.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:33:47.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:47 smithi027 bash[22610]: cluster 2024-08-31T04:33:46.630662+0000 mgr.a (mgr.14388) 6163 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:47 smithi191 bash[24992]: cluster 2024-08-31T04:33:46.630662+0000 mgr.a (mgr.14388) 6163 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:48.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:47 smithi163 bash[24253]: cluster 2024-08-31T04:33:46.630662+0000 mgr.a (mgr.14388) 6163 : cluster [DBG] pgmap v4272: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:48.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:33:48.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:33:48.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:33:48.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:33:48.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:33:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:48 smithi027 bash[22610]: audit 2024-08-31T04:33:48.196569+0000 mgr.a (mgr.14388) 6164 : audit [DBG] from='client.142038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:48 smithi191 bash[24992]: audit 2024-08-31T04:33:48.196569+0000 mgr.a (mgr.14388) 6164 : audit [DBG] from='client.142038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:48 smithi163 bash[24253]: audit 2024-08-31T04:33:48.196569+0000 mgr.a (mgr.14388) 6164 : audit [DBG] from='client.142038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:49 smithi027 bash[22610]: cluster 2024-08-31T04:33:48.631978+0000 mgr.a (mgr.14388) 6165 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:49.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:49 smithi027 bash[22610]: audit 2024-08-31T04:33:49.430180+0000 mon.a (mon.0) 1505 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:33:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:49 smithi191 bash[24992]: cluster 2024-08-31T04:33:48.631978+0000 mgr.a (mgr.14388) 6165 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:49 smithi191 bash[24992]: audit 2024-08-31T04:33:49.430180+0000 mon.a (mon.0) 1505 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:33:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:49 smithi163 bash[24253]: cluster 2024-08-31T04:33:48.631978+0000 mgr.a (mgr.14388) 6165 : cluster [DBG] pgmap v4273: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:33:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:49 smithi163 bash[24253]: audit 2024-08-31T04:33:49.430180+0000 mon.a (mon.0) 1505 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:33:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:51 smithi163 bash[24253]: audit 2024-08-31T04:33:50.047636+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:51 smithi163 bash[24253]: audit 2024-08-31T04:33:50.053711+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:51 smithi163 bash[24253]: audit 2024-08-31T04:33:50.059929+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:51 smithi163 bash[24253]: audit 2024-08-31T04:33:50.066448+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:51 smithi163 bash[24253]: audit 2024-08-31T04:33:50.832785+0000 mon.a (mon.0) 1510 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:33:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:51 smithi163 bash[24253]: audit 2024-08-31T04:33:50.834630+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:33:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:51 smithi163 bash[24253]: audit 2024-08-31T04:33:50.843516+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:51 smithi163 bash[24253]: audit 2024-08-31T04:33:50.848971+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:33:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:51 smithi027 bash[22610]: audit 2024-08-31T04:33:50.047636+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:51 smithi027 bash[22610]: audit 2024-08-31T04:33:50.053711+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:51 smithi027 bash[22610]: audit 2024-08-31T04:33:50.059929+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:51 smithi027 bash[22610]: audit 2024-08-31T04:33:50.066448+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:51 smithi027 bash[22610]: audit 2024-08-31T04:33:50.832785+0000 mon.a (mon.0) 1510 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:33:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:51 smithi027 bash[22610]: audit 2024-08-31T04:33:50.834630+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:33:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:51 smithi027 bash[22610]: audit 2024-08-31T04:33:50.843516+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:51 smithi027 bash[22610]: audit 2024-08-31T04:33:50.848971+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:33:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:51 smithi191 bash[24992]: audit 2024-08-31T04:33:50.047636+0000 mon.a (mon.0) 1506 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:51 smithi191 bash[24992]: audit 2024-08-31T04:33:50.053711+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:51 smithi191 bash[24992]: audit 2024-08-31T04:33:50.059929+0000 mon.a (mon.0) 1508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:51 smithi191 bash[24992]: audit 2024-08-31T04:33:50.066448+0000 mon.a (mon.0) 1509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:51 smithi191 bash[24992]: audit 2024-08-31T04:33:50.832785+0000 mon.a (mon.0) 1510 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:33:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:51 smithi191 bash[24992]: audit 2024-08-31T04:33:50.834630+0000 mon.a (mon.0) 1511 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:33:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:51 smithi191 bash[24992]: audit 2024-08-31T04:33:50.843516+0000 mon.a (mon.0) 1512 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:33:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:51 smithi191 bash[24992]: audit 2024-08-31T04:33:50.848971+0000 mon.a (mon.0) 1513 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:33:51.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:33:51 smithi027 bash[22863]: debug 2024-08-31T04:33:51.579+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:33:51.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:33:51 smithi027 bash[22863]: debug 2024-08-31T04:33:51.579+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:33:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:52 smithi163 bash[24253]: cluster 2024-08-31T04:33:50.632701+0000 mgr.a (mgr.14388) 6166 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:33:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:52 smithi163 bash[24253]: audit 2024-08-31T04:33:50.851406+0000 mgr.a (mgr.14388) 6167 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:33:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:52 smithi163 bash[24253]: audit 2024-08-31T04:33:51.583729+0000 mgr.a (mgr.14388) 6168 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:33:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:52 smithi163 bash[24253]: cephadm 2024-08-31T04:33:51.585247+0000 mgr.a (mgr.14388) 6169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:33:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:52 smithi027 bash[22610]: cluster 2024-08-31T04:33:50.632701+0000 mgr.a (mgr.14388) 6166 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:33:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:52 smithi027 bash[22610]: audit 2024-08-31T04:33:50.851406+0000 mgr.a (mgr.14388) 6167 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:33:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:52 smithi027 bash[22610]: audit 2024-08-31T04:33:51.583729+0000 mgr.a (mgr.14388) 6168 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:33:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:52 smithi027 bash[22610]: cephadm 2024-08-31T04:33:51.585247+0000 mgr.a (mgr.14388) 6169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:33:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:52 smithi191 bash[24992]: cluster 2024-08-31T04:33:50.632701+0000 mgr.a (mgr.14388) 6166 : cluster [DBG] pgmap v4274: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:33:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:52 smithi191 bash[24992]: audit 2024-08-31T04:33:50.851406+0000 mgr.a (mgr.14388) 6167 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:33:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:52 smithi191 bash[24992]: audit 2024-08-31T04:33:51.583729+0000 mgr.a (mgr.14388) 6168 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:33:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:52 smithi191 bash[24992]: cephadm 2024-08-31T04:33:51.585247+0000 mgr.a (mgr.14388) 6169 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:33:53.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:53.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:53.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:33:54.368 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:33:54.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:33:54.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:33:54.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:33:54.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:33:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:54 smithi163 bash[24253]: cluster 2024-08-31T04:33:52.633602+0000 mgr.a (mgr.14388) 6170 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:33:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:54 smithi027 bash[22610]: cluster 2024-08-31T04:33:52.633602+0000 mgr.a (mgr.14388) 6170 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:33:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:54 smithi191 bash[24992]: cluster 2024-08-31T04:33:52.633602+0000 mgr.a (mgr.14388) 6170 : cluster [DBG] pgmap v4275: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:33:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:55 smithi163 bash[24253]: audit 2024-08-31T04:33:53.938808+0000 mgr.a (mgr.14388) 6171 : audit [DBG] from='client.142221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:55 smithi027 bash[22610]: audit 2024-08-31T04:33:53.938808+0000 mgr.a (mgr.14388) 6171 : audit [DBG] from='client.142221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:55 smithi191 bash[24992]: audit 2024-08-31T04:33:53.938808+0000 mgr.a (mgr.14388) 6171 : audit [DBG] from='client.142221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:33:56.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:56 smithi163 bash[24253]: cluster 2024-08-31T04:33:54.636982+0000 mgr.a (mgr.14388) 6172 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:56 smithi027 bash[22610]: cluster 2024-08-31T04:33:54.636982+0000 mgr.a (mgr.14388) 6172 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:56 smithi191 bash[24992]: cluster 2024-08-31T04:33:54.636982+0000 mgr.a (mgr.14388) 6172 : cluster [DBG] pgmap v4276: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:33:58.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:33:58 smithi163 bash[24253]: cluster 2024-08-31T04:33:56.637834+0000 mgr.a (mgr.14388) 6173 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:33:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:33:58 smithi027 bash[22610]: cluster 2024-08-31T04:33:56.637834+0000 mgr.a (mgr.14388) 6173 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:33:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:33:58 smithi191 bash[24992]: cluster 2024-08-31T04:33:56.637834+0000 mgr.a (mgr.14388) 6173 : cluster [DBG] pgmap v4277: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:33:59.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:33:59.370 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:33:59.371 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:00.131 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:00.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:00 smithi163 bash[24253]: cluster 2024-08-31T04:33:58.639975+0000 mgr.a (mgr.14388) 6174 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:00 smithi027 bash[22610]: cluster 2024-08-31T04:33:58.639975+0000 mgr.a (mgr.14388) 6174 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:00 smithi191 bash[24992]: cluster 2024-08-31T04:33:58.639975+0000 mgr.a (mgr.14388) 6174 : cluster [DBG] pgmap v4278: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:01 smithi163 bash[24253]: audit 2024-08-31T04:33:59.705678+0000 mgr.a (mgr.14388) 6175 : audit [DBG] from='client.142299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:01 smithi027 bash[22610]: audit 2024-08-31T04:33:59.705678+0000 mgr.a (mgr.14388) 6175 : audit [DBG] from='client.142299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:01 smithi191 bash[24992]: audit 2024-08-31T04:33:59.705678+0000 mgr.a (mgr.14388) 6175 : audit [DBG] from='client.142299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:02 smithi163 bash[24253]: cluster 2024-08-31T04:34:00.641097+0000 mgr.a (mgr.14388) 6176 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:02 smithi027 bash[22610]: cluster 2024-08-31T04:34:00.641097+0000 mgr.a (mgr.14388) 6176 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:02 smithi191 bash[24992]: cluster 2024-08-31T04:34:00.641097+0000 mgr.a (mgr.14388) 6176 : cluster [DBG] pgmap v4279: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:04.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:04 smithi163 bash[24253]: cluster 2024-08-31T04:34:02.641870+0000 mgr.a (mgr.14388) 6177 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:04 smithi027 bash[22610]: cluster 2024-08-31T04:34:02.641870+0000 mgr.a (mgr.14388) 6177 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:04 smithi191 bash[24992]: cluster 2024-08-31T04:34:02.641870+0000 mgr.a (mgr.14388) 6177 : cluster [DBG] pgmap v4280: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:05.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:34:05.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:34:05.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:05.888 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:05.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:05.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:05.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:05.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:06.111 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:06 smithi191 bash[24992]: cluster 2024-08-31T04:34:04.644091+0000 mgr.a (mgr.14388) 6178 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:06 smithi163 bash[24253]: cluster 2024-08-31T04:34:04.644091+0000 mgr.a (mgr.14388) 6178 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:06 smithi163 bash[24253]: audit 2024-08-31T04:34:05.465178+0000 mgr.a (mgr.14388) 6179 : audit [DBG] from='client.142377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:06 smithi027 bash[22610]: cluster 2024-08-31T04:34:04.644091+0000 mgr.a (mgr.14388) 6178 : cluster [DBG] pgmap v4281: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:34:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:06 smithi027 bash[22610]: audit 2024-08-31T04:34:05.465178+0000 mgr.a (mgr.14388) 6179 : audit [DBG] from='client.142377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:08 smithi163 bash[24253]: cluster 2024-08-31T04:34:06.645136+0000 mgr.a (mgr.14388) 6180 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:08 smithi027 bash[22610]: cluster 2024-08-31T04:34:06.645136+0000 mgr.a (mgr.14388) 6180 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:06 smithi191 bash[24992]: audit 2024-08-31T04:34:05.465178+0000 mgr.a (mgr.14388) 6179 : audit [DBG] from='client.142377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:08 smithi191 bash[24992]: cluster 2024-08-31T04:34:06.645136+0000 mgr.a (mgr.14388) 6180 : cluster [DBG] pgmap v4282: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:10.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:10 smithi163 bash[24253]: cluster 2024-08-31T04:34:08.647525+0000 mgr.a (mgr.14388) 6181 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:10 smithi027 bash[22610]: cluster 2024-08-31T04:34:08.647525+0000 mgr.a (mgr.14388) 6181 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:10 smithi191 bash[24992]: cluster 2024-08-31T04:34:08.647525+0000 mgr.a (mgr.14388) 6181 : cluster [DBG] pgmap v4283: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:10.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:34:10.890 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:34:10.890 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:11.654 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:11.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:11.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:11.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:11.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:12 smithi163 bash[24253]: cluster 2024-08-31T04:34:10.648453+0000 mgr.a (mgr.14388) 6182 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:12 smithi163 bash[24253]: audit 2024-08-31T04:34:11.229953+0000 mgr.a (mgr.14388) 6183 : audit [DBG] from='client.142455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:12 smithi027 bash[22610]: cluster 2024-08-31T04:34:10.648453+0000 mgr.a (mgr.14388) 6182 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:12 smithi027 bash[22610]: audit 2024-08-31T04:34:11.229953+0000 mgr.a (mgr.14388) 6183 : audit [DBG] from='client.142455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:12 smithi191 bash[24992]: cluster 2024-08-31T04:34:10.648453+0000 mgr.a (mgr.14388) 6182 : cluster [DBG] pgmap v4284: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:12 smithi191 bash[24992]: audit 2024-08-31T04:34:11.229953+0000 mgr.a (mgr.14388) 6183 : audit [DBG] from='client.142455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:14 smithi163 bash[24253]: cluster 2024-08-31T04:34:12.649346+0000 mgr.a (mgr.14388) 6184 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:14 smithi027 bash[22610]: cluster 2024-08-31T04:34:12.649346+0000 mgr.a (mgr.14388) 6184 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:14 smithi191 bash[24992]: cluster 2024-08-31T04:34:12.649346+0000 mgr.a (mgr.14388) 6184 : cluster [DBG] pgmap v4285: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:16.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:16 smithi163 bash[24253]: cluster 2024-08-31T04:34:14.651604+0000 mgr.a (mgr.14388) 6185 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:16 smithi027 bash[22610]: cluster 2024-08-31T04:34:14.651604+0000 mgr.a (mgr.14388) 6185 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:16 smithi191 bash[24992]: cluster 2024-08-31T04:34:14.651604+0000 mgr.a (mgr.14388) 6185 : cluster [DBG] pgmap v4286: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:16.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:34:16.656 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:34:16.656 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:17.396 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:17.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:17.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:17.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:17.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:18 smithi163 bash[24253]: cluster 2024-08-31T04:34:16.652369+0000 mgr.a (mgr.14388) 6186 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:18 smithi163 bash[24253]: audit 2024-08-31T04:34:16.988297+0000 mgr.a (mgr.14388) 6187 : audit [DBG] from='client.142530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:18 smithi027 bash[22610]: cluster 2024-08-31T04:34:16.652369+0000 mgr.a (mgr.14388) 6186 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:18 smithi027 bash[22610]: audit 2024-08-31T04:34:16.988297+0000 mgr.a (mgr.14388) 6187 : audit [DBG] from='client.142530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:18 smithi191 bash[24992]: cluster 2024-08-31T04:34:16.652369+0000 mgr.a (mgr.14388) 6186 : cluster [DBG] pgmap v4287: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:18 smithi191 bash[24992]: audit 2024-08-31T04:34:16.988297+0000 mgr.a (mgr.14388) 6187 : audit [DBG] from='client.142530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:20 smithi163 bash[24253]: cluster 2024-08-31T04:34:18.654683+0000 mgr.a (mgr.14388) 6188 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:20 smithi027 bash[22610]: cluster 2024-08-31T04:34:18.654683+0000 mgr.a (mgr.14388) 6188 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:20 smithi191 bash[24992]: cluster 2024-08-31T04:34:18.654683+0000 mgr.a (mgr.14388) 6188 : cluster [DBG] pgmap v4288: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:22.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:34:22.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:34:22.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:22 smithi163 bash[24253]: cluster 2024-08-31T04:34:20.655672+0000 mgr.a (mgr.14388) 6189 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:22 smithi027 bash[22610]: cluster 2024-08-31T04:34:20.655672+0000 mgr.a (mgr.14388) 6189 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:22 smithi191 bash[24992]: cluster 2024-08-31T04:34:20.655672+0000 mgr.a (mgr.14388) 6189 : cluster [DBG] pgmap v4289: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:23.176 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:23.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:23.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:23.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:24 smithi163 bash[24253]: cluster 2024-08-31T04:34:22.656447+0000 mgr.a (mgr.14388) 6190 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:24 smithi163 bash[24253]: audit 2024-08-31T04:34:22.738348+0000 mgr.a (mgr.14388) 6191 : audit [DBG] from='client.142602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:24 smithi027 bash[22610]: cluster 2024-08-31T04:34:22.656447+0000 mgr.a (mgr.14388) 6190 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:24 smithi027 bash[22610]: audit 2024-08-31T04:34:22.738348+0000 mgr.a (mgr.14388) 6191 : audit [DBG] from='client.142602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:24 smithi191 bash[24992]: cluster 2024-08-31T04:34:22.656447+0000 mgr.a (mgr.14388) 6190 : cluster [DBG] pgmap v4290: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:24 smithi191 bash[24992]: audit 2024-08-31T04:34:22.738348+0000 mgr.a (mgr.14388) 6191 : audit [DBG] from='client.142602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:26 smithi163 bash[24253]: cluster 2024-08-31T04:34:24.658976+0000 mgr.a (mgr.14388) 6192 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:34:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:26 smithi027 bash[22610]: cluster 2024-08-31T04:34:24.658976+0000 mgr.a (mgr.14388) 6192 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:34:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:26 smithi191 bash[24992]: cluster 2024-08-31T04:34:24.658976+0000 mgr.a (mgr.14388) 6192 : cluster [DBG] pgmap v4291: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:34:28.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:34:28.178 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:34:28.179 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:28 smithi163 bash[24253]: cluster 2024-08-31T04:34:26.659745+0000 mgr.a (mgr.14388) 6193 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:34:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:28 smithi027 bash[22610]: cluster 2024-08-31T04:34:26.659745+0000 mgr.a (mgr.14388) 6193 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:34:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:28 smithi191 bash[24992]: cluster 2024-08-31T04:34:26.659745+0000 mgr.a (mgr.14388) 6193 : cluster [DBG] pgmap v4292: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:34:28.954 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:28.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:28.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:28.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:28.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:29 smithi163 bash[24253]: audit 2024-08-31T04:34:28.513896+0000 mgr.a (mgr.14388) 6194 : audit [DBG] from='client.142680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:29 smithi027 bash[22610]: audit 2024-08-31T04:34:28.513896+0000 mgr.a (mgr.14388) 6194 : audit [DBG] from='client.142680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:29 smithi191 bash[24992]: audit 2024-08-31T04:34:28.513896+0000 mgr.a (mgr.14388) 6194 : audit [DBG] from='client.142680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:30 smithi163 bash[24253]: cluster 2024-08-31T04:34:28.663998+0000 mgr.a (mgr.14388) 6195 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:30 smithi027 bash[22610]: cluster 2024-08-31T04:34:28.663998+0000 mgr.a (mgr.14388) 6195 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:30 smithi191 bash[24992]: cluster 2024-08-31T04:34:28.663998+0000 mgr.a (mgr.14388) 6195 : cluster [DBG] pgmap v4293: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:32 smithi163 bash[24253]: cluster 2024-08-31T04:34:30.664864+0000 mgr.a (mgr.14388) 6196 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:34:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:32 smithi027 bash[22610]: cluster 2024-08-31T04:34:30.664864+0000 mgr.a (mgr.14388) 6196 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:34:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:32 smithi191 bash[24992]: cluster 2024-08-31T04:34:30.664864+0000 mgr.a (mgr.14388) 6196 : cluster [DBG] pgmap v4294: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:34:33.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:34:33.956 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:34:33.956 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:34.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:34 smithi163 bash[24253]: cluster 2024-08-31T04:34:32.665649+0000 mgr.a (mgr.14388) 6197 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:34:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:34 smithi027 bash[22610]: cluster 2024-08-31T04:34:32.665649+0000 mgr.a (mgr.14388) 6197 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:34:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:34 smithi191 bash[24992]: cluster 2024-08-31T04:34:32.665649+0000 mgr.a (mgr.14388) 6197 : cluster [DBG] pgmap v4295: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:34:34.736 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:34.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:34.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:34.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:34.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:35 smithi163 bash[24253]: audit 2024-08-31T04:34:34.289911+0000 mgr.a (mgr.14388) 6198 : audit [DBG] from='client.142755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:35 smithi027 bash[22610]: audit 2024-08-31T04:34:34.289911+0000 mgr.a (mgr.14388) 6198 : audit [DBG] from='client.142755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:35 smithi191 bash[24992]: audit 2024-08-31T04:34:34.289911+0000 mgr.a (mgr.14388) 6198 : audit [DBG] from='client.142755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:36 smithi163 bash[24253]: cluster 2024-08-31T04:34:34.668011+0000 mgr.a (mgr.14388) 6199 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:36 smithi027 bash[22610]: cluster 2024-08-31T04:34:34.668011+0000 mgr.a (mgr.14388) 6199 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:36 smithi191 bash[24992]: cluster 2024-08-31T04:34:34.668011+0000 mgr.a (mgr.14388) 6199 : cluster [DBG] pgmap v4296: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:38 smithi163 bash[24253]: cluster 2024-08-31T04:34:36.668809+0000 mgr.a (mgr.14388) 6200 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:34:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:38 smithi027 bash[22610]: cluster 2024-08-31T04:34:36.668809+0000 mgr.a (mgr.14388) 6200 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:34:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:38 smithi191 bash[24992]: cluster 2024-08-31T04:34:36.668809+0000 mgr.a (mgr.14388) 6200 : cluster [DBG] pgmap v4297: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:34:39.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:34:39.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:34:39.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:40.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:40 smithi163 bash[24253]: cluster 2024-08-31T04:34:38.670800+0000 mgr.a (mgr.14388) 6201 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:34:40.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:40 smithi027 bash[22610]: cluster 2024-08-31T04:34:38.670800+0000 mgr.a (mgr.14388) 6201 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:34:40.490 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:40.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:40.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:40.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:40.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:40 smithi191 bash[24992]: cluster 2024-08-31T04:34:38.670800+0000 mgr.a (mgr.14388) 6201 : cluster [DBG] pgmap v4298: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:34:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:41 smithi027 bash[22610]: audit 2024-08-31T04:34:40.069515+0000 mgr.a (mgr.14388) 6202 : audit [DBG] from='client.142833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:41 smithi191 bash[24992]: audit 2024-08-31T04:34:40.069515+0000 mgr.a (mgr.14388) 6202 : audit [DBG] from='client.142833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:41 smithi163 bash[24253]: audit 2024-08-31T04:34:40.069515+0000 mgr.a (mgr.14388) 6202 : audit [DBG] from='client.142833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:42 smithi027 bash[22610]: cluster 2024-08-31T04:34:40.671655+0000 mgr.a (mgr.14388) 6203 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:42 smithi191 bash[24992]: cluster 2024-08-31T04:34:40.671655+0000 mgr.a (mgr.14388) 6203 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:42 smithi163 bash[24253]: cluster 2024-08-31T04:34:40.671655+0000 mgr.a (mgr.14388) 6203 : cluster [DBG] pgmap v4299: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:44 smithi027 bash[22610]: cluster 2024-08-31T04:34:42.672442+0000 mgr.a (mgr.14388) 6204 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:44 smithi191 bash[24992]: cluster 2024-08-31T04:34:42.672442+0000 mgr.a (mgr.14388) 6204 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:44 smithi163 bash[24253]: cluster 2024-08-31T04:34:42.672442+0000 mgr.a (mgr.14388) 6204 : cluster [DBG] pgmap v4300: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:45.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:34:45.492 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:34:45.492 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:46.268 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:46.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:46.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:46.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:46.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:46 smithi027 bash[22610]: cluster 2024-08-31T04:34:44.674670+0000 mgr.a (mgr.14388) 6205 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:46 smithi191 bash[24992]: cluster 2024-08-31T04:34:44.674670+0000 mgr.a (mgr.14388) 6205 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:46 smithi163 bash[24253]: cluster 2024-08-31T04:34:44.674670+0000 mgr.a (mgr.14388) 6205 : cluster [DBG] pgmap v4301: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:47 smithi027 bash[22610]: audit 2024-08-31T04:34:45.829080+0000 mgr.a (mgr.14388) 6206 : audit [DBG] from='client.142908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:47 smithi191 bash[24992]: audit 2024-08-31T04:34:45.829080+0000 mgr.a (mgr.14388) 6206 : audit [DBG] from='client.142908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:47 smithi163 bash[24253]: audit 2024-08-31T04:34:45.829080+0000 mgr.a (mgr.14388) 6206 : audit [DBG] from='client.142908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:48 smithi027 bash[22610]: cluster 2024-08-31T04:34:46.675592+0000 mgr.a (mgr.14388) 6207 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:48 smithi191 bash[24992]: cluster 2024-08-31T04:34:46.675592+0000 mgr.a (mgr.14388) 6207 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:48 smithi163 bash[24253]: cluster 2024-08-31T04:34:46.675592+0000 mgr.a (mgr.14388) 6207 : cluster [DBG] pgmap v4302: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:50 smithi191 bash[24992]: cluster 2024-08-31T04:34:48.677822+0000 mgr.a (mgr.14388) 6208 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:50 smithi163 bash[24253]: cluster 2024-08-31T04:34:48.677822+0000 mgr.a (mgr.14388) 6208 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:50 smithi027 bash[22610]: cluster 2024-08-31T04:34:48.677822+0000 mgr.a (mgr.14388) 6208 : cluster [DBG] pgmap v4303: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:34:51.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:34:51.270 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:34:51.270 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:52.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:52.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:52.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:52.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:52.037 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:52 smithi191 bash[24992]: cluster 2024-08-31T04:34:50.678812+0000 mgr.a (mgr.14388) 6209 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:52 smithi191 bash[24992]: audit 2024-08-31T04:34:51.604546+0000 mgr.a (mgr.14388) 6210 : audit [DBG] from='client.142980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:52 smithi191 bash[24992]: audit 2024-08-31T04:34:51.638616+0000 mon.a (mon.0) 1514 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:34:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:52 smithi163 bash[24253]: cluster 2024-08-31T04:34:50.678812+0000 mgr.a (mgr.14388) 6209 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:52 smithi163 bash[24253]: audit 2024-08-31T04:34:51.604546+0000 mgr.a (mgr.14388) 6210 : audit [DBG] from='client.142980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:52 smithi163 bash[24253]: audit 2024-08-31T04:34:51.638616+0000 mon.a (mon.0) 1514 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:34:52.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:52 smithi027 bash[22610]: cluster 2024-08-31T04:34:50.678812+0000 mgr.a (mgr.14388) 6209 : cluster [DBG] pgmap v4304: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:52 smithi027 bash[22610]: audit 2024-08-31T04:34:51.604546+0000 mgr.a (mgr.14388) 6210 : audit [DBG] from='client.142980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:52 smithi027 bash[22610]: audit 2024-08-31T04:34:51.638616+0000 mon.a (mon.0) 1514 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:34:53.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:34:53 smithi027 bash[22863]: debug 2024-08-31T04:34:53.165+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:34:53.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:34:53 smithi027 bash[22863]: debug 2024-08-31T04:34:53.169+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:34:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:53 smithi027 bash[22610]: audit 2024-08-31T04:34:52.446866+0000 mon.a (mon.0) 1515 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:34:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:53 smithi027 bash[22610]: audit 2024-08-31T04:34:52.448256+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:34:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:53 smithi027 bash[22610]: audit 2024-08-31T04:34:52.458576+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:34:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:53 smithi027 bash[22610]: audit 2024-08-31T04:34:52.461073+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:34:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:53 smithi027 bash[22610]: audit 2024-08-31T04:34:52.463498+0000 mgr.a (mgr.14388) 6211 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:34:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:53 smithi191 bash[24992]: audit 2024-08-31T04:34:52.446866+0000 mon.a (mon.0) 1515 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:34:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:53 smithi191 bash[24992]: audit 2024-08-31T04:34:52.448256+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:34:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:53 smithi191 bash[24992]: audit 2024-08-31T04:34:52.458576+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:34:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:53 smithi191 bash[24992]: audit 2024-08-31T04:34:52.461073+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:34:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:53 smithi191 bash[24992]: audit 2024-08-31T04:34:52.463498+0000 mgr.a (mgr.14388) 6211 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:34:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:53 smithi163 bash[24253]: audit 2024-08-31T04:34:52.446866+0000 mon.a (mon.0) 1515 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:34:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:53 smithi163 bash[24253]: audit 2024-08-31T04:34:52.448256+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:34:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:53 smithi163 bash[24253]: audit 2024-08-31T04:34:52.458576+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:34:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:53 smithi163 bash[24253]: audit 2024-08-31T04:34:52.461073+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:34:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:53 smithi163 bash[24253]: audit 2024-08-31T04:34:52.463498+0000 mgr.a (mgr.14388) 6211 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:34:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:54 smithi027 bash[22610]: cluster 2024-08-31T04:34:52.679494+0000 mgr.a (mgr.14388) 6212 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:54 smithi027 bash[22610]: audit 2024-08-31T04:34:53.170627+0000 mgr.a (mgr.14388) 6213 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:34:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:54 smithi027 bash[22610]: cephadm 2024-08-31T04:34:53.172119+0000 mgr.a (mgr.14388) 6214 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:34:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:54 smithi191 bash[24992]: cluster 2024-08-31T04:34:52.679494+0000 mgr.a (mgr.14388) 6212 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:54 smithi191 bash[24992]: audit 2024-08-31T04:34:53.170627+0000 mgr.a (mgr.14388) 6213 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:34:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:54 smithi191 bash[24992]: cephadm 2024-08-31T04:34:53.172119+0000 mgr.a (mgr.14388) 6214 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:34:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:54 smithi163 bash[24253]: cluster 2024-08-31T04:34:52.679494+0000 mgr.a (mgr.14388) 6212 : cluster [DBG] pgmap v4305: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:34:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:54 smithi163 bash[24253]: audit 2024-08-31T04:34:53.170627+0000 mgr.a (mgr.14388) 6213 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:34:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:54 smithi163 bash[24253]: cephadm 2024-08-31T04:34:53.172119+0000 mgr.a (mgr.14388) 6214 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:34:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:56 smithi027 bash[22610]: cluster 2024-08-31T04:34:54.681819+0000 mgr.a (mgr.14388) 6215 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T04:34:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:56 smithi191 bash[24992]: cluster 2024-08-31T04:34:54.681819+0000 mgr.a (mgr.14388) 6215 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T04:34:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:56 smithi163 bash[24253]: cluster 2024-08-31T04:34:54.681819+0000 mgr.a (mgr.14388) 6215 : cluster [DBG] pgmap v4306: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T04:34:57.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:34:57.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:34:57.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:34:57.802 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:34:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:34:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:34:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:34:57.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:34:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:58 smithi027 bash[22610]: cluster 2024-08-31T04:34:56.682608+0000 mgr.a (mgr.14388) 6216 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:34:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:34:58 smithi027 bash[22610]: audit 2024-08-31T04:34:57.379153+0000 mgr.a (mgr.14388) 6217 : audit [DBG] from='client.143166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:58 smithi191 bash[24992]: cluster 2024-08-31T04:34:56.682608+0000 mgr.a (mgr.14388) 6216 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:34:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:34:58 smithi191 bash[24992]: audit 2024-08-31T04:34:57.379153+0000 mgr.a (mgr.14388) 6217 : audit [DBG] from='client.143166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:34:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:58 smithi163 bash[24253]: cluster 2024-08-31T04:34:56.682608+0000 mgr.a (mgr.14388) 6216 : cluster [DBG] pgmap v4307: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:34:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:34:58 smithi163 bash[24253]: audit 2024-08-31T04:34:57.379153+0000 mgr.a (mgr.14388) 6217 : audit [DBG] from='client.143166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:00 smithi027 bash[22610]: cluster 2024-08-31T04:34:58.684919+0000 mgr.a (mgr.14388) 6218 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:00 smithi191 bash[24992]: cluster 2024-08-31T04:34:58.684919+0000 mgr.a (mgr.14388) 6218 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:00 smithi163 bash[24253]: cluster 2024-08-31T04:34:58.684919+0000 mgr.a (mgr.14388) 6218 : cluster [DBG] pgmap v4308: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:02 smithi027 bash[22610]: cluster 2024-08-31T04:35:00.685692+0000 mgr.a (mgr.14388) 6219 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:02 smithi191 bash[24992]: cluster 2024-08-31T04:35:00.685692+0000 mgr.a (mgr.14388) 6219 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:02.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:35:02.804 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:35:02.804 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:35:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:02 smithi163 bash[24253]: cluster 2024-08-31T04:35:00.685692+0000 mgr.a (mgr.14388) 6219 : cluster [DBG] pgmap v4309: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:03.574 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:35:03.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:35:03.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:35:03.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:35:03.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:35:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:04 smithi027 bash[22610]: cluster 2024-08-31T04:35:02.686452+0000 mgr.a (mgr.14388) 6220 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:04 smithi027 bash[22610]: audit 2024-08-31T04:35:03.143814+0000 mgr.a (mgr.14388) 6221 : audit [DBG] from='client.143244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:04.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:04 smithi191 bash[24992]: cluster 2024-08-31T04:35:02.686452+0000 mgr.a (mgr.14388) 6220 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:04.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:04 smithi191 bash[24992]: audit 2024-08-31T04:35:03.143814+0000 mgr.a (mgr.14388) 6221 : audit [DBG] from='client.143244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:04 smithi163 bash[24253]: cluster 2024-08-31T04:35:02.686452+0000 mgr.a (mgr.14388) 6220 : cluster [DBG] pgmap v4310: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:04 smithi163 bash[24253]: audit 2024-08-31T04:35:03.143814+0000 mgr.a (mgr.14388) 6221 : audit [DBG] from='client.143244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:06 smithi191 bash[24992]: cluster 2024-08-31T04:35:04.689174+0000 mgr.a (mgr.14388) 6222 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:06 smithi163 bash[24253]: cluster 2024-08-31T04:35:04.689174+0000 mgr.a (mgr.14388) 6222 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:06 smithi027 bash[22610]: cluster 2024-08-31T04:35:04.689174+0000 mgr.a (mgr.14388) 6222 : cluster [DBG] pgmap v4311: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:35:08.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:35:08.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:35:08.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:35:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:08 smithi191 bash[24992]: cluster 2024-08-31T04:35:06.689968+0000 mgr.a (mgr.14388) 6223 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:35:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:08 smithi163 bash[24253]: cluster 2024-08-31T04:35:06.689968+0000 mgr.a (mgr.14388) 6223 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:35:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:08 smithi027 bash[22610]: cluster 2024-08-31T04:35:06.689968+0000 mgr.a (mgr.14388) 6223 : cluster [DBG] pgmap v4312: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:35:09.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:35:09.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:35:09.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:35:09.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:35:09.349 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:35:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:10 smithi191 bash[24992]: cluster 2024-08-31T04:35:08.690988+0000 mgr.a (mgr.14388) 6224 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:35:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:10 smithi191 bash[24992]: audit 2024-08-31T04:35:08.911789+0000 mgr.a (mgr.14388) 6225 : audit [DBG] from='client.143319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:10 smithi163 bash[24253]: cluster 2024-08-31T04:35:08.690988+0000 mgr.a (mgr.14388) 6224 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:35:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:10 smithi163 bash[24253]: audit 2024-08-31T04:35:08.911789+0000 mgr.a (mgr.14388) 6225 : audit [DBG] from='client.143319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:10 smithi027 bash[22610]: cluster 2024-08-31T04:35:08.690988+0000 mgr.a (mgr.14388) 6224 : cluster [DBG] pgmap v4313: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:35:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:10 smithi027 bash[22610]: audit 2024-08-31T04:35:08.911789+0000 mgr.a (mgr.14388) 6225 : audit [DBG] from='client.143319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:12 smithi191 bash[24992]: cluster 2024-08-31T04:35:10.692206+0000 mgr.a (mgr.14388) 6226 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:35:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:12 smithi163 bash[24253]: cluster 2024-08-31T04:35:10.692206+0000 mgr.a (mgr.14388) 6226 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:35:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:12 smithi027 bash[22610]: cluster 2024-08-31T04:35:10.692206+0000 mgr.a (mgr.14388) 6226 : cluster [DBG] pgmap v4314: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:35:14.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:35:14.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:35:14.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:35:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:14 smithi191 bash[24992]: cluster 2024-08-31T04:35:12.693039+0000 mgr.a (mgr.14388) 6227 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:35:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:14 smithi163 bash[24253]: cluster 2024-08-31T04:35:12.693039+0000 mgr.a (mgr.14388) 6227 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:35:14.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:14 smithi027 bash[22610]: cluster 2024-08-31T04:35:12.693039+0000 mgr.a (mgr.14388) 6227 : cluster [DBG] pgmap v4315: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:35:15.131 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:35:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:35:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:35:15.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:35:15.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:35:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:16 smithi191 bash[24992]: audit 2024-08-31T04:35:14.691204+0000 mgr.a (mgr.14388) 6228 : audit [DBG] from='client.143397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:16 smithi191 bash[24992]: cluster 2024-08-31T04:35:14.710702+0000 mgr.a (mgr.14388) 6229 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:16 smithi163 bash[24253]: audit 2024-08-31T04:35:14.691204+0000 mgr.a (mgr.14388) 6228 : audit [DBG] from='client.143397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:16 smithi163 bash[24253]: cluster 2024-08-31T04:35:14.710702+0000 mgr.a (mgr.14388) 6229 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:16 smithi027 bash[22610]: audit 2024-08-31T04:35:14.691204+0000 mgr.a (mgr.14388) 6228 : audit [DBG] from='client.143397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:16 smithi027 bash[22610]: cluster 2024-08-31T04:35:14.710702+0000 mgr.a (mgr.14388) 6229 : cluster [DBG] pgmap v4316: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:18 smithi191 bash[24992]: cluster 2024-08-31T04:35:16.711765+0000 mgr.a (mgr.14388) 6230 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:18 smithi163 bash[24253]: cluster 2024-08-31T04:35:16.711765+0000 mgr.a (mgr.14388) 6230 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:18 smithi027 bash[22610]: cluster 2024-08-31T04:35:16.711765+0000 mgr.a (mgr.14388) 6230 : cluster [DBG] pgmap v4317: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:20.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:35:20.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:35:20.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:35:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:20 smithi191 bash[24992]: cluster 2024-08-31T04:35:18.714147+0000 mgr.a (mgr.14388) 6231 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:20.914 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:35:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:35:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:35:20.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:35:20.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:35:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:20 smithi163 bash[24253]: cluster 2024-08-31T04:35:18.714147+0000 mgr.a (mgr.14388) 6231 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:20 smithi027 bash[22610]: cluster 2024-08-31T04:35:18.714147+0000 mgr.a (mgr.14388) 6231 : cluster [DBG] pgmap v4318: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:21 smithi191 bash[24992]: audit 2024-08-31T04:35:20.478009+0000 mgr.a (mgr.14388) 6232 : audit [DBG] from='client.143475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:21 smithi163 bash[24253]: audit 2024-08-31T04:35:20.478009+0000 mgr.a (mgr.14388) 6232 : audit [DBG] from='client.143475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:21 smithi027 bash[22610]: audit 2024-08-31T04:35:20.478009+0000 mgr.a (mgr.14388) 6232 : audit [DBG] from='client.143475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:22 smithi191 bash[24992]: cluster 2024-08-31T04:35:20.720578+0000 mgr.a (mgr.14388) 6233 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:22 smithi163 bash[24253]: cluster 2024-08-31T04:35:20.720578+0000 mgr.a (mgr.14388) 6233 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:22 smithi027 bash[22610]: cluster 2024-08-31T04:35:20.720578+0000 mgr.a (mgr.14388) 6233 : cluster [DBG] pgmap v4319: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:24 smithi191 bash[24992]: cluster 2024-08-31T04:35:22.721471+0000 mgr.a (mgr.14388) 6234 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:24 smithi163 bash[24253]: cluster 2024-08-31T04:35:22.721471+0000 mgr.a (mgr.14388) 6234 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:24 smithi027 bash[22610]: cluster 2024-08-31T04:35:22.721471+0000 mgr.a (mgr.14388) 6234 : cluster [DBG] pgmap v4320: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:25.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:35:25.916 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:35:25.916 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:35:26.685 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:35:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:35:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:35:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:35:26.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:35:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:26 smithi191 bash[24992]: cluster 2024-08-31T04:35:24.723825+0000 mgr.a (mgr.14388) 6235 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:26 smithi163 bash[24253]: cluster 2024-08-31T04:35:24.723825+0000 mgr.a (mgr.14388) 6235 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:26 smithi027 bash[22610]: cluster 2024-08-31T04:35:24.723825+0000 mgr.a (mgr.14388) 6235 : cluster [DBG] pgmap v4321: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:27 smithi163 bash[24253]: audit 2024-08-31T04:35:26.249109+0000 mgr.a (mgr.14388) 6236 : audit [DBG] from='client.143553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:27 smithi027 bash[22610]: audit 2024-08-31T04:35:26.249109+0000 mgr.a (mgr.14388) 6236 : audit [DBG] from='client.143553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:27 smithi191 bash[24992]: audit 2024-08-31T04:35:26.249109+0000 mgr.a (mgr.14388) 6236 : audit [DBG] from='client.143553 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:28 smithi163 bash[24253]: cluster 2024-08-31T04:35:26.724593+0000 mgr.a (mgr.14388) 6237 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:28 smithi027 bash[22610]: cluster 2024-08-31T04:35:26.724593+0000 mgr.a (mgr.14388) 6237 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:28 smithi191 bash[24992]: cluster 2024-08-31T04:35:26.724593+0000 mgr.a (mgr.14388) 6237 : cluster [DBG] pgmap v4322: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:30 smithi163 bash[24253]: cluster 2024-08-31T04:35:28.726783+0000 mgr.a (mgr.14388) 6238 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:30 smithi027 bash[22610]: cluster 2024-08-31T04:35:28.726783+0000 mgr.a (mgr.14388) 6238 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:30 smithi191 bash[24992]: cluster 2024-08-31T04:35:28.726783+0000 mgr.a (mgr.14388) 6238 : cluster [DBG] pgmap v4323: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:31.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:35:31.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:35:31.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:35:32.427 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:35:32.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:35:32.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:35:32.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:35:32.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:35:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:32 smithi163 bash[24253]: cluster 2024-08-31T04:35:30.727591+0000 mgr.a (mgr.14388) 6239 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:32 smithi027 bash[22610]: cluster 2024-08-31T04:35:30.727591+0000 mgr.a (mgr.14388) 6239 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:32 smithi191 bash[24992]: cluster 2024-08-31T04:35:30.727591+0000 mgr.a (mgr.14388) 6239 : cluster [DBG] pgmap v4324: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:33 smithi163 bash[24253]: audit 2024-08-31T04:35:32.017409+0000 mgr.a (mgr.14388) 6240 : audit [DBG] from='client.143628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:33 smithi027 bash[22610]: audit 2024-08-31T04:35:32.017409+0000 mgr.a (mgr.14388) 6240 : audit [DBG] from='client.143628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:33 smithi191 bash[24992]: audit 2024-08-31T04:35:32.017409+0000 mgr.a (mgr.14388) 6240 : audit [DBG] from='client.143628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:34 smithi163 bash[24253]: cluster 2024-08-31T04:35:32.728524+0000 mgr.a (mgr.14388) 6241 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:34 smithi027 bash[22610]: cluster 2024-08-31T04:35:32.728524+0000 mgr.a (mgr.14388) 6241 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:34 smithi191 bash[24992]: cluster 2024-08-31T04:35:32.728524+0000 mgr.a (mgr.14388) 6241 : cluster [DBG] pgmap v4325: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:36 smithi163 bash[24253]: cluster 2024-08-31T04:35:34.730813+0000 mgr.a (mgr.14388) 6242 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:36 smithi027 bash[22610]: cluster 2024-08-31T04:35:34.730813+0000 mgr.a (mgr.14388) 6242 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:36 smithi191 bash[24992]: cluster 2024-08-31T04:35:34.730813+0000 mgr.a (mgr.14388) 6242 : cluster [DBG] pgmap v4326: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:35:37.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:35:37.429 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:35:37.430 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:35:38.184 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:35:38.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:35:38.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:35:38.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:35:38.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:35:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:38 smithi163 bash[24253]: cluster 2024-08-31T04:35:36.731630+0000 mgr.a (mgr.14388) 6243 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:38 smithi027 bash[22610]: cluster 2024-08-31T04:35:36.731630+0000 mgr.a (mgr.14388) 6243 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:38 smithi191 bash[24992]: cluster 2024-08-31T04:35:36.731630+0000 mgr.a (mgr.14388) 6243 : cluster [DBG] pgmap v4327: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:39 smithi163 bash[24253]: audit 2024-08-31T04:35:37.763275+0000 mgr.a (mgr.14388) 6244 : audit [DBG] from='client.143706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:39 smithi027 bash[22610]: audit 2024-08-31T04:35:37.763275+0000 mgr.a (mgr.14388) 6244 : audit [DBG] from='client.143706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:39 smithi191 bash[24992]: audit 2024-08-31T04:35:37.763275+0000 mgr.a (mgr.14388) 6244 : audit [DBG] from='client.143706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:40 smithi163 bash[24253]: cluster 2024-08-31T04:35:38.734210+0000 mgr.a (mgr.14388) 6245 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:35:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:40 smithi027 bash[22610]: cluster 2024-08-31T04:35:38.734210+0000 mgr.a (mgr.14388) 6245 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:35:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:40 smithi191 bash[24992]: cluster 2024-08-31T04:35:38.734210+0000 mgr.a (mgr.14388) 6245 : cluster [DBG] pgmap v4328: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:35:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:42 smithi163 bash[24253]: cluster 2024-08-31T04:35:40.735061+0000 mgr.a (mgr.14388) 6246 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:35:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:42 smithi027 bash[22610]: cluster 2024-08-31T04:35:40.735061+0000 mgr.a (mgr.14388) 6246 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:35:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:42 smithi191 bash[24992]: cluster 2024-08-31T04:35:40.735061+0000 mgr.a (mgr.14388) 6246 : cluster [DBG] pgmap v4329: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:35:43.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:35:43.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:35:43.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:35:43.971 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:35:43.971 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:35:43.971 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:35:43.971 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:35:43.971 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:35:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:44 smithi163 bash[24253]: cluster 2024-08-31T04:35:42.735840+0000 mgr.a (mgr.14388) 6247 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:35:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:44 smithi163 bash[24253]: audit 2024-08-31T04:35:43.524607+0000 mgr.a (mgr.14388) 6248 : audit [DBG] from='client.143784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:44 smithi027 bash[22610]: cluster 2024-08-31T04:35:42.735840+0000 mgr.a (mgr.14388) 6247 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:35:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:44 smithi027 bash[22610]: audit 2024-08-31T04:35:43.524607+0000 mgr.a (mgr.14388) 6248 : audit [DBG] from='client.143784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:44 smithi191 bash[24992]: cluster 2024-08-31T04:35:42.735840+0000 mgr.a (mgr.14388) 6247 : cluster [DBG] pgmap v4330: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:35:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:44 smithi191 bash[24992]: audit 2024-08-31T04:35:43.524607+0000 mgr.a (mgr.14388) 6248 : audit [DBG] from='client.143784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:46.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:46 smithi163 bash[24253]: cluster 2024-08-31T04:35:44.738678+0000 mgr.a (mgr.14388) 6249 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:47.061 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:46 smithi191 bash[24992]: cluster 2024-08-31T04:35:44.738678+0000 mgr.a (mgr.14388) 6249 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:47.061 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:46 smithi027 bash[22610]: cluster 2024-08-31T04:35:44.738678+0000 mgr.a (mgr.14388) 6249 : cluster [DBG] pgmap v4331: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:48 smithi163 bash[24253]: cluster 2024-08-31T04:35:46.739454+0000 mgr.a (mgr.14388) 6250 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:35:48.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:35:48.973 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:35:48.973 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:35:48.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:48 smithi027 bash[22610]: cluster 2024-08-31T04:35:46.739454+0000 mgr.a (mgr.14388) 6250 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:35:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:48 smithi191 bash[24992]: cluster 2024-08-31T04:35:46.739454+0000 mgr.a (mgr.14388) 6250 : cluster [DBG] pgmap v4332: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:35:49.742 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:35:49.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:35:49.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:35:49.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:35:49.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:35:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:50 smithi163 bash[24253]: cluster 2024-08-31T04:35:48.741435+0000 mgr.a (mgr.14388) 6251 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:50 smithi163 bash[24253]: audit 2024-08-31T04:35:49.306337+0000 mgr.a (mgr.14388) 6252 : audit [DBG] from='client.143862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:50 smithi027 bash[22610]: cluster 2024-08-31T04:35:48.741435+0000 mgr.a (mgr.14388) 6251 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:50 smithi027 bash[22610]: audit 2024-08-31T04:35:49.306337+0000 mgr.a (mgr.14388) 6252 : audit [DBG] from='client.143862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:50 smithi191 bash[24992]: cluster 2024-08-31T04:35:48.741435+0000 mgr.a (mgr.14388) 6251 : cluster [DBG] pgmap v4333: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:50 smithi191 bash[24992]: audit 2024-08-31T04:35:49.306337+0000 mgr.a (mgr.14388) 6252 : audit [DBG] from='client.143862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:52 smithi163 bash[24253]: cluster 2024-08-31T04:35:50.742387+0000 mgr.a (mgr.14388) 6253 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:35:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:52 smithi027 bash[22610]: cluster 2024-08-31T04:35:50.742387+0000 mgr.a (mgr.14388) 6253 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:35:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:52 smithi191 bash[24992]: cluster 2024-08-31T04:35:50.742387+0000 mgr.a (mgr.14388) 6253 : cluster [DBG] pgmap v4334: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:35:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:53 smithi163 bash[24253]: audit 2024-08-31T04:35:53.222678+0000 mon.a (mon.0) 1519 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:35:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:53 smithi027 bash[22610]: audit 2024-08-31T04:35:53.222678+0000 mon.a (mon.0) 1519 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:35:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:53 smithi191 bash[24992]: audit 2024-08-31T04:35:53.222678+0000 mon.a (mon.0) 1519 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:35:54.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:35:54.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:35:54.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:35:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:54 smithi163 bash[24253]: cluster 2024-08-31T04:35:52.743176+0000 mgr.a (mgr.14388) 6254 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:35:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:54 smithi163 bash[24253]: audit 2024-08-31T04:35:54.072417+0000 mon.a (mon.0) 1520 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:35:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:54 smithi163 bash[24253]: audit 2024-08-31T04:35:54.074203+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:35:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:54 smithi163 bash[24253]: audit 2024-08-31T04:35:54.084540+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:35:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:54 smithi163 bash[24253]: audit 2024-08-31T04:35:54.089223+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:35:54.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:35:54 smithi027 bash[22863]: debug 2024-08-31T04:35:54.815+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:35:54.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:35:54 smithi027 bash[22863]: debug 2024-08-31T04:35:54.815+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:35:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:54 smithi027 bash[22610]: cluster 2024-08-31T04:35:52.743176+0000 mgr.a (mgr.14388) 6254 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:35:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:54 smithi027 bash[22610]: audit 2024-08-31T04:35:54.072417+0000 mon.a (mon.0) 1520 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:35:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:54 smithi027 bash[22610]: audit 2024-08-31T04:35:54.074203+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:35:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:54 smithi027 bash[22610]: audit 2024-08-31T04:35:54.084540+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:35:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:54 smithi027 bash[22610]: audit 2024-08-31T04:35:54.089223+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:35:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:54 smithi191 bash[24992]: cluster 2024-08-31T04:35:52.743176+0000 mgr.a (mgr.14388) 6254 : cluster [DBG] pgmap v4335: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:35:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:54 smithi191 bash[24992]: audit 2024-08-31T04:35:54.072417+0000 mon.a (mon.0) 1520 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:35:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:54 smithi191 bash[24992]: audit 2024-08-31T04:35:54.074203+0000 mon.a (mon.0) 1521 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:35:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:54 smithi191 bash[24992]: audit 2024-08-31T04:35:54.084540+0000 mon.a (mon.0) 1522 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:35:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:54 smithi191 bash[24992]: audit 2024-08-31T04:35:54.089223+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:35:55.478 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:35:55.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:35:55.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:35:55.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:35:55.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:35:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:55 smithi163 bash[24253]: audit 2024-08-31T04:35:54.091472+0000 mgr.a (mgr.14388) 6255 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:35:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:55 smithi027 bash[22610]: audit 2024-08-31T04:35:54.091472+0000 mgr.a (mgr.14388) 6255 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:35:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:55 smithi191 bash[24992]: audit 2024-08-31T04:35:54.091472+0000 mgr.a (mgr.14388) 6255 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:35:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:56 smithi163 bash[24253]: cluster 2024-08-31T04:35:54.744565+0000 mgr.a (mgr.14388) 6256 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:35:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:56 smithi163 bash[24253]: audit 2024-08-31T04:35:54.819072+0000 mgr.a (mgr.14388) 6257 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:35:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:56 smithi163 bash[24253]: cephadm 2024-08-31T04:35:54.820406+0000 mgr.a (mgr.14388) 6258 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:35:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:56 smithi163 bash[24253]: audit 2024-08-31T04:35:55.064277+0000 mgr.a (mgr.14388) 6259 : audit [DBG] from='client.144048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:56 smithi027 bash[22610]: cluster 2024-08-31T04:35:54.744565+0000 mgr.a (mgr.14388) 6256 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:35:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:56 smithi027 bash[22610]: audit 2024-08-31T04:35:54.819072+0000 mgr.a (mgr.14388) 6257 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:35:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:56 smithi027 bash[22610]: cephadm 2024-08-31T04:35:54.820406+0000 mgr.a (mgr.14388) 6258 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:35:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:56 smithi027 bash[22610]: audit 2024-08-31T04:35:55.064277+0000 mgr.a (mgr.14388) 6259 : audit [DBG] from='client.144048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:56 smithi191 bash[24992]: cluster 2024-08-31T04:35:54.744565+0000 mgr.a (mgr.14388) 6256 : cluster [DBG] pgmap v4336: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:35:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:56 smithi191 bash[24992]: audit 2024-08-31T04:35:54.819072+0000 mgr.a (mgr.14388) 6257 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:35:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:56 smithi191 bash[24992]: cephadm 2024-08-31T04:35:54.820406+0000 mgr.a (mgr.14388) 6258 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:35:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:56 smithi191 bash[24992]: audit 2024-08-31T04:35:55.064277+0000 mgr.a (mgr.14388) 6259 : audit [DBG] from='client.144048 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:35:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:35:58 smithi163 bash[24253]: cluster 2024-08-31T04:35:56.745463+0000 mgr.a (mgr.14388) 6260 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:35:58 smithi027 bash[22610]: cluster 2024-08-31T04:35:56.745463+0000 mgr.a (mgr.14388) 6260 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:35:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:35:58 smithi191 bash[24992]: cluster 2024-08-31T04:35:56.745463+0000 mgr.a (mgr.14388) 6260 : cluster [DBG] pgmap v4337: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:00.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:00.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:00.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:00 smithi163 bash[24253]: cluster 2024-08-31T04:35:58.747706+0000 mgr.a (mgr.14388) 6261 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:00 smithi027 bash[22610]: cluster 2024-08-31T04:35:58.747706+0000 mgr.a (mgr.14388) 6261 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:00 smithi191 bash[24992]: cluster 2024-08-31T04:35:58.747706+0000 mgr.a (mgr.14388) 6261 : cluster [DBG] pgmap v4338: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:01.264 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:01.264 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:01.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:01.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:01.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:02 smithi163 bash[24253]: cluster 2024-08-31T04:36:00.748439+0000 mgr.a (mgr.14388) 6262 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:02 smithi163 bash[24253]: audit 2024-08-31T04:36:00.818619+0000 mgr.a (mgr.14388) 6263 : audit [DBG] from='client.144126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:02 smithi027 bash[22610]: cluster 2024-08-31T04:36:00.748439+0000 mgr.a (mgr.14388) 6262 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:02 smithi027 bash[22610]: audit 2024-08-31T04:36:00.818619+0000 mgr.a (mgr.14388) 6263 : audit [DBG] from='client.144126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:02 smithi191 bash[24992]: cluster 2024-08-31T04:36:00.748439+0000 mgr.a (mgr.14388) 6262 : cluster [DBG] pgmap v4339: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:02 smithi191 bash[24992]: audit 2024-08-31T04:36:00.818619+0000 mgr.a (mgr.14388) 6263 : audit [DBG] from='client.144126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:04 smithi163 bash[24253]: cluster 2024-08-31T04:36:02.749397+0000 mgr.a (mgr.14388) 6264 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:04 smithi027 bash[22610]: cluster 2024-08-31T04:36:02.749397+0000 mgr.a (mgr.14388) 6264 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:04 smithi191 bash[24992]: cluster 2024-08-31T04:36:02.749397+0000 mgr.a (mgr.14388) 6264 : cluster [DBG] pgmap v4340: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:06.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:06.266 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:06.267 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:06 smithi163 bash[24253]: cluster 2024-08-31T04:36:04.751734+0000 mgr.a (mgr.14388) 6265 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:06 smithi027 bash[22610]: cluster 2024-08-31T04:36:04.751734+0000 mgr.a (mgr.14388) 6265 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:07.027 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:07.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:07.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:07.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:07.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:06 smithi191 bash[24992]: cluster 2024-08-31T04:36:04.751734+0000 mgr.a (mgr.14388) 6265 : cluster [DBG] pgmap v4341: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:07 smithi163 bash[24253]: audit 2024-08-31T04:36:06.599863+0000 mgr.a (mgr.14388) 6266 : audit [DBG] from='client.144201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:07 smithi027 bash[22610]: audit 2024-08-31T04:36:06.599863+0000 mgr.a (mgr.14388) 6266 : audit [DBG] from='client.144201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:07 smithi191 bash[24992]: audit 2024-08-31T04:36:06.599863+0000 mgr.a (mgr.14388) 6266 : audit [DBG] from='client.144201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:08 smithi163 bash[24253]: cluster 2024-08-31T04:36:06.752304+0000 mgr.a (mgr.14388) 6267 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:08 smithi027 bash[22610]: cluster 2024-08-31T04:36:06.752304+0000 mgr.a (mgr.14388) 6267 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:08 smithi191 bash[24992]: cluster 2024-08-31T04:36:06.752304+0000 mgr.a (mgr.14388) 6267 : cluster [DBG] pgmap v4342: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:09 smithi163 bash[24253]: cluster 2024-08-31T04:36:08.754569+0000 mgr.a (mgr.14388) 6268 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:09 smithi027 bash[22610]: cluster 2024-08-31T04:36:08.754569+0000 mgr.a (mgr.14388) 6268 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:09 smithi191 bash[24992]: cluster 2024-08-31T04:36:08.754569+0000 mgr.a (mgr.14388) 6268 : cluster [DBG] pgmap v4343: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:36:12.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:12.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:12.030 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:12.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:11 smithi163 bash[24253]: cluster 2024-08-31T04:36:10.755389+0000 mgr.a (mgr.14388) 6269 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:11 smithi027 bash[22610]: cluster 2024-08-31T04:36:10.755389+0000 mgr.a (mgr.14388) 6269 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:11 smithi191 bash[24992]: cluster 2024-08-31T04:36:10.755389+0000 mgr.a (mgr.14388) 6269 : cluster [DBG] pgmap v4344: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:12.781 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:12.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:12.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:12.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:12.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:12 smithi191 bash[24992]: audit 2024-08-31T04:36:12.363912+0000 mgr.a (mgr.14388) 6270 : audit [DBG] from='client.144276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:12 smithi163 bash[24253]: audit 2024-08-31T04:36:12.363912+0000 mgr.a (mgr.14388) 6270 : audit [DBG] from='client.144276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:12 smithi027 bash[22610]: audit 2024-08-31T04:36:12.363912+0000 mgr.a (mgr.14388) 6270 : audit [DBG] from='client.144276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:14 smithi191 bash[24992]: cluster 2024-08-31T04:36:12.755893+0000 mgr.a (mgr.14388) 6271 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:14 smithi163 bash[24253]: cluster 2024-08-31T04:36:12.755893+0000 mgr.a (mgr.14388) 6271 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:14 smithi027 bash[22610]: cluster 2024-08-31T04:36:12.755893+0000 mgr.a (mgr.14388) 6271 : cluster [DBG] pgmap v4345: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:16 smithi191 bash[24992]: cluster 2024-08-31T04:36:14.758104+0000 mgr.a (mgr.14388) 6272 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:16.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:16 smithi163 bash[24253]: cluster 2024-08-31T04:36:14.758104+0000 mgr.a (mgr.14388) 6272 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:16 smithi027 bash[22610]: cluster 2024-08-31T04:36:14.758104+0000 mgr.a (mgr.14388) 6272 : cluster [DBG] pgmap v4346: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:17.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:17.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:17.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:18 smithi191 bash[24992]: cluster 2024-08-31T04:36:16.758917+0000 mgr.a (mgr.14388) 6273 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:18 smithi163 bash[24253]: cluster 2024-08-31T04:36:16.758917+0000 mgr.a (mgr.14388) 6273 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:18 smithi027 bash[22610]: cluster 2024-08-31T04:36:16.758917+0000 mgr.a (mgr.14388) 6273 : cluster [DBG] pgmap v4347: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:18.547 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:18.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:18.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:18.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:18.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:19 smithi191 bash[24992]: audit 2024-08-31T04:36:18.121671+0000 mgr.a (mgr.14388) 6274 : audit [DBG] from='client.144354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:19 smithi163 bash[24253]: audit 2024-08-31T04:36:18.121671+0000 mgr.a (mgr.14388) 6274 : audit [DBG] from='client.144354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:19 smithi027 bash[22610]: audit 2024-08-31T04:36:18.121671+0000 mgr.a (mgr.14388) 6274 : audit [DBG] from='client.144354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:20 smithi191 bash[24992]: cluster 2024-08-31T04:36:18.761608+0000 mgr.a (mgr.14388) 6275 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:20 smithi163 bash[24253]: cluster 2024-08-31T04:36:18.761608+0000 mgr.a (mgr.14388) 6275 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:20 smithi027 bash[22610]: cluster 2024-08-31T04:36:18.761608+0000 mgr.a (mgr.14388) 6275 : cluster [DBG] pgmap v4348: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:22 smithi191 bash[24992]: cluster 2024-08-31T04:36:20.762558+0000 mgr.a (mgr.14388) 6276 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:36:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:22 smithi163 bash[24253]: cluster 2024-08-31T04:36:20.762558+0000 mgr.a (mgr.14388) 6276 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:36:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:22 smithi027 bash[22610]: cluster 2024-08-31T04:36:20.762558+0000 mgr.a (mgr.14388) 6276 : cluster [DBG] pgmap v4349: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:36:23.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:23.550 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:23.550 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:24 smithi191 bash[24992]: cluster 2024-08-31T04:36:22.763503+0000 mgr.a (mgr.14388) 6277 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:36:24.335 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:24.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:24.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:24 smithi163 bash[24253]: cluster 2024-08-31T04:36:22.763503+0000 mgr.a (mgr.14388) 6277 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:36:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:24 smithi027 bash[22610]: cluster 2024-08-31T04:36:22.763503+0000 mgr.a (mgr.14388) 6277 : cluster [DBG] pgmap v4350: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:36:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:25 smithi191 bash[24992]: audit 2024-08-31T04:36:23.890426+0000 mgr.a (mgr.14388) 6278 : audit [DBG] from='client.144432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:25 smithi163 bash[24253]: audit 2024-08-31T04:36:23.890426+0000 mgr.a (mgr.14388) 6278 : audit [DBG] from='client.144432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:25 smithi027 bash[22610]: audit 2024-08-31T04:36:23.890426+0000 mgr.a (mgr.14388) 6278 : audit [DBG] from='client.144432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:26 smithi191 bash[24992]: cluster 2024-08-31T04:36:24.766342+0000 mgr.a (mgr.14388) 6279 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:26 smithi163 bash[24253]: cluster 2024-08-31T04:36:24.766342+0000 mgr.a (mgr.14388) 6279 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:26 smithi027 bash[22610]: cluster 2024-08-31T04:36:24.766342+0000 mgr.a (mgr.14388) 6279 : cluster [DBG] pgmap v4351: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:28 smithi163 bash[24253]: cluster 2024-08-31T04:36:26.767220+0000 mgr.a (mgr.14388) 6280 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:36:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:28 smithi027 bash[22610]: cluster 2024-08-31T04:36:26.767220+0000 mgr.a (mgr.14388) 6280 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:36:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:28 smithi191 bash[24992]: cluster 2024-08-31T04:36:26.767220+0000 mgr.a (mgr.14388) 6280 : cluster [DBG] pgmap v4352: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:36:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:29.337 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:30.077 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:30.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:30.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:30.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:30.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:30 smithi163 bash[24253]: cluster 2024-08-31T04:36:28.769311+0000 mgr.a (mgr.14388) 6281 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:30 smithi027 bash[22610]: cluster 2024-08-31T04:36:28.769311+0000 mgr.a (mgr.14388) 6281 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:30 smithi191 bash[24992]: cluster 2024-08-31T04:36:28.769311+0000 mgr.a (mgr.14388) 6281 : cluster [DBG] pgmap v4353: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:31 smithi163 bash[24253]: audit 2024-08-31T04:36:29.666760+0000 mgr.a (mgr.14388) 6282 : audit [DBG] from='client.144510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:31 smithi027 bash[22610]: audit 2024-08-31T04:36:29.666760+0000 mgr.a (mgr.14388) 6282 : audit [DBG] from='client.144510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:31 smithi191 bash[24992]: audit 2024-08-31T04:36:29.666760+0000 mgr.a (mgr.14388) 6282 : audit [DBG] from='client.144510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:32 smithi163 bash[24253]: cluster 2024-08-31T04:36:30.770305+0000 mgr.a (mgr.14388) 6283 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:32 smithi027 bash[22610]: cluster 2024-08-31T04:36:30.770305+0000 mgr.a (mgr.14388) 6283 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:32 smithi191 bash[24992]: cluster 2024-08-31T04:36:30.770305+0000 mgr.a (mgr.14388) 6283 : cluster [DBG] pgmap v4354: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:34.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:34 smithi163 bash[24253]: cluster 2024-08-31T04:36:32.771123+0000 mgr.a (mgr.14388) 6284 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:34 smithi027 bash[22610]: cluster 2024-08-31T04:36:32.771123+0000 mgr.a (mgr.14388) 6284 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:34 smithi191 bash[24992]: cluster 2024-08-31T04:36:32.771123+0000 mgr.a (mgr.14388) 6284 : cluster [DBG] pgmap v4355: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:35.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:35.081 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:35.081 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:35.816 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:35.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:35.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:35.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:35.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:36 smithi163 bash[24253]: cluster 2024-08-31T04:36:34.773399+0000 mgr.a (mgr.14388) 6285 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:36 smithi163 bash[24253]: audit 2024-08-31T04:36:35.411164+0000 mgr.a (mgr.14388) 6286 : audit [DBG] from='client.144585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:36 smithi027 bash[22610]: cluster 2024-08-31T04:36:34.773399+0000 mgr.a (mgr.14388) 6285 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:36 smithi027 bash[22610]: audit 2024-08-31T04:36:35.411164+0000 mgr.a (mgr.14388) 6286 : audit [DBG] from='client.144585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:36 smithi191 bash[24992]: cluster 2024-08-31T04:36:34.773399+0000 mgr.a (mgr.14388) 6285 : cluster [DBG] pgmap v4356: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:36 smithi191 bash[24992]: audit 2024-08-31T04:36:35.411164+0000 mgr.a (mgr.14388) 6286 : audit [DBG] from='client.144585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:38 smithi163 bash[24253]: cluster 2024-08-31T04:36:36.774416+0000 mgr.a (mgr.14388) 6287 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:38 smithi027 bash[22610]: cluster 2024-08-31T04:36:36.774416+0000 mgr.a (mgr.14388) 6287 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:38 smithi191 bash[24992]: cluster 2024-08-31T04:36:36.774416+0000 mgr.a (mgr.14388) 6287 : cluster [DBG] pgmap v4357: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:40 smithi163 bash[24253]: cluster 2024-08-31T04:36:38.776672+0000 mgr.a (mgr.14388) 6288 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:40 smithi027 bash[22610]: cluster 2024-08-31T04:36:38.776672+0000 mgr.a (mgr.14388) 6288 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:40 smithi191 bash[24992]: cluster 2024-08-31T04:36:38.776672+0000 mgr.a (mgr.14388) 6288 : cluster [DBG] pgmap v4358: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:40.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:40.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:40.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:41.566 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:41.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:42.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:42 smithi163 bash[24253]: cluster 2024-08-31T04:36:40.777431+0000 mgr.a (mgr.14388) 6289 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:42 smithi163 bash[24253]: audit 2024-08-31T04:36:41.157552+0000 mgr.a (mgr.14388) 6290 : audit [DBG] from='client.144663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:42 smithi027 bash[22610]: cluster 2024-08-31T04:36:40.777431+0000 mgr.a (mgr.14388) 6289 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:42 smithi027 bash[22610]: audit 2024-08-31T04:36:41.157552+0000 mgr.a (mgr.14388) 6290 : audit [DBG] from='client.144663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:42 smithi191 bash[24992]: cluster 2024-08-31T04:36:40.777431+0000 mgr.a (mgr.14388) 6289 : cluster [DBG] pgmap v4359: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:42 smithi191 bash[24992]: audit 2024-08-31T04:36:41.157552+0000 mgr.a (mgr.14388) 6290 : audit [DBG] from='client.144663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:44.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:44 smithi163 bash[24253]: cluster 2024-08-31T04:36:42.778294+0000 mgr.a (mgr.14388) 6291 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:44 smithi027 bash[22610]: cluster 2024-08-31T04:36:42.778294+0000 mgr.a (mgr.14388) 6291 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:44 smithi191 bash[24992]: cluster 2024-08-31T04:36:42.778294+0000 mgr.a (mgr.14388) 6291 : cluster [DBG] pgmap v4360: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:46 smithi163 bash[24253]: cluster 2024-08-31T04:36:44.780578+0000 mgr.a (mgr.14388) 6292 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:46 smithi027 bash[22610]: cluster 2024-08-31T04:36:44.780578+0000 mgr.a (mgr.14388) 6292 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:46 smithi191 bash[24992]: cluster 2024-08-31T04:36:44.780578+0000 mgr.a (mgr.14388) 6292 : cluster [DBG] pgmap v4361: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:46.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:46.569 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:46.569 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:47.315 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:47.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:48.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:48 smithi163 bash[24253]: cluster 2024-08-31T04:36:46.781333+0000 mgr.a (mgr.14388) 6293 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:48 smithi163 bash[24253]: audit 2024-08-31T04:36:46.901488+0000 mgr.a (mgr.14388) 6294 : audit [DBG] from='client.144741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:48.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:48 smithi027 bash[22610]: cluster 2024-08-31T04:36:46.781333+0000 mgr.a (mgr.14388) 6293 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:48 smithi027 bash[22610]: audit 2024-08-31T04:36:46.901488+0000 mgr.a (mgr.14388) 6294 : audit [DBG] from='client.144741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:48 smithi191 bash[24992]: cluster 2024-08-31T04:36:46.781333+0000 mgr.a (mgr.14388) 6293 : cluster [DBG] pgmap v4362: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:48 smithi191 bash[24992]: audit 2024-08-31T04:36:46.901488+0000 mgr.a (mgr.14388) 6294 : audit [DBG] from='client.144741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:50.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:50 smithi163 bash[24253]: cluster 2024-08-31T04:36:48.783650+0000 mgr.a (mgr.14388) 6295 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:50 smithi027 bash[22610]: cluster 2024-08-31T04:36:48.783650+0000 mgr.a (mgr.14388) 6295 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:50 smithi191 bash[24992]: cluster 2024-08-31T04:36:48.783650+0000 mgr.a (mgr.14388) 6295 : cluster [DBG] pgmap v4363: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:36:52.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:52.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:52.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:52 smithi163 bash[24253]: cluster 2024-08-31T04:36:50.784413+0000 mgr.a (mgr.14388) 6296 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:52.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:52 smithi027 bash[22610]: cluster 2024-08-31T04:36:50.784413+0000 mgr.a (mgr.14388) 6296 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:52 smithi191 bash[24992]: cluster 2024-08-31T04:36:50.784413+0000 mgr.a (mgr.14388) 6296 : cluster [DBG] pgmap v4364: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:53.062 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:53 smithi163 bash[24253]: audit 2024-08-31T04:36:52.655253+0000 mgr.a (mgr.14388) 6297 : audit [DBG] from='client.144819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:53 smithi027 bash[22610]: audit 2024-08-31T04:36:52.655253+0000 mgr.a (mgr.14388) 6297 : audit [DBG] from='client.144819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:53 smithi191 bash[24992]: audit 2024-08-31T04:36:52.655253+0000 mgr.a (mgr.14388) 6297 : audit [DBG] from='client.144819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:54 smithi163 bash[24253]: cluster 2024-08-31T04:36:52.784971+0000 mgr.a (mgr.14388) 6298 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:54 smithi027 bash[22610]: cluster 2024-08-31T04:36:52.784971+0000 mgr.a (mgr.14388) 6298 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:54 smithi191 bash[24992]: cluster 2024-08-31T04:36:52.784971+0000 mgr.a (mgr.14388) 6298 : cluster [DBG] pgmap v4365: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:36:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:55 smithi163 bash[24253]: audit 2024-08-31T04:36:54.871623+0000 mon.a (mon.0) 1524 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:36:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:55 smithi027 bash[22610]: audit 2024-08-31T04:36:54.871623+0000 mon.a (mon.0) 1524 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:36:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:55 smithi191 bash[24992]: audit 2024-08-31T04:36:54.871623+0000 mon.a (mon.0) 1524 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:36:56.449 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:56 smithi027 bash[22610]: cluster 2024-08-31T04:36:54.787335+0000 mgr.a (mgr.14388) 6299 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:36:56.449 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:56 smithi027 bash[22610]: audit 2024-08-31T04:36:55.720859+0000 mon.a (mon.0) 1525 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:36:56.449 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:56 smithi027 bash[22610]: audit 2024-08-31T04:36:55.722361+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:36:56.449 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:56 smithi027 bash[22610]: audit 2024-08-31T04:36:55.732437+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:36:56.449 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:56 smithi027 bash[22610]: audit 2024-08-31T04:36:55.735453+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:36:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:56 smithi163 bash[24253]: cluster 2024-08-31T04:36:54.787335+0000 mgr.a (mgr.14388) 6299 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:36:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:56 smithi163 bash[24253]: audit 2024-08-31T04:36:55.720859+0000 mon.a (mon.0) 1525 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:36:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:56 smithi163 bash[24253]: audit 2024-08-31T04:36:55.722361+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:36:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:56 smithi163 bash[24253]: audit 2024-08-31T04:36:55.732437+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:36:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:56 smithi163 bash[24253]: audit 2024-08-31T04:36:55.735453+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:36:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:56 smithi191 bash[24992]: cluster 2024-08-31T04:36:54.787335+0000 mgr.a (mgr.14388) 6299 : cluster [DBG] pgmap v4366: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:36:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:56 smithi191 bash[24992]: audit 2024-08-31T04:36:55.720859+0000 mon.a (mon.0) 1525 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:36:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:56 smithi191 bash[24992]: audit 2024-08-31T04:36:55.722361+0000 mon.a (mon.0) 1526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:36:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:56 smithi191 bash[24992]: audit 2024-08-31T04:36:55.732437+0000 mon.a (mon.0) 1527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:36:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:56 smithi191 bash[24992]: audit 2024-08-31T04:36:55.735453+0000 mon.a (mon.0) 1528 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:36:56.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:36:56 smithi027 bash[22863]: debug 2024-08-31T04:36:56.446+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:36:56.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:36:56 smithi027 bash[22863]: debug 2024-08-31T04:36:56.450+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:36:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:57 smithi163 bash[24253]: audit 2024-08-31T04:36:55.736715+0000 mgr.a (mgr.14388) 6300 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:36:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:57 smithi163 bash[24253]: audit 2024-08-31T04:36:56.450272+0000 mgr.a (mgr.14388) 6301 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:36:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:57 smithi163 bash[24253]: cephadm 2024-08-31T04:36:56.452295+0000 mgr.a (mgr.14388) 6302 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:36:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:57 smithi027 bash[22610]: audit 2024-08-31T04:36:55.736715+0000 mgr.a (mgr.14388) 6300 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:36:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:57 smithi027 bash[22610]: audit 2024-08-31T04:36:56.450272+0000 mgr.a (mgr.14388) 6301 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:36:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:57 smithi027 bash[22610]: cephadm 2024-08-31T04:36:56.452295+0000 mgr.a (mgr.14388) 6302 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:36:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:57 smithi191 bash[24992]: audit 2024-08-31T04:36:55.736715+0000 mgr.a (mgr.14388) 6300 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:36:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:57 smithi191 bash[24992]: audit 2024-08-31T04:36:56.450272+0000 mgr.a (mgr.14388) 6301 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:36:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:57 smithi191 bash[24992]: cephadm 2024-08-31T04:36:56.452295+0000 mgr.a (mgr.14388) 6302 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:36:58.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:36:58.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:36:58.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:36:58.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:58 smithi163 bash[24253]: cluster 2024-08-31T04:36:56.788274+0000 mgr.a (mgr.14388) 6303 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:36:58.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:58 smithi027 bash[22610]: cluster 2024-08-31T04:36:56.788274+0000 mgr.a (mgr.14388) 6303 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:36:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:58 smithi191 bash[24992]: cluster 2024-08-31T04:36:56.788274+0000 mgr.a (mgr.14388) 6303 : cluster [DBG] pgmap v4367: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:36:58.797 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:36:58.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:36:58.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:36:58.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:36:58.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:36:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:36:59 smithi163 bash[24253]: audit 2024-08-31T04:36:58.390885+0000 mgr.a (mgr.14388) 6304 : audit [DBG] from='client.145005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:36:59 smithi027 bash[22610]: audit 2024-08-31T04:36:58.390885+0000 mgr.a (mgr.14388) 6304 : audit [DBG] from='client.145005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:36:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:36:59 smithi191 bash[24992]: audit 2024-08-31T04:36:58.390885+0000 mgr.a (mgr.14388) 6304 : audit [DBG] from='client.145005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:00 smithi163 bash[24253]: cluster 2024-08-31T04:36:58.789542+0000 mgr.a (mgr.14388) 6305 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:37:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:00 smithi027 bash[22610]: cluster 2024-08-31T04:36:58.789542+0000 mgr.a (mgr.14388) 6305 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:37:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:00 smithi191 bash[24992]: cluster 2024-08-31T04:36:58.789542+0000 mgr.a (mgr.14388) 6305 : cluster [DBG] pgmap v4368: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:37:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:02 smithi163 bash[24253]: cluster 2024-08-31T04:37:00.790291+0000 mgr.a (mgr.14388) 6306 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:37:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:02 smithi027 bash[22610]: cluster 2024-08-31T04:37:00.790291+0000 mgr.a (mgr.14388) 6306 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:37:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:02 smithi191 bash[24992]: cluster 2024-08-31T04:37:00.790291+0000 mgr.a (mgr.14388) 6306 : cluster [DBG] pgmap v4369: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:37:03.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:37:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:37:03.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:37:04.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:04 smithi163 bash[24253]: cluster 2024-08-31T04:37:02.791077+0000 mgr.a (mgr.14388) 6307 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:37:04.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:04 smithi027 bash[22610]: cluster 2024-08-31T04:37:02.791077+0000 mgr.a (mgr.14388) 6307 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:37:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:04 smithi191 bash[24992]: cluster 2024-08-31T04:37:02.791077+0000 mgr.a (mgr.14388) 6307 : cluster [DBG] pgmap v4370: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:37:04.552 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:37:04.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:37:04.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:37:04.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:37:04.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:37:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:05 smithi163 bash[24253]: audit 2024-08-31T04:37:04.128944+0000 mgr.a (mgr.14388) 6308 : audit [DBG] from='client.145083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:05 smithi027 bash[22610]: audit 2024-08-31T04:37:04.128944+0000 mgr.a (mgr.14388) 6308 : audit [DBG] from='client.145083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:05 smithi191 bash[24992]: audit 2024-08-31T04:37:04.128944+0000 mgr.a (mgr.14388) 6308 : audit [DBG] from='client.145083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:06 smithi163 bash[24253]: cluster 2024-08-31T04:37:04.793761+0000 mgr.a (mgr.14388) 6309 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:37:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:06 smithi027 bash[22610]: cluster 2024-08-31T04:37:04.793761+0000 mgr.a (mgr.14388) 6309 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:37:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:06 smithi191 bash[24992]: cluster 2024-08-31T04:37:04.793761+0000 mgr.a (mgr.14388) 6309 : cluster [DBG] pgmap v4371: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:37:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:08 smithi163 bash[24253]: cluster 2024-08-31T04:37:06.794543+0000 mgr.a (mgr.14388) 6310 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:37:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:08 smithi027 bash[22610]: cluster 2024-08-31T04:37:06.794543+0000 mgr.a (mgr.14388) 6310 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:37:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:08 smithi191 bash[24992]: cluster 2024-08-31T04:37:06.794543+0000 mgr.a (mgr.14388) 6310 : cluster [DBG] pgmap v4372: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:37:09.554 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:37:09.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:37:09.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:37:10.323 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:37:10.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:37:10.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:37:10.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:37:10.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:37:10.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:10 smithi163 bash[24253]: cluster 2024-08-31T04:37:08.796559+0000 mgr.a (mgr.14388) 6311 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:37:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:10 smithi027 bash[22610]: cluster 2024-08-31T04:37:08.796559+0000 mgr.a (mgr.14388) 6311 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:37:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:10 smithi191 bash[24992]: cluster 2024-08-31T04:37:08.796559+0000 mgr.a (mgr.14388) 6311 : cluster [DBG] pgmap v4373: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:37:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:11 smithi163 bash[24253]: audit 2024-08-31T04:37:09.893592+0000 mgr.a (mgr.14388) 6312 : audit [DBG] from='client.145158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:11 smithi027 bash[22610]: audit 2024-08-31T04:37:09.893592+0000 mgr.a (mgr.14388) 6312 : audit [DBG] from='client.145158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:11 smithi191 bash[24992]: audit 2024-08-31T04:37:09.893592+0000 mgr.a (mgr.14388) 6312 : audit [DBG] from='client.145158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:12 smithi163 bash[24253]: cluster 2024-08-31T04:37:10.797546+0000 mgr.a (mgr.14388) 6313 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:12 smithi027 bash[22610]: cluster 2024-08-31T04:37:10.797546+0000 mgr.a (mgr.14388) 6313 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:12 smithi191 bash[24992]: cluster 2024-08-31T04:37:10.797546+0000 mgr.a (mgr.14388) 6313 : cluster [DBG] pgmap v4374: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:14 smithi163 bash[24253]: cluster 2024-08-31T04:37:12.798337+0000 mgr.a (mgr.14388) 6314 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:14 smithi027 bash[22610]: cluster 2024-08-31T04:37:12.798337+0000 mgr.a (mgr.14388) 6314 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:14 smithi191 bash[24992]: cluster 2024-08-31T04:37:12.798337+0000 mgr.a (mgr.14388) 6314 : cluster [DBG] pgmap v4375: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:37:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:37:15.325 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:37:16.075 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:37:16.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:37:16.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:37:16.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:37:16.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:37:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:16 smithi163 bash[24253]: cluster 2024-08-31T04:37:14.800592+0000 mgr.a (mgr.14388) 6315 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:16 smithi163 bash[24253]: audit 2024-08-31T04:37:15.659079+0000 mgr.a (mgr.14388) 6316 : audit [DBG] from='client.145236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:16 smithi027 bash[22610]: cluster 2024-08-31T04:37:14.800592+0000 mgr.a (mgr.14388) 6315 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:16 smithi027 bash[22610]: audit 2024-08-31T04:37:15.659079+0000 mgr.a (mgr.14388) 6316 : audit [DBG] from='client.145236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:16 smithi191 bash[24992]: cluster 2024-08-31T04:37:14.800592+0000 mgr.a (mgr.14388) 6315 : cluster [DBG] pgmap v4376: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:16 smithi191 bash[24992]: audit 2024-08-31T04:37:15.659079+0000 mgr.a (mgr.14388) 6316 : audit [DBG] from='client.145236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:18 smithi163 bash[24253]: cluster 2024-08-31T04:37:16.801544+0000 mgr.a (mgr.14388) 6317 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:18 smithi027 bash[22610]: cluster 2024-08-31T04:37:16.801544+0000 mgr.a (mgr.14388) 6317 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:18 smithi191 bash[24992]: cluster 2024-08-31T04:37:16.801544+0000 mgr.a (mgr.14388) 6317 : cluster [DBG] pgmap v4377: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:20 smithi027 bash[22610]: cluster 2024-08-31T04:37:18.803804+0000 mgr.a (mgr.14388) 6318 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:20 smithi191 bash[24992]: cluster 2024-08-31T04:37:18.803804+0000 mgr.a (mgr.14388) 6318 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:20 smithi163 bash[24253]: cluster 2024-08-31T04:37:18.803804+0000 mgr.a (mgr.14388) 6318 : cluster [DBG] pgmap v4378: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:37:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:37:21.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:37:21.821 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:37:21.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:37:21.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:37:21.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:37:21.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:37:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:22 smithi027 bash[22610]: cluster 2024-08-31T04:37:20.804564+0000 mgr.a (mgr.14388) 6319 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:22 smithi027 bash[22610]: audit 2024-08-31T04:37:21.411668+0000 mgr.a (mgr.14388) 6320 : audit [DBG] from='client.145314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:22 smithi191 bash[24992]: cluster 2024-08-31T04:37:20.804564+0000 mgr.a (mgr.14388) 6319 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:22 smithi191 bash[24992]: audit 2024-08-31T04:37:21.411668+0000 mgr.a (mgr.14388) 6320 : audit [DBG] from='client.145314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:22 smithi163 bash[24253]: cluster 2024-08-31T04:37:20.804564+0000 mgr.a (mgr.14388) 6319 : cluster [DBG] pgmap v4379: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:22 smithi163 bash[24253]: audit 2024-08-31T04:37:21.411668+0000 mgr.a (mgr.14388) 6320 : audit [DBG] from='client.145314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:24 smithi027 bash[22610]: cluster 2024-08-31T04:37:22.805445+0000 mgr.a (mgr.14388) 6321 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:24 smithi191 bash[24992]: cluster 2024-08-31T04:37:22.805445+0000 mgr.a (mgr.14388) 6321 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:24 smithi163 bash[24253]: cluster 2024-08-31T04:37:22.805445+0000 mgr.a (mgr.14388) 6321 : cluster [DBG] pgmap v4380: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:26 smithi027 bash[22610]: cluster 2024-08-31T04:37:24.807693+0000 mgr.a (mgr.14388) 6322 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:26 smithi191 bash[24992]: cluster 2024-08-31T04:37:24.807693+0000 mgr.a (mgr.14388) 6322 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:26 smithi163 bash[24253]: cluster 2024-08-31T04:37:24.807693+0000 mgr.a (mgr.14388) 6322 : cluster [DBG] pgmap v4381: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:26.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:37:26.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:37:26.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:37:27.588 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:37:27.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:37:27.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:37:27.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:37:27.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:37:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:28 smithi027 bash[22610]: cluster 2024-08-31T04:37:26.808447+0000 mgr.a (mgr.14388) 6323 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:28 smithi027 bash[22610]: audit 2024-08-31T04:37:27.160427+0000 mgr.a (mgr.14388) 6324 : audit [DBG] from='client.145386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:28 smithi191 bash[24992]: cluster 2024-08-31T04:37:26.808447+0000 mgr.a (mgr.14388) 6323 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:28 smithi191 bash[24992]: audit 2024-08-31T04:37:27.160427+0000 mgr.a (mgr.14388) 6324 : audit [DBG] from='client.145386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:28 smithi163 bash[24253]: cluster 2024-08-31T04:37:26.808447+0000 mgr.a (mgr.14388) 6323 : cluster [DBG] pgmap v4382: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:28 smithi163 bash[24253]: audit 2024-08-31T04:37:27.160427+0000 mgr.a (mgr.14388) 6324 : audit [DBG] from='client.145386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:30 smithi027 bash[22610]: cluster 2024-08-31T04:37:28.810762+0000 mgr.a (mgr.14388) 6325 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:30 smithi191 bash[24992]: cluster 2024-08-31T04:37:28.810762+0000 mgr.a (mgr.14388) 6325 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:30 smithi163 bash[24253]: cluster 2024-08-31T04:37:28.810762+0000 mgr.a (mgr.14388) 6325 : cluster [DBG] pgmap v4383: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:32 smithi027 bash[22610]: cluster 2024-08-31T04:37:30.811551+0000 mgr.a (mgr.14388) 6326 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:32 smithi191 bash[24992]: cluster 2024-08-31T04:37:30.811551+0000 mgr.a (mgr.14388) 6326 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:32.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:37:32.590 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:37:32.590 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:37:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:32 smithi163 bash[24253]: cluster 2024-08-31T04:37:30.811551+0000 mgr.a (mgr.14388) 6326 : cluster [DBG] pgmap v4384: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:33.336 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:37:33.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:37:33.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:37:33.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:37:33.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:37:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:34 smithi027 bash[22610]: cluster 2024-08-31T04:37:32.812284+0000 mgr.a (mgr.14388) 6327 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:34 smithi027 bash[22610]: audit 2024-08-31T04:37:32.924610+0000 mgr.a (mgr.14388) 6328 : audit [DBG] from='client.145464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:34 smithi191 bash[24992]: cluster 2024-08-31T04:37:32.812284+0000 mgr.a (mgr.14388) 6327 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:34 smithi191 bash[24992]: audit 2024-08-31T04:37:32.924610+0000 mgr.a (mgr.14388) 6328 : audit [DBG] from='client.145464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:34 smithi163 bash[24253]: cluster 2024-08-31T04:37:32.812284+0000 mgr.a (mgr.14388) 6327 : cluster [DBG] pgmap v4385: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:34 smithi163 bash[24253]: audit 2024-08-31T04:37:32.924610+0000 mgr.a (mgr.14388) 6328 : audit [DBG] from='client.145464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:36 smithi191 bash[24992]: cluster 2024-08-31T04:37:34.814986+0000 mgr.a (mgr.14388) 6329 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:37:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:36 smithi163 bash[24253]: cluster 2024-08-31T04:37:34.814986+0000 mgr.a (mgr.14388) 6329 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:37:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:36 smithi027 bash[22610]: cluster 2024-08-31T04:37:34.814986+0000 mgr.a (mgr.14388) 6329 : cluster [DBG] pgmap v4386: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:37:38.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:37:38.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:37:38.339 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:37:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:38 smithi191 bash[24992]: cluster 2024-08-31T04:37:36.815707+0000 mgr.a (mgr.14388) 6330 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:37:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:38 smithi163 bash[24253]: cluster 2024-08-31T04:37:36.815707+0000 mgr.a (mgr.14388) 6330 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:37:38.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:38 smithi027 bash[22610]: cluster 2024-08-31T04:37:36.815707+0000 mgr.a (mgr.14388) 6330 : cluster [DBG] pgmap v4387: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:37:39.104 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:37:39.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:37:39.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:37:39.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:37:39.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:37:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:39 smithi191 bash[24992]: audit 2024-08-31T04:37:38.678881+0000 mgr.a (mgr.14388) 6331 : audit [DBG] from='client.145539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:39 smithi163 bash[24253]: audit 2024-08-31T04:37:38.678881+0000 mgr.a (mgr.14388) 6331 : audit [DBG] from='client.145539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:39 smithi027 bash[22610]: audit 2024-08-31T04:37:38.678881+0000 mgr.a (mgr.14388) 6331 : audit [DBG] from='client.145539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:40 smithi191 bash[24992]: cluster 2024-08-31T04:37:38.817200+0000 mgr.a (mgr.14388) 6332 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:40 smithi163 bash[24253]: cluster 2024-08-31T04:37:38.817200+0000 mgr.a (mgr.14388) 6332 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:40 smithi027 bash[22610]: cluster 2024-08-31T04:37:38.817200+0000 mgr.a (mgr.14388) 6332 : cluster [DBG] pgmap v4388: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:42 smithi191 bash[24992]: cluster 2024-08-31T04:37:40.818220+0000 mgr.a (mgr.14388) 6333 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:37:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:42 smithi163 bash[24253]: cluster 2024-08-31T04:37:40.818220+0000 mgr.a (mgr.14388) 6333 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:37:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:42 smithi027 bash[22610]: cluster 2024-08-31T04:37:40.818220+0000 mgr.a (mgr.14388) 6333 : cluster [DBG] pgmap v4389: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:37:44.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:37:44.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:37:44.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:37:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:44 smithi191 bash[24992]: cluster 2024-08-31T04:37:42.819217+0000 mgr.a (mgr.14388) 6334 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:37:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:44 smithi163 bash[24253]: cluster 2024-08-31T04:37:42.819217+0000 mgr.a (mgr.14388) 6334 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:37:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:44 smithi027 bash[22610]: cluster 2024-08-31T04:37:42.819217+0000 mgr.a (mgr.14388) 6334 : cluster [DBG] pgmap v4390: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:37:44.872 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:37:44.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:37:44.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:37:44.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:37:44.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:37:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:45 smithi191 bash[24992]: audit 2024-08-31T04:37:44.444526+0000 mgr.a (mgr.14388) 6335 : audit [DBG] from='client.145614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:45 smithi163 bash[24253]: audit 2024-08-31T04:37:44.444526+0000 mgr.a (mgr.14388) 6335 : audit [DBG] from='client.145614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:45 smithi027 bash[22610]: audit 2024-08-31T04:37:44.444526+0000 mgr.a (mgr.14388) 6335 : audit [DBG] from='client.145614 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:46 smithi191 bash[24992]: cluster 2024-08-31T04:37:44.820575+0000 mgr.a (mgr.14388) 6336 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:46 smithi163 bash[24253]: cluster 2024-08-31T04:37:44.820575+0000 mgr.a (mgr.14388) 6336 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:46 smithi027 bash[22610]: cluster 2024-08-31T04:37:44.820575+0000 mgr.a (mgr.14388) 6336 : cluster [DBG] pgmap v4391: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:48 smithi191 bash[24992]: cluster 2024-08-31T04:37:46.821344+0000 mgr.a (mgr.14388) 6337 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:37:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:48 smithi163 bash[24253]: cluster 2024-08-31T04:37:46.821344+0000 mgr.a (mgr.14388) 6337 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:37:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:48 smithi027 bash[22610]: cluster 2024-08-31T04:37:46.821344+0000 mgr.a (mgr.14388) 6337 : cluster [DBG] pgmap v4392: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:37:49.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:37:49.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:37:49.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:37:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:50 smithi191 bash[24992]: cluster 2024-08-31T04:37:48.823322+0000 mgr.a (mgr.14388) 6338 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:37:50.653 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:37:50.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:37:50.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:37:50.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:37:50.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:37:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:50 smithi163 bash[24253]: cluster 2024-08-31T04:37:48.823322+0000 mgr.a (mgr.14388) 6338 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:37:50.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:50 smithi027 bash[22610]: cluster 2024-08-31T04:37:48.823322+0000 mgr.a (mgr.14388) 6338 : cluster [DBG] pgmap v4393: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:37:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:51 smithi191 bash[24992]: audit 2024-08-31T04:37:50.215406+0000 mgr.a (mgr.14388) 6339 : audit [DBG] from='client.145689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:51 smithi163 bash[24253]: audit 2024-08-31T04:37:50.215406+0000 mgr.a (mgr.14388) 6339 : audit [DBG] from='client.145689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:51 smithi027 bash[22610]: audit 2024-08-31T04:37:50.215406+0000 mgr.a (mgr.14388) 6339 : audit [DBG] from='client.145689 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:52 smithi163 bash[24253]: cluster 2024-08-31T04:37:50.824259+0000 mgr.a (mgr.14388) 6340 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:52 smithi027 bash[22610]: cluster 2024-08-31T04:37:50.824259+0000 mgr.a (mgr.14388) 6340 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:52 smithi191 bash[24992]: cluster 2024-08-31T04:37:50.824259+0000 mgr.a (mgr.14388) 6340 : cluster [DBG] pgmap v4394: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:54 smithi163 bash[24253]: cluster 2024-08-31T04:37:52.825046+0000 mgr.a (mgr.14388) 6341 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:54 smithi027 bash[22610]: cluster 2024-08-31T04:37:52.825046+0000 mgr.a (mgr.14388) 6341 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:54 smithi191 bash[24992]: cluster 2024-08-31T04:37:52.825046+0000 mgr.a (mgr.14388) 6341 : cluster [DBG] pgmap v4395: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:37:55.655 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:37:55.655 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:37:56.411 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:37:56.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:37:56.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:37:56.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:37:56.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:37:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:56 smithi163 bash[24253]: cluster 2024-08-31T04:37:54.827274+0000 mgr.a (mgr.14388) 6342 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:56.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:56 smithi027 bash[22610]: cluster 2024-08-31T04:37:54.827274+0000 mgr.a (mgr.14388) 6342 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:56 smithi191 bash[24992]: cluster 2024-08-31T04:37:54.827274+0000 mgr.a (mgr.14388) 6342 : cluster [DBG] pgmap v4396: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:37:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:57 smithi163 bash[24253]: audit 2024-08-31T04:37:55.989668+0000 mgr.a (mgr.14388) 6343 : audit [DBG] from='client.145767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:57 smithi163 bash[24253]: audit 2024-08-31T04:37:56.505192+0000 mon.a (mon.0) 1529 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:37:57.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:57 smithi027 bash[22610]: audit 2024-08-31T04:37:55.989668+0000 mgr.a (mgr.14388) 6343 : audit [DBG] from='client.145767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:57.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:57 smithi027 bash[22610]: audit 2024-08-31T04:37:56.505192+0000 mon.a (mon.0) 1529 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:37:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:57 smithi191 bash[24992]: audit 2024-08-31T04:37:55.989668+0000 mgr.a (mgr.14388) 6343 : audit [DBG] from='client.145767 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:37:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:57 smithi191 bash[24992]: audit 2024-08-31T04:37:56.505192+0000 mon.a (mon.0) 1529 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:37:58.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:37:58 smithi027 bash[22863]: debug 2024-08-31T04:37:58.104+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:37:58.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:37:58 smithi027 bash[22863]: debug 2024-08-31T04:37:58.104+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:37:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:58 smithi027 bash[22610]: cluster 2024-08-31T04:37:56.828199+0000 mgr.a (mgr.14388) 6344 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:58 smithi027 bash[22610]: audit 2024-08-31T04:37:57.352284+0000 mon.a (mon.0) 1530 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:37:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:58 smithi027 bash[22610]: audit 2024-08-31T04:37:57.354136+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:37:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:58 smithi027 bash[22610]: audit 2024-08-31T04:37:57.365937+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:37:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:58 smithi027 bash[22610]: audit 2024-08-31T04:37:57.370811+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:37:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:58 smithi027 bash[22610]: audit 2024-08-31T04:37:57.373459+0000 mgr.a (mgr.14388) 6345 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:37:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:58 smithi163 bash[24253]: cluster 2024-08-31T04:37:56.828199+0000 mgr.a (mgr.14388) 6344 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:58 smithi163 bash[24253]: audit 2024-08-31T04:37:57.352284+0000 mon.a (mon.0) 1530 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:37:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:58 smithi163 bash[24253]: audit 2024-08-31T04:37:57.354136+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:37:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:58 smithi163 bash[24253]: audit 2024-08-31T04:37:57.365937+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:37:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:58 smithi163 bash[24253]: audit 2024-08-31T04:37:57.370811+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:37:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:58 smithi163 bash[24253]: audit 2024-08-31T04:37:57.373459+0000 mgr.a (mgr.14388) 6345 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:37:58.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:58 smithi191 bash[24992]: cluster 2024-08-31T04:37:56.828199+0000 mgr.a (mgr.14388) 6344 : cluster [DBG] pgmap v4397: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:37:58.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:58 smithi191 bash[24992]: audit 2024-08-31T04:37:57.352284+0000 mon.a (mon.0) 1530 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:37:58.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:58 smithi191 bash[24992]: audit 2024-08-31T04:37:57.354136+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:37:58.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:58 smithi191 bash[24992]: audit 2024-08-31T04:37:57.365937+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:37:58.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:58 smithi191 bash[24992]: audit 2024-08-31T04:37:57.370811+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:37:58.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:58 smithi191 bash[24992]: audit 2024-08-31T04:37:57.373459+0000 mgr.a (mgr.14388) 6345 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:37:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:59 smithi163 bash[24253]: audit 2024-08-31T04:37:58.106883+0000 mgr.a (mgr.14388) 6346 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:37:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:37:59 smithi163 bash[24253]: cephadm 2024-08-31T04:37:58.108335+0000 mgr.a (mgr.14388) 6347 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:37:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:59 smithi027 bash[22610]: audit 2024-08-31T04:37:58.106883+0000 mgr.a (mgr.14388) 6346 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:37:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:37:59 smithi027 bash[22610]: cephadm 2024-08-31T04:37:58.108335+0000 mgr.a (mgr.14388) 6347 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:37:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:59 smithi191 bash[24992]: audit 2024-08-31T04:37:58.106883+0000 mgr.a (mgr.14388) 6346 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:37:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:37:59 smithi191 bash[24992]: cephadm 2024-08-31T04:37:58.108335+0000 mgr.a (mgr.14388) 6347 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:38:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:00 smithi163 bash[24253]: cluster 2024-08-31T04:37:58.830657+0000 mgr.a (mgr.14388) 6348 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T04:38:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:00 smithi027 bash[22610]: cluster 2024-08-31T04:37:58.830657+0000 mgr.a (mgr.14388) 6348 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T04:38:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:00 smithi191 bash[24992]: cluster 2024-08-31T04:37:58.830657+0000 mgr.a (mgr.14388) 6348 : cluster [DBG] pgmap v4398: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T04:38:01.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:01.414 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:01.414 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:02.150 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:38:02.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:02.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:02.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:02.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:02 smithi163 bash[24253]: cluster 2024-08-31T04:38:00.831509+0000 mgr.a (mgr.14388) 6349 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T04:38:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:02 smithi027 bash[22610]: cluster 2024-08-31T04:38:00.831509+0000 mgr.a (mgr.14388) 6349 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T04:38:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:02 smithi191 bash[24992]: cluster 2024-08-31T04:38:00.831509+0000 mgr.a (mgr.14388) 6349 : cluster [DBG] pgmap v4399: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T04:38:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:03 smithi163 bash[24253]: audit 2024-08-31T04:38:01.744852+0000 mgr.a (mgr.14388) 6350 : audit [DBG] from='client.145953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:03 smithi027 bash[22610]: audit 2024-08-31T04:38:01.744852+0000 mgr.a (mgr.14388) 6350 : audit [DBG] from='client.145953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:03 smithi191 bash[24992]: audit 2024-08-31T04:38:01.744852+0000 mgr.a (mgr.14388) 6350 : audit [DBG] from='client.145953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:04 smithi163 bash[24253]: cluster 2024-08-31T04:38:02.832543+0000 mgr.a (mgr.14388) 6351 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T04:38:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:04 smithi027 bash[22610]: cluster 2024-08-31T04:38:02.832543+0000 mgr.a (mgr.14388) 6351 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T04:38:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:04 smithi191 bash[24992]: cluster 2024-08-31T04:38:02.832543+0000 mgr.a (mgr.14388) 6351 : cluster [DBG] pgmap v4400: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T04:38:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:06 smithi163 bash[24253]: cluster 2024-08-31T04:38:04.834977+0000 mgr.a (mgr.14388) 6352 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:38:06.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:06 smithi027 bash[22610]: cluster 2024-08-31T04:38:04.834977+0000 mgr.a (mgr.14388) 6352 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:38:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:06 smithi191 bash[24992]: cluster 2024-08-31T04:38:04.834977+0000 mgr.a (mgr.14388) 6352 : cluster [DBG] pgmap v4401: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:38:07.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:07.152 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:07.152 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:07.889 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:38:07.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:07.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:07.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:07.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:08 smithi163 bash[24253]: cluster 2024-08-31T04:38:06.835914+0000 mgr.a (mgr.14388) 6353 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:38:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:08 smithi163 bash[24253]: audit 2024-08-31T04:38:07.482312+0000 mgr.a (mgr.14388) 6354 : audit [DBG] from='client.146031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:08 smithi027 bash[22610]: cluster 2024-08-31T04:38:06.835914+0000 mgr.a (mgr.14388) 6353 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:38:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:08 smithi027 bash[22610]: audit 2024-08-31T04:38:07.482312+0000 mgr.a (mgr.14388) 6354 : audit [DBG] from='client.146031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:08 smithi191 bash[24992]: cluster 2024-08-31T04:38:06.835914+0000 mgr.a (mgr.14388) 6353 : cluster [DBG] pgmap v4402: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:38:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:08 smithi191 bash[24992]: audit 2024-08-31T04:38:07.482312+0000 mgr.a (mgr.14388) 6354 : audit [DBG] from='client.146031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:10 smithi163 bash[24253]: cluster 2024-08-31T04:38:08.838246+0000 mgr.a (mgr.14388) 6355 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:38:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:10 smithi027 bash[22610]: cluster 2024-08-31T04:38:08.838246+0000 mgr.a (mgr.14388) 6355 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:38:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:10 smithi191 bash[24992]: cluster 2024-08-31T04:38:08.838246+0000 mgr.a (mgr.14388) 6355 : cluster [DBG] pgmap v4403: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:38:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:12 smithi163 bash[24253]: cluster 2024-08-31T04:38:10.839054+0000 mgr.a (mgr.14388) 6356 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:38:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:12 smithi027 bash[22610]: cluster 2024-08-31T04:38:10.839054+0000 mgr.a (mgr.14388) 6356 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:38:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:12 smithi191 bash[24992]: cluster 2024-08-31T04:38:10.839054+0000 mgr.a (mgr.14388) 6356 : cluster [DBG] pgmap v4404: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:38:12.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:12.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:12.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:13.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:38:13.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:13.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:13.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:13.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:14 smithi163 bash[24253]: cluster 2024-08-31T04:38:12.839838+0000 mgr.a (mgr.14388) 6357 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:38:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:14 smithi163 bash[24253]: audit 2024-08-31T04:38:13.230372+0000 mgr.a (mgr.14388) 6358 : audit [DBG] from='client.146106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:14 smithi027 bash[22610]: cluster 2024-08-31T04:38:12.839838+0000 mgr.a (mgr.14388) 6357 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:38:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:14 smithi027 bash[22610]: audit 2024-08-31T04:38:13.230372+0000 mgr.a (mgr.14388) 6358 : audit [DBG] from='client.146106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:14 smithi191 bash[24992]: cluster 2024-08-31T04:38:12.839838+0000 mgr.a (mgr.14388) 6357 : cluster [DBG] pgmap v4405: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:38:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:14 smithi191 bash[24992]: audit 2024-08-31T04:38:13.230372+0000 mgr.a (mgr.14388) 6358 : audit [DBG] from='client.146106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:16 smithi163 bash[24253]: cluster 2024-08-31T04:38:14.842522+0000 mgr.a (mgr.14388) 6359 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:38:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:16 smithi027 bash[22610]: cluster 2024-08-31T04:38:14.842522+0000 mgr.a (mgr.14388) 6359 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:38:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:16 smithi191 bash[24992]: cluster 2024-08-31T04:38:14.842522+0000 mgr.a (mgr.14388) 6359 : cluster [DBG] pgmap v4406: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:38:18.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:18.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:18.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:18 smithi163 bash[24253]: cluster 2024-08-31T04:38:16.843311+0000 mgr.a (mgr.14388) 6360 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:38:18.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:18 smithi027 bash[22610]: cluster 2024-08-31T04:38:16.843311+0000 mgr.a (mgr.14388) 6360 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:38:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:18 smithi191 bash[24992]: cluster 2024-08-31T04:38:16.843311+0000 mgr.a (mgr.14388) 6360 : cluster [DBG] pgmap v4407: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:38:19.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:19.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:19.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:19.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:19.426 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:38:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:20 smithi163 bash[24253]: cluster 2024-08-31T04:38:18.844751+0000 mgr.a (mgr.14388) 6361 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:20 smithi163 bash[24253]: audit 2024-08-31T04:38:19.010717+0000 mgr.a (mgr.14388) 6362 : audit [DBG] from='client.146181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:20 smithi027 bash[22610]: cluster 2024-08-31T04:38:18.844751+0000 mgr.a (mgr.14388) 6361 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:20 smithi027 bash[22610]: audit 2024-08-31T04:38:19.010717+0000 mgr.a (mgr.14388) 6362 : audit [DBG] from='client.146181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:20 smithi191 bash[24992]: cluster 2024-08-31T04:38:18.844751+0000 mgr.a (mgr.14388) 6361 : cluster [DBG] pgmap v4408: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:20 smithi191 bash[24992]: audit 2024-08-31T04:38:19.010717+0000 mgr.a (mgr.14388) 6362 : audit [DBG] from='client.146181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:22 smithi163 bash[24253]: cluster 2024-08-31T04:38:20.845628+0000 mgr.a (mgr.14388) 6363 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:38:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:22 smithi027 bash[22610]: cluster 2024-08-31T04:38:20.845628+0000 mgr.a (mgr.14388) 6363 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:38:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:22 smithi191 bash[24992]: cluster 2024-08-31T04:38:20.845628+0000 mgr.a (mgr.14388) 6363 : cluster [DBG] pgmap v4409: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:38:24.427 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:24.428 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:24.428 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:24 smithi163 bash[24253]: cluster 2024-08-31T04:38:22.846624+0000 mgr.a (mgr.14388) 6364 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:38:24.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:24 smithi027 bash[22610]: cluster 2024-08-31T04:38:22.846624+0000 mgr.a (mgr.14388) 6364 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:38:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:24 smithi191 bash[24992]: cluster 2024-08-31T04:38:22.846624+0000 mgr.a (mgr.14388) 6364 : cluster [DBG] pgmap v4410: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:38:25.192 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:38:25.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:25.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:25.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:25.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:26 smithi163 bash[24253]: audit 2024-08-31T04:38:24.763331+0000 mgr.a (mgr.14388) 6365 : audit [DBG] from='client.146259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:26 smithi163 bash[24253]: cluster 2024-08-31T04:38:24.848334+0000 mgr.a (mgr.14388) 6366 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:26 smithi027 bash[22610]: audit 2024-08-31T04:38:24.763331+0000 mgr.a (mgr.14388) 6365 : audit [DBG] from='client.146259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:26 smithi027 bash[22610]: cluster 2024-08-31T04:38:24.848334+0000 mgr.a (mgr.14388) 6366 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:26 smithi191 bash[24992]: audit 2024-08-31T04:38:24.763331+0000 mgr.a (mgr.14388) 6365 : audit [DBG] from='client.146259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:26 smithi191 bash[24992]: cluster 2024-08-31T04:38:24.848334+0000 mgr.a (mgr.14388) 6366 : cluster [DBG] pgmap v4411: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:28 smithi163 bash[24253]: cluster 2024-08-31T04:38:26.849188+0000 mgr.a (mgr.14388) 6367 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:28 smithi027 bash[22610]: cluster 2024-08-31T04:38:26.849188+0000 mgr.a (mgr.14388) 6367 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:28 smithi191 bash[24992]: cluster 2024-08-31T04:38:26.849188+0000 mgr.a (mgr.14388) 6367 : cluster [DBG] pgmap v4412: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:30.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:30.194 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:30.194 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:30 smithi163 bash[24253]: cluster 2024-08-31T04:38:28.851451+0000 mgr.a (mgr.14388) 6368 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:30.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:30 smithi027 bash[22610]: cluster 2024-08-31T04:38:28.851451+0000 mgr.a (mgr.14388) 6368 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:30 smithi191 bash[24992]: cluster 2024-08-31T04:38:28.851451+0000 mgr.a (mgr.14388) 6368 : cluster [DBG] pgmap v4413: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:30.943 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:38:30.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:30.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:30.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:30.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:31 smithi163 bash[24253]: audit 2024-08-31T04:38:30.521285+0000 mgr.a (mgr.14388) 6369 : audit [DBG] from='client.146337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:31 smithi027 bash[22610]: audit 2024-08-31T04:38:30.521285+0000 mgr.a (mgr.14388) 6369 : audit [DBG] from='client.146337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:31 smithi191 bash[24992]: audit 2024-08-31T04:38:30.521285+0000 mgr.a (mgr.14388) 6369 : audit [DBG] from='client.146337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:32 smithi163 bash[24253]: cluster 2024-08-31T04:38:30.851989+0000 mgr.a (mgr.14388) 6370 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:32 smithi027 bash[22610]: cluster 2024-08-31T04:38:30.851989+0000 mgr.a (mgr.14388) 6370 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:32 smithi191 bash[24992]: cluster 2024-08-31T04:38:30.851989+0000 mgr.a (mgr.14388) 6370 : cluster [DBG] pgmap v4414: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:34 smithi163 bash[24253]: cluster 2024-08-31T04:38:32.852733+0000 mgr.a (mgr.14388) 6371 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:34.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:34 smithi027 bash[22610]: cluster 2024-08-31T04:38:32.852733+0000 mgr.a (mgr.14388) 6371 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:34 smithi191 bash[24992]: cluster 2024-08-31T04:38:32.852733+0000 mgr.a (mgr.14388) 6371 : cluster [DBG] pgmap v4415: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:35.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:35.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:35.946 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:36.699 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:38:36.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:36.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:36.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:36.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:36 smithi163 bash[24253]: cluster 2024-08-31T04:38:34.854960+0000 mgr.a (mgr.14388) 6372 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:36.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:36 smithi027 bash[22610]: cluster 2024-08-31T04:38:34.854960+0000 mgr.a (mgr.14388) 6372 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:36 smithi191 bash[24992]: cluster 2024-08-31T04:38:34.854960+0000 mgr.a (mgr.14388) 6372 : cluster [DBG] pgmap v4416: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:37 smithi163 bash[24253]: audit 2024-08-31T04:38:36.282918+0000 mgr.a (mgr.14388) 6373 : audit [DBG] from='client.146412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:37.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:37 smithi027 bash[22610]: audit 2024-08-31T04:38:36.282918+0000 mgr.a (mgr.14388) 6373 : audit [DBG] from='client.146412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:37 smithi191 bash[24992]: audit 2024-08-31T04:38:36.282918+0000 mgr.a (mgr.14388) 6373 : audit [DBG] from='client.146412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:38 smithi163 bash[24253]: cluster 2024-08-31T04:38:36.855941+0000 mgr.a (mgr.14388) 6374 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:38 smithi027 bash[22610]: cluster 2024-08-31T04:38:36.855941+0000 mgr.a (mgr.14388) 6374 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:38 smithi191 bash[24992]: cluster 2024-08-31T04:38:36.855941+0000 mgr.a (mgr.14388) 6374 : cluster [DBG] pgmap v4417: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:40 smithi163 bash[24253]: cluster 2024-08-31T04:38:38.858192+0000 mgr.a (mgr.14388) 6375 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:40.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:40 smithi027 bash[22610]: cluster 2024-08-31T04:38:38.858192+0000 mgr.a (mgr.14388) 6375 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:40 smithi191 bash[24992]: cluster 2024-08-31T04:38:38.858192+0000 mgr.a (mgr.14388) 6375 : cluster [DBG] pgmap v4418: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:41.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:41.702 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:41.702 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:42.478 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:38:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:42.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:42 smithi163 bash[24253]: cluster 2024-08-31T04:38:40.858978+0000 mgr.a (mgr.14388) 6376 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:42.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:42 smithi027 bash[22610]: cluster 2024-08-31T04:38:40.858978+0000 mgr.a (mgr.14388) 6376 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:42 smithi191 bash[24992]: cluster 2024-08-31T04:38:40.858978+0000 mgr.a (mgr.14388) 6376 : cluster [DBG] pgmap v4419: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:43 smithi163 bash[24253]: audit 2024-08-31T04:38:42.040090+0000 mgr.a (mgr.14388) 6377 : audit [DBG] from='client.146490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:43.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:43 smithi027 bash[22610]: audit 2024-08-31T04:38:42.040090+0000 mgr.a (mgr.14388) 6377 : audit [DBG] from='client.146490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:43 smithi191 bash[24992]: audit 2024-08-31T04:38:42.040090+0000 mgr.a (mgr.14388) 6377 : audit [DBG] from='client.146490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:44 smithi163 bash[24253]: cluster 2024-08-31T04:38:42.859927+0000 mgr.a (mgr.14388) 6378 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:44 smithi027 bash[22610]: cluster 2024-08-31T04:38:42.859927+0000 mgr.a (mgr.14388) 6378 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:44 smithi191 bash[24992]: cluster 2024-08-31T04:38:42.859927+0000 mgr.a (mgr.14388) 6378 : cluster [DBG] pgmap v4420: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:46 smithi163 bash[24253]: cluster 2024-08-31T04:38:44.862282+0000 mgr.a (mgr.14388) 6379 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:46 smithi027 bash[22610]: cluster 2024-08-31T04:38:44.862282+0000 mgr.a (mgr.14388) 6379 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:46 smithi191 bash[24992]: cluster 2024-08-31T04:38:44.862282+0000 mgr.a (mgr.14388) 6379 : cluster [DBG] pgmap v4421: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:38:47.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:47.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:47.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:38:48.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:48.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:48.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:48.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:48 smithi163 bash[24253]: cluster 2024-08-31T04:38:46.863254+0000 mgr.a (mgr.14388) 6380 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:48.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:48 smithi027 bash[22610]: cluster 2024-08-31T04:38:46.863254+0000 mgr.a (mgr.14388) 6380 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:48 smithi191 bash[24992]: cluster 2024-08-31T04:38:46.863254+0000 mgr.a (mgr.14388) 6380 : cluster [DBG] pgmap v4422: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:49 smithi027 bash[22610]: audit 2024-08-31T04:38:47.812027+0000 mgr.a (mgr.14388) 6381 : audit [DBG] from='client.146568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:49 smithi191 bash[24992]: audit 2024-08-31T04:38:47.812027+0000 mgr.a (mgr.14388) 6381 : audit [DBG] from='client.146568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:49 smithi163 bash[24253]: audit 2024-08-31T04:38:47.812027+0000 mgr.a (mgr.14388) 6381 : audit [DBG] from='client.146568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:50 smithi027 bash[22610]: cluster 2024-08-31T04:38:48.865772+0000 mgr.a (mgr.14388) 6382 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:38:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:50 smithi191 bash[24992]: cluster 2024-08-31T04:38:48.865772+0000 mgr.a (mgr.14388) 6382 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:38:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:50 smithi163 bash[24253]: cluster 2024-08-31T04:38:48.865772+0000 mgr.a (mgr.14388) 6382 : cluster [DBG] pgmap v4423: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:38:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:52 smithi027 bash[22610]: cluster 2024-08-31T04:38:50.866748+0000 mgr.a (mgr.14388) 6383 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:38:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:52 smithi191 bash[24992]: cluster 2024-08-31T04:38:50.866748+0000 mgr.a (mgr.14388) 6383 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:38:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:52 smithi163 bash[24253]: cluster 2024-08-31T04:38:50.866748+0000 mgr.a (mgr.14388) 6383 : cluster [DBG] pgmap v4424: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:38:53.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:53.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:53.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:54.001 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:38:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:54.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:54 smithi027 bash[22610]: cluster 2024-08-31T04:38:52.867511+0000 mgr.a (mgr.14388) 6384 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:38:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:54 smithi027 bash[22610]: audit 2024-08-31T04:38:53.561847+0000 mgr.a (mgr.14388) 6385 : audit [DBG] from='client.146646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:54 smithi191 bash[24992]: cluster 2024-08-31T04:38:52.867511+0000 mgr.a (mgr.14388) 6384 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:38:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:54 smithi191 bash[24992]: audit 2024-08-31T04:38:53.561847+0000 mgr.a (mgr.14388) 6385 : audit [DBG] from='client.146646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:54 smithi163 bash[24253]: cluster 2024-08-31T04:38:52.867511+0000 mgr.a (mgr.14388) 6384 : cluster [DBG] pgmap v4425: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:38:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:54 smithi163 bash[24253]: audit 2024-08-31T04:38:53.561847+0000 mgr.a (mgr.14388) 6385 : audit [DBG] from='client.146646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:38:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:56 smithi027 bash[22610]: cluster 2024-08-31T04:38:54.870111+0000 mgr.a (mgr.14388) 6386 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:56 smithi191 bash[24992]: cluster 2024-08-31T04:38:54.870111+0000 mgr.a (mgr.14388) 6386 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:56 smithi163 bash[24253]: cluster 2024-08-31T04:38:54.870111+0000 mgr.a (mgr.14388) 6386 : cluster [DBG] pgmap v4426: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:38:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:58 smithi027 bash[22610]: cluster 2024-08-31T04:38:56.870921+0000 mgr.a (mgr.14388) 6387 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:38:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:38:58 smithi027 bash[22610]: audit 2024-08-31T04:38:58.166831+0000 mon.a (mon.0) 1534 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:38:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:58 smithi191 bash[24992]: cluster 2024-08-31T04:38:56.870921+0000 mgr.a (mgr.14388) 6387 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:38:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:38:58 smithi191 bash[24992]: audit 2024-08-31T04:38:58.166831+0000 mon.a (mon.0) 1534 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:38:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:58 smithi163 bash[24253]: cluster 2024-08-31T04:38:56.870921+0000 mgr.a (mgr.14388) 6387 : cluster [DBG] pgmap v4427: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:38:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:38:58 smithi163 bash[24253]: audit 2024-08-31T04:38:58.166831+0000 mon.a (mon.0) 1534 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:38:59.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:38:59.003 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:38:59.003 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:38:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:38:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:38:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:38:59.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:38:59.773 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:00 smithi027 bash[22610]: cluster 2024-08-31T04:38:58.873122+0000 mgr.a (mgr.14388) 6388 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:00 smithi027 bash[22610]: audit 2024-08-31T04:38:59.340011+0000 mgr.a (mgr.14388) 6389 : audit [DBG] from='client.146721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:00 smithi191 bash[24992]: cluster 2024-08-31T04:38:58.873122+0000 mgr.a (mgr.14388) 6388 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:00 smithi191 bash[24992]: audit 2024-08-31T04:38:59.340011+0000 mgr.a (mgr.14388) 6389 : audit [DBG] from='client.146721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:00 smithi163 bash[24253]: cluster 2024-08-31T04:38:58.873122+0000 mgr.a (mgr.14388) 6388 : cluster [DBG] pgmap v4428: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:00 smithi163 bash[24253]: audit 2024-08-31T04:38:59.340011+0000 mgr.a (mgr.14388) 6389 : audit [DBG] from='client.146721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:02 smithi191 bash[24992]: cluster 2024-08-31T04:39:00.873997+0000 mgr.a (mgr.14388) 6390 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:39:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:02 smithi163 bash[24253]: cluster 2024-08-31T04:39:00.873997+0000 mgr.a (mgr.14388) 6390 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:39:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:02 smithi027 bash[22610]: cluster 2024-08-31T04:39:00.873997+0000 mgr.a (mgr.14388) 6390 : cluster [DBG] pgmap v4429: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:39:04.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:39:04.774 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:39:04.774 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:39:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: cluster 2024-08-31T04:39:02.874831+0000 mgr.a (mgr.14388) 6391 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:39:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: audit 2024-08-31T04:39:03.503403+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: audit 2024-08-31T04:39:03.507404+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: audit 2024-08-31T04:39:03.539336+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: audit 2024-08-31T04:39:03.543878+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: audit 2024-08-31T04:39:03.553799+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: audit 2024-08-31T04:39:03.560371+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: audit 2024-08-31T04:39:04.258702+0000 mon.a (mon.0) 1541 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:39:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: audit 2024-08-31T04:39:04.260488+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:39:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: audit 2024-08-31T04:39:04.269201+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:04 smithi191 bash[24992]: audit 2024-08-31T04:39:04.273996+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:39:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: cluster 2024-08-31T04:39:02.874831+0000 mgr.a (mgr.14388) 6391 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:39:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: audit 2024-08-31T04:39:03.503403+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: audit 2024-08-31T04:39:03.507404+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: audit 2024-08-31T04:39:03.539336+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: audit 2024-08-31T04:39:03.543878+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: audit 2024-08-31T04:39:03.553799+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: audit 2024-08-31T04:39:03.560371+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: audit 2024-08-31T04:39:04.258702+0000 mon.a (mon.0) 1541 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:39:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: audit 2024-08-31T04:39:04.260488+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:39:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: audit 2024-08-31T04:39:04.269201+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:04 smithi163 bash[24253]: audit 2024-08-31T04:39:04.273996+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:39:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: cluster 2024-08-31T04:39:02.874831+0000 mgr.a (mgr.14388) 6391 : cluster [DBG] pgmap v4430: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:39:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: audit 2024-08-31T04:39:03.503403+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: audit 2024-08-31T04:39:03.507404+0000 mon.a (mon.0) 1536 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: audit 2024-08-31T04:39:03.539336+0000 mon.a (mon.0) 1537 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: audit 2024-08-31T04:39:03.543878+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: audit 2024-08-31T04:39:03.553799+0000 mon.a (mon.0) 1539 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: audit 2024-08-31T04:39:03.560371+0000 mon.a (mon.0) 1540 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: audit 2024-08-31T04:39:04.258702+0000 mon.a (mon.0) 1541 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:39:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: audit 2024-08-31T04:39:04.260488+0000 mon.a (mon.0) 1542 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:39:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: audit 2024-08-31T04:39:04.269201+0000 mon.a (mon.0) 1543 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:39:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:04 smithi027 bash[22610]: audit 2024-08-31T04:39:04.273996+0000 mon.a (mon.0) 1544 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:39:05.481 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:39:05 smithi027 bash[22863]: debug 2024-08-31T04:39:05.015+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:39:05.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:39:05 smithi027 bash[22863]: debug 2024-08-31T04:39:05.019+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:39:05.500 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:05.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:39:05.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:39:05.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:39:05.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:39:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:05 smithi191 bash[24992]: audit 2024-08-31T04:39:04.276565+0000 mgr.a (mgr.14388) 6392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:39:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:05 smithi163 bash[24253]: audit 2024-08-31T04:39:04.276565+0000 mgr.a (mgr.14388) 6392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:39:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:05 smithi027 bash[22610]: audit 2024-08-31T04:39:04.276565+0000 mgr.a (mgr.14388) 6392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:39:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:06 smithi191 bash[24992]: cluster 2024-08-31T04:39:04.876002+0000 mgr.a (mgr.14388) 6393 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:39:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:06 smithi191 bash[24992]: audit 2024-08-31T04:39:05.022498+0000 mgr.a (mgr.14388) 6394 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:39:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:06 smithi191 bash[24992]: cephadm 2024-08-31T04:39:05.023721+0000 mgr.a (mgr.14388) 6395 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:39:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:06 smithi191 bash[24992]: audit 2024-08-31T04:39:05.104432+0000 mgr.a (mgr.14388) 6396 : audit [DBG] from='client.146892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:06 smithi163 bash[24253]: cluster 2024-08-31T04:39:04.876002+0000 mgr.a (mgr.14388) 6393 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:39:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:06 smithi163 bash[24253]: audit 2024-08-31T04:39:05.022498+0000 mgr.a (mgr.14388) 6394 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:39:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:06 smithi163 bash[24253]: cephadm 2024-08-31T04:39:05.023721+0000 mgr.a (mgr.14388) 6395 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:39:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:06 smithi163 bash[24253]: audit 2024-08-31T04:39:05.104432+0000 mgr.a (mgr.14388) 6396 : audit [DBG] from='client.146892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:06 smithi027 bash[22610]: cluster 2024-08-31T04:39:04.876002+0000 mgr.a (mgr.14388) 6393 : cluster [DBG] pgmap v4431: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:39:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:06 smithi027 bash[22610]: audit 2024-08-31T04:39:05.022498+0000 mgr.a (mgr.14388) 6394 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:39:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:06 smithi027 bash[22610]: cephadm 2024-08-31T04:39:05.023721+0000 mgr.a (mgr.14388) 6395 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:39:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:06 smithi027 bash[22610]: audit 2024-08-31T04:39:05.104432+0000 mgr.a (mgr.14388) 6396 : audit [DBG] from='client.146892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:08 smithi191 bash[24992]: cluster 2024-08-31T04:39:06.876952+0000 mgr.a (mgr.14388) 6397 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:08 smithi163 bash[24253]: cluster 2024-08-31T04:39:06.876952+0000 mgr.a (mgr.14388) 6397 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:08 smithi027 bash[22610]: cluster 2024-08-31T04:39:06.876952+0000 mgr.a (mgr.14388) 6397 : cluster [DBG] pgmap v4432: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:10.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:39:10.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:39:10.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:39:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:10 smithi191 bash[24992]: cluster 2024-08-31T04:39:08.879260+0000 mgr.a (mgr.14388) 6398 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:10 smithi163 bash[24253]: cluster 2024-08-31T04:39:08.879260+0000 mgr.a (mgr.14388) 6398 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:10.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:10 smithi027 bash[22610]: cluster 2024-08-31T04:39:08.879260+0000 mgr.a (mgr.14388) 6398 : cluster [DBG] pgmap v4433: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:11.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:11.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:39:11.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:39:11.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:39:11.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:39:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:12 smithi191 bash[24992]: audit 2024-08-31T04:39:10.846244+0000 mgr.a (mgr.14388) 6399 : audit [DBG] from='client.146982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:12 smithi191 bash[24992]: cluster 2024-08-31T04:39:10.879866+0000 mgr.a (mgr.14388) 6400 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:12 smithi163 bash[24253]: audit 2024-08-31T04:39:10.846244+0000 mgr.a (mgr.14388) 6399 : audit [DBG] from='client.146982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:12 smithi163 bash[24253]: cluster 2024-08-31T04:39:10.879866+0000 mgr.a (mgr.14388) 6400 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:12 smithi027 bash[22610]: audit 2024-08-31T04:39:10.846244+0000 mgr.a (mgr.14388) 6399 : audit [DBG] from='client.146982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:12 smithi027 bash[22610]: cluster 2024-08-31T04:39:10.879866+0000 mgr.a (mgr.14388) 6400 : cluster [DBG] pgmap v4434: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:14 smithi191 bash[24992]: cluster 2024-08-31T04:39:12.880790+0000 mgr.a (mgr.14388) 6401 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:14 smithi163 bash[24253]: cluster 2024-08-31T04:39:12.880790+0000 mgr.a (mgr.14388) 6401 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:14.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:14 smithi027 bash[22610]: cluster 2024-08-31T04:39:12.880790+0000 mgr.a (mgr.14388) 6401 : cluster [DBG] pgmap v4435: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:16.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:39:16.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:39:16.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:39:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:16 smithi191 bash[24992]: cluster 2024-08-31T04:39:14.883083+0000 mgr.a (mgr.14388) 6402 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:16 smithi163 bash[24253]: cluster 2024-08-31T04:39:14.883083+0000 mgr.a (mgr.14388) 6402 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:16.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:16 smithi027 bash[22610]: cluster 2024-08-31T04:39:14.883083+0000 mgr.a (mgr.14388) 6402 : cluster [DBG] pgmap v4436: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:17.043 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:17.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:39:17.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:39:17.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:39:17.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:39:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:17 smithi163 bash[24253]: audit 2024-08-31T04:39:16.628933+0000 mgr.a (mgr.14388) 6403 : audit [DBG] from='client.147060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:17.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:17 smithi027 bash[22610]: audit 2024-08-31T04:39:16.628933+0000 mgr.a (mgr.14388) 6403 : audit [DBG] from='client.147060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:17 smithi191 bash[24992]: audit 2024-08-31T04:39:16.628933+0000 mgr.a (mgr.14388) 6403 : audit [DBG] from='client.147060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:18 smithi163 bash[24253]: cluster 2024-08-31T04:39:16.883615+0000 mgr.a (mgr.14388) 6404 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:18 smithi027 bash[22610]: cluster 2024-08-31T04:39:16.883615+0000 mgr.a (mgr.14388) 6404 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:18 smithi191 bash[24992]: cluster 2024-08-31T04:39:16.883615+0000 mgr.a (mgr.14388) 6404 : cluster [DBG] pgmap v4437: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:20 smithi163 bash[24253]: cluster 2024-08-31T04:39:18.885901+0000 mgr.a (mgr.14388) 6405 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:20 smithi027 bash[22610]: cluster 2024-08-31T04:39:18.885901+0000 mgr.a (mgr.14388) 6405 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:20 smithi191 bash[24992]: cluster 2024-08-31T04:39:18.885901+0000 mgr.a (mgr.14388) 6405 : cluster [DBG] pgmap v4438: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:39:22.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:39:22.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:39:22.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:39:22.837 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:22.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:39:22.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:39:22.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:39:22.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:39:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:22 smithi163 bash[24253]: cluster 2024-08-31T04:39:20.886690+0000 mgr.a (mgr.14388) 6406 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:22 smithi027 bash[22610]: cluster 2024-08-31T04:39:20.886690+0000 mgr.a (mgr.14388) 6406 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:23.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:22 smithi191 bash[24992]: cluster 2024-08-31T04:39:20.886690+0000 mgr.a (mgr.14388) 6406 : cluster [DBG] pgmap v4439: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:23 smithi163 bash[24253]: audit 2024-08-31T04:39:22.384566+0000 mgr.a (mgr.14388) 6407 : audit [DBG] from='client.147135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:23 smithi027 bash[22610]: audit 2024-08-31T04:39:22.384566+0000 mgr.a (mgr.14388) 6407 : audit [DBG] from='client.147135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:23 smithi191 bash[24992]: audit 2024-08-31T04:39:22.384566+0000 mgr.a (mgr.14388) 6407 : audit [DBG] from='client.147135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:24 smithi163 bash[24253]: cluster 2024-08-31T04:39:22.887312+0000 mgr.a (mgr.14388) 6408 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:24 smithi027 bash[22610]: cluster 2024-08-31T04:39:22.887312+0000 mgr.a (mgr.14388) 6408 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:24 smithi191 bash[24992]: cluster 2024-08-31T04:39:22.887312+0000 mgr.a (mgr.14388) 6408 : cluster [DBG] pgmap v4440: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:26 smithi163 bash[24253]: cluster 2024-08-31T04:39:24.889523+0000 mgr.a (mgr.14388) 6409 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:26 smithi027 bash[22610]: cluster 2024-08-31T04:39:24.889523+0000 mgr.a (mgr.14388) 6409 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:26 smithi191 bash[24992]: cluster 2024-08-31T04:39:24.889523+0000 mgr.a (mgr.14388) 6409 : cluster [DBG] pgmap v4441: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:27.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:39:27.829 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:39:27.830 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:39:28.612 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:39:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:39:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:39:28.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:39:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:28 smithi163 bash[24253]: cluster 2024-08-31T04:39:26.890279+0000 mgr.a (mgr.14388) 6410 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:28.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:28 smithi027 bash[22610]: cluster 2024-08-31T04:39:26.890279+0000 mgr.a (mgr.14388) 6410 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:28 smithi191 bash[24992]: cluster 2024-08-31T04:39:26.890279+0000 mgr.a (mgr.14388) 6410 : cluster [DBG] pgmap v4442: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:29 smithi163 bash[24253]: audit 2024-08-31T04:39:28.172338+0000 mgr.a (mgr.14388) 6411 : audit [DBG] from='client.147207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:29 smithi027 bash[22610]: audit 2024-08-31T04:39:28.172338+0000 mgr.a (mgr.14388) 6411 : audit [DBG] from='client.147207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:29 smithi191 bash[24992]: audit 2024-08-31T04:39:28.172338+0000 mgr.a (mgr.14388) 6411 : audit [DBG] from='client.147207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:30 smithi163 bash[24253]: cluster 2024-08-31T04:39:28.893002+0000 mgr.a (mgr.14388) 6412 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:30.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:30 smithi027 bash[22610]: cluster 2024-08-31T04:39:28.893002+0000 mgr.a (mgr.14388) 6412 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:30 smithi191 bash[24992]: cluster 2024-08-31T04:39:28.893002+0000 mgr.a (mgr.14388) 6412 : cluster [DBG] pgmap v4443: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:32 smithi163 bash[24253]: cluster 2024-08-31T04:39:30.893779+0000 mgr.a (mgr.14388) 6413 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:39:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:32 smithi027 bash[22610]: cluster 2024-08-31T04:39:30.893779+0000 mgr.a (mgr.14388) 6413 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:39:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:32 smithi191 bash[24992]: cluster 2024-08-31T04:39:30.893779+0000 mgr.a (mgr.14388) 6413 : cluster [DBG] pgmap v4444: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:39:33.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:39:33.614 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:39:33.614 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:39:34.384 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:34.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:39:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:39:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:39:34.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:39:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:34 smithi163 bash[24253]: cluster 2024-08-31T04:39:32.894522+0000 mgr.a (mgr.14388) 6414 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:39:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:34 smithi027 bash[22610]: cluster 2024-08-31T04:39:32.894522+0000 mgr.a (mgr.14388) 6414 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:39:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:34 smithi191 bash[24992]: cluster 2024-08-31T04:39:32.894522+0000 mgr.a (mgr.14388) 6414 : cluster [DBG] pgmap v4445: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:39:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:35 smithi163 bash[24253]: audit 2024-08-31T04:39:33.951131+0000 mgr.a (mgr.14388) 6415 : audit [DBG] from='client.147285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:35.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:35 smithi027 bash[22610]: audit 2024-08-31T04:39:33.951131+0000 mgr.a (mgr.14388) 6415 : audit [DBG] from='client.147285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:35 smithi191 bash[24992]: audit 2024-08-31T04:39:33.951131+0000 mgr.a (mgr.14388) 6415 : audit [DBG] from='client.147285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:36 smithi163 bash[24253]: cluster 2024-08-31T04:39:34.897273+0000 mgr.a (mgr.14388) 6416 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:36 smithi027 bash[22610]: cluster 2024-08-31T04:39:34.897273+0000 mgr.a (mgr.14388) 6416 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:36 smithi191 bash[24992]: cluster 2024-08-31T04:39:34.897273+0000 mgr.a (mgr.14388) 6416 : cluster [DBG] pgmap v4446: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:38 smithi163 bash[24253]: cluster 2024-08-31T04:39:36.898067+0000 mgr.a (mgr.14388) 6417 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:39:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:38 smithi027 bash[22610]: cluster 2024-08-31T04:39:36.898067+0000 mgr.a (mgr.14388) 6417 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:39:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:38 smithi191 bash[24992]: cluster 2024-08-31T04:39:36.898067+0000 mgr.a (mgr.14388) 6417 : cluster [DBG] pgmap v4447: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:39:39.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:39:39.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:39:39.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:39:40.135 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:40.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:39:40.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:39:40.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:39:40.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:39:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:40 smithi163 bash[24253]: cluster 2024-08-31T04:39:38.900063+0000 mgr.a (mgr.14388) 6418 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:40 smithi163 bash[24253]: audit 2024-08-31T04:39:39.717238+0000 mgr.a (mgr.14388) 6419 : audit [DBG] from='client.147363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:40 smithi027 bash[22610]: cluster 2024-08-31T04:39:38.900063+0000 mgr.a (mgr.14388) 6418 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:40 smithi027 bash[22610]: audit 2024-08-31T04:39:39.717238+0000 mgr.a (mgr.14388) 6419 : audit [DBG] from='client.147363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:40 smithi191 bash[24992]: cluster 2024-08-31T04:39:38.900063+0000 mgr.a (mgr.14388) 6418 : cluster [DBG] pgmap v4448: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:40 smithi191 bash[24992]: audit 2024-08-31T04:39:39.717238+0000 mgr.a (mgr.14388) 6419 : audit [DBG] from='client.147363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:42 smithi163 bash[24253]: cluster 2024-08-31T04:39:40.901029+0000 mgr.a (mgr.14388) 6420 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:42 smithi027 bash[22610]: cluster 2024-08-31T04:39:40.901029+0000 mgr.a (mgr.14388) 6420 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:42 smithi191 bash[24992]: cluster 2024-08-31T04:39:40.901029+0000 mgr.a (mgr.14388) 6420 : cluster [DBG] pgmap v4449: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:44 smithi163 bash[24253]: cluster 2024-08-31T04:39:42.901827+0000 mgr.a (mgr.14388) 6421 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:44.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:44 smithi027 bash[22610]: cluster 2024-08-31T04:39:42.901827+0000 mgr.a (mgr.14388) 6421 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:44 smithi191 bash[24992]: cluster 2024-08-31T04:39:42.901827+0000 mgr.a (mgr.14388) 6421 : cluster [DBG] pgmap v4450: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:45.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:39:45.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:39:45.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:39:45.886 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:39:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:39:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:39:45.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:39:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:46 smithi163 bash[24253]: cluster 2024-08-31T04:39:44.904047+0000 mgr.a (mgr.14388) 6422 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:46 smithi163 bash[24253]: audit 2024-08-31T04:39:45.470883+0000 mgr.a (mgr.14388) 6423 : audit [DBG] from='client.147441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:46 smithi027 bash[22610]: cluster 2024-08-31T04:39:44.904047+0000 mgr.a (mgr.14388) 6422 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:46 smithi027 bash[22610]: audit 2024-08-31T04:39:45.470883+0000 mgr.a (mgr.14388) 6423 : audit [DBG] from='client.147441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:46 smithi191 bash[24992]: cluster 2024-08-31T04:39:44.904047+0000 mgr.a (mgr.14388) 6422 : cluster [DBG] pgmap v4451: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:46 smithi191 bash[24992]: audit 2024-08-31T04:39:45.470883+0000 mgr.a (mgr.14388) 6423 : audit [DBG] from='client.147441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:48 smithi163 bash[24253]: cluster 2024-08-31T04:39:46.905175+0000 mgr.a (mgr.14388) 6424 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:48 smithi027 bash[22610]: cluster 2024-08-31T04:39:46.905175+0000 mgr.a (mgr.14388) 6424 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:48 smithi191 bash[24992]: cluster 2024-08-31T04:39:46.905175+0000 mgr.a (mgr.14388) 6424 : cluster [DBG] pgmap v4452: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:50.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:39:50.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:39:50.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:39:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:50 smithi163 bash[24253]: cluster 2024-08-31T04:39:48.907587+0000 mgr.a (mgr.14388) 6425 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:50.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:50 smithi027 bash[22610]: cluster 2024-08-31T04:39:48.907587+0000 mgr.a (mgr.14388) 6425 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:50 smithi191 bash[24992]: cluster 2024-08-31T04:39:48.907587+0000 mgr.a (mgr.14388) 6425 : cluster [DBG] pgmap v4453: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:51.656 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:51.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:39:51.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:39:51.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:39:51.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:39:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:52 smithi163 bash[24253]: cluster 2024-08-31T04:39:50.908496+0000 mgr.a (mgr.14388) 6426 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:52 smithi163 bash[24253]: audit 2024-08-31T04:39:51.225275+0000 mgr.a (mgr.14388) 6427 : audit [DBG] from='client.147519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:52 smithi027 bash[22610]: cluster 2024-08-31T04:39:50.908496+0000 mgr.a (mgr.14388) 6426 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:52 smithi027 bash[22610]: audit 2024-08-31T04:39:51.225275+0000 mgr.a (mgr.14388) 6427 : audit [DBG] from='client.147519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:52 smithi191 bash[24992]: cluster 2024-08-31T04:39:50.908496+0000 mgr.a (mgr.14388) 6426 : cluster [DBG] pgmap v4454: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:52 smithi191 bash[24992]: audit 2024-08-31T04:39:51.225275+0000 mgr.a (mgr.14388) 6427 : audit [DBG] from='client.147519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:54 smithi163 bash[24253]: cluster 2024-08-31T04:39:52.909604+0000 mgr.a (mgr.14388) 6428 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:54 smithi027 bash[22610]: cluster 2024-08-31T04:39:52.909604+0000 mgr.a (mgr.14388) 6428 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:54 smithi191 bash[24992]: cluster 2024-08-31T04:39:52.909604+0000 mgr.a (mgr.14388) 6428 : cluster [DBG] pgmap v4455: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:56.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:39:56.658 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:39:56.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:39:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:56 smithi163 bash[24253]: cluster 2024-08-31T04:39:54.911899+0000 mgr.a (mgr.14388) 6429 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:56 smithi027 bash[22610]: cluster 2024-08-31T04:39:54.911899+0000 mgr.a (mgr.14388) 6429 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:56 smithi191 bash[24992]: cluster 2024-08-31T04:39:54.911899+0000 mgr.a (mgr.14388) 6429 : cluster [DBG] pgmap v4456: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:39:57.395 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:39:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:39:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:39:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:39:57.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:39:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:58 smithi163 bash[24253]: cluster 2024-08-31T04:39:56.912619+0000 mgr.a (mgr.14388) 6430 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:39:58 smithi163 bash[24253]: audit 2024-08-31T04:39:56.984700+0000 mgr.a (mgr.14388) 6431 : audit [DBG] from='client.147597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:58 smithi027 bash[22610]: cluster 2024-08-31T04:39:56.912619+0000 mgr.a (mgr.14388) 6430 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:39:58 smithi027 bash[22610]: audit 2024-08-31T04:39:56.984700+0000 mgr.a (mgr.14388) 6431 : audit [DBG] from='client.147597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:39:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:58 smithi191 bash[24992]: cluster 2024-08-31T04:39:56.912619+0000 mgr.a (mgr.14388) 6430 : cluster [DBG] pgmap v4457: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:39:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:39:58 smithi191 bash[24992]: audit 2024-08-31T04:39:56.984700+0000 mgr.a (mgr.14388) 6431 : audit [DBG] from='client.147597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:00 smithi163 bash[24253]: cluster 2024-08-31T04:39:58.914939+0000 mgr.a (mgr.14388) 6432 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:00 smithi163 bash[24253]: cluster 2024-08-31T04:40:00.000148+0000 mon.a (mon.0) 1545 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:40:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:00 smithi027 bash[22610]: cluster 2024-08-31T04:39:58.914939+0000 mgr.a (mgr.14388) 6432 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:00 smithi027 bash[22610]: cluster 2024-08-31T04:40:00.000148+0000 mon.a (mon.0) 1545 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:40:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:00 smithi191 bash[24992]: cluster 2024-08-31T04:39:58.914939+0000 mgr.a (mgr.14388) 6432 : cluster [DBG] pgmap v4458: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:00 smithi191 bash[24992]: cluster 2024-08-31T04:40:00.000148+0000 mon.a (mon.0) 1545 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:40:02.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:40:02.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:40:02.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:40:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:02 smithi163 bash[24253]: cluster 2024-08-31T04:40:00.915733+0000 mgr.a (mgr.14388) 6433 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:02.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:02 smithi027 bash[22610]: cluster 2024-08-31T04:40:00.915733+0000 mgr.a (mgr.14388) 6433 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:02 smithi191 bash[24992]: cluster 2024-08-31T04:40:00.915733+0000 mgr.a (mgr.14388) 6433 : cluster [DBG] pgmap v4459: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:03.171 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:40:03.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:40:03.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:40:03.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:40:03.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:40:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:03 smithi163 bash[24253]: audit 2024-08-31T04:40:02.734183+0000 mgr.a (mgr.14388) 6434 : audit [DBG] from='client.147675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:03.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:03 smithi027 bash[22610]: audit 2024-08-31T04:40:02.734183+0000 mgr.a (mgr.14388) 6434 : audit [DBG] from='client.147675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:03 smithi191 bash[24992]: audit 2024-08-31T04:40:02.734183+0000 mgr.a (mgr.14388) 6434 : audit [DBG] from='client.147675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:04 smithi163 bash[24253]: cluster 2024-08-31T04:40:02.916245+0000 mgr.a (mgr.14388) 6435 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:04 smithi027 bash[22610]: cluster 2024-08-31T04:40:02.916245+0000 mgr.a (mgr.14388) 6435 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:04 smithi191 bash[24992]: cluster 2024-08-31T04:40:02.916245+0000 mgr.a (mgr.14388) 6435 : cluster [DBG] pgmap v4460: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:05 smithi163 bash[24253]: audit 2024-08-31T04:40:05.073345+0000 mon.a (mon.0) 1546 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:40:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:05 smithi027 bash[22610]: audit 2024-08-31T04:40:05.073345+0000 mon.a (mon.0) 1546 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:40:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:05 smithi191 bash[24992]: audit 2024-08-31T04:40:05.073345+0000 mon.a (mon.0) 1546 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:40:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:06 smithi163 bash[24253]: cluster 2024-08-31T04:40:04.918601+0000 mgr.a (mgr.14388) 6436 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:40:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:06 smithi163 bash[24253]: audit 2024-08-31T04:40:05.912051+0000 mon.a (mon.0) 1547 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:40:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:06 smithi163 bash[24253]: audit 2024-08-31T04:40:05.913757+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:40:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:06 smithi163 bash[24253]: audit 2024-08-31T04:40:05.922375+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:40:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:06 smithi163 bash[24253]: audit 2024-08-31T04:40:05.927256+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:40:06.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:40:06 smithi027 bash[22863]: debug 2024-08-31T04:40:06.653+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:40:06.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:40:06 smithi027 bash[22863]: debug 2024-08-31T04:40:06.657+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:40:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:06 smithi027 bash[22610]: cluster 2024-08-31T04:40:04.918601+0000 mgr.a (mgr.14388) 6436 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:40:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:06 smithi027 bash[22610]: audit 2024-08-31T04:40:05.912051+0000 mon.a (mon.0) 1547 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:40:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:06 smithi027 bash[22610]: audit 2024-08-31T04:40:05.913757+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:40:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:06 smithi027 bash[22610]: audit 2024-08-31T04:40:05.922375+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:40:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:06 smithi027 bash[22610]: audit 2024-08-31T04:40:05.927256+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:40:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:06 smithi191 bash[24992]: cluster 2024-08-31T04:40:04.918601+0000 mgr.a (mgr.14388) 6436 : cluster [DBG] pgmap v4461: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:40:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:06 smithi191 bash[24992]: audit 2024-08-31T04:40:05.912051+0000 mon.a (mon.0) 1547 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:40:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:06 smithi191 bash[24992]: audit 2024-08-31T04:40:05.913757+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:40:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:06 smithi191 bash[24992]: audit 2024-08-31T04:40:05.922375+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:40:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:06 smithi191 bash[24992]: audit 2024-08-31T04:40:05.927256+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:40:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:07 smithi163 bash[24253]: audit 2024-08-31T04:40:05.929640+0000 mgr.a (mgr.14388) 6437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:40:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:07 smithi163 bash[24253]: audit 2024-08-31T04:40:06.658410+0000 mgr.a (mgr.14388) 6438 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:40:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:07 smithi163 bash[24253]: cephadm 2024-08-31T04:40:06.659895+0000 mgr.a (mgr.14388) 6439 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:40:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:07 smithi027 bash[22610]: audit 2024-08-31T04:40:05.929640+0000 mgr.a (mgr.14388) 6437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:40:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:07 smithi027 bash[22610]: audit 2024-08-31T04:40:06.658410+0000 mgr.a (mgr.14388) 6438 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:40:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:07 smithi027 bash[22610]: cephadm 2024-08-31T04:40:06.659895+0000 mgr.a (mgr.14388) 6439 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:40:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:07 smithi191 bash[24992]: audit 2024-08-31T04:40:05.929640+0000 mgr.a (mgr.14388) 6437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:40:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:07 smithi191 bash[24992]: audit 2024-08-31T04:40:06.658410+0000 mgr.a (mgr.14388) 6438 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:40:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:07 smithi191 bash[24992]: cephadm 2024-08-31T04:40:06.659895+0000 mgr.a (mgr.14388) 6439 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:40:08.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:40:08.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:40:08.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:40:08.914 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:40:08.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:40:08.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:40:08.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:40:08.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:40:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:08 smithi163 bash[24253]: cluster 2024-08-31T04:40:06.919476+0000 mgr.a (mgr.14388) 6440 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:40:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:08 smithi027 bash[22610]: cluster 2024-08-31T04:40:06.919476+0000 mgr.a (mgr.14388) 6440 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:40:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:08 smithi191 bash[24992]: cluster 2024-08-31T04:40:06.919476+0000 mgr.a (mgr.14388) 6440 : cluster [DBG] pgmap v4462: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:40:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:09 smithi163 bash[24253]: audit 2024-08-31T04:40:08.499653+0000 mgr.a (mgr.14388) 6441 : audit [DBG] from='client.147855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:09.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:09 smithi027 bash[22610]: audit 2024-08-31T04:40:08.499653+0000 mgr.a (mgr.14388) 6441 : audit [DBG] from='client.147855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:09 smithi191 bash[24992]: audit 2024-08-31T04:40:08.499653+0000 mgr.a (mgr.14388) 6441 : audit [DBG] from='client.147855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:10 smithi163 bash[24253]: cluster 2024-08-31T04:40:08.920786+0000 mgr.a (mgr.14388) 6442 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:40:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:10 smithi027 bash[22610]: cluster 2024-08-31T04:40:08.920786+0000 mgr.a (mgr.14388) 6442 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:40:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:10 smithi191 bash[24992]: cluster 2024-08-31T04:40:08.920786+0000 mgr.a (mgr.14388) 6442 : cluster [DBG] pgmap v4463: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:40:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:12 smithi027 bash[22610]: cluster 2024-08-31T04:40:10.921660+0000 mgr.a (mgr.14388) 6443 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:40:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:12 smithi191 bash[24992]: cluster 2024-08-31T04:40:10.921660+0000 mgr.a (mgr.14388) 6443 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:40:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:12 smithi163 bash[24253]: cluster 2024-08-31T04:40:10.921660+0000 mgr.a (mgr.14388) 6443 : cluster [DBG] pgmap v4464: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:40:13.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:40:13.916 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:40:13.916 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:40:14.691 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:40:14.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:40:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:40:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:40:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:40:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:14 smithi027 bash[22610]: cluster 2024-08-31T04:40:12.922606+0000 mgr.a (mgr.14388) 6444 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:40:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:14 smithi191 bash[24992]: cluster 2024-08-31T04:40:12.922606+0000 mgr.a (mgr.14388) 6444 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:40:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:14 smithi163 bash[24253]: cluster 2024-08-31T04:40:12.922606+0000 mgr.a (mgr.14388) 6444 : cluster [DBG] pgmap v4465: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:40:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:15 smithi027 bash[22610]: audit 2024-08-31T04:40:14.253824+0000 mgr.a (mgr.14388) 6445 : audit [DBG] from='client.147930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:15 smithi191 bash[24992]: audit 2024-08-31T04:40:14.253824+0000 mgr.a (mgr.14388) 6445 : audit [DBG] from='client.147930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:15 smithi163 bash[24253]: audit 2024-08-31T04:40:14.253824+0000 mgr.a (mgr.14388) 6445 : audit [DBG] from='client.147930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:16 smithi027 bash[22610]: cluster 2024-08-31T04:40:14.925347+0000 mgr.a (mgr.14388) 6446 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:40:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:16 smithi191 bash[24992]: cluster 2024-08-31T04:40:14.925347+0000 mgr.a (mgr.14388) 6446 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:40:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:16 smithi163 bash[24253]: cluster 2024-08-31T04:40:14.925347+0000 mgr.a (mgr.14388) 6446 : cluster [DBG] pgmap v4466: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:40:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:18 smithi027 bash[22610]: cluster 2024-08-31T04:40:16.926294+0000 mgr.a (mgr.14388) 6447 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:40:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:18 smithi191 bash[24992]: cluster 2024-08-31T04:40:16.926294+0000 mgr.a (mgr.14388) 6447 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:40:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:18 smithi163 bash[24253]: cluster 2024-08-31T04:40:16.926294+0000 mgr.a (mgr.14388) 6447 : cluster [DBG] pgmap v4467: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:40:19.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:40:19.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:40:19.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:40:20.443 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:40:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:40:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:40:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:40:20.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:40:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:20 smithi027 bash[22610]: cluster 2024-08-31T04:40:18.928325+0000 mgr.a (mgr.14388) 6448 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:40:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:20 smithi191 bash[24992]: cluster 2024-08-31T04:40:18.928325+0000 mgr.a (mgr.14388) 6448 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:40:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:20 smithi163 bash[24253]: cluster 2024-08-31T04:40:18.928325+0000 mgr.a (mgr.14388) 6448 : cluster [DBG] pgmap v4468: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:40:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:21 smithi191 bash[24992]: audit 2024-08-31T04:40:20.027695+0000 mgr.a (mgr.14388) 6449 : audit [DBG] from='client.148005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:21 smithi163 bash[24253]: audit 2024-08-31T04:40:20.027695+0000 mgr.a (mgr.14388) 6449 : audit [DBG] from='client.148005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:21 smithi027 bash[22610]: audit 2024-08-31T04:40:20.027695+0000 mgr.a (mgr.14388) 6449 : audit [DBG] from='client.148005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:22 smithi191 bash[24992]: cluster 2024-08-31T04:40:20.929278+0000 mgr.a (mgr.14388) 6450 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:22 smithi163 bash[24253]: cluster 2024-08-31T04:40:20.929278+0000 mgr.a (mgr.14388) 6450 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:22 smithi027 bash[22610]: cluster 2024-08-31T04:40:20.929278+0000 mgr.a (mgr.14388) 6450 : cluster [DBG] pgmap v4469: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:24 smithi191 bash[24992]: cluster 2024-08-31T04:40:22.930554+0000 mgr.a (mgr.14388) 6451 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:24 smithi163 bash[24253]: cluster 2024-08-31T04:40:22.930554+0000 mgr.a (mgr.14388) 6451 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:25.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:24 smithi027 bash[22610]: cluster 2024-08-31T04:40:22.930554+0000 mgr.a (mgr.14388) 6451 : cluster [DBG] pgmap v4470: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:25.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:40:25.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:40:25.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:40:26.187 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:40:26.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:40:26.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:40:26.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:40:26.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:40:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:26 smithi191 bash[24992]: cluster 2024-08-31T04:40:24.932783+0000 mgr.a (mgr.14388) 6452 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:26 smithi163 bash[24253]: cluster 2024-08-31T04:40:24.932783+0000 mgr.a (mgr.14388) 6452 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:26 smithi027 bash[22610]: cluster 2024-08-31T04:40:24.932783+0000 mgr.a (mgr.14388) 6452 : cluster [DBG] pgmap v4471: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:27 smithi191 bash[24992]: audit 2024-08-31T04:40:25.777661+0000 mgr.a (mgr.14388) 6453 : audit [DBG] from='client.148083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:27 smithi163 bash[24253]: audit 2024-08-31T04:40:25.777661+0000 mgr.a (mgr.14388) 6453 : audit [DBG] from='client.148083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:28.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:27 smithi027 bash[22610]: audit 2024-08-31T04:40:25.777661+0000 mgr.a (mgr.14388) 6453 : audit [DBG] from='client.148083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:28 smithi191 bash[24992]: cluster 2024-08-31T04:40:26.933738+0000 mgr.a (mgr.14388) 6454 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:28 smithi163 bash[24253]: cluster 2024-08-31T04:40:26.933738+0000 mgr.a (mgr.14388) 6454 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:29.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:28 smithi027 bash[22610]: cluster 2024-08-31T04:40:26.933738+0000 mgr.a (mgr.14388) 6454 : cluster [DBG] pgmap v4472: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:30.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:29 smithi191 bash[24992]: cluster 2024-08-31T04:40:28.935985+0000 mgr.a (mgr.14388) 6455 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:29 smithi163 bash[24253]: cluster 2024-08-31T04:40:28.935985+0000 mgr.a (mgr.14388) 6455 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:29 smithi027 bash[22610]: cluster 2024-08-31T04:40:28.935985+0000 mgr.a (mgr.14388) 6455 : cluster [DBG] pgmap v4473: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:31.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:40:31.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:40:31.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:40:31.959 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:40:31.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:40:31.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:40:31.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:40:31.960 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:40:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:31 smithi191 bash[24992]: cluster 2024-08-31T04:40:30.936734+0000 mgr.a (mgr.14388) 6456 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:31 smithi191 bash[24992]: audit 2024-08-31T04:40:31.527875+0000 mgr.a (mgr.14388) 6457 : audit [DBG] from='client.148158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:31 smithi163 bash[24253]: cluster 2024-08-31T04:40:30.936734+0000 mgr.a (mgr.14388) 6456 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:31 smithi163 bash[24253]: audit 2024-08-31T04:40:31.527875+0000 mgr.a (mgr.14388) 6457 : audit [DBG] from='client.148158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:32.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:31 smithi027 bash[22610]: cluster 2024-08-31T04:40:30.936734+0000 mgr.a (mgr.14388) 6456 : cluster [DBG] pgmap v4474: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:31 smithi027 bash[22610]: audit 2024-08-31T04:40:31.527875+0000 mgr.a (mgr.14388) 6457 : audit [DBG] from='client.148158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:33 smithi191 bash[24992]: cluster 2024-08-31T04:40:32.937659+0000 mgr.a (mgr.14388) 6458 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:33 smithi163 bash[24253]: cluster 2024-08-31T04:40:32.937659+0000 mgr.a (mgr.14388) 6458 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:34.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:33 smithi027 bash[22610]: cluster 2024-08-31T04:40:32.937659+0000 mgr.a (mgr.14388) 6458 : cluster [DBG] pgmap v4475: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:36 smithi191 bash[24992]: cluster 2024-08-31T04:40:34.939945+0000 mgr.a (mgr.14388) 6459 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:36 smithi163 bash[24253]: cluster 2024-08-31T04:40:34.939945+0000 mgr.a (mgr.14388) 6459 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:36 smithi027 bash[22610]: cluster 2024-08-31T04:40:34.939945+0000 mgr.a (mgr.14388) 6459 : cluster [DBG] pgmap v4476: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:36.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:40:36.962 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:40:36.962 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:40:37.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:40:37.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:40:37.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:40:37.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:40:37.734 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:40:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:38 smithi191 bash[24992]: cluster 2024-08-31T04:40:36.940731+0000 mgr.a (mgr.14388) 6460 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:38 smithi191 bash[24992]: audit 2024-08-31T04:40:37.298646+0000 mgr.a (mgr.14388) 6461 : audit [DBG] from='client.148236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:38 smithi163 bash[24253]: cluster 2024-08-31T04:40:36.940731+0000 mgr.a (mgr.14388) 6460 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:38 smithi163 bash[24253]: audit 2024-08-31T04:40:37.298646+0000 mgr.a (mgr.14388) 6461 : audit [DBG] from='client.148236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:38 smithi027 bash[22610]: cluster 2024-08-31T04:40:36.940731+0000 mgr.a (mgr.14388) 6460 : cluster [DBG] pgmap v4477: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:38 smithi027 bash[22610]: audit 2024-08-31T04:40:37.298646+0000 mgr.a (mgr.14388) 6461 : audit [DBG] from='client.148236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:40 smithi191 bash[24992]: cluster 2024-08-31T04:40:38.943083+0000 mgr.a (mgr.14388) 6462 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:40 smithi163 bash[24253]: cluster 2024-08-31T04:40:38.943083+0000 mgr.a (mgr.14388) 6462 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:40 smithi027 bash[22610]: cluster 2024-08-31T04:40:38.943083+0000 mgr.a (mgr.14388) 6462 : cluster [DBG] pgmap v4478: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:40:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:42 smithi191 bash[24992]: cluster 2024-08-31T04:40:40.943862+0000 mgr.a (mgr.14388) 6463 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:42 smithi163 bash[24253]: cluster 2024-08-31T04:40:40.943862+0000 mgr.a (mgr.14388) 6463 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:42 smithi027 bash[22610]: cluster 2024-08-31T04:40:40.943862+0000 mgr.a (mgr.14388) 6463 : cluster [DBG] pgmap v4479: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:42.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:40:42.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:40:42.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:40:43.508 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:40:43.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:40:43.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:40:43.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:40:43.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:40:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:44 smithi191 bash[24992]: cluster 2024-08-31T04:40:42.944589+0000 mgr.a (mgr.14388) 6464 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:44 smithi191 bash[24992]: audit 2024-08-31T04:40:43.073445+0000 mgr.a (mgr.14388) 6465 : audit [DBG] from='client.148311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:44 smithi163 bash[24253]: cluster 2024-08-31T04:40:42.944589+0000 mgr.a (mgr.14388) 6464 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:44 smithi163 bash[24253]: audit 2024-08-31T04:40:43.073445+0000 mgr.a (mgr.14388) 6465 : audit [DBG] from='client.148311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:44.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:44 smithi027 bash[22610]: cluster 2024-08-31T04:40:42.944589+0000 mgr.a (mgr.14388) 6464 : cluster [DBG] pgmap v4480: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:44.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:44 smithi027 bash[22610]: audit 2024-08-31T04:40:43.073445+0000 mgr.a (mgr.14388) 6465 : audit [DBG] from='client.148311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:46 smithi191 bash[24992]: cluster 2024-08-31T04:40:44.947300+0000 mgr.a (mgr.14388) 6466 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:46 smithi163 bash[24253]: cluster 2024-08-31T04:40:44.947300+0000 mgr.a (mgr.14388) 6466 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:46.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:46 smithi027 bash[22610]: cluster 2024-08-31T04:40:44.947300+0000 mgr.a (mgr.14388) 6466 : cluster [DBG] pgmap v4481: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:48 smithi191 bash[24992]: cluster 2024-08-31T04:40:46.948068+0000 mgr.a (mgr.14388) 6467 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:40:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:48 smithi163 bash[24253]: cluster 2024-08-31T04:40:46.948068+0000 mgr.a (mgr.14388) 6467 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:40:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:48 smithi027 bash[22610]: cluster 2024-08-31T04:40:46.948068+0000 mgr.a (mgr.14388) 6467 : cluster [DBG] pgmap v4482: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:40:48.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:40:48.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:40:48.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:40:49.260 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:40:49.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:40:49.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:40:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:40:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:40:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:50 smithi191 bash[24992]: audit 2024-08-31T04:40:48.847280+0000 mgr.a (mgr.14388) 6468 : audit [DBG] from='client.148386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:50 smithi191 bash[24992]: cluster 2024-08-31T04:40:48.949261+0000 mgr.a (mgr.14388) 6469 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:50 smithi163 bash[24253]: audit 2024-08-31T04:40:48.847280+0000 mgr.a (mgr.14388) 6468 : audit [DBG] from='client.148386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:50 smithi163 bash[24253]: cluster 2024-08-31T04:40:48.949261+0000 mgr.a (mgr.14388) 6469 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:50 smithi027 bash[22610]: audit 2024-08-31T04:40:48.847280+0000 mgr.a (mgr.14388) 6468 : audit [DBG] from='client.148386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:50 smithi027 bash[22610]: cluster 2024-08-31T04:40:48.949261+0000 mgr.a (mgr.14388) 6469 : cluster [DBG] pgmap v4483: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:52 smithi163 bash[24253]: cluster 2024-08-31T04:40:50.950121+0000 mgr.a (mgr.14388) 6470 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:40:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:52 smithi027 bash[22610]: cluster 2024-08-31T04:40:50.950121+0000 mgr.a (mgr.14388) 6470 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:40:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:52 smithi191 bash[24992]: cluster 2024-08-31T04:40:50.950121+0000 mgr.a (mgr.14388) 6470 : cluster [DBG] pgmap v4484: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:40:54.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:40:54.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:40:54.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:40:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:54 smithi163 bash[24253]: cluster 2024-08-31T04:40:52.950918+0000 mgr.a (mgr.14388) 6471 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:40:54.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:54 smithi027 bash[22610]: cluster 2024-08-31T04:40:52.950918+0000 mgr.a (mgr.14388) 6471 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:40:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:54 smithi191 bash[24992]: cluster 2024-08-31T04:40:52.950918+0000 mgr.a (mgr.14388) 6471 : cluster [DBG] pgmap v4485: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:40:55.003 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:40:55.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:40:55.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:40:55.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:40:55.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:40:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:55 smithi163 bash[24253]: audit 2024-08-31T04:40:54.592801+0000 mgr.a (mgr.14388) 6472 : audit [DBG] from='client.148464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:55 smithi027 bash[22610]: audit 2024-08-31T04:40:54.592801+0000 mgr.a (mgr.14388) 6472 : audit [DBG] from='client.148464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:55 smithi191 bash[24992]: audit 2024-08-31T04:40:54.592801+0000 mgr.a (mgr.14388) 6472 : audit [DBG] from='client.148464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:40:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:56 smithi163 bash[24253]: cluster 2024-08-31T04:40:54.952711+0000 mgr.a (mgr.14388) 6473 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:56.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:56 smithi027 bash[22610]: cluster 2024-08-31T04:40:54.952711+0000 mgr.a (mgr.14388) 6473 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:56 smithi191 bash[24992]: cluster 2024-08-31T04:40:54.952711+0000 mgr.a (mgr.14388) 6473 : cluster [DBG] pgmap v4486: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:40:58 smithi163 bash[24253]: cluster 2024-08-31T04:40:56.953457+0000 mgr.a (mgr.14388) 6474 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:40:58 smithi027 bash[22610]: cluster 2024-08-31T04:40:56.953457+0000 mgr.a (mgr.14388) 6474 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:40:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:40:58 smithi191 bash[24992]: cluster 2024-08-31T04:40:56.953457+0000 mgr.a (mgr.14388) 6474 : cluster [DBG] pgmap v4487: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:00.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:00.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:00.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:00 smithi163 bash[24253]: cluster 2024-08-31T04:40:58.955435+0000 mgr.a (mgr.14388) 6475 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:00.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:00 smithi027 bash[22610]: cluster 2024-08-31T04:40:58.955435+0000 mgr.a (mgr.14388) 6475 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:00 smithi191 bash[24992]: cluster 2024-08-31T04:40:58.955435+0000 mgr.a (mgr.14388) 6475 : cluster [DBG] pgmap v4488: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:00.795 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:00.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:00.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:00.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:00.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:01 smithi163 bash[24253]: audit 2024-08-31T04:41:00.350551+0000 mgr.a (mgr.14388) 6476 : audit [DBG] from='client.148542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:01 smithi027 bash[22610]: audit 2024-08-31T04:41:00.350551+0000 mgr.a (mgr.14388) 6476 : audit [DBG] from='client.148542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:01 smithi191 bash[24992]: audit 2024-08-31T04:41:00.350551+0000 mgr.a (mgr.14388) 6476 : audit [DBG] from='client.148542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:02 smithi163 bash[24253]: cluster 2024-08-31T04:41:00.956418+0000 mgr.a (mgr.14388) 6477 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:02 smithi027 bash[22610]: cluster 2024-08-31T04:41:00.956418+0000 mgr.a (mgr.14388) 6477 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:02 smithi191 bash[24992]: cluster 2024-08-31T04:41:00.956418+0000 mgr.a (mgr.14388) 6477 : cluster [DBG] pgmap v4489: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:04 smithi163 bash[24253]: cluster 2024-08-31T04:41:02.957210+0000 mgr.a (mgr.14388) 6478 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:04 smithi027 bash[22610]: cluster 2024-08-31T04:41:02.957210+0000 mgr.a (mgr.14388) 6478 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:04 smithi191 bash[24992]: cluster 2024-08-31T04:41:02.957210+0000 mgr.a (mgr.14388) 6478 : cluster [DBG] pgmap v4490: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:05.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:05.798 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:05.798 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:06 smithi163 bash[24253]: cluster 2024-08-31T04:41:04.959436+0000 mgr.a (mgr.14388) 6479 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:06.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:06 smithi027 bash[22610]: cluster 2024-08-31T04:41:04.959436+0000 mgr.a (mgr.14388) 6479 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:06 smithi191 bash[24992]: cluster 2024-08-31T04:41:04.959436+0000 mgr.a (mgr.14388) 6479 : cluster [DBG] pgmap v4491: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:06.572 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:06.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:06.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:06.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:06.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:07 smithi163 bash[24253]: audit 2024-08-31T04:41:06.136989+0000 mgr.a (mgr.14388) 6480 : audit [DBG] from='client.148620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:07 smithi163 bash[24253]: audit 2024-08-31T04:41:06.713430+0000 mon.a (mon.0) 1551 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:41:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:07 smithi027 bash[22610]: audit 2024-08-31T04:41:06.136989+0000 mgr.a (mgr.14388) 6480 : audit [DBG] from='client.148620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:07 smithi027 bash[22610]: audit 2024-08-31T04:41:06.713430+0000 mon.a (mon.0) 1551 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:41:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:07 smithi191 bash[24992]: audit 2024-08-31T04:41:06.136989+0000 mgr.a (mgr.14388) 6480 : audit [DBG] from='client.148620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:07 smithi191 bash[24992]: audit 2024-08-31T04:41:06.713430+0000 mon.a (mon.0) 1551 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:41:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:08 smithi163 bash[24253]: cluster 2024-08-31T04:41:06.960354+0000 mgr.a (mgr.14388) 6481 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:08 smithi027 bash[22610]: cluster 2024-08-31T04:41:06.960354+0000 mgr.a (mgr.14388) 6481 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:08 smithi191 bash[24992]: cluster 2024-08-31T04:41:06.960354+0000 mgr.a (mgr.14388) 6481 : cluster [DBG] pgmap v4492: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:10 smithi163 bash[24253]: cluster 2024-08-31T04:41:08.962584+0000 mgr.a (mgr.14388) 6482 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:10 smithi027 bash[22610]: cluster 2024-08-31T04:41:08.962584+0000 mgr.a (mgr.14388) 6482 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:10 smithi191 bash[24992]: cluster 2024-08-31T04:41:08.962584+0000 mgr.a (mgr.14388) 6482 : cluster [DBG] pgmap v4493: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:11.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:11.575 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:11.575 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:12.341 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:12.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:12.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:12.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:12.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:12 smithi163 bash[24253]: cluster 2024-08-31T04:41:10.963396+0000 mgr.a (mgr.14388) 6483 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:12.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:12 smithi027 bash[22610]: cluster 2024-08-31T04:41:10.963396+0000 mgr.a (mgr.14388) 6483 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:12 smithi191 bash[24992]: cluster 2024-08-31T04:41:10.963396+0000 mgr.a (mgr.14388) 6483 : cluster [DBG] pgmap v4494: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:13 smithi163 bash[24253]: audit 2024-08-31T04:41:11.914502+0000 mgr.a (mgr.14388) 6484 : audit [DBG] from='client.148692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:13.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:13 smithi027 bash[22610]: audit 2024-08-31T04:41:11.914502+0000 mgr.a (mgr.14388) 6484 : audit [DBG] from='client.148692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:13 smithi191 bash[24992]: audit 2024-08-31T04:41:11.914502+0000 mgr.a (mgr.14388) 6484 : audit [DBG] from='client.148692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:14 smithi163 bash[24253]: cluster 2024-08-31T04:41:12.964307+0000 mgr.a (mgr.14388) 6485 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:14.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:14 smithi027 bash[22610]: cluster 2024-08-31T04:41:12.964307+0000 mgr.a (mgr.14388) 6485 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:14 smithi191 bash[24992]: cluster 2024-08-31T04:41:12.964307+0000 mgr.a (mgr.14388) 6485 : cluster [DBG] pgmap v4495: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:16 smithi163 bash[24253]: cluster 2024-08-31T04:41:14.966585+0000 mgr.a (mgr.14388) 6486 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:16 smithi027 bash[22610]: cluster 2024-08-31T04:41:14.966585+0000 mgr.a (mgr.14388) 6486 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:16 smithi191 bash[24992]: cluster 2024-08-31T04:41:14.966585+0000 mgr.a (mgr.14388) 6486 : cluster [DBG] pgmap v4496: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:17.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:17.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:18.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:18.731 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22863]: debug 2024-08-31T04:41:18.271+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:41:18.731 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22863]: debug 2024-08-31T04:41:18.283+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:41:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22610]: cluster 2024-08-31T04:41:16.967405+0000 mgr.a (mgr.14388) 6487 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22610]: audit 2024-08-31T04:41:17.523617+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:41:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22610]: audit 2024-08-31T04:41:17.530031+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:41:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22610]: audit 2024-08-31T04:41:17.532338+0000 mon.a (mon.0) 1554 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:41:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22610]: audit 2024-08-31T04:41:17.533728+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:41:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22610]: audit 2024-08-31T04:41:17.540671+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:41:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22610]: audit 2024-08-31T04:41:17.543675+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:41:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22610]: audit 2024-08-31T04:41:17.544622+0000 mgr.a (mgr.14388) 6488 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:41:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:18 smithi027 bash[22610]: audit 2024-08-31T04:41:17.693544+0000 mgr.a (mgr.14388) 6489 : audit [DBG] from='client.148770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:18 smithi191 bash[24992]: cluster 2024-08-31T04:41:16.967405+0000 mgr.a (mgr.14388) 6487 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:18 smithi191 bash[24992]: audit 2024-08-31T04:41:17.523617+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:41:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:18 smithi191 bash[24992]: audit 2024-08-31T04:41:17.530031+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:41:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:18 smithi191 bash[24992]: audit 2024-08-31T04:41:17.532338+0000 mon.a (mon.0) 1554 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:41:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:18 smithi191 bash[24992]: audit 2024-08-31T04:41:17.533728+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:41:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:18 smithi191 bash[24992]: audit 2024-08-31T04:41:17.540671+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:41:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:18 smithi191 bash[24992]: audit 2024-08-31T04:41:17.543675+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:41:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:18 smithi191 bash[24992]: audit 2024-08-31T04:41:17.544622+0000 mgr.a (mgr.14388) 6488 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:41:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:18 smithi191 bash[24992]: audit 2024-08-31T04:41:17.693544+0000 mgr.a (mgr.14388) 6489 : audit [DBG] from='client.148770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:18 smithi163 bash[24253]: cluster 2024-08-31T04:41:16.967405+0000 mgr.a (mgr.14388) 6487 : cluster [DBG] pgmap v4497: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:18 smithi163 bash[24253]: audit 2024-08-31T04:41:17.523617+0000 mon.a (mon.0) 1552 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:41:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:18 smithi163 bash[24253]: audit 2024-08-31T04:41:17.530031+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:41:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:18 smithi163 bash[24253]: audit 2024-08-31T04:41:17.532338+0000 mon.a (mon.0) 1554 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:41:18.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:18 smithi163 bash[24253]: audit 2024-08-31T04:41:17.533728+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:41:18.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:18 smithi163 bash[24253]: audit 2024-08-31T04:41:17.540671+0000 mon.a (mon.0) 1556 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:41:18.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:18 smithi163 bash[24253]: audit 2024-08-31T04:41:17.543675+0000 mon.a (mon.0) 1557 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:41:18.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:18 smithi163 bash[24253]: audit 2024-08-31T04:41:17.544622+0000 mgr.a (mgr.14388) 6488 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:41:18.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:18 smithi163 bash[24253]: audit 2024-08-31T04:41:17.693544+0000 mgr.a (mgr.14388) 6489 : audit [DBG] from='client.148770 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:19 smithi191 bash[24992]: audit 2024-08-31T04:41:18.277177+0000 mgr.a (mgr.14388) 6490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:41:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:19 smithi191 bash[24992]: cephadm 2024-08-31T04:41:18.289383+0000 mgr.a (mgr.14388) 6491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:41:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:19 smithi163 bash[24253]: audit 2024-08-31T04:41:18.277177+0000 mgr.a (mgr.14388) 6490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:41:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:19 smithi163 bash[24253]: cephadm 2024-08-31T04:41:18.289383+0000 mgr.a (mgr.14388) 6491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:41:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:19 smithi027 bash[22610]: audit 2024-08-31T04:41:18.277177+0000 mgr.a (mgr.14388) 6490 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:41:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:19 smithi027 bash[22610]: cephadm 2024-08-31T04:41:18.289383+0000 mgr.a (mgr.14388) 6491 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:41:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:20 smithi191 bash[24992]: cluster 2024-08-31T04:41:18.970273+0000 mgr.a (mgr.14388) 6492 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:41:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:20 smithi163 bash[24253]: cluster 2024-08-31T04:41:18.970273+0000 mgr.a (mgr.14388) 6492 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:41:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:20 smithi027 bash[22610]: cluster 2024-08-31T04:41:18.970273+0000 mgr.a (mgr.14388) 6492 : cluster [DBG] pgmap v4498: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:41:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:22 smithi191 bash[24992]: cluster 2024-08-31T04:41:20.971123+0000 mgr.a (mgr.14388) 6493 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T04:41:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:22 smithi163 bash[24253]: cluster 2024-08-31T04:41:20.971123+0000 mgr.a (mgr.14388) 6493 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T04:41:22.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:22 smithi027 bash[22610]: cluster 2024-08-31T04:41:20.971123+0000 mgr.a (mgr.14388) 6493 : cluster [DBG] pgmap v4499: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T04:41:23.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:23.685 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:24.431 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:24.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:24.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:24.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:24.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:24 smithi163 bash[24253]: cluster 2024-08-31T04:41:22.972236+0000 mgr.a (mgr.14388) 6494 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:41:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:24 smithi027 bash[22610]: cluster 2024-08-31T04:41:22.972236+0000 mgr.a (mgr.14388) 6494 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:41:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:24 smithi191 bash[24992]: cluster 2024-08-31T04:41:22.972236+0000 mgr.a (mgr.14388) 6494 : cluster [DBG] pgmap v4500: 225 pgs: 225 active+clean; 589 KiB data, 104 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:41:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:25 smithi163 bash[24253]: audit 2024-08-31T04:41:24.016907+0000 mgr.a (mgr.14388) 6495 : audit [DBG] from='client.148947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:25 smithi027 bash[22610]: audit 2024-08-31T04:41:24.016907+0000 mgr.a (mgr.14388) 6495 : audit [DBG] from='client.148947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:25 smithi191 bash[24992]: audit 2024-08-31T04:41:24.016907+0000 mgr.a (mgr.14388) 6495 : audit [DBG] from='client.148947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:26 smithi163 bash[24253]: cluster 2024-08-31T04:41:24.974697+0000 mgr.a (mgr.14388) 6496 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:41:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:26 smithi027 bash[22610]: cluster 2024-08-31T04:41:24.974697+0000 mgr.a (mgr.14388) 6496 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:41:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:26 smithi191 bash[24992]: cluster 2024-08-31T04:41:24.974697+0000 mgr.a (mgr.14388) 6496 : cluster [DBG] pgmap v4501: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:41:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:28 smithi163 bash[24253]: cluster 2024-08-31T04:41:26.975722+0000 mgr.a (mgr.14388) 6497 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:41:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:28 smithi027 bash[22610]: cluster 2024-08-31T04:41:26.975722+0000 mgr.a (mgr.14388) 6497 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:41:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:28 smithi191 bash[24992]: cluster 2024-08-31T04:41:26.975722+0000 mgr.a (mgr.14388) 6497 : cluster [DBG] pgmap v4502: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:41:29.432 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:29.433 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:29.433 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:30.200 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:30.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:30 smithi163 bash[24253]: cluster 2024-08-31T04:41:28.977907+0000 mgr.a (mgr.14388) 6498 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:41:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:30 smithi163 bash[24253]: audit 2024-08-31T04:41:29.769286+0000 mgr.a (mgr.14388) 6499 : audit [DBG] from='client.149025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:30 smithi027 bash[22610]: cluster 2024-08-31T04:41:28.977907+0000 mgr.a (mgr.14388) 6498 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:41:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:30 smithi027 bash[22610]: audit 2024-08-31T04:41:29.769286+0000 mgr.a (mgr.14388) 6499 : audit [DBG] from='client.149025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:30 smithi191 bash[24992]: cluster 2024-08-31T04:41:28.977907+0000 mgr.a (mgr.14388) 6498 : cluster [DBG] pgmap v4503: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:41:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:30 smithi191 bash[24992]: audit 2024-08-31T04:41:29.769286+0000 mgr.a (mgr.14388) 6499 : audit [DBG] from='client.149025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:32 smithi163 bash[24253]: cluster 2024-08-31T04:41:30.978841+0000 mgr.a (mgr.14388) 6500 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:41:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:32 smithi027 bash[22610]: cluster 2024-08-31T04:41:30.978841+0000 mgr.a (mgr.14388) 6500 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:41:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:32 smithi191 bash[24992]: cluster 2024-08-31T04:41:30.978841+0000 mgr.a (mgr.14388) 6500 : cluster [DBG] pgmap v4504: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:41:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:34 smithi163 bash[24253]: cluster 2024-08-31T04:41:32.980623+0000 mgr.a (mgr.14388) 6501 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:41:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:34 smithi027 bash[22610]: cluster 2024-08-31T04:41:32.980623+0000 mgr.a (mgr.14388) 6501 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:41:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:34 smithi191 bash[24992]: cluster 2024-08-31T04:41:32.980623+0000 mgr.a (mgr.14388) 6501 : cluster [DBG] pgmap v4505: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:41:35.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:35.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:35.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:35.951 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:35.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:35.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:35.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:35.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:36 smithi163 bash[24253]: cluster 2024-08-31T04:41:34.981903+0000 mgr.a (mgr.14388) 6502 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:41:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:36 smithi163 bash[24253]: audit 2024-08-31T04:41:35.531398+0000 mgr.a (mgr.14388) 6503 : audit [DBG] from='client.149103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:36 smithi027 bash[22610]: cluster 2024-08-31T04:41:34.981903+0000 mgr.a (mgr.14388) 6502 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:41:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:36 smithi027 bash[22610]: audit 2024-08-31T04:41:35.531398+0000 mgr.a (mgr.14388) 6503 : audit [DBG] from='client.149103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:36 smithi191 bash[24992]: cluster 2024-08-31T04:41:34.981903+0000 mgr.a (mgr.14388) 6502 : cluster [DBG] pgmap v4506: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:41:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:36 smithi191 bash[24992]: audit 2024-08-31T04:41:35.531398+0000 mgr.a (mgr.14388) 6503 : audit [DBG] from='client.149103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:38 smithi163 bash[24253]: cluster 2024-08-31T04:41:36.983005+0000 mgr.a (mgr.14388) 6504 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:38 smithi027 bash[22610]: cluster 2024-08-31T04:41:36.983005+0000 mgr.a (mgr.14388) 6504 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:38 smithi191 bash[24992]: cluster 2024-08-31T04:41:36.983005+0000 mgr.a (mgr.14388) 6504 : cluster [DBG] pgmap v4507: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:40 smithi163 bash[24253]: cluster 2024-08-31T04:41:38.985343+0000 mgr.a (mgr.14388) 6505 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:40.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:40.953 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:40.954 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:40.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:40 smithi027 bash[22610]: cluster 2024-08-31T04:41:38.985343+0000 mgr.a (mgr.14388) 6505 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:40 smithi191 bash[24992]: cluster 2024-08-31T04:41:38.985343+0000 mgr.a (mgr.14388) 6505 : cluster [DBG] pgmap v4508: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:41.726 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:41.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:41.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:41.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:41.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:42 smithi163 bash[24253]: cluster 2024-08-31T04:41:40.985931+0000 mgr.a (mgr.14388) 6506 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:42 smithi163 bash[24253]: audit 2024-08-31T04:41:41.290824+0000 mgr.a (mgr.14388) 6507 : audit [DBG] from='client.149181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:42 smithi027 bash[22610]: cluster 2024-08-31T04:41:40.985931+0000 mgr.a (mgr.14388) 6506 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:42 smithi027 bash[22610]: audit 2024-08-31T04:41:41.290824+0000 mgr.a (mgr.14388) 6507 : audit [DBG] from='client.149181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:42 smithi191 bash[24992]: cluster 2024-08-31T04:41:40.985931+0000 mgr.a (mgr.14388) 6506 : cluster [DBG] pgmap v4509: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:42 smithi191 bash[24992]: audit 2024-08-31T04:41:41.290824+0000 mgr.a (mgr.14388) 6507 : audit [DBG] from='client.149181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:44 smithi163 bash[24253]: cluster 2024-08-31T04:41:42.987843+0000 mgr.a (mgr.14388) 6508 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:41:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:44 smithi027 bash[22610]: cluster 2024-08-31T04:41:42.987843+0000 mgr.a (mgr.14388) 6508 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:41:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:44 smithi191 bash[24992]: cluster 2024-08-31T04:41:42.987843+0000 mgr.a (mgr.14388) 6508 : cluster [DBG] pgmap v4510: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:41:46.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:46.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:46.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:46 smithi163 bash[24253]: cluster 2024-08-31T04:41:44.989059+0000 mgr.a (mgr.14388) 6509 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:41:46.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:46 smithi027 bash[22610]: cluster 2024-08-31T04:41:44.989059+0000 mgr.a (mgr.14388) 6509 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:41:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:46 smithi191 bash[24992]: cluster 2024-08-31T04:41:44.989059+0000 mgr.a (mgr.14388) 6509 : cluster [DBG] pgmap v4511: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T04:41:47.467 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:47.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:47.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:47.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:47.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:48 smithi163 bash[24253]: cluster 2024-08-31T04:41:46.989811+0000 mgr.a (mgr.14388) 6510 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:48 smithi163 bash[24253]: audit 2024-08-31T04:41:47.055477+0000 mgr.a (mgr.14388) 6511 : audit [DBG] from='client.149256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:48.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:48 smithi027 bash[22610]: cluster 2024-08-31T04:41:46.989811+0000 mgr.a (mgr.14388) 6510 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:48.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:48 smithi027 bash[22610]: audit 2024-08-31T04:41:47.055477+0000 mgr.a (mgr.14388) 6511 : audit [DBG] from='client.149256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:48 smithi191 bash[24992]: cluster 2024-08-31T04:41:46.989811+0000 mgr.a (mgr.14388) 6510 : cluster [DBG] pgmap v4512: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:48 smithi191 bash[24992]: audit 2024-08-31T04:41:47.055477+0000 mgr.a (mgr.14388) 6511 : audit [DBG] from='client.149256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:50 smithi163 bash[24253]: cluster 2024-08-31T04:41:48.992152+0000 mgr.a (mgr.14388) 6512 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:50.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:50 smithi027 bash[22610]: cluster 2024-08-31T04:41:48.992152+0000 mgr.a (mgr.14388) 6512 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:50 smithi191 bash[24992]: cluster 2024-08-31T04:41:48.992152+0000 mgr.a (mgr.14388) 6512 : cluster [DBG] pgmap v4513: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:41:52.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:52.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:52.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:52 smithi163 bash[24253]: cluster 2024-08-31T04:41:50.992909+0000 mgr.a (mgr.14388) 6513 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:52.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:52 smithi027 bash[22610]: cluster 2024-08-31T04:41:50.992909+0000 mgr.a (mgr.14388) 6513 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:52 smithi191 bash[24992]: cluster 2024-08-31T04:41:50.992909+0000 mgr.a (mgr.14388) 6513 : cluster [DBG] pgmap v4514: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:53.240 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:53.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:53.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:53.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:53.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:54 smithi163 bash[24253]: audit 2024-08-31T04:41:52.804066+0000 mgr.a (mgr.14388) 6514 : audit [DBG] from='client.149334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:54 smithi163 bash[24253]: cluster 2024-08-31T04:41:52.993891+0000 mgr.a (mgr.14388) 6515 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:54 smithi027 bash[22610]: audit 2024-08-31T04:41:52.804066+0000 mgr.a (mgr.14388) 6514 : audit [DBG] from='client.149334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:54 smithi027 bash[22610]: cluster 2024-08-31T04:41:52.993891+0000 mgr.a (mgr.14388) 6515 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:54 smithi191 bash[24992]: audit 2024-08-31T04:41:52.804066+0000 mgr.a (mgr.14388) 6514 : audit [DBG] from='client.149334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:54 smithi191 bash[24992]: cluster 2024-08-31T04:41:52.993891+0000 mgr.a (mgr.14388) 6515 : cluster [DBG] pgmap v4515: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:41:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:56 smithi163 bash[24253]: cluster 2024-08-31T04:41:54.995430+0000 mgr.a (mgr.14388) 6516 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:41:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:56 smithi027 bash[22610]: cluster 2024-08-31T04:41:54.995430+0000 mgr.a (mgr.14388) 6516 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:41:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:56 smithi191 bash[24992]: cluster 2024-08-31T04:41:54.995430+0000 mgr.a (mgr.14388) 6516 : cluster [DBG] pgmap v4516: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:41:58.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:41:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:41:58.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:41:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:58 smithi163 bash[24253]: cluster 2024-08-31T04:41:56.996196+0000 mgr.a (mgr.14388) 6517 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:41:58.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:58 smithi027 bash[22610]: cluster 2024-08-31T04:41:56.996196+0000 mgr.a (mgr.14388) 6517 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:41:59.006 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:41:59.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:41:59.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:41:59.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:41:59.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:41:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:58 smithi191 bash[24992]: cluster 2024-08-31T04:41:56.996196+0000 mgr.a (mgr.14388) 6517 : cluster [DBG] pgmap v4517: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:41:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:41:59 smithi163 bash[24253]: audit 2024-08-31T04:41:58.580834+0000 mgr.a (mgr.14388) 6518 : audit [DBG] from='client.149412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:41:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:41:59 smithi027 bash[22610]: audit 2024-08-31T04:41:58.580834+0000 mgr.a (mgr.14388) 6518 : audit [DBG] from='client.149412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:41:59 smithi191 bash[24992]: audit 2024-08-31T04:41:58.580834+0000 mgr.a (mgr.14388) 6518 : audit [DBG] from='client.149412 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:00 smithi163 bash[24253]: cluster 2024-08-31T04:41:58.997444+0000 mgr.a (mgr.14388) 6519 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:00 smithi027 bash[22610]: cluster 2024-08-31T04:41:58.997444+0000 mgr.a (mgr.14388) 6519 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:00 smithi191 bash[24992]: cluster 2024-08-31T04:41:58.997444+0000 mgr.a (mgr.14388) 6519 : cluster [DBG] pgmap v4518: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:02 smithi163 bash[24253]: cluster 2024-08-31T04:42:00.998307+0000 mgr.a (mgr.14388) 6520 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:42:02.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:02 smithi027 bash[22610]: cluster 2024-08-31T04:42:00.998307+0000 mgr.a (mgr.14388) 6520 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:42:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:02 smithi191 bash[24992]: cluster 2024-08-31T04:42:00.998307+0000 mgr.a (mgr.14388) 6520 : cluster [DBG] pgmap v4519: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:42:04.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:42:04.009 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:42:04.009 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:42:04.779 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:42:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:42:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:42:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:42:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:42:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:04 smithi163 bash[24253]: cluster 2024-08-31T04:42:03.000419+0000 mgr.a (mgr.14388) 6521 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:04.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:04 smithi027 bash[22610]: cluster 2024-08-31T04:42:03.000419+0000 mgr.a (mgr.14388) 6521 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:04 smithi191 bash[24992]: cluster 2024-08-31T04:42:03.000419+0000 mgr.a (mgr.14388) 6521 : cluster [DBG] pgmap v4520: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:05 smithi163 bash[24253]: audit 2024-08-31T04:42:04.344059+0000 mgr.a (mgr.14388) 6522 : audit [DBG] from='client.149490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:05 smithi027 bash[22610]: audit 2024-08-31T04:42:04.344059+0000 mgr.a (mgr.14388) 6522 : audit [DBG] from='client.149490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:05 smithi191 bash[24992]: audit 2024-08-31T04:42:04.344059+0000 mgr.a (mgr.14388) 6522 : audit [DBG] from='client.149490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:06 smithi163 bash[24253]: cluster 2024-08-31T04:42:05.001337+0000 mgr.a (mgr.14388) 6523 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:06 smithi027 bash[22610]: cluster 2024-08-31T04:42:05.001337+0000 mgr.a (mgr.14388) 6523 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:06 smithi191 bash[24992]: cluster 2024-08-31T04:42:05.001337+0000 mgr.a (mgr.14388) 6523 : cluster [DBG] pgmap v4521: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:08 smithi163 bash[24253]: cluster 2024-08-31T04:42:07.002117+0000 mgr.a (mgr.14388) 6524 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:42:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:08 smithi027 bash[22610]: cluster 2024-08-31T04:42:07.002117+0000 mgr.a (mgr.14388) 6524 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:42:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:08 smithi191 bash[24992]: cluster 2024-08-31T04:42:07.002117+0000 mgr.a (mgr.14388) 6524 : cluster [DBG] pgmap v4522: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:42:09.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:42:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:42:09.782 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:42:10.547 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:42:10.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:42:10.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:42:10.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:42:10.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:42:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:10 smithi163 bash[24253]: cluster 2024-08-31T04:42:09.004355+0000 mgr.a (mgr.14388) 6525 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:42:10.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:10 smithi027 bash[22610]: cluster 2024-08-31T04:42:09.004355+0000 mgr.a (mgr.14388) 6525 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:42:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:10 smithi191 bash[24992]: cluster 2024-08-31T04:42:09.004355+0000 mgr.a (mgr.14388) 6525 : cluster [DBG] pgmap v4523: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:42:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:11 smithi163 bash[24253]: audit 2024-08-31T04:42:10.118554+0000 mgr.a (mgr.14388) 6526 : audit [DBG] from='client.149568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:11 smithi027 bash[22610]: audit 2024-08-31T04:42:10.118554+0000 mgr.a (mgr.14388) 6526 : audit [DBG] from='client.149568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:11 smithi191 bash[24992]: audit 2024-08-31T04:42:10.118554+0000 mgr.a (mgr.14388) 6526 : audit [DBG] from='client.149568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:12 smithi163 bash[24253]: cluster 2024-08-31T04:42:11.005376+0000 mgr.a (mgr.14388) 6527 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:12 smithi027 bash[22610]: cluster 2024-08-31T04:42:11.005376+0000 mgr.a (mgr.14388) 6527 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:12 smithi191 bash[24992]: cluster 2024-08-31T04:42:11.005376+0000 mgr.a (mgr.14388) 6527 : cluster [DBG] pgmap v4524: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:14 smithi163 bash[24253]: cluster 2024-08-31T04:42:13.008073+0000 mgr.a (mgr.14388) 6528 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:14 smithi027 bash[22610]: cluster 2024-08-31T04:42:13.008073+0000 mgr.a (mgr.14388) 6528 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:14 smithi191 bash[24992]: cluster 2024-08-31T04:42:13.008073+0000 mgr.a (mgr.14388) 6528 : cluster [DBG] pgmap v4525: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:15.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:42:15.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:42:15.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:42:16.329 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:42:16.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:42:16.330 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:42:16.330 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:42:16.330 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:42:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:16 smithi163 bash[24253]: cluster 2024-08-31T04:42:15.008858+0000 mgr.a (mgr.14388) 6529 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:16.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:16 smithi027 bash[22610]: cluster 2024-08-31T04:42:15.008858+0000 mgr.a (mgr.14388) 6529 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:16 smithi191 bash[24992]: cluster 2024-08-31T04:42:15.008858+0000 mgr.a (mgr.14388) 6529 : cluster [DBG] pgmap v4526: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:17 smithi163 bash[24253]: audit 2024-08-31T04:42:15.887621+0000 mgr.a (mgr.14388) 6530 : audit [DBG] from='client.149646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:17.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:17 smithi027 bash[22610]: audit 2024-08-31T04:42:15.887621+0000 mgr.a (mgr.14388) 6530 : audit [DBG] from='client.149646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:17 smithi191 bash[24992]: audit 2024-08-31T04:42:15.887621+0000 mgr.a (mgr.14388) 6530 : audit [DBG] from='client.149646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:18 smithi163 bash[24253]: cluster 2024-08-31T04:42:17.009781+0000 mgr.a (mgr.14388) 6531 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:18 smithi163 bash[24253]: audit 2024-08-31T04:42:18.343330+0000 mon.a (mon.0) 1558 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:42:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:18 smithi027 bash[22610]: cluster 2024-08-31T04:42:17.009781+0000 mgr.a (mgr.14388) 6531 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:18 smithi027 bash[22610]: audit 2024-08-31T04:42:18.343330+0000 mon.a (mon.0) 1558 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:42:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:18 smithi191 bash[24992]: cluster 2024-08-31T04:42:17.009781+0000 mgr.a (mgr.14388) 6531 : cluster [DBG] pgmap v4527: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:18 smithi191 bash[24992]: audit 2024-08-31T04:42:18.343330+0000 mon.a (mon.0) 1558 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:42:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:20 smithi163 bash[24253]: cluster 2024-08-31T04:42:19.010892+0000 mgr.a (mgr.14388) 6532 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:20 smithi027 bash[22610]: cluster 2024-08-31T04:42:19.010892+0000 mgr.a (mgr.14388) 6532 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:20 smithi191 bash[24992]: cluster 2024-08-31T04:42:19.010892+0000 mgr.a (mgr.14388) 6532 : cluster [DBG] pgmap v4528: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:21.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:42:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:42:21.332 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:42:22.109 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:42:22.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:42:22.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:42:22.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:42:22.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:42:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:22 smithi027 bash[22610]: cluster 2024-08-31T04:42:21.011607+0000 mgr.a (mgr.14388) 6533 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:22 smithi027 bash[22610]: audit 2024-08-31T04:42:21.662874+0000 mgr.a (mgr.14388) 6534 : audit [DBG] from='client.149724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:22 smithi191 bash[24992]: cluster 2024-08-31T04:42:21.011607+0000 mgr.a (mgr.14388) 6533 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:22 smithi191 bash[24992]: audit 2024-08-31T04:42:21.662874+0000 mgr.a (mgr.14388) 6534 : audit [DBG] from='client.149724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:22 smithi163 bash[24253]: cluster 2024-08-31T04:42:21.011607+0000 mgr.a (mgr.14388) 6533 : cluster [DBG] pgmap v4529: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:22 smithi163 bash[24253]: audit 2024-08-31T04:42:21.662874+0000 mgr.a (mgr.14388) 6534 : audit [DBG] from='client.149724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:24 smithi163 bash[24253]: cluster 2024-08-31T04:42:23.013870+0000 mgr.a (mgr.14388) 6535 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:42:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:24 smithi027 bash[22610]: cluster 2024-08-31T04:42:23.013870+0000 mgr.a (mgr.14388) 6535 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:42:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:24 smithi191 bash[24992]: cluster 2024-08-31T04:42:23.013870+0000 mgr.a (mgr.14388) 6535 : cluster [DBG] pgmap v4530: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:42:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:26 smithi163 bash[24253]: cluster 2024-08-31T04:42:25.014644+0000 mgr.a (mgr.14388) 6536 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:42:26.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:26 smithi027 bash[22610]: cluster 2024-08-31T04:42:25.014644+0000 mgr.a (mgr.14388) 6536 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:42:27.030 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:26 smithi191 bash[24992]: cluster 2024-08-31T04:42:25.014644+0000 mgr.a (mgr.14388) 6536 : cluster [DBG] pgmap v4531: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:42:27.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:42:27.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:42:27.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:42:27.845 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:42:27.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:42:27.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:42:27.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:42:27.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:42:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:28 smithi027 bash[22610]: cluster 2024-08-31T04:42:27.015447+0000 mgr.a (mgr.14388) 6537 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:42:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:28 smithi027 bash[22610]: audit 2024-08-31T04:42:27.443435+0000 mgr.a (mgr.14388) 6538 : audit [DBG] from='client.149799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:28 smithi191 bash[24992]: cluster 2024-08-31T04:42:27.015447+0000 mgr.a (mgr.14388) 6537 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:42:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:28 smithi191 bash[24992]: audit 2024-08-31T04:42:27.443435+0000 mgr.a (mgr.14388) 6538 : audit [DBG] from='client.149799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:29.103 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:28 smithi163 bash[24253]: cluster 2024-08-31T04:42:27.015447+0000 mgr.a (mgr.14388) 6537 : cluster [DBG] pgmap v4532: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:42:29.103 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:28 smithi163 bash[24253]: audit 2024-08-31T04:42:27.443435+0000 mgr.a (mgr.14388) 6538 : audit [DBG] from='client.149799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:29 smithi191 bash[24992]: audit 2024-08-31T04:42:28.773200+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:29 smithi191 bash[24992]: audit 2024-08-31T04:42:28.781771+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:29 smithi191 bash[24992]: audit 2024-08-31T04:42:29.625567+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:29 smithi191 bash[24992]: audit 2024-08-31T04:42:29.634754+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:29 smithi191 bash[24992]: audit 2024-08-31T04:42:29.636974+0000 mon.a (mon.0) 1563 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:42:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:29 smithi191 bash[24992]: audit 2024-08-31T04:42:29.639036+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:42:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:29 smithi191 bash[24992]: audit 2024-08-31T04:42:29.651585+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:29 smithi191 bash[24992]: audit 2024-08-31T04:42:29.656927+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:42:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:29 smithi163 bash[24253]: audit 2024-08-31T04:42:28.773200+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:29 smithi163 bash[24253]: audit 2024-08-31T04:42:28.781771+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:29 smithi163 bash[24253]: audit 2024-08-31T04:42:29.625567+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:29 smithi163 bash[24253]: audit 2024-08-31T04:42:29.634754+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:29 smithi163 bash[24253]: audit 2024-08-31T04:42:29.636974+0000 mon.a (mon.0) 1563 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:42:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:29 smithi163 bash[24253]: audit 2024-08-31T04:42:29.639036+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:42:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:29 smithi163 bash[24253]: audit 2024-08-31T04:42:29.651585+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:29 smithi163 bash[24253]: audit 2024-08-31T04:42:29.656927+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:42:30.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:29 smithi027 bash[22610]: audit 2024-08-31T04:42:28.773200+0000 mon.a (mon.0) 1559 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:29 smithi027 bash[22610]: audit 2024-08-31T04:42:28.781771+0000 mon.a (mon.0) 1560 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:29 smithi027 bash[22610]: audit 2024-08-31T04:42:29.625567+0000 mon.a (mon.0) 1561 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:29 smithi027 bash[22610]: audit 2024-08-31T04:42:29.634754+0000 mon.a (mon.0) 1562 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:29 smithi027 bash[22610]: audit 2024-08-31T04:42:29.636974+0000 mon.a (mon.0) 1563 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:42:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:29 smithi027 bash[22610]: audit 2024-08-31T04:42:29.639036+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:42:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:29 smithi027 bash[22610]: audit 2024-08-31T04:42:29.651585+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:42:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:29 smithi027 bash[22610]: audit 2024-08-31T04:42:29.656927+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:42:30.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:42:30 smithi027 bash[22863]: debug 2024-08-31T04:42:30.461+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:42:30.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:42:30 smithi027 bash[22863]: debug 2024-08-31T04:42:30.465+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:42:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:30 smithi191 bash[24992]: cluster 2024-08-31T04:42:29.017699+0000 mgr.a (mgr.14388) 6539 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:42:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:30 smithi191 bash[24992]: audit 2024-08-31T04:42:29.659329+0000 mgr.a (mgr.14388) 6540 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:42:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:30 smithi163 bash[24253]: cluster 2024-08-31T04:42:29.017699+0000 mgr.a (mgr.14388) 6539 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:42:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:30 smithi163 bash[24253]: audit 2024-08-31T04:42:29.659329+0000 mgr.a (mgr.14388) 6540 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:42:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:30 smithi027 bash[22610]: cluster 2024-08-31T04:42:29.017699+0000 mgr.a (mgr.14388) 6539 : cluster [DBG] pgmap v4533: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:42:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:30 smithi027 bash[22610]: audit 2024-08-31T04:42:29.659329+0000 mgr.a (mgr.14388) 6540 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:42:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:31 smithi163 bash[24253]: audit 2024-08-31T04:42:30.465752+0000 mgr.a (mgr.14388) 6541 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:42:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:31 smithi163 bash[24253]: cephadm 2024-08-31T04:42:30.467255+0000 mgr.a (mgr.14388) 6542 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:42:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:31 smithi027 bash[22610]: audit 2024-08-31T04:42:30.465752+0000 mgr.a (mgr.14388) 6541 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:42:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:31 smithi027 bash[22610]: cephadm 2024-08-31T04:42:30.467255+0000 mgr.a (mgr.14388) 6542 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:42:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:31 smithi191 bash[24992]: audit 2024-08-31T04:42:30.465752+0000 mgr.a (mgr.14388) 6541 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:42:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:31 smithi191 bash[24992]: cephadm 2024-08-31T04:42:30.467255+0000 mgr.a (mgr.14388) 6542 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:42:32.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:42:32.847 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:42:32.847 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:42:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:32 smithi163 bash[24253]: cluster 2024-08-31T04:42:31.018635+0000 mgr.a (mgr.14388) 6543 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T04:42:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:32 smithi027 bash[22610]: cluster 2024-08-31T04:42:31.018635+0000 mgr.a (mgr.14388) 6543 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T04:42:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:32 smithi191 bash[24992]: cluster 2024-08-31T04:42:31.018635+0000 mgr.a (mgr.14388) 6543 : cluster [DBG] pgmap v4534: 225 pgs: 225 active+clean; 589 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T04:42:33.590 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:42:33.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:42:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:42:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:42:33.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:42:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:34 smithi163 bash[24253]: cluster 2024-08-31T04:42:33.020803+0000 mgr.a (mgr.14388) 6544 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 68 op/s 2024-08-31T04:42:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:34 smithi163 bash[24253]: audit 2024-08-31T04:42:33.182804+0000 mgr.a (mgr.14388) 6545 : audit [DBG] from='client.149982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:34 smithi027 bash[22610]: cluster 2024-08-31T04:42:33.020803+0000 mgr.a (mgr.14388) 6544 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 68 op/s 2024-08-31T04:42:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:34 smithi027 bash[22610]: audit 2024-08-31T04:42:33.182804+0000 mgr.a (mgr.14388) 6545 : audit [DBG] from='client.149982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:34 smithi191 bash[24992]: cluster 2024-08-31T04:42:33.020803+0000 mgr.a (mgr.14388) 6544 : cluster [DBG] pgmap v4535: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 44 KiB/s rd, 426 B/s wr, 68 op/s 2024-08-31T04:42:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:34 smithi191 bash[24992]: audit 2024-08-31T04:42:33.182804+0000 mgr.a (mgr.14388) 6545 : audit [DBG] from='client.149982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:36 smithi163 bash[24253]: cluster 2024-08-31T04:42:35.021719+0000 mgr.a (mgr.14388) 6546 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T04:42:37.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:36 smithi027 bash[22610]: cluster 2024-08-31T04:42:35.021719+0000 mgr.a (mgr.14388) 6546 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T04:42:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:36 smithi191 bash[24992]: cluster 2024-08-31T04:42:35.021719+0000 mgr.a (mgr.14388) 6546 : cluster [DBG] pgmap v4536: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T04:42:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:37 smithi163 bash[24253]: cluster 2024-08-31T04:42:37.022526+0000 mgr.a (mgr.14388) 6547 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T04:42:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:37 smithi027 bash[22610]: cluster 2024-08-31T04:42:37.022526+0000 mgr.a (mgr.14388) 6547 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T04:42:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:37 smithi191 bash[24992]: cluster 2024-08-31T04:42:37.022526+0000 mgr.a (mgr.14388) 6547 : cluster [DBG] pgmap v4537: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T04:42:38.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:42:38.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:42:38.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:42:39.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:42:39.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:42:39.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:42:39.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:42:39.332 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:42:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:40 smithi163 bash[24253]: audit 2024-08-31T04:42:38.926614+0000 mgr.a (mgr.14388) 6548 : audit [DBG] from='client.150054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:40 smithi163 bash[24253]: cluster 2024-08-31T04:42:39.023853+0000 mgr.a (mgr.14388) 6549 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T04:42:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:40 smithi027 bash[22610]: audit 2024-08-31T04:42:38.926614+0000 mgr.a (mgr.14388) 6548 : audit [DBG] from='client.150054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:40 smithi027 bash[22610]: cluster 2024-08-31T04:42:39.023853+0000 mgr.a (mgr.14388) 6549 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T04:42:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:40 smithi191 bash[24992]: audit 2024-08-31T04:42:38.926614+0000 mgr.a (mgr.14388) 6548 : audit [DBG] from='client.150054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:40 smithi191 bash[24992]: cluster 2024-08-31T04:42:39.023853+0000 mgr.a (mgr.14388) 6549 : cluster [DBG] pgmap v4538: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T04:42:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:42 smithi163 bash[24253]: cluster 2024-08-31T04:42:41.024802+0000 mgr.a (mgr.14388) 6550 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T04:42:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:42 smithi027 bash[22610]: cluster 2024-08-31T04:42:41.024802+0000 mgr.a (mgr.14388) 6550 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T04:42:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:42 smithi191 bash[24992]: cluster 2024-08-31T04:42:41.024802+0000 mgr.a (mgr.14388) 6550 : cluster [DBG] pgmap v4539: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T04:42:44.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:42:44.333 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:42:44.333 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:42:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:44 smithi163 bash[24253]: cluster 2024-08-31T04:42:43.027005+0000 mgr.a (mgr.14388) 6551 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T04:42:44.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:44 smithi027 bash[22610]: cluster 2024-08-31T04:42:43.027005+0000 mgr.a (mgr.14388) 6551 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T04:42:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:44 smithi191 bash[24992]: cluster 2024-08-31T04:42:43.027005+0000 mgr.a (mgr.14388) 6551 : cluster [DBG] pgmap v4540: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T04:42:45.116 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:42:45.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:42:45.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:42:45.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:42:45.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:42:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:45 smithi163 bash[24253]: audit 2024-08-31T04:42:44.673546+0000 mgr.a (mgr.14388) 6552 : audit [DBG] from='client.150129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:45.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:45 smithi027 bash[22610]: audit 2024-08-31T04:42:44.673546+0000 mgr.a (mgr.14388) 6552 : audit [DBG] from='client.150129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:45 smithi191 bash[24992]: audit 2024-08-31T04:42:44.673546+0000 mgr.a (mgr.14388) 6552 : audit [DBG] from='client.150129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:46 smithi163 bash[24253]: cluster 2024-08-31T04:42:45.027578+0000 mgr.a (mgr.14388) 6553 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:46.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:46 smithi027 bash[22610]: cluster 2024-08-31T04:42:45.027578+0000 mgr.a (mgr.14388) 6553 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:46 smithi191 bash[24992]: cluster 2024-08-31T04:42:45.027578+0000 mgr.a (mgr.14388) 6553 : cluster [DBG] pgmap v4541: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:48 smithi163 bash[24253]: cluster 2024-08-31T04:42:47.028365+0000 mgr.a (mgr.14388) 6554 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:48 smithi027 bash[22610]: cluster 2024-08-31T04:42:47.028365+0000 mgr.a (mgr.14388) 6554 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:48 smithi191 bash[24992]: cluster 2024-08-31T04:42:47.028365+0000 mgr.a (mgr.14388) 6554 : cluster [DBG] pgmap v4542: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:50.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:42:50.118 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:42:50.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:42:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:50 smithi163 bash[24253]: cluster 2024-08-31T04:42:49.030607+0000 mgr.a (mgr.14388) 6555 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:50.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:50 smithi027 bash[22610]: cluster 2024-08-31T04:42:49.030607+0000 mgr.a (mgr.14388) 6555 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:50 smithi191 bash[24992]: cluster 2024-08-31T04:42:49.030607+0000 mgr.a (mgr.14388) 6555 : cluster [DBG] pgmap v4543: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:50.886 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:42:50.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:42:50.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:42:50.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:42:50.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:42:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:51 smithi163 bash[24253]: audit 2024-08-31T04:42:50.455316+0000 mgr.a (mgr.14388) 6556 : audit [DBG] from='client.150207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:51 smithi027 bash[22610]: audit 2024-08-31T04:42:50.455316+0000 mgr.a (mgr.14388) 6556 : audit [DBG] from='client.150207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:51 smithi191 bash[24992]: audit 2024-08-31T04:42:50.455316+0000 mgr.a (mgr.14388) 6556 : audit [DBG] from='client.150207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:52 smithi163 bash[24253]: cluster 2024-08-31T04:42:51.031589+0000 mgr.a (mgr.14388) 6557 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:52 smithi027 bash[22610]: cluster 2024-08-31T04:42:51.031589+0000 mgr.a (mgr.14388) 6557 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:52 smithi191 bash[24992]: cluster 2024-08-31T04:42:51.031589+0000 mgr.a (mgr.14388) 6557 : cluster [DBG] pgmap v4544: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:54.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:54 smithi163 bash[24253]: cluster 2024-08-31T04:42:53.033760+0000 mgr.a (mgr.14388) 6558 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:54.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:54 smithi027 bash[22610]: cluster 2024-08-31T04:42:53.033760+0000 mgr.a (mgr.14388) 6558 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:54 smithi191 bash[24992]: cluster 2024-08-31T04:42:53.033760+0000 mgr.a (mgr.14388) 6558 : cluster [DBG] pgmap v4545: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:42:55.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:42:55.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:42:55.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:42:56.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:56 smithi163 bash[24253]: cluster 2024-08-31T04:42:55.034520+0000 mgr.a (mgr.14388) 6559 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:56.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:56 smithi027 bash[22610]: cluster 2024-08-31T04:42:55.034520+0000 mgr.a (mgr.14388) 6559 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:56 smithi191 bash[24992]: cluster 2024-08-31T04:42:55.034520+0000 mgr.a (mgr.14388) 6559 : cluster [DBG] pgmap v4546: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:56.657 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:42:56.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:42:56.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:42:56.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:42:56.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:42:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:57 smithi163 bash[24253]: audit 2024-08-31T04:42:56.223889+0000 mgr.a (mgr.14388) 6560 : audit [DBG] from='client.150285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:57.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:57 smithi027 bash[22610]: audit 2024-08-31T04:42:56.223889+0000 mgr.a (mgr.14388) 6560 : audit [DBG] from='client.150285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:57 smithi191 bash[24992]: audit 2024-08-31T04:42:56.223889+0000 mgr.a (mgr.14388) 6560 : audit [DBG] from='client.150285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:42:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:42:58 smithi163 bash[24253]: cluster 2024-08-31T04:42:57.035502+0000 mgr.a (mgr.14388) 6561 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:58.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:42:58 smithi027 bash[22610]: cluster 2024-08-31T04:42:57.035502+0000 mgr.a (mgr.14388) 6561 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:42:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:42:58 smithi191 bash[24992]: cluster 2024-08-31T04:42:57.035502+0000 mgr.a (mgr.14388) 6561 : cluster [DBG] pgmap v4547: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:00 smithi163 bash[24253]: cluster 2024-08-31T04:42:59.037831+0000 mgr.a (mgr.14388) 6562 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:00.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:00 smithi027 bash[22610]: cluster 2024-08-31T04:42:59.037831+0000 mgr.a (mgr.14388) 6562 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:00 smithi191 bash[24992]: cluster 2024-08-31T04:42:59.037831+0000 mgr.a (mgr.14388) 6562 : cluster [DBG] pgmap v4548: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:01.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:01.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:01.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:43:02.403 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:43:02.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:43:02.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:43:02.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:43:02.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:43:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:02 smithi163 bash[24253]: cluster 2024-08-31T04:43:01.038612+0000 mgr.a (mgr.14388) 6563 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:02.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:02 smithi027 bash[22610]: cluster 2024-08-31T04:43:01.038612+0000 mgr.a (mgr.14388) 6563 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:02 smithi191 bash[24992]: cluster 2024-08-31T04:43:01.038612+0000 mgr.a (mgr.14388) 6563 : cluster [DBG] pgmap v4549: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:03 smithi163 bash[24253]: audit 2024-08-31T04:43:01.987373+0000 mgr.a (mgr.14388) 6564 : audit [DBG] from='client.150360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:03 smithi027 bash[22610]: audit 2024-08-31T04:43:01.987373+0000 mgr.a (mgr.14388) 6564 : audit [DBG] from='client.150360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:03 smithi191 bash[24992]: audit 2024-08-31T04:43:01.987373+0000 mgr.a (mgr.14388) 6564 : audit [DBG] from='client.150360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:04 smithi163 bash[24253]: cluster 2024-08-31T04:43:03.040931+0000 mgr.a (mgr.14388) 6565 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:04.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:04 smithi027 bash[22610]: cluster 2024-08-31T04:43:03.040931+0000 mgr.a (mgr.14388) 6565 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:04 smithi191 bash[24992]: cluster 2024-08-31T04:43:03.040931+0000 mgr.a (mgr.14388) 6565 : cluster [DBG] pgmap v4550: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:06 smithi163 bash[24253]: cluster 2024-08-31T04:43:05.041725+0000 mgr.a (mgr.14388) 6566 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:06.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:06 smithi027 bash[22610]: cluster 2024-08-31T04:43:05.041725+0000 mgr.a (mgr.14388) 6566 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:06 smithi191 bash[24992]: cluster 2024-08-31T04:43:05.041725+0000 mgr.a (mgr.14388) 6566 : cluster [DBG] pgmap v4551: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:07.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:07.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:43:08.159 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:43:08.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:43:08.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:43:08.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:43:08.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:43:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:08 smithi163 bash[24253]: cluster 2024-08-31T04:43:07.042502+0000 mgr.a (mgr.14388) 6567 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:08 smithi163 bash[24253]: audit 2024-08-31T04:43:07.739764+0000 mgr.a (mgr.14388) 6568 : audit [DBG] from='client.150438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:08.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:08 smithi027 bash[22610]: cluster 2024-08-31T04:43:07.042502+0000 mgr.a (mgr.14388) 6567 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:08 smithi027 bash[22610]: audit 2024-08-31T04:43:07.739764+0000 mgr.a (mgr.14388) 6568 : audit [DBG] from='client.150438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:08 smithi191 bash[24992]: cluster 2024-08-31T04:43:07.042502+0000 mgr.a (mgr.14388) 6567 : cluster [DBG] pgmap v4552: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:08 smithi191 bash[24992]: audit 2024-08-31T04:43:07.739764+0000 mgr.a (mgr.14388) 6568 : audit [DBG] from='client.150438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:10 smithi163 bash[24253]: cluster 2024-08-31T04:43:09.045341+0000 mgr.a (mgr.14388) 6569 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:10.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:10 smithi027 bash[22610]: cluster 2024-08-31T04:43:09.045341+0000 mgr.a (mgr.14388) 6569 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:10 smithi191 bash[24992]: cluster 2024-08-31T04:43:09.045341+0000 mgr.a (mgr.14388) 6569 : cluster [DBG] pgmap v4553: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:12 smithi163 bash[24253]: cluster 2024-08-31T04:43:11.046145+0000 mgr.a (mgr.14388) 6570 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:12.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:12 smithi027 bash[22610]: cluster 2024-08-31T04:43:11.046145+0000 mgr.a (mgr.14388) 6570 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:12 smithi191 bash[24992]: cluster 2024-08-31T04:43:11.046145+0000 mgr.a (mgr.14388) 6570 : cluster [DBG] pgmap v4554: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:13.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:13.162 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:13.162 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:43:13.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:43:13.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:43:13.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:43:13.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:43:13.934 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:43:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:14 smithi163 bash[24253]: cluster 2024-08-31T04:43:13.048092+0000 mgr.a (mgr.14388) 6571 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:14 smithi163 bash[24253]: audit 2024-08-31T04:43:13.503315+0000 mgr.a (mgr.14388) 6572 : audit [DBG] from='client.150516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:14 smithi027 bash[22610]: cluster 2024-08-31T04:43:13.048092+0000 mgr.a (mgr.14388) 6571 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:14 smithi027 bash[22610]: audit 2024-08-31T04:43:13.503315+0000 mgr.a (mgr.14388) 6572 : audit [DBG] from='client.150516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:14 smithi191 bash[24992]: cluster 2024-08-31T04:43:13.048092+0000 mgr.a (mgr.14388) 6571 : cluster [DBG] pgmap v4555: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:14 smithi191 bash[24992]: audit 2024-08-31T04:43:13.503315+0000 mgr.a (mgr.14388) 6572 : audit [DBG] from='client.150516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:16 smithi163 bash[24253]: cluster 2024-08-31T04:43:15.049062+0000 mgr.a (mgr.14388) 6573 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:16 smithi027 bash[22610]: cluster 2024-08-31T04:43:15.049062+0000 mgr.a (mgr.14388) 6573 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:16 smithi191 bash[24992]: cluster 2024-08-31T04:43:15.049062+0000 mgr.a (mgr.14388) 6573 : cluster [DBG] pgmap v4556: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:18 smithi163 bash[24253]: cluster 2024-08-31T04:43:17.049853+0000 mgr.a (mgr.14388) 6574 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:43:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:18 smithi027 bash[22610]: cluster 2024-08-31T04:43:17.049853+0000 mgr.a (mgr.14388) 6574 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:43:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:18 smithi191 bash[24992]: cluster 2024-08-31T04:43:17.049853+0000 mgr.a (mgr.14388) 6574 : cluster [DBG] pgmap v4557: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:43:18.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:18.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:18.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:43:19.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:43:19.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:43:19.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:43:19.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:43:19.691 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:43:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:20 smithi163 bash[24253]: cluster 2024-08-31T04:43:19.050921+0000 mgr.a (mgr.14388) 6575 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:20 smithi163 bash[24253]: audit 2024-08-31T04:43:19.266821+0000 mgr.a (mgr.14388) 6576 : audit [DBG] from='client.150594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:20 smithi027 bash[22610]: cluster 2024-08-31T04:43:19.050921+0000 mgr.a (mgr.14388) 6575 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:20 smithi027 bash[22610]: audit 2024-08-31T04:43:19.266821+0000 mgr.a (mgr.14388) 6576 : audit [DBG] from='client.150594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:20 smithi191 bash[24992]: cluster 2024-08-31T04:43:19.050921+0000 mgr.a (mgr.14388) 6575 : cluster [DBG] pgmap v4558: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:20 smithi191 bash[24992]: audit 2024-08-31T04:43:19.266821+0000 mgr.a (mgr.14388) 6576 : audit [DBG] from='client.150594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:22 smithi163 bash[24253]: cluster 2024-08-31T04:43:21.051839+0000 mgr.a (mgr.14388) 6577 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:22 smithi027 bash[22610]: cluster 2024-08-31T04:43:21.051839+0000 mgr.a (mgr.14388) 6577 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:22 smithi191 bash[24992]: cluster 2024-08-31T04:43:21.051839+0000 mgr.a (mgr.14388) 6577 : cluster [DBG] pgmap v4559: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:24 smithi027 bash[22610]: cluster 2024-08-31T04:43:23.053999+0000 mgr.a (mgr.14388) 6578 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:24 smithi191 bash[24992]: cluster 2024-08-31T04:43:23.053999+0000 mgr.a (mgr.14388) 6578 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:24.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:24.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:24.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:43:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:24 smithi163 bash[24253]: cluster 2024-08-31T04:43:23.053999+0000 mgr.a (mgr.14388) 6578 : cluster [DBG] pgmap v4560: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:25.478 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:43:25.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:43:25.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:43:25.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:43:25.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:43:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:26 smithi027 bash[22610]: audit 2024-08-31T04:43:25.037852+0000 mgr.a (mgr.14388) 6579 : audit [DBG] from='client.150672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:26 smithi027 bash[22610]: cluster 2024-08-31T04:43:25.054965+0000 mgr.a (mgr.14388) 6580 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:26 smithi191 bash[24992]: audit 2024-08-31T04:43:25.037852+0000 mgr.a (mgr.14388) 6579 : audit [DBG] from='client.150672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:26 smithi191 bash[24992]: cluster 2024-08-31T04:43:25.054965+0000 mgr.a (mgr.14388) 6580 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:26 smithi163 bash[24253]: audit 2024-08-31T04:43:25.037852+0000 mgr.a (mgr.14388) 6579 : audit [DBG] from='client.150672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:26 smithi163 bash[24253]: cluster 2024-08-31T04:43:25.054965+0000 mgr.a (mgr.14388) 6580 : cluster [DBG] pgmap v4561: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:28 smithi027 bash[22610]: cluster 2024-08-31T04:43:27.055886+0000 mgr.a (mgr.14388) 6581 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:28 smithi191 bash[24992]: cluster 2024-08-31T04:43:27.055886+0000 mgr.a (mgr.14388) 6581 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:28 smithi163 bash[24253]: cluster 2024-08-31T04:43:27.055886+0000 mgr.a (mgr.14388) 6581 : cluster [DBG] pgmap v4562: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:30.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:30.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:30.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:30 smithi027 bash[22610]: cluster 2024-08-31T04:43:29.058139+0000 mgr.a (mgr.14388) 6582 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:30.482 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:43:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:30 smithi191 bash[24992]: cluster 2024-08-31T04:43:29.058139+0000 mgr.a (mgr.14388) 6582 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:30 smithi163 bash[24253]: cluster 2024-08-31T04:43:29.058139+0000 mgr.a (mgr.14388) 6582 : cluster [DBG] pgmap v4563: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:43:31.270 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:43:31.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:43:31.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:43:31.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:43:31.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:43:31.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:31 smithi027 bash[22610]: audit 2024-08-31T04:43:30.525422+0000 mon.a (mon.0) 1567 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:43:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:31 smithi191 bash[24992]: audit 2024-08-31T04:43:30.525422+0000 mon.a (mon.0) 1567 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:43:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:31 smithi163 bash[24253]: audit 2024-08-31T04:43:30.525422+0000 mon.a (mon.0) 1567 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:43:32.629 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:32 smithi027 bash[22610]: audit 2024-08-31T04:43:30.814286+0000 mgr.a (mgr.14388) 6583 : audit [DBG] from='client.150747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:32.629 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:32 smithi027 bash[22610]: cluster 2024-08-31T04:43:31.058936+0000 mgr.a (mgr.14388) 6584 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:32.629 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:32 smithi027 bash[22610]: audit 2024-08-31T04:43:31.303582+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:43:32.629 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:32 smithi027 bash[22610]: audit 2024-08-31T04:43:31.308567+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:43:32.629 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:32 smithi027 bash[22610]: audit 2024-08-31T04:43:31.904000+0000 mon.a (mon.0) 1570 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:43:32.630 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:32 smithi027 bash[22610]: audit 2024-08-31T04:43:31.905658+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:43:32.630 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:32 smithi027 bash[22610]: audit 2024-08-31T04:43:31.915777+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:43:32.630 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:32 smithi027 bash[22610]: audit 2024-08-31T04:43:31.920668+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:43:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:32 smithi163 bash[24253]: audit 2024-08-31T04:43:30.814286+0000 mgr.a (mgr.14388) 6583 : audit [DBG] from='client.150747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:32 smithi163 bash[24253]: cluster 2024-08-31T04:43:31.058936+0000 mgr.a (mgr.14388) 6584 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:32 smithi163 bash[24253]: audit 2024-08-31T04:43:31.303582+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:43:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:32 smithi163 bash[24253]: audit 2024-08-31T04:43:31.308567+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:43:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:32 smithi163 bash[24253]: audit 2024-08-31T04:43:31.904000+0000 mon.a (mon.0) 1570 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:43:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:32 smithi163 bash[24253]: audit 2024-08-31T04:43:31.905658+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:43:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:32 smithi163 bash[24253]: audit 2024-08-31T04:43:31.915777+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:43:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:32 smithi163 bash[24253]: audit 2024-08-31T04:43:31.920668+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:43:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:32 smithi191 bash[24992]: audit 2024-08-31T04:43:30.814286+0000 mgr.a (mgr.14388) 6583 : audit [DBG] from='client.150747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:32 smithi191 bash[24992]: cluster 2024-08-31T04:43:31.058936+0000 mgr.a (mgr.14388) 6584 : cluster [DBG] pgmap v4564: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:32 smithi191 bash[24992]: audit 2024-08-31T04:43:31.303582+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:43:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:32 smithi191 bash[24992]: audit 2024-08-31T04:43:31.308567+0000 mon.a (mon.0) 1569 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:43:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:32 smithi191 bash[24992]: audit 2024-08-31T04:43:31.904000+0000 mon.a (mon.0) 1570 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:43:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:32 smithi191 bash[24992]: audit 2024-08-31T04:43:31.905658+0000 mon.a (mon.0) 1571 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:43:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:32 smithi191 bash[24992]: audit 2024-08-31T04:43:31.915777+0000 mon.a (mon.0) 1572 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:43:32.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:32 smithi191 bash[24992]: audit 2024-08-31T04:43:31.920668+0000 mon.a (mon.0) 1573 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:43:32.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:43:32 smithi027 bash[22863]: debug 2024-08-31T04:43:32.624+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:43:32.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:43:32 smithi027 bash[22863]: debug 2024-08-31T04:43:32.628+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:43:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:33 smithi163 bash[24253]: audit 2024-08-31T04:43:31.923177+0000 mgr.a (mgr.14388) 6585 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:43:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:33 smithi163 bash[24253]: audit 2024-08-31T04:43:32.630462+0000 mgr.a (mgr.14388) 6586 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:43:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:33 smithi163 bash[24253]: cephadm 2024-08-31T04:43:32.631954+0000 mgr.a (mgr.14388) 6587 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:43:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:33 smithi027 bash[22610]: audit 2024-08-31T04:43:31.923177+0000 mgr.a (mgr.14388) 6585 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:43:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:33 smithi027 bash[22610]: audit 2024-08-31T04:43:32.630462+0000 mgr.a (mgr.14388) 6586 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:43:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:33 smithi027 bash[22610]: cephadm 2024-08-31T04:43:32.631954+0000 mgr.a (mgr.14388) 6587 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:43:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:33 smithi191 bash[24992]: audit 2024-08-31T04:43:31.923177+0000 mgr.a (mgr.14388) 6585 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:43:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:33 smithi191 bash[24992]: audit 2024-08-31T04:43:32.630462+0000 mgr.a (mgr.14388) 6586 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:43:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:33 smithi191 bash[24992]: cephadm 2024-08-31T04:43:32.631954+0000 mgr.a (mgr.14388) 6587 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:43:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:34 smithi163 bash[24253]: cluster 2024-08-31T04:43:33.061257+0000 mgr.a (mgr.14388) 6588 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:34 smithi027 bash[22610]: cluster 2024-08-31T04:43:33.061257+0000 mgr.a (mgr.14388) 6588 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:34 smithi191 bash[24992]: cluster 2024-08-31T04:43:33.061257+0000 mgr.a (mgr.14388) 6588 : cluster [DBG] pgmap v4565: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:36.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:36.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:36.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:43:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:36 smithi163 bash[24253]: cluster 2024-08-31T04:43:35.062031+0000 mgr.a (mgr.14388) 6589 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:36.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:36 smithi027 bash[22610]: cluster 2024-08-31T04:43:35.062031+0000 mgr.a (mgr.14388) 6589 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:36 smithi191 bash[24992]: cluster 2024-08-31T04:43:35.062031+0000 mgr.a (mgr.14388) 6589 : cluster [DBG] pgmap v4566: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:37.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:43:37.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:43:37.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:43:37.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:43:37.049 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:43:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:37 smithi163 bash[24253]: audit 2024-08-31T04:43:36.608777+0000 mgr.a (mgr.14388) 6590 : audit [DBG] from='client.150930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:37 smithi027 bash[22610]: audit 2024-08-31T04:43:36.608777+0000 mgr.a (mgr.14388) 6590 : audit [DBG] from='client.150930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:37 smithi191 bash[24992]: audit 2024-08-31T04:43:36.608777+0000 mgr.a (mgr.14388) 6590 : audit [DBG] from='client.150930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:38 smithi163 bash[24253]: cluster 2024-08-31T04:43:37.062741+0000 mgr.a (mgr.14388) 6591 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:38 smithi027 bash[22610]: cluster 2024-08-31T04:43:37.062741+0000 mgr.a (mgr.14388) 6591 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:38 smithi191 bash[24992]: cluster 2024-08-31T04:43:37.062741+0000 mgr.a (mgr.14388) 6591 : cluster [DBG] pgmap v4567: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:40 smithi163 bash[24253]: cluster 2024-08-31T04:43:39.065424+0000 mgr.a (mgr.14388) 6592 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:40.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:40 smithi027 bash[22610]: cluster 2024-08-31T04:43:39.065424+0000 mgr.a (mgr.14388) 6592 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:40 smithi191 bash[24992]: cluster 2024-08-31T04:43:39.065424+0000 mgr.a (mgr.14388) 6592 : cluster [DBG] pgmap v4568: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:42.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:42.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:42.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:43:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:42 smithi163 bash[24253]: cluster 2024-08-31T04:43:41.066212+0000 mgr.a (mgr.14388) 6593 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:42.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:42 smithi027 bash[22610]: cluster 2024-08-31T04:43:41.066212+0000 mgr.a (mgr.14388) 6593 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:42.786 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:43:42.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:43:42.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:43:42.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:43:42.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:43:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:42 smithi191 bash[24992]: cluster 2024-08-31T04:43:41.066212+0000 mgr.a (mgr.14388) 6593 : cluster [DBG] pgmap v4569: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:43 smithi163 bash[24253]: audit 2024-08-31T04:43:42.385643+0000 mgr.a (mgr.14388) 6594 : audit [DBG] from='client.151005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:43 smithi027 bash[22610]: audit 2024-08-31T04:43:42.385643+0000 mgr.a (mgr.14388) 6594 : audit [DBG] from='client.151005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:43 smithi191 bash[24992]: audit 2024-08-31T04:43:42.385643+0000 mgr.a (mgr.14388) 6594 : audit [DBG] from='client.151005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:44.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:44 smithi163 bash[24253]: cluster 2024-08-31T04:43:43.068496+0000 mgr.a (mgr.14388) 6595 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:44.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:44 smithi027 bash[22610]: cluster 2024-08-31T04:43:43.068496+0000 mgr.a (mgr.14388) 6595 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:44 smithi191 bash[24992]: cluster 2024-08-31T04:43:43.068496+0000 mgr.a (mgr.14388) 6595 : cluster [DBG] pgmap v4570: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:43:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:46 smithi163 bash[24253]: cluster 2024-08-31T04:43:45.069292+0000 mgr.a (mgr.14388) 6596 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:46.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:46 smithi027 bash[22610]: cluster 2024-08-31T04:43:45.069292+0000 mgr.a (mgr.14388) 6596 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:46 smithi191 bash[24992]: cluster 2024-08-31T04:43:45.069292+0000 mgr.a (mgr.14388) 6596 : cluster [DBG] pgmap v4571: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:47.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:47.789 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:47.789 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:43:48.531 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:43:48.531 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:43:48.531 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:43:48.531 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:43:48.531 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:43:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:48 smithi163 bash[24253]: cluster 2024-08-31T04:43:47.070018+0000 mgr.a (mgr.14388) 6597 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:48 smithi027 bash[22610]: cluster 2024-08-31T04:43:47.070018+0000 mgr.a (mgr.14388) 6597 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:48 smithi191 bash[24992]: cluster 2024-08-31T04:43:47.070018+0000 mgr.a (mgr.14388) 6597 : cluster [DBG] pgmap v4572: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:49 smithi163 bash[24253]: audit 2024-08-31T04:43:48.123829+0000 mgr.a (mgr.14388) 6598 : audit [DBG] from='client.151083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:49.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:49 smithi027 bash[22610]: audit 2024-08-31T04:43:48.123829+0000 mgr.a (mgr.14388) 6598 : audit [DBG] from='client.151083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:49 smithi191 bash[24992]: audit 2024-08-31T04:43:48.123829+0000 mgr.a (mgr.14388) 6598 : audit [DBG] from='client.151083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:50 smithi163 bash[24253]: cluster 2024-08-31T04:43:49.072891+0000 mgr.a (mgr.14388) 6599 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:50.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:50 smithi027 bash[22610]: cluster 2024-08-31T04:43:49.072891+0000 mgr.a (mgr.14388) 6599 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:50 smithi191 bash[24992]: cluster 2024-08-31T04:43:49.072891+0000 mgr.a (mgr.14388) 6599 : cluster [DBG] pgmap v4573: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:52 smithi163 bash[24253]: cluster 2024-08-31T04:43:51.073682+0000 mgr.a (mgr.14388) 6600 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:52 smithi027 bash[22610]: cluster 2024-08-31T04:43:51.073682+0000 mgr.a (mgr.14388) 6600 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:52 smithi191 bash[24992]: cluster 2024-08-31T04:43:51.073682+0000 mgr.a (mgr.14388) 6600 : cluster [DBG] pgmap v4574: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:53.532 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:53.533 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:53.533 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:43:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:43:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:43:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:43:54.279 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:43:54.279 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:43:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:54 smithi163 bash[24253]: cluster 2024-08-31T04:43:53.075606+0000 mgr.a (mgr.14388) 6601 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:54.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:54 smithi027 bash[22610]: cluster 2024-08-31T04:43:53.075606+0000 mgr.a (mgr.14388) 6601 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:54 smithi191 bash[24992]: cluster 2024-08-31T04:43:53.075606+0000 mgr.a (mgr.14388) 6601 : cluster [DBG] pgmap v4575: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:43:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:55 smithi163 bash[24253]: audit 2024-08-31T04:43:53.869576+0000 mgr.a (mgr.14388) 6602 : audit [DBG] from='client.151161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:55 smithi027 bash[22610]: audit 2024-08-31T04:43:53.869576+0000 mgr.a (mgr.14388) 6602 : audit [DBG] from='client.151161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:55 smithi191 bash[24992]: audit 2024-08-31T04:43:53.869576+0000 mgr.a (mgr.14388) 6602 : audit [DBG] from='client.151161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:43:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:56 smithi163 bash[24253]: cluster 2024-08-31T04:43:55.076576+0000 mgr.a (mgr.14388) 6603 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:56.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:56 smithi027 bash[22610]: cluster 2024-08-31T04:43:55.076576+0000 mgr.a (mgr.14388) 6603 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:56 smithi191 bash[24992]: cluster 2024-08-31T04:43:55.076576+0000 mgr.a (mgr.14388) 6603 : cluster [DBG] pgmap v4576: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:43:58.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:43:58 smithi163 bash[24253]: cluster 2024-08-31T04:43:57.077342+0000 mgr.a (mgr.14388) 6604 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:43:58.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:43:58 smithi027 bash[22610]: cluster 2024-08-31T04:43:57.077342+0000 mgr.a (mgr.14388) 6604 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:43:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:43:58 smithi191 bash[24992]: cluster 2024-08-31T04:43:57.077342+0000 mgr.a (mgr.14388) 6604 : cluster [DBG] pgmap v4577: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:43:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:43:59.281 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:43:59.281 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:00.049 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:00.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:00.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:00.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:00.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:00 smithi163 bash[24253]: cluster 2024-08-31T04:43:59.079602+0000 mgr.a (mgr.14388) 6605 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:00 smithi163 bash[24253]: audit 2024-08-31T04:43:59.615072+0000 mgr.a (mgr.14388) 6606 : audit [DBG] from='client.151233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:00 smithi027 bash[22610]: cluster 2024-08-31T04:43:59.079602+0000 mgr.a (mgr.14388) 6605 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:00 smithi027 bash[22610]: audit 2024-08-31T04:43:59.615072+0000 mgr.a (mgr.14388) 6606 : audit [DBG] from='client.151233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:00 smithi191 bash[24992]: cluster 2024-08-31T04:43:59.079602+0000 mgr.a (mgr.14388) 6605 : cluster [DBG] pgmap v4578: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:00 smithi191 bash[24992]: audit 2024-08-31T04:43:59.615072+0000 mgr.a (mgr.14388) 6606 : audit [DBG] from='client.151233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:02 smithi163 bash[24253]: cluster 2024-08-31T04:44:01.080550+0000 mgr.a (mgr.14388) 6607 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:02 smithi027 bash[22610]: cluster 2024-08-31T04:44:01.080550+0000 mgr.a (mgr.14388) 6607 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:02 smithi191 bash[24992]: cluster 2024-08-31T04:44:01.080550+0000 mgr.a (mgr.14388) 6607 : cluster [DBG] pgmap v4579: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:04 smithi163 bash[24253]: cluster 2024-08-31T04:44:03.082696+0000 mgr.a (mgr.14388) 6608 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:04.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:04 smithi027 bash[22610]: cluster 2024-08-31T04:44:03.082696+0000 mgr.a (mgr.14388) 6608 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:04 smithi191 bash[24992]: cluster 2024-08-31T04:44:03.082696+0000 mgr.a (mgr.14388) 6608 : cluster [DBG] pgmap v4580: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:05.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:44:05.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:44:05.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:05.837 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:05.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:06.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:06 smithi163 bash[24253]: cluster 2024-08-31T04:44:05.083373+0000 mgr.a (mgr.14388) 6609 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:06.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:06 smithi163 bash[24253]: audit 2024-08-31T04:44:05.390330+0000 mgr.a (mgr.14388) 6610 : audit [DBG] from='client.151311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:06.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:06 smithi027 bash[22610]: cluster 2024-08-31T04:44:05.083373+0000 mgr.a (mgr.14388) 6609 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:06.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:06 smithi027 bash[22610]: audit 2024-08-31T04:44:05.390330+0000 mgr.a (mgr.14388) 6610 : audit [DBG] from='client.151311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:06 smithi191 bash[24992]: cluster 2024-08-31T04:44:05.083373+0000 mgr.a (mgr.14388) 6609 : cluster [DBG] pgmap v4581: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:06 smithi191 bash[24992]: audit 2024-08-31T04:44:05.390330+0000 mgr.a (mgr.14388) 6610 : audit [DBG] from='client.151311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:08 smithi163 bash[24253]: cluster 2024-08-31T04:44:07.084255+0000 mgr.a (mgr.14388) 6611 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:08.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:08 smithi027 bash[22610]: cluster 2024-08-31T04:44:07.084255+0000 mgr.a (mgr.14388) 6611 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:08 smithi191 bash[24992]: cluster 2024-08-31T04:44:07.084255+0000 mgr.a (mgr.14388) 6611 : cluster [DBG] pgmap v4582: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:10.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:10 smithi163 bash[24253]: cluster 2024-08-31T04:44:09.086562+0000 mgr.a (mgr.14388) 6612 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:10 smithi027 bash[22610]: cluster 2024-08-31T04:44:09.086562+0000 mgr.a (mgr.14388) 6612 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:10 smithi191 bash[24992]: cluster 2024-08-31T04:44:09.086562+0000 mgr.a (mgr.14388) 6612 : cluster [DBG] pgmap v4583: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:10.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:44:10.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:44:10.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:11.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:11.620 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:12 smithi163 bash[24253]: cluster 2024-08-31T04:44:11.087132+0000 mgr.a (mgr.14388) 6613 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:12 smithi163 bash[24253]: audit 2024-08-31T04:44:11.180235+0000 mgr.a (mgr.14388) 6614 : audit [DBG] from='client.151386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:12.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:12 smithi027 bash[22610]: cluster 2024-08-31T04:44:11.087132+0000 mgr.a (mgr.14388) 6613 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:12 smithi027 bash[22610]: audit 2024-08-31T04:44:11.180235+0000 mgr.a (mgr.14388) 6614 : audit [DBG] from='client.151386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:12 smithi191 bash[24992]: cluster 2024-08-31T04:44:11.087132+0000 mgr.a (mgr.14388) 6613 : cluster [DBG] pgmap v4584: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:12 smithi191 bash[24992]: audit 2024-08-31T04:44:11.180235+0000 mgr.a (mgr.14388) 6614 : audit [DBG] from='client.151386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:14 smithi163 bash[24253]: cluster 2024-08-31T04:44:13.089542+0000 mgr.a (mgr.14388) 6615 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:14.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:14 smithi027 bash[22610]: cluster 2024-08-31T04:44:13.089542+0000 mgr.a (mgr.14388) 6615 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:14 smithi191 bash[24992]: cluster 2024-08-31T04:44:13.089542+0000 mgr.a (mgr.14388) 6615 : cluster [DBG] pgmap v4585: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:16.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:44:16.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:44:16.623 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:16.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:16 smithi163 bash[24253]: cluster 2024-08-31T04:44:15.090488+0000 mgr.a (mgr.14388) 6616 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:16 smithi027 bash[22610]: cluster 2024-08-31T04:44:15.090488+0000 mgr.a (mgr.14388) 6616 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:16 smithi191 bash[24992]: cluster 2024-08-31T04:44:15.090488+0000 mgr.a (mgr.14388) 6616 : cluster [DBG] pgmap v4586: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:17.365 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:17.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:17.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:17.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:17.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:18 smithi163 bash[24253]: audit 2024-08-31T04:44:16.952684+0000 mgr.a (mgr.14388) 6617 : audit [DBG] from='client.151461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:18 smithi163 bash[24253]: cluster 2024-08-31T04:44:17.091249+0000 mgr.a (mgr.14388) 6618 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:18 smithi027 bash[22610]: audit 2024-08-31T04:44:16.952684+0000 mgr.a (mgr.14388) 6617 : audit [DBG] from='client.151461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:18 smithi027 bash[22610]: cluster 2024-08-31T04:44:17.091249+0000 mgr.a (mgr.14388) 6618 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:18 smithi191 bash[24992]: audit 2024-08-31T04:44:16.952684+0000 mgr.a (mgr.14388) 6617 : audit [DBG] from='client.151461 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:18 smithi191 bash[24992]: cluster 2024-08-31T04:44:17.091249+0000 mgr.a (mgr.14388) 6618 : cluster [DBG] pgmap v4587: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:20 smithi027 bash[22610]: cluster 2024-08-31T04:44:19.093598+0000 mgr.a (mgr.14388) 6619 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:20 smithi191 bash[24992]: cluster 2024-08-31T04:44:19.093598+0000 mgr.a (mgr.14388) 6619 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:20 smithi163 bash[24253]: cluster 2024-08-31T04:44:19.093598+0000 mgr.a (mgr.14388) 6619 : cluster [DBG] pgmap v4588: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:22.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:44:22.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:44:22.368 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:22.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:22 smithi027 bash[22610]: cluster 2024-08-31T04:44:21.094387+0000 mgr.a (mgr.14388) 6620 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:22 smithi191 bash[24992]: cluster 2024-08-31T04:44:21.094387+0000 mgr.a (mgr.14388) 6620 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:22.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:22 smithi163 bash[24253]: cluster 2024-08-31T04:44:21.094387+0000 mgr.a (mgr.14388) 6620 : cluster [DBG] pgmap v4589: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:23.108 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:23 smithi027 bash[22610]: audit 2024-08-31T04:44:22.699643+0000 mgr.a (mgr.14388) 6621 : audit [DBG] from='client.151539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:23 smithi191 bash[24992]: audit 2024-08-31T04:44:22.699643+0000 mgr.a (mgr.14388) 6621 : audit [DBG] from='client.151539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:23 smithi163 bash[24253]: audit 2024-08-31T04:44:22.699643+0000 mgr.a (mgr.14388) 6621 : audit [DBG] from='client.151539 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:24.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:24 smithi027 bash[22610]: cluster 2024-08-31T04:44:23.095661+0000 mgr.a (mgr.14388) 6622 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:24 smithi191 bash[24992]: cluster 2024-08-31T04:44:23.095661+0000 mgr.a (mgr.14388) 6622 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:24 smithi163 bash[24253]: cluster 2024-08-31T04:44:23.095661+0000 mgr.a (mgr.14388) 6622 : cluster [DBG] pgmap v4590: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:26 smithi027 bash[22610]: cluster 2024-08-31T04:44:25.096545+0000 mgr.a (mgr.14388) 6623 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:44:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:26 smithi191 bash[24992]: cluster 2024-08-31T04:44:25.096545+0000 mgr.a (mgr.14388) 6623 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:44:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:26 smithi163 bash[24253]: cluster 2024-08-31T04:44:25.096545+0000 mgr.a (mgr.14388) 6623 : cluster [DBG] pgmap v4591: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:44:28.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:44:28.110 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:44:28.110 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:28.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:28 smithi027 bash[22610]: cluster 2024-08-31T04:44:27.097497+0000 mgr.a (mgr.14388) 6624 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:44:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:28 smithi191 bash[24992]: cluster 2024-08-31T04:44:27.097497+0000 mgr.a (mgr.14388) 6624 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:44:28.892 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:28.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:28.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:28.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:28.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:28 smithi163 bash[24253]: cluster 2024-08-31T04:44:27.097497+0000 mgr.a (mgr.14388) 6624 : cluster [DBG] pgmap v4592: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:44:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:29 smithi191 bash[24992]: audit 2024-08-31T04:44:28.450256+0000 mgr.a (mgr.14388) 6625 : audit [DBG] from='client.151617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:29 smithi163 bash[24253]: audit 2024-08-31T04:44:28.450256+0000 mgr.a (mgr.14388) 6625 : audit [DBG] from='client.151617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:29.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:29 smithi027 bash[22610]: audit 2024-08-31T04:44:28.450256+0000 mgr.a (mgr.14388) 6625 : audit [DBG] from='client.151617 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:30 smithi191 bash[24992]: cluster 2024-08-31T04:44:29.100344+0000 mgr.a (mgr.14388) 6626 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:30 smithi163 bash[24253]: cluster 2024-08-31T04:44:29.100344+0000 mgr.a (mgr.14388) 6626 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:30 smithi027 bash[22610]: cluster 2024-08-31T04:44:29.100344+0000 mgr.a (mgr.14388) 6626 : cluster [DBG] pgmap v4593: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:32 smithi191 bash[24992]: cluster 2024-08-31T04:44:31.101107+0000 mgr.a (mgr.14388) 6627 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:44:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:32 smithi163 bash[24253]: cluster 2024-08-31T04:44:31.101107+0000 mgr.a (mgr.14388) 6627 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:44:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:32 smithi027 bash[22610]: cluster 2024-08-31T04:44:31.101107+0000 mgr.a (mgr.14388) 6627 : cluster [DBG] pgmap v4594: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:44:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:33 smithi191 bash[24992]: audit 2024-08-31T04:44:32.687123+0000 mon.a (mon.0) 1574 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:44:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:33 smithi191 bash[24992]: audit 2024-08-31T04:44:33.296162+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:33 smithi191 bash[24992]: audit 2024-08-31T04:44:33.303010+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:33 smithi191 bash[24992]: audit 2024-08-31T04:44:33.309010+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:33 smithi191 bash[24992]: audit 2024-08-31T04:44:33.315197+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:44:33.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:44:33.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:33 smithi163 bash[24253]: audit 2024-08-31T04:44:32.687123+0000 mon.a (mon.0) 1574 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:44:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:33 smithi163 bash[24253]: audit 2024-08-31T04:44:33.296162+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:33 smithi163 bash[24253]: audit 2024-08-31T04:44:33.303010+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:33 smithi163 bash[24253]: audit 2024-08-31T04:44:33.309010+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:33 smithi163 bash[24253]: audit 2024-08-31T04:44:33.315197+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:33 smithi027 bash[22610]: audit 2024-08-31T04:44:32.687123+0000 mon.a (mon.0) 1574 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:44:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:33 smithi027 bash[22610]: audit 2024-08-31T04:44:33.296162+0000 mon.a (mon.0) 1575 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:33 smithi027 bash[22610]: audit 2024-08-31T04:44:33.303010+0000 mon.a (mon.0) 1576 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:33 smithi027 bash[22610]: audit 2024-08-31T04:44:33.309010+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:33 smithi027 bash[22610]: audit 2024-08-31T04:44:33.315197+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.642 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:34.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:34.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:34.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:34.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:34 smithi191 bash[24992]: cluster 2024-08-31T04:44:33.103186+0000 mgr.a (mgr.14388) 6628 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:34 smithi191 bash[24992]: audit 2024-08-31T04:44:33.995570+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:34 smithi191 bash[24992]: audit 2024-08-31T04:44:34.002505+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:34 smithi191 bash[24992]: audit 2024-08-31T04:44:34.469617+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:34 smithi191 bash[24992]: audit 2024-08-31T04:44:34.475316+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:34 smithi191 bash[24992]: audit 2024-08-31T04:44:34.490133+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:34 smithi191 bash[24992]: audit 2024-08-31T04:44:34.495256+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:34 smithi191 bash[24992]: audit 2024-08-31T04:44:34.496347+0000 mon.a (mon.0) 1585 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:44:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:34 smithi191 bash[24992]: audit 2024-08-31T04:44:34.497176+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:44:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:34 smithi163 bash[24253]: cluster 2024-08-31T04:44:33.103186+0000 mgr.a (mgr.14388) 6628 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:34 smithi163 bash[24253]: audit 2024-08-31T04:44:33.995570+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:34 smithi163 bash[24253]: audit 2024-08-31T04:44:34.002505+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:34 smithi163 bash[24253]: audit 2024-08-31T04:44:34.469617+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:34 smithi163 bash[24253]: audit 2024-08-31T04:44:34.475316+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:34 smithi163 bash[24253]: audit 2024-08-31T04:44:34.490133+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:34 smithi163 bash[24253]: audit 2024-08-31T04:44:34.495256+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:34 smithi163 bash[24253]: audit 2024-08-31T04:44:34.496347+0000 mon.a (mon.0) 1585 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:44:34.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:34 smithi163 bash[24253]: audit 2024-08-31T04:44:34.497176+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:44:34.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:34 smithi027 bash[22610]: cluster 2024-08-31T04:44:33.103186+0000 mgr.a (mgr.14388) 6628 : cluster [DBG] pgmap v4595: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:34 smithi027 bash[22610]: audit 2024-08-31T04:44:33.995570+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:34 smithi027 bash[22610]: audit 2024-08-31T04:44:34.002505+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:34 smithi027 bash[22610]: audit 2024-08-31T04:44:34.469617+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:34 smithi027 bash[22610]: audit 2024-08-31T04:44:34.475316+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:34 smithi027 bash[22610]: audit 2024-08-31T04:44:34.490133+0000 mon.a (mon.0) 1583 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:34 smithi027 bash[22610]: audit 2024-08-31T04:44:34.495256+0000 mon.a (mon.0) 1584 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:34 smithi027 bash[22610]: audit 2024-08-31T04:44:34.496347+0000 mon.a (mon.0) 1585 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:44:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:34 smithi027 bash[22610]: audit 2024-08-31T04:44:34.497176+0000 mon.a (mon.0) 1586 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:44:35.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:44:35 smithi027 bash[22863]: debug 2024-08-31T04:44:35.330+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:44:35.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:44:35 smithi027 bash[22863]: debug 2024-08-31T04:44:35.334+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:44:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:35 smithi027 bash[22610]: audit 2024-08-31T04:44:34.218538+0000 mgr.a (mgr.14388) 6629 : audit [DBG] from='client.151692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:35 smithi027 bash[22610]: audit 2024-08-31T04:44:34.502265+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:35 smithi027 bash[22610]: audit 2024-08-31T04:44:34.504834+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:44:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:35 smithi027 bash[22610]: audit 2024-08-31T04:44:34.506217+0000 mgr.a (mgr.14388) 6630 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:44:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:35 smithi191 bash[24992]: audit 2024-08-31T04:44:34.218538+0000 mgr.a (mgr.14388) 6629 : audit [DBG] from='client.151692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:35 smithi191 bash[24992]: audit 2024-08-31T04:44:34.502265+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:35 smithi191 bash[24992]: audit 2024-08-31T04:44:34.504834+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:44:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:35 smithi191 bash[24992]: audit 2024-08-31T04:44:34.506217+0000 mgr.a (mgr.14388) 6630 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:44:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:35 smithi163 bash[24253]: audit 2024-08-31T04:44:34.218538+0000 mgr.a (mgr.14388) 6629 : audit [DBG] from='client.151692 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:35 smithi163 bash[24253]: audit 2024-08-31T04:44:34.502265+0000 mon.a (mon.0) 1587 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:44:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:35 smithi163 bash[24253]: audit 2024-08-31T04:44:34.504834+0000 mon.a (mon.0) 1588 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:44:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:35 smithi163 bash[24253]: audit 2024-08-31T04:44:34.506217+0000 mgr.a (mgr.14388) 6630 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:44:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:36 smithi191 bash[24992]: cluster 2024-08-31T04:44:35.103791+0000 mgr.a (mgr.14388) 6631 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:36 smithi191 bash[24992]: audit 2024-08-31T04:44:35.333681+0000 mgr.a (mgr.14388) 6632 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:44:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:36 smithi191 bash[24992]: cephadm 2024-08-31T04:44:35.335081+0000 mgr.a (mgr.14388) 6633 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:44:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:36 smithi163 bash[24253]: cluster 2024-08-31T04:44:35.103791+0000 mgr.a (mgr.14388) 6631 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:36 smithi163 bash[24253]: audit 2024-08-31T04:44:35.333681+0000 mgr.a (mgr.14388) 6632 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:44:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:36 smithi163 bash[24253]: cephadm 2024-08-31T04:44:35.335081+0000 mgr.a (mgr.14388) 6633 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:44:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:36 smithi027 bash[22610]: cluster 2024-08-31T04:44:35.103791+0000 mgr.a (mgr.14388) 6631 : cluster [DBG] pgmap v4596: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:36 smithi027 bash[22610]: audit 2024-08-31T04:44:35.333681+0000 mgr.a (mgr.14388) 6632 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:44:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:36 smithi027 bash[22610]: cephadm 2024-08-31T04:44:35.335081+0000 mgr.a (mgr.14388) 6633 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:44:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:38 smithi191 bash[24992]: cluster 2024-08-31T04:44:37.104646+0000 mgr.a (mgr.14388) 6634 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:38 smithi163 bash[24253]: cluster 2024-08-31T04:44:37.104646+0000 mgr.a (mgr.14388) 6634 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:38 smithi027 bash[22610]: cluster 2024-08-31T04:44:37.104646+0000 mgr.a (mgr.14388) 6634 : cluster [DBG] pgmap v4597: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:39.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:44:39.644 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:44:39.644 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:40.381 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:40.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:40.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:40 smithi191 bash[24992]: cluster 2024-08-31T04:44:39.106931+0000 mgr.a (mgr.14388) 6635 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:40 smithi163 bash[24253]: cluster 2024-08-31T04:44:39.106931+0000 mgr.a (mgr.14388) 6635 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:40 smithi027 bash[22610]: cluster 2024-08-31T04:44:39.106931+0000 mgr.a (mgr.14388) 6635 : cluster [DBG] pgmap v4598: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:41 smithi191 bash[24992]: audit 2024-08-31T04:44:39.975442+0000 mgr.a (mgr.14388) 6636 : audit [DBG] from='client.151875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:41 smithi163 bash[24253]: audit 2024-08-31T04:44:39.975442+0000 mgr.a (mgr.14388) 6636 : audit [DBG] from='client.151875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:41.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:41 smithi027 bash[22610]: audit 2024-08-31T04:44:39.975442+0000 mgr.a (mgr.14388) 6636 : audit [DBG] from='client.151875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:42 smithi191 bash[24992]: cluster 2024-08-31T04:44:41.107915+0000 mgr.a (mgr.14388) 6637 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:42 smithi163 bash[24253]: cluster 2024-08-31T04:44:41.107915+0000 mgr.a (mgr.14388) 6637 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:42 smithi027 bash[22610]: cluster 2024-08-31T04:44:41.107915+0000 mgr.a (mgr.14388) 6637 : cluster [DBG] pgmap v4599: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:44 smithi163 bash[24253]: cluster 2024-08-31T04:44:43.110110+0000 mgr.a (mgr.14388) 6638 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:44.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:44 smithi027 bash[22610]: cluster 2024-08-31T04:44:43.110110+0000 mgr.a (mgr.14388) 6638 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:44 smithi191 bash[24992]: cluster 2024-08-31T04:44:43.110110+0000 mgr.a (mgr.14388) 6638 : cluster [DBG] pgmap v4600: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:45.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:44:45.383 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:44:45.383 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:46.141 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:46.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:46 smithi163 bash[24253]: cluster 2024-08-31T04:44:45.110914+0000 mgr.a (mgr.14388) 6639 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:46 smithi163 bash[24253]: audit 2024-08-31T04:44:45.718174+0000 mgr.a (mgr.14388) 6640 : audit [DBG] from='client.151953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:46.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:46 smithi027 bash[22610]: cluster 2024-08-31T04:44:45.110914+0000 mgr.a (mgr.14388) 6639 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:46 smithi027 bash[22610]: audit 2024-08-31T04:44:45.718174+0000 mgr.a (mgr.14388) 6640 : audit [DBG] from='client.151953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:46 smithi191 bash[24992]: cluster 2024-08-31T04:44:45.110914+0000 mgr.a (mgr.14388) 6639 : cluster [DBG] pgmap v4601: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:46 smithi191 bash[24992]: audit 2024-08-31T04:44:45.718174+0000 mgr.a (mgr.14388) 6640 : audit [DBG] from='client.151953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:48 smithi163 bash[24253]: cluster 2024-08-31T04:44:47.111837+0000 mgr.a (mgr.14388) 6641 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:48 smithi027 bash[22610]: cluster 2024-08-31T04:44:47.111837+0000 mgr.a (mgr.14388) 6641 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:48 smithi191 bash[24992]: cluster 2024-08-31T04:44:47.111837+0000 mgr.a (mgr.14388) 6641 : cluster [DBG] pgmap v4602: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:50 smithi163 bash[24253]: cluster 2024-08-31T04:44:49.114117+0000 mgr.a (mgr.14388) 6642 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:50 smithi027 bash[22610]: cluster 2024-08-31T04:44:49.114117+0000 mgr.a (mgr.14388) 6642 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:50 smithi191 bash[24992]: cluster 2024-08-31T04:44:49.114117+0000 mgr.a (mgr.14388) 6642 : cluster [DBG] pgmap v4603: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:44:51.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:44:51.144 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:44:51.144 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:51.926 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:51.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:51.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:51.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:51.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:52 smithi163 bash[24253]: cluster 2024-08-31T04:44:51.114918+0000 mgr.a (mgr.14388) 6643 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:52 smithi163 bash[24253]: audit 2024-08-31T04:44:51.478445+0000 mgr.a (mgr.14388) 6644 : audit [DBG] from='client.152028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:52 smithi027 bash[22610]: cluster 2024-08-31T04:44:51.114918+0000 mgr.a (mgr.14388) 6643 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:52 smithi027 bash[22610]: audit 2024-08-31T04:44:51.478445+0000 mgr.a (mgr.14388) 6644 : audit [DBG] from='client.152028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:52 smithi191 bash[24992]: cluster 2024-08-31T04:44:51.114918+0000 mgr.a (mgr.14388) 6643 : cluster [DBG] pgmap v4604: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:52 smithi191 bash[24992]: audit 2024-08-31T04:44:51.478445+0000 mgr.a (mgr.14388) 6644 : audit [DBG] from='client.152028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:54 smithi163 bash[24253]: cluster 2024-08-31T04:44:53.117173+0000 mgr.a (mgr.14388) 6645 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:54.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:54 smithi027 bash[22610]: cluster 2024-08-31T04:44:53.117173+0000 mgr.a (mgr.14388) 6645 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:54 smithi191 bash[24992]: cluster 2024-08-31T04:44:53.117173+0000 mgr.a (mgr.14388) 6645 : cluster [DBG] pgmap v4605: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:44:56.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:44:56.927 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:44:56.927 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:44:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:56 smithi163 bash[24253]: cluster 2024-08-31T04:44:55.118052+0000 mgr.a (mgr.14388) 6646 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:56 smithi027 bash[22610]: cluster 2024-08-31T04:44:55.118052+0000 mgr.a (mgr.14388) 6646 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:56 smithi191 bash[24992]: cluster 2024-08-31T04:44:55.118052+0000 mgr.a (mgr.14388) 6646 : cluster [DBG] pgmap v4606: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:57.672 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:44:57.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:44:57.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:44:57.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:44:57.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:44:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:58 smithi163 bash[24253]: cluster 2024-08-31T04:44:57.118953+0000 mgr.a (mgr.14388) 6647 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:44:58 smithi163 bash[24253]: audit 2024-08-31T04:44:57.258992+0000 mgr.a (mgr.14388) 6648 : audit [DBG] from='client.152106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:58 smithi027 bash[22610]: cluster 2024-08-31T04:44:57.118953+0000 mgr.a (mgr.14388) 6647 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:44:58 smithi027 bash[22610]: audit 2024-08-31T04:44:57.258992+0000 mgr.a (mgr.14388) 6648 : audit [DBG] from='client.152106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:44:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:58 smithi191 bash[24992]: cluster 2024-08-31T04:44:57.118953+0000 mgr.a (mgr.14388) 6647 : cluster [DBG] pgmap v4607: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:44:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:44:58 smithi191 bash[24992]: audit 2024-08-31T04:44:57.258992+0000 mgr.a (mgr.14388) 6648 : audit [DBG] from='client.152106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:00 smithi163 bash[24253]: cluster 2024-08-31T04:44:59.121216+0000 mgr.a (mgr.14388) 6649 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:00 smithi027 bash[22610]: cluster 2024-08-31T04:44:59.121216+0000 mgr.a (mgr.14388) 6649 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:00 smithi191 bash[24992]: cluster 2024-08-31T04:44:59.121216+0000 mgr.a (mgr.14388) 6649 : cluster [DBG] pgmap v4608: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:02.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:45:02.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:45:02.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:45:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:02 smithi163 bash[24253]: cluster 2024-08-31T04:45:01.122014+0000 mgr.a (mgr.14388) 6650 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:02 smithi027 bash[22610]: cluster 2024-08-31T04:45:01.122014+0000 mgr.a (mgr.14388) 6650 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:02 smithi191 bash[24992]: cluster 2024-08-31T04:45:01.122014+0000 mgr.a (mgr.14388) 6650 : cluster [DBG] pgmap v4609: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:03.427 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:45:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:45:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:45:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:45:03.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:45:04.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:04 smithi163 bash[24253]: audit 2024-08-31T04:45:03.013898+0000 mgr.a (mgr.14388) 6651 : audit [DBG] from='client.152181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:04.954 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:04 smithi163 bash[24253]: cluster 2024-08-31T04:45:03.123440+0000 mgr.a (mgr.14388) 6652 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:04 smithi027 bash[22610]: audit 2024-08-31T04:45:03.013898+0000 mgr.a (mgr.14388) 6651 : audit [DBG] from='client.152181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:04 smithi027 bash[22610]: cluster 2024-08-31T04:45:03.123440+0000 mgr.a (mgr.14388) 6652 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:04 smithi191 bash[24992]: audit 2024-08-31T04:45:03.013898+0000 mgr.a (mgr.14388) 6651 : audit [DBG] from='client.152181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:04 smithi191 bash[24992]: cluster 2024-08-31T04:45:03.123440+0000 mgr.a (mgr.14388) 6652 : cluster [DBG] pgmap v4610: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:06 smithi163 bash[24253]: cluster 2024-08-31T04:45:05.124273+0000 mgr.a (mgr.14388) 6653 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:45:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:06 smithi027 bash[22610]: cluster 2024-08-31T04:45:05.124273+0000 mgr.a (mgr.14388) 6653 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:45:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:06 smithi191 bash[24992]: cluster 2024-08-31T04:45:05.124273+0000 mgr.a (mgr.14388) 6653 : cluster [DBG] pgmap v4611: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:45:08.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:45:08.430 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:45:08.430 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:45:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:08 smithi163 bash[24253]: cluster 2024-08-31T04:45:07.125037+0000 mgr.a (mgr.14388) 6654 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:45:08.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:08 smithi027 bash[22610]: cluster 2024-08-31T04:45:07.125037+0000 mgr.a (mgr.14388) 6654 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:45:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:08 smithi191 bash[24992]: cluster 2024-08-31T04:45:07.125037+0000 mgr.a (mgr.14388) 6654 : cluster [DBG] pgmap v4612: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:45:09.208 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:45:09.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:45:09.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:45:09.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:45:09.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:45:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:09 smithi163 bash[24253]: audit 2024-08-31T04:45:08.771428+0000 mgr.a (mgr.14388) 6655 : audit [DBG] from='client.152256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:09.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:09 smithi027 bash[22610]: audit 2024-08-31T04:45:08.771428+0000 mgr.a (mgr.14388) 6655 : audit [DBG] from='client.152256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:09 smithi191 bash[24992]: audit 2024-08-31T04:45:08.771428+0000 mgr.a (mgr.14388) 6655 : audit [DBG] from='client.152256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:10 smithi163 bash[24253]: cluster 2024-08-31T04:45:09.126415+0000 mgr.a (mgr.14388) 6656 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:10 smithi027 bash[22610]: cluster 2024-08-31T04:45:09.126415+0000 mgr.a (mgr.14388) 6656 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:10 smithi191 bash[24992]: cluster 2024-08-31T04:45:09.126415+0000 mgr.a (mgr.14388) 6656 : cluster [DBG] pgmap v4613: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:12 smithi163 bash[24253]: cluster 2024-08-31T04:45:11.127328+0000 mgr.a (mgr.14388) 6657 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:45:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:12 smithi027 bash[22610]: cluster 2024-08-31T04:45:11.127328+0000 mgr.a (mgr.14388) 6657 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:45:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:12 smithi191 bash[24992]: cluster 2024-08-31T04:45:11.127328+0000 mgr.a (mgr.14388) 6657 : cluster [DBG] pgmap v4614: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:45:14.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:45:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:45:14.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:45:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:14 smithi163 bash[24253]: cluster 2024-08-31T04:45:13.129368+0000 mgr.a (mgr.14388) 6658 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:14 smithi027 bash[22610]: cluster 2024-08-31T04:45:13.129368+0000 mgr.a (mgr.14388) 6658 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:14 smithi191 bash[24992]: cluster 2024-08-31T04:45:13.129368+0000 mgr.a (mgr.14388) 6658 : cluster [DBG] pgmap v4615: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:14.960 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:45:14.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:45:14.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:45:14.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:45:14.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:45:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:15 smithi163 bash[24253]: audit 2024-08-31T04:45:14.543065+0000 mgr.a (mgr.14388) 6659 : audit [DBG] from='client.152334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:15 smithi027 bash[22610]: audit 2024-08-31T04:45:14.543065+0000 mgr.a (mgr.14388) 6659 : audit [DBG] from='client.152334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:15 smithi191 bash[24992]: audit 2024-08-31T04:45:14.543065+0000 mgr.a (mgr.14388) 6659 : audit [DBG] from='client.152334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:16 smithi163 bash[24253]: cluster 2024-08-31T04:45:15.130364+0000 mgr.a (mgr.14388) 6660 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:16 smithi027 bash[22610]: cluster 2024-08-31T04:45:15.130364+0000 mgr.a (mgr.14388) 6660 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:16 smithi191 bash[24992]: cluster 2024-08-31T04:45:15.130364+0000 mgr.a (mgr.14388) 6660 : cluster [DBG] pgmap v4616: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:18 smithi163 bash[24253]: cluster 2024-08-31T04:45:17.131162+0000 mgr.a (mgr.14388) 6661 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:18 smithi027 bash[22610]: cluster 2024-08-31T04:45:17.131162+0000 mgr.a (mgr.14388) 6661 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:18 smithi191 bash[24992]: cluster 2024-08-31T04:45:17.131162+0000 mgr.a (mgr.14388) 6661 : cluster [DBG] pgmap v4617: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:19.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:45:19.962 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:45:19.962 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:45:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:20 smithi163 bash[24253]: cluster 2024-08-31T04:45:19.133356+0000 mgr.a (mgr.14388) 6662 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:20.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:20 smithi027 bash[22610]: cluster 2024-08-31T04:45:19.133356+0000 mgr.a (mgr.14388) 6662 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:20 smithi191 bash[24992]: cluster 2024-08-31T04:45:19.133356+0000 mgr.a (mgr.14388) 6662 : cluster [DBG] pgmap v4618: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:20.734 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:45:20.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:45:20.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:45:20.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:45:20.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:45:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:21 smithi163 bash[24253]: audit 2024-08-31T04:45:20.299486+0000 mgr.a (mgr.14388) 6663 : audit [DBG] from='client.152409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:21.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:21 smithi027 bash[22610]: audit 2024-08-31T04:45:20.299486+0000 mgr.a (mgr.14388) 6663 : audit [DBG] from='client.152409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:21 smithi191 bash[24992]: audit 2024-08-31T04:45:20.299486+0000 mgr.a (mgr.14388) 6663 : audit [DBG] from='client.152409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:22 smithi163 bash[24253]: cluster 2024-08-31T04:45:21.134252+0000 mgr.a (mgr.14388) 6664 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:22.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:22 smithi027 bash[22610]: cluster 2024-08-31T04:45:21.134252+0000 mgr.a (mgr.14388) 6664 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:22 smithi191 bash[24992]: cluster 2024-08-31T04:45:21.134252+0000 mgr.a (mgr.14388) 6664 : cluster [DBG] pgmap v4619: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:24 smithi163 bash[24253]: cluster 2024-08-31T04:45:23.136458+0000 mgr.a (mgr.14388) 6665 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:24 smithi027 bash[22610]: cluster 2024-08-31T04:45:23.136458+0000 mgr.a (mgr.14388) 6665 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:24 smithi191 bash[24992]: cluster 2024-08-31T04:45:23.136458+0000 mgr.a (mgr.14388) 6665 : cluster [DBG] pgmap v4620: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:25.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:45:25.736 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:45:25.737 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:45:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:26 smithi163 bash[24253]: cluster 2024-08-31T04:45:25.137225+0000 mgr.a (mgr.14388) 6666 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:26.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:26 smithi027 bash[22610]: cluster 2024-08-31T04:45:25.137225+0000 mgr.a (mgr.14388) 6666 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:26.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:45:26.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:45:26.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:45:26.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:45:26.499 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:45:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:26 smithi191 bash[24992]: cluster 2024-08-31T04:45:25.137225+0000 mgr.a (mgr.14388) 6666 : cluster [DBG] pgmap v4621: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:27 smithi163 bash[24253]: audit 2024-08-31T04:45:26.067390+0000 mgr.a (mgr.14388) 6667 : audit [DBG] from='client.152487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:27 smithi027 bash[22610]: audit 2024-08-31T04:45:26.067390+0000 mgr.a (mgr.14388) 6667 : audit [DBG] from='client.152487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:27 smithi191 bash[24992]: audit 2024-08-31T04:45:26.067390+0000 mgr.a (mgr.14388) 6667 : audit [DBG] from='client.152487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:28 smithi027 bash[22610]: cluster 2024-08-31T04:45:27.138134+0000 mgr.a (mgr.14388) 6668 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:28 smithi191 bash[24992]: cluster 2024-08-31T04:45:27.138134+0000 mgr.a (mgr.14388) 6668 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:28 smithi163 bash[24253]: cluster 2024-08-31T04:45:27.138134+0000 mgr.a (mgr.14388) 6668 : cluster [DBG] pgmap v4622: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:30 smithi027 bash[22610]: cluster 2024-08-31T04:45:29.140390+0000 mgr.a (mgr.14388) 6669 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:30 smithi191 bash[24992]: cluster 2024-08-31T04:45:29.140390+0000 mgr.a (mgr.14388) 6669 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:30 smithi163 bash[24253]: cluster 2024-08-31T04:45:29.140390+0000 mgr.a (mgr.14388) 6669 : cluster [DBG] pgmap v4623: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:31.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:45:31.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:45:31.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:45:32.275 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:45:32.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:45:32.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:45:32.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:45:32.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:45:32.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:32 smithi027 bash[22610]: cluster 2024-08-31T04:45:31.141155+0000 mgr.a (mgr.14388) 6670 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:32 smithi191 bash[24992]: cluster 2024-08-31T04:45:31.141155+0000 mgr.a (mgr.14388) 6670 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:32 smithi163 bash[24253]: cluster 2024-08-31T04:45:31.141155+0000 mgr.a (mgr.14388) 6670 : cluster [DBG] pgmap v4624: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:33.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:33 smithi027 bash[22610]: audit 2024-08-31T04:45:31.841036+0000 mgr.a (mgr.14388) 6671 : audit [DBG] from='client.152562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:33 smithi191 bash[24992]: audit 2024-08-31T04:45:31.841036+0000 mgr.a (mgr.14388) 6671 : audit [DBG] from='client.152562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:33 smithi163 bash[24253]: audit 2024-08-31T04:45:31.841036+0000 mgr.a (mgr.14388) 6671 : audit [DBG] from='client.152562 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:34 smithi027 bash[22610]: cluster 2024-08-31T04:45:33.143417+0000 mgr.a (mgr.14388) 6672 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:34 smithi191 bash[24992]: cluster 2024-08-31T04:45:33.143417+0000 mgr.a (mgr.14388) 6672 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:34 smithi163 bash[24253]: cluster 2024-08-31T04:45:33.143417+0000 mgr.a (mgr.14388) 6672 : cluster [DBG] pgmap v4625: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:36.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:36 smithi027 bash[22610]: cluster 2024-08-31T04:45:35.144174+0000 mgr.a (mgr.14388) 6673 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:36 smithi027 bash[22610]: audit 2024-08-31T04:45:35.395552+0000 mon.a (mon.0) 1589 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:45:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:36 smithi191 bash[24992]: cluster 2024-08-31T04:45:35.144174+0000 mgr.a (mgr.14388) 6673 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:36 smithi191 bash[24992]: audit 2024-08-31T04:45:35.395552+0000 mon.a (mon.0) 1589 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:45:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:36 smithi163 bash[24253]: cluster 2024-08-31T04:45:35.144174+0000 mgr.a (mgr.14388) 6673 : cluster [DBG] pgmap v4626: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:36 smithi163 bash[24253]: audit 2024-08-31T04:45:35.395552+0000 mon.a (mon.0) 1589 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:45:37.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:45:37.278 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:45:37.278 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:45:37.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:45:36 smithi027 bash[22863]: debug 2024-08-31T04:45:36.985+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:45:37.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:45:36 smithi027 bash[22863]: debug 2024-08-31T04:45:36.985+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:45:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:37 smithi027 bash[22610]: audit 2024-08-31T04:45:36.230238+0000 mon.a (mon.0) 1590 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:45:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:37 smithi027 bash[22610]: audit 2024-08-31T04:45:36.231521+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:45:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:37 smithi027 bash[22610]: audit 2024-08-31T04:45:36.239785+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:45:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:37 smithi027 bash[22610]: audit 2024-08-31T04:45:36.242039+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:45:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:37 smithi027 bash[22610]: audit 2024-08-31T04:45:36.243019+0000 mgr.a (mgr.14388) 6674 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:45:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:37 smithi191 bash[24992]: audit 2024-08-31T04:45:36.230238+0000 mon.a (mon.0) 1590 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:45:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:37 smithi191 bash[24992]: audit 2024-08-31T04:45:36.231521+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:45:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:37 smithi191 bash[24992]: audit 2024-08-31T04:45:36.239785+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:45:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:37 smithi191 bash[24992]: audit 2024-08-31T04:45:36.242039+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:45:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:37 smithi191 bash[24992]: audit 2024-08-31T04:45:36.243019+0000 mgr.a (mgr.14388) 6674 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:45:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:37 smithi163 bash[24253]: audit 2024-08-31T04:45:36.230238+0000 mon.a (mon.0) 1590 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:45:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:37 smithi163 bash[24253]: audit 2024-08-31T04:45:36.231521+0000 mon.a (mon.0) 1591 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:45:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:37 smithi163 bash[24253]: audit 2024-08-31T04:45:36.239785+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:45:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:37 smithi163 bash[24253]: audit 2024-08-31T04:45:36.242039+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:45:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:37 smithi163 bash[24253]: audit 2024-08-31T04:45:36.243019+0000 mgr.a (mgr.14388) 6674 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:45:38.055 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:45:38.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:45:38.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:45:38.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:45:38.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:45:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:38 smithi191 bash[24992]: audit 2024-08-31T04:45:36.987124+0000 mgr.a (mgr.14388) 6675 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:45:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:38 smithi191 bash[24992]: cephadm 2024-08-31T04:45:36.988450+0000 mgr.a (mgr.14388) 6676 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:45:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:38 smithi191 bash[24992]: cluster 2024-08-31T04:45:37.144745+0000 mgr.a (mgr.14388) 6677 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:38 smithi191 bash[24992]: audit 2024-08-31T04:45:37.612013+0000 mgr.a (mgr.14388) 6678 : audit [DBG] from='client.152739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:38 smithi163 bash[24253]: audit 2024-08-31T04:45:36.987124+0000 mgr.a (mgr.14388) 6675 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:45:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:38 smithi163 bash[24253]: cephadm 2024-08-31T04:45:36.988450+0000 mgr.a (mgr.14388) 6676 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:45:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:38 smithi163 bash[24253]: cluster 2024-08-31T04:45:37.144745+0000 mgr.a (mgr.14388) 6677 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:38 smithi163 bash[24253]: audit 2024-08-31T04:45:37.612013+0000 mgr.a (mgr.14388) 6678 : audit [DBG] from='client.152739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:38 smithi027 bash[22610]: audit 2024-08-31T04:45:36.987124+0000 mgr.a (mgr.14388) 6675 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:45:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:38 smithi027 bash[22610]: cephadm 2024-08-31T04:45:36.988450+0000 mgr.a (mgr.14388) 6676 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:45:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:38 smithi027 bash[22610]: cluster 2024-08-31T04:45:37.144745+0000 mgr.a (mgr.14388) 6677 : cluster [DBG] pgmap v4627: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:38 smithi027 bash[22610]: audit 2024-08-31T04:45:37.612013+0000 mgr.a (mgr.14388) 6678 : audit [DBG] from='client.152739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:40 smithi191 bash[24992]: cluster 2024-08-31T04:45:39.147437+0000 mgr.a (mgr.14388) 6679 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:45:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:40 smithi163 bash[24253]: cluster 2024-08-31T04:45:39.147437+0000 mgr.a (mgr.14388) 6679 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:45:40.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:40 smithi027 bash[22610]: cluster 2024-08-31T04:45:39.147437+0000 mgr.a (mgr.14388) 6679 : cluster [DBG] pgmap v4628: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:45:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:42 smithi191 bash[24992]: cluster 2024-08-31T04:45:41.148246+0000 mgr.a (mgr.14388) 6680 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:45:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:42 smithi163 bash[24253]: cluster 2024-08-31T04:45:41.148246+0000 mgr.a (mgr.14388) 6680 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:45:42.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:42 smithi027 bash[22610]: cluster 2024-08-31T04:45:41.148246+0000 mgr.a (mgr.14388) 6680 : cluster [DBG] pgmap v4629: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:45:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:45:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:45:43.057 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:45:43.823 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:45:43.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:45:43.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:45:43.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:45:43.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:45:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:44 smithi191 bash[24992]: cluster 2024-08-31T04:45:43.149725+0000 mgr.a (mgr.14388) 6681 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:45:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:44 smithi191 bash[24992]: audit 2024-08-31T04:45:43.395470+0000 mgr.a (mgr.14388) 6682 : audit [DBG] from='client.152814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:44.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:44 smithi163 bash[24253]: cluster 2024-08-31T04:45:43.149725+0000 mgr.a (mgr.14388) 6681 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:45:44.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:44 smithi163 bash[24253]: audit 2024-08-31T04:45:43.395470+0000 mgr.a (mgr.14388) 6682 : audit [DBG] from='client.152814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:44 smithi027 bash[22610]: cluster 2024-08-31T04:45:43.149725+0000 mgr.a (mgr.14388) 6681 : cluster [DBG] pgmap v4630: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:45:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:44 smithi027 bash[22610]: audit 2024-08-31T04:45:43.395470+0000 mgr.a (mgr.14388) 6682 : audit [DBG] from='client.152814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:46 smithi191 bash[24992]: cluster 2024-08-31T04:45:45.150771+0000 mgr.a (mgr.14388) 6683 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:45:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:46 smithi163 bash[24253]: cluster 2024-08-31T04:45:45.150771+0000 mgr.a (mgr.14388) 6683 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:45:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:46 smithi027 bash[22610]: cluster 2024-08-31T04:45:45.150771+0000 mgr.a (mgr.14388) 6683 : cluster [DBG] pgmap v4631: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:45:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:48 smithi191 bash[24992]: cluster 2024-08-31T04:45:47.151692+0000 mgr.a (mgr.14388) 6684 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:45:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:48 smithi163 bash[24253]: cluster 2024-08-31T04:45:47.151692+0000 mgr.a (mgr.14388) 6684 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:45:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:48 smithi027 bash[22610]: cluster 2024-08-31T04:45:47.151692+0000 mgr.a (mgr.14388) 6684 : cluster [DBG] pgmap v4632: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:45:48.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:45:48.825 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:45:48.825 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:45:49.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:45:49.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:45:49.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:45:49.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:45:49.600 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:45:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:50 smithi191 bash[24992]: cluster 2024-08-31T04:45:49.154004+0000 mgr.a (mgr.14388) 6685 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:45:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:50 smithi191 bash[24992]: audit 2024-08-31T04:45:49.160154+0000 mgr.a (mgr.14388) 6686 : audit [DBG] from='client.152892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:50.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:50 smithi163 bash[24253]: cluster 2024-08-31T04:45:49.154004+0000 mgr.a (mgr.14388) 6685 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:45:50.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:50 smithi163 bash[24253]: audit 2024-08-31T04:45:49.160154+0000 mgr.a (mgr.14388) 6686 : audit [DBG] from='client.152892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:50.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:50 smithi027 bash[22610]: cluster 2024-08-31T04:45:49.154004+0000 mgr.a (mgr.14388) 6685 : cluster [DBG] pgmap v4633: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:45:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:50 smithi027 bash[22610]: audit 2024-08-31T04:45:49.160154+0000 mgr.a (mgr.14388) 6686 : audit [DBG] from='client.152892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:52 smithi191 bash[24992]: cluster 2024-08-31T04:45:51.154918+0000 mgr.a (mgr.14388) 6687 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:52 smithi163 bash[24253]: cluster 2024-08-31T04:45:51.154918+0000 mgr.a (mgr.14388) 6687 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:52.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:52 smithi027 bash[22610]: cluster 2024-08-31T04:45:51.154918+0000 mgr.a (mgr.14388) 6687 : cluster [DBG] pgmap v4634: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:54 smithi191 bash[24992]: cluster 2024-08-31T04:45:53.157095+0000 mgr.a (mgr.14388) 6688 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:54.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:45:54.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:45:54.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:45:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:54 smithi163 bash[24253]: cluster 2024-08-31T04:45:53.157095+0000 mgr.a (mgr.14388) 6688 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:54.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:54 smithi027 bash[22610]: cluster 2024-08-31T04:45:53.157095+0000 mgr.a (mgr.14388) 6688 : cluster [DBG] pgmap v4635: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:45:55.370 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:45:55.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:45:55.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:45:55.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:45:55.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:45:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:56 smithi191 bash[24992]: audit 2024-08-31T04:45:54.943677+0000 mgr.a (mgr.14388) 6689 : audit [DBG] from='client.152967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:56 smithi191 bash[24992]: cluster 2024-08-31T04:45:55.157663+0000 mgr.a (mgr.14388) 6690 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:56.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:56 smithi163 bash[24253]: audit 2024-08-31T04:45:54.943677+0000 mgr.a (mgr.14388) 6689 : audit [DBG] from='client.152967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:56.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:56 smithi163 bash[24253]: cluster 2024-08-31T04:45:55.157663+0000 mgr.a (mgr.14388) 6690 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:56.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:56 smithi027 bash[22610]: audit 2024-08-31T04:45:54.943677+0000 mgr.a (mgr.14388) 6689 : audit [DBG] from='client.152967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:45:56.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:56 smithi027 bash[22610]: cluster 2024-08-31T04:45:55.157663+0000 mgr.a (mgr.14388) 6690 : cluster [DBG] pgmap v4636: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:45:58 smithi191 bash[24992]: cluster 2024-08-31T04:45:57.158664+0000 mgr.a (mgr.14388) 6691 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:58.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:45:58 smithi163 bash[24253]: cluster 2024-08-31T04:45:57.158664+0000 mgr.a (mgr.14388) 6691 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:45:58.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:45:58 smithi027 bash[22610]: cluster 2024-08-31T04:45:57.158664+0000 mgr.a (mgr.14388) 6691 : cluster [DBG] pgmap v4637: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:00.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:00.372 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:00.372 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:00 smithi191 bash[24992]: cluster 2024-08-31T04:45:59.161074+0000 mgr.a (mgr.14388) 6692 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:00 smithi163 bash[24253]: cluster 2024-08-31T04:45:59.161074+0000 mgr.a (mgr.14388) 6692 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:00.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:00 smithi027 bash[22610]: cluster 2024-08-31T04:45:59.161074+0000 mgr.a (mgr.14388) 6692 : cluster [DBG] pgmap v4638: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:01.119 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:01.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:01 smithi163 bash[24253]: audit 2024-08-31T04:46:00.703594+0000 mgr.a (mgr.14388) 6693 : audit [DBG] from='client.153039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:01.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:01 smithi027 bash[22610]: audit 2024-08-31T04:46:00.703594+0000 mgr.a (mgr.14388) 6693 : audit [DBG] from='client.153039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:01 smithi191 bash[24992]: audit 2024-08-31T04:46:00.703594+0000 mgr.a (mgr.14388) 6693 : audit [DBG] from='client.153039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:02 smithi163 bash[24253]: cluster 2024-08-31T04:46:01.161644+0000 mgr.a (mgr.14388) 6694 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:02.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:02 smithi027 bash[22610]: cluster 2024-08-31T04:46:01.161644+0000 mgr.a (mgr.14388) 6694 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:02 smithi191 bash[24992]: cluster 2024-08-31T04:46:01.161644+0000 mgr.a (mgr.14388) 6694 : cluster [DBG] pgmap v4639: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:04 smithi163 bash[24253]: cluster 2024-08-31T04:46:03.163761+0000 mgr.a (mgr.14388) 6695 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:04.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:04 smithi027 bash[22610]: cluster 2024-08-31T04:46:03.163761+0000 mgr.a (mgr.14388) 6695 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:04 smithi191 bash[24992]: cluster 2024-08-31T04:46:03.163761+0000 mgr.a (mgr.14388) 6695 : cluster [DBG] pgmap v4640: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:06.121 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:06.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:06 smithi163 bash[24253]: cluster 2024-08-31T04:46:05.164544+0000 mgr.a (mgr.14388) 6696 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:06.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:06 smithi027 bash[22610]: cluster 2024-08-31T04:46:05.164544+0000 mgr.a (mgr.14388) 6696 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:06 smithi191 bash[24992]: cluster 2024-08-31T04:46:05.164544+0000 mgr.a (mgr.14388) 6696 : cluster [DBG] pgmap v4641: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:06.892 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:06.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:06.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:06.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:06.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:07.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:07 smithi163 bash[24253]: audit 2024-08-31T04:46:06.459785+0000 mgr.a (mgr.14388) 6697 : audit [DBG] from='client.153117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:07 smithi027 bash[22610]: audit 2024-08-31T04:46:06.459785+0000 mgr.a (mgr.14388) 6697 : audit [DBG] from='client.153117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:07 smithi191 bash[24992]: audit 2024-08-31T04:46:06.459785+0000 mgr.a (mgr.14388) 6697 : audit [DBG] from='client.153117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:08 smithi163 bash[24253]: cluster 2024-08-31T04:46:07.165406+0000 mgr.a (mgr.14388) 6698 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:08.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:08 smithi027 bash[22610]: cluster 2024-08-31T04:46:07.165406+0000 mgr.a (mgr.14388) 6698 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:08 smithi191 bash[24992]: cluster 2024-08-31T04:46:07.165406+0000 mgr.a (mgr.14388) 6698 : cluster [DBG] pgmap v4642: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:10.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:10 smithi163 bash[24253]: cluster 2024-08-31T04:46:09.167680+0000 mgr.a (mgr.14388) 6699 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:10.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:10 smithi027 bash[22610]: cluster 2024-08-31T04:46:09.167680+0000 mgr.a (mgr.14388) 6699 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:10 smithi191 bash[24992]: cluster 2024-08-31T04:46:09.167680+0000 mgr.a (mgr.14388) 6699 : cluster [DBG] pgmap v4643: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:11.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:11.897 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:11.897 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:12.642 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:12.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:12.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:12.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:12.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:12 smithi163 bash[24253]: cluster 2024-08-31T04:46:11.168465+0000 mgr.a (mgr.14388) 6700 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:12.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:12 smithi027 bash[22610]: cluster 2024-08-31T04:46:11.168465+0000 mgr.a (mgr.14388) 6700 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:12 smithi191 bash[24992]: cluster 2024-08-31T04:46:11.168465+0000 mgr.a (mgr.14388) 6700 : cluster [DBG] pgmap v4644: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:13 smithi163 bash[24253]: audit 2024-08-31T04:46:12.224185+0000 mgr.a (mgr.14388) 6701 : audit [DBG] from='client.153192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:13.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:13 smithi027 bash[22610]: audit 2024-08-31T04:46:12.224185+0000 mgr.a (mgr.14388) 6701 : audit [DBG] from='client.153192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:13 smithi191 bash[24992]: audit 2024-08-31T04:46:12.224185+0000 mgr.a (mgr.14388) 6701 : audit [DBG] from='client.153192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:14 smithi163 bash[24253]: cluster 2024-08-31T04:46:13.170808+0000 mgr.a (mgr.14388) 6702 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:14 smithi027 bash[22610]: cluster 2024-08-31T04:46:13.170808+0000 mgr.a (mgr.14388) 6702 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:14 smithi191 bash[24992]: cluster 2024-08-31T04:46:13.170808+0000 mgr.a (mgr.14388) 6702 : cluster [DBG] pgmap v4645: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:16.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:16 smithi163 bash[24253]: cluster 2024-08-31T04:46:15.171603+0000 mgr.a (mgr.14388) 6703 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:16 smithi027 bash[22610]: cluster 2024-08-31T04:46:15.171603+0000 mgr.a (mgr.14388) 6703 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:16 smithi191 bash[24992]: cluster 2024-08-31T04:46:15.171603+0000 mgr.a (mgr.14388) 6703 : cluster [DBG] pgmap v4646: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:17.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:17.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:18.406 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:18.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:18.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:18.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:18.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:18 smithi163 bash[24253]: cluster 2024-08-31T04:46:17.172384+0000 mgr.a (mgr.14388) 6704 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:18.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:18 smithi027 bash[22610]: cluster 2024-08-31T04:46:17.172384+0000 mgr.a (mgr.14388) 6704 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:18 smithi191 bash[24992]: cluster 2024-08-31T04:46:17.172384+0000 mgr.a (mgr.14388) 6704 : cluster [DBG] pgmap v4647: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:19 smithi163 bash[24253]: audit 2024-08-31T04:46:17.979808+0000 mgr.a (mgr.14388) 6705 : audit [DBG] from='client.153270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:19 smithi027 bash[22610]: audit 2024-08-31T04:46:17.979808+0000 mgr.a (mgr.14388) 6705 : audit [DBG] from='client.153270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:19 smithi191 bash[24992]: audit 2024-08-31T04:46:17.979808+0000 mgr.a (mgr.14388) 6705 : audit [DBG] from='client.153270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:20 smithi163 bash[24253]: cluster 2024-08-31T04:46:19.175222+0000 mgr.a (mgr.14388) 6706 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:20 smithi027 bash[22610]: cluster 2024-08-31T04:46:19.175222+0000 mgr.a (mgr.14388) 6706 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:20 smithi191 bash[24992]: cluster 2024-08-31T04:46:19.175222+0000 mgr.a (mgr.14388) 6706 : cluster [DBG] pgmap v4648: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:22 smithi163 bash[24253]: cluster 2024-08-31T04:46:21.176001+0000 mgr.a (mgr.14388) 6707 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:46:22.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:22 smithi027 bash[22610]: cluster 2024-08-31T04:46:21.176001+0000 mgr.a (mgr.14388) 6707 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:46:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:22 smithi191 bash[24992]: cluster 2024-08-31T04:46:21.176001+0000 mgr.a (mgr.14388) 6707 : cluster [DBG] pgmap v4649: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:46:23.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:23.408 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:24.183 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:24.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:24.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:24.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:24.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:24.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:24 smithi163 bash[24253]: cluster 2024-08-31T04:46:23.177920+0000 mgr.a (mgr.14388) 6708 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:24.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:24 smithi163 bash[24253]: audit 2024-08-31T04:46:23.745362+0000 mgr.a (mgr.14388) 6709 : audit [DBG] from='client.153345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:24.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:24 smithi027 bash[22610]: cluster 2024-08-31T04:46:23.177920+0000 mgr.a (mgr.14388) 6708 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:24 smithi027 bash[22610]: audit 2024-08-31T04:46:23.745362+0000 mgr.a (mgr.14388) 6709 : audit [DBG] from='client.153345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:24 smithi191 bash[24992]: cluster 2024-08-31T04:46:23.177920+0000 mgr.a (mgr.14388) 6708 : cluster [DBG] pgmap v4650: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:24 smithi191 bash[24992]: audit 2024-08-31T04:46:23.745362+0000 mgr.a (mgr.14388) 6709 : audit [DBG] from='client.153345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:26 smithi163 bash[24253]: cluster 2024-08-31T04:46:25.178890+0000 mgr.a (mgr.14388) 6710 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:46:26.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:26 smithi027 bash[22610]: cluster 2024-08-31T04:46:25.178890+0000 mgr.a (mgr.14388) 6710 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:46:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:26 smithi191 bash[24992]: cluster 2024-08-31T04:46:25.178890+0000 mgr.a (mgr.14388) 6710 : cluster [DBG] pgmap v4651: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:46:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:28 smithi163 bash[24253]: cluster 2024-08-31T04:46:27.179702+0000 mgr.a (mgr.14388) 6711 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:46:28.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:28 smithi027 bash[22610]: cluster 2024-08-31T04:46:27.179702+0000 mgr.a (mgr.14388) 6711 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:46:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:28 smithi191 bash[24992]: cluster 2024-08-31T04:46:27.179702+0000 mgr.a (mgr.14388) 6711 : cluster [DBG] pgmap v4652: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:46:29.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:29.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:29.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:29.932 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:29.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:29.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:29.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:29.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:30 smithi163 bash[24253]: cluster 2024-08-31T04:46:29.181970+0000 mgr.a (mgr.14388) 6712 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:30 smithi163 bash[24253]: audit 2024-08-31T04:46:29.519780+0000 mgr.a (mgr.14388) 6713 : audit [DBG] from='client.153420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:30 smithi027 bash[22610]: cluster 2024-08-31T04:46:29.181970+0000 mgr.a (mgr.14388) 6712 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:30 smithi027 bash[22610]: audit 2024-08-31T04:46:29.519780+0000 mgr.a (mgr.14388) 6713 : audit [DBG] from='client.153420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:30 smithi191 bash[24992]: cluster 2024-08-31T04:46:29.181970+0000 mgr.a (mgr.14388) 6712 : cluster [DBG] pgmap v4653: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:30 smithi191 bash[24992]: audit 2024-08-31T04:46:29.519780+0000 mgr.a (mgr.14388) 6713 : audit [DBG] from='client.153420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:32 smithi163 bash[24253]: cluster 2024-08-31T04:46:31.183089+0000 mgr.a (mgr.14388) 6714 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:32.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:32 smithi027 bash[22610]: cluster 2024-08-31T04:46:31.183089+0000 mgr.a (mgr.14388) 6714 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:32 smithi191 bash[24992]: cluster 2024-08-31T04:46:31.183089+0000 mgr.a (mgr.14388) 6714 : cluster [DBG] pgmap v4654: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:34 smithi163 bash[24253]: cluster 2024-08-31T04:46:33.185412+0000 mgr.a (mgr.14388) 6715 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:34 smithi027 bash[22610]: cluster 2024-08-31T04:46:33.185412+0000 mgr.a (mgr.14388) 6715 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:34 smithi191 bash[24992]: cluster 2024-08-31T04:46:33.185412+0000 mgr.a (mgr.14388) 6715 : cluster [DBG] pgmap v4655: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:34.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:34.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:34.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:35.722 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:35.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:35.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:35.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:35.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:36 smithi163 bash[24253]: cluster 2024-08-31T04:46:35.186283+0000 mgr.a (mgr.14388) 6716 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:36 smithi163 bash[24253]: audit 2024-08-31T04:46:35.278873+0000 mgr.a (mgr.14388) 6717 : audit [DBG] from='client.153498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:36.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:36 smithi027 bash[22610]: cluster 2024-08-31T04:46:35.186283+0000 mgr.a (mgr.14388) 6716 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:36 smithi027 bash[22610]: audit 2024-08-31T04:46:35.278873+0000 mgr.a (mgr.14388) 6717 : audit [DBG] from='client.153498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:36 smithi191 bash[24992]: cluster 2024-08-31T04:46:35.186283+0000 mgr.a (mgr.14388) 6716 : cluster [DBG] pgmap v4656: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:36 smithi191 bash[24992]: audit 2024-08-31T04:46:35.278873+0000 mgr.a (mgr.14388) 6717 : audit [DBG] from='client.153498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:37 smithi163 bash[24253]: audit 2024-08-31T04:46:37.040519+0000 mon.a (mon.0) 1594 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:46:37.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:37 smithi027 bash[22610]: audit 2024-08-31T04:46:37.040519+0000 mon.a (mon.0) 1594 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:46:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:37 smithi191 bash[24992]: audit 2024-08-31T04:46:37.040519+0000 mon.a (mon.0) 1594 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:46:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:38 smithi163 bash[24253]: cluster 2024-08-31T04:46:37.187302+0000 mgr.a (mgr.14388) 6718 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:38 smithi163 bash[24253]: audit 2024-08-31T04:46:37.865878+0000 mon.a (mon.0) 1595 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:46:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:38 smithi163 bash[24253]: audit 2024-08-31T04:46:37.867369+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:46:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:38 smithi163 bash[24253]: audit 2024-08-31T04:46:37.876689+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:46:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:38 smithi163 bash[24253]: audit 2024-08-31T04:46:37.879651+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:46:38.731 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:46:38 smithi027 bash[22863]: debug 2024-08-31T04:46:38.603+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:46:38.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:46:38 smithi027 bash[22863]: debug 2024-08-31T04:46:38.603+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:46:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:38 smithi027 bash[22610]: cluster 2024-08-31T04:46:37.187302+0000 mgr.a (mgr.14388) 6718 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:38 smithi027 bash[22610]: audit 2024-08-31T04:46:37.865878+0000 mon.a (mon.0) 1595 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:46:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:38 smithi027 bash[22610]: audit 2024-08-31T04:46:37.867369+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:46:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:38 smithi027 bash[22610]: audit 2024-08-31T04:46:37.876689+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:46:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:38 smithi027 bash[22610]: audit 2024-08-31T04:46:37.879651+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:46:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:38 smithi191 bash[24992]: cluster 2024-08-31T04:46:37.187302+0000 mgr.a (mgr.14388) 6718 : cluster [DBG] pgmap v4657: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:38 smithi191 bash[24992]: audit 2024-08-31T04:46:37.865878+0000 mon.a (mon.0) 1595 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:46:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:38 smithi191 bash[24992]: audit 2024-08-31T04:46:37.867369+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:46:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:38 smithi191 bash[24992]: audit 2024-08-31T04:46:37.876689+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:46:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:38 smithi191 bash[24992]: audit 2024-08-31T04:46:37.879651+0000 mon.a (mon.0) 1598 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:46:39.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:39 smithi163 bash[24253]: audit 2024-08-31T04:46:37.881989+0000 mgr.a (mgr.14388) 6719 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:46:39.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:39 smithi163 bash[24253]: audit 2024-08-31T04:46:38.609010+0000 mgr.a (mgr.14388) 6720 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:46:39.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:39 smithi163 bash[24253]: cephadm 2024-08-31T04:46:38.610277+0000 mgr.a (mgr.14388) 6721 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:46:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:39 smithi027 bash[22610]: audit 2024-08-31T04:46:37.881989+0000 mgr.a (mgr.14388) 6719 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:46:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:39 smithi027 bash[22610]: audit 2024-08-31T04:46:38.609010+0000 mgr.a (mgr.14388) 6720 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:46:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:39 smithi027 bash[22610]: cephadm 2024-08-31T04:46:38.610277+0000 mgr.a (mgr.14388) 6721 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:46:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:39 smithi191 bash[24992]: audit 2024-08-31T04:46:37.881989+0000 mgr.a (mgr.14388) 6719 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:46:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:39 smithi191 bash[24992]: audit 2024-08-31T04:46:38.609010+0000 mgr.a (mgr.14388) 6720 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:46:39.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:39 smithi191 bash[24992]: cephadm 2024-08-31T04:46:38.610277+0000 mgr.a (mgr.14388) 6721 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:46:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:40 smithi163 bash[24253]: cluster 2024-08-31T04:46:39.190218+0000 mgr.a (mgr.14388) 6722 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:40.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:40.724 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:40.724 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:40.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:40 smithi027 bash[22610]: cluster 2024-08-31T04:46:39.190218+0000 mgr.a (mgr.14388) 6722 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:40 smithi191 bash[24992]: cluster 2024-08-31T04:46:39.190218+0000 mgr.a (mgr.14388) 6722 : cluster [DBG] pgmap v4658: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:46:41.497 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:41.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:41.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:41.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:41.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:42 smithi163 bash[24253]: audit 2024-08-31T04:46:41.066509+0000 mgr.a (mgr.14388) 6723 : audit [DBG] from='client.153681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:42 smithi163 bash[24253]: cluster 2024-08-31T04:46:41.190797+0000 mgr.a (mgr.14388) 6724 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:42 smithi027 bash[22610]: audit 2024-08-31T04:46:41.066509+0000 mgr.a (mgr.14388) 6723 : audit [DBG] from='client.153681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:42 smithi027 bash[22610]: cluster 2024-08-31T04:46:41.190797+0000 mgr.a (mgr.14388) 6724 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:42 smithi191 bash[24992]: audit 2024-08-31T04:46:41.066509+0000 mgr.a (mgr.14388) 6723 : audit [DBG] from='client.153681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:42 smithi191 bash[24992]: cluster 2024-08-31T04:46:41.190797+0000 mgr.a (mgr.14388) 6724 : cluster [DBG] pgmap v4659: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:46:44.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:44 smithi163 bash[24253]: cluster 2024-08-31T04:46:43.192946+0000 mgr.a (mgr.14388) 6725 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:44.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:44 smithi027 bash[22610]: cluster 2024-08-31T04:46:43.192946+0000 mgr.a (mgr.14388) 6725 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:44 smithi191 bash[24992]: cluster 2024-08-31T04:46:43.192946+0000 mgr.a (mgr.14388) 6725 : cluster [DBG] pgmap v4660: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:46.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:46.500 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:46.500 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:46 smithi163 bash[24253]: cluster 2024-08-31T04:46:45.193744+0000 mgr.a (mgr.14388) 6726 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:46.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:46 smithi027 bash[22610]: cluster 2024-08-31T04:46:45.193744+0000 mgr.a (mgr.14388) 6726 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:46 smithi191 bash[24992]: cluster 2024-08-31T04:46:45.193744+0000 mgr.a (mgr.14388) 6726 : cluster [DBG] pgmap v4661: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:47.234 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:47.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:47.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:47.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:47.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:47 smithi163 bash[24253]: audit 2024-08-31T04:46:46.827157+0000 mgr.a (mgr.14388) 6727 : audit [DBG] from='client.153759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:47.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:47 smithi027 bash[22610]: audit 2024-08-31T04:46:46.827157+0000 mgr.a (mgr.14388) 6727 : audit [DBG] from='client.153759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:47 smithi191 bash[24992]: audit 2024-08-31T04:46:46.827157+0000 mgr.a (mgr.14388) 6727 : audit [DBG] from='client.153759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:48 smithi163 bash[24253]: cluster 2024-08-31T04:46:47.194482+0000 mgr.a (mgr.14388) 6728 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:48.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:48 smithi027 bash[22610]: cluster 2024-08-31T04:46:47.194482+0000 mgr.a (mgr.14388) 6728 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:48 smithi191 bash[24992]: cluster 2024-08-31T04:46:47.194482+0000 mgr.a (mgr.14388) 6728 : cluster [DBG] pgmap v4662: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:50.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:50 smithi163 bash[24253]: cluster 2024-08-31T04:46:49.196754+0000 mgr.a (mgr.14388) 6729 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:50.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:50 smithi027 bash[22610]: cluster 2024-08-31T04:46:49.196754+0000 mgr.a (mgr.14388) 6729 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:50 smithi191 bash[24992]: cluster 2024-08-31T04:46:49.196754+0000 mgr.a (mgr.14388) 6729 : cluster [DBG] pgmap v4663: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:52.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:52.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:52 smithi163 bash[24253]: cluster 2024-08-31T04:46:51.197542+0000 mgr.a (mgr.14388) 6730 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:52.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:52 smithi027 bash[22610]: cluster 2024-08-31T04:46:51.197542+0000 mgr.a (mgr.14388) 6730 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:52 smithi191 bash[24992]: cluster 2024-08-31T04:46:51.197542+0000 mgr.a (mgr.14388) 6730 : cluster [DBG] pgmap v4664: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:53.015 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:53.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:53.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:53.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:53.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:53 smithi163 bash[24253]: audit 2024-08-31T04:46:52.577538+0000 mgr.a (mgr.14388) 6731 : audit [DBG] from='client.153837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:53.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:53 smithi027 bash[22610]: audit 2024-08-31T04:46:52.577538+0000 mgr.a (mgr.14388) 6731 : audit [DBG] from='client.153837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:53 smithi191 bash[24992]: audit 2024-08-31T04:46:52.577538+0000 mgr.a (mgr.14388) 6731 : audit [DBG] from='client.153837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:54 smithi027 bash[22610]: cluster 2024-08-31T04:46:53.200311+0000 mgr.a (mgr.14388) 6732 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:54 smithi191 bash[24992]: cluster 2024-08-31T04:46:53.200311+0000 mgr.a (mgr.14388) 6732 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:54 smithi163 bash[24253]: cluster 2024-08-31T04:46:53.200311+0000 mgr.a (mgr.14388) 6732 : cluster [DBG] pgmap v4665: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:46:56.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:56 smithi027 bash[22610]: cluster 2024-08-31T04:46:55.201114+0000 mgr.a (mgr.14388) 6733 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:46:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:56 smithi191 bash[24992]: cluster 2024-08-31T04:46:55.201114+0000 mgr.a (mgr.14388) 6733 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:46:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:56 smithi163 bash[24253]: cluster 2024-08-31T04:46:55.201114+0000 mgr.a (mgr.14388) 6733 : cluster [DBG] pgmap v4666: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:46:58.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:46:58.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:46:58.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:46:58.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:58 smithi027 bash[22610]: cluster 2024-08-31T04:46:57.201891+0000 mgr.a (mgr.14388) 6734 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:46:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:58 smithi191 bash[24992]: cluster 2024-08-31T04:46:57.201891+0000 mgr.a (mgr.14388) 6734 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:46:58.790 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:46:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:46:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:46:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:46:58.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:46:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:58 smithi163 bash[24253]: cluster 2024-08-31T04:46:57.201891+0000 mgr.a (mgr.14388) 6734 : cluster [DBG] pgmap v4667: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:46:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:46:59 smithi027 bash[22610]: audit 2024-08-31T04:46:58.352761+0000 mgr.a (mgr.14388) 6735 : audit [DBG] from='client.153912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:46:59 smithi191 bash[24992]: audit 2024-08-31T04:46:58.352761+0000 mgr.a (mgr.14388) 6735 : audit [DBG] from='client.153912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:46:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:46:59 smithi163 bash[24253]: audit 2024-08-31T04:46:58.352761+0000 mgr.a (mgr.14388) 6735 : audit [DBG] from='client.153912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:00 smithi027 bash[22610]: cluster 2024-08-31T04:46:59.204919+0000 mgr.a (mgr.14388) 6736 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:00 smithi191 bash[24992]: cluster 2024-08-31T04:46:59.204919+0000 mgr.a (mgr.14388) 6736 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:00 smithi163 bash[24253]: cluster 2024-08-31T04:46:59.204919+0000 mgr.a (mgr.14388) 6736 : cluster [DBG] pgmap v4668: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:02 smithi027 bash[22610]: cluster 2024-08-31T04:47:01.205887+0000 mgr.a (mgr.14388) 6737 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:47:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:02 smithi191 bash[24992]: cluster 2024-08-31T04:47:01.205887+0000 mgr.a (mgr.14388) 6737 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:47:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:02 smithi163 bash[24253]: cluster 2024-08-31T04:47:01.205887+0000 mgr.a (mgr.14388) 6737 : cluster [DBG] pgmap v4669: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:47:03.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:47:03.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:47:03.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:47:04.575 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:47:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:47:04.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:47:04.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:47:04.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:47:04.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:04 smithi027 bash[22610]: cluster 2024-08-31T04:47:03.207886+0000 mgr.a (mgr.14388) 6738 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:04 smithi191 bash[24992]: cluster 2024-08-31T04:47:03.207886+0000 mgr.a (mgr.14388) 6738 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:04 smithi163 bash[24253]: cluster 2024-08-31T04:47:03.207886+0000 mgr.a (mgr.14388) 6738 : cluster [DBG] pgmap v4670: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:05 smithi191 bash[24992]: audit 2024-08-31T04:47:04.131508+0000 mgr.a (mgr.14388) 6739 : audit [DBG] from='client.153990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:05 smithi163 bash[24253]: audit 2024-08-31T04:47:04.131508+0000 mgr.a (mgr.14388) 6739 : audit [DBG] from='client.153990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:05 smithi027 bash[22610]: audit 2024-08-31T04:47:04.131508+0000 mgr.a (mgr.14388) 6739 : audit [DBG] from='client.153990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:06 smithi191 bash[24992]: cluster 2024-08-31T04:47:05.208958+0000 mgr.a (mgr.14388) 6740 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:47:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:06 smithi163 bash[24253]: cluster 2024-08-31T04:47:05.208958+0000 mgr.a (mgr.14388) 6740 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:47:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:06 smithi027 bash[22610]: cluster 2024-08-31T04:47:05.208958+0000 mgr.a (mgr.14388) 6740 : cluster [DBG] pgmap v4671: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:47:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:08 smithi191 bash[24992]: cluster 2024-08-31T04:47:07.209931+0000 mgr.a (mgr.14388) 6741 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:47:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:08 smithi163 bash[24253]: cluster 2024-08-31T04:47:07.209931+0000 mgr.a (mgr.14388) 6741 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:47:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:08 smithi027 bash[22610]: cluster 2024-08-31T04:47:07.209931+0000 mgr.a (mgr.14388) 6741 : cluster [DBG] pgmap v4672: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:47:09.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:47:09.578 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:47:09.578 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:47:10.347 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:47:10.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:47:10.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:47:10.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:47:10.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:47:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:10 smithi191 bash[24992]: cluster 2024-08-31T04:47:09.212335+0000 mgr.a (mgr.14388) 6742 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:47:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:10 smithi163 bash[24253]: cluster 2024-08-31T04:47:09.212335+0000 mgr.a (mgr.14388) 6742 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:47:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:10 smithi027 bash[22610]: cluster 2024-08-31T04:47:09.212335+0000 mgr.a (mgr.14388) 6742 : cluster [DBG] pgmap v4673: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:47:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:11 smithi191 bash[24992]: audit 2024-08-31T04:47:09.913592+0000 mgr.a (mgr.14388) 6743 : audit [DBG] from='client.154065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:11 smithi163 bash[24253]: audit 2024-08-31T04:47:09.913592+0000 mgr.a (mgr.14388) 6743 : audit [DBG] from='client.154065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:11 smithi027 bash[22610]: audit 2024-08-31T04:47:09.913592+0000 mgr.a (mgr.14388) 6743 : audit [DBG] from='client.154065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:12 smithi191 bash[24992]: cluster 2024-08-31T04:47:11.213326+0000 mgr.a (mgr.14388) 6744 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:12 smithi163 bash[24253]: cluster 2024-08-31T04:47:11.213326+0000 mgr.a (mgr.14388) 6744 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:12 smithi027 bash[22610]: cluster 2024-08-31T04:47:11.213326+0000 mgr.a (mgr.14388) 6744 : cluster [DBG] pgmap v4674: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:14 smithi191 bash[24992]: cluster 2024-08-31T04:47:13.215529+0000 mgr.a (mgr.14388) 6745 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:14 smithi163 bash[24253]: cluster 2024-08-31T04:47:13.215529+0000 mgr.a (mgr.14388) 6745 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:14 smithi027 bash[22610]: cluster 2024-08-31T04:47:13.215529+0000 mgr.a (mgr.14388) 6745 : cluster [DBG] pgmap v4675: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:15.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:47:15.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:47:15.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:47:16.110 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:47:16.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:47:16.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:47:16.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:47:16.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:47:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:16 smithi191 bash[24992]: cluster 2024-08-31T04:47:15.216299+0000 mgr.a (mgr.14388) 6746 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:16 smithi191 bash[24992]: audit 2024-08-31T04:47:15.684991+0000 mgr.a (mgr.14388) 6747 : audit [DBG] from='client.154143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:16 smithi163 bash[24253]: cluster 2024-08-31T04:47:15.216299+0000 mgr.a (mgr.14388) 6746 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:16 smithi163 bash[24253]: audit 2024-08-31T04:47:15.684991+0000 mgr.a (mgr.14388) 6747 : audit [DBG] from='client.154143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:16 smithi027 bash[22610]: cluster 2024-08-31T04:47:15.216299+0000 mgr.a (mgr.14388) 6746 : cluster [DBG] pgmap v4676: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:16 smithi027 bash[22610]: audit 2024-08-31T04:47:15.684991+0000 mgr.a (mgr.14388) 6747 : audit [DBG] from='client.154143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:18 smithi191 bash[24992]: cluster 2024-08-31T04:47:17.217447+0000 mgr.a (mgr.14388) 6748 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:18 smithi163 bash[24253]: cluster 2024-08-31T04:47:17.217447+0000 mgr.a (mgr.14388) 6748 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:18 smithi027 bash[22610]: cluster 2024-08-31T04:47:17.217447+0000 mgr.a (mgr.14388) 6748 : cluster [DBG] pgmap v4677: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:20 smithi191 bash[24992]: cluster 2024-08-31T04:47:19.219792+0000 mgr.a (mgr.14388) 6749 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:20 smithi163 bash[24253]: cluster 2024-08-31T04:47:19.219792+0000 mgr.a (mgr.14388) 6749 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:20 smithi027 bash[22610]: cluster 2024-08-31T04:47:19.219792+0000 mgr.a (mgr.14388) 6749 : cluster [DBG] pgmap v4678: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:21.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:47:21.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:47:21.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:47:21.888 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:47:21.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:47:21.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:47:21.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:47:21.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:47:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:22 smithi191 bash[24992]: cluster 2024-08-31T04:47:21.220207+0000 mgr.a (mgr.14388) 6750 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:22 smithi191 bash[24992]: audit 2024-08-31T04:47:21.448434+0000 mgr.a (mgr.14388) 6751 : audit [DBG] from='client.154221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:22.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:22 smithi163 bash[24253]: cluster 2024-08-31T04:47:21.220207+0000 mgr.a (mgr.14388) 6750 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:22.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:22 smithi163 bash[24253]: audit 2024-08-31T04:47:21.448434+0000 mgr.a (mgr.14388) 6751 : audit [DBG] from='client.154221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:22 smithi027 bash[22610]: cluster 2024-08-31T04:47:21.220207+0000 mgr.a (mgr.14388) 6750 : cluster [DBG] pgmap v4679: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:22 smithi027 bash[22610]: audit 2024-08-31T04:47:21.448434+0000 mgr.a (mgr.14388) 6751 : audit [DBG] from='client.154221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:24 smithi163 bash[24253]: cluster 2024-08-31T04:47:23.222438+0000 mgr.a (mgr.14388) 6752 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:24 smithi027 bash[22610]: cluster 2024-08-31T04:47:23.222438+0000 mgr.a (mgr.14388) 6752 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:24 smithi191 bash[24992]: cluster 2024-08-31T04:47:23.222438+0000 mgr.a (mgr.14388) 6752 : cluster [DBG] pgmap v4680: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:26.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:47:26.890 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:47:26.890 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:47:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:26 smithi163 bash[24253]: cluster 2024-08-31T04:47:25.223242+0000 mgr.a (mgr.14388) 6753 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:26 smithi027 bash[22610]: cluster 2024-08-31T04:47:25.223242+0000 mgr.a (mgr.14388) 6753 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:26 smithi191 bash[24992]: cluster 2024-08-31T04:47:25.223242+0000 mgr.a (mgr.14388) 6753 : cluster [DBG] pgmap v4681: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:27.673 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:47:27.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:47:27.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:47:27.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:47:27.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:47:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:28 smithi163 bash[24253]: cluster 2024-08-31T04:47:27.223986+0000 mgr.a (mgr.14388) 6754 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:28 smithi163 bash[24253]: audit 2024-08-31T04:47:27.229395+0000 mgr.a (mgr.14388) 6755 : audit [DBG] from='client.154293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:28 smithi027 bash[22610]: cluster 2024-08-31T04:47:27.223986+0000 mgr.a (mgr.14388) 6754 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:28 smithi027 bash[22610]: audit 2024-08-31T04:47:27.229395+0000 mgr.a (mgr.14388) 6755 : audit [DBG] from='client.154293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:28 smithi191 bash[24992]: cluster 2024-08-31T04:47:27.223986+0000 mgr.a (mgr.14388) 6754 : cluster [DBG] pgmap v4682: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:28 smithi191 bash[24992]: audit 2024-08-31T04:47:27.229395+0000 mgr.a (mgr.14388) 6755 : audit [DBG] from='client.154293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:30 smithi163 bash[24253]: cluster 2024-08-31T04:47:29.226373+0000 mgr.a (mgr.14388) 6756 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:30.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:30 smithi027 bash[22610]: cluster 2024-08-31T04:47:29.226373+0000 mgr.a (mgr.14388) 6756 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:30 smithi191 bash[24992]: cluster 2024-08-31T04:47:29.226373+0000 mgr.a (mgr.14388) 6756 : cluster [DBG] pgmap v4683: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:47:32.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:47:32.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:47:32.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:47:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:32 smithi163 bash[24253]: cluster 2024-08-31T04:47:31.227202+0000 mgr.a (mgr.14388) 6757 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:32.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:32 smithi027 bash[22610]: cluster 2024-08-31T04:47:31.227202+0000 mgr.a (mgr.14388) 6757 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:32 smithi191 bash[24992]: cluster 2024-08-31T04:47:31.227202+0000 mgr.a (mgr.14388) 6757 : cluster [DBG] pgmap v4684: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:33.456 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:47:33.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:47:33.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:47:33.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:47:33.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:47:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:34 smithi163 bash[24253]: audit 2024-08-31T04:47:33.011758+0000 mgr.a (mgr.14388) 6758 : audit [DBG] from='client.154371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:34 smithi163 bash[24253]: cluster 2024-08-31T04:47:33.228523+0000 mgr.a (mgr.14388) 6759 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:34.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:34 smithi027 bash[22610]: audit 2024-08-31T04:47:33.011758+0000 mgr.a (mgr.14388) 6758 : audit [DBG] from='client.154371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:35.069 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:34 smithi027 bash[22610]: cluster 2024-08-31T04:47:33.228523+0000 mgr.a (mgr.14388) 6759 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:35.070 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:34 smithi191 bash[24992]: audit 2024-08-31T04:47:33.011758+0000 mgr.a (mgr.14388) 6758 : audit [DBG] from='client.154371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:35.070 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:34 smithi191 bash[24992]: cluster 2024-08-31T04:47:33.228523+0000 mgr.a (mgr.14388) 6759 : cluster [DBG] pgmap v4685: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:36 smithi163 bash[24253]: cluster 2024-08-31T04:47:35.229432+0000 mgr.a (mgr.14388) 6760 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:47:36.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:36 smithi027 bash[22610]: cluster 2024-08-31T04:47:35.229432+0000 mgr.a (mgr.14388) 6760 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:47:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:36 smithi191 bash[24992]: cluster 2024-08-31T04:47:35.229432+0000 mgr.a (mgr.14388) 6760 : cluster [DBG] pgmap v4686: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:47:38.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:47:38.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:47:38.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:47:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:38 smithi163 bash[24253]: cluster 2024-08-31T04:47:37.230200+0000 mgr.a (mgr.14388) 6761 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:47:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:38 smithi027 bash[22610]: cluster 2024-08-31T04:47:37.230200+0000 mgr.a (mgr.14388) 6761 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:47:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:38 smithi191 bash[24992]: cluster 2024-08-31T04:47:37.230200+0000 mgr.a (mgr.14388) 6761 : cluster [DBG] pgmap v4687: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:47:39.212 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:47:39.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:47:39.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:47:39.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:47:39.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:47:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:39 smithi163 bash[24253]: audit 2024-08-31T04:47:38.661545+0000 mon.a (mon.0) 1599 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:47:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:39 smithi163 bash[24253]: audit 2024-08-31T04:47:38.791941+0000 mgr.a (mgr.14388) 6762 : audit [DBG] from='client.154449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:39 smithi163 bash[24253]: audit 2024-08-31T04:47:39.469215+0000 mon.a (mon.0) 1600 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:47:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:39 smithi163 bash[24253]: audit 2024-08-31T04:47:39.470689+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:47:39.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:39 smithi163 bash[24253]: audit 2024-08-31T04:47:39.477367+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:47:39.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:39 smithi163 bash[24253]: audit 2024-08-31T04:47:39.479836+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:47:39.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:39 smithi027 bash[22610]: audit 2024-08-31T04:47:38.661545+0000 mon.a (mon.0) 1599 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:47:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:39 smithi027 bash[22610]: audit 2024-08-31T04:47:38.791941+0000 mgr.a (mgr.14388) 6762 : audit [DBG] from='client.154449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:39 smithi027 bash[22610]: audit 2024-08-31T04:47:39.469215+0000 mon.a (mon.0) 1600 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:47:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:39 smithi027 bash[22610]: audit 2024-08-31T04:47:39.470689+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:47:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:39 smithi027 bash[22610]: audit 2024-08-31T04:47:39.477367+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:47:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:39 smithi027 bash[22610]: audit 2024-08-31T04:47:39.479836+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:47:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:39 smithi191 bash[24992]: audit 2024-08-31T04:47:38.661545+0000 mon.a (mon.0) 1599 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:47:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:39 smithi191 bash[24992]: audit 2024-08-31T04:47:38.791941+0000 mgr.a (mgr.14388) 6762 : audit [DBG] from='client.154449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:39 smithi191 bash[24992]: audit 2024-08-31T04:47:39.469215+0000 mon.a (mon.0) 1600 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:47:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:39 smithi191 bash[24992]: audit 2024-08-31T04:47:39.470689+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:47:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:39 smithi191 bash[24992]: audit 2024-08-31T04:47:39.477367+0000 mon.a (mon.0) 1602 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:47:40.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:39 smithi191 bash[24992]: audit 2024-08-31T04:47:39.479836+0000 mon.a (mon.0) 1603 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:47:40.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:47:40 smithi027 bash[22863]: debug 2024-08-31T04:47:40.197+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:47:40.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:47:40 smithi027 bash[22863]: debug 2024-08-31T04:47:40.197+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:47:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:40 smithi163 bash[24253]: cluster 2024-08-31T04:47:39.231598+0000 mgr.a (mgr.14388) 6763 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:40 smithi163 bash[24253]: audit 2024-08-31T04:47:39.482511+0000 mgr.a (mgr.14388) 6764 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:47:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:40 smithi027 bash[22610]: cluster 2024-08-31T04:47:39.231598+0000 mgr.a (mgr.14388) 6763 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:40 smithi027 bash[22610]: audit 2024-08-31T04:47:39.482511+0000 mgr.a (mgr.14388) 6764 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:47:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:40 smithi191 bash[24992]: cluster 2024-08-31T04:47:39.231598+0000 mgr.a (mgr.14388) 6763 : cluster [DBG] pgmap v4688: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:40 smithi191 bash[24992]: audit 2024-08-31T04:47:39.482511+0000 mgr.a (mgr.14388) 6764 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:47:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:41 smithi163 bash[24253]: audit 2024-08-31T04:47:40.199271+0000 mgr.a (mgr.14388) 6765 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:47:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:41 smithi163 bash[24253]: cephadm 2024-08-31T04:47:40.200594+0000 mgr.a (mgr.14388) 6766 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:47:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:41 smithi027 bash[22610]: audit 2024-08-31T04:47:40.199271+0000 mgr.a (mgr.14388) 6765 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:47:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:41 smithi027 bash[22610]: cephadm 2024-08-31T04:47:40.200594+0000 mgr.a (mgr.14388) 6766 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:47:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:41 smithi191 bash[24992]: audit 2024-08-31T04:47:40.199271+0000 mgr.a (mgr.14388) 6765 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:47:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:41 smithi191 bash[24992]: cephadm 2024-08-31T04:47:40.200594+0000 mgr.a (mgr.14388) 6766 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:47:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:42 smithi163 bash[24253]: cluster 2024-08-31T04:47:41.232487+0000 mgr.a (mgr.14388) 6767 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:47:42.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:42 smithi027 bash[22610]: cluster 2024-08-31T04:47:41.232487+0000 mgr.a (mgr.14388) 6767 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:47:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:42 smithi191 bash[24992]: cluster 2024-08-31T04:47:41.232487+0000 mgr.a (mgr.14388) 6767 : cluster [DBG] pgmap v4689: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:47:44.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:47:44.214 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:47:44.214 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:47:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:44 smithi163 bash[24253]: cluster 2024-08-31T04:47:43.234649+0000 mgr.a (mgr.14388) 6768 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:44.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:44 smithi027 bash[22610]: cluster 2024-08-31T04:47:43.234649+0000 mgr.a (mgr.14388) 6768 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:44.988 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:47:44.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:47:44.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:47:44.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:47:44.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:47:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:44 smithi191 bash[24992]: cluster 2024-08-31T04:47:43.234649+0000 mgr.a (mgr.14388) 6768 : cluster [DBG] pgmap v4690: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:45 smithi163 bash[24253]: audit 2024-08-31T04:47:44.549987+0000 mgr.a (mgr.14388) 6769 : audit [DBG] from='client.154635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:45 smithi027 bash[22610]: audit 2024-08-31T04:47:44.549987+0000 mgr.a (mgr.14388) 6769 : audit [DBG] from='client.154635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:45 smithi191 bash[24992]: audit 2024-08-31T04:47:44.549987+0000 mgr.a (mgr.14388) 6769 : audit [DBG] from='client.154635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:46 smithi163 bash[24253]: cluster 2024-08-31T04:47:45.235694+0000 mgr.a (mgr.14388) 6770 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:46.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:46 smithi027 bash[22610]: cluster 2024-08-31T04:47:45.235694+0000 mgr.a (mgr.14388) 6770 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:46 smithi191 bash[24992]: cluster 2024-08-31T04:47:45.235694+0000 mgr.a (mgr.14388) 6770 : cluster [DBG] pgmap v4691: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:48 smithi163 bash[24253]: cluster 2024-08-31T04:47:47.236498+0000 mgr.a (mgr.14388) 6771 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:48.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:48 smithi027 bash[22610]: cluster 2024-08-31T04:47:47.236498+0000 mgr.a (mgr.14388) 6771 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:48 smithi191 bash[24992]: cluster 2024-08-31T04:47:47.236498+0000 mgr.a (mgr.14388) 6771 : cluster [DBG] pgmap v4692: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:49.990 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:47:49.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:47:49.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:47:50.767 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:47:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:47:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:47:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:47:50.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:47:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:50 smithi163 bash[24253]: cluster 2024-08-31T04:47:49.238754+0000 mgr.a (mgr.14388) 6772 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:50 smithi027 bash[22610]: cluster 2024-08-31T04:47:49.238754+0000 mgr.a (mgr.14388) 6772 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:50 smithi191 bash[24992]: cluster 2024-08-31T04:47:49.238754+0000 mgr.a (mgr.14388) 6772 : cluster [DBG] pgmap v4693: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:51 smithi163 bash[24253]: audit 2024-08-31T04:47:50.326301+0000 mgr.a (mgr.14388) 6773 : audit [DBG] from='client.154713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:51.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:51 smithi027 bash[22610]: audit 2024-08-31T04:47:50.326301+0000 mgr.a (mgr.14388) 6773 : audit [DBG] from='client.154713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:51 smithi191 bash[24992]: audit 2024-08-31T04:47:50.326301+0000 mgr.a (mgr.14388) 6773 : audit [DBG] from='client.154713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:52 smithi163 bash[24253]: cluster 2024-08-31T04:47:51.239964+0000 mgr.a (mgr.14388) 6774 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:52 smithi027 bash[22610]: cluster 2024-08-31T04:47:51.239964+0000 mgr.a (mgr.14388) 6774 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:52 smithi191 bash[24992]: cluster 2024-08-31T04:47:51.239964+0000 mgr.a (mgr.14388) 6774 : cluster [DBG] pgmap v4694: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:54 smithi163 bash[24253]: cluster 2024-08-31T04:47:53.242333+0000 mgr.a (mgr.14388) 6775 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:54.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:54 smithi027 bash[22610]: cluster 2024-08-31T04:47:53.242333+0000 mgr.a (mgr.14388) 6775 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:54 smithi191 bash[24992]: cluster 2024-08-31T04:47:53.242333+0000 mgr.a (mgr.14388) 6775 : cluster [DBG] pgmap v4695: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:47:55.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:47:55.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:47:55.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:47:56.503 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:47:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:47:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:47:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:47:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:47:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:56 smithi163 bash[24253]: cluster 2024-08-31T04:47:55.243313+0000 mgr.a (mgr.14388) 6776 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:56 smithi027 bash[22610]: cluster 2024-08-31T04:47:55.243313+0000 mgr.a (mgr.14388) 6776 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:56 smithi191 bash[24992]: cluster 2024-08-31T04:47:55.243313+0000 mgr.a (mgr.14388) 6776 : cluster [DBG] pgmap v4696: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:57 smithi163 bash[24253]: audit 2024-08-31T04:47:56.097864+0000 mgr.a (mgr.14388) 6777 : audit [DBG] from='client.154788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:57.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:57 smithi027 bash[22610]: audit 2024-08-31T04:47:56.097864+0000 mgr.a (mgr.14388) 6777 : audit [DBG] from='client.154788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:57 smithi191 bash[24992]: audit 2024-08-31T04:47:56.097864+0000 mgr.a (mgr.14388) 6777 : audit [DBG] from='client.154788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:47:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:47:58 smithi163 bash[24253]: cluster 2024-08-31T04:47:57.244330+0000 mgr.a (mgr.14388) 6778 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:47:58 smithi027 bash[22610]: cluster 2024-08-31T04:47:57.244330+0000 mgr.a (mgr.14388) 6778 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:47:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:47:58 smithi191 bash[24992]: cluster 2024-08-31T04:47:57.244330+0000 mgr.a (mgr.14388) 6778 : cluster [DBG] pgmap v4697: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:00 smithi163 bash[24253]: cluster 2024-08-31T04:47:59.246557+0000 mgr.a (mgr.14388) 6779 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:00 smithi027 bash[22610]: cluster 2024-08-31T04:47:59.246557+0000 mgr.a (mgr.14388) 6779 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:00 smithi191 bash[24992]: cluster 2024-08-31T04:47:59.246557+0000 mgr.a (mgr.14388) 6779 : cluster [DBG] pgmap v4698: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:01.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:01.505 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:01.505 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:02.279 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:48:02.279 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:02 smithi163 bash[24253]: cluster 2024-08-31T04:48:01.247311+0000 mgr.a (mgr.14388) 6780 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:02 smithi163 bash[24253]: audit 2024-08-31T04:48:01.844957+0000 mgr.a (mgr.14388) 6781 : audit [DBG] from='client.154866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:02 smithi027 bash[22610]: cluster 2024-08-31T04:48:01.247311+0000 mgr.a (mgr.14388) 6780 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:02 smithi027 bash[22610]: audit 2024-08-31T04:48:01.844957+0000 mgr.a (mgr.14388) 6781 : audit [DBG] from='client.154866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:02 smithi191 bash[24992]: cluster 2024-08-31T04:48:01.247311+0000 mgr.a (mgr.14388) 6780 : cluster [DBG] pgmap v4699: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:02 smithi191 bash[24992]: audit 2024-08-31T04:48:01.844957+0000 mgr.a (mgr.14388) 6781 : audit [DBG] from='client.154866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:04 smithi163 bash[24253]: cluster 2024-08-31T04:48:03.249720+0000 mgr.a (mgr.14388) 6782 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:04.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:04 smithi027 bash[22610]: cluster 2024-08-31T04:48:03.249720+0000 mgr.a (mgr.14388) 6782 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:04 smithi191 bash[24992]: cluster 2024-08-31T04:48:03.249720+0000 mgr.a (mgr.14388) 6782 : cluster [DBG] pgmap v4700: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:06 smithi163 bash[24253]: cluster 2024-08-31T04:48:05.250523+0000 mgr.a (mgr.14388) 6783 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:06 smithi027 bash[22610]: cluster 2024-08-31T04:48:05.250523+0000 mgr.a (mgr.14388) 6783 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:06 smithi191 bash[24992]: cluster 2024-08-31T04:48:05.250523+0000 mgr.a (mgr.14388) 6783 : cluster [DBG] pgmap v4701: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:07.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:07.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:07.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:08.028 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:48:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:08 smithi163 bash[24253]: cluster 2024-08-31T04:48:07.251296+0000 mgr.a (mgr.14388) 6784 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:08 smithi163 bash[24253]: audit 2024-08-31T04:48:07.610254+0000 mgr.a (mgr.14388) 6785 : audit [DBG] from='client.154941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:08 smithi027 bash[22610]: cluster 2024-08-31T04:48:07.251296+0000 mgr.a (mgr.14388) 6784 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:08 smithi027 bash[22610]: audit 2024-08-31T04:48:07.610254+0000 mgr.a (mgr.14388) 6785 : audit [DBG] from='client.154941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:08 smithi191 bash[24992]: cluster 2024-08-31T04:48:07.251296+0000 mgr.a (mgr.14388) 6784 : cluster [DBG] pgmap v4702: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:08 smithi191 bash[24992]: audit 2024-08-31T04:48:07.610254+0000 mgr.a (mgr.14388) 6785 : audit [DBG] from='client.154941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:10 smithi163 bash[24253]: cluster 2024-08-31T04:48:09.254037+0000 mgr.a (mgr.14388) 6786 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:48:10.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:10 smithi027 bash[22610]: cluster 2024-08-31T04:48:09.254037+0000 mgr.a (mgr.14388) 6786 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:48:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:10 smithi191 bash[24992]: cluster 2024-08-31T04:48:09.254037+0000 mgr.a (mgr.14388) 6786 : cluster [DBG] pgmap v4703: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T04:48:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:12 smithi163 bash[24253]: cluster 2024-08-31T04:48:11.254894+0000 mgr.a (mgr.14388) 6787 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:48:12.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:12 smithi027 bash[22610]: cluster 2024-08-31T04:48:11.254894+0000 mgr.a (mgr.14388) 6787 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:48:13.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:13.030 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:13.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:12 smithi191 bash[24992]: cluster 2024-08-31T04:48:11.254894+0000 mgr.a (mgr.14388) 6787 : cluster [DBG] pgmap v4704: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T04:48:13.774 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:13.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:13.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:13.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:13.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:48:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:14 smithi163 bash[24253]: cluster 2024-08-31T04:48:13.256111+0000 mgr.a (mgr.14388) 6788 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:14 smithi163 bash[24253]: audit 2024-08-31T04:48:13.358693+0000 mgr.a (mgr.14388) 6789 : audit [DBG] from='client.155016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:14 smithi027 bash[22610]: cluster 2024-08-31T04:48:13.256111+0000 mgr.a (mgr.14388) 6788 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:14 smithi027 bash[22610]: audit 2024-08-31T04:48:13.358693+0000 mgr.a (mgr.14388) 6789 : audit [DBG] from='client.155016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:14 smithi191 bash[24992]: cluster 2024-08-31T04:48:13.256111+0000 mgr.a (mgr.14388) 6788 : cluster [DBG] pgmap v4705: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:14 smithi191 bash[24992]: audit 2024-08-31T04:48:13.358693+0000 mgr.a (mgr.14388) 6789 : audit [DBG] from='client.155016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:16 smithi163 bash[24253]: cluster 2024-08-31T04:48:15.256994+0000 mgr.a (mgr.14388) 6790 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:48:16.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:16 smithi027 bash[22610]: cluster 2024-08-31T04:48:15.256994+0000 mgr.a (mgr.14388) 6790 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:48:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:16 smithi191 bash[24992]: cluster 2024-08-31T04:48:15.256994+0000 mgr.a (mgr.14388) 6790 : cluster [DBG] pgmap v4706: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:48:18.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:18.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:18.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:18 smithi163 bash[24253]: cluster 2024-08-31T04:48:17.257771+0000 mgr.a (mgr.14388) 6791 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:48:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:18 smithi027 bash[22610]: cluster 2024-08-31T04:48:17.257771+0000 mgr.a (mgr.14388) 6791 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:48:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:18 smithi191 bash[24992]: cluster 2024-08-31T04:48:17.257771+0000 mgr.a (mgr.14388) 6791 : cluster [DBG] pgmap v4707: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:48:19.548 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:19.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:19.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:19.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:19.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:48:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:20 smithi163 bash[24253]: audit 2024-08-31T04:48:19.114007+0000 mgr.a (mgr.14388) 6792 : audit [DBG] from='client.155091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:20 smithi163 bash[24253]: cluster 2024-08-31T04:48:19.259130+0000 mgr.a (mgr.14388) 6793 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:20 smithi027 bash[22610]: audit 2024-08-31T04:48:19.114007+0000 mgr.a (mgr.14388) 6792 : audit [DBG] from='client.155091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:20 smithi027 bash[22610]: cluster 2024-08-31T04:48:19.259130+0000 mgr.a (mgr.14388) 6793 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:20 smithi191 bash[24992]: audit 2024-08-31T04:48:19.114007+0000 mgr.a (mgr.14388) 6792 : audit [DBG] from='client.155091 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:20 smithi191 bash[24992]: cluster 2024-08-31T04:48:19.259130+0000 mgr.a (mgr.14388) 6793 : cluster [DBG] pgmap v4708: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:22.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:22 smithi027 bash[22610]: cluster 2024-08-31T04:48:21.260035+0000 mgr.a (mgr.14388) 6794 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:48:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:22 smithi191 bash[24992]: cluster 2024-08-31T04:48:21.260035+0000 mgr.a (mgr.14388) 6794 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:48:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:22 smithi163 bash[24253]: cluster 2024-08-31T04:48:21.260035+0000 mgr.a (mgr.14388) 6794 : cluster [DBG] pgmap v4709: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T04:48:24.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:24.551 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:24.551 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:24 smithi027 bash[22610]: cluster 2024-08-31T04:48:23.262183+0000 mgr.a (mgr.14388) 6795 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:48:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:24 smithi191 bash[24992]: cluster 2024-08-31T04:48:23.262183+0000 mgr.a (mgr.14388) 6795 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:48:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:24 smithi163 bash[24253]: cluster 2024-08-31T04:48:23.262183+0000 mgr.a (mgr.14388) 6795 : cluster [DBG] pgmap v4710: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T04:48:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:25.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:48:25.284 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:26 smithi027 bash[22610]: audit 2024-08-31T04:48:24.876314+0000 mgr.a (mgr.14388) 6796 : audit [DBG] from='client.155166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:26 smithi027 bash[22610]: cluster 2024-08-31T04:48:25.262686+0000 mgr.a (mgr.14388) 6797 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:26 smithi191 bash[24992]: audit 2024-08-31T04:48:24.876314+0000 mgr.a (mgr.14388) 6796 : audit [DBG] from='client.155166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:26 smithi191 bash[24992]: cluster 2024-08-31T04:48:25.262686+0000 mgr.a (mgr.14388) 6797 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:26 smithi163 bash[24253]: audit 2024-08-31T04:48:24.876314+0000 mgr.a (mgr.14388) 6796 : audit [DBG] from='client.155166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:26 smithi163 bash[24253]: cluster 2024-08-31T04:48:25.262686+0000 mgr.a (mgr.14388) 6797 : cluster [DBG] pgmap v4711: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:28 smithi027 bash[22610]: cluster 2024-08-31T04:48:27.263578+0000 mgr.a (mgr.14388) 6798 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:28 smithi191 bash[24992]: cluster 2024-08-31T04:48:27.263578+0000 mgr.a (mgr.14388) 6798 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:28 smithi163 bash[24253]: cluster 2024-08-31T04:48:27.263578+0000 mgr.a (mgr.14388) 6798 : cluster [DBG] pgmap v4712: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:30.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:30.286 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:30.286 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:30.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:30 smithi027 bash[22610]: cluster 2024-08-31T04:48:29.265977+0000 mgr.a (mgr.14388) 6799 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:30 smithi191 bash[24992]: cluster 2024-08-31T04:48:29.265977+0000 mgr.a (mgr.14388) 6799 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:31.060 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:48:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:30 smithi163 bash[24253]: cluster 2024-08-31T04:48:29.265977+0000 mgr.a (mgr.14388) 6799 : cluster [DBG] pgmap v4713: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:31.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:31 smithi027 bash[22610]: audit 2024-08-31T04:48:30.623728+0000 mgr.a (mgr.14388) 6800 : audit [DBG] from='client.155244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:31 smithi191 bash[24992]: audit 2024-08-31T04:48:30.623728+0000 mgr.a (mgr.14388) 6800 : audit [DBG] from='client.155244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:31 smithi163 bash[24253]: audit 2024-08-31T04:48:30.623728+0000 mgr.a (mgr.14388) 6800 : audit [DBG] from='client.155244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:32 smithi027 bash[22610]: cluster 2024-08-31T04:48:31.266967+0000 mgr.a (mgr.14388) 6801 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:32 smithi191 bash[24992]: cluster 2024-08-31T04:48:31.266967+0000 mgr.a (mgr.14388) 6801 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:32 smithi163 bash[24253]: cluster 2024-08-31T04:48:31.266967+0000 mgr.a (mgr.14388) 6801 : cluster [DBG] pgmap v4714: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:34 smithi191 bash[24992]: cluster 2024-08-31T04:48:33.269246+0000 mgr.a (mgr.14388) 6802 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:34 smithi163 bash[24253]: cluster 2024-08-31T04:48:33.269246+0000 mgr.a (mgr.14388) 6802 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:34 smithi027 bash[22610]: cluster 2024-08-31T04:48:33.269246+0000 mgr.a (mgr.14388) 6802 : cluster [DBG] pgmap v4715: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:36.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:36.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:36.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:36.806 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:36.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:36.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:36.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:36.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:48:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:36 smithi191 bash[24992]: cluster 2024-08-31T04:48:35.270059+0000 mgr.a (mgr.14388) 6803 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:36 smithi163 bash[24253]: cluster 2024-08-31T04:48:35.270059+0000 mgr.a (mgr.14388) 6803 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:36 smithi027 bash[22610]: cluster 2024-08-31T04:48:35.270059+0000 mgr.a (mgr.14388) 6803 : cluster [DBG] pgmap v4716: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:37 smithi191 bash[24992]: audit 2024-08-31T04:48:36.399077+0000 mgr.a (mgr.14388) 6804 : audit [DBG] from='client.155322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:38.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:37 smithi163 bash[24253]: audit 2024-08-31T04:48:36.399077+0000 mgr.a (mgr.14388) 6804 : audit [DBG] from='client.155322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:38.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:37 smithi027 bash[22610]: audit 2024-08-31T04:48:36.399077+0000 mgr.a (mgr.14388) 6804 : audit [DBG] from='client.155322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:38 smithi191 bash[24992]: cluster 2024-08-31T04:48:37.271060+0000 mgr.a (mgr.14388) 6805 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:38 smithi163 bash[24253]: cluster 2024-08-31T04:48:37.271060+0000 mgr.a (mgr.14388) 6805 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:38 smithi027 bash[22610]: cluster 2024-08-31T04:48:37.271060+0000 mgr.a (mgr.14388) 6805 : cluster [DBG] pgmap v4717: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:40 smithi191 bash[24992]: cluster 2024-08-31T04:48:39.273308+0000 mgr.a (mgr.14388) 6806 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:40 smithi191 bash[24992]: audit 2024-08-31T04:48:40.252076+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:48:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:40 smithi163 bash[24253]: cluster 2024-08-31T04:48:39.273308+0000 mgr.a (mgr.14388) 6806 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:40 smithi163 bash[24253]: audit 2024-08-31T04:48:40.252076+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:48:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:40 smithi027 bash[22610]: cluster 2024-08-31T04:48:39.273308+0000 mgr.a (mgr.14388) 6806 : cluster [DBG] pgmap v4718: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:48:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:40 smithi027 bash[22610]: audit 2024-08-31T04:48:40.252076+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:48:41.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:41.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:41.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:41 smithi191 bash[24992]: audit 2024-08-31T04:48:41.091884+0000 mon.a (mon.0) 1605 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:48:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:41 smithi191 bash[24992]: audit 2024-08-31T04:48:41.093740+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:48:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:41 smithi191 bash[24992]: audit 2024-08-31T04:48:41.102785+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:48:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:41 smithi191 bash[24992]: audit 2024-08-31T04:48:41.107539+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:48:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:41 smithi163 bash[24253]: audit 2024-08-31T04:48:41.091884+0000 mon.a (mon.0) 1605 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:48:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:41 smithi163 bash[24253]: audit 2024-08-31T04:48:41.093740+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:48:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:41 smithi163 bash[24253]: audit 2024-08-31T04:48:41.102785+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:48:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:41 smithi163 bash[24253]: audit 2024-08-31T04:48:41.107539+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:48:42.231 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:48:41 smithi027 bash[22863]: debug 2024-08-31T04:48:41.832+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:48:42.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:48:41 smithi027 bash[22863]: debug 2024-08-31T04:48:41.836+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:48:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:41 smithi027 bash[22610]: audit 2024-08-31T04:48:41.091884+0000 mon.a (mon.0) 1605 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:48:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:41 smithi027 bash[22610]: audit 2024-08-31T04:48:41.093740+0000 mon.a (mon.0) 1606 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:48:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:41 smithi027 bash[22610]: audit 2024-08-31T04:48:41.102785+0000 mon.a (mon.0) 1607 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:48:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:41 smithi027 bash[22610]: audit 2024-08-31T04:48:41.107539+0000 mon.a (mon.0) 1608 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:48:42.543 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:42.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:42.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:42.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:42.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:48:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:42 smithi191 bash[24992]: audit 2024-08-31T04:48:41.109883+0000 mgr.a (mgr.14388) 6807 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:48:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:42 smithi191 bash[24992]: cluster 2024-08-31T04:48:41.273910+0000 mgr.a (mgr.14388) 6808 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:42 smithi191 bash[24992]: audit 2024-08-31T04:48:41.837799+0000 mgr.a (mgr.14388) 6809 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:48:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:42 smithi191 bash[24992]: cephadm 2024-08-31T04:48:41.839005+0000 mgr.a (mgr.14388) 6810 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:48:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:42 smithi163 bash[24253]: audit 2024-08-31T04:48:41.109883+0000 mgr.a (mgr.14388) 6807 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:48:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:42 smithi163 bash[24253]: cluster 2024-08-31T04:48:41.273910+0000 mgr.a (mgr.14388) 6808 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:42 smithi163 bash[24253]: audit 2024-08-31T04:48:41.837799+0000 mgr.a (mgr.14388) 6809 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:48:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:42 smithi163 bash[24253]: cephadm 2024-08-31T04:48:41.839005+0000 mgr.a (mgr.14388) 6810 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:48:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:42 smithi027 bash[22610]: audit 2024-08-31T04:48:41.109883+0000 mgr.a (mgr.14388) 6807 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:48:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:42 smithi027 bash[22610]: cluster 2024-08-31T04:48:41.273910+0000 mgr.a (mgr.14388) 6808 : cluster [DBG] pgmap v4719: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:48:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:42 smithi027 bash[22610]: audit 2024-08-31T04:48:41.837799+0000 mgr.a (mgr.14388) 6809 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:48:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:42 smithi027 bash[22610]: cephadm 2024-08-31T04:48:41.839005+0000 mgr.a (mgr.14388) 6810 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:48:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:43 smithi191 bash[24992]: audit 2024-08-31T04:48:42.122427+0000 mgr.a (mgr.14388) 6811 : audit [DBG] from='client.155502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:43 smithi163 bash[24253]: audit 2024-08-31T04:48:42.122427+0000 mgr.a (mgr.14388) 6811 : audit [DBG] from='client.155502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:43 smithi027 bash[22610]: audit 2024-08-31T04:48:42.122427+0000 mgr.a (mgr.14388) 6811 : audit [DBG] from='client.155502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:44 smithi191 bash[24992]: cluster 2024-08-31T04:48:43.276208+0000 mgr.a (mgr.14388) 6812 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:44 smithi163 bash[24253]: cluster 2024-08-31T04:48:43.276208+0000 mgr.a (mgr.14388) 6812 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:44 smithi027 bash[22610]: cluster 2024-08-31T04:48:43.276208+0000 mgr.a (mgr.14388) 6812 : cluster [DBG] pgmap v4720: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:46 smithi191 bash[24992]: cluster 2024-08-31T04:48:45.276988+0000 mgr.a (mgr.14388) 6813 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:46 smithi163 bash[24253]: cluster 2024-08-31T04:48:45.276988+0000 mgr.a (mgr.14388) 6813 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:46 smithi027 bash[22610]: cluster 2024-08-31T04:48:45.276988+0000 mgr.a (mgr.14388) 6813 : cluster [DBG] pgmap v4721: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:47.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:47.545 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:47.545 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:48.291 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:48.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:48:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:48 smithi191 bash[24992]: cluster 2024-08-31T04:48:47.277774+0000 mgr.a (mgr.14388) 6814 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:48 smithi163 bash[24253]: cluster 2024-08-31T04:48:47.277774+0000 mgr.a (mgr.14388) 6814 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:49.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:48 smithi027 bash[22610]: cluster 2024-08-31T04:48:47.277774+0000 mgr.a (mgr.14388) 6814 : cluster [DBG] pgmap v4722: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:49 smithi191 bash[24992]: audit 2024-08-31T04:48:47.880547+0000 mgr.a (mgr.14388) 6815 : audit [DBG] from='client.155577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:49 smithi163 bash[24253]: audit 2024-08-31T04:48:47.880547+0000 mgr.a (mgr.14388) 6815 : audit [DBG] from='client.155577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:50.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:49 smithi027 bash[22610]: audit 2024-08-31T04:48:47.880547+0000 mgr.a (mgr.14388) 6815 : audit [DBG] from='client.155577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:50 smithi163 bash[24253]: cluster 2024-08-31T04:48:49.280503+0000 mgr.a (mgr.14388) 6816 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:51.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:50 smithi027 bash[22610]: cluster 2024-08-31T04:48:49.280503+0000 mgr.a (mgr.14388) 6816 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:50 smithi191 bash[24992]: cluster 2024-08-31T04:48:49.280503+0000 mgr.a (mgr.14388) 6816 : cluster [DBG] pgmap v4723: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:52 smithi163 bash[24253]: cluster 2024-08-31T04:48:51.281290+0000 mgr.a (mgr.14388) 6817 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:48:53.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:52 smithi027 bash[22610]: cluster 2024-08-31T04:48:51.281290+0000 mgr.a (mgr.14388) 6817 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:48:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:52 smithi191 bash[24992]: cluster 2024-08-31T04:48:51.281290+0000 mgr.a (mgr.14388) 6817 : cluster [DBG] pgmap v4724: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:48:53.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:53.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:53.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:54.066 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:54.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:54.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:54.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:54.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:48:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:54 smithi163 bash[24253]: cluster 2024-08-31T04:48:53.283225+0000 mgr.a (mgr.14388) 6818 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:54 smithi163 bash[24253]: audit 2024-08-31T04:48:53.630437+0000 mgr.a (mgr.14388) 6819 : audit [DBG] from='client.155655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:55.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:54 smithi027 bash[22610]: cluster 2024-08-31T04:48:53.283225+0000 mgr.a (mgr.14388) 6818 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:54 smithi027 bash[22610]: audit 2024-08-31T04:48:53.630437+0000 mgr.a (mgr.14388) 6819 : audit [DBG] from='client.155655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:54 smithi191 bash[24992]: cluster 2024-08-31T04:48:53.283225+0000 mgr.a (mgr.14388) 6818 : cluster [DBG] pgmap v4725: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:48:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:54 smithi191 bash[24992]: audit 2024-08-31T04:48:53.630437+0000 mgr.a (mgr.14388) 6819 : audit [DBG] from='client.155655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:48:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:56 smithi163 bash[24253]: cluster 2024-08-31T04:48:55.284136+0000 mgr.a (mgr.14388) 6820 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:48:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:56 smithi027 bash[22610]: cluster 2024-08-31T04:48:55.284136+0000 mgr.a (mgr.14388) 6820 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:48:57.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:56 smithi191 bash[24992]: cluster 2024-08-31T04:48:55.284136+0000 mgr.a (mgr.14388) 6820 : cluster [DBG] pgmap v4726: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:48:59.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:48:59.068 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:48:59.069 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:48:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:48:58 smithi163 bash[24253]: cluster 2024-08-31T04:48:57.284937+0000 mgr.a (mgr.14388) 6821 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:48:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:48:58 smithi027 bash[22610]: cluster 2024-08-31T04:48:57.284937+0000 mgr.a (mgr.14388) 6821 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:48:59.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:48:58 smithi191 bash[24992]: cluster 2024-08-31T04:48:57.284937+0000 mgr.a (mgr.14388) 6821 : cluster [DBG] pgmap v4727: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:48:59.827 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:48:59.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:48:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:48:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:48:59.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:00 smithi163 bash[24253]: cluster 2024-08-31T04:48:59.287124+0000 mgr.a (mgr.14388) 6822 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:00 smithi163 bash[24253]: audit 2024-08-31T04:48:59.403377+0000 mgr.a (mgr.14388) 6823 : audit [DBG] from='client.155733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:00 smithi027 bash[22610]: cluster 2024-08-31T04:48:59.287124+0000 mgr.a (mgr.14388) 6822 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:00 smithi027 bash[22610]: audit 2024-08-31T04:48:59.403377+0000 mgr.a (mgr.14388) 6823 : audit [DBG] from='client.155733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:00 smithi191 bash[24992]: cluster 2024-08-31T04:48:59.287124+0000 mgr.a (mgr.14388) 6822 : cluster [DBG] pgmap v4728: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:00 smithi191 bash[24992]: audit 2024-08-31T04:48:59.403377+0000 mgr.a (mgr.14388) 6823 : audit [DBG] from='client.155733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:02 smithi163 bash[24253]: cluster 2024-08-31T04:49:01.287987+0000 mgr.a (mgr.14388) 6824 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:03.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:02 smithi027 bash[22610]: cluster 2024-08-31T04:49:01.287987+0000 mgr.a (mgr.14388) 6824 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:02 smithi191 bash[24992]: cluster 2024-08-31T04:49:01.287987+0000 mgr.a (mgr.14388) 6824 : cluster [DBG] pgmap v4729: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:04.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:49:04.829 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:49:04.830 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:49:05.205 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:04 smithi163 bash[24253]: cluster 2024-08-31T04:49:03.290169+0000 mgr.a (mgr.14388) 6825 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:04 smithi027 bash[22610]: cluster 2024-08-31T04:49:03.290169+0000 mgr.a (mgr.14388) 6825 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:04 smithi191 bash[24992]: cluster 2024-08-31T04:49:03.290169+0000 mgr.a (mgr.14388) 6825 : cluster [DBG] pgmap v4730: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:05.605 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:49:05.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:49:05.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:49:05.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:49:05.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:06 smithi163 bash[24253]: audit 2024-08-31T04:49:05.169019+0000 mgr.a (mgr.14388) 6826 : audit [DBG] from='client.155808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:06 smithi163 bash[24253]: cluster 2024-08-31T04:49:05.290681+0000 mgr.a (mgr.14388) 6827 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:07.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:06 smithi027 bash[22610]: audit 2024-08-31T04:49:05.169019+0000 mgr.a (mgr.14388) 6826 : audit [DBG] from='client.155808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:06 smithi027 bash[22610]: cluster 2024-08-31T04:49:05.290681+0000 mgr.a (mgr.14388) 6827 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:06 smithi191 bash[24992]: audit 2024-08-31T04:49:05.169019+0000 mgr.a (mgr.14388) 6826 : audit [DBG] from='client.155808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:06 smithi191 bash[24992]: cluster 2024-08-31T04:49:05.290681+0000 mgr.a (mgr.14388) 6827 : cluster [DBG] pgmap v4731: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:08 smithi163 bash[24253]: cluster 2024-08-31T04:49:07.291490+0000 mgr.a (mgr.14388) 6828 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:08 smithi027 bash[22610]: cluster 2024-08-31T04:49:07.291490+0000 mgr.a (mgr.14388) 6828 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:08 smithi191 bash[24992]: cluster 2024-08-31T04:49:07.291490+0000 mgr.a (mgr.14388) 6828 : cluster [DBG] pgmap v4732: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:10.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:49:10.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:49:10.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:49:10.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:10 smithi163 bash[24253]: cluster 2024-08-31T04:49:09.293731+0000 mgr.a (mgr.14388) 6829 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:10.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:10 smithi027 bash[22610]: cluster 2024-08-31T04:49:09.293731+0000 mgr.a (mgr.14388) 6829 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:10 smithi191 bash[24992]: cluster 2024-08-31T04:49:09.293731+0000 mgr.a (mgr.14388) 6829 : cluster [DBG] pgmap v4733: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:11.388 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:49:11.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:49:11.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:49:11.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:49:11.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:12 smithi163 bash[24253]: audit 2024-08-31T04:49:10.949620+0000 mgr.a (mgr.14388) 6830 : audit [DBG] from='client.155886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:12 smithi163 bash[24253]: cluster 2024-08-31T04:49:11.294324+0000 mgr.a (mgr.14388) 6831 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:12 smithi027 bash[22610]: audit 2024-08-31T04:49:10.949620+0000 mgr.a (mgr.14388) 6830 : audit [DBG] from='client.155886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:12 smithi027 bash[22610]: cluster 2024-08-31T04:49:11.294324+0000 mgr.a (mgr.14388) 6831 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:12 smithi191 bash[24992]: audit 2024-08-31T04:49:10.949620+0000 mgr.a (mgr.14388) 6830 : audit [DBG] from='client.155886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:12 smithi191 bash[24992]: cluster 2024-08-31T04:49:11.294324+0000 mgr.a (mgr.14388) 6831 : cluster [DBG] pgmap v4734: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:14 smithi163 bash[24253]: cluster 2024-08-31T04:49:13.296480+0000 mgr.a (mgr.14388) 6832 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:14.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:14 smithi027 bash[22610]: cluster 2024-08-31T04:49:13.296480+0000 mgr.a (mgr.14388) 6832 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:14 smithi191 bash[24992]: cluster 2024-08-31T04:49:13.296480+0000 mgr.a (mgr.14388) 6832 : cluster [DBG] pgmap v4735: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:16.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:49:16.390 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:49:16.390 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:49:16.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:16 smithi163 bash[24253]: cluster 2024-08-31T04:49:15.297230+0000 mgr.a (mgr.14388) 6833 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:16 smithi027 bash[22610]: cluster 2024-08-31T04:49:15.297230+0000 mgr.a (mgr.14388) 6833 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:16 smithi191 bash[24992]: cluster 2024-08-31T04:49:15.297230+0000 mgr.a (mgr.14388) 6833 : cluster [DBG] pgmap v4736: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:17.133 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:49:17.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:49:17.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:49:17.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:49:17.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:17 smithi163 bash[24253]: audit 2024-08-31T04:49:16.725915+0000 mgr.a (mgr.14388) 6834 : audit [DBG] from='client.155961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:17.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:17 smithi027 bash[22610]: audit 2024-08-31T04:49:16.725915+0000 mgr.a (mgr.14388) 6834 : audit [DBG] from='client.155961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:17 smithi191 bash[24992]: audit 2024-08-31T04:49:16.725915+0000 mgr.a (mgr.14388) 6834 : audit [DBG] from='client.155961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:18 smithi163 bash[24253]: cluster 2024-08-31T04:49:17.298165+0000 mgr.a (mgr.14388) 6835 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:18.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:18 smithi027 bash[22610]: cluster 2024-08-31T04:49:17.298165+0000 mgr.a (mgr.14388) 6835 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:18 smithi191 bash[24992]: cluster 2024-08-31T04:49:17.298165+0000 mgr.a (mgr.14388) 6835 : cluster [DBG] pgmap v4737: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:20 smithi163 bash[24253]: cluster 2024-08-31T04:49:19.300413+0000 mgr.a (mgr.14388) 6836 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:20 smithi027 bash[22610]: cluster 2024-08-31T04:49:19.300413+0000 mgr.a (mgr.14388) 6836 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:20.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:20 smithi191 bash[24992]: cluster 2024-08-31T04:49:19.300413+0000 mgr.a (mgr.14388) 6836 : cluster [DBG] pgmap v4738: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:22.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:49:22.136 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:49:22.136 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:49:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:22 smithi163 bash[24253]: cluster 2024-08-31T04:49:21.301159+0000 mgr.a (mgr.14388) 6837 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:22.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:22 smithi027 bash[22610]: cluster 2024-08-31T04:49:21.301159+0000 mgr.a (mgr.14388) 6837 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:22 smithi191 bash[24992]: cluster 2024-08-31T04:49:21.301159+0000 mgr.a (mgr.14388) 6837 : cluster [DBG] pgmap v4739: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:22.915 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:49:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:49:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:49:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:49:22.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:23 smithi163 bash[24253]: audit 2024-08-31T04:49:22.474106+0000 mgr.a (mgr.14388) 6838 : audit [DBG] from='client.156033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:23.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:23 smithi027 bash[22610]: audit 2024-08-31T04:49:22.474106+0000 mgr.a (mgr.14388) 6838 : audit [DBG] from='client.156033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:23 smithi191 bash[24992]: audit 2024-08-31T04:49:22.474106+0000 mgr.a (mgr.14388) 6838 : audit [DBG] from='client.156033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:24.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:24 smithi163 bash[24253]: cluster 2024-08-31T04:49:23.303544+0000 mgr.a (mgr.14388) 6839 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:49:24.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:24 smithi027 bash[22610]: cluster 2024-08-31T04:49:23.303544+0000 mgr.a (mgr.14388) 6839 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:49:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:24 smithi191 bash[24992]: cluster 2024-08-31T04:49:23.303544+0000 mgr.a (mgr.14388) 6839 : cluster [DBG] pgmap v4740: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T04:49:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:26 smithi163 bash[24253]: cluster 2024-08-31T04:49:25.304308+0000 mgr.a (mgr.14388) 6840 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:49:26.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:26 smithi027 bash[22610]: cluster 2024-08-31T04:49:25.304308+0000 mgr.a (mgr.14388) 6840 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:49:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:26 smithi191 bash[24992]: cluster 2024-08-31T04:49:25.304308+0000 mgr.a (mgr.14388) 6840 : cluster [DBG] pgmap v4741: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:49:27.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:49:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:49:27.921 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:49:28.693 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:49:28.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:49:28.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:49:28.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:49:28.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:28 smithi163 bash[24253]: cluster 2024-08-31T04:49:27.305061+0000 mgr.a (mgr.14388) 6841 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:49:28.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:28 smithi027 bash[22610]: cluster 2024-08-31T04:49:27.305061+0000 mgr.a (mgr.14388) 6841 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:49:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:28 smithi191 bash[24992]: cluster 2024-08-31T04:49:27.305061+0000 mgr.a (mgr.14388) 6841 : cluster [DBG] pgmap v4742: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T04:49:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:29 smithi163 bash[24253]: audit 2024-08-31T04:49:28.252974+0000 mgr.a (mgr.14388) 6842 : audit [DBG] from='client.156111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:29.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:29 smithi027 bash[22610]: audit 2024-08-31T04:49:28.252974+0000 mgr.a (mgr.14388) 6842 : audit [DBG] from='client.156111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:29 smithi191 bash[24992]: audit 2024-08-31T04:49:28.252974+0000 mgr.a (mgr.14388) 6842 : audit [DBG] from='client.156111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:30 smithi163 bash[24253]: cluster 2024-08-31T04:49:29.307789+0000 mgr.a (mgr.14388) 6843 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:30.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:30 smithi027 bash[22610]: cluster 2024-08-31T04:49:29.307789+0000 mgr.a (mgr.14388) 6843 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:30 smithi191 bash[24992]: cluster 2024-08-31T04:49:29.307789+0000 mgr.a (mgr.14388) 6843 : cluster [DBG] pgmap v4743: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:32 smithi163 bash[24253]: cluster 2024-08-31T04:49:31.308544+0000 mgr.a (mgr.14388) 6844 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:49:32.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:32 smithi027 bash[22610]: cluster 2024-08-31T04:49:31.308544+0000 mgr.a (mgr.14388) 6844 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:49:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:32 smithi191 bash[24992]: cluster 2024-08-31T04:49:31.308544+0000 mgr.a (mgr.14388) 6844 : cluster [DBG] pgmap v4744: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:49:33.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:49:33.695 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:49:33.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:49:34.443 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:49:34.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:49:34.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:49:34.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:49:34.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:34 smithi163 bash[24253]: cluster 2024-08-31T04:49:33.310449+0000 mgr.a (mgr.14388) 6845 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:34.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:34 smithi027 bash[22610]: cluster 2024-08-31T04:49:33.310449+0000 mgr.a (mgr.14388) 6845 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:34 smithi191 bash[24992]: cluster 2024-08-31T04:49:33.310449+0000 mgr.a (mgr.14388) 6845 : cluster [DBG] pgmap v4745: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:35 smithi163 bash[24253]: audit 2024-08-31T04:49:34.028473+0000 mgr.a (mgr.14388) 6846 : audit [DBG] from='client.156189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:35.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:35 smithi027 bash[22610]: audit 2024-08-31T04:49:34.028473+0000 mgr.a (mgr.14388) 6846 : audit [DBG] from='client.156189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:35 smithi191 bash[24992]: audit 2024-08-31T04:49:34.028473+0000 mgr.a (mgr.14388) 6846 : audit [DBG] from='client.156189 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:36 smithi163 bash[24253]: cluster 2024-08-31T04:49:35.311343+0000 mgr.a (mgr.14388) 6847 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:49:36.909 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:36 smithi191 bash[24992]: cluster 2024-08-31T04:49:35.311343+0000 mgr.a (mgr.14388) 6847 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:49:36.909 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:36 smithi027 bash[22610]: cluster 2024-08-31T04:49:35.311343+0000 mgr.a (mgr.14388) 6847 : cluster [DBG] pgmap v4746: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:49:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:38 smithi163 bash[24253]: cluster 2024-08-31T04:49:37.312290+0000 mgr.a (mgr.14388) 6848 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:49:38.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:38 smithi027 bash[22610]: cluster 2024-08-31T04:49:37.312290+0000 mgr.a (mgr.14388) 6848 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:49:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:38 smithi191 bash[24992]: cluster 2024-08-31T04:49:37.312290+0000 mgr.a (mgr.14388) 6848 : cluster [DBG] pgmap v4747: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T04:49:39.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:49:39.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:49:39.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:49:40.195 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:49:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:49:40.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:49:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:49:40.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:40 smithi163 bash[24253]: cluster 2024-08-31T04:49:39.314531+0000 mgr.a (mgr.14388) 6849 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:49:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:40 smithi163 bash[24253]: audit 2024-08-31T04:49:39.776333+0000 mgr.a (mgr.14388) 6850 : audit [DBG] from='client.156267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:40.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:40 smithi027 bash[22610]: cluster 2024-08-31T04:49:39.314531+0000 mgr.a (mgr.14388) 6849 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:49:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:40 smithi027 bash[22610]: audit 2024-08-31T04:49:39.776333+0000 mgr.a (mgr.14388) 6850 : audit [DBG] from='client.156267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:40 smithi191 bash[24992]: cluster 2024-08-31T04:49:39.314531+0000 mgr.a (mgr.14388) 6849 : cluster [DBG] pgmap v4748: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T04:49:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:40 smithi191 bash[24992]: audit 2024-08-31T04:49:39.776333+0000 mgr.a (mgr.14388) 6850 : audit [DBG] from='client.156267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:42 smithi027 bash[22610]: cluster 2024-08-31T04:49:41.315417+0000 mgr.a (mgr.14388) 6851 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:42 smithi027 bash[22610]: audit 2024-08-31T04:49:41.890123+0000 mon.a (mon.0) 1609 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:49:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:42 smithi191 bash[24992]: cluster 2024-08-31T04:49:41.315417+0000 mgr.a (mgr.14388) 6851 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:42 smithi191 bash[24992]: audit 2024-08-31T04:49:41.890123+0000 mon.a (mon.0) 1609 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:49:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:42 smithi163 bash[24253]: cluster 2024-08-31T04:49:41.315417+0000 mgr.a (mgr.14388) 6851 : cluster [DBG] pgmap v4749: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:42 smithi163 bash[24253]: audit 2024-08-31T04:49:41.890123+0000 mon.a (mon.0) 1609 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:49:44.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:44 smithi027 bash[22610]: cluster 2024-08-31T04:49:43.317594+0000 mgr.a (mgr.14388) 6852 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:44 smithi191 bash[24992]: cluster 2024-08-31T04:49:43.317594+0000 mgr.a (mgr.14388) 6852 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:44 smithi163 bash[24253]: cluster 2024-08-31T04:49:43.317594+0000 mgr.a (mgr.14388) 6852 : cluster [DBG] pgmap v4750: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:45.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:49:45.197 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:49:45.197 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:49:45.971 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:49:45.971 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:49:45.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:49:45.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:49:45.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:46 smithi027 bash[22610]: cluster 2024-08-31T04:49:45.318236+0000 mgr.a (mgr.14388) 6853 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:46 smithi027 bash[22610]: audit 2024-08-31T04:49:45.534829+0000 mgr.a (mgr.14388) 6854 : audit [DBG] from='client.156342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:46 smithi191 bash[24992]: cluster 2024-08-31T04:49:45.318236+0000 mgr.a (mgr.14388) 6853 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:46 smithi191 bash[24992]: audit 2024-08-31T04:49:45.534829+0000 mgr.a (mgr.14388) 6854 : audit [DBG] from='client.156342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:46.961 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:46 smithi163 bash[24253]: cluster 2024-08-31T04:49:45.318236+0000 mgr.a (mgr.14388) 6853 : cluster [DBG] pgmap v4751: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:46.961 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:46 smithi163 bash[24253]: audit 2024-08-31T04:49:45.534829+0000 mgr.a (mgr.14388) 6854 : audit [DBG] from='client.156342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:48.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: audit 2024-08-31T04:49:47.220929+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: audit 2024-08-31T04:49:47.225130+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: audit 2024-08-31T04:49:47.265223+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: audit 2024-08-31T04:49:47.271245+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: audit 2024-08-31T04:49:47.277476+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: audit 2024-08-31T04:49:47.284171+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: cluster 2024-08-31T04:49:47.318786+0000 mgr.a (mgr.14388) 6855 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: audit 2024-08-31T04:49:47.975361+0000 mon.a (mon.0) 1616 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:49:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: audit 2024-08-31T04:49:47.977140+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:49:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: audit 2024-08-31T04:49:47.987737+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22610]: audit 2024-08-31T04:49:47.992517+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:49:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: audit 2024-08-31T04:49:47.220929+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: audit 2024-08-31T04:49:47.225130+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: audit 2024-08-31T04:49:47.265223+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: audit 2024-08-31T04:49:47.271245+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: audit 2024-08-31T04:49:47.277476+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: audit 2024-08-31T04:49:47.284171+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: cluster 2024-08-31T04:49:47.318786+0000 mgr.a (mgr.14388) 6855 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:48.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: audit 2024-08-31T04:49:47.975361+0000 mon.a (mon.0) 1616 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:49:48.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: audit 2024-08-31T04:49:47.977140+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:49:48.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: audit 2024-08-31T04:49:47.987737+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:48 smithi191 bash[24992]: audit 2024-08-31T04:49:47.992517+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:49:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: audit 2024-08-31T04:49:47.220929+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: audit 2024-08-31T04:49:47.225130+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: audit 2024-08-31T04:49:47.265223+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: audit 2024-08-31T04:49:47.271245+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: audit 2024-08-31T04:49:47.277476+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: audit 2024-08-31T04:49:47.284171+0000 mon.a (mon.0) 1615 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: cluster 2024-08-31T04:49:47.318786+0000 mgr.a (mgr.14388) 6855 : cluster [DBG] pgmap v4752: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:48.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: audit 2024-08-31T04:49:47.975361+0000 mon.a (mon.0) 1616 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:49:48.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: audit 2024-08-31T04:49:47.977140+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:49:48.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: audit 2024-08-31T04:49:47.987737+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:49:48.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:48 smithi163 bash[24253]: audit 2024-08-31T04:49:47.992517+0000 mon.a (mon.0) 1619 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:49:48.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22863]: debug 2024-08-31T04:49:48.722+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:49:48.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:49:48 smithi027 bash[22863]: debug 2024-08-31T04:49:48.722+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:49:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:49 smithi191 bash[24992]: audit 2024-08-31T04:49:47.994810+0000 mgr.a (mgr.14388) 6856 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:49:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:49 smithi191 bash[24992]: audit 2024-08-31T04:49:48.723664+0000 mgr.a (mgr.14388) 6857 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:49:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:49 smithi191 bash[24992]: cephadm 2024-08-31T04:49:48.724904+0000 mgr.a (mgr.14388) 6858 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:49:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:49 smithi163 bash[24253]: audit 2024-08-31T04:49:47.994810+0000 mgr.a (mgr.14388) 6856 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:49:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:49 smithi163 bash[24253]: audit 2024-08-31T04:49:48.723664+0000 mgr.a (mgr.14388) 6857 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:49:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:49 smithi163 bash[24253]: cephadm 2024-08-31T04:49:48.724904+0000 mgr.a (mgr.14388) 6858 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:49:49.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:49 smithi027 bash[22610]: audit 2024-08-31T04:49:47.994810+0000 mgr.a (mgr.14388) 6856 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:49:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:49 smithi027 bash[22610]: audit 2024-08-31T04:49:48.723664+0000 mgr.a (mgr.14388) 6857 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:49:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:49 smithi027 bash[22610]: cephadm 2024-08-31T04:49:48.724904+0000 mgr.a (mgr.14388) 6858 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:49:50.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:50 smithi163 bash[24253]: cluster 2024-08-31T04:49:49.321429+0000 mgr.a (mgr.14388) 6859 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:50.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:50 smithi027 bash[22610]: cluster 2024-08-31T04:49:49.321429+0000 mgr.a (mgr.14388) 6859 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:50 smithi191 bash[24992]: cluster 2024-08-31T04:49:49.321429+0000 mgr.a (mgr.14388) 6859 : cluster [DBG] pgmap v4753: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:49:50.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:49:50.973 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:49:50.973 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:49:51.742 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:49:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:49:51.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:49:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:49:51.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:52 smithi163 bash[24253]: audit 2024-08-31T04:49:51.305488+0000 mgr.a (mgr.14388) 6860 : audit [DBG] from='client.156522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:52 smithi163 bash[24253]: cluster 2024-08-31T04:49:51.322642+0000 mgr.a (mgr.14388) 6861 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:52.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:52 smithi027 bash[22610]: audit 2024-08-31T04:49:51.305488+0000 mgr.a (mgr.14388) 6860 : audit [DBG] from='client.156522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:52 smithi027 bash[22610]: cluster 2024-08-31T04:49:51.322642+0000 mgr.a (mgr.14388) 6861 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:52 smithi191 bash[24992]: audit 2024-08-31T04:49:51.305488+0000 mgr.a (mgr.14388) 6860 : audit [DBG] from='client.156522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:52 smithi191 bash[24992]: cluster 2024-08-31T04:49:51.322642+0000 mgr.a (mgr.14388) 6861 : cluster [DBG] pgmap v4754: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:49:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:54 smithi163 bash[24253]: cluster 2024-08-31T04:49:53.325044+0000 mgr.a (mgr.14388) 6862 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:49:54.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:54 smithi027 bash[22610]: cluster 2024-08-31T04:49:53.325044+0000 mgr.a (mgr.14388) 6862 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:49:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:54 smithi191 bash[24992]: cluster 2024-08-31T04:49:53.325044+0000 mgr.a (mgr.14388) 6862 : cluster [DBG] pgmap v4755: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:49:56.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:56 smithi163 bash[24253]: cluster 2024-08-31T04:49:55.325847+0000 mgr.a (mgr.14388) 6863 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:49:56.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:56 smithi027 bash[22610]: cluster 2024-08-31T04:49:55.325847+0000 mgr.a (mgr.14388) 6863 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:49:56.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:49:56.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:49:56.745 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:49:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:56 smithi191 bash[24992]: cluster 2024-08-31T04:49:55.325847+0000 mgr.a (mgr.14388) 6863 : cluster [DBG] pgmap v4756: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:49:57.515 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:49:57.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:49:57.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:49:57.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:49:57.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:49:58.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:58 smithi163 bash[24253]: audit 2024-08-31T04:49:57.086282+0000 mgr.a (mgr.14388) 6864 : audit [DBG] from='client.156600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:58.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:49:58 smithi163 bash[24253]: cluster 2024-08-31T04:49:57.326439+0000 mgr.a (mgr.14388) 6865 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:49:58.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:58 smithi027 bash[22610]: audit 2024-08-31T04:49:57.086282+0000 mgr.a (mgr.14388) 6864 : audit [DBG] from='client.156600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:49:58 smithi027 bash[22610]: cluster 2024-08-31T04:49:57.326439+0000 mgr.a (mgr.14388) 6865 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:49:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:58 smithi191 bash[24992]: audit 2024-08-31T04:49:57.086282+0000 mgr.a (mgr.14388) 6864 : audit [DBG] from='client.156600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:49:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:49:58 smithi191 bash[24992]: cluster 2024-08-31T04:49:57.326439+0000 mgr.a (mgr.14388) 6865 : cluster [DBG] pgmap v4757: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:00 smithi163 bash[24253]: cluster 2024-08-31T04:49:59.328847+0000 mgr.a (mgr.14388) 6866 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:00 smithi163 bash[24253]: cluster 2024-08-31T04:50:00.000133+0000 mon.a (mon.0) 1620 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:50:00.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:00 smithi027 bash[22610]: cluster 2024-08-31T04:49:59.328847+0000 mgr.a (mgr.14388) 6866 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:00.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:00 smithi027 bash[22610]: cluster 2024-08-31T04:50:00.000133+0000 mon.a (mon.0) 1620 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:50:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:00 smithi191 bash[24992]: cluster 2024-08-31T04:49:59.328847+0000 mgr.a (mgr.14388) 6866 : cluster [DBG] pgmap v4758: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:00 smithi191 bash[24992]: cluster 2024-08-31T04:50:00.000133+0000 mon.a (mon.0) 1620 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T04:50:02.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:50:02.517 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:50:02.517 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:50:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:02 smithi163 bash[24253]: cluster 2024-08-31T04:50:01.329632+0000 mgr.a (mgr.14388) 6867 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:02.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:02 smithi027 bash[22610]: cluster 2024-08-31T04:50:01.329632+0000 mgr.a (mgr.14388) 6867 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:02 smithi191 bash[24992]: cluster 2024-08-31T04:50:01.329632+0000 mgr.a (mgr.14388) 6867 : cluster [DBG] pgmap v4759: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:03.276 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:50:03.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:50:03.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:50:03.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:50:03.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:50:03.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:03 smithi163 bash[24253]: audit 2024-08-31T04:50:02.856990+0000 mgr.a (mgr.14388) 6868 : audit [DBG] from='client.156678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:03.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:03 smithi027 bash[22610]: audit 2024-08-31T04:50:02.856990+0000 mgr.a (mgr.14388) 6868 : audit [DBG] from='client.156678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:03 smithi191 bash[24992]: audit 2024-08-31T04:50:02.856990+0000 mgr.a (mgr.14388) 6868 : audit [DBG] from='client.156678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:04 smithi163 bash[24253]: cluster 2024-08-31T04:50:03.330998+0000 mgr.a (mgr.14388) 6869 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:04.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:04 smithi027 bash[22610]: cluster 2024-08-31T04:50:03.330998+0000 mgr.a (mgr.14388) 6869 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:04 smithi191 bash[24992]: cluster 2024-08-31T04:50:03.330998+0000 mgr.a (mgr.14388) 6869 : cluster [DBG] pgmap v4760: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:06.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:06 smithi163 bash[24253]: cluster 2024-08-31T04:50:05.331716+0000 mgr.a (mgr.14388) 6870 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:06.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:06 smithi027 bash[22610]: cluster 2024-08-31T04:50:05.331716+0000 mgr.a (mgr.14388) 6870 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:06 smithi191 bash[24992]: cluster 2024-08-31T04:50:05.331716+0000 mgr.a (mgr.14388) 6870 : cluster [DBG] pgmap v4761: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:08.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:50:08.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:50:08.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:50:08.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:08 smithi027 bash[22610]: cluster 2024-08-31T04:50:07.332507+0000 mgr.a (mgr.14388) 6871 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:08 smithi191 bash[24992]: cluster 2024-08-31T04:50:07.332507+0000 mgr.a (mgr.14388) 6871 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:08 smithi163 bash[24253]: cluster 2024-08-31T04:50:07.332507+0000 mgr.a (mgr.14388) 6871 : cluster [DBG] pgmap v4762: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:09.067 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:50:09.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:50:09.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:50:09.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:50:09.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:50:09.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:09 smithi027 bash[22610]: audit 2024-08-31T04:50:08.619021+0000 mgr.a (mgr.14388) 6872 : audit [DBG] from='client.156753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:09 smithi191 bash[24992]: audit 2024-08-31T04:50:08.619021+0000 mgr.a (mgr.14388) 6872 : audit [DBG] from='client.156753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:09 smithi163 bash[24253]: audit 2024-08-31T04:50:08.619021+0000 mgr.a (mgr.14388) 6872 : audit [DBG] from='client.156753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:10.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:10 smithi027 bash[22610]: cluster 2024-08-31T04:50:09.335369+0000 mgr.a (mgr.14388) 6873 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:10 smithi191 bash[24992]: cluster 2024-08-31T04:50:09.335369+0000 mgr.a (mgr.14388) 6873 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:10.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:10 smithi163 bash[24253]: cluster 2024-08-31T04:50:09.335369+0000 mgr.a (mgr.14388) 6873 : cluster [DBG] pgmap v4763: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:12 smithi163 bash[24253]: cluster 2024-08-31T04:50:11.336288+0000 mgr.a (mgr.14388) 6874 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:50:12.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:12 smithi027 bash[22610]: cluster 2024-08-31T04:50:11.336288+0000 mgr.a (mgr.14388) 6874 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:50:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:12 smithi191 bash[24992]: cluster 2024-08-31T04:50:11.336288+0000 mgr.a (mgr.14388) 6874 : cluster [DBG] pgmap v4764: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:50:14.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:50:14.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:50:14.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:50:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:14 smithi163 bash[24253]: cluster 2024-08-31T04:50:13.338291+0000 mgr.a (mgr.14388) 6875 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:14.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:14 smithi027 bash[22610]: cluster 2024-08-31T04:50:13.338291+0000 mgr.a (mgr.14388) 6875 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:14 smithi191 bash[24992]: cluster 2024-08-31T04:50:13.338291+0000 mgr.a (mgr.14388) 6875 : cluster [DBG] pgmap v4765: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:14.858 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:50:14.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:50:14.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:50:14.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:50:14.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:50:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:15 smithi163 bash[24253]: audit 2024-08-31T04:50:14.410453+0000 mgr.a (mgr.14388) 6876 : audit [DBG] from='client.156831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:15.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:15 smithi027 bash[22610]: audit 2024-08-31T04:50:14.410453+0000 mgr.a (mgr.14388) 6876 : audit [DBG] from='client.156831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:15 smithi191 bash[24992]: audit 2024-08-31T04:50:14.410453+0000 mgr.a (mgr.14388) 6876 : audit [DBG] from='client.156831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:16.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:16 smithi163 bash[24253]: cluster 2024-08-31T04:50:15.339304+0000 mgr.a (mgr.14388) 6877 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:16.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:16 smithi027 bash[22610]: cluster 2024-08-31T04:50:15.339304+0000 mgr.a (mgr.14388) 6877 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:16 smithi191 bash[24992]: cluster 2024-08-31T04:50:15.339304+0000 mgr.a (mgr.14388) 6877 : cluster [DBG] pgmap v4766: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:18 smithi163 bash[24253]: cluster 2024-08-31T04:50:17.340113+0000 mgr.a (mgr.14388) 6878 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:18.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:18 smithi027 bash[22610]: cluster 2024-08-31T04:50:17.340113+0000 mgr.a (mgr.14388) 6878 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:18 smithi191 bash[24992]: cluster 2024-08-31T04:50:17.340113+0000 mgr.a (mgr.14388) 6878 : cluster [DBG] pgmap v4767: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:19.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:50:19.860 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:50:19.860 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:50:20.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:50:20.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:50:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:20 smithi163 bash[24253]: cluster 2024-08-31T04:50:19.342365+0000 mgr.a (mgr.14388) 6879 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:20 smithi027 bash[22610]: cluster 2024-08-31T04:50:19.342365+0000 mgr.a (mgr.14388) 6879 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:20 smithi191 bash[24992]: cluster 2024-08-31T04:50:19.342365+0000 mgr.a (mgr.14388) 6879 : cluster [DBG] pgmap v4768: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:21 smithi163 bash[24253]: audit 2024-08-31T04:50:20.188975+0000 mgr.a (mgr.14388) 6880 : audit [DBG] from='client.156906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:21.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:21 smithi027 bash[22610]: audit 2024-08-31T04:50:20.188975+0000 mgr.a (mgr.14388) 6880 : audit [DBG] from='client.156906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:21 smithi191 bash[24992]: audit 2024-08-31T04:50:20.188975+0000 mgr.a (mgr.14388) 6880 : audit [DBG] from='client.156906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:22 smithi163 bash[24253]: cluster 2024-08-31T04:50:21.343361+0000 mgr.a (mgr.14388) 6881 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:22.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:22 smithi027 bash[22610]: cluster 2024-08-31T04:50:21.343361+0000 mgr.a (mgr.14388) 6881 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:22 smithi191 bash[24992]: cluster 2024-08-31T04:50:21.343361+0000 mgr.a (mgr.14388) 6881 : cluster [DBG] pgmap v4769: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:24.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:24 smithi163 bash[24253]: cluster 2024-08-31T04:50:23.345537+0000 mgr.a (mgr.14388) 6882 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:24.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:24 smithi027 bash[22610]: cluster 2024-08-31T04:50:23.345537+0000 mgr.a (mgr.14388) 6882 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:24 smithi191 bash[24992]: cluster 2024-08-31T04:50:23.345537+0000 mgr.a (mgr.14388) 6882 : cluster [DBG] pgmap v4770: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:25.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:50:25.609 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:50:25.609 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:50:26.384 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:50:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:50:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:50:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:50:26.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:50:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:26 smithi163 bash[24253]: cluster 2024-08-31T04:50:25.346300+0000 mgr.a (mgr.14388) 6883 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:26.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:26 smithi027 bash[22610]: cluster 2024-08-31T04:50:25.346300+0000 mgr.a (mgr.14388) 6883 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:26 smithi191 bash[24992]: cluster 2024-08-31T04:50:25.346300+0000 mgr.a (mgr.14388) 6883 : cluster [DBG] pgmap v4771: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:27 smithi163 bash[24253]: audit 2024-08-31T04:50:25.949675+0000 mgr.a (mgr.14388) 6884 : audit [DBG] from='client.156984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:27.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:27 smithi027 bash[22610]: audit 2024-08-31T04:50:25.949675+0000 mgr.a (mgr.14388) 6884 : audit [DBG] from='client.156984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:27 smithi191 bash[24992]: audit 2024-08-31T04:50:25.949675+0000 mgr.a (mgr.14388) 6884 : audit [DBG] from='client.156984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:28 smithi163 bash[24253]: cluster 2024-08-31T04:50:27.347341+0000 mgr.a (mgr.14388) 6885 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:28.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:28 smithi027 bash[22610]: cluster 2024-08-31T04:50:27.347341+0000 mgr.a (mgr.14388) 6885 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:28 smithi191 bash[24992]: cluster 2024-08-31T04:50:27.347341+0000 mgr.a (mgr.14388) 6885 : cluster [DBG] pgmap v4772: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:30 smithi027 bash[22610]: cluster 2024-08-31T04:50:29.349734+0000 mgr.a (mgr.14388) 6886 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:30 smithi191 bash[24992]: cluster 2024-08-31T04:50:29.349734+0000 mgr.a (mgr.14388) 6886 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:30 smithi163 bash[24253]: cluster 2024-08-31T04:50:29.349734+0000 mgr.a (mgr.14388) 6886 : cluster [DBG] pgmap v4773: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:31.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:50:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:50:31.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:50:32.155 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:50:32.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:50:32.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:50:32.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:50:32.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:50:32.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:32 smithi027 bash[22610]: cluster 2024-08-31T04:50:31.350546+0000 mgr.a (mgr.14388) 6887 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:32 smithi027 bash[22610]: audit 2024-08-31T04:50:31.721787+0000 mgr.a (mgr.14388) 6888 : audit [DBG] from='client.157062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:32 smithi191 bash[24992]: cluster 2024-08-31T04:50:31.350546+0000 mgr.a (mgr.14388) 6887 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:32 smithi191 bash[24992]: audit 2024-08-31T04:50:31.721787+0000 mgr.a (mgr.14388) 6888 : audit [DBG] from='client.157062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:32 smithi163 bash[24253]: cluster 2024-08-31T04:50:31.350546+0000 mgr.a (mgr.14388) 6887 : cluster [DBG] pgmap v4774: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:32 smithi163 bash[24253]: audit 2024-08-31T04:50:31.721787+0000 mgr.a (mgr.14388) 6888 : audit [DBG] from='client.157062 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:34.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:34 smithi027 bash[22610]: cluster 2024-08-31T04:50:33.352871+0000 mgr.a (mgr.14388) 6889 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:34 smithi191 bash[24992]: cluster 2024-08-31T04:50:33.352871+0000 mgr.a (mgr.14388) 6889 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:34 smithi163 bash[24253]: cluster 2024-08-31T04:50:33.352871+0000 mgr.a (mgr.14388) 6889 : cluster [DBG] pgmap v4775: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:36.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:36 smithi027 bash[22610]: cluster 2024-08-31T04:50:35.353669+0000 mgr.a (mgr.14388) 6890 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:36 smithi191 bash[24992]: cluster 2024-08-31T04:50:35.353669+0000 mgr.a (mgr.14388) 6890 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:36 smithi163 bash[24253]: cluster 2024-08-31T04:50:35.353669+0000 mgr.a (mgr.14388) 6890 : cluster [DBG] pgmap v4776: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:50:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:50:37.158 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:50:37.903 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:50:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:50:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:50:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:50:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:50:38.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:38 smithi027 bash[22610]: cluster 2024-08-31T04:50:37.354381+0000 mgr.a (mgr.14388) 6891 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:38 smithi027 bash[22610]: audit 2024-08-31T04:50:37.491950+0000 mgr.a (mgr.14388) 6892 : audit [DBG] from='client.157140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:38 smithi191 bash[24992]: cluster 2024-08-31T04:50:37.354381+0000 mgr.a (mgr.14388) 6891 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:38 smithi191 bash[24992]: audit 2024-08-31T04:50:37.491950+0000 mgr.a (mgr.14388) 6892 : audit [DBG] from='client.157140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:38 smithi163 bash[24253]: cluster 2024-08-31T04:50:37.354381+0000 mgr.a (mgr.14388) 6891 : cluster [DBG] pgmap v4777: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:38 smithi163 bash[24253]: audit 2024-08-31T04:50:37.491950+0000 mgr.a (mgr.14388) 6892 : audit [DBG] from='client.157140 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:40.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:40 smithi027 bash[22610]: cluster 2024-08-31T04:50:39.356761+0000 mgr.a (mgr.14388) 6893 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:40 smithi191 bash[24992]: cluster 2024-08-31T04:50:39.356761+0000 mgr.a (mgr.14388) 6893 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:40 smithi163 bash[24253]: cluster 2024-08-31T04:50:39.356761+0000 mgr.a (mgr.14388) 6893 : cluster [DBG] pgmap v4778: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:50:42.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:42 smithi027 bash[22610]: cluster 2024-08-31T04:50:41.357555+0000 mgr.a (mgr.14388) 6894 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:42 smithi191 bash[24992]: cluster 2024-08-31T04:50:41.357555+0000 mgr.a (mgr.14388) 6894 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:42.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:50:42.905 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:50:42.905 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:50:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:42 smithi163 bash[24253]: cluster 2024-08-31T04:50:41.357555+0000 mgr.a (mgr.14388) 6894 : cluster [DBG] pgmap v4779: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:43.689 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:50:43.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:50:43.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:50:43.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:50:43.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:50:44.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:44 smithi027 bash[22610]: audit 2024-08-31T04:50:43.244593+0000 mgr.a (mgr.14388) 6895 : audit [DBG] from='client.157218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:44 smithi027 bash[22610]: cluster 2024-08-31T04:50:43.358887+0000 mgr.a (mgr.14388) 6896 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:44 smithi191 bash[24992]: audit 2024-08-31T04:50:43.244593+0000 mgr.a (mgr.14388) 6895 : audit [DBG] from='client.157218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:44 smithi191 bash[24992]: cluster 2024-08-31T04:50:43.358887+0000 mgr.a (mgr.14388) 6896 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:44 smithi163 bash[24253]: audit 2024-08-31T04:50:43.244593+0000 mgr.a (mgr.14388) 6895 : audit [DBG] from='client.157218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:44 smithi163 bash[24253]: cluster 2024-08-31T04:50:43.358887+0000 mgr.a (mgr.14388) 6896 : cluster [DBG] pgmap v4780: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:46 smithi191 bash[24992]: cluster 2024-08-31T04:50:45.359744+0000 mgr.a (mgr.14388) 6897 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:46 smithi163 bash[24253]: cluster 2024-08-31T04:50:45.359744+0000 mgr.a (mgr.14388) 6897 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:46.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:46 smithi027 bash[22610]: cluster 2024-08-31T04:50:45.359744+0000 mgr.a (mgr.14388) 6897 : cluster [DBG] pgmap v4781: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:48.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:50:48.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:50:48.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:50:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:48 smithi191 bash[24992]: cluster 2024-08-31T04:50:47.360533+0000 mgr.a (mgr.14388) 6898 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:48 smithi163 bash[24253]: cluster 2024-08-31T04:50:47.360533+0000 mgr.a (mgr.14388) 6898 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:48.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:48 smithi027 bash[22610]: cluster 2024-08-31T04:50:47.360533+0000 mgr.a (mgr.14388) 6898 : cluster [DBG] pgmap v4782: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:50:49.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:50:49.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:50:49.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:50:49.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:50:49.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:50:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:49 smithi191 bash[24992]: audit 2024-08-31T04:50:48.776162+0000 mon.a (mon.0) 1621 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:50:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:49 smithi163 bash[24253]: audit 2024-08-31T04:50:48.776162+0000 mon.a (mon.0) 1621 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:50:49.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:49 smithi027 bash[22610]: audit 2024-08-31T04:50:48.776162+0000 mon.a (mon.0) 1621 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:50:50.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:50:50 smithi027 bash[22863]: debug 2024-08-31T04:50:50.297+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:50:50.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:50:50 smithi027 bash[22863]: debug 2024-08-31T04:50:50.297+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:50:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:50 smithi027 bash[22610]: audit 2024-08-31T04:50:49.046955+0000 mgr.a (mgr.14388) 6899 : audit [DBG] from='client.157293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:50 smithi027 bash[22610]: cluster 2024-08-31T04:50:49.364477+0000 mgr.a (mgr.14388) 6900 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:50 smithi027 bash[22610]: audit 2024-08-31T04:50:49.569871+0000 mon.a (mon.0) 1622 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:50:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:50 smithi027 bash[22610]: audit 2024-08-31T04:50:49.570992+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:50:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:50 smithi027 bash[22610]: audit 2024-08-31T04:50:49.580706+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:50:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:50 smithi027 bash[22610]: audit 2024-08-31T04:50:49.583504+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:50:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:50 smithi027 bash[22610]: audit 2024-08-31T04:50:49.586111+0000 mgr.a (mgr.14388) 6901 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:50:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:50 smithi191 bash[24992]: audit 2024-08-31T04:50:49.046955+0000 mgr.a (mgr.14388) 6899 : audit [DBG] from='client.157293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:50 smithi191 bash[24992]: cluster 2024-08-31T04:50:49.364477+0000 mgr.a (mgr.14388) 6900 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:50 smithi191 bash[24992]: audit 2024-08-31T04:50:49.569871+0000 mon.a (mon.0) 1622 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:50:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:50 smithi191 bash[24992]: audit 2024-08-31T04:50:49.570992+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:50:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:50 smithi191 bash[24992]: audit 2024-08-31T04:50:49.580706+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:50:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:50 smithi191 bash[24992]: audit 2024-08-31T04:50:49.583504+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:50:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:50 smithi191 bash[24992]: audit 2024-08-31T04:50:49.586111+0000 mgr.a (mgr.14388) 6901 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:50:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:50 smithi163 bash[24253]: audit 2024-08-31T04:50:49.046955+0000 mgr.a (mgr.14388) 6899 : audit [DBG] from='client.157293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:50 smithi163 bash[24253]: cluster 2024-08-31T04:50:49.364477+0000 mgr.a (mgr.14388) 6900 : cluster [DBG] pgmap v4783: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:50:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:50 smithi163 bash[24253]: audit 2024-08-31T04:50:49.569871+0000 mon.a (mon.0) 1622 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:50:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:50 smithi163 bash[24253]: audit 2024-08-31T04:50:49.570992+0000 mon.a (mon.0) 1623 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:50:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:50 smithi163 bash[24253]: audit 2024-08-31T04:50:49.580706+0000 mon.a (mon.0) 1624 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:50:50.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:50 smithi163 bash[24253]: audit 2024-08-31T04:50:49.583504+0000 mon.a (mon.0) 1625 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:50:50.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:50 smithi163 bash[24253]: audit 2024-08-31T04:50:49.586111+0000 mgr.a (mgr.14388) 6901 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:50:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:51 smithi191 bash[24992]: audit 2024-08-31T04:50:50.299245+0000 mgr.a (mgr.14388) 6902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:50:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:51 smithi191 bash[24992]: cephadm 2024-08-31T04:50:50.300701+0000 mgr.a (mgr.14388) 6903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:50:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:51 smithi163 bash[24253]: audit 2024-08-31T04:50:50.299245+0000 mgr.a (mgr.14388) 6902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:50:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:51 smithi163 bash[24253]: cephadm 2024-08-31T04:50:50.300701+0000 mgr.a (mgr.14388) 6903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:50:51.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:51 smithi027 bash[22610]: audit 2024-08-31T04:50:50.299245+0000 mgr.a (mgr.14388) 6902 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:50:51.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:51 smithi027 bash[22610]: cephadm 2024-08-31T04:50:50.300701+0000 mgr.a (mgr.14388) 6903 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:50:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:52 smithi191 bash[24992]: cluster 2024-08-31T04:50:51.365391+0000 mgr.a (mgr.14388) 6904 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:50:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:52 smithi163 bash[24253]: cluster 2024-08-31T04:50:51.365391+0000 mgr.a (mgr.14388) 6904 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:50:52.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:52 smithi027 bash[22610]: cluster 2024-08-31T04:50:51.365391+0000 mgr.a (mgr.14388) 6904 : cluster [DBG] pgmap v4784: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:50:54.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:50:54.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:50:54.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:50:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:54 smithi191 bash[24992]: cluster 2024-08-31T04:50:53.367566+0000 mgr.a (mgr.14388) 6905 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:54 smithi163 bash[24253]: cluster 2024-08-31T04:50:53.367566+0000 mgr.a (mgr.14388) 6905 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:54.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:54 smithi027 bash[22610]: cluster 2024-08-31T04:50:53.367566+0000 mgr.a (mgr.14388) 6905 : cluster [DBG] pgmap v4785: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:55.266 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:50:55.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:50:55.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:50:55.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:50:55.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:50:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:55 smithi191 bash[24992]: audit 2024-08-31T04:50:54.824465+0000 mgr.a (mgr.14388) 6906 : audit [DBG] from='client.157476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:55 smithi163 bash[24253]: audit 2024-08-31T04:50:54.824465+0000 mgr.a (mgr.14388) 6906 : audit [DBG] from='client.157476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:55.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:55 smithi027 bash[22610]: audit 2024-08-31T04:50:54.824465+0000 mgr.a (mgr.14388) 6906 : audit [DBG] from='client.157476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:50:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:56 smithi191 bash[24992]: cluster 2024-08-31T04:50:55.368547+0000 mgr.a (mgr.14388) 6907 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:56 smithi163 bash[24253]: cluster 2024-08-31T04:50:55.368547+0000 mgr.a (mgr.14388) 6907 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:56 smithi027 bash[22610]: cluster 2024-08-31T04:50:55.368547+0000 mgr.a (mgr.14388) 6907 : cluster [DBG] pgmap v4786: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:50:58 smithi191 bash[24992]: cluster 2024-08-31T04:50:57.369378+0000 mgr.a (mgr.14388) 6908 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:50:58 smithi163 bash[24253]: cluster 2024-08-31T04:50:57.369378+0000 mgr.a (mgr.14388) 6908 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:50:58.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:50:58 smithi027 bash[22610]: cluster 2024-08-31T04:50:57.369378+0000 mgr.a (mgr.14388) 6908 : cluster [DBG] pgmap v4787: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:00.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:00.269 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:00.269 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:00 smithi191 bash[24992]: cluster 2024-08-31T04:50:59.371623+0000 mgr.a (mgr.14388) 6909 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:00.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:00 smithi163 bash[24253]: cluster 2024-08-31T04:50:59.371623+0000 mgr.a (mgr.14388) 6909 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:00 smithi027 bash[22610]: cluster 2024-08-31T04:50:59.371623+0000 mgr.a (mgr.14388) 6909 : cluster [DBG] pgmap v4788: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:01.037 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:01.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:01 smithi163 bash[24253]: audit 2024-08-31T04:51:00.607634+0000 mgr.a (mgr.14388) 6910 : audit [DBG] from='client.157554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:01.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:01 smithi027 bash[22610]: audit 2024-08-31T04:51:00.607634+0000 mgr.a (mgr.14388) 6910 : audit [DBG] from='client.157554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:01 smithi191 bash[24992]: audit 2024-08-31T04:51:00.607634+0000 mgr.a (mgr.14388) 6910 : audit [DBG] from='client.157554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:02 smithi163 bash[24253]: cluster 2024-08-31T04:51:01.372589+0000 mgr.a (mgr.14388) 6911 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:02.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:02 smithi027 bash[22610]: cluster 2024-08-31T04:51:01.372589+0000 mgr.a (mgr.14388) 6911 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:02 smithi191 bash[24992]: cluster 2024-08-31T04:51:01.372589+0000 mgr.a (mgr.14388) 6911 : cluster [DBG] pgmap v4789: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:04 smithi163 bash[24253]: cluster 2024-08-31T04:51:03.374794+0000 mgr.a (mgr.14388) 6912 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:04.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:04 smithi027 bash[22610]: cluster 2024-08-31T04:51:03.374794+0000 mgr.a (mgr.14388) 6912 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:04 smithi191 bash[24992]: cluster 2024-08-31T04:51:03.374794+0000 mgr.a (mgr.14388) 6912 : cluster [DBG] pgmap v4790: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:06.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:06.818 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:06.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:06.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:06.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:06.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:06 smithi163 bash[24253]: cluster 2024-08-31T04:51:05.375587+0000 mgr.a (mgr.14388) 6913 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:06 smithi027 bash[22610]: cluster 2024-08-31T04:51:05.375587+0000 mgr.a (mgr.14388) 6913 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:06 smithi191 bash[24992]: cluster 2024-08-31T04:51:05.375587+0000 mgr.a (mgr.14388) 6913 : cluster [DBG] pgmap v4791: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:07 smithi163 bash[24253]: audit 2024-08-31T04:51:06.376593+0000 mgr.a (mgr.14388) 6914 : audit [DBG] from='client.157632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:07.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:07 smithi027 bash[22610]: audit 2024-08-31T04:51:06.376593+0000 mgr.a (mgr.14388) 6914 : audit [DBG] from='client.157632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:07 smithi191 bash[24992]: audit 2024-08-31T04:51:06.376593+0000 mgr.a (mgr.14388) 6914 : audit [DBG] from='client.157632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:08 smithi163 bash[24253]: cluster 2024-08-31T04:51:07.376719+0000 mgr.a (mgr.14388) 6915 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:08 smithi027 bash[22610]: cluster 2024-08-31T04:51:07.376719+0000 mgr.a (mgr.14388) 6915 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:08 smithi191 bash[24992]: cluster 2024-08-31T04:51:07.376719+0000 mgr.a (mgr.14388) 6915 : cluster [DBG] pgmap v4792: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:10 smithi163 bash[24253]: cluster 2024-08-31T04:51:09.379035+0000 mgr.a (mgr.14388) 6916 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:10.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:10 smithi027 bash[22610]: cluster 2024-08-31T04:51:09.379035+0000 mgr.a (mgr.14388) 6916 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:10 smithi191 bash[24992]: cluster 2024-08-31T04:51:09.379035+0000 mgr.a (mgr.14388) 6916 : cluster [DBG] pgmap v4793: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:11.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:11.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:11.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:12.598 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:12.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:12.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:12.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:12.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:12 smithi163 bash[24253]: cluster 2024-08-31T04:51:11.379791+0000 mgr.a (mgr.14388) 6917 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:12.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:12 smithi027 bash[22610]: cluster 2024-08-31T04:51:11.379791+0000 mgr.a (mgr.14388) 6917 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:12 smithi191 bash[24992]: cluster 2024-08-31T04:51:11.379791+0000 mgr.a (mgr.14388) 6917 : cluster [DBG] pgmap v4794: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:13 smithi163 bash[24253]: audit 2024-08-31T04:51:12.153410+0000 mgr.a (mgr.14388) 6918 : audit [DBG] from='client.157710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:13.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:13 smithi027 bash[22610]: audit 2024-08-31T04:51:12.153410+0000 mgr.a (mgr.14388) 6918 : audit [DBG] from='client.157710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:13 smithi191 bash[24992]: audit 2024-08-31T04:51:12.153410+0000 mgr.a (mgr.14388) 6918 : audit [DBG] from='client.157710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:14 smithi163 bash[24253]: cluster 2024-08-31T04:51:13.382265+0000 mgr.a (mgr.14388) 6919 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:14.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:14 smithi027 bash[22610]: cluster 2024-08-31T04:51:13.382265+0000 mgr.a (mgr.14388) 6919 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:14 smithi191 bash[24992]: cluster 2024-08-31T04:51:13.382265+0000 mgr.a (mgr.14388) 6919 : cluster [DBG] pgmap v4795: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:16 smithi163 bash[24253]: cluster 2024-08-31T04:51:15.383129+0000 mgr.a (mgr.14388) 6920 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:16.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:16 smithi027 bash[22610]: cluster 2024-08-31T04:51:15.383129+0000 mgr.a (mgr.14388) 6920 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:16 smithi191 bash[24992]: cluster 2024-08-31T04:51:15.383129+0000 mgr.a (mgr.14388) 6920 : cluster [DBG] pgmap v4796: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:17.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:17.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:18.361 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:18.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:18.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:18.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:18.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:18 smithi163 bash[24253]: cluster 2024-08-31T04:51:17.383891+0000 mgr.a (mgr.14388) 6921 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:18 smithi027 bash[22610]: cluster 2024-08-31T04:51:17.383891+0000 mgr.a (mgr.14388) 6921 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:18 smithi191 bash[24992]: cluster 2024-08-31T04:51:17.383891+0000 mgr.a (mgr.14388) 6921 : cluster [DBG] pgmap v4797: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:19 smithi163 bash[24253]: audit 2024-08-31T04:51:17.937023+0000 mgr.a (mgr.14388) 6922 : audit [DBG] from='client.157785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:19 smithi027 bash[22610]: audit 2024-08-31T04:51:17.937023+0000 mgr.a (mgr.14388) 6922 : audit [DBG] from='client.157785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:19 smithi191 bash[24992]: audit 2024-08-31T04:51:17.937023+0000 mgr.a (mgr.14388) 6922 : audit [DBG] from='client.157785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:20.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:20 smithi163 bash[24253]: cluster 2024-08-31T04:51:19.386838+0000 mgr.a (mgr.14388) 6923 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:20 smithi027 bash[22610]: cluster 2024-08-31T04:51:19.386838+0000 mgr.a (mgr.14388) 6923 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:20 smithi191 bash[24992]: cluster 2024-08-31T04:51:19.386838+0000 mgr.a (mgr.14388) 6923 : cluster [DBG] pgmap v4798: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:22.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:22 smithi163 bash[24253]: cluster 2024-08-31T04:51:21.387684+0000 mgr.a (mgr.14388) 6924 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:51:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:22 smithi027 bash[22610]: cluster 2024-08-31T04:51:21.387684+0000 mgr.a (mgr.14388) 6924 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:51:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:22 smithi191 bash[24992]: cluster 2024-08-31T04:51:21.387684+0000 mgr.a (mgr.14388) 6924 : cluster [DBG] pgmap v4799: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:51:23.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:23.363 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:23.363 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:24.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:24.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:24.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:24.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:24.131 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:24 smithi163 bash[24253]: cluster 2024-08-31T04:51:23.389734+0000 mgr.a (mgr.14388) 6925 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:24 smithi163 bash[24253]: audit 2024-08-31T04:51:23.699998+0000 mgr.a (mgr.14388) 6926 : audit [DBG] from='client.157860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:24 smithi027 bash[22610]: cluster 2024-08-31T04:51:23.389734+0000 mgr.a (mgr.14388) 6925 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:24 smithi027 bash[22610]: audit 2024-08-31T04:51:23.699998+0000 mgr.a (mgr.14388) 6926 : audit [DBG] from='client.157860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:24 smithi191 bash[24992]: cluster 2024-08-31T04:51:23.389734+0000 mgr.a (mgr.14388) 6925 : cluster [DBG] pgmap v4800: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:24 smithi191 bash[24992]: audit 2024-08-31T04:51:23.699998+0000 mgr.a (mgr.14388) 6926 : audit [DBG] from='client.157860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:26 smithi163 bash[24253]: cluster 2024-08-31T04:51:25.390689+0000 mgr.a (mgr.14388) 6927 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:51:26.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:26 smithi027 bash[22610]: cluster 2024-08-31T04:51:25.390689+0000 mgr.a (mgr.14388) 6927 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:51:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:26 smithi191 bash[24992]: cluster 2024-08-31T04:51:25.390689+0000 mgr.a (mgr.14388) 6927 : cluster [DBG] pgmap v4801: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:51:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:28 smithi163 bash[24253]: cluster 2024-08-31T04:51:27.391524+0000 mgr.a (mgr.14388) 6928 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:51:28.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:28 smithi027 bash[22610]: cluster 2024-08-31T04:51:27.391524+0000 mgr.a (mgr.14388) 6928 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:51:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:28 smithi191 bash[24992]: cluster 2024-08-31T04:51:27.391524+0000 mgr.a (mgr.14388) 6928 : cluster [DBG] pgmap v4802: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:51:29.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:29.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:29.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:29.868 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:29.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:29.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:29.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:29.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:30 smithi163 bash[24253]: cluster 2024-08-31T04:51:29.393780+0000 mgr.a (mgr.14388) 6929 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:30 smithi163 bash[24253]: audit 2024-08-31T04:51:29.459675+0000 mgr.a (mgr.14388) 6930 : audit [DBG] from='client.157938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:30.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:30 smithi027 bash[22610]: cluster 2024-08-31T04:51:29.393780+0000 mgr.a (mgr.14388) 6929 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:30.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:30 smithi027 bash[22610]: audit 2024-08-31T04:51:29.459675+0000 mgr.a (mgr.14388) 6930 : audit [DBG] from='client.157938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:30 smithi191 bash[24992]: cluster 2024-08-31T04:51:29.393780+0000 mgr.a (mgr.14388) 6929 : cluster [DBG] pgmap v4803: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:30 smithi191 bash[24992]: audit 2024-08-31T04:51:29.459675+0000 mgr.a (mgr.14388) 6930 : audit [DBG] from='client.157938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:32 smithi163 bash[24253]: cluster 2024-08-31T04:51:31.394755+0000 mgr.a (mgr.14388) 6931 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:32.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:32 smithi027 bash[22610]: cluster 2024-08-31T04:51:31.394755+0000 mgr.a (mgr.14388) 6931 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:32 smithi191 bash[24992]: cluster 2024-08-31T04:51:31.394755+0000 mgr.a (mgr.14388) 6931 : cluster [DBG] pgmap v4804: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:34.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:34.870 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:34.870 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:34 smithi163 bash[24253]: cluster 2024-08-31T04:51:33.396932+0000 mgr.a (mgr.14388) 6932 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:34.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:34 smithi027 bash[22610]: cluster 2024-08-31T04:51:33.396932+0000 mgr.a (mgr.14388) 6932 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:34 smithi191 bash[24992]: cluster 2024-08-31T04:51:33.396932+0000 mgr.a (mgr.14388) 6932 : cluster [DBG] pgmap v4805: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:35.624 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:35.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:36 smithi163 bash[24253]: audit 2024-08-31T04:51:35.207267+0000 mgr.a (mgr.14388) 6933 : audit [DBG] from='client.158016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:36 smithi163 bash[24253]: cluster 2024-08-31T04:51:35.397585+0000 mgr.a (mgr.14388) 6934 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:36.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:36 smithi027 bash[22610]: audit 2024-08-31T04:51:35.207267+0000 mgr.a (mgr.14388) 6933 : audit [DBG] from='client.158016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:36 smithi027 bash[22610]: cluster 2024-08-31T04:51:35.397585+0000 mgr.a (mgr.14388) 6934 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:36 smithi191 bash[24992]: audit 2024-08-31T04:51:35.207267+0000 mgr.a (mgr.14388) 6933 : audit [DBG] from='client.158016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:36 smithi191 bash[24992]: cluster 2024-08-31T04:51:35.397585+0000 mgr.a (mgr.14388) 6934 : cluster [DBG] pgmap v4806: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:38 smithi163 bash[24253]: cluster 2024-08-31T04:51:37.398470+0000 mgr.a (mgr.14388) 6935 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:38.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:38 smithi027 bash[22610]: cluster 2024-08-31T04:51:37.398470+0000 mgr.a (mgr.14388) 6935 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:38 smithi191 bash[24992]: cluster 2024-08-31T04:51:37.398470+0000 mgr.a (mgr.14388) 6935 : cluster [DBG] pgmap v4807: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:40.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:40.626 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:40.626 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:40 smithi163 bash[24253]: cluster 2024-08-31T04:51:39.400742+0000 mgr.a (mgr.14388) 6936 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:40.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:40 smithi027 bash[22610]: cluster 2024-08-31T04:51:39.400742+0000 mgr.a (mgr.14388) 6936 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:40 smithi191 bash[24992]: cluster 2024-08-31T04:51:39.400742+0000 mgr.a (mgr.14388) 6936 : cluster [DBG] pgmap v4808: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:41.381 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:41.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:41.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:41.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:41.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:42 smithi163 bash[24253]: audit 2024-08-31T04:51:40.957700+0000 mgr.a (mgr.14388) 6937 : audit [DBG] from='client.158094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:42 smithi163 bash[24253]: cluster 2024-08-31T04:51:41.401292+0000 mgr.a (mgr.14388) 6938 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:42.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:42 smithi027 bash[22610]: audit 2024-08-31T04:51:40.957700+0000 mgr.a (mgr.14388) 6937 : audit [DBG] from='client.158094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:42.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:42 smithi027 bash[22610]: cluster 2024-08-31T04:51:41.401292+0000 mgr.a (mgr.14388) 6938 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:42 smithi191 bash[24992]: audit 2024-08-31T04:51:40.957700+0000 mgr.a (mgr.14388) 6937 : audit [DBG] from='client.158094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:42 smithi191 bash[24992]: cluster 2024-08-31T04:51:41.401292+0000 mgr.a (mgr.14388) 6938 : cluster [DBG] pgmap v4809: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:44 smithi163 bash[24253]: cluster 2024-08-31T04:51:43.403452+0000 mgr.a (mgr.14388) 6939 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:44.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:44 smithi027 bash[22610]: cluster 2024-08-31T04:51:43.403452+0000 mgr.a (mgr.14388) 6939 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:44 smithi191 bash[24992]: cluster 2024-08-31T04:51:43.403452+0000 mgr.a (mgr.14388) 6939 : cluster [DBG] pgmap v4810: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:46.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:46.384 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:46.384 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:46 smithi163 bash[24253]: cluster 2024-08-31T04:51:45.404245+0000 mgr.a (mgr.14388) 6940 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:46.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:46 smithi027 bash[22610]: cluster 2024-08-31T04:51:45.404245+0000 mgr.a (mgr.14388) 6940 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:46 smithi191 bash[24992]: cluster 2024-08-31T04:51:45.404245+0000 mgr.a (mgr.14388) 6940 : cluster [DBG] pgmap v4811: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:47.162 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:47.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:47.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:47.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:47.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:47 smithi163 bash[24253]: audit 2024-08-31T04:51:46.726032+0000 mgr.a (mgr.14388) 6941 : audit [DBG] from='client.158172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:47.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:47 smithi027 bash[22610]: audit 2024-08-31T04:51:46.726032+0000 mgr.a (mgr.14388) 6941 : audit [DBG] from='client.158172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:47 smithi191 bash[24992]: audit 2024-08-31T04:51:46.726032+0000 mgr.a (mgr.14388) 6941 : audit [DBG] from='client.158172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:48 smithi163 bash[24253]: cluster 2024-08-31T04:51:47.405356+0000 mgr.a (mgr.14388) 6942 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:48.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:48 smithi027 bash[22610]: cluster 2024-08-31T04:51:47.405356+0000 mgr.a (mgr.14388) 6942 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:48 smithi191 bash[24992]: cluster 2024-08-31T04:51:47.405356+0000 mgr.a (mgr.14388) 6942 : cluster [DBG] pgmap v4812: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:50 smithi163 bash[24253]: cluster 2024-08-31T04:51:49.407694+0000 mgr.a (mgr.14388) 6943 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:50 smithi163 bash[24253]: audit 2024-08-31T04:51:50.353304+0000 mon.a (mon.0) 1626 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:51:50.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:50 smithi027 bash[22610]: cluster 2024-08-31T04:51:49.407694+0000 mgr.a (mgr.14388) 6943 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:50.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:50 smithi027 bash[22610]: audit 2024-08-31T04:51:50.353304+0000 mon.a (mon.0) 1626 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:51:51.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:50 smithi191 bash[24992]: cluster 2024-08-31T04:51:49.407694+0000 mgr.a (mgr.14388) 6943 : cluster [DBG] pgmap v4813: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:51:51.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:50 smithi191 bash[24992]: audit 2024-08-31T04:51:50.353304+0000 mon.a (mon.0) 1626 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:51:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:51 smithi163 bash[24253]: audit 2024-08-31T04:51:51.191678+0000 mon.a (mon.0) 1627 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:51:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:51 smithi163 bash[24253]: audit 2024-08-31T04:51:51.193604+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:51:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:51 smithi163 bash[24253]: audit 2024-08-31T04:51:51.204302+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:51:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:51 smithi163 bash[24253]: audit 2024-08-31T04:51:51.209077+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:51:51.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:51:51 smithi027 bash[22863]: debug 2024-08-31T04:51:51.927+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:51:51.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:51:51 smithi027 bash[22863]: debug 2024-08-31T04:51:51.927+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:51:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:51 smithi027 bash[22610]: audit 2024-08-31T04:51:51.191678+0000 mon.a (mon.0) 1627 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:51:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:51 smithi027 bash[22610]: audit 2024-08-31T04:51:51.193604+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:51:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:51 smithi027 bash[22610]: audit 2024-08-31T04:51:51.204302+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:51:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:51 smithi027 bash[22610]: audit 2024-08-31T04:51:51.209077+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:51:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:51 smithi191 bash[24992]: audit 2024-08-31T04:51:51.191678+0000 mon.a (mon.0) 1627 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:51:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:51 smithi191 bash[24992]: audit 2024-08-31T04:51:51.193604+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:51:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:51 smithi191 bash[24992]: audit 2024-08-31T04:51:51.204302+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:51:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:51 smithi191 bash[24992]: audit 2024-08-31T04:51:51.209077+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:51:52.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:52.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:52.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:52.878 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:52.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:52.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:52.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:52.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:52 smithi163 bash[24253]: audit 2024-08-31T04:51:51.211390+0000 mgr.a (mgr.14388) 6944 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:51:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:52 smithi163 bash[24253]: cluster 2024-08-31T04:51:51.408284+0000 mgr.a (mgr.14388) 6945 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:52.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:52 smithi027 bash[22610]: audit 2024-08-31T04:51:51.211390+0000 mgr.a (mgr.14388) 6944 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:51:52.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:52 smithi027 bash[22610]: cluster 2024-08-31T04:51:51.408284+0000 mgr.a (mgr.14388) 6945 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:52 smithi191 bash[24992]: audit 2024-08-31T04:51:51.211390+0000 mgr.a (mgr.14388) 6944 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:51:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:52 smithi191 bash[24992]: cluster 2024-08-31T04:51:51.408284+0000 mgr.a (mgr.14388) 6945 : cluster [DBG] pgmap v4814: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:51:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:53 smithi163 bash[24253]: audit 2024-08-31T04:51:51.931757+0000 mgr.a (mgr.14388) 6946 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:51:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:53 smithi163 bash[24253]: cephadm 2024-08-31T04:51:51.933164+0000 mgr.a (mgr.14388) 6947 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:51:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:53 smithi163 bash[24253]: audit 2024-08-31T04:51:52.476880+0000 mgr.a (mgr.14388) 6948 : audit [DBG] from='client.158352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:53.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:53 smithi027 bash[22610]: audit 2024-08-31T04:51:51.931757+0000 mgr.a (mgr.14388) 6946 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:51:53.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:53 smithi027 bash[22610]: cephadm 2024-08-31T04:51:51.933164+0000 mgr.a (mgr.14388) 6947 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:51:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:53 smithi027 bash[22610]: audit 2024-08-31T04:51:52.476880+0000 mgr.a (mgr.14388) 6948 : audit [DBG] from='client.158352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:53 smithi191 bash[24992]: audit 2024-08-31T04:51:51.931757+0000 mgr.a (mgr.14388) 6946 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:51:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:53 smithi191 bash[24992]: cephadm 2024-08-31T04:51:51.933164+0000 mgr.a (mgr.14388) 6947 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:51:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:53 smithi191 bash[24992]: audit 2024-08-31T04:51:52.476880+0000 mgr.a (mgr.14388) 6948 : audit [DBG] from='client.158352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:51:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:54 smithi027 bash[22610]: cluster 2024-08-31T04:51:53.410628+0000 mgr.a (mgr.14388) 6949 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:54 smithi191 bash[24992]: cluster 2024-08-31T04:51:53.410628+0000 mgr.a (mgr.14388) 6949 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:54 smithi163 bash[24253]: cluster 2024-08-31T04:51:53.410628+0000 mgr.a (mgr.14388) 6949 : cluster [DBG] pgmap v4815: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:56 smithi027 bash[22610]: cluster 2024-08-31T04:51:55.411366+0000 mgr.a (mgr.14388) 6950 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:56 smithi191 bash[24992]: cluster 2024-08-31T04:51:55.411366+0000 mgr.a (mgr.14388) 6950 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:56 smithi163 bash[24253]: cluster 2024-08-31T04:51:55.411366+0000 mgr.a (mgr.14388) 6950 : cluster [DBG] pgmap v4816: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:57.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:51:57.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:51:57.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:51:58.632 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:51:58.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:51:58.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:51:58.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:51:58.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:51:58.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:58 smithi027 bash[22610]: cluster 2024-08-31T04:51:57.412137+0000 mgr.a (mgr.14388) 6951 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:58 smithi191 bash[24992]: cluster 2024-08-31T04:51:57.412137+0000 mgr.a (mgr.14388) 6951 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:58 smithi163 bash[24253]: cluster 2024-08-31T04:51:57.412137+0000 mgr.a (mgr.14388) 6951 : cluster [DBG] pgmap v4817: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:51:59.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:51:59 smithi027 bash[22610]: audit 2024-08-31T04:51:58.211542+0000 mgr.a (mgr.14388) 6952 : audit [DBG] from='client.158430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:51:59 smithi191 bash[24992]: audit 2024-08-31T04:51:58.211542+0000 mgr.a (mgr.14388) 6952 : audit [DBG] from='client.158430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:51:59 smithi163 bash[24253]: audit 2024-08-31T04:51:58.211542+0000 mgr.a (mgr.14388) 6952 : audit [DBG] from='client.158430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:00 smithi027 bash[22610]: cluster 2024-08-31T04:51:59.414979+0000 mgr.a (mgr.14388) 6953 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:52:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:00 smithi191 bash[24992]: cluster 2024-08-31T04:51:59.414979+0000 mgr.a (mgr.14388) 6953 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:52:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:00 smithi163 bash[24253]: cluster 2024-08-31T04:51:59.414979+0000 mgr.a (mgr.14388) 6953 : cluster [DBG] pgmap v4818: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:52:02.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:02 smithi027 bash[22610]: cluster 2024-08-31T04:52:01.415763+0000 mgr.a (mgr.14388) 6954 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:52:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:02 smithi191 bash[24992]: cluster 2024-08-31T04:52:01.415763+0000 mgr.a (mgr.14388) 6954 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:52:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:02 smithi163 bash[24253]: cluster 2024-08-31T04:52:01.415763+0000 mgr.a (mgr.14388) 6954 : cluster [DBG] pgmap v4819: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:52:03.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:52:03.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:52:03.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:52:04.374 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:52:04.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:52:04.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:52:04.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:52:04.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:52:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:04 smithi191 bash[24992]: cluster 2024-08-31T04:52:03.417703+0000 mgr.a (mgr.14388) 6955 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:52:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:04 smithi163 bash[24253]: cluster 2024-08-31T04:52:03.417703+0000 mgr.a (mgr.14388) 6955 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:52:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:04 smithi027 bash[22610]: cluster 2024-08-31T04:52:03.417703+0000 mgr.a (mgr.14388) 6955 : cluster [DBG] pgmap v4820: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:52:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:05 smithi191 bash[24992]: audit 2024-08-31T04:52:03.969480+0000 mgr.a (mgr.14388) 6956 : audit [DBG] from='client.158508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:05 smithi163 bash[24253]: audit 2024-08-31T04:52:03.969480+0000 mgr.a (mgr.14388) 6956 : audit [DBG] from='client.158508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:06.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:05 smithi027 bash[22610]: audit 2024-08-31T04:52:03.969480+0000 mgr.a (mgr.14388) 6956 : audit [DBG] from='client.158508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:06 smithi191 bash[24992]: cluster 2024-08-31T04:52:05.418615+0000 mgr.a (mgr.14388) 6957 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:52:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:06 smithi163 bash[24253]: cluster 2024-08-31T04:52:05.418615+0000 mgr.a (mgr.14388) 6957 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:52:07.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:06 smithi027 bash[22610]: cluster 2024-08-31T04:52:05.418615+0000 mgr.a (mgr.14388) 6957 : cluster [DBG] pgmap v4821: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:52:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:08 smithi191 bash[24992]: cluster 2024-08-31T04:52:07.419417+0000 mgr.a (mgr.14388) 6958 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:52:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:08 smithi163 bash[24253]: cluster 2024-08-31T04:52:07.419417+0000 mgr.a (mgr.14388) 6958 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:52:09.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:08 smithi027 bash[22610]: cluster 2024-08-31T04:52:07.419417+0000 mgr.a (mgr.14388) 6958 : cluster [DBG] pgmap v4822: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:52:09.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:52:09.376 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:52:09.377 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:52:10.154 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:52:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:52:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:52:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:52:10.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:52:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:10 smithi191 bash[24992]: cluster 2024-08-31T04:52:09.421658+0000 mgr.a (mgr.14388) 6959 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:10 smithi191 bash[24992]: audit 2024-08-31T04:52:09.711925+0000 mgr.a (mgr.14388) 6960 : audit [DBG] from='client.158586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:10 smithi163 bash[24253]: cluster 2024-08-31T04:52:09.421658+0000 mgr.a (mgr.14388) 6959 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:10 smithi163 bash[24253]: audit 2024-08-31T04:52:09.711925+0000 mgr.a (mgr.14388) 6960 : audit [DBG] from='client.158586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:11.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:10 smithi027 bash[22610]: cluster 2024-08-31T04:52:09.421658+0000 mgr.a (mgr.14388) 6959 : cluster [DBG] pgmap v4823: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:10 smithi027 bash[22610]: audit 2024-08-31T04:52:09.711925+0000 mgr.a (mgr.14388) 6960 : audit [DBG] from='client.158586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:12 smithi191 bash[24992]: cluster 2024-08-31T04:52:11.422553+0000 mgr.a (mgr.14388) 6961 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:12 smithi163 bash[24253]: cluster 2024-08-31T04:52:11.422553+0000 mgr.a (mgr.14388) 6961 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:13.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:12 smithi027 bash[22610]: cluster 2024-08-31T04:52:11.422553+0000 mgr.a (mgr.14388) 6961 : cluster [DBG] pgmap v4824: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:14 smithi191 bash[24992]: cluster 2024-08-31T04:52:13.424802+0000 mgr.a (mgr.14388) 6962 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:15.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:52:15.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:52:15.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:52:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:14 smithi163 bash[24253]: cluster 2024-08-31T04:52:13.424802+0000 mgr.a (mgr.14388) 6962 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:15.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:14 smithi027 bash[22610]: cluster 2024-08-31T04:52:13.424802+0000 mgr.a (mgr.14388) 6962 : cluster [DBG] pgmap v4825: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:15.944 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:52:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:52:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:52:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:52:15.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:52:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:16 smithi191 bash[24992]: cluster 2024-08-31T04:52:15.425545+0000 mgr.a (mgr.14388) 6963 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:16 smithi191 bash[24992]: audit 2024-08-31T04:52:15.492928+0000 mgr.a (mgr.14388) 6964 : audit [DBG] from='client.158661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:16 smithi163 bash[24253]: cluster 2024-08-31T04:52:15.425545+0000 mgr.a (mgr.14388) 6963 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:16 smithi163 bash[24253]: audit 2024-08-31T04:52:15.492928+0000 mgr.a (mgr.14388) 6964 : audit [DBG] from='client.158661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:17.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:16 smithi027 bash[22610]: cluster 2024-08-31T04:52:15.425545+0000 mgr.a (mgr.14388) 6963 : cluster [DBG] pgmap v4826: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:16 smithi027 bash[22610]: audit 2024-08-31T04:52:15.492928+0000 mgr.a (mgr.14388) 6964 : audit [DBG] from='client.158661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:18 smithi191 bash[24992]: cluster 2024-08-31T04:52:17.426427+0000 mgr.a (mgr.14388) 6965 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:18 smithi163 bash[24253]: cluster 2024-08-31T04:52:17.426427+0000 mgr.a (mgr.14388) 6965 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:19.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:18 smithi027 bash[22610]: cluster 2024-08-31T04:52:17.426427+0000 mgr.a (mgr.14388) 6965 : cluster [DBG] pgmap v4827: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:20.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:52:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:52:20.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:52:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:20 smithi191 bash[24992]: cluster 2024-08-31T04:52:19.428659+0000 mgr.a (mgr.14388) 6966 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:20 smithi163 bash[24253]: cluster 2024-08-31T04:52:19.428659+0000 mgr.a (mgr.14388) 6966 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:21.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:20 smithi027 bash[22610]: cluster 2024-08-31T04:52:19.428659+0000 mgr.a (mgr.14388) 6966 : cluster [DBG] pgmap v4828: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:21.730 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:52:21.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:52:21.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:52:21.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:52:21.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:52:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:22 smithi191 bash[24992]: audit 2024-08-31T04:52:21.292788+0000 mgr.a (mgr.14388) 6967 : audit [DBG] from='client.158730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:22 smithi191 bash[24992]: cluster 2024-08-31T04:52:21.433861+0000 mgr.a (mgr.14388) 6968 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:22 smithi163 bash[24253]: audit 2024-08-31T04:52:21.292788+0000 mgr.a (mgr.14388) 6967 : audit [DBG] from='client.158730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:22 smithi163 bash[24253]: cluster 2024-08-31T04:52:21.433861+0000 mgr.a (mgr.14388) 6968 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:22 smithi027 bash[22610]: audit 2024-08-31T04:52:21.292788+0000 mgr.a (mgr.14388) 6967 : audit [DBG] from='client.158730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:22 smithi027 bash[22610]: cluster 2024-08-31T04:52:21.433861+0000 mgr.a (mgr.14388) 6968 : cluster [DBG] pgmap v4829: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:24 smithi191 bash[24992]: cluster 2024-08-31T04:52:23.436167+0000 mgr.a (mgr.14388) 6969 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:52:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:24 smithi163 bash[24253]: cluster 2024-08-31T04:52:23.436167+0000 mgr.a (mgr.14388) 6969 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:52:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:24 smithi027 bash[22610]: cluster 2024-08-31T04:52:23.436167+0000 mgr.a (mgr.14388) 6969 : cluster [DBG] pgmap v4830: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:52:26.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:52:26.732 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:52:26.732 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:52:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:26 smithi191 bash[24992]: cluster 2024-08-31T04:52:25.436955+0000 mgr.a (mgr.14388) 6970 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:52:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:26 smithi163 bash[24253]: cluster 2024-08-31T04:52:25.436955+0000 mgr.a (mgr.14388) 6970 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:52:27.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:26 smithi027 bash[22610]: cluster 2024-08-31T04:52:25.436955+0000 mgr.a (mgr.14388) 6970 : cluster [DBG] pgmap v4831: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:52:27.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:52:27.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:52:27.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:52:27.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:52:27.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:52:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:28 smithi163 bash[24253]: audit 2024-08-31T04:52:27.068734+0000 mgr.a (mgr.14388) 6971 : audit [DBG] from='client.158808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:28 smithi163 bash[24253]: cluster 2024-08-31T04:52:27.437517+0000 mgr.a (mgr.14388) 6972 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:52:29.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:28 smithi027 bash[22610]: audit 2024-08-31T04:52:27.068734+0000 mgr.a (mgr.14388) 6971 : audit [DBG] from='client.158808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:28 smithi027 bash[22610]: cluster 2024-08-31T04:52:27.437517+0000 mgr.a (mgr.14388) 6972 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:52:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:28 smithi191 bash[24992]: audit 2024-08-31T04:52:27.068734+0000 mgr.a (mgr.14388) 6971 : audit [DBG] from='client.158808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:28 smithi191 bash[24992]: cluster 2024-08-31T04:52:27.437517+0000 mgr.a (mgr.14388) 6972 : cluster [DBG] pgmap v4832: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:52:31.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:30 smithi163 bash[24253]: cluster 2024-08-31T04:52:29.439727+0000 mgr.a (mgr.14388) 6973 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:52:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:30 smithi027 bash[22610]: cluster 2024-08-31T04:52:29.439727+0000 mgr.a (mgr.14388) 6973 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:52:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:30 smithi191 bash[24992]: cluster 2024-08-31T04:52:29.439727+0000 mgr.a (mgr.14388) 6973 : cluster [DBG] pgmap v4833: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T04:52:32.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:52:32.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:52:32.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:52:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:32 smithi163 bash[24253]: cluster 2024-08-31T04:52:31.440519+0000 mgr.a (mgr.14388) 6974 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:52:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:32 smithi027 bash[22610]: cluster 2024-08-31T04:52:31.440519+0000 mgr.a (mgr.14388) 6974 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:52:33.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:52:33.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:52:33.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:52:33.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:52:33.266 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:52:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:32 smithi191 bash[24992]: cluster 2024-08-31T04:52:31.440519+0000 mgr.a (mgr.14388) 6974 : cluster [DBG] pgmap v4834: 225 pgs: 225 active+clean; 589 KiB data, 117 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T04:52:34.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:33 smithi163 bash[24253]: audit 2024-08-31T04:52:32.820357+0000 mgr.a (mgr.14388) 6975 : audit [DBG] from='client.158883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:34.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:33 smithi027 bash[22610]: audit 2024-08-31T04:52:32.820357+0000 mgr.a (mgr.14388) 6975 : audit [DBG] from='client.158883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:33 smithi191 bash[24992]: audit 2024-08-31T04:52:32.820357+0000 mgr.a (mgr.14388) 6975 : audit [DBG] from='client.158883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:34 smithi163 bash[24253]: cluster 2024-08-31T04:52:33.443394+0000 mgr.a (mgr.14388) 6976 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-08-31T04:52:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:34 smithi027 bash[22610]: cluster 2024-08-31T04:52:33.443394+0000 mgr.a (mgr.14388) 6976 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-08-31T04:52:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:34 smithi191 bash[24992]: cluster 2024-08-31T04:52:33.443394+0000 mgr.a (mgr.14388) 6976 : cluster [DBG] pgmap v4835: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 61 op/s 2024-08-31T04:52:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:36 smithi163 bash[24253]: cluster 2024-08-31T04:52:35.444205+0000 mgr.a (mgr.14388) 6977 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T04:52:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:36 smithi027 bash[22610]: cluster 2024-08-31T04:52:35.444205+0000 mgr.a (mgr.14388) 6977 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T04:52:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:36 smithi191 bash[24992]: cluster 2024-08-31T04:52:35.444205+0000 mgr.a (mgr.14388) 6977 : cluster [DBG] pgmap v4836: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T04:52:38.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:52:38.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:52:38.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:52:39.021 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:52:39.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:52:39.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:52:39.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:52:39.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:52:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:38 smithi163 bash[24253]: cluster 2024-08-31T04:52:37.444969+0000 mgr.a (mgr.14388) 6978 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T04:52:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:38 smithi027 bash[22610]: cluster 2024-08-31T04:52:37.444969+0000 mgr.a (mgr.14388) 6978 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T04:52:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:38 smithi191 bash[24992]: cluster 2024-08-31T04:52:37.444969+0000 mgr.a (mgr.14388) 6978 : cluster [DBG] pgmap v4837: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T04:52:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:39 smithi163 bash[24253]: audit 2024-08-31T04:52:38.599941+0000 mgr.a (mgr.14388) 6979 : audit [DBG] from='client.158958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:40.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:39 smithi027 bash[22610]: audit 2024-08-31T04:52:38.599941+0000 mgr.a (mgr.14388) 6979 : audit [DBG] from='client.158958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:39 smithi191 bash[24992]: audit 2024-08-31T04:52:38.599941+0000 mgr.a (mgr.14388) 6979 : audit [DBG] from='client.158958 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:40 smithi163 bash[24253]: cluster 2024-08-31T04:52:39.447660+0000 mgr.a (mgr.14388) 6980 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:52:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:40 smithi027 bash[22610]: cluster 2024-08-31T04:52:39.447660+0000 mgr.a (mgr.14388) 6980 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:52:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:40 smithi191 bash[24992]: cluster 2024-08-31T04:52:39.447660+0000 mgr.a (mgr.14388) 6980 : cluster [DBG] pgmap v4838: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:52:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:42 smithi163 bash[24253]: cluster 2024-08-31T04:52:41.448462+0000 mgr.a (mgr.14388) 6981 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T04:52:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:42 smithi027 bash[22610]: cluster 2024-08-31T04:52:41.448462+0000 mgr.a (mgr.14388) 6981 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T04:52:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:42 smithi191 bash[24992]: cluster 2024-08-31T04:52:41.448462+0000 mgr.a (mgr.14388) 6981 : cluster [DBG] pgmap v4839: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T04:52:44.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:52:44.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:52:44.024 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:52:44.764 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:52:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:52:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:52:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:52:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:52:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:44 smithi163 bash[24253]: cluster 2024-08-31T04:52:43.450428+0000 mgr.a (mgr.14388) 6982 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:52:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:44 smithi027 bash[22610]: cluster 2024-08-31T04:52:43.450428+0000 mgr.a (mgr.14388) 6982 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:52:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:44 smithi191 bash[24992]: cluster 2024-08-31T04:52:43.450428+0000 mgr.a (mgr.14388) 6982 : cluster [DBG] pgmap v4840: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T04:52:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:45 smithi163 bash[24253]: audit 2024-08-31T04:52:44.347370+0000 mgr.a (mgr.14388) 6983 : audit [DBG] from='client.159027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:46.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:45 smithi027 bash[22610]: audit 2024-08-31T04:52:44.347370+0000 mgr.a (mgr.14388) 6983 : audit [DBG] from='client.159027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:45 smithi191 bash[24992]: audit 2024-08-31T04:52:44.347370+0000 mgr.a (mgr.14388) 6983 : audit [DBG] from='client.159027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:46 smithi163 bash[24253]: cluster 2024-08-31T04:52:45.451371+0000 mgr.a (mgr.14388) 6984 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:46 smithi027 bash[22610]: cluster 2024-08-31T04:52:45.451371+0000 mgr.a (mgr.14388) 6984 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:46 smithi191 bash[24992]: cluster 2024-08-31T04:52:45.451371+0000 mgr.a (mgr.14388) 6984 : cluster [DBG] pgmap v4841: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:48 smithi191 bash[24992]: cluster 2024-08-31T04:52:47.452285+0000 mgr.a (mgr.14388) 6985 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:48 smithi163 bash[24253]: cluster 2024-08-31T04:52:47.452285+0000 mgr.a (mgr.14388) 6985 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:48.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:48 smithi027 bash[22610]: cluster 2024-08-31T04:52:47.452285+0000 mgr.a (mgr.14388) 6985 : cluster [DBG] pgmap v4842: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:49.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:52:49.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:52:49.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:52:50.532 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:52:50.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:52:50.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:52:50.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:52:50.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:52:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:50 smithi191 bash[24992]: cluster 2024-08-31T04:52:49.454665+0000 mgr.a (mgr.14388) 6986 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:50 smithi163 bash[24253]: cluster 2024-08-31T04:52:49.454665+0000 mgr.a (mgr.14388) 6986 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:50.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:50 smithi027 bash[22610]: cluster 2024-08-31T04:52:49.454665+0000 mgr.a (mgr.14388) 6986 : cluster [DBG] pgmap v4843: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:51 smithi191 bash[24992]: audit 2024-08-31T04:52:50.103509+0000 mgr.a (mgr.14388) 6987 : audit [DBG] from='client.159105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:51 smithi163 bash[24253]: audit 2024-08-31T04:52:50.103509+0000 mgr.a (mgr.14388) 6987 : audit [DBG] from='client.159105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:51.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:51 smithi027 bash[22610]: audit 2024-08-31T04:52:50.103509+0000 mgr.a (mgr.14388) 6987 : audit [DBG] from='client.159105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:52 smithi191 bash[24992]: cluster 2024-08-31T04:52:51.455619+0000 mgr.a (mgr.14388) 6988 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:52 smithi191 bash[24992]: audit 2024-08-31T04:52:51.985419+0000 mon.a (mon.0) 1631 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:52:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:52 smithi163 bash[24253]: cluster 2024-08-31T04:52:51.455619+0000 mgr.a (mgr.14388) 6988 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:52 smithi163 bash[24253]: audit 2024-08-31T04:52:51.985419+0000 mon.a (mon.0) 1631 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:52:52.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:52 smithi027 bash[22610]: cluster 2024-08-31T04:52:51.455619+0000 mgr.a (mgr.14388) 6988 : cluster [DBG] pgmap v4844: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:52.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:52 smithi027 bash[22610]: audit 2024-08-31T04:52:51.985419+0000 mon.a (mon.0) 1631 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:52:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:53 smithi191 bash[24992]: audit 2024-08-31T04:52:52.811146+0000 mon.a (mon.0) 1632 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:52:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:53 smithi191 bash[24992]: audit 2024-08-31T04:52:52.812712+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:52:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:53 smithi191 bash[24992]: audit 2024-08-31T04:52:52.824464+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:52:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:53 smithi191 bash[24992]: audit 2024-08-31T04:52:52.829802+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:52:53.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:53 smithi191 bash[24992]: audit 2024-08-31T04:52:52.832247+0000 mgr.a (mgr.14388) 6989 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:52:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:53 smithi163 bash[24253]: audit 2024-08-31T04:52:52.811146+0000 mon.a (mon.0) 1632 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:52:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:53 smithi163 bash[24253]: audit 2024-08-31T04:52:52.812712+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:52:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:53 smithi163 bash[24253]: audit 2024-08-31T04:52:52.824464+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:52:53.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:53 smithi163 bash[24253]: audit 2024-08-31T04:52:52.829802+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:52:53.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:53 smithi163 bash[24253]: audit 2024-08-31T04:52:52.832247+0000 mgr.a (mgr.14388) 6989 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:52:53.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:52:53 smithi027 bash[22863]: debug 2024-08-31T04:52:53.561+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:52:53.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:52:53 smithi027 bash[22863]: debug 2024-08-31T04:52:53.561+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:52:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:53 smithi027 bash[22610]: audit 2024-08-31T04:52:52.811146+0000 mon.a (mon.0) 1632 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:52:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:53 smithi027 bash[22610]: audit 2024-08-31T04:52:52.812712+0000 mon.a (mon.0) 1633 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:52:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:53 smithi027 bash[22610]: audit 2024-08-31T04:52:52.824464+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:52:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:53 smithi027 bash[22610]: audit 2024-08-31T04:52:52.829802+0000 mon.a (mon.0) 1635 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:52:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:53 smithi027 bash[22610]: audit 2024-08-31T04:52:52.832247+0000 mgr.a (mgr.14388) 6989 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:52:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:54 smithi163 bash[24253]: cluster 2024-08-31T04:52:53.456826+0000 mgr.a (mgr.14388) 6990 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:54 smithi163 bash[24253]: audit 2024-08-31T04:52:53.564418+0000 mgr.a (mgr.14388) 6991 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:52:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:54 smithi163 bash[24253]: cephadm 2024-08-31T04:52:53.565663+0000 mgr.a (mgr.14388) 6992 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:52:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:54 smithi027 bash[22610]: cluster 2024-08-31T04:52:53.456826+0000 mgr.a (mgr.14388) 6990 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:54 smithi027 bash[22610]: audit 2024-08-31T04:52:53.564418+0000 mgr.a (mgr.14388) 6991 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:52:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:54 smithi027 bash[22610]: cephadm 2024-08-31T04:52:53.565663+0000 mgr.a (mgr.14388) 6992 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:52:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:54 smithi191 bash[24992]: cluster 2024-08-31T04:52:53.456826+0000 mgr.a (mgr.14388) 6990 : cluster [DBG] pgmap v4845: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:52:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:54 smithi191 bash[24992]: audit 2024-08-31T04:52:53.564418+0000 mgr.a (mgr.14388) 6991 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:52:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:54 smithi191 bash[24992]: cephadm 2024-08-31T04:52:53.565663+0000 mgr.a (mgr.14388) 6992 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:52:55.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:52:55.534 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:52:55.534 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:52:56.299 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:52:56.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:52:56.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:52:56.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:52:56.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:52:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:56 smithi163 bash[24253]: cluster 2024-08-31T04:52:55.457554+0000 mgr.a (mgr.14388) 6993 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:57.320 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:56 smithi163 bash[24253]: audit 2024-08-31T04:52:55.874099+0000 mgr.a (mgr.14388) 6994 : audit [DBG] from='client.159285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:57.321 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:56 smithi191 bash[24992]: cluster 2024-08-31T04:52:55.457554+0000 mgr.a (mgr.14388) 6993 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:57.321 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:56 smithi191 bash[24992]: audit 2024-08-31T04:52:55.874099+0000 mgr.a (mgr.14388) 6994 : audit [DBG] from='client.159285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:57.322 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:56 smithi027 bash[22610]: cluster 2024-08-31T04:52:55.457554+0000 mgr.a (mgr.14388) 6993 : cluster [DBG] pgmap v4846: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:57.322 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:56 smithi027 bash[22610]: audit 2024-08-31T04:52:55.874099+0000 mgr.a (mgr.14388) 6994 : audit [DBG] from='client.159285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:52:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:52:58 smithi163 bash[24253]: cluster 2024-08-31T04:52:57.458455+0000 mgr.a (mgr.14388) 6995 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:52:58 smithi027 bash[22610]: cluster 2024-08-31T04:52:57.458455+0000 mgr.a (mgr.14388) 6995 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:52:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:52:58 smithi191 bash[24992]: cluster 2024-08-31T04:52:57.458455+0000 mgr.a (mgr.14388) 6995 : cluster [DBG] pgmap v4847: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:00 smithi163 bash[24253]: cluster 2024-08-31T04:52:59.460706+0000 mgr.a (mgr.14388) 6996 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:00 smithi027 bash[22610]: cluster 2024-08-31T04:52:59.460706+0000 mgr.a (mgr.14388) 6996 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:00 smithi191 bash[24992]: cluster 2024-08-31T04:52:59.460706+0000 mgr.a (mgr.14388) 6996 : cluster [DBG] pgmap v4848: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:01.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:01.302 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:01.302 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:02.076 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:02.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:02.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:02.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:02.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:53:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:02 smithi163 bash[24253]: cluster 2024-08-31T04:53:01.461245+0000 mgr.a (mgr.14388) 6997 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:02 smithi163 bash[24253]: audit 2024-08-31T04:53:01.635453+0000 mgr.a (mgr.14388) 6998 : audit [DBG] from='client.159363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:03.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:02 smithi027 bash[22610]: cluster 2024-08-31T04:53:01.461245+0000 mgr.a (mgr.14388) 6997 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:02 smithi027 bash[22610]: audit 2024-08-31T04:53:01.635453+0000 mgr.a (mgr.14388) 6998 : audit [DBG] from='client.159363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:02 smithi191 bash[24992]: cluster 2024-08-31T04:53:01.461245+0000 mgr.a (mgr.14388) 6997 : cluster [DBG] pgmap v4849: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:02 smithi191 bash[24992]: audit 2024-08-31T04:53:01.635453+0000 mgr.a (mgr.14388) 6998 : audit [DBG] from='client.159363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:04 smithi163 bash[24253]: cluster 2024-08-31T04:53:03.463510+0000 mgr.a (mgr.14388) 6999 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:04 smithi027 bash[22610]: cluster 2024-08-31T04:53:03.463510+0000 mgr.a (mgr.14388) 6999 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:04 smithi191 bash[24992]: cluster 2024-08-31T04:53:03.463510+0000 mgr.a (mgr.14388) 6999 : cluster [DBG] pgmap v4850: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:07.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:07.078 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:07.078 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:06 smithi163 bash[24253]: cluster 2024-08-31T04:53:05.464281+0000 mgr.a (mgr.14388) 7000 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:07.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:06 smithi027 bash[22610]: cluster 2024-08-31T04:53:05.464281+0000 mgr.a (mgr.14388) 7000 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:06 smithi191 bash[24992]: cluster 2024-08-31T04:53:05.464281+0000 mgr.a (mgr.14388) 7000 : cluster [DBG] pgmap v4851: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:07.831 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:07.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:07.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:07.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:07.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:53:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:08 smithi191 bash[24992]: audit 2024-08-31T04:53:07.412930+0000 mgr.a (mgr.14388) 7001 : audit [DBG] from='client.159441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:08 smithi191 bash[24992]: cluster 2024-08-31T04:53:07.465258+0000 mgr.a (mgr.14388) 7002 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:08 smithi163 bash[24253]: audit 2024-08-31T04:53:07.412930+0000 mgr.a (mgr.14388) 7001 : audit [DBG] from='client.159441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:08 smithi163 bash[24253]: cluster 2024-08-31T04:53:07.465258+0000 mgr.a (mgr.14388) 7002 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:08.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:08 smithi027 bash[22610]: audit 2024-08-31T04:53:07.412930+0000 mgr.a (mgr.14388) 7001 : audit [DBG] from='client.159441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:08 smithi027 bash[22610]: cluster 2024-08-31T04:53:07.465258+0000 mgr.a (mgr.14388) 7002 : cluster [DBG] pgmap v4852: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:10 smithi191 bash[24992]: cluster 2024-08-31T04:53:09.467753+0000 mgr.a (mgr.14388) 7003 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:10 smithi163 bash[24253]: cluster 2024-08-31T04:53:09.467753+0000 mgr.a (mgr.14388) 7003 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:10.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:10 smithi027 bash[22610]: cluster 2024-08-31T04:53:09.467753+0000 mgr.a (mgr.14388) 7003 : cluster [DBG] pgmap v4853: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:53:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:12 smithi191 bash[24992]: cluster 2024-08-31T04:53:11.468705+0000 mgr.a (mgr.14388) 7004 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:12.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:12.834 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:12.834 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:12 smithi163 bash[24253]: cluster 2024-08-31T04:53:11.468705+0000 mgr.a (mgr.14388) 7004 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:12.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:12 smithi027 bash[22610]: cluster 2024-08-31T04:53:11.468705+0000 mgr.a (mgr.14388) 7004 : cluster [DBG] pgmap v4854: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:13.616 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:13.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:13.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:13.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:13.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:53:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:14 smithi191 bash[24992]: audit 2024-08-31T04:53:13.177778+0000 mgr.a (mgr.14388) 7005 : audit [DBG] from='client.159519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:14 smithi191 bash[24992]: cluster 2024-08-31T04:53:13.470069+0000 mgr.a (mgr.14388) 7006 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:14 smithi163 bash[24253]: audit 2024-08-31T04:53:13.177778+0000 mgr.a (mgr.14388) 7005 : audit [DBG] from='client.159519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:14 smithi163 bash[24253]: cluster 2024-08-31T04:53:13.470069+0000 mgr.a (mgr.14388) 7006 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:14.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:14 smithi027 bash[22610]: audit 2024-08-31T04:53:13.177778+0000 mgr.a (mgr.14388) 7005 : audit [DBG] from='client.159519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:14 smithi027 bash[22610]: cluster 2024-08-31T04:53:13.470069+0000 mgr.a (mgr.14388) 7006 : cluster [DBG] pgmap v4855: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:16 smithi191 bash[24992]: cluster 2024-08-31T04:53:15.470957+0000 mgr.a (mgr.14388) 7007 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:16 smithi163 bash[24253]: cluster 2024-08-31T04:53:15.470957+0000 mgr.a (mgr.14388) 7007 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:16.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:16 smithi027 bash[22610]: cluster 2024-08-31T04:53:15.470957+0000 mgr.a (mgr.14388) 7007 : cluster [DBG] pgmap v4856: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:18.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:18.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:18.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:18 smithi163 bash[24253]: cluster 2024-08-31T04:53:17.471737+0000 mgr.a (mgr.14388) 7008 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:53:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:18 smithi027 bash[22610]: cluster 2024-08-31T04:53:17.471737+0000 mgr.a (mgr.14388) 7008 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:53:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:18 smithi191 bash[24992]: cluster 2024-08-31T04:53:17.471737+0000 mgr.a (mgr.14388) 7008 : cluster [DBG] pgmap v4857: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:53:19.390 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:19.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:19.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:19.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:19.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:53:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:20 smithi163 bash[24253]: audit 2024-08-31T04:53:18.954527+0000 mgr.a (mgr.14388) 7009 : audit [DBG] from='client.159597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:20 smithi163 bash[24253]: cluster 2024-08-31T04:53:19.474033+0000 mgr.a (mgr.14388) 7010 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:20 smithi027 bash[22610]: audit 2024-08-31T04:53:18.954527+0000 mgr.a (mgr.14388) 7009 : audit [DBG] from='client.159597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:20 smithi027 bash[22610]: cluster 2024-08-31T04:53:19.474033+0000 mgr.a (mgr.14388) 7010 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:20 smithi191 bash[24992]: audit 2024-08-31T04:53:18.954527+0000 mgr.a (mgr.14388) 7009 : audit [DBG] from='client.159597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:20 smithi191 bash[24992]: cluster 2024-08-31T04:53:19.474033+0000 mgr.a (mgr.14388) 7010 : cluster [DBG] pgmap v4858: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:22.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:22 smithi163 bash[24253]: cluster 2024-08-31T04:53:21.474830+0000 mgr.a (mgr.14388) 7011 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:22.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:22 smithi027 bash[22610]: cluster 2024-08-31T04:53:21.474830+0000 mgr.a (mgr.14388) 7011 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:22 smithi191 bash[24992]: cluster 2024-08-31T04:53:21.474830+0000 mgr.a (mgr.14388) 7011 : cluster [DBG] pgmap v4859: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:24.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:24.392 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:24.392 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:24 smithi163 bash[24253]: cluster 2024-08-31T04:53:23.476749+0000 mgr.a (mgr.14388) 7012 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:24 smithi027 bash[22610]: cluster 2024-08-31T04:53:23.476749+0000 mgr.a (mgr.14388) 7012 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:24 smithi191 bash[24992]: cluster 2024-08-31T04:53:23.476749+0000 mgr.a (mgr.14388) 7012 : cluster [DBG] pgmap v4860: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:25.169 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:25.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:25.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:25.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:25.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:53:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:25 smithi163 bash[24253]: audit 2024-08-31T04:53:24.734165+0000 mgr.a (mgr.14388) 7013 : audit [DBG] from='client.159675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:25.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:25 smithi027 bash[22610]: audit 2024-08-31T04:53:24.734165+0000 mgr.a (mgr.14388) 7013 : audit [DBG] from='client.159675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:25 smithi191 bash[24992]: audit 2024-08-31T04:53:24.734165+0000 mgr.a (mgr.14388) 7013 : audit [DBG] from='client.159675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:26 smithi163 bash[24253]: cluster 2024-08-31T04:53:25.477643+0000 mgr.a (mgr.14388) 7014 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:26.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:26 smithi027 bash[22610]: cluster 2024-08-31T04:53:25.477643+0000 mgr.a (mgr.14388) 7014 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:26 smithi191 bash[24992]: cluster 2024-08-31T04:53:25.477643+0000 mgr.a (mgr.14388) 7014 : cluster [DBG] pgmap v4861: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:28 smithi163 bash[24253]: cluster 2024-08-31T04:53:27.478568+0000 mgr.a (mgr.14388) 7015 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:28.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:28 smithi027 bash[22610]: cluster 2024-08-31T04:53:27.478568+0000 mgr.a (mgr.14388) 7015 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:28 smithi191 bash[24992]: cluster 2024-08-31T04:53:27.478568+0000 mgr.a (mgr.14388) 7015 : cluster [DBG] pgmap v4862: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:30.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:30.171 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:30.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:30 smithi163 bash[24253]: cluster 2024-08-31T04:53:29.480856+0000 mgr.a (mgr.14388) 7016 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:30.952 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:30.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:30.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:30.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:30.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:53:30.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:30 smithi027 bash[22610]: cluster 2024-08-31T04:53:29.480856+0000 mgr.a (mgr.14388) 7016 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:30 smithi191 bash[24992]: cluster 2024-08-31T04:53:29.480856+0000 mgr.a (mgr.14388) 7016 : cluster [DBG] pgmap v4863: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:31 smithi163 bash[24253]: audit 2024-08-31T04:53:30.505785+0000 mgr.a (mgr.14388) 7017 : audit [DBG] from='client.159753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:31.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:31 smithi027 bash[22610]: audit 2024-08-31T04:53:30.505785+0000 mgr.a (mgr.14388) 7017 : audit [DBG] from='client.159753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:31 smithi191 bash[24992]: audit 2024-08-31T04:53:30.505785+0000 mgr.a (mgr.14388) 7017 : audit [DBG] from='client.159753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:32 smithi163 bash[24253]: cluster 2024-08-31T04:53:31.482005+0000 mgr.a (mgr.14388) 7018 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:32.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:32 smithi027 bash[22610]: cluster 2024-08-31T04:53:31.482005+0000 mgr.a (mgr.14388) 7018 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:32 smithi191 bash[24992]: cluster 2024-08-31T04:53:31.482005+0000 mgr.a (mgr.14388) 7018 : cluster [DBG] pgmap v4864: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:34 smithi163 bash[24253]: cluster 2024-08-31T04:53:33.484381+0000 mgr.a (mgr.14388) 7019 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:34.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:34 smithi027 bash[22610]: cluster 2024-08-31T04:53:33.484381+0000 mgr.a (mgr.14388) 7019 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:34 smithi191 bash[24992]: cluster 2024-08-31T04:53:33.484381+0000 mgr.a (mgr.14388) 7019 : cluster [DBG] pgmap v4865: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:35.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:35.954 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:35.954 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:36.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:36.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:36.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:36.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:53:36.733 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:36 smithi163 bash[24253]: cluster 2024-08-31T04:53:35.485331+0000 mgr.a (mgr.14388) 7020 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:36.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:36 smithi027 bash[22610]: cluster 2024-08-31T04:53:35.485331+0000 mgr.a (mgr.14388) 7020 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:36 smithi191 bash[24992]: cluster 2024-08-31T04:53:35.485331+0000 mgr.a (mgr.14388) 7020 : cluster [DBG] pgmap v4866: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:37 smithi163 bash[24253]: audit 2024-08-31T04:53:36.288562+0000 mgr.a (mgr.14388) 7021 : audit [DBG] from='client.159831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:37.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:37 smithi027 bash[22610]: audit 2024-08-31T04:53:36.288562+0000 mgr.a (mgr.14388) 7021 : audit [DBG] from='client.159831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:37 smithi191 bash[24992]: audit 2024-08-31T04:53:36.288562+0000 mgr.a (mgr.14388) 7021 : audit [DBG] from='client.159831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:38 smithi163 bash[24253]: cluster 2024-08-31T04:53:37.486345+0000 mgr.a (mgr.14388) 7022 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:38.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:38 smithi027 bash[22610]: cluster 2024-08-31T04:53:37.486345+0000 mgr.a (mgr.14388) 7022 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:38 smithi191 bash[24992]: cluster 2024-08-31T04:53:37.486345+0000 mgr.a (mgr.14388) 7022 : cluster [DBG] pgmap v4867: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:40 smithi163 bash[24253]: cluster 2024-08-31T04:53:39.488581+0000 mgr.a (mgr.14388) 7023 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:40.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:40 smithi027 bash[22610]: cluster 2024-08-31T04:53:39.488581+0000 mgr.a (mgr.14388) 7023 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:40 smithi191 bash[24992]: cluster 2024-08-31T04:53:39.488581+0000 mgr.a (mgr.14388) 7023 : cluster [DBG] pgmap v4868: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:41.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:41.734 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:41.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:42.483 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:42.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:42.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:42.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:42.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:53:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:42 smithi163 bash[24253]: cluster 2024-08-31T04:53:41.489353+0000 mgr.a (mgr.14388) 7024 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:42.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:42 smithi027 bash[22610]: cluster 2024-08-31T04:53:41.489353+0000 mgr.a (mgr.14388) 7024 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:42 smithi191 bash[24992]: cluster 2024-08-31T04:53:41.489353+0000 mgr.a (mgr.14388) 7024 : cluster [DBG] pgmap v4869: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:43 smithi163 bash[24253]: audit 2024-08-31T04:53:42.064254+0000 mgr.a (mgr.14388) 7025 : audit [DBG] from='client.159900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:43.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:43 smithi027 bash[22610]: audit 2024-08-31T04:53:42.064254+0000 mgr.a (mgr.14388) 7025 : audit [DBG] from='client.159900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:43 smithi191 bash[24992]: audit 2024-08-31T04:53:42.064254+0000 mgr.a (mgr.14388) 7025 : audit [DBG] from='client.159900 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:44 smithi163 bash[24253]: cluster 2024-08-31T04:53:43.491841+0000 mgr.a (mgr.14388) 7026 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:44.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:44 smithi027 bash[22610]: cluster 2024-08-31T04:53:43.491841+0000 mgr.a (mgr.14388) 7026 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:44 smithi191 bash[24992]: cluster 2024-08-31T04:53:43.491841+0000 mgr.a (mgr.14388) 7026 : cluster [DBG] pgmap v4870: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:53:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:46 smithi163 bash[24253]: cluster 2024-08-31T04:53:45.492807+0000 mgr.a (mgr.14388) 7027 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:46.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:46 smithi027 bash[22610]: cluster 2024-08-31T04:53:45.492807+0000 mgr.a (mgr.14388) 7027 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:46 smithi191 bash[24992]: cluster 2024-08-31T04:53:45.492807+0000 mgr.a (mgr.14388) 7027 : cluster [DBG] pgmap v4871: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:47.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:47.486 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:47.486 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:48.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:48.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:48.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:48.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:53:48.270 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:48 smithi163 bash[24253]: cluster 2024-08-31T04:53:47.493387+0000 mgr.a (mgr.14388) 7028 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:48 smithi163 bash[24253]: audit 2024-08-31T04:53:47.825270+0000 mgr.a (mgr.14388) 7029 : audit [DBG] from='client.159975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:48.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:48 smithi027 bash[22610]: cluster 2024-08-31T04:53:47.493387+0000 mgr.a (mgr.14388) 7028 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:48.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:48 smithi027 bash[22610]: audit 2024-08-31T04:53:47.825270+0000 mgr.a (mgr.14388) 7029 : audit [DBG] from='client.159975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:48 smithi191 bash[24992]: cluster 2024-08-31T04:53:47.493387+0000 mgr.a (mgr.14388) 7028 : cluster [DBG] pgmap v4872: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:48 smithi191 bash[24992]: audit 2024-08-31T04:53:47.825270+0000 mgr.a (mgr.14388) 7029 : audit [DBG] from='client.159975 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:50 smithi163 bash[24253]: cluster 2024-08-31T04:53:49.496187+0000 mgr.a (mgr.14388) 7030 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:50.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:50 smithi027 bash[22610]: cluster 2024-08-31T04:53:49.496187+0000 mgr.a (mgr.14388) 7030 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:50 smithi191 bash[24992]: cluster 2024-08-31T04:53:49.496187+0000 mgr.a (mgr.14388) 7030 : cluster [DBG] pgmap v4873: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:52 smithi163 bash[24253]: cluster 2024-08-31T04:53:51.497002+0000 mgr.a (mgr.14388) 7031 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:52.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:52 smithi027 bash[22610]: cluster 2024-08-31T04:53:51.497002+0000 mgr.a (mgr.14388) 7031 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:52 smithi191 bash[24992]: cluster 2024-08-31T04:53:51.497002+0000 mgr.a (mgr.14388) 7031 : cluster [DBG] pgmap v4874: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:53.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:53.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:53.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:53 smithi163 bash[24253]: audit 2024-08-31T04:53:53.623202+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:53:53.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:53 smithi027 bash[22610]: audit 2024-08-31T04:53:53.623202+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:53:54.029 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:53:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:53 smithi191 bash[24992]: audit 2024-08-31T04:53:53.623202+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:53:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:54 smithi163 bash[24253]: cluster 2024-08-31T04:53:53.498969+0000 mgr.a (mgr.14388) 7032 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:54 smithi163 bash[24253]: audit 2024-08-31T04:53:53.604011+0000 mgr.a (mgr.14388) 7033 : audit [DBG] from='client.160053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:54 smithi163 bash[24253]: audit 2024-08-31T04:53:54.221308+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:53:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:54 smithi163 bash[24253]: audit 2024-08-31T04:53:54.227177+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:53:54.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:54 smithi027 bash[22610]: cluster 2024-08-31T04:53:53.498969+0000 mgr.a (mgr.14388) 7032 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:54 smithi027 bash[22610]: audit 2024-08-31T04:53:53.604011+0000 mgr.a (mgr.14388) 7033 : audit [DBG] from='client.160053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:54 smithi027 bash[22610]: audit 2024-08-31T04:53:54.221308+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:53:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:54 smithi027 bash[22610]: audit 2024-08-31T04:53:54.227177+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:53:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:54 smithi191 bash[24992]: cluster 2024-08-31T04:53:53.498969+0000 mgr.a (mgr.14388) 7032 : cluster [DBG] pgmap v4875: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:53:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:54 smithi191 bash[24992]: audit 2024-08-31T04:53:53.604011+0000 mgr.a (mgr.14388) 7033 : audit [DBG] from='client.160053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:53:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:54 smithi191 bash[24992]: audit 2024-08-31T04:53:54.221308+0000 mon.a (mon.0) 1637 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:53:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:54 smithi191 bash[24992]: audit 2024-08-31T04:53:54.227177+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:53:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:55 smithi163 bash[24253]: audit 2024-08-31T04:53:55.019197+0000 mon.a (mon.0) 1639 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:53:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:55 smithi163 bash[24253]: audit 2024-08-31T04:53:55.020427+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:53:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:55 smithi163 bash[24253]: audit 2024-08-31T04:53:55.029593+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:53:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:55 smithi163 bash[24253]: audit 2024-08-31T04:53:55.032538+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:53:55.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:53:55 smithi027 bash[22863]: debug 2024-08-31T04:53:55.752+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:53:55.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:53:55 smithi027 bash[22863]: debug 2024-08-31T04:53:55.752+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:53:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:55 smithi027 bash[22610]: audit 2024-08-31T04:53:55.019197+0000 mon.a (mon.0) 1639 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:53:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:55 smithi027 bash[22610]: audit 2024-08-31T04:53:55.020427+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:53:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:55 smithi027 bash[22610]: audit 2024-08-31T04:53:55.029593+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:53:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:55 smithi027 bash[22610]: audit 2024-08-31T04:53:55.032538+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:53:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:55 smithi191 bash[24992]: audit 2024-08-31T04:53:55.019197+0000 mon.a (mon.0) 1639 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:53:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:55 smithi191 bash[24992]: audit 2024-08-31T04:53:55.020427+0000 mon.a (mon.0) 1640 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:53:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:55 smithi191 bash[24992]: audit 2024-08-31T04:53:55.029593+0000 mon.a (mon.0) 1641 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:53:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:55 smithi191 bash[24992]: audit 2024-08-31T04:53:55.032538+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:53:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:56 smithi163 bash[24253]: audit 2024-08-31T04:53:55.035210+0000 mgr.a (mgr.14388) 7034 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:53:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:56 smithi163 bash[24253]: cluster 2024-08-31T04:53:55.499480+0000 mgr.a (mgr.14388) 7035 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:56 smithi163 bash[24253]: audit 2024-08-31T04:53:55.755163+0000 mgr.a (mgr.14388) 7036 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:53:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:56 smithi163 bash[24253]: cephadm 2024-08-31T04:53:55.756260+0000 mgr.a (mgr.14388) 7037 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:53:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:56 smithi027 bash[22610]: audit 2024-08-31T04:53:55.035210+0000 mgr.a (mgr.14388) 7034 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:53:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:56 smithi027 bash[22610]: cluster 2024-08-31T04:53:55.499480+0000 mgr.a (mgr.14388) 7035 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:56 smithi027 bash[22610]: audit 2024-08-31T04:53:55.755163+0000 mgr.a (mgr.14388) 7036 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:53:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:56 smithi027 bash[22610]: cephadm 2024-08-31T04:53:55.756260+0000 mgr.a (mgr.14388) 7037 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:53:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:56 smithi191 bash[24992]: audit 2024-08-31T04:53:55.035210+0000 mgr.a (mgr.14388) 7034 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:53:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:56 smithi191 bash[24992]: cluster 2024-08-31T04:53:55.499480+0000 mgr.a (mgr.14388) 7035 : cluster [DBG] pgmap v4876: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:53:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:56 smithi191 bash[24992]: audit 2024-08-31T04:53:55.755163+0000 mgr.a (mgr.14388) 7036 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:53:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:56 smithi191 bash[24992]: cephadm 2024-08-31T04:53:55.756260+0000 mgr.a (mgr.14388) 7037 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:53:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:53:58 smithi163 bash[24253]: cluster 2024-08-31T04:53:57.500344+0000 mgr.a (mgr.14388) 7038 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:53:58.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:53:58 smithi027 bash[22610]: cluster 2024-08-31T04:53:57.500344+0000 mgr.a (mgr.14388) 7038 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:53:59.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:53:59.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:53:59.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:53:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:53:58 smithi191 bash[24992]: cluster 2024-08-31T04:53:57.500344+0000 mgr.a (mgr.14388) 7038 : cluster [DBG] pgmap v4877: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:53:59.778 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:53:59.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:53:59.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:53:59.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:53:59.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:00 smithi163 bash[24253]: audit 2024-08-31T04:53:59.362697+0000 mgr.a (mgr.14388) 7039 : audit [DBG] from='client.160239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:00 smithi163 bash[24253]: cluster 2024-08-31T04:53:59.501674+0000 mgr.a (mgr.14388) 7040 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:00 smithi027 bash[22610]: audit 2024-08-31T04:53:59.362697+0000 mgr.a (mgr.14388) 7039 : audit [DBG] from='client.160239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:00 smithi027 bash[22610]: cluster 2024-08-31T04:53:59.501674+0000 mgr.a (mgr.14388) 7040 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:00 smithi191 bash[24992]: audit 2024-08-31T04:53:59.362697+0000 mgr.a (mgr.14388) 7039 : audit [DBG] from='client.160239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:00 smithi191 bash[24992]: cluster 2024-08-31T04:53:59.501674+0000 mgr.a (mgr.14388) 7040 : cluster [DBG] pgmap v4878: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:02 smithi163 bash[24253]: cluster 2024-08-31T04:54:01.502495+0000 mgr.a (mgr.14388) 7041 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:02.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:02 smithi027 bash[22610]: cluster 2024-08-31T04:54:01.502495+0000 mgr.a (mgr.14388) 7041 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:02 smithi191 bash[24992]: cluster 2024-08-31T04:54:01.502495+0000 mgr.a (mgr.14388) 7041 : cluster [DBG] pgmap v4879: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:54:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:54:04.780 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:54:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:04 smithi163 bash[24253]: cluster 2024-08-31T04:54:03.504644+0000 mgr.a (mgr.14388) 7042 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:04.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:04 smithi027 bash[22610]: cluster 2024-08-31T04:54:03.504644+0000 mgr.a (mgr.14388) 7042 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:04 smithi191 bash[24992]: cluster 2024-08-31T04:54:03.504644+0000 mgr.a (mgr.14388) 7042 : cluster [DBG] pgmap v4880: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:05.550 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:54:05.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:54:05.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:54:05.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:54:05.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:06 smithi163 bash[24253]: audit 2024-08-31T04:54:05.117428+0000 mgr.a (mgr.14388) 7043 : audit [DBG] from='client.160314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:06 smithi163 bash[24253]: cluster 2024-08-31T04:54:05.505195+0000 mgr.a (mgr.14388) 7044 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:06 smithi027 bash[22610]: audit 2024-08-31T04:54:05.117428+0000 mgr.a (mgr.14388) 7043 : audit [DBG] from='client.160314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:06 smithi027 bash[22610]: cluster 2024-08-31T04:54:05.505195+0000 mgr.a (mgr.14388) 7044 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:06 smithi191 bash[24992]: audit 2024-08-31T04:54:05.117428+0000 mgr.a (mgr.14388) 7043 : audit [DBG] from='client.160314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:06 smithi191 bash[24992]: cluster 2024-08-31T04:54:05.505195+0000 mgr.a (mgr.14388) 7044 : cluster [DBG] pgmap v4881: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:08 smithi163 bash[24253]: cluster 2024-08-31T04:54:07.505980+0000 mgr.a (mgr.14388) 7045 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:08 smithi027 bash[22610]: cluster 2024-08-31T04:54:07.505980+0000 mgr.a (mgr.14388) 7045 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:08 smithi191 bash[24992]: cluster 2024-08-31T04:54:07.505980+0000 mgr.a (mgr.14388) 7045 : cluster [DBG] pgmap v4882: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:10.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:54:10.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:54:10.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:54:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:10 smithi163 bash[24253]: cluster 2024-08-31T04:54:09.508271+0000 mgr.a (mgr.14388) 7046 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:10.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:10 smithi027 bash[22610]: cluster 2024-08-31T04:54:09.508271+0000 mgr.a (mgr.14388) 7046 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:10 smithi191 bash[24992]: cluster 2024-08-31T04:54:09.508271+0000 mgr.a (mgr.14388) 7046 : cluster [DBG] pgmap v4883: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:54:11.319 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:54:11.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:54:11.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:54:11.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:54:11.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:11 smithi163 bash[24253]: audit 2024-08-31T04:54:10.891672+0000 mgr.a (mgr.14388) 7047 : audit [DBG] from='client.160392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:11 smithi027 bash[22610]: audit 2024-08-31T04:54:10.891672+0000 mgr.a (mgr.14388) 7047 : audit [DBG] from='client.160392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:11 smithi191 bash[24992]: audit 2024-08-31T04:54:10.891672+0000 mgr.a (mgr.14388) 7047 : audit [DBG] from='client.160392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:12 smithi163 bash[24253]: cluster 2024-08-31T04:54:11.509387+0000 mgr.a (mgr.14388) 7048 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:12.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:12 smithi027 bash[22610]: cluster 2024-08-31T04:54:11.509387+0000 mgr.a (mgr.14388) 7048 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:12 smithi191 bash[24992]: cluster 2024-08-31T04:54:11.509387+0000 mgr.a (mgr.14388) 7048 : cluster [DBG] pgmap v4884: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:14.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:14 smithi027 bash[22610]: cluster 2024-08-31T04:54:13.511647+0000 mgr.a (mgr.14388) 7049 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:14 smithi191 bash[24992]: cluster 2024-08-31T04:54:13.511647+0000 mgr.a (mgr.14388) 7049 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:14 smithi163 bash[24253]: cluster 2024-08-31T04:54:13.511647+0000 mgr.a (mgr.14388) 7049 : cluster [DBG] pgmap v4885: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:16.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:54:16.322 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:54:16.322 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:54:16.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:16 smithi027 bash[22610]: cluster 2024-08-31T04:54:15.512426+0000 mgr.a (mgr.14388) 7050 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:16 smithi191 bash[24992]: cluster 2024-08-31T04:54:15.512426+0000 mgr.a (mgr.14388) 7050 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:17.067 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:54:17.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:54:17.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:54:17.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:54:17.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:16 smithi163 bash[24253]: cluster 2024-08-31T04:54:15.512426+0000 mgr.a (mgr.14388) 7050 : cluster [DBG] pgmap v4886: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:17.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:17 smithi027 bash[22610]: audit 2024-08-31T04:54:16.656564+0000 mgr.a (mgr.14388) 7051 : audit [DBG] from='client.160470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:17 smithi191 bash[24992]: audit 2024-08-31T04:54:16.656564+0000 mgr.a (mgr.14388) 7051 : audit [DBG] from='client.160470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:17 smithi163 bash[24253]: audit 2024-08-31T04:54:16.656564+0000 mgr.a (mgr.14388) 7051 : audit [DBG] from='client.160470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:18 smithi027 bash[22610]: cluster 2024-08-31T04:54:17.513388+0000 mgr.a (mgr.14388) 7052 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:18 smithi191 bash[24992]: cluster 2024-08-31T04:54:17.513388+0000 mgr.a (mgr.14388) 7052 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:18 smithi163 bash[24253]: cluster 2024-08-31T04:54:17.513388+0000 mgr.a (mgr.14388) 7052 : cluster [DBG] pgmap v4887: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:20 smithi027 bash[22610]: cluster 2024-08-31T04:54:19.515665+0000 mgr.a (mgr.14388) 7053 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:20 smithi191 bash[24992]: cluster 2024-08-31T04:54:19.515665+0000 mgr.a (mgr.14388) 7053 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:20 smithi163 bash[24253]: cluster 2024-08-31T04:54:19.515665+0000 mgr.a (mgr.14388) 7053 : cluster [DBG] pgmap v4888: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:22.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:54:22.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:54:22.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:54:22.855 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:54:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:54:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:54:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:54:22.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:22.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:22 smithi027 bash[22610]: cluster 2024-08-31T04:54:21.516427+0000 mgr.a (mgr.14388) 7054 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:22 smithi191 bash[24992]: cluster 2024-08-31T04:54:21.516427+0000 mgr.a (mgr.14388) 7054 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:22 smithi163 bash[24253]: cluster 2024-08-31T04:54:21.516427+0000 mgr.a (mgr.14388) 7054 : cluster [DBG] pgmap v4889: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:23 smithi191 bash[24992]: audit 2024-08-31T04:54:22.408681+0000 mgr.a (mgr.14388) 7055 : audit [DBG] from='client.160545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:23 smithi163 bash[24253]: audit 2024-08-31T04:54:22.408681+0000 mgr.a (mgr.14388) 7055 : audit [DBG] from='client.160545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:24.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:23 smithi027 bash[22610]: audit 2024-08-31T04:54:22.408681+0000 mgr.a (mgr.14388) 7055 : audit [DBG] from='client.160545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:24 smithi191 bash[24992]: cluster 2024-08-31T04:54:23.518819+0000 mgr.a (mgr.14388) 7056 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:24 smithi163 bash[24253]: cluster 2024-08-31T04:54:23.518819+0000 mgr.a (mgr.14388) 7056 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:24 smithi027 bash[22610]: cluster 2024-08-31T04:54:23.518819+0000 mgr.a (mgr.14388) 7056 : cluster [DBG] pgmap v4890: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:26 smithi191 bash[24992]: cluster 2024-08-31T04:54:25.519707+0000 mgr.a (mgr.14388) 7057 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:26 smithi163 bash[24253]: cluster 2024-08-31T04:54:25.519707+0000 mgr.a (mgr.14388) 7057 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:27.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:26 smithi027 bash[22610]: cluster 2024-08-31T04:54:25.519707+0000 mgr.a (mgr.14388) 7057 : cluster [DBG] pgmap v4891: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:27.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:54:27.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:54:27.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:54:28.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:54:28.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:54:28.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:54:28.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:54:28.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:28 smithi191 bash[24992]: cluster 2024-08-31T04:54:27.520591+0000 mgr.a (mgr.14388) 7058 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:28 smithi163 bash[24253]: cluster 2024-08-31T04:54:27.520591+0000 mgr.a (mgr.14388) 7058 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:29.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:28 smithi027 bash[22610]: cluster 2024-08-31T04:54:27.520591+0000 mgr.a (mgr.14388) 7058 : cluster [DBG] pgmap v4892: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:29 smithi191 bash[24992]: audit 2024-08-31T04:54:28.188993+0000 mgr.a (mgr.14388) 7059 : audit [DBG] from='client.160623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:29 smithi163 bash[24253]: audit 2024-08-31T04:54:28.188993+0000 mgr.a (mgr.14388) 7059 : audit [DBG] from='client.160623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:30.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:29 smithi027 bash[22610]: audit 2024-08-31T04:54:28.188993+0000 mgr.a (mgr.14388) 7059 : audit [DBG] from='client.160623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:30 smithi191 bash[24992]: cluster 2024-08-31T04:54:29.523509+0000 mgr.a (mgr.14388) 7060 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:30 smithi163 bash[24253]: cluster 2024-08-31T04:54:29.523509+0000 mgr.a (mgr.14388) 7060 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:31.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:30 smithi027 bash[22610]: cluster 2024-08-31T04:54:29.523509+0000 mgr.a (mgr.14388) 7060 : cluster [DBG] pgmap v4893: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:32 smithi191 bash[24992]: cluster 2024-08-31T04:54:31.524308+0000 mgr.a (mgr.14388) 7061 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:54:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:32 smithi163 bash[24253]: cluster 2024-08-31T04:54:31.524308+0000 mgr.a (mgr.14388) 7061 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:54:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:32 smithi027 bash[22610]: cluster 2024-08-31T04:54:31.524308+0000 mgr.a (mgr.14388) 7061 : cluster [DBG] pgmap v4894: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:54:33.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:54:33.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:54:33.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:54:34.352 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:54:34.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:54:34.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:54:34.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:54:34.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:34 smithi191 bash[24992]: cluster 2024-08-31T04:54:33.526231+0000 mgr.a (mgr.14388) 7062 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:34 smithi191 bash[24992]: audit 2024-08-31T04:54:33.931160+0000 mgr.a (mgr.14388) 7063 : audit [DBG] from='client.160701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:34 smithi163 bash[24253]: cluster 2024-08-31T04:54:33.526231+0000 mgr.a (mgr.14388) 7062 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:34 smithi163 bash[24253]: audit 2024-08-31T04:54:33.931160+0000 mgr.a (mgr.14388) 7063 : audit [DBG] from='client.160701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:34 smithi027 bash[22610]: cluster 2024-08-31T04:54:33.526231+0000 mgr.a (mgr.14388) 7062 : cluster [DBG] pgmap v4895: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:34 smithi027 bash[22610]: audit 2024-08-31T04:54:33.931160+0000 mgr.a (mgr.14388) 7063 : audit [DBG] from='client.160701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:36 smithi191 bash[24992]: cluster 2024-08-31T04:54:35.527384+0000 mgr.a (mgr.14388) 7064 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:54:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:36 smithi163 bash[24253]: cluster 2024-08-31T04:54:35.527384+0000 mgr.a (mgr.14388) 7064 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:54:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:36 smithi027 bash[22610]: cluster 2024-08-31T04:54:35.527384+0000 mgr.a (mgr.14388) 7064 : cluster [DBG] pgmap v4896: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:54:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:38 smithi191 bash[24992]: cluster 2024-08-31T04:54:37.528349+0000 mgr.a (mgr.14388) 7065 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:54:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:38 smithi163 bash[24253]: cluster 2024-08-31T04:54:37.528349+0000 mgr.a (mgr.14388) 7065 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:54:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:38 smithi027 bash[22610]: cluster 2024-08-31T04:54:37.528349+0000 mgr.a (mgr.14388) 7065 : cluster [DBG] pgmap v4897: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:54:39.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:54:39.354 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:54:39.354 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:54:40.128 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:54:40.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:54:40.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:54:40.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:54:40.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:40 smithi191 bash[24992]: cluster 2024-08-31T04:54:39.529770+0000 mgr.a (mgr.14388) 7066 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:40 smithi191 bash[24992]: audit 2024-08-31T04:54:39.695292+0000 mgr.a (mgr.14388) 7067 : audit [DBG] from='client.160779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:40 smithi163 bash[24253]: cluster 2024-08-31T04:54:39.529770+0000 mgr.a (mgr.14388) 7066 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:40 smithi163 bash[24253]: audit 2024-08-31T04:54:39.695292+0000 mgr.a (mgr.14388) 7067 : audit [DBG] from='client.160779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:40 smithi027 bash[22610]: cluster 2024-08-31T04:54:39.529770+0000 mgr.a (mgr.14388) 7066 : cluster [DBG] pgmap v4898: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:40 smithi027 bash[22610]: audit 2024-08-31T04:54:39.695292+0000 mgr.a (mgr.14388) 7067 : audit [DBG] from='client.160779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:42 smithi191 bash[24992]: cluster 2024-08-31T04:54:41.530639+0000 mgr.a (mgr.14388) 7068 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:42 smithi163 bash[24253]: cluster 2024-08-31T04:54:41.530639+0000 mgr.a (mgr.14388) 7068 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:42 smithi027 bash[22610]: cluster 2024-08-31T04:54:41.530639+0000 mgr.a (mgr.14388) 7068 : cluster [DBG] pgmap v4899: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:45.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:54:45.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:54:45.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:54:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:44 smithi163 bash[24253]: cluster 2024-08-31T04:54:43.532857+0000 mgr.a (mgr.14388) 7069 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:44 smithi027 bash[22610]: cluster 2024-08-31T04:54:43.532857+0000 mgr.a (mgr.14388) 7069 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:44 smithi191 bash[24992]: cluster 2024-08-31T04:54:43.532857+0000 mgr.a (mgr.14388) 7069 : cluster [DBG] pgmap v4900: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:45.877 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:54:45.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:54:45.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:54:45.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:54:45.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:46 smithi163 bash[24253]: audit 2024-08-31T04:54:45.460895+0000 mgr.a (mgr.14388) 7070 : audit [DBG] from='client.160857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:46 smithi163 bash[24253]: cluster 2024-08-31T04:54:45.533420+0000 mgr.a (mgr.14388) 7071 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:46 smithi027 bash[22610]: audit 2024-08-31T04:54:45.460895+0000 mgr.a (mgr.14388) 7070 : audit [DBG] from='client.160857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:46 smithi027 bash[22610]: cluster 2024-08-31T04:54:45.533420+0000 mgr.a (mgr.14388) 7071 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:46 smithi191 bash[24992]: audit 2024-08-31T04:54:45.460895+0000 mgr.a (mgr.14388) 7070 : audit [DBG] from='client.160857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:46 smithi191 bash[24992]: cluster 2024-08-31T04:54:45.533420+0000 mgr.a (mgr.14388) 7071 : cluster [DBG] pgmap v4901: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:48 smithi163 bash[24253]: cluster 2024-08-31T04:54:47.534310+0000 mgr.a (mgr.14388) 7072 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:49.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:48 smithi027 bash[22610]: cluster 2024-08-31T04:54:47.534310+0000 mgr.a (mgr.14388) 7072 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:48 smithi191 bash[24992]: cluster 2024-08-31T04:54:47.534310+0000 mgr.a (mgr.14388) 7072 : cluster [DBG] pgmap v4902: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:50.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:54:50.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:54:50.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:54:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:50 smithi163 bash[24253]: cluster 2024-08-31T04:54:49.536582+0000 mgr.a (mgr.14388) 7073 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:51.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:50 smithi027 bash[22610]: cluster 2024-08-31T04:54:49.536582+0000 mgr.a (mgr.14388) 7073 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:50 smithi191 bash[24992]: cluster 2024-08-31T04:54:49.536582+0000 mgr.a (mgr.14388) 7073 : cluster [DBG] pgmap v4903: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:51.642 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:54:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:54:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:54:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:54:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:52 smithi163 bash[24253]: audit 2024-08-31T04:54:51.215803+0000 mgr.a (mgr.14388) 7074 : audit [DBG] from='client.160935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:52 smithi163 bash[24253]: cluster 2024-08-31T04:54:51.544330+0000 mgr.a (mgr.14388) 7075 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:53.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:52 smithi027 bash[22610]: audit 2024-08-31T04:54:51.215803+0000 mgr.a (mgr.14388) 7074 : audit [DBG] from='client.160935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:53.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:52 smithi027 bash[22610]: cluster 2024-08-31T04:54:51.544330+0000 mgr.a (mgr.14388) 7075 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:52 smithi191 bash[24992]: audit 2024-08-31T04:54:51.215803+0000 mgr.a (mgr.14388) 7074 : audit [DBG] from='client.160935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:52 smithi191 bash[24992]: cluster 2024-08-31T04:54:51.544330+0000 mgr.a (mgr.14388) 7075 : cluster [DBG] pgmap v4904: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:54 smithi163 bash[24253]: cluster 2024-08-31T04:54:53.546485+0000 mgr.a (mgr.14388) 7076 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:55.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:54 smithi027 bash[22610]: cluster 2024-08-31T04:54:53.546485+0000 mgr.a (mgr.14388) 7076 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:54 smithi191 bash[24992]: cluster 2024-08-31T04:54:53.546485+0000 mgr.a (mgr.14388) 7076 : cluster [DBG] pgmap v4905: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:54:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:55 smithi163 bash[24253]: audit 2024-08-31T04:54:55.805555+0000 mon.a (mon.0) 1643 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:54:56.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:55 smithi027 bash[22610]: audit 2024-08-31T04:54:55.805555+0000 mon.a (mon.0) 1643 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:54:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:55 smithi191 bash[24992]: audit 2024-08-31T04:54:55.805555+0000 mon.a (mon.0) 1643 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:54:56.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:54:56.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:54:56.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:54:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:56 smithi163 bash[24253]: cluster 2024-08-31T04:54:55.547295+0000 mgr.a (mgr.14388) 7077 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:56 smithi163 bash[24253]: audit 2024-08-31T04:54:56.432932+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:56 smithi163 bash[24253]: audit 2024-08-31T04:54:56.437842+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:56 smithi163 bash[24253]: audit 2024-08-31T04:54:56.442047+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:56 smithi163 bash[24253]: audit 2024-08-31T04:54:56.455187+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:56 smithi027 bash[22610]: cluster 2024-08-31T04:54:55.547295+0000 mgr.a (mgr.14388) 7077 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:56 smithi027 bash[22610]: audit 2024-08-31T04:54:56.432932+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:56 smithi027 bash[22610]: audit 2024-08-31T04:54:56.437842+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:56 smithi027 bash[22610]: audit 2024-08-31T04:54:56.442047+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:56 smithi027 bash[22610]: audit 2024-08-31T04:54:56.455187+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:56 smithi191 bash[24992]: cluster 2024-08-31T04:54:55.547295+0000 mgr.a (mgr.14388) 7077 : cluster [DBG] pgmap v4906: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:56 smithi191 bash[24992]: audit 2024-08-31T04:54:56.432932+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:56 smithi191 bash[24992]: audit 2024-08-31T04:54:56.437842+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:56 smithi191 bash[24992]: audit 2024-08-31T04:54:56.442047+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:56 smithi191 bash[24992]: audit 2024-08-31T04:54:56.455187+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:57.432 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:54:57.432 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:54:57.432 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:54:57.432 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:54:57.432 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:54:58.111 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:57 smithi027 bash[22610]: audit 2024-08-31T04:54:57.146502+0000 mon.a (mon.0) 1648 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:54:58.112 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:57 smithi027 bash[22610]: audit 2024-08-31T04:54:57.147695+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:54:58.112 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:57 smithi027 bash[22610]: audit 2024-08-31T04:54:57.155058+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:58.112 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:57 smithi027 bash[22610]: audit 2024-08-31T04:54:57.157470+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:54:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:57 smithi163 bash[24253]: audit 2024-08-31T04:54:57.146502+0000 mon.a (mon.0) 1648 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:54:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:57 smithi163 bash[24253]: audit 2024-08-31T04:54:57.147695+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:54:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:57 smithi163 bash[24253]: audit 2024-08-31T04:54:57.155058+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:57 smithi163 bash[24253]: audit 2024-08-31T04:54:57.157470+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:54:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:57 smithi191 bash[24992]: audit 2024-08-31T04:54:57.146502+0000 mon.a (mon.0) 1648 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:54:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:57 smithi191 bash[24992]: audit 2024-08-31T04:54:57.147695+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:54:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:57 smithi191 bash[24992]: audit 2024-08-31T04:54:57.155058+0000 mon.a (mon.0) 1650 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:54:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:57 smithi191 bash[24992]: audit 2024-08-31T04:54:57.157470+0000 mon.a (mon.0) 1651 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:54:58.481 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:54:58 smithi027 bash[22863]: debug 2024-08-31T04:54:58.106+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:54:58.481 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:54:58 smithi027 bash[22863]: debug 2024-08-31T04:54:58.106+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:54:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:58 smithi163 bash[24253]: audit 2024-08-31T04:54:56.974979+0000 mgr.a (mgr.14388) 7078 : audit [DBG] from='client.161010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:58 smithi163 bash[24253]: audit 2024-08-31T04:54:57.158703+0000 mgr.a (mgr.14388) 7079 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:54:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:58 smithi163 bash[24253]: cluster 2024-08-31T04:54:57.547807+0000 mgr.a (mgr.14388) 7080 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:58 smithi027 bash[22610]: audit 2024-08-31T04:54:56.974979+0000 mgr.a (mgr.14388) 7078 : audit [DBG] from='client.161010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:58 smithi027 bash[22610]: audit 2024-08-31T04:54:57.158703+0000 mgr.a (mgr.14388) 7079 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:54:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:58 smithi027 bash[22610]: cluster 2024-08-31T04:54:57.547807+0000 mgr.a (mgr.14388) 7080 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:54:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:58 smithi191 bash[24992]: audit 2024-08-31T04:54:56.974979+0000 mgr.a (mgr.14388) 7078 : audit [DBG] from='client.161010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:54:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:58 smithi191 bash[24992]: audit 2024-08-31T04:54:57.158703+0000 mgr.a (mgr.14388) 7079 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:54:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:58 smithi191 bash[24992]: cluster 2024-08-31T04:54:57.547807+0000 mgr.a (mgr.14388) 7080 : cluster [DBG] pgmap v4907: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:59 smithi163 bash[24253]: audit 2024-08-31T04:54:58.113478+0000 mgr.a (mgr.14388) 7081 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:55:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:54:59 smithi163 bash[24253]: cephadm 2024-08-31T04:54:58.114700+0000 mgr.a (mgr.14388) 7082 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:55:00.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:59 smithi027 bash[22610]: audit 2024-08-31T04:54:58.113478+0000 mgr.a (mgr.14388) 7081 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:55:00.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:54:59 smithi027 bash[22610]: cephadm 2024-08-31T04:54:58.114700+0000 mgr.a (mgr.14388) 7082 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:55:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:59 smithi191 bash[24992]: audit 2024-08-31T04:54:58.113478+0000 mgr.a (mgr.14388) 7081 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:55:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:54:59 smithi191 bash[24992]: cephadm 2024-08-31T04:54:58.114700+0000 mgr.a (mgr.14388) 7082 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:55:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:00 smithi163 bash[24253]: cluster 2024-08-31T04:54:59.550179+0000 mgr.a (mgr.14388) 7083 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:55:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:00 smithi027 bash[22610]: cluster 2024-08-31T04:54:59.550179+0000 mgr.a (mgr.14388) 7083 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:55:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:00 smithi191 bash[24992]: cluster 2024-08-31T04:54:59.550179+0000 mgr.a (mgr.14388) 7083 : cluster [DBG] pgmap v4908: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:55:02.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:55:02.434 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:55:02.434 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:55:03.198 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:55:03.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:55:03.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:55:03.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:55:03.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:55:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:02 smithi163 bash[24253]: cluster 2024-08-31T04:55:01.550998+0000 mgr.a (mgr.14388) 7084 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:55:03.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:02 smithi027 bash[22610]: cluster 2024-08-31T04:55:01.550998+0000 mgr.a (mgr.14388) 7084 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:55:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:02 smithi191 bash[24992]: cluster 2024-08-31T04:55:01.550998+0000 mgr.a (mgr.14388) 7084 : cluster [DBG] pgmap v4909: 225 pgs: 225 active+clean; 589 KiB data, 121 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:55:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:03 smithi163 bash[24253]: audit 2024-08-31T04:55:02.772490+0000 mgr.a (mgr.14388) 7085 : audit [DBG] from='client.161193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:04.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:03 smithi027 bash[22610]: audit 2024-08-31T04:55:02.772490+0000 mgr.a (mgr.14388) 7085 : audit [DBG] from='client.161193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:03 smithi191 bash[24992]: audit 2024-08-31T04:55:02.772490+0000 mgr.a (mgr.14388) 7085 : audit [DBG] from='client.161193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:04 smithi163 bash[24253]: cluster 2024-08-31T04:55:03.553712+0000 mgr.a (mgr.14388) 7086 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:55:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:04 smithi027 bash[22610]: cluster 2024-08-31T04:55:03.553712+0000 mgr.a (mgr.14388) 7086 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:55:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:04 smithi191 bash[24992]: cluster 2024-08-31T04:55:03.553712+0000 mgr.a (mgr.14388) 7086 : cluster [DBG] pgmap v4910: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:55:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:06 smithi163 bash[24253]: cluster 2024-08-31T04:55:05.554494+0000 mgr.a (mgr.14388) 7087 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:55:07.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:06 smithi027 bash[22610]: cluster 2024-08-31T04:55:05.554494+0000 mgr.a (mgr.14388) 7087 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:55:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:06 smithi191 bash[24992]: cluster 2024-08-31T04:55:05.554494+0000 mgr.a (mgr.14388) 7087 : cluster [DBG] pgmap v4911: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:55:08.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:55:08.201 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:55:08.201 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:55:08.974 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:55:08.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:55:08.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:55:08.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:55:08.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:55:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:08 smithi163 bash[24253]: cluster 2024-08-31T04:55:07.555300+0000 mgr.a (mgr.14388) 7088 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:55:09.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:08 smithi027 bash[22610]: cluster 2024-08-31T04:55:07.555300+0000 mgr.a (mgr.14388) 7088 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:55:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:08 smithi191 bash[24992]: cluster 2024-08-31T04:55:07.555300+0000 mgr.a (mgr.14388) 7088 : cluster [DBG] pgmap v4912: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:55:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:09 smithi163 bash[24253]: audit 2024-08-31T04:55:08.538429+0000 mgr.a (mgr.14388) 7089 : audit [DBG] from='client.161271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:10.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:09 smithi027 bash[22610]: audit 2024-08-31T04:55:08.538429+0000 mgr.a (mgr.14388) 7089 : audit [DBG] from='client.161271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:09 smithi191 bash[24992]: audit 2024-08-31T04:55:08.538429+0000 mgr.a (mgr.14388) 7089 : audit [DBG] from='client.161271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:10 smithi163 bash[24253]: cluster 2024-08-31T04:55:09.558139+0000 mgr.a (mgr.14388) 7090 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:55:11.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:10 smithi027 bash[22610]: cluster 2024-08-31T04:55:09.558139+0000 mgr.a (mgr.14388) 7090 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:55:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:10 smithi191 bash[24992]: cluster 2024-08-31T04:55:09.558139+0000 mgr.a (mgr.14388) 7090 : cluster [DBG] pgmap v4913: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:55:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:12 smithi163 bash[24253]: cluster 2024-08-31T04:55:11.559010+0000 mgr.a (mgr.14388) 7091 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:55:13.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:12 smithi027 bash[22610]: cluster 2024-08-31T04:55:11.559010+0000 mgr.a (mgr.14388) 7091 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:55:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:12 smithi191 bash[24992]: cluster 2024-08-31T04:55:11.559010+0000 mgr.a (mgr.14388) 7091 : cluster [DBG] pgmap v4914: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T04:55:13.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:55:13.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:55:13.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:55:14.762 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:55:14.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:55:14.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:55:14.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:55:14.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:55:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:14 smithi163 bash[24253]: cluster 2024-08-31T04:55:13.560937+0000 mgr.a (mgr.14388) 7092 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:55:15.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:14 smithi027 bash[22610]: cluster 2024-08-31T04:55:13.560937+0000 mgr.a (mgr.14388) 7092 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:55:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:14 smithi191 bash[24992]: cluster 2024-08-31T04:55:13.560937+0000 mgr.a (mgr.14388) 7092 : cluster [DBG] pgmap v4915: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:55:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:15 smithi163 bash[24253]: audit 2024-08-31T04:55:14.311109+0000 mgr.a (mgr.14388) 7093 : audit [DBG] from='client.161349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:16.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:15 smithi027 bash[22610]: audit 2024-08-31T04:55:14.311109+0000 mgr.a (mgr.14388) 7093 : audit [DBG] from='client.161349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:15 smithi191 bash[24992]: audit 2024-08-31T04:55:14.311109+0000 mgr.a (mgr.14388) 7093 : audit [DBG] from='client.161349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:16 smithi163 bash[24253]: cluster 2024-08-31T04:55:15.561906+0000 mgr.a (mgr.14388) 7094 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:17.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:16 smithi027 bash[22610]: cluster 2024-08-31T04:55:15.561906+0000 mgr.a (mgr.14388) 7094 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:16 smithi191 bash[24992]: cluster 2024-08-31T04:55:15.561906+0000 mgr.a (mgr.14388) 7094 : cluster [DBG] pgmap v4916: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:18 smithi163 bash[24253]: cluster 2024-08-31T04:55:17.562875+0000 mgr.a (mgr.14388) 7095 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:19.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:18 smithi027 bash[22610]: cluster 2024-08-31T04:55:17.562875+0000 mgr.a (mgr.14388) 7095 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:18 smithi191 bash[24992]: cluster 2024-08-31T04:55:17.562875+0000 mgr.a (mgr.14388) 7095 : cluster [DBG] pgmap v4917: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:19.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:55:19.764 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:55:19.764 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:55:20.533 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:55:20.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:55:20.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:55:20.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:55:20.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:55:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:20 smithi163 bash[24253]: cluster 2024-08-31T04:55:19.565193+0000 mgr.a (mgr.14388) 7096 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:21.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:20 smithi027 bash[22610]: cluster 2024-08-31T04:55:19.565193+0000 mgr.a (mgr.14388) 7096 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:20 smithi191 bash[24992]: cluster 2024-08-31T04:55:19.565193+0000 mgr.a (mgr.14388) 7096 : cluster [DBG] pgmap v4918: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:21 smithi163 bash[24253]: audit 2024-08-31T04:55:20.105220+0000 mgr.a (mgr.14388) 7097 : audit [DBG] from='client.161427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:22.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:21 smithi027 bash[22610]: audit 2024-08-31T04:55:20.105220+0000 mgr.a (mgr.14388) 7097 : audit [DBG] from='client.161427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:21 smithi191 bash[24992]: audit 2024-08-31T04:55:20.105220+0000 mgr.a (mgr.14388) 7097 : audit [DBG] from='client.161427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:22 smithi163 bash[24253]: cluster 2024-08-31T04:55:21.566105+0000 mgr.a (mgr.14388) 7098 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:23.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:22 smithi027 bash[22610]: cluster 2024-08-31T04:55:21.566105+0000 mgr.a (mgr.14388) 7098 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:22 smithi191 bash[24992]: cluster 2024-08-31T04:55:21.566105+0000 mgr.a (mgr.14388) 7098 : cluster [DBG] pgmap v4919: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:24 smithi163 bash[24253]: cluster 2024-08-31T04:55:23.568454+0000 mgr.a (mgr.14388) 7099 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:24 smithi027 bash[22610]: cluster 2024-08-31T04:55:23.568454+0000 mgr.a (mgr.14388) 7099 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:24 smithi191 bash[24992]: cluster 2024-08-31T04:55:23.568454+0000 mgr.a (mgr.14388) 7099 : cluster [DBG] pgmap v4920: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:25.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:55:25.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:55:25.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:55:26.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:55:26.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:55:26.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:55:26.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:55:26.285 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:55:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:26 smithi163 bash[24253]: cluster 2024-08-31T04:55:25.569270+0000 mgr.a (mgr.14388) 7100 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:26 smithi163 bash[24253]: audit 2024-08-31T04:55:25.870985+0000 mgr.a (mgr.14388) 7101 : audit [DBG] from='client.161505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:27.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:26 smithi027 bash[22610]: cluster 2024-08-31T04:55:25.569270+0000 mgr.a (mgr.14388) 7100 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:27.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:26 smithi027 bash[22610]: audit 2024-08-31T04:55:25.870985+0000 mgr.a (mgr.14388) 7101 : audit [DBG] from='client.161505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:26 smithi191 bash[24992]: cluster 2024-08-31T04:55:25.569270+0000 mgr.a (mgr.14388) 7100 : cluster [DBG] pgmap v4921: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:26 smithi191 bash[24992]: audit 2024-08-31T04:55:25.870985+0000 mgr.a (mgr.14388) 7101 : audit [DBG] from='client.161505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:28 smithi163 bash[24253]: cluster 2024-08-31T04:55:27.570196+0000 mgr.a (mgr.14388) 7102 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:29.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:28 smithi027 bash[22610]: cluster 2024-08-31T04:55:27.570196+0000 mgr.a (mgr.14388) 7102 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:28 smithi191 bash[24992]: cluster 2024-08-31T04:55:27.570196+0000 mgr.a (mgr.14388) 7102 : cluster [DBG] pgmap v4922: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:30 smithi163 bash[24253]: cluster 2024-08-31T04:55:29.572458+0000 mgr.a (mgr.14388) 7103 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:31.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:30 smithi027 bash[22610]: cluster 2024-08-31T04:55:29.572458+0000 mgr.a (mgr.14388) 7103 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:31.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:55:31.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:55:31.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:55:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:30 smithi191 bash[24992]: cluster 2024-08-31T04:55:29.572458+0000 mgr.a (mgr.14388) 7103 : cluster [DBG] pgmap v4923: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:32.068 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:55:32.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:55:32.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:55:32.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:55:32.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:55:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:32 smithi163 bash[24253]: cluster 2024-08-31T04:55:31.572997+0000 mgr.a (mgr.14388) 7104 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:32 smithi163 bash[24253]: audit 2024-08-31T04:55:31.624474+0000 mgr.a (mgr.14388) 7105 : audit [DBG] from='client.161583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:32 smithi027 bash[22610]: cluster 2024-08-31T04:55:31.572997+0000 mgr.a (mgr.14388) 7104 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:32 smithi027 bash[22610]: audit 2024-08-31T04:55:31.624474+0000 mgr.a (mgr.14388) 7105 : audit [DBG] from='client.161583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:32 smithi191 bash[24992]: cluster 2024-08-31T04:55:31.572997+0000 mgr.a (mgr.14388) 7104 : cluster [DBG] pgmap v4924: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:32 smithi191 bash[24992]: audit 2024-08-31T04:55:31.624474+0000 mgr.a (mgr.14388) 7105 : audit [DBG] from='client.161583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:34 smithi163 bash[24253]: cluster 2024-08-31T04:55:33.575390+0000 mgr.a (mgr.14388) 7106 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:34 smithi027 bash[22610]: cluster 2024-08-31T04:55:33.575390+0000 mgr.a (mgr.14388) 7106 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:34 smithi191 bash[24992]: cluster 2024-08-31T04:55:33.575390+0000 mgr.a (mgr.14388) 7106 : cluster [DBG] pgmap v4925: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:37.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:55:37.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:55:37.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:55:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:36 smithi163 bash[24253]: cluster 2024-08-31T04:55:35.576335+0000 mgr.a (mgr.14388) 7107 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:36 smithi027 bash[22610]: cluster 2024-08-31T04:55:35.576335+0000 mgr.a (mgr.14388) 7107 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:36 smithi191 bash[24992]: cluster 2024-08-31T04:55:35.576335+0000 mgr.a (mgr.14388) 7107 : cluster [DBG] pgmap v4926: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:37.844 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:55:37.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:55:37.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:55:37.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:55:37.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:55:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:38 smithi163 bash[24253]: audit 2024-08-31T04:55:37.407753+0000 mgr.a (mgr.14388) 7108 : audit [DBG] from='client.161661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:38 smithi163 bash[24253]: cluster 2024-08-31T04:55:37.576940+0000 mgr.a (mgr.14388) 7109 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:38 smithi027 bash[22610]: audit 2024-08-31T04:55:37.407753+0000 mgr.a (mgr.14388) 7108 : audit [DBG] from='client.161661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:38 smithi027 bash[22610]: cluster 2024-08-31T04:55:37.576940+0000 mgr.a (mgr.14388) 7109 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:38 smithi191 bash[24992]: audit 2024-08-31T04:55:37.407753+0000 mgr.a (mgr.14388) 7108 : audit [DBG] from='client.161661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:38 smithi191 bash[24992]: cluster 2024-08-31T04:55:37.576940+0000 mgr.a (mgr.14388) 7109 : cluster [DBG] pgmap v4927: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:40 smithi163 bash[24253]: cluster 2024-08-31T04:55:39.579295+0000 mgr.a (mgr.14388) 7110 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:40 smithi027 bash[22610]: cluster 2024-08-31T04:55:39.579295+0000 mgr.a (mgr.14388) 7110 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:40 smithi191 bash[24992]: cluster 2024-08-31T04:55:39.579295+0000 mgr.a (mgr.14388) 7110 : cluster [DBG] pgmap v4928: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:55:42.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:55:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:55:42.847 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:55:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:42 smithi163 bash[24253]: cluster 2024-08-31T04:55:41.580081+0000 mgr.a (mgr.14388) 7111 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:42 smithi027 bash[22610]: cluster 2024-08-31T04:55:41.580081+0000 mgr.a (mgr.14388) 7111 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:42 smithi191 bash[24992]: cluster 2024-08-31T04:55:41.580081+0000 mgr.a (mgr.14388) 7111 : cluster [DBG] pgmap v4929: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:43.632 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:55:43.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:55:43.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:55:43.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:55:43.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:55:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:44 smithi027 bash[22610]: audit 2024-08-31T04:55:43.188964+0000 mgr.a (mgr.14388) 7112 : audit [DBG] from='client.161739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:44 smithi027 bash[22610]: cluster 2024-08-31T04:55:43.581407+0000 mgr.a (mgr.14388) 7113 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:44 smithi191 bash[24992]: audit 2024-08-31T04:55:43.188964+0000 mgr.a (mgr.14388) 7112 : audit [DBG] from='client.161739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:44 smithi191 bash[24992]: cluster 2024-08-31T04:55:43.581407+0000 mgr.a (mgr.14388) 7113 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:44 smithi163 bash[24253]: audit 2024-08-31T04:55:43.188964+0000 mgr.a (mgr.14388) 7112 : audit [DBG] from='client.161739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:44 smithi163 bash[24253]: cluster 2024-08-31T04:55:43.581407+0000 mgr.a (mgr.14388) 7113 : cluster [DBG] pgmap v4930: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:46 smithi027 bash[22610]: cluster 2024-08-31T04:55:45.582178+0000 mgr.a (mgr.14388) 7114 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:55:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:46 smithi191 bash[24992]: cluster 2024-08-31T04:55:45.582178+0000 mgr.a (mgr.14388) 7114 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:55:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:46 smithi163 bash[24253]: cluster 2024-08-31T04:55:45.582178+0000 mgr.a (mgr.14388) 7114 : cluster [DBG] pgmap v4931: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:55:48.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:55:48.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:55:48.635 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:55:49.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:48 smithi027 bash[22610]: cluster 2024-08-31T04:55:47.582999+0000 mgr.a (mgr.14388) 7115 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:55:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:48 smithi191 bash[24992]: cluster 2024-08-31T04:55:47.582999+0000 mgr.a (mgr.14388) 7115 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:55:49.404 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:55:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:55:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:55:49.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:55:49.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:55:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:48 smithi163 bash[24253]: cluster 2024-08-31T04:55:47.582999+0000 mgr.a (mgr.14388) 7115 : cluster [DBG] pgmap v4932: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:55:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:50 smithi191 bash[24992]: audit 2024-08-31T04:55:48.971639+0000 mgr.a (mgr.14388) 7116 : audit [DBG] from='client.161817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:50 smithi191 bash[24992]: cluster 2024-08-31T04:55:49.585745+0000 mgr.a (mgr.14388) 7117 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:50.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:50 smithi163 bash[24253]: audit 2024-08-31T04:55:48.971639+0000 mgr.a (mgr.14388) 7116 : audit [DBG] from='client.161817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:50.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:50 smithi163 bash[24253]: cluster 2024-08-31T04:55:49.585745+0000 mgr.a (mgr.14388) 7117 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:50.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:50 smithi027 bash[22610]: audit 2024-08-31T04:55:48.971639+0000 mgr.a (mgr.14388) 7116 : audit [DBG] from='client.161817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:50.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:50 smithi027 bash[22610]: cluster 2024-08-31T04:55:49.585745+0000 mgr.a (mgr.14388) 7117 : cluster [DBG] pgmap v4933: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:52 smithi163 bash[24253]: cluster 2024-08-31T04:55:51.586542+0000 mgr.a (mgr.14388) 7118 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:55:52.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:52 smithi027 bash[22610]: cluster 2024-08-31T04:55:51.586542+0000 mgr.a (mgr.14388) 7118 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:55:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:52 smithi191 bash[24992]: cluster 2024-08-31T04:55:51.586542+0000 mgr.a (mgr.14388) 7118 : cluster [DBG] pgmap v4934: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:55:54.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:55:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:55:54.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:55:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:54 smithi163 bash[24253]: cluster 2024-08-31T04:55:53.588482+0000 mgr.a (mgr.14388) 7119 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:54.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:54 smithi027 bash[22610]: cluster 2024-08-31T04:55:53.588482+0000 mgr.a (mgr.14388) 7119 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:54 smithi191 bash[24992]: cluster 2024-08-31T04:55:53.588482+0000 mgr.a (mgr.14388) 7119 : cluster [DBG] pgmap v4935: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:55.183 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:55:55.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:55:55.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:55:55.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:55:55.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:55:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:55 smithi163 bash[24253]: audit 2024-08-31T04:55:54.745659+0000 mgr.a (mgr.14388) 7120 : audit [DBG] from='client.161895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:55.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:55 smithi027 bash[22610]: audit 2024-08-31T04:55:54.745659+0000 mgr.a (mgr.14388) 7120 : audit [DBG] from='client.161895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:55 smithi191 bash[24992]: audit 2024-08-31T04:55:54.745659+0000 mgr.a (mgr.14388) 7120 : audit [DBG] from='client.161895 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:55:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:56 smithi163 bash[24253]: cluster 2024-08-31T04:55:55.589585+0000 mgr.a (mgr.14388) 7121 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:56.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:56 smithi027 bash[22610]: cluster 2024-08-31T04:55:55.589585+0000 mgr.a (mgr.14388) 7121 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:56 smithi191 bash[24992]: cluster 2024-08-31T04:55:55.589585+0000 mgr.a (mgr.14388) 7121 : cluster [DBG] pgmap v4936: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:58 smithi163 bash[24253]: cluster 2024-08-31T04:55:57.590577+0000 mgr.a (mgr.14388) 7122 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:58 smithi163 bash[24253]: audit 2024-08-31T04:55:58.167007+0000 mon.a (mon.0) 1652 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:55:58.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:58 smithi027 bash[22610]: cluster 2024-08-31T04:55:57.590577+0000 mgr.a (mgr.14388) 7122 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:58.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:58 smithi027 bash[22610]: audit 2024-08-31T04:55:58.167007+0000 mon.a (mon.0) 1652 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:55:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:58 smithi191 bash[24992]: cluster 2024-08-31T04:55:57.590577+0000 mgr.a (mgr.14388) 7122 : cluster [DBG] pgmap v4937: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:55:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:58 smithi191 bash[24992]: audit 2024-08-31T04:55:58.167007+0000 mon.a (mon.0) 1652 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:55:59.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:59 smithi163 bash[24253]: audit 2024-08-31T04:55:59.018611+0000 mon.a (mon.0) 1653 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:55:59.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:59 smithi163 bash[24253]: audit 2024-08-31T04:55:59.019617+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:55:59.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:59 smithi163 bash[24253]: audit 2024-08-31T04:55:59.027700+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:55:59.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:55:59 smithi163 bash[24253]: audit 2024-08-31T04:55:59.032354+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:55:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:55:59 smithi027 bash[22863]: debug 2024-08-31T04:55:59.765+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:55:59.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:55:59 smithi027 bash[22863]: debug 2024-08-31T04:55:59.765+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:55:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:59 smithi027 bash[22610]: audit 2024-08-31T04:55:59.018611+0000 mon.a (mon.0) 1653 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:55:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:59 smithi027 bash[22610]: audit 2024-08-31T04:55:59.019617+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:55:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:59 smithi027 bash[22610]: audit 2024-08-31T04:55:59.027700+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:55:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:55:59 smithi027 bash[22610]: audit 2024-08-31T04:55:59.032354+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:56:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:59 smithi191 bash[24992]: audit 2024-08-31T04:55:59.018611+0000 mon.a (mon.0) 1653 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:56:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:59 smithi191 bash[24992]: audit 2024-08-31T04:55:59.019617+0000 mon.a (mon.0) 1654 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:56:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:59 smithi191 bash[24992]: audit 2024-08-31T04:55:59.027700+0000 mon.a (mon.0) 1655 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:56:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:55:59 smithi191 bash[24992]: audit 2024-08-31T04:55:59.032354+0000 mon.a (mon.0) 1656 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:56:00.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:00.185 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:00.185 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:00 smithi163 bash[24253]: audit 2024-08-31T04:55:59.034625+0000 mgr.a (mgr.14388) 7123 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:56:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:00 smithi163 bash[24253]: cluster 2024-08-31T04:55:59.593051+0000 mgr.a (mgr.14388) 7124 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:00 smithi163 bash[24253]: audit 2024-08-31T04:55:59.767918+0000 mgr.a (mgr.14388) 7125 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:56:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:00 smithi163 bash[24253]: cephadm 2024-08-31T04:55:59.769762+0000 mgr.a (mgr.14388) 7126 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:56:00.955 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:00.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:00.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:00.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:00.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:00 smithi027 bash[22610]: audit 2024-08-31T04:55:59.034625+0000 mgr.a (mgr.14388) 7123 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:56:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:00 smithi027 bash[22610]: cluster 2024-08-31T04:55:59.593051+0000 mgr.a (mgr.14388) 7124 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:00 smithi027 bash[22610]: audit 2024-08-31T04:55:59.767918+0000 mgr.a (mgr.14388) 7125 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:56:00.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:00 smithi027 bash[22610]: cephadm 2024-08-31T04:55:59.769762+0000 mgr.a (mgr.14388) 7126 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:56:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:00 smithi191 bash[24992]: audit 2024-08-31T04:55:59.034625+0000 mgr.a (mgr.14388) 7123 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:56:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:00 smithi191 bash[24992]: cluster 2024-08-31T04:55:59.593051+0000 mgr.a (mgr.14388) 7124 : cluster [DBG] pgmap v4938: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:00 smithi191 bash[24992]: audit 2024-08-31T04:55:59.767918+0000 mgr.a (mgr.14388) 7125 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:56:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:00 smithi191 bash[24992]: cephadm 2024-08-31T04:55:59.769762+0000 mgr.a (mgr.14388) 7126 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:56:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:01 smithi163 bash[24253]: audit 2024-08-31T04:56:00.523843+0000 mgr.a (mgr.14388) 7127 : audit [DBG] from='client.162075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:01.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:01 smithi027 bash[22610]: audit 2024-08-31T04:56:00.523843+0000 mgr.a (mgr.14388) 7127 : audit [DBG] from='client.162075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:01 smithi191 bash[24992]: audit 2024-08-31T04:56:00.523843+0000 mgr.a (mgr.14388) 7127 : audit [DBG] from='client.162075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:02 smithi163 bash[24253]: cluster 2024-08-31T04:56:01.594026+0000 mgr.a (mgr.14388) 7128 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:02.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:02 smithi027 bash[22610]: cluster 2024-08-31T04:56:01.594026+0000 mgr.a (mgr.14388) 7128 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:02 smithi191 bash[24992]: cluster 2024-08-31T04:56:01.594026+0000 mgr.a (mgr.14388) 7128 : cluster [DBG] pgmap v4939: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:04 smithi163 bash[24253]: cluster 2024-08-31T04:56:03.596227+0000 mgr.a (mgr.14388) 7129 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:04.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:04 smithi027 bash[22610]: cluster 2024-08-31T04:56:03.596227+0000 mgr.a (mgr.14388) 7129 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:04 smithi191 bash[24992]: cluster 2024-08-31T04:56:03.596227+0000 mgr.a (mgr.14388) 7129 : cluster [DBG] pgmap v4940: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:05.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:05.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:05.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:06.704 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:06.704 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:06.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:06.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:06.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:06 smithi163 bash[24253]: cluster 2024-08-31T04:56:05.597008+0000 mgr.a (mgr.14388) 7130 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:06.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:06 smithi027 bash[22610]: cluster 2024-08-31T04:56:05.597008+0000 mgr.a (mgr.14388) 7130 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:06 smithi191 bash[24992]: cluster 2024-08-31T04:56:05.597008+0000 mgr.a (mgr.14388) 7130 : cluster [DBG] pgmap v4941: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:07 smithi163 bash[24253]: audit 2024-08-31T04:56:06.291532+0000 mgr.a (mgr.14388) 7131 : audit [DBG] from='client.162153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:07.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:07 smithi027 bash[22610]: audit 2024-08-31T04:56:06.291532+0000 mgr.a (mgr.14388) 7131 : audit [DBG] from='client.162153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:07 smithi191 bash[24992]: audit 2024-08-31T04:56:06.291532+0000 mgr.a (mgr.14388) 7131 : audit [DBG] from='client.162153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:08 smithi163 bash[24253]: cluster 2024-08-31T04:56:07.597891+0000 mgr.a (mgr.14388) 7132 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:08 smithi027 bash[22610]: cluster 2024-08-31T04:56:07.597891+0000 mgr.a (mgr.14388) 7132 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:08 smithi191 bash[24992]: cluster 2024-08-31T04:56:07.597891+0000 mgr.a (mgr.14388) 7132 : cluster [DBG] pgmap v4942: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:10 smithi163 bash[24253]: cluster 2024-08-31T04:56:09.600124+0000 mgr.a (mgr.14388) 7133 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:10.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:10 smithi027 bash[22610]: cluster 2024-08-31T04:56:09.600124+0000 mgr.a (mgr.14388) 7133 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:10 smithi191 bash[24992]: cluster 2024-08-31T04:56:09.600124+0000 mgr.a (mgr.14388) 7133 : cluster [DBG] pgmap v4943: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:11.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:11.706 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:11.706 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:12.492 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:12.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:12.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:12.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:12.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:12.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:12 smithi027 bash[22610]: cluster 2024-08-31T04:56:11.600870+0000 mgr.a (mgr.14388) 7134 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:12 smithi191 bash[24992]: cluster 2024-08-31T04:56:11.600870+0000 mgr.a (mgr.14388) 7134 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:12 smithi163 bash[24253]: cluster 2024-08-31T04:56:11.600870+0000 mgr.a (mgr.14388) 7134 : cluster [DBG] pgmap v4944: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:13.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:13 smithi027 bash[22610]: audit 2024-08-31T04:56:12.046052+0000 mgr.a (mgr.14388) 7135 : audit [DBG] from='client.162231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:13 smithi191 bash[24992]: audit 2024-08-31T04:56:12.046052+0000 mgr.a (mgr.14388) 7135 : audit [DBG] from='client.162231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:13 smithi163 bash[24253]: audit 2024-08-31T04:56:12.046052+0000 mgr.a (mgr.14388) 7135 : audit [DBG] from='client.162231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:14.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:14 smithi027 bash[22610]: cluster 2024-08-31T04:56:13.603228+0000 mgr.a (mgr.14388) 7136 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:14 smithi191 bash[24992]: cluster 2024-08-31T04:56:13.603228+0000 mgr.a (mgr.14388) 7136 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:14 smithi163 bash[24253]: cluster 2024-08-31T04:56:13.603228+0000 mgr.a (mgr.14388) 7136 : cluster [DBG] pgmap v4945: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:56:16.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:16 smithi027 bash[22610]: cluster 2024-08-31T04:56:15.604123+0000 mgr.a (mgr.14388) 7137 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:16 smithi191 bash[24992]: cluster 2024-08-31T04:56:15.604123+0000 mgr.a (mgr.14388) 7137 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:16 smithi163 bash[24253]: cluster 2024-08-31T04:56:15.604123+0000 mgr.a (mgr.14388) 7137 : cluster [DBG] pgmap v4946: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:17.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:17.494 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:17.494 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:18.260 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:18.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:18.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:18.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:18 smithi027 bash[22610]: cluster 2024-08-31T04:56:17.604589+0000 mgr.a (mgr.14388) 7138 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:18 smithi027 bash[22610]: audit 2024-08-31T04:56:17.831238+0000 mgr.a (mgr.14388) 7139 : audit [DBG] from='client.162309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:18 smithi191 bash[24992]: cluster 2024-08-31T04:56:17.604589+0000 mgr.a (mgr.14388) 7138 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:18 smithi191 bash[24992]: audit 2024-08-31T04:56:17.831238+0000 mgr.a (mgr.14388) 7139 : audit [DBG] from='client.162309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:18 smithi163 bash[24253]: cluster 2024-08-31T04:56:17.604589+0000 mgr.a (mgr.14388) 7138 : cluster [DBG] pgmap v4947: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:18 smithi163 bash[24253]: audit 2024-08-31T04:56:17.831238+0000 mgr.a (mgr.14388) 7139 : audit [DBG] from='client.162309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:20 smithi027 bash[22610]: cluster 2024-08-31T04:56:19.607365+0000 mgr.a (mgr.14388) 7140 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:20 smithi191 bash[24992]: cluster 2024-08-31T04:56:19.607365+0000 mgr.a (mgr.14388) 7140 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:20 smithi163 bash[24253]: cluster 2024-08-31T04:56:19.607365+0000 mgr.a (mgr.14388) 7140 : cluster [DBG] pgmap v4948: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:22 smithi191 bash[24992]: cluster 2024-08-31T04:56:21.608171+0000 mgr.a (mgr.14388) 7141 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:56:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:22 smithi163 bash[24253]: cluster 2024-08-31T04:56:21.608171+0000 mgr.a (mgr.14388) 7141 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:56:23.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:22 smithi027 bash[22610]: cluster 2024-08-31T04:56:21.608171+0000 mgr.a (mgr.14388) 7141 : cluster [DBG] pgmap v4949: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:56:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:23.262 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:24.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:24.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:24.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:24.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:24.028 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:24 smithi191 bash[24992]: audit 2024-08-31T04:56:23.602670+0000 mgr.a (mgr.14388) 7142 : audit [DBG] from='client.162384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:24 smithi191 bash[24992]: cluster 2024-08-31T04:56:23.616403+0000 mgr.a (mgr.14388) 7143 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:24 smithi163 bash[24253]: audit 2024-08-31T04:56:23.602670+0000 mgr.a (mgr.14388) 7142 : audit [DBG] from='client.162384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:24 smithi163 bash[24253]: cluster 2024-08-31T04:56:23.616403+0000 mgr.a (mgr.14388) 7143 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:24 smithi027 bash[22610]: audit 2024-08-31T04:56:23.602670+0000 mgr.a (mgr.14388) 7142 : audit [DBG] from='client.162384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:24 smithi027 bash[22610]: cluster 2024-08-31T04:56:23.616403+0000 mgr.a (mgr.14388) 7143 : cluster [DBG] pgmap v4950: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:26 smithi191 bash[24992]: cluster 2024-08-31T04:56:25.617356+0000 mgr.a (mgr.14388) 7144 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:56:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:26 smithi163 bash[24253]: cluster 2024-08-31T04:56:25.617356+0000 mgr.a (mgr.14388) 7144 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:56:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:26 smithi027 bash[22610]: cluster 2024-08-31T04:56:25.617356+0000 mgr.a (mgr.14388) 7144 : cluster [DBG] pgmap v4951: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:56:29.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:29.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:29.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:28 smithi191 bash[24992]: cluster 2024-08-31T04:56:27.618186+0000 mgr.a (mgr.14388) 7145 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:56:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:28 smithi163 bash[24253]: cluster 2024-08-31T04:56:27.618186+0000 mgr.a (mgr.14388) 7145 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:56:29.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:28 smithi027 bash[22610]: cluster 2024-08-31T04:56:27.618186+0000 mgr.a (mgr.14388) 7145 : cluster [DBG] pgmap v4952: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:56:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:29.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:29.770 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:30 smithi191 bash[24992]: audit 2024-08-31T04:56:29.361348+0000 mgr.a (mgr.14388) 7146 : audit [DBG] from='client.162459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:30 smithi191 bash[24992]: cluster 2024-08-31T04:56:29.619467+0000 mgr.a (mgr.14388) 7147 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:30 smithi163 bash[24253]: audit 2024-08-31T04:56:29.361348+0000 mgr.a (mgr.14388) 7146 : audit [DBG] from='client.162459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:30 smithi163 bash[24253]: cluster 2024-08-31T04:56:29.619467+0000 mgr.a (mgr.14388) 7147 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:31.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:30 smithi027 bash[22610]: audit 2024-08-31T04:56:29.361348+0000 mgr.a (mgr.14388) 7146 : audit [DBG] from='client.162459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:31.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:30 smithi027 bash[22610]: cluster 2024-08-31T04:56:29.619467+0000 mgr.a (mgr.14388) 7147 : cluster [DBG] pgmap v4953: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:32 smithi191 bash[24992]: cluster 2024-08-31T04:56:31.620237+0000 mgr.a (mgr.14388) 7148 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:32 smithi163 bash[24253]: cluster 2024-08-31T04:56:31.620237+0000 mgr.a (mgr.14388) 7148 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:32 smithi027 bash[22610]: cluster 2024-08-31T04:56:31.620237+0000 mgr.a (mgr.14388) 7148 : cluster [DBG] pgmap v4954: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:34.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:34.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:34.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:34 smithi191 bash[24992]: cluster 2024-08-31T04:56:33.622438+0000 mgr.a (mgr.14388) 7149 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:34 smithi163 bash[24253]: cluster 2024-08-31T04:56:33.622438+0000 mgr.a (mgr.14388) 7149 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:34 smithi027 bash[22610]: cluster 2024-08-31T04:56:33.622438+0000 mgr.a (mgr.14388) 7149 : cluster [DBG] pgmap v4955: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:35.546 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:35.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:35.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:35.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:35.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:36 smithi191 bash[24992]: audit 2024-08-31T04:56:35.110296+0000 mgr.a (mgr.14388) 7150 : audit [DBG] from='client.162534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:36 smithi191 bash[24992]: cluster 2024-08-31T04:56:35.623148+0000 mgr.a (mgr.14388) 7151 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:36 smithi163 bash[24253]: audit 2024-08-31T04:56:35.110296+0000 mgr.a (mgr.14388) 7150 : audit [DBG] from='client.162534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:36 smithi163 bash[24253]: cluster 2024-08-31T04:56:35.623148+0000 mgr.a (mgr.14388) 7151 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:36 smithi027 bash[22610]: audit 2024-08-31T04:56:35.110296+0000 mgr.a (mgr.14388) 7150 : audit [DBG] from='client.162534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:36 smithi027 bash[22610]: cluster 2024-08-31T04:56:35.623148+0000 mgr.a (mgr.14388) 7151 : cluster [DBG] pgmap v4956: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:38 smithi191 bash[24992]: cluster 2024-08-31T04:56:37.623817+0000 mgr.a (mgr.14388) 7152 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:38 smithi163 bash[24253]: cluster 2024-08-31T04:56:37.623817+0000 mgr.a (mgr.14388) 7152 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:38 smithi027 bash[22610]: cluster 2024-08-31T04:56:37.623817+0000 mgr.a (mgr.14388) 7152 : cluster [DBG] pgmap v4957: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:40.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:40.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:40.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:40 smithi191 bash[24992]: cluster 2024-08-31T04:56:39.626043+0000 mgr.a (mgr.14388) 7153 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:40 smithi163 bash[24253]: cluster 2024-08-31T04:56:39.626043+0000 mgr.a (mgr.14388) 7153 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:40 smithi027 bash[22610]: cluster 2024-08-31T04:56:39.626043+0000 mgr.a (mgr.14388) 7153 : cluster [DBG] pgmap v4958: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:41.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:41.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:41.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:41.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:41.295 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:41 smithi191 bash[24992]: audit 2024-08-31T04:56:40.884398+0000 mgr.a (mgr.14388) 7154 : audit [DBG] from='client.162612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:41 smithi163 bash[24253]: audit 2024-08-31T04:56:40.884398+0000 mgr.a (mgr.14388) 7154 : audit [DBG] from='client.162612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:42.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:41 smithi027 bash[22610]: audit 2024-08-31T04:56:40.884398+0000 mgr.a (mgr.14388) 7154 : audit [DBG] from='client.162612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:42 smithi191 bash[24992]: cluster 2024-08-31T04:56:41.626922+0000 mgr.a (mgr.14388) 7155 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:42 smithi163 bash[24253]: cluster 2024-08-31T04:56:41.626922+0000 mgr.a (mgr.14388) 7155 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:42 smithi027 bash[22610]: cluster 2024-08-31T04:56:41.626922+0000 mgr.a (mgr.14388) 7155 : cluster [DBG] pgmap v4959: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:44 smithi163 bash[24253]: cluster 2024-08-31T04:56:43.629104+0000 mgr.a (mgr.14388) 7156 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:44 smithi027 bash[22610]: cluster 2024-08-31T04:56:43.629104+0000 mgr.a (mgr.14388) 7156 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:44 smithi191 bash[24992]: cluster 2024-08-31T04:56:43.629104+0000 mgr.a (mgr.14388) 7156 : cluster [DBG] pgmap v4960: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:46.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:46.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:46.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:47.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:47.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:47.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:47.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:47.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:46 smithi163 bash[24253]: cluster 2024-08-31T04:56:45.629890+0000 mgr.a (mgr.14388) 7157 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:46 smithi027 bash[22610]: cluster 2024-08-31T04:56:45.629890+0000 mgr.a (mgr.14388) 7157 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:46 smithi191 bash[24992]: cluster 2024-08-31T04:56:45.629890+0000 mgr.a (mgr.14388) 7157 : cluster [DBG] pgmap v4961: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:47 smithi163 bash[24253]: audit 2024-08-31T04:56:46.638033+0000 mgr.a (mgr.14388) 7158 : audit [DBG] from='client.162687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:48.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:47 smithi027 bash[22610]: audit 2024-08-31T04:56:46.638033+0000 mgr.a (mgr.14388) 7158 : audit [DBG] from='client.162687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:47 smithi191 bash[24992]: audit 2024-08-31T04:56:46.638033+0000 mgr.a (mgr.14388) 7158 : audit [DBG] from='client.162687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:48 smithi163 bash[24253]: cluster 2024-08-31T04:56:47.630790+0000 mgr.a (mgr.14388) 7159 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:49.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:48 smithi027 bash[22610]: cluster 2024-08-31T04:56:47.630790+0000 mgr.a (mgr.14388) 7159 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:48 smithi191 bash[24992]: cluster 2024-08-31T04:56:47.630790+0000 mgr.a (mgr.14388) 7159 : cluster [DBG] pgmap v4962: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:50 smithi163 bash[24253]: cluster 2024-08-31T04:56:49.633025+0000 mgr.a (mgr.14388) 7160 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:51.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:50 smithi027 bash[22610]: cluster 2024-08-31T04:56:49.633025+0000 mgr.a (mgr.14388) 7160 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:50 smithi191 bash[24992]: cluster 2024-08-31T04:56:49.633025+0000 mgr.a (mgr.14388) 7160 : cluster [DBG] pgmap v4963: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:52.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:52.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:52.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:52.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:52.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:52.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:52.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:52.851 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:52 smithi163 bash[24253]: cluster 2024-08-31T04:56:51.633788+0000 mgr.a (mgr.14388) 7161 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:53.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:52 smithi027 bash[22610]: cluster 2024-08-31T04:56:51.633788+0000 mgr.a (mgr.14388) 7161 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:52 smithi191 bash[24992]: cluster 2024-08-31T04:56:51.633788+0000 mgr.a (mgr.14388) 7161 : cluster [DBG] pgmap v4964: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:53 smithi163 bash[24253]: audit 2024-08-31T04:56:52.402473+0000 mgr.a (mgr.14388) 7162 : audit [DBG] from='client.162759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:54.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:53 smithi027 bash[22610]: audit 2024-08-31T04:56:52.402473+0000 mgr.a (mgr.14388) 7162 : audit [DBG] from='client.162759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:53 smithi191 bash[24992]: audit 2024-08-31T04:56:52.402473+0000 mgr.a (mgr.14388) 7162 : audit [DBG] from='client.162759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:56:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:54 smithi163 bash[24253]: cluster 2024-08-31T04:56:53.636061+0000 mgr.a (mgr.14388) 7163 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:55.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:54 smithi027 bash[22610]: cluster 2024-08-31T04:56:53.636061+0000 mgr.a (mgr.14388) 7163 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:54 smithi191 bash[24992]: cluster 2024-08-31T04:56:53.636061+0000 mgr.a (mgr.14388) 7163 : cluster [DBG] pgmap v4965: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:56:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:56 smithi163 bash[24253]: cluster 2024-08-31T04:56:55.636825+0000 mgr.a (mgr.14388) 7164 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:56 smithi027 bash[22610]: cluster 2024-08-31T04:56:55.636825+0000 mgr.a (mgr.14388) 7164 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:56 smithi191 bash[24992]: cluster 2024-08-31T04:56:55.636825+0000 mgr.a (mgr.14388) 7164 : cluster [DBG] pgmap v4966: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:57.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:56:57.852 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:56:57.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:56:58.595 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:56:58.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:56:58.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:56:58.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:56:58.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:56:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:58 smithi163 bash[24253]: cluster 2024-08-31T04:56:57.637575+0000 mgr.a (mgr.14388) 7165 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:58 smithi027 bash[22610]: cluster 2024-08-31T04:56:57.637575+0000 mgr.a (mgr.14388) 7165 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:56:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:58 smithi191 bash[24992]: cluster 2024-08-31T04:56:57.637575+0000 mgr.a (mgr.14388) 7165 : cluster [DBG] pgmap v4967: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:56:59 smithi163 bash[24253]: audit 2024-08-31T04:56:58.179528+0000 mgr.a (mgr.14388) 7166 : audit [DBG] from='client.162837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:00.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:56:59 smithi027 bash[22610]: audit 2024-08-31T04:56:58.179528+0000 mgr.a (mgr.14388) 7166 : audit [DBG] from='client.162837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:56:59 smithi191 bash[24992]: audit 2024-08-31T04:56:58.179528+0000 mgr.a (mgr.14388) 7166 : audit [DBG] from='client.162837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:00 smithi163 bash[24253]: cluster 2024-08-31T04:56:59.640255+0000 mgr.a (mgr.14388) 7167 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:00 smithi163 bash[24253]: audit 2024-08-31T04:56:59.828019+0000 mon.a (mon.0) 1657 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:57:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:00 smithi163 bash[24253]: audit 2024-08-31T04:57:00.700501+0000 mon.a (mon.0) 1658 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:57:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:00 smithi163 bash[24253]: audit 2024-08-31T04:57:00.702350+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:57:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:00 smithi163 bash[24253]: audit 2024-08-31T04:57:00.712865+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:57:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:00 smithi163 bash[24253]: audit 2024-08-31T04:57:00.717796+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:57:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:00 smithi027 bash[22610]: cluster 2024-08-31T04:56:59.640255+0000 mgr.a (mgr.14388) 7167 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:00 smithi027 bash[22610]: audit 2024-08-31T04:56:59.828019+0000 mon.a (mon.0) 1657 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:57:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:00 smithi027 bash[22610]: audit 2024-08-31T04:57:00.700501+0000 mon.a (mon.0) 1658 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:57:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:00 smithi027 bash[22610]: audit 2024-08-31T04:57:00.702350+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:57:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:00 smithi027 bash[22610]: audit 2024-08-31T04:57:00.712865+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:57:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:00 smithi027 bash[22610]: audit 2024-08-31T04:57:00.717796+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:57:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:00 smithi191 bash[24992]: cluster 2024-08-31T04:56:59.640255+0000 mgr.a (mgr.14388) 7167 : cluster [DBG] pgmap v4968: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:00 smithi191 bash[24992]: audit 2024-08-31T04:56:59.828019+0000 mon.a (mon.0) 1657 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:57:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:00 smithi191 bash[24992]: audit 2024-08-31T04:57:00.700501+0000 mon.a (mon.0) 1658 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:57:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:00 smithi191 bash[24992]: audit 2024-08-31T04:57:00.702350+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:57:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:00 smithi191 bash[24992]: audit 2024-08-31T04:57:00.712865+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:57:01.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:00 smithi191 bash[24992]: audit 2024-08-31T04:57:00.717796+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:57:01.731 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:57:01 smithi027 bash[22863]: debug 2024-08-31T04:57:01.451+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:57:01.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:57:01 smithi027 bash[22863]: debug 2024-08-31T04:57:01.451+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:57:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:01 smithi163 bash[24253]: audit 2024-08-31T04:57:00.720185+0000 mgr.a (mgr.14388) 7168 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:57:02.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:01 smithi027 bash[22610]: audit 2024-08-31T04:57:00.720185+0000 mgr.a (mgr.14388) 7168 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:57:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:01 smithi191 bash[24992]: audit 2024-08-31T04:57:00.720185+0000 mgr.a (mgr.14388) 7168 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:57:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:02 smithi163 bash[24253]: audit 2024-08-31T04:57:01.455575+0000 mgr.a (mgr.14388) 7169 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:57:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:02 smithi163 bash[24253]: cephadm 2024-08-31T04:57:01.456905+0000 mgr.a (mgr.14388) 7170 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:57:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:02 smithi163 bash[24253]: cluster 2024-08-31T04:57:01.641122+0000 mgr.a (mgr.14388) 7171 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:57:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:02 smithi027 bash[22610]: audit 2024-08-31T04:57:01.455575+0000 mgr.a (mgr.14388) 7169 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:57:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:02 smithi027 bash[22610]: cephadm 2024-08-31T04:57:01.456905+0000 mgr.a (mgr.14388) 7170 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:57:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:02 smithi027 bash[22610]: cluster 2024-08-31T04:57:01.641122+0000 mgr.a (mgr.14388) 7171 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:57:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:02 smithi191 bash[24992]: audit 2024-08-31T04:57:01.455575+0000 mgr.a (mgr.14388) 7169 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:57:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:02 smithi191 bash[24992]: cephadm 2024-08-31T04:57:01.456905+0000 mgr.a (mgr.14388) 7170 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:57:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:02 smithi191 bash[24992]: cluster 2024-08-31T04:57:01.641122+0000 mgr.a (mgr.14388) 7171 : cluster [DBG] pgmap v4969: 225 pgs: 225 active+clean; 589 KiB data, 125 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:57:03.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:57:03.597 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:57:03.598 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:57:04.345 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:57:04.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:57:04.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:57:04.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:57:04.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:57:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:04 smithi163 bash[24253]: cluster 2024-08-31T04:57:03.643323+0000 mgr.a (mgr.14388) 7172 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:04 smithi163 bash[24253]: audit 2024-08-31T04:57:03.932080+0000 mgr.a (mgr.14388) 7173 : audit [DBG] from='client.163020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:04 smithi027 bash[22610]: cluster 2024-08-31T04:57:03.643323+0000 mgr.a (mgr.14388) 7172 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:04 smithi027 bash[22610]: audit 2024-08-31T04:57:03.932080+0000 mgr.a (mgr.14388) 7173 : audit [DBG] from='client.163020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:04 smithi191 bash[24992]: cluster 2024-08-31T04:57:03.643323+0000 mgr.a (mgr.14388) 7172 : cluster [DBG] pgmap v4970: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:04 smithi191 bash[24992]: audit 2024-08-31T04:57:03.932080+0000 mgr.a (mgr.14388) 7173 : audit [DBG] from='client.163020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:06 smithi163 bash[24253]: cluster 2024-08-31T04:57:05.644238+0000 mgr.a (mgr.14388) 7174 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:57:07.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:06 smithi027 bash[22610]: cluster 2024-08-31T04:57:05.644238+0000 mgr.a (mgr.14388) 7174 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:57:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:06 smithi191 bash[24992]: cluster 2024-08-31T04:57:05.644238+0000 mgr.a (mgr.14388) 7174 : cluster [DBG] pgmap v4971: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:57:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:08 smithi163 bash[24253]: cluster 2024-08-31T04:57:07.645031+0000 mgr.a (mgr.14388) 7175 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:57:08.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:08 smithi027 bash[22610]: cluster 2024-08-31T04:57:07.645031+0000 mgr.a (mgr.14388) 7175 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:57:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:08 smithi191 bash[24992]: cluster 2024-08-31T04:57:07.645031+0000 mgr.a (mgr.14388) 7175 : cluster [DBG] pgmap v4972: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T04:57:09.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:57:09.347 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:57:09.347 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:57:10.095 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:57:10.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:57:10.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:57:10.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:57:10.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:57:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:10 smithi027 bash[22610]: cluster 2024-08-31T04:57:09.647189+0000 mgr.a (mgr.14388) 7176 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:10 smithi027 bash[22610]: audit 2024-08-31T04:57:09.678029+0000 mgr.a (mgr.14388) 7177 : audit [DBG] from='client.163098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:10 smithi191 bash[24992]: cluster 2024-08-31T04:57:09.647189+0000 mgr.a (mgr.14388) 7176 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:10 smithi191 bash[24992]: audit 2024-08-31T04:57:09.678029+0000 mgr.a (mgr.14388) 7177 : audit [DBG] from='client.163098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:10 smithi163 bash[24253]: cluster 2024-08-31T04:57:09.647189+0000 mgr.a (mgr.14388) 7176 : cluster [DBG] pgmap v4973: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:10 smithi163 bash[24253]: audit 2024-08-31T04:57:09.678029+0000 mgr.a (mgr.14388) 7177 : audit [DBG] from='client.163098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:12.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:12 smithi027 bash[22610]: cluster 2024-08-31T04:57:11.648158+0000 mgr.a (mgr.14388) 7178 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:12 smithi191 bash[24992]: cluster 2024-08-31T04:57:11.648158+0000 mgr.a (mgr.14388) 7178 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:12 smithi163 bash[24253]: cluster 2024-08-31T04:57:11.648158+0000 mgr.a (mgr.14388) 7178 : cluster [DBG] pgmap v4974: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:14.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:14 smithi027 bash[22610]: cluster 2024-08-31T04:57:13.650350+0000 mgr.a (mgr.14388) 7179 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:14 smithi191 bash[24992]: cluster 2024-08-31T04:57:13.650350+0000 mgr.a (mgr.14388) 7179 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:15.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:57:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:57:15.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:57:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:14 smithi163 bash[24253]: cluster 2024-08-31T04:57:13.650350+0000 mgr.a (mgr.14388) 7179 : cluster [DBG] pgmap v4975: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:57:15.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:57:15.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:57:15.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:57:15.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:57:15.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:57:16.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:16 smithi027 bash[22610]: audit 2024-08-31T04:57:15.433894+0000 mgr.a (mgr.14388) 7180 : audit [DBG] from='client.163176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:16.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:16 smithi027 bash[22610]: cluster 2024-08-31T04:57:15.650918+0000 mgr.a (mgr.14388) 7181 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:16 smithi191 bash[24992]: audit 2024-08-31T04:57:15.433894+0000 mgr.a (mgr.14388) 7180 : audit [DBG] from='client.163176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:16 smithi191 bash[24992]: cluster 2024-08-31T04:57:15.650918+0000 mgr.a (mgr.14388) 7181 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:16 smithi163 bash[24253]: audit 2024-08-31T04:57:15.433894+0000 mgr.a (mgr.14388) 7180 : audit [DBG] from='client.163176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:16 smithi163 bash[24253]: cluster 2024-08-31T04:57:15.650918+0000 mgr.a (mgr.14388) 7181 : cluster [DBG] pgmap v4976: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:18 smithi027 bash[22610]: cluster 2024-08-31T04:57:17.651832+0000 mgr.a (mgr.14388) 7182 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:19.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:18 smithi191 bash[24992]: cluster 2024-08-31T04:57:17.651832+0000 mgr.a (mgr.14388) 7182 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:19.206 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:18 smithi163 bash[24253]: cluster 2024-08-31T04:57:17.651832+0000 mgr.a (mgr.14388) 7182 : cluster [DBG] pgmap v4977: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:20.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:57:20.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:57:20.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:57:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:20 smithi027 bash[22610]: cluster 2024-08-31T04:57:19.654106+0000 mgr.a (mgr.14388) 7183 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:20 smithi191 bash[24992]: cluster 2024-08-31T04:57:19.654106+0000 mgr.a (mgr.14388) 7183 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:20 smithi163 bash[24253]: cluster 2024-08-31T04:57:19.654106+0000 mgr.a (mgr.14388) 7183 : cluster [DBG] pgmap v4978: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:21.631 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:57:21.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:57:21.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:57:21.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:57:21.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:57:22.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:22 smithi027 bash[22610]: audit 2024-08-31T04:57:21.212733+0000 mgr.a (mgr.14388) 7184 : audit [DBG] from='client.163254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:22 smithi027 bash[22610]: cluster 2024-08-31T04:57:21.654880+0000 mgr.a (mgr.14388) 7185 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:22 smithi191 bash[24992]: audit 2024-08-31T04:57:21.212733+0000 mgr.a (mgr.14388) 7184 : audit [DBG] from='client.163254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:22 smithi191 bash[24992]: cluster 2024-08-31T04:57:21.654880+0000 mgr.a (mgr.14388) 7185 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:22 smithi163 bash[24253]: audit 2024-08-31T04:57:21.212733+0000 mgr.a (mgr.14388) 7184 : audit [DBG] from='client.163254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:22 smithi163 bash[24253]: cluster 2024-08-31T04:57:21.654880+0000 mgr.a (mgr.14388) 7185 : cluster [DBG] pgmap v4979: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:24.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:24 smithi027 bash[22610]: cluster 2024-08-31T04:57:23.657055+0000 mgr.a (mgr.14388) 7186 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:24 smithi191 bash[24992]: cluster 2024-08-31T04:57:23.657055+0000 mgr.a (mgr.14388) 7186 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:24 smithi163 bash[24253]: cluster 2024-08-31T04:57:23.657055+0000 mgr.a (mgr.14388) 7186 : cluster [DBG] pgmap v4980: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:57:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:57:26.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:57:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:26 smithi191 bash[24992]: cluster 2024-08-31T04:57:25.657839+0000 mgr.a (mgr.14388) 7187 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:26 smithi163 bash[24253]: cluster 2024-08-31T04:57:25.657839+0000 mgr.a (mgr.14388) 7187 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:27.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:26 smithi027 bash[22610]: cluster 2024-08-31T04:57:25.657839+0000 mgr.a (mgr.14388) 7187 : cluster [DBG] pgmap v4981: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:27.386 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:57:27.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:57:27.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:57:27.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:57:27.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:57:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:27 smithi191 bash[24992]: audit 2024-08-31T04:57:26.967910+0000 mgr.a (mgr.14388) 7188 : audit [DBG] from='client.163332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:27 smithi163 bash[24253]: audit 2024-08-31T04:57:26.967910+0000 mgr.a (mgr.14388) 7188 : audit [DBG] from='client.163332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:28.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:27 smithi027 bash[22610]: audit 2024-08-31T04:57:26.967910+0000 mgr.a (mgr.14388) 7188 : audit [DBG] from='client.163332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:28 smithi191 bash[24992]: cluster 2024-08-31T04:57:27.658826+0000 mgr.a (mgr.14388) 7189 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:28 smithi163 bash[24253]: cluster 2024-08-31T04:57:27.658826+0000 mgr.a (mgr.14388) 7189 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:29.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:28 smithi027 bash[22610]: cluster 2024-08-31T04:57:27.658826+0000 mgr.a (mgr.14388) 7189 : cluster [DBG] pgmap v4982: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:30 smithi191 bash[24992]: cluster 2024-08-31T04:57:29.661134+0000 mgr.a (mgr.14388) 7190 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:30 smithi163 bash[24253]: cluster 2024-08-31T04:57:29.661134+0000 mgr.a (mgr.14388) 7190 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:31.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:30 smithi027 bash[22610]: cluster 2024-08-31T04:57:29.661134+0000 mgr.a (mgr.14388) 7190 : cluster [DBG] pgmap v4983: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:32.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:57:32.389 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:57:32.389 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:57:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:32 smithi191 bash[24992]: cluster 2024-08-31T04:57:31.661927+0000 mgr.a (mgr.14388) 7191 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:33.147 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:57:33.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:57:33.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:57:33.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:57:33.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:57:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:32 smithi163 bash[24253]: cluster 2024-08-31T04:57:31.661927+0000 mgr.a (mgr.14388) 7191 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:32 smithi027 bash[22610]: cluster 2024-08-31T04:57:31.661927+0000 mgr.a (mgr.14388) 7191 : cluster [DBG] pgmap v4984: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:33 smithi191 bash[24992]: audit 2024-08-31T04:57:32.722416+0000 mgr.a (mgr.14388) 7192 : audit [DBG] from='client.163407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:34.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:33 smithi163 bash[24253]: audit 2024-08-31T04:57:32.722416+0000 mgr.a (mgr.14388) 7192 : audit [DBG] from='client.163407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:34.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:33 smithi027 bash[22610]: audit 2024-08-31T04:57:32.722416+0000 mgr.a (mgr.14388) 7192 : audit [DBG] from='client.163407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:34 smithi191 bash[24992]: cluster 2024-08-31T04:57:33.664773+0000 mgr.a (mgr.14388) 7193 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:34 smithi163 bash[24253]: cluster 2024-08-31T04:57:33.664773+0000 mgr.a (mgr.14388) 7193 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:34 smithi027 bash[22610]: cluster 2024-08-31T04:57:33.664773+0000 mgr.a (mgr.14388) 7193 : cluster [DBG] pgmap v4985: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:36 smithi191 bash[24992]: cluster 2024-08-31T04:57:35.665564+0000 mgr.a (mgr.14388) 7194 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:57:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:36 smithi163 bash[24253]: cluster 2024-08-31T04:57:35.665564+0000 mgr.a (mgr.14388) 7194 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:57:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:36 smithi027 bash[22610]: cluster 2024-08-31T04:57:35.665564+0000 mgr.a (mgr.14388) 7194 : cluster [DBG] pgmap v4986: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:57:38.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:57:38.149 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:57:38.150 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:57:38.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:57:38.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:57:38.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:57:38.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:57:38.907 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:57:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:38 smithi191 bash[24992]: cluster 2024-08-31T04:57:37.666339+0000 mgr.a (mgr.14388) 7195 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:57:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:38 smithi163 bash[24253]: cluster 2024-08-31T04:57:37.666339+0000 mgr.a (mgr.14388) 7195 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:57:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:38 smithi027 bash[22610]: cluster 2024-08-31T04:57:37.666339+0000 mgr.a (mgr.14388) 7195 : cluster [DBG] pgmap v4987: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:57:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:39 smithi191 bash[24992]: audit 2024-08-31T04:57:38.487217+0000 mgr.a (mgr.14388) 7196 : audit [DBG] from='client.163482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:39 smithi163 bash[24253]: audit 2024-08-31T04:57:38.487217+0000 mgr.a (mgr.14388) 7196 : audit [DBG] from='client.163482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:40.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:39 smithi027 bash[22610]: audit 2024-08-31T04:57:38.487217+0000 mgr.a (mgr.14388) 7196 : audit [DBG] from='client.163482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:40 smithi191 bash[24992]: cluster 2024-08-31T04:57:39.669171+0000 mgr.a (mgr.14388) 7197 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:40 smithi163 bash[24253]: cluster 2024-08-31T04:57:39.669171+0000 mgr.a (mgr.14388) 7197 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:40 smithi027 bash[22610]: cluster 2024-08-31T04:57:39.669171+0000 mgr.a (mgr.14388) 7197 : cluster [DBG] pgmap v4988: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:42 smithi191 bash[24992]: cluster 2024-08-31T04:57:41.669970+0000 mgr.a (mgr.14388) 7198 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:57:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:42 smithi163 bash[24253]: cluster 2024-08-31T04:57:41.669970+0000 mgr.a (mgr.14388) 7198 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:57:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:42 smithi027 bash[22610]: cluster 2024-08-31T04:57:41.669970+0000 mgr.a (mgr.14388) 7198 : cluster [DBG] pgmap v4989: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:57:43.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:57:43.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:57:43.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:57:44.686 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:57:44.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:57:44.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:57:44.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:57:44.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:57:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:44 smithi163 bash[24253]: cluster 2024-08-31T04:57:43.672007+0000 mgr.a (mgr.14388) 7199 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:44 smithi027 bash[22610]: cluster 2024-08-31T04:57:43.672007+0000 mgr.a (mgr.14388) 7199 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:44 smithi191 bash[24992]: cluster 2024-08-31T04:57:43.672007+0000 mgr.a (mgr.14388) 7199 : cluster [DBG] pgmap v4990: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:45 smithi163 bash[24253]: audit 2024-08-31T04:57:44.244476+0000 mgr.a (mgr.14388) 7200 : audit [DBG] from='client.163557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:46.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:45 smithi027 bash[22610]: audit 2024-08-31T04:57:44.244476+0000 mgr.a (mgr.14388) 7200 : audit [DBG] from='client.163557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:45 smithi191 bash[24992]: audit 2024-08-31T04:57:44.244476+0000 mgr.a (mgr.14388) 7200 : audit [DBG] from='client.163557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:46 smithi163 bash[24253]: cluster 2024-08-31T04:57:45.673096+0000 mgr.a (mgr.14388) 7201 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:46 smithi027 bash[22610]: cluster 2024-08-31T04:57:45.673096+0000 mgr.a (mgr.14388) 7201 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:46 smithi191 bash[24992]: cluster 2024-08-31T04:57:45.673096+0000 mgr.a (mgr.14388) 7201 : cluster [DBG] pgmap v4991: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:48 smithi163 bash[24253]: cluster 2024-08-31T04:57:47.674058+0000 mgr.a (mgr.14388) 7202 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:49.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:48 smithi027 bash[22610]: cluster 2024-08-31T04:57:47.674058+0000 mgr.a (mgr.14388) 7202 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:48 smithi191 bash[24992]: cluster 2024-08-31T04:57:47.674058+0000 mgr.a (mgr.14388) 7202 : cluster [DBG] pgmap v4992: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:49.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:57:49.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:57:49.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:57:50.460 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:57:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:57:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:57:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:57:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:57:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:50 smithi163 bash[24253]: cluster 2024-08-31T04:57:49.676522+0000 mgr.a (mgr.14388) 7203 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:51.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:50 smithi027 bash[22610]: cluster 2024-08-31T04:57:49.676522+0000 mgr.a (mgr.14388) 7203 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:50 smithi191 bash[24992]: cluster 2024-08-31T04:57:49.676522+0000 mgr.a (mgr.14388) 7203 : cluster [DBG] pgmap v4993: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:51 smithi163 bash[24253]: audit 2024-08-31T04:57:50.025995+0000 mgr.a (mgr.14388) 7204 : audit [DBG] from='client.163632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:52.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:51 smithi027 bash[22610]: audit 2024-08-31T04:57:50.025995+0000 mgr.a (mgr.14388) 7204 : audit [DBG] from='client.163632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:51 smithi191 bash[24992]: audit 2024-08-31T04:57:50.025995+0000 mgr.a (mgr.14388) 7204 : audit [DBG] from='client.163632 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:52 smithi163 bash[24253]: cluster 2024-08-31T04:57:51.677474+0000 mgr.a (mgr.14388) 7205 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:53.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:52 smithi027 bash[22610]: cluster 2024-08-31T04:57:51.677474+0000 mgr.a (mgr.14388) 7205 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:52 smithi191 bash[24992]: cluster 2024-08-31T04:57:51.677474+0000 mgr.a (mgr.14388) 7205 : cluster [DBG] pgmap v4994: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:54 smithi163 bash[24253]: cluster 2024-08-31T04:57:53.679756+0000 mgr.a (mgr.14388) 7206 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:55.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:54 smithi027 bash[22610]: cluster 2024-08-31T04:57:53.679756+0000 mgr.a (mgr.14388) 7206 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:54 smithi191 bash[24992]: cluster 2024-08-31T04:57:53.679756+0000 mgr.a (mgr.14388) 7206 : cluster [DBG] pgmap v4995: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:57:55.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:57:55.462 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:57:55.462 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:57:56.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:57:56.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:57:56.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:57:56.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:57:56.224 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:57:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:56 smithi163 bash[24253]: cluster 2024-08-31T04:57:55.680493+0000 mgr.a (mgr.14388) 7207 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:56 smithi163 bash[24253]: audit 2024-08-31T04:57:55.799504+0000 mgr.a (mgr.14388) 7208 : audit [DBG] from='client.163710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:56 smithi027 bash[22610]: cluster 2024-08-31T04:57:55.680493+0000 mgr.a (mgr.14388) 7207 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:56 smithi027 bash[22610]: audit 2024-08-31T04:57:55.799504+0000 mgr.a (mgr.14388) 7208 : audit [DBG] from='client.163710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:56 smithi191 bash[24992]: cluster 2024-08-31T04:57:55.680493+0000 mgr.a (mgr.14388) 7207 : cluster [DBG] pgmap v4996: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:56 smithi191 bash[24992]: audit 2024-08-31T04:57:55.799504+0000 mgr.a (mgr.14388) 7208 : audit [DBG] from='client.163710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:57:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:57:58 smithi163 bash[24253]: cluster 2024-08-31T04:57:57.681418+0000 mgr.a (mgr.14388) 7209 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:57:58 smithi027 bash[22610]: cluster 2024-08-31T04:57:57.681418+0000 mgr.a (mgr.14388) 7209 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:57:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:57:58 smithi191 bash[24992]: cluster 2024-08-31T04:57:57.681418+0000 mgr.a (mgr.14388) 7209 : cluster [DBG] pgmap v4997: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:00 smithi163 bash[24253]: cluster 2024-08-31T04:57:59.683834+0000 mgr.a (mgr.14388) 7210 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:01.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:01.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:01.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:00 smithi027 bash[22610]: cluster 2024-08-31T04:57:59.683834+0000 mgr.a (mgr.14388) 7210 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:00 smithi191 bash[24992]: cluster 2024-08-31T04:57:59.683834+0000 mgr.a (mgr.14388) 7210 : cluster [DBG] pgmap v4998: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:01.981 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:01.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:01.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:01.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:01.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:58:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:01 smithi163 bash[24253]: audit 2024-08-31T04:58:01.512250+0000 mon.a (mon.0) 1662 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:58:02.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:01 smithi027 bash[22610]: audit 2024-08-31T04:58:01.512250+0000 mon.a (mon.0) 1662 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:58:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:01 smithi191 bash[24992]: audit 2024-08-31T04:58:01.512250+0000 mon.a (mon.0) 1662 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:58:03.144 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:02 smithi027 bash[22610]: audit 2024-08-31T04:58:01.559831+0000 mgr.a (mgr.14388) 7211 : audit [DBG] from='client.163788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:03.144 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:02 smithi027 bash[22610]: cluster 2024-08-31T04:58:01.684348+0000 mgr.a (mgr.14388) 7212 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:03.144 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:02 smithi027 bash[22610]: audit 2024-08-31T04:58:02.403113+0000 mon.a (mon.0) 1663 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:58:03.144 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:02 smithi027 bash[22610]: audit 2024-08-31T04:58:02.404928+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:58:03.144 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:02 smithi027 bash[22610]: audit 2024-08-31T04:58:02.415800+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:58:03.144 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:02 smithi027 bash[22610]: audit 2024-08-31T04:58:02.420826+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:58:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:02 smithi163 bash[24253]: audit 2024-08-31T04:58:01.559831+0000 mgr.a (mgr.14388) 7211 : audit [DBG] from='client.163788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:02 smithi163 bash[24253]: cluster 2024-08-31T04:58:01.684348+0000 mgr.a (mgr.14388) 7212 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:02 smithi163 bash[24253]: audit 2024-08-31T04:58:02.403113+0000 mon.a (mon.0) 1663 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:58:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:02 smithi163 bash[24253]: audit 2024-08-31T04:58:02.404928+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:58:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:02 smithi163 bash[24253]: audit 2024-08-31T04:58:02.415800+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:58:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:02 smithi163 bash[24253]: audit 2024-08-31T04:58:02.420826+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:58:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:02 smithi191 bash[24992]: audit 2024-08-31T04:58:01.559831+0000 mgr.a (mgr.14388) 7211 : audit [DBG] from='client.163788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:02 smithi191 bash[24992]: cluster 2024-08-31T04:58:01.684348+0000 mgr.a (mgr.14388) 7212 : cluster [DBG] pgmap v4999: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:02 smithi191 bash[24992]: audit 2024-08-31T04:58:02.403113+0000 mon.a (mon.0) 1663 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:58:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:02 smithi191 bash[24992]: audit 2024-08-31T04:58:02.404928+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:58:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:02 smithi191 bash[24992]: audit 2024-08-31T04:58:02.415800+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:58:03.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:02 smithi191 bash[24992]: audit 2024-08-31T04:58:02.420826+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:58:03.481 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:58:03 smithi027 bash[22863]: debug 2024-08-31T04:58:03.142+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:58:03.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:58:03 smithi027 bash[22863]: debug 2024-08-31T04:58:03.146+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:58:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:03 smithi163 bash[24253]: audit 2024-08-31T04:58:02.423401+0000 mgr.a (mgr.14388) 7213 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:58:04.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:03 smithi027 bash[22610]: audit 2024-08-31T04:58:02.423401+0000 mgr.a (mgr.14388) 7213 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:58:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:03 smithi191 bash[24992]: audit 2024-08-31T04:58:02.423401+0000 mgr.a (mgr.14388) 7213 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:58:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:04 smithi163 bash[24253]: audit 2024-08-31T04:58:03.145738+0000 mgr.a (mgr.14388) 7214 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:58:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:04 smithi163 bash[24253]: cephadm 2024-08-31T04:58:03.147227+0000 mgr.a (mgr.14388) 7215 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:58:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:04 smithi163 bash[24253]: cluster 2024-08-31T04:58:03.687238+0000 mgr.a (mgr.14388) 7216 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:58:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:04 smithi027 bash[22610]: audit 2024-08-31T04:58:03.145738+0000 mgr.a (mgr.14388) 7214 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:58:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:04 smithi027 bash[22610]: cephadm 2024-08-31T04:58:03.147227+0000 mgr.a (mgr.14388) 7215 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:58:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:04 smithi027 bash[22610]: cluster 2024-08-31T04:58:03.687238+0000 mgr.a (mgr.14388) 7216 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:58:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:04 smithi191 bash[24992]: audit 2024-08-31T04:58:03.145738+0000 mgr.a (mgr.14388) 7214 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:58:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:04 smithi191 bash[24992]: cephadm 2024-08-31T04:58:03.147227+0000 mgr.a (mgr.14388) 7215 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:58:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:04 smithi191 bash[24992]: cluster 2024-08-31T04:58:03.687238+0000 mgr.a (mgr.14388) 7216 : cluster [DBG] pgmap v5000: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:58:06.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:06.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:06.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:06 smithi163 bash[24253]: cluster 2024-08-31T04:58:05.688059+0000 mgr.a (mgr.14388) 7217 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:58:07.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:06 smithi027 bash[22610]: cluster 2024-08-31T04:58:05.688059+0000 mgr.a (mgr.14388) 7217 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:58:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:06 smithi191 bash[24992]: cluster 2024-08-31T04:58:05.688059+0000 mgr.a (mgr.14388) 7217 : cluster [DBG] pgmap v5001: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:58:07.727 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:07.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:07.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:07.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:07.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:58:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:08 smithi163 bash[24253]: audit 2024-08-31T04:58:07.315611+0000 mgr.a (mgr.14388) 7218 : audit [DBG] from='client.163971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:08 smithi163 bash[24253]: cluster 2024-08-31T04:58:07.688630+0000 mgr.a (mgr.14388) 7219 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:58:09.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:08 smithi027 bash[22610]: audit 2024-08-31T04:58:07.315611+0000 mgr.a (mgr.14388) 7218 : audit [DBG] from='client.163971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:09.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:08 smithi027 bash[22610]: cluster 2024-08-31T04:58:07.688630+0000 mgr.a (mgr.14388) 7219 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:58:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:08 smithi191 bash[24992]: audit 2024-08-31T04:58:07.315611+0000 mgr.a (mgr.14388) 7218 : audit [DBG] from='client.163971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:08 smithi191 bash[24992]: cluster 2024-08-31T04:58:07.688630+0000 mgr.a (mgr.14388) 7219 : cluster [DBG] pgmap v5002: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T04:58:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:10 smithi163 bash[24253]: cluster 2024-08-31T04:58:09.690922+0000 mgr.a (mgr.14388) 7220 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T04:58:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:10 smithi027 bash[22610]: cluster 2024-08-31T04:58:09.690922+0000 mgr.a (mgr.14388) 7220 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T04:58:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:10 smithi191 bash[24992]: cluster 2024-08-31T04:58:09.690922+0000 mgr.a (mgr.14388) 7220 : cluster [DBG] pgmap v5003: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T04:58:12.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:12.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:12.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:12 smithi163 bash[24253]: cluster 2024-08-31T04:58:11.691642+0000 mgr.a (mgr.14388) 7221 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:58:13.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:12 smithi027 bash[22610]: cluster 2024-08-31T04:58:11.691642+0000 mgr.a (mgr.14388) 7221 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:58:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:12 smithi191 bash[24992]: cluster 2024-08-31T04:58:11.691642+0000 mgr.a (mgr.14388) 7221 : cluster [DBG] pgmap v5004: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:58:13.512 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:13.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:13.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:13.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:13.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:58:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:14 smithi163 bash[24253]: audit 2024-08-31T04:58:13.069138+0000 mgr.a (mgr.14388) 7222 : audit [DBG] from='client.164049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:14 smithi163 bash[24253]: cluster 2024-08-31T04:58:13.694442+0000 mgr.a (mgr.14388) 7223 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:58:15.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:14 smithi027 bash[22610]: audit 2024-08-31T04:58:13.069138+0000 mgr.a (mgr.14388) 7222 : audit [DBG] from='client.164049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:14 smithi027 bash[22610]: cluster 2024-08-31T04:58:13.694442+0000 mgr.a (mgr.14388) 7223 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:58:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:14 smithi191 bash[24992]: audit 2024-08-31T04:58:13.069138+0000 mgr.a (mgr.14388) 7222 : audit [DBG] from='client.164049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:14 smithi191 bash[24992]: cluster 2024-08-31T04:58:13.694442+0000 mgr.a (mgr.14388) 7223 : cluster [DBG] pgmap v5005: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:58:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:16 smithi163 bash[24253]: cluster 2024-08-31T04:58:15.695266+0000 mgr.a (mgr.14388) 7224 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:58:17.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:16 smithi027 bash[22610]: cluster 2024-08-31T04:58:15.695266+0000 mgr.a (mgr.14388) 7224 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:58:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:16 smithi191 bash[24992]: cluster 2024-08-31T04:58:15.695266+0000 mgr.a (mgr.14388) 7224 : cluster [DBG] pgmap v5006: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:58:18.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:18.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:18.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:18 smithi163 bash[24253]: cluster 2024-08-31T04:58:17.696045+0000 mgr.a (mgr.14388) 7225 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:58:19.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:18 smithi027 bash[22610]: cluster 2024-08-31T04:58:17.696045+0000 mgr.a (mgr.14388) 7225 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:58:19.279 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:19.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:58:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:18 smithi191 bash[24992]: cluster 2024-08-31T04:58:17.696045+0000 mgr.a (mgr.14388) 7225 : cluster [DBG] pgmap v5007: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T04:58:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:19 smithi163 bash[24253]: audit 2024-08-31T04:58:18.854875+0000 mgr.a (mgr.14388) 7226 : audit [DBG] from='client.164124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:20.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:19 smithi027 bash[22610]: audit 2024-08-31T04:58:18.854875+0000 mgr.a (mgr.14388) 7226 : audit [DBG] from='client.164124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:19 smithi191 bash[24992]: audit 2024-08-31T04:58:18.854875+0000 mgr.a (mgr.14388) 7226 : audit [DBG] from='client.164124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:20 smithi163 bash[24253]: cluster 2024-08-31T04:58:19.698949+0000 mgr.a (mgr.14388) 7227 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:58:21.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:20 smithi027 bash[22610]: cluster 2024-08-31T04:58:19.698949+0000 mgr.a (mgr.14388) 7227 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:58:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:20 smithi191 bash[24992]: cluster 2024-08-31T04:58:19.698949+0000 mgr.a (mgr.14388) 7227 : cluster [DBG] pgmap v5008: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T04:58:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:22 smithi163 bash[24253]: cluster 2024-08-31T04:58:21.699753+0000 mgr.a (mgr.14388) 7228 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:58:23.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:22 smithi027 bash[22610]: cluster 2024-08-31T04:58:21.699753+0000 mgr.a (mgr.14388) 7228 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:58:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:22 smithi191 bash[24992]: cluster 2024-08-31T04:58:21.699753+0000 mgr.a (mgr.14388) 7228 : cluster [DBG] pgmap v5009: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:58:24.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:24.282 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:24.282 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:25.065 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:25.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:58:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:24 smithi163 bash[24253]: cluster 2024-08-31T04:58:23.701753+0000 mgr.a (mgr.14388) 7229 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:24 smithi027 bash[22610]: cluster 2024-08-31T04:58:23.701753+0000 mgr.a (mgr.14388) 7229 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:24 smithi191 bash[24992]: cluster 2024-08-31T04:58:23.701753+0000 mgr.a (mgr.14388) 7229 : cluster [DBG] pgmap v5010: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:25 smithi163 bash[24253]: audit 2024-08-31T04:58:24.617005+0000 mgr.a (mgr.14388) 7230 : audit [DBG] from='client.164202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:26.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:25 smithi027 bash[22610]: audit 2024-08-31T04:58:24.617005+0000 mgr.a (mgr.14388) 7230 : audit [DBG] from='client.164202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:25 smithi191 bash[24992]: audit 2024-08-31T04:58:24.617005+0000 mgr.a (mgr.14388) 7230 : audit [DBG] from='client.164202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:26 smithi163 bash[24253]: cluster 2024-08-31T04:58:25.702742+0000 mgr.a (mgr.14388) 7231 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:27.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:26 smithi027 bash[22610]: cluster 2024-08-31T04:58:25.702742+0000 mgr.a (mgr.14388) 7231 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:26 smithi191 bash[24992]: cluster 2024-08-31T04:58:25.702742+0000 mgr.a (mgr.14388) 7231 : cluster [DBG] pgmap v5011: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:28 smithi163 bash[24253]: cluster 2024-08-31T04:58:27.703510+0000 mgr.a (mgr.14388) 7232 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:29.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:28 smithi027 bash[22610]: cluster 2024-08-31T04:58:27.703510+0000 mgr.a (mgr.14388) 7232 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:28 smithi191 bash[24992]: cluster 2024-08-31T04:58:27.703510+0000 mgr.a (mgr.14388) 7232 : cluster [DBG] pgmap v5012: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:30.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:30.067 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:30.067 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:30.854 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:30.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:30.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:30.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:30.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:58:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:30 smithi163 bash[24253]: cluster 2024-08-31T04:58:29.705805+0000 mgr.a (mgr.14388) 7233 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:31.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:30 smithi027 bash[22610]: cluster 2024-08-31T04:58:29.705805+0000 mgr.a (mgr.14388) 7233 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:30 smithi191 bash[24992]: cluster 2024-08-31T04:58:29.705805+0000 mgr.a (mgr.14388) 7233 : cluster [DBG] pgmap v5013: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:31 smithi163 bash[24253]: audit 2024-08-31T04:58:30.409192+0000 mgr.a (mgr.14388) 7234 : audit [DBG] from='client.164280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:32.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:31 smithi027 bash[22610]: audit 2024-08-31T04:58:30.409192+0000 mgr.a (mgr.14388) 7234 : audit [DBG] from='client.164280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:31 smithi191 bash[24992]: audit 2024-08-31T04:58:30.409192+0000 mgr.a (mgr.14388) 7234 : audit [DBG] from='client.164280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:32 smithi163 bash[24253]: cluster 2024-08-31T04:58:31.706838+0000 mgr.a (mgr.14388) 7235 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:32 smithi027 bash[22610]: cluster 2024-08-31T04:58:31.706838+0000 mgr.a (mgr.14388) 7235 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:32 smithi191 bash[24992]: cluster 2024-08-31T04:58:31.706838+0000 mgr.a (mgr.14388) 7235 : cluster [DBG] pgmap v5014: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:34 smithi027 bash[22610]: cluster 2024-08-31T04:58:33.709609+0000 mgr.a (mgr.14388) 7236 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:34 smithi191 bash[24992]: cluster 2024-08-31T04:58:33.709609+0000 mgr.a (mgr.14388) 7236 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:34 smithi163 bash[24253]: cluster 2024-08-31T04:58:33.709609+0000 mgr.a (mgr.14388) 7236 : cluster [DBG] pgmap v5015: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:35.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:35.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:35.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:36.644 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:36.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:36.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:36.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:36.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:58:37.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:36 smithi027 bash[22610]: cluster 2024-08-31T04:58:35.710377+0000 mgr.a (mgr.14388) 7237 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:36 smithi191 bash[24992]: cluster 2024-08-31T04:58:35.710377+0000 mgr.a (mgr.14388) 7237 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:36 smithi163 bash[24253]: cluster 2024-08-31T04:58:35.710377+0000 mgr.a (mgr.14388) 7237 : cluster [DBG] pgmap v5016: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:38.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:37 smithi027 bash[22610]: audit 2024-08-31T04:58:36.194884+0000 mgr.a (mgr.14388) 7238 : audit [DBG] from='client.164355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:37 smithi191 bash[24992]: audit 2024-08-31T04:58:36.194884+0000 mgr.a (mgr.14388) 7238 : audit [DBG] from='client.164355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:37 smithi163 bash[24253]: audit 2024-08-31T04:58:36.194884+0000 mgr.a (mgr.14388) 7238 : audit [DBG] from='client.164355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:38 smithi027 bash[22610]: cluster 2024-08-31T04:58:37.711304+0000 mgr.a (mgr.14388) 7239 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:38 smithi191 bash[24992]: cluster 2024-08-31T04:58:37.711304+0000 mgr.a (mgr.14388) 7239 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:38 smithi163 bash[24253]: cluster 2024-08-31T04:58:37.711304+0000 mgr.a (mgr.14388) 7239 : cluster [DBG] pgmap v5017: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:40 smithi027 bash[22610]: cluster 2024-08-31T04:58:39.713569+0000 mgr.a (mgr.14388) 7240 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:40 smithi191 bash[24992]: cluster 2024-08-31T04:58:39.713569+0000 mgr.a (mgr.14388) 7240 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:40 smithi163 bash[24253]: cluster 2024-08-31T04:58:39.713569+0000 mgr.a (mgr.14388) 7240 : cluster [DBG] pgmap v5018: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:41.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:41.646 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:41.647 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:42.383 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:42.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:42.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:42.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:42.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:58:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:42 smithi027 bash[22610]: cluster 2024-08-31T04:58:41.714140+0000 mgr.a (mgr.14388) 7241 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:42 smithi027 bash[22610]: audit 2024-08-31T04:58:41.981468+0000 mgr.a (mgr.14388) 7242 : audit [DBG] from='client.164430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:42 smithi191 bash[24992]: cluster 2024-08-31T04:58:41.714140+0000 mgr.a (mgr.14388) 7241 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:42 smithi191 bash[24992]: audit 2024-08-31T04:58:41.981468+0000 mgr.a (mgr.14388) 7242 : audit [DBG] from='client.164430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:42 smithi163 bash[24253]: cluster 2024-08-31T04:58:41.714140+0000 mgr.a (mgr.14388) 7241 : cluster [DBG] pgmap v5019: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:42 smithi163 bash[24253]: audit 2024-08-31T04:58:41.981468+0000 mgr.a (mgr.14388) 7242 : audit [DBG] from='client.164430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:44 smithi191 bash[24992]: cluster 2024-08-31T04:58:43.716490+0000 mgr.a (mgr.14388) 7243 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:44 smithi163 bash[24253]: cluster 2024-08-31T04:58:43.716490+0000 mgr.a (mgr.14388) 7243 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:45.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:44 smithi027 bash[22610]: cluster 2024-08-31T04:58:43.716490+0000 mgr.a (mgr.14388) 7243 : cluster [DBG] pgmap v5020: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:58:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:46 smithi191 bash[24992]: cluster 2024-08-31T04:58:45.717262+0000 mgr.a (mgr.14388) 7244 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:47.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:47.385 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:47.385 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:46 smithi163 bash[24253]: cluster 2024-08-31T04:58:45.717262+0000 mgr.a (mgr.14388) 7244 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:47.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:46 smithi027 bash[22610]: cluster 2024-08-31T04:58:45.717262+0000 mgr.a (mgr.14388) 7244 : cluster [DBG] pgmap v5021: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:48.167 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:48.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:48.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:48.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:48.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:58:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:48 smithi191 bash[24992]: cluster 2024-08-31T04:58:47.717990+0000 mgr.a (mgr.14388) 7245 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:48 smithi191 bash[24992]: audit 2024-08-31T04:58:47.728078+0000 mgr.a (mgr.14388) 7246 : audit [DBG] from='client.164508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:48 smithi163 bash[24253]: cluster 2024-08-31T04:58:47.717990+0000 mgr.a (mgr.14388) 7245 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:48 smithi163 bash[24253]: audit 2024-08-31T04:58:47.728078+0000 mgr.a (mgr.14388) 7246 : audit [DBG] from='client.164508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:49.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:48 smithi027 bash[22610]: cluster 2024-08-31T04:58:47.717990+0000 mgr.a (mgr.14388) 7245 : cluster [DBG] pgmap v5022: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:49.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:48 smithi027 bash[22610]: audit 2024-08-31T04:58:47.728078+0000 mgr.a (mgr.14388) 7246 : audit [DBG] from='client.164508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:50 smithi191 bash[24992]: cluster 2024-08-31T04:58:49.720815+0000 mgr.a (mgr.14388) 7247 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:50 smithi163 bash[24253]: cluster 2024-08-31T04:58:49.720815+0000 mgr.a (mgr.14388) 7247 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:51.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:50 smithi027 bash[22610]: cluster 2024-08-31T04:58:49.720815+0000 mgr.a (mgr.14388) 7247 : cluster [DBG] pgmap v5023: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:52.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:52 smithi163 bash[24253]: cluster 2024-08-31T04:58:51.721642+0000 mgr.a (mgr.14388) 7248 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:58:52.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:52 smithi027 bash[22610]: cluster 2024-08-31T04:58:51.721642+0000 mgr.a (mgr.14388) 7248 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:58:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:52 smithi191 bash[24992]: cluster 2024-08-31T04:58:51.721642+0000 mgr.a (mgr.14388) 7248 : cluster [DBG] pgmap v5024: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:58:53.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:53.169 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:53.170 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:53.952 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:53.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:53.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:53.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:53.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:58:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:54 smithi191 bash[24992]: audit 2024-08-31T04:58:53.507459+0000 mgr.a (mgr.14388) 7249 : audit [DBG] from='client.164583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:54 smithi191 bash[24992]: cluster 2024-08-31T04:58:53.722988+0000 mgr.a (mgr.14388) 7250 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:54 smithi163 bash[24253]: audit 2024-08-31T04:58:53.507459+0000 mgr.a (mgr.14388) 7249 : audit [DBG] from='client.164583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:54 smithi163 bash[24253]: cluster 2024-08-31T04:58:53.722988+0000 mgr.a (mgr.14388) 7250 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:55.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:54 smithi027 bash[22610]: audit 2024-08-31T04:58:53.507459+0000 mgr.a (mgr.14388) 7249 : audit [DBG] from='client.164583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:58:55.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:54 smithi027 bash[22610]: cluster 2024-08-31T04:58:53.722988+0000 mgr.a (mgr.14388) 7250 : cluster [DBG] pgmap v5025: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:58:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:56 smithi191 bash[24992]: cluster 2024-08-31T04:58:55.723858+0000 mgr.a (mgr.14388) 7251 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:58:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:56 smithi163 bash[24253]: cluster 2024-08-31T04:58:55.723858+0000 mgr.a (mgr.14388) 7251 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:58:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:56 smithi027 bash[22610]: cluster 2024-08-31T04:58:55.723858+0000 mgr.a (mgr.14388) 7251 : cluster [DBG] pgmap v5026: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:58:58.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:58:58.956 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:58:58.956 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:58:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:58:58 smithi191 bash[24992]: cluster 2024-08-31T04:58:57.724597+0000 mgr.a (mgr.14388) 7252 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:58:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:58:58 smithi163 bash[24253]: cluster 2024-08-31T04:58:57.724597+0000 mgr.a (mgr.14388) 7252 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:58:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:58:58 smithi027 bash[22610]: cluster 2024-08-31T04:58:57.724597+0000 mgr.a (mgr.14388) 7252 : cluster [DBG] pgmap v5027: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:58:59.693 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:58:59.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:58:59.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:58:59.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:58:59.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:00 smithi163 bash[24253]: audit 2024-08-31T04:58:59.289838+0000 mgr.a (mgr.14388) 7253 : audit [DBG] from='client.164661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:00 smithi163 bash[24253]: cluster 2024-08-31T04:58:59.727161+0000 mgr.a (mgr.14388) 7254 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:00 smithi027 bash[22610]: audit 2024-08-31T04:58:59.289838+0000 mgr.a (mgr.14388) 7253 : audit [DBG] from='client.164661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:00 smithi027 bash[22610]: cluster 2024-08-31T04:58:59.727161+0000 mgr.a (mgr.14388) 7254 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:00 smithi191 bash[24992]: audit 2024-08-31T04:58:59.289838+0000 mgr.a (mgr.14388) 7253 : audit [DBG] from='client.164661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:00 smithi191 bash[24992]: cluster 2024-08-31T04:58:59.727161+0000 mgr.a (mgr.14388) 7254 : cluster [DBG] pgmap v5028: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:02 smithi163 bash[24253]: cluster 2024-08-31T04:59:01.727897+0000 mgr.a (mgr.14388) 7255 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:03.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:02 smithi027 bash[22610]: cluster 2024-08-31T04:59:01.727897+0000 mgr.a (mgr.14388) 7255 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:02 smithi191 bash[24992]: cluster 2024-08-31T04:59:01.727897+0000 mgr.a (mgr.14388) 7255 : cluster [DBG] pgmap v5029: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:03 smithi163 bash[24253]: audit 2024-08-31T04:59:03.197246+0000 mon.a (mon.0) 1667 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:59:04.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:03 smithi027 bash[22610]: audit 2024-08-31T04:59:03.197246+0000 mon.a (mon.0) 1667 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:59:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:03 smithi191 bash[24992]: audit 2024-08-31T04:59:03.197246+0000 mon.a (mon.0) 1667 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T04:59:04.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:59:04.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:59:04.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:59:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:04 smithi163 bash[24253]: cluster 2024-08-31T04:59:03.729862+0000 mgr.a (mgr.14388) 7256 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:04 smithi163 bash[24253]: audit 2024-08-31T04:59:04.020578+0000 mon.a (mon.0) 1668 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:59:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:04 smithi163 bash[24253]: audit 2024-08-31T04:59:04.022429+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:59:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:04 smithi163 bash[24253]: audit 2024-08-31T04:59:04.033182+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:59:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:04 smithi163 bash[24253]: audit 2024-08-31T04:59:04.037998+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:59:05.231 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:59:04 smithi027 bash[22863]: debug 2024-08-31T04:59:04.756+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:59:05.231 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 04:59:04 smithi027 bash[22863]: debug 2024-08-31T04:59:04.760+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:59:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:04 smithi027 bash[22610]: cluster 2024-08-31T04:59:03.729862+0000 mgr.a (mgr.14388) 7256 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:04 smithi027 bash[22610]: audit 2024-08-31T04:59:04.020578+0000 mon.a (mon.0) 1668 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:59:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:04 smithi027 bash[22610]: audit 2024-08-31T04:59:04.022429+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:59:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:04 smithi027 bash[22610]: audit 2024-08-31T04:59:04.033182+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:59:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:04 smithi027 bash[22610]: audit 2024-08-31T04:59:04.037998+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:59:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:04 smithi191 bash[24992]: cluster 2024-08-31T04:59:03.729862+0000 mgr.a (mgr.14388) 7256 : cluster [DBG] pgmap v5030: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:04 smithi191 bash[24992]: audit 2024-08-31T04:59:04.020578+0000 mon.a (mon.0) 1668 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T04:59:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:04 smithi191 bash[24992]: audit 2024-08-31T04:59:04.022429+0000 mon.a (mon.0) 1669 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T04:59:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:04 smithi191 bash[24992]: audit 2024-08-31T04:59:04.033182+0000 mon.a (mon.0) 1670 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T04:59:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:04 smithi191 bash[24992]: audit 2024-08-31T04:59:04.037998+0000 mon.a (mon.0) 1671 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:59:05.429 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:59:05.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:59:05.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:59:05.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:59:05.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:05 smithi163 bash[24253]: audit 2024-08-31T04:59:04.039735+0000 mgr.a (mgr.14388) 7257 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:59:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:05 smithi163 bash[24253]: audit 2024-08-31T04:59:04.761811+0000 mgr.a (mgr.14388) 7258 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:59:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:05 smithi163 bash[24253]: cephadm 2024-08-31T04:59:04.763036+0000 mgr.a (mgr.14388) 7259 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:59:06.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:05 smithi027 bash[22610]: audit 2024-08-31T04:59:04.039735+0000 mgr.a (mgr.14388) 7257 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:59:06.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:05 smithi027 bash[22610]: audit 2024-08-31T04:59:04.761811+0000 mgr.a (mgr.14388) 7258 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:59:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:05 smithi027 bash[22610]: cephadm 2024-08-31T04:59:04.763036+0000 mgr.a (mgr.14388) 7259 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:59:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:05 smithi191 bash[24992]: audit 2024-08-31T04:59:04.039735+0000 mgr.a (mgr.14388) 7257 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T04:59:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:05 smithi191 bash[24992]: audit 2024-08-31T04:59:04.761811+0000 mgr.a (mgr.14388) 7258 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T04:59:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:05 smithi191 bash[24992]: cephadm 2024-08-31T04:59:04.763036+0000 mgr.a (mgr.14388) 7259 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T04:59:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:06 smithi163 bash[24253]: audit 2024-08-31T04:59:05.019548+0000 mgr.a (mgr.14388) 7260 : audit [DBG] from='client.164847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:06 smithi163 bash[24253]: cluster 2024-08-31T04:59:05.730851+0000 mgr.a (mgr.14388) 7261 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:07.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:06 smithi027 bash[22610]: audit 2024-08-31T04:59:05.019548+0000 mgr.a (mgr.14388) 7260 : audit [DBG] from='client.164847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:07.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:06 smithi027 bash[22610]: cluster 2024-08-31T04:59:05.730851+0000 mgr.a (mgr.14388) 7261 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:06 smithi191 bash[24992]: audit 2024-08-31T04:59:05.019548+0000 mgr.a (mgr.14388) 7260 : audit [DBG] from='client.164847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:06 smithi191 bash[24992]: cluster 2024-08-31T04:59:05.730851+0000 mgr.a (mgr.14388) 7261 : cluster [DBG] pgmap v5031: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:08 smithi163 bash[24253]: cluster 2024-08-31T04:59:07.731661+0000 mgr.a (mgr.14388) 7262 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:09.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:08 smithi027 bash[22610]: cluster 2024-08-31T04:59:07.731661+0000 mgr.a (mgr.14388) 7262 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:08 smithi191 bash[24992]: cluster 2024-08-31T04:59:07.731661+0000 mgr.a (mgr.14388) 7262 : cluster [DBG] pgmap v5032: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:10.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:59:10.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:59:10.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:59:11.196 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:59:11.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:59:11.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:59:11.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:59:11.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:10 smithi163 bash[24253]: cluster 2024-08-31T04:59:09.733913+0000 mgr.a (mgr.14388) 7263 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:11.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:10 smithi027 bash[22610]: cluster 2024-08-31T04:59:09.733913+0000 mgr.a (mgr.14388) 7263 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:10 smithi191 bash[24992]: cluster 2024-08-31T04:59:09.733913+0000 mgr.a (mgr.14388) 7263 : cluster [DBG] pgmap v5033: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:11 smithi163 bash[24253]: audit 2024-08-31T04:59:10.768884+0000 mgr.a (mgr.14388) 7264 : audit [DBG] from='client.164925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:12.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:11 smithi027 bash[22610]: audit 2024-08-31T04:59:10.768884+0000 mgr.a (mgr.14388) 7264 : audit [DBG] from='client.164925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:11 smithi191 bash[24992]: audit 2024-08-31T04:59:10.768884+0000 mgr.a (mgr.14388) 7264 : audit [DBG] from='client.164925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:13.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:12 smithi163 bash[24253]: cluster 2024-08-31T04:59:11.735010+0000 mgr.a (mgr.14388) 7265 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:13.240 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:12 smithi027 bash[22610]: cluster 2024-08-31T04:59:11.735010+0000 mgr.a (mgr.14388) 7265 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:13.293 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:12 smithi191 bash[24992]: cluster 2024-08-31T04:59:11.735010+0000 mgr.a (mgr.14388) 7265 : cluster [DBG] pgmap v5034: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:14 smithi163 bash[24253]: cluster 2024-08-31T04:59:13.737290+0000 mgr.a (mgr.14388) 7266 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:15.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:14 smithi027 bash[22610]: cluster 2024-08-31T04:59:13.737290+0000 mgr.a (mgr.14388) 7266 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:14 smithi191 bash[24992]: cluster 2024-08-31T04:59:13.737290+0000 mgr.a (mgr.14388) 7266 : cluster [DBG] pgmap v5035: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:16.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:59:16.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:59:16.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:59:16.958 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:59:16.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:59:16.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:59:16.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:59:16.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:16 smithi163 bash[24253]: cluster 2024-08-31T04:59:15.738232+0000 mgr.a (mgr.14388) 7267 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:17.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:16 smithi027 bash[22610]: cluster 2024-08-31T04:59:15.738232+0000 mgr.a (mgr.14388) 7267 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:16 smithi191 bash[24992]: cluster 2024-08-31T04:59:15.738232+0000 mgr.a (mgr.14388) 7267 : cluster [DBG] pgmap v5036: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:17 smithi163 bash[24253]: audit 2024-08-31T04:59:16.531967+0000 mgr.a (mgr.14388) 7268 : audit [DBG] from='client.165000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:18.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:17 smithi027 bash[22610]: audit 2024-08-31T04:59:16.531967+0000 mgr.a (mgr.14388) 7268 : audit [DBG] from='client.165000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:17 smithi191 bash[24992]: audit 2024-08-31T04:59:16.531967+0000 mgr.a (mgr.14388) 7268 : audit [DBG] from='client.165000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:18 smithi163 bash[24253]: cluster 2024-08-31T04:59:17.739206+0000 mgr.a (mgr.14388) 7269 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:19.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:18 smithi027 bash[22610]: cluster 2024-08-31T04:59:17.739206+0000 mgr.a (mgr.14388) 7269 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:18 smithi191 bash[24992]: cluster 2024-08-31T04:59:17.739206+0000 mgr.a (mgr.14388) 7269 : cluster [DBG] pgmap v5037: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:20 smithi163 bash[24253]: cluster 2024-08-31T04:59:19.741602+0000 mgr.a (mgr.14388) 7270 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:21.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:20 smithi027 bash[22610]: cluster 2024-08-31T04:59:19.741602+0000 mgr.a (mgr.14388) 7270 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:20 smithi191 bash[24992]: cluster 2024-08-31T04:59:19.741602+0000 mgr.a (mgr.14388) 7270 : cluster [DBG] pgmap v5038: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T04:59:21.959 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:59:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:59:21.960 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:59:22.727 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:59:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:59:22.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:59:22.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:59:22.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:22 smithi163 bash[24253]: cluster 2024-08-31T04:59:21.742398+0000 mgr.a (mgr.14388) 7271 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:23.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:22 smithi027 bash[22610]: cluster 2024-08-31T04:59:21.742398+0000 mgr.a (mgr.14388) 7271 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:22 smithi191 bash[24992]: cluster 2024-08-31T04:59:21.742398+0000 mgr.a (mgr.14388) 7271 : cluster [DBG] pgmap v5039: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:23 smithi163 bash[24253]: audit 2024-08-31T04:59:22.294866+0000 mgr.a (mgr.14388) 7272 : audit [DBG] from='client.165075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:24.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:23 smithi027 bash[22610]: audit 2024-08-31T04:59:22.294866+0000 mgr.a (mgr.14388) 7272 : audit [DBG] from='client.165075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:23 smithi191 bash[24992]: audit 2024-08-31T04:59:22.294866+0000 mgr.a (mgr.14388) 7272 : audit [DBG] from='client.165075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:24 smithi163 bash[24253]: cluster 2024-08-31T04:59:23.744744+0000 mgr.a (mgr.14388) 7273 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:24 smithi027 bash[22610]: cluster 2024-08-31T04:59:23.744744+0000 mgr.a (mgr.14388) 7273 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:24 smithi191 bash[24992]: cluster 2024-08-31T04:59:23.744744+0000 mgr.a (mgr.14388) 7273 : cluster [DBG] pgmap v5040: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:26 smithi163 bash[24253]: cluster 2024-08-31T04:59:25.745700+0000 mgr.a (mgr.14388) 7274 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:27.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:26 smithi027 bash[22610]: cluster 2024-08-31T04:59:25.745700+0000 mgr.a (mgr.14388) 7274 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:26 smithi191 bash[24992]: cluster 2024-08-31T04:59:25.745700+0000 mgr.a (mgr.14388) 7274 : cluster [DBG] pgmap v5041: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:27.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:59:27.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:59:27.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:59:28.478 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:59:28.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:59:28.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:59:28.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:59:28.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:28 smithi163 bash[24253]: cluster 2024-08-31T04:59:27.746296+0000 mgr.a (mgr.14388) 7275 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:29.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:28 smithi027 bash[22610]: cluster 2024-08-31T04:59:27.746296+0000 mgr.a (mgr.14388) 7275 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:28 smithi191 bash[24992]: cluster 2024-08-31T04:59:27.746296+0000 mgr.a (mgr.14388) 7275 : cluster [DBG] pgmap v5042: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:29 smithi163 bash[24253]: audit 2024-08-31T04:59:28.064692+0000 mgr.a (mgr.14388) 7276 : audit [DBG] from='client.165153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:30.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:29 smithi027 bash[22610]: audit 2024-08-31T04:59:28.064692+0000 mgr.a (mgr.14388) 7276 : audit [DBG] from='client.165153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:29 smithi191 bash[24992]: audit 2024-08-31T04:59:28.064692+0000 mgr.a (mgr.14388) 7276 : audit [DBG] from='client.165153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:30 smithi163 bash[24253]: cluster 2024-08-31T04:59:29.748985+0000 mgr.a (mgr.14388) 7277 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:30 smithi027 bash[22610]: cluster 2024-08-31T04:59:29.748985+0000 mgr.a (mgr.14388) 7277 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:30 smithi191 bash[24992]: cluster 2024-08-31T04:59:29.748985+0000 mgr.a (mgr.14388) 7277 : cluster [DBG] pgmap v5043: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:32 smithi163 bash[24253]: cluster 2024-08-31T04:59:31.749802+0000 mgr.a (mgr.14388) 7278 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:59:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:32 smithi027 bash[22610]: cluster 2024-08-31T04:59:31.749802+0000 mgr.a (mgr.14388) 7278 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:59:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:32 smithi191 bash[24992]: cluster 2024-08-31T04:59:31.749802+0000 mgr.a (mgr.14388) 7278 : cluster [DBG] pgmap v5044: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:59:33.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:59:33.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:59:33.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:59:34.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:59:34.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:59:34.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:59:34.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:34.257 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:59:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:34 smithi163 bash[24253]: cluster 2024-08-31T04:59:33.751866+0000 mgr.a (mgr.14388) 7279 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:34 smithi163 bash[24253]: audit 2024-08-31T04:59:33.813859+0000 mgr.a (mgr.14388) 7280 : audit [DBG] from='client.165231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:34 smithi027 bash[22610]: cluster 2024-08-31T04:59:33.751866+0000 mgr.a (mgr.14388) 7279 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:34 smithi027 bash[22610]: audit 2024-08-31T04:59:33.813859+0000 mgr.a (mgr.14388) 7280 : audit [DBG] from='client.165231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:34 smithi191 bash[24992]: cluster 2024-08-31T04:59:33.751866+0000 mgr.a (mgr.14388) 7279 : cluster [DBG] pgmap v5045: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:34 smithi191 bash[24992]: audit 2024-08-31T04:59:33.813859+0000 mgr.a (mgr.14388) 7280 : audit [DBG] from='client.165231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:36 smithi163 bash[24253]: cluster 2024-08-31T04:59:35.752789+0000 mgr.a (mgr.14388) 7281 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:59:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:36 smithi027 bash[22610]: cluster 2024-08-31T04:59:35.752789+0000 mgr.a (mgr.14388) 7281 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:59:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:36 smithi191 bash[24992]: cluster 2024-08-31T04:59:35.752789+0000 mgr.a (mgr.14388) 7281 : cluster [DBG] pgmap v5046: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T04:59:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:38 smithi163 bash[24253]: cluster 2024-08-31T04:59:37.753550+0000 mgr.a (mgr.14388) 7282 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:59:39.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:38 smithi027 bash[22610]: cluster 2024-08-31T04:59:37.753550+0000 mgr.a (mgr.14388) 7282 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:59:39.258 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:59:39.259 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:59:39.259 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:59:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:38 smithi191 bash[24992]: cluster 2024-08-31T04:59:37.753550+0000 mgr.a (mgr.14388) 7282 : cluster [DBG] pgmap v5047: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T04:59:40.039 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:59:40.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:59:40.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:59:40.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:59:40.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:40 smithi163 bash[24253]: audit 2024-08-31T04:59:39.595922+0000 mgr.a (mgr.14388) 7283 : audit [DBG] from='client.165306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:40 smithi163 bash[24253]: cluster 2024-08-31T04:59:39.755064+0000 mgr.a (mgr.14388) 7284 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:40 smithi027 bash[22610]: audit 2024-08-31T04:59:39.595922+0000 mgr.a (mgr.14388) 7283 : audit [DBG] from='client.165306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:40 smithi027 bash[22610]: cluster 2024-08-31T04:59:39.755064+0000 mgr.a (mgr.14388) 7284 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:40 smithi191 bash[24992]: audit 2024-08-31T04:59:39.595922+0000 mgr.a (mgr.14388) 7283 : audit [DBG] from='client.165306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:40 smithi191 bash[24992]: cluster 2024-08-31T04:59:39.755064+0000 mgr.a (mgr.14388) 7284 : cluster [DBG] pgmap v5048: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:42 smithi163 bash[24253]: cluster 2024-08-31T04:59:41.755928+0000 mgr.a (mgr.14388) 7285 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:42 smithi027 bash[22610]: cluster 2024-08-31T04:59:41.755928+0000 mgr.a (mgr.14388) 7285 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:42 smithi191 bash[24992]: cluster 2024-08-31T04:59:41.755928+0000 mgr.a (mgr.14388) 7285 : cluster [DBG] pgmap v5049: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:45.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:59:45.041 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:59:45.041 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:59:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:44 smithi163 bash[24253]: cluster 2024-08-31T04:59:43.758290+0000 mgr.a (mgr.14388) 7286 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:44 smithi027 bash[22610]: cluster 2024-08-31T04:59:43.758290+0000 mgr.a (mgr.14388) 7286 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:44 smithi191 bash[24992]: cluster 2024-08-31T04:59:43.758290+0000 mgr.a (mgr.14388) 7286 : cluster [DBG] pgmap v5050: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:45.812 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:59:45.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:59:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:59:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:59:45.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:46 smithi163 bash[24253]: audit 2024-08-31T04:59:45.381108+0000 mgr.a (mgr.14388) 7287 : audit [DBG] from='client.165384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:46 smithi163 bash[24253]: cluster 2024-08-31T04:59:45.758846+0000 mgr.a (mgr.14388) 7288 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:46 smithi027 bash[22610]: audit 2024-08-31T04:59:45.381108+0000 mgr.a (mgr.14388) 7287 : audit [DBG] from='client.165384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:46 smithi027 bash[22610]: cluster 2024-08-31T04:59:45.758846+0000 mgr.a (mgr.14388) 7288 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:46 smithi191 bash[24992]: audit 2024-08-31T04:59:45.381108+0000 mgr.a (mgr.14388) 7287 : audit [DBG] from='client.165384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:46 smithi191 bash[24992]: cluster 2024-08-31T04:59:45.758846+0000 mgr.a (mgr.14388) 7288 : cluster [DBG] pgmap v5051: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:48 smithi163 bash[24253]: cluster 2024-08-31T04:59:47.759512+0000 mgr.a (mgr.14388) 7289 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:49.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:48 smithi027 bash[22610]: cluster 2024-08-31T04:59:47.759512+0000 mgr.a (mgr.14388) 7289 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:48 smithi191 bash[24992]: cluster 2024-08-31T04:59:47.759512+0000 mgr.a (mgr.14388) 7289 : cluster [DBG] pgmap v5052: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:50.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:59:50.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:59:50.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:59:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:50 smithi163 bash[24253]: cluster 2024-08-31T04:59:49.761742+0000 mgr.a (mgr.14388) 7290 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:51.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:50 smithi027 bash[22610]: cluster 2024-08-31T04:59:49.761742+0000 mgr.a (mgr.14388) 7290 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:50 smithi191 bash[24992]: cluster 2024-08-31T04:59:49.761742+0000 mgr.a (mgr.14388) 7290 : cluster [DBG] pgmap v5053: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:51.582 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:59:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:59:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:59:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:59:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:52 smithi163 bash[24253]: audit 2024-08-31T04:59:51.149507+0000 mgr.a (mgr.14388) 7291 : audit [DBG] from='client.165462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:52 smithi163 bash[24253]: cluster 2024-08-31T04:59:51.762647+0000 mgr.a (mgr.14388) 7292 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:53.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:52 smithi027 bash[22610]: audit 2024-08-31T04:59:51.149507+0000 mgr.a (mgr.14388) 7291 : audit [DBG] from='client.165462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:53.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:52 smithi027 bash[22610]: cluster 2024-08-31T04:59:51.762647+0000 mgr.a (mgr.14388) 7292 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:52 smithi191 bash[24992]: audit 2024-08-31T04:59:51.149507+0000 mgr.a (mgr.14388) 7291 : audit [DBG] from='client.165462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:52 smithi191 bash[24992]: cluster 2024-08-31T04:59:51.762647+0000 mgr.a (mgr.14388) 7292 : cluster [DBG] pgmap v5054: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:54 smithi163 bash[24253]: cluster 2024-08-31T04:59:53.764864+0000 mgr.a (mgr.14388) 7293 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:55.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:54 smithi027 bash[22610]: cluster 2024-08-31T04:59:53.764864+0000 mgr.a (mgr.14388) 7293 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:54 smithi191 bash[24992]: cluster 2024-08-31T04:59:53.764864+0000 mgr.a (mgr.14388) 7293 : cluster [DBG] pgmap v5055: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T04:59:56.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T04:59:56.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T04:59:56.585 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T04:59:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:56 smithi163 bash[24253]: cluster 2024-08-31T04:59:55.765603+0000 mgr.a (mgr.14388) 7294 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:56 smithi027 bash[22610]: cluster 2024-08-31T04:59:55.765603+0000 mgr.a (mgr.14388) 7294 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:56 smithi191 bash[24992]: cluster 2024-08-31T04:59:55.765603+0000 mgr.a (mgr.14388) 7294 : cluster [DBG] pgmap v5056: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:57.358 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T04:59:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T04:59:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T04:59:57.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T04:59:57.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T04:59:58.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:57 smithi027 bash[22610]: audit 2024-08-31T04:59:56.919535+0000 mgr.a (mgr.14388) 7295 : audit [DBG] from='client.165537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:57 smithi191 bash[24992]: audit 2024-08-31T04:59:56.919535+0000 mgr.a (mgr.14388) 7295 : audit [DBG] from='client.165537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:57 smithi163 bash[24253]: audit 2024-08-31T04:59:56.919535+0000 mgr.a (mgr.14388) 7295 : audit [DBG] from='client.165537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T04:59:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 04:59:58 smithi027 bash[22610]: cluster 2024-08-31T04:59:57.766428+0000 mgr.a (mgr.14388) 7296 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 04:59:58 smithi191 bash[24992]: cluster 2024-08-31T04:59:57.766428+0000 mgr.a (mgr.14388) 7296 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T04:59:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 04:59:58 smithi163 bash[24253]: cluster 2024-08-31T04:59:57.766428+0000 mgr.a (mgr.14388) 7296 : cluster [DBG] pgmap v5057: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:00 smithi027 bash[22610]: cluster 2024-08-31T04:59:59.768740+0000 mgr.a (mgr.14388) 7297 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:00 smithi027 bash[22610]: cluster 2024-08-31T05:00:00.000145+0000 mon.a (mon.0) 1672 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:00:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:00 smithi191 bash[24992]: cluster 2024-08-31T04:59:59.768740+0000 mgr.a (mgr.14388) 7297 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:00 smithi191 bash[24992]: cluster 2024-08-31T05:00:00.000145+0000 mon.a (mon.0) 1672 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:00:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:00 smithi163 bash[24253]: cluster 2024-08-31T04:59:59.768740+0000 mgr.a (mgr.14388) 7297 : cluster [DBG] pgmap v5058: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:00 smithi163 bash[24253]: cluster 2024-08-31T05:00:00.000145+0000 mon.a (mon.0) 1672 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:00:02.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:00:02.360 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:00:02.360 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:00:03.137 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:00:03.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:00:03.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:00:03.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:00:03.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:00:03.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:02 smithi027 bash[22610]: cluster 2024-08-31T05:00:01.769485+0000 mgr.a (mgr.14388) 7298 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:02 smithi191 bash[24992]: cluster 2024-08-31T05:00:01.769485+0000 mgr.a (mgr.14388) 7298 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:02 smithi163 bash[24253]: cluster 2024-08-31T05:00:01.769485+0000 mgr.a (mgr.14388) 7298 : cluster [DBG] pgmap v5059: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:03 smithi027 bash[22610]: audit 2024-08-31T05:00:02.695014+0000 mgr.a (mgr.14388) 7299 : audit [DBG] from='client.165615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:03 smithi191 bash[24992]: audit 2024-08-31T05:00:02.695014+0000 mgr.a (mgr.14388) 7299 : audit [DBG] from='client.165615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:03 smithi163 bash[24253]: audit 2024-08-31T05:00:02.695014+0000 mgr.a (mgr.14388) 7299 : audit [DBG] from='client.165615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:04 smithi027 bash[22610]: cluster 2024-08-31T05:00:03.772220+0000 mgr.a (mgr.14388) 7300 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:05.516 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:04 smithi027 bash[22610]: audit 2024-08-31T05:00:04.816860+0000 mon.a (mon.0) 1673 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:00:05.517 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:04 smithi163 bash[24253]: cluster 2024-08-31T05:00:03.772220+0000 mgr.a (mgr.14388) 7300 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:05.517 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:04 smithi163 bash[24253]: audit 2024-08-31T05:00:04.816860+0000 mon.a (mon.0) 1673 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:00:05.517 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:04 smithi191 bash[24992]: cluster 2024-08-31T05:00:03.772220+0000 mgr.a (mgr.14388) 7300 : cluster [DBG] pgmap v5060: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:05.517 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:04 smithi191 bash[24992]: audit 2024-08-31T05:00:04.816860+0000 mon.a (mon.0) 1673 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:00:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:06 smithi191 bash[24992]: cluster 2024-08-31T05:00:05.773002+0000 mgr.a (mgr.14388) 7301 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:06 smithi163 bash[24253]: cluster 2024-08-31T05:00:05.773002+0000 mgr.a (mgr.14388) 7301 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:07.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:06 smithi027 bash[22610]: cluster 2024-08-31T05:00:05.773002+0000 mgr.a (mgr.14388) 7301 : cluster [DBG] pgmap v5061: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:08.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:00:08.140 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:00:08.140 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:00:08.889 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:00:08.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:00:08.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:00:08.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:00:08.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:00:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:08 smithi191 bash[24992]: cluster 2024-08-31T05:00:07.773774+0000 mgr.a (mgr.14388) 7302 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:00:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:08 smithi163 bash[24253]: cluster 2024-08-31T05:00:07.773774+0000 mgr.a (mgr.14388) 7302 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:00:09.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:08 smithi027 bash[22610]: cluster 2024-08-31T05:00:07.773774+0000 mgr.a (mgr.14388) 7302 : cluster [DBG] pgmap v5062: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:00:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:09 smithi191 bash[24992]: audit 2024-08-31T05:00:08.479317+0000 mgr.a (mgr.14388) 7303 : audit [DBG] from='client.165693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:09 smithi163 bash[24253]: audit 2024-08-31T05:00:08.479317+0000 mgr.a (mgr.14388) 7303 : audit [DBG] from='client.165693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:10.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:09 smithi027 bash[22610]: audit 2024-08-31T05:00:08.479317+0000 mgr.a (mgr.14388) 7303 : audit [DBG] from='client.165693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:10 smithi191 bash[24992]: cluster 2024-08-31T05:00:09.776519+0000 mgr.a (mgr.14388) 7304 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:10 smithi191 bash[24992]: audit 2024-08-31T05:00:10.161924+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:10 smithi191 bash[24992]: audit 2024-08-31T05:00:10.168292+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:10 smithi191 bash[24992]: audit 2024-08-31T05:00:10.187119+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:10 smithi191 bash[24992]: audit 2024-08-31T05:00:10.193045+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:10 smithi191 bash[24992]: audit 2024-08-31T05:00:10.198460+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:10 smithi191 bash[24992]: audit 2024-08-31T05:00:10.204519+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:10 smithi191 bash[24992]: audit 2024-08-31T05:00:10.881398+0000 mon.a (mon.0) 1680 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:00:11.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:10 smithi191 bash[24992]: audit 2024-08-31T05:00:10.882983+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:00:11.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:11 smithi191 bash[24992]: audit 2024-08-31T05:00:10.891653+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:11 smithi191 bash[24992]: audit 2024-08-31T05:00:10.894086+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:00:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: cluster 2024-08-31T05:00:09.776519+0000 mgr.a (mgr.14388) 7304 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: audit 2024-08-31T05:00:10.161924+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: audit 2024-08-31T05:00:10.168292+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: audit 2024-08-31T05:00:10.187119+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: audit 2024-08-31T05:00:10.193045+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: audit 2024-08-31T05:00:10.198460+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: audit 2024-08-31T05:00:10.204519+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: audit 2024-08-31T05:00:10.881398+0000 mon.a (mon.0) 1680 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:00:11.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: audit 2024-08-31T05:00:10.882983+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:00:11.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: audit 2024-08-31T05:00:10.891653+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:10 smithi163 bash[24253]: audit 2024-08-31T05:00:10.894086+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:00:11.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:10 smithi027 bash[22610]: cluster 2024-08-31T05:00:09.776519+0000 mgr.a (mgr.14388) 7304 : cluster [DBG] pgmap v5063: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:11.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:10 smithi027 bash[22610]: audit 2024-08-31T05:00:10.161924+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:10 smithi027 bash[22610]: audit 2024-08-31T05:00:10.168292+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:10 smithi027 bash[22610]: audit 2024-08-31T05:00:10.187119+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:10 smithi027 bash[22610]: audit 2024-08-31T05:00:10.193045+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:10 smithi027 bash[22610]: audit 2024-08-31T05:00:10.198460+0000 mon.a (mon.0) 1678 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:10 smithi027 bash[22610]: audit 2024-08-31T05:00:10.204519+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:10 smithi027 bash[22610]: audit 2024-08-31T05:00:10.881398+0000 mon.a (mon.0) 1680 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:00:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:11 smithi027 bash[22610]: audit 2024-08-31T05:00:10.882983+0000 mon.a (mon.0) 1681 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:00:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:11 smithi027 bash[22610]: audit 2024-08-31T05:00:10.891653+0000 mon.a (mon.0) 1682 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:00:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:11 smithi027 bash[22610]: audit 2024-08-31T05:00:10.894086+0000 mon.a (mon.0) 1683 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:00:11.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:00:11 smithi027 bash[22863]: debug 2024-08-31T05:00:11.618+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:00:11.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:00:11 smithi027 bash[22863]: debug 2024-08-31T05:00:11.618+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:00:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:12 smithi191 bash[24992]: audit 2024-08-31T05:00:10.896435+0000 mgr.a (mgr.14388) 7305 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:00:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:12 smithi163 bash[24253]: audit 2024-08-31T05:00:10.896435+0000 mgr.a (mgr.14388) 7305 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:00:12.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:12 smithi027 bash[22610]: audit 2024-08-31T05:00:10.896435+0000 mgr.a (mgr.14388) 7305 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:00:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:13 smithi191 bash[24992]: audit 2024-08-31T05:00:11.622787+0000 mgr.a (mgr.14388) 7306 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:00:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:13 smithi191 bash[24992]: cephadm 2024-08-31T05:00:11.624081+0000 mgr.a (mgr.14388) 7307 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:00:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:13 smithi191 bash[24992]: cluster 2024-08-31T05:00:11.777491+0000 mgr.a (mgr.14388) 7308 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:13 smithi163 bash[24253]: audit 2024-08-31T05:00:11.622787+0000 mgr.a (mgr.14388) 7306 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:00:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:13 smithi163 bash[24253]: cephadm 2024-08-31T05:00:11.624081+0000 mgr.a (mgr.14388) 7307 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:00:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:13 smithi163 bash[24253]: cluster 2024-08-31T05:00:11.777491+0000 mgr.a (mgr.14388) 7308 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:13.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:13 smithi027 bash[22610]: audit 2024-08-31T05:00:11.622787+0000 mgr.a (mgr.14388) 7306 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:00:13.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:13 smithi027 bash[22610]: cephadm 2024-08-31T05:00:11.624081+0000 mgr.a (mgr.14388) 7307 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:00:13.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:13 smithi027 bash[22610]: cluster 2024-08-31T05:00:11.777491+0000 mgr.a (mgr.14388) 7308 : cluster [DBG] pgmap v5064: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:13.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:00:13.891 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:00:13.891 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:00:14.665 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:00:14.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:00:14.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:00:14.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:00:14.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:00:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:15 smithi191 bash[24992]: cluster 2024-08-31T05:00:13.779822+0000 mgr.a (mgr.14388) 7309 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:15 smithi163 bash[24253]: cluster 2024-08-31T05:00:13.779822+0000 mgr.a (mgr.14388) 7309 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:15 smithi027 bash[22610]: cluster 2024-08-31T05:00:13.779822+0000 mgr.a (mgr.14388) 7309 : cluster [DBG] pgmap v5065: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:16 smithi191 bash[24992]: audit 2024-08-31T05:00:14.230487+0000 mgr.a (mgr.14388) 7310 : audit [DBG] from='client.165876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:16 smithi163 bash[24253]: audit 2024-08-31T05:00:14.230487+0000 mgr.a (mgr.14388) 7310 : audit [DBG] from='client.165876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:16 smithi027 bash[22610]: audit 2024-08-31T05:00:14.230487+0000 mgr.a (mgr.14388) 7310 : audit [DBG] from='client.165876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:17 smithi191 bash[24992]: cluster 2024-08-31T05:00:15.780843+0000 mgr.a (mgr.14388) 7311 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:17 smithi163 bash[24253]: cluster 2024-08-31T05:00:15.780843+0000 mgr.a (mgr.14388) 7311 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:17.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:17 smithi027 bash[22610]: cluster 2024-08-31T05:00:15.780843+0000 mgr.a (mgr.14388) 7311 : cluster [DBG] pgmap v5066: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:18 smithi191 bash[24992]: cluster 2024-08-31T05:00:17.781645+0000 mgr.a (mgr.14388) 7312 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:18 smithi163 bash[24253]: cluster 2024-08-31T05:00:17.781645+0000 mgr.a (mgr.14388) 7312 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:18 smithi027 bash[22610]: cluster 2024-08-31T05:00:17.781645+0000 mgr.a (mgr.14388) 7312 : cluster [DBG] pgmap v5067: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:00:19.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:00:19.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:00:20.418 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:00:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:00:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:00:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:00:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:00:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:20 smithi163 bash[24253]: cluster 2024-08-31T05:00:19.783071+0000 mgr.a (mgr.14388) 7313 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:20 smithi163 bash[24253]: audit 2024-08-31T05:00:19.999820+0000 mgr.a (mgr.14388) 7314 : audit [DBG] from='client.165954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:21.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:20 smithi027 bash[22610]: cluster 2024-08-31T05:00:19.783071+0000 mgr.a (mgr.14388) 7313 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:21.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:20 smithi027 bash[22610]: audit 2024-08-31T05:00:19.999820+0000 mgr.a (mgr.14388) 7314 : audit [DBG] from='client.165954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:20 smithi191 bash[24992]: cluster 2024-08-31T05:00:19.783071+0000 mgr.a (mgr.14388) 7313 : cluster [DBG] pgmap v5068: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:20 smithi191 bash[24992]: audit 2024-08-31T05:00:19.999820+0000 mgr.a (mgr.14388) 7314 : audit [DBG] from='client.165954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:22 smithi163 bash[24253]: cluster 2024-08-31T05:00:21.783867+0000 mgr.a (mgr.14388) 7315 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:23.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:22 smithi027 bash[22610]: cluster 2024-08-31T05:00:21.783867+0000 mgr.a (mgr.14388) 7315 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:22 smithi191 bash[24992]: cluster 2024-08-31T05:00:21.783867+0000 mgr.a (mgr.14388) 7315 : cluster [DBG] pgmap v5069: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:24 smithi163 bash[24253]: cluster 2024-08-31T05:00:23.786090+0000 mgr.a (mgr.14388) 7316 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:24 smithi027 bash[22610]: cluster 2024-08-31T05:00:23.786090+0000 mgr.a (mgr.14388) 7316 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:24 smithi191 bash[24992]: cluster 2024-08-31T05:00:23.786090+0000 mgr.a (mgr.14388) 7316 : cluster [DBG] pgmap v5070: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:00:25.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:00:25.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:00:25.421 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:00:26.179 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:00:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:00:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:00:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:00:26.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:00:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:26 smithi163 bash[24253]: audit 2024-08-31T05:00:25.757506+0000 mgr.a (mgr.14388) 7317 : audit [DBG] from='client.166032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:26 smithi163 bash[24253]: cluster 2024-08-31T05:00:25.787122+0000 mgr.a (mgr.14388) 7318 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:27.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:26 smithi027 bash[22610]: audit 2024-08-31T05:00:25.757506+0000 mgr.a (mgr.14388) 7317 : audit [DBG] from='client.166032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:27.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:26 smithi027 bash[22610]: cluster 2024-08-31T05:00:25.787122+0000 mgr.a (mgr.14388) 7318 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:26 smithi191 bash[24992]: audit 2024-08-31T05:00:25.757506+0000 mgr.a (mgr.14388) 7317 : audit [DBG] from='client.166032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:26 smithi191 bash[24992]: cluster 2024-08-31T05:00:25.787122+0000 mgr.a (mgr.14388) 7318 : cluster [DBG] pgmap v5071: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:28 smithi163 bash[24253]: cluster 2024-08-31T05:00:27.788000+0000 mgr.a (mgr.14388) 7319 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:29.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:28 smithi027 bash[22610]: cluster 2024-08-31T05:00:27.788000+0000 mgr.a (mgr.14388) 7319 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:28 smithi191 bash[24992]: cluster 2024-08-31T05:00:27.788000+0000 mgr.a (mgr.14388) 7319 : cluster [DBG] pgmap v5072: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:31.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:00:31.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:00:31.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:00:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:30 smithi163 bash[24253]: cluster 2024-08-31T05:00:29.790365+0000 mgr.a (mgr.14388) 7320 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:31.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:30 smithi027 bash[22610]: cluster 2024-08-31T05:00:29.790365+0000 mgr.a (mgr.14388) 7320 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:30 smithi191 bash[24992]: cluster 2024-08-31T05:00:29.790365+0000 mgr.a (mgr.14388) 7320 : cluster [DBG] pgmap v5073: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:31.951 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:00:31.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:00:31.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:00:31.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:00:31.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:00:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:32 smithi163 bash[24253]: audit 2024-08-31T05:00:31.522931+0000 mgr.a (mgr.14388) 7321 : audit [DBG] from='client.166110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:32 smithi163 bash[24253]: cluster 2024-08-31T05:00:31.791054+0000 mgr.a (mgr.14388) 7322 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:32 smithi027 bash[22610]: audit 2024-08-31T05:00:31.522931+0000 mgr.a (mgr.14388) 7321 : audit [DBG] from='client.166110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:32 smithi027 bash[22610]: cluster 2024-08-31T05:00:31.791054+0000 mgr.a (mgr.14388) 7322 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:32 smithi191 bash[24992]: audit 2024-08-31T05:00:31.522931+0000 mgr.a (mgr.14388) 7321 : audit [DBG] from='client.166110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:32 smithi191 bash[24992]: cluster 2024-08-31T05:00:31.791054+0000 mgr.a (mgr.14388) 7322 : cluster [DBG] pgmap v5074: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:34 smithi163 bash[24253]: cluster 2024-08-31T05:00:33.793456+0000 mgr.a (mgr.14388) 7323 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:34 smithi027 bash[22610]: cluster 2024-08-31T05:00:33.793456+0000 mgr.a (mgr.14388) 7323 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:34 smithi191 bash[24992]: cluster 2024-08-31T05:00:33.793456+0000 mgr.a (mgr.14388) 7323 : cluster [DBG] pgmap v5075: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:36.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:00:36.953 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:00:36.954 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:00:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:36 smithi163 bash[24253]: cluster 2024-08-31T05:00:35.794396+0000 mgr.a (mgr.14388) 7324 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:36 smithi027 bash[22610]: cluster 2024-08-31T05:00:35.794396+0000 mgr.a (mgr.14388) 7324 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:36 smithi191 bash[24992]: cluster 2024-08-31T05:00:35.794396+0000 mgr.a (mgr.14388) 7324 : cluster [DBG] pgmap v5076: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:37.740 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:00:37.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:00:37.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:00:37.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:00:37.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:00:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:38 smithi163 bash[24253]: audit 2024-08-31T05:00:37.297961+0000 mgr.a (mgr.14388) 7325 : audit [DBG] from='client.166188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:38 smithi163 bash[24253]: cluster 2024-08-31T05:00:37.795027+0000 mgr.a (mgr.14388) 7326 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:38 smithi027 bash[22610]: audit 2024-08-31T05:00:37.297961+0000 mgr.a (mgr.14388) 7325 : audit [DBG] from='client.166188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:38 smithi027 bash[22610]: cluster 2024-08-31T05:00:37.795027+0000 mgr.a (mgr.14388) 7326 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:38 smithi191 bash[24992]: audit 2024-08-31T05:00:37.297961+0000 mgr.a (mgr.14388) 7325 : audit [DBG] from='client.166188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:38 smithi191 bash[24992]: cluster 2024-08-31T05:00:37.795027+0000 mgr.a (mgr.14388) 7326 : cluster [DBG] pgmap v5077: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:40 smithi163 bash[24253]: cluster 2024-08-31T05:00:39.797352+0000 mgr.a (mgr.14388) 7327 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:40 smithi027 bash[22610]: cluster 2024-08-31T05:00:39.797352+0000 mgr.a (mgr.14388) 7327 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:40 smithi191 bash[24992]: cluster 2024-08-31T05:00:39.797352+0000 mgr.a (mgr.14388) 7327 : cluster [DBG] pgmap v5078: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:00:42.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:00:42.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:00:42.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:00:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:42 smithi163 bash[24253]: cluster 2024-08-31T05:00:41.798264+0000 mgr.a (mgr.14388) 7328 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:42 smithi027 bash[22610]: cluster 2024-08-31T05:00:41.798264+0000 mgr.a (mgr.14388) 7328 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:42 smithi191 bash[24992]: cluster 2024-08-31T05:00:41.798264+0000 mgr.a (mgr.14388) 7328 : cluster [DBG] pgmap v5079: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:43.506 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:00:43.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:00:43.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:00:43.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:00:43.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:00:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:44 smithi163 bash[24253]: audit 2024-08-31T05:00:43.079196+0000 mgr.a (mgr.14388) 7329 : audit [DBG] from='client.166266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:44 smithi163 bash[24253]: cluster 2024-08-31T05:00:43.801281+0000 mgr.a (mgr.14388) 7330 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:44 smithi027 bash[22610]: audit 2024-08-31T05:00:43.079196+0000 mgr.a (mgr.14388) 7329 : audit [DBG] from='client.166266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:44 smithi027 bash[22610]: cluster 2024-08-31T05:00:43.801281+0000 mgr.a (mgr.14388) 7330 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:44 smithi191 bash[24992]: audit 2024-08-31T05:00:43.079196+0000 mgr.a (mgr.14388) 7329 : audit [DBG] from='client.166266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:44 smithi191 bash[24992]: cluster 2024-08-31T05:00:43.801281+0000 mgr.a (mgr.14388) 7330 : cluster [DBG] pgmap v5080: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:46 smithi163 bash[24253]: cluster 2024-08-31T05:00:45.802247+0000 mgr.a (mgr.14388) 7331 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:46 smithi027 bash[22610]: cluster 2024-08-31T05:00:45.802247+0000 mgr.a (mgr.14388) 7331 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:46 smithi191 bash[24992]: cluster 2024-08-31T05:00:45.802247+0000 mgr.a (mgr.14388) 7331 : cluster [DBG] pgmap v5081: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:48.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:00:48.508 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:00:48.508 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:00:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:48 smithi163 bash[24253]: cluster 2024-08-31T05:00:47.803047+0000 mgr.a (mgr.14388) 7332 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:49.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:48 smithi027 bash[22610]: cluster 2024-08-31T05:00:47.803047+0000 mgr.a (mgr.14388) 7332 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:49.289 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:00:49.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:00:49.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:00:49.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:00:49.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:00:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:48 smithi191 bash[24992]: cluster 2024-08-31T05:00:47.803047+0000 mgr.a (mgr.14388) 7332 : cluster [DBG] pgmap v5082: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:49 smithi163 bash[24253]: audit 2024-08-31T05:00:48.842267+0000 mgr.a (mgr.14388) 7333 : audit [DBG] from='client.166344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:50.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:49 smithi027 bash[22610]: audit 2024-08-31T05:00:48.842267+0000 mgr.a (mgr.14388) 7333 : audit [DBG] from='client.166344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:49 smithi191 bash[24992]: audit 2024-08-31T05:00:48.842267+0000 mgr.a (mgr.14388) 7333 : audit [DBG] from='client.166344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:51.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:50 smithi163 bash[24253]: cluster 2024-08-31T05:00:49.805998+0000 mgr.a (mgr.14388) 7334 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:50 smithi027 bash[22610]: cluster 2024-08-31T05:00:49.805998+0000 mgr.a (mgr.14388) 7334 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:50 smithi191 bash[24992]: cluster 2024-08-31T05:00:49.805998+0000 mgr.a (mgr.14388) 7334 : cluster [DBG] pgmap v5083: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:52 smithi163 bash[24253]: cluster 2024-08-31T05:00:51.807040+0000 mgr.a (mgr.14388) 7335 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:53.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:52 smithi027 bash[22610]: cluster 2024-08-31T05:00:51.807040+0000 mgr.a (mgr.14388) 7335 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:52 smithi191 bash[24992]: cluster 2024-08-31T05:00:51.807040+0000 mgr.a (mgr.14388) 7335 : cluster [DBG] pgmap v5084: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:00:54.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:00:54.291 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:00:54.291 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:00:55.038 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:00:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:00:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:00:55.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:00:55.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:00:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:54 smithi163 bash[24253]: cluster 2024-08-31T05:00:53.809183+0000 mgr.a (mgr.14388) 7336 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:55.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:54 smithi027 bash[22610]: cluster 2024-08-31T05:00:53.809183+0000 mgr.a (mgr.14388) 7336 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:54 smithi191 bash[24992]: cluster 2024-08-31T05:00:53.809183+0000 mgr.a (mgr.14388) 7336 : cluster [DBG] pgmap v5085: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:55 smithi163 bash[24253]: audit 2024-08-31T05:00:54.625897+0000 mgr.a (mgr.14388) 7337 : audit [DBG] from='client.166422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:56.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:55 smithi027 bash[22610]: audit 2024-08-31T05:00:54.625897+0000 mgr.a (mgr.14388) 7337 : audit [DBG] from='client.166422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:55 smithi191 bash[24992]: audit 2024-08-31T05:00:54.625897+0000 mgr.a (mgr.14388) 7337 : audit [DBG] from='client.166422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:00:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:56 smithi163 bash[24253]: cluster 2024-08-31T05:00:55.810179+0000 mgr.a (mgr.14388) 7338 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:56 smithi027 bash[22610]: cluster 2024-08-31T05:00:55.810179+0000 mgr.a (mgr.14388) 7338 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:56 smithi191 bash[24992]: cluster 2024-08-31T05:00:55.810179+0000 mgr.a (mgr.14388) 7338 : cluster [DBG] pgmap v5086: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:00:58 smithi163 bash[24253]: cluster 2024-08-31T05:00:57.811005+0000 mgr.a (mgr.14388) 7339 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:00:58 smithi027 bash[22610]: cluster 2024-08-31T05:00:57.811005+0000 mgr.a (mgr.14388) 7339 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:00:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:00:58 smithi191 bash[24992]: cluster 2024-08-31T05:00:57.811005+0000 mgr.a (mgr.14388) 7339 : cluster [DBG] pgmap v5087: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:00.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:00.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:00.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:00.825 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:00.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:00.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:00.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:00.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:00 smithi163 bash[24253]: cluster 2024-08-31T05:00:59.813263+0000 mgr.a (mgr.14388) 7340 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:00 smithi027 bash[22610]: cluster 2024-08-31T05:00:59.813263+0000 mgr.a (mgr.14388) 7340 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:00 smithi191 bash[24992]: cluster 2024-08-31T05:00:59.813263+0000 mgr.a (mgr.14388) 7340 : cluster [DBG] pgmap v5088: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:01 smithi163 bash[24253]: audit 2024-08-31T05:01:00.376759+0000 mgr.a (mgr.14388) 7341 : audit [DBG] from='client.166500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:02.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:01 smithi027 bash[22610]: audit 2024-08-31T05:01:00.376759+0000 mgr.a (mgr.14388) 7341 : audit [DBG] from='client.166500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:01 smithi191 bash[24992]: audit 2024-08-31T05:01:00.376759+0000 mgr.a (mgr.14388) 7341 : audit [DBG] from='client.166500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:02 smithi163 bash[24253]: cluster 2024-08-31T05:01:01.814265+0000 mgr.a (mgr.14388) 7342 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:03.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:02 smithi027 bash[22610]: cluster 2024-08-31T05:01:01.814265+0000 mgr.a (mgr.14388) 7342 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:02 smithi191 bash[24992]: cluster 2024-08-31T05:01:01.814265+0000 mgr.a (mgr.14388) 7342 : cluster [DBG] pgmap v5089: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:04 smithi027 bash[22610]: cluster 2024-08-31T05:01:03.816543+0000 mgr.a (mgr.14388) 7343 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:04 smithi191 bash[24992]: cluster 2024-08-31T05:01:03.816543+0000 mgr.a (mgr.14388) 7343 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:04 smithi163 bash[24253]: cluster 2024-08-31T05:01:03.816543+0000 mgr.a (mgr.14388) 7343 : cluster [DBG] pgmap v5090: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:05.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:05.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:06.578 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:06.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:06.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:06.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:06.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:07.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:06 smithi027 bash[22610]: cluster 2024-08-31T05:01:05.817327+0000 mgr.a (mgr.14388) 7344 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:06 smithi191 bash[24992]: cluster 2024-08-31T05:01:05.817327+0000 mgr.a (mgr.14388) 7344 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:06 smithi163 bash[24253]: cluster 2024-08-31T05:01:05.817327+0000 mgr.a (mgr.14388) 7344 : cluster [DBG] pgmap v5091: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:08.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:07 smithi027 bash[22610]: audit 2024-08-31T05:01:06.158874+0000 mgr.a (mgr.14388) 7345 : audit [DBG] from='client.166578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:07 smithi191 bash[24992]: audit 2024-08-31T05:01:06.158874+0000 mgr.a (mgr.14388) 7345 : audit [DBG] from='client.166578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:07 smithi163 bash[24253]: audit 2024-08-31T05:01:06.158874+0000 mgr.a (mgr.14388) 7345 : audit [DBG] from='client.166578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:09.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:08 smithi027 bash[22610]: cluster 2024-08-31T05:01:07.818241+0000 mgr.a (mgr.14388) 7346 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:08 smithi191 bash[24992]: cluster 2024-08-31T05:01:07.818241+0000 mgr.a (mgr.14388) 7346 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:08 smithi163 bash[24253]: cluster 2024-08-31T05:01:07.818241+0000 mgr.a (mgr.14388) 7346 : cluster [DBG] pgmap v5092: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:11.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:10 smithi027 bash[22610]: cluster 2024-08-31T05:01:09.820562+0000 mgr.a (mgr.14388) 7347 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:10 smithi191 bash[24992]: cluster 2024-08-31T05:01:09.820562+0000 mgr.a (mgr.14388) 7347 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:10 smithi163 bash[24253]: cluster 2024-08-31T05:01:09.820562+0000 mgr.a (mgr.14388) 7347 : cluster [DBG] pgmap v5093: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:11.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:11.580 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:11.580 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:12.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:11 smithi027 bash[22610]: audit 2024-08-31T05:01:11.674568+0000 mon.a (mon.0) 1684 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:01:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:11 smithi191 bash[24992]: audit 2024-08-31T05:01:11.674568+0000 mon.a (mon.0) 1684 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:01:12.348 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:12.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:12.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:12.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:12.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:11 smithi163 bash[24253]: audit 2024-08-31T05:01:11.674568+0000 mon.a (mon.0) 1684 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:01:13.231 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:01:13 smithi027 bash[22863]: debug 2024-08-31T05:01:13.189+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:01:13.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:01:13 smithi027 bash[22863]: debug 2024-08-31T05:01:13.189+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:01:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:12 smithi027 bash[22610]: cluster 2024-08-31T05:01:11.821343+0000 mgr.a (mgr.14388) 7348 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:12 smithi027 bash[22610]: audit 2024-08-31T05:01:11.917868+0000 mgr.a (mgr.14388) 7349 : audit [DBG] from='client.166653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:12 smithi027 bash[22610]: audit 2024-08-31T05:01:12.462409+0000 mon.a (mon.0) 1685 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:01:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:12 smithi027 bash[22610]: audit 2024-08-31T05:01:12.464439+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:01:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:12 smithi027 bash[22610]: audit 2024-08-31T05:01:12.475040+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:01:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:12 smithi027 bash[22610]: audit 2024-08-31T05:01:12.477402+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:01:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:12 smithi191 bash[24992]: cluster 2024-08-31T05:01:11.821343+0000 mgr.a (mgr.14388) 7348 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:12 smithi191 bash[24992]: audit 2024-08-31T05:01:11.917868+0000 mgr.a (mgr.14388) 7349 : audit [DBG] from='client.166653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:12 smithi191 bash[24992]: audit 2024-08-31T05:01:12.462409+0000 mon.a (mon.0) 1685 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:01:13.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:12 smithi191 bash[24992]: audit 2024-08-31T05:01:12.464439+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:01:13.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:12 smithi191 bash[24992]: audit 2024-08-31T05:01:12.475040+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:01:13.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:12 smithi191 bash[24992]: audit 2024-08-31T05:01:12.477402+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:01:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:12 smithi163 bash[24253]: cluster 2024-08-31T05:01:11.821343+0000 mgr.a (mgr.14388) 7348 : cluster [DBG] pgmap v5094: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:12 smithi163 bash[24253]: audit 2024-08-31T05:01:11.917868+0000 mgr.a (mgr.14388) 7349 : audit [DBG] from='client.166653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:12 smithi163 bash[24253]: audit 2024-08-31T05:01:12.462409+0000 mon.a (mon.0) 1685 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:01:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:12 smithi163 bash[24253]: audit 2024-08-31T05:01:12.464439+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:01:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:12 smithi163 bash[24253]: audit 2024-08-31T05:01:12.475040+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:01:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:12 smithi163 bash[24253]: audit 2024-08-31T05:01:12.477402+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:01:14.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:13 smithi027 bash[22610]: audit 2024-08-31T05:01:12.480091+0000 mgr.a (mgr.14388) 7350 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:01:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:13 smithi191 bash[24992]: audit 2024-08-31T05:01:12.480091+0000 mgr.a (mgr.14388) 7350 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:01:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:13 smithi163 bash[24253]: audit 2024-08-31T05:01:12.480091+0000 mgr.a (mgr.14388) 7350 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:01:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:14 smithi191 bash[24992]: audit 2024-08-31T05:01:13.191007+0000 mgr.a (mgr.14388) 7351 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:01:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:14 smithi191 bash[24992]: cephadm 2024-08-31T05:01:13.192339+0000 mgr.a (mgr.14388) 7352 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:01:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:14 smithi191 bash[24992]: cluster 2024-08-31T05:01:13.824109+0000 mgr.a (mgr.14388) 7353 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:01:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:14 smithi163 bash[24253]: audit 2024-08-31T05:01:13.191007+0000 mgr.a (mgr.14388) 7351 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:01:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:14 smithi163 bash[24253]: cephadm 2024-08-31T05:01:13.192339+0000 mgr.a (mgr.14388) 7352 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:01:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:14 smithi163 bash[24253]: cluster 2024-08-31T05:01:13.824109+0000 mgr.a (mgr.14388) 7353 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:01:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:14 smithi027 bash[22610]: audit 2024-08-31T05:01:13.191007+0000 mgr.a (mgr.14388) 7351 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:01:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:14 smithi027 bash[22610]: cephadm 2024-08-31T05:01:13.192339+0000 mgr.a (mgr.14388) 7352 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:01:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:14 smithi027 bash[22610]: cluster 2024-08-31T05:01:13.824109+0000 mgr.a (mgr.14388) 7353 : cluster [DBG] pgmap v5095: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:01:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:16 smithi191 bash[24992]: cluster 2024-08-31T05:01:15.824910+0000 mgr.a (mgr.14388) 7354 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:01:17.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:17.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:17.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:16 smithi163 bash[24253]: cluster 2024-08-31T05:01:15.824910+0000 mgr.a (mgr.14388) 7354 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:01:17.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:16 smithi027 bash[22610]: cluster 2024-08-31T05:01:15.824910+0000 mgr.a (mgr.14388) 7354 : cluster [DBG] pgmap v5096: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:01:18.100 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:18.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:18.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:18.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:18.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:18 smithi191 bash[24992]: audit 2024-08-31T05:01:17.686339+0000 mgr.a (mgr.14388) 7355 : audit [DBG] from='client.166839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:18 smithi191 bash[24992]: cluster 2024-08-31T05:01:17.825688+0000 mgr.a (mgr.14388) 7356 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:01:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:18 smithi163 bash[24253]: audit 2024-08-31T05:01:17.686339+0000 mgr.a (mgr.14388) 7355 : audit [DBG] from='client.166839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:18 smithi163 bash[24253]: cluster 2024-08-31T05:01:17.825688+0000 mgr.a (mgr.14388) 7356 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:01:19.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:18 smithi027 bash[22610]: audit 2024-08-31T05:01:17.686339+0000 mgr.a (mgr.14388) 7355 : audit [DBG] from='client.166839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:19.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:18 smithi027 bash[22610]: cluster 2024-08-31T05:01:17.825688+0000 mgr.a (mgr.14388) 7356 : cluster [DBG] pgmap v5097: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:01:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:21 smithi191 bash[24992]: cluster 2024-08-31T05:01:19.828323+0000 mgr.a (mgr.14388) 7357 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:01:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:21 smithi163 bash[24253]: cluster 2024-08-31T05:01:19.828323+0000 mgr.a (mgr.14388) 7357 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:01:21.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:21 smithi027 bash[22610]: cluster 2024-08-31T05:01:19.828323+0000 mgr.a (mgr.14388) 7357 : cluster [DBG] pgmap v5098: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:01:23.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:23.102 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:23.102 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:23 smithi191 bash[24992]: cluster 2024-08-31T05:01:21.829133+0000 mgr.a (mgr.14388) 7358 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:01:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:23 smithi163 bash[24253]: cluster 2024-08-31T05:01:21.829133+0000 mgr.a (mgr.14388) 7358 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:01:23.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:23 smithi027 bash[22610]: cluster 2024-08-31T05:01:21.829133+0000 mgr.a (mgr.14388) 7358 : cluster [DBG] pgmap v5099: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:01:23.882 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:23.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:23.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:23.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:23.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:25 smithi191 bash[24992]: audit 2024-08-31T05:01:23.440381+0000 mgr.a (mgr.14388) 7359 : audit [DBG] from='client.166917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:25 smithi191 bash[24992]: cluster 2024-08-31T05:01:23.830500+0000 mgr.a (mgr.14388) 7360 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:01:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:25 smithi163 bash[24253]: audit 2024-08-31T05:01:23.440381+0000 mgr.a (mgr.14388) 7359 : audit [DBG] from='client.166917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:25 smithi163 bash[24253]: cluster 2024-08-31T05:01:23.830500+0000 mgr.a (mgr.14388) 7360 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:01:25.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:25 smithi027 bash[22610]: audit 2024-08-31T05:01:23.440381+0000 mgr.a (mgr.14388) 7359 : audit [DBG] from='client.166917 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:25.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:25 smithi027 bash[22610]: cluster 2024-08-31T05:01:23.830500+0000 mgr.a (mgr.14388) 7360 : cluster [DBG] pgmap v5100: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:01:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:27 smithi191 bash[24992]: cluster 2024-08-31T05:01:25.831434+0000 mgr.a (mgr.14388) 7361 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:01:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:27 smithi163 bash[24253]: cluster 2024-08-31T05:01:25.831434+0000 mgr.a (mgr.14388) 7361 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:01:27.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:27 smithi027 bash[22610]: cluster 2024-08-31T05:01:25.831434+0000 mgr.a (mgr.14388) 7361 : cluster [DBG] pgmap v5101: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:01:28.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:28.884 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:28.884 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:29 smithi191 bash[24992]: cluster 2024-08-31T05:01:27.832347+0000 mgr.a (mgr.14388) 7362 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:01:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:29 smithi163 bash[24253]: cluster 2024-08-31T05:01:27.832347+0000 mgr.a (mgr.14388) 7362 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:01:29.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:29 smithi027 bash[22610]: cluster 2024-08-31T05:01:27.832347+0000 mgr.a (mgr.14388) 7362 : cluster [DBG] pgmap v5102: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:01:29.627 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:29.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:31 smithi191 bash[24992]: audit 2024-08-31T05:01:29.220286+0000 mgr.a (mgr.14388) 7363 : audit [DBG] from='client.166992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:31 smithi191 bash[24992]: cluster 2024-08-31T05:01:29.835195+0000 mgr.a (mgr.14388) 7364 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:01:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:31 smithi163 bash[24253]: audit 2024-08-31T05:01:29.220286+0000 mgr.a (mgr.14388) 7363 : audit [DBG] from='client.166992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:31 smithi163 bash[24253]: cluster 2024-08-31T05:01:29.835195+0000 mgr.a (mgr.14388) 7364 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:01:31.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:31 smithi027 bash[22610]: audit 2024-08-31T05:01:29.220286+0000 mgr.a (mgr.14388) 7363 : audit [DBG] from='client.166992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:31.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:31 smithi027 bash[22610]: cluster 2024-08-31T05:01:29.835195+0000 mgr.a (mgr.14388) 7364 : cluster [DBG] pgmap v5103: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:01:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:33 smithi191 bash[24992]: cluster 2024-08-31T05:01:31.836000+0000 mgr.a (mgr.14388) 7365 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:33 smithi163 bash[24253]: cluster 2024-08-31T05:01:31.836000+0000 mgr.a (mgr.14388) 7365 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:33.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:33 smithi027 bash[22610]: cluster 2024-08-31T05:01:31.836000+0000 mgr.a (mgr.14388) 7365 : cluster [DBG] pgmap v5104: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:34.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:34.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:34.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:35 smithi191 bash[24992]: cluster 2024-08-31T05:01:33.838035+0000 mgr.a (mgr.14388) 7366 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:35.402 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:35.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:35.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:35.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:35.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:35 smithi163 bash[24253]: cluster 2024-08-31T05:01:33.838035+0000 mgr.a (mgr.14388) 7366 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:35.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:35 smithi027 bash[22610]: cluster 2024-08-31T05:01:33.838035+0000 mgr.a (mgr.14388) 7366 : cluster [DBG] pgmap v5105: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:36 smithi191 bash[24992]: audit 2024-08-31T05:01:34.969478+0000 mgr.a (mgr.14388) 7367 : audit [DBG] from='client.167070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:36 smithi163 bash[24253]: audit 2024-08-31T05:01:34.969478+0000 mgr.a (mgr.14388) 7367 : audit [DBG] from='client.167070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:36.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:36 smithi027 bash[22610]: audit 2024-08-31T05:01:34.969478+0000 mgr.a (mgr.14388) 7367 : audit [DBG] from='client.167070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:37 smithi191 bash[24992]: cluster 2024-08-31T05:01:35.839020+0000 mgr.a (mgr.14388) 7368 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:37 smithi163 bash[24253]: cluster 2024-08-31T05:01:35.839020+0000 mgr.a (mgr.14388) 7368 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:37 smithi027 bash[22610]: cluster 2024-08-31T05:01:35.839020+0000 mgr.a (mgr.14388) 7368 : cluster [DBG] pgmap v5106: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:38 smithi163 bash[24253]: cluster 2024-08-31T05:01:37.840590+0000 mgr.a (mgr.14388) 7369 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:01:38.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:38 smithi027 bash[22610]: cluster 2024-08-31T05:01:37.840590+0000 mgr.a (mgr.14388) 7369 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:01:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:38 smithi191 bash[24992]: cluster 2024-08-31T05:01:37.840590+0000 mgr.a (mgr.14388) 7369 : cluster [DBG] pgmap v5107: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:01:40.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:40.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:41.184 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:41.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:41.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:41.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:41.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:40 smithi163 bash[24253]: cluster 2024-08-31T05:01:39.842474+0000 mgr.a (mgr.14388) 7370 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:40 smithi027 bash[22610]: cluster 2024-08-31T05:01:39.842474+0000 mgr.a (mgr.14388) 7370 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:40 smithi191 bash[24992]: cluster 2024-08-31T05:01:39.842474+0000 mgr.a (mgr.14388) 7370 : cluster [DBG] pgmap v5108: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:41 smithi163 bash[24253]: audit 2024-08-31T05:01:40.741242+0000 mgr.a (mgr.14388) 7371 : audit [DBG] from='client.167145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:42.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:41 smithi027 bash[22610]: audit 2024-08-31T05:01:40.741242+0000 mgr.a (mgr.14388) 7371 : audit [DBG] from='client.167145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:41 smithi191 bash[24992]: audit 2024-08-31T05:01:40.741242+0000 mgr.a (mgr.14388) 7371 : audit [DBG] from='client.167145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:42 smithi163 bash[24253]: cluster 2024-08-31T05:01:41.843516+0000 mgr.a (mgr.14388) 7372 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:42 smithi027 bash[22610]: cluster 2024-08-31T05:01:41.843516+0000 mgr.a (mgr.14388) 7372 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:42 smithi191 bash[24992]: cluster 2024-08-31T05:01:41.843516+0000 mgr.a (mgr.14388) 7372 : cluster [DBG] pgmap v5109: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:44 smithi163 bash[24253]: cluster 2024-08-31T05:01:43.845977+0000 mgr.a (mgr.14388) 7373 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:44 smithi027 bash[22610]: cluster 2024-08-31T05:01:43.845977+0000 mgr.a (mgr.14388) 7373 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:44 smithi191 bash[24992]: cluster 2024-08-31T05:01:43.845977+0000 mgr.a (mgr.14388) 7373 : cluster [DBG] pgmap v5110: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:46.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:46.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:46.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:46.934 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:46.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:46.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:46.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:46.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:46 smithi163 bash[24253]: cluster 2024-08-31T05:01:45.846924+0000 mgr.a (mgr.14388) 7374 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:46 smithi027 bash[22610]: cluster 2024-08-31T05:01:45.846924+0000 mgr.a (mgr.14388) 7374 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:46 smithi191 bash[24992]: cluster 2024-08-31T05:01:45.846924+0000 mgr.a (mgr.14388) 7374 : cluster [DBG] pgmap v5111: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:47 smithi163 bash[24253]: audit 2024-08-31T05:01:46.519680+0000 mgr.a (mgr.14388) 7375 : audit [DBG] from='client.167223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:48.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:47 smithi027 bash[22610]: audit 2024-08-31T05:01:46.519680+0000 mgr.a (mgr.14388) 7375 : audit [DBG] from='client.167223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:47 smithi191 bash[24992]: audit 2024-08-31T05:01:46.519680+0000 mgr.a (mgr.14388) 7375 : audit [DBG] from='client.167223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:48 smithi163 bash[24253]: cluster 2024-08-31T05:01:47.849166+0000 mgr.a (mgr.14388) 7376 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:49.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:48 smithi027 bash[22610]: cluster 2024-08-31T05:01:47.849166+0000 mgr.a (mgr.14388) 7376 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:48 smithi191 bash[24992]: cluster 2024-08-31T05:01:47.849166+0000 mgr.a (mgr.14388) 7376 : cluster [DBG] pgmap v5112: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:50 smithi163 bash[24253]: cluster 2024-08-31T05:01:49.849947+0000 mgr.a (mgr.14388) 7377 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:01:51.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:50 smithi027 bash[22610]: cluster 2024-08-31T05:01:49.849947+0000 mgr.a (mgr.14388) 7377 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:01:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:50 smithi191 bash[24992]: cluster 2024-08-31T05:01:49.849947+0000 mgr.a (mgr.14388) 7377 : cluster [DBG] pgmap v5113: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:01:51.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:51.937 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:51.937 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:52.710 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:52.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:52.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:52.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:52.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:52 smithi163 bash[24253]: cluster 2024-08-31T05:01:51.850773+0000 mgr.a (mgr.14388) 7378 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:53.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:52 smithi027 bash[22610]: cluster 2024-08-31T05:01:51.850773+0000 mgr.a (mgr.14388) 7378 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:52 smithi191 bash[24992]: cluster 2024-08-31T05:01:51.850773+0000 mgr.a (mgr.14388) 7378 : cluster [DBG] pgmap v5114: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:53 smithi163 bash[24253]: audit 2024-08-31T05:01:52.273254+0000 mgr.a (mgr.14388) 7379 : audit [DBG] from='client.167298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:54.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:53 smithi027 bash[22610]: audit 2024-08-31T05:01:52.273254+0000 mgr.a (mgr.14388) 7379 : audit [DBG] from='client.167298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:53 smithi191 bash[24992]: audit 2024-08-31T05:01:52.273254+0000 mgr.a (mgr.14388) 7379 : audit [DBG] from='client.167298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:01:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:54 smithi163 bash[24253]: cluster 2024-08-31T05:01:53.853158+0000 mgr.a (mgr.14388) 7380 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:55.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:54 smithi027 bash[22610]: cluster 2024-08-31T05:01:53.853158+0000 mgr.a (mgr.14388) 7380 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:54 smithi191 bash[24992]: cluster 2024-08-31T05:01:53.853158+0000 mgr.a (mgr.14388) 7380 : cluster [DBG] pgmap v5115: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:01:57.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:56 smithi027 bash[22610]: cluster 2024-08-31T05:01:55.853936+0000 mgr.a (mgr.14388) 7381 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:56 smithi191 bash[24992]: cluster 2024-08-31T05:01:55.853936+0000 mgr.a (mgr.14388) 7381 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:56 smithi163 bash[24253]: cluster 2024-08-31T05:01:55.853936+0000 mgr.a (mgr.14388) 7381 : cluster [DBG] pgmap v5116: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:57.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:01:57.712 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:01:57.713 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:01:58.453 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:01:58.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:01:58.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:01:58.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:01:58.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:01:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:58 smithi027 bash[22610]: cluster 2024-08-31T05:01:57.854943+0000 mgr.a (mgr.14388) 7382 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:58 smithi191 bash[24992]: cluster 2024-08-31T05:01:57.854943+0000 mgr.a (mgr.14388) 7382 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:01:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:58 smithi163 bash[24253]: cluster 2024-08-31T05:01:57.854943+0000 mgr.a (mgr.14388) 7382 : cluster [DBG] pgmap v5117: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:00.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:01:59 smithi027 bash[22610]: audit 2024-08-31T05:01:58.045768+0000 mgr.a (mgr.14388) 7383 : audit [DBG] from='client.167370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:01:59 smithi191 bash[24992]: audit 2024-08-31T05:01:58.045768+0000 mgr.a (mgr.14388) 7383 : audit [DBG] from='client.167370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:01:59 smithi163 bash[24253]: audit 2024-08-31T05:01:58.045768+0000 mgr.a (mgr.14388) 7383 : audit [DBG] from='client.167370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:01.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:00 smithi027 bash[22610]: cluster 2024-08-31T05:01:59.855732+0000 mgr.a (mgr.14388) 7384 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:02:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:00 smithi191 bash[24992]: cluster 2024-08-31T05:01:59.855732+0000 mgr.a (mgr.14388) 7384 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:02:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:00 smithi163 bash[24253]: cluster 2024-08-31T05:01:59.855732+0000 mgr.a (mgr.14388) 7384 : cluster [DBG] pgmap v5118: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:02:03.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:02 smithi027 bash[22610]: cluster 2024-08-31T05:02:01.856505+0000 mgr.a (mgr.14388) 7385 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:02:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:02 smithi191 bash[24992]: cluster 2024-08-31T05:02:01.856505+0000 mgr.a (mgr.14388) 7385 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:02:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:02 smithi163 bash[24253]: cluster 2024-08-31T05:02:01.856505+0000 mgr.a (mgr.14388) 7385 : cluster [DBG] pgmap v5119: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:02:03.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:02:03.456 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:02:03.456 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:02:04.241 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:02:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:02:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:02:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:02:04.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:02:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:04 smithi027 bash[22610]: audit 2024-08-31T05:02:03.791637+0000 mgr.a (mgr.14388) 7386 : audit [DBG] from='client.167448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:05.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:04 smithi027 bash[22610]: cluster 2024-08-31T05:02:03.858571+0000 mgr.a (mgr.14388) 7387 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:04 smithi191 bash[24992]: audit 2024-08-31T05:02:03.791637+0000 mgr.a (mgr.14388) 7386 : audit [DBG] from='client.167448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:04 smithi191 bash[24992]: cluster 2024-08-31T05:02:03.858571+0000 mgr.a (mgr.14388) 7387 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:04 smithi163 bash[24253]: audit 2024-08-31T05:02:03.791637+0000 mgr.a (mgr.14388) 7386 : audit [DBG] from='client.167448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:04 smithi163 bash[24253]: cluster 2024-08-31T05:02:03.858571+0000 mgr.a (mgr.14388) 7387 : cluster [DBG] pgmap v5120: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:07.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:06 smithi027 bash[22610]: cluster 2024-08-31T05:02:05.859453+0000 mgr.a (mgr.14388) 7388 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:02:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:06 smithi191 bash[24992]: cluster 2024-08-31T05:02:05.859453+0000 mgr.a (mgr.14388) 7388 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:02:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:06 smithi163 bash[24253]: cluster 2024-08-31T05:02:05.859453+0000 mgr.a (mgr.14388) 7388 : cluster [DBG] pgmap v5121: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:02:09.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:02:09.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:02:09.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:02:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:08 smithi191 bash[24992]: cluster 2024-08-31T05:02:07.861570+0000 mgr.a (mgr.14388) 7389 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:08 smithi163 bash[24253]: cluster 2024-08-31T05:02:07.861570+0000 mgr.a (mgr.14388) 7389 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:09.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:08 smithi027 bash[22610]: cluster 2024-08-31T05:02:07.861570+0000 mgr.a (mgr.14388) 7389 : cluster [DBG] pgmap v5122: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:10.023 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:02:10.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:02:10.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:02:10.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:02:10.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:02:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:10 smithi191 bash[24992]: audit 2024-08-31T05:02:09.582451+0000 mgr.a (mgr.14388) 7390 : audit [DBG] from='client.167526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:10 smithi191 bash[24992]: cluster 2024-08-31T05:02:09.862106+0000 mgr.a (mgr.14388) 7391 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:10 smithi163 bash[24253]: audit 2024-08-31T05:02:09.582451+0000 mgr.a (mgr.14388) 7390 : audit [DBG] from='client.167526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:10 smithi163 bash[24253]: cluster 2024-08-31T05:02:09.862106+0000 mgr.a (mgr.14388) 7391 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:11.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:10 smithi027 bash[22610]: audit 2024-08-31T05:02:09.582451+0000 mgr.a (mgr.14388) 7390 : audit [DBG] from='client.167526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:11.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:10 smithi027 bash[22610]: cluster 2024-08-31T05:02:09.862106+0000 mgr.a (mgr.14388) 7391 : cluster [DBG] pgmap v5123: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:13 smithi191 bash[24992]: cluster 2024-08-31T05:02:11.862982+0000 mgr.a (mgr.14388) 7392 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:13 smithi163 bash[24253]: cluster 2024-08-31T05:02:11.862982+0000 mgr.a (mgr.14388) 7392 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:13.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:13 smithi027 bash[22610]: cluster 2024-08-31T05:02:11.862982+0000 mgr.a (mgr.14388) 7392 : cluster [DBG] pgmap v5124: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:14 smithi191 bash[24992]: audit 2024-08-31T05:02:13.241550+0000 mon.a (mon.0) 1689 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:02:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:14 smithi163 bash[24253]: audit 2024-08-31T05:02:13.241550+0000 mon.a (mon.0) 1689 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:02:14.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:14 smithi027 bash[22610]: audit 2024-08-31T05:02:13.241550+0000 mon.a (mon.0) 1689 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:02:15.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:02:15.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:02:15.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:02:15.231 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:02:14 smithi027 bash[22863]: debug 2024-08-31T05:02:14.839+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:02:15.231 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:02:14 smithi027 bash[22863]: debug 2024-08-31T05:02:14.839+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:02:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:15 smithi027 bash[22610]: cluster 2024-08-31T05:02:13.863989+0000 mgr.a (mgr.14388) 7393 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:15 smithi027 bash[22610]: audit 2024-08-31T05:02:14.086462+0000 mon.a (mon.0) 1690 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:02:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:15 smithi027 bash[22610]: audit 2024-08-31T05:02:14.088136+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:02:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:15 smithi027 bash[22610]: audit 2024-08-31T05:02:14.096541+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:02:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:15 smithi027 bash[22610]: audit 2024-08-31T05:02:14.101741+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:02:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:15 smithi191 bash[24992]: cluster 2024-08-31T05:02:13.863989+0000 mgr.a (mgr.14388) 7393 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:15 smithi191 bash[24992]: audit 2024-08-31T05:02:14.086462+0000 mon.a (mon.0) 1690 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:02:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:15 smithi191 bash[24992]: audit 2024-08-31T05:02:14.088136+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:02:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:15 smithi191 bash[24992]: audit 2024-08-31T05:02:14.096541+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:02:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:15 smithi191 bash[24992]: audit 2024-08-31T05:02:14.101741+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:02:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:15 smithi163 bash[24253]: cluster 2024-08-31T05:02:13.863989+0000 mgr.a (mgr.14388) 7393 : cluster [DBG] pgmap v5125: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:15 smithi163 bash[24253]: audit 2024-08-31T05:02:14.086462+0000 mon.a (mon.0) 1690 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:02:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:15 smithi163 bash[24253]: audit 2024-08-31T05:02:14.088136+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:02:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:15 smithi163 bash[24253]: audit 2024-08-31T05:02:14.096541+0000 mon.a (mon.0) 1692 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:02:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:15 smithi163 bash[24253]: audit 2024-08-31T05:02:14.101741+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:02:15.766 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:02:15.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:02:15.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:02:15.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:02:15.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:02:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:16 smithi191 bash[24992]: audit 2024-08-31T05:02:14.104049+0000 mgr.a (mgr.14388) 7394 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:02:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:16 smithi191 bash[24992]: audit 2024-08-31T05:02:14.844092+0000 mgr.a (mgr.14388) 7395 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:02:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:16 smithi191 bash[24992]: cephadm 2024-08-31T05:02:14.845268+0000 mgr.a (mgr.14388) 7396 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:02:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:16 smithi163 bash[24253]: audit 2024-08-31T05:02:14.104049+0000 mgr.a (mgr.14388) 7394 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:02:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:16 smithi163 bash[24253]: audit 2024-08-31T05:02:14.844092+0000 mgr.a (mgr.14388) 7395 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:02:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:16 smithi163 bash[24253]: cephadm 2024-08-31T05:02:14.845268+0000 mgr.a (mgr.14388) 7396 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:02:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:16 smithi027 bash[22610]: audit 2024-08-31T05:02:14.104049+0000 mgr.a (mgr.14388) 7394 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:02:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:16 smithi027 bash[22610]: audit 2024-08-31T05:02:14.844092+0000 mgr.a (mgr.14388) 7395 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:02:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:16 smithi027 bash[22610]: cephadm 2024-08-31T05:02:14.845268+0000 mgr.a (mgr.14388) 7396 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:02:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:17 smithi191 bash[24992]: audit 2024-08-31T05:02:15.352363+0000 mgr.a (mgr.14388) 7397 : audit [DBG] from='client.167709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:17 smithi191 bash[24992]: cluster 2024-08-31T05:02:15.864885+0000 mgr.a (mgr.14388) 7398 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:17 smithi163 bash[24253]: audit 2024-08-31T05:02:15.352363+0000 mgr.a (mgr.14388) 7397 : audit [DBG] from='client.167709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:17 smithi163 bash[24253]: cluster 2024-08-31T05:02:15.864885+0000 mgr.a (mgr.14388) 7398 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:17.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:17 smithi027 bash[22610]: audit 2024-08-31T05:02:15.352363+0000 mgr.a (mgr.14388) 7397 : audit [DBG] from='client.167709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:17.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:17 smithi027 bash[22610]: cluster 2024-08-31T05:02:15.864885+0000 mgr.a (mgr.14388) 7398 : cluster [DBG] pgmap v5126: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:19 smithi191 bash[24992]: cluster 2024-08-31T05:02:17.867129+0000 mgr.a (mgr.14388) 7399 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:02:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:19 smithi163 bash[24253]: cluster 2024-08-31T05:02:17.867129+0000 mgr.a (mgr.14388) 7399 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:02:19.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:19 smithi027 bash[22610]: cluster 2024-08-31T05:02:17.867129+0000 mgr.a (mgr.14388) 7399 : cluster [DBG] pgmap v5127: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:02:20.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:02:20.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:02:20.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:02:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:21 smithi191 bash[24992]: cluster 2024-08-31T05:02:19.868069+0000 mgr.a (mgr.14388) 7400 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:02:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:21 smithi163 bash[24253]: cluster 2024-08-31T05:02:19.868069+0000 mgr.a (mgr.14388) 7400 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:02:21.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:21 smithi027 bash[22610]: cluster 2024-08-31T05:02:19.868069+0000 mgr.a (mgr.14388) 7400 : cluster [DBG] pgmap v5128: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:02:21.559 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:02:21.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:02:21.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:02:21.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:02:21.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:02:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:23 smithi191 bash[24992]: audit 2024-08-31T05:02:21.106693+0000 mgr.a (mgr.14388) 7401 : audit [DBG] from='client.167787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:23 smithi191 bash[24992]: cluster 2024-08-31T05:02:21.869061+0000 mgr.a (mgr.14388) 7402 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:02:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:23 smithi163 bash[24253]: audit 2024-08-31T05:02:21.106693+0000 mgr.a (mgr.14388) 7401 : audit [DBG] from='client.167787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:23 smithi163 bash[24253]: cluster 2024-08-31T05:02:21.869061+0000 mgr.a (mgr.14388) 7402 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:02:23.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:23 smithi027 bash[22610]: audit 2024-08-31T05:02:21.106693+0000 mgr.a (mgr.14388) 7401 : audit [DBG] from='client.167787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:23.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:23 smithi027 bash[22610]: cluster 2024-08-31T05:02:21.869061+0000 mgr.a (mgr.14388) 7402 : cluster [DBG] pgmap v5129: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:02:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:25 smithi163 bash[24253]: cluster 2024-08-31T05:02:23.871366+0000 mgr.a (mgr.14388) 7403 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 15 op/s 2024-08-31T05:02:25.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:25 smithi027 bash[22610]: cluster 2024-08-31T05:02:23.871366+0000 mgr.a (mgr.14388) 7403 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 15 op/s 2024-08-31T05:02:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:25 smithi191 bash[24992]: cluster 2024-08-31T05:02:23.871366+0000 mgr.a (mgr.14388) 7403 : cluster [DBG] pgmap v5130: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 15 op/s 2024-08-31T05:02:26.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:02:26.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:02:26.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:02:27.347 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:02:27.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:02:27.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:02:27.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:02:27.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:02:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:27 smithi163 bash[24253]: cluster 2024-08-31T05:02:25.872107+0000 mgr.a (mgr.14388) 7404 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:02:27.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:27 smithi027 bash[22610]: cluster 2024-08-31T05:02:25.872107+0000 mgr.a (mgr.14388) 7404 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:02:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:27 smithi191 bash[24992]: cluster 2024-08-31T05:02:25.872107+0000 mgr.a (mgr.14388) 7404 : cluster [DBG] pgmap v5131: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:02:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:28 smithi163 bash[24253]: audit 2024-08-31T05:02:26.901568+0000 mgr.a (mgr.14388) 7405 : audit [DBG] from='client.167865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:28.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:28 smithi027 bash[22610]: audit 2024-08-31T05:02:26.901568+0000 mgr.a (mgr.14388) 7405 : audit [DBG] from='client.167865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:28 smithi191 bash[24992]: audit 2024-08-31T05:02:26.901568+0000 mgr.a (mgr.14388) 7405 : audit [DBG] from='client.167865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:29 smithi163 bash[24253]: cluster 2024-08-31T05:02:27.874445+0000 mgr.a (mgr.14388) 7406 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 15 op/s 2024-08-31T05:02:29.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:29 smithi027 bash[22610]: cluster 2024-08-31T05:02:27.874445+0000 mgr.a (mgr.14388) 7406 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 15 op/s 2024-08-31T05:02:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:29 smithi191 bash[24992]: cluster 2024-08-31T05:02:27.874445+0000 mgr.a (mgr.14388) 7406 : cluster [DBG] pgmap v5132: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 15 op/s 2024-08-31T05:02:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:30 smithi163 bash[24253]: cluster 2024-08-31T05:02:29.875235+0000 mgr.a (mgr.14388) 7407 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:02:30.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:30 smithi027 bash[22610]: cluster 2024-08-31T05:02:29.875235+0000 mgr.a (mgr.14388) 7407 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:02:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:30 smithi191 bash[24992]: cluster 2024-08-31T05:02:29.875235+0000 mgr.a (mgr.14388) 7407 : cluster [DBG] pgmap v5133: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:02:32.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:02:32.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:02:32.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:02:33.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:02:33.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:02:33.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:02:33.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:02:33.126 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:02:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:32 smithi163 bash[24253]: cluster 2024-08-31T05:02:31.876016+0000 mgr.a (mgr.14388) 7408 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:02:33.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:32 smithi027 bash[22610]: cluster 2024-08-31T05:02:31.876016+0000 mgr.a (mgr.14388) 7408 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:02:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:32 smithi191 bash[24992]: cluster 2024-08-31T05:02:31.876016+0000 mgr.a (mgr.14388) 7408 : cluster [DBG] pgmap v5134: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:02:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:33 smithi163 bash[24253]: audit 2024-08-31T05:02:32.689549+0000 mgr.a (mgr.14388) 7409 : audit [DBG] from='client.167937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:34.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:33 smithi027 bash[22610]: audit 2024-08-31T05:02:32.689549+0000 mgr.a (mgr.14388) 7409 : audit [DBG] from='client.167937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:33 smithi191 bash[24992]: audit 2024-08-31T05:02:32.689549+0000 mgr.a (mgr.14388) 7409 : audit [DBG] from='client.167937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:34 smithi163 bash[24253]: cluster 2024-08-31T05:02:33.878852+0000 mgr.a (mgr.14388) 7410 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-08-31T05:02:35.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:34 smithi027 bash[22610]: cluster 2024-08-31T05:02:33.878852+0000 mgr.a (mgr.14388) 7410 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-08-31T05:02:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:34 smithi191 bash[24992]: cluster 2024-08-31T05:02:33.878852+0000 mgr.a (mgr.14388) 7410 : cluster [DBG] pgmap v5135: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 0 B/s wr, 62 op/s 2024-08-31T05:02:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:36 smithi163 bash[24253]: cluster 2024-08-31T05:02:35.879592+0000 mgr.a (mgr.14388) 7411 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:02:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:36 smithi027 bash[22610]: cluster 2024-08-31T05:02:35.879592+0000 mgr.a (mgr.14388) 7411 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:02:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:36 smithi191 bash[24992]: cluster 2024-08-31T05:02:35.879592+0000 mgr.a (mgr.14388) 7411 : cluster [DBG] pgmap v5136: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:02:38.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:02:38.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:02:38.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:02:38.870 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:02:38.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:02:38.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:02:38.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:02:38.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:02:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:38 smithi163 bash[24253]: cluster 2024-08-31T05:02:37.881479+0000 mgr.a (mgr.14388) 7412 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:02:39.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:38 smithi027 bash[22610]: cluster 2024-08-31T05:02:37.881479+0000 mgr.a (mgr.14388) 7412 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:02:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:38 smithi191 bash[24992]: cluster 2024-08-31T05:02:37.881479+0000 mgr.a (mgr.14388) 7412 : cluster [DBG] pgmap v5137: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:02:40.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:39 smithi027 bash[22610]: audit 2024-08-31T05:02:38.457400+0000 mgr.a (mgr.14388) 7413 : audit [DBG] from='client.168009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:39 smithi191 bash[24992]: audit 2024-08-31T05:02:38.457400+0000 mgr.a (mgr.14388) 7413 : audit [DBG] from='client.168009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:39 smithi163 bash[24253]: audit 2024-08-31T05:02:38.457400+0000 mgr.a (mgr.14388) 7413 : audit [DBG] from='client.168009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:41.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:40 smithi027 bash[22610]: cluster 2024-08-31T05:02:39.882382+0000 mgr.a (mgr.14388) 7414 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:02:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:40 smithi191 bash[24992]: cluster 2024-08-31T05:02:39.882382+0000 mgr.a (mgr.14388) 7414 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:02:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:40 smithi163 bash[24253]: cluster 2024-08-31T05:02:39.882382+0000 mgr.a (mgr.14388) 7414 : cluster [DBG] pgmap v5138: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:02:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:42 smithi027 bash[22610]: cluster 2024-08-31T05:02:41.883263+0000 mgr.a (mgr.14388) 7415 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:02:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:42 smithi191 bash[24992]: cluster 2024-08-31T05:02:41.883263+0000 mgr.a (mgr.14388) 7415 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:02:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:42 smithi163 bash[24253]: cluster 2024-08-31T05:02:41.883263+0000 mgr.a (mgr.14388) 7415 : cluster [DBG] pgmap v5139: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:02:43.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:02:43.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:02:43.873 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:02:44.609 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:02:44.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:02:44.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:02:44.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:02:44.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:02:45.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:44 smithi027 bash[22610]: cluster 2024-08-31T05:02:43.885422+0000 mgr.a (mgr.14388) 7416 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:02:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:44 smithi191 bash[24992]: cluster 2024-08-31T05:02:43.885422+0000 mgr.a (mgr.14388) 7416 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:02:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:44 smithi163 bash[24253]: cluster 2024-08-31T05:02:43.885422+0000 mgr.a (mgr.14388) 7416 : cluster [DBG] pgmap v5140: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:02:46.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:45 smithi027 bash[22610]: audit 2024-08-31T05:02:44.204404+0000 mgr.a (mgr.14388) 7417 : audit [DBG] from='client.168084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:45 smithi191 bash[24992]: audit 2024-08-31T05:02:44.204404+0000 mgr.a (mgr.14388) 7417 : audit [DBG] from='client.168084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:45 smithi163 bash[24253]: audit 2024-08-31T05:02:44.204404+0000 mgr.a (mgr.14388) 7417 : audit [DBG] from='client.168084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:46 smithi027 bash[22610]: cluster 2024-08-31T05:02:45.886306+0000 mgr.a (mgr.14388) 7418 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:46 smithi191 bash[24992]: cluster 2024-08-31T05:02:45.886306+0000 mgr.a (mgr.14388) 7418 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:46 smithi163 bash[24253]: cluster 2024-08-31T05:02:45.886306+0000 mgr.a (mgr.14388) 7418 : cluster [DBG] pgmap v5141: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:48 smithi191 bash[24992]: cluster 2024-08-31T05:02:47.888463+0000 mgr.a (mgr.14388) 7419 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:48 smithi163 bash[24253]: cluster 2024-08-31T05:02:47.888463+0000 mgr.a (mgr.14388) 7419 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:49.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:48 smithi027 bash[22610]: cluster 2024-08-31T05:02:47.888463+0000 mgr.a (mgr.14388) 7419 : cluster [DBG] pgmap v5142: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:49.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:02:49.611 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:02:49.612 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:02:50.359 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:02:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:02:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:02:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:02:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:02:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:50 smithi191 bash[24992]: cluster 2024-08-31T05:02:49.889177+0000 mgr.a (mgr.14388) 7420 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:50 smithi191 bash[24992]: audit 2024-08-31T05:02:49.947585+0000 mgr.a (mgr.14388) 7421 : audit [DBG] from='client.168162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:50 smithi163 bash[24253]: cluster 2024-08-31T05:02:49.889177+0000 mgr.a (mgr.14388) 7420 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:50 smithi163 bash[24253]: audit 2024-08-31T05:02:49.947585+0000 mgr.a (mgr.14388) 7421 : audit [DBG] from='client.168162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:51.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:50 smithi027 bash[22610]: cluster 2024-08-31T05:02:49.889177+0000 mgr.a (mgr.14388) 7420 : cluster [DBG] pgmap v5143: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:51.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:50 smithi027 bash[22610]: audit 2024-08-31T05:02:49.947585+0000 mgr.a (mgr.14388) 7421 : audit [DBG] from='client.168162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:52 smithi191 bash[24992]: cluster 2024-08-31T05:02:51.890098+0000 mgr.a (mgr.14388) 7422 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:52 smithi163 bash[24253]: cluster 2024-08-31T05:02:51.890098+0000 mgr.a (mgr.14388) 7422 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:53.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:52 smithi027 bash[22610]: cluster 2024-08-31T05:02:51.890098+0000 mgr.a (mgr.14388) 7422 : cluster [DBG] pgmap v5144: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:54 smithi191 bash[24992]: cluster 2024-08-31T05:02:53.892360+0000 mgr.a (mgr.14388) 7423 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:02:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:02:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:02:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:54 smithi163 bash[24253]: cluster 2024-08-31T05:02:53.892360+0000 mgr.a (mgr.14388) 7423 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:55.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:54 smithi027 bash[22610]: cluster 2024-08-31T05:02:53.892360+0000 mgr.a (mgr.14388) 7423 : cluster [DBG] pgmap v5145: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:56.116 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:02:56.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:02:56.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:02:56.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:02:56.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:02:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:56 smithi191 bash[24992]: audit 2024-08-31T05:02:55.699293+0000 mgr.a (mgr.14388) 7424 : audit [DBG] from='client.168237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:56 smithi191 bash[24992]: cluster 2024-08-31T05:02:55.892958+0000 mgr.a (mgr.14388) 7425 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:56 smithi163 bash[24253]: audit 2024-08-31T05:02:55.699293+0000 mgr.a (mgr.14388) 7424 : audit [DBG] from='client.168237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:56 smithi163 bash[24253]: cluster 2024-08-31T05:02:55.892958+0000 mgr.a (mgr.14388) 7425 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:57.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:57 smithi027 bash[22610]: audit 2024-08-31T05:02:55.699293+0000 mgr.a (mgr.14388) 7424 : audit [DBG] from='client.168237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:02:57.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:57 smithi027 bash[22610]: cluster 2024-08-31T05:02:55.892958+0000 mgr.a (mgr.14388) 7425 : cluster [DBG] pgmap v5146: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:02:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:02:59 smithi191 bash[24992]: cluster 2024-08-31T05:02:57.895298+0000 mgr.a (mgr.14388) 7426 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:02:59 smithi163 bash[24253]: cluster 2024-08-31T05:02:57.895298+0000 mgr.a (mgr.14388) 7426 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:02:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:02:59 smithi027 bash[22610]: cluster 2024-08-31T05:02:57.895298+0000 mgr.a (mgr.14388) 7426 : cluster [DBG] pgmap v5147: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:01.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:01.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:01 smithi191 bash[24992]: cluster 2024-08-31T05:02:59.896071+0000 mgr.a (mgr.14388) 7427 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:01 smithi163 bash[24253]: cluster 2024-08-31T05:02:59.896071+0000 mgr.a (mgr.14388) 7427 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:01.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:01 smithi027 bash[22610]: cluster 2024-08-31T05:02:59.896071+0000 mgr.a (mgr.14388) 7427 : cluster [DBG] pgmap v5148: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:01.898 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:01.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:03 smithi191 bash[24992]: audit 2024-08-31T05:03:01.461439+0000 mgr.a (mgr.14388) 7428 : audit [DBG] from='client.168312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:03 smithi191 bash[24992]: cluster 2024-08-31T05:03:01.896532+0000 mgr.a (mgr.14388) 7429 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:03 smithi163 bash[24253]: audit 2024-08-31T05:03:01.461439+0000 mgr.a (mgr.14388) 7428 : audit [DBG] from='client.168312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:03 smithi163 bash[24253]: cluster 2024-08-31T05:03:01.896532+0000 mgr.a (mgr.14388) 7429 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:03 smithi027 bash[22610]: audit 2024-08-31T05:03:01.461439+0000 mgr.a (mgr.14388) 7428 : audit [DBG] from='client.168312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:03 smithi027 bash[22610]: cluster 2024-08-31T05:03:01.896532+0000 mgr.a (mgr.14388) 7429 : cluster [DBG] pgmap v5149: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:05 smithi191 bash[24992]: cluster 2024-08-31T05:03:03.898672+0000 mgr.a (mgr.14388) 7430 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:05 smithi163 bash[24253]: cluster 2024-08-31T05:03:03.898672+0000 mgr.a (mgr.14388) 7430 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:05 smithi027 bash[22610]: cluster 2024-08-31T05:03:03.898672+0000 mgr.a (mgr.14388) 7430 : cluster [DBG] pgmap v5150: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:06.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:06.901 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:06.901 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:07 smithi191 bash[24992]: cluster 2024-08-31T05:03:05.899456+0000 mgr.a (mgr.14388) 7431 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:07 smithi163 bash[24253]: cluster 2024-08-31T05:03:05.899456+0000 mgr.a (mgr.14388) 7431 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:07.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:07 smithi027 bash[22610]: cluster 2024-08-31T05:03:05.899456+0000 mgr.a (mgr.14388) 7431 : cluster [DBG] pgmap v5151: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:07.651 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:07.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:07.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:07.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:07.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:09 smithi191 bash[24992]: audit 2024-08-31T05:03:07.233678+0000 mgr.a (mgr.14388) 7432 : audit [DBG] from='client.168390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:09 smithi191 bash[24992]: cluster 2024-08-31T05:03:07.901680+0000 mgr.a (mgr.14388) 7433 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:09 smithi163 bash[24253]: audit 2024-08-31T05:03:07.233678+0000 mgr.a (mgr.14388) 7432 : audit [DBG] from='client.168390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:09 smithi163 bash[24253]: cluster 2024-08-31T05:03:07.901680+0000 mgr.a (mgr.14388) 7433 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:09.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:09 smithi027 bash[22610]: audit 2024-08-31T05:03:07.233678+0000 mgr.a (mgr.14388) 7432 : audit [DBG] from='client.168390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:09.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:09 smithi027 bash[22610]: cluster 2024-08-31T05:03:07.901680+0000 mgr.a (mgr.14388) 7433 : cluster [DBG] pgmap v5152: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:11.325 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:11 smithi191 bash[24992]: cluster 2024-08-31T05:03:09.902455+0000 mgr.a (mgr.14388) 7434 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:11 smithi163 bash[24253]: cluster 2024-08-31T05:03:09.902455+0000 mgr.a (mgr.14388) 7434 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:11.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:11 smithi027 bash[22610]: cluster 2024-08-31T05:03:09.902455+0000 mgr.a (mgr.14388) 7434 : cluster [DBG] pgmap v5153: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:12.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:12.654 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:12.654 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:13 smithi191 bash[24992]: cluster 2024-08-31T05:03:11.903259+0000 mgr.a (mgr.14388) 7435 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:13.397 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:13.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:13.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:13.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:13.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:13 smithi163 bash[24253]: cluster 2024-08-31T05:03:11.903259+0000 mgr.a (mgr.14388) 7435 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:13.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:13 smithi027 bash[22610]: cluster 2024-08-31T05:03:11.903259+0000 mgr.a (mgr.14388) 7435 : cluster [DBG] pgmap v5154: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:14 smithi163 bash[24253]: audit 2024-08-31T05:03:12.988111+0000 mgr.a (mgr.14388) 7436 : audit [DBG] from='client.168465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:14.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:14 smithi027 bash[22610]: audit 2024-08-31T05:03:12.988111+0000 mgr.a (mgr.14388) 7436 : audit [DBG] from='client.168465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:14 smithi191 bash[24992]: audit 2024-08-31T05:03:12.988111+0000 mgr.a (mgr.14388) 7436 : audit [DBG] from='client.168465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:15 smithi163 bash[24253]: cluster 2024-08-31T05:03:13.905958+0000 mgr.a (mgr.14388) 7437 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:15 smithi163 bash[24253]: audit 2024-08-31T05:03:14.896108+0000 mon.a (mon.0) 1694 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:03:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:15 smithi027 bash[22610]: cluster 2024-08-31T05:03:13.905958+0000 mgr.a (mgr.14388) 7437 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:15 smithi027 bash[22610]: audit 2024-08-31T05:03:14.896108+0000 mon.a (mon.0) 1694 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:03:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:15 smithi191 bash[24992]: cluster 2024-08-31T05:03:13.905958+0000 mgr.a (mgr.14388) 7437 : cluster [DBG] pgmap v5155: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:15 smithi191 bash[24992]: audit 2024-08-31T05:03:14.896108+0000 mon.a (mon.0) 1694 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:03:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:16 smithi163 bash[24253]: audit 2024-08-31T05:03:15.742361+0000 mon.a (mon.0) 1695 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:03:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:16 smithi163 bash[24253]: audit 2024-08-31T05:03:15.743669+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:03:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:16 smithi163 bash[24253]: audit 2024-08-31T05:03:15.753114+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:03:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:16 smithi163 bash[24253]: audit 2024-08-31T05:03:15.758436+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:03:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:16 smithi027 bash[22610]: audit 2024-08-31T05:03:15.742361+0000 mon.a (mon.0) 1695 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:03:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:16 smithi027 bash[22610]: audit 2024-08-31T05:03:15.743669+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:03:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:16 smithi027 bash[22610]: audit 2024-08-31T05:03:15.753114+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:03:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:16 smithi027 bash[22610]: audit 2024-08-31T05:03:15.758436+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:03:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:16 smithi191 bash[24992]: audit 2024-08-31T05:03:15.742361+0000 mon.a (mon.0) 1695 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:03:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:16 smithi191 bash[24992]: audit 2024-08-31T05:03:15.743669+0000 mon.a (mon.0) 1696 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:03:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:16 smithi191 bash[24992]: audit 2024-08-31T05:03:15.753114+0000 mon.a (mon.0) 1697 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:03:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:16 smithi191 bash[24992]: audit 2024-08-31T05:03:15.758436+0000 mon.a (mon.0) 1698 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:03:16.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:03:16 smithi027 bash[22863]: debug 2024-08-31T05:03:16.498+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:03:16.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:03:16 smithi027 bash[22863]: debug 2024-08-31T05:03:16.498+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:03:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:17 smithi163 bash[24253]: audit 2024-08-31T05:03:15.759820+0000 mgr.a (mgr.14388) 7438 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:03:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:17 smithi163 bash[24253]: cluster 2024-08-31T05:03:15.906532+0000 mgr.a (mgr.14388) 7439 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:03:17.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:17 smithi027 bash[22610]: audit 2024-08-31T05:03:15.759820+0000 mgr.a (mgr.14388) 7438 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:03:17.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:17 smithi027 bash[22610]: cluster 2024-08-31T05:03:15.906532+0000 mgr.a (mgr.14388) 7439 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:03:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:17 smithi191 bash[24992]: audit 2024-08-31T05:03:15.759820+0000 mgr.a (mgr.14388) 7438 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:03:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:17 smithi191 bash[24992]: cluster 2024-08-31T05:03:15.906532+0000 mgr.a (mgr.14388) 7439 : cluster [DBG] pgmap v5156: 225 pgs: 225 active+clean; 589 KiB data, 129 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:03:18.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:18.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:18.400 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:18 smithi163 bash[24253]: audit 2024-08-31T05:03:16.498855+0000 mgr.a (mgr.14388) 7440 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:03:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:18 smithi163 bash[24253]: cephadm 2024-08-31T05:03:16.500279+0000 mgr.a (mgr.14388) 7441 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:03:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:18 smithi027 bash[22610]: audit 2024-08-31T05:03:16.498855+0000 mgr.a (mgr.14388) 7440 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:03:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:18 smithi027 bash[22610]: cephadm 2024-08-31T05:03:16.500279+0000 mgr.a (mgr.14388) 7441 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:03:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:18 smithi191 bash[24992]: audit 2024-08-31T05:03:16.498855+0000 mgr.a (mgr.14388) 7440 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:03:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:18 smithi191 bash[24992]: cephadm 2024-08-31T05:03:16.500279+0000 mgr.a (mgr.14388) 7441 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:03:19.175 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:19.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:19.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:19.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:19.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:19 smithi163 bash[24253]: cluster 2024-08-31T05:03:17.908736+0000 mgr.a (mgr.14388) 7442 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:19.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:19 smithi027 bash[22610]: cluster 2024-08-31T05:03:17.908736+0000 mgr.a (mgr.14388) 7442 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:19 smithi191 bash[24992]: cluster 2024-08-31T05:03:17.908736+0000 mgr.a (mgr.14388) 7442 : cluster [DBG] pgmap v5157: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:20 smithi163 bash[24253]: audit 2024-08-31T05:03:18.737310+0000 mgr.a (mgr.14388) 7443 : audit [DBG] from='client.168648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:20.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:20 smithi027 bash[22610]: audit 2024-08-31T05:03:18.737310+0000 mgr.a (mgr.14388) 7443 : audit [DBG] from='client.168648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:20 smithi191 bash[24992]: audit 2024-08-31T05:03:18.737310+0000 mgr.a (mgr.14388) 7443 : audit [DBG] from='client.168648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:21 smithi163 bash[24253]: cluster 2024-08-31T05:03:19.909650+0000 mgr.a (mgr.14388) 7444 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:03:21.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:21 smithi027 bash[22610]: cluster 2024-08-31T05:03:19.909650+0000 mgr.a (mgr.14388) 7444 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:03:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:21 smithi191 bash[24992]: cluster 2024-08-31T05:03:19.909650+0000 mgr.a (mgr.14388) 7444 : cluster [DBG] pgmap v5158: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:03:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:22 smithi163 bash[24253]: cluster 2024-08-31T05:03:21.910441+0000 mgr.a (mgr.14388) 7445 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:03:22.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:22 smithi027 bash[22610]: cluster 2024-08-31T05:03:21.910441+0000 mgr.a (mgr.14388) 7445 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:03:22.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:22 smithi191 bash[24992]: cluster 2024-08-31T05:03:21.910441+0000 mgr.a (mgr.14388) 7445 : cluster [DBG] pgmap v5159: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:03:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:24.180 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:24.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:24.957 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:24.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:24.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:24.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:24.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:24 smithi027 bash[22610]: cluster 2024-08-31T05:03:23.912634+0000 mgr.a (mgr.14388) 7446 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:24 smithi191 bash[24992]: cluster 2024-08-31T05:03:23.912634+0000 mgr.a (mgr.14388) 7446 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:24 smithi163 bash[24253]: cluster 2024-08-31T05:03:23.912634+0000 mgr.a (mgr.14388) 7446 : cluster [DBG] pgmap v5160: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:26.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:25 smithi027 bash[22610]: audit 2024-08-31T05:03:24.512392+0000 mgr.a (mgr.14388) 7447 : audit [DBG] from='client.168726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:25 smithi191 bash[24992]: audit 2024-08-31T05:03:24.512392+0000 mgr.a (mgr.14388) 7447 : audit [DBG] from='client.168726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:25 smithi163 bash[24253]: audit 2024-08-31T05:03:24.512392+0000 mgr.a (mgr.14388) 7447 : audit [DBG] from='client.168726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:26 smithi027 bash[22610]: cluster 2024-08-31T05:03:25.913510+0000 mgr.a (mgr.14388) 7448 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:26 smithi191 bash[24992]: cluster 2024-08-31T05:03:25.913510+0000 mgr.a (mgr.14388) 7448 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:26 smithi163 bash[24253]: cluster 2024-08-31T05:03:25.913510+0000 mgr.a (mgr.14388) 7448 : cluster [DBG] pgmap v5161: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:28 smithi191 bash[24992]: cluster 2024-08-31T05:03:27.915692+0000 mgr.a (mgr.14388) 7449 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:28 smithi163 bash[24253]: cluster 2024-08-31T05:03:27.915692+0000 mgr.a (mgr.14388) 7449 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:29.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:28 smithi027 bash[22610]: cluster 2024-08-31T05:03:27.915692+0000 mgr.a (mgr.14388) 7449 : cluster [DBG] pgmap v5162: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:03:29.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:29.959 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:29.959 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:30.711 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:30.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:30 smithi191 bash[24992]: cluster 2024-08-31T05:03:29.916470+0000 mgr.a (mgr.14388) 7450 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:30 smithi163 bash[24253]: cluster 2024-08-31T05:03:29.916470+0000 mgr.a (mgr.14388) 7450 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:31.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:30 smithi027 bash[22610]: cluster 2024-08-31T05:03:29.916470+0000 mgr.a (mgr.14388) 7450 : cluster [DBG] pgmap v5163: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:31 smithi191 bash[24992]: audit 2024-08-31T05:03:30.289368+0000 mgr.a (mgr.14388) 7451 : audit [DBG] from='client.168804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:31 smithi163 bash[24253]: audit 2024-08-31T05:03:30.289368+0000 mgr.a (mgr.14388) 7451 : audit [DBG] from='client.168804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:32.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:31 smithi027 bash[22610]: audit 2024-08-31T05:03:30.289368+0000 mgr.a (mgr.14388) 7451 : audit [DBG] from='client.168804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:32 smithi191 bash[24992]: cluster 2024-08-31T05:03:31.917380+0000 mgr.a (mgr.14388) 7452 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:32 smithi163 bash[24253]: cluster 2024-08-31T05:03:31.917380+0000 mgr.a (mgr.14388) 7452 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:33.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:32 smithi027 bash[22610]: cluster 2024-08-31T05:03:31.917380+0000 mgr.a (mgr.14388) 7452 : cluster [DBG] pgmap v5164: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:35 smithi191 bash[24992]: cluster 2024-08-31T05:03:33.919582+0000 mgr.a (mgr.14388) 7453 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:35 smithi163 bash[24253]: cluster 2024-08-31T05:03:33.919582+0000 mgr.a (mgr.14388) 7453 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:35.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:35 smithi027 bash[22610]: cluster 2024-08-31T05:03:33.919582+0000 mgr.a (mgr.14388) 7453 : cluster [DBG] pgmap v5165: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:35.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:35.714 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:35.714 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:36.458 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:36.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:36.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:36.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:36.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:37 smithi191 bash[24992]: cluster 2024-08-31T05:03:35.920315+0000 mgr.a (mgr.14388) 7454 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:37 smithi191 bash[24992]: audit 2024-08-31T05:03:36.050344+0000 mgr.a (mgr.14388) 7455 : audit [DBG] from='client.168879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:37 smithi163 bash[24253]: cluster 2024-08-31T05:03:35.920315+0000 mgr.a (mgr.14388) 7454 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:37 smithi163 bash[24253]: audit 2024-08-31T05:03:36.050344+0000 mgr.a (mgr.14388) 7455 : audit [DBG] from='client.168879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:37 smithi027 bash[22610]: cluster 2024-08-31T05:03:35.920315+0000 mgr.a (mgr.14388) 7454 : cluster [DBG] pgmap v5166: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:37 smithi027 bash[22610]: audit 2024-08-31T05:03:36.050344+0000 mgr.a (mgr.14388) 7455 : audit [DBG] from='client.168879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:39 smithi191 bash[24992]: cluster 2024-08-31T05:03:37.922520+0000 mgr.a (mgr.14388) 7456 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:39 smithi163 bash[24253]: cluster 2024-08-31T05:03:37.922520+0000 mgr.a (mgr.14388) 7456 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:39.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:39 smithi027 bash[22610]: cluster 2024-08-31T05:03:37.922520+0000 mgr.a (mgr.14388) 7456 : cluster [DBG] pgmap v5167: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:41 smithi191 bash[24992]: cluster 2024-08-31T05:03:39.923301+0000 mgr.a (mgr.14388) 7457 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:41 smithi163 bash[24253]: cluster 2024-08-31T05:03:39.923301+0000 mgr.a (mgr.14388) 7457 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:41.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:41.460 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:41.460 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:41.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:41 smithi027 bash[22610]: cluster 2024-08-31T05:03:39.923301+0000 mgr.a (mgr.14388) 7457 : cluster [DBG] pgmap v5168: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:42.206 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:42.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:42.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:42.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:42.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:43 smithi191 bash[24992]: audit 2024-08-31T05:03:41.789035+0000 mgr.a (mgr.14388) 7458 : audit [DBG] from='client.168954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:43 smithi191 bash[24992]: cluster 2024-08-31T05:03:41.926802+0000 mgr.a (mgr.14388) 7459 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:43 smithi163 bash[24253]: audit 2024-08-31T05:03:41.789035+0000 mgr.a (mgr.14388) 7458 : audit [DBG] from='client.168954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:43 smithi163 bash[24253]: cluster 2024-08-31T05:03:41.926802+0000 mgr.a (mgr.14388) 7459 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:43.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:43 smithi027 bash[22610]: audit 2024-08-31T05:03:41.789035+0000 mgr.a (mgr.14388) 7458 : audit [DBG] from='client.168954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:43.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:43 smithi027 bash[22610]: cluster 2024-08-31T05:03:41.926802+0000 mgr.a (mgr.14388) 7459 : cluster [DBG] pgmap v5169: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:45 smithi191 bash[24992]: cluster 2024-08-31T05:03:43.929090+0000 mgr.a (mgr.14388) 7460 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:45 smithi163 bash[24253]: cluster 2024-08-31T05:03:43.929090+0000 mgr.a (mgr.14388) 7460 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:45.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:45 smithi027 bash[22610]: cluster 2024-08-31T05:03:43.929090+0000 mgr.a (mgr.14388) 7460 : cluster [DBG] pgmap v5170: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:03:47.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:47.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:47.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:47 smithi191 bash[24992]: cluster 2024-08-31T05:03:45.929852+0000 mgr.a (mgr.14388) 7461 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:47 smithi163 bash[24253]: cluster 2024-08-31T05:03:45.929852+0000 mgr.a (mgr.14388) 7461 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:47.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:47 smithi027 bash[22610]: cluster 2024-08-31T05:03:45.929852+0000 mgr.a (mgr.14388) 7461 : cluster [DBG] pgmap v5171: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:47.984 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:47.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:47.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:47.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:47.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:49 smithi191 bash[24992]: audit 2024-08-31T05:03:47.546545+0000 mgr.a (mgr.14388) 7462 : audit [DBG] from='client.169032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:49 smithi191 bash[24992]: cluster 2024-08-31T05:03:47.931201+0000 mgr.a (mgr.14388) 7463 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:03:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:49 smithi163 bash[24253]: audit 2024-08-31T05:03:47.546545+0000 mgr.a (mgr.14388) 7462 : audit [DBG] from='client.169032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:49 smithi163 bash[24253]: cluster 2024-08-31T05:03:47.931201+0000 mgr.a (mgr.14388) 7463 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:03:49.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:49 smithi027 bash[22610]: audit 2024-08-31T05:03:47.546545+0000 mgr.a (mgr.14388) 7462 : audit [DBG] from='client.169032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:49.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:49 smithi027 bash[22610]: cluster 2024-08-31T05:03:47.931201+0000 mgr.a (mgr.14388) 7463 : cluster [DBG] pgmap v5172: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:03:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:51 smithi191 bash[24992]: cluster 2024-08-31T05:03:49.931912+0000 mgr.a (mgr.14388) 7464 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:03:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:51 smithi163 bash[24253]: cluster 2024-08-31T05:03:49.931912+0000 mgr.a (mgr.14388) 7464 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:03:51.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:51 smithi027 bash[22610]: cluster 2024-08-31T05:03:49.931912+0000 mgr.a (mgr.14388) 7464 : cluster [DBG] pgmap v5173: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:03:52.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:52.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:52.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:53 smithi163 bash[24253]: cluster 2024-08-31T05:03:51.932654+0000 mgr.a (mgr.14388) 7465 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:03:53.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:53 smithi027 bash[22610]: cluster 2024-08-31T05:03:51.932654+0000 mgr.a (mgr.14388) 7465 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:03:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:53 smithi191 bash[24992]: cluster 2024-08-31T05:03:51.932654+0000 mgr.a (mgr.14388) 7465 : cluster [DBG] pgmap v5174: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:03:53.750 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:53.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:53.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:53.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:53.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:55 smithi163 bash[24253]: audit 2024-08-31T05:03:53.321346+0000 mgr.a (mgr.14388) 7466 : audit [DBG] from='client.169110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:55 smithi163 bash[24253]: cluster 2024-08-31T05:03:53.935256+0000 mgr.a (mgr.14388) 7467 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:55.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:55 smithi027 bash[22610]: audit 2024-08-31T05:03:53.321346+0000 mgr.a (mgr.14388) 7466 : audit [DBG] from='client.169110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:55.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:55 smithi027 bash[22610]: cluster 2024-08-31T05:03:53.935256+0000 mgr.a (mgr.14388) 7467 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:55 smithi191 bash[24992]: audit 2024-08-31T05:03:53.321346+0000 mgr.a (mgr.14388) 7466 : audit [DBG] from='client.169110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:03:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:55 smithi191 bash[24992]: cluster 2024-08-31T05:03:53.935256+0000 mgr.a (mgr.14388) 7467 : cluster [DBG] pgmap v5175: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:57 smithi163 bash[24253]: cluster 2024-08-31T05:03:55.936012+0000 mgr.a (mgr.14388) 7468 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:03:57.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:57 smithi027 bash[22610]: cluster 2024-08-31T05:03:55.936012+0000 mgr.a (mgr.14388) 7468 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:03:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:57 smithi191 bash[24992]: cluster 2024-08-31T05:03:55.936012+0000 mgr.a (mgr.14388) 7468 : cluster [DBG] pgmap v5176: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:03:58.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:03:58.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:03:58.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:03:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:03:59 smithi163 bash[24253]: cluster 2024-08-31T05:03:57.937887+0000 mgr.a (mgr.14388) 7469 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:03:59 smithi027 bash[22610]: cluster 2024-08-31T05:03:57.937887+0000 mgr.a (mgr.14388) 7469 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:03:59.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:03:59.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:03:59.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:03:59.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:03:59.518 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:03:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:03:59 smithi191 bash[24992]: cluster 2024-08-31T05:03:57.937887+0000 mgr.a (mgr.14388) 7469 : cluster [DBG] pgmap v5177: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:01 smithi163 bash[24253]: audit 2024-08-31T05:03:59.087455+0000 mgr.a (mgr.14388) 7470 : audit [DBG] from='client.169188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:01 smithi163 bash[24253]: cluster 2024-08-31T05:03:59.938798+0000 mgr.a (mgr.14388) 7471 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:04:01.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:01 smithi027 bash[22610]: audit 2024-08-31T05:03:59.087455+0000 mgr.a (mgr.14388) 7470 : audit [DBG] from='client.169188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:01.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:01 smithi027 bash[22610]: cluster 2024-08-31T05:03:59.938798+0000 mgr.a (mgr.14388) 7471 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:04:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:01 smithi191 bash[24992]: audit 2024-08-31T05:03:59.087455+0000 mgr.a (mgr.14388) 7470 : audit [DBG] from='client.169188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:01 smithi191 bash[24992]: cluster 2024-08-31T05:03:59.938798+0000 mgr.a (mgr.14388) 7471 : cluster [DBG] pgmap v5178: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:04:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:03 smithi163 bash[24253]: cluster 2024-08-31T05:04:01.939550+0000 mgr.a (mgr.14388) 7472 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:04:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:03 smithi027 bash[22610]: cluster 2024-08-31T05:04:01.939550+0000 mgr.a (mgr.14388) 7472 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:04:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:03 smithi191 bash[24992]: cluster 2024-08-31T05:04:01.939550+0000 mgr.a (mgr.14388) 7472 : cluster [DBG] pgmap v5179: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:04:04.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:04:04.520 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:04:04.520 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:04:05.306 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:04:05.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:04:05.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:04:05.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:04:05.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:04:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:05 smithi163 bash[24253]: cluster 2024-08-31T05:04:03.941733+0000 mgr.a (mgr.14388) 7473 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:04:05.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:05 smithi027 bash[22610]: cluster 2024-08-31T05:04:03.941733+0000 mgr.a (mgr.14388) 7473 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:04:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:05 smithi191 bash[24992]: cluster 2024-08-31T05:04:03.941733+0000 mgr.a (mgr.14388) 7473 : cluster [DBG] pgmap v5180: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:04:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:06 smithi163 bash[24253]: audit 2024-08-31T05:04:04.861130+0000 mgr.a (mgr.14388) 7474 : audit [DBG] from='client.169266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:06.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:06 smithi027 bash[22610]: audit 2024-08-31T05:04:04.861130+0000 mgr.a (mgr.14388) 7474 : audit [DBG] from='client.169266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:06 smithi191 bash[24992]: audit 2024-08-31T05:04:04.861130+0000 mgr.a (mgr.14388) 7474 : audit [DBG] from='client.169266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:07 smithi163 bash[24253]: cluster 2024-08-31T05:04:05.942622+0000 mgr.a (mgr.14388) 7475 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:07.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:07 smithi027 bash[22610]: cluster 2024-08-31T05:04:05.942622+0000 mgr.a (mgr.14388) 7475 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:07 smithi191 bash[24992]: cluster 2024-08-31T05:04:05.942622+0000 mgr.a (mgr.14388) 7475 : cluster [DBG] pgmap v5181: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:08 smithi163 bash[24253]: cluster 2024-08-31T05:04:07.944785+0000 mgr.a (mgr.14388) 7476 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:08.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:08 smithi027 bash[22610]: cluster 2024-08-31T05:04:07.944785+0000 mgr.a (mgr.14388) 7476 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:08 smithi191 bash[24992]: cluster 2024-08-31T05:04:07.944785+0000 mgr.a (mgr.14388) 7476 : cluster [DBG] pgmap v5182: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:10.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:04:10.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:04:10.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:04:11.083 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:04:11.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:04:11.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:04:11.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:04:11.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:04:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:11 smithi191 bash[24992]: cluster 2024-08-31T05:04:09.945541+0000 mgr.a (mgr.14388) 7477 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:11 smithi163 bash[24253]: cluster 2024-08-31T05:04:09.945541+0000 mgr.a (mgr.14388) 7477 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:11.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:11 smithi027 bash[22610]: cluster 2024-08-31T05:04:09.945541+0000 mgr.a (mgr.14388) 7477 : cluster [DBG] pgmap v5183: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:12 smithi191 bash[24992]: audit 2024-08-31T05:04:10.642680+0000 mgr.a (mgr.14388) 7478 : audit [DBG] from='client.169338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:12 smithi163 bash[24253]: audit 2024-08-31T05:04:10.642680+0000 mgr.a (mgr.14388) 7478 : audit [DBG] from='client.169338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:12.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:12 smithi027 bash[22610]: audit 2024-08-31T05:04:10.642680+0000 mgr.a (mgr.14388) 7478 : audit [DBG] from='client.169338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:13 smithi191 bash[24992]: cluster 2024-08-31T05:04:11.946423+0000 mgr.a (mgr.14388) 7479 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:13 smithi163 bash[24253]: cluster 2024-08-31T05:04:11.946423+0000 mgr.a (mgr.14388) 7479 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:13.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:13 smithi027 bash[22610]: cluster 2024-08-31T05:04:11.946423+0000 mgr.a (mgr.14388) 7479 : cluster [DBG] pgmap v5184: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:15 smithi191 bash[24992]: cluster 2024-08-31T05:04:13.948645+0000 mgr.a (mgr.14388) 7480 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:15 smithi163 bash[24253]: cluster 2024-08-31T05:04:13.948645+0000 mgr.a (mgr.14388) 7480 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:15 smithi027 bash[22610]: cluster 2024-08-31T05:04:13.948645+0000 mgr.a (mgr.14388) 7480 : cluster [DBG] pgmap v5185: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:16.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:04:16.085 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:04:16.085 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:04:16.844 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:04:16.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:04:16.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:04:16.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:04:16.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:04:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:17 smithi191 bash[24992]: cluster 2024-08-31T05:04:15.949382+0000 mgr.a (mgr.14388) 7481 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:17 smithi191 bash[24992]: audit 2024-08-31T05:04:16.553095+0000 mon.a (mon.0) 1699 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:04:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:17 smithi163 bash[24253]: cluster 2024-08-31T05:04:15.949382+0000 mgr.a (mgr.14388) 7481 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:17 smithi163 bash[24253]: audit 2024-08-31T05:04:16.553095+0000 mon.a (mon.0) 1699 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:04:17.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:17 smithi027 bash[22610]: cluster 2024-08-31T05:04:15.949382+0000 mgr.a (mgr.14388) 7481 : cluster [DBG] pgmap v5186: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:17.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:17 smithi027 bash[22610]: audit 2024-08-31T05:04:16.553095+0000 mon.a (mon.0) 1699 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:04:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:18 smithi191 bash[24992]: audit 2024-08-31T05:04:16.420831+0000 mgr.a (mgr.14388) 7482 : audit [DBG] from='client.169416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:18 smithi191 bash[24992]: audit 2024-08-31T05:04:17.104178+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:04:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:18 smithi191 bash[24992]: audit 2024-08-31T05:04:17.109977+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:04:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:18 smithi191 bash[24992]: audit 2024-08-31T05:04:17.878234+0000 mon.a (mon.0) 1702 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:04:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:18 smithi191 bash[24992]: audit 2024-08-31T05:04:17.879525+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:04:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:18 smithi191 bash[24992]: audit 2024-08-31T05:04:17.888006+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:04:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:18 smithi191 bash[24992]: audit 2024-08-31T05:04:17.890601+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:04:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:18 smithi163 bash[24253]: audit 2024-08-31T05:04:16.420831+0000 mgr.a (mgr.14388) 7482 : audit [DBG] from='client.169416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:18 smithi163 bash[24253]: audit 2024-08-31T05:04:17.104178+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:04:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:18 smithi163 bash[24253]: audit 2024-08-31T05:04:17.109977+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:04:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:18 smithi163 bash[24253]: audit 2024-08-31T05:04:17.878234+0000 mon.a (mon.0) 1702 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:04:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:18 smithi163 bash[24253]: audit 2024-08-31T05:04:17.879525+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:04:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:18 smithi163 bash[24253]: audit 2024-08-31T05:04:17.888006+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:04:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:18 smithi163 bash[24253]: audit 2024-08-31T05:04:17.890601+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:04:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:18 smithi027 bash[22610]: audit 2024-08-31T05:04:16.420831+0000 mgr.a (mgr.14388) 7482 : audit [DBG] from='client.169416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:18 smithi027 bash[22610]: audit 2024-08-31T05:04:17.104178+0000 mon.a (mon.0) 1700 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:04:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:18 smithi027 bash[22610]: audit 2024-08-31T05:04:17.109977+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:04:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:18 smithi027 bash[22610]: audit 2024-08-31T05:04:17.878234+0000 mon.a (mon.0) 1702 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:04:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:18 smithi027 bash[22610]: audit 2024-08-31T05:04:17.879525+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:04:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:18 smithi027 bash[22610]: audit 2024-08-31T05:04:17.888006+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:04:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:18 smithi027 bash[22610]: audit 2024-08-31T05:04:17.890601+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:04:18.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:04:18 smithi027 bash[22863]: debug 2024-08-31T05:04:18.592+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:04:18.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:04:18 smithi027 bash[22863]: debug 2024-08-31T05:04:18.592+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:04:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:19 smithi191 bash[24992]: audit 2024-08-31T05:04:17.891612+0000 mgr.a (mgr.14388) 7483 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:04:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:19 smithi191 bash[24992]: cluster 2024-08-31T05:04:17.950958+0000 mgr.a (mgr.14388) 7484 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:19 smithi163 bash[24253]: audit 2024-08-31T05:04:17.891612+0000 mgr.a (mgr.14388) 7483 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:04:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:19 smithi163 bash[24253]: cluster 2024-08-31T05:04:17.950958+0000 mgr.a (mgr.14388) 7484 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:19.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:19 smithi027 bash[22610]: audit 2024-08-31T05:04:17.891612+0000 mgr.a (mgr.14388) 7483 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:04:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:19 smithi027 bash[22610]: cluster 2024-08-31T05:04:17.950958+0000 mgr.a (mgr.14388) 7484 : cluster [DBG] pgmap v5187: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:20 smithi191 bash[24992]: audit 2024-08-31T05:04:18.595859+0000 mgr.a (mgr.14388) 7485 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:04:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:20 smithi191 bash[24992]: cephadm 2024-08-31T05:04:18.597332+0000 mgr.a (mgr.14388) 7486 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:04:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:20 smithi163 bash[24253]: audit 2024-08-31T05:04:18.595859+0000 mgr.a (mgr.14388) 7485 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:04:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:20 smithi163 bash[24253]: cephadm 2024-08-31T05:04:18.597332+0000 mgr.a (mgr.14388) 7486 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:04:20.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:20 smithi027 bash[22610]: audit 2024-08-31T05:04:18.595859+0000 mgr.a (mgr.14388) 7485 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:04:20.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:20 smithi027 bash[22610]: cephadm 2024-08-31T05:04:18.597332+0000 mgr.a (mgr.14388) 7486 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:04:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:21 smithi191 bash[24992]: cluster 2024-08-31T05:04:19.951809+0000 mgr.a (mgr.14388) 7487 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:21 smithi163 bash[24253]: cluster 2024-08-31T05:04:19.951809+0000 mgr.a (mgr.14388) 7487 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:21.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:21 smithi027 bash[22610]: cluster 2024-08-31T05:04:19.951809+0000 mgr.a (mgr.14388) 7487 : cluster [DBG] pgmap v5188: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:21.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:04:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:04:21.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:04:22.584 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:04:22.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:04:22.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:04:22.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:04:22.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:04:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:23 smithi191 bash[24992]: cluster 2024-08-31T05:04:21.952290+0000 mgr.a (mgr.14388) 7488 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:23 smithi163 bash[24253]: cluster 2024-08-31T05:04:21.952290+0000 mgr.a (mgr.14388) 7488 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:23 smithi027 bash[22610]: cluster 2024-08-31T05:04:21.952290+0000 mgr.a (mgr.14388) 7488 : cluster [DBG] pgmap v5189: 225 pgs: 225 active+clean; 589 KiB data, 146 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:24 smithi163 bash[24253]: audit 2024-08-31T05:04:22.178163+0000 mgr.a (mgr.14388) 7489 : audit [DBG] from='client.169602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:24.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:24 smithi027 bash[22610]: audit 2024-08-31T05:04:22.178163+0000 mgr.a (mgr.14388) 7489 : audit [DBG] from='client.169602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:24 smithi191 bash[24992]: audit 2024-08-31T05:04:22.178163+0000 mgr.a (mgr.14388) 7489 : audit [DBG] from='client.169602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:25 smithi163 bash[24253]: cluster 2024-08-31T05:04:23.954613+0000 mgr.a (mgr.14388) 7490 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:25.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:25 smithi027 bash[22610]: cluster 2024-08-31T05:04:23.954613+0000 mgr.a (mgr.14388) 7490 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:25 smithi191 bash[24992]: cluster 2024-08-31T05:04:23.954613+0000 mgr.a (mgr.14388) 7490 : cluster [DBG] pgmap v5190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:27 smithi163 bash[24253]: cluster 2024-08-31T05:04:25.955432+0000 mgr.a (mgr.14388) 7491 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:27.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:27 smithi027 bash[22610]: cluster 2024-08-31T05:04:25.955432+0000 mgr.a (mgr.14388) 7491 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:27 smithi191 bash[24992]: cluster 2024-08-31T05:04:25.955432+0000 mgr.a (mgr.14388) 7491 : cluster [DBG] pgmap v5191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:27.585 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:04:27.586 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:04:27.586 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:04:28.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:04:28.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:04:28.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:04:28.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:04:28.354 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:04:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:29 smithi163 bash[24253]: audit 2024-08-31T05:04:27.921333+0000 mgr.a (mgr.14388) 7492 : audit [DBG] from='client.169680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:29 smithi163 bash[24253]: cluster 2024-08-31T05:04:27.958594+0000 mgr.a (mgr.14388) 7493 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:29.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:29 smithi027 bash[22610]: audit 2024-08-31T05:04:27.921333+0000 mgr.a (mgr.14388) 7492 : audit [DBG] from='client.169680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:29.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:29 smithi027 bash[22610]: cluster 2024-08-31T05:04:27.958594+0000 mgr.a (mgr.14388) 7493 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:29 smithi191 bash[24992]: audit 2024-08-31T05:04:27.921333+0000 mgr.a (mgr.14388) 7492 : audit [DBG] from='client.169680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:29 smithi191 bash[24992]: cluster 2024-08-31T05:04:27.958594+0000 mgr.a (mgr.14388) 7493 : cluster [DBG] pgmap v5192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:31 smithi163 bash[24253]: cluster 2024-08-31T05:04:29.959676+0000 mgr.a (mgr.14388) 7494 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:04:31.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:31 smithi027 bash[22610]: cluster 2024-08-31T05:04:29.959676+0000 mgr.a (mgr.14388) 7494 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:04:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:31 smithi191 bash[24992]: cluster 2024-08-31T05:04:29.959676+0000 mgr.a (mgr.14388) 7494 : cluster [DBG] pgmap v5193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:04:33.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:04:33.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:04:33.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:04:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:33 smithi163 bash[24253]: cluster 2024-08-31T05:04:31.960475+0000 mgr.a (mgr.14388) 7495 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:04:33.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:33 smithi027 bash[22610]: cluster 2024-08-31T05:04:31.960475+0000 mgr.a (mgr.14388) 7495 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:04:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:33 smithi191 bash[24992]: cluster 2024-08-31T05:04:31.960475+0000 mgr.a (mgr.14388) 7495 : cluster [DBG] pgmap v5194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:04:34.088 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:04:34.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:04:34.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:04:34.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:04:34.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:04:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:35 smithi163 bash[24253]: audit 2024-08-31T05:04:33.679743+0000 mgr.a (mgr.14388) 7496 : audit [DBG] from='client.169755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:35 smithi163 bash[24253]: cluster 2024-08-31T05:04:33.962196+0000 mgr.a (mgr.14388) 7497 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:35.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:35 smithi027 bash[22610]: audit 2024-08-31T05:04:33.679743+0000 mgr.a (mgr.14388) 7496 : audit [DBG] from='client.169755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:35 smithi027 bash[22610]: cluster 2024-08-31T05:04:33.962196+0000 mgr.a (mgr.14388) 7497 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:35 smithi191 bash[24992]: audit 2024-08-31T05:04:33.679743+0000 mgr.a (mgr.14388) 7496 : audit [DBG] from='client.169755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:35 smithi191 bash[24992]: cluster 2024-08-31T05:04:33.962196+0000 mgr.a (mgr.14388) 7497 : cluster [DBG] pgmap v5195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:04:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:37 smithi163 bash[24253]: cluster 2024-08-31T05:04:35.963083+0000 mgr.a (mgr.14388) 7498 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:04:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:37 smithi027 bash[22610]: cluster 2024-08-31T05:04:35.963083+0000 mgr.a (mgr.14388) 7498 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:04:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:37 smithi191 bash[24992]: cluster 2024-08-31T05:04:35.963083+0000 mgr.a (mgr.14388) 7498 : cluster [DBG] pgmap v5196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:04:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:38 smithi163 bash[24253]: cluster 2024-08-31T05:04:37.965209+0000 mgr.a (mgr.14388) 7499 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:38.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:38 smithi027 bash[22610]: cluster 2024-08-31T05:04:37.965209+0000 mgr.a (mgr.14388) 7499 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:38 smithi191 bash[24992]: cluster 2024-08-31T05:04:37.965209+0000 mgr.a (mgr.14388) 7499 : cluster [DBG] pgmap v5197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:39.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:04:39.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:04:39.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:04:39.857 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:04:39.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:04:39.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:04:39.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:04:39.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:04:41.293 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:41 smithi191 bash[24992]: audit 2024-08-31T05:04:39.427625+0000 mgr.a (mgr.14388) 7500 : audit [DBG] from='client.169830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:41.293 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:41 smithi191 bash[24992]: cluster 2024-08-31T05:04:39.966137+0000 mgr.a (mgr.14388) 7501 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:41 smithi163 bash[24253]: audit 2024-08-31T05:04:39.427625+0000 mgr.a (mgr.14388) 7500 : audit [DBG] from='client.169830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:41 smithi163 bash[24253]: cluster 2024-08-31T05:04:39.966137+0000 mgr.a (mgr.14388) 7501 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:41.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:41 smithi027 bash[22610]: audit 2024-08-31T05:04:39.427625+0000 mgr.a (mgr.14388) 7500 : audit [DBG] from='client.169830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:41.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:41 smithi027 bash[22610]: cluster 2024-08-31T05:04:39.966137+0000 mgr.a (mgr.14388) 7501 : cluster [DBG] pgmap v5198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:43 smithi191 bash[24992]: cluster 2024-08-31T05:04:41.966969+0000 mgr.a (mgr.14388) 7502 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:43 smithi163 bash[24253]: cluster 2024-08-31T05:04:41.966969+0000 mgr.a (mgr.14388) 7502 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:43.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:43 smithi027 bash[22610]: cluster 2024-08-31T05:04:41.966969+0000 mgr.a (mgr.14388) 7502 : cluster [DBG] pgmap v5199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:44.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:04:44.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:04:44.860 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:04:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:45 smithi191 bash[24992]: cluster 2024-08-31T05:04:43.969198+0000 mgr.a (mgr.14388) 7503 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:45 smithi163 bash[24253]: cluster 2024-08-31T05:04:43.969198+0000 mgr.a (mgr.14388) 7503 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:45.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:45 smithi027 bash[22610]: cluster 2024-08-31T05:04:43.969198+0000 mgr.a (mgr.14388) 7503 : cluster [DBG] pgmap v5200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:45.620 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:04:45.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:04:45.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:04:45.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:04:45.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:04:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:47 smithi191 bash[24992]: audit 2024-08-31T05:04:45.192345+0000 mgr.a (mgr.14388) 7504 : audit [DBG] from='client.169908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:47 smithi191 bash[24992]: cluster 2024-08-31T05:04:45.970124+0000 mgr.a (mgr.14388) 7505 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:47 smithi163 bash[24253]: audit 2024-08-31T05:04:45.192345+0000 mgr.a (mgr.14388) 7504 : audit [DBG] from='client.169908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:47 smithi163 bash[24253]: cluster 2024-08-31T05:04:45.970124+0000 mgr.a (mgr.14388) 7505 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:47.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:47 smithi027 bash[22610]: audit 2024-08-31T05:04:45.192345+0000 mgr.a (mgr.14388) 7504 : audit [DBG] from='client.169908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:47.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:47 smithi027 bash[22610]: cluster 2024-08-31T05:04:45.970124+0000 mgr.a (mgr.14388) 7505 : cluster [DBG] pgmap v5201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:49 smithi163 bash[24253]: cluster 2024-08-31T05:04:47.972281+0000 mgr.a (mgr.14388) 7506 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:49.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:49 smithi027 bash[22610]: cluster 2024-08-31T05:04:47.972281+0000 mgr.a (mgr.14388) 7506 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:49 smithi191 bash[24992]: cluster 2024-08-31T05:04:47.972281+0000 mgr.a (mgr.14388) 7506 : cluster [DBG] pgmap v5202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:04:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:04:50.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:04:51.405 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:04:51.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:04:51.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:04:51.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:04:51.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:04:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:51 smithi163 bash[24253]: cluster 2024-08-31T05:04:49.973058+0000 mgr.a (mgr.14388) 7507 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:51.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:51 smithi027 bash[22610]: cluster 2024-08-31T05:04:49.973058+0000 mgr.a (mgr.14388) 7507 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:51 smithi191 bash[24992]: cluster 2024-08-31T05:04:49.973058+0000 mgr.a (mgr.14388) 7507 : cluster [DBG] pgmap v5203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:52 smithi163 bash[24253]: audit 2024-08-31T05:04:50.959839+0000 mgr.a (mgr.14388) 7508 : audit [DBG] from='client.169980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:52.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:52 smithi027 bash[22610]: audit 2024-08-31T05:04:50.959839+0000 mgr.a (mgr.14388) 7508 : audit [DBG] from='client.169980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:52 smithi191 bash[24992]: audit 2024-08-31T05:04:50.959839+0000 mgr.a (mgr.14388) 7508 : audit [DBG] from='client.169980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:53 smithi163 bash[24253]: cluster 2024-08-31T05:04:51.974046+0000 mgr.a (mgr.14388) 7509 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:53.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:53 smithi027 bash[22610]: cluster 2024-08-31T05:04:51.974046+0000 mgr.a (mgr.14388) 7509 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:53 smithi191 bash[24992]: cluster 2024-08-31T05:04:51.974046+0000 mgr.a (mgr.14388) 7509 : cluster [DBG] pgmap v5204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:55 smithi163 bash[24253]: cluster 2024-08-31T05:04:53.976329+0000 mgr.a (mgr.14388) 7510 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:55.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:55 smithi027 bash[22610]: cluster 2024-08-31T05:04:53.976329+0000 mgr.a (mgr.14388) 7510 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:55 smithi191 bash[24992]: cluster 2024-08-31T05:04:53.976329+0000 mgr.a (mgr.14388) 7510 : cluster [DBG] pgmap v5205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:56.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:04:56.407 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:04:56.407 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:04:57.172 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:04:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:04:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:04:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:04:57.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:04:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:57 smithi163 bash[24253]: cluster 2024-08-31T05:04:55.977145+0000 mgr.a (mgr.14388) 7511 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:57.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:57 smithi027 bash[22610]: cluster 2024-08-31T05:04:55.977145+0000 mgr.a (mgr.14388) 7511 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:57 smithi191 bash[24992]: cluster 2024-08-31T05:04:55.977145+0000 mgr.a (mgr.14388) 7511 : cluster [DBG] pgmap v5206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:04:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:58 smithi163 bash[24253]: audit 2024-08-31T05:04:56.743270+0000 mgr.a (mgr.14388) 7512 : audit [DBG] from='client.170055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:58.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:58 smithi027 bash[22610]: audit 2024-08-31T05:04:56.743270+0000 mgr.a (mgr.14388) 7512 : audit [DBG] from='client.170055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:58 smithi191 bash[24992]: audit 2024-08-31T05:04:56.743270+0000 mgr.a (mgr.14388) 7512 : audit [DBG] from='client.170055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:04:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:04:59 smithi163 bash[24253]: cluster 2024-08-31T05:04:57.979413+0000 mgr.a (mgr.14388) 7513 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:59.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:04:59 smithi027 bash[22610]: cluster 2024-08-31T05:04:57.979413+0000 mgr.a (mgr.14388) 7513 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:04:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:04:59 smithi191 bash[24992]: cluster 2024-08-31T05:04:57.979413+0000 mgr.a (mgr.14388) 7513 : cluster [DBG] pgmap v5207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:05:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:01 smithi163 bash[24253]: cluster 2024-08-31T05:04:59.980182+0000 mgr.a (mgr.14388) 7514 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:01.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:01 smithi027 bash[22610]: cluster 2024-08-31T05:04:59.980182+0000 mgr.a (mgr.14388) 7514 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:01 smithi191 bash[24992]: cluster 2024-08-31T05:04:59.980182+0000 mgr.a (mgr.14388) 7514 : cluster [DBG] pgmap v5208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:02.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:02.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:02.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:05:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:02 smithi163 bash[24253]: cluster 2024-08-31T05:05:01.980941+0000 mgr.a (mgr.14388) 7515 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:02.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:02 smithi027 bash[22610]: cluster 2024-08-31T05:05:01.980941+0000 mgr.a (mgr.14388) 7515 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:02 smithi191 bash[24992]: cluster 2024-08-31T05:05:01.980941+0000 mgr.a (mgr.14388) 7515 : cluster [DBG] pgmap v5209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:02.963 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:05:02.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:05:02.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:05:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:05:02.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:05:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:03 smithi163 bash[24253]: audit 2024-08-31T05:05:02.517863+0000 mgr.a (mgr.14388) 7516 : audit [DBG] from='client.170133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:03 smithi027 bash[22610]: audit 2024-08-31T05:05:02.517863+0000 mgr.a (mgr.14388) 7516 : audit [DBG] from='client.170133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:03 smithi191 bash[24992]: audit 2024-08-31T05:05:02.517863+0000 mgr.a (mgr.14388) 7516 : audit [DBG] from='client.170133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:04 smithi163 bash[24253]: cluster 2024-08-31T05:05:03.983342+0000 mgr.a (mgr.14388) 7517 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:05:04.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:04 smithi027 bash[22610]: cluster 2024-08-31T05:05:03.983342+0000 mgr.a (mgr.14388) 7517 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:05:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:04 smithi191 bash[24992]: cluster 2024-08-31T05:05:03.983342+0000 mgr.a (mgr.14388) 7517 : cluster [DBG] pgmap v5210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:05:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:07 smithi163 bash[24253]: cluster 2024-08-31T05:05:05.984091+0000 mgr.a (mgr.14388) 7518 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:05:07.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:07 smithi027 bash[22610]: cluster 2024-08-31T05:05:05.984091+0000 mgr.a (mgr.14388) 7518 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:05:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:07 smithi191 bash[24992]: cluster 2024-08-31T05:05:05.984091+0000 mgr.a (mgr.14388) 7518 : cluster [DBG] pgmap v5211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:05:07.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:07.966 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:07.966 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:05:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:08 smithi163 bash[24253]: cluster 2024-08-31T05:05:07.985946+0000 mgr.a (mgr.14388) 7519 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:08.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:08 smithi027 bash[22610]: cluster 2024-08-31T05:05:07.985946+0000 mgr.a (mgr.14388) 7519 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:08.738 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:05:08.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:05:08.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:05:08.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:05:08.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:05:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:08 smithi191 bash[24992]: cluster 2024-08-31T05:05:07.985946+0000 mgr.a (mgr.14388) 7519 : cluster [DBG] pgmap v5212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:09 smithi163 bash[24253]: audit 2024-08-31T05:05:08.308841+0000 mgr.a (mgr.14388) 7520 : audit [DBG] from='client.170211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:09.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:09 smithi027 bash[22610]: audit 2024-08-31T05:05:08.308841+0000 mgr.a (mgr.14388) 7520 : audit [DBG] from='client.170211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:09 smithi191 bash[24992]: audit 2024-08-31T05:05:08.308841+0000 mgr.a (mgr.14388) 7520 : audit [DBG] from='client.170211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:10 smithi163 bash[24253]: cluster 2024-08-31T05:05:09.986944+0000 mgr.a (mgr.14388) 7521 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:10.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:10 smithi027 bash[22610]: cluster 2024-08-31T05:05:09.986944+0000 mgr.a (mgr.14388) 7521 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:10 smithi191 bash[24992]: cluster 2024-08-31T05:05:09.986944+0000 mgr.a (mgr.14388) 7521 : cluster [DBG] pgmap v5213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:13 smithi163 bash[24253]: cluster 2024-08-31T05:05:11.987875+0000 mgr.a (mgr.14388) 7522 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:05:13.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:13 smithi027 bash[22610]: cluster 2024-08-31T05:05:11.987875+0000 mgr.a (mgr.14388) 7522 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:05:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:13 smithi191 bash[24992]: cluster 2024-08-31T05:05:11.987875+0000 mgr.a (mgr.14388) 7522 : cluster [DBG] pgmap v5214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:05:13.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:13.741 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:13.741 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:05:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:05:14.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:05:14.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:05:14.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:05:14.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:05:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:15 smithi163 bash[24253]: cluster 2024-08-31T05:05:13.990055+0000 mgr.a (mgr.14388) 7523 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:15 smithi163 bash[24253]: audit 2024-08-31T05:05:14.080620+0000 mgr.a (mgr.14388) 7524 : audit [DBG] from='client.170289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:15 smithi027 bash[22610]: cluster 2024-08-31T05:05:13.990055+0000 mgr.a (mgr.14388) 7523 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:15 smithi027 bash[22610]: audit 2024-08-31T05:05:14.080620+0000 mgr.a (mgr.14388) 7524 : audit [DBG] from='client.170289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:15 smithi191 bash[24992]: cluster 2024-08-31T05:05:13.990055+0000 mgr.a (mgr.14388) 7523 : cluster [DBG] pgmap v5215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:15 smithi191 bash[24992]: audit 2024-08-31T05:05:14.080620+0000 mgr.a (mgr.14388) 7524 : audit [DBG] from='client.170289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:17 smithi163 bash[24253]: cluster 2024-08-31T05:05:15.990954+0000 mgr.a (mgr.14388) 7525 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:05:17.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:17 smithi027 bash[22610]: cluster 2024-08-31T05:05:15.990954+0000 mgr.a (mgr.14388) 7525 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:05:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:17 smithi191 bash[24992]: cluster 2024-08-31T05:05:15.990954+0000 mgr.a (mgr.14388) 7525 : cluster [DBG] pgmap v5216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:05:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:19 smithi163 bash[24253]: cluster 2024-08-31T05:05:17.993131+0000 mgr.a (mgr.14388) 7526 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:05:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:19 smithi163 bash[24253]: audit 2024-08-31T05:05:18.652880+0000 mon.a (mon.0) 1706 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:05:19.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:19 smithi027 bash[22610]: cluster 2024-08-31T05:05:17.993131+0000 mgr.a (mgr.14388) 7526 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:05:19.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:19 smithi027 bash[22610]: audit 2024-08-31T05:05:18.652880+0000 mon.a (mon.0) 1706 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:05:19.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:19.494 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:19.494 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:05:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:19 smithi191 bash[24992]: cluster 2024-08-31T05:05:17.993131+0000 mgr.a (mgr.14388) 7526 : cluster [DBG] pgmap v5217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:05:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:19 smithi191 bash[24992]: audit 2024-08-31T05:05:18.652880+0000 mon.a (mon.0) 1706 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:05:20.313 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:05:20.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:05:20.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:05:20.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:05:20.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:05:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:20 smithi191 bash[24992]: audit 2024-08-31T05:05:19.273586+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:20 smithi191 bash[24992]: audit 2024-08-31T05:05:19.280078+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:20 smithi191 bash[24992]: audit 2024-08-31T05:05:19.285375+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:20 smithi191 bash[24992]: audit 2024-08-31T05:05:19.291011+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:20 smithi191 bash[24992]: audit 2024-08-31T05:05:19.825331+0000 mgr.a (mgr.14388) 7527 : audit [DBG] from='client.170367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:20 smithi191 bash[24992]: cluster 2024-08-31T05:05:19.993674+0000 mgr.a (mgr.14388) 7528 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:20 smithi191 bash[24992]: audit 2024-08-31T05:05:20.106846+0000 mon.a (mon.0) 1711 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:05:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:20 smithi191 bash[24992]: audit 2024-08-31T05:05:20.108382+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:05:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:20 smithi191 bash[24992]: audit 2024-08-31T05:05:20.117104+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:20 smithi191 bash[24992]: audit 2024-08-31T05:05:20.119659+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:05:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:20 smithi163 bash[24253]: audit 2024-08-31T05:05:19.273586+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:20 smithi163 bash[24253]: audit 2024-08-31T05:05:19.280078+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:20 smithi163 bash[24253]: audit 2024-08-31T05:05:19.285375+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:20 smithi163 bash[24253]: audit 2024-08-31T05:05:19.291011+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:20 smithi163 bash[24253]: audit 2024-08-31T05:05:19.825331+0000 mgr.a (mgr.14388) 7527 : audit [DBG] from='client.170367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:20 smithi163 bash[24253]: cluster 2024-08-31T05:05:19.993674+0000 mgr.a (mgr.14388) 7528 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:20 smithi163 bash[24253]: audit 2024-08-31T05:05:20.106846+0000 mon.a (mon.0) 1711 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:05:20.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:20 smithi163 bash[24253]: audit 2024-08-31T05:05:20.108382+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:05:20.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:20 smithi163 bash[24253]: audit 2024-08-31T05:05:20.117104+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:20 smithi163 bash[24253]: audit 2024-08-31T05:05:20.119659+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:05:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:20 smithi027 bash[22610]: audit 2024-08-31T05:05:19.273586+0000 mon.a (mon.0) 1707 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:20 smithi027 bash[22610]: audit 2024-08-31T05:05:19.280078+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:20 smithi027 bash[22610]: audit 2024-08-31T05:05:19.285375+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:20 smithi027 bash[22610]: audit 2024-08-31T05:05:19.291011+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:20 smithi027 bash[22610]: audit 2024-08-31T05:05:19.825331+0000 mgr.a (mgr.14388) 7527 : audit [DBG] from='client.170367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:20 smithi027 bash[22610]: cluster 2024-08-31T05:05:19.993674+0000 mgr.a (mgr.14388) 7528 : cluster [DBG] pgmap v5218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:20 smithi027 bash[22610]: audit 2024-08-31T05:05:20.106846+0000 mon.a (mon.0) 1711 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:05:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:20 smithi027 bash[22610]: audit 2024-08-31T05:05:20.108382+0000 mon.a (mon.0) 1712 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:05:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:20 smithi027 bash[22610]: audit 2024-08-31T05:05:20.117104+0000 mon.a (mon.0) 1713 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:05:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:20 smithi027 bash[22610]: audit 2024-08-31T05:05:20.119659+0000 mon.a (mon.0) 1714 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:05:21.292 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:05:21 smithi027 bash[22863]: debug 2024-08-31T05:05:21.014+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:05:21.292 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:05:21 smithi027 bash[22863]: debug 2024-08-31T05:05:21.014+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:05:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:21 smithi163 bash[24253]: audit 2024-08-31T05:05:20.121614+0000 mgr.a (mgr.14388) 7529 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:05:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:21 smithi163 bash[24253]: audit 2024-08-31T05:05:21.016220+0000 mgr.a (mgr.14388) 7530 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:05:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:21 smithi163 bash[24253]: cephadm 2024-08-31T05:05:21.017521+0000 mgr.a (mgr.14388) 7531 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:05:21.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:21 smithi027 bash[22610]: audit 2024-08-31T05:05:20.121614+0000 mgr.a (mgr.14388) 7529 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:05:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:21 smithi027 bash[22610]: audit 2024-08-31T05:05:21.016220+0000 mgr.a (mgr.14388) 7530 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:05:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:21 smithi027 bash[22610]: cephadm 2024-08-31T05:05:21.017521+0000 mgr.a (mgr.14388) 7531 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:05:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:21 smithi191 bash[24992]: audit 2024-08-31T05:05:20.121614+0000 mgr.a (mgr.14388) 7529 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:05:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:21 smithi191 bash[24992]: audit 2024-08-31T05:05:21.016220+0000 mgr.a (mgr.14388) 7530 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:05:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:21 smithi191 bash[24992]: cephadm 2024-08-31T05:05:21.017521+0000 mgr.a (mgr.14388) 7531 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:05:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:22 smithi163 bash[24253]: cluster 2024-08-31T05:05:21.994520+0000 mgr.a (mgr.14388) 7532 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:22.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:22 smithi027 bash[22610]: cluster 2024-08-31T05:05:21.994520+0000 mgr.a (mgr.14388) 7532 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:22 smithi191 bash[24992]: cluster 2024-08-31T05:05:21.994520+0000 mgr.a (mgr.14388) 7532 : cluster [DBG] pgmap v5219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:25.315 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:05:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:25 smithi163 bash[24253]: cluster 2024-08-31T05:05:23.996703+0000 mgr.a (mgr.14388) 7533 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:25.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:25 smithi027 bash[22610]: cluster 2024-08-31T05:05:23.996703+0000 mgr.a (mgr.14388) 7533 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:25 smithi191 bash[24992]: cluster 2024-08-31T05:05:23.996703+0000 mgr.a (mgr.14388) 7533 : cluster [DBG] pgmap v5220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:26.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:05:26.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:05:26.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:05:26.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:05:26.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:05:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:27 smithi163 bash[24253]: audit 2024-08-31T05:05:25.651226+0000 mgr.a (mgr.14388) 7534 : audit [DBG] from='client.170550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:27 smithi163 bash[24253]: cluster 2024-08-31T05:05:25.997286+0000 mgr.a (mgr.14388) 7535 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:27.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:27 smithi027 bash[22610]: audit 2024-08-31T05:05:25.651226+0000 mgr.a (mgr.14388) 7534 : audit [DBG] from='client.170550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:27 smithi027 bash[22610]: cluster 2024-08-31T05:05:25.997286+0000 mgr.a (mgr.14388) 7535 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:27 smithi191 bash[24992]: audit 2024-08-31T05:05:25.651226+0000 mgr.a (mgr.14388) 7534 : audit [DBG] from='client.170550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:27 smithi191 bash[24992]: cluster 2024-08-31T05:05:25.997286+0000 mgr.a (mgr.14388) 7535 : cluster [DBG] pgmap v5221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:29 smithi163 bash[24253]: cluster 2024-08-31T05:05:27.999431+0000 mgr.a (mgr.14388) 7536 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:29.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:29 smithi027 bash[22610]: cluster 2024-08-31T05:05:27.999431+0000 mgr.a (mgr.14388) 7536 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:29 smithi191 bash[24992]: cluster 2024-08-31T05:05:27.999431+0000 mgr.a (mgr.14388) 7536 : cluster [DBG] pgmap v5222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:31.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:31.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:05:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:31 smithi163 bash[24253]: cluster 2024-08-31T05:05:30.000205+0000 mgr.a (mgr.14388) 7537 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:31.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:31 smithi027 bash[22610]: cluster 2024-08-31T05:05:30.000205+0000 mgr.a (mgr.14388) 7537 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:31 smithi191 bash[24992]: cluster 2024-08-31T05:05:30.000205+0000 mgr.a (mgr.14388) 7537 : cluster [DBG] pgmap v5223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:31.802 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:05:31.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:05:31.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:05:31.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:05:31.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:05:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:33 smithi163 bash[24253]: audit 2024-08-31T05:05:31.396627+0000 mgr.a (mgr.14388) 7538 : audit [DBG] from='client.170628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:33 smithi163 bash[24253]: cluster 2024-08-31T05:05:32.001107+0000 mgr.a (mgr.14388) 7539 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:33.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:33 smithi027 bash[22610]: audit 2024-08-31T05:05:31.396627+0000 mgr.a (mgr.14388) 7538 : audit [DBG] from='client.170628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:33 smithi027 bash[22610]: cluster 2024-08-31T05:05:32.001107+0000 mgr.a (mgr.14388) 7539 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:33 smithi191 bash[24992]: audit 2024-08-31T05:05:31.396627+0000 mgr.a (mgr.14388) 7538 : audit [DBG] from='client.170628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:33 smithi191 bash[24992]: cluster 2024-08-31T05:05:32.001107+0000 mgr.a (mgr.14388) 7539 : cluster [DBG] pgmap v5224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:35 smithi163 bash[24253]: cluster 2024-08-31T05:05:34.003372+0000 mgr.a (mgr.14388) 7540 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:35.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:35 smithi027 bash[22610]: cluster 2024-08-31T05:05:34.003372+0000 mgr.a (mgr.14388) 7540 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:35 smithi191 bash[24992]: cluster 2024-08-31T05:05:34.003372+0000 mgr.a (mgr.14388) 7540 : cluster [DBG] pgmap v5225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:05:36.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:36.804 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:36.805 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:05:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:37 smithi163 bash[24253]: cluster 2024-08-31T05:05:36.004153+0000 mgr.a (mgr.14388) 7541 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:37 smithi027 bash[22610]: cluster 2024-08-31T05:05:36.004153+0000 mgr.a (mgr.14388) 7541 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:37 smithi191 bash[24992]: cluster 2024-08-31T05:05:36.004153+0000 mgr.a (mgr.14388) 7541 : cluster [DBG] pgmap v5226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:37.546 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:05:37.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:05:37.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:05:37.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:05:37.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:05:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:39 smithi163 bash[24253]: audit 2024-08-31T05:05:37.133635+0000 mgr.a (mgr.14388) 7542 : audit [DBG] from='client.170703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:39 smithi163 bash[24253]: cluster 2024-08-31T05:05:38.006383+0000 mgr.a (mgr.14388) 7543 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:05:39.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:39 smithi027 bash[22610]: audit 2024-08-31T05:05:37.133635+0000 mgr.a (mgr.14388) 7542 : audit [DBG] from='client.170703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:39.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:39 smithi027 bash[22610]: cluster 2024-08-31T05:05:38.006383+0000 mgr.a (mgr.14388) 7543 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:05:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:39 smithi191 bash[24992]: audit 2024-08-31T05:05:37.133635+0000 mgr.a (mgr.14388) 7542 : audit [DBG] from='client.170703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:39 smithi191 bash[24992]: cluster 2024-08-31T05:05:38.006383+0000 mgr.a (mgr.14388) 7543 : cluster [DBG] pgmap v5227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:05:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:41 smithi163 bash[24253]: cluster 2024-08-31T05:05:40.007309+0000 mgr.a (mgr.14388) 7544 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:41.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:41 smithi027 bash[22610]: cluster 2024-08-31T05:05:40.007309+0000 mgr.a (mgr.14388) 7544 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:41 smithi191 bash[24992]: cluster 2024-08-31T05:05:40.007309+0000 mgr.a (mgr.14388) 7544 : cluster [DBG] pgmap v5228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:42.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:42.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:42.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:05:43.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:05:43.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:05:43.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:05:43.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:05:43.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:05:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:43 smithi163 bash[24253]: cluster 2024-08-31T05:05:42.008280+0000 mgr.a (mgr.14388) 7545 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:43.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:43 smithi027 bash[22610]: cluster 2024-08-31T05:05:42.008280+0000 mgr.a (mgr.14388) 7545 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:43 smithi191 bash[24992]: cluster 2024-08-31T05:05:42.008280+0000 mgr.a (mgr.14388) 7545 : cluster [DBG] pgmap v5229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:44 smithi163 bash[24253]: audit 2024-08-31T05:05:42.879798+0000 mgr.a (mgr.14388) 7546 : audit [DBG] from='client.170781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:44.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:44 smithi027 bash[22610]: audit 2024-08-31T05:05:42.879798+0000 mgr.a (mgr.14388) 7546 : audit [DBG] from='client.170781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:44 smithi191 bash[24992]: audit 2024-08-31T05:05:42.879798+0000 mgr.a (mgr.14388) 7546 : audit [DBG] from='client.170781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:45 smithi163 bash[24253]: cluster 2024-08-31T05:05:44.011241+0000 mgr.a (mgr.14388) 7547 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:45.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:45 smithi027 bash[22610]: cluster 2024-08-31T05:05:44.011241+0000 mgr.a (mgr.14388) 7547 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:45 smithi191 bash[24992]: cluster 2024-08-31T05:05:44.011241+0000 mgr.a (mgr.14388) 7547 : cluster [DBG] pgmap v5230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:46 smithi163 bash[24253]: cluster 2024-08-31T05:05:46.012069+0000 mgr.a (mgr.14388) 7548 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:46.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:46 smithi027 bash[22610]: cluster 2024-08-31T05:05:46.012069+0000 mgr.a (mgr.14388) 7548 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:46 smithi191 bash[24992]: cluster 2024-08-31T05:05:46.012069+0000 mgr.a (mgr.14388) 7548 : cluster [DBG] pgmap v5231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:48.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:48.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:48.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:05:49.050 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:05:49.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:05:49.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:05:49.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:05:49.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:05:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:49 smithi163 bash[24253]: cluster 2024-08-31T05:05:48.013947+0000 mgr.a (mgr.14388) 7549 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:49.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:49 smithi027 bash[22610]: cluster 2024-08-31T05:05:48.013947+0000 mgr.a (mgr.14388) 7549 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:49 smithi191 bash[24992]: cluster 2024-08-31T05:05:48.013947+0000 mgr.a (mgr.14388) 7549 : cluster [DBG] pgmap v5232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:50 smithi163 bash[24253]: audit 2024-08-31T05:05:48.625900+0000 mgr.a (mgr.14388) 7550 : audit [DBG] from='client.170856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:50.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:50 smithi027 bash[22610]: audit 2024-08-31T05:05:48.625900+0000 mgr.a (mgr.14388) 7550 : audit [DBG] from='client.170856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:50 smithi191 bash[24992]: audit 2024-08-31T05:05:48.625900+0000 mgr.a (mgr.14388) 7550 : audit [DBG] from='client.170856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:51 smithi163 bash[24253]: cluster 2024-08-31T05:05:50.014942+0000 mgr.a (mgr.14388) 7551 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:51.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:51 smithi027 bash[22610]: cluster 2024-08-31T05:05:50.014942+0000 mgr.a (mgr.14388) 7551 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:51 smithi191 bash[24992]: cluster 2024-08-31T05:05:50.014942+0000 mgr.a (mgr.14388) 7551 : cluster [DBG] pgmap v5233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:53 smithi163 bash[24253]: cluster 2024-08-31T05:05:52.015726+0000 mgr.a (mgr.14388) 7552 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:53.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:53 smithi027 bash[22610]: cluster 2024-08-31T05:05:52.015726+0000 mgr.a (mgr.14388) 7552 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:53 smithi191 bash[24992]: cluster 2024-08-31T05:05:52.015726+0000 mgr.a (mgr.14388) 7552 : cluster [DBG] pgmap v5234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:05:54.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:54.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:54.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:05:54.837 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:05:54.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:05:54.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:05:54.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:05:54.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:05:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:55 smithi163 bash[24253]: cluster 2024-08-31T05:05:54.017933+0000 mgr.a (mgr.14388) 7553 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:55.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:55 smithi027 bash[22610]: cluster 2024-08-31T05:05:54.017933+0000 mgr.a (mgr.14388) 7553 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:55 smithi191 bash[24992]: cluster 2024-08-31T05:05:54.017933+0000 mgr.a (mgr.14388) 7553 : cluster [DBG] pgmap v5235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:56 smithi163 bash[24253]: audit 2024-08-31T05:05:54.391245+0000 mgr.a (mgr.14388) 7554 : audit [DBG] from='client.170934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:56.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:56 smithi027 bash[22610]: audit 2024-08-31T05:05:54.391245+0000 mgr.a (mgr.14388) 7554 : audit [DBG] from='client.170934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:56 smithi191 bash[24992]: audit 2024-08-31T05:05:54.391245+0000 mgr.a (mgr.14388) 7554 : audit [DBG] from='client.170934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:05:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:57 smithi163 bash[24253]: cluster 2024-08-31T05:05:56.018819+0000 mgr.a (mgr.14388) 7555 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:57.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:57 smithi027 bash[22610]: cluster 2024-08-31T05:05:56.018819+0000 mgr.a (mgr.14388) 7555 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:57 smithi191 bash[24992]: cluster 2024-08-31T05:05:56.018819+0000 mgr.a (mgr.14388) 7555 : cluster [DBG] pgmap v5236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:05:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:05:59 smithi163 bash[24253]: cluster 2024-08-31T05:05:58.020871+0000 mgr.a (mgr.14388) 7556 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:05:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:05:59 smithi027 bash[22610]: cluster 2024-08-31T05:05:58.020871+0000 mgr.a (mgr.14388) 7556 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:05:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:05:59 smithi191 bash[24992]: cluster 2024-08-31T05:05:58.020871+0000 mgr.a (mgr.14388) 7556 : cluster [DBG] pgmap v5237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:05:59.839 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:05:59.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:05:59.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:00.591 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:00.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:00.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:00.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:00.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:01 smithi163 bash[24253]: cluster 2024-08-31T05:06:00.021751+0000 mgr.a (mgr.14388) 7557 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:01.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:01 smithi027 bash[22610]: cluster 2024-08-31T05:06:00.021751+0000 mgr.a (mgr.14388) 7557 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:01 smithi191 bash[24992]: cluster 2024-08-31T05:06:00.021751+0000 mgr.a (mgr.14388) 7557 : cluster [DBG] pgmap v5238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:02 smithi163 bash[24253]: audit 2024-08-31T05:06:00.173766+0000 mgr.a (mgr.14388) 7558 : audit [DBG] from='client.171009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:02.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:02 smithi027 bash[22610]: audit 2024-08-31T05:06:00.173766+0000 mgr.a (mgr.14388) 7558 : audit [DBG] from='client.171009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:02 smithi191 bash[24992]: audit 2024-08-31T05:06:00.173766+0000 mgr.a (mgr.14388) 7558 : audit [DBG] from='client.171009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:03 smithi163 bash[24253]: cluster 2024-08-31T05:06:02.022846+0000 mgr.a (mgr.14388) 7559 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:03 smithi027 bash[22610]: cluster 2024-08-31T05:06:02.022846+0000 mgr.a (mgr.14388) 7559 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:03 smithi191 bash[24992]: cluster 2024-08-31T05:06:02.022846+0000 mgr.a (mgr.14388) 7559 : cluster [DBG] pgmap v5239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:04 smithi163 bash[24253]: cluster 2024-08-31T05:06:04.025106+0000 mgr.a (mgr.14388) 7560 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:04.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:04 smithi027 bash[22610]: cluster 2024-08-31T05:06:04.025106+0000 mgr.a (mgr.14388) 7560 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:04 smithi191 bash[24992]: cluster 2024-08-31T05:06:04.025106+0000 mgr.a (mgr.14388) 7560 : cluster [DBG] pgmap v5240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:05.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:06:05.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:06:05.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:06.357 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:06.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:06.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:06.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:06.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:07 smithi163 bash[24253]: audit 2024-08-31T05:06:05.935310+0000 mgr.a (mgr.14388) 7561 : audit [DBG] from='client.171087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:07 smithi163 bash[24253]: cluster 2024-08-31T05:06:06.025600+0000 mgr.a (mgr.14388) 7562 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:07.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:07 smithi027 bash[22610]: audit 2024-08-31T05:06:05.935310+0000 mgr.a (mgr.14388) 7561 : audit [DBG] from='client.171087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:07.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:07 smithi027 bash[22610]: cluster 2024-08-31T05:06:06.025600+0000 mgr.a (mgr.14388) 7562 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:07 smithi191 bash[24992]: audit 2024-08-31T05:06:05.935310+0000 mgr.a (mgr.14388) 7561 : audit [DBG] from='client.171087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:07 smithi191 bash[24992]: cluster 2024-08-31T05:06:06.025600+0000 mgr.a (mgr.14388) 7562 : cluster [DBG] pgmap v5241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:09 smithi163 bash[24253]: cluster 2024-08-31T05:06:08.027939+0000 mgr.a (mgr.14388) 7563 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:09.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:09 smithi027 bash[22610]: cluster 2024-08-31T05:06:08.027939+0000 mgr.a (mgr.14388) 7563 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:09 smithi191 bash[24992]: cluster 2024-08-31T05:06:08.027939+0000 mgr.a (mgr.14388) 7563 : cluster [DBG] pgmap v5242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:11.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:06:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:06:11.359 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:11 smithi163 bash[24253]: cluster 2024-08-31T05:06:10.028757+0000 mgr.a (mgr.14388) 7564 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:11.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:11 smithi027 bash[22610]: cluster 2024-08-31T05:06:10.028757+0000 mgr.a (mgr.14388) 7564 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:11 smithi191 bash[24992]: cluster 2024-08-31T05:06:10.028757+0000 mgr.a (mgr.14388) 7564 : cluster [DBG] pgmap v5243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:12.126 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:12.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:12.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:12.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:12.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:13 smithi163 bash[24253]: audit 2024-08-31T05:06:11.693561+0000 mgr.a (mgr.14388) 7565 : audit [DBG] from='client.171165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:13 smithi163 bash[24253]: cluster 2024-08-31T05:06:12.029536+0000 mgr.a (mgr.14388) 7566 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:13.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:13 smithi027 bash[22610]: audit 2024-08-31T05:06:11.693561+0000 mgr.a (mgr.14388) 7565 : audit [DBG] from='client.171165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:13 smithi027 bash[22610]: cluster 2024-08-31T05:06:12.029536+0000 mgr.a (mgr.14388) 7566 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:13 smithi191 bash[24992]: audit 2024-08-31T05:06:11.693561+0000 mgr.a (mgr.14388) 7565 : audit [DBG] from='client.171165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:13 smithi191 bash[24992]: cluster 2024-08-31T05:06:12.029536+0000 mgr.a (mgr.14388) 7566 : cluster [DBG] pgmap v5244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:15 smithi163 bash[24253]: cluster 2024-08-31T05:06:14.031881+0000 mgr.a (mgr.14388) 7567 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:15 smithi027 bash[22610]: cluster 2024-08-31T05:06:14.031881+0000 mgr.a (mgr.14388) 7567 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:15 smithi191 bash[24992]: cluster 2024-08-31T05:06:14.031881+0000 mgr.a (mgr.14388) 7567 : cluster [DBG] pgmap v5245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:17.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:06:17.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:06:17.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:17 smithi163 bash[24253]: cluster 2024-08-31T05:06:16.032817+0000 mgr.a (mgr.14388) 7568 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:17.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:17 smithi027 bash[22610]: cluster 2024-08-31T05:06:16.032817+0000 mgr.a (mgr.14388) 7568 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:17 smithi191 bash[24992]: cluster 2024-08-31T05:06:16.032817+0000 mgr.a (mgr.14388) 7568 : cluster [DBG] pgmap v5246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:17.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:17.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:17.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:17.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:17.879 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:19 smithi163 bash[24253]: audit 2024-08-31T05:06:17.457490+0000 mgr.a (mgr.14388) 7569 : audit [DBG] from='client.171243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:19 smithi163 bash[24253]: cluster 2024-08-31T05:06:18.035075+0000 mgr.a (mgr.14388) 7570 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:19.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:19 smithi027 bash[22610]: audit 2024-08-31T05:06:17.457490+0000 mgr.a (mgr.14388) 7569 : audit [DBG] from='client.171243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:19.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:19 smithi027 bash[22610]: cluster 2024-08-31T05:06:18.035075+0000 mgr.a (mgr.14388) 7570 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:19 smithi191 bash[24992]: audit 2024-08-31T05:06:17.457490+0000 mgr.a (mgr.14388) 7569 : audit [DBG] from='client.171243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:19 smithi191 bash[24992]: cluster 2024-08-31T05:06:18.035075+0000 mgr.a (mgr.14388) 7570 : cluster [DBG] pgmap v5247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:21 smithi163 bash[24253]: cluster 2024-08-31T05:06:20.035849+0000 mgr.a (mgr.14388) 7571 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:21 smithi163 bash[24253]: audit 2024-08-31T05:06:21.078167+0000 mon.a (mon.0) 1715 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:06:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:21 smithi027 bash[22610]: cluster 2024-08-31T05:06:20.035849+0000 mgr.a (mgr.14388) 7571 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:21 smithi027 bash[22610]: audit 2024-08-31T05:06:21.078167+0000 mon.a (mon.0) 1715 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:06:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:21 smithi191 bash[24992]: cluster 2024-08-31T05:06:20.035849+0000 mgr.a (mgr.14388) 7571 : cluster [DBG] pgmap v5248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:21 smithi191 bash[24992]: audit 2024-08-31T05:06:21.078167+0000 mon.a (mon.0) 1715 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:06:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:22 smithi163 bash[24253]: audit 2024-08-31T05:06:21.928311+0000 mon.a (mon.0) 1716 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:06:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:22 smithi163 bash[24253]: audit 2024-08-31T05:06:21.929992+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:06:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:22 smithi163 bash[24253]: audit 2024-08-31T05:06:21.940321+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:06:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:22 smithi163 bash[24253]: audit 2024-08-31T05:06:21.945855+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:06:22.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:22 smithi027 bash[22610]: audit 2024-08-31T05:06:21.928311+0000 mon.a (mon.0) 1716 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:06:22.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:22 smithi027 bash[22610]: audit 2024-08-31T05:06:21.929992+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:06:22.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:22 smithi027 bash[22610]: audit 2024-08-31T05:06:21.940321+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:06:22.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:22 smithi027 bash[22610]: audit 2024-08-31T05:06:21.945855+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:06:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:22 smithi191 bash[24992]: audit 2024-08-31T05:06:21.928311+0000 mon.a (mon.0) 1716 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:06:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:22 smithi191 bash[24992]: audit 2024-08-31T05:06:21.929992+0000 mon.a (mon.0) 1717 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:06:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:22 smithi191 bash[24992]: audit 2024-08-31T05:06:21.940321+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:06:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:22 smithi191 bash[24992]: audit 2024-08-31T05:06:21.945855+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:06:22.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:06:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:06:22.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:22.981 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:06:22 smithi027 bash[22863]: debug 2024-08-31T05:06:22.680+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:06:22.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:06:22 smithi027 bash[22863]: debug 2024-08-31T05:06:22.680+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:06:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:23 smithi163 bash[24253]: audit 2024-08-31T05:06:21.948152+0000 mgr.a (mgr.14388) 7572 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:06:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:23 smithi163 bash[24253]: cluster 2024-08-31T05:06:22.036418+0000 mgr.a (mgr.14388) 7573 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:23 smithi163 bash[24253]: audit 2024-08-31T05:06:22.683010+0000 mgr.a (mgr.14388) 7574 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:06:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:23 smithi163 bash[24253]: cephadm 2024-08-31T05:06:22.684735+0000 mgr.a (mgr.14388) 7575 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:06:23.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:23 smithi027 bash[22610]: audit 2024-08-31T05:06:21.948152+0000 mgr.a (mgr.14388) 7572 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:06:23.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:23 smithi027 bash[22610]: cluster 2024-08-31T05:06:22.036418+0000 mgr.a (mgr.14388) 7573 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:23.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:23 smithi027 bash[22610]: audit 2024-08-31T05:06:22.683010+0000 mgr.a (mgr.14388) 7574 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:06:23.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:23 smithi027 bash[22610]: cephadm 2024-08-31T05:06:22.684735+0000 mgr.a (mgr.14388) 7575 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:06:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:23 smithi191 bash[24992]: audit 2024-08-31T05:06:21.948152+0000 mgr.a (mgr.14388) 7572 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:06:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:23 smithi191 bash[24992]: cluster 2024-08-31T05:06:22.036418+0000 mgr.a (mgr.14388) 7573 : cluster [DBG] pgmap v5249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:23 smithi191 bash[24992]: audit 2024-08-31T05:06:22.683010+0000 mgr.a (mgr.14388) 7574 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:06:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:23 smithi191 bash[24992]: cephadm 2024-08-31T05:06:22.684735+0000 mgr.a (mgr.14388) 7575 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:06:23.631 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:23.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:23.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:23.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:23.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:24 smithi163 bash[24253]: audit 2024-08-31T05:06:23.219866+0000 mgr.a (mgr.14388) 7576 : audit [DBG] from='client.171426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:24 smithi163 bash[24253]: cluster 2024-08-31T05:06:24.039285+0000 mgr.a (mgr.14388) 7577 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:06:24.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:24 smithi027 bash[22610]: audit 2024-08-31T05:06:23.219866+0000 mgr.a (mgr.14388) 7576 : audit [DBG] from='client.171426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:24 smithi027 bash[22610]: cluster 2024-08-31T05:06:24.039285+0000 mgr.a (mgr.14388) 7577 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:06:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:24 smithi191 bash[24992]: audit 2024-08-31T05:06:23.219866+0000 mgr.a (mgr.14388) 7576 : audit [DBG] from='client.171426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:24 smithi191 bash[24992]: cluster 2024-08-31T05:06:24.039285+0000 mgr.a (mgr.14388) 7577 : cluster [DBG] pgmap v5250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:06:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:27 smithi163 bash[24253]: cluster 2024-08-31T05:06:26.040219+0000 mgr.a (mgr.14388) 7578 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:06:27.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:27 smithi027 bash[22610]: cluster 2024-08-31T05:06:26.040219+0000 mgr.a (mgr.14388) 7578 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:06:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:27 smithi191 bash[24992]: cluster 2024-08-31T05:06:26.040219+0000 mgr.a (mgr.14388) 7578 : cluster [DBG] pgmap v5251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:06:28.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:06:28.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:06:28.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:29.410 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:29.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:29.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:29.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:29.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:29 smithi163 bash[24253]: cluster 2024-08-31T05:06:28.042280+0000 mgr.a (mgr.14388) 7579 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:06:29.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:29 smithi027 bash[22610]: cluster 2024-08-31T05:06:28.042280+0000 mgr.a (mgr.14388) 7579 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:06:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:29 smithi191 bash[24992]: cluster 2024-08-31T05:06:28.042280+0000 mgr.a (mgr.14388) 7579 : cluster [DBG] pgmap v5252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:06:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:30 smithi163 bash[24253]: audit 2024-08-31T05:06:28.967992+0000 mgr.a (mgr.14388) 7580 : audit [DBG] from='client.171501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:30.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:30 smithi027 bash[22610]: audit 2024-08-31T05:06:28.967992+0000 mgr.a (mgr.14388) 7580 : audit [DBG] from='client.171501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:30 smithi191 bash[24992]: audit 2024-08-31T05:06:28.967992+0000 mgr.a (mgr.14388) 7580 : audit [DBG] from='client.171501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:31 smithi163 bash[24253]: cluster 2024-08-31T05:06:30.043317+0000 mgr.a (mgr.14388) 7581 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:06:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:31 smithi027 bash[22610]: cluster 2024-08-31T05:06:30.043317+0000 mgr.a (mgr.14388) 7581 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:06:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:31 smithi191 bash[24992]: cluster 2024-08-31T05:06:30.043317+0000 mgr.a (mgr.14388) 7581 : cluster [DBG] pgmap v5253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:06:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:33 smithi163 bash[24253]: cluster 2024-08-31T05:06:32.044146+0000 mgr.a (mgr.14388) 7582 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:06:33.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:33 smithi027 bash[22610]: cluster 2024-08-31T05:06:32.044146+0000 mgr.a (mgr.14388) 7582 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:06:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:33 smithi191 bash[24992]: cluster 2024-08-31T05:06:32.044146+0000 mgr.a (mgr.14388) 7582 : cluster [DBG] pgmap v5254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:06:34.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:06:34.412 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:06:34.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:34 smithi163 bash[24253]: cluster 2024-08-31T05:06:34.046354+0000 mgr.a (mgr.14388) 7583 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:06:34.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:34 smithi027 bash[22610]: cluster 2024-08-31T05:06:34.046354+0000 mgr.a (mgr.14388) 7583 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:06:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:34 smithi191 bash[24992]: cluster 2024-08-31T05:06:34.046354+0000 mgr.a (mgr.14388) 7583 : cluster [DBG] pgmap v5255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:06:35.170 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:35.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:35 smithi163 bash[24253]: audit 2024-08-31T05:06:34.747281+0000 mgr.a (mgr.14388) 7584 : audit [DBG] from='client.171579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:35.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:35 smithi027 bash[22610]: audit 2024-08-31T05:06:34.747281+0000 mgr.a (mgr.14388) 7584 : audit [DBG] from='client.171579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:35 smithi191 bash[24992]: audit 2024-08-31T05:06:34.747281+0000 mgr.a (mgr.14388) 7584 : audit [DBG] from='client.171579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:36 smithi163 bash[24253]: cluster 2024-08-31T05:06:36.047262+0000 mgr.a (mgr.14388) 7585 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:36.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:36 smithi027 bash[22610]: cluster 2024-08-31T05:06:36.047262+0000 mgr.a (mgr.14388) 7585 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:36 smithi191 bash[24992]: cluster 2024-08-31T05:06:36.047262+0000 mgr.a (mgr.14388) 7585 : cluster [DBG] pgmap v5256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:39 smithi163 bash[24253]: cluster 2024-08-31T05:06:38.049410+0000 mgr.a (mgr.14388) 7586 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:39.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:39 smithi027 bash[22610]: cluster 2024-08-31T05:06:38.049410+0000 mgr.a (mgr.14388) 7586 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:39 smithi191 bash[24992]: cluster 2024-08-31T05:06:38.049410+0000 mgr.a (mgr.14388) 7586 : cluster [DBG] pgmap v5257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:40.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:06:40.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:06:40.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:40.950 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:40.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:41 smithi163 bash[24253]: cluster 2024-08-31T05:06:40.050299+0000 mgr.a (mgr.14388) 7587 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:41.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:41 smithi027 bash[22610]: cluster 2024-08-31T05:06:40.050299+0000 mgr.a (mgr.14388) 7587 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:41 smithi191 bash[24992]: cluster 2024-08-31T05:06:40.050299+0000 mgr.a (mgr.14388) 7587 : cluster [DBG] pgmap v5258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:42 smithi163 bash[24253]: audit 2024-08-31T05:06:40.514140+0000 mgr.a (mgr.14388) 7588 : audit [DBG] from='client.171657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:42 smithi027 bash[22610]: audit 2024-08-31T05:06:40.514140+0000 mgr.a (mgr.14388) 7588 : audit [DBG] from='client.171657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:42 smithi191 bash[24992]: audit 2024-08-31T05:06:40.514140+0000 mgr.a (mgr.14388) 7588 : audit [DBG] from='client.171657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:43 smithi163 bash[24253]: cluster 2024-08-31T05:06:42.051239+0000 mgr.a (mgr.14388) 7589 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:43 smithi027 bash[22610]: cluster 2024-08-31T05:06:42.051239+0000 mgr.a (mgr.14388) 7589 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:43 smithi191 bash[24992]: cluster 2024-08-31T05:06:42.051239+0000 mgr.a (mgr.14388) 7589 : cluster [DBG] pgmap v5259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:44 smithi163 bash[24253]: cluster 2024-08-31T05:06:44.053439+0000 mgr.a (mgr.14388) 7590 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:44.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:44 smithi027 bash[22610]: cluster 2024-08-31T05:06:44.053439+0000 mgr.a (mgr.14388) 7590 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:44 smithi191 bash[24992]: cluster 2024-08-31T05:06:44.053439+0000 mgr.a (mgr.14388) 7590 : cluster [DBG] pgmap v5260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:45.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:06:45.953 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:06:45.953 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:46.697 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:46.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:46.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:46.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:46.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:47 smithi163 bash[24253]: cluster 2024-08-31T05:06:46.053860+0000 mgr.a (mgr.14388) 7591 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:47.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:47 smithi027 bash[22610]: cluster 2024-08-31T05:06:46.053860+0000 mgr.a (mgr.14388) 7591 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:47 smithi191 bash[24992]: cluster 2024-08-31T05:06:46.053860+0000 mgr.a (mgr.14388) 7591 : cluster [DBG] pgmap v5261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:48 smithi163 bash[24253]: audit 2024-08-31T05:06:46.280209+0000 mgr.a (mgr.14388) 7592 : audit [DBG] from='client.171732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:48.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:48 smithi027 bash[22610]: audit 2024-08-31T05:06:46.280209+0000 mgr.a (mgr.14388) 7592 : audit [DBG] from='client.171732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:48 smithi191 bash[24992]: audit 2024-08-31T05:06:46.280209+0000 mgr.a (mgr.14388) 7592 : audit [DBG] from='client.171732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:49 smithi163 bash[24253]: cluster 2024-08-31T05:06:48.056084+0000 mgr.a (mgr.14388) 7593 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:49.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:49 smithi027 bash[22610]: cluster 2024-08-31T05:06:48.056084+0000 mgr.a (mgr.14388) 7593 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:49 smithi191 bash[24992]: cluster 2024-08-31T05:06:48.056084+0000 mgr.a (mgr.14388) 7593 : cluster [DBG] pgmap v5262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:50 smithi163 bash[24253]: cluster 2024-08-31T05:06:50.056988+0000 mgr.a (mgr.14388) 7594 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:50.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:50 smithi027 bash[22610]: cluster 2024-08-31T05:06:50.056988+0000 mgr.a (mgr.14388) 7594 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:50 smithi191 bash[24992]: cluster 2024-08-31T05:06:50.056988+0000 mgr.a (mgr.14388) 7594 : cluster [DBG] pgmap v5263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:51.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:06:51.700 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:06:51.700 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:52.477 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:52.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:52.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:52.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:52.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:53 smithi163 bash[24253]: audit 2024-08-31T05:06:52.035630+0000 mgr.a (mgr.14388) 7595 : audit [DBG] from='client.171807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:53 smithi163 bash[24253]: cluster 2024-08-31T05:06:52.057985+0000 mgr.a (mgr.14388) 7596 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:53 smithi027 bash[22610]: audit 2024-08-31T05:06:52.035630+0000 mgr.a (mgr.14388) 7595 : audit [DBG] from='client.171807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:53 smithi027 bash[22610]: cluster 2024-08-31T05:06:52.057985+0000 mgr.a (mgr.14388) 7596 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:53 smithi191 bash[24992]: audit 2024-08-31T05:06:52.035630+0000 mgr.a (mgr.14388) 7595 : audit [DBG] from='client.171807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:53 smithi191 bash[24992]: cluster 2024-08-31T05:06:52.057985+0000 mgr.a (mgr.14388) 7596 : cluster [DBG] pgmap v5264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:55 smithi163 bash[24253]: cluster 2024-08-31T05:06:54.060296+0000 mgr.a (mgr.14388) 7597 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:55 smithi027 bash[22610]: cluster 2024-08-31T05:06:54.060296+0000 mgr.a (mgr.14388) 7597 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:55 smithi191 bash[24992]: cluster 2024-08-31T05:06:54.060296+0000 mgr.a (mgr.14388) 7597 : cluster [DBG] pgmap v5265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:06:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:56 smithi163 bash[24253]: cluster 2024-08-31T05:06:56.061069+0000 mgr.a (mgr.14388) 7598 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:56.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:56 smithi027 bash[22610]: cluster 2024-08-31T05:06:56.061069+0000 mgr.a (mgr.14388) 7598 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:56 smithi191 bash[24992]: cluster 2024-08-31T05:06:56.061069+0000 mgr.a (mgr.14388) 7598 : cluster [DBG] pgmap v5266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:57.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:06:57.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:06:57.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:06:58.229 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:06:58.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:06:58.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:06:58.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:06:58.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:06:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:59 smithi163 bash[24253]: audit 2024-08-31T05:06:57.811311+0000 mgr.a (mgr.14388) 7599 : audit [DBG] from='client.171885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:06:59 smithi163 bash[24253]: cluster 2024-08-31T05:06:58.062391+0000 mgr.a (mgr.14388) 7600 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:59 smithi027 bash[22610]: audit 2024-08-31T05:06:57.811311+0000 mgr.a (mgr.14388) 7599 : audit [DBG] from='client.171885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:06:59 smithi027 bash[22610]: cluster 2024-08-31T05:06:58.062391+0000 mgr.a (mgr.14388) 7600 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:06:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:59 smithi191 bash[24992]: audit 2024-08-31T05:06:57.811311+0000 mgr.a (mgr.14388) 7599 : audit [DBG] from='client.171885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:06:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:06:59 smithi191 bash[24992]: cluster 2024-08-31T05:06:58.062391+0000 mgr.a (mgr.14388) 7600 : cluster [DBG] pgmap v5267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:01 smithi163 bash[24253]: cluster 2024-08-31T05:07:00.063256+0000 mgr.a (mgr.14388) 7601 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:01 smithi027 bash[22610]: cluster 2024-08-31T05:07:00.063256+0000 mgr.a (mgr.14388) 7601 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:01 smithi191 bash[24992]: cluster 2024-08-31T05:07:00.063256+0000 mgr.a (mgr.14388) 7601 : cluster [DBG] pgmap v5268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:02 smithi163 bash[24253]: cluster 2024-08-31T05:07:02.064042+0000 mgr.a (mgr.14388) 7602 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:02.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:02 smithi027 bash[22610]: cluster 2024-08-31T05:07:02.064042+0000 mgr.a (mgr.14388) 7602 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:02 smithi191 bash[24992]: cluster 2024-08-31T05:07:02.064042+0000 mgr.a (mgr.14388) 7602 : cluster [DBG] pgmap v5269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:03.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:07:03.231 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:07:03.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:07:03.986 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:07:03.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:07:03.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:07:03.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:07:03.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:07:04.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:04 smithi163 bash[24253]: audit 2024-08-31T05:07:03.566604+0000 mgr.a (mgr.14388) 7603 : audit [DBG] from='client.171963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:04.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:04 smithi163 bash[24253]: cluster 2024-08-31T05:07:04.066793+0000 mgr.a (mgr.14388) 7604 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:04 smithi027 bash[22610]: audit 2024-08-31T05:07:03.566604+0000 mgr.a (mgr.14388) 7603 : audit [DBG] from='client.171963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:04 smithi027 bash[22610]: cluster 2024-08-31T05:07:04.066793+0000 mgr.a (mgr.14388) 7604 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:04 smithi191 bash[24992]: audit 2024-08-31T05:07:03.566604+0000 mgr.a (mgr.14388) 7603 : audit [DBG] from='client.171963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:04 smithi191 bash[24992]: cluster 2024-08-31T05:07:04.066793+0000 mgr.a (mgr.14388) 7604 : cluster [DBG] pgmap v5270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:06 smithi163 bash[24253]: cluster 2024-08-31T05:07:06.067575+0000 mgr.a (mgr.14388) 7605 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:07:06.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:06 smithi027 bash[22610]: cluster 2024-08-31T05:07:06.067575+0000 mgr.a (mgr.14388) 7605 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:07:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:06 smithi191 bash[24992]: cluster 2024-08-31T05:07:06.067575+0000 mgr.a (mgr.14388) 7605 : cluster [DBG] pgmap v5271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:07:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:08 smithi163 bash[24253]: cluster 2024-08-31T05:07:08.069469+0000 mgr.a (mgr.14388) 7606 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:08 smithi027 bash[22610]: cluster 2024-08-31T05:07:08.069469+0000 mgr.a (mgr.14388) 7606 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:08 smithi191 bash[24992]: cluster 2024-08-31T05:07:08.069469+0000 mgr.a (mgr.14388) 7606 : cluster [DBG] pgmap v5272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:08.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:07:08.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:07:08.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:07:09.772 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:07:09.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:07:09.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:07:09.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:07:09.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:07:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:10 smithi163 bash[24253]: audit 2024-08-31T05:07:09.327071+0000 mgr.a (mgr.14388) 7607 : audit [DBG] from='client.172041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:10 smithi163 bash[24253]: cluster 2024-08-31T05:07:10.070379+0000 mgr.a (mgr.14388) 7608 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:10.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:10 smithi027 bash[22610]: audit 2024-08-31T05:07:09.327071+0000 mgr.a (mgr.14388) 7607 : audit [DBG] from='client.172041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:10 smithi027 bash[22610]: cluster 2024-08-31T05:07:10.070379+0000 mgr.a (mgr.14388) 7608 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:10 smithi191 bash[24992]: audit 2024-08-31T05:07:09.327071+0000 mgr.a (mgr.14388) 7607 : audit [DBG] from='client.172041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:10 smithi191 bash[24992]: cluster 2024-08-31T05:07:10.070379+0000 mgr.a (mgr.14388) 7608 : cluster [DBG] pgmap v5273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:12 smithi163 bash[24253]: cluster 2024-08-31T05:07:12.071189+0000 mgr.a (mgr.14388) 7609 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:12.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:12 smithi027 bash[22610]: cluster 2024-08-31T05:07:12.071189+0000 mgr.a (mgr.14388) 7609 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:12 smithi191 bash[24992]: cluster 2024-08-31T05:07:12.071189+0000 mgr.a (mgr.14388) 7609 : cluster [DBG] pgmap v5274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:14 smithi163 bash[24253]: cluster 2024-08-31T05:07:14.073330+0000 mgr.a (mgr.14388) 7610 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:14.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:14 smithi027 bash[22610]: cluster 2024-08-31T05:07:14.073330+0000 mgr.a (mgr.14388) 7610 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:14 smithi191 bash[24992]: cluster 2024-08-31T05:07:14.073330+0000 mgr.a (mgr.14388) 7610 : cluster [DBG] pgmap v5275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:14.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:07:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:07:14.775 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:07:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:15 smithi163 bash[24253]: audit 2024-08-31T05:07:15.110464+0000 mgr.a (mgr.14388) 7611 : audit [DBG] from='client.172116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:15.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:15 smithi027 bash[22610]: audit 2024-08-31T05:07:15.110464+0000 mgr.a (mgr.14388) 7611 : audit [DBG] from='client.172116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:15 smithi191 bash[24992]: audit 2024-08-31T05:07:15.110464+0000 mgr.a (mgr.14388) 7611 : audit [DBG] from='client.172116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:15.551 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:07:15.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:07:15.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:07:15.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:07:15.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:07:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:16 smithi163 bash[24253]: cluster 2024-08-31T05:07:16.074209+0000 mgr.a (mgr.14388) 7612 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:16 smithi027 bash[22610]: cluster 2024-08-31T05:07:16.074209+0000 mgr.a (mgr.14388) 7612 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:16 smithi191 bash[24992]: cluster 2024-08-31T05:07:16.074209+0000 mgr.a (mgr.14388) 7612 : cluster [DBG] pgmap v5276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:18 smithi163 bash[24253]: cluster 2024-08-31T05:07:18.076327+0000 mgr.a (mgr.14388) 7613 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:18 smithi027 bash[22610]: cluster 2024-08-31T05:07:18.076327+0000 mgr.a (mgr.14388) 7613 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:18 smithi191 bash[24992]: cluster 2024-08-31T05:07:18.076327+0000 mgr.a (mgr.14388) 7613 : cluster [DBG] pgmap v5277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:20 smithi163 bash[24253]: cluster 2024-08-31T05:07:20.077085+0000 mgr.a (mgr.14388) 7614 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:20 smithi027 bash[22610]: cluster 2024-08-31T05:07:20.077085+0000 mgr.a (mgr.14388) 7614 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:20 smithi191 bash[24992]: cluster 2024-08-31T05:07:20.077085+0000 mgr.a (mgr.14388) 7614 : cluster [DBG] pgmap v5278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:20.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:07:20.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:07:20.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:07:21.333 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:07:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:07:21.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:07:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:07:21.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:07:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:21 smithi163 bash[24253]: audit 2024-08-31T05:07:20.894331+0000 mgr.a (mgr.14388) 7615 : audit [DBG] from='client.172194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:21 smithi027 bash[22610]: audit 2024-08-31T05:07:20.894331+0000 mgr.a (mgr.14388) 7615 : audit [DBG] from='client.172194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:21 smithi191 bash[24992]: audit 2024-08-31T05:07:20.894331+0000 mgr.a (mgr.14388) 7615 : audit [DBG] from='client.172194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:22 smithi163 bash[24253]: cluster 2024-08-31T05:07:22.077958+0000 mgr.a (mgr.14388) 7616 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:22.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:22 smithi027 bash[22610]: cluster 2024-08-31T05:07:22.077958+0000 mgr.a (mgr.14388) 7616 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:22 smithi191 bash[24992]: cluster 2024-08-31T05:07:22.077958+0000 mgr.a (mgr.14388) 7616 : cluster [DBG] pgmap v5279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:23 smithi163 bash[24253]: audit 2024-08-31T05:07:22.738166+0000 mon.a (mon.0) 1720 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:07:23.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:23 smithi027 bash[22610]: audit 2024-08-31T05:07:22.738166+0000 mon.a (mon.0) 1720 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:07:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:23 smithi191 bash[24992]: audit 2024-08-31T05:07:22.738166+0000 mon.a (mon.0) 1720 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:07:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:24 smithi163 bash[24253]: audit 2024-08-31T05:07:23.596599+0000 mon.a (mon.0) 1721 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:07:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:24 smithi163 bash[24253]: audit 2024-08-31T05:07:23.598004+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:07:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:24 smithi163 bash[24253]: audit 2024-08-31T05:07:23.604519+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:07:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:24 smithi163 bash[24253]: audit 2024-08-31T05:07:23.606840+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:07:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:24 smithi163 bash[24253]: audit 2024-08-31T05:07:23.609282+0000 mgr.a (mgr.14388) 7617 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:07:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:24 smithi163 bash[24253]: cluster 2024-08-31T05:07:24.079802+0000 mgr.a (mgr.14388) 7618 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:24.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:07:24 smithi027 bash[22863]: debug 2024-08-31T05:07:24.323+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:07:24.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:07:24 smithi027 bash[22863]: debug 2024-08-31T05:07:24.327+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:07:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:24 smithi027 bash[22610]: audit 2024-08-31T05:07:23.596599+0000 mon.a (mon.0) 1721 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:07:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:24 smithi027 bash[22610]: audit 2024-08-31T05:07:23.598004+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:07:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:24 smithi027 bash[22610]: audit 2024-08-31T05:07:23.604519+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:07:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:24 smithi027 bash[22610]: audit 2024-08-31T05:07:23.606840+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:07:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:24 smithi027 bash[22610]: audit 2024-08-31T05:07:23.609282+0000 mgr.a (mgr.14388) 7617 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:07:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:24 smithi027 bash[22610]: cluster 2024-08-31T05:07:24.079802+0000 mgr.a (mgr.14388) 7618 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:24 smithi191 bash[24992]: audit 2024-08-31T05:07:23.596599+0000 mon.a (mon.0) 1721 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:07:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:24 smithi191 bash[24992]: audit 2024-08-31T05:07:23.598004+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:07:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:24 smithi191 bash[24992]: audit 2024-08-31T05:07:23.604519+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:07:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:24 smithi191 bash[24992]: audit 2024-08-31T05:07:23.606840+0000 mon.a (mon.0) 1724 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:07:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:24 smithi191 bash[24992]: audit 2024-08-31T05:07:23.609282+0000 mgr.a (mgr.14388) 7617 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:07:24.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:24 smithi191 bash[24992]: cluster 2024-08-31T05:07:24.079802+0000 mgr.a (mgr.14388) 7618 : cluster [DBG] pgmap v5280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:25 smithi163 bash[24253]: audit 2024-08-31T05:07:24.330503+0000 mgr.a (mgr.14388) 7619 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:07:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:25 smithi163 bash[24253]: cephadm 2024-08-31T05:07:24.332017+0000 mgr.a (mgr.14388) 7620 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:07:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:25 smithi027 bash[22610]: audit 2024-08-31T05:07:24.330503+0000 mgr.a (mgr.14388) 7619 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:07:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:25 smithi027 bash[22610]: cephadm 2024-08-31T05:07:24.332017+0000 mgr.a (mgr.14388) 7620 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:07:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:25 smithi191 bash[24992]: audit 2024-08-31T05:07:24.330503+0000 mgr.a (mgr.14388) 7619 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:07:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:25 smithi191 bash[24992]: cephadm 2024-08-31T05:07:24.332017+0000 mgr.a (mgr.14388) 7620 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:07:26.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:07:26.336 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:07:26.336 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:07:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:26 smithi163 bash[24253]: cluster 2024-08-31T05:07:26.080812+0000 mgr.a (mgr.14388) 7621 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:26.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:26 smithi027 bash[22610]: cluster 2024-08-31T05:07:26.080812+0000 mgr.a (mgr.14388) 7621 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:26 smithi191 bash[24992]: cluster 2024-08-31T05:07:26.080812+0000 mgr.a (mgr.14388) 7621 : cluster [DBG] pgmap v5281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:27.112 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:07:27.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:07:27.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:07:27.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:07:27.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:07:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:27 smithi163 bash[24253]: audit 2024-08-31T05:07:26.669544+0000 mgr.a (mgr.14388) 7622 : audit [DBG] from='client.172377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:27 smithi027 bash[22610]: audit 2024-08-31T05:07:26.669544+0000 mgr.a (mgr.14388) 7622 : audit [DBG] from='client.172377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:27 smithi191 bash[24992]: audit 2024-08-31T05:07:26.669544+0000 mgr.a (mgr.14388) 7622 : audit [DBG] from='client.172377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:28 smithi163 bash[24253]: cluster 2024-08-31T05:07:28.083108+0000 mgr.a (mgr.14388) 7623 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:28.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:28 smithi027 bash[22610]: cluster 2024-08-31T05:07:28.083108+0000 mgr.a (mgr.14388) 7623 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:28 smithi191 bash[24992]: cluster 2024-08-31T05:07:28.083108+0000 mgr.a (mgr.14388) 7623 : cluster [DBG] pgmap v5282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:30 smithi163 bash[24253]: cluster 2024-08-31T05:07:30.083876+0000 mgr.a (mgr.14388) 7624 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:30 smithi027 bash[22610]: cluster 2024-08-31T05:07:30.083876+0000 mgr.a (mgr.14388) 7624 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:30 smithi191 bash[24992]: cluster 2024-08-31T05:07:30.083876+0000 mgr.a (mgr.14388) 7624 : cluster [DBG] pgmap v5283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:32.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:07:32.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:07:32.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:07:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:32 smithi163 bash[24253]: cluster 2024-08-31T05:07:32.084633+0000 mgr.a (mgr.14388) 7625 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:32.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:32 smithi027 bash[22610]: cluster 2024-08-31T05:07:32.084633+0000 mgr.a (mgr.14388) 7625 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:32 smithi191 bash[24992]: cluster 2024-08-31T05:07:32.084633+0000 mgr.a (mgr.14388) 7625 : cluster [DBG] pgmap v5284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:32.888 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:07:32.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:07:32.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:07:32.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:07:32.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:07:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:33 smithi163 bash[24253]: audit 2024-08-31T05:07:32.453329+0000 mgr.a (mgr.14388) 7626 : audit [DBG] from='client.172455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:33.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:33 smithi027 bash[22610]: audit 2024-08-31T05:07:32.453329+0000 mgr.a (mgr.14388) 7626 : audit [DBG] from='client.172455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:33 smithi191 bash[24992]: audit 2024-08-31T05:07:32.453329+0000 mgr.a (mgr.14388) 7626 : audit [DBG] from='client.172455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:34 smithi163 bash[24253]: cluster 2024-08-31T05:07:34.086950+0000 mgr.a (mgr.14388) 7627 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:34 smithi027 bash[22610]: cluster 2024-08-31T05:07:34.086950+0000 mgr.a (mgr.14388) 7627 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:34 smithi191 bash[24992]: cluster 2024-08-31T05:07:34.086950+0000 mgr.a (mgr.14388) 7627 : cluster [DBG] pgmap v5285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:36 smithi163 bash[24253]: cluster 2024-08-31T05:07:36.087691+0000 mgr.a (mgr.14388) 7628 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:36 smithi027 bash[22610]: cluster 2024-08-31T05:07:36.087691+0000 mgr.a (mgr.14388) 7628 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:36 smithi191 bash[24992]: cluster 2024-08-31T05:07:36.087691+0000 mgr.a (mgr.14388) 7628 : cluster [DBG] pgmap v5286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:37.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:07:37.890 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:07:37.890 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:07:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:38 smithi163 bash[24253]: cluster 2024-08-31T05:07:38.089635+0000 mgr.a (mgr.14388) 7629 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:38.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:38 smithi027 bash[22610]: cluster 2024-08-31T05:07:38.089635+0000 mgr.a (mgr.14388) 7629 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:38 smithi191 bash[24992]: cluster 2024-08-31T05:07:38.089635+0000 mgr.a (mgr.14388) 7629 : cluster [DBG] pgmap v5287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:07:38.679 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:07:38.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:07:38.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:07:38.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:07:38.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:07:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:39 smithi163 bash[24253]: audit 2024-08-31T05:07:38.234764+0000 mgr.a (mgr.14388) 7630 : audit [DBG] from='client.172533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:39 smithi027 bash[22610]: audit 2024-08-31T05:07:38.234764+0000 mgr.a (mgr.14388) 7630 : audit [DBG] from='client.172533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:39 smithi191 bash[24992]: audit 2024-08-31T05:07:38.234764+0000 mgr.a (mgr.14388) 7630 : audit [DBG] from='client.172533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:40 smithi163 bash[24253]: cluster 2024-08-31T05:07:40.090561+0000 mgr.a (mgr.14388) 7631 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:07:40.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:40 smithi027 bash[22610]: cluster 2024-08-31T05:07:40.090561+0000 mgr.a (mgr.14388) 7631 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:07:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:40 smithi191 bash[24992]: cluster 2024-08-31T05:07:40.090561+0000 mgr.a (mgr.14388) 7631 : cluster [DBG] pgmap v5288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:07:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:42 smithi163 bash[24253]: cluster 2024-08-31T05:07:42.091342+0000 mgr.a (mgr.14388) 7632 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:42.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:42 smithi027 bash[22610]: cluster 2024-08-31T05:07:42.091342+0000 mgr.a (mgr.14388) 7632 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:42 smithi191 bash[24992]: cluster 2024-08-31T05:07:42.091342+0000 mgr.a (mgr.14388) 7632 : cluster [DBG] pgmap v5289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:43.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:07:43.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:07:43.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:07:44.422 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:07:44.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:07:44.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:07:44.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:07:44.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:07:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:44 smithi163 bash[24253]: audit 2024-08-31T05:07:44.014234+0000 mgr.a (mgr.14388) 7633 : audit [DBG] from='client.172611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:44 smithi163 bash[24253]: cluster 2024-08-31T05:07:44.092759+0000 mgr.a (mgr.14388) 7634 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:44.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:44 smithi027 bash[22610]: audit 2024-08-31T05:07:44.014234+0000 mgr.a (mgr.14388) 7633 : audit [DBG] from='client.172611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:44 smithi027 bash[22610]: cluster 2024-08-31T05:07:44.092759+0000 mgr.a (mgr.14388) 7634 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:44 smithi191 bash[24992]: audit 2024-08-31T05:07:44.014234+0000 mgr.a (mgr.14388) 7633 : audit [DBG] from='client.172611 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:44 smithi191 bash[24992]: cluster 2024-08-31T05:07:44.092759+0000 mgr.a (mgr.14388) 7634 : cluster [DBG] pgmap v5290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:46 smithi163 bash[24253]: cluster 2024-08-31T05:07:46.093624+0000 mgr.a (mgr.14388) 7635 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:46.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:46 smithi027 bash[22610]: cluster 2024-08-31T05:07:46.093624+0000 mgr.a (mgr.14388) 7635 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:46 smithi191 bash[24992]: cluster 2024-08-31T05:07:46.093624+0000 mgr.a (mgr.14388) 7635 : cluster [DBG] pgmap v5291: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:07:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:48 smithi163 bash[24253]: cluster 2024-08-31T05:07:48.095791+0000 mgr.a (mgr.14388) 7636 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:48.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:48 smithi027 bash[22610]: cluster 2024-08-31T05:07:48.095791+0000 mgr.a (mgr.14388) 7636 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:48 smithi191 bash[24992]: cluster 2024-08-31T05:07:48.095791+0000 mgr.a (mgr.14388) 7636 : cluster [DBG] pgmap v5292: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:49.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:07:49.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:07:49.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:07:50.167 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:07:50.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:07:50.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:07:50.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:07:50.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:07:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:50 smithi163 bash[24253]: audit 2024-08-31T05:07:49.752225+0000 mgr.a (mgr.14388) 7637 : audit [DBG] from='client.172686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:50.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:50 smithi163 bash[24253]: cluster 2024-08-31T05:07:50.096301+0000 mgr.a (mgr.14388) 7638 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:50 smithi027 bash[22610]: audit 2024-08-31T05:07:49.752225+0000 mgr.a (mgr.14388) 7637 : audit [DBG] from='client.172686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:50 smithi027 bash[22610]: cluster 2024-08-31T05:07:50.096301+0000 mgr.a (mgr.14388) 7638 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:50 smithi191 bash[24992]: audit 2024-08-31T05:07:49.752225+0000 mgr.a (mgr.14388) 7637 : audit [DBG] from='client.172686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:50 smithi191 bash[24992]: cluster 2024-08-31T05:07:50.096301+0000 mgr.a (mgr.14388) 7638 : cluster [DBG] pgmap v5293: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:52 smithi163 bash[24253]: cluster 2024-08-31T05:07:52.097194+0000 mgr.a (mgr.14388) 7639 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:52.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:52 smithi027 bash[22610]: cluster 2024-08-31T05:07:52.097194+0000 mgr.a (mgr.14388) 7639 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:52 smithi191 bash[24992]: cluster 2024-08-31T05:07:52.097194+0000 mgr.a (mgr.14388) 7639 : cluster [DBG] pgmap v5294: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:54 smithi163 bash[24253]: cluster 2024-08-31T05:07:54.099422+0000 mgr.a (mgr.14388) 7640 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:54.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:54 smithi027 bash[22610]: cluster 2024-08-31T05:07:54.099422+0000 mgr.a (mgr.14388) 7640 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:54 smithi191 bash[24992]: cluster 2024-08-31T05:07:54.099422+0000 mgr.a (mgr.14388) 7640 : cluster [DBG] pgmap v5295: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:55.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:07:55.170 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:07:55.170 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:07:55.923 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:07:55.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:07:55.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:07:55.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:07:55.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:07:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:56 smithi163 bash[24253]: audit 2024-08-31T05:07:55.503470+0000 mgr.a (mgr.14388) 7641 : audit [DBG] from='client.172764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:56.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:56 smithi163 bash[24253]: cluster 2024-08-31T05:07:56.100365+0000 mgr.a (mgr.14388) 7642 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:56 smithi027 bash[22610]: audit 2024-08-31T05:07:55.503470+0000 mgr.a (mgr.14388) 7641 : audit [DBG] from='client.172764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:56 smithi027 bash[22610]: cluster 2024-08-31T05:07:56.100365+0000 mgr.a (mgr.14388) 7642 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:56 smithi191 bash[24992]: audit 2024-08-31T05:07:55.503470+0000 mgr.a (mgr.14388) 7641 : audit [DBG] from='client.172764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:07:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:56 smithi191 bash[24992]: cluster 2024-08-31T05:07:56.100365+0000 mgr.a (mgr.14388) 7642 : cluster [DBG] pgmap v5296: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:07:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:07:58 smithi163 bash[24253]: cluster 2024-08-31T05:07:58.102514+0000 mgr.a (mgr.14388) 7643 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:58.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:07:58 smithi027 bash[22610]: cluster 2024-08-31T05:07:58.102514+0000 mgr.a (mgr.14388) 7643 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:07:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:07:58 smithi191 bash[24992]: cluster 2024-08-31T05:07:58.102514+0000 mgr.a (mgr.14388) 7643 : cluster [DBG] pgmap v5297: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:00 smithi163 bash[24253]: cluster 2024-08-31T05:08:00.103272+0000 mgr.a (mgr.14388) 7644 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:00.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:00 smithi027 bash[22610]: cluster 2024-08-31T05:08:00.103272+0000 mgr.a (mgr.14388) 7644 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:00 smithi191 bash[24992]: cluster 2024-08-31T05:08:00.103272+0000 mgr.a (mgr.14388) 7644 : cluster [DBG] pgmap v5298: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:00.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:00.925 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:00.925 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:01.669 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:01.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:01.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:01.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:01.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:02 smithi163 bash[24253]: audit 2024-08-31T05:08:01.254865+0000 mgr.a (mgr.14388) 7645 : audit [DBG] from='client.172836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:02 smithi163 bash[24253]: cluster 2024-08-31T05:08:02.104213+0000 mgr.a (mgr.14388) 7646 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:02.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:02 smithi027 bash[22610]: audit 2024-08-31T05:08:01.254865+0000 mgr.a (mgr.14388) 7645 : audit [DBG] from='client.172836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:02 smithi027 bash[22610]: cluster 2024-08-31T05:08:02.104213+0000 mgr.a (mgr.14388) 7646 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:02 smithi191 bash[24992]: audit 2024-08-31T05:08:01.254865+0000 mgr.a (mgr.14388) 7645 : audit [DBG] from='client.172836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:02 smithi191 bash[24992]: cluster 2024-08-31T05:08:02.104213+0000 mgr.a (mgr.14388) 7646 : cluster [DBG] pgmap v5299: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:04 smithi163 bash[24253]: cluster 2024-08-31T05:08:04.106401+0000 mgr.a (mgr.14388) 7647 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:04.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:04 smithi027 bash[22610]: cluster 2024-08-31T05:08:04.106401+0000 mgr.a (mgr.14388) 7647 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:04 smithi191 bash[24992]: cluster 2024-08-31T05:08:04.106401+0000 mgr.a (mgr.14388) 7647 : cluster [DBG] pgmap v5300: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:06 smithi163 bash[24253]: cluster 2024-08-31T05:08:06.107194+0000 mgr.a (mgr.14388) 7648 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:06 smithi027 bash[22610]: cluster 2024-08-31T05:08:06.107194+0000 mgr.a (mgr.14388) 7648 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:06 smithi191 bash[24992]: cluster 2024-08-31T05:08:06.107194+0000 mgr.a (mgr.14388) 7648 : cluster [DBG] pgmap v5301: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:06.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:06.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:06.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:07.423 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:07.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:07.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:07.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:07.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:07 smithi163 bash[24253]: audit 2024-08-31T05:08:07.000516+0000 mgr.a (mgr.14388) 7649 : audit [DBG] from='client.172911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:07.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:07 smithi027 bash[22610]: audit 2024-08-31T05:08:07.000516+0000 mgr.a (mgr.14388) 7649 : audit [DBG] from='client.172911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:07 smithi191 bash[24992]: audit 2024-08-31T05:08:07.000516+0000 mgr.a (mgr.14388) 7649 : audit [DBG] from='client.172911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:08.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:08 smithi027 bash[22610]: cluster 2024-08-31T05:08:08.109621+0000 mgr.a (mgr.14388) 7650 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:08 smithi191 bash[24992]: cluster 2024-08-31T05:08:08.109621+0000 mgr.a (mgr.14388) 7650 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:08 smithi163 bash[24253]: cluster 2024-08-31T05:08:08.109621+0000 mgr.a (mgr.14388) 7650 : cluster [DBG] pgmap v5302: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:10 smithi163 bash[24253]: cluster 2024-08-31T05:08:10.110414+0000 mgr.a (mgr.14388) 7651 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:10.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:10 smithi027 bash[22610]: cluster 2024-08-31T05:08:10.110414+0000 mgr.a (mgr.14388) 7651 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:10 smithi191 bash[24992]: cluster 2024-08-31T05:08:10.110414+0000 mgr.a (mgr.14388) 7651 : cluster [DBG] pgmap v5303: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:12.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:12.425 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:12.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:12 smithi163 bash[24253]: cluster 2024-08-31T05:08:12.111347+0000 mgr.a (mgr.14388) 7652 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:12 smithi027 bash[22610]: cluster 2024-08-31T05:08:12.111347+0000 mgr.a (mgr.14388) 7652 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:12 smithi191 bash[24992]: cluster 2024-08-31T05:08:12.111347+0000 mgr.a (mgr.14388) 7652 : cluster [DBG] pgmap v5304: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:13.212 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:13.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:13.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:13.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:13.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:13 smithi163 bash[24253]: audit 2024-08-31T05:08:12.763796+0000 mgr.a (mgr.14388) 7653 : audit [DBG] from='client.172986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:13.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:13 smithi027 bash[22610]: audit 2024-08-31T05:08:12.763796+0000 mgr.a (mgr.14388) 7653 : audit [DBG] from='client.172986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:13 smithi191 bash[24992]: audit 2024-08-31T05:08:12.763796+0000 mgr.a (mgr.14388) 7653 : audit [DBG] from='client.172986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:14 smithi027 bash[22610]: cluster 2024-08-31T05:08:14.114194+0000 mgr.a (mgr.14388) 7654 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:14 smithi191 bash[24992]: cluster 2024-08-31T05:08:14.114194+0000 mgr.a (mgr.14388) 7654 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:14 smithi163 bash[24253]: cluster 2024-08-31T05:08:14.114194+0000 mgr.a (mgr.14388) 7654 : cluster [DBG] pgmap v5305: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:16 smithi163 bash[24253]: cluster 2024-08-31T05:08:16.115003+0000 mgr.a (mgr.14388) 7655 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:08:16.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:16 smithi027 bash[22610]: cluster 2024-08-31T05:08:16.115003+0000 mgr.a (mgr.14388) 7655 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:08:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:16 smithi191 bash[24992]: cluster 2024-08-31T05:08:16.115003+0000 mgr.a (mgr.14388) 7655 : cluster [DBG] pgmap v5306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:08:18.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:18.214 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:18.214 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:18.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:18 smithi027 bash[22610]: cluster 2024-08-31T05:08:18.116909+0000 mgr.a (mgr.14388) 7656 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:18 smithi191 bash[24992]: cluster 2024-08-31T05:08:18.116909+0000 mgr.a (mgr.14388) 7656 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:18 smithi163 bash[24253]: cluster 2024-08-31T05:08:18.116909+0000 mgr.a (mgr.14388) 7656 : cluster [DBG] pgmap v5307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:18.984 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:18.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:18.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:18.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:18.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:19 smithi027 bash[22610]: audit 2024-08-31T05:08:18.555587+0000 mgr.a (mgr.14388) 7657 : audit [DBG] from='client.173061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:19 smithi191 bash[24992]: audit 2024-08-31T05:08:18.555587+0000 mgr.a (mgr.14388) 7657 : audit [DBG] from='client.173061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:19 smithi163 bash[24253]: audit 2024-08-31T05:08:18.555587+0000 mgr.a (mgr.14388) 7657 : audit [DBG] from='client.173061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:20 smithi027 bash[22610]: cluster 2024-08-31T05:08:20.117874+0000 mgr.a (mgr.14388) 7658 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:08:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:20 smithi191 bash[24992]: cluster 2024-08-31T05:08:20.117874+0000 mgr.a (mgr.14388) 7658 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:08:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:20 smithi163 bash[24253]: cluster 2024-08-31T05:08:20.117874+0000 mgr.a (mgr.14388) 7658 : cluster [DBG] pgmap v5308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:08:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:22 smithi027 bash[22610]: cluster 2024-08-31T05:08:22.118670+0000 mgr.a (mgr.14388) 7659 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:08:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:22 smithi191 bash[24992]: cluster 2024-08-31T05:08:22.118670+0000 mgr.a (mgr.14388) 7659 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:08:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:22 smithi163 bash[24253]: cluster 2024-08-31T05:08:22.118670+0000 mgr.a (mgr.14388) 7659 : cluster [DBG] pgmap v5309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:08:23.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:23.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:23.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:24.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:24 smithi027 bash[22610]: cluster 2024-08-31T05:08:24.119707+0000 mgr.a (mgr.14388) 7660 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:24 smithi191 bash[24992]: cluster 2024-08-31T05:08:24.119707+0000 mgr.a (mgr.14388) 7660 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:24 smithi163 bash[24253]: cluster 2024-08-31T05:08:24.119707+0000 mgr.a (mgr.14388) 7660 : cluster [DBG] pgmap v5310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:24.777 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:24.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:24.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:24.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:24.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:25.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:25 smithi027 bash[22610]: audit 2024-08-31T05:08:24.327539+0000 mgr.a (mgr.14388) 7661 : audit [DBG] from='client.173139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:25.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:25 smithi027 bash[22610]: audit 2024-08-31T05:08:24.385188+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:08:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:25 smithi027 bash[22610]: audit 2024-08-31T05:08:25.187727+0000 mon.a (mon.0) 1726 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:08:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:25 smithi027 bash[22610]: audit 2024-08-31T05:08:25.189583+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:08:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:25 smithi027 bash[22610]: audit 2024-08-31T05:08:25.198153+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:08:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:25 smithi191 bash[24992]: audit 2024-08-31T05:08:24.327539+0000 mgr.a (mgr.14388) 7661 : audit [DBG] from='client.173139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:25 smithi191 bash[24992]: audit 2024-08-31T05:08:24.385188+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:08:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:25 smithi191 bash[24992]: audit 2024-08-31T05:08:25.187727+0000 mon.a (mon.0) 1726 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:08:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:25 smithi191 bash[24992]: audit 2024-08-31T05:08:25.189583+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:08:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:25 smithi191 bash[24992]: audit 2024-08-31T05:08:25.198153+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:08:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:25 smithi163 bash[24253]: audit 2024-08-31T05:08:24.327539+0000 mgr.a (mgr.14388) 7661 : audit [DBG] from='client.173139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:25 smithi163 bash[24253]: audit 2024-08-31T05:08:24.385188+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:08:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:25 smithi163 bash[24253]: audit 2024-08-31T05:08:25.187727+0000 mon.a (mon.0) 1726 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:08:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:25 smithi163 bash[24253]: audit 2024-08-31T05:08:25.189583+0000 mon.a (mon.0) 1727 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:08:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:25 smithi163 bash[24253]: audit 2024-08-31T05:08:25.198153+0000 mon.a (mon.0) 1728 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:08:26.211 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:08:25 smithi027 bash[22863]: debug 2024-08-31T05:08:25.925+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:08:26.211 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:08:25 smithi027 bash[22863]: debug 2024-08-31T05:08:25.925+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:08:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:26 smithi027 bash[22610]: audit 2024-08-31T05:08:25.208041+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:08:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:26 smithi027 bash[22610]: audit 2024-08-31T05:08:25.210774+0000 mgr.a (mgr.14388) 7662 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:08:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:26 smithi027 bash[22610]: audit 2024-08-31T05:08:25.926835+0000 mgr.a (mgr.14388) 7663 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:08:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:26 smithi027 bash[22610]: cephadm 2024-08-31T05:08:25.927948+0000 mgr.a (mgr.14388) 7664 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:08:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:26 smithi027 bash[22610]: cluster 2024-08-31T05:08:26.120581+0000 mgr.a (mgr.14388) 7665 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:26 smithi191 bash[24992]: audit 2024-08-31T05:08:25.208041+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:08:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:26 smithi191 bash[24992]: audit 2024-08-31T05:08:25.210774+0000 mgr.a (mgr.14388) 7662 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:08:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:26 smithi191 bash[24992]: audit 2024-08-31T05:08:25.926835+0000 mgr.a (mgr.14388) 7663 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:08:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:26 smithi191 bash[24992]: cephadm 2024-08-31T05:08:25.927948+0000 mgr.a (mgr.14388) 7664 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:08:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:26 smithi191 bash[24992]: cluster 2024-08-31T05:08:26.120581+0000 mgr.a (mgr.14388) 7665 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:26 smithi163 bash[24253]: audit 2024-08-31T05:08:25.208041+0000 mon.a (mon.0) 1729 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:08:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:26 smithi163 bash[24253]: audit 2024-08-31T05:08:25.210774+0000 mgr.a (mgr.14388) 7662 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:08:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:26 smithi163 bash[24253]: audit 2024-08-31T05:08:25.926835+0000 mgr.a (mgr.14388) 7663 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:08:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:26 smithi163 bash[24253]: cephadm 2024-08-31T05:08:25.927948+0000 mgr.a (mgr.14388) 7664 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:08:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:26 smithi163 bash[24253]: cluster 2024-08-31T05:08:26.120581+0000 mgr.a (mgr.14388) 7665 : cluster [DBG] pgmap v5311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:28.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:28 smithi027 bash[22610]: cluster 2024-08-31T05:08:28.122745+0000 mgr.a (mgr.14388) 7666 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:28 smithi191 bash[24992]: cluster 2024-08-31T05:08:28.122745+0000 mgr.a (mgr.14388) 7666 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:28 smithi163 bash[24253]: cluster 2024-08-31T05:08:28.122745+0000 mgr.a (mgr.14388) 7666 : cluster [DBG] pgmap v5312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:30 smithi027 bash[22610]: audit 2024-08-31T05:08:30.115625+0000 mgr.a (mgr.14388) 7667 : audit [DBG] from='client.173325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:30 smithi027 bash[22610]: cluster 2024-08-31T05:08:30.134276+0000 mgr.a (mgr.14388) 7668 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:30 smithi191 bash[24992]: audit 2024-08-31T05:08:30.115625+0000 mgr.a (mgr.14388) 7667 : audit [DBG] from='client.173325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:30 smithi191 bash[24992]: cluster 2024-08-31T05:08:30.134276+0000 mgr.a (mgr.14388) 7668 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:30.556 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:30.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:30.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:30.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:30.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:30 smithi163 bash[24253]: audit 2024-08-31T05:08:30.115625+0000 mgr.a (mgr.14388) 7667 : audit [DBG] from='client.173325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:30 smithi163 bash[24253]: cluster 2024-08-31T05:08:30.134276+0000 mgr.a (mgr.14388) 7668 : cluster [DBG] pgmap v5313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:32 smithi027 bash[22610]: cluster 2024-08-31T05:08:32.135326+0000 mgr.a (mgr.14388) 7669 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:32 smithi191 bash[24992]: cluster 2024-08-31T05:08:32.135326+0000 mgr.a (mgr.14388) 7669 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:32 smithi163 bash[24253]: cluster 2024-08-31T05:08:32.135326+0000 mgr.a (mgr.14388) 7669 : cluster [DBG] pgmap v5314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:34 smithi027 bash[22610]: cluster 2024-08-31T05:08:34.137543+0000 mgr.a (mgr.14388) 7670 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:34 smithi191 bash[24992]: cluster 2024-08-31T05:08:34.137543+0000 mgr.a (mgr.14388) 7670 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:34 smithi163 bash[24253]: cluster 2024-08-31T05:08:34.137543+0000 mgr.a (mgr.14388) 7670 : cluster [DBG] pgmap v5315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:08:35.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:35.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:35.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:36.347 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:36.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:36 smithi027 bash[22610]: audit 2024-08-31T05:08:35.896792+0000 mgr.a (mgr.14388) 7671 : audit [DBG] from='client.173403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:36 smithi027 bash[22610]: cluster 2024-08-31T05:08:36.140005+0000 mgr.a (mgr.14388) 7672 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T05:08:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:36 smithi191 bash[24992]: audit 2024-08-31T05:08:35.896792+0000 mgr.a (mgr.14388) 7671 : audit [DBG] from='client.173403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:36 smithi191 bash[24992]: cluster 2024-08-31T05:08:36.140005+0000 mgr.a (mgr.14388) 7672 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T05:08:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:36 smithi163 bash[24253]: audit 2024-08-31T05:08:35.896792+0000 mgr.a (mgr.14388) 7671 : audit [DBG] from='client.173403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:36 smithi163 bash[24253]: cluster 2024-08-31T05:08:36.140005+0000 mgr.a (mgr.14388) 7672 : cluster [DBG] pgmap v5316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T05:08:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:38 smithi027 bash[22610]: cluster 2024-08-31T05:08:38.142425+0000 mgr.a (mgr.14388) 7673 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T05:08:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:38 smithi191 bash[24992]: cluster 2024-08-31T05:08:38.142425+0000 mgr.a (mgr.14388) 7673 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T05:08:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:38 smithi163 bash[24253]: cluster 2024-08-31T05:08:38.142425+0000 mgr.a (mgr.14388) 7673 : cluster [DBG] pgmap v5317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T05:08:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:40 smithi027 bash[22610]: cluster 2024-08-31T05:08:40.143399+0000 mgr.a (mgr.14388) 7674 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:40 smithi191 bash[24992]: cluster 2024-08-31T05:08:40.143399+0000 mgr.a (mgr.14388) 7674 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:40 smithi163 bash[24253]: cluster 2024-08-31T05:08:40.143399+0000 mgr.a (mgr.14388) 7674 : cluster [DBG] pgmap v5318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:41.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:41.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:41.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:42.096 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:42.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:42.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:42.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:42.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:42 smithi027 bash[22610]: audit 2024-08-31T05:08:41.681391+0000 mgr.a (mgr.14388) 7675 : audit [DBG] from='client.173481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:42 smithi027 bash[22610]: cluster 2024-08-31T05:08:42.144201+0000 mgr.a (mgr.14388) 7676 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:42 smithi191 bash[24992]: audit 2024-08-31T05:08:41.681391+0000 mgr.a (mgr.14388) 7675 : audit [DBG] from='client.173481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:42 smithi191 bash[24992]: cluster 2024-08-31T05:08:42.144201+0000 mgr.a (mgr.14388) 7676 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:42 smithi163 bash[24253]: audit 2024-08-31T05:08:41.681391+0000 mgr.a (mgr.14388) 7675 : audit [DBG] from='client.173481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:42 smithi163 bash[24253]: cluster 2024-08-31T05:08:42.144201+0000 mgr.a (mgr.14388) 7676 : cluster [DBG] pgmap v5319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:44 smithi027 bash[22610]: cluster 2024-08-31T05:08:44.146404+0000 mgr.a (mgr.14388) 7677 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:44 smithi191 bash[24992]: cluster 2024-08-31T05:08:44.146404+0000 mgr.a (mgr.14388) 7677 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:44 smithi163 bash[24253]: cluster 2024-08-31T05:08:44.146404+0000 mgr.a (mgr.14388) 7677 : cluster [DBG] pgmap v5320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:46 smithi027 bash[22610]: cluster 2024-08-31T05:08:46.147182+0000 mgr.a (mgr.14388) 7678 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:46 smithi191 bash[24992]: cluster 2024-08-31T05:08:46.147182+0000 mgr.a (mgr.14388) 7678 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:46 smithi163 bash[24253]: cluster 2024-08-31T05:08:46.147182+0000 mgr.a (mgr.14388) 7678 : cluster [DBG] pgmap v5321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:47.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:47.098 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:47.098 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:47.843 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:47.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:47.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:48 smithi027 bash[22610]: audit 2024-08-31T05:08:47.430647+0000 mgr.a (mgr.14388) 7679 : audit [DBG] from='client.173559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:48 smithi027 bash[22610]: cluster 2024-08-31T05:08:48.149401+0000 mgr.a (mgr.14388) 7680 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:48 smithi191 bash[24992]: audit 2024-08-31T05:08:47.430647+0000 mgr.a (mgr.14388) 7679 : audit [DBG] from='client.173559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:48 smithi191 bash[24992]: cluster 2024-08-31T05:08:48.149401+0000 mgr.a (mgr.14388) 7680 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:48 smithi163 bash[24253]: audit 2024-08-31T05:08:47.430647+0000 mgr.a (mgr.14388) 7679 : audit [DBG] from='client.173559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:48 smithi163 bash[24253]: cluster 2024-08-31T05:08:48.149401+0000 mgr.a (mgr.14388) 7680 : cluster [DBG] pgmap v5322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:08:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:50 smithi027 bash[22610]: cluster 2024-08-31T05:08:50.150309+0000 mgr.a (mgr.14388) 7681 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:50 smithi191 bash[24992]: cluster 2024-08-31T05:08:50.150309+0000 mgr.a (mgr.14388) 7681 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:50 smithi163 bash[24253]: cluster 2024-08-31T05:08:50.150309+0000 mgr.a (mgr.14388) 7681 : cluster [DBG] pgmap v5323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:52 smithi027 bash[22610]: cluster 2024-08-31T05:08:52.151148+0000 mgr.a (mgr.14388) 7682 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:52 smithi191 bash[24992]: cluster 2024-08-31T05:08:52.151148+0000 mgr.a (mgr.14388) 7682 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:52 smithi163 bash[24253]: cluster 2024-08-31T05:08:52.151148+0000 mgr.a (mgr.14388) 7682 : cluster [DBG] pgmap v5324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:52.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:52.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:52.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:53.594 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:53.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:53.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:53.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:53.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:54 smithi027 bash[22610]: audit 2024-08-31T05:08:53.179490+0000 mgr.a (mgr.14388) 7683 : audit [DBG] from='client.173637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:54 smithi027 bash[22610]: cluster 2024-08-31T05:08:54.153960+0000 mgr.a (mgr.14388) 7684 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:54 smithi191 bash[24992]: audit 2024-08-31T05:08:53.179490+0000 mgr.a (mgr.14388) 7683 : audit [DBG] from='client.173637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:54 smithi191 bash[24992]: cluster 2024-08-31T05:08:54.153960+0000 mgr.a (mgr.14388) 7684 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:54 smithi163 bash[24253]: audit 2024-08-31T05:08:53.179490+0000 mgr.a (mgr.14388) 7683 : audit [DBG] from='client.173637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:54 smithi163 bash[24253]: cluster 2024-08-31T05:08:54.153960+0000 mgr.a (mgr.14388) 7684 : cluster [DBG] pgmap v5325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:56 smithi027 bash[22610]: cluster 2024-08-31T05:08:56.154794+0000 mgr.a (mgr.14388) 7685 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:08:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:56 smithi191 bash[24992]: cluster 2024-08-31T05:08:56.154794+0000 mgr.a (mgr.14388) 7685 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:08:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:56 smithi163 bash[24253]: cluster 2024-08-31T05:08:56.154794+0000 mgr.a (mgr.14388) 7685 : cluster [DBG] pgmap v5326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:08:58.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:08:58.597 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:08:58.597 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:08:59.340 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:08:59.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:08:59.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:08:59.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:08:59.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:08:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:59 smithi027 bash[22610]: cluster 2024-08-31T05:08:58.156701+0000 mgr.a (mgr.14388) 7686 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:08:59 smithi027 bash[22610]: audit 2024-08-31T05:08:58.924576+0000 mgr.a (mgr.14388) 7687 : audit [DBG] from='client.173712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:59 smithi191 bash[24992]: cluster 2024-08-31T05:08:58.156701+0000 mgr.a (mgr.14388) 7686 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:08:59 smithi191 bash[24992]: audit 2024-08-31T05:08:58.924576+0000 mgr.a (mgr.14388) 7687 : audit [DBG] from='client.173712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:08:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:59 smithi163 bash[24253]: cluster 2024-08-31T05:08:58.156701+0000 mgr.a (mgr.14388) 7686 : cluster [DBG] pgmap v5327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:08:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:08:59 smithi163 bash[24253]: audit 2024-08-31T05:08:58.924576+0000 mgr.a (mgr.14388) 7687 : audit [DBG] from='client.173712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:01 smithi027 bash[22610]: cluster 2024-08-31T05:09:00.157655+0000 mgr.a (mgr.14388) 7688 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:09:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:01 smithi191 bash[24992]: cluster 2024-08-31T05:09:00.157655+0000 mgr.a (mgr.14388) 7688 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:09:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:01 smithi163 bash[24253]: cluster 2024-08-31T05:09:00.157655+0000 mgr.a (mgr.14388) 7688 : cluster [DBG] pgmap v5328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:09:03.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:03 smithi027 bash[22610]: cluster 2024-08-31T05:09:02.158461+0000 mgr.a (mgr.14388) 7689 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:09:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:03 smithi191 bash[24992]: cluster 2024-08-31T05:09:02.158461+0000 mgr.a (mgr.14388) 7689 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:09:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:03 smithi163 bash[24253]: cluster 2024-08-31T05:09:02.158461+0000 mgr.a (mgr.14388) 7689 : cluster [DBG] pgmap v5329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:09:04.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:09:04.342 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:09:04.342 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:09:05.110 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:09:05.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:09:05.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:09:05.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:09:05.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:09:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:05 smithi027 bash[22610]: cluster 2024-08-31T05:09:04.160648+0000 mgr.a (mgr.14388) 7690 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:05 smithi027 bash[22610]: audit 2024-08-31T05:09:04.678625+0000 mgr.a (mgr.14388) 7691 : audit [DBG] from='client.173784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:05 smithi191 bash[24992]: cluster 2024-08-31T05:09:04.160648+0000 mgr.a (mgr.14388) 7690 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:05 smithi191 bash[24992]: audit 2024-08-31T05:09:04.678625+0000 mgr.a (mgr.14388) 7691 : audit [DBG] from='client.173784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:05 smithi163 bash[24253]: cluster 2024-08-31T05:09:04.160648+0000 mgr.a (mgr.14388) 7690 : cluster [DBG] pgmap v5330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:05.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:05 smithi163 bash[24253]: audit 2024-08-31T05:09:04.678625+0000 mgr.a (mgr.14388) 7691 : audit [DBG] from='client.173784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:07 smithi027 bash[22610]: cluster 2024-08-31T05:09:06.161601+0000 mgr.a (mgr.14388) 7692 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:07 smithi191 bash[24992]: cluster 2024-08-31T05:09:06.161601+0000 mgr.a (mgr.14388) 7692 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:07 smithi163 bash[24253]: cluster 2024-08-31T05:09:06.161601+0000 mgr.a (mgr.14388) 7692 : cluster [DBG] pgmap v5331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:09 smithi027 bash[22610]: cluster 2024-08-31T05:09:08.163808+0000 mgr.a (mgr.14388) 7693 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:09 smithi191 bash[24992]: cluster 2024-08-31T05:09:08.163808+0000 mgr.a (mgr.14388) 7693 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:09 smithi163 bash[24253]: cluster 2024-08-31T05:09:08.163808+0000 mgr.a (mgr.14388) 7693 : cluster [DBG] pgmap v5332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:10.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:09:10.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:09:10.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:09:10.878 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:09:10.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:09:10.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:09:10.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:09:10.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:09:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:11 smithi027 bash[22610]: cluster 2024-08-31T05:09:10.164551+0000 mgr.a (mgr.14388) 7694 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:11 smithi027 bash[22610]: audit 2024-08-31T05:09:10.446784+0000 mgr.a (mgr.14388) 7695 : audit [DBG] from='client.173859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:11 smithi191 bash[24992]: cluster 2024-08-31T05:09:10.164551+0000 mgr.a (mgr.14388) 7694 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:11 smithi191 bash[24992]: audit 2024-08-31T05:09:10.446784+0000 mgr.a (mgr.14388) 7695 : audit [DBG] from='client.173859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:11 smithi163 bash[24253]: cluster 2024-08-31T05:09:10.164551+0000 mgr.a (mgr.14388) 7694 : cluster [DBG] pgmap v5333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:11 smithi163 bash[24253]: audit 2024-08-31T05:09:10.446784+0000 mgr.a (mgr.14388) 7695 : audit [DBG] from='client.173859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:13 smithi027 bash[22610]: cluster 2024-08-31T05:09:12.165456+0000 mgr.a (mgr.14388) 7696 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:13 smithi191 bash[24992]: cluster 2024-08-31T05:09:12.165456+0000 mgr.a (mgr.14388) 7696 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:13 smithi163 bash[24253]: cluster 2024-08-31T05:09:12.165456+0000 mgr.a (mgr.14388) 7696 : cluster [DBG] pgmap v5334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:15 smithi027 bash[22610]: cluster 2024-08-31T05:09:14.167712+0000 mgr.a (mgr.14388) 7697 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:15 smithi191 bash[24992]: cluster 2024-08-31T05:09:14.167712+0000 mgr.a (mgr.14388) 7697 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:15.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:09:15.880 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:09:15.880 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:09:15.968 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:15 smithi163 bash[24253]: cluster 2024-08-31T05:09:14.167712+0000 mgr.a (mgr.14388) 7697 : cluster [DBG] pgmap v5335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:16.644 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:09:16.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:09:16.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:09:16.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:09:16.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:09:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:17 smithi027 bash[22610]: cluster 2024-08-31T05:09:16.168400+0000 mgr.a (mgr.14388) 7698 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:17 smithi027 bash[22610]: audit 2024-08-31T05:09:16.214837+0000 mgr.a (mgr.14388) 7699 : audit [DBG] from='client.173937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:17 smithi191 bash[24992]: cluster 2024-08-31T05:09:16.168400+0000 mgr.a (mgr.14388) 7698 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:17 smithi191 bash[24992]: audit 2024-08-31T05:09:16.214837+0000 mgr.a (mgr.14388) 7699 : audit [DBG] from='client.173937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:17 smithi163 bash[24253]: cluster 2024-08-31T05:09:16.168400+0000 mgr.a (mgr.14388) 7698 : cluster [DBG] pgmap v5336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:17 smithi163 bash[24253]: audit 2024-08-31T05:09:16.214837+0000 mgr.a (mgr.14388) 7699 : audit [DBG] from='client.173937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:19 smithi027 bash[22610]: cluster 2024-08-31T05:09:18.170633+0000 mgr.a (mgr.14388) 7700 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:19 smithi191 bash[24992]: cluster 2024-08-31T05:09:18.170633+0000 mgr.a (mgr.14388) 7700 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:19 smithi163 bash[24253]: cluster 2024-08-31T05:09:18.170633+0000 mgr.a (mgr.14388) 7700 : cluster [DBG] pgmap v5337: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:21.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:09:21.646 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:09:21.647 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:09:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:21 smithi191 bash[24992]: cluster 2024-08-31T05:09:20.171358+0000 mgr.a (mgr.14388) 7701 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:21 smithi163 bash[24253]: cluster 2024-08-31T05:09:20.171358+0000 mgr.a (mgr.14388) 7701 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:21.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:21 smithi027 bash[22610]: cluster 2024-08-31T05:09:20.171358+0000 mgr.a (mgr.14388) 7701 : cluster [DBG] pgmap v5338: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:22.395 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:09:22.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:09:22.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:09:22.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:09:22.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:09:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:22 smithi191 bash[24992]: audit 2024-08-31T05:09:21.983839+0000 mgr.a (mgr.14388) 7702 : audit [DBG] from='client.174015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:22 smithi163 bash[24253]: audit 2024-08-31T05:09:21.983839+0000 mgr.a (mgr.14388) 7702 : audit [DBG] from='client.174015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:22 smithi027 bash[22610]: audit 2024-08-31T05:09:21.983839+0000 mgr.a (mgr.14388) 7702 : audit [DBG] from='client.174015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:23 smithi191 bash[24992]: cluster 2024-08-31T05:09:22.171871+0000 mgr.a (mgr.14388) 7703 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:23 smithi163 bash[24253]: cluster 2024-08-31T05:09:22.171871+0000 mgr.a (mgr.14388) 7703 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:23.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:23 smithi027 bash[22610]: cluster 2024-08-31T05:09:22.171871+0000 mgr.a (mgr.14388) 7703 : cluster [DBG] pgmap v5339: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:25 smithi191 bash[24992]: cluster 2024-08-31T05:09:24.174150+0000 mgr.a (mgr.14388) 7704 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:25 smithi163 bash[24253]: cluster 2024-08-31T05:09:24.174150+0000 mgr.a (mgr.14388) 7704 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:25 smithi027 bash[22610]: cluster 2024-08-31T05:09:24.174150+0000 mgr.a (mgr.14388) 7704 : cluster [DBG] pgmap v5340: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:26 smithi191 bash[24992]: audit 2024-08-31T05:09:25.977072+0000 mon.a (mon.0) 1730 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:09:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:26 smithi163 bash[24253]: audit 2024-08-31T05:09:25.977072+0000 mon.a (mon.0) 1730 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:09:26.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:26 smithi027 bash[22610]: audit 2024-08-31T05:09:25.977072+0000 mon.a (mon.0) 1730 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:09:27.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:09:27.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:09:27.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:09:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:27 smithi191 bash[24992]: cluster 2024-08-31T05:09:26.174762+0000 mgr.a (mgr.14388) 7705 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:27 smithi191 bash[24992]: audit 2024-08-31T05:09:26.829918+0000 mon.a (mon.0) 1731 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:09:27.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:27 smithi191 bash[24992]: audit 2024-08-31T05:09:26.831503+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:09:27.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:27 smithi191 bash[24992]: audit 2024-08-31T05:09:26.841916+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:09:27.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:27 smithi191 bash[24992]: audit 2024-08-31T05:09:26.846617+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:09:27.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:27 smithi191 bash[24992]: audit 2024-08-31T05:09:26.848831+0000 mgr.a (mgr.14388) 7706 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:09:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:27 smithi163 bash[24253]: cluster 2024-08-31T05:09:26.174762+0000 mgr.a (mgr.14388) 7705 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:27 smithi163 bash[24253]: audit 2024-08-31T05:09:26.829918+0000 mon.a (mon.0) 1731 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:09:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:27 smithi163 bash[24253]: audit 2024-08-31T05:09:26.831503+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:09:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:27 smithi163 bash[24253]: audit 2024-08-31T05:09:26.841916+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:09:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:27 smithi163 bash[24253]: audit 2024-08-31T05:09:26.846617+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:09:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:27 smithi163 bash[24253]: audit 2024-08-31T05:09:26.848831+0000 mgr.a (mgr.14388) 7706 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:09:27.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:09:27 smithi027 bash[22863]: debug 2024-08-31T05:09:27.552+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:09:27.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:09:27 smithi027 bash[22863]: debug 2024-08-31T05:09:27.552+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:09:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:27 smithi027 bash[22610]: cluster 2024-08-31T05:09:26.174762+0000 mgr.a (mgr.14388) 7705 : cluster [DBG] pgmap v5341: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:27 smithi027 bash[22610]: audit 2024-08-31T05:09:26.829918+0000 mon.a (mon.0) 1731 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:09:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:27 smithi027 bash[22610]: audit 2024-08-31T05:09:26.831503+0000 mon.a (mon.0) 1732 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:09:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:27 smithi027 bash[22610]: audit 2024-08-31T05:09:26.841916+0000 mon.a (mon.0) 1733 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:09:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:27 smithi027 bash[22610]: audit 2024-08-31T05:09:26.846617+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:09:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:27 smithi027 bash[22610]: audit 2024-08-31T05:09:26.848831+0000 mgr.a (mgr.14388) 7706 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:09:28.129 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:09:28.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:09:28.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:09:28.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:09:28.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:09:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:28 smithi191 bash[24992]: audit 2024-08-31T05:09:27.556522+0000 mgr.a (mgr.14388) 7707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:09:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:28 smithi191 bash[24992]: cephadm 2024-08-31T05:09:27.557554+0000 mgr.a (mgr.14388) 7708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:09:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:28 smithi191 bash[24992]: audit 2024-08-31T05:09:27.719749+0000 mgr.a (mgr.14388) 7709 : audit [DBG] from='client.174198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:28 smithi163 bash[24253]: audit 2024-08-31T05:09:27.556522+0000 mgr.a (mgr.14388) 7707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:09:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:28 smithi163 bash[24253]: cephadm 2024-08-31T05:09:27.557554+0000 mgr.a (mgr.14388) 7708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:09:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:28 smithi163 bash[24253]: audit 2024-08-31T05:09:27.719749+0000 mgr.a (mgr.14388) 7709 : audit [DBG] from='client.174198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:28 smithi027 bash[22610]: audit 2024-08-31T05:09:27.556522+0000 mgr.a (mgr.14388) 7707 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:09:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:28 smithi027 bash[22610]: cephadm 2024-08-31T05:09:27.557554+0000 mgr.a (mgr.14388) 7708 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:09:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:28 smithi027 bash[22610]: audit 2024-08-31T05:09:27.719749+0000 mgr.a (mgr.14388) 7709 : audit [DBG] from='client.174198 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:29 smithi191 bash[24992]: cluster 2024-08-31T05:09:28.175907+0000 mgr.a (mgr.14388) 7710 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:09:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:29 smithi163 bash[24253]: cluster 2024-08-31T05:09:28.175907+0000 mgr.a (mgr.14388) 7710 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:09:29.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:29 smithi027 bash[22610]: cluster 2024-08-31T05:09:28.175907+0000 mgr.a (mgr.14388) 7710 : cluster [DBG] pgmap v5342: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:09:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:31 smithi191 bash[24992]: cluster 2024-08-31T05:09:30.176640+0000 mgr.a (mgr.14388) 7711 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:09:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:31 smithi163 bash[24253]: cluster 2024-08-31T05:09:30.176640+0000 mgr.a (mgr.14388) 7711 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:09:31.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:31 smithi027 bash[22610]: cluster 2024-08-31T05:09:30.176640+0000 mgr.a (mgr.14388) 7711 : cluster [DBG] pgmap v5343: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:09:33.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:09:33.131 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:09:33.131 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:09:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:33 smithi191 bash[24992]: cluster 2024-08-31T05:09:32.177430+0000 mgr.a (mgr.14388) 7712 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:09:33.898 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:09:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:09:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:09:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:09:33.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:09:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:33 smithi163 bash[24253]: cluster 2024-08-31T05:09:32.177430+0000 mgr.a (mgr.14388) 7712 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:09:33.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:33 smithi027 bash[22610]: cluster 2024-08-31T05:09:32.177430+0000 mgr.a (mgr.14388) 7712 : cluster [DBG] pgmap v5344: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:09:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:34 smithi191 bash[24992]: audit 2024-08-31T05:09:33.471664+0000 mgr.a (mgr.14388) 7713 : audit [DBG] from='client.174273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:34 smithi163 bash[24253]: audit 2024-08-31T05:09:33.471664+0000 mgr.a (mgr.14388) 7713 : audit [DBG] from='client.174273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:34 smithi027 bash[22610]: audit 2024-08-31T05:09:33.471664+0000 mgr.a (mgr.14388) 7713 : audit [DBG] from='client.174273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:35 smithi163 bash[24253]: cluster 2024-08-31T05:09:34.180192+0000 mgr.a (mgr.14388) 7714 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:09:35.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:35 smithi027 bash[22610]: cluster 2024-08-31T05:09:34.180192+0000 mgr.a (mgr.14388) 7714 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:09:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:35 smithi191 bash[24992]: cluster 2024-08-31T05:09:34.180192+0000 mgr.a (mgr.14388) 7714 : cluster [DBG] pgmap v5345: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:09:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:37 smithi163 bash[24253]: cluster 2024-08-31T05:09:36.180976+0000 mgr.a (mgr.14388) 7715 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:09:37.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:37 smithi027 bash[22610]: cluster 2024-08-31T05:09:36.180976+0000 mgr.a (mgr.14388) 7715 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:09:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:37 smithi191 bash[24992]: cluster 2024-08-31T05:09:36.180976+0000 mgr.a (mgr.14388) 7715 : cluster [DBG] pgmap v5346: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:09:38.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:09:38.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:09:38.901 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:09:39.677 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:09:39.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:09:39.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:09:39.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:09:39.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:09:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:39 smithi163 bash[24253]: cluster 2024-08-31T05:09:38.182947+0000 mgr.a (mgr.14388) 7716 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:09:39.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:39 smithi027 bash[22610]: cluster 2024-08-31T05:09:38.182947+0000 mgr.a (mgr.14388) 7716 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:09:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:39 smithi191 bash[24992]: cluster 2024-08-31T05:09:38.182947+0000 mgr.a (mgr.14388) 7716 : cluster [DBG] pgmap v5347: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:09:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:40 smithi163 bash[24253]: audit 2024-08-31T05:09:39.239738+0000 mgr.a (mgr.14388) 7717 : audit [DBG] from='client.174351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:40.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:40 smithi027 bash[22610]: audit 2024-08-31T05:09:39.239738+0000 mgr.a (mgr.14388) 7717 : audit [DBG] from='client.174351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:40 smithi191 bash[24992]: audit 2024-08-31T05:09:39.239738+0000 mgr.a (mgr.14388) 7717 : audit [DBG] from='client.174351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:41 smithi163 bash[24253]: cluster 2024-08-31T05:09:40.183902+0000 mgr.a (mgr.14388) 7718 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:09:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:41 smithi027 bash[22610]: cluster 2024-08-31T05:09:40.183902+0000 mgr.a (mgr.14388) 7718 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:09:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:41 smithi191 bash[24992]: cluster 2024-08-31T05:09:40.183902+0000 mgr.a (mgr.14388) 7718 : cluster [DBG] pgmap v5348: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:09:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:43 smithi163 bash[24253]: cluster 2024-08-31T05:09:42.184691+0000 mgr.a (mgr.14388) 7719 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:09:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:43 smithi027 bash[22610]: cluster 2024-08-31T05:09:42.184691+0000 mgr.a (mgr.14388) 7719 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:09:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:43 smithi191 bash[24992]: cluster 2024-08-31T05:09:42.184691+0000 mgr.a (mgr.14388) 7719 : cluster [DBG] pgmap v5349: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:09:44.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:09:44.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:09:44.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:09:45.436 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:09:45.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:09:45.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:09:45.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:09:45.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:09:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:45 smithi163 bash[24253]: cluster 2024-08-31T05:09:44.186924+0000 mgr.a (mgr.14388) 7720 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:09:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:45 smithi163 bash[24253]: audit 2024-08-31T05:09:45.012251+0000 mgr.a (mgr.14388) 7721 : audit [DBG] from='client.174429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:45 smithi027 bash[22610]: cluster 2024-08-31T05:09:44.186924+0000 mgr.a (mgr.14388) 7720 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:09:45.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:45 smithi027 bash[22610]: audit 2024-08-31T05:09:45.012251+0000 mgr.a (mgr.14388) 7721 : audit [DBG] from='client.174429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:45 smithi191 bash[24992]: cluster 2024-08-31T05:09:44.186924+0000 mgr.a (mgr.14388) 7720 : cluster [DBG] pgmap v5350: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:09:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:45 smithi191 bash[24992]: audit 2024-08-31T05:09:45.012251+0000 mgr.a (mgr.14388) 7721 : audit [DBG] from='client.174429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:47 smithi163 bash[24253]: cluster 2024-08-31T05:09:46.187815+0000 mgr.a (mgr.14388) 7722 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:47 smithi027 bash[22610]: cluster 2024-08-31T05:09:46.187815+0000 mgr.a (mgr.14388) 7722 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:47 smithi191 bash[24992]: cluster 2024-08-31T05:09:46.187815+0000 mgr.a (mgr.14388) 7722 : cluster [DBG] pgmap v5351: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:49 smithi163 bash[24253]: cluster 2024-08-31T05:09:48.190005+0000 mgr.a (mgr.14388) 7723 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:49 smithi027 bash[22610]: cluster 2024-08-31T05:09:48.190005+0000 mgr.a (mgr.14388) 7723 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:49 smithi191 bash[24992]: cluster 2024-08-31T05:09:48.190005+0000 mgr.a (mgr.14388) 7723 : cluster [DBG] pgmap v5352: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:50.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:09:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:09:50.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:09:51.227 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:09:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:09:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:09:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:09:51.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:09:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:51 smithi163 bash[24253]: cluster 2024-08-31T05:09:50.190788+0000 mgr.a (mgr.14388) 7724 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:51 smithi163 bash[24253]: audit 2024-08-31T05:09:50.779434+0000 mgr.a (mgr.14388) 7725 : audit [DBG] from='client.174501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:51 smithi027 bash[22610]: cluster 2024-08-31T05:09:50.190788+0000 mgr.a (mgr.14388) 7724 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:51 smithi027 bash[22610]: audit 2024-08-31T05:09:50.779434+0000 mgr.a (mgr.14388) 7725 : audit [DBG] from='client.174501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:51 smithi191 bash[24992]: cluster 2024-08-31T05:09:50.190788+0000 mgr.a (mgr.14388) 7724 : cluster [DBG] pgmap v5353: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:51 smithi191 bash[24992]: audit 2024-08-31T05:09:50.779434+0000 mgr.a (mgr.14388) 7725 : audit [DBG] from='client.174501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:53 smithi163 bash[24253]: cluster 2024-08-31T05:09:52.191655+0000 mgr.a (mgr.14388) 7726 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:53.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:53 smithi027 bash[22610]: cluster 2024-08-31T05:09:52.191655+0000 mgr.a (mgr.14388) 7726 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:53 smithi191 bash[24992]: cluster 2024-08-31T05:09:52.191655+0000 mgr.a (mgr.14388) 7726 : cluster [DBG] pgmap v5354: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:55 smithi163 bash[24253]: cluster 2024-08-31T05:09:54.193884+0000 mgr.a (mgr.14388) 7727 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:55 smithi027 bash[22610]: cluster 2024-08-31T05:09:54.193884+0000 mgr.a (mgr.14388) 7727 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:55 smithi191 bash[24992]: cluster 2024-08-31T05:09:54.193884+0000 mgr.a (mgr.14388) 7727 : cluster [DBG] pgmap v5355: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:56.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:09:56.229 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:09:56.229 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:09:57.008 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:09:57.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:09:57.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:09:57.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:09:57.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:09:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:57 smithi163 bash[24253]: cluster 2024-08-31T05:09:56.194636+0000 mgr.a (mgr.14388) 7728 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:57 smithi163 bash[24253]: audit 2024-08-31T05:09:56.564866+0000 mgr.a (mgr.14388) 7729 : audit [DBG] from='client.174576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:57 smithi027 bash[22610]: cluster 2024-08-31T05:09:56.194636+0000 mgr.a (mgr.14388) 7728 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:57 smithi027 bash[22610]: audit 2024-08-31T05:09:56.564866+0000 mgr.a (mgr.14388) 7729 : audit [DBG] from='client.174576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:57 smithi191 bash[24992]: cluster 2024-08-31T05:09:56.194636+0000 mgr.a (mgr.14388) 7728 : cluster [DBG] pgmap v5356: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:09:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:57 smithi191 bash[24992]: audit 2024-08-31T05:09:56.564866+0000 mgr.a (mgr.14388) 7729 : audit [DBG] from='client.174576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:09:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:09:59 smithi163 bash[24253]: cluster 2024-08-31T05:09:58.196905+0000 mgr.a (mgr.14388) 7730 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:09:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:09:59 smithi027 bash[22610]: cluster 2024-08-31T05:09:58.196905+0000 mgr.a (mgr.14388) 7730 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:09:59 smithi191 bash[24992]: cluster 2024-08-31T05:09:58.196905+0000 mgr.a (mgr.14388) 7730 : cluster [DBG] pgmap v5357: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:00 smithi163 bash[24253]: cluster 2024-08-31T05:10:00.000151+0000 mon.a (mon.0) 1735 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:10:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:00 smithi027 bash[22610]: cluster 2024-08-31T05:10:00.000151+0000 mon.a (mon.0) 1735 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:10:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:00 smithi191 bash[24992]: cluster 2024-08-31T05:10:00.000151+0000 mon.a (mon.0) 1735 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:10:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:01 smithi163 bash[24253]: cluster 2024-08-31T05:10:00.197682+0000 mgr.a (mgr.14388) 7731 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:01.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:01 smithi027 bash[22610]: cluster 2024-08-31T05:10:00.197682+0000 mgr.a (mgr.14388) 7731 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:02.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:02.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:10:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:01 smithi191 bash[24992]: cluster 2024-08-31T05:10:00.197682+0000 mgr.a (mgr.14388) 7731 : cluster [DBG] pgmap v5358: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:02.767 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:10:02.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:10:02.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:10:02.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:10:02.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:10:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:03 smithi163 bash[24253]: cluster 2024-08-31T05:10:02.198416+0000 mgr.a (mgr.14388) 7732 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:03 smithi163 bash[24253]: audit 2024-08-31T05:10:02.344925+0000 mgr.a (mgr.14388) 7733 : audit [DBG] from='client.174654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:03 smithi027 bash[22610]: cluster 2024-08-31T05:10:02.198416+0000 mgr.a (mgr.14388) 7732 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:03 smithi027 bash[22610]: audit 2024-08-31T05:10:02.344925+0000 mgr.a (mgr.14388) 7733 : audit [DBG] from='client.174654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:03 smithi191 bash[24992]: cluster 2024-08-31T05:10:02.198416+0000 mgr.a (mgr.14388) 7732 : cluster [DBG] pgmap v5359: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:03 smithi191 bash[24992]: audit 2024-08-31T05:10:02.344925+0000 mgr.a (mgr.14388) 7733 : audit [DBG] from='client.174654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:05 smithi163 bash[24253]: cluster 2024-08-31T05:10:04.200727+0000 mgr.a (mgr.14388) 7734 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:05 smithi027 bash[22610]: cluster 2024-08-31T05:10:04.200727+0000 mgr.a (mgr.14388) 7734 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:05 smithi191 bash[24992]: cluster 2024-08-31T05:10:04.200727+0000 mgr.a (mgr.14388) 7734 : cluster [DBG] pgmap v5360: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:07.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:07.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:10:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:07 smithi163 bash[24253]: cluster 2024-08-31T05:10:06.201627+0000 mgr.a (mgr.14388) 7735 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:07 smithi027 bash[22610]: cluster 2024-08-31T05:10:06.201627+0000 mgr.a (mgr.14388) 7735 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:07 smithi191 bash[24992]: cluster 2024-08-31T05:10:06.201627+0000 mgr.a (mgr.14388) 7735 : cluster [DBG] pgmap v5361: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:08.551 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:10:08.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:10:08.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:10:08.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:10:08.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:10:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:08 smithi163 bash[24253]: audit 2024-08-31T05:10:08.107233+0000 mgr.a (mgr.14388) 7736 : audit [DBG] from='client.174732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:08 smithi027 bash[22610]: audit 2024-08-31T05:10:08.107233+0000 mgr.a (mgr.14388) 7736 : audit [DBG] from='client.174732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:08 smithi191 bash[24992]: audit 2024-08-31T05:10:08.107233+0000 mgr.a (mgr.14388) 7736 : audit [DBG] from='client.174732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:09 smithi163 bash[24253]: cluster 2024-08-31T05:10:08.203455+0000 mgr.a (mgr.14388) 7737 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:09 smithi027 bash[22610]: cluster 2024-08-31T05:10:08.203455+0000 mgr.a (mgr.14388) 7737 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:09 smithi191 bash[24992]: cluster 2024-08-31T05:10:08.203455+0000 mgr.a (mgr.14388) 7737 : cluster [DBG] pgmap v5362: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:11 smithi163 bash[24253]: cluster 2024-08-31T05:10:10.204478+0000 mgr.a (mgr.14388) 7738 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:10:11.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:11 smithi027 bash[22610]: cluster 2024-08-31T05:10:10.204478+0000 mgr.a (mgr.14388) 7738 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:10:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:11 smithi191 bash[24992]: cluster 2024-08-31T05:10:10.204478+0000 mgr.a (mgr.14388) 7738 : cluster [DBG] pgmap v5363: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:10:13.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:13.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:13.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:10:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:13 smithi163 bash[24253]: cluster 2024-08-31T05:10:12.205440+0000 mgr.a (mgr.14388) 7739 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:10:13.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:13 smithi027 bash[22610]: cluster 2024-08-31T05:10:12.205440+0000 mgr.a (mgr.14388) 7739 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:10:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:13 smithi191 bash[24992]: cluster 2024-08-31T05:10:12.205440+0000 mgr.a (mgr.14388) 7739 : cluster [DBG] pgmap v5364: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:10:14.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:10:14.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:10:14.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:10:14.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:10:14.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:10:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:14 smithi163 bash[24253]: audit 2024-08-31T05:10:13.886511+0000 mgr.a (mgr.14388) 7740 : audit [DBG] from='client.174810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:14.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:14 smithi027 bash[22610]: audit 2024-08-31T05:10:13.886511+0000 mgr.a (mgr.14388) 7740 : audit [DBG] from='client.174810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:14 smithi191 bash[24992]: audit 2024-08-31T05:10:13.886511+0000 mgr.a (mgr.14388) 7740 : audit [DBG] from='client.174810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:15 smithi163 bash[24253]: cluster 2024-08-31T05:10:14.206824+0000 mgr.a (mgr.14388) 7741 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:15.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:15 smithi027 bash[22610]: cluster 2024-08-31T05:10:14.206824+0000 mgr.a (mgr.14388) 7741 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:15 smithi191 bash[24992]: cluster 2024-08-31T05:10:14.206824+0000 mgr.a (mgr.14388) 7741 : cluster [DBG] pgmap v5365: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:17 smithi163 bash[24253]: cluster 2024-08-31T05:10:16.207505+0000 mgr.a (mgr.14388) 7742 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:10:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:17 smithi027 bash[22610]: cluster 2024-08-31T05:10:16.207505+0000 mgr.a (mgr.14388) 7742 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:10:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:17 smithi191 bash[24992]: cluster 2024-08-31T05:10:16.207505+0000 mgr.a (mgr.14388) 7742 : cluster [DBG] pgmap v5366: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:10:19.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:19.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:19.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:10:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:19 smithi163 bash[24253]: cluster 2024-08-31T05:10:18.209431+0000 mgr.a (mgr.14388) 7743 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:19 smithi027 bash[22610]: cluster 2024-08-31T05:10:18.209431+0000 mgr.a (mgr.14388) 7743 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:19 smithi191 bash[24992]: cluster 2024-08-31T05:10:18.209431+0000 mgr.a (mgr.14388) 7743 : cluster [DBG] pgmap v5367: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:20.048 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:10:20.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:10:20.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:10:20.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:10:20.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:10:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:20 smithi163 bash[24253]: audit 2024-08-31T05:10:19.631576+0000 mgr.a (mgr.14388) 7744 : audit [DBG] from='client.174888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:20.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:20 smithi027 bash[22610]: audit 2024-08-31T05:10:19.631576+0000 mgr.a (mgr.14388) 7744 : audit [DBG] from='client.174888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:20 smithi191 bash[24992]: audit 2024-08-31T05:10:19.631576+0000 mgr.a (mgr.14388) 7744 : audit [DBG] from='client.174888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:21 smithi163 bash[24253]: cluster 2024-08-31T05:10:20.210518+0000 mgr.a (mgr.14388) 7745 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:21.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:21 smithi027 bash[22610]: cluster 2024-08-31T05:10:20.210518+0000 mgr.a (mgr.14388) 7745 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:21 smithi191 bash[24992]: cluster 2024-08-31T05:10:20.210518+0000 mgr.a (mgr.14388) 7745 : cluster [DBG] pgmap v5368: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:23 smithi163 bash[24253]: cluster 2024-08-31T05:10:22.211349+0000 mgr.a (mgr.14388) 7746 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:23 smithi027 bash[22610]: cluster 2024-08-31T05:10:22.211349+0000 mgr.a (mgr.14388) 7746 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:23 smithi191 bash[24992]: cluster 2024-08-31T05:10:22.211349+0000 mgr.a (mgr.14388) 7746 : cluster [DBG] pgmap v5369: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:25.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:25.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:25.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:10:25.828 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:10:25.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:10:25.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:10:25.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:10:25.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:10:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:25 smithi163 bash[24253]: cluster 2024-08-31T05:10:24.213558+0000 mgr.a (mgr.14388) 7747 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:25.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:25 smithi027 bash[22610]: cluster 2024-08-31T05:10:24.213558+0000 mgr.a (mgr.14388) 7747 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:25 smithi191 bash[24992]: cluster 2024-08-31T05:10:24.213558+0000 mgr.a (mgr.14388) 7747 : cluster [DBG] pgmap v5370: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:26 smithi163 bash[24253]: audit 2024-08-31T05:10:25.387581+0000 mgr.a (mgr.14388) 7748 : audit [DBG] from='client.174960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:26.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:26 smithi027 bash[22610]: audit 2024-08-31T05:10:25.387581+0000 mgr.a (mgr.14388) 7748 : audit [DBG] from='client.174960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:26 smithi191 bash[24992]: audit 2024-08-31T05:10:25.387581+0000 mgr.a (mgr.14388) 7748 : audit [DBG] from='client.174960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:27 smithi163 bash[24253]: cluster 2024-08-31T05:10:26.214520+0000 mgr.a (mgr.14388) 7749 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:27 smithi163 bash[24253]: audit 2024-08-31T05:10:27.606153+0000 mon.a (mon.0) 1736 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:10:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:27 smithi027 bash[22610]: cluster 2024-08-31T05:10:26.214520+0000 mgr.a (mgr.14388) 7749 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:27 smithi027 bash[22610]: audit 2024-08-31T05:10:27.606153+0000 mon.a (mon.0) 1736 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:10:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:27 smithi191 bash[24992]: cluster 2024-08-31T05:10:26.214520+0000 mgr.a (mgr.14388) 7749 : cluster [DBG] pgmap v5371: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:27 smithi191 bash[24992]: audit 2024-08-31T05:10:27.606153+0000 mon.a (mon.0) 1736 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:10:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:29 smithi027 bash[22610]: cluster 2024-08-31T05:10:28.215664+0000 mgr.a (mgr.14388) 7750 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:29 smithi191 bash[24992]: cluster 2024-08-31T05:10:28.215664+0000 mgr.a (mgr.14388) 7750 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:29 smithi163 bash[24253]: cluster 2024-08-31T05:10:28.215664+0000 mgr.a (mgr.14388) 7750 : cluster [DBG] pgmap v5372: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:30.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:30.830 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:30.831 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:10:31.565 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:10:31.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:10:31.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:10:31.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:10:31.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:10:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:31 smithi027 bash[22610]: cluster 2024-08-31T05:10:30.216345+0000 mgr.a (mgr.14388) 7751 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:31 smithi027 bash[22610]: audit 2024-08-31T05:10:31.156852+0000 mgr.a (mgr.14388) 7752 : audit [DBG] from='client.175035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:31 smithi191 bash[24992]: cluster 2024-08-31T05:10:30.216345+0000 mgr.a (mgr.14388) 7751 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:31 smithi191 bash[24992]: audit 2024-08-31T05:10:31.156852+0000 mgr.a (mgr.14388) 7752 : audit [DBG] from='client.175035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:31 smithi163 bash[24253]: cluster 2024-08-31T05:10:30.216345+0000 mgr.a (mgr.14388) 7751 : cluster [DBG] pgmap v5373: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:31 smithi163 bash[24253]: audit 2024-08-31T05:10:31.156852+0000 mgr.a (mgr.14388) 7752 : audit [DBG] from='client.175035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: cluster 2024-08-31T05:10:32.217226+0000 mgr.a (mgr.14388) 7753 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: audit 2024-08-31T05:10:32.969968+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: audit 2024-08-31T05:10:32.975224+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: audit 2024-08-31T05:10:32.982252+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: audit 2024-08-31T05:10:32.985373+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: audit 2024-08-31T05:10:32.994304+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: audit 2024-08-31T05:10:32.999326+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: audit 2024-08-31T05:10:33.730343+0000 mon.a (mon.0) 1743 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:10:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: audit 2024-08-31T05:10:33.733052+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:10:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: audit 2024-08-31T05:10:33.741280+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:33 smithi027 bash[22610]: audit 2024-08-31T05:10:33.745986+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:10:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: cluster 2024-08-31T05:10:32.217226+0000 mgr.a (mgr.14388) 7753 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: audit 2024-08-31T05:10:32.969968+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: audit 2024-08-31T05:10:32.975224+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: audit 2024-08-31T05:10:32.982252+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: audit 2024-08-31T05:10:32.985373+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: audit 2024-08-31T05:10:32.994304+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: audit 2024-08-31T05:10:32.999326+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: audit 2024-08-31T05:10:33.730343+0000 mon.a (mon.0) 1743 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:10:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: audit 2024-08-31T05:10:33.733052+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:10:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: audit 2024-08-31T05:10:33.741280+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:33 smithi191 bash[24992]: audit 2024-08-31T05:10:33.745986+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: cluster 2024-08-31T05:10:32.217226+0000 mgr.a (mgr.14388) 7753 : cluster [DBG] pgmap v5374: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: audit 2024-08-31T05:10:32.969968+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: audit 2024-08-31T05:10:32.975224+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: audit 2024-08-31T05:10:32.982252+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: audit 2024-08-31T05:10:32.985373+0000 mon.a (mon.0) 1740 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: audit 2024-08-31T05:10:32.994304+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: audit 2024-08-31T05:10:32.999326+0000 mon.a (mon.0) 1742 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: audit 2024-08-31T05:10:33.730343+0000 mon.a (mon.0) 1743 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: audit 2024-08-31T05:10:33.733052+0000 mon.a (mon.0) 1744 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: audit 2024-08-31T05:10:33.741280+0000 mon.a (mon.0) 1745 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:10:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:33 smithi163 bash[24253]: audit 2024-08-31T05:10:33.745986+0000 mon.a (mon.0) 1746 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:10:34.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:10:34 smithi027 bash[22863]: debug 2024-08-31T05:10:34.466+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:10:34.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:10:34 smithi027 bash[22863]: debug 2024-08-31T05:10:34.466+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:10:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:34 smithi027 bash[22610]: audit 2024-08-31T05:10:33.748277+0000 mgr.a (mgr.14388) 7754 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:10:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:34 smithi191 bash[24992]: audit 2024-08-31T05:10:33.748277+0000 mgr.a (mgr.14388) 7754 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:10:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:34 smithi163 bash[24253]: audit 2024-08-31T05:10:33.748277+0000 mgr.a (mgr.14388) 7754 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:10:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:35 smithi027 bash[22610]: cluster 2024-08-31T05:10:34.218618+0000 mgr.a (mgr.14388) 7755 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:35 smithi027 bash[22610]: audit 2024-08-31T05:10:34.467004+0000 mgr.a (mgr.14388) 7756 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:10:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:35 smithi027 bash[22610]: cephadm 2024-08-31T05:10:34.468422+0000 mgr.a (mgr.14388) 7757 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:10:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:35 smithi191 bash[24992]: cluster 2024-08-31T05:10:34.218618+0000 mgr.a (mgr.14388) 7755 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:35 smithi191 bash[24992]: audit 2024-08-31T05:10:34.467004+0000 mgr.a (mgr.14388) 7756 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:10:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:35 smithi191 bash[24992]: cephadm 2024-08-31T05:10:34.468422+0000 mgr.a (mgr.14388) 7757 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:10:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:35 smithi163 bash[24253]: cluster 2024-08-31T05:10:34.218618+0000 mgr.a (mgr.14388) 7755 : cluster [DBG] pgmap v5375: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:10:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:35 smithi163 bash[24253]: audit 2024-08-31T05:10:34.467004+0000 mgr.a (mgr.14388) 7756 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:10:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:35 smithi163 bash[24253]: cephadm 2024-08-31T05:10:34.468422+0000 mgr.a (mgr.14388) 7757 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:10:36.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:36.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:36.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:10:37.316 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:10:37.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:10:37.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:10:37.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:10:37.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:10:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:37 smithi191 bash[24992]: cluster 2024-08-31T05:10:36.219481+0000 mgr.a (mgr.14388) 7758 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:37 smithi191 bash[24992]: audit 2024-08-31T05:10:36.899870+0000 mgr.a (mgr.14388) 7759 : audit [DBG] from='client.175215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:37 smithi163 bash[24253]: cluster 2024-08-31T05:10:36.219481+0000 mgr.a (mgr.14388) 7758 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:38.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:37 smithi163 bash[24253]: audit 2024-08-31T05:10:36.899870+0000 mgr.a (mgr.14388) 7759 : audit [DBG] from='client.175215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:38.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:37 smithi027 bash[22610]: cluster 2024-08-31T05:10:36.219481+0000 mgr.a (mgr.14388) 7758 : cluster [DBG] pgmap v5376: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:37 smithi027 bash[22610]: audit 2024-08-31T05:10:36.899870+0000 mgr.a (mgr.14388) 7759 : audit [DBG] from='client.175215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:39 smithi191 bash[24992]: cluster 2024-08-31T05:10:38.221967+0000 mgr.a (mgr.14388) 7760 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:39 smithi163 bash[24253]: cluster 2024-08-31T05:10:38.221967+0000 mgr.a (mgr.14388) 7760 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:39 smithi027 bash[22610]: cluster 2024-08-31T05:10:38.221967+0000 mgr.a (mgr.14388) 7760 : cluster [DBG] pgmap v5377: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:41 smithi191 bash[24992]: cluster 2024-08-31T05:10:40.222804+0000 mgr.a (mgr.14388) 7761 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:42.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:42.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:42.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:10:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:41 smithi163 bash[24253]: cluster 2024-08-31T05:10:40.222804+0000 mgr.a (mgr.14388) 7761 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:42.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:41 smithi027 bash[22610]: cluster 2024-08-31T05:10:40.222804+0000 mgr.a (mgr.14388) 7761 : cluster [DBG] pgmap v5378: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:43.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:10:43.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:10:43.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:10:43.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:10:43.100 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:10:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:43 smithi191 bash[24992]: cluster 2024-08-31T05:10:42.223567+0000 mgr.a (mgr.14388) 7762 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:43 smithi191 bash[24992]: audit 2024-08-31T05:10:42.661419+0000 mgr.a (mgr.14388) 7763 : audit [DBG] from='client.175293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:43 smithi163 bash[24253]: cluster 2024-08-31T05:10:42.223567+0000 mgr.a (mgr.14388) 7762 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:43 smithi163 bash[24253]: audit 2024-08-31T05:10:42.661419+0000 mgr.a (mgr.14388) 7763 : audit [DBG] from='client.175293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:43 smithi027 bash[22610]: cluster 2024-08-31T05:10:42.223567+0000 mgr.a (mgr.14388) 7762 : cluster [DBG] pgmap v5379: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:43 smithi027 bash[22610]: audit 2024-08-31T05:10:42.661419+0000 mgr.a (mgr.14388) 7763 : audit [DBG] from='client.175293 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:46 smithi191 bash[24992]: cluster 2024-08-31T05:10:44.226284+0000 mgr.a (mgr.14388) 7764 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:46 smithi163 bash[24253]: cluster 2024-08-31T05:10:44.226284+0000 mgr.a (mgr.14388) 7764 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:46 smithi027 bash[22610]: cluster 2024-08-31T05:10:44.226284+0000 mgr.a (mgr.14388) 7764 : cluster [DBG] pgmap v5380: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:10:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:48 smithi191 bash[24992]: cluster 2024-08-31T05:10:46.227071+0000 mgr.a (mgr.14388) 7765 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:10:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:48 smithi163 bash[24253]: cluster 2024-08-31T05:10:46.227071+0000 mgr.a (mgr.14388) 7765 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:10:48.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:48 smithi027 bash[22610]: cluster 2024-08-31T05:10:46.227071+0000 mgr.a (mgr.14388) 7765 : cluster [DBG] pgmap v5381: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:10:48.853 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:10:48.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:10:48.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:10:48.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:10:48.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:10:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:50 smithi191 bash[24992]: cluster 2024-08-31T05:10:48.228357+0000 mgr.a (mgr.14388) 7766 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:50 smithi191 bash[24992]: audit 2024-08-31T05:10:48.432039+0000 mgr.a (mgr.14388) 7767 : audit [DBG] from='client.175368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:50 smithi163 bash[24253]: cluster 2024-08-31T05:10:48.228357+0000 mgr.a (mgr.14388) 7766 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:50 smithi163 bash[24253]: audit 2024-08-31T05:10:48.432039+0000 mgr.a (mgr.14388) 7767 : audit [DBG] from='client.175368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:50 smithi027 bash[22610]: cluster 2024-08-31T05:10:48.228357+0000 mgr.a (mgr.14388) 7766 : cluster [DBG] pgmap v5382: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:10:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:50 smithi027 bash[22610]: audit 2024-08-31T05:10:48.432039+0000 mgr.a (mgr.14388) 7767 : audit [DBG] from='client.175368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:52 smithi191 bash[24992]: cluster 2024-08-31T05:10:50.229208+0000 mgr.a (mgr.14388) 7768 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:10:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:52 smithi163 bash[24253]: cluster 2024-08-31T05:10:50.229208+0000 mgr.a (mgr.14388) 7768 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:10:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:52 smithi027 bash[22610]: cluster 2024-08-31T05:10:50.229208+0000 mgr.a (mgr.14388) 7768 : cluster [DBG] pgmap v5383: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:10:53.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:53.855 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:10:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:54 smithi191 bash[24992]: cluster 2024-08-31T05:10:52.230138+0000 mgr.a (mgr.14388) 7769 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:10:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:54 smithi163 bash[24253]: cluster 2024-08-31T05:10:52.230138+0000 mgr.a (mgr.14388) 7769 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:10:54.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:54 smithi027 bash[22610]: cluster 2024-08-31T05:10:52.230138+0000 mgr.a (mgr.14388) 7769 : cluster [DBG] pgmap v5384: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:10:54.634 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:10:54.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:10:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:10:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:10:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:10:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:56 smithi191 bash[24992]: audit 2024-08-31T05:10:54.191520+0000 mgr.a (mgr.14388) 7770 : audit [DBG] from='client.175446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:56 smithi191 bash[24992]: cluster 2024-08-31T05:10:54.233221+0000 mgr.a (mgr.14388) 7771 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:56 smithi163 bash[24253]: audit 2024-08-31T05:10:54.191520+0000 mgr.a (mgr.14388) 7770 : audit [DBG] from='client.175446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:56 smithi163 bash[24253]: cluster 2024-08-31T05:10:54.233221+0000 mgr.a (mgr.14388) 7771 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:56 smithi027 bash[22610]: audit 2024-08-31T05:10:54.191520+0000 mgr.a (mgr.14388) 7770 : audit [DBG] from='client.175446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:10:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:56 smithi027 bash[22610]: cluster 2024-08-31T05:10:54.233221+0000 mgr.a (mgr.14388) 7771 : cluster [DBG] pgmap v5385: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:10:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:10:58 smithi191 bash[24992]: cluster 2024-08-31T05:10:56.234160+0000 mgr.a (mgr.14388) 7772 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:10:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:10:58 smithi163 bash[24253]: cluster 2024-08-31T05:10:56.234160+0000 mgr.a (mgr.14388) 7772 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:10:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:10:58 smithi027 bash[22610]: cluster 2024-08-31T05:10:56.234160+0000 mgr.a (mgr.14388) 7772 : cluster [DBG] pgmap v5386: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:10:59.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:10:59.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:10:59.637 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:00 smithi191 bash[24992]: cluster 2024-08-31T05:10:58.236415+0000 mgr.a (mgr.14388) 7773 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:11:00.414 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:00.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:00.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:00.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:00.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:00 smithi163 bash[24253]: cluster 2024-08-31T05:10:58.236415+0000 mgr.a (mgr.14388) 7773 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:11:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:00 smithi027 bash[22610]: cluster 2024-08-31T05:10:58.236415+0000 mgr.a (mgr.14388) 7773 : cluster [DBG] pgmap v5387: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:11:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:01 smithi163 bash[24253]: audit 2024-08-31T05:10:59.977688+0000 mgr.a (mgr.14388) 7774 : audit [DBG] from='client.175524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:01 smithi027 bash[22610]: audit 2024-08-31T05:10:59.977688+0000 mgr.a (mgr.14388) 7774 : audit [DBG] from='client.175524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:01 smithi191 bash[24992]: audit 2024-08-31T05:10:59.977688+0000 mgr.a (mgr.14388) 7774 : audit [DBG] from='client.175524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:02 smithi163 bash[24253]: cluster 2024-08-31T05:11:00.237028+0000 mgr.a (mgr.14388) 7775 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:02 smithi027 bash[22610]: cluster 2024-08-31T05:11:00.237028+0000 mgr.a (mgr.14388) 7775 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:02 smithi191 bash[24992]: cluster 2024-08-31T05:11:00.237028+0000 mgr.a (mgr.14388) 7775 : cluster [DBG] pgmap v5388: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:04 smithi163 bash[24253]: cluster 2024-08-31T05:11:02.237829+0000 mgr.a (mgr.14388) 7776 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:04 smithi027 bash[22610]: cluster 2024-08-31T05:11:02.237829+0000 mgr.a (mgr.14388) 7776 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:04 smithi191 bash[24992]: cluster 2024-08-31T05:11:02.237829+0000 mgr.a (mgr.14388) 7776 : cluster [DBG] pgmap v5389: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:05.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:11:05.417 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:11:05.417 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:06.175 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:06.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:06.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:06.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:06.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:06 smithi163 bash[24253]: cluster 2024-08-31T05:11:04.240062+0000 mgr.a (mgr.14388) 7777 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:06.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:06 smithi027 bash[22610]: cluster 2024-08-31T05:11:04.240062+0000 mgr.a (mgr.14388) 7777 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:06 smithi191 bash[24992]: cluster 2024-08-31T05:11:04.240062+0000 mgr.a (mgr.14388) 7777 : cluster [DBG] pgmap v5390: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:07 smithi163 bash[24253]: audit 2024-08-31T05:11:05.751155+0000 mgr.a (mgr.14388) 7778 : audit [DBG] from='client.175599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:07 smithi027 bash[22610]: audit 2024-08-31T05:11:05.751155+0000 mgr.a (mgr.14388) 7778 : audit [DBG] from='client.175599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:07 smithi191 bash[24992]: audit 2024-08-31T05:11:05.751155+0000 mgr.a (mgr.14388) 7778 : audit [DBG] from='client.175599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:08 smithi163 bash[24253]: cluster 2024-08-31T05:11:06.240560+0000 mgr.a (mgr.14388) 7779 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:08 smithi027 bash[22610]: cluster 2024-08-31T05:11:06.240560+0000 mgr.a (mgr.14388) 7779 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:08 smithi191 bash[24992]: cluster 2024-08-31T05:11:06.240560+0000 mgr.a (mgr.14388) 7779 : cluster [DBG] pgmap v5391: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:10 smithi163 bash[24253]: cluster 2024-08-31T05:11:08.242596+0000 mgr.a (mgr.14388) 7780 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:10 smithi027 bash[22610]: cluster 2024-08-31T05:11:08.242596+0000 mgr.a (mgr.14388) 7780 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:10 smithi191 bash[24992]: cluster 2024-08-31T05:11:08.242596+0000 mgr.a (mgr.14388) 7780 : cluster [DBG] pgmap v5392: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:11.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:11:11.177 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:11:11.177 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:11.944 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:11.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:11.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:11.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:11.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:12 smithi163 bash[24253]: cluster 2024-08-31T05:11:10.243346+0000 mgr.a (mgr.14388) 7781 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:12 smithi027 bash[22610]: cluster 2024-08-31T05:11:10.243346+0000 mgr.a (mgr.14388) 7781 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:12 smithi191 bash[24992]: cluster 2024-08-31T05:11:10.243346+0000 mgr.a (mgr.14388) 7781 : cluster [DBG] pgmap v5393: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:13 smithi163 bash[24253]: audit 2024-08-31T05:11:11.509996+0000 mgr.a (mgr.14388) 7782 : audit [DBG] from='client.175677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:13 smithi027 bash[22610]: audit 2024-08-31T05:11:11.509996+0000 mgr.a (mgr.14388) 7782 : audit [DBG] from='client.175677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:13 smithi191 bash[24992]: audit 2024-08-31T05:11:11.509996+0000 mgr.a (mgr.14388) 7782 : audit [DBG] from='client.175677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:14 smithi163 bash[24253]: cluster 2024-08-31T05:11:12.244205+0000 mgr.a (mgr.14388) 7783 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:14 smithi027 bash[22610]: cluster 2024-08-31T05:11:12.244205+0000 mgr.a (mgr.14388) 7783 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:14 smithi191 bash[24992]: cluster 2024-08-31T05:11:12.244205+0000 mgr.a (mgr.14388) 7783 : cluster [DBG] pgmap v5394: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:16 smithi163 bash[24253]: cluster 2024-08-31T05:11:14.246391+0000 mgr.a (mgr.14388) 7784 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:16 smithi027 bash[22610]: cluster 2024-08-31T05:11:14.246391+0000 mgr.a (mgr.14388) 7784 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:16 smithi191 bash[24992]: cluster 2024-08-31T05:11:14.246391+0000 mgr.a (mgr.14388) 7784 : cluster [DBG] pgmap v5395: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:16.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:11:16.946 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:11:16.946 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:17.685 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:17.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:17.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:17.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:17.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:18 smithi163 bash[24253]: cluster 2024-08-31T05:11:16.247152+0000 mgr.a (mgr.14388) 7785 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:18 smithi027 bash[22610]: cluster 2024-08-31T05:11:16.247152+0000 mgr.a (mgr.14388) 7785 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:18 smithi191 bash[24992]: cluster 2024-08-31T05:11:16.247152+0000 mgr.a (mgr.14388) 7785 : cluster [DBG] pgmap v5396: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:19 smithi163 bash[24253]: audit 2024-08-31T05:11:17.278780+0000 mgr.a (mgr.14388) 7786 : audit [DBG] from='client.175755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:19 smithi027 bash[22610]: audit 2024-08-31T05:11:17.278780+0000 mgr.a (mgr.14388) 7786 : audit [DBG] from='client.175755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:19 smithi191 bash[24992]: audit 2024-08-31T05:11:17.278780+0000 mgr.a (mgr.14388) 7786 : audit [DBG] from='client.175755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:20 smithi163 bash[24253]: cluster 2024-08-31T05:11:18.249351+0000 mgr.a (mgr.14388) 7787 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:20 smithi027 bash[22610]: cluster 2024-08-31T05:11:18.249351+0000 mgr.a (mgr.14388) 7787 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:20 smithi191 bash[24992]: cluster 2024-08-31T05:11:18.249351+0000 mgr.a (mgr.14388) 7787 : cluster [DBG] pgmap v5397: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:22 smithi163 bash[24253]: cluster 2024-08-31T05:11:20.250088+0000 mgr.a (mgr.14388) 7788 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:22 smithi027 bash[22610]: cluster 2024-08-31T05:11:20.250088+0000 mgr.a (mgr.14388) 7788 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:22 smithi191 bash[24992]: cluster 2024-08-31T05:11:20.250088+0000 mgr.a (mgr.14388) 7788 : cluster [DBG] pgmap v5398: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:22.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:11:22.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:11:22.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:23.469 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:24 smithi163 bash[24253]: cluster 2024-08-31T05:11:22.250976+0000 mgr.a (mgr.14388) 7789 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:24 smithi163 bash[24253]: audit 2024-08-31T05:11:23.025452+0000 mgr.a (mgr.14388) 7790 : audit [DBG] from='client.175827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:24 smithi027 bash[22610]: cluster 2024-08-31T05:11:22.250976+0000 mgr.a (mgr.14388) 7789 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:24 smithi027 bash[22610]: audit 2024-08-31T05:11:23.025452+0000 mgr.a (mgr.14388) 7790 : audit [DBG] from='client.175827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:24 smithi191 bash[24992]: cluster 2024-08-31T05:11:22.250976+0000 mgr.a (mgr.14388) 7789 : cluster [DBG] pgmap v5399: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:24 smithi191 bash[24992]: audit 2024-08-31T05:11:23.025452+0000 mgr.a (mgr.14388) 7790 : audit [DBG] from='client.175827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:26 smithi163 bash[24253]: cluster 2024-08-31T05:11:24.253626+0000 mgr.a (mgr.14388) 7791 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:26 smithi027 bash[22610]: cluster 2024-08-31T05:11:24.253626+0000 mgr.a (mgr.14388) 7791 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:26 smithi191 bash[24992]: cluster 2024-08-31T05:11:24.253626+0000 mgr.a (mgr.14388) 7791 : cluster [DBG] pgmap v5400: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:28 smithi163 bash[24253]: cluster 2024-08-31T05:11:26.254366+0000 mgr.a (mgr.14388) 7792 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:11:28.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:11:28.471 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:11:28.471 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:28.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:28 smithi027 bash[22610]: cluster 2024-08-31T05:11:26.254366+0000 mgr.a (mgr.14388) 7792 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:11:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:28 smithi191 bash[24992]: cluster 2024-08-31T05:11:26.254366+0000 mgr.a (mgr.14388) 7792 : cluster [DBG] pgmap v5401: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:11:29.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:29.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:29.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:29.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:29.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:30 smithi163 bash[24253]: cluster 2024-08-31T05:11:28.256363+0000 mgr.a (mgr.14388) 7793 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:30 smithi163 bash[24253]: audit 2024-08-31T05:11:28.809124+0000 mgr.a (mgr.14388) 7794 : audit [DBG] from='client.175905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:30 smithi027 bash[22610]: cluster 2024-08-31T05:11:28.256363+0000 mgr.a (mgr.14388) 7793 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:30 smithi027 bash[22610]: audit 2024-08-31T05:11:28.809124+0000 mgr.a (mgr.14388) 7794 : audit [DBG] from='client.175905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:30 smithi191 bash[24992]: cluster 2024-08-31T05:11:28.256363+0000 mgr.a (mgr.14388) 7793 : cluster [DBG] pgmap v5402: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:30 smithi191 bash[24992]: audit 2024-08-31T05:11:28.809124+0000 mgr.a (mgr.14388) 7794 : audit [DBG] from='client.175905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:32 smithi163 bash[24253]: cluster 2024-08-31T05:11:30.257385+0000 mgr.a (mgr.14388) 7795 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:11:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:32 smithi027 bash[22610]: cluster 2024-08-31T05:11:30.257385+0000 mgr.a (mgr.14388) 7795 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:11:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:32 smithi191 bash[24992]: cluster 2024-08-31T05:11:30.257385+0000 mgr.a (mgr.14388) 7795 : cluster [DBG] pgmap v5403: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:11:34.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:11:34.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:11:34.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:34 smithi163 bash[24253]: cluster 2024-08-31T05:11:32.258191+0000 mgr.a (mgr.14388) 7796 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:11:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:34 smithi027 bash[22610]: cluster 2024-08-31T05:11:32.258191+0000 mgr.a (mgr.14388) 7796 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:11:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:34 smithi191 bash[24992]: cluster 2024-08-31T05:11:32.258191+0000 mgr.a (mgr.14388) 7796 : cluster [DBG] pgmap v5404: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:11:35.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:35.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:35.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:35.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:35.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:35 smithi163 bash[24253]: audit 2024-08-31T05:11:34.519422+0000 mon.a (mon.0) 1747 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:11:35.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:35 smithi027 bash[22610]: audit 2024-08-31T05:11:34.519422+0000 mon.a (mon.0) 1747 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:11:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:35 smithi191 bash[24992]: audit 2024-08-31T05:11:34.519422+0000 mon.a (mon.0) 1747 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:11:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:36 smithi163 bash[24253]: cluster 2024-08-31T05:11:34.260288+0000 mgr.a (mgr.14388) 7797 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:36 smithi163 bash[24253]: audit 2024-08-31T05:11:34.591388+0000 mgr.a (mgr.14388) 7798 : audit [DBG] from='client.175983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:36 smithi027 bash[22610]: cluster 2024-08-31T05:11:34.260288+0000 mgr.a (mgr.14388) 7797 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:36 smithi027 bash[22610]: audit 2024-08-31T05:11:34.591388+0000 mgr.a (mgr.14388) 7798 : audit [DBG] from='client.175983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:36 smithi191 bash[24992]: cluster 2024-08-31T05:11:34.260288+0000 mgr.a (mgr.14388) 7797 : cluster [DBG] pgmap v5405: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:36 smithi191 bash[24992]: audit 2024-08-31T05:11:34.591388+0000 mgr.a (mgr.14388) 7798 : audit [DBG] from='client.175983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:38 smithi163 bash[24253]: cluster 2024-08-31T05:11:36.261180+0000 mgr.a (mgr.14388) 7799 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:38 smithi027 bash[22610]: cluster 2024-08-31T05:11:36.261180+0000 mgr.a (mgr.14388) 7799 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:38 smithi191 bash[24992]: cluster 2024-08-31T05:11:36.261180+0000 mgr.a (mgr.14388) 7799 : cluster [DBG] pgmap v5406: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:40.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:11:40.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:11:40.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:40 smithi163 bash[24253]: cluster 2024-08-31T05:11:38.263398+0000 mgr.a (mgr.14388) 7800 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:40.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:40 smithi027 bash[22610]: cluster 2024-08-31T05:11:38.263398+0000 mgr.a (mgr.14388) 7800 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:40 smithi191 bash[24992]: cluster 2024-08-31T05:11:38.263398+0000 mgr.a (mgr.14388) 7800 : cluster [DBG] pgmap v5407: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:40.783 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:40.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:40.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:40.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:40.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:42 smithi027 bash[22610]: cluster 2024-08-31T05:11:40.264134+0000 mgr.a (mgr.14388) 7801 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:42 smithi027 bash[22610]: audit 2024-08-31T05:11:40.350253+0000 mgr.a (mgr.14388) 7802 : audit [DBG] from='client.176058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:42 smithi163 bash[24253]: cluster 2024-08-31T05:11:40.264134+0000 mgr.a (mgr.14388) 7801 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:42 smithi163 bash[24253]: audit 2024-08-31T05:11:40.350253+0000 mgr.a (mgr.14388) 7802 : audit [DBG] from='client.176058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:42 smithi191 bash[24992]: cluster 2024-08-31T05:11:40.264134+0000 mgr.a (mgr.14388) 7801 : cluster [DBG] pgmap v5408: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:42 smithi191 bash[24992]: audit 2024-08-31T05:11:40.350253+0000 mgr.a (mgr.14388) 7802 : audit [DBG] from='client.176058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:44 smithi163 bash[24253]: cluster 2024-08-31T05:11:42.265112+0000 mgr.a (mgr.14388) 7803 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:44.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:44 smithi027 bash[22610]: cluster 2024-08-31T05:11:42.265112+0000 mgr.a (mgr.14388) 7803 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:44 smithi191 bash[24992]: cluster 2024-08-31T05:11:42.265112+0000 mgr.a (mgr.14388) 7803 : cluster [DBG] pgmap v5409: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:45.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:11:45.784 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:11:45.785 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:46 smithi163 bash[24253]: cluster 2024-08-31T05:11:44.267258+0000 mgr.a (mgr.14388) 7804 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:46 smithi163 bash[24253]: audit 2024-08-31T05:11:45.589671+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:11:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:46 smithi163 bash[24253]: audit 2024-08-31T05:11:45.597594+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:11:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:46 smithi163 bash[24253]: audit 2024-08-31T05:11:45.599475+0000 mon.a (mon.0) 1750 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:11:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:46 smithi163 bash[24253]: audit 2024-08-31T05:11:45.601255+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:11:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:46 smithi163 bash[24253]: audit 2024-08-31T05:11:45.611070+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:11:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:46 smithi163 bash[24253]: audit 2024-08-31T05:11:45.615547+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:11:46.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:11:46 smithi027 bash[22863]: debug 2024-08-31T05:11:46.376+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:11:46.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:11:46 smithi027 bash[22863]: debug 2024-08-31T05:11:46.388+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:11:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:46 smithi027 bash[22610]: cluster 2024-08-31T05:11:44.267258+0000 mgr.a (mgr.14388) 7804 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:46 smithi027 bash[22610]: audit 2024-08-31T05:11:45.589671+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:11:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:46 smithi027 bash[22610]: audit 2024-08-31T05:11:45.597594+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:11:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:46 smithi027 bash[22610]: audit 2024-08-31T05:11:45.599475+0000 mon.a (mon.0) 1750 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:11:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:46 smithi027 bash[22610]: audit 2024-08-31T05:11:45.601255+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:11:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:46 smithi027 bash[22610]: audit 2024-08-31T05:11:45.611070+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:11:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:46 smithi027 bash[22610]: audit 2024-08-31T05:11:45.615547+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:11:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:46 smithi191 bash[24992]: cluster 2024-08-31T05:11:44.267258+0000 mgr.a (mgr.14388) 7804 : cluster [DBG] pgmap v5410: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:11:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:46 smithi191 bash[24992]: audit 2024-08-31T05:11:45.589671+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:11:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:46 smithi191 bash[24992]: audit 2024-08-31T05:11:45.597594+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:11:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:46 smithi191 bash[24992]: audit 2024-08-31T05:11:45.599475+0000 mon.a (mon.0) 1750 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:11:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:46 smithi191 bash[24992]: audit 2024-08-31T05:11:45.601255+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:11:46.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:46 smithi191 bash[24992]: audit 2024-08-31T05:11:45.611070+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:11:46.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:46 smithi191 bash[24992]: audit 2024-08-31T05:11:45.615547+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:11:46.788 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:46.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:46.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:46.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:46.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:47 smithi163 bash[24253]: audit 2024-08-31T05:11:45.617516+0000 mgr.a (mgr.14388) 7805 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:11:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:47 smithi163 bash[24253]: audit 2024-08-31T05:11:46.135998+0000 mgr.a (mgr.14388) 7806 : audit [DBG] from='client.176169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:47 smithi027 bash[22610]: audit 2024-08-31T05:11:45.617516+0000 mgr.a (mgr.14388) 7805 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:11:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:47 smithi027 bash[22610]: audit 2024-08-31T05:11:46.135998+0000 mgr.a (mgr.14388) 7806 : audit [DBG] from='client.176169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:47 smithi191 bash[24992]: audit 2024-08-31T05:11:45.617516+0000 mgr.a (mgr.14388) 7805 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:11:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:47 smithi191 bash[24992]: audit 2024-08-31T05:11:46.135998+0000 mgr.a (mgr.14388) 7806 : audit [DBG] from='client.176169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:48 smithi163 bash[24253]: cluster 2024-08-31T05:11:46.267694+0000 mgr.a (mgr.14388) 7807 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:48 smithi163 bash[24253]: audit 2024-08-31T05:11:46.380973+0000 mgr.a (mgr.14388) 7808 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:11:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:48 smithi163 bash[24253]: cephadm 2024-08-31T05:11:46.392529+0000 mgr.a (mgr.14388) 7809 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:11:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:48 smithi027 bash[22610]: cluster 2024-08-31T05:11:46.267694+0000 mgr.a (mgr.14388) 7807 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:48 smithi027 bash[22610]: audit 2024-08-31T05:11:46.380973+0000 mgr.a (mgr.14388) 7808 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:11:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:48 smithi027 bash[22610]: cephadm 2024-08-31T05:11:46.392529+0000 mgr.a (mgr.14388) 7809 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:11:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:48 smithi191 bash[24992]: cluster 2024-08-31T05:11:46.267694+0000 mgr.a (mgr.14388) 7807 : cluster [DBG] pgmap v5411: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:11:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:48 smithi191 bash[24992]: audit 2024-08-31T05:11:46.380973+0000 mgr.a (mgr.14388) 7808 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:11:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:48 smithi191 bash[24992]: cephadm 2024-08-31T05:11:46.392529+0000 mgr.a (mgr.14388) 7809 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:11:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:50 smithi163 bash[24253]: cluster 2024-08-31T05:11:48.270008+0000 mgr.a (mgr.14388) 7810 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:50 smithi027 bash[22610]: cluster 2024-08-31T05:11:48.270008+0000 mgr.a (mgr.14388) 7810 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:50 smithi191 bash[24992]: cluster 2024-08-31T05:11:48.270008+0000 mgr.a (mgr.14388) 7810 : cluster [DBG] pgmap v5412: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:51.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:11:51.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:11:51.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:52 smithi163 bash[24253]: cluster 2024-08-31T05:11:50.270838+0000 mgr.a (mgr.14388) 7811 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:52.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:52 smithi027 bash[22610]: cluster 2024-08-31T05:11:50.270838+0000 mgr.a (mgr.14388) 7811 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:52 smithi191 bash[24992]: cluster 2024-08-31T05:11:50.270838+0000 mgr.a (mgr.14388) 7811 : cluster [DBG] pgmap v5413: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:52.567 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:52.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:52.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:52.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:52.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:53 smithi163 bash[24253]: audit 2024-08-31T05:11:52.131165+0000 mgr.a (mgr.14388) 7812 : audit [DBG] from='client.176313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:53 smithi027 bash[22610]: audit 2024-08-31T05:11:52.131165+0000 mgr.a (mgr.14388) 7812 : audit [DBG] from='client.176313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:53 smithi191 bash[24992]: audit 2024-08-31T05:11:52.131165+0000 mgr.a (mgr.14388) 7812 : audit [DBG] from='client.176313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:54 smithi163 bash[24253]: cluster 2024-08-31T05:11:52.275014+0000 mgr.a (mgr.14388) 7813 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:54.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:54 smithi027 bash[22610]: cluster 2024-08-31T05:11:52.275014+0000 mgr.a (mgr.14388) 7813 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:54 smithi191 bash[24992]: cluster 2024-08-31T05:11:52.275014+0000 mgr.a (mgr.14388) 7813 : cluster [DBG] pgmap v5414: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:56 smithi163 bash[24253]: cluster 2024-08-31T05:11:54.277363+0000 mgr.a (mgr.14388) 7814 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:56 smithi027 bash[22610]: cluster 2024-08-31T05:11:54.277363+0000 mgr.a (mgr.14388) 7814 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:56 smithi191 bash[24992]: cluster 2024-08-31T05:11:54.277363+0000 mgr.a (mgr.14388) 7814 : cluster [DBG] pgmap v5415: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:57.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:11:57.569 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:11:57.569 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:11:58.362 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:11:58.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:11:58.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:11:58.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:11:58.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:11:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:58 smithi163 bash[24253]: cluster 2024-08-31T05:11:56.278151+0000 mgr.a (mgr.14388) 7815 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:58 smithi027 bash[22610]: cluster 2024-08-31T05:11:56.278151+0000 mgr.a (mgr.14388) 7815 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:58 smithi191 bash[24992]: cluster 2024-08-31T05:11:56.278151+0000 mgr.a (mgr.14388) 7815 : cluster [DBG] pgmap v5416: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:11:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:11:59 smithi027 bash[22610]: audit 2024-08-31T05:11:57.912818+0000 mgr.a (mgr.14388) 7816 : audit [DBG] from='client.176391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:11:59 smithi191 bash[24992]: audit 2024-08-31T05:11:57.912818+0000 mgr.a (mgr.14388) 7816 : audit [DBG] from='client.176391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:11:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:11:59 smithi163 bash[24253]: audit 2024-08-31T05:11:57.912818+0000 mgr.a (mgr.14388) 7816 : audit [DBG] from='client.176391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:00 smithi027 bash[22610]: cluster 2024-08-31T05:11:58.279534+0000 mgr.a (mgr.14388) 7817 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:12:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:00 smithi191 bash[24992]: cluster 2024-08-31T05:11:58.279534+0000 mgr.a (mgr.14388) 7817 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:12:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:00 smithi163 bash[24253]: cluster 2024-08-31T05:11:58.279534+0000 mgr.a (mgr.14388) 7817 : cluster [DBG] pgmap v5417: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:12:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:01 smithi027 bash[22610]: cluster 2024-08-31T05:12:00.280243+0000 mgr.a (mgr.14388) 7818 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:12:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:01 smithi191 bash[24992]: cluster 2024-08-31T05:12:00.280243+0000 mgr.a (mgr.14388) 7818 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:12:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:01 smithi163 bash[24253]: cluster 2024-08-31T05:12:00.280243+0000 mgr.a (mgr.14388) 7818 : cluster [DBG] pgmap v5418: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:12:03.363 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:12:03.364 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:12:03.364 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:12:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:03 smithi163 bash[24253]: cluster 2024-08-31T05:12:02.281018+0000 mgr.a (mgr.14388) 7819 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:12:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:03 smithi027 bash[22610]: cluster 2024-08-31T05:12:02.281018+0000 mgr.a (mgr.14388) 7819 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:12:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:03 smithi191 bash[24992]: cluster 2024-08-31T05:12:02.281018+0000 mgr.a (mgr.14388) 7819 : cluster [DBG] pgmap v5419: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:12:04.104 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:12:04.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:12:04.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:12:04.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:12:04.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:04 smithi163 bash[24253]: audit 2024-08-31T05:12:03.699595+0000 mgr.a (mgr.14388) 7820 : audit [DBG] from='client.176469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:04 smithi027 bash[22610]: audit 2024-08-31T05:12:03.699595+0000 mgr.a (mgr.14388) 7820 : audit [DBG] from='client.176469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:04 smithi191 bash[24992]: audit 2024-08-31T05:12:03.699595+0000 mgr.a (mgr.14388) 7820 : audit [DBG] from='client.176469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:05 smithi163 bash[24253]: cluster 2024-08-31T05:12:04.283777+0000 mgr.a (mgr.14388) 7821 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:05 smithi027 bash[22610]: cluster 2024-08-31T05:12:04.283777+0000 mgr.a (mgr.14388) 7821 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:05 smithi191 bash[24992]: cluster 2024-08-31T05:12:04.283777+0000 mgr.a (mgr.14388) 7821 : cluster [DBG] pgmap v5420: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:07 smithi163 bash[24253]: cluster 2024-08-31T05:12:06.284542+0000 mgr.a (mgr.14388) 7822 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:12:07.731 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:07 smithi027 bash[22610]: cluster 2024-08-31T05:12:06.284542+0000 mgr.a (mgr.14388) 7822 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:12:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:07 smithi191 bash[24992]: cluster 2024-08-31T05:12:06.284542+0000 mgr.a (mgr.14388) 7822 : cluster [DBG] pgmap v5421: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:12:09.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:12:09.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:12:09.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:12:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:09 smithi191 bash[24992]: cluster 2024-08-31T05:12:08.286470+0000 mgr.a (mgr.14388) 7823 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:09.881 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:12:09.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:12:09.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:12:09.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:12:09.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:12:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:09 smithi163 bash[24253]: cluster 2024-08-31T05:12:08.286470+0000 mgr.a (mgr.14388) 7823 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:09 smithi027 bash[22610]: cluster 2024-08-31T05:12:08.286470+0000 mgr.a (mgr.14388) 7823 : cluster [DBG] pgmap v5422: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:10 smithi191 bash[24992]: audit 2024-08-31T05:12:09.446829+0000 mgr.a (mgr.14388) 7824 : audit [DBG] from='client.176547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:10 smithi163 bash[24253]: audit 2024-08-31T05:12:09.446829+0000 mgr.a (mgr.14388) 7824 : audit [DBG] from='client.176547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:10 smithi027 bash[22610]: audit 2024-08-31T05:12:09.446829+0000 mgr.a (mgr.14388) 7824 : audit [DBG] from='client.176547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:11 smithi191 bash[24992]: cluster 2024-08-31T05:12:10.287620+0000 mgr.a (mgr.14388) 7825 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:11 smithi163 bash[24253]: cluster 2024-08-31T05:12:10.287620+0000 mgr.a (mgr.14388) 7825 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:11 smithi027 bash[22610]: cluster 2024-08-31T05:12:10.287620+0000 mgr.a (mgr.14388) 7825 : cluster [DBG] pgmap v5423: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:13 smithi191 bash[24992]: cluster 2024-08-31T05:12:12.288607+0000 mgr.a (mgr.14388) 7826 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:13 smithi163 bash[24253]: cluster 2024-08-31T05:12:12.288607+0000 mgr.a (mgr.14388) 7826 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:13.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:13 smithi027 bash[22610]: cluster 2024-08-31T05:12:12.288607+0000 mgr.a (mgr.14388) 7826 : cluster [DBG] pgmap v5424: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:14.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:12:14.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:12:14.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:12:15.669 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:12:15.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:12:15.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:12:15.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:12:15.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:12:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:15 smithi191 bash[24992]: cluster 2024-08-31T05:12:14.291007+0000 mgr.a (mgr.14388) 7827 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:15 smithi163 bash[24253]: cluster 2024-08-31T05:12:14.291007+0000 mgr.a (mgr.14388) 7827 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:15.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:15 smithi027 bash[22610]: cluster 2024-08-31T05:12:14.291007+0000 mgr.a (mgr.14388) 7827 : cluster [DBG] pgmap v5425: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:16 smithi191 bash[24992]: audit 2024-08-31T05:12:15.221441+0000 mgr.a (mgr.14388) 7828 : audit [DBG] from='client.176622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:16 smithi163 bash[24253]: audit 2024-08-31T05:12:15.221441+0000 mgr.a (mgr.14388) 7828 : audit [DBG] from='client.176622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:16 smithi027 bash[22610]: audit 2024-08-31T05:12:15.221441+0000 mgr.a (mgr.14388) 7828 : audit [DBG] from='client.176622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:17 smithi191 bash[24992]: cluster 2024-08-31T05:12:16.291953+0000 mgr.a (mgr.14388) 7829 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:17 smithi163 bash[24253]: cluster 2024-08-31T05:12:16.291953+0000 mgr.a (mgr.14388) 7829 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:17 smithi027 bash[22610]: cluster 2024-08-31T05:12:16.291953+0000 mgr.a (mgr.14388) 7829 : cluster [DBG] pgmap v5426: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:19 smithi163 bash[24253]: cluster 2024-08-31T05:12:18.294118+0000 mgr.a (mgr.14388) 7830 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:19.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:19 smithi027 bash[22610]: cluster 2024-08-31T05:12:18.294118+0000 mgr.a (mgr.14388) 7830 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:19 smithi191 bash[24992]: cluster 2024-08-31T05:12:18.294118+0000 mgr.a (mgr.14388) 7830 : cluster [DBG] pgmap v5427: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:20.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:12:20.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:12:20.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:12:21.459 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:12:21.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:12:21.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:12:21.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:12:21.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:12:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:21 smithi163 bash[24253]: cluster 2024-08-31T05:12:20.294903+0000 mgr.a (mgr.14388) 7831 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:21 smithi163 bash[24253]: audit 2024-08-31T05:12:21.008658+0000 mgr.a (mgr.14388) 7832 : audit [DBG] from='client.176697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:21 smithi027 bash[22610]: cluster 2024-08-31T05:12:20.294903+0000 mgr.a (mgr.14388) 7831 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:21 smithi027 bash[22610]: audit 2024-08-31T05:12:21.008658+0000 mgr.a (mgr.14388) 7832 : audit [DBG] from='client.176697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:21 smithi191 bash[24992]: cluster 2024-08-31T05:12:20.294903+0000 mgr.a (mgr.14388) 7831 : cluster [DBG] pgmap v5428: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:21 smithi191 bash[24992]: audit 2024-08-31T05:12:21.008658+0000 mgr.a (mgr.14388) 7832 : audit [DBG] from='client.176697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:23 smithi163 bash[24253]: cluster 2024-08-31T05:12:22.295868+0000 mgr.a (mgr.14388) 7833 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:23 smithi027 bash[22610]: cluster 2024-08-31T05:12:22.295868+0000 mgr.a (mgr.14388) 7833 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:23 smithi191 bash[24992]: cluster 2024-08-31T05:12:22.295868+0000 mgr.a (mgr.14388) 7833 : cluster [DBG] pgmap v5429: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:25 smithi163 bash[24253]: cluster 2024-08-31T05:12:24.298139+0000 mgr.a (mgr.14388) 7834 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T05:12:25.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:25 smithi027 bash[22610]: cluster 2024-08-31T05:12:24.298139+0000 mgr.a (mgr.14388) 7834 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T05:12:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:25 smithi191 bash[24992]: cluster 2024-08-31T05:12:24.298139+0000 mgr.a (mgr.14388) 7834 : cluster [DBG] pgmap v5430: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T05:12:26.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:12:26.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:12:26.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:12:27.235 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:12:27.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:12:27.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:12:27.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:12:27.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:12:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:27 smithi163 bash[24253]: cluster 2024-08-31T05:12:26.298901+0000 mgr.a (mgr.14388) 7835 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T05:12:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:27 smithi163 bash[24253]: audit 2024-08-31T05:12:26.801370+0000 mgr.a (mgr.14388) 7836 : audit [DBG] from='client.176775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:27.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:27 smithi027 bash[22610]: cluster 2024-08-31T05:12:26.298901+0000 mgr.a (mgr.14388) 7835 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T05:12:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:27 smithi027 bash[22610]: audit 2024-08-31T05:12:26.801370+0000 mgr.a (mgr.14388) 7836 : audit [DBG] from='client.176775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:27 smithi191 bash[24992]: cluster 2024-08-31T05:12:26.298901+0000 mgr.a (mgr.14388) 7835 : cluster [DBG] pgmap v5431: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T05:12:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:27 smithi191 bash[24992]: audit 2024-08-31T05:12:26.801370+0000 mgr.a (mgr.14388) 7836 : audit [DBG] from='client.176775 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:29 smithi163 bash[24253]: cluster 2024-08-31T05:12:28.301203+0000 mgr.a (mgr.14388) 7837 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T05:12:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:29 smithi027 bash[22610]: cluster 2024-08-31T05:12:28.301203+0000 mgr.a (mgr.14388) 7837 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T05:12:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:29 smithi191 bash[24992]: cluster 2024-08-31T05:12:28.301203+0000 mgr.a (mgr.14388) 7837 : cluster [DBG] pgmap v5432: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T05:12:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:31 smithi163 bash[24253]: cluster 2024-08-31T05:12:30.302004+0000 mgr.a (mgr.14388) 7838 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T05:12:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:31 smithi027 bash[22610]: cluster 2024-08-31T05:12:30.302004+0000 mgr.a (mgr.14388) 7838 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T05:12:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:31 smithi191 bash[24992]: cluster 2024-08-31T05:12:30.302004+0000 mgr.a (mgr.14388) 7838 : cluster [DBG] pgmap v5433: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T05:12:32.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:12:32.238 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:12:32.238 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:12:33.024 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:12:33.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:12:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:12:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:12:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:12:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:33 smithi163 bash[24253]: cluster 2024-08-31T05:12:32.302763+0000 mgr.a (mgr.14388) 7839 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T05:12:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:33 smithi163 bash[24253]: audit 2024-08-31T05:12:32.579928+0000 mgr.a (mgr.14388) 7840 : audit [DBG] from='client.176853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:33 smithi027 bash[22610]: cluster 2024-08-31T05:12:32.302763+0000 mgr.a (mgr.14388) 7839 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T05:12:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:33 smithi027 bash[22610]: audit 2024-08-31T05:12:32.579928+0000 mgr.a (mgr.14388) 7840 : audit [DBG] from='client.176853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:33 smithi191 bash[24992]: cluster 2024-08-31T05:12:32.302763+0000 mgr.a (mgr.14388) 7839 : cluster [DBG] pgmap v5434: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T05:12:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:33 smithi191 bash[24992]: audit 2024-08-31T05:12:32.579928+0000 mgr.a (mgr.14388) 7840 : audit [DBG] from='client.176853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:35 smithi163 bash[24253]: cluster 2024-08-31T05:12:34.305567+0000 mgr.a (mgr.14388) 7841 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-08-31T05:12:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:35 smithi027 bash[22610]: cluster 2024-08-31T05:12:34.305567+0000 mgr.a (mgr.14388) 7841 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-08-31T05:12:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:35 smithi191 bash[24992]: cluster 2024-08-31T05:12:34.305567+0000 mgr.a (mgr.14388) 7841 : cluster [DBG] pgmap v5435: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 55 KiB/s rd, 0 B/s wr, 90 op/s 2024-08-31T05:12:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:37 smithi163 bash[24253]: cluster 2024-08-31T05:12:36.306380+0000 mgr.a (mgr.14388) 7842 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:12:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:37 smithi027 bash[22610]: cluster 2024-08-31T05:12:36.306380+0000 mgr.a (mgr.14388) 7842 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:12:38.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:12:38.027 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:12:38.027 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:12:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:37 smithi191 bash[24992]: cluster 2024-08-31T05:12:36.306380+0000 mgr.a (mgr.14388) 7842 : cluster [DBG] pgmap v5436: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:12:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:12:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:12:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:12:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:12:38.813 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:12:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:39 smithi163 bash[24253]: cluster 2024-08-31T05:12:38.308289+0000 mgr.a (mgr.14388) 7843 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T05:12:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:39 smithi163 bash[24253]: audit 2024-08-31T05:12:38.361785+0000 mgr.a (mgr.14388) 7844 : audit [DBG] from='client.176925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:39 smithi027 bash[22610]: cluster 2024-08-31T05:12:38.308289+0000 mgr.a (mgr.14388) 7843 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T05:12:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:39 smithi027 bash[22610]: audit 2024-08-31T05:12:38.361785+0000 mgr.a (mgr.14388) 7844 : audit [DBG] from='client.176925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:39 smithi191 bash[24992]: cluster 2024-08-31T05:12:38.308289+0000 mgr.a (mgr.14388) 7843 : cluster [DBG] pgmap v5437: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T05:12:40.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:39 smithi191 bash[24992]: audit 2024-08-31T05:12:38.361785+0000 mgr.a (mgr.14388) 7844 : audit [DBG] from='client.176925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:41 smithi163 bash[24253]: cluster 2024-08-31T05:12:40.309194+0000 mgr.a (mgr.14388) 7845 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:12:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:41 smithi027 bash[22610]: cluster 2024-08-31T05:12:40.309194+0000 mgr.a (mgr.14388) 7845 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:12:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:41 smithi191 bash[24992]: cluster 2024-08-31T05:12:40.309194+0000 mgr.a (mgr.14388) 7845 : cluster [DBG] pgmap v5438: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:12:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:12:43.815 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:12:43.815 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:12:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:43 smithi163 bash[24253]: cluster 2024-08-31T05:12:42.309985+0000 mgr.a (mgr.14388) 7846 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:12:43.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:43 smithi027 bash[22610]: cluster 2024-08-31T05:12:42.309985+0000 mgr.a (mgr.14388) 7846 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:12:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:43 smithi191 bash[24992]: cluster 2024-08-31T05:12:42.309985+0000 mgr.a (mgr.14388) 7846 : cluster [DBG] pgmap v5439: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:12:44.587 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:12:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:12:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:12:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:12:44.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:12:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:44 smithi163 bash[24253]: audit 2024-08-31T05:12:44.153115+0000 mgr.a (mgr.14388) 7847 : audit [DBG] from='client.177000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:44.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:44 smithi027 bash[22610]: audit 2024-08-31T05:12:44.153115+0000 mgr.a (mgr.14388) 7847 : audit [DBG] from='client.177000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:44 smithi191 bash[24992]: audit 2024-08-31T05:12:44.153115+0000 mgr.a (mgr.14388) 7847 : audit [DBG] from='client.177000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:45 smithi163 bash[24253]: cluster 2024-08-31T05:12:44.311375+0000 mgr.a (mgr.14388) 7848 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T05:12:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:45 smithi027 bash[22610]: cluster 2024-08-31T05:12:44.311375+0000 mgr.a (mgr.14388) 7848 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T05:12:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:45 smithi191 bash[24992]: cluster 2024-08-31T05:12:44.311375+0000 mgr.a (mgr.14388) 7848 : cluster [DBG] pgmap v5440: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T05:12:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:46 smithi163 bash[24253]: audit 2024-08-31T05:12:46.453925+0000 mon.a (mon.0) 1754 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:12:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:46 smithi027 bash[22610]: audit 2024-08-31T05:12:46.453925+0000 mon.a (mon.0) 1754 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:12:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:46 smithi191 bash[24992]: audit 2024-08-31T05:12:46.453925+0000 mon.a (mon.0) 1754 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:12:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:47 smithi163 bash[24253]: cluster 2024-08-31T05:12:46.312261+0000 mgr.a (mgr.14388) 7849 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:47 smithi027 bash[22610]: cluster 2024-08-31T05:12:46.312261+0000 mgr.a (mgr.14388) 7849 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:47 smithi191 bash[24992]: cluster 2024-08-31T05:12:46.312261+0000 mgr.a (mgr.14388) 7849 : cluster [DBG] pgmap v5441: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:12:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:12:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:12:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:49 smithi163 bash[24253]: cluster 2024-08-31T05:12:48.314384+0000 mgr.a (mgr.14388) 7850 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:49.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:49 smithi027 bash[22610]: cluster 2024-08-31T05:12:48.314384+0000 mgr.a (mgr.14388) 7850 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:49 smithi191 bash[24992]: cluster 2024-08-31T05:12:48.314384+0000 mgr.a (mgr.14388) 7850 : cluster [DBG] pgmap v5442: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:50.340 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:12:50.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:12:50.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:12:50.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:12:50.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:12:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:50 smithi163 bash[24253]: audit 2024-08-31T05:12:49.924139+0000 mgr.a (mgr.14388) 7851 : audit [DBG] from='client.177075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:50 smithi027 bash[22610]: audit 2024-08-31T05:12:49.924139+0000 mgr.a (mgr.14388) 7851 : audit [DBG] from='client.177075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:50 smithi191 bash[24992]: audit 2024-08-31T05:12:49.924139+0000 mgr.a (mgr.14388) 7851 : audit [DBG] from='client.177075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:51 smithi163 bash[24253]: cluster 2024-08-31T05:12:50.314881+0000 mgr.a (mgr.14388) 7852 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:51.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:51 smithi027 bash[22610]: cluster 2024-08-31T05:12:50.314881+0000 mgr.a (mgr.14388) 7852 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:51 smithi191 bash[24992]: cluster 2024-08-31T05:12:50.314881+0000 mgr.a (mgr.14388) 7852 : cluster [DBG] pgmap v5443: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:53 smithi163 bash[24253]: cluster 2024-08-31T05:12:52.315571+0000 mgr.a (mgr.14388) 7853 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:53.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:53 smithi027 bash[22610]: cluster 2024-08-31T05:12:52.315571+0000 mgr.a (mgr.14388) 7853 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:53 smithi191 bash[24992]: cluster 2024-08-31T05:12:52.315571+0000 mgr.a (mgr.14388) 7853 : cluster [DBG] pgmap v5444: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:55.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:12:55.342 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:12:55.342 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:12:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:55 smithi163 bash[24253]: cluster 2024-08-31T05:12:54.317817+0000 mgr.a (mgr.14388) 7854 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:55.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:55 smithi027 bash[22610]: cluster 2024-08-31T05:12:54.317817+0000 mgr.a (mgr.14388) 7854 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:56.015 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:55 smithi191 bash[24992]: cluster 2024-08-31T05:12:54.317817+0000 mgr.a (mgr.14388) 7854 : cluster [DBG] pgmap v5445: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:12:56.110 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:12:56.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:12:56.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:12:56.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:12:56.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:12:56.908 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:56 smithi163 bash[24253]: audit 2024-08-31T05:12:55.681259+0000 mgr.a (mgr.14388) 7855 : audit [DBG] from='client.177153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:56 smithi027 bash[22610]: audit 2024-08-31T05:12:55.681259+0000 mgr.a (mgr.14388) 7855 : audit [DBG] from='client.177153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:56 smithi191 bash[24992]: audit 2024-08-31T05:12:55.681259+0000 mgr.a (mgr.14388) 7855 : audit [DBG] from='client.177153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:12:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:57 smithi163 bash[24253]: cluster 2024-08-31T05:12:56.318795+0000 mgr.a (mgr.14388) 7856 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:57 smithi163 bash[24253]: audit 2024-08-31T05:12:56.662711+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:57 smithi163 bash[24253]: audit 2024-08-31T05:12:56.671374+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:57 smithi163 bash[24253]: audit 2024-08-31T05:12:57.419854+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:57 smithi163 bash[24253]: audit 2024-08-31T05:12:57.428583+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:57 smithi163 bash[24253]: audit 2024-08-31T05:12:57.431017+0000 mon.a (mon.0) 1759 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:12:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:57 smithi163 bash[24253]: audit 2024-08-31T05:12:57.433239+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:12:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:57 smithi163 bash[24253]: audit 2024-08-31T05:12:57.444209+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:57 smithi163 bash[24253]: audit 2024-08-31T05:12:57.449580+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:12:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:57 smithi027 bash[22610]: cluster 2024-08-31T05:12:56.318795+0000 mgr.a (mgr.14388) 7856 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:57 smithi027 bash[22610]: audit 2024-08-31T05:12:56.662711+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:57 smithi027 bash[22610]: audit 2024-08-31T05:12:56.671374+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:57 smithi027 bash[22610]: audit 2024-08-31T05:12:57.419854+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:57 smithi027 bash[22610]: audit 2024-08-31T05:12:57.428583+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:57 smithi027 bash[22610]: audit 2024-08-31T05:12:57.431017+0000 mon.a (mon.0) 1759 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:12:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:57 smithi027 bash[22610]: audit 2024-08-31T05:12:57.433239+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:12:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:57 smithi027 bash[22610]: audit 2024-08-31T05:12:57.444209+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:57 smithi027 bash[22610]: audit 2024-08-31T05:12:57.449580+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:12:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:57 smithi191 bash[24992]: cluster 2024-08-31T05:12:56.318795+0000 mgr.a (mgr.14388) 7856 : cluster [DBG] pgmap v5446: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:12:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:57 smithi191 bash[24992]: audit 2024-08-31T05:12:56.662711+0000 mon.a (mon.0) 1755 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:57 smithi191 bash[24992]: audit 2024-08-31T05:12:56.671374+0000 mon.a (mon.0) 1756 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:57 smithi191 bash[24992]: audit 2024-08-31T05:12:57.419854+0000 mon.a (mon.0) 1757 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:57 smithi191 bash[24992]: audit 2024-08-31T05:12:57.428583+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:57 smithi191 bash[24992]: audit 2024-08-31T05:12:57.431017+0000 mon.a (mon.0) 1759 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:12:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:57 smithi191 bash[24992]: audit 2024-08-31T05:12:57.433239+0000 mon.a (mon.0) 1760 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:12:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:57 smithi191 bash[24992]: audit 2024-08-31T05:12:57.444209+0000 mon.a (mon.0) 1761 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:12:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:57 smithi191 bash[24992]: audit 2024-08-31T05:12:57.449580+0000 mon.a (mon.0) 1762 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:12:58.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:12:58 smithi027 bash[22863]: debug 2024-08-31T05:12:58.222+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:12:58.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:12:58 smithi027 bash[22863]: debug 2024-08-31T05:12:58.222+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:12:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:58 smithi163 bash[24253]: audit 2024-08-31T05:12:57.452123+0000 mgr.a (mgr.14388) 7857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:12:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:58 smithi027 bash[22610]: audit 2024-08-31T05:12:57.452123+0000 mgr.a (mgr.14388) 7857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:12:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:58 smithi191 bash[24992]: audit 2024-08-31T05:12:57.452123+0000 mgr.a (mgr.14388) 7857 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:12:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:59 smithi163 bash[24253]: audit 2024-08-31T05:12:58.222761+0000 mgr.a (mgr.14388) 7858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:12:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:59 smithi163 bash[24253]: cephadm 2024-08-31T05:12:58.224351+0000 mgr.a (mgr.14388) 7859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:12:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:12:59 smithi163 bash[24253]: cluster 2024-08-31T05:12:58.321625+0000 mgr.a (mgr.14388) 7860 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:12:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:59 smithi027 bash[22610]: audit 2024-08-31T05:12:58.222761+0000 mgr.a (mgr.14388) 7858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:12:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:59 smithi027 bash[22610]: cephadm 2024-08-31T05:12:58.224351+0000 mgr.a (mgr.14388) 7859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:12:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:12:59 smithi027 bash[22610]: cluster 2024-08-31T05:12:58.321625+0000 mgr.a (mgr.14388) 7860 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:13:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:59 smithi191 bash[24992]: audit 2024-08-31T05:12:58.222761+0000 mgr.a (mgr.14388) 7858 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:13:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:59 smithi191 bash[24992]: cephadm 2024-08-31T05:12:58.224351+0000 mgr.a (mgr.14388) 7859 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:13:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:12:59 smithi191 bash[24992]: cluster 2024-08-31T05:12:58.321625+0000 mgr.a (mgr.14388) 7860 : cluster [DBG] pgmap v5447: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:13:01.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:01.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:01.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:01.893 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:01.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:01.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:01.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:01.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:13:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:01 smithi163 bash[24253]: cluster 2024-08-31T05:13:00.322418+0000 mgr.a (mgr.14388) 7861 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:13:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:01 smithi027 bash[22610]: cluster 2024-08-31T05:13:00.322418+0000 mgr.a (mgr.14388) 7861 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:13:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:01 smithi191 bash[24992]: cluster 2024-08-31T05:13:00.322418+0000 mgr.a (mgr.14388) 7861 : cluster [DBG] pgmap v5448: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:13:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:02 smithi163 bash[24253]: audit 2024-08-31T05:13:01.447175+0000 mgr.a (mgr.14388) 7862 : audit [DBG] from='client.177336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:02 smithi027 bash[22610]: audit 2024-08-31T05:13:01.447175+0000 mgr.a (mgr.14388) 7862 : audit [DBG] from='client.177336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:02 smithi191 bash[24992]: audit 2024-08-31T05:13:01.447175+0000 mgr.a (mgr.14388) 7862 : audit [DBG] from='client.177336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:03 smithi163 bash[24253]: cluster 2024-08-31T05:13:02.323388+0000 mgr.a (mgr.14388) 7863 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:13:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:03 smithi027 bash[22610]: cluster 2024-08-31T05:13:02.323388+0000 mgr.a (mgr.14388) 7863 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:13:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:03 smithi191 bash[24992]: cluster 2024-08-31T05:13:02.323388+0000 mgr.a (mgr.14388) 7863 : cluster [DBG] pgmap v5449: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:13:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:05 smithi027 bash[22610]: cluster 2024-08-31T05:13:04.325611+0000 mgr.a (mgr.14388) 7864 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:13:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:05 smithi191 bash[24992]: cluster 2024-08-31T05:13:04.325611+0000 mgr.a (mgr.14388) 7864 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:13:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:05 smithi163 bash[24253]: cluster 2024-08-31T05:13:04.325611+0000 mgr.a (mgr.14388) 7864 : cluster [DBG] pgmap v5450: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:13:06.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:06.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:06.896 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:07.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:07.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:07.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:07.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:07.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:13:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:07 smithi027 bash[22610]: cluster 2024-08-31T05:13:06.326391+0000 mgr.a (mgr.14388) 7865 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:13:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:07 smithi191 bash[24992]: cluster 2024-08-31T05:13:06.326391+0000 mgr.a (mgr.14388) 7865 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:13:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:07 smithi163 bash[24253]: cluster 2024-08-31T05:13:06.326391+0000 mgr.a (mgr.14388) 7865 : cluster [DBG] pgmap v5451: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:13:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:08 smithi027 bash[22610]: audit 2024-08-31T05:13:07.230982+0000 mgr.a (mgr.14388) 7866 : audit [DBG] from='client.177414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:08 smithi191 bash[24992]: audit 2024-08-31T05:13:07.230982+0000 mgr.a (mgr.14388) 7866 : audit [DBG] from='client.177414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:08 smithi163 bash[24253]: audit 2024-08-31T05:13:07.230982+0000 mgr.a (mgr.14388) 7866 : audit [DBG] from='client.177414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:09 smithi027 bash[22610]: cluster 2024-08-31T05:13:08.328715+0000 mgr.a (mgr.14388) 7867 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:13:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:09 smithi191 bash[24992]: cluster 2024-08-31T05:13:08.328715+0000 mgr.a (mgr.14388) 7867 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:13:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:09 smithi163 bash[24253]: cluster 2024-08-31T05:13:08.328715+0000 mgr.a (mgr.14388) 7867 : cluster [DBG] pgmap v5452: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:13:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:11 smithi027 bash[22610]: cluster 2024-08-31T05:13:10.329501+0000 mgr.a (mgr.14388) 7868 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:13:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:11 smithi191 bash[24992]: cluster 2024-08-31T05:13:10.329501+0000 mgr.a (mgr.14388) 7868 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:13:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:11 smithi163 bash[24253]: cluster 2024-08-31T05:13:10.329501+0000 mgr.a (mgr.14388) 7868 : cluster [DBG] pgmap v5453: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:13:12.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:12.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:12.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:13.420 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:13.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:13.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:13.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:13.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:13:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:13 smithi027 bash[22610]: cluster 2024-08-31T05:13:12.330265+0000 mgr.a (mgr.14388) 7869 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:13:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:13 smithi027 bash[22610]: audit 2024-08-31T05:13:13.006777+0000 mgr.a (mgr.14388) 7870 : audit [DBG] from='client.177492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:13 smithi191 bash[24992]: cluster 2024-08-31T05:13:12.330265+0000 mgr.a (mgr.14388) 7869 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:13:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:13 smithi191 bash[24992]: audit 2024-08-31T05:13:13.006777+0000 mgr.a (mgr.14388) 7870 : audit [DBG] from='client.177492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:13 smithi163 bash[24253]: cluster 2024-08-31T05:13:12.330265+0000 mgr.a (mgr.14388) 7869 : cluster [DBG] pgmap v5454: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:13:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:13 smithi163 bash[24253]: audit 2024-08-31T05:13:13.006777+0000 mgr.a (mgr.14388) 7870 : audit [DBG] from='client.177492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:15 smithi027 bash[22610]: cluster 2024-08-31T05:13:14.333166+0000 mgr.a (mgr.14388) 7871 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:13:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:15 smithi191 bash[24992]: cluster 2024-08-31T05:13:14.333166+0000 mgr.a (mgr.14388) 7871 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:13:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:15 smithi163 bash[24253]: cluster 2024-08-31T05:13:14.333166+0000 mgr.a (mgr.14388) 7871 : cluster [DBG] pgmap v5455: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:13:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:17 smithi191 bash[24992]: cluster 2024-08-31T05:13:16.334124+0000 mgr.a (mgr.14388) 7872 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:13:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:17 smithi163 bash[24253]: cluster 2024-08-31T05:13:16.334124+0000 mgr.a (mgr.14388) 7872 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:13:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:17 smithi027 bash[22610]: cluster 2024-08-31T05:13:16.334124+0000 mgr.a (mgr.14388) 7872 : cluster [DBG] pgmap v5456: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:13:18.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:18.422 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:18.422 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:19.213 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:19.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:13:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:19 smithi191 bash[24992]: cluster 2024-08-31T05:13:18.336221+0000 mgr.a (mgr.14388) 7873 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:19 smithi191 bash[24992]: audit 2024-08-31T05:13:18.762490+0000 mgr.a (mgr.14388) 7874 : audit [DBG] from='client.177567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:19 smithi163 bash[24253]: cluster 2024-08-31T05:13:18.336221+0000 mgr.a (mgr.14388) 7873 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:19 smithi163 bash[24253]: audit 2024-08-31T05:13:18.762490+0000 mgr.a (mgr.14388) 7874 : audit [DBG] from='client.177567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:19 smithi027 bash[22610]: cluster 2024-08-31T05:13:18.336221+0000 mgr.a (mgr.14388) 7873 : cluster [DBG] pgmap v5457: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:19 smithi027 bash[22610]: audit 2024-08-31T05:13:18.762490+0000 mgr.a (mgr.14388) 7874 : audit [DBG] from='client.177567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:21 smithi191 bash[24992]: cluster 2024-08-31T05:13:20.337172+0000 mgr.a (mgr.14388) 7875 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:13:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:21 smithi163 bash[24253]: cluster 2024-08-31T05:13:20.337172+0000 mgr.a (mgr.14388) 7875 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:13:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:21 smithi027 bash[22610]: cluster 2024-08-31T05:13:20.337172+0000 mgr.a (mgr.14388) 7875 : cluster [DBG] pgmap v5458: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:13:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:23 smithi191 bash[24992]: cluster 2024-08-31T05:13:22.337975+0000 mgr.a (mgr.14388) 7876 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:13:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:23 smithi163 bash[24253]: cluster 2024-08-31T05:13:22.337975+0000 mgr.a (mgr.14388) 7876 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:13:24.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:24.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:24.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:23 smithi027 bash[22610]: cluster 2024-08-31T05:13:22.337975+0000 mgr.a (mgr.14388) 7876 : cluster [DBG] pgmap v5459: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:13:24.989 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:24.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:24.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:24.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:24.990 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:13:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:25 smithi191 bash[24992]: cluster 2024-08-31T05:13:24.339643+0000 mgr.a (mgr.14388) 7877 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:25 smithi191 bash[24992]: audit 2024-08-31T05:13:24.547771+0000 mgr.a (mgr.14388) 7878 : audit [DBG] from='client.177645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:25 smithi163 bash[24253]: cluster 2024-08-31T05:13:24.339643+0000 mgr.a (mgr.14388) 7877 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:25 smithi163 bash[24253]: audit 2024-08-31T05:13:24.547771+0000 mgr.a (mgr.14388) 7878 : audit [DBG] from='client.177645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:25 smithi027 bash[22610]: cluster 2024-08-31T05:13:24.339643+0000 mgr.a (mgr.14388) 7877 : cluster [DBG] pgmap v5460: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:25 smithi027 bash[22610]: audit 2024-08-31T05:13:24.547771+0000 mgr.a (mgr.14388) 7878 : audit [DBG] from='client.177645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:27 smithi191 bash[24992]: cluster 2024-08-31T05:13:26.340513+0000 mgr.a (mgr.14388) 7879 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:27 smithi163 bash[24253]: cluster 2024-08-31T05:13:26.340513+0000 mgr.a (mgr.14388) 7879 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:28.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:27 smithi027 bash[22610]: cluster 2024-08-31T05:13:26.340513+0000 mgr.a (mgr.14388) 7879 : cluster [DBG] pgmap v5461: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:29.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:29.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:29.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:29 smithi191 bash[24992]: cluster 2024-08-31T05:13:28.342608+0000 mgr.a (mgr.14388) 7880 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:29 smithi163 bash[24253]: cluster 2024-08-31T05:13:28.342608+0000 mgr.a (mgr.14388) 7880 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:30.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:29 smithi027 bash[22610]: cluster 2024-08-31T05:13:28.342608+0000 mgr.a (mgr.14388) 7880 : cluster [DBG] pgmap v5462: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:30.774 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:30.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:30.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:30.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:30.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:13:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:31 smithi191 bash[24992]: audit 2024-08-31T05:13:30.330418+0000 mgr.a (mgr.14388) 7881 : audit [DBG] from='client.177720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:31 smithi191 bash[24992]: cluster 2024-08-31T05:13:30.349473+0000 mgr.a (mgr.14388) 7882 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:31 smithi163 bash[24253]: audit 2024-08-31T05:13:30.330418+0000 mgr.a (mgr.14388) 7881 : audit [DBG] from='client.177720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:31 smithi163 bash[24253]: cluster 2024-08-31T05:13:30.349473+0000 mgr.a (mgr.14388) 7882 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:31 smithi027 bash[22610]: audit 2024-08-31T05:13:30.330418+0000 mgr.a (mgr.14388) 7881 : audit [DBG] from='client.177720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:31 smithi027 bash[22610]: cluster 2024-08-31T05:13:30.349473+0000 mgr.a (mgr.14388) 7882 : cluster [DBG] pgmap v5463: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:33 smithi191 bash[24992]: cluster 2024-08-31T05:13:32.350629+0000 mgr.a (mgr.14388) 7883 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:33 smithi163 bash[24253]: cluster 2024-08-31T05:13:32.350629+0000 mgr.a (mgr.14388) 7883 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:33 smithi027 bash[22610]: cluster 2024-08-31T05:13:32.350629+0000 mgr.a (mgr.14388) 7883 : cluster [DBG] pgmap v5464: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:35.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:35.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:35.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:35 smithi191 bash[24992]: cluster 2024-08-31T05:13:34.352973+0000 mgr.a (mgr.14388) 7884 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:35 smithi163 bash[24253]: cluster 2024-08-31T05:13:34.352973+0000 mgr.a (mgr.14388) 7884 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:36.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:35 smithi027 bash[22610]: cluster 2024-08-31T05:13:34.352973+0000 mgr.a (mgr.14388) 7884 : cluster [DBG] pgmap v5465: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:36.533 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:36.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:36.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:36.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:36.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:13:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:36 smithi191 bash[24992]: audit 2024-08-31T05:13:36.111709+0000 mgr.a (mgr.14388) 7885 : audit [DBG] from='client.177795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:36 smithi163 bash[24253]: audit 2024-08-31T05:13:36.111709+0000 mgr.a (mgr.14388) 7885 : audit [DBG] from='client.177795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:37.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:36 smithi027 bash[22610]: audit 2024-08-31T05:13:36.111709+0000 mgr.a (mgr.14388) 7885 : audit [DBG] from='client.177795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:37 smithi191 bash[24992]: cluster 2024-08-31T05:13:36.353525+0000 mgr.a (mgr.14388) 7886 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:37 smithi163 bash[24253]: cluster 2024-08-31T05:13:36.353525+0000 mgr.a (mgr.14388) 7886 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:37 smithi027 bash[22610]: cluster 2024-08-31T05:13:36.353525+0000 mgr.a (mgr.14388) 7886 : cluster [DBG] pgmap v5466: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:39 smithi163 bash[24253]: cluster 2024-08-31T05:13:38.355867+0000 mgr.a (mgr.14388) 7887 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:39 smithi027 bash[22610]: cluster 2024-08-31T05:13:38.355867+0000 mgr.a (mgr.14388) 7887 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:39 smithi191 bash[24992]: cluster 2024-08-31T05:13:38.355867+0000 mgr.a (mgr.14388) 7887 : cluster [DBG] pgmap v5467: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:41.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:41.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:41.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:41 smithi163 bash[24253]: cluster 2024-08-31T05:13:40.356687+0000 mgr.a (mgr.14388) 7888 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:42.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:41 smithi027 bash[22610]: cluster 2024-08-31T05:13:40.356687+0000 mgr.a (mgr.14388) 7888 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:42.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:42.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:42.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:42.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:13:42.268 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:41 smithi191 bash[24992]: cluster 2024-08-31T05:13:40.356687+0000 mgr.a (mgr.14388) 7888 : cluster [DBG] pgmap v5468: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:42 smithi163 bash[24253]: audit 2024-08-31T05:13:41.859002+0000 mgr.a (mgr.14388) 7889 : audit [DBG] from='client.177873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:43.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:42 smithi027 bash[22610]: audit 2024-08-31T05:13:41.859002+0000 mgr.a (mgr.14388) 7889 : audit [DBG] from='client.177873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:42 smithi191 bash[24992]: audit 2024-08-31T05:13:41.859002+0000 mgr.a (mgr.14388) 7889 : audit [DBG] from='client.177873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:43 smithi163 bash[24253]: cluster 2024-08-31T05:13:42.357613+0000 mgr.a (mgr.14388) 7890 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:43 smithi027 bash[22610]: cluster 2024-08-31T05:13:42.357613+0000 mgr.a (mgr.14388) 7890 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:43 smithi191 bash[24992]: cluster 2024-08-31T05:13:42.357613+0000 mgr.a (mgr.14388) 7890 : cluster [DBG] pgmap v5469: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:45 smithi163 bash[24253]: cluster 2024-08-31T05:13:44.359883+0000 mgr.a (mgr.14388) 7891 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:45 smithi027 bash[22610]: cluster 2024-08-31T05:13:44.359883+0000 mgr.a (mgr.14388) 7891 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:45 smithi191 bash[24992]: cluster 2024-08-31T05:13:44.359883+0000 mgr.a (mgr.14388) 7891 : cluster [DBG] pgmap v5470: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:13:47.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:47.270 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:47.270 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:48.014 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:48.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:48.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:48.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:48.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:13:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:47 smithi163 bash[24253]: cluster 2024-08-31T05:13:46.360665+0000 mgr.a (mgr.14388) 7892 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:48.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:47 smithi027 bash[22610]: cluster 2024-08-31T05:13:46.360665+0000 mgr.a (mgr.14388) 7892 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:47 smithi191 bash[24992]: cluster 2024-08-31T05:13:46.360665+0000 mgr.a (mgr.14388) 7892 : cluster [DBG] pgmap v5471: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:48 smithi163 bash[24253]: audit 2024-08-31T05:13:47.599668+0000 mgr.a (mgr.14388) 7893 : audit [DBG] from='client.177951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:48 smithi027 bash[22610]: audit 2024-08-31T05:13:47.599668+0000 mgr.a (mgr.14388) 7893 : audit [DBG] from='client.177951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:48 smithi191 bash[24992]: audit 2024-08-31T05:13:47.599668+0000 mgr.a (mgr.14388) 7893 : audit [DBG] from='client.177951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:49 smithi163 bash[24253]: cluster 2024-08-31T05:13:48.363525+0000 mgr.a (mgr.14388) 7894 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:13:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:49 smithi027 bash[22610]: cluster 2024-08-31T05:13:48.363525+0000 mgr.a (mgr.14388) 7894 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:13:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:49 smithi191 bash[24992]: cluster 2024-08-31T05:13:48.363525+0000 mgr.a (mgr.14388) 7894 : cluster [DBG] pgmap v5472: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:13:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:51 smithi163 bash[24253]: cluster 2024-08-31T05:13:50.364301+0000 mgr.a (mgr.14388) 7895 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:13:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:51 smithi027 bash[22610]: cluster 2024-08-31T05:13:50.364301+0000 mgr.a (mgr.14388) 7895 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:13:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:51 smithi191 bash[24992]: cluster 2024-08-31T05:13:50.364301+0000 mgr.a (mgr.14388) 7895 : cluster [DBG] pgmap v5473: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:13:53.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:53.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:53.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:53.791 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:53.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:53.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:53.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:53.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:13:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:53 smithi163 bash[24253]: cluster 2024-08-31T05:13:52.365059+0000 mgr.a (mgr.14388) 7896 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:13:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:53 smithi027 bash[22610]: cluster 2024-08-31T05:13:52.365059+0000 mgr.a (mgr.14388) 7896 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:13:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:53 smithi191 bash[24992]: cluster 2024-08-31T05:13:52.365059+0000 mgr.a (mgr.14388) 7896 : cluster [DBG] pgmap v5474: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:13:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:54 smithi163 bash[24253]: audit 2024-08-31T05:13:53.356877+0000 mgr.a (mgr.14388) 7897 : audit [DBG] from='client.178029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:55.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:54 smithi027 bash[22610]: audit 2024-08-31T05:13:53.356877+0000 mgr.a (mgr.14388) 7897 : audit [DBG] from='client.178029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:54 smithi191 bash[24992]: audit 2024-08-31T05:13:53.356877+0000 mgr.a (mgr.14388) 7897 : audit [DBG] from='client.178029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:13:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:55 smithi163 bash[24253]: cluster 2024-08-31T05:13:54.367850+0000 mgr.a (mgr.14388) 7898 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:56.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:55 smithi027 bash[22610]: cluster 2024-08-31T05:13:54.367850+0000 mgr.a (mgr.14388) 7898 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:55 smithi191 bash[24992]: cluster 2024-08-31T05:13:54.367850+0000 mgr.a (mgr.14388) 7898 : cluster [DBG] pgmap v5475: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:13:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:57 smithi163 bash[24253]: cluster 2024-08-31T05:13:56.368655+0000 mgr.a (mgr.14388) 7899 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:13:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:57 smithi027 bash[22610]: cluster 2024-08-31T05:13:56.368655+0000 mgr.a (mgr.14388) 7899 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:13:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:57 smithi191 bash[24992]: cluster 2024-08-31T05:13:56.368655+0000 mgr.a (mgr.14388) 7899 : cluster [DBG] pgmap v5476: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:13:58.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:13:58.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:13:58.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:13:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:58 smithi163 bash[24253]: audit 2024-08-31T05:13:58.283068+0000 mon.a (mon.0) 1763 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:13:59.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:58 smithi027 bash[22610]: audit 2024-08-31T05:13:58.283068+0000 mon.a (mon.0) 1763 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:13:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:58 smithi191 bash[24992]: audit 2024-08-31T05:13:58.283068+0000 mon.a (mon.0) 1763 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:13:59.524 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:13:59.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:13:59.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:13:59.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:13:59.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:00.200 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:59 smithi027 bash[22610]: cluster 2024-08-31T05:13:58.370646+0000 mgr.a (mgr.14388) 7900 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:00.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:59 smithi027 bash[22610]: audit 2024-08-31T05:13:59.123157+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:00.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:59 smithi027 bash[22610]: audit 2024-08-31T05:13:59.124269+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:14:00.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:59 smithi027 bash[22610]: audit 2024-08-31T05:13:59.126286+0000 mgr.a (mgr.14388) 7901 : audit [DBG] from='client.178107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:00.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:59 smithi027 bash[22610]: audit 2024-08-31T05:13:59.132111+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:14:00.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:59 smithi027 bash[22610]: audit 2024-08-31T05:13:59.149797+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:14:00.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:13:59 smithi027 bash[22610]: audit 2024-08-31T05:13:59.152001+0000 mgr.a (mgr.14388) 7902 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:14:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:59 smithi163 bash[24253]: cluster 2024-08-31T05:13:58.370646+0000 mgr.a (mgr.14388) 7900 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:00.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:59 smithi163 bash[24253]: audit 2024-08-31T05:13:59.123157+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:00.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:59 smithi163 bash[24253]: audit 2024-08-31T05:13:59.124269+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:14:00.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:59 smithi163 bash[24253]: audit 2024-08-31T05:13:59.126286+0000 mgr.a (mgr.14388) 7901 : audit [DBG] from='client.178107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:00.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:59 smithi163 bash[24253]: audit 2024-08-31T05:13:59.132111+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:14:00.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:59 smithi163 bash[24253]: audit 2024-08-31T05:13:59.149797+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:14:00.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:13:59 smithi163 bash[24253]: audit 2024-08-31T05:13:59.152001+0000 mgr.a (mgr.14388) 7902 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:14:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:59 smithi191 bash[24992]: cluster 2024-08-31T05:13:58.370646+0000 mgr.a (mgr.14388) 7900 : cluster [DBG] pgmap v5477: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:59 smithi191 bash[24992]: audit 2024-08-31T05:13:59.123157+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:14:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:59 smithi191 bash[24992]: audit 2024-08-31T05:13:59.124269+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:14:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:59 smithi191 bash[24992]: audit 2024-08-31T05:13:59.126286+0000 mgr.a (mgr.14388) 7901 : audit [DBG] from='client.178107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:59 smithi191 bash[24992]: audit 2024-08-31T05:13:59.132111+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:14:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:59 smithi191 bash[24992]: audit 2024-08-31T05:13:59.149797+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:14:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:13:59 smithi191 bash[24992]: audit 2024-08-31T05:13:59.152001+0000 mgr.a (mgr.14388) 7902 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:14:00.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:14:00 smithi027 bash[22863]: debug 2024-08-31T05:14:00.196+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:14:00.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:14:00 smithi027 bash[22863]: debug 2024-08-31T05:14:00.200+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:14:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:00 smithi163 bash[24253]: audit 2024-08-31T05:14:00.201720+0000 mgr.a (mgr.14388) 7903 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:14:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:00 smithi163 bash[24253]: cephadm 2024-08-31T05:14:00.202877+0000 mgr.a (mgr.14388) 7904 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:14:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:00 smithi027 bash[22610]: audit 2024-08-31T05:14:00.201720+0000 mgr.a (mgr.14388) 7903 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:14:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:00 smithi027 bash[22610]: cephadm 2024-08-31T05:14:00.202877+0000 mgr.a (mgr.14388) 7904 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:14:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:00 smithi191 bash[24992]: audit 2024-08-31T05:14:00.201720+0000 mgr.a (mgr.14388) 7903 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:14:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:00 smithi191 bash[24992]: cephadm 2024-08-31T05:14:00.202877+0000 mgr.a (mgr.14388) 7904 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:14:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:01 smithi163 bash[24253]: cluster 2024-08-31T05:14:00.371587+0000 mgr.a (mgr.14388) 7905 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:14:02.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:01 smithi027 bash[22610]: cluster 2024-08-31T05:14:00.371587+0000 mgr.a (mgr.14388) 7905 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:14:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:01 smithi191 bash[24992]: cluster 2024-08-31T05:14:00.371587+0000 mgr.a (mgr.14388) 7905 : cluster [DBG] pgmap v5478: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:14:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:03 smithi163 bash[24253]: cluster 2024-08-31T05:14:02.372351+0000 mgr.a (mgr.14388) 7906 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:14:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:03 smithi027 bash[22610]: cluster 2024-08-31T05:14:02.372351+0000 mgr.a (mgr.14388) 7906 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:14:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:03 smithi191 bash[24992]: cluster 2024-08-31T05:14:02.372351+0000 mgr.a (mgr.14388) 7906 : cluster [DBG] pgmap v5479: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:14:04.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:14:04.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:14:04.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:14:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:14:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:14:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:14:05.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:05.283 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:14:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:05 smithi163 bash[24253]: cluster 2024-08-31T05:14:04.374551+0000 mgr.a (mgr.14388) 7907 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:05 smithi163 bash[24253]: audit 2024-08-31T05:14:04.861869+0000 mgr.a (mgr.14388) 7908 : audit [DBG] from='client.178290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:05 smithi027 bash[22610]: cluster 2024-08-31T05:14:04.374551+0000 mgr.a (mgr.14388) 7907 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:05 smithi027 bash[22610]: audit 2024-08-31T05:14:04.861869+0000 mgr.a (mgr.14388) 7908 : audit [DBG] from='client.178290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:05 smithi191 bash[24992]: cluster 2024-08-31T05:14:04.374551+0000 mgr.a (mgr.14388) 7907 : cluster [DBG] pgmap v5480: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:05 smithi191 bash[24992]: audit 2024-08-31T05:14:04.861869+0000 mgr.a (mgr.14388) 7908 : audit [DBG] from='client.178290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:07 smithi163 bash[24253]: cluster 2024-08-31T05:14:06.375445+0000 mgr.a (mgr.14388) 7909 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:07 smithi027 bash[22610]: cluster 2024-08-31T05:14:06.375445+0000 mgr.a (mgr.14388) 7909 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:07 smithi191 bash[24992]: cluster 2024-08-31T05:14:06.375445+0000 mgr.a (mgr.14388) 7909 : cluster [DBG] pgmap v5481: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:09 smithi163 bash[24253]: cluster 2024-08-31T05:14:08.377654+0000 mgr.a (mgr.14388) 7910 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:09 smithi027 bash[22610]: cluster 2024-08-31T05:14:08.377654+0000 mgr.a (mgr.14388) 7910 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:10.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:14:10.286 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:14:10.286 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:14:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:09 smithi191 bash[24992]: cluster 2024-08-31T05:14:08.377654+0000 mgr.a (mgr.14388) 7910 : cluster [DBG] pgmap v5482: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:11.061 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:14:11.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:14:11.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:14:11.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:14:11.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:11 smithi163 bash[24253]: cluster 2024-08-31T05:14:10.378194+0000 mgr.a (mgr.14388) 7911 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:11 smithi163 bash[24253]: audit 2024-08-31T05:14:10.625220+0000 mgr.a (mgr.14388) 7912 : audit [DBG] from='client.178368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:11 smithi027 bash[22610]: cluster 2024-08-31T05:14:10.378194+0000 mgr.a (mgr.14388) 7911 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:11 smithi027 bash[22610]: audit 2024-08-31T05:14:10.625220+0000 mgr.a (mgr.14388) 7912 : audit [DBG] from='client.178368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:11 smithi191 bash[24992]: cluster 2024-08-31T05:14:10.378194+0000 mgr.a (mgr.14388) 7911 : cluster [DBG] pgmap v5483: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:11 smithi191 bash[24992]: audit 2024-08-31T05:14:10.625220+0000 mgr.a (mgr.14388) 7912 : audit [DBG] from='client.178368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:13 smithi163 bash[24253]: cluster 2024-08-31T05:14:12.379095+0000 mgr.a (mgr.14388) 7913 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:13 smithi027 bash[22610]: cluster 2024-08-31T05:14:12.379095+0000 mgr.a (mgr.14388) 7913 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:13 smithi191 bash[24992]: cluster 2024-08-31T05:14:12.379095+0000 mgr.a (mgr.14388) 7913 : cluster [DBG] pgmap v5484: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:16.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:14:16.064 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:14:16.064 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:14:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:15 smithi163 bash[24253]: cluster 2024-08-31T05:14:14.381320+0000 mgr.a (mgr.14388) 7914 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:15 smithi027 bash[22610]: cluster 2024-08-31T05:14:14.381320+0000 mgr.a (mgr.14388) 7914 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:15 smithi191 bash[24992]: cluster 2024-08-31T05:14:14.381320+0000 mgr.a (mgr.14388) 7914 : cluster [DBG] pgmap v5485: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:14:16.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:14:16.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:14:16.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:14:16.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:16.825 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:14:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:17 smithi163 bash[24253]: cluster 2024-08-31T05:14:16.382051+0000 mgr.a (mgr.14388) 7915 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:17 smithi163 bash[24253]: audit 2024-08-31T05:14:16.397016+0000 mgr.a (mgr.14388) 7916 : audit [DBG] from='client.178443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:17 smithi027 bash[22610]: cluster 2024-08-31T05:14:16.382051+0000 mgr.a (mgr.14388) 7915 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:17 smithi027 bash[22610]: audit 2024-08-31T05:14:16.397016+0000 mgr.a (mgr.14388) 7916 : audit [DBG] from='client.178443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:17 smithi191 bash[24992]: cluster 2024-08-31T05:14:16.382051+0000 mgr.a (mgr.14388) 7915 : cluster [DBG] pgmap v5486: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:17 smithi191 bash[24992]: audit 2024-08-31T05:14:16.397016+0000 mgr.a (mgr.14388) 7916 : audit [DBG] from='client.178443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:19 smithi163 bash[24253]: cluster 2024-08-31T05:14:18.384367+0000 mgr.a (mgr.14388) 7917 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:19 smithi027 bash[22610]: cluster 2024-08-31T05:14:18.384367+0000 mgr.a (mgr.14388) 7917 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:19 smithi191 bash[24992]: cluster 2024-08-31T05:14:18.384367+0000 mgr.a (mgr.14388) 7917 : cluster [DBG] pgmap v5487: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:14:21.826 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:14:21.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:14:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:21 smithi163 bash[24253]: cluster 2024-08-31T05:14:20.385123+0000 mgr.a (mgr.14388) 7918 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:22.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:21 smithi027 bash[22610]: cluster 2024-08-31T05:14:20.385123+0000 mgr.a (mgr.14388) 7918 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:21 smithi191 bash[24992]: cluster 2024-08-31T05:14:20.385123+0000 mgr.a (mgr.14388) 7918 : cluster [DBG] pgmap v5488: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:22.573 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:14:22.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:22 smithi163 bash[24253]: audit 2024-08-31T05:14:22.159104+0000 mgr.a (mgr.14388) 7919 : audit [DBG] from='client.178521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:22 smithi027 bash[22610]: audit 2024-08-31T05:14:22.159104+0000 mgr.a (mgr.14388) 7919 : audit [DBG] from='client.178521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:22 smithi191 bash[24992]: audit 2024-08-31T05:14:22.159104+0000 mgr.a (mgr.14388) 7919 : audit [DBG] from='client.178521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:23 smithi163 bash[24253]: cluster 2024-08-31T05:14:22.385854+0000 mgr.a (mgr.14388) 7920 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:23 smithi027 bash[22610]: cluster 2024-08-31T05:14:22.385854+0000 mgr.a (mgr.14388) 7920 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:23 smithi191 bash[24992]: cluster 2024-08-31T05:14:22.385854+0000 mgr.a (mgr.14388) 7920 : cluster [DBG] pgmap v5489: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:25 smithi163 bash[24253]: cluster 2024-08-31T05:14:24.388207+0000 mgr.a (mgr.14388) 7921 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:25 smithi027 bash[22610]: cluster 2024-08-31T05:14:24.388207+0000 mgr.a (mgr.14388) 7921 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:25 smithi191 bash[24992]: cluster 2024-08-31T05:14:24.388207+0000 mgr.a (mgr.14388) 7921 : cluster [DBG] pgmap v5490: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:27.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:14:27.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:14:27.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:14:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:27 smithi163 bash[24253]: cluster 2024-08-31T05:14:26.388971+0000 mgr.a (mgr.14388) 7922 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:28.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:27 smithi027 bash[22610]: cluster 2024-08-31T05:14:26.388971+0000 mgr.a (mgr.14388) 7922 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:27 smithi191 bash[24992]: cluster 2024-08-31T05:14:26.388971+0000 mgr.a (mgr.14388) 7922 : cluster [DBG] pgmap v5491: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:28.324 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:14:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:14:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:14:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:14:28.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:28 smithi163 bash[24253]: audit 2024-08-31T05:14:27.909623+0000 mgr.a (mgr.14388) 7923 : audit [DBG] from='client.178599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:28 smithi027 bash[22610]: audit 2024-08-31T05:14:27.909623+0000 mgr.a (mgr.14388) 7923 : audit [DBG] from='client.178599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:28 smithi191 bash[24992]: audit 2024-08-31T05:14:27.909623+0000 mgr.a (mgr.14388) 7923 : audit [DBG] from='client.178599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:29 smithi163 bash[24253]: cluster 2024-08-31T05:14:28.391179+0000 mgr.a (mgr.14388) 7924 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:29 smithi027 bash[22610]: cluster 2024-08-31T05:14:28.391179+0000 mgr.a (mgr.14388) 7924 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:29 smithi191 bash[24992]: cluster 2024-08-31T05:14:28.391179+0000 mgr.a (mgr.14388) 7924 : cluster [DBG] pgmap v5492: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:31 smithi027 bash[22610]: cluster 2024-08-31T05:14:30.391898+0000 mgr.a (mgr.14388) 7925 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:14:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:31 smithi191 bash[24992]: cluster 2024-08-31T05:14:30.391898+0000 mgr.a (mgr.14388) 7925 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:14:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:31 smithi163 bash[24253]: cluster 2024-08-31T05:14:30.391898+0000 mgr.a (mgr.14388) 7925 : cluster [DBG] pgmap v5493: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:14:33.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:14:33.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:14:33.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:14:34.097 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:14:34.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:14:34.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:14:34.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:14:34.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:33 smithi027 bash[22610]: cluster 2024-08-31T05:14:32.392646+0000 mgr.a (mgr.14388) 7926 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:14:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:33 smithi191 bash[24992]: cluster 2024-08-31T05:14:32.392646+0000 mgr.a (mgr.14388) 7926 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:14:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:33 smithi163 bash[24253]: cluster 2024-08-31T05:14:32.392646+0000 mgr.a (mgr.14388) 7926 : cluster [DBG] pgmap v5494: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:14:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:34 smithi027 bash[22610]: audit 2024-08-31T05:14:33.667120+0000 mgr.a (mgr.14388) 7927 : audit [DBG] from='client.178677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:34 smithi191 bash[24992]: audit 2024-08-31T05:14:33.667120+0000 mgr.a (mgr.14388) 7927 : audit [DBG] from='client.178677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:34 smithi163 bash[24253]: audit 2024-08-31T05:14:33.667120+0000 mgr.a (mgr.14388) 7927 : audit [DBG] from='client.178677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:35 smithi027 bash[22610]: cluster 2024-08-31T05:14:34.395405+0000 mgr.a (mgr.14388) 7928 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:35 smithi191 bash[24992]: cluster 2024-08-31T05:14:34.395405+0000 mgr.a (mgr.14388) 7928 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:35 smithi163 bash[24253]: cluster 2024-08-31T05:14:34.395405+0000 mgr.a (mgr.14388) 7928 : cluster [DBG] pgmap v5495: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:37 smithi027 bash[22610]: cluster 2024-08-31T05:14:36.396342+0000 mgr.a (mgr.14388) 7929 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:14:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:37 smithi191 bash[24992]: cluster 2024-08-31T05:14:36.396342+0000 mgr.a (mgr.14388) 7929 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:14:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:37 smithi163 bash[24253]: cluster 2024-08-31T05:14:36.396342+0000 mgr.a (mgr.14388) 7929 : cluster [DBG] pgmap v5496: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:14:39.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:14:39.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:14:39.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:14:39.887 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:14:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:14:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:14:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:14:39.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:39 smithi027 bash[22610]: cluster 2024-08-31T05:14:38.398344+0000 mgr.a (mgr.14388) 7930 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:39 smithi191 bash[24992]: cluster 2024-08-31T05:14:38.398344+0000 mgr.a (mgr.14388) 7930 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:39 smithi163 bash[24253]: cluster 2024-08-31T05:14:38.398344+0000 mgr.a (mgr.14388) 7930 : cluster [DBG] pgmap v5497: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:40 smithi191 bash[24992]: audit 2024-08-31T05:14:39.440636+0000 mgr.a (mgr.14388) 7931 : audit [DBG] from='client.178752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:40 smithi163 bash[24253]: audit 2024-08-31T05:14:39.440636+0000 mgr.a (mgr.14388) 7931 : audit [DBG] from='client.178752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:40 smithi027 bash[22610]: audit 2024-08-31T05:14:39.440636+0000 mgr.a (mgr.14388) 7931 : audit [DBG] from='client.178752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:41 smithi191 bash[24992]: cluster 2024-08-31T05:14:40.399432+0000 mgr.a (mgr.14388) 7932 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:41 smithi163 bash[24253]: cluster 2024-08-31T05:14:40.399432+0000 mgr.a (mgr.14388) 7932 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:41 smithi027 bash[22610]: cluster 2024-08-31T05:14:40.399432+0000 mgr.a (mgr.14388) 7932 : cluster [DBG] pgmap v5498: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:43 smithi191 bash[24992]: cluster 2024-08-31T05:14:42.400376+0000 mgr.a (mgr.14388) 7933 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:43 smithi163 bash[24253]: cluster 2024-08-31T05:14:42.400376+0000 mgr.a (mgr.14388) 7933 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:43 smithi027 bash[22610]: cluster 2024-08-31T05:14:42.400376+0000 mgr.a (mgr.14388) 7933 : cluster [DBG] pgmap v5499: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:44.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:14:44.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:14:44.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:14:45.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:14:45.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:14:45.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:14:45.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:45.625 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:14:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:46 smithi191 bash[24992]: cluster 2024-08-31T05:14:44.402753+0000 mgr.a (mgr.14388) 7934 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:46 smithi191 bash[24992]: audit 2024-08-31T05:14:45.221648+0000 mgr.a (mgr.14388) 7935 : audit [DBG] from='client.178830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:46 smithi163 bash[24253]: cluster 2024-08-31T05:14:44.402753+0000 mgr.a (mgr.14388) 7934 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:46 smithi163 bash[24253]: audit 2024-08-31T05:14:45.221648+0000 mgr.a (mgr.14388) 7935 : audit [DBG] from='client.178830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:46 smithi027 bash[22610]: cluster 2024-08-31T05:14:44.402753+0000 mgr.a (mgr.14388) 7934 : cluster [DBG] pgmap v5500: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:46 smithi027 bash[22610]: audit 2024-08-31T05:14:45.221648+0000 mgr.a (mgr.14388) 7935 : audit [DBG] from='client.178830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:48 smithi191 bash[24992]: cluster 2024-08-31T05:14:46.403619+0000 mgr.a (mgr.14388) 7936 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:48 smithi163 bash[24253]: cluster 2024-08-31T05:14:46.403619+0000 mgr.a (mgr.14388) 7936 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:48 smithi027 bash[22610]: cluster 2024-08-31T05:14:46.403619+0000 mgr.a (mgr.14388) 7936 : cluster [DBG] pgmap v5501: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:50 smithi191 bash[24992]: cluster 2024-08-31T05:14:48.406430+0000 mgr.a (mgr.14388) 7937 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:50 smithi163 bash[24253]: cluster 2024-08-31T05:14:48.406430+0000 mgr.a (mgr.14388) 7937 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:50 smithi027 bash[22610]: cluster 2024-08-31T05:14:48.406430+0000 mgr.a (mgr.14388) 7937 : cluster [DBG] pgmap v5502: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:50.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:14:50.627 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:14:50.627 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:14:51.402 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:14:51.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:14:51.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:14:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:14:51.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:52 smithi191 bash[24992]: cluster 2024-08-31T05:14:50.407227+0000 mgr.a (mgr.14388) 7938 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:52 smithi191 bash[24992]: audit 2024-08-31T05:14:50.968205+0000 mgr.a (mgr.14388) 7939 : audit [DBG] from='client.178905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:52 smithi163 bash[24253]: cluster 2024-08-31T05:14:50.407227+0000 mgr.a (mgr.14388) 7938 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:52 smithi163 bash[24253]: audit 2024-08-31T05:14:50.968205+0000 mgr.a (mgr.14388) 7939 : audit [DBG] from='client.178905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:52 smithi027 bash[22610]: cluster 2024-08-31T05:14:50.407227+0000 mgr.a (mgr.14388) 7938 : cluster [DBG] pgmap v5503: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:52 smithi027 bash[22610]: audit 2024-08-31T05:14:50.968205+0000 mgr.a (mgr.14388) 7939 : audit [DBG] from='client.178905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:54 smithi191 bash[24992]: cluster 2024-08-31T05:14:52.408135+0000 mgr.a (mgr.14388) 7940 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:54 smithi163 bash[24253]: cluster 2024-08-31T05:14:52.408135+0000 mgr.a (mgr.14388) 7940 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:54 smithi027 bash[22610]: cluster 2024-08-31T05:14:52.408135+0000 mgr.a (mgr.14388) 7940 : cluster [DBG] pgmap v5504: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:56 smithi191 bash[24992]: cluster 2024-08-31T05:14:54.410380+0000 mgr.a (mgr.14388) 7941 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:14:56.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:14:56.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:14:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:56 smithi163 bash[24253]: cluster 2024-08-31T05:14:54.410380+0000 mgr.a (mgr.14388) 7941 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:56 smithi027 bash[22610]: cluster 2024-08-31T05:14:54.410380+0000 mgr.a (mgr.14388) 7941 : cluster [DBG] pgmap v5505: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:14:57.168 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:14:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:14:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:14:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:14:57.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:14:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:58 smithi191 bash[24992]: cluster 2024-08-31T05:14:56.411137+0000 mgr.a (mgr.14388) 7942 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:14:58 smithi191 bash[24992]: audit 2024-08-31T05:14:56.741520+0000 mgr.a (mgr.14388) 7943 : audit [DBG] from='client.178983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:58 smithi163 bash[24253]: cluster 2024-08-31T05:14:56.411137+0000 mgr.a (mgr.14388) 7942 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:14:58 smithi163 bash[24253]: audit 2024-08-31T05:14:56.741520+0000 mgr.a (mgr.14388) 7943 : audit [DBG] from='client.178983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:14:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:58 smithi027 bash[22610]: cluster 2024-08-31T05:14:56.411137+0000 mgr.a (mgr.14388) 7942 : cluster [DBG] pgmap v5506: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:14:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:14:58 smithi027 bash[22610]: audit 2024-08-31T05:14:56.741520+0000 mgr.a (mgr.14388) 7943 : audit [DBG] from='client.178983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:00 smithi191 bash[24992]: cluster 2024-08-31T05:14:58.413543+0000 mgr.a (mgr.14388) 7944 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:00 smithi163 bash[24253]: cluster 2024-08-31T05:14:58.413543+0000 mgr.a (mgr.14388) 7944 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:00 smithi027 bash[22610]: cluster 2024-08-31T05:14:58.413543+0000 mgr.a (mgr.14388) 7944 : cluster [DBG] pgmap v5507: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:01.316 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:01 smithi027 bash[22610]: audit 2024-08-31T05:15:00.252789+0000 mon.a (mon.0) 1768 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:01.317 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:01 smithi027 bash[22610]: audit 2024-08-31T05:15:00.880337+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:01.317 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:01 smithi027 bash[22610]: audit 2024-08-31T05:15:00.883694+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:01 smithi163 bash[24253]: audit 2024-08-31T05:15:00.252789+0000 mon.a (mon.0) 1768 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:01 smithi163 bash[24253]: audit 2024-08-31T05:15:00.880337+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:01 smithi163 bash[24253]: audit 2024-08-31T05:15:00.883694+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:01.547 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:01 smithi191 bash[24992]: audit 2024-08-31T05:15:00.252789+0000 mon.a (mon.0) 1768 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:15:01.548 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:01 smithi191 bash[24992]: audit 2024-08-31T05:15:00.880337+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:01.548 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:01 smithi191 bash[24992]: audit 2024-08-31T05:15:00.883694+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:15:02.170 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:15:02.170 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:15:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:02 smithi163 bash[24253]: cluster 2024-08-31T05:15:00.414298+0000 mgr.a (mgr.14388) 7945 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:02 smithi163 bash[24253]: audit 2024-08-31T05:15:01.538145+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:02 smithi163 bash[24253]: audit 2024-08-31T05:15:01.543703+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:02 smithi163 bash[24253]: audit 2024-08-31T05:15:01.571430+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:02 smithi163 bash[24253]: audit 2024-08-31T05:15:01.577493+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:02 smithi027 bash[22610]: cluster 2024-08-31T05:15:00.414298+0000 mgr.a (mgr.14388) 7945 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:02 smithi027 bash[22610]: audit 2024-08-31T05:15:01.538145+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:02 smithi027 bash[22610]: audit 2024-08-31T05:15:01.543703+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:02 smithi027 bash[22610]: audit 2024-08-31T05:15:01.571430+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:02 smithi027 bash[22610]: audit 2024-08-31T05:15:01.577493+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:02 smithi191 bash[24992]: cluster 2024-08-31T05:15:00.414298+0000 mgr.a (mgr.14388) 7945 : cluster [DBG] pgmap v5508: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:02 smithi191 bash[24992]: audit 2024-08-31T05:15:01.538145+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:02 smithi191 bash[24992]: audit 2024-08-31T05:15:01.543703+0000 mon.a (mon.0) 1772 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:02 smithi191 bash[24992]: audit 2024-08-31T05:15:01.571430+0000 mon.a (mon.0) 1773 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:02 smithi191 bash[24992]: audit 2024-08-31T05:15:01.577493+0000 mon.a (mon.0) 1774 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:03.231 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:15:02 smithi027 bash[22863]: debug 2024-08-31T05:15:02.951+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:15:03.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:15:02 smithi027 bash[22863]: debug 2024-08-31T05:15:02.963+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:15:03.351 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:15:03.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:15:03.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:15:03.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:15:03.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:15:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:03 smithi191 bash[24992]: audit 2024-08-31T05:15:02.236504+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:03 smithi191 bash[24992]: audit 2024-08-31T05:15:02.241509+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:03 smithi191 bash[24992]: audit 2024-08-31T05:15:02.242504+0000 mon.a (mon.0) 1777 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:03 smithi191 bash[24992]: audit 2024-08-31T05:15:02.243367+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:03 smithi191 bash[24992]: audit 2024-08-31T05:15:02.249172+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:03 smithi191 bash[24992]: audit 2024-08-31T05:15:02.251733+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:15:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:03 smithi163 bash[24253]: audit 2024-08-31T05:15:02.236504+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:03 smithi163 bash[24253]: audit 2024-08-31T05:15:02.241509+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:03 smithi163 bash[24253]: audit 2024-08-31T05:15:02.242504+0000 mon.a (mon.0) 1777 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:03.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:03 smithi163 bash[24253]: audit 2024-08-31T05:15:02.243367+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:03.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:03 smithi163 bash[24253]: audit 2024-08-31T05:15:02.249172+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:03.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:03 smithi163 bash[24253]: audit 2024-08-31T05:15:02.251733+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:15:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:03 smithi027 bash[22610]: audit 2024-08-31T05:15:02.236504+0000 mon.a (mon.0) 1775 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:03 smithi027 bash[22610]: audit 2024-08-31T05:15:02.241509+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:03 smithi027 bash[22610]: audit 2024-08-31T05:15:02.242504+0000 mon.a (mon.0) 1777 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:15:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:03 smithi027 bash[22610]: audit 2024-08-31T05:15:02.243367+0000 mon.a (mon.0) 1778 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:15:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:03 smithi027 bash[22610]: audit 2024-08-31T05:15:02.249172+0000 mon.a (mon.0) 1779 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:15:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:03 smithi027 bash[22610]: audit 2024-08-31T05:15:02.251733+0000 mon.a (mon.0) 1780 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:15:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:04 smithi191 bash[24992]: audit 2024-08-31T05:15:02.252869+0000 mgr.a (mgr.14388) 7946 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:15:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:04 smithi191 bash[24992]: cluster 2024-08-31T05:15:02.414868+0000 mgr.a (mgr.14388) 7947 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:04 smithi191 bash[24992]: audit 2024-08-31T05:15:02.508744+0000 mgr.a (mgr.14388) 7948 : audit [DBG] from='client.179061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:04 smithi191 bash[24992]: audit 2024-08-31T05:15:02.957049+0000 mgr.a (mgr.14388) 7949 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:15:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:04 smithi191 bash[24992]: cephadm 2024-08-31T05:15:02.967491+0000 mgr.a (mgr.14388) 7950 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:15:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:04 smithi163 bash[24253]: audit 2024-08-31T05:15:02.252869+0000 mgr.a (mgr.14388) 7946 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:15:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:04 smithi163 bash[24253]: cluster 2024-08-31T05:15:02.414868+0000 mgr.a (mgr.14388) 7947 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:04 smithi163 bash[24253]: audit 2024-08-31T05:15:02.508744+0000 mgr.a (mgr.14388) 7948 : audit [DBG] from='client.179061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:04 smithi163 bash[24253]: audit 2024-08-31T05:15:02.957049+0000 mgr.a (mgr.14388) 7949 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:15:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:04 smithi163 bash[24253]: cephadm 2024-08-31T05:15:02.967491+0000 mgr.a (mgr.14388) 7950 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:15:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:04 smithi027 bash[22610]: audit 2024-08-31T05:15:02.252869+0000 mgr.a (mgr.14388) 7946 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:15:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:04 smithi027 bash[22610]: cluster 2024-08-31T05:15:02.414868+0000 mgr.a (mgr.14388) 7947 : cluster [DBG] pgmap v5509: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:04 smithi027 bash[22610]: audit 2024-08-31T05:15:02.508744+0000 mgr.a (mgr.14388) 7948 : audit [DBG] from='client.179061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:04 smithi027 bash[22610]: audit 2024-08-31T05:15:02.957049+0000 mgr.a (mgr.14388) 7949 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:15:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:04 smithi027 bash[22610]: cephadm 2024-08-31T05:15:02.967491+0000 mgr.a (mgr.14388) 7950 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:15:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:05 smithi191 bash[24992]: cluster 2024-08-31T05:15:04.417440+0000 mgr.a (mgr.14388) 7951 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:15:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:05 smithi163 bash[24253]: cluster 2024-08-31T05:15:04.417440+0000 mgr.a (mgr.14388) 7951 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:15:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:05 smithi027 bash[22610]: cluster 2024-08-31T05:15:04.417440+0000 mgr.a (mgr.14388) 7951 : cluster [DBG] pgmap v5510: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.1 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:15:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:07 smithi027 bash[22610]: cluster 2024-08-31T05:15:06.418206+0000 mgr.a (mgr.14388) 7952 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:15:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:07 smithi191 bash[24992]: cluster 2024-08-31T05:15:06.418206+0000 mgr.a (mgr.14388) 7952 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:15:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:07 smithi163 bash[24253]: cluster 2024-08-31T05:15:06.418206+0000 mgr.a (mgr.14388) 7952 : cluster [DBG] pgmap v5511: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:15:08.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:15:08.354 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:15:08.354 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:15:09.133 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:15:09.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:15:09.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:15:09.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:15:09.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:15:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:09 smithi027 bash[22610]: cluster 2024-08-31T05:15:08.420213+0000 mgr.a (mgr.14388) 7953 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:15:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:09 smithi027 bash[22610]: audit 2024-08-31T05:15:08.692825+0000 mgr.a (mgr.14388) 7954 : audit [DBG] from='client.179247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:09 smithi191 bash[24992]: cluster 2024-08-31T05:15:08.420213+0000 mgr.a (mgr.14388) 7953 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:15:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:09 smithi191 bash[24992]: audit 2024-08-31T05:15:08.692825+0000 mgr.a (mgr.14388) 7954 : audit [DBG] from='client.179247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:09 smithi163 bash[24253]: cluster 2024-08-31T05:15:08.420213+0000 mgr.a (mgr.14388) 7953 : cluster [DBG] pgmap v5512: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:15:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:09 smithi163 bash[24253]: audit 2024-08-31T05:15:08.692825+0000 mgr.a (mgr.14388) 7954 : audit [DBG] from='client.179247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:11 smithi027 bash[22610]: cluster 2024-08-31T05:15:10.421231+0000 mgr.a (mgr.14388) 7955 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:15:12.035 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:11 smithi163 bash[24253]: cluster 2024-08-31T05:15:10.421231+0000 mgr.a (mgr.14388) 7955 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:15:12.036 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:11 smithi191 bash[24992]: cluster 2024-08-31T05:15:10.421231+0000 mgr.a (mgr.14388) 7955 : cluster [DBG] pgmap v5513: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:15:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:13 smithi191 bash[24992]: cluster 2024-08-31T05:15:12.422027+0000 mgr.a (mgr.14388) 7956 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:15:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:13 smithi163 bash[24253]: cluster 2024-08-31T05:15:12.422027+0000 mgr.a (mgr.14388) 7956 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:15:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:13 smithi027 bash[22610]: cluster 2024-08-31T05:15:12.422027+0000 mgr.a (mgr.14388) 7956 : cluster [DBG] pgmap v5514: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:15:14.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:15:14.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:15:14.136 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:15:14.915 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:15:14.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:15:14.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:15:14.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:15:14.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:15:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:15 smithi191 bash[24992]: cluster 2024-08-31T05:15:14.424165+0000 mgr.a (mgr.14388) 7957 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:15:15.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:15 smithi191 bash[24992]: audit 2024-08-31T05:15:14.470956+0000 mgr.a (mgr.14388) 7958 : audit [DBG] from='client.179319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:15 smithi163 bash[24253]: cluster 2024-08-31T05:15:14.424165+0000 mgr.a (mgr.14388) 7957 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:15:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:15 smithi163 bash[24253]: audit 2024-08-31T05:15:14.470956+0000 mgr.a (mgr.14388) 7958 : audit [DBG] from='client.179319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:15 smithi027 bash[22610]: cluster 2024-08-31T05:15:14.424165+0000 mgr.a (mgr.14388) 7957 : cluster [DBG] pgmap v5515: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:15:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:15 smithi027 bash[22610]: audit 2024-08-31T05:15:14.470956+0000 mgr.a (mgr.14388) 7958 : audit [DBG] from='client.179319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:17 smithi191 bash[24992]: cluster 2024-08-31T05:15:16.425121+0000 mgr.a (mgr.14388) 7959 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:15:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:17 smithi163 bash[24253]: cluster 2024-08-31T05:15:16.425121+0000 mgr.a (mgr.14388) 7959 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:15:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:17 smithi027 bash[22610]: cluster 2024-08-31T05:15:16.425121+0000 mgr.a (mgr.14388) 7959 : cluster [DBG] pgmap v5516: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:15:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:19 smithi191 bash[24992]: cluster 2024-08-31T05:15:18.427305+0000 mgr.a (mgr.14388) 7960 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:15:19.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:15:19.917 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:15:19.917 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:15:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:19 smithi163 bash[24253]: cluster 2024-08-31T05:15:18.427305+0000 mgr.a (mgr.14388) 7960 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:15:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:19 smithi027 bash[22610]: cluster 2024-08-31T05:15:18.427305+0000 mgr.a (mgr.14388) 7960 : cluster [DBG] pgmap v5517: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:15:20.695 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:15:20.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:15:20.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:15:20.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:15:20.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:15:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:21 smithi191 bash[24992]: audit 2024-08-31T05:15:20.252804+0000 mgr.a (mgr.14388) 7961 : audit [DBG] from='client.179394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:21 smithi191 bash[24992]: cluster 2024-08-31T05:15:20.427987+0000 mgr.a (mgr.14388) 7962 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:21 smithi163 bash[24253]: audit 2024-08-31T05:15:20.252804+0000 mgr.a (mgr.14388) 7961 : audit [DBG] from='client.179394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:21 smithi163 bash[24253]: cluster 2024-08-31T05:15:20.427987+0000 mgr.a (mgr.14388) 7962 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:21 smithi027 bash[22610]: audit 2024-08-31T05:15:20.252804+0000 mgr.a (mgr.14388) 7961 : audit [DBG] from='client.179394 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:21 smithi027 bash[22610]: cluster 2024-08-31T05:15:20.427987+0000 mgr.a (mgr.14388) 7962 : cluster [DBG] pgmap v5518: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:23 smithi191 bash[24992]: cluster 2024-08-31T05:15:22.428945+0000 mgr.a (mgr.14388) 7963 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:23 smithi163 bash[24253]: cluster 2024-08-31T05:15:22.428945+0000 mgr.a (mgr.14388) 7963 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:23 smithi027 bash[22610]: cluster 2024-08-31T05:15:22.428945+0000 mgr.a (mgr.14388) 7963 : cluster [DBG] pgmap v5519: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:25.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:15:25.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:15:25.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:15:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:25 smithi191 bash[24992]: cluster 2024-08-31T05:15:24.431332+0000 mgr.a (mgr.14388) 7964 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:25 smithi163 bash[24253]: cluster 2024-08-31T05:15:24.431332+0000 mgr.a (mgr.14388) 7964 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:25 smithi027 bash[22610]: cluster 2024-08-31T05:15:24.431332+0000 mgr.a (mgr.14388) 7964 : cluster [DBG] pgmap v5520: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:26.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:15:26.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:15:26.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:15:26.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:15:26.438 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:15:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:26 smithi191 bash[24992]: audit 2024-08-31T05:15:26.025052+0000 mgr.a (mgr.14388) 7965 : audit [DBG] from='client.179466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:26 smithi163 bash[24253]: audit 2024-08-31T05:15:26.025052+0000 mgr.a (mgr.14388) 7965 : audit [DBG] from='client.179466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:26 smithi027 bash[22610]: audit 2024-08-31T05:15:26.025052+0000 mgr.a (mgr.14388) 7965 : audit [DBG] from='client.179466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:27 smithi191 bash[24992]: cluster 2024-08-31T05:15:26.431884+0000 mgr.a (mgr.14388) 7966 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:27 smithi163 bash[24253]: cluster 2024-08-31T05:15:26.431884+0000 mgr.a (mgr.14388) 7966 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:27 smithi027 bash[22610]: cluster 2024-08-31T05:15:26.431884+0000 mgr.a (mgr.14388) 7966 : cluster [DBG] pgmap v5521: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:29 smithi191 bash[24992]: cluster 2024-08-31T05:15:28.434036+0000 mgr.a (mgr.14388) 7967 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:29 smithi163 bash[24253]: cluster 2024-08-31T05:15:28.434036+0000 mgr.a (mgr.14388) 7967 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:29 smithi027 bash[22610]: cluster 2024-08-31T05:15:28.434036+0000 mgr.a (mgr.14388) 7967 : cluster [DBG] pgmap v5522: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:31.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:15:31.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:15:31.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:15:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:31 smithi191 bash[24992]: cluster 2024-08-31T05:15:30.434965+0000 mgr.a (mgr.14388) 7968 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:31 smithi163 bash[24253]: cluster 2024-08-31T05:15:30.434965+0000 mgr.a (mgr.14388) 7968 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:31 smithi027 bash[22610]: cluster 2024-08-31T05:15:30.434965+0000 mgr.a (mgr.14388) 7968 : cluster [DBG] pgmap v5523: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:32.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:15:32.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:15:32.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:15:32.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:15:32.184 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:15:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:32 smithi191 bash[24992]: audit 2024-08-31T05:15:31.771654+0000 mgr.a (mgr.14388) 7969 : audit [DBG] from='client.179541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:32 smithi163 bash[24253]: audit 2024-08-31T05:15:31.771654+0000 mgr.a (mgr.14388) 7969 : audit [DBG] from='client.179541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:32 smithi027 bash[22610]: audit 2024-08-31T05:15:31.771654+0000 mgr.a (mgr.14388) 7969 : audit [DBG] from='client.179541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:33 smithi163 bash[24253]: cluster 2024-08-31T05:15:32.435935+0000 mgr.a (mgr.14388) 7970 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:33 smithi027 bash[22610]: cluster 2024-08-31T05:15:32.435935+0000 mgr.a (mgr.14388) 7970 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:33 smithi191 bash[24992]: cluster 2024-08-31T05:15:32.435935+0000 mgr.a (mgr.14388) 7970 : cluster [DBG] pgmap v5524: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:35 smithi163 bash[24253]: cluster 2024-08-31T05:15:34.438065+0000 mgr.a (mgr.14388) 7971 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:35 smithi027 bash[22610]: cluster 2024-08-31T05:15:34.438065+0000 mgr.a (mgr.14388) 7971 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:35 smithi191 bash[24992]: cluster 2024-08-31T05:15:34.438065+0000 mgr.a (mgr.14388) 7971 : cluster [DBG] pgmap v5525: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:37.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:15:37.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:15:37.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:15:37.937 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:15:37.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:15:37.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:15:37.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:15:37.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:15:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:37 smithi163 bash[24253]: cluster 2024-08-31T05:15:36.438856+0000 mgr.a (mgr.14388) 7972 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:37.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:37 smithi027 bash[22610]: cluster 2024-08-31T05:15:36.438856+0000 mgr.a (mgr.14388) 7972 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:37 smithi191 bash[24992]: cluster 2024-08-31T05:15:36.438856+0000 mgr.a (mgr.14388) 7972 : cluster [DBG] pgmap v5526: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:38 smithi163 bash[24253]: audit 2024-08-31T05:15:37.518291+0000 mgr.a (mgr.14388) 7973 : audit [DBG] from='client.179619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:38 smithi027 bash[22610]: audit 2024-08-31T05:15:37.518291+0000 mgr.a (mgr.14388) 7973 : audit [DBG] from='client.179619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:38 smithi191 bash[24992]: audit 2024-08-31T05:15:37.518291+0000 mgr.a (mgr.14388) 7973 : audit [DBG] from='client.179619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:39 smithi163 bash[24253]: cluster 2024-08-31T05:15:38.441240+0000 mgr.a (mgr.14388) 7974 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:15:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:39 smithi027 bash[22610]: cluster 2024-08-31T05:15:38.441240+0000 mgr.a (mgr.14388) 7974 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:15:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:39 smithi191 bash[24992]: cluster 2024-08-31T05:15:38.441240+0000 mgr.a (mgr.14388) 7974 : cluster [DBG] pgmap v5527: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:15:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:41 smithi163 bash[24253]: cluster 2024-08-31T05:15:40.442016+0000 mgr.a (mgr.14388) 7975 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:15:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:41 smithi027 bash[22610]: cluster 2024-08-31T05:15:40.442016+0000 mgr.a (mgr.14388) 7975 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:15:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:41 smithi191 bash[24992]: cluster 2024-08-31T05:15:40.442016+0000 mgr.a (mgr.14388) 7975 : cluster [DBG] pgmap v5528: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:15:42.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:15:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:15:42.939 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:15:43.706 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:15:43.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:15:43.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:15:43.707 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:15:43.707 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:15:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:43 smithi163 bash[24253]: cluster 2024-08-31T05:15:42.442813+0000 mgr.a (mgr.14388) 7976 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:15:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:43 smithi027 bash[22610]: cluster 2024-08-31T05:15:42.442813+0000 mgr.a (mgr.14388) 7976 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:15:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:43 smithi191 bash[24992]: cluster 2024-08-31T05:15:42.442813+0000 mgr.a (mgr.14388) 7976 : cluster [DBG] pgmap v5529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:15:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:44 smithi163 bash[24253]: audit 2024-08-31T05:15:43.275608+0000 mgr.a (mgr.14388) 7977 : audit [DBG] from='client.179694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:44 smithi027 bash[22610]: audit 2024-08-31T05:15:43.275608+0000 mgr.a (mgr.14388) 7977 : audit [DBG] from='client.179694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:44 smithi191 bash[24992]: audit 2024-08-31T05:15:43.275608+0000 mgr.a (mgr.14388) 7977 : audit [DBG] from='client.179694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:45 smithi163 bash[24253]: cluster 2024-08-31T05:15:44.445637+0000 mgr.a (mgr.14388) 7978 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:45 smithi027 bash[22610]: cluster 2024-08-31T05:15:44.445637+0000 mgr.a (mgr.14388) 7978 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:45 smithi191 bash[24992]: cluster 2024-08-31T05:15:44.445637+0000 mgr.a (mgr.14388) 7978 : cluster [DBG] pgmap v5530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:47 smithi163 bash[24253]: cluster 2024-08-31T05:15:46.446435+0000 mgr.a (mgr.14388) 7979 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:15:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:47 smithi027 bash[22610]: cluster 2024-08-31T05:15:46.446435+0000 mgr.a (mgr.14388) 7979 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:15:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:47 smithi191 bash[24992]: cluster 2024-08-31T05:15:46.446435+0000 mgr.a (mgr.14388) 7979 : cluster [DBG] pgmap v5531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:15:48.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:15:48.708 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:15:48.708 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:15:49.459 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:15:49.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:15:49.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:15:49.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:15:49.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:15:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:49 smithi163 bash[24253]: cluster 2024-08-31T05:15:48.448399+0000 mgr.a (mgr.14388) 7980 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:49 smithi163 bash[24253]: audit 2024-08-31T05:15:49.039742+0000 mgr.a (mgr.14388) 7981 : audit [DBG] from='client.179769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:49 smithi027 bash[22610]: cluster 2024-08-31T05:15:48.448399+0000 mgr.a (mgr.14388) 7980 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:49 smithi027 bash[22610]: audit 2024-08-31T05:15:49.039742+0000 mgr.a (mgr.14388) 7981 : audit [DBG] from='client.179769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:49 smithi191 bash[24992]: cluster 2024-08-31T05:15:48.448399+0000 mgr.a (mgr.14388) 7980 : cluster [DBG] pgmap v5532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:49 smithi191 bash[24992]: audit 2024-08-31T05:15:49.039742+0000 mgr.a (mgr.14388) 7981 : audit [DBG] from='client.179769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:51 smithi163 bash[24253]: cluster 2024-08-31T05:15:50.449398+0000 mgr.a (mgr.14388) 7982 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:15:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:51 smithi027 bash[22610]: cluster 2024-08-31T05:15:50.449398+0000 mgr.a (mgr.14388) 7982 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:15:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:51 smithi191 bash[24992]: cluster 2024-08-31T05:15:50.449398+0000 mgr.a (mgr.14388) 7982 : cluster [DBG] pgmap v5533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:15:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:53 smithi163 bash[24253]: cluster 2024-08-31T05:15:52.450229+0000 mgr.a (mgr.14388) 7983 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:15:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:53 smithi027 bash[22610]: cluster 2024-08-31T05:15:52.450229+0000 mgr.a (mgr.14388) 7983 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:15:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:53 smithi191 bash[24992]: cluster 2024-08-31T05:15:52.450229+0000 mgr.a (mgr.14388) 7983 : cluster [DBG] pgmap v5534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:15:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:15:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:15:54.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:15:55.238 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:15:55.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:15:55.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:15:55.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:15:55.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:15:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:55 smithi163 bash[24253]: cluster 2024-08-31T05:15:54.452500+0000 mgr.a (mgr.14388) 7984 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:15:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:55 smithi163 bash[24253]: audit 2024-08-31T05:15:54.802262+0000 mgr.a (mgr.14388) 7985 : audit [DBG] from='client.179847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:55 smithi027 bash[22610]: cluster 2024-08-31T05:15:54.452500+0000 mgr.a (mgr.14388) 7984 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:15:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:55 smithi027 bash[22610]: audit 2024-08-31T05:15:54.802262+0000 mgr.a (mgr.14388) 7985 : audit [DBG] from='client.179847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:55 smithi191 bash[24992]: cluster 2024-08-31T05:15:54.452500+0000 mgr.a (mgr.14388) 7984 : cluster [DBG] pgmap v5535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:15:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:55 smithi191 bash[24992]: audit 2024-08-31T05:15:54.802262+0000 mgr.a (mgr.14388) 7985 : audit [DBG] from='client.179847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:15:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:57 smithi163 bash[24253]: cluster 2024-08-31T05:15:56.453648+0000 mgr.a (mgr.14388) 7986 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:57 smithi027 bash[22610]: cluster 2024-08-31T05:15:56.453648+0000 mgr.a (mgr.14388) 7986 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:57 smithi191 bash[24992]: cluster 2024-08-31T05:15:56.453648+0000 mgr.a (mgr.14388) 7986 : cluster [DBG] pgmap v5536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:15:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:15:59 smithi163 bash[24253]: cluster 2024-08-31T05:15:58.455817+0000 mgr.a (mgr.14388) 7987 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:15:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:15:59 smithi027 bash[22610]: cluster 2024-08-31T05:15:58.455817+0000 mgr.a (mgr.14388) 7987 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:15:59 smithi191 bash[24992]: cluster 2024-08-31T05:15:58.455817+0000 mgr.a (mgr.14388) 7987 : cluster [DBG] pgmap v5537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:00.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:00.240 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:00.240 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:01.007 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:01.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:01.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:01.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:01.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:01 smithi163 bash[24253]: cluster 2024-08-31T05:16:00.456555+0000 mgr.a (mgr.14388) 7988 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:01 smithi163 bash[24253]: audit 2024-08-31T05:16:00.576171+0000 mgr.a (mgr.14388) 7989 : audit [DBG] from='client.179925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:01 smithi027 bash[22610]: cluster 2024-08-31T05:16:00.456555+0000 mgr.a (mgr.14388) 7988 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:01 smithi027 bash[22610]: audit 2024-08-31T05:16:00.576171+0000 mgr.a (mgr.14388) 7989 : audit [DBG] from='client.179925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:01 smithi191 bash[24992]: cluster 2024-08-31T05:16:00.456555+0000 mgr.a (mgr.14388) 7988 : cluster [DBG] pgmap v5538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:01 smithi191 bash[24992]: audit 2024-08-31T05:16:00.576171+0000 mgr.a (mgr.14388) 7989 : audit [DBG] from='client.179925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:03 smithi163 bash[24253]: cluster 2024-08-31T05:16:02.457444+0000 mgr.a (mgr.14388) 7990 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:03 smithi163 bash[24253]: audit 2024-08-31T05:16:03.024393+0000 mon.a (mon.0) 1781 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:03 smithi027 bash[22610]: cluster 2024-08-31T05:16:02.457444+0000 mgr.a (mgr.14388) 7990 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:03 smithi027 bash[22610]: audit 2024-08-31T05:16:03.024393+0000 mon.a (mon.0) 1781 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:04.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:03 smithi191 bash[24992]: cluster 2024-08-31T05:16:02.457444+0000 mgr.a (mgr.14388) 7990 : cluster [DBG] pgmap v5539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:04.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:03 smithi191 bash[24992]: audit 2024-08-31T05:16:03.024393+0000 mon.a (mon.0) 1781 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:16:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:04 smithi163 bash[24253]: audit 2024-08-31T05:16:03.640189+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:04 smithi163 bash[24253]: audit 2024-08-31T05:16:03.646533+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:04 smithi163 bash[24253]: audit 2024-08-31T05:16:03.652916+0000 mon.a (mon.0) 1784 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:04 smithi163 bash[24253]: audit 2024-08-31T05:16:03.657738+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:04 smithi163 bash[24253]: audit 2024-08-31T05:16:04.480424+0000 mon.a (mon.0) 1786 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:04 smithi163 bash[24253]: audit 2024-08-31T05:16:04.481757+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:04 smithi163 bash[24253]: audit 2024-08-31T05:16:04.490905+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:04 smithi163 bash[24253]: audit 2024-08-31T05:16:04.494611+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:16:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:04 smithi027 bash[22610]: audit 2024-08-31T05:16:03.640189+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:04 smithi027 bash[22610]: audit 2024-08-31T05:16:03.646533+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:04 smithi027 bash[22610]: audit 2024-08-31T05:16:03.652916+0000 mon.a (mon.0) 1784 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:04 smithi027 bash[22610]: audit 2024-08-31T05:16:03.657738+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:04 smithi027 bash[22610]: audit 2024-08-31T05:16:04.480424+0000 mon.a (mon.0) 1786 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:04 smithi027 bash[22610]: audit 2024-08-31T05:16:04.481757+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:04 smithi027 bash[22610]: audit 2024-08-31T05:16:04.490905+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:04 smithi027 bash[22610]: audit 2024-08-31T05:16:04.494611+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:16:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:04 smithi191 bash[24992]: audit 2024-08-31T05:16:03.640189+0000 mon.a (mon.0) 1782 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:04 smithi191 bash[24992]: audit 2024-08-31T05:16:03.646533+0000 mon.a (mon.0) 1783 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:04 smithi191 bash[24992]: audit 2024-08-31T05:16:03.652916+0000 mon.a (mon.0) 1784 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:04 smithi191 bash[24992]: audit 2024-08-31T05:16:03.657738+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:04 smithi191 bash[24992]: audit 2024-08-31T05:16:04.480424+0000 mon.a (mon.0) 1786 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:16:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:04 smithi191 bash[24992]: audit 2024-08-31T05:16:04.481757+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:16:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:04 smithi191 bash[24992]: audit 2024-08-31T05:16:04.490905+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:16:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:04 smithi191 bash[24992]: audit 2024-08-31T05:16:04.494611+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:16:05.659 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:16:05 smithi027 bash[22863]: debug 2024-08-31T05:16:05.237+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:16:05.659 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:16:05 smithi027 bash[22863]: debug 2024-08-31T05:16:05.241+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:16:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:05 smithi163 bash[24253]: cluster 2024-08-31T05:16:04.459601+0000 mgr.a (mgr.14388) 7991 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:05 smithi163 bash[24253]: audit 2024-08-31T05:16:04.496871+0000 mgr.a (mgr.14388) 7992 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:16:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:05 smithi163 bash[24253]: audit 2024-08-31T05:16:05.242270+0000 mgr.a (mgr.14388) 7993 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:16:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:05 smithi163 bash[24253]: cephadm 2024-08-31T05:16:05.244234+0000 mgr.a (mgr.14388) 7994 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:16:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:05 smithi027 bash[22610]: cluster 2024-08-31T05:16:04.459601+0000 mgr.a (mgr.14388) 7991 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:05 smithi027 bash[22610]: audit 2024-08-31T05:16:04.496871+0000 mgr.a (mgr.14388) 7992 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:16:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:05 smithi027 bash[22610]: audit 2024-08-31T05:16:05.242270+0000 mgr.a (mgr.14388) 7993 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:16:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:05 smithi027 bash[22610]: cephadm 2024-08-31T05:16:05.244234+0000 mgr.a (mgr.14388) 7994 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:16:06.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:06.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:06.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:05 smithi191 bash[24992]: cluster 2024-08-31T05:16:04.459601+0000 mgr.a (mgr.14388) 7991 : cluster [DBG] pgmap v5540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:05 smithi191 bash[24992]: audit 2024-08-31T05:16:04.496871+0000 mgr.a (mgr.14388) 7992 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:16:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:05 smithi191 bash[24992]: audit 2024-08-31T05:16:05.242270+0000 mgr.a (mgr.14388) 7993 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:16:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:05 smithi191 bash[24992]: cephadm 2024-08-31T05:16:05.244234+0000 mgr.a (mgr.14388) 7994 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:16:06.771 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:06.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:06.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:07 smithi163 bash[24253]: audit 2024-08-31T05:16:06.346079+0000 mgr.a (mgr.14388) 7995 : audit [DBG] from='client.180105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:07 smithi163 bash[24253]: cluster 2024-08-31T05:16:06.460133+0000 mgr.a (mgr.14388) 7996 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:07 smithi027 bash[22610]: audit 2024-08-31T05:16:06.346079+0000 mgr.a (mgr.14388) 7995 : audit [DBG] from='client.180105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:07 smithi027 bash[22610]: cluster 2024-08-31T05:16:06.460133+0000 mgr.a (mgr.14388) 7996 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:07 smithi191 bash[24992]: audit 2024-08-31T05:16:06.346079+0000 mgr.a (mgr.14388) 7995 : audit [DBG] from='client.180105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:07 smithi191 bash[24992]: cluster 2024-08-31T05:16:06.460133+0000 mgr.a (mgr.14388) 7996 : cluster [DBG] pgmap v5541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:09 smithi163 bash[24253]: cluster 2024-08-31T05:16:08.462368+0000 mgr.a (mgr.14388) 7997 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:09.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:09 smithi027 bash[22610]: cluster 2024-08-31T05:16:08.462368+0000 mgr.a (mgr.14388) 7997 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:09 smithi191 bash[24992]: cluster 2024-08-31T05:16:08.462368+0000 mgr.a (mgr.14388) 7997 : cluster [DBG] pgmap v5542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:11.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:11.773 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:11.773 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:11 smithi163 bash[24253]: cluster 2024-08-31T05:16:10.463177+0000 mgr.a (mgr.14388) 7998 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:11 smithi027 bash[22610]: cluster 2024-08-31T05:16:10.463177+0000 mgr.a (mgr.14388) 7998 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:11 smithi191 bash[24992]: cluster 2024-08-31T05:16:10.463177+0000 mgr.a (mgr.14388) 7998 : cluster [DBG] pgmap v5543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:12.541 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:12.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:12.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:12.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:12.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:12 smithi163 bash[24253]: audit 2024-08-31T05:16:12.110582+0000 mgr.a (mgr.14388) 7999 : audit [DBG] from='client.180177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:12 smithi027 bash[22610]: audit 2024-08-31T05:16:12.110582+0000 mgr.a (mgr.14388) 7999 : audit [DBG] from='client.180177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:12 smithi191 bash[24992]: audit 2024-08-31T05:16:12.110582+0000 mgr.a (mgr.14388) 7999 : audit [DBG] from='client.180177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:13 smithi163 bash[24253]: cluster 2024-08-31T05:16:12.463687+0000 mgr.a (mgr.14388) 8000 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:13 smithi027 bash[22610]: cluster 2024-08-31T05:16:12.463687+0000 mgr.a (mgr.14388) 8000 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:13 smithi191 bash[24992]: cluster 2024-08-31T05:16:12.463687+0000 mgr.a (mgr.14388) 8000 : cluster [DBG] pgmap v5544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:15 smithi163 bash[24253]: cluster 2024-08-31T05:16:14.465895+0000 mgr.a (mgr.14388) 8001 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:15 smithi027 bash[22610]: cluster 2024-08-31T05:16:14.465895+0000 mgr.a (mgr.14388) 8001 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:15 smithi191 bash[24992]: cluster 2024-08-31T05:16:14.465895+0000 mgr.a (mgr.14388) 8001 : cluster [DBG] pgmap v5545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:17.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:17.543 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:17.543 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:17 smithi163 bash[24253]: cluster 2024-08-31T05:16:16.466659+0000 mgr.a (mgr.14388) 8002 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:17.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:17 smithi027 bash[22610]: cluster 2024-08-31T05:16:16.466659+0000 mgr.a (mgr.14388) 8002 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:17 smithi191 bash[24992]: cluster 2024-08-31T05:16:16.466659+0000 mgr.a (mgr.14388) 8002 : cluster [DBG] pgmap v5546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:18.318 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:18.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:18.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:18.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:18.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:18 smithi163 bash[24253]: audit 2024-08-31T05:16:17.878470+0000 mgr.a (mgr.14388) 8003 : audit [DBG] from='client.180255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:18 smithi027 bash[22610]: audit 2024-08-31T05:16:17.878470+0000 mgr.a (mgr.14388) 8003 : audit [DBG] from='client.180255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:18 smithi191 bash[24992]: audit 2024-08-31T05:16:17.878470+0000 mgr.a (mgr.14388) 8003 : audit [DBG] from='client.180255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:19 smithi027 bash[22610]: cluster 2024-08-31T05:16:18.469329+0000 mgr.a (mgr.14388) 8004 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:19 smithi191 bash[24992]: cluster 2024-08-31T05:16:18.469329+0000 mgr.a (mgr.14388) 8004 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:19 smithi163 bash[24253]: cluster 2024-08-31T05:16:18.469329+0000 mgr.a (mgr.14388) 8004 : cluster [DBG] pgmap v5547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:16:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:21 smithi027 bash[22610]: cluster 2024-08-31T05:16:20.470129+0000 mgr.a (mgr.14388) 8005 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:16:22.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:21 smithi191 bash[24992]: cluster 2024-08-31T05:16:20.470129+0000 mgr.a (mgr.14388) 8005 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:16:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:21 smithi163 bash[24253]: cluster 2024-08-31T05:16:20.470129+0000 mgr.a (mgr.14388) 8005 : cluster [DBG] pgmap v5548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:16:23.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:23.320 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:23.320 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:23 smithi027 bash[22610]: cluster 2024-08-31T05:16:22.470930+0000 mgr.a (mgr.14388) 8006 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:16:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:23 smithi191 bash[24992]: cluster 2024-08-31T05:16:22.470930+0000 mgr.a (mgr.14388) 8006 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:16:24.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:23 smithi163 bash[24253]: cluster 2024-08-31T05:16:22.470930+0000 mgr.a (mgr.14388) 8006 : cluster [DBG] pgmap v5549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:16:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:24 smithi027 bash[22610]: audit 2024-08-31T05:16:23.647976+0000 mgr.a (mgr.14388) 8007 : audit [DBG] from='client.180327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:24 smithi191 bash[24992]: audit 2024-08-31T05:16:23.647976+0000 mgr.a (mgr.14388) 8007 : audit [DBG] from='client.180327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:24 smithi163 bash[24253]: audit 2024-08-31T05:16:23.647976+0000 mgr.a (mgr.14388) 8007 : audit [DBG] from='client.180327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:25 smithi027 bash[22610]: cluster 2024-08-31T05:16:24.473785+0000 mgr.a (mgr.14388) 8008 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:25 smithi191 bash[24992]: cluster 2024-08-31T05:16:24.473785+0000 mgr.a (mgr.14388) 8008 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:25 smithi163 bash[24253]: cluster 2024-08-31T05:16:24.473785+0000 mgr.a (mgr.14388) 8008 : cluster [DBG] pgmap v5550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:27 smithi027 bash[22610]: cluster 2024-08-31T05:16:26.474575+0000 mgr.a (mgr.14388) 8009 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:16:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:27 smithi191 bash[24992]: cluster 2024-08-31T05:16:26.474575+0000 mgr.a (mgr.14388) 8009 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:16:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:27 smithi163 bash[24253]: cluster 2024-08-31T05:16:26.474575+0000 mgr.a (mgr.14388) 8009 : cluster [DBG] pgmap v5551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:16:29.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:29.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:29.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:29.847 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:29.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:29.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:29.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:29.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:29 smithi191 bash[24992]: cluster 2024-08-31T05:16:28.476485+0000 mgr.a (mgr.14388) 8010 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:29 smithi163 bash[24253]: cluster 2024-08-31T05:16:28.476485+0000 mgr.a (mgr.14388) 8010 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:29 smithi027 bash[22610]: cluster 2024-08-31T05:16:28.476485+0000 mgr.a (mgr.14388) 8010 : cluster [DBG] pgmap v5552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:30 smithi191 bash[24992]: audit 2024-08-31T05:16:29.400168+0000 mgr.a (mgr.14388) 8011 : audit [DBG] from='client.180402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:30 smithi163 bash[24253]: audit 2024-08-31T05:16:29.400168+0000 mgr.a (mgr.14388) 8011 : audit [DBG] from='client.180402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:30 smithi027 bash[22610]: audit 2024-08-31T05:16:29.400168+0000 mgr.a (mgr.14388) 8011 : audit [DBG] from='client.180402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:31 smithi191 bash[24992]: cluster 2024-08-31T05:16:30.477475+0000 mgr.a (mgr.14388) 8012 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:31 smithi163 bash[24253]: cluster 2024-08-31T05:16:30.477475+0000 mgr.a (mgr.14388) 8012 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:31 smithi027 bash[22610]: cluster 2024-08-31T05:16:30.477475+0000 mgr.a (mgr.14388) 8012 : cluster [DBG] pgmap v5553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:33 smithi191 bash[24992]: cluster 2024-08-31T05:16:32.478318+0000 mgr.a (mgr.14388) 8013 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:33 smithi163 bash[24253]: cluster 2024-08-31T05:16:32.478318+0000 mgr.a (mgr.14388) 8013 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:33 smithi027 bash[22610]: cluster 2024-08-31T05:16:32.478318+0000 mgr.a (mgr.14388) 8013 : cluster [DBG] pgmap v5554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:34.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:34.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:34.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:35.603 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:35.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:35.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:35.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:35.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:35 smithi191 bash[24992]: cluster 2024-08-31T05:16:34.480569+0000 mgr.a (mgr.14388) 8014 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:35 smithi191 bash[24992]: audit 2024-08-31T05:16:35.182173+0000 mgr.a (mgr.14388) 8015 : audit [DBG] from='client.180480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:35 smithi163 bash[24253]: cluster 2024-08-31T05:16:34.480569+0000 mgr.a (mgr.14388) 8014 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:35 smithi163 bash[24253]: audit 2024-08-31T05:16:35.182173+0000 mgr.a (mgr.14388) 8015 : audit [DBG] from='client.180480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:35 smithi027 bash[22610]: cluster 2024-08-31T05:16:34.480569+0000 mgr.a (mgr.14388) 8014 : cluster [DBG] pgmap v5555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:35 smithi027 bash[22610]: audit 2024-08-31T05:16:35.182173+0000 mgr.a (mgr.14388) 8015 : audit [DBG] from='client.180480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:37 smithi191 bash[24992]: cluster 2024-08-31T05:16:36.481532+0000 mgr.a (mgr.14388) 8016 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:37 smithi163 bash[24253]: cluster 2024-08-31T05:16:36.481532+0000 mgr.a (mgr.14388) 8016 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:37 smithi027 bash[22610]: cluster 2024-08-31T05:16:36.481532+0000 mgr.a (mgr.14388) 8016 : cluster [DBG] pgmap v5556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:39 smithi191 bash[24992]: cluster 2024-08-31T05:16:38.483710+0000 mgr.a (mgr.14388) 8017 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:39 smithi163 bash[24253]: cluster 2024-08-31T05:16:38.483710+0000 mgr.a (mgr.14388) 8017 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:39 smithi027 bash[22610]: cluster 2024-08-31T05:16:38.483710+0000 mgr.a (mgr.14388) 8017 : cluster [DBG] pgmap v5557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:40.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:40.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:40.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:41.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:41.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:41.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:41.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:41.357 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:41 smithi191 bash[24992]: cluster 2024-08-31T05:16:40.484521+0000 mgr.a (mgr.14388) 8018 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:41 smithi191 bash[24992]: audit 2024-08-31T05:16:40.943098+0000 mgr.a (mgr.14388) 8019 : audit [DBG] from='client.180555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:41 smithi163 bash[24253]: cluster 2024-08-31T05:16:40.484521+0000 mgr.a (mgr.14388) 8018 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:41 smithi163 bash[24253]: audit 2024-08-31T05:16:40.943098+0000 mgr.a (mgr.14388) 8019 : audit [DBG] from='client.180555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:41 smithi027 bash[22610]: cluster 2024-08-31T05:16:40.484521+0000 mgr.a (mgr.14388) 8018 : cluster [DBG] pgmap v5558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:41 smithi027 bash[22610]: audit 2024-08-31T05:16:40.943098+0000 mgr.a (mgr.14388) 8019 : audit [DBG] from='client.180555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:43 smithi191 bash[24992]: cluster 2024-08-31T05:16:42.485448+0000 mgr.a (mgr.14388) 8020 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:43 smithi163 bash[24253]: cluster 2024-08-31T05:16:42.485448+0000 mgr.a (mgr.14388) 8020 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:43 smithi027 bash[22610]: cluster 2024-08-31T05:16:42.485448+0000 mgr.a (mgr.14388) 8020 : cluster [DBG] pgmap v5559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:45 smithi191 bash[24992]: cluster 2024-08-31T05:16:44.487834+0000 mgr.a (mgr.14388) 8021 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:45 smithi163 bash[24253]: cluster 2024-08-31T05:16:44.487834+0000 mgr.a (mgr.14388) 8021 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:45 smithi027 bash[22610]: cluster 2024-08-31T05:16:44.487834+0000 mgr.a (mgr.14388) 8021 : cluster [DBG] pgmap v5560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:46.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:46.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:46.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:47.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:47.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:47.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:47.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:47.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:47 smithi191 bash[24992]: cluster 2024-08-31T05:16:46.488342+0000 mgr.a (mgr.14388) 8022 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:47 smithi191 bash[24992]: audit 2024-08-31T05:16:46.691498+0000 mgr.a (mgr.14388) 8023 : audit [DBG] from='client.180630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:47 smithi163 bash[24253]: cluster 2024-08-31T05:16:46.488342+0000 mgr.a (mgr.14388) 8022 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:47 smithi163 bash[24253]: audit 2024-08-31T05:16:46.691498+0000 mgr.a (mgr.14388) 8023 : audit [DBG] from='client.180630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:47 smithi027 bash[22610]: cluster 2024-08-31T05:16:46.488342+0000 mgr.a (mgr.14388) 8022 : cluster [DBG] pgmap v5561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:47 smithi027 bash[22610]: audit 2024-08-31T05:16:46.691498+0000 mgr.a (mgr.14388) 8023 : audit [DBG] from='client.180630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:49 smithi163 bash[24253]: cluster 2024-08-31T05:16:48.490547+0000 mgr.a (mgr.14388) 8024 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:49 smithi027 bash[22610]: cluster 2024-08-31T05:16:48.490547+0000 mgr.a (mgr.14388) 8024 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:49 smithi191 bash[24992]: cluster 2024-08-31T05:16:48.490547+0000 mgr.a (mgr.14388) 8024 : cluster [DBG] pgmap v5562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:16:52.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:52.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:52.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:51 smithi163 bash[24253]: cluster 2024-08-31T05:16:50.491328+0000 mgr.a (mgr.14388) 8025 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:52.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:51 smithi027 bash[22610]: cluster 2024-08-31T05:16:50.491328+0000 mgr.a (mgr.14388) 8025 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:51 smithi191 bash[24992]: cluster 2024-08-31T05:16:50.491328+0000 mgr.a (mgr.14388) 8025 : cluster [DBG] pgmap v5563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:52.883 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:52.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:52.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:52.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:52.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:53 smithi163 bash[24253]: audit 2024-08-31T05:16:52.439483+0000 mgr.a (mgr.14388) 8026 : audit [DBG] from='client.180708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:53 smithi163 bash[24253]: cluster 2024-08-31T05:16:52.492185+0000 mgr.a (mgr.14388) 8027 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:53 smithi027 bash[22610]: audit 2024-08-31T05:16:52.439483+0000 mgr.a (mgr.14388) 8026 : audit [DBG] from='client.180708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:53 smithi027 bash[22610]: cluster 2024-08-31T05:16:52.492185+0000 mgr.a (mgr.14388) 8027 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:53 smithi191 bash[24992]: audit 2024-08-31T05:16:52.439483+0000 mgr.a (mgr.14388) 8026 : audit [DBG] from='client.180708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:53 smithi191 bash[24992]: cluster 2024-08-31T05:16:52.492185+0000 mgr.a (mgr.14388) 8027 : cluster [DBG] pgmap v5564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:16:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:55 smithi163 bash[24253]: cluster 2024-08-31T05:16:54.494461+0000 mgr.a (mgr.14388) 8028 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:16:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:55 smithi027 bash[22610]: cluster 2024-08-31T05:16:54.494461+0000 mgr.a (mgr.14388) 8028 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:16:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:55 smithi191 bash[24992]: cluster 2024-08-31T05:16:54.494461+0000 mgr.a (mgr.14388) 8028 : cluster [DBG] pgmap v5565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:16:57.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:16:57.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:16:57.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:16:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:57 smithi163 bash[24253]: cluster 2024-08-31T05:16:56.495244+0000 mgr.a (mgr.14388) 8029 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:16:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:57 smithi027 bash[22610]: cluster 2024-08-31T05:16:56.495244+0000 mgr.a (mgr.14388) 8029 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:16:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:57 smithi191 bash[24992]: cluster 2024-08-31T05:16:56.495244+0000 mgr.a (mgr.14388) 8029 : cluster [DBG] pgmap v5566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:16:58.640 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:16:58.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:16:58.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:16:58.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:16:58.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:16:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:58 smithi163 bash[24253]: audit 2024-08-31T05:16:58.220342+0000 mgr.a (mgr.14388) 8030 : audit [DBG] from='client.180783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:58 smithi027 bash[22610]: audit 2024-08-31T05:16:58.220342+0000 mgr.a (mgr.14388) 8030 : audit [DBG] from='client.180783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:16:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:58 smithi191 bash[24992]: audit 2024-08-31T05:16:58.220342+0000 mgr.a (mgr.14388) 8030 : audit [DBG] from='client.180783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:16:59 smithi163 bash[24253]: cluster 2024-08-31T05:16:58.496565+0000 mgr.a (mgr.14388) 8031 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:16:59 smithi027 bash[22610]: cluster 2024-08-31T05:16:58.496565+0000 mgr.a (mgr.14388) 8031 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:16:59 smithi191 bash[24992]: cluster 2024-08-31T05:16:58.496565+0000 mgr.a (mgr.14388) 8031 : cluster [DBG] pgmap v5567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:01 smithi191 bash[24992]: cluster 2024-08-31T05:17:00.497441+0000 mgr.a (mgr.14388) 8032 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:17:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:01 smithi163 bash[24253]: cluster 2024-08-31T05:17:00.497441+0000 mgr.a (mgr.14388) 8032 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:17:02.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:01 smithi027 bash[22610]: cluster 2024-08-31T05:17:00.497441+0000 mgr.a (mgr.14388) 8032 : cluster [DBG] pgmap v5568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:17:03.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:17:03.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:17:03.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:17:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:03 smithi163 bash[24253]: cluster 2024-08-31T05:17:02.498222+0000 mgr.a (mgr.14388) 8033 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:17:04.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:03 smithi027 bash[22610]: cluster 2024-08-31T05:17:02.498222+0000 mgr.a (mgr.14388) 8033 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:17:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:03 smithi191 bash[24992]: cluster 2024-08-31T05:17:02.498222+0000 mgr.a (mgr.14388) 8033 : cluster [DBG] pgmap v5569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:17:04.421 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:17:04.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:17:04.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:17:04.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:17:04.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:17:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:04 smithi163 bash[24253]: audit 2024-08-31T05:17:03.978867+0000 mgr.a (mgr.14388) 8034 : audit [DBG] from='client.180861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:04 smithi027 bash[22610]: audit 2024-08-31T05:17:03.978867+0000 mgr.a (mgr.14388) 8034 : audit [DBG] from='client.180861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:04 smithi191 bash[24992]: audit 2024-08-31T05:17:03.978867+0000 mgr.a (mgr.14388) 8034 : audit [DBG] from='client.180861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:05 smithi163 bash[24253]: cluster 2024-08-31T05:17:04.499717+0000 mgr.a (mgr.14388) 8035 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:05 smithi163 bash[24253]: audit 2024-08-31T05:17:05.297515+0000 mon.a (mon.0) 1790 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:17:06.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:05 smithi027 bash[22610]: cluster 2024-08-31T05:17:04.499717+0000 mgr.a (mgr.14388) 8035 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:05 smithi027 bash[22610]: audit 2024-08-31T05:17:05.297515+0000 mon.a (mon.0) 1790 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:17:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:05 smithi191 bash[24992]: cluster 2024-08-31T05:17:04.499717+0000 mgr.a (mgr.14388) 8035 : cluster [DBG] pgmap v5570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:05 smithi191 bash[24992]: audit 2024-08-31T05:17:05.297515+0000 mon.a (mon.0) 1790 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:17:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:06 smithi163 bash[24253]: audit 2024-08-31T05:17:06.133447+0000 mon.a (mon.0) 1791 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:06 smithi163 bash[24253]: audit 2024-08-31T05:17:06.135111+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:06 smithi163 bash[24253]: audit 2024-08-31T05:17:06.144111+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:17:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:06 smithi163 bash[24253]: audit 2024-08-31T05:17:06.149040+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:17:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:06 smithi163 bash[24253]: audit 2024-08-31T05:17:06.151562+0000 mgr.a (mgr.14388) 8036 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:17:07.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:17:06 smithi027 bash[22863]: debug 2024-08-31T05:17:06.867+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:17:07.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:17:06 smithi027 bash[22863]: debug 2024-08-31T05:17:06.871+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:17:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:06 smithi027 bash[22610]: audit 2024-08-31T05:17:06.133447+0000 mon.a (mon.0) 1791 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:06 smithi027 bash[22610]: audit 2024-08-31T05:17:06.135111+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:06 smithi027 bash[22610]: audit 2024-08-31T05:17:06.144111+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:17:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:06 smithi027 bash[22610]: audit 2024-08-31T05:17:06.149040+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:17:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:06 smithi027 bash[22610]: audit 2024-08-31T05:17:06.151562+0000 mgr.a (mgr.14388) 8036 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:17:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:06 smithi191 bash[24992]: audit 2024-08-31T05:17:06.133447+0000 mon.a (mon.0) 1791 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:17:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:06 smithi191 bash[24992]: audit 2024-08-31T05:17:06.135111+0000 mon.a (mon.0) 1792 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:17:07.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:06 smithi191 bash[24992]: audit 2024-08-31T05:17:06.144111+0000 mon.a (mon.0) 1793 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:17:07.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:06 smithi191 bash[24992]: audit 2024-08-31T05:17:06.149040+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:17:07.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:06 smithi191 bash[24992]: audit 2024-08-31T05:17:06.151562+0000 mgr.a (mgr.14388) 8036 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:17:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:08 smithi163 bash[24253]: cluster 2024-08-31T05:17:06.500315+0000 mgr.a (mgr.14388) 8037 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:17:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:08 smithi163 bash[24253]: audit 2024-08-31T05:17:06.874463+0000 mgr.a (mgr.14388) 8038 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:17:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:08 smithi163 bash[24253]: cephadm 2024-08-31T05:17:06.875519+0000 mgr.a (mgr.14388) 8039 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:17:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:08 smithi027 bash[22610]: cluster 2024-08-31T05:17:06.500315+0000 mgr.a (mgr.14388) 8037 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:17:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:08 smithi027 bash[22610]: audit 2024-08-31T05:17:06.874463+0000 mgr.a (mgr.14388) 8038 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:17:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:08 smithi027 bash[22610]: cephadm 2024-08-31T05:17:06.875519+0000 mgr.a (mgr.14388) 8039 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:17:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:08 smithi191 bash[24992]: cluster 2024-08-31T05:17:06.500315+0000 mgr.a (mgr.14388) 8037 : cluster [DBG] pgmap v5571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:17:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:08 smithi191 bash[24992]: audit 2024-08-31T05:17:06.874463+0000 mgr.a (mgr.14388) 8038 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:17:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:08 smithi191 bash[24992]: cephadm 2024-08-31T05:17:06.875519+0000 mgr.a (mgr.14388) 8039 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:17:09.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:17:09.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:17:09.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:17:10.202 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:17:10.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:17:10.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:17:10.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:17:10.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:17:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:10 smithi163 bash[24253]: cluster 2024-08-31T05:17:08.502562+0000 mgr.a (mgr.14388) 8040 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:10 smithi027 bash[22610]: cluster 2024-08-31T05:17:08.502562+0000 mgr.a (mgr.14388) 8040 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:10 smithi191 bash[24992]: cluster 2024-08-31T05:17:08.502562+0000 mgr.a (mgr.14388) 8040 : cluster [DBG] pgmap v5572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:11 smithi163 bash[24253]: audit 2024-08-31T05:17:09.757340+0000 mgr.a (mgr.14388) 8041 : audit [DBG] from='client.181044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:11 smithi027 bash[22610]: audit 2024-08-31T05:17:09.757340+0000 mgr.a (mgr.14388) 8041 : audit [DBG] from='client.181044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:11 smithi191 bash[24992]: audit 2024-08-31T05:17:09.757340+0000 mgr.a (mgr.14388) 8041 : audit [DBG] from='client.181044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:12 smithi163 bash[24253]: cluster 2024-08-31T05:17:10.503563+0000 mgr.a (mgr.14388) 8042 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:12 smithi027 bash[22610]: cluster 2024-08-31T05:17:10.503563+0000 mgr.a (mgr.14388) 8042 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:12 smithi191 bash[24992]: cluster 2024-08-31T05:17:10.503563+0000 mgr.a (mgr.14388) 8042 : cluster [DBG] pgmap v5573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:14 smithi163 bash[24253]: cluster 2024-08-31T05:17:12.504361+0000 mgr.a (mgr.14388) 8043 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:14 smithi027 bash[22610]: cluster 2024-08-31T05:17:12.504361+0000 mgr.a (mgr.14388) 8043 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:14 smithi191 bash[24992]: cluster 2024-08-31T05:17:12.504361+0000 mgr.a (mgr.14388) 8043 : cluster [DBG] pgmap v5574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:15.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:17:15.205 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:17:15.205 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:17:15.966 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:17:15.967 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:17:15.967 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:17:15.967 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:17:15.967 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:17:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:16 smithi163 bash[24253]: cluster 2024-08-31T05:17:14.506701+0000 mgr.a (mgr.14388) 8044 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:16 smithi027 bash[22610]: cluster 2024-08-31T05:17:14.506701+0000 mgr.a (mgr.14388) 8044 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:16 smithi191 bash[24992]: cluster 2024-08-31T05:17:14.506701+0000 mgr.a (mgr.14388) 8044 : cluster [DBG] pgmap v5575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:17 smithi163 bash[24253]: audit 2024-08-31T05:17:15.538391+0000 mgr.a (mgr.14388) 8045 : audit [DBG] from='client.181122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:17 smithi027 bash[22610]: audit 2024-08-31T05:17:15.538391+0000 mgr.a (mgr.14388) 8045 : audit [DBG] from='client.181122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:17 smithi191 bash[24992]: audit 2024-08-31T05:17:15.538391+0000 mgr.a (mgr.14388) 8045 : audit [DBG] from='client.181122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:18 smithi163 bash[24253]: cluster 2024-08-31T05:17:16.507661+0000 mgr.a (mgr.14388) 8046 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:18 smithi027 bash[22610]: cluster 2024-08-31T05:17:16.507661+0000 mgr.a (mgr.14388) 8046 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:18 smithi191 bash[24992]: cluster 2024-08-31T05:17:16.507661+0000 mgr.a (mgr.14388) 8046 : cluster [DBG] pgmap v5576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:20 smithi163 bash[24253]: cluster 2024-08-31T05:17:18.509868+0000 mgr.a (mgr.14388) 8047 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:20 smithi027 bash[22610]: cluster 2024-08-31T05:17:18.509868+0000 mgr.a (mgr.14388) 8047 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:20 smithi191 bash[24992]: cluster 2024-08-31T05:17:18.509868+0000 mgr.a (mgr.14388) 8047 : cluster [DBG] pgmap v5577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:17:20.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:17:20.969 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:17:20.969 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:17:21.698 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:17:21.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:17:21.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:17:21.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:17:21.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:17:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:22 smithi163 bash[24253]: cluster 2024-08-31T05:17:20.510652+0000 mgr.a (mgr.14388) 8048 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:22 smithi027 bash[22610]: cluster 2024-08-31T05:17:20.510652+0000 mgr.a (mgr.14388) 8048 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:22 smithi191 bash[24992]: cluster 2024-08-31T05:17:20.510652+0000 mgr.a (mgr.14388) 8048 : cluster [DBG] pgmap v5578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:23 smithi163 bash[24253]: audit 2024-08-31T05:17:21.297685+0000 mgr.a (mgr.14388) 8049 : audit [DBG] from='client.181200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:23 smithi027 bash[22610]: audit 2024-08-31T05:17:21.297685+0000 mgr.a (mgr.14388) 8049 : audit [DBG] from='client.181200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:23 smithi191 bash[24992]: audit 2024-08-31T05:17:21.297685+0000 mgr.a (mgr.14388) 8049 : audit [DBG] from='client.181200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:24 smithi027 bash[22610]: cluster 2024-08-31T05:17:22.511571+0000 mgr.a (mgr.14388) 8050 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:24 smithi191 bash[24992]: cluster 2024-08-31T05:17:22.511571+0000 mgr.a (mgr.14388) 8050 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:24 smithi163 bash[24253]: cluster 2024-08-31T05:17:22.511571+0000 mgr.a (mgr.14388) 8050 : cluster [DBG] pgmap v5579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:26 smithi027 bash[22610]: cluster 2024-08-31T05:17:24.513763+0000 mgr.a (mgr.14388) 8051 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:26 smithi191 bash[24992]: cluster 2024-08-31T05:17:24.513763+0000 mgr.a (mgr.14388) 8051 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:26.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:17:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:26 smithi163 bash[24253]: cluster 2024-08-31T05:17:24.513763+0000 mgr.a (mgr.14388) 8051 : cluster [DBG] pgmap v5580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:17:26.701 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:17:27.471 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:17:27.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:17:27.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:17:27.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:17:27.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:17:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:28 smithi027 bash[22610]: cluster 2024-08-31T05:17:26.514660+0000 mgr.a (mgr.14388) 8052 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:28 smithi027 bash[22610]: audit 2024-08-31T05:17:27.037257+0000 mgr.a (mgr.14388) 8053 : audit [DBG] from='client.181278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:28 smithi191 bash[24992]: cluster 2024-08-31T05:17:26.514660+0000 mgr.a (mgr.14388) 8052 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:28 smithi191 bash[24992]: audit 2024-08-31T05:17:27.037257+0000 mgr.a (mgr.14388) 8053 : audit [DBG] from='client.181278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:28 smithi163 bash[24253]: cluster 2024-08-31T05:17:26.514660+0000 mgr.a (mgr.14388) 8052 : cluster [DBG] pgmap v5581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:28 smithi163 bash[24253]: audit 2024-08-31T05:17:27.037257+0000 mgr.a (mgr.14388) 8053 : audit [DBG] from='client.181278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:30 smithi027 bash[22610]: cluster 2024-08-31T05:17:28.516945+0000 mgr.a (mgr.14388) 8054 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:30 smithi191 bash[24992]: cluster 2024-08-31T05:17:28.516945+0000 mgr.a (mgr.14388) 8054 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:30 smithi163 bash[24253]: cluster 2024-08-31T05:17:28.516945+0000 mgr.a (mgr.14388) 8054 : cluster [DBG] pgmap v5582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:32.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:17:32.473 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:17:32.474 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:17:32.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:32 smithi027 bash[22610]: cluster 2024-08-31T05:17:30.517729+0000 mgr.a (mgr.14388) 8055 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:32 smithi191 bash[24992]: cluster 2024-08-31T05:17:30.517729+0000 mgr.a (mgr.14388) 8055 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:32 smithi163 bash[24253]: cluster 2024-08-31T05:17:30.517729+0000 mgr.a (mgr.14388) 8055 : cluster [DBG] pgmap v5583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:33.233 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:17:33.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:17:33.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:17:33.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:17:33.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:17:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:34 smithi027 bash[22610]: cluster 2024-08-31T05:17:32.518487+0000 mgr.a (mgr.14388) 8056 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:34 smithi027 bash[22610]: audit 2024-08-31T05:17:32.809550+0000 mgr.a (mgr.14388) 8057 : audit [DBG] from='client.181356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:34 smithi191 bash[24992]: cluster 2024-08-31T05:17:32.518487+0000 mgr.a (mgr.14388) 8056 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:34 smithi191 bash[24992]: audit 2024-08-31T05:17:32.809550+0000 mgr.a (mgr.14388) 8057 : audit [DBG] from='client.181356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:34 smithi163 bash[24253]: cluster 2024-08-31T05:17:32.518487+0000 mgr.a (mgr.14388) 8056 : cluster [DBG] pgmap v5584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:34 smithi163 bash[24253]: audit 2024-08-31T05:17:32.809550+0000 mgr.a (mgr.14388) 8057 : audit [DBG] from='client.181356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:36 smithi027 bash[22610]: cluster 2024-08-31T05:17:34.521192+0000 mgr.a (mgr.14388) 8058 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:36 smithi191 bash[24992]: cluster 2024-08-31T05:17:34.521192+0000 mgr.a (mgr.14388) 8058 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:36 smithi163 bash[24253]: cluster 2024-08-31T05:17:34.521192+0000 mgr.a (mgr.14388) 8058 : cluster [DBG] pgmap v5585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:38.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:17:38.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:17:38.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:17:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:38 smithi027 bash[22610]: cluster 2024-08-31T05:17:36.521975+0000 mgr.a (mgr.14388) 8059 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:17:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:38 smithi191 bash[24992]: cluster 2024-08-31T05:17:36.521975+0000 mgr.a (mgr.14388) 8059 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:17:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:38 smithi163 bash[24253]: cluster 2024-08-31T05:17:36.521975+0000 mgr.a (mgr.14388) 8059 : cluster [DBG] pgmap v5586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:17:39.011 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:17:39.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:17:39.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:17:39.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:17:39.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:17:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:40 smithi191 bash[24992]: cluster 2024-08-31T05:17:38.523930+0000 mgr.a (mgr.14388) 8060 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:40 smithi191 bash[24992]: audit 2024-08-31T05:17:38.573167+0000 mgr.a (mgr.14388) 8061 : audit [DBG] from='client.181434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:40 smithi163 bash[24253]: cluster 2024-08-31T05:17:38.523930+0000 mgr.a (mgr.14388) 8060 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:40 smithi163 bash[24253]: audit 2024-08-31T05:17:38.573167+0000 mgr.a (mgr.14388) 8061 : audit [DBG] from='client.181434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:40 smithi027 bash[22610]: cluster 2024-08-31T05:17:38.523930+0000 mgr.a (mgr.14388) 8060 : cluster [DBG] pgmap v5587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:40 smithi027 bash[22610]: audit 2024-08-31T05:17:38.573167+0000 mgr.a (mgr.14388) 8061 : audit [DBG] from='client.181434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:42 smithi191 bash[24992]: cluster 2024-08-31T05:17:40.524813+0000 mgr.a (mgr.14388) 8062 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:17:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:42 smithi163 bash[24253]: cluster 2024-08-31T05:17:40.524813+0000 mgr.a (mgr.14388) 8062 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:17:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:42 smithi027 bash[22610]: cluster 2024-08-31T05:17:40.524813+0000 mgr.a (mgr.14388) 8062 : cluster [DBG] pgmap v5588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:17:44.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:17:44.013 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:17:44.013 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:17:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:44 smithi191 bash[24992]: cluster 2024-08-31T05:17:42.525592+0000 mgr.a (mgr.14388) 8063 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:17:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:44 smithi163 bash[24253]: cluster 2024-08-31T05:17:42.525592+0000 mgr.a (mgr.14388) 8063 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:17:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:44 smithi027 bash[22610]: cluster 2024-08-31T05:17:42.525592+0000 mgr.a (mgr.14388) 8063 : cluster [DBG] pgmap v5589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:17:44.795 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:17:44.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:17:44.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:17:44.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:17:44.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:17:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:46 smithi191 bash[24992]: audit 2024-08-31T05:17:44.353398+0000 mgr.a (mgr.14388) 8064 : audit [DBG] from='client.181509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:46 smithi191 bash[24992]: cluster 2024-08-31T05:17:44.527725+0000 mgr.a (mgr.14388) 8065 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:46 smithi163 bash[24253]: audit 2024-08-31T05:17:44.353398+0000 mgr.a (mgr.14388) 8064 : audit [DBG] from='client.181509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:46 smithi163 bash[24253]: cluster 2024-08-31T05:17:44.527725+0000 mgr.a (mgr.14388) 8065 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:46 smithi027 bash[22610]: audit 2024-08-31T05:17:44.353398+0000 mgr.a (mgr.14388) 8064 : audit [DBG] from='client.181509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:46 smithi027 bash[22610]: cluster 2024-08-31T05:17:44.527725+0000 mgr.a (mgr.14388) 8065 : cluster [DBG] pgmap v5590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:48 smithi191 bash[24992]: cluster 2024-08-31T05:17:46.528577+0000 mgr.a (mgr.14388) 8066 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:48 smithi163 bash[24253]: cluster 2024-08-31T05:17:46.528577+0000 mgr.a (mgr.14388) 8066 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:48 smithi027 bash[22610]: cluster 2024-08-31T05:17:46.528577+0000 mgr.a (mgr.14388) 8066 : cluster [DBG] pgmap v5591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:49.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:17:49.798 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:17:49.798 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:17:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:50 smithi191 bash[24992]: cluster 2024-08-31T05:17:48.530842+0000 mgr.a (mgr.14388) 8067 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:50.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:17:50.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:17:50.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:17:50.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:17:50.582 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:17:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:50 smithi163 bash[24253]: cluster 2024-08-31T05:17:48.530842+0000 mgr.a (mgr.14388) 8067 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:50 smithi027 bash[22610]: cluster 2024-08-31T05:17:48.530842+0000 mgr.a (mgr.14388) 8067 : cluster [DBG] pgmap v5592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:51 smithi191 bash[24992]: audit 2024-08-31T05:17:50.137670+0000 mgr.a (mgr.14388) 8068 : audit [DBG] from='client.181584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:51 smithi163 bash[24253]: audit 2024-08-31T05:17:50.137670+0000 mgr.a (mgr.14388) 8068 : audit [DBG] from='client.181584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:51 smithi027 bash[22610]: audit 2024-08-31T05:17:50.137670+0000 mgr.a (mgr.14388) 8068 : audit [DBG] from='client.181584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:52 smithi191 bash[24992]: cluster 2024-08-31T05:17:50.531390+0000 mgr.a (mgr.14388) 8069 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:52 smithi163 bash[24253]: cluster 2024-08-31T05:17:50.531390+0000 mgr.a (mgr.14388) 8069 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:52 smithi027 bash[22610]: cluster 2024-08-31T05:17:50.531390+0000 mgr.a (mgr.14388) 8069 : cluster [DBG] pgmap v5593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:54 smithi191 bash[24992]: cluster 2024-08-31T05:17:52.532144+0000 mgr.a (mgr.14388) 8070 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:54 smithi163 bash[24253]: cluster 2024-08-31T05:17:52.532144+0000 mgr.a (mgr.14388) 8070 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:54 smithi027 bash[22610]: cluster 2024-08-31T05:17:52.532144+0000 mgr.a (mgr.14388) 8070 : cluster [DBG] pgmap v5594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:55.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:17:55.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:17:55.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:17:56.337 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:17:56.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:17:56.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:17:56.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:17:56.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:17:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:56 smithi191 bash[24992]: cluster 2024-08-31T05:17:54.534376+0000 mgr.a (mgr.14388) 8071 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:56 smithi163 bash[24253]: cluster 2024-08-31T05:17:54.534376+0000 mgr.a (mgr.14388) 8071 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:56 smithi027 bash[22610]: cluster 2024-08-31T05:17:54.534376+0000 mgr.a (mgr.14388) 8071 : cluster [DBG] pgmap v5595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:17:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:57 smithi191 bash[24992]: audit 2024-08-31T05:17:55.918331+0000 mgr.a (mgr.14388) 8072 : audit [DBG] from='client.181662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:57 smithi163 bash[24253]: audit 2024-08-31T05:17:55.918331+0000 mgr.a (mgr.14388) 8072 : audit [DBG] from='client.181662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:57 smithi027 bash[22610]: audit 2024-08-31T05:17:55.918331+0000 mgr.a (mgr.14388) 8072 : audit [DBG] from='client.181662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:17:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:17:58 smithi191 bash[24992]: cluster 2024-08-31T05:17:56.535335+0000 mgr.a (mgr.14388) 8073 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:17:58 smithi163 bash[24253]: cluster 2024-08-31T05:17:56.535335+0000 mgr.a (mgr.14388) 8073 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:17:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:17:58 smithi027 bash[22610]: cluster 2024-08-31T05:17:56.535335+0000 mgr.a (mgr.14388) 8073 : cluster [DBG] pgmap v5596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:00.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:00 smithi191 bash[24992]: cluster 2024-08-31T05:17:58.537610+0000 mgr.a (mgr.14388) 8074 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:00 smithi163 bash[24253]: cluster 2024-08-31T05:17:58.537610+0000 mgr.a (mgr.14388) 8074 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:00 smithi027 bash[22610]: cluster 2024-08-31T05:17:58.537610+0000 mgr.a (mgr.14388) 8074 : cluster [DBG] pgmap v5597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:01.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:01.339 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:01.339 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:02.115 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:02.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:18:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:02 smithi191 bash[24992]: cluster 2024-08-31T05:18:00.538383+0000 mgr.a (mgr.14388) 8075 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:02 smithi163 bash[24253]: cluster 2024-08-31T05:18:00.538383+0000 mgr.a (mgr.14388) 8075 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:02 smithi027 bash[22610]: cluster 2024-08-31T05:18:00.538383+0000 mgr.a (mgr.14388) 8075 : cluster [DBG] pgmap v5598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:03 smithi163 bash[24253]: audit 2024-08-31T05:18:01.671000+0000 mgr.a (mgr.14388) 8076 : audit [DBG] from='client.181734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:03 smithi163 bash[24253]: cluster 2024-08-31T05:18:02.539270+0000 mgr.a (mgr.14388) 8077 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:03 smithi027 bash[22610]: audit 2024-08-31T05:18:01.671000+0000 mgr.a (mgr.14388) 8076 : audit [DBG] from='client.181734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:03 smithi027 bash[22610]: cluster 2024-08-31T05:18:02.539270+0000 mgr.a (mgr.14388) 8077 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:03 smithi191 bash[24992]: audit 2024-08-31T05:18:01.671000+0000 mgr.a (mgr.14388) 8076 : audit [DBG] from='client.181734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:03 smithi191 bash[24992]: cluster 2024-08-31T05:18:02.539270+0000 mgr.a (mgr.14388) 8077 : cluster [DBG] pgmap v5599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:05 smithi163 bash[24253]: cluster 2024-08-31T05:18:04.541455+0000 mgr.a (mgr.14388) 8078 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:05 smithi027 bash[22610]: cluster 2024-08-31T05:18:04.541455+0000 mgr.a (mgr.14388) 8078 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:05 smithi191 bash[24992]: cluster 2024-08-31T05:18:04.541455+0000 mgr.a (mgr.14388) 8078 : cluster [DBG] pgmap v5600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:07.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:07.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:07.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:07.892 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:07.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:07.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:07.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:07.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:18:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:07 smithi163 bash[24253]: cluster 2024-08-31T05:18:06.542194+0000 mgr.a (mgr.14388) 8079 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:07 smithi163 bash[24253]: audit 2024-08-31T05:18:06.930758+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:07 smithi027 bash[22610]: cluster 2024-08-31T05:18:06.542194+0000 mgr.a (mgr.14388) 8079 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:07 smithi027 bash[22610]: audit 2024-08-31T05:18:06.930758+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:07 smithi191 bash[24992]: cluster 2024-08-31T05:18:06.542194+0000 mgr.a (mgr.14388) 8079 : cluster [DBG] pgmap v5601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:07 smithi191 bash[24992]: audit 2024-08-31T05:18:06.930758+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:18:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:08 smithi163 bash[24253]: audit 2024-08-31T05:18:07.453458+0000 mgr.a (mgr.14388) 8080 : audit [DBG] from='client.181809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:08 smithi163 bash[24253]: audit 2024-08-31T05:18:07.799457+0000 mon.a (mon.0) 1796 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:08 smithi163 bash[24253]: audit 2024-08-31T05:18:07.800435+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:08 smithi163 bash[24253]: audit 2024-08-31T05:18:07.806119+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:18:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:08 smithi163 bash[24253]: audit 2024-08-31T05:18:07.808201+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:18:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:08 smithi163 bash[24253]: audit 2024-08-31T05:18:07.809307+0000 mgr.a (mgr.14388) 8081 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:18:08.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:18:08 smithi027 bash[22863]: debug 2024-08-31T05:18:08.582+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:18:08.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:18:08 smithi027 bash[22863]: debug 2024-08-31T05:18:08.586+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:18:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:08 smithi027 bash[22610]: audit 2024-08-31T05:18:07.453458+0000 mgr.a (mgr.14388) 8080 : audit [DBG] from='client.181809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:08 smithi027 bash[22610]: audit 2024-08-31T05:18:07.799457+0000 mon.a (mon.0) 1796 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:08 smithi027 bash[22610]: audit 2024-08-31T05:18:07.800435+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:08 smithi027 bash[22610]: audit 2024-08-31T05:18:07.806119+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:18:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:08 smithi027 bash[22610]: audit 2024-08-31T05:18:07.808201+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:18:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:08 smithi027 bash[22610]: audit 2024-08-31T05:18:07.809307+0000 mgr.a (mgr.14388) 8081 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:18:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:08 smithi191 bash[24992]: audit 2024-08-31T05:18:07.453458+0000 mgr.a (mgr.14388) 8080 : audit [DBG] from='client.181809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:09.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:08 smithi191 bash[24992]: audit 2024-08-31T05:18:07.799457+0000 mon.a (mon.0) 1796 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:18:09.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:08 smithi191 bash[24992]: audit 2024-08-31T05:18:07.800435+0000 mon.a (mon.0) 1797 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:18:09.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:08 smithi191 bash[24992]: audit 2024-08-31T05:18:07.806119+0000 mon.a (mon.0) 1798 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:18:09.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:08 smithi191 bash[24992]: audit 2024-08-31T05:18:07.808201+0000 mon.a (mon.0) 1799 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:18:09.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:08 smithi191 bash[24992]: audit 2024-08-31T05:18:07.809307+0000 mgr.a (mgr.14388) 8081 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:18:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:09 smithi163 bash[24253]: cluster 2024-08-31T05:18:08.543806+0000 mgr.a (mgr.14388) 8082 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T05:18:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:09 smithi163 bash[24253]: audit 2024-08-31T05:18:08.585836+0000 mgr.a (mgr.14388) 8083 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:18:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:09 smithi163 bash[24253]: cephadm 2024-08-31T05:18:08.587506+0000 mgr.a (mgr.14388) 8084 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:18:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:09 smithi027 bash[22610]: cluster 2024-08-31T05:18:08.543806+0000 mgr.a (mgr.14388) 8082 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T05:18:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:09 smithi027 bash[22610]: audit 2024-08-31T05:18:08.585836+0000 mgr.a (mgr.14388) 8083 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:18:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:09 smithi027 bash[22610]: cephadm 2024-08-31T05:18:08.587506+0000 mgr.a (mgr.14388) 8084 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:18:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:09 smithi191 bash[24992]: cluster 2024-08-31T05:18:08.543806+0000 mgr.a (mgr.14388) 8082 : cluster [DBG] pgmap v5602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T05:18:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:09 smithi191 bash[24992]: audit 2024-08-31T05:18:08.585836+0000 mgr.a (mgr.14388) 8083 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:18:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:09 smithi191 bash[24992]: cephadm 2024-08-31T05:18:08.587506+0000 mgr.a (mgr.14388) 8084 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:18:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:11 smithi163 bash[24253]: cluster 2024-08-31T05:18:10.544552+0000 mgr.a (mgr.14388) 8085 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:18:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:11 smithi027 bash[22610]: cluster 2024-08-31T05:18:10.544552+0000 mgr.a (mgr.14388) 8085 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:18:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:11 smithi191 bash[24992]: cluster 2024-08-31T05:18:10.544552+0000 mgr.a (mgr.14388) 8085 : cluster [DBG] pgmap v5603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:18:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:12.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:12.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:13.649 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:13.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:13.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:13.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:13.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:18:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:13 smithi163 bash[24253]: cluster 2024-08-31T05:18:12.545328+0000 mgr.a (mgr.14388) 8086 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:18:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:13 smithi163 bash[24253]: audit 2024-08-31T05:18:13.225129+0000 mgr.a (mgr.14388) 8087 : audit [DBG] from='client.181980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:13 smithi027 bash[22610]: cluster 2024-08-31T05:18:12.545328+0000 mgr.a (mgr.14388) 8086 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:18:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:13 smithi027 bash[22610]: audit 2024-08-31T05:18:13.225129+0000 mgr.a (mgr.14388) 8087 : audit [DBG] from='client.181980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:13 smithi191 bash[24992]: cluster 2024-08-31T05:18:12.545328+0000 mgr.a (mgr.14388) 8086 : cluster [DBG] pgmap v5604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:18:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:13 smithi191 bash[24992]: audit 2024-08-31T05:18:13.225129+0000 mgr.a (mgr.14388) 8087 : audit [DBG] from='client.181980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:15 smithi163 bash[24253]: cluster 2024-08-31T05:18:14.548030+0000 mgr.a (mgr.14388) 8088 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:18:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:15 smithi027 bash[22610]: cluster 2024-08-31T05:18:14.548030+0000 mgr.a (mgr.14388) 8088 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:18:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:15 smithi191 bash[24992]: cluster 2024-08-31T05:18:14.548030+0000 mgr.a (mgr.14388) 8088 : cluster [DBG] pgmap v5605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:18:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:17 smithi163 bash[24253]: cluster 2024-08-31T05:18:16.548843+0000 mgr.a (mgr.14388) 8089 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:18:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:17 smithi027 bash[22610]: cluster 2024-08-31T05:18:16.548843+0000 mgr.a (mgr.14388) 8089 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:18:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:17 smithi191 bash[24992]: cluster 2024-08-31T05:18:16.548843+0000 mgr.a (mgr.14388) 8089 : cluster [DBG] pgmap v5606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:18:18.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:18.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:18.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:19.436 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:19.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:19.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:19.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:19.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:18:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:19 smithi163 bash[24253]: cluster 2024-08-31T05:18:18.550795+0000 mgr.a (mgr.14388) 8090 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:18:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:19 smithi163 bash[24253]: audit 2024-08-31T05:18:18.991929+0000 mgr.a (mgr.14388) 8091 : audit [DBG] from='client.182055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:19 smithi027 bash[22610]: cluster 2024-08-31T05:18:18.550795+0000 mgr.a (mgr.14388) 8090 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:18:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:19 smithi027 bash[22610]: audit 2024-08-31T05:18:18.991929+0000 mgr.a (mgr.14388) 8091 : audit [DBG] from='client.182055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:19 smithi191 bash[24992]: cluster 2024-08-31T05:18:18.550795+0000 mgr.a (mgr.14388) 8090 : cluster [DBG] pgmap v5607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:18:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:19 smithi191 bash[24992]: audit 2024-08-31T05:18:18.991929+0000 mgr.a (mgr.14388) 8091 : audit [DBG] from='client.182055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:21 smithi163 bash[24253]: cluster 2024-08-31T05:18:20.551722+0000 mgr.a (mgr.14388) 8092 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:18:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:21 smithi027 bash[22610]: cluster 2024-08-31T05:18:20.551722+0000 mgr.a (mgr.14388) 8092 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:18:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:21 smithi191 bash[24992]: cluster 2024-08-31T05:18:20.551722+0000 mgr.a (mgr.14388) 8092 : cluster [DBG] pgmap v5608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:18:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:23 smithi163 bash[24253]: cluster 2024-08-31T05:18:22.552477+0000 mgr.a (mgr.14388) 8093 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:18:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:23 smithi027 bash[22610]: cluster 2024-08-31T05:18:22.552477+0000 mgr.a (mgr.14388) 8093 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:18:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:23 smithi191 bash[24992]: cluster 2024-08-31T05:18:22.552477+0000 mgr.a (mgr.14388) 8093 : cluster [DBG] pgmap v5609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:18:24.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:24.439 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:24.439 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:25.196 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:25.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:25.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:25.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:25.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:18:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:25 smithi163 bash[24253]: cluster 2024-08-31T05:18:24.554645+0000 mgr.a (mgr.14388) 8094 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:18:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:25 smithi163 bash[24253]: audit 2024-08-31T05:18:24.772193+0000 mgr.a (mgr.14388) 8095 : audit [DBG] from='client.182133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:25 smithi027 bash[22610]: cluster 2024-08-31T05:18:24.554645+0000 mgr.a (mgr.14388) 8094 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:18:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:25 smithi027 bash[22610]: audit 2024-08-31T05:18:24.772193+0000 mgr.a (mgr.14388) 8095 : audit [DBG] from='client.182133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:25 smithi191 bash[24992]: cluster 2024-08-31T05:18:24.554645+0000 mgr.a (mgr.14388) 8094 : cluster [DBG] pgmap v5610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:18:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:25 smithi191 bash[24992]: audit 2024-08-31T05:18:24.772193+0000 mgr.a (mgr.14388) 8095 : audit [DBG] from='client.182133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:27 smithi163 bash[24253]: cluster 2024-08-31T05:18:26.555539+0000 mgr.a (mgr.14388) 8096 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:28.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:27 smithi027 bash[22610]: cluster 2024-08-31T05:18:26.555539+0000 mgr.a (mgr.14388) 8096 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:27 smithi191 bash[24992]: cluster 2024-08-31T05:18:26.555539+0000 mgr.a (mgr.14388) 8096 : cluster [DBG] pgmap v5611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:30.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:30.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:30.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:29 smithi163 bash[24253]: cluster 2024-08-31T05:18:28.557702+0000 mgr.a (mgr.14388) 8097 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:29 smithi027 bash[22610]: cluster 2024-08-31T05:18:28.557702+0000 mgr.a (mgr.14388) 8097 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:29 smithi191 bash[24992]: cluster 2024-08-31T05:18:28.557702+0000 mgr.a (mgr.14388) 8097 : cluster [DBG] pgmap v5612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:30.927 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:30.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:30.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:30.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:30.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:18:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:31 smithi163 bash[24253]: audit 2024-08-31T05:18:30.520968+0000 mgr.a (mgr.14388) 8098 : audit [DBG] from='client.182208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:31 smithi163 bash[24253]: cluster 2024-08-31T05:18:30.558713+0000 mgr.a (mgr.14388) 8099 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:31 smithi027 bash[22610]: audit 2024-08-31T05:18:30.520968+0000 mgr.a (mgr.14388) 8098 : audit [DBG] from='client.182208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:31 smithi027 bash[22610]: cluster 2024-08-31T05:18:30.558713+0000 mgr.a (mgr.14388) 8099 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:31 smithi191 bash[24992]: audit 2024-08-31T05:18:30.520968+0000 mgr.a (mgr.14388) 8098 : audit [DBG] from='client.182208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:31 smithi191 bash[24992]: cluster 2024-08-31T05:18:30.558713+0000 mgr.a (mgr.14388) 8099 : cluster [DBG] pgmap v5613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:33 smithi163 bash[24253]: cluster 2024-08-31T05:18:32.559635+0000 mgr.a (mgr.14388) 8100 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:33 smithi027 bash[22610]: cluster 2024-08-31T05:18:32.559635+0000 mgr.a (mgr.14388) 8100 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:33 smithi191 bash[24992]: cluster 2024-08-31T05:18:32.559635+0000 mgr.a (mgr.14388) 8100 : cluster [DBG] pgmap v5614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:35.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:35.929 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:35.929 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:35 smithi163 bash[24253]: cluster 2024-08-31T05:18:34.561848+0000 mgr.a (mgr.14388) 8101 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:35 smithi027 bash[22610]: cluster 2024-08-31T05:18:34.561848+0000 mgr.a (mgr.14388) 8101 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:35 smithi191 bash[24992]: cluster 2024-08-31T05:18:34.561848+0000 mgr.a (mgr.14388) 8101 : cluster [DBG] pgmap v5615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:36.693 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:36.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:36.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:36.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:36.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:18:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:36 smithi163 bash[24253]: audit 2024-08-31T05:18:36.263188+0000 mgr.a (mgr.14388) 8102 : audit [DBG] from='client.182286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:37.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:36 smithi027 bash[22610]: audit 2024-08-31T05:18:36.263188+0000 mgr.a (mgr.14388) 8102 : audit [DBG] from='client.182286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:36 smithi191 bash[24992]: audit 2024-08-31T05:18:36.263188+0000 mgr.a (mgr.14388) 8102 : audit [DBG] from='client.182286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:37 smithi163 bash[24253]: cluster 2024-08-31T05:18:36.562439+0000 mgr.a (mgr.14388) 8103 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:37 smithi027 bash[22610]: cluster 2024-08-31T05:18:36.562439+0000 mgr.a (mgr.14388) 8103 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:37 smithi191 bash[24992]: cluster 2024-08-31T05:18:36.562439+0000 mgr.a (mgr.14388) 8103 : cluster [DBG] pgmap v5616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:39 smithi163 bash[24253]: cluster 2024-08-31T05:18:38.564646+0000 mgr.a (mgr.14388) 8104 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:39 smithi027 bash[22610]: cluster 2024-08-31T05:18:38.564646+0000 mgr.a (mgr.14388) 8104 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:39 smithi191 bash[24992]: cluster 2024-08-31T05:18:38.564646+0000 mgr.a (mgr.14388) 8104 : cluster [DBG] pgmap v5617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:41.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:41.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:41.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:41 smithi163 bash[24253]: cluster 2024-08-31T05:18:40.565413+0000 mgr.a (mgr.14388) 8105 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:41 smithi027 bash[22610]: cluster 2024-08-31T05:18:40.565413+0000 mgr.a (mgr.14388) 8105 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:41 smithi191 bash[24992]: cluster 2024-08-31T05:18:40.565413+0000 mgr.a (mgr.14388) 8105 : cluster [DBG] pgmap v5618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:42.457 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:42.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:42.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:42.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:42.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:18:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:42 smithi163 bash[24253]: audit 2024-08-31T05:18:42.031069+0000 mgr.a (mgr.14388) 8106 : audit [DBG] from='client.182361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:43.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:42 smithi027 bash[22610]: audit 2024-08-31T05:18:42.031069+0000 mgr.a (mgr.14388) 8106 : audit [DBG] from='client.182361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:42 smithi191 bash[24992]: audit 2024-08-31T05:18:42.031069+0000 mgr.a (mgr.14388) 8106 : audit [DBG] from='client.182361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:43 smithi163 bash[24253]: cluster 2024-08-31T05:18:42.566442+0000 mgr.a (mgr.14388) 8107 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:43 smithi027 bash[22610]: cluster 2024-08-31T05:18:42.566442+0000 mgr.a (mgr.14388) 8107 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:43 smithi191 bash[24992]: cluster 2024-08-31T05:18:42.566442+0000 mgr.a (mgr.14388) 8107 : cluster [DBG] pgmap v5619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:45 smithi163 bash[24253]: cluster 2024-08-31T05:18:44.568690+0000 mgr.a (mgr.14388) 8108 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:45 smithi027 bash[22610]: cluster 2024-08-31T05:18:44.568690+0000 mgr.a (mgr.14388) 8108 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:45 smithi191 bash[24992]: cluster 2024-08-31T05:18:44.568690+0000 mgr.a (mgr.14388) 8108 : cluster [DBG] pgmap v5620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:18:47.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:47.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:47.460 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:47 smithi163 bash[24253]: cluster 2024-08-31T05:18:46.569616+0000 mgr.a (mgr.14388) 8109 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:48.209 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:48.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:48.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:48.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:48.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:18:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:47 smithi027 bash[22610]: cluster 2024-08-31T05:18:46.569616+0000 mgr.a (mgr.14388) 8109 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:47 smithi191 bash[24992]: cluster 2024-08-31T05:18:46.569616+0000 mgr.a (mgr.14388) 8109 : cluster [DBG] pgmap v5621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:48 smithi163 bash[24253]: audit 2024-08-31T05:18:47.795436+0000 mgr.a (mgr.14388) 8110 : audit [DBG] from='client.182436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:48 smithi027 bash[22610]: audit 2024-08-31T05:18:47.795436+0000 mgr.a (mgr.14388) 8110 : audit [DBG] from='client.182436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:48 smithi191 bash[24992]: audit 2024-08-31T05:18:47.795436+0000 mgr.a (mgr.14388) 8110 : audit [DBG] from='client.182436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:49 smithi163 bash[24253]: cluster 2024-08-31T05:18:48.572431+0000 mgr.a (mgr.14388) 8111 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:49 smithi027 bash[22610]: cluster 2024-08-31T05:18:48.572431+0000 mgr.a (mgr.14388) 8111 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:49 smithi191 bash[24992]: cluster 2024-08-31T05:18:48.572431+0000 mgr.a (mgr.14388) 8111 : cluster [DBG] pgmap v5622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:51 smithi163 bash[24253]: cluster 2024-08-31T05:18:50.573208+0000 mgr.a (mgr.14388) 8112 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:18:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:51 smithi027 bash[22610]: cluster 2024-08-31T05:18:50.573208+0000 mgr.a (mgr.14388) 8112 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:18:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:51 smithi191 bash[24992]: cluster 2024-08-31T05:18:50.573208+0000 mgr.a (mgr.14388) 8112 : cluster [DBG] pgmap v5623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:18:53.210 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:53.211 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:53.211 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:53.979 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:53.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:53.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:53.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:53.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:18:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:53 smithi163 bash[24253]: cluster 2024-08-31T05:18:52.573957+0000 mgr.a (mgr.14388) 8113 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:18:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:53 smithi027 bash[22610]: cluster 2024-08-31T05:18:52.573957+0000 mgr.a (mgr.14388) 8113 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:18:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:53 smithi191 bash[24992]: cluster 2024-08-31T05:18:52.573957+0000 mgr.a (mgr.14388) 8113 : cluster [DBG] pgmap v5624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:18:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:54 smithi163 bash[24253]: audit 2024-08-31T05:18:53.545422+0000 mgr.a (mgr.14388) 8114 : audit [DBG] from='client.182511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:54 smithi027 bash[22610]: audit 2024-08-31T05:18:53.545422+0000 mgr.a (mgr.14388) 8114 : audit [DBG] from='client.182511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:54 smithi191 bash[24992]: audit 2024-08-31T05:18:53.545422+0000 mgr.a (mgr.14388) 8114 : audit [DBG] from='client.182511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:18:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:55 smithi163 bash[24253]: cluster 2024-08-31T05:18:54.576831+0000 mgr.a (mgr.14388) 8115 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:55 smithi027 bash[22610]: cluster 2024-08-31T05:18:54.576831+0000 mgr.a (mgr.14388) 8115 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:55 smithi191 bash[24992]: cluster 2024-08-31T05:18:54.576831+0000 mgr.a (mgr.14388) 8115 : cluster [DBG] pgmap v5625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:18:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:57 smithi163 bash[24253]: cluster 2024-08-31T05:18:56.577623+0000 mgr.a (mgr.14388) 8116 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:18:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:57 smithi027 bash[22610]: cluster 2024-08-31T05:18:56.577623+0000 mgr.a (mgr.14388) 8116 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:18:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:57 smithi191 bash[24992]: cluster 2024-08-31T05:18:56.577623+0000 mgr.a (mgr.14388) 8116 : cluster [DBG] pgmap v5626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:18:58.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:18:58.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:18:58.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:18:59.736 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:18:59.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:18:59.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:18:59.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:18:59.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:18:59 smithi163 bash[24253]: cluster 2024-08-31T05:18:58.579593+0000 mgr.a (mgr.14388) 8117 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:18:59 smithi027 bash[22610]: cluster 2024-08-31T05:18:58.579593+0000 mgr.a (mgr.14388) 8117 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:18:59 smithi191 bash[24992]: cluster 2024-08-31T05:18:58.579593+0000 mgr.a (mgr.14388) 8117 : cluster [DBG] pgmap v5627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:00 smithi163 bash[24253]: audit 2024-08-31T05:18:59.316681+0000 mgr.a (mgr.14388) 8118 : audit [DBG] from='client.182586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:00 smithi027 bash[22610]: audit 2024-08-31T05:18:59.316681+0000 mgr.a (mgr.14388) 8118 : audit [DBG] from='client.182586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:00 smithi191 bash[24992]: audit 2024-08-31T05:18:59.316681+0000 mgr.a (mgr.14388) 8118 : audit [DBG] from='client.182586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:02.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:01 smithi027 bash[22610]: cluster 2024-08-31T05:19:00.580716+0000 mgr.a (mgr.14388) 8119 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:01 smithi191 bash[24992]: cluster 2024-08-31T05:19:00.580716+0000 mgr.a (mgr.14388) 8119 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:01 smithi163 bash[24253]: cluster 2024-08-31T05:19:00.580716+0000 mgr.a (mgr.14388) 8119 : cluster [DBG] pgmap v5628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:03 smithi027 bash[22610]: cluster 2024-08-31T05:19:02.581565+0000 mgr.a (mgr.14388) 8120 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:03 smithi191 bash[24992]: cluster 2024-08-31T05:19:02.581565+0000 mgr.a (mgr.14388) 8120 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:03 smithi163 bash[24253]: cluster 2024-08-31T05:19:02.581565+0000 mgr.a (mgr.14388) 8120 : cluster [DBG] pgmap v5629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:04.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:19:04.738 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:19:04.738 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:19:05.519 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:19:05.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:19:05.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:19:05.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:19:05.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:05 smithi027 bash[22610]: cluster 2024-08-31T05:19:04.583798+0000 mgr.a (mgr.14388) 8121 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:05 smithi027 bash[22610]: audit 2024-08-31T05:19:05.078925+0000 mgr.a (mgr.14388) 8122 : audit [DBG] from='client.182664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:05 smithi191 bash[24992]: cluster 2024-08-31T05:19:04.583798+0000 mgr.a (mgr.14388) 8121 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:05 smithi191 bash[24992]: audit 2024-08-31T05:19:05.078925+0000 mgr.a (mgr.14388) 8122 : audit [DBG] from='client.182664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:05 smithi163 bash[24253]: cluster 2024-08-31T05:19:04.583798+0000 mgr.a (mgr.14388) 8121 : cluster [DBG] pgmap v5630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:05 smithi163 bash[24253]: audit 2024-08-31T05:19:05.078925+0000 mgr.a (mgr.14388) 8122 : audit [DBG] from='client.182664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:07 smithi027 bash[22610]: cluster 2024-08-31T05:19:06.584715+0000 mgr.a (mgr.14388) 8123 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:07 smithi191 bash[24992]: cluster 2024-08-31T05:19:06.584715+0000 mgr.a (mgr.14388) 8123 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:07 smithi163 bash[24253]: cluster 2024-08-31T05:19:06.584715+0000 mgr.a (mgr.14388) 8123 : cluster [DBG] pgmap v5631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:08 smithi027 bash[22610]: audit 2024-08-31T05:19:08.643199+0000 mon.a (mon.0) 1800 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:19:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:08 smithi191 bash[24992]: audit 2024-08-31T05:19:08.643199+0000 mon.a (mon.0) 1800 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:19:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:08 smithi163 bash[24253]: audit 2024-08-31T05:19:08.643199+0000 mon.a (mon.0) 1800 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:19:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:09 smithi027 bash[22610]: cluster 2024-08-31T05:19:08.587052+0000 mgr.a (mgr.14388) 8124 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:09 smithi027 bash[22610]: audit 2024-08-31T05:19:09.491191+0000 mon.a (mon.0) 1801 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:19:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:09 smithi027 bash[22610]: audit 2024-08-31T05:19:09.493070+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:19:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:09 smithi027 bash[22610]: audit 2024-08-31T05:19:09.504022+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:19:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:09 smithi027 bash[22610]: audit 2024-08-31T05:19:09.509240+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:19:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:09 smithi191 bash[24992]: cluster 2024-08-31T05:19:08.587052+0000 mgr.a (mgr.14388) 8124 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:09 smithi191 bash[24992]: audit 2024-08-31T05:19:09.491191+0000 mon.a (mon.0) 1801 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:19:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:09 smithi191 bash[24992]: audit 2024-08-31T05:19:09.493070+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:19:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:09 smithi191 bash[24992]: audit 2024-08-31T05:19:09.504022+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:19:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:09 smithi191 bash[24992]: audit 2024-08-31T05:19:09.509240+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:19:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:09 smithi163 bash[24253]: cluster 2024-08-31T05:19:08.587052+0000 mgr.a (mgr.14388) 8124 : cluster [DBG] pgmap v5632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:09 smithi163 bash[24253]: audit 2024-08-31T05:19:09.491191+0000 mon.a (mon.0) 1801 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:19:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:09 smithi163 bash[24253]: audit 2024-08-31T05:19:09.493070+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:19:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:09 smithi163 bash[24253]: audit 2024-08-31T05:19:09.504022+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:19:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:09 smithi163 bash[24253]: audit 2024-08-31T05:19:09.509240+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:19:10.521 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:19:10.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:19:10.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:19:10.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:19:10 smithi027 bash[22863]: debug 2024-08-31T05:19:10.236+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:19:10.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:19:10 smithi027 bash[22863]: debug 2024-08-31T05:19:10.236+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:19:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:10 smithi027 bash[22610]: audit 2024-08-31T05:19:09.511571+0000 mgr.a (mgr.14388) 8125 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:19:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:10 smithi027 bash[22610]: audit 2024-08-31T05:19:10.239110+0000 mgr.a (mgr.14388) 8126 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:19:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:10 smithi027 bash[22610]: cephadm 2024-08-31T05:19:10.240969+0000 mgr.a (mgr.14388) 8127 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:19:11.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:19:11.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:19:11.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:19:11.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:11.275 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:19:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:10 smithi191 bash[24992]: audit 2024-08-31T05:19:09.511571+0000 mgr.a (mgr.14388) 8125 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:19:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:10 smithi191 bash[24992]: audit 2024-08-31T05:19:10.239110+0000 mgr.a (mgr.14388) 8126 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:19:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:10 smithi191 bash[24992]: cephadm 2024-08-31T05:19:10.240969+0000 mgr.a (mgr.14388) 8127 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:19:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:10 smithi163 bash[24253]: audit 2024-08-31T05:19:09.511571+0000 mgr.a (mgr.14388) 8125 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:19:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:10 smithi163 bash[24253]: audit 2024-08-31T05:19:10.239110+0000 mgr.a (mgr.14388) 8126 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:19:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:10 smithi163 bash[24253]: cephadm 2024-08-31T05:19:10.240969+0000 mgr.a (mgr.14388) 8127 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:19:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:11 smithi191 bash[24992]: cluster 2024-08-31T05:19:10.587972+0000 mgr.a (mgr.14388) 8128 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:11 smithi191 bash[24992]: audit 2024-08-31T05:19:10.845057+0000 mgr.a (mgr.14388) 8129 : audit [DBG] from='client.182850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:11 smithi163 bash[24253]: cluster 2024-08-31T05:19:10.587972+0000 mgr.a (mgr.14388) 8128 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:11 smithi163 bash[24253]: audit 2024-08-31T05:19:10.845057+0000 mgr.a (mgr.14388) 8129 : audit [DBG] from='client.182850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:11 smithi027 bash[22610]: cluster 2024-08-31T05:19:10.587972+0000 mgr.a (mgr.14388) 8128 : cluster [DBG] pgmap v5633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:11 smithi027 bash[22610]: audit 2024-08-31T05:19:10.845057+0000 mgr.a (mgr.14388) 8129 : audit [DBG] from='client.182850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:13 smithi191 bash[24992]: cluster 2024-08-31T05:19:12.588951+0000 mgr.a (mgr.14388) 8130 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:13 smithi163 bash[24253]: cluster 2024-08-31T05:19:12.588951+0000 mgr.a (mgr.14388) 8130 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:13 smithi027 bash[22610]: cluster 2024-08-31T05:19:12.588951+0000 mgr.a (mgr.14388) 8130 : cluster [DBG] pgmap v5634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:16.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:19:16.277 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:19:16.277 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:19:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:15 smithi191 bash[24992]: cluster 2024-08-31T05:19:14.591237+0000 mgr.a (mgr.14388) 8131 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:15 smithi163 bash[24253]: cluster 2024-08-31T05:19:14.591237+0000 mgr.a (mgr.14388) 8131 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:15 smithi027 bash[22610]: cluster 2024-08-31T05:19:14.591237+0000 mgr.a (mgr.14388) 8131 : cluster [DBG] pgmap v5635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:17.051 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:19:17.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:19:17.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:19:17.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:19:17.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:17 smithi191 bash[24992]: cluster 2024-08-31T05:19:16.591966+0000 mgr.a (mgr.14388) 8132 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:17 smithi191 bash[24992]: audit 2024-08-31T05:19:16.616255+0000 mgr.a (mgr.14388) 8133 : audit [DBG] from='client.182928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:17 smithi163 bash[24253]: cluster 2024-08-31T05:19:16.591966+0000 mgr.a (mgr.14388) 8132 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:17 smithi163 bash[24253]: audit 2024-08-31T05:19:16.616255+0000 mgr.a (mgr.14388) 8133 : audit [DBG] from='client.182928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:17 smithi027 bash[22610]: cluster 2024-08-31T05:19:16.591966+0000 mgr.a (mgr.14388) 8132 : cluster [DBG] pgmap v5636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:17 smithi027 bash[22610]: audit 2024-08-31T05:19:16.616255+0000 mgr.a (mgr.14388) 8133 : audit [DBG] from='client.182928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:20 smithi191 bash[24992]: cluster 2024-08-31T05:19:18.594330+0000 mgr.a (mgr.14388) 8134 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:20 smithi163 bash[24253]: cluster 2024-08-31T05:19:18.594330+0000 mgr.a (mgr.14388) 8134 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:20 smithi027 bash[22610]: cluster 2024-08-31T05:19:18.594330+0000 mgr.a (mgr.14388) 8134 : cluster [DBG] pgmap v5637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:22.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:19:22.054 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:19:22.054 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:19:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:22 smithi191 bash[24992]: cluster 2024-08-31T05:19:20.595126+0000 mgr.a (mgr.14388) 8135 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:22 smithi163 bash[24253]: cluster 2024-08-31T05:19:20.595126+0000 mgr.a (mgr.14388) 8135 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:22 smithi027 bash[22610]: cluster 2024-08-31T05:19:20.595126+0000 mgr.a (mgr.14388) 8135 : cluster [DBG] pgmap v5638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:22.804 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:19:22.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:19:22.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:19:22.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:19:22.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:24 smithi191 bash[24992]: audit 2024-08-31T05:19:22.382603+0000 mgr.a (mgr.14388) 8136 : audit [DBG] from='client.183003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:24 smithi191 bash[24992]: cluster 2024-08-31T05:19:22.595610+0000 mgr.a (mgr.14388) 8137 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:24 smithi163 bash[24253]: audit 2024-08-31T05:19:22.382603+0000 mgr.a (mgr.14388) 8136 : audit [DBG] from='client.183003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:24 smithi163 bash[24253]: cluster 2024-08-31T05:19:22.595610+0000 mgr.a (mgr.14388) 8137 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:24 smithi027 bash[22610]: audit 2024-08-31T05:19:22.382603+0000 mgr.a (mgr.14388) 8136 : audit [DBG] from='client.183003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:24 smithi027 bash[22610]: cluster 2024-08-31T05:19:22.595610+0000 mgr.a (mgr.14388) 8137 : cluster [DBG] pgmap v5639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:26 smithi191 bash[24992]: cluster 2024-08-31T05:19:24.597902+0000 mgr.a (mgr.14388) 8138 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:26 smithi163 bash[24253]: cluster 2024-08-31T05:19:24.597902+0000 mgr.a (mgr.14388) 8138 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:26 smithi027 bash[22610]: cluster 2024-08-31T05:19:24.597902+0000 mgr.a (mgr.14388) 8138 : cluster [DBG] pgmap v5640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:19:27.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:19:27.806 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:19:27.806 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:19:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:28 smithi191 bash[24992]: cluster 2024-08-31T05:19:26.598672+0000 mgr.a (mgr.14388) 8139 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:28 smithi163 bash[24253]: cluster 2024-08-31T05:19:26.598672+0000 mgr.a (mgr.14388) 8139 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:28 smithi027 bash[22610]: cluster 2024-08-31T05:19:26.598672+0000 mgr.a (mgr.14388) 8139 : cluster [DBG] pgmap v5641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:28.561 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:19:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:19:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:19:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:19:28.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:29 smithi191 bash[24992]: audit 2024-08-31T05:19:28.142963+0000 mgr.a (mgr.14388) 8140 : audit [DBG] from='client.183078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:29 smithi163 bash[24253]: audit 2024-08-31T05:19:28.142963+0000 mgr.a (mgr.14388) 8140 : audit [DBG] from='client.183078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:29 smithi027 bash[22610]: audit 2024-08-31T05:19:28.142963+0000 mgr.a (mgr.14388) 8140 : audit [DBG] from='client.183078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:30 smithi191 bash[24992]: cluster 2024-08-31T05:19:28.599986+0000 mgr.a (mgr.14388) 8141 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:30 smithi163 bash[24253]: cluster 2024-08-31T05:19:28.599986+0000 mgr.a (mgr.14388) 8141 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:30 smithi027 bash[22610]: cluster 2024-08-31T05:19:28.599986+0000 mgr.a (mgr.14388) 8141 : cluster [DBG] pgmap v5642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:32 smithi191 bash[24992]: cluster 2024-08-31T05:19:30.600712+0000 mgr.a (mgr.14388) 8142 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:19:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:32 smithi163 bash[24253]: cluster 2024-08-31T05:19:30.600712+0000 mgr.a (mgr.14388) 8142 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:19:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:32 smithi027 bash[22610]: cluster 2024-08-31T05:19:30.600712+0000 mgr.a (mgr.14388) 8142 : cluster [DBG] pgmap v5643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:19:33.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:19:33.563 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:19:33.563 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:19:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:34 smithi191 bash[24992]: cluster 2024-08-31T05:19:32.601437+0000 mgr.a (mgr.14388) 8143 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:19:34.327 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:19:34.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:19:34.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:19:34.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:19:34.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:34 smithi163 bash[24253]: cluster 2024-08-31T05:19:32.601437+0000 mgr.a (mgr.14388) 8143 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:19:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:34 smithi027 bash[22610]: cluster 2024-08-31T05:19:32.601437+0000 mgr.a (mgr.14388) 8143 : cluster [DBG] pgmap v5644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:19:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:35 smithi163 bash[24253]: audit 2024-08-31T05:19:33.893609+0000 mgr.a (mgr.14388) 8144 : audit [DBG] from='client.183156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:35 smithi027 bash[22610]: audit 2024-08-31T05:19:33.893609+0000 mgr.a (mgr.14388) 8144 : audit [DBG] from='client.183156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:35 smithi191 bash[24992]: audit 2024-08-31T05:19:33.893609+0000 mgr.a (mgr.14388) 8144 : audit [DBG] from='client.183156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:36 smithi163 bash[24253]: cluster 2024-08-31T05:19:34.604240+0000 mgr.a (mgr.14388) 8145 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:36 smithi027 bash[22610]: cluster 2024-08-31T05:19:34.604240+0000 mgr.a (mgr.14388) 8145 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:36 smithi191 bash[24992]: cluster 2024-08-31T05:19:34.604240+0000 mgr.a (mgr.14388) 8145 : cluster [DBG] pgmap v5645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:38 smithi163 bash[24253]: cluster 2024-08-31T05:19:36.604994+0000 mgr.a (mgr.14388) 8146 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:19:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:38 smithi027 bash[22610]: cluster 2024-08-31T05:19:36.604994+0000 mgr.a (mgr.14388) 8146 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:19:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:38 smithi191 bash[24992]: cluster 2024-08-31T05:19:36.604994+0000 mgr.a (mgr.14388) 8146 : cluster [DBG] pgmap v5646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:19:39.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:19:39.329 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:19:39.330 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:19:40.110 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:19:40.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:19:40.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:19:40.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:19:40.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:40 smithi163 bash[24253]: cluster 2024-08-31T05:19:38.606978+0000 mgr.a (mgr.14388) 8147 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:40 smithi027 bash[22610]: cluster 2024-08-31T05:19:38.606978+0000 mgr.a (mgr.14388) 8147 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:40 smithi191 bash[24992]: cluster 2024-08-31T05:19:38.606978+0000 mgr.a (mgr.14388) 8147 : cluster [DBG] pgmap v5647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:41 smithi163 bash[24253]: audit 2024-08-31T05:19:39.668700+0000 mgr.a (mgr.14388) 8148 : audit [DBG] from='client.183234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:41 smithi027 bash[22610]: audit 2024-08-31T05:19:39.668700+0000 mgr.a (mgr.14388) 8148 : audit [DBG] from='client.183234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:41 smithi191 bash[24992]: audit 2024-08-31T05:19:39.668700+0000 mgr.a (mgr.14388) 8148 : audit [DBG] from='client.183234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:42 smithi163 bash[24253]: cluster 2024-08-31T05:19:40.608049+0000 mgr.a (mgr.14388) 8149 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:42 smithi027 bash[22610]: cluster 2024-08-31T05:19:40.608049+0000 mgr.a (mgr.14388) 8149 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:42 smithi191 bash[24992]: cluster 2024-08-31T05:19:40.608049+0000 mgr.a (mgr.14388) 8149 : cluster [DBG] pgmap v5648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:44 smithi163 bash[24253]: cluster 2024-08-31T05:19:42.609006+0000 mgr.a (mgr.14388) 8150 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:44 smithi027 bash[22610]: cluster 2024-08-31T05:19:42.609006+0000 mgr.a (mgr.14388) 8150 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:44 smithi191 bash[24992]: cluster 2024-08-31T05:19:42.609006+0000 mgr.a (mgr.14388) 8150 : cluster [DBG] pgmap v5649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:45.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:19:45.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:19:45.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:19:45.871 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:19:45.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:19:45.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:19:45.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:19:45.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:46 smithi163 bash[24253]: cluster 2024-08-31T05:19:44.611282+0000 mgr.a (mgr.14388) 8151 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:46 smithi027 bash[22610]: cluster 2024-08-31T05:19:44.611282+0000 mgr.a (mgr.14388) 8151 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:46 smithi191 bash[24992]: cluster 2024-08-31T05:19:44.611282+0000 mgr.a (mgr.14388) 8151 : cluster [DBG] pgmap v5650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:47 smithi163 bash[24253]: audit 2024-08-31T05:19:45.463413+0000 mgr.a (mgr.14388) 8152 : audit [DBG] from='client.183312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:47 smithi027 bash[22610]: audit 2024-08-31T05:19:45.463413+0000 mgr.a (mgr.14388) 8152 : audit [DBG] from='client.183312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:47 smithi191 bash[24992]: audit 2024-08-31T05:19:45.463413+0000 mgr.a (mgr.14388) 8152 : audit [DBG] from='client.183312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:48 smithi163 bash[24253]: cluster 2024-08-31T05:19:46.612231+0000 mgr.a (mgr.14388) 8153 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:48 smithi027 bash[22610]: cluster 2024-08-31T05:19:46.612231+0000 mgr.a (mgr.14388) 8153 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:48 smithi191 bash[24992]: cluster 2024-08-31T05:19:46.612231+0000 mgr.a (mgr.14388) 8153 : cluster [DBG] pgmap v5651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:50 smithi163 bash[24253]: cluster 2024-08-31T05:19:48.614381+0000 mgr.a (mgr.14388) 8154 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:50 smithi027 bash[22610]: cluster 2024-08-31T05:19:48.614381+0000 mgr.a (mgr.14388) 8154 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:50 smithi191 bash[24992]: cluster 2024-08-31T05:19:48.614381+0000 mgr.a (mgr.14388) 8154 : cluster [DBG] pgmap v5652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:50.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:19:50.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:19:50.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:19:51.620 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:19:51.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:19:51.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:19:51.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:19:51.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:52 smithi163 bash[24253]: cluster 2024-08-31T05:19:50.615168+0000 mgr.a (mgr.14388) 8155 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:52 smithi163 bash[24253]: audit 2024-08-31T05:19:51.209595+0000 mgr.a (mgr.14388) 8156 : audit [DBG] from='client.183390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:52 smithi027 bash[22610]: cluster 2024-08-31T05:19:50.615168+0000 mgr.a (mgr.14388) 8155 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:52 smithi027 bash[22610]: audit 2024-08-31T05:19:51.209595+0000 mgr.a (mgr.14388) 8156 : audit [DBG] from='client.183390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:52 smithi191 bash[24992]: cluster 2024-08-31T05:19:50.615168+0000 mgr.a (mgr.14388) 8155 : cluster [DBG] pgmap v5653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:52 smithi191 bash[24992]: audit 2024-08-31T05:19:51.209595+0000 mgr.a (mgr.14388) 8156 : audit [DBG] from='client.183390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:54 smithi163 bash[24253]: cluster 2024-08-31T05:19:52.616119+0000 mgr.a (mgr.14388) 8157 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:54 smithi027 bash[22610]: cluster 2024-08-31T05:19:52.616119+0000 mgr.a (mgr.14388) 8157 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:54 smithi191 bash[24992]: cluster 2024-08-31T05:19:52.616119+0000 mgr.a (mgr.14388) 8157 : cluster [DBG] pgmap v5654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:56 smithi163 bash[24253]: cluster 2024-08-31T05:19:54.618348+0000 mgr.a (mgr.14388) 8158 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:56 smithi027 bash[22610]: cluster 2024-08-31T05:19:54.618348+0000 mgr.a (mgr.14388) 8158 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:56 smithi191 bash[24992]: cluster 2024-08-31T05:19:54.618348+0000 mgr.a (mgr.14388) 8158 : cluster [DBG] pgmap v5655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:19:56.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:19:56.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:19:56.623 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:19:57.367 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:19:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:19:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:19:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:19:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:19:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:58 smithi163 bash[24253]: cluster 2024-08-31T05:19:56.619071+0000 mgr.a (mgr.14388) 8159 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:19:58 smithi163 bash[24253]: audit 2024-08-31T05:19:56.958854+0000 mgr.a (mgr.14388) 8160 : audit [DBG] from='client.183468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:58 smithi027 bash[22610]: cluster 2024-08-31T05:19:56.619071+0000 mgr.a (mgr.14388) 8159 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:19:58 smithi027 bash[22610]: audit 2024-08-31T05:19:56.958854+0000 mgr.a (mgr.14388) 8160 : audit [DBG] from='client.183468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:58 smithi191 bash[24992]: cluster 2024-08-31T05:19:56.619071+0000 mgr.a (mgr.14388) 8159 : cluster [DBG] pgmap v5656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:19:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:19:58 smithi191 bash[24992]: audit 2024-08-31T05:19:56.958854+0000 mgr.a (mgr.14388) 8160 : audit [DBG] from='client.183468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:00 smithi163 bash[24253]: cluster 2024-08-31T05:19:58.621322+0000 mgr.a (mgr.14388) 8161 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:00.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:00 smithi163 bash[24253]: cluster 2024-08-31T05:20:00.000159+0000 mon.a (mon.0) 1805 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:20:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:00 smithi027 bash[22610]: cluster 2024-08-31T05:19:58.621322+0000 mgr.a (mgr.14388) 8161 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:00 smithi027 bash[22610]: cluster 2024-08-31T05:20:00.000159+0000 mon.a (mon.0) 1805 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:20:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:00 smithi191 bash[24992]: cluster 2024-08-31T05:19:58.621322+0000 mgr.a (mgr.14388) 8161 : cluster [DBG] pgmap v5657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:00 smithi191 bash[24992]: cluster 2024-08-31T05:20:00.000159+0000 mon.a (mon.0) 1805 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:20:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:20:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:20:02.372 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:20:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:02 smithi163 bash[24253]: cluster 2024-08-31T05:20:00.622111+0000 mgr.a (mgr.14388) 8162 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:02 smithi027 bash[22610]: cluster 2024-08-31T05:20:00.622111+0000 mgr.a (mgr.14388) 8162 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:02 smithi191 bash[24992]: cluster 2024-08-31T05:20:00.622111+0000 mgr.a (mgr.14388) 8162 : cluster [DBG] pgmap v5658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:03.118 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:20:03.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:20:03.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:20:03.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:20:03.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:20:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:04 smithi163 bash[24253]: cluster 2024-08-31T05:20:02.622859+0000 mgr.a (mgr.14388) 8163 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:04 smithi163 bash[24253]: audit 2024-08-31T05:20:02.705520+0000 mgr.a (mgr.14388) 8164 : audit [DBG] from='client.183546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:04 smithi027 bash[22610]: cluster 2024-08-31T05:20:02.622859+0000 mgr.a (mgr.14388) 8163 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:04 smithi027 bash[22610]: audit 2024-08-31T05:20:02.705520+0000 mgr.a (mgr.14388) 8164 : audit [DBG] from='client.183546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:04 smithi191 bash[24992]: cluster 2024-08-31T05:20:02.622859+0000 mgr.a (mgr.14388) 8163 : cluster [DBG] pgmap v5659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:04 smithi191 bash[24992]: audit 2024-08-31T05:20:02.705520+0000 mgr.a (mgr.14388) 8164 : audit [DBG] from='client.183546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:06 smithi163 bash[24253]: cluster 2024-08-31T05:20:04.625568+0000 mgr.a (mgr.14388) 8165 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:06 smithi027 bash[22610]: cluster 2024-08-31T05:20:04.625568+0000 mgr.a (mgr.14388) 8165 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:06 smithi191 bash[24992]: cluster 2024-08-31T05:20:04.625568+0000 mgr.a (mgr.14388) 8165 : cluster [DBG] pgmap v5660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:08.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:20:08.121 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:20:08.121 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:20:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:08 smithi163 bash[24253]: cluster 2024-08-31T05:20:06.626351+0000 mgr.a (mgr.14388) 8166 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:08 smithi027 bash[22610]: cluster 2024-08-31T05:20:06.626351+0000 mgr.a (mgr.14388) 8166 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:08 smithi191 bash[24992]: cluster 2024-08-31T05:20:06.626351+0000 mgr.a (mgr.14388) 8166 : cluster [DBG] pgmap v5661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:08.875 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:20:08.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:20:08.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:20:08.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:20:08.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:20:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:10 smithi163 bash[24253]: audit 2024-08-31T05:20:08.454639+0000 mgr.a (mgr.14388) 8167 : audit [DBG] from='client.183621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:10 smithi163 bash[24253]: cluster 2024-08-31T05:20:08.627694+0000 mgr.a (mgr.14388) 8168 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:10 smithi027 bash[22610]: audit 2024-08-31T05:20:08.454639+0000 mgr.a (mgr.14388) 8167 : audit [DBG] from='client.183621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:10 smithi027 bash[22610]: cluster 2024-08-31T05:20:08.627694+0000 mgr.a (mgr.14388) 8168 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:10 smithi191 bash[24992]: audit 2024-08-31T05:20:08.454639+0000 mgr.a (mgr.14388) 8167 : audit [DBG] from='client.183621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:10 smithi191 bash[24992]: cluster 2024-08-31T05:20:08.627694+0000 mgr.a (mgr.14388) 8168 : cluster [DBG] pgmap v5662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:11 smithi163 bash[24253]: audit 2024-08-31T05:20:10.295129+0000 mon.a (mon.0) 1806 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:20:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:11 smithi163 bash[24253]: audit 2024-08-31T05:20:11.134471+0000 mon.a (mon.0) 1807 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:20:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:11 smithi163 bash[24253]: audit 2024-08-31T05:20:11.135574+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:20:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:11 smithi027 bash[22610]: audit 2024-08-31T05:20:10.295129+0000 mon.a (mon.0) 1806 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:20:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:11 smithi027 bash[22610]: audit 2024-08-31T05:20:11.134471+0000 mon.a (mon.0) 1807 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:20:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:11 smithi027 bash[22610]: audit 2024-08-31T05:20:11.135574+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:20:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:11 smithi191 bash[24992]: audit 2024-08-31T05:20:10.295129+0000 mon.a (mon.0) 1806 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:20:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:11 smithi191 bash[24992]: audit 2024-08-31T05:20:11.134471+0000 mon.a (mon.0) 1807 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:20:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:11 smithi191 bash[24992]: audit 2024-08-31T05:20:11.135574+0000 mon.a (mon.0) 1808 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:20:12.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:20:11 smithi027 bash[22863]: debug 2024-08-31T05:20:11.923+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:20:12.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:20:11 smithi027 bash[22863]: debug 2024-08-31T05:20:11.923+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:20:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:12 smithi027 bash[22610]: cluster 2024-08-31T05:20:10.628487+0000 mgr.a (mgr.14388) 8169 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:12 smithi027 bash[22610]: audit 2024-08-31T05:20:11.149191+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:20:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:12 smithi027 bash[22610]: audit 2024-08-31T05:20:11.155648+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:20:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:12 smithi027 bash[22610]: audit 2024-08-31T05:20:11.158118+0000 mgr.a (mgr.14388) 8170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:20:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:12 smithi163 bash[24253]: cluster 2024-08-31T05:20:10.628487+0000 mgr.a (mgr.14388) 8169 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:12 smithi163 bash[24253]: audit 2024-08-31T05:20:11.149191+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:20:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:12 smithi163 bash[24253]: audit 2024-08-31T05:20:11.155648+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:20:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:12 smithi163 bash[24253]: audit 2024-08-31T05:20:11.158118+0000 mgr.a (mgr.14388) 8170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:20:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:12 smithi191 bash[24992]: cluster 2024-08-31T05:20:10.628487+0000 mgr.a (mgr.14388) 8169 : cluster [DBG] pgmap v5663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:12 smithi191 bash[24992]: audit 2024-08-31T05:20:11.149191+0000 mon.a (mon.0) 1809 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:20:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:12 smithi191 bash[24992]: audit 2024-08-31T05:20:11.155648+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:20:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:12 smithi191 bash[24992]: audit 2024-08-31T05:20:11.158118+0000 mgr.a (mgr.14388) 8170 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:20:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:13 smithi163 bash[24253]: audit 2024-08-31T05:20:11.928838+0000 mgr.a (mgr.14388) 8171 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:20:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:13 smithi163 bash[24253]: cephadm 2024-08-31T05:20:11.930369+0000 mgr.a (mgr.14388) 8172 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:20:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:13 smithi027 bash[22610]: audit 2024-08-31T05:20:11.928838+0000 mgr.a (mgr.14388) 8171 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:20:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:13 smithi027 bash[22610]: cephadm 2024-08-31T05:20:11.930369+0000 mgr.a (mgr.14388) 8172 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:20:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:13 smithi191 bash[24992]: audit 2024-08-31T05:20:11.928838+0000 mgr.a (mgr.14388) 8171 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:20:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:13 smithi191 bash[24992]: cephadm 2024-08-31T05:20:11.930369+0000 mgr.a (mgr.14388) 8172 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:20:13.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:20:13.877 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:20:13.877 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:20:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:14 smithi163 bash[24253]: cluster 2024-08-31T05:20:12.629462+0000 mgr.a (mgr.14388) 8173 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:20:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:14 smithi027 bash[22610]: cluster 2024-08-31T05:20:12.629462+0000 mgr.a (mgr.14388) 8173 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:20:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:14 smithi191 bash[24992]: cluster 2024-08-31T05:20:12.629462+0000 mgr.a (mgr.14388) 8173 : cluster [DBG] pgmap v5664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:20:14.665 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:20:14.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:20:14.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:20:14.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:20:14.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:20:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:15 smithi163 bash[24253]: audit 2024-08-31T05:20:14.213980+0000 mgr.a (mgr.14388) 8174 : audit [DBG] from='client.183807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:15 smithi027 bash[22610]: audit 2024-08-31T05:20:14.213980+0000 mgr.a (mgr.14388) 8174 : audit [DBG] from='client.183807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:15 smithi191 bash[24992]: audit 2024-08-31T05:20:14.213980+0000 mgr.a (mgr.14388) 8174 : audit [DBG] from='client.183807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:16 smithi163 bash[24253]: cluster 2024-08-31T05:20:14.631069+0000 mgr.a (mgr.14388) 8175 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:16 smithi027 bash[22610]: cluster 2024-08-31T05:20:14.631069+0000 mgr.a (mgr.14388) 8175 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:16 smithi191 bash[24992]: cluster 2024-08-31T05:20:14.631069+0000 mgr.a (mgr.14388) 8175 : cluster [DBG] pgmap v5665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:18 smithi163 bash[24253]: cluster 2024-08-31T05:20:16.631820+0000 mgr.a (mgr.14388) 8176 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:18 smithi027 bash[22610]: cluster 2024-08-31T05:20:16.631820+0000 mgr.a (mgr.14388) 8176 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:18 smithi191 bash[24992]: cluster 2024-08-31T05:20:16.631820+0000 mgr.a (mgr.14388) 8176 : cluster [DBG] pgmap v5666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:19.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:20:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:20:19.668 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:20:20.417 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:20:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:20:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:20:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:20:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:20:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:20 smithi163 bash[24253]: cluster 2024-08-31T05:20:18.633834+0000 mgr.a (mgr.14388) 8177 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:20 smithi027 bash[22610]: cluster 2024-08-31T05:20:18.633834+0000 mgr.a (mgr.14388) 8177 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:20 smithi191 bash[24992]: cluster 2024-08-31T05:20:18.633834+0000 mgr.a (mgr.14388) 8177 : cluster [DBG] pgmap v5667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:21 smithi163 bash[24253]: audit 2024-08-31T05:20:20.002366+0000 mgr.a (mgr.14388) 8178 : audit [DBG] from='client.183879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:21 smithi027 bash[22610]: audit 2024-08-31T05:20:20.002366+0000 mgr.a (mgr.14388) 8178 : audit [DBG] from='client.183879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:21 smithi191 bash[24992]: audit 2024-08-31T05:20:20.002366+0000 mgr.a (mgr.14388) 8178 : audit [DBG] from='client.183879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:22 smithi163 bash[24253]: cluster 2024-08-31T05:20:20.634929+0000 mgr.a (mgr.14388) 8179 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:22 smithi027 bash[22610]: cluster 2024-08-31T05:20:20.634929+0000 mgr.a (mgr.14388) 8179 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:22 smithi191 bash[24992]: cluster 2024-08-31T05:20:20.634929+0000 mgr.a (mgr.14388) 8179 : cluster [DBG] pgmap v5668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:24 smithi163 bash[24253]: cluster 2024-08-31T05:20:22.635721+0000 mgr.a (mgr.14388) 8180 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:24 smithi027 bash[22610]: cluster 2024-08-31T05:20:22.635721+0000 mgr.a (mgr.14388) 8180 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:24 smithi191 bash[24992]: cluster 2024-08-31T05:20:22.635721+0000 mgr.a (mgr.14388) 8180 : cluster [DBG] pgmap v5669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:25.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:20:25.419 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:20:25.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:20:26.206 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:20:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:20:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:20:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:20:26.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:20:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:26 smithi163 bash[24253]: cluster 2024-08-31T05:20:24.637923+0000 mgr.a (mgr.14388) 8181 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:26 smithi027 bash[22610]: cluster 2024-08-31T05:20:24.637923+0000 mgr.a (mgr.14388) 8181 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:26 smithi191 bash[24992]: cluster 2024-08-31T05:20:24.637923+0000 mgr.a (mgr.14388) 8181 : cluster [DBG] pgmap v5670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:20:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:27 smithi027 bash[22610]: audit 2024-08-31T05:20:25.756756+0000 mgr.a (mgr.14388) 8182 : audit [DBG] from='client.183954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:27 smithi191 bash[24992]: audit 2024-08-31T05:20:25.756756+0000 mgr.a (mgr.14388) 8182 : audit [DBG] from='client.183954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:27 smithi163 bash[24253]: audit 2024-08-31T05:20:25.756756+0000 mgr.a (mgr.14388) 8182 : audit [DBG] from='client.183954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:28 smithi027 bash[22610]: cluster 2024-08-31T05:20:26.638923+0000 mgr.a (mgr.14388) 8183 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:28 smithi191 bash[24992]: cluster 2024-08-31T05:20:26.638923+0000 mgr.a (mgr.14388) 8183 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:28 smithi163 bash[24253]: cluster 2024-08-31T05:20:26.638923+0000 mgr.a (mgr.14388) 8183 : cluster [DBG] pgmap v5671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:30 smithi027 bash[22610]: cluster 2024-08-31T05:20:28.641174+0000 mgr.a (mgr.14388) 8184 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:30 smithi191 bash[24992]: cluster 2024-08-31T05:20:28.641174+0000 mgr.a (mgr.14388) 8184 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:30 smithi163 bash[24253]: cluster 2024-08-31T05:20:28.641174+0000 mgr.a (mgr.14388) 8184 : cluster [DBG] pgmap v5672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:31.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:20:31.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:20:31.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:20:31.984 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:20:31.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:20:31.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:20:31.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:20:31.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:20:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:32 smithi027 bash[22610]: cluster 2024-08-31T05:20:30.641948+0000 mgr.a (mgr.14388) 8185 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:32 smithi191 bash[24992]: cluster 2024-08-31T05:20:30.641948+0000 mgr.a (mgr.14388) 8185 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:32 smithi163 bash[24253]: cluster 2024-08-31T05:20:30.641948+0000 mgr.a (mgr.14388) 8185 : cluster [DBG] pgmap v5673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:33 smithi027 bash[22610]: audit 2024-08-31T05:20:31.542241+0000 mgr.a (mgr.14388) 8186 : audit [DBG] from='client.184032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:33 smithi191 bash[24992]: audit 2024-08-31T05:20:31.542241+0000 mgr.a (mgr.14388) 8186 : audit [DBG] from='client.184032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:33 smithi163 bash[24253]: audit 2024-08-31T05:20:31.542241+0000 mgr.a (mgr.14388) 8186 : audit [DBG] from='client.184032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:34 smithi027 bash[22610]: cluster 2024-08-31T05:20:32.642964+0000 mgr.a (mgr.14388) 8187 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:34 smithi191 bash[24992]: cluster 2024-08-31T05:20:32.642964+0000 mgr.a (mgr.14388) 8187 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:34 smithi163 bash[24253]: cluster 2024-08-31T05:20:32.642964+0000 mgr.a (mgr.14388) 8187 : cluster [DBG] pgmap v5674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:36 smithi027 bash[22610]: cluster 2024-08-31T05:20:34.645259+0000 mgr.a (mgr.14388) 8188 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:36 smithi191 bash[24992]: cluster 2024-08-31T05:20:34.645259+0000 mgr.a (mgr.14388) 8188 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:36 smithi163 bash[24253]: cluster 2024-08-31T05:20:34.645259+0000 mgr.a (mgr.14388) 8188 : cluster [DBG] pgmap v5675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:36.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:20:36.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:20:36.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:20:37.734 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:20:37.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:20:37.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:20:37.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:20:37.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:20:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:38 smithi191 bash[24992]: cluster 2024-08-31T05:20:36.646018+0000 mgr.a (mgr.14388) 8189 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:38 smithi163 bash[24253]: cluster 2024-08-31T05:20:36.646018+0000 mgr.a (mgr.14388) 8189 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:38 smithi027 bash[22610]: cluster 2024-08-31T05:20:36.646018+0000 mgr.a (mgr.14388) 8189 : cluster [DBG] pgmap v5676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:39 smithi191 bash[24992]: audit 2024-08-31T05:20:37.317126+0000 mgr.a (mgr.14388) 8190 : audit [DBG] from='client.184110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:39 smithi163 bash[24253]: audit 2024-08-31T05:20:37.317126+0000 mgr.a (mgr.14388) 8190 : audit [DBG] from='client.184110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:39 smithi027 bash[22610]: audit 2024-08-31T05:20:37.317126+0000 mgr.a (mgr.14388) 8190 : audit [DBG] from='client.184110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:40 smithi191 bash[24992]: cluster 2024-08-31T05:20:38.648476+0000 mgr.a (mgr.14388) 8191 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:40 smithi163 bash[24253]: cluster 2024-08-31T05:20:38.648476+0000 mgr.a (mgr.14388) 8191 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:40 smithi027 bash[22610]: cluster 2024-08-31T05:20:38.648476+0000 mgr.a (mgr.14388) 8191 : cluster [DBG] pgmap v5677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:20:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:42 smithi191 bash[24992]: cluster 2024-08-31T05:20:40.649460+0000 mgr.a (mgr.14388) 8192 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:42 smithi163 bash[24253]: cluster 2024-08-31T05:20:40.649460+0000 mgr.a (mgr.14388) 8192 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:42 smithi027 bash[22610]: cluster 2024-08-31T05:20:40.649460+0000 mgr.a (mgr.14388) 8192 : cluster [DBG] pgmap v5678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:42.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:20:42.736 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:20:42.736 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:20:43.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:20:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:20:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:20:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:20:43.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:44 smithi191 bash[24992]: cluster 2024-08-31T05:20:42.650363+0000 mgr.a (mgr.14388) 8193 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:44 smithi191 bash[24992]: audit 2024-08-31T05:20:43.075778+0000 mgr.a (mgr.14388) 8194 : audit [DBG] from='client.184188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:44 smithi163 bash[24253]: cluster 2024-08-31T05:20:42.650363+0000 mgr.a (mgr.14388) 8193 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:44 smithi163 bash[24253]: audit 2024-08-31T05:20:43.075778+0000 mgr.a (mgr.14388) 8194 : audit [DBG] from='client.184188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:44 smithi027 bash[22610]: cluster 2024-08-31T05:20:42.650363+0000 mgr.a (mgr.14388) 8193 : cluster [DBG] pgmap v5679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:44 smithi027 bash[22610]: audit 2024-08-31T05:20:43.075778+0000 mgr.a (mgr.14388) 8194 : audit [DBG] from='client.184188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:46.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:46 smithi191 bash[24992]: cluster 2024-08-31T05:20:44.653169+0000 mgr.a (mgr.14388) 8195 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:46 smithi163 bash[24253]: cluster 2024-08-31T05:20:44.653169+0000 mgr.a (mgr.14388) 8195 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:46 smithi027 bash[22610]: cluster 2024-08-31T05:20:44.653169+0000 mgr.a (mgr.14388) 8195 : cluster [DBG] pgmap v5680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:48.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:20:48.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:20:48.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:20:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:48 smithi191 bash[24992]: cluster 2024-08-31T05:20:46.653956+0000 mgr.a (mgr.14388) 8196 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:48 smithi163 bash[24253]: cluster 2024-08-31T05:20:46.653956+0000 mgr.a (mgr.14388) 8196 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:48 smithi027 bash[22610]: cluster 2024-08-31T05:20:46.653956+0000 mgr.a (mgr.14388) 8196 : cluster [DBG] pgmap v5681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:49.271 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:20:49.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:20:49.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:20:49.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:20:49.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:20:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:50 smithi191 bash[24992]: cluster 2024-08-31T05:20:48.655928+0000 mgr.a (mgr.14388) 8197 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:50 smithi191 bash[24992]: audit 2024-08-31T05:20:48.823089+0000 mgr.a (mgr.14388) 8198 : audit [DBG] from='client.184263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:50 smithi163 bash[24253]: cluster 2024-08-31T05:20:48.655928+0000 mgr.a (mgr.14388) 8197 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:50 smithi163 bash[24253]: audit 2024-08-31T05:20:48.823089+0000 mgr.a (mgr.14388) 8198 : audit [DBG] from='client.184263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:50 smithi027 bash[22610]: cluster 2024-08-31T05:20:48.655928+0000 mgr.a (mgr.14388) 8197 : cluster [DBG] pgmap v5682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:50 smithi027 bash[22610]: audit 2024-08-31T05:20:48.823089+0000 mgr.a (mgr.14388) 8198 : audit [DBG] from='client.184263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:52 smithi191 bash[24992]: cluster 2024-08-31T05:20:50.656789+0000 mgr.a (mgr.14388) 8199 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:52 smithi163 bash[24253]: cluster 2024-08-31T05:20:50.656789+0000 mgr.a (mgr.14388) 8199 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:52 smithi027 bash[22610]: cluster 2024-08-31T05:20:50.656789+0000 mgr.a (mgr.14388) 8199 : cluster [DBG] pgmap v5683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:20:54.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:20:54.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:20:54.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:20:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:54 smithi191 bash[24992]: cluster 2024-08-31T05:20:52.657527+0000 mgr.a (mgr.14388) 8200 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:20:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:54 smithi163 bash[24253]: cluster 2024-08-31T05:20:52.657527+0000 mgr.a (mgr.14388) 8200 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:20:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:54 smithi027 bash[22610]: cluster 2024-08-31T05:20:52.657527+0000 mgr.a (mgr.14388) 8200 : cluster [DBG] pgmap v5684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:20:55.043 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:20:55.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:20:55.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:20:55.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:20:55.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:20:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:56 smithi191 bash[24992]: audit 2024-08-31T05:20:54.611003+0000 mgr.a (mgr.14388) 8201 : audit [DBG] from='client.184341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:56 smithi191 bash[24992]: cluster 2024-08-31T05:20:54.660369+0000 mgr.a (mgr.14388) 8202 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:56 smithi163 bash[24253]: audit 2024-08-31T05:20:54.611003+0000 mgr.a (mgr.14388) 8201 : audit [DBG] from='client.184341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:56 smithi163 bash[24253]: cluster 2024-08-31T05:20:54.660369+0000 mgr.a (mgr.14388) 8202 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:56 smithi027 bash[22610]: audit 2024-08-31T05:20:54.611003+0000 mgr.a (mgr.14388) 8201 : audit [DBG] from='client.184341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:56 smithi027 bash[22610]: cluster 2024-08-31T05:20:54.660369+0000 mgr.a (mgr.14388) 8202 : cluster [DBG] pgmap v5685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:20:58 smithi191 bash[24992]: cluster 2024-08-31T05:20:56.661293+0000 mgr.a (mgr.14388) 8203 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:20:58 smithi163 bash[24253]: cluster 2024-08-31T05:20:56.661293+0000 mgr.a (mgr.14388) 8203 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:20:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:20:58 smithi027 bash[22610]: cluster 2024-08-31T05:20:56.661293+0000 mgr.a (mgr.14388) 8203 : cluster [DBG] pgmap v5686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:00.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:00 smithi191 bash[24992]: cluster 2024-08-31T05:20:58.663674+0000 mgr.a (mgr.14388) 8204 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:00 smithi163 bash[24253]: cluster 2024-08-31T05:20:58.663674+0000 mgr.a (mgr.14388) 8204 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:00 smithi027 bash[22610]: cluster 2024-08-31T05:20:58.663674+0000 mgr.a (mgr.14388) 8204 : cluster [DBG] pgmap v5687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:00.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:00.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:00.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:00.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:00.812 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:02 smithi163 bash[24253]: audit 2024-08-31T05:21:00.379625+0000 mgr.a (mgr.14388) 8205 : audit [DBG] from='client.184419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:02 smithi163 bash[24253]: cluster 2024-08-31T05:21:00.664223+0000 mgr.a (mgr.14388) 8206 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:02 smithi027 bash[22610]: audit 2024-08-31T05:21:00.379625+0000 mgr.a (mgr.14388) 8205 : audit [DBG] from='client.184419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:02 smithi027 bash[22610]: cluster 2024-08-31T05:21:00.664223+0000 mgr.a (mgr.14388) 8206 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:02 smithi191 bash[24992]: audit 2024-08-31T05:21:00.379625+0000 mgr.a (mgr.14388) 8205 : audit [DBG] from='client.184419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:02 smithi191 bash[24992]: cluster 2024-08-31T05:21:00.664223+0000 mgr.a (mgr.14388) 8206 : cluster [DBG] pgmap v5688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:04 smithi163 bash[24253]: cluster 2024-08-31T05:21:02.665193+0000 mgr.a (mgr.14388) 8207 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:04 smithi027 bash[22610]: cluster 2024-08-31T05:21:02.665193+0000 mgr.a (mgr.14388) 8207 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:04 smithi191 bash[24992]: cluster 2024-08-31T05:21:02.665193+0000 mgr.a (mgr.14388) 8207 : cluster [DBG] pgmap v5689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:05.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:05.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:06.606 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:06.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:06.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:06.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:06 smithi163 bash[24253]: cluster 2024-08-31T05:21:04.667600+0000 mgr.a (mgr.14388) 8208 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:06 smithi027 bash[22610]: cluster 2024-08-31T05:21:04.667600+0000 mgr.a (mgr.14388) 8208 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:06 smithi191 bash[24992]: cluster 2024-08-31T05:21:04.667600+0000 mgr.a (mgr.14388) 8208 : cluster [DBG] pgmap v5690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:07 smithi163 bash[24253]: audit 2024-08-31T05:21:06.150418+0000 mgr.a (mgr.14388) 8209 : audit [DBG] from='client.184494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:07 smithi027 bash[22610]: audit 2024-08-31T05:21:06.150418+0000 mgr.a (mgr.14388) 8209 : audit [DBG] from='client.184494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:07 smithi191 bash[24992]: audit 2024-08-31T05:21:06.150418+0000 mgr.a (mgr.14388) 8209 : audit [DBG] from='client.184494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:08 smithi163 bash[24253]: cluster 2024-08-31T05:21:06.668722+0000 mgr.a (mgr.14388) 8210 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:08 smithi027 bash[22610]: cluster 2024-08-31T05:21:06.668722+0000 mgr.a (mgr.14388) 8210 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:08 smithi191 bash[24992]: cluster 2024-08-31T05:21:06.668722+0000 mgr.a (mgr.14388) 8210 : cluster [DBG] pgmap v5691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:10 smithi163 bash[24253]: cluster 2024-08-31T05:21:08.671024+0000 mgr.a (mgr.14388) 8211 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:10 smithi027 bash[22610]: cluster 2024-08-31T05:21:08.671024+0000 mgr.a (mgr.14388) 8211 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:10 smithi191 bash[24992]: cluster 2024-08-31T05:21:08.671024+0000 mgr.a (mgr.14388) 8211 : cluster [DBG] pgmap v5692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:11.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:11.597 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:11.597 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:12.348 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:12.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:12.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:12.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:12.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:12 smithi163 bash[24253]: cluster 2024-08-31T05:21:10.671795+0000 mgr.a (mgr.14388) 8212 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:12 smithi163 bash[24253]: audit 2024-08-31T05:21:11.988489+0000 mon.a (mon.0) 1811 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:21:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:12 smithi027 bash[22610]: cluster 2024-08-31T05:21:10.671795+0000 mgr.a (mgr.14388) 8212 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:12 smithi027 bash[22610]: audit 2024-08-31T05:21:11.988489+0000 mon.a (mon.0) 1811 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:21:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:12 smithi191 bash[24992]: cluster 2024-08-31T05:21:10.671795+0000 mgr.a (mgr.14388) 8212 : cluster [DBG] pgmap v5693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:12 smithi191 bash[24992]: audit 2024-08-31T05:21:11.988489+0000 mon.a (mon.0) 1811 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:21:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:13 smithi163 bash[24253]: audit 2024-08-31T05:21:11.926947+0000 mgr.a (mgr.14388) 8213 : audit [DBG] from='client.184569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:13 smithi027 bash[22610]: audit 2024-08-31T05:21:11.926947+0000 mgr.a (mgr.14388) 8213 : audit [DBG] from='client.184569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:13 smithi191 bash[24992]: audit 2024-08-31T05:21:11.926947+0000 mgr.a (mgr.14388) 8213 : audit [DBG] from='client.184569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:14 smithi163 bash[24253]: cluster 2024-08-31T05:21:12.672735+0000 mgr.a (mgr.14388) 8214 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:14 smithi027 bash[22610]: cluster 2024-08-31T05:21:12.672735+0000 mgr.a (mgr.14388) 8214 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:14 smithi191 bash[24992]: cluster 2024-08-31T05:21:12.672735+0000 mgr.a (mgr.14388) 8214 : cluster [DBG] pgmap v5694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:15 smithi163 bash[24253]: cluster 2024-08-31T05:21:14.675018+0000 mgr.a (mgr.14388) 8215 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:15 smithi027 bash[22610]: cluster 2024-08-31T05:21:14.675018+0000 mgr.a (mgr.14388) 8215 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:15 smithi191 bash[24992]: cluster 2024-08-31T05:21:14.675018+0000 mgr.a (mgr.14388) 8215 : cluster [DBG] pgmap v5695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:17.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:17.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:17.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:18.136 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:18.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:18.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:18.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:18.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: cluster 2024-08-31T05:21:16.675836+0000 mgr.a (mgr.14388) 8216 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:18.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: audit 2024-08-31T05:21:17.279418+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: audit 2024-08-31T05:21:17.285479+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: audit 2024-08-31T05:21:17.311749+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: audit 2024-08-31T05:21:17.316463+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: audit 2024-08-31T05:21:17.321046+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: audit 2024-08-31T05:21:17.325695+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: audit 2024-08-31T05:21:18.051334+0000 mon.a (mon.0) 1818 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:21:18.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: audit 2024-08-31T05:21:18.052178+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:21:18.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: audit 2024-08-31T05:21:18.058572+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:18 smithi191 bash[24992]: audit 2024-08-31T05:21:18.060606+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: cluster 2024-08-31T05:21:16.675836+0000 mgr.a (mgr.14388) 8216 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: audit 2024-08-31T05:21:17.279418+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: audit 2024-08-31T05:21:17.285479+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: audit 2024-08-31T05:21:17.311749+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: audit 2024-08-31T05:21:17.316463+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: audit 2024-08-31T05:21:17.321046+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: audit 2024-08-31T05:21:17.325695+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: audit 2024-08-31T05:21:18.051334+0000 mon.a (mon.0) 1818 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: audit 2024-08-31T05:21:18.052178+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: audit 2024-08-31T05:21:18.058572+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:18 smithi163 bash[24253]: audit 2024-08-31T05:21:18.060606+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:21:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: cluster 2024-08-31T05:21:16.675836+0000 mgr.a (mgr.14388) 8216 : cluster [DBG] pgmap v5696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: audit 2024-08-31T05:21:17.279418+0000 mon.a (mon.0) 1812 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: audit 2024-08-31T05:21:17.285479+0000 mon.a (mon.0) 1813 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: audit 2024-08-31T05:21:17.311749+0000 mon.a (mon.0) 1814 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: audit 2024-08-31T05:21:17.316463+0000 mon.a (mon.0) 1815 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: audit 2024-08-31T05:21:17.321046+0000 mon.a (mon.0) 1816 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: audit 2024-08-31T05:21:17.325695+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: audit 2024-08-31T05:21:18.051334+0000 mon.a (mon.0) 1818 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:21:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: audit 2024-08-31T05:21:18.052178+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:21:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: audit 2024-08-31T05:21:18.058572+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:21:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22610]: audit 2024-08-31T05:21:18.060606+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:21:19.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22863]: debug 2024-08-31T05:21:18.825+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:21:19.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:21:18 smithi027 bash[22863]: debug 2024-08-31T05:21:18.825+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:21:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:19 smithi163 bash[24253]: audit 2024-08-31T05:21:17.702678+0000 mgr.a (mgr.14388) 8217 : audit [DBG] from='client.184647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:19 smithi163 bash[24253]: audit 2024-08-31T05:21:18.061700+0000 mgr.a (mgr.14388) 8218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:21:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:19 smithi027 bash[22610]: audit 2024-08-31T05:21:17.702678+0000 mgr.a (mgr.14388) 8217 : audit [DBG] from='client.184647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:19 smithi027 bash[22610]: audit 2024-08-31T05:21:18.061700+0000 mgr.a (mgr.14388) 8218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:21:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:19 smithi191 bash[24992]: audit 2024-08-31T05:21:17.702678+0000 mgr.a (mgr.14388) 8217 : audit [DBG] from='client.184647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:19 smithi191 bash[24992]: audit 2024-08-31T05:21:18.061700+0000 mgr.a (mgr.14388) 8218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:21:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:20 smithi163 bash[24253]: cluster 2024-08-31T05:21:18.677117+0000 mgr.a (mgr.14388) 8219 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:21:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:20 smithi163 bash[24253]: audit 2024-08-31T05:21:18.828254+0000 mgr.a (mgr.14388) 8220 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:21:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:20 smithi163 bash[24253]: cephadm 2024-08-31T05:21:18.829675+0000 mgr.a (mgr.14388) 8221 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:21:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:20 smithi027 bash[22610]: cluster 2024-08-31T05:21:18.677117+0000 mgr.a (mgr.14388) 8219 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:21:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:20 smithi027 bash[22610]: audit 2024-08-31T05:21:18.828254+0000 mgr.a (mgr.14388) 8220 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:21:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:20 smithi027 bash[22610]: cephadm 2024-08-31T05:21:18.829675+0000 mgr.a (mgr.14388) 8221 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:21:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:20 smithi191 bash[24992]: cluster 2024-08-31T05:21:18.677117+0000 mgr.a (mgr.14388) 8219 : cluster [DBG] pgmap v5697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:21:20.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:20 smithi191 bash[24992]: audit 2024-08-31T05:21:18.828254+0000 mgr.a (mgr.14388) 8220 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:21:20.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:20 smithi191 bash[24992]: cephadm 2024-08-31T05:21:18.829675+0000 mgr.a (mgr.14388) 8221 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:21:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:22 smithi163 bash[24253]: cluster 2024-08-31T05:21:20.678037+0000 mgr.a (mgr.14388) 8222 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:21:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:22 smithi027 bash[22610]: cluster 2024-08-31T05:21:20.678037+0000 mgr.a (mgr.14388) 8222 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:21:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:22 smithi191 bash[24992]: cluster 2024-08-31T05:21:20.678037+0000 mgr.a (mgr.14388) 8222 : cluster [DBG] pgmap v5698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:21:23.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:23.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:23.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:23.885 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:23.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:23.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:23.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:23.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:24 smithi163 bash[24253]: cluster 2024-08-31T05:21:22.678975+0000 mgr.a (mgr.14388) 8223 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:21:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:24 smithi027 bash[22610]: cluster 2024-08-31T05:21:22.678975+0000 mgr.a (mgr.14388) 8223 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:21:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:24 smithi191 bash[24992]: cluster 2024-08-31T05:21:22.678975+0000 mgr.a (mgr.14388) 8223 : cluster [DBG] pgmap v5699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:21:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:25 smithi163 bash[24253]: audit 2024-08-31T05:21:23.473180+0000 mgr.a (mgr.14388) 8224 : audit [DBG] from='client.184830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:25 smithi027 bash[22610]: audit 2024-08-31T05:21:23.473180+0000 mgr.a (mgr.14388) 8224 : audit [DBG] from='client.184830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:25 smithi191 bash[24992]: audit 2024-08-31T05:21:23.473180+0000 mgr.a (mgr.14388) 8224 : audit [DBG] from='client.184830 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:26 smithi163 bash[24253]: cluster 2024-08-31T05:21:24.681748+0000 mgr.a (mgr.14388) 8225 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:21:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:26 smithi027 bash[22610]: cluster 2024-08-31T05:21:24.681748+0000 mgr.a (mgr.14388) 8225 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:21:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:26 smithi191 bash[24992]: cluster 2024-08-31T05:21:24.681748+0000 mgr.a (mgr.14388) 8225 : cluster [DBG] pgmap v5700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:21:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:28 smithi163 bash[24253]: cluster 2024-08-31T05:21:26.682529+0000 mgr.a (mgr.14388) 8226 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:21:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:28 smithi027 bash[22610]: cluster 2024-08-31T05:21:26.682529+0000 mgr.a (mgr.14388) 8226 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:21:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:28 smithi191 bash[24992]: cluster 2024-08-31T05:21:26.682529+0000 mgr.a (mgr.14388) 8226 : cluster [DBG] pgmap v5701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:21:28.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:28.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:28.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:29.628 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:29.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:29.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:29.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:29.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:30 smithi163 bash[24253]: cluster 2024-08-31T05:21:28.684528+0000 mgr.a (mgr.14388) 8227 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:21:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:30 smithi163 bash[24253]: audit 2024-08-31T05:21:29.219551+0000 mgr.a (mgr.14388) 8228 : audit [DBG] from='client.184908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:30 smithi027 bash[22610]: cluster 2024-08-31T05:21:28.684528+0000 mgr.a (mgr.14388) 8227 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:21:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:30 smithi027 bash[22610]: audit 2024-08-31T05:21:29.219551+0000 mgr.a (mgr.14388) 8228 : audit [DBG] from='client.184908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:30 smithi191 bash[24992]: cluster 2024-08-31T05:21:28.684528+0000 mgr.a (mgr.14388) 8227 : cluster [DBG] pgmap v5702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:21:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:30 smithi191 bash[24992]: audit 2024-08-31T05:21:29.219551+0000 mgr.a (mgr.14388) 8228 : audit [DBG] from='client.184908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:32 smithi163 bash[24253]: cluster 2024-08-31T05:21:30.685475+0000 mgr.a (mgr.14388) 8229 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:21:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:32 smithi027 bash[22610]: cluster 2024-08-31T05:21:30.685475+0000 mgr.a (mgr.14388) 8229 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:21:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:32 smithi191 bash[24992]: cluster 2024-08-31T05:21:30.685475+0000 mgr.a (mgr.14388) 8229 : cluster [DBG] pgmap v5703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:21:34.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:34.631 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:34 smithi163 bash[24253]: cluster 2024-08-31T05:21:32.686244+0000 mgr.a (mgr.14388) 8230 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:21:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:34 smithi027 bash[22610]: cluster 2024-08-31T05:21:32.686244+0000 mgr.a (mgr.14388) 8230 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:21:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:34 smithi191 bash[24992]: cluster 2024-08-31T05:21:32.686244+0000 mgr.a (mgr.14388) 8230 : cluster [DBG] pgmap v5704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:21:35.394 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:35.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:35.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:35.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:35.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:35 smithi163 bash[24253]: cluster 2024-08-31T05:21:34.688162+0000 mgr.a (mgr.14388) 8231 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:21:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:35 smithi163 bash[24253]: audit 2024-08-31T05:21:34.967609+0000 mgr.a (mgr.14388) 8232 : audit [DBG] from='client.184983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:35 smithi027 bash[22610]: cluster 2024-08-31T05:21:34.688162+0000 mgr.a (mgr.14388) 8231 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:21:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:35 smithi027 bash[22610]: audit 2024-08-31T05:21:34.967609+0000 mgr.a (mgr.14388) 8232 : audit [DBG] from='client.184983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:35 smithi191 bash[24992]: cluster 2024-08-31T05:21:34.688162+0000 mgr.a (mgr.14388) 8231 : cluster [DBG] pgmap v5705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:21:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:35 smithi191 bash[24992]: audit 2024-08-31T05:21:34.967609+0000 mgr.a (mgr.14388) 8232 : audit [DBG] from='client.184983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:37 smithi191 bash[24992]: cluster 2024-08-31T05:21:36.689136+0000 mgr.a (mgr.14388) 8233 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:37 smithi163 bash[24253]: cluster 2024-08-31T05:21:36.689136+0000 mgr.a (mgr.14388) 8233 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:37 smithi027 bash[22610]: cluster 2024-08-31T05:21:36.689136+0000 mgr.a (mgr.14388) 8233 : cluster [DBG] pgmap v5706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:39 smithi191 bash[24992]: cluster 2024-08-31T05:21:38.691309+0000 mgr.a (mgr.14388) 8234 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:39 smithi163 bash[24253]: cluster 2024-08-31T05:21:38.691309+0000 mgr.a (mgr.14388) 8234 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:39 smithi027 bash[22610]: cluster 2024-08-31T05:21:38.691309+0000 mgr.a (mgr.14388) 8234 : cluster [DBG] pgmap v5707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:40.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:40.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:40.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:41.165 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:41.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:41 smithi191 bash[24992]: cluster 2024-08-31T05:21:40.692025+0000 mgr.a (mgr.14388) 8235 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:41 smithi191 bash[24992]: audit 2024-08-31T05:21:40.729972+0000 mgr.a (mgr.14388) 8236 : audit [DBG] from='client.185058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:41 smithi163 bash[24253]: cluster 2024-08-31T05:21:40.692025+0000 mgr.a (mgr.14388) 8235 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:41 smithi163 bash[24253]: audit 2024-08-31T05:21:40.729972+0000 mgr.a (mgr.14388) 8236 : audit [DBG] from='client.185058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:41 smithi027 bash[22610]: cluster 2024-08-31T05:21:40.692025+0000 mgr.a (mgr.14388) 8235 : cluster [DBG] pgmap v5708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:41 smithi027 bash[22610]: audit 2024-08-31T05:21:40.729972+0000 mgr.a (mgr.14388) 8236 : audit [DBG] from='client.185058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:43 smithi191 bash[24992]: cluster 2024-08-31T05:21:42.693085+0000 mgr.a (mgr.14388) 8237 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:43 smithi163 bash[24253]: cluster 2024-08-31T05:21:42.693085+0000 mgr.a (mgr.14388) 8237 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:43 smithi027 bash[22610]: cluster 2024-08-31T05:21:42.693085+0000 mgr.a (mgr.14388) 8237 : cluster [DBG] pgmap v5709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:45 smithi191 bash[24992]: cluster 2024-08-31T05:21:44.695423+0000 mgr.a (mgr.14388) 8238 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:46.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:46.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:45 smithi163 bash[24253]: cluster 2024-08-31T05:21:44.695423+0000 mgr.a (mgr.14388) 8238 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:45 smithi027 bash[22610]: cluster 2024-08-31T05:21:44.695423+0000 mgr.a (mgr.14388) 8238 : cluster [DBG] pgmap v5710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:46.910 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:46.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:47 smithi191 bash[24992]: audit 2024-08-31T05:21:46.495881+0000 mgr.a (mgr.14388) 8239 : audit [DBG] from='client.185136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:47 smithi191 bash[24992]: cluster 2024-08-31T05:21:46.695939+0000 mgr.a (mgr.14388) 8240 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:47 smithi163 bash[24253]: audit 2024-08-31T05:21:46.495881+0000 mgr.a (mgr.14388) 8239 : audit [DBG] from='client.185136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:47 smithi163 bash[24253]: cluster 2024-08-31T05:21:46.695939+0000 mgr.a (mgr.14388) 8240 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:47 smithi027 bash[22610]: audit 2024-08-31T05:21:46.495881+0000 mgr.a (mgr.14388) 8239 : audit [DBG] from='client.185136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:47 smithi027 bash[22610]: cluster 2024-08-31T05:21:46.695939+0000 mgr.a (mgr.14388) 8240 : cluster [DBG] pgmap v5711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:49 smithi191 bash[24992]: cluster 2024-08-31T05:21:48.698189+0000 mgr.a (mgr.14388) 8241 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:49 smithi163 bash[24253]: cluster 2024-08-31T05:21:48.698189+0000 mgr.a (mgr.14388) 8241 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:49 smithi027 bash[22610]: cluster 2024-08-31T05:21:48.698189+0000 mgr.a (mgr.14388) 8241 : cluster [DBG] pgmap v5712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:51.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:51.912 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:51.912 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:51 smithi191 bash[24992]: cluster 2024-08-31T05:21:50.698967+0000 mgr.a (mgr.14388) 8242 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:51 smithi163 bash[24253]: cluster 2024-08-31T05:21:50.698967+0000 mgr.a (mgr.14388) 8242 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:51 smithi027 bash[22610]: cluster 2024-08-31T05:21:50.698967+0000 mgr.a (mgr.14388) 8242 : cluster [DBG] pgmap v5713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:52.655 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:52.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:52 smithi191 bash[24992]: audit 2024-08-31T05:21:52.239715+0000 mgr.a (mgr.14388) 8243 : audit [DBG] from='client.185214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:52 smithi163 bash[24253]: audit 2024-08-31T05:21:52.239715+0000 mgr.a (mgr.14388) 8243 : audit [DBG] from='client.185214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:52 smithi027 bash[22610]: audit 2024-08-31T05:21:52.239715+0000 mgr.a (mgr.14388) 8243 : audit [DBG] from='client.185214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:53 smithi163 bash[24253]: cluster 2024-08-31T05:21:52.699403+0000 mgr.a (mgr.14388) 8244 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:53 smithi027 bash[22610]: cluster 2024-08-31T05:21:52.699403+0000 mgr.a (mgr.14388) 8244 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:53 smithi191 bash[24992]: cluster 2024-08-31T05:21:52.699403+0000 mgr.a (mgr.14388) 8244 : cluster [DBG] pgmap v5714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:55 smithi163 bash[24253]: cluster 2024-08-31T05:21:54.701558+0000 mgr.a (mgr.14388) 8245 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:55 smithi027 bash[22610]: cluster 2024-08-31T05:21:54.701558+0000 mgr.a (mgr.14388) 8245 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:55 smithi191 bash[24992]: cluster 2024-08-31T05:21:54.701558+0000 mgr.a (mgr.14388) 8245 : cluster [DBG] pgmap v5715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:21:57.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:21:57.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:21:57.658 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:21:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:57 smithi163 bash[24253]: cluster 2024-08-31T05:21:56.702475+0000 mgr.a (mgr.14388) 8246 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:57 smithi027 bash[22610]: cluster 2024-08-31T05:21:56.702475+0000 mgr.a (mgr.14388) 8246 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:58.415 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:21:58.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:21:58.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:21:58.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:21:58.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:21:58.497 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:57 smithi191 bash[24992]: cluster 2024-08-31T05:21:56.702475+0000 mgr.a (mgr.14388) 8246 : cluster [DBG] pgmap v5716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:21:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:58 smithi163 bash[24253]: audit 2024-08-31T05:21:57.992137+0000 mgr.a (mgr.14388) 8247 : audit [DBG] from='client.185292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:59.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:58 smithi027 bash[22610]: audit 2024-08-31T05:21:57.992137+0000 mgr.a (mgr.14388) 8247 : audit [DBG] from='client.185292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:58 smithi191 bash[24992]: audit 2024-08-31T05:21:57.992137+0000 mgr.a (mgr.14388) 8247 : audit [DBG] from='client.185292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:21:59 smithi163 bash[24253]: cluster 2024-08-31T05:21:58.705180+0000 mgr.a (mgr.14388) 8248 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:21:59 smithi027 bash[22610]: cluster 2024-08-31T05:21:58.705180+0000 mgr.a (mgr.14388) 8248 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:21:59 smithi191 bash[24992]: cluster 2024-08-31T05:21:58.705180+0000 mgr.a (mgr.14388) 8248 : cluster [DBG] pgmap v5717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:01 smithi163 bash[24253]: cluster 2024-08-31T05:22:00.705949+0000 mgr.a (mgr.14388) 8249 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:22:02.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:01 smithi027 bash[22610]: cluster 2024-08-31T05:22:00.705949+0000 mgr.a (mgr.14388) 8249 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:22:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:01 smithi191 bash[24992]: cluster 2024-08-31T05:22:00.705949+0000 mgr.a (mgr.14388) 8249 : cluster [DBG] pgmap v5718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:22:03.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:22:03.417 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:22:03.417 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:22:04.186 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:22:04.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:22:04.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:22:04.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:22:04.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:22:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:03 smithi163 bash[24253]: cluster 2024-08-31T05:22:02.706708+0000 mgr.a (mgr.14388) 8250 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:22:04.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:03 smithi027 bash[22610]: cluster 2024-08-31T05:22:02.706708+0000 mgr.a (mgr.14388) 8250 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:22:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:03 smithi191 bash[24992]: cluster 2024-08-31T05:22:02.706708+0000 mgr.a (mgr.14388) 8250 : cluster [DBG] pgmap v5719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:22:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:04 smithi163 bash[24253]: audit 2024-08-31T05:22:03.752648+0000 mgr.a (mgr.14388) 8251 : audit [DBG] from='client.185370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:04 smithi027 bash[22610]: audit 2024-08-31T05:22:03.752648+0000 mgr.a (mgr.14388) 8251 : audit [DBG] from='client.185370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:04 smithi191 bash[24992]: audit 2024-08-31T05:22:03.752648+0000 mgr.a (mgr.14388) 8251 : audit [DBG] from='client.185370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:05 smithi163 bash[24253]: cluster 2024-08-31T05:22:04.709455+0000 mgr.a (mgr.14388) 8252 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:05 smithi027 bash[22610]: cluster 2024-08-31T05:22:04.709455+0000 mgr.a (mgr.14388) 8252 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:05 smithi191 bash[24992]: cluster 2024-08-31T05:22:04.709455+0000 mgr.a (mgr.14388) 8252 : cluster [DBG] pgmap v5720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:07 smithi163 bash[24253]: cluster 2024-08-31T05:22:06.710226+0000 mgr.a (mgr.14388) 8253 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:22:08.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:07 smithi027 bash[22610]: cluster 2024-08-31T05:22:06.710226+0000 mgr.a (mgr.14388) 8253 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:22:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:07 smithi191 bash[24992]: cluster 2024-08-31T05:22:06.710226+0000 mgr.a (mgr.14388) 8253 : cluster [DBG] pgmap v5721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:22:09.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:22:09.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:22:09.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:22:09.968 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:22:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:22:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:22:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:22:09.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:22:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:09 smithi163 bash[24253]: cluster 2024-08-31T05:22:08.712195+0000 mgr.a (mgr.14388) 8254 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:09 smithi027 bash[22610]: cluster 2024-08-31T05:22:08.712195+0000 mgr.a (mgr.14388) 8254 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:09 smithi191 bash[24992]: cluster 2024-08-31T05:22:08.712195+0000 mgr.a (mgr.14388) 8254 : cluster [DBG] pgmap v5722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:10 smithi163 bash[24253]: audit 2024-08-31T05:22:09.527152+0000 mgr.a (mgr.14388) 8255 : audit [DBG] from='client.185445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:10 smithi027 bash[22610]: audit 2024-08-31T05:22:09.527152+0000 mgr.a (mgr.14388) 8255 : audit [DBG] from='client.185445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:10 smithi191 bash[24992]: audit 2024-08-31T05:22:09.527152+0000 mgr.a (mgr.14388) 8255 : audit [DBG] from='client.185445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:11 smithi163 bash[24253]: cluster 2024-08-31T05:22:10.713059+0000 mgr.a (mgr.14388) 8256 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:11 smithi027 bash[22610]: cluster 2024-08-31T05:22:10.713059+0000 mgr.a (mgr.14388) 8256 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:11 smithi191 bash[24992]: cluster 2024-08-31T05:22:10.713059+0000 mgr.a (mgr.14388) 8256 : cluster [DBG] pgmap v5723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:13 smithi163 bash[24253]: cluster 2024-08-31T05:22:12.713840+0000 mgr.a (mgr.14388) 8257 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:14.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:13 smithi027 bash[22610]: cluster 2024-08-31T05:22:12.713840+0000 mgr.a (mgr.14388) 8257 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:13 smithi191 bash[24992]: cluster 2024-08-31T05:22:12.713840+0000 mgr.a (mgr.14388) 8257 : cluster [DBG] pgmap v5724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:14.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:22:14.970 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:22:14.970 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:22:15.733 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:22:15.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:22:15.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:22:15.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:22:15.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:22:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:15 smithi163 bash[24253]: cluster 2024-08-31T05:22:14.716081+0000 mgr.a (mgr.14388) 8258 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:22:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:15 smithi163 bash[24253]: audit 2024-08-31T05:22:15.307348+0000 mgr.a (mgr.14388) 8259 : audit [DBG] from='client.185523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:15 smithi027 bash[22610]: cluster 2024-08-31T05:22:14.716081+0000 mgr.a (mgr.14388) 8258 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:22:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:15 smithi027 bash[22610]: audit 2024-08-31T05:22:15.307348+0000 mgr.a (mgr.14388) 8259 : audit [DBG] from='client.185523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:15 smithi191 bash[24992]: cluster 2024-08-31T05:22:14.716081+0000 mgr.a (mgr.14388) 8258 : cluster [DBG] pgmap v5725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:22:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:15 smithi191 bash[24992]: audit 2024-08-31T05:22:15.307348+0000 mgr.a (mgr.14388) 8259 : audit [DBG] from='client.185523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:17 smithi163 bash[24253]: cluster 2024-08-31T05:22:16.716977+0000 mgr.a (mgr.14388) 8260 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:18.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:17 smithi027 bash[22610]: cluster 2024-08-31T05:22:16.716977+0000 mgr.a (mgr.14388) 8260 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:17 smithi191 bash[24992]: cluster 2024-08-31T05:22:16.716977+0000 mgr.a (mgr.14388) 8260 : cluster [DBG] pgmap v5726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:19 smithi163 bash[24253]: cluster 2024-08-31T05:22:18.719254+0000 mgr.a (mgr.14388) 8261 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:22:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:19 smithi163 bash[24253]: audit 2024-08-31T05:22:18.896230+0000 mon.a (mon.0) 1822 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:19 smithi163 bash[24253]: audit 2024-08-31T05:22:19.745082+0000 mon.a (mon.0) 1823 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:19 smithi163 bash[24253]: audit 2024-08-31T05:22:19.746900+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:22:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:19 smithi163 bash[24253]: audit 2024-08-31T05:22:19.755859+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:22:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:19 smithi163 bash[24253]: audit 2024-08-31T05:22:19.761391+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:22:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:19 smithi027 bash[22610]: cluster 2024-08-31T05:22:18.719254+0000 mgr.a (mgr.14388) 8261 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:22:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:19 smithi027 bash[22610]: audit 2024-08-31T05:22:18.896230+0000 mon.a (mon.0) 1822 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:19 smithi027 bash[22610]: audit 2024-08-31T05:22:19.745082+0000 mon.a (mon.0) 1823 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:19 smithi027 bash[22610]: audit 2024-08-31T05:22:19.746900+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:22:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:19 smithi027 bash[22610]: audit 2024-08-31T05:22:19.755859+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:22:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:19 smithi027 bash[22610]: audit 2024-08-31T05:22:19.761391+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:22:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:19 smithi191 bash[24992]: cluster 2024-08-31T05:22:18.719254+0000 mgr.a (mgr.14388) 8261 : cluster [DBG] pgmap v5727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:22:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:19 smithi191 bash[24992]: audit 2024-08-31T05:22:18.896230+0000 mon.a (mon.0) 1822 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:22:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:19 smithi191 bash[24992]: audit 2024-08-31T05:22:19.745082+0000 mon.a (mon.0) 1823 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:22:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:19 smithi191 bash[24992]: audit 2024-08-31T05:22:19.746900+0000 mon.a (mon.0) 1824 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:22:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:19 smithi191 bash[24992]: audit 2024-08-31T05:22:19.755859+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:22:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:19 smithi191 bash[24992]: audit 2024-08-31T05:22:19.761391+0000 mon.a (mon.0) 1826 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:22:20.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:22:20.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:22:20.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:22:20.877 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:22:20 smithi027 bash[22863]: debug 2024-08-31T05:22:20.495+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:22:20.877 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:22:20 smithi027 bash[22863]: debug 2024-08-31T05:22:20.495+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:22:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:20 smithi163 bash[24253]: audit 2024-08-31T05:22:19.763680+0000 mgr.a (mgr.14388) 8262 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:22:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:20 smithi027 bash[22610]: audit 2024-08-31T05:22:19.763680+0000 mgr.a (mgr.14388) 8262 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:22:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:20 smithi191 bash[24992]: audit 2024-08-31T05:22:19.763680+0000 mgr.a (mgr.14388) 8262 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:22:21.478 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:22:21.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:22:21.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:22:21.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:22:21.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:22:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:21 smithi163 bash[24253]: audit 2024-08-31T05:22:20.499637+0000 mgr.a (mgr.14388) 8263 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:22:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:21 smithi163 bash[24253]: cephadm 2024-08-31T05:22:20.501220+0000 mgr.a (mgr.14388) 8264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:22:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:21 smithi163 bash[24253]: cluster 2024-08-31T05:22:20.720214+0000 mgr.a (mgr.14388) 8265 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:21 smithi163 bash[24253]: audit 2024-08-31T05:22:21.069774+0000 mgr.a (mgr.14388) 8266 : audit [DBG] from='client.185700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:21 smithi027 bash[22610]: audit 2024-08-31T05:22:20.499637+0000 mgr.a (mgr.14388) 8263 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:22:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:21 smithi027 bash[22610]: cephadm 2024-08-31T05:22:20.501220+0000 mgr.a (mgr.14388) 8264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:22:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:21 smithi027 bash[22610]: cluster 2024-08-31T05:22:20.720214+0000 mgr.a (mgr.14388) 8265 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:21 smithi027 bash[22610]: audit 2024-08-31T05:22:21.069774+0000 mgr.a (mgr.14388) 8266 : audit [DBG] from='client.185700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:21 smithi191 bash[24992]: audit 2024-08-31T05:22:20.499637+0000 mgr.a (mgr.14388) 8263 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:22:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:21 smithi191 bash[24992]: cephadm 2024-08-31T05:22:20.501220+0000 mgr.a (mgr.14388) 8264 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:22:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:21 smithi191 bash[24992]: cluster 2024-08-31T05:22:20.720214+0000 mgr.a (mgr.14388) 8265 : cluster [DBG] pgmap v5728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:21 smithi191 bash[24992]: audit 2024-08-31T05:22:21.069774+0000 mgr.a (mgr.14388) 8266 : audit [DBG] from='client.185700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:23 smithi163 bash[24253]: cluster 2024-08-31T05:22:22.721181+0000 mgr.a (mgr.14388) 8267 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:23 smithi027 bash[22610]: cluster 2024-08-31T05:22:22.721181+0000 mgr.a (mgr.14388) 8267 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:23 smithi191 bash[24992]: cluster 2024-08-31T05:22:22.721181+0000 mgr.a (mgr.14388) 8267 : cluster [DBG] pgmap v5729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:25 smithi163 bash[24253]: cluster 2024-08-31T05:22:24.723499+0000 mgr.a (mgr.14388) 8268 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:26.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:25 smithi027 bash[22610]: cluster 2024-08-31T05:22:24.723499+0000 mgr.a (mgr.14388) 8268 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:25 smithi191 bash[24992]: cluster 2024-08-31T05:22:24.723499+0000 mgr.a (mgr.14388) 8268 : cluster [DBG] pgmap v5730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:26.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:22:26.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:22:26.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:22:27.253 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:22:27.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:22:27.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:22:27.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:22:27.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:22:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:27 smithi163 bash[24253]: cluster 2024-08-31T05:22:26.724034+0000 mgr.a (mgr.14388) 8269 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:27 smithi163 bash[24253]: audit 2024-08-31T05:22:26.818237+0000 mgr.a (mgr.14388) 8270 : audit [DBG] from='client.185778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:28.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:27 smithi027 bash[22610]: cluster 2024-08-31T05:22:26.724034+0000 mgr.a (mgr.14388) 8269 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:28.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:27 smithi027 bash[22610]: audit 2024-08-31T05:22:26.818237+0000 mgr.a (mgr.14388) 8270 : audit [DBG] from='client.185778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:27 smithi191 bash[24992]: cluster 2024-08-31T05:22:26.724034+0000 mgr.a (mgr.14388) 8269 : cluster [DBG] pgmap v5731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:27 smithi191 bash[24992]: audit 2024-08-31T05:22:26.818237+0000 mgr.a (mgr.14388) 8270 : audit [DBG] from='client.185778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:29 smithi163 bash[24253]: cluster 2024-08-31T05:22:28.726278+0000 mgr.a (mgr.14388) 8271 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:29 smithi027 bash[22610]: cluster 2024-08-31T05:22:28.726278+0000 mgr.a (mgr.14388) 8271 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:29 smithi191 bash[24992]: cluster 2024-08-31T05:22:28.726278+0000 mgr.a (mgr.14388) 8271 : cluster [DBG] pgmap v5732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:31 smithi163 bash[24253]: cluster 2024-08-31T05:22:30.727105+0000 mgr.a (mgr.14388) 8272 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:31 smithi027 bash[22610]: cluster 2024-08-31T05:22:30.727105+0000 mgr.a (mgr.14388) 8272 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:32.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:22:32.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:22:32.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:22:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:31 smithi191 bash[24992]: cluster 2024-08-31T05:22:30.727105+0000 mgr.a (mgr.14388) 8272 : cluster [DBG] pgmap v5733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:33.048 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:22:33.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:22:33.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:22:33.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:22:33.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:22:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:33 smithi163 bash[24253]: audit 2024-08-31T05:22:32.618856+0000 mgr.a (mgr.14388) 8273 : audit [DBG] from='client.185856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:34.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:33 smithi163 bash[24253]: cluster 2024-08-31T05:22:32.727685+0000 mgr.a (mgr.14388) 8274 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:33 smithi027 bash[22610]: audit 2024-08-31T05:22:32.618856+0000 mgr.a (mgr.14388) 8273 : audit [DBG] from='client.185856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:33 smithi027 bash[22610]: cluster 2024-08-31T05:22:32.727685+0000 mgr.a (mgr.14388) 8274 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:33 smithi191 bash[24992]: audit 2024-08-31T05:22:32.618856+0000 mgr.a (mgr.14388) 8273 : audit [DBG] from='client.185856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:33 smithi191 bash[24992]: cluster 2024-08-31T05:22:32.727685+0000 mgr.a (mgr.14388) 8274 : cluster [DBG] pgmap v5734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:22:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:35 smithi163 bash[24253]: cluster 2024-08-31T05:22:34.730469+0000 mgr.a (mgr.14388) 8275 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 67 op/s 2024-08-31T05:22:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:35 smithi027 bash[22610]: cluster 2024-08-31T05:22:34.730469+0000 mgr.a (mgr.14388) 8275 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 67 op/s 2024-08-31T05:22:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:35 smithi191 bash[24992]: cluster 2024-08-31T05:22:34.730469+0000 mgr.a (mgr.14388) 8275 : cluster [DBG] pgmap v5735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 43 KiB/s rd, 426 B/s wr, 67 op/s 2024-08-31T05:22:38.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:22:38.050 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:22:38.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:22:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:37 smithi163 bash[24253]: cluster 2024-08-31T05:22:36.731303+0000 mgr.a (mgr.14388) 8276 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:37 smithi027 bash[22610]: cluster 2024-08-31T05:22:36.731303+0000 mgr.a (mgr.14388) 8276 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:37 smithi191 bash[24992]: cluster 2024-08-31T05:22:36.731303+0000 mgr.a (mgr.14388) 8276 : cluster [DBG] pgmap v5736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:38.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:22:38.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:22:38.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:22:38.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:22:38.805 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:22:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:39 smithi163 bash[24253]: audit 2024-08-31T05:22:38.383400+0000 mgr.a (mgr.14388) 8277 : audit [DBG] from='client.185928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:39 smithi163 bash[24253]: cluster 2024-08-31T05:22:38.732564+0000 mgr.a (mgr.14388) 8278 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:39 smithi027 bash[22610]: audit 2024-08-31T05:22:38.383400+0000 mgr.a (mgr.14388) 8277 : audit [DBG] from='client.185928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:39 smithi027 bash[22610]: cluster 2024-08-31T05:22:38.732564+0000 mgr.a (mgr.14388) 8278 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:39 smithi191 bash[24992]: audit 2024-08-31T05:22:38.383400+0000 mgr.a (mgr.14388) 8277 : audit [DBG] from='client.185928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:39 smithi191 bash[24992]: cluster 2024-08-31T05:22:38.732564+0000 mgr.a (mgr.14388) 8278 : cluster [DBG] pgmap v5737: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:41 smithi163 bash[24253]: cluster 2024-08-31T05:22:40.733386+0000 mgr.a (mgr.14388) 8279 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:41 smithi027 bash[22610]: cluster 2024-08-31T05:22:40.733386+0000 mgr.a (mgr.14388) 8279 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:41 smithi191 bash[24992]: cluster 2024-08-31T05:22:40.733386+0000 mgr.a (mgr.14388) 8279 : cluster [DBG] pgmap v5738: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:43.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:22:43.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:22:43.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:22:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:43 smithi163 bash[24253]: cluster 2024-08-31T05:22:42.734142+0000 mgr.a (mgr.14388) 8280 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:43 smithi027 bash[22610]: cluster 2024-08-31T05:22:42.734142+0000 mgr.a (mgr.14388) 8280 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:43 smithi191 bash[24992]: cluster 2024-08-31T05:22:42.734142+0000 mgr.a (mgr.14388) 8280 : cluster [DBG] pgmap v5739: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:44.548 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:22:44.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:22:44.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:22:44.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:22:44.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:22:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:44 smithi163 bash[24253]: audit 2024-08-31T05:22:44.141254+0000 mgr.a (mgr.14388) 8281 : audit [DBG] from='client.186006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:45.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:44 smithi027 bash[22610]: audit 2024-08-31T05:22:44.141254+0000 mgr.a (mgr.14388) 8281 : audit [DBG] from='client.186006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:44 smithi191 bash[24992]: audit 2024-08-31T05:22:44.141254+0000 mgr.a (mgr.14388) 8281 : audit [DBG] from='client.186006 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:45 smithi163 bash[24253]: cluster 2024-08-31T05:22:44.736991+0000 mgr.a (mgr.14388) 8282 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:45 smithi027 bash[22610]: cluster 2024-08-31T05:22:44.736991+0000 mgr.a (mgr.14388) 8282 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:45 smithi191 bash[24992]: cluster 2024-08-31T05:22:44.736991+0000 mgr.a (mgr.14388) 8282 : cluster [DBG] pgmap v5740: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:22:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:47 smithi163 bash[24253]: cluster 2024-08-31T05:22:46.737798+0000 mgr.a (mgr.14388) 8283 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-08-31T05:22:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:47 smithi027 bash[22610]: cluster 2024-08-31T05:22:46.737798+0000 mgr.a (mgr.14388) 8283 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-08-31T05:22:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:47 smithi191 bash[24992]: cluster 2024-08-31T05:22:46.737798+0000 mgr.a (mgr.14388) 8283 : cluster [DBG] pgmap v5741: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-08-31T05:22:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:22:49.550 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:22:49.551 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:22:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:49 smithi163 bash[24253]: cluster 2024-08-31T05:22:48.739854+0000 mgr.a (mgr.14388) 8284 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T05:22:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:49 smithi027 bash[22610]: cluster 2024-08-31T05:22:48.739854+0000 mgr.a (mgr.14388) 8284 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T05:22:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:49 smithi191 bash[24992]: cluster 2024-08-31T05:22:48.739854+0000 mgr.a (mgr.14388) 8284 : cluster [DBG] pgmap v5742: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T05:22:50.319 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:22:50.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:22:50.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:22:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:22:50.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:22:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:50 smithi163 bash[24253]: audit 2024-08-31T05:22:49.890712+0000 mgr.a (mgr.14388) 8285 : audit [DBG] from='client.186084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:50 smithi027 bash[22610]: audit 2024-08-31T05:22:49.890712+0000 mgr.a (mgr.14388) 8285 : audit [DBG] from='client.186084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:50 smithi191 bash[24992]: audit 2024-08-31T05:22:49.890712+0000 mgr.a (mgr.14388) 8285 : audit [DBG] from='client.186084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:51 smithi027 bash[22610]: cluster 2024-08-31T05:22:50.740800+0000 mgr.a (mgr.14388) 8286 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:51 smithi191 bash[24992]: cluster 2024-08-31T05:22:50.740800+0000 mgr.a (mgr.14388) 8286 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:51 smithi163 bash[24253]: cluster 2024-08-31T05:22:50.740800+0000 mgr.a (mgr.14388) 8286 : cluster [DBG] pgmap v5743: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:53 smithi027 bash[22610]: cluster 2024-08-31T05:22:52.741593+0000 mgr.a (mgr.14388) 8287 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:53 smithi191 bash[24992]: cluster 2024-08-31T05:22:52.741593+0000 mgr.a (mgr.14388) 8287 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:53 smithi163 bash[24253]: cluster 2024-08-31T05:22:52.741593+0000 mgr.a (mgr.14388) 8287 : cluster [DBG] pgmap v5744: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:55.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:22:55.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:22:55.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:22:56.094 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:22:56.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:22:56.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:22:56.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:22:56.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:22:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:55 smithi027 bash[22610]: cluster 2024-08-31T05:22:54.743885+0000 mgr.a (mgr.14388) 8288 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:22:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:55 smithi191 bash[24992]: cluster 2024-08-31T05:22:54.743885+0000 mgr.a (mgr.14388) 8288 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:22:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:55 smithi163 bash[24253]: cluster 2024-08-31T05:22:54.743885+0000 mgr.a (mgr.14388) 8288 : cluster [DBG] pgmap v5745: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:22:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:56 smithi027 bash[22610]: audit 2024-08-31T05:22:55.654525+0000 mgr.a (mgr.14388) 8289 : audit [DBG] from='client.186159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:56 smithi191 bash[24992]: audit 2024-08-31T05:22:55.654525+0000 mgr.a (mgr.14388) 8289 : audit [DBG] from='client.186159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:56 smithi163 bash[24253]: audit 2024-08-31T05:22:55.654525+0000 mgr.a (mgr.14388) 8289 : audit [DBG] from='client.186159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:58.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:57 smithi027 bash[22610]: cluster 2024-08-31T05:22:56.744863+0000 mgr.a (mgr.14388) 8290 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:57 smithi191 bash[24992]: cluster 2024-08-31T05:22:56.744863+0000 mgr.a (mgr.14388) 8290 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:22:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:57 smithi163 bash[24253]: cluster 2024-08-31T05:22:56.744863+0000 mgr.a (mgr.14388) 8290 : cluster [DBG] pgmap v5746: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:22:59 smithi027 bash[22610]: cluster 2024-08-31T05:22:58.747112+0000 mgr.a (mgr.14388) 8291 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:22:59 smithi191 bash[24992]: cluster 2024-08-31T05:22:58.747112+0000 mgr.a (mgr.14388) 8291 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:22:59 smithi163 bash[24253]: cluster 2024-08-31T05:22:58.747112+0000 mgr.a (mgr.14388) 8291 : cluster [DBG] pgmap v5747: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:01.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:01.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:01.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:01.827 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:01.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:01.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:01.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:01.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:23:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:01 smithi191 bash[24992]: cluster 2024-08-31T05:23:00.747869+0000 mgr.a (mgr.14388) 8292 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:01 smithi163 bash[24253]: cluster 2024-08-31T05:23:00.747869+0000 mgr.a (mgr.14388) 8292 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:01 smithi027 bash[22610]: cluster 2024-08-31T05:23:00.747869+0000 mgr.a (mgr.14388) 8292 : cluster [DBG] pgmap v5748: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:02 smithi191 bash[24992]: audit 2024-08-31T05:23:01.426264+0000 mgr.a (mgr.14388) 8293 : audit [DBG] from='client.186237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:02 smithi163 bash[24253]: audit 2024-08-31T05:23:01.426264+0000 mgr.a (mgr.14388) 8293 : audit [DBG] from='client.186237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:02 smithi027 bash[22610]: audit 2024-08-31T05:23:01.426264+0000 mgr.a (mgr.14388) 8293 : audit [DBG] from='client.186237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:03 smithi191 bash[24992]: cluster 2024-08-31T05:23:02.748821+0000 mgr.a (mgr.14388) 8294 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:03 smithi163 bash[24253]: cluster 2024-08-31T05:23:02.748821+0000 mgr.a (mgr.14388) 8294 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:03 smithi027 bash[22610]: cluster 2024-08-31T05:23:02.748821+0000 mgr.a (mgr.14388) 8294 : cluster [DBG] pgmap v5749: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:06 smithi191 bash[24992]: cluster 2024-08-31T05:23:04.751111+0000 mgr.a (mgr.14388) 8295 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:06 smithi163 bash[24253]: cluster 2024-08-31T05:23:04.751111+0000 mgr.a (mgr.14388) 8295 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:06 smithi027 bash[22610]: cluster 2024-08-31T05:23:04.751111+0000 mgr.a (mgr.14388) 8295 : cluster [DBG] pgmap v5750: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:06.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:06.829 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:06.829 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:07.591 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:07.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:07.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:07.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:07.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:23:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:08 smithi191 bash[24992]: cluster 2024-08-31T05:23:06.751870+0000 mgr.a (mgr.14388) 8296 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:08 smithi191 bash[24992]: audit 2024-08-31T05:23:07.168192+0000 mgr.a (mgr.14388) 8297 : audit [DBG] from='client.186312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:08 smithi163 bash[24253]: cluster 2024-08-31T05:23:06.751870+0000 mgr.a (mgr.14388) 8296 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:08 smithi163 bash[24253]: audit 2024-08-31T05:23:07.168192+0000 mgr.a (mgr.14388) 8297 : audit [DBG] from='client.186312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:08 smithi027 bash[22610]: cluster 2024-08-31T05:23:06.751870+0000 mgr.a (mgr.14388) 8296 : cluster [DBG] pgmap v5751: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:08 smithi027 bash[22610]: audit 2024-08-31T05:23:07.168192+0000 mgr.a (mgr.14388) 8297 : audit [DBG] from='client.186312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:10 smithi191 bash[24992]: cluster 2024-08-31T05:23:08.754244+0000 mgr.a (mgr.14388) 8298 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:10 smithi163 bash[24253]: cluster 2024-08-31T05:23:08.754244+0000 mgr.a (mgr.14388) 8298 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:10 smithi027 bash[22610]: cluster 2024-08-31T05:23:08.754244+0000 mgr.a (mgr.14388) 8298 : cluster [DBG] pgmap v5752: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:12 smithi191 bash[24992]: cluster 2024-08-31T05:23:10.755210+0000 mgr.a (mgr.14388) 8299 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:12 smithi163 bash[24253]: cluster 2024-08-31T05:23:10.755210+0000 mgr.a (mgr.14388) 8299 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:12 smithi027 bash[22610]: cluster 2024-08-31T05:23:10.755210+0000 mgr.a (mgr.14388) 8299 : cluster [DBG] pgmap v5753: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:12.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:12.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:12.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:13.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:13.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:13.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:13.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:23:13.370 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:14 smithi191 bash[24992]: cluster 2024-08-31T05:23:12.755979+0000 mgr.a (mgr.14388) 8300 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:14 smithi191 bash[24992]: audit 2024-08-31T05:23:12.931187+0000 mgr.a (mgr.14388) 8301 : audit [DBG] from='client.186387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:14 smithi163 bash[24253]: cluster 2024-08-31T05:23:12.755979+0000 mgr.a (mgr.14388) 8300 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:14 smithi163 bash[24253]: audit 2024-08-31T05:23:12.931187+0000 mgr.a (mgr.14388) 8301 : audit [DBG] from='client.186387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:14 smithi027 bash[22610]: cluster 2024-08-31T05:23:12.755979+0000 mgr.a (mgr.14388) 8300 : cluster [DBG] pgmap v5754: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:14 smithi027 bash[22610]: audit 2024-08-31T05:23:12.931187+0000 mgr.a (mgr.14388) 8301 : audit [DBG] from='client.186387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:16 smithi191 bash[24992]: cluster 2024-08-31T05:23:14.758686+0000 mgr.a (mgr.14388) 8302 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:16 smithi163 bash[24253]: cluster 2024-08-31T05:23:14.758686+0000 mgr.a (mgr.14388) 8302 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:16 smithi027 bash[22610]: cluster 2024-08-31T05:23:14.758686+0000 mgr.a (mgr.14388) 8302 : cluster [DBG] pgmap v5755: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:18 smithi191 bash[24992]: cluster 2024-08-31T05:23:16.759533+0000 mgr.a (mgr.14388) 8303 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:23:18.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:18.372 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:18.373 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:18 smithi163 bash[24253]: cluster 2024-08-31T05:23:16.759533+0000 mgr.a (mgr.14388) 8303 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:23:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:18 smithi027 bash[22610]: cluster 2024-08-31T05:23:16.759533+0000 mgr.a (mgr.14388) 8303 : cluster [DBG] pgmap v5756: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:23:19.112 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:19.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:19.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:19.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:19.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:23:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:20 smithi191 bash[24992]: audit 2024-08-31T05:23:18.697610+0000 mgr.a (mgr.14388) 8304 : audit [DBG] from='client.186462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:20 smithi191 bash[24992]: cluster 2024-08-31T05:23:18.761380+0000 mgr.a (mgr.14388) 8305 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:20 smithi163 bash[24253]: audit 2024-08-31T05:23:18.697610+0000 mgr.a (mgr.14388) 8304 : audit [DBG] from='client.186462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:20 smithi163 bash[24253]: cluster 2024-08-31T05:23:18.761380+0000 mgr.a (mgr.14388) 8305 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:20 smithi027 bash[22610]: audit 2024-08-31T05:23:18.697610+0000 mgr.a (mgr.14388) 8304 : audit [DBG] from='client.186462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:20 smithi027 bash[22610]: cluster 2024-08-31T05:23:18.761380+0000 mgr.a (mgr.14388) 8305 : cluster [DBG] pgmap v5757: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:21.457 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:21 smithi163 bash[24253]: audit 2024-08-31T05:23:20.560110+0000 mon.a (mon.0) 1827 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:21.486 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:21 smithi027 bash[22610]: audit 2024-08-31T05:23:20.560110+0000 mon.a (mon.0) 1827 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:21 smithi191 bash[24992]: audit 2024-08-31T05:23:20.560110+0000 mon.a (mon.0) 1827 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:23:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:22 smithi191 bash[24992]: cluster 2024-08-31T05:23:20.762216+0000 mgr.a (mgr.14388) 8306 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:23:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:22 smithi191 bash[24992]: audit 2024-08-31T05:23:21.405841+0000 mon.a (mon.0) 1828 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:23:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:22 smithi191 bash[24992]: audit 2024-08-31T05:23:21.407689+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:23:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:22 smithi191 bash[24992]: audit 2024-08-31T05:23:21.416444+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:23:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:22 smithi191 bash[24992]: audit 2024-08-31T05:23:21.421634+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:23:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:22 smithi163 bash[24253]: cluster 2024-08-31T05:23:20.762216+0000 mgr.a (mgr.14388) 8306 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:23:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:22 smithi163 bash[24253]: audit 2024-08-31T05:23:21.405841+0000 mon.a (mon.0) 1828 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:23:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:22 smithi163 bash[24253]: audit 2024-08-31T05:23:21.407689+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:23:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:22 smithi163 bash[24253]: audit 2024-08-31T05:23:21.416444+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:23:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:22 smithi163 bash[24253]: audit 2024-08-31T05:23:21.421634+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:23:22.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:23:22 smithi027 bash[22863]: debug 2024-08-31T05:23:22.142+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:23:22.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:23:22 smithi027 bash[22863]: debug 2024-08-31T05:23:22.146+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:23:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:22 smithi027 bash[22610]: cluster 2024-08-31T05:23:20.762216+0000 mgr.a (mgr.14388) 8306 : cluster [DBG] pgmap v5758: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:23:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:22 smithi027 bash[22610]: audit 2024-08-31T05:23:21.405841+0000 mon.a (mon.0) 1828 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:23:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:22 smithi027 bash[22610]: audit 2024-08-31T05:23:21.407689+0000 mon.a (mon.0) 1829 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:23:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:22 smithi027 bash[22610]: audit 2024-08-31T05:23:21.416444+0000 mon.a (mon.0) 1830 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:23:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:22 smithi027 bash[22610]: audit 2024-08-31T05:23:21.421634+0000 mon.a (mon.0) 1831 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:23:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:23 smithi163 bash[24253]: audit 2024-08-31T05:23:21.424112+0000 mgr.a (mgr.14388) 8307 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:23:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:23 smithi163 bash[24253]: audit 2024-08-31T05:23:22.145755+0000 mgr.a (mgr.14388) 8308 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:23:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:23 smithi163 bash[24253]: cephadm 2024-08-31T05:23:22.147067+0000 mgr.a (mgr.14388) 8309 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:23:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:23 smithi027 bash[22610]: audit 2024-08-31T05:23:21.424112+0000 mgr.a (mgr.14388) 8307 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:23:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:23 smithi027 bash[22610]: audit 2024-08-31T05:23:22.145755+0000 mgr.a (mgr.14388) 8308 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:23:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:23 smithi027 bash[22610]: cephadm 2024-08-31T05:23:22.147067+0000 mgr.a (mgr.14388) 8309 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:23:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:23 smithi191 bash[24992]: audit 2024-08-31T05:23:21.424112+0000 mgr.a (mgr.14388) 8307 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:23:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:23 smithi191 bash[24992]: audit 2024-08-31T05:23:22.145755+0000 mgr.a (mgr.14388) 8308 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:23:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:23 smithi191 bash[24992]: cephadm 2024-08-31T05:23:22.147067+0000 mgr.a (mgr.14388) 8309 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:23:24.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:24.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:24.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:24 smithi163 bash[24253]: cluster 2024-08-31T05:23:22.763166+0000 mgr.a (mgr.14388) 8310 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:23:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:24 smithi027 bash[22610]: cluster 2024-08-31T05:23:22.763166+0000 mgr.a (mgr.14388) 8310 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:23:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:24 smithi191 bash[24992]: cluster 2024-08-31T05:23:22.763166+0000 mgr.a (mgr.14388) 8310 : cluster [DBG] pgmap v5759: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:23:24.854 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:24.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:24.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:24.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:24.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:23:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:26 smithi163 bash[24253]: audit 2024-08-31T05:23:24.438522+0000 mgr.a (mgr.14388) 8311 : audit [DBG] from='client.186645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:26 smithi163 bash[24253]: cluster 2024-08-31T05:23:24.764458+0000 mgr.a (mgr.14388) 8312 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:26 smithi027 bash[22610]: audit 2024-08-31T05:23:24.438522+0000 mgr.a (mgr.14388) 8311 : audit [DBG] from='client.186645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:26 smithi027 bash[22610]: cluster 2024-08-31T05:23:24.764458+0000 mgr.a (mgr.14388) 8312 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:26 smithi191 bash[24992]: audit 2024-08-31T05:23:24.438522+0000 mgr.a (mgr.14388) 8311 : audit [DBG] from='client.186645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:26 smithi191 bash[24992]: cluster 2024-08-31T05:23:24.764458+0000 mgr.a (mgr.14388) 8312 : cluster [DBG] pgmap v5760: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:28 smithi163 bash[24253]: cluster 2024-08-31T05:23:26.765220+0000 mgr.a (mgr.14388) 8313 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:28 smithi027 bash[22610]: cluster 2024-08-31T05:23:26.765220+0000 mgr.a (mgr.14388) 8313 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:28 smithi191 bash[24992]: cluster 2024-08-31T05:23:26.765220+0000 mgr.a (mgr.14388) 8313 : cluster [DBG] pgmap v5761: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:29.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:29.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:29.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:30 smithi163 bash[24253]: cluster 2024-08-31T05:23:28.767221+0000 mgr.a (mgr.14388) 8314 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:30 smithi027 bash[22610]: cluster 2024-08-31T05:23:28.767221+0000 mgr.a (mgr.14388) 8314 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:30 smithi191 bash[24992]: cluster 2024-08-31T05:23:28.767221+0000 mgr.a (mgr.14388) 8314 : cluster [DBG] pgmap v5762: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:30.607 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:30.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:30.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:30.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:30.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:23:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:31 smithi163 bash[24253]: audit 2024-08-31T05:23:30.189494+0000 mgr.a (mgr.14388) 8315 : audit [DBG] from='client.186723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:31 smithi027 bash[22610]: audit 2024-08-31T05:23:30.189494+0000 mgr.a (mgr.14388) 8315 : audit [DBG] from='client.186723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:31 smithi191 bash[24992]: audit 2024-08-31T05:23:30.189494+0000 mgr.a (mgr.14388) 8315 : audit [DBG] from='client.186723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:32 smithi163 bash[24253]: cluster 2024-08-31T05:23:30.768104+0000 mgr.a (mgr.14388) 8316 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:32 smithi027 bash[22610]: cluster 2024-08-31T05:23:30.768104+0000 mgr.a (mgr.14388) 8316 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:32 smithi191 bash[24992]: cluster 2024-08-31T05:23:30.768104+0000 mgr.a (mgr.14388) 8316 : cluster [DBG] pgmap v5763: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:34 smithi163 bash[24253]: cluster 2024-08-31T05:23:32.769035+0000 mgr.a (mgr.14388) 8317 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:34 smithi027 bash[22610]: cluster 2024-08-31T05:23:32.769035+0000 mgr.a (mgr.14388) 8317 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:34 smithi191 bash[24992]: cluster 2024-08-31T05:23:32.769035+0000 mgr.a (mgr.14388) 8317 : cluster [DBG] pgmap v5764: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:35.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:35.610 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:35.610 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:36.390 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:36.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:36.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:36.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:36.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:23:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:36 smithi163 bash[24253]: cluster 2024-08-31T05:23:34.771316+0000 mgr.a (mgr.14388) 8318 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:36 smithi027 bash[22610]: cluster 2024-08-31T05:23:34.771316+0000 mgr.a (mgr.14388) 8318 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:36 smithi191 bash[24992]: cluster 2024-08-31T05:23:34.771316+0000 mgr.a (mgr.14388) 8318 : cluster [DBG] pgmap v5765: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:23:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:37 smithi163 bash[24253]: audit 2024-08-31T05:23:35.945337+0000 mgr.a (mgr.14388) 8319 : audit [DBG] from='client.186798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:37 smithi027 bash[22610]: audit 2024-08-31T05:23:35.945337+0000 mgr.a (mgr.14388) 8319 : audit [DBG] from='client.186798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:37 smithi191 bash[24992]: audit 2024-08-31T05:23:35.945337+0000 mgr.a (mgr.14388) 8319 : audit [DBG] from='client.186798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:38 smithi163 bash[24253]: cluster 2024-08-31T05:23:36.772318+0000 mgr.a (mgr.14388) 8320 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:38 smithi027 bash[22610]: cluster 2024-08-31T05:23:36.772318+0000 mgr.a (mgr.14388) 8320 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:38 smithi191 bash[24992]: cluster 2024-08-31T05:23:36.772318+0000 mgr.a (mgr.14388) 8320 : cluster [DBG] pgmap v5766: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:40 smithi163 bash[24253]: cluster 2024-08-31T05:23:38.774572+0000 mgr.a (mgr.14388) 8321 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:40 smithi027 bash[22610]: cluster 2024-08-31T05:23:38.774572+0000 mgr.a (mgr.14388) 8321 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:40 smithi191 bash[24992]: cluster 2024-08-31T05:23:38.774572+0000 mgr.a (mgr.14388) 8321 : cluster [DBG] pgmap v5767: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:41.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:41.393 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:41.393 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:42.139 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:42.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:42.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:42.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:42.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:23:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:42 smithi163 bash[24253]: cluster 2024-08-31T05:23:40.775360+0000 mgr.a (mgr.14388) 8322 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:42 smithi027 bash[22610]: cluster 2024-08-31T05:23:40.775360+0000 mgr.a (mgr.14388) 8322 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:42 smithi191 bash[24992]: cluster 2024-08-31T05:23:40.775360+0000 mgr.a (mgr.14388) 8322 : cluster [DBG] pgmap v5768: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:43 smithi163 bash[24253]: audit 2024-08-31T05:23:41.720318+0000 mgr.a (mgr.14388) 8323 : audit [DBG] from='client.186876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:43 smithi027 bash[22610]: audit 2024-08-31T05:23:41.720318+0000 mgr.a (mgr.14388) 8323 : audit [DBG] from='client.186876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:43 smithi191 bash[24992]: audit 2024-08-31T05:23:41.720318+0000 mgr.a (mgr.14388) 8323 : audit [DBG] from='client.186876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:44 smithi163 bash[24253]: cluster 2024-08-31T05:23:42.776293+0000 mgr.a (mgr.14388) 8324 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:44 smithi027 bash[22610]: cluster 2024-08-31T05:23:42.776293+0000 mgr.a (mgr.14388) 8324 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:44 smithi191 bash[24992]: cluster 2024-08-31T05:23:42.776293+0000 mgr.a (mgr.14388) 8324 : cluster [DBG] pgmap v5769: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:46 smithi163 bash[24253]: cluster 2024-08-31T05:23:44.778520+0000 mgr.a (mgr.14388) 8325 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:46 smithi027 bash[22610]: cluster 2024-08-31T05:23:44.778520+0000 mgr.a (mgr.14388) 8325 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:46 smithi191 bash[24992]: cluster 2024-08-31T05:23:44.778520+0000 mgr.a (mgr.14388) 8325 : cluster [DBG] pgmap v5770: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:47.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:47.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:47.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:47.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:47.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:47.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:47.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:23:47.917 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:48 smithi163 bash[24253]: cluster 2024-08-31T05:23:46.779377+0000 mgr.a (mgr.14388) 8326 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:48 smithi027 bash[22610]: cluster 2024-08-31T05:23:46.779377+0000 mgr.a (mgr.14388) 8326 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:48 smithi191 bash[24992]: cluster 2024-08-31T05:23:46.779377+0000 mgr.a (mgr.14388) 8326 : cluster [DBG] pgmap v5771: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:49 smithi163 bash[24253]: audit 2024-08-31T05:23:47.477583+0000 mgr.a (mgr.14388) 8327 : audit [DBG] from='client.186954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:49 smithi027 bash[22610]: audit 2024-08-31T05:23:47.477583+0000 mgr.a (mgr.14388) 8327 : audit [DBG] from='client.186954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:49 smithi191 bash[24992]: audit 2024-08-31T05:23:47.477583+0000 mgr.a (mgr.14388) 8327 : audit [DBG] from='client.186954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:50 smithi163 bash[24253]: cluster 2024-08-31T05:23:48.781799+0000 mgr.a (mgr.14388) 8328 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:50 smithi027 bash[22610]: cluster 2024-08-31T05:23:48.781799+0000 mgr.a (mgr.14388) 8328 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:50 smithi191 bash[24992]: cluster 2024-08-31T05:23:48.781799+0000 mgr.a (mgr.14388) 8328 : cluster [DBG] pgmap v5772: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:23:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:52 smithi163 bash[24253]: cluster 2024-08-31T05:23:50.782561+0000 mgr.a (mgr.14388) 8329 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:52 smithi027 bash[22610]: cluster 2024-08-31T05:23:50.782561+0000 mgr.a (mgr.14388) 8329 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:52 smithi191 bash[24992]: cluster 2024-08-31T05:23:50.782561+0000 mgr.a (mgr.14388) 8329 : cluster [DBG] pgmap v5773: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:52.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:52.919 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:52.919 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:53.704 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:53.704 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:53.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:53.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:53.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:23:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:54 smithi163 bash[24253]: cluster 2024-08-31T05:23:52.783332+0000 mgr.a (mgr.14388) 8330 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:54 smithi163 bash[24253]: audit 2024-08-31T05:23:53.262969+0000 mgr.a (mgr.14388) 8331 : audit [DBG] from='client.187032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:54 smithi027 bash[22610]: cluster 2024-08-31T05:23:52.783332+0000 mgr.a (mgr.14388) 8330 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:54 smithi027 bash[22610]: audit 2024-08-31T05:23:53.262969+0000 mgr.a (mgr.14388) 8331 : audit [DBG] from='client.187032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:54 smithi191 bash[24992]: cluster 2024-08-31T05:23:52.783332+0000 mgr.a (mgr.14388) 8330 : cluster [DBG] pgmap v5774: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:54 smithi191 bash[24992]: audit 2024-08-31T05:23:53.262969+0000 mgr.a (mgr.14388) 8331 : audit [DBG] from='client.187032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:56 smithi163 bash[24253]: cluster 2024-08-31T05:23:54.786028+0000 mgr.a (mgr.14388) 8332 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:56 smithi027 bash[22610]: cluster 2024-08-31T05:23:54.786028+0000 mgr.a (mgr.14388) 8332 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:56 smithi191 bash[24992]: cluster 2024-08-31T05:23:54.786028+0000 mgr.a (mgr.14388) 8332 : cluster [DBG] pgmap v5775: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:23:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:23:58 smithi163 bash[24253]: cluster 2024-08-31T05:23:56.786867+0000 mgr.a (mgr.14388) 8333 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:23:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:23:58 smithi027 bash[22610]: cluster 2024-08-31T05:23:56.786867+0000 mgr.a (mgr.14388) 8333 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:23:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:23:58 smithi191 bash[24992]: cluster 2024-08-31T05:23:56.786867+0000 mgr.a (mgr.14388) 8333 : cluster [DBG] pgmap v5776: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:23:58.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:23:58.706 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:23:58.706 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:23:59.479 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:23:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:23:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:23:59.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:23:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:00 smithi163 bash[24253]: cluster 2024-08-31T05:23:58.788850+0000 mgr.a (mgr.14388) 8334 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:00.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:00 smithi163 bash[24253]: audit 2024-08-31T05:23:59.044200+0000 mgr.a (mgr.14388) 8335 : audit [DBG] from='client.187110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:00 smithi027 bash[22610]: cluster 2024-08-31T05:23:58.788850+0000 mgr.a (mgr.14388) 8334 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:00 smithi027 bash[22610]: audit 2024-08-31T05:23:59.044200+0000 mgr.a (mgr.14388) 8335 : audit [DBG] from='client.187110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:00 smithi191 bash[24992]: cluster 2024-08-31T05:23:58.788850+0000 mgr.a (mgr.14388) 8334 : cluster [DBG] pgmap v5777: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:00 smithi191 bash[24992]: audit 2024-08-31T05:23:59.044200+0000 mgr.a (mgr.14388) 8335 : audit [DBG] from='client.187110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:02 smithi163 bash[24253]: cluster 2024-08-31T05:24:00.789787+0000 mgr.a (mgr.14388) 8336 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:24:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:02 smithi027 bash[22610]: cluster 2024-08-31T05:24:00.789787+0000 mgr.a (mgr.14388) 8336 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:24:02.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:02 smithi191 bash[24992]: cluster 2024-08-31T05:24:00.789787+0000 mgr.a (mgr.14388) 8336 : cluster [DBG] pgmap v5778: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:24:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:04 smithi163 bash[24253]: cluster 2024-08-31T05:24:02.790562+0000 mgr.a (mgr.14388) 8337 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:24:04.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:24:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:24:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:24:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:04 smithi027 bash[22610]: cluster 2024-08-31T05:24:02.790562+0000 mgr.a (mgr.14388) 8337 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:24:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:04 smithi191 bash[24992]: cluster 2024-08-31T05:24:02.790562+0000 mgr.a (mgr.14388) 8337 : cluster [DBG] pgmap v5779: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:24:05.247 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:24:05.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:24:05.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:24:05.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:24:05.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:06 smithi163 bash[24253]: cluster 2024-08-31T05:24:04.792684+0000 mgr.a (mgr.14388) 8338 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:06 smithi163 bash[24253]: audit 2024-08-31T05:24:04.813691+0000 mgr.a (mgr.14388) 8339 : audit [DBG] from='client.187188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:06 smithi027 bash[22610]: cluster 2024-08-31T05:24:04.792684+0000 mgr.a (mgr.14388) 8338 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:06 smithi027 bash[22610]: audit 2024-08-31T05:24:04.813691+0000 mgr.a (mgr.14388) 8339 : audit [DBG] from='client.187188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:06 smithi191 bash[24992]: cluster 2024-08-31T05:24:04.792684+0000 mgr.a (mgr.14388) 8338 : cluster [DBG] pgmap v5780: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:06 smithi191 bash[24992]: audit 2024-08-31T05:24:04.813691+0000 mgr.a (mgr.14388) 8339 : audit [DBG] from='client.187188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:08 smithi163 bash[24253]: cluster 2024-08-31T05:24:06.793577+0000 mgr.a (mgr.14388) 8340 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:08 smithi027 bash[22610]: cluster 2024-08-31T05:24:06.793577+0000 mgr.a (mgr.14388) 8340 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:08 smithi191 bash[24992]: cluster 2024-08-31T05:24:06.793577+0000 mgr.a (mgr.14388) 8340 : cluster [DBG] pgmap v5781: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:10.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:24:10.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:24:10.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:24:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:10 smithi163 bash[24253]: cluster 2024-08-31T05:24:08.795835+0000 mgr.a (mgr.14388) 8341 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:10 smithi027 bash[22610]: cluster 2024-08-31T05:24:08.795835+0000 mgr.a (mgr.14388) 8341 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:10 smithi191 bash[24992]: cluster 2024-08-31T05:24:08.795835+0000 mgr.a (mgr.14388) 8341 : cluster [DBG] pgmap v5782: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:10.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:24:10.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:24:10.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:24:10.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:11.000 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:24:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:12 smithi163 bash[24253]: audit 2024-08-31T05:24:10.579648+0000 mgr.a (mgr.14388) 8342 : audit [DBG] from='client.187266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:12 smithi163 bash[24253]: cluster 2024-08-31T05:24:10.796342+0000 mgr.a (mgr.14388) 8343 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:12 smithi027 bash[22610]: audit 2024-08-31T05:24:10.579648+0000 mgr.a (mgr.14388) 8342 : audit [DBG] from='client.187266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:12 smithi027 bash[22610]: cluster 2024-08-31T05:24:10.796342+0000 mgr.a (mgr.14388) 8343 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:12 smithi191 bash[24992]: audit 2024-08-31T05:24:10.579648+0000 mgr.a (mgr.14388) 8342 : audit [DBG] from='client.187266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:12 smithi191 bash[24992]: cluster 2024-08-31T05:24:10.796342+0000 mgr.a (mgr.14388) 8343 : cluster [DBG] pgmap v5783: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:14 smithi163 bash[24253]: cluster 2024-08-31T05:24:12.797193+0000 mgr.a (mgr.14388) 8344 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:14 smithi027 bash[22610]: cluster 2024-08-31T05:24:12.797193+0000 mgr.a (mgr.14388) 8344 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:14 smithi191 bash[24992]: cluster 2024-08-31T05:24:12.797193+0000 mgr.a (mgr.14388) 8344 : cluster [DBG] pgmap v5784: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:16.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:24:16.001 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:24:16.001 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:24:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:16 smithi163 bash[24253]: cluster 2024-08-31T05:24:14.799435+0000 mgr.a (mgr.14388) 8345 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:16 smithi027 bash[22610]: cluster 2024-08-31T05:24:14.799435+0000 mgr.a (mgr.14388) 8345 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:16 smithi191 bash[24992]: cluster 2024-08-31T05:24:14.799435+0000 mgr.a (mgr.14388) 8345 : cluster [DBG] pgmap v5785: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:16.776 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:24:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:24:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:24:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:24:16.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:17 smithi027 bash[22610]: audit 2024-08-31T05:24:16.336714+0000 mgr.a (mgr.14388) 8346 : audit [DBG] from='client.187344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:17 smithi191 bash[24992]: audit 2024-08-31T05:24:16.336714+0000 mgr.a (mgr.14388) 8346 : audit [DBG] from='client.187344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:17 smithi163 bash[24253]: audit 2024-08-31T05:24:16.336714+0000 mgr.a (mgr.14388) 8346 : audit [DBG] from='client.187344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:18 smithi027 bash[22610]: cluster 2024-08-31T05:24:16.800090+0000 mgr.a (mgr.14388) 8347 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:18 smithi191 bash[24992]: cluster 2024-08-31T05:24:16.800090+0000 mgr.a (mgr.14388) 8347 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:18 smithi163 bash[24253]: cluster 2024-08-31T05:24:16.800090+0000 mgr.a (mgr.14388) 8347 : cluster [DBG] pgmap v5786: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:20 smithi027 bash[22610]: cluster 2024-08-31T05:24:18.802263+0000 mgr.a (mgr.14388) 8348 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:20 smithi191 bash[24992]: cluster 2024-08-31T05:24:18.802263+0000 mgr.a (mgr.14388) 8348 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:20 smithi163 bash[24253]: cluster 2024-08-31T05:24:18.802263+0000 mgr.a (mgr.14388) 8348 : cluster [DBG] pgmap v5787: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:21.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:24:21.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:24:21.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:24:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:22 smithi027 bash[22610]: cluster 2024-08-31T05:24:20.803204+0000 mgr.a (mgr.14388) 8349 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:22 smithi027 bash[22610]: audit 2024-08-31T05:24:22.200627+0000 mon.a (mon.0) 1832 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:22 smithi191 bash[24992]: cluster 2024-08-31T05:24:20.803204+0000 mgr.a (mgr.14388) 8349 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:22 smithi191 bash[24992]: audit 2024-08-31T05:24:22.200627+0000 mon.a (mon.0) 1832 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:22.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:24:22.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:24:22.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:24:22.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:22.565 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:24:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:22 smithi163 bash[24253]: cluster 2024-08-31T05:24:20.803204+0000 mgr.a (mgr.14388) 8349 : cluster [DBG] pgmap v5788: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:22 smithi163 bash[24253]: audit 2024-08-31T05:24:22.200627+0000 mon.a (mon.0) 1832 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:24:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:23 smithi027 bash[22610]: audit 2024-08-31T05:24:22.120944+0000 mgr.a (mgr.14388) 8350 : audit [DBG] from='client.187419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:23 smithi027 bash[22610]: audit 2024-08-31T05:24:22.990008+0000 mon.a (mon.0) 1833 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:23 smithi027 bash[22610]: audit 2024-08-31T05:24:22.991321+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:23 smithi027 bash[22610]: audit 2024-08-31T05:24:22.998248+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:24:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:23 smithi027 bash[22610]: audit 2024-08-31T05:24:23.003050+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:24:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:23 smithi191 bash[24992]: audit 2024-08-31T05:24:22.120944+0000 mgr.a (mgr.14388) 8350 : audit [DBG] from='client.187419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:23 smithi191 bash[24992]: audit 2024-08-31T05:24:22.990008+0000 mon.a (mon.0) 1833 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:23 smithi191 bash[24992]: audit 2024-08-31T05:24:22.991321+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:23 smithi191 bash[24992]: audit 2024-08-31T05:24:22.998248+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:24:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:23 smithi191 bash[24992]: audit 2024-08-31T05:24:23.003050+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:24:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:23 smithi163 bash[24253]: audit 2024-08-31T05:24:22.120944+0000 mgr.a (mgr.14388) 8350 : audit [DBG] from='client.187419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:23 smithi163 bash[24253]: audit 2024-08-31T05:24:22.990008+0000 mon.a (mon.0) 1833 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:24:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:23 smithi163 bash[24253]: audit 2024-08-31T05:24:22.991321+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:24:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:23 smithi163 bash[24253]: audit 2024-08-31T05:24:22.998248+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:24:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:23 smithi163 bash[24253]: audit 2024-08-31T05:24:23.003050+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:24:24.222 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:24:23 smithi027 bash[22863]: debug 2024-08-31T05:24:23.736+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:24:24.222 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:24:23 smithi027 bash[22863]: debug 2024-08-31T05:24:23.736+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:24:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:24 smithi027 bash[22610]: cluster 2024-08-31T05:24:22.804115+0000 mgr.a (mgr.14388) 8351 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:24 smithi027 bash[22610]: audit 2024-08-31T05:24:23.005600+0000 mgr.a (mgr.14388) 8352 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:24:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:24 smithi191 bash[24992]: cluster 2024-08-31T05:24:22.804115+0000 mgr.a (mgr.14388) 8351 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:24 smithi191 bash[24992]: audit 2024-08-31T05:24:23.005600+0000 mgr.a (mgr.14388) 8352 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:24:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:24 smithi163 bash[24253]: cluster 2024-08-31T05:24:22.804115+0000 mgr.a (mgr.14388) 8351 : cluster [DBG] pgmap v5789: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:24.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:24 smithi163 bash[24253]: audit 2024-08-31T05:24:23.005600+0000 mgr.a (mgr.14388) 8352 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:24:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:25 smithi027 bash[22610]: audit 2024-08-31T05:24:23.739011+0000 mgr.a (mgr.14388) 8353 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:24:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:25 smithi027 bash[22610]: cephadm 2024-08-31T05:24:23.740341+0000 mgr.a (mgr.14388) 8354 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:24:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:25 smithi191 bash[24992]: audit 2024-08-31T05:24:23.739011+0000 mgr.a (mgr.14388) 8353 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:24:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:25 smithi191 bash[24992]: cephadm 2024-08-31T05:24:23.740341+0000 mgr.a (mgr.14388) 8354 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:24:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:25 smithi163 bash[24253]: audit 2024-08-31T05:24:23.739011+0000 mgr.a (mgr.14388) 8353 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:24:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:25 smithi163 bash[24253]: cephadm 2024-08-31T05:24:23.740341+0000 mgr.a (mgr.14388) 8354 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:24:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:26 smithi191 bash[24992]: cluster 2024-08-31T05:24:24.806896+0000 mgr.a (mgr.14388) 8355 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:26 smithi163 bash[24253]: cluster 2024-08-31T05:24:24.806896+0000 mgr.a (mgr.14388) 8355 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:26 smithi027 bash[22610]: cluster 2024-08-31T05:24:24.806896+0000 mgr.a (mgr.14388) 8355 : cluster [DBG] pgmap v5790: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:27.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:24:27.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:24:27.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:24:28.326 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:24:28.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:24:28.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:24:28.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:24:28.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:28 smithi191 bash[24992]: cluster 2024-08-31T05:24:26.807722+0000 mgr.a (mgr.14388) 8356 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:28 smithi163 bash[24253]: cluster 2024-08-31T05:24:26.807722+0000 mgr.a (mgr.14388) 8356 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:28 smithi027 bash[22610]: cluster 2024-08-31T05:24:26.807722+0000 mgr.a (mgr.14388) 8356 : cluster [DBG] pgmap v5791: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:29 smithi191 bash[24992]: audit 2024-08-31T05:24:27.900128+0000 mgr.a (mgr.14388) 8357 : audit [DBG] from='client.187599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:29 smithi163 bash[24253]: audit 2024-08-31T05:24:27.900128+0000 mgr.a (mgr.14388) 8357 : audit [DBG] from='client.187599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:29 smithi027 bash[22610]: audit 2024-08-31T05:24:27.900128+0000 mgr.a (mgr.14388) 8357 : audit [DBG] from='client.187599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:30 smithi191 bash[24992]: cluster 2024-08-31T05:24:28.810537+0000 mgr.a (mgr.14388) 8358 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:24:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:30 smithi163 bash[24253]: cluster 2024-08-31T05:24:28.810537+0000 mgr.a (mgr.14388) 8358 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:24:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:30 smithi027 bash[22610]: cluster 2024-08-31T05:24:28.810537+0000 mgr.a (mgr.14388) 8358 : cluster [DBG] pgmap v5792: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:24:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:32 smithi191 bash[24992]: cluster 2024-08-31T05:24:30.811351+0000 mgr.a (mgr.14388) 8359 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:24:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:32 smithi163 bash[24253]: cluster 2024-08-31T05:24:30.811351+0000 mgr.a (mgr.14388) 8359 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:24:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:32 smithi027 bash[22610]: cluster 2024-08-31T05:24:30.811351+0000 mgr.a (mgr.14388) 8359 : cluster [DBG] pgmap v5793: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:24:33.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:24:33.331 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:24:33.331 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:24:34.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:24:34.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:24:34.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:24:34.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:24:34.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:34 smithi191 bash[24992]: cluster 2024-08-31T05:24:32.812138+0000 mgr.a (mgr.14388) 8360 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:24:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:34 smithi163 bash[24253]: cluster 2024-08-31T05:24:32.812138+0000 mgr.a (mgr.14388) 8360 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:24:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:34 smithi027 bash[22610]: cluster 2024-08-31T05:24:32.812138+0000 mgr.a (mgr.14388) 8360 : cluster [DBG] pgmap v5794: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:24:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:35 smithi191 bash[24992]: audit 2024-08-31T05:24:33.664036+0000 mgr.a (mgr.14388) 8361 : audit [DBG] from='client.187677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:35 smithi163 bash[24253]: audit 2024-08-31T05:24:33.664036+0000 mgr.a (mgr.14388) 8361 : audit [DBG] from='client.187677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:35 smithi027 bash[22610]: audit 2024-08-31T05:24:33.664036+0000 mgr.a (mgr.14388) 8361 : audit [DBG] from='client.187677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:36 smithi191 bash[24992]: cluster 2024-08-31T05:24:34.814874+0000 mgr.a (mgr.14388) 8362 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:24:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:36 smithi163 bash[24253]: cluster 2024-08-31T05:24:34.814874+0000 mgr.a (mgr.14388) 8362 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:24:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:36 smithi027 bash[22610]: cluster 2024-08-31T05:24:34.814874+0000 mgr.a (mgr.14388) 8362 : cluster [DBG] pgmap v5795: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:24:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:38 smithi191 bash[24992]: cluster 2024-08-31T05:24:36.815606+0000 mgr.a (mgr.14388) 8363 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:24:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:38 smithi163 bash[24253]: cluster 2024-08-31T05:24:36.815606+0000 mgr.a (mgr.14388) 8363 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:24:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:38 smithi027 bash[22610]: cluster 2024-08-31T05:24:36.815606+0000 mgr.a (mgr.14388) 8363 : cluster [DBG] pgmap v5796: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:24:39.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:24:39.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:24:39.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:24:39.856 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:24:39.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:24:39.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:24:39.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:24:39.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:40 smithi191 bash[24992]: cluster 2024-08-31T05:24:38.817608+0000 mgr.a (mgr.14388) 8364 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:24:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:40 smithi163 bash[24253]: cluster 2024-08-31T05:24:38.817608+0000 mgr.a (mgr.14388) 8364 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:24:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:40 smithi027 bash[22610]: cluster 2024-08-31T05:24:38.817608+0000 mgr.a (mgr.14388) 8364 : cluster [DBG] pgmap v5797: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:24:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:41 smithi191 bash[24992]: audit 2024-08-31T05:24:39.436636+0000 mgr.a (mgr.14388) 8365 : audit [DBG] from='client.187752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:41 smithi163 bash[24253]: audit 2024-08-31T05:24:39.436636+0000 mgr.a (mgr.14388) 8365 : audit [DBG] from='client.187752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:41 smithi027 bash[22610]: audit 2024-08-31T05:24:39.436636+0000 mgr.a (mgr.14388) 8365 : audit [DBG] from='client.187752 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:42 smithi163 bash[24253]: cluster 2024-08-31T05:24:40.818510+0000 mgr.a (mgr.14388) 8366 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:42 smithi027 bash[22610]: cluster 2024-08-31T05:24:40.818510+0000 mgr.a (mgr.14388) 8366 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:42 smithi191 bash[24992]: cluster 2024-08-31T05:24:40.818510+0000 mgr.a (mgr.14388) 8366 : cluster [DBG] pgmap v5798: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:44 smithi163 bash[24253]: cluster 2024-08-31T05:24:42.819292+0000 mgr.a (mgr.14388) 8367 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:44 smithi027 bash[22610]: cluster 2024-08-31T05:24:42.819292+0000 mgr.a (mgr.14388) 8367 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:44 smithi191 bash[24992]: cluster 2024-08-31T05:24:42.819292+0000 mgr.a (mgr.14388) 8367 : cluster [DBG] pgmap v5799: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:44.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:24:44.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:24:44.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:24:45.641 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:24:45.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:24:45.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:24:45.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:24:45.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:46 smithi163 bash[24253]: cluster 2024-08-31T05:24:44.821520+0000 mgr.a (mgr.14388) 8368 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:46 smithi163 bash[24253]: audit 2024-08-31T05:24:45.198644+0000 mgr.a (mgr.14388) 8369 : audit [DBG] from='client.187824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:46 smithi027 bash[22610]: cluster 2024-08-31T05:24:44.821520+0000 mgr.a (mgr.14388) 8368 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:46 smithi027 bash[22610]: audit 2024-08-31T05:24:45.198644+0000 mgr.a (mgr.14388) 8369 : audit [DBG] from='client.187824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:46 smithi191 bash[24992]: cluster 2024-08-31T05:24:44.821520+0000 mgr.a (mgr.14388) 8368 : cluster [DBG] pgmap v5800: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:46 smithi191 bash[24992]: audit 2024-08-31T05:24:45.198644+0000 mgr.a (mgr.14388) 8369 : audit [DBG] from='client.187824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:48 smithi163 bash[24253]: cluster 2024-08-31T05:24:46.822396+0000 mgr.a (mgr.14388) 8370 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:48 smithi027 bash[22610]: cluster 2024-08-31T05:24:46.822396+0000 mgr.a (mgr.14388) 8370 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:48 smithi191 bash[24992]: cluster 2024-08-31T05:24:46.822396+0000 mgr.a (mgr.14388) 8370 : cluster [DBG] pgmap v5801: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:50.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:24:50.646 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:24:50.646 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:24:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:50 smithi163 bash[24253]: cluster 2024-08-31T05:24:48.824636+0000 mgr.a (mgr.14388) 8371 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:50 smithi027 bash[22610]: cluster 2024-08-31T05:24:48.824636+0000 mgr.a (mgr.14388) 8371 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:50 smithi191 bash[24992]: cluster 2024-08-31T05:24:48.824636+0000 mgr.a (mgr.14388) 8371 : cluster [DBG] pgmap v5802: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:51.386 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:24:51.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:24:51.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:24:51.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:24:51.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:52 smithi163 bash[24253]: cluster 2024-08-31T05:24:50.825327+0000 mgr.a (mgr.14388) 8372 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:52 smithi163 bash[24253]: audit 2024-08-31T05:24:50.978167+0000 mgr.a (mgr.14388) 8373 : audit [DBG] from='client.187899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:52 smithi027 bash[22610]: cluster 2024-08-31T05:24:50.825327+0000 mgr.a (mgr.14388) 8372 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:52 smithi027 bash[22610]: audit 2024-08-31T05:24:50.978167+0000 mgr.a (mgr.14388) 8373 : audit [DBG] from='client.187899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:52 smithi191 bash[24992]: cluster 2024-08-31T05:24:50.825327+0000 mgr.a (mgr.14388) 8372 : cluster [DBG] pgmap v5803: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:52 smithi191 bash[24992]: audit 2024-08-31T05:24:50.978167+0000 mgr.a (mgr.14388) 8373 : audit [DBG] from='client.187899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:54 smithi163 bash[24253]: cluster 2024-08-31T05:24:52.826207+0000 mgr.a (mgr.14388) 8374 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:54 smithi027 bash[22610]: cluster 2024-08-31T05:24:52.826207+0000 mgr.a (mgr.14388) 8374 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:54 smithi191 bash[24992]: cluster 2024-08-31T05:24:52.826207+0000 mgr.a (mgr.14388) 8374 : cluster [DBG] pgmap v5804: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:56.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:24:56.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:24:56.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:24:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:56 smithi163 bash[24253]: cluster 2024-08-31T05:24:54.828482+0000 mgr.a (mgr.14388) 8375 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:56 smithi027 bash[22610]: cluster 2024-08-31T05:24:54.828482+0000 mgr.a (mgr.14388) 8375 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:56 smithi191 bash[24992]: cluster 2024-08-31T05:24:54.828482+0000 mgr.a (mgr.14388) 8375 : cluster [DBG] pgmap v5805: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:24:57.133 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:24:57.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:24:57.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:24:57.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:24:57.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:24:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:58 smithi163 bash[24253]: audit 2024-08-31T05:24:56.715586+0000 mgr.a (mgr.14388) 8376 : audit [DBG] from='client.187977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:58.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:24:58 smithi163 bash[24253]: cluster 2024-08-31T05:24:56.828948+0000 mgr.a (mgr.14388) 8377 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:58 smithi027 bash[22610]: audit 2024-08-31T05:24:56.715586+0000 mgr.a (mgr.14388) 8376 : audit [DBG] from='client.187977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:24:58 smithi027 bash[22610]: cluster 2024-08-31T05:24:56.828948+0000 mgr.a (mgr.14388) 8377 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:24:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:58 smithi191 bash[24992]: audit 2024-08-31T05:24:56.715586+0000 mgr.a (mgr.14388) 8376 : audit [DBG] from='client.187977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:24:58 smithi191 bash[24992]: cluster 2024-08-31T05:24:56.828948+0000 mgr.a (mgr.14388) 8377 : cluster [DBG] pgmap v5806: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:00 smithi163 bash[24253]: cluster 2024-08-31T05:24:58.831207+0000 mgr.a (mgr.14388) 8378 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:25:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:00 smithi027 bash[22610]: cluster 2024-08-31T05:24:58.831207+0000 mgr.a (mgr.14388) 8378 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:25:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:00 smithi191 bash[24992]: cluster 2024-08-31T05:24:58.831207+0000 mgr.a (mgr.14388) 8378 : cluster [DBG] pgmap v5807: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:25:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:25:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:25:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:25:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:02 smithi163 bash[24253]: cluster 2024-08-31T05:25:00.831992+0000 mgr.a (mgr.14388) 8379 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:02 smithi027 bash[22610]: cluster 2024-08-31T05:25:00.831992+0000 mgr.a (mgr.14388) 8379 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:02 smithi191 bash[24992]: cluster 2024-08-31T05:25:00.831992+0000 mgr.a (mgr.14388) 8379 : cluster [DBG] pgmap v5808: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:02.914 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:25:02.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:25:02.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:25:02.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:25:02.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:25:04.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:04 smithi163 bash[24253]: audit 2024-08-31T05:25:02.476907+0000 mgr.a (mgr.14388) 8380 : audit [DBG] from='client.188055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:04.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:04 smithi163 bash[24253]: cluster 2024-08-31T05:25:02.832531+0000 mgr.a (mgr.14388) 8381 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:04 smithi027 bash[22610]: audit 2024-08-31T05:25:02.476907+0000 mgr.a (mgr.14388) 8380 : audit [DBG] from='client.188055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:04 smithi027 bash[22610]: cluster 2024-08-31T05:25:02.832531+0000 mgr.a (mgr.14388) 8381 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:04 smithi191 bash[24992]: audit 2024-08-31T05:25:02.476907+0000 mgr.a (mgr.14388) 8380 : audit [DBG] from='client.188055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:04 smithi191 bash[24992]: cluster 2024-08-31T05:25:02.832531+0000 mgr.a (mgr.14388) 8381 : cluster [DBG] pgmap v5809: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:06 smithi163 bash[24253]: cluster 2024-08-31T05:25:04.834889+0000 mgr.a (mgr.14388) 8382 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:25:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:06 smithi027 bash[22610]: cluster 2024-08-31T05:25:04.834889+0000 mgr.a (mgr.14388) 8382 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:25:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:06 smithi191 bash[24992]: cluster 2024-08-31T05:25:04.834889+0000 mgr.a (mgr.14388) 8382 : cluster [DBG] pgmap v5810: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:25:07.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:25:07.916 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:25:07.916 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:25:08.691 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:25:08.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:25:08.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:25:08.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:25:08.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:25:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:08 smithi163 bash[24253]: cluster 2024-08-31T05:25:06.835629+0000 mgr.a (mgr.14388) 8383 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:08 smithi027 bash[22610]: cluster 2024-08-31T05:25:06.835629+0000 mgr.a (mgr.14388) 8383 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:08 smithi191 bash[24992]: cluster 2024-08-31T05:25:06.835629+0000 mgr.a (mgr.14388) 8383 : cluster [DBG] pgmap v5811: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:09 smithi163 bash[24253]: audit 2024-08-31T05:25:08.252485+0000 mgr.a (mgr.14388) 8384 : audit [DBG] from='client.188130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:09 smithi027 bash[22610]: audit 2024-08-31T05:25:08.252485+0000 mgr.a (mgr.14388) 8384 : audit [DBG] from='client.188130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:09 smithi191 bash[24992]: audit 2024-08-31T05:25:08.252485+0000 mgr.a (mgr.14388) 8384 : audit [DBG] from='client.188130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:10 smithi163 bash[24253]: cluster 2024-08-31T05:25:08.838804+0000 mgr.a (mgr.14388) 8385 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:10 smithi027 bash[22610]: cluster 2024-08-31T05:25:08.838804+0000 mgr.a (mgr.14388) 8385 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:10 smithi191 bash[24992]: cluster 2024-08-31T05:25:08.838804+0000 mgr.a (mgr.14388) 8385 : cluster [DBG] pgmap v5812: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:12 smithi163 bash[24253]: cluster 2024-08-31T05:25:10.839571+0000 mgr.a (mgr.14388) 8386 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:12 smithi027 bash[22610]: cluster 2024-08-31T05:25:10.839571+0000 mgr.a (mgr.14388) 8386 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:12 smithi191 bash[24992]: cluster 2024-08-31T05:25:10.839571+0000 mgr.a (mgr.14388) 8386 : cluster [DBG] pgmap v5813: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:13.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:25:13.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:25:13.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:25:14.474 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:25:14.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:25:14.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:25:14.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:25:14.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:25:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:14 smithi163 bash[24253]: cluster 2024-08-31T05:25:12.840336+0000 mgr.a (mgr.14388) 8387 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:25:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:14 smithi027 bash[22610]: cluster 2024-08-31T05:25:12.840336+0000 mgr.a (mgr.14388) 8387 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:25:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:14 smithi191 bash[24992]: cluster 2024-08-31T05:25:12.840336+0000 mgr.a (mgr.14388) 8387 : cluster [DBG] pgmap v5814: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:25:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:15 smithi163 bash[24253]: audit 2024-08-31T05:25:14.031379+0000 mgr.a (mgr.14388) 8388 : audit [DBG] from='client.188208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:15 smithi027 bash[22610]: audit 2024-08-31T05:25:14.031379+0000 mgr.a (mgr.14388) 8388 : audit [DBG] from='client.188208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:15 smithi191 bash[24992]: audit 2024-08-31T05:25:14.031379+0000 mgr.a (mgr.14388) 8388 : audit [DBG] from='client.188208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:16 smithi163 bash[24253]: cluster 2024-08-31T05:25:14.843135+0000 mgr.a (mgr.14388) 8389 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:16 smithi027 bash[22610]: cluster 2024-08-31T05:25:14.843135+0000 mgr.a (mgr.14388) 8389 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:16 smithi191 bash[24992]: cluster 2024-08-31T05:25:14.843135+0000 mgr.a (mgr.14388) 8389 : cluster [DBG] pgmap v5815: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:17 smithi163 bash[24253]: cluster 2024-08-31T05:25:16.844022+0000 mgr.a (mgr.14388) 8390 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:17 smithi027 bash[22610]: cluster 2024-08-31T05:25:16.844022+0000 mgr.a (mgr.14388) 8390 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:17 smithi191 bash[24992]: cluster 2024-08-31T05:25:16.844022+0000 mgr.a (mgr.14388) 8390 : cluster [DBG] pgmap v5816: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:19.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:25:19.476 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:25:19.476 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:25:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:19 smithi163 bash[24253]: cluster 2024-08-31T05:25:18.846080+0000 mgr.a (mgr.14388) 8391 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:20.229 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:25:20.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:25:20.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:25:20.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:25:20.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:25:20.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:19 smithi027 bash[22610]: cluster 2024-08-31T05:25:18.846080+0000 mgr.a (mgr.14388) 8391 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:19 smithi191 bash[24992]: cluster 2024-08-31T05:25:18.846080+0000 mgr.a (mgr.14388) 8391 : cluster [DBG] pgmap v5817: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:20 smithi163 bash[24253]: audit 2024-08-31T05:25:19.805704+0000 mgr.a (mgr.14388) 8392 : audit [DBG] from='client.188280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:20 smithi027 bash[22610]: audit 2024-08-31T05:25:19.805704+0000 mgr.a (mgr.14388) 8392 : audit [DBG] from='client.188280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:20 smithi191 bash[24992]: audit 2024-08-31T05:25:19.805704+0000 mgr.a (mgr.14388) 8392 : audit [DBG] from='client.188280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:21 smithi163 bash[24253]: cluster 2024-08-31T05:25:20.847139+0000 mgr.a (mgr.14388) 8393 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:21 smithi027 bash[22610]: cluster 2024-08-31T05:25:20.847139+0000 mgr.a (mgr.14388) 8393 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:21 smithi191 bash[24992]: cluster 2024-08-31T05:25:20.847139+0000 mgr.a (mgr.14388) 8393 : cluster [DBG] pgmap v5818: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:23 smithi163 bash[24253]: cluster 2024-08-31T05:25:22.848066+0000 mgr.a (mgr.14388) 8394 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:23 smithi163 bash[24253]: audit 2024-08-31T05:25:23.797341+0000 mon.a (mon.0) 1837 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:23 smithi027 bash[22610]: cluster 2024-08-31T05:25:22.848066+0000 mgr.a (mgr.14388) 8394 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:23 smithi027 bash[22610]: audit 2024-08-31T05:25:23.797341+0000 mon.a (mon.0) 1837 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:23 smithi191 bash[24992]: cluster 2024-08-31T05:25:22.848066+0000 mgr.a (mgr.14388) 8394 : cluster [DBG] pgmap v5819: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:23 smithi191 bash[24992]: audit 2024-08-31T05:25:23.797341+0000 mon.a (mon.0) 1837 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:25:25.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:25:25.231 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:25:25.231 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:25:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:25 smithi163 bash[24253]: audit 2024-08-31T05:25:24.424280+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:25:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:25 smithi163 bash[24253]: audit 2024-08-31T05:25:24.428765+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:25:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:25 smithi163 bash[24253]: cluster 2024-08-31T05:25:24.849441+0000 mgr.a (mgr.14388) 8395 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:25:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:25 smithi163 bash[24253]: audit 2024-08-31T05:25:25.232525+0000 mon.a (mon.0) 1840 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:25 smithi163 bash[24253]: audit 2024-08-31T05:25:25.234397+0000 mon.a (mon.0) 1841 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:25:25.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:25 smithi163 bash[24253]: audit 2024-08-31T05:25:25.244006+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:25:25.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:25 smithi163 bash[24253]: audit 2024-08-31T05:25:25.247217+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:25:25.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:25 smithi163 bash[24253]: audit 2024-08-31T05:25:25.249457+0000 mgr.a (mgr.14388) 8396 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:25:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:25 smithi027 bash[22610]: audit 2024-08-31T05:25:24.424280+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:25:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:25 smithi027 bash[22610]: audit 2024-08-31T05:25:24.428765+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:25:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:25 smithi027 bash[22610]: cluster 2024-08-31T05:25:24.849441+0000 mgr.a (mgr.14388) 8395 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:25:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:25 smithi027 bash[22610]: audit 2024-08-31T05:25:25.232525+0000 mon.a (mon.0) 1840 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:25 smithi027 bash[22610]: audit 2024-08-31T05:25:25.234397+0000 mon.a (mon.0) 1841 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:25:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:25 smithi027 bash[22610]: audit 2024-08-31T05:25:25.244006+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:25:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:25 smithi027 bash[22610]: audit 2024-08-31T05:25:25.247217+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:25:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:25 smithi027 bash[22610]: audit 2024-08-31T05:25:25.249457+0000 mgr.a (mgr.14388) 8396 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:25:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:25 smithi191 bash[24992]: audit 2024-08-31T05:25:24.424280+0000 mon.a (mon.0) 1838 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:25:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:25 smithi191 bash[24992]: audit 2024-08-31T05:25:24.428765+0000 mon.a (mon.0) 1839 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:25:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:25 smithi191 bash[24992]: cluster 2024-08-31T05:25:24.849441+0000 mgr.a (mgr.14388) 8395 : cluster [DBG] pgmap v5820: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:25:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:25 smithi191 bash[24992]: audit 2024-08-31T05:25:25.232525+0000 mon.a (mon.0) 1840 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:25:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:25 smithi191 bash[24992]: audit 2024-08-31T05:25:25.234397+0000 mon.a (mon.0) 1841 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:25:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:25 smithi191 bash[24992]: audit 2024-08-31T05:25:25.244006+0000 mon.a (mon.0) 1842 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:25:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:25 smithi191 bash[24992]: audit 2024-08-31T05:25:25.247217+0000 mon.a (mon.0) 1843 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:25:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:25 smithi191 bash[24992]: audit 2024-08-31T05:25:25.249457+0000 mgr.a (mgr.14388) 8396 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:25:26.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:25:26.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:25:26.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:25:26.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:25:26.379 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:25:26.431 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:25:25 smithi027 bash[22863]: debug 2024-08-31T05:25:25.978+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:25:26.432 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:25:25 smithi027 bash[22863]: debug 2024-08-31T05:25:25.986+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:25:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:26 smithi163 bash[24253]: audit 2024-08-31T05:25:25.580225+0000 mgr.a (mgr.14388) 8397 : audit [DBG] from='client.188361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:26 smithi163 bash[24253]: audit 2024-08-31T05:25:25.983592+0000 mgr.a (mgr.14388) 8398 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:25:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:26 smithi163 bash[24253]: cephadm 2024-08-31T05:25:25.994523+0000 mgr.a (mgr.14388) 8399 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:25:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:26 smithi027 bash[22610]: audit 2024-08-31T05:25:25.580225+0000 mgr.a (mgr.14388) 8397 : audit [DBG] from='client.188361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:26 smithi027 bash[22610]: audit 2024-08-31T05:25:25.983592+0000 mgr.a (mgr.14388) 8398 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:25:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:26 smithi027 bash[22610]: cephadm 2024-08-31T05:25:25.994523+0000 mgr.a (mgr.14388) 8399 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:25:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:26 smithi191 bash[24992]: audit 2024-08-31T05:25:25.580225+0000 mgr.a (mgr.14388) 8397 : audit [DBG] from='client.188361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:26 smithi191 bash[24992]: audit 2024-08-31T05:25:25.983592+0000 mgr.a (mgr.14388) 8398 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:25:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:26 smithi191 bash[24992]: cephadm 2024-08-31T05:25:25.994523+0000 mgr.a (mgr.14388) 8399 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:25:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:27 smithi163 bash[24253]: cluster 2024-08-31T05:25:26.850438+0000 mgr.a (mgr.14388) 8400 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:27 smithi027 bash[22610]: cluster 2024-08-31T05:25:26.850438+0000 mgr.a (mgr.14388) 8400 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:27.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:27 smithi191 bash[24992]: cluster 2024-08-31T05:25:26.850438+0000 mgr.a (mgr.14388) 8400 : cluster [DBG] pgmap v5821: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:29 smithi163 bash[24253]: cluster 2024-08-31T05:25:28.852784+0000 mgr.a (mgr.14388) 8401 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:29 smithi027 bash[22610]: cluster 2024-08-31T05:25:28.852784+0000 mgr.a (mgr.14388) 8401 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:29 smithi191 bash[24992]: cluster 2024-08-31T05:25:28.852784+0000 mgr.a (mgr.14388) 8401 : cluster [DBG] pgmap v5822: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:31.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:25:31.381 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:25:31.381 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:25:32.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:25:32.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:25:32.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:25:32.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:25:32.122 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:25:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:31 smithi163 bash[24253]: cluster 2024-08-31T05:25:30.853587+0000 mgr.a (mgr.14388) 8402 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:31 smithi027 bash[22610]: cluster 2024-08-31T05:25:30.853587+0000 mgr.a (mgr.14388) 8402 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:31 smithi191 bash[24992]: cluster 2024-08-31T05:25:30.853587+0000 mgr.a (mgr.14388) 8402 : cluster [DBG] pgmap v5823: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:32 smithi163 bash[24253]: audit 2024-08-31T05:25:31.711984+0000 mgr.a (mgr.14388) 8403 : audit [DBG] from='client.188544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:32 smithi027 bash[22610]: audit 2024-08-31T05:25:31.711984+0000 mgr.a (mgr.14388) 8403 : audit [DBG] from='client.188544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:32 smithi191 bash[24992]: audit 2024-08-31T05:25:31.711984+0000 mgr.a (mgr.14388) 8403 : audit [DBG] from='client.188544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:33 smithi163 bash[24253]: cluster 2024-08-31T05:25:32.854441+0000 mgr.a (mgr.14388) 8404 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:33 smithi027 bash[22610]: cluster 2024-08-31T05:25:32.854441+0000 mgr.a (mgr.14388) 8404 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:33 smithi191 bash[24992]: cluster 2024-08-31T05:25:32.854441+0000 mgr.a (mgr.14388) 8404 : cluster [DBG] pgmap v5824: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:35 smithi163 bash[24253]: cluster 2024-08-31T05:25:34.856731+0000 mgr.a (mgr.14388) 8405 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:35 smithi027 bash[22610]: cluster 2024-08-31T05:25:34.856731+0000 mgr.a (mgr.14388) 8405 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:35 smithi191 bash[24992]: cluster 2024-08-31T05:25:34.856731+0000 mgr.a (mgr.14388) 8405 : cluster [DBG] pgmap v5825: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:37.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:25:37.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:25:37.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:25:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:25:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:25:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:25:37.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:25:37.865 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:25:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:37 smithi163 bash[24253]: cluster 2024-08-31T05:25:36.857477+0000 mgr.a (mgr.14388) 8406 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:37 smithi027 bash[22610]: cluster 2024-08-31T05:25:36.857477+0000 mgr.a (mgr.14388) 8406 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:37 smithi191 bash[24992]: cluster 2024-08-31T05:25:36.857477+0000 mgr.a (mgr.14388) 8406 : cluster [DBG] pgmap v5826: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:38 smithi163 bash[24253]: audit 2024-08-31T05:25:37.457133+0000 mgr.a (mgr.14388) 8407 : audit [DBG] from='client.188622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:39.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:38 smithi027 bash[22610]: audit 2024-08-31T05:25:37.457133+0000 mgr.a (mgr.14388) 8407 : audit [DBG] from='client.188622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:38 smithi191 bash[24992]: audit 2024-08-31T05:25:37.457133+0000 mgr.a (mgr.14388) 8407 : audit [DBG] from='client.188622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:39 smithi163 bash[24253]: cluster 2024-08-31T05:25:38.859792+0000 mgr.a (mgr.14388) 8408 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:39 smithi027 bash[22610]: cluster 2024-08-31T05:25:38.859792+0000 mgr.a (mgr.14388) 8408 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:39 smithi191 bash[24992]: cluster 2024-08-31T05:25:38.859792+0000 mgr.a (mgr.14388) 8408 : cluster [DBG] pgmap v5827: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:25:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:41 smithi163 bash[24253]: cluster 2024-08-31T05:25:40.860564+0000 mgr.a (mgr.14388) 8409 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:41 smithi027 bash[22610]: cluster 2024-08-31T05:25:40.860564+0000 mgr.a (mgr.14388) 8409 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:41 smithi191 bash[24992]: cluster 2024-08-31T05:25:40.860564+0000 mgr.a (mgr.14388) 8409 : cluster [DBG] pgmap v5828: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:42.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:25:42.867 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:25:42.867 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:25:43.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:25:43.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:25:43.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:25:43.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:25:43.638 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:25:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:43 smithi027 bash[22610]: cluster 2024-08-31T05:25:42.861351+0000 mgr.a (mgr.14388) 8410 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:43 smithi027 bash[22610]: audit 2024-08-31T05:25:43.205703+0000 mgr.a (mgr.14388) 8411 : audit [DBG] from='client.188694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:43 smithi191 bash[24992]: cluster 2024-08-31T05:25:42.861351+0000 mgr.a (mgr.14388) 8410 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:43 smithi191 bash[24992]: audit 2024-08-31T05:25:43.205703+0000 mgr.a (mgr.14388) 8411 : audit [DBG] from='client.188694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:43 smithi163 bash[24253]: cluster 2024-08-31T05:25:42.861351+0000 mgr.a (mgr.14388) 8410 : cluster [DBG] pgmap v5829: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:43 smithi163 bash[24253]: audit 2024-08-31T05:25:43.205703+0000 mgr.a (mgr.14388) 8411 : audit [DBG] from='client.188694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:46.254 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:45 smithi027 bash[22610]: cluster 2024-08-31T05:25:44.864246+0000 mgr.a (mgr.14388) 8412 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:46.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:45 smithi191 bash[24992]: cluster 2024-08-31T05:25:44.864246+0000 mgr.a (mgr.14388) 8412 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:46.454 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:45 smithi163 bash[24253]: cluster 2024-08-31T05:25:44.864246+0000 mgr.a (mgr.14388) 8412 : cluster [DBG] pgmap v5830: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:47 smithi027 bash[22610]: cluster 2024-08-31T05:25:46.865203+0000 mgr.a (mgr.14388) 8413 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:47 smithi191 bash[24992]: cluster 2024-08-31T05:25:46.865203+0000 mgr.a (mgr.14388) 8413 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:47 smithi163 bash[24253]: cluster 2024-08-31T05:25:46.865203+0000 mgr.a (mgr.14388) 8413 : cluster [DBG] pgmap v5831: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:48.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:25:48.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:25:48.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:25:49.420 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:25:49.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:25:49.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:25:49.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:25:49.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:25:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:49 smithi027 bash[22610]: cluster 2024-08-31T05:25:48.867173+0000 mgr.a (mgr.14388) 8414 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:49 smithi027 bash[22610]: audit 2024-08-31T05:25:48.974872+0000 mgr.a (mgr.14388) 8415 : audit [DBG] from='client.188772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:49 smithi191 bash[24992]: cluster 2024-08-31T05:25:48.867173+0000 mgr.a (mgr.14388) 8414 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:49 smithi191 bash[24992]: audit 2024-08-31T05:25:48.974872+0000 mgr.a (mgr.14388) 8415 : audit [DBG] from='client.188772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:49 smithi163 bash[24253]: cluster 2024-08-31T05:25:48.867173+0000 mgr.a (mgr.14388) 8414 : cluster [DBG] pgmap v5832: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:49 smithi163 bash[24253]: audit 2024-08-31T05:25:48.974872+0000 mgr.a (mgr.14388) 8415 : audit [DBG] from='client.188772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:51 smithi027 bash[22610]: cluster 2024-08-31T05:25:50.868066+0000 mgr.a (mgr.14388) 8416 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:51 smithi191 bash[24992]: cluster 2024-08-31T05:25:50.868066+0000 mgr.a (mgr.14388) 8416 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:51 smithi163 bash[24253]: cluster 2024-08-31T05:25:50.868066+0000 mgr.a (mgr.14388) 8416 : cluster [DBG] pgmap v5833: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:25:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:53 smithi027 bash[22610]: cluster 2024-08-31T05:25:52.868833+0000 mgr.a (mgr.14388) 8417 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:25:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:53 smithi191 bash[24992]: cluster 2024-08-31T05:25:52.868833+0000 mgr.a (mgr.14388) 8417 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:25:54.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:25:54.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:25:54.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:25:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:53 smithi163 bash[24253]: cluster 2024-08-31T05:25:52.868833+0000 mgr.a (mgr.14388) 8417 : cluster [DBG] pgmap v5834: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:25:55.197 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:25:55.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:25:55.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:25:55.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:25:55.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:25:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:55 smithi027 bash[22610]: audit 2024-08-31T05:25:54.765490+0000 mgr.a (mgr.14388) 8418 : audit [DBG] from='client.188847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:55 smithi027 bash[22610]: cluster 2024-08-31T05:25:54.870085+0000 mgr.a (mgr.14388) 8419 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:55 smithi191 bash[24992]: audit 2024-08-31T05:25:54.765490+0000 mgr.a (mgr.14388) 8418 : audit [DBG] from='client.188847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:55 smithi191 bash[24992]: cluster 2024-08-31T05:25:54.870085+0000 mgr.a (mgr.14388) 8419 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:55 smithi163 bash[24253]: audit 2024-08-31T05:25:54.765490+0000 mgr.a (mgr.14388) 8418 : audit [DBG] from='client.188847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:55 smithi163 bash[24253]: cluster 2024-08-31T05:25:54.870085+0000 mgr.a (mgr.14388) 8419 : cluster [DBG] pgmap v5835: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:57 smithi191 bash[24992]: cluster 2024-08-31T05:25:56.871051+0000 mgr.a (mgr.14388) 8420 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:57 smithi163 bash[24253]: cluster 2024-08-31T05:25:56.871051+0000 mgr.a (mgr.14388) 8420 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:25:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:57 smithi027 bash[22610]: cluster 2024-08-31T05:25:56.871051+0000 mgr.a (mgr.14388) 8420 : cluster [DBG] pgmap v5836: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:00.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:00.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:00.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:25:59 smithi191 bash[24992]: cluster 2024-08-31T05:25:58.873303+0000 mgr.a (mgr.14388) 8421 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:25:59 smithi163 bash[24253]: cluster 2024-08-31T05:25:58.873303+0000 mgr.a (mgr.14388) 8421 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:25:59 smithi027 bash[22610]: cluster 2024-08-31T05:25:58.873303+0000 mgr.a (mgr.14388) 8421 : cluster [DBG] pgmap v5837: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:00.981 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:00.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:00.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:01 smithi191 bash[24992]: audit 2024-08-31T05:26:00.535621+0000 mgr.a (mgr.14388) 8422 : audit [DBG] from='client.188922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:01 smithi191 bash[24992]: cluster 2024-08-31T05:26:00.879836+0000 mgr.a (mgr.14388) 8423 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:01 smithi163 bash[24253]: audit 2024-08-31T05:26:00.535621+0000 mgr.a (mgr.14388) 8422 : audit [DBG] from='client.188922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:01 smithi163 bash[24253]: cluster 2024-08-31T05:26:00.879836+0000 mgr.a (mgr.14388) 8423 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:01 smithi027 bash[22610]: audit 2024-08-31T05:26:00.535621+0000 mgr.a (mgr.14388) 8422 : audit [DBG] from='client.188922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:01 smithi027 bash[22610]: cluster 2024-08-31T05:26:00.879836+0000 mgr.a (mgr.14388) 8423 : cluster [DBG] pgmap v5838: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:03 smithi191 bash[24992]: cluster 2024-08-31T05:26:02.880678+0000 mgr.a (mgr.14388) 8424 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:03 smithi163 bash[24253]: cluster 2024-08-31T05:26:02.880678+0000 mgr.a (mgr.14388) 8424 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:03 smithi027 bash[22610]: cluster 2024-08-31T05:26:02.880678+0000 mgr.a (mgr.14388) 8424 : cluster [DBG] pgmap v5839: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:05.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:05.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:05.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:06 smithi191 bash[24992]: cluster 2024-08-31T05:26:04.882923+0000 mgr.a (mgr.14388) 8425 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:06 smithi163 bash[24253]: cluster 2024-08-31T05:26:04.882923+0000 mgr.a (mgr.14388) 8425 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:06 smithi027 bash[22610]: cluster 2024-08-31T05:26:04.882923+0000 mgr.a (mgr.14388) 8425 : cluster [DBG] pgmap v5840: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:06.727 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:06.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:06.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:07 smithi191 bash[24992]: audit 2024-08-31T05:26:06.314102+0000 mgr.a (mgr.14388) 8426 : audit [DBG] from='client.189000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:07 smithi163 bash[24253]: audit 2024-08-31T05:26:06.314102+0000 mgr.a (mgr.14388) 8426 : audit [DBG] from='client.189000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:07 smithi027 bash[22610]: audit 2024-08-31T05:26:06.314102+0000 mgr.a (mgr.14388) 8426 : audit [DBG] from='client.189000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:08 smithi191 bash[24992]: cluster 2024-08-31T05:26:06.883937+0000 mgr.a (mgr.14388) 8427 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:08 smithi163 bash[24253]: cluster 2024-08-31T05:26:06.883937+0000 mgr.a (mgr.14388) 8427 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:08 smithi027 bash[22610]: cluster 2024-08-31T05:26:06.883937+0000 mgr.a (mgr.14388) 8427 : cluster [DBG] pgmap v5841: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:10 smithi191 bash[24992]: cluster 2024-08-31T05:26:08.886209+0000 mgr.a (mgr.14388) 8428 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:10 smithi163 bash[24253]: cluster 2024-08-31T05:26:08.886209+0000 mgr.a (mgr.14388) 8428 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:10 smithi027 bash[22610]: cluster 2024-08-31T05:26:08.886209+0000 mgr.a (mgr.14388) 8428 : cluster [DBG] pgmap v5842: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:11.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:11.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:12 smithi191 bash[24992]: cluster 2024-08-31T05:26:10.887021+0000 mgr.a (mgr.14388) 8429 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:12 smithi163 bash[24253]: cluster 2024-08-31T05:26:10.887021+0000 mgr.a (mgr.14388) 8429 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:12 smithi027 bash[22610]: cluster 2024-08-31T05:26:10.887021+0000 mgr.a (mgr.14388) 8429 : cluster [DBG] pgmap v5843: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:12.493 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:12.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:12.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:12.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:12.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:13 smithi191 bash[24992]: audit 2024-08-31T05:26:12.067828+0000 mgr.a (mgr.14388) 8430 : audit [DBG] from='client.189078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:13 smithi163 bash[24253]: audit 2024-08-31T05:26:12.067828+0000 mgr.a (mgr.14388) 8430 : audit [DBG] from='client.189078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:13 smithi027 bash[22610]: audit 2024-08-31T05:26:12.067828+0000 mgr.a (mgr.14388) 8430 : audit [DBG] from='client.189078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:14 smithi191 bash[24992]: cluster 2024-08-31T05:26:12.887877+0000 mgr.a (mgr.14388) 8431 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:14 smithi163 bash[24253]: cluster 2024-08-31T05:26:12.887877+0000 mgr.a (mgr.14388) 8431 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:14 smithi027 bash[22610]: cluster 2024-08-31T05:26:12.887877+0000 mgr.a (mgr.14388) 8431 : cluster [DBG] pgmap v5844: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:16 smithi191 bash[24992]: cluster 2024-08-31T05:26:14.890110+0000 mgr.a (mgr.14388) 8432 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:16 smithi163 bash[24253]: cluster 2024-08-31T05:26:14.890110+0000 mgr.a (mgr.14388) 8432 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:16 smithi027 bash[22610]: cluster 2024-08-31T05:26:14.890110+0000 mgr.a (mgr.14388) 8432 : cluster [DBG] pgmap v5845: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:17.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:17.496 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:17.496 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:18.251 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:18.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:18.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:18.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:18.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:18 smithi163 bash[24253]: cluster 2024-08-31T05:26:16.890905+0000 mgr.a (mgr.14388) 8433 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:18 smithi027 bash[22610]: cluster 2024-08-31T05:26:16.890905+0000 mgr.a (mgr.14388) 8433 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:18 smithi191 bash[24992]: cluster 2024-08-31T05:26:16.890905+0000 mgr.a (mgr.14388) 8433 : cluster [DBG] pgmap v5846: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:19 smithi163 bash[24253]: audit 2024-08-31T05:26:17.827407+0000 mgr.a (mgr.14388) 8434 : audit [DBG] from='client.189156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:19 smithi027 bash[22610]: audit 2024-08-31T05:26:17.827407+0000 mgr.a (mgr.14388) 8434 : audit [DBG] from='client.189156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:19 smithi191 bash[24992]: audit 2024-08-31T05:26:17.827407+0000 mgr.a (mgr.14388) 8434 : audit [DBG] from='client.189156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:20 smithi163 bash[24253]: cluster 2024-08-31T05:26:18.893768+0000 mgr.a (mgr.14388) 8435 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:20 smithi027 bash[22610]: cluster 2024-08-31T05:26:18.893768+0000 mgr.a (mgr.14388) 8435 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:20 smithi191 bash[24992]: cluster 2024-08-31T05:26:18.893768+0000 mgr.a (mgr.14388) 8435 : cluster [DBG] pgmap v5847: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:22 smithi163 bash[24253]: cluster 2024-08-31T05:26:20.894686+0000 mgr.a (mgr.14388) 8436 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:26:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:22 smithi027 bash[22610]: cluster 2024-08-31T05:26:20.894686+0000 mgr.a (mgr.14388) 8436 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:26:22.542 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:22 smithi191 bash[24992]: cluster 2024-08-31T05:26:20.894686+0000 mgr.a (mgr.14388) 8436 : cluster [DBG] pgmap v5848: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:26:23.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:23.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:23.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:24.032 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:24.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:24 smithi163 bash[24253]: cluster 2024-08-31T05:26:22.895580+0000 mgr.a (mgr.14388) 8437 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:26:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:24 smithi027 bash[22610]: cluster 2024-08-31T05:26:22.895580+0000 mgr.a (mgr.14388) 8437 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:26:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:24 smithi191 bash[24992]: cluster 2024-08-31T05:26:22.895580+0000 mgr.a (mgr.14388) 8437 : cluster [DBG] pgmap v5849: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:26:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:25 smithi163 bash[24253]: audit 2024-08-31T05:26:23.588317+0000 mgr.a (mgr.14388) 8438 : audit [DBG] from='client.189234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:25 smithi027 bash[22610]: audit 2024-08-31T05:26:23.588317+0000 mgr.a (mgr.14388) 8438 : audit [DBG] from='client.189234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:25 smithi191 bash[24992]: audit 2024-08-31T05:26:23.588317+0000 mgr.a (mgr.14388) 8438 : audit [DBG] from='client.189234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:26 smithi163 bash[24253]: cluster 2024-08-31T05:26:24.898493+0000 mgr.a (mgr.14388) 8439 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:26 smithi163 bash[24253]: audit 2024-08-31T05:26:26.048287+0000 mon.a (mon.0) 1844 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:26:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:26 smithi027 bash[22610]: cluster 2024-08-31T05:26:24.898493+0000 mgr.a (mgr.14388) 8439 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:26 smithi027 bash[22610]: audit 2024-08-31T05:26:26.048287+0000 mon.a (mon.0) 1844 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:26:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:26 smithi191 bash[24992]: cluster 2024-08-31T05:26:24.898493+0000 mgr.a (mgr.14388) 8439 : cluster [DBG] pgmap v5850: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:26 smithi191 bash[24992]: audit 2024-08-31T05:26:26.048287+0000 mon.a (mon.0) 1844 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:26:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:27 smithi163 bash[24253]: audit 2024-08-31T05:26:26.660687+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:27 smithi163 bash[24253]: audit 2024-08-31T05:26:26.666853+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:27 smithi163 bash[24253]: audit 2024-08-31T05:26:26.674317+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:27 smithi163 bash[24253]: audit 2024-08-31T05:26:26.680977+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:27 smithi163 bash[24253]: cluster 2024-08-31T05:26:26.899276+0000 mgr.a (mgr.14388) 8440 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:26:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:27 smithi163 bash[24253]: audit 2024-08-31T05:26:27.508619+0000 mon.a (mon.0) 1849 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:26:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:27 smithi163 bash[24253]: audit 2024-08-31T05:26:27.510202+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:26:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:27 smithi163 bash[24253]: audit 2024-08-31T05:26:27.520439+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:27 smithi163 bash[24253]: audit 2024-08-31T05:26:27.525722+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:26:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:27 smithi027 bash[22610]: audit 2024-08-31T05:26:26.660687+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:27 smithi027 bash[22610]: audit 2024-08-31T05:26:26.666853+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:27 smithi027 bash[22610]: audit 2024-08-31T05:26:26.674317+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:27 smithi027 bash[22610]: audit 2024-08-31T05:26:26.680977+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:27 smithi027 bash[22610]: cluster 2024-08-31T05:26:26.899276+0000 mgr.a (mgr.14388) 8440 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:26:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:27 smithi027 bash[22610]: audit 2024-08-31T05:26:27.508619+0000 mon.a (mon.0) 1849 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:26:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:27 smithi027 bash[22610]: audit 2024-08-31T05:26:27.510202+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:26:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:27 smithi027 bash[22610]: audit 2024-08-31T05:26:27.520439+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:27 smithi027 bash[22610]: audit 2024-08-31T05:26:27.525722+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:26:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:27 smithi191 bash[24992]: audit 2024-08-31T05:26:26.660687+0000 mon.a (mon.0) 1845 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:27 smithi191 bash[24992]: audit 2024-08-31T05:26:26.666853+0000 mon.a (mon.0) 1846 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:27 smithi191 bash[24992]: audit 2024-08-31T05:26:26.674317+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:27 smithi191 bash[24992]: audit 2024-08-31T05:26:26.680977+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:27 smithi191 bash[24992]: cluster 2024-08-31T05:26:26.899276+0000 mgr.a (mgr.14388) 8440 : cluster [DBG] pgmap v5851: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:26:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:27 smithi191 bash[24992]: audit 2024-08-31T05:26:27.508619+0000 mon.a (mon.0) 1849 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:26:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:27 smithi191 bash[24992]: audit 2024-08-31T05:26:27.510202+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:26:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:27 smithi191 bash[24992]: audit 2024-08-31T05:26:27.520439+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:26:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:27 smithi191 bash[24992]: audit 2024-08-31T05:26:27.525722+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:26:28.680 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:26:28 smithi027 bash[22863]: debug 2024-08-31T05:26:28.253+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:26:28.681 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:26:28 smithi027 bash[22863]: debug 2024-08-31T05:26:28.257+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:26:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:28 smithi163 bash[24253]: audit 2024-08-31T05:26:27.528164+0000 mgr.a (mgr.14388) 8441 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:26:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:28 smithi163 bash[24253]: audit 2024-08-31T05:26:28.257436+0000 mgr.a (mgr.14388) 8442 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:26:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:28 smithi163 bash[24253]: cephadm 2024-08-31T05:26:28.259136+0000 mgr.a (mgr.14388) 8443 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:26:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:28 smithi027 bash[22610]: audit 2024-08-31T05:26:27.528164+0000 mgr.a (mgr.14388) 8441 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:26:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:28 smithi027 bash[22610]: audit 2024-08-31T05:26:28.257436+0000 mgr.a (mgr.14388) 8442 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:26:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:28 smithi027 bash[22610]: cephadm 2024-08-31T05:26:28.259136+0000 mgr.a (mgr.14388) 8443 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:26:29.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:29.034 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:29.034 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:28 smithi191 bash[24992]: audit 2024-08-31T05:26:27.528164+0000 mgr.a (mgr.14388) 8441 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:26:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:28 smithi191 bash[24992]: audit 2024-08-31T05:26:28.257436+0000 mgr.a (mgr.14388) 8442 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:26:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:28 smithi191 bash[24992]: cephadm 2024-08-31T05:26:28.259136+0000 mgr.a (mgr.14388) 8443 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:26:29.776 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:29 smithi163 bash[24253]: cluster 2024-08-31T05:26:28.902074+0000 mgr.a (mgr.14388) 8444 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:26:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:29 smithi163 bash[24253]: audit 2024-08-31T05:26:29.366625+0000 mgr.a (mgr.14388) 8445 : audit [DBG] from='client.189414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:29 smithi027 bash[22610]: cluster 2024-08-31T05:26:28.902074+0000 mgr.a (mgr.14388) 8444 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:26:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:29 smithi027 bash[22610]: audit 2024-08-31T05:26:29.366625+0000 mgr.a (mgr.14388) 8445 : audit [DBG] from='client.189414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:29 smithi191 bash[24992]: cluster 2024-08-31T05:26:28.902074+0000 mgr.a (mgr.14388) 8444 : cluster [DBG] pgmap v5852: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:26:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:29 smithi191 bash[24992]: audit 2024-08-31T05:26:29.366625+0000 mgr.a (mgr.14388) 8445 : audit [DBG] from='client.189414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:32.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:31 smithi027 bash[22610]: cluster 2024-08-31T05:26:30.903182+0000 mgr.a (mgr.14388) 8446 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:26:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:31 smithi191 bash[24992]: cluster 2024-08-31T05:26:30.903182+0000 mgr.a (mgr.14388) 8446 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:26:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:31 smithi163 bash[24253]: cluster 2024-08-31T05:26:30.903182+0000 mgr.a (mgr.14388) 8446 : cluster [DBG] pgmap v5853: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:26:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:33 smithi027 bash[22610]: cluster 2024-08-31T05:26:32.904034+0000 mgr.a (mgr.14388) 8447 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:26:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:33 smithi191 bash[24992]: cluster 2024-08-31T05:26:32.904034+0000 mgr.a (mgr.14388) 8447 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:26:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:33 smithi163 bash[24253]: cluster 2024-08-31T05:26:32.904034+0000 mgr.a (mgr.14388) 8447 : cluster [DBG] pgmap v5854: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:26:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:34.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:34.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:35.550 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:35.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:35.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:35.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:35.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:35 smithi027 bash[22610]: cluster 2024-08-31T05:26:34.905442+0000 mgr.a (mgr.14388) 8448 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:26:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:35 smithi027 bash[22610]: audit 2024-08-31T05:26:35.118592+0000 mgr.a (mgr.14388) 8449 : audit [DBG] from='client.189489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:35 smithi191 bash[24992]: cluster 2024-08-31T05:26:34.905442+0000 mgr.a (mgr.14388) 8448 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:26:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:35 smithi191 bash[24992]: audit 2024-08-31T05:26:35.118592+0000 mgr.a (mgr.14388) 8449 : audit [DBG] from='client.189489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:35 smithi163 bash[24253]: cluster 2024-08-31T05:26:34.905442+0000 mgr.a (mgr.14388) 8448 : cluster [DBG] pgmap v5855: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:26:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:35 smithi163 bash[24253]: audit 2024-08-31T05:26:35.118592+0000 mgr.a (mgr.14388) 8449 : audit [DBG] from='client.189489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:37 smithi163 bash[24253]: cluster 2024-08-31T05:26:36.906374+0000 mgr.a (mgr.14388) 8450 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:26:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:37 smithi027 bash[22610]: cluster 2024-08-31T05:26:36.906374+0000 mgr.a (mgr.14388) 8450 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:26:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:37 smithi191 bash[24992]: cluster 2024-08-31T05:26:36.906374+0000 mgr.a (mgr.14388) 8450 : cluster [DBG] pgmap v5856: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:26:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:39 smithi027 bash[22610]: cluster 2024-08-31T05:26:38.908572+0000 mgr.a (mgr.14388) 8451 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:26:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:39 smithi191 bash[24992]: cluster 2024-08-31T05:26:38.908572+0000 mgr.a (mgr.14388) 8451 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:26:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:39 smithi163 bash[24253]: cluster 2024-08-31T05:26:38.908572+0000 mgr.a (mgr.14388) 8451 : cluster [DBG] pgmap v5857: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:26:40.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:40.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:40.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:41.317 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:41.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:41.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:41.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:41.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:41 smithi027 bash[22610]: audit 2024-08-31T05:26:40.884312+0000 mgr.a (mgr.14388) 8452 : audit [DBG] from='client.189564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:41 smithi027 bash[22610]: cluster 2024-08-31T05:26:40.909230+0000 mgr.a (mgr.14388) 8453 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:26:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:41 smithi191 bash[24992]: audit 2024-08-31T05:26:40.884312+0000 mgr.a (mgr.14388) 8452 : audit [DBG] from='client.189564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:41 smithi191 bash[24992]: cluster 2024-08-31T05:26:40.909230+0000 mgr.a (mgr.14388) 8453 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:26:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:41 smithi163 bash[24253]: audit 2024-08-31T05:26:40.884312+0000 mgr.a (mgr.14388) 8452 : audit [DBG] from='client.189564 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:41 smithi163 bash[24253]: cluster 2024-08-31T05:26:40.909230+0000 mgr.a (mgr.14388) 8453 : cluster [DBG] pgmap v5858: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:26:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:43 smithi191 bash[24992]: cluster 2024-08-31T05:26:42.910093+0000 mgr.a (mgr.14388) 8454 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:26:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:43 smithi163 bash[24253]: cluster 2024-08-31T05:26:42.910093+0000 mgr.a (mgr.14388) 8454 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:26:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:43 smithi027 bash[22610]: cluster 2024-08-31T05:26:42.910093+0000 mgr.a (mgr.14388) 8454 : cluster [DBG] pgmap v5859: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:26:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:45 smithi191 bash[24992]: cluster 2024-08-31T05:26:44.912331+0000 mgr.a (mgr.14388) 8455 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:26:46.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:46.319 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:46.320 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:45 smithi163 bash[24253]: cluster 2024-08-31T05:26:44.912331+0000 mgr.a (mgr.14388) 8455 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:26:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:45 smithi027 bash[22610]: cluster 2024-08-31T05:26:44.912331+0000 mgr.a (mgr.14388) 8455 : cluster [DBG] pgmap v5860: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:26:47.061 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:47.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:47.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:47.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:47.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:47 smithi191 bash[24992]: audit 2024-08-31T05:26:46.649599+0000 mgr.a (mgr.14388) 8456 : audit [DBG] from='client.189636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:47 smithi191 bash[24992]: cluster 2024-08-31T05:26:46.912823+0000 mgr.a (mgr.14388) 8457 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:47 smithi163 bash[24253]: audit 2024-08-31T05:26:46.649599+0000 mgr.a (mgr.14388) 8456 : audit [DBG] from='client.189636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:47 smithi163 bash[24253]: cluster 2024-08-31T05:26:46.912823+0000 mgr.a (mgr.14388) 8457 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:47 smithi027 bash[22610]: audit 2024-08-31T05:26:46.649599+0000 mgr.a (mgr.14388) 8456 : audit [DBG] from='client.189636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:47 smithi027 bash[22610]: cluster 2024-08-31T05:26:46.912823+0000 mgr.a (mgr.14388) 8457 : cluster [DBG] pgmap v5861: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:49 smithi191 bash[24992]: cluster 2024-08-31T05:26:48.915129+0000 mgr.a (mgr.14388) 8458 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:49 smithi163 bash[24253]: cluster 2024-08-31T05:26:48.915129+0000 mgr.a (mgr.14388) 8458 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:49 smithi027 bash[22610]: cluster 2024-08-31T05:26:48.915129+0000 mgr.a (mgr.14388) 8458 : cluster [DBG] pgmap v5862: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:52.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:52.064 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:52.064 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:52 smithi191 bash[24992]: cluster 2024-08-31T05:26:50.915901+0000 mgr.a (mgr.14388) 8459 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:52 smithi163 bash[24253]: cluster 2024-08-31T05:26:50.915901+0000 mgr.a (mgr.14388) 8459 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:52 smithi027 bash[22610]: cluster 2024-08-31T05:26:50.915901+0000 mgr.a (mgr.14388) 8459 : cluster [DBG] pgmap v5863: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:52.808 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:52.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:52.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:52.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:52.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:54 smithi191 bash[24992]: audit 2024-08-31T05:26:52.396071+0000 mgr.a (mgr.14388) 8460 : audit [DBG] from='client.189714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:54 smithi191 bash[24992]: cluster 2024-08-31T05:26:52.916813+0000 mgr.a (mgr.14388) 8461 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:54.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:54 smithi163 bash[24253]: audit 2024-08-31T05:26:52.396071+0000 mgr.a (mgr.14388) 8460 : audit [DBG] from='client.189714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:54.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:54 smithi163 bash[24253]: cluster 2024-08-31T05:26:52.916813+0000 mgr.a (mgr.14388) 8461 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:54 smithi027 bash[22610]: audit 2024-08-31T05:26:52.396071+0000 mgr.a (mgr.14388) 8460 : audit [DBG] from='client.189714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:54 smithi027 bash[22610]: cluster 2024-08-31T05:26:52.916813+0000 mgr.a (mgr.14388) 8461 : cluster [DBG] pgmap v5864: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:56 smithi191 bash[24992]: cluster 2024-08-31T05:26:54.919096+0000 mgr.a (mgr.14388) 8462 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:56 smithi163 bash[24253]: cluster 2024-08-31T05:26:54.919096+0000 mgr.a (mgr.14388) 8462 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:56 smithi027 bash[22610]: cluster 2024-08-31T05:26:54.919096+0000 mgr.a (mgr.14388) 8462 : cluster [DBG] pgmap v5865: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:26:57.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:26:57.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:26:57.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:26:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:58 smithi191 bash[24992]: cluster 2024-08-31T05:26:56.919817+0000 mgr.a (mgr.14388) 8463 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:58 smithi163 bash[24253]: cluster 2024-08-31T05:26:56.919817+0000 mgr.a (mgr.14388) 8463 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:58 smithi027 bash[22610]: cluster 2024-08-31T05:26:56.919817+0000 mgr.a (mgr.14388) 8463 : cluster [DBG] pgmap v5866: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:26:58.575 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:26:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:26:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:26:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:26:58.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:26:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:26:59 smithi191 bash[24992]: audit 2024-08-31T05:26:58.150068+0000 mgr.a (mgr.14388) 8464 : audit [DBG] from='client.189792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:26:59 smithi163 bash[24253]: audit 2024-08-31T05:26:58.150068+0000 mgr.a (mgr.14388) 8464 : audit [DBG] from='client.189792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:26:59 smithi027 bash[22610]: audit 2024-08-31T05:26:58.150068+0000 mgr.a (mgr.14388) 8464 : audit [DBG] from='client.189792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:00 smithi191 bash[24992]: cluster 2024-08-31T05:26:58.922577+0000 mgr.a (mgr.14388) 8465 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:00 smithi163 bash[24253]: cluster 2024-08-31T05:26:58.922577+0000 mgr.a (mgr.14388) 8465 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:00 smithi027 bash[22610]: cluster 2024-08-31T05:26:58.922577+0000 mgr.a (mgr.14388) 8465 : cluster [DBG] pgmap v5867: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:02 smithi191 bash[24992]: cluster 2024-08-31T05:27:00.923387+0000 mgr.a (mgr.14388) 8466 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:27:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:02 smithi163 bash[24253]: cluster 2024-08-31T05:27:00.923387+0000 mgr.a (mgr.14388) 8466 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:27:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:02 smithi027 bash[22610]: cluster 2024-08-31T05:27:00.923387+0000 mgr.a (mgr.14388) 8466 : cluster [DBG] pgmap v5868: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:27:03.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:27:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:27:03.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:27:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:04 smithi191 bash[24992]: cluster 2024-08-31T05:27:02.925296+0000 mgr.a (mgr.14388) 8467 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:04.331 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:27:04.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:27:04.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:27:04.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:27:04.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:27:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:04 smithi163 bash[24253]: cluster 2024-08-31T05:27:02.925296+0000 mgr.a (mgr.14388) 8467 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:04 smithi027 bash[22610]: cluster 2024-08-31T05:27:02.925296+0000 mgr.a (mgr.14388) 8467 : cluster [DBG] pgmap v5869: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:05 smithi163 bash[24253]: audit 2024-08-31T05:27:03.910297+0000 mgr.a (mgr.14388) 8468 : audit [DBG] from='client.189870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:05 smithi027 bash[22610]: audit 2024-08-31T05:27:03.910297+0000 mgr.a (mgr.14388) 8468 : audit [DBG] from='client.189870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:05 smithi191 bash[24992]: audit 2024-08-31T05:27:03.910297+0000 mgr.a (mgr.14388) 8468 : audit [DBG] from='client.189870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:06 smithi163 bash[24253]: cluster 2024-08-31T05:27:04.926285+0000 mgr.a (mgr.14388) 8469 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:06 smithi027 bash[22610]: cluster 2024-08-31T05:27:04.926285+0000 mgr.a (mgr.14388) 8469 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:06 smithi191 bash[24992]: cluster 2024-08-31T05:27:04.926285+0000 mgr.a (mgr.14388) 8469 : cluster [DBG] pgmap v5870: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:08 smithi163 bash[24253]: cluster 2024-08-31T05:27:06.927097+0000 mgr.a (mgr.14388) 8470 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:27:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:08 smithi027 bash[22610]: cluster 2024-08-31T05:27:06.927097+0000 mgr.a (mgr.14388) 8470 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:27:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:08 smithi191 bash[24992]: cluster 2024-08-31T05:27:06.927097+0000 mgr.a (mgr.14388) 8470 : cluster [DBG] pgmap v5871: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:27:09.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:27:09.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:27:09.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:27:10.104 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:27:10.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:27:10.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:27:10.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:27:10.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:27:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:10 smithi163 bash[24253]: cluster 2024-08-31T05:27:08.929270+0000 mgr.a (mgr.14388) 8471 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:10 smithi027 bash[22610]: cluster 2024-08-31T05:27:08.929270+0000 mgr.a (mgr.14388) 8471 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:10 smithi191 bash[24992]: cluster 2024-08-31T05:27:08.929270+0000 mgr.a (mgr.14388) 8471 : cluster [DBG] pgmap v5872: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:11 smithi163 bash[24253]: audit 2024-08-31T05:27:09.671478+0000 mgr.a (mgr.14388) 8472 : audit [DBG] from='client.189948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:11 smithi027 bash[22610]: audit 2024-08-31T05:27:09.671478+0000 mgr.a (mgr.14388) 8472 : audit [DBG] from='client.189948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:11 smithi191 bash[24992]: audit 2024-08-31T05:27:09.671478+0000 mgr.a (mgr.14388) 8472 : audit [DBG] from='client.189948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:12 smithi163 bash[24253]: cluster 2024-08-31T05:27:10.930264+0000 mgr.a (mgr.14388) 8473 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:12 smithi027 bash[22610]: cluster 2024-08-31T05:27:10.930264+0000 mgr.a (mgr.14388) 8473 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:12 smithi191 bash[24992]: cluster 2024-08-31T05:27:10.930264+0000 mgr.a (mgr.14388) 8473 : cluster [DBG] pgmap v5873: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:14 smithi163 bash[24253]: cluster 2024-08-31T05:27:12.932430+0000 mgr.a (mgr.14388) 8474 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:14 smithi027 bash[22610]: cluster 2024-08-31T05:27:12.932430+0000 mgr.a (mgr.14388) 8474 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:14 smithi191 bash[24992]: cluster 2024-08-31T05:27:12.932430+0000 mgr.a (mgr.14388) 8474 : cluster [DBG] pgmap v5874: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:15.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:27:15.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:27:15.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:27:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:27:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:27:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:27:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:27:15.890 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:27:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:16 smithi163 bash[24253]: cluster 2024-08-31T05:27:14.933204+0000 mgr.a (mgr.14388) 8475 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:16 smithi027 bash[22610]: cluster 2024-08-31T05:27:14.933204+0000 mgr.a (mgr.14388) 8475 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:16 smithi191 bash[24992]: cluster 2024-08-31T05:27:14.933204+0000 mgr.a (mgr.14388) 8475 : cluster [DBG] pgmap v5875: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:17 smithi163 bash[24253]: audit 2024-08-31T05:27:15.445065+0000 mgr.a (mgr.14388) 8476 : audit [DBG] from='client.190023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:17 smithi027 bash[22610]: audit 2024-08-31T05:27:15.445065+0000 mgr.a (mgr.14388) 8476 : audit [DBG] from='client.190023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:17 smithi191 bash[24992]: audit 2024-08-31T05:27:15.445065+0000 mgr.a (mgr.14388) 8476 : audit [DBG] from='client.190023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:18 smithi163 bash[24253]: cluster 2024-08-31T05:27:16.934187+0000 mgr.a (mgr.14388) 8477 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:18 smithi027 bash[22610]: cluster 2024-08-31T05:27:16.934187+0000 mgr.a (mgr.14388) 8477 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:18 smithi191 bash[24992]: cluster 2024-08-31T05:27:16.934187+0000 mgr.a (mgr.14388) 8477 : cluster [DBG] pgmap v5876: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:20 smithi163 bash[24253]: cluster 2024-08-31T05:27:18.936449+0000 mgr.a (mgr.14388) 8478 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:20 smithi027 bash[22610]: cluster 2024-08-31T05:27:18.936449+0000 mgr.a (mgr.14388) 8478 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:20 smithi191 bash[24992]: cluster 2024-08-31T05:27:18.936449+0000 mgr.a (mgr.14388) 8478 : cluster [DBG] pgmap v5877: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:20.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:27:20.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:27:20.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:27:21.669 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:27:21.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:27:21.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:27:21.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:27:21.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:27:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:22 smithi163 bash[24253]: cluster 2024-08-31T05:27:20.937012+0000 mgr.a (mgr.14388) 8479 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:22 smithi163 bash[24253]: audit 2024-08-31T05:27:21.229663+0000 mgr.a (mgr.14388) 8480 : audit [DBG] from='client.190101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:22 smithi027 bash[22610]: cluster 2024-08-31T05:27:20.937012+0000 mgr.a (mgr.14388) 8479 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:22 smithi027 bash[22610]: audit 2024-08-31T05:27:21.229663+0000 mgr.a (mgr.14388) 8480 : audit [DBG] from='client.190101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:22 smithi191 bash[24992]: cluster 2024-08-31T05:27:20.937012+0000 mgr.a (mgr.14388) 8479 : cluster [DBG] pgmap v5878: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:22 smithi191 bash[24992]: audit 2024-08-31T05:27:21.229663+0000 mgr.a (mgr.14388) 8480 : audit [DBG] from='client.190101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:24 smithi163 bash[24253]: cluster 2024-08-31T05:27:22.939299+0000 mgr.a (mgr.14388) 8481 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:24 smithi027 bash[22610]: cluster 2024-08-31T05:27:22.939299+0000 mgr.a (mgr.14388) 8481 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:24 smithi191 bash[24992]: cluster 2024-08-31T05:27:22.939299+0000 mgr.a (mgr.14388) 8481 : cluster [DBG] pgmap v5879: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:26 smithi163 bash[24253]: cluster 2024-08-31T05:27:24.940079+0000 mgr.a (mgr.14388) 8482 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:26 smithi027 bash[22610]: cluster 2024-08-31T05:27:24.940079+0000 mgr.a (mgr.14388) 8482 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:26 smithi191 bash[24992]: cluster 2024-08-31T05:27:24.940079+0000 mgr.a (mgr.14388) 8482 : cluster [DBG] pgmap v5880: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:26.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:27:26.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:27:26.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:27:27.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:27:27.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:27:27.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:27:27.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:27:27.448 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:27:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:28 smithi163 bash[24253]: cluster 2024-08-31T05:27:26.940823+0000 mgr.a (mgr.14388) 8483 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:28 smithi163 bash[24253]: audit 2024-08-31T05:27:27.008648+0000 mgr.a (mgr.14388) 8484 : audit [DBG] from='client.190173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:28 smithi027 bash[22610]: cluster 2024-08-31T05:27:26.940823+0000 mgr.a (mgr.14388) 8483 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:28 smithi027 bash[22610]: audit 2024-08-31T05:27:27.008648+0000 mgr.a (mgr.14388) 8484 : audit [DBG] from='client.190173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:28 smithi191 bash[24992]: cluster 2024-08-31T05:27:26.940823+0000 mgr.a (mgr.14388) 8483 : cluster [DBG] pgmap v5881: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:28 smithi191 bash[24992]: audit 2024-08-31T05:27:27.008648+0000 mgr.a (mgr.14388) 8484 : audit [DBG] from='client.190173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:29 smithi163 bash[24253]: audit 2024-08-31T05:27:28.314125+0000 mon.a (mon.0) 1853 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:27:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:29 smithi027 bash[22610]: audit 2024-08-31T05:27:28.314125+0000 mon.a (mon.0) 1853 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:27:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:29 smithi191 bash[24992]: audit 2024-08-31T05:27:28.314125+0000 mon.a (mon.0) 1853 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:27:30.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:27:29 smithi027 bash[22863]: debug 2024-08-31T05:27:29.891+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:27:30.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:27:29 smithi027 bash[22863]: debug 2024-08-31T05:27:29.895+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:27:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:30 smithi027 bash[22610]: cluster 2024-08-31T05:27:28.942443+0000 mgr.a (mgr.14388) 8485 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:30 smithi027 bash[22610]: audit 2024-08-31T05:27:29.146097+0000 mon.a (mon.0) 1854 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:27:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:30 smithi027 bash[22610]: audit 2024-08-31T05:27:29.147645+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:27:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:30 smithi027 bash[22610]: audit 2024-08-31T05:27:29.156718+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:27:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:30 smithi027 bash[22610]: audit 2024-08-31T05:27:29.161679+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:27:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:30 smithi027 bash[22610]: audit 2024-08-31T05:27:29.164064+0000 mgr.a (mgr.14388) 8486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:27:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:30 smithi163 bash[24253]: cluster 2024-08-31T05:27:28.942443+0000 mgr.a (mgr.14388) 8485 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:30 smithi163 bash[24253]: audit 2024-08-31T05:27:29.146097+0000 mon.a (mon.0) 1854 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:27:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:30 smithi163 bash[24253]: audit 2024-08-31T05:27:29.147645+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:27:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:30 smithi163 bash[24253]: audit 2024-08-31T05:27:29.156718+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:27:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:30 smithi163 bash[24253]: audit 2024-08-31T05:27:29.161679+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:27:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:30 smithi163 bash[24253]: audit 2024-08-31T05:27:29.164064+0000 mgr.a (mgr.14388) 8486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:27:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:30 smithi191 bash[24992]: cluster 2024-08-31T05:27:28.942443+0000 mgr.a (mgr.14388) 8485 : cluster [DBG] pgmap v5882: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:30 smithi191 bash[24992]: audit 2024-08-31T05:27:29.146097+0000 mon.a (mon.0) 1854 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:27:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:30 smithi191 bash[24992]: audit 2024-08-31T05:27:29.147645+0000 mon.a (mon.0) 1855 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:27:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:30 smithi191 bash[24992]: audit 2024-08-31T05:27:29.156718+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:27:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:30 smithi191 bash[24992]: audit 2024-08-31T05:27:29.161679+0000 mon.a (mon.0) 1857 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:27:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:30 smithi191 bash[24992]: audit 2024-08-31T05:27:29.164064+0000 mgr.a (mgr.14388) 8486 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:27:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:31 smithi163 bash[24253]: audit 2024-08-31T05:27:29.898099+0000 mgr.a (mgr.14388) 8487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:27:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:31 smithi163 bash[24253]: cephadm 2024-08-31T05:27:29.899515+0000 mgr.a (mgr.14388) 8488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:27:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:31 smithi027 bash[22610]: audit 2024-08-31T05:27:29.898099+0000 mgr.a (mgr.14388) 8487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:27:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:31 smithi027 bash[22610]: cephadm 2024-08-31T05:27:29.899515+0000 mgr.a (mgr.14388) 8488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:27:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:31 smithi191 bash[24992]: audit 2024-08-31T05:27:29.898099+0000 mgr.a (mgr.14388) 8487 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:27:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:31 smithi191 bash[24992]: cephadm 2024-08-31T05:27:29.899515+0000 mgr.a (mgr.14388) 8488 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:27:32.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:27:32.449 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:27:32.450 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:27:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:32 smithi163 bash[24253]: cluster 2024-08-31T05:27:30.943359+0000 mgr.a (mgr.14388) 8489 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:32 smithi027 bash[22610]: cluster 2024-08-31T05:27:30.943359+0000 mgr.a (mgr.14388) 8489 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:32 smithi191 bash[24992]: cluster 2024-08-31T05:27:30.943359+0000 mgr.a (mgr.14388) 8489 : cluster [DBG] pgmap v5883: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:33.195 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:27:33.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:27:33.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:27:33.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:27:33.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:27:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:34 smithi163 bash[24253]: audit 2024-08-31T05:27:32.777257+0000 mgr.a (mgr.14388) 8490 : audit [DBG] from='client.190356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:34 smithi163 bash[24253]: cluster 2024-08-31T05:27:32.944640+0000 mgr.a (mgr.14388) 8491 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:27:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:34 smithi027 bash[22610]: audit 2024-08-31T05:27:32.777257+0000 mgr.a (mgr.14388) 8490 : audit [DBG] from='client.190356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:34 smithi027 bash[22610]: cluster 2024-08-31T05:27:32.944640+0000 mgr.a (mgr.14388) 8491 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:27:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:34 smithi191 bash[24992]: audit 2024-08-31T05:27:32.777257+0000 mgr.a (mgr.14388) 8490 : audit [DBG] from='client.190356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:34 smithi191 bash[24992]: cluster 2024-08-31T05:27:32.944640+0000 mgr.a (mgr.14388) 8491 : cluster [DBG] pgmap v5884: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:27:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:36 smithi163 bash[24253]: cluster 2024-08-31T05:27:34.945527+0000 mgr.a (mgr.14388) 8492 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:27:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:36 smithi027 bash[22610]: cluster 2024-08-31T05:27:34.945527+0000 mgr.a (mgr.14388) 8492 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:27:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:36 smithi191 bash[24992]: cluster 2024-08-31T05:27:34.945527+0000 mgr.a (mgr.14388) 8492 : cluster [DBG] pgmap v5885: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:27:38.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:27:38.197 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:27:38.197 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:27:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:38 smithi163 bash[24253]: cluster 2024-08-31T05:27:36.946325+0000 mgr.a (mgr.14388) 8493 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:27:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:38 smithi027 bash[22610]: cluster 2024-08-31T05:27:36.946325+0000 mgr.a (mgr.14388) 8493 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:27:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:38 smithi191 bash[24992]: cluster 2024-08-31T05:27:36.946325+0000 mgr.a (mgr.14388) 8493 : cluster [DBG] pgmap v5886: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:27:38.970 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:27:38.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:27:38.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:27:38.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:27:38.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:27:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:40 smithi163 bash[24253]: audit 2024-08-31T05:27:38.531722+0000 mgr.a (mgr.14388) 8494 : audit [DBG] from='client.190434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:40 smithi163 bash[24253]: cluster 2024-08-31T05:27:38.947876+0000 mgr.a (mgr.14388) 8495 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:27:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:40 smithi027 bash[22610]: audit 2024-08-31T05:27:38.531722+0000 mgr.a (mgr.14388) 8494 : audit [DBG] from='client.190434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:40 smithi027 bash[22610]: cluster 2024-08-31T05:27:38.947876+0000 mgr.a (mgr.14388) 8495 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:27:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:40 smithi191 bash[24992]: audit 2024-08-31T05:27:38.531722+0000 mgr.a (mgr.14388) 8494 : audit [DBG] from='client.190434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:40.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:40 smithi191 bash[24992]: cluster 2024-08-31T05:27:38.947876+0000 mgr.a (mgr.14388) 8495 : cluster [DBG] pgmap v5887: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:27:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:42 smithi163 bash[24253]: cluster 2024-08-31T05:27:40.948622+0000 mgr.a (mgr.14388) 8496 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:27:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:42 smithi027 bash[22610]: cluster 2024-08-31T05:27:40.948622+0000 mgr.a (mgr.14388) 8496 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:27:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:42 smithi191 bash[24992]: cluster 2024-08-31T05:27:40.948622+0000 mgr.a (mgr.14388) 8496 : cluster [DBG] pgmap v5888: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:27:43.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:27:43.972 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:27:43.972 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:27:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:44 smithi163 bash[24253]: cluster 2024-08-31T05:27:42.950559+0000 mgr.a (mgr.14388) 8497 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:27:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:44 smithi027 bash[22610]: cluster 2024-08-31T05:27:42.950559+0000 mgr.a (mgr.14388) 8497 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:27:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:44 smithi191 bash[24992]: cluster 2024-08-31T05:27:42.950559+0000 mgr.a (mgr.14388) 8497 : cluster [DBG] pgmap v5889: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:27:44.739 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:27:44.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:27:44.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:27:44.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:27:44.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:27:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:45 smithi163 bash[24253]: audit 2024-08-31T05:27:44.309112+0000 mgr.a (mgr.14388) 8498 : audit [DBG] from='client.190512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:45 smithi027 bash[22610]: audit 2024-08-31T05:27:44.309112+0000 mgr.a (mgr.14388) 8498 : audit [DBG] from='client.190512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:45.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:45 smithi191 bash[24992]: audit 2024-08-31T05:27:44.309112+0000 mgr.a (mgr.14388) 8498 : audit [DBG] from='client.190512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:46 smithi163 bash[24253]: cluster 2024-08-31T05:27:44.951538+0000 mgr.a (mgr.14388) 8499 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:46 smithi027 bash[22610]: cluster 2024-08-31T05:27:44.951538+0000 mgr.a (mgr.14388) 8499 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:46 smithi191 bash[24992]: cluster 2024-08-31T05:27:44.951538+0000 mgr.a (mgr.14388) 8499 : cluster [DBG] pgmap v5890: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:48 smithi163 bash[24253]: cluster 2024-08-31T05:27:46.952367+0000 mgr.a (mgr.14388) 8500 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:48 smithi027 bash[22610]: cluster 2024-08-31T05:27:46.952367+0000 mgr.a (mgr.14388) 8500 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:48 smithi191 bash[24992]: cluster 2024-08-31T05:27:46.952367+0000 mgr.a (mgr.14388) 8500 : cluster [DBG] pgmap v5891: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:49.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:27:49.741 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:27:49.741 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:27:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:50 smithi163 bash[24253]: cluster 2024-08-31T05:27:48.954636+0000 mgr.a (mgr.14388) 8501 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:50 smithi027 bash[22610]: cluster 2024-08-31T05:27:48.954636+0000 mgr.a (mgr.14388) 8501 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:50.507 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:27:50.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:27:50.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:27:50.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:27:50.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:27:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:50 smithi191 bash[24992]: cluster 2024-08-31T05:27:48.954636+0000 mgr.a (mgr.14388) 8501 : cluster [DBG] pgmap v5892: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:51 smithi163 bash[24253]: audit 2024-08-31T05:27:50.073607+0000 mgr.a (mgr.14388) 8502 : audit [DBG] from='client.190587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:51 smithi027 bash[22610]: audit 2024-08-31T05:27:50.073607+0000 mgr.a (mgr.14388) 8502 : audit [DBG] from='client.190587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:51 smithi191 bash[24992]: audit 2024-08-31T05:27:50.073607+0000 mgr.a (mgr.14388) 8502 : audit [DBG] from='client.190587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:52 smithi163 bash[24253]: cluster 2024-08-31T05:27:50.955644+0000 mgr.a (mgr.14388) 8503 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:52 smithi027 bash[22610]: cluster 2024-08-31T05:27:50.955644+0000 mgr.a (mgr.14388) 8503 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:52 smithi191 bash[24992]: cluster 2024-08-31T05:27:50.955644+0000 mgr.a (mgr.14388) 8503 : cluster [DBG] pgmap v5893: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:54 smithi163 bash[24253]: cluster 2024-08-31T05:27:52.957823+0000 mgr.a (mgr.14388) 8504 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:54 smithi027 bash[22610]: cluster 2024-08-31T05:27:52.957823+0000 mgr.a (mgr.14388) 8504 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:54 smithi191 bash[24992]: cluster 2024-08-31T05:27:52.957823+0000 mgr.a (mgr.14388) 8504 : cluster [DBG] pgmap v5894: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:27:55.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:27:55.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:27:55.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:27:56.286 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:27:56.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:27:56.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:27:56.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:27:56.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:27:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:56 smithi163 bash[24253]: cluster 2024-08-31T05:27:54.958599+0000 mgr.a (mgr.14388) 8505 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:56 smithi027 bash[22610]: cluster 2024-08-31T05:27:54.958599+0000 mgr.a (mgr.14388) 8505 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:56 smithi191 bash[24992]: cluster 2024-08-31T05:27:54.958599+0000 mgr.a (mgr.14388) 8505 : cluster [DBG] pgmap v5895: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:57 smithi027 bash[22610]: audit 2024-08-31T05:27:55.850570+0000 mgr.a (mgr.14388) 8506 : audit [DBG] from='client.190662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:57 smithi191 bash[24992]: audit 2024-08-31T05:27:55.850570+0000 mgr.a (mgr.14388) 8506 : audit [DBG] from='client.190662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:57 smithi163 bash[24253]: audit 2024-08-31T05:27:55.850570+0000 mgr.a (mgr.14388) 8506 : audit [DBG] from='client.190662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:27:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:27:58 smithi027 bash[22610]: cluster 2024-08-31T05:27:56.959759+0000 mgr.a (mgr.14388) 8507 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:27:58 smithi191 bash[24992]: cluster 2024-08-31T05:27:56.959759+0000 mgr.a (mgr.14388) 8507 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:27:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:27:58 smithi163 bash[24253]: cluster 2024-08-31T05:27:56.959759+0000 mgr.a (mgr.14388) 8507 : cluster [DBG] pgmap v5896: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:00 smithi027 bash[22610]: cluster 2024-08-31T05:27:58.962110+0000 mgr.a (mgr.14388) 8508 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:28:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:00 smithi191 bash[24992]: cluster 2024-08-31T05:27:58.962110+0000 mgr.a (mgr.14388) 8508 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:28:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:00 smithi163 bash[24253]: cluster 2024-08-31T05:27:58.962110+0000 mgr.a (mgr.14388) 8508 : cluster [DBG] pgmap v5897: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:28:01.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:01.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:01.289 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:02.036 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:28:02.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:02.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:02.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:02.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:02 smithi027 bash[22610]: cluster 2024-08-31T05:28:00.962918+0000 mgr.a (mgr.14388) 8509 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:02 smithi191 bash[24992]: cluster 2024-08-31T05:28:00.962918+0000 mgr.a (mgr.14388) 8509 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:02 smithi163 bash[24253]: cluster 2024-08-31T05:28:00.962918+0000 mgr.a (mgr.14388) 8509 : cluster [DBG] pgmap v5898: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:03 smithi027 bash[22610]: audit 2024-08-31T05:28:01.616572+0000 mgr.a (mgr.14388) 8510 : audit [DBG] from='client.190740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:03 smithi191 bash[24992]: audit 2024-08-31T05:28:01.616572+0000 mgr.a (mgr.14388) 8510 : audit [DBG] from='client.190740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:03 smithi163 bash[24253]: audit 2024-08-31T05:28:01.616572+0000 mgr.a (mgr.14388) 8510 : audit [DBG] from='client.190740 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:04 smithi027 bash[22610]: cluster 2024-08-31T05:28:02.965153+0000 mgr.a (mgr.14388) 8511 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:28:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:04 smithi191 bash[24992]: cluster 2024-08-31T05:28:02.965153+0000 mgr.a (mgr.14388) 8511 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:28:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:04 smithi163 bash[24253]: cluster 2024-08-31T05:28:02.965153+0000 mgr.a (mgr.14388) 8511 : cluster [DBG] pgmap v5899: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:28:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:06 smithi191 bash[24992]: cluster 2024-08-31T05:28:04.966080+0000 mgr.a (mgr.14388) 8512 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:06 smithi163 bash[24253]: cluster 2024-08-31T05:28:04.966080+0000 mgr.a (mgr.14388) 8512 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:06 smithi027 bash[22610]: cluster 2024-08-31T05:28:04.966080+0000 mgr.a (mgr.14388) 8512 : cluster [DBG] pgmap v5900: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:07.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:07.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:07.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:07.827 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:28:07.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:07.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:07.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:07.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:08 smithi191 bash[24992]: cluster 2024-08-31T05:28:06.966935+0000 mgr.a (mgr.14388) 8513 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:08 smithi191 bash[24992]: audit 2024-08-31T05:28:07.377798+0000 mgr.a (mgr.14388) 8514 : audit [DBG] from='client.190818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:08 smithi163 bash[24253]: cluster 2024-08-31T05:28:06.966935+0000 mgr.a (mgr.14388) 8513 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:08 smithi163 bash[24253]: audit 2024-08-31T05:28:07.377798+0000 mgr.a (mgr.14388) 8514 : audit [DBG] from='client.190818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:08 smithi027 bash[22610]: cluster 2024-08-31T05:28:06.966935+0000 mgr.a (mgr.14388) 8513 : cluster [DBG] pgmap v5901: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:08 smithi027 bash[22610]: audit 2024-08-31T05:28:07.377798+0000 mgr.a (mgr.14388) 8514 : audit [DBG] from='client.190818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:10 smithi191 bash[24992]: cluster 2024-08-31T05:28:08.969271+0000 mgr.a (mgr.14388) 8515 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:28:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:10 smithi163 bash[24253]: cluster 2024-08-31T05:28:08.969271+0000 mgr.a (mgr.14388) 8515 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:28:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:10 smithi027 bash[22610]: cluster 2024-08-31T05:28:08.969271+0000 mgr.a (mgr.14388) 8515 : cluster [DBG] pgmap v5902: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:28:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:12 smithi191 bash[24992]: cluster 2024-08-31T05:28:10.970033+0000 mgr.a (mgr.14388) 8516 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:28:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:12 smithi163 bash[24253]: cluster 2024-08-31T05:28:10.970033+0000 mgr.a (mgr.14388) 8516 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:28:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:12 smithi027 bash[22610]: cluster 2024-08-31T05:28:10.970033+0000 mgr.a (mgr.14388) 8516 : cluster [DBG] pgmap v5903: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:28:12.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:12.829 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:12.830 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:13.605 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:28:13.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:13.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:13.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:13.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:14 smithi191 bash[24992]: cluster 2024-08-31T05:28:12.971766+0000 mgr.a (mgr.14388) 8517 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:14.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:14 smithi191 bash[24992]: audit 2024-08-31T05:28:13.167220+0000 mgr.a (mgr.14388) 8518 : audit [DBG] from='client.190896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:14 smithi163 bash[24253]: cluster 2024-08-31T05:28:12.971766+0000 mgr.a (mgr.14388) 8517 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:14 smithi163 bash[24253]: audit 2024-08-31T05:28:13.167220+0000 mgr.a (mgr.14388) 8518 : audit [DBG] from='client.190896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:14 smithi027 bash[22610]: cluster 2024-08-31T05:28:12.971766+0000 mgr.a (mgr.14388) 8517 : cluster [DBG] pgmap v5904: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:14 smithi027 bash[22610]: audit 2024-08-31T05:28:13.167220+0000 mgr.a (mgr.14388) 8518 : audit [DBG] from='client.190896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:16 smithi191 bash[24992]: cluster 2024-08-31T05:28:14.972645+0000 mgr.a (mgr.14388) 8519 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:28:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:16 smithi163 bash[24253]: cluster 2024-08-31T05:28:14.972645+0000 mgr.a (mgr.14388) 8519 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:28:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:16 smithi027 bash[22610]: cluster 2024-08-31T05:28:14.972645+0000 mgr.a (mgr.14388) 8519 : cluster [DBG] pgmap v5905: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:28:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:18 smithi191 bash[24992]: cluster 2024-08-31T05:28:16.973429+0000 mgr.a (mgr.14388) 8520 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:28:18.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:18.607 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:18.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:18 smithi163 bash[24253]: cluster 2024-08-31T05:28:16.973429+0000 mgr.a (mgr.14388) 8520 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:28:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:18 smithi027 bash[22610]: cluster 2024-08-31T05:28:16.973429+0000 mgr.a (mgr.14388) 8520 : cluster [DBG] pgmap v5906: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:28:19.396 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:28:19.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:19.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:19.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:19.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:20 smithi191 bash[24992]: audit 2024-08-31T05:28:18.947251+0000 mgr.a (mgr.14388) 8521 : audit [DBG] from='client.190974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:20 smithi191 bash[24992]: cluster 2024-08-31T05:28:18.975072+0000 mgr.a (mgr.14388) 8522 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:20 smithi163 bash[24253]: audit 2024-08-31T05:28:18.947251+0000 mgr.a (mgr.14388) 8521 : audit [DBG] from='client.190974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:20 smithi163 bash[24253]: cluster 2024-08-31T05:28:18.975072+0000 mgr.a (mgr.14388) 8522 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:20 smithi027 bash[22610]: audit 2024-08-31T05:28:18.947251+0000 mgr.a (mgr.14388) 8521 : audit [DBG] from='client.190974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:20 smithi027 bash[22610]: cluster 2024-08-31T05:28:18.975072+0000 mgr.a (mgr.14388) 8522 : cluster [DBG] pgmap v5907: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:22 smithi191 bash[24992]: cluster 2024-08-31T05:28:20.975976+0000 mgr.a (mgr.14388) 8523 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:28:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:22 smithi163 bash[24253]: cluster 2024-08-31T05:28:20.975976+0000 mgr.a (mgr.14388) 8523 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:28:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:22 smithi027 bash[22610]: cluster 2024-08-31T05:28:20.975976+0000 mgr.a (mgr.14388) 8523 : cluster [DBG] pgmap v5908: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:28:24.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:24.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:24.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:24 smithi191 bash[24992]: cluster 2024-08-31T05:28:22.978135+0000 mgr.a (mgr.14388) 8524 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:28:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:24 smithi163 bash[24253]: cluster 2024-08-31T05:28:22.978135+0000 mgr.a (mgr.14388) 8524 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:28:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:24 smithi027 bash[22610]: cluster 2024-08-31T05:28:22.978135+0000 mgr.a (mgr.14388) 8524 : cluster [DBG] pgmap v5909: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:28:25.140 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:28:25.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:25.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:25.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:25.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:26 smithi191 bash[24992]: audit 2024-08-31T05:28:24.729934+0000 mgr.a (mgr.14388) 8525 : audit [DBG] from='client.191052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:26 smithi191 bash[24992]: cluster 2024-08-31T05:28:24.978683+0000 mgr.a (mgr.14388) 8526 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:26 smithi163 bash[24253]: audit 2024-08-31T05:28:24.729934+0000 mgr.a (mgr.14388) 8525 : audit [DBG] from='client.191052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:26 smithi163 bash[24253]: cluster 2024-08-31T05:28:24.978683+0000 mgr.a (mgr.14388) 8526 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:26 smithi027 bash[22610]: audit 2024-08-31T05:28:24.729934+0000 mgr.a (mgr.14388) 8525 : audit [DBG] from='client.191052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:26 smithi027 bash[22610]: cluster 2024-08-31T05:28:24.978683+0000 mgr.a (mgr.14388) 8526 : cluster [DBG] pgmap v5910: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:28 smithi191 bash[24992]: cluster 2024-08-31T05:28:26.979534+0000 mgr.a (mgr.14388) 8527 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:28 smithi163 bash[24253]: cluster 2024-08-31T05:28:26.979534+0000 mgr.a (mgr.14388) 8527 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:28 smithi027 bash[22610]: cluster 2024-08-31T05:28:26.979534+0000 mgr.a (mgr.14388) 8527 : cluster [DBG] pgmap v5911: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:30.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:30.142 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:30.143 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:30 smithi191 bash[24992]: cluster 2024-08-31T05:28:28.981772+0000 mgr.a (mgr.14388) 8528 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:28:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:30 smithi191 bash[24992]: audit 2024-08-31T05:28:29.951362+0000 mon.a (mon.0) 1858 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:28:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:30 smithi163 bash[24253]: cluster 2024-08-31T05:28:28.981772+0000 mgr.a (mgr.14388) 8528 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:28:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:30 smithi163 bash[24253]: audit 2024-08-31T05:28:29.951362+0000 mon.a (mon.0) 1858 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:28:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:30 smithi027 bash[22610]: cluster 2024-08-31T05:28:28.981772+0000 mgr.a (mgr.14388) 8528 : cluster [DBG] pgmap v5912: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:28:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:30 smithi027 bash[22610]: audit 2024-08-31T05:28:29.951362+0000 mon.a (mon.0) 1858 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:28:30.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:30.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:30.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:30.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:30.893 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:28:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:31 smithi191 bash[24992]: audit 2024-08-31T05:28:30.810731+0000 mon.a (mon.0) 1859 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:28:31.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:31 smithi191 bash[24992]: audit 2024-08-31T05:28:30.811586+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:28:31.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:31 smithi191 bash[24992]: audit 2024-08-31T05:28:30.816639+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:28:31.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:31 smithi191 bash[24992]: audit 2024-08-31T05:28:30.818884+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:28:31.572 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:31 smithi027 bash[22610]: audit 2024-08-31T05:28:30.810731+0000 mon.a (mon.0) 1859 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:28:31.572 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:31 smithi027 bash[22610]: audit 2024-08-31T05:28:30.811586+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:28:31.572 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:31 smithi027 bash[22610]: audit 2024-08-31T05:28:30.816639+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:28:31.572 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:31 smithi027 bash[22610]: audit 2024-08-31T05:28:30.818884+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:28:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:31 smithi163 bash[24253]: audit 2024-08-31T05:28:30.810731+0000 mon.a (mon.0) 1859 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:28:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:31 smithi163 bash[24253]: audit 2024-08-31T05:28:30.811586+0000 mon.a (mon.0) 1860 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:28:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:31 smithi163 bash[24253]: audit 2024-08-31T05:28:30.816639+0000 mon.a (mon.0) 1861 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:28:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:31 smithi163 bash[24253]: audit 2024-08-31T05:28:30.818884+0000 mon.a (mon.0) 1862 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:28:31.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:28:31 smithi027 bash[22863]: debug 2024-08-31T05:28:31.570+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:28:31.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:28:31 smithi027 bash[22863]: debug 2024-08-31T05:28:31.570+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:28:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:32 smithi163 bash[24253]: audit 2024-08-31T05:28:30.475824+0000 mgr.a (mgr.14388) 8529 : audit [DBG] from='client.191130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:32 smithi163 bash[24253]: audit 2024-08-31T05:28:30.820125+0000 mgr.a (mgr.14388) 8530 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:28:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:32 smithi163 bash[24253]: cluster 2024-08-31T05:28:30.982857+0000 mgr.a (mgr.14388) 8531 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:32 smithi027 bash[22610]: audit 2024-08-31T05:28:30.475824+0000 mgr.a (mgr.14388) 8529 : audit [DBG] from='client.191130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:32 smithi027 bash[22610]: audit 2024-08-31T05:28:30.820125+0000 mgr.a (mgr.14388) 8530 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:28:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:32 smithi027 bash[22610]: cluster 2024-08-31T05:28:30.982857+0000 mgr.a (mgr.14388) 8531 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:32 smithi191 bash[24992]: audit 2024-08-31T05:28:30.475824+0000 mgr.a (mgr.14388) 8529 : audit [DBG] from='client.191130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:32.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:32 smithi191 bash[24992]: audit 2024-08-31T05:28:30.820125+0000 mgr.a (mgr.14388) 8530 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:28:32.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:32 smithi191 bash[24992]: cluster 2024-08-31T05:28:30.982857+0000 mgr.a (mgr.14388) 8531 : cluster [DBG] pgmap v5913: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:33 smithi163 bash[24253]: audit 2024-08-31T05:28:31.573256+0000 mgr.a (mgr.14388) 8532 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:28:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:33 smithi163 bash[24253]: cephadm 2024-08-31T05:28:31.574711+0000 mgr.a (mgr.14388) 8533 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:28:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:33 smithi027 bash[22610]: audit 2024-08-31T05:28:31.573256+0000 mgr.a (mgr.14388) 8532 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:28:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:33 smithi027 bash[22610]: cephadm 2024-08-31T05:28:31.574711+0000 mgr.a (mgr.14388) 8533 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:28:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:33 smithi191 bash[24992]: audit 2024-08-31T05:28:31.573256+0000 mgr.a (mgr.14388) 8532 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:28:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:33 smithi191 bash[24992]: cephadm 2024-08-31T05:28:31.574711+0000 mgr.a (mgr.14388) 8533 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:28:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:34 smithi163 bash[24253]: cluster 2024-08-31T05:28:32.985029+0000 mgr.a (mgr.14388) 8534 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:34 smithi027 bash[22610]: cluster 2024-08-31T05:28:32.985029+0000 mgr.a (mgr.14388) 8534 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:34 smithi191 bash[24992]: cluster 2024-08-31T05:28:32.985029+0000 mgr.a (mgr.14388) 8534 : cluster [DBG] pgmap v5914: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:35.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:35.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:35.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:36.660 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:28:36.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:36.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:36.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:36.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:36 smithi163 bash[24253]: cluster 2024-08-31T05:28:34.985769+0000 mgr.a (mgr.14388) 8535 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:36 smithi027 bash[22610]: cluster 2024-08-31T05:28:34.985769+0000 mgr.a (mgr.14388) 8535 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:36 smithi191 bash[24992]: cluster 2024-08-31T05:28:34.985769+0000 mgr.a (mgr.14388) 8535 : cluster [DBG] pgmap v5915: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:37 smithi163 bash[24253]: audit 2024-08-31T05:28:36.231951+0000 mgr.a (mgr.14388) 8536 : audit [DBG] from='client.191313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:37 smithi027 bash[22610]: audit 2024-08-31T05:28:36.231951+0000 mgr.a (mgr.14388) 8536 : audit [DBG] from='client.191313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:37 smithi191 bash[24992]: audit 2024-08-31T05:28:36.231951+0000 mgr.a (mgr.14388) 8536 : audit [DBG] from='client.191313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:38 smithi163 bash[24253]: cluster 2024-08-31T05:28:36.986748+0000 mgr.a (mgr.14388) 8537 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:38 smithi027 bash[22610]: cluster 2024-08-31T05:28:36.986748+0000 mgr.a (mgr.14388) 8537 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:38 smithi191 bash[24992]: cluster 2024-08-31T05:28:36.986748+0000 mgr.a (mgr.14388) 8537 : cluster [DBG] pgmap v5916: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:40 smithi163 bash[24253]: cluster 2024-08-31T05:28:38.988982+0000 mgr.a (mgr.14388) 8538 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:40 smithi027 bash[22610]: cluster 2024-08-31T05:28:38.988982+0000 mgr.a (mgr.14388) 8538 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:40 smithi191 bash[24992]: cluster 2024-08-31T05:28:38.988982+0000 mgr.a (mgr.14388) 8538 : cluster [DBG] pgmap v5917: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:41.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:41.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:41.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:42.410 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:28:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:42.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:42 smithi163 bash[24253]: cluster 2024-08-31T05:28:40.989871+0000 mgr.a (mgr.14388) 8539 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:42 smithi027 bash[22610]: cluster 2024-08-31T05:28:40.989871+0000 mgr.a (mgr.14388) 8539 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:42 smithi191 bash[24992]: cluster 2024-08-31T05:28:40.989871+0000 mgr.a (mgr.14388) 8539 : cluster [DBG] pgmap v5918: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:43 smithi163 bash[24253]: audit 2024-08-31T05:28:41.995720+0000 mgr.a (mgr.14388) 8540 : audit [DBG] from='client.191388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:43 smithi027 bash[22610]: audit 2024-08-31T05:28:41.995720+0000 mgr.a (mgr.14388) 8540 : audit [DBG] from='client.191388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:43 smithi191 bash[24992]: audit 2024-08-31T05:28:41.995720+0000 mgr.a (mgr.14388) 8540 : audit [DBG] from='client.191388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:44 smithi163 bash[24253]: cluster 2024-08-31T05:28:42.992312+0000 mgr.a (mgr.14388) 8541 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:44 smithi027 bash[22610]: cluster 2024-08-31T05:28:42.992312+0000 mgr.a (mgr.14388) 8541 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:44 smithi191 bash[24992]: cluster 2024-08-31T05:28:42.992312+0000 mgr.a (mgr.14388) 8541 : cluster [DBG] pgmap v5919: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:28:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:46 smithi163 bash[24253]: cluster 2024-08-31T05:28:44.993132+0000 mgr.a (mgr.14388) 8542 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:46 smithi027 bash[22610]: cluster 2024-08-31T05:28:44.993132+0000 mgr.a (mgr.14388) 8542 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:46 smithi191 bash[24992]: cluster 2024-08-31T05:28:44.993132+0000 mgr.a (mgr.14388) 8542 : cluster [DBG] pgmap v5920: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:47.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:47.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:47.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:48.160 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:28:48.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:48.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:48.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:48.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:48 smithi163 bash[24253]: cluster 2024-08-31T05:28:46.993845+0000 mgr.a (mgr.14388) 8543 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:48 smithi027 bash[22610]: cluster 2024-08-31T05:28:46.993845+0000 mgr.a (mgr.14388) 8543 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:48 smithi191 bash[24992]: cluster 2024-08-31T05:28:46.993845+0000 mgr.a (mgr.14388) 8543 : cluster [DBG] pgmap v5921: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:49 smithi163 bash[24253]: audit 2024-08-31T05:28:47.746492+0000 mgr.a (mgr.14388) 8544 : audit [DBG] from='client.191466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:49 smithi027 bash[22610]: audit 2024-08-31T05:28:47.746492+0000 mgr.a (mgr.14388) 8544 : audit [DBG] from='client.191466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:49 smithi191 bash[24992]: audit 2024-08-31T05:28:47.746492+0000 mgr.a (mgr.14388) 8544 : audit [DBG] from='client.191466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:50 smithi163 bash[24253]: cluster 2024-08-31T05:28:48.996586+0000 mgr.a (mgr.14388) 8545 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:50 smithi027 bash[22610]: cluster 2024-08-31T05:28:48.996586+0000 mgr.a (mgr.14388) 8545 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:50 smithi191 bash[24992]: cluster 2024-08-31T05:28:48.996586+0000 mgr.a (mgr.14388) 8545 : cluster [DBG] pgmap v5922: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:52 smithi163 bash[24253]: cluster 2024-08-31T05:28:50.997369+0000 mgr.a (mgr.14388) 8546 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:28:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:52 smithi027 bash[22610]: cluster 2024-08-31T05:28:50.997369+0000 mgr.a (mgr.14388) 8546 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:28:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:52 smithi191 bash[24992]: cluster 2024-08-31T05:28:50.997369+0000 mgr.a (mgr.14388) 8546 : cluster [DBG] pgmap v5923: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:28:53.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:53.162 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:53.162 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:53.912 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:28:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:54 smithi163 bash[24253]: cluster 2024-08-31T05:28:52.999300+0000 mgr.a (mgr.14388) 8547 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:54 smithi027 bash[22610]: cluster 2024-08-31T05:28:52.999300+0000 mgr.a (mgr.14388) 8547 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:54 smithi191 bash[24992]: cluster 2024-08-31T05:28:52.999300+0000 mgr.a (mgr.14388) 8547 : cluster [DBG] pgmap v5924: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:28:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:55 smithi163 bash[24253]: audit 2024-08-31T05:28:53.495084+0000 mgr.a (mgr.14388) 8548 : audit [DBG] from='client.191544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:55 smithi027 bash[22610]: audit 2024-08-31T05:28:53.495084+0000 mgr.a (mgr.14388) 8548 : audit [DBG] from='client.191544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:55 smithi191 bash[24992]: audit 2024-08-31T05:28:53.495084+0000 mgr.a (mgr.14388) 8548 : audit [DBG] from='client.191544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:56 smithi163 bash[24253]: cluster 2024-08-31T05:28:55.000202+0000 mgr.a (mgr.14388) 8549 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:28:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:56 smithi027 bash[22610]: cluster 2024-08-31T05:28:55.000202+0000 mgr.a (mgr.14388) 8549 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:28:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:56 smithi191 bash[24992]: cluster 2024-08-31T05:28:55.000202+0000 mgr.a (mgr.14388) 8549 : cluster [DBG] pgmap v5925: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:28:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:28:58 smithi163 bash[24253]: cluster 2024-08-31T05:28:57.000957+0000 mgr.a (mgr.14388) 8550 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:28:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:28:58 smithi027 bash[22610]: cluster 2024-08-31T05:28:57.000957+0000 mgr.a (mgr.14388) 8550 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:28:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:28:58 smithi191 bash[24992]: cluster 2024-08-31T05:28:57.000957+0000 mgr.a (mgr.14388) 8550 : cluster [DBG] pgmap v5926: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:28:58.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:28:58.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:28:58.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:28:59.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:28:59.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:28:59.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:28:59.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:28:59.691 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:00 smithi163 bash[24253]: cluster 2024-08-31T05:28:59.002961+0000 mgr.a (mgr.14388) 8551 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:00 smithi163 bash[24253]: audit 2024-08-31T05:28:59.251576+0000 mgr.a (mgr.14388) 8552 : audit [DBG] from='client.191619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:00 smithi027 bash[22610]: cluster 2024-08-31T05:28:59.002961+0000 mgr.a (mgr.14388) 8551 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:00 smithi027 bash[22610]: audit 2024-08-31T05:28:59.251576+0000 mgr.a (mgr.14388) 8552 : audit [DBG] from='client.191619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:00 smithi191 bash[24992]: cluster 2024-08-31T05:28:59.002961+0000 mgr.a (mgr.14388) 8551 : cluster [DBG] pgmap v5927: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:00 smithi191 bash[24992]: audit 2024-08-31T05:28:59.251576+0000 mgr.a (mgr.14388) 8552 : audit [DBG] from='client.191619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:02 smithi163 bash[24253]: cluster 2024-08-31T05:29:01.003807+0000 mgr.a (mgr.14388) 8553 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:02 smithi027 bash[22610]: cluster 2024-08-31T05:29:01.003807+0000 mgr.a (mgr.14388) 8553 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:02 smithi191 bash[24992]: cluster 2024-08-31T05:29:01.003807+0000 mgr.a (mgr.14388) 8553 : cluster [DBG] pgmap v5928: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:04.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:29:04.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:29:04.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:29:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:04 smithi163 bash[24253]: cluster 2024-08-31T05:29:03.005960+0000 mgr.a (mgr.14388) 8554 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:04 smithi027 bash[22610]: cluster 2024-08-31T05:29:03.005960+0000 mgr.a (mgr.14388) 8554 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:04 smithi191 bash[24992]: cluster 2024-08-31T05:29:03.005960+0000 mgr.a (mgr.14388) 8554 : cluster [DBG] pgmap v5929: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:05.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:29:05.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:29:05.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:29:05.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:29:05.437 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:06 smithi163 bash[24253]: cluster 2024-08-31T05:29:05.006680+0000 mgr.a (mgr.14388) 8555 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:06.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:06 smithi163 bash[24253]: audit 2024-08-31T05:29:05.022774+0000 mgr.a (mgr.14388) 8556 : audit [DBG] from='client.191688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:06 smithi027 bash[22610]: cluster 2024-08-31T05:29:05.006680+0000 mgr.a (mgr.14388) 8555 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:06 smithi027 bash[22610]: audit 2024-08-31T05:29:05.022774+0000 mgr.a (mgr.14388) 8556 : audit [DBG] from='client.191688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:06 smithi191 bash[24992]: cluster 2024-08-31T05:29:05.006680+0000 mgr.a (mgr.14388) 8555 : cluster [DBG] pgmap v5930: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:06 smithi191 bash[24992]: audit 2024-08-31T05:29:05.022774+0000 mgr.a (mgr.14388) 8556 : audit [DBG] from='client.191688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:08 smithi163 bash[24253]: cluster 2024-08-31T05:29:07.007613+0000 mgr.a (mgr.14388) 8557 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:08 smithi027 bash[22610]: cluster 2024-08-31T05:29:07.007613+0000 mgr.a (mgr.14388) 8557 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:08 smithi191 bash[24992]: cluster 2024-08-31T05:29:07.007613+0000 mgr.a (mgr.14388) 8557 : cluster [DBG] pgmap v5931: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:10.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:29:10.439 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:29:10.439 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:29:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:10 smithi163 bash[24253]: cluster 2024-08-31T05:29:09.009863+0000 mgr.a (mgr.14388) 8558 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:10 smithi027 bash[22610]: cluster 2024-08-31T05:29:09.009863+0000 mgr.a (mgr.14388) 8558 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:10 smithi191 bash[24992]: cluster 2024-08-31T05:29:09.009863+0000 mgr.a (mgr.14388) 8558 : cluster [DBG] pgmap v5932: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:11.185 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:29:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:29:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:29:11.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:29:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:12 smithi163 bash[24253]: audit 2024-08-31T05:29:10.770061+0000 mgr.a (mgr.14388) 8559 : audit [DBG] from='client.191766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:12 smithi163 bash[24253]: cluster 2024-08-31T05:29:11.010410+0000 mgr.a (mgr.14388) 8560 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:12 smithi027 bash[22610]: audit 2024-08-31T05:29:10.770061+0000 mgr.a (mgr.14388) 8559 : audit [DBG] from='client.191766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:12 smithi027 bash[22610]: cluster 2024-08-31T05:29:11.010410+0000 mgr.a (mgr.14388) 8560 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:12 smithi191 bash[24992]: audit 2024-08-31T05:29:10.770061+0000 mgr.a (mgr.14388) 8559 : audit [DBG] from='client.191766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:12 smithi191 bash[24992]: cluster 2024-08-31T05:29:11.010410+0000 mgr.a (mgr.14388) 8560 : cluster [DBG] pgmap v5933: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:14 smithi163 bash[24253]: cluster 2024-08-31T05:29:13.012623+0000 mgr.a (mgr.14388) 8561 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:14 smithi027 bash[22610]: cluster 2024-08-31T05:29:13.012623+0000 mgr.a (mgr.14388) 8561 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:14 smithi191 bash[24992]: cluster 2024-08-31T05:29:13.012623+0000 mgr.a (mgr.14388) 8561 : cluster [DBG] pgmap v5934: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:16.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:29:16.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:29:16.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:29:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:16 smithi163 bash[24253]: cluster 2024-08-31T05:29:15.013404+0000 mgr.a (mgr.14388) 8562 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:16 smithi027 bash[22610]: cluster 2024-08-31T05:29:15.013404+0000 mgr.a (mgr.14388) 8562 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:16 smithi191 bash[24992]: cluster 2024-08-31T05:29:15.013404+0000 mgr.a (mgr.14388) 8562 : cluster [DBG] pgmap v5935: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:16.943 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:29:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:29:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:29:16.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:29:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:18 smithi163 bash[24253]: audit 2024-08-31T05:29:16.523830+0000 mgr.a (mgr.14388) 8563 : audit [DBG] from='client.191844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:18 smithi163 bash[24253]: cluster 2024-08-31T05:29:17.014147+0000 mgr.a (mgr.14388) 8564 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:18 smithi027 bash[22610]: audit 2024-08-31T05:29:16.523830+0000 mgr.a (mgr.14388) 8563 : audit [DBG] from='client.191844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:18 smithi027 bash[22610]: cluster 2024-08-31T05:29:17.014147+0000 mgr.a (mgr.14388) 8564 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:18 smithi191 bash[24992]: audit 2024-08-31T05:29:16.523830+0000 mgr.a (mgr.14388) 8563 : audit [DBG] from='client.191844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:18 smithi191 bash[24992]: cluster 2024-08-31T05:29:17.014147+0000 mgr.a (mgr.14388) 8564 : cluster [DBG] pgmap v5936: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:20 smithi163 bash[24253]: cluster 2024-08-31T05:29:19.016344+0000 mgr.a (mgr.14388) 8565 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:20 smithi027 bash[22610]: cluster 2024-08-31T05:29:19.016344+0000 mgr.a (mgr.14388) 8565 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:20 smithi191 bash[24992]: cluster 2024-08-31T05:29:19.016344+0000 mgr.a (mgr.14388) 8565 : cluster [DBG] pgmap v5937: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:21.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:29:21.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:29:21.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:29:22.694 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:22.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:29:22.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:29:22.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:29:22.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:29:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:22 smithi163 bash[24253]: cluster 2024-08-31T05:29:21.017078+0000 mgr.a (mgr.14388) 8566 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:22 smithi027 bash[22610]: cluster 2024-08-31T05:29:21.017078+0000 mgr.a (mgr.14388) 8566 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:22 smithi191 bash[24992]: cluster 2024-08-31T05:29:21.017078+0000 mgr.a (mgr.14388) 8566 : cluster [DBG] pgmap v5938: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:23 smithi163 bash[24253]: audit 2024-08-31T05:29:22.274701+0000 mgr.a (mgr.14388) 8567 : audit [DBG] from='client.191922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:23 smithi163 bash[24253]: cluster 2024-08-31T05:29:23.019241+0000 mgr.a (mgr.14388) 8568 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:23 smithi027 bash[22610]: audit 2024-08-31T05:29:22.274701+0000 mgr.a (mgr.14388) 8567 : audit [DBG] from='client.191922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:23 smithi027 bash[22610]: cluster 2024-08-31T05:29:23.019241+0000 mgr.a (mgr.14388) 8568 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:23 smithi191 bash[24992]: audit 2024-08-31T05:29:22.274701+0000 mgr.a (mgr.14388) 8567 : audit [DBG] from='client.191922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:23 smithi191 bash[24992]: cluster 2024-08-31T05:29:23.019241+0000 mgr.a (mgr.14388) 8568 : cluster [DBG] pgmap v5939: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:26 smithi163 bash[24253]: cluster 2024-08-31T05:29:25.019990+0000 mgr.a (mgr.14388) 8569 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:26 smithi027 bash[22610]: cluster 2024-08-31T05:29:25.019990+0000 mgr.a (mgr.14388) 8569 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:26 smithi191 bash[24992]: cluster 2024-08-31T05:29:25.019990+0000 mgr.a (mgr.14388) 8569 : cluster [DBG] pgmap v5940: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:27.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:29:27.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:29:27.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:29:28.448 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:28.448 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:29:28.448 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:29:28.448 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:29:28.448 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:29:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:28 smithi163 bash[24253]: cluster 2024-08-31T05:29:27.020784+0000 mgr.a (mgr.14388) 8570 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:28 smithi027 bash[22610]: cluster 2024-08-31T05:29:27.020784+0000 mgr.a (mgr.14388) 8570 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:28 smithi191 bash[24992]: cluster 2024-08-31T05:29:27.020784+0000 mgr.a (mgr.14388) 8570 : cluster [DBG] pgmap v5941: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:29 smithi163 bash[24253]: audit 2024-08-31T05:29:28.029408+0000 mgr.a (mgr.14388) 8571 : audit [DBG] from='client.191997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:29 smithi027 bash[22610]: audit 2024-08-31T05:29:28.029408+0000 mgr.a (mgr.14388) 8571 : audit [DBG] from='client.191997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:29 smithi191 bash[24992]: audit 2024-08-31T05:29:28.029408+0000 mgr.a (mgr.14388) 8571 : audit [DBG] from='client.191997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:30.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:30 smithi163 bash[24253]: cluster 2024-08-31T05:29:29.023639+0000 mgr.a (mgr.14388) 8572 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:30 smithi027 bash[22610]: cluster 2024-08-31T05:29:29.023639+0000 mgr.a (mgr.14388) 8572 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:30 smithi191 bash[24992]: cluster 2024-08-31T05:29:29.023639+0000 mgr.a (mgr.14388) 8572 : cluster [DBG] pgmap v5942: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:32 smithi163 bash[24253]: cluster 2024-08-31T05:29:31.024395+0000 mgr.a (mgr.14388) 8573 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:29:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:32 smithi163 bash[24253]: audit 2024-08-31T05:29:31.627788+0000 mon.a (mon.0) 1863 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:29:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:32 smithi027 bash[22610]: cluster 2024-08-31T05:29:31.024395+0000 mgr.a (mgr.14388) 8573 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:29:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:32 smithi027 bash[22610]: audit 2024-08-31T05:29:31.627788+0000 mon.a (mon.0) 1863 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:29:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:32 smithi191 bash[24992]: cluster 2024-08-31T05:29:31.024395+0000 mgr.a (mgr.14388) 8573 : cluster [DBG] pgmap v5943: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:29:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:32 smithi191 bash[24992]: audit 2024-08-31T05:29:31.627788+0000 mon.a (mon.0) 1863 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:29:33.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:29:33.450 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:29:33.450 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:29:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:33 smithi163 bash[24253]: audit 2024-08-31T05:29:32.459358+0000 mon.a (mon.0) 1864 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:29:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:33 smithi163 bash[24253]: audit 2024-08-31T05:29:32.460718+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:29:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:33 smithi163 bash[24253]: audit 2024-08-31T05:29:32.469391+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:29:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:33 smithi163 bash[24253]: audit 2024-08-31T05:29:32.474301+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:29:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:33 smithi027 bash[22610]: audit 2024-08-31T05:29:32.459358+0000 mon.a (mon.0) 1864 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:29:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:33 smithi027 bash[22610]: audit 2024-08-31T05:29:32.460718+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:29:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:33 smithi027 bash[22610]: audit 2024-08-31T05:29:32.469391+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:29:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:33 smithi027 bash[22610]: audit 2024-08-31T05:29:32.474301+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:29:33.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:29:33 smithi027 bash[22863]: debug 2024-08-31T05:29:33.220+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:29:33.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:29:33 smithi027 bash[22863]: debug 2024-08-31T05:29:33.220+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:29:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:33 smithi191 bash[24992]: audit 2024-08-31T05:29:32.459358+0000 mon.a (mon.0) 1864 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:29:33.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:33 smithi191 bash[24992]: audit 2024-08-31T05:29:32.460718+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:29:33.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:33 smithi191 bash[24992]: audit 2024-08-31T05:29:32.469391+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:29:33.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:33 smithi191 bash[24992]: audit 2024-08-31T05:29:32.474301+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:29:34.188 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:29:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:29:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:29:34.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:29:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:34 smithi163 bash[24253]: audit 2024-08-31T05:29:32.475469+0000 mgr.a (mgr.14388) 8574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:29:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:34 smithi163 bash[24253]: cluster 2024-08-31T05:29:33.025782+0000 mgr.a (mgr.14388) 8575 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:29:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:34 smithi163 bash[24253]: audit 2024-08-31T05:29:33.223679+0000 mgr.a (mgr.14388) 8576 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:29:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:34 smithi163 bash[24253]: cephadm 2024-08-31T05:29:33.225445+0000 mgr.a (mgr.14388) 8577 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:29:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:34 smithi027 bash[22610]: audit 2024-08-31T05:29:32.475469+0000 mgr.a (mgr.14388) 8574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:29:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:34 smithi027 bash[22610]: cluster 2024-08-31T05:29:33.025782+0000 mgr.a (mgr.14388) 8575 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:29:34.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:34 smithi027 bash[22610]: audit 2024-08-31T05:29:33.223679+0000 mgr.a (mgr.14388) 8576 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:29:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:34 smithi027 bash[22610]: cephadm 2024-08-31T05:29:33.225445+0000 mgr.a (mgr.14388) 8577 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:29:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:34 smithi191 bash[24992]: audit 2024-08-31T05:29:32.475469+0000 mgr.a (mgr.14388) 8574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:29:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:34 smithi191 bash[24992]: cluster 2024-08-31T05:29:33.025782+0000 mgr.a (mgr.14388) 8575 : cluster [DBG] pgmap v5944: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T05:29:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:34 smithi191 bash[24992]: audit 2024-08-31T05:29:33.223679+0000 mgr.a (mgr.14388) 8576 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:29:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:34 smithi191 bash[24992]: cephadm 2024-08-31T05:29:33.225445+0000 mgr.a (mgr.14388) 8577 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:29:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:35 smithi163 bash[24253]: audit 2024-08-31T05:29:33.772095+0000 mgr.a (mgr.14388) 8578 : audit [DBG] from='client.192183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:35 smithi027 bash[22610]: audit 2024-08-31T05:29:33.772095+0000 mgr.a (mgr.14388) 8578 : audit [DBG] from='client.192183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:35 smithi191 bash[24992]: audit 2024-08-31T05:29:33.772095+0000 mgr.a (mgr.14388) 8578 : audit [DBG] from='client.192183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:36 smithi163 bash[24253]: cluster 2024-08-31T05:29:35.026776+0000 mgr.a (mgr.14388) 8579 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:29:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:36 smithi027 bash[22610]: cluster 2024-08-31T05:29:35.026776+0000 mgr.a (mgr.14388) 8579 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:29:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:36 smithi191 bash[24992]: cluster 2024-08-31T05:29:35.026776+0000 mgr.a (mgr.14388) 8579 : cluster [DBG] pgmap v5945: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:29:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:38 smithi163 bash[24253]: cluster 2024-08-31T05:29:37.027557+0000 mgr.a (mgr.14388) 8580 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:29:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:38 smithi027 bash[22610]: cluster 2024-08-31T05:29:37.027557+0000 mgr.a (mgr.14388) 8580 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:29:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:38 smithi191 bash[24992]: cluster 2024-08-31T05:29:37.027557+0000 mgr.a (mgr.14388) 8580 : cluster [DBG] pgmap v5946: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-08-31T05:29:39.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:29:39.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:29:39.191 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:29:39.935 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:39.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:29:39.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:29:39.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:29:39.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:29:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:40 smithi163 bash[24253]: cluster 2024-08-31T05:29:39.029759+0000 mgr.a (mgr.14388) 8581 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:29:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:40 smithi027 bash[22610]: cluster 2024-08-31T05:29:39.029759+0000 mgr.a (mgr.14388) 8581 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:29:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:40 smithi191 bash[24992]: cluster 2024-08-31T05:29:39.029759+0000 mgr.a (mgr.14388) 8581 : cluster [DBG] pgmap v5947: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:29:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:41 smithi163 bash[24253]: audit 2024-08-31T05:29:39.525340+0000 mgr.a (mgr.14388) 8582 : audit [DBG] from='client.192261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:41.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:41 smithi027 bash[22610]: audit 2024-08-31T05:29:39.525340+0000 mgr.a (mgr.14388) 8582 : audit [DBG] from='client.192261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:41 smithi191 bash[24992]: audit 2024-08-31T05:29:39.525340+0000 mgr.a (mgr.14388) 8582 : audit [DBG] from='client.192261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:42 smithi163 bash[24253]: cluster 2024-08-31T05:29:41.030786+0000 mgr.a (mgr.14388) 8583 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:29:42.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:42 smithi027 bash[22610]: cluster 2024-08-31T05:29:41.030786+0000 mgr.a (mgr.14388) 8583 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:29:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:42 smithi191 bash[24992]: cluster 2024-08-31T05:29:41.030786+0000 mgr.a (mgr.14388) 8583 : cluster [DBG] pgmap v5948: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:29:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:44 smithi163 bash[24253]: cluster 2024-08-31T05:29:43.032956+0000 mgr.a (mgr.14388) 8584 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:29:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:44 smithi027 bash[22610]: cluster 2024-08-31T05:29:43.032956+0000 mgr.a (mgr.14388) 8584 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:29:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:44 smithi191 bash[24992]: cluster 2024-08-31T05:29:43.032956+0000 mgr.a (mgr.14388) 8584 : cluster [DBG] pgmap v5949: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:29:44.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:29:44.937 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:29:44.938 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:29:45.711 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:29:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:29:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:29:45.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:29:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:46 smithi163 bash[24253]: cluster 2024-08-31T05:29:45.033648+0000 mgr.a (mgr.14388) 8585 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:29:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:46 smithi163 bash[24253]: audit 2024-08-31T05:29:45.276306+0000 mgr.a (mgr.14388) 8586 : audit [DBG] from='client.192339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:46 smithi027 bash[22610]: cluster 2024-08-31T05:29:45.033648+0000 mgr.a (mgr.14388) 8585 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:29:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:46 smithi027 bash[22610]: audit 2024-08-31T05:29:45.276306+0000 mgr.a (mgr.14388) 8586 : audit [DBG] from='client.192339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:46 smithi191 bash[24992]: cluster 2024-08-31T05:29:45.033648+0000 mgr.a (mgr.14388) 8585 : cluster [DBG] pgmap v5950: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:29:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:46 smithi191 bash[24992]: audit 2024-08-31T05:29:45.276306+0000 mgr.a (mgr.14388) 8586 : audit [DBG] from='client.192339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:48 smithi163 bash[24253]: cluster 2024-08-31T05:29:47.034633+0000 mgr.a (mgr.14388) 8587 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:29:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:48 smithi027 bash[22610]: cluster 2024-08-31T05:29:47.034633+0000 mgr.a (mgr.14388) 8587 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:29:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:48 smithi191 bash[24992]: cluster 2024-08-31T05:29:47.034633+0000 mgr.a (mgr.14388) 8587 : cluster [DBG] pgmap v5951: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:29:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:50 smithi163 bash[24253]: cluster 2024-08-31T05:29:49.036922+0000 mgr.a (mgr.14388) 8588 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:29:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:50 smithi027 bash[22610]: cluster 2024-08-31T05:29:49.036922+0000 mgr.a (mgr.14388) 8588 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:29:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:50 smithi191 bash[24992]: cluster 2024-08-31T05:29:49.036922+0000 mgr.a (mgr.14388) 8588 : cluster [DBG] pgmap v5952: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T05:29:50.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:29:50.713 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:29:50.713 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:29:51.496 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:51.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:29:51.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:29:51.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:29:51.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:29:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:52 smithi163 bash[24253]: cluster 2024-08-31T05:29:51.037482+0000 mgr.a (mgr.14388) 8589 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:52 smithi163 bash[24253]: audit 2024-08-31T05:29:51.053128+0000 mgr.a (mgr.14388) 8590 : audit [DBG] from='client.192417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:52 smithi027 bash[22610]: cluster 2024-08-31T05:29:51.037482+0000 mgr.a (mgr.14388) 8589 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:52.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:52 smithi027 bash[22610]: audit 2024-08-31T05:29:51.053128+0000 mgr.a (mgr.14388) 8590 : audit [DBG] from='client.192417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:52 smithi191 bash[24992]: cluster 2024-08-31T05:29:51.037482+0000 mgr.a (mgr.14388) 8589 : cluster [DBG] pgmap v5953: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:52 smithi191 bash[24992]: audit 2024-08-31T05:29:51.053128+0000 mgr.a (mgr.14388) 8590 : audit [DBG] from='client.192417 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:54 smithi163 bash[24253]: cluster 2024-08-31T05:29:53.039893+0000 mgr.a (mgr.14388) 8591 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:54 smithi027 bash[22610]: cluster 2024-08-31T05:29:53.039893+0000 mgr.a (mgr.14388) 8591 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:54 smithi191 bash[24992]: cluster 2024-08-31T05:29:53.039893+0000 mgr.a (mgr.14388) 8591 : cluster [DBG] pgmap v5954: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:29:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:56 smithi163 bash[24253]: cluster 2024-08-31T05:29:55.040733+0000 mgr.a (mgr.14388) 8592 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:56 smithi027 bash[22610]: cluster 2024-08-31T05:29:55.040733+0000 mgr.a (mgr.14388) 8592 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:56.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:29:56.498 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:29:56.499 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:29:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:56 smithi191 bash[24992]: cluster 2024-08-31T05:29:55.040733+0000 mgr.a (mgr.14388) 8592 : cluster [DBG] pgmap v5955: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:57.275 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:29:57.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:29:57.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:29:57.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:29:57.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:29:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:58 smithi163 bash[24253]: audit 2024-08-31T05:29:56.836414+0000 mgr.a (mgr.14388) 8593 : audit [DBG] from='client.192492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:29:58 smithi163 bash[24253]: cluster 2024-08-31T05:29:57.041368+0000 mgr.a (mgr.14388) 8594 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:58 smithi027 bash[22610]: audit 2024-08-31T05:29:56.836414+0000 mgr.a (mgr.14388) 8593 : audit [DBG] from='client.192492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:29:58 smithi027 bash[22610]: cluster 2024-08-31T05:29:57.041368+0000 mgr.a (mgr.14388) 8594 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:29:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:58 smithi191 bash[24992]: audit 2024-08-31T05:29:56.836414+0000 mgr.a (mgr.14388) 8593 : audit [DBG] from='client.192492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:29:58 smithi191 bash[24992]: cluster 2024-08-31T05:29:57.041368+0000 mgr.a (mgr.14388) 8594 : cluster [DBG] pgmap v5956: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:00 smithi163 bash[24253]: cluster 2024-08-31T05:29:59.043711+0000 mgr.a (mgr.14388) 8595 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:00 smithi163 bash[24253]: cluster 2024-08-31T05:30:00.000147+0000 mon.a (mon.0) 1868 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:30:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:00 smithi027 bash[22610]: cluster 2024-08-31T05:29:59.043711+0000 mgr.a (mgr.14388) 8595 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:00 smithi027 bash[22610]: cluster 2024-08-31T05:30:00.000147+0000 mon.a (mon.0) 1868 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:30:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:00 smithi191 bash[24992]: cluster 2024-08-31T05:29:59.043711+0000 mgr.a (mgr.14388) 8595 : cluster [DBG] pgmap v5957: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:00 smithi191 bash[24992]: cluster 2024-08-31T05:30:00.000147+0000 mon.a (mon.0) 1868 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:30:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:30:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:30:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:30:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:02 smithi163 bash[24253]: cluster 2024-08-31T05:30:01.044483+0000 mgr.a (mgr.14388) 8596 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:02 smithi027 bash[22610]: cluster 2024-08-31T05:30:01.044483+0000 mgr.a (mgr.14388) 8596 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:02 smithi191 bash[24992]: cluster 2024-08-31T05:30:01.044483+0000 mgr.a (mgr.14388) 8596 : cluster [DBG] pgmap v5958: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:03.065 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:30:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:30:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:30:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:30:03.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:30:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:04 smithi163 bash[24253]: audit 2024-08-31T05:30:02.616512+0000 mgr.a (mgr.14388) 8597 : audit [DBG] from='client.192570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:04 smithi163 bash[24253]: cluster 2024-08-31T05:30:03.046132+0000 mgr.a (mgr.14388) 8598 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:04 smithi027 bash[22610]: audit 2024-08-31T05:30:02.616512+0000 mgr.a (mgr.14388) 8597 : audit [DBG] from='client.192570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:04 smithi027 bash[22610]: cluster 2024-08-31T05:30:03.046132+0000 mgr.a (mgr.14388) 8598 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:04 smithi191 bash[24992]: audit 2024-08-31T05:30:02.616512+0000 mgr.a (mgr.14388) 8597 : audit [DBG] from='client.192570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:04 smithi191 bash[24992]: cluster 2024-08-31T05:30:03.046132+0000 mgr.a (mgr.14388) 8598 : cluster [DBG] pgmap v5959: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:06 smithi163 bash[24253]: cluster 2024-08-31T05:30:05.046928+0000 mgr.a (mgr.14388) 8599 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:30:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:06 smithi027 bash[22610]: cluster 2024-08-31T05:30:05.046928+0000 mgr.a (mgr.14388) 8599 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:30:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:06 smithi191 bash[24992]: cluster 2024-08-31T05:30:05.046928+0000 mgr.a (mgr.14388) 8599 : cluster [DBG] pgmap v5960: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:30:08.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:30:08.068 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:30:08.068 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:30:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:08 smithi163 bash[24253]: cluster 2024-08-31T05:30:07.047742+0000 mgr.a (mgr.14388) 8600 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:30:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:08 smithi027 bash[22610]: cluster 2024-08-31T05:30:07.047742+0000 mgr.a (mgr.14388) 8600 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:30:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:08 smithi191 bash[24992]: cluster 2024-08-31T05:30:07.047742+0000 mgr.a (mgr.14388) 8600 : cluster [DBG] pgmap v5961: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:30:08.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:30:08.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:30:08.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:30:08.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:30:08.851 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:30:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:09 smithi163 bash[24253]: audit 2024-08-31T05:30:08.404461+0000 mgr.a (mgr.14388) 8601 : audit [DBG] from='client.192642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:09 smithi027 bash[22610]: audit 2024-08-31T05:30:08.404461+0000 mgr.a (mgr.14388) 8601 : audit [DBG] from='client.192642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:09 smithi191 bash[24992]: audit 2024-08-31T05:30:08.404461+0000 mgr.a (mgr.14388) 8601 : audit [DBG] from='client.192642 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:10 smithi163 bash[24253]: cluster 2024-08-31T05:30:09.050595+0000 mgr.a (mgr.14388) 8602 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:10 smithi027 bash[22610]: cluster 2024-08-31T05:30:09.050595+0000 mgr.a (mgr.14388) 8602 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:10 smithi191 bash[24992]: cluster 2024-08-31T05:30:09.050595+0000 mgr.a (mgr.14388) 8602 : cluster [DBG] pgmap v5962: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:12 smithi027 bash[22610]: cluster 2024-08-31T05:30:11.051358+0000 mgr.a (mgr.14388) 8603 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:30:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:12 smithi191 bash[24992]: cluster 2024-08-31T05:30:11.051358+0000 mgr.a (mgr.14388) 8603 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:30:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:12 smithi163 bash[24253]: cluster 2024-08-31T05:30:11.051358+0000 mgr.a (mgr.14388) 8603 : cluster [DBG] pgmap v5963: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:30:13.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:30:13.852 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:30:13.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:30:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:14 smithi027 bash[22610]: cluster 2024-08-31T05:30:13.053216+0000 mgr.a (mgr.14388) 8604 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:14 smithi191 bash[24992]: cluster 2024-08-31T05:30:13.053216+0000 mgr.a (mgr.14388) 8604 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:14.634 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:30:14.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:30:14.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:30:14.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:30:14.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:30:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:14 smithi163 bash[24253]: cluster 2024-08-31T05:30:13.053216+0000 mgr.a (mgr.14388) 8604 : cluster [DBG] pgmap v5964: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:15 smithi027 bash[22610]: audit 2024-08-31T05:30:14.191944+0000 mgr.a (mgr.14388) 8605 : audit [DBG] from='client.192720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:15 smithi191 bash[24992]: audit 2024-08-31T05:30:14.191944+0000 mgr.a (mgr.14388) 8605 : audit [DBG] from='client.192720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:15 smithi163 bash[24253]: audit 2024-08-31T05:30:14.191944+0000 mgr.a (mgr.14388) 8605 : audit [DBG] from='client.192720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:16 smithi027 bash[22610]: cluster 2024-08-31T05:30:15.054169+0000 mgr.a (mgr.14388) 8606 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:16 smithi191 bash[24992]: cluster 2024-08-31T05:30:15.054169+0000 mgr.a (mgr.14388) 8606 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:16 smithi163 bash[24253]: cluster 2024-08-31T05:30:15.054169+0000 mgr.a (mgr.14388) 8606 : cluster [DBG] pgmap v5965: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:18 smithi027 bash[22610]: cluster 2024-08-31T05:30:17.055005+0000 mgr.a (mgr.14388) 8607 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:18 smithi191 bash[24992]: cluster 2024-08-31T05:30:17.055005+0000 mgr.a (mgr.14388) 8607 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:18 smithi163 bash[24253]: cluster 2024-08-31T05:30:17.055005+0000 mgr.a (mgr.14388) 8607 : cluster [DBG] pgmap v5966: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:19.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:30:19.637 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:30:19.637 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:30:20.419 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:30:20.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:30:20.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:30:20.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:30:20.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:30:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:20 smithi027 bash[22610]: cluster 2024-08-31T05:30:19.057194+0000 mgr.a (mgr.14388) 8608 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:20 smithi191 bash[24992]: cluster 2024-08-31T05:30:19.057194+0000 mgr.a (mgr.14388) 8608 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:20 smithi163 bash[24253]: cluster 2024-08-31T05:30:19.057194+0000 mgr.a (mgr.14388) 8608 : cluster [DBG] pgmap v5967: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:21 smithi191 bash[24992]: audit 2024-08-31T05:30:19.984870+0000 mgr.a (mgr.14388) 8609 : audit [DBG] from='client.192795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:21 smithi163 bash[24253]: audit 2024-08-31T05:30:19.984870+0000 mgr.a (mgr.14388) 8609 : audit [DBG] from='client.192795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:21 smithi027 bash[22610]: audit 2024-08-31T05:30:19.984870+0000 mgr.a (mgr.14388) 8609 : audit [DBG] from='client.192795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:22 smithi191 bash[24992]: cluster 2024-08-31T05:30:21.058176+0000 mgr.a (mgr.14388) 8610 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:22 smithi163 bash[24253]: cluster 2024-08-31T05:30:21.058176+0000 mgr.a (mgr.14388) 8610 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:22 smithi027 bash[22610]: cluster 2024-08-31T05:30:21.058176+0000 mgr.a (mgr.14388) 8610 : cluster [DBG] pgmap v5968: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:24 smithi191 bash[24992]: cluster 2024-08-31T05:30:23.060379+0000 mgr.a (mgr.14388) 8611 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:24 smithi163 bash[24253]: cluster 2024-08-31T05:30:23.060379+0000 mgr.a (mgr.14388) 8611 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:24 smithi027 bash[22610]: cluster 2024-08-31T05:30:23.060379+0000 mgr.a (mgr.14388) 8611 : cluster [DBG] pgmap v5969: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:25.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:30:25.421 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:30:25.421 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:30:26.197 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:30:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:30:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:30:26.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:30:26.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:30:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:26 smithi191 bash[24992]: cluster 2024-08-31T05:30:25.061183+0000 mgr.a (mgr.14388) 8612 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:26 smithi163 bash[24253]: cluster 2024-08-31T05:30:25.061183+0000 mgr.a (mgr.14388) 8612 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:26 smithi027 bash[22610]: cluster 2024-08-31T05:30:25.061183+0000 mgr.a (mgr.14388) 8612 : cluster [DBG] pgmap v5970: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:27 smithi191 bash[24992]: audit 2024-08-31T05:30:25.758258+0000 mgr.a (mgr.14388) 8613 : audit [DBG] from='client.192873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:27 smithi163 bash[24253]: audit 2024-08-31T05:30:25.758258+0000 mgr.a (mgr.14388) 8613 : audit [DBG] from='client.192873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:27.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:27 smithi027 bash[22610]: audit 2024-08-31T05:30:25.758258+0000 mgr.a (mgr.14388) 8613 : audit [DBG] from='client.192873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:28 smithi191 bash[24992]: cluster 2024-08-31T05:30:27.062151+0000 mgr.a (mgr.14388) 8614 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:28 smithi163 bash[24253]: cluster 2024-08-31T05:30:27.062151+0000 mgr.a (mgr.14388) 8614 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:28 smithi027 bash[22610]: cluster 2024-08-31T05:30:27.062151+0000 mgr.a (mgr.14388) 8614 : cluster [DBG] pgmap v5971: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:30 smithi191 bash[24992]: cluster 2024-08-31T05:30:29.064417+0000 mgr.a (mgr.14388) 8615 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:30 smithi163 bash[24253]: cluster 2024-08-31T05:30:29.064417+0000 mgr.a (mgr.14388) 8615 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:30 smithi027 bash[22610]: cluster 2024-08-31T05:30:29.064417+0000 mgr.a (mgr.14388) 8615 : cluster [DBG] pgmap v5972: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:31.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:30:31.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:30:31.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:30:31.978 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:30:31.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:30:31.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:30:31.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:30:31.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:30:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:32 smithi191 bash[24992]: cluster 2024-08-31T05:30:31.065193+0000 mgr.a (mgr.14388) 8616 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:32 smithi163 bash[24253]: cluster 2024-08-31T05:30:31.065193+0000 mgr.a (mgr.14388) 8616 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:32 smithi027 bash[22610]: cluster 2024-08-31T05:30:31.065193+0000 mgr.a (mgr.14388) 8616 : cluster [DBG] pgmap v5973: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:33 smithi191 bash[24992]: audit 2024-08-31T05:30:31.535162+0000 mgr.a (mgr.14388) 8617 : audit [DBG] from='client.192948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:33 smithi163 bash[24253]: audit 2024-08-31T05:30:31.535162+0000 mgr.a (mgr.14388) 8617 : audit [DBG] from='client.192948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:33 smithi027 bash[22610]: audit 2024-08-31T05:30:31.535162+0000 mgr.a (mgr.14388) 8617 : audit [DBG] from='client.192948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:34 smithi191 bash[24992]: cluster 2024-08-31T05:30:33.067508+0000 mgr.a (mgr.14388) 8618 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:34 smithi191 bash[24992]: audit 2024-08-31T05:30:33.281083+0000 mon.a (mon.0) 1869 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:30:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:34 smithi191 bash[24992]: audit 2024-08-31T05:30:34.127278+0000 mon.a (mon.0) 1870 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:30:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:34 smithi191 bash[24992]: audit 2024-08-31T05:30:34.129181+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:30:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:34 smithi191 bash[24992]: audit 2024-08-31T05:30:34.139977+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:30:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:34 smithi191 bash[24992]: audit 2024-08-31T05:30:34.145031+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:30:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:34 smithi163 bash[24253]: cluster 2024-08-31T05:30:33.067508+0000 mgr.a (mgr.14388) 8618 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:34 smithi163 bash[24253]: audit 2024-08-31T05:30:33.281083+0000 mon.a (mon.0) 1869 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:30:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:34 smithi163 bash[24253]: audit 2024-08-31T05:30:34.127278+0000 mon.a (mon.0) 1870 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:30:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:34 smithi163 bash[24253]: audit 2024-08-31T05:30:34.129181+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:30:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:34 smithi163 bash[24253]: audit 2024-08-31T05:30:34.139977+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:30:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:34 smithi163 bash[24253]: audit 2024-08-31T05:30:34.145031+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:30:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:34 smithi027 bash[22610]: cluster 2024-08-31T05:30:33.067508+0000 mgr.a (mgr.14388) 8618 : cluster [DBG] pgmap v5974: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:30:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:34 smithi027 bash[22610]: audit 2024-08-31T05:30:33.281083+0000 mon.a (mon.0) 1869 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:30:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:34 smithi027 bash[22610]: audit 2024-08-31T05:30:34.127278+0000 mon.a (mon.0) 1870 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:30:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:34 smithi027 bash[22610]: audit 2024-08-31T05:30:34.129181+0000 mon.a (mon.0) 1871 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:30:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:34 smithi027 bash[22610]: audit 2024-08-31T05:30:34.139977+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:30:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:34 smithi027 bash[22610]: audit 2024-08-31T05:30:34.145031+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:30:35.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:30:34 smithi027 bash[22863]: debug 2024-08-31T05:30:34.874+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:30:35.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:30:34 smithi027 bash[22863]: debug 2024-08-31T05:30:34.874+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:30:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:35 smithi191 bash[24992]: audit 2024-08-31T05:30:34.147400+0000 mgr.a (mgr.14388) 8619 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:30:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:35 smithi163 bash[24253]: audit 2024-08-31T05:30:34.147400+0000 mgr.a (mgr.14388) 8619 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:30:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:35 smithi027 bash[22610]: audit 2024-08-31T05:30:34.147400+0000 mgr.a (mgr.14388) 8619 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:30:36.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:36 smithi191 bash[24992]: audit 2024-08-31T05:30:34.880249+0000 mgr.a (mgr.14388) 8620 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:30:36.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:36 smithi191 bash[24992]: cephadm 2024-08-31T05:30:34.881702+0000 mgr.a (mgr.14388) 8621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:30:36.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:36 smithi191 bash[24992]: cluster 2024-08-31T05:30:35.068408+0000 mgr.a (mgr.14388) 8622 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:36 smithi163 bash[24253]: audit 2024-08-31T05:30:34.880249+0000 mgr.a (mgr.14388) 8620 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:30:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:36 smithi163 bash[24253]: cephadm 2024-08-31T05:30:34.881702+0000 mgr.a (mgr.14388) 8621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:30:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:36 smithi163 bash[24253]: cluster 2024-08-31T05:30:35.068408+0000 mgr.a (mgr.14388) 8622 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:36 smithi027 bash[22610]: audit 2024-08-31T05:30:34.880249+0000 mgr.a (mgr.14388) 8620 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:30:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:36 smithi027 bash[22610]: cephadm 2024-08-31T05:30:34.881702+0000 mgr.a (mgr.14388) 8621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:30:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:36 smithi027 bash[22610]: cluster 2024-08-31T05:30:35.068408+0000 mgr.a (mgr.14388) 8622 : cluster [DBG] pgmap v5975: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:36.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:30:36.980 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:30:36.980 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:30:37.748 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:30:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:30:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:30:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:30:37.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:30:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:38 smithi163 bash[24253]: cluster 2024-08-31T05:30:37.069297+0000 mgr.a (mgr.14388) 8623 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:38 smithi163 bash[24253]: audit 2024-08-31T05:30:37.314244+0000 mgr.a (mgr.14388) 8624 : audit [DBG] from='client.193128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:38 smithi027 bash[22610]: cluster 2024-08-31T05:30:37.069297+0000 mgr.a (mgr.14388) 8623 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:38 smithi027 bash[22610]: audit 2024-08-31T05:30:37.314244+0000 mgr.a (mgr.14388) 8624 : audit [DBG] from='client.193128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:38 smithi191 bash[24992]: cluster 2024-08-31T05:30:37.069297+0000 mgr.a (mgr.14388) 8623 : cluster [DBG] pgmap v5976: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:38 smithi191 bash[24992]: audit 2024-08-31T05:30:37.314244+0000 mgr.a (mgr.14388) 8624 : audit [DBG] from='client.193128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:40 smithi163 bash[24253]: cluster 2024-08-31T05:30:39.071678+0000 mgr.a (mgr.14388) 8625 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:40 smithi027 bash[22610]: cluster 2024-08-31T05:30:39.071678+0000 mgr.a (mgr.14388) 8625 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:40 smithi191 bash[24992]: cluster 2024-08-31T05:30:39.071678+0000 mgr.a (mgr.14388) 8625 : cluster [DBG] pgmap v5977: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:42 smithi163 bash[24253]: cluster 2024-08-31T05:30:41.072471+0000 mgr.a (mgr.14388) 8626 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:42 smithi027 bash[22610]: cluster 2024-08-31T05:30:41.072471+0000 mgr.a (mgr.14388) 8626 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:42.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:30:42.751 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:30:42.751 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:30:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:42 smithi191 bash[24992]: cluster 2024-08-31T05:30:41.072471+0000 mgr.a (mgr.14388) 8626 : cluster [DBG] pgmap v5978: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:43.495 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:30:43.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:30:43.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:30:43.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:30:43.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:30:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:44 smithi163 bash[24253]: cluster 2024-08-31T05:30:43.073650+0000 mgr.a (mgr.14388) 8627 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:44 smithi163 bash[24253]: audit 2024-08-31T05:30:43.078773+0000 mgr.a (mgr.14388) 8628 : audit [DBG] from='client.193206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:44 smithi027 bash[22610]: cluster 2024-08-31T05:30:43.073650+0000 mgr.a (mgr.14388) 8627 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:44 smithi027 bash[22610]: audit 2024-08-31T05:30:43.078773+0000 mgr.a (mgr.14388) 8628 : audit [DBG] from='client.193206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:44 smithi191 bash[24992]: cluster 2024-08-31T05:30:43.073650+0000 mgr.a (mgr.14388) 8627 : cluster [DBG] pgmap v5979: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:44 smithi191 bash[24992]: audit 2024-08-31T05:30:43.078773+0000 mgr.a (mgr.14388) 8628 : audit [DBG] from='client.193206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:46 smithi163 bash[24253]: cluster 2024-08-31T05:30:45.074532+0000 mgr.a (mgr.14388) 8629 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:30:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:46 smithi027 bash[22610]: cluster 2024-08-31T05:30:45.074532+0000 mgr.a (mgr.14388) 8629 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:30:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:46 smithi191 bash[24992]: cluster 2024-08-31T05:30:45.074532+0000 mgr.a (mgr.14388) 8629 : cluster [DBG] pgmap v5980: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:30:48.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:30:48.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:30:48.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:30:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:48 smithi163 bash[24253]: cluster 2024-08-31T05:30:47.075308+0000 mgr.a (mgr.14388) 8630 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:30:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:48 smithi027 bash[22610]: cluster 2024-08-31T05:30:47.075308+0000 mgr.a (mgr.14388) 8630 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:30:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:48 smithi191 bash[24992]: cluster 2024-08-31T05:30:47.075308+0000 mgr.a (mgr.14388) 8630 : cluster [DBG] pgmap v5981: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:30:49.276 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:30:49.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:30:49.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:30:49.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:30:49.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:30:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:50 smithi163 bash[24253]: audit 2024-08-31T05:30:48.833626+0000 mgr.a (mgr.14388) 8631 : audit [DBG] from='client.193281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:50 smithi163 bash[24253]: cluster 2024-08-31T05:30:49.077128+0000 mgr.a (mgr.14388) 8632 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:50 smithi027 bash[22610]: audit 2024-08-31T05:30:48.833626+0000 mgr.a (mgr.14388) 8631 : audit [DBG] from='client.193281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:50 smithi027 bash[22610]: cluster 2024-08-31T05:30:49.077128+0000 mgr.a (mgr.14388) 8632 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:50 smithi191 bash[24992]: audit 2024-08-31T05:30:48.833626+0000 mgr.a (mgr.14388) 8631 : audit [DBG] from='client.193281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:50 smithi191 bash[24992]: cluster 2024-08-31T05:30:49.077128+0000 mgr.a (mgr.14388) 8632 : cluster [DBG] pgmap v5982: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:30:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:52 smithi163 bash[24253]: cluster 2024-08-31T05:30:51.077991+0000 mgr.a (mgr.14388) 8633 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:30:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:52 smithi027 bash[22610]: cluster 2024-08-31T05:30:51.077991+0000 mgr.a (mgr.14388) 8633 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:30:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:52 smithi191 bash[24992]: cluster 2024-08-31T05:30:51.077991+0000 mgr.a (mgr.14388) 8633 : cluster [DBG] pgmap v5983: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:30:54.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:30:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:30:54.278 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:30:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:54 smithi163 bash[24253]: cluster 2024-08-31T05:30:53.080191+0000 mgr.a (mgr.14388) 8634 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:54 smithi027 bash[22610]: cluster 2024-08-31T05:30:53.080191+0000 mgr.a (mgr.14388) 8634 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:54 smithi191 bash[24992]: cluster 2024-08-31T05:30:53.080191+0000 mgr.a (mgr.14388) 8634 : cluster [DBG] pgmap v5984: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:55.043 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:30:55.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:30:55.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:30:55.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:30:55.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:30:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:56 smithi163 bash[24253]: audit 2024-08-31T05:30:54.615015+0000 mgr.a (mgr.14388) 8635 : audit [DBG] from='client.193359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:56 smithi163 bash[24253]: cluster 2024-08-31T05:30:55.080738+0000 mgr.a (mgr.14388) 8636 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:56 smithi027 bash[22610]: audit 2024-08-31T05:30:54.615015+0000 mgr.a (mgr.14388) 8635 : audit [DBG] from='client.193359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:56 smithi027 bash[22610]: cluster 2024-08-31T05:30:55.080738+0000 mgr.a (mgr.14388) 8636 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:56 smithi191 bash[24992]: audit 2024-08-31T05:30:54.615015+0000 mgr.a (mgr.14388) 8635 : audit [DBG] from='client.193359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:56 smithi191 bash[24992]: cluster 2024-08-31T05:30:55.080738+0000 mgr.a (mgr.14388) 8636 : cluster [DBG] pgmap v5985: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:30:58 smithi163 bash[24253]: cluster 2024-08-31T05:30:57.081473+0000 mgr.a (mgr.14388) 8637 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:30:58 smithi027 bash[22610]: cluster 2024-08-31T05:30:57.081473+0000 mgr.a (mgr.14388) 8637 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:30:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:30:58 smithi191 bash[24992]: cluster 2024-08-31T05:30:57.081473+0000 mgr.a (mgr.14388) 8637 : cluster [DBG] pgmap v5986: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:00.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:00 smithi163 bash[24253]: cluster 2024-08-31T05:30:59.083741+0000 mgr.a (mgr.14388) 8638 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:00 smithi027 bash[22610]: cluster 2024-08-31T05:30:59.083741+0000 mgr.a (mgr.14388) 8638 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:00 smithi191 bash[24992]: cluster 2024-08-31T05:30:59.083741+0000 mgr.a (mgr.14388) 8638 : cluster [DBG] pgmap v5987: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:00.802 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:00.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:00.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:00.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:00.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:01 smithi163 bash[24253]: audit 2024-08-31T05:31:00.378974+0000 mgr.a (mgr.14388) 8639 : audit [DBG] from='client.193437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:01 smithi027 bash[22610]: audit 2024-08-31T05:31:00.378974+0000 mgr.a (mgr.14388) 8639 : audit [DBG] from='client.193437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:01 smithi191 bash[24992]: audit 2024-08-31T05:31:00.378974+0000 mgr.a (mgr.14388) 8639 : audit [DBG] from='client.193437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:02 smithi163 bash[24253]: cluster 2024-08-31T05:31:01.084833+0000 mgr.a (mgr.14388) 8640 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:02 smithi027 bash[22610]: cluster 2024-08-31T05:31:01.084833+0000 mgr.a (mgr.14388) 8640 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:02 smithi191 bash[24992]: cluster 2024-08-31T05:31:01.084833+0000 mgr.a (mgr.14388) 8640 : cluster [DBG] pgmap v5988: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:04 smithi163 bash[24253]: cluster 2024-08-31T05:31:03.087175+0000 mgr.a (mgr.14388) 8641 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:04 smithi027 bash[22610]: cluster 2024-08-31T05:31:03.087175+0000 mgr.a (mgr.14388) 8641 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:04 smithi191 bash[24992]: cluster 2024-08-31T05:31:03.087175+0000 mgr.a (mgr.14388) 8641 : cluster [DBG] pgmap v5989: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:05.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:05.805 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:06.553 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:06.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:06.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:06.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:06.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:06 smithi163 bash[24253]: cluster 2024-08-31T05:31:05.088059+0000 mgr.a (mgr.14388) 8642 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:06 smithi027 bash[22610]: cluster 2024-08-31T05:31:05.088059+0000 mgr.a (mgr.14388) 8642 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:06 smithi191 bash[24992]: cluster 2024-08-31T05:31:05.088059+0000 mgr.a (mgr.14388) 8642 : cluster [DBG] pgmap v5990: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:07 smithi163 bash[24253]: audit 2024-08-31T05:31:06.138426+0000 mgr.a (mgr.14388) 8643 : audit [DBG] from='client.193509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:07 smithi027 bash[22610]: audit 2024-08-31T05:31:06.138426+0000 mgr.a (mgr.14388) 8643 : audit [DBG] from='client.193509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:07 smithi191 bash[24992]: audit 2024-08-31T05:31:06.138426+0000 mgr.a (mgr.14388) 8643 : audit [DBG] from='client.193509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:08 smithi163 bash[24253]: cluster 2024-08-31T05:31:07.089243+0000 mgr.a (mgr.14388) 8644 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:08 smithi027 bash[22610]: cluster 2024-08-31T05:31:07.089243+0000 mgr.a (mgr.14388) 8644 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:08 smithi191 bash[24992]: cluster 2024-08-31T05:31:07.089243+0000 mgr.a (mgr.14388) 8644 : cluster [DBG] pgmap v5991: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:10 smithi163 bash[24253]: cluster 2024-08-31T05:31:09.091714+0000 mgr.a (mgr.14388) 8645 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:10 smithi027 bash[22610]: cluster 2024-08-31T05:31:09.091714+0000 mgr.a (mgr.14388) 8645 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:10.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:10 smithi191 bash[24992]: cluster 2024-08-31T05:31:09.091714+0000 mgr.a (mgr.14388) 8645 : cluster [DBG] pgmap v5992: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:11.554 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:11.555 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:11.555 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:12.325 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:12.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:12.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:12.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:12.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:12 smithi163 bash[24253]: cluster 2024-08-31T05:31:11.092530+0000 mgr.a (mgr.14388) 8646 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:12 smithi027 bash[22610]: cluster 2024-08-31T05:31:11.092530+0000 mgr.a (mgr.14388) 8646 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:12 smithi191 bash[24992]: cluster 2024-08-31T05:31:11.092530+0000 mgr.a (mgr.14388) 8646 : cluster [DBG] pgmap v5993: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:13 smithi163 bash[24253]: audit 2024-08-31T05:31:11.893553+0000 mgr.a (mgr.14388) 8647 : audit [DBG] from='client.193587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:13 smithi027 bash[22610]: audit 2024-08-31T05:31:11.893553+0000 mgr.a (mgr.14388) 8647 : audit [DBG] from='client.193587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:13 smithi191 bash[24992]: audit 2024-08-31T05:31:11.893553+0000 mgr.a (mgr.14388) 8647 : audit [DBG] from='client.193587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:14 smithi163 bash[24253]: cluster 2024-08-31T05:31:13.094870+0000 mgr.a (mgr.14388) 8648 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:14 smithi027 bash[22610]: cluster 2024-08-31T05:31:13.094870+0000 mgr.a (mgr.14388) 8648 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:14 smithi191 bash[24992]: cluster 2024-08-31T05:31:13.094870+0000 mgr.a (mgr.14388) 8648 : cluster [DBG] pgmap v5994: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:16 smithi163 bash[24253]: cluster 2024-08-31T05:31:15.095630+0000 mgr.a (mgr.14388) 8649 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:16 smithi027 bash[22610]: cluster 2024-08-31T05:31:15.095630+0000 mgr.a (mgr.14388) 8649 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:16 smithi191 bash[24992]: cluster 2024-08-31T05:31:15.095630+0000 mgr.a (mgr.14388) 8649 : cluster [DBG] pgmap v5995: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:17.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:17.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:17.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:18.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:18.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:18.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:18.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:18.080 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:18 smithi163 bash[24253]: cluster 2024-08-31T05:31:17.096398+0000 mgr.a (mgr.14388) 8650 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:18 smithi027 bash[22610]: cluster 2024-08-31T05:31:17.096398+0000 mgr.a (mgr.14388) 8650 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:18 smithi191 bash[24992]: cluster 2024-08-31T05:31:17.096398+0000 mgr.a (mgr.14388) 8650 : cluster [DBG] pgmap v5996: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:19 smithi163 bash[24253]: audit 2024-08-31T05:31:17.658961+0000 mgr.a (mgr.14388) 8651 : audit [DBG] from='client.193665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:19 smithi027 bash[22610]: audit 2024-08-31T05:31:17.658961+0000 mgr.a (mgr.14388) 8651 : audit [DBG] from='client.193665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:19 smithi191 bash[24992]: audit 2024-08-31T05:31:17.658961+0000 mgr.a (mgr.14388) 8651 : audit [DBG] from='client.193665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:20 smithi163 bash[24253]: cluster 2024-08-31T05:31:19.099197+0000 mgr.a (mgr.14388) 8652 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:20 smithi027 bash[22610]: cluster 2024-08-31T05:31:19.099197+0000 mgr.a (mgr.14388) 8652 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:20 smithi191 bash[24992]: cluster 2024-08-31T05:31:19.099197+0000 mgr.a (mgr.14388) 8652 : cluster [DBG] pgmap v5997: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:22 smithi163 bash[24253]: cluster 2024-08-31T05:31:21.099988+0000 mgr.a (mgr.14388) 8653 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:31:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:22 smithi027 bash[22610]: cluster 2024-08-31T05:31:21.099988+0000 mgr.a (mgr.14388) 8653 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:31:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:22 smithi191 bash[24992]: cluster 2024-08-31T05:31:21.099988+0000 mgr.a (mgr.14388) 8653 : cluster [DBG] pgmap v5998: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:31:23.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:23.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:23.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:23.861 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:23.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:23.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:23.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:23.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:24 smithi163 bash[24253]: cluster 2024-08-31T05:31:23.101969+0000 mgr.a (mgr.14388) 8654 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:24.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:24 smithi163 bash[24253]: audit 2024-08-31T05:31:23.423412+0000 mgr.a (mgr.14388) 8655 : audit [DBG] from='client.193743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:24 smithi027 bash[22610]: cluster 2024-08-31T05:31:23.101969+0000 mgr.a (mgr.14388) 8654 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:24 smithi027 bash[22610]: audit 2024-08-31T05:31:23.423412+0000 mgr.a (mgr.14388) 8655 : audit [DBG] from='client.193743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:24 smithi191 bash[24992]: cluster 2024-08-31T05:31:23.101969+0000 mgr.a (mgr.14388) 8654 : cluster [DBG] pgmap v5999: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:24 smithi191 bash[24992]: audit 2024-08-31T05:31:23.423412+0000 mgr.a (mgr.14388) 8655 : audit [DBG] from='client.193743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:26 smithi163 bash[24253]: cluster 2024-08-31T05:31:25.103010+0000 mgr.a (mgr.14388) 8656 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:31:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:26 smithi027 bash[22610]: cluster 2024-08-31T05:31:25.103010+0000 mgr.a (mgr.14388) 8656 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:31:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:26 smithi191 bash[24992]: cluster 2024-08-31T05:31:25.103010+0000 mgr.a (mgr.14388) 8656 : cluster [DBG] pgmap v6000: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:31:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:28 smithi163 bash[24253]: cluster 2024-08-31T05:31:27.104087+0000 mgr.a (mgr.14388) 8657 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:31:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:28 smithi027 bash[22610]: cluster 2024-08-31T05:31:27.104087+0000 mgr.a (mgr.14388) 8657 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:31:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:28 smithi191 bash[24992]: cluster 2024-08-31T05:31:27.104087+0000 mgr.a (mgr.14388) 8657 : cluster [DBG] pgmap v6001: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:31:28.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:28.863 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:28.863 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:29.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:29.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:29.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:29.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:29.644 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:30 smithi163 bash[24253]: cluster 2024-08-31T05:31:29.106312+0000 mgr.a (mgr.14388) 8658 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:30 smithi163 bash[24253]: audit 2024-08-31T05:31:29.200800+0000 mgr.a (mgr.14388) 8659 : audit [DBG] from='client.193821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:30 smithi027 bash[22610]: cluster 2024-08-31T05:31:29.106312+0000 mgr.a (mgr.14388) 8658 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:30 smithi027 bash[22610]: audit 2024-08-31T05:31:29.200800+0000 mgr.a (mgr.14388) 8659 : audit [DBG] from='client.193821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:30 smithi191 bash[24992]: cluster 2024-08-31T05:31:29.106312+0000 mgr.a (mgr.14388) 8658 : cluster [DBG] pgmap v6002: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:30 smithi191 bash[24992]: audit 2024-08-31T05:31:29.200800+0000 mgr.a (mgr.14388) 8659 : audit [DBG] from='client.193821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:32 smithi163 bash[24253]: cluster 2024-08-31T05:31:31.107236+0000 mgr.a (mgr.14388) 8660 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:32 smithi027 bash[22610]: cluster 2024-08-31T05:31:31.107236+0000 mgr.a (mgr.14388) 8660 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:32 smithi191 bash[24992]: cluster 2024-08-31T05:31:31.107236+0000 mgr.a (mgr.14388) 8660 : cluster [DBG] pgmap v6003: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:34.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:34.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:34.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:34 smithi163 bash[24253]: cluster 2024-08-31T05:31:33.109529+0000 mgr.a (mgr.14388) 8661 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:34 smithi027 bash[22610]: cluster 2024-08-31T05:31:33.109529+0000 mgr.a (mgr.14388) 8661 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:34 smithi191 bash[24992]: cluster 2024-08-31T05:31:33.109529+0000 mgr.a (mgr.14388) 8661 : cluster [DBG] pgmap v6004: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:35.401 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:35.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:35.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:35.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:35.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:35 smithi027 bash[22610]: audit 2024-08-31T05:31:34.932061+0000 mon.a (mon.0) 1874 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:31:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:35 smithi191 bash[24992]: audit 2024-08-31T05:31:34.932061+0000 mon.a (mon.0) 1874 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:31:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:35 smithi163 bash[24253]: audit 2024-08-31T05:31:34.932061+0000 mon.a (mon.0) 1874 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:31:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:36 smithi027 bash[22610]: audit 2024-08-31T05:31:34.975948+0000 mgr.a (mgr.14388) 8662 : audit [DBG] from='client.193896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:36 smithi027 bash[22610]: cluster 2024-08-31T05:31:35.110098+0000 mgr.a (mgr.14388) 8663 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:36 smithi191 bash[24992]: audit 2024-08-31T05:31:34.975948+0000 mgr.a (mgr.14388) 8662 : audit [DBG] from='client.193896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:36 smithi191 bash[24992]: cluster 2024-08-31T05:31:35.110098+0000 mgr.a (mgr.14388) 8663 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:36 smithi163 bash[24253]: audit 2024-08-31T05:31:34.975948+0000 mgr.a (mgr.14388) 8662 : audit [DBG] from='client.193896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:36 smithi163 bash[24253]: cluster 2024-08-31T05:31:35.110098+0000 mgr.a (mgr.14388) 8663 : cluster [DBG] pgmap v6005: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:38 smithi027 bash[22610]: cluster 2024-08-31T05:31:37.111000+0000 mgr.a (mgr.14388) 8664 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:38 smithi191 bash[24992]: cluster 2024-08-31T05:31:37.111000+0000 mgr.a (mgr.14388) 8664 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:38 smithi163 bash[24253]: cluster 2024-08-31T05:31:37.111000+0000 mgr.a (mgr.14388) 8664 : cluster [DBG] pgmap v6006: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:39 smithi191 bash[24992]: cluster 2024-08-31T05:31:39.113282+0000 mgr.a (mgr.14388) 8665 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:39 smithi163 bash[24253]: cluster 2024-08-31T05:31:39.113282+0000 mgr.a (mgr.14388) 8665 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:39 smithi027 bash[22610]: cluster 2024-08-31T05:31:39.113282+0000 mgr.a (mgr.14388) 8665 : cluster [DBG] pgmap v6007: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:31:40.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:40.403 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:40.403 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:41.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:41.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:41.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:41.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:41.170 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:41 smithi191 bash[24992]: audit 2024-08-31T05:31:40.284419+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:41 smithi191 bash[24992]: audit 2024-08-31T05:31:40.288466+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:41 smithi191 bash[24992]: audit 2024-08-31T05:31:40.326663+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:41 smithi191 bash[24992]: audit 2024-08-31T05:31:40.332081+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:41 smithi191 bash[24992]: audit 2024-08-31T05:31:40.344651+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:41 smithi191 bash[24992]: audit 2024-08-31T05:31:40.355062+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:41 smithi191 bash[24992]: audit 2024-08-31T05:31:41.083237+0000 mon.a (mon.0) 1881 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:31:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:41 smithi191 bash[24992]: audit 2024-08-31T05:31:41.084403+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:31:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:41 smithi191 bash[24992]: audit 2024-08-31T05:31:41.090370+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:41 smithi191 bash[24992]: audit 2024-08-31T05:31:41.092520+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:31:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:41 smithi163 bash[24253]: audit 2024-08-31T05:31:40.284419+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:41 smithi163 bash[24253]: audit 2024-08-31T05:31:40.288466+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:41 smithi163 bash[24253]: audit 2024-08-31T05:31:40.326663+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:41 smithi163 bash[24253]: audit 2024-08-31T05:31:40.332081+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:41 smithi163 bash[24253]: audit 2024-08-31T05:31:40.344651+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:41 smithi163 bash[24253]: audit 2024-08-31T05:31:40.355062+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:41 smithi163 bash[24253]: audit 2024-08-31T05:31:41.083237+0000 mon.a (mon.0) 1881 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:31:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:41 smithi163 bash[24253]: audit 2024-08-31T05:31:41.084403+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:31:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:41 smithi163 bash[24253]: audit 2024-08-31T05:31:41.090370+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:41 smithi163 bash[24253]: audit 2024-08-31T05:31:41.092520+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:31:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22610]: audit 2024-08-31T05:31:40.284419+0000 mon.a (mon.0) 1875 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22610]: audit 2024-08-31T05:31:40.288466+0000 mon.a (mon.0) 1876 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22610]: audit 2024-08-31T05:31:40.326663+0000 mon.a (mon.0) 1877 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22610]: audit 2024-08-31T05:31:40.332081+0000 mon.a (mon.0) 1878 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22610]: audit 2024-08-31T05:31:40.344651+0000 mon.a (mon.0) 1879 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22610]: audit 2024-08-31T05:31:40.355062+0000 mon.a (mon.0) 1880 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22610]: audit 2024-08-31T05:31:41.083237+0000 mon.a (mon.0) 1881 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:31:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22610]: audit 2024-08-31T05:31:41.084403+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:31:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22610]: audit 2024-08-31T05:31:41.090370+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:31:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22610]: audit 2024-08-31T05:31:41.092520+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:31:42.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22863]: debug 2024-08-31T05:31:41.861+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:31:42.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:31:41 smithi027 bash[22863]: debug 2024-08-31T05:31:41.861+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:31:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:42 smithi191 bash[24992]: audit 2024-08-31T05:31:40.720133+0000 mgr.a (mgr.14388) 8666 : audit [DBG] from='client.193974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:42.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:42 smithi191 bash[24992]: audit 2024-08-31T05:31:41.093753+0000 mgr.a (mgr.14388) 8667 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:31:42.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:42 smithi191 bash[24992]: cluster 2024-08-31T05:31:41.113738+0000 mgr.a (mgr.14388) 8668 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:42 smithi163 bash[24253]: audit 2024-08-31T05:31:40.720133+0000 mgr.a (mgr.14388) 8666 : audit [DBG] from='client.193974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:42 smithi163 bash[24253]: audit 2024-08-31T05:31:41.093753+0000 mgr.a (mgr.14388) 8667 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:31:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:42 smithi163 bash[24253]: cluster 2024-08-31T05:31:41.113738+0000 mgr.a (mgr.14388) 8668 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:42 smithi027 bash[22610]: audit 2024-08-31T05:31:40.720133+0000 mgr.a (mgr.14388) 8666 : audit [DBG] from='client.193974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:42 smithi027 bash[22610]: audit 2024-08-31T05:31:41.093753+0000 mgr.a (mgr.14388) 8667 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:31:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:42 smithi027 bash[22610]: cluster 2024-08-31T05:31:41.113738+0000 mgr.a (mgr.14388) 8668 : cluster [DBG] pgmap v6008: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:43 smithi163 bash[24253]: audit 2024-08-31T05:31:41.863317+0000 mgr.a (mgr.14388) 8669 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:31:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:43 smithi163 bash[24253]: cephadm 2024-08-31T05:31:41.865276+0000 mgr.a (mgr.14388) 8670 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:31:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:43 smithi027 bash[22610]: audit 2024-08-31T05:31:41.863317+0000 mgr.a (mgr.14388) 8669 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:31:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:43 smithi027 bash[22610]: cephadm 2024-08-31T05:31:41.865276+0000 mgr.a (mgr.14388) 8670 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:31:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:43 smithi191 bash[24992]: audit 2024-08-31T05:31:41.863317+0000 mgr.a (mgr.14388) 8669 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:31:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:43 smithi191 bash[24992]: cephadm 2024-08-31T05:31:41.865276+0000 mgr.a (mgr.14388) 8670 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:31:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:44 smithi163 bash[24253]: cluster 2024-08-31T05:31:43.116031+0000 mgr.a (mgr.14388) 8671 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:44 smithi027 bash[22610]: cluster 2024-08-31T05:31:43.116031+0000 mgr.a (mgr.14388) 8671 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:44 smithi191 bash[24992]: cluster 2024-08-31T05:31:43.116031+0000 mgr.a (mgr.14388) 8671 : cluster [DBG] pgmap v6009: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:46.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:46.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:46.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:46 smithi163 bash[24253]: cluster 2024-08-31T05:31:45.116961+0000 mgr.a (mgr.14388) 8672 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:46 smithi027 bash[22610]: cluster 2024-08-31T05:31:45.116961+0000 mgr.a (mgr.14388) 8672 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:46 smithi191 bash[24992]: cluster 2024-08-31T05:31:45.116961+0000 mgr.a (mgr.14388) 8672 : cluster [DBG] pgmap v6010: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:46.922 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:47.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:47.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:47.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:47.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:48 smithi163 bash[24253]: audit 2024-08-31T05:31:46.508493+0000 mgr.a (mgr.14388) 8673 : audit [DBG] from='client.194160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:48 smithi163 bash[24253]: cluster 2024-08-31T05:31:47.117952+0000 mgr.a (mgr.14388) 8674 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:48 smithi027 bash[22610]: audit 2024-08-31T05:31:46.508493+0000 mgr.a (mgr.14388) 8673 : audit [DBG] from='client.194160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:48 smithi027 bash[22610]: cluster 2024-08-31T05:31:47.117952+0000 mgr.a (mgr.14388) 8674 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:48 smithi191 bash[24992]: audit 2024-08-31T05:31:46.508493+0000 mgr.a (mgr.14388) 8673 : audit [DBG] from='client.194160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:48 smithi191 bash[24992]: cluster 2024-08-31T05:31:47.117952+0000 mgr.a (mgr.14388) 8674 : cluster [DBG] pgmap v6011: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:50 smithi163 bash[24253]: cluster 2024-08-31T05:31:49.120213+0000 mgr.a (mgr.14388) 8675 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:50 smithi027 bash[22610]: cluster 2024-08-31T05:31:49.120213+0000 mgr.a (mgr.14388) 8675 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:50 smithi191 bash[24992]: cluster 2024-08-31T05:31:49.120213+0000 mgr.a (mgr.14388) 8675 : cluster [DBG] pgmap v6012: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:51.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:51.925 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:51.925 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:52 smithi163 bash[24253]: cluster 2024-08-31T05:31:51.120962+0000 mgr.a (mgr.14388) 8676 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:52.706 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:52.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:52.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:52.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:52.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:52 smithi027 bash[22610]: cluster 2024-08-31T05:31:51.120962+0000 mgr.a (mgr.14388) 8676 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:52 smithi191 bash[24992]: cluster 2024-08-31T05:31:51.120962+0000 mgr.a (mgr.14388) 8676 : cluster [DBG] pgmap v6013: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:53 smithi163 bash[24253]: audit 2024-08-31T05:31:52.257486+0000 mgr.a (mgr.14388) 8677 : audit [DBG] from='client.194235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:53 smithi027 bash[22610]: audit 2024-08-31T05:31:52.257486+0000 mgr.a (mgr.14388) 8677 : audit [DBG] from='client.194235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:53 smithi191 bash[24992]: audit 2024-08-31T05:31:52.257486+0000 mgr.a (mgr.14388) 8677 : audit [DBG] from='client.194235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:54 smithi163 bash[24253]: cluster 2024-08-31T05:31:53.123242+0000 mgr.a (mgr.14388) 8678 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:54 smithi027 bash[22610]: cluster 2024-08-31T05:31:53.123242+0000 mgr.a (mgr.14388) 8678 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:54 smithi191 bash[24992]: cluster 2024-08-31T05:31:53.123242+0000 mgr.a (mgr.14388) 8678 : cluster [DBG] pgmap v6014: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:31:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:56 smithi163 bash[24253]: cluster 2024-08-31T05:31:55.124015+0000 mgr.a (mgr.14388) 8679 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:56 smithi027 bash[22610]: cluster 2024-08-31T05:31:55.124015+0000 mgr.a (mgr.14388) 8679 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:56 smithi191 bash[24992]: cluster 2024-08-31T05:31:55.124015+0000 mgr.a (mgr.14388) 8679 : cluster [DBG] pgmap v6015: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:57.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:31:57.709 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:31:57.709 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:31:58.462 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:31:58.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:31:58.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:31:58.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:31:58.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:31:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:58 smithi163 bash[24253]: cluster 2024-08-31T05:31:57.124786+0000 mgr.a (mgr.14388) 8680 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:58 smithi027 bash[22610]: cluster 2024-08-31T05:31:57.124786+0000 mgr.a (mgr.14388) 8680 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:58 smithi191 bash[24992]: cluster 2024-08-31T05:31:57.124786+0000 mgr.a (mgr.14388) 8680 : cluster [DBG] pgmap v6016: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:31:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:31:59 smithi163 bash[24253]: audit 2024-08-31T05:31:58.038836+0000 mgr.a (mgr.14388) 8681 : audit [DBG] from='client.194313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:59.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:31:59 smithi027 bash[22610]: audit 2024-08-31T05:31:58.038836+0000 mgr.a (mgr.14388) 8681 : audit [DBG] from='client.194313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:31:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:31:59 smithi191 bash[24992]: audit 2024-08-31T05:31:58.038836+0000 mgr.a (mgr.14388) 8681 : audit [DBG] from='client.194313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:00 smithi163 bash[24253]: cluster 2024-08-31T05:31:59.127613+0000 mgr.a (mgr.14388) 8682 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:00 smithi027 bash[22610]: cluster 2024-08-31T05:31:59.127613+0000 mgr.a (mgr.14388) 8682 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:00 smithi191 bash[24992]: cluster 2024-08-31T05:31:59.127613+0000 mgr.a (mgr.14388) 8682 : cluster [DBG] pgmap v6017: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:02 smithi163 bash[24253]: cluster 2024-08-31T05:32:01.128543+0000 mgr.a (mgr.14388) 8683 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:32:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:02 smithi027 bash[22610]: cluster 2024-08-31T05:32:01.128543+0000 mgr.a (mgr.14388) 8683 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:32:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:02 smithi191 bash[24992]: cluster 2024-08-31T05:32:01.128543+0000 mgr.a (mgr.14388) 8683 : cluster [DBG] pgmap v6018: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:32:03.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:32:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:32:03.465 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:32:04.245 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:32:04.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:32:04.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:32:04.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:32:04.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:32:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:04 smithi163 bash[24253]: cluster 2024-08-31T05:32:03.130613+0000 mgr.a (mgr.14388) 8684 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:04 smithi027 bash[22610]: cluster 2024-08-31T05:32:03.130613+0000 mgr.a (mgr.14388) 8684 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:04 smithi191 bash[24992]: cluster 2024-08-31T05:32:03.130613+0000 mgr.a (mgr.14388) 8684 : cluster [DBG] pgmap v6019: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:05 smithi163 bash[24253]: audit 2024-08-31T05:32:03.797794+0000 mgr.a (mgr.14388) 8685 : audit [DBG] from='client.194388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:05 smithi027 bash[22610]: audit 2024-08-31T05:32:03.797794+0000 mgr.a (mgr.14388) 8685 : audit [DBG] from='client.194388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:05 smithi191 bash[24992]: audit 2024-08-31T05:32:03.797794+0000 mgr.a (mgr.14388) 8685 : audit [DBG] from='client.194388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:06 smithi163 bash[24253]: cluster 2024-08-31T05:32:05.131565+0000 mgr.a (mgr.14388) 8686 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:32:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:06 smithi027 bash[22610]: cluster 2024-08-31T05:32:05.131565+0000 mgr.a (mgr.14388) 8686 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:32:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:06 smithi191 bash[24992]: cluster 2024-08-31T05:32:05.131565+0000 mgr.a (mgr.14388) 8686 : cluster [DBG] pgmap v6020: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:32:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:08 smithi163 bash[24253]: cluster 2024-08-31T05:32:07.132401+0000 mgr.a (mgr.14388) 8687 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:32:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:08 smithi027 bash[22610]: cluster 2024-08-31T05:32:07.132401+0000 mgr.a (mgr.14388) 8687 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:32:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:08 smithi191 bash[24992]: cluster 2024-08-31T05:32:07.132401+0000 mgr.a (mgr.14388) 8687 : cluster [DBG] pgmap v6021: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:32:09.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:32:09.247 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:32:09.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:32:09.994 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:32:09.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:32:09.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:32:09.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:32:09.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:32:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:10 smithi163 bash[24253]: cluster 2024-08-31T05:32:09.134660+0000 mgr.a (mgr.14388) 8688 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:10 smithi027 bash[22610]: cluster 2024-08-31T05:32:09.134660+0000 mgr.a (mgr.14388) 8688 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:10 smithi191 bash[24992]: cluster 2024-08-31T05:32:09.134660+0000 mgr.a (mgr.14388) 8688 : cluster [DBG] pgmap v6022: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:11 smithi163 bash[24253]: audit 2024-08-31T05:32:09.581616+0000 mgr.a (mgr.14388) 8689 : audit [DBG] from='client.194466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:11 smithi027 bash[22610]: audit 2024-08-31T05:32:09.581616+0000 mgr.a (mgr.14388) 8689 : audit [DBG] from='client.194466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:11 smithi191 bash[24992]: audit 2024-08-31T05:32:09.581616+0000 mgr.a (mgr.14388) 8689 : audit [DBG] from='client.194466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:12 smithi163 bash[24253]: cluster 2024-08-31T05:32:11.135727+0000 mgr.a (mgr.14388) 8690 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:12 smithi027 bash[22610]: cluster 2024-08-31T05:32:11.135727+0000 mgr.a (mgr.14388) 8690 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:12 smithi191 bash[24992]: cluster 2024-08-31T05:32:11.135727+0000 mgr.a (mgr.14388) 8690 : cluster [DBG] pgmap v6023: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:14 smithi163 bash[24253]: cluster 2024-08-31T05:32:13.138043+0000 mgr.a (mgr.14388) 8691 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:32:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:14 smithi027 bash[22610]: cluster 2024-08-31T05:32:13.138043+0000 mgr.a (mgr.14388) 8691 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:32:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:14 smithi191 bash[24992]: cluster 2024-08-31T05:32:13.138043+0000 mgr.a (mgr.14388) 8691 : cluster [DBG] pgmap v6024: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:32:14.996 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:32:14.996 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:32:14.997 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:32:15.736 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:32:15.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:32:15.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:32:15.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:32:15.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:32:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:16 smithi163 bash[24253]: cluster 2024-08-31T05:32:15.138700+0000 mgr.a (mgr.14388) 8692 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:16 smithi163 bash[24253]: audit 2024-08-31T05:32:15.323873+0000 mgr.a (mgr.14388) 8693 : audit [DBG] from='client.194544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:16 smithi027 bash[22610]: cluster 2024-08-31T05:32:15.138700+0000 mgr.a (mgr.14388) 8692 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:16 smithi027 bash[22610]: audit 2024-08-31T05:32:15.323873+0000 mgr.a (mgr.14388) 8693 : audit [DBG] from='client.194544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:16 smithi191 bash[24992]: cluster 2024-08-31T05:32:15.138700+0000 mgr.a (mgr.14388) 8692 : cluster [DBG] pgmap v6025: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:16 smithi191 bash[24992]: audit 2024-08-31T05:32:15.323873+0000 mgr.a (mgr.14388) 8693 : audit [DBG] from='client.194544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:18 smithi163 bash[24253]: cluster 2024-08-31T05:32:17.139617+0000 mgr.a (mgr.14388) 8694 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:18 smithi027 bash[22610]: cluster 2024-08-31T05:32:17.139617+0000 mgr.a (mgr.14388) 8694 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:18 smithi191 bash[24992]: cluster 2024-08-31T05:32:17.139617+0000 mgr.a (mgr.14388) 8694 : cluster [DBG] pgmap v6026: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:20 smithi163 bash[24253]: cluster 2024-08-31T05:32:19.141850+0000 mgr.a (mgr.14388) 8695 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:32:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:20 smithi027 bash[22610]: cluster 2024-08-31T05:32:19.141850+0000 mgr.a (mgr.14388) 8695 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:32:20.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:32:20.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:32:20.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:32:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:20 smithi191 bash[24992]: cluster 2024-08-31T05:32:19.141850+0000 mgr.a (mgr.14388) 8695 : cluster [DBG] pgmap v6027: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:32:21.483 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:32:21.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:32:21.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:32:21.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:32:21.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:32:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:22 smithi163 bash[24253]: audit 2024-08-31T05:32:21.062331+0000 mgr.a (mgr.14388) 8696 : audit [DBG] from='client.194619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:22 smithi163 bash[24253]: cluster 2024-08-31T05:32:21.142380+0000 mgr.a (mgr.14388) 8697 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:22 smithi027 bash[22610]: audit 2024-08-31T05:32:21.062331+0000 mgr.a (mgr.14388) 8696 : audit [DBG] from='client.194619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:22 smithi027 bash[22610]: cluster 2024-08-31T05:32:21.142380+0000 mgr.a (mgr.14388) 8697 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:22 smithi191 bash[24992]: audit 2024-08-31T05:32:21.062331+0000 mgr.a (mgr.14388) 8696 : audit [DBG] from='client.194619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:22 smithi191 bash[24992]: cluster 2024-08-31T05:32:21.142380+0000 mgr.a (mgr.14388) 8697 : cluster [DBG] pgmap v6028: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:32:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:24 smithi163 bash[24253]: cluster 2024-08-31T05:32:23.144611+0000 mgr.a (mgr.14388) 8698 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:32:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:24 smithi027 bash[22610]: cluster 2024-08-31T05:32:23.144611+0000 mgr.a (mgr.14388) 8698 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:32:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:24 smithi191 bash[24992]: cluster 2024-08-31T05:32:23.144611+0000 mgr.a (mgr.14388) 8698 : cluster [DBG] pgmap v6029: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:32:26.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:32:26.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:32:26.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:32:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:26 smithi163 bash[24253]: cluster 2024-08-31T05:32:25.145387+0000 mgr.a (mgr.14388) 8699 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:26 smithi027 bash[22610]: cluster 2024-08-31T05:32:25.145387+0000 mgr.a (mgr.14388) 8699 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:26 smithi191 bash[24992]: cluster 2024-08-31T05:32:25.145387+0000 mgr.a (mgr.14388) 8699 : cluster [DBG] pgmap v6030: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:27.265 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:32:27.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:32:27.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:32:27.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:32:27.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:32:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:28 smithi163 bash[24253]: audit 2024-08-31T05:32:26.823509+0000 mgr.a (mgr.14388) 8700 : audit [DBG] from='client.194697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:28 smithi163 bash[24253]: cluster 2024-08-31T05:32:27.145979+0000 mgr.a (mgr.14388) 8701 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:28 smithi027 bash[22610]: audit 2024-08-31T05:32:26.823509+0000 mgr.a (mgr.14388) 8700 : audit [DBG] from='client.194697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:28 smithi027 bash[22610]: cluster 2024-08-31T05:32:27.145979+0000 mgr.a (mgr.14388) 8701 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:28 smithi191 bash[24992]: audit 2024-08-31T05:32:26.823509+0000 mgr.a (mgr.14388) 8700 : audit [DBG] from='client.194697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:28 smithi191 bash[24992]: cluster 2024-08-31T05:32:27.145979+0000 mgr.a (mgr.14388) 8701 : cluster [DBG] pgmap v6031: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:30 smithi163 bash[24253]: cluster 2024-08-31T05:32:29.148289+0000 mgr.a (mgr.14388) 8702 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:32:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:30 smithi027 bash[22610]: cluster 2024-08-31T05:32:29.148289+0000 mgr.a (mgr.14388) 8702 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:32:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:30 smithi191 bash[24992]: cluster 2024-08-31T05:32:29.148289+0000 mgr.a (mgr.14388) 8702 : cluster [DBG] pgmap v6032: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:32:32.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:32:32.267 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:32:32.267 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:32:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:32 smithi163 bash[24253]: cluster 2024-08-31T05:32:31.149083+0000 mgr.a (mgr.14388) 8703 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:32 smithi027 bash[22610]: cluster 2024-08-31T05:32:31.149083+0000 mgr.a (mgr.14388) 8703 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:32 smithi191 bash[24992]: cluster 2024-08-31T05:32:31.149083+0000 mgr.a (mgr.14388) 8703 : cluster [DBG] pgmap v6033: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:33.058 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:32:33.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:32:33.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:32:33.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:32:33.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:32:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:34 smithi163 bash[24253]: audit 2024-08-31T05:32:32.605195+0000 mgr.a (mgr.14388) 8704 : audit [DBG] from='client.194772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:34 smithi163 bash[24253]: cluster 2024-08-31T05:32:33.151377+0000 mgr.a (mgr.14388) 8705 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:34 smithi027 bash[22610]: audit 2024-08-31T05:32:32.605195+0000 mgr.a (mgr.14388) 8704 : audit [DBG] from='client.194772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:34 smithi027 bash[22610]: cluster 2024-08-31T05:32:33.151377+0000 mgr.a (mgr.14388) 8705 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:34 smithi191 bash[24992]: audit 2024-08-31T05:32:32.605195+0000 mgr.a (mgr.14388) 8704 : audit [DBG] from='client.194772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:34 smithi191 bash[24992]: cluster 2024-08-31T05:32:33.151377+0000 mgr.a (mgr.14388) 8705 : cluster [DBG] pgmap v6034: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:32:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:36 smithi163 bash[24253]: cluster 2024-08-31T05:32:35.152117+0000 mgr.a (mgr.14388) 8706 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:32:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:36 smithi027 bash[22610]: cluster 2024-08-31T05:32:35.152117+0000 mgr.a (mgr.14388) 8706 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:32:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:36 smithi191 bash[24992]: cluster 2024-08-31T05:32:35.152117+0000 mgr.a (mgr.14388) 8706 : cluster [DBG] pgmap v6035: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:32:38.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:32:38.060 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:32:38.061 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:32:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:38 smithi163 bash[24253]: cluster 2024-08-31T05:32:37.152877+0000 mgr.a (mgr.14388) 8707 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:32:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:38 smithi027 bash[22610]: cluster 2024-08-31T05:32:37.152877+0000 mgr.a (mgr.14388) 8707 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:32:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:38 smithi191 bash[24992]: cluster 2024-08-31T05:32:37.152877+0000 mgr.a (mgr.14388) 8707 : cluster [DBG] pgmap v6036: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:32:38.838 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:32:38.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:32:38.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:32:38.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:32:38.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:32:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:39 smithi163 bash[24253]: audit 2024-08-31T05:32:38.398230+0000 mgr.a (mgr.14388) 8708 : audit [DBG] from='client.194847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:39 smithi027 bash[22610]: audit 2024-08-31T05:32:38.398230+0000 mgr.a (mgr.14388) 8708 : audit [DBG] from='client.194847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:39 smithi191 bash[24992]: audit 2024-08-31T05:32:38.398230+0000 mgr.a (mgr.14388) 8708 : audit [DBG] from='client.194847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:40 smithi027 bash[22610]: cluster 2024-08-31T05:32:39.155694+0000 mgr.a (mgr.14388) 8709 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:40 smithi191 bash[24992]: cluster 2024-08-31T05:32:39.155694+0000 mgr.a (mgr.14388) 8709 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:40 smithi163 bash[24253]: cluster 2024-08-31T05:32:39.155694+0000 mgr.a (mgr.14388) 8709 : cluster [DBG] pgmap v6037: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:42 smithi027 bash[22610]: cluster 2024-08-31T05:32:41.156497+0000 mgr.a (mgr.14388) 8710 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:32:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:42 smithi027 bash[22610]: audit 2024-08-31T05:32:41.921684+0000 mon.a (mon.0) 1885 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:32:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:42 smithi191 bash[24992]: cluster 2024-08-31T05:32:41.156497+0000 mgr.a (mgr.14388) 8710 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:32:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:42 smithi191 bash[24992]: audit 2024-08-31T05:32:41.921684+0000 mon.a (mon.0) 1885 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:32:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:42 smithi163 bash[24253]: cluster 2024-08-31T05:32:41.156497+0000 mgr.a (mgr.14388) 8710 : cluster [DBG] pgmap v6038: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:32:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:42 smithi163 bash[24253]: audit 2024-08-31T05:32:41.921684+0000 mon.a (mon.0) 1885 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:32:43.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:32:43 smithi027 bash[22863]: debug 2024-08-31T05:32:43.507+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:32:43.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:32:43 smithi027 bash[22863]: debug 2024-08-31T05:32:43.507+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:32:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:43 smithi027 bash[22610]: audit 2024-08-31T05:32:42.768105+0000 mon.a (mon.0) 1886 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:32:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:43 smithi027 bash[22610]: audit 2024-08-31T05:32:42.769148+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:32:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:43 smithi027 bash[22610]: audit 2024-08-31T05:32:42.777587+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:32:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:43 smithi027 bash[22610]: audit 2024-08-31T05:32:42.780102+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:32:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:43 smithi191 bash[24992]: audit 2024-08-31T05:32:42.768105+0000 mon.a (mon.0) 1886 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:32:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:43 smithi191 bash[24992]: audit 2024-08-31T05:32:42.769148+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:32:43.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:43 smithi191 bash[24992]: audit 2024-08-31T05:32:42.777587+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:32:43.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:43 smithi191 bash[24992]: audit 2024-08-31T05:32:42.780102+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:32:43.839 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:32:43.840 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:32:43.840 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:32:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:43 smithi163 bash[24253]: audit 2024-08-31T05:32:42.768105+0000 mon.a (mon.0) 1886 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:32:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:43 smithi163 bash[24253]: audit 2024-08-31T05:32:42.769148+0000 mon.a (mon.0) 1887 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:32:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:43 smithi163 bash[24253]: audit 2024-08-31T05:32:42.777587+0000 mon.a (mon.0) 1888 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:32:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:43 smithi163 bash[24253]: audit 2024-08-31T05:32:42.780102+0000 mon.a (mon.0) 1889 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:32:44.591 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:32:44.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:32:44.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:32:44.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:32:44.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:32:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:44 smithi027 bash[22610]: audit 2024-08-31T05:32:42.782448+0000 mgr.a (mgr.14388) 8711 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:32:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:44 smithi027 bash[22610]: cluster 2024-08-31T05:32:43.157850+0000 mgr.a (mgr.14388) 8712 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:44 smithi191 bash[24992]: audit 2024-08-31T05:32:42.782448+0000 mgr.a (mgr.14388) 8711 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:32:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:44 smithi191 bash[24992]: cluster 2024-08-31T05:32:43.157850+0000 mgr.a (mgr.14388) 8712 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:44 smithi163 bash[24253]: audit 2024-08-31T05:32:42.782448+0000 mgr.a (mgr.14388) 8711 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:32:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:44 smithi163 bash[24253]: cluster 2024-08-31T05:32:43.157850+0000 mgr.a (mgr.14388) 8712 : cluster [DBG] pgmap v6039: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:45 smithi027 bash[22610]: audit 2024-08-31T05:32:43.511862+0000 mgr.a (mgr.14388) 8713 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:32:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:45 smithi027 bash[22610]: cephadm 2024-08-31T05:32:43.512977+0000 mgr.a (mgr.14388) 8714 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:32:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:45 smithi027 bash[22610]: audit 2024-08-31T05:32:44.170533+0000 mgr.a (mgr.14388) 8715 : audit [DBG] from='client.195027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:45 smithi191 bash[24992]: audit 2024-08-31T05:32:43.511862+0000 mgr.a (mgr.14388) 8713 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:32:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:45 smithi191 bash[24992]: cephadm 2024-08-31T05:32:43.512977+0000 mgr.a (mgr.14388) 8714 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:32:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:45 smithi191 bash[24992]: audit 2024-08-31T05:32:44.170533+0000 mgr.a (mgr.14388) 8715 : audit [DBG] from='client.195027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:45 smithi163 bash[24253]: audit 2024-08-31T05:32:43.511862+0000 mgr.a (mgr.14388) 8713 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:32:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:45 smithi163 bash[24253]: cephadm 2024-08-31T05:32:43.512977+0000 mgr.a (mgr.14388) 8714 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:32:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:45 smithi163 bash[24253]: audit 2024-08-31T05:32:44.170533+0000 mgr.a (mgr.14388) 8715 : audit [DBG] from='client.195027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:46 smithi027 bash[22610]: cluster 2024-08-31T05:32:45.158885+0000 mgr.a (mgr.14388) 8716 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:46 smithi191 bash[24992]: cluster 2024-08-31T05:32:45.158885+0000 mgr.a (mgr.14388) 8716 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:46 smithi163 bash[24253]: cluster 2024-08-31T05:32:45.158885+0000 mgr.a (mgr.14388) 8716 : cluster [DBG] pgmap v6040: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:48 smithi027 bash[22610]: cluster 2024-08-31T05:32:47.159722+0000 mgr.a (mgr.14388) 8717 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:48 smithi191 bash[24992]: cluster 2024-08-31T05:32:47.159722+0000 mgr.a (mgr.14388) 8717 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:48 smithi163 bash[24253]: cluster 2024-08-31T05:32:47.159722+0000 mgr.a (mgr.14388) 8717 : cluster [DBG] pgmap v6041: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T05:32:49.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:32:49.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:32:49.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:32:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:49 smithi191 bash[24992]: cluster 2024-08-31T05:32:49.162532+0000 mgr.a (mgr.14388) 8718 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T05:32:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:49 smithi163 bash[24253]: cluster 2024-08-31T05:32:49.162532+0000 mgr.a (mgr.14388) 8718 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T05:32:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:49 smithi027 bash[22610]: cluster 2024-08-31T05:32:49.162532+0000 mgr.a (mgr.14388) 8718 : cluster [DBG] pgmap v6042: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T05:32:50.359 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:32:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:32:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:32:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:32:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:32:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:50 smithi191 bash[24992]: audit 2024-08-31T05:32:49.930616+0000 mgr.a (mgr.14388) 8719 : audit [DBG] from='client.195099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:50 smithi163 bash[24253]: audit 2024-08-31T05:32:49.930616+0000 mgr.a (mgr.14388) 8719 : audit [DBG] from='client.195099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:50 smithi027 bash[22610]: audit 2024-08-31T05:32:49.930616+0000 mgr.a (mgr.14388) 8719 : audit [DBG] from='client.195099 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:51 smithi191 bash[24992]: cluster 2024-08-31T05:32:51.163405+0000 mgr.a (mgr.14388) 8720 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:51 smithi163 bash[24253]: cluster 2024-08-31T05:32:51.163405+0000 mgr.a (mgr.14388) 8720 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:51 smithi027 bash[22610]: cluster 2024-08-31T05:32:51.163405+0000 mgr.a (mgr.14388) 8720 : cluster [DBG] pgmap v6043: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:54 smithi027 bash[22610]: cluster 2024-08-31T05:32:53.165502+0000 mgr.a (mgr.14388) 8721 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:54 smithi191 bash[24992]: cluster 2024-08-31T05:32:53.165502+0000 mgr.a (mgr.14388) 8721 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:54 smithi163 bash[24253]: cluster 2024-08-31T05:32:53.165502+0000 mgr.a (mgr.14388) 8721 : cluster [DBG] pgmap v6044: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:55.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:32:55.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:32:55.362 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:32:56.142 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:32:56.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:32:56.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:32:56.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:32:56.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:32:56.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:56 smithi027 bash[22610]: cluster 2024-08-31T05:32:55.166262+0000 mgr.a (mgr.14388) 8722 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:56 smithi191 bash[24992]: cluster 2024-08-31T05:32:55.166262+0000 mgr.a (mgr.14388) 8722 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:56 smithi163 bash[24253]: cluster 2024-08-31T05:32:55.166262+0000 mgr.a (mgr.14388) 8722 : cluster [DBG] pgmap v6045: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:57 smithi191 bash[24992]: audit 2024-08-31T05:32:55.694320+0000 mgr.a (mgr.14388) 8723 : audit [DBG] from='client.195174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:57 smithi163 bash[24253]: audit 2024-08-31T05:32:55.694320+0000 mgr.a (mgr.14388) 8723 : audit [DBG] from='client.195174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:57 smithi027 bash[22610]: audit 2024-08-31T05:32:55.694320+0000 mgr.a (mgr.14388) 8723 : audit [DBG] from='client.195174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:32:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:32:58 smithi191 bash[24992]: cluster 2024-08-31T05:32:57.167139+0000 mgr.a (mgr.14388) 8724 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:32:58 smithi163 bash[24253]: cluster 2024-08-31T05:32:57.167139+0000 mgr.a (mgr.14388) 8724 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:32:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:32:58 smithi027 bash[22610]: cluster 2024-08-31T05:32:57.167139+0000 mgr.a (mgr.14388) 8724 : cluster [DBG] pgmap v6046: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:33:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:00 smithi191 bash[24992]: cluster 2024-08-31T05:32:59.169360+0000 mgr.a (mgr.14388) 8725 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:33:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:00 smithi163 bash[24253]: cluster 2024-08-31T05:32:59.169360+0000 mgr.a (mgr.14388) 8725 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:33:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:00 smithi027 bash[22610]: cluster 2024-08-31T05:32:59.169360+0000 mgr.a (mgr.14388) 8725 : cluster [DBG] pgmap v6047: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:33:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:01.144 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:01.913 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:01.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:33:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:02 smithi191 bash[24992]: cluster 2024-08-31T05:33:01.169994+0000 mgr.a (mgr.14388) 8726 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:02 smithi191 bash[24992]: audit 2024-08-31T05:33:01.479143+0000 mgr.a (mgr.14388) 8727 : audit [DBG] from='client.195249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:02 smithi163 bash[24253]: cluster 2024-08-31T05:33:01.169994+0000 mgr.a (mgr.14388) 8726 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:02 smithi163 bash[24253]: audit 2024-08-31T05:33:01.479143+0000 mgr.a (mgr.14388) 8727 : audit [DBG] from='client.195249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:02 smithi027 bash[22610]: cluster 2024-08-31T05:33:01.169994+0000 mgr.a (mgr.14388) 8726 : cluster [DBG] pgmap v6048: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:02 smithi027 bash[22610]: audit 2024-08-31T05:33:01.479143+0000 mgr.a (mgr.14388) 8727 : audit [DBG] from='client.195249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:04 smithi191 bash[24992]: cluster 2024-08-31T05:33:03.172223+0000 mgr.a (mgr.14388) 8728 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:04 smithi163 bash[24253]: cluster 2024-08-31T05:33:03.172223+0000 mgr.a (mgr.14388) 8728 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:04 smithi027 bash[22610]: cluster 2024-08-31T05:33:03.172223+0000 mgr.a (mgr.14388) 8728 : cluster [DBG] pgmap v6049: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:06 smithi191 bash[24992]: cluster 2024-08-31T05:33:05.173023+0000 mgr.a (mgr.14388) 8729 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:06 smithi163 bash[24253]: cluster 2024-08-31T05:33:05.173023+0000 mgr.a (mgr.14388) 8729 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:06 smithi027 bash[22610]: cluster 2024-08-31T05:33:05.173023+0000 mgr.a (mgr.14388) 8729 : cluster [DBG] pgmap v6050: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:06.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:06.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:06.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:07.656 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:07.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:07.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:07.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:07.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:33:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:08 smithi191 bash[24992]: cluster 2024-08-31T05:33:07.173742+0000 mgr.a (mgr.14388) 8730 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:08.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:08 smithi191 bash[24992]: audit 2024-08-31T05:33:07.247057+0000 mgr.a (mgr.14388) 8731 : audit [DBG] from='client.195327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:08 smithi163 bash[24253]: cluster 2024-08-31T05:33:07.173742+0000 mgr.a (mgr.14388) 8730 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:08 smithi163 bash[24253]: audit 2024-08-31T05:33:07.247057+0000 mgr.a (mgr.14388) 8731 : audit [DBG] from='client.195327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:08 smithi027 bash[22610]: cluster 2024-08-31T05:33:07.173742+0000 mgr.a (mgr.14388) 8730 : cluster [DBG] pgmap v6051: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:08 smithi027 bash[22610]: audit 2024-08-31T05:33:07.247057+0000 mgr.a (mgr.14388) 8731 : audit [DBG] from='client.195327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:10 smithi191 bash[24992]: cluster 2024-08-31T05:33:09.176163+0000 mgr.a (mgr.14388) 8732 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:10 smithi163 bash[24253]: cluster 2024-08-31T05:33:09.176163+0000 mgr.a (mgr.14388) 8732 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:10 smithi027 bash[22610]: cluster 2024-08-31T05:33:09.176163+0000 mgr.a (mgr.14388) 8732 : cluster [DBG] pgmap v6052: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:12 smithi191 bash[24992]: cluster 2024-08-31T05:33:11.176954+0000 mgr.a (mgr.14388) 8733 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:12.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:12.658 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:12.658 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:12 smithi163 bash[24253]: cluster 2024-08-31T05:33:11.176954+0000 mgr.a (mgr.14388) 8733 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:12 smithi027 bash[22610]: cluster 2024-08-31T05:33:11.176954+0000 mgr.a (mgr.14388) 8733 : cluster [DBG] pgmap v6053: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:13.408 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:13.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:13.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:13.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:13.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:33:14.651 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:14 smithi191 bash[24992]: audit 2024-08-31T05:33:12.995596+0000 mgr.a (mgr.14388) 8734 : audit [DBG] from='client.195402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:14.652 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:14 smithi191 bash[24992]: cluster 2024-08-31T05:33:13.178295+0000 mgr.a (mgr.14388) 8735 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:14 smithi163 bash[24253]: audit 2024-08-31T05:33:12.995596+0000 mgr.a (mgr.14388) 8734 : audit [DBG] from='client.195402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:14 smithi163 bash[24253]: cluster 2024-08-31T05:33:13.178295+0000 mgr.a (mgr.14388) 8735 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:14 smithi027 bash[22610]: audit 2024-08-31T05:33:12.995596+0000 mgr.a (mgr.14388) 8734 : audit [DBG] from='client.195402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:14 smithi027 bash[22610]: cluster 2024-08-31T05:33:13.178295+0000 mgr.a (mgr.14388) 8735 : cluster [DBG] pgmap v6054: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:16 smithi191 bash[24992]: cluster 2024-08-31T05:33:15.179233+0000 mgr.a (mgr.14388) 8736 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:33:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:16 smithi163 bash[24253]: cluster 2024-08-31T05:33:15.179233+0000 mgr.a (mgr.14388) 8736 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:33:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:16 smithi027 bash[22610]: cluster 2024-08-31T05:33:15.179233+0000 mgr.a (mgr.14388) 8736 : cluster [DBG] pgmap v6055: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:33:18.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:18.410 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:18.410 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:18 smithi191 bash[24992]: cluster 2024-08-31T05:33:17.179978+0000 mgr.a (mgr.14388) 8737 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:33:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:18 smithi163 bash[24253]: cluster 2024-08-31T05:33:17.179978+0000 mgr.a (mgr.14388) 8737 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:33:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:18 smithi027 bash[22610]: cluster 2024-08-31T05:33:17.179978+0000 mgr.a (mgr.14388) 8737 : cluster [DBG] pgmap v6056: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:33:19.151 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:19.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:19.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:19.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:19.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:33:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:20 smithi191 bash[24992]: audit 2024-08-31T05:33:18.739361+0000 mgr.a (mgr.14388) 8738 : audit [DBG] from='client.195477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:20 smithi191 bash[24992]: cluster 2024-08-31T05:33:19.181269+0000 mgr.a (mgr.14388) 8739 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:20 smithi163 bash[24253]: audit 2024-08-31T05:33:18.739361+0000 mgr.a (mgr.14388) 8738 : audit [DBG] from='client.195477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:20 smithi163 bash[24253]: cluster 2024-08-31T05:33:19.181269+0000 mgr.a (mgr.14388) 8739 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:20 smithi027 bash[22610]: audit 2024-08-31T05:33:18.739361+0000 mgr.a (mgr.14388) 8738 : audit [DBG] from='client.195477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:20 smithi027 bash[22610]: cluster 2024-08-31T05:33:19.181269+0000 mgr.a (mgr.14388) 8739 : cluster [DBG] pgmap v6057: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:22 smithi191 bash[24992]: cluster 2024-08-31T05:33:21.182008+0000 mgr.a (mgr.14388) 8740 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:33:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:22 smithi163 bash[24253]: cluster 2024-08-31T05:33:21.182008+0000 mgr.a (mgr.14388) 8740 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:33:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:22 smithi027 bash[22610]: cluster 2024-08-31T05:33:21.182008+0000 mgr.a (mgr.14388) 8740 : cluster [DBG] pgmap v6058: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:33:24.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:24.153 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:24 smithi163 bash[24253]: cluster 2024-08-31T05:33:23.183962+0000 mgr.a (mgr.14388) 8741 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:24 smithi027 bash[22610]: cluster 2024-08-31T05:33:23.183962+0000 mgr.a (mgr.14388) 8741 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:24.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:24 smithi191 bash[24992]: cluster 2024-08-31T05:33:23.183962+0000 mgr.a (mgr.14388) 8741 : cluster [DBG] pgmap v6059: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:24.926 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:24.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:24.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:24.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:24.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:33:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:26 smithi163 bash[24253]: audit 2024-08-31T05:33:24.492099+0000 mgr.a (mgr.14388) 8742 : audit [DBG] from='client.195552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:26 smithi163 bash[24253]: cluster 2024-08-31T05:33:25.184898+0000 mgr.a (mgr.14388) 8743 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:26 smithi027 bash[22610]: audit 2024-08-31T05:33:24.492099+0000 mgr.a (mgr.14388) 8742 : audit [DBG] from='client.195552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:26 smithi027 bash[22610]: cluster 2024-08-31T05:33:25.184898+0000 mgr.a (mgr.14388) 8743 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:26 smithi191 bash[24992]: audit 2024-08-31T05:33:24.492099+0000 mgr.a (mgr.14388) 8742 : audit [DBG] from='client.195552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:26 smithi191 bash[24992]: cluster 2024-08-31T05:33:25.184898+0000 mgr.a (mgr.14388) 8743 : cluster [DBG] pgmap v6060: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:28 smithi163 bash[24253]: cluster 2024-08-31T05:33:27.185683+0000 mgr.a (mgr.14388) 8744 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:28 smithi027 bash[22610]: cluster 2024-08-31T05:33:27.185683+0000 mgr.a (mgr.14388) 8744 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:28 smithi191 bash[24992]: cluster 2024-08-31T05:33:27.185683+0000 mgr.a (mgr.14388) 8744 : cluster [DBG] pgmap v6061: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:29.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:29.937 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:29.937 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:30.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:30.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:30.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:30.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:33:30.684 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:30 smithi163 bash[24253]: cluster 2024-08-31T05:33:29.187930+0000 mgr.a (mgr.14388) 8745 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:30 smithi027 bash[22610]: cluster 2024-08-31T05:33:29.187930+0000 mgr.a (mgr.14388) 8745 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:30 smithi191 bash[24992]: cluster 2024-08-31T05:33:29.187930+0000 mgr.a (mgr.14388) 8745 : cluster [DBG] pgmap v6062: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:31 smithi163 bash[24253]: audit 2024-08-31T05:33:30.264597+0000 mgr.a (mgr.14388) 8746 : audit [DBG] from='client.195627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:31 smithi027 bash[22610]: audit 2024-08-31T05:33:30.264597+0000 mgr.a (mgr.14388) 8746 : audit [DBG] from='client.195627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:31 smithi191 bash[24992]: audit 2024-08-31T05:33:30.264597+0000 mgr.a (mgr.14388) 8746 : audit [DBG] from='client.195627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:32 smithi163 bash[24253]: cluster 2024-08-31T05:33:31.188904+0000 mgr.a (mgr.14388) 8747 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:32 smithi027 bash[22610]: cluster 2024-08-31T05:33:31.188904+0000 mgr.a (mgr.14388) 8747 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:32 smithi191 bash[24992]: cluster 2024-08-31T05:33:31.188904+0000 mgr.a (mgr.14388) 8747 : cluster [DBG] pgmap v6063: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:34 smithi163 bash[24253]: cluster 2024-08-31T05:33:33.191071+0000 mgr.a (mgr.14388) 8748 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:34 smithi027 bash[22610]: cluster 2024-08-31T05:33:33.191071+0000 mgr.a (mgr.14388) 8748 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:34 smithi191 bash[24992]: cluster 2024-08-31T05:33:33.191071+0000 mgr.a (mgr.14388) 8748 : cluster [DBG] pgmap v6064: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:35.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:35.685 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:35.686 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:36.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:36.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:36.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:36.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:33:36.434 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:36 smithi163 bash[24253]: cluster 2024-08-31T05:33:35.191789+0000 mgr.a (mgr.14388) 8749 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:36 smithi027 bash[22610]: cluster 2024-08-31T05:33:35.191789+0000 mgr.a (mgr.14388) 8749 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:36 smithi191 bash[24992]: cluster 2024-08-31T05:33:35.191789+0000 mgr.a (mgr.14388) 8749 : cluster [DBG] pgmap v6065: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:37 smithi163 bash[24253]: audit 2024-08-31T05:33:36.018557+0000 mgr.a (mgr.14388) 8750 : audit [DBG] from='client.195705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:37 smithi027 bash[22610]: audit 2024-08-31T05:33:36.018557+0000 mgr.a (mgr.14388) 8750 : audit [DBG] from='client.195705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:37 smithi191 bash[24992]: audit 2024-08-31T05:33:36.018557+0000 mgr.a (mgr.14388) 8750 : audit [DBG] from='client.195705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:38 smithi163 bash[24253]: cluster 2024-08-31T05:33:37.192790+0000 mgr.a (mgr.14388) 8751 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:38 smithi027 bash[22610]: cluster 2024-08-31T05:33:37.192790+0000 mgr.a (mgr.14388) 8751 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:38.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:38 smithi191 bash[24992]: cluster 2024-08-31T05:33:37.192790+0000 mgr.a (mgr.14388) 8751 : cluster [DBG] pgmap v6066: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:40 smithi163 bash[24253]: cluster 2024-08-31T05:33:39.195013+0000 mgr.a (mgr.14388) 8752 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:40 smithi027 bash[22610]: cluster 2024-08-31T05:33:39.195013+0000 mgr.a (mgr.14388) 8752 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:40 smithi191 bash[24992]: cluster 2024-08-31T05:33:39.195013+0000 mgr.a (mgr.14388) 8752 : cluster [DBG] pgmap v6067: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:41.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:41.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:42.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:42.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:42.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:42.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:33:42.204 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:42 smithi163 bash[24253]: cluster 2024-08-31T05:33:41.195723+0000 mgr.a (mgr.14388) 8753 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:42 smithi027 bash[22610]: cluster 2024-08-31T05:33:41.195723+0000 mgr.a (mgr.14388) 8753 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:42 smithi191 bash[24992]: cluster 2024-08-31T05:33:41.195723+0000 mgr.a (mgr.14388) 8753 : cluster [DBG] pgmap v6068: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:43 smithi163 bash[24253]: audit 2024-08-31T05:33:41.773229+0000 mgr.a (mgr.14388) 8754 : audit [DBG] from='client.195777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:43 smithi027 bash[22610]: audit 2024-08-31T05:33:41.773229+0000 mgr.a (mgr.14388) 8754 : audit [DBG] from='client.195777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:43 smithi191 bash[24992]: audit 2024-08-31T05:33:41.773229+0000 mgr.a (mgr.14388) 8754 : audit [DBG] from='client.195777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:44 smithi163 bash[24253]: cluster 2024-08-31T05:33:43.198002+0000 mgr.a (mgr.14388) 8755 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:44 smithi163 bash[24253]: audit 2024-08-31T05:33:43.564871+0000 mon.a (mon.0) 1890 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:33:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:44 smithi027 bash[22610]: cluster 2024-08-31T05:33:43.198002+0000 mgr.a (mgr.14388) 8755 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:44 smithi027 bash[22610]: audit 2024-08-31T05:33:43.564871+0000 mon.a (mon.0) 1890 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:33:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:44 smithi191 bash[24992]: cluster 2024-08-31T05:33:43.198002+0000 mgr.a (mgr.14388) 8755 : cluster [DBG] pgmap v6069: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:33:44.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:44 smithi191 bash[24992]: audit 2024-08-31T05:33:43.564871+0000 mon.a (mon.0) 1890 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:33:45.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:33:45 smithi027 bash[22863]: debug 2024-08-31T05:33:45.157+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:33:45.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:33:45 smithi027 bash[22863]: debug 2024-08-31T05:33:45.161+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:33:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:45 smithi027 bash[22610]: audit 2024-08-31T05:33:44.407825+0000 mon.a (mon.0) 1891 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:33:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:45 smithi027 bash[22610]: audit 2024-08-31T05:33:44.409468+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:33:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:45 smithi027 bash[22610]: audit 2024-08-31T05:33:44.420109+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:33:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:45 smithi027 bash[22610]: audit 2024-08-31T05:33:44.424951+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:33:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:45 smithi027 bash[22610]: audit 2024-08-31T05:33:44.427343+0000 mgr.a (mgr.14388) 8756 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:33:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:45 smithi163 bash[24253]: audit 2024-08-31T05:33:44.407825+0000 mon.a (mon.0) 1891 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:33:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:45 smithi163 bash[24253]: audit 2024-08-31T05:33:44.409468+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:33:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:45 smithi163 bash[24253]: audit 2024-08-31T05:33:44.420109+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:33:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:45 smithi163 bash[24253]: audit 2024-08-31T05:33:44.424951+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:33:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:45 smithi163 bash[24253]: audit 2024-08-31T05:33:44.427343+0000 mgr.a (mgr.14388) 8756 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:33:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:45 smithi191 bash[24992]: audit 2024-08-31T05:33:44.407825+0000 mon.a (mon.0) 1891 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:33:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:45 smithi191 bash[24992]: audit 2024-08-31T05:33:44.409468+0000 mon.a (mon.0) 1892 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:33:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:45 smithi191 bash[24992]: audit 2024-08-31T05:33:44.420109+0000 mon.a (mon.0) 1893 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:33:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:45 smithi191 bash[24992]: audit 2024-08-31T05:33:44.424951+0000 mon.a (mon.0) 1894 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:33:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:45 smithi191 bash[24992]: audit 2024-08-31T05:33:44.427343+0000 mgr.a (mgr.14388) 8756 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:33:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:46 smithi163 bash[24253]: audit 2024-08-31T05:33:45.162299+0000 mgr.a (mgr.14388) 8757 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:33:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:46 smithi163 bash[24253]: cephadm 2024-08-31T05:33:45.164445+0000 mgr.a (mgr.14388) 8758 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:33:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:46 smithi163 bash[24253]: cluster 2024-08-31T05:33:45.198651+0000 mgr.a (mgr.14388) 8759 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:46 smithi027 bash[22610]: audit 2024-08-31T05:33:45.162299+0000 mgr.a (mgr.14388) 8757 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:33:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:46 smithi027 bash[22610]: cephadm 2024-08-31T05:33:45.164445+0000 mgr.a (mgr.14388) 8758 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:33:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:46 smithi027 bash[22610]: cluster 2024-08-31T05:33:45.198651+0000 mgr.a (mgr.14388) 8759 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:46 smithi191 bash[24992]: audit 2024-08-31T05:33:45.162299+0000 mgr.a (mgr.14388) 8757 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:33:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:46 smithi191 bash[24992]: cephadm 2024-08-31T05:33:45.164445+0000 mgr.a (mgr.14388) 8758 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:33:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:46 smithi191 bash[24992]: cluster 2024-08-31T05:33:45.198651+0000 mgr.a (mgr.14388) 8759 : cluster [DBG] pgmap v6070: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:47.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:47.206 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:47.206 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:47.993 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:47.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:47.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:47.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:47.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:33:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:48 smithi163 bash[24253]: cluster 2024-08-31T05:33:47.199389+0000 mgr.a (mgr.14388) 8760 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:48 smithi027 bash[22610]: cluster 2024-08-31T05:33:47.199389+0000 mgr.a (mgr.14388) 8760 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:48 smithi191 bash[24992]: cluster 2024-08-31T05:33:47.199389+0000 mgr.a (mgr.14388) 8760 : cluster [DBG] pgmap v6071: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:33:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:49 smithi163 bash[24253]: audit 2024-08-31T05:33:47.543780+0000 mgr.a (mgr.14388) 8761 : audit [DBG] from='client.195960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:49 smithi027 bash[22610]: audit 2024-08-31T05:33:47.543780+0000 mgr.a (mgr.14388) 8761 : audit [DBG] from='client.195960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:49 smithi191 bash[24992]: audit 2024-08-31T05:33:47.543780+0000 mgr.a (mgr.14388) 8761 : audit [DBG] from='client.195960 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:50 smithi163 bash[24253]: cluster 2024-08-31T05:33:49.202190+0000 mgr.a (mgr.14388) 8762 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:33:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:50 smithi027 bash[22610]: cluster 2024-08-31T05:33:49.202190+0000 mgr.a (mgr.14388) 8762 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:33:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:50 smithi191 bash[24992]: cluster 2024-08-31T05:33:49.202190+0000 mgr.a (mgr.14388) 8762 : cluster [DBG] pgmap v6072: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:33:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:52 smithi163 bash[24253]: cluster 2024-08-31T05:33:51.202991+0000 mgr.a (mgr.14388) 8763 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:33:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:52 smithi027 bash[22610]: cluster 2024-08-31T05:33:51.202991+0000 mgr.a (mgr.14388) 8763 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:33:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:52 smithi191 bash[24992]: cluster 2024-08-31T05:33:51.202991+0000 mgr.a (mgr.14388) 8763 : cluster [DBG] pgmap v6073: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:33:52.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:52.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:52.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:53.775 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:53.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:53.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:53.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:53.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:33:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:54 smithi163 bash[24253]: cluster 2024-08-31T05:33:53.204944+0000 mgr.a (mgr.14388) 8764 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:33:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:54 smithi163 bash[24253]: audit 2024-08-31T05:33:53.333260+0000 mgr.a (mgr.14388) 8765 : audit [DBG] from='client.196038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:54 smithi027 bash[22610]: cluster 2024-08-31T05:33:53.204944+0000 mgr.a (mgr.14388) 8764 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:33:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:54 smithi027 bash[22610]: audit 2024-08-31T05:33:53.333260+0000 mgr.a (mgr.14388) 8765 : audit [DBG] from='client.196038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:54 smithi191 bash[24992]: cluster 2024-08-31T05:33:53.204944+0000 mgr.a (mgr.14388) 8764 : cluster [DBG] pgmap v6074: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:33:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:54 smithi191 bash[24992]: audit 2024-08-31T05:33:53.333260+0000 mgr.a (mgr.14388) 8765 : audit [DBG] from='client.196038 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:33:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:56 smithi163 bash[24253]: cluster 2024-08-31T05:33:55.205833+0000 mgr.a (mgr.14388) 8766 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:33:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:56 smithi027 bash[22610]: cluster 2024-08-31T05:33:55.205833+0000 mgr.a (mgr.14388) 8766 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:33:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:56 smithi191 bash[24992]: cluster 2024-08-31T05:33:55.205833+0000 mgr.a (mgr.14388) 8766 : cluster [DBG] pgmap v6075: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:33:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:33:58 smithi027 bash[22610]: cluster 2024-08-31T05:33:57.206644+0000 mgr.a (mgr.14388) 8767 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:33:58.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:33:58.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:33:58.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:33:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:33:58 smithi191 bash[24992]: cluster 2024-08-31T05:33:57.206644+0000 mgr.a (mgr.14388) 8767 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:33:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:33:58 smithi163 bash[24253]: cluster 2024-08-31T05:33:57.206644+0000 mgr.a (mgr.14388) 8767 : cluster [DBG] pgmap v6076: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:33:59.561 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:33:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:33:59.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:33:59.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:33:59.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:00 smithi027 bash[22610]: audit 2024-08-31T05:33:59.120100+0000 mgr.a (mgr.14388) 8768 : audit [DBG] from='client.196116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:00 smithi027 bash[22610]: cluster 2024-08-31T05:33:59.208415+0000 mgr.a (mgr.14388) 8769 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:00 smithi191 bash[24992]: audit 2024-08-31T05:33:59.120100+0000 mgr.a (mgr.14388) 8768 : audit [DBG] from='client.196116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:01.097 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:00 smithi191 bash[24992]: cluster 2024-08-31T05:33:59.208415+0000 mgr.a (mgr.14388) 8769 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:01.098 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:00 smithi163 bash[24253]: audit 2024-08-31T05:33:59.120100+0000 mgr.a (mgr.14388) 8768 : audit [DBG] from='client.196116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:01.098 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:00 smithi163 bash[24253]: cluster 2024-08-31T05:33:59.208415+0000 mgr.a (mgr.14388) 8769 : cluster [DBG] pgmap v6077: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:02 smithi027 bash[22610]: cluster 2024-08-31T05:34:01.209312+0000 mgr.a (mgr.14388) 8770 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:34:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:02 smithi191 bash[24992]: cluster 2024-08-31T05:34:01.209312+0000 mgr.a (mgr.14388) 8770 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:34:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:02 smithi163 bash[24253]: cluster 2024-08-31T05:34:01.209312+0000 mgr.a (mgr.14388) 8770 : cluster [DBG] pgmap v6078: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:34:04.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:34:04.563 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:34:04.563 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:34:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:04 smithi027 bash[22610]: cluster 2024-08-31T05:34:03.211532+0000 mgr.a (mgr.14388) 8771 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:34:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:04 smithi191 bash[24992]: cluster 2024-08-31T05:34:03.211532+0000 mgr.a (mgr.14388) 8771 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:34:04.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:04 smithi163 bash[24253]: cluster 2024-08-31T05:34:03.211532+0000 mgr.a (mgr.14388) 8771 : cluster [DBG] pgmap v6079: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T05:34:05.349 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:34:05.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:34:05.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:34:05.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:34:05.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:06 smithi027 bash[22610]: audit 2024-08-31T05:34:04.903436+0000 mgr.a (mgr.14388) 8772 : audit [DBG] from='client.196191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:06 smithi027 bash[22610]: cluster 2024-08-31T05:34:05.212064+0000 mgr.a (mgr.14388) 8773 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:06 smithi191 bash[24992]: audit 2024-08-31T05:34:04.903436+0000 mgr.a (mgr.14388) 8772 : audit [DBG] from='client.196191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:06 smithi191 bash[24992]: cluster 2024-08-31T05:34:05.212064+0000 mgr.a (mgr.14388) 8773 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:06 smithi163 bash[24253]: audit 2024-08-31T05:34:04.903436+0000 mgr.a (mgr.14388) 8772 : audit [DBG] from='client.196191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:06 smithi163 bash[24253]: cluster 2024-08-31T05:34:05.212064+0000 mgr.a (mgr.14388) 8773 : cluster [DBG] pgmap v6080: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:08 smithi027 bash[22610]: cluster 2024-08-31T05:34:07.212962+0000 mgr.a (mgr.14388) 8774 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:08 smithi191 bash[24992]: cluster 2024-08-31T05:34:07.212962+0000 mgr.a (mgr.14388) 8774 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:08 smithi163 bash[24253]: cluster 2024-08-31T05:34:07.212962+0000 mgr.a (mgr.14388) 8774 : cluster [DBG] pgmap v6081: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:10.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:34:10.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:34:10.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:34:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:10 smithi027 bash[22610]: cluster 2024-08-31T05:34:09.215226+0000 mgr.a (mgr.14388) 8775 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:10 smithi191 bash[24992]: cluster 2024-08-31T05:34:09.215226+0000 mgr.a (mgr.14388) 8775 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:10 smithi163 bash[24253]: cluster 2024-08-31T05:34:09.215226+0000 mgr.a (mgr.14388) 8775 : cluster [DBG] pgmap v6082: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:11.115 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:34:11.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:34:11.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:34:11.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:34:11.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:12 smithi191 bash[24992]: audit 2024-08-31T05:34:10.686559+0000 mgr.a (mgr.14388) 8776 : audit [DBG] from='client.196266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:12 smithi191 bash[24992]: cluster 2024-08-31T05:34:11.216148+0000 mgr.a (mgr.14388) 8777 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:12 smithi163 bash[24253]: audit 2024-08-31T05:34:10.686559+0000 mgr.a (mgr.14388) 8776 : audit [DBG] from='client.196266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:12 smithi163 bash[24253]: cluster 2024-08-31T05:34:11.216148+0000 mgr.a (mgr.14388) 8777 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:12 smithi027 bash[22610]: audit 2024-08-31T05:34:10.686559+0000 mgr.a (mgr.14388) 8776 : audit [DBG] from='client.196266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:12 smithi027 bash[22610]: cluster 2024-08-31T05:34:11.216148+0000 mgr.a (mgr.14388) 8777 : cluster [DBG] pgmap v6083: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:14 smithi191 bash[24992]: cluster 2024-08-31T05:34:13.218312+0000 mgr.a (mgr.14388) 8778 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:14 smithi163 bash[24253]: cluster 2024-08-31T05:34:13.218312+0000 mgr.a (mgr.14388) 8778 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:14 smithi027 bash[22610]: cluster 2024-08-31T05:34:13.218312+0000 mgr.a (mgr.14388) 8778 : cluster [DBG] pgmap v6084: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:16.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:34:16.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:34:16.118 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:34:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:16 smithi191 bash[24992]: cluster 2024-08-31T05:34:15.219107+0000 mgr.a (mgr.14388) 8779 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:16.877 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:34:16.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:34:16.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:34:16.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:34:16.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:16 smithi163 bash[24253]: cluster 2024-08-31T05:34:15.219107+0000 mgr.a (mgr.14388) 8779 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:16 smithi027 bash[22610]: cluster 2024-08-31T05:34:15.219107+0000 mgr.a (mgr.14388) 8779 : cluster [DBG] pgmap v6085: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:17.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:17 smithi191 bash[24992]: audit 2024-08-31T05:34:16.450418+0000 mgr.a (mgr.14388) 8780 : audit [DBG] from='client.196335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:17 smithi163 bash[24253]: audit 2024-08-31T05:34:16.450418+0000 mgr.a (mgr.14388) 8780 : audit [DBG] from='client.196335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:17 smithi027 bash[22610]: audit 2024-08-31T05:34:16.450418+0000 mgr.a (mgr.14388) 8780 : audit [DBG] from='client.196335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:18 smithi191 bash[24992]: cluster 2024-08-31T05:34:17.220074+0000 mgr.a (mgr.14388) 8781 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:18 smithi163 bash[24253]: cluster 2024-08-31T05:34:17.220074+0000 mgr.a (mgr.14388) 8781 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:18 smithi027 bash[22610]: cluster 2024-08-31T05:34:17.220074+0000 mgr.a (mgr.14388) 8781 : cluster [DBG] pgmap v6086: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:19 smithi163 bash[24253]: cluster 2024-08-31T05:34:19.222316+0000 mgr.a (mgr.14388) 8782 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:19 smithi027 bash[22610]: cluster 2024-08-31T05:34:19.222316+0000 mgr.a (mgr.14388) 8782 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:19 smithi191 bash[24992]: cluster 2024-08-31T05:34:19.222316+0000 mgr.a (mgr.14388) 8782 : cluster [DBG] pgmap v6087: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:21.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:34:21.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:34:21.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:34:22.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:22 smithi191 bash[24992]: cluster 2024-08-31T05:34:21.223109+0000 mgr.a (mgr.14388) 8783 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:22.624 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:34:22.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:34:22.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:34:22.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:34:22.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:22 smithi163 bash[24253]: cluster 2024-08-31T05:34:21.223109+0000 mgr.a (mgr.14388) 8783 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:22 smithi027 bash[22610]: cluster 2024-08-31T05:34:21.223109+0000 mgr.a (mgr.14388) 8783 : cluster [DBG] pgmap v6088: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:23 smithi191 bash[24992]: audit 2024-08-31T05:34:22.208704+0000 mgr.a (mgr.14388) 8784 : audit [DBG] from='client.196413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:23 smithi163 bash[24253]: audit 2024-08-31T05:34:22.208704+0000 mgr.a (mgr.14388) 8784 : audit [DBG] from='client.196413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:23.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:23 smithi027 bash[22610]: audit 2024-08-31T05:34:22.208704+0000 mgr.a (mgr.14388) 8784 : audit [DBG] from='client.196413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:24 smithi163 bash[24253]: cluster 2024-08-31T05:34:23.225433+0000 mgr.a (mgr.14388) 8785 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:24 smithi027 bash[22610]: cluster 2024-08-31T05:34:23.225433+0000 mgr.a (mgr.14388) 8785 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:24 smithi191 bash[24992]: cluster 2024-08-31T05:34:23.225433+0000 mgr.a (mgr.14388) 8785 : cluster [DBG] pgmap v6089: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:26 smithi163 bash[24253]: cluster 2024-08-31T05:34:25.226220+0000 mgr.a (mgr.14388) 8786 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:26 smithi027 bash[22610]: cluster 2024-08-31T05:34:25.226220+0000 mgr.a (mgr.14388) 8786 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:26 smithi191 bash[24992]: cluster 2024-08-31T05:34:25.226220+0000 mgr.a (mgr.14388) 8786 : cluster [DBG] pgmap v6090: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:27.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:34:27.626 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:34:27.627 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:34:28.404 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:34:28.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:34:28.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:34:28.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:34:28.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:28 smithi163 bash[24253]: cluster 2024-08-31T05:34:27.227009+0000 mgr.a (mgr.14388) 8787 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:28 smithi027 bash[22610]: cluster 2024-08-31T05:34:27.227009+0000 mgr.a (mgr.14388) 8787 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:28 smithi191 bash[24992]: cluster 2024-08-31T05:34:27.227009+0000 mgr.a (mgr.14388) 8787 : cluster [DBG] pgmap v6091: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:29 smithi163 bash[24253]: audit 2024-08-31T05:34:27.962896+0000 mgr.a (mgr.14388) 8788 : audit [DBG] from='client.196491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:29.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:29 smithi027 bash[22610]: audit 2024-08-31T05:34:27.962896+0000 mgr.a (mgr.14388) 8788 : audit [DBG] from='client.196491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:29 smithi191 bash[24992]: audit 2024-08-31T05:34:27.962896+0000 mgr.a (mgr.14388) 8788 : audit [DBG] from='client.196491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:30 smithi163 bash[24253]: cluster 2024-08-31T05:34:29.229839+0000 mgr.a (mgr.14388) 8789 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:30 smithi027 bash[22610]: cluster 2024-08-31T05:34:29.229839+0000 mgr.a (mgr.14388) 8789 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:30 smithi191 bash[24992]: cluster 2024-08-31T05:34:29.229839+0000 mgr.a (mgr.14388) 8789 : cluster [DBG] pgmap v6092: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:32 smithi163 bash[24253]: cluster 2024-08-31T05:34:31.230607+0000 mgr.a (mgr.14388) 8790 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:34:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:32 smithi027 bash[22610]: cluster 2024-08-31T05:34:31.230607+0000 mgr.a (mgr.14388) 8790 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:34:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:32 smithi191 bash[24992]: cluster 2024-08-31T05:34:31.230607+0000 mgr.a (mgr.14388) 8790 : cluster [DBG] pgmap v6093: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:34:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:34:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:34:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:34:34.171 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:34:34.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:34:34.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:34:34.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:34:34.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:34 smithi163 bash[24253]: cluster 2024-08-31T05:34:33.232632+0000 mgr.a (mgr.14388) 8791 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:34 smithi027 bash[22610]: cluster 2024-08-31T05:34:33.232632+0000 mgr.a (mgr.14388) 8791 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:34 smithi191 bash[24992]: cluster 2024-08-31T05:34:33.232632+0000 mgr.a (mgr.14388) 8791 : cluster [DBG] pgmap v6094: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:35 smithi163 bash[24253]: audit 2024-08-31T05:34:33.743254+0000 mgr.a (mgr.14388) 8792 : audit [DBG] from='client.196566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:35 smithi027 bash[22610]: audit 2024-08-31T05:34:33.743254+0000 mgr.a (mgr.14388) 8792 : audit [DBG] from='client.196566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:35 smithi191 bash[24992]: audit 2024-08-31T05:34:33.743254+0000 mgr.a (mgr.14388) 8792 : audit [DBG] from='client.196566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:36 smithi163 bash[24253]: cluster 2024-08-31T05:34:35.233625+0000 mgr.a (mgr.14388) 8793 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:34:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:36 smithi027 bash[22610]: cluster 2024-08-31T05:34:35.233625+0000 mgr.a (mgr.14388) 8793 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:34:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:36 smithi191 bash[24992]: cluster 2024-08-31T05:34:35.233625+0000 mgr.a (mgr.14388) 8793 : cluster [DBG] pgmap v6095: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:34:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:38 smithi163 bash[24253]: cluster 2024-08-31T05:34:37.234552+0000 mgr.a (mgr.14388) 8794 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:34:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:38 smithi027 bash[22610]: cluster 2024-08-31T05:34:37.234552+0000 mgr.a (mgr.14388) 8794 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:34:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:38 smithi191 bash[24992]: cluster 2024-08-31T05:34:37.234552+0000 mgr.a (mgr.14388) 8794 : cluster [DBG] pgmap v6096: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:34:39.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:34:39.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:34:39.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:34:39.925 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:34:39.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:34:39.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:34:39.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:34:39.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:40 smithi163 bash[24253]: cluster 2024-08-31T05:34:39.236863+0000 mgr.a (mgr.14388) 8795 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:40 smithi027 bash[22610]: cluster 2024-08-31T05:34:39.236863+0000 mgr.a (mgr.14388) 8795 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:40 smithi191 bash[24992]: cluster 2024-08-31T05:34:39.236863+0000 mgr.a (mgr.14388) 8795 : cluster [DBG] pgmap v6097: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:41 smithi163 bash[24253]: audit 2024-08-31T05:34:39.509007+0000 mgr.a (mgr.14388) 8796 : audit [DBG] from='client.196644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:41 smithi027 bash[22610]: audit 2024-08-31T05:34:39.509007+0000 mgr.a (mgr.14388) 8796 : audit [DBG] from='client.196644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:41 smithi191 bash[24992]: audit 2024-08-31T05:34:39.509007+0000 mgr.a (mgr.14388) 8796 : audit [DBG] from='client.196644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:42 smithi163 bash[24253]: cluster 2024-08-31T05:34:41.237924+0000 mgr.a (mgr.14388) 8797 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:42 smithi027 bash[22610]: cluster 2024-08-31T05:34:41.237924+0000 mgr.a (mgr.14388) 8797 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:42 smithi191 bash[24992]: cluster 2024-08-31T05:34:41.237924+0000 mgr.a (mgr.14388) 8797 : cluster [DBG] pgmap v6098: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:44 smithi163 bash[24253]: cluster 2024-08-31T05:34:43.240240+0000 mgr.a (mgr.14388) 8798 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:44 smithi027 bash[22610]: cluster 2024-08-31T05:34:43.240240+0000 mgr.a (mgr.14388) 8798 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:44.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:44 smithi191 bash[24992]: cluster 2024-08-31T05:34:43.240240+0000 mgr.a (mgr.14388) 8798 : cluster [DBG] pgmap v6099: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:34:44.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:34:44.927 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:34:44.928 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:34:45.686 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:34:45.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:34:45.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:34:45.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:34:45.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:45 smithi163 bash[24253]: audit 2024-08-31T05:34:45.218947+0000 mon.a (mon.0) 1895 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:34:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:45 smithi027 bash[22610]: audit 2024-08-31T05:34:45.218947+0000 mon.a (mon.0) 1895 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:34:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:45 smithi191 bash[24992]: audit 2024-08-31T05:34:45.218947+0000 mon.a (mon.0) 1895 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:34:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:46 smithi163 bash[24253]: cluster 2024-08-31T05:34:45.240825+0000 mgr.a (mgr.14388) 8799 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:46 smithi163 bash[24253]: audit 2024-08-31T05:34:45.260001+0000 mgr.a (mgr.14388) 8800 : audit [DBG] from='client.196719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:46 smithi163 bash[24253]: audit 2024-08-31T05:34:46.105633+0000 mon.a (mon.0) 1896 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:34:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:46 smithi163 bash[24253]: audit 2024-08-31T05:34:46.107633+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:34:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:46 smithi163 bash[24253]: audit 2024-08-31T05:34:46.118659+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:34:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:46 smithi163 bash[24253]: audit 2024-08-31T05:34:46.123694+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:34:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:46 smithi027 bash[22610]: cluster 2024-08-31T05:34:45.240825+0000 mgr.a (mgr.14388) 8799 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:46 smithi027 bash[22610]: audit 2024-08-31T05:34:45.260001+0000 mgr.a (mgr.14388) 8800 : audit [DBG] from='client.196719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:46 smithi027 bash[22610]: audit 2024-08-31T05:34:46.105633+0000 mon.a (mon.0) 1896 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:34:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:46 smithi027 bash[22610]: audit 2024-08-31T05:34:46.107633+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:34:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:46 smithi027 bash[22610]: audit 2024-08-31T05:34:46.118659+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:34:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:46 smithi027 bash[22610]: audit 2024-08-31T05:34:46.123694+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:34:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:46 smithi191 bash[24992]: cluster 2024-08-31T05:34:45.240825+0000 mgr.a (mgr.14388) 8799 : cluster [DBG] pgmap v6100: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:46 smithi191 bash[24992]: audit 2024-08-31T05:34:45.260001+0000 mgr.a (mgr.14388) 8800 : audit [DBG] from='client.196719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:46 smithi191 bash[24992]: audit 2024-08-31T05:34:46.105633+0000 mon.a (mon.0) 1896 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:34:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:46 smithi191 bash[24992]: audit 2024-08-31T05:34:46.107633+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:34:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:46 smithi191 bash[24992]: audit 2024-08-31T05:34:46.118659+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:34:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:46 smithi191 bash[24992]: audit 2024-08-31T05:34:46.123694+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:34:47.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:34:46 smithi027 bash[22863]: debug 2024-08-31T05:34:46.836+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:34:47.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:34:46 smithi027 bash[22863]: debug 2024-08-31T05:34:46.836+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:34:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:47 smithi163 bash[24253]: audit 2024-08-31T05:34:46.126396+0000 mgr.a (mgr.14388) 8801 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:34:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:47 smithi027 bash[22610]: audit 2024-08-31T05:34:46.126396+0000 mgr.a (mgr.14388) 8801 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:34:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:47 smithi191 bash[24992]: audit 2024-08-31T05:34:46.126396+0000 mgr.a (mgr.14388) 8801 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:34:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:48 smithi163 bash[24253]: audit 2024-08-31T05:34:46.840433+0000 mgr.a (mgr.14388) 8802 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:34:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:48 smithi163 bash[24253]: cephadm 2024-08-31T05:34:46.841736+0000 mgr.a (mgr.14388) 8803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:34:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:48 smithi163 bash[24253]: cluster 2024-08-31T05:34:47.241749+0000 mgr.a (mgr.14388) 8804 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:48 smithi027 bash[22610]: audit 2024-08-31T05:34:46.840433+0000 mgr.a (mgr.14388) 8802 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:34:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:48 smithi027 bash[22610]: cephadm 2024-08-31T05:34:46.841736+0000 mgr.a (mgr.14388) 8803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:34:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:48 smithi027 bash[22610]: cluster 2024-08-31T05:34:47.241749+0000 mgr.a (mgr.14388) 8804 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:48 smithi191 bash[24992]: audit 2024-08-31T05:34:46.840433+0000 mgr.a (mgr.14388) 8802 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:34:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:48 smithi191 bash[24992]: cephadm 2024-08-31T05:34:46.841736+0000 mgr.a (mgr.14388) 8803 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:34:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:48 smithi191 bash[24992]: cluster 2024-08-31T05:34:47.241749+0000 mgr.a (mgr.14388) 8804 : cluster [DBG] pgmap v6101: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:34:50.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:34:50.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:34:50.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:34:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:50 smithi163 bash[24253]: cluster 2024-08-31T05:34:49.244134+0000 mgr.a (mgr.14388) 8805 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:50 smithi027 bash[22610]: cluster 2024-08-31T05:34:49.244134+0000 mgr.a (mgr.14388) 8805 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:50 smithi191 bash[24992]: cluster 2024-08-31T05:34:49.244134+0000 mgr.a (mgr.14388) 8805 : cluster [DBG] pgmap v6102: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:51.467 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:34:51.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:34:51.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:34:51.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:34:51.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:52 smithi163 bash[24253]: audit 2024-08-31T05:34:51.026755+0000 mgr.a (mgr.14388) 8806 : audit [DBG] from='client.196896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:52 smithi163 bash[24253]: cluster 2024-08-31T05:34:51.244673+0000 mgr.a (mgr.14388) 8807 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:52 smithi027 bash[22610]: audit 2024-08-31T05:34:51.026755+0000 mgr.a (mgr.14388) 8806 : audit [DBG] from='client.196896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:52 smithi027 bash[22610]: cluster 2024-08-31T05:34:51.244673+0000 mgr.a (mgr.14388) 8807 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:52 smithi191 bash[24992]: audit 2024-08-31T05:34:51.026755+0000 mgr.a (mgr.14388) 8806 : audit [DBG] from='client.196896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:52 smithi191 bash[24992]: cluster 2024-08-31T05:34:51.244673+0000 mgr.a (mgr.14388) 8807 : cluster [DBG] pgmap v6103: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:54 smithi163 bash[24253]: cluster 2024-08-31T05:34:53.246909+0000 mgr.a (mgr.14388) 8808 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:54 smithi027 bash[22610]: cluster 2024-08-31T05:34:53.246909+0000 mgr.a (mgr.14388) 8808 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:54 smithi191 bash[24992]: cluster 2024-08-31T05:34:53.246909+0000 mgr.a (mgr.14388) 8808 : cluster [DBG] pgmap v6104: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:34:56.469 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:34:56.469 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:34:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:56 smithi163 bash[24253]: cluster 2024-08-31T05:34:55.247692+0000 mgr.a (mgr.14388) 8809 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:56 smithi027 bash[22610]: cluster 2024-08-31T05:34:55.247692+0000 mgr.a (mgr.14388) 8809 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:56 smithi191 bash[24992]: cluster 2024-08-31T05:34:55.247692+0000 mgr.a (mgr.14388) 8809 : cluster [DBG] pgmap v6105: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:57.248 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:34:57.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:34:57.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:34:57.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:34:57.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:34:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:58 smithi163 bash[24253]: audit 2024-08-31T05:34:56.806294+0000 mgr.a (mgr.14388) 8810 : audit [DBG] from='client.196971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:34:58 smithi163 bash[24253]: cluster 2024-08-31T05:34:57.248199+0000 mgr.a (mgr.14388) 8811 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:58 smithi027 bash[22610]: audit 2024-08-31T05:34:56.806294+0000 mgr.a (mgr.14388) 8810 : audit [DBG] from='client.196971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:34:58 smithi027 bash[22610]: cluster 2024-08-31T05:34:57.248199+0000 mgr.a (mgr.14388) 8811 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:34:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:58 smithi191 bash[24992]: audit 2024-08-31T05:34:56.806294+0000 mgr.a (mgr.14388) 8810 : audit [DBG] from='client.196971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:34:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:34:58 smithi191 bash[24992]: cluster 2024-08-31T05:34:57.248199+0000 mgr.a (mgr.14388) 8811 : cluster [DBG] pgmap v6106: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:00 smithi163 bash[24253]: cluster 2024-08-31T05:34:59.250354+0000 mgr.a (mgr.14388) 8812 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:00 smithi027 bash[22610]: cluster 2024-08-31T05:34:59.250354+0000 mgr.a (mgr.14388) 8812 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:00 smithi191 bash[24992]: cluster 2024-08-31T05:34:59.250354+0000 mgr.a (mgr.14388) 8812 : cluster [DBG] pgmap v6107: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:02.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:35:02.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:35:02.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:35:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:02 smithi163 bash[24253]: cluster 2024-08-31T05:35:01.251137+0000 mgr.a (mgr.14388) 8813 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:02 smithi027 bash[22610]: cluster 2024-08-31T05:35:01.251137+0000 mgr.a (mgr.14388) 8813 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:02 smithi191 bash[24992]: cluster 2024-08-31T05:35:01.251137+0000 mgr.a (mgr.14388) 8813 : cluster [DBG] pgmap v6108: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:03.028 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:35:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:35:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:35:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:35:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:35:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:04 smithi163 bash[24253]: audit 2024-08-31T05:35:02.589469+0000 mgr.a (mgr.14388) 8814 : audit [DBG] from='client.197046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:04 smithi163 bash[24253]: cluster 2024-08-31T05:35:03.253923+0000 mgr.a (mgr.14388) 8815 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:35:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:04 smithi027 bash[22610]: audit 2024-08-31T05:35:02.589469+0000 mgr.a (mgr.14388) 8814 : audit [DBG] from='client.197046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:04 smithi027 bash[22610]: cluster 2024-08-31T05:35:03.253923+0000 mgr.a (mgr.14388) 8815 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:35:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:04 smithi191 bash[24992]: audit 2024-08-31T05:35:02.589469+0000 mgr.a (mgr.14388) 8814 : audit [DBG] from='client.197046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:04 smithi191 bash[24992]: cluster 2024-08-31T05:35:03.253923+0000 mgr.a (mgr.14388) 8815 : cluster [DBG] pgmap v6109: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:35:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:06 smithi163 bash[24253]: cluster 2024-08-31T05:35:05.254710+0000 mgr.a (mgr.14388) 8816 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:35:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:06 smithi027 bash[22610]: cluster 2024-08-31T05:35:05.254710+0000 mgr.a (mgr.14388) 8816 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:35:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:06 smithi191 bash[24992]: cluster 2024-08-31T05:35:05.254710+0000 mgr.a (mgr.14388) 8816 : cluster [DBG] pgmap v6110: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:35:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:35:08.030 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:35:08.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:35:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:08 smithi163 bash[24253]: cluster 2024-08-31T05:35:07.255458+0000 mgr.a (mgr.14388) 8817 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:35:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:08 smithi027 bash[22610]: cluster 2024-08-31T05:35:07.255458+0000 mgr.a (mgr.14388) 8817 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:35:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:08 smithi191 bash[24992]: cluster 2024-08-31T05:35:07.255458+0000 mgr.a (mgr.14388) 8817 : cluster [DBG] pgmap v6111: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:35:08.821 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:35:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:35:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:35:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:35:08.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:35:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:09 smithi163 bash[24253]: audit 2024-08-31T05:35:08.368654+0000 mgr.a (mgr.14388) 8818 : audit [DBG] from='client.197124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:09.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:09 smithi027 bash[22610]: audit 2024-08-31T05:35:08.368654+0000 mgr.a (mgr.14388) 8818 : audit [DBG] from='client.197124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:09 smithi191 bash[24992]: audit 2024-08-31T05:35:08.368654+0000 mgr.a (mgr.14388) 8818 : audit [DBG] from='client.197124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:10 smithi163 bash[24253]: cluster 2024-08-31T05:35:09.258315+0000 mgr.a (mgr.14388) 8819 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:10 smithi027 bash[22610]: cluster 2024-08-31T05:35:09.258315+0000 mgr.a (mgr.14388) 8819 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:10 smithi191 bash[24992]: cluster 2024-08-31T05:35:09.258315+0000 mgr.a (mgr.14388) 8819 : cluster [DBG] pgmap v6112: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:12 smithi163 bash[24253]: cluster 2024-08-31T05:35:11.259143+0000 mgr.a (mgr.14388) 8820 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:35:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:12 smithi027 bash[22610]: cluster 2024-08-31T05:35:11.259143+0000 mgr.a (mgr.14388) 8820 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:35:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:12 smithi191 bash[24992]: cluster 2024-08-31T05:35:11.259143+0000 mgr.a (mgr.14388) 8820 : cluster [DBG] pgmap v6113: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:35:13.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:35:13.823 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:35:13.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:35:14.577 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:35:14.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:35:14.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:35:14.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:35:14.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:35:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:14 smithi163 bash[24253]: cluster 2024-08-31T05:35:13.261161+0000 mgr.a (mgr.14388) 8821 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:14 smithi027 bash[22610]: cluster 2024-08-31T05:35:13.261161+0000 mgr.a (mgr.14388) 8821 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:14 smithi191 bash[24992]: cluster 2024-08-31T05:35:13.261161+0000 mgr.a (mgr.14388) 8821 : cluster [DBG] pgmap v6114: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:15.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:15 smithi027 bash[22610]: audit 2024-08-31T05:35:14.150757+0000 mgr.a (mgr.14388) 8822 : audit [DBG] from='client.197202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:15 smithi191 bash[24992]: audit 2024-08-31T05:35:14.150757+0000 mgr.a (mgr.14388) 8822 : audit [DBG] from='client.197202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:15 smithi163 bash[24253]: audit 2024-08-31T05:35:14.150757+0000 mgr.a (mgr.14388) 8822 : audit [DBG] from='client.197202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:16 smithi027 bash[22610]: cluster 2024-08-31T05:35:15.262283+0000 mgr.a (mgr.14388) 8823 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:35:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:16 smithi191 bash[24992]: cluster 2024-08-31T05:35:15.262283+0000 mgr.a (mgr.14388) 8823 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:35:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:16 smithi163 bash[24253]: cluster 2024-08-31T05:35:15.262283+0000 mgr.a (mgr.14388) 8823 : cluster [DBG] pgmap v6115: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:35:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:18 smithi027 bash[22610]: cluster 2024-08-31T05:35:17.263301+0000 mgr.a (mgr.14388) 8824 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:35:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:18 smithi191 bash[24992]: cluster 2024-08-31T05:35:17.263301+0000 mgr.a (mgr.14388) 8824 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:35:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:18 smithi163 bash[24253]: cluster 2024-08-31T05:35:17.263301+0000 mgr.a (mgr.14388) 8824 : cluster [DBG] pgmap v6116: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:35:19.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:35:19.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:35:19.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:35:20.312 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:35:20.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:35:20.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:35:20.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:35:20.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:35:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:20 smithi027 bash[22610]: cluster 2024-08-31T05:35:19.265687+0000 mgr.a (mgr.14388) 8825 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:35:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:20 smithi191 bash[24992]: cluster 2024-08-31T05:35:19.265687+0000 mgr.a (mgr.14388) 8825 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:35:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:20 smithi163 bash[24253]: cluster 2024-08-31T05:35:19.265687+0000 mgr.a (mgr.14388) 8825 : cluster [DBG] pgmap v6117: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:35:21.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:21 smithi027 bash[22610]: audit 2024-08-31T05:35:19.909488+0000 mgr.a (mgr.14388) 8826 : audit [DBG] from='client.197277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:21 smithi191 bash[24992]: audit 2024-08-31T05:35:19.909488+0000 mgr.a (mgr.14388) 8826 : audit [DBG] from='client.197277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:21 smithi163 bash[24253]: audit 2024-08-31T05:35:19.909488+0000 mgr.a (mgr.14388) 8826 : audit [DBG] from='client.197277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:22 smithi027 bash[22610]: cluster 2024-08-31T05:35:21.266627+0000 mgr.a (mgr.14388) 8827 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:22 smithi191 bash[24992]: cluster 2024-08-31T05:35:21.266627+0000 mgr.a (mgr.14388) 8827 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:22 smithi163 bash[24253]: cluster 2024-08-31T05:35:21.266627+0000 mgr.a (mgr.14388) 8827 : cluster [DBG] pgmap v6118: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:24 smithi027 bash[22610]: cluster 2024-08-31T05:35:23.268799+0000 mgr.a (mgr.14388) 8828 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:24 smithi191 bash[24992]: cluster 2024-08-31T05:35:23.268799+0000 mgr.a (mgr.14388) 8828 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:24 smithi163 bash[24253]: cluster 2024-08-31T05:35:23.268799+0000 mgr.a (mgr.14388) 8828 : cluster [DBG] pgmap v6119: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:25.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:35:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:35:25.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:35:26.096 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:35:26.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:35:26.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:35:26.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:35:26.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:35:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:26 smithi191 bash[24992]: cluster 2024-08-31T05:35:25.269549+0000 mgr.a (mgr.14388) 8829 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:26 smithi163 bash[24253]: cluster 2024-08-31T05:35:25.269549+0000 mgr.a (mgr.14388) 8829 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:26 smithi027 bash[22610]: cluster 2024-08-31T05:35:25.269549+0000 mgr.a (mgr.14388) 8829 : cluster [DBG] pgmap v6120: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:27 smithi191 bash[24992]: audit 2024-08-31T05:35:25.654068+0000 mgr.a (mgr.14388) 8830 : audit [DBG] from='client.197355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:27 smithi163 bash[24253]: audit 2024-08-31T05:35:25.654068+0000 mgr.a (mgr.14388) 8830 : audit [DBG] from='client.197355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:27 smithi027 bash[22610]: audit 2024-08-31T05:35:25.654068+0000 mgr.a (mgr.14388) 8830 : audit [DBG] from='client.197355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:28 smithi191 bash[24992]: cluster 2024-08-31T05:35:27.270428+0000 mgr.a (mgr.14388) 8831 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:28 smithi163 bash[24253]: cluster 2024-08-31T05:35:27.270428+0000 mgr.a (mgr.14388) 8831 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:28 smithi027 bash[22610]: cluster 2024-08-31T05:35:27.270428+0000 mgr.a (mgr.14388) 8831 : cluster [DBG] pgmap v6121: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:30 smithi191 bash[24992]: cluster 2024-08-31T05:35:29.272681+0000 mgr.a (mgr.14388) 8832 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:30 smithi163 bash[24253]: cluster 2024-08-31T05:35:29.272681+0000 mgr.a (mgr.14388) 8832 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:30 smithi027 bash[22610]: cluster 2024-08-31T05:35:29.272681+0000 mgr.a (mgr.14388) 8832 : cluster [DBG] pgmap v6122: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:31.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:35:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:35:31.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:35:31.840 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:35:31.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:35:31.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:35:31.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:35:31.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:35:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:32 smithi191 bash[24992]: cluster 2024-08-31T05:35:31.273575+0000 mgr.a (mgr.14388) 8833 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:32 smithi191 bash[24992]: audit 2024-08-31T05:35:31.428072+0000 mgr.a (mgr.14388) 8834 : audit [DBG] from='client.197433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:32 smithi163 bash[24253]: cluster 2024-08-31T05:35:31.273575+0000 mgr.a (mgr.14388) 8833 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:32 smithi163 bash[24253]: audit 2024-08-31T05:35:31.428072+0000 mgr.a (mgr.14388) 8834 : audit [DBG] from='client.197433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:32 smithi027 bash[22610]: cluster 2024-08-31T05:35:31.273575+0000 mgr.a (mgr.14388) 8833 : cluster [DBG] pgmap v6123: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:32 smithi027 bash[22610]: audit 2024-08-31T05:35:31.428072+0000 mgr.a (mgr.14388) 8834 : audit [DBG] from='client.197433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:34 smithi191 bash[24992]: cluster 2024-08-31T05:35:33.275805+0000 mgr.a (mgr.14388) 8835 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:34 smithi163 bash[24253]: cluster 2024-08-31T05:35:33.275805+0000 mgr.a (mgr.14388) 8835 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:34 smithi027 bash[22610]: cluster 2024-08-31T05:35:33.275805+0000 mgr.a (mgr.14388) 8835 : cluster [DBG] pgmap v6124: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:36 smithi191 bash[24992]: cluster 2024-08-31T05:35:35.276612+0000 mgr.a (mgr.14388) 8836 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:36.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:35:36.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:35:36.843 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:35:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:36 smithi163 bash[24253]: cluster 2024-08-31T05:35:35.276612+0000 mgr.a (mgr.14388) 8836 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:36 smithi027 bash[22610]: cluster 2024-08-31T05:35:35.276612+0000 mgr.a (mgr.14388) 8836 : cluster [DBG] pgmap v6125: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:37.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:35:37.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:35:37.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:35:37.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:35:37.620 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:35:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:38 smithi191 bash[24992]: audit 2024-08-31T05:35:37.178173+0000 mgr.a (mgr.14388) 8837 : audit [DBG] from='client.197511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:38 smithi191 bash[24992]: cluster 2024-08-31T05:35:37.277100+0000 mgr.a (mgr.14388) 8838 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:38 smithi163 bash[24253]: audit 2024-08-31T05:35:37.178173+0000 mgr.a (mgr.14388) 8837 : audit [DBG] from='client.197511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:38 smithi163 bash[24253]: cluster 2024-08-31T05:35:37.277100+0000 mgr.a (mgr.14388) 8838 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:38 smithi027 bash[22610]: audit 2024-08-31T05:35:37.178173+0000 mgr.a (mgr.14388) 8837 : audit [DBG] from='client.197511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:38 smithi027 bash[22610]: cluster 2024-08-31T05:35:37.277100+0000 mgr.a (mgr.14388) 8838 : cluster [DBG] pgmap v6126: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:40 smithi191 bash[24992]: cluster 2024-08-31T05:35:39.279432+0000 mgr.a (mgr.14388) 8839 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:40 smithi163 bash[24253]: cluster 2024-08-31T05:35:39.279432+0000 mgr.a (mgr.14388) 8839 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:40 smithi027 bash[22610]: cluster 2024-08-31T05:35:39.279432+0000 mgr.a (mgr.14388) 8839 : cluster [DBG] pgmap v6127: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:35:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:41 smithi191 bash[24992]: cluster 2024-08-31T05:35:41.280189+0000 mgr.a (mgr.14388) 8840 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:41 smithi163 bash[24253]: cluster 2024-08-31T05:35:41.280189+0000 mgr.a (mgr.14388) 8840 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:41 smithi027 bash[22610]: cluster 2024-08-31T05:35:41.280189+0000 mgr.a (mgr.14388) 8840 : cluster [DBG] pgmap v6128: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:42.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:35:42.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:35:42.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:35:43.377 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:35:43.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:35:43.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:35:43.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:35:43.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:35:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:44 smithi163 bash[24253]: audit 2024-08-31T05:35:42.958832+0000 mgr.a (mgr.14388) 8841 : audit [DBG] from='client.197589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:44.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:44 smithi163 bash[24253]: cluster 2024-08-31T05:35:43.281998+0000 mgr.a (mgr.14388) 8842 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:44 smithi027 bash[22610]: audit 2024-08-31T05:35:42.958832+0000 mgr.a (mgr.14388) 8841 : audit [DBG] from='client.197589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:44 smithi027 bash[22610]: cluster 2024-08-31T05:35:43.281998+0000 mgr.a (mgr.14388) 8842 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:44 smithi191 bash[24992]: audit 2024-08-31T05:35:42.958832+0000 mgr.a (mgr.14388) 8841 : audit [DBG] from='client.197589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:44 smithi191 bash[24992]: cluster 2024-08-31T05:35:43.281998+0000 mgr.a (mgr.14388) 8842 : cluster [DBG] pgmap v6129: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:46 smithi163 bash[24253]: cluster 2024-08-31T05:35:45.282794+0000 mgr.a (mgr.14388) 8843 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:35:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:46 smithi027 bash[22610]: cluster 2024-08-31T05:35:45.282794+0000 mgr.a (mgr.14388) 8843 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:35:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:46 smithi191 bash[24992]: cluster 2024-08-31T05:35:45.282794+0000 mgr.a (mgr.14388) 8843 : cluster [DBG] pgmap v6130: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:35:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:47 smithi163 bash[24253]: audit 2024-08-31T05:35:46.893760+0000 mon.a (mon.0) 1900 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:35:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:47 smithi027 bash[22610]: audit 2024-08-31T05:35:46.893760+0000 mon.a (mon.0) 1900 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:35:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:47 smithi191 bash[24992]: audit 2024-08-31T05:35:46.893760+0000 mon.a (mon.0) 1900 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:35:48.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:35:48.380 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:35:48.380 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:35:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:48 smithi191 bash[24992]: cluster 2024-08-31T05:35:47.283493+0000 mgr.a (mgr.14388) 8844 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:35:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:48 smithi191 bash[24992]: audit 2024-08-31T05:35:47.520231+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:35:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:48 smithi191 bash[24992]: audit 2024-08-31T05:35:47.523639+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:35:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:48 smithi191 bash[24992]: audit 2024-08-31T05:35:48.310137+0000 mon.a (mon.0) 1903 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:35:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:48 smithi191 bash[24992]: audit 2024-08-31T05:35:48.311786+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:35:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:48 smithi191 bash[24992]: audit 2024-08-31T05:35:48.322100+0000 mon.a (mon.0) 1905 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:35:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:48 smithi191 bash[24992]: audit 2024-08-31T05:35:48.327062+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:35:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:48 smithi163 bash[24253]: cluster 2024-08-31T05:35:47.283493+0000 mgr.a (mgr.14388) 8844 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:35:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:48 smithi163 bash[24253]: audit 2024-08-31T05:35:47.520231+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:35:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:48 smithi163 bash[24253]: audit 2024-08-31T05:35:47.523639+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:35:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:48 smithi163 bash[24253]: audit 2024-08-31T05:35:48.310137+0000 mon.a (mon.0) 1903 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:35:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:48 smithi163 bash[24253]: audit 2024-08-31T05:35:48.311786+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:35:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:48 smithi163 bash[24253]: audit 2024-08-31T05:35:48.322100+0000 mon.a (mon.0) 1905 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:35:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:48 smithi163 bash[24253]: audit 2024-08-31T05:35:48.327062+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:35:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:48 smithi027 bash[22610]: cluster 2024-08-31T05:35:47.283493+0000 mgr.a (mgr.14388) 8844 : cluster [DBG] pgmap v6131: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:35:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:48 smithi027 bash[22610]: audit 2024-08-31T05:35:47.520231+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:35:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:48 smithi027 bash[22610]: audit 2024-08-31T05:35:47.523639+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:35:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:48 smithi027 bash[22610]: audit 2024-08-31T05:35:48.310137+0000 mon.a (mon.0) 1903 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:35:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:48 smithi027 bash[22610]: audit 2024-08-31T05:35:48.311786+0000 mon.a (mon.0) 1904 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:35:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:48 smithi027 bash[22610]: audit 2024-08-31T05:35:48.322100+0000 mon.a (mon.0) 1905 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:35:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:48 smithi027 bash[22610]: audit 2024-08-31T05:35:48.327062+0000 mon.a (mon.0) 1906 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:35:49.455 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:35:49.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:35:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:35:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:35:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:35:49.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:35:49 smithi027 bash[22863]: debug 2024-08-31T05:35:49.054+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:35:49.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:35:49 smithi027 bash[22863]: debug 2024-08-31T05:35:49.066+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:35:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:49 smithi191 bash[24992]: audit 2024-08-31T05:35:48.329339+0000 mgr.a (mgr.14388) 8845 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:35:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:49 smithi163 bash[24253]: audit 2024-08-31T05:35:48.329339+0000 mgr.a (mgr.14388) 8845 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:35:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:49 smithi027 bash[22610]: audit 2024-08-31T05:35:48.329339+0000 mgr.a (mgr.14388) 8845 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:35:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:50 smithi191 bash[24992]: audit 2024-08-31T05:35:48.714673+0000 mgr.a (mgr.14388) 8846 : audit [DBG] from='client.197682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:50 smithi191 bash[24992]: audit 2024-08-31T05:35:49.056764+0000 mgr.a (mgr.14388) 8847 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:35:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:50 smithi191 bash[24992]: cephadm 2024-08-31T05:35:49.067962+0000 mgr.a (mgr.14388) 8848 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:35:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:50 smithi191 bash[24992]: cluster 2024-08-31T05:35:49.284759+0000 mgr.a (mgr.14388) 8849 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:50 smithi163 bash[24253]: audit 2024-08-31T05:35:48.714673+0000 mgr.a (mgr.14388) 8846 : audit [DBG] from='client.197682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:50 smithi163 bash[24253]: audit 2024-08-31T05:35:49.056764+0000 mgr.a (mgr.14388) 8847 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:35:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:50 smithi163 bash[24253]: cephadm 2024-08-31T05:35:49.067962+0000 mgr.a (mgr.14388) 8848 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:35:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:50 smithi163 bash[24253]: cluster 2024-08-31T05:35:49.284759+0000 mgr.a (mgr.14388) 8849 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:50 smithi027 bash[22610]: audit 2024-08-31T05:35:48.714673+0000 mgr.a (mgr.14388) 8846 : audit [DBG] from='client.197682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:50 smithi027 bash[22610]: audit 2024-08-31T05:35:49.056764+0000 mgr.a (mgr.14388) 8847 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:35:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:50 smithi027 bash[22610]: cephadm 2024-08-31T05:35:49.067962+0000 mgr.a (mgr.14388) 8848 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:35:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:50 smithi027 bash[22610]: cluster 2024-08-31T05:35:49.284759+0000 mgr.a (mgr.14388) 8849 : cluster [DBG] pgmap v6132: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:35:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:51 smithi191 bash[24992]: cluster 2024-08-31T05:35:51.285595+0000 mgr.a (mgr.14388) 8850 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:35:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:51 smithi163 bash[24253]: cluster 2024-08-31T05:35:51.285595+0000 mgr.a (mgr.14388) 8850 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:35:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:51 smithi027 bash[22610]: cluster 2024-08-31T05:35:51.285595+0000 mgr.a (mgr.14388) 8850 : cluster [DBG] pgmap v6133: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:35:54.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:35:54.458 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:35:54.458 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:35:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:54 smithi163 bash[24253]: cluster 2024-08-31T05:35:53.287786+0000 mgr.a (mgr.14388) 8851 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:54.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:54 smithi027 bash[22610]: cluster 2024-08-31T05:35:53.287786+0000 mgr.a (mgr.14388) 8851 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:54.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:54 smithi191 bash[24992]: cluster 2024-08-31T05:35:53.287786+0000 mgr.a (mgr.14388) 8851 : cluster [DBG] pgmap v6134: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:55.229 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:35:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:35:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:35:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:35:55.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:35:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:56 smithi163 bash[24253]: audit 2024-08-31T05:35:54.791823+0000 mgr.a (mgr.14388) 8852 : audit [DBG] from='client.197847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:56.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:56 smithi163 bash[24253]: cluster 2024-08-31T05:35:55.288718+0000 mgr.a (mgr.14388) 8853 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:56.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:56 smithi027 bash[22610]: audit 2024-08-31T05:35:54.791823+0000 mgr.a (mgr.14388) 8852 : audit [DBG] from='client.197847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:56 smithi027 bash[22610]: cluster 2024-08-31T05:35:55.288718+0000 mgr.a (mgr.14388) 8853 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:56 smithi191 bash[24992]: audit 2024-08-31T05:35:54.791823+0000 mgr.a (mgr.14388) 8852 : audit [DBG] from='client.197847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:35:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:56 smithi191 bash[24992]: cluster 2024-08-31T05:35:55.288718+0000 mgr.a (mgr.14388) 8853 : cluster [DBG] pgmap v6135: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:35:58 smithi163 bash[24253]: cluster 2024-08-31T05:35:57.289541+0000 mgr.a (mgr.14388) 8854 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:35:58 smithi027 bash[22610]: cluster 2024-08-31T05:35:57.289541+0000 mgr.a (mgr.14388) 8854 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:35:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:35:58 smithi191 bash[24992]: cluster 2024-08-31T05:35:57.289541+0000 mgr.a (mgr.14388) 8854 : cluster [DBG] pgmap v6136: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:00.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:00.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:00.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:00 smithi163 bash[24253]: cluster 2024-08-31T05:35:59.291793+0000 mgr.a (mgr.14388) 8855 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:00.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:00 smithi027 bash[22610]: cluster 2024-08-31T05:35:59.291793+0000 mgr.a (mgr.14388) 8855 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:00 smithi191 bash[24992]: cluster 2024-08-31T05:35:59.291793+0000 mgr.a (mgr.14388) 8855 : cluster [DBG] pgmap v6137: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:01.019 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:01.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:01.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:01.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:01.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:02 smithi163 bash[24253]: audit 2024-08-31T05:36:00.569560+0000 mgr.a (mgr.14388) 8856 : audit [DBG] from='client.197922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:02 smithi163 bash[24253]: cluster 2024-08-31T05:36:01.292842+0000 mgr.a (mgr.14388) 8857 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:02 smithi027 bash[22610]: audit 2024-08-31T05:36:00.569560+0000 mgr.a (mgr.14388) 8856 : audit [DBG] from='client.197922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:02.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:02 smithi027 bash[22610]: cluster 2024-08-31T05:36:01.292842+0000 mgr.a (mgr.14388) 8857 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:02 smithi191 bash[24992]: audit 2024-08-31T05:36:00.569560+0000 mgr.a (mgr.14388) 8856 : audit [DBG] from='client.197922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:02 smithi191 bash[24992]: cluster 2024-08-31T05:36:01.292842+0000 mgr.a (mgr.14388) 8857 : cluster [DBG] pgmap v6138: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:04 smithi163 bash[24253]: cluster 2024-08-31T05:36:03.295231+0000 mgr.a (mgr.14388) 8858 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:04 smithi027 bash[22610]: cluster 2024-08-31T05:36:03.295231+0000 mgr.a (mgr.14388) 8858 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:04 smithi191 bash[24992]: cluster 2024-08-31T05:36:03.295231+0000 mgr.a (mgr.14388) 8858 : cluster [DBG] pgmap v6139: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:06.021 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:06.022 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:06.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:06 smithi163 bash[24253]: cluster 2024-08-31T05:36:05.296141+0000 mgr.a (mgr.14388) 8859 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:06 smithi027 bash[22610]: cluster 2024-08-31T05:36:05.296141+0000 mgr.a (mgr.14388) 8859 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:06.766 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:06.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:06.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:06.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:06.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:06 smithi191 bash[24992]: cluster 2024-08-31T05:36:05.296141+0000 mgr.a (mgr.14388) 8859 : cluster [DBG] pgmap v6140: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:07 smithi163 bash[24253]: audit 2024-08-31T05:36:06.353226+0000 mgr.a (mgr.14388) 8860 : audit [DBG] from='client.197997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:07 smithi027 bash[22610]: audit 2024-08-31T05:36:06.353226+0000 mgr.a (mgr.14388) 8860 : audit [DBG] from='client.197997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:07 smithi191 bash[24992]: audit 2024-08-31T05:36:06.353226+0000 mgr.a (mgr.14388) 8860 : audit [DBG] from='client.197997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:08 smithi163 bash[24253]: cluster 2024-08-31T05:36:07.297056+0000 mgr.a (mgr.14388) 8861 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:08 smithi027 bash[22610]: cluster 2024-08-31T05:36:07.297056+0000 mgr.a (mgr.14388) 8861 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:08 smithi191 bash[24992]: cluster 2024-08-31T05:36:07.297056+0000 mgr.a (mgr.14388) 8861 : cluster [DBG] pgmap v6141: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:10 smithi163 bash[24253]: cluster 2024-08-31T05:36:09.299290+0000 mgr.a (mgr.14388) 8862 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:10 smithi027 bash[22610]: cluster 2024-08-31T05:36:09.299290+0000 mgr.a (mgr.14388) 8862 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:10 smithi191 bash[24992]: cluster 2024-08-31T05:36:09.299290+0000 mgr.a (mgr.14388) 8862 : cluster [DBG] pgmap v6142: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:11.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:11.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:11.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:12.544 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:12.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:12.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:12.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:12.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:12 smithi163 bash[24253]: cluster 2024-08-31T05:36:11.300042+0000 mgr.a (mgr.14388) 8863 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:12 smithi027 bash[22610]: cluster 2024-08-31T05:36:11.300042+0000 mgr.a (mgr.14388) 8863 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:12 smithi191 bash[24992]: cluster 2024-08-31T05:36:11.300042+0000 mgr.a (mgr.14388) 8863 : cluster [DBG] pgmap v6143: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:13 smithi163 bash[24253]: audit 2024-08-31T05:36:12.103848+0000 mgr.a (mgr.14388) 8864 : audit [DBG] from='client.198072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:13.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:13 smithi027 bash[22610]: audit 2024-08-31T05:36:12.103848+0000 mgr.a (mgr.14388) 8864 : audit [DBG] from='client.198072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:13 smithi191 bash[24992]: audit 2024-08-31T05:36:12.103848+0000 mgr.a (mgr.14388) 8864 : audit [DBG] from='client.198072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:14 smithi163 bash[24253]: cluster 2024-08-31T05:36:13.302278+0000 mgr.a (mgr.14388) 8865 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:14 smithi027 bash[22610]: cluster 2024-08-31T05:36:13.302278+0000 mgr.a (mgr.14388) 8865 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:14 smithi191 bash[24992]: cluster 2024-08-31T05:36:13.302278+0000 mgr.a (mgr.14388) 8865 : cluster [DBG] pgmap v6144: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:16.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:16 smithi163 bash[24253]: cluster 2024-08-31T05:36:15.303078+0000 mgr.a (mgr.14388) 8866 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:16 smithi027 bash[22610]: cluster 2024-08-31T05:36:15.303078+0000 mgr.a (mgr.14388) 8866 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:16 smithi191 bash[24992]: cluster 2024-08-31T05:36:15.303078+0000 mgr.a (mgr.14388) 8866 : cluster [DBG] pgmap v6145: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:17.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:17.547 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:17.547 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:18.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:18.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:18.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:18.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:18.313 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:18 smithi163 bash[24253]: cluster 2024-08-31T05:36:17.303826+0000 mgr.a (mgr.14388) 8867 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:18 smithi027 bash[22610]: cluster 2024-08-31T05:36:17.303826+0000 mgr.a (mgr.14388) 8867 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:18 smithi191 bash[24992]: cluster 2024-08-31T05:36:17.303826+0000 mgr.a (mgr.14388) 8867 : cluster [DBG] pgmap v6146: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:19 smithi163 bash[24253]: audit 2024-08-31T05:36:17.884985+0000 mgr.a (mgr.14388) 8868 : audit [DBG] from='client.198147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:19 smithi027 bash[22610]: audit 2024-08-31T05:36:17.884985+0000 mgr.a (mgr.14388) 8868 : audit [DBG] from='client.198147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:19 smithi191 bash[24992]: audit 2024-08-31T05:36:17.884985+0000 mgr.a (mgr.14388) 8868 : audit [DBG] from='client.198147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:20 smithi163 bash[24253]: cluster 2024-08-31T05:36:19.306558+0000 mgr.a (mgr.14388) 8869 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:20 smithi027 bash[22610]: cluster 2024-08-31T05:36:19.306558+0000 mgr.a (mgr.14388) 8869 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:20 smithi191 bash[24992]: cluster 2024-08-31T05:36:19.306558+0000 mgr.a (mgr.14388) 8869 : cluster [DBG] pgmap v6147: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:22 smithi163 bash[24253]: cluster 2024-08-31T05:36:21.307332+0000 mgr.a (mgr.14388) 8870 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:36:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:22 smithi027 bash[22610]: cluster 2024-08-31T05:36:21.307332+0000 mgr.a (mgr.14388) 8870 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:36:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:22 smithi191 bash[24992]: cluster 2024-08-31T05:36:21.307332+0000 mgr.a (mgr.14388) 8870 : cluster [DBG] pgmap v6148: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:36:23.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:23.315 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:23.315 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:24.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:24.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:24.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:24.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:24.086 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:24 smithi163 bash[24253]: cluster 2024-08-31T05:36:23.309322+0000 mgr.a (mgr.14388) 8871 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:24 smithi027 bash[22610]: cluster 2024-08-31T05:36:23.309322+0000 mgr.a (mgr.14388) 8871 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:24 smithi191 bash[24992]: cluster 2024-08-31T05:36:23.309322+0000 mgr.a (mgr.14388) 8871 : cluster [DBG] pgmap v6149: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:25 smithi163 bash[24253]: audit 2024-08-31T05:36:23.651147+0000 mgr.a (mgr.14388) 8872 : audit [DBG] from='client.198225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:25.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:25 smithi027 bash[22610]: audit 2024-08-31T05:36:23.651147+0000 mgr.a (mgr.14388) 8872 : audit [DBG] from='client.198225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:25 smithi191 bash[24992]: audit 2024-08-31T05:36:23.651147+0000 mgr.a (mgr.14388) 8872 : audit [DBG] from='client.198225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:26 smithi163 bash[24253]: cluster 2024-08-31T05:36:25.310213+0000 mgr.a (mgr.14388) 8873 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:36:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:26 smithi027 bash[22610]: cluster 2024-08-31T05:36:25.310213+0000 mgr.a (mgr.14388) 8873 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:36:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:26 smithi191 bash[24992]: cluster 2024-08-31T05:36:25.310213+0000 mgr.a (mgr.14388) 8873 : cluster [DBG] pgmap v6150: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:36:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:28 smithi163 bash[24253]: cluster 2024-08-31T05:36:27.310981+0000 mgr.a (mgr.14388) 8874 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:36:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:28 smithi027 bash[22610]: cluster 2024-08-31T05:36:27.310981+0000 mgr.a (mgr.14388) 8874 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:36:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:28 smithi191 bash[24992]: cluster 2024-08-31T05:36:27.310981+0000 mgr.a (mgr.14388) 8874 : cluster [DBG] pgmap v6151: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:36:29.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:29.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:29.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:29.861 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:29.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:29.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:29.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:29.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:30 smithi027 bash[22610]: cluster 2024-08-31T05:36:29.312324+0000 mgr.a (mgr.14388) 8875 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:30 smithi027 bash[22610]: audit 2024-08-31T05:36:29.422957+0000 mgr.a (mgr.14388) 8876 : audit [DBG] from='client.198300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:30 smithi191 bash[24992]: cluster 2024-08-31T05:36:29.312324+0000 mgr.a (mgr.14388) 8875 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:30 smithi191 bash[24992]: audit 2024-08-31T05:36:29.422957+0000 mgr.a (mgr.14388) 8876 : audit [DBG] from='client.198300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:30 smithi163 bash[24253]: cluster 2024-08-31T05:36:29.312324+0000 mgr.a (mgr.14388) 8875 : cluster [DBG] pgmap v6152: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:30 smithi163 bash[24253]: audit 2024-08-31T05:36:29.422957+0000 mgr.a (mgr.14388) 8876 : audit [DBG] from='client.198300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:32 smithi027 bash[22610]: cluster 2024-08-31T05:36:31.313191+0000 mgr.a (mgr.14388) 8877 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:32 smithi191 bash[24992]: cluster 2024-08-31T05:36:31.313191+0000 mgr.a (mgr.14388) 8877 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:32 smithi163 bash[24253]: cluster 2024-08-31T05:36:31.313191+0000 mgr.a (mgr.14388) 8877 : cluster [DBG] pgmap v6153: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:34 smithi027 bash[22610]: cluster 2024-08-31T05:36:33.315423+0000 mgr.a (mgr.14388) 8878 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:34 smithi191 bash[24992]: cluster 2024-08-31T05:36:33.315423+0000 mgr.a (mgr.14388) 8878 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:34.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:34.863 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:34.864 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:34 smithi163 bash[24253]: cluster 2024-08-31T05:36:33.315423+0000 mgr.a (mgr.14388) 8878 : cluster [DBG] pgmap v6154: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:35.604 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:35.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:35.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:35.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:35.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:36 smithi027 bash[22610]: audit 2024-08-31T05:36:35.191347+0000 mgr.a (mgr.14388) 8879 : audit [DBG] from='client.198378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:36 smithi027 bash[22610]: cluster 2024-08-31T05:36:35.315930+0000 mgr.a (mgr.14388) 8880 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:36 smithi191 bash[24992]: audit 2024-08-31T05:36:35.191347+0000 mgr.a (mgr.14388) 8879 : audit [DBG] from='client.198378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:36 smithi191 bash[24992]: cluster 2024-08-31T05:36:35.315930+0000 mgr.a (mgr.14388) 8880 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:36 smithi163 bash[24253]: audit 2024-08-31T05:36:35.191347+0000 mgr.a (mgr.14388) 8879 : audit [DBG] from='client.198378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:36 smithi163 bash[24253]: cluster 2024-08-31T05:36:35.315930+0000 mgr.a (mgr.14388) 8880 : cluster [DBG] pgmap v6155: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:38 smithi027 bash[22610]: cluster 2024-08-31T05:36:37.316763+0000 mgr.a (mgr.14388) 8881 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:38 smithi191 bash[24992]: cluster 2024-08-31T05:36:37.316763+0000 mgr.a (mgr.14388) 8881 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:38 smithi163 bash[24253]: cluster 2024-08-31T05:36:37.316763+0000 mgr.a (mgr.14388) 8881 : cluster [DBG] pgmap v6156: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:40.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:40.607 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:40.607 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:40 smithi027 bash[22610]: cluster 2024-08-31T05:36:39.319052+0000 mgr.a (mgr.14388) 8882 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:40 smithi191 bash[24992]: cluster 2024-08-31T05:36:39.319052+0000 mgr.a (mgr.14388) 8882 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:40 smithi163 bash[24253]: cluster 2024-08-31T05:36:39.319052+0000 mgr.a (mgr.14388) 8882 : cluster [DBG] pgmap v6157: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:41.372 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:41.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:41.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:41.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:41.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:42 smithi027 bash[22610]: audit 2024-08-31T05:36:40.941011+0000 mgr.a (mgr.14388) 8883 : audit [DBG] from='client.198453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:42 smithi027 bash[22610]: cluster 2024-08-31T05:36:41.319558+0000 mgr.a (mgr.14388) 8884 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:42 smithi191 bash[24992]: audit 2024-08-31T05:36:40.941011+0000 mgr.a (mgr.14388) 8883 : audit [DBG] from='client.198453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:42.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:42 smithi191 bash[24992]: cluster 2024-08-31T05:36:41.319558+0000 mgr.a (mgr.14388) 8884 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:42 smithi163 bash[24253]: audit 2024-08-31T05:36:40.941011+0000 mgr.a (mgr.14388) 8883 : audit [DBG] from='client.198453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:42 smithi163 bash[24253]: cluster 2024-08-31T05:36:41.319558+0000 mgr.a (mgr.14388) 8884 : cluster [DBG] pgmap v6158: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:44 smithi027 bash[22610]: cluster 2024-08-31T05:36:43.321708+0000 mgr.a (mgr.14388) 8885 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:44 smithi191 bash[24992]: cluster 2024-08-31T05:36:43.321708+0000 mgr.a (mgr.14388) 8885 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:44 smithi163 bash[24253]: cluster 2024-08-31T05:36:43.321708+0000 mgr.a (mgr.14388) 8885 : cluster [DBG] pgmap v6159: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:46.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:46.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:46.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:46.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:46 smithi191 bash[24992]: cluster 2024-08-31T05:36:45.322506+0000 mgr.a (mgr.14388) 8886 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:46 smithi163 bash[24253]: cluster 2024-08-31T05:36:45.322506+0000 mgr.a (mgr.14388) 8886 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:46 smithi027 bash[22610]: cluster 2024-08-31T05:36:45.322506+0000 mgr.a (mgr.14388) 8886 : cluster [DBG] pgmap v6160: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:47.144 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:47.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:47.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:47.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:47.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:48 smithi191 bash[24992]: audit 2024-08-31T05:36:46.710550+0000 mgr.a (mgr.14388) 8887 : audit [DBG] from='client.198531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:48 smithi191 bash[24992]: cluster 2024-08-31T05:36:47.323546+0000 mgr.a (mgr.14388) 8888 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:48 smithi163 bash[24253]: audit 2024-08-31T05:36:46.710550+0000 mgr.a (mgr.14388) 8887 : audit [DBG] from='client.198531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:48 smithi163 bash[24253]: cluster 2024-08-31T05:36:47.323546+0000 mgr.a (mgr.14388) 8888 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:48 smithi027 bash[22610]: audit 2024-08-31T05:36:46.710550+0000 mgr.a (mgr.14388) 8887 : audit [DBG] from='client.198531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:48 smithi027 bash[22610]: cluster 2024-08-31T05:36:47.323546+0000 mgr.a (mgr.14388) 8888 : cluster [DBG] pgmap v6161: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:49 smithi191 bash[24992]: audit 2024-08-31T05:36:49.127282+0000 mon.a (mon.0) 1907 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:36:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:49 smithi163 bash[24253]: audit 2024-08-31T05:36:49.127282+0000 mon.a (mon.0) 1907 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:36:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:49 smithi027 bash[22610]: audit 2024-08-31T05:36:49.127282+0000 mon.a (mon.0) 1907 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:36:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:50 smithi191 bash[24992]: cluster 2024-08-31T05:36:49.325804+0000 mgr.a (mgr.14388) 8889 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:50 smithi191 bash[24992]: audit 2024-08-31T05:36:49.737199+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:50 smithi191 bash[24992]: audit 2024-08-31T05:36:49.742844+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:50 smithi191 bash[24992]: audit 2024-08-31T05:36:49.746533+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:50 smithi191 bash[24992]: audit 2024-08-31T05:36:49.752507+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:50 smithi163 bash[24253]: cluster 2024-08-31T05:36:49.325804+0000 mgr.a (mgr.14388) 8889 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:50 smithi163 bash[24253]: audit 2024-08-31T05:36:49.737199+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:50 smithi163 bash[24253]: audit 2024-08-31T05:36:49.742844+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:50 smithi163 bash[24253]: audit 2024-08-31T05:36:49.746533+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:50 smithi163 bash[24253]: audit 2024-08-31T05:36:49.752507+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:50 smithi027 bash[22610]: cluster 2024-08-31T05:36:49.325804+0000 mgr.a (mgr.14388) 8889 : cluster [DBG] pgmap v6162: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:36:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:50 smithi027 bash[22610]: audit 2024-08-31T05:36:49.737199+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:50 smithi027 bash[22610]: audit 2024-08-31T05:36:49.742844+0000 mon.a (mon.0) 1909 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:50 smithi027 bash[22610]: audit 2024-08-31T05:36:49.746533+0000 mon.a (mon.0) 1910 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:50 smithi027 bash[22610]: audit 2024-08-31T05:36:49.752507+0000 mon.a (mon.0) 1911 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:51.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:36:51 smithi027 bash[22863]: debug 2024-08-31T05:36:51.285+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:36:51.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:36:51 smithi027 bash[22863]: debug 2024-08-31T05:36:51.289+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:36:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:51 smithi027 bash[22610]: audit 2024-08-31T05:36:50.546219+0000 mon.a (mon.0) 1912 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:36:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:51 smithi027 bash[22610]: audit 2024-08-31T05:36:50.548041+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:36:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:51 smithi027 bash[22610]: audit 2024-08-31T05:36:50.558095+0000 mon.a (mon.0) 1914 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:51 smithi027 bash[22610]: audit 2024-08-31T05:36:50.561373+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:36:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:51 smithi191 bash[24992]: audit 2024-08-31T05:36:50.546219+0000 mon.a (mon.0) 1912 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:36:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:51 smithi191 bash[24992]: audit 2024-08-31T05:36:50.548041+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:36:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:51 smithi191 bash[24992]: audit 2024-08-31T05:36:50.558095+0000 mon.a (mon.0) 1914 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:51.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:51 smithi191 bash[24992]: audit 2024-08-31T05:36:50.561373+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:36:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:51 smithi163 bash[24253]: audit 2024-08-31T05:36:50.546219+0000 mon.a (mon.0) 1912 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:36:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:51 smithi163 bash[24253]: audit 2024-08-31T05:36:50.548041+0000 mon.a (mon.0) 1913 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:36:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:51 smithi163 bash[24253]: audit 2024-08-31T05:36:50.558095+0000 mon.a (mon.0) 1914 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:36:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:51 smithi163 bash[24253]: audit 2024-08-31T05:36:50.561373+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:36:52.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:52.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:52.147 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:52 smithi191 bash[24992]: audit 2024-08-31T05:36:50.563741+0000 mgr.a (mgr.14388) 8890 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:36:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:52 smithi191 bash[24992]: audit 2024-08-31T05:36:51.289575+0000 mgr.a (mgr.14388) 8891 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:36:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:52 smithi191 bash[24992]: cephadm 2024-08-31T05:36:51.290748+0000 mgr.a (mgr.14388) 8892 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:36:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:52 smithi191 bash[24992]: cluster 2024-08-31T05:36:51.326562+0000 mgr.a (mgr.14388) 8893 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:52.905 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:52.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:52.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:52.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:52.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:52 smithi163 bash[24253]: audit 2024-08-31T05:36:50.563741+0000 mgr.a (mgr.14388) 8890 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:36:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:52 smithi163 bash[24253]: audit 2024-08-31T05:36:51.289575+0000 mgr.a (mgr.14388) 8891 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:36:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:52 smithi163 bash[24253]: cephadm 2024-08-31T05:36:51.290748+0000 mgr.a (mgr.14388) 8892 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:36:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:52 smithi163 bash[24253]: cluster 2024-08-31T05:36:51.326562+0000 mgr.a (mgr.14388) 8893 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:52 smithi027 bash[22610]: audit 2024-08-31T05:36:50.563741+0000 mgr.a (mgr.14388) 8890 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:36:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:52 smithi027 bash[22610]: audit 2024-08-31T05:36:51.289575+0000 mgr.a (mgr.14388) 8891 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:36:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:52 smithi027 bash[22610]: cephadm 2024-08-31T05:36:51.290748+0000 mgr.a (mgr.14388) 8892 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:36:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:52 smithi027 bash[22610]: cluster 2024-08-31T05:36:51.326562+0000 mgr.a (mgr.14388) 8893 : cluster [DBG] pgmap v6163: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:36:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:53 smithi191 bash[24992]: audit 2024-08-31T05:36:52.479370+0000 mgr.a (mgr.14388) 8894 : audit [DBG] from='client.198714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:53 smithi163 bash[24253]: audit 2024-08-31T05:36:52.479370+0000 mgr.a (mgr.14388) 8894 : audit [DBG] from='client.198714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:53 smithi027 bash[22610]: audit 2024-08-31T05:36:52.479370+0000 mgr.a (mgr.14388) 8894 : audit [DBG] from='client.198714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:54 smithi191 bash[24992]: cluster 2024-08-31T05:36:53.328864+0000 mgr.a (mgr.14388) 8895 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:54 smithi163 bash[24253]: cluster 2024-08-31T05:36:53.328864+0000 mgr.a (mgr.14388) 8895 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:54 smithi027 bash[22610]: cluster 2024-08-31T05:36:53.328864+0000 mgr.a (mgr.14388) 8895 : cluster [DBG] pgmap v6164: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:56 smithi191 bash[24992]: cluster 2024-08-31T05:36:55.329650+0000 mgr.a (mgr.14388) 8896 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:56.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:56 smithi163 bash[24253]: cluster 2024-08-31T05:36:55.329650+0000 mgr.a (mgr.14388) 8896 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:56 smithi027 bash[22610]: cluster 2024-08-31T05:36:55.329650+0000 mgr.a (mgr.14388) 8896 : cluster [DBG] pgmap v6165: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:57.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:36:57.907 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:36:57.907 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:36:58.656 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:36:58.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:36:58.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:36:58.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:36:58.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:36:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:58 smithi191 bash[24992]: cluster 2024-08-31T05:36:57.330442+0000 mgr.a (mgr.14388) 8897 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:58 smithi163 bash[24253]: cluster 2024-08-31T05:36:57.330442+0000 mgr.a (mgr.14388) 8897 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:58 smithi027 bash[22610]: cluster 2024-08-31T05:36:57.330442+0000 mgr.a (mgr.14388) 8897 : cluster [DBG] pgmap v6166: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:36:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:36:59 smithi191 bash[24992]: audit 2024-08-31T05:36:58.242848+0000 mgr.a (mgr.14388) 8898 : audit [DBG] from='client.198792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:36:59 smithi163 bash[24253]: audit 2024-08-31T05:36:58.242848+0000 mgr.a (mgr.14388) 8898 : audit [DBG] from='client.198792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:36:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:36:59 smithi027 bash[22610]: audit 2024-08-31T05:36:58.242848+0000 mgr.a (mgr.14388) 8898 : audit [DBG] from='client.198792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:00 smithi191 bash[24992]: cluster 2024-08-31T05:36:59.333285+0000 mgr.a (mgr.14388) 8899 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:00 smithi163 bash[24253]: cluster 2024-08-31T05:36:59.333285+0000 mgr.a (mgr.14388) 8899 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:00 smithi027 bash[22610]: cluster 2024-08-31T05:36:59.333285+0000 mgr.a (mgr.14388) 8899 : cluster [DBG] pgmap v6167: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:01 smithi163 bash[24253]: cluster 2024-08-31T05:37:01.334111+0000 mgr.a (mgr.14388) 8900 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:37:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:01 smithi027 bash[22610]: cluster 2024-08-31T05:37:01.334111+0000 mgr.a (mgr.14388) 8900 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:37:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:01 smithi191 bash[24992]: cluster 2024-08-31T05:37:01.334111+0000 mgr.a (mgr.14388) 8900 : cluster [DBG] pgmap v6168: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:37:03.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:37:03.658 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:37:03.658 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:37:04.443 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:37:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:37:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:37:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:37:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:37:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:04 smithi163 bash[24253]: cluster 2024-08-31T05:37:03.336125+0000 mgr.a (mgr.14388) 8901 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:04 smithi027 bash[22610]: cluster 2024-08-31T05:37:03.336125+0000 mgr.a (mgr.14388) 8901 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:04 smithi191 bash[24992]: cluster 2024-08-31T05:37:03.336125+0000 mgr.a (mgr.14388) 8901 : cluster [DBG] pgmap v6169: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:05 smithi163 bash[24253]: audit 2024-08-31T05:37:03.992162+0000 mgr.a (mgr.14388) 8902 : audit [DBG] from='client.198870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:05 smithi027 bash[22610]: audit 2024-08-31T05:37:03.992162+0000 mgr.a (mgr.14388) 8902 : audit [DBG] from='client.198870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:05 smithi191 bash[24992]: audit 2024-08-31T05:37:03.992162+0000 mgr.a (mgr.14388) 8902 : audit [DBG] from='client.198870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:06.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:06 smithi163 bash[24253]: cluster 2024-08-31T05:37:05.337133+0000 mgr.a (mgr.14388) 8903 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:37:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:06 smithi027 bash[22610]: cluster 2024-08-31T05:37:05.337133+0000 mgr.a (mgr.14388) 8903 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:37:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:06 smithi191 bash[24992]: cluster 2024-08-31T05:37:05.337133+0000 mgr.a (mgr.14388) 8903 : cluster [DBG] pgmap v6170: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:37:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:08 smithi163 bash[24253]: cluster 2024-08-31T05:37:07.337909+0000 mgr.a (mgr.14388) 8904 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:37:08.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:08 smithi027 bash[22610]: cluster 2024-08-31T05:37:07.337909+0000 mgr.a (mgr.14388) 8904 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:37:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:08 smithi191 bash[24992]: cluster 2024-08-31T05:37:07.337909+0000 mgr.a (mgr.14388) 8904 : cluster [DBG] pgmap v6171: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:37:09.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:37:09.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:37:09.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:37:10.192 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:37:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:37:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:37:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:37:10.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:37:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:10 smithi163 bash[24253]: cluster 2024-08-31T05:37:09.340144+0000 mgr.a (mgr.14388) 8905 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:10.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:10 smithi027 bash[22610]: cluster 2024-08-31T05:37:09.340144+0000 mgr.a (mgr.14388) 8905 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:10 smithi191 bash[24992]: cluster 2024-08-31T05:37:09.340144+0000 mgr.a (mgr.14388) 8905 : cluster [DBG] pgmap v6172: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:11 smithi163 bash[24253]: audit 2024-08-31T05:37:09.775428+0000 mgr.a (mgr.14388) 8906 : audit [DBG] from='client.198948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:11.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:11 smithi027 bash[22610]: audit 2024-08-31T05:37:09.775428+0000 mgr.a (mgr.14388) 8906 : audit [DBG] from='client.198948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:11 smithi191 bash[24992]: audit 2024-08-31T05:37:09.775428+0000 mgr.a (mgr.14388) 8906 : audit [DBG] from='client.198948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:12 smithi163 bash[24253]: cluster 2024-08-31T05:37:11.341080+0000 mgr.a (mgr.14388) 8907 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:12 smithi027 bash[22610]: cluster 2024-08-31T05:37:11.341080+0000 mgr.a (mgr.14388) 8907 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:12 smithi191 bash[24992]: cluster 2024-08-31T05:37:11.341080+0000 mgr.a (mgr.14388) 8907 : cluster [DBG] pgmap v6173: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:14 smithi163 bash[24253]: cluster 2024-08-31T05:37:13.343326+0000 mgr.a (mgr.14388) 8908 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:14 smithi027 bash[22610]: cluster 2024-08-31T05:37:13.343326+0000 mgr.a (mgr.14388) 8908 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:14 smithi191 bash[24992]: cluster 2024-08-31T05:37:13.343326+0000 mgr.a (mgr.14388) 8908 : cluster [DBG] pgmap v6174: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:15.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:37:15.194 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:37:15.194 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:37:15.969 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:37:15.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:37:15.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:37:15.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:37:15.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:37:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:16 smithi163 bash[24253]: cluster 2024-08-31T05:37:15.343875+0000 mgr.a (mgr.14388) 8909 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:16.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:16 smithi163 bash[24253]: audit 2024-08-31T05:37:15.534079+0000 mgr.a (mgr.14388) 8910 : audit [DBG] from='client.199026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:16 smithi027 bash[22610]: cluster 2024-08-31T05:37:15.343875+0000 mgr.a (mgr.14388) 8909 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:16.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:16 smithi027 bash[22610]: audit 2024-08-31T05:37:15.534079+0000 mgr.a (mgr.14388) 8910 : audit [DBG] from='client.199026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:16 smithi191 bash[24992]: cluster 2024-08-31T05:37:15.343875+0000 mgr.a (mgr.14388) 8909 : cluster [DBG] pgmap v6175: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:16 smithi191 bash[24992]: audit 2024-08-31T05:37:15.534079+0000 mgr.a (mgr.14388) 8910 : audit [DBG] from='client.199026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:18 smithi163 bash[24253]: cluster 2024-08-31T05:37:17.344995+0000 mgr.a (mgr.14388) 8911 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:18.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:18 smithi027 bash[22610]: cluster 2024-08-31T05:37:17.344995+0000 mgr.a (mgr.14388) 8911 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:18 smithi191 bash[24992]: cluster 2024-08-31T05:37:17.344995+0000 mgr.a (mgr.14388) 8911 : cluster [DBG] pgmap v6176: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:20 smithi163 bash[24253]: cluster 2024-08-31T05:37:19.347423+0000 mgr.a (mgr.14388) 8912 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:20 smithi027 bash[22610]: cluster 2024-08-31T05:37:19.347423+0000 mgr.a (mgr.14388) 8912 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:20 smithi191 bash[24992]: cluster 2024-08-31T05:37:19.347423+0000 mgr.a (mgr.14388) 8912 : cluster [DBG] pgmap v6177: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:20.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:37:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:37:20.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:37:21.739 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:37:21.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:37:21.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:37:21.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:37:21.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:37:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:22 smithi163 bash[24253]: audit 2024-08-31T05:37:21.308821+0000 mgr.a (mgr.14388) 8913 : audit [DBG] from='client.199098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:22 smithi163 bash[24253]: cluster 2024-08-31T05:37:21.348622+0000 mgr.a (mgr.14388) 8914 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:22 smithi027 bash[22610]: audit 2024-08-31T05:37:21.308821+0000 mgr.a (mgr.14388) 8913 : audit [DBG] from='client.199098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:22 smithi027 bash[22610]: cluster 2024-08-31T05:37:21.348622+0000 mgr.a (mgr.14388) 8914 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:22 smithi191 bash[24992]: audit 2024-08-31T05:37:21.308821+0000 mgr.a (mgr.14388) 8913 : audit [DBG] from='client.199098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:22.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:22 smithi191 bash[24992]: cluster 2024-08-31T05:37:21.348622+0000 mgr.a (mgr.14388) 8914 : cluster [DBG] pgmap v6178: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:23 smithi163 bash[24253]: cluster 2024-08-31T05:37:23.351134+0000 mgr.a (mgr.14388) 8915 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:23 smithi027 bash[22610]: cluster 2024-08-31T05:37:23.351134+0000 mgr.a (mgr.14388) 8915 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:23 smithi191 bash[24992]: cluster 2024-08-31T05:37:23.351134+0000 mgr.a (mgr.14388) 8915 : cluster [DBG] pgmap v6179: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:26 smithi163 bash[24253]: cluster 2024-08-31T05:37:25.351941+0000 mgr.a (mgr.14388) 8916 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:26 smithi027 bash[22610]: cluster 2024-08-31T05:37:25.351941+0000 mgr.a (mgr.14388) 8916 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:26.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:37:26.741 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:37:26.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:37:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:26 smithi191 bash[24992]: cluster 2024-08-31T05:37:25.351941+0000 mgr.a (mgr.14388) 8916 : cluster [DBG] pgmap v6180: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:27.487 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:37:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:37:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:37:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:37:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:37:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:28 smithi163 bash[24253]: audit 2024-08-31T05:37:27.069958+0000 mgr.a (mgr.14388) 8917 : audit [DBG] from='client.199176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:28 smithi163 bash[24253]: cluster 2024-08-31T05:37:27.352459+0000 mgr.a (mgr.14388) 8918 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:28 smithi027 bash[22610]: audit 2024-08-31T05:37:27.069958+0000 mgr.a (mgr.14388) 8917 : audit [DBG] from='client.199176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:28 smithi027 bash[22610]: cluster 2024-08-31T05:37:27.352459+0000 mgr.a (mgr.14388) 8918 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:28 smithi191 bash[24992]: audit 2024-08-31T05:37:27.069958+0000 mgr.a (mgr.14388) 8917 : audit [DBG] from='client.199176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:28.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:28 smithi191 bash[24992]: cluster 2024-08-31T05:37:27.352459+0000 mgr.a (mgr.14388) 8918 : cluster [DBG] pgmap v6181: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:30 smithi163 bash[24253]: cluster 2024-08-31T05:37:29.354899+0000 mgr.a (mgr.14388) 8919 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:30 smithi027 bash[22610]: cluster 2024-08-31T05:37:29.354899+0000 mgr.a (mgr.14388) 8919 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:30 smithi191 bash[24992]: cluster 2024-08-31T05:37:29.354899+0000 mgr.a (mgr.14388) 8919 : cluster [DBG] pgmap v6182: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:32.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:37:32.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:37:32.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:37:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:32 smithi163 bash[24253]: cluster 2024-08-31T05:37:31.355647+0000 mgr.a (mgr.14388) 8920 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:32 smithi027 bash[22610]: cluster 2024-08-31T05:37:31.355647+0000 mgr.a (mgr.14388) 8920 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:32.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:32 smithi191 bash[24992]: cluster 2024-08-31T05:37:31.355647+0000 mgr.a (mgr.14388) 8920 : cluster [DBG] pgmap v6183: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:33.238 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:37:33.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:37:33.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:37:33.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:37:33.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:37:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:34 smithi163 bash[24253]: audit 2024-08-31T05:37:32.811486+0000 mgr.a (mgr.14388) 8921 : audit [DBG] from='client.199248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:34 smithi163 bash[24253]: cluster 2024-08-31T05:37:33.358383+0000 mgr.a (mgr.14388) 8922 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:34 smithi027 bash[22610]: audit 2024-08-31T05:37:32.811486+0000 mgr.a (mgr.14388) 8921 : audit [DBG] from='client.199248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:34.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:34 smithi027 bash[22610]: cluster 2024-08-31T05:37:33.358383+0000 mgr.a (mgr.14388) 8922 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:34 smithi191 bash[24992]: audit 2024-08-31T05:37:32.811486+0000 mgr.a (mgr.14388) 8921 : audit [DBG] from='client.199248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:34.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:34 smithi191 bash[24992]: cluster 2024-08-31T05:37:33.358383+0000 mgr.a (mgr.14388) 8922 : cluster [DBG] pgmap v6184: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:36 smithi163 bash[24253]: cluster 2024-08-31T05:37:35.359195+0000 mgr.a (mgr.14388) 8923 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:37:36.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:36 smithi027 bash[22610]: cluster 2024-08-31T05:37:35.359195+0000 mgr.a (mgr.14388) 8923 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:37:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:36 smithi191 bash[24992]: cluster 2024-08-31T05:37:35.359195+0000 mgr.a (mgr.14388) 8923 : cluster [DBG] pgmap v6185: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:37:38.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:37:38.240 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:37:38.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:37:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:38 smithi163 bash[24253]: cluster 2024-08-31T05:37:37.359986+0000 mgr.a (mgr.14388) 8924 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:37:38.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:38 smithi027 bash[22610]: cluster 2024-08-31T05:37:37.359986+0000 mgr.a (mgr.14388) 8924 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:37:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:38 smithi191 bash[24992]: cluster 2024-08-31T05:37:37.359986+0000 mgr.a (mgr.14388) 8924 : cluster [DBG] pgmap v6186: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:37:39.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:37:39.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:37:39.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:37:39.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:37:39.016 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:37:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:40 smithi163 bash[24253]: audit 2024-08-31T05:37:38.577714+0000 mgr.a (mgr.14388) 8925 : audit [DBG] from='client.199323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:40 smithi163 bash[24253]: cluster 2024-08-31T05:37:39.362781+0000 mgr.a (mgr.14388) 8926 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:40 smithi027 bash[22610]: audit 2024-08-31T05:37:38.577714+0000 mgr.a (mgr.14388) 8925 : audit [DBG] from='client.199323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:40 smithi027 bash[22610]: cluster 2024-08-31T05:37:39.362781+0000 mgr.a (mgr.14388) 8926 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:40 smithi191 bash[24992]: audit 2024-08-31T05:37:38.577714+0000 mgr.a (mgr.14388) 8925 : audit [DBG] from='client.199323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:40.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:40 smithi191 bash[24992]: cluster 2024-08-31T05:37:39.362781+0000 mgr.a (mgr.14388) 8926 : cluster [DBG] pgmap v6187: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:42 smithi163 bash[24253]: cluster 2024-08-31T05:37:41.363570+0000 mgr.a (mgr.14388) 8927 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:37:42.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:42 smithi027 bash[22610]: cluster 2024-08-31T05:37:41.363570+0000 mgr.a (mgr.14388) 8927 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:37:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:42 smithi191 bash[24992]: cluster 2024-08-31T05:37:41.363570+0000 mgr.a (mgr.14388) 8927 : cluster [DBG] pgmap v6188: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:37:44.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:37:44.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:37:44.018 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:37:44.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:44 smithi163 bash[24253]: cluster 2024-08-31T05:37:43.365542+0000 mgr.a (mgr.14388) 8928 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:44 smithi027 bash[22610]: cluster 2024-08-31T05:37:43.365542+0000 mgr.a (mgr.14388) 8928 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:44.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:37:44.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:37:44.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:37:44.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:37:44.788 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:37:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:44 smithi191 bash[24992]: cluster 2024-08-31T05:37:43.365542+0000 mgr.a (mgr.14388) 8928 : cluster [DBG] pgmap v6189: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:45 smithi027 bash[22610]: audit 2024-08-31T05:37:44.353745+0000 mgr.a (mgr.14388) 8929 : audit [DBG] from='client.199395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:45 smithi191 bash[24992]: audit 2024-08-31T05:37:44.353745+0000 mgr.a (mgr.14388) 8929 : audit [DBG] from='client.199395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:45 smithi163 bash[24253]: audit 2024-08-31T05:37:44.353745+0000 mgr.a (mgr.14388) 8929 : audit [DBG] from='client.199395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:46 smithi027 bash[22610]: cluster 2024-08-31T05:37:45.366518+0000 mgr.a (mgr.14388) 8930 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:46 smithi191 bash[24992]: cluster 2024-08-31T05:37:45.366518+0000 mgr.a (mgr.14388) 8930 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:46 smithi163 bash[24253]: cluster 2024-08-31T05:37:45.366518+0000 mgr.a (mgr.14388) 8930 : cluster [DBG] pgmap v6190: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:48 smithi027 bash[22610]: cluster 2024-08-31T05:37:47.367334+0000 mgr.a (mgr.14388) 8931 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:48 smithi191 bash[24992]: cluster 2024-08-31T05:37:47.367334+0000 mgr.a (mgr.14388) 8931 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:48 smithi163 bash[24253]: cluster 2024-08-31T05:37:47.367334+0000 mgr.a (mgr.14388) 8931 : cluster [DBG] pgmap v6191: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:49.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:37:49.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:37:49.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:37:50.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:37:50.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:37:50.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:37:50.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:37:50.533 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:37:50.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:50 smithi027 bash[22610]: cluster 2024-08-31T05:37:49.369493+0000 mgr.a (mgr.14388) 8932 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:50 smithi191 bash[24992]: cluster 2024-08-31T05:37:49.369493+0000 mgr.a (mgr.14388) 8932 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:50 smithi163 bash[24253]: cluster 2024-08-31T05:37:49.369493+0000 mgr.a (mgr.14388) 8932 : cluster [DBG] pgmap v6192: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:37:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:51 smithi027 bash[22610]: audit 2024-08-31T05:37:50.120989+0000 mgr.a (mgr.14388) 8933 : audit [DBG] from='client.199470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:51 smithi027 bash[22610]: audit 2024-08-31T05:37:51.341337+0000 mon.a (mon.0) 1916 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:37:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:51 smithi191 bash[24992]: audit 2024-08-31T05:37:50.120989+0000 mgr.a (mgr.14388) 8933 : audit [DBG] from='client.199470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:51.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:51 smithi191 bash[24992]: audit 2024-08-31T05:37:51.341337+0000 mon.a (mon.0) 1916 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:37:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:51 smithi163 bash[24253]: audit 2024-08-31T05:37:50.120989+0000 mgr.a (mgr.14388) 8933 : audit [DBG] from='client.199470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:51 smithi163 bash[24253]: audit 2024-08-31T05:37:51.341337+0000 mon.a (mon.0) 1916 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:37:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:52 smithi027 bash[22610]: cluster 2024-08-31T05:37:51.370131+0000 mgr.a (mgr.14388) 8934 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:52 smithi027 bash[22610]: audit 2024-08-31T05:37:52.189866+0000 mon.a (mon.0) 1917 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:37:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:52 smithi027 bash[22610]: audit 2024-08-31T05:37:52.191219+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:37:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:52 smithi027 bash[22610]: audit 2024-08-31T05:37:52.198926+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:37:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:52 smithi027 bash[22610]: audit 2024-08-31T05:37:52.201548+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:37:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:52 smithi191 bash[24992]: cluster 2024-08-31T05:37:51.370131+0000 mgr.a (mgr.14388) 8934 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:52 smithi191 bash[24992]: audit 2024-08-31T05:37:52.189866+0000 mon.a (mon.0) 1917 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:37:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:52 smithi191 bash[24992]: audit 2024-08-31T05:37:52.191219+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:37:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:52 smithi191 bash[24992]: audit 2024-08-31T05:37:52.198926+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:37:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:52 smithi191 bash[24992]: audit 2024-08-31T05:37:52.201548+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:37:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:52 smithi163 bash[24253]: cluster 2024-08-31T05:37:51.370131+0000 mgr.a (mgr.14388) 8934 : cluster [DBG] pgmap v6193: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:37:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:52 smithi163 bash[24253]: audit 2024-08-31T05:37:52.189866+0000 mon.a (mon.0) 1917 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:37:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:52 smithi163 bash[24253]: audit 2024-08-31T05:37:52.191219+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:37:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:52 smithi163 bash[24253]: audit 2024-08-31T05:37:52.198926+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:37:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:52 smithi163 bash[24253]: audit 2024-08-31T05:37:52.201548+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:37:53.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:37:52 smithi027 bash[22863]: debug 2024-08-31T05:37:52.911+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:37:53.232 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:37:52 smithi027 bash[22863]: debug 2024-08-31T05:37:52.915+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:37:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:53 smithi027 bash[22610]: audit 2024-08-31T05:37:52.202616+0000 mgr.a (mgr.14388) 8935 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:37:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:53 smithi191 bash[24992]: audit 2024-08-31T05:37:52.202616+0000 mgr.a (mgr.14388) 8935 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:37:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:53 smithi163 bash[24253]: audit 2024-08-31T05:37:52.202616+0000 mgr.a (mgr.14388) 8935 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:37:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:54 smithi191 bash[24992]: audit 2024-08-31T05:37:52.917665+0000 mgr.a (mgr.14388) 8936 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:37:54.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:54 smithi191 bash[24992]: cephadm 2024-08-31T05:37:52.918766+0000 mgr.a (mgr.14388) 8937 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:37:54.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:54 smithi191 bash[24992]: cluster 2024-08-31T05:37:53.372420+0000 mgr.a (mgr.14388) 8938 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:54 smithi163 bash[24253]: audit 2024-08-31T05:37:52.917665+0000 mgr.a (mgr.14388) 8936 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:37:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:54 smithi163 bash[24253]: cephadm 2024-08-31T05:37:52.918766+0000 mgr.a (mgr.14388) 8937 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:37:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:54 smithi163 bash[24253]: cluster 2024-08-31T05:37:53.372420+0000 mgr.a (mgr.14388) 8938 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:54 smithi027 bash[22610]: audit 2024-08-31T05:37:52.917665+0000 mgr.a (mgr.14388) 8936 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:37:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:54 smithi027 bash[22610]: cephadm 2024-08-31T05:37:52.918766+0000 mgr.a (mgr.14388) 8937 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:37:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:54 smithi027 bash[22610]: cluster 2024-08-31T05:37:53.372420+0000 mgr.a (mgr.14388) 8938 : cluster [DBG] pgmap v6194: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:55.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:37:55.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:37:55.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:37:56.308 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:37:56.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:37:56.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:37:56.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:37:56.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:37:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:56 smithi191 bash[24992]: cluster 2024-08-31T05:37:55.373337+0000 mgr.a (mgr.14388) 8939 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:56 smithi163 bash[24253]: cluster 2024-08-31T05:37:55.373337+0000 mgr.a (mgr.14388) 8939 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:56 smithi027 bash[22610]: cluster 2024-08-31T05:37:55.373337+0000 mgr.a (mgr.14388) 8939 : cluster [DBG] pgmap v6195: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:57 smithi191 bash[24992]: audit 2024-08-31T05:37:55.870163+0000 mgr.a (mgr.14388) 8940 : audit [DBG] from='client.199656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:57 smithi163 bash[24253]: audit 2024-08-31T05:37:55.870163+0000 mgr.a (mgr.14388) 8940 : audit [DBG] from='client.199656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:57 smithi027 bash[22610]: audit 2024-08-31T05:37:55.870163+0000 mgr.a (mgr.14388) 8940 : audit [DBG] from='client.199656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:37:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:37:58 smithi191 bash[24992]: cluster 2024-08-31T05:37:57.374324+0000 mgr.a (mgr.14388) 8941 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:37:58 smithi163 bash[24253]: cluster 2024-08-31T05:37:57.374324+0000 mgr.a (mgr.14388) 8941 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:37:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:37:58 smithi027 bash[22610]: cluster 2024-08-31T05:37:57.374324+0000 mgr.a (mgr.14388) 8941 : cluster [DBG] pgmap v6196: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:38:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:00 smithi191 bash[24992]: cluster 2024-08-31T05:37:59.376590+0000 mgr.a (mgr.14388) 8942 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:38:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:00 smithi163 bash[24253]: cluster 2024-08-31T05:37:59.376590+0000 mgr.a (mgr.14388) 8942 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:38:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:00 smithi027 bash[22610]: cluster 2024-08-31T05:37:59.376590+0000 mgr.a (mgr.14388) 8942 : cluster [DBG] pgmap v6197: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:38:01.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:01.310 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:01.310 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:02.087 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:02.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:02.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:02.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:02.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:38:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:02 smithi191 bash[24992]: cluster 2024-08-31T05:38:01.377308+0000 mgr.a (mgr.14388) 8943 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:38:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:02 smithi163 bash[24253]: cluster 2024-08-31T05:38:01.377308+0000 mgr.a (mgr.14388) 8943 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:38:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:02 smithi027 bash[22610]: cluster 2024-08-31T05:38:01.377308+0000 mgr.a (mgr.14388) 8943 : cluster [DBG] pgmap v6198: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:38:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:03 smithi191 bash[24992]: audit 2024-08-31T05:38:01.648676+0000 mgr.a (mgr.14388) 8944 : audit [DBG] from='client.199734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:03 smithi163 bash[24253]: audit 2024-08-31T05:38:01.648676+0000 mgr.a (mgr.14388) 8944 : audit [DBG] from='client.199734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:03 smithi027 bash[22610]: audit 2024-08-31T05:38:01.648676+0000 mgr.a (mgr.14388) 8944 : audit [DBG] from='client.199734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:04 smithi191 bash[24992]: cluster 2024-08-31T05:38:03.379774+0000 mgr.a (mgr.14388) 8945 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:38:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:04 smithi163 bash[24253]: cluster 2024-08-31T05:38:03.379774+0000 mgr.a (mgr.14388) 8945 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:38:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:04 smithi027 bash[22610]: cluster 2024-08-31T05:38:03.379774+0000 mgr.a (mgr.14388) 8945 : cluster [DBG] pgmap v6199: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:38:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:06 smithi191 bash[24992]: cluster 2024-08-31T05:38:05.380576+0000 mgr.a (mgr.14388) 8946 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:06 smithi163 bash[24253]: cluster 2024-08-31T05:38:05.380576+0000 mgr.a (mgr.14388) 8946 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:06 smithi027 bash[22610]: cluster 2024-08-31T05:38:05.380576+0000 mgr.a (mgr.14388) 8946 : cluster [DBG] pgmap v6200: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:07.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:07.089 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:07.090 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:07.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:07.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:07.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:07.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:38:07.843 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:08 smithi191 bash[24992]: cluster 2024-08-31T05:38:07.381318+0000 mgr.a (mgr.14388) 8947 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:08.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:08 smithi191 bash[24992]: audit 2024-08-31T05:38:07.422208+0000 mgr.a (mgr.14388) 8948 : audit [DBG] from='client.199809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:08 smithi163 bash[24253]: cluster 2024-08-31T05:38:07.381318+0000 mgr.a (mgr.14388) 8947 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:08 smithi163 bash[24253]: audit 2024-08-31T05:38:07.422208+0000 mgr.a (mgr.14388) 8948 : audit [DBG] from='client.199809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:08 smithi027 bash[22610]: cluster 2024-08-31T05:38:07.381318+0000 mgr.a (mgr.14388) 8947 : cluster [DBG] pgmap v6201: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:08 smithi027 bash[22610]: audit 2024-08-31T05:38:07.422208+0000 mgr.a (mgr.14388) 8948 : audit [DBG] from='client.199809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:10 smithi163 bash[24253]: cluster 2024-08-31T05:38:09.383677+0000 mgr.a (mgr.14388) 8949 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:10 smithi027 bash[22610]: cluster 2024-08-31T05:38:09.383677+0000 mgr.a (mgr.14388) 8949 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:10 smithi191 bash[24992]: cluster 2024-08-31T05:38:09.383677+0000 mgr.a (mgr.14388) 8949 : cluster [DBG] pgmap v6202: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:12.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:12.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:12.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:12 smithi163 bash[24253]: cluster 2024-08-31T05:38:11.384448+0000 mgr.a (mgr.14388) 8950 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:12 smithi027 bash[22610]: cluster 2024-08-31T05:38:11.384448+0000 mgr.a (mgr.14388) 8950 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:12 smithi191 bash[24992]: cluster 2024-08-31T05:38:11.384448+0000 mgr.a (mgr.14388) 8950 : cluster [DBG] pgmap v6203: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:13.597 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:13.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:13.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:13.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:13.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:38:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:14 smithi163 bash[24253]: audit 2024-08-31T05:38:13.179742+0000 mgr.a (mgr.14388) 8951 : audit [DBG] from='client.199887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:14 smithi163 bash[24253]: cluster 2024-08-31T05:38:13.385656+0000 mgr.a (mgr.14388) 8952 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:14 smithi027 bash[22610]: audit 2024-08-31T05:38:13.179742+0000 mgr.a (mgr.14388) 8951 : audit [DBG] from='client.199887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:14 smithi027 bash[22610]: cluster 2024-08-31T05:38:13.385656+0000 mgr.a (mgr.14388) 8952 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:14 smithi191 bash[24992]: audit 2024-08-31T05:38:13.179742+0000 mgr.a (mgr.14388) 8951 : audit [DBG] from='client.199887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:14 smithi191 bash[24992]: cluster 2024-08-31T05:38:13.385656+0000 mgr.a (mgr.14388) 8952 : cluster [DBG] pgmap v6204: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:16 smithi163 bash[24253]: cluster 2024-08-31T05:38:15.386508+0000 mgr.a (mgr.14388) 8953 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:16 smithi027 bash[22610]: cluster 2024-08-31T05:38:15.386508+0000 mgr.a (mgr.14388) 8953 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:16 smithi191 bash[24992]: cluster 2024-08-31T05:38:15.386508+0000 mgr.a (mgr.14388) 8953 : cluster [DBG] pgmap v6205: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:17 smithi163 bash[24253]: cluster 2024-08-31T05:38:17.387314+0000 mgr.a (mgr.14388) 8954 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:17 smithi027 bash[22610]: cluster 2024-08-31T05:38:17.387314+0000 mgr.a (mgr.14388) 8954 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:17 smithi191 bash[24992]: cluster 2024-08-31T05:38:17.387314+0000 mgr.a (mgr.14388) 8954 : cluster [DBG] pgmap v6206: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:18.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:18.599 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:18.599 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:19.378 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:19.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:19.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:19.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:19.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:38:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:20 smithi163 bash[24253]: audit 2024-08-31T05:38:18.936855+0000 mgr.a (mgr.14388) 8955 : audit [DBG] from='client.199965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:20 smithi163 bash[24253]: cluster 2024-08-31T05:38:19.388791+0000 mgr.a (mgr.14388) 8956 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:20 smithi027 bash[22610]: audit 2024-08-31T05:38:18.936855+0000 mgr.a (mgr.14388) 8955 : audit [DBG] from='client.199965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:20 smithi027 bash[22610]: cluster 2024-08-31T05:38:19.388791+0000 mgr.a (mgr.14388) 8956 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:20 smithi191 bash[24992]: audit 2024-08-31T05:38:18.936855+0000 mgr.a (mgr.14388) 8955 : audit [DBG] from='client.199965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:20 smithi191 bash[24992]: cluster 2024-08-31T05:38:19.388791+0000 mgr.a (mgr.14388) 8956 : cluster [DBG] pgmap v6207: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:22 smithi163 bash[24253]: cluster 2024-08-31T05:38:21.389665+0000 mgr.a (mgr.14388) 8957 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:22 smithi027 bash[22610]: cluster 2024-08-31T05:38:21.389665+0000 mgr.a (mgr.14388) 8957 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:22.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:22 smithi191 bash[24992]: cluster 2024-08-31T05:38:21.389665+0000 mgr.a (mgr.14388) 8957 : cluster [DBG] pgmap v6208: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:24.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:24.380 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:24.381 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:24.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:24 smithi027 bash[22610]: cluster 2024-08-31T05:38:23.391839+0000 mgr.a (mgr.14388) 8958 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:24 smithi191 bash[24992]: cluster 2024-08-31T05:38:23.391839+0000 mgr.a (mgr.14388) 8958 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:24 smithi163 bash[24253]: cluster 2024-08-31T05:38:23.391839+0000 mgr.a (mgr.14388) 8958 : cluster [DBG] pgmap v6209: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:25.134 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:25.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:25.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:25.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:25.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:38:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:26 smithi027 bash[22610]: audit 2024-08-31T05:38:24.711988+0000 mgr.a (mgr.14388) 8959 : audit [DBG] from='client.200043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:26 smithi027 bash[22610]: cluster 2024-08-31T05:38:25.392832+0000 mgr.a (mgr.14388) 8960 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:26 smithi191 bash[24992]: audit 2024-08-31T05:38:24.711988+0000 mgr.a (mgr.14388) 8959 : audit [DBG] from='client.200043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:26 smithi191 bash[24992]: cluster 2024-08-31T05:38:25.392832+0000 mgr.a (mgr.14388) 8960 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:26 smithi163 bash[24253]: audit 2024-08-31T05:38:24.711988+0000 mgr.a (mgr.14388) 8959 : audit [DBG] from='client.200043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:26 smithi163 bash[24253]: cluster 2024-08-31T05:38:25.392832+0000 mgr.a (mgr.14388) 8960 : cluster [DBG] pgmap v6210: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:28 smithi027 bash[22610]: cluster 2024-08-31T05:38:27.393641+0000 mgr.a (mgr.14388) 8961 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:28 smithi191 bash[24992]: cluster 2024-08-31T05:38:27.393641+0000 mgr.a (mgr.14388) 8961 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:28 smithi163 bash[24253]: cluster 2024-08-31T05:38:27.393641+0000 mgr.a (mgr.14388) 8961 : cluster [DBG] pgmap v6211: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:30.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:30.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:30.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:30 smithi027 bash[22610]: cluster 2024-08-31T05:38:29.395892+0000 mgr.a (mgr.14388) 8962 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:30 smithi191 bash[24992]: cluster 2024-08-31T05:38:29.395892+0000 mgr.a (mgr.14388) 8962 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:30.918 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:30.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:30.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:30.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:30.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:38:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:30 smithi163 bash[24253]: cluster 2024-08-31T05:38:29.395892+0000 mgr.a (mgr.14388) 8962 : cluster [DBG] pgmap v6212: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:31 smithi027 bash[22610]: audit 2024-08-31T05:38:30.475370+0000 mgr.a (mgr.14388) 8963 : audit [DBG] from='client.200118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:31 smithi191 bash[24992]: audit 2024-08-31T05:38:30.475370+0000 mgr.a (mgr.14388) 8963 : audit [DBG] from='client.200118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:31 smithi163 bash[24253]: audit 2024-08-31T05:38:30.475370+0000 mgr.a (mgr.14388) 8963 : audit [DBG] from='client.200118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:32.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:32 smithi027 bash[22610]: cluster 2024-08-31T05:38:31.396846+0000 mgr.a (mgr.14388) 8964 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:32 smithi191 bash[24992]: cluster 2024-08-31T05:38:31.396846+0000 mgr.a (mgr.14388) 8964 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:32 smithi163 bash[24253]: cluster 2024-08-31T05:38:31.396846+0000 mgr.a (mgr.14388) 8964 : cluster [DBG] pgmap v6213: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:34 smithi027 bash[22610]: cluster 2024-08-31T05:38:33.399145+0000 mgr.a (mgr.14388) 8965 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:34 smithi191 bash[24992]: cluster 2024-08-31T05:38:33.399145+0000 mgr.a (mgr.14388) 8965 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:34 smithi163 bash[24253]: cluster 2024-08-31T05:38:33.399145+0000 mgr.a (mgr.14388) 8965 : cluster [DBG] pgmap v6214: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:35.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:35.920 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:35.921 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:36.668 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:36.668 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:36.668 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:36.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:36.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:38:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:36 smithi191 bash[24992]: cluster 2024-08-31T05:38:35.399895+0000 mgr.a (mgr.14388) 8966 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:36 smithi163 bash[24253]: cluster 2024-08-31T05:38:35.399895+0000 mgr.a (mgr.14388) 8966 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:36 smithi027 bash[22610]: cluster 2024-08-31T05:38:35.399895+0000 mgr.a (mgr.14388) 8966 : cluster [DBG] pgmap v6215: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:37 smithi191 bash[24992]: audit 2024-08-31T05:38:36.252453+0000 mgr.a (mgr.14388) 8967 : audit [DBG] from='client.200196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:37 smithi163 bash[24253]: audit 2024-08-31T05:38:36.252453+0000 mgr.a (mgr.14388) 8967 : audit [DBG] from='client.200196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:37 smithi027 bash[22610]: audit 2024-08-31T05:38:36.252453+0000 mgr.a (mgr.14388) 8967 : audit [DBG] from='client.200196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:38 smithi191 bash[24992]: cluster 2024-08-31T05:38:37.400863+0000 mgr.a (mgr.14388) 8968 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:38 smithi163 bash[24253]: cluster 2024-08-31T05:38:37.400863+0000 mgr.a (mgr.14388) 8968 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:38 smithi027 bash[22610]: cluster 2024-08-31T05:38:37.400863+0000 mgr.a (mgr.14388) 8968 : cluster [DBG] pgmap v6216: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:40 smithi191 bash[24992]: cluster 2024-08-31T05:38:39.403152+0000 mgr.a (mgr.14388) 8969 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:40 smithi163 bash[24253]: cluster 2024-08-31T05:38:39.403152+0000 mgr.a (mgr.14388) 8969 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:40 smithi027 bash[22610]: cluster 2024-08-31T05:38:39.403152+0000 mgr.a (mgr.14388) 8969 : cluster [DBG] pgmap v6217: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:41.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:41.670 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:41.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:42.451 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:42.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:42.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:42.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:42.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:38:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:42 smithi191 bash[24992]: cluster 2024-08-31T05:38:41.403908+0000 mgr.a (mgr.14388) 8970 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:42 smithi163 bash[24253]: cluster 2024-08-31T05:38:41.403908+0000 mgr.a (mgr.14388) 8970 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:42 smithi027 bash[22610]: cluster 2024-08-31T05:38:41.403908+0000 mgr.a (mgr.14388) 8970 : cluster [DBG] pgmap v6218: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:43 smithi191 bash[24992]: audit 2024-08-31T05:38:42.007151+0000 mgr.a (mgr.14388) 8971 : audit [DBG] from='client.200274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:43 smithi163 bash[24253]: audit 2024-08-31T05:38:42.007151+0000 mgr.a (mgr.14388) 8971 : audit [DBG] from='client.200274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:43 smithi027 bash[22610]: audit 2024-08-31T05:38:42.007151+0000 mgr.a (mgr.14388) 8971 : audit [DBG] from='client.200274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:44 smithi191 bash[24992]: cluster 2024-08-31T05:38:43.406216+0000 mgr.a (mgr.14388) 8972 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:44 smithi163 bash[24253]: cluster 2024-08-31T05:38:43.406216+0000 mgr.a (mgr.14388) 8972 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:44 smithi027 bash[22610]: cluster 2024-08-31T05:38:43.406216+0000 mgr.a (mgr.14388) 8972 : cluster [DBG] pgmap v6219: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:38:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:46 smithi191 bash[24992]: cluster 2024-08-31T05:38:45.406995+0000 mgr.a (mgr.14388) 8973 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:46 smithi163 bash[24253]: cluster 2024-08-31T05:38:45.406995+0000 mgr.a (mgr.14388) 8973 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:46 smithi027 bash[22610]: cluster 2024-08-31T05:38:45.406995+0000 mgr.a (mgr.14388) 8973 : cluster [DBG] pgmap v6220: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:47.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:47.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:48.216 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:48.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:48.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:48.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:48.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:38:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:48 smithi191 bash[24992]: cluster 2024-08-31T05:38:47.407699+0000 mgr.a (mgr.14388) 8974 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:48 smithi163 bash[24253]: cluster 2024-08-31T05:38:47.407699+0000 mgr.a (mgr.14388) 8974 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:48 smithi027 bash[22610]: cluster 2024-08-31T05:38:47.407699+0000 mgr.a (mgr.14388) 8974 : cluster [DBG] pgmap v6221: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:49 smithi191 bash[24992]: audit 2024-08-31T05:38:47.789305+0000 mgr.a (mgr.14388) 8975 : audit [DBG] from='client.200352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:49.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:49 smithi163 bash[24253]: audit 2024-08-31T05:38:47.789305+0000 mgr.a (mgr.14388) 8975 : audit [DBG] from='client.200352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:49 smithi027 bash[22610]: audit 2024-08-31T05:38:47.789305+0000 mgr.a (mgr.14388) 8975 : audit [DBG] from='client.200352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:50 smithi191 bash[24992]: cluster 2024-08-31T05:38:49.410416+0000 mgr.a (mgr.14388) 8976 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:50 smithi163 bash[24253]: cluster 2024-08-31T05:38:49.410416+0000 mgr.a (mgr.14388) 8976 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:50 smithi027 bash[22610]: cluster 2024-08-31T05:38:49.410416+0000 mgr.a (mgr.14388) 8976 : cluster [DBG] pgmap v6222: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:52 smithi191 bash[24992]: cluster 2024-08-31T05:38:51.411242+0000 mgr.a (mgr.14388) 8977 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:38:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:52 smithi163 bash[24253]: cluster 2024-08-31T05:38:51.411242+0000 mgr.a (mgr.14388) 8977 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:38:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:52 smithi027 bash[22610]: cluster 2024-08-31T05:38:51.411242+0000 mgr.a (mgr.14388) 8977 : cluster [DBG] pgmap v6223: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:38:53.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:53.218 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:53.219 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:53 smithi163 bash[24253]: audit 2024-08-31T05:38:52.971048+0000 mon.a (mon.0) 1921 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:38:53.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:53 smithi027 bash[22610]: audit 2024-08-31T05:38:52.971048+0000 mon.a (mon.0) 1921 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:38:54.028 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:54.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:54.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:54.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:54.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:38:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:53 smithi191 bash[24992]: audit 2024-08-31T05:38:52.971048+0000 mon.a (mon.0) 1921 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:38:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:54 smithi163 bash[24253]: cluster 2024-08-31T05:38:53.412518+0000 mgr.a (mgr.14388) 8978 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:54 smithi163 bash[24253]: audit 2024-08-31T05:38:53.826975+0000 mon.a (mon.0) 1922 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:38:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:54 smithi163 bash[24253]: audit 2024-08-31T05:38:53.827804+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:38:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:54 smithi163 bash[24253]: audit 2024-08-31T05:38:53.833043+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:38:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:54 smithi163 bash[24253]: audit 2024-08-31T05:38:53.845079+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:38:54.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:38:54 smithi027 bash[22863]: debug 2024-08-31T05:38:54.713+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:38:54.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:38:54 smithi027 bash[22863]: debug 2024-08-31T05:38:54.713+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:38:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:54 smithi027 bash[22610]: cluster 2024-08-31T05:38:53.412518+0000 mgr.a (mgr.14388) 8978 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:54 smithi027 bash[22610]: audit 2024-08-31T05:38:53.826975+0000 mon.a (mon.0) 1922 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:38:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:54 smithi027 bash[22610]: audit 2024-08-31T05:38:53.827804+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:38:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:54 smithi027 bash[22610]: audit 2024-08-31T05:38:53.833043+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:38:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:54 smithi027 bash[22610]: audit 2024-08-31T05:38:53.845079+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:38:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:54 smithi191 bash[24992]: cluster 2024-08-31T05:38:53.412518+0000 mgr.a (mgr.14388) 8978 : cluster [DBG] pgmap v6224: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:38:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:54 smithi191 bash[24992]: audit 2024-08-31T05:38:53.826975+0000 mon.a (mon.0) 1922 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:38:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:54 smithi191 bash[24992]: audit 2024-08-31T05:38:53.827804+0000 mon.a (mon.0) 1923 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:38:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:54 smithi191 bash[24992]: audit 2024-08-31T05:38:53.833043+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:38:55.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:54 smithi191 bash[24992]: audit 2024-08-31T05:38:53.845079+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:38:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:55 smithi163 bash[24253]: audit 2024-08-31T05:38:53.572251+0000 mgr.a (mgr.14388) 8979 : audit [DBG] from='client.200430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:55 smithi163 bash[24253]: audit 2024-08-31T05:38:53.846732+0000 mgr.a (mgr.14388) 8980 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:38:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:55 smithi027 bash[22610]: audit 2024-08-31T05:38:53.572251+0000 mgr.a (mgr.14388) 8979 : audit [DBG] from='client.200430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:55 smithi027 bash[22610]: audit 2024-08-31T05:38:53.846732+0000 mgr.a (mgr.14388) 8980 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:38:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:55 smithi191 bash[24992]: audit 2024-08-31T05:38:53.572251+0000 mgr.a (mgr.14388) 8979 : audit [DBG] from='client.200430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:38:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:55 smithi191 bash[24992]: audit 2024-08-31T05:38:53.846732+0000 mgr.a (mgr.14388) 8980 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:38:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:56 smithi163 bash[24253]: audit 2024-08-31T05:38:54.715386+0000 mgr.a (mgr.14388) 8981 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:38:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:56 smithi163 bash[24253]: cephadm 2024-08-31T05:38:54.716490+0000 mgr.a (mgr.14388) 8982 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:38:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:56 smithi163 bash[24253]: cluster 2024-08-31T05:38:55.413396+0000 mgr.a (mgr.14388) 8983 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:38:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:56 smithi027 bash[22610]: audit 2024-08-31T05:38:54.715386+0000 mgr.a (mgr.14388) 8981 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:38:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:56 smithi027 bash[22610]: cephadm 2024-08-31T05:38:54.716490+0000 mgr.a (mgr.14388) 8982 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:38:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:56 smithi027 bash[22610]: cluster 2024-08-31T05:38:55.413396+0000 mgr.a (mgr.14388) 8983 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:38:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:56 smithi191 bash[24992]: audit 2024-08-31T05:38:54.715386+0000 mgr.a (mgr.14388) 8981 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:38:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:56 smithi191 bash[24992]: cephadm 2024-08-31T05:38:54.716490+0000 mgr.a (mgr.14388) 8982 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:38:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:56 smithi191 bash[24992]: cluster 2024-08-31T05:38:55.413396+0000 mgr.a (mgr.14388) 8983 : cluster [DBG] pgmap v6225: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:38:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:38:58 smithi163 bash[24253]: cluster 2024-08-31T05:38:57.414168+0000 mgr.a (mgr.14388) 8984 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:38:58 smithi027 bash[22610]: cluster 2024-08-31T05:38:57.414168+0000 mgr.a (mgr.14388) 8984 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:59.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:38:59.030 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:38:59.030 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:38:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:38:58 smithi191 bash[24992]: cluster 2024-08-31T05:38:57.414168+0000 mgr.a (mgr.14388) 8984 : cluster [DBG] pgmap v6226: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:38:59.805 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:38:59.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:38:59.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:38:59.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:38:59.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:00 smithi163 bash[24253]: audit 2024-08-31T05:38:59.369030+0000 mgr.a (mgr.14388) 8985 : audit [DBG] from='client.200616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:00 smithi163 bash[24253]: cluster 2024-08-31T05:38:59.417210+0000 mgr.a (mgr.14388) 8986 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:00 smithi027 bash[22610]: audit 2024-08-31T05:38:59.369030+0000 mgr.a (mgr.14388) 8985 : audit [DBG] from='client.200616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:00 smithi027 bash[22610]: cluster 2024-08-31T05:38:59.417210+0000 mgr.a (mgr.14388) 8986 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:00 smithi191 bash[24992]: audit 2024-08-31T05:38:59.369030+0000 mgr.a (mgr.14388) 8985 : audit [DBG] from='client.200616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:00 smithi191 bash[24992]: cluster 2024-08-31T05:38:59.417210+0000 mgr.a (mgr.14388) 8986 : cluster [DBG] pgmap v6227: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:01 smithi163 bash[24253]: cluster 2024-08-31T05:39:01.418282+0000 mgr.a (mgr.14388) 8987 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:01 smithi027 bash[22610]: cluster 2024-08-31T05:39:01.418282+0000 mgr.a (mgr.14388) 8987 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:01 smithi191 bash[24992]: cluster 2024-08-31T05:39:01.418282+0000 mgr.a (mgr.14388) 8987 : cluster [DBG] pgmap v6228: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:04 smithi027 bash[22610]: cluster 2024-08-31T05:39:03.420675+0000 mgr.a (mgr.14388) 8988 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:04 smithi191 bash[24992]: cluster 2024-08-31T05:39:03.420675+0000 mgr.a (mgr.14388) 8988 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:04.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:39:04.808 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:39:04.808 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:39:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:04 smithi163 bash[24253]: cluster 2024-08-31T05:39:03.420675+0000 mgr.a (mgr.14388) 8988 : cluster [DBG] pgmap v6229: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:05.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:39:05.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:39:05.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:39:05.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:05.576 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:39:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:06 smithi027 bash[22610]: audit 2024-08-31T05:39:05.148090+0000 mgr.a (mgr.14388) 8989 : audit [DBG] from='client.200694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:06 smithi027 bash[22610]: cluster 2024-08-31T05:39:05.421271+0000 mgr.a (mgr.14388) 8990 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:06 smithi191 bash[24992]: audit 2024-08-31T05:39:05.148090+0000 mgr.a (mgr.14388) 8989 : audit [DBG] from='client.200694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:06 smithi191 bash[24992]: cluster 2024-08-31T05:39:05.421271+0000 mgr.a (mgr.14388) 8990 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:06 smithi163 bash[24253]: audit 2024-08-31T05:39:05.148090+0000 mgr.a (mgr.14388) 8989 : audit [DBG] from='client.200694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:06 smithi163 bash[24253]: cluster 2024-08-31T05:39:05.421271+0000 mgr.a (mgr.14388) 8990 : cluster [DBG] pgmap v6230: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:08 smithi191 bash[24992]: cluster 2024-08-31T05:39:07.422119+0000 mgr.a (mgr.14388) 8991 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:08 smithi163 bash[24253]: cluster 2024-08-31T05:39:07.422119+0000 mgr.a (mgr.14388) 8991 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:08 smithi027 bash[22610]: cluster 2024-08-31T05:39:07.422119+0000 mgr.a (mgr.14388) 8991 : cluster [DBG] pgmap v6231: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:10.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:39:10.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:39:10.578 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:39:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:10 smithi191 bash[24992]: cluster 2024-08-31T05:39:09.424368+0000 mgr.a (mgr.14388) 8992 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:10 smithi163 bash[24253]: cluster 2024-08-31T05:39:09.424368+0000 mgr.a (mgr.14388) 8992 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:10 smithi027 bash[22610]: cluster 2024-08-31T05:39:09.424368+0000 mgr.a (mgr.14388) 8992 : cluster [DBG] pgmap v6232: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:39:11.349 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:39:11.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:39:11.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:39:11.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:39:11.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:12 smithi191 bash[24992]: audit 2024-08-31T05:39:10.914467+0000 mgr.a (mgr.14388) 8993 : audit [DBG] from='client.200772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:12.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:12 smithi191 bash[24992]: cluster 2024-08-31T05:39:11.425299+0000 mgr.a (mgr.14388) 8994 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:12 smithi163 bash[24253]: audit 2024-08-31T05:39:10.914467+0000 mgr.a (mgr.14388) 8993 : audit [DBG] from='client.200772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:12 smithi163 bash[24253]: cluster 2024-08-31T05:39:11.425299+0000 mgr.a (mgr.14388) 8994 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:12 smithi027 bash[22610]: audit 2024-08-31T05:39:10.914467+0000 mgr.a (mgr.14388) 8993 : audit [DBG] from='client.200772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:12 smithi027 bash[22610]: cluster 2024-08-31T05:39:11.425299+0000 mgr.a (mgr.14388) 8994 : cluster [DBG] pgmap v6233: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:14 smithi191 bash[24992]: cluster 2024-08-31T05:39:13.427533+0000 mgr.a (mgr.14388) 8995 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:14 smithi163 bash[24253]: cluster 2024-08-31T05:39:13.427533+0000 mgr.a (mgr.14388) 8995 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:14 smithi027 bash[22610]: cluster 2024-08-31T05:39:13.427533+0000 mgr.a (mgr.14388) 8995 : cluster [DBG] pgmap v6234: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:16.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:39:16.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:39:16.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:39:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:16 smithi191 bash[24992]: cluster 2024-08-31T05:39:15.428301+0000 mgr.a (mgr.14388) 8996 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:16 smithi163 bash[24253]: cluster 2024-08-31T05:39:15.428301+0000 mgr.a (mgr.14388) 8996 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:16 smithi027 bash[22610]: cluster 2024-08-31T05:39:15.428301+0000 mgr.a (mgr.14388) 8996 : cluster [DBG] pgmap v6235: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:17.130 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:39:17.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:39:17.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:39:17.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:39:17.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:18 smithi191 bash[24992]: audit 2024-08-31T05:39:16.690033+0000 mgr.a (mgr.14388) 8997 : audit [DBG] from='client.200847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:18.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:18 smithi191 bash[24992]: cluster 2024-08-31T05:39:17.429241+0000 mgr.a (mgr.14388) 8998 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:18 smithi163 bash[24253]: audit 2024-08-31T05:39:16.690033+0000 mgr.a (mgr.14388) 8997 : audit [DBG] from='client.200847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:18 smithi163 bash[24253]: cluster 2024-08-31T05:39:17.429241+0000 mgr.a (mgr.14388) 8998 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:18 smithi027 bash[22610]: audit 2024-08-31T05:39:16.690033+0000 mgr.a (mgr.14388) 8997 : audit [DBG] from='client.200847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:18 smithi027 bash[22610]: cluster 2024-08-31T05:39:17.429241+0000 mgr.a (mgr.14388) 8998 : cluster [DBG] pgmap v6236: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:20 smithi191 bash[24992]: cluster 2024-08-31T05:39:19.431513+0000 mgr.a (mgr.14388) 8999 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:20 smithi163 bash[24253]: cluster 2024-08-31T05:39:19.431513+0000 mgr.a (mgr.14388) 8999 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:20 smithi027 bash[22610]: cluster 2024-08-31T05:39:19.431513+0000 mgr.a (mgr.14388) 8999 : cluster [DBG] pgmap v6237: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:22.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:39:22.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:39:22.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:39:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:22 smithi191 bash[24992]: cluster 2024-08-31T05:39:21.432300+0000 mgr.a (mgr.14388) 9000 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:22.909 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:39:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:39:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:39:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:39:22.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:22 smithi163 bash[24253]: cluster 2024-08-31T05:39:21.432300+0000 mgr.a (mgr.14388) 9000 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:22 smithi027 bash[22610]: cluster 2024-08-31T05:39:21.432300+0000 mgr.a (mgr.14388) 9000 : cluster [DBG] pgmap v6238: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:23 smithi191 bash[24992]: audit 2024-08-31T05:39:22.467473+0000 mgr.a (mgr.14388) 9001 : audit [DBG] from='client.200922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:23 smithi163 bash[24253]: audit 2024-08-31T05:39:22.467473+0000 mgr.a (mgr.14388) 9001 : audit [DBG] from='client.200922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:23 smithi027 bash[22610]: audit 2024-08-31T05:39:22.467473+0000 mgr.a (mgr.14388) 9001 : audit [DBG] from='client.200922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:24 smithi191 bash[24992]: cluster 2024-08-31T05:39:23.434543+0000 mgr.a (mgr.14388) 9002 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:24 smithi163 bash[24253]: cluster 2024-08-31T05:39:23.434543+0000 mgr.a (mgr.14388) 9002 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:24 smithi027 bash[22610]: cluster 2024-08-31T05:39:23.434543+0000 mgr.a (mgr.14388) 9002 : cluster [DBG] pgmap v6239: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:26 smithi191 bash[24992]: cluster 2024-08-31T05:39:25.435300+0000 mgr.a (mgr.14388) 9003 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:26 smithi163 bash[24253]: cluster 2024-08-31T05:39:25.435300+0000 mgr.a (mgr.14388) 9003 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:26 smithi027 bash[22610]: cluster 2024-08-31T05:39:25.435300+0000 mgr.a (mgr.14388) 9003 : cluster [DBG] pgmap v6240: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:27.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:39:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:39:27.912 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:39:28.672 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:39:28.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:39:28.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:39:28.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:39:28.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:28 smithi191 bash[24992]: cluster 2024-08-31T05:39:27.436042+0000 mgr.a (mgr.14388) 9004 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:28 smithi163 bash[24253]: cluster 2024-08-31T05:39:27.436042+0000 mgr.a (mgr.14388) 9004 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:28 smithi027 bash[22610]: cluster 2024-08-31T05:39:27.436042+0000 mgr.a (mgr.14388) 9004 : cluster [DBG] pgmap v6241: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:29 smithi163 bash[24253]: audit 2024-08-31T05:39:28.243183+0000 mgr.a (mgr.14388) 9005 : audit [DBG] from='client.200997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:29 smithi027 bash[22610]: audit 2024-08-31T05:39:28.243183+0000 mgr.a (mgr.14388) 9005 : audit [DBG] from='client.200997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:29 smithi191 bash[24992]: audit 2024-08-31T05:39:28.243183+0000 mgr.a (mgr.14388) 9005 : audit [DBG] from='client.200997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:30 smithi163 bash[24253]: cluster 2024-08-31T05:39:29.438788+0000 mgr.a (mgr.14388) 9006 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:30 smithi027 bash[22610]: cluster 2024-08-31T05:39:29.438788+0000 mgr.a (mgr.14388) 9006 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:30 smithi191 bash[24992]: cluster 2024-08-31T05:39:29.438788+0000 mgr.a (mgr.14388) 9006 : cluster [DBG] pgmap v6242: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:32 smithi163 bash[24253]: cluster 2024-08-31T05:39:31.439559+0000 mgr.a (mgr.14388) 9007 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:39:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:32 smithi027 bash[22610]: cluster 2024-08-31T05:39:31.439559+0000 mgr.a (mgr.14388) 9007 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:39:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:32 smithi191 bash[24992]: cluster 2024-08-31T05:39:31.439559+0000 mgr.a (mgr.14388) 9007 : cluster [DBG] pgmap v6243: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:39:33.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:39:33.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:39:33.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:39:34.465 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:39:34.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:39:34.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:39:34.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:39:34.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:34 smithi163 bash[24253]: cluster 2024-08-31T05:39:33.441453+0000 mgr.a (mgr.14388) 9008 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:34 smithi027 bash[22610]: cluster 2024-08-31T05:39:33.441453+0000 mgr.a (mgr.14388) 9008 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:35.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:34 smithi191 bash[24992]: cluster 2024-08-31T05:39:33.441453+0000 mgr.a (mgr.14388) 9008 : cluster [DBG] pgmap v6244: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:35 smithi163 bash[24253]: audit 2024-08-31T05:39:34.012900+0000 mgr.a (mgr.14388) 9009 : audit [DBG] from='client.201075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:35 smithi027 bash[22610]: audit 2024-08-31T05:39:34.012900+0000 mgr.a (mgr.14388) 9009 : audit [DBG] from='client.201075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:35 smithi191 bash[24992]: audit 2024-08-31T05:39:34.012900+0000 mgr.a (mgr.14388) 9009 : audit [DBG] from='client.201075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:36 smithi163 bash[24253]: cluster 2024-08-31T05:39:35.442330+0000 mgr.a (mgr.14388) 9010 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:39:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:36 smithi027 bash[22610]: cluster 2024-08-31T05:39:35.442330+0000 mgr.a (mgr.14388) 9010 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:39:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:36 smithi191 bash[24992]: cluster 2024-08-31T05:39:35.442330+0000 mgr.a (mgr.14388) 9010 : cluster [DBG] pgmap v6245: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:39:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:38 smithi163 bash[24253]: cluster 2024-08-31T05:39:37.443129+0000 mgr.a (mgr.14388) 9011 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:39:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:38 smithi027 bash[22610]: cluster 2024-08-31T05:39:37.443129+0000 mgr.a (mgr.14388) 9011 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:39:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:38 smithi191 bash[24992]: cluster 2024-08-31T05:39:37.443129+0000 mgr.a (mgr.14388) 9011 : cluster [DBG] pgmap v6246: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:39:39.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:39:39.467 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:39:39.467 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:39:40.241 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:39:40.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:39:40.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:39:40.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:39:40.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:40 smithi163 bash[24253]: cluster 2024-08-31T05:39:39.445314+0000 mgr.a (mgr.14388) 9012 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:40 smithi027 bash[22610]: cluster 2024-08-31T05:39:39.445314+0000 mgr.a (mgr.14388) 9012 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:40 smithi191 bash[24992]: cluster 2024-08-31T05:39:39.445314+0000 mgr.a (mgr.14388) 9012 : cluster [DBG] pgmap v6247: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:41 smithi163 bash[24253]: audit 2024-08-31T05:39:39.805282+0000 mgr.a (mgr.14388) 9013 : audit [DBG] from='client.201153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:41 smithi027 bash[22610]: audit 2024-08-31T05:39:39.805282+0000 mgr.a (mgr.14388) 9013 : audit [DBG] from='client.201153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:41 smithi191 bash[24992]: audit 2024-08-31T05:39:39.805282+0000 mgr.a (mgr.14388) 9013 : audit [DBG] from='client.201153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:42 smithi163 bash[24253]: cluster 2024-08-31T05:39:41.446193+0000 mgr.a (mgr.14388) 9014 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:42 smithi027 bash[22610]: cluster 2024-08-31T05:39:41.446193+0000 mgr.a (mgr.14388) 9014 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:42 smithi191 bash[24992]: cluster 2024-08-31T05:39:41.446193+0000 mgr.a (mgr.14388) 9014 : cluster [DBG] pgmap v6248: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:43 smithi163 bash[24253]: cluster 2024-08-31T05:39:43.448383+0000 mgr.a (mgr.14388) 9015 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:43 smithi027 bash[22610]: cluster 2024-08-31T05:39:43.448383+0000 mgr.a (mgr.14388) 9015 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:43 smithi191 bash[24992]: cluster 2024-08-31T05:39:43.448383+0000 mgr.a (mgr.14388) 9015 : cluster [DBG] pgmap v6249: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:45.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:39:45.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:39:45.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:39:46.027 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:39:46.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:39:46.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:39:46.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:39:46.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:46 smithi191 bash[24992]: cluster 2024-08-31T05:39:45.449085+0000 mgr.a (mgr.14388) 9016 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:46 smithi163 bash[24253]: cluster 2024-08-31T05:39:45.449085+0000 mgr.a (mgr.14388) 9016 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:46 smithi027 bash[22610]: cluster 2024-08-31T05:39:45.449085+0000 mgr.a (mgr.14388) 9016 : cluster [DBG] pgmap v6250: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:47 smithi191 bash[24992]: audit 2024-08-31T05:39:45.581453+0000 mgr.a (mgr.14388) 9017 : audit [DBG] from='client.201231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:47 smithi163 bash[24253]: audit 2024-08-31T05:39:45.581453+0000 mgr.a (mgr.14388) 9017 : audit [DBG] from='client.201231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:47 smithi027 bash[22610]: audit 2024-08-31T05:39:45.581453+0000 mgr.a (mgr.14388) 9017 : audit [DBG] from='client.201231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:48 smithi191 bash[24992]: cluster 2024-08-31T05:39:47.449969+0000 mgr.a (mgr.14388) 9018 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:48 smithi163 bash[24253]: cluster 2024-08-31T05:39:47.449969+0000 mgr.a (mgr.14388) 9018 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:48 smithi027 bash[22610]: cluster 2024-08-31T05:39:47.449969+0000 mgr.a (mgr.14388) 9018 : cluster [DBG] pgmap v6251: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:50 smithi191 bash[24992]: cluster 2024-08-31T05:39:49.452222+0000 mgr.a (mgr.14388) 9019 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:50 smithi163 bash[24253]: cluster 2024-08-31T05:39:49.452222+0000 mgr.a (mgr.14388) 9019 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:50 smithi027 bash[22610]: cluster 2024-08-31T05:39:49.452222+0000 mgr.a (mgr.14388) 9019 : cluster [DBG] pgmap v6252: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:51.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:39:51.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:39:51.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:39:51.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:39:51.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:39:51.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:39:51.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:51.765 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:39:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:52 smithi191 bash[24992]: audit 2024-08-31T05:39:51.359959+0000 mgr.a (mgr.14388) 9020 : audit [DBG] from='client.201309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:52 smithi191 bash[24992]: cluster 2024-08-31T05:39:51.452772+0000 mgr.a (mgr.14388) 9021 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:52 smithi163 bash[24253]: audit 2024-08-31T05:39:51.359959+0000 mgr.a (mgr.14388) 9020 : audit [DBG] from='client.201309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:52 smithi163 bash[24253]: cluster 2024-08-31T05:39:51.452772+0000 mgr.a (mgr.14388) 9021 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:52 smithi027 bash[22610]: audit 2024-08-31T05:39:51.359959+0000 mgr.a (mgr.14388) 9020 : audit [DBG] from='client.201309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:52 smithi027 bash[22610]: cluster 2024-08-31T05:39:51.452772+0000 mgr.a (mgr.14388) 9021 : cluster [DBG] pgmap v6253: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:54 smithi191 bash[24992]: cluster 2024-08-31T05:39:53.455045+0000 mgr.a (mgr.14388) 9022 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:54 smithi163 bash[24253]: cluster 2024-08-31T05:39:53.455045+0000 mgr.a (mgr.14388) 9022 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:54 smithi027 bash[22610]: cluster 2024-08-31T05:39:53.455045+0000 mgr.a (mgr.14388) 9022 : cluster [DBG] pgmap v6254: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:39:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:55 smithi191 bash[24992]: audit 2024-08-31T05:39:54.769434+0000 mon.a (mon.0) 1926 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:39:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:55 smithi163 bash[24253]: audit 2024-08-31T05:39:54.769434+0000 mon.a (mon.0) 1926 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:39:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:55 smithi027 bash[22610]: audit 2024-08-31T05:39:54.769434+0000 mon.a (mon.0) 1926 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:39:56.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:39:56 smithi027 bash[22863]: debug 2024-08-31T05:39:56.360+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:39:56.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:39:56 smithi027 bash[22863]: debug 2024-08-31T05:39:56.360+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:39:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:56 smithi027 bash[22610]: cluster 2024-08-31T05:39:55.455520+0000 mgr.a (mgr.14388) 9023 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:56 smithi027 bash[22610]: audit 2024-08-31T05:39:55.618188+0000 mon.a (mon.0) 1927 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:39:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:56 smithi027 bash[22610]: audit 2024-08-31T05:39:55.619837+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:39:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:56 smithi027 bash[22610]: audit 2024-08-31T05:39:55.629063+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:39:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:56 smithi027 bash[22610]: audit 2024-08-31T05:39:55.633846+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:39:56.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:39:56.767 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:39:56.767 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:39:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:56 smithi191 bash[24992]: cluster 2024-08-31T05:39:55.455520+0000 mgr.a (mgr.14388) 9023 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:56 smithi191 bash[24992]: audit 2024-08-31T05:39:55.618188+0000 mon.a (mon.0) 1927 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:39:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:56 smithi191 bash[24992]: audit 2024-08-31T05:39:55.619837+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:39:56.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:56 smithi191 bash[24992]: audit 2024-08-31T05:39:55.629063+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:39:56.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:56 smithi191 bash[24992]: audit 2024-08-31T05:39:55.633846+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:39:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:56 smithi163 bash[24253]: cluster 2024-08-31T05:39:55.455520+0000 mgr.a (mgr.14388) 9023 : cluster [DBG] pgmap v6255: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:56 smithi163 bash[24253]: audit 2024-08-31T05:39:55.618188+0000 mon.a (mon.0) 1927 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:39:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:56 smithi163 bash[24253]: audit 2024-08-31T05:39:55.619837+0000 mon.a (mon.0) 1928 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:39:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:56 smithi163 bash[24253]: audit 2024-08-31T05:39:55.629063+0000 mon.a (mon.0) 1929 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:39:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:56 smithi163 bash[24253]: audit 2024-08-31T05:39:55.633846+0000 mon.a (mon.0) 1930 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:39:57.521 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:39:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:39:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:39:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:39:57.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:39:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:57 smithi163 bash[24253]: audit 2024-08-31T05:39:55.636152+0000 mgr.a (mgr.14388) 9024 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:39:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:57 smithi163 bash[24253]: audit 2024-08-31T05:39:56.363392+0000 mgr.a (mgr.14388) 9025 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:39:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:57 smithi163 bash[24253]: cephadm 2024-08-31T05:39:56.364734+0000 mgr.a (mgr.14388) 9026 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:39:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:57 smithi027 bash[22610]: audit 2024-08-31T05:39:55.636152+0000 mgr.a (mgr.14388) 9024 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:39:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:57 smithi027 bash[22610]: audit 2024-08-31T05:39:56.363392+0000 mgr.a (mgr.14388) 9025 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:39:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:57 smithi027 bash[22610]: cephadm 2024-08-31T05:39:56.364734+0000 mgr.a (mgr.14388) 9026 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:39:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:57 smithi191 bash[24992]: audit 2024-08-31T05:39:55.636152+0000 mgr.a (mgr.14388) 9024 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:39:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:57 smithi191 bash[24992]: audit 2024-08-31T05:39:56.363392+0000 mgr.a (mgr.14388) 9025 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:39:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:57 smithi191 bash[24992]: cephadm 2024-08-31T05:39:56.364734+0000 mgr.a (mgr.14388) 9026 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:39:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:58 smithi163 bash[24253]: audit 2024-08-31T05:39:57.102863+0000 mgr.a (mgr.14388) 9027 : audit [DBG] from='client.201492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:39:58 smithi163 bash[24253]: cluster 2024-08-31T05:39:57.455994+0000 mgr.a (mgr.14388) 9028 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:58 smithi027 bash[22610]: audit 2024-08-31T05:39:57.102863+0000 mgr.a (mgr.14388) 9027 : audit [DBG] from='client.201492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:39:58 smithi027 bash[22610]: cluster 2024-08-31T05:39:57.455994+0000 mgr.a (mgr.14388) 9028 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:39:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:58 smithi191 bash[24992]: audit 2024-08-31T05:39:57.102863+0000 mgr.a (mgr.14388) 9027 : audit [DBG] from='client.201492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:39:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:39:58 smithi191 bash[24992]: cluster 2024-08-31T05:39:57.455994+0000 mgr.a (mgr.14388) 9028 : cluster [DBG] pgmap v6256: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:00 smithi163 bash[24253]: cluster 2024-08-31T05:39:59.458172+0000 mgr.a (mgr.14388) 9029 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:00 smithi163 bash[24253]: cluster 2024-08-31T05:40:00.000143+0000 mon.a (mon.0) 1931 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:40:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:00 smithi027 bash[22610]: cluster 2024-08-31T05:39:59.458172+0000 mgr.a (mgr.14388) 9029 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:00 smithi027 bash[22610]: cluster 2024-08-31T05:40:00.000143+0000 mon.a (mon.0) 1931 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:40:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:00 smithi191 bash[24992]: cluster 2024-08-31T05:39:59.458172+0000 mgr.a (mgr.14388) 9029 : cluster [DBG] pgmap v6257: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:00 smithi191 bash[24992]: cluster 2024-08-31T05:40:00.000143+0000 mon.a (mon.0) 1931 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:40:02.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:40:02.524 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:40:02.524 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:40:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:02 smithi163 bash[24253]: cluster 2024-08-31T05:40:01.458947+0000 mgr.a (mgr.14388) 9030 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:02 smithi027 bash[22610]: cluster 2024-08-31T05:40:01.458947+0000 mgr.a (mgr.14388) 9030 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:02 smithi191 bash[24992]: cluster 2024-08-31T05:40:01.458947+0000 mgr.a (mgr.14388) 9030 : cluster [DBG] pgmap v6258: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:03.294 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:40:03.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:40:03.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:40:03.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:40:03.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:40:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:04 smithi163 bash[24253]: audit 2024-08-31T05:40:02.862137+0000 mgr.a (mgr.14388) 9031 : audit [DBG] from='client.201570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:04 smithi163 bash[24253]: cluster 2024-08-31T05:40:03.461572+0000 mgr.a (mgr.14388) 9032 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:04 smithi027 bash[22610]: audit 2024-08-31T05:40:02.862137+0000 mgr.a (mgr.14388) 9031 : audit [DBG] from='client.201570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:04 smithi027 bash[22610]: cluster 2024-08-31T05:40:03.461572+0000 mgr.a (mgr.14388) 9032 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:04 smithi191 bash[24992]: audit 2024-08-31T05:40:02.862137+0000 mgr.a (mgr.14388) 9031 : audit [DBG] from='client.201570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:04 smithi191 bash[24992]: cluster 2024-08-31T05:40:03.461572+0000 mgr.a (mgr.14388) 9032 : cluster [DBG] pgmap v6259: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:06 smithi163 bash[24253]: cluster 2024-08-31T05:40:05.462336+0000 mgr.a (mgr.14388) 9033 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:40:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:06 smithi027 bash[22610]: cluster 2024-08-31T05:40:05.462336+0000 mgr.a (mgr.14388) 9033 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:40:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:06 smithi191 bash[24992]: cluster 2024-08-31T05:40:05.462336+0000 mgr.a (mgr.14388) 9033 : cluster [DBG] pgmap v6260: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:40:08.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:40:08.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:40:08.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:40:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:08 smithi163 bash[24253]: cluster 2024-08-31T05:40:07.463121+0000 mgr.a (mgr.14388) 9034 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:40:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:08 smithi027 bash[22610]: cluster 2024-08-31T05:40:07.463121+0000 mgr.a (mgr.14388) 9034 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:40:09.031 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:40:09.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:40:09.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:40:09.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:40:09.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:40:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:08 smithi191 bash[24992]: cluster 2024-08-31T05:40:07.463121+0000 mgr.a (mgr.14388) 9034 : cluster [DBG] pgmap v6261: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:40:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:10 smithi163 bash[24253]: audit 2024-08-31T05:40:08.624890+0000 mgr.a (mgr.14388) 9035 : audit [DBG] from='client.201645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:10 smithi163 bash[24253]: cluster 2024-08-31T05:40:09.465889+0000 mgr.a (mgr.14388) 9036 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:10 smithi027 bash[22610]: audit 2024-08-31T05:40:08.624890+0000 mgr.a (mgr.14388) 9035 : audit [DBG] from='client.201645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:10 smithi027 bash[22610]: cluster 2024-08-31T05:40:09.465889+0000 mgr.a (mgr.14388) 9036 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:10 smithi191 bash[24992]: audit 2024-08-31T05:40:08.624890+0000 mgr.a (mgr.14388) 9035 : audit [DBG] from='client.201645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:10 smithi191 bash[24992]: cluster 2024-08-31T05:40:09.465889+0000 mgr.a (mgr.14388) 9036 : cluster [DBG] pgmap v6262: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:40:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:12 smithi163 bash[24253]: cluster 2024-08-31T05:40:11.466691+0000 mgr.a (mgr.14388) 9037 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:40:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:12 smithi027 bash[22610]: cluster 2024-08-31T05:40:11.466691+0000 mgr.a (mgr.14388) 9037 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:40:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:12 smithi191 bash[24992]: cluster 2024-08-31T05:40:11.466691+0000 mgr.a (mgr.14388) 9037 : cluster [DBG] pgmap v6263: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:40:14.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:40:14.033 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:40:14.033 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:40:14.787 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:40:14.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:40:14.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:40:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:40:14.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:40:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:14 smithi163 bash[24253]: cluster 2024-08-31T05:40:13.468541+0000 mgr.a (mgr.14388) 9038 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:14 smithi027 bash[22610]: cluster 2024-08-31T05:40:13.468541+0000 mgr.a (mgr.14388) 9038 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:14 smithi191 bash[24992]: cluster 2024-08-31T05:40:13.468541+0000 mgr.a (mgr.14388) 9038 : cluster [DBG] pgmap v6264: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:15 smithi163 bash[24253]: audit 2024-08-31T05:40:14.364092+0000 mgr.a (mgr.14388) 9039 : audit [DBG] from='client.201723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:15 smithi027 bash[22610]: audit 2024-08-31T05:40:14.364092+0000 mgr.a (mgr.14388) 9039 : audit [DBG] from='client.201723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:15 smithi191 bash[24992]: audit 2024-08-31T05:40:14.364092+0000 mgr.a (mgr.14388) 9039 : audit [DBG] from='client.201723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:16 smithi163 bash[24253]: cluster 2024-08-31T05:40:15.469509+0000 mgr.a (mgr.14388) 9040 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:16 smithi027 bash[22610]: cluster 2024-08-31T05:40:15.469509+0000 mgr.a (mgr.14388) 9040 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:16 smithi191 bash[24992]: cluster 2024-08-31T05:40:15.469509+0000 mgr.a (mgr.14388) 9040 : cluster [DBG] pgmap v6265: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:17 smithi163 bash[24253]: cluster 2024-08-31T05:40:17.470332+0000 mgr.a (mgr.14388) 9041 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:17 smithi027 bash[22610]: cluster 2024-08-31T05:40:17.470332+0000 mgr.a (mgr.14388) 9041 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:17 smithi191 bash[24992]: cluster 2024-08-31T05:40:17.470332+0000 mgr.a (mgr.14388) 9041 : cluster [DBG] pgmap v6266: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:19.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:40:19.789 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:40:19.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:40:20.545 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:40:20.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:40:20.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:40:20.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:40:20.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:40:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:20 smithi191 bash[24992]: cluster 2024-08-31T05:40:19.472553+0000 mgr.a (mgr.14388) 9042 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:20 smithi163 bash[24253]: cluster 2024-08-31T05:40:19.472553+0000 mgr.a (mgr.14388) 9042 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:20 smithi027 bash[22610]: cluster 2024-08-31T05:40:19.472553+0000 mgr.a (mgr.14388) 9042 : cluster [DBG] pgmap v6267: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:21 smithi191 bash[24992]: audit 2024-08-31T05:40:20.123325+0000 mgr.a (mgr.14388) 9043 : audit [DBG] from='client.201801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:21 smithi163 bash[24253]: audit 2024-08-31T05:40:20.123325+0000 mgr.a (mgr.14388) 9043 : audit [DBG] from='client.201801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:21 smithi027 bash[22610]: audit 2024-08-31T05:40:20.123325+0000 mgr.a (mgr.14388) 9043 : audit [DBG] from='client.201801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:22.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:22 smithi163 bash[24253]: cluster 2024-08-31T05:40:21.473528+0000 mgr.a (mgr.14388) 9044 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:22.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:22 smithi027 bash[22610]: cluster 2024-08-31T05:40:21.473528+0000 mgr.a (mgr.14388) 9044 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:23.408 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:22 smithi191 bash[24992]: cluster 2024-08-31T05:40:21.473528+0000 mgr.a (mgr.14388) 9044 : cluster [DBG] pgmap v6268: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:24 smithi163 bash[24253]: cluster 2024-08-31T05:40:23.475749+0000 mgr.a (mgr.14388) 9045 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:24 smithi027 bash[22610]: cluster 2024-08-31T05:40:23.475749+0000 mgr.a (mgr.14388) 9045 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:24 smithi191 bash[24992]: cluster 2024-08-31T05:40:23.475749+0000 mgr.a (mgr.14388) 9045 : cluster [DBG] pgmap v6269: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:25.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:40:25.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:40:25.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:40:26.295 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:40:26.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:40:26.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:40:26.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:40:26.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:40:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:26 smithi163 bash[24253]: cluster 2024-08-31T05:40:25.476518+0000 mgr.a (mgr.14388) 9046 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:26 smithi027 bash[22610]: cluster 2024-08-31T05:40:25.476518+0000 mgr.a (mgr.14388) 9046 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:26 smithi191 bash[24992]: cluster 2024-08-31T05:40:25.476518+0000 mgr.a (mgr.14388) 9046 : cluster [DBG] pgmap v6270: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:27 smithi163 bash[24253]: audit 2024-08-31T05:40:25.880636+0000 mgr.a (mgr.14388) 9047 : audit [DBG] from='client.201879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:27 smithi027 bash[22610]: audit 2024-08-31T05:40:25.880636+0000 mgr.a (mgr.14388) 9047 : audit [DBG] from='client.201879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:27 smithi191 bash[24992]: audit 2024-08-31T05:40:25.880636+0000 mgr.a (mgr.14388) 9047 : audit [DBG] from='client.201879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:28 smithi163 bash[24253]: cluster 2024-08-31T05:40:27.477494+0000 mgr.a (mgr.14388) 9048 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:28 smithi027 bash[22610]: cluster 2024-08-31T05:40:27.477494+0000 mgr.a (mgr.14388) 9048 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:28 smithi191 bash[24992]: cluster 2024-08-31T05:40:27.477494+0000 mgr.a (mgr.14388) 9048 : cluster [DBG] pgmap v6271: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:30 smithi163 bash[24253]: cluster 2024-08-31T05:40:29.479737+0000 mgr.a (mgr.14388) 9049 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:30 smithi027 bash[22610]: cluster 2024-08-31T05:40:29.479737+0000 mgr.a (mgr.14388) 9049 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:30 smithi191 bash[24992]: cluster 2024-08-31T05:40:29.479737+0000 mgr.a (mgr.14388) 9049 : cluster [DBG] pgmap v6272: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:31.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:40:31.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:40:31.298 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:40:32.061 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:40:32.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:40:32.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:40:32.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:40:32.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:40:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:32 smithi163 bash[24253]: cluster 2024-08-31T05:40:31.480379+0000 mgr.a (mgr.14388) 9050 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:32 smithi027 bash[22610]: cluster 2024-08-31T05:40:31.480379+0000 mgr.a (mgr.14388) 9050 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:32 smithi191 bash[24992]: cluster 2024-08-31T05:40:31.480379+0000 mgr.a (mgr.14388) 9050 : cluster [DBG] pgmap v6273: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:33 smithi163 bash[24253]: audit 2024-08-31T05:40:31.635841+0000 mgr.a (mgr.14388) 9051 : audit [DBG] from='client.201957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:33 smithi027 bash[22610]: audit 2024-08-31T05:40:31.635841+0000 mgr.a (mgr.14388) 9051 : audit [DBG] from='client.201957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:33 smithi191 bash[24992]: audit 2024-08-31T05:40:31.635841+0000 mgr.a (mgr.14388) 9051 : audit [DBG] from='client.201957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:34 smithi163 bash[24253]: cluster 2024-08-31T05:40:33.482708+0000 mgr.a (mgr.14388) 9052 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:34 smithi027 bash[22610]: cluster 2024-08-31T05:40:33.482708+0000 mgr.a (mgr.14388) 9052 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:34 smithi191 bash[24992]: cluster 2024-08-31T05:40:33.482708+0000 mgr.a (mgr.14388) 9052 : cluster [DBG] pgmap v6274: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:36 smithi163 bash[24253]: cluster 2024-08-31T05:40:35.483524+0000 mgr.a (mgr.14388) 9053 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:36 smithi027 bash[22610]: cluster 2024-08-31T05:40:35.483524+0000 mgr.a (mgr.14388) 9053 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:36 smithi191 bash[24992]: cluster 2024-08-31T05:40:35.483524+0000 mgr.a (mgr.14388) 9053 : cluster [DBG] pgmap v6275: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:37.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:40:37.064 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:40:37.064 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:40:37.808 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:40:37.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:40:37.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:40:37.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:40:37.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:40:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:38 smithi163 bash[24253]: audit 2024-08-31T05:40:37.394403+0000 mgr.a (mgr.14388) 9054 : audit [DBG] from='client.202032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:38 smithi163 bash[24253]: cluster 2024-08-31T05:40:37.483988+0000 mgr.a (mgr.14388) 9055 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:38 smithi027 bash[22610]: audit 2024-08-31T05:40:37.394403+0000 mgr.a (mgr.14388) 9054 : audit [DBG] from='client.202032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:38 smithi027 bash[22610]: cluster 2024-08-31T05:40:37.483988+0000 mgr.a (mgr.14388) 9055 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:39.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:38 smithi191 bash[24992]: audit 2024-08-31T05:40:37.394403+0000 mgr.a (mgr.14388) 9054 : audit [DBG] from='client.202032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:39.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:38 smithi191 bash[24992]: cluster 2024-08-31T05:40:37.483988+0000 mgr.a (mgr.14388) 9055 : cluster [DBG] pgmap v6276: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:39 smithi163 bash[24253]: cluster 2024-08-31T05:40:39.486281+0000 mgr.a (mgr.14388) 9056 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:39 smithi027 bash[22610]: cluster 2024-08-31T05:40:39.486281+0000 mgr.a (mgr.14388) 9056 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:39 smithi191 bash[24992]: cluster 2024-08-31T05:40:39.486281+0000 mgr.a (mgr.14388) 9056 : cluster [DBG] pgmap v6277: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:40:42.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:40:42.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:40:42.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:40:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:42 smithi163 bash[24253]: cluster 2024-08-31T05:40:41.487074+0000 mgr.a (mgr.14388) 9057 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:42 smithi027 bash[22610]: cluster 2024-08-31T05:40:41.487074+0000 mgr.a (mgr.14388) 9057 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:42 smithi191 bash[24992]: cluster 2024-08-31T05:40:41.487074+0000 mgr.a (mgr.14388) 9057 : cluster [DBG] pgmap v6278: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:43.576 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:40:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:40:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:40:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:40:43.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:40:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:44 smithi163 bash[24253]: audit 2024-08-31T05:40:43.146922+0000 mgr.a (mgr.14388) 9058 : audit [DBG] from='client.202107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:44 smithi163 bash[24253]: cluster 2024-08-31T05:40:43.488351+0000 mgr.a (mgr.14388) 9059 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:44 smithi027 bash[22610]: audit 2024-08-31T05:40:43.146922+0000 mgr.a (mgr.14388) 9058 : audit [DBG] from='client.202107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:44 smithi027 bash[22610]: cluster 2024-08-31T05:40:43.488351+0000 mgr.a (mgr.14388) 9059 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:44 smithi191 bash[24992]: audit 2024-08-31T05:40:43.146922+0000 mgr.a (mgr.14388) 9058 : audit [DBG] from='client.202107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:44 smithi191 bash[24992]: cluster 2024-08-31T05:40:43.488351+0000 mgr.a (mgr.14388) 9059 : cluster [DBG] pgmap v6279: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:46 smithi163 bash[24253]: cluster 2024-08-31T05:40:45.489090+0000 mgr.a (mgr.14388) 9060 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:40:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:46 smithi027 bash[22610]: cluster 2024-08-31T05:40:45.489090+0000 mgr.a (mgr.14388) 9060 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:40:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:46 smithi191 bash[24992]: cluster 2024-08-31T05:40:45.489090+0000 mgr.a (mgr.14388) 9060 : cluster [DBG] pgmap v6280: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:40:48.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:40:48.578 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:40:48.578 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:40:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:48 smithi163 bash[24253]: cluster 2024-08-31T05:40:47.489908+0000 mgr.a (mgr.14388) 9061 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:40:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:48 smithi027 bash[22610]: cluster 2024-08-31T05:40:47.489908+0000 mgr.a (mgr.14388) 9061 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:40:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:48 smithi191 bash[24992]: cluster 2024-08-31T05:40:47.489908+0000 mgr.a (mgr.14388) 9061 : cluster [DBG] pgmap v6281: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:40:49.351 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:40:49.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:40:49.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:40:49.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:40:49.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:40:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:50 smithi163 bash[24253]: audit 2024-08-31T05:40:48.913858+0000 mgr.a (mgr.14388) 9062 : audit [DBG] from='client.202185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:50 smithi163 bash[24253]: cluster 2024-08-31T05:40:49.492644+0000 mgr.a (mgr.14388) 9063 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:50 smithi027 bash[22610]: audit 2024-08-31T05:40:48.913858+0000 mgr.a (mgr.14388) 9062 : audit [DBG] from='client.202185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:50 smithi027 bash[22610]: cluster 2024-08-31T05:40:49.492644+0000 mgr.a (mgr.14388) 9063 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:50 smithi191 bash[24992]: audit 2024-08-31T05:40:48.913858+0000 mgr.a (mgr.14388) 9062 : audit [DBG] from='client.202185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:50 smithi191 bash[24992]: cluster 2024-08-31T05:40:49.492644+0000 mgr.a (mgr.14388) 9063 : cluster [DBG] pgmap v6282: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:52 smithi163 bash[24253]: cluster 2024-08-31T05:40:51.493572+0000 mgr.a (mgr.14388) 9064 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:40:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:52 smithi027 bash[22610]: cluster 2024-08-31T05:40:51.493572+0000 mgr.a (mgr.14388) 9064 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:40:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:52 smithi191 bash[24992]: cluster 2024-08-31T05:40:51.493572+0000 mgr.a (mgr.14388) 9064 : cluster [DBG] pgmap v6283: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:40:54.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:40:54.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:40:54.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:40:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:54 smithi163 bash[24253]: cluster 2024-08-31T05:40:53.495546+0000 mgr.a (mgr.14388) 9065 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:54 smithi027 bash[22610]: cluster 2024-08-31T05:40:53.495546+0000 mgr.a (mgr.14388) 9065 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:54 smithi191 bash[24992]: cluster 2024-08-31T05:40:53.495546+0000 mgr.a (mgr.14388) 9065 : cluster [DBG] pgmap v6284: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:55.120 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:40:55.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:40:55.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:40:55.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:40:55.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:40:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:56 smithi163 bash[24253]: audit 2024-08-31T05:40:54.687119+0000 mgr.a (mgr.14388) 9066 : audit [DBG] from='client.202263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:56 smithi163 bash[24253]: cluster 2024-08-31T05:40:55.496491+0000 mgr.a (mgr.14388) 9067 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:56 smithi163 bash[24253]: audit 2024-08-31T05:40:56.418586+0000 mon.a (mon.0) 1932 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:40:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:56 smithi027 bash[22610]: audit 2024-08-31T05:40:54.687119+0000 mgr.a (mgr.14388) 9066 : audit [DBG] from='client.202263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:56 smithi027 bash[22610]: cluster 2024-08-31T05:40:55.496491+0000 mgr.a (mgr.14388) 9067 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:56 smithi027 bash[22610]: audit 2024-08-31T05:40:56.418586+0000 mon.a (mon.0) 1932 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:40:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:56 smithi191 bash[24992]: audit 2024-08-31T05:40:54.687119+0000 mgr.a (mgr.14388) 9066 : audit [DBG] from='client.202263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:40:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:56 smithi191 bash[24992]: cluster 2024-08-31T05:40:55.496491+0000 mgr.a (mgr.14388) 9067 : cluster [DBG] pgmap v6285: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:56 smithi191 bash[24992]: audit 2024-08-31T05:40:56.418586+0000 mon.a (mon.0) 1932 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:40:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:57 smithi163 bash[24253]: audit 2024-08-31T05:40:57.249936+0000 mon.a (mon.0) 1933 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:40:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:57 smithi163 bash[24253]: audit 2024-08-31T05:40:57.251750+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:40:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:57 smithi163 bash[24253]: audit 2024-08-31T05:40:57.262242+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:40:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:57 smithi163 bash[24253]: audit 2024-08-31T05:40:57.265628+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:40:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:57 smithi027 bash[22610]: audit 2024-08-31T05:40:57.249936+0000 mon.a (mon.0) 1933 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:40:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:57 smithi027 bash[22610]: audit 2024-08-31T05:40:57.251750+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:40:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:57 smithi027 bash[22610]: audit 2024-08-31T05:40:57.262242+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:40:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:57 smithi027 bash[22610]: audit 2024-08-31T05:40:57.265628+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:40:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:57 smithi191 bash[24992]: audit 2024-08-31T05:40:57.249936+0000 mon.a (mon.0) 1933 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:40:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:57 smithi191 bash[24992]: audit 2024-08-31T05:40:57.251750+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:40:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:57 smithi191 bash[24992]: audit 2024-08-31T05:40:57.262242+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:40:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:57 smithi191 bash[24992]: audit 2024-08-31T05:40:57.265628+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:40:58.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:40:57 smithi027 bash[22863]: debug 2024-08-31T05:40:57.990+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:40:58.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:40:57 smithi027 bash[22863]: debug 2024-08-31T05:40:57.990+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:40:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:58 smithi163 bash[24253]: audit 2024-08-31T05:40:57.268093+0000 mgr.a (mgr.14388) 9068 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:40:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:58 smithi163 bash[24253]: cluster 2024-08-31T05:40:57.497114+0000 mgr.a (mgr.14388) 9069 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:58 smithi027 bash[22610]: audit 2024-08-31T05:40:57.268093+0000 mgr.a (mgr.14388) 9068 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:40:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:58 smithi027 bash[22610]: cluster 2024-08-31T05:40:57.497114+0000 mgr.a (mgr.14388) 9069 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:58 smithi191 bash[24992]: audit 2024-08-31T05:40:57.268093+0000 mgr.a (mgr.14388) 9068 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:40:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:58 smithi191 bash[24992]: cluster 2024-08-31T05:40:57.497114+0000 mgr.a (mgr.14388) 9069 : cluster [DBG] pgmap v6286: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:40:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:59 smithi163 bash[24253]: audit 2024-08-31T05:40:57.993528+0000 mgr.a (mgr.14388) 9070 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:40:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:40:59 smithi163 bash[24253]: cephadm 2024-08-31T05:40:57.994652+0000 mgr.a (mgr.14388) 9071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:40:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:59 smithi027 bash[22610]: audit 2024-08-31T05:40:57.993528+0000 mgr.a (mgr.14388) 9070 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:40:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:40:59 smithi027 bash[22610]: cephadm 2024-08-31T05:40:57.994652+0000 mgr.a (mgr.14388) 9071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:41:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:59 smithi191 bash[24992]: audit 2024-08-31T05:40:57.993528+0000 mgr.a (mgr.14388) 9070 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:41:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:40:59 smithi191 bash[24992]: cephadm 2024-08-31T05:40:57.994652+0000 mgr.a (mgr.14388) 9071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:41:00.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:00.122 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:00.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:00.859 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:00.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:00.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:00.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:00.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:00 smithi163 bash[24253]: cluster 2024-08-31T05:40:59.499423+0000 mgr.a (mgr.14388) 9072 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:00 smithi027 bash[22610]: cluster 2024-08-31T05:40:59.499423+0000 mgr.a (mgr.14388) 9072 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:00 smithi191 bash[24992]: cluster 2024-08-31T05:40:59.499423+0000 mgr.a (mgr.14388) 9072 : cluster [DBG] pgmap v6287: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:01 smithi163 bash[24253]: audit 2024-08-31T05:41:00.452771+0000 mgr.a (mgr.14388) 9073 : audit [DBG] from='client.202449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:01 smithi027 bash[22610]: audit 2024-08-31T05:41:00.452771+0000 mgr.a (mgr.14388) 9073 : audit [DBG] from='client.202449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:01 smithi191 bash[24992]: audit 2024-08-31T05:41:00.452771+0000 mgr.a (mgr.14388) 9073 : audit [DBG] from='client.202449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:02 smithi163 bash[24253]: cluster 2024-08-31T05:41:01.500527+0000 mgr.a (mgr.14388) 9074 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:02 smithi027 bash[22610]: cluster 2024-08-31T05:41:01.500527+0000 mgr.a (mgr.14388) 9074 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:02 smithi191 bash[24992]: cluster 2024-08-31T05:41:01.500527+0000 mgr.a (mgr.14388) 9074 : cluster [DBG] pgmap v6288: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:03 smithi163 bash[24253]: cluster 2024-08-31T05:41:03.502894+0000 mgr.a (mgr.14388) 9075 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:03 smithi027 bash[22610]: cluster 2024-08-31T05:41:03.502894+0000 mgr.a (mgr.14388) 9075 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:03 smithi191 bash[24992]: cluster 2024-08-31T05:41:03.502894+0000 mgr.a (mgr.14388) 9075 : cluster [DBG] pgmap v6289: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:05.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:05.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:05.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:06.625 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:06.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:06.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:06.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:06 smithi163 bash[24253]: cluster 2024-08-31T05:41:05.503861+0000 mgr.a (mgr.14388) 9076 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:06 smithi027 bash[22610]: cluster 2024-08-31T05:41:05.503861+0000 mgr.a (mgr.14388) 9076 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:06 smithi191 bash[24992]: cluster 2024-08-31T05:41:05.503861+0000 mgr.a (mgr.14388) 9076 : cluster [DBG] pgmap v6290: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:07 smithi163 bash[24253]: audit 2024-08-31T05:41:06.195118+0000 mgr.a (mgr.14388) 9077 : audit [DBG] from='client.202527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:07 smithi027 bash[22610]: audit 2024-08-31T05:41:06.195118+0000 mgr.a (mgr.14388) 9077 : audit [DBG] from='client.202527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:07 smithi191 bash[24992]: audit 2024-08-31T05:41:06.195118+0000 mgr.a (mgr.14388) 9077 : audit [DBG] from='client.202527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:08 smithi163 bash[24253]: cluster 2024-08-31T05:41:07.504867+0000 mgr.a (mgr.14388) 9078 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:08 smithi027 bash[22610]: cluster 2024-08-31T05:41:07.504867+0000 mgr.a (mgr.14388) 9078 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:08 smithi191 bash[24992]: cluster 2024-08-31T05:41:07.504867+0000 mgr.a (mgr.14388) 9078 : cluster [DBG] pgmap v6291: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:10 smithi163 bash[24253]: cluster 2024-08-31T05:41:09.507147+0000 mgr.a (mgr.14388) 9079 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:10 smithi027 bash[22610]: cluster 2024-08-31T05:41:09.507147+0000 mgr.a (mgr.14388) 9079 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:10 smithi191 bash[24992]: cluster 2024-08-31T05:41:09.507147+0000 mgr.a (mgr.14388) 9079 : cluster [DBG] pgmap v6292: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:41:11.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:11.627 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:11.628 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:12.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:12.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:12.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:12.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:12.385 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:12 smithi163 bash[24253]: cluster 2024-08-31T05:41:11.507904+0000 mgr.a (mgr.14388) 9080 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:12 smithi027 bash[22610]: cluster 2024-08-31T05:41:11.507904+0000 mgr.a (mgr.14388) 9080 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:12 smithi191 bash[24992]: cluster 2024-08-31T05:41:11.507904+0000 mgr.a (mgr.14388) 9080 : cluster [DBG] pgmap v6293: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:13 smithi163 bash[24253]: audit 2024-08-31T05:41:11.954174+0000 mgr.a (mgr.14388) 9081 : audit [DBG] from='client.202605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:13 smithi027 bash[22610]: audit 2024-08-31T05:41:11.954174+0000 mgr.a (mgr.14388) 9081 : audit [DBG] from='client.202605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:13 smithi191 bash[24992]: audit 2024-08-31T05:41:11.954174+0000 mgr.a (mgr.14388) 9081 : audit [DBG] from='client.202605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:14 smithi163 bash[24253]: cluster 2024-08-31T05:41:13.510233+0000 mgr.a (mgr.14388) 9082 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:14 smithi027 bash[22610]: cluster 2024-08-31T05:41:13.510233+0000 mgr.a (mgr.14388) 9082 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:14 smithi191 bash[24992]: cluster 2024-08-31T05:41:13.510233+0000 mgr.a (mgr.14388) 9082 : cluster [DBG] pgmap v6294: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:16 smithi163 bash[24253]: cluster 2024-08-31T05:41:15.511033+0000 mgr.a (mgr.14388) 9083 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:16 smithi027 bash[22610]: cluster 2024-08-31T05:41:15.511033+0000 mgr.a (mgr.14388) 9083 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:16 smithi191 bash[24992]: cluster 2024-08-31T05:41:15.511033+0000 mgr.a (mgr.14388) 9083 : cluster [DBG] pgmap v6295: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:17.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:17.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:17.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:18.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:18.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:18.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:18.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:18.152 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:18 smithi163 bash[24253]: cluster 2024-08-31T05:41:17.511460+0000 mgr.a (mgr.14388) 9084 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:18 smithi027 bash[22610]: cluster 2024-08-31T05:41:17.511460+0000 mgr.a (mgr.14388) 9084 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:18 smithi191 bash[24992]: cluster 2024-08-31T05:41:17.511460+0000 mgr.a (mgr.14388) 9084 : cluster [DBG] pgmap v6296: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:19 smithi163 bash[24253]: audit 2024-08-31T05:41:17.723117+0000 mgr.a (mgr.14388) 9085 : audit [DBG] from='client.202683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:19 smithi027 bash[22610]: audit 2024-08-31T05:41:17.723117+0000 mgr.a (mgr.14388) 9085 : audit [DBG] from='client.202683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:19 smithi191 bash[24992]: audit 2024-08-31T05:41:17.723117+0000 mgr.a (mgr.14388) 9085 : audit [DBG] from='client.202683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:20 smithi163 bash[24253]: cluster 2024-08-31T05:41:19.514146+0000 mgr.a (mgr.14388) 9086 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:41:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:20 smithi027 bash[22610]: cluster 2024-08-31T05:41:19.514146+0000 mgr.a (mgr.14388) 9086 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:41:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:20 smithi191 bash[24992]: cluster 2024-08-31T05:41:19.514146+0000 mgr.a (mgr.14388) 9086 : cluster [DBG] pgmap v6297: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:41:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:21 smithi163 bash[24253]: cluster 2024-08-31T05:41:21.514967+0000 mgr.a (mgr.14388) 9087 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:41:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:21 smithi027 bash[22610]: cluster 2024-08-31T05:41:21.514967+0000 mgr.a (mgr.14388) 9087 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:41:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:21 smithi191 bash[24992]: cluster 2024-08-31T05:41:21.514967+0000 mgr.a (mgr.14388) 9087 : cluster [DBG] pgmap v6298: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:41:23.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:23.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:23.154 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:23.912 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:23.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:23.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:23.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:23.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:24 smithi163 bash[24253]: audit 2024-08-31T05:41:23.486202+0000 mgr.a (mgr.14388) 9088 : audit [DBG] from='client.202758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:24 smithi163 bash[24253]: cluster 2024-08-31T05:41:23.517900+0000 mgr.a (mgr.14388) 9089 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:24 smithi027 bash[22610]: audit 2024-08-31T05:41:23.486202+0000 mgr.a (mgr.14388) 9088 : audit [DBG] from='client.202758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:24 smithi027 bash[22610]: cluster 2024-08-31T05:41:23.517900+0000 mgr.a (mgr.14388) 9089 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:24 smithi191 bash[24992]: audit 2024-08-31T05:41:23.486202+0000 mgr.a (mgr.14388) 9088 : audit [DBG] from='client.202758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:24 smithi191 bash[24992]: cluster 2024-08-31T05:41:23.517900+0000 mgr.a (mgr.14388) 9089 : cluster [DBG] pgmap v6299: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:26 smithi163 bash[24253]: cluster 2024-08-31T05:41:25.518861+0000 mgr.a (mgr.14388) 9090 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:41:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:26 smithi027 bash[22610]: cluster 2024-08-31T05:41:25.518861+0000 mgr.a (mgr.14388) 9090 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:41:27.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:26 smithi191 bash[24992]: cluster 2024-08-31T05:41:25.518861+0000 mgr.a (mgr.14388) 9090 : cluster [DBG] pgmap v6300: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:41:28.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:28.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:28.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:28 smithi163 bash[24253]: cluster 2024-08-31T05:41:27.519598+0000 mgr.a (mgr.14388) 9091 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:41:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:28 smithi027 bash[22610]: cluster 2024-08-31T05:41:27.519598+0000 mgr.a (mgr.14388) 9091 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:41:29.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:28 smithi191 bash[24992]: cluster 2024-08-31T05:41:27.519598+0000 mgr.a (mgr.14388) 9091 : cluster [DBG] pgmap v6301: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:41:29.661 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:29.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:29.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:29.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:29.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:30 smithi163 bash[24253]: audit 2024-08-31T05:41:29.251019+0000 mgr.a (mgr.14388) 9092 : audit [DBG] from='client.202836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:30 smithi163 bash[24253]: cluster 2024-08-31T05:41:29.520899+0000 mgr.a (mgr.14388) 9093 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:30 smithi027 bash[22610]: audit 2024-08-31T05:41:29.251019+0000 mgr.a (mgr.14388) 9092 : audit [DBG] from='client.202836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:30 smithi027 bash[22610]: cluster 2024-08-31T05:41:29.520899+0000 mgr.a (mgr.14388) 9093 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:30 smithi191 bash[24992]: audit 2024-08-31T05:41:29.251019+0000 mgr.a (mgr.14388) 9092 : audit [DBG] from='client.202836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:31.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:30 smithi191 bash[24992]: cluster 2024-08-31T05:41:29.520899+0000 mgr.a (mgr.14388) 9093 : cluster [DBG] pgmap v6302: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:32 smithi163 bash[24253]: cluster 2024-08-31T05:41:31.521791+0000 mgr.a (mgr.14388) 9094 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:41:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:32 smithi027 bash[22610]: cluster 2024-08-31T05:41:31.521791+0000 mgr.a (mgr.14388) 9094 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:41:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:32 smithi191 bash[24992]: cluster 2024-08-31T05:41:31.521791+0000 mgr.a (mgr.14388) 9094 : cluster [DBG] pgmap v6303: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:41:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:34.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:34.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:34 smithi163 bash[24253]: cluster 2024-08-31T05:41:33.523978+0000 mgr.a (mgr.14388) 9095 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:41:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:34 smithi027 bash[22610]: cluster 2024-08-31T05:41:33.523978+0000 mgr.a (mgr.14388) 9095 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:41:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:34 smithi191 bash[24992]: cluster 2024-08-31T05:41:33.523978+0000 mgr.a (mgr.14388) 9095 : cluster [DBG] pgmap v6304: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:41:35.428 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:35.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:35.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:35.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:35.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:36 smithi163 bash[24253]: audit 2024-08-31T05:41:35.001471+0000 mgr.a (mgr.14388) 9096 : audit [DBG] from='client.202911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:36 smithi163 bash[24253]: cluster 2024-08-31T05:41:35.524916+0000 mgr.a (mgr.14388) 9097 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:36 smithi027 bash[22610]: audit 2024-08-31T05:41:35.001471+0000 mgr.a (mgr.14388) 9096 : audit [DBG] from='client.202911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:36 smithi027 bash[22610]: cluster 2024-08-31T05:41:35.524916+0000 mgr.a (mgr.14388) 9097 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:37.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:36 smithi191 bash[24992]: audit 2024-08-31T05:41:35.001471+0000 mgr.a (mgr.14388) 9096 : audit [DBG] from='client.202911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:37.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:36 smithi191 bash[24992]: cluster 2024-08-31T05:41:35.524916+0000 mgr.a (mgr.14388) 9097 : cluster [DBG] pgmap v6305: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:38 smithi163 bash[24253]: cluster 2024-08-31T05:41:37.525897+0000 mgr.a (mgr.14388) 9098 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:38 smithi027 bash[22610]: cluster 2024-08-31T05:41:37.525897+0000 mgr.a (mgr.14388) 9098 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:38 smithi191 bash[24992]: cluster 2024-08-31T05:41:37.525897+0000 mgr.a (mgr.14388) 9098 : cluster [DBG] pgmap v6306: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:40.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:40.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:40.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:40 smithi163 bash[24253]: cluster 2024-08-31T05:41:39.528164+0000 mgr.a (mgr.14388) 9099 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:40 smithi027 bash[22610]: cluster 2024-08-31T05:41:39.528164+0000 mgr.a (mgr.14388) 9099 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:40 smithi191 bash[24992]: cluster 2024-08-31T05:41:39.528164+0000 mgr.a (mgr.14388) 9099 : cluster [DBG] pgmap v6307: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:41.203 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:41.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:41.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:41.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:41.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:41 smithi163 bash[24253]: audit 2024-08-31T05:41:40.768062+0000 mgr.a (mgr.14388) 9100 : audit [DBG] from='client.202983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:41 smithi163 bash[24253]: cluster 2024-08-31T05:41:41.529086+0000 mgr.a (mgr.14388) 9101 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:41 smithi027 bash[22610]: audit 2024-08-31T05:41:40.768062+0000 mgr.a (mgr.14388) 9100 : audit [DBG] from='client.202983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:41 smithi027 bash[22610]: cluster 2024-08-31T05:41:41.529086+0000 mgr.a (mgr.14388) 9101 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:41 smithi191 bash[24992]: audit 2024-08-31T05:41:40.768062+0000 mgr.a (mgr.14388) 9100 : audit [DBG] from='client.202983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:41 smithi191 bash[24992]: cluster 2024-08-31T05:41:41.529086+0000 mgr.a (mgr.14388) 9101 : cluster [DBG] pgmap v6308: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:44 smithi163 bash[24253]: cluster 2024-08-31T05:41:43.531275+0000 mgr.a (mgr.14388) 9102 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:44 smithi027 bash[22610]: cluster 2024-08-31T05:41:43.531275+0000 mgr.a (mgr.14388) 9102 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:44 smithi191 bash[24992]: cluster 2024-08-31T05:41:43.531275+0000 mgr.a (mgr.14388) 9102 : cluster [DBG] pgmap v6309: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:46.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:46.206 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:46.206 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:46.944 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:46.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:46.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:46.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:46.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:46 smithi163 bash[24253]: cluster 2024-08-31T05:41:45.532034+0000 mgr.a (mgr.14388) 9103 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:46 smithi027 bash[22610]: cluster 2024-08-31T05:41:45.532034+0000 mgr.a (mgr.14388) 9103 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:46 smithi191 bash[24992]: cluster 2024-08-31T05:41:45.532034+0000 mgr.a (mgr.14388) 9103 : cluster [DBG] pgmap v6310: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:47 smithi163 bash[24253]: audit 2024-08-31T05:41:46.536834+0000 mgr.a (mgr.14388) 9104 : audit [DBG] from='client.203061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:47 smithi027 bash[22610]: audit 2024-08-31T05:41:46.536834+0000 mgr.a (mgr.14388) 9104 : audit [DBG] from='client.203061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:47 smithi191 bash[24992]: audit 2024-08-31T05:41:46.536834+0000 mgr.a (mgr.14388) 9104 : audit [DBG] from='client.203061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:48 smithi163 bash[24253]: cluster 2024-08-31T05:41:47.533014+0000 mgr.a (mgr.14388) 9105 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:48 smithi027 bash[22610]: cluster 2024-08-31T05:41:47.533014+0000 mgr.a (mgr.14388) 9105 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:48 smithi191 bash[24992]: cluster 2024-08-31T05:41:47.533014+0000 mgr.a (mgr.14388) 9105 : cluster [DBG] pgmap v6311: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:50 smithi163 bash[24253]: cluster 2024-08-31T05:41:49.535311+0000 mgr.a (mgr.14388) 9106 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:50 smithi027 bash[22610]: cluster 2024-08-31T05:41:49.535311+0000 mgr.a (mgr.14388) 9106 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:50 smithi191 bash[24992]: cluster 2024-08-31T05:41:49.535311+0000 mgr.a (mgr.14388) 9106 : cluster [DBG] pgmap v6312: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:51.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:51.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:51.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:51 smithi163 bash[24253]: cluster 2024-08-31T05:41:51.536090+0000 mgr.a (mgr.14388) 9107 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:51 smithi027 bash[22610]: cluster 2024-08-31T05:41:51.536090+0000 mgr.a (mgr.14388) 9107 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:51 smithi191 bash[24992]: cluster 2024-08-31T05:41:51.536090+0000 mgr.a (mgr.14388) 9107 : cluster [DBG] pgmap v6313: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:52.732 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:52.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:52.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:52.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:52.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:52 smithi163 bash[24253]: audit 2024-08-31T05:41:52.283826+0000 mgr.a (mgr.14388) 9108 : audit [DBG] from='client.203139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:52 smithi027 bash[22610]: audit 2024-08-31T05:41:52.283826+0000 mgr.a (mgr.14388) 9108 : audit [DBG] from='client.203139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:52 smithi191 bash[24992]: audit 2024-08-31T05:41:52.283826+0000 mgr.a (mgr.14388) 9108 : audit [DBG] from='client.203139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:53 smithi163 bash[24253]: cluster 2024-08-31T05:41:53.538450+0000 mgr.a (mgr.14388) 9109 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:53 smithi027 bash[22610]: cluster 2024-08-31T05:41:53.538450+0000 mgr.a (mgr.14388) 9109 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:53 smithi191 bash[24992]: cluster 2024-08-31T05:41:53.538450+0000 mgr.a (mgr.14388) 9109 : cluster [DBG] pgmap v6314: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:41:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:56 smithi163 bash[24253]: cluster 2024-08-31T05:41:55.539245+0000 mgr.a (mgr.14388) 9110 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:56 smithi027 bash[22610]: cluster 2024-08-31T05:41:55.539245+0000 mgr.a (mgr.14388) 9110 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:56 smithi191 bash[24992]: cluster 2024-08-31T05:41:55.539245+0000 mgr.a (mgr.14388) 9110 : cluster [DBG] pgmap v6315: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:57.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:41:57.734 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:41:57.734 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:41:58.484 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:41:58.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:41:58.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:41:58.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:41:58.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:41:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:58 smithi163 bash[24253]: cluster 2024-08-31T05:41:57.540007+0000 mgr.a (mgr.14388) 9111 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:58 smithi163 bash[24253]: audit 2024-08-31T05:41:58.044842+0000 mon.a (mon.0) 1937 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:41:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:58 smithi027 bash[22610]: cluster 2024-08-31T05:41:57.540007+0000 mgr.a (mgr.14388) 9111 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:58 smithi027 bash[22610]: audit 2024-08-31T05:41:58.044842+0000 mon.a (mon.0) 1937 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:41:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:58 smithi191 bash[24992]: cluster 2024-08-31T05:41:57.540007+0000 mgr.a (mgr.14388) 9111 : cluster [DBG] pgmap v6316: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:41:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:58 smithi191 bash[24992]: audit 2024-08-31T05:41:58.044842+0000 mon.a (mon.0) 1937 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:41:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:41:59 smithi163 bash[24253]: audit 2024-08-31T05:41:58.070706+0000 mgr.a (mgr.14388) 9112 : audit [DBG] from='client.203214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:41:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:41:59 smithi027 bash[22610]: audit 2024-08-31T05:41:58.070706+0000 mgr.a (mgr.14388) 9112 : audit [DBG] from='client.203214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:41:59 smithi191 bash[24992]: audit 2024-08-31T05:41:58.070706+0000 mgr.a (mgr.14388) 9112 : audit [DBG] from='client.203214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:00 smithi163 bash[24253]: cluster 2024-08-31T05:41:59.542628+0000 mgr.a (mgr.14388) 9113 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:00 smithi027 bash[22610]: cluster 2024-08-31T05:41:59.542628+0000 mgr.a (mgr.14388) 9113 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:00 smithi191 bash[24992]: cluster 2024-08-31T05:41:59.542628+0000 mgr.a (mgr.14388) 9113 : cluster [DBG] pgmap v6317: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:02 smithi163 bash[24253]: cluster 2024-08-31T05:42:01.543461+0000 mgr.a (mgr.14388) 9114 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:42:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:02 smithi027 bash[22610]: cluster 2024-08-31T05:42:01.543461+0000 mgr.a (mgr.14388) 9114 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:42:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:02 smithi191 bash[24992]: cluster 2024-08-31T05:42:01.543461+0000 mgr.a (mgr.14388) 9114 : cluster [DBG] pgmap v6318: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:42:03.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:42:03.486 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:42:03.486 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:42:04.224 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:42:04.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:42:04.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:42:04.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:42:04.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:42:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:04 smithi163 bash[24253]: audit 2024-08-31T05:42:03.396808+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:04 smithi163 bash[24253]: audit 2024-08-31T05:42:03.401026+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:04 smithi163 bash[24253]: audit 2024-08-31T05:42:03.434970+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:04 smithi163 bash[24253]: audit 2024-08-31T05:42:03.441725+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:04 smithi163 bash[24253]: audit 2024-08-31T05:42:03.450525+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:04 smithi163 bash[24253]: audit 2024-08-31T05:42:03.456754+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:04 smithi163 bash[24253]: cluster 2024-08-31T05:42:03.544758+0000 mgr.a (mgr.14388) 9115 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:04.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:04 smithi027 bash[22610]: audit 2024-08-31T05:42:03.396808+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:04 smithi027 bash[22610]: audit 2024-08-31T05:42:03.401026+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:04 smithi027 bash[22610]: audit 2024-08-31T05:42:03.434970+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:04 smithi027 bash[22610]: audit 2024-08-31T05:42:03.441725+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:04 smithi027 bash[22610]: audit 2024-08-31T05:42:03.450525+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:04 smithi027 bash[22610]: audit 2024-08-31T05:42:03.456754+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:04 smithi027 bash[22610]: cluster 2024-08-31T05:42:03.544758+0000 mgr.a (mgr.14388) 9115 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:04 smithi191 bash[24992]: audit 2024-08-31T05:42:03.396808+0000 mon.a (mon.0) 1938 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:04 smithi191 bash[24992]: audit 2024-08-31T05:42:03.401026+0000 mon.a (mon.0) 1939 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:04 smithi191 bash[24992]: audit 2024-08-31T05:42:03.434970+0000 mon.a (mon.0) 1940 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:04 smithi191 bash[24992]: audit 2024-08-31T05:42:03.441725+0000 mon.a (mon.0) 1941 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:04 smithi191 bash[24992]: audit 2024-08-31T05:42:03.450525+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:04 smithi191 bash[24992]: audit 2024-08-31T05:42:03.456754+0000 mon.a (mon.0) 1943 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:04 smithi191 bash[24992]: cluster 2024-08-31T05:42:03.544758+0000 mgr.a (mgr.14388) 9115 : cluster [DBG] pgmap v6319: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:05 smithi027 bash[22610]: audit 2024-08-31T05:42:03.794807+0000 mgr.a (mgr.14388) 9116 : audit [DBG] from='client.203289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:05 smithi191 bash[24992]: audit 2024-08-31T05:42:03.794807+0000 mgr.a (mgr.14388) 9116 : audit [DBG] from='client.203289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:05 smithi163 bash[24253]: audit 2024-08-31T05:42:03.794807+0000 mgr.a (mgr.14388) 9116 : audit [DBG] from='client.203289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:06.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:06 smithi027 bash[22610]: cluster 2024-08-31T05:42:05.545798+0000 mgr.a (mgr.14388) 9117 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:42:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:06 smithi191 bash[24992]: cluster 2024-08-31T05:42:05.545798+0000 mgr.a (mgr.14388) 9117 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:42:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:06 smithi163 bash[24253]: cluster 2024-08-31T05:42:05.545798+0000 mgr.a (mgr.14388) 9117 : cluster [DBG] pgmap v6320: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:42:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:08 smithi163 bash[24253]: cluster 2024-08-31T05:42:07.546802+0000 mgr.a (mgr.14388) 9118 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:42:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:08 smithi027 bash[22610]: cluster 2024-08-31T05:42:07.546802+0000 mgr.a (mgr.14388) 9118 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:42:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:08 smithi191 bash[24992]: cluster 2024-08-31T05:42:07.546802+0000 mgr.a (mgr.14388) 9118 : cluster [DBG] pgmap v6321: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:42:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:42:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:42:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:42:09.972 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:42:09.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:42:09.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:42:09.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:42:09.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:42:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:10 smithi163 bash[24253]: cluster 2024-08-31T05:42:09.549036+0000 mgr.a (mgr.14388) 9119 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:10 smithi163 bash[24253]: audit 2024-08-31T05:42:09.552479+0000 mgr.a (mgr.14388) 9120 : audit [DBG] from='client.203364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:10 smithi027 bash[22610]: cluster 2024-08-31T05:42:09.549036+0000 mgr.a (mgr.14388) 9119 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:10 smithi027 bash[22610]: audit 2024-08-31T05:42:09.552479+0000 mgr.a (mgr.14388) 9120 : audit [DBG] from='client.203364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:10 smithi191 bash[24992]: cluster 2024-08-31T05:42:09.549036+0000 mgr.a (mgr.14388) 9119 : cluster [DBG] pgmap v6322: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:10 smithi191 bash[24992]: audit 2024-08-31T05:42:09.552479+0000 mgr.a (mgr.14388) 9120 : audit [DBG] from='client.203364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:12 smithi163 bash[24253]: cluster 2024-08-31T05:42:11.549985+0000 mgr.a (mgr.14388) 9121 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:12 smithi027 bash[22610]: cluster 2024-08-31T05:42:11.549985+0000 mgr.a (mgr.14388) 9121 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:12 smithi191 bash[24992]: cluster 2024-08-31T05:42:11.549985+0000 mgr.a (mgr.14388) 9121 : cluster [DBG] pgmap v6323: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:14 smithi163 bash[24253]: cluster 2024-08-31T05:42:13.552254+0000 mgr.a (mgr.14388) 9122 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:42:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:14 smithi163 bash[24253]: audit 2024-08-31T05:42:13.961779+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:14 smithi163 bash[24253]: audit 2024-08-31T05:42:13.970799+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:14 smithi163 bash[24253]: audit 2024-08-31T05:42:13.973475+0000 mon.a (mon.0) 1946 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:42:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:14 smithi163 bash[24253]: audit 2024-08-31T05:42:13.975428+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:42:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:14 smithi163 bash[24253]: audit 2024-08-31T05:42:13.986165+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:14.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:14 smithi163 bash[24253]: audit 2024-08-31T05:42:13.991222+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:42:14.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:42:14.974 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:42:14.974 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:42:14.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:42:14 smithi027 bash[22863]: debug 2024-08-31T05:42:14.748+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:42:14.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:42:14 smithi027 bash[22863]: debug 2024-08-31T05:42:14.752+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:42:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:14 smithi027 bash[22610]: cluster 2024-08-31T05:42:13.552254+0000 mgr.a (mgr.14388) 9122 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:42:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:14 smithi027 bash[22610]: audit 2024-08-31T05:42:13.961779+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:14 smithi027 bash[22610]: audit 2024-08-31T05:42:13.970799+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:14 smithi027 bash[22610]: audit 2024-08-31T05:42:13.973475+0000 mon.a (mon.0) 1946 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:42:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:14 smithi027 bash[22610]: audit 2024-08-31T05:42:13.975428+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:42:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:14 smithi027 bash[22610]: audit 2024-08-31T05:42:13.986165+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:14 smithi027 bash[22610]: audit 2024-08-31T05:42:13.991222+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:42:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:14 smithi191 bash[24992]: cluster 2024-08-31T05:42:13.552254+0000 mgr.a (mgr.14388) 9122 : cluster [DBG] pgmap v6324: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:42:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:14 smithi191 bash[24992]: audit 2024-08-31T05:42:13.961779+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:14 smithi191 bash[24992]: audit 2024-08-31T05:42:13.970799+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:14 smithi191 bash[24992]: audit 2024-08-31T05:42:13.973475+0000 mon.a (mon.0) 1946 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:42:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:14 smithi191 bash[24992]: audit 2024-08-31T05:42:13.975428+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:42:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:14 smithi191 bash[24992]: audit 2024-08-31T05:42:13.986165+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:42:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:14 smithi191 bash[24992]: audit 2024-08-31T05:42:13.991222+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:42:15.729 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:42:15.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:42:15.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:42:15.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:42:15.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:42:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:15 smithi163 bash[24253]: audit 2024-08-31T05:42:13.993520+0000 mgr.a (mgr.14388) 9123 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:42:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:15 smithi163 bash[24253]: audit 2024-08-31T05:42:14.754631+0000 mgr.a (mgr.14388) 9124 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:42:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:15 smithi163 bash[24253]: cephadm 2024-08-31T05:42:14.755783+0000 mgr.a (mgr.14388) 9125 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:42:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:15 smithi163 bash[24253]: audit 2024-08-31T05:42:15.304586+0000 mgr.a (mgr.14388) 9126 : audit [DBG] from='client.203544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:15 smithi163 bash[24253]: cluster 2024-08-31T05:42:15.552783+0000 mgr.a (mgr.14388) 9127 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:15 smithi027 bash[22610]: audit 2024-08-31T05:42:13.993520+0000 mgr.a (mgr.14388) 9123 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:42:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:15 smithi027 bash[22610]: audit 2024-08-31T05:42:14.754631+0000 mgr.a (mgr.14388) 9124 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:42:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:15 smithi027 bash[22610]: cephadm 2024-08-31T05:42:14.755783+0000 mgr.a (mgr.14388) 9125 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:42:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:15 smithi027 bash[22610]: audit 2024-08-31T05:42:15.304586+0000 mgr.a (mgr.14388) 9126 : audit [DBG] from='client.203544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:15 smithi027 bash[22610]: cluster 2024-08-31T05:42:15.552783+0000 mgr.a (mgr.14388) 9127 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:15 smithi191 bash[24992]: audit 2024-08-31T05:42:13.993520+0000 mgr.a (mgr.14388) 9123 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:42:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:15 smithi191 bash[24992]: audit 2024-08-31T05:42:14.754631+0000 mgr.a (mgr.14388) 9124 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:42:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:15 smithi191 bash[24992]: cephadm 2024-08-31T05:42:14.755783+0000 mgr.a (mgr.14388) 9125 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:42:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:15 smithi191 bash[24992]: audit 2024-08-31T05:42:15.304586+0000 mgr.a (mgr.14388) 9126 : audit [DBG] from='client.203544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:15 smithi191 bash[24992]: cluster 2024-08-31T05:42:15.552783+0000 mgr.a (mgr.14388) 9127 : cluster [DBG] pgmap v6325: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:18 smithi163 bash[24253]: cluster 2024-08-31T05:42:17.553663+0000 mgr.a (mgr.14388) 9128 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:18 smithi027 bash[22610]: cluster 2024-08-31T05:42:17.553663+0000 mgr.a (mgr.14388) 9128 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:18 smithi191 bash[24992]: cluster 2024-08-31T05:42:17.553663+0000 mgr.a (mgr.14388) 9128 : cluster [DBG] pgmap v6326: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:20.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:42:20.731 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:42:20.731 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:42:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:20 smithi163 bash[24253]: cluster 2024-08-31T05:42:19.555936+0000 mgr.a (mgr.14388) 9129 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:42:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:20 smithi027 bash[22610]: cluster 2024-08-31T05:42:19.555936+0000 mgr.a (mgr.14388) 9129 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:42:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:20 smithi191 bash[24992]: cluster 2024-08-31T05:42:19.555936+0000 mgr.a (mgr.14388) 9129 : cluster [DBG] pgmap v6327: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:42:21.508 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:42:21.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:42:21.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:42:21.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:42:21.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:42:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:21 smithi163 bash[24253]: audit 2024-08-31T05:42:21.070111+0000 mgr.a (mgr.14388) 9130 : audit [DBG] from='client.203622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:21 smithi163 bash[24253]: cluster 2024-08-31T05:42:21.556906+0000 mgr.a (mgr.14388) 9131 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:42:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:21 smithi027 bash[22610]: audit 2024-08-31T05:42:21.070111+0000 mgr.a (mgr.14388) 9130 : audit [DBG] from='client.203622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:21 smithi027 bash[22610]: cluster 2024-08-31T05:42:21.556906+0000 mgr.a (mgr.14388) 9131 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:42:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:21 smithi191 bash[24992]: audit 2024-08-31T05:42:21.070111+0000 mgr.a (mgr.14388) 9130 : audit [DBG] from='client.203622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:21 smithi191 bash[24992]: cluster 2024-08-31T05:42:21.556906+0000 mgr.a (mgr.14388) 9131 : cluster [DBG] pgmap v6328: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:42:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:24 smithi163 bash[24253]: cluster 2024-08-31T05:42:23.559097+0000 mgr.a (mgr.14388) 9132 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:42:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:24 smithi027 bash[22610]: cluster 2024-08-31T05:42:23.559097+0000 mgr.a (mgr.14388) 9132 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:42:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:24 smithi191 bash[24992]: cluster 2024-08-31T05:42:23.559097+0000 mgr.a (mgr.14388) 9132 : cluster [DBG] pgmap v6329: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:42:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:25 smithi163 bash[24253]: cluster 2024-08-31T05:42:25.559859+0000 mgr.a (mgr.14388) 9133 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T05:42:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:25 smithi027 bash[22610]: cluster 2024-08-31T05:42:25.559859+0000 mgr.a (mgr.14388) 9133 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T05:42:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:25 smithi191 bash[24992]: cluster 2024-08-31T05:42:25.559859+0000 mgr.a (mgr.14388) 9133 : cluster [DBG] pgmap v6330: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T05:42:26.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:42:26.511 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:42:26.511 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:42:27.282 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:42:27.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:42:27.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:42:27.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:42:27.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:42:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:28 smithi163 bash[24253]: audit 2024-08-31T05:42:26.845450+0000 mgr.a (mgr.14388) 9134 : audit [DBG] from='client.203700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:28 smithi163 bash[24253]: cluster 2024-08-31T05:42:27.560809+0000 mgr.a (mgr.14388) 9135 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T05:42:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:28 smithi027 bash[22610]: audit 2024-08-31T05:42:26.845450+0000 mgr.a (mgr.14388) 9134 : audit [DBG] from='client.203700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:28 smithi027 bash[22610]: cluster 2024-08-31T05:42:27.560809+0000 mgr.a (mgr.14388) 9135 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T05:42:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:28 smithi191 bash[24992]: audit 2024-08-31T05:42:26.845450+0000 mgr.a (mgr.14388) 9134 : audit [DBG] from='client.203700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:29.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:28 smithi191 bash[24992]: cluster 2024-08-31T05:42:27.560809+0000 mgr.a (mgr.14388) 9135 : cluster [DBG] pgmap v6331: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T05:42:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:29 smithi163 bash[24253]: cluster 2024-08-31T05:42:29.563127+0000 mgr.a (mgr.14388) 9136 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:42:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:29 smithi027 bash[22610]: cluster 2024-08-31T05:42:29.563127+0000 mgr.a (mgr.14388) 9136 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:42:30.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:29 smithi191 bash[24992]: cluster 2024-08-31T05:42:29.563127+0000 mgr.a (mgr.14388) 9136 : cluster [DBG] pgmap v6332: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T05:42:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:31 smithi163 bash[24253]: cluster 2024-08-31T05:42:31.563887+0000 mgr.a (mgr.14388) 9137 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:42:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:31 smithi027 bash[22610]: cluster 2024-08-31T05:42:31.563887+0000 mgr.a (mgr.14388) 9137 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:42:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:31 smithi191 bash[24992]: cluster 2024-08-31T05:42:31.563887+0000 mgr.a (mgr.14388) 9137 : cluster [DBG] pgmap v6333: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:42:32.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:42:32.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:42:32.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:42:33.053 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:42:33.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:42:33.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:42:33.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:42:33.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:42:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:33 smithi163 bash[24253]: audit 2024-08-31T05:42:32.625074+0000 mgr.a (mgr.14388) 9138 : audit [DBG] from='client.203778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:33 smithi163 bash[24253]: cluster 2024-08-31T05:42:33.566388+0000 mgr.a (mgr.14388) 9139 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:42:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:33 smithi027 bash[22610]: audit 2024-08-31T05:42:32.625074+0000 mgr.a (mgr.14388) 9138 : audit [DBG] from='client.203778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:33 smithi027 bash[22610]: cluster 2024-08-31T05:42:33.566388+0000 mgr.a (mgr.14388) 9139 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:42:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:33 smithi191 bash[24992]: audit 2024-08-31T05:42:32.625074+0000 mgr.a (mgr.14388) 9138 : audit [DBG] from='client.203778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:33 smithi191 bash[24992]: cluster 2024-08-31T05:42:33.566388+0000 mgr.a (mgr.14388) 9139 : cluster [DBG] pgmap v6334: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:42:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:35 smithi163 bash[24253]: cluster 2024-08-31T05:42:35.567210+0000 mgr.a (mgr.14388) 9140 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:42:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:35 smithi027 bash[22610]: cluster 2024-08-31T05:42:35.567210+0000 mgr.a (mgr.14388) 9140 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:42:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:35 smithi191 bash[24992]: cluster 2024-08-31T05:42:35.567210+0000 mgr.a (mgr.14388) 9140 : cluster [DBG] pgmap v6335: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:42:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:37 smithi163 bash[24253]: cluster 2024-08-31T05:42:37.568001+0000 mgr.a (mgr.14388) 9141 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:42:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:37 smithi027 bash[22610]: cluster 2024-08-31T05:42:37.568001+0000 mgr.a (mgr.14388) 9141 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:42:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:37 smithi191 bash[24992]: cluster 2024-08-31T05:42:37.568001+0000 mgr.a (mgr.14388) 9141 : cluster [DBG] pgmap v6336: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:42:38.054 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:42:38.055 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:42:38.055 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:42:38.834 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:42:38.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:42:38.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:42:38.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:42:38.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:42:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:38 smithi163 bash[24253]: audit 2024-08-31T05:42:38.394774+0000 mgr.a (mgr.14388) 9142 : audit [DBG] from='client.203856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:38 smithi027 bash[22610]: audit 2024-08-31T05:42:38.394774+0000 mgr.a (mgr.14388) 9142 : audit [DBG] from='client.203856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:38 smithi191 bash[24992]: audit 2024-08-31T05:42:38.394774+0000 mgr.a (mgr.14388) 9142 : audit [DBG] from='client.203856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:39 smithi163 bash[24253]: cluster 2024-08-31T05:42:39.570816+0000 mgr.a (mgr.14388) 9143 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:39 smithi027 bash[22610]: cluster 2024-08-31T05:42:39.570816+0000 mgr.a (mgr.14388) 9143 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:40.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:39 smithi191 bash[24992]: cluster 2024-08-31T05:42:39.570816+0000 mgr.a (mgr.14388) 9143 : cluster [DBG] pgmap v6337: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:41 smithi163 bash[24253]: cluster 2024-08-31T05:42:41.571636+0000 mgr.a (mgr.14388) 9144 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:42:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:41 smithi027 bash[22610]: cluster 2024-08-31T05:42:41.571636+0000 mgr.a (mgr.14388) 9144 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:42:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:41 smithi191 bash[24992]: cluster 2024-08-31T05:42:41.571636+0000 mgr.a (mgr.14388) 9144 : cluster [DBG] pgmap v6338: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T05:42:43.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:42:43.836 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:42:43.837 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:42:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:43 smithi163 bash[24253]: cluster 2024-08-31T05:42:43.573647+0000 mgr.a (mgr.14388) 9145 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:43 smithi027 bash[22610]: cluster 2024-08-31T05:42:43.573647+0000 mgr.a (mgr.14388) 9145 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:43 smithi191 bash[24992]: cluster 2024-08-31T05:42:43.573647+0000 mgr.a (mgr.14388) 9145 : cluster [DBG] pgmap v6339: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:44.586 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:42:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:42:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:42:44.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:42:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:42:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:44 smithi163 bash[24253]: audit 2024-08-31T05:42:44.164871+0000 mgr.a (mgr.14388) 9146 : audit [DBG] from='client.203934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:44 smithi027 bash[22610]: audit 2024-08-31T05:42:44.164871+0000 mgr.a (mgr.14388) 9146 : audit [DBG] from='client.203934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:44 smithi191 bash[24992]: audit 2024-08-31T05:42:44.164871+0000 mgr.a (mgr.14388) 9146 : audit [DBG] from='client.203934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:45 smithi163 bash[24253]: cluster 2024-08-31T05:42:45.574557+0000 mgr.a (mgr.14388) 9147 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:45 smithi027 bash[22610]: cluster 2024-08-31T05:42:45.574557+0000 mgr.a (mgr.14388) 9147 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:45 smithi191 bash[24992]: cluster 2024-08-31T05:42:45.574557+0000 mgr.a (mgr.14388) 9147 : cluster [DBG] pgmap v6340: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:47 smithi163 bash[24253]: cluster 2024-08-31T05:42:47.575354+0000 mgr.a (mgr.14388) 9148 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:47 smithi027 bash[22610]: cluster 2024-08-31T05:42:47.575354+0000 mgr.a (mgr.14388) 9148 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:47 smithi191 bash[24992]: cluster 2024-08-31T05:42:47.575354+0000 mgr.a (mgr.14388) 9148 : cluster [DBG] pgmap v6341: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:42:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:42:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:42:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:42:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:49 smithi163 bash[24253]: cluster 2024-08-31T05:42:49.577520+0000 mgr.a (mgr.14388) 9149 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:42:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:49 smithi027 bash[22610]: cluster 2024-08-31T05:42:49.577520+0000 mgr.a (mgr.14388) 9149 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:42:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:49 smithi191 bash[24992]: cluster 2024-08-31T05:42:49.577520+0000 mgr.a (mgr.14388) 9149 : cluster [DBG] pgmap v6342: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:42:50.345 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:42:50.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:42:50.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:42:50.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:42:50.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:42:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:50 smithi163 bash[24253]: audit 2024-08-31T05:42:49.922946+0000 mgr.a (mgr.14388) 9150 : audit [DBG] from='client.204012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:50 smithi027 bash[22610]: audit 2024-08-31T05:42:49.922946+0000 mgr.a (mgr.14388) 9150 : audit [DBG] from='client.204012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:50 smithi191 bash[24992]: audit 2024-08-31T05:42:49.922946+0000 mgr.a (mgr.14388) 9150 : audit [DBG] from='client.204012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:51 smithi163 bash[24253]: cluster 2024-08-31T05:42:51.578409+0000 mgr.a (mgr.14388) 9151 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:51 smithi027 bash[22610]: cluster 2024-08-31T05:42:51.578409+0000 mgr.a (mgr.14388) 9151 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:51 smithi191 bash[24992]: cluster 2024-08-31T05:42:51.578409+0000 mgr.a (mgr.14388) 9151 : cluster [DBG] pgmap v6343: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:53 smithi163 bash[24253]: cluster 2024-08-31T05:42:53.580600+0000 mgr.a (mgr.14388) 9152 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:42:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:53 smithi027 bash[22610]: cluster 2024-08-31T05:42:53.580600+0000 mgr.a (mgr.14388) 9152 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:42:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:53 smithi191 bash[24992]: cluster 2024-08-31T05:42:53.580600+0000 mgr.a (mgr.14388) 9152 : cluster [DBG] pgmap v6344: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:42:55.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:42:55.482 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:42:55.482 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:42:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:55 smithi163 bash[24253]: cluster 2024-08-31T05:42:55.581363+0000 mgr.a (mgr.14388) 9153 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:55 smithi027 bash[22610]: cluster 2024-08-31T05:42:55.581363+0000 mgr.a (mgr.14388) 9153 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:55 smithi191 bash[24992]: cluster 2024-08-31T05:42:55.581363+0000 mgr.a (mgr.14388) 9153 : cluster [DBG] pgmap v6345: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:56.098 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:42:56.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:42:56.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:42:56.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:42:56.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:42:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:56 smithi163 bash[24253]: audit 2024-08-31T05:42:55.683436+0000 mgr.a (mgr.14388) 9154 : audit [DBG] from='client.204090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:56 smithi027 bash[22610]: audit 2024-08-31T05:42:55.683436+0000 mgr.a (mgr.14388) 9154 : audit [DBG] from='client.204090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:56 smithi191 bash[24992]: audit 2024-08-31T05:42:55.683436+0000 mgr.a (mgr.14388) 9154 : audit [DBG] from='client.204090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:42:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:57 smithi163 bash[24253]: cluster 2024-08-31T05:42:57.582375+0000 mgr.a (mgr.14388) 9155 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:57 smithi027 bash[22610]: cluster 2024-08-31T05:42:57.582375+0000 mgr.a (mgr.14388) 9155 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:57 smithi191 bash[24992]: cluster 2024-08-31T05:42:57.582375+0000 mgr.a (mgr.14388) 9155 : cluster [DBG] pgmap v6346: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:42:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:42:59 smithi163 bash[24253]: cluster 2024-08-31T05:42:59.584665+0000 mgr.a (mgr.14388) 9156 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:42:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:42:59 smithi027 bash[22610]: cluster 2024-08-31T05:42:59.584665+0000 mgr.a (mgr.14388) 9156 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:42:59 smithi191 bash[24992]: cluster 2024-08-31T05:42:59.584665+0000 mgr.a (mgr.14388) 9156 : cluster [DBG] pgmap v6347: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:01.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:01.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:01.101 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:01.867 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:01.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:01.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:01.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:01.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:01.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:01 smithi163 bash[24253]: audit 2024-08-31T05:43:01.432106+0000 mgr.a (mgr.14388) 9157 : audit [DBG] from='client.204165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:01.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:01 smithi163 bash[24253]: cluster 2024-08-31T05:43:01.585230+0000 mgr.a (mgr.14388) 9158 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:01 smithi027 bash[22610]: audit 2024-08-31T05:43:01.432106+0000 mgr.a (mgr.14388) 9157 : audit [DBG] from='client.204165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:01 smithi027 bash[22610]: cluster 2024-08-31T05:43:01.585230+0000 mgr.a (mgr.14388) 9158 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:01 smithi191 bash[24992]: audit 2024-08-31T05:43:01.432106+0000 mgr.a (mgr.14388) 9157 : audit [DBG] from='client.204165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:01 smithi191 bash[24992]: cluster 2024-08-31T05:43:01.585230+0000 mgr.a (mgr.14388) 9158 : cluster [DBG] pgmap v6348: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:03 smithi163 bash[24253]: cluster 2024-08-31T05:43:03.587467+0000 mgr.a (mgr.14388) 9159 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:03 smithi027 bash[22610]: cluster 2024-08-31T05:43:03.587467+0000 mgr.a (mgr.14388) 9159 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:03 smithi191 bash[24992]: cluster 2024-08-31T05:43:03.587467+0000 mgr.a (mgr.14388) 9159 : cluster [DBG] pgmap v6349: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:05 smithi163 bash[24253]: cluster 2024-08-31T05:43:05.588266+0000 mgr.a (mgr.14388) 9160 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:05 smithi027 bash[22610]: cluster 2024-08-31T05:43:05.588266+0000 mgr.a (mgr.14388) 9160 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:05 smithi191 bash[24992]: cluster 2024-08-31T05:43:05.588266+0000 mgr.a (mgr.14388) 9160 : cluster [DBG] pgmap v6350: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:06.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:06.869 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:06.869 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:07.616 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:07.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:07.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:07.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:07.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:07 smithi163 bash[24253]: audit 2024-08-31T05:43:07.199488+0000 mgr.a (mgr.14388) 9161 : audit [DBG] from='client.204243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:07 smithi163 bash[24253]: cluster 2024-08-31T05:43:07.588753+0000 mgr.a (mgr.14388) 9162 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:07 smithi027 bash[22610]: audit 2024-08-31T05:43:07.199488+0000 mgr.a (mgr.14388) 9161 : audit [DBG] from='client.204243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:07 smithi027 bash[22610]: cluster 2024-08-31T05:43:07.588753+0000 mgr.a (mgr.14388) 9162 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:07 smithi191 bash[24992]: audit 2024-08-31T05:43:07.199488+0000 mgr.a (mgr.14388) 9161 : audit [DBG] from='client.204243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:07 smithi191 bash[24992]: cluster 2024-08-31T05:43:07.588753+0000 mgr.a (mgr.14388) 9162 : cluster [DBG] pgmap v6351: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:09.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:09 smithi163 bash[24253]: cluster 2024-08-31T05:43:09.590943+0000 mgr.a (mgr.14388) 9163 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:09 smithi027 bash[22610]: cluster 2024-08-31T05:43:09.590943+0000 mgr.a (mgr.14388) 9163 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:09 smithi191 bash[24992]: cluster 2024-08-31T05:43:09.590943+0000 mgr.a (mgr.14388) 9163 : cluster [DBG] pgmap v6352: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:11 smithi163 bash[24253]: cluster 2024-08-31T05:43:11.591691+0000 mgr.a (mgr.14388) 9164 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:11 smithi027 bash[22610]: cluster 2024-08-31T05:43:11.591691+0000 mgr.a (mgr.14388) 9164 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:11 smithi191 bash[24992]: cluster 2024-08-31T05:43:11.591691+0000 mgr.a (mgr.14388) 9164 : cluster [DBG] pgmap v6353: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:12.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:12.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:12.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:13.376 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:13.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:13.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:13.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:13.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:13 smithi163 bash[24253]: audit 2024-08-31T05:43:12.956432+0000 mgr.a (mgr.14388) 9165 : audit [DBG] from='client.204321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:13 smithi163 bash[24253]: cluster 2024-08-31T05:43:13.594473+0000 mgr.a (mgr.14388) 9166 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:13 smithi027 bash[22610]: audit 2024-08-31T05:43:12.956432+0000 mgr.a (mgr.14388) 9165 : audit [DBG] from='client.204321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:13 smithi027 bash[22610]: cluster 2024-08-31T05:43:13.594473+0000 mgr.a (mgr.14388) 9166 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:13 smithi191 bash[24992]: audit 2024-08-31T05:43:12.956432+0000 mgr.a (mgr.14388) 9165 : audit [DBG] from='client.204321 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:13 smithi191 bash[24992]: cluster 2024-08-31T05:43:13.594473+0000 mgr.a (mgr.14388) 9166 : cluster [DBG] pgmap v6354: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:14 smithi163 bash[24253]: audit 2024-08-31T05:43:14.806304+0000 mon.a (mon.0) 1950 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:43:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:14 smithi027 bash[22610]: audit 2024-08-31T05:43:14.806304+0000 mon.a (mon.0) 1950 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:43:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:14 smithi191 bash[24992]: audit 2024-08-31T05:43:14.806304+0000 mon.a (mon.0) 1950 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:43:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:15 smithi163 bash[24253]: cluster 2024-08-31T05:43:15.595274+0000 mgr.a (mgr.14388) 9167 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:16.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:15 smithi027 bash[22610]: cluster 2024-08-31T05:43:15.595274+0000 mgr.a (mgr.14388) 9167 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:15 smithi191 bash[24992]: cluster 2024-08-31T05:43:15.595274+0000 mgr.a (mgr.14388) 9167 : cluster [DBG] pgmap v6355: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:17 smithi163 bash[24253]: cluster 2024-08-31T05:43:17.596038+0000 mgr.a (mgr.14388) 9168 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:43:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:17 smithi027 bash[22610]: cluster 2024-08-31T05:43:17.596038+0000 mgr.a (mgr.14388) 9168 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:43:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:17 smithi191 bash[24992]: cluster 2024-08-31T05:43:17.596038+0000 mgr.a (mgr.14388) 9168 : cluster [DBG] pgmap v6356: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:43:18.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:18.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:18.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:19.181 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:19.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:19.182 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:19.182 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:19.182 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:19 smithi163 bash[24253]: audit 2024-08-31T05:43:18.729966+0000 mgr.a (mgr.14388) 9169 : audit [DBG] from='client.65378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:19 smithi163 bash[24253]: cluster 2024-08-31T05:43:19.598794+0000 mgr.a (mgr.14388) 9170 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:19 smithi027 bash[22610]: audit 2024-08-31T05:43:18.729966+0000 mgr.a (mgr.14388) 9169 : audit [DBG] from='client.65378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:19 smithi027 bash[22610]: cluster 2024-08-31T05:43:19.598794+0000 mgr.a (mgr.14388) 9170 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:19 smithi191 bash[24992]: audit 2024-08-31T05:43:18.729966+0000 mgr.a (mgr.14388) 9169 : audit [DBG] from='client.65378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:19 smithi191 bash[24992]: cluster 2024-08-31T05:43:19.598794+0000 mgr.a (mgr.14388) 9170 : cluster [DBG] pgmap v6357: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:21.933 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:21 smithi163 bash[24253]: cluster 2024-08-31T05:43:21.599524+0000 mgr.a (mgr.14388) 9171 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:21 smithi027 bash[22610]: cluster 2024-08-31T05:43:21.599524+0000 mgr.a (mgr.14388) 9171 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:21 smithi191 bash[24992]: cluster 2024-08-31T05:43:21.599524+0000 mgr.a (mgr.14388) 9171 : cluster [DBG] pgmap v6358: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:23 smithi191 bash[24992]: cluster 2024-08-31T05:43:23.601487+0000 mgr.a (mgr.14388) 9172 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:23 smithi163 bash[24253]: cluster 2024-08-31T05:43:23.601487+0000 mgr.a (mgr.14388) 9172 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:23 smithi027 bash[22610]: cluster 2024-08-31T05:43:23.601487+0000 mgr.a (mgr.14388) 9172 : cluster [DBG] pgmap v6359: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:24.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:24.183 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:24.184 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:24 smithi191 bash[24992]: audit 2024-08-31T05:43:24.519067+0000 mgr.a (mgr.14388) 9173 : audit [DBG] from='client.204471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:24.944 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:24.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:24.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:24.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:24.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:24 smithi163 bash[24253]: audit 2024-08-31T05:43:24.519067+0000 mgr.a (mgr.14388) 9173 : audit [DBG] from='client.204471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:24 smithi027 bash[22610]: audit 2024-08-31T05:43:24.519067+0000 mgr.a (mgr.14388) 9173 : audit [DBG] from='client.204471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:26.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22863]: debug 2024-08-31T05:43:26.406+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:43:26.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22863]: debug 2024-08-31T05:43:26.406+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:43:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22610]: audit 2024-08-31T05:43:25.234804+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22610]: audit 2024-08-31T05:43:25.242676+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22610]: cluster 2024-08-31T05:43:25.602326+0000 mgr.a (mgr.14388) 9174 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22610]: audit 2024-08-31T05:43:25.647107+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22610]: audit 2024-08-31T05:43:25.655507+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22610]: audit 2024-08-31T05:43:25.657618+0000 mon.a (mon.0) 1955 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:43:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22610]: audit 2024-08-31T05:43:25.659624+0000 mon.a (mon.0) 1956 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:43:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22610]: audit 2024-08-31T05:43:25.670560+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:26 smithi027 bash[22610]: audit 2024-08-31T05:43:25.675807+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:43:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:26 smithi191 bash[24992]: audit 2024-08-31T05:43:25.234804+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:26 smithi191 bash[24992]: audit 2024-08-31T05:43:25.242676+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:26 smithi191 bash[24992]: cluster 2024-08-31T05:43:25.602326+0000 mgr.a (mgr.14388) 9174 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:26 smithi191 bash[24992]: audit 2024-08-31T05:43:25.647107+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:26 smithi191 bash[24992]: audit 2024-08-31T05:43:25.655507+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:26 smithi191 bash[24992]: audit 2024-08-31T05:43:25.657618+0000 mon.a (mon.0) 1955 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:43:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:26 smithi191 bash[24992]: audit 2024-08-31T05:43:25.659624+0000 mon.a (mon.0) 1956 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:43:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:26 smithi191 bash[24992]: audit 2024-08-31T05:43:25.670560+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:26 smithi191 bash[24992]: audit 2024-08-31T05:43:25.675807+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:43:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:26 smithi163 bash[24253]: audit 2024-08-31T05:43:25.234804+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:27.248 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:26 smithi163 bash[24253]: audit 2024-08-31T05:43:25.242676+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:27.248 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:26 smithi163 bash[24253]: cluster 2024-08-31T05:43:25.602326+0000 mgr.a (mgr.14388) 9174 : cluster [DBG] pgmap v6360: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:27.249 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:26 smithi163 bash[24253]: audit 2024-08-31T05:43:25.647107+0000 mon.a (mon.0) 1953 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:27.249 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:26 smithi163 bash[24253]: audit 2024-08-31T05:43:25.655507+0000 mon.a (mon.0) 1954 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:27.249 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:26 smithi163 bash[24253]: audit 2024-08-31T05:43:25.657618+0000 mon.a (mon.0) 1955 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:43:27.249 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:26 smithi163 bash[24253]: audit 2024-08-31T05:43:25.659624+0000 mon.a (mon.0) 1956 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:43:27.249 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:26 smithi163 bash[24253]: audit 2024-08-31T05:43:25.670560+0000 mon.a (mon.0) 1957 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:43:27.249 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:26 smithi163 bash[24253]: audit 2024-08-31T05:43:25.675807+0000 mon.a (mon.0) 1958 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:43:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:27 smithi191 bash[24992]: audit 2024-08-31T05:43:25.678371+0000 mgr.a (mgr.14388) 9175 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:43:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:27 smithi191 bash[24992]: audit 2024-08-31T05:43:26.408579+0000 mgr.a (mgr.14388) 9176 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:43:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:27 smithi191 bash[24992]: cephadm 2024-08-31T05:43:26.409766+0000 mgr.a (mgr.14388) 9177 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:43:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:27 smithi163 bash[24253]: audit 2024-08-31T05:43:25.678371+0000 mgr.a (mgr.14388) 9175 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:43:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:27 smithi163 bash[24253]: audit 2024-08-31T05:43:26.408579+0000 mgr.a (mgr.14388) 9176 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:43:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:27 smithi163 bash[24253]: cephadm 2024-08-31T05:43:26.409766+0000 mgr.a (mgr.14388) 9177 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:43:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:27 smithi027 bash[22610]: audit 2024-08-31T05:43:25.678371+0000 mgr.a (mgr.14388) 9175 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:43:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:27 smithi027 bash[22610]: audit 2024-08-31T05:43:26.408579+0000 mgr.a (mgr.14388) 9176 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:43:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:27 smithi027 bash[22610]: cephadm 2024-08-31T05:43:26.409766+0000 mgr.a (mgr.14388) 9177 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:43:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:28 smithi191 bash[24992]: cluster 2024-08-31T05:43:27.603381+0000 mgr.a (mgr.14388) 9178 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:28 smithi163 bash[24253]: cluster 2024-08-31T05:43:27.603381+0000 mgr.a (mgr.14388) 9178 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:28.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:28 smithi027 bash[22610]: cluster 2024-08-31T05:43:27.603381+0000 mgr.a (mgr.14388) 9178 : cluster [DBG] pgmap v6361: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:29.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:29.946 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:29.946 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:29 smithi163 bash[24253]: cluster 2024-08-31T05:43:29.605737+0000 mgr.a (mgr.14388) 9179 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:29 smithi027 bash[22610]: cluster 2024-08-31T05:43:29.605737+0000 mgr.a (mgr.14388) 9179 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:29 smithi191 bash[24992]: cluster 2024-08-31T05:43:29.605737+0000 mgr.a (mgr.14388) 9179 : cluster [DBG] pgmap v6362: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:30.725 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:30.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:30.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:30.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:30.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:30 smithi163 bash[24253]: audit 2024-08-31T05:43:30.285772+0000 mgr.a (mgr.14388) 9180 : audit [DBG] from='client.204651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:30 smithi027 bash[22610]: audit 2024-08-31T05:43:30.285772+0000 mgr.a (mgr.14388) 9180 : audit [DBG] from='client.204651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:30 smithi191 bash[24992]: audit 2024-08-31T05:43:30.285772+0000 mgr.a (mgr.14388) 9180 : audit [DBG] from='client.204651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:31 smithi163 bash[24253]: cluster 2024-08-31T05:43:31.606654+0000 mgr.a (mgr.14388) 9181 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:31 smithi027 bash[22610]: cluster 2024-08-31T05:43:31.606654+0000 mgr.a (mgr.14388) 9181 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:31 smithi191 bash[24992]: cluster 2024-08-31T05:43:31.606654+0000 mgr.a (mgr.14388) 9181 : cluster [DBG] pgmap v6363: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:33 smithi163 bash[24253]: cluster 2024-08-31T05:43:33.608838+0000 mgr.a (mgr.14388) 9182 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:33 smithi027 bash[22610]: cluster 2024-08-31T05:43:33.608838+0000 mgr.a (mgr.14388) 9182 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:33 smithi191 bash[24992]: cluster 2024-08-31T05:43:33.608838+0000 mgr.a (mgr.14388) 9182 : cluster [DBG] pgmap v6364: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:35.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:36.099 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:35 smithi191 bash[24992]: cluster 2024-08-31T05:43:35.609562+0000 mgr.a (mgr.14388) 9183 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:36.100 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:35 smithi163 bash[24253]: cluster 2024-08-31T05:43:35.609562+0000 mgr.a (mgr.14388) 9183 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:36.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:36.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:36.100 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:35 smithi027 bash[22610]: cluster 2024-08-31T05:43:35.609562+0000 mgr.a (mgr.14388) 9183 : cluster [DBG] pgmap v6365: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:36.476 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:36.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:36.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:36.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:36.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:36.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:36 smithi163 bash[24253]: audit 2024-08-31T05:43:36.060976+0000 mgr.a (mgr.14388) 9184 : audit [DBG] from='client.204729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:36 smithi027 bash[22610]: audit 2024-08-31T05:43:36.060976+0000 mgr.a (mgr.14388) 9184 : audit [DBG] from='client.204729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:36 smithi191 bash[24992]: audit 2024-08-31T05:43:36.060976+0000 mgr.a (mgr.14388) 9184 : audit [DBG] from='client.204729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:37 smithi163 bash[24253]: cluster 2024-08-31T05:43:37.610459+0000 mgr.a (mgr.14388) 9185 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:37 smithi027 bash[22610]: cluster 2024-08-31T05:43:37.610459+0000 mgr.a (mgr.14388) 9185 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:37 smithi191 bash[24992]: cluster 2024-08-31T05:43:37.610459+0000 mgr.a (mgr.14388) 9185 : cluster [DBG] pgmap v6366: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:39.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:39 smithi163 bash[24253]: cluster 2024-08-31T05:43:39.612668+0000 mgr.a (mgr.14388) 9186 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:39.989 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:39 smithi027 bash[22610]: cluster 2024-08-31T05:43:39.612668+0000 mgr.a (mgr.14388) 9186 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:40.051 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:39 smithi191 bash[24992]: cluster 2024-08-31T05:43:39.612668+0000 mgr.a (mgr.14388) 9186 : cluster [DBG] pgmap v6367: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:43:41.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:41.478 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:41.478 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:41 smithi163 bash[24253]: cluster 2024-08-31T05:43:41.613206+0000 mgr.a (mgr.14388) 9187 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:41 smithi027 bash[22610]: cluster 2024-08-31T05:43:41.613206+0000 mgr.a (mgr.14388) 9187 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:41 smithi191 bash[24992]: cluster 2024-08-31T05:43:41.613206+0000 mgr.a (mgr.14388) 9187 : cluster [DBG] pgmap v6368: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:42.261 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:42.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:42.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:42.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:42.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:42 smithi163 bash[24253]: audit 2024-08-31T05:43:41.819145+0000 mgr.a (mgr.14388) 9188 : audit [DBG] from='client.204804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:42 smithi027 bash[22610]: audit 2024-08-31T05:43:41.819145+0000 mgr.a (mgr.14388) 9188 : audit [DBG] from='client.204804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:42 smithi191 bash[24992]: audit 2024-08-31T05:43:41.819145+0000 mgr.a (mgr.14388) 9188 : audit [DBG] from='client.204804 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:43 smithi163 bash[24253]: cluster 2024-08-31T05:43:43.615518+0000 mgr.a (mgr.14388) 9189 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:43 smithi027 bash[22610]: cluster 2024-08-31T05:43:43.615518+0000 mgr.a (mgr.14388) 9189 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:43 smithi191 bash[24992]: cluster 2024-08-31T05:43:43.615518+0000 mgr.a (mgr.14388) 9189 : cluster [DBG] pgmap v6369: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:43:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:45 smithi163 bash[24253]: cluster 2024-08-31T05:43:45.616288+0000 mgr.a (mgr.14388) 9190 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:45 smithi027 bash[22610]: cluster 2024-08-31T05:43:45.616288+0000 mgr.a (mgr.14388) 9190 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:45 smithi191 bash[24992]: cluster 2024-08-31T05:43:45.616288+0000 mgr.a (mgr.14388) 9190 : cluster [DBG] pgmap v6370: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:47.263 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:47.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:47.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:47 smithi163 bash[24253]: audit 2024-08-31T05:43:47.606059+0000 mgr.a (mgr.14388) 9191 : audit [DBG] from='client.204879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:47 smithi163 bash[24253]: cluster 2024-08-31T05:43:47.623177+0000 mgr.a (mgr.14388) 9192 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:47 smithi027 bash[22610]: audit 2024-08-31T05:43:47.606059+0000 mgr.a (mgr.14388) 9191 : audit [DBG] from='client.204879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:47 smithi027 bash[22610]: cluster 2024-08-31T05:43:47.623177+0000 mgr.a (mgr.14388) 9192 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:47 smithi191 bash[24992]: audit 2024-08-31T05:43:47.606059+0000 mgr.a (mgr.14388) 9191 : audit [DBG] from='client.204879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:47 smithi191 bash[24992]: cluster 2024-08-31T05:43:47.623177+0000 mgr.a (mgr.14388) 9192 : cluster [DBG] pgmap v6371: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:48.054 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:48.054 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:48.054 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:48.054 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:48.054 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:49 smithi163 bash[24253]: cluster 2024-08-31T05:43:49.625804+0000 mgr.a (mgr.14388) 9193 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:43:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:49 smithi027 bash[22610]: cluster 2024-08-31T05:43:49.625804+0000 mgr.a (mgr.14388) 9193 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:43:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:49 smithi191 bash[24992]: cluster 2024-08-31T05:43:49.625804+0000 mgr.a (mgr.14388) 9193 : cluster [DBG] pgmap v6372: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:43:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:51 smithi163 bash[24253]: cluster 2024-08-31T05:43:51.626602+0000 mgr.a (mgr.14388) 9194 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:43:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:51 smithi027 bash[22610]: cluster 2024-08-31T05:43:51.626602+0000 mgr.a (mgr.14388) 9194 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:43:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:51 smithi191 bash[24992]: cluster 2024-08-31T05:43:51.626602+0000 mgr.a (mgr.14388) 9194 : cluster [DBG] pgmap v6373: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:43:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:53.056 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:53.056 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:53.840 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:53.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:53.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:53.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:53.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:53 smithi163 bash[24253]: audit 2024-08-31T05:43:53.395384+0000 mgr.a (mgr.14388) 9195 : audit [DBG] from='client.204957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:53 smithi163 bash[24253]: cluster 2024-08-31T05:43:53.632946+0000 mgr.a (mgr.14388) 9196 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:53 smithi027 bash[22610]: audit 2024-08-31T05:43:53.395384+0000 mgr.a (mgr.14388) 9195 : audit [DBG] from='client.204957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:53 smithi027 bash[22610]: cluster 2024-08-31T05:43:53.632946+0000 mgr.a (mgr.14388) 9196 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:53 smithi191 bash[24992]: audit 2024-08-31T05:43:53.395384+0000 mgr.a (mgr.14388) 9195 : audit [DBG] from='client.204957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:43:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:53 smithi191 bash[24992]: cluster 2024-08-31T05:43:53.632946+0000 mgr.a (mgr.14388) 9196 : cluster [DBG] pgmap v6374: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:43:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:56 smithi163 bash[24253]: cluster 2024-08-31T05:43:55.633947+0000 mgr.a (mgr.14388) 9197 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:56 smithi027 bash[22610]: cluster 2024-08-31T05:43:55.633947+0000 mgr.a (mgr.14388) 9197 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:56 smithi191 bash[24992]: cluster 2024-08-31T05:43:55.633947+0000 mgr.a (mgr.14388) 9197 : cluster [DBG] pgmap v6375: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:58.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:43:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:43:58.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:43:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:58 smithi163 bash[24253]: cluster 2024-08-31T05:43:57.634799+0000 mgr.a (mgr.14388) 9198 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:58 smithi027 bash[22610]: cluster 2024-08-31T05:43:57.634799+0000 mgr.a (mgr.14388) 9198 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:58 smithi191 bash[24992]: cluster 2024-08-31T05:43:57.634799+0000 mgr.a (mgr.14388) 9198 : cluster [DBG] pgmap v6376: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:43:59.593 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:43:59.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:43:59.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:43:59.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:43:59.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:43:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:43:59 smithi027 bash[22610]: audit 2024-08-31T05:43:59.177585+0000 mgr.a (mgr.14388) 9199 : audit [DBG] from='client.205035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:43:59 smithi191 bash[24992]: audit 2024-08-31T05:43:59.177585+0000 mgr.a (mgr.14388) 9199 : audit [DBG] from='client.205035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:43:59 smithi163 bash[24253]: audit 2024-08-31T05:43:59.177585+0000 mgr.a (mgr.14388) 9199 : audit [DBG] from='client.205035 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:00 smithi027 bash[22610]: cluster 2024-08-31T05:43:59.636020+0000 mgr.a (mgr.14388) 9200 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:00 smithi191 bash[24992]: cluster 2024-08-31T05:43:59.636020+0000 mgr.a (mgr.14388) 9200 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:00 smithi163 bash[24253]: cluster 2024-08-31T05:43:59.636020+0000 mgr.a (mgr.14388) 9200 : cluster [DBG] pgmap v6377: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:02 smithi027 bash[22610]: cluster 2024-08-31T05:44:01.636764+0000 mgr.a (mgr.14388) 9201 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:44:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:02 smithi191 bash[24992]: cluster 2024-08-31T05:44:01.636764+0000 mgr.a (mgr.14388) 9201 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:44:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:02 smithi163 bash[24253]: cluster 2024-08-31T05:44:01.636764+0000 mgr.a (mgr.14388) 9201 : cluster [DBG] pgmap v6378: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:44:04.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:44:04.596 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:44:04.596 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:44:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:04 smithi027 bash[22610]: cluster 2024-08-31T05:44:03.638683+0000 mgr.a (mgr.14388) 9202 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:44:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:04 smithi191 bash[24992]: cluster 2024-08-31T05:44:03.638683+0000 mgr.a (mgr.14388) 9202 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:44:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:04 smithi163 bash[24253]: cluster 2024-08-31T05:44:03.638683+0000 mgr.a (mgr.14388) 9202 : cluster [DBG] pgmap v6379: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:44:05.336 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:44:05.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:44:05.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:44:05.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:44:05.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:44:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:05 smithi027 bash[22610]: audit 2024-08-31T05:44:04.927969+0000 mgr.a (mgr.14388) 9203 : audit [DBG] from='client.205113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:05 smithi191 bash[24992]: audit 2024-08-31T05:44:04.927969+0000 mgr.a (mgr.14388) 9203 : audit [DBG] from='client.205113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:05 smithi163 bash[24253]: audit 2024-08-31T05:44:04.927969+0000 mgr.a (mgr.14388) 9203 : audit [DBG] from='client.205113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:06 smithi027 bash[22610]: cluster 2024-08-31T05:44:05.639631+0000 mgr.a (mgr.14388) 9204 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:06 smithi191 bash[24992]: cluster 2024-08-31T05:44:05.639631+0000 mgr.a (mgr.14388) 9204 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:06 smithi163 bash[24253]: cluster 2024-08-31T05:44:05.639631+0000 mgr.a (mgr.14388) 9204 : cluster [DBG] pgmap v6380: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:08 smithi027 bash[22610]: cluster 2024-08-31T05:44:07.640413+0000 mgr.a (mgr.14388) 9205 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:08 smithi191 bash[24992]: cluster 2024-08-31T05:44:07.640413+0000 mgr.a (mgr.14388) 9205 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:08 smithi163 bash[24253]: cluster 2024-08-31T05:44:07.640413+0000 mgr.a (mgr.14388) 9205 : cluster [DBG] pgmap v6381: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:10.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:44:10.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:44:10.339 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:44:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:10 smithi027 bash[22610]: cluster 2024-08-31T05:44:09.642677+0000 mgr.a (mgr.14388) 9206 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:11.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:10 smithi191 bash[24992]: cluster 2024-08-31T05:44:09.642677+0000 mgr.a (mgr.14388) 9206 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:11.109 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:44:11.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:44:11.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:44:11.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:44:11.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:44:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:10 smithi163 bash[24253]: cluster 2024-08-31T05:44:09.642677+0000 mgr.a (mgr.14388) 9206 : cluster [DBG] pgmap v6382: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:11 smithi191 bash[24992]: audit 2024-08-31T05:44:10.677669+0000 mgr.a (mgr.14388) 9207 : audit [DBG] from='client.205188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:11 smithi163 bash[24253]: audit 2024-08-31T05:44:10.677669+0000 mgr.a (mgr.14388) 9207 : audit [DBG] from='client.205188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:11 smithi027 bash[22610]: audit 2024-08-31T05:44:10.677669+0000 mgr.a (mgr.14388) 9207 : audit [DBG] from='client.205188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:12 smithi191 bash[24992]: cluster 2024-08-31T05:44:11.643631+0000 mgr.a (mgr.14388) 9208 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:12 smithi163 bash[24253]: cluster 2024-08-31T05:44:11.643631+0000 mgr.a (mgr.14388) 9208 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:13.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:12 smithi027 bash[22610]: cluster 2024-08-31T05:44:11.643631+0000 mgr.a (mgr.14388) 9208 : cluster [DBG] pgmap v6383: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:14 smithi191 bash[24992]: cluster 2024-08-31T05:44:13.645791+0000 mgr.a (mgr.14388) 9209 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:14 smithi163 bash[24253]: cluster 2024-08-31T05:44:13.645791+0000 mgr.a (mgr.14388) 9209 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:14 smithi027 bash[22610]: cluster 2024-08-31T05:44:13.645791+0000 mgr.a (mgr.14388) 9209 : cluster [DBG] pgmap v6384: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:16.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:44:16.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:44:16.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:44:16.857 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:44:16.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:44:16.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:44:16.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:44:16.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:44:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:16 smithi191 bash[24992]: cluster 2024-08-31T05:44:15.646547+0000 mgr.a (mgr.14388) 9210 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:16 smithi191 bash[24992]: audit 2024-08-31T05:44:16.435283+0000 mgr.a (mgr.14388) 9211 : audit [DBG] from='client.205266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:16 smithi163 bash[24253]: cluster 2024-08-31T05:44:15.646547+0000 mgr.a (mgr.14388) 9210 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:16 smithi163 bash[24253]: audit 2024-08-31T05:44:16.435283+0000 mgr.a (mgr.14388) 9211 : audit [DBG] from='client.205266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:16 smithi027 bash[22610]: cluster 2024-08-31T05:44:15.646547+0000 mgr.a (mgr.14388) 9210 : cluster [DBG] pgmap v6385: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:16 smithi027 bash[22610]: audit 2024-08-31T05:44:16.435283+0000 mgr.a (mgr.14388) 9211 : audit [DBG] from='client.205266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:18 smithi191 bash[24992]: cluster 2024-08-31T05:44:17.647515+0000 mgr.a (mgr.14388) 9212 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:18 smithi163 bash[24253]: cluster 2024-08-31T05:44:17.647515+0000 mgr.a (mgr.14388) 9212 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:18 smithi027 bash[22610]: cluster 2024-08-31T05:44:17.647515+0000 mgr.a (mgr.14388) 9212 : cluster [DBG] pgmap v6386: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:20 smithi191 bash[24992]: cluster 2024-08-31T05:44:19.649770+0000 mgr.a (mgr.14388) 9213 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:21.206 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:20 smithi163 bash[24253]: cluster 2024-08-31T05:44:19.649770+0000 mgr.a (mgr.14388) 9213 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:21.238 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:20 smithi027 bash[22610]: cluster 2024-08-31T05:44:19.649770+0000 mgr.a (mgr.14388) 9213 : cluster [DBG] pgmap v6387: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:21.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:44:21.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:44:21.860 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:44:22.620 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:44:22.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:44:22.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:44:22.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:44:22.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:44:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:22 smithi191 bash[24992]: cluster 2024-08-31T05:44:21.650593+0000 mgr.a (mgr.14388) 9214 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:22 smithi191 bash[24992]: audit 2024-08-31T05:44:22.189916+0000 mgr.a (mgr.14388) 9215 : audit [DBG] from='client.205338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:22 smithi163 bash[24253]: cluster 2024-08-31T05:44:21.650593+0000 mgr.a (mgr.14388) 9214 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:22 smithi163 bash[24253]: audit 2024-08-31T05:44:22.189916+0000 mgr.a (mgr.14388) 9215 : audit [DBG] from='client.205338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:23.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:22 smithi027 bash[22610]: cluster 2024-08-31T05:44:21.650593+0000 mgr.a (mgr.14388) 9214 : cluster [DBG] pgmap v6388: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:22 smithi027 bash[22610]: audit 2024-08-31T05:44:22.189916+0000 mgr.a (mgr.14388) 9215 : audit [DBG] from='client.205338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:24 smithi191 bash[24992]: cluster 2024-08-31T05:44:23.653075+0000 mgr.a (mgr.14388) 9216 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:24 smithi163 bash[24253]: cluster 2024-08-31T05:44:23.653075+0000 mgr.a (mgr.14388) 9216 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:24 smithi027 bash[22610]: cluster 2024-08-31T05:44:23.653075+0000 mgr.a (mgr.14388) 9216 : cluster [DBG] pgmap v6389: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:26 smithi191 bash[24992]: cluster 2024-08-31T05:44:25.653837+0000 mgr.a (mgr.14388) 9217 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:27.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:26 smithi191 bash[24992]: audit 2024-08-31T05:44:26.467315+0000 mon.a (mon.0) 1959 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:44:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:26 smithi163 bash[24253]: cluster 2024-08-31T05:44:25.653837+0000 mgr.a (mgr.14388) 9217 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:26 smithi163 bash[24253]: audit 2024-08-31T05:44:26.467315+0000 mon.a (mon.0) 1959 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:44:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:26 smithi027 bash[22610]: cluster 2024-08-31T05:44:25.653837+0000 mgr.a (mgr.14388) 9217 : cluster [DBG] pgmap v6390: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:26 smithi027 bash[22610]: audit 2024-08-31T05:44:26.467315+0000 mon.a (mon.0) 1959 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:44:28.037 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:27 smithi027 bash[22610]: audit 2024-08-31T05:44:27.296703+0000 mon.a (mon.0) 1960 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:44:28.037 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:27 smithi027 bash[22610]: audit 2024-08-31T05:44:27.298223+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:44:28.037 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:27 smithi027 bash[22610]: audit 2024-08-31T05:44:27.305867+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:44:28.037 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:27 smithi027 bash[22610]: audit 2024-08-31T05:44:27.310633+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:44:28.038 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:27 smithi027 bash[22610]: audit 2024-08-31T05:44:27.312817+0000 mgr.a (mgr.14388) 9218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:44:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:27 smithi191 bash[24992]: audit 2024-08-31T05:44:27.296703+0000 mon.a (mon.0) 1960 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:44:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:27 smithi191 bash[24992]: audit 2024-08-31T05:44:27.298223+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:44:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:27 smithi191 bash[24992]: audit 2024-08-31T05:44:27.305867+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:44:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:27 smithi191 bash[24992]: audit 2024-08-31T05:44:27.310633+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:44:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:27 smithi191 bash[24992]: audit 2024-08-31T05:44:27.312817+0000 mgr.a (mgr.14388) 9218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:44:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:27 smithi163 bash[24253]: audit 2024-08-31T05:44:27.296703+0000 mon.a (mon.0) 1960 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:44:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:27 smithi163 bash[24253]: audit 2024-08-31T05:44:27.298223+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:44:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:27 smithi163 bash[24253]: audit 2024-08-31T05:44:27.305867+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:44:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:27 smithi163 bash[24253]: audit 2024-08-31T05:44:27.310633+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:44:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:27 smithi163 bash[24253]: audit 2024-08-31T05:44:27.312817+0000 mgr.a (mgr.14388) 9218 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:44:28.439 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:44:28.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:44:28.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:44:28.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:44:28.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:44:28.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:44:28 smithi027 bash[22863]: debug 2024-08-31T05:44:28.033+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:44:28.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:44:28 smithi027 bash[22863]: debug 2024-08-31T05:44:28.045+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:44:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:29 smithi163 bash[24253]: cluster 2024-08-31T05:44:27.654393+0000 mgr.a (mgr.14388) 9219 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:29 smithi163 bash[24253]: audit 2024-08-31T05:44:27.947928+0000 mgr.a (mgr.14388) 9220 : audit [DBG] from='client.205482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:29 smithi163 bash[24253]: audit 2024-08-31T05:44:28.037820+0000 mgr.a (mgr.14388) 9221 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:44:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:29 smithi163 bash[24253]: cephadm 2024-08-31T05:44:28.048389+0000 mgr.a (mgr.14388) 9222 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:44:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:29 smithi027 bash[22610]: cluster 2024-08-31T05:44:27.654393+0000 mgr.a (mgr.14388) 9219 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:29 smithi027 bash[22610]: audit 2024-08-31T05:44:27.947928+0000 mgr.a (mgr.14388) 9220 : audit [DBG] from='client.205482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:29 smithi027 bash[22610]: audit 2024-08-31T05:44:28.037820+0000 mgr.a (mgr.14388) 9221 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:44:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:29 smithi027 bash[22610]: cephadm 2024-08-31T05:44:28.048389+0000 mgr.a (mgr.14388) 9222 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:44:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:29 smithi191 bash[24992]: cluster 2024-08-31T05:44:27.654393+0000 mgr.a (mgr.14388) 9219 : cluster [DBG] pgmap v6391: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:29.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:29 smithi191 bash[24992]: audit 2024-08-31T05:44:27.947928+0000 mgr.a (mgr.14388) 9220 : audit [DBG] from='client.205482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:29.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:29 smithi191 bash[24992]: audit 2024-08-31T05:44:28.037820+0000 mgr.a (mgr.14388) 9221 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:44:29.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:29 smithi191 bash[24992]: cephadm 2024-08-31T05:44:28.048389+0000 mgr.a (mgr.14388) 9222 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:44:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:31 smithi163 bash[24253]: cluster 2024-08-31T05:44:29.657182+0000 mgr.a (mgr.14388) 9223 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T05:44:31.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:31 smithi027 bash[22610]: cluster 2024-08-31T05:44:29.657182+0000 mgr.a (mgr.14388) 9223 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T05:44:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:31 smithi191 bash[24992]: cluster 2024-08-31T05:44:29.657182+0000 mgr.a (mgr.14388) 9223 : cluster [DBG] pgmap v6392: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T05:44:33.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:44:33.441 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:44:33.441 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:44:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:33 smithi163 bash[24253]: cluster 2024-08-31T05:44:31.657972+0000 mgr.a (mgr.14388) 9224 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:44:33.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:33 smithi027 bash[22610]: cluster 2024-08-31T05:44:31.657972+0000 mgr.a (mgr.14388) 9224 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:44:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:33 smithi191 bash[24992]: cluster 2024-08-31T05:44:31.657972+0000 mgr.a (mgr.14388) 9224 : cluster [DBG] pgmap v6393: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T05:44:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:44:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:44:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:44:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:44:34.202 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:44:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:35 smithi163 bash[24253]: cluster 2024-08-31T05:44:33.659915+0000 mgr.a (mgr.14388) 9225 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:44:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:35 smithi163 bash[24253]: audit 2024-08-31T05:44:33.775337+0000 mgr.a (mgr.14388) 9226 : audit [DBG] from='client.205596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:35 smithi027 bash[22610]: cluster 2024-08-31T05:44:33.659915+0000 mgr.a (mgr.14388) 9225 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:44:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:35 smithi027 bash[22610]: audit 2024-08-31T05:44:33.775337+0000 mgr.a (mgr.14388) 9226 : audit [DBG] from='client.205596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:35 smithi191 bash[24992]: cluster 2024-08-31T05:44:33.659915+0000 mgr.a (mgr.14388) 9225 : cluster [DBG] pgmap v6394: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:44:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:35 smithi191 bash[24992]: audit 2024-08-31T05:44:33.775337+0000 mgr.a (mgr.14388) 9226 : audit [DBG] from='client.205596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:37 smithi163 bash[24253]: cluster 2024-08-31T05:44:35.660852+0000 mgr.a (mgr.14388) 9227 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:44:37.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:37 smithi027 bash[22610]: cluster 2024-08-31T05:44:35.660852+0000 mgr.a (mgr.14388) 9227 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:44:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:37 smithi191 bash[24992]: cluster 2024-08-31T05:44:35.660852+0000 mgr.a (mgr.14388) 9227 : cluster [DBG] pgmap v6395: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:44:39.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:44:39.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:44:39.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:44:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:39 smithi163 bash[24253]: cluster 2024-08-31T05:44:37.661660+0000 mgr.a (mgr.14388) 9228 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:44:39.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:39 smithi027 bash[22610]: cluster 2024-08-31T05:44:37.661660+0000 mgr.a (mgr.14388) 9228 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:44:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:39 smithi191 bash[24992]: cluster 2024-08-31T05:44:37.661660+0000 mgr.a (mgr.14388) 9228 : cluster [DBG] pgmap v6396: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:44:39.976 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:44:39.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:44:39.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:44:39.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:44:39.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:44:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:40 smithi163 bash[24253]: audit 2024-08-31T05:44:39.540654+0000 mgr.a (mgr.14388) 9229 : audit [DBG] from='client.205674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:40 smithi027 bash[22610]: audit 2024-08-31T05:44:39.540654+0000 mgr.a (mgr.14388) 9229 : audit [DBG] from='client.205674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:40 smithi191 bash[24992]: audit 2024-08-31T05:44:39.540654+0000 mgr.a (mgr.14388) 9229 : audit [DBG] from='client.205674 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:41 smithi163 bash[24253]: cluster 2024-08-31T05:44:39.663131+0000 mgr.a (mgr.14388) 9230 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:44:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:41 smithi027 bash[22610]: cluster 2024-08-31T05:44:39.663131+0000 mgr.a (mgr.14388) 9230 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:44:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:41 smithi191 bash[24992]: cluster 2024-08-31T05:44:39.663131+0000 mgr.a (mgr.14388) 9230 : cluster [DBG] pgmap v6397: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:44:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:43 smithi163 bash[24253]: cluster 2024-08-31T05:44:41.663991+0000 mgr.a (mgr.14388) 9231 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T05:44:43.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:43 smithi027 bash[22610]: cluster 2024-08-31T05:44:41.663991+0000 mgr.a (mgr.14388) 9231 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T05:44:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:43 smithi191 bash[24992]: cluster 2024-08-31T05:44:41.663991+0000 mgr.a (mgr.14388) 9231 : cluster [DBG] pgmap v6398: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T05:44:44.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:44:44.978 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:44:44.979 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:44:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:45 smithi163 bash[24253]: cluster 2024-08-31T05:44:43.666228+0000 mgr.a (mgr.14388) 9232 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:44:45.718 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:44:45.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:44:45.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:44:45.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:44:45.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:44:45.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:45 smithi027 bash[22610]: cluster 2024-08-31T05:44:43.666228+0000 mgr.a (mgr.14388) 9232 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:44:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:45 smithi191 bash[24992]: cluster 2024-08-31T05:44:43.666228+0000 mgr.a (mgr.14388) 9232 : cluster [DBG] pgmap v6399: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:44:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:46 smithi163 bash[24253]: audit 2024-08-31T05:44:45.305505+0000 mgr.a (mgr.14388) 9233 : audit [DBG] from='client.205746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:46 smithi027 bash[22610]: audit 2024-08-31T05:44:45.305505+0000 mgr.a (mgr.14388) 9233 : audit [DBG] from='client.205746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:46 smithi191 bash[24992]: audit 2024-08-31T05:44:45.305505+0000 mgr.a (mgr.14388) 9233 : audit [DBG] from='client.205746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:47 smithi163 bash[24253]: cluster 2024-08-31T05:44:45.666733+0000 mgr.a (mgr.14388) 9234 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:47 smithi027 bash[22610]: cluster 2024-08-31T05:44:45.666733+0000 mgr.a (mgr.14388) 9234 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:47 smithi191 bash[24992]: cluster 2024-08-31T05:44:45.666733+0000 mgr.a (mgr.14388) 9234 : cluster [DBG] pgmap v6400: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:49 smithi163 bash[24253]: cluster 2024-08-31T05:44:47.667460+0000 mgr.a (mgr.14388) 9235 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:49.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:49 smithi027 bash[22610]: cluster 2024-08-31T05:44:47.667460+0000 mgr.a (mgr.14388) 9235 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:49 smithi191 bash[24992]: cluster 2024-08-31T05:44:47.667460+0000 mgr.a (mgr.14388) 9235 : cluster [DBG] pgmap v6401: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:50.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:44:50.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:44:50.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:44:51.510 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:44:51.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:44:51.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:44:51.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:44:51.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:44:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:51 smithi163 bash[24253]: cluster 2024-08-31T05:44:49.669791+0000 mgr.a (mgr.14388) 9236 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:51 smithi027 bash[22610]: cluster 2024-08-31T05:44:49.669791+0000 mgr.a (mgr.14388) 9236 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:51 smithi191 bash[24992]: cluster 2024-08-31T05:44:49.669791+0000 mgr.a (mgr.14388) 9236 : cluster [DBG] pgmap v6402: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:52 smithi163 bash[24253]: audit 2024-08-31T05:44:51.057486+0000 mgr.a (mgr.14388) 9237 : audit [DBG] from='client.205821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:52 smithi027 bash[22610]: audit 2024-08-31T05:44:51.057486+0000 mgr.a (mgr.14388) 9237 : audit [DBG] from='client.205821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:52 smithi191 bash[24992]: audit 2024-08-31T05:44:51.057486+0000 mgr.a (mgr.14388) 9237 : audit [DBG] from='client.205821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:53 smithi163 bash[24253]: cluster 2024-08-31T05:44:51.670788+0000 mgr.a (mgr.14388) 9238 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:53.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:53 smithi027 bash[22610]: cluster 2024-08-31T05:44:51.670788+0000 mgr.a (mgr.14388) 9238 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:53 smithi191 bash[24992]: cluster 2024-08-31T05:44:51.670788+0000 mgr.a (mgr.14388) 9238 : cluster [DBG] pgmap v6403: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:55.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:55 smithi163 bash[24253]: cluster 2024-08-31T05:44:53.672940+0000 mgr.a (mgr.14388) 9239 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:55.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:55 smithi027 bash[22610]: cluster 2024-08-31T05:44:53.672940+0000 mgr.a (mgr.14388) 9239 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:55 smithi191 bash[24992]: cluster 2024-08-31T05:44:53.672940+0000 mgr.a (mgr.14388) 9239 : cluster [DBG] pgmap v6404: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:44:56.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:44:56.512 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:44:56.512 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:44:57.295 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:44:57.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:44:57.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:44:57.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:44:57.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:44:57.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:57 smithi163 bash[24253]: cluster 2024-08-31T05:44:55.673702+0000 mgr.a (mgr.14388) 9240 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:57.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:57 smithi027 bash[22610]: cluster 2024-08-31T05:44:55.673702+0000 mgr.a (mgr.14388) 9240 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:57 smithi191 bash[24992]: cluster 2024-08-31T05:44:55.673702+0000 mgr.a (mgr.14388) 9240 : cluster [DBG] pgmap v6405: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:58.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:58 smithi163 bash[24253]: audit 2024-08-31T05:44:56.868481+0000 mgr.a (mgr.14388) 9241 : audit [DBG] from='client.205899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:58 smithi027 bash[22610]: audit 2024-08-31T05:44:56.868481+0000 mgr.a (mgr.14388) 9241 : audit [DBG] from='client.205899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:58 smithi191 bash[24992]: audit 2024-08-31T05:44:56.868481+0000 mgr.a (mgr.14388) 9241 : audit [DBG] from='client.205899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:44:59 smithi163 bash[24253]: cluster 2024-08-31T05:44:57.674639+0000 mgr.a (mgr.14388) 9242 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:44:59 smithi027 bash[22610]: cluster 2024-08-31T05:44:57.674639+0000 mgr.a (mgr.14388) 9242 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:44:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:44:59 smithi191 bash[24992]: cluster 2024-08-31T05:44:57.674639+0000 mgr.a (mgr.14388) 9242 : cluster [DBG] pgmap v6406: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:01.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:01 smithi191 bash[24992]: cluster 2024-08-31T05:44:59.676897+0000 mgr.a (mgr.14388) 9243 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:45:01.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:01 smithi163 bash[24253]: cluster 2024-08-31T05:44:59.676897+0000 mgr.a (mgr.14388) 9243 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:45:01.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:01 smithi027 bash[22610]: cluster 2024-08-31T05:44:59.676897+0000 mgr.a (mgr.14388) 9243 : cluster [DBG] pgmap v6407: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:45:02.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:45:02.298 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:45:02.298 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:45:03.072 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:45:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:45:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:45:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:45:03.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:45:03.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:03 smithi163 bash[24253]: cluster 2024-08-31T05:45:01.677671+0000 mgr.a (mgr.14388) 9244 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:03.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:03 smithi163 bash[24253]: audit 2024-08-31T05:45:02.637256+0000 mgr.a (mgr.14388) 9245 : audit [DBG] from='client.205977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:03.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:03 smithi027 bash[22610]: cluster 2024-08-31T05:45:01.677671+0000 mgr.a (mgr.14388) 9244 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:03 smithi027 bash[22610]: audit 2024-08-31T05:45:02.637256+0000 mgr.a (mgr.14388) 9245 : audit [DBG] from='client.205977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:03 smithi191 bash[24992]: cluster 2024-08-31T05:45:01.677671+0000 mgr.a (mgr.14388) 9244 : cluster [DBG] pgmap v6408: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:03 smithi191 bash[24992]: audit 2024-08-31T05:45:02.637256+0000 mgr.a (mgr.14388) 9245 : audit [DBG] from='client.205977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:05.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:05 smithi163 bash[24253]: cluster 2024-08-31T05:45:03.680111+0000 mgr.a (mgr.14388) 9246 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:45:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:05 smithi027 bash[22610]: cluster 2024-08-31T05:45:03.680111+0000 mgr.a (mgr.14388) 9246 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:45:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:05 smithi191 bash[24992]: cluster 2024-08-31T05:45:03.680111+0000 mgr.a (mgr.14388) 9246 : cluster [DBG] pgmap v6409: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:45:07.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:07 smithi163 bash[24253]: cluster 2024-08-31T05:45:05.680875+0000 mgr.a (mgr.14388) 9247 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:45:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:07 smithi027 bash[22610]: cluster 2024-08-31T05:45:05.680875+0000 mgr.a (mgr.14388) 9247 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:45:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:07 smithi191 bash[24992]: cluster 2024-08-31T05:45:05.680875+0000 mgr.a (mgr.14388) 9247 : cluster [DBG] pgmap v6410: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:45:08.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:45:08.074 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:45:08.074 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:45:08.852 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:45:08.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:45:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:45:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:45:08.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:45:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:09 smithi163 bash[24253]: cluster 2024-08-31T05:45:07.681653+0000 mgr.a (mgr.14388) 9248 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:45:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:09 smithi163 bash[24253]: audit 2024-08-31T05:45:08.412979+0000 mgr.a (mgr.14388) 9249 : audit [DBG] from='client.206055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:09 smithi027 bash[22610]: cluster 2024-08-31T05:45:07.681653+0000 mgr.a (mgr.14388) 9248 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:45:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:09 smithi027 bash[22610]: audit 2024-08-31T05:45:08.412979+0000 mgr.a (mgr.14388) 9249 : audit [DBG] from='client.206055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:09 smithi191 bash[24992]: cluster 2024-08-31T05:45:07.681653+0000 mgr.a (mgr.14388) 9248 : cluster [DBG] pgmap v6411: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:45:09.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:09 smithi191 bash[24992]: audit 2024-08-31T05:45:08.412979+0000 mgr.a (mgr.14388) 9249 : audit [DBG] from='client.206055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:11 smithi163 bash[24253]: cluster 2024-08-31T05:45:09.684498+0000 mgr.a (mgr.14388) 9250 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:11 smithi027 bash[22610]: cluster 2024-08-31T05:45:09.684498+0000 mgr.a (mgr.14388) 9250 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:11 smithi191 bash[24992]: cluster 2024-08-31T05:45:09.684498+0000 mgr.a (mgr.14388) 9250 : cluster [DBG] pgmap v6412: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:13 smithi163 bash[24253]: cluster 2024-08-31T05:45:11.685247+0000 mgr.a (mgr.14388) 9251 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:45:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:13 smithi027 bash[22610]: cluster 2024-08-31T05:45:11.685247+0000 mgr.a (mgr.14388) 9251 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:45:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:13 smithi191 bash[24992]: cluster 2024-08-31T05:45:11.685247+0000 mgr.a (mgr.14388) 9251 : cluster [DBG] pgmap v6413: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:45:13.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:45:13.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:45:13.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:45:14.637 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:45:14.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:45:14.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:45:14.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:45:14.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:45:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:15 smithi163 bash[24253]: cluster 2024-08-31T05:45:13.687271+0000 mgr.a (mgr.14388) 9252 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:15 smithi163 bash[24253]: audit 2024-08-31T05:45:14.193085+0000 mgr.a (mgr.14388) 9253 : audit [DBG] from='client.206133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:15 smithi027 bash[22610]: cluster 2024-08-31T05:45:13.687271+0000 mgr.a (mgr.14388) 9252 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:15 smithi027 bash[22610]: audit 2024-08-31T05:45:14.193085+0000 mgr.a (mgr.14388) 9253 : audit [DBG] from='client.206133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:15 smithi191 bash[24992]: cluster 2024-08-31T05:45:13.687271+0000 mgr.a (mgr.14388) 9252 : cluster [DBG] pgmap v6414: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:15 smithi191 bash[24992]: audit 2024-08-31T05:45:14.193085+0000 mgr.a (mgr.14388) 9253 : audit [DBG] from='client.206133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:17 smithi163 bash[24253]: cluster 2024-08-31T05:45:15.688259+0000 mgr.a (mgr.14388) 9254 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:45:17.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:17 smithi027 bash[22610]: cluster 2024-08-31T05:45:15.688259+0000 mgr.a (mgr.14388) 9254 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:45:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:17 smithi191 bash[24992]: cluster 2024-08-31T05:45:15.688259+0000 mgr.a (mgr.14388) 9254 : cluster [DBG] pgmap v6415: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:45:19.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:45:19.639 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:45:19.639 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:45:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:19 smithi163 bash[24253]: cluster 2024-08-31T05:45:17.689056+0000 mgr.a (mgr.14388) 9255 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:45:19.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:19 smithi027 bash[22610]: cluster 2024-08-31T05:45:17.689056+0000 mgr.a (mgr.14388) 9255 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:45:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:19 smithi191 bash[24992]: cluster 2024-08-31T05:45:17.689056+0000 mgr.a (mgr.14388) 9255 : cluster [DBG] pgmap v6416: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:45:20.417 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:45:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:45:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:45:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:45:20.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:45:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:21 smithi163 bash[24253]: cluster 2024-08-31T05:45:19.691283+0000 mgr.a (mgr.14388) 9256 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:45:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:21 smithi163 bash[24253]: audit 2024-08-31T05:45:19.973792+0000 mgr.a (mgr.14388) 9257 : audit [DBG] from='client.206208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:21 smithi027 bash[22610]: cluster 2024-08-31T05:45:19.691283+0000 mgr.a (mgr.14388) 9256 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:45:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:21 smithi027 bash[22610]: audit 2024-08-31T05:45:19.973792+0000 mgr.a (mgr.14388) 9257 : audit [DBG] from='client.206208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:21 smithi191 bash[24992]: cluster 2024-08-31T05:45:19.691283+0000 mgr.a (mgr.14388) 9256 : cluster [DBG] pgmap v6417: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:45:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:21 smithi191 bash[24992]: audit 2024-08-31T05:45:19.973792+0000 mgr.a (mgr.14388) 9257 : audit [DBG] from='client.206208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:23 smithi027 bash[22610]: cluster 2024-08-31T05:45:21.692197+0000 mgr.a (mgr.14388) 9258 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:23 smithi191 bash[24992]: cluster 2024-08-31T05:45:21.692197+0000 mgr.a (mgr.14388) 9258 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:23 smithi163 bash[24253]: cluster 2024-08-31T05:45:21.692197+0000 mgr.a (mgr.14388) 9258 : cluster [DBG] pgmap v6418: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:25.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:45:25.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:45:25.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:45:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:25 smithi027 bash[22610]: cluster 2024-08-31T05:45:23.694582+0000 mgr.a (mgr.14388) 9259 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:45:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:25 smithi191 bash[24992]: cluster 2024-08-31T05:45:23.694582+0000 mgr.a (mgr.14388) 9259 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:45:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:25 smithi163 bash[24253]: cluster 2024-08-31T05:45:23.694582+0000 mgr.a (mgr.14388) 9259 : cluster [DBG] pgmap v6419: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:45:26.196 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:45:26.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:45:26.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:45:26.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:45:26.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:45:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:27 smithi027 bash[22610]: cluster 2024-08-31T05:45:25.695454+0000 mgr.a (mgr.14388) 9260 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:27 smithi027 bash[22610]: audit 2024-08-31T05:45:25.757040+0000 mgr.a (mgr.14388) 9261 : audit [DBG] from='client.206286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:27 smithi191 bash[24992]: cluster 2024-08-31T05:45:25.695454+0000 mgr.a (mgr.14388) 9260 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:27.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:27 smithi191 bash[24992]: audit 2024-08-31T05:45:25.757040+0000 mgr.a (mgr.14388) 9261 : audit [DBG] from='client.206286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:27 smithi163 bash[24253]: cluster 2024-08-31T05:45:25.695454+0000 mgr.a (mgr.14388) 9260 : cluster [DBG] pgmap v6420: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:27 smithi163 bash[24253]: audit 2024-08-31T05:45:25.757040+0000 mgr.a (mgr.14388) 9261 : audit [DBG] from='client.206286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:28 smithi191 bash[24992]: audit 2024-08-31T05:45:28.100319+0000 mon.a (mon.0) 1964 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:45:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:28 smithi163 bash[24253]: audit 2024-08-31T05:45:28.100319+0000 mon.a (mon.0) 1964 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:45:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:28 smithi027 bash[22610]: audit 2024-08-31T05:45:28.100319+0000 mon.a (mon.0) 1964 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:45:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:29 smithi191 bash[24992]: cluster 2024-08-31T05:45:27.696294+0000 mgr.a (mgr.14388) 9262 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:29 smithi163 bash[24253]: cluster 2024-08-31T05:45:27.696294+0000 mgr.a (mgr.14388) 9262 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:29.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:29 smithi027 bash[22610]: cluster 2024-08-31T05:45:27.696294+0000 mgr.a (mgr.14388) 9262 : cluster [DBG] pgmap v6421: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:30.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22863]: debug 2024-08-31T05:45:30.239+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:45:30.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22863]: debug 2024-08-31T05:45:30.243+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:45:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.493697+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.498593+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.503456+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.508673+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.511843+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.515011+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.515906+0000 mon.a (mon.0) 1971 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:45:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.516697+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:45:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.521865+0000 mon.a (mon.0) 1973 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.524418+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:45:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:30 smithi027 bash[22610]: audit 2024-08-31T05:45:29.525769+0000 mgr.a (mgr.14388) 9263 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:45:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.493697+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.498593+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.503456+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.508673+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.511843+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.515011+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.515906+0000 mon.a (mon.0) 1971 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:45:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.516697+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:45:30.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.521865+0000 mon.a (mon.0) 1973 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.524418+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:45:30.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:30 smithi191 bash[24992]: audit 2024-08-31T05:45:29.525769+0000 mgr.a (mgr.14388) 9263 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:45:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.493697+0000 mon.a (mon.0) 1965 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.498593+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.503456+0000 mon.a (mon.0) 1967 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.508673+0000 mon.a (mon.0) 1968 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.511843+0000 mon.a (mon.0) 1969 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.515011+0000 mon.a (mon.0) 1970 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.515906+0000 mon.a (mon.0) 1971 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:45:30.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.516697+0000 mon.a (mon.0) 1972 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:45:30.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.521865+0000 mon.a (mon.0) 1973 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:45:30.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.524418+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:45:30.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:30 smithi163 bash[24253]: audit 2024-08-31T05:45:29.525769+0000 mgr.a (mgr.14388) 9263 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:45:31.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:45:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:45:31.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:45:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:31 smithi191 bash[24992]: cluster 2024-08-31T05:45:29.697705+0000 mgr.a (mgr.14388) 9264 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:45:31.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:31 smithi191 bash[24992]: audit 2024-08-31T05:45:30.246201+0000 mgr.a (mgr.14388) 9265 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:45:31.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:31 smithi191 bash[24992]: cephadm 2024-08-31T05:45:30.247445+0000 mgr.a (mgr.14388) 9266 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:45:31.941 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:45:31.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:45:31.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:45:31.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:45:31.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:45:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:31 smithi163 bash[24253]: cluster 2024-08-31T05:45:29.697705+0000 mgr.a (mgr.14388) 9264 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:45:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:31 smithi163 bash[24253]: audit 2024-08-31T05:45:30.246201+0000 mgr.a (mgr.14388) 9265 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:45:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:31 smithi163 bash[24253]: cephadm 2024-08-31T05:45:30.247445+0000 mgr.a (mgr.14388) 9266 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:45:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:31 smithi027 bash[22610]: cluster 2024-08-31T05:45:29.697705+0000 mgr.a (mgr.14388) 9264 : cluster [DBG] pgmap v6422: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:45:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:31 smithi027 bash[22610]: audit 2024-08-31T05:45:30.246201+0000 mgr.a (mgr.14388) 9265 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:45:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:31 smithi027 bash[22610]: cephadm 2024-08-31T05:45:30.247445+0000 mgr.a (mgr.14388) 9266 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:45:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:32 smithi191 bash[24992]: audit 2024-08-31T05:45:31.525528+0000 mgr.a (mgr.14388) 9267 : audit [DBG] from='client.206466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:32 smithi163 bash[24253]: audit 2024-08-31T05:45:31.525528+0000 mgr.a (mgr.14388) 9267 : audit [DBG] from='client.206466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:32 smithi027 bash[22610]: audit 2024-08-31T05:45:31.525528+0000 mgr.a (mgr.14388) 9267 : audit [DBG] from='client.206466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:33.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:33 smithi191 bash[24992]: cluster 2024-08-31T05:45:31.698154+0000 mgr.a (mgr.14388) 9268 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:33 smithi163 bash[24253]: cluster 2024-08-31T05:45:31.698154+0000 mgr.a (mgr.14388) 9268 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:33 smithi027 bash[22610]: cluster 2024-08-31T05:45:31.698154+0000 mgr.a (mgr.14388) 9268 : cluster [DBG] pgmap v6423: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:35 smithi163 bash[24253]: cluster 2024-08-31T05:45:33.700541+0000 mgr.a (mgr.14388) 9269 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:35 smithi027 bash[22610]: cluster 2024-08-31T05:45:33.700541+0000 mgr.a (mgr.14388) 9269 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:35 smithi191 bash[24992]: cluster 2024-08-31T05:45:33.700541+0000 mgr.a (mgr.14388) 9269 : cluster [DBG] pgmap v6424: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:36.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:45:36.944 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:45:36.944 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:45:37.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:45:38.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:45:38.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:45:38.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:45:38.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:45:38.032 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:37 smithi027 bash[22610]: cluster 2024-08-31T05:45:35.701348+0000 mgr.a (mgr.14388) 9270 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:38.032 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:37 smithi163 bash[24253]: cluster 2024-08-31T05:45:35.701348+0000 mgr.a (mgr.14388) 9270 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:37 smithi191 bash[24992]: cluster 2024-08-31T05:45:35.701348+0000 mgr.a (mgr.14388) 9270 : cluster [DBG] pgmap v6425: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:38 smithi163 bash[24253]: audit 2024-08-31T05:45:37.278855+0000 mgr.a (mgr.14388) 9271 : audit [DBG] from='client.206538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:38 smithi027 bash[22610]: audit 2024-08-31T05:45:37.278855+0000 mgr.a (mgr.14388) 9271 : audit [DBG] from='client.206538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:38 smithi191 bash[24992]: audit 2024-08-31T05:45:37.278855+0000 mgr.a (mgr.14388) 9271 : audit [DBG] from='client.206538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:39 smithi163 bash[24253]: cluster 2024-08-31T05:45:37.701886+0000 mgr.a (mgr.14388) 9272 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:39 smithi027 bash[22610]: cluster 2024-08-31T05:45:37.701886+0000 mgr.a (mgr.14388) 9272 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:39 smithi191 bash[24992]: cluster 2024-08-31T05:45:37.701886+0000 mgr.a (mgr.14388) 9272 : cluster [DBG] pgmap v6426: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:41 smithi163 bash[24253]: cluster 2024-08-31T05:45:39.704131+0000 mgr.a (mgr.14388) 9273 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:41 smithi027 bash[22610]: cluster 2024-08-31T05:45:39.704131+0000 mgr.a (mgr.14388) 9273 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:41 smithi191 bash[24992]: cluster 2024-08-31T05:45:39.704131+0000 mgr.a (mgr.14388) 9273 : cluster [DBG] pgmap v6427: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:42.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:45:42.720 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:45:42.720 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:45:43.462 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:45:43.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:45:43.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:45:43.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:45:43.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:45:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:43 smithi163 bash[24253]: cluster 2024-08-31T05:45:41.704909+0000 mgr.a (mgr.14388) 9274 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:43 smithi027 bash[22610]: cluster 2024-08-31T05:45:41.704909+0000 mgr.a (mgr.14388) 9274 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:43 smithi191 bash[24992]: cluster 2024-08-31T05:45:41.704909+0000 mgr.a (mgr.14388) 9274 : cluster [DBG] pgmap v6428: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:44 smithi163 bash[24253]: audit 2024-08-31T05:45:43.053776+0000 mgr.a (mgr.14388) 9275 : audit [DBG] from='client.206616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:44 smithi027 bash[22610]: audit 2024-08-31T05:45:43.053776+0000 mgr.a (mgr.14388) 9275 : audit [DBG] from='client.206616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:44 smithi191 bash[24992]: audit 2024-08-31T05:45:43.053776+0000 mgr.a (mgr.14388) 9275 : audit [DBG] from='client.206616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:45 smithi163 bash[24253]: cluster 2024-08-31T05:45:43.707680+0000 mgr.a (mgr.14388) 9276 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:45 smithi027 bash[22610]: cluster 2024-08-31T05:45:43.707680+0000 mgr.a (mgr.14388) 9276 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:45 smithi191 bash[24992]: cluster 2024-08-31T05:45:43.707680+0000 mgr.a (mgr.14388) 9276 : cluster [DBG] pgmap v6429: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:45:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:47 smithi163 bash[24253]: cluster 2024-08-31T05:45:45.708458+0000 mgr.a (mgr.14388) 9277 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:45:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:47 smithi027 bash[22610]: cluster 2024-08-31T05:45:45.708458+0000 mgr.a (mgr.14388) 9277 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:45:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:47 smithi191 bash[24992]: cluster 2024-08-31T05:45:45.708458+0000 mgr.a (mgr.14388) 9277 : cluster [DBG] pgmap v6430: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:45:48.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:45:48.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:45:48.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:45:49.233 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:45:49.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:45:49.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:45:49.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:45:49.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:45:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:49 smithi163 bash[24253]: cluster 2024-08-31T05:45:47.709219+0000 mgr.a (mgr.14388) 9278 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:45:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:49 smithi027 bash[22610]: cluster 2024-08-31T05:45:47.709219+0000 mgr.a (mgr.14388) 9278 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:45:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:49 smithi191 bash[24992]: cluster 2024-08-31T05:45:47.709219+0000 mgr.a (mgr.14388) 9278 : cluster [DBG] pgmap v6431: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:45:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:50 smithi163 bash[24253]: audit 2024-08-31T05:45:48.797781+0000 mgr.a (mgr.14388) 9279 : audit [DBG] from='client.206691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:50 smithi027 bash[22610]: audit 2024-08-31T05:45:48.797781+0000 mgr.a (mgr.14388) 9279 : audit [DBG] from='client.206691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:50 smithi191 bash[24992]: audit 2024-08-31T05:45:48.797781+0000 mgr.a (mgr.14388) 9279 : audit [DBG] from='client.206691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:51 smithi163 bash[24253]: cluster 2024-08-31T05:45:49.712054+0000 mgr.a (mgr.14388) 9280 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:51 smithi027 bash[22610]: cluster 2024-08-31T05:45:49.712054+0000 mgr.a (mgr.14388) 9280 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:51 smithi191 bash[24992]: cluster 2024-08-31T05:45:49.712054+0000 mgr.a (mgr.14388) 9280 : cluster [DBG] pgmap v6432: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:53 smithi163 bash[24253]: cluster 2024-08-31T05:45:51.712839+0000 mgr.a (mgr.14388) 9281 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:45:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:53 smithi027 bash[22610]: cluster 2024-08-31T05:45:51.712839+0000 mgr.a (mgr.14388) 9281 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:45:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:53 smithi191 bash[24992]: cluster 2024-08-31T05:45:51.712839+0000 mgr.a (mgr.14388) 9281 : cluster [DBG] pgmap v6433: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:45:54.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:45:54.235 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:45:54.235 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:45:55.016 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:45:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:45:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:45:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:45:55.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:45:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:55 smithi163 bash[24253]: cluster 2024-08-31T05:45:53.714860+0000 mgr.a (mgr.14388) 9282 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:55 smithi163 bash[24253]: audit 2024-08-31T05:45:54.574852+0000 mgr.a (mgr.14388) 9283 : audit [DBG] from='client.206766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:55 smithi027 bash[22610]: cluster 2024-08-31T05:45:53.714860+0000 mgr.a (mgr.14388) 9282 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:55 smithi027 bash[22610]: audit 2024-08-31T05:45:54.574852+0000 mgr.a (mgr.14388) 9283 : audit [DBG] from='client.206766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:55 smithi191 bash[24992]: cluster 2024-08-31T05:45:53.714860+0000 mgr.a (mgr.14388) 9282 : cluster [DBG] pgmap v6434: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:55 smithi191 bash[24992]: audit 2024-08-31T05:45:54.574852+0000 mgr.a (mgr.14388) 9283 : audit [DBG] from='client.206766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:45:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:57 smithi163 bash[24253]: cluster 2024-08-31T05:45:55.715802+0000 mgr.a (mgr.14388) 9284 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:57 smithi027 bash[22610]: cluster 2024-08-31T05:45:55.715802+0000 mgr.a (mgr.14388) 9284 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:57 smithi191 bash[24992]: cluster 2024-08-31T05:45:55.715802+0000 mgr.a (mgr.14388) 9284 : cluster [DBG] pgmap v6435: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:45:59 smithi163 bash[24253]: cluster 2024-08-31T05:45:57.716589+0000 mgr.a (mgr.14388) 9285 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:45:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:45:59 smithi027 bash[22610]: cluster 2024-08-31T05:45:57.716589+0000 mgr.a (mgr.14388) 9285 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:00.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:00.018 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:00.019 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:45:59 smithi191 bash[24992]: cluster 2024-08-31T05:45:57.716589+0000 mgr.a (mgr.14388) 9285 : cluster [DBG] pgmap v6436: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:00.793 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:00.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:00.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:00.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:00.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:01 smithi163 bash[24253]: cluster 2024-08-31T05:45:59.718847+0000 mgr.a (mgr.14388) 9286 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:01 smithi163 bash[24253]: audit 2024-08-31T05:46:00.352515+0000 mgr.a (mgr.14388) 9287 : audit [DBG] from='client.206844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:01 smithi027 bash[22610]: cluster 2024-08-31T05:45:59.718847+0000 mgr.a (mgr.14388) 9286 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:01 smithi027 bash[22610]: audit 2024-08-31T05:46:00.352515+0000 mgr.a (mgr.14388) 9287 : audit [DBG] from='client.206844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:01 smithi191 bash[24992]: cluster 2024-08-31T05:45:59.718847+0000 mgr.a (mgr.14388) 9286 : cluster [DBG] pgmap v6437: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:01 smithi191 bash[24992]: audit 2024-08-31T05:46:00.352515+0000 mgr.a (mgr.14388) 9287 : audit [DBG] from='client.206844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:03 smithi163 bash[24253]: cluster 2024-08-31T05:46:01.719732+0000 mgr.a (mgr.14388) 9288 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:03 smithi027 bash[22610]: cluster 2024-08-31T05:46:01.719732+0000 mgr.a (mgr.14388) 9288 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:03 smithi191 bash[24992]: cluster 2024-08-31T05:46:01.719732+0000 mgr.a (mgr.14388) 9288 : cluster [DBG] pgmap v6438: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:05.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:05.796 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:05.796 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:05 smithi163 bash[24253]: cluster 2024-08-31T05:46:03.722072+0000 mgr.a (mgr.14388) 9289 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:05 smithi027 bash[22610]: cluster 2024-08-31T05:46:03.722072+0000 mgr.a (mgr.14388) 9289 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:05 smithi191 bash[24992]: cluster 2024-08-31T05:46:03.722072+0000 mgr.a (mgr.14388) 9289 : cluster [DBG] pgmap v6439: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:06.551 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:06.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:06.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:06.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:06.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:07 smithi163 bash[24253]: cluster 2024-08-31T05:46:05.723028+0000 mgr.a (mgr.14388) 9290 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:07 smithi163 bash[24253]: audit 2024-08-31T05:46:06.130103+0000 mgr.a (mgr.14388) 9291 : audit [DBG] from='client.206922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:07 smithi027 bash[22610]: cluster 2024-08-31T05:46:05.723028+0000 mgr.a (mgr.14388) 9290 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:07 smithi027 bash[22610]: audit 2024-08-31T05:46:06.130103+0000 mgr.a (mgr.14388) 9291 : audit [DBG] from='client.206922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:07 smithi191 bash[24992]: cluster 2024-08-31T05:46:05.723028+0000 mgr.a (mgr.14388) 9290 : cluster [DBG] pgmap v6440: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:07 smithi191 bash[24992]: audit 2024-08-31T05:46:06.130103+0000 mgr.a (mgr.14388) 9291 : audit [DBG] from='client.206922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:09.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:09 smithi163 bash[24253]: cluster 2024-08-31T05:46:07.723892+0000 mgr.a (mgr.14388) 9292 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:09 smithi027 bash[22610]: cluster 2024-08-31T05:46:07.723892+0000 mgr.a (mgr.14388) 9292 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:09 smithi191 bash[24992]: cluster 2024-08-31T05:46:07.723892+0000 mgr.a (mgr.14388) 9292 : cluster [DBG] pgmap v6441: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:11.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:11.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:11.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:11 smithi163 bash[24253]: cluster 2024-08-31T05:46:09.726161+0000 mgr.a (mgr.14388) 9293 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:11.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:11 smithi027 bash[22610]: cluster 2024-08-31T05:46:09.726161+0000 mgr.a (mgr.14388) 9293 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:11 smithi191 bash[24992]: cluster 2024-08-31T05:46:09.726161+0000 mgr.a (mgr.14388) 9293 : cluster [DBG] pgmap v6442: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:12.304 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:12.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:12.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:12.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:12.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:13 smithi163 bash[24253]: cluster 2024-08-31T05:46:11.726799+0000 mgr.a (mgr.14388) 9294 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:13 smithi163 bash[24253]: audit 2024-08-31T05:46:11.887124+0000 mgr.a (mgr.14388) 9295 : audit [DBG] from='client.207000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:13 smithi027 bash[22610]: cluster 2024-08-31T05:46:11.726799+0000 mgr.a (mgr.14388) 9294 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:13 smithi027 bash[22610]: audit 2024-08-31T05:46:11.887124+0000 mgr.a (mgr.14388) 9295 : audit [DBG] from='client.207000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:13 smithi191 bash[24992]: cluster 2024-08-31T05:46:11.726799+0000 mgr.a (mgr.14388) 9294 : cluster [DBG] pgmap v6443: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:13 smithi191 bash[24992]: audit 2024-08-31T05:46:11.887124+0000 mgr.a (mgr.14388) 9295 : audit [DBG] from='client.207000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:15 smithi163 bash[24253]: cluster 2024-08-31T05:46:13.729077+0000 mgr.a (mgr.14388) 9296 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:15 smithi027 bash[22610]: cluster 2024-08-31T05:46:13.729077+0000 mgr.a (mgr.14388) 9296 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:15 smithi191 bash[24992]: cluster 2024-08-31T05:46:13.729077+0000 mgr.a (mgr.14388) 9296 : cluster [DBG] pgmap v6444: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:17.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:17.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:17.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:17 smithi163 bash[24253]: cluster 2024-08-31T05:46:15.729847+0000 mgr.a (mgr.14388) 9297 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:17.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:17 smithi027 bash[22610]: cluster 2024-08-31T05:46:15.729847+0000 mgr.a (mgr.14388) 9297 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:17 smithi191 bash[24992]: cluster 2024-08-31T05:46:15.729847+0000 mgr.a (mgr.14388) 9297 : cluster [DBG] pgmap v6445: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:18.081 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:18.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:18.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:18 smithi163 bash[24253]: audit 2024-08-31T05:46:17.642683+0000 mgr.a (mgr.14388) 9298 : audit [DBG] from='client.207072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:18.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:18 smithi027 bash[22610]: audit 2024-08-31T05:46:17.642683+0000 mgr.a (mgr.14388) 9298 : audit [DBG] from='client.207072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:18 smithi191 bash[24992]: audit 2024-08-31T05:46:17.642683+0000 mgr.a (mgr.14388) 9298 : audit [DBG] from='client.207072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:19 smithi163 bash[24253]: cluster 2024-08-31T05:46:17.730355+0000 mgr.a (mgr.14388) 9299 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:19 smithi027 bash[22610]: cluster 2024-08-31T05:46:17.730355+0000 mgr.a (mgr.14388) 9299 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:19 smithi191 bash[24992]: cluster 2024-08-31T05:46:17.730355+0000 mgr.a (mgr.14388) 9299 : cluster [DBG] pgmap v6446: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:21 smithi163 bash[24253]: cluster 2024-08-31T05:46:19.732660+0000 mgr.a (mgr.14388) 9300 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:46:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:21 smithi027 bash[22610]: cluster 2024-08-31T05:46:19.732660+0000 mgr.a (mgr.14388) 9300 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:46:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:21 smithi191 bash[24992]: cluster 2024-08-31T05:46:19.732660+0000 mgr.a (mgr.14388) 9300 : cluster [DBG] pgmap v6447: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:46:23.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:23.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:23.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:23.871 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:23 smithi163 bash[24253]: cluster 2024-08-31T05:46:21.733431+0000 mgr.a (mgr.14388) 9301 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:46:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:23 smithi027 bash[22610]: cluster 2024-08-31T05:46:21.733431+0000 mgr.a (mgr.14388) 9301 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:46:24.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:23 smithi191 bash[24992]: cluster 2024-08-31T05:46:21.733431+0000 mgr.a (mgr.14388) 9301 : cluster [DBG] pgmap v6448: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:46:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:24 smithi163 bash[24253]: audit 2024-08-31T05:46:23.420129+0000 mgr.a (mgr.14388) 9302 : audit [DBG] from='client.207147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:24 smithi027 bash[22610]: audit 2024-08-31T05:46:23.420129+0000 mgr.a (mgr.14388) 9302 : audit [DBG] from='client.207147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:24 smithi191 bash[24992]: audit 2024-08-31T05:46:23.420129+0000 mgr.a (mgr.14388) 9302 : audit [DBG] from='client.207147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:25 smithi163 bash[24253]: cluster 2024-08-31T05:46:23.734774+0000 mgr.a (mgr.14388) 9303 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:25 smithi027 bash[22610]: cluster 2024-08-31T05:46:23.734774+0000 mgr.a (mgr.14388) 9303 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:25 smithi191 bash[24992]: cluster 2024-08-31T05:46:23.734774+0000 mgr.a (mgr.14388) 9303 : cluster [DBG] pgmap v6449: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:26 smithi163 bash[24253]: cluster 2024-08-31T05:46:25.735711+0000 mgr.a (mgr.14388) 9304 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:46:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:26 smithi027 bash[22610]: cluster 2024-08-31T05:46:25.735711+0000 mgr.a (mgr.14388) 9304 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:46:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:26 smithi191 bash[24992]: cluster 2024-08-31T05:46:25.735711+0000 mgr.a (mgr.14388) 9304 : cluster [DBG] pgmap v6450: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:46:28.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:28.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:28.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:29.205 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:28 smithi163 bash[24253]: cluster 2024-08-31T05:46:27.736657+0000 mgr.a (mgr.14388) 9305 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:46:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:28 smithi027 bash[22610]: cluster 2024-08-31T05:46:27.736657+0000 mgr.a (mgr.14388) 9305 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:46:29.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:28 smithi191 bash[24992]: cluster 2024-08-31T05:46:27.736657+0000 mgr.a (mgr.14388) 9305 : cluster [DBG] pgmap v6451: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:46:29.639 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:29.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:29.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:29.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:29.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:29 smithi163 bash[24253]: audit 2024-08-31T05:46:29.208922+0000 mgr.a (mgr.14388) 9306 : audit [DBG] from='client.207222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:30.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:29 smithi027 bash[22610]: audit 2024-08-31T05:46:29.208922+0000 mgr.a (mgr.14388) 9306 : audit [DBG] from='client.207222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:29 smithi191 bash[24992]: audit 2024-08-31T05:46:29.208922+0000 mgr.a (mgr.14388) 9306 : audit [DBG] from='client.207222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:30 smithi163 bash[24253]: cluster 2024-08-31T05:46:29.739465+0000 mgr.a (mgr.14388) 9307 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:30 smithi163 bash[24253]: audit 2024-08-31T05:46:30.303831+0000 mon.a (mon.0) 1975 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:46:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:30 smithi027 bash[22610]: cluster 2024-08-31T05:46:29.739465+0000 mgr.a (mgr.14388) 9307 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:30 smithi027 bash[22610]: audit 2024-08-31T05:46:30.303831+0000 mon.a (mon.0) 1975 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:46:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:30 smithi191 bash[24992]: cluster 2024-08-31T05:46:29.739465+0000 mgr.a (mgr.14388) 9307 : cluster [DBG] pgmap v6452: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:30 smithi191 bash[24992]: audit 2024-08-31T05:46:30.303831+0000 mon.a (mon.0) 1975 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:46:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:31 smithi163 bash[24253]: audit 2024-08-31T05:46:30.931221+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:46:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:31 smithi163 bash[24253]: audit 2024-08-31T05:46:30.938622+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:46:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:31 smithi163 bash[24253]: audit 2024-08-31T05:46:31.705385+0000 mon.a (mon.0) 1978 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:46:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:31 smithi163 bash[24253]: audit 2024-08-31T05:46:31.706544+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:46:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:31 smithi163 bash[24253]: audit 2024-08-31T05:46:31.712355+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:46:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:31 smithi163 bash[24253]: audit 2024-08-31T05:46:31.717415+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:46:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:31 smithi027 bash[22610]: audit 2024-08-31T05:46:30.931221+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:46:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:31 smithi027 bash[22610]: audit 2024-08-31T05:46:30.938622+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:46:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:31 smithi027 bash[22610]: audit 2024-08-31T05:46:31.705385+0000 mon.a (mon.0) 1978 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:46:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:31 smithi027 bash[22610]: audit 2024-08-31T05:46:31.706544+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:46:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:31 smithi027 bash[22610]: audit 2024-08-31T05:46:31.712355+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:46:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:31 smithi027 bash[22610]: audit 2024-08-31T05:46:31.717415+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:46:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:31 smithi191 bash[24992]: audit 2024-08-31T05:46:30.931221+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:46:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:31 smithi191 bash[24992]: audit 2024-08-31T05:46:30.938622+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:46:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:31 smithi191 bash[24992]: audit 2024-08-31T05:46:31.705385+0000 mon.a (mon.0) 1978 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:46:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:31 smithi191 bash[24992]: audit 2024-08-31T05:46:31.706544+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:46:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:31 smithi191 bash[24992]: audit 2024-08-31T05:46:31.712355+0000 mon.a (mon.0) 1980 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:46:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:31 smithi191 bash[24992]: audit 2024-08-31T05:46:31.717415+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:46:32.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:46:32 smithi027 bash[22863]: debug 2024-08-31T05:46:32.429+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:46:32.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:46:32 smithi027 bash[22863]: debug 2024-08-31T05:46:32.433+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:46:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:32 smithi163 bash[24253]: audit 2024-08-31T05:46:31.718564+0000 mgr.a (mgr.14388) 9308 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:46:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:32 smithi163 bash[24253]: cluster 2024-08-31T05:46:31.740643+0000 mgr.a (mgr.14388) 9309 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:46:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:32 smithi163 bash[24253]: audit 2024-08-31T05:46:32.433640+0000 mgr.a (mgr.14388) 9310 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:46:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:32 smithi163 bash[24253]: cephadm 2024-08-31T05:46:32.435131+0000 mgr.a (mgr.14388) 9311 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:46:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:32 smithi027 bash[22610]: audit 2024-08-31T05:46:31.718564+0000 mgr.a (mgr.14388) 9308 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:46:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:32 smithi027 bash[22610]: cluster 2024-08-31T05:46:31.740643+0000 mgr.a (mgr.14388) 9309 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:46:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:32 smithi027 bash[22610]: audit 2024-08-31T05:46:32.433640+0000 mgr.a (mgr.14388) 9310 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:46:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:32 smithi027 bash[22610]: cephadm 2024-08-31T05:46:32.435131+0000 mgr.a (mgr.14388) 9311 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:46:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:32 smithi191 bash[24992]: audit 2024-08-31T05:46:31.718564+0000 mgr.a (mgr.14388) 9308 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:46:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:32 smithi191 bash[24992]: cluster 2024-08-31T05:46:31.740643+0000 mgr.a (mgr.14388) 9309 : cluster [DBG] pgmap v6453: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:46:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:32 smithi191 bash[24992]: audit 2024-08-31T05:46:32.433640+0000 mgr.a (mgr.14388) 9310 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:46:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:32 smithi191 bash[24992]: cephadm 2024-08-31T05:46:32.435131+0000 mgr.a (mgr.14388) 9311 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:46:34.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:34.641 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:34.641 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:34 smithi163 bash[24253]: cluster 2024-08-31T05:46:33.743048+0000 mgr.a (mgr.14388) 9312 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:34 smithi027 bash[22610]: cluster 2024-08-31T05:46:33.743048+0000 mgr.a (mgr.14388) 9312 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:34 smithi191 bash[24992]: cluster 2024-08-31T05:46:33.743048+0000 mgr.a (mgr.14388) 9312 : cluster [DBG] pgmap v6454: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:35.416 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:35.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:35.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:35.417 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:35.417 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:36.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:35 smithi163 bash[24253]: audit 2024-08-31T05:46:34.976656+0000 mgr.a (mgr.14388) 9313 : audit [DBG] from='client.207408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:35 smithi027 bash[22610]: audit 2024-08-31T05:46:34.976656+0000 mgr.a (mgr.14388) 9313 : audit [DBG] from='client.207408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:35 smithi191 bash[24992]: audit 2024-08-31T05:46:34.976656+0000 mgr.a (mgr.14388) 9313 : audit [DBG] from='client.207408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:36 smithi163 bash[24253]: cluster 2024-08-31T05:46:35.743982+0000 mgr.a (mgr.14388) 9314 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:36 smithi027 bash[22610]: cluster 2024-08-31T05:46:35.743982+0000 mgr.a (mgr.14388) 9314 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:36 smithi191 bash[24992]: cluster 2024-08-31T05:46:35.743982+0000 mgr.a (mgr.14388) 9314 : cluster [DBG] pgmap v6455: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:38 smithi027 bash[22610]: cluster 2024-08-31T05:46:37.744768+0000 mgr.a (mgr.14388) 9315 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:38 smithi191 bash[24992]: cluster 2024-08-31T05:46:37.744768+0000 mgr.a (mgr.14388) 9315 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:38 smithi163 bash[24253]: cluster 2024-08-31T05:46:37.744768+0000 mgr.a (mgr.14388) 9315 : cluster [DBG] pgmap v6456: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:40.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:40.418 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:40.418 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:41.203 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:41.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:41.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:41.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:41.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:41.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:40 smithi027 bash[22610]: cluster 2024-08-31T05:46:39.747039+0000 mgr.a (mgr.14388) 9316 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:40 smithi191 bash[24992]: cluster 2024-08-31T05:46:39.747039+0000 mgr.a (mgr.14388) 9316 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:40 smithi163 bash[24253]: cluster 2024-08-31T05:46:39.747039+0000 mgr.a (mgr.14388) 9316 : cluster [DBG] pgmap v6457: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:41 smithi027 bash[22610]: audit 2024-08-31T05:46:40.753541+0000 mgr.a (mgr.14388) 9317 : audit [DBG] from='client.207486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:41 smithi191 bash[24992]: audit 2024-08-31T05:46:40.753541+0000 mgr.a (mgr.14388) 9317 : audit [DBG] from='client.207486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:41 smithi163 bash[24253]: audit 2024-08-31T05:46:40.753541+0000 mgr.a (mgr.14388) 9317 : audit [DBG] from='client.207486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:42 smithi027 bash[22610]: cluster 2024-08-31T05:46:41.747942+0000 mgr.a (mgr.14388) 9318 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:42 smithi191 bash[24992]: cluster 2024-08-31T05:46:41.747942+0000 mgr.a (mgr.14388) 9318 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:42 smithi163 bash[24253]: cluster 2024-08-31T05:46:41.747942+0000 mgr.a (mgr.14388) 9318 : cluster [DBG] pgmap v6458: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:44 smithi027 bash[22610]: cluster 2024-08-31T05:46:43.750168+0000 mgr.a (mgr.14388) 9319 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:44 smithi191 bash[24992]: cluster 2024-08-31T05:46:43.750168+0000 mgr.a (mgr.14388) 9319 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:44 smithi163 bash[24253]: cluster 2024-08-31T05:46:43.750168+0000 mgr.a (mgr.14388) 9319 : cluster [DBG] pgmap v6459: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:46:46.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:46.205 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:46.205 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:46.958 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:46.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:46.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:46.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:46.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:46 smithi027 bash[22610]: cluster 2024-08-31T05:46:45.751009+0000 mgr.a (mgr.14388) 9320 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:46 smithi027 bash[22610]: audit 2024-08-31T05:46:46.532146+0000 mgr.a (mgr.14388) 9321 : audit [DBG] from='client.207561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:46 smithi191 bash[24992]: cluster 2024-08-31T05:46:45.751009+0000 mgr.a (mgr.14388) 9320 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:47.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:46 smithi191 bash[24992]: audit 2024-08-31T05:46:46.532146+0000 mgr.a (mgr.14388) 9321 : audit [DBG] from='client.207561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:46 smithi163 bash[24253]: cluster 2024-08-31T05:46:45.751009+0000 mgr.a (mgr.14388) 9320 : cluster [DBG] pgmap v6460: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:46 smithi163 bash[24253]: audit 2024-08-31T05:46:46.532146+0000 mgr.a (mgr.14388) 9321 : audit [DBG] from='client.207561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:48 smithi027 bash[22610]: cluster 2024-08-31T05:46:47.751876+0000 mgr.a (mgr.14388) 9322 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:48 smithi191 bash[24992]: cluster 2024-08-31T05:46:47.751876+0000 mgr.a (mgr.14388) 9322 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:48 smithi163 bash[24253]: cluster 2024-08-31T05:46:47.751876+0000 mgr.a (mgr.14388) 9322 : cluster [DBG] pgmap v6461: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:50 smithi191 bash[24992]: cluster 2024-08-31T05:46:49.754048+0000 mgr.a (mgr.14388) 9323 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:50 smithi163 bash[24253]: cluster 2024-08-31T05:46:49.754048+0000 mgr.a (mgr.14388) 9323 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:51.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:50 smithi027 bash[22610]: cluster 2024-08-31T05:46:49.754048+0000 mgr.a (mgr.14388) 9323 : cluster [DBG] pgmap v6462: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:51.959 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:51.960 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:51.960 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:52.700 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:52.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:52.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:52.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:52.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:52 smithi191 bash[24992]: cluster 2024-08-31T05:46:51.754827+0000 mgr.a (mgr.14388) 9324 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:52 smithi191 bash[24992]: audit 2024-08-31T05:46:52.291841+0000 mgr.a (mgr.14388) 9325 : audit [DBG] from='client.207639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:52 smithi163 bash[24253]: cluster 2024-08-31T05:46:51.754827+0000 mgr.a (mgr.14388) 9324 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:52 smithi163 bash[24253]: audit 2024-08-31T05:46:52.291841+0000 mgr.a (mgr.14388) 9325 : audit [DBG] from='client.207639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:52 smithi027 bash[22610]: cluster 2024-08-31T05:46:51.754827+0000 mgr.a (mgr.14388) 9324 : cluster [DBG] pgmap v6463: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:52 smithi027 bash[22610]: audit 2024-08-31T05:46:52.291841+0000 mgr.a (mgr.14388) 9325 : audit [DBG] from='client.207639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:54 smithi191 bash[24992]: cluster 2024-08-31T05:46:53.757043+0000 mgr.a (mgr.14388) 9326 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:54 smithi163 bash[24253]: cluster 2024-08-31T05:46:53.757043+0000 mgr.a (mgr.14388) 9326 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:54 smithi027 bash[22610]: cluster 2024-08-31T05:46:53.757043+0000 mgr.a (mgr.14388) 9326 : cluster [DBG] pgmap v6464: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:46:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:56 smithi191 bash[24992]: cluster 2024-08-31T05:46:55.757786+0000 mgr.a (mgr.14388) 9327 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:56 smithi163 bash[24253]: cluster 2024-08-31T05:46:55.757786+0000 mgr.a (mgr.14388) 9327 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:56 smithi027 bash[22610]: cluster 2024-08-31T05:46:55.757786+0000 mgr.a (mgr.14388) 9327 : cluster [DBG] pgmap v6465: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:57.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:46:57.703 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:46:57.703 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:46:58.468 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:46:58.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:46:58.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:46:58.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:46:58.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:46:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:59 smithi191 bash[24992]: cluster 2024-08-31T05:46:57.758532+0000 mgr.a (mgr.14388) 9328 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:46:59 smithi191 bash[24992]: audit 2024-08-31T05:46:58.046036+0000 mgr.a (mgr.14388) 9329 : audit [DBG] from='client.207717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:59 smithi163 bash[24253]: cluster 2024-08-31T05:46:57.758532+0000 mgr.a (mgr.14388) 9328 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:46:59 smithi163 bash[24253]: audit 2024-08-31T05:46:58.046036+0000 mgr.a (mgr.14388) 9329 : audit [DBG] from='client.207717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:46:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:59 smithi027 bash[22610]: cluster 2024-08-31T05:46:57.758532+0000 mgr.a (mgr.14388) 9328 : cluster [DBG] pgmap v6466: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:46:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:46:59 smithi027 bash[22610]: audit 2024-08-31T05:46:58.046036+0000 mgr.a (mgr.14388) 9329 : audit [DBG] from='client.207717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:01 smithi191 bash[24992]: cluster 2024-08-31T05:46:59.761236+0000 mgr.a (mgr.14388) 9330 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:01 smithi163 bash[24253]: cluster 2024-08-31T05:46:59.761236+0000 mgr.a (mgr.14388) 9330 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:01 smithi027 bash[22610]: cluster 2024-08-31T05:46:59.761236+0000 mgr.a (mgr.14388) 9330 : cluster [DBG] pgmap v6467: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:03 smithi191 bash[24992]: cluster 2024-08-31T05:47:01.762001+0000 mgr.a (mgr.14388) 9331 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:47:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:03 smithi163 bash[24253]: cluster 2024-08-31T05:47:01.762001+0000 mgr.a (mgr.14388) 9331 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:47:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:47:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:47:03.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:47:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:03 smithi027 bash[22610]: cluster 2024-08-31T05:47:01.762001+0000 mgr.a (mgr.14388) 9331 : cluster [DBG] pgmap v6468: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:47:04.241 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:47:04.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:47:04.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:47:04.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:47:04.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:47:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:05 smithi191 bash[24992]: cluster 2024-08-31T05:47:03.763971+0000 mgr.a (mgr.14388) 9332 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:05 smithi191 bash[24992]: audit 2024-08-31T05:47:03.808248+0000 mgr.a (mgr.14388) 9333 : audit [DBG] from='client.207795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:05 smithi163 bash[24253]: cluster 2024-08-31T05:47:03.763971+0000 mgr.a (mgr.14388) 9332 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:05 smithi163 bash[24253]: audit 2024-08-31T05:47:03.808248+0000 mgr.a (mgr.14388) 9333 : audit [DBG] from='client.207795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:05 smithi027 bash[22610]: cluster 2024-08-31T05:47:03.763971+0000 mgr.a (mgr.14388) 9332 : cluster [DBG] pgmap v6469: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:05 smithi027 bash[22610]: audit 2024-08-31T05:47:03.808248+0000 mgr.a (mgr.14388) 9333 : audit [DBG] from='client.207795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:07 smithi191 bash[24992]: cluster 2024-08-31T05:47:05.764837+0000 mgr.a (mgr.14388) 9334 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:47:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:07 smithi163 bash[24253]: cluster 2024-08-31T05:47:05.764837+0000 mgr.a (mgr.14388) 9334 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:47:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:07 smithi027 bash[22610]: cluster 2024-08-31T05:47:05.764837+0000 mgr.a (mgr.14388) 9334 : cluster [DBG] pgmap v6470: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:47:09.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:47:09.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:47:09.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:47:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:09 smithi191 bash[24992]: cluster 2024-08-31T05:47:07.765613+0000 mgr.a (mgr.14388) 9335 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:47:09.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:09 smithi163 bash[24253]: cluster 2024-08-31T05:47:07.765613+0000 mgr.a (mgr.14388) 9335 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:47:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:09 smithi027 bash[22610]: cluster 2024-08-31T05:47:07.765613+0000 mgr.a (mgr.14388) 9335 : cluster [DBG] pgmap v6471: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:47:10.022 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:47:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:47:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:47:10.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:47:10.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:47:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:10 smithi191 bash[24992]: audit 2024-08-31T05:47:09.578356+0000 mgr.a (mgr.14388) 9336 : audit [DBG] from='client.207873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:10 smithi163 bash[24253]: audit 2024-08-31T05:47:09.578356+0000 mgr.a (mgr.14388) 9336 : audit [DBG] from='client.207873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:10 smithi027 bash[22610]: audit 2024-08-31T05:47:09.578356+0000 mgr.a (mgr.14388) 9336 : audit [DBG] from='client.207873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:11 smithi191 bash[24992]: cluster 2024-08-31T05:47:09.767431+0000 mgr.a (mgr.14388) 9337 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:11 smithi163 bash[24253]: cluster 2024-08-31T05:47:09.767431+0000 mgr.a (mgr.14388) 9337 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:11 smithi027 bash[22610]: cluster 2024-08-31T05:47:09.767431+0000 mgr.a (mgr.14388) 9337 : cluster [DBG] pgmap v6472: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:13 smithi191 bash[24992]: cluster 2024-08-31T05:47:11.768430+0000 mgr.a (mgr.14388) 9338 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:13 smithi163 bash[24253]: cluster 2024-08-31T05:47:11.768430+0000 mgr.a (mgr.14388) 9338 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:13 smithi027 bash[22610]: cluster 2024-08-31T05:47:11.768430+0000 mgr.a (mgr.14388) 9338 : cluster [DBG] pgmap v6473: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:15.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:47:15.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:47:15.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:47:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:15 smithi163 bash[24253]: cluster 2024-08-31T05:47:13.770667+0000 mgr.a (mgr.14388) 9339 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:15.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:15 smithi027 bash[22610]: cluster 2024-08-31T05:47:13.770667+0000 mgr.a (mgr.14388) 9339 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:15 smithi191 bash[24992]: cluster 2024-08-31T05:47:13.770667+0000 mgr.a (mgr.14388) 9339 : cluster [DBG] pgmap v6474: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:15.773 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:47:15.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:47:15.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:47:15.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:47:15.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:47:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:16 smithi163 bash[24253]: audit 2024-08-31T05:47:15.348714+0000 mgr.a (mgr.14388) 9340 : audit [DBG] from='client.207948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:16.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:16 smithi027 bash[22610]: audit 2024-08-31T05:47:15.348714+0000 mgr.a (mgr.14388) 9340 : audit [DBG] from='client.207948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:16 smithi191 bash[24992]: audit 2024-08-31T05:47:15.348714+0000 mgr.a (mgr.14388) 9340 : audit [DBG] from='client.207948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:17.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:17 smithi163 bash[24253]: cluster 2024-08-31T05:47:15.771148+0000 mgr.a (mgr.14388) 9341 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:17 smithi027 bash[22610]: cluster 2024-08-31T05:47:15.771148+0000 mgr.a (mgr.14388) 9341 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:17 smithi191 bash[24992]: cluster 2024-08-31T05:47:15.771148+0000 mgr.a (mgr.14388) 9341 : cluster [DBG] pgmap v6475: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:19 smithi163 bash[24253]: cluster 2024-08-31T05:47:17.771879+0000 mgr.a (mgr.14388) 9342 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:19 smithi027 bash[22610]: cluster 2024-08-31T05:47:17.771879+0000 mgr.a (mgr.14388) 9342 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:19 smithi191 bash[24992]: cluster 2024-08-31T05:47:17.771879+0000 mgr.a (mgr.14388) 9342 : cluster [DBG] pgmap v6476: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:20.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:47:20.775 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:47:20.775 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:47:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:21 smithi163 bash[24253]: cluster 2024-08-31T05:47:19.774069+0000 mgr.a (mgr.14388) 9343 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:21.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:21 smithi027 bash[22610]: cluster 2024-08-31T05:47:19.774069+0000 mgr.a (mgr.14388) 9343 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:21.525 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:47:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:47:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:47:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:47:21.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:47:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:21 smithi191 bash[24992]: cluster 2024-08-31T05:47:19.774069+0000 mgr.a (mgr.14388) 9343 : cluster [DBG] pgmap v6477: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:22 smithi163 bash[24253]: audit 2024-08-31T05:47:21.110168+0000 mgr.a (mgr.14388) 9344 : audit [DBG] from='client.208023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:22 smithi027 bash[22610]: audit 2024-08-31T05:47:21.110168+0000 mgr.a (mgr.14388) 9344 : audit [DBG] from='client.208023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:22 smithi191 bash[24992]: audit 2024-08-31T05:47:21.110168+0000 mgr.a (mgr.14388) 9344 : audit [DBG] from='client.208023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:23 smithi163 bash[24253]: cluster 2024-08-31T05:47:21.774956+0000 mgr.a (mgr.14388) 9345 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:23 smithi027 bash[22610]: cluster 2024-08-31T05:47:21.774956+0000 mgr.a (mgr.14388) 9345 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:23 smithi191 bash[24992]: cluster 2024-08-31T05:47:21.774956+0000 mgr.a (mgr.14388) 9345 : cluster [DBG] pgmap v6478: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:25 smithi163 bash[24253]: cluster 2024-08-31T05:47:23.777186+0000 mgr.a (mgr.14388) 9346 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:25.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:25 smithi027 bash[22610]: cluster 2024-08-31T05:47:23.777186+0000 mgr.a (mgr.14388) 9346 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:25 smithi191 bash[24992]: cluster 2024-08-31T05:47:23.777186+0000 mgr.a (mgr.14388) 9346 : cluster [DBG] pgmap v6479: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:26.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:47:26.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:47:26.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:47:27.306 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:47:27.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:47:27.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:47:27.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:47:27.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:47:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:27 smithi163 bash[24253]: cluster 2024-08-31T05:47:25.777975+0000 mgr.a (mgr.14388) 9347 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:27 smithi027 bash[22610]: cluster 2024-08-31T05:47:25.777975+0000 mgr.a (mgr.14388) 9347 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:27 smithi191 bash[24992]: cluster 2024-08-31T05:47:25.777975+0000 mgr.a (mgr.14388) 9347 : cluster [DBG] pgmap v6480: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:28 smithi163 bash[24253]: audit 2024-08-31T05:47:26.862246+0000 mgr.a (mgr.14388) 9348 : audit [DBG] from='client.208098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:28 smithi027 bash[22610]: audit 2024-08-31T05:47:26.862246+0000 mgr.a (mgr.14388) 9348 : audit [DBG] from='client.208098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:28 smithi191 bash[24992]: audit 2024-08-31T05:47:26.862246+0000 mgr.a (mgr.14388) 9348 : audit [DBG] from='client.208098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:29 smithi163 bash[24253]: cluster 2024-08-31T05:47:27.779054+0000 mgr.a (mgr.14388) 9349 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:29 smithi027 bash[22610]: cluster 2024-08-31T05:47:27.779054+0000 mgr.a (mgr.14388) 9349 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:29 smithi191 bash[24992]: cluster 2024-08-31T05:47:27.779054+0000 mgr.a (mgr.14388) 9349 : cluster [DBG] pgmap v6481: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:31 smithi163 bash[24253]: cluster 2024-08-31T05:47:29.781299+0000 mgr.a (mgr.14388) 9350 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:31 smithi027 bash[22610]: cluster 2024-08-31T05:47:29.781299+0000 mgr.a (mgr.14388) 9350 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:31 smithi191 bash[24992]: cluster 2024-08-31T05:47:29.781299+0000 mgr.a (mgr.14388) 9350 : cluster [DBG] pgmap v6482: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:32.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:47:32.309 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:47:32.309 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:47:33.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:47:33.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:47:33.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:47:33.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:47:33.084 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:47:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:33 smithi163 bash[24253]: cluster 2024-08-31T05:47:31.782079+0000 mgr.a (mgr.14388) 9351 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:33 smithi163 bash[24253]: audit 2024-08-31T05:47:32.490473+0000 mon.a (mon.0) 1982 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:47:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:33 smithi163 bash[24253]: audit 2024-08-31T05:47:32.645947+0000 mgr.a (mgr.14388) 9352 : audit [DBG] from='client.208176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:33 smithi027 bash[22610]: cluster 2024-08-31T05:47:31.782079+0000 mgr.a (mgr.14388) 9351 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:33 smithi027 bash[22610]: audit 2024-08-31T05:47:32.490473+0000 mon.a (mon.0) 1982 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:47:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:33 smithi027 bash[22610]: audit 2024-08-31T05:47:32.645947+0000 mgr.a (mgr.14388) 9352 : audit [DBG] from='client.208176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:33 smithi191 bash[24992]: cluster 2024-08-31T05:47:31.782079+0000 mgr.a (mgr.14388) 9351 : cluster [DBG] pgmap v6483: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:33 smithi191 bash[24992]: audit 2024-08-31T05:47:32.490473+0000 mon.a (mon.0) 1982 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:47:33.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:33 smithi191 bash[24992]: audit 2024-08-31T05:47:32.645947+0000 mgr.a (mgr.14388) 9352 : audit [DBG] from='client.208176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:34 smithi163 bash[24253]: audit 2024-08-31T05:47:33.103618+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:34 smithi163 bash[24253]: audit 2024-08-31T05:47:33.109043+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:34 smithi163 bash[24253]: audit 2024-08-31T05:47:33.114265+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:34 smithi163 bash[24253]: audit 2024-08-31T05:47:33.119455+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:34 smithi163 bash[24253]: audit 2024-08-31T05:47:33.799268+0000 mon.a (mon.0) 1987 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:47:34.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:34 smithi163 bash[24253]: audit 2024-08-31T05:47:33.801385+0000 mon.a (mon.0) 1988 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:47:34.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:34 smithi163 bash[24253]: audit 2024-08-31T05:47:33.812067+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:34 smithi163 bash[24253]: audit 2024-08-31T05:47:33.816925+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:47:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:34 smithi027 bash[22610]: audit 2024-08-31T05:47:33.103618+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:34 smithi027 bash[22610]: audit 2024-08-31T05:47:33.109043+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:34 smithi027 bash[22610]: audit 2024-08-31T05:47:33.114265+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:34 smithi027 bash[22610]: audit 2024-08-31T05:47:33.119455+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:34 smithi027 bash[22610]: audit 2024-08-31T05:47:33.799268+0000 mon.a (mon.0) 1987 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:47:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:34 smithi027 bash[22610]: audit 2024-08-31T05:47:33.801385+0000 mon.a (mon.0) 1988 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:47:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:34 smithi027 bash[22610]: audit 2024-08-31T05:47:33.812067+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:34 smithi027 bash[22610]: audit 2024-08-31T05:47:33.816925+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:47:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:34 smithi191 bash[24992]: audit 2024-08-31T05:47:33.103618+0000 mon.a (mon.0) 1983 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:34 smithi191 bash[24992]: audit 2024-08-31T05:47:33.109043+0000 mon.a (mon.0) 1984 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:34 smithi191 bash[24992]: audit 2024-08-31T05:47:33.114265+0000 mon.a (mon.0) 1985 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:34 smithi191 bash[24992]: audit 2024-08-31T05:47:33.119455+0000 mon.a (mon.0) 1986 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:34 smithi191 bash[24992]: audit 2024-08-31T05:47:33.799268+0000 mon.a (mon.0) 1987 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:47:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:34 smithi191 bash[24992]: audit 2024-08-31T05:47:33.801385+0000 mon.a (mon.0) 1988 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:47:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:34 smithi191 bash[24992]: audit 2024-08-31T05:47:33.812067+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:47:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:34 smithi191 bash[24992]: audit 2024-08-31T05:47:33.816925+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:47:34.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:47:34 smithi027 bash[22863]: debug 2024-08-31T05:47:34.552+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:47:34.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:47:34 smithi027 bash[22863]: debug 2024-08-31T05:47:34.552+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:47:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:35 smithi163 bash[24253]: cluster 2024-08-31T05:47:33.784353+0000 mgr.a (mgr.14388) 9353 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:47:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:35 smithi163 bash[24253]: audit 2024-08-31T05:47:33.819457+0000 mgr.a (mgr.14388) 9354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:47:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:35 smithi163 bash[24253]: audit 2024-08-31T05:47:34.556517+0000 mgr.a (mgr.14388) 9355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:47:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:35 smithi163 bash[24253]: cephadm 2024-08-31T05:47:34.557861+0000 mgr.a (mgr.14388) 9356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:47:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:35 smithi027 bash[22610]: cluster 2024-08-31T05:47:33.784353+0000 mgr.a (mgr.14388) 9353 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:47:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:35 smithi027 bash[22610]: audit 2024-08-31T05:47:33.819457+0000 mgr.a (mgr.14388) 9354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:47:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:35 smithi027 bash[22610]: audit 2024-08-31T05:47:34.556517+0000 mgr.a (mgr.14388) 9355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:47:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:35 smithi027 bash[22610]: cephadm 2024-08-31T05:47:34.557861+0000 mgr.a (mgr.14388) 9356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:47:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:35 smithi191 bash[24992]: cluster 2024-08-31T05:47:33.784353+0000 mgr.a (mgr.14388) 9353 : cluster [DBG] pgmap v6484: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:47:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:35 smithi191 bash[24992]: audit 2024-08-31T05:47:33.819457+0000 mgr.a (mgr.14388) 9354 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:47:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:35 smithi191 bash[24992]: audit 2024-08-31T05:47:34.556517+0000 mgr.a (mgr.14388) 9355 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:47:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:35 smithi191 bash[24992]: cephadm 2024-08-31T05:47:34.557861+0000 mgr.a (mgr.14388) 9356 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:47:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:37 smithi163 bash[24253]: cluster 2024-08-31T05:47:35.785270+0000 mgr.a (mgr.14388) 9357 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:47:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:37 smithi027 bash[22610]: cluster 2024-08-31T05:47:35.785270+0000 mgr.a (mgr.14388) 9357 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:47:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:37 smithi191 bash[24992]: cluster 2024-08-31T05:47:35.785270+0000 mgr.a (mgr.14388) 9357 : cluster [DBG] pgmap v6485: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:47:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:47:38.085 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:47:38.086 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:47:38.859 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:47:38.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:47:38.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:47:38.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:47:38.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:47:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:39 smithi163 bash[24253]: cluster 2024-08-31T05:47:37.786043+0000 mgr.a (mgr.14388) 9358 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:47:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:39 smithi163 bash[24253]: audit 2024-08-31T05:47:38.419217+0000 mgr.a (mgr.14388) 9359 : audit [DBG] from='client.208356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:39 smithi027 bash[22610]: cluster 2024-08-31T05:47:37.786043+0000 mgr.a (mgr.14388) 9358 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:47:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:39 smithi027 bash[22610]: audit 2024-08-31T05:47:38.419217+0000 mgr.a (mgr.14388) 9359 : audit [DBG] from='client.208356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:39 smithi191 bash[24992]: cluster 2024-08-31T05:47:37.786043+0000 mgr.a (mgr.14388) 9358 : cluster [DBG] pgmap v6486: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:47:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:39 smithi191 bash[24992]: audit 2024-08-31T05:47:38.419217+0000 mgr.a (mgr.14388) 9359 : audit [DBG] from='client.208356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:41 smithi163 bash[24253]: cluster 2024-08-31T05:47:39.788875+0000 mgr.a (mgr.14388) 9360 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:47:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:41 smithi027 bash[22610]: cluster 2024-08-31T05:47:39.788875+0000 mgr.a (mgr.14388) 9360 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:47:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:41 smithi191 bash[24992]: cluster 2024-08-31T05:47:39.788875+0000 mgr.a (mgr.14388) 9360 : cluster [DBG] pgmap v6487: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:47:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:43 smithi163 bash[24253]: cluster 2024-08-31T05:47:41.789658+0000 mgr.a (mgr.14388) 9361 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:47:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:43 smithi027 bash[22610]: cluster 2024-08-31T05:47:41.789658+0000 mgr.a (mgr.14388) 9361 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:47:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:43 smithi191 bash[24992]: cluster 2024-08-31T05:47:41.789658+0000 mgr.a (mgr.14388) 9361 : cluster [DBG] pgmap v6488: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:47:43.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:47:43.861 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:47:43.861 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:47:44.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:47:44.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:47:44.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:47:44.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:47:44.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:47:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:45 smithi163 bash[24253]: cluster 2024-08-31T05:47:43.791675+0000 mgr.a (mgr.14388) 9362 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:47:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:45 smithi163 bash[24253]: audit 2024-08-31T05:47:44.193626+0000 mgr.a (mgr.14388) 9363 : audit [DBG] from='client.208428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:45 smithi027 bash[22610]: cluster 2024-08-31T05:47:43.791675+0000 mgr.a (mgr.14388) 9362 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:47:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:45 smithi027 bash[22610]: audit 2024-08-31T05:47:44.193626+0000 mgr.a (mgr.14388) 9363 : audit [DBG] from='client.208428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:45 smithi191 bash[24992]: cluster 2024-08-31T05:47:43.791675+0000 mgr.a (mgr.14388) 9362 : cluster [DBG] pgmap v6489: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:47:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:45 smithi191 bash[24992]: audit 2024-08-31T05:47:44.193626+0000 mgr.a (mgr.14388) 9363 : audit [DBG] from='client.208428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:47 smithi163 bash[24253]: cluster 2024-08-31T05:47:45.792625+0000 mgr.a (mgr.14388) 9364 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:47:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:47 smithi027 bash[22610]: cluster 2024-08-31T05:47:45.792625+0000 mgr.a (mgr.14388) 9364 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:47:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:47 smithi191 bash[24992]: cluster 2024-08-31T05:47:45.792625+0000 mgr.a (mgr.14388) 9364 : cluster [DBG] pgmap v6490: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:47:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:49 smithi163 bash[24253]: cluster 2024-08-31T05:47:47.793400+0000 mgr.a (mgr.14388) 9365 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:47:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:49 smithi027 bash[22610]: cluster 2024-08-31T05:47:47.793400+0000 mgr.a (mgr.14388) 9365 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:47:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:49 smithi191 bash[24992]: cluster 2024-08-31T05:47:47.793400+0000 mgr.a (mgr.14388) 9365 : cluster [DBG] pgmap v6491: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:47:49.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:47:49.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:47:49.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:47:50.363 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:47:50.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:47:50.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:47:50.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:47:50.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:47:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:51 smithi163 bash[24253]: cluster 2024-08-31T05:47:49.795702+0000 mgr.a (mgr.14388) 9366 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:47:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:51 smithi163 bash[24253]: audit 2024-08-31T05:47:49.932167+0000 mgr.a (mgr.14388) 9367 : audit [DBG] from='client.208506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:51 smithi027 bash[22610]: cluster 2024-08-31T05:47:49.795702+0000 mgr.a (mgr.14388) 9366 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:47:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:51 smithi027 bash[22610]: audit 2024-08-31T05:47:49.932167+0000 mgr.a (mgr.14388) 9367 : audit [DBG] from='client.208506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:51 smithi191 bash[24992]: cluster 2024-08-31T05:47:49.795702+0000 mgr.a (mgr.14388) 9366 : cluster [DBG] pgmap v6492: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:47:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:51 smithi191 bash[24992]: audit 2024-08-31T05:47:49.932167+0000 mgr.a (mgr.14388) 9367 : audit [DBG] from='client.208506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:53 smithi163 bash[24253]: cluster 2024-08-31T05:47:51.796718+0000 mgr.a (mgr.14388) 9368 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:53 smithi027 bash[22610]: cluster 2024-08-31T05:47:51.796718+0000 mgr.a (mgr.14388) 9368 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:53 smithi191 bash[24992]: cluster 2024-08-31T05:47:51.796718+0000 mgr.a (mgr.14388) 9368 : cluster [DBG] pgmap v6493: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:55.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:47:55.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:47:55.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:47:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:55 smithi163 bash[24253]: cluster 2024-08-31T05:47:53.799010+0000 mgr.a (mgr.14388) 9369 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:55 smithi027 bash[22610]: cluster 2024-08-31T05:47:53.799010+0000 mgr.a (mgr.14388) 9369 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:55 smithi191 bash[24992]: cluster 2024-08-31T05:47:53.799010+0000 mgr.a (mgr.14388) 9369 : cluster [DBG] pgmap v6494: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:47:56.131 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:47:56.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:47:56.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:47:56.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:47:56.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:47:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:57 smithi163 bash[24253]: audit 2024-08-31T05:47:55.703322+0000 mgr.a (mgr.14388) 9370 : audit [DBG] from='client.208578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:57 smithi163 bash[24253]: cluster 2024-08-31T05:47:55.799514+0000 mgr.a (mgr.14388) 9371 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:57 smithi027 bash[22610]: audit 2024-08-31T05:47:55.703322+0000 mgr.a (mgr.14388) 9370 : audit [DBG] from='client.208578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:57 smithi027 bash[22610]: cluster 2024-08-31T05:47:55.799514+0000 mgr.a (mgr.14388) 9371 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:57 smithi191 bash[24992]: audit 2024-08-31T05:47:55.703322+0000 mgr.a (mgr.14388) 9370 : audit [DBG] from='client.208578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:47:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:57 smithi191 bash[24992]: cluster 2024-08-31T05:47:55.799514+0000 mgr.a (mgr.14388) 9371 : cluster [DBG] pgmap v6495: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:47:59 smithi163 bash[24253]: cluster 2024-08-31T05:47:57.800305+0000 mgr.a (mgr.14388) 9372 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:47:59 smithi027 bash[22610]: cluster 2024-08-31T05:47:57.800305+0000 mgr.a (mgr.14388) 9372 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:47:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:47:59 smithi191 bash[24992]: cluster 2024-08-31T05:47:57.800305+0000 mgr.a (mgr.14388) 9372 : cluster [DBG] pgmap v6496: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:01.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:01.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:01.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:01 smithi163 bash[24253]: cluster 2024-08-31T05:47:59.802541+0000 mgr.a (mgr.14388) 9373 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:01 smithi027 bash[22610]: cluster 2024-08-31T05:47:59.802541+0000 mgr.a (mgr.14388) 9373 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:01 smithi191 bash[24992]: cluster 2024-08-31T05:47:59.802541+0000 mgr.a (mgr.14388) 9373 : cluster [DBG] pgmap v6497: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:01.877 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:01.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:01.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:01.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:01.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:02 smithi163 bash[24253]: audit 2024-08-31T05:48:01.464122+0000 mgr.a (mgr.14388) 9374 : audit [DBG] from='client.208650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:02 smithi027 bash[22610]: audit 2024-08-31T05:48:01.464122+0000 mgr.a (mgr.14388) 9374 : audit [DBG] from='client.208650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:02 smithi191 bash[24992]: audit 2024-08-31T05:48:01.464122+0000 mgr.a (mgr.14388) 9374 : audit [DBG] from='client.208650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:03 smithi163 bash[24253]: cluster 2024-08-31T05:48:01.803048+0000 mgr.a (mgr.14388) 9375 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:03 smithi027 bash[22610]: cluster 2024-08-31T05:48:01.803048+0000 mgr.a (mgr.14388) 9375 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:03 smithi191 bash[24992]: cluster 2024-08-31T05:48:01.803048+0000 mgr.a (mgr.14388) 9375 : cluster [DBG] pgmap v6498: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:05 smithi163 bash[24253]: cluster 2024-08-31T05:48:03.805238+0000 mgr.a (mgr.14388) 9376 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:05 smithi027 bash[22610]: cluster 2024-08-31T05:48:03.805238+0000 mgr.a (mgr.14388) 9376 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:05 smithi191 bash[24992]: cluster 2024-08-31T05:48:03.805238+0000 mgr.a (mgr.14388) 9376 : cluster [DBG] pgmap v6499: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:06.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:06.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:06.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:07 smithi163 bash[24253]: cluster 2024-08-31T05:48:05.805988+0000 mgr.a (mgr.14388) 9377 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:07 smithi027 bash[22610]: cluster 2024-08-31T05:48:05.805988+0000 mgr.a (mgr.14388) 9377 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:07 smithi191 bash[24992]: cluster 2024-08-31T05:48:05.805988+0000 mgr.a (mgr.14388) 9377 : cluster [DBG] pgmap v6500: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:07.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:07.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:07.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:07.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:07.650 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:08 smithi027 bash[22610]: audit 2024-08-31T05:48:07.212871+0000 mgr.a (mgr.14388) 9378 : audit [DBG] from='client.208725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:08 smithi191 bash[24992]: audit 2024-08-31T05:48:07.212871+0000 mgr.a (mgr.14388) 9378 : audit [DBG] from='client.208725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:08 smithi163 bash[24253]: audit 2024-08-31T05:48:07.212871+0000 mgr.a (mgr.14388) 9378 : audit [DBG] from='client.208725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:09 smithi027 bash[22610]: cluster 2024-08-31T05:48:07.806915+0000 mgr.a (mgr.14388) 9379 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:09 smithi191 bash[24992]: cluster 2024-08-31T05:48:07.806915+0000 mgr.a (mgr.14388) 9379 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:09 smithi163 bash[24253]: cluster 2024-08-31T05:48:07.806915+0000 mgr.a (mgr.14388) 9379 : cluster [DBG] pgmap v6501: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:11 smithi027 bash[22610]: cluster 2024-08-31T05:48:09.809113+0000 mgr.a (mgr.14388) 9380 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:11 smithi191 bash[24992]: cluster 2024-08-31T05:48:09.809113+0000 mgr.a (mgr.14388) 9380 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:11 smithi163 bash[24253]: cluster 2024-08-31T05:48:09.809113+0000 mgr.a (mgr.14388) 9380 : cluster [DBG] pgmap v6502: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:12.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:12.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:12.652 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:13.389 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:13.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:13.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:13.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:13.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:13 smithi027 bash[22610]: cluster 2024-08-31T05:48:11.809884+0000 mgr.a (mgr.14388) 9381 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:13 smithi191 bash[24992]: cluster 2024-08-31T05:48:11.809884+0000 mgr.a (mgr.14388) 9381 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:13 smithi163 bash[24253]: cluster 2024-08-31T05:48:11.809884+0000 mgr.a (mgr.14388) 9381 : cluster [DBG] pgmap v6503: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:14 smithi027 bash[22610]: audit 2024-08-31T05:48:12.977331+0000 mgr.a (mgr.14388) 9382 : audit [DBG] from='client.208800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:14 smithi191 bash[24992]: audit 2024-08-31T05:48:12.977331+0000 mgr.a (mgr.14388) 9382 : audit [DBG] from='client.208800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:14 smithi163 bash[24253]: audit 2024-08-31T05:48:12.977331+0000 mgr.a (mgr.14388) 9382 : audit [DBG] from='client.208800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:15 smithi027 bash[22610]: cluster 2024-08-31T05:48:13.812642+0000 mgr.a (mgr.14388) 9383 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:15 smithi191 bash[24992]: cluster 2024-08-31T05:48:13.812642+0000 mgr.a (mgr.14388) 9383 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:15 smithi163 bash[24253]: cluster 2024-08-31T05:48:13.812642+0000 mgr.a (mgr.14388) 9383 : cluster [DBG] pgmap v6504: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:17 smithi027 bash[22610]: cluster 2024-08-31T05:48:15.813413+0000 mgr.a (mgr.14388) 9384 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:48:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:17 smithi191 bash[24992]: cluster 2024-08-31T05:48:15.813413+0000 mgr.a (mgr.14388) 9384 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:48:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:17 smithi163 bash[24253]: cluster 2024-08-31T05:48:15.813413+0000 mgr.a (mgr.14388) 9384 : cluster [DBG] pgmap v6505: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:48:18.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:18.392 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:18.392 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:19.147 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:19.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:19.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:19.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:19.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:19 smithi191 bash[24992]: cluster 2024-08-31T05:48:17.814244+0000 mgr.a (mgr.14388) 9385 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:48:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:19 smithi163 bash[24253]: cluster 2024-08-31T05:48:17.814244+0000 mgr.a (mgr.14388) 9385 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:48:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:19 smithi027 bash[22610]: cluster 2024-08-31T05:48:17.814244+0000 mgr.a (mgr.14388) 9385 : cluster [DBG] pgmap v6506: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:48:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:20 smithi191 bash[24992]: audit 2024-08-31T05:48:18.724669+0000 mgr.a (mgr.14388) 9386 : audit [DBG] from='client.208878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:20 smithi163 bash[24253]: audit 2024-08-31T05:48:18.724669+0000 mgr.a (mgr.14388) 9386 : audit [DBG] from='client.208878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:20 smithi027 bash[22610]: audit 2024-08-31T05:48:18.724669+0000 mgr.a (mgr.14388) 9386 : audit [DBG] from='client.208878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:21 smithi191 bash[24992]: cluster 2024-08-31T05:48:19.817077+0000 mgr.a (mgr.14388) 9387 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:21 smithi163 bash[24253]: cluster 2024-08-31T05:48:19.817077+0000 mgr.a (mgr.14388) 9387 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:21 smithi027 bash[22610]: cluster 2024-08-31T05:48:19.817077+0000 mgr.a (mgr.14388) 9387 : cluster [DBG] pgmap v6507: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:23 smithi191 bash[24992]: cluster 2024-08-31T05:48:21.817901+0000 mgr.a (mgr.14388) 9388 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:48:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:23 smithi163 bash[24253]: cluster 2024-08-31T05:48:21.817901+0000 mgr.a (mgr.14388) 9388 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:48:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:23 smithi027 bash[22610]: cluster 2024-08-31T05:48:21.817901+0000 mgr.a (mgr.14388) 9388 : cluster [DBG] pgmap v6508: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:48:24.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:24.150 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:24.892 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:24.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:24.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:24.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:24.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:25 smithi191 bash[24992]: cluster 2024-08-31T05:48:23.819961+0000 mgr.a (mgr.14388) 9389 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:25 smithi191 bash[24992]: audit 2024-08-31T05:48:24.482590+0000 mgr.a (mgr.14388) 9390 : audit [DBG] from='client.208956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:25 smithi163 bash[24253]: cluster 2024-08-31T05:48:23.819961+0000 mgr.a (mgr.14388) 9389 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:25 smithi163 bash[24253]: audit 2024-08-31T05:48:24.482590+0000 mgr.a (mgr.14388) 9390 : audit [DBG] from='client.208956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:25 smithi027 bash[22610]: cluster 2024-08-31T05:48:23.819961+0000 mgr.a (mgr.14388) 9389 : cluster [DBG] pgmap v6509: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:25 smithi027 bash[22610]: audit 2024-08-31T05:48:24.482590+0000 mgr.a (mgr.14388) 9390 : audit [DBG] from='client.208956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:27 smithi191 bash[24992]: cluster 2024-08-31T05:48:25.820921+0000 mgr.a (mgr.14388) 9391 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:27 smithi163 bash[24253]: cluster 2024-08-31T05:48:25.820921+0000 mgr.a (mgr.14388) 9391 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:27 smithi027 bash[22610]: cluster 2024-08-31T05:48:25.820921+0000 mgr.a (mgr.14388) 9391 : cluster [DBG] pgmap v6510: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:29.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:29 smithi191 bash[24992]: cluster 2024-08-31T05:48:27.821695+0000 mgr.a (mgr.14388) 9392 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:29 smithi163 bash[24253]: cluster 2024-08-31T05:48:27.821695+0000 mgr.a (mgr.14388) 9392 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:29 smithi027 bash[22610]: cluster 2024-08-31T05:48:27.821695+0000 mgr.a (mgr.14388) 9392 : cluster [DBG] pgmap v6511: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:29.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:29.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:29.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:30.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:30.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:30.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:30.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:30.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:31 smithi191 bash[24992]: cluster 2024-08-31T05:48:29.823927+0000 mgr.a (mgr.14388) 9393 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:31.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:31 smithi191 bash[24992]: audit 2024-08-31T05:48:30.233007+0000 mgr.a (mgr.14388) 9394 : audit [DBG] from='client.209034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:31 smithi163 bash[24253]: cluster 2024-08-31T05:48:29.823927+0000 mgr.a (mgr.14388) 9393 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:31 smithi163 bash[24253]: audit 2024-08-31T05:48:30.233007+0000 mgr.a (mgr.14388) 9394 : audit [DBG] from='client.209034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:31 smithi027 bash[22610]: cluster 2024-08-31T05:48:29.823927+0000 mgr.a (mgr.14388) 9393 : cluster [DBG] pgmap v6512: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:31 smithi027 bash[22610]: audit 2024-08-31T05:48:30.233007+0000 mgr.a (mgr.14388) 9394 : audit [DBG] from='client.209034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:33 smithi191 bash[24992]: cluster 2024-08-31T05:48:31.824880+0000 mgr.a (mgr.14388) 9395 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:33 smithi163 bash[24253]: cluster 2024-08-31T05:48:31.824880+0000 mgr.a (mgr.14388) 9395 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:33 smithi027 bash[22610]: cluster 2024-08-31T05:48:31.824880+0000 mgr.a (mgr.14388) 9395 : cluster [DBG] pgmap v6513: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:35 smithi191 bash[24992]: cluster 2024-08-31T05:48:33.827123+0000 mgr.a (mgr.14388) 9396 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:35 smithi191 bash[24992]: audit 2024-08-31T05:48:34.614353+0000 mon.a (mon.0) 1991 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:48:35.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:35.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:35.671 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:35 smithi163 bash[24253]: cluster 2024-08-31T05:48:33.827123+0000 mgr.a (mgr.14388) 9396 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:35 smithi163 bash[24253]: audit 2024-08-31T05:48:34.614353+0000 mon.a (mon.0) 1991 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:48:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:35 smithi027 bash[22610]: cluster 2024-08-31T05:48:33.827123+0000 mgr.a (mgr.14388) 9396 : cluster [DBG] pgmap v6514: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:48:35.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:35 smithi027 bash[22610]: audit 2024-08-31T05:48:34.614353+0000 mon.a (mon.0) 1991 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:48:36.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:48:36 smithi027 bash[22863]: debug 2024-08-31T05:48:36.190+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:48:36.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:48:36 smithi027 bash[22863]: debug 2024-08-31T05:48:36.202+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:48:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:36 smithi027 bash[22610]: audit 2024-08-31T05:48:35.436499+0000 mon.a (mon.0) 1992 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:48:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:36 smithi027 bash[22610]: audit 2024-08-31T05:48:35.438293+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:48:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:36 smithi027 bash[22610]: audit 2024-08-31T05:48:35.448558+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:48:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:36 smithi027 bash[22610]: audit 2024-08-31T05:48:35.453272+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:48:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:36 smithi027 bash[22610]: audit 2024-08-31T05:48:35.454653+0000 mgr.a (mgr.14388) 9397 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:48:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:36 smithi191 bash[24992]: audit 2024-08-31T05:48:35.436499+0000 mon.a (mon.0) 1992 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:48:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:36 smithi191 bash[24992]: audit 2024-08-31T05:48:35.438293+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:48:36.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:36 smithi191 bash[24992]: audit 2024-08-31T05:48:35.448558+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:48:36.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:36 smithi191 bash[24992]: audit 2024-08-31T05:48:35.453272+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:48:36.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:36 smithi191 bash[24992]: audit 2024-08-31T05:48:35.454653+0000 mgr.a (mgr.14388) 9397 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:48:36.593 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:36.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:36.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:36.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:36.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:36 smithi163 bash[24253]: audit 2024-08-31T05:48:35.436499+0000 mon.a (mon.0) 1992 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:48:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:36 smithi163 bash[24253]: audit 2024-08-31T05:48:35.438293+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:48:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:36 smithi163 bash[24253]: audit 2024-08-31T05:48:35.448558+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:48:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:36 smithi163 bash[24253]: audit 2024-08-31T05:48:35.453272+0000 mon.a (mon.0) 1995 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:48:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:36 smithi163 bash[24253]: audit 2024-08-31T05:48:35.454653+0000 mgr.a (mgr.14388) 9397 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:48:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:37 smithi163 bash[24253]: cluster 2024-08-31T05:48:35.827772+0000 mgr.a (mgr.14388) 9398 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:37 smithi163 bash[24253]: audit 2024-08-31T05:48:35.999927+0000 mgr.a (mgr.14388) 9399 : audit [DBG] from='client.209166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:37 smithi163 bash[24253]: audit 2024-08-31T05:48:36.193355+0000 mgr.a (mgr.14388) 9400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:48:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:37 smithi163 bash[24253]: cephadm 2024-08-31T05:48:36.206565+0000 mgr.a (mgr.14388) 9401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:48:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:37 smithi027 bash[22610]: cluster 2024-08-31T05:48:35.827772+0000 mgr.a (mgr.14388) 9398 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:37 smithi027 bash[22610]: audit 2024-08-31T05:48:35.999927+0000 mgr.a (mgr.14388) 9399 : audit [DBG] from='client.209166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:37 smithi027 bash[22610]: audit 2024-08-31T05:48:36.193355+0000 mgr.a (mgr.14388) 9400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:48:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:37 smithi027 bash[22610]: cephadm 2024-08-31T05:48:36.206565+0000 mgr.a (mgr.14388) 9401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:48:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:37 smithi191 bash[24992]: cluster 2024-08-31T05:48:35.827772+0000 mgr.a (mgr.14388) 9398 : cluster [DBG] pgmap v6515: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:37.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:37 smithi191 bash[24992]: audit 2024-08-31T05:48:35.999927+0000 mgr.a (mgr.14388) 9399 : audit [DBG] from='client.209166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:37.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:37 smithi191 bash[24992]: audit 2024-08-31T05:48:36.193355+0000 mgr.a (mgr.14388) 9400 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:48:37.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:37 smithi191 bash[24992]: cephadm 2024-08-31T05:48:36.206565+0000 mgr.a (mgr.14388) 9401 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:48:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:39 smithi027 bash[22610]: cluster 2024-08-31T05:48:37.828632+0000 mgr.a (mgr.14388) 9402 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:39 smithi191 bash[24992]: cluster 2024-08-31T05:48:37.828632+0000 mgr.a (mgr.14388) 9402 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:39 smithi163 bash[24253]: cluster 2024-08-31T05:48:37.828632+0000 mgr.a (mgr.14388) 9402 : cluster [DBG] pgmap v6516: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:41.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:41.595 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:41.595 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:41.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:41 smithi027 bash[22610]: cluster 2024-08-31T05:48:39.830927+0000 mgr.a (mgr.14388) 9403 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:41 smithi191 bash[24992]: cluster 2024-08-31T05:48:39.830927+0000 mgr.a (mgr.14388) 9403 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:41 smithi163 bash[24253]: cluster 2024-08-31T05:48:39.830927+0000 mgr.a (mgr.14388) 9403 : cluster [DBG] pgmap v6517: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:42.368 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:42.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:42.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:42.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:42.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:43 smithi027 bash[22610]: cluster 2024-08-31T05:48:41.831663+0000 mgr.a (mgr.14388) 9404 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:43 smithi027 bash[22610]: audit 2024-08-31T05:48:41.934252+0000 mgr.a (mgr.14388) 9405 : audit [DBG] from='client.209295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:43 smithi191 bash[24992]: cluster 2024-08-31T05:48:41.831663+0000 mgr.a (mgr.14388) 9404 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:43 smithi191 bash[24992]: audit 2024-08-31T05:48:41.934252+0000 mgr.a (mgr.14388) 9405 : audit [DBG] from='client.209295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:43 smithi163 bash[24253]: cluster 2024-08-31T05:48:41.831663+0000 mgr.a (mgr.14388) 9404 : cluster [DBG] pgmap v6518: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:43 smithi163 bash[24253]: audit 2024-08-31T05:48:41.934252+0000 mgr.a (mgr.14388) 9405 : audit [DBG] from='client.209295 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:45 smithi027 bash[22610]: cluster 2024-08-31T05:48:43.834085+0000 mgr.a (mgr.14388) 9406 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:45 smithi191 bash[24992]: cluster 2024-08-31T05:48:43.834085+0000 mgr.a (mgr.14388) 9406 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:45 smithi163 bash[24253]: cluster 2024-08-31T05:48:43.834085+0000 mgr.a (mgr.14388) 9406 : cluster [DBG] pgmap v6519: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:47.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:47.370 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:47.370 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:47.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:47 smithi027 bash[22610]: cluster 2024-08-31T05:48:45.835065+0000 mgr.a (mgr.14388) 9407 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:47 smithi191 bash[24992]: cluster 2024-08-31T05:48:45.835065+0000 mgr.a (mgr.14388) 9407 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:47 smithi163 bash[24253]: cluster 2024-08-31T05:48:45.835065+0000 mgr.a (mgr.14388) 9407 : cluster [DBG] pgmap v6520: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:48.112 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:48.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:48.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:48.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:48.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:49 smithi027 bash[22610]: audit 2024-08-31T05:48:47.704618+0000 mgr.a (mgr.14388) 9408 : audit [DBG] from='client.209373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:49 smithi027 bash[22610]: cluster 2024-08-31T05:48:47.835755+0000 mgr.a (mgr.14388) 9409 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:49 smithi191 bash[24992]: audit 2024-08-31T05:48:47.704618+0000 mgr.a (mgr.14388) 9408 : audit [DBG] from='client.209373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:49 smithi191 bash[24992]: cluster 2024-08-31T05:48:47.835755+0000 mgr.a (mgr.14388) 9409 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:49 smithi163 bash[24253]: audit 2024-08-31T05:48:47.704618+0000 mgr.a (mgr.14388) 9408 : audit [DBG] from='client.209373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:49 smithi163 bash[24253]: cluster 2024-08-31T05:48:47.835755+0000 mgr.a (mgr.14388) 9409 : cluster [DBG] pgmap v6521: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:51 smithi027 bash[22610]: cluster 2024-08-31T05:48:49.838162+0000 mgr.a (mgr.14388) 9410 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:51 smithi191 bash[24992]: cluster 2024-08-31T05:48:49.838162+0000 mgr.a (mgr.14388) 9410 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:51 smithi163 bash[24253]: cluster 2024-08-31T05:48:49.838162+0000 mgr.a (mgr.14388) 9410 : cluster [DBG] pgmap v6522: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:48:53.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:53.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:53.115 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:53 smithi191 bash[24992]: cluster 2024-08-31T05:48:51.838947+0000 mgr.a (mgr.14388) 9411 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:48:53.849 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:53.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:53.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:53.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:53.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:53 smithi163 bash[24253]: cluster 2024-08-31T05:48:51.838947+0000 mgr.a (mgr.14388) 9411 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:48:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:53 smithi027 bash[22610]: cluster 2024-08-31T05:48:51.838947+0000 mgr.a (mgr.14388) 9411 : cluster [DBG] pgmap v6523: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:48:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:54 smithi191 bash[24992]: audit 2024-08-31T05:48:53.440113+0000 mgr.a (mgr.14388) 9412 : audit [DBG] from='client.209451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:54 smithi163 bash[24253]: audit 2024-08-31T05:48:53.440113+0000 mgr.a (mgr.14388) 9412 : audit [DBG] from='client.209451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:54 smithi027 bash[22610]: audit 2024-08-31T05:48:53.440113+0000 mgr.a (mgr.14388) 9412 : audit [DBG] from='client.209451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:48:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:55 smithi191 bash[24992]: cluster 2024-08-31T05:48:53.840213+0000 mgr.a (mgr.14388) 9413 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:55 smithi163 bash[24253]: cluster 2024-08-31T05:48:53.840213+0000 mgr.a (mgr.14388) 9413 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:55 smithi027 bash[22610]: cluster 2024-08-31T05:48:53.840213+0000 mgr.a (mgr.14388) 9413 : cluster [DBG] pgmap v6524: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:48:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:57 smithi191 bash[24992]: cluster 2024-08-31T05:48:55.840953+0000 mgr.a (mgr.14388) 9414 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:48:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:57 smithi163 bash[24253]: cluster 2024-08-31T05:48:55.840953+0000 mgr.a (mgr.14388) 9414 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:48:57.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:57 smithi027 bash[22610]: cluster 2024-08-31T05:48:55.840953+0000 mgr.a (mgr.14388) 9414 : cluster [DBG] pgmap v6525: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:48:58.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:48:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:48:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:48:59.637 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:48:59.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:48:59.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:48:59.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:48:59.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:48:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:48:59 smithi191 bash[24992]: cluster 2024-08-31T05:48:57.841745+0000 mgr.a (mgr.14388) 9415 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:48:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:48:59 smithi163 bash[24253]: cluster 2024-08-31T05:48:57.841745+0000 mgr.a (mgr.14388) 9415 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:48:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:48:59 smithi027 bash[22610]: cluster 2024-08-31T05:48:57.841745+0000 mgr.a (mgr.14388) 9415 : cluster [DBG] pgmap v6526: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:49:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:00 smithi191 bash[24992]: audit 2024-08-31T05:48:59.190306+0000 mgr.a (mgr.14388) 9416 : audit [DBG] from='client.209529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:00 smithi163 bash[24253]: audit 2024-08-31T05:48:59.190306+0000 mgr.a (mgr.14388) 9416 : audit [DBG] from='client.209529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:00 smithi027 bash[22610]: audit 2024-08-31T05:48:59.190306+0000 mgr.a (mgr.14388) 9416 : audit [DBG] from='client.209529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:01 smithi191 bash[24992]: cluster 2024-08-31T05:48:59.844576+0000 mgr.a (mgr.14388) 9417 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:01 smithi163 bash[24253]: cluster 2024-08-31T05:48:59.844576+0000 mgr.a (mgr.14388) 9417 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:01 smithi027 bash[22610]: cluster 2024-08-31T05:48:59.844576+0000 mgr.a (mgr.14388) 9417 : cluster [DBG] pgmap v6527: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:03 smithi191 bash[24992]: cluster 2024-08-31T05:49:01.845375+0000 mgr.a (mgr.14388) 9418 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:49:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:03 smithi163 bash[24253]: cluster 2024-08-31T05:49:01.845375+0000 mgr.a (mgr.14388) 9418 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:49:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:03 smithi027 bash[22610]: cluster 2024-08-31T05:49:01.845375+0000 mgr.a (mgr.14388) 9418 : cluster [DBG] pgmap v6528: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:49:04.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:49:04.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:49:04.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:49:05.425 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:49:05.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:49:05.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:49:05.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:49:05.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:49:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:05 smithi191 bash[24992]: cluster 2024-08-31T05:49:03.847406+0000 mgr.a (mgr.14388) 9419 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:49:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:05 smithi163 bash[24253]: cluster 2024-08-31T05:49:03.847406+0000 mgr.a (mgr.14388) 9419 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:49:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:05 smithi027 bash[22610]: cluster 2024-08-31T05:49:03.847406+0000 mgr.a (mgr.14388) 9419 : cluster [DBG] pgmap v6529: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:49:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:06 smithi191 bash[24992]: audit 2024-08-31T05:49:04.979937+0000 mgr.a (mgr.14388) 9420 : audit [DBG] from='client.209604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:06 smithi163 bash[24253]: audit 2024-08-31T05:49:04.979937+0000 mgr.a (mgr.14388) 9420 : audit [DBG] from='client.209604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:06 smithi027 bash[22610]: audit 2024-08-31T05:49:04.979937+0000 mgr.a (mgr.14388) 9420 : audit [DBG] from='client.209604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:07 smithi163 bash[24253]: cluster 2024-08-31T05:49:05.848353+0000 mgr.a (mgr.14388) 9421 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:07 smithi027 bash[22610]: cluster 2024-08-31T05:49:05.848353+0000 mgr.a (mgr.14388) 9421 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:07 smithi191 bash[24992]: cluster 2024-08-31T05:49:05.848353+0000 mgr.a (mgr.14388) 9421 : cluster [DBG] pgmap v6530: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:09.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:09 smithi163 bash[24253]: cluster 2024-08-31T05:49:07.849304+0000 mgr.a (mgr.14388) 9422 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:09 smithi027 bash[22610]: cluster 2024-08-31T05:49:07.849304+0000 mgr.a (mgr.14388) 9422 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:09 smithi191 bash[24992]: cluster 2024-08-31T05:49:07.849304+0000 mgr.a (mgr.14388) 9422 : cluster [DBG] pgmap v6531: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:10.427 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:49:10.428 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:49:10.428 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:49:11.182 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:49:11.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:49:11.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:49:11.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:49:11.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:49:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:11 smithi163 bash[24253]: cluster 2024-08-31T05:49:09.851587+0000 mgr.a (mgr.14388) 9423 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:11 smithi027 bash[22610]: cluster 2024-08-31T05:49:09.851587+0000 mgr.a (mgr.14388) 9423 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:11 smithi191 bash[24992]: cluster 2024-08-31T05:49:09.851587+0000 mgr.a (mgr.14388) 9423 : cluster [DBG] pgmap v6532: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:12 smithi163 bash[24253]: audit 2024-08-31T05:49:10.759790+0000 mgr.a (mgr.14388) 9424 : audit [DBG] from='client.209679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:12 smithi027 bash[22610]: audit 2024-08-31T05:49:10.759790+0000 mgr.a (mgr.14388) 9424 : audit [DBG] from='client.209679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:12 smithi191 bash[24992]: audit 2024-08-31T05:49:10.759790+0000 mgr.a (mgr.14388) 9424 : audit [DBG] from='client.209679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:13 smithi163 bash[24253]: cluster 2024-08-31T05:49:11.852535+0000 mgr.a (mgr.14388) 9425 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:13 smithi027 bash[22610]: cluster 2024-08-31T05:49:11.852535+0000 mgr.a (mgr.14388) 9425 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:13 smithi191 bash[24992]: cluster 2024-08-31T05:49:11.852535+0000 mgr.a (mgr.14388) 9425 : cluster [DBG] pgmap v6533: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:15 smithi163 bash[24253]: cluster 2024-08-31T05:49:13.854790+0000 mgr.a (mgr.14388) 9426 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:15 smithi027 bash[22610]: cluster 2024-08-31T05:49:13.854790+0000 mgr.a (mgr.14388) 9426 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:15 smithi191 bash[24992]: cluster 2024-08-31T05:49:13.854790+0000 mgr.a (mgr.14388) 9426 : cluster [DBG] pgmap v6534: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:16.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:49:16.185 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:49:16.185 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:49:16.928 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:49:16.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:49:16.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:49:16.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:49:16.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:49:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:17 smithi163 bash[24253]: cluster 2024-08-31T05:49:15.855691+0000 mgr.a (mgr.14388) 9427 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:17 smithi163 bash[24253]: audit 2024-08-31T05:49:16.514162+0000 mgr.a (mgr.14388) 9428 : audit [DBG] from='client.209754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:17 smithi027 bash[22610]: cluster 2024-08-31T05:49:15.855691+0000 mgr.a (mgr.14388) 9427 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:17 smithi027 bash[22610]: audit 2024-08-31T05:49:16.514162+0000 mgr.a (mgr.14388) 9428 : audit [DBG] from='client.209754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:17 smithi191 bash[24992]: cluster 2024-08-31T05:49:15.855691+0000 mgr.a (mgr.14388) 9427 : cluster [DBG] pgmap v6535: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:18.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:17 smithi191 bash[24992]: audit 2024-08-31T05:49:16.514162+0000 mgr.a (mgr.14388) 9428 : audit [DBG] from='client.209754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:19 smithi163 bash[24253]: cluster 2024-08-31T05:49:17.856756+0000 mgr.a (mgr.14388) 9429 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:19 smithi027 bash[22610]: cluster 2024-08-31T05:49:17.856756+0000 mgr.a (mgr.14388) 9429 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:19 smithi191 bash[24992]: cluster 2024-08-31T05:49:17.856756+0000 mgr.a (mgr.14388) 9429 : cluster [DBG] pgmap v6536: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:21.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:49:21.929 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:49:21.929 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:49:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:21 smithi163 bash[24253]: cluster 2024-08-31T05:49:19.859048+0000 mgr.a (mgr.14388) 9430 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:21 smithi027 bash[22610]: cluster 2024-08-31T05:49:19.859048+0000 mgr.a (mgr.14388) 9430 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:21 smithi191 bash[24992]: cluster 2024-08-31T05:49:19.859048+0000 mgr.a (mgr.14388) 9430 : cluster [DBG] pgmap v6537: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:22.697 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:49:22.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:49:22.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:49:22.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:49:22.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:49:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:23 smithi163 bash[24253]: cluster 2024-08-31T05:49:21.859820+0000 mgr.a (mgr.14388) 9431 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:23 smithi163 bash[24253]: audit 2024-08-31T05:49:22.261602+0000 mgr.a (mgr.14388) 9432 : audit [DBG] from='client.209826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:23 smithi027 bash[22610]: cluster 2024-08-31T05:49:21.859820+0000 mgr.a (mgr.14388) 9431 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:23 smithi027 bash[22610]: audit 2024-08-31T05:49:22.261602+0000 mgr.a (mgr.14388) 9432 : audit [DBG] from='client.209826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:23 smithi191 bash[24992]: cluster 2024-08-31T05:49:21.859820+0000 mgr.a (mgr.14388) 9431 : cluster [DBG] pgmap v6538: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:24.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:23 smithi191 bash[24992]: audit 2024-08-31T05:49:22.261602+0000 mgr.a (mgr.14388) 9432 : audit [DBG] from='client.209826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:25 smithi163 bash[24253]: cluster 2024-08-31T05:49:23.862129+0000 mgr.a (mgr.14388) 9433 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:25 smithi027 bash[22610]: cluster 2024-08-31T05:49:23.862129+0000 mgr.a (mgr.14388) 9433 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:25 smithi191 bash[24992]: cluster 2024-08-31T05:49:23.862129+0000 mgr.a (mgr.14388) 9433 : cluster [DBG] pgmap v6539: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:27.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:49:27.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:49:27.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:49:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:27 smithi163 bash[24253]: cluster 2024-08-31T05:49:25.862928+0000 mgr.a (mgr.14388) 9434 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:27 smithi027 bash[22610]: cluster 2024-08-31T05:49:25.862928+0000 mgr.a (mgr.14388) 9434 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:27 smithi191 bash[24992]: cluster 2024-08-31T05:49:25.862928+0000 mgr.a (mgr.14388) 9434 : cluster [DBG] pgmap v6540: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:28.450 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:49:28.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:49:28.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:49:28.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:49:28.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:49:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:29 smithi163 bash[24253]: cluster 2024-08-31T05:49:27.863649+0000 mgr.a (mgr.14388) 9435 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:29 smithi163 bash[24253]: audit 2024-08-31T05:49:28.031184+0000 mgr.a (mgr.14388) 9436 : audit [DBG] from='client.209904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:29 smithi027 bash[22610]: cluster 2024-08-31T05:49:27.863649+0000 mgr.a (mgr.14388) 9435 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:29 smithi027 bash[22610]: audit 2024-08-31T05:49:28.031184+0000 mgr.a (mgr.14388) 9436 : audit [DBG] from='client.209904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:29 smithi191 bash[24992]: cluster 2024-08-31T05:49:27.863649+0000 mgr.a (mgr.14388) 9435 : cluster [DBG] pgmap v6541: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:30.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:29 smithi191 bash[24992]: audit 2024-08-31T05:49:28.031184+0000 mgr.a (mgr.14388) 9436 : audit [DBG] from='client.209904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:31 smithi163 bash[24253]: cluster 2024-08-31T05:49:29.866350+0000 mgr.a (mgr.14388) 9437 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:31 smithi027 bash[22610]: cluster 2024-08-31T05:49:29.866350+0000 mgr.a (mgr.14388) 9437 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:31 smithi191 bash[24992]: cluster 2024-08-31T05:49:29.866350+0000 mgr.a (mgr.14388) 9437 : cluster [DBG] pgmap v6542: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:33.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:49:33.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:49:33.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:49:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:33 smithi163 bash[24253]: cluster 2024-08-31T05:49:31.867152+0000 mgr.a (mgr.14388) 9438 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:49:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:33 smithi027 bash[22610]: cluster 2024-08-31T05:49:31.867152+0000 mgr.a (mgr.14388) 9438 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:49:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:33 smithi191 bash[24992]: cluster 2024-08-31T05:49:31.867152+0000 mgr.a (mgr.14388) 9438 : cluster [DBG] pgmap v6543: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:49:34.237 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:49:34.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:49:34.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:49:34.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:49:34.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:49:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:35 smithi163 bash[24253]: audit 2024-08-31T05:49:33.787670+0000 mgr.a (mgr.14388) 9439 : audit [DBG] from='client.209982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:35 smithi163 bash[24253]: cluster 2024-08-31T05:49:33.869099+0000 mgr.a (mgr.14388) 9440 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:35 smithi027 bash[22610]: audit 2024-08-31T05:49:33.787670+0000 mgr.a (mgr.14388) 9439 : audit [DBG] from='client.209982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:35 smithi027 bash[22610]: cluster 2024-08-31T05:49:33.869099+0000 mgr.a (mgr.14388) 9440 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:35 smithi191 bash[24992]: audit 2024-08-31T05:49:33.787670+0000 mgr.a (mgr.14388) 9439 : audit [DBG] from='client.209982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:35 smithi191 bash[24992]: cluster 2024-08-31T05:49:33.869099+0000 mgr.a (mgr.14388) 9440 : cluster [DBG] pgmap v6544: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:36 smithi163 bash[24253]: audit 2024-08-31T05:49:36.261290+0000 mon.a (mon.0) 1996 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:49:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:36 smithi027 bash[22610]: audit 2024-08-31T05:49:36.261290+0000 mon.a (mon.0) 1996 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:49:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:36 smithi191 bash[24992]: audit 2024-08-31T05:49:36.261290+0000 mon.a (mon.0) 1996 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:49:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:37 smithi163 bash[24253]: cluster 2024-08-31T05:49:35.869986+0000 mgr.a (mgr.14388) 9441 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:49:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:37 smithi163 bash[24253]: audit 2024-08-31T05:49:37.090132+0000 mon.a (mon.0) 1997 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:49:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:37 smithi163 bash[24253]: audit 2024-08-31T05:49:37.091984+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:49:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:37 smithi163 bash[24253]: audit 2024-08-31T05:49:37.100529+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:49:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:37 smithi163 bash[24253]: audit 2024-08-31T05:49:37.105396+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:49:37.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:49:37 smithi027 bash[22863]: debug 2024-08-31T05:49:37.844+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:49:37.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:49:37 smithi027 bash[22863]: debug 2024-08-31T05:49:37.848+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:49:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:37 smithi027 bash[22610]: cluster 2024-08-31T05:49:35.869986+0000 mgr.a (mgr.14388) 9441 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:49:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:37 smithi027 bash[22610]: audit 2024-08-31T05:49:37.090132+0000 mon.a (mon.0) 1997 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:49:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:37 smithi027 bash[22610]: audit 2024-08-31T05:49:37.091984+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:49:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:37 smithi027 bash[22610]: audit 2024-08-31T05:49:37.100529+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:49:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:37 smithi027 bash[22610]: audit 2024-08-31T05:49:37.105396+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:49:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:37 smithi191 bash[24992]: cluster 2024-08-31T05:49:35.869986+0000 mgr.a (mgr.14388) 9441 : cluster [DBG] pgmap v6545: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:49:38.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:37 smithi191 bash[24992]: audit 2024-08-31T05:49:37.090132+0000 mon.a (mon.0) 1997 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:49:38.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:37 smithi191 bash[24992]: audit 2024-08-31T05:49:37.091984+0000 mon.a (mon.0) 1998 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:49:38.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:37 smithi191 bash[24992]: audit 2024-08-31T05:49:37.100529+0000 mon.a (mon.0) 1999 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:49:38.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:37 smithi191 bash[24992]: audit 2024-08-31T05:49:37.105396+0000 mon.a (mon.0) 2000 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:49:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:38 smithi163 bash[24253]: audit 2024-08-31T05:49:37.107823+0000 mgr.a (mgr.14388) 9442 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:49:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:38 smithi027 bash[22610]: audit 2024-08-31T05:49:37.107823+0000 mgr.a (mgr.14388) 9442 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:49:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:38 smithi191 bash[24992]: audit 2024-08-31T05:49:37.107823+0000 mgr.a (mgr.14388) 9442 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:49:39.238 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:49:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:49:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:49:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:39 smithi163 bash[24253]: audit 2024-08-31T05:49:37.849878+0000 mgr.a (mgr.14388) 9443 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:49:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:39 smithi163 bash[24253]: cephadm 2024-08-31T05:49:37.851150+0000 mgr.a (mgr.14388) 9444 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:49:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:39 smithi163 bash[24253]: cluster 2024-08-31T05:49:37.870679+0000 mgr.a (mgr.14388) 9445 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:49:39.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:39 smithi027 bash[22610]: audit 2024-08-31T05:49:37.849878+0000 mgr.a (mgr.14388) 9443 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:49:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:39 smithi027 bash[22610]: cephadm 2024-08-31T05:49:37.851150+0000 mgr.a (mgr.14388) 9444 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:49:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:39 smithi027 bash[22610]: cluster 2024-08-31T05:49:37.870679+0000 mgr.a (mgr.14388) 9445 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:49:40.004 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:49:40.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:49:40.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:49:40.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:49:40.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:49:40.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:39 smithi191 bash[24992]: audit 2024-08-31T05:49:37.849878+0000 mgr.a (mgr.14388) 9443 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:49:40.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:39 smithi191 bash[24992]: cephadm 2024-08-31T05:49:37.851150+0000 mgr.a (mgr.14388) 9444 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:49:40.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:39 smithi191 bash[24992]: cluster 2024-08-31T05:49:37.870679+0000 mgr.a (mgr.14388) 9445 : cluster [DBG] pgmap v6546: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:49:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:40 smithi163 bash[24253]: audit 2024-08-31T05:49:39.574136+0000 mgr.a (mgr.14388) 9446 : audit [DBG] from='client.210165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:40 smithi027 bash[22610]: audit 2024-08-31T05:49:39.574136+0000 mgr.a (mgr.14388) 9446 : audit [DBG] from='client.210165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:40 smithi191 bash[24992]: audit 2024-08-31T05:49:39.574136+0000 mgr.a (mgr.14388) 9446 : audit [DBG] from='client.210165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:41 smithi163 bash[24253]: cluster 2024-08-31T05:49:39.872282+0000 mgr.a (mgr.14388) 9447 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:41 smithi027 bash[22610]: cluster 2024-08-31T05:49:39.872282+0000 mgr.a (mgr.14388) 9447 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:41 smithi191 bash[24992]: cluster 2024-08-31T05:49:39.872282+0000 mgr.a (mgr.14388) 9447 : cluster [DBG] pgmap v6547: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:43 smithi163 bash[24253]: cluster 2024-08-31T05:49:41.873287+0000 mgr.a (mgr.14388) 9448 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:43 smithi027 bash[22610]: cluster 2024-08-31T05:49:41.873287+0000 mgr.a (mgr.14388) 9448 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:43 smithi191 bash[24992]: cluster 2024-08-31T05:49:41.873287+0000 mgr.a (mgr.14388) 9448 : cluster [DBG] pgmap v6548: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:45.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:49:45.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:49:45.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:49:45.790 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:49:45.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:49:45.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:49:45.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:49:45.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:49:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:45 smithi163 bash[24253]: cluster 2024-08-31T05:49:43.875688+0000 mgr.a (mgr.14388) 9449 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:45 smithi027 bash[22610]: cluster 2024-08-31T05:49:43.875688+0000 mgr.a (mgr.14388) 9449 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:45 smithi191 bash[24992]: cluster 2024-08-31T05:49:43.875688+0000 mgr.a (mgr.14388) 9449 : cluster [DBG] pgmap v6549: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:46 smithi163 bash[24253]: audit 2024-08-31T05:49:45.347719+0000 mgr.a (mgr.14388) 9450 : audit [DBG] from='client.210243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:46 smithi027 bash[22610]: audit 2024-08-31T05:49:45.347719+0000 mgr.a (mgr.14388) 9450 : audit [DBG] from='client.210243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:46 smithi191 bash[24992]: audit 2024-08-31T05:49:45.347719+0000 mgr.a (mgr.14388) 9450 : audit [DBG] from='client.210243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:47 smithi163 bash[24253]: cluster 2024-08-31T05:49:45.876701+0000 mgr.a (mgr.14388) 9451 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:47 smithi027 bash[22610]: cluster 2024-08-31T05:49:45.876701+0000 mgr.a (mgr.14388) 9451 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:47 smithi191 bash[24992]: cluster 2024-08-31T05:49:45.876701+0000 mgr.a (mgr.14388) 9451 : cluster [DBG] pgmap v6550: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:49 smithi163 bash[24253]: cluster 2024-08-31T05:49:47.877659+0000 mgr.a (mgr.14388) 9452 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:49 smithi027 bash[22610]: cluster 2024-08-31T05:49:47.877659+0000 mgr.a (mgr.14388) 9452 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:49 smithi191 bash[24992]: cluster 2024-08-31T05:49:47.877659+0000 mgr.a (mgr.14388) 9452 : cluster [DBG] pgmap v6551: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:50.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:49:50.792 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:49:50.792 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:49:51.570 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:49:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:49:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:49:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:49:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:49:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:51 smithi163 bash[24253]: cluster 2024-08-31T05:49:49.879943+0000 mgr.a (mgr.14388) 9453 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:51 smithi027 bash[22610]: cluster 2024-08-31T05:49:49.879943+0000 mgr.a (mgr.14388) 9453 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:51 smithi191 bash[24992]: cluster 2024-08-31T05:49:49.879943+0000 mgr.a (mgr.14388) 9453 : cluster [DBG] pgmap v6552: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:49:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:52 smithi163 bash[24253]: audit 2024-08-31T05:49:51.127209+0000 mgr.a (mgr.14388) 9454 : audit [DBG] from='client.210315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:52 smithi027 bash[22610]: audit 2024-08-31T05:49:51.127209+0000 mgr.a (mgr.14388) 9454 : audit [DBG] from='client.210315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:53.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:52 smithi191 bash[24992]: audit 2024-08-31T05:49:51.127209+0000 mgr.a (mgr.14388) 9454 : audit [DBG] from='client.210315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:53 smithi163 bash[24253]: cluster 2024-08-31T05:49:51.880906+0000 mgr.a (mgr.14388) 9455 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:53 smithi027 bash[22610]: cluster 2024-08-31T05:49:51.880906+0000 mgr.a (mgr.14388) 9455 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:53 smithi191 bash[24992]: cluster 2024-08-31T05:49:51.880906+0000 mgr.a (mgr.14388) 9455 : cluster [DBG] pgmap v6553: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:55 smithi163 bash[24253]: cluster 2024-08-31T05:49:53.883141+0000 mgr.a (mgr.14388) 9456 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:55 smithi027 bash[22610]: cluster 2024-08-31T05:49:53.883141+0000 mgr.a (mgr.14388) 9456 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:55 smithi191 bash[24992]: cluster 2024-08-31T05:49:53.883141+0000 mgr.a (mgr.14388) 9456 : cluster [DBG] pgmap v6554: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:49:56.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:49:56.572 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:49:56.572 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:49:57.350 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:49:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:49:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:49:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:49:57.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:49:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:57 smithi163 bash[24253]: cluster 2024-08-31T05:49:55.883861+0000 mgr.a (mgr.14388) 9457 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:57 smithi027 bash[22610]: cluster 2024-08-31T05:49:55.883861+0000 mgr.a (mgr.14388) 9457 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:57 smithi191 bash[24992]: cluster 2024-08-31T05:49:55.883861+0000 mgr.a (mgr.14388) 9457 : cluster [DBG] pgmap v6555: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:58 smithi163 bash[24253]: audit 2024-08-31T05:49:56.908222+0000 mgr.a (mgr.14388) 9458 : audit [DBG] from='client.210393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:58 smithi027 bash[22610]: audit 2024-08-31T05:49:56.908222+0000 mgr.a (mgr.14388) 9458 : audit [DBG] from='client.210393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:58 smithi191 bash[24992]: audit 2024-08-31T05:49:56.908222+0000 mgr.a (mgr.14388) 9458 : audit [DBG] from='client.210393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:49:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:49:59 smithi163 bash[24253]: cluster 2024-08-31T05:49:57.884760+0000 mgr.a (mgr.14388) 9459 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:49:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:49:59 smithi027 bash[22610]: cluster 2024-08-31T05:49:57.884760+0000 mgr.a (mgr.14388) 9459 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:49:59 smithi191 bash[24992]: cluster 2024-08-31T05:49:57.884760+0000 mgr.a (mgr.14388) 9459 : cluster [DBG] pgmap v6556: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:00 smithi027 bash[22610]: cluster 2024-08-31T05:50:00.000142+0000 mon.a (mon.0) 2001 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:50:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:00 smithi191 bash[24992]: cluster 2024-08-31T05:50:00.000142+0000 mon.a (mon.0) 2001 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:50:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:00 smithi163 bash[24253]: cluster 2024-08-31T05:50:00.000142+0000 mon.a (mon.0) 2001 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T05:50:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:01 smithi027 bash[22610]: cluster 2024-08-31T05:49:59.887009+0000 mgr.a (mgr.14388) 9460 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:01 smithi191 bash[24992]: cluster 2024-08-31T05:49:59.887009+0000 mgr.a (mgr.14388) 9460 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:01 smithi163 bash[24253]: cluster 2024-08-31T05:49:59.887009+0000 mgr.a (mgr.14388) 9460 : cluster [DBG] pgmap v6557: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:02.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:02.353 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:02.353 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:50:03.121 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:50:03.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:50:03.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:50:03.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:50:03.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:50:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:03 smithi027 bash[22610]: cluster 2024-08-31T05:50:01.887736+0000 mgr.a (mgr.14388) 9461 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:03 smithi027 bash[22610]: audit 2024-08-31T05:50:02.687697+0000 mgr.a (mgr.14388) 9462 : audit [DBG] from='client.210471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:03 smithi191 bash[24992]: cluster 2024-08-31T05:50:01.887736+0000 mgr.a (mgr.14388) 9461 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:03 smithi191 bash[24992]: audit 2024-08-31T05:50:02.687697+0000 mgr.a (mgr.14388) 9462 : audit [DBG] from='client.210471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:03 smithi163 bash[24253]: cluster 2024-08-31T05:50:01.887736+0000 mgr.a (mgr.14388) 9461 : cluster [DBG] pgmap v6558: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:03 smithi163 bash[24253]: audit 2024-08-31T05:50:02.687697+0000 mgr.a (mgr.14388) 9462 : audit [DBG] from='client.210471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:05 smithi027 bash[22610]: cluster 2024-08-31T05:50:03.890176+0000 mgr.a (mgr.14388) 9463 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:50:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:05 smithi191 bash[24992]: cluster 2024-08-31T05:50:03.890176+0000 mgr.a (mgr.14388) 9463 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:50:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:05 smithi163 bash[24253]: cluster 2024-08-31T05:50:03.890176+0000 mgr.a (mgr.14388) 9463 : cluster [DBG] pgmap v6559: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:50:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:07 smithi027 bash[22610]: cluster 2024-08-31T05:50:05.891005+0000 mgr.a (mgr.14388) 9464 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:50:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:07 smithi191 bash[24992]: cluster 2024-08-31T05:50:05.891005+0000 mgr.a (mgr.14388) 9464 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:50:08.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:08.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:08.123 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:50:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:07 smithi163 bash[24253]: cluster 2024-08-31T05:50:05.891005+0000 mgr.a (mgr.14388) 9464 : cluster [DBG] pgmap v6560: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:50:08.903 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:50:08.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:50:08.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:50:08.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:50:08.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:50:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:08 smithi027 bash[22610]: cluster 2024-08-31T05:50:07.891759+0000 mgr.a (mgr.14388) 9465 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:50:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:08 smithi027 bash[22610]: audit 2024-08-31T05:50:08.462102+0000 mgr.a (mgr.14388) 9466 : audit [DBG] from='client.210546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:08 smithi191 bash[24992]: cluster 2024-08-31T05:50:07.891759+0000 mgr.a (mgr.14388) 9465 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:50:09.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:08 smithi191 bash[24992]: audit 2024-08-31T05:50:08.462102+0000 mgr.a (mgr.14388) 9466 : audit [DBG] from='client.210546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:08 smithi163 bash[24253]: cluster 2024-08-31T05:50:07.891759+0000 mgr.a (mgr.14388) 9465 : cluster [DBG] pgmap v6561: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:50:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:08 smithi163 bash[24253]: audit 2024-08-31T05:50:08.462102+0000 mgr.a (mgr.14388) 9466 : audit [DBG] from='client.210546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:10 smithi027 bash[22610]: cluster 2024-08-31T05:50:09.894498+0000 mgr.a (mgr.14388) 9467 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:10 smithi191 bash[24992]: cluster 2024-08-31T05:50:09.894498+0000 mgr.a (mgr.14388) 9467 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:10 smithi163 bash[24253]: cluster 2024-08-31T05:50:09.894498+0000 mgr.a (mgr.14388) 9467 : cluster [DBG] pgmap v6562: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:12 smithi027 bash[22610]: cluster 2024-08-31T05:50:11.895280+0000 mgr.a (mgr.14388) 9468 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:50:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:12 smithi191 bash[24992]: cluster 2024-08-31T05:50:11.895280+0000 mgr.a (mgr.14388) 9468 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:50:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:12 smithi163 bash[24253]: cluster 2024-08-31T05:50:11.895280+0000 mgr.a (mgr.14388) 9468 : cluster [DBG] pgmap v6563: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:50:13.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:13.905 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:13.905 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:50:14.641 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:50:14.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:50:14.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:50:14.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:50:14.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:50:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:14 smithi027 bash[22610]: cluster 2024-08-31T05:50:13.897212+0000 mgr.a (mgr.14388) 9469 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:14 smithi027 bash[22610]: audit 2024-08-31T05:50:14.234092+0000 mgr.a (mgr.14388) 9470 : audit [DBG] from='client.210618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:15.293 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:14 smithi191 bash[24992]: cluster 2024-08-31T05:50:13.897212+0000 mgr.a (mgr.14388) 9469 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:15.293 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:14 smithi191 bash[24992]: audit 2024-08-31T05:50:14.234092+0000 mgr.a (mgr.14388) 9470 : audit [DBG] from='client.210618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:14 smithi163 bash[24253]: cluster 2024-08-31T05:50:13.897212+0000 mgr.a (mgr.14388) 9469 : cluster [DBG] pgmap v6564: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:14 smithi163 bash[24253]: audit 2024-08-31T05:50:14.234092+0000 mgr.a (mgr.14388) 9470 : audit [DBG] from='client.210618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:16 smithi027 bash[22610]: cluster 2024-08-31T05:50:15.898099+0000 mgr.a (mgr.14388) 9471 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:50:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:16 smithi191 bash[24992]: cluster 2024-08-31T05:50:15.898099+0000 mgr.a (mgr.14388) 9471 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:50:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:16 smithi163 bash[24253]: cluster 2024-08-31T05:50:15.898099+0000 mgr.a (mgr.14388) 9471 : cluster [DBG] pgmap v6565: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:50:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:18 smithi027 bash[22610]: cluster 2024-08-31T05:50:17.898892+0000 mgr.a (mgr.14388) 9472 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:50:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:18 smithi191 bash[24992]: cluster 2024-08-31T05:50:17.898892+0000 mgr.a (mgr.14388) 9472 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:50:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:18 smithi163 bash[24253]: cluster 2024-08-31T05:50:17.898892+0000 mgr.a (mgr.14388) 9472 : cluster [DBG] pgmap v6566: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:50:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:50:20.411 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:50:20.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:50:20.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:50:20.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:50:20.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:50:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:20 smithi027 bash[22610]: cluster 2024-08-31T05:50:19.901026+0000 mgr.a (mgr.14388) 9473 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:50:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:20 smithi027 bash[22610]: audit 2024-08-31T05:50:19.977872+0000 mgr.a (mgr.14388) 9474 : audit [DBG] from='client.210693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:20 smithi191 bash[24992]: cluster 2024-08-31T05:50:19.901026+0000 mgr.a (mgr.14388) 9473 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:50:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:20 smithi191 bash[24992]: audit 2024-08-31T05:50:19.977872+0000 mgr.a (mgr.14388) 9474 : audit [DBG] from='client.210693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:20 smithi163 bash[24253]: cluster 2024-08-31T05:50:19.901026+0000 mgr.a (mgr.14388) 9473 : cluster [DBG] pgmap v6567: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:50:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:20 smithi163 bash[24253]: audit 2024-08-31T05:50:19.977872+0000 mgr.a (mgr.14388) 9474 : audit [DBG] from='client.210693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:22 smithi027 bash[22610]: cluster 2024-08-31T05:50:21.901895+0000 mgr.a (mgr.14388) 9475 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:22 smithi191 bash[24992]: cluster 2024-08-31T05:50:21.901895+0000 mgr.a (mgr.14388) 9475 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:22 smithi163 bash[24253]: cluster 2024-08-31T05:50:21.901895+0000 mgr.a (mgr.14388) 9475 : cluster [DBG] pgmap v6568: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:24 smithi027 bash[22610]: cluster 2024-08-31T05:50:23.904106+0000 mgr.a (mgr.14388) 9476 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:24 smithi191 bash[24992]: cluster 2024-08-31T05:50:23.904106+0000 mgr.a (mgr.14388) 9476 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:25.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:25.414 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:25.414 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:50:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:24 smithi163 bash[24253]: cluster 2024-08-31T05:50:23.904106+0000 mgr.a (mgr.14388) 9476 : cluster [DBG] pgmap v6569: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:26.157 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:50:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:50:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:50:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:50:26.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:50:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:26 smithi191 bash[24992]: audit 2024-08-31T05:50:25.744523+0000 mgr.a (mgr.14388) 9477 : audit [DBG] from='client.210771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:26 smithi191 bash[24992]: cluster 2024-08-31T05:50:25.904646+0000 mgr.a (mgr.14388) 9478 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:26 smithi163 bash[24253]: audit 2024-08-31T05:50:25.744523+0000 mgr.a (mgr.14388) 9477 : audit [DBG] from='client.210771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:26 smithi163 bash[24253]: cluster 2024-08-31T05:50:25.904646+0000 mgr.a (mgr.14388) 9478 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:26 smithi027 bash[22610]: audit 2024-08-31T05:50:25.744523+0000 mgr.a (mgr.14388) 9477 : audit [DBG] from='client.210771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:26 smithi027 bash[22610]: cluster 2024-08-31T05:50:25.904646+0000 mgr.a (mgr.14388) 9478 : cluster [DBG] pgmap v6570: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:28 smithi191 bash[24992]: cluster 2024-08-31T05:50:27.905705+0000 mgr.a (mgr.14388) 9479 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:28 smithi163 bash[24253]: cluster 2024-08-31T05:50:27.905705+0000 mgr.a (mgr.14388) 9479 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:28 smithi027 bash[22610]: cluster 2024-08-31T05:50:27.905705+0000 mgr.a (mgr.14388) 9479 : cluster [DBG] pgmap v6571: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:31.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:31.159 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:31.159 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:50:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:30 smithi191 bash[24992]: cluster 2024-08-31T05:50:29.907981+0000 mgr.a (mgr.14388) 9480 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:30 smithi163 bash[24253]: cluster 2024-08-31T05:50:29.907981+0000 mgr.a (mgr.14388) 9480 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:30 smithi027 bash[22610]: cluster 2024-08-31T05:50:29.907981+0000 mgr.a (mgr.14388) 9480 : cluster [DBG] pgmap v6572: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:31.899 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:50:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:50:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:50:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:50:31.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:50:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:32 smithi191 bash[24992]: audit 2024-08-31T05:50:31.487585+0000 mgr.a (mgr.14388) 9481 : audit [DBG] from='client.210849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:32.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:32 smithi163 bash[24253]: audit 2024-08-31T05:50:31.487585+0000 mgr.a (mgr.14388) 9481 : audit [DBG] from='client.210849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:32 smithi027 bash[22610]: audit 2024-08-31T05:50:31.487585+0000 mgr.a (mgr.14388) 9481 : audit [DBG] from='client.210849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:33 smithi191 bash[24992]: cluster 2024-08-31T05:50:31.908721+0000 mgr.a (mgr.14388) 9482 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:33 smithi163 bash[24253]: cluster 2024-08-31T05:50:31.908721+0000 mgr.a (mgr.14388) 9482 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:33 smithi027 bash[22610]: cluster 2024-08-31T05:50:31.908721+0000 mgr.a (mgr.14388) 9482 : cluster [DBG] pgmap v6573: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:35 smithi191 bash[24992]: cluster 2024-08-31T05:50:33.910919+0000 mgr.a (mgr.14388) 9483 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:35 smithi163 bash[24253]: cluster 2024-08-31T05:50:33.910919+0000 mgr.a (mgr.14388) 9483 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:35 smithi027 bash[22610]: cluster 2024-08-31T05:50:33.910919+0000 mgr.a (mgr.14388) 9483 : cluster [DBG] pgmap v6574: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:36.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:36.902 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:36.902 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:50:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:37 smithi191 bash[24992]: cluster 2024-08-31T05:50:35.911672+0000 mgr.a (mgr.14388) 9484 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:37 smithi163 bash[24253]: cluster 2024-08-31T05:50:35.911672+0000 mgr.a (mgr.14388) 9484 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:37 smithi027 bash[22610]: cluster 2024-08-31T05:50:35.911672+0000 mgr.a (mgr.14388) 9484 : cluster [DBG] pgmap v6575: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:37.653 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:50:37.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:50:37.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:50:37.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:50:37.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:50:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:38 smithi191 bash[24992]: audit 2024-08-31T05:50:37.233301+0000 mgr.a (mgr.14388) 9485 : audit [DBG] from='client.210927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:38.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:38 smithi191 bash[24992]: audit 2024-08-31T05:50:37.902887+0000 mon.a (mon.0) 2002 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:50:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:38 smithi163 bash[24253]: audit 2024-08-31T05:50:37.233301+0000 mgr.a (mgr.14388) 9485 : audit [DBG] from='client.210927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:38.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:38 smithi163 bash[24253]: audit 2024-08-31T05:50:37.902887+0000 mon.a (mon.0) 2002 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:50:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:38 smithi027 bash[22610]: audit 2024-08-31T05:50:37.233301+0000 mgr.a (mgr.14388) 9485 : audit [DBG] from='client.210927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:38 smithi027 bash[22610]: audit 2024-08-31T05:50:37.902887+0000 mon.a (mon.0) 2002 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:50:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:39 smithi191 bash[24992]: cluster 2024-08-31T05:50:37.913543+0000 mgr.a (mgr.14388) 9486 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:50:39.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:39 smithi191 bash[24992]: audit 2024-08-31T05:50:38.731190+0000 mon.a (mon.0) 2003 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:50:39.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:39 smithi191 bash[24992]: audit 2024-08-31T05:50:38.732589+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:50:39.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:39 smithi191 bash[24992]: audit 2024-08-31T05:50:38.741285+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:50:39.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:39 smithi191 bash[24992]: audit 2024-08-31T05:50:38.743709+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:50:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:39 smithi163 bash[24253]: cluster 2024-08-31T05:50:37.913543+0000 mgr.a (mgr.14388) 9486 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:50:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:39 smithi163 bash[24253]: audit 2024-08-31T05:50:38.731190+0000 mon.a (mon.0) 2003 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:50:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:39 smithi163 bash[24253]: audit 2024-08-31T05:50:38.732589+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:50:39.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:39 smithi163 bash[24253]: audit 2024-08-31T05:50:38.741285+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:50:39.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:39 smithi163 bash[24253]: audit 2024-08-31T05:50:38.743709+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:50:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:39 smithi027 bash[22610]: cluster 2024-08-31T05:50:37.913543+0000 mgr.a (mgr.14388) 9486 : cluster [DBG] pgmap v6576: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:50:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:39 smithi027 bash[22610]: audit 2024-08-31T05:50:38.731190+0000 mon.a (mon.0) 2003 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:50:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:39 smithi027 bash[22610]: audit 2024-08-31T05:50:38.732589+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:50:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:39 smithi027 bash[22610]: audit 2024-08-31T05:50:38.741285+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:50:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:39 smithi027 bash[22610]: audit 2024-08-31T05:50:38.743709+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:50:39.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:50:39 smithi027 bash[22863]: debug 2024-08-31T05:50:39.483+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:50:39.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:50:39 smithi027 bash[22863]: debug 2024-08-31T05:50:39.487+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:50:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:40 smithi191 bash[24992]: audit 2024-08-31T05:50:38.745938+0000 mgr.a (mgr.14388) 9487 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:50:40.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:40 smithi191 bash[24992]: audit 2024-08-31T05:50:39.490365+0000 mgr.a (mgr.14388) 9488 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:50:40.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:40 smithi191 bash[24992]: cephadm 2024-08-31T05:50:39.491884+0000 mgr.a (mgr.14388) 9489 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:50:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:40 smithi163 bash[24253]: audit 2024-08-31T05:50:38.745938+0000 mgr.a (mgr.14388) 9487 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:50:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:40 smithi163 bash[24253]: audit 2024-08-31T05:50:39.490365+0000 mgr.a (mgr.14388) 9488 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:50:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:40 smithi163 bash[24253]: cephadm 2024-08-31T05:50:39.491884+0000 mgr.a (mgr.14388) 9489 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:50:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:40 smithi027 bash[22610]: audit 2024-08-31T05:50:38.745938+0000 mgr.a (mgr.14388) 9487 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:50:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:40 smithi027 bash[22610]: audit 2024-08-31T05:50:39.490365+0000 mgr.a (mgr.14388) 9488 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:50:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:40 smithi027 bash[22610]: cephadm 2024-08-31T05:50:39.491884+0000 mgr.a (mgr.14388) 9489 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:50:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:41 smithi191 bash[24992]: cluster 2024-08-31T05:50:39.915417+0000 mgr.a (mgr.14388) 9490 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:41 smithi163 bash[24253]: cluster 2024-08-31T05:50:39.915417+0000 mgr.a (mgr.14388) 9490 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:41 smithi027 bash[22610]: cluster 2024-08-31T05:50:39.915417+0000 mgr.a (mgr.14388) 9490 : cluster [DBG] pgmap v6577: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:50:42.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:42.656 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:42.656 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:50:43.435 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:50:43.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:50:43.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:50:43.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:50:43.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:50:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:43 smithi163 bash[24253]: cluster 2024-08-31T05:50:41.916253+0000 mgr.a (mgr.14388) 9491 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:43 smithi027 bash[22610]: cluster 2024-08-31T05:50:41.916253+0000 mgr.a (mgr.14388) 9491 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:43 smithi191 bash[24992]: cluster 2024-08-31T05:50:41.916253+0000 mgr.a (mgr.14388) 9491 : cluster [DBG] pgmap v6578: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:44.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:44 smithi163 bash[24253]: audit 2024-08-31T05:50:42.992861+0000 mgr.a (mgr.14388) 9492 : audit [DBG] from='client.211113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:44 smithi027 bash[22610]: audit 2024-08-31T05:50:42.992861+0000 mgr.a (mgr.14388) 9492 : audit [DBG] from='client.211113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:44 smithi191 bash[24992]: audit 2024-08-31T05:50:42.992861+0000 mgr.a (mgr.14388) 9492 : audit [DBG] from='client.211113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:45 smithi163 bash[24253]: cluster 2024-08-31T05:50:43.919111+0000 mgr.a (mgr.14388) 9493 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:50:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:45 smithi027 bash[22610]: cluster 2024-08-31T05:50:43.919111+0000 mgr.a (mgr.14388) 9493 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:50:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:45 smithi191 bash[24992]: cluster 2024-08-31T05:50:43.919111+0000 mgr.a (mgr.14388) 9493 : cluster [DBG] pgmap v6579: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:50:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:47 smithi163 bash[24253]: cluster 2024-08-31T05:50:45.919916+0000 mgr.a (mgr.14388) 9494 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:47 smithi027 bash[22610]: cluster 2024-08-31T05:50:45.919916+0000 mgr.a (mgr.14388) 9494 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:47 smithi191 bash[24992]: cluster 2024-08-31T05:50:45.919916+0000 mgr.a (mgr.14388) 9494 : cluster [DBG] pgmap v6580: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:48.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:48.437 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:48.437 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:50:49.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:50:49.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:50:49.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:50:49.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:50:49.209 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:50:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:49 smithi163 bash[24253]: cluster 2024-08-31T05:50:47.921417+0000 mgr.a (mgr.14388) 9495 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:49 smithi027 bash[22610]: cluster 2024-08-31T05:50:47.921417+0000 mgr.a (mgr.14388) 9495 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:49 smithi191 bash[24992]: cluster 2024-08-31T05:50:47.921417+0000 mgr.a (mgr.14388) 9495 : cluster [DBG] pgmap v6581: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:50.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:50 smithi163 bash[24253]: audit 2024-08-31T05:50:48.773326+0000 mgr.a (mgr.14388) 9496 : audit [DBG] from='client.211191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:50 smithi027 bash[22610]: audit 2024-08-31T05:50:48.773326+0000 mgr.a (mgr.14388) 9496 : audit [DBG] from='client.211191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:50 smithi191 bash[24992]: audit 2024-08-31T05:50:48.773326+0000 mgr.a (mgr.14388) 9496 : audit [DBG] from='client.211191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:51 smithi163 bash[24253]: cluster 2024-08-31T05:50:49.923172+0000 mgr.a (mgr.14388) 9497 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:51 smithi027 bash[22610]: cluster 2024-08-31T05:50:49.923172+0000 mgr.a (mgr.14388) 9497 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:51 smithi191 bash[24992]: cluster 2024-08-31T05:50:49.923172+0000 mgr.a (mgr.14388) 9497 : cluster [DBG] pgmap v6582: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:53 smithi163 bash[24253]: cluster 2024-08-31T05:50:51.923951+0000 mgr.a (mgr.14388) 9498 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:53 smithi027 bash[22610]: cluster 2024-08-31T05:50:51.923951+0000 mgr.a (mgr.14388) 9498 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:53 smithi191 bash[24992]: cluster 2024-08-31T05:50:51.923951+0000 mgr.a (mgr.14388) 9498 : cluster [DBG] pgmap v6583: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:50:54.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:54.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:54.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:50:54.956 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:50:54.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:50:54.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:50:54.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:50:54.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:50:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:55 smithi163 bash[24253]: cluster 2024-08-31T05:50:53.925959+0000 mgr.a (mgr.14388) 9499 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:50:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:55 smithi163 bash[24253]: audit 2024-08-31T05:50:54.541741+0000 mgr.a (mgr.14388) 9500 : audit [DBG] from='client.211269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:55 smithi027 bash[22610]: cluster 2024-08-31T05:50:53.925959+0000 mgr.a (mgr.14388) 9499 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:50:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:55 smithi027 bash[22610]: audit 2024-08-31T05:50:54.541741+0000 mgr.a (mgr.14388) 9500 : audit [DBG] from='client.211269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:55 smithi191 bash[24992]: cluster 2024-08-31T05:50:53.925959+0000 mgr.a (mgr.14388) 9499 : cluster [DBG] pgmap v6584: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:50:55.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:55 smithi191 bash[24992]: audit 2024-08-31T05:50:54.541741+0000 mgr.a (mgr.14388) 9500 : audit [DBG] from='client.211269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:50:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:57 smithi163 bash[24253]: cluster 2024-08-31T05:50:55.926859+0000 mgr.a (mgr.14388) 9501 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:57 smithi027 bash[22610]: cluster 2024-08-31T05:50:55.926859+0000 mgr.a (mgr.14388) 9501 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:57 smithi191 bash[24992]: cluster 2024-08-31T05:50:55.926859+0000 mgr.a (mgr.14388) 9501 : cluster [DBG] pgmap v6585: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:50:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:50:59 smithi163 bash[24253]: cluster 2024-08-31T05:50:57.928567+0000 mgr.a (mgr.14388) 9502 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:50:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:50:59 smithi027 bash[22610]: cluster 2024-08-31T05:50:57.928567+0000 mgr.a (mgr.14388) 9502 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:50:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:50:59 smithi191 bash[24992]: cluster 2024-08-31T05:50:57.928567+0000 mgr.a (mgr.14388) 9502 : cluster [DBG] pgmap v6586: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:50:59.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:50:59.959 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:50:59.959 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:00.752 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:00.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:00.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:00.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:00.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:01 smithi163 bash[24253]: cluster 2024-08-31T05:50:59.929827+0000 mgr.a (mgr.14388) 9503 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:51:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:01 smithi163 bash[24253]: audit 2024-08-31T05:51:00.301420+0000 mgr.a (mgr.14388) 9504 : audit [DBG] from='client.211347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:01 smithi027 bash[22610]: cluster 2024-08-31T05:50:59.929827+0000 mgr.a (mgr.14388) 9503 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:51:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:01 smithi027 bash[22610]: audit 2024-08-31T05:51:00.301420+0000 mgr.a (mgr.14388) 9504 : audit [DBG] from='client.211347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:01 smithi191 bash[24992]: cluster 2024-08-31T05:50:59.929827+0000 mgr.a (mgr.14388) 9503 : cluster [DBG] pgmap v6587: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:51:01.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:01 smithi191 bash[24992]: audit 2024-08-31T05:51:00.301420+0000 mgr.a (mgr.14388) 9504 : audit [DBG] from='client.211347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:03 smithi163 bash[24253]: cluster 2024-08-31T05:51:01.930759+0000 mgr.a (mgr.14388) 9505 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:03 smithi027 bash[22610]: cluster 2024-08-31T05:51:01.930759+0000 mgr.a (mgr.14388) 9505 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:03 smithi191 bash[24992]: cluster 2024-08-31T05:51:01.930759+0000 mgr.a (mgr.14388) 9505 : cluster [DBG] pgmap v6588: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:05 smithi163 bash[24253]: cluster 2024-08-31T05:51:03.932947+0000 mgr.a (mgr.14388) 9506 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:51:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:05 smithi027 bash[22610]: cluster 2024-08-31T05:51:03.932947+0000 mgr.a (mgr.14388) 9506 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:51:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:05 smithi191 bash[24992]: cluster 2024-08-31T05:51:03.932947+0000 mgr.a (mgr.14388) 9506 : cluster [DBG] pgmap v6589: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:51:05.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:51:05.754 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:51:05.754 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:06.532 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:06.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:06.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:06.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:06.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:07 smithi163 bash[24253]: cluster 2024-08-31T05:51:05.933492+0000 mgr.a (mgr.14388) 9507 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:07 smithi163 bash[24253]: audit 2024-08-31T05:51:06.089260+0000 mgr.a (mgr.14388) 9508 : audit [DBG] from='client.211422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:07 smithi027 bash[22610]: cluster 2024-08-31T05:51:05.933492+0000 mgr.a (mgr.14388) 9507 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:07 smithi027 bash[22610]: audit 2024-08-31T05:51:06.089260+0000 mgr.a (mgr.14388) 9508 : audit [DBG] from='client.211422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:07 smithi191 bash[24992]: cluster 2024-08-31T05:51:05.933492+0000 mgr.a (mgr.14388) 9507 : cluster [DBG] pgmap v6590: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:07 smithi191 bash[24992]: audit 2024-08-31T05:51:06.089260+0000 mgr.a (mgr.14388) 9508 : audit [DBG] from='client.211422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:09 smithi163 bash[24253]: cluster 2024-08-31T05:51:07.935387+0000 mgr.a (mgr.14388) 9509 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:51:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:09 smithi027 bash[22610]: cluster 2024-08-31T05:51:07.935387+0000 mgr.a (mgr.14388) 9509 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:51:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:09 smithi191 bash[24992]: cluster 2024-08-31T05:51:07.935387+0000 mgr.a (mgr.14388) 9509 : cluster [DBG] pgmap v6591: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:51:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:11 smithi163 bash[24253]: cluster 2024-08-31T05:51:09.936617+0000 mgr.a (mgr.14388) 9510 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:51:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:11 smithi027 bash[22610]: cluster 2024-08-31T05:51:09.936617+0000 mgr.a (mgr.14388) 9510 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:51:11.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:51:11.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:51:11.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:11 smithi191 bash[24992]: cluster 2024-08-31T05:51:09.936617+0000 mgr.a (mgr.14388) 9510 : cluster [DBG] pgmap v6592: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:51:12.316 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:12.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:12.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:12.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:12.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:13 smithi163 bash[24253]: audit 2024-08-31T05:51:11.867958+0000 mgr.a (mgr.14388) 9511 : audit [DBG] from='client.211497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:13 smithi163 bash[24253]: cluster 2024-08-31T05:51:11.937321+0000 mgr.a (mgr.14388) 9512 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:13 smithi027 bash[22610]: audit 2024-08-31T05:51:11.867958+0000 mgr.a (mgr.14388) 9511 : audit [DBG] from='client.211497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:13 smithi027 bash[22610]: cluster 2024-08-31T05:51:11.937321+0000 mgr.a (mgr.14388) 9512 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:13 smithi191 bash[24992]: audit 2024-08-31T05:51:11.867958+0000 mgr.a (mgr.14388) 9511 : audit [DBG] from='client.211497 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:13 smithi191 bash[24992]: cluster 2024-08-31T05:51:11.937321+0000 mgr.a (mgr.14388) 9512 : cluster [DBG] pgmap v6593: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:15 smithi163 bash[24253]: cluster 2024-08-31T05:51:13.939679+0000 mgr.a (mgr.14388) 9513 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:51:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:15 smithi027 bash[22610]: cluster 2024-08-31T05:51:13.939679+0000 mgr.a (mgr.14388) 9513 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:51:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:15 smithi191 bash[24992]: cluster 2024-08-31T05:51:13.939679+0000 mgr.a (mgr.14388) 9513 : cluster [DBG] pgmap v6594: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:51:17.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:51:17.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:51:17.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:17 smithi163 bash[24253]: cluster 2024-08-31T05:51:15.940441+0000 mgr.a (mgr.14388) 9514 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:17 smithi027 bash[22610]: cluster 2024-08-31T05:51:15.940441+0000 mgr.a (mgr.14388) 9514 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:17 smithi191 bash[24992]: cluster 2024-08-31T05:51:15.940441+0000 mgr.a (mgr.14388) 9514 : cluster [DBG] pgmap v6595: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:18.081 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:18.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:18 smithi163 bash[24253]: audit 2024-08-31T05:51:17.649964+0000 mgr.a (mgr.14388) 9515 : audit [DBG] from='client.211572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:18 smithi027 bash[22610]: audit 2024-08-31T05:51:17.649964+0000 mgr.a (mgr.14388) 9515 : audit [DBG] from='client.211572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:18 smithi191 bash[24992]: audit 2024-08-31T05:51:17.649964+0000 mgr.a (mgr.14388) 9515 : audit [DBG] from='client.211572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:19 smithi163 bash[24253]: cluster 2024-08-31T05:51:17.941468+0000 mgr.a (mgr.14388) 9516 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:19 smithi027 bash[22610]: cluster 2024-08-31T05:51:17.941468+0000 mgr.a (mgr.14388) 9516 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:19 smithi191 bash[24992]: cluster 2024-08-31T05:51:17.941468+0000 mgr.a (mgr.14388) 9516 : cluster [DBG] pgmap v6596: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:21 smithi163 bash[24253]: cluster 2024-08-31T05:51:19.943014+0000 mgr.a (mgr.14388) 9517 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:51:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:21 smithi027 bash[22610]: cluster 2024-08-31T05:51:19.943014+0000 mgr.a (mgr.14388) 9517 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:51:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:21 smithi191 bash[24992]: cluster 2024-08-31T05:51:19.943014+0000 mgr.a (mgr.14388) 9517 : cluster [DBG] pgmap v6597: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:51:23.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:51:23.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:51:23.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:23 smithi163 bash[24253]: cluster 2024-08-31T05:51:21.943782+0000 mgr.a (mgr.14388) 9518 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:51:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:23 smithi027 bash[22610]: cluster 2024-08-31T05:51:21.943782+0000 mgr.a (mgr.14388) 9518 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:51:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:23 smithi191 bash[24992]: cluster 2024-08-31T05:51:21.943782+0000 mgr.a (mgr.14388) 9518 : cluster [DBG] pgmap v6598: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:51:23.824 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:23.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:23.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:23.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:23.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:24 smithi163 bash[24253]: audit 2024-08-31T05:51:23.417160+0000 mgr.a (mgr.14388) 9519 : audit [DBG] from='client.211650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:24 smithi027 bash[22610]: audit 2024-08-31T05:51:23.417160+0000 mgr.a (mgr.14388) 9519 : audit [DBG] from='client.211650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:24 smithi191 bash[24992]: audit 2024-08-31T05:51:23.417160+0000 mgr.a (mgr.14388) 9519 : audit [DBG] from='client.211650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:25 smithi163 bash[24253]: cluster 2024-08-31T05:51:23.946638+0000 mgr.a (mgr.14388) 9520 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:25 smithi027 bash[22610]: cluster 2024-08-31T05:51:23.946638+0000 mgr.a (mgr.14388) 9520 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:25 smithi191 bash[24992]: cluster 2024-08-31T05:51:23.946638+0000 mgr.a (mgr.14388) 9520 : cluster [DBG] pgmap v6599: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:27 smithi163 bash[24253]: cluster 2024-08-31T05:51:25.947466+0000 mgr.a (mgr.14388) 9521 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:51:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:27 smithi027 bash[22610]: cluster 2024-08-31T05:51:25.947466+0000 mgr.a (mgr.14388) 9521 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:51:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:27 smithi191 bash[24992]: cluster 2024-08-31T05:51:25.947466+0000 mgr.a (mgr.14388) 9521 : cluster [DBG] pgmap v6600: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:51:28.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:51:28.826 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:51:28.826 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:29 smithi163 bash[24253]: cluster 2024-08-31T05:51:27.948977+0000 mgr.a (mgr.14388) 9522 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:51:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:29 smithi027 bash[22610]: cluster 2024-08-31T05:51:27.948977+0000 mgr.a (mgr.14388) 9522 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:51:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:29 smithi191 bash[24992]: cluster 2024-08-31T05:51:27.948977+0000 mgr.a (mgr.14388) 9522 : cluster [DBG] pgmap v6601: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:51:29.571 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:29.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:29.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:29.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:29.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:30 smithi163 bash[24253]: audit 2024-08-31T05:51:29.159627+0000 mgr.a (mgr.14388) 9523 : audit [DBG] from='client.211728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:30 smithi027 bash[22610]: audit 2024-08-31T05:51:29.159627+0000 mgr.a (mgr.14388) 9523 : audit [DBG] from='client.211728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:30 smithi191 bash[24992]: audit 2024-08-31T05:51:29.159627+0000 mgr.a (mgr.14388) 9523 : audit [DBG] from='client.211728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:31 smithi163 bash[24253]: cluster 2024-08-31T05:51:29.950831+0000 mgr.a (mgr.14388) 9524 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:31 smithi027 bash[22610]: cluster 2024-08-31T05:51:29.950831+0000 mgr.a (mgr.14388) 9524 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:31 smithi191 bash[24992]: cluster 2024-08-31T05:51:29.950831+0000 mgr.a (mgr.14388) 9524 : cluster [DBG] pgmap v6602: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:33 smithi163 bash[24253]: cluster 2024-08-31T05:51:31.951628+0000 mgr.a (mgr.14388) 9525 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:51:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:33 smithi027 bash[22610]: cluster 2024-08-31T05:51:31.951628+0000 mgr.a (mgr.14388) 9525 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:51:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:33 smithi191 bash[24992]: cluster 2024-08-31T05:51:31.951628+0000 mgr.a (mgr.14388) 9525 : cluster [DBG] pgmap v6603: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:51:34.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:51:34.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:51:34.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:35.344 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:35 smithi163 bash[24253]: cluster 2024-08-31T05:51:33.953671+0000 mgr.a (mgr.14388) 9526 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:51:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:35 smithi027 bash[22610]: cluster 2024-08-31T05:51:33.953671+0000 mgr.a (mgr.14388) 9526 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:51:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:35 smithi191 bash[24992]: cluster 2024-08-31T05:51:33.953671+0000 mgr.a (mgr.14388) 9526 : cluster [DBG] pgmap v6604: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:51:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:36 smithi163 bash[24253]: audit 2024-08-31T05:51:34.913602+0000 mgr.a (mgr.14388) 9527 : audit [DBG] from='client.211806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:36 smithi027 bash[22610]: audit 2024-08-31T05:51:34.913602+0000 mgr.a (mgr.14388) 9527 : audit [DBG] from='client.211806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:36 smithi191 bash[24992]: audit 2024-08-31T05:51:34.913602+0000 mgr.a (mgr.14388) 9527 : audit [DBG] from='client.211806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:37 smithi163 bash[24253]: cluster 2024-08-31T05:51:35.954612+0000 mgr.a (mgr.14388) 9528 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:37 smithi027 bash[22610]: cluster 2024-08-31T05:51:35.954612+0000 mgr.a (mgr.14388) 9528 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:37 smithi191 bash[24992]: cluster 2024-08-31T05:51:35.954612+0000 mgr.a (mgr.14388) 9528 : cluster [DBG] pgmap v6605: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:39 smithi027 bash[22610]: cluster 2024-08-31T05:51:37.956386+0000 mgr.a (mgr.14388) 9529 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:51:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:39 smithi191 bash[24992]: cluster 2024-08-31T05:51:37.956386+0000 mgr.a (mgr.14388) 9529 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:51:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:39 smithi163 bash[24253]: cluster 2024-08-31T05:51:37.956386+0000 mgr.a (mgr.14388) 9529 : cluster [DBG] pgmap v6606: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:51:40.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:51:40.346 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:51:40.346 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:40 smithi027 bash[22610]: audit 2024-08-31T05:51:39.543321+0000 mon.a (mon.0) 2007 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:51:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:40 smithi191 bash[24992]: audit 2024-08-31T05:51:39.543321+0000 mon.a (mon.0) 2007 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:51:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:40 smithi163 bash[24253]: audit 2024-08-31T05:51:39.543321+0000 mon.a (mon.0) 2007 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:51:41.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:51:41 smithi027 bash[22863]: debug 2024-08-31T05:51:41.133+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:51:41.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:51:41 smithi027 bash[22863]: debug 2024-08-31T05:51:41.145+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:51:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:41 smithi027 bash[22610]: cluster 2024-08-31T05:51:39.957595+0000 mgr.a (mgr.14388) 9530 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:51:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:41 smithi027 bash[22610]: audit 2024-08-31T05:51:40.395879+0000 mon.a (mon.0) 2008 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:51:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:41 smithi027 bash[22610]: audit 2024-08-31T05:51:40.397692+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:51:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:41 smithi027 bash[22610]: audit 2024-08-31T05:51:40.408012+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:51:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:41 smithi027 bash[22610]: audit 2024-08-31T05:51:40.410903+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:51:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:41 smithi027 bash[22610]: audit 2024-08-31T05:51:40.412032+0000 mgr.a (mgr.14388) 9531 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:51:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:41 smithi027 bash[22610]: audit 2024-08-31T05:51:40.686579+0000 mgr.a (mgr.14388) 9532 : audit [DBG] from='client.211884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:41 smithi191 bash[24992]: cluster 2024-08-31T05:51:39.957595+0000 mgr.a (mgr.14388) 9530 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:51:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:41 smithi191 bash[24992]: audit 2024-08-31T05:51:40.395879+0000 mon.a (mon.0) 2008 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:51:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:41 smithi191 bash[24992]: audit 2024-08-31T05:51:40.397692+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:51:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:41 smithi191 bash[24992]: audit 2024-08-31T05:51:40.408012+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:51:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:41 smithi191 bash[24992]: audit 2024-08-31T05:51:40.410903+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:51:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:41 smithi191 bash[24992]: audit 2024-08-31T05:51:40.412032+0000 mgr.a (mgr.14388) 9531 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:51:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:41 smithi191 bash[24992]: audit 2024-08-31T05:51:40.686579+0000 mgr.a (mgr.14388) 9532 : audit [DBG] from='client.211884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:41.541 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:41.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:41.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:41.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:41.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:41 smithi163 bash[24253]: cluster 2024-08-31T05:51:39.957595+0000 mgr.a (mgr.14388) 9530 : cluster [DBG] pgmap v6607: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:51:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:41 smithi163 bash[24253]: audit 2024-08-31T05:51:40.395879+0000 mon.a (mon.0) 2008 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:51:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:41 smithi163 bash[24253]: audit 2024-08-31T05:51:40.397692+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:51:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:41 smithi163 bash[24253]: audit 2024-08-31T05:51:40.408012+0000 mon.a (mon.0) 2010 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:51:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:41 smithi163 bash[24253]: audit 2024-08-31T05:51:40.410903+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:51:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:41 smithi163 bash[24253]: audit 2024-08-31T05:51:40.412032+0000 mgr.a (mgr.14388) 9531 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:51:41.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:41 smithi163 bash[24253]: audit 2024-08-31T05:51:40.686579+0000 mgr.a (mgr.14388) 9532 : audit [DBG] from='client.211884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:42 smithi027 bash[22610]: audit 2024-08-31T05:51:41.135661+0000 mgr.a (mgr.14388) 9533 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:51:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:42 smithi027 bash[22610]: cephadm 2024-08-31T05:51:41.148824+0000 mgr.a (mgr.14388) 9534 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:51:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:42 smithi191 bash[24992]: audit 2024-08-31T05:51:41.135661+0000 mgr.a (mgr.14388) 9533 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:51:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:42 smithi191 bash[24992]: cephadm 2024-08-31T05:51:41.148824+0000 mgr.a (mgr.14388) 9534 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:51:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:42 smithi163 bash[24253]: audit 2024-08-31T05:51:41.135661+0000 mgr.a (mgr.14388) 9533 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:51:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:42 smithi163 bash[24253]: cephadm 2024-08-31T05:51:41.148824+0000 mgr.a (mgr.14388) 9534 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:51:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:43 smithi027 bash[22610]: cluster 2024-08-31T05:51:41.958535+0000 mgr.a (mgr.14388) 9535 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:43 smithi191 bash[24992]: cluster 2024-08-31T05:51:41.958535+0000 mgr.a (mgr.14388) 9535 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:43 smithi163 bash[24253]: cluster 2024-08-31T05:51:41.958535+0000 mgr.a (mgr.14388) 9535 : cluster [DBG] pgmap v6608: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:45 smithi027 bash[22610]: cluster 2024-08-31T05:51:43.960775+0000 mgr.a (mgr.14388) 9536 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:45 smithi191 bash[24992]: cluster 2024-08-31T05:51:43.960775+0000 mgr.a (mgr.14388) 9536 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:45 smithi163 bash[24253]: cluster 2024-08-31T05:51:43.960775+0000 mgr.a (mgr.14388) 9536 : cluster [DBG] pgmap v6609: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:46.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:51:46.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:51:46.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:47.323 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:47.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:47.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:47.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:47.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:47 smithi027 bash[22610]: cluster 2024-08-31T05:51:45.961555+0000 mgr.a (mgr.14388) 9537 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:47 smithi191 bash[24992]: cluster 2024-08-31T05:51:45.961555+0000 mgr.a (mgr.14388) 9537 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:47 smithi163 bash[24253]: cluster 2024-08-31T05:51:45.961555+0000 mgr.a (mgr.14388) 9537 : cluster [DBG] pgmap v6610: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:48 smithi191 bash[24992]: audit 2024-08-31T05:51:46.880719+0000 mgr.a (mgr.14388) 9538 : audit [DBG] from='client.212067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:48 smithi163 bash[24253]: audit 2024-08-31T05:51:46.880719+0000 mgr.a (mgr.14388) 9538 : audit [DBG] from='client.212067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:48 smithi027 bash[22610]: audit 2024-08-31T05:51:46.880719+0000 mgr.a (mgr.14388) 9538 : audit [DBG] from='client.212067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:49 smithi191 bash[24992]: cluster 2024-08-31T05:51:47.963508+0000 mgr.a (mgr.14388) 9539 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:49 smithi163 bash[24253]: cluster 2024-08-31T05:51:47.963508+0000 mgr.a (mgr.14388) 9539 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:49 smithi027 bash[22610]: cluster 2024-08-31T05:51:47.963508+0000 mgr.a (mgr.14388) 9539 : cluster [DBG] pgmap v6611: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:51 smithi191 bash[24992]: cluster 2024-08-31T05:51:49.964919+0000 mgr.a (mgr.14388) 9540 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:51 smithi163 bash[24253]: cluster 2024-08-31T05:51:49.964919+0000 mgr.a (mgr.14388) 9540 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:51 smithi027 bash[22610]: cluster 2024-08-31T05:51:49.964919+0000 mgr.a (mgr.14388) 9540 : cluster [DBG] pgmap v6612: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:52.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:51:52.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:51:52.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:53.110 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:53.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:53.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:53.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:53.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:53 smithi191 bash[24992]: cluster 2024-08-31T05:51:51.965854+0000 mgr.a (mgr.14388) 9541 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:53 smithi191 bash[24992]: audit 2024-08-31T05:51:52.659204+0000 mgr.a (mgr.14388) 9542 : audit [DBG] from='client.212145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:53 smithi163 bash[24253]: cluster 2024-08-31T05:51:51.965854+0000 mgr.a (mgr.14388) 9541 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:53 smithi163 bash[24253]: audit 2024-08-31T05:51:52.659204+0000 mgr.a (mgr.14388) 9542 : audit [DBG] from='client.212145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:53 smithi027 bash[22610]: cluster 2024-08-31T05:51:51.965854+0000 mgr.a (mgr.14388) 9541 : cluster [DBG] pgmap v6613: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:53 smithi027 bash[22610]: audit 2024-08-31T05:51:52.659204+0000 mgr.a (mgr.14388) 9542 : audit [DBG] from='client.212145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:55 smithi191 bash[24992]: cluster 2024-08-31T05:51:53.968332+0000 mgr.a (mgr.14388) 9543 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:55.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:55 smithi163 bash[24253]: cluster 2024-08-31T05:51:53.968332+0000 mgr.a (mgr.14388) 9543 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:55 smithi027 bash[22610]: cluster 2024-08-31T05:51:53.968332+0000 mgr.a (mgr.14388) 9543 : cluster [DBG] pgmap v6614: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:51:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:57 smithi191 bash[24992]: cluster 2024-08-31T05:51:55.969114+0000 mgr.a (mgr.14388) 9544 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:51:57.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:57 smithi163 bash[24253]: cluster 2024-08-31T05:51:55.969114+0000 mgr.a (mgr.14388) 9544 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:51:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:57 smithi027 bash[22610]: cluster 2024-08-31T05:51:55.969114+0000 mgr.a (mgr.14388) 9544 : cluster [DBG] pgmap v6615: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:51:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:51:58.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:51:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:51:58.862 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:51:58.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:51:58.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:51:58.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:51:58.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:51:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:59 smithi191 bash[24992]: cluster 2024-08-31T05:51:57.970708+0000 mgr.a (mgr.14388) 9545 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:59.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:51:59 smithi191 bash[24992]: audit 2024-08-31T05:51:58.445181+0000 mgr.a (mgr.14388) 9546 : audit [DBG] from='client.212223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:59 smithi163 bash[24253]: cluster 2024-08-31T05:51:57.970708+0000 mgr.a (mgr.14388) 9545 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:51:59 smithi163 bash[24253]: audit 2024-08-31T05:51:58.445181+0000 mgr.a (mgr.14388) 9546 : audit [DBG] from='client.212223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:51:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:59 smithi027 bash[22610]: cluster 2024-08-31T05:51:57.970708+0000 mgr.a (mgr.14388) 9545 : cluster [DBG] pgmap v6616: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:51:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:51:59 smithi027 bash[22610]: audit 2024-08-31T05:51:58.445181+0000 mgr.a (mgr.14388) 9546 : audit [DBG] from='client.212223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:01 smithi191 bash[24992]: cluster 2024-08-31T05:51:59.972681+0000 mgr.a (mgr.14388) 9547 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:52:01.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:01 smithi163 bash[24253]: cluster 2024-08-31T05:51:59.972681+0000 mgr.a (mgr.14388) 9547 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:52:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:01 smithi027 bash[22610]: cluster 2024-08-31T05:51:59.972681+0000 mgr.a (mgr.14388) 9547 : cluster [DBG] pgmap v6617: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:52:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:03 smithi191 bash[24992]: cluster 2024-08-31T05:52:01.973631+0000 mgr.a (mgr.14388) 9548 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:52:03.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:03 smithi163 bash[24253]: cluster 2024-08-31T05:52:01.973631+0000 mgr.a (mgr.14388) 9548 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:52:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:03 smithi027 bash[22610]: cluster 2024-08-31T05:52:01.973631+0000 mgr.a (mgr.14388) 9548 : cluster [DBG] pgmap v6618: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:52:03.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:52:03.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:52:03.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:52:04.638 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:52:04.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:52:04.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:52:04.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:52:04.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:52:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:05 smithi191 bash[24992]: cluster 2024-08-31T05:52:03.974707+0000 mgr.a (mgr.14388) 9549 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:05 smithi191 bash[24992]: audit 2024-08-31T05:52:04.198107+0000 mgr.a (mgr.14388) 9550 : audit [DBG] from='client.212298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:05.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:05 smithi163 bash[24253]: cluster 2024-08-31T05:52:03.974707+0000 mgr.a (mgr.14388) 9549 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:05.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:05 smithi163 bash[24253]: audit 2024-08-31T05:52:04.198107+0000 mgr.a (mgr.14388) 9550 : audit [DBG] from='client.212298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:05 smithi027 bash[22610]: cluster 2024-08-31T05:52:03.974707+0000 mgr.a (mgr.14388) 9549 : cluster [DBG] pgmap v6619: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:05 smithi027 bash[22610]: audit 2024-08-31T05:52:04.198107+0000 mgr.a (mgr.14388) 9550 : audit [DBG] from='client.212298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:07 smithi191 bash[24992]: cluster 2024-08-31T05:52:05.975755+0000 mgr.a (mgr.14388) 9551 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:52:07.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:07 smithi163 bash[24253]: cluster 2024-08-31T05:52:05.975755+0000 mgr.a (mgr.14388) 9551 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:52:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:07 smithi027 bash[22610]: cluster 2024-08-31T05:52:05.975755+0000 mgr.a (mgr.14388) 9551 : cluster [DBG] pgmap v6620: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:52:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:09 smithi191 bash[24992]: cluster 2024-08-31T05:52:07.977637+0000 mgr.a (mgr.14388) 9552 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T05:52:09.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:52:09.641 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:52:09.641 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:52:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:09 smithi163 bash[24253]: cluster 2024-08-31T05:52:07.977637+0000 mgr.a (mgr.14388) 9552 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T05:52:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:09 smithi027 bash[22610]: cluster 2024-08-31T05:52:07.977637+0000 mgr.a (mgr.14388) 9552 : cluster [DBG] pgmap v6621: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T05:52:10.409 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:52:10.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:52:10.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:52:10.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:52:10.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:52:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:11 smithi163 bash[24253]: audit 2024-08-31T05:52:09.976673+0000 mgr.a (mgr.14388) 9553 : audit [DBG] from='client.212373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:11 smithi163 bash[24253]: cluster 2024-08-31T05:52:09.995203+0000 mgr.a (mgr.14388) 9554 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:11 smithi027 bash[22610]: audit 2024-08-31T05:52:09.976673+0000 mgr.a (mgr.14388) 9553 : audit [DBG] from='client.212373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:11 smithi027 bash[22610]: cluster 2024-08-31T05:52:09.995203+0000 mgr.a (mgr.14388) 9554 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:11 smithi191 bash[24992]: audit 2024-08-31T05:52:09.976673+0000 mgr.a (mgr.14388) 9553 : audit [DBG] from='client.212373 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:11.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:11 smithi191 bash[24992]: cluster 2024-08-31T05:52:09.995203+0000 mgr.a (mgr.14388) 9554 : cluster [DBG] pgmap v6622: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:13 smithi163 bash[24253]: cluster 2024-08-31T05:52:11.996273+0000 mgr.a (mgr.14388) 9555 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:13 smithi027 bash[22610]: cluster 2024-08-31T05:52:11.996273+0000 mgr.a (mgr.14388) 9555 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:13 smithi191 bash[24992]: cluster 2024-08-31T05:52:11.996273+0000 mgr.a (mgr.14388) 9555 : cluster [DBG] pgmap v6623: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:15.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:52:15.411 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:52:15.411 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:52:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:15 smithi163 bash[24253]: cluster 2024-08-31T05:52:13.998531+0000 mgr.a (mgr.14388) 9556 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:52:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:15 smithi027 bash[22610]: cluster 2024-08-31T05:52:13.998531+0000 mgr.a (mgr.14388) 9556 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:52:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:15 smithi191 bash[24992]: cluster 2024-08-31T05:52:13.998531+0000 mgr.a (mgr.14388) 9556 : cluster [DBG] pgmap v6624: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:52:16.177 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:52:16.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:52:16.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:52:16.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:52:16.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:52:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:17 smithi163 bash[24253]: audit 2024-08-31T05:52:15.746841+0000 mgr.a (mgr.14388) 9557 : audit [DBG] from='client.212451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:17 smithi163 bash[24253]: cluster 2024-08-31T05:52:15.999079+0000 mgr.a (mgr.14388) 9558 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:17 smithi027 bash[22610]: audit 2024-08-31T05:52:15.746841+0000 mgr.a (mgr.14388) 9557 : audit [DBG] from='client.212451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:17 smithi027 bash[22610]: cluster 2024-08-31T05:52:15.999079+0000 mgr.a (mgr.14388) 9558 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:17 smithi191 bash[24992]: audit 2024-08-31T05:52:15.746841+0000 mgr.a (mgr.14388) 9557 : audit [DBG] from='client.212451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:17 smithi191 bash[24992]: cluster 2024-08-31T05:52:15.999079+0000 mgr.a (mgr.14388) 9558 : cluster [DBG] pgmap v6625: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:19 smithi163 bash[24253]: cluster 2024-08-31T05:52:18.000906+0000 mgr.a (mgr.14388) 9559 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:52:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:19 smithi027 bash[22610]: cluster 2024-08-31T05:52:18.000906+0000 mgr.a (mgr.14388) 9559 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:52:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:19 smithi191 bash[24992]: cluster 2024-08-31T05:52:18.000906+0000 mgr.a (mgr.14388) 9559 : cluster [DBG] pgmap v6626: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:52:21.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:52:21.180 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:52:21.180 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:52:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:21 smithi163 bash[24253]: cluster 2024-08-31T05:52:20.002184+0000 mgr.a (mgr.14388) 9560 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:52:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:21 smithi027 bash[22610]: cluster 2024-08-31T05:52:20.002184+0000 mgr.a (mgr.14388) 9560 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:52:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:21 smithi191 bash[24992]: cluster 2024-08-31T05:52:20.002184+0000 mgr.a (mgr.14388) 9560 : cluster [DBG] pgmap v6627: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:52:21.961 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:52:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:52:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:52:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:52:21.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:52:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:22 smithi163 bash[24253]: audit 2024-08-31T05:52:21.513164+0000 mgr.a (mgr.14388) 9561 : audit [DBG] from='client.212529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:22 smithi027 bash[22610]: audit 2024-08-31T05:52:21.513164+0000 mgr.a (mgr.14388) 9561 : audit [DBG] from='client.212529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:22 smithi191 bash[24992]: audit 2024-08-31T05:52:21.513164+0000 mgr.a (mgr.14388) 9561 : audit [DBG] from='client.212529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:23 smithi163 bash[24253]: cluster 2024-08-31T05:52:22.002936+0000 mgr.a (mgr.14388) 9562 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:23 smithi027 bash[22610]: cluster 2024-08-31T05:52:22.002936+0000 mgr.a (mgr.14388) 9562 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:23 smithi191 bash[24992]: cluster 2024-08-31T05:52:22.002936+0000 mgr.a (mgr.14388) 9562 : cluster [DBG] pgmap v6628: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:52:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:25 smithi163 bash[24253]: cluster 2024-08-31T05:52:24.005237+0000 mgr.a (mgr.14388) 9563 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:52:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:25 smithi027 bash[22610]: cluster 2024-08-31T05:52:24.005237+0000 mgr.a (mgr.14388) 9563 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:52:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:25 smithi191 bash[24992]: cluster 2024-08-31T05:52:24.005237+0000 mgr.a (mgr.14388) 9563 : cluster [DBG] pgmap v6629: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T05:52:26.962 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:52:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:52:26.963 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:52:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:27 smithi163 bash[24253]: cluster 2024-08-31T05:52:26.006063+0000 mgr.a (mgr.14388) 9564 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:27 smithi027 bash[22610]: cluster 2024-08-31T05:52:26.006063+0000 mgr.a (mgr.14388) 9564 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:27.746 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:52:27.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:52:27.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:52:27.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:52:27.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:52:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:27 smithi191 bash[24992]: cluster 2024-08-31T05:52:26.006063+0000 mgr.a (mgr.14388) 9564 : cluster [DBG] pgmap v6630: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:28 smithi163 bash[24253]: audit 2024-08-31T05:52:27.300070+0000 mgr.a (mgr.14388) 9565 : audit [DBG] from='client.212607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:28 smithi027 bash[22610]: audit 2024-08-31T05:52:27.300070+0000 mgr.a (mgr.14388) 9565 : audit [DBG] from='client.212607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:28 smithi191 bash[24992]: audit 2024-08-31T05:52:27.300070+0000 mgr.a (mgr.14388) 9565 : audit [DBG] from='client.212607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:29 smithi163 bash[24253]: cluster 2024-08-31T05:52:28.007934+0000 mgr.a (mgr.14388) 9566 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:29 smithi027 bash[22610]: cluster 2024-08-31T05:52:28.007934+0000 mgr.a (mgr.14388) 9566 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:29 smithi191 bash[24992]: cluster 2024-08-31T05:52:28.007934+0000 mgr.a (mgr.14388) 9566 : cluster [DBG] pgmap v6631: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:31 smithi163 bash[24253]: cluster 2024-08-31T05:52:30.009172+0000 mgr.a (mgr.14388) 9567 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:31 smithi027 bash[22610]: cluster 2024-08-31T05:52:30.009172+0000 mgr.a (mgr.14388) 9567 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:31 smithi191 bash[24992]: cluster 2024-08-31T05:52:30.009172+0000 mgr.a (mgr.14388) 9567 : cluster [DBG] pgmap v6632: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:32.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:52:32.749 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:52:32.749 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:52:33.483 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:52:33.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:52:33.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:52:33.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:52:33.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:52:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:33 smithi163 bash[24253]: cluster 2024-08-31T05:52:32.009946+0000 mgr.a (mgr.14388) 9568 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:33 smithi027 bash[22610]: cluster 2024-08-31T05:52:32.009946+0000 mgr.a (mgr.14388) 9568 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:33 smithi191 bash[24992]: cluster 2024-08-31T05:52:32.009946+0000 mgr.a (mgr.14388) 9568 : cluster [DBG] pgmap v6633: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:34 smithi163 bash[24253]: audit 2024-08-31T05:52:33.075248+0000 mgr.a (mgr.14388) 9569 : audit [DBG] from='client.212679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:34 smithi027 bash[22610]: audit 2024-08-31T05:52:33.075248+0000 mgr.a (mgr.14388) 9569 : audit [DBG] from='client.212679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:34.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:34 smithi191 bash[24992]: audit 2024-08-31T05:52:33.075248+0000 mgr.a (mgr.14388) 9569 : audit [DBG] from='client.212679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:35 smithi163 bash[24253]: cluster 2024-08-31T05:52:34.012760+0000 mgr.a (mgr.14388) 9570 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:35 smithi027 bash[22610]: cluster 2024-08-31T05:52:34.012760+0000 mgr.a (mgr.14388) 9570 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:35 smithi191 bash[24992]: cluster 2024-08-31T05:52:34.012760+0000 mgr.a (mgr.14388) 9570 : cluster [DBG] pgmap v6634: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T05:52:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:37 smithi163 bash[24253]: cluster 2024-08-31T05:52:36.013537+0000 mgr.a (mgr.14388) 9571 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:52:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:37 smithi027 bash[22610]: cluster 2024-08-31T05:52:36.013537+0000 mgr.a (mgr.14388) 9571 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:52:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:37 smithi191 bash[24992]: cluster 2024-08-31T05:52:36.013537+0000 mgr.a (mgr.14388) 9571 : cluster [DBG] pgmap v6635: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:52:38.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:52:38.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:52:38.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:52:39.224 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:52:39.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:52:39.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:52:39.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:52:39.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:52:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:39 smithi163 bash[24253]: cluster 2024-08-31T05:52:38.015060+0000 mgr.a (mgr.14388) 9572 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-08-31T05:52:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:39 smithi027 bash[22610]: cluster 2024-08-31T05:52:38.015060+0000 mgr.a (mgr.14388) 9572 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-08-31T05:52:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:39 smithi191 bash[24992]: cluster 2024-08-31T05:52:38.015060+0000 mgr.a (mgr.14388) 9572 : cluster [DBG] pgmap v6636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 20 KiB/s rd, 0 B/s wr, 31 op/s 2024-08-31T05:52:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:40 smithi163 bash[24253]: audit 2024-08-31T05:52:38.814648+0000 mgr.a (mgr.14388) 9573 : audit [DBG] from='client.212754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:40 smithi027 bash[22610]: audit 2024-08-31T05:52:38.814648+0000 mgr.a (mgr.14388) 9573 : audit [DBG] from='client.212754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:40 smithi191 bash[24992]: audit 2024-08-31T05:52:38.814648+0000 mgr.a (mgr.14388) 9573 : audit [DBG] from='client.212754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:41 smithi163 bash[24253]: cluster 2024-08-31T05:52:40.016937+0000 mgr.a (mgr.14388) 9574 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:52:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:41 smithi163 bash[24253]: audit 2024-08-31T05:52:41.205219+0000 mon.a (mon.0) 2012 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:52:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:41 smithi027 bash[22610]: cluster 2024-08-31T05:52:40.016937+0000 mgr.a (mgr.14388) 9574 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:52:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:41 smithi027 bash[22610]: audit 2024-08-31T05:52:41.205219+0000 mon.a (mon.0) 2012 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:52:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:41 smithi191 bash[24992]: cluster 2024-08-31T05:52:40.016937+0000 mgr.a (mgr.14388) 9574 : cluster [DBG] pgmap v6637: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:52:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:41 smithi191 bash[24992]: audit 2024-08-31T05:52:41.205219+0000 mon.a (mon.0) 2012 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:52:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:43 smithi163 bash[24253]: cluster 2024-08-31T05:52:42.017739+0000 mgr.a (mgr.14388) 9575 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:52:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:43 smithi027 bash[22610]: cluster 2024-08-31T05:52:42.017739+0000 mgr.a (mgr.14388) 9575 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:52:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:43 smithi191 bash[24992]: cluster 2024-08-31T05:52:42.017739+0000 mgr.a (mgr.14388) 9575 : cluster [DBG] pgmap v6638: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T05:52:44.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:52:44.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:52:44.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:52:44.969 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:52:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:52:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:52:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:52:44.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:52:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:45 smithi163 bash[24253]: cluster 2024-08-31T05:52:44.019814+0000 mgr.a (mgr.14388) 9576 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:52:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:45 smithi163 bash[24253]: audit 2024-08-31T05:52:44.552247+0000 mgr.a (mgr.14388) 9577 : audit [DBG] from='client.212832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:45 smithi027 bash[22610]: cluster 2024-08-31T05:52:44.019814+0000 mgr.a (mgr.14388) 9576 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:52:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:45 smithi027 bash[22610]: audit 2024-08-31T05:52:44.552247+0000 mgr.a (mgr.14388) 9577 : audit [DBG] from='client.212832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:45 smithi191 bash[24992]: cluster 2024-08-31T05:52:44.019814+0000 mgr.a (mgr.14388) 9576 : cluster [DBG] pgmap v6639: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:52:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:45 smithi191 bash[24992]: audit 2024-08-31T05:52:44.552247+0000 mgr.a (mgr.14388) 9577 : audit [DBG] from='client.212832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: cluster 2024-08-31T05:52:46.020723+0000 mgr.a (mgr.14388) 9578 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:52:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: audit 2024-08-31T05:52:46.555632+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: audit 2024-08-31T05:52:46.559643+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: audit 2024-08-31T05:52:46.573095+0000 mon.a (mon.0) 2015 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: audit 2024-08-31T05:52:46.577918+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: audit 2024-08-31T05:52:46.581397+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: audit 2024-08-31T05:52:46.586832+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: audit 2024-08-31T05:52:47.290392+0000 mon.a (mon.0) 2019 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:52:47.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: audit 2024-08-31T05:52:47.292150+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:52:47.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: audit 2024-08-31T05:52:47.302194+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:47 smithi163 bash[24253]: audit 2024-08-31T05:52:47.306958+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:52:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: cluster 2024-08-31T05:52:46.020723+0000 mgr.a (mgr.14388) 9578 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:52:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: audit 2024-08-31T05:52:46.555632+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: audit 2024-08-31T05:52:46.559643+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: audit 2024-08-31T05:52:46.573095+0000 mon.a (mon.0) 2015 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: audit 2024-08-31T05:52:46.577918+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: audit 2024-08-31T05:52:46.581397+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: audit 2024-08-31T05:52:46.586832+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: audit 2024-08-31T05:52:47.290392+0000 mon.a (mon.0) 2019 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:52:47.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: audit 2024-08-31T05:52:47.292150+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:52:47.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: audit 2024-08-31T05:52:47.302194+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:47.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:47 smithi027 bash[22610]: audit 2024-08-31T05:52:47.306958+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:52:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: cluster 2024-08-31T05:52:46.020723+0000 mgr.a (mgr.14388) 9578 : cluster [DBG] pgmap v6640: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T05:52:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: audit 2024-08-31T05:52:46.555632+0000 mon.a (mon.0) 2013 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: audit 2024-08-31T05:52:46.559643+0000 mon.a (mon.0) 2014 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: audit 2024-08-31T05:52:46.573095+0000 mon.a (mon.0) 2015 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: audit 2024-08-31T05:52:46.577918+0000 mon.a (mon.0) 2016 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: audit 2024-08-31T05:52:46.581397+0000 mon.a (mon.0) 2017 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: audit 2024-08-31T05:52:46.586832+0000 mon.a (mon.0) 2018 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: audit 2024-08-31T05:52:47.290392+0000 mon.a (mon.0) 2019 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:52:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: audit 2024-08-31T05:52:47.292150+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:52:48.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: audit 2024-08-31T05:52:47.302194+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:52:48.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:47 smithi191 bash[24992]: audit 2024-08-31T05:52:47.306958+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:52:48.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:52:48 smithi027 bash[22863]: debug 2024-08-31T05:52:48.043+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:52:48.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:52:48 smithi027 bash[22863]: debug 2024-08-31T05:52:48.043+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:52:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:48 smithi163 bash[24253]: audit 2024-08-31T05:52:47.309286+0000 mgr.a (mgr.14388) 9579 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:52:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:48 smithi027 bash[22610]: audit 2024-08-31T05:52:47.309286+0000 mgr.a (mgr.14388) 9579 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:52:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:48 smithi191 bash[24992]: audit 2024-08-31T05:52:47.309286+0000 mgr.a (mgr.14388) 9579 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:52:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:49 smithi163 bash[24253]: cluster 2024-08-31T05:52:48.022008+0000 mgr.a (mgr.14388) 9580 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 255 B/s wr, 59 op/s 2024-08-31T05:52:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:49 smithi163 bash[24253]: audit 2024-08-31T05:52:48.048471+0000 mgr.a (mgr.14388) 9581 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:52:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:49 smithi163 bash[24253]: cephadm 2024-08-31T05:52:48.049719+0000 mgr.a (mgr.14388) 9582 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:52:49.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:52:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:52:49.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:52:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:49 smithi027 bash[22610]: cluster 2024-08-31T05:52:48.022008+0000 mgr.a (mgr.14388) 9580 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 255 B/s wr, 59 op/s 2024-08-31T05:52:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:49 smithi027 bash[22610]: audit 2024-08-31T05:52:48.048471+0000 mgr.a (mgr.14388) 9581 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:52:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:49 smithi027 bash[22610]: cephadm 2024-08-31T05:52:48.049719+0000 mgr.a (mgr.14388) 9582 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:52:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:49 smithi191 bash[24992]: cluster 2024-08-31T05:52:48.022008+0000 mgr.a (mgr.14388) 9580 : cluster [DBG] pgmap v6641: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 37 KiB/s rd, 255 B/s wr, 59 op/s 2024-08-31T05:52:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:49 smithi191 bash[24992]: audit 2024-08-31T05:52:48.048471+0000 mgr.a (mgr.14388) 9581 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:52:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:49 smithi191 bash[24992]: cephadm 2024-08-31T05:52:48.049719+0000 mgr.a (mgr.14388) 9582 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:52:50.753 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:52:50.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:52:50.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:52:50.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:52:50.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:52:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:51 smithi163 bash[24253]: cluster 2024-08-31T05:52:50.023168+0000 mgr.a (mgr.14388) 9583 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 255 B/s wr, 30 op/s 2024-08-31T05:52:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:51 smithi163 bash[24253]: audit 2024-08-31T05:52:50.311331+0000 mgr.a (mgr.14388) 9584 : audit [DBG] from='client.213015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:51 smithi027 bash[22610]: cluster 2024-08-31T05:52:50.023168+0000 mgr.a (mgr.14388) 9583 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 255 B/s wr, 30 op/s 2024-08-31T05:52:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:51 smithi027 bash[22610]: audit 2024-08-31T05:52:50.311331+0000 mgr.a (mgr.14388) 9584 : audit [DBG] from='client.213015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:51 smithi191 bash[24992]: cluster 2024-08-31T05:52:50.023168+0000 mgr.a (mgr.14388) 9583 : cluster [DBG] pgmap v6642: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 255 B/s wr, 30 op/s 2024-08-31T05:52:52.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:51 smithi191 bash[24992]: audit 2024-08-31T05:52:50.311331+0000 mgr.a (mgr.14388) 9584 : audit [DBG] from='client.213015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:53 smithi163 bash[24253]: cluster 2024-08-31T05:52:52.024012+0000 mgr.a (mgr.14388) 9585 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T05:52:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:53 smithi027 bash[22610]: cluster 2024-08-31T05:52:52.024012+0000 mgr.a (mgr.14388) 9585 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T05:52:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:53 smithi191 bash[24992]: cluster 2024-08-31T05:52:52.024012+0000 mgr.a (mgr.14388) 9585 : cluster [DBG] pgmap v6643: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T05:52:55.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:52:55.756 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:52:55.756 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:52:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:55 smithi163 bash[24253]: cluster 2024-08-31T05:52:54.026351+0000 mgr.a (mgr.14388) 9586 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:52:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:55 smithi027 bash[22610]: cluster 2024-08-31T05:52:54.026351+0000 mgr.a (mgr.14388) 9586 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:52:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:55 smithi191 bash[24992]: cluster 2024-08-31T05:52:54.026351+0000 mgr.a (mgr.14388) 9586 : cluster [DBG] pgmap v6644: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:52:56.505 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:52:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:52:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:52:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:52:56.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:52:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:57 smithi163 bash[24253]: cluster 2024-08-31T05:52:56.027125+0000 mgr.a (mgr.14388) 9587 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:52:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:57 smithi163 bash[24253]: audit 2024-08-31T05:52:56.087141+0000 mgr.a (mgr.14388) 9588 : audit [DBG] from='client.213093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:57 smithi027 bash[22610]: cluster 2024-08-31T05:52:56.027125+0000 mgr.a (mgr.14388) 9587 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:52:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:57 smithi027 bash[22610]: audit 2024-08-31T05:52:56.087141+0000 mgr.a (mgr.14388) 9588 : audit [DBG] from='client.213093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:57 smithi191 bash[24992]: cluster 2024-08-31T05:52:56.027125+0000 mgr.a (mgr.14388) 9587 : cluster [DBG] pgmap v6645: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:52:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:57 smithi191 bash[24992]: audit 2024-08-31T05:52:56.087141+0000 mgr.a (mgr.14388) 9588 : audit [DBG] from='client.213093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:52:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:52:59 smithi163 bash[24253]: cluster 2024-08-31T05:52:58.028905+0000 mgr.a (mgr.14388) 9589 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:52:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:52:59 smithi027 bash[22610]: cluster 2024-08-31T05:52:58.028905+0000 mgr.a (mgr.14388) 9589 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:53:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:52:59 smithi191 bash[24992]: cluster 2024-08-31T05:52:58.028905+0000 mgr.a (mgr.14388) 9589 : cluster [DBG] pgmap v6646: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:53:01.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:01.507 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:01.507 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:01 smithi163 bash[24253]: cluster 2024-08-31T05:53:00.030154+0000 mgr.a (mgr.14388) 9590 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:53:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:01 smithi027 bash[22610]: cluster 2024-08-31T05:53:00.030154+0000 mgr.a (mgr.14388) 9590 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:53:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:01 smithi191 bash[24992]: cluster 2024-08-31T05:53:00.030154+0000 mgr.a (mgr.14388) 9590 : cluster [DBG] pgmap v6647: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T05:53:02.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:02.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:02.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:02.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:53:02.295 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:03 smithi163 bash[24253]: audit 2024-08-31T05:53:01.843050+0000 mgr.a (mgr.14388) 9591 : audit [DBG] from='client.213171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:03 smithi163 bash[24253]: cluster 2024-08-31T05:53:02.030804+0000 mgr.a (mgr.14388) 9592 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T05:53:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:03 smithi027 bash[22610]: audit 2024-08-31T05:53:01.843050+0000 mgr.a (mgr.14388) 9591 : audit [DBG] from='client.213171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:03 smithi027 bash[22610]: cluster 2024-08-31T05:53:02.030804+0000 mgr.a (mgr.14388) 9592 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T05:53:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:03 smithi191 bash[24992]: audit 2024-08-31T05:53:01.843050+0000 mgr.a (mgr.14388) 9591 : audit [DBG] from='client.213171 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:03 smithi191 bash[24992]: cluster 2024-08-31T05:53:02.030804+0000 mgr.a (mgr.14388) 9592 : cluster [DBG] pgmap v6648: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T05:53:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:05 smithi163 bash[24253]: cluster 2024-08-31T05:53:04.033123+0000 mgr.a (mgr.14388) 9593 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T05:53:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:05 smithi027 bash[22610]: cluster 2024-08-31T05:53:04.033123+0000 mgr.a (mgr.14388) 9593 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T05:53:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:05 smithi191 bash[24992]: cluster 2024-08-31T05:53:04.033123+0000 mgr.a (mgr.14388) 9593 : cluster [DBG] pgmap v6649: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T05:53:07.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:07.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:07.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:07 smithi163 bash[24253]: cluster 2024-08-31T05:53:06.033900+0000 mgr.a (mgr.14388) 9594 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:07 smithi027 bash[22610]: cluster 2024-08-31T05:53:06.033900+0000 mgr.a (mgr.14388) 9594 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:07 smithi191 bash[24992]: cluster 2024-08-31T05:53:06.033900+0000 mgr.a (mgr.14388) 9594 : cluster [DBG] pgmap v6650: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:08.052 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:08.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:08.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:08.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:08.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:53:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:08 smithi163 bash[24253]: audit 2024-08-31T05:53:07.632189+0000 mgr.a (mgr.14388) 9595 : audit [DBG] from='client.213249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:08 smithi027 bash[22610]: audit 2024-08-31T05:53:07.632189+0000 mgr.a (mgr.14388) 9595 : audit [DBG] from='client.213249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:08 smithi191 bash[24992]: audit 2024-08-31T05:53:07.632189+0000 mgr.a (mgr.14388) 9595 : audit [DBG] from='client.213249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:09.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:09 smithi163 bash[24253]: cluster 2024-08-31T05:53:08.034960+0000 mgr.a (mgr.14388) 9596 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:53:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:09 smithi027 bash[22610]: cluster 2024-08-31T05:53:08.034960+0000 mgr.a (mgr.14388) 9596 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:53:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:09 smithi191 bash[24992]: cluster 2024-08-31T05:53:08.034960+0000 mgr.a (mgr.14388) 9596 : cluster [DBG] pgmap v6651: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:53:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:11 smithi163 bash[24253]: cluster 2024-08-31T05:53:10.036216+0000 mgr.a (mgr.14388) 9597 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T05:53:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:11 smithi027 bash[22610]: cluster 2024-08-31T05:53:10.036216+0000 mgr.a (mgr.14388) 9597 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T05:53:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:11 smithi191 bash[24992]: cluster 2024-08-31T05:53:10.036216+0000 mgr.a (mgr.14388) 9597 : cluster [DBG] pgmap v6652: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T05:53:13.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:13.054 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:13.054 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:13.815 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:13.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:13.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:13.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:13.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:53:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:13 smithi163 bash[24253]: cluster 2024-08-31T05:53:12.037002+0000 mgr.a (mgr.14388) 9598 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:53:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:13 smithi027 bash[22610]: cluster 2024-08-31T05:53:12.037002+0000 mgr.a (mgr.14388) 9598 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:53:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:13 smithi191 bash[24992]: cluster 2024-08-31T05:53:12.037002+0000 mgr.a (mgr.14388) 9598 : cluster [DBG] pgmap v6653: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:53:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:14 smithi163 bash[24253]: audit 2024-08-31T05:53:13.383449+0000 mgr.a (mgr.14388) 9599 : audit [DBG] from='client.213327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:14 smithi027 bash[22610]: audit 2024-08-31T05:53:13.383449+0000 mgr.a (mgr.14388) 9599 : audit [DBG] from='client.213327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:14 smithi191 bash[24992]: audit 2024-08-31T05:53:13.383449+0000 mgr.a (mgr.14388) 9599 : audit [DBG] from='client.213327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:15 smithi163 bash[24253]: cluster 2024-08-31T05:53:14.039781+0000 mgr.a (mgr.14388) 9600 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:15 smithi027 bash[22610]: cluster 2024-08-31T05:53:14.039781+0000 mgr.a (mgr.14388) 9600 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:15 smithi191 bash[24992]: cluster 2024-08-31T05:53:14.039781+0000 mgr.a (mgr.14388) 9600 : cluster [DBG] pgmap v6654: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:17 smithi163 bash[24253]: cluster 2024-08-31T05:53:16.040574+0000 mgr.a (mgr.14388) 9601 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:53:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:17 smithi027 bash[22610]: cluster 2024-08-31T05:53:16.040574+0000 mgr.a (mgr.14388) 9601 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:53:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:17 smithi191 bash[24992]: cluster 2024-08-31T05:53:16.040574+0000 mgr.a (mgr.14388) 9601 : cluster [DBG] pgmap v6655: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:53:18.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:18.817 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:18.817 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:19.580 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:19.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:19.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:19.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:19.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:53:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:19 smithi163 bash[24253]: cluster 2024-08-31T05:53:18.042076+0000 mgr.a (mgr.14388) 9602 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:53:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:19 smithi027 bash[22610]: cluster 2024-08-31T05:53:18.042076+0000 mgr.a (mgr.14388) 9602 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:53:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:19 smithi191 bash[24992]: cluster 2024-08-31T05:53:18.042076+0000 mgr.a (mgr.14388) 9602 : cluster [DBG] pgmap v6656: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:53:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:20 smithi163 bash[24253]: audit 2024-08-31T05:53:19.151587+0000 mgr.a (mgr.14388) 9603 : audit [DBG] from='client.213405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:20 smithi027 bash[22610]: audit 2024-08-31T05:53:19.151587+0000 mgr.a (mgr.14388) 9603 : audit [DBG] from='client.213405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:21.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:20 smithi191 bash[24992]: audit 2024-08-31T05:53:19.151587+0000 mgr.a (mgr.14388) 9603 : audit [DBG] from='client.213405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:21 smithi163 bash[24253]: cluster 2024-08-31T05:53:20.043924+0000 mgr.a (mgr.14388) 9604 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:53:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:21 smithi027 bash[22610]: cluster 2024-08-31T05:53:20.043924+0000 mgr.a (mgr.14388) 9604 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:53:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:21 smithi191 bash[24992]: cluster 2024-08-31T05:53:20.043924+0000 mgr.a (mgr.14388) 9604 : cluster [DBG] pgmap v6657: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:53:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:23 smithi163 bash[24253]: cluster 2024-08-31T05:53:22.044733+0000 mgr.a (mgr.14388) 9605 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T05:53:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:23 smithi027 bash[22610]: cluster 2024-08-31T05:53:22.044733+0000 mgr.a (mgr.14388) 9605 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T05:53:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:23 smithi191 bash[24992]: cluster 2024-08-31T05:53:22.044733+0000 mgr.a (mgr.14388) 9605 : cluster [DBG] pgmap v6658: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T05:53:24.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:24.582 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:24.582 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:25.361 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:25.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:25.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:25.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:25.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:53:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:25 smithi163 bash[24253]: cluster 2024-08-31T05:53:24.046799+0000 mgr.a (mgr.14388) 9606 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T05:53:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:25 smithi027 bash[22610]: cluster 2024-08-31T05:53:24.046799+0000 mgr.a (mgr.14388) 9606 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T05:53:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:25 smithi191 bash[24992]: cluster 2024-08-31T05:53:24.046799+0000 mgr.a (mgr.14388) 9606 : cluster [DBG] pgmap v6659: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T05:53:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:26 smithi163 bash[24253]: audit 2024-08-31T05:53:24.922696+0000 mgr.a (mgr.14388) 9607 : audit [DBG] from='client.213483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:26 smithi027 bash[22610]: audit 2024-08-31T05:53:24.922696+0000 mgr.a (mgr.14388) 9607 : audit [DBG] from='client.213483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:26 smithi191 bash[24992]: audit 2024-08-31T05:53:24.922696+0000 mgr.a (mgr.14388) 9607 : audit [DBG] from='client.213483 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:27 smithi163 bash[24253]: cluster 2024-08-31T05:53:26.047633+0000 mgr.a (mgr.14388) 9608 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:53:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:27 smithi027 bash[22610]: cluster 2024-08-31T05:53:26.047633+0000 mgr.a (mgr.14388) 9608 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:53:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:27 smithi191 bash[24992]: cluster 2024-08-31T05:53:26.047633+0000 mgr.a (mgr.14388) 9608 : cluster [DBG] pgmap v6660: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:53:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:29 smithi163 bash[24253]: cluster 2024-08-31T05:53:28.049377+0000 mgr.a (mgr.14388) 9609 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-08-31T05:53:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:29 smithi027 bash[22610]: cluster 2024-08-31T05:53:28.049377+0000 mgr.a (mgr.14388) 9609 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-08-31T05:53:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:29 smithi191 bash[24992]: cluster 2024-08-31T05:53:28.049377+0000 mgr.a (mgr.14388) 9609 : cluster [DBG] pgmap v6661: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-08-31T05:53:30.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:30.363 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:30.363 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:31.144 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:31.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:31.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:31.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:31.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:53:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:31 smithi163 bash[24253]: cluster 2024-08-31T05:53:30.050636+0000 mgr.a (mgr.14388) 9610 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:53:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:31 smithi163 bash[24253]: audit 2024-08-31T05:53:30.698285+0000 mgr.a (mgr.14388) 9611 : audit [DBG] from='client.213561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:31 smithi027 bash[22610]: cluster 2024-08-31T05:53:30.050636+0000 mgr.a (mgr.14388) 9610 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:53:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:31 smithi027 bash[22610]: audit 2024-08-31T05:53:30.698285+0000 mgr.a (mgr.14388) 9611 : audit [DBG] from='client.213561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:31 smithi191 bash[24992]: cluster 2024-08-31T05:53:30.050636+0000 mgr.a (mgr.14388) 9610 : cluster [DBG] pgmap v6662: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:53:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:31 smithi191 bash[24992]: audit 2024-08-31T05:53:30.698285+0000 mgr.a (mgr.14388) 9611 : audit [DBG] from='client.213561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:33 smithi163 bash[24253]: cluster 2024-08-31T05:53:32.051543+0000 mgr.a (mgr.14388) 9612 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:53:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:33 smithi027 bash[22610]: cluster 2024-08-31T05:53:32.051543+0000 mgr.a (mgr.14388) 9612 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:53:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:33 smithi191 bash[24992]: cluster 2024-08-31T05:53:32.051543+0000 mgr.a (mgr.14388) 9612 : cluster [DBG] pgmap v6663: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:53:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:35 smithi163 bash[24253]: cluster 2024-08-31T05:53:34.053772+0000 mgr.a (mgr.14388) 9613 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T05:53:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:35 smithi027 bash[22610]: cluster 2024-08-31T05:53:34.053772+0000 mgr.a (mgr.14388) 9613 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T05:53:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:35 smithi191 bash[24992]: cluster 2024-08-31T05:53:34.053772+0000 mgr.a (mgr.14388) 9613 : cluster [DBG] pgmap v6664: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T05:53:36.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:36.147 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:36.147 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:36.888 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:36.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:36.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:36.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:36.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:53:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:37 smithi163 bash[24253]: cluster 2024-08-31T05:53:36.054531+0000 mgr.a (mgr.14388) 9614 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:37 smithi163 bash[24253]: audit 2024-08-31T05:53:36.471839+0000 mgr.a (mgr.14388) 9615 : audit [DBG] from='client.213636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:37 smithi027 bash[22610]: cluster 2024-08-31T05:53:36.054531+0000 mgr.a (mgr.14388) 9614 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:37 smithi027 bash[22610]: audit 2024-08-31T05:53:36.471839+0000 mgr.a (mgr.14388) 9615 : audit [DBG] from='client.213636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:37 smithi191 bash[24992]: cluster 2024-08-31T05:53:36.054531+0000 mgr.a (mgr.14388) 9614 : cluster [DBG] pgmap v6665: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:37 smithi191 bash[24992]: audit 2024-08-31T05:53:36.471839+0000 mgr.a (mgr.14388) 9615 : audit [DBG] from='client.213636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:39 smithi027 bash[22610]: cluster 2024-08-31T05:53:38.056382+0000 mgr.a (mgr.14388) 9616 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:53:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:39 smithi191 bash[24992]: cluster 2024-08-31T05:53:38.056382+0000 mgr.a (mgr.14388) 9616 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:53:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:39 smithi163 bash[24253]: cluster 2024-08-31T05:53:38.056382+0000 mgr.a (mgr.14388) 9616 : cluster [DBG] pgmap v6666: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:53:41.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:41.891 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:41.891 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:41 smithi027 bash[22610]: cluster 2024-08-31T05:53:40.057632+0000 mgr.a (mgr.14388) 9617 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:53:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:41 smithi191 bash[24992]: cluster 2024-08-31T05:53:40.057632+0000 mgr.a (mgr.14388) 9617 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:53:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:41 smithi163 bash[24253]: cluster 2024-08-31T05:53:40.057632+0000 mgr.a (mgr.14388) 9617 : cluster [DBG] pgmap v6667: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:53:42.634 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:42.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:42.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:42.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:42.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:53:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:43 smithi027 bash[22610]: cluster 2024-08-31T05:53:42.058369+0000 mgr.a (mgr.14388) 9618 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:43 smithi027 bash[22610]: audit 2024-08-31T05:53:42.218358+0000 mgr.a (mgr.14388) 9619 : audit [DBG] from='client.213714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:43 smithi191 bash[24992]: cluster 2024-08-31T05:53:42.058369+0000 mgr.a (mgr.14388) 9618 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:43 smithi191 bash[24992]: audit 2024-08-31T05:53:42.218358+0000 mgr.a (mgr.14388) 9619 : audit [DBG] from='client.213714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:43 smithi163 bash[24253]: cluster 2024-08-31T05:53:42.058369+0000 mgr.a (mgr.14388) 9618 : cluster [DBG] pgmap v6668: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:43 smithi163 bash[24253]: audit 2024-08-31T05:53:42.218358+0000 mgr.a (mgr.14388) 9619 : audit [DBG] from='client.213714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:45 smithi027 bash[22610]: cluster 2024-08-31T05:53:44.060691+0000 mgr.a (mgr.14388) 9620 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:53:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:45 smithi191 bash[24992]: cluster 2024-08-31T05:53:44.060691+0000 mgr.a (mgr.14388) 9620 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:53:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:45 smithi163 bash[24253]: cluster 2024-08-31T05:53:44.060691+0000 mgr.a (mgr.14388) 9620 : cluster [DBG] pgmap v6669: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:53:47.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:47.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:47.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:47 smithi027 bash[22610]: cluster 2024-08-31T05:53:46.061487+0000 mgr.a (mgr.14388) 9621 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:47 smithi191 bash[24992]: cluster 2024-08-31T05:53:46.061487+0000 mgr.a (mgr.14388) 9621 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:47 smithi163 bash[24253]: cluster 2024-08-31T05:53:46.061487+0000 mgr.a (mgr.14388) 9621 : cluster [DBG] pgmap v6670: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:48.435 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:48.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:48.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:48.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:48.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:53:48.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:48 smithi027 bash[22610]: audit 2024-08-31T05:53:48.102299+0000 mon.a (mon.0) 2023 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:53:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:48 smithi191 bash[24992]: audit 2024-08-31T05:53:48.102299+0000 mon.a (mon.0) 2023 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:53:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:48 smithi163 bash[24253]: audit 2024-08-31T05:53:48.102299+0000 mon.a (mon.0) 2023 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:53:49.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:53:49 smithi027 bash[22863]: debug 2024-08-31T05:53:49.634+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:53:49.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:53:49 smithi027 bash[22863]: debug 2024-08-31T05:53:49.634+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:53:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:49 smithi027 bash[22610]: audit 2024-08-31T05:53:47.976143+0000 mgr.a (mgr.14388) 9622 : audit [DBG] from='client.213792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:49 smithi027 bash[22610]: cluster 2024-08-31T05:53:48.062958+0000 mgr.a (mgr.14388) 9623 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:49 smithi027 bash[22610]: audit 2024-08-31T05:53:48.894293+0000 mon.a (mon.0) 2024 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:53:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:49 smithi027 bash[22610]: audit 2024-08-31T05:53:48.896145+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:53:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:49 smithi027 bash[22610]: audit 2024-08-31T05:53:48.907994+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:53:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:49 smithi027 bash[22610]: audit 2024-08-31T05:53:48.910486+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:53:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:49 smithi191 bash[24992]: audit 2024-08-31T05:53:47.976143+0000 mgr.a (mgr.14388) 9622 : audit [DBG] from='client.213792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:49 smithi191 bash[24992]: cluster 2024-08-31T05:53:48.062958+0000 mgr.a (mgr.14388) 9623 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:49 smithi191 bash[24992]: audit 2024-08-31T05:53:48.894293+0000 mon.a (mon.0) 2024 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:53:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:49 smithi191 bash[24992]: audit 2024-08-31T05:53:48.896145+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:53:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:49 smithi191 bash[24992]: audit 2024-08-31T05:53:48.907994+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:53:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:49 smithi191 bash[24992]: audit 2024-08-31T05:53:48.910486+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:53:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:49 smithi163 bash[24253]: audit 2024-08-31T05:53:47.976143+0000 mgr.a (mgr.14388) 9622 : audit [DBG] from='client.213792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:49 smithi163 bash[24253]: cluster 2024-08-31T05:53:48.062958+0000 mgr.a (mgr.14388) 9623 : cluster [DBG] pgmap v6671: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:53:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:49 smithi163 bash[24253]: audit 2024-08-31T05:53:48.894293+0000 mon.a (mon.0) 2024 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:53:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:49 smithi163 bash[24253]: audit 2024-08-31T05:53:48.896145+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:53:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:49 smithi163 bash[24253]: audit 2024-08-31T05:53:48.907994+0000 mon.a (mon.0) 2026 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:53:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:49 smithi163 bash[24253]: audit 2024-08-31T05:53:48.910486+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:53:51.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:50 smithi191 bash[24992]: audit 2024-08-31T05:53:48.913013+0000 mgr.a (mgr.14388) 9624 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:53:51.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:50 smithi191 bash[24992]: audit 2024-08-31T05:53:49.636061+0000 mgr.a (mgr.14388) 9625 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:53:51.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:50 smithi191 bash[24992]: cephadm 2024-08-31T05:53:49.637497+0000 mgr.a (mgr.14388) 9626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:53:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:50 smithi163 bash[24253]: audit 2024-08-31T05:53:48.913013+0000 mgr.a (mgr.14388) 9624 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:53:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:50 smithi163 bash[24253]: audit 2024-08-31T05:53:49.636061+0000 mgr.a (mgr.14388) 9625 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:53:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:50 smithi163 bash[24253]: cephadm 2024-08-31T05:53:49.637497+0000 mgr.a (mgr.14388) 9626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:53:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:50 smithi027 bash[22610]: audit 2024-08-31T05:53:48.913013+0000 mgr.a (mgr.14388) 9624 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:53:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:50 smithi027 bash[22610]: audit 2024-08-31T05:53:49.636061+0000 mgr.a (mgr.14388) 9625 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:53:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:50 smithi027 bash[22610]: cephadm 2024-08-31T05:53:49.637497+0000 mgr.a (mgr.14388) 9626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:53:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:51 smithi191 bash[24992]: cluster 2024-08-31T05:53:50.064687+0000 mgr.a (mgr.14388) 9627 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:53:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:51 smithi163 bash[24253]: cluster 2024-08-31T05:53:50.064687+0000 mgr.a (mgr.14388) 9627 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:53:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:51 smithi027 bash[22610]: cluster 2024-08-31T05:53:50.064687+0000 mgr.a (mgr.14388) 9627 : cluster [DBG] pgmap v6672: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:53:53.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:53.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:53.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:53 smithi191 bash[24992]: cluster 2024-08-31T05:53:52.065465+0000 mgr.a (mgr.14388) 9628 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:53:54.184 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:54.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:54.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:54.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:54.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:53:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:53 smithi163 bash[24253]: cluster 2024-08-31T05:53:52.065465+0000 mgr.a (mgr.14388) 9628 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:53:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:53 smithi027 bash[22610]: cluster 2024-08-31T05:53:52.065465+0000 mgr.a (mgr.14388) 9628 : cluster [DBG] pgmap v6673: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:53:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:55 smithi191 bash[24992]: audit 2024-08-31T05:53:53.771302+0000 mgr.a (mgr.14388) 9629 : audit [DBG] from='client.213969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:55 smithi191 bash[24992]: cluster 2024-08-31T05:53:54.066726+0000 mgr.a (mgr.14388) 9630 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:53:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:55 smithi163 bash[24253]: audit 2024-08-31T05:53:53.771302+0000 mgr.a (mgr.14388) 9629 : audit [DBG] from='client.213969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:55 smithi163 bash[24253]: cluster 2024-08-31T05:53:54.066726+0000 mgr.a (mgr.14388) 9630 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:53:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:55 smithi027 bash[22610]: audit 2024-08-31T05:53:53.771302+0000 mgr.a (mgr.14388) 9629 : audit [DBG] from='client.213969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:53:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:55 smithi027 bash[22610]: cluster 2024-08-31T05:53:54.066726+0000 mgr.a (mgr.14388) 9630 : cluster [DBG] pgmap v6674: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:53:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:57 smithi191 bash[24992]: cluster 2024-08-31T05:53:56.067608+0000 mgr.a (mgr.14388) 9631 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:53:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:57 smithi163 bash[24253]: cluster 2024-08-31T05:53:56.067608+0000 mgr.a (mgr.14388) 9631 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:53:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:57 smithi027 bash[22610]: cluster 2024-08-31T05:53:56.067608+0000 mgr.a (mgr.14388) 9631 : cluster [DBG] pgmap v6675: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:53:59.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:53:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:53:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:53:59.931 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:53:59.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:53:59.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:53:59.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:53:59.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:53:59 smithi191 bash[24992]: cluster 2024-08-31T05:53:58.069483+0000 mgr.a (mgr.14388) 9632 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:54:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:53:59 smithi163 bash[24253]: cluster 2024-08-31T05:53:58.069483+0000 mgr.a (mgr.14388) 9632 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:54:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:53:59 smithi027 bash[22610]: cluster 2024-08-31T05:53:58.069483+0000 mgr.a (mgr.14388) 9632 : cluster [DBG] pgmap v6676: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:54:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:00 smithi191 bash[24992]: audit 2024-08-31T05:53:59.518650+0000 mgr.a (mgr.14388) 9633 : audit [DBG] from='client.214044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:00 smithi163 bash[24253]: audit 2024-08-31T05:53:59.518650+0000 mgr.a (mgr.14388) 9633 : audit [DBG] from='client.214044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:00 smithi027 bash[22610]: audit 2024-08-31T05:53:59.518650+0000 mgr.a (mgr.14388) 9633 : audit [DBG] from='client.214044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:01 smithi191 bash[24992]: cluster 2024-08-31T05:54:00.070772+0000 mgr.a (mgr.14388) 9634 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:01 smithi163 bash[24253]: cluster 2024-08-31T05:54:00.070772+0000 mgr.a (mgr.14388) 9634 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:01 smithi027 bash[22610]: cluster 2024-08-31T05:54:00.070772+0000 mgr.a (mgr.14388) 9634 : cluster [DBG] pgmap v6677: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:02 smithi163 bash[24253]: cluster 2024-08-31T05:54:02.071480+0000 mgr.a (mgr.14388) 9635 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:02 smithi027 bash[22610]: cluster 2024-08-31T05:54:02.071480+0000 mgr.a (mgr.14388) 9635 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:02 smithi191 bash[24992]: cluster 2024-08-31T05:54:02.071480+0000 mgr.a (mgr.14388) 9635 : cluster [DBG] pgmap v6678: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:04.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:54:04.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:54:04.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:54:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:05 smithi163 bash[24253]: cluster 2024-08-31T05:54:04.073480+0000 mgr.a (mgr.14388) 9636 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:05 smithi027 bash[22610]: cluster 2024-08-31T05:54:04.073480+0000 mgr.a (mgr.14388) 9636 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:05 smithi191 bash[24992]: cluster 2024-08-31T05:54:04.073480+0000 mgr.a (mgr.14388) 9636 : cluster [DBG] pgmap v6679: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:05.708 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:54:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:54:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:54:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:54:05.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:06.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:06 smithi163 bash[24253]: audit 2024-08-31T05:54:05.273529+0000 mgr.a (mgr.14388) 9637 : audit [DBG] from='client.214116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:06 smithi027 bash[22610]: audit 2024-08-31T05:54:05.273529+0000 mgr.a (mgr.14388) 9637 : audit [DBG] from='client.214116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:06 smithi191 bash[24992]: audit 2024-08-31T05:54:05.273529+0000 mgr.a (mgr.14388) 9637 : audit [DBG] from='client.214116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:07 smithi163 bash[24253]: cluster 2024-08-31T05:54:06.074377+0000 mgr.a (mgr.14388) 9638 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:07 smithi027 bash[22610]: cluster 2024-08-31T05:54:06.074377+0000 mgr.a (mgr.14388) 9638 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:07 smithi191 bash[24992]: cluster 2024-08-31T05:54:06.074377+0000 mgr.a (mgr.14388) 9638 : cluster [DBG] pgmap v6680: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:09 smithi163 bash[24253]: cluster 2024-08-31T05:54:08.076140+0000 mgr.a (mgr.14388) 9639 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:54:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:09 smithi027 bash[22610]: cluster 2024-08-31T05:54:08.076140+0000 mgr.a (mgr.14388) 9639 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:54:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:09 smithi191 bash[24992]: cluster 2024-08-31T05:54:08.076140+0000 mgr.a (mgr.14388) 9639 : cluster [DBG] pgmap v6681: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:54:10.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:54:10.710 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:54:10.710 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:54:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:11 smithi163 bash[24253]: cluster 2024-08-31T05:54:10.077381+0000 mgr.a (mgr.14388) 9640 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:54:11.483 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:54:11.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:54:11.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:54:11.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:54:11.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:11 smithi027 bash[22610]: cluster 2024-08-31T05:54:10.077381+0000 mgr.a (mgr.14388) 9640 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:54:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:11 smithi191 bash[24992]: cluster 2024-08-31T05:54:10.077381+0000 mgr.a (mgr.14388) 9640 : cluster [DBG] pgmap v6682: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:54:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:12 smithi163 bash[24253]: audit 2024-08-31T05:54:11.048956+0000 mgr.a (mgr.14388) 9641 : audit [DBG] from='client.214194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:12 smithi027 bash[22610]: audit 2024-08-31T05:54:11.048956+0000 mgr.a (mgr.14388) 9641 : audit [DBG] from='client.214194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:12 smithi191 bash[24992]: audit 2024-08-31T05:54:11.048956+0000 mgr.a (mgr.14388) 9641 : audit [DBG] from='client.214194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:13 smithi163 bash[24253]: cluster 2024-08-31T05:54:12.078196+0000 mgr.a (mgr.14388) 9642 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:13 smithi027 bash[22610]: cluster 2024-08-31T05:54:12.078196+0000 mgr.a (mgr.14388) 9642 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:13 smithi191 bash[24992]: cluster 2024-08-31T05:54:12.078196+0000 mgr.a (mgr.14388) 9642 : cluster [DBG] pgmap v6683: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:15 smithi163 bash[24253]: cluster 2024-08-31T05:54:14.080411+0000 mgr.a (mgr.14388) 9643 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:54:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:15 smithi027 bash[22610]: cluster 2024-08-31T05:54:14.080411+0000 mgr.a (mgr.14388) 9643 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:54:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:15 smithi191 bash[24992]: cluster 2024-08-31T05:54:14.080411+0000 mgr.a (mgr.14388) 9643 : cluster [DBG] pgmap v6684: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:54:16.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:54:16.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:54:16.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:54:17.271 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:54:17.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:54:17.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:54:17.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:54:17.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:17 smithi163 bash[24253]: cluster 2024-08-31T05:54:16.081163+0000 mgr.a (mgr.14388) 9644 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:17 smithi027 bash[22610]: cluster 2024-08-31T05:54:16.081163+0000 mgr.a (mgr.14388) 9644 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:17 smithi191 bash[24992]: cluster 2024-08-31T05:54:16.081163+0000 mgr.a (mgr.14388) 9644 : cluster [DBG] pgmap v6685: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:18 smithi163 bash[24253]: audit 2024-08-31T05:54:16.822970+0000 mgr.a (mgr.14388) 9645 : audit [DBG] from='client.214272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:18 smithi027 bash[22610]: audit 2024-08-31T05:54:16.822970+0000 mgr.a (mgr.14388) 9645 : audit [DBG] from='client.214272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:18 smithi191 bash[24992]: audit 2024-08-31T05:54:16.822970+0000 mgr.a (mgr.14388) 9645 : audit [DBG] from='client.214272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:19 smithi163 bash[24253]: cluster 2024-08-31T05:54:18.083011+0000 mgr.a (mgr.14388) 9646 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:54:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:19 smithi027 bash[22610]: cluster 2024-08-31T05:54:18.083011+0000 mgr.a (mgr.14388) 9646 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:54:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:19 smithi191 bash[24992]: cluster 2024-08-31T05:54:18.083011+0000 mgr.a (mgr.14388) 9646 : cluster [DBG] pgmap v6686: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:54:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:21 smithi163 bash[24253]: cluster 2024-08-31T05:54:20.084269+0000 mgr.a (mgr.14388) 9647 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:54:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:21 smithi027 bash[22610]: cluster 2024-08-31T05:54:20.084269+0000 mgr.a (mgr.14388) 9647 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:54:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:21 smithi191 bash[24992]: cluster 2024-08-31T05:54:20.084269+0000 mgr.a (mgr.14388) 9647 : cluster [DBG] pgmap v6687: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:54:22.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:54:22.274 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:54:22.274 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:54:23.035 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:54:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:54:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:54:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:54:23.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:23 smithi163 bash[24253]: cluster 2024-08-31T05:54:22.084951+0000 mgr.a (mgr.14388) 9648 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:23 smithi163 bash[24253]: audit 2024-08-31T05:54:22.609320+0000 mgr.a (mgr.14388) 9649 : audit [DBG] from='client.214344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:23 smithi027 bash[22610]: cluster 2024-08-31T05:54:22.084951+0000 mgr.a (mgr.14388) 9648 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:23 smithi027 bash[22610]: audit 2024-08-31T05:54:22.609320+0000 mgr.a (mgr.14388) 9649 : audit [DBG] from='client.214344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:23 smithi191 bash[24992]: cluster 2024-08-31T05:54:22.084951+0000 mgr.a (mgr.14388) 9648 : cluster [DBG] pgmap v6688: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:23 smithi191 bash[24992]: audit 2024-08-31T05:54:22.609320+0000 mgr.a (mgr.14388) 9649 : audit [DBG] from='client.214344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:25 smithi163 bash[24253]: cluster 2024-08-31T05:54:24.087283+0000 mgr.a (mgr.14388) 9650 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:54:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:25 smithi027 bash[22610]: cluster 2024-08-31T05:54:24.087283+0000 mgr.a (mgr.14388) 9650 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:54:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:25 smithi191 bash[24992]: cluster 2024-08-31T05:54:24.087283+0000 mgr.a (mgr.14388) 9650 : cluster [DBG] pgmap v6689: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:54:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:27 smithi163 bash[24253]: cluster 2024-08-31T05:54:26.088033+0000 mgr.a (mgr.14388) 9651 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:54:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:27 smithi027 bash[22610]: cluster 2024-08-31T05:54:26.088033+0000 mgr.a (mgr.14388) 9651 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:54:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:27 smithi191 bash[24992]: cluster 2024-08-31T05:54:26.088033+0000 mgr.a (mgr.14388) 9651 : cluster [DBG] pgmap v6690: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:54:28.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:54:28.037 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:54:28.037 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:54:28.787 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:54:28.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:54:28.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:54:28.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:54:28.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:29 smithi027 bash[22610]: cluster 2024-08-31T05:54:28.089091+0000 mgr.a (mgr.14388) 9652 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:29 smithi027 bash[22610]: audit 2024-08-31T05:54:28.368122+0000 mgr.a (mgr.14388) 9653 : audit [DBG] from='client.214416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:29 smithi191 bash[24992]: cluster 2024-08-31T05:54:28.089091+0000 mgr.a (mgr.14388) 9652 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:29 smithi191 bash[24992]: audit 2024-08-31T05:54:28.368122+0000 mgr.a (mgr.14388) 9653 : audit [DBG] from='client.214416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:29 smithi163 bash[24253]: cluster 2024-08-31T05:54:28.089091+0000 mgr.a (mgr.14388) 9652 : cluster [DBG] pgmap v6691: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:29 smithi163 bash[24253]: audit 2024-08-31T05:54:28.368122+0000 mgr.a (mgr.14388) 9653 : audit [DBG] from='client.214416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:31 smithi027 bash[22610]: cluster 2024-08-31T05:54:30.090845+0000 mgr.a (mgr.14388) 9654 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:54:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:31 smithi191 bash[24992]: cluster 2024-08-31T05:54:30.090845+0000 mgr.a (mgr.14388) 9654 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:54:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:31 smithi163 bash[24253]: cluster 2024-08-31T05:54:30.090845+0000 mgr.a (mgr.14388) 9654 : cluster [DBG] pgmap v6692: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:54:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:33 smithi027 bash[22610]: cluster 2024-08-31T05:54:32.091543+0000 mgr.a (mgr.14388) 9655 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:54:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:33 smithi191 bash[24992]: cluster 2024-08-31T05:54:32.091543+0000 mgr.a (mgr.14388) 9655 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:54:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:33 smithi163 bash[24253]: cluster 2024-08-31T05:54:32.091543+0000 mgr.a (mgr.14388) 9655 : cluster [DBG] pgmap v6693: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:54:33.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:54:33.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:54:33.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:54:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:54:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:54:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:54:34.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:34.519 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:54:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:35 smithi027 bash[22610]: cluster 2024-08-31T05:54:34.092929+0000 mgr.a (mgr.14388) 9656 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:35 smithi027 bash[22610]: audit 2024-08-31T05:54:34.112885+0000 mgr.a (mgr.14388) 9657 : audit [DBG] from='client.214488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:35 smithi191 bash[24992]: cluster 2024-08-31T05:54:34.092929+0000 mgr.a (mgr.14388) 9656 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:35 smithi191 bash[24992]: audit 2024-08-31T05:54:34.112885+0000 mgr.a (mgr.14388) 9657 : audit [DBG] from='client.214488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:35 smithi163 bash[24253]: cluster 2024-08-31T05:54:34.092929+0000 mgr.a (mgr.14388) 9656 : cluster [DBG] pgmap v6694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:35 smithi163 bash[24253]: audit 2024-08-31T05:54:34.112885+0000 mgr.a (mgr.14388) 9657 : audit [DBG] from='client.214488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:37 smithi027 bash[22610]: cluster 2024-08-31T05:54:36.093813+0000 mgr.a (mgr.14388) 9658 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T05:54:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:37 smithi191 bash[24992]: cluster 2024-08-31T05:54:36.093813+0000 mgr.a (mgr.14388) 9658 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T05:54:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:37 smithi163 bash[24253]: cluster 2024-08-31T05:54:36.093813+0000 mgr.a (mgr.14388) 9658 : cluster [DBG] pgmap v6695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T05:54:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:39 smithi027 bash[22610]: cluster 2024-08-31T05:54:38.095640+0000 mgr.a (mgr.14388) 9659 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:54:39.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:54:39.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:54:39.522 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:54:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:39 smithi191 bash[24992]: cluster 2024-08-31T05:54:38.095640+0000 mgr.a (mgr.14388) 9659 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:54:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:39 smithi163 bash[24253]: cluster 2024-08-31T05:54:38.095640+0000 mgr.a (mgr.14388) 9659 : cluster [DBG] pgmap v6696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:54:40.277 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:54:40.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:54:40.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:54:40.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:54:40.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:41 smithi027 bash[22610]: audit 2024-08-31T05:54:39.851667+0000 mgr.a (mgr.14388) 9660 : audit [DBG] from='client.214566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:41 smithi027 bash[22610]: cluster 2024-08-31T05:54:40.096613+0000 mgr.a (mgr.14388) 9661 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:41 smithi191 bash[24992]: audit 2024-08-31T05:54:39.851667+0000 mgr.a (mgr.14388) 9660 : audit [DBG] from='client.214566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:41 smithi191 bash[24992]: cluster 2024-08-31T05:54:40.096613+0000 mgr.a (mgr.14388) 9661 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:41.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:41 smithi163 bash[24253]: audit 2024-08-31T05:54:39.851667+0000 mgr.a (mgr.14388) 9660 : audit [DBG] from='client.214566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:41.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:41 smithi163 bash[24253]: cluster 2024-08-31T05:54:40.096613+0000 mgr.a (mgr.14388) 9661 : cluster [DBG] pgmap v6697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:43 smithi191 bash[24992]: cluster 2024-08-31T05:54:42.097671+0000 mgr.a (mgr.14388) 9662 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:43 smithi163 bash[24253]: cluster 2024-08-31T05:54:42.097671+0000 mgr.a (mgr.14388) 9662 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:43 smithi027 bash[22610]: cluster 2024-08-31T05:54:42.097671+0000 mgr.a (mgr.14388) 9662 : cluster [DBG] pgmap v6698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:45.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:54:45.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:54:45.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:54:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:45 smithi191 bash[24992]: cluster 2024-08-31T05:54:44.100111+0000 mgr.a (mgr.14388) 9663 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:54:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:45 smithi163 bash[24253]: cluster 2024-08-31T05:54:44.100111+0000 mgr.a (mgr.14388) 9663 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:54:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:45 smithi027 bash[22610]: cluster 2024-08-31T05:54:44.100111+0000 mgr.a (mgr.14388) 9663 : cluster [DBG] pgmap v6699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:54:46.041 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:54:46.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:54:46.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:54:46.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:54:46.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:46 smithi191 bash[24992]: audit 2024-08-31T05:54:45.610596+0000 mgr.a (mgr.14388) 9664 : audit [DBG] from='client.214641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:46 smithi163 bash[24253]: audit 2024-08-31T05:54:45.610596+0000 mgr.a (mgr.14388) 9664 : audit [DBG] from='client.214641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:46 smithi027 bash[22610]: audit 2024-08-31T05:54:45.610596+0000 mgr.a (mgr.14388) 9664 : audit [DBG] from='client.214641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:47 smithi191 bash[24992]: cluster 2024-08-31T05:54:46.101101+0000 mgr.a (mgr.14388) 9665 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:47 smithi163 bash[24253]: cluster 2024-08-31T05:54:46.101101+0000 mgr.a (mgr.14388) 9665 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:47 smithi027 bash[22610]: cluster 2024-08-31T05:54:46.101101+0000 mgr.a (mgr.14388) 9665 : cluster [DBG] pgmap v6700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:49 smithi191 bash[24992]: cluster 2024-08-31T05:54:48.102852+0000 mgr.a (mgr.14388) 9666 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:54:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:49 smithi163 bash[24253]: cluster 2024-08-31T05:54:48.102852+0000 mgr.a (mgr.14388) 9666 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:54:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:49 smithi027 bash[22610]: cluster 2024-08-31T05:54:48.102852+0000 mgr.a (mgr.14388) 9666 : cluster [DBG] pgmap v6701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:54:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:50 smithi191 bash[24992]: audit 2024-08-31T05:54:49.690218+0000 mon.a (mon.0) 2028 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:54:50.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:50 smithi163 bash[24253]: audit 2024-08-31T05:54:49.690218+0000 mon.a (mon.0) 2028 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:54:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:50 smithi027 bash[22610]: audit 2024-08-31T05:54:49.690218+0000 mon.a (mon.0) 2028 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:54:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:54:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:54:51.043 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:54:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:51 smithi191 bash[24992]: cluster 2024-08-31T05:54:50.104069+0000 mgr.a (mgr.14388) 9667 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:54:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:51 smithi191 bash[24992]: audit 2024-08-31T05:54:50.529644+0000 mon.a (mon.0) 2029 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:54:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:51 smithi191 bash[24992]: audit 2024-08-31T05:54:50.531311+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:54:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:51 smithi191 bash[24992]: audit 2024-08-31T05:54:50.539719+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:54:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:51 smithi191 bash[24992]: audit 2024-08-31T05:54:50.544500+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:54:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:51 smithi191 bash[24992]: audit 2024-08-31T05:54:50.546773+0000 mgr.a (mgr.14388) 9668 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:54:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:51 smithi163 bash[24253]: cluster 2024-08-31T05:54:50.104069+0000 mgr.a (mgr.14388) 9667 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:54:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:51 smithi163 bash[24253]: audit 2024-08-31T05:54:50.529644+0000 mon.a (mon.0) 2029 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:54:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:51 smithi163 bash[24253]: audit 2024-08-31T05:54:50.531311+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:54:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:51 smithi163 bash[24253]: audit 2024-08-31T05:54:50.539719+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:54:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:51 smithi163 bash[24253]: audit 2024-08-31T05:54:50.544500+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:54:51.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:51 smithi163 bash[24253]: audit 2024-08-31T05:54:50.546773+0000 mgr.a (mgr.14388) 9668 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:54:51.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:54:51 smithi027 bash[22863]: debug 2024-08-31T05:54:51.284+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:54:51.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:54:51 smithi027 bash[22863]: debug 2024-08-31T05:54:51.284+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:54:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:51 smithi027 bash[22610]: cluster 2024-08-31T05:54:50.104069+0000 mgr.a (mgr.14388) 9667 : cluster [DBG] pgmap v6702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:54:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:51 smithi027 bash[22610]: audit 2024-08-31T05:54:50.529644+0000 mon.a (mon.0) 2029 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:54:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:51 smithi027 bash[22610]: audit 2024-08-31T05:54:50.531311+0000 mon.a (mon.0) 2030 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:54:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:51 smithi027 bash[22610]: audit 2024-08-31T05:54:50.539719+0000 mon.a (mon.0) 2031 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:54:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:51 smithi027 bash[22610]: audit 2024-08-31T05:54:50.544500+0000 mon.a (mon.0) 2032 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:54:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:51 smithi027 bash[22610]: audit 2024-08-31T05:54:50.546773+0000 mgr.a (mgr.14388) 9668 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:54:51.767 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:54:51.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:54:51.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:54:51.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:54:51.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:52.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:52 smithi191 bash[24992]: audit 2024-08-31T05:54:51.288925+0000 mgr.a (mgr.14388) 9669 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:54:52.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:52 smithi191 bash[24992]: cephadm 2024-08-31T05:54:51.290073+0000 mgr.a (mgr.14388) 9670 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:54:52.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:52 smithi191 bash[24992]: audit 2024-08-31T05:54:51.360867+0000 mgr.a (mgr.14388) 9671 : audit [DBG] from='client.214809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:52 smithi163 bash[24253]: audit 2024-08-31T05:54:51.288925+0000 mgr.a (mgr.14388) 9669 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:54:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:52 smithi163 bash[24253]: cephadm 2024-08-31T05:54:51.290073+0000 mgr.a (mgr.14388) 9670 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:54:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:52 smithi163 bash[24253]: audit 2024-08-31T05:54:51.360867+0000 mgr.a (mgr.14388) 9671 : audit [DBG] from='client.214809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:52 smithi027 bash[22610]: audit 2024-08-31T05:54:51.288925+0000 mgr.a (mgr.14388) 9669 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:54:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:52 smithi027 bash[22610]: cephadm 2024-08-31T05:54:51.290073+0000 mgr.a (mgr.14388) 9670 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:54:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:52 smithi027 bash[22610]: audit 2024-08-31T05:54:51.360867+0000 mgr.a (mgr.14388) 9671 : audit [DBG] from='client.214809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:53 smithi191 bash[24992]: cluster 2024-08-31T05:54:52.105005+0000 mgr.a (mgr.14388) 9672 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:53 smithi163 bash[24253]: cluster 2024-08-31T05:54:52.105005+0000 mgr.a (mgr.14388) 9672 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:53 smithi027 bash[22610]: cluster 2024-08-31T05:54:52.105005+0000 mgr.a (mgr.14388) 9672 : cluster [DBG] pgmap v6703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:54:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:55 smithi191 bash[24992]: cluster 2024-08-31T05:54:54.107259+0000 mgr.a (mgr.14388) 9673 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:55.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:55 smithi163 bash[24253]: cluster 2024-08-31T05:54:54.107259+0000 mgr.a (mgr.14388) 9673 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:55 smithi027 bash[22610]: cluster 2024-08-31T05:54:54.107259+0000 mgr.a (mgr.14388) 9673 : cluster [DBG] pgmap v6704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:56.769 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:54:56.770 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:54:56.770 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:54:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:57 smithi191 bash[24992]: cluster 2024-08-31T05:54:56.108038+0000 mgr.a (mgr.14388) 9674 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:57.552 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:54:57.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:54:57.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:54:57.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:54:57.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:54:57.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:57 smithi163 bash[24253]: cluster 2024-08-31T05:54:56.108038+0000 mgr.a (mgr.14388) 9674 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:57 smithi027 bash[22610]: cluster 2024-08-31T05:54:56.108038+0000 mgr.a (mgr.14388) 9674 : cluster [DBG] pgmap v6705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:58.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:58 smithi163 bash[24253]: audit 2024-08-31T05:54:57.105774+0000 mgr.a (mgr.14388) 9675 : audit [DBG] from='client.214902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:58 smithi027 bash[22610]: audit 2024-08-31T05:54:57.105774+0000 mgr.a (mgr.14388) 9675 : audit [DBG] from='client.214902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:58 smithi191 bash[24992]: audit 2024-08-31T05:54:57.105774+0000 mgr.a (mgr.14388) 9675 : audit [DBG] from='client.214902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:54:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:54:59 smithi163 bash[24253]: cluster 2024-08-31T05:54:58.109922+0000 mgr.a (mgr.14388) 9676 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:54:59 smithi027 bash[22610]: cluster 2024-08-31T05:54:58.109922+0000 mgr.a (mgr.14388) 9676 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:54:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:54:59 smithi191 bash[24992]: cluster 2024-08-31T05:54:58.109922+0000 mgr.a (mgr.14388) 9676 : cluster [DBG] pgmap v6706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:01 smithi163 bash[24253]: cluster 2024-08-31T05:55:00.111199+0000 mgr.a (mgr.14388) 9677 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:01.681 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:01 smithi191 bash[24992]: cluster 2024-08-31T05:55:00.111199+0000 mgr.a (mgr.14388) 9677 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:01 smithi027 bash[22610]: cluster 2024-08-31T05:55:00.111199+0000 mgr.a (mgr.14388) 9677 : cluster [DBG] pgmap v6707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:02.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:55:02.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:55:02.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:55:03.321 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:55:03.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:55:03.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:55:03.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:55:03.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:55:03.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:03 smithi163 bash[24253]: cluster 2024-08-31T05:55:02.111886+0000 mgr.a (mgr.14388) 9678 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:03 smithi027 bash[22610]: cluster 2024-08-31T05:55:02.111886+0000 mgr.a (mgr.14388) 9678 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:03 smithi191 bash[24992]: cluster 2024-08-31T05:55:02.111886+0000 mgr.a (mgr.14388) 9678 : cluster [DBG] pgmap v6708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:04 smithi163 bash[24253]: audit 2024-08-31T05:55:02.888286+0000 mgr.a (mgr.14388) 9679 : audit [DBG] from='client.214980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:04 smithi027 bash[22610]: audit 2024-08-31T05:55:02.888286+0000 mgr.a (mgr.14388) 9679 : audit [DBG] from='client.214980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:04 smithi191 bash[24992]: audit 2024-08-31T05:55:02.888286+0000 mgr.a (mgr.14388) 9679 : audit [DBG] from='client.214980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:05.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:05 smithi163 bash[24253]: cluster 2024-08-31T05:55:04.114701+0000 mgr.a (mgr.14388) 9680 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:05 smithi027 bash[22610]: cluster 2024-08-31T05:55:04.114701+0000 mgr.a (mgr.14388) 9680 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:05 smithi191 bash[24992]: cluster 2024-08-31T05:55:04.114701+0000 mgr.a (mgr.14388) 9680 : cluster [DBG] pgmap v6709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:07.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:07 smithi163 bash[24253]: cluster 2024-08-31T05:55:06.115507+0000 mgr.a (mgr.14388) 9681 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:55:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:07 smithi027 bash[22610]: cluster 2024-08-31T05:55:06.115507+0000 mgr.a (mgr.14388) 9681 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:55:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:07 smithi191 bash[24992]: cluster 2024-08-31T05:55:06.115507+0000 mgr.a (mgr.14388) 9681 : cluster [DBG] pgmap v6710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:55:08.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:55:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:55:08.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:55:09.077 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:55:09.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:55:09.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:55:09.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:55:09.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:55:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:09 smithi163 bash[24253]: cluster 2024-08-31T05:55:08.117001+0000 mgr.a (mgr.14388) 9682 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:55:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:09 smithi163 bash[24253]: audit 2024-08-31T05:55:08.658644+0000 mgr.a (mgr.14388) 9683 : audit [DBG] from='client.215055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:09 smithi027 bash[22610]: cluster 2024-08-31T05:55:08.117001+0000 mgr.a (mgr.14388) 9682 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:55:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:09 smithi027 bash[22610]: audit 2024-08-31T05:55:08.658644+0000 mgr.a (mgr.14388) 9683 : audit [DBG] from='client.215055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:09 smithi191 bash[24992]: cluster 2024-08-31T05:55:08.117001+0000 mgr.a (mgr.14388) 9682 : cluster [DBG] pgmap v6711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T05:55:09.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:09 smithi191 bash[24992]: audit 2024-08-31T05:55:08.658644+0000 mgr.a (mgr.14388) 9683 : audit [DBG] from='client.215055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:11 smithi163 bash[24253]: cluster 2024-08-31T05:55:10.119058+0000 mgr.a (mgr.14388) 9684 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:55:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:11 smithi027 bash[22610]: cluster 2024-08-31T05:55:10.119058+0000 mgr.a (mgr.14388) 9684 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:55:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:11 smithi191 bash[24992]: cluster 2024-08-31T05:55:10.119058+0000 mgr.a (mgr.14388) 9684 : cluster [DBG] pgmap v6712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:55:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:13 smithi163 bash[24253]: cluster 2024-08-31T05:55:12.119984+0000 mgr.a (mgr.14388) 9685 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:55:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:13 smithi027 bash[22610]: cluster 2024-08-31T05:55:12.119984+0000 mgr.a (mgr.14388) 9685 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:55:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:13 smithi191 bash[24992]: cluster 2024-08-31T05:55:12.119984+0000 mgr.a (mgr.14388) 9685 : cluster [DBG] pgmap v6713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:55:14.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:55:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:55:14.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:55:14.826 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:55:14.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:55:14.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:55:14.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:55:14.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:55:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:15 smithi163 bash[24253]: cluster 2024-08-31T05:55:14.121794+0000 mgr.a (mgr.14388) 9686 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:15 smithi163 bash[24253]: audit 2024-08-31T05:55:14.413463+0000 mgr.a (mgr.14388) 9687 : audit [DBG] from='client.215130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:15 smithi027 bash[22610]: cluster 2024-08-31T05:55:14.121794+0000 mgr.a (mgr.14388) 9686 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:15 smithi027 bash[22610]: audit 2024-08-31T05:55:14.413463+0000 mgr.a (mgr.14388) 9687 : audit [DBG] from='client.215130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:15 smithi191 bash[24992]: cluster 2024-08-31T05:55:14.121794+0000 mgr.a (mgr.14388) 9686 : cluster [DBG] pgmap v6714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:15.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:15 smithi191 bash[24992]: audit 2024-08-31T05:55:14.413463+0000 mgr.a (mgr.14388) 9687 : audit [DBG] from='client.215130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:17 smithi163 bash[24253]: cluster 2024-08-31T05:55:16.122792+0000 mgr.a (mgr.14388) 9688 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:55:17.798 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:17 smithi191 bash[24992]: cluster 2024-08-31T05:55:16.122792+0000 mgr.a (mgr.14388) 9688 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:55:17.798 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:17 smithi027 bash[22610]: cluster 2024-08-31T05:55:16.122792+0000 mgr.a (mgr.14388) 9688 : cluster [DBG] pgmap v6715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:55:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:19 smithi163 bash[24253]: cluster 2024-08-31T05:55:18.124543+0000 mgr.a (mgr.14388) 9689 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:55:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:19 smithi027 bash[22610]: cluster 2024-08-31T05:55:18.124543+0000 mgr.a (mgr.14388) 9689 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:55:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:19 smithi191 bash[24992]: cluster 2024-08-31T05:55:18.124543+0000 mgr.a (mgr.14388) 9689 : cluster [DBG] pgmap v6716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T05:55:19.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:55:19.828 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:55:19.829 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:55:20.593 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:55:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:55:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:55:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:55:20.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:55:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:21 smithi163 bash[24253]: cluster 2024-08-31T05:55:20.125749+0000 mgr.a (mgr.14388) 9690 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T05:55:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:21 smithi163 bash[24253]: audit 2024-08-31T05:55:20.166107+0000 mgr.a (mgr.14388) 9691 : audit [DBG] from='client.215208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:21 smithi027 bash[22610]: cluster 2024-08-31T05:55:20.125749+0000 mgr.a (mgr.14388) 9690 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T05:55:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:21 smithi027 bash[22610]: audit 2024-08-31T05:55:20.166107+0000 mgr.a (mgr.14388) 9691 : audit [DBG] from='client.215208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:21 smithi191 bash[24992]: cluster 2024-08-31T05:55:20.125749+0000 mgr.a (mgr.14388) 9690 : cluster [DBG] pgmap v6717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T05:55:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:21 smithi191 bash[24992]: audit 2024-08-31T05:55:20.166107+0000 mgr.a (mgr.14388) 9691 : audit [DBG] from='client.215208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:23 smithi163 bash[24253]: cluster 2024-08-31T05:55:22.126566+0000 mgr.a (mgr.14388) 9692 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:23 smithi027 bash[22610]: cluster 2024-08-31T05:55:22.126566+0000 mgr.a (mgr.14388) 9692 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:23 smithi191 bash[24992]: cluster 2024-08-31T05:55:22.126566+0000 mgr.a (mgr.14388) 9692 : cluster [DBG] pgmap v6718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:25.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:55:25.596 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:55:25.596 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:55:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:25 smithi163 bash[24253]: cluster 2024-08-31T05:55:24.128826+0000 mgr.a (mgr.14388) 9693 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:55:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:25 smithi027 bash[22610]: cluster 2024-08-31T05:55:24.128826+0000 mgr.a (mgr.14388) 9693 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:55:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:25 smithi191 bash[24992]: cluster 2024-08-31T05:55:24.128826+0000 mgr.a (mgr.14388) 9693 : cluster [DBG] pgmap v6719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:55:26.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:55:26.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:55:26.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:55:26.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:55:26.369 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:55:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:27 smithi163 bash[24253]: audit 2024-08-31T05:55:25.933216+0000 mgr.a (mgr.14388) 9694 : audit [DBG] from='client.215286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:27 smithi163 bash[24253]: cluster 2024-08-31T05:55:26.129391+0000 mgr.a (mgr.14388) 9695 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:27 smithi027 bash[22610]: audit 2024-08-31T05:55:25.933216+0000 mgr.a (mgr.14388) 9694 : audit [DBG] from='client.215286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:27 smithi027 bash[22610]: cluster 2024-08-31T05:55:26.129391+0000 mgr.a (mgr.14388) 9695 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:27.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:27 smithi191 bash[24992]: audit 2024-08-31T05:55:25.933216+0000 mgr.a (mgr.14388) 9694 : audit [DBG] from='client.215286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:27.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:27 smithi191 bash[24992]: cluster 2024-08-31T05:55:26.129391+0000 mgr.a (mgr.14388) 9695 : cluster [DBG] pgmap v6720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:29 smithi163 bash[24253]: cluster 2024-08-31T05:55:28.131247+0000 mgr.a (mgr.14388) 9696 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:55:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:29 smithi027 bash[22610]: cluster 2024-08-31T05:55:28.131247+0000 mgr.a (mgr.14388) 9696 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:55:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:29 smithi191 bash[24992]: cluster 2024-08-31T05:55:28.131247+0000 mgr.a (mgr.14388) 9696 : cluster [DBG] pgmap v6721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:55:31.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:55:31.371 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:55:31.371 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:55:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:31 smithi163 bash[24253]: cluster 2024-08-31T05:55:30.132529+0000 mgr.a (mgr.14388) 9697 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:55:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:31 smithi027 bash[22610]: cluster 2024-08-31T05:55:30.132529+0000 mgr.a (mgr.14388) 9697 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:55:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:31 smithi191 bash[24992]: cluster 2024-08-31T05:55:30.132529+0000 mgr.a (mgr.14388) 9697 : cluster [DBG] pgmap v6722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:55:32.154 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:55:32.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:55:32.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:55:32.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:55:32.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:55:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:32 smithi163 bash[24253]: audit 2024-08-31T05:55:31.708043+0000 mgr.a (mgr.14388) 9698 : audit [DBG] from='client.215364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:32 smithi027 bash[22610]: audit 2024-08-31T05:55:31.708043+0000 mgr.a (mgr.14388) 9698 : audit [DBG] from='client.215364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:32 smithi191 bash[24992]: audit 2024-08-31T05:55:31.708043+0000 mgr.a (mgr.14388) 9698 : audit [DBG] from='client.215364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:33 smithi163 bash[24253]: cluster 2024-08-31T05:55:32.133126+0000 mgr.a (mgr.14388) 9699 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:33 smithi027 bash[22610]: cluster 2024-08-31T05:55:32.133126+0000 mgr.a (mgr.14388) 9699 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:33 smithi191 bash[24992]: cluster 2024-08-31T05:55:32.133126+0000 mgr.a (mgr.14388) 9699 : cluster [DBG] pgmap v6723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:35.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:35 smithi163 bash[24253]: cluster 2024-08-31T05:55:34.135355+0000 mgr.a (mgr.14388) 9700 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:55:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:35 smithi027 bash[22610]: cluster 2024-08-31T05:55:34.135355+0000 mgr.a (mgr.14388) 9700 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:55:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:35 smithi191 bash[24992]: cluster 2024-08-31T05:55:34.135355+0000 mgr.a (mgr.14388) 9700 : cluster [DBG] pgmap v6724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:55:37.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:55:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:55:37.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:55:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:37 smithi163 bash[24253]: cluster 2024-08-31T05:55:36.136128+0000 mgr.a (mgr.14388) 9701 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:37 smithi027 bash[22610]: cluster 2024-08-31T05:55:36.136128+0000 mgr.a (mgr.14388) 9701 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:37 smithi191 bash[24992]: cluster 2024-08-31T05:55:36.136128+0000 mgr.a (mgr.14388) 9701 : cluster [DBG] pgmap v6725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:37.903 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:55:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:55:37.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:55:37.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:55:37.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:55:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:38 smithi163 bash[24253]: audit 2024-08-31T05:55:37.494004+0000 mgr.a (mgr.14388) 9702 : audit [DBG] from='client.215439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:38 smithi027 bash[22610]: audit 2024-08-31T05:55:37.494004+0000 mgr.a (mgr.14388) 9702 : audit [DBG] from='client.215439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:38 smithi191 bash[24992]: audit 2024-08-31T05:55:37.494004+0000 mgr.a (mgr.14388) 9702 : audit [DBG] from='client.215439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:39 smithi163 bash[24253]: cluster 2024-08-31T05:55:38.138004+0000 mgr.a (mgr.14388) 9703 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:55:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:39 smithi027 bash[22610]: cluster 2024-08-31T05:55:38.138004+0000 mgr.a (mgr.14388) 9703 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:55:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:39 smithi191 bash[24992]: cluster 2024-08-31T05:55:38.138004+0000 mgr.a (mgr.14388) 9703 : cluster [DBG] pgmap v6726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:55:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:41 smithi163 bash[24253]: cluster 2024-08-31T05:55:40.139425+0000 mgr.a (mgr.14388) 9704 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:55:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:41 smithi027 bash[22610]: cluster 2024-08-31T05:55:40.139425+0000 mgr.a (mgr.14388) 9704 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:55:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:41 smithi191 bash[24992]: cluster 2024-08-31T05:55:40.139425+0000 mgr.a (mgr.14388) 9704 : cluster [DBG] pgmap v6727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:55:42.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:55:42.906 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:55:42.906 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:55:43.680 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:55:43.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:55:43.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:55:43.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:55:43.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:55:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:43 smithi163 bash[24253]: cluster 2024-08-31T05:55:42.140220+0000 mgr.a (mgr.14388) 9705 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:43 smithi027 bash[22610]: cluster 2024-08-31T05:55:42.140220+0000 mgr.a (mgr.14388) 9705 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:43 smithi191 bash[24992]: cluster 2024-08-31T05:55:42.140220+0000 mgr.a (mgr.14388) 9705 : cluster [DBG] pgmap v6728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:44.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:44 smithi163 bash[24253]: audit 2024-08-31T05:55:43.239263+0000 mgr.a (mgr.14388) 9706 : audit [DBG] from='client.215517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:44 smithi027 bash[22610]: audit 2024-08-31T05:55:43.239263+0000 mgr.a (mgr.14388) 9706 : audit [DBG] from='client.215517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:44 smithi191 bash[24992]: audit 2024-08-31T05:55:43.239263+0000 mgr.a (mgr.14388) 9706 : audit [DBG] from='client.215517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:45 smithi163 bash[24253]: cluster 2024-08-31T05:55:44.143073+0000 mgr.a (mgr.14388) 9707 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:45 smithi027 bash[22610]: cluster 2024-08-31T05:55:44.143073+0000 mgr.a (mgr.14388) 9707 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:45 smithi191 bash[24992]: cluster 2024-08-31T05:55:44.143073+0000 mgr.a (mgr.14388) 9707 : cluster [DBG] pgmap v6729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:55:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:47 smithi163 bash[24253]: cluster 2024-08-31T05:55:46.143847+0000 mgr.a (mgr.14388) 9708 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:55:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:47 smithi027 bash[22610]: cluster 2024-08-31T05:55:46.143847+0000 mgr.a (mgr.14388) 9708 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:55:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:47 smithi191 bash[24992]: cluster 2024-08-31T05:55:46.143847+0000 mgr.a (mgr.14388) 9708 : cluster [DBG] pgmap v6730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:55:48.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:55:48.682 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:55:48.682 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:55:49.465 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:55:49.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:55:49.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:55:49.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:55:49.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:55:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:49 smithi163 bash[24253]: cluster 2024-08-31T05:55:48.145351+0000 mgr.a (mgr.14388) 9709 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:55:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:49 smithi027 bash[22610]: cluster 2024-08-31T05:55:48.145351+0000 mgr.a (mgr.14388) 9709 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:55:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:49 smithi191 bash[24992]: cluster 2024-08-31T05:55:48.145351+0000 mgr.a (mgr.14388) 9709 : cluster [DBG] pgmap v6731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:55:50.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:50 smithi163 bash[24253]: audit 2024-08-31T05:55:49.023658+0000 mgr.a (mgr.14388) 9710 : audit [DBG] from='client.215592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:50 smithi027 bash[22610]: audit 2024-08-31T05:55:49.023658+0000 mgr.a (mgr.14388) 9710 : audit [DBG] from='client.215592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:50 smithi191 bash[24992]: audit 2024-08-31T05:55:49.023658+0000 mgr.a (mgr.14388) 9710 : audit [DBG] from='client.215592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:51 smithi163 bash[24253]: cluster 2024-08-31T05:55:50.147266+0000 mgr.a (mgr.14388) 9711 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:55:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:51 smithi163 bash[24253]: audit 2024-08-31T05:55:51.340985+0000 mon.a (mon.0) 2033 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:55:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:51 smithi027 bash[22610]: cluster 2024-08-31T05:55:50.147266+0000 mgr.a (mgr.14388) 9711 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:55:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:51 smithi027 bash[22610]: audit 2024-08-31T05:55:51.340985+0000 mon.a (mon.0) 2033 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:55:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:51 smithi191 bash[24992]: cluster 2024-08-31T05:55:50.147266+0000 mgr.a (mgr.14388) 9711 : cluster [DBG] pgmap v6732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T05:55:51.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:51 smithi191 bash[24992]: audit 2024-08-31T05:55:51.340985+0000 mon.a (mon.0) 2033 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:55:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:52 smithi163 bash[24253]: audit 2024-08-31T05:55:52.171992+0000 mon.a (mon.0) 2034 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:55:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:52 smithi163 bash[24253]: audit 2024-08-31T05:55:52.173803+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:55:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:52 smithi163 bash[24253]: audit 2024-08-31T05:55:52.184497+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:55:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:52 smithi163 bash[24253]: audit 2024-08-31T05:55:52.189289+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:55:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:52 smithi027 bash[22610]: audit 2024-08-31T05:55:52.171992+0000 mon.a (mon.0) 2034 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:55:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:52 smithi027 bash[22610]: audit 2024-08-31T05:55:52.173803+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:55:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:52 smithi027 bash[22610]: audit 2024-08-31T05:55:52.184497+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:55:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:52 smithi027 bash[22610]: audit 2024-08-31T05:55:52.189289+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:55:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:52 smithi191 bash[24992]: audit 2024-08-31T05:55:52.171992+0000 mon.a (mon.0) 2034 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:55:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:52 smithi191 bash[24992]: audit 2024-08-31T05:55:52.173803+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:55:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:52 smithi191 bash[24992]: audit 2024-08-31T05:55:52.184497+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:55:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:52 smithi191 bash[24992]: audit 2024-08-31T05:55:52.189289+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:55:53.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:55:52 smithi027 bash[22863]: debug 2024-08-31T05:55:52.910+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:55:53.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:55:52 smithi027 bash[22863]: debug 2024-08-31T05:55:52.910+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:55:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:53 smithi027 bash[22610]: cluster 2024-08-31T05:55:52.148051+0000 mgr.a (mgr.14388) 9712 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:55:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:53 smithi027 bash[22610]: audit 2024-08-31T05:55:52.191717+0000 mgr.a (mgr.14388) 9713 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:55:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:53 smithi191 bash[24992]: cluster 2024-08-31T05:55:52.148051+0000 mgr.a (mgr.14388) 9712 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:55:53.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:53 smithi191 bash[24992]: audit 2024-08-31T05:55:52.191717+0000 mgr.a (mgr.14388) 9713 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:55:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:53 smithi163 bash[24253]: cluster 2024-08-31T05:55:52.148051+0000 mgr.a (mgr.14388) 9712 : cluster [DBG] pgmap v6733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:55:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:53 smithi163 bash[24253]: audit 2024-08-31T05:55:52.191717+0000 mgr.a (mgr.14388) 9713 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:55:54.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:55:54.467 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:55:54.468 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:55:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:54 smithi027 bash[22610]: audit 2024-08-31T05:55:52.914833+0000 mgr.a (mgr.14388) 9714 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:55:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:54 smithi027 bash[22610]: cephadm 2024-08-31T05:55:52.915998+0000 mgr.a (mgr.14388) 9715 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:55:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:54 smithi191 bash[24992]: audit 2024-08-31T05:55:52.914833+0000 mgr.a (mgr.14388) 9714 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:55:54.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:54 smithi191 bash[24992]: cephadm 2024-08-31T05:55:52.915998+0000 mgr.a (mgr.14388) 9715 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:55:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:54 smithi163 bash[24253]: audit 2024-08-31T05:55:52.914833+0000 mgr.a (mgr.14388) 9714 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:55:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:54 smithi163 bash[24253]: cephadm 2024-08-31T05:55:52.915998+0000 mgr.a (mgr.14388) 9715 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:55:55.207 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:55:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:55:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:55:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:55:55.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:55:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:55 smithi027 bash[22610]: cluster 2024-08-31T05:55:54.150420+0000 mgr.a (mgr.14388) 9716 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:55 smithi191 bash[24992]: cluster 2024-08-31T05:55:54.150420+0000 mgr.a (mgr.14388) 9716 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:55 smithi163 bash[24253]: cluster 2024-08-31T05:55:54.150420+0000 mgr.a (mgr.14388) 9716 : cluster [DBG] pgmap v6734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:56 smithi027 bash[22610]: audit 2024-08-31T05:55:54.792913+0000 mgr.a (mgr.14388) 9717 : audit [DBG] from='client.215772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:56 smithi191 bash[24992]: audit 2024-08-31T05:55:54.792913+0000 mgr.a (mgr.14388) 9717 : audit [DBG] from='client.215772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:56 smithi163 bash[24253]: audit 2024-08-31T05:55:54.792913+0000 mgr.a (mgr.14388) 9717 : audit [DBG] from='client.215772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:55:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:57 smithi027 bash[22610]: cluster 2024-08-31T05:55:56.151403+0000 mgr.a (mgr.14388) 9718 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:57 smithi191 bash[24992]: cluster 2024-08-31T05:55:56.151403+0000 mgr.a (mgr.14388) 9718 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:57 smithi163 bash[24253]: cluster 2024-08-31T05:55:56.151403+0000 mgr.a (mgr.14388) 9718 : cluster [DBG] pgmap v6735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:55:59 smithi027 bash[22610]: cluster 2024-08-31T05:55:58.153309+0000 mgr.a (mgr.14388) 9719 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:55:59 smithi191 bash[24992]: cluster 2024-08-31T05:55:58.153309+0000 mgr.a (mgr.14388) 9719 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:55:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:55:59 smithi163 bash[24253]: cluster 2024-08-31T05:55:58.153309+0000 mgr.a (mgr.14388) 9719 : cluster [DBG] pgmap v6736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:00.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:00.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:00.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:00.945 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:01 smithi027 bash[22610]: cluster 2024-08-31T05:56:00.154536+0000 mgr.a (mgr.14388) 9720 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:01 smithi027 bash[22610]: audit 2024-08-31T05:56:00.534099+0000 mgr.a (mgr.14388) 9721 : audit [DBG] from='client.215850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:01 smithi191 bash[24992]: cluster 2024-08-31T05:56:00.154536+0000 mgr.a (mgr.14388) 9720 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:01.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:01 smithi191 bash[24992]: audit 2024-08-31T05:56:00.534099+0000 mgr.a (mgr.14388) 9721 : audit [DBG] from='client.215850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:01 smithi163 bash[24253]: cluster 2024-08-31T05:56:00.154536+0000 mgr.a (mgr.14388) 9720 : cluster [DBG] pgmap v6737: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:01 smithi163 bash[24253]: audit 2024-08-31T05:56:00.534099+0000 mgr.a (mgr.14388) 9721 : audit [DBG] from='client.215850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:03 smithi191 bash[24992]: cluster 2024-08-31T05:56:02.155386+0000 mgr.a (mgr.14388) 9722 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:03 smithi163 bash[24253]: cluster 2024-08-31T05:56:02.155386+0000 mgr.a (mgr.14388) 9722 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:03 smithi027 bash[22610]: cluster 2024-08-31T05:56:02.155386+0000 mgr.a (mgr.14388) 9722 : cluster [DBG] pgmap v6738: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:05 smithi191 bash[24992]: cluster 2024-08-31T05:56:04.157631+0000 mgr.a (mgr.14388) 9723 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:05.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:05.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:05.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:05 smithi163 bash[24253]: cluster 2024-08-31T05:56:04.157631+0000 mgr.a (mgr.14388) 9723 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:05 smithi027 bash[22610]: cluster 2024-08-31T05:56:04.157631+0000 mgr.a (mgr.14388) 9723 : cluster [DBG] pgmap v6739: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:06.696 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:06.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:06.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:06.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:06.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:07 smithi191 bash[24992]: cluster 2024-08-31T05:56:06.158519+0000 mgr.a (mgr.14388) 9724 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:07 smithi191 bash[24992]: audit 2024-08-31T05:56:06.276229+0000 mgr.a (mgr.14388) 9725 : audit [DBG] from='client.215919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:07 smithi163 bash[24253]: cluster 2024-08-31T05:56:06.158519+0000 mgr.a (mgr.14388) 9724 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:07 smithi163 bash[24253]: audit 2024-08-31T05:56:06.276229+0000 mgr.a (mgr.14388) 9725 : audit [DBG] from='client.215919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:07 smithi027 bash[22610]: cluster 2024-08-31T05:56:06.158519+0000 mgr.a (mgr.14388) 9724 : cluster [DBG] pgmap v6740: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:07 smithi027 bash[22610]: audit 2024-08-31T05:56:06.276229+0000 mgr.a (mgr.14388) 9725 : audit [DBG] from='client.215919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:09 smithi163 bash[24253]: cluster 2024-08-31T05:56:08.160447+0000 mgr.a (mgr.14388) 9726 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:56:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:09 smithi027 bash[22610]: cluster 2024-08-31T05:56:08.160447+0000 mgr.a (mgr.14388) 9726 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:56:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:09 smithi191 bash[24992]: cluster 2024-08-31T05:56:08.160447+0000 mgr.a (mgr.14388) 9726 : cluster [DBG] pgmap v6741: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:56:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:11 smithi027 bash[22610]: cluster 2024-08-31T05:56:10.161708+0000 mgr.a (mgr.14388) 9727 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:56:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:11 smithi191 bash[24992]: cluster 2024-08-31T05:56:10.161708+0000 mgr.a (mgr.14388) 9727 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:56:11.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:11.698 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:11.698 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:11 smithi163 bash[24253]: cluster 2024-08-31T05:56:10.161708+0000 mgr.a (mgr.14388) 9727 : cluster [DBG] pgmap v6742: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:56:12.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:12.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:12.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:12.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:12.470 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:13 smithi027 bash[22610]: audit 2024-08-31T05:56:12.029920+0000 mgr.a (mgr.14388) 9728 : audit [DBG] from='client.215994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:13 smithi027 bash[22610]: cluster 2024-08-31T05:56:12.162281+0000 mgr.a (mgr.14388) 9729 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:13 smithi191 bash[24992]: audit 2024-08-31T05:56:12.029920+0000 mgr.a (mgr.14388) 9728 : audit [DBG] from='client.215994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:13.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:13 smithi191 bash[24992]: cluster 2024-08-31T05:56:12.162281+0000 mgr.a (mgr.14388) 9729 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:13 smithi163 bash[24253]: audit 2024-08-31T05:56:12.029920+0000 mgr.a (mgr.14388) 9728 : audit [DBG] from='client.215994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:13 smithi163 bash[24253]: cluster 2024-08-31T05:56:12.162281+0000 mgr.a (mgr.14388) 9729 : cluster [DBG] pgmap v6743: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:15 smithi027 bash[22610]: cluster 2024-08-31T05:56:14.164638+0000 mgr.a (mgr.14388) 9730 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:56:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:15 smithi191 bash[24992]: cluster 2024-08-31T05:56:14.164638+0000 mgr.a (mgr.14388) 9730 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:56:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:15 smithi163 bash[24253]: cluster 2024-08-31T05:56:14.164638+0000 mgr.a (mgr.14388) 9730 : cluster [DBG] pgmap v6744: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:56:17.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:17.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:17.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:17 smithi027 bash[22610]: cluster 2024-08-31T05:56:16.165436+0000 mgr.a (mgr.14388) 9731 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:17 smithi191 bash[24992]: cluster 2024-08-31T05:56:16.165436+0000 mgr.a (mgr.14388) 9731 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:17 smithi163 bash[24253]: cluster 2024-08-31T05:56:16.165436+0000 mgr.a (mgr.14388) 9731 : cluster [DBG] pgmap v6745: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:18.244 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:18.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:18.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:18.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:18.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:19 smithi191 bash[24992]: audit 2024-08-31T05:56:17.805502+0000 mgr.a (mgr.14388) 9732 : audit [DBG] from='client.216072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:19 smithi191 bash[24992]: cluster 2024-08-31T05:56:18.166949+0000 mgr.a (mgr.14388) 9733 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:19 smithi163 bash[24253]: audit 2024-08-31T05:56:17.805502+0000 mgr.a (mgr.14388) 9732 : audit [DBG] from='client.216072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:19 smithi163 bash[24253]: cluster 2024-08-31T05:56:18.166949+0000 mgr.a (mgr.14388) 9733 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:19 smithi027 bash[22610]: audit 2024-08-31T05:56:17.805502+0000 mgr.a (mgr.14388) 9732 : audit [DBG] from='client.216072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:19 smithi027 bash[22610]: cluster 2024-08-31T05:56:18.166949+0000 mgr.a (mgr.14388) 9733 : cluster [DBG] pgmap v6746: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:21 smithi191 bash[24992]: cluster 2024-08-31T05:56:20.168208+0000 mgr.a (mgr.14388) 9734 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:56:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:21 smithi163 bash[24253]: cluster 2024-08-31T05:56:20.168208+0000 mgr.a (mgr.14388) 9734 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:56:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:21 smithi027 bash[22610]: cluster 2024-08-31T05:56:20.168208+0000 mgr.a (mgr.14388) 9734 : cluster [DBG] pgmap v6747: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:56:23.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:23.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:23.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:23 smithi191 bash[24992]: cluster 2024-08-31T05:56:22.168965+0000 mgr.a (mgr.14388) 9735 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:56:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:23 smithi163 bash[24253]: cluster 2024-08-31T05:56:22.168965+0000 mgr.a (mgr.14388) 9735 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:56:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:23 smithi027 bash[22610]: cluster 2024-08-31T05:56:22.168965+0000 mgr.a (mgr.14388) 9735 : cluster [DBG] pgmap v6748: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T05:56:24.012 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:24.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:24.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:24.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:24.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:24 smithi191 bash[24992]: audit 2024-08-31T05:56:23.580097+0000 mgr.a (mgr.14388) 9736 : audit [DBG] from='client.216150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:24.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:24 smithi163 bash[24253]: audit 2024-08-31T05:56:23.580097+0000 mgr.a (mgr.14388) 9736 : audit [DBG] from='client.216150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:24 smithi027 bash[22610]: audit 2024-08-31T05:56:23.580097+0000 mgr.a (mgr.14388) 9736 : audit [DBG] from='client.216150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:25 smithi191 bash[24992]: cluster 2024-08-31T05:56:24.171763+0000 mgr.a (mgr.14388) 9737 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:25 smithi163 bash[24253]: cluster 2024-08-31T05:56:24.171763+0000 mgr.a (mgr.14388) 9737 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:25 smithi027 bash[22610]: cluster 2024-08-31T05:56:24.171763+0000 mgr.a (mgr.14388) 9737 : cluster [DBG] pgmap v6749: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:27 smithi191 bash[24992]: cluster 2024-08-31T05:56:26.172548+0000 mgr.a (mgr.14388) 9738 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:56:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:27 smithi163 bash[24253]: cluster 2024-08-31T05:56:26.172548+0000 mgr.a (mgr.14388) 9738 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:56:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:27 smithi027 bash[22610]: cluster 2024-08-31T05:56:26.172548+0000 mgr.a (mgr.14388) 9738 : cluster [DBG] pgmap v6750: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:56:29.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:29.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:29.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:29 smithi191 bash[24992]: cluster 2024-08-31T05:56:28.174039+0000 mgr.a (mgr.14388) 9739 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:56:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:29 smithi163 bash[24253]: cluster 2024-08-31T05:56:28.174039+0000 mgr.a (mgr.14388) 9739 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:56:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:29 smithi027 bash[22610]: cluster 2024-08-31T05:56:28.174039+0000 mgr.a (mgr.14388) 9739 : cluster [DBG] pgmap v6751: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T05:56:29.763 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:29.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:30 smithi191 bash[24992]: audit 2024-08-31T05:56:29.348013+0000 mgr.a (mgr.14388) 9740 : audit [DBG] from='client.216222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:30 smithi163 bash[24253]: audit 2024-08-31T05:56:29.348013+0000 mgr.a (mgr.14388) 9740 : audit [DBG] from='client.216222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:30 smithi027 bash[22610]: audit 2024-08-31T05:56:29.348013+0000 mgr.a (mgr.14388) 9740 : audit [DBG] from='client.216222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:31 smithi191 bash[24992]: cluster 2024-08-31T05:56:30.175907+0000 mgr.a (mgr.14388) 9741 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:31 smithi163 bash[24253]: cluster 2024-08-31T05:56:30.175907+0000 mgr.a (mgr.14388) 9741 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:31 smithi027 bash[22610]: cluster 2024-08-31T05:56:30.175907+0000 mgr.a (mgr.14388) 9741 : cluster [DBG] pgmap v6752: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:33 smithi191 bash[24992]: cluster 2024-08-31T05:56:32.176816+0000 mgr.a (mgr.14388) 9742 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:56:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:33 smithi163 bash[24253]: cluster 2024-08-31T05:56:32.176816+0000 mgr.a (mgr.14388) 9742 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:56:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:33 smithi027 bash[22610]: cluster 2024-08-31T05:56:32.176816+0000 mgr.a (mgr.14388) 9742 : cluster [DBG] pgmap v6753: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T05:56:34.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:34.765 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:34.765 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:35.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:35.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:35.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:35.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:35.534 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:35 smithi191 bash[24992]: cluster 2024-08-31T05:56:34.178906+0000 mgr.a (mgr.14388) 9743 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:56:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:35 smithi163 bash[24253]: cluster 2024-08-31T05:56:34.178906+0000 mgr.a (mgr.14388) 9743 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:56:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:35 smithi027 bash[22610]: cluster 2024-08-31T05:56:34.178906+0000 mgr.a (mgr.14388) 9743 : cluster [DBG] pgmap v6754: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T05:56:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:36 smithi163 bash[24253]: audit 2024-08-31T05:56:35.099435+0000 mgr.a (mgr.14388) 9744 : audit [DBG] from='client.216300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:36 smithi027 bash[22610]: audit 2024-08-31T05:56:35.099435+0000 mgr.a (mgr.14388) 9744 : audit [DBG] from='client.216300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:36 smithi191 bash[24992]: audit 2024-08-31T05:56:35.099435+0000 mgr.a (mgr.14388) 9744 : audit [DBG] from='client.216300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:37 smithi163 bash[24253]: cluster 2024-08-31T05:56:36.179859+0000 mgr.a (mgr.14388) 9745 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:37 smithi027 bash[22610]: cluster 2024-08-31T05:56:36.179859+0000 mgr.a (mgr.14388) 9745 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:37 smithi191 bash[24992]: cluster 2024-08-31T05:56:36.179859+0000 mgr.a (mgr.14388) 9745 : cluster [DBG] pgmap v6755: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:39 smithi163 bash[24253]: cluster 2024-08-31T05:56:38.181688+0000 mgr.a (mgr.14388) 9746 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:56:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:39 smithi027 bash[22610]: cluster 2024-08-31T05:56:38.181688+0000 mgr.a (mgr.14388) 9746 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:56:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:39 smithi191 bash[24992]: cluster 2024-08-31T05:56:38.181688+0000 mgr.a (mgr.14388) 9746 : cluster [DBG] pgmap v6756: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:56:40.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:40.536 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:40.536 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:41.305 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:41.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:41.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:41.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:41.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:41 smithi163 bash[24253]: cluster 2024-08-31T05:56:40.182961+0000 mgr.a (mgr.14388) 9747 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:56:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:41 smithi027 bash[22610]: cluster 2024-08-31T05:56:40.182961+0000 mgr.a (mgr.14388) 9747 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:56:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:41 smithi191 bash[24992]: cluster 2024-08-31T05:56:40.182961+0000 mgr.a (mgr.14388) 9747 : cluster [DBG] pgmap v6757: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:56:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:42 smithi163 bash[24253]: audit 2024-08-31T05:56:40.867299+0000 mgr.a (mgr.14388) 9748 : audit [DBG] from='client.216375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:42 smithi027 bash[22610]: audit 2024-08-31T05:56:40.867299+0000 mgr.a (mgr.14388) 9748 : audit [DBG] from='client.216375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:42.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:42 smithi191 bash[24992]: audit 2024-08-31T05:56:40.867299+0000 mgr.a (mgr.14388) 9748 : audit [DBG] from='client.216375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:43 smithi163 bash[24253]: cluster 2024-08-31T05:56:42.183884+0000 mgr.a (mgr.14388) 9749 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:43 smithi027 bash[22610]: cluster 2024-08-31T05:56:42.183884+0000 mgr.a (mgr.14388) 9749 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:43 smithi191 bash[24992]: cluster 2024-08-31T05:56:42.183884+0000 mgr.a (mgr.14388) 9749 : cluster [DBG] pgmap v6758: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:45 smithi163 bash[24253]: cluster 2024-08-31T05:56:44.186140+0000 mgr.a (mgr.14388) 9750 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:56:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:45 smithi027 bash[22610]: cluster 2024-08-31T05:56:44.186140+0000 mgr.a (mgr.14388) 9750 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:56:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:45 smithi191 bash[24992]: cluster 2024-08-31T05:56:44.186140+0000 mgr.a (mgr.14388) 9750 : cluster [DBG] pgmap v6759: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:56:46.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:46.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:46.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:47.088 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:47.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:47.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:47.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:47.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:47 smithi163 bash[24253]: cluster 2024-08-31T05:56:46.186926+0000 mgr.a (mgr.14388) 9751 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:47 smithi163 bash[24253]: audit 2024-08-31T05:56:46.640380+0000 mgr.a (mgr.14388) 9752 : audit [DBG] from='client.216447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:47 smithi027 bash[22610]: cluster 2024-08-31T05:56:46.186926+0000 mgr.a (mgr.14388) 9751 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:47 smithi027 bash[22610]: audit 2024-08-31T05:56:46.640380+0000 mgr.a (mgr.14388) 9752 : audit [DBG] from='client.216447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:47 smithi191 bash[24992]: cluster 2024-08-31T05:56:46.186926+0000 mgr.a (mgr.14388) 9751 : cluster [DBG] pgmap v6760: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:47.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:47 smithi191 bash[24992]: audit 2024-08-31T05:56:46.640380+0000 mgr.a (mgr.14388) 9752 : audit [DBG] from='client.216447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:49 smithi163 bash[24253]: cluster 2024-08-31T05:56:48.188753+0000 mgr.a (mgr.14388) 9753 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:56:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:49 smithi027 bash[22610]: cluster 2024-08-31T05:56:48.188753+0000 mgr.a (mgr.14388) 9753 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:56:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:49 smithi191 bash[24992]: cluster 2024-08-31T05:56:48.188753+0000 mgr.a (mgr.14388) 9753 : cluster [DBG] pgmap v6761: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T05:56:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:51 smithi163 bash[24253]: cluster 2024-08-31T05:56:50.190016+0000 mgr.a (mgr.14388) 9754 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:56:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:51 smithi027 bash[22610]: cluster 2024-08-31T05:56:50.190016+0000 mgr.a (mgr.14388) 9754 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:56:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:51 smithi191 bash[24992]: cluster 2024-08-31T05:56:50.190016+0000 mgr.a (mgr.14388) 9754 : cluster [DBG] pgmap v6762: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T05:56:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:52.856 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:52.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:52.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:52.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:52.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:53 smithi163 bash[24253]: cluster 2024-08-31T05:56:52.190450+0000 mgr.a (mgr.14388) 9755 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:53 smithi163 bash[24253]: audit 2024-08-31T05:56:52.425735+0000 mgr.a (mgr.14388) 9756 : audit [DBG] from='client.216522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:53 smithi163 bash[24253]: audit 2024-08-31T05:56:52.966928+0000 mon.a (mon.0) 2038 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:56:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:53 smithi027 bash[22610]: cluster 2024-08-31T05:56:52.190450+0000 mgr.a (mgr.14388) 9755 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:53 smithi027 bash[22610]: audit 2024-08-31T05:56:52.425735+0000 mgr.a (mgr.14388) 9756 : audit [DBG] from='client.216522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:53 smithi027 bash[22610]: audit 2024-08-31T05:56:52.966928+0000 mon.a (mon.0) 2038 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:56:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:53 smithi191 bash[24992]: cluster 2024-08-31T05:56:52.190450+0000 mgr.a (mgr.14388) 9755 : cluster [DBG] pgmap v6763: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:53.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:53 smithi191 bash[24992]: audit 2024-08-31T05:56:52.425735+0000 mgr.a (mgr.14388) 9756 : audit [DBG] from='client.216522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:53.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:53 smithi191 bash[24992]: audit 2024-08-31T05:56:52.966928+0000 mon.a (mon.0) 2038 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:56:54.899 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:54 smithi027 bash[22610]: audit 2024-08-31T05:56:53.567721+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:56:54.899 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:54 smithi027 bash[22610]: audit 2024-08-31T05:56:53.571949+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:56:54.899 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:54 smithi027 bash[22610]: audit 2024-08-31T05:56:54.168181+0000 mon.a (mon.0) 2041 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:56:54.899 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:54 smithi027 bash[22610]: audit 2024-08-31T05:56:54.169669+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:56:54.899 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:54 smithi027 bash[22610]: audit 2024-08-31T05:56:54.179874+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:56:54.899 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:54 smithi027 bash[22610]: audit 2024-08-31T05:56:54.184520+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:56:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:54 smithi163 bash[24253]: audit 2024-08-31T05:56:53.567721+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:56:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:54 smithi163 bash[24253]: audit 2024-08-31T05:56:53.571949+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:56:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:54 smithi163 bash[24253]: audit 2024-08-31T05:56:54.168181+0000 mon.a (mon.0) 2041 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:56:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:54 smithi163 bash[24253]: audit 2024-08-31T05:56:54.169669+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:56:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:54 smithi163 bash[24253]: audit 2024-08-31T05:56:54.179874+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:56:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:54 smithi163 bash[24253]: audit 2024-08-31T05:56:54.184520+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:56:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:54 smithi191 bash[24992]: audit 2024-08-31T05:56:53.567721+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:56:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:54 smithi191 bash[24992]: audit 2024-08-31T05:56:53.571949+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:56:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:54 smithi191 bash[24992]: audit 2024-08-31T05:56:54.168181+0000 mon.a (mon.0) 2041 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:56:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:54 smithi191 bash[24992]: audit 2024-08-31T05:56:54.169669+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:56:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:54 smithi191 bash[24992]: audit 2024-08-31T05:56:54.179874+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:56:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:54 smithi191 bash[24992]: audit 2024-08-31T05:56:54.184520+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:56:55.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:56:54 smithi027 bash[22863]: debug 2024-08-31T05:56:54.897+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:56:55.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:56:54 smithi027 bash[22863]: debug 2024-08-31T05:56:54.897+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:56:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:55 smithi163 bash[24253]: audit 2024-08-31T05:56:54.186805+0000 mgr.a (mgr.14388) 9757 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:56:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:55 smithi163 bash[24253]: cluster 2024-08-31T05:56:54.200361+0000 mgr.a (mgr.14388) 9758 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:56:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:55 smithi027 bash[22610]: audit 2024-08-31T05:56:54.186805+0000 mgr.a (mgr.14388) 9757 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:56:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:55 smithi027 bash[22610]: cluster 2024-08-31T05:56:54.200361+0000 mgr.a (mgr.14388) 9758 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:56:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:55 smithi191 bash[24992]: audit 2024-08-31T05:56:54.186805+0000 mgr.a (mgr.14388) 9757 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:56:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:55 smithi191 bash[24992]: cluster 2024-08-31T05:56:54.200361+0000 mgr.a (mgr.14388) 9758 : cluster [DBG] pgmap v6764: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:56:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:56 smithi163 bash[24253]: audit 2024-08-31T05:56:54.898822+0000 mgr.a (mgr.14388) 9759 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:56:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:56 smithi163 bash[24253]: cephadm 2024-08-31T05:56:54.900073+0000 mgr.a (mgr.14388) 9760 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:56:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:56 smithi027 bash[22610]: audit 2024-08-31T05:56:54.898822+0000 mgr.a (mgr.14388) 9759 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:56:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:56 smithi027 bash[22610]: cephadm 2024-08-31T05:56:54.900073+0000 mgr.a (mgr.14388) 9760 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:56:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:56 smithi191 bash[24992]: audit 2024-08-31T05:56:54.898822+0000 mgr.a (mgr.14388) 9759 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:56:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:56 smithi191 bash[24992]: cephadm 2024-08-31T05:56:54.900073+0000 mgr.a (mgr.14388) 9760 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:56:57.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:56:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:56:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:56:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:57 smithi163 bash[24253]: cluster 2024-08-31T05:56:56.201463+0000 mgr.a (mgr.14388) 9761 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:57 smithi027 bash[22610]: cluster 2024-08-31T05:56:56.201463+0000 mgr.a (mgr.14388) 9761 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:57 smithi191 bash[24992]: cluster 2024-08-31T05:56:56.201463+0000 mgr.a (mgr.14388) 9761 : cluster [DBG] pgmap v6765: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:56:58.608 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:56:58.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:56:58.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:56:58.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:56:58.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:56:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:59 smithi163 bash[24253]: audit 2024-08-31T05:56:58.188865+0000 mgr.a (mgr.14388) 9762 : audit [DBG] from='client.216708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:56:59 smithi163 bash[24253]: cluster 2024-08-31T05:56:58.203730+0000 mgr.a (mgr.14388) 9763 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:56:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:59 smithi027 bash[22610]: audit 2024-08-31T05:56:58.188865+0000 mgr.a (mgr.14388) 9762 : audit [DBG] from='client.216708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:56:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:56:59 smithi027 bash[22610]: cluster 2024-08-31T05:56:58.203730+0000 mgr.a (mgr.14388) 9763 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:57:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:59 smithi191 bash[24992]: audit 2024-08-31T05:56:58.188865+0000 mgr.a (mgr.14388) 9762 : audit [DBG] from='client.216708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:56:59 smithi191 bash[24992]: cluster 2024-08-31T05:56:58.203730+0000 mgr.a (mgr.14388) 9763 : cluster [DBG] pgmap v6766: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:57:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:01 smithi163 bash[24253]: cluster 2024-08-31T05:57:00.204773+0000 mgr.a (mgr.14388) 9764 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:57:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:01 smithi027 bash[22610]: cluster 2024-08-31T05:57:00.204773+0000 mgr.a (mgr.14388) 9764 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:57:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:01 smithi191 bash[24992]: cluster 2024-08-31T05:57:00.204773+0000 mgr.a (mgr.14388) 9764 : cluster [DBG] pgmap v6767: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:57:03.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:57:03.610 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:57:03.611 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:57:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:03 smithi163 bash[24253]: cluster 2024-08-31T05:57:02.205727+0000 mgr.a (mgr.14388) 9765 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:57:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:03 smithi027 bash[22610]: cluster 2024-08-31T05:57:02.205727+0000 mgr.a (mgr.14388) 9765 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:57:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:03 smithi191 bash[24992]: cluster 2024-08-31T05:57:02.205727+0000 mgr.a (mgr.14388) 9765 : cluster [DBG] pgmap v6768: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:57:04.346 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:57:04.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:57:04.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:57:04.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:57:04.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:57:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:05 smithi163 bash[24253]: audit 2024-08-31T05:57:03.937396+0000 mgr.a (mgr.14388) 9766 : audit [DBG] from='client.216786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:05 smithi163 bash[24253]: cluster 2024-08-31T05:57:04.207445+0000 mgr.a (mgr.14388) 9767 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:57:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:05 smithi027 bash[22610]: audit 2024-08-31T05:57:03.937396+0000 mgr.a (mgr.14388) 9766 : audit [DBG] from='client.216786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:05 smithi027 bash[22610]: cluster 2024-08-31T05:57:04.207445+0000 mgr.a (mgr.14388) 9767 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:57:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:05 smithi191 bash[24992]: audit 2024-08-31T05:57:03.937396+0000 mgr.a (mgr.14388) 9766 : audit [DBG] from='client.216786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:05 smithi191 bash[24992]: cluster 2024-08-31T05:57:04.207445+0000 mgr.a (mgr.14388) 9767 : cluster [DBG] pgmap v6769: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:57:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:07 smithi163 bash[24253]: cluster 2024-08-31T05:57:06.208429+0000 mgr.a (mgr.14388) 9768 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:57:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:07 smithi027 bash[22610]: cluster 2024-08-31T05:57:06.208429+0000 mgr.a (mgr.14388) 9768 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:57:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:07 smithi191 bash[24992]: cluster 2024-08-31T05:57:06.208429+0000 mgr.a (mgr.14388) 9768 : cluster [DBG] pgmap v6770: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T05:57:09.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:57:09.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:57:09.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:57:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:09 smithi163 bash[24253]: cluster 2024-08-31T05:57:08.210676+0000 mgr.a (mgr.14388) 9769 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:57:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:09 smithi027 bash[22610]: cluster 2024-08-31T05:57:08.210676+0000 mgr.a (mgr.14388) 9769 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:57:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:09 smithi191 bash[24992]: cluster 2024-08-31T05:57:08.210676+0000 mgr.a (mgr.14388) 9769 : cluster [DBG] pgmap v6771: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:57:10.100 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:57:10.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:57:10.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:57:10.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:57:10.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:57:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:10 smithi163 bash[24253]: audit 2024-08-31T05:57:09.684491+0000 mgr.a (mgr.14388) 9770 : audit [DBG] from='client.216858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:10 smithi027 bash[22610]: audit 2024-08-31T05:57:09.684491+0000 mgr.a (mgr.14388) 9770 : audit [DBG] from='client.216858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:10 smithi191 bash[24992]: audit 2024-08-31T05:57:09.684491+0000 mgr.a (mgr.14388) 9770 : audit [DBG] from='client.216858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:11 smithi163 bash[24253]: cluster 2024-08-31T05:57:10.211792+0000 mgr.a (mgr.14388) 9771 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:11 smithi027 bash[22610]: cluster 2024-08-31T05:57:10.211792+0000 mgr.a (mgr.14388) 9771 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:11 smithi191 bash[24992]: cluster 2024-08-31T05:57:10.211792+0000 mgr.a (mgr.14388) 9771 : cluster [DBG] pgmap v6772: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:13 smithi191 bash[24992]: cluster 2024-08-31T05:57:12.212539+0000 mgr.a (mgr.14388) 9772 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:13 smithi163 bash[24253]: cluster 2024-08-31T05:57:12.212539+0000 mgr.a (mgr.14388) 9772 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:13 smithi027 bash[22610]: cluster 2024-08-31T05:57:12.212539+0000 mgr.a (mgr.14388) 9772 : cluster [DBG] pgmap v6773: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:15.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:57:15.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:57:15.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:57:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:15 smithi191 bash[24992]: cluster 2024-08-31T05:57:14.214677+0000 mgr.a (mgr.14388) 9773 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:15 smithi163 bash[24253]: cluster 2024-08-31T05:57:14.214677+0000 mgr.a (mgr.14388) 9773 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:15 smithi027 bash[22610]: cluster 2024-08-31T05:57:14.214677+0000 mgr.a (mgr.14388) 9773 : cluster [DBG] pgmap v6774: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:15.842 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:57:15.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:57:15.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:57:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:57:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:57:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:16 smithi191 bash[24992]: audit 2024-08-31T05:57:15.437478+0000 mgr.a (mgr.14388) 9774 : audit [DBG] from='client.216930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:16.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:16 smithi163 bash[24253]: audit 2024-08-31T05:57:15.437478+0000 mgr.a (mgr.14388) 9774 : audit [DBG] from='client.216930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:16 smithi027 bash[22610]: audit 2024-08-31T05:57:15.437478+0000 mgr.a (mgr.14388) 9774 : audit [DBG] from='client.216930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:17 smithi191 bash[24992]: cluster 2024-08-31T05:57:16.215650+0000 mgr.a (mgr.14388) 9775 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:17 smithi163 bash[24253]: cluster 2024-08-31T05:57:16.215650+0000 mgr.a (mgr.14388) 9775 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:17 smithi027 bash[22610]: cluster 2024-08-31T05:57:16.215650+0000 mgr.a (mgr.14388) 9775 : cluster [DBG] pgmap v6775: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:19 smithi163 bash[24253]: cluster 2024-08-31T05:57:18.217789+0000 mgr.a (mgr.14388) 9776 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:19 smithi027 bash[22610]: cluster 2024-08-31T05:57:18.217789+0000 mgr.a (mgr.14388) 9776 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:19 smithi191 bash[24992]: cluster 2024-08-31T05:57:18.217789+0000 mgr.a (mgr.14388) 9776 : cluster [DBG] pgmap v6776: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:20.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:57:20.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:57:20.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:57:21.617 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:57:21.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:57:21.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:57:21.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:57:21.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:57:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:21 smithi163 bash[24253]: cluster 2024-08-31T05:57:20.218555+0000 mgr.a (mgr.14388) 9777 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:21 smithi027 bash[22610]: cluster 2024-08-31T05:57:20.218555+0000 mgr.a (mgr.14388) 9777 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:21 smithi191 bash[24992]: cluster 2024-08-31T05:57:20.218555+0000 mgr.a (mgr.14388) 9777 : cluster [DBG] pgmap v6777: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:22 smithi163 bash[24253]: audit 2024-08-31T05:57:21.174986+0000 mgr.a (mgr.14388) 9778 : audit [DBG] from='client.217008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:22 smithi027 bash[22610]: audit 2024-08-31T05:57:21.174986+0000 mgr.a (mgr.14388) 9778 : audit [DBG] from='client.217008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:22 smithi191 bash[24992]: audit 2024-08-31T05:57:21.174986+0000 mgr.a (mgr.14388) 9778 : audit [DBG] from='client.217008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:23 smithi163 bash[24253]: cluster 2024-08-31T05:57:22.219440+0000 mgr.a (mgr.14388) 9779 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:23 smithi027 bash[22610]: cluster 2024-08-31T05:57:22.219440+0000 mgr.a (mgr.14388) 9779 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:23 smithi191 bash[24992]: cluster 2024-08-31T05:57:22.219440+0000 mgr.a (mgr.14388) 9779 : cluster [DBG] pgmap v6778: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:25 smithi163 bash[24253]: cluster 2024-08-31T05:57:24.221825+0000 mgr.a (mgr.14388) 9780 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:25 smithi027 bash[22610]: cluster 2024-08-31T05:57:24.221825+0000 mgr.a (mgr.14388) 9780 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:25 smithi191 bash[24992]: cluster 2024-08-31T05:57:24.221825+0000 mgr.a (mgr.14388) 9780 : cluster [DBG] pgmap v6779: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:26.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:57:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:57:26.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:57:27.394 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:57:27.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:57:27.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:57:27.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:57:27.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:57:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:27 smithi163 bash[24253]: cluster 2024-08-31T05:57:26.222786+0000 mgr.a (mgr.14388) 9781 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:27 smithi027 bash[22610]: cluster 2024-08-31T05:57:26.222786+0000 mgr.a (mgr.14388) 9781 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:27 smithi191 bash[24992]: cluster 2024-08-31T05:57:26.222786+0000 mgr.a (mgr.14388) 9781 : cluster [DBG] pgmap v6780: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:28 smithi163 bash[24253]: audit 2024-08-31T05:57:26.953150+0000 mgr.a (mgr.14388) 9782 : audit [DBG] from='client.217083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:28 smithi027 bash[22610]: audit 2024-08-31T05:57:26.953150+0000 mgr.a (mgr.14388) 9782 : audit [DBG] from='client.217083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:28 smithi191 bash[24992]: audit 2024-08-31T05:57:26.953150+0000 mgr.a (mgr.14388) 9782 : audit [DBG] from='client.217083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:29 smithi163 bash[24253]: cluster 2024-08-31T05:57:28.225144+0000 mgr.a (mgr.14388) 9783 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:29 smithi027 bash[22610]: cluster 2024-08-31T05:57:28.225144+0000 mgr.a (mgr.14388) 9783 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:29 smithi191 bash[24992]: cluster 2024-08-31T05:57:28.225144+0000 mgr.a (mgr.14388) 9783 : cluster [DBG] pgmap v6781: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:31 smithi163 bash[24253]: cluster 2024-08-31T05:57:30.226077+0000 mgr.a (mgr.14388) 9784 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:31 smithi027 bash[22610]: cluster 2024-08-31T05:57:30.226077+0000 mgr.a (mgr.14388) 9784 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:31 smithi191 bash[24992]: cluster 2024-08-31T05:57:30.226077+0000 mgr.a (mgr.14388) 9784 : cluster [DBG] pgmap v6782: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:32.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:57:32.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:57:32.396 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:57:33.141 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:57:33.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:57:33.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:57:33.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:57:33.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:57:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:33 smithi163 bash[24253]: cluster 2024-08-31T05:57:32.226997+0000 mgr.a (mgr.14388) 9785 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:33 smithi163 bash[24253]: audit 2024-08-31T05:57:32.727863+0000 mgr.a (mgr.14388) 9786 : audit [DBG] from='client.217161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:33 smithi027 bash[22610]: cluster 2024-08-31T05:57:32.226997+0000 mgr.a (mgr.14388) 9785 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:33 smithi027 bash[22610]: audit 2024-08-31T05:57:32.727863+0000 mgr.a (mgr.14388) 9786 : audit [DBG] from='client.217161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:33 smithi191 bash[24992]: cluster 2024-08-31T05:57:32.226997+0000 mgr.a (mgr.14388) 9785 : cluster [DBG] pgmap v6783: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:33.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:33 smithi191 bash[24992]: audit 2024-08-31T05:57:32.727863+0000 mgr.a (mgr.14388) 9786 : audit [DBG] from='client.217161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:35 smithi163 bash[24253]: cluster 2024-08-31T05:57:34.229736+0000 mgr.a (mgr.14388) 9787 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:35 smithi027 bash[22610]: cluster 2024-08-31T05:57:34.229736+0000 mgr.a (mgr.14388) 9787 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:35 smithi191 bash[24992]: cluster 2024-08-31T05:57:34.229736+0000 mgr.a (mgr.14388) 9787 : cluster [DBG] pgmap v6784: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:37 smithi163 bash[24253]: cluster 2024-08-31T05:57:36.230520+0000 mgr.a (mgr.14388) 9788 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:57:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:37 smithi027 bash[22610]: cluster 2024-08-31T05:57:36.230520+0000 mgr.a (mgr.14388) 9788 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:57:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:37 smithi191 bash[24992]: cluster 2024-08-31T05:57:36.230520+0000 mgr.a (mgr.14388) 9788 : cluster [DBG] pgmap v6785: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:57:38.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:57:38.143 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:57:38.144 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:57:38.890 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:57:38.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:57:38.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:57:38.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:57:38.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:57:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:39 smithi163 bash[24253]: cluster 2024-08-31T05:57:38.231490+0000 mgr.a (mgr.14388) 9789 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:39 smithi163 bash[24253]: audit 2024-08-31T05:57:38.476101+0000 mgr.a (mgr.14388) 9790 : audit [DBG] from='client.217236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:39 smithi027 bash[22610]: cluster 2024-08-31T05:57:38.231490+0000 mgr.a (mgr.14388) 9789 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:39 smithi027 bash[22610]: audit 2024-08-31T05:57:38.476101+0000 mgr.a (mgr.14388) 9790 : audit [DBG] from='client.217236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:39 smithi191 bash[24992]: cluster 2024-08-31T05:57:38.231490+0000 mgr.a (mgr.14388) 9789 : cluster [DBG] pgmap v6786: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:39.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:39 smithi191 bash[24992]: audit 2024-08-31T05:57:38.476101+0000 mgr.a (mgr.14388) 9790 : audit [DBG] from='client.217236 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:41 smithi163 bash[24253]: cluster 2024-08-31T05:57:40.232344+0000 mgr.a (mgr.14388) 9791 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:57:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:41 smithi027 bash[22610]: cluster 2024-08-31T05:57:40.232344+0000 mgr.a (mgr.14388) 9791 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:57:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:41 smithi191 bash[24992]: cluster 2024-08-31T05:57:40.232344+0000 mgr.a (mgr.14388) 9791 : cluster [DBG] pgmap v6787: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:57:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:43 smithi163 bash[24253]: cluster 2024-08-31T05:57:42.233093+0000 mgr.a (mgr.14388) 9792 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:57:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:43 smithi027 bash[22610]: cluster 2024-08-31T05:57:42.233093+0000 mgr.a (mgr.14388) 9792 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:57:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:43 smithi191 bash[24992]: cluster 2024-08-31T05:57:42.233093+0000 mgr.a (mgr.14388) 9792 : cluster [DBG] pgmap v6788: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:57:43.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:57:43.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:57:43.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:57:44.644 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:57:44.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:57:44.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:57:44.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:57:44.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:57:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:45 smithi163 bash[24253]: audit 2024-08-31T05:57:44.221383+0000 mgr.a (mgr.14388) 9793 : audit [DBG] from='client.217314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:45 smithi163 bash[24253]: cluster 2024-08-31T05:57:44.241724+0000 mgr.a (mgr.14388) 9794 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:45 smithi027 bash[22610]: audit 2024-08-31T05:57:44.221383+0000 mgr.a (mgr.14388) 9793 : audit [DBG] from='client.217314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:45 smithi027 bash[22610]: cluster 2024-08-31T05:57:44.241724+0000 mgr.a (mgr.14388) 9794 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:45 smithi191 bash[24992]: audit 2024-08-31T05:57:44.221383+0000 mgr.a (mgr.14388) 9793 : audit [DBG] from='client.217314 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:45 smithi191 bash[24992]: cluster 2024-08-31T05:57:44.241724+0000 mgr.a (mgr.14388) 9794 : cluster [DBG] pgmap v6789: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:47 smithi163 bash[24253]: cluster 2024-08-31T05:57:46.242651+0000 mgr.a (mgr.14388) 9795 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:47 smithi027 bash[22610]: cluster 2024-08-31T05:57:46.242651+0000 mgr.a (mgr.14388) 9795 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:47 smithi191 bash[24992]: cluster 2024-08-31T05:57:46.242651+0000 mgr.a (mgr.14388) 9795 : cluster [DBG] pgmap v6790: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:49.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:57:49.646 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:57:49.646 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:57:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:49 smithi163 bash[24253]: cluster 2024-08-31T05:57:48.244773+0000 mgr.a (mgr.14388) 9796 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:49 smithi027 bash[22610]: cluster 2024-08-31T05:57:48.244773+0000 mgr.a (mgr.14388) 9796 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:49 smithi191 bash[24992]: cluster 2024-08-31T05:57:48.244773+0000 mgr.a (mgr.14388) 9796 : cluster [DBG] pgmap v6791: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:50.416 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:57:50.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:57:50.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:57:50.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:57:50.416 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:57:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:51 smithi163 bash[24253]: audit 2024-08-31T05:57:49.981371+0000 mgr.a (mgr.14388) 9797 : audit [DBG] from='client.217389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:51 smithi163 bash[24253]: cluster 2024-08-31T05:57:50.245332+0000 mgr.a (mgr.14388) 9798 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:51 smithi027 bash[22610]: audit 2024-08-31T05:57:49.981371+0000 mgr.a (mgr.14388) 9797 : audit [DBG] from='client.217389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:51 smithi027 bash[22610]: cluster 2024-08-31T05:57:50.245332+0000 mgr.a (mgr.14388) 9798 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:51 smithi191 bash[24992]: audit 2024-08-31T05:57:49.981371+0000 mgr.a (mgr.14388) 9797 : audit [DBG] from='client.217389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:51 smithi191 bash[24992]: cluster 2024-08-31T05:57:50.245332+0000 mgr.a (mgr.14388) 9798 : cluster [DBG] pgmap v6792: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:53 smithi163 bash[24253]: cluster 2024-08-31T05:57:52.246231+0000 mgr.a (mgr.14388) 9799 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:53 smithi027 bash[22610]: cluster 2024-08-31T05:57:52.246231+0000 mgr.a (mgr.14388) 9799 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:53 smithi191 bash[24992]: cluster 2024-08-31T05:57:52.246231+0000 mgr.a (mgr.14388) 9799 : cluster [DBG] pgmap v6793: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:55.417 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:57:55.418 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:57:55.418 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:57:55.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:55 smithi163 bash[24253]: cluster 2024-08-31T05:57:54.248487+0000 mgr.a (mgr.14388) 9800 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:55.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:55 smithi163 bash[24253]: audit 2024-08-31T05:57:54.950977+0000 mon.a (mon.0) 2045 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:57:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:55 smithi027 bash[22610]: cluster 2024-08-31T05:57:54.248487+0000 mgr.a (mgr.14388) 9800 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:55 smithi027 bash[22610]: audit 2024-08-31T05:57:54.950977+0000 mon.a (mon.0) 2045 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:57:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:55 smithi191 bash[24992]: cluster 2024-08-31T05:57:54.248487+0000 mgr.a (mgr.14388) 9800 : cluster [DBG] pgmap v6794: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:57:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:55 smithi191 bash[24992]: audit 2024-08-31T05:57:54.950977+0000 mon.a (mon.0) 2045 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:57:56.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:57:56.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:57:56.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:57:56.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:57:56.188 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:57:56.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22610]: audit 2024-08-31T05:57:55.553711+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:56.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22610]: audit 2024-08-31T05:57:55.557749+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:56.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22610]: audit 2024-08-31T05:57:55.562883+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:56.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22610]: audit 2024-08-31T05:57:55.568031+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:56.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22610]: audit 2024-08-31T05:57:55.750104+0000 mgr.a (mgr.14388) 9801 : audit [DBG] from='client.217467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:56.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22610]: audit 2024-08-31T05:57:56.211477+0000 mon.a (mon.0) 2050 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:57:56.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22610]: audit 2024-08-31T05:57:56.212329+0000 mon.a (mon.0) 2051 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:57:56.917 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22610]: audit 2024-08-31T05:57:56.217389+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:56.918 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22610]: audit 2024-08-31T05:57:56.219297+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:57:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:56 smithi163 bash[24253]: audit 2024-08-31T05:57:55.553711+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:56 smithi163 bash[24253]: audit 2024-08-31T05:57:55.557749+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:56 smithi163 bash[24253]: audit 2024-08-31T05:57:55.562883+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:56 smithi163 bash[24253]: audit 2024-08-31T05:57:55.568031+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:56 smithi163 bash[24253]: audit 2024-08-31T05:57:55.750104+0000 mgr.a (mgr.14388) 9801 : audit [DBG] from='client.217467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:56 smithi163 bash[24253]: audit 2024-08-31T05:57:56.211477+0000 mon.a (mon.0) 2050 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:57:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:56 smithi163 bash[24253]: audit 2024-08-31T05:57:56.212329+0000 mon.a (mon.0) 2051 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:57:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:56 smithi163 bash[24253]: audit 2024-08-31T05:57:56.217389+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:56 smithi163 bash[24253]: audit 2024-08-31T05:57:56.219297+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:57:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:56 smithi191 bash[24992]: audit 2024-08-31T05:57:55.553711+0000 mon.a (mon.0) 2046 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:56 smithi191 bash[24992]: audit 2024-08-31T05:57:55.557749+0000 mon.a (mon.0) 2047 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:56 smithi191 bash[24992]: audit 2024-08-31T05:57:55.562883+0000 mon.a (mon.0) 2048 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:56 smithi191 bash[24992]: audit 2024-08-31T05:57:55.568031+0000 mon.a (mon.0) 2049 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:56 smithi191 bash[24992]: audit 2024-08-31T05:57:55.750104+0000 mgr.a (mgr.14388) 9801 : audit [DBG] from='client.217467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:57:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:56 smithi191 bash[24992]: audit 2024-08-31T05:57:56.211477+0000 mon.a (mon.0) 2050 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:57:57.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:56 smithi191 bash[24992]: audit 2024-08-31T05:57:56.212329+0000 mon.a (mon.0) 2051 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:57:57.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:56 smithi191 bash[24992]: audit 2024-08-31T05:57:56.217389+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:57:57.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:56 smithi191 bash[24992]: audit 2024-08-31T05:57:56.219297+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:57:57.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22863]: debug 2024-08-31T05:57:56.911+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:57:57.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:57:56 smithi027 bash[22863]: debug 2024-08-31T05:57:56.911+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:57:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:57 smithi163 bash[24253]: audit 2024-08-31T05:57:56.220345+0000 mgr.a (mgr.14388) 9802 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:57:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:57 smithi163 bash[24253]: cluster 2024-08-31T05:57:56.249038+0000 mgr.a (mgr.14388) 9803 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:57 smithi027 bash[22610]: audit 2024-08-31T05:57:56.220345+0000 mgr.a (mgr.14388) 9802 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:57:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:57 smithi027 bash[22610]: cluster 2024-08-31T05:57:56.249038+0000 mgr.a (mgr.14388) 9803 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:57 smithi191 bash[24992]: audit 2024-08-31T05:57:56.220345+0000 mgr.a (mgr.14388) 9802 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:57:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:57 smithi191 bash[24992]: cluster 2024-08-31T05:57:56.249038+0000 mgr.a (mgr.14388) 9803 : cluster [DBG] pgmap v6795: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:57:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:58 smithi163 bash[24253]: audit 2024-08-31T05:57:56.916784+0000 mgr.a (mgr.14388) 9804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:57:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:58 smithi163 bash[24253]: cephadm 2024-08-31T05:57:56.917902+0000 mgr.a (mgr.14388) 9805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:57:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:58 smithi027 bash[22610]: audit 2024-08-31T05:57:56.916784+0000 mgr.a (mgr.14388) 9804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:57:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:58 smithi027 bash[22610]: cephadm 2024-08-31T05:57:56.917902+0000 mgr.a (mgr.14388) 9805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:57:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:58 smithi191 bash[24992]: audit 2024-08-31T05:57:56.916784+0000 mgr.a (mgr.14388) 9804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:57:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:58 smithi191 bash[24992]: cephadm 2024-08-31T05:57:56.917902+0000 mgr.a (mgr.14388) 9805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:57:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:57:59 smithi163 bash[24253]: cluster 2024-08-31T05:57:58.251555+0000 mgr.a (mgr.14388) 9806 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:57:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:57:59 smithi027 bash[22610]: cluster 2024-08-31T05:57:58.251555+0000 mgr.a (mgr.14388) 9806 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:57:59 smithi191 bash[24992]: cluster 2024-08-31T05:57:58.251555+0000 mgr.a (mgr.14388) 9806 : cluster [DBG] pgmap v6796: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:01.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:01.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:01.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:01 smithi163 bash[24253]: cluster 2024-08-31T05:58:00.252353+0000 mgr.a (mgr.14388) 9807 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:01.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:01.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:01.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:01.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:58:01.969 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:01 smithi027 bash[22610]: cluster 2024-08-31T05:58:00.252353+0000 mgr.a (mgr.14388) 9807 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:01 smithi191 bash[24992]: cluster 2024-08-31T05:58:00.252353+0000 mgr.a (mgr.14388) 9807 : cluster [DBG] pgmap v6797: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:02 smithi163 bash[24253]: audit 2024-08-31T05:58:01.524142+0000 mgr.a (mgr.14388) 9808 : audit [DBG] from='client.217653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:02 smithi027 bash[22610]: audit 2024-08-31T05:58:01.524142+0000 mgr.a (mgr.14388) 9808 : audit [DBG] from='client.217653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:02 smithi191 bash[24992]: audit 2024-08-31T05:58:01.524142+0000 mgr.a (mgr.14388) 9808 : audit [DBG] from='client.217653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:03.956 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:03 smithi163 bash[24253]: cluster 2024-08-31T05:58:02.253375+0000 mgr.a (mgr.14388) 9809 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:03 smithi027 bash[22610]: cluster 2024-08-31T05:58:02.253375+0000 mgr.a (mgr.14388) 9809 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:03 smithi191 bash[24992]: cluster 2024-08-31T05:58:02.253375+0000 mgr.a (mgr.14388) 9809 : cluster [DBG] pgmap v6798: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:05 smithi163 bash[24253]: cluster 2024-08-31T05:58:04.255596+0000 mgr.a (mgr.14388) 9810 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:05 smithi027 bash[22610]: cluster 2024-08-31T05:58:04.255596+0000 mgr.a (mgr.14388) 9810 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:05 smithi191 bash[24992]: cluster 2024-08-31T05:58:04.255596+0000 mgr.a (mgr.14388) 9810 : cluster [DBG] pgmap v6799: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:06.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:06.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:06.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:07.744 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:07.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:58:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:07 smithi163 bash[24253]: cluster 2024-08-31T05:58:06.256310+0000 mgr.a (mgr.14388) 9811 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:07 smithi027 bash[22610]: cluster 2024-08-31T05:58:06.256310+0000 mgr.a (mgr.14388) 9811 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:07 smithi191 bash[24992]: cluster 2024-08-31T05:58:06.256310+0000 mgr.a (mgr.14388) 9811 : cluster [DBG] pgmap v6800: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:08 smithi163 bash[24253]: audit 2024-08-31T05:58:07.308878+0000 mgr.a (mgr.14388) 9812 : audit [DBG] from='client.217731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:08 smithi027 bash[22610]: audit 2024-08-31T05:58:07.308878+0000 mgr.a (mgr.14388) 9812 : audit [DBG] from='client.217731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:08 smithi191 bash[24992]: audit 2024-08-31T05:58:07.308878+0000 mgr.a (mgr.14388) 9812 : audit [DBG] from='client.217731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:09.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:09 smithi163 bash[24253]: cluster 2024-08-31T05:58:08.258542+0000 mgr.a (mgr.14388) 9813 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:09 smithi027 bash[22610]: cluster 2024-08-31T05:58:08.258542+0000 mgr.a (mgr.14388) 9813 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:09 smithi191 bash[24992]: cluster 2024-08-31T05:58:08.258542+0000 mgr.a (mgr.14388) 9813 : cluster [DBG] pgmap v6801: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:58:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:11 smithi163 bash[24253]: cluster 2024-08-31T05:58:10.259289+0000 mgr.a (mgr.14388) 9814 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:11 smithi027 bash[22610]: cluster 2024-08-31T05:58:10.259289+0000 mgr.a (mgr.14388) 9814 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:11 smithi191 bash[24992]: cluster 2024-08-31T05:58:10.259289+0000 mgr.a (mgr.14388) 9814 : cluster [DBG] pgmap v6802: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:12.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:12.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:12.747 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:13.502 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:13.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:13.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:13.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:13.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:58:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:13 smithi163 bash[24253]: cluster 2024-08-31T05:58:12.260082+0000 mgr.a (mgr.14388) 9815 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:13 smithi027 bash[22610]: cluster 2024-08-31T05:58:12.260082+0000 mgr.a (mgr.14388) 9815 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:13 smithi191 bash[24992]: cluster 2024-08-31T05:58:12.260082+0000 mgr.a (mgr.14388) 9815 : cluster [DBG] pgmap v6803: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:14 smithi163 bash[24253]: audit 2024-08-31T05:58:13.082717+0000 mgr.a (mgr.14388) 9816 : audit [DBG] from='client.217809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:14 smithi027 bash[22610]: audit 2024-08-31T05:58:13.082717+0000 mgr.a (mgr.14388) 9816 : audit [DBG] from='client.217809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:14 smithi191 bash[24992]: audit 2024-08-31T05:58:13.082717+0000 mgr.a (mgr.14388) 9816 : audit [DBG] from='client.217809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:15 smithi163 bash[24253]: cluster 2024-08-31T05:58:14.262943+0000 mgr.a (mgr.14388) 9817 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:15 smithi027 bash[22610]: cluster 2024-08-31T05:58:14.262943+0000 mgr.a (mgr.14388) 9817 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:15 smithi191 bash[24992]: cluster 2024-08-31T05:58:14.262943+0000 mgr.a (mgr.14388) 9817 : cluster [DBG] pgmap v6804: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:17 smithi163 bash[24253]: cluster 2024-08-31T05:58:16.263723+0000 mgr.a (mgr.14388) 9818 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:17 smithi027 bash[22610]: cluster 2024-08-31T05:58:16.263723+0000 mgr.a (mgr.14388) 9818 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:17 smithi191 bash[24992]: cluster 2024-08-31T05:58:16.263723+0000 mgr.a (mgr.14388) 9818 : cluster [DBG] pgmap v6805: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:19.269 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:19.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:19.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:58:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:19 smithi163 bash[24253]: cluster 2024-08-31T05:58:18.265676+0000 mgr.a (mgr.14388) 9819 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:19 smithi027 bash[22610]: cluster 2024-08-31T05:58:18.265676+0000 mgr.a (mgr.14388) 9819 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:19 smithi191 bash[24992]: cluster 2024-08-31T05:58:18.265676+0000 mgr.a (mgr.14388) 9819 : cluster [DBG] pgmap v6806: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:20 smithi163 bash[24253]: audit 2024-08-31T05:58:18.837359+0000 mgr.a (mgr.14388) 9820 : audit [DBG] from='client.217884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:20 smithi027 bash[22610]: audit 2024-08-31T05:58:18.837359+0000 mgr.a (mgr.14388) 9820 : audit [DBG] from='client.217884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:20 smithi191 bash[24992]: audit 2024-08-31T05:58:18.837359+0000 mgr.a (mgr.14388) 9820 : audit [DBG] from='client.217884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:21 smithi163 bash[24253]: cluster 2024-08-31T05:58:20.266635+0000 mgr.a (mgr.14388) 9821 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:21 smithi027 bash[22610]: cluster 2024-08-31T05:58:20.266635+0000 mgr.a (mgr.14388) 9821 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:22.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:21 smithi191 bash[24992]: cluster 2024-08-31T05:58:20.266635+0000 mgr.a (mgr.14388) 9821 : cluster [DBG] pgmap v6807: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:23 smithi163 bash[24253]: cluster 2024-08-31T05:58:22.267468+0000 mgr.a (mgr.14388) 9822 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:58:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:23 smithi027 bash[22610]: cluster 2024-08-31T05:58:22.267468+0000 mgr.a (mgr.14388) 9822 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:58:24.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:23 smithi191 bash[24992]: cluster 2024-08-31T05:58:22.267468+0000 mgr.a (mgr.14388) 9822 : cluster [DBG] pgmap v6808: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:58:24.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:24.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:24.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:25.047 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:25.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:25.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:25.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:25.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:58:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:25 smithi163 bash[24253]: cluster 2024-08-31T05:58:24.269688+0000 mgr.a (mgr.14388) 9823 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:25 smithi163 bash[24253]: audit 2024-08-31T05:58:24.606284+0000 mgr.a (mgr.14388) 9824 : audit [DBG] from='client.217959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:25 smithi027 bash[22610]: cluster 2024-08-31T05:58:24.269688+0000 mgr.a (mgr.14388) 9823 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:25 smithi027 bash[22610]: audit 2024-08-31T05:58:24.606284+0000 mgr.a (mgr.14388) 9824 : audit [DBG] from='client.217959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:25 smithi191 bash[24992]: cluster 2024-08-31T05:58:24.269688+0000 mgr.a (mgr.14388) 9823 : cluster [DBG] pgmap v6809: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:26.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:25 smithi191 bash[24992]: audit 2024-08-31T05:58:24.606284+0000 mgr.a (mgr.14388) 9824 : audit [DBG] from='client.217959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:27 smithi163 bash[24253]: cluster 2024-08-31T05:58:26.270635+0000 mgr.a (mgr.14388) 9825 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:27 smithi027 bash[22610]: cluster 2024-08-31T05:58:26.270635+0000 mgr.a (mgr.14388) 9825 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:27 smithi191 bash[24992]: cluster 2024-08-31T05:58:26.270635+0000 mgr.a (mgr.14388) 9825 : cluster [DBG] pgmap v6810: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:29 smithi163 bash[24253]: cluster 2024-08-31T05:58:28.272826+0000 mgr.a (mgr.14388) 9826 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:29 smithi027 bash[22610]: cluster 2024-08-31T05:58:28.272826+0000 mgr.a (mgr.14388) 9826 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:29 smithi191 bash[24992]: cluster 2024-08-31T05:58:28.272826+0000 mgr.a (mgr.14388) 9826 : cluster [DBG] pgmap v6811: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:30.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:30.049 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:30.049 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:30.800 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:30.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:30.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:30.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:30.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:58:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:31 smithi163 bash[24253]: cluster 2024-08-31T05:58:30.273578+0000 mgr.a (mgr.14388) 9827 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:31 smithi163 bash[24253]: audit 2024-08-31T05:58:30.378664+0000 mgr.a (mgr.14388) 9828 : audit [DBG] from='client.218037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:31 smithi027 bash[22610]: cluster 2024-08-31T05:58:30.273578+0000 mgr.a (mgr.14388) 9827 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:31 smithi027 bash[22610]: audit 2024-08-31T05:58:30.378664+0000 mgr.a (mgr.14388) 9828 : audit [DBG] from='client.218037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:31 smithi191 bash[24992]: cluster 2024-08-31T05:58:30.273578+0000 mgr.a (mgr.14388) 9827 : cluster [DBG] pgmap v6812: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:31 smithi191 bash[24992]: audit 2024-08-31T05:58:30.378664+0000 mgr.a (mgr.14388) 9828 : audit [DBG] from='client.218037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:33 smithi163 bash[24253]: cluster 2024-08-31T05:58:32.274551+0000 mgr.a (mgr.14388) 9829 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:33 smithi027 bash[22610]: cluster 2024-08-31T05:58:32.274551+0000 mgr.a (mgr.14388) 9829 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:33 smithi191 bash[24992]: cluster 2024-08-31T05:58:32.274551+0000 mgr.a (mgr.14388) 9829 : cluster [DBG] pgmap v6813: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:35.801 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:35.802 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:35.802 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:35 smithi163 bash[24253]: cluster 2024-08-31T05:58:34.276782+0000 mgr.a (mgr.14388) 9830 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:35 smithi027 bash[22610]: cluster 2024-08-31T05:58:34.276782+0000 mgr.a (mgr.14388) 9830 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:35 smithi191 bash[24992]: cluster 2024-08-31T05:58:34.276782+0000 mgr.a (mgr.14388) 9830 : cluster [DBG] pgmap v6814: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:36.544 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:36.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:36.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:36.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:36.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:58:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:37 smithi163 bash[24253]: audit 2024-08-31T05:58:36.130533+0000 mgr.a (mgr.14388) 9831 : audit [DBG] from='client.218115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:37 smithi163 bash[24253]: cluster 2024-08-31T05:58:36.277336+0000 mgr.a (mgr.14388) 9832 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:37 smithi027 bash[22610]: audit 2024-08-31T05:58:36.130533+0000 mgr.a (mgr.14388) 9831 : audit [DBG] from='client.218115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:37 smithi027 bash[22610]: cluster 2024-08-31T05:58:36.277336+0000 mgr.a (mgr.14388) 9832 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:38.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:37 smithi191 bash[24992]: audit 2024-08-31T05:58:36.130533+0000 mgr.a (mgr.14388) 9831 : audit [DBG] from='client.218115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:38.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:37 smithi191 bash[24992]: cluster 2024-08-31T05:58:36.277336+0000 mgr.a (mgr.14388) 9832 : cluster [DBG] pgmap v6815: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:39 smithi163 bash[24253]: cluster 2024-08-31T05:58:38.279577+0000 mgr.a (mgr.14388) 9833 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:39 smithi027 bash[22610]: cluster 2024-08-31T05:58:38.279577+0000 mgr.a (mgr.14388) 9833 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:39 smithi191 bash[24992]: cluster 2024-08-31T05:58:38.279577+0000 mgr.a (mgr.14388) 9833 : cluster [DBG] pgmap v6816: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:41.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:41.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:41.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:41 smithi163 bash[24253]: cluster 2024-08-31T05:58:40.280372+0000 mgr.a (mgr.14388) 9834 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:41 smithi027 bash[22610]: cluster 2024-08-31T05:58:40.280372+0000 mgr.a (mgr.14388) 9834 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:41 smithi191 bash[24992]: cluster 2024-08-31T05:58:40.280372+0000 mgr.a (mgr.14388) 9834 : cluster [DBG] pgmap v6817: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:42.312 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:42.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:42.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:42.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:42.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:58:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:43 smithi163 bash[24253]: audit 2024-08-31T05:58:41.884304+0000 mgr.a (mgr.14388) 9835 : audit [DBG] from='client.218193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:43 smithi163 bash[24253]: cluster 2024-08-31T05:58:42.280887+0000 mgr.a (mgr.14388) 9836 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:43 smithi027 bash[22610]: audit 2024-08-31T05:58:41.884304+0000 mgr.a (mgr.14388) 9835 : audit [DBG] from='client.218193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:43 smithi027 bash[22610]: cluster 2024-08-31T05:58:42.280887+0000 mgr.a (mgr.14388) 9836 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:43 smithi191 bash[24992]: audit 2024-08-31T05:58:41.884304+0000 mgr.a (mgr.14388) 9835 : audit [DBG] from='client.218193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:44.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:43 smithi191 bash[24992]: cluster 2024-08-31T05:58:42.280887+0000 mgr.a (mgr.14388) 9836 : cluster [DBG] pgmap v6818: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:45 smithi163 bash[24253]: cluster 2024-08-31T05:58:44.283082+0000 mgr.a (mgr.14388) 9837 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:45 smithi027 bash[22610]: cluster 2024-08-31T05:58:44.283082+0000 mgr.a (mgr.14388) 9837 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:45 smithi191 bash[24992]: cluster 2024-08-31T05:58:44.283082+0000 mgr.a (mgr.14388) 9837 : cluster [DBG] pgmap v6819: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:58:47.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:47.315 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:47 smithi027 bash[22610]: cluster 2024-08-31T05:58:46.283861+0000 mgr.a (mgr.14388) 9838 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:47 smithi191 bash[24992]: cluster 2024-08-31T05:58:46.283861+0000 mgr.a (mgr.14388) 9838 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:48.097 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:48.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:58:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:47 smithi163 bash[24253]: cluster 2024-08-31T05:58:46.283861+0000 mgr.a (mgr.14388) 9838 : cluster [DBG] pgmap v6820: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:48 smithi027 bash[22610]: audit 2024-08-31T05:58:47.656679+0000 mgr.a (mgr.14388) 9839 : audit [DBG] from='client.218265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:48 smithi191 bash[24992]: audit 2024-08-31T05:58:47.656679+0000 mgr.a (mgr.14388) 9839 : audit [DBG] from='client.218265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:48 smithi163 bash[24253]: audit 2024-08-31T05:58:47.656679+0000 mgr.a (mgr.14388) 9839 : audit [DBG] from='client.218265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:49 smithi027 bash[22610]: cluster 2024-08-31T05:58:48.286709+0000 mgr.a (mgr.14388) 9840 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:49 smithi191 bash[24992]: cluster 2024-08-31T05:58:48.286709+0000 mgr.a (mgr.14388) 9840 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:49 smithi163 bash[24253]: cluster 2024-08-31T05:58:48.286709+0000 mgr.a (mgr.14388) 9840 : cluster [DBG] pgmap v6821: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:51 smithi027 bash[22610]: cluster 2024-08-31T05:58:50.287533+0000 mgr.a (mgr.14388) 9841 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:51 smithi191 bash[24992]: cluster 2024-08-31T05:58:50.287533+0000 mgr.a (mgr.14388) 9841 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:51 smithi163 bash[24253]: cluster 2024-08-31T05:58:50.287533+0000 mgr.a (mgr.14388) 9841 : cluster [DBG] pgmap v6822: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:53.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:53.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:53.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:53.869 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:53.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:53.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:53.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:53.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:58:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:53 smithi027 bash[22610]: cluster 2024-08-31T05:58:52.288322+0000 mgr.a (mgr.14388) 9842 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:58:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:53 smithi191 bash[24992]: cluster 2024-08-31T05:58:52.288322+0000 mgr.a (mgr.14388) 9842 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:58:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:53 smithi163 bash[24253]: cluster 2024-08-31T05:58:52.288322+0000 mgr.a (mgr.14388) 9842 : cluster [DBG] pgmap v6823: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:58:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:54 smithi027 bash[22610]: audit 2024-08-31T05:58:53.437562+0000 mgr.a (mgr.14388) 9843 : audit [DBG] from='client.218343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:54 smithi191 bash[24992]: audit 2024-08-31T05:58:53.437562+0000 mgr.a (mgr.14388) 9843 : audit [DBG] from='client.218343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:54 smithi163 bash[24253]: audit 2024-08-31T05:58:53.437562+0000 mgr.a (mgr.14388) 9843 : audit [DBG] from='client.218343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:58:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:55 smithi027 bash[22610]: cluster 2024-08-31T05:58:54.291123+0000 mgr.a (mgr.14388) 9844 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:55 smithi191 bash[24992]: cluster 2024-08-31T05:58:54.291123+0000 mgr.a (mgr.14388) 9844 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:55 smithi163 bash[24253]: cluster 2024-08-31T05:58:54.291123+0000 mgr.a (mgr.14388) 9844 : cluster [DBG] pgmap v6824: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:58:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:57 smithi027 bash[22610]: cluster 2024-08-31T05:58:56.291945+0000 mgr.a (mgr.14388) 9845 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:57 smithi027 bash[22610]: audit 2024-08-31T05:58:56.969364+0000 mon.a (mon.0) 2054 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:58:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:57 smithi191 bash[24992]: cluster 2024-08-31T05:58:56.291945+0000 mgr.a (mgr.14388) 9845 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:57 smithi191 bash[24992]: audit 2024-08-31T05:58:56.969364+0000 mon.a (mon.0) 2054 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:58:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:57 smithi163 bash[24253]: cluster 2024-08-31T05:58:56.291945+0000 mgr.a (mgr.14388) 9845 : cluster [DBG] pgmap v6825: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:58:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:57 smithi163 bash[24253]: audit 2024-08-31T05:58:56.969364+0000 mon.a (mon.0) 2054 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:58:58.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:58:58.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:58:58.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:58:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:58 smithi027 bash[22610]: audit 2024-08-31T05:58:57.801934+0000 mon.a (mon.0) 2055 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:58:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:58 smithi027 bash[22610]: audit 2024-08-31T05:58:57.803649+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:58:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:58 smithi027 bash[22610]: audit 2024-08-31T05:58:57.813134+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:58:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:58 smithi027 bash[22610]: audit 2024-08-31T05:58:57.818090+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:58:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:58 smithi027 bash[22610]: audit 2024-08-31T05:58:57.820350+0000 mgr.a (mgr.14388) 9846 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:58:58.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:58:58 smithi027 bash[22863]: debug 2024-08-31T05:58:58.565+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:58:58.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 05:58:58 smithi027 bash[22863]: debug 2024-08-31T05:58:58.565+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:58:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:58 smithi191 bash[24992]: audit 2024-08-31T05:58:57.801934+0000 mon.a (mon.0) 2055 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:58:59.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:58 smithi191 bash[24992]: audit 2024-08-31T05:58:57.803649+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:58:59.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:58 smithi191 bash[24992]: audit 2024-08-31T05:58:57.813134+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:58:59.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:58 smithi191 bash[24992]: audit 2024-08-31T05:58:57.818090+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:58:59.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:58 smithi191 bash[24992]: audit 2024-08-31T05:58:57.820350+0000 mgr.a (mgr.14388) 9846 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:58:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:58 smithi163 bash[24253]: audit 2024-08-31T05:58:57.801934+0000 mon.a (mon.0) 2055 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:58:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:58 smithi163 bash[24253]: audit 2024-08-31T05:58:57.803649+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:58:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:58 smithi163 bash[24253]: audit 2024-08-31T05:58:57.813134+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:58:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:58 smithi163 bash[24253]: audit 2024-08-31T05:58:57.818090+0000 mon.a (mon.0) 2058 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:58:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:58 smithi163 bash[24253]: audit 2024-08-31T05:58:57.820350+0000 mgr.a (mgr.14388) 9846 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:58:59.644 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:58:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:58:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:58:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:58:59.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:59 smithi163 bash[24253]: cluster 2024-08-31T05:58:58.293284+0000 mgr.a (mgr.14388) 9847 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:59 smithi163 bash[24253]: audit 2024-08-31T05:58:58.567248+0000 mgr.a (mgr.14388) 9848 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:59:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:58:59 smithi163 bash[24253]: cephadm 2024-08-31T05:58:58.569018+0000 mgr.a (mgr.14388) 9849 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:59:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:59 smithi027 bash[22610]: cluster 2024-08-31T05:58:58.293284+0000 mgr.a (mgr.14388) 9847 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:59 smithi027 bash[22610]: audit 2024-08-31T05:58:58.567248+0000 mgr.a (mgr.14388) 9848 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:59:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:58:59 smithi027 bash[22610]: cephadm 2024-08-31T05:58:58.569018+0000 mgr.a (mgr.14388) 9849 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:59:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:59 smithi191 bash[24992]: cluster 2024-08-31T05:58:58.293284+0000 mgr.a (mgr.14388) 9847 : cluster [DBG] pgmap v6826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:59 smithi191 bash[24992]: audit 2024-08-31T05:58:58.567248+0000 mgr.a (mgr.14388) 9848 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T05:59:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:58:59 smithi191 bash[24992]: cephadm 2024-08-31T05:58:58.569018+0000 mgr.a (mgr.14388) 9849 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T05:59:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:00 smithi163 bash[24253]: audit 2024-08-31T05:58:59.204804+0000 mgr.a (mgr.14388) 9850 : audit [DBG] from='client.218526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:00 smithi027 bash[22610]: audit 2024-08-31T05:58:59.204804+0000 mgr.a (mgr.14388) 9850 : audit [DBG] from='client.218526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:00 smithi191 bash[24992]: audit 2024-08-31T05:58:59.204804+0000 mgr.a (mgr.14388) 9850 : audit [DBG] from='client.218526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:01 smithi163 bash[24253]: cluster 2024-08-31T05:59:00.294219+0000 mgr.a (mgr.14388) 9851 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:01 smithi027 bash[22610]: cluster 2024-08-31T05:59:00.294219+0000 mgr.a (mgr.14388) 9851 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:01 smithi191 bash[24992]: cluster 2024-08-31T05:59:00.294219+0000 mgr.a (mgr.14388) 9851 : cluster [DBG] pgmap v6827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:03 smithi163 bash[24253]: cluster 2024-08-31T05:59:02.295048+0000 mgr.a (mgr.14388) 9852 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:03 smithi027 bash[22610]: cluster 2024-08-31T05:59:02.295048+0000 mgr.a (mgr.14388) 9852 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:03 smithi191 bash[24992]: cluster 2024-08-31T05:59:02.295048+0000 mgr.a (mgr.14388) 9852 : cluster [DBG] pgmap v6828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:04.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:59:04.646 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:59:04.646 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:59:05.405 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:59:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:59:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:59:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:59:05.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:05 smithi163 bash[24253]: cluster 2024-08-31T05:59:04.297266+0000 mgr.a (mgr.14388) 9853 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:06.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:05 smithi027 bash[22610]: cluster 2024-08-31T05:59:04.297266+0000 mgr.a (mgr.14388) 9853 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:05 smithi191 bash[24992]: cluster 2024-08-31T05:59:04.297266+0000 mgr.a (mgr.14388) 9853 : cluster [DBG] pgmap v6829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:06 smithi163 bash[24253]: audit 2024-08-31T05:59:04.971523+0000 mgr.a (mgr.14388) 9854 : audit [DBG] from='client.218601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:06 smithi027 bash[22610]: audit 2024-08-31T05:59:04.971523+0000 mgr.a (mgr.14388) 9854 : audit [DBG] from='client.218601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:06 smithi191 bash[24992]: audit 2024-08-31T05:59:04.971523+0000 mgr.a (mgr.14388) 9854 : audit [DBG] from='client.218601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:07 smithi163 bash[24253]: cluster 2024-08-31T05:59:06.298264+0000 mgr.a (mgr.14388) 9855 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:07 smithi027 bash[22610]: cluster 2024-08-31T05:59:06.298264+0000 mgr.a (mgr.14388) 9855 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:07 smithi191 bash[24992]: cluster 2024-08-31T05:59:06.298264+0000 mgr.a (mgr.14388) 9855 : cluster [DBG] pgmap v6830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:08 smithi163 bash[24253]: cluster 2024-08-31T05:59:08.300551+0000 mgr.a (mgr.14388) 9856 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:08 smithi027 bash[22610]: cluster 2024-08-31T05:59:08.300551+0000 mgr.a (mgr.14388) 9856 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:08 smithi191 bash[24992]: cluster 2024-08-31T05:59:08.300551+0000 mgr.a (mgr.14388) 9856 : cluster [DBG] pgmap v6831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:10.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:59:10.408 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:59:10.408 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:59:11.188 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:59:11.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:59:11.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:59:11.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:59:11.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:11 smithi163 bash[24253]: cluster 2024-08-31T05:59:10.301324+0000 mgr.a (mgr.14388) 9857 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:11 smithi163 bash[24253]: audit 2024-08-31T05:59:10.748064+0000 mgr.a (mgr.14388) 9858 : audit [DBG] from='client.218679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:11 smithi027 bash[22610]: cluster 2024-08-31T05:59:10.301324+0000 mgr.a (mgr.14388) 9857 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:11 smithi027 bash[22610]: audit 2024-08-31T05:59:10.748064+0000 mgr.a (mgr.14388) 9858 : audit [DBG] from='client.218679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:11 smithi191 bash[24992]: cluster 2024-08-31T05:59:10.301324+0000 mgr.a (mgr.14388) 9857 : cluster [DBG] pgmap v6832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:11.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:11 smithi191 bash[24992]: audit 2024-08-31T05:59:10.748064+0000 mgr.a (mgr.14388) 9858 : audit [DBG] from='client.218679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:13 smithi163 bash[24253]: cluster 2024-08-31T05:59:12.302314+0000 mgr.a (mgr.14388) 9859 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:13 smithi027 bash[22610]: cluster 2024-08-31T05:59:12.302314+0000 mgr.a (mgr.14388) 9859 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:13 smithi191 bash[24992]: cluster 2024-08-31T05:59:12.302314+0000 mgr.a (mgr.14388) 9859 : cluster [DBG] pgmap v6833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:15 smithi163 bash[24253]: cluster 2024-08-31T05:59:14.304597+0000 mgr.a (mgr.14388) 9860 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:15 smithi027 bash[22610]: cluster 2024-08-31T05:59:14.304597+0000 mgr.a (mgr.14388) 9860 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:15 smithi191 bash[24992]: cluster 2024-08-31T05:59:14.304597+0000 mgr.a (mgr.14388) 9860 : cluster [DBG] pgmap v6834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T05:59:16.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:59:16.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:59:16.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:59:16.937 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:59:16.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:59:16.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:59:16.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:59:16.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:17 smithi163 bash[24253]: cluster 2024-08-31T05:59:16.305135+0000 mgr.a (mgr.14388) 9861 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:17 smithi163 bash[24253]: audit 2024-08-31T05:59:16.517488+0000 mgr.a (mgr.14388) 9862 : audit [DBG] from='client.218751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:17 smithi027 bash[22610]: cluster 2024-08-31T05:59:16.305135+0000 mgr.a (mgr.14388) 9861 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:17 smithi027 bash[22610]: audit 2024-08-31T05:59:16.517488+0000 mgr.a (mgr.14388) 9862 : audit [DBG] from='client.218751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:17 smithi191 bash[24992]: cluster 2024-08-31T05:59:16.305135+0000 mgr.a (mgr.14388) 9861 : cluster [DBG] pgmap v6835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:17 smithi191 bash[24992]: audit 2024-08-31T05:59:16.517488+0000 mgr.a (mgr.14388) 9862 : audit [DBG] from='client.218751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:19 smithi163 bash[24253]: cluster 2024-08-31T05:59:18.307538+0000 mgr.a (mgr.14388) 9863 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:19 smithi027 bash[22610]: cluster 2024-08-31T05:59:18.307538+0000 mgr.a (mgr.14388) 9863 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:19 smithi191 bash[24992]: cluster 2024-08-31T05:59:18.307538+0000 mgr.a (mgr.14388) 9863 : cluster [DBG] pgmap v6836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:21 smithi163 bash[24253]: cluster 2024-08-31T05:59:20.308369+0000 mgr.a (mgr.14388) 9864 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:21 smithi027 bash[22610]: cluster 2024-08-31T05:59:20.308369+0000 mgr.a (mgr.14388) 9864 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:21 smithi191 bash[24992]: cluster 2024-08-31T05:59:20.308369+0000 mgr.a (mgr.14388) 9864 : cluster [DBG] pgmap v6837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:21.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:59:21.939 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:59:21.939 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:59:22.709 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:59:22.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:59:22.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:59:22.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:59:22.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:23 smithi163 bash[24253]: audit 2024-08-31T05:59:22.272191+0000 mgr.a (mgr.14388) 9865 : audit [DBG] from='client.218829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:23 smithi163 bash[24253]: cluster 2024-08-31T05:59:22.309084+0000 mgr.a (mgr.14388) 9866 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:23 smithi027 bash[22610]: audit 2024-08-31T05:59:22.272191+0000 mgr.a (mgr.14388) 9865 : audit [DBG] from='client.218829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:23 smithi027 bash[22610]: cluster 2024-08-31T05:59:22.309084+0000 mgr.a (mgr.14388) 9866 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:23 smithi191 bash[24992]: audit 2024-08-31T05:59:22.272191+0000 mgr.a (mgr.14388) 9865 : audit [DBG] from='client.218829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:23.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:23 smithi191 bash[24992]: cluster 2024-08-31T05:59:22.309084+0000 mgr.a (mgr.14388) 9866 : cluster [DBG] pgmap v6838: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:25 smithi163 bash[24253]: cluster 2024-08-31T05:59:24.311556+0000 mgr.a (mgr.14388) 9867 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:25 smithi027 bash[22610]: cluster 2024-08-31T05:59:24.311556+0000 mgr.a (mgr.14388) 9867 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:25 smithi191 bash[24992]: cluster 2024-08-31T05:59:24.311556+0000 mgr.a (mgr.14388) 9867 : cluster [DBG] pgmap v6839: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:27 smithi163 bash[24253]: cluster 2024-08-31T05:59:26.312503+0000 mgr.a (mgr.14388) 9868 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:27.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:59:27.711 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:59:27.712 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:59:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:27 smithi027 bash[22610]: cluster 2024-08-31T05:59:26.312503+0000 mgr.a (mgr.14388) 9868 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:27.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:27 smithi191 bash[24992]: cluster 2024-08-31T05:59:26.312503+0000 mgr.a (mgr.14388) 9868 : cluster [DBG] pgmap v6840: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:28.461 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:59:28.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:59:28.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:59:28.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:59:28.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:29 smithi163 bash[24253]: audit 2024-08-31T05:59:28.034981+0000 mgr.a (mgr.14388) 9869 : audit [DBG] from='client.218904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:29 smithi163 bash[24253]: cluster 2024-08-31T05:59:28.313878+0000 mgr.a (mgr.14388) 9870 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:29 smithi027 bash[22610]: audit 2024-08-31T05:59:28.034981+0000 mgr.a (mgr.14388) 9869 : audit [DBG] from='client.218904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:29 smithi027 bash[22610]: cluster 2024-08-31T05:59:28.313878+0000 mgr.a (mgr.14388) 9870 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:29.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:29 smithi191 bash[24992]: audit 2024-08-31T05:59:28.034981+0000 mgr.a (mgr.14388) 9869 : audit [DBG] from='client.218904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:29.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:29 smithi191 bash[24992]: cluster 2024-08-31T05:59:28.313878+0000 mgr.a (mgr.14388) 9870 : cluster [DBG] pgmap v6841: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:31 smithi163 bash[24253]: cluster 2024-08-31T05:59:30.314768+0000 mgr.a (mgr.14388) 9871 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:59:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:31 smithi027 bash[22610]: cluster 2024-08-31T05:59:30.314768+0000 mgr.a (mgr.14388) 9871 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:59:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:31 smithi191 bash[24992]: cluster 2024-08-31T05:59:30.314768+0000 mgr.a (mgr.14388) 9871 : cluster [DBG] pgmap v6842: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T05:59:33.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:59:33.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:59:33.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:59:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:33 smithi163 bash[24253]: cluster 2024-08-31T05:59:32.315517+0000 mgr.a (mgr.14388) 9872 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:59:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:33 smithi027 bash[22610]: cluster 2024-08-31T05:59:32.315517+0000 mgr.a (mgr.14388) 9872 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:59:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:33 smithi191 bash[24992]: cluster 2024-08-31T05:59:32.315517+0000 mgr.a (mgr.14388) 9872 : cluster [DBG] pgmap v6843: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:59:34.241 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:59:34.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:59:34.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:59:34.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:59:34.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:34 smithi163 bash[24253]: audit 2024-08-31T05:59:33.798688+0000 mgr.a (mgr.14388) 9873 : audit [DBG] from='client.218982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:34 smithi027 bash[22610]: audit 2024-08-31T05:59:33.798688+0000 mgr.a (mgr.14388) 9873 : audit [DBG] from='client.218982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:34 smithi191 bash[24992]: audit 2024-08-31T05:59:33.798688+0000 mgr.a (mgr.14388) 9873 : audit [DBG] from='client.218982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:35 smithi163 bash[24253]: cluster 2024-08-31T05:59:34.316984+0000 mgr.a (mgr.14388) 9874 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:35 smithi027 bash[22610]: cluster 2024-08-31T05:59:34.316984+0000 mgr.a (mgr.14388) 9874 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:35 smithi191 bash[24992]: cluster 2024-08-31T05:59:34.316984+0000 mgr.a (mgr.14388) 9874 : cluster [DBG] pgmap v6844: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:37 smithi163 bash[24253]: cluster 2024-08-31T05:59:36.317709+0000 mgr.a (mgr.14388) 9875 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:59:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:37 smithi027 bash[22610]: cluster 2024-08-31T05:59:36.317709+0000 mgr.a (mgr.14388) 9875 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:59:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:37 smithi191 bash[24992]: cluster 2024-08-31T05:59:36.317709+0000 mgr.a (mgr.14388) 9875 : cluster [DBG] pgmap v6845: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T05:59:39.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:59:39.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:59:39.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:59:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:39 smithi163 bash[24253]: cluster 2024-08-31T05:59:38.319638+0000 mgr.a (mgr.14388) 9876 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:39 smithi027 bash[22610]: cluster 2024-08-31T05:59:38.319638+0000 mgr.a (mgr.14388) 9876 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:39 smithi191 bash[24992]: cluster 2024-08-31T05:59:38.319638+0000 mgr.a (mgr.14388) 9876 : cluster [DBG] pgmap v6846: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:40.029 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:59:40.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:59:40.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:59:40.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:59:40.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:40 smithi163 bash[24253]: audit 2024-08-31T05:59:39.580328+0000 mgr.a (mgr.14388) 9877 : audit [DBG] from='client.219057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:40 smithi027 bash[22610]: audit 2024-08-31T05:59:39.580328+0000 mgr.a (mgr.14388) 9877 : audit [DBG] from='client.219057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:40 smithi191 bash[24992]: audit 2024-08-31T05:59:39.580328+0000 mgr.a (mgr.14388) 9877 : audit [DBG] from='client.219057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:41 smithi163 bash[24253]: cluster 2024-08-31T05:59:40.320604+0000 mgr.a (mgr.14388) 9878 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:41 smithi027 bash[22610]: cluster 2024-08-31T05:59:40.320604+0000 mgr.a (mgr.14388) 9878 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:41 smithi191 bash[24992]: cluster 2024-08-31T05:59:40.320604+0000 mgr.a (mgr.14388) 9878 : cluster [DBG] pgmap v6847: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:43 smithi163 bash[24253]: cluster 2024-08-31T05:59:42.321428+0000 mgr.a (mgr.14388) 9879 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:43 smithi027 bash[22610]: cluster 2024-08-31T05:59:42.321428+0000 mgr.a (mgr.14388) 9879 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:43.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:43 smithi191 bash[24992]: cluster 2024-08-31T05:59:42.321428+0000 mgr.a (mgr.14388) 9879 : cluster [DBG] pgmap v6848: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:45.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:59:45.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:59:45.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:59:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:45 smithi027 bash[22610]: cluster 2024-08-31T05:59:44.323684+0000 mgr.a (mgr.14388) 9880 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:45.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:45 smithi191 bash[24992]: cluster 2024-08-31T05:59:44.323684+0000 mgr.a (mgr.14388) 9880 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:45.811 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:59:45.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:59:45.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:59:45.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:59:45.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:45 smithi163 bash[24253]: cluster 2024-08-31T05:59:44.323684+0000 mgr.a (mgr.14388) 9880 : cluster [DBG] pgmap v6849: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:46 smithi027 bash[22610]: audit 2024-08-31T05:59:45.368106+0000 mgr.a (mgr.14388) 9881 : audit [DBG] from='client.219135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:46 smithi191 bash[24992]: audit 2024-08-31T05:59:45.368106+0000 mgr.a (mgr.14388) 9881 : audit [DBG] from='client.219135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:46 smithi163 bash[24253]: audit 2024-08-31T05:59:45.368106+0000 mgr.a (mgr.14388) 9881 : audit [DBG] from='client.219135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:47 smithi027 bash[22610]: cluster 2024-08-31T05:59:46.324642+0000 mgr.a (mgr.14388) 9882 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:47 smithi191 bash[24992]: cluster 2024-08-31T05:59:46.324642+0000 mgr.a (mgr.14388) 9882 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:47 smithi163 bash[24253]: cluster 2024-08-31T05:59:46.324642+0000 mgr.a (mgr.14388) 9882 : cluster [DBG] pgmap v6850: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:49 smithi027 bash[22610]: cluster 2024-08-31T05:59:48.326834+0000 mgr.a (mgr.14388) 9883 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:49 smithi191 bash[24992]: cluster 2024-08-31T05:59:48.326834+0000 mgr.a (mgr.14388) 9883 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:49.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:49 smithi163 bash[24253]: cluster 2024-08-31T05:59:48.326834+0000 mgr.a (mgr.14388) 9883 : cluster [DBG] pgmap v6851: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:50.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:59:50.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:59:50.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:59:51.555 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:59:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:59:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:59:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:59:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:51 smithi027 bash[22610]: cluster 2024-08-31T05:59:50.327602+0000 mgr.a (mgr.14388) 9884 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:51 smithi191 bash[24992]: cluster 2024-08-31T05:59:50.327602+0000 mgr.a (mgr.14388) 9884 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:51 smithi163 bash[24253]: cluster 2024-08-31T05:59:50.327602+0000 mgr.a (mgr.14388) 9884 : cluster [DBG] pgmap v6852: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:52 smithi027 bash[22610]: audit 2024-08-31T05:59:51.144116+0000 mgr.a (mgr.14388) 9885 : audit [DBG] from='client.219213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:52 smithi191 bash[24992]: audit 2024-08-31T05:59:51.144116+0000 mgr.a (mgr.14388) 9885 : audit [DBG] from='client.219213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:52 smithi163 bash[24253]: audit 2024-08-31T05:59:51.144116+0000 mgr.a (mgr.14388) 9885 : audit [DBG] from='client.219213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:53 smithi191 bash[24992]: cluster 2024-08-31T05:59:52.328583+0000 mgr.a (mgr.14388) 9886 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:53 smithi163 bash[24253]: cluster 2024-08-31T05:59:52.328583+0000 mgr.a (mgr.14388) 9886 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:53 smithi027 bash[22610]: cluster 2024-08-31T05:59:52.328583+0000 mgr.a (mgr.14388) 9886 : cluster [DBG] pgmap v6853: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:55 smithi191 bash[24992]: cluster 2024-08-31T05:59:54.330856+0000 mgr.a (mgr.14388) 9887 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:55 smithi163 bash[24253]: cluster 2024-08-31T05:59:54.330856+0000 mgr.a (mgr.14388) 9887 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:55 smithi027 bash[22610]: cluster 2024-08-31T05:59:54.330856+0000 mgr.a (mgr.14388) 9887 : cluster [DBG] pgmap v6854: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:56.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T05:59:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T05:59:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T05:59:57.332 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T05:59:57.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T05:59:57.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T05:59:57.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T05:59:57.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T05:59:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:57 smithi191 bash[24992]: cluster 2024-08-31T05:59:56.331654+0000 mgr.a (mgr.14388) 9888 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:57 smithi163 bash[24253]: cluster 2024-08-31T05:59:56.331654+0000 mgr.a (mgr.14388) 9888 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:57 smithi027 bash[22610]: cluster 2024-08-31T05:59:56.331654+0000 mgr.a (mgr.14388) 9888 : cluster [DBG] pgmap v6855: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T05:59:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:58 smithi191 bash[24992]: audit 2024-08-31T05:59:56.888547+0000 mgr.a (mgr.14388) 9889 : audit [DBG] from='client.219285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:58 smithi163 bash[24253]: audit 2024-08-31T05:59:56.888547+0000 mgr.a (mgr.14388) 9889 : audit [DBG] from='client.219285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:58 smithi027 bash[22610]: audit 2024-08-31T05:59:56.888547+0000 mgr.a (mgr.14388) 9889 : audit [DBG] from='client.219285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:59:59.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:59 smithi191 bash[24992]: cluster 2024-08-31T05:59:58.333873+0000 mgr.a (mgr.14388) 9890 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:59.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:59 smithi191 bash[24992]: audit 2024-08-31T05:59:58.624550+0000 mon.a (mon.0) 2059 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:59:59.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:59 smithi191 bash[24992]: audit 2024-08-31T05:59:59.463001+0000 mon.a (mon.0) 2060 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:59:59.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:59 smithi191 bash[24992]: audit 2024-08-31T05:59:59.464822+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:59:59.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:59 smithi191 bash[24992]: audit 2024-08-31T05:59:59.475700+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:59:59.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 05:59:59 smithi191 bash[24992]: audit 2024-08-31T05:59:59.480693+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:59:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:59 smithi163 bash[24253]: cluster 2024-08-31T05:59:58.333873+0000 mgr.a (mgr.14388) 9890 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:59 smithi163 bash[24253]: audit 2024-08-31T05:59:58.624550+0000 mon.a (mon.0) 2059 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:59:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:59 smithi163 bash[24253]: audit 2024-08-31T05:59:59.463001+0000 mon.a (mon.0) 2060 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:59:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:59 smithi163 bash[24253]: audit 2024-08-31T05:59:59.464822+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:59:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:59 smithi163 bash[24253]: audit 2024-08-31T05:59:59.475700+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:59:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 05:59:59 smithi163 bash[24253]: audit 2024-08-31T05:59:59.480693+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T05:59:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:59 smithi027 bash[22610]: cluster 2024-08-31T05:59:58.333873+0000 mgr.a (mgr.14388) 9890 : cluster [DBG] pgmap v6856: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T05:59:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:59 smithi027 bash[22610]: audit 2024-08-31T05:59:58.624550+0000 mon.a (mon.0) 2059 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T05:59:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:59 smithi027 bash[22610]: audit 2024-08-31T05:59:59.463001+0000 mon.a (mon.0) 2060 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T05:59:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:59 smithi027 bash[22610]: audit 2024-08-31T05:59:59.464822+0000 mon.a (mon.0) 2061 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T05:59:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:59 smithi027 bash[22610]: audit 2024-08-31T05:59:59.475700+0000 mon.a (mon.0) 2062 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T05:59:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 05:59:59 smithi027 bash[22610]: audit 2024-08-31T05:59:59.480693+0000 mon.a (mon.0) 2063 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:00:00.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:00:00 smithi027 bash[22863]: debug 2024-08-31T06:00:00.208+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:00:00.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:00:00 smithi027 bash[22863]: debug 2024-08-31T06:00:00.208+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:00:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:00 smithi191 bash[24992]: audit 2024-08-31T05:59:59.483015+0000 mgr.a (mgr.14388) 9891 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:00:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:00 smithi191 bash[24992]: cluster 2024-08-31T06:00:00.000123+0000 mon.a (mon.0) 2064 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:00:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:00 smithi163 bash[24253]: audit 2024-08-31T05:59:59.483015+0000 mgr.a (mgr.14388) 9891 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:00:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:00 smithi163 bash[24253]: cluster 2024-08-31T06:00:00.000123+0000 mon.a (mon.0) 2064 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:00:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:00 smithi027 bash[22610]: audit 2024-08-31T05:59:59.483015+0000 mgr.a (mgr.14388) 9891 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:00:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:00 smithi027 bash[22610]: cluster 2024-08-31T06:00:00.000123+0000 mon.a (mon.0) 2064 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:00:01.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:01 smithi191 bash[24992]: audit 2024-08-31T06:00:00.211145+0000 mgr.a (mgr.14388) 9892 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:00:01.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:01 smithi191 bash[24992]: cephadm 2024-08-31T06:00:00.212617+0000 mgr.a (mgr.14388) 9893 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:00:01.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:01 smithi191 bash[24992]: cluster 2024-08-31T06:00:00.334840+0000 mgr.a (mgr.14388) 9894 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:01 smithi163 bash[24253]: audit 2024-08-31T06:00:00.211145+0000 mgr.a (mgr.14388) 9892 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:00:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:01 smithi163 bash[24253]: cephadm 2024-08-31T06:00:00.212617+0000 mgr.a (mgr.14388) 9893 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:00:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:01 smithi163 bash[24253]: cluster 2024-08-31T06:00:00.334840+0000 mgr.a (mgr.14388) 9894 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:01 smithi027 bash[22610]: audit 2024-08-31T06:00:00.211145+0000 mgr.a (mgr.14388) 9892 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:00:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:01 smithi027 bash[22610]: cephadm 2024-08-31T06:00:00.212617+0000 mgr.a (mgr.14388) 9893 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:00:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:01 smithi027 bash[22610]: cluster 2024-08-31T06:00:00.334840+0000 mgr.a (mgr.14388) 9894 : cluster [DBG] pgmap v6857: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:02.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:00:02.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:00:02.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:00:03.121 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:00:03.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:00:03.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:00:03.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:00:03.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:00:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:03 smithi191 bash[24992]: cluster 2024-08-31T06:00:02.335413+0000 mgr.a (mgr.14388) 9895 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:03 smithi191 bash[24992]: audit 2024-08-31T06:00:02.671677+0000 mgr.a (mgr.14388) 9896 : audit [DBG] from='client.219468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:03 smithi163 bash[24253]: cluster 2024-08-31T06:00:02.335413+0000 mgr.a (mgr.14388) 9895 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:03 smithi163 bash[24253]: audit 2024-08-31T06:00:02.671677+0000 mgr.a (mgr.14388) 9896 : audit [DBG] from='client.219468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:03 smithi027 bash[22610]: cluster 2024-08-31T06:00:02.335413+0000 mgr.a (mgr.14388) 9895 : cluster [DBG] pgmap v6858: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:03 smithi027 bash[22610]: audit 2024-08-31T06:00:02.671677+0000 mgr.a (mgr.14388) 9896 : audit [DBG] from='client.219468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:05 smithi191 bash[24992]: cluster 2024-08-31T06:00:04.338058+0000 mgr.a (mgr.14388) 9897 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:00:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:05 smithi163 bash[24253]: cluster 2024-08-31T06:00:04.338058+0000 mgr.a (mgr.14388) 9897 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:00:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:05 smithi027 bash[22610]: cluster 2024-08-31T06:00:04.338058+0000 mgr.a (mgr.14388) 9897 : cluster [DBG] pgmap v6859: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:00:07.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:07 smithi191 bash[24992]: cluster 2024-08-31T06:00:06.338884+0000 mgr.a (mgr.14388) 9898 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:00:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:07 smithi163 bash[24253]: cluster 2024-08-31T06:00:06.338884+0000 mgr.a (mgr.14388) 9898 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:00:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:07 smithi027 bash[22610]: cluster 2024-08-31T06:00:06.338884+0000 mgr.a (mgr.14388) 9898 : cluster [DBG] pgmap v6860: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:00:08.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:00:08.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:00:08.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:00:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:00:08.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:00:08.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:00:08.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:00:08.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:00:09.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:09 smithi191 bash[24992]: cluster 2024-08-31T06:00:08.340815+0000 mgr.a (mgr.14388) 9899 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:00:09.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:09 smithi191 bash[24992]: audit 2024-08-31T06:00:08.457583+0000 mgr.a (mgr.14388) 9900 : audit [DBG] from='client.219546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:09.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:09 smithi163 bash[24253]: cluster 2024-08-31T06:00:08.340815+0000 mgr.a (mgr.14388) 9899 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:00:09.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:09 smithi163 bash[24253]: audit 2024-08-31T06:00:08.457583+0000 mgr.a (mgr.14388) 9900 : audit [DBG] from='client.219546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:09 smithi027 bash[22610]: cluster 2024-08-31T06:00:08.340815+0000 mgr.a (mgr.14388) 9899 : cluster [DBG] pgmap v6861: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:00:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:09 smithi027 bash[22610]: audit 2024-08-31T06:00:08.457583+0000 mgr.a (mgr.14388) 9900 : audit [DBG] from='client.219546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:11 smithi191 bash[24992]: cluster 2024-08-31T06:00:10.341729+0000 mgr.a (mgr.14388) 9901 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:00:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:11 smithi163 bash[24253]: cluster 2024-08-31T06:00:10.341729+0000 mgr.a (mgr.14388) 9901 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:00:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:11 smithi027 bash[22610]: cluster 2024-08-31T06:00:10.341729+0000 mgr.a (mgr.14388) 9901 : cluster [DBG] pgmap v6862: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:00:13.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:00:13.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:00:13.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:00:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:13 smithi163 bash[24253]: cluster 2024-08-31T06:00:12.342573+0000 mgr.a (mgr.14388) 9902 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:00:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:13 smithi027 bash[22610]: cluster 2024-08-31T06:00:12.342573+0000 mgr.a (mgr.14388) 9902 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:00:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:13 smithi191 bash[24992]: cluster 2024-08-31T06:00:12.342573+0000 mgr.a (mgr.14388) 9902 : cluster [DBG] pgmap v6863: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:00:14.664 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:00:14.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:00:14.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:00:14.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:00:14.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:00:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:15 smithi163 bash[24253]: audit 2024-08-31T06:00:14.231726+0000 mgr.a (mgr.14388) 9903 : audit [DBG] from='client.219621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:15 smithi163 bash[24253]: cluster 2024-08-31T06:00:14.343796+0000 mgr.a (mgr.14388) 9904 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:00:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:15 smithi027 bash[22610]: audit 2024-08-31T06:00:14.231726+0000 mgr.a (mgr.14388) 9903 : audit [DBG] from='client.219621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:15 smithi027 bash[22610]: cluster 2024-08-31T06:00:14.343796+0000 mgr.a (mgr.14388) 9904 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:00:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:15 smithi191 bash[24992]: audit 2024-08-31T06:00:14.231726+0000 mgr.a (mgr.14388) 9903 : audit [DBG] from='client.219621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:15 smithi191 bash[24992]: cluster 2024-08-31T06:00:14.343796+0000 mgr.a (mgr.14388) 9904 : cluster [DBG] pgmap v6864: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:00:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:17 smithi163 bash[24253]: cluster 2024-08-31T06:00:16.344785+0000 mgr.a (mgr.14388) 9905 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:17 smithi027 bash[22610]: cluster 2024-08-31T06:00:16.344785+0000 mgr.a (mgr.14388) 9905 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:17 smithi191 bash[24992]: cluster 2024-08-31T06:00:16.344785+0000 mgr.a (mgr.14388) 9905 : cluster [DBG] pgmap v6865: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:00:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:00:19.666 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:00:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:19 smithi163 bash[24253]: cluster 2024-08-31T06:00:18.347151+0000 mgr.a (mgr.14388) 9906 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:19 smithi027 bash[22610]: cluster 2024-08-31T06:00:18.347151+0000 mgr.a (mgr.14388) 9906 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:19 smithi191 bash[24992]: cluster 2024-08-31T06:00:18.347151+0000 mgr.a (mgr.14388) 9906 : cluster [DBG] pgmap v6866: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:20.406 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:00:20.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:00:20.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:00:20.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:00:20.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:00:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:21 smithi163 bash[24253]: audit 2024-08-31T06:00:19.993575+0000 mgr.a (mgr.14388) 9907 : audit [DBG] from='client.219699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:21 smithi163 bash[24253]: cluster 2024-08-31T06:00:20.347845+0000 mgr.a (mgr.14388) 9908 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:21 smithi027 bash[22610]: audit 2024-08-31T06:00:19.993575+0000 mgr.a (mgr.14388) 9907 : audit [DBG] from='client.219699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:21 smithi027 bash[22610]: cluster 2024-08-31T06:00:20.347845+0000 mgr.a (mgr.14388) 9908 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:21 smithi191 bash[24992]: audit 2024-08-31T06:00:19.993575+0000 mgr.a (mgr.14388) 9907 : audit [DBG] from='client.219699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:21 smithi191 bash[24992]: cluster 2024-08-31T06:00:20.347845+0000 mgr.a (mgr.14388) 9908 : cluster [DBG] pgmap v6867: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:23 smithi163 bash[24253]: cluster 2024-08-31T06:00:22.348682+0000 mgr.a (mgr.14388) 9909 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:23 smithi027 bash[22610]: cluster 2024-08-31T06:00:22.348682+0000 mgr.a (mgr.14388) 9909 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:23 smithi191 bash[24992]: cluster 2024-08-31T06:00:22.348682+0000 mgr.a (mgr.14388) 9909 : cluster [DBG] pgmap v6868: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:25.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:00:25.409 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:00:25.409 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:00:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:25 smithi163 bash[24253]: cluster 2024-08-31T06:00:24.350945+0000 mgr.a (mgr.14388) 9910 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:25 smithi027 bash[22610]: cluster 2024-08-31T06:00:24.350945+0000 mgr.a (mgr.14388) 9910 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:25 smithi191 bash[24992]: cluster 2024-08-31T06:00:24.350945+0000 mgr.a (mgr.14388) 9910 : cluster [DBG] pgmap v6869: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:26.180 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:00:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:00:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:00:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:00:26.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:00:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:26 smithi163 bash[24253]: audit 2024-08-31T06:00:25.742217+0000 mgr.a (mgr.14388) 9911 : audit [DBG] from='client.219774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:26 smithi027 bash[22610]: audit 2024-08-31T06:00:25.742217+0000 mgr.a (mgr.14388) 9911 : audit [DBG] from='client.219774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:26 smithi191 bash[24992]: audit 2024-08-31T06:00:25.742217+0000 mgr.a (mgr.14388) 9911 : audit [DBG] from='client.219774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:27 smithi163 bash[24253]: cluster 2024-08-31T06:00:26.352119+0000 mgr.a (mgr.14388) 9912 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:27 smithi027 bash[22610]: cluster 2024-08-31T06:00:26.352119+0000 mgr.a (mgr.14388) 9912 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:27 smithi191 bash[24992]: cluster 2024-08-31T06:00:26.352119+0000 mgr.a (mgr.14388) 9912 : cluster [DBG] pgmap v6870: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:29 smithi163 bash[24253]: cluster 2024-08-31T06:00:28.354510+0000 mgr.a (mgr.14388) 9913 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:29 smithi027 bash[22610]: cluster 2024-08-31T06:00:28.354510+0000 mgr.a (mgr.14388) 9913 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:29 smithi191 bash[24992]: cluster 2024-08-31T06:00:28.354510+0000 mgr.a (mgr.14388) 9913 : cluster [DBG] pgmap v6871: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:31.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:00:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:00:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:00:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:31 smithi163 bash[24253]: cluster 2024-08-31T06:00:30.355463+0000 mgr.a (mgr.14388) 9914 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:31.955 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:00:31.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:00:31.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:00:31.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:00:31.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:00:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:31 smithi027 bash[22610]: cluster 2024-08-31T06:00:30.355463+0000 mgr.a (mgr.14388) 9914 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:31 smithi191 bash[24992]: cluster 2024-08-31T06:00:30.355463+0000 mgr.a (mgr.14388) 9914 : cluster [DBG] pgmap v6872: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:32 smithi163 bash[24253]: audit 2024-08-31T06:00:31.516714+0000 mgr.a (mgr.14388) 9915 : audit [DBG] from='client.219852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:32 smithi027 bash[22610]: audit 2024-08-31T06:00:31.516714+0000 mgr.a (mgr.14388) 9915 : audit [DBG] from='client.219852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:32 smithi191 bash[24992]: audit 2024-08-31T06:00:31.516714+0000 mgr.a (mgr.14388) 9915 : audit [DBG] from='client.219852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:33 smithi163 bash[24253]: cluster 2024-08-31T06:00:32.356454+0000 mgr.a (mgr.14388) 9916 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:33 smithi027 bash[22610]: cluster 2024-08-31T06:00:32.356454+0000 mgr.a (mgr.14388) 9916 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:33 smithi191 bash[24992]: cluster 2024-08-31T06:00:32.356454+0000 mgr.a (mgr.14388) 9916 : cluster [DBG] pgmap v6873: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:35 smithi163 bash[24253]: cluster 2024-08-31T06:00:34.358710+0000 mgr.a (mgr.14388) 9917 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:35 smithi027 bash[22610]: cluster 2024-08-31T06:00:34.358710+0000 mgr.a (mgr.14388) 9917 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:35 smithi191 bash[24992]: cluster 2024-08-31T06:00:34.358710+0000 mgr.a (mgr.14388) 9917 : cluster [DBG] pgmap v6874: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:36.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:00:36.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:00:36.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:00:37.740 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:00:37.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:00:37.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:00:37.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:00:37.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:00:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:37 smithi163 bash[24253]: cluster 2024-08-31T06:00:36.359500+0000 mgr.a (mgr.14388) 9918 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:37 smithi027 bash[22610]: cluster 2024-08-31T06:00:36.359500+0000 mgr.a (mgr.14388) 9918 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:37 smithi191 bash[24992]: cluster 2024-08-31T06:00:36.359500+0000 mgr.a (mgr.14388) 9918 : cluster [DBG] pgmap v6875: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:38 smithi163 bash[24253]: audit 2024-08-31T06:00:37.295198+0000 mgr.a (mgr.14388) 9919 : audit [DBG] from='client.219927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:38 smithi027 bash[22610]: audit 2024-08-31T06:00:37.295198+0000 mgr.a (mgr.14388) 9919 : audit [DBG] from='client.219927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:38 smithi191 bash[24992]: audit 2024-08-31T06:00:37.295198+0000 mgr.a (mgr.14388) 9919 : audit [DBG] from='client.219927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:39 smithi163 bash[24253]: cluster 2024-08-31T06:00:38.361780+0000 mgr.a (mgr.14388) 9920 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:39 smithi027 bash[22610]: cluster 2024-08-31T06:00:38.361780+0000 mgr.a (mgr.14388) 9920 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:39 smithi191 bash[24992]: cluster 2024-08-31T06:00:38.361780+0000 mgr.a (mgr.14388) 9920 : cluster [DBG] pgmap v6876: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:41 smithi163 bash[24253]: cluster 2024-08-31T06:00:40.362546+0000 mgr.a (mgr.14388) 9921 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:41.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:41 smithi027 bash[22610]: cluster 2024-08-31T06:00:40.362546+0000 mgr.a (mgr.14388) 9921 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:41 smithi191 bash[24992]: cluster 2024-08-31T06:00:40.362546+0000 mgr.a (mgr.14388) 9921 : cluster [DBG] pgmap v6877: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:42.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:00:42.743 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:00:42.743 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:00:43.493 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:00:43.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:00:43.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:00:43.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:00:43.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:00:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:43 smithi163 bash[24253]: cluster 2024-08-31T06:00:42.363333+0000 mgr.a (mgr.14388) 9922 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:43 smithi027 bash[22610]: cluster 2024-08-31T06:00:42.363333+0000 mgr.a (mgr.14388) 9922 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:43 smithi191 bash[24992]: cluster 2024-08-31T06:00:42.363333+0000 mgr.a (mgr.14388) 9922 : cluster [DBG] pgmap v6878: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:44 smithi163 bash[24253]: audit 2024-08-31T06:00:43.073892+0000 mgr.a (mgr.14388) 9923 : audit [DBG] from='client.219999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:44 smithi027 bash[22610]: audit 2024-08-31T06:00:43.073892+0000 mgr.a (mgr.14388) 9923 : audit [DBG] from='client.219999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:44 smithi191 bash[24992]: audit 2024-08-31T06:00:43.073892+0000 mgr.a (mgr.14388) 9923 : audit [DBG] from='client.219999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:45 smithi163 bash[24253]: cluster 2024-08-31T06:00:44.366202+0000 mgr.a (mgr.14388) 9924 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:45 smithi027 bash[22610]: cluster 2024-08-31T06:00:44.366202+0000 mgr.a (mgr.14388) 9924 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:45 smithi191 bash[24992]: cluster 2024-08-31T06:00:44.366202+0000 mgr.a (mgr.14388) 9924 : cluster [DBG] pgmap v6879: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:47 smithi163 bash[24253]: cluster 2024-08-31T06:00:46.367127+0000 mgr.a (mgr.14388) 9925 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:00:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:47 smithi027 bash[22610]: cluster 2024-08-31T06:00:46.367127+0000 mgr.a (mgr.14388) 9925 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:00:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:47 smithi191 bash[24992]: cluster 2024-08-31T06:00:46.367127+0000 mgr.a (mgr.14388) 9925 : cluster [DBG] pgmap v6880: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:00:48.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:00:48.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:00:48.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:00:49.240 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:00:49.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:00:49.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:00:49.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:00:49.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:00:49.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:49 smithi163 bash[24253]: cluster 2024-08-31T06:00:48.369214+0000 mgr.a (mgr.14388) 9926 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:49.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:49 smithi163 bash[24253]: audit 2024-08-31T06:00:48.824787+0000 mgr.a (mgr.14388) 9927 : audit [DBG] from='client.220071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:49 smithi027 bash[22610]: cluster 2024-08-31T06:00:48.369214+0000 mgr.a (mgr.14388) 9926 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:49 smithi027 bash[22610]: audit 2024-08-31T06:00:48.824787+0000 mgr.a (mgr.14388) 9927 : audit [DBG] from='client.220071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:49 smithi191 bash[24992]: cluster 2024-08-31T06:00:48.369214+0000 mgr.a (mgr.14388) 9926 : cluster [DBG] pgmap v6881: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:49 smithi191 bash[24992]: audit 2024-08-31T06:00:48.824787+0000 mgr.a (mgr.14388) 9927 : audit [DBG] from='client.220071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:51 smithi163 bash[24253]: cluster 2024-08-31T06:00:50.370107+0000 mgr.a (mgr.14388) 9928 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:00:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:51 smithi027 bash[22610]: cluster 2024-08-31T06:00:50.370107+0000 mgr.a (mgr.14388) 9928 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:00:52.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:51 smithi191 bash[24992]: cluster 2024-08-31T06:00:50.370107+0000 mgr.a (mgr.14388) 9928 : cluster [DBG] pgmap v6882: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:00:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:53 smithi163 bash[24253]: cluster 2024-08-31T06:00:52.370971+0000 mgr.a (mgr.14388) 9929 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:00:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:53 smithi027 bash[22610]: cluster 2024-08-31T06:00:52.370971+0000 mgr.a (mgr.14388) 9929 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:00:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:53 smithi191 bash[24992]: cluster 2024-08-31T06:00:52.370971+0000 mgr.a (mgr.14388) 9929 : cluster [DBG] pgmap v6883: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:00:54.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:00:54.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:00:54.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:00:55.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:00:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:00:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:00:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:00:55.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:00:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:55 smithi163 bash[24253]: cluster 2024-08-31T06:00:54.372361+0000 mgr.a (mgr.14388) 9930 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:55 smithi163 bash[24253]: audit 2024-08-31T06:00:54.578114+0000 mgr.a (mgr.14388) 9931 : audit [DBG] from='client.220149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:55 smithi027 bash[22610]: cluster 2024-08-31T06:00:54.372361+0000 mgr.a (mgr.14388) 9930 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:55 smithi027 bash[22610]: audit 2024-08-31T06:00:54.578114+0000 mgr.a (mgr.14388) 9931 : audit [DBG] from='client.220149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:55 smithi191 bash[24992]: cluster 2024-08-31T06:00:54.372361+0000 mgr.a (mgr.14388) 9930 : cluster [DBG] pgmap v6884: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:55 smithi191 bash[24992]: audit 2024-08-31T06:00:54.578114+0000 mgr.a (mgr.14388) 9931 : audit [DBG] from='client.220149 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:00:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:57 smithi163 bash[24253]: cluster 2024-08-31T06:00:56.373229+0000 mgr.a (mgr.14388) 9932 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:57 smithi027 bash[22610]: cluster 2024-08-31T06:00:56.373229+0000 mgr.a (mgr.14388) 9932 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:57 smithi191 bash[24992]: cluster 2024-08-31T06:00:56.373229+0000 mgr.a (mgr.14388) 9932 : cluster [DBG] pgmap v6885: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:00:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:00:59 smithi163 bash[24253]: cluster 2024-08-31T06:00:58.375421+0000 mgr.a (mgr.14388) 9933 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:00:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:00:59 smithi027 bash[22610]: cluster 2024-08-31T06:00:58.375421+0000 mgr.a (mgr.14388) 9933 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:00.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:00.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:00.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:00:59 smithi191 bash[24992]: cluster 2024-08-31T06:00:58.375421+0000 mgr.a (mgr.14388) 9933 : cluster [DBG] pgmap v6886: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:00.775 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:00.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:00.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:00.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:00.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:00 smithi163 bash[24253]: audit 2024-08-31T06:01:00.263858+0000 mon.a (mon.0) 2065 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:01:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:00 smithi027 bash[22610]: audit 2024-08-31T06:01:00.263858+0000 mon.a (mon.0) 2065 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:01:01.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:00 smithi191 bash[24992]: audit 2024-08-31T06:01:00.263858+0000 mon.a (mon.0) 2065 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:01:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:01 smithi163 bash[24253]: audit 2024-08-31T06:01:00.365145+0000 mgr.a (mgr.14388) 9934 : audit [DBG] from='client.220227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:01 smithi163 bash[24253]: cluster 2024-08-31T06:01:00.376351+0000 mgr.a (mgr.14388) 9935 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:01 smithi163 bash[24253]: audit 2024-08-31T06:01:01.046508+0000 mon.a (mon.0) 2066 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:01:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:01 smithi163 bash[24253]: audit 2024-08-31T06:01:01.048168+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:01:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:01 smithi163 bash[24253]: audit 2024-08-31T06:01:01.058517+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:01:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:01 smithi163 bash[24253]: audit 2024-08-31T06:01:01.063232+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:01:01.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:01:01 smithi027 bash[22863]: debug 2024-08-31T06:01:01.794+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:01:01.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:01:01 smithi027 bash[22863]: debug 2024-08-31T06:01:01.794+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:01:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:01 smithi027 bash[22610]: audit 2024-08-31T06:01:00.365145+0000 mgr.a (mgr.14388) 9934 : audit [DBG] from='client.220227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:01 smithi027 bash[22610]: cluster 2024-08-31T06:01:00.376351+0000 mgr.a (mgr.14388) 9935 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:01 smithi027 bash[22610]: audit 2024-08-31T06:01:01.046508+0000 mon.a (mon.0) 2066 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:01:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:01 smithi027 bash[22610]: audit 2024-08-31T06:01:01.048168+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:01:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:01 smithi027 bash[22610]: audit 2024-08-31T06:01:01.058517+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:01:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:01 smithi027 bash[22610]: audit 2024-08-31T06:01:01.063232+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:01:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:01 smithi191 bash[24992]: audit 2024-08-31T06:01:00.365145+0000 mgr.a (mgr.14388) 9934 : audit [DBG] from='client.220227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:01 smithi191 bash[24992]: cluster 2024-08-31T06:01:00.376351+0000 mgr.a (mgr.14388) 9935 : cluster [DBG] pgmap v6887: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:01 smithi191 bash[24992]: audit 2024-08-31T06:01:01.046508+0000 mon.a (mon.0) 2066 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:01:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:01 smithi191 bash[24992]: audit 2024-08-31T06:01:01.048168+0000 mon.a (mon.0) 2067 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:01:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:01 smithi191 bash[24992]: audit 2024-08-31T06:01:01.058517+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:01:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:01 smithi191 bash[24992]: audit 2024-08-31T06:01:01.063232+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:01:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:02 smithi163 bash[24253]: audit 2024-08-31T06:01:01.065938+0000 mgr.a (mgr.14388) 9936 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:01:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:02 smithi163 bash[24253]: audit 2024-08-31T06:01:01.795381+0000 mgr.a (mgr.14388) 9937 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:01:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:02 smithi163 bash[24253]: cephadm 2024-08-31T06:01:01.796689+0000 mgr.a (mgr.14388) 9938 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:01:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:02 smithi027 bash[22610]: audit 2024-08-31T06:01:01.065938+0000 mgr.a (mgr.14388) 9936 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:01:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:02 smithi027 bash[22610]: audit 2024-08-31T06:01:01.795381+0000 mgr.a (mgr.14388) 9937 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:01:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:02 smithi027 bash[22610]: cephadm 2024-08-31T06:01:01.796689+0000 mgr.a (mgr.14388) 9938 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:01:03.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:02 smithi191 bash[24992]: audit 2024-08-31T06:01:01.065938+0000 mgr.a (mgr.14388) 9936 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:01:03.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:02 smithi191 bash[24992]: audit 2024-08-31T06:01:01.795381+0000 mgr.a (mgr.14388) 9937 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:01:03.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:02 smithi191 bash[24992]: cephadm 2024-08-31T06:01:01.796689+0000 mgr.a (mgr.14388) 9938 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:01:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:03 smithi163 bash[24253]: cluster 2024-08-31T06:01:02.377369+0000 mgr.a (mgr.14388) 9939 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:03 smithi027 bash[22610]: cluster 2024-08-31T06:01:02.377369+0000 mgr.a (mgr.14388) 9939 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:03 smithi191 bash[24992]: cluster 2024-08-31T06:01:02.377369+0000 mgr.a (mgr.14388) 9939 : cluster [DBG] pgmap v6888: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:05.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:05.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:05.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:05 smithi163 bash[24253]: cluster 2024-08-31T06:01:04.379767+0000 mgr.a (mgr.14388) 9940 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:05 smithi027 bash[22610]: cluster 2024-08-31T06:01:04.379767+0000 mgr.a (mgr.14388) 9940 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:05 smithi191 bash[24992]: cluster 2024-08-31T06:01:04.379767+0000 mgr.a (mgr.14388) 9940 : cluster [DBG] pgmap v6889: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:06.530 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:06.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:06.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:06.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:06.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:07 smithi163 bash[24253]: audit 2024-08-31T06:01:06.107818+0000 mgr.a (mgr.14388) 9941 : audit [DBG] from='client.220413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:07 smithi163 bash[24253]: cluster 2024-08-31T06:01:06.380316+0000 mgr.a (mgr.14388) 9942 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:07 smithi027 bash[22610]: audit 2024-08-31T06:01:06.107818+0000 mgr.a (mgr.14388) 9941 : audit [DBG] from='client.220413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:07.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:07 smithi027 bash[22610]: cluster 2024-08-31T06:01:06.380316+0000 mgr.a (mgr.14388) 9942 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:07 smithi191 bash[24992]: audit 2024-08-31T06:01:06.107818+0000 mgr.a (mgr.14388) 9941 : audit [DBG] from='client.220413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:07 smithi191 bash[24992]: cluster 2024-08-31T06:01:06.380316+0000 mgr.a (mgr.14388) 9942 : cluster [DBG] pgmap v6890: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:09 smithi163 bash[24253]: cluster 2024-08-31T06:01:08.382707+0000 mgr.a (mgr.14388) 9943 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:09 smithi027 bash[22610]: cluster 2024-08-31T06:01:08.382707+0000 mgr.a (mgr.14388) 9943 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:09 smithi191 bash[24992]: cluster 2024-08-31T06:01:08.382707+0000 mgr.a (mgr.14388) 9943 : cluster [DBG] pgmap v6891: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:11.531 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:11.532 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:11.532 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:11 smithi163 bash[24253]: cluster 2024-08-31T06:01:10.383542+0000 mgr.a (mgr.14388) 9944 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:11 smithi027 bash[22610]: cluster 2024-08-31T06:01:10.383542+0000 mgr.a (mgr.14388) 9944 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:11 smithi191 bash[24992]: cluster 2024-08-31T06:01:10.383542+0000 mgr.a (mgr.14388) 9944 : cluster [DBG] pgmap v6892: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:12.309 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:12.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:12.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:12.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:12.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:13 smithi163 bash[24253]: audit 2024-08-31T06:01:11.865123+0000 mgr.a (mgr.14388) 9945 : audit [DBG] from='client.220491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:13 smithi163 bash[24253]: cluster 2024-08-31T06:01:12.384500+0000 mgr.a (mgr.14388) 9946 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:13 smithi027 bash[22610]: audit 2024-08-31T06:01:11.865123+0000 mgr.a (mgr.14388) 9945 : audit [DBG] from='client.220491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:13 smithi027 bash[22610]: cluster 2024-08-31T06:01:12.384500+0000 mgr.a (mgr.14388) 9946 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:13 smithi191 bash[24992]: audit 2024-08-31T06:01:11.865123+0000 mgr.a (mgr.14388) 9945 : audit [DBG] from='client.220491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:13.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:13 smithi191 bash[24992]: cluster 2024-08-31T06:01:12.384500+0000 mgr.a (mgr.14388) 9946 : cluster [DBG] pgmap v6893: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:15 smithi163 bash[24253]: cluster 2024-08-31T06:01:14.386770+0000 mgr.a (mgr.14388) 9947 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:15 smithi027 bash[22610]: cluster 2024-08-31T06:01:14.386770+0000 mgr.a (mgr.14388) 9947 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:15.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:15 smithi191 bash[24992]: cluster 2024-08-31T06:01:14.386770+0000 mgr.a (mgr.14388) 9947 : cluster [DBG] pgmap v6894: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:01:17.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:17.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:17.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:17 smithi027 bash[22610]: cluster 2024-08-31T06:01:16.387507+0000 mgr.a (mgr.14388) 9948 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:17 smithi191 bash[24992]: cluster 2024-08-31T06:01:16.387507+0000 mgr.a (mgr.14388) 9948 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:17 smithi163 bash[24253]: cluster 2024-08-31T06:01:16.387507+0000 mgr.a (mgr.14388) 9948 : cluster [DBG] pgmap v6895: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:18.072 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:18.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:18.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:18.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:18.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:18 smithi027 bash[22610]: audit 2024-08-31T06:01:17.643792+0000 mgr.a (mgr.14388) 9949 : audit [DBG] from='client.220566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:18 smithi191 bash[24992]: audit 2024-08-31T06:01:17.643792+0000 mgr.a (mgr.14388) 9949 : audit [DBG] from='client.220566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:18 smithi163 bash[24253]: audit 2024-08-31T06:01:17.643792+0000 mgr.a (mgr.14388) 9949 : audit [DBG] from='client.220566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:19.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:19 smithi027 bash[22610]: cluster 2024-08-31T06:01:18.390159+0000 mgr.a (mgr.14388) 9950 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:19.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:19 smithi191 bash[24992]: cluster 2024-08-31T06:01:18.390159+0000 mgr.a (mgr.14388) 9950 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:19 smithi163 bash[24253]: cluster 2024-08-31T06:01:18.390159+0000 mgr.a (mgr.14388) 9950 : cluster [DBG] pgmap v6896: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:21 smithi027 bash[22610]: cluster 2024-08-31T06:01:20.390999+0000 mgr.a (mgr.14388) 9951 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:01:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:21 smithi191 bash[24992]: cluster 2024-08-31T06:01:20.390999+0000 mgr.a (mgr.14388) 9951 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:01:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:21 smithi163 bash[24253]: cluster 2024-08-31T06:01:20.390999+0000 mgr.a (mgr.14388) 9951 : cluster [DBG] pgmap v6897: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:01:23.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:23.074 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:23.074 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:23 smithi027 bash[22610]: cluster 2024-08-31T06:01:22.391744+0000 mgr.a (mgr.14388) 9952 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:01:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:23 smithi191 bash[24992]: cluster 2024-08-31T06:01:22.391744+0000 mgr.a (mgr.14388) 9952 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:01:23.851 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:23.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:23.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:23.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:23.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:23 smithi163 bash[24253]: cluster 2024-08-31T06:01:22.391744+0000 mgr.a (mgr.14388) 9952 : cluster [DBG] pgmap v6898: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:01:24.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:24 smithi191 bash[24992]: audit 2024-08-31T06:01:23.409155+0000 mgr.a (mgr.14388) 9953 : audit [DBG] from='client.220644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:24.962 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:24 smithi163 bash[24253]: audit 2024-08-31T06:01:23.409155+0000 mgr.a (mgr.14388) 9953 : audit [DBG] from='client.220644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:24.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:24 smithi027 bash[22610]: audit 2024-08-31T06:01:23.409155+0000 mgr.a (mgr.14388) 9953 : audit [DBG] from='client.220644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:25 smithi191 bash[24992]: cluster 2024-08-31T06:01:24.394620+0000 mgr.a (mgr.14388) 9954 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:25 smithi163 bash[24253]: cluster 2024-08-31T06:01:24.394620+0000 mgr.a (mgr.14388) 9954 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:25 smithi027 bash[22610]: cluster 2024-08-31T06:01:24.394620+0000 mgr.a (mgr.14388) 9954 : cluster [DBG] pgmap v6899: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:27.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:27 smithi191 bash[24992]: cluster 2024-08-31T06:01:26.395608+0000 mgr.a (mgr.14388) 9955 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:01:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:27 smithi163 bash[24253]: cluster 2024-08-31T06:01:26.395608+0000 mgr.a (mgr.14388) 9955 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:01:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:27 smithi027 bash[22610]: cluster 2024-08-31T06:01:26.395608+0000 mgr.a (mgr.14388) 9955 : cluster [DBG] pgmap v6900: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:01:28.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:28.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:28.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:29.600 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:29 smithi191 bash[24992]: cluster 2024-08-31T06:01:28.397566+0000 mgr.a (mgr.14388) 9956 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:29 smithi163 bash[24253]: cluster 2024-08-31T06:01:28.397566+0000 mgr.a (mgr.14388) 9956 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:29 smithi027 bash[22610]: cluster 2024-08-31T06:01:28.397566+0000 mgr.a (mgr.14388) 9956 : cluster [DBG] pgmap v6901: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:30 smithi191 bash[24992]: audit 2024-08-31T06:01:29.184998+0000 mgr.a (mgr.14388) 9957 : audit [DBG] from='client.220722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:30 smithi163 bash[24253]: audit 2024-08-31T06:01:29.184998+0000 mgr.a (mgr.14388) 9957 : audit [DBG] from='client.220722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:30 smithi027 bash[22610]: audit 2024-08-31T06:01:29.184998+0000 mgr.a (mgr.14388) 9957 : audit [DBG] from='client.220722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:31 smithi191 bash[24992]: cluster 2024-08-31T06:01:30.398450+0000 mgr.a (mgr.14388) 9958 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:31 smithi163 bash[24253]: cluster 2024-08-31T06:01:30.398450+0000 mgr.a (mgr.14388) 9958 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:31 smithi027 bash[22610]: cluster 2024-08-31T06:01:30.398450+0000 mgr.a (mgr.14388) 9958 : cluster [DBG] pgmap v6902: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:33 smithi191 bash[24992]: cluster 2024-08-31T06:01:32.399240+0000 mgr.a (mgr.14388) 9959 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:33 smithi163 bash[24253]: cluster 2024-08-31T06:01:32.399240+0000 mgr.a (mgr.14388) 9959 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:33 smithi027 bash[22610]: cluster 2024-08-31T06:01:32.399240+0000 mgr.a (mgr.14388) 9959 : cluster [DBG] pgmap v6903: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:34.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:35.367 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:35.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:35.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:35.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:35.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:35 smithi191 bash[24992]: cluster 2024-08-31T06:01:34.401466+0000 mgr.a (mgr.14388) 9960 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:35.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:35 smithi163 bash[24253]: cluster 2024-08-31T06:01:34.401466+0000 mgr.a (mgr.14388) 9960 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:35 smithi027 bash[22610]: cluster 2024-08-31T06:01:34.401466+0000 mgr.a (mgr.14388) 9960 : cluster [DBG] pgmap v6904: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:36 smithi191 bash[24992]: audit 2024-08-31T06:01:34.937782+0000 mgr.a (mgr.14388) 9961 : audit [DBG] from='client.220800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:36 smithi163 bash[24253]: audit 2024-08-31T06:01:34.937782+0000 mgr.a (mgr.14388) 9961 : audit [DBG] from='client.220800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:36 smithi027 bash[22610]: audit 2024-08-31T06:01:34.937782+0000 mgr.a (mgr.14388) 9961 : audit [DBG] from='client.220800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:37 smithi191 bash[24992]: cluster 2024-08-31T06:01:36.402515+0000 mgr.a (mgr.14388) 9962 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:37 smithi163 bash[24253]: cluster 2024-08-31T06:01:36.402515+0000 mgr.a (mgr.14388) 9962 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:37 smithi027 bash[22610]: cluster 2024-08-31T06:01:36.402515+0000 mgr.a (mgr.14388) 9962 : cluster [DBG] pgmap v6905: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:39.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:39 smithi191 bash[24992]: cluster 2024-08-31T06:01:38.404694+0000 mgr.a (mgr.14388) 9963 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:39 smithi163 bash[24253]: cluster 2024-08-31T06:01:38.404694+0000 mgr.a (mgr.14388) 9963 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:39 smithi027 bash[22610]: cluster 2024-08-31T06:01:38.404694+0000 mgr.a (mgr.14388) 9963 : cluster [DBG] pgmap v6906: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:40.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:40.369 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:40.369 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:41.145 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:41.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:41.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:41.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:41.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:41 smithi191 bash[24992]: cluster 2024-08-31T06:01:40.405338+0000 mgr.a (mgr.14388) 9964 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:41 smithi191 bash[24992]: audit 2024-08-31T06:01:40.705989+0000 mgr.a (mgr.14388) 9965 : audit [DBG] from='client.220878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:41 smithi163 bash[24253]: cluster 2024-08-31T06:01:40.405338+0000 mgr.a (mgr.14388) 9964 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:41.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:41 smithi163 bash[24253]: audit 2024-08-31T06:01:40.705989+0000 mgr.a (mgr.14388) 9965 : audit [DBG] from='client.220878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:41 smithi027 bash[22610]: cluster 2024-08-31T06:01:40.405338+0000 mgr.a (mgr.14388) 9964 : cluster [DBG] pgmap v6907: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:41 smithi027 bash[22610]: audit 2024-08-31T06:01:40.705989+0000 mgr.a (mgr.14388) 9965 : audit [DBG] from='client.220878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:43 smithi163 bash[24253]: cluster 2024-08-31T06:01:42.406232+0000 mgr.a (mgr.14388) 9966 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:43 smithi027 bash[22610]: cluster 2024-08-31T06:01:42.406232+0000 mgr.a (mgr.14388) 9966 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:43 smithi191 bash[24992]: cluster 2024-08-31T06:01:42.406232+0000 mgr.a (mgr.14388) 9966 : cluster [DBG] pgmap v6908: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:45 smithi163 bash[24253]: cluster 2024-08-31T06:01:44.408488+0000 mgr.a (mgr.14388) 9967 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:45.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:45 smithi027 bash[22610]: cluster 2024-08-31T06:01:44.408488+0000 mgr.a (mgr.14388) 9967 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:46.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:45 smithi191 bash[24992]: cluster 2024-08-31T06:01:44.408488+0000 mgr.a (mgr.14388) 9967 : cluster [DBG] pgmap v6909: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:46.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:46.147 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:46.148 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:46.912 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:46.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:46.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:46.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:46.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:47 smithi163 bash[24253]: cluster 2024-08-31T06:01:46.409155+0000 mgr.a (mgr.14388) 9968 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:47 smithi163 bash[24253]: audit 2024-08-31T06:01:46.484072+0000 mgr.a (mgr.14388) 9969 : audit [DBG] from='client.220956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:47 smithi027 bash[22610]: cluster 2024-08-31T06:01:46.409155+0000 mgr.a (mgr.14388) 9968 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:47.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:47 smithi027 bash[22610]: audit 2024-08-31T06:01:46.484072+0000 mgr.a (mgr.14388) 9969 : audit [DBG] from='client.220956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:47 smithi191 bash[24992]: cluster 2024-08-31T06:01:46.409155+0000 mgr.a (mgr.14388) 9968 : cluster [DBG] pgmap v6910: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:47 smithi191 bash[24992]: audit 2024-08-31T06:01:46.484072+0000 mgr.a (mgr.14388) 9969 : audit [DBG] from='client.220956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:49 smithi163 bash[24253]: cluster 2024-08-31T06:01:48.411404+0000 mgr.a (mgr.14388) 9970 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:49 smithi027 bash[22610]: cluster 2024-08-31T06:01:48.411404+0000 mgr.a (mgr.14388) 9970 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:49 smithi191 bash[24992]: cluster 2024-08-31T06:01:48.411404+0000 mgr.a (mgr.14388) 9970 : cluster [DBG] pgmap v6911: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:51.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:51 smithi163 bash[24253]: cluster 2024-08-31T06:01:50.412200+0000 mgr.a (mgr.14388) 9971 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:51 smithi027 bash[22610]: cluster 2024-08-31T06:01:50.412200+0000 mgr.a (mgr.14388) 9971 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:52.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:51 smithi191 bash[24992]: cluster 2024-08-31T06:01:50.412200+0000 mgr.a (mgr.14388) 9971 : cluster [DBG] pgmap v6912: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:52.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:52.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:52.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:52.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:52.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:53 smithi163 bash[24253]: audit 2024-08-31T06:01:52.247471+0000 mgr.a (mgr.14388) 9972 : audit [DBG] from='client.221034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:53 smithi163 bash[24253]: cluster 2024-08-31T06:01:52.412755+0000 mgr.a (mgr.14388) 9973 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:53 smithi027 bash[22610]: audit 2024-08-31T06:01:52.247471+0000 mgr.a (mgr.14388) 9972 : audit [DBG] from='client.221034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:53 smithi027 bash[22610]: cluster 2024-08-31T06:01:52.412755+0000 mgr.a (mgr.14388) 9973 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:53 smithi191 bash[24992]: audit 2024-08-31T06:01:52.247471+0000 mgr.a (mgr.14388) 9972 : audit [DBG] from='client.221034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:54.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:53 smithi191 bash[24992]: cluster 2024-08-31T06:01:52.412755+0000 mgr.a (mgr.14388) 9973 : cluster [DBG] pgmap v6913: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:55 smithi163 bash[24253]: cluster 2024-08-31T06:01:54.415128+0000 mgr.a (mgr.14388) 9974 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:55 smithi027 bash[22610]: cluster 2024-08-31T06:01:54.415128+0000 mgr.a (mgr.14388) 9974 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:55 smithi191 bash[24992]: cluster 2024-08-31T06:01:54.415128+0000 mgr.a (mgr.14388) 9974 : cluster [DBG] pgmap v6914: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:01:57.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:01:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:01:57.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:01:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:57 smithi163 bash[24253]: cluster 2024-08-31T06:01:56.415901+0000 mgr.a (mgr.14388) 9975 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:57 smithi027 bash[22610]: cluster 2024-08-31T06:01:56.415901+0000 mgr.a (mgr.14388) 9975 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:57 smithi191 bash[24992]: cluster 2024-08-31T06:01:56.415901+0000 mgr.a (mgr.14388) 9975 : cluster [DBG] pgmap v6915: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:58.438 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:01:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:01:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:01:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:01:58.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:01:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:59 smithi163 bash[24253]: audit 2024-08-31T06:01:58.010290+0000 mgr.a (mgr.14388) 9976 : audit [DBG] from='client.221106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:01:59 smithi163 bash[24253]: cluster 2024-08-31T06:01:58.417362+0000 mgr.a (mgr.14388) 9977 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:01:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:59 smithi027 bash[22610]: audit 2024-08-31T06:01:58.010290+0000 mgr.a (mgr.14388) 9976 : audit [DBG] from='client.221106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:01:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:01:59 smithi027 bash[22610]: cluster 2024-08-31T06:01:58.417362+0000 mgr.a (mgr.14388) 9977 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:59 smithi191 bash[24992]: audit 2024-08-31T06:01:58.010290+0000 mgr.a (mgr.14388) 9976 : audit [DBG] from='client.221106 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:01:59 smithi191 bash[24992]: cluster 2024-08-31T06:01:58.417362+0000 mgr.a (mgr.14388) 9977 : cluster [DBG] pgmap v6916: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:01 smithi163 bash[24253]: cluster 2024-08-31T06:02:00.418115+0000 mgr.a (mgr.14388) 9978 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:02:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:01 smithi027 bash[22610]: cluster 2024-08-31T06:02:00.418115+0000 mgr.a (mgr.14388) 9978 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:02:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:01 smithi191 bash[24992]: cluster 2024-08-31T06:02:00.418115+0000 mgr.a (mgr.14388) 9978 : cluster [DBG] pgmap v6917: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:02:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:02 smithi163 bash[24253]: audit 2024-08-31T06:02:01.848192+0000 mon.a (mon.0) 2070 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:02:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:02 smithi027 bash[22610]: audit 2024-08-31T06:02:01.848192+0000 mon.a (mon.0) 2070 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:02:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:02 smithi191 bash[24992]: audit 2024-08-31T06:02:01.848192+0000 mon.a (mon.0) 2070 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:02:03.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:02:03.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:02:03.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:02:03.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:02:03 smithi027 bash[22863]: debug 2024-08-31T06:02:03.416+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:02:03.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:02:03 smithi027 bash[22863]: debug 2024-08-31T06:02:03.416+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:02:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:03 smithi027 bash[22610]: cluster 2024-08-31T06:02:02.418877+0000 mgr.a (mgr.14388) 9979 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:02:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:03 smithi027 bash[22610]: audit 2024-08-31T06:02:02.688275+0000 mon.a (mon.0) 2071 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:02:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:03 smithi027 bash[22610]: audit 2024-08-31T06:02:02.689806+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:02:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:03 smithi027 bash[22610]: audit 2024-08-31T06:02:02.698321+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:02:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:03 smithi027 bash[22610]: audit 2024-08-31T06:02:02.700806+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:02:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:03 smithi027 bash[22610]: audit 2024-08-31T06:02:02.703119+0000 mgr.a (mgr.14388) 9980 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:02:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:03 smithi163 bash[24253]: cluster 2024-08-31T06:02:02.418877+0000 mgr.a (mgr.14388) 9979 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:02:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:03 smithi163 bash[24253]: audit 2024-08-31T06:02:02.688275+0000 mon.a (mon.0) 2071 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:02:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:03 smithi163 bash[24253]: audit 2024-08-31T06:02:02.689806+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:02:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:03 smithi163 bash[24253]: audit 2024-08-31T06:02:02.698321+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:02:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:03 smithi163 bash[24253]: audit 2024-08-31T06:02:02.700806+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:02:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:03 smithi163 bash[24253]: audit 2024-08-31T06:02:02.703119+0000 mgr.a (mgr.14388) 9980 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:02:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:03 smithi191 bash[24992]: cluster 2024-08-31T06:02:02.418877+0000 mgr.a (mgr.14388) 9979 : cluster [DBG] pgmap v6918: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:02:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:03 smithi191 bash[24992]: audit 2024-08-31T06:02:02.688275+0000 mon.a (mon.0) 2071 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:02:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:03 smithi191 bash[24992]: audit 2024-08-31T06:02:02.689806+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:02:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:03 smithi191 bash[24992]: audit 2024-08-31T06:02:02.698321+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:02:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:03 smithi191 bash[24992]: audit 2024-08-31T06:02:02.700806+0000 mon.a (mon.0) 2074 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:02:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:03 smithi191 bash[24992]: audit 2024-08-31T06:02:02.703119+0000 mgr.a (mgr.14388) 9980 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:02:04.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:02:04.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:02:04.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:02:04.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:02:04.184 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:02:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:04 smithi163 bash[24253]: audit 2024-08-31T06:02:03.421495+0000 mgr.a (mgr.14388) 9981 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:02:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:04 smithi163 bash[24253]: cephadm 2024-08-31T06:02:03.422675+0000 mgr.a (mgr.14388) 9982 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:02:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:04 smithi163 bash[24253]: audit 2024-08-31T06:02:03.755269+0000 mgr.a (mgr.14388) 9983 : audit [DBG] from='client.221292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:04 smithi027 bash[22610]: audit 2024-08-31T06:02:03.421495+0000 mgr.a (mgr.14388) 9981 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:02:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:04 smithi027 bash[22610]: cephadm 2024-08-31T06:02:03.422675+0000 mgr.a (mgr.14388) 9982 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:02:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:04 smithi027 bash[22610]: audit 2024-08-31T06:02:03.755269+0000 mgr.a (mgr.14388) 9983 : audit [DBG] from='client.221292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:04 smithi191 bash[24992]: audit 2024-08-31T06:02:03.421495+0000 mgr.a (mgr.14388) 9981 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:02:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:04 smithi191 bash[24992]: cephadm 2024-08-31T06:02:03.422675+0000 mgr.a (mgr.14388) 9982 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:02:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:04 smithi191 bash[24992]: audit 2024-08-31T06:02:03.755269+0000 mgr.a (mgr.14388) 9983 : audit [DBG] from='client.221292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:05 smithi163 bash[24253]: cluster 2024-08-31T06:02:04.421581+0000 mgr.a (mgr.14388) 9984 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:02:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:05 smithi027 bash[22610]: cluster 2024-08-31T06:02:04.421581+0000 mgr.a (mgr.14388) 9984 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:02:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:05 smithi191 bash[24992]: cluster 2024-08-31T06:02:04.421581+0000 mgr.a (mgr.14388) 9984 : cluster [DBG] pgmap v6919: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:02:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:07 smithi163 bash[24253]: cluster 2024-08-31T06:02:06.422393+0000 mgr.a (mgr.14388) 9985 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:02:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:07 smithi027 bash[22610]: cluster 2024-08-31T06:02:06.422393+0000 mgr.a (mgr.14388) 9985 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:02:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:07 smithi191 bash[24992]: cluster 2024-08-31T06:02:06.422393+0000 mgr.a (mgr.14388) 9985 : cluster [DBG] pgmap v6920: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:02:09.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:02:09.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:02:09.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:02:09.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:09 smithi163 bash[24253]: cluster 2024-08-31T06:02:08.424475+0000 mgr.a (mgr.14388) 9986 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:09.964 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:02:09.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:02:09.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:02:09.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:02:09.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:02:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:09 smithi027 bash[22610]: cluster 2024-08-31T06:02:08.424475+0000 mgr.a (mgr.14388) 9986 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:10.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:09 smithi191 bash[24992]: cluster 2024-08-31T06:02:08.424475+0000 mgr.a (mgr.14388) 9986 : cluster [DBG] pgmap v6921: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:10 smithi163 bash[24253]: audit 2024-08-31T06:02:09.520702+0000 mgr.a (mgr.14388) 9987 : audit [DBG] from='client.221370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:10 smithi027 bash[22610]: audit 2024-08-31T06:02:09.520702+0000 mgr.a (mgr.14388) 9987 : audit [DBG] from='client.221370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:10 smithi191 bash[24992]: audit 2024-08-31T06:02:09.520702+0000 mgr.a (mgr.14388) 9987 : audit [DBG] from='client.221370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:11 smithi163 bash[24253]: cluster 2024-08-31T06:02:10.425514+0000 mgr.a (mgr.14388) 9988 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:11 smithi027 bash[22610]: cluster 2024-08-31T06:02:10.425514+0000 mgr.a (mgr.14388) 9988 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:11 smithi191 bash[24992]: cluster 2024-08-31T06:02:10.425514+0000 mgr.a (mgr.14388) 9988 : cluster [DBG] pgmap v6922: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:13 smithi163 bash[24253]: cluster 2024-08-31T06:02:12.426322+0000 mgr.a (mgr.14388) 9989 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:13 smithi027 bash[22610]: cluster 2024-08-31T06:02:12.426322+0000 mgr.a (mgr.14388) 9989 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:13 smithi191 bash[24992]: cluster 2024-08-31T06:02:12.426322+0000 mgr.a (mgr.14388) 9989 : cluster [DBG] pgmap v6923: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:14.966 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:02:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:02:14.967 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:02:15.750 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:02:15.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:02:15.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:02:15.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:02:15.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:02:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:15 smithi163 bash[24253]: cluster 2024-08-31T06:02:14.428547+0000 mgr.a (mgr.14388) 9990 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:15 smithi027 bash[22610]: cluster 2024-08-31T06:02:14.428547+0000 mgr.a (mgr.14388) 9990 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:15 smithi191 bash[24992]: cluster 2024-08-31T06:02:14.428547+0000 mgr.a (mgr.14388) 9990 : cluster [DBG] pgmap v6924: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:16 smithi163 bash[24253]: audit 2024-08-31T06:02:15.305431+0000 mgr.a (mgr.14388) 9991 : audit [DBG] from='client.221448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:16 smithi027 bash[22610]: audit 2024-08-31T06:02:15.305431+0000 mgr.a (mgr.14388) 9991 : audit [DBG] from='client.221448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:17.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:16 smithi191 bash[24992]: audit 2024-08-31T06:02:15.305431+0000 mgr.a (mgr.14388) 9991 : audit [DBG] from='client.221448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:17 smithi163 bash[24253]: cluster 2024-08-31T06:02:16.429519+0000 mgr.a (mgr.14388) 9992 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:02:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:17 smithi027 bash[22610]: cluster 2024-08-31T06:02:16.429519+0000 mgr.a (mgr.14388) 9992 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:02:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:17 smithi191 bash[24992]: cluster 2024-08-31T06:02:16.429519+0000 mgr.a (mgr.14388) 9992 : cluster [DBG] pgmap v6925: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:02:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:19 smithi163 bash[24253]: cluster 2024-08-31T06:02:18.431833+0000 mgr.a (mgr.14388) 9993 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:20.012 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:19 smithi027 bash[22610]: cluster 2024-08-31T06:02:18.431833+0000 mgr.a (mgr.14388) 9993 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:20.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:19 smithi191 bash[24992]: cluster 2024-08-31T06:02:18.431833+0000 mgr.a (mgr.14388) 9993 : cluster [DBG] pgmap v6926: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:02:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:02:20.753 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:02:20.753 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:02:21.518 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:02:21.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:02:21.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:02:21.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:02:21.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:02:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:21 smithi163 bash[24253]: cluster 2024-08-31T06:02:20.432724+0000 mgr.a (mgr.14388) 9994 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:21 smithi027 bash[22610]: cluster 2024-08-31T06:02:20.432724+0000 mgr.a (mgr.14388) 9994 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:21 smithi191 bash[24992]: cluster 2024-08-31T06:02:20.432724+0000 mgr.a (mgr.14388) 9994 : cluster [DBG] pgmap v6927: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:22.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:22 smithi163 bash[24253]: audit 2024-08-31T06:02:21.083783+0000 mgr.a (mgr.14388) 9995 : audit [DBG] from='client.221520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:22 smithi027 bash[22610]: audit 2024-08-31T06:02:21.083783+0000 mgr.a (mgr.14388) 9995 : audit [DBG] from='client.221520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:22 smithi191 bash[24992]: audit 2024-08-31T06:02:21.083783+0000 mgr.a (mgr.14388) 9995 : audit [DBG] from='client.221520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:23 smithi163 bash[24253]: cluster 2024-08-31T06:02:22.433729+0000 mgr.a (mgr.14388) 9996 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:23 smithi027 bash[22610]: cluster 2024-08-31T06:02:22.433729+0000 mgr.a (mgr.14388) 9996 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:24.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:23 smithi191 bash[24992]: cluster 2024-08-31T06:02:22.433729+0000 mgr.a (mgr.14388) 9996 : cluster [DBG] pgmap v6928: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:25 smithi163 bash[24253]: cluster 2024-08-31T06:02:24.436013+0000 mgr.a (mgr.14388) 9997 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:02:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:25 smithi027 bash[22610]: cluster 2024-08-31T06:02:24.436013+0000 mgr.a (mgr.14388) 9997 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:02:26.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:25 smithi191 bash[24992]: cluster 2024-08-31T06:02:24.436013+0000 mgr.a (mgr.14388) 9997 : cluster [DBG] pgmap v6929: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:02:26.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:02:26.520 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:02:26.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:02:27.306 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:02:27.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:02:27.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:02:27.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:02:27.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:02:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:27 smithi163 bash[24253]: cluster 2024-08-31T06:02:26.436766+0000 mgr.a (mgr.14388) 9998 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:27 smithi163 bash[24253]: audit 2024-08-31T06:02:26.863323+0000 mgr.a (mgr.14388) 9999 : audit [DBG] from='client.221592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:27 smithi027 bash[22610]: cluster 2024-08-31T06:02:26.436766+0000 mgr.a (mgr.14388) 9998 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:27 smithi027 bash[22610]: audit 2024-08-31T06:02:26.863323+0000 mgr.a (mgr.14388) 9999 : audit [DBG] from='client.221592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:27 smithi191 bash[24992]: cluster 2024-08-31T06:02:26.436766+0000 mgr.a (mgr.14388) 9998 : cluster [DBG] pgmap v6930: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:27 smithi191 bash[24992]: audit 2024-08-31T06:02:26.863323+0000 mgr.a (mgr.14388) 9999 : audit [DBG] from='client.221592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:29.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:29 smithi163 bash[24253]: cluster 2024-08-31T06:02:28.439086+0000 mgr.a (mgr.14388) 10000 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:02:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:29 smithi027 bash[22610]: cluster 2024-08-31T06:02:28.439086+0000 mgr.a (mgr.14388) 10000 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:02:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:29 smithi191 bash[24992]: cluster 2024-08-31T06:02:28.439086+0000 mgr.a (mgr.14388) 10000 : cluster [DBG] pgmap v6931: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:02:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:31 smithi163 bash[24253]: cluster 2024-08-31T06:02:30.439870+0000 mgr.a (mgr.14388) 10001 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:31 smithi027 bash[22610]: cluster 2024-08-31T06:02:30.439870+0000 mgr.a (mgr.14388) 10001 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:32.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:31 smithi191 bash[24992]: cluster 2024-08-31T06:02:30.439870+0000 mgr.a (mgr.14388) 10001 : cluster [DBG] pgmap v6932: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:32.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:02:32.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:02:32.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:02:33.056 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:02:33.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:02:33.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:02:33.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:02:33.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:02:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:33 smithi163 bash[24253]: cluster 2024-08-31T06:02:32.440331+0000 mgr.a (mgr.14388) 10002 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:33 smithi163 bash[24253]: audit 2024-08-31T06:02:32.642117+0000 mgr.a (mgr.14388) 10003 : audit [DBG] from='client.221670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:33.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:33 smithi027 bash[22610]: cluster 2024-08-31T06:02:32.440331+0000 mgr.a (mgr.14388) 10002 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:33.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:33 smithi027 bash[22610]: audit 2024-08-31T06:02:32.642117+0000 mgr.a (mgr.14388) 10003 : audit [DBG] from='client.221670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:34.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:33 smithi191 bash[24992]: cluster 2024-08-31T06:02:32.440331+0000 mgr.a (mgr.14388) 10002 : cluster [DBG] pgmap v6933: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:34.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:33 smithi191 bash[24992]: audit 2024-08-31T06:02:32.642117+0000 mgr.a (mgr.14388) 10003 : audit [DBG] from='client.221670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:35 smithi163 bash[24253]: cluster 2024-08-31T06:02:34.443102+0000 mgr.a (mgr.14388) 10004 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:35.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:35 smithi027 bash[22610]: cluster 2024-08-31T06:02:34.443102+0000 mgr.a (mgr.14388) 10004 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:36.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:35 smithi191 bash[24992]: cluster 2024-08-31T06:02:34.443102+0000 mgr.a (mgr.14388) 10004 : cluster [DBG] pgmap v6934: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:02:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:37 smithi163 bash[24253]: cluster 2024-08-31T06:02:36.443899+0000 mgr.a (mgr.14388) 10005 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:02:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:37 smithi027 bash[22610]: cluster 2024-08-31T06:02:36.443899+0000 mgr.a (mgr.14388) 10005 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:02:38.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:37 smithi191 bash[24992]: cluster 2024-08-31T06:02:36.443899+0000 mgr.a (mgr.14388) 10005 : cluster [DBG] pgmap v6935: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:02:38.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:02:38.058 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:02:38.059 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:02:38.798 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:02:38.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:02:38.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:02:38.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:02:38.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:02:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:39 smithi163 bash[24253]: audit 2024-08-31T06:02:38.386973+0000 mgr.a (mgr.14388) 10006 : audit [DBG] from='client.221748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:39 smithi163 bash[24253]: cluster 2024-08-31T06:02:38.445741+0000 mgr.a (mgr.14388) 10007 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:02:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:39 smithi027 bash[22610]: audit 2024-08-31T06:02:38.386973+0000 mgr.a (mgr.14388) 10006 : audit [DBG] from='client.221748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:39 smithi027 bash[22610]: cluster 2024-08-31T06:02:38.445741+0000 mgr.a (mgr.14388) 10007 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:02:40.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:39 smithi191 bash[24992]: audit 2024-08-31T06:02:38.386973+0000 mgr.a (mgr.14388) 10006 : audit [DBG] from='client.221748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:40.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:39 smithi191 bash[24992]: cluster 2024-08-31T06:02:38.445741+0000 mgr.a (mgr.14388) 10007 : cluster [DBG] pgmap v6936: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:02:41.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:41 smithi027 bash[22610]: cluster 2024-08-31T06:02:40.446642+0000 mgr.a (mgr.14388) 10008 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T06:02:42.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:41 smithi191 bash[24992]: cluster 2024-08-31T06:02:40.446642+0000 mgr.a (mgr.14388) 10008 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T06:02:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:41 smithi163 bash[24253]: cluster 2024-08-31T06:02:40.446642+0000 mgr.a (mgr.14388) 10008 : cluster [DBG] pgmap v6937: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T06:02:43.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:02:43.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:02:43.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:02:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:43 smithi027 bash[22610]: cluster 2024-08-31T06:02:42.447463+0000 mgr.a (mgr.14388) 10009 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T06:02:44.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:43 smithi191 bash[24992]: cluster 2024-08-31T06:02:42.447463+0000 mgr.a (mgr.14388) 10009 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T06:02:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:43 smithi163 bash[24253]: cluster 2024-08-31T06:02:42.447463+0000 mgr.a (mgr.14388) 10009 : cluster [DBG] pgmap v6938: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T06:02:44.533 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:02:44.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:02:44.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:02:44.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:02:44.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:02:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:45 smithi027 bash[22610]: audit 2024-08-31T06:02:44.128209+0000 mgr.a (mgr.14388) 10010 : audit [DBG] from='client.221823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:45 smithi027 bash[22610]: cluster 2024-08-31T06:02:44.448748+0000 mgr.a (mgr.14388) 10011 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:02:46.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:45 smithi191 bash[24992]: audit 2024-08-31T06:02:44.128209+0000 mgr.a (mgr.14388) 10010 : audit [DBG] from='client.221823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:46.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:45 smithi191 bash[24992]: cluster 2024-08-31T06:02:44.448748+0000 mgr.a (mgr.14388) 10011 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:02:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:45 smithi163 bash[24253]: audit 2024-08-31T06:02:44.128209+0000 mgr.a (mgr.14388) 10010 : audit [DBG] from='client.221823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:45 smithi163 bash[24253]: cluster 2024-08-31T06:02:44.448748+0000 mgr.a (mgr.14388) 10011 : cluster [DBG] pgmap v6939: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:02:47.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:47 smithi027 bash[22610]: cluster 2024-08-31T06:02:46.449514+0000 mgr.a (mgr.14388) 10012 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:02:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:47 smithi191 bash[24992]: cluster 2024-08-31T06:02:46.449514+0000 mgr.a (mgr.14388) 10012 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:02:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:47 smithi163 bash[24253]: cluster 2024-08-31T06:02:46.449514+0000 mgr.a (mgr.14388) 10012 : cluster [DBG] pgmap v6940: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:02:49.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:02:49.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:02:49.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:02:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:49 smithi027 bash[22610]: cluster 2024-08-31T06:02:48.451469+0000 mgr.a (mgr.14388) 10013 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:02:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:49 smithi191 bash[24992]: cluster 2024-08-31T06:02:48.451469+0000 mgr.a (mgr.14388) 10013 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:02:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:49 smithi163 bash[24253]: cluster 2024-08-31T06:02:48.451469+0000 mgr.a (mgr.14388) 10013 : cluster [DBG] pgmap v6941: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:02:50.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:02:50.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:02:50.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:02:50.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:02:50.311 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:02:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:50 smithi027 bash[22610]: audit 2024-08-31T06:02:49.870791+0000 mgr.a (mgr.14388) 10014 : audit [DBG] from='client.221901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:50 smithi191 bash[24992]: audit 2024-08-31T06:02:49.870791+0000 mgr.a (mgr.14388) 10014 : audit [DBG] from='client.221901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:50 smithi163 bash[24253]: audit 2024-08-31T06:02:49.870791+0000 mgr.a (mgr.14388) 10014 : audit [DBG] from='client.221901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:51 smithi027 bash[22610]: cluster 2024-08-31T06:02:50.452422+0000 mgr.a (mgr.14388) 10015 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:51 smithi191 bash[24992]: cluster 2024-08-31T06:02:50.452422+0000 mgr.a (mgr.14388) 10015 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:51 smithi163 bash[24253]: cluster 2024-08-31T06:02:50.452422+0000 mgr.a (mgr.14388) 10015 : cluster [DBG] pgmap v6942: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:54.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:53 smithi191 bash[24992]: cluster 2024-08-31T06:02:52.453230+0000 mgr.a (mgr.14388) 10016 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:53 smithi163 bash[24253]: cluster 2024-08-31T06:02:52.453230+0000 mgr.a (mgr.14388) 10016 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:53 smithi027 bash[22610]: cluster 2024-08-31T06:02:52.453230+0000 mgr.a (mgr.14388) 10016 : cluster [DBG] pgmap v6943: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:55.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:02:55.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:02:55.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:02:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:55 smithi191 bash[24992]: cluster 2024-08-31T06:02:54.455491+0000 mgr.a (mgr.14388) 10017 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:02:56.105 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:02:56.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:02:56.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:02:56.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:02:56.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:02:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:55 smithi163 bash[24253]: cluster 2024-08-31T06:02:54.455491+0000 mgr.a (mgr.14388) 10017 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:02:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:55 smithi027 bash[22610]: cluster 2024-08-31T06:02:54.455491+0000 mgr.a (mgr.14388) 10017 : cluster [DBG] pgmap v6944: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:02:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:56 smithi191 bash[24992]: audit 2024-08-31T06:02:55.650219+0000 mgr.a (mgr.14388) 10018 : audit [DBG] from='client.221976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:56 smithi163 bash[24253]: audit 2024-08-31T06:02:55.650219+0000 mgr.a (mgr.14388) 10018 : audit [DBG] from='client.221976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:56 smithi027 bash[22610]: audit 2024-08-31T06:02:55.650219+0000 mgr.a (mgr.14388) 10018 : audit [DBG] from='client.221976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:02:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:57 smithi191 bash[24992]: cluster 2024-08-31T06:02:56.456463+0000 mgr.a (mgr.14388) 10019 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:57 smithi163 bash[24253]: cluster 2024-08-31T06:02:56.456463+0000 mgr.a (mgr.14388) 10019 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:02:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:57 smithi027 bash[22610]: cluster 2024-08-31T06:02:56.456463+0000 mgr.a (mgr.14388) 10019 : cluster [DBG] pgmap v6945: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:02:59 smithi191 bash[24992]: cluster 2024-08-31T06:02:58.458678+0000 mgr.a (mgr.14388) 10020 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:02:59 smithi163 bash[24253]: cluster 2024-08-31T06:02:58.458678+0000 mgr.a (mgr.14388) 10020 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:02:59 smithi027 bash[22610]: cluster 2024-08-31T06:02:58.458678+0000 mgr.a (mgr.14388) 10020 : cluster [DBG] pgmap v6946: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:01.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:01.108 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:01.108 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:01.854 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:01.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:01.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:01.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:01.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:01 smithi191 bash[24992]: cluster 2024-08-31T06:03:00.459477+0000 mgr.a (mgr.14388) 10021 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:01 smithi163 bash[24253]: cluster 2024-08-31T06:03:00.459477+0000 mgr.a (mgr.14388) 10021 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:01 smithi027 bash[22610]: cluster 2024-08-31T06:03:00.459477+0000 mgr.a (mgr.14388) 10021 : cluster [DBG] pgmap v6947: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:03.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:02 smithi191 bash[24992]: audit 2024-08-31T06:03:01.440425+0000 mgr.a (mgr.14388) 10022 : audit [DBG] from='client.222054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:02 smithi163 bash[24253]: audit 2024-08-31T06:03:01.440425+0000 mgr.a (mgr.14388) 10022 : audit [DBG] from='client.222054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:02 smithi027 bash[22610]: audit 2024-08-31T06:03:01.440425+0000 mgr.a (mgr.14388) 10022 : audit [DBG] from='client.222054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:03 smithi191 bash[24992]: cluster 2024-08-31T06:03:02.460609+0000 mgr.a (mgr.14388) 10023 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:03 smithi191 bash[24992]: audit 2024-08-31T06:03:03.473701+0000 mon.a (mon.0) 2075 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:03:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:03 smithi163 bash[24253]: cluster 2024-08-31T06:03:02.460609+0000 mgr.a (mgr.14388) 10023 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:03 smithi163 bash[24253]: audit 2024-08-31T06:03:03.473701+0000 mon.a (mon.0) 2075 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:03:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:03 smithi027 bash[22610]: cluster 2024-08-31T06:03:02.460609+0000 mgr.a (mgr.14388) 10023 : cluster [DBG] pgmap v6948: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:03 smithi027 bash[22610]: audit 2024-08-31T06:03:03.473701+0000 mon.a (mon.0) 2075 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:03:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:05 smithi191 bash[24992]: cluster 2024-08-31T06:03:04.463046+0000 mgr.a (mgr.14388) 10024 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:05 smithi163 bash[24253]: cluster 2024-08-31T06:03:04.463046+0000 mgr.a (mgr.14388) 10024 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:05 smithi027 bash[22610]: cluster 2024-08-31T06:03:04.463046+0000 mgr.a (mgr.14388) 10024 : cluster [DBG] pgmap v6949: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:06.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:06.856 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:06.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:07.601 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:07.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:07.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:07.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:07.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:07 smithi191 bash[24992]: cluster 2024-08-31T06:03:06.463932+0000 mgr.a (mgr.14388) 10025 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:07 smithi163 bash[24253]: cluster 2024-08-31T06:03:06.463932+0000 mgr.a (mgr.14388) 10025 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:07 smithi027 bash[22610]: cluster 2024-08-31T06:03:06.463932+0000 mgr.a (mgr.14388) 10025 : cluster [DBG] pgmap v6950: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:08 smithi163 bash[24253]: audit 2024-08-31T06:03:07.187122+0000 mgr.a (mgr.14388) 10026 : audit [DBG] from='client.222126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:08 smithi027 bash[22610]: audit 2024-08-31T06:03:07.187122+0000 mgr.a (mgr.14388) 10026 : audit [DBG] from='client.222126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:08 smithi191 bash[24992]: audit 2024-08-31T06:03:07.187122+0000 mgr.a (mgr.14388) 10026 : audit [DBG] from='client.222126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: cluster 2024-08-31T06:03:08.466316+0000 mgr.a (mgr.14388) 10027 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: audit 2024-08-31T06:03:08.803138+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: audit 2024-08-31T06:03:08.809882+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: audit 2024-08-31T06:03:08.836509+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: audit 2024-08-31T06:03:08.840956+0000 mon.a (mon.0) 2079 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: audit 2024-08-31T06:03:08.846955+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: audit 2024-08-31T06:03:08.850681+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: audit 2024-08-31T06:03:09.571669+0000 mon.a (mon.0) 2082 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:03:10.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: audit 2024-08-31T06:03:09.573483+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:03:10.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: audit 2024-08-31T06:03:09.585482+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:09 smithi163 bash[24253]: audit 2024-08-31T06:03:09.590947+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:03:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: cluster 2024-08-31T06:03:08.466316+0000 mgr.a (mgr.14388) 10027 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: audit 2024-08-31T06:03:08.803138+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: audit 2024-08-31T06:03:08.809882+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: audit 2024-08-31T06:03:08.836509+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: audit 2024-08-31T06:03:08.840956+0000 mon.a (mon.0) 2079 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: audit 2024-08-31T06:03:08.846955+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: audit 2024-08-31T06:03:08.850681+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: audit 2024-08-31T06:03:09.571669+0000 mon.a (mon.0) 2082 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:03:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: audit 2024-08-31T06:03:09.573483+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:03:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: audit 2024-08-31T06:03:09.585482+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:09 smithi027 bash[22610]: audit 2024-08-31T06:03:09.590947+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:03:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: cluster 2024-08-31T06:03:08.466316+0000 mgr.a (mgr.14388) 10027 : cluster [DBG] pgmap v6951: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: audit 2024-08-31T06:03:08.803138+0000 mon.a (mon.0) 2076 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: audit 2024-08-31T06:03:08.809882+0000 mon.a (mon.0) 2077 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: audit 2024-08-31T06:03:08.836509+0000 mon.a (mon.0) 2078 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: audit 2024-08-31T06:03:08.840956+0000 mon.a (mon.0) 2079 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: audit 2024-08-31T06:03:08.846955+0000 mon.a (mon.0) 2080 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: audit 2024-08-31T06:03:08.850681+0000 mon.a (mon.0) 2081 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: audit 2024-08-31T06:03:09.571669+0000 mon.a (mon.0) 2082 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:03:10.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: audit 2024-08-31T06:03:09.573483+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:03:10.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: audit 2024-08-31T06:03:09.585482+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:03:10.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:09 smithi191 bash[24992]: audit 2024-08-31T06:03:09.590947+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:03:10.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:03:10 smithi027 bash[22863]: debug 2024-08-31T06:03:10.319+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:03:10.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:03:10 smithi027 bash[22863]: debug 2024-08-31T06:03:10.319+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:03:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:10 smithi163 bash[24253]: audit 2024-08-31T06:03:09.592348+0000 mgr.a (mgr.14388) 10028 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:03:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:10 smithi027 bash[22610]: audit 2024-08-31T06:03:09.592348+0000 mgr.a (mgr.14388) 10028 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:03:11.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:10 smithi191 bash[24992]: audit 2024-08-31T06:03:09.592348+0000 mgr.a (mgr.14388) 10028 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:03:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:11 smithi163 bash[24253]: audit 2024-08-31T06:03:10.324651+0000 mgr.a (mgr.14388) 10029 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:03:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:11 smithi163 bash[24253]: cephadm 2024-08-31T06:03:10.326057+0000 mgr.a (mgr.14388) 10030 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:03:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:11 smithi163 bash[24253]: cluster 2024-08-31T06:03:10.467259+0000 mgr.a (mgr.14388) 10031 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:11 smithi027 bash[22610]: audit 2024-08-31T06:03:10.324651+0000 mgr.a (mgr.14388) 10029 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:03:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:11 smithi027 bash[22610]: cephadm 2024-08-31T06:03:10.326057+0000 mgr.a (mgr.14388) 10030 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:03:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:11 smithi027 bash[22610]: cluster 2024-08-31T06:03:10.467259+0000 mgr.a (mgr.14388) 10031 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:11 smithi191 bash[24992]: audit 2024-08-31T06:03:10.324651+0000 mgr.a (mgr.14388) 10029 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:03:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:11 smithi191 bash[24992]: cephadm 2024-08-31T06:03:10.326057+0000 mgr.a (mgr.14388) 10030 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:03:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:11 smithi191 bash[24992]: cluster 2024-08-31T06:03:10.467259+0000 mgr.a (mgr.14388) 10031 : cluster [DBG] pgmap v6952: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:12.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:12.604 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:12.604 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:13.350 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:13.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:13.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:13.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:13.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:13 smithi163 bash[24253]: cluster 2024-08-31T06:03:12.468029+0000 mgr.a (mgr.14388) 10032 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:13 smithi027 bash[22610]: cluster 2024-08-31T06:03:12.468029+0000 mgr.a (mgr.14388) 10032 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:13 smithi191 bash[24992]: cluster 2024-08-31T06:03:12.468029+0000 mgr.a (mgr.14388) 10032 : cluster [DBG] pgmap v6953: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:14 smithi163 bash[24253]: audit 2024-08-31T06:03:12.933538+0000 mgr.a (mgr.14388) 10033 : audit [DBG] from='client.222309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:14 smithi027 bash[22610]: audit 2024-08-31T06:03:12.933538+0000 mgr.a (mgr.14388) 10033 : audit [DBG] from='client.222309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:14 smithi191 bash[24992]: audit 2024-08-31T06:03:12.933538+0000 mgr.a (mgr.14388) 10033 : audit [DBG] from='client.222309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:15 smithi163 bash[24253]: cluster 2024-08-31T06:03:14.470872+0000 mgr.a (mgr.14388) 10034 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:03:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:15 smithi027 bash[22610]: cluster 2024-08-31T06:03:14.470872+0000 mgr.a (mgr.14388) 10034 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:03:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:15 smithi191 bash[24992]: cluster 2024-08-31T06:03:14.470872+0000 mgr.a (mgr.14388) 10034 : cluster [DBG] pgmap v6954: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:03:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:17 smithi163 bash[24253]: cluster 2024-08-31T06:03:16.471646+0000 mgr.a (mgr.14388) 10035 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:03:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:17 smithi027 bash[22610]: cluster 2024-08-31T06:03:16.471646+0000 mgr.a (mgr.14388) 10035 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:03:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:17 smithi191 bash[24992]: cluster 2024-08-31T06:03:16.471646+0000 mgr.a (mgr.14388) 10035 : cluster [DBG] pgmap v6955: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:03:18.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:18.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:19.103 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:19.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:19.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:19.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:19.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:19 smithi163 bash[24253]: cluster 2024-08-31T06:03:18.472964+0000 mgr.a (mgr.14388) 10036 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:03:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:19 smithi163 bash[24253]: audit 2024-08-31T06:03:18.685396+0000 mgr.a (mgr.14388) 10037 : audit [DBG] from='client.222387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:19 smithi027 bash[22610]: cluster 2024-08-31T06:03:18.472964+0000 mgr.a (mgr.14388) 10036 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:03:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:19 smithi027 bash[22610]: audit 2024-08-31T06:03:18.685396+0000 mgr.a (mgr.14388) 10037 : audit [DBG] from='client.222387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:19 smithi191 bash[24992]: cluster 2024-08-31T06:03:18.472964+0000 mgr.a (mgr.14388) 10036 : cluster [DBG] pgmap v6956: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:03:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:19 smithi191 bash[24992]: audit 2024-08-31T06:03:18.685396+0000 mgr.a (mgr.14388) 10037 : audit [DBG] from='client.222387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:21 smithi163 bash[24253]: cluster 2024-08-31T06:03:20.473832+0000 mgr.a (mgr.14388) 10038 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:03:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:21 smithi027 bash[22610]: cluster 2024-08-31T06:03:20.473832+0000 mgr.a (mgr.14388) 10038 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:03:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:21 smithi191 bash[24992]: cluster 2024-08-31T06:03:20.473832+0000 mgr.a (mgr.14388) 10038 : cluster [DBG] pgmap v6957: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:03:24.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:24.105 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:23 smithi163 bash[24253]: cluster 2024-08-31T06:03:22.474624+0000 mgr.a (mgr.14388) 10039 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:03:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:23 smithi027 bash[22610]: cluster 2024-08-31T06:03:22.474624+0000 mgr.a (mgr.14388) 10039 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:03:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:23 smithi191 bash[24992]: cluster 2024-08-31T06:03:22.474624+0000 mgr.a (mgr.14388) 10039 : cluster [DBG] pgmap v6958: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:03:24.879 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:24.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:24.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:24.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:24.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:25 smithi163 bash[24253]: audit 2024-08-31T06:03:24.442057+0000 mgr.a (mgr.14388) 10040 : audit [DBG] from='client.222459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:25 smithi163 bash[24253]: cluster 2024-08-31T06:03:24.477610+0000 mgr.a (mgr.14388) 10041 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:03:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:25 smithi027 bash[22610]: audit 2024-08-31T06:03:24.442057+0000 mgr.a (mgr.14388) 10040 : audit [DBG] from='client.222459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:25 smithi027 bash[22610]: cluster 2024-08-31T06:03:24.477610+0000 mgr.a (mgr.14388) 10041 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:03:26.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:25 smithi191 bash[24992]: audit 2024-08-31T06:03:24.442057+0000 mgr.a (mgr.14388) 10040 : audit [DBG] from='client.222459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:26.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:25 smithi191 bash[24992]: cluster 2024-08-31T06:03:24.477610+0000 mgr.a (mgr.14388) 10041 : cluster [DBG] pgmap v6959: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:03:28.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:27 smithi163 bash[24253]: cluster 2024-08-31T06:03:26.478544+0000 mgr.a (mgr.14388) 10042 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:27 smithi027 bash[22610]: cluster 2024-08-31T06:03:26.478544+0000 mgr.a (mgr.14388) 10042 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:28.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:27 smithi191 bash[24992]: cluster 2024-08-31T06:03:26.478544+0000 mgr.a (mgr.14388) 10042 : cluster [DBG] pgmap v6960: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:29.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:29.882 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:29.882 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:29 smithi163 bash[24253]: cluster 2024-08-31T06:03:28.480721+0000 mgr.a (mgr.14388) 10043 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:29 smithi027 bash[22610]: cluster 2024-08-31T06:03:28.480721+0000 mgr.a (mgr.14388) 10043 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:29 smithi191 bash[24992]: cluster 2024-08-31T06:03:28.480721+0000 mgr.a (mgr.14388) 10043 : cluster [DBG] pgmap v6961: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:30.634 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:30.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:30.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:30.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:30.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:31 smithi163 bash[24253]: audit 2024-08-31T06:03:30.212721+0000 mgr.a (mgr.14388) 10044 : audit [DBG] from='client.222537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:31 smithi163 bash[24253]: cluster 2024-08-31T06:03:30.481288+0000 mgr.a (mgr.14388) 10045 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:31 smithi027 bash[22610]: audit 2024-08-31T06:03:30.212721+0000 mgr.a (mgr.14388) 10044 : audit [DBG] from='client.222537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:31 smithi027 bash[22610]: cluster 2024-08-31T06:03:30.481288+0000 mgr.a (mgr.14388) 10045 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:31 smithi191 bash[24992]: audit 2024-08-31T06:03:30.212721+0000 mgr.a (mgr.14388) 10044 : audit [DBG] from='client.222537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:31 smithi191 bash[24992]: cluster 2024-08-31T06:03:30.481288+0000 mgr.a (mgr.14388) 10045 : cluster [DBG] pgmap v6962: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:34.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:33 smithi163 bash[24253]: cluster 2024-08-31T06:03:32.482128+0000 mgr.a (mgr.14388) 10046 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:33 smithi027 bash[22610]: cluster 2024-08-31T06:03:32.482128+0000 mgr.a (mgr.14388) 10046 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:33 smithi191 bash[24992]: cluster 2024-08-31T06:03:32.482128+0000 mgr.a (mgr.14388) 10046 : cluster [DBG] pgmap v6963: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:35.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:35.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:35.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:36.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:35 smithi163 bash[24253]: cluster 2024-08-31T06:03:34.484399+0000 mgr.a (mgr.14388) 10047 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:35 smithi027 bash[22610]: cluster 2024-08-31T06:03:34.484399+0000 mgr.a (mgr.14388) 10047 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:35 smithi191 bash[24992]: cluster 2024-08-31T06:03:34.484399+0000 mgr.a (mgr.14388) 10047 : cluster [DBG] pgmap v6964: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:36.385 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:36.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:36.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:36.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:36.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:38.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:37 smithi163 bash[24253]: audit 2024-08-31T06:03:35.963616+0000 mgr.a (mgr.14388) 10048 : audit [DBG] from='client.222612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:38.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:37 smithi163 bash[24253]: cluster 2024-08-31T06:03:36.484990+0000 mgr.a (mgr.14388) 10049 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:37 smithi027 bash[22610]: audit 2024-08-31T06:03:35.963616+0000 mgr.a (mgr.14388) 10048 : audit [DBG] from='client.222612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:37 smithi027 bash[22610]: cluster 2024-08-31T06:03:36.484990+0000 mgr.a (mgr.14388) 10049 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:37 smithi191 bash[24992]: audit 2024-08-31T06:03:35.963616+0000 mgr.a (mgr.14388) 10048 : audit [DBG] from='client.222612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:38.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:37 smithi191 bash[24992]: cluster 2024-08-31T06:03:36.484990+0000 mgr.a (mgr.14388) 10049 : cluster [DBG] pgmap v6965: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:39 smithi163 bash[24253]: cluster 2024-08-31T06:03:38.487200+0000 mgr.a (mgr.14388) 10050 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:39 smithi027 bash[22610]: cluster 2024-08-31T06:03:38.487200+0000 mgr.a (mgr.14388) 10050 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:39 smithi191 bash[24992]: cluster 2024-08-31T06:03:38.487200+0000 mgr.a (mgr.14388) 10050 : cluster [DBG] pgmap v6966: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:41.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:41.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:41.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:42.165 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:42.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:42.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:42.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:42.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:41 smithi163 bash[24253]: cluster 2024-08-31T06:03:40.487966+0000 mgr.a (mgr.14388) 10051 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:41 smithi027 bash[22610]: cluster 2024-08-31T06:03:40.487966+0000 mgr.a (mgr.14388) 10051 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:41 smithi191 bash[24992]: cluster 2024-08-31T06:03:40.487966+0000 mgr.a (mgr.14388) 10051 : cluster [DBG] pgmap v6967: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:42 smithi163 bash[24253]: audit 2024-08-31T06:03:41.725342+0000 mgr.a (mgr.14388) 10052 : audit [DBG] from='client.222690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:42 smithi027 bash[22610]: audit 2024-08-31T06:03:41.725342+0000 mgr.a (mgr.14388) 10052 : audit [DBG] from='client.222690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:42 smithi191 bash[24992]: audit 2024-08-31T06:03:41.725342+0000 mgr.a (mgr.14388) 10052 : audit [DBG] from='client.222690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:43 smithi163 bash[24253]: cluster 2024-08-31T06:03:42.488932+0000 mgr.a (mgr.14388) 10053 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:43 smithi027 bash[22610]: cluster 2024-08-31T06:03:42.488932+0000 mgr.a (mgr.14388) 10053 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:43 smithi191 bash[24992]: cluster 2024-08-31T06:03:42.488932+0000 mgr.a (mgr.14388) 10053 : cluster [DBG] pgmap v6968: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:44 smithi163 bash[24253]: cluster 2024-08-31T06:03:44.491211+0000 mgr.a (mgr.14388) 10054 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:44 smithi027 bash[22610]: cluster 2024-08-31T06:03:44.491211+0000 mgr.a (mgr.14388) 10054 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:44 smithi191 bash[24992]: cluster 2024-08-31T06:03:44.491211+0000 mgr.a (mgr.14388) 10054 : cluster [DBG] pgmap v6969: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:03:47.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:47.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:47.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:47.912 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:47.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:47.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:47.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:47.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:47.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:47 smithi163 bash[24253]: cluster 2024-08-31T06:03:46.491954+0000 mgr.a (mgr.14388) 10055 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:47 smithi027 bash[22610]: cluster 2024-08-31T06:03:46.491954+0000 mgr.a (mgr.14388) 10055 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:47 smithi191 bash[24992]: cluster 2024-08-31T06:03:46.491954+0000 mgr.a (mgr.14388) 10055 : cluster [DBG] pgmap v6970: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:48 smithi163 bash[24253]: audit 2024-08-31T06:03:47.500086+0000 mgr.a (mgr.14388) 10056 : audit [DBG] from='client.222768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:48 smithi027 bash[22610]: audit 2024-08-31T06:03:47.500086+0000 mgr.a (mgr.14388) 10056 : audit [DBG] from='client.222768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:48 smithi191 bash[24992]: audit 2024-08-31T06:03:47.500086+0000 mgr.a (mgr.14388) 10056 : audit [DBG] from='client.222768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:49.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:49 smithi163 bash[24253]: cluster 2024-08-31T06:03:48.494446+0000 mgr.a (mgr.14388) 10057 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:03:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:49 smithi027 bash[22610]: cluster 2024-08-31T06:03:48.494446+0000 mgr.a (mgr.14388) 10057 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:03:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:49 smithi191 bash[24992]: cluster 2024-08-31T06:03:48.494446+0000 mgr.a (mgr.14388) 10057 : cluster [DBG] pgmap v6971: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:03:51.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:51 smithi163 bash[24253]: cluster 2024-08-31T06:03:50.495225+0000 mgr.a (mgr.14388) 10058 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:03:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:51 smithi027 bash[22610]: cluster 2024-08-31T06:03:50.495225+0000 mgr.a (mgr.14388) 10058 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:03:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:51 smithi191 bash[24992]: cluster 2024-08-31T06:03:50.495225+0000 mgr.a (mgr.14388) 10058 : cluster [DBG] pgmap v6972: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:03:52.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:52.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:52.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:53.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:53.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:53.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:53.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:53.650 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:53.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:53 smithi163 bash[24253]: cluster 2024-08-31T06:03:52.495933+0000 mgr.a (mgr.14388) 10059 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:03:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:53 smithi027 bash[22610]: cluster 2024-08-31T06:03:52.495933+0000 mgr.a (mgr.14388) 10059 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:03:54.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:53 smithi191 bash[24992]: cluster 2024-08-31T06:03:52.495933+0000 mgr.a (mgr.14388) 10059 : cluster [DBG] pgmap v6973: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:03:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:54 smithi163 bash[24253]: audit 2024-08-31T06:03:53.238183+0000 mgr.a (mgr.14388) 10060 : audit [DBG] from='client.222843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:54 smithi027 bash[22610]: audit 2024-08-31T06:03:53.238183+0000 mgr.a (mgr.14388) 10060 : audit [DBG] from='client.222843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:54 smithi191 bash[24992]: audit 2024-08-31T06:03:53.238183+0000 mgr.a (mgr.14388) 10060 : audit [DBG] from='client.222843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:03:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:55 smithi163 bash[24253]: cluster 2024-08-31T06:03:54.498651+0000 mgr.a (mgr.14388) 10061 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:55 smithi027 bash[22610]: cluster 2024-08-31T06:03:54.498651+0000 mgr.a (mgr.14388) 10061 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:55 smithi191 bash[24992]: cluster 2024-08-31T06:03:54.498651+0000 mgr.a (mgr.14388) 10061 : cluster [DBG] pgmap v6974: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:57 smithi163 bash[24253]: cluster 2024-08-31T06:03:56.499416+0000 mgr.a (mgr.14388) 10062 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:03:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:57 smithi027 bash[22610]: cluster 2024-08-31T06:03:56.499416+0000 mgr.a (mgr.14388) 10062 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:03:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:57 smithi191 bash[24992]: cluster 2024-08-31T06:03:56.499416+0000 mgr.a (mgr.14388) 10062 : cluster [DBG] pgmap v6975: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:03:58.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:03:58.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:03:58.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:03:59.393 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:03:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:03:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:03:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:03:59.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:03:59.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:03:59 smithi163 bash[24253]: cluster 2024-08-31T06:03:58.501356+0000 mgr.a (mgr.14388) 10063 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:03:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:03:59 smithi027 bash[22610]: cluster 2024-08-31T06:03:58.501356+0000 mgr.a (mgr.14388) 10063 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:03:59 smithi191 bash[24992]: cluster 2024-08-31T06:03:58.501356+0000 mgr.a (mgr.14388) 10063 : cluster [DBG] pgmap v6976: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:00 smithi163 bash[24253]: audit 2024-08-31T06:03:58.980018+0000 mgr.a (mgr.14388) 10064 : audit [DBG] from='client.222921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:00 smithi027 bash[22610]: audit 2024-08-31T06:03:58.980018+0000 mgr.a (mgr.14388) 10064 : audit [DBG] from='client.222921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:00 smithi191 bash[24992]: audit 2024-08-31T06:03:58.980018+0000 mgr.a (mgr.14388) 10064 : audit [DBG] from='client.222921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:01 smithi163 bash[24253]: cluster 2024-08-31T06:04:00.502261+0000 mgr.a (mgr.14388) 10065 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:04:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:01 smithi027 bash[22610]: cluster 2024-08-31T06:04:00.502261+0000 mgr.a (mgr.14388) 10065 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:04:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:01 smithi191 bash[24992]: cluster 2024-08-31T06:04:00.502261+0000 mgr.a (mgr.14388) 10065 : cluster [DBG] pgmap v6977: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:04:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:03 smithi163 bash[24253]: cluster 2024-08-31T06:04:02.503057+0000 mgr.a (mgr.14388) 10066 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:04:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:03 smithi027 bash[22610]: cluster 2024-08-31T06:04:02.503057+0000 mgr.a (mgr.14388) 10066 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:04:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:03 smithi191 bash[24992]: cluster 2024-08-31T06:04:02.503057+0000 mgr.a (mgr.14388) 10066 : cluster [DBG] pgmap v6978: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:04:04.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:04:04.395 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:04:04.395 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:04:05.174 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:04:05.174 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:04:05.174 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:04:05.174 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:04:05.174 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:04:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:05 smithi163 bash[24253]: cluster 2024-08-31T06:04:04.504645+0000 mgr.a (mgr.14388) 10067 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:04:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:05 smithi163 bash[24253]: audit 2024-08-31T06:04:04.743350+0000 mgr.a (mgr.14388) 10068 : audit [DBG] from='client.222999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:05 smithi027 bash[22610]: cluster 2024-08-31T06:04:04.504645+0000 mgr.a (mgr.14388) 10067 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:04:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:05 smithi027 bash[22610]: audit 2024-08-31T06:04:04.743350+0000 mgr.a (mgr.14388) 10068 : audit [DBG] from='client.222999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:05 smithi191 bash[24992]: cluster 2024-08-31T06:04:04.504645+0000 mgr.a (mgr.14388) 10067 : cluster [DBG] pgmap v6979: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:04:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:05 smithi191 bash[24992]: audit 2024-08-31T06:04:04.743350+0000 mgr.a (mgr.14388) 10068 : audit [DBG] from='client.222999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:07 smithi163 bash[24253]: cluster 2024-08-31T06:04:06.505513+0000 mgr.a (mgr.14388) 10069 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:07 smithi027 bash[22610]: cluster 2024-08-31T06:04:06.505513+0000 mgr.a (mgr.14388) 10069 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:07 smithi191 bash[24992]: cluster 2024-08-31T06:04:06.505513+0000 mgr.a (mgr.14388) 10069 : cluster [DBG] pgmap v6980: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:09.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:09 smithi163 bash[24253]: cluster 2024-08-31T06:04:08.507683+0000 mgr.a (mgr.14388) 10070 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:09 smithi027 bash[22610]: cluster 2024-08-31T06:04:08.507683+0000 mgr.a (mgr.14388) 10070 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:09 smithi191 bash[24992]: cluster 2024-08-31T06:04:08.507683+0000 mgr.a (mgr.14388) 10070 : cluster [DBG] pgmap v6981: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:10.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:04:10.176 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:04:10.176 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:04:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:10 smithi163 bash[24253]: audit 2024-08-31T06:04:10.378888+0000 mon.a (mon.0) 2086 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:04:10.953 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:04:10.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:04:10.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:04:10.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:04:10.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:04:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:10 smithi027 bash[22610]: audit 2024-08-31T06:04:10.378888+0000 mon.a (mon.0) 2086 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:04:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:10 smithi191 bash[24992]: audit 2024-08-31T06:04:10.378888+0000 mon.a (mon.0) 2086 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:04:11.933 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:11 smithi027 bash[22610]: cluster 2024-08-31T06:04:10.508421+0000 mgr.a (mgr.14388) 10071 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:11.933 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:11 smithi027 bash[22610]: audit 2024-08-31T06:04:10.516235+0000 mgr.a (mgr.14388) 10072 : audit [DBG] from='client.223077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:11.933 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:11 smithi027 bash[22610]: audit 2024-08-31T06:04:11.201410+0000 mon.a (mon.0) 2087 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:04:11.933 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:11 smithi027 bash[22610]: audit 2024-08-31T06:04:11.202678+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:04:11.934 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:11 smithi027 bash[22610]: audit 2024-08-31T06:04:11.209304+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:04:11.934 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:11 smithi027 bash[22610]: audit 2024-08-31T06:04:11.211587+0000 mon.a (mon.0) 2090 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:04:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:11 smithi163 bash[24253]: cluster 2024-08-31T06:04:10.508421+0000 mgr.a (mgr.14388) 10071 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:11 smithi163 bash[24253]: audit 2024-08-31T06:04:10.516235+0000 mgr.a (mgr.14388) 10072 : audit [DBG] from='client.223077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:11 smithi163 bash[24253]: audit 2024-08-31T06:04:11.201410+0000 mon.a (mon.0) 2087 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:04:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:11 smithi163 bash[24253]: audit 2024-08-31T06:04:11.202678+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:04:11.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:11 smithi163 bash[24253]: audit 2024-08-31T06:04:11.209304+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:04:11.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:11 smithi163 bash[24253]: audit 2024-08-31T06:04:11.211587+0000 mon.a (mon.0) 2090 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:04:12.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:11 smithi191 bash[24992]: cluster 2024-08-31T06:04:10.508421+0000 mgr.a (mgr.14388) 10071 : cluster [DBG] pgmap v6982: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:12.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:11 smithi191 bash[24992]: audit 2024-08-31T06:04:10.516235+0000 mgr.a (mgr.14388) 10072 : audit [DBG] from='client.223077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:12.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:11 smithi191 bash[24992]: audit 2024-08-31T06:04:11.201410+0000 mon.a (mon.0) 2087 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:04:12.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:11 smithi191 bash[24992]: audit 2024-08-31T06:04:11.202678+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:04:12.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:11 smithi191 bash[24992]: audit 2024-08-31T06:04:11.209304+0000 mon.a (mon.0) 2089 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:04:12.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:11 smithi191 bash[24992]: audit 2024-08-31T06:04:11.211587+0000 mon.a (mon.0) 2090 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:04:12.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:04:11 smithi027 bash[22863]: debug 2024-08-31T06:04:11.929+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:04:12.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:04:11 smithi027 bash[22863]: debug 2024-08-31T06:04:11.929+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:04:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:12 smithi163 bash[24253]: audit 2024-08-31T06:04:11.214408+0000 mgr.a (mgr.14388) 10073 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:04:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:12 smithi027 bash[22610]: audit 2024-08-31T06:04:11.214408+0000 mgr.a (mgr.14388) 10073 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:04:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:12 smithi191 bash[24992]: audit 2024-08-31T06:04:11.214408+0000 mgr.a (mgr.14388) 10073 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:04:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:13 smithi163 bash[24253]: audit 2024-08-31T06:04:11.933032+0000 mgr.a (mgr.14388) 10074 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:04:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:13 smithi163 bash[24253]: cephadm 2024-08-31T06:04:11.934539+0000 mgr.a (mgr.14388) 10075 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:04:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:13 smithi163 bash[24253]: cluster 2024-08-31T06:04:12.509328+0000 mgr.a (mgr.14388) 10076 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:13 smithi027 bash[22610]: audit 2024-08-31T06:04:11.933032+0000 mgr.a (mgr.14388) 10074 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:04:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:13 smithi027 bash[22610]: cephadm 2024-08-31T06:04:11.934539+0000 mgr.a (mgr.14388) 10075 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:04:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:13 smithi027 bash[22610]: cluster 2024-08-31T06:04:12.509328+0000 mgr.a (mgr.14388) 10076 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:13 smithi191 bash[24992]: audit 2024-08-31T06:04:11.933032+0000 mgr.a (mgr.14388) 10074 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:04:14.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:13 smithi191 bash[24992]: cephadm 2024-08-31T06:04:11.934539+0000 mgr.a (mgr.14388) 10075 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:04:14.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:13 smithi191 bash[24992]: cluster 2024-08-31T06:04:12.509328+0000 mgr.a (mgr.14388) 10076 : cluster [DBG] pgmap v6983: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:15 smithi163 bash[24253]: cluster 2024-08-31T06:04:14.511691+0000 mgr.a (mgr.14388) 10077 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:15.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:04:15.956 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:04:15.956 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:04:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:15 smithi027 bash[22610]: cluster 2024-08-31T06:04:14.511691+0000 mgr.a (mgr.14388) 10077 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:15 smithi191 bash[24992]: cluster 2024-08-31T06:04:14.511691+0000 mgr.a (mgr.14388) 10077 : cluster [DBG] pgmap v6984: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:16.730 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:04:16.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:04:16.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:04:16.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:04:16.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:04:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:17 smithi163 bash[24253]: audit 2024-08-31T06:04:16.284966+0000 mgr.a (mgr.14388) 10078 : audit [DBG] from='client.223257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:17 smithi163 bash[24253]: cluster 2024-08-31T06:04:16.512348+0000 mgr.a (mgr.14388) 10079 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:17 smithi027 bash[22610]: audit 2024-08-31T06:04:16.284966+0000 mgr.a (mgr.14388) 10078 : audit [DBG] from='client.223257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:17 smithi027 bash[22610]: cluster 2024-08-31T06:04:16.512348+0000 mgr.a (mgr.14388) 10079 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:18.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:17 smithi191 bash[24992]: audit 2024-08-31T06:04:16.284966+0000 mgr.a (mgr.14388) 10078 : audit [DBG] from='client.223257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:18.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:17 smithi191 bash[24992]: cluster 2024-08-31T06:04:16.512348+0000 mgr.a (mgr.14388) 10079 : cluster [DBG] pgmap v6985: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:19 smithi163 bash[24253]: cluster 2024-08-31T06:04:18.514628+0000 mgr.a (mgr.14388) 10080 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:19 smithi027 bash[22610]: cluster 2024-08-31T06:04:18.514628+0000 mgr.a (mgr.14388) 10080 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:19 smithi191 bash[24992]: cluster 2024-08-31T06:04:18.514628+0000 mgr.a (mgr.14388) 10080 : cluster [DBG] pgmap v6986: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:21.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:04:21.732 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:04:21.732 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:04:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:21 smithi163 bash[24253]: cluster 2024-08-31T06:04:20.515405+0000 mgr.a (mgr.14388) 10081 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:21 smithi027 bash[22610]: cluster 2024-08-31T06:04:20.515405+0000 mgr.a (mgr.14388) 10081 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:21 smithi191 bash[24992]: cluster 2024-08-31T06:04:20.515405+0000 mgr.a (mgr.14388) 10081 : cluster [DBG] pgmap v6987: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:22.500 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:04:22.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:04:22.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:04:22.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:04:22.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:04:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:23 smithi163 bash[24253]: audit 2024-08-31T06:04:22.069225+0000 mgr.a (mgr.14388) 10082 : audit [DBG] from='client.223335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:23 smithi163 bash[24253]: cluster 2024-08-31T06:04:22.516001+0000 mgr.a (mgr.14388) 10083 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:23 smithi027 bash[22610]: audit 2024-08-31T06:04:22.069225+0000 mgr.a (mgr.14388) 10082 : audit [DBG] from='client.223335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:23 smithi027 bash[22610]: cluster 2024-08-31T06:04:22.516001+0000 mgr.a (mgr.14388) 10083 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:23 smithi191 bash[24992]: audit 2024-08-31T06:04:22.069225+0000 mgr.a (mgr.14388) 10082 : audit [DBG] from='client.223335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:24.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:23 smithi191 bash[24992]: cluster 2024-08-31T06:04:22.516001+0000 mgr.a (mgr.14388) 10083 : cluster [DBG] pgmap v6988: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:25 smithi163 bash[24253]: cluster 2024-08-31T06:04:24.518159+0000 mgr.a (mgr.14388) 10084 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:25 smithi027 bash[22610]: cluster 2024-08-31T06:04:24.518159+0000 mgr.a (mgr.14388) 10084 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:25 smithi191 bash[24992]: cluster 2024-08-31T06:04:24.518159+0000 mgr.a (mgr.14388) 10084 : cluster [DBG] pgmap v6989: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:04:27.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:04:27.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:04:27.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:04:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:27 smithi163 bash[24253]: cluster 2024-08-31T06:04:26.518921+0000 mgr.a (mgr.14388) 10085 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:27 smithi027 bash[22610]: cluster 2024-08-31T06:04:26.518921+0000 mgr.a (mgr.14388) 10085 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:27 smithi191 bash[24992]: cluster 2024-08-31T06:04:26.518921+0000 mgr.a (mgr.14388) 10085 : cluster [DBG] pgmap v6990: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:28.250 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:04:28.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:04:28.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:04:28.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:04:28.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:04:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:28 smithi163 bash[24253]: audit 2024-08-31T06:04:27.832265+0000 mgr.a (mgr.14388) 10086 : audit [DBG] from='client.223413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:28 smithi027 bash[22610]: audit 2024-08-31T06:04:27.832265+0000 mgr.a (mgr.14388) 10086 : audit [DBG] from='client.223413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:29.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:28 smithi191 bash[24992]: audit 2024-08-31T06:04:27.832265+0000 mgr.a (mgr.14388) 10086 : audit [DBG] from='client.223413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:29 smithi163 bash[24253]: cluster 2024-08-31T06:04:28.521653+0000 mgr.a (mgr.14388) 10087 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:29.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:29 smithi027 bash[22610]: cluster 2024-08-31T06:04:28.521653+0000 mgr.a (mgr.14388) 10087 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:29 smithi191 bash[24992]: cluster 2024-08-31T06:04:28.521653+0000 mgr.a (mgr.14388) 10087 : cluster [DBG] pgmap v6991: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:31 smithi163 bash[24253]: cluster 2024-08-31T06:04:30.522438+0000 mgr.a (mgr.14388) 10088 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:04:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:31 smithi027 bash[22610]: cluster 2024-08-31T06:04:30.522438+0000 mgr.a (mgr.14388) 10088 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:04:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:31 smithi191 bash[24992]: cluster 2024-08-31T06:04:30.522438+0000 mgr.a (mgr.14388) 10088 : cluster [DBG] pgmap v6992: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:04:33.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:04:33.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:04:33.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:04:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:33 smithi163 bash[24253]: cluster 2024-08-31T06:04:32.523190+0000 mgr.a (mgr.14388) 10089 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:04:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:33 smithi027 bash[22610]: cluster 2024-08-31T06:04:32.523190+0000 mgr.a (mgr.14388) 10089 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:04:34.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:04:34.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:04:34.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:04:34.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:04:34.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:04:34.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:33 smithi191 bash[24992]: cluster 2024-08-31T06:04:32.523190+0000 mgr.a (mgr.14388) 10089 : cluster [DBG] pgmap v6993: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:04:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:34 smithi163 bash[24253]: audit 2024-08-31T06:04:33.584423+0000 mgr.a (mgr.14388) 10090 : audit [DBG] from='client.223488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:34 smithi027 bash[22610]: audit 2024-08-31T06:04:33.584423+0000 mgr.a (mgr.14388) 10090 : audit [DBG] from='client.223488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:34 smithi191 bash[24992]: audit 2024-08-31T06:04:33.584423+0000 mgr.a (mgr.14388) 10090 : audit [DBG] from='client.223488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:35 smithi163 bash[24253]: cluster 2024-08-31T06:04:34.525915+0000 mgr.a (mgr.14388) 10091 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:35 smithi027 bash[22610]: cluster 2024-08-31T06:04:34.525915+0000 mgr.a (mgr.14388) 10091 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:35 smithi191 bash[24992]: cluster 2024-08-31T06:04:34.525915+0000 mgr.a (mgr.14388) 10091 : cluster [DBG] pgmap v6994: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:37 smithi027 bash[22610]: cluster 2024-08-31T06:04:36.526715+0000 mgr.a (mgr.14388) 10092 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:04:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:37 smithi191 bash[24992]: cluster 2024-08-31T06:04:36.526715+0000 mgr.a (mgr.14388) 10092 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:04:38.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:37 smithi163 bash[24253]: cluster 2024-08-31T06:04:36.526715+0000 mgr.a (mgr.14388) 10092 : cluster [DBG] pgmap v6995: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:04:39.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:04:39.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:04:39.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:04:39.776 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:04:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:04:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:04:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:04:39.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:04:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:39 smithi027 bash[22610]: cluster 2024-08-31T06:04:38.528735+0000 mgr.a (mgr.14388) 10093 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:40.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:39 smithi191 bash[24992]: cluster 2024-08-31T06:04:38.528735+0000 mgr.a (mgr.14388) 10093 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:39 smithi163 bash[24253]: cluster 2024-08-31T06:04:38.528735+0000 mgr.a (mgr.14388) 10093 : cluster [DBG] pgmap v6996: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:40 smithi027 bash[22610]: audit 2024-08-31T06:04:39.344999+0000 mgr.a (mgr.14388) 10094 : audit [DBG] from='client.223566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:40 smithi191 bash[24992]: audit 2024-08-31T06:04:39.344999+0000 mgr.a (mgr.14388) 10094 : audit [DBG] from='client.223566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:40 smithi163 bash[24253]: audit 2024-08-31T06:04:39.344999+0000 mgr.a (mgr.14388) 10094 : audit [DBG] from='client.223566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:41 smithi027 bash[22610]: cluster 2024-08-31T06:04:40.529823+0000 mgr.a (mgr.14388) 10095 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:41 smithi191 bash[24992]: cluster 2024-08-31T06:04:40.529823+0000 mgr.a (mgr.14388) 10095 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:41 smithi163 bash[24253]: cluster 2024-08-31T06:04:40.529823+0000 mgr.a (mgr.14388) 10095 : cluster [DBG] pgmap v6997: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:43 smithi027 bash[22610]: cluster 2024-08-31T06:04:42.530641+0000 mgr.a (mgr.14388) 10096 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:43 smithi191 bash[24992]: cluster 2024-08-31T06:04:42.530641+0000 mgr.a (mgr.14388) 10096 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:43 smithi163 bash[24253]: cluster 2024-08-31T06:04:42.530641+0000 mgr.a (mgr.14388) 10096 : cluster [DBG] pgmap v6998: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:44.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:04:44.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:04:44.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:04:45.561 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:04:45.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:04:45.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:04:45.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:04:45.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:04:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:45 smithi027 bash[22610]: cluster 2024-08-31T06:04:44.532856+0000 mgr.a (mgr.14388) 10097 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:45 smithi191 bash[24992]: cluster 2024-08-31T06:04:44.532856+0000 mgr.a (mgr.14388) 10097 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:45 smithi163 bash[24253]: cluster 2024-08-31T06:04:44.532856+0000 mgr.a (mgr.14388) 10097 : cluster [DBG] pgmap v6999: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:46 smithi027 bash[22610]: audit 2024-08-31T06:04:45.117059+0000 mgr.a (mgr.14388) 10098 : audit [DBG] from='client.223641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:46 smithi191 bash[24992]: audit 2024-08-31T06:04:45.117059+0000 mgr.a (mgr.14388) 10098 : audit [DBG] from='client.223641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:46 smithi163 bash[24253]: audit 2024-08-31T06:04:45.117059+0000 mgr.a (mgr.14388) 10098 : audit [DBG] from='client.223641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:47 smithi191 bash[24992]: cluster 2024-08-31T06:04:46.533729+0000 mgr.a (mgr.14388) 10099 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:47 smithi163 bash[24253]: cluster 2024-08-31T06:04:46.533729+0000 mgr.a (mgr.14388) 10099 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:47 smithi027 bash[22610]: cluster 2024-08-31T06:04:46.533729+0000 mgr.a (mgr.14388) 10099 : cluster [DBG] pgmap v7000: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:49 smithi191 bash[24992]: cluster 2024-08-31T06:04:48.536139+0000 mgr.a (mgr.14388) 10100 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:49 smithi163 bash[24253]: cluster 2024-08-31T06:04:48.536139+0000 mgr.a (mgr.14388) 10100 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:49 smithi027 bash[22610]: cluster 2024-08-31T06:04:48.536139+0000 mgr.a (mgr.14388) 10100 : cluster [DBG] pgmap v7001: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:50.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:04:50.572 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:04:50.572 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:04:51.337 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:04:51.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:04:51.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:04:51.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:04:51.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:04:52.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:51 smithi191 bash[24992]: cluster 2024-08-31T06:04:50.537064+0000 mgr.a (mgr.14388) 10101 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:52.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:51 smithi191 bash[24992]: audit 2024-08-31T06:04:50.905722+0000 mgr.a (mgr.14388) 10102 : audit [DBG] from='client.223716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:51 smithi163 bash[24253]: cluster 2024-08-31T06:04:50.537064+0000 mgr.a (mgr.14388) 10101 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:51 smithi163 bash[24253]: audit 2024-08-31T06:04:50.905722+0000 mgr.a (mgr.14388) 10102 : audit [DBG] from='client.223716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:51 smithi027 bash[22610]: cluster 2024-08-31T06:04:50.537064+0000 mgr.a (mgr.14388) 10101 : cluster [DBG] pgmap v7002: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:51 smithi027 bash[22610]: audit 2024-08-31T06:04:50.905722+0000 mgr.a (mgr.14388) 10102 : audit [DBG] from='client.223716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:54.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:53 smithi191 bash[24992]: cluster 2024-08-31T06:04:52.537994+0000 mgr.a (mgr.14388) 10103 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:53 smithi163 bash[24253]: cluster 2024-08-31T06:04:52.537994+0000 mgr.a (mgr.14388) 10103 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:53 smithi027 bash[22610]: cluster 2024-08-31T06:04:52.537994+0000 mgr.a (mgr.14388) 10103 : cluster [DBG] pgmap v7003: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:55 smithi191 bash[24992]: cluster 2024-08-31T06:04:54.540209+0000 mgr.a (mgr.14388) 10104 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:55 smithi163 bash[24253]: cluster 2024-08-31T06:04:54.540209+0000 mgr.a (mgr.14388) 10104 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:55 smithi027 bash[22610]: cluster 2024-08-31T06:04:54.540209+0000 mgr.a (mgr.14388) 10104 : cluster [DBG] pgmap v7004: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:04:56.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:04:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:04:56.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:04:57.108 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:04:57.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:04:57.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:04:57.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:04:57.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:04:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:57 smithi191 bash[24992]: cluster 2024-08-31T06:04:56.540940+0000 mgr.a (mgr.14388) 10105 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:57 smithi191 bash[24992]: audit 2024-08-31T06:04:56.676011+0000 mgr.a (mgr.14388) 10106 : audit [DBG] from='client.223794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:57 smithi163 bash[24253]: cluster 2024-08-31T06:04:56.540940+0000 mgr.a (mgr.14388) 10105 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:57 smithi163 bash[24253]: audit 2024-08-31T06:04:56.676011+0000 mgr.a (mgr.14388) 10106 : audit [DBG] from='client.223794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:04:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:57 smithi027 bash[22610]: cluster 2024-08-31T06:04:56.540940+0000 mgr.a (mgr.14388) 10105 : cluster [DBG] pgmap v7005: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:04:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:57 smithi027 bash[22610]: audit 2024-08-31T06:04:56.676011+0000 mgr.a (mgr.14388) 10106 : audit [DBG] from='client.223794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:04:59 smithi191 bash[24992]: cluster 2024-08-31T06:04:58.543252+0000 mgr.a (mgr.14388) 10107 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:04:59 smithi163 bash[24253]: cluster 2024-08-31T06:04:58.543252+0000 mgr.a (mgr.14388) 10107 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:04:59 smithi027 bash[22610]: cluster 2024-08-31T06:04:58.543252+0000 mgr.a (mgr.14388) 10107 : cluster [DBG] pgmap v7006: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:01 smithi191 bash[24992]: cluster 2024-08-31T06:05:00.544007+0000 mgr.a (mgr.14388) 10108 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:02.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:02.111 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:02.111 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:05:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:01 smithi163 bash[24253]: cluster 2024-08-31T06:05:00.544007+0000 mgr.a (mgr.14388) 10108 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:01 smithi027 bash[22610]: cluster 2024-08-31T06:05:00.544007+0000 mgr.a (mgr.14388) 10108 : cluster [DBG] pgmap v7007: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:02.854 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:05:02.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:05:02.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:05:02.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:05:02.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:05:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:03 smithi191 bash[24992]: audit 2024-08-31T06:05:02.438615+0000 mgr.a (mgr.14388) 10109 : audit [DBG] from='client.223872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:03 smithi191 bash[24992]: cluster 2024-08-31T06:05:02.544467+0000 mgr.a (mgr.14388) 10110 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:03 smithi163 bash[24253]: audit 2024-08-31T06:05:02.438615+0000 mgr.a (mgr.14388) 10109 : audit [DBG] from='client.223872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:03 smithi163 bash[24253]: cluster 2024-08-31T06:05:02.544467+0000 mgr.a (mgr.14388) 10110 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:03 smithi027 bash[22610]: audit 2024-08-31T06:05:02.438615+0000 mgr.a (mgr.14388) 10109 : audit [DBG] from='client.223872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:03 smithi027 bash[22610]: cluster 2024-08-31T06:05:02.544467+0000 mgr.a (mgr.14388) 10110 : cluster [DBG] pgmap v7008: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:05 smithi191 bash[24992]: cluster 2024-08-31T06:05:04.546883+0000 mgr.a (mgr.14388) 10111 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:06.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:05 smithi163 bash[24253]: cluster 2024-08-31T06:05:04.546883+0000 mgr.a (mgr.14388) 10111 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:05 smithi027 bash[22610]: cluster 2024-08-31T06:05:04.546883+0000 mgr.a (mgr.14388) 10111 : cluster [DBG] pgmap v7009: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:07.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:07.856 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:07.856 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:05:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:07 smithi191 bash[24992]: cluster 2024-08-31T06:05:06.547686+0000 mgr.a (mgr.14388) 10112 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:07 smithi163 bash[24253]: cluster 2024-08-31T06:05:06.547686+0000 mgr.a (mgr.14388) 10112 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:07 smithi027 bash[22610]: cluster 2024-08-31T06:05:06.547686+0000 mgr.a (mgr.14388) 10112 : cluster [DBG] pgmap v7010: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:08.621 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:05:08.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:05:08.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:05:08.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:05:08.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:05:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:09 smithi191 bash[24992]: audit 2024-08-31T06:05:08.189798+0000 mgr.a (mgr.14388) 10113 : audit [DBG] from='client.223950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:09 smithi191 bash[24992]: cluster 2024-08-31T06:05:08.550856+0000 mgr.a (mgr.14388) 10114 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:09 smithi163 bash[24253]: audit 2024-08-31T06:05:08.189798+0000 mgr.a (mgr.14388) 10113 : audit [DBG] from='client.223950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:09 smithi163 bash[24253]: cluster 2024-08-31T06:05:08.550856+0000 mgr.a (mgr.14388) 10114 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:09 smithi027 bash[22610]: audit 2024-08-31T06:05:08.189798+0000 mgr.a (mgr.14388) 10113 : audit [DBG] from='client.223950 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:09 smithi027 bash[22610]: cluster 2024-08-31T06:05:08.550856+0000 mgr.a (mgr.14388) 10114 : cluster [DBG] pgmap v7011: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:11 smithi163 bash[24253]: cluster 2024-08-31T06:05:10.551641+0000 mgr.a (mgr.14388) 10115 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:11 smithi027 bash[22610]: cluster 2024-08-31T06:05:10.551641+0000 mgr.a (mgr.14388) 10115 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:11 smithi191 bash[24992]: cluster 2024-08-31T06:05:10.551641+0000 mgr.a (mgr.14388) 10115 : cluster [DBG] pgmap v7012: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:12 smithi163 bash[24253]: audit 2024-08-31T06:05:11.987818+0000 mon.a (mon.0) 2091 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:05:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:12 smithi027 bash[22610]: audit 2024-08-31T06:05:11.987818+0000 mon.a (mon.0) 2091 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:05:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:12 smithi191 bash[24992]: audit 2024-08-31T06:05:11.987818+0000 mon.a (mon.0) 2091 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:05:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:05:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:13 smithi163 bash[24253]: cluster 2024-08-31T06:05:12.552091+0000 mgr.a (mgr.14388) 10116 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:05:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:13 smithi163 bash[24253]: audit 2024-08-31T06:05:12.799125+0000 mon.a (mon.0) 2092 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:05:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:13 smithi163 bash[24253]: audit 2024-08-31T06:05:12.800628+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:05:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:13 smithi163 bash[24253]: audit 2024-08-31T06:05:12.811313+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:05:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:13 smithi163 bash[24253]: audit 2024-08-31T06:05:12.815957+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:05:13.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:13 smithi163 bash[24253]: audit 2024-08-31T06:05:12.818265+0000 mgr.a (mgr.14388) 10117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:05:13.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:05:13 smithi027 bash[22863]: debug 2024-08-31T06:05:13.535+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:05:13.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:05:13 smithi027 bash[22863]: debug 2024-08-31T06:05:13.539+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:05:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:13 smithi027 bash[22610]: cluster 2024-08-31T06:05:12.552091+0000 mgr.a (mgr.14388) 10116 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:05:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:13 smithi027 bash[22610]: audit 2024-08-31T06:05:12.799125+0000 mon.a (mon.0) 2092 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:05:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:13 smithi027 bash[22610]: audit 2024-08-31T06:05:12.800628+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:05:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:13 smithi027 bash[22610]: audit 2024-08-31T06:05:12.811313+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:05:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:13 smithi027 bash[22610]: audit 2024-08-31T06:05:12.815957+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:05:13.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:13 smithi027 bash[22610]: audit 2024-08-31T06:05:12.818265+0000 mgr.a (mgr.14388) 10117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:05:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:13 smithi191 bash[24992]: cluster 2024-08-31T06:05:12.552091+0000 mgr.a (mgr.14388) 10116 : cluster [DBG] pgmap v7013: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:05:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:13 smithi191 bash[24992]: audit 2024-08-31T06:05:12.799125+0000 mon.a (mon.0) 2092 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:05:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:13 smithi191 bash[24992]: audit 2024-08-31T06:05:12.800628+0000 mon.a (mon.0) 2093 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:05:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:13 smithi191 bash[24992]: audit 2024-08-31T06:05:12.811313+0000 mon.a (mon.0) 2094 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:05:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:13 smithi191 bash[24992]: audit 2024-08-31T06:05:12.815957+0000 mon.a (mon.0) 2095 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:05:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:13 smithi191 bash[24992]: audit 2024-08-31T06:05:12.818265+0000 mgr.a (mgr.14388) 10117 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:05:14.361 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:05:14.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:05:14.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:05:14.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:05:14.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:05:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:14 smithi163 bash[24253]: audit 2024-08-31T06:05:13.541724+0000 mgr.a (mgr.14388) 10118 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:05:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:14 smithi163 bash[24253]: cephadm 2024-08-31T06:05:13.542931+0000 mgr.a (mgr.14388) 10119 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:05:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:14 smithi027 bash[22610]: audit 2024-08-31T06:05:13.541724+0000 mgr.a (mgr.14388) 10118 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:05:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:14 smithi027 bash[22610]: cephadm 2024-08-31T06:05:13.542931+0000 mgr.a (mgr.14388) 10119 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:05:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:14 smithi191 bash[24992]: audit 2024-08-31T06:05:13.541724+0000 mgr.a (mgr.14388) 10118 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:05:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:14 smithi191 bash[24992]: cephadm 2024-08-31T06:05:13.542931+0000 mgr.a (mgr.14388) 10119 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:05:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:15 smithi163 bash[24253]: audit 2024-08-31T06:05:13.948643+0000 mgr.a (mgr.14388) 10120 : audit [DBG] from='client.224136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:15 smithi163 bash[24253]: cluster 2024-08-31T06:05:14.554785+0000 mgr.a (mgr.14388) 10121 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:15 smithi027 bash[22610]: audit 2024-08-31T06:05:13.948643+0000 mgr.a (mgr.14388) 10120 : audit [DBG] from='client.224136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:15 smithi027 bash[22610]: cluster 2024-08-31T06:05:14.554785+0000 mgr.a (mgr.14388) 10121 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:15 smithi191 bash[24992]: audit 2024-08-31T06:05:13.948643+0000 mgr.a (mgr.14388) 10120 : audit [DBG] from='client.224136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:15 smithi191 bash[24992]: cluster 2024-08-31T06:05:14.554785+0000 mgr.a (mgr.14388) 10121 : cluster [DBG] pgmap v7014: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:17 smithi163 bash[24253]: cluster 2024-08-31T06:05:16.555595+0000 mgr.a (mgr.14388) 10122 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:17 smithi027 bash[22610]: cluster 2024-08-31T06:05:16.555595+0000 mgr.a (mgr.14388) 10122 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:18.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:17 smithi191 bash[24992]: cluster 2024-08-31T06:05:16.555595+0000 mgr.a (mgr.14388) 10122 : cluster [DBG] pgmap v7015: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:19.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:19.363 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:19.363 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:05:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:19 smithi163 bash[24253]: cluster 2024-08-31T06:05:18.557570+0000 mgr.a (mgr.14388) 10123 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:19 smithi027 bash[22610]: cluster 2024-08-31T06:05:18.557570+0000 mgr.a (mgr.14388) 10123 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:19 smithi191 bash[24992]: cluster 2024-08-31T06:05:18.557570+0000 mgr.a (mgr.14388) 10123 : cluster [DBG] pgmap v7016: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:20.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:05:20.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:05:20.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:05:20.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:05:20.126 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:05:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:20 smithi163 bash[24253]: audit 2024-08-31T06:05:19.693627+0000 mgr.a (mgr.14388) 10124 : audit [DBG] from='client.224214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:20 smithi027 bash[22610]: audit 2024-08-31T06:05:19.693627+0000 mgr.a (mgr.14388) 10124 : audit [DBG] from='client.224214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:21.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:20 smithi191 bash[24992]: audit 2024-08-31T06:05:19.693627+0000 mgr.a (mgr.14388) 10124 : audit [DBG] from='client.224214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:21 smithi163 bash[24253]: cluster 2024-08-31T06:05:20.558560+0000 mgr.a (mgr.14388) 10125 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:21 smithi027 bash[22610]: cluster 2024-08-31T06:05:20.558560+0000 mgr.a (mgr.14388) 10125 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:21 smithi191 bash[24992]: cluster 2024-08-31T06:05:20.558560+0000 mgr.a (mgr.14388) 10125 : cluster [DBG] pgmap v7017: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:23 smithi163 bash[24253]: cluster 2024-08-31T06:05:22.559517+0000 mgr.a (mgr.14388) 10126 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:23 smithi027 bash[22610]: cluster 2024-08-31T06:05:22.559517+0000 mgr.a (mgr.14388) 10126 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:23 smithi191 bash[24992]: cluster 2024-08-31T06:05:22.559517+0000 mgr.a (mgr.14388) 10126 : cluster [DBG] pgmap v7018: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:25.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:25.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:25.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:05:25.923 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:05:25.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:05:25.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:05:25.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:05:25.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:05:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:25 smithi163 bash[24253]: cluster 2024-08-31T06:05:24.561773+0000 mgr.a (mgr.14388) 10127 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:25 smithi027 bash[22610]: cluster 2024-08-31T06:05:24.561773+0000 mgr.a (mgr.14388) 10127 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:26.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:25 smithi191 bash[24992]: cluster 2024-08-31T06:05:24.561773+0000 mgr.a (mgr.14388) 10127 : cluster [DBG] pgmap v7019: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:26 smithi163 bash[24253]: audit 2024-08-31T06:05:25.465519+0000 mgr.a (mgr.14388) 10128 : audit [DBG] from='client.224292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:26.986 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:26 smithi027 bash[22610]: audit 2024-08-31T06:05:25.465519+0000 mgr.a (mgr.14388) 10128 : audit [DBG] from='client.224292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:27.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:26 smithi191 bash[24992]: audit 2024-08-31T06:05:25.465519+0000 mgr.a (mgr.14388) 10128 : audit [DBG] from='client.224292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:27 smithi163 bash[24253]: cluster 2024-08-31T06:05:26.562772+0000 mgr.a (mgr.14388) 10129 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:27 smithi027 bash[22610]: cluster 2024-08-31T06:05:26.562772+0000 mgr.a (mgr.14388) 10129 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:27 smithi191 bash[24992]: cluster 2024-08-31T06:05:26.562772+0000 mgr.a (mgr.14388) 10129 : cluster [DBG] pgmap v7020: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:29 smithi163 bash[24253]: cluster 2024-08-31T06:05:28.564998+0000 mgr.a (mgr.14388) 10130 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:29 smithi027 bash[22610]: cluster 2024-08-31T06:05:28.564998+0000 mgr.a (mgr.14388) 10130 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:29 smithi191 bash[24992]: cluster 2024-08-31T06:05:28.564998+0000 mgr.a (mgr.14388) 10130 : cluster [DBG] pgmap v7021: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:05:30.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:30.926 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:30.926 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:05:31.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:05:31.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:05:31.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:05:31.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:05:31.663 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:05:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:31 smithi163 bash[24253]: cluster 2024-08-31T06:05:30.565803+0000 mgr.a (mgr.14388) 10131 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:31 smithi027 bash[22610]: cluster 2024-08-31T06:05:30.565803+0000 mgr.a (mgr.14388) 10131 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:31 smithi191 bash[24992]: cluster 2024-08-31T06:05:30.565803+0000 mgr.a (mgr.14388) 10131 : cluster [DBG] pgmap v7022: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:32 smithi163 bash[24253]: audit 2024-08-31T06:05:31.259472+0000 mgr.a (mgr.14388) 10132 : audit [DBG] from='client.224370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:32 smithi027 bash[22610]: audit 2024-08-31T06:05:31.259472+0000 mgr.a (mgr.14388) 10132 : audit [DBG] from='client.224370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:32 smithi191 bash[24992]: audit 2024-08-31T06:05:31.259472+0000 mgr.a (mgr.14388) 10132 : audit [DBG] from='client.224370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:33.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:33 smithi163 bash[24253]: cluster 2024-08-31T06:05:32.566807+0000 mgr.a (mgr.14388) 10133 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:33 smithi027 bash[22610]: cluster 2024-08-31T06:05:32.566807+0000 mgr.a (mgr.14388) 10133 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:33 smithi191 bash[24992]: cluster 2024-08-31T06:05:32.566807+0000 mgr.a (mgr.14388) 10133 : cluster [DBG] pgmap v7023: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:35 smithi163 bash[24253]: cluster 2024-08-31T06:05:34.569061+0000 mgr.a (mgr.14388) 10134 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:35 smithi027 bash[22610]: cluster 2024-08-31T06:05:34.569061+0000 mgr.a (mgr.14388) 10134 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:36.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:35 smithi191 bash[24992]: cluster 2024-08-31T06:05:34.569061+0000 mgr.a (mgr.14388) 10134 : cluster [DBG] pgmap v7024: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:36.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:36.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:36.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:05:37.439 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:05:37.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:05:37.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:05:37.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:05:37.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:05:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:37 smithi163 bash[24253]: cluster 2024-08-31T06:05:36.569825+0000 mgr.a (mgr.14388) 10135 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:37 smithi027 bash[22610]: cluster 2024-08-31T06:05:36.569825+0000 mgr.a (mgr.14388) 10135 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:38.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:37 smithi191 bash[24992]: cluster 2024-08-31T06:05:36.569825+0000 mgr.a (mgr.14388) 10135 : cluster [DBG] pgmap v7025: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:38 smithi027 bash[22610]: audit 2024-08-31T06:05:37.002694+0000 mgr.a (mgr.14388) 10136 : audit [DBG] from='client.224448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:38 smithi191 bash[24992]: audit 2024-08-31T06:05:37.002694+0000 mgr.a (mgr.14388) 10136 : audit [DBG] from='client.224448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:38 smithi163 bash[24253]: audit 2024-08-31T06:05:37.002694+0000 mgr.a (mgr.14388) 10136 : audit [DBG] from='client.224448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:39 smithi027 bash[22610]: cluster 2024-08-31T06:05:38.572286+0000 mgr.a (mgr.14388) 10137 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:39 smithi191 bash[24992]: cluster 2024-08-31T06:05:38.572286+0000 mgr.a (mgr.14388) 10137 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:39 smithi163 bash[24253]: cluster 2024-08-31T06:05:38.572286+0000 mgr.a (mgr.14388) 10137 : cluster [DBG] pgmap v7026: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:05:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:41 smithi027 bash[22610]: cluster 2024-08-31T06:05:40.573068+0000 mgr.a (mgr.14388) 10138 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:41 smithi191 bash[24992]: cluster 2024-08-31T06:05:40.573068+0000 mgr.a (mgr.14388) 10138 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:41 smithi163 bash[24253]: cluster 2024-08-31T06:05:40.573068+0000 mgr.a (mgr.14388) 10138 : cluster [DBG] pgmap v7027: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:42.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:42.441 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:42.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:05:43.185 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:05:43.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:05:43.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:05:43.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:05:43.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:05:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:43 smithi027 bash[22610]: cluster 2024-08-31T06:05:42.573556+0000 mgr.a (mgr.14388) 10139 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:43 smithi027 bash[22610]: audit 2024-08-31T06:05:42.771222+0000 mgr.a (mgr.14388) 10140 : audit [DBG] from='client.224523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:43 smithi191 bash[24992]: cluster 2024-08-31T06:05:42.573556+0000 mgr.a (mgr.14388) 10139 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:44.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:43 smithi191 bash[24992]: audit 2024-08-31T06:05:42.771222+0000 mgr.a (mgr.14388) 10140 : audit [DBG] from='client.224523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:43 smithi163 bash[24253]: cluster 2024-08-31T06:05:42.573556+0000 mgr.a (mgr.14388) 10139 : cluster [DBG] pgmap v7028: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:43 smithi163 bash[24253]: audit 2024-08-31T06:05:42.771222+0000 mgr.a (mgr.14388) 10140 : audit [DBG] from='client.224523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:45 smithi027 bash[22610]: cluster 2024-08-31T06:05:44.576322+0000 mgr.a (mgr.14388) 10141 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:45 smithi191 bash[24992]: cluster 2024-08-31T06:05:44.576322+0000 mgr.a (mgr.14388) 10141 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:45 smithi163 bash[24253]: cluster 2024-08-31T06:05:44.576322+0000 mgr.a (mgr.14388) 10141 : cluster [DBG] pgmap v7029: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:47 smithi027 bash[22610]: cluster 2024-08-31T06:05:46.577109+0000 mgr.a (mgr.14388) 10142 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:48.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:47 smithi191 bash[24992]: cluster 2024-08-31T06:05:46.577109+0000 mgr.a (mgr.14388) 10142 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:48.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:48.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:48.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:05:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:47 smithi163 bash[24253]: cluster 2024-08-31T06:05:46.577109+0000 mgr.a (mgr.14388) 10142 : cluster [DBG] pgmap v7030: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:48.962 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:05:48.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:05:48.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:05:48.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:05:48.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:05:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:49 smithi027 bash[22610]: audit 2024-08-31T06:05:48.519115+0000 mgr.a (mgr.14388) 10143 : audit [DBG] from='client.224601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:49 smithi027 bash[22610]: cluster 2024-08-31T06:05:48.578984+0000 mgr.a (mgr.14388) 10144 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:49 smithi191 bash[24992]: audit 2024-08-31T06:05:48.519115+0000 mgr.a (mgr.14388) 10143 : audit [DBG] from='client.224601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:50.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:49 smithi191 bash[24992]: cluster 2024-08-31T06:05:48.578984+0000 mgr.a (mgr.14388) 10144 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:49 smithi163 bash[24253]: audit 2024-08-31T06:05:48.519115+0000 mgr.a (mgr.14388) 10143 : audit [DBG] from='client.224601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:49 smithi163 bash[24253]: cluster 2024-08-31T06:05:48.578984+0000 mgr.a (mgr.14388) 10144 : cluster [DBG] pgmap v7031: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:51 smithi027 bash[22610]: cluster 2024-08-31T06:05:50.579943+0000 mgr.a (mgr.14388) 10145 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:51 smithi191 bash[24992]: cluster 2024-08-31T06:05:50.579943+0000 mgr.a (mgr.14388) 10145 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:51 smithi163 bash[24253]: cluster 2024-08-31T06:05:50.579943+0000 mgr.a (mgr.14388) 10145 : cluster [DBG] pgmap v7032: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:05:53.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:53.964 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:53.965 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:05:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:53 smithi027 bash[22610]: cluster 2024-08-31T06:05:52.580744+0000 mgr.a (mgr.14388) 10146 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:05:54.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:53 smithi191 bash[24992]: cluster 2024-08-31T06:05:52.580744+0000 mgr.a (mgr.14388) 10146 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:05:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:53 smithi163 bash[24253]: cluster 2024-08-31T06:05:52.580744+0000 mgr.a (mgr.14388) 10146 : cluster [DBG] pgmap v7033: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:05:54.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:05:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:05:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:05:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:05:54.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:05:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:55 smithi191 bash[24992]: audit 2024-08-31T06:05:54.298462+0000 mgr.a (mgr.14388) 10147 : audit [DBG] from='client.224679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:55 smithi191 bash[24992]: cluster 2024-08-31T06:05:54.582006+0000 mgr.a (mgr.14388) 10148 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:55 smithi163 bash[24253]: audit 2024-08-31T06:05:54.298462+0000 mgr.a (mgr.14388) 10147 : audit [DBG] from='client.224679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:55 smithi163 bash[24253]: cluster 2024-08-31T06:05:54.582006+0000 mgr.a (mgr.14388) 10148 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:55 smithi027 bash[22610]: audit 2024-08-31T06:05:54.298462+0000 mgr.a (mgr.14388) 10147 : audit [DBG] from='client.224679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:05:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:55 smithi027 bash[22610]: cluster 2024-08-31T06:05:54.582006+0000 mgr.a (mgr.14388) 10148 : cluster [DBG] pgmap v7034: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:57 smithi191 bash[24992]: cluster 2024-08-31T06:05:56.582894+0000 mgr.a (mgr.14388) 10149 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:57 smithi163 bash[24253]: cluster 2024-08-31T06:05:56.582894+0000 mgr.a (mgr.14388) 10149 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:57 smithi027 bash[22610]: cluster 2024-08-31T06:05:56.582894+0000 mgr.a (mgr.14388) 10149 : cluster [DBG] pgmap v7035: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:05:59.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:05:59.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:05:59.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:05:59 smithi191 bash[24992]: cluster 2024-08-31T06:05:58.585107+0000 mgr.a (mgr.14388) 10150 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:05:59 smithi163 bash[24253]: cluster 2024-08-31T06:05:58.585107+0000 mgr.a (mgr.14388) 10150 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:05:59 smithi027 bash[22610]: cluster 2024-08-31T06:05:58.585107+0000 mgr.a (mgr.14388) 10150 : cluster [DBG] pgmap v7036: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:00.497 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:00.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:01 smithi191 bash[24992]: audit 2024-08-31T06:06:00.056076+0000 mgr.a (mgr.14388) 10151 : audit [DBG] from='client.224751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:01 smithi191 bash[24992]: cluster 2024-08-31T06:06:00.586098+0000 mgr.a (mgr.14388) 10152 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:01 smithi163 bash[24253]: audit 2024-08-31T06:06:00.056076+0000 mgr.a (mgr.14388) 10151 : audit [DBG] from='client.224751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:01 smithi163 bash[24253]: cluster 2024-08-31T06:06:00.586098+0000 mgr.a (mgr.14388) 10152 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:01 smithi027 bash[22610]: audit 2024-08-31T06:06:00.056076+0000 mgr.a (mgr.14388) 10151 : audit [DBG] from='client.224751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:01 smithi027 bash[22610]: cluster 2024-08-31T06:06:00.586098+0000 mgr.a (mgr.14388) 10152 : cluster [DBG] pgmap v7037: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:03 smithi191 bash[24992]: cluster 2024-08-31T06:06:02.586934+0000 mgr.a (mgr.14388) 10153 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:03 smithi163 bash[24253]: cluster 2024-08-31T06:06:02.586934+0000 mgr.a (mgr.14388) 10153 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:03 smithi027 bash[22610]: cluster 2024-08-31T06:06:02.586934+0000 mgr.a (mgr.14388) 10153 : cluster [DBG] pgmap v7038: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:05.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:06:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:06:05.499 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:05 smithi191 bash[24992]: cluster 2024-08-31T06:06:04.589093+0000 mgr.a (mgr.14388) 10154 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:05 smithi163 bash[24253]: cluster 2024-08-31T06:06:04.589093+0000 mgr.a (mgr.14388) 10154 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:05 smithi027 bash[22610]: cluster 2024-08-31T06:06:04.589093+0000 mgr.a (mgr.14388) 10154 : cluster [DBG] pgmap v7039: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:06.285 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:06.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:06 smithi191 bash[24992]: audit 2024-08-31T06:06:05.838764+0000 mgr.a (mgr.14388) 10155 : audit [DBG] from='client.224829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:06 smithi163 bash[24253]: audit 2024-08-31T06:06:05.838764+0000 mgr.a (mgr.14388) 10155 : audit [DBG] from='client.224829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:06 smithi027 bash[22610]: audit 2024-08-31T06:06:05.838764+0000 mgr.a (mgr.14388) 10155 : audit [DBG] from='client.224829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:07 smithi191 bash[24992]: cluster 2024-08-31T06:06:06.590026+0000 mgr.a (mgr.14388) 10156 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:07 smithi163 bash[24253]: cluster 2024-08-31T06:06:06.590026+0000 mgr.a (mgr.14388) 10156 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:07 smithi027 bash[22610]: cluster 2024-08-31T06:06:06.590026+0000 mgr.a (mgr.14388) 10156 : cluster [DBG] pgmap v7040: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:10.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:09 smithi191 bash[24992]: cluster 2024-08-31T06:06:08.593087+0000 mgr.a (mgr.14388) 10157 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:09 smithi163 bash[24253]: cluster 2024-08-31T06:06:08.593087+0000 mgr.a (mgr.14388) 10157 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:09 smithi027 bash[22610]: cluster 2024-08-31T06:06:08.593087+0000 mgr.a (mgr.14388) 10157 : cluster [DBG] pgmap v7041: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:06:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:06:11.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:11 smithi191 bash[24992]: cluster 2024-08-31T06:06:10.594018+0000 mgr.a (mgr.14388) 10158 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:12.047 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:12.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:12.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:12.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:12.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:11 smithi163 bash[24253]: cluster 2024-08-31T06:06:10.594018+0000 mgr.a (mgr.14388) 10158 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:11 smithi027 bash[22610]: cluster 2024-08-31T06:06:10.594018+0000 mgr.a (mgr.14388) 10158 : cluster [DBG] pgmap v7042: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:13.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:12 smithi191 bash[24992]: audit 2024-08-31T06:06:11.620139+0000 mgr.a (mgr.14388) 10159 : audit [DBG] from='client.224907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:12 smithi163 bash[24253]: audit 2024-08-31T06:06:11.620139+0000 mgr.a (mgr.14388) 10159 : audit [DBG] from='client.224907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:12 smithi027 bash[22610]: audit 2024-08-31T06:06:11.620139+0000 mgr.a (mgr.14388) 10159 : audit [DBG] from='client.224907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:13 smithi163 bash[24253]: cluster 2024-08-31T06:06:12.594969+0000 mgr.a (mgr.14388) 10160 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:13 smithi163 bash[24253]: audit 2024-08-31T06:06:13.593583+0000 mon.a (mon.0) 2096 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:06:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:13 smithi027 bash[22610]: cluster 2024-08-31T06:06:12.594969+0000 mgr.a (mgr.14388) 10160 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:13 smithi027 bash[22610]: audit 2024-08-31T06:06:13.593583+0000 mon.a (mon.0) 2096 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:06:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:13 smithi191 bash[24992]: cluster 2024-08-31T06:06:12.594969+0000 mgr.a (mgr.14388) 10160 : cluster [DBG] pgmap v7043: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:13 smithi191 bash[24992]: audit 2024-08-31T06:06:13.593583+0000 mon.a (mon.0) 2096 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:06:15.162 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:14 smithi027 bash[22610]: audit 2024-08-31T06:06:14.428304+0000 mon.a (mon.0) 2097 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:06:15.163 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:14 smithi027 bash[22610]: audit 2024-08-31T06:06:14.430095+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:06:15.163 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:14 smithi027 bash[22610]: audit 2024-08-31T06:06:14.439678+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:06:15.163 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:14 smithi027 bash[22610]: audit 2024-08-31T06:06:14.443163+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:06:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:14 smithi163 bash[24253]: audit 2024-08-31T06:06:14.428304+0000 mon.a (mon.0) 2097 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:06:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:14 smithi163 bash[24253]: audit 2024-08-31T06:06:14.430095+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:06:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:14 smithi163 bash[24253]: audit 2024-08-31T06:06:14.439678+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:06:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:14 smithi163 bash[24253]: audit 2024-08-31T06:06:14.443163+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:06:15.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:14 smithi191 bash[24992]: audit 2024-08-31T06:06:14.428304+0000 mon.a (mon.0) 2097 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:06:15.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:14 smithi191 bash[24992]: audit 2024-08-31T06:06:14.430095+0000 mon.a (mon.0) 2098 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:06:15.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:14 smithi191 bash[24992]: audit 2024-08-31T06:06:14.439678+0000 mon.a (mon.0) 2099 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:06:15.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:14 smithi191 bash[24992]: audit 2024-08-31T06:06:14.443163+0000 mon.a (mon.0) 2100 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:06:15.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:06:15 smithi027 bash[22863]: debug 2024-08-31T06:06:15.158+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:06:15.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:06:15 smithi027 bash[22863]: debug 2024-08-31T06:06:15.162+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:06:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:15 smithi163 bash[24253]: audit 2024-08-31T06:06:14.445482+0000 mgr.a (mgr.14388) 10161 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:06:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:15 smithi163 bash[24253]: cluster 2024-08-31T06:06:14.596264+0000 mgr.a (mgr.14388) 10162 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:15 smithi027 bash[22610]: audit 2024-08-31T06:06:14.445482+0000 mgr.a (mgr.14388) 10161 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:06:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:15 smithi027 bash[22610]: cluster 2024-08-31T06:06:14.596264+0000 mgr.a (mgr.14388) 10162 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:16.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:15 smithi191 bash[24992]: audit 2024-08-31T06:06:14.445482+0000 mgr.a (mgr.14388) 10161 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:06:16.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:15 smithi191 bash[24992]: cluster 2024-08-31T06:06:14.596264+0000 mgr.a (mgr.14388) 10162 : cluster [DBG] pgmap v7044: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:17.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:06:17.050 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:06:17.050 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:16 smithi163 bash[24253]: audit 2024-08-31T06:06:15.162225+0000 mgr.a (mgr.14388) 10163 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:06:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:16 smithi163 bash[24253]: cephadm 2024-08-31T06:06:15.163338+0000 mgr.a (mgr.14388) 10164 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:06:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:16 smithi027 bash[22610]: audit 2024-08-31T06:06:15.162225+0000 mgr.a (mgr.14388) 10163 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:06:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:16 smithi027 bash[22610]: cephadm 2024-08-31T06:06:15.163338+0000 mgr.a (mgr.14388) 10164 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:06:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:16 smithi191 bash[24992]: audit 2024-08-31T06:06:15.162225+0000 mgr.a (mgr.14388) 10163 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:06:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:16 smithi191 bash[24992]: cephadm 2024-08-31T06:06:15.163338+0000 mgr.a (mgr.14388) 10164 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:06:17.806 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:17.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:17.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:17.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:17.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:17 smithi163 bash[24253]: cluster 2024-08-31T06:06:16.597078+0000 mgr.a (mgr.14388) 10165 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:17 smithi027 bash[22610]: cluster 2024-08-31T06:06:16.597078+0000 mgr.a (mgr.14388) 10165 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:17 smithi191 bash[24992]: cluster 2024-08-31T06:06:16.597078+0000 mgr.a (mgr.14388) 10165 : cluster [DBG] pgmap v7045: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:18 smithi163 bash[24253]: audit 2024-08-31T06:06:17.379663+0000 mgr.a (mgr.14388) 10166 : audit [DBG] from='client.225093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:18 smithi027 bash[22610]: audit 2024-08-31T06:06:17.379663+0000 mgr.a (mgr.14388) 10166 : audit [DBG] from='client.225093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:18 smithi191 bash[24992]: audit 2024-08-31T06:06:17.379663+0000 mgr.a (mgr.14388) 10166 : audit [DBG] from='client.225093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:19 smithi163 bash[24253]: cluster 2024-08-31T06:06:18.599505+0000 mgr.a (mgr.14388) 10167 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:19 smithi027 bash[22610]: cluster 2024-08-31T06:06:18.599505+0000 mgr.a (mgr.14388) 10167 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:19 smithi191 bash[24992]: cluster 2024-08-31T06:06:18.599505+0000 mgr.a (mgr.14388) 10167 : cluster [DBG] pgmap v7046: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:21 smithi163 bash[24253]: cluster 2024-08-31T06:06:20.600327+0000 mgr.a (mgr.14388) 10168 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:21 smithi027 bash[22610]: cluster 2024-08-31T06:06:20.600327+0000 mgr.a (mgr.14388) 10168 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:21 smithi191 bash[24992]: cluster 2024-08-31T06:06:20.600327+0000 mgr.a (mgr.14388) 10168 : cluster [DBG] pgmap v7047: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:22.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:06:22.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:06:22.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:23.581 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:23.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:23.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:23.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:23.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:23 smithi163 bash[24253]: cluster 2024-08-31T06:06:22.601098+0000 mgr.a (mgr.14388) 10169 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:23 smithi027 bash[22610]: cluster 2024-08-31T06:06:22.601098+0000 mgr.a (mgr.14388) 10169 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:23 smithi191 bash[24992]: cluster 2024-08-31T06:06:22.601098+0000 mgr.a (mgr.14388) 10169 : cluster [DBG] pgmap v7048: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:24 smithi163 bash[24253]: audit 2024-08-31T06:06:23.147047+0000 mgr.a (mgr.14388) 10170 : audit [DBG] from='client.225168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:24 smithi027 bash[22610]: audit 2024-08-31T06:06:23.147047+0000 mgr.a (mgr.14388) 10170 : audit [DBG] from='client.225168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:24 smithi191 bash[24992]: audit 2024-08-31T06:06:23.147047+0000 mgr.a (mgr.14388) 10170 : audit [DBG] from='client.225168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:25 smithi163 bash[24253]: cluster 2024-08-31T06:06:24.603819+0000 mgr.a (mgr.14388) 10171 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:25 smithi027 bash[22610]: cluster 2024-08-31T06:06:24.603819+0000 mgr.a (mgr.14388) 10171 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:25 smithi191 bash[24992]: cluster 2024-08-31T06:06:24.603819+0000 mgr.a (mgr.14388) 10171 : cluster [DBG] pgmap v7049: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:27 smithi163 bash[24253]: cluster 2024-08-31T06:06:26.604626+0000 mgr.a (mgr.14388) 10172 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:06:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:27 smithi027 bash[22610]: cluster 2024-08-31T06:06:26.604626+0000 mgr.a (mgr.14388) 10172 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:06:28.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:27 smithi191 bash[24992]: cluster 2024-08-31T06:06:26.604626+0000 mgr.a (mgr.14388) 10172 : cluster [DBG] pgmap v7050: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:06:28.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:06:28.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:06:28.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:29.353 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:29.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:29.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:29.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:29.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:29 smithi163 bash[24253]: cluster 2024-08-31T06:06:28.606645+0000 mgr.a (mgr.14388) 10173 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:29 smithi163 bash[24253]: audit 2024-08-31T06:06:28.926119+0000 mgr.a (mgr.14388) 10174 : audit [DBG] from='client.225246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:29 smithi027 bash[22610]: cluster 2024-08-31T06:06:28.606645+0000 mgr.a (mgr.14388) 10173 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:29 smithi027 bash[22610]: audit 2024-08-31T06:06:28.926119+0000 mgr.a (mgr.14388) 10174 : audit [DBG] from='client.225246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:29 smithi191 bash[24992]: cluster 2024-08-31T06:06:28.606645+0000 mgr.a (mgr.14388) 10173 : cluster [DBG] pgmap v7051: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:06:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:29 smithi191 bash[24992]: audit 2024-08-31T06:06:28.926119+0000 mgr.a (mgr.14388) 10174 : audit [DBG] from='client.225246 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:31 smithi163 bash[24253]: cluster 2024-08-31T06:06:30.607645+0000 mgr.a (mgr.14388) 10175 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:06:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:31 smithi027 bash[22610]: cluster 2024-08-31T06:06:30.607645+0000 mgr.a (mgr.14388) 10175 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:06:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:31 smithi191 bash[24992]: cluster 2024-08-31T06:06:30.607645+0000 mgr.a (mgr.14388) 10175 : cluster [DBG] pgmap v7052: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:06:34.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:33 smithi163 bash[24253]: cluster 2024-08-31T06:06:32.608446+0000 mgr.a (mgr.14388) 10176 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:06:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:33 smithi027 bash[22610]: cluster 2024-08-31T06:06:32.608446+0000 mgr.a (mgr.14388) 10176 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:06:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:33 smithi191 bash[24992]: cluster 2024-08-31T06:06:32.608446+0000 mgr.a (mgr.14388) 10176 : cluster [DBG] pgmap v7053: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:06:34.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:06:34.355 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:06:34.356 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:35.099 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:35.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:35.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:35.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:35.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:36.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:35 smithi163 bash[24253]: cluster 2024-08-31T06:06:34.610575+0000 mgr.a (mgr.14388) 10177 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:36.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:35 smithi163 bash[24253]: audit 2024-08-31T06:06:34.676637+0000 mgr.a (mgr.14388) 10178 : audit [DBG] from='client.225324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:35 smithi027 bash[22610]: cluster 2024-08-31T06:06:34.610575+0000 mgr.a (mgr.14388) 10177 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:35 smithi027 bash[22610]: audit 2024-08-31T06:06:34.676637+0000 mgr.a (mgr.14388) 10178 : audit [DBG] from='client.225324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:35 smithi191 bash[24992]: cluster 2024-08-31T06:06:34.610575+0000 mgr.a (mgr.14388) 10177 : cluster [DBG] pgmap v7054: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:35 smithi191 bash[24992]: audit 2024-08-31T06:06:34.676637+0000 mgr.a (mgr.14388) 10178 : audit [DBG] from='client.225324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:38.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:37 smithi163 bash[24253]: cluster 2024-08-31T06:06:36.611490+0000 mgr.a (mgr.14388) 10179 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:37 smithi027 bash[22610]: cluster 2024-08-31T06:06:36.611490+0000 mgr.a (mgr.14388) 10179 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:37 smithi191 bash[24992]: cluster 2024-08-31T06:06:36.611490+0000 mgr.a (mgr.14388) 10179 : cluster [DBG] pgmap v7055: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:40.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:06:40.101 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:06:40.101 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:39 smithi163 bash[24253]: cluster 2024-08-31T06:06:38.613706+0000 mgr.a (mgr.14388) 10180 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:39 smithi027 bash[22610]: cluster 2024-08-31T06:06:38.613706+0000 mgr.a (mgr.14388) 10180 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:40.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:39 smithi191 bash[24992]: cluster 2024-08-31T06:06:38.613706+0000 mgr.a (mgr.14388) 10180 : cluster [DBG] pgmap v7056: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:40.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:40.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:40.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:40.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:40.879 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:41 smithi163 bash[24253]: audit 2024-08-31T06:06:40.441201+0000 mgr.a (mgr.14388) 10181 : audit [DBG] from='client.225402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:41 smithi163 bash[24253]: cluster 2024-08-31T06:06:40.614255+0000 mgr.a (mgr.14388) 10182 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:41 smithi027 bash[22610]: audit 2024-08-31T06:06:40.441201+0000 mgr.a (mgr.14388) 10181 : audit [DBG] from='client.225402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:41 smithi027 bash[22610]: cluster 2024-08-31T06:06:40.614255+0000 mgr.a (mgr.14388) 10182 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:41 smithi191 bash[24992]: audit 2024-08-31T06:06:40.441201+0000 mgr.a (mgr.14388) 10181 : audit [DBG] from='client.225402 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:41 smithi191 bash[24992]: cluster 2024-08-31T06:06:40.614255+0000 mgr.a (mgr.14388) 10182 : cluster [DBG] pgmap v7057: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:43 smithi163 bash[24253]: cluster 2024-08-31T06:06:42.615166+0000 mgr.a (mgr.14388) 10183 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:43 smithi027 bash[22610]: cluster 2024-08-31T06:06:42.615166+0000 mgr.a (mgr.14388) 10183 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:44.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:43 smithi191 bash[24992]: cluster 2024-08-31T06:06:42.615166+0000 mgr.a (mgr.14388) 10183 : cluster [DBG] pgmap v7058: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:45.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:06:45.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:06:45.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:45 smithi163 bash[24253]: cluster 2024-08-31T06:06:44.617384+0000 mgr.a (mgr.14388) 10184 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:45 smithi027 bash[22610]: cluster 2024-08-31T06:06:44.617384+0000 mgr.a (mgr.14388) 10184 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:45 smithi191 bash[24992]: cluster 2024-08-31T06:06:44.617384+0000 mgr.a (mgr.14388) 10184 : cluster [DBG] pgmap v7059: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:46.624 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:46.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:47 smithi163 bash[24253]: audit 2024-08-31T06:06:46.210986+0000 mgr.a (mgr.14388) 10185 : audit [DBG] from='client.225480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:47 smithi163 bash[24253]: cluster 2024-08-31T06:06:46.617891+0000 mgr.a (mgr.14388) 10186 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:47 smithi027 bash[22610]: audit 2024-08-31T06:06:46.210986+0000 mgr.a (mgr.14388) 10185 : audit [DBG] from='client.225480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:47 smithi027 bash[22610]: cluster 2024-08-31T06:06:46.617891+0000 mgr.a (mgr.14388) 10186 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:47 smithi191 bash[24992]: audit 2024-08-31T06:06:46.210986+0000 mgr.a (mgr.14388) 10185 : audit [DBG] from='client.225480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:47 smithi191 bash[24992]: cluster 2024-08-31T06:06:46.617891+0000 mgr.a (mgr.14388) 10186 : cluster [DBG] pgmap v7060: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:49 smithi163 bash[24253]: cluster 2024-08-31T06:06:48.620003+0000 mgr.a (mgr.14388) 10187 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:49 smithi027 bash[22610]: cluster 2024-08-31T06:06:48.620003+0000 mgr.a (mgr.14388) 10187 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:49 smithi191 bash[24992]: cluster 2024-08-31T06:06:48.620003+0000 mgr.a (mgr.14388) 10187 : cluster [DBG] pgmap v7061: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:51.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:06:51.626 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:06:51.627 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:51 smithi163 bash[24253]: cluster 2024-08-31T06:06:50.620755+0000 mgr.a (mgr.14388) 10188 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:51 smithi027 bash[22610]: cluster 2024-08-31T06:06:50.620755+0000 mgr.a (mgr.14388) 10188 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:51 smithi191 bash[24992]: cluster 2024-08-31T06:06:50.620755+0000 mgr.a (mgr.14388) 10188 : cluster [DBG] pgmap v7062: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:52.385 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:52.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:52.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:52.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:52.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:53 smithi163 bash[24253]: audit 2024-08-31T06:06:51.960671+0000 mgr.a (mgr.14388) 10189 : audit [DBG] from='client.225555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:53 smithi163 bash[24253]: cluster 2024-08-31T06:06:52.621685+0000 mgr.a (mgr.14388) 10190 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:53 smithi027 bash[22610]: audit 2024-08-31T06:06:51.960671+0000 mgr.a (mgr.14388) 10189 : audit [DBG] from='client.225555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:53 smithi027 bash[22610]: cluster 2024-08-31T06:06:52.621685+0000 mgr.a (mgr.14388) 10190 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:53 smithi191 bash[24992]: audit 2024-08-31T06:06:51.960671+0000 mgr.a (mgr.14388) 10189 : audit [DBG] from='client.225555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:53 smithi191 bash[24992]: cluster 2024-08-31T06:06:52.621685+0000 mgr.a (mgr.14388) 10190 : cluster [DBG] pgmap v7063: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:55 smithi163 bash[24253]: cluster 2024-08-31T06:06:54.623962+0000 mgr.a (mgr.14388) 10191 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:55 smithi027 bash[22610]: cluster 2024-08-31T06:06:54.623962+0000 mgr.a (mgr.14388) 10191 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:55 smithi191 bash[24992]: cluster 2024-08-31T06:06:54.623962+0000 mgr.a (mgr.14388) 10191 : cluster [DBG] pgmap v7064: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:06:57.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:06:57.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:06:57.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:06:58.147 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:06:58.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:06:58.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:06:58.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:06:58.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:06:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:57 smithi163 bash[24253]: cluster 2024-08-31T06:06:56.624728+0000 mgr.a (mgr.14388) 10192 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:57 smithi027 bash[22610]: cluster 2024-08-31T06:06:56.624728+0000 mgr.a (mgr.14388) 10192 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:57 smithi191 bash[24992]: cluster 2024-08-31T06:06:56.624728+0000 mgr.a (mgr.14388) 10192 : cluster [DBG] pgmap v7065: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:06:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:58 smithi163 bash[24253]: audit 2024-08-31T06:06:57.725803+0000 mgr.a (mgr.14388) 10193 : audit [DBG] from='client.225630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:58 smithi027 bash[22610]: audit 2024-08-31T06:06:57.725803+0000 mgr.a (mgr.14388) 10193 : audit [DBG] from='client.225630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:06:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:58 smithi191 bash[24992]: audit 2024-08-31T06:06:57.725803+0000 mgr.a (mgr.14388) 10193 : audit [DBG] from='client.225630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:06:59 smithi163 bash[24253]: cluster 2024-08-31T06:06:58.627541+0000 mgr.a (mgr.14388) 10194 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:06:59 smithi027 bash[22610]: cluster 2024-08-31T06:06:58.627541+0000 mgr.a (mgr.14388) 10194 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:06:59 smithi191 bash[24992]: cluster 2024-08-31T06:06:58.627541+0000 mgr.a (mgr.14388) 10194 : cluster [DBG] pgmap v7066: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:01 smithi163 bash[24253]: cluster 2024-08-31T06:07:00.628338+0000 mgr.a (mgr.14388) 10195 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:01 smithi027 bash[22610]: cluster 2024-08-31T06:07:00.628338+0000 mgr.a (mgr.14388) 10195 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:01 smithi191 bash[24992]: cluster 2024-08-31T06:07:00.628338+0000 mgr.a (mgr.14388) 10195 : cluster [DBG] pgmap v7067: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:03.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:07:03.150 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:07:03.150 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:07:03.905 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:07:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:07:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:07:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:07:03.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:07:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:03 smithi163 bash[24253]: cluster 2024-08-31T06:07:02.629080+0000 mgr.a (mgr.14388) 10196 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:07:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:03 smithi027 bash[22610]: cluster 2024-08-31T06:07:02.629080+0000 mgr.a (mgr.14388) 10196 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:07:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:03 smithi191 bash[24992]: cluster 2024-08-31T06:07:02.629080+0000 mgr.a (mgr.14388) 10196 : cluster [DBG] pgmap v7068: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:07:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:04 smithi163 bash[24253]: audit 2024-08-31T06:07:03.482812+0000 mgr.a (mgr.14388) 10197 : audit [DBG] from='client.225705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:04 smithi027 bash[22610]: audit 2024-08-31T06:07:03.482812+0000 mgr.a (mgr.14388) 10197 : audit [DBG] from='client.225705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:04 smithi191 bash[24992]: audit 2024-08-31T06:07:03.482812+0000 mgr.a (mgr.14388) 10197 : audit [DBG] from='client.225705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:05 smithi163 bash[24253]: cluster 2024-08-31T06:07:04.631881+0000 mgr.a (mgr.14388) 10198 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:05 smithi027 bash[22610]: cluster 2024-08-31T06:07:04.631881+0000 mgr.a (mgr.14388) 10198 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:05 smithi191 bash[24992]: cluster 2024-08-31T06:07:04.631881+0000 mgr.a (mgr.14388) 10198 : cluster [DBG] pgmap v7069: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:07 smithi163 bash[24253]: cluster 2024-08-31T06:07:06.632664+0000 mgr.a (mgr.14388) 10199 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:07 smithi027 bash[22610]: cluster 2024-08-31T06:07:06.632664+0000 mgr.a (mgr.14388) 10199 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:07 smithi191 bash[24992]: cluster 2024-08-31T06:07:06.632664+0000 mgr.a (mgr.14388) 10199 : cluster [DBG] pgmap v7070: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:08.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:07:08.908 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:07:08.908 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:07:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:09 smithi191 bash[24992]: cluster 2024-08-31T06:07:08.634702+0000 mgr.a (mgr.14388) 10200 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:09.689 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:07:09.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:07:09.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:07:09.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:07:09.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:07:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:09 smithi163 bash[24253]: cluster 2024-08-31T06:07:08.634702+0000 mgr.a (mgr.14388) 10200 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:09 smithi027 bash[22610]: cluster 2024-08-31T06:07:08.634702+0000 mgr.a (mgr.14388) 10200 : cluster [DBG] pgmap v7071: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:10.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:10 smithi191 bash[24992]: audit 2024-08-31T06:07:09.242842+0000 mgr.a (mgr.14388) 10201 : audit [DBG] from='client.225783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:10.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:10 smithi163 bash[24253]: audit 2024-08-31T06:07:09.242842+0000 mgr.a (mgr.14388) 10201 : audit [DBG] from='client.225783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:10 smithi027 bash[22610]: audit 2024-08-31T06:07:09.242842+0000 mgr.a (mgr.14388) 10201 : audit [DBG] from='client.225783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:11 smithi163 bash[24253]: cluster 2024-08-31T06:07:10.635604+0000 mgr.a (mgr.14388) 10202 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:11 smithi027 bash[22610]: cluster 2024-08-31T06:07:10.635604+0000 mgr.a (mgr.14388) 10202 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:11.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:11 smithi191 bash[24992]: cluster 2024-08-31T06:07:10.635604+0000 mgr.a (mgr.14388) 10202 : cluster [DBG] pgmap v7072: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:13.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:13 smithi163 bash[24253]: cluster 2024-08-31T06:07:12.636383+0000 mgr.a (mgr.14388) 10203 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:13 smithi027 bash[22610]: cluster 2024-08-31T06:07:12.636383+0000 mgr.a (mgr.14388) 10203 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:13 smithi191 bash[24992]: cluster 2024-08-31T06:07:12.636383+0000 mgr.a (mgr.14388) 10203 : cluster [DBG] pgmap v7073: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:14.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:07:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:07:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:07:15.481 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:07:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:07:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:07:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:07:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:07:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:15 smithi163 bash[24253]: cluster 2024-08-31T06:07:14.638586+0000 mgr.a (mgr.14388) 10204 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:07:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:15 smithi163 bash[24253]: audit 2024-08-31T06:07:15.211873+0000 mon.a (mon.0) 2101 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:07:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:15 smithi027 bash[22610]: cluster 2024-08-31T06:07:14.638586+0000 mgr.a (mgr.14388) 10204 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:07:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:15 smithi027 bash[22610]: audit 2024-08-31T06:07:15.211873+0000 mon.a (mon.0) 2101 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:07:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:15 smithi191 bash[24992]: cluster 2024-08-31T06:07:14.638586+0000 mgr.a (mgr.14388) 10204 : cluster [DBG] pgmap v7074: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:07:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:15 smithi191 bash[24992]: audit 2024-08-31T06:07:15.211873+0000 mon.a (mon.0) 2101 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:07:17.164 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:16 smithi027 bash[22610]: audit 2024-08-31T06:07:15.029698+0000 mgr.a (mgr.14388) 10205 : audit [DBG] from='client.225861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:17.164 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:16 smithi027 bash[22610]: audit 2024-08-31T06:07:15.792724+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:07:17.164 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:16 smithi027 bash[22610]: audit 2024-08-31T06:07:15.798932+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:07:17.164 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:16 smithi027 bash[22610]: audit 2024-08-31T06:07:16.419189+0000 mon.a (mon.0) 2104 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:07:17.164 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:16 smithi027 bash[22610]: audit 2024-08-31T06:07:16.420491+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:07:17.164 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:16 smithi027 bash[22610]: audit 2024-08-31T06:07:16.427076+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:07:17.165 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:16 smithi027 bash[22610]: audit 2024-08-31T06:07:16.431691+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:07:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:16 smithi163 bash[24253]: audit 2024-08-31T06:07:15.029698+0000 mgr.a (mgr.14388) 10205 : audit [DBG] from='client.225861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:16 smithi163 bash[24253]: audit 2024-08-31T06:07:15.792724+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:07:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:16 smithi163 bash[24253]: audit 2024-08-31T06:07:15.798932+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:07:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:16 smithi163 bash[24253]: audit 2024-08-31T06:07:16.419189+0000 mon.a (mon.0) 2104 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:07:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:16 smithi163 bash[24253]: audit 2024-08-31T06:07:16.420491+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:07:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:16 smithi163 bash[24253]: audit 2024-08-31T06:07:16.427076+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:07:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:16 smithi163 bash[24253]: audit 2024-08-31T06:07:16.431691+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:07:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:16 smithi191 bash[24992]: audit 2024-08-31T06:07:15.029698+0000 mgr.a (mgr.14388) 10205 : audit [DBG] from='client.225861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:16 smithi191 bash[24992]: audit 2024-08-31T06:07:15.792724+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:07:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:16 smithi191 bash[24992]: audit 2024-08-31T06:07:15.798932+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:07:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:16 smithi191 bash[24992]: audit 2024-08-31T06:07:16.419189+0000 mon.a (mon.0) 2104 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:07:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:16 smithi191 bash[24992]: audit 2024-08-31T06:07:16.420491+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:07:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:16 smithi191 bash[24992]: audit 2024-08-31T06:07:16.427076+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:07:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:16 smithi191 bash[24992]: audit 2024-08-31T06:07:16.431691+0000 mon.a (mon.0) 2107 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:07:17.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:07:17 smithi027 bash[22863]: debug 2024-08-31T06:07:17.160+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:07:17.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:07:17 smithi027 bash[22863]: debug 2024-08-31T06:07:17.160+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:07:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:17 smithi163 bash[24253]: audit 2024-08-31T06:07:16.434133+0000 mgr.a (mgr.14388) 10206 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:07:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:17 smithi163 bash[24253]: cluster 2024-08-31T06:07:16.639069+0000 mgr.a (mgr.14388) 10207 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:17 smithi027 bash[22610]: audit 2024-08-31T06:07:16.434133+0000 mgr.a (mgr.14388) 10206 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:07:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:17 smithi027 bash[22610]: cluster 2024-08-31T06:07:16.639069+0000 mgr.a (mgr.14388) 10207 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:17 smithi191 bash[24992]: audit 2024-08-31T06:07:16.434133+0000 mgr.a (mgr.14388) 10206 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:07:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:17 smithi191 bash[24992]: cluster 2024-08-31T06:07:16.639069+0000 mgr.a (mgr.14388) 10207 : cluster [DBG] pgmap v7075: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:18 smithi163 bash[24253]: audit 2024-08-31T06:07:17.163562+0000 mgr.a (mgr.14388) 10208 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:07:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:18 smithi163 bash[24253]: cephadm 2024-08-31T06:07:17.164928+0000 mgr.a (mgr.14388) 10209 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:07:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:18 smithi027 bash[22610]: audit 2024-08-31T06:07:17.163562+0000 mgr.a (mgr.14388) 10208 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:07:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:18 smithi027 bash[22610]: cephadm 2024-08-31T06:07:17.164928+0000 mgr.a (mgr.14388) 10209 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:07:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:18 smithi191 bash[24992]: audit 2024-08-31T06:07:17.163562+0000 mgr.a (mgr.14388) 10208 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:07:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:18 smithi191 bash[24992]: cephadm 2024-08-31T06:07:17.164928+0000 mgr.a (mgr.14388) 10209 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:07:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:19 smithi163 bash[24253]: cluster 2024-08-31T06:07:18.641482+0000 mgr.a (mgr.14388) 10210 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:19 smithi027 bash[22610]: cluster 2024-08-31T06:07:18.641482+0000 mgr.a (mgr.14388) 10210 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:19 smithi191 bash[24992]: cluster 2024-08-31T06:07:18.641482+0000 mgr.a (mgr.14388) 10210 : cluster [DBG] pgmap v7076: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:20.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:07:20.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:07:20.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:07:21.255 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:07:21.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:07:21.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:07:21.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:07:21.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:07:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:21 smithi163 bash[24253]: cluster 2024-08-31T06:07:20.642206+0000 mgr.a (mgr.14388) 10211 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:21 smithi163 bash[24253]: audit 2024-08-31T06:07:20.819000+0000 mgr.a (mgr.14388) 10212 : audit [DBG] from='client.226041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:21 smithi027 bash[22610]: cluster 2024-08-31T06:07:20.642206+0000 mgr.a (mgr.14388) 10211 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:21 smithi027 bash[22610]: audit 2024-08-31T06:07:20.819000+0000 mgr.a (mgr.14388) 10212 : audit [DBG] from='client.226041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:21 smithi191 bash[24992]: cluster 2024-08-31T06:07:20.642206+0000 mgr.a (mgr.14388) 10211 : cluster [DBG] pgmap v7077: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:21 smithi191 bash[24992]: audit 2024-08-31T06:07:20.819000+0000 mgr.a (mgr.14388) 10212 : audit [DBG] from='client.226041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:23 smithi163 bash[24253]: cluster 2024-08-31T06:07:22.643120+0000 mgr.a (mgr.14388) 10213 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:23 smithi027 bash[22610]: cluster 2024-08-31T06:07:22.643120+0000 mgr.a (mgr.14388) 10213 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:23 smithi191 bash[24992]: cluster 2024-08-31T06:07:22.643120+0000 mgr.a (mgr.14388) 10213 : cluster [DBG] pgmap v7078: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:25 smithi163 bash[24253]: cluster 2024-08-31T06:07:24.645345+0000 mgr.a (mgr.14388) 10214 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:25 smithi027 bash[22610]: cluster 2024-08-31T06:07:24.645345+0000 mgr.a (mgr.14388) 10214 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:26.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:07:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:07:26.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:07:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:25 smithi191 bash[24992]: cluster 2024-08-31T06:07:24.645345+0000 mgr.a (mgr.14388) 10214 : cluster [DBG] pgmap v7079: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:27.009 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:07:27.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:07:27.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:07:27.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:07:27.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:07:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:27 smithi163 bash[24253]: audit 2024-08-31T06:07:26.588639+0000 mgr.a (mgr.14388) 10215 : audit [DBG] from='client.226116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:27 smithi163 bash[24253]: cluster 2024-08-31T06:07:26.645851+0000 mgr.a (mgr.14388) 10216 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:27 smithi027 bash[22610]: audit 2024-08-31T06:07:26.588639+0000 mgr.a (mgr.14388) 10215 : audit [DBG] from='client.226116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:27 smithi027 bash[22610]: cluster 2024-08-31T06:07:26.645851+0000 mgr.a (mgr.14388) 10216 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:28.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:27 smithi191 bash[24992]: audit 2024-08-31T06:07:26.588639+0000 mgr.a (mgr.14388) 10215 : audit [DBG] from='client.226116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:28.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:27 smithi191 bash[24992]: cluster 2024-08-31T06:07:26.645851+0000 mgr.a (mgr.14388) 10216 : cluster [DBG] pgmap v7080: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:29 smithi163 bash[24253]: cluster 2024-08-31T06:07:28.648143+0000 mgr.a (mgr.14388) 10217 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:29 smithi027 bash[22610]: cluster 2024-08-31T06:07:28.648143+0000 mgr.a (mgr.14388) 10217 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:29 smithi191 bash[24992]: cluster 2024-08-31T06:07:28.648143+0000 mgr.a (mgr.14388) 10217 : cluster [DBG] pgmap v7081: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:07:32.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:07:32.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:07:32.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:07:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:31 smithi163 bash[24253]: cluster 2024-08-31T06:07:30.648918+0000 mgr.a (mgr.14388) 10218 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:31 smithi027 bash[22610]: cluster 2024-08-31T06:07:30.648918+0000 mgr.a (mgr.14388) 10218 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:31 smithi191 bash[24992]: cluster 2024-08-31T06:07:30.648918+0000 mgr.a (mgr.14388) 10218 : cluster [DBG] pgmap v7082: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:32.782 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:07:32.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:07:32.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:07:32.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:07:32.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:07:34.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:33 smithi163 bash[24253]: audit 2024-08-31T06:07:32.345357+0000 mgr.a (mgr.14388) 10219 : audit [DBG] from='client.226191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:34.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:33 smithi163 bash[24253]: cluster 2024-08-31T06:07:32.649496+0000 mgr.a (mgr.14388) 10220 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:34.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:33 smithi027 bash[22610]: audit 2024-08-31T06:07:32.345357+0000 mgr.a (mgr.14388) 10219 : audit [DBG] from='client.226191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:34.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:33 smithi027 bash[22610]: cluster 2024-08-31T06:07:32.649496+0000 mgr.a (mgr.14388) 10220 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:33 smithi191 bash[24992]: audit 2024-08-31T06:07:32.345357+0000 mgr.a (mgr.14388) 10219 : audit [DBG] from='client.226191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:33 smithi191 bash[24992]: cluster 2024-08-31T06:07:32.649496+0000 mgr.a (mgr.14388) 10220 : cluster [DBG] pgmap v7083: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:36.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:35 smithi163 bash[24253]: cluster 2024-08-31T06:07:34.651820+0000 mgr.a (mgr.14388) 10221 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:07:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:35 smithi027 bash[22610]: cluster 2024-08-31T06:07:34.651820+0000 mgr.a (mgr.14388) 10221 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:07:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:35 smithi191 bash[24992]: cluster 2024-08-31T06:07:34.651820+0000 mgr.a (mgr.14388) 10221 : cluster [DBG] pgmap v7084: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:07:37.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:07:37.785 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:07:37.785 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:07:38.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:37 smithi163 bash[24253]: cluster 2024-08-31T06:07:36.652594+0000 mgr.a (mgr.14388) 10222 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:37 smithi027 bash[22610]: cluster 2024-08-31T06:07:36.652594+0000 mgr.a (mgr.14388) 10222 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:37 smithi191 bash[24992]: cluster 2024-08-31T06:07:36.652594+0000 mgr.a (mgr.14388) 10222 : cluster [DBG] pgmap v7085: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:38.541 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:07:38.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:07:38.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:07:38.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:07:38.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:07:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:39 smithi163 bash[24253]: audit 2024-08-31T06:07:38.119077+0000 mgr.a (mgr.14388) 10223 : audit [DBG] from='client.226266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:39 smithi163 bash[24253]: cluster 2024-08-31T06:07:38.655343+0000 mgr.a (mgr.14388) 10224 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:39 smithi027 bash[22610]: audit 2024-08-31T06:07:38.119077+0000 mgr.a (mgr.14388) 10223 : audit [DBG] from='client.226266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:39 smithi027 bash[22610]: cluster 2024-08-31T06:07:38.655343+0000 mgr.a (mgr.14388) 10224 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:40.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:39 smithi191 bash[24992]: audit 2024-08-31T06:07:38.119077+0000 mgr.a (mgr.14388) 10223 : audit [DBG] from='client.226266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:40.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:39 smithi191 bash[24992]: cluster 2024-08-31T06:07:38.655343+0000 mgr.a (mgr.14388) 10224 : cluster [DBG] pgmap v7086: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:41 smithi163 bash[24253]: cluster 2024-08-31T06:07:40.656098+0000 mgr.a (mgr.14388) 10225 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:41 smithi027 bash[22610]: cluster 2024-08-31T06:07:40.656098+0000 mgr.a (mgr.14388) 10225 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:41 smithi191 bash[24992]: cluster 2024-08-31T06:07:40.656098+0000 mgr.a (mgr.14388) 10225 : cluster [DBG] pgmap v7087: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:43.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:07:43.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:07:43.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:07:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:43 smithi163 bash[24253]: cluster 2024-08-31T06:07:42.656882+0000 mgr.a (mgr.14388) 10226 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:07:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:43 smithi027 bash[22610]: cluster 2024-08-31T06:07:42.656882+0000 mgr.a (mgr.14388) 10226 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:07:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:43 smithi191 bash[24992]: cluster 2024-08-31T06:07:42.656882+0000 mgr.a (mgr.14388) 10226 : cluster [DBG] pgmap v7088: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:07:44.324 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:07:44.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:07:44.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:07:44.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:07:44.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:07:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:44 smithi163 bash[24253]: audit 2024-08-31T06:07:43.882284+0000 mgr.a (mgr.14388) 10227 : audit [DBG] from='client.226341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:44 smithi027 bash[22610]: audit 2024-08-31T06:07:43.882284+0000 mgr.a (mgr.14388) 10227 : audit [DBG] from='client.226341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:45.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:44 smithi191 bash[24992]: audit 2024-08-31T06:07:43.882284+0000 mgr.a (mgr.14388) 10227 : audit [DBG] from='client.226341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:45 smithi163 bash[24253]: cluster 2024-08-31T06:07:44.659754+0000 mgr.a (mgr.14388) 10228 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:45 smithi027 bash[22610]: cluster 2024-08-31T06:07:44.659754+0000 mgr.a (mgr.14388) 10228 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:45 smithi191 bash[24992]: cluster 2024-08-31T06:07:44.659754+0000 mgr.a (mgr.14388) 10228 : cluster [DBG] pgmap v7089: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:47 smithi163 bash[24253]: cluster 2024-08-31T06:07:46.660549+0000 mgr.a (mgr.14388) 10229 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:47 smithi027 bash[22610]: cluster 2024-08-31T06:07:46.660549+0000 mgr.a (mgr.14388) 10229 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:47 smithi191 bash[24992]: cluster 2024-08-31T06:07:46.660549+0000 mgr.a (mgr.14388) 10229 : cluster [DBG] pgmap v7090: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:07:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:07:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:07:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:07:50.096 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:07:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:07:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:07:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:07:50.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:07:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:49 smithi163 bash[24253]: cluster 2024-08-31T06:07:48.662456+0000 mgr.a (mgr.14388) 10230 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:49 smithi027 bash[22610]: cluster 2024-08-31T06:07:48.662456+0000 mgr.a (mgr.14388) 10230 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:50.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:49 smithi191 bash[24992]: cluster 2024-08-31T06:07:48.662456+0000 mgr.a (mgr.14388) 10230 : cluster [DBG] pgmap v7091: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:50 smithi163 bash[24253]: audit 2024-08-31T06:07:49.659991+0000 mgr.a (mgr.14388) 10231 : audit [DBG] from='client.226419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:50 smithi027 bash[22610]: audit 2024-08-31T06:07:49.659991+0000 mgr.a (mgr.14388) 10231 : audit [DBG] from='client.226419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:51.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:50 smithi191 bash[24992]: audit 2024-08-31T06:07:49.659991+0000 mgr.a (mgr.14388) 10231 : audit [DBG] from='client.226419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:51 smithi163 bash[24253]: cluster 2024-08-31T06:07:50.663373+0000 mgr.a (mgr.14388) 10232 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:51 smithi027 bash[22610]: cluster 2024-08-31T06:07:50.663373+0000 mgr.a (mgr.14388) 10232 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:51 smithi191 bash[24992]: cluster 2024-08-31T06:07:50.663373+0000 mgr.a (mgr.14388) 10232 : cluster [DBG] pgmap v7092: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:53 smithi163 bash[24253]: cluster 2024-08-31T06:07:52.664159+0000 mgr.a (mgr.14388) 10233 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:53 smithi027 bash[22610]: cluster 2024-08-31T06:07:52.664159+0000 mgr.a (mgr.14388) 10233 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:53 smithi191 bash[24992]: cluster 2024-08-31T06:07:52.664159+0000 mgr.a (mgr.14388) 10233 : cluster [DBG] pgmap v7093: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:55.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:07:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:07:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:07:55.844 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:07:55.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:07:55.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:07:55.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:07:55.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:07:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:55 smithi163 bash[24253]: cluster 2024-08-31T06:07:54.666356+0000 mgr.a (mgr.14388) 10234 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:07:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:55 smithi027 bash[22610]: cluster 2024-08-31T06:07:54.666356+0000 mgr.a (mgr.14388) 10234 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:07:56.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:55 smithi191 bash[24992]: cluster 2024-08-31T06:07:54.666356+0000 mgr.a (mgr.14388) 10234 : cluster [DBG] pgmap v7094: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:07:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:56 smithi163 bash[24253]: audit 2024-08-31T06:07:55.427295+0000 mgr.a (mgr.14388) 10235 : audit [DBG] from='client.226494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:56 smithi027 bash[22610]: audit 2024-08-31T06:07:55.427295+0000 mgr.a (mgr.14388) 10235 : audit [DBG] from='client.226494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:57.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:56 smithi191 bash[24992]: audit 2024-08-31T06:07:55.427295+0000 mgr.a (mgr.14388) 10235 : audit [DBG] from='client.226494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:07:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:57 smithi163 bash[24253]: cluster 2024-08-31T06:07:56.667266+0000 mgr.a (mgr.14388) 10236 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:57 smithi027 bash[22610]: cluster 2024-08-31T06:07:56.667266+0000 mgr.a (mgr.14388) 10236 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:07:58.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:57 smithi191 bash[24992]: cluster 2024-08-31T06:07:56.667266+0000 mgr.a (mgr.14388) 10236 : cluster [DBG] pgmap v7095: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:07:59 smithi163 bash[24253]: cluster 2024-08-31T06:07:58.669486+0000 mgr.a (mgr.14388) 10237 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:07:59 smithi027 bash[22610]: cluster 2024-08-31T06:07:58.669486+0000 mgr.a (mgr.14388) 10237 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:07:59 smithi191 bash[24992]: cluster 2024-08-31T06:07:58.669486+0000 mgr.a (mgr.14388) 10237 : cluster [DBG] pgmap v7096: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:00.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:00.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:00.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:08:01.620 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:08:01.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:08:01.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:08:01.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:08:01.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:08:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:01 smithi163 bash[24253]: cluster 2024-08-31T06:08:00.670221+0000 mgr.a (mgr.14388) 10238 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:01 smithi027 bash[22610]: cluster 2024-08-31T06:08:00.670221+0000 mgr.a (mgr.14388) 10238 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:01 smithi191 bash[24992]: cluster 2024-08-31T06:08:00.670221+0000 mgr.a (mgr.14388) 10238 : cluster [DBG] pgmap v7097: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:02 smithi163 bash[24253]: audit 2024-08-31T06:08:01.181324+0000 mgr.a (mgr.14388) 10239 : audit [DBG] from='client.226569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:02 smithi027 bash[22610]: audit 2024-08-31T06:08:01.181324+0000 mgr.a (mgr.14388) 10239 : audit [DBG] from='client.226569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:03.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:02 smithi191 bash[24992]: audit 2024-08-31T06:08:01.181324+0000 mgr.a (mgr.14388) 10239 : audit [DBG] from='client.226569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:03 smithi163 bash[24253]: cluster 2024-08-31T06:08:02.671111+0000 mgr.a (mgr.14388) 10240 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:03 smithi027 bash[22610]: cluster 2024-08-31T06:08:02.671111+0000 mgr.a (mgr.14388) 10240 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:03 smithi191 bash[24992]: cluster 2024-08-31T06:08:02.671111+0000 mgr.a (mgr.14388) 10240 : cluster [DBG] pgmap v7098: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:05 smithi163 bash[24253]: cluster 2024-08-31T06:08:04.673231+0000 mgr.a (mgr.14388) 10241 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:05 smithi027 bash[22610]: cluster 2024-08-31T06:08:04.673231+0000 mgr.a (mgr.14388) 10241 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:05 smithi191 bash[24992]: cluster 2024-08-31T06:08:04.673231+0000 mgr.a (mgr.14388) 10241 : cluster [DBG] pgmap v7099: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:06.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:06.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:06.623 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:08:07.407 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:08:07.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:08:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:08:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:08:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:08:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:07 smithi163 bash[24253]: cluster 2024-08-31T06:08:06.673980+0000 mgr.a (mgr.14388) 10242 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:07 smithi163 bash[24253]: audit 2024-08-31T06:08:06.955793+0000 mgr.a (mgr.14388) 10243 : audit [DBG] from='client.226644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:07 smithi027 bash[22610]: cluster 2024-08-31T06:08:06.673980+0000 mgr.a (mgr.14388) 10242 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:07 smithi027 bash[22610]: audit 2024-08-31T06:08:06.955793+0000 mgr.a (mgr.14388) 10243 : audit [DBG] from='client.226644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:07 smithi191 bash[24992]: cluster 2024-08-31T06:08:06.673980+0000 mgr.a (mgr.14388) 10242 : cluster [DBG] pgmap v7100: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:07 smithi191 bash[24992]: audit 2024-08-31T06:08:06.955793+0000 mgr.a (mgr.14388) 10243 : audit [DBG] from='client.226644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:09 smithi163 bash[24253]: cluster 2024-08-31T06:08:08.676313+0000 mgr.a (mgr.14388) 10244 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:09 smithi027 bash[22610]: cluster 2024-08-31T06:08:08.676313+0000 mgr.a (mgr.14388) 10244 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:10.293 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:09 smithi191 bash[24992]: cluster 2024-08-31T06:08:08.676313+0000 mgr.a (mgr.14388) 10244 : cluster [DBG] pgmap v7101: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:11 smithi163 bash[24253]: cluster 2024-08-31T06:08:10.677099+0000 mgr.a (mgr.14388) 10245 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:11 smithi027 bash[22610]: cluster 2024-08-31T06:08:10.677099+0000 mgr.a (mgr.14388) 10245 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:11 smithi191 bash[24992]: cluster 2024-08-31T06:08:10.677099+0000 mgr.a (mgr.14388) 10245 : cluster [DBG] pgmap v7102: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:12.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:12.410 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:12.410 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:08:13.185 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:08:13.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:08:13.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:08:13.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:08:13.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:08:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:13 smithi027 bash[22610]: cluster 2024-08-31T06:08:12.677823+0000 mgr.a (mgr.14388) 10246 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:13 smithi027 bash[22610]: audit 2024-08-31T06:08:12.744997+0000 mgr.a (mgr.14388) 10247 : audit [DBG] from='client.226716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:13 smithi191 bash[24992]: cluster 2024-08-31T06:08:12.677823+0000 mgr.a (mgr.14388) 10246 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:13 smithi191 bash[24992]: audit 2024-08-31T06:08:12.744997+0000 mgr.a (mgr.14388) 10247 : audit [DBG] from='client.226716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:13 smithi163 bash[24253]: cluster 2024-08-31T06:08:12.677823+0000 mgr.a (mgr.14388) 10246 : cluster [DBG] pgmap v7103: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:13 smithi163 bash[24253]: audit 2024-08-31T06:08:12.744997+0000 mgr.a (mgr.14388) 10247 : audit [DBG] from='client.226716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:15 smithi027 bash[22610]: cluster 2024-08-31T06:08:14.680573+0000 mgr.a (mgr.14388) 10248 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:15 smithi191 bash[24992]: cluster 2024-08-31T06:08:14.680573+0000 mgr.a (mgr.14388) 10248 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:15 smithi163 bash[24253]: cluster 2024-08-31T06:08:14.680573+0000 mgr.a (mgr.14388) 10248 : cluster [DBG] pgmap v7104: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:18.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:18.188 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:08:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:17 smithi027 bash[22610]: cluster 2024-08-31T06:08:16.681352+0000 mgr.a (mgr.14388) 10249 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:17 smithi027 bash[22610]: audit 2024-08-31T06:08:17.215725+0000 mon.a (mon.0) 2108 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:08:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:17 smithi027 bash[22610]: audit 2024-08-31T06:08:17.831733+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:17 smithi027 bash[22610]: audit 2024-08-31T06:08:17.840256+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:17 smithi027 bash[22610]: audit 2024-08-31T06:08:17.846261+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:17 smithi027 bash[22610]: audit 2024-08-31T06:08:17.853106+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:17 smithi191 bash[24992]: cluster 2024-08-31T06:08:16.681352+0000 mgr.a (mgr.14388) 10249 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:17 smithi191 bash[24992]: audit 2024-08-31T06:08:17.215725+0000 mon.a (mon.0) 2108 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:08:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:17 smithi191 bash[24992]: audit 2024-08-31T06:08:17.831733+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:17 smithi191 bash[24992]: audit 2024-08-31T06:08:17.840256+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:17 smithi191 bash[24992]: audit 2024-08-31T06:08:17.846261+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:17 smithi191 bash[24992]: audit 2024-08-31T06:08:17.853106+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:17 smithi163 bash[24253]: cluster 2024-08-31T06:08:16.681352+0000 mgr.a (mgr.14388) 10249 : cluster [DBG] pgmap v7105: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:17 smithi163 bash[24253]: audit 2024-08-31T06:08:17.215725+0000 mon.a (mon.0) 2108 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:08:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:17 smithi163 bash[24253]: audit 2024-08-31T06:08:17.831733+0000 mon.a (mon.0) 2109 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:17 smithi163 bash[24253]: audit 2024-08-31T06:08:17.840256+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:17 smithi163 bash[24253]: audit 2024-08-31T06:08:17.846261+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:17 smithi163 bash[24253]: audit 2024-08-31T06:08:17.853106+0000 mon.a (mon.0) 2112 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:18 smithi027 bash[22610]: audit 2024-08-31T06:08:18.579776+0000 mon.a (mon.0) 2113 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:08:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:18 smithi027 bash[22610]: audit 2024-08-31T06:08:18.580862+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:08:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:18 smithi027 bash[22610]: audit 2024-08-31T06:08:18.589204+0000 mon.a (mon.0) 2115 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:18 smithi027 bash[22610]: audit 2024-08-31T06:08:18.591453+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:08:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:18 smithi191 bash[24992]: audit 2024-08-31T06:08:18.579776+0000 mon.a (mon.0) 2113 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:08:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:18 smithi191 bash[24992]: audit 2024-08-31T06:08:18.580862+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:08:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:18 smithi191 bash[24992]: audit 2024-08-31T06:08:18.589204+0000 mon.a (mon.0) 2115 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:18 smithi191 bash[24992]: audit 2024-08-31T06:08:18.591453+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:08:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:18 smithi163 bash[24253]: audit 2024-08-31T06:08:18.579776+0000 mon.a (mon.0) 2113 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:08:19.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:18 smithi163 bash[24253]: audit 2024-08-31T06:08:18.580862+0000 mon.a (mon.0) 2114 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:08:19.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:18 smithi163 bash[24253]: audit 2024-08-31T06:08:18.589204+0000 mon.a (mon.0) 2115 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:08:19.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:18 smithi163 bash[24253]: audit 2024-08-31T06:08:18.591453+0000 mon.a (mon.0) 2116 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:08:19.705 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:08:19.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:08:19.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:08:19.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:08:19.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:08:19.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:08:19 smithi027 bash[22863]: debug 2024-08-31T06:08:19.303+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:08:19.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:08:19 smithi027 bash[22863]: debug 2024-08-31T06:08:19.319+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:08:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:19 smithi027 bash[22610]: audit 2024-08-31T06:08:18.593695+0000 mgr.a (mgr.14388) 10250 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:08:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:19 smithi027 bash[22610]: audit 2024-08-31T06:08:18.613289+0000 mgr.a (mgr.14388) 10251 : audit [DBG] from='client.226794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:19 smithi027 bash[22610]: cluster 2024-08-31T06:08:18.682584+0000 mgr.a (mgr.14388) 10252 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:19 smithi191 bash[24992]: audit 2024-08-31T06:08:18.593695+0000 mgr.a (mgr.14388) 10250 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:08:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:19 smithi191 bash[24992]: audit 2024-08-31T06:08:18.613289+0000 mgr.a (mgr.14388) 10251 : audit [DBG] from='client.226794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:19 smithi191 bash[24992]: cluster 2024-08-31T06:08:18.682584+0000 mgr.a (mgr.14388) 10252 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:19 smithi163 bash[24253]: audit 2024-08-31T06:08:18.593695+0000 mgr.a (mgr.14388) 10250 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:08:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:19 smithi163 bash[24253]: audit 2024-08-31T06:08:18.613289+0000 mgr.a (mgr.14388) 10251 : audit [DBG] from='client.226794 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:19 smithi163 bash[24253]: cluster 2024-08-31T06:08:18.682584+0000 mgr.a (mgr.14388) 10252 : cluster [DBG] pgmap v7106: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:20 smithi027 bash[22610]: audit 2024-08-31T06:08:19.308390+0000 mgr.a (mgr.14388) 10253 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:08:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:20 smithi027 bash[22610]: cephadm 2024-08-31T06:08:19.323967+0000 mgr.a (mgr.14388) 10254 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:08:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:20 smithi191 bash[24992]: audit 2024-08-31T06:08:19.308390+0000 mgr.a (mgr.14388) 10253 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:08:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:20 smithi191 bash[24992]: cephadm 2024-08-31T06:08:19.323967+0000 mgr.a (mgr.14388) 10254 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:08:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:20 smithi163 bash[24253]: audit 2024-08-31T06:08:19.308390+0000 mgr.a (mgr.14388) 10253 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:08:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:20 smithi163 bash[24253]: cephadm 2024-08-31T06:08:19.323967+0000 mgr.a (mgr.14388) 10254 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:08:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:21 smithi027 bash[22610]: cluster 2024-08-31T06:08:20.683437+0000 mgr.a (mgr.14388) 10255 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:21 smithi191 bash[24992]: cluster 2024-08-31T06:08:20.683437+0000 mgr.a (mgr.14388) 10255 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:21 smithi163 bash[24253]: cluster 2024-08-31T06:08:20.683437+0000 mgr.a (mgr.14388) 10255 : cluster [DBG] pgmap v7107: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:23.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:23 smithi191 bash[24992]: cluster 2024-08-31T06:08:22.684231+0000 mgr.a (mgr.14388) 10256 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:08:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:23 smithi163 bash[24253]: cluster 2024-08-31T06:08:22.684231+0000 mgr.a (mgr.14388) 10256 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:08:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:23 smithi027 bash[22610]: cluster 2024-08-31T06:08:22.684231+0000 mgr.a (mgr.14388) 10256 : cluster [DBG] pgmap v7108: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:08:24.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:24.707 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:08:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:08:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:08:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:08:25.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:08:25.459 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:08:26.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:25 smithi191 bash[24992]: cluster 2024-08-31T06:08:24.686440+0000 mgr.a (mgr.14388) 10257 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:25 smithi163 bash[24253]: cluster 2024-08-31T06:08:24.686440+0000 mgr.a (mgr.14388) 10257 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:25 smithi027 bash[22610]: cluster 2024-08-31T06:08:24.686440+0000 mgr.a (mgr.14388) 10257 : cluster [DBG] pgmap v7109: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:27.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:26 smithi191 bash[24992]: audit 2024-08-31T06:08:25.038742+0000 mgr.a (mgr.14388) 10258 : audit [DBG] from='client.226980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:26 smithi163 bash[24253]: audit 2024-08-31T06:08:25.038742+0000 mgr.a (mgr.14388) 10258 : audit [DBG] from='client.226980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:26 smithi027 bash[22610]: audit 2024-08-31T06:08:25.038742+0000 mgr.a (mgr.14388) 10258 : audit [DBG] from='client.226980 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:27 smithi191 bash[24992]: cluster 2024-08-31T06:08:26.687379+0000 mgr.a (mgr.14388) 10259 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:27 smithi163 bash[24253]: cluster 2024-08-31T06:08:26.687379+0000 mgr.a (mgr.14388) 10259 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:27 smithi027 bash[22610]: cluster 2024-08-31T06:08:26.687379+0000 mgr.a (mgr.14388) 10259 : cluster [DBG] pgmap v7110: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:30.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:29 smithi191 bash[24992]: cluster 2024-08-31T06:08:28.689511+0000 mgr.a (mgr.14388) 10260 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:29 smithi163 bash[24253]: cluster 2024-08-31T06:08:28.689511+0000 mgr.a (mgr.14388) 10260 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:29 smithi027 bash[22610]: cluster 2024-08-31T06:08:28.689511+0000 mgr.a (mgr.14388) 10260 : cluster [DBG] pgmap v7111: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:30.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:30.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:30.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:08:31.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:08:31.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:08:31.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:08:31.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:08:31.235 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:08:32.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:31 smithi191 bash[24992]: cluster 2024-08-31T06:08:30.690241+0000 mgr.a (mgr.14388) 10261 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:32.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:31 smithi191 bash[24992]: audit 2024-08-31T06:08:30.797166+0000 mgr.a (mgr.14388) 10262 : audit [DBG] from='client.227058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:31 smithi163 bash[24253]: cluster 2024-08-31T06:08:30.690241+0000 mgr.a (mgr.14388) 10261 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:31 smithi163 bash[24253]: audit 2024-08-31T06:08:30.797166+0000 mgr.a (mgr.14388) 10262 : audit [DBG] from='client.227058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:31 smithi027 bash[22610]: cluster 2024-08-31T06:08:30.690241+0000 mgr.a (mgr.14388) 10261 : cluster [DBG] pgmap v7112: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:31 smithi027 bash[22610]: audit 2024-08-31T06:08:30.797166+0000 mgr.a (mgr.14388) 10262 : audit [DBG] from='client.227058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:34.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:33 smithi191 bash[24992]: cluster 2024-08-31T06:08:32.691149+0000 mgr.a (mgr.14388) 10263 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:34.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:33 smithi163 bash[24253]: cluster 2024-08-31T06:08:32.691149+0000 mgr.a (mgr.14388) 10263 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:34.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:33 smithi027 bash[22610]: cluster 2024-08-31T06:08:32.691149+0000 mgr.a (mgr.14388) 10263 : cluster [DBG] pgmap v7113: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:36.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:35 smithi191 bash[24992]: cluster 2024-08-31T06:08:34.693344+0000 mgr.a (mgr.14388) 10264 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:36.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:35 smithi163 bash[24253]: cluster 2024-08-31T06:08:34.693344+0000 mgr.a (mgr.14388) 10264 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:35 smithi027 bash[22610]: cluster 2024-08-31T06:08:34.693344+0000 mgr.a (mgr.14388) 10264 : cluster [DBG] pgmap v7114: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:08:36.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:36.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:36.237 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:08:37.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:08:37.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:08:37.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:08:37.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:08:37.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:08:38.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:37 smithi191 bash[24992]: audit 2024-08-31T06:08:36.573150+0000 mgr.a (mgr.14388) 10265 : audit [DBG] from='client.227133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:38.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:37 smithi191 bash[24992]: cluster 2024-08-31T06:08:36.693913+0000 mgr.a (mgr.14388) 10266 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:38.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:37 smithi163 bash[24253]: audit 2024-08-31T06:08:36.573150+0000 mgr.a (mgr.14388) 10265 : audit [DBG] from='client.227133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:38.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:37 smithi163 bash[24253]: cluster 2024-08-31T06:08:36.693913+0000 mgr.a (mgr.14388) 10266 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:37 smithi027 bash[22610]: audit 2024-08-31T06:08:36.573150+0000 mgr.a (mgr.14388) 10265 : audit [DBG] from='client.227133 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:38.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:37 smithi027 bash[22610]: cluster 2024-08-31T06:08:36.693913+0000 mgr.a (mgr.14388) 10266 : cluster [DBG] pgmap v7115: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:40.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:39 smithi191 bash[24992]: cluster 2024-08-31T06:08:38.696229+0000 mgr.a (mgr.14388) 10267 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:39 smithi163 bash[24253]: cluster 2024-08-31T06:08:38.696229+0000 mgr.a (mgr.14388) 10267 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:39 smithi027 bash[22610]: cluster 2024-08-31T06:08:38.696229+0000 mgr.a (mgr.14388) 10267 : cluster [DBG] pgmap v7116: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:42.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:42.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:42.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:08:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:41 smithi191 bash[24992]: cluster 2024-08-31T06:08:40.696988+0000 mgr.a (mgr.14388) 10268 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:41 smithi163 bash[24253]: cluster 2024-08-31T06:08:40.696988+0000 mgr.a (mgr.14388) 10268 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:41 smithi027 bash[22610]: cluster 2024-08-31T06:08:40.696988+0000 mgr.a (mgr.14388) 10268 : cluster [DBG] pgmap v7117: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:42.777 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:08:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:08:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:08:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:08:42.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:08:44.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:43 smithi191 bash[24992]: audit 2024-08-31T06:08:42.346017+0000 mgr.a (mgr.14388) 10269 : audit [DBG] from='client.227211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:44.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:43 smithi191 bash[24992]: cluster 2024-08-31T06:08:42.697536+0000 mgr.a (mgr.14388) 10270 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:43 smithi163 bash[24253]: audit 2024-08-31T06:08:42.346017+0000 mgr.a (mgr.14388) 10269 : audit [DBG] from='client.227211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:43 smithi163 bash[24253]: cluster 2024-08-31T06:08:42.697536+0000 mgr.a (mgr.14388) 10270 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:43 smithi027 bash[22610]: audit 2024-08-31T06:08:42.346017+0000 mgr.a (mgr.14388) 10269 : audit [DBG] from='client.227211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:43 smithi027 bash[22610]: cluster 2024-08-31T06:08:42.697536+0000 mgr.a (mgr.14388) 10270 : cluster [DBG] pgmap v7118: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:45 smithi163 bash[24253]: cluster 2024-08-31T06:08:44.699756+0000 mgr.a (mgr.14388) 10271 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:45 smithi027 bash[22610]: cluster 2024-08-31T06:08:44.699756+0000 mgr.a (mgr.14388) 10271 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:46.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:45 smithi191 bash[24992]: cluster 2024-08-31T06:08:44.699756+0000 mgr.a (mgr.14388) 10271 : cluster [DBG] pgmap v7119: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:08:47.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:47.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:47.780 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:08:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:47 smithi163 bash[24253]: cluster 2024-08-31T06:08:46.700506+0000 mgr.a (mgr.14388) 10272 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:47 smithi027 bash[22610]: cluster 2024-08-31T06:08:46.700506+0000 mgr.a (mgr.14388) 10272 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:47 smithi191 bash[24992]: cluster 2024-08-31T06:08:46.700506+0000 mgr.a (mgr.14388) 10272 : cluster [DBG] pgmap v7120: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:48.521 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:08:48.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:08:48.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:08:48.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:08:48.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:08:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:49 smithi163 bash[24253]: audit 2024-08-31T06:08:48.111263+0000 mgr.a (mgr.14388) 10273 : audit [DBG] from='client.227289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:49 smithi163 bash[24253]: cluster 2024-08-31T06:08:48.703110+0000 mgr.a (mgr.14388) 10274 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:50.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:49 smithi027 bash[22610]: audit 2024-08-31T06:08:48.111263+0000 mgr.a (mgr.14388) 10273 : audit [DBG] from='client.227289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:50.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:49 smithi027 bash[22610]: cluster 2024-08-31T06:08:48.703110+0000 mgr.a (mgr.14388) 10274 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:50.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:49 smithi191 bash[24992]: audit 2024-08-31T06:08:48.111263+0000 mgr.a (mgr.14388) 10273 : audit [DBG] from='client.227289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:50.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:49 smithi191 bash[24992]: cluster 2024-08-31T06:08:48.703110+0000 mgr.a (mgr.14388) 10274 : cluster [DBG] pgmap v7121: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:51 smithi163 bash[24253]: cluster 2024-08-31T06:08:50.703878+0000 mgr.a (mgr.14388) 10275 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:51 smithi027 bash[22610]: cluster 2024-08-31T06:08:50.703878+0000 mgr.a (mgr.14388) 10275 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:51 smithi191 bash[24992]: cluster 2024-08-31T06:08:50.703878+0000 mgr.a (mgr.14388) 10275 : cluster [DBG] pgmap v7122: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:53.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:53.524 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:53.524 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:08:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:53 smithi163 bash[24253]: cluster 2024-08-31T06:08:52.704638+0000 mgr.a (mgr.14388) 10276 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:08:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:53 smithi027 bash[22610]: cluster 2024-08-31T06:08:52.704638+0000 mgr.a (mgr.14388) 10276 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:08:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:53 smithi191 bash[24992]: cluster 2024-08-31T06:08:52.704638+0000 mgr.a (mgr.14388) 10276 : cluster [DBG] pgmap v7123: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:08:54.302 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:08:54.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:08:54.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:08:54.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:08:54.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:08:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:54 smithi163 bash[24253]: audit 2024-08-31T06:08:53.866104+0000 mgr.a (mgr.14388) 10277 : audit [DBG] from='client.227367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:54 smithi027 bash[22610]: audit 2024-08-31T06:08:53.866104+0000 mgr.a (mgr.14388) 10277 : audit [DBG] from='client.227367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:54 smithi191 bash[24992]: audit 2024-08-31T06:08:53.866104+0000 mgr.a (mgr.14388) 10277 : audit [DBG] from='client.227367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:08:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:55 smithi163 bash[24253]: cluster 2024-08-31T06:08:54.707324+0000 mgr.a (mgr.14388) 10278 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:55 smithi027 bash[22610]: cluster 2024-08-31T06:08:54.707324+0000 mgr.a (mgr.14388) 10278 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:56.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:55 smithi191 bash[24992]: cluster 2024-08-31T06:08:54.707324+0000 mgr.a (mgr.14388) 10278 : cluster [DBG] pgmap v7124: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:08:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:57 smithi163 bash[24253]: cluster 2024-08-31T06:08:56.708115+0000 mgr.a (mgr.14388) 10279 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:57 smithi027 bash[22610]: cluster 2024-08-31T06:08:56.708115+0000 mgr.a (mgr.14388) 10279 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:58.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:57 smithi191 bash[24992]: cluster 2024-08-31T06:08:56.708115+0000 mgr.a (mgr.14388) 10279 : cluster [DBG] pgmap v7125: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:08:59.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:08:59.305 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:08:59.305 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:00.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:00.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:00.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:00.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:00.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:08:59 smithi163 bash[24253]: cluster 2024-08-31T06:08:58.709987+0000 mgr.a (mgr.14388) 10280 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:08:59 smithi027 bash[22610]: cluster 2024-08-31T06:08:58.709987+0000 mgr.a (mgr.14388) 10280 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:08:59 smithi191 bash[24992]: cluster 2024-08-31T06:08:58.709987+0000 mgr.a (mgr.14388) 10280 : cluster [DBG] pgmap v7126: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:00 smithi163 bash[24253]: audit 2024-08-31T06:08:59.635431+0000 mgr.a (mgr.14388) 10281 : audit [DBG] from='client.227442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:00 smithi027 bash[22610]: audit 2024-08-31T06:08:59.635431+0000 mgr.a (mgr.14388) 10281 : audit [DBG] from='client.227442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:01.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:00 smithi191 bash[24992]: audit 2024-08-31T06:08:59.635431+0000 mgr.a (mgr.14388) 10281 : audit [DBG] from='client.227442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:01 smithi163 bash[24253]: cluster 2024-08-31T06:09:00.711087+0000 mgr.a (mgr.14388) 10282 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:01 smithi027 bash[22610]: cluster 2024-08-31T06:09:00.711087+0000 mgr.a (mgr.14388) 10282 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:01 smithi191 bash[24992]: cluster 2024-08-31T06:09:00.711087+0000 mgr.a (mgr.14388) 10282 : cluster [DBG] pgmap v7127: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:03 smithi163 bash[24253]: cluster 2024-08-31T06:09:02.712054+0000 mgr.a (mgr.14388) 10283 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:03 smithi027 bash[22610]: cluster 2024-08-31T06:09:02.712054+0000 mgr.a (mgr.14388) 10283 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:03 smithi191 bash[24992]: cluster 2024-08-31T06:09:02.712054+0000 mgr.a (mgr.14388) 10283 : cluster [DBG] pgmap v7128: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:05.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:09:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:09:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:05.845 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:05.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:05.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:05.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:05.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:05 smithi163 bash[24253]: cluster 2024-08-31T06:09:04.714290+0000 mgr.a (mgr.14388) 10284 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:05 smithi027 bash[22610]: cluster 2024-08-31T06:09:04.714290+0000 mgr.a (mgr.14388) 10284 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:06.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:05 smithi191 bash[24992]: cluster 2024-08-31T06:09:04.714290+0000 mgr.a (mgr.14388) 10284 : cluster [DBG] pgmap v7129: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:06 smithi163 bash[24253]: audit 2024-08-31T06:09:05.402758+0000 mgr.a (mgr.14388) 10285 : audit [DBG] from='client.227517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:06 smithi027 bash[22610]: audit 2024-08-31T06:09:05.402758+0000 mgr.a (mgr.14388) 10285 : audit [DBG] from='client.227517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:06 smithi191 bash[24992]: audit 2024-08-31T06:09:05.402758+0000 mgr.a (mgr.14388) 10285 : audit [DBG] from='client.227517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:07 smithi163 bash[24253]: cluster 2024-08-31T06:09:06.715435+0000 mgr.a (mgr.14388) 10286 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:07 smithi027 bash[22610]: cluster 2024-08-31T06:09:06.715435+0000 mgr.a (mgr.14388) 10286 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:07 smithi191 bash[24992]: cluster 2024-08-31T06:09:06.715435+0000 mgr.a (mgr.14388) 10286 : cluster [DBG] pgmap v7130: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:09 smithi163 bash[24253]: cluster 2024-08-31T06:09:08.717745+0000 mgr.a (mgr.14388) 10287 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:09 smithi027 bash[22610]: cluster 2024-08-31T06:09:08.717745+0000 mgr.a (mgr.14388) 10287 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:09.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:09 smithi191 bash[24992]: cluster 2024-08-31T06:09:08.717745+0000 mgr.a (mgr.14388) 10287 : cluster [DBG] pgmap v7131: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:09:10.848 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:09:10.848 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:11.591 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:11.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:11.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:11.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:11 smithi191 bash[24992]: cluster 2024-08-31T06:09:10.718525+0000 mgr.a (mgr.14388) 10288 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:11 smithi163 bash[24253]: cluster 2024-08-31T06:09:10.718525+0000 mgr.a (mgr.14388) 10288 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:11 smithi027 bash[22610]: cluster 2024-08-31T06:09:10.718525+0000 mgr.a (mgr.14388) 10288 : cluster [DBG] pgmap v7132: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:13.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:12 smithi191 bash[24992]: audit 2024-08-31T06:09:11.177083+0000 mgr.a (mgr.14388) 10289 : audit [DBG] from='client.227595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:12 smithi163 bash[24253]: audit 2024-08-31T06:09:11.177083+0000 mgr.a (mgr.14388) 10289 : audit [DBG] from='client.227595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:12 smithi027 bash[22610]: audit 2024-08-31T06:09:11.177083+0000 mgr.a (mgr.14388) 10289 : audit [DBG] from='client.227595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:13 smithi191 bash[24992]: cluster 2024-08-31T06:09:12.719483+0000 mgr.a (mgr.14388) 10290 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:13 smithi163 bash[24253]: cluster 2024-08-31T06:09:12.719483+0000 mgr.a (mgr.14388) 10290 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:13 smithi027 bash[22610]: cluster 2024-08-31T06:09:12.719483+0000 mgr.a (mgr.14388) 10290 : cluster [DBG] pgmap v7133: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:15 smithi163 bash[24253]: cluster 2024-08-31T06:09:14.721664+0000 mgr.a (mgr.14388) 10291 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:15 smithi027 bash[22610]: cluster 2024-08-31T06:09:14.721664+0000 mgr.a (mgr.14388) 10291 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:15 smithi191 bash[24992]: cluster 2024-08-31T06:09:14.721664+0000 mgr.a (mgr.14388) 10291 : cluster [DBG] pgmap v7134: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:16.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:09:16.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:09:16.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:17.343 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:17.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:17.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:17.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:17.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:17 smithi163 bash[24253]: cluster 2024-08-31T06:09:16.722139+0000 mgr.a (mgr.14388) 10292 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:17 smithi163 bash[24253]: audit 2024-08-31T06:09:16.922443+0000 mgr.a (mgr.14388) 10293 : audit [DBG] from='client.227673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:17 smithi027 bash[22610]: cluster 2024-08-31T06:09:16.722139+0000 mgr.a (mgr.14388) 10292 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:17 smithi027 bash[22610]: audit 2024-08-31T06:09:16.922443+0000 mgr.a (mgr.14388) 10293 : audit [DBG] from='client.227673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:17 smithi191 bash[24992]: cluster 2024-08-31T06:09:16.722139+0000 mgr.a (mgr.14388) 10292 : cluster [DBG] pgmap v7135: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:17 smithi191 bash[24992]: audit 2024-08-31T06:09:16.922443+0000 mgr.a (mgr.14388) 10293 : audit [DBG] from='client.227673 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:19 smithi163 bash[24253]: cluster 2024-08-31T06:09:18.724703+0000 mgr.a (mgr.14388) 10294 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:19 smithi163 bash[24253]: audit 2024-08-31T06:09:19.377567+0000 mon.a (mon.0) 2117 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:09:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:19 smithi027 bash[22610]: cluster 2024-08-31T06:09:18.724703+0000 mgr.a (mgr.14388) 10294 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:19 smithi027 bash[22610]: audit 2024-08-31T06:09:19.377567+0000 mon.a (mon.0) 2117 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:09:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:19 smithi191 bash[24992]: cluster 2024-08-31T06:09:18.724703+0000 mgr.a (mgr.14388) 10294 : cluster [DBG] pgmap v7136: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:19 smithi191 bash[24992]: audit 2024-08-31T06:09:19.377567+0000 mon.a (mon.0) 2117 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:09:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:20 smithi163 bash[24253]: audit 2024-08-31T06:09:20.218345+0000 mon.a (mon.0) 2118 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:09:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:20 smithi163 bash[24253]: audit 2024-08-31T06:09:20.219991+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:09:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:20 smithi163 bash[24253]: audit 2024-08-31T06:09:20.231828+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:09:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:20 smithi163 bash[24253]: audit 2024-08-31T06:09:20.236811+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:09:21.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:09:20 smithi027 bash[22863]: debug 2024-08-31T06:09:20.981+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:09:21.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:09:20 smithi027 bash[22863]: debug 2024-08-31T06:09:20.981+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:09:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:20 smithi027 bash[22610]: audit 2024-08-31T06:09:20.218345+0000 mon.a (mon.0) 2118 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:09:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:20 smithi027 bash[22610]: audit 2024-08-31T06:09:20.219991+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:09:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:20 smithi027 bash[22610]: audit 2024-08-31T06:09:20.231828+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:09:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:20 smithi027 bash[22610]: audit 2024-08-31T06:09:20.236811+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:09:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:20 smithi191 bash[24992]: audit 2024-08-31T06:09:20.218345+0000 mon.a (mon.0) 2118 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:09:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:20 smithi191 bash[24992]: audit 2024-08-31T06:09:20.219991+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:09:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:20 smithi191 bash[24992]: audit 2024-08-31T06:09:20.231828+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:09:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:20 smithi191 bash[24992]: audit 2024-08-31T06:09:20.236811+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:09:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:21 smithi163 bash[24253]: audit 2024-08-31T06:09:20.239166+0000 mgr.a (mgr.14388) 10295 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:09:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:21 smithi163 bash[24253]: cluster 2024-08-31T06:09:20.725272+0000 mgr.a (mgr.14388) 10296 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:21 smithi163 bash[24253]: audit 2024-08-31T06:09:20.983234+0000 mgr.a (mgr.14388) 10297 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:09:22.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:21 smithi163 bash[24253]: cephadm 2024-08-31T06:09:20.984754+0000 mgr.a (mgr.14388) 10298 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:09:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:21 smithi027 bash[22610]: audit 2024-08-31T06:09:20.239166+0000 mgr.a (mgr.14388) 10295 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:09:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:21 smithi027 bash[22610]: cluster 2024-08-31T06:09:20.725272+0000 mgr.a (mgr.14388) 10296 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:21 smithi027 bash[22610]: audit 2024-08-31T06:09:20.983234+0000 mgr.a (mgr.14388) 10297 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:09:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:21 smithi027 bash[22610]: cephadm 2024-08-31T06:09:20.984754+0000 mgr.a (mgr.14388) 10298 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:09:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:21 smithi191 bash[24992]: audit 2024-08-31T06:09:20.239166+0000 mgr.a (mgr.14388) 10295 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:09:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:21 smithi191 bash[24992]: cluster 2024-08-31T06:09:20.725272+0000 mgr.a (mgr.14388) 10296 : cluster [DBG] pgmap v7137: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:21 smithi191 bash[24992]: audit 2024-08-31T06:09:20.983234+0000 mgr.a (mgr.14388) 10297 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:09:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:21 smithi191 bash[24992]: cephadm 2024-08-31T06:09:20.984754+0000 mgr.a (mgr.14388) 10298 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:09:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:09:22.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:09:22.346 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:23.092 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:23.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:23.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:23.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:23.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:23 smithi163 bash[24253]: audit 2024-08-31T06:09:22.676151+0000 mgr.a (mgr.14388) 10299 : audit [DBG] from='client.227853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:23 smithi163 bash[24253]: cluster 2024-08-31T06:09:22.725926+0000 mgr.a (mgr.14388) 10300 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:23 smithi027 bash[22610]: audit 2024-08-31T06:09:22.676151+0000 mgr.a (mgr.14388) 10299 : audit [DBG] from='client.227853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:23 smithi027 bash[22610]: cluster 2024-08-31T06:09:22.725926+0000 mgr.a (mgr.14388) 10300 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:23 smithi191 bash[24992]: audit 2024-08-31T06:09:22.676151+0000 mgr.a (mgr.14388) 10299 : audit [DBG] from='client.227853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:23 smithi191 bash[24992]: cluster 2024-08-31T06:09:22.725926+0000 mgr.a (mgr.14388) 10300 : cluster [DBG] pgmap v7138: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:25 smithi163 bash[24253]: cluster 2024-08-31T06:09:24.728688+0000 mgr.a (mgr.14388) 10301 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:09:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:25 smithi027 bash[22610]: cluster 2024-08-31T06:09:24.728688+0000 mgr.a (mgr.14388) 10301 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:09:26.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:25 smithi191 bash[24992]: cluster 2024-08-31T06:09:24.728688+0000 mgr.a (mgr.14388) 10301 : cluster [DBG] pgmap v7139: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:09:28.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:09:28.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:09:28.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:27 smithi163 bash[24253]: cluster 2024-08-31T06:09:26.729481+0000 mgr.a (mgr.14388) 10302 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:09:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:27 smithi027 bash[22610]: cluster 2024-08-31T06:09:26.729481+0000 mgr.a (mgr.14388) 10302 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:09:28.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:27 smithi191 bash[24992]: cluster 2024-08-31T06:09:26.729481+0000 mgr.a (mgr.14388) 10302 : cluster [DBG] pgmap v7140: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:09:28.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:29 smithi163 bash[24253]: audit 2024-08-31T06:09:28.429773+0000 mgr.a (mgr.14388) 10303 : audit [DBG] from='client.227931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:29 smithi163 bash[24253]: cluster 2024-08-31T06:09:28.730911+0000 mgr.a (mgr.14388) 10304 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:09:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:29 smithi027 bash[22610]: audit 2024-08-31T06:09:28.429773+0000 mgr.a (mgr.14388) 10303 : audit [DBG] from='client.227931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:29 smithi027 bash[22610]: cluster 2024-08-31T06:09:28.730911+0000 mgr.a (mgr.14388) 10304 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:09:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:29 smithi191 bash[24992]: audit 2024-08-31T06:09:28.429773+0000 mgr.a (mgr.14388) 10303 : audit [DBG] from='client.227931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:29 smithi191 bash[24992]: cluster 2024-08-31T06:09:28.730911+0000 mgr.a (mgr.14388) 10304 : cluster [DBG] pgmap v7141: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:09:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:31 smithi163 bash[24253]: cluster 2024-08-31T06:09:30.731762+0000 mgr.a (mgr.14388) 10305 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:09:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:31 smithi027 bash[22610]: cluster 2024-08-31T06:09:30.731762+0000 mgr.a (mgr.14388) 10305 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:09:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:31 smithi191 bash[24992]: cluster 2024-08-31T06:09:30.731762+0000 mgr.a (mgr.14388) 10305 : cluster [DBG] pgmap v7142: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:09:33.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:09:33.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:09:33.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:34.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:33 smithi163 bash[24253]: cluster 2024-08-31T06:09:32.732544+0000 mgr.a (mgr.14388) 10306 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:09:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:33 smithi027 bash[22610]: cluster 2024-08-31T06:09:32.732544+0000 mgr.a (mgr.14388) 10306 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:09:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:33 smithi191 bash[24992]: cluster 2024-08-31T06:09:32.732544+0000 mgr.a (mgr.14388) 10306 : cluster [DBG] pgmap v7143: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:09:34.623 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:36.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:35 smithi163 bash[24253]: audit 2024-08-31T06:09:34.202873+0000 mgr.a (mgr.14388) 10307 : audit [DBG] from='client.228009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:36.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:35 smithi163 bash[24253]: cluster 2024-08-31T06:09:34.735292+0000 mgr.a (mgr.14388) 10308 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:09:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:35 smithi027 bash[22610]: audit 2024-08-31T06:09:34.202873+0000 mgr.a (mgr.14388) 10307 : audit [DBG] from='client.228009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:35 smithi027 bash[22610]: cluster 2024-08-31T06:09:34.735292+0000 mgr.a (mgr.14388) 10308 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:09:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:35 smithi191 bash[24992]: audit 2024-08-31T06:09:34.202873+0000 mgr.a (mgr.14388) 10307 : audit [DBG] from='client.228009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:35 smithi191 bash[24992]: cluster 2024-08-31T06:09:34.735292+0000 mgr.a (mgr.14388) 10308 : cluster [DBG] pgmap v7144: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:09:38.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:37 smithi163 bash[24253]: cluster 2024-08-31T06:09:36.736080+0000 mgr.a (mgr.14388) 10309 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:09:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:37 smithi027 bash[22610]: cluster 2024-08-31T06:09:36.736080+0000 mgr.a (mgr.14388) 10309 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:09:38.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:37 smithi191 bash[24992]: cluster 2024-08-31T06:09:36.736080+0000 mgr.a (mgr.14388) 10309 : cluster [DBG] pgmap v7145: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:09:39.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:09:39.626 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:09:39.626 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:39 smithi163 bash[24253]: cluster 2024-08-31T06:09:38.738027+0000 mgr.a (mgr.14388) 10310 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:09:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:39 smithi027 bash[22610]: cluster 2024-08-31T06:09:38.738027+0000 mgr.a (mgr.14388) 10310 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:09:40.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:39 smithi191 bash[24992]: cluster 2024-08-31T06:09:38.738027+0000 mgr.a (mgr.14388) 10310 : cluster [DBG] pgmap v7146: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:09:40.399 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:40.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:40 smithi163 bash[24253]: audit 2024-08-31T06:09:39.963256+0000 mgr.a (mgr.14388) 10311 : audit [DBG] from='client.228084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:40 smithi027 bash[22610]: audit 2024-08-31T06:09:39.963256+0000 mgr.a (mgr.14388) 10311 : audit [DBG] from='client.228084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:41.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:40 smithi191 bash[24992]: audit 2024-08-31T06:09:39.963256+0000 mgr.a (mgr.14388) 10311 : audit [DBG] from='client.228084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:41 smithi163 bash[24253]: cluster 2024-08-31T06:09:40.738964+0000 mgr.a (mgr.14388) 10312 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:41 smithi027 bash[22610]: cluster 2024-08-31T06:09:40.738964+0000 mgr.a (mgr.14388) 10312 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:41 smithi191 bash[24992]: cluster 2024-08-31T06:09:40.738964+0000 mgr.a (mgr.14388) 10312 : cluster [DBG] pgmap v7147: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:43 smithi163 bash[24253]: cluster 2024-08-31T06:09:42.739792+0000 mgr.a (mgr.14388) 10313 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:43 smithi027 bash[22610]: cluster 2024-08-31T06:09:42.739792+0000 mgr.a (mgr.14388) 10313 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:44.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:43 smithi191 bash[24992]: cluster 2024-08-31T06:09:42.739792+0000 mgr.a (mgr.14388) 10313 : cluster [DBG] pgmap v7148: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:45.400 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:09:45.401 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:09:45.402 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:46.160 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:46.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:46.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:46.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:46.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:45 smithi163 bash[24253]: cluster 2024-08-31T06:09:44.742054+0000 mgr.a (mgr.14388) 10314 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:45 smithi027 bash[22610]: cluster 2024-08-31T06:09:44.742054+0000 mgr.a (mgr.14388) 10314 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:45 smithi191 bash[24992]: cluster 2024-08-31T06:09:44.742054+0000 mgr.a (mgr.14388) 10314 : cluster [DBG] pgmap v7149: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:46 smithi163 bash[24253]: audit 2024-08-31T06:09:45.735641+0000 mgr.a (mgr.14388) 10315 : audit [DBG] from='client.228156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:46 smithi027 bash[22610]: audit 2024-08-31T06:09:45.735641+0000 mgr.a (mgr.14388) 10315 : audit [DBG] from='client.228156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:47.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:46 smithi191 bash[24992]: audit 2024-08-31T06:09:45.735641+0000 mgr.a (mgr.14388) 10315 : audit [DBG] from='client.228156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:47 smithi163 bash[24253]: cluster 2024-08-31T06:09:46.743089+0000 mgr.a (mgr.14388) 10316 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:47 smithi027 bash[22610]: cluster 2024-08-31T06:09:46.743089+0000 mgr.a (mgr.14388) 10316 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:47 smithi191 bash[24992]: cluster 2024-08-31T06:09:46.743089+0000 mgr.a (mgr.14388) 10316 : cluster [DBG] pgmap v7150: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:49 smithi163 bash[24253]: cluster 2024-08-31T06:09:48.745336+0000 mgr.a (mgr.14388) 10317 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:50.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:49 smithi027 bash[22610]: cluster 2024-08-31T06:09:48.745336+0000 mgr.a (mgr.14388) 10317 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:50.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:49 smithi191 bash[24992]: cluster 2024-08-31T06:09:48.745336+0000 mgr.a (mgr.14388) 10317 : cluster [DBG] pgmap v7151: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:51.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:09:51.162 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:09:51.162 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:51.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:51.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:51.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:51.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:51.907 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:51 smithi163 bash[24253]: cluster 2024-08-31T06:09:50.746248+0000 mgr.a (mgr.14388) 10318 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:51 smithi027 bash[22610]: cluster 2024-08-31T06:09:50.746248+0000 mgr.a (mgr.14388) 10318 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:51 smithi191 bash[24992]: cluster 2024-08-31T06:09:50.746248+0000 mgr.a (mgr.14388) 10318 : cluster [DBG] pgmap v7152: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:52 smithi163 bash[24253]: audit 2024-08-31T06:09:51.496610+0000 mgr.a (mgr.14388) 10319 : audit [DBG] from='client.228234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:52 smithi027 bash[22610]: audit 2024-08-31T06:09:51.496610+0000 mgr.a (mgr.14388) 10319 : audit [DBG] from='client.228234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:52 smithi191 bash[24992]: audit 2024-08-31T06:09:51.496610+0000 mgr.a (mgr.14388) 10319 : audit [DBG] from='client.228234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:53 smithi163 bash[24253]: cluster 2024-08-31T06:09:52.747456+0000 mgr.a (mgr.14388) 10320 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:53 smithi027 bash[22610]: cluster 2024-08-31T06:09:52.747456+0000 mgr.a (mgr.14388) 10320 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:53 smithi191 bash[24992]: cluster 2024-08-31T06:09:52.747456+0000 mgr.a (mgr.14388) 10320 : cluster [DBG] pgmap v7153: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:55 smithi163 bash[24253]: cluster 2024-08-31T06:09:54.749860+0000 mgr.a (mgr.14388) 10321 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:55 smithi027 bash[22610]: cluster 2024-08-31T06:09:54.749860+0000 mgr.a (mgr.14388) 10321 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:56.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:55 smithi191 bash[24992]: cluster 2024-08-31T06:09:54.749860+0000 mgr.a (mgr.14388) 10321 : cluster [DBG] pgmap v7154: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:09:56.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:09:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:09:56.909 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:09:57.695 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:09:57.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:09:57.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:09:57.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:09:57.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:09:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:57 smithi163 bash[24253]: cluster 2024-08-31T06:09:56.750669+0000 mgr.a (mgr.14388) 10322 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:57 smithi027 bash[22610]: cluster 2024-08-31T06:09:56.750669+0000 mgr.a (mgr.14388) 10322 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:58.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:57 smithi191 bash[24992]: cluster 2024-08-31T06:09:56.750669+0000 mgr.a (mgr.14388) 10322 : cluster [DBG] pgmap v7155: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:09:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:58 smithi163 bash[24253]: audit 2024-08-31T06:09:57.244787+0000 mgr.a (mgr.14388) 10323 : audit [DBG] from='client.228312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:58 smithi027 bash[22610]: audit 2024-08-31T06:09:57.244787+0000 mgr.a (mgr.14388) 10323 : audit [DBG] from='client.228312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:09:59.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:58 smithi191 bash[24992]: audit 2024-08-31T06:09:57.244787+0000 mgr.a (mgr.14388) 10323 : audit [DBG] from='client.228312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:09:59 smithi163 bash[24253]: cluster 2024-08-31T06:09:58.753050+0000 mgr.a (mgr.14388) 10324 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:10:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:09:59 smithi027 bash[22610]: cluster 2024-08-31T06:09:58.753050+0000 mgr.a (mgr.14388) 10324 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:10:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:09:59 smithi191 bash[24992]: cluster 2024-08-31T06:09:58.753050+0000 mgr.a (mgr.14388) 10324 : cluster [DBG] pgmap v7156: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:10:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:00 smithi163 bash[24253]: cluster 2024-08-31T06:10:00.000159+0000 mon.a (mon.0) 2122 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:10:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:00 smithi027 bash[22610]: cluster 2024-08-31T06:10:00.000159+0000 mon.a (mon.0) 2122 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:10:01.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:00 smithi191 bash[24992]: cluster 2024-08-31T06:10:00.000159+0000 mon.a (mon.0) 2122 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:10:02.204 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:01 smithi163 bash[24253]: cluster 2024-08-31T06:10:00.753841+0000 mgr.a (mgr.14388) 10325 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:01 smithi027 bash[22610]: cluster 2024-08-31T06:10:00.753841+0000 mgr.a (mgr.14388) 10325 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:01 smithi191 bash[24992]: cluster 2024-08-31T06:10:00.753841+0000 mgr.a (mgr.14388) 10325 : cluster [DBG] pgmap v7157: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:10:02.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:10:02.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:10:03.476 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:10:03.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:10:03.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:10:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:10:03.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:10:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:03 smithi163 bash[24253]: cluster 2024-08-31T06:10:02.754599+0000 mgr.a (mgr.14388) 10326 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:03 smithi027 bash[22610]: cluster 2024-08-31T06:10:02.754599+0000 mgr.a (mgr.14388) 10326 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:03 smithi191 bash[24992]: cluster 2024-08-31T06:10:02.754599+0000 mgr.a (mgr.14388) 10326 : cluster [DBG] pgmap v7158: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:04 smithi163 bash[24253]: audit 2024-08-31T06:10:03.036806+0000 mgr.a (mgr.14388) 10327 : audit [DBG] from='client.228390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:04 smithi027 bash[22610]: audit 2024-08-31T06:10:03.036806+0000 mgr.a (mgr.14388) 10327 : audit [DBG] from='client.228390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:04 smithi191 bash[24992]: audit 2024-08-31T06:10:03.036806+0000 mgr.a (mgr.14388) 10327 : audit [DBG] from='client.228390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:05 smithi163 bash[24253]: cluster 2024-08-31T06:10:04.757372+0000 mgr.a (mgr.14388) 10328 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:05 smithi027 bash[22610]: cluster 2024-08-31T06:10:04.757372+0000 mgr.a (mgr.14388) 10328 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:06.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:05 smithi191 bash[24992]: cluster 2024-08-31T06:10:04.757372+0000 mgr.a (mgr.14388) 10328 : cluster [DBG] pgmap v7159: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:07 smithi163 bash[24253]: cluster 2024-08-31T06:10:06.758162+0000 mgr.a (mgr.14388) 10329 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:10:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:07 smithi027 bash[22610]: cluster 2024-08-31T06:10:06.758162+0000 mgr.a (mgr.14388) 10329 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:10:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:07 smithi191 bash[24992]: cluster 2024-08-31T06:10:06.758162+0000 mgr.a (mgr.14388) 10329 : cluster [DBG] pgmap v7160: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:10:08.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:10:08.478 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:10:08.478 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:10:09.225 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:10:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:10:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:10:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:10:09.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:10:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:09 smithi163 bash[24253]: cluster 2024-08-31T06:10:08.760116+0000 mgr.a (mgr.14388) 10330 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:09 smithi163 bash[24253]: audit 2024-08-31T06:10:08.808737+0000 mgr.a (mgr.14388) 10331 : audit [DBG] from='client.228462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:09 smithi027 bash[22610]: cluster 2024-08-31T06:10:08.760116+0000 mgr.a (mgr.14388) 10330 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:09 smithi027 bash[22610]: audit 2024-08-31T06:10:08.808737+0000 mgr.a (mgr.14388) 10331 : audit [DBG] from='client.228462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:09 smithi191 bash[24992]: cluster 2024-08-31T06:10:08.760116+0000 mgr.a (mgr.14388) 10330 : cluster [DBG] pgmap v7161: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:09 smithi191 bash[24992]: audit 2024-08-31T06:10:08.808737+0000 mgr.a (mgr.14388) 10331 : audit [DBG] from='client.228462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:11 smithi027 bash[22610]: cluster 2024-08-31T06:10:10.761014+0000 mgr.a (mgr.14388) 10332 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:10:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:11 smithi191 bash[24992]: cluster 2024-08-31T06:10:10.761014+0000 mgr.a (mgr.14388) 10332 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:10:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:11 smithi163 bash[24253]: cluster 2024-08-31T06:10:10.761014+0000 mgr.a (mgr.14388) 10332 : cluster [DBG] pgmap v7162: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:10:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:10:14.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:10:14.228 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:10:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:13 smithi027 bash[22610]: cluster 2024-08-31T06:10:12.761796+0000 mgr.a (mgr.14388) 10333 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:10:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:13 smithi191 bash[24992]: cluster 2024-08-31T06:10:12.761796+0000 mgr.a (mgr.14388) 10333 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:10:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:13 smithi163 bash[24253]: cluster 2024-08-31T06:10:12.761796+0000 mgr.a (mgr.14388) 10333 : cluster [DBG] pgmap v7163: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:10:14.998 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:10:14.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:10:14.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:10:14.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:10:14.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:10:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:15 smithi027 bash[22610]: audit 2024-08-31T06:10:14.565853+0000 mgr.a (mgr.14388) 10334 : audit [DBG] from='client.228537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:15 smithi027 bash[22610]: cluster 2024-08-31T06:10:14.763239+0000 mgr.a (mgr.14388) 10335 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:16.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:15 smithi191 bash[24992]: audit 2024-08-31T06:10:14.565853+0000 mgr.a (mgr.14388) 10334 : audit [DBG] from='client.228537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:16.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:15 smithi191 bash[24992]: cluster 2024-08-31T06:10:14.763239+0000 mgr.a (mgr.14388) 10335 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:15 smithi163 bash[24253]: audit 2024-08-31T06:10:14.565853+0000 mgr.a (mgr.14388) 10334 : audit [DBG] from='client.228537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:15 smithi163 bash[24253]: cluster 2024-08-31T06:10:14.763239+0000 mgr.a (mgr.14388) 10335 : cluster [DBG] pgmap v7164: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:17 smithi027 bash[22610]: cluster 2024-08-31T06:10:16.764134+0000 mgr.a (mgr.14388) 10336 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:17 smithi191 bash[24992]: cluster 2024-08-31T06:10:16.764134+0000 mgr.a (mgr.14388) 10336 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:17 smithi163 bash[24253]: cluster 2024-08-31T06:10:16.764134+0000 mgr.a (mgr.14388) 10336 : cluster [DBG] pgmap v7165: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:19.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:10:20.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:10:20.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:10:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:19 smithi027 bash[22610]: cluster 2024-08-31T06:10:18.766298+0000 mgr.a (mgr.14388) 10337 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:10:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:19 smithi191 bash[24992]: cluster 2024-08-31T06:10:18.766298+0000 mgr.a (mgr.14388) 10337 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:10:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:19 smithi163 bash[24253]: cluster 2024-08-31T06:10:18.766298+0000 mgr.a (mgr.14388) 10337 : cluster [DBG] pgmap v7166: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:10:20.751 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:10:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:10:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:10:20.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:10:20.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:10:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:21 smithi027 bash[22610]: audit 2024-08-31T06:10:20.328868+0000 mgr.a (mgr.14388) 10338 : audit [DBG] from='client.228612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:21 smithi027 bash[22610]: cluster 2024-08-31T06:10:20.766812+0000 mgr.a (mgr.14388) 10339 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:21 smithi027 bash[22610]: audit 2024-08-31T06:10:21.038827+0000 mon.a (mon.0) 2123 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:10:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:21 smithi027 bash[22610]: audit 2024-08-31T06:10:21.855595+0000 mon.a (mon.0) 2124 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:10:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:21 smithi027 bash[22610]: audit 2024-08-31T06:10:21.857041+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:10:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:21 smithi027 bash[22610]: audit 2024-08-31T06:10:21.867052+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:10:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:21 smithi027 bash[22610]: audit 2024-08-31T06:10:21.871734+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:10:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:21 smithi191 bash[24992]: audit 2024-08-31T06:10:20.328868+0000 mgr.a (mgr.14388) 10338 : audit [DBG] from='client.228612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:21 smithi191 bash[24992]: cluster 2024-08-31T06:10:20.766812+0000 mgr.a (mgr.14388) 10339 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:21 smithi191 bash[24992]: audit 2024-08-31T06:10:21.038827+0000 mon.a (mon.0) 2123 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:10:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:21 smithi191 bash[24992]: audit 2024-08-31T06:10:21.855595+0000 mon.a (mon.0) 2124 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:10:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:21 smithi191 bash[24992]: audit 2024-08-31T06:10:21.857041+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:10:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:21 smithi191 bash[24992]: audit 2024-08-31T06:10:21.867052+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:10:22.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:21 smithi191 bash[24992]: audit 2024-08-31T06:10:21.871734+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:10:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:21 smithi163 bash[24253]: audit 2024-08-31T06:10:20.328868+0000 mgr.a (mgr.14388) 10338 : audit [DBG] from='client.228612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:21 smithi163 bash[24253]: cluster 2024-08-31T06:10:20.766812+0000 mgr.a (mgr.14388) 10339 : cluster [DBG] pgmap v7167: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:22.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:21 smithi163 bash[24253]: audit 2024-08-31T06:10:21.038827+0000 mon.a (mon.0) 2123 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:10:22.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:21 smithi163 bash[24253]: audit 2024-08-31T06:10:21.855595+0000 mon.a (mon.0) 2124 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:10:22.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:21 smithi163 bash[24253]: audit 2024-08-31T06:10:21.857041+0000 mon.a (mon.0) 2125 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:10:22.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:21 smithi163 bash[24253]: audit 2024-08-31T06:10:21.867052+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:10:22.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:21 smithi163 bash[24253]: audit 2024-08-31T06:10:21.871734+0000 mon.a (mon.0) 2127 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:10:22.978 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:10:22 smithi027 bash[22863]: debug 2024-08-31T06:10:22.603+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:10:22.978 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:10:22 smithi027 bash[22863]: debug 2024-08-31T06:10:22.603+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:10:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:22 smithi027 bash[22610]: audit 2024-08-31T06:10:21.872952+0000 mgr.a (mgr.14388) 10340 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:10:23.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:22 smithi191 bash[24992]: audit 2024-08-31T06:10:21.872952+0000 mgr.a (mgr.14388) 10340 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:10:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:22 smithi163 bash[24253]: audit 2024-08-31T06:10:21.872952+0000 mgr.a (mgr.14388) 10340 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:10:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:23 smithi191 bash[24992]: audit 2024-08-31T06:10:22.607921+0000 mgr.a (mgr.14388) 10341 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:10:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:23 smithi191 bash[24992]: cephadm 2024-08-31T06:10:22.609799+0000 mgr.a (mgr.14388) 10342 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:10:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:23 smithi191 bash[24992]: cluster 2024-08-31T06:10:22.767814+0000 mgr.a (mgr.14388) 10343 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:23 smithi163 bash[24253]: audit 2024-08-31T06:10:22.607921+0000 mgr.a (mgr.14388) 10341 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:10:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:23 smithi163 bash[24253]: cephadm 2024-08-31T06:10:22.609799+0000 mgr.a (mgr.14388) 10342 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:10:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:23 smithi163 bash[24253]: cluster 2024-08-31T06:10:22.767814+0000 mgr.a (mgr.14388) 10343 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:23 smithi027 bash[22610]: audit 2024-08-31T06:10:22.607921+0000 mgr.a (mgr.14388) 10341 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:10:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:23 smithi027 bash[22610]: cephadm 2024-08-31T06:10:22.609799+0000 mgr.a (mgr.14388) 10342 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:10:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:23 smithi027 bash[22610]: cluster 2024-08-31T06:10:22.767814+0000 mgr.a (mgr.14388) 10343 : cluster [DBG] pgmap v7168: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:25.753 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:10:25.753 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:10:25.753 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:10:26.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:25 smithi191 bash[24992]: cluster 2024-08-31T06:10:24.770104+0000 mgr.a (mgr.14388) 10344 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:25 smithi163 bash[24253]: cluster 2024-08-31T06:10:24.770104+0000 mgr.a (mgr.14388) 10344 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:25 smithi027 bash[22610]: cluster 2024-08-31T06:10:24.770104+0000 mgr.a (mgr.14388) 10344 : cluster [DBG] pgmap v7169: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:26.534 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:10:26.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:10:26.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:10:26.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:10:26.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:10:28.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:27 smithi191 bash[24992]: audit 2024-08-31T06:10:26.093035+0000 mgr.a (mgr.14388) 10345 : audit [DBG] from='client.228795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:28.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:27 smithi191 bash[24992]: cluster 2024-08-31T06:10:26.771205+0000 mgr.a (mgr.14388) 10346 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:27 smithi163 bash[24253]: audit 2024-08-31T06:10:26.093035+0000 mgr.a (mgr.14388) 10345 : audit [DBG] from='client.228795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:27 smithi163 bash[24253]: cluster 2024-08-31T06:10:26.771205+0000 mgr.a (mgr.14388) 10346 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:27 smithi027 bash[22610]: audit 2024-08-31T06:10:26.093035+0000 mgr.a (mgr.14388) 10345 : audit [DBG] from='client.228795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:27 smithi027 bash[22610]: cluster 2024-08-31T06:10:26.771205+0000 mgr.a (mgr.14388) 10346 : cluster [DBG] pgmap v7170: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:30 smithi191 bash[24992]: cluster 2024-08-31T06:10:28.773611+0000 mgr.a (mgr.14388) 10347 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:30 smithi163 bash[24253]: cluster 2024-08-31T06:10:28.773611+0000 mgr.a (mgr.14388) 10347 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:30 smithi027 bash[22610]: cluster 2024-08-31T06:10:28.773611+0000 mgr.a (mgr.14388) 10347 : cluster [DBG] pgmap v7171: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:31.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:10:31.536 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:10:31.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:10:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:32 smithi191 bash[24992]: cluster 2024-08-31T06:10:30.774567+0000 mgr.a (mgr.14388) 10348 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:32.300 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:10:32.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:10:32.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:10:32.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:10:32.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:10:32.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:32 smithi163 bash[24253]: cluster 2024-08-31T06:10:30.774567+0000 mgr.a (mgr.14388) 10348 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:32 smithi027 bash[22610]: cluster 2024-08-31T06:10:30.774567+0000 mgr.a (mgr.14388) 10348 : cluster [DBG] pgmap v7172: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:33 smithi191 bash[24992]: audit 2024-08-31T06:10:31.869357+0000 mgr.a (mgr.14388) 10349 : audit [DBG] from='client.228870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:33 smithi163 bash[24253]: audit 2024-08-31T06:10:31.869357+0000 mgr.a (mgr.14388) 10349 : audit [DBG] from='client.228870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:33 smithi027 bash[22610]: audit 2024-08-31T06:10:31.869357+0000 mgr.a (mgr.14388) 10349 : audit [DBG] from='client.228870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:34 smithi191 bash[24992]: cluster 2024-08-31T06:10:32.775713+0000 mgr.a (mgr.14388) 10350 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:34.459 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:34 smithi163 bash[24253]: cluster 2024-08-31T06:10:32.775713+0000 mgr.a (mgr.14388) 10350 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:34.961 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:34 smithi027 bash[22610]: cluster 2024-08-31T06:10:32.775713+0000 mgr.a (mgr.14388) 10350 : cluster [DBG] pgmap v7173: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:35 smithi163 bash[24253]: cluster 2024-08-31T06:10:34.778126+0000 mgr.a (mgr.14388) 10351 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:35 smithi027 bash[22610]: cluster 2024-08-31T06:10:34.778126+0000 mgr.a (mgr.14388) 10351 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:35 smithi191 bash[24992]: cluster 2024-08-31T06:10:34.778126+0000 mgr.a (mgr.14388) 10351 : cluster [DBG] pgmap v7174: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:10:37.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:10:37.302 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:10:37.302 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:10:38.082 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:10:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:10:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:10:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:10:38.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:10:38.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:37 smithi163 bash[24253]: cluster 2024-08-31T06:10:36.779038+0000 mgr.a (mgr.14388) 10352 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:38.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:37 smithi027 bash[22610]: cluster 2024-08-31T06:10:36.779038+0000 mgr.a (mgr.14388) 10352 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:38.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:37 smithi191 bash[24992]: cluster 2024-08-31T06:10:36.779038+0000 mgr.a (mgr.14388) 10352 : cluster [DBG] pgmap v7175: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:38 smithi163 bash[24253]: audit 2024-08-31T06:10:37.635010+0000 mgr.a (mgr.14388) 10353 : audit [DBG] from='client.228948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:38 smithi027 bash[22610]: audit 2024-08-31T06:10:37.635010+0000 mgr.a (mgr.14388) 10353 : audit [DBG] from='client.228948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:39.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:38 smithi191 bash[24992]: audit 2024-08-31T06:10:37.635010+0000 mgr.a (mgr.14388) 10353 : audit [DBG] from='client.228948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:40.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:39 smithi163 bash[24253]: cluster 2024-08-31T06:10:38.781598+0000 mgr.a (mgr.14388) 10354 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:10:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:39 smithi027 bash[22610]: cluster 2024-08-31T06:10:38.781598+0000 mgr.a (mgr.14388) 10354 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:10:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:39 smithi191 bash[24992]: cluster 2024-08-31T06:10:38.781598+0000 mgr.a (mgr.14388) 10354 : cluster [DBG] pgmap v7176: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:10:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:41 smithi163 bash[24253]: cluster 2024-08-31T06:10:40.782537+0000 mgr.a (mgr.14388) 10355 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:10:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:41 smithi027 bash[22610]: cluster 2024-08-31T06:10:40.782537+0000 mgr.a (mgr.14388) 10355 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:10:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:41 smithi191 bash[24992]: cluster 2024-08-31T06:10:40.782537+0000 mgr.a (mgr.14388) 10355 : cluster [DBG] pgmap v7177: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:10:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:10:43.085 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:10:43.085 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:10:43.865 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:10:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:10:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:10:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:10:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:10:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:43 smithi163 bash[24253]: cluster 2024-08-31T06:10:42.783330+0000 mgr.a (mgr.14388) 10356 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:10:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:43 smithi027 bash[22610]: cluster 2024-08-31T06:10:42.783330+0000 mgr.a (mgr.14388) 10356 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:10:44.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:43 smithi191 bash[24992]: cluster 2024-08-31T06:10:42.783330+0000 mgr.a (mgr.14388) 10356 : cluster [DBG] pgmap v7178: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:10:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:44 smithi163 bash[24253]: audit 2024-08-31T06:10:43.419808+0000 mgr.a (mgr.14388) 10357 : audit [DBG] from='client.229023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:44 smithi027 bash[22610]: audit 2024-08-31T06:10:43.419808+0000 mgr.a (mgr.14388) 10357 : audit [DBG] from='client.229023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:44 smithi191 bash[24992]: audit 2024-08-31T06:10:43.419808+0000 mgr.a (mgr.14388) 10357 : audit [DBG] from='client.229023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:46.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:45 smithi163 bash[24253]: cluster 2024-08-31T06:10:44.786166+0000 mgr.a (mgr.14388) 10358 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:45 smithi027 bash[22610]: cluster 2024-08-31T06:10:44.786166+0000 mgr.a (mgr.14388) 10358 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:46.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:45 smithi191 bash[24992]: cluster 2024-08-31T06:10:44.786166+0000 mgr.a (mgr.14388) 10358 : cluster [DBG] pgmap v7179: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:47 smithi163 bash[24253]: cluster 2024-08-31T06:10:46.786997+0000 mgr.a (mgr.14388) 10359 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:10:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:47 smithi027 bash[22610]: cluster 2024-08-31T06:10:46.786997+0000 mgr.a (mgr.14388) 10359 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:10:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:47 smithi191 bash[24992]: cluster 2024-08-31T06:10:46.786997+0000 mgr.a (mgr.14388) 10359 : cluster [DBG] pgmap v7180: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:10:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:10:48.868 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:10:48.868 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:10:49.638 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:10:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:10:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:10:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:10:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:10:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:49 smithi163 bash[24253]: cluster 2024-08-31T06:10:48.789120+0000 mgr.a (mgr.14388) 10360 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:49 smithi027 bash[22610]: cluster 2024-08-31T06:10:48.789120+0000 mgr.a (mgr.14388) 10360 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:49.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:49 smithi191 bash[24992]: cluster 2024-08-31T06:10:48.789120+0000 mgr.a (mgr.14388) 10360 : cluster [DBG] pgmap v7181: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:50.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:50 smithi163 bash[24253]: audit 2024-08-31T06:10:49.198873+0000 mgr.a (mgr.14388) 10361 : audit [DBG] from='client.229101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:50 smithi027 bash[22610]: audit 2024-08-31T06:10:49.198873+0000 mgr.a (mgr.14388) 10361 : audit [DBG] from='client.229101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:50 smithi191 bash[24992]: audit 2024-08-31T06:10:49.198873+0000 mgr.a (mgr.14388) 10361 : audit [DBG] from='client.229101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:51 smithi163 bash[24253]: cluster 2024-08-31T06:10:50.790016+0000 mgr.a (mgr.14388) 10362 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:10:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:51 smithi027 bash[22610]: cluster 2024-08-31T06:10:50.790016+0000 mgr.a (mgr.14388) 10362 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:10:51.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:51 smithi191 bash[24992]: cluster 2024-08-31T06:10:50.790016+0000 mgr.a (mgr.14388) 10362 : cluster [DBG] pgmap v7182: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:10:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:53 smithi163 bash[24253]: cluster 2024-08-31T06:10:52.790798+0000 mgr.a (mgr.14388) 10363 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:10:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:53 smithi027 bash[22610]: cluster 2024-08-31T06:10:52.790798+0000 mgr.a (mgr.14388) 10363 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:10:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:53 smithi191 bash[24992]: cluster 2024-08-31T06:10:52.790798+0000 mgr.a (mgr.14388) 10363 : cluster [DBG] pgmap v7183: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:10:54.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:10:54.641 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:10:54.641 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:10:55.424 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:10:55.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:10:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:10:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:10:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:10:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:55 smithi163 bash[24253]: cluster 2024-08-31T06:10:54.792174+0000 mgr.a (mgr.14388) 10364 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:10:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:55 smithi163 bash[24253]: audit 2024-08-31T06:10:54.975448+0000 mgr.a (mgr.14388) 10365 : audit [DBG] from='client.229179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:55 smithi027 bash[22610]: cluster 2024-08-31T06:10:54.792174+0000 mgr.a (mgr.14388) 10364 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:10:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:55 smithi027 bash[22610]: audit 2024-08-31T06:10:54.975448+0000 mgr.a (mgr.14388) 10365 : audit [DBG] from='client.229179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:56.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:55 smithi191 bash[24992]: cluster 2024-08-31T06:10:54.792174+0000 mgr.a (mgr.14388) 10364 : cluster [DBG] pgmap v7184: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:10:56.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:55 smithi191 bash[24992]: audit 2024-08-31T06:10:54.975448+0000 mgr.a (mgr.14388) 10365 : audit [DBG] from='client.229179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:10:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:57 smithi163 bash[24253]: cluster 2024-08-31T06:10:56.793187+0000 mgr.a (mgr.14388) 10366 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:57 smithi027 bash[22610]: cluster 2024-08-31T06:10:56.793187+0000 mgr.a (mgr.14388) 10366 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:10:58.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:57 smithi191 bash[24992]: cluster 2024-08-31T06:10:56.793187+0000 mgr.a (mgr.14388) 10366 : cluster [DBG] pgmap v7185: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:10:59 smithi163 bash[24253]: cluster 2024-08-31T06:10:58.795564+0000 mgr.a (mgr.14388) 10367 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:10:59 smithi027 bash[22610]: cluster 2024-08-31T06:10:58.795564+0000 mgr.a (mgr.14388) 10367 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:10:59 smithi191 bash[24992]: cluster 2024-08-31T06:10:58.795564+0000 mgr.a (mgr.14388) 10367 : cluster [DBG] pgmap v7186: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:00.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:00.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:00.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:01.171 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:01.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:01.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:01.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:01.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:11:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:01 smithi163 bash[24253]: audit 2024-08-31T06:11:00.756719+0000 mgr.a (mgr.14388) 10368 : audit [DBG] from='client.229254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:01 smithi163 bash[24253]: cluster 2024-08-31T06:11:00.796365+0000 mgr.a (mgr.14388) 10369 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:01 smithi027 bash[22610]: audit 2024-08-31T06:11:00.756719+0000 mgr.a (mgr.14388) 10368 : audit [DBG] from='client.229254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:01 smithi027 bash[22610]: cluster 2024-08-31T06:11:00.796365+0000 mgr.a (mgr.14388) 10369 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:01 smithi191 bash[24992]: audit 2024-08-31T06:11:00.756719+0000 mgr.a (mgr.14388) 10368 : audit [DBG] from='client.229254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:01 smithi191 bash[24992]: cluster 2024-08-31T06:11:00.796365+0000 mgr.a (mgr.14388) 10369 : cluster [DBG] pgmap v7187: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:03 smithi163 bash[24253]: cluster 2024-08-31T06:11:02.797231+0000 mgr.a (mgr.14388) 10370 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:03 smithi027 bash[22610]: cluster 2024-08-31T06:11:02.797231+0000 mgr.a (mgr.14388) 10370 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:03 smithi191 bash[24992]: cluster 2024-08-31T06:11:02.797231+0000 mgr.a (mgr.14388) 10370 : cluster [DBG] pgmap v7188: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:06.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:06.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:06.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:05 smithi163 bash[24253]: cluster 2024-08-31T06:11:04.799458+0000 mgr.a (mgr.14388) 10371 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:05 smithi027 bash[22610]: cluster 2024-08-31T06:11:04.799458+0000 mgr.a (mgr.14388) 10371 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:06.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:05 smithi191 bash[24992]: cluster 2024-08-31T06:11:04.799458+0000 mgr.a (mgr.14388) 10371 : cluster [DBG] pgmap v7189: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:06.925 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:06.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:06.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:06.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:06.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:11:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:07 smithi163 bash[24253]: audit 2024-08-31T06:11:06.499259+0000 mgr.a (mgr.14388) 10372 : audit [DBG] from='client.229329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:08.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:07 smithi163 bash[24253]: cluster 2024-08-31T06:11:06.799933+0000 mgr.a (mgr.14388) 10373 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:07 smithi027 bash[22610]: audit 2024-08-31T06:11:06.499259+0000 mgr.a (mgr.14388) 10372 : audit [DBG] from='client.229329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:07 smithi027 bash[22610]: cluster 2024-08-31T06:11:06.799933+0000 mgr.a (mgr.14388) 10373 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:07 smithi191 bash[24992]: audit 2024-08-31T06:11:06.499259+0000 mgr.a (mgr.14388) 10372 : audit [DBG] from='client.229329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:07 smithi191 bash[24992]: cluster 2024-08-31T06:11:06.799933+0000 mgr.a (mgr.14388) 10373 : cluster [DBG] pgmap v7190: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:09 smithi163 bash[24253]: cluster 2024-08-31T06:11:08.802340+0000 mgr.a (mgr.14388) 10374 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:09 smithi027 bash[22610]: cluster 2024-08-31T06:11:08.802340+0000 mgr.a (mgr.14388) 10374 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:09 smithi191 bash[24992]: cluster 2024-08-31T06:11:08.802340+0000 mgr.a (mgr.14388) 10374 : cluster [DBG] pgmap v7191: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:11.927 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:11.928 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:11 smithi163 bash[24253]: cluster 2024-08-31T06:11:10.803298+0000 mgr.a (mgr.14388) 10375 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:11 smithi027 bash[22610]: cluster 2024-08-31T06:11:10.803298+0000 mgr.a (mgr.14388) 10375 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:11 smithi191 bash[24992]: cluster 2024-08-31T06:11:10.803298+0000 mgr.a (mgr.14388) 10375 : cluster [DBG] pgmap v7192: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:12.694 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:12.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:12.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:12.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:12.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:11:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:13 smithi163 bash[24253]: audit 2024-08-31T06:11:12.266215+0000 mgr.a (mgr.14388) 10376 : audit [DBG] from='client.229407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:13 smithi163 bash[24253]: cluster 2024-08-31T06:11:12.804268+0000 mgr.a (mgr.14388) 10377 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:13 smithi027 bash[22610]: audit 2024-08-31T06:11:12.266215+0000 mgr.a (mgr.14388) 10376 : audit [DBG] from='client.229407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:13 smithi027 bash[22610]: cluster 2024-08-31T06:11:12.804268+0000 mgr.a (mgr.14388) 10377 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:13 smithi191 bash[24992]: audit 2024-08-31T06:11:12.266215+0000 mgr.a (mgr.14388) 10376 : audit [DBG] from='client.229407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:13 smithi191 bash[24992]: cluster 2024-08-31T06:11:12.804268+0000 mgr.a (mgr.14388) 10377 : cluster [DBG] pgmap v7193: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:15 smithi163 bash[24253]: cluster 2024-08-31T06:11:14.806508+0000 mgr.a (mgr.14388) 10378 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:15 smithi027 bash[22610]: cluster 2024-08-31T06:11:14.806508+0000 mgr.a (mgr.14388) 10378 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:16.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:15 smithi191 bash[24992]: cluster 2024-08-31T06:11:14.806508+0000 mgr.a (mgr.14388) 10378 : cluster [DBG] pgmap v7194: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:17.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:17.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:17.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:17 smithi163 bash[24253]: cluster 2024-08-31T06:11:16.807281+0000 mgr.a (mgr.14388) 10379 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:17 smithi027 bash[22610]: cluster 2024-08-31T06:11:16.807281+0000 mgr.a (mgr.14388) 10379 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:17 smithi191 bash[24992]: cluster 2024-08-31T06:11:16.807281+0000 mgr.a (mgr.14388) 10379 : cluster [DBG] pgmap v7195: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:18.458 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:11:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:19 smithi163 bash[24253]: audit 2024-08-31T06:11:18.031683+0000 mgr.a (mgr.14388) 10380 : audit [DBG] from='client.229485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:19 smithi163 bash[24253]: cluster 2024-08-31T06:11:18.810038+0000 mgr.a (mgr.14388) 10381 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:19 smithi027 bash[22610]: audit 2024-08-31T06:11:18.031683+0000 mgr.a (mgr.14388) 10380 : audit [DBG] from='client.229485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:19 smithi027 bash[22610]: cluster 2024-08-31T06:11:18.810038+0000 mgr.a (mgr.14388) 10381 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:19 smithi191 bash[24992]: audit 2024-08-31T06:11:18.031683+0000 mgr.a (mgr.14388) 10380 : audit [DBG] from='client.229485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:19 smithi191 bash[24992]: cluster 2024-08-31T06:11:18.810038+0000 mgr.a (mgr.14388) 10381 : cluster [DBG] pgmap v7196: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:21 smithi163 bash[24253]: cluster 2024-08-31T06:11:20.810852+0000 mgr.a (mgr.14388) 10382 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:11:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:21 smithi027 bash[22610]: cluster 2024-08-31T06:11:20.810852+0000 mgr.a (mgr.14388) 10382 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:11:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:21 smithi191 bash[24992]: cluster 2024-08-31T06:11:20.810852+0000 mgr.a (mgr.14388) 10382 : cluster [DBG] pgmap v7197: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:11:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:22 smithi163 bash[24253]: audit 2024-08-31T06:11:22.661437+0000 mon.a (mon.0) 2128 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:11:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:22 smithi027 bash[22610]: audit 2024-08-31T06:11:22.661437+0000 mon.a (mon.0) 2128 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:11:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:22 smithi191 bash[24992]: audit 2024-08-31T06:11:22.661437+0000 mon.a (mon.0) 2128 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:11:23.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:23.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:23.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:23 smithi163 bash[24253]: cluster 2024-08-31T06:11:22.811460+0000 mgr.a (mgr.14388) 10383 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:11:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:23 smithi163 bash[24253]: audit 2024-08-31T06:11:23.507438+0000 mon.a (mon.0) 2129 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:11:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:23 smithi163 bash[24253]: audit 2024-08-31T06:11:23.508890+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:11:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:23 smithi163 bash[24253]: audit 2024-08-31T06:11:23.517637+0000 mon.a (mon.0) 2131 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:11:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:23 smithi163 bash[24253]: audit 2024-08-31T06:11:23.520256+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:11:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:23 smithi027 bash[22610]: cluster 2024-08-31T06:11:22.811460+0000 mgr.a (mgr.14388) 10383 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:11:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:23 smithi027 bash[22610]: audit 2024-08-31T06:11:23.507438+0000 mon.a (mon.0) 2129 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:11:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:23 smithi027 bash[22610]: audit 2024-08-31T06:11:23.508890+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:11:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:23 smithi027 bash[22610]: audit 2024-08-31T06:11:23.517637+0000 mon.a (mon.0) 2131 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:11:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:23 smithi027 bash[22610]: audit 2024-08-31T06:11:23.520256+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:11:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:23 smithi191 bash[24992]: cluster 2024-08-31T06:11:22.811460+0000 mgr.a (mgr.14388) 10383 : cluster [DBG] pgmap v7198: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:11:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:23 smithi191 bash[24992]: audit 2024-08-31T06:11:23.507438+0000 mon.a (mon.0) 2129 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:11:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:23 smithi191 bash[24992]: audit 2024-08-31T06:11:23.508890+0000 mon.a (mon.0) 2130 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:11:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:23 smithi191 bash[24992]: audit 2024-08-31T06:11:23.517637+0000 mon.a (mon.0) 2131 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:11:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:23 smithi191 bash[24992]: audit 2024-08-31T06:11:23.520256+0000 mon.a (mon.0) 2132 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:11:24.645 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:11:24.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:11:24 smithi027 bash[22863]: debug 2024-08-31T06:11:24.246+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:11:24.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:11:24 smithi027 bash[22863]: debug 2024-08-31T06:11:24.258+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:11:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:24 smithi163 bash[24253]: audit 2024-08-31T06:11:23.521349+0000 mgr.a (mgr.14388) 10384 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:11:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:24 smithi163 bash[24253]: audit 2024-08-31T06:11:23.825503+0000 mgr.a (mgr.14388) 10385 : audit [DBG] from='client.229563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:24 smithi027 bash[22610]: audit 2024-08-31T06:11:23.521349+0000 mgr.a (mgr.14388) 10384 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:11:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:24 smithi027 bash[22610]: audit 2024-08-31T06:11:23.825503+0000 mgr.a (mgr.14388) 10385 : audit [DBG] from='client.229563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:25.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:24 smithi191 bash[24992]: audit 2024-08-31T06:11:23.521349+0000 mgr.a (mgr.14388) 10384 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:11:25.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:24 smithi191 bash[24992]: audit 2024-08-31T06:11:23.825503+0000 mgr.a (mgr.14388) 10385 : audit [DBG] from='client.229563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:25 smithi163 bash[24253]: audit 2024-08-31T06:11:24.250366+0000 mgr.a (mgr.14388) 10386 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:11:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:25 smithi163 bash[24253]: cephadm 2024-08-31T06:11:24.260917+0000 mgr.a (mgr.14388) 10387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:11:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:25 smithi163 bash[24253]: cluster 2024-08-31T06:11:24.814232+0000 mgr.a (mgr.14388) 10388 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:25 smithi027 bash[22610]: audit 2024-08-31T06:11:24.250366+0000 mgr.a (mgr.14388) 10386 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:11:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:25 smithi027 bash[22610]: cephadm 2024-08-31T06:11:24.260917+0000 mgr.a (mgr.14388) 10387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:11:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:25 smithi027 bash[22610]: cluster 2024-08-31T06:11:24.814232+0000 mgr.a (mgr.14388) 10388 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:26.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:25 smithi191 bash[24992]: audit 2024-08-31T06:11:24.250366+0000 mgr.a (mgr.14388) 10386 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:11:26.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:25 smithi191 bash[24992]: cephadm 2024-08-31T06:11:24.260917+0000 mgr.a (mgr.14388) 10387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:11:26.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:25 smithi191 bash[24992]: cluster 2024-08-31T06:11:24.814232+0000 mgr.a (mgr.14388) 10388 : cluster [DBG] pgmap v7199: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:27 smithi163 bash[24253]: cluster 2024-08-31T06:11:26.815046+0000 mgr.a (mgr.14388) 10389 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:11:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:27 smithi027 bash[22610]: cluster 2024-08-31T06:11:26.815046+0000 mgr.a (mgr.14388) 10389 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:11:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:27 smithi191 bash[24992]: cluster 2024-08-31T06:11:26.815046+0000 mgr.a (mgr.14388) 10389 : cluster [DBG] pgmap v7200: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:11:29.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:29.647 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:29.647 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:29 smithi163 bash[24253]: cluster 2024-08-31T06:11:28.817041+0000 mgr.a (mgr.14388) 10390 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:29 smithi027 bash[22610]: cluster 2024-08-31T06:11:28.817041+0000 mgr.a (mgr.14388) 10390 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:29 smithi191 bash[24992]: cluster 2024-08-31T06:11:28.817041+0000 mgr.a (mgr.14388) 10390 : cluster [DBG] pgmap v7201: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:30.396 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:30.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:30.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:30.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:30.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:11:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:30 smithi163 bash[24253]: audit 2024-08-31T06:11:29.980344+0000 mgr.a (mgr.14388) 10391 : audit [DBG] from='client.229749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:30 smithi027 bash[22610]: audit 2024-08-31T06:11:29.980344+0000 mgr.a (mgr.14388) 10391 : audit [DBG] from='client.229749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:30 smithi191 bash[24992]: audit 2024-08-31T06:11:29.980344+0000 mgr.a (mgr.14388) 10391 : audit [DBG] from='client.229749 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:31 smithi163 bash[24253]: cluster 2024-08-31T06:11:30.817991+0000 mgr.a (mgr.14388) 10392 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:31 smithi027 bash[22610]: cluster 2024-08-31T06:11:30.817991+0000 mgr.a (mgr.14388) 10392 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:31 smithi191 bash[24992]: cluster 2024-08-31T06:11:30.817991+0000 mgr.a (mgr.14388) 10392 : cluster [DBG] pgmap v7202: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:34.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:33 smithi027 bash[22610]: cluster 2024-08-31T06:11:32.818818+0000 mgr.a (mgr.14388) 10393 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:33 smithi191 bash[24992]: cluster 2024-08-31T06:11:32.818818+0000 mgr.a (mgr.14388) 10393 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:33 smithi163 bash[24253]: cluster 2024-08-31T06:11:32.818818+0000 mgr.a (mgr.14388) 10393 : cluster [DBG] pgmap v7203: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:35.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:35.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:35.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:36.154 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:36.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:36.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:36.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:36.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:11:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:35 smithi027 bash[22610]: cluster 2024-08-31T06:11:34.821029+0000 mgr.a (mgr.14388) 10394 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:36.346 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:35 smithi191 bash[24992]: cluster 2024-08-31T06:11:34.821029+0000 mgr.a (mgr.14388) 10394 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:35 smithi163 bash[24253]: cluster 2024-08-31T06:11:34.821029+0000 mgr.a (mgr.14388) 10394 : cluster [DBG] pgmap v7204: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:36 smithi027 bash[22610]: audit 2024-08-31T06:11:35.726456+0000 mgr.a (mgr.14388) 10395 : audit [DBG] from='client.229827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:37.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:36 smithi191 bash[24992]: audit 2024-08-31T06:11:35.726456+0000 mgr.a (mgr.14388) 10395 : audit [DBG] from='client.229827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:36 smithi163 bash[24253]: audit 2024-08-31T06:11:35.726456+0000 mgr.a (mgr.14388) 10395 : audit [DBG] from='client.229827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:38.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:37 smithi027 bash[22610]: cluster 2024-08-31T06:11:36.822073+0000 mgr.a (mgr.14388) 10396 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:38.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:37 smithi191 bash[24992]: cluster 2024-08-31T06:11:36.822073+0000 mgr.a (mgr.14388) 10396 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:38.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:37 smithi163 bash[24253]: cluster 2024-08-31T06:11:36.822073+0000 mgr.a (mgr.14388) 10396 : cluster [DBG] pgmap v7205: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:39 smithi027 bash[22610]: cluster 2024-08-31T06:11:38.824320+0000 mgr.a (mgr.14388) 10397 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:40.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:39 smithi191 bash[24992]: cluster 2024-08-31T06:11:38.824320+0000 mgr.a (mgr.14388) 10397 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:39 smithi163 bash[24253]: cluster 2024-08-31T06:11:38.824320+0000 mgr.a (mgr.14388) 10397 : cluster [DBG] pgmap v7206: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:11:41.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:41.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:41.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:41.939 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:41.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:41.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:41.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:41.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:11:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:41 smithi027 bash[22610]: cluster 2024-08-31T06:11:40.825073+0000 mgr.a (mgr.14388) 10398 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:41 smithi191 bash[24992]: cluster 2024-08-31T06:11:40.825073+0000 mgr.a (mgr.14388) 10398 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:41 smithi163 bash[24253]: cluster 2024-08-31T06:11:40.825073+0000 mgr.a (mgr.14388) 10398 : cluster [DBG] pgmap v7207: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:43.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:42 smithi191 bash[24992]: audit 2024-08-31T06:11:41.495084+0000 mgr.a (mgr.14388) 10399 : audit [DBG] from='client.229905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:42 smithi163 bash[24253]: audit 2024-08-31T06:11:41.495084+0000 mgr.a (mgr.14388) 10399 : audit [DBG] from='client.229905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:42 smithi027 bash[22610]: audit 2024-08-31T06:11:41.495084+0000 mgr.a (mgr.14388) 10399 : audit [DBG] from='client.229905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:44.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:43 smithi191 bash[24992]: cluster 2024-08-31T06:11:42.825956+0000 mgr.a (mgr.14388) 10400 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:43 smithi163 bash[24253]: cluster 2024-08-31T06:11:42.825956+0000 mgr.a (mgr.14388) 10400 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:43 smithi027 bash[22610]: cluster 2024-08-31T06:11:42.825956+0000 mgr.a (mgr.14388) 10400 : cluster [DBG] pgmap v7208: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:46.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:45 smithi191 bash[24992]: cluster 2024-08-31T06:11:44.828202+0000 mgr.a (mgr.14388) 10401 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:45 smithi163 bash[24253]: cluster 2024-08-31T06:11:44.828202+0000 mgr.a (mgr.14388) 10401 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:45 smithi027 bash[22610]: cluster 2024-08-31T06:11:44.828202+0000 mgr.a (mgr.14388) 10401 : cluster [DBG] pgmap v7209: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:46.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:46.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:46.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:47.723 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:11:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:47 smithi191 bash[24992]: cluster 2024-08-31T06:11:46.828965+0000 mgr.a (mgr.14388) 10402 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:47 smithi163 bash[24253]: cluster 2024-08-31T06:11:46.828965+0000 mgr.a (mgr.14388) 10402 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:47 smithi027 bash[22610]: cluster 2024-08-31T06:11:46.828965+0000 mgr.a (mgr.14388) 10402 : cluster [DBG] pgmap v7210: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:49.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:49 smithi191 bash[24992]: audit 2024-08-31T06:11:47.279634+0000 mgr.a (mgr.14388) 10403 : audit [DBG] from='client.229983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:49 smithi163 bash[24253]: audit 2024-08-31T06:11:47.279634+0000 mgr.a (mgr.14388) 10403 : audit [DBG] from='client.229983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:49 smithi027 bash[22610]: audit 2024-08-31T06:11:47.279634+0000 mgr.a (mgr.14388) 10403 : audit [DBG] from='client.229983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:50.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:50 smithi191 bash[24992]: cluster 2024-08-31T06:11:48.831253+0000 mgr.a (mgr.14388) 10404 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:50.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:50 smithi163 bash[24253]: cluster 2024-08-31T06:11:48.831253+0000 mgr.a (mgr.14388) 10404 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:50.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:50 smithi027 bash[22610]: cluster 2024-08-31T06:11:48.831253+0000 mgr.a (mgr.14388) 10404 : cluster [DBG] pgmap v7211: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:11:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:52 smithi191 bash[24992]: cluster 2024-08-31T06:11:50.832025+0000 mgr.a (mgr.14388) 10405 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:52.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:52 smithi163 bash[24253]: cluster 2024-08-31T06:11:50.832025+0000 mgr.a (mgr.14388) 10405 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:52 smithi027 bash[22610]: cluster 2024-08-31T06:11:50.832025+0000 mgr.a (mgr.14388) 10405 : cluster [DBG] pgmap v7212: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:52.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:52.726 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:52.726 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:53.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:53.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:53.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:11:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:54 smithi191 bash[24992]: cluster 2024-08-31T06:11:52.832440+0000 mgr.a (mgr.14388) 10406 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:54.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:54 smithi163 bash[24253]: cluster 2024-08-31T06:11:52.832440+0000 mgr.a (mgr.14388) 10406 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:54.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:54 smithi027 bash[22610]: cluster 2024-08-31T06:11:52.832440+0000 mgr.a (mgr.14388) 10406 : cluster [DBG] pgmap v7213: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:55.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:55 smithi191 bash[24992]: audit 2024-08-31T06:11:53.059509+0000 mgr.a (mgr.14388) 10407 : audit [DBG] from='client.230058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:55 smithi163 bash[24253]: audit 2024-08-31T06:11:53.059509+0000 mgr.a (mgr.14388) 10407 : audit [DBG] from='client.230058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:55 smithi027 bash[22610]: audit 2024-08-31T06:11:53.059509+0000 mgr.a (mgr.14388) 10407 : audit [DBG] from='client.230058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:11:56.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:56 smithi191 bash[24992]: cluster 2024-08-31T06:11:54.835098+0000 mgr.a (mgr.14388) 10408 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:56.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:56 smithi163 bash[24253]: cluster 2024-08-31T06:11:54.835098+0000 mgr.a (mgr.14388) 10408 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:56 smithi027 bash[22610]: cluster 2024-08-31T06:11:54.835098+0000 mgr.a (mgr.14388) 10408 : cluster [DBG] pgmap v7214: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:11:57.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:57 smithi163 bash[24253]: cluster 2024-08-31T06:11:56.835828+0000 mgr.a (mgr.14388) 10409 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:11:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:57 smithi027 bash[22610]: cluster 2024-08-31T06:11:56.835828+0000 mgr.a (mgr.14388) 10409 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:11:57.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:57 smithi191 bash[24992]: cluster 2024-08-31T06:11:56.835828+0000 mgr.a (mgr.14388) 10409 : cluster [DBG] pgmap v7215: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:11:58.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:11:58.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:11:58.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:11:59.258 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:11:59.258 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:11:59.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:11:59.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:11:59.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:59 smithi163 bash[24253]: audit 2024-08-31T06:11:58.820891+0000 mgr.a (mgr.14388) 10410 : audit [DBG] from='client.230136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:11:59 smithi163 bash[24253]: cluster 2024-08-31T06:11:58.839773+0000 mgr.a (mgr.14388) 10411 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:59 smithi027 bash[22610]: audit 2024-08-31T06:11:58.820891+0000 mgr.a (mgr.14388) 10410 : audit [DBG] from='client.230136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:11:59 smithi027 bash[22610]: cluster 2024-08-31T06:11:58.839773+0000 mgr.a (mgr.14388) 10411 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:59 smithi191 bash[24992]: audit 2024-08-31T06:11:58.820891+0000 mgr.a (mgr.14388) 10410 : audit [DBG] from='client.230136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:11:59 smithi191 bash[24992]: cluster 2024-08-31T06:11:58.839773+0000 mgr.a (mgr.14388) 10411 : cluster [DBG] pgmap v7216: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:01 smithi163 bash[24253]: cluster 2024-08-31T06:12:00.840637+0000 mgr.a (mgr.14388) 10412 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:12:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:01 smithi027 bash[22610]: cluster 2024-08-31T06:12:00.840637+0000 mgr.a (mgr.14388) 10412 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:12:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:01 smithi191 bash[24992]: cluster 2024-08-31T06:12:00.840637+0000 mgr.a (mgr.14388) 10412 : cluster [DBG] pgmap v7217: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:12:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:03 smithi163 bash[24253]: cluster 2024-08-31T06:12:02.842771+0000 mgr.a (mgr.14388) 10413 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:03 smithi027 bash[22610]: cluster 2024-08-31T06:12:02.842771+0000 mgr.a (mgr.14388) 10413 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:04.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:12:04.260 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:12:04.261 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:12:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:03 smithi191 bash[24992]: cluster 2024-08-31T06:12:02.842771+0000 mgr.a (mgr.14388) 10413 : cluster [DBG] pgmap v7218: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:04.997 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:12:04.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:12:04.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:12:04.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:12:04.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:05 smithi163 bash[24253]: audit 2024-08-31T06:12:04.581951+0000 mgr.a (mgr.14388) 10414 : audit [DBG] from='client.230211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:05 smithi163 bash[24253]: cluster 2024-08-31T06:12:04.843297+0000 mgr.a (mgr.14388) 10415 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:05 smithi027 bash[22610]: audit 2024-08-31T06:12:04.581951+0000 mgr.a (mgr.14388) 10414 : audit [DBG] from='client.230211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:05 smithi027 bash[22610]: cluster 2024-08-31T06:12:04.843297+0000 mgr.a (mgr.14388) 10415 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:06.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:05 smithi191 bash[24992]: audit 2024-08-31T06:12:04.581951+0000 mgr.a (mgr.14388) 10414 : audit [DBG] from='client.230211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:06.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:05 smithi191 bash[24992]: cluster 2024-08-31T06:12:04.843297+0000 mgr.a (mgr.14388) 10415 : cluster [DBG] pgmap v7219: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:07 smithi163 bash[24253]: cluster 2024-08-31T06:12:06.844158+0000 mgr.a (mgr.14388) 10416 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:07 smithi027 bash[22610]: cluster 2024-08-31T06:12:06.844158+0000 mgr.a (mgr.14388) 10416 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:07 smithi191 bash[24992]: cluster 2024-08-31T06:12:06.844158+0000 mgr.a (mgr.14388) 10416 : cluster [DBG] pgmap v7220: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:09.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:12:09.999 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:12:09.999 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:12:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:09 smithi163 bash[24253]: cluster 2024-08-31T06:12:08.846371+0000 mgr.a (mgr.14388) 10417 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:09 smithi027 bash[22610]: cluster 2024-08-31T06:12:08.846371+0000 mgr.a (mgr.14388) 10417 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:09 smithi191 bash[24992]: cluster 2024-08-31T06:12:08.846371+0000 mgr.a (mgr.14388) 10417 : cluster [DBG] pgmap v7221: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:10.772 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:12:10.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:12:10.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:12:10.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:12:10.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:11 smithi163 bash[24253]: audit 2024-08-31T06:12:10.333826+0000 mgr.a (mgr.14388) 10418 : audit [DBG] from='client.230289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:11 smithi163 bash[24253]: cluster 2024-08-31T06:12:10.846933+0000 mgr.a (mgr.14388) 10419 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:11 smithi027 bash[22610]: audit 2024-08-31T06:12:10.333826+0000 mgr.a (mgr.14388) 10418 : audit [DBG] from='client.230289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:11 smithi027 bash[22610]: cluster 2024-08-31T06:12:10.846933+0000 mgr.a (mgr.14388) 10419 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:11 smithi191 bash[24992]: audit 2024-08-31T06:12:10.333826+0000 mgr.a (mgr.14388) 10418 : audit [DBG] from='client.230289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:11 smithi191 bash[24992]: cluster 2024-08-31T06:12:10.846933+0000 mgr.a (mgr.14388) 10419 : cluster [DBG] pgmap v7222: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:13 smithi163 bash[24253]: cluster 2024-08-31T06:12:12.849037+0000 mgr.a (mgr.14388) 10420 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:13 smithi027 bash[22610]: cluster 2024-08-31T06:12:12.849037+0000 mgr.a (mgr.14388) 10420 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:13 smithi191 bash[24992]: cluster 2024-08-31T06:12:12.849037+0000 mgr.a (mgr.14388) 10420 : cluster [DBG] pgmap v7223: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:15.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:12:15.774 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:12:15.774 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:12:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:15 smithi163 bash[24253]: cluster 2024-08-31T06:12:14.849804+0000 mgr.a (mgr.14388) 10421 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:15 smithi027 bash[22610]: cluster 2024-08-31T06:12:14.849804+0000 mgr.a (mgr.14388) 10421 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:16.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:15 smithi191 bash[24992]: cluster 2024-08-31T06:12:14.849804+0000 mgr.a (mgr.14388) 10421 : cluster [DBG] pgmap v7224: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:16.542 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:12:16.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:12:16.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:12:16.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:12:16.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:17 smithi163 bash[24253]: audit 2024-08-31T06:12:16.108649+0000 mgr.a (mgr.14388) 10422 : audit [DBG] from='client.230367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:17 smithi163 bash[24253]: cluster 2024-08-31T06:12:16.850744+0000 mgr.a (mgr.14388) 10423 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:17 smithi027 bash[22610]: audit 2024-08-31T06:12:16.108649+0000 mgr.a (mgr.14388) 10422 : audit [DBG] from='client.230367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:17 smithi027 bash[22610]: cluster 2024-08-31T06:12:16.850744+0000 mgr.a (mgr.14388) 10423 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:17 smithi191 bash[24992]: audit 2024-08-31T06:12:16.108649+0000 mgr.a (mgr.14388) 10422 : audit [DBG] from='client.230367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:17 smithi191 bash[24992]: cluster 2024-08-31T06:12:16.850744+0000 mgr.a (mgr.14388) 10423 : cluster [DBG] pgmap v7225: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:19 smithi163 bash[24253]: cluster 2024-08-31T06:12:18.852939+0000 mgr.a (mgr.14388) 10424 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:19 smithi027 bash[22610]: cluster 2024-08-31T06:12:18.852939+0000 mgr.a (mgr.14388) 10424 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:19 smithi191 bash[24992]: cluster 2024-08-31T06:12:18.852939+0000 mgr.a (mgr.14388) 10424 : cluster [DBG] pgmap v7226: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:21.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:12:21.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:12:21.545 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:12:22.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:21 smithi163 bash[24253]: cluster 2024-08-31T06:12:20.853722+0000 mgr.a (mgr.14388) 10425 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:21 smithi027 bash[22610]: cluster 2024-08-31T06:12:20.853722+0000 mgr.a (mgr.14388) 10425 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:21 smithi191 bash[24992]: cluster 2024-08-31T06:12:20.853722+0000 mgr.a (mgr.14388) 10425 : cluster [DBG] pgmap v7227: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:22.319 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:12:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:12:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:12:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:12:22.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:22 smithi027 bash[22610]: audit 2024-08-31T06:12:21.878085+0000 mgr.a (mgr.14388) 10426 : audit [DBG] from='client.230442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:23.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:22 smithi191 bash[24992]: audit 2024-08-31T06:12:21.878085+0000 mgr.a (mgr.14388) 10426 : audit [DBG] from='client.230442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:22 smithi163 bash[24253]: audit 2024-08-31T06:12:21.878085+0000 mgr.a (mgr.14388) 10426 : audit [DBG] from='client.230442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:23 smithi027 bash[22610]: cluster 2024-08-31T06:12:22.855981+0000 mgr.a (mgr.14388) 10427 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T06:12:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:23 smithi191 bash[24992]: cluster 2024-08-31T06:12:22.855981+0000 mgr.a (mgr.14388) 10427 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T06:12:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:23 smithi163 bash[24253]: cluster 2024-08-31T06:12:22.855981+0000 mgr.a (mgr.14388) 10427 : cluster [DBG] pgmap v7228: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T06:12:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:24 smithi027 bash[22610]: audit 2024-08-31T06:12:24.312802+0000 mon.a (mon.0) 2133 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:12:25.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:24 smithi191 bash[24992]: audit 2024-08-31T06:12:24.312802+0000 mon.a (mon.0) 2133 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:12:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:24 smithi163 bash[24253]: audit 2024-08-31T06:12:24.312802+0000 mon.a (mon.0) 2133 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:12:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:25 smithi027 bash[22610]: cluster 2024-08-31T06:12:24.856728+0000 mgr.a (mgr.14388) 10428 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:26.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:25 smithi191 bash[24992]: cluster 2024-08-31T06:12:24.856728+0000 mgr.a (mgr.14388) 10428 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:25 smithi163 bash[24253]: cluster 2024-08-31T06:12:24.856728+0000 mgr.a (mgr.14388) 10428 : cluster [DBG] pgmap v7229: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:27.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:12:27.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:12:27.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:12:28.095 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:12:28.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:12:28.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:12:28.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:12:28.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:27 smithi027 bash[22610]: cluster 2024-08-31T06:12:26.857479+0000 mgr.a (mgr.14388) 10429 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:28.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:27 smithi191 bash[24992]: cluster 2024-08-31T06:12:26.857479+0000 mgr.a (mgr.14388) 10429 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:27 smithi163 bash[24253]: cluster 2024-08-31T06:12:26.857479+0000 mgr.a (mgr.14388) 10429 : cluster [DBG] pgmap v7230: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:28 smithi027 bash[22610]: audit 2024-08-31T06:12:27.657336+0000 mgr.a (mgr.14388) 10430 : audit [DBG] from='client.230517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:29.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:28 smithi191 bash[24992]: audit 2024-08-31T06:12:27.657336+0000 mgr.a (mgr.14388) 10430 : audit [DBG] from='client.230517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:28 smithi163 bash[24253]: audit 2024-08-31T06:12:27.657336+0000 mgr.a (mgr.14388) 10430 : audit [DBG] from='client.230517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:29 smithi027 bash[22610]: cluster 2024-08-31T06:12:28.860214+0000 mgr.a (mgr.14388) 10431 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:29 smithi191 bash[24992]: cluster 2024-08-31T06:12:28.860214+0000 mgr.a (mgr.14388) 10431 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:29 smithi163 bash[24253]: cluster 2024-08-31T06:12:28.860214+0000 mgr.a (mgr.14388) 10431 : cluster [DBG] pgmap v7231: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:31 smithi027 bash[22610]: cluster 2024-08-31T06:12:30.860900+0000 mgr.a (mgr.14388) 10432 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:31 smithi191 bash[24992]: cluster 2024-08-31T06:12:30.860900+0000 mgr.a (mgr.14388) 10432 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:32.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:31 smithi163 bash[24253]: cluster 2024-08-31T06:12:30.860900+0000 mgr.a (mgr.14388) 10432 : cluster [DBG] pgmap v7232: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 21 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:33.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:12:33.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:12:33.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:12:33.881 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:12:33.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:12:33.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:12:33.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:12:33.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:34.292 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:33 smithi191 bash[24992]: cluster 2024-08-31T06:12:32.862750+0000 mgr.a (mgr.14388) 10433 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:34.347 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:33 smithi027 bash[22610]: cluster 2024-08-31T06:12:32.862750+0000 mgr.a (mgr.14388) 10433 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:33 smithi163 bash[24253]: cluster 2024-08-31T06:12:32.862750+0000 mgr.a (mgr.14388) 10433 : cluster [DBG] pgmap v7233: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T06:12:35.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:34 smithi191 bash[24992]: audit 2024-08-31T06:12:33.462128+0000 mgr.a (mgr.14388) 10434 : audit [DBG] from='client.230595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:34 smithi163 bash[24253]: audit 2024-08-31T06:12:33.462128+0000 mgr.a (mgr.14388) 10434 : audit [DBG] from='client.230595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:34 smithi027 bash[22610]: audit 2024-08-31T06:12:33.462128+0000 mgr.a (mgr.14388) 10434 : audit [DBG] from='client.230595 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:36.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:12:35 smithi027 bash[22863]: debug 2024-08-31T06:12:35.864+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:12:36.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:12:35 smithi027 bash[22863]: debug 2024-08-31T06:12:35.868+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:12:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:35 smithi027 bash[22610]: cluster 2024-08-31T06:12:34.863625+0000 mgr.a (mgr.14388) 10435 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:12:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:35 smithi027 bash[22610]: audit 2024-08-31T06:12:35.062390+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:12:36.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:35 smithi027 bash[22610]: audit 2024-08-31T06:12:35.070180+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:12:36.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:35 smithi027 bash[22610]: audit 2024-08-31T06:12:35.072106+0000 mon.a (mon.0) 2136 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:12:36.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:35 smithi027 bash[22610]: audit 2024-08-31T06:12:35.073708+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:12:36.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:35 smithi027 bash[22610]: audit 2024-08-31T06:12:35.083734+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:12:36.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:35 smithi027 bash[22610]: audit 2024-08-31T06:12:35.089049+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:12:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:35 smithi191 bash[24992]: cluster 2024-08-31T06:12:34.863625+0000 mgr.a (mgr.14388) 10435 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:12:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:35 smithi191 bash[24992]: audit 2024-08-31T06:12:35.062390+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:12:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:35 smithi191 bash[24992]: audit 2024-08-31T06:12:35.070180+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:12:36.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:35 smithi191 bash[24992]: audit 2024-08-31T06:12:35.072106+0000 mon.a (mon.0) 2136 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:12:36.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:35 smithi191 bash[24992]: audit 2024-08-31T06:12:35.073708+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:12:36.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:35 smithi191 bash[24992]: audit 2024-08-31T06:12:35.083734+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:12:36.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:35 smithi191 bash[24992]: audit 2024-08-31T06:12:35.089049+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:12:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:35 smithi163 bash[24253]: cluster 2024-08-31T06:12:34.863625+0000 mgr.a (mgr.14388) 10435 : cluster [DBG] pgmap v7234: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:12:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:35 smithi163 bash[24253]: audit 2024-08-31T06:12:35.062390+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:12:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:35 smithi163 bash[24253]: audit 2024-08-31T06:12:35.070180+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:12:36.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:35 smithi163 bash[24253]: audit 2024-08-31T06:12:35.072106+0000 mon.a (mon.0) 2136 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:12:36.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:35 smithi163 bash[24253]: audit 2024-08-31T06:12:35.073708+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:12:36.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:35 smithi163 bash[24253]: audit 2024-08-31T06:12:35.083734+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:12:36.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:35 smithi163 bash[24253]: audit 2024-08-31T06:12:35.089049+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:12:37.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:36 smithi191 bash[24992]: audit 2024-08-31T06:12:35.091672+0000 mgr.a (mgr.14388) 10436 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:12:37.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:36 smithi191 bash[24992]: audit 2024-08-31T06:12:35.870267+0000 mgr.a (mgr.14388) 10437 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:12:37.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:36 smithi191 bash[24992]: cephadm 2024-08-31T06:12:35.871731+0000 mgr.a (mgr.14388) 10438 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:12:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:36 smithi163 bash[24253]: audit 2024-08-31T06:12:35.091672+0000 mgr.a (mgr.14388) 10436 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:12:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:36 smithi163 bash[24253]: audit 2024-08-31T06:12:35.870267+0000 mgr.a (mgr.14388) 10437 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:12:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:36 smithi163 bash[24253]: cephadm 2024-08-31T06:12:35.871731+0000 mgr.a (mgr.14388) 10438 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:12:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:36 smithi027 bash[22610]: audit 2024-08-31T06:12:35.091672+0000 mgr.a (mgr.14388) 10436 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:12:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:36 smithi027 bash[22610]: audit 2024-08-31T06:12:35.870267+0000 mgr.a (mgr.14388) 10437 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:12:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:36 smithi027 bash[22610]: cephadm 2024-08-31T06:12:35.871731+0000 mgr.a (mgr.14388) 10438 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:12:38.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:38 smithi191 bash[24992]: cluster 2024-08-31T06:12:36.864604+0000 mgr.a (mgr.14388) 10439 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:12:38.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:38 smithi163 bash[24253]: cluster 2024-08-31T06:12:36.864604+0000 mgr.a (mgr.14388) 10439 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:12:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:38 smithi027 bash[22610]: cluster 2024-08-31T06:12:36.864604+0000 mgr.a (mgr.14388) 10439 : cluster [DBG] pgmap v7235: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:12:38.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:12:38.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:12:38.883 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:12:39.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:12:39.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:12:39.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:12:39.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:12:39.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:40.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:40 smithi191 bash[24992]: cluster 2024-08-31T06:12:38.866858+0000 mgr.a (mgr.14388) 10440 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:40 smithi163 bash[24253]: cluster 2024-08-31T06:12:38.866858+0000 mgr.a (mgr.14388) 10440 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:40 smithi027 bash[22610]: cluster 2024-08-31T06:12:38.866858+0000 mgr.a (mgr.14388) 10440 : cluster [DBG] pgmap v7236: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:41.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:41 smithi191 bash[24992]: audit 2024-08-31T06:12:39.220467+0000 mgr.a (mgr.14388) 10441 : audit [DBG] from='client.230781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:41 smithi163 bash[24253]: audit 2024-08-31T06:12:39.220467+0000 mgr.a (mgr.14388) 10441 : audit [DBG] from='client.230781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:41 smithi027 bash[22610]: audit 2024-08-31T06:12:39.220467+0000 mgr.a (mgr.14388) 10441 : audit [DBG] from='client.230781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:42 smithi191 bash[24992]: cluster 2024-08-31T06:12:40.867837+0000 mgr.a (mgr.14388) 10442 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:42 smithi163 bash[24253]: cluster 2024-08-31T06:12:40.867837+0000 mgr.a (mgr.14388) 10442 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:42.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:42 smithi027 bash[22610]: cluster 2024-08-31T06:12:40.867837+0000 mgr.a (mgr.14388) 10442 : cluster [DBG] pgmap v7237: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:44.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:44 smithi191 bash[24992]: cluster 2024-08-31T06:12:42.869967+0000 mgr.a (mgr.14388) 10443 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:12:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:44 smithi163 bash[24253]: cluster 2024-08-31T06:12:42.869967+0000 mgr.a (mgr.14388) 10443 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:12:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:44 smithi027 bash[22610]: cluster 2024-08-31T06:12:42.869967+0000 mgr.a (mgr.14388) 10443 : cluster [DBG] pgmap v7238: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:12:44.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:12:44.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:12:44.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:12:45.450 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:12:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:12:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:12:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:12:45.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:46.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:46 smithi191 bash[24992]: cluster 2024-08-31T06:12:44.870630+0000 mgr.a (mgr.14388) 10444 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:46.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:46 smithi191 bash[24992]: audit 2024-08-31T06:12:45.005914+0000 mgr.a (mgr.14388) 10445 : audit [DBG] from='client.230856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:46 smithi163 bash[24253]: cluster 2024-08-31T06:12:44.870630+0000 mgr.a (mgr.14388) 10444 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:46 smithi163 bash[24253]: audit 2024-08-31T06:12:45.005914+0000 mgr.a (mgr.14388) 10445 : audit [DBG] from='client.230856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:46 smithi027 bash[22610]: cluster 2024-08-31T06:12:44.870630+0000 mgr.a (mgr.14388) 10444 : cluster [DBG] pgmap v7239: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:46 smithi027 bash[22610]: audit 2024-08-31T06:12:45.005914+0000 mgr.a (mgr.14388) 10445 : audit [DBG] from='client.230856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:48 smithi191 bash[24992]: cluster 2024-08-31T06:12:46.871607+0000 mgr.a (mgr.14388) 10446 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:48 smithi163 bash[24253]: cluster 2024-08-31T06:12:46.871607+0000 mgr.a (mgr.14388) 10446 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:48 smithi027 bash[22610]: cluster 2024-08-31T06:12:46.871607+0000 mgr.a (mgr.14388) 10446 : cluster [DBG] pgmap v7240: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:12:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:49 smithi163 bash[24253]: cluster 2024-08-31T06:12:48.873858+0000 mgr.a (mgr.14388) 10447 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:12:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:49 smithi027 bash[22610]: cluster 2024-08-31T06:12:48.873858+0000 mgr.a (mgr.14388) 10447 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:12:49.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:49 smithi191 bash[24992]: cluster 2024-08-31T06:12:48.873858+0000 mgr.a (mgr.14388) 10447 : cluster [DBG] pgmap v7241: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 41 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:12:50.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:12:50.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:12:50.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:12:51.236 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:12:51.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:12:51.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:12:51.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:12:51.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:51 smithi163 bash[24253]: audit 2024-08-31T06:12:50.788139+0000 mgr.a (mgr.14388) 10448 : audit [DBG] from='client.230934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:51 smithi163 bash[24253]: cluster 2024-08-31T06:12:50.874545+0000 mgr.a (mgr.14388) 10449 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:51 smithi027 bash[22610]: audit 2024-08-31T06:12:50.788139+0000 mgr.a (mgr.14388) 10448 : audit [DBG] from='client.230934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:51 smithi027 bash[22610]: cluster 2024-08-31T06:12:50.874545+0000 mgr.a (mgr.14388) 10449 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:52.292 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:51 smithi191 bash[24992]: audit 2024-08-31T06:12:50.788139+0000 mgr.a (mgr.14388) 10448 : audit [DBG] from='client.230934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:52.292 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:51 smithi191 bash[24992]: cluster 2024-08-31T06:12:50.874545+0000 mgr.a (mgr.14388) 10449 : cluster [DBG] pgmap v7242: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:53 smithi163 bash[24253]: cluster 2024-08-31T06:12:52.876827+0000 mgr.a (mgr.14388) 10450 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:53 smithi027 bash[22610]: cluster 2024-08-31T06:12:52.876827+0000 mgr.a (mgr.14388) 10450 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:53 smithi191 bash[24992]: cluster 2024-08-31T06:12:52.876827+0000 mgr.a (mgr.14388) 10450 : cluster [DBG] pgmap v7243: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:12:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:55 smithi163 bash[24253]: cluster 2024-08-31T06:12:54.877626+0000 mgr.a (mgr.14388) 10451 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:55 smithi027 bash[22610]: cluster 2024-08-31T06:12:54.877626+0000 mgr.a (mgr.14388) 10451 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:56.237 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:12:56.238 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:12:56.238 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:12:56.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:55 smithi191 bash[24992]: cluster 2024-08-31T06:12:54.877626+0000 mgr.a (mgr.14388) 10451 : cluster [DBG] pgmap v7244: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:57.017 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:12:57.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:12:57.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:12:57.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:12:57.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:12:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:57 smithi163 bash[24253]: audit 2024-08-31T06:12:56.571976+0000 mgr.a (mgr.14388) 10452 : audit [DBG] from='client.231009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:57 smithi163 bash[24253]: cluster 2024-08-31T06:12:56.878181+0000 mgr.a (mgr.14388) 10453 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:57 smithi027 bash[22610]: audit 2024-08-31T06:12:56.571976+0000 mgr.a (mgr.14388) 10452 : audit [DBG] from='client.231009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:57 smithi027 bash[22610]: cluster 2024-08-31T06:12:56.878181+0000 mgr.a (mgr.14388) 10453 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:12:58.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:57 smithi191 bash[24992]: audit 2024-08-31T06:12:56.571976+0000 mgr.a (mgr.14388) 10452 : audit [DBG] from='client.231009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:12:58.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:57 smithi191 bash[24992]: cluster 2024-08-31T06:12:56.878181+0000 mgr.a (mgr.14388) 10453 : cluster [DBG] pgmap v7245: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:12:59 smithi163 bash[24253]: cluster 2024-08-31T06:12:58.880513+0000 mgr.a (mgr.14388) 10454 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:12:59 smithi027 bash[22610]: cluster 2024-08-31T06:12:58.880513+0000 mgr.a (mgr.14388) 10454 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:12:59 smithi191 bash[24992]: cluster 2024-08-31T06:12:58.880513+0000 mgr.a (mgr.14388) 10454 : cluster [DBG] pgmap v7246: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:02.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:02.020 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:02.020 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:13:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:01 smithi027 bash[22610]: cluster 2024-08-31T06:13:00.881302+0000 mgr.a (mgr.14388) 10455 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:01 smithi191 bash[24992]: cluster 2024-08-31T06:13:00.881302+0000 mgr.a (mgr.14388) 10455 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:01 smithi163 bash[24253]: cluster 2024-08-31T06:13:00.881302+0000 mgr.a (mgr.14388) 10455 : cluster [DBG] pgmap v7247: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:02.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:13:02.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:13:02.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:13:02.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:13:02.791 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:13:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:03 smithi027 bash[22610]: audit 2024-08-31T06:13:02.354047+0000 mgr.a (mgr.14388) 10456 : audit [DBG] from='client.231087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:03 smithi027 bash[22610]: cluster 2024-08-31T06:13:02.882301+0000 mgr.a (mgr.14388) 10457 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:03 smithi191 bash[24992]: audit 2024-08-31T06:13:02.354047+0000 mgr.a (mgr.14388) 10456 : audit [DBG] from='client.231087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:03 smithi191 bash[24992]: cluster 2024-08-31T06:13:02.882301+0000 mgr.a (mgr.14388) 10457 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:04.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:03 smithi163 bash[24253]: audit 2024-08-31T06:13:02.354047+0000 mgr.a (mgr.14388) 10456 : audit [DBG] from='client.231087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:04.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:03 smithi163 bash[24253]: cluster 2024-08-31T06:13:02.882301+0000 mgr.a (mgr.14388) 10457 : cluster [DBG] pgmap v7248: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:05 smithi027 bash[22610]: cluster 2024-08-31T06:13:04.883021+0000 mgr.a (mgr.14388) 10458 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:06.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:05 smithi191 bash[24992]: cluster 2024-08-31T06:13:04.883021+0000 mgr.a (mgr.14388) 10458 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:06.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:05 smithi163 bash[24253]: cluster 2024-08-31T06:13:04.883021+0000 mgr.a (mgr.14388) 10458 : cluster [DBG] pgmap v7249: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:07.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:07.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:07.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:13:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:07 smithi027 bash[22610]: cluster 2024-08-31T06:13:06.883823+0000 mgr.a (mgr.14388) 10459 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:07 smithi191 bash[24992]: cluster 2024-08-31T06:13:06.883823+0000 mgr.a (mgr.14388) 10459 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:07 smithi163 bash[24253]: cluster 2024-08-31T06:13:06.883823+0000 mgr.a (mgr.14388) 10459 : cluster [DBG] pgmap v7250: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:08.575 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:13:08.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:13:08.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:13:08.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:13:08.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:13:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:09 smithi163 bash[24253]: audit 2024-08-31T06:13:08.131493+0000 mgr.a (mgr.14388) 10460 : audit [DBG] from='client.231159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:09 smithi163 bash[24253]: cluster 2024-08-31T06:13:08.886617+0000 mgr.a (mgr.14388) 10461 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:09 smithi027 bash[22610]: audit 2024-08-31T06:13:08.131493+0000 mgr.a (mgr.14388) 10460 : audit [DBG] from='client.231159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:09 smithi027 bash[22610]: cluster 2024-08-31T06:13:08.886617+0000 mgr.a (mgr.14388) 10461 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:09.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:09 smithi191 bash[24992]: audit 2024-08-31T06:13:08.131493+0000 mgr.a (mgr.14388) 10460 : audit [DBG] from='client.231159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:09.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:09 smithi191 bash[24992]: cluster 2024-08-31T06:13:08.886617+0000 mgr.a (mgr.14388) 10461 : cluster [DBG] pgmap v7251: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:11 smithi163 bash[24253]: cluster 2024-08-31T06:13:10.887482+0000 mgr.a (mgr.14388) 10462 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:13:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:11 smithi027 bash[22610]: cluster 2024-08-31T06:13:10.887482+0000 mgr.a (mgr.14388) 10462 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:13:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:11 smithi191 bash[24992]: cluster 2024-08-31T06:13:10.887482+0000 mgr.a (mgr.14388) 10462 : cluster [DBG] pgmap v7252: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:13:13.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:13.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:13.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:13:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:13 smithi163 bash[24253]: cluster 2024-08-31T06:13:12.889403+0000 mgr.a (mgr.14388) 10463 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:13 smithi027 bash[22610]: cluster 2024-08-31T06:13:12.889403+0000 mgr.a (mgr.14388) 10463 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:13 smithi191 bash[24992]: cluster 2024-08-31T06:13:12.889403+0000 mgr.a (mgr.14388) 10463 : cluster [DBG] pgmap v7253: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:14.346 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:13:14.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:13:14.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:13:14.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:13:14.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:13:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:14 smithi027 bash[22610]: audit 2024-08-31T06:13:13.909868+0000 mgr.a (mgr.14388) 10464 : audit [DBG] from='client.231237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:15.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:14 smithi191 bash[24992]: audit 2024-08-31T06:13:13.909868+0000 mgr.a (mgr.14388) 10464 : audit [DBG] from='client.231237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:14 smithi163 bash[24253]: audit 2024-08-31T06:13:13.909868+0000 mgr.a (mgr.14388) 10464 : audit [DBG] from='client.231237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:15 smithi027 bash[22610]: cluster 2024-08-31T06:13:14.890328+0000 mgr.a (mgr.14388) 10465 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:16.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:15 smithi191 bash[24992]: cluster 2024-08-31T06:13:14.890328+0000 mgr.a (mgr.14388) 10465 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:15 smithi163 bash[24253]: cluster 2024-08-31T06:13:14.890328+0000 mgr.a (mgr.14388) 10465 : cluster [DBG] pgmap v7254: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:17 smithi027 bash[22610]: cluster 2024-08-31T06:13:16.891185+0000 mgr.a (mgr.14388) 10466 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:17 smithi191 bash[24992]: cluster 2024-08-31T06:13:16.891185+0000 mgr.a (mgr.14388) 10466 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:17 smithi163 bash[24253]: cluster 2024-08-31T06:13:16.891185+0000 mgr.a (mgr.14388) 10466 : cluster [DBG] pgmap v7255: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:19.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:19.348 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:19.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:13:20.129 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:13:20.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:13:20.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:13:20.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:13:20.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:13:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:19 smithi027 bash[22610]: cluster 2024-08-31T06:13:18.893446+0000 mgr.a (mgr.14388) 10467 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:19 smithi191 bash[24992]: cluster 2024-08-31T06:13:18.893446+0000 mgr.a (mgr.14388) 10467 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:19 smithi163 bash[24253]: cluster 2024-08-31T06:13:18.893446+0000 mgr.a (mgr.14388) 10467 : cluster [DBG] pgmap v7256: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:20 smithi027 bash[22610]: audit 2024-08-31T06:13:19.682254+0000 mgr.a (mgr.14388) 10468 : audit [DBG] from='client.231315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:20 smithi191 bash[24992]: audit 2024-08-31T06:13:19.682254+0000 mgr.a (mgr.14388) 10468 : audit [DBG] from='client.231315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:20 smithi163 bash[24253]: audit 2024-08-31T06:13:19.682254+0000 mgr.a (mgr.14388) 10468 : audit [DBG] from='client.231315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:21 smithi027 bash[22610]: cluster 2024-08-31T06:13:20.894419+0000 mgr.a (mgr.14388) 10469 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:21 smithi191 bash[24992]: cluster 2024-08-31T06:13:20.894419+0000 mgr.a (mgr.14388) 10469 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:21 smithi163 bash[24253]: cluster 2024-08-31T06:13:20.894419+0000 mgr.a (mgr.14388) 10469 : cluster [DBG] pgmap v7257: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:23 smithi191 bash[24992]: cluster 2024-08-31T06:13:22.896640+0000 mgr.a (mgr.14388) 10470 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:23 smithi163 bash[24253]: cluster 2024-08-31T06:13:22.896640+0000 mgr.a (mgr.14388) 10470 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:23 smithi027 bash[22610]: cluster 2024-08-31T06:13:22.896640+0000 mgr.a (mgr.14388) 10470 : cluster [DBG] pgmap v7258: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:25.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:25.131 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:13:25.902 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:13:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:13:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:13:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:13:25.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:13:26.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:25 smithi191 bash[24992]: cluster 2024-08-31T06:13:24.897435+0000 mgr.a (mgr.14388) 10471 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:25 smithi163 bash[24253]: cluster 2024-08-31T06:13:24.897435+0000 mgr.a (mgr.14388) 10471 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:25 smithi027 bash[22610]: cluster 2024-08-31T06:13:24.897435+0000 mgr.a (mgr.14388) 10471 : cluster [DBG] pgmap v7259: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:27.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:26 smithi191 bash[24992]: audit 2024-08-31T06:13:25.466216+0000 mgr.a (mgr.14388) 10472 : audit [DBG] from='client.231390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:26 smithi163 bash[24253]: audit 2024-08-31T06:13:25.466216+0000 mgr.a (mgr.14388) 10472 : audit [DBG] from='client.231390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:26 smithi027 bash[22610]: audit 2024-08-31T06:13:25.466216+0000 mgr.a (mgr.14388) 10472 : audit [DBG] from='client.231390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:28.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:27 smithi191 bash[24992]: cluster 2024-08-31T06:13:26.898444+0000 mgr.a (mgr.14388) 10473 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:27 smithi163 bash[24253]: cluster 2024-08-31T06:13:26.898444+0000 mgr.a (mgr.14388) 10473 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:27 smithi027 bash[22610]: cluster 2024-08-31T06:13:26.898444+0000 mgr.a (mgr.14388) 10473 : cluster [DBG] pgmap v7260: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:30 smithi191 bash[24992]: cluster 2024-08-31T06:13:28.900640+0000 mgr.a (mgr.14388) 10474 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:30 smithi163 bash[24253]: cluster 2024-08-31T06:13:28.900640+0000 mgr.a (mgr.14388) 10474 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:30 smithi027 bash[22610]: cluster 2024-08-31T06:13:28.900640+0000 mgr.a (mgr.14388) 10474 : cluster [DBG] pgmap v7261: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:30.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:30.905 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:30.905 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:13:31.666 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:13:31.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:13:31.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:13:31.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:13:31.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:13:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:32 smithi191 bash[24992]: cluster 2024-08-31T06:13:30.901410+0000 mgr.a (mgr.14388) 10475 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:32.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:32 smithi163 bash[24253]: cluster 2024-08-31T06:13:30.901410+0000 mgr.a (mgr.14388) 10475 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:32 smithi027 bash[22610]: cluster 2024-08-31T06:13:30.901410+0000 mgr.a (mgr.14388) 10475 : cluster [DBG] pgmap v7262: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:33 smithi191 bash[24992]: audit 2024-08-31T06:13:31.233312+0000 mgr.a (mgr.14388) 10476 : audit [DBG] from='client.231465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:33 smithi163 bash[24253]: audit 2024-08-31T06:13:31.233312+0000 mgr.a (mgr.14388) 10476 : audit [DBG] from='client.231465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:33 smithi027 bash[22610]: audit 2024-08-31T06:13:31.233312+0000 mgr.a (mgr.14388) 10476 : audit [DBG] from='client.231465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:34 smithi191 bash[24992]: cluster 2024-08-31T06:13:32.903741+0000 mgr.a (mgr.14388) 10477 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:34 smithi163 bash[24253]: cluster 2024-08-31T06:13:32.903741+0000 mgr.a (mgr.14388) 10477 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:34 smithi027 bash[22610]: cluster 2024-08-31T06:13:32.903741+0000 mgr.a (mgr.14388) 10477 : cluster [DBG] pgmap v7263: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:36 smithi191 bash[24992]: cluster 2024-08-31T06:13:34.904556+0000 mgr.a (mgr.14388) 10478 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:36 smithi191 bash[24992]: audit 2024-08-31T06:13:35.925341+0000 mon.a (mon.0) 2140 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:13:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:36 smithi163 bash[24253]: cluster 2024-08-31T06:13:34.904556+0000 mgr.a (mgr.14388) 10478 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:36 smithi163 bash[24253]: audit 2024-08-31T06:13:35.925341+0000 mon.a (mon.0) 2140 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:13:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:36 smithi027 bash[22610]: cluster 2024-08-31T06:13:34.904556+0000 mgr.a (mgr.14388) 10478 : cluster [DBG] pgmap v7264: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:36 smithi027 bash[22610]: audit 2024-08-31T06:13:35.925341+0000 mon.a (mon.0) 2140 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:13:36.668 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:36.668 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:36.668 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:13:37.421 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:13:37.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:13:37.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:13:37.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:13:37.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:13:38.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:38 smithi191 bash[24992]: cluster 2024-08-31T06:13:36.905293+0000 mgr.a (mgr.14388) 10479 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:38.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:38 smithi191 bash[24992]: audit 2024-08-31T06:13:37.001079+0000 mgr.a (mgr.14388) 10480 : audit [DBG] from='client.231543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:38.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:38 smithi163 bash[24253]: cluster 2024-08-31T06:13:36.905293+0000 mgr.a (mgr.14388) 10479 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:38.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:38 smithi163 bash[24253]: audit 2024-08-31T06:13:37.001079+0000 mgr.a (mgr.14388) 10480 : audit [DBG] from='client.231543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:38 smithi027 bash[22610]: cluster 2024-08-31T06:13:36.905293+0000 mgr.a (mgr.14388) 10479 : cluster [DBG] pgmap v7265: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:38 smithi027 bash[22610]: audit 2024-08-31T06:13:37.001079+0000 mgr.a (mgr.14388) 10480 : audit [DBG] from='client.231543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:40.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:40 smithi191 bash[24992]: cluster 2024-08-31T06:13:38.907634+0000 mgr.a (mgr.14388) 10481 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:40 smithi163 bash[24253]: cluster 2024-08-31T06:13:38.907634+0000 mgr.a (mgr.14388) 10481 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:40 smithi027 bash[22610]: cluster 2024-08-31T06:13:38.907634+0000 mgr.a (mgr.14388) 10481 : cluster [DBG] pgmap v7266: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:13:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:42 smithi191 bash[24992]: cluster 2024-08-31T06:13:40.908427+0000 mgr.a (mgr.14388) 10482 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:42 smithi191 bash[24992]: audit 2024-08-31T06:13:41.282057+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:42 smithi191 bash[24992]: audit 2024-08-31T06:13:41.289297+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:42 smithi191 bash[24992]: audit 2024-08-31T06:13:41.294863+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:42 smithi191 bash[24992]: audit 2024-08-31T06:13:41.300188+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:42 smithi191 bash[24992]: audit 2024-08-31T06:13:41.321427+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:42 smithi191 bash[24992]: audit 2024-08-31T06:13:41.326288+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:42.425 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:42.425 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:13:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:42 smithi163 bash[24253]: cluster 2024-08-31T06:13:40.908427+0000 mgr.a (mgr.14388) 10482 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:42 smithi163 bash[24253]: audit 2024-08-31T06:13:41.282057+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:42 smithi163 bash[24253]: audit 2024-08-31T06:13:41.289297+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:42 smithi163 bash[24253]: audit 2024-08-31T06:13:41.294863+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:42 smithi163 bash[24253]: audit 2024-08-31T06:13:41.300188+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:42 smithi163 bash[24253]: audit 2024-08-31T06:13:41.321427+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:42 smithi163 bash[24253]: audit 2024-08-31T06:13:41.326288+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:42 smithi027 bash[22610]: cluster 2024-08-31T06:13:40.908427+0000 mgr.a (mgr.14388) 10482 : cluster [DBG] pgmap v7267: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:42 smithi027 bash[22610]: audit 2024-08-31T06:13:41.282057+0000 mon.a (mon.0) 2141 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:42 smithi027 bash[22610]: audit 2024-08-31T06:13:41.289297+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:42 smithi027 bash[22610]: audit 2024-08-31T06:13:41.294863+0000 mon.a (mon.0) 2143 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:42 smithi027 bash[22610]: audit 2024-08-31T06:13:41.300188+0000 mon.a (mon.0) 2144 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:42 smithi027 bash[22610]: audit 2024-08-31T06:13:41.321427+0000 mon.a (mon.0) 2145 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:42 smithi027 bash[22610]: audit 2024-08-31T06:13:41.326288+0000 mon.a (mon.0) 2146 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:43.194 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:13:43.194 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:13:43.194 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:13:43.194 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:13:43.194 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:13:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:44 smithi163 bash[24253]: audit 2024-08-31T06:13:42.758560+0000 mgr.a (mgr.14388) 10483 : audit [DBG] from='client.231618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:44 smithi163 bash[24253]: cluster 2024-08-31T06:13:42.909771+0000 mgr.a (mgr.14388) 10484 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:44 smithi027 bash[22610]: audit 2024-08-31T06:13:42.758560+0000 mgr.a (mgr.14388) 10483 : audit [DBG] from='client.231618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:44 smithi027 bash[22610]: cluster 2024-08-31T06:13:42.909771+0000 mgr.a (mgr.14388) 10484 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:44 smithi191 bash[24992]: audit 2024-08-31T06:13:42.758560+0000 mgr.a (mgr.14388) 10483 : audit [DBG] from='client.231618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:44.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:44 smithi191 bash[24992]: cluster 2024-08-31T06:13:42.909771+0000 mgr.a (mgr.14388) 10484 : cluster [DBG] pgmap v7268: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:46 smithi163 bash[24253]: cluster 2024-08-31T06:13:44.910640+0000 mgr.a (mgr.14388) 10485 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:46 smithi027 bash[22610]: cluster 2024-08-31T06:13:44.910640+0000 mgr.a (mgr.14388) 10485 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:46.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:46 smithi191 bash[24992]: cluster 2024-08-31T06:13:44.910640+0000 mgr.a (mgr.14388) 10485 : cluster [DBG] pgmap v7269: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:47 smithi163 bash[24253]: cluster 2024-08-31T06:13:46.911486+0000 mgr.a (mgr.14388) 10486 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:47 smithi027 bash[22610]: cluster 2024-08-31T06:13:46.911486+0000 mgr.a (mgr.14388) 10486 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:47 smithi191 bash[24992]: cluster 2024-08-31T06:13:46.911486+0000 mgr.a (mgr.14388) 10486 : cluster [DBG] pgmap v7270: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:48.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:48.196 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:48.196 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:13:48.978 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:13:48.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:13:48.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:13:48.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:13:48.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:13:50.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:49 smithi027 bash[22610]: audit 2024-08-31T06:13:48.532166+0000 mgr.a (mgr.14388) 10487 : audit [DBG] from='client.231696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:50.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:49 smithi027 bash[22610]: cluster 2024-08-31T06:13:48.912827+0000 mgr.a (mgr.14388) 10488 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:50.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:49 smithi191 bash[24992]: audit 2024-08-31T06:13:48.532166+0000 mgr.a (mgr.14388) 10487 : audit [DBG] from='client.231696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:50.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:49 smithi191 bash[24992]: cluster 2024-08-31T06:13:48.912827+0000 mgr.a (mgr.14388) 10488 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:50.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:49 smithi163 bash[24253]: audit 2024-08-31T06:13:48.532166+0000 mgr.a (mgr.14388) 10487 : audit [DBG] from='client.231696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:50.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:49 smithi163 bash[24253]: cluster 2024-08-31T06:13:48.912827+0000 mgr.a (mgr.14388) 10488 : cluster [DBG] pgmap v7271: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:13:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:51 smithi027 bash[22610]: cluster 2024-08-31T06:13:50.913568+0000 mgr.a (mgr.14388) 10489 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:51 smithi027 bash[22610]: audit 2024-08-31T06:13:51.514229+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:51 smithi027 bash[22610]: audit 2024-08-31T06:13:51.522927+0000 mon.a (mon.0) 2148 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:51 smithi191 bash[24992]: cluster 2024-08-31T06:13:50.913568+0000 mgr.a (mgr.14388) 10489 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:51 smithi191 bash[24992]: audit 2024-08-31T06:13:51.514229+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:51 smithi191 bash[24992]: audit 2024-08-31T06:13:51.522927+0000 mon.a (mon.0) 2148 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:52.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:51 smithi163 bash[24253]: cluster 2024-08-31T06:13:50.913568+0000 mgr.a (mgr.14388) 10489 : cluster [DBG] pgmap v7272: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:13:52.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:51 smithi163 bash[24253]: audit 2024-08-31T06:13:51.514229+0000 mon.a (mon.0) 2147 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:52.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:51 smithi163 bash[24253]: audit 2024-08-31T06:13:51.522927+0000 mon.a (mon.0) 2148 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:53.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:13:52 smithi027 bash[22863]: debug 2024-08-31T06:13:52.806+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:13:53.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:13:52 smithi027 bash[22863]: debug 2024-08-31T06:13:52.810+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:13:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:53 smithi027 bash[22610]: audit 2024-08-31T06:13:52.009955+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:53 smithi027 bash[22610]: audit 2024-08-31T06:13:52.019811+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:53 smithi027 bash[22610]: audit 2024-08-31T06:13:52.023209+0000 mon.a (mon.0) 2151 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:13:53.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:53 smithi027 bash[22610]: audit 2024-08-31T06:13:52.025265+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:13:53.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:53 smithi027 bash[22610]: audit 2024-08-31T06:13:52.037556+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:53.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:53 smithi027 bash[22610]: audit 2024-08-31T06:13:52.042817+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:13:53.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:53 smithi027 bash[22610]: audit 2024-08-31T06:13:52.045306+0000 mgr.a (mgr.14388) 10490 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:13:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:53 smithi191 bash[24992]: audit 2024-08-31T06:13:52.009955+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:53 smithi191 bash[24992]: audit 2024-08-31T06:13:52.019811+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:53 smithi191 bash[24992]: audit 2024-08-31T06:13:52.023209+0000 mon.a (mon.0) 2151 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:13:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:53 smithi191 bash[24992]: audit 2024-08-31T06:13:52.025265+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:13:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:53 smithi191 bash[24992]: audit 2024-08-31T06:13:52.037556+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:53 smithi191 bash[24992]: audit 2024-08-31T06:13:52.042817+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:13:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:53 smithi191 bash[24992]: audit 2024-08-31T06:13:52.045306+0000 mgr.a (mgr.14388) 10490 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:13:53.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:53 smithi163 bash[24253]: audit 2024-08-31T06:13:52.009955+0000 mon.a (mon.0) 2149 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:53.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:53 smithi163 bash[24253]: audit 2024-08-31T06:13:52.019811+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:53.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:53 smithi163 bash[24253]: audit 2024-08-31T06:13:52.023209+0000 mon.a (mon.0) 2151 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:13:53.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:53 smithi163 bash[24253]: audit 2024-08-31T06:13:52.025265+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:13:53.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:53 smithi163 bash[24253]: audit 2024-08-31T06:13:52.037556+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:13:53.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:53 smithi163 bash[24253]: audit 2024-08-31T06:13:52.042817+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:13:53.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:53 smithi163 bash[24253]: audit 2024-08-31T06:13:52.045306+0000 mgr.a (mgr.14388) 10490 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:13:53.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:53.980 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:53.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:13:54.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:54 smithi163 bash[24253]: audit 2024-08-31T06:13:52.810166+0000 mgr.a (mgr.14388) 10491 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:13:54.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:54 smithi163 bash[24253]: cephadm 2024-08-31T06:13:52.811322+0000 mgr.a (mgr.14388) 10492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:13:54.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:54 smithi163 bash[24253]: cluster 2024-08-31T06:13:52.915972+0000 mgr.a (mgr.14388) 10493 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:54 smithi027 bash[22610]: audit 2024-08-31T06:13:52.810166+0000 mgr.a (mgr.14388) 10491 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:13:54.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:54 smithi027 bash[22610]: cephadm 2024-08-31T06:13:52.811322+0000 mgr.a (mgr.14388) 10492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:13:54.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:54 smithi027 bash[22610]: cluster 2024-08-31T06:13:52.915972+0000 mgr.a (mgr.14388) 10493 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:54.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:54 smithi191 bash[24992]: audit 2024-08-31T06:13:52.810166+0000 mgr.a (mgr.14388) 10491 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:13:54.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:54 smithi191 bash[24992]: cephadm 2024-08-31T06:13:52.811322+0000 mgr.a (mgr.14388) 10492 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:13:54.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:54 smithi191 bash[24992]: cluster 2024-08-31T06:13:52.915972+0000 mgr.a (mgr.14388) 10493 : cluster [DBG] pgmap v7273: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:54.714 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:13:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:13:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:13:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:13:54.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:13:56.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:56 smithi163 bash[24253]: audit 2024-08-31T06:13:54.306061+0000 mgr.a (mgr.14388) 10494 : audit [DBG] from='client.231876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:56.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:56 smithi163 bash[24253]: cluster 2024-08-31T06:13:54.916966+0000 mgr.a (mgr.14388) 10495 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:56 smithi027 bash[22610]: audit 2024-08-31T06:13:54.306061+0000 mgr.a (mgr.14388) 10494 : audit [DBG] from='client.231876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:56 smithi027 bash[22610]: cluster 2024-08-31T06:13:54.916966+0000 mgr.a (mgr.14388) 10495 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:56.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:56 smithi191 bash[24992]: audit 2024-08-31T06:13:54.306061+0000 mgr.a (mgr.14388) 10494 : audit [DBG] from='client.231876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:13:56.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:56 smithi191 bash[24992]: cluster 2024-08-31T06:13:54.916966+0000 mgr.a (mgr.14388) 10495 : cluster [DBG] pgmap v7274: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:58.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:58 smithi163 bash[24253]: cluster 2024-08-31T06:13:56.917780+0000 mgr.a (mgr.14388) 10496 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:58 smithi027 bash[22610]: cluster 2024-08-31T06:13:56.917780+0000 mgr.a (mgr.14388) 10496 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:58.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:58 smithi191 bash[24992]: cluster 2024-08-31T06:13:56.917780+0000 mgr.a (mgr.14388) 10496 : cluster [DBG] pgmap v7275: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:13:59 smithi163 bash[24253]: cluster 2024-08-31T06:13:58.919971+0000 mgr.a (mgr.14388) 10497 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:13:59 smithi027 bash[22610]: cluster 2024-08-31T06:13:58.919971+0000 mgr.a (mgr.14388) 10497 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:59.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:13:59 smithi191 bash[24992]: cluster 2024-08-31T06:13:58.919971+0000 mgr.a (mgr.14388) 10497 : cluster [DBG] pgmap v7276: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:13:59.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:13:59.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:13:59.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:00.454 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:00.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:00.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:00.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:00.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:01 smithi027 bash[22610]: audit 2024-08-31T06:14:00.050870+0000 mgr.a (mgr.14388) 10498 : audit [DBG] from='client.231954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:01 smithi027 bash[22610]: cluster 2024-08-31T06:14:00.920926+0000 mgr.a (mgr.14388) 10499 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:14:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:01 smithi191 bash[24992]: audit 2024-08-31T06:14:00.050870+0000 mgr.a (mgr.14388) 10498 : audit [DBG] from='client.231954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:01 smithi191 bash[24992]: cluster 2024-08-31T06:14:00.920926+0000 mgr.a (mgr.14388) 10499 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:14:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:01 smithi163 bash[24253]: audit 2024-08-31T06:14:00.050870+0000 mgr.a (mgr.14388) 10498 : audit [DBG] from='client.231954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:01 smithi163 bash[24253]: cluster 2024-08-31T06:14:00.920926+0000 mgr.a (mgr.14388) 10499 : cluster [DBG] pgmap v7277: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:14:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:03 smithi027 bash[22610]: cluster 2024-08-31T06:14:02.923235+0000 mgr.a (mgr.14388) 10500 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:14:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:03 smithi191 bash[24992]: cluster 2024-08-31T06:14:02.923235+0000 mgr.a (mgr.14388) 10500 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:14:04.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:03 smithi163 bash[24253]: cluster 2024-08-31T06:14:02.923235+0000 mgr.a (mgr.14388) 10500 : cluster [DBG] pgmap v7278: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:14:05.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:14:05.457 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:14:05.457 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:06.243 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:06.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:06.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:06.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:06.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:06.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:05 smithi191 bash[24992]: cluster 2024-08-31T06:14:04.924022+0000 mgr.a (mgr.14388) 10501 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:06.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:05 smithi163 bash[24253]: cluster 2024-08-31T06:14:04.924022+0000 mgr.a (mgr.14388) 10501 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:05 smithi027 bash[22610]: cluster 2024-08-31T06:14:04.924022+0000 mgr.a (mgr.14388) 10501 : cluster [DBG] pgmap v7279: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:07.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:07 smithi191 bash[24992]: audit 2024-08-31T06:14:05.793615+0000 mgr.a (mgr.14388) 10502 : audit [DBG] from='client.232029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:07 smithi163 bash[24253]: audit 2024-08-31T06:14:05.793615+0000 mgr.a (mgr.14388) 10502 : audit [DBG] from='client.232029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:07 smithi027 bash[22610]: audit 2024-08-31T06:14:05.793615+0000 mgr.a (mgr.14388) 10502 : audit [DBG] from='client.232029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:08 smithi191 bash[24992]: cluster 2024-08-31T06:14:06.925004+0000 mgr.a (mgr.14388) 10503 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:08 smithi163 bash[24253]: cluster 2024-08-31T06:14:06.925004+0000 mgr.a (mgr.14388) 10503 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:08 smithi027 bash[22610]: cluster 2024-08-31T06:14:06.925004+0000 mgr.a (mgr.14388) 10503 : cluster [DBG] pgmap v7280: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:10 smithi191 bash[24992]: cluster 2024-08-31T06:14:08.927286+0000 mgr.a (mgr.14388) 10504 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:10 smithi163 bash[24253]: cluster 2024-08-31T06:14:08.927286+0000 mgr.a (mgr.14388) 10504 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:10 smithi027 bash[22610]: cluster 2024-08-31T06:14:08.927286+0000 mgr.a (mgr.14388) 10504 : cluster [DBG] pgmap v7281: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:11.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:14:11.245 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:14:11.245 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:11.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:11.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:11.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:11.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:11.993 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:12 smithi191 bash[24992]: cluster 2024-08-31T06:14:10.928086+0000 mgr.a (mgr.14388) 10505 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:12 smithi163 bash[24253]: cluster 2024-08-31T06:14:10.928086+0000 mgr.a (mgr.14388) 10505 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:12.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:12 smithi027 bash[22610]: cluster 2024-08-31T06:14:10.928086+0000 mgr.a (mgr.14388) 10505 : cluster [DBG] pgmap v7282: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:13.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:13 smithi191 bash[24992]: audit 2024-08-31T06:14:11.574020+0000 mgr.a (mgr.14388) 10506 : audit [DBG] from='client.232107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:13 smithi163 bash[24253]: audit 2024-08-31T06:14:11.574020+0000 mgr.a (mgr.14388) 10506 : audit [DBG] from='client.232107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:13 smithi027 bash[22610]: audit 2024-08-31T06:14:11.574020+0000 mgr.a (mgr.14388) 10506 : audit [DBG] from='client.232107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:14 smithi191 bash[24992]: cluster 2024-08-31T06:14:12.930331+0000 mgr.a (mgr.14388) 10507 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:14 smithi163 bash[24253]: cluster 2024-08-31T06:14:12.930331+0000 mgr.a (mgr.14388) 10507 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:14 smithi027 bash[22610]: cluster 2024-08-31T06:14:12.930331+0000 mgr.a (mgr.14388) 10507 : cluster [DBG] pgmap v7283: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:16.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:16 smithi191 bash[24992]: cluster 2024-08-31T06:14:14.931122+0000 mgr.a (mgr.14388) 10508 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:16 smithi163 bash[24253]: cluster 2024-08-31T06:14:14.931122+0000 mgr.a (mgr.14388) 10508 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:16 smithi027 bash[22610]: cluster 2024-08-31T06:14:14.931122+0000 mgr.a (mgr.14388) 10508 : cluster [DBG] pgmap v7284: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:16.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:14:16.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:14:16.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:17.733 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:17.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:17.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:17.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:17.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:18 smithi191 bash[24992]: cluster 2024-08-31T06:14:16.931932+0000 mgr.a (mgr.14388) 10509 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:18 smithi163 bash[24253]: cluster 2024-08-31T06:14:16.931932+0000 mgr.a (mgr.14388) 10509 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:18 smithi027 bash[22610]: cluster 2024-08-31T06:14:16.931932+0000 mgr.a (mgr.14388) 10509 : cluster [DBG] pgmap v7285: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:19 smithi163 bash[24253]: audit 2024-08-31T06:14:17.323697+0000 mgr.a (mgr.14388) 10510 : audit [DBG] from='client.232185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:19 smithi027 bash[22610]: audit 2024-08-31T06:14:17.323697+0000 mgr.a (mgr.14388) 10510 : audit [DBG] from='client.232185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:19 smithi191 bash[24992]: audit 2024-08-31T06:14:17.323697+0000 mgr.a (mgr.14388) 10510 : audit [DBG] from='client.232185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:20 smithi163 bash[24253]: cluster 2024-08-31T06:14:18.934247+0000 mgr.a (mgr.14388) 10511 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:20 smithi027 bash[22610]: cluster 2024-08-31T06:14:18.934247+0000 mgr.a (mgr.14388) 10511 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:20 smithi191 bash[24992]: cluster 2024-08-31T06:14:18.934247+0000 mgr.a (mgr.14388) 10511 : cluster [DBG] pgmap v7286: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:22 smithi163 bash[24253]: cluster 2024-08-31T06:14:20.935052+0000 mgr.a (mgr.14388) 10512 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:22 smithi027 bash[22610]: cluster 2024-08-31T06:14:20.935052+0000 mgr.a (mgr.14388) 10512 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:22.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:22 smithi191 bash[24992]: cluster 2024-08-31T06:14:20.935052+0000 mgr.a (mgr.14388) 10512 : cluster [DBG] pgmap v7287: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:22.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:14:22.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:14:22.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:23.492 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:23.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:23.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:23.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:23.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:24 smithi163 bash[24253]: cluster 2024-08-31T06:14:22.937014+0000 mgr.a (mgr.14388) 10513 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:24 smithi027 bash[22610]: cluster 2024-08-31T06:14:22.937014+0000 mgr.a (mgr.14388) 10513 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:24.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:24 smithi191 bash[24992]: cluster 2024-08-31T06:14:22.937014+0000 mgr.a (mgr.14388) 10513 : cluster [DBG] pgmap v7288: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:25 smithi163 bash[24253]: audit 2024-08-31T06:14:23.068606+0000 mgr.a (mgr.14388) 10514 : audit [DBG] from='client.232260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:25 smithi027 bash[22610]: audit 2024-08-31T06:14:23.068606+0000 mgr.a (mgr.14388) 10514 : audit [DBG] from='client.232260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:25 smithi191 bash[24992]: audit 2024-08-31T06:14:23.068606+0000 mgr.a (mgr.14388) 10514 : audit [DBG] from='client.232260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:26 smithi163 bash[24253]: cluster 2024-08-31T06:14:24.937939+0000 mgr.a (mgr.14388) 10515 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:14:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:26 smithi027 bash[22610]: cluster 2024-08-31T06:14:24.937939+0000 mgr.a (mgr.14388) 10515 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:14:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:26 smithi191 bash[24992]: cluster 2024-08-31T06:14:24.937939+0000 mgr.a (mgr.14388) 10515 : cluster [DBG] pgmap v7289: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:14:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:27 smithi163 bash[24253]: cluster 2024-08-31T06:14:26.938762+0000 mgr.a (mgr.14388) 10516 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:14:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:27 smithi027 bash[22610]: cluster 2024-08-31T06:14:26.938762+0000 mgr.a (mgr.14388) 10516 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:14:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:27 smithi191 bash[24992]: cluster 2024-08-31T06:14:26.938762+0000 mgr.a (mgr.14388) 10516 : cluster [DBG] pgmap v7290: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:14:28.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:14:28.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:14:28.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:29.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:29.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:29.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:29.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:29.250 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:29 smithi191 bash[24992]: audit 2024-08-31T06:14:28.825011+0000 mgr.a (mgr.14388) 10517 : audit [DBG] from='client.232338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:29 smithi191 bash[24992]: cluster 2024-08-31T06:14:28.940115+0000 mgr.a (mgr.14388) 10518 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:29 smithi163 bash[24253]: audit 2024-08-31T06:14:28.825011+0000 mgr.a (mgr.14388) 10517 : audit [DBG] from='client.232338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:29 smithi163 bash[24253]: cluster 2024-08-31T06:14:28.940115+0000 mgr.a (mgr.14388) 10518 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:29 smithi027 bash[22610]: audit 2024-08-31T06:14:28.825011+0000 mgr.a (mgr.14388) 10517 : audit [DBG] from='client.232338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:29 smithi027 bash[22610]: cluster 2024-08-31T06:14:28.940115+0000 mgr.a (mgr.14388) 10518 : cluster [DBG] pgmap v7291: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:32 smithi191 bash[24992]: cluster 2024-08-31T06:14:30.940966+0000 mgr.a (mgr.14388) 10519 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:14:32.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:32 smithi163 bash[24253]: cluster 2024-08-31T06:14:30.940966+0000 mgr.a (mgr.14388) 10519 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:14:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:31 smithi027 bash[22610]: cluster 2024-08-31T06:14:30.940966+0000 mgr.a (mgr.14388) 10519 : cluster [DBG] pgmap v7292: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:14:34.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:14:34.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:14:34.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:34 smithi191 bash[24992]: cluster 2024-08-31T06:14:32.943151+0000 mgr.a (mgr.14388) 10520 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:34 smithi163 bash[24253]: cluster 2024-08-31T06:14:32.943151+0000 mgr.a (mgr.14388) 10520 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:34 smithi027 bash[22610]: cluster 2024-08-31T06:14:32.943151+0000 mgr.a (mgr.14388) 10520 : cluster [DBG] pgmap v7293: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:35.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:35.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:35.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:35.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:35.002 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:36 smithi191 bash[24992]: audit 2024-08-31T06:14:34.579717+0000 mgr.a (mgr.14388) 10521 : audit [DBG] from='client.232413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:36.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:36 smithi191 bash[24992]: cluster 2024-08-31T06:14:34.943811+0000 mgr.a (mgr.14388) 10522 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:36 smithi163 bash[24253]: audit 2024-08-31T06:14:34.579717+0000 mgr.a (mgr.14388) 10521 : audit [DBG] from='client.232413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:36 smithi163 bash[24253]: cluster 2024-08-31T06:14:34.943811+0000 mgr.a (mgr.14388) 10522 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:36 smithi027 bash[22610]: audit 2024-08-31T06:14:34.579717+0000 mgr.a (mgr.14388) 10521 : audit [DBG] from='client.232413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:36 smithi027 bash[22610]: cluster 2024-08-31T06:14:34.943811+0000 mgr.a (mgr.14388) 10522 : cluster [DBG] pgmap v7294: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:38.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:38 smithi191 bash[24992]: cluster 2024-08-31T06:14:36.944568+0000 mgr.a (mgr.14388) 10523 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:38.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:38 smithi163 bash[24253]: cluster 2024-08-31T06:14:36.944568+0000 mgr.a (mgr.14388) 10523 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:38 smithi027 bash[22610]: cluster 2024-08-31T06:14:36.944568+0000 mgr.a (mgr.14388) 10523 : cluster [DBG] pgmap v7295: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:40.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:14:40.003 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:14:40.004 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:40.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:40 smithi191 bash[24992]: cluster 2024-08-31T06:14:38.946904+0000 mgr.a (mgr.14388) 10524 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:40 smithi163 bash[24253]: cluster 2024-08-31T06:14:38.946904+0000 mgr.a (mgr.14388) 10524 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:40 smithi027 bash[22610]: cluster 2024-08-31T06:14:38.946904+0000 mgr.a (mgr.14388) 10524 : cluster [DBG] pgmap v7296: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:40.774 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:40.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:40.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:40.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:40.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:42 smithi191 bash[24992]: audit 2024-08-31T06:14:40.336697+0000 mgr.a (mgr.14388) 10525 : audit [DBG] from='client.232491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:42 smithi191 bash[24992]: cluster 2024-08-31T06:14:40.947849+0000 mgr.a (mgr.14388) 10526 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:42 smithi163 bash[24253]: audit 2024-08-31T06:14:40.336697+0000 mgr.a (mgr.14388) 10525 : audit [DBG] from='client.232491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:42 smithi163 bash[24253]: cluster 2024-08-31T06:14:40.947849+0000 mgr.a (mgr.14388) 10526 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:42 smithi027 bash[22610]: audit 2024-08-31T06:14:40.336697+0000 mgr.a (mgr.14388) 10525 : audit [DBG] from='client.232491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:42 smithi027 bash[22610]: cluster 2024-08-31T06:14:40.947849+0000 mgr.a (mgr.14388) 10526 : cluster [DBG] pgmap v7297: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:44.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:44 smithi191 bash[24992]: cluster 2024-08-31T06:14:42.950010+0000 mgr.a (mgr.14388) 10527 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:44 smithi163 bash[24253]: cluster 2024-08-31T06:14:42.950010+0000 mgr.a (mgr.14388) 10527 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:44 smithi027 bash[22610]: cluster 2024-08-31T06:14:42.950010+0000 mgr.a (mgr.14388) 10527 : cluster [DBG] pgmap v7298: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:45.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:14:45.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:14:45.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:46.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:46 smithi191 bash[24992]: cluster 2024-08-31T06:14:44.950798+0000 mgr.a (mgr.14388) 10528 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:46 smithi163 bash[24253]: cluster 2024-08-31T06:14:44.950798+0000 mgr.a (mgr.14388) 10528 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:46 smithi027 bash[22610]: cluster 2024-08-31T06:14:44.950798+0000 mgr.a (mgr.14388) 10528 : cluster [DBG] pgmap v7299: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:46.528 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:46.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:48 smithi191 bash[24992]: audit 2024-08-31T06:14:46.107198+0000 mgr.a (mgr.14388) 10529 : audit [DBG] from='client.232569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:48 smithi191 bash[24992]: cluster 2024-08-31T06:14:46.951767+0000 mgr.a (mgr.14388) 10530 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:48 smithi163 bash[24253]: audit 2024-08-31T06:14:46.107198+0000 mgr.a (mgr.14388) 10529 : audit [DBG] from='client.232569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:48 smithi163 bash[24253]: cluster 2024-08-31T06:14:46.951767+0000 mgr.a (mgr.14388) 10530 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:48 smithi027 bash[22610]: audit 2024-08-31T06:14:46.107198+0000 mgr.a (mgr.14388) 10529 : audit [DBG] from='client.232569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:48 smithi027 bash[22610]: cluster 2024-08-31T06:14:46.951767+0000 mgr.a (mgr.14388) 10530 : cluster [DBG] pgmap v7300: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:50.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:50 smithi191 bash[24992]: cluster 2024-08-31T06:14:48.954007+0000 mgr.a (mgr.14388) 10531 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:50.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:50 smithi163 bash[24253]: cluster 2024-08-31T06:14:48.954007+0000 mgr.a (mgr.14388) 10531 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:50 smithi027 bash[22610]: cluster 2024-08-31T06:14:48.954007+0000 mgr.a (mgr.14388) 10531 : cluster [DBG] pgmap v7301: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:14:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:14:51.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:52.305 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:52.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:52.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:52.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:52.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:52.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:52 smithi163 bash[24253]: cluster 2024-08-31T06:14:50.954779+0000 mgr.a (mgr.14388) 10532 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:52 smithi027 bash[22610]: cluster 2024-08-31T06:14:50.954779+0000 mgr.a (mgr.14388) 10532 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:52.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:52 smithi191 bash[24992]: cluster 2024-08-31T06:14:50.954779+0000 mgr.a (mgr.14388) 10532 : cluster [DBG] pgmap v7302: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:53 smithi163 bash[24253]: audit 2024-08-31T06:14:51.866151+0000 mgr.a (mgr.14388) 10533 : audit [DBG] from='client.232647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:53 smithi163 bash[24253]: audit 2024-08-31T06:14:52.863670+0000 mon.a (mon.0) 2155 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:14:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:53 smithi027 bash[22610]: audit 2024-08-31T06:14:51.866151+0000 mgr.a (mgr.14388) 10533 : audit [DBG] from='client.232647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:53 smithi027 bash[22610]: audit 2024-08-31T06:14:52.863670+0000 mon.a (mon.0) 2155 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:14:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:53 smithi191 bash[24992]: audit 2024-08-31T06:14:51.866151+0000 mgr.a (mgr.14388) 10533 : audit [DBG] from='client.232647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:53 smithi191 bash[24992]: audit 2024-08-31T06:14:52.863670+0000 mon.a (mon.0) 2155 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:14:54.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:54 smithi163 bash[24253]: cluster 2024-08-31T06:14:52.956184+0000 mgr.a (mgr.14388) 10534 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:54.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:54 smithi163 bash[24253]: audit 2024-08-31T06:14:53.712134+0000 mon.a (mon.0) 2156 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:14:54.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:54 smithi163 bash[24253]: audit 2024-08-31T06:14:53.713560+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:14:54.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:54 smithi163 bash[24253]: audit 2024-08-31T06:14:53.720609+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:14:54.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:54 smithi163 bash[24253]: audit 2024-08-31T06:14:53.723231+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:14:54.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:54 smithi027 bash[22610]: cluster 2024-08-31T06:14:52.956184+0000 mgr.a (mgr.14388) 10534 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:54.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:54 smithi027 bash[22610]: audit 2024-08-31T06:14:53.712134+0000 mon.a (mon.0) 2156 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:14:54.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:54 smithi027 bash[22610]: audit 2024-08-31T06:14:53.713560+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:14:54.469 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:54 smithi027 bash[22610]: audit 2024-08-31T06:14:53.720609+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:14:54.469 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:54 smithi027 bash[22610]: audit 2024-08-31T06:14:53.723231+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:14:54.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:54 smithi191 bash[24992]: cluster 2024-08-31T06:14:52.956184+0000 mgr.a (mgr.14388) 10534 : cluster [DBG] pgmap v7303: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:14:54.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:54 smithi191 bash[24992]: audit 2024-08-31T06:14:53.712134+0000 mon.a (mon.0) 2156 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:14:54.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:54 smithi191 bash[24992]: audit 2024-08-31T06:14:53.713560+0000 mon.a (mon.0) 2157 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:14:54.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:54 smithi191 bash[24992]: audit 2024-08-31T06:14:53.720609+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:14:54.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:54 smithi191 bash[24992]: audit 2024-08-31T06:14:53.723231+0000 mon.a (mon.0) 2159 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:14:54.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:14:54 smithi027 bash[22863]: debug 2024-08-31T06:14:54.464+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:14:54.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:14:54 smithi027 bash[22863]: debug 2024-08-31T06:14:54.464+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:14:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:55 smithi163 bash[24253]: audit 2024-08-31T06:14:53.724657+0000 mgr.a (mgr.14388) 10535 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:14:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:55 smithi027 bash[22610]: audit 2024-08-31T06:14:53.724657+0000 mgr.a (mgr.14388) 10535 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:14:55.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:55 smithi191 bash[24992]: audit 2024-08-31T06:14:53.724657+0000 mgr.a (mgr.14388) 10535 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:14:56.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:56 smithi163 bash[24253]: audit 2024-08-31T06:14:54.467738+0000 mgr.a (mgr.14388) 10536 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:14:56.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:56 smithi163 bash[24253]: cephadm 2024-08-31T06:14:54.469169+0000 mgr.a (mgr.14388) 10537 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:14:56.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:56 smithi163 bash[24253]: cluster 2024-08-31T06:14:54.957175+0000 mgr.a (mgr.14388) 10538 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:56 smithi027 bash[22610]: audit 2024-08-31T06:14:54.467738+0000 mgr.a (mgr.14388) 10536 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:14:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:56 smithi027 bash[22610]: cephadm 2024-08-31T06:14:54.469169+0000 mgr.a (mgr.14388) 10537 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:14:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:56 smithi027 bash[22610]: cluster 2024-08-31T06:14:54.957175+0000 mgr.a (mgr.14388) 10538 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:56.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:56 smithi191 bash[24992]: audit 2024-08-31T06:14:54.467738+0000 mgr.a (mgr.14388) 10536 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:14:56.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:56 smithi191 bash[24992]: cephadm 2024-08-31T06:14:54.469169+0000 mgr.a (mgr.14388) 10537 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:14:56.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:56 smithi191 bash[24992]: cluster 2024-08-31T06:14:54.957175+0000 mgr.a (mgr.14388) 10538 : cluster [DBG] pgmap v7304: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:57.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:14:57.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:14:57.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:14:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:57 smithi163 bash[24253]: cluster 2024-08-31T06:14:56.958137+0000 mgr.a (mgr.14388) 10539 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:57 smithi027 bash[22610]: cluster 2024-08-31T06:14:56.958137+0000 mgr.a (mgr.14388) 10539 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:57.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:57 smithi191 bash[24992]: cluster 2024-08-31T06:14:56.958137+0000 mgr.a (mgr.14388) 10539 : cluster [DBG] pgmap v7305: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:14:58.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:14:58.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:14:58.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:14:58.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:14:58.073 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:14:58.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:58 smithi163 bash[24253]: audit 2024-08-31T06:14:57.641520+0000 mgr.a (mgr.14388) 10540 : audit [DBG] from='client.232833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:58 smithi027 bash[22610]: audit 2024-08-31T06:14:57.641520+0000 mgr.a (mgr.14388) 10540 : audit [DBG] from='client.232833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:58.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:58 smithi191 bash[24992]: audit 2024-08-31T06:14:57.641520+0000 mgr.a (mgr.14388) 10540 : audit [DBG] from='client.232833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:14:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:14:59 smithi163 bash[24253]: cluster 2024-08-31T06:14:58.960943+0000 mgr.a (mgr.14388) 10541 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:14:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:14:59 smithi027 bash[22610]: cluster 2024-08-31T06:14:58.960943+0000 mgr.a (mgr.14388) 10541 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:14:59.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:14:59 smithi191 bash[24992]: cluster 2024-08-31T06:14:58.960943+0000 mgr.a (mgr.14388) 10541 : cluster [DBG] pgmap v7306: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:15:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:02 smithi191 bash[24992]: cluster 2024-08-31T06:15:00.961775+0000 mgr.a (mgr.14388) 10542 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:15:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:02 smithi163 bash[24253]: cluster 2024-08-31T06:15:00.961775+0000 mgr.a (mgr.14388) 10542 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:15:02.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:02 smithi027 bash[22610]: cluster 2024-08-31T06:15:00.961775+0000 mgr.a (mgr.14388) 10542 : cluster [DBG] pgmap v7307: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:15:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:15:03.074 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:15:03.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:15:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:15:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:15:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:15:03.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:15:03.849 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:15:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:04 smithi191 bash[24992]: cluster 2024-08-31T06:15:02.963848+0000 mgr.a (mgr.14388) 10543 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:15:04.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:04 smithi163 bash[24253]: cluster 2024-08-31T06:15:02.963848+0000 mgr.a (mgr.14388) 10543 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:15:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:04 smithi027 bash[22610]: cluster 2024-08-31T06:15:02.963848+0000 mgr.a (mgr.14388) 10543 : cluster [DBG] pgmap v7308: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:15:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:05 smithi191 bash[24992]: audit 2024-08-31T06:15:03.411532+0000 mgr.a (mgr.14388) 10544 : audit [DBG] from='client.232911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:05 smithi163 bash[24253]: audit 2024-08-31T06:15:03.411532+0000 mgr.a (mgr.14388) 10544 : audit [DBG] from='client.232911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:05 smithi027 bash[22610]: audit 2024-08-31T06:15:03.411532+0000 mgr.a (mgr.14388) 10544 : audit [DBG] from='client.232911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:06.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:06 smithi191 bash[24992]: cluster 2024-08-31T06:15:04.964846+0000 mgr.a (mgr.14388) 10545 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:15:06.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:06 smithi163 bash[24253]: cluster 2024-08-31T06:15:04.964846+0000 mgr.a (mgr.14388) 10545 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:15:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:06 smithi027 bash[22610]: cluster 2024-08-31T06:15:04.964846+0000 mgr.a (mgr.14388) 10545 : cluster [DBG] pgmap v7309: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:15:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:08 smithi163 bash[24253]: cluster 2024-08-31T06:15:06.965822+0000 mgr.a (mgr.14388) 10546 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:15:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:08 smithi027 bash[22610]: cluster 2024-08-31T06:15:06.965822+0000 mgr.a (mgr.14388) 10546 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:15:08.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:08 smithi191 bash[24992]: cluster 2024-08-31T06:15:06.965822+0000 mgr.a (mgr.14388) 10546 : cluster [DBG] pgmap v7310: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:15:08.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:15:08.851 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:15:08.852 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:15:09.612 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:15:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:15:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:15:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:15:09.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:15:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:10 smithi163 bash[24253]: cluster 2024-08-31T06:15:08.966965+0000 mgr.a (mgr.14388) 10547 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:15:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:10 smithi027 bash[22610]: cluster 2024-08-31T06:15:08.966965+0000 mgr.a (mgr.14388) 10547 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:15:10.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:10 smithi191 bash[24992]: cluster 2024-08-31T06:15:08.966965+0000 mgr.a (mgr.14388) 10547 : cluster [DBG] pgmap v7311: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:15:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:11 smithi163 bash[24253]: audit 2024-08-31T06:15:09.184713+0000 mgr.a (mgr.14388) 10548 : audit [DBG] from='client.232986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:11 smithi027 bash[22610]: audit 2024-08-31T06:15:09.184713+0000 mgr.a (mgr.14388) 10548 : audit [DBG] from='client.232986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:11.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:11 smithi191 bash[24992]: audit 2024-08-31T06:15:09.184713+0000 mgr.a (mgr.14388) 10548 : audit [DBG] from='client.232986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:12 smithi163 bash[24253]: cluster 2024-08-31T06:15:10.967797+0000 mgr.a (mgr.14388) 10549 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:12.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:12 smithi027 bash[22610]: cluster 2024-08-31T06:15:10.967797+0000 mgr.a (mgr.14388) 10549 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:12.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:12 smithi191 bash[24992]: cluster 2024-08-31T06:15:10.967797+0000 mgr.a (mgr.14388) 10549 : cluster [DBG] pgmap v7312: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:14 smithi163 bash[24253]: cluster 2024-08-31T06:15:12.969952+0000 mgr.a (mgr.14388) 10550 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:14 smithi027 bash[22610]: cluster 2024-08-31T06:15:12.969952+0000 mgr.a (mgr.14388) 10550 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:14.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:14 smithi191 bash[24992]: cluster 2024-08-31T06:15:12.969952+0000 mgr.a (mgr.14388) 10550 : cluster [DBG] pgmap v7313: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:15:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:15:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:15:15.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:15:15.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:15:15.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:15:15.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:15:15.373 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:15:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:16 smithi163 bash[24253]: audit 2024-08-31T06:15:14.946813+0000 mgr.a (mgr.14388) 10551 : audit [DBG] from='client.233058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:16 smithi163 bash[24253]: cluster 2024-08-31T06:15:14.971063+0000 mgr.a (mgr.14388) 10552 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:16 smithi027 bash[22610]: audit 2024-08-31T06:15:14.946813+0000 mgr.a (mgr.14388) 10551 : audit [DBG] from='client.233058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:16 smithi027 bash[22610]: cluster 2024-08-31T06:15:14.971063+0000 mgr.a (mgr.14388) 10552 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:16.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:16 smithi191 bash[24992]: audit 2024-08-31T06:15:14.946813+0000 mgr.a (mgr.14388) 10551 : audit [DBG] from='client.233058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:16.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:16 smithi191 bash[24992]: cluster 2024-08-31T06:15:14.971063+0000 mgr.a (mgr.14388) 10552 : cluster [DBG] pgmap v7314: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:17 smithi163 bash[24253]: cluster 2024-08-31T06:15:16.971992+0000 mgr.a (mgr.14388) 10553 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:17 smithi027 bash[22610]: cluster 2024-08-31T06:15:16.971992+0000 mgr.a (mgr.14388) 10553 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:17.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:17 smithi191 bash[24992]: cluster 2024-08-31T06:15:16.971992+0000 mgr.a (mgr.14388) 10553 : cluster [DBG] pgmap v7315: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:20.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:20 smithi191 bash[24992]: cluster 2024-08-31T06:15:18.974194+0000 mgr.a (mgr.14388) 10554 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:20.374 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:15:20.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:15:20.375 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:15:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:20 smithi163 bash[24253]: cluster 2024-08-31T06:15:18.974194+0000 mgr.a (mgr.14388) 10554 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:20 smithi027 bash[22610]: cluster 2024-08-31T06:15:18.974194+0000 mgr.a (mgr.14388) 10554 : cluster [DBG] pgmap v7316: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:21.110 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:15:21.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:15:21.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:15:21.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:15:21.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:15:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:22 smithi191 bash[24992]: audit 2024-08-31T06:15:20.703508+0000 mgr.a (mgr.14388) 10555 : audit [DBG] from='client.233136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:22 smithi191 bash[24992]: cluster 2024-08-31T06:15:20.974801+0000 mgr.a (mgr.14388) 10556 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:22 smithi163 bash[24253]: audit 2024-08-31T06:15:20.703508+0000 mgr.a (mgr.14388) 10555 : audit [DBG] from='client.233136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:22 smithi163 bash[24253]: cluster 2024-08-31T06:15:20.974801+0000 mgr.a (mgr.14388) 10556 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:22 smithi027 bash[22610]: audit 2024-08-31T06:15:20.703508+0000 mgr.a (mgr.14388) 10555 : audit [DBG] from='client.233136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:22 smithi027 bash[22610]: cluster 2024-08-31T06:15:20.974801+0000 mgr.a (mgr.14388) 10556 : cluster [DBG] pgmap v7317: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:24 smithi163 bash[24253]: cluster 2024-08-31T06:15:22.977031+0000 mgr.a (mgr.14388) 10557 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:24 smithi027 bash[22610]: cluster 2024-08-31T06:15:22.977031+0000 mgr.a (mgr.14388) 10557 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:24.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:24 smithi191 bash[24992]: cluster 2024-08-31T06:15:22.977031+0000 mgr.a (mgr.14388) 10557 : cluster [DBG] pgmap v7318: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:26.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:15:26.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:15:26.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:15:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:26 smithi163 bash[24253]: cluster 2024-08-31T06:15:24.977821+0000 mgr.a (mgr.14388) 10558 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:26 smithi027 bash[22610]: cluster 2024-08-31T06:15:24.977821+0000 mgr.a (mgr.14388) 10558 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:26 smithi191 bash[24992]: cluster 2024-08-31T06:15:24.977821+0000 mgr.a (mgr.14388) 10558 : cluster [DBG] pgmap v7319: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:26.893 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:15:26.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:15:26.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:15:26.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:15:26.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:15:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:28 smithi163 bash[24253]: audit 2024-08-31T06:15:26.448587+0000 mgr.a (mgr.14388) 10559 : audit [DBG] from='client.233211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:28 smithi163 bash[24253]: cluster 2024-08-31T06:15:26.978364+0000 mgr.a (mgr.14388) 10560 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:28 smithi027 bash[22610]: audit 2024-08-31T06:15:26.448587+0000 mgr.a (mgr.14388) 10559 : audit [DBG] from='client.233211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:28 smithi027 bash[22610]: cluster 2024-08-31T06:15:26.978364+0000 mgr.a (mgr.14388) 10560 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:28.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:28 smithi191 bash[24992]: audit 2024-08-31T06:15:26.448587+0000 mgr.a (mgr.14388) 10559 : audit [DBG] from='client.233211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:28.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:28 smithi191 bash[24992]: cluster 2024-08-31T06:15:26.978364+0000 mgr.a (mgr.14388) 10560 : cluster [DBG] pgmap v7320: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:30 smithi163 bash[24253]: cluster 2024-08-31T06:15:28.980554+0000 mgr.a (mgr.14388) 10561 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:30 smithi027 bash[22610]: cluster 2024-08-31T06:15:28.980554+0000 mgr.a (mgr.14388) 10561 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:30 smithi191 bash[24992]: cluster 2024-08-31T06:15:28.980554+0000 mgr.a (mgr.14388) 10561 : cluster [DBG] pgmap v7321: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:31.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:15:31.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:15:31.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:15:32.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:32 smithi163 bash[24253]: cluster 2024-08-31T06:15:30.981315+0000 mgr.a (mgr.14388) 10562 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:32 smithi027 bash[22610]: cluster 2024-08-31T06:15:30.981315+0000 mgr.a (mgr.14388) 10562 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:32.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:32 smithi191 bash[24992]: cluster 2024-08-31T06:15:30.981315+0000 mgr.a (mgr.14388) 10562 : cluster [DBG] pgmap v7322: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:32.659 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:15:32.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:15:32.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:15:32.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:15:32.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:15:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:34 smithi163 bash[24253]: audit 2024-08-31T06:15:32.228849+0000 mgr.a (mgr.14388) 10563 : audit [DBG] from='client.233289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:34 smithi163 bash[24253]: cluster 2024-08-31T06:15:32.983475+0000 mgr.a (mgr.14388) 10564 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:34 smithi027 bash[22610]: audit 2024-08-31T06:15:32.228849+0000 mgr.a (mgr.14388) 10563 : audit [DBG] from='client.233289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:34 smithi027 bash[22610]: cluster 2024-08-31T06:15:32.983475+0000 mgr.a (mgr.14388) 10564 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:34 smithi191 bash[24992]: audit 2024-08-31T06:15:32.228849+0000 mgr.a (mgr.14388) 10563 : audit [DBG] from='client.233289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:34 smithi191 bash[24992]: cluster 2024-08-31T06:15:32.983475+0000 mgr.a (mgr.14388) 10564 : cluster [DBG] pgmap v7323: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:36 smithi163 bash[24253]: cluster 2024-08-31T06:15:34.984253+0000 mgr.a (mgr.14388) 10565 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:36 smithi027 bash[22610]: cluster 2024-08-31T06:15:34.984253+0000 mgr.a (mgr.14388) 10565 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:36.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:36 smithi191 bash[24992]: cluster 2024-08-31T06:15:34.984253+0000 mgr.a (mgr.14388) 10565 : cluster [DBG] pgmap v7324: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:37.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:15:37.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:15:37.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:15:38.410 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:15:38.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:15:38.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:15:38.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:15:38.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:15:38.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:38 smithi163 bash[24253]: cluster 2024-08-31T06:15:36.984988+0000 mgr.a (mgr.14388) 10566 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:38 smithi027 bash[22610]: cluster 2024-08-31T06:15:36.984988+0000 mgr.a (mgr.14388) 10566 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:38.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:38 smithi191 bash[24992]: cluster 2024-08-31T06:15:36.984988+0000 mgr.a (mgr.14388) 10566 : cluster [DBG] pgmap v7325: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:39 smithi163 bash[24253]: audit 2024-08-31T06:15:37.993683+0000 mgr.a (mgr.14388) 10567 : audit [DBG] from='client.233364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:39 smithi027 bash[22610]: audit 2024-08-31T06:15:37.993683+0000 mgr.a (mgr.14388) 10567 : audit [DBG] from='client.233364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:39 smithi191 bash[24992]: audit 2024-08-31T06:15:37.993683+0000 mgr.a (mgr.14388) 10567 : audit [DBG] from='client.233364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:40 smithi163 bash[24253]: cluster 2024-08-31T06:15:38.987726+0000 mgr.a (mgr.14388) 10568 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:40 smithi027 bash[22610]: cluster 2024-08-31T06:15:38.987726+0000 mgr.a (mgr.14388) 10568 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:40.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:40 smithi191 bash[24992]: cluster 2024-08-31T06:15:38.987726+0000 mgr.a (mgr.14388) 10568 : cluster [DBG] pgmap v7326: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:41 smithi163 bash[24253]: cluster 2024-08-31T06:15:40.988533+0000 mgr.a (mgr.14388) 10569 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:15:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:41 smithi027 bash[22610]: cluster 2024-08-31T06:15:40.988533+0000 mgr.a (mgr.14388) 10569 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:15:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:41 smithi191 bash[24992]: cluster 2024-08-31T06:15:40.988533+0000 mgr.a (mgr.14388) 10569 : cluster [DBG] pgmap v7327: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:15:43.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:15:43.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:15:43.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:15:44.163 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:15:44.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:15:44.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:15:44.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:15:44.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:15:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:44 smithi163 bash[24253]: cluster 2024-08-31T06:15:42.990450+0000 mgr.a (mgr.14388) 10570 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:44 smithi027 bash[22610]: cluster 2024-08-31T06:15:42.990450+0000 mgr.a (mgr.14388) 10570 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:44.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:44 smithi191 bash[24992]: cluster 2024-08-31T06:15:42.990450+0000 mgr.a (mgr.14388) 10570 : cluster [DBG] pgmap v7328: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:45 smithi163 bash[24253]: audit 2024-08-31T06:15:43.743878+0000 mgr.a (mgr.14388) 10571 : audit [DBG] from='client.233442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:45 smithi027 bash[22610]: audit 2024-08-31T06:15:43.743878+0000 mgr.a (mgr.14388) 10571 : audit [DBG] from='client.233442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:45.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:45 smithi191 bash[24992]: audit 2024-08-31T06:15:43.743878+0000 mgr.a (mgr.14388) 10571 : audit [DBG] from='client.233442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:46 smithi163 bash[24253]: cluster 2024-08-31T06:15:44.991380+0000 mgr.a (mgr.14388) 10572 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:15:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:46 smithi027 bash[22610]: cluster 2024-08-31T06:15:44.991380+0000 mgr.a (mgr.14388) 10572 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:15:46.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:46 smithi191 bash[24992]: cluster 2024-08-31T06:15:44.991380+0000 mgr.a (mgr.14388) 10572 : cluster [DBG] pgmap v7329: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:15:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:48 smithi163 bash[24253]: cluster 2024-08-31T06:15:46.992162+0000 mgr.a (mgr.14388) 10573 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:15:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:48 smithi027 bash[22610]: cluster 2024-08-31T06:15:46.992162+0000 mgr.a (mgr.14388) 10573 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:15:48.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:48 smithi191 bash[24992]: cluster 2024-08-31T06:15:46.992162+0000 mgr.a (mgr.14388) 10573 : cluster [DBG] pgmap v7330: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:15:49.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:15:49.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:15:49.166 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:15:49.945 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:15:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:15:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:15:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:15:49.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:15:50.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:50 smithi163 bash[24253]: cluster 2024-08-31T06:15:48.994350+0000 mgr.a (mgr.14388) 10574 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:50 smithi027 bash[22610]: cluster 2024-08-31T06:15:48.994350+0000 mgr.a (mgr.14388) 10574 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:50.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:50 smithi191 bash[24992]: cluster 2024-08-31T06:15:48.994350+0000 mgr.a (mgr.14388) 10574 : cluster [DBG] pgmap v7331: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:51 smithi163 bash[24253]: audit 2024-08-31T06:15:49.502411+0000 mgr.a (mgr.14388) 10575 : audit [DBG] from='client.233520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:51 smithi027 bash[22610]: audit 2024-08-31T06:15:49.502411+0000 mgr.a (mgr.14388) 10575 : audit [DBG] from='client.233520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:51 smithi191 bash[24992]: audit 2024-08-31T06:15:49.502411+0000 mgr.a (mgr.14388) 10575 : audit [DBG] from='client.233520 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:52.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:52 smithi163 bash[24253]: cluster 2024-08-31T06:15:50.995258+0000 mgr.a (mgr.14388) 10576 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:52 smithi027 bash[22610]: cluster 2024-08-31T06:15:50.995258+0000 mgr.a (mgr.14388) 10576 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:52 smithi191 bash[24992]: cluster 2024-08-31T06:15:50.995258+0000 mgr.a (mgr.14388) 10576 : cluster [DBG] pgmap v7332: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:53 smithi163 bash[24253]: cluster 2024-08-31T06:15:52.997409+0000 mgr.a (mgr.14388) 10577 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:53 smithi027 bash[22610]: cluster 2024-08-31T06:15:52.997409+0000 mgr.a (mgr.14388) 10577 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:53 smithi191 bash[24992]: cluster 2024-08-31T06:15:52.997409+0000 mgr.a (mgr.14388) 10577 : cluster [DBG] pgmap v7333: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:15:54.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:15:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:15:54.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:15:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:54 smithi163 bash[24253]: audit 2024-08-31T06:15:54.519742+0000 mon.a (mon.0) 2160 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:15:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:54 smithi027 bash[22610]: audit 2024-08-31T06:15:54.519742+0000 mon.a (mon.0) 2160 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:15:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:54 smithi191 bash[24992]: audit 2024-08-31T06:15:54.519742+0000 mon.a (mon.0) 2160 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:15:55.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:15:55.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:15:55.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:15:55.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:15:55.692 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:15:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:55 smithi163 bash[24253]: cluster 2024-08-31T06:15:54.998149+0000 mgr.a (mgr.14388) 10578 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:55 smithi027 bash[22610]: cluster 2024-08-31T06:15:54.998149+0000 mgr.a (mgr.14388) 10578 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:55 smithi191 bash[24992]: cluster 2024-08-31T06:15:54.998149+0000 mgr.a (mgr.14388) 10578 : cluster [DBG] pgmap v7334: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:56.889 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22863]: debug 2024-08-31T06:15:56.631+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:15:56.889 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22863]: debug 2024-08-31T06:15:56.635+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:15:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.277479+0000 mgr.a (mgr.14388) 10579 : audit [DBG] from='client.233598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.887297+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.893712+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.898381+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.902576+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.908052+0000 mon.a (mon.0) 2165 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.914030+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.915550+0000 mon.a (mon.0) 2167 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.916678+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.922945+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.924849+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:15:57.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:56 smithi163 bash[24253]: audit 2024-08-31T06:15:55.925986+0000 mgr.a (mgr.14388) 10580 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:15:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.277479+0000 mgr.a (mgr.14388) 10579 : audit [DBG] from='client.233598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.887297+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.893712+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.898381+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.902576+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.908052+0000 mon.a (mon.0) 2165 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.914030+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.915550+0000 mon.a (mon.0) 2167 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:15:57.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.916678+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:15:57.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.922945+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.924849+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:15:57.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:56 smithi027 bash[22610]: audit 2024-08-31T06:15:55.925986+0000 mgr.a (mgr.14388) 10580 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:15:57.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.277479+0000 mgr.a (mgr.14388) 10579 : audit [DBG] from='client.233598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:15:57.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.887297+0000 mon.a (mon.0) 2161 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.893712+0000 mon.a (mon.0) 2162 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.898381+0000 mon.a (mon.0) 2163 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.902576+0000 mon.a (mon.0) 2164 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.908052+0000 mon.a (mon.0) 2165 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.914030+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.915550+0000 mon.a (mon.0) 2167 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:15:57.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.916678+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:15:57.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.922945+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:15:57.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.924849+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:15:57.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:56 smithi191 bash[24992]: audit 2024-08-31T06:15:55.925986+0000 mgr.a (mgr.14388) 10580 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:15:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:57 smithi163 bash[24253]: audit 2024-08-31T06:15:56.637887+0000 mgr.a (mgr.14388) 10581 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:15:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:57 smithi163 bash[24253]: cephadm 2024-08-31T06:15:56.639418+0000 mgr.a (mgr.14388) 10582 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:15:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:15:57 smithi163 bash[24253]: cluster 2024-08-31T06:15:56.999072+0000 mgr.a (mgr.14388) 10583 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:57 smithi027 bash[22610]: audit 2024-08-31T06:15:56.637887+0000 mgr.a (mgr.14388) 10581 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:15:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:57 smithi027 bash[22610]: cephadm 2024-08-31T06:15:56.639418+0000 mgr.a (mgr.14388) 10582 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:15:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:15:57 smithi027 bash[22610]: cluster 2024-08-31T06:15:56.999072+0000 mgr.a (mgr.14388) 10583 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:15:58.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:57 smithi191 bash[24992]: audit 2024-08-31T06:15:56.637887+0000 mgr.a (mgr.14388) 10581 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:15:58.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:57 smithi191 bash[24992]: cephadm 2024-08-31T06:15:56.639418+0000 mgr.a (mgr.14388) 10582 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:15:58.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:15:57 smithi191 bash[24992]: cluster 2024-08-31T06:15:56.999072+0000 mgr.a (mgr.14388) 10583 : cluster [DBG] pgmap v7335: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:00.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:00 smithi163 bash[24253]: cluster 2024-08-31T06:15:59.001248+0000 mgr.a (mgr.14388) 10584 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:00 smithi027 bash[22610]: cluster 2024-08-31T06:15:59.001248+0000 mgr.a (mgr.14388) 10584 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:00.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:00 smithi191 bash[24992]: cluster 2024-08-31T06:15:59.001248+0000 mgr.a (mgr.14388) 10584 : cluster [DBG] pgmap v7336: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:00.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:00.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:00.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:01.440 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:01.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:01.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:01.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:01.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:02 smithi163 bash[24253]: cluster 2024-08-31T06:16:01.001742+0000 mgr.a (mgr.14388) 10585 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:02 smithi163 bash[24253]: audit 2024-08-31T06:16:01.013394+0000 mgr.a (mgr.14388) 10586 : audit [DBG] from='client.233781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:02.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:02 smithi027 bash[22610]: cluster 2024-08-31T06:16:01.001742+0000 mgr.a (mgr.14388) 10585 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:02.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:02 smithi027 bash[22610]: audit 2024-08-31T06:16:01.013394+0000 mgr.a (mgr.14388) 10586 : audit [DBG] from='client.233781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:02.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:02 smithi191 bash[24992]: cluster 2024-08-31T06:16:01.001742+0000 mgr.a (mgr.14388) 10585 : cluster [DBG] pgmap v7337: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:02.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:02 smithi191 bash[24992]: audit 2024-08-31T06:16:01.013394+0000 mgr.a (mgr.14388) 10586 : audit [DBG] from='client.233781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:04.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:04 smithi163 bash[24253]: cluster 2024-08-31T06:16:03.003895+0000 mgr.a (mgr.14388) 10587 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:04 smithi027 bash[22610]: cluster 2024-08-31T06:16:03.003895+0000 mgr.a (mgr.14388) 10587 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:04.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:04 smithi191 bash[24992]: cluster 2024-08-31T06:16:03.003895+0000 mgr.a (mgr.14388) 10587 : cluster [DBG] pgmap v7338: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:06.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:06.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:06.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:06 smithi163 bash[24253]: cluster 2024-08-31T06:16:05.004680+0000 mgr.a (mgr.14388) 10588 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:06 smithi027 bash[22610]: cluster 2024-08-31T06:16:05.004680+0000 mgr.a (mgr.14388) 10588 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:06.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:06 smithi191 bash[24992]: cluster 2024-08-31T06:16:05.004680+0000 mgr.a (mgr.14388) 10588 : cluster [DBG] pgmap v7339: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:07.205 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:07.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:07.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:07.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:07.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:08 smithi163 bash[24253]: audit 2024-08-31T06:16:06.775633+0000 mgr.a (mgr.14388) 10589 : audit [DBG] from='client.233856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:08 smithi163 bash[24253]: cluster 2024-08-31T06:16:07.005563+0000 mgr.a (mgr.14388) 10590 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:08 smithi027 bash[22610]: audit 2024-08-31T06:16:06.775633+0000 mgr.a (mgr.14388) 10589 : audit [DBG] from='client.233856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:08 smithi027 bash[22610]: cluster 2024-08-31T06:16:07.005563+0000 mgr.a (mgr.14388) 10590 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:08.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:08 smithi191 bash[24992]: audit 2024-08-31T06:16:06.775633+0000 mgr.a (mgr.14388) 10589 : audit [DBG] from='client.233856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:08.561 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:08 smithi191 bash[24992]: cluster 2024-08-31T06:16:07.005563+0000 mgr.a (mgr.14388) 10590 : cluster [DBG] pgmap v7340: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:09 smithi163 bash[24253]: cluster 2024-08-31T06:16:09.007918+0000 mgr.a (mgr.14388) 10591 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:09 smithi027 bash[22610]: cluster 2024-08-31T06:16:09.007918+0000 mgr.a (mgr.14388) 10591 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:09 smithi191 bash[24992]: cluster 2024-08-31T06:16:09.007918+0000 mgr.a (mgr.14388) 10591 : cluster [DBG] pgmap v7341: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:16:12.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:12.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:12.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:12 smithi163 bash[24253]: cluster 2024-08-31T06:16:11.008725+0000 mgr.a (mgr.14388) 10592 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:12.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:12 smithi027 bash[22610]: cluster 2024-08-31T06:16:11.008725+0000 mgr.a (mgr.14388) 10592 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:12.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:12 smithi191 bash[24992]: cluster 2024-08-31T06:16:11.008725+0000 mgr.a (mgr.14388) 10592 : cluster [DBG] pgmap v7342: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:12.956 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:12.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:12.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:12.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:12.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:14 smithi163 bash[24253]: audit 2024-08-31T06:16:12.527046+0000 mgr.a (mgr.14388) 10593 : audit [DBG] from='client.233934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:14 smithi163 bash[24253]: cluster 2024-08-31T06:16:13.010086+0000 mgr.a (mgr.14388) 10594 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:16:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:14 smithi027 bash[22610]: audit 2024-08-31T06:16:12.527046+0000 mgr.a (mgr.14388) 10593 : audit [DBG] from='client.233934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:14 smithi027 bash[22610]: cluster 2024-08-31T06:16:13.010086+0000 mgr.a (mgr.14388) 10594 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:16:14.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:14 smithi191 bash[24992]: audit 2024-08-31T06:16:12.527046+0000 mgr.a (mgr.14388) 10593 : audit [DBG] from='client.233934 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:14.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:14 smithi191 bash[24992]: cluster 2024-08-31T06:16:13.010086+0000 mgr.a (mgr.14388) 10594 : cluster [DBG] pgmap v7343: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:16:16.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:16 smithi163 bash[24253]: cluster 2024-08-31T06:16:15.010861+0000 mgr.a (mgr.14388) 10595 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:16:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:16 smithi027 bash[22610]: cluster 2024-08-31T06:16:15.010861+0000 mgr.a (mgr.14388) 10595 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:16:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:16 smithi191 bash[24992]: cluster 2024-08-31T06:16:15.010861+0000 mgr.a (mgr.14388) 10595 : cluster [DBG] pgmap v7344: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:16:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:17.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:17.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:18 smithi163 bash[24253]: cluster 2024-08-31T06:16:17.011632+0000 mgr.a (mgr.14388) 10596 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:16:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:18 smithi027 bash[22610]: cluster 2024-08-31T06:16:17.011632+0000 mgr.a (mgr.14388) 10596 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:16:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:18 smithi191 bash[24992]: cluster 2024-08-31T06:16:17.011632+0000 mgr.a (mgr.14388) 10596 : cluster [DBG] pgmap v7345: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:16:18.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:18.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:18.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:18.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:19 smithi163 bash[24253]: audit 2024-08-31T06:16:18.287871+0000 mgr.a (mgr.14388) 10597 : audit [DBG] from='client.234009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:19 smithi163 bash[24253]: cluster 2024-08-31T06:16:19.015230+0000 mgr.a (mgr.14388) 10598 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:19 smithi027 bash[22610]: audit 2024-08-31T06:16:18.287871+0000 mgr.a (mgr.14388) 10597 : audit [DBG] from='client.234009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:19 smithi027 bash[22610]: cluster 2024-08-31T06:16:19.015230+0000 mgr.a (mgr.14388) 10598 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:19 smithi191 bash[24992]: audit 2024-08-31T06:16:18.287871+0000 mgr.a (mgr.14388) 10597 : audit [DBG] from='client.234009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:19 smithi191 bash[24992]: cluster 2024-08-31T06:16:19.015230+0000 mgr.a (mgr.14388) 10598 : cluster [DBG] pgmap v7346: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:22 smithi163 bash[24253]: cluster 2024-08-31T06:16:21.016065+0000 mgr.a (mgr.14388) 10599 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:16:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:22 smithi027 bash[22610]: cluster 2024-08-31T06:16:21.016065+0000 mgr.a (mgr.14388) 10599 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:16:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:22 smithi191 bash[24992]: cluster 2024-08-31T06:16:21.016065+0000 mgr.a (mgr.14388) 10599 : cluster [DBG] pgmap v7347: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:16:23.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:23.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:23.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:24 smithi163 bash[24253]: cluster 2024-08-31T06:16:23.017969+0000 mgr.a (mgr.14388) 10600 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:24.451 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:24.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:24.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:24.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:24.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:24 smithi027 bash[22610]: cluster 2024-08-31T06:16:23.017969+0000 mgr.a (mgr.14388) 10600 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:24.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:24 smithi191 bash[24992]: cluster 2024-08-31T06:16:23.017969+0000 mgr.a (mgr.14388) 10600 : cluster [DBG] pgmap v7348: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:25 smithi163 bash[24253]: audit 2024-08-31T06:16:24.044244+0000 mgr.a (mgr.14388) 10601 : audit [DBG] from='client.234084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:25 smithi027 bash[22610]: audit 2024-08-31T06:16:24.044244+0000 mgr.a (mgr.14388) 10601 : audit [DBG] from='client.234084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:25 smithi191 bash[24992]: audit 2024-08-31T06:16:24.044244+0000 mgr.a (mgr.14388) 10601 : audit [DBG] from='client.234084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:26 smithi163 bash[24253]: cluster 2024-08-31T06:16:25.018954+0000 mgr.a (mgr.14388) 10602 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:16:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:26 smithi027 bash[22610]: cluster 2024-08-31T06:16:25.018954+0000 mgr.a (mgr.14388) 10602 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:16:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:26 smithi191 bash[24992]: cluster 2024-08-31T06:16:25.018954+0000 mgr.a (mgr.14388) 10602 : cluster [DBG] pgmap v7349: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:16:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:27 smithi163 bash[24253]: cluster 2024-08-31T06:16:27.019719+0000 mgr.a (mgr.14388) 10603 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:16:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:27 smithi027 bash[22610]: cluster 2024-08-31T06:16:27.019719+0000 mgr.a (mgr.14388) 10603 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:16:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:27 smithi191 bash[24992]: cluster 2024-08-31T06:16:27.019719+0000 mgr.a (mgr.14388) 10603 : cluster [DBG] pgmap v7350: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:16:29.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:29.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:29.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:30.203 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:30.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:30 smithi163 bash[24253]: cluster 2024-08-31T06:16:29.021816+0000 mgr.a (mgr.14388) 10604 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:16:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:30 smithi027 bash[22610]: cluster 2024-08-31T06:16:29.021816+0000 mgr.a (mgr.14388) 10604 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:16:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:30 smithi191 bash[24992]: cluster 2024-08-31T06:16:29.021816+0000 mgr.a (mgr.14388) 10604 : cluster [DBG] pgmap v7351: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:16:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:31 smithi163 bash[24253]: audit 2024-08-31T06:16:29.781249+0000 mgr.a (mgr.14388) 10605 : audit [DBG] from='client.234159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:31 smithi027 bash[22610]: audit 2024-08-31T06:16:29.781249+0000 mgr.a (mgr.14388) 10605 : audit [DBG] from='client.234159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:31.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:31 smithi191 bash[24992]: audit 2024-08-31T06:16:29.781249+0000 mgr.a (mgr.14388) 10605 : audit [DBG] from='client.234159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:32.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:32 smithi163 bash[24253]: cluster 2024-08-31T06:16:31.022791+0000 mgr.a (mgr.14388) 10606 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:32 smithi027 bash[22610]: cluster 2024-08-31T06:16:31.022791+0000 mgr.a (mgr.14388) 10606 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:32.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:32 smithi191 bash[24992]: cluster 2024-08-31T06:16:31.022791+0000 mgr.a (mgr.14388) 10606 : cluster [DBG] pgmap v7352: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:33 smithi163 bash[24253]: cluster 2024-08-31T06:16:33.025037+0000 mgr.a (mgr.14388) 10607 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:33 smithi027 bash[22610]: cluster 2024-08-31T06:16:33.025037+0000 mgr.a (mgr.14388) 10607 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:33.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:33 smithi191 bash[24992]: cluster 2024-08-31T06:16:33.025037+0000 mgr.a (mgr.14388) 10607 : cluster [DBG] pgmap v7353: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:35.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:35.205 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:35.205 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:35.940 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:35.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:35.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:35.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:35.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:36 smithi163 bash[24253]: cluster 2024-08-31T06:16:35.025771+0000 mgr.a (mgr.14388) 10608 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:36 smithi027 bash[22610]: cluster 2024-08-31T06:16:35.025771+0000 mgr.a (mgr.14388) 10608 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:36.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:36 smithi191 bash[24992]: cluster 2024-08-31T06:16:35.025771+0000 mgr.a (mgr.14388) 10608 : cluster [DBG] pgmap v7354: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:37 smithi163 bash[24253]: audit 2024-08-31T06:16:35.534936+0000 mgr.a (mgr.14388) 10609 : audit [DBG] from='client.234237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:37 smithi163 bash[24253]: cluster 2024-08-31T06:16:37.026752+0000 mgr.a (mgr.14388) 10610 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:37 smithi027 bash[22610]: audit 2024-08-31T06:16:35.534936+0000 mgr.a (mgr.14388) 10609 : audit [DBG] from='client.234237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:37 smithi027 bash[22610]: cluster 2024-08-31T06:16:37.026752+0000 mgr.a (mgr.14388) 10610 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:37 smithi191 bash[24992]: audit 2024-08-31T06:16:35.534936+0000 mgr.a (mgr.14388) 10609 : audit [DBG] from='client.234237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:37 smithi191 bash[24992]: cluster 2024-08-31T06:16:37.026752+0000 mgr.a (mgr.14388) 10610 : cluster [DBG] pgmap v7355: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:39 smithi163 bash[24253]: cluster 2024-08-31T06:16:39.028905+0000 mgr.a (mgr.14388) 10611 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:39 smithi027 bash[22610]: cluster 2024-08-31T06:16:39.028905+0000 mgr.a (mgr.14388) 10611 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:39 smithi191 bash[24992]: cluster 2024-08-31T06:16:39.028905+0000 mgr.a (mgr.14388) 10611 : cluster [DBG] pgmap v7356: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:40.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:40.942 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:40.942 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:41 smithi163 bash[24253]: cluster 2024-08-31T06:16:41.029637+0000 mgr.a (mgr.14388) 10612 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:41 smithi027 bash[22610]: cluster 2024-08-31T06:16:41.029637+0000 mgr.a (mgr.14388) 10612 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:41 smithi191 bash[24992]: cluster 2024-08-31T06:16:41.029637+0000 mgr.a (mgr.14388) 10612 : cluster [DBG] pgmap v7357: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:41.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:41.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:41.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:41.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:41.688 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:42 smithi163 bash[24253]: audit 2024-08-31T06:16:41.273649+0000 mgr.a (mgr.14388) 10613 : audit [DBG] from='client.234312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:42 smithi027 bash[22610]: audit 2024-08-31T06:16:41.273649+0000 mgr.a (mgr.14388) 10613 : audit [DBG] from='client.234312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:42.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:42 smithi191 bash[24992]: audit 2024-08-31T06:16:41.273649+0000 mgr.a (mgr.14388) 10613 : audit [DBG] from='client.234312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:43 smithi163 bash[24253]: cluster 2024-08-31T06:16:43.031962+0000 mgr.a (mgr.14388) 10614 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:43 smithi027 bash[22610]: cluster 2024-08-31T06:16:43.031962+0000 mgr.a (mgr.14388) 10614 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:43.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:43 smithi191 bash[24992]: cluster 2024-08-31T06:16:43.031962+0000 mgr.a (mgr.14388) 10614 : cluster [DBG] pgmap v7358: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:45 smithi163 bash[24253]: cluster 2024-08-31T06:16:45.032845+0000 mgr.a (mgr.14388) 10615 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:45 smithi027 bash[22610]: cluster 2024-08-31T06:16:45.032845+0000 mgr.a (mgr.14388) 10615 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:45.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:45 smithi191 bash[24992]: cluster 2024-08-31T06:16:45.032845+0000 mgr.a (mgr.14388) 10615 : cluster [DBG] pgmap v7359: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:46.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:46.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:46.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:47 smithi163 bash[24253]: audit 2024-08-31T06:16:47.024825+0000 mgr.a (mgr.14388) 10616 : audit [DBG] from='client.234387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:47 smithi163 bash[24253]: cluster 2024-08-31T06:16:47.036041+0000 mgr.a (mgr.14388) 10617 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:47.466 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:47.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:47.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:47.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:47.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:47 smithi027 bash[22610]: audit 2024-08-31T06:16:47.024825+0000 mgr.a (mgr.14388) 10616 : audit [DBG] from='client.234387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:47 smithi027 bash[22610]: cluster 2024-08-31T06:16:47.036041+0000 mgr.a (mgr.14388) 10617 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:47 smithi191 bash[24992]: audit 2024-08-31T06:16:47.024825+0000 mgr.a (mgr.14388) 10616 : audit [DBG] from='client.234387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:47 smithi191 bash[24992]: cluster 2024-08-31T06:16:47.036041+0000 mgr.a (mgr.14388) 10617 : cluster [DBG] pgmap v7360: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:49 smithi163 bash[24253]: cluster 2024-08-31T06:16:49.038446+0000 mgr.a (mgr.14388) 10618 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:49 smithi027 bash[22610]: cluster 2024-08-31T06:16:49.038446+0000 mgr.a (mgr.14388) 10618 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:49.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:49 smithi191 bash[24992]: cluster 2024-08-31T06:16:49.038446+0000 mgr.a (mgr.14388) 10618 : cluster [DBG] pgmap v7361: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:16:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:51 smithi163 bash[24253]: cluster 2024-08-31T06:16:51.039255+0000 mgr.a (mgr.14388) 10619 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:51 smithi027 bash[22610]: cluster 2024-08-31T06:16:51.039255+0000 mgr.a (mgr.14388) 10619 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:51 smithi191 bash[24992]: cluster 2024-08-31T06:16:51.039255+0000 mgr.a (mgr.14388) 10619 : cluster [DBG] pgmap v7362: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:52.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:52.468 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:52.468 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:53.225 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:53.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:53.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:53.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:53.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:53 smithi163 bash[24253]: audit 2024-08-31T06:16:52.800567+0000 mgr.a (mgr.14388) 10620 : audit [DBG] from='client.234465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:53 smithi163 bash[24253]: cluster 2024-08-31T06:16:53.040554+0000 mgr.a (mgr.14388) 10621 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:53 smithi027 bash[22610]: audit 2024-08-31T06:16:52.800567+0000 mgr.a (mgr.14388) 10620 : audit [DBG] from='client.234465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:53 smithi027 bash[22610]: cluster 2024-08-31T06:16:53.040554+0000 mgr.a (mgr.14388) 10621 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:53 smithi191 bash[24992]: audit 2024-08-31T06:16:52.800567+0000 mgr.a (mgr.14388) 10620 : audit [DBG] from='client.234465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:16:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:53 smithi191 bash[24992]: cluster 2024-08-31T06:16:53.040554+0000 mgr.a (mgr.14388) 10621 : cluster [DBG] pgmap v7363: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:16:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:55 smithi163 bash[24253]: cluster 2024-08-31T06:16:55.041399+0000 mgr.a (mgr.14388) 10622 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:16:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:55 smithi027 bash[22610]: cluster 2024-08-31T06:16:55.041399+0000 mgr.a (mgr.14388) 10622 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:16:55.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:55 smithi191 bash[24992]: cluster 2024-08-31T06:16:55.041399+0000 mgr.a (mgr.14388) 10622 : cluster [DBG] pgmap v7364: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:16:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:56 smithi191 bash[24992]: audit 2024-08-31T06:16:56.701587+0000 mon.a (mon.0) 2171 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:16:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:56 smithi163 bash[24253]: audit 2024-08-31T06:16:56.701587+0000 mon.a (mon.0) 2171 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:16:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:56 smithi027 bash[22610]: audit 2024-08-31T06:16:56.701587+0000 mon.a (mon.0) 2171 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:16:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:57 smithi191 bash[24992]: cluster 2024-08-31T06:16:57.042123+0000 mgr.a (mgr.14388) 10623 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:16:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:57 smithi191 bash[24992]: audit 2024-08-31T06:16:57.539647+0000 mon.a (mon.0) 2172 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:16:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:57 smithi191 bash[24992]: audit 2024-08-31T06:16:57.541413+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:16:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:57 smithi191 bash[24992]: audit 2024-08-31T06:16:57.552680+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:16:58.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:57 smithi191 bash[24992]: audit 2024-08-31T06:16:57.557458+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:16:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:57 smithi163 bash[24253]: cluster 2024-08-31T06:16:57.042123+0000 mgr.a (mgr.14388) 10623 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:16:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:57 smithi163 bash[24253]: audit 2024-08-31T06:16:57.539647+0000 mon.a (mon.0) 2172 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:16:58.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:57 smithi163 bash[24253]: audit 2024-08-31T06:16:57.541413+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:16:58.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:57 smithi163 bash[24253]: audit 2024-08-31T06:16:57.552680+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:16:58.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:57 smithi163 bash[24253]: audit 2024-08-31T06:16:57.557458+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:16:58.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:16:58.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:16:58.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:16:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:57 smithi027 bash[22610]: cluster 2024-08-31T06:16:57.042123+0000 mgr.a (mgr.14388) 10623 : cluster [DBG] pgmap v7365: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:16:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:57 smithi027 bash[22610]: audit 2024-08-31T06:16:57.539647+0000 mon.a (mon.0) 2172 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:16:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:57 smithi027 bash[22610]: audit 2024-08-31T06:16:57.541413+0000 mon.a (mon.0) 2173 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:16:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:57 smithi027 bash[22610]: audit 2024-08-31T06:16:57.552680+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:16:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:57 smithi027 bash[22610]: audit 2024-08-31T06:16:57.557458+0000 mon.a (mon.0) 2175 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:16:58.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:16:58 smithi027 bash[22863]: debug 2024-08-31T06:16:58.305+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:16:58.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:16:58 smithi027 bash[22863]: debug 2024-08-31T06:16:58.309+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:16:58.967 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:16:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:16:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:16:58.967 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:16:58.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:16:59.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:58 smithi191 bash[24992]: audit 2024-08-31T06:16:57.558613+0000 mgr.a (mgr.14388) 10624 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:16:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:58 smithi163 bash[24253]: audit 2024-08-31T06:16:57.558613+0000 mgr.a (mgr.14388) 10624 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:16:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:58 smithi027 bash[22610]: audit 2024-08-31T06:16:57.558613+0000 mgr.a (mgr.14388) 10624 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:17:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:59 smithi191 bash[24992]: audit 2024-08-31T06:16:58.309792+0000 mgr.a (mgr.14388) 10625 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:17:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:59 smithi191 bash[24992]: cephadm 2024-08-31T06:16:58.310983+0000 mgr.a (mgr.14388) 10626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:17:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:59 smithi191 bash[24992]: audit 2024-08-31T06:16:58.542536+0000 mgr.a (mgr.14388) 10627 : audit [DBG] from='client.234651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:16:59 smithi191 bash[24992]: cluster 2024-08-31T06:16:59.043360+0000 mgr.a (mgr.14388) 10628 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:17:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:59 smithi163 bash[24253]: audit 2024-08-31T06:16:58.309792+0000 mgr.a (mgr.14388) 10625 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:17:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:59 smithi163 bash[24253]: cephadm 2024-08-31T06:16:58.310983+0000 mgr.a (mgr.14388) 10626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:17:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:59 smithi163 bash[24253]: audit 2024-08-31T06:16:58.542536+0000 mgr.a (mgr.14388) 10627 : audit [DBG] from='client.234651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:00.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:16:59 smithi163 bash[24253]: cluster 2024-08-31T06:16:59.043360+0000 mgr.a (mgr.14388) 10628 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:17:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:59 smithi027 bash[22610]: audit 2024-08-31T06:16:58.309792+0000 mgr.a (mgr.14388) 10625 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:17:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:59 smithi027 bash[22610]: cephadm 2024-08-31T06:16:58.310983+0000 mgr.a (mgr.14388) 10626 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:17:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:59 smithi027 bash[22610]: audit 2024-08-31T06:16:58.542536+0000 mgr.a (mgr.14388) 10627 : audit [DBG] from='client.234651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:16:59 smithi027 bash[22610]: cluster 2024-08-31T06:16:59.043360+0000 mgr.a (mgr.14388) 10628 : cluster [DBG] pgmap v7366: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:17:01.395 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:01 smithi027 bash[22610]: cluster 2024-08-31T06:17:01.044053+0000 mgr.a (mgr.14388) 10629 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:17:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:01 smithi163 bash[24253]: cluster 2024-08-31T06:17:01.044053+0000 mgr.a (mgr.14388) 10629 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:17:01.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:01 smithi191 bash[24992]: cluster 2024-08-31T06:17:01.044053+0000 mgr.a (mgr.14388) 10629 : cluster [DBG] pgmap v7367: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:17:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:03 smithi163 bash[24253]: cluster 2024-08-31T06:17:03.045986+0000 mgr.a (mgr.14388) 10630 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:03 smithi027 bash[22610]: cluster 2024-08-31T06:17:03.045986+0000 mgr.a (mgr.14388) 10630 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:03 smithi191 bash[24992]: cluster 2024-08-31T06:17:03.045986+0000 mgr.a (mgr.14388) 10630 : cluster [DBG] pgmap v7368: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:03.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:17:03.969 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:17:03.969 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:17:04.714 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:17:04.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:17:04.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:17:04.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:17:04.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:17:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:05 smithi163 bash[24253]: audit 2024-08-31T06:17:04.302893+0000 mgr.a (mgr.14388) 10631 : audit [DBG] from='client.234729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:05 smithi163 bash[24253]: cluster 2024-08-31T06:17:05.046934+0000 mgr.a (mgr.14388) 10632 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:05 smithi027 bash[22610]: audit 2024-08-31T06:17:04.302893+0000 mgr.a (mgr.14388) 10631 : audit [DBG] from='client.234729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:05 smithi027 bash[22610]: cluster 2024-08-31T06:17:05.046934+0000 mgr.a (mgr.14388) 10632 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:05.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:05 smithi191 bash[24992]: audit 2024-08-31T06:17:04.302893+0000 mgr.a (mgr.14388) 10631 : audit [DBG] from='client.234729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:05.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:05 smithi191 bash[24992]: cluster 2024-08-31T06:17:05.046934+0000 mgr.a (mgr.14388) 10632 : cluster [DBG] pgmap v7369: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:07 smithi163 bash[24253]: cluster 2024-08-31T06:17:07.047734+0000 mgr.a (mgr.14388) 10633 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:07 smithi027 bash[22610]: cluster 2024-08-31T06:17:07.047734+0000 mgr.a (mgr.14388) 10633 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:07.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:07 smithi191 bash[24992]: cluster 2024-08-31T06:17:07.047734+0000 mgr.a (mgr.14388) 10633 : cluster [DBG] pgmap v7370: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:09 smithi163 bash[24253]: cluster 2024-08-31T06:17:09.049934+0000 mgr.a (mgr.14388) 10634 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:09.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:17:09.717 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:17:09.717 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:17:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:09 smithi027 bash[22610]: cluster 2024-08-31T06:17:09.049934+0000 mgr.a (mgr.14388) 10634 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:09 smithi191 bash[24992]: cluster 2024-08-31T06:17:09.049934+0000 mgr.a (mgr.14388) 10634 : cluster [DBG] pgmap v7371: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:10.498 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:17:10.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:17:10.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:17:10.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:17:10.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:17:10.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:10 smithi163 bash[24253]: audit 2024-08-31T06:17:10.053165+0000 mgr.a (mgr.14388) 10635 : audit [DBG] from='client.234807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:10 smithi027 bash[22610]: audit 2024-08-31T06:17:10.053165+0000 mgr.a (mgr.14388) 10635 : audit [DBG] from='client.234807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:10.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:10 smithi191 bash[24992]: audit 2024-08-31T06:17:10.053165+0000 mgr.a (mgr.14388) 10635 : audit [DBG] from='client.234807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:11 smithi163 bash[24253]: cluster 2024-08-31T06:17:11.051059+0000 mgr.a (mgr.14388) 10636 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:17:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:11 smithi027 bash[22610]: cluster 2024-08-31T06:17:11.051059+0000 mgr.a (mgr.14388) 10636 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:17:11.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:11 smithi191 bash[24992]: cluster 2024-08-31T06:17:11.051059+0000 mgr.a (mgr.14388) 10636 : cluster [DBG] pgmap v7372: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:17:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:13 smithi163 bash[24253]: cluster 2024-08-31T06:17:13.053381+0000 mgr.a (mgr.14388) 10637 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:13 smithi027 bash[22610]: cluster 2024-08-31T06:17:13.053381+0000 mgr.a (mgr.14388) 10637 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:13.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:13 smithi191 bash[24992]: cluster 2024-08-31T06:17:13.053381+0000 mgr.a (mgr.14388) 10637 : cluster [DBG] pgmap v7373: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:17:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:15 smithi163 bash[24253]: cluster 2024-08-31T06:17:15.054336+0000 mgr.a (mgr.14388) 10638 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:15 smithi027 bash[22610]: cluster 2024-08-31T06:17:15.054336+0000 mgr.a (mgr.14388) 10638 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:15.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:17:15.500 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:17:15.501 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:17:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:15 smithi191 bash[24992]: cluster 2024-08-31T06:17:15.054336+0000 mgr.a (mgr.14388) 10638 : cluster [DBG] pgmap v7374: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:16.289 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:17:16.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:17:16.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:17:16.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:17:16.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:17:16.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:16 smithi163 bash[24253]: audit 2024-08-31T06:17:15.838395+0000 mgr.a (mgr.14388) 10639 : audit [DBG] from='client.234876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:16 smithi027 bash[22610]: audit 2024-08-31T06:17:15.838395+0000 mgr.a (mgr.14388) 10639 : audit [DBG] from='client.234876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:16.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:16 smithi191 bash[24992]: audit 2024-08-31T06:17:15.838395+0000 mgr.a (mgr.14388) 10639 : audit [DBG] from='client.234876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:17 smithi163 bash[24253]: cluster 2024-08-31T06:17:17.055375+0000 mgr.a (mgr.14388) 10640 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:17 smithi027 bash[22610]: cluster 2024-08-31T06:17:17.055375+0000 mgr.a (mgr.14388) 10640 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:17.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:17 smithi191 bash[24992]: cluster 2024-08-31T06:17:17.055375+0000 mgr.a (mgr.14388) 10640 : cluster [DBG] pgmap v7375: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:19 smithi163 bash[24253]: cluster 2024-08-31T06:17:19.057595+0000 mgr.a (mgr.14388) 10641 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:19 smithi027 bash[22610]: cluster 2024-08-31T06:17:19.057595+0000 mgr.a (mgr.14388) 10641 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:19 smithi191 bash[24992]: cluster 2024-08-31T06:17:19.057595+0000 mgr.a (mgr.14388) 10641 : cluster [DBG] pgmap v7376: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:21.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:17:21.291 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:17:21.291 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:17:21.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:21 smithi163 bash[24253]: cluster 2024-08-31T06:17:21.058403+0000 mgr.a (mgr.14388) 10642 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:21 smithi027 bash[22610]: cluster 2024-08-31T06:17:21.058403+0000 mgr.a (mgr.14388) 10642 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:21.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:21 smithi191 bash[24992]: cluster 2024-08-31T06:17:21.058403+0000 mgr.a (mgr.14388) 10642 : cluster [DBG] pgmap v7377: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:22.040 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:17:22.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:17:22.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:17:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:17:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:17:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:22 smithi163 bash[24253]: audit 2024-08-31T06:17:21.622488+0000 mgr.a (mgr.14388) 10643 : audit [DBG] from='client.234951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:22 smithi027 bash[22610]: audit 2024-08-31T06:17:21.622488+0000 mgr.a (mgr.14388) 10643 : audit [DBG] from='client.234951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:22.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:22 smithi191 bash[24992]: audit 2024-08-31T06:17:21.622488+0000 mgr.a (mgr.14388) 10643 : audit [DBG] from='client.234951 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:23 smithi163 bash[24253]: cluster 2024-08-31T06:17:23.060715+0000 mgr.a (mgr.14388) 10644 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:23 smithi027 bash[22610]: cluster 2024-08-31T06:17:23.060715+0000 mgr.a (mgr.14388) 10644 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:23 smithi191 bash[24992]: cluster 2024-08-31T06:17:23.060715+0000 mgr.a (mgr.14388) 10644 : cluster [DBG] pgmap v7378: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:25 smithi163 bash[24253]: cluster 2024-08-31T06:17:25.061478+0000 mgr.a (mgr.14388) 10645 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:25 smithi027 bash[22610]: cluster 2024-08-31T06:17:25.061478+0000 mgr.a (mgr.14388) 10645 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:25 smithi191 bash[24992]: cluster 2024-08-31T06:17:25.061478+0000 mgr.a (mgr.14388) 10645 : cluster [DBG] pgmap v7379: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:27.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:17:27.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:17:27.043 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:17:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:27 smithi163 bash[24253]: cluster 2024-08-31T06:17:27.062047+0000 mgr.a (mgr.14388) 10646 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:27 smithi027 bash[22610]: cluster 2024-08-31T06:17:27.062047+0000 mgr.a (mgr.14388) 10646 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:27 smithi191 bash[24992]: cluster 2024-08-31T06:17:27.062047+0000 mgr.a (mgr.14388) 10646 : cluster [DBG] pgmap v7380: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:27.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:17:27.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:17:27.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:17:27.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:17:27.825 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:17:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:28 smithi163 bash[24253]: audit 2024-08-31T06:17:27.380738+0000 mgr.a (mgr.14388) 10647 : audit [DBG] from='client.235029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:28 smithi027 bash[22610]: audit 2024-08-31T06:17:27.380738+0000 mgr.a (mgr.14388) 10647 : audit [DBG] from='client.235029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:28.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:28 smithi191 bash[24992]: audit 2024-08-31T06:17:27.380738+0000 mgr.a (mgr.14388) 10647 : audit [DBG] from='client.235029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:29 smithi163 bash[24253]: cluster 2024-08-31T06:17:29.064326+0000 mgr.a (mgr.14388) 10648 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:29 smithi027 bash[22610]: cluster 2024-08-31T06:17:29.064326+0000 mgr.a (mgr.14388) 10648 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:29.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:29 smithi191 bash[24992]: cluster 2024-08-31T06:17:29.064326+0000 mgr.a (mgr.14388) 10648 : cluster [DBG] pgmap v7381: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:31.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:31 smithi163 bash[24253]: cluster 2024-08-31T06:17:31.065116+0000 mgr.a (mgr.14388) 10649 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:31 smithi027 bash[22610]: cluster 2024-08-31T06:17:31.065116+0000 mgr.a (mgr.14388) 10649 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:31.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:31 smithi191 bash[24992]: cluster 2024-08-31T06:17:31.065116+0000 mgr.a (mgr.14388) 10649 : cluster [DBG] pgmap v7382: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:32.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:17:32.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:17:32.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:17:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:33 smithi163 bash[24253]: cluster 2024-08-31T06:17:33.067026+0000 mgr.a (mgr.14388) 10650 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:33 smithi027 bash[22610]: cluster 2024-08-31T06:17:33.067026+0000 mgr.a (mgr.14388) 10650 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:33.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:33 smithi191 bash[24992]: cluster 2024-08-31T06:17:33.067026+0000 mgr.a (mgr.14388) 10650 : cluster [DBG] pgmap v7383: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:33.570 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:17:33.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:17:33.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:17:33.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:17:33.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:17:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:34 smithi163 bash[24253]: audit 2024-08-31T06:17:33.159748+0000 mgr.a (mgr.14388) 10651 : audit [DBG] from='client.235104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:34 smithi027 bash[22610]: audit 2024-08-31T06:17:33.159748+0000 mgr.a (mgr.14388) 10651 : audit [DBG] from='client.235104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:34 smithi191 bash[24992]: audit 2024-08-31T06:17:33.159748+0000 mgr.a (mgr.14388) 10651 : audit [DBG] from='client.235104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:35 smithi163 bash[24253]: cluster 2024-08-31T06:17:35.067903+0000 mgr.a (mgr.14388) 10652 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:17:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:35 smithi027 bash[22610]: cluster 2024-08-31T06:17:35.067903+0000 mgr.a (mgr.14388) 10652 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:17:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:35 smithi191 bash[24992]: cluster 2024-08-31T06:17:35.067903+0000 mgr.a (mgr.14388) 10652 : cluster [DBG] pgmap v7384: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:17:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:37 smithi163 bash[24253]: cluster 2024-08-31T06:17:37.068692+0000 mgr.a (mgr.14388) 10653 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:17:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:37 smithi027 bash[22610]: cluster 2024-08-31T06:17:37.068692+0000 mgr.a (mgr.14388) 10653 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:17:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:37 smithi191 bash[24992]: cluster 2024-08-31T06:17:37.068692+0000 mgr.a (mgr.14388) 10653 : cluster [DBG] pgmap v7385: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:17:38.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:17:38.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:17:38.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:17:39.358 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:17:39.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:17:39.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:17:39.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:17:39.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:17:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:39 smithi163 bash[24253]: audit 2024-08-31T06:17:38.910118+0000 mgr.a (mgr.14388) 10654 : audit [DBG] from='client.235182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:39 smithi163 bash[24253]: cluster 2024-08-31T06:17:39.070093+0000 mgr.a (mgr.14388) 10655 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:39 smithi027 bash[22610]: audit 2024-08-31T06:17:38.910118+0000 mgr.a (mgr.14388) 10654 : audit [DBG] from='client.235182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:39 smithi027 bash[22610]: cluster 2024-08-31T06:17:39.070093+0000 mgr.a (mgr.14388) 10655 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:39 smithi191 bash[24992]: audit 2024-08-31T06:17:38.910118+0000 mgr.a (mgr.14388) 10654 : audit [DBG] from='client.235182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:39 smithi191 bash[24992]: cluster 2024-08-31T06:17:39.070093+0000 mgr.a (mgr.14388) 10655 : cluster [DBG] pgmap v7386: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:41 smithi163 bash[24253]: cluster 2024-08-31T06:17:41.070998+0000 mgr.a (mgr.14388) 10656 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:17:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:41 smithi027 bash[22610]: cluster 2024-08-31T06:17:41.070998+0000 mgr.a (mgr.14388) 10656 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:17:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:41 smithi191 bash[24992]: cluster 2024-08-31T06:17:41.070998+0000 mgr.a (mgr.14388) 10656 : cluster [DBG] pgmap v7387: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:17:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:43 smithi163 bash[24253]: cluster 2024-08-31T06:17:43.073796+0000 mgr.a (mgr.14388) 10657 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:43 smithi027 bash[22610]: cluster 2024-08-31T06:17:43.073796+0000 mgr.a (mgr.14388) 10657 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:43.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:43 smithi191 bash[24992]: cluster 2024-08-31T06:17:43.073796+0000 mgr.a (mgr.14388) 10657 : cluster [DBG] pgmap v7388: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:44.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:17:44.360 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:17:44.363 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:17:45.106 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:17:45.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:17:45.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:17:45.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:17:45.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:17:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:45 smithi163 bash[24253]: audit 2024-08-31T06:17:44.680603+0000 mgr.a (mgr.14388) 10658 : audit [DBG] from='client.235257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:45 smithi163 bash[24253]: cluster 2024-08-31T06:17:45.074444+0000 mgr.a (mgr.14388) 10659 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:45 smithi027 bash[22610]: audit 2024-08-31T06:17:44.680603+0000 mgr.a (mgr.14388) 10658 : audit [DBG] from='client.235257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:45 smithi027 bash[22610]: cluster 2024-08-31T06:17:45.074444+0000 mgr.a (mgr.14388) 10659 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:45.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:45 smithi191 bash[24992]: audit 2024-08-31T06:17:44.680603+0000 mgr.a (mgr.14388) 10658 : audit [DBG] from='client.235257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:45.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:45 smithi191 bash[24992]: cluster 2024-08-31T06:17:45.074444+0000 mgr.a (mgr.14388) 10659 : cluster [DBG] pgmap v7389: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:47 smithi163 bash[24253]: cluster 2024-08-31T06:17:47.075223+0000 mgr.a (mgr.14388) 10660 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:47 smithi027 bash[22610]: cluster 2024-08-31T06:17:47.075223+0000 mgr.a (mgr.14388) 10660 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:47 smithi191 bash[24992]: cluster 2024-08-31T06:17:47.075223+0000 mgr.a (mgr.14388) 10660 : cluster [DBG] pgmap v7390: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:49 smithi163 bash[24253]: cluster 2024-08-31T06:17:49.077403+0000 mgr.a (mgr.14388) 10661 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:49 smithi027 bash[22610]: cluster 2024-08-31T06:17:49.077403+0000 mgr.a (mgr.14388) 10661 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:49.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:49 smithi191 bash[24992]: cluster 2024-08-31T06:17:49.077403+0000 mgr.a (mgr.14388) 10661 : cluster [DBG] pgmap v7391: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:50.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:17:50.109 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:17:50.109 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:17:50.865 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:17:50.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:17:50.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:17:50.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:17:50.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:17:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:51 smithi163 bash[24253]: audit 2024-08-31T06:17:50.438884+0000 mgr.a (mgr.14388) 10662 : audit [DBG] from='client.235335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:51 smithi163 bash[24253]: cluster 2024-08-31T06:17:51.078277+0000 mgr.a (mgr.14388) 10663 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:51 smithi027 bash[22610]: audit 2024-08-31T06:17:50.438884+0000 mgr.a (mgr.14388) 10662 : audit [DBG] from='client.235335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:51 smithi027 bash[22610]: cluster 2024-08-31T06:17:51.078277+0000 mgr.a (mgr.14388) 10663 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:51 smithi191 bash[24992]: audit 2024-08-31T06:17:50.438884+0000 mgr.a (mgr.14388) 10662 : audit [DBG] from='client.235335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:51 smithi191 bash[24992]: cluster 2024-08-31T06:17:51.078277+0000 mgr.a (mgr.14388) 10663 : cluster [DBG] pgmap v7392: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:53 smithi163 bash[24253]: cluster 2024-08-31T06:17:53.080470+0000 mgr.a (mgr.14388) 10664 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:53 smithi027 bash[22610]: cluster 2024-08-31T06:17:53.080470+0000 mgr.a (mgr.14388) 10664 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:53 smithi191 bash[24992]: cluster 2024-08-31T06:17:53.080470+0000 mgr.a (mgr.14388) 10664 : cluster [DBG] pgmap v7393: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:17:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:55 smithi163 bash[24253]: cluster 2024-08-31T06:17:55.081255+0000 mgr.a (mgr.14388) 10665 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:55 smithi027 bash[22610]: cluster 2024-08-31T06:17:55.081255+0000 mgr.a (mgr.14388) 10665 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:55.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:55 smithi191 bash[24992]: cluster 2024-08-31T06:17:55.081255+0000 mgr.a (mgr.14388) 10665 : cluster [DBG] pgmap v7394: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:55.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:17:55.867 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:17:55.867 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:17:56.614 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:17:56.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:17:56.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:17:56.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:17:56.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:17:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:57 smithi163 bash[24253]: audit 2024-08-31T06:17:56.195907+0000 mgr.a (mgr.14388) 10666 : audit [DBG] from='client.235413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:57 smithi163 bash[24253]: cluster 2024-08-31T06:17:57.082223+0000 mgr.a (mgr.14388) 10667 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:57 smithi027 bash[22610]: audit 2024-08-31T06:17:56.195907+0000 mgr.a (mgr.14388) 10666 : audit [DBG] from='client.235413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:57 smithi027 bash[22610]: cluster 2024-08-31T06:17:57.082223+0000 mgr.a (mgr.14388) 10667 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:57.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:57 smithi191 bash[24992]: audit 2024-08-31T06:17:56.195907+0000 mgr.a (mgr.14388) 10666 : audit [DBG] from='client.235413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:17:57.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:57 smithi191 bash[24992]: cluster 2024-08-31T06:17:57.082223+0000 mgr.a (mgr.14388) 10667 : cluster [DBG] pgmap v7395: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:17:58.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:17:58 smithi163 bash[24253]: audit 2024-08-31T06:17:58.360966+0000 mon.a (mon.0) 2176 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:17:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:17:58 smithi027 bash[22610]: audit 2024-08-31T06:17:58.360966+0000 mon.a (mon.0) 2176 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:17:58.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:17:58 smithi191 bash[24992]: audit 2024-08-31T06:17:58.360966+0000 mon.a (mon.0) 2176 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:18:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:00 smithi191 bash[24992]: audit 2024-08-31T06:17:59.002127+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:18:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:00 smithi191 bash[24992]: audit 2024-08-31T06:17:59.011666+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:18:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:00 smithi191 bash[24992]: cluster 2024-08-31T06:17:59.084403+0000 mgr.a (mgr.14388) 10668 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:00 smithi191 bash[24992]: audit 2024-08-31T06:17:59.812347+0000 mon.a (mon.0) 2179 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:18:00.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:00 smithi191 bash[24992]: audit 2024-08-31T06:17:59.813942+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:18:00.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:00 smithi191 bash[24992]: audit 2024-08-31T06:17:59.824567+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:18:00.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:00 smithi191 bash[24992]: audit 2024-08-31T06:17:59.829963+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:18:00.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:00 smithi163 bash[24253]: audit 2024-08-31T06:17:59.002127+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:18:00.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:00 smithi163 bash[24253]: audit 2024-08-31T06:17:59.011666+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:18:00.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:00 smithi163 bash[24253]: cluster 2024-08-31T06:17:59.084403+0000 mgr.a (mgr.14388) 10668 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:00.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:00 smithi163 bash[24253]: audit 2024-08-31T06:17:59.812347+0000 mon.a (mon.0) 2179 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:18:00.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:00 smithi163 bash[24253]: audit 2024-08-31T06:17:59.813942+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:18:00.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:00 smithi163 bash[24253]: audit 2024-08-31T06:17:59.824567+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:18:00.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:00 smithi163 bash[24253]: audit 2024-08-31T06:17:59.829963+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:18:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:00 smithi027 bash[22610]: audit 2024-08-31T06:17:59.002127+0000 mon.a (mon.0) 2177 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:18:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:00 smithi027 bash[22610]: audit 2024-08-31T06:17:59.011666+0000 mon.a (mon.0) 2178 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:18:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:00 smithi027 bash[22610]: cluster 2024-08-31T06:17:59.084403+0000 mgr.a (mgr.14388) 10668 : cluster [DBG] pgmap v7396: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:00 smithi027 bash[22610]: audit 2024-08-31T06:17:59.812347+0000 mon.a (mon.0) 2179 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:18:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:00 smithi027 bash[22610]: audit 2024-08-31T06:17:59.813942+0000 mon.a (mon.0) 2180 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:18:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:00 smithi027 bash[22610]: audit 2024-08-31T06:17:59.824567+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:18:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:00 smithi027 bash[22610]: audit 2024-08-31T06:17:59.829963+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:18:00.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:18:00 smithi027 bash[22863]: debug 2024-08-31T06:18:00.571+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:18:00.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:18:00 smithi027 bash[22863]: debug 2024-08-31T06:18:00.575+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:18:01.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:01 smithi191 bash[24992]: audit 2024-08-31T06:17:59.832299+0000 mgr.a (mgr.14388) 10669 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:18:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:01 smithi163 bash[24253]: audit 2024-08-31T06:17:59.832299+0000 mgr.a (mgr.14388) 10669 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:18:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:01 smithi027 bash[22610]: audit 2024-08-31T06:17:59.832299+0000 mgr.a (mgr.14388) 10669 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:18:01.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:01.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:01.617 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:18:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:02 smithi191 bash[24992]: audit 2024-08-31T06:18:00.577869+0000 mgr.a (mgr.14388) 10670 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:18:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:02 smithi191 bash[24992]: cephadm 2024-08-31T06:18:00.579032+0000 mgr.a (mgr.14388) 10671 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:18:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:02 smithi191 bash[24992]: cluster 2024-08-31T06:18:01.085335+0000 mgr.a (mgr.14388) 10672 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:02.361 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:18:02.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:18:02.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:18:02.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:18:02.362 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:18:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:02 smithi163 bash[24253]: audit 2024-08-31T06:18:00.577869+0000 mgr.a (mgr.14388) 10670 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:18:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:02 smithi163 bash[24253]: cephadm 2024-08-31T06:18:00.579032+0000 mgr.a (mgr.14388) 10671 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:18:02.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:02 smithi163 bash[24253]: cluster 2024-08-31T06:18:01.085335+0000 mgr.a (mgr.14388) 10672 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:02.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:02 smithi027 bash[22610]: audit 2024-08-31T06:18:00.577869+0000 mgr.a (mgr.14388) 10670 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:18:02.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:02 smithi027 bash[22610]: cephadm 2024-08-31T06:18:00.579032+0000 mgr.a (mgr.14388) 10671 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:18:02.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:02 smithi027 bash[22610]: cluster 2024-08-31T06:18:01.085335+0000 mgr.a (mgr.14388) 10672 : cluster [DBG] pgmap v7397: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:03.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:03 smithi191 bash[24992]: audit 2024-08-31T06:18:01.946127+0000 mgr.a (mgr.14388) 10673 : audit [DBG] from='client.235599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:03 smithi163 bash[24253]: audit 2024-08-31T06:18:01.946127+0000 mgr.a (mgr.14388) 10673 : audit [DBG] from='client.235599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:03 smithi027 bash[22610]: audit 2024-08-31T06:18:01.946127+0000 mgr.a (mgr.14388) 10673 : audit [DBG] from='client.235599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:04 smithi191 bash[24992]: cluster 2024-08-31T06:18:03.087723+0000 mgr.a (mgr.14388) 10674 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:04.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:04 smithi163 bash[24253]: cluster 2024-08-31T06:18:03.087723+0000 mgr.a (mgr.14388) 10674 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:04 smithi027 bash[22610]: cluster 2024-08-31T06:18:03.087723+0000 mgr.a (mgr.14388) 10674 : cluster [DBG] pgmap v7398: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:05 smithi163 bash[24253]: cluster 2024-08-31T06:18:05.088497+0000 mgr.a (mgr.14388) 10675 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:05 smithi027 bash[22610]: cluster 2024-08-31T06:18:05.088497+0000 mgr.a (mgr.14388) 10675 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:05.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:05 smithi191 bash[24992]: cluster 2024-08-31T06:18:05.088497+0000 mgr.a (mgr.14388) 10675 : cluster [DBG] pgmap v7399: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:07.363 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:07.364 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:07.364 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:18:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:07 smithi163 bash[24253]: cluster 2024-08-31T06:18:07.089277+0000 mgr.a (mgr.14388) 10676 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:07 smithi027 bash[22610]: cluster 2024-08-31T06:18:07.089277+0000 mgr.a (mgr.14388) 10676 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:07.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:07 smithi191 bash[24992]: cluster 2024-08-31T06:18:07.089277+0000 mgr.a (mgr.14388) 10676 : cluster [DBG] pgmap v7400: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:08.136 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:18:08.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:18:08.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:18:08.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:18:08.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:18:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:08 smithi163 bash[24253]: audit 2024-08-31T06:18:07.696860+0000 mgr.a (mgr.14388) 10677 : audit [DBG] from='client.235677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:08 smithi027 bash[22610]: audit 2024-08-31T06:18:07.696860+0000 mgr.a (mgr.14388) 10677 : audit [DBG] from='client.235677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:08.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:08 smithi191 bash[24992]: audit 2024-08-31T06:18:07.696860+0000 mgr.a (mgr.14388) 10677 : audit [DBG] from='client.235677 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:09.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:09 smithi163 bash[24253]: cluster 2024-08-31T06:18:09.092041+0000 mgr.a (mgr.14388) 10678 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:09 smithi027 bash[22610]: cluster 2024-08-31T06:18:09.092041+0000 mgr.a (mgr.14388) 10678 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:09.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:09 smithi191 bash[24992]: cluster 2024-08-31T06:18:09.092041+0000 mgr.a (mgr.14388) 10678 : cluster [DBG] pgmap v7401: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:11 smithi163 bash[24253]: cluster 2024-08-31T06:18:11.092971+0000 mgr.a (mgr.14388) 10679 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:18:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:11 smithi027 bash[22610]: cluster 2024-08-31T06:18:11.092971+0000 mgr.a (mgr.14388) 10679 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:18:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:11 smithi191 bash[24992]: cluster 2024-08-31T06:18:11.092971+0000 mgr.a (mgr.14388) 10679 : cluster [DBG] pgmap v7402: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:18:13.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:13.139 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:13.139 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:18:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:13 smithi163 bash[24253]: cluster 2024-08-31T06:18:13.095064+0000 mgr.a (mgr.14388) 10680 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:13 smithi027 bash[22610]: cluster 2024-08-31T06:18:13.095064+0000 mgr.a (mgr.14388) 10680 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:13.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:13 smithi191 bash[24992]: cluster 2024-08-31T06:18:13.095064+0000 mgr.a (mgr.14388) 10680 : cluster [DBG] pgmap v7403: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:18:13.879 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:18:13.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:18:13.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:18:13.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:18:13.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:18:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:14 smithi163 bash[24253]: audit 2024-08-31T06:18:13.468834+0000 mgr.a (mgr.14388) 10681 : audit [DBG] from='client.235755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:14 smithi027 bash[22610]: audit 2024-08-31T06:18:13.468834+0000 mgr.a (mgr.14388) 10681 : audit [DBG] from='client.235755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:14.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:14 smithi191 bash[24992]: audit 2024-08-31T06:18:13.468834+0000 mgr.a (mgr.14388) 10681 : audit [DBG] from='client.235755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:15 smithi163 bash[24253]: cluster 2024-08-31T06:18:15.095924+0000 mgr.a (mgr.14388) 10682 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:18:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:15 smithi027 bash[22610]: cluster 2024-08-31T06:18:15.095924+0000 mgr.a (mgr.14388) 10682 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:18:15.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:15 smithi191 bash[24992]: cluster 2024-08-31T06:18:15.095924+0000 mgr.a (mgr.14388) 10682 : cluster [DBG] pgmap v7404: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:18:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:17 smithi163 bash[24253]: cluster 2024-08-31T06:18:17.096731+0000 mgr.a (mgr.14388) 10683 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:18:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:17 smithi027 bash[22610]: cluster 2024-08-31T06:18:17.096731+0000 mgr.a (mgr.14388) 10683 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:18:17.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:17 smithi191 bash[24992]: cluster 2024-08-31T06:18:17.096731+0000 mgr.a (mgr.14388) 10683 : cluster [DBG] pgmap v7405: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:18:18.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:18.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:18.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:18:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:19 smithi163 bash[24253]: cluster 2024-08-31T06:18:19.098877+0000 mgr.a (mgr.14388) 10684 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:19 smithi027 bash[22610]: cluster 2024-08-31T06:18:19.098877+0000 mgr.a (mgr.14388) 10684 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:19 smithi191 bash[24992]: cluster 2024-08-31T06:18:19.098877+0000 mgr.a (mgr.14388) 10684 : cluster [DBG] pgmap v7406: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:19.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:18:19.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:18:19.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:18:19.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:18:19.659 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:18:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:20 smithi163 bash[24253]: audit 2024-08-31T06:18:19.220614+0000 mgr.a (mgr.14388) 10685 : audit [DBG] from='client.235833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:20 smithi027 bash[22610]: audit 2024-08-31T06:18:19.220614+0000 mgr.a (mgr.14388) 10685 : audit [DBG] from='client.235833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:20.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:20 smithi191 bash[24992]: audit 2024-08-31T06:18:19.220614+0000 mgr.a (mgr.14388) 10685 : audit [DBG] from='client.235833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:21 smithi163 bash[24253]: cluster 2024-08-31T06:18:21.099776+0000 mgr.a (mgr.14388) 10686 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:21 smithi027 bash[22610]: cluster 2024-08-31T06:18:21.099776+0000 mgr.a (mgr.14388) 10686 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:21.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:21 smithi191 bash[24992]: cluster 2024-08-31T06:18:21.099776+0000 mgr.a (mgr.14388) 10686 : cluster [DBG] pgmap v7407: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:24 smithi163 bash[24253]: cluster 2024-08-31T06:18:23.101959+0000 mgr.a (mgr.14388) 10687 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:24 smithi027 bash[22610]: cluster 2024-08-31T06:18:23.101959+0000 mgr.a (mgr.14388) 10687 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:24.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:24 smithi191 bash[24992]: cluster 2024-08-31T06:18:23.101959+0000 mgr.a (mgr.14388) 10687 : cluster [DBG] pgmap v7408: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:24.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:24.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:24.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:18:25.421 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:18:25.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:18:25.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:18:25.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:18:25.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:18:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:25 smithi163 bash[24253]: audit 2024-08-31T06:18:24.992935+0000 mgr.a (mgr.14388) 10688 : audit [DBG] from='client.235911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:25 smithi027 bash[22610]: audit 2024-08-31T06:18:24.992935+0000 mgr.a (mgr.14388) 10688 : audit [DBG] from='client.235911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:25 smithi191 bash[24992]: audit 2024-08-31T06:18:24.992935+0000 mgr.a (mgr.14388) 10688 : audit [DBG] from='client.235911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:26 smithi163 bash[24253]: cluster 2024-08-31T06:18:25.102503+0000 mgr.a (mgr.14388) 10689 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:26 smithi027 bash[22610]: cluster 2024-08-31T06:18:25.102503+0000 mgr.a (mgr.14388) 10689 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:26 smithi191 bash[24992]: cluster 2024-08-31T06:18:25.102503+0000 mgr.a (mgr.14388) 10689 : cluster [DBG] pgmap v7409: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:28 smithi163 bash[24253]: cluster 2024-08-31T06:18:27.103343+0000 mgr.a (mgr.14388) 10690 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:28 smithi027 bash[22610]: cluster 2024-08-31T06:18:27.103343+0000 mgr.a (mgr.14388) 10690 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:28.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:28 smithi191 bash[24992]: cluster 2024-08-31T06:18:27.103343+0000 mgr.a (mgr.14388) 10690 : cluster [DBG] pgmap v7410: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:30.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:30.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:30.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:18:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:30 smithi163 bash[24253]: cluster 2024-08-31T06:18:29.105570+0000 mgr.a (mgr.14388) 10691 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:30 smithi027 bash[22610]: cluster 2024-08-31T06:18:29.105570+0000 mgr.a (mgr.14388) 10691 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:30 smithi191 bash[24992]: cluster 2024-08-31T06:18:29.105570+0000 mgr.a (mgr.14388) 10691 : cluster [DBG] pgmap v7411: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:31.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:18:31.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:18:31.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:18:31.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:18:31.195 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:18:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:31 smithi163 bash[24253]: audit 2024-08-31T06:18:30.758281+0000 mgr.a (mgr.14388) 10692 : audit [DBG] from='client.235989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:31 smithi027 bash[22610]: audit 2024-08-31T06:18:30.758281+0000 mgr.a (mgr.14388) 10692 : audit [DBG] from='client.235989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:31 smithi191 bash[24992]: audit 2024-08-31T06:18:30.758281+0000 mgr.a (mgr.14388) 10692 : audit [DBG] from='client.235989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:32.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:32 smithi163 bash[24253]: cluster 2024-08-31T06:18:31.106110+0000 mgr.a (mgr.14388) 10693 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:32 smithi027 bash[22610]: cluster 2024-08-31T06:18:31.106110+0000 mgr.a (mgr.14388) 10693 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:32.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:32 smithi191 bash[24992]: cluster 2024-08-31T06:18:31.106110+0000 mgr.a (mgr.14388) 10693 : cluster [DBG] pgmap v7412: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:34 smithi163 bash[24253]: cluster 2024-08-31T06:18:33.108250+0000 mgr.a (mgr.14388) 10694 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:34 smithi027 bash[22610]: cluster 2024-08-31T06:18:33.108250+0000 mgr.a (mgr.14388) 10694 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:34 smithi191 bash[24992]: cluster 2024-08-31T06:18:33.108250+0000 mgr.a (mgr.14388) 10694 : cluster [DBG] pgmap v7413: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:36.197 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:18:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:36 smithi163 bash[24253]: cluster 2024-08-31T06:18:35.109041+0000 mgr.a (mgr.14388) 10695 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:36 smithi027 bash[22610]: cluster 2024-08-31T06:18:35.109041+0000 mgr.a (mgr.14388) 10695 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:36.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:36 smithi191 bash[24992]: cluster 2024-08-31T06:18:35.109041+0000 mgr.a (mgr.14388) 10695 : cluster [DBG] pgmap v7414: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:36.981 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:18:36.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:18:36.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:18:36.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:18:36.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:18:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:37 smithi027 bash[22610]: audit 2024-08-31T06:18:36.529021+0000 mgr.a (mgr.14388) 10696 : audit [DBG] from='client.236067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:37 smithi191 bash[24992]: audit 2024-08-31T06:18:36.529021+0000 mgr.a (mgr.14388) 10696 : audit [DBG] from='client.236067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:37 smithi163 bash[24253]: audit 2024-08-31T06:18:36.529021+0000 mgr.a (mgr.14388) 10696 : audit [DBG] from='client.236067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:38 smithi027 bash[22610]: cluster 2024-08-31T06:18:37.110019+0000 mgr.a (mgr.14388) 10697 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:38.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:38 smithi191 bash[24992]: cluster 2024-08-31T06:18:37.110019+0000 mgr.a (mgr.14388) 10697 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:38 smithi163 bash[24253]: cluster 2024-08-31T06:18:37.110019+0000 mgr.a (mgr.14388) 10697 : cluster [DBG] pgmap v7415: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:40 smithi027 bash[22610]: cluster 2024-08-31T06:18:39.112318+0000 mgr.a (mgr.14388) 10698 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:40.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:40 smithi191 bash[24992]: cluster 2024-08-31T06:18:39.112318+0000 mgr.a (mgr.14388) 10698 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:40 smithi163 bash[24253]: cluster 2024-08-31T06:18:39.112318+0000 mgr.a (mgr.14388) 10698 : cluster [DBG] pgmap v7416: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:41.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:41.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:18:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:42 smithi027 bash[22610]: cluster 2024-08-31T06:18:41.113086+0000 mgr.a (mgr.14388) 10699 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:42.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:42 smithi191 bash[24992]: cluster 2024-08-31T06:18:41.113086+0000 mgr.a (mgr.14388) 10699 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:42 smithi163 bash[24253]: cluster 2024-08-31T06:18:41.113086+0000 mgr.a (mgr.14388) 10699 : cluster [DBG] pgmap v7417: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:42.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:18:42.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:18:42.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:18:42.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:18:42.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:18:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:43 smithi027 bash[22610]: audit 2024-08-31T06:18:42.310768+0000 mgr.a (mgr.14388) 10700 : audit [DBG] from='client.236142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:43.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:43 smithi191 bash[24992]: audit 2024-08-31T06:18:42.310768+0000 mgr.a (mgr.14388) 10700 : audit [DBG] from='client.236142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:43 smithi163 bash[24253]: audit 2024-08-31T06:18:42.310768+0000 mgr.a (mgr.14388) 10700 : audit [DBG] from='client.236142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:44 smithi027 bash[22610]: cluster 2024-08-31T06:18:43.115292+0000 mgr.a (mgr.14388) 10701 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:44.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:44 smithi191 bash[24992]: cluster 2024-08-31T06:18:43.115292+0000 mgr.a (mgr.14388) 10701 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:44.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:44 smithi163 bash[24253]: cluster 2024-08-31T06:18:43.115292+0000 mgr.a (mgr.14388) 10701 : cluster [DBG] pgmap v7418: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:18:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:46 smithi027 bash[22610]: cluster 2024-08-31T06:18:45.116045+0000 mgr.a (mgr.14388) 10702 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:46.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:46 smithi191 bash[24992]: cluster 2024-08-31T06:18:45.116045+0000 mgr.a (mgr.14388) 10702 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:46 smithi163 bash[24253]: cluster 2024-08-31T06:18:45.116045+0000 mgr.a (mgr.14388) 10702 : cluster [DBG] pgmap v7419: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:47.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:47.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:47.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:18:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:48 smithi027 bash[22610]: cluster 2024-08-31T06:18:47.116806+0000 mgr.a (mgr.14388) 10703 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:48 smithi027 bash[22610]: audit 2024-08-31T06:18:48.057256+0000 mgr.a (mgr.14388) 10704 : audit [DBG] from='client.236220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:48.490 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:18:48.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:18:48.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:18:48.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:18:48.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:18:48.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:48 smithi191 bash[24992]: cluster 2024-08-31T06:18:47.116806+0000 mgr.a (mgr.14388) 10703 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:48.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:48 smithi191 bash[24992]: audit 2024-08-31T06:18:48.057256+0000 mgr.a (mgr.14388) 10704 : audit [DBG] from='client.236220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:48 smithi163 bash[24253]: cluster 2024-08-31T06:18:47.116806+0000 mgr.a (mgr.14388) 10703 : cluster [DBG] pgmap v7420: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:48.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:48 smithi163 bash[24253]: audit 2024-08-31T06:18:48.057256+0000 mgr.a (mgr.14388) 10704 : audit [DBG] from='client.236220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:50.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:50 smithi191 bash[24992]: cluster 2024-08-31T06:18:49.119553+0000 mgr.a (mgr.14388) 10705 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:50.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:50 smithi163 bash[24253]: cluster 2024-08-31T06:18:49.119553+0000 mgr.a (mgr.14388) 10705 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:50 smithi027 bash[22610]: cluster 2024-08-31T06:18:49.119553+0000 mgr.a (mgr.14388) 10705 : cluster [DBG] pgmap v7421: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:52.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:52 smithi191 bash[24992]: cluster 2024-08-31T06:18:51.120369+0000 mgr.a (mgr.14388) 10706 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:18:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:52 smithi163 bash[24253]: cluster 2024-08-31T06:18:51.120369+0000 mgr.a (mgr.14388) 10706 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:18:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:52 smithi027 bash[22610]: cluster 2024-08-31T06:18:51.120369+0000 mgr.a (mgr.14388) 10706 : cluster [DBG] pgmap v7422: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:18:53.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:53.492 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:53.493 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:18:54.239 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:18:54.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:18:54.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:18:54.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:18:54.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:18:54.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:54 smithi191 bash[24992]: cluster 2024-08-31T06:18:53.122321+0000 mgr.a (mgr.14388) 10707 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:54.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:54 smithi191 bash[24992]: audit 2024-08-31T06:18:53.823728+0000 mgr.a (mgr.14388) 10708 : audit [DBG] from='client.236298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:54 smithi163 bash[24253]: cluster 2024-08-31T06:18:53.122321+0000 mgr.a (mgr.14388) 10707 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:54 smithi163 bash[24253]: audit 2024-08-31T06:18:53.823728+0000 mgr.a (mgr.14388) 10708 : audit [DBG] from='client.236298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:54 smithi027 bash[22610]: cluster 2024-08-31T06:18:53.122321+0000 mgr.a (mgr.14388) 10707 : cluster [DBG] pgmap v7423: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:18:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:54 smithi027 bash[22610]: audit 2024-08-31T06:18:53.823728+0000 mgr.a (mgr.14388) 10708 : audit [DBG] from='client.236298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:18:56.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:56 smithi191 bash[24992]: cluster 2024-08-31T06:18:55.123249+0000 mgr.a (mgr.14388) 10709 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:18:56.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:56 smithi163 bash[24253]: cluster 2024-08-31T06:18:55.123249+0000 mgr.a (mgr.14388) 10709 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:18:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:56 smithi027 bash[22610]: cluster 2024-08-31T06:18:55.123249+0000 mgr.a (mgr.14388) 10709 : cluster [DBG] pgmap v7424: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:18:58.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:18:58 smithi191 bash[24992]: cluster 2024-08-31T06:18:57.124163+0000 mgr.a (mgr.14388) 10710 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:18:58.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:18:58 smithi163 bash[24253]: cluster 2024-08-31T06:18:57.124163+0000 mgr.a (mgr.14388) 10710 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:18:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:18:58 smithi027 bash[22610]: cluster 2024-08-31T06:18:57.124163+0000 mgr.a (mgr.14388) 10710 : cluster [DBG] pgmap v7425: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:18:59.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:18:59.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:18:59.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:00.005 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:00.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:00.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:00.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:00.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:00.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:00 smithi191 bash[24992]: cluster 2024-08-31T06:18:59.126507+0000 mgr.a (mgr.14388) 10711 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:00.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:00 smithi191 bash[24992]: audit 2024-08-31T06:18:59.581505+0000 mgr.a (mgr.14388) 10712 : audit [DBG] from='client.236376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:00 smithi163 bash[24253]: cluster 2024-08-31T06:18:59.126507+0000 mgr.a (mgr.14388) 10711 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:00 smithi163 bash[24253]: audit 2024-08-31T06:18:59.581505+0000 mgr.a (mgr.14388) 10712 : audit [DBG] from='client.236376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:00 smithi027 bash[22610]: cluster 2024-08-31T06:18:59.126507+0000 mgr.a (mgr.14388) 10711 : cluster [DBG] pgmap v7426: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:00 smithi027 bash[22610]: audit 2024-08-31T06:18:59.581505+0000 mgr.a (mgr.14388) 10712 : audit [DBG] from='client.236376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:01.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:01 smithi191 bash[24992]: audit 2024-08-31T06:19:00.632165+0000 mon.a (mon.0) 2183 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:19:01.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:01 smithi191 bash[24992]: audit 2024-08-31T06:19:01.246065+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:01.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:01 smithi191 bash[24992]: audit 2024-08-31T06:19:01.252390+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:01.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:01 smithi163 bash[24253]: audit 2024-08-31T06:19:00.632165+0000 mon.a (mon.0) 2183 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:19:01.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:01 smithi163 bash[24253]: audit 2024-08-31T06:19:01.246065+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:01.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:01 smithi163 bash[24253]: audit 2024-08-31T06:19:01.252390+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:01 smithi027 bash[22610]: audit 2024-08-31T06:19:00.632165+0000 mon.a (mon.0) 2183 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:19:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:01 smithi027 bash[22610]: audit 2024-08-31T06:19:01.246065+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:01 smithi027 bash[22610]: audit 2024-08-31T06:19:01.252390+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:02.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:02 smithi191 bash[24992]: cluster 2024-08-31T06:19:01.127395+0000 mgr.a (mgr.14388) 10713 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:02.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:02 smithi191 bash[24992]: audit 2024-08-31T06:19:01.258516+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:02.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:02 smithi191 bash[24992]: audit 2024-08-31T06:19:01.264733+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:02.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:02 smithi191 bash[24992]: audit 2024-08-31T06:19:02.080035+0000 mon.a (mon.0) 2188 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:19:02.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:02 smithi191 bash[24992]: audit 2024-08-31T06:19:02.081514+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:19:02.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:02 smithi191 bash[24992]: audit 2024-08-31T06:19:02.091911+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:02.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:02 smithi191 bash[24992]: audit 2024-08-31T06:19:02.097393+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:19:02.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:02 smithi191 bash[24992]: audit 2024-08-31T06:19:02.099895+0000 mgr.a (mgr.14388) 10714 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:19:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:02 smithi163 bash[24253]: cluster 2024-08-31T06:19:01.127395+0000 mgr.a (mgr.14388) 10713 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:02 smithi163 bash[24253]: audit 2024-08-31T06:19:01.258516+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:02.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:02 smithi163 bash[24253]: audit 2024-08-31T06:19:01.264733+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:02.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:02 smithi163 bash[24253]: audit 2024-08-31T06:19:02.080035+0000 mon.a (mon.0) 2188 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:19:02.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:02 smithi163 bash[24253]: audit 2024-08-31T06:19:02.081514+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:19:02.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:02 smithi163 bash[24253]: audit 2024-08-31T06:19:02.091911+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:02.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:02 smithi163 bash[24253]: audit 2024-08-31T06:19:02.097393+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:19:02.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:02 smithi163 bash[24253]: audit 2024-08-31T06:19:02.099895+0000 mgr.a (mgr.14388) 10714 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:19:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:02 smithi027 bash[22610]: cluster 2024-08-31T06:19:01.127395+0000 mgr.a (mgr.14388) 10713 : cluster [DBG] pgmap v7427: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:02 smithi027 bash[22610]: audit 2024-08-31T06:19:01.258516+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:02 smithi027 bash[22610]: audit 2024-08-31T06:19:01.264733+0000 mon.a (mon.0) 2187 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:02 smithi027 bash[22610]: audit 2024-08-31T06:19:02.080035+0000 mon.a (mon.0) 2188 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:19:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:02 smithi027 bash[22610]: audit 2024-08-31T06:19:02.081514+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:19:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:02 smithi027 bash[22610]: audit 2024-08-31T06:19:02.091911+0000 mon.a (mon.0) 2190 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:19:02.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:02 smithi027 bash[22610]: audit 2024-08-31T06:19:02.097393+0000 mon.a (mon.0) 2191 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:19:02.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:02 smithi027 bash[22610]: audit 2024-08-31T06:19:02.099895+0000 mgr.a (mgr.14388) 10714 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:19:03.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:19:02 smithi027 bash[22863]: debug 2024-08-31T06:19:02.830+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:19:03.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:19:02 smithi027 bash[22863]: debug 2024-08-31T06:19:02.834+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:19:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:03 smithi191 bash[24992]: audit 2024-08-31T06:19:02.834292+0000 mgr.a (mgr.14388) 10715 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:19:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:03 smithi191 bash[24992]: cephadm 2024-08-31T06:19:02.835838+0000 mgr.a (mgr.14388) 10716 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:19:03.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:03 smithi163 bash[24253]: audit 2024-08-31T06:19:02.834292+0000 mgr.a (mgr.14388) 10715 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:19:03.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:03 smithi163 bash[24253]: cephadm 2024-08-31T06:19:02.835838+0000 mgr.a (mgr.14388) 10716 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:19:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:03 smithi027 bash[22610]: audit 2024-08-31T06:19:02.834292+0000 mgr.a (mgr.14388) 10715 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:19:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:03 smithi027 bash[22610]: cephadm 2024-08-31T06:19:02.835838+0000 mgr.a (mgr.14388) 10716 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:19:04.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:04 smithi191 bash[24992]: cluster 2024-08-31T06:19:03.129692+0000 mgr.a (mgr.14388) 10717 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:04.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:04 smithi163 bash[24253]: cluster 2024-08-31T06:19:03.129692+0000 mgr.a (mgr.14388) 10717 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:04.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:04 smithi027 bash[22610]: cluster 2024-08-31T06:19:03.129692+0000 mgr.a (mgr.14388) 10717 : cluster [DBG] pgmap v7428: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:05.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:19:05.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:19:05.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:05.758 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:05.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:05.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:05.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:05.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:06.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:06 smithi191 bash[24992]: cluster 2024-08-31T06:19:05.130135+0000 mgr.a (mgr.14388) 10718 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:06.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:06 smithi191 bash[24992]: audit 2024-08-31T06:19:05.340464+0000 mgr.a (mgr.14388) 10719 : audit [DBG] from='client.236559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:06.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:06 smithi163 bash[24253]: cluster 2024-08-31T06:19:05.130135+0000 mgr.a (mgr.14388) 10718 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:06.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:06 smithi163 bash[24253]: audit 2024-08-31T06:19:05.340464+0000 mgr.a (mgr.14388) 10719 : audit [DBG] from='client.236559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:06 smithi027 bash[22610]: cluster 2024-08-31T06:19:05.130135+0000 mgr.a (mgr.14388) 10718 : cluster [DBG] pgmap v7429: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:06 smithi027 bash[22610]: audit 2024-08-31T06:19:05.340464+0000 mgr.a (mgr.14388) 10719 : audit [DBG] from='client.236559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:08 smithi163 bash[24253]: cluster 2024-08-31T06:19:07.131020+0000 mgr.a (mgr.14388) 10720 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:08.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:08 smithi027 bash[22610]: cluster 2024-08-31T06:19:07.131020+0000 mgr.a (mgr.14388) 10720 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:08.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:08 smithi191 bash[24992]: cluster 2024-08-31T06:19:07.131020+0000 mgr.a (mgr.14388) 10720 : cluster [DBG] pgmap v7430: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:10.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:10 smithi163 bash[24253]: cluster 2024-08-31T06:19:09.133346+0000 mgr.a (mgr.14388) 10721 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:10 smithi027 bash[22610]: cluster 2024-08-31T06:19:09.133346+0000 mgr.a (mgr.14388) 10721 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:10.760 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:19:10.761 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:19:10.761 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:10.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:10 smithi191 bash[24992]: cluster 2024-08-31T06:19:09.133346+0000 mgr.a (mgr.14388) 10721 : cluster [DBG] pgmap v7431: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:11.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:11.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:11.518 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:11 smithi163 bash[24253]: audit 2024-08-31T06:19:11.090312+0000 mgr.a (mgr.14388) 10722 : audit [DBG] from='client.236634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:11 smithi027 bash[22610]: audit 2024-08-31T06:19:11.090312+0000 mgr.a (mgr.14388) 10722 : audit [DBG] from='client.236634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:11.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:11 smithi191 bash[24992]: audit 2024-08-31T06:19:11.090312+0000 mgr.a (mgr.14388) 10722 : audit [DBG] from='client.236634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:12 smithi163 bash[24253]: cluster 2024-08-31T06:19:11.134356+0000 mgr.a (mgr.14388) 10723 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:12 smithi027 bash[22610]: cluster 2024-08-31T06:19:11.134356+0000 mgr.a (mgr.14388) 10723 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:12.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:12 smithi191 bash[24992]: cluster 2024-08-31T06:19:11.134356+0000 mgr.a (mgr.14388) 10723 : cluster [DBG] pgmap v7432: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:14 smithi163 bash[24253]: cluster 2024-08-31T06:19:13.136633+0000 mgr.a (mgr.14388) 10724 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:14 smithi027 bash[22610]: cluster 2024-08-31T06:19:13.136633+0000 mgr.a (mgr.14388) 10724 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:14.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:14 smithi191 bash[24992]: cluster 2024-08-31T06:19:13.136633+0000 mgr.a (mgr.14388) 10724 : cluster [DBG] pgmap v7433: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:19:16.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:19:16.520 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:19:16.520 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:16.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:16 smithi163 bash[24253]: cluster 2024-08-31T06:19:15.137405+0000 mgr.a (mgr.14388) 10725 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:16.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:16 smithi027 bash[22610]: cluster 2024-08-31T06:19:15.137405+0000 mgr.a (mgr.14388) 10725 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:16.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:16 smithi191 bash[24992]: cluster 2024-08-31T06:19:15.137405+0000 mgr.a (mgr.14388) 10725 : cluster [DBG] pgmap v7434: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:17.270 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:17.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:17.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:17.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:17.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:17 smithi163 bash[24253]: audit 2024-08-31T06:19:16.850680+0000 mgr.a (mgr.14388) 10726 : audit [DBG] from='client.236712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:17.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:17 smithi027 bash[22610]: audit 2024-08-31T06:19:16.850680+0000 mgr.a (mgr.14388) 10726 : audit [DBG] from='client.236712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:17.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:17 smithi191 bash[24992]: audit 2024-08-31T06:19:16.850680+0000 mgr.a (mgr.14388) 10726 : audit [DBG] from='client.236712 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:18 smithi163 bash[24253]: cluster 2024-08-31T06:19:17.137974+0000 mgr.a (mgr.14388) 10727 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:18 smithi027 bash[22610]: cluster 2024-08-31T06:19:17.137974+0000 mgr.a (mgr.14388) 10727 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:18.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:18 smithi191 bash[24992]: cluster 2024-08-31T06:19:17.137974+0000 mgr.a (mgr.14388) 10727 : cluster [DBG] pgmap v7435: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:20 smithi163 bash[24253]: cluster 2024-08-31T06:19:19.140437+0000 mgr.a (mgr.14388) 10728 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:20 smithi027 bash[22610]: cluster 2024-08-31T06:19:19.140437+0000 mgr.a (mgr.14388) 10728 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:20.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:20 smithi191 bash[24992]: cluster 2024-08-31T06:19:19.140437+0000 mgr.a (mgr.14388) 10728 : cluster [DBG] pgmap v7436: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:22.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:19:22.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:19:22.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:22 smithi163 bash[24253]: cluster 2024-08-31T06:19:21.141241+0000 mgr.a (mgr.14388) 10729 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:22 smithi027 bash[22610]: cluster 2024-08-31T06:19:21.141241+0000 mgr.a (mgr.14388) 10729 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:22.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:22 smithi191 bash[24992]: cluster 2024-08-31T06:19:21.141241+0000 mgr.a (mgr.14388) 10729 : cluster [DBG] pgmap v7437: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:23.064 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:23.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:23 smithi163 bash[24253]: audit 2024-08-31T06:19:22.613204+0000 mgr.a (mgr.14388) 10730 : audit [DBG] from='client.236784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:23 smithi027 bash[22610]: audit 2024-08-31T06:19:22.613204+0000 mgr.a (mgr.14388) 10730 : audit [DBG] from='client.236784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:23 smithi191 bash[24992]: audit 2024-08-31T06:19:22.613204+0000 mgr.a (mgr.14388) 10730 : audit [DBG] from='client.236784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:24 smithi027 bash[22610]: cluster 2024-08-31T06:19:23.142644+0000 mgr.a (mgr.14388) 10731 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:19:24.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:24 smithi191 bash[24992]: cluster 2024-08-31T06:19:23.142644+0000 mgr.a (mgr.14388) 10731 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:19:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:24 smithi163 bash[24253]: cluster 2024-08-31T06:19:23.142644+0000 mgr.a (mgr.14388) 10731 : cluster [DBG] pgmap v7438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:19:26.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:26 smithi027 bash[22610]: cluster 2024-08-31T06:19:25.143384+0000 mgr.a (mgr.14388) 10732 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:19:26.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:26 smithi191 bash[24992]: cluster 2024-08-31T06:19:25.143384+0000 mgr.a (mgr.14388) 10732 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:19:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:26 smithi163 bash[24253]: cluster 2024-08-31T06:19:25.143384+0000 mgr.a (mgr.14388) 10732 : cluster [DBG] pgmap v7439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:19:28.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:19:28.067 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:19:28.067 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:28.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:28 smithi027 bash[22610]: cluster 2024-08-31T06:19:27.144146+0000 mgr.a (mgr.14388) 10733 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:19:28.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:28 smithi191 bash[24992]: cluster 2024-08-31T06:19:27.144146+0000 mgr.a (mgr.14388) 10733 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:19:28.812 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:28.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:28.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:28.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:28.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:28 smithi163 bash[24253]: cluster 2024-08-31T06:19:27.144146+0000 mgr.a (mgr.14388) 10733 : cluster [DBG] pgmap v7440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:19:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:29 smithi027 bash[22610]: audit 2024-08-31T06:19:28.397031+0000 mgr.a (mgr.14388) 10734 : audit [DBG] from='client.236859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:29.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:29 smithi191 bash[24992]: audit 2024-08-31T06:19:28.397031+0000 mgr.a (mgr.14388) 10734 : audit [DBG] from='client.236859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:29.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:29 smithi163 bash[24253]: audit 2024-08-31T06:19:28.397031+0000 mgr.a (mgr.14388) 10734 : audit [DBG] from='client.236859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:30 smithi027 bash[22610]: cluster 2024-08-31T06:19:29.146805+0000 mgr.a (mgr.14388) 10735 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:30 smithi191 bash[24992]: cluster 2024-08-31T06:19:29.146805+0000 mgr.a (mgr.14388) 10735 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:30 smithi163 bash[24253]: cluster 2024-08-31T06:19:29.146805+0000 mgr.a (mgr.14388) 10735 : cluster [DBG] pgmap v7441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:32.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:32 smithi027 bash[22610]: cluster 2024-08-31T06:19:31.147571+0000 mgr.a (mgr.14388) 10736 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:19:32.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:32 smithi191 bash[24992]: cluster 2024-08-31T06:19:31.147571+0000 mgr.a (mgr.14388) 10736 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:19:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:32 smithi163 bash[24253]: cluster 2024-08-31T06:19:31.147571+0000 mgr.a (mgr.14388) 10736 : cluster [DBG] pgmap v7442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:19:33.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:19:33.815 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:19:33.815 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:34.603 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:34.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:34 smithi027 bash[22610]: cluster 2024-08-31T06:19:33.149471+0000 mgr.a (mgr.14388) 10737 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:34.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:34 smithi191 bash[24992]: cluster 2024-08-31T06:19:33.149471+0000 mgr.a (mgr.14388) 10737 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:34 smithi163 bash[24253]: cluster 2024-08-31T06:19:33.149471+0000 mgr.a (mgr.14388) 10737 : cluster [DBG] pgmap v7443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:35.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:35 smithi191 bash[24992]: audit 2024-08-31T06:19:34.154682+0000 mgr.a (mgr.14388) 10738 : audit [DBG] from='client.236937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:35.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:35 smithi163 bash[24253]: audit 2024-08-31T06:19:34.154682+0000 mgr.a (mgr.14388) 10738 : audit [DBG] from='client.236937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:35.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:35 smithi027 bash[22610]: audit 2024-08-31T06:19:34.154682+0000 mgr.a (mgr.14388) 10738 : audit [DBG] from='client.236937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:36 smithi191 bash[24992]: cluster 2024-08-31T06:19:35.150487+0000 mgr.a (mgr.14388) 10739 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:19:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:36 smithi163 bash[24253]: cluster 2024-08-31T06:19:35.150487+0000 mgr.a (mgr.14388) 10739 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:19:36.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:36 smithi027 bash[22610]: cluster 2024-08-31T06:19:35.150487+0000 mgr.a (mgr.14388) 10739 : cluster [DBG] pgmap v7444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:19:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:38 smithi191 bash[24992]: cluster 2024-08-31T06:19:37.151305+0000 mgr.a (mgr.14388) 10740 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:19:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:38 smithi163 bash[24253]: cluster 2024-08-31T06:19:37.151305+0000 mgr.a (mgr.14388) 10740 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:19:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:38 smithi027 bash[22610]: cluster 2024-08-31T06:19:37.151305+0000 mgr.a (mgr.14388) 10740 : cluster [DBG] pgmap v7445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:19:39.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:19:39.605 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:19:39.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:40.388 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:40.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:40.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:40.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:40.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:40.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:40 smithi191 bash[24992]: cluster 2024-08-31T06:19:39.153441+0000 mgr.a (mgr.14388) 10741 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:19:40.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:40 smithi191 bash[24992]: audit 2024-08-31T06:19:39.940401+0000 mgr.a (mgr.14388) 10742 : audit [DBG] from='client.237012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:40 smithi163 bash[24253]: cluster 2024-08-31T06:19:39.153441+0000 mgr.a (mgr.14388) 10741 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:19:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:40 smithi163 bash[24253]: audit 2024-08-31T06:19:39.940401+0000 mgr.a (mgr.14388) 10742 : audit [DBG] from='client.237012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:40 smithi027 bash[22610]: cluster 2024-08-31T06:19:39.153441+0000 mgr.a (mgr.14388) 10741 : cluster [DBG] pgmap v7446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:19:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:40 smithi027 bash[22610]: audit 2024-08-31T06:19:39.940401+0000 mgr.a (mgr.14388) 10742 : audit [DBG] from='client.237012 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:42.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:42 smithi191 bash[24992]: cluster 2024-08-31T06:19:41.154314+0000 mgr.a (mgr.14388) 10743 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:42 smithi163 bash[24253]: cluster 2024-08-31T06:19:41.154314+0000 mgr.a (mgr.14388) 10743 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:42 smithi027 bash[22610]: cluster 2024-08-31T06:19:41.154314+0000 mgr.a (mgr.14388) 10743 : cluster [DBG] pgmap v7447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:44.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:44 smithi191 bash[24992]: cluster 2024-08-31T06:19:43.156517+0000 mgr.a (mgr.14388) 10744 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:44 smithi163 bash[24253]: cluster 2024-08-31T06:19:43.156517+0000 mgr.a (mgr.14388) 10744 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:44.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:44 smithi027 bash[22610]: cluster 2024-08-31T06:19:43.156517+0000 mgr.a (mgr.14388) 10744 : cluster [DBG] pgmap v7448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:45.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:19:45.391 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:19:45.391 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:46.138 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:46.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:46.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:46.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:46.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:46 smithi191 bash[24992]: cluster 2024-08-31T06:19:45.157276+0000 mgr.a (mgr.14388) 10745 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:46 smithi191 bash[24992]: audit 2024-08-31T06:19:45.720142+0000 mgr.a (mgr.14388) 10746 : audit [DBG] from='client.237084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:46 smithi163 bash[24253]: cluster 2024-08-31T06:19:45.157276+0000 mgr.a (mgr.14388) 10745 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:46 smithi163 bash[24253]: audit 2024-08-31T06:19:45.720142+0000 mgr.a (mgr.14388) 10746 : audit [DBG] from='client.237084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:46 smithi027 bash[22610]: cluster 2024-08-31T06:19:45.157276+0000 mgr.a (mgr.14388) 10745 : cluster [DBG] pgmap v7449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:46 smithi027 bash[22610]: audit 2024-08-31T06:19:45.720142+0000 mgr.a (mgr.14388) 10746 : audit [DBG] from='client.237084 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:48 smithi191 bash[24992]: cluster 2024-08-31T06:19:47.158287+0000 mgr.a (mgr.14388) 10747 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:48 smithi163 bash[24253]: cluster 2024-08-31T06:19:47.158287+0000 mgr.a (mgr.14388) 10747 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:48 smithi027 bash[22610]: cluster 2024-08-31T06:19:47.158287+0000 mgr.a (mgr.14388) 10747 : cluster [DBG] pgmap v7450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:50 smithi191 bash[24992]: cluster 2024-08-31T06:19:49.160492+0000 mgr.a (mgr.14388) 10748 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:50 smithi163 bash[24253]: cluster 2024-08-31T06:19:49.160492+0000 mgr.a (mgr.14388) 10748 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:50 smithi027 bash[22610]: cluster 2024-08-31T06:19:49.160492+0000 mgr.a (mgr.14388) 10748 : cluster [DBG] pgmap v7451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:51.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:19:51.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:19:51.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:51.927 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:51.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:51.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:51.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:51.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:52 smithi191 bash[24992]: cluster 2024-08-31T06:19:51.161439+0000 mgr.a (mgr.14388) 10749 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:52 smithi191 bash[24992]: audit 2024-08-31T06:19:51.480786+0000 mgr.a (mgr.14388) 10750 : audit [DBG] from='client.237162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:52 smithi163 bash[24253]: cluster 2024-08-31T06:19:51.161439+0000 mgr.a (mgr.14388) 10749 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:52 smithi163 bash[24253]: audit 2024-08-31T06:19:51.480786+0000 mgr.a (mgr.14388) 10750 : audit [DBG] from='client.237162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:52 smithi027 bash[22610]: cluster 2024-08-31T06:19:51.161439+0000 mgr.a (mgr.14388) 10749 : cluster [DBG] pgmap v7452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:52 smithi027 bash[22610]: audit 2024-08-31T06:19:51.480786+0000 mgr.a (mgr.14388) 10750 : audit [DBG] from='client.237162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:54.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:54 smithi191 bash[24992]: cluster 2024-08-31T06:19:53.163816+0000 mgr.a (mgr.14388) 10751 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:54 smithi163 bash[24253]: cluster 2024-08-31T06:19:53.163816+0000 mgr.a (mgr.14388) 10751 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:54 smithi027 bash[22610]: cluster 2024-08-31T06:19:53.163816+0000 mgr.a (mgr.14388) 10751 : cluster [DBG] pgmap v7453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:19:56.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:56 smithi191 bash[24992]: cluster 2024-08-31T06:19:55.164617+0000 mgr.a (mgr.14388) 10752 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:56.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:19:56.930 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:19:56.930 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:19:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:56 smithi163 bash[24253]: cluster 2024-08-31T06:19:55.164617+0000 mgr.a (mgr.14388) 10752 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:56 smithi027 bash[22610]: cluster 2024-08-31T06:19:55.164617+0000 mgr.a (mgr.14388) 10752 : cluster [DBG] pgmap v7454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:57.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:19:57.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:19:57.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:19:57.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:19:57.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:19:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:58 smithi163 bash[24253]: cluster 2024-08-31T06:19:57.165341+0000 mgr.a (mgr.14388) 10753 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:58.996 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:19:58 smithi163 bash[24253]: audit 2024-08-31T06:19:57.263873+0000 mgr.a (mgr.14388) 10754 : audit [DBG] from='client.237240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:58.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:58 smithi027 bash[22610]: cluster 2024-08-31T06:19:57.165341+0000 mgr.a (mgr.14388) 10753 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:58.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:19:58 smithi027 bash[22610]: audit 2024-08-31T06:19:57.263873+0000 mgr.a (mgr.14388) 10754 : audit [DBG] from='client.237240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:19:59.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:58 smithi191 bash[24992]: cluster 2024-08-31T06:19:57.165341+0000 mgr.a (mgr.14388) 10753 : cluster [DBG] pgmap v7455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:19:59.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:19:58 smithi191 bash[24992]: audit 2024-08-31T06:19:57.263873+0000 mgr.a (mgr.14388) 10754 : audit [DBG] from='client.237240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:00 smithi163 bash[24253]: cluster 2024-08-31T06:19:59.167853+0000 mgr.a (mgr.14388) 10755 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:00 smithi163 bash[24253]: cluster 2024-08-31T06:20:00.000149+0000 mon.a (mon.0) 2192 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:20:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:00 smithi027 bash[22610]: cluster 2024-08-31T06:19:59.167853+0000 mgr.a (mgr.14388) 10755 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:00 smithi027 bash[22610]: cluster 2024-08-31T06:20:00.000149+0000 mon.a (mon.0) 2192 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:20:01.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:00 smithi191 bash[24992]: cluster 2024-08-31T06:19:59.167853+0000 mgr.a (mgr.14388) 10755 : cluster [DBG] pgmap v7456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:01.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:00 smithi191 bash[24992]: cluster 2024-08-31T06:20:00.000149+0000 mon.a (mon.0) 2192 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:20:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:20:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:20:02.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:20:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:02 smithi163 bash[24253]: cluster 2024-08-31T06:20:01.168685+0000 mgr.a (mgr.14388) 10756 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:02 smithi027 bash[22610]: cluster 2024-08-31T06:20:01.168685+0000 mgr.a (mgr.14388) 10756 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:03.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:02 smithi191 bash[24992]: cluster 2024-08-31T06:20:01.168685+0000 mgr.a (mgr.14388) 10756 : cluster [DBG] pgmap v7457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:03.517 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:20:03.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:20:03.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:20:03.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:20:03.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:20:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:03 smithi163 bash[24253]: audit 2024-08-31T06:20:02.892882+0000 mon.a (mon.0) 2193 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:20:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:03 smithi163 bash[24253]: audit 2024-08-31T06:20:03.063579+0000 mgr.a (mgr.14388) 10757 : audit [DBG] from='client.237315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:03 smithi027 bash[22610]: audit 2024-08-31T06:20:02.892882+0000 mon.a (mon.0) 2193 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:20:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:03 smithi027 bash[22610]: audit 2024-08-31T06:20:03.063579+0000 mgr.a (mgr.14388) 10757 : audit [DBG] from='client.237315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:03 smithi191 bash[24992]: audit 2024-08-31T06:20:02.892882+0000 mon.a (mon.0) 2193 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:20:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:03 smithi191 bash[24992]: audit 2024-08-31T06:20:03.063579+0000 mgr.a (mgr.14388) 10757 : audit [DBG] from='client.237315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:04.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:20:04 smithi027 bash[22863]: debug 2024-08-31T06:20:04.436+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:20:04.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:20:04 smithi027 bash[22863]: debug 2024-08-31T06:20:04.436+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:20:04.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:04 smithi027 bash[22610]: cluster 2024-08-31T06:20:03.169950+0000 mgr.a (mgr.14388) 10758 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:04.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:04 smithi027 bash[22610]: audit 2024-08-31T06:20:03.708193+0000 mon.a (mon.0) 2194 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:20:04.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:04 smithi027 bash[22610]: audit 2024-08-31T06:20:03.709751+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:20:04.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:04 smithi027 bash[22610]: audit 2024-08-31T06:20:03.721051+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:20:04.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:04 smithi027 bash[22610]: audit 2024-08-31T06:20:03.725714+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:20:04.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:04 smithi027 bash[22610]: audit 2024-08-31T06:20:03.728486+0000 mgr.a (mgr.14388) 10759 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:20:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:04 smithi163 bash[24253]: cluster 2024-08-31T06:20:03.169950+0000 mgr.a (mgr.14388) 10758 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:04 smithi163 bash[24253]: audit 2024-08-31T06:20:03.708193+0000 mon.a (mon.0) 2194 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:20:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:04 smithi163 bash[24253]: audit 2024-08-31T06:20:03.709751+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:20:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:04 smithi163 bash[24253]: audit 2024-08-31T06:20:03.721051+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:20:04.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:04 smithi163 bash[24253]: audit 2024-08-31T06:20:03.725714+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:20:04.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:04 smithi163 bash[24253]: audit 2024-08-31T06:20:03.728486+0000 mgr.a (mgr.14388) 10759 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:20:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:04 smithi191 bash[24992]: cluster 2024-08-31T06:20:03.169950+0000 mgr.a (mgr.14388) 10758 : cluster [DBG] pgmap v7458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:04 smithi191 bash[24992]: audit 2024-08-31T06:20:03.708193+0000 mon.a (mon.0) 2194 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:20:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:04 smithi191 bash[24992]: audit 2024-08-31T06:20:03.709751+0000 mon.a (mon.0) 2195 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:20:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:04 smithi191 bash[24992]: audit 2024-08-31T06:20:03.721051+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:20:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:04 smithi191 bash[24992]: audit 2024-08-31T06:20:03.725714+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:20:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:04 smithi191 bash[24992]: audit 2024-08-31T06:20:03.728486+0000 mgr.a (mgr.14388) 10759 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:20:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:05 smithi163 bash[24253]: audit 2024-08-31T06:20:04.439491+0000 mgr.a (mgr.14388) 10760 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:20:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:05 smithi163 bash[24253]: cephadm 2024-08-31T06:20:04.440805+0000 mgr.a (mgr.14388) 10761 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:20:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:05 smithi027 bash[22610]: audit 2024-08-31T06:20:04.439491+0000 mgr.a (mgr.14388) 10760 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:20:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:05 smithi027 bash[22610]: cephadm 2024-08-31T06:20:04.440805+0000 mgr.a (mgr.14388) 10761 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:20:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:05 smithi191 bash[24992]: audit 2024-08-31T06:20:04.439491+0000 mgr.a (mgr.14388) 10760 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:20:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:05 smithi191 bash[24992]: cephadm 2024-08-31T06:20:04.440805+0000 mgr.a (mgr.14388) 10761 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:20:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:06 smithi163 bash[24253]: cluster 2024-08-31T06:20:05.170841+0000 mgr.a (mgr.14388) 10762 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:20:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:06 smithi027 bash[22610]: cluster 2024-08-31T06:20:05.170841+0000 mgr.a (mgr.14388) 10762 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:20:07.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:06 smithi191 bash[24992]: cluster 2024-08-31T06:20:05.170841+0000 mgr.a (mgr.14388) 10762 : cluster [DBG] pgmap v7459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:20:08.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:20:08.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:20:08.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:20:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:08 smithi163 bash[24253]: cluster 2024-08-31T06:20:07.171633+0000 mgr.a (mgr.14388) 10763 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:20:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:08 smithi027 bash[22610]: cluster 2024-08-31T06:20:07.171633+0000 mgr.a (mgr.14388) 10763 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:20:09.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:08 smithi191 bash[24992]: cluster 2024-08-31T06:20:07.171633+0000 mgr.a (mgr.14388) 10763 : cluster [DBG] pgmap v7460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:20:09.262 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:20:09.263 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:20:09.263 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:20:09.263 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:20:09.263 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:20:09.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:09 smithi163 bash[24253]: audit 2024-08-31T06:20:08.851011+0000 mgr.a (mgr.14388) 10764 : audit [DBG] from='client.237498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:09 smithi027 bash[22610]: audit 2024-08-31T06:20:08.851011+0000 mgr.a (mgr.14388) 10764 : audit [DBG] from='client.237498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:10.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:09 smithi191 bash[24992]: audit 2024-08-31T06:20:08.851011+0000 mgr.a (mgr.14388) 10764 : audit [DBG] from='client.237498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:10 smithi163 bash[24253]: cluster 2024-08-31T06:20:09.173040+0000 mgr.a (mgr.14388) 10765 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:10 smithi027 bash[22610]: cluster 2024-08-31T06:20:09.173040+0000 mgr.a (mgr.14388) 10765 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:11.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:10 smithi191 bash[24992]: cluster 2024-08-31T06:20:09.173040+0000 mgr.a (mgr.14388) 10765 : cluster [DBG] pgmap v7461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:12 smithi163 bash[24253]: cluster 2024-08-31T06:20:11.173804+0000 mgr.a (mgr.14388) 10766 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:20:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:12 smithi027 bash[22610]: cluster 2024-08-31T06:20:11.173804+0000 mgr.a (mgr.14388) 10766 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:20:13.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:12 smithi191 bash[24992]: cluster 2024-08-31T06:20:11.173804+0000 mgr.a (mgr.14388) 10766 : cluster [DBG] pgmap v7462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:20:14.264 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:20:14.265 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:20:14.265 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:20:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:14 smithi163 bash[24253]: cluster 2024-08-31T06:20:13.175735+0000 mgr.a (mgr.14388) 10767 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:14 smithi027 bash[22610]: cluster 2024-08-31T06:20:13.175735+0000 mgr.a (mgr.14388) 10767 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:14 smithi191 bash[24992]: cluster 2024-08-31T06:20:13.175735+0000 mgr.a (mgr.14388) 10767 : cluster [DBG] pgmap v7463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:15.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:20:15.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:20:15.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:20:15.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:20:15.048 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:20:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:15 smithi163 bash[24253]: audit 2024-08-31T06:20:14.599906+0000 mgr.a (mgr.14388) 10768 : audit [DBG] from='client.237576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:15 smithi027 bash[22610]: audit 2024-08-31T06:20:14.599906+0000 mgr.a (mgr.14388) 10768 : audit [DBG] from='client.237576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:15 smithi191 bash[24992]: audit 2024-08-31T06:20:14.599906+0000 mgr.a (mgr.14388) 10768 : audit [DBG] from='client.237576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:16 smithi163 bash[24253]: cluster 2024-08-31T06:20:15.176658+0000 mgr.a (mgr.14388) 10769 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:16.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:16 smithi027 bash[22610]: cluster 2024-08-31T06:20:15.176658+0000 mgr.a (mgr.14388) 10769 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:17.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:16 smithi191 bash[24992]: cluster 2024-08-31T06:20:15.176658+0000 mgr.a (mgr.14388) 10769 : cluster [DBG] pgmap v7464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:18 smithi163 bash[24253]: cluster 2024-08-31T06:20:17.177450+0000 mgr.a (mgr.14388) 10770 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:18 smithi027 bash[22610]: cluster 2024-08-31T06:20:17.177450+0000 mgr.a (mgr.14388) 10770 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:18 smithi191 bash[24992]: cluster 2024-08-31T06:20:17.177450+0000 mgr.a (mgr.14388) 10770 : cluster [DBG] pgmap v7465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:20.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:20:20.050 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:20:20.050 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:20:20.797 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:20:20.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:20:20.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:20:20.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:20:20.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:20:20.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:20 smithi163 bash[24253]: cluster 2024-08-31T06:20:19.179682+0000 mgr.a (mgr.14388) 10771 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:20 smithi027 bash[22610]: cluster 2024-08-31T06:20:19.179682+0000 mgr.a (mgr.14388) 10771 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:21.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:20 smithi191 bash[24992]: cluster 2024-08-31T06:20:19.179682+0000 mgr.a (mgr.14388) 10771 : cluster [DBG] pgmap v7466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:20:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:21 smithi163 bash[24253]: audit 2024-08-31T06:20:20.378125+0000 mgr.a (mgr.14388) 10772 : audit [DBG] from='client.237654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:21 smithi027 bash[22610]: audit 2024-08-31T06:20:20.378125+0000 mgr.a (mgr.14388) 10772 : audit [DBG] from='client.237654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:22.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:21 smithi191 bash[24992]: audit 2024-08-31T06:20:20.378125+0000 mgr.a (mgr.14388) 10772 : audit [DBG] from='client.237654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:22.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:22 smithi163 bash[24253]: cluster 2024-08-31T06:20:21.180639+0000 mgr.a (mgr.14388) 10773 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:22.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:22 smithi027 bash[22610]: cluster 2024-08-31T06:20:21.180639+0000 mgr.a (mgr.14388) 10773 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:23.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:22 smithi191 bash[24992]: cluster 2024-08-31T06:20:21.180639+0000 mgr.a (mgr.14388) 10773 : cluster [DBG] pgmap v7467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:24.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:24 smithi163 bash[24253]: cluster 2024-08-31T06:20:23.182876+0000 mgr.a (mgr.14388) 10774 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:24.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:24 smithi027 bash[22610]: cluster 2024-08-31T06:20:23.182876+0000 mgr.a (mgr.14388) 10774 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:25.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:24 smithi191 bash[24992]: cluster 2024-08-31T06:20:23.182876+0000 mgr.a (mgr.14388) 10774 : cluster [DBG] pgmap v7468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:20:25.799 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:20:25.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:20:26.574 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:20:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:20:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:20:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:20:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:20:26.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:26 smithi163 bash[24253]: cluster 2024-08-31T06:20:25.183634+0000 mgr.a (mgr.14388) 10775 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:26 smithi027 bash[22610]: cluster 2024-08-31T06:20:25.183634+0000 mgr.a (mgr.14388) 10775 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:27.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:26 smithi191 bash[24992]: cluster 2024-08-31T06:20:25.183634+0000 mgr.a (mgr.14388) 10775 : cluster [DBG] pgmap v7469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:27 smithi163 bash[24253]: audit 2024-08-31T06:20:26.133764+0000 mgr.a (mgr.14388) 10776 : audit [DBG] from='client.237732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:27 smithi027 bash[22610]: audit 2024-08-31T06:20:26.133764+0000 mgr.a (mgr.14388) 10776 : audit [DBG] from='client.237732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:28.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:27 smithi191 bash[24992]: audit 2024-08-31T06:20:26.133764+0000 mgr.a (mgr.14388) 10776 : audit [DBG] from='client.237732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:28 smithi163 bash[24253]: cluster 2024-08-31T06:20:27.184591+0000 mgr.a (mgr.14388) 10777 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:28.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:28 smithi027 bash[22610]: cluster 2024-08-31T06:20:27.184591+0000 mgr.a (mgr.14388) 10777 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:29.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:28 smithi191 bash[24992]: cluster 2024-08-31T06:20:27.184591+0000 mgr.a (mgr.14388) 10777 : cluster [DBG] pgmap v7470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:30.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:30 smithi163 bash[24253]: cluster 2024-08-31T06:20:29.186846+0000 mgr.a (mgr.14388) 10778 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:30 smithi027 bash[22610]: cluster 2024-08-31T06:20:29.186846+0000 mgr.a (mgr.14388) 10778 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:31.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:30 smithi191 bash[24992]: cluster 2024-08-31T06:20:29.186846+0000 mgr.a (mgr.14388) 10778 : cluster [DBG] pgmap v7471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:31.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:20:31.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:20:31.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:20:32.325 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:20:32.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:20:32.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:20:32.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:20:32.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:20:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:32 smithi163 bash[24253]: cluster 2024-08-31T06:20:31.187599+0000 mgr.a (mgr.14388) 10779 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:32.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:32 smithi163 bash[24253]: audit 2024-08-31T06:20:31.907456+0000 mgr.a (mgr.14388) 10780 : audit [DBG] from='client.237810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:32 smithi027 bash[22610]: cluster 2024-08-31T06:20:31.187599+0000 mgr.a (mgr.14388) 10779 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:32 smithi027 bash[22610]: audit 2024-08-31T06:20:31.907456+0000 mgr.a (mgr.14388) 10780 : audit [DBG] from='client.237810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:33.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:32 smithi191 bash[24992]: cluster 2024-08-31T06:20:31.187599+0000 mgr.a (mgr.14388) 10779 : cluster [DBG] pgmap v7472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:33.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:32 smithi191 bash[24992]: audit 2024-08-31T06:20:31.907456+0000 mgr.a (mgr.14388) 10780 : audit [DBG] from='client.237810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:34.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:34 smithi163 bash[24253]: cluster 2024-08-31T06:20:33.189885+0000 mgr.a (mgr.14388) 10781 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:34.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:34 smithi027 bash[22610]: cluster 2024-08-31T06:20:33.189885+0000 mgr.a (mgr.14388) 10781 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:35.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:34 smithi191 bash[24992]: cluster 2024-08-31T06:20:33.189885+0000 mgr.a (mgr.14388) 10781 : cluster [DBG] pgmap v7473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:20:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:36 smithi163 bash[24253]: cluster 2024-08-31T06:20:35.190622+0000 mgr.a (mgr.14388) 10782 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:36.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:36 smithi027 bash[22610]: cluster 2024-08-31T06:20:35.190622+0000 mgr.a (mgr.14388) 10782 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:37.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:36 smithi191 bash[24992]: cluster 2024-08-31T06:20:35.190622+0000 mgr.a (mgr.14388) 10782 : cluster [DBG] pgmap v7474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:37.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:20:37.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:20:37.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:20:38.105 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:20:38.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:20:38.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:20:38.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:20:38.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:20:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:38 smithi163 bash[24253]: cluster 2024-08-31T06:20:37.191305+0000 mgr.a (mgr.14388) 10783 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:38.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:38 smithi163 bash[24253]: audit 2024-08-31T06:20:37.659091+0000 mgr.a (mgr.14388) 10784 : audit [DBG] from='client.237888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:38 smithi027 bash[22610]: cluster 2024-08-31T06:20:37.191305+0000 mgr.a (mgr.14388) 10783 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:38 smithi027 bash[22610]: audit 2024-08-31T06:20:37.659091+0000 mgr.a (mgr.14388) 10784 : audit [DBG] from='client.237888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:39.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:38 smithi191 bash[24992]: cluster 2024-08-31T06:20:37.191305+0000 mgr.a (mgr.14388) 10783 : cluster [DBG] pgmap v7475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:39.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:38 smithi191 bash[24992]: audit 2024-08-31T06:20:37.659091+0000 mgr.a (mgr.14388) 10784 : audit [DBG] from='client.237888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:40 smithi163 bash[24253]: cluster 2024-08-31T06:20:39.194088+0000 mgr.a (mgr.14388) 10785 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:20:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:40 smithi027 bash[22610]: cluster 2024-08-31T06:20:39.194088+0000 mgr.a (mgr.14388) 10785 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:20:41.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:40 smithi191 bash[24992]: cluster 2024-08-31T06:20:39.194088+0000 mgr.a (mgr.14388) 10785 : cluster [DBG] pgmap v7476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:20:42.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:42 smithi163 bash[24253]: cluster 2024-08-31T06:20:41.194968+0000 mgr.a (mgr.14388) 10786 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:20:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:42 smithi027 bash[22610]: cluster 2024-08-31T06:20:41.194968+0000 mgr.a (mgr.14388) 10786 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:20:43.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:42 smithi191 bash[24992]: cluster 2024-08-31T06:20:41.194968+0000 mgr.a (mgr.14388) 10786 : cluster [DBG] pgmap v7477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:20:43.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:20:43.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:20:43.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:20:43.865 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:20:43.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:20:43.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:20:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:44 smithi163 bash[24253]: cluster 2024-08-31T06:20:43.196457+0000 mgr.a (mgr.14388) 10787 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:44 smithi163 bash[24253]: audit 2024-08-31T06:20:43.439157+0000 mgr.a (mgr.14388) 10788 : audit [DBG] from='client.237966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:44.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:44 smithi027 bash[22610]: cluster 2024-08-31T06:20:43.196457+0000 mgr.a (mgr.14388) 10787 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:44.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:44 smithi027 bash[22610]: audit 2024-08-31T06:20:43.439157+0000 mgr.a (mgr.14388) 10788 : audit [DBG] from='client.237966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:45.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:44 smithi191 bash[24992]: cluster 2024-08-31T06:20:43.196457+0000 mgr.a (mgr.14388) 10787 : cluster [DBG] pgmap v7478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:45.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:44 smithi191 bash[24992]: audit 2024-08-31T06:20:43.439157+0000 mgr.a (mgr.14388) 10788 : audit [DBG] from='client.237966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:46 smithi163 bash[24253]: cluster 2024-08-31T06:20:45.197333+0000 mgr.a (mgr.14388) 10789 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:20:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:46 smithi027 bash[22610]: cluster 2024-08-31T06:20:45.197333+0000 mgr.a (mgr.14388) 10789 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:20:47.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:46 smithi191 bash[24992]: cluster 2024-08-31T06:20:45.197333+0000 mgr.a (mgr.14388) 10789 : cluster [DBG] pgmap v7479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:20:48.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:20:48.867 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:20:48.868 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:20:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:48 smithi163 bash[24253]: cluster 2024-08-31T06:20:47.198113+0000 mgr.a (mgr.14388) 10790 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:20:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:48 smithi027 bash[22610]: cluster 2024-08-31T06:20:47.198113+0000 mgr.a (mgr.14388) 10790 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:20:49.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:48 smithi191 bash[24992]: cluster 2024-08-31T06:20:47.198113+0000 mgr.a (mgr.14388) 10790 : cluster [DBG] pgmap v7480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:20:49.628 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:20:49.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:20:49.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:20:49.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:20:49.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:20:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:50 smithi163 bash[24253]: audit 2024-08-31T06:20:49.198043+0000 mgr.a (mgr.14388) 10791 : audit [DBG] from='client.238044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:50 smithi163 bash[24253]: cluster 2024-08-31T06:20:49.216263+0000 mgr.a (mgr.14388) 10792 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:50 smithi027 bash[22610]: audit 2024-08-31T06:20:49.198043+0000 mgr.a (mgr.14388) 10791 : audit [DBG] from='client.238044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:50 smithi027 bash[22610]: cluster 2024-08-31T06:20:49.216263+0000 mgr.a (mgr.14388) 10792 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:51.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:50 smithi191 bash[24992]: audit 2024-08-31T06:20:49.198043+0000 mgr.a (mgr.14388) 10791 : audit [DBG] from='client.238044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:51.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:50 smithi191 bash[24992]: cluster 2024-08-31T06:20:49.216263+0000 mgr.a (mgr.14388) 10792 : cluster [DBG] pgmap v7481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:52 smithi163 bash[24253]: cluster 2024-08-31T06:20:51.217263+0000 mgr.a (mgr.14388) 10793 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:20:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:52 smithi027 bash[22610]: cluster 2024-08-31T06:20:51.217263+0000 mgr.a (mgr.14388) 10793 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:20:53.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:52 smithi191 bash[24992]: cluster 2024-08-31T06:20:51.217263+0000 mgr.a (mgr.14388) 10793 : cluster [DBG] pgmap v7482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:20:54.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:20:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:20:54.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:20:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:54 smithi163 bash[24253]: cluster 2024-08-31T06:20:53.219418+0000 mgr.a (mgr.14388) 10794 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:20:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:54 smithi027 bash[22610]: cluster 2024-08-31T06:20:53.219418+0000 mgr.a (mgr.14388) 10794 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:20:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:54 smithi191 bash[24992]: cluster 2024-08-31T06:20:53.219418+0000 mgr.a (mgr.14388) 10794 : cluster [DBG] pgmap v7483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:20:55.413 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:20:55.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:20:55.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:20:55.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:20:55.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:20:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:55 smithi027 bash[22610]: audit 2024-08-31T06:20:54.962564+0000 mgr.a (mgr.14388) 10795 : audit [DBG] from='client.238122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:56.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:55 smithi191 bash[24992]: audit 2024-08-31T06:20:54.962564+0000 mgr.a (mgr.14388) 10795 : audit [DBG] from='client.238122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:55 smithi163 bash[24253]: audit 2024-08-31T06:20:54.962564+0000 mgr.a (mgr.14388) 10795 : audit [DBG] from='client.238122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:20:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:56 smithi027 bash[22610]: cluster 2024-08-31T06:20:55.219982+0000 mgr.a (mgr.14388) 10796 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:56 smithi191 bash[24992]: cluster 2024-08-31T06:20:55.219982+0000 mgr.a (mgr.14388) 10796 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:56 smithi163 bash[24253]: cluster 2024-08-31T06:20:55.219982+0000 mgr.a (mgr.14388) 10796 : cluster [DBG] pgmap v7484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:20:58 smithi027 bash[22610]: cluster 2024-08-31T06:20:57.220848+0000 mgr.a (mgr.14388) 10797 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:59.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:20:58 smithi191 bash[24992]: cluster 2024-08-31T06:20:57.220848+0000 mgr.a (mgr.14388) 10797 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:20:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:20:58 smithi163 bash[24253]: cluster 2024-08-31T06:20:57.220848+0000 mgr.a (mgr.14388) 10797 : cluster [DBG] pgmap v7485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:00.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:00.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:00.416 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:00 smithi027 bash[22610]: cluster 2024-08-31T06:20:59.223091+0000 mgr.a (mgr.14388) 10798 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:01.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:00 smithi191 bash[24992]: cluster 2024-08-31T06:20:59.223091+0000 mgr.a (mgr.14388) 10798 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:01.159 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:01.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:01.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:01.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:01.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:00 smithi163 bash[24253]: cluster 2024-08-31T06:20:59.223091+0000 mgr.a (mgr.14388) 10798 : cluster [DBG] pgmap v7486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:01 smithi027 bash[22610]: audit 2024-08-31T06:21:00.747322+0000 mgr.a (mgr.14388) 10799 : audit [DBG] from='client.238200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:02.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:01 smithi191 bash[24992]: audit 2024-08-31T06:21:00.747322+0000 mgr.a (mgr.14388) 10799 : audit [DBG] from='client.238200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:01 smithi163 bash[24253]: audit 2024-08-31T06:21:00.747322+0000 mgr.a (mgr.14388) 10799 : audit [DBG] from='client.238200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:02 smithi027 bash[22610]: cluster 2024-08-31T06:21:01.223974+0000 mgr.a (mgr.14388) 10800 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:03.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:02 smithi191 bash[24992]: cluster 2024-08-31T06:21:01.223974+0000 mgr.a (mgr.14388) 10800 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:02 smithi163 bash[24253]: cluster 2024-08-31T06:21:01.223974+0000 mgr.a (mgr.14388) 10800 : cluster [DBG] pgmap v7487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:04 smithi027 bash[22610]: cluster 2024-08-31T06:21:03.226226+0000 mgr.a (mgr.14388) 10801 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:04 smithi027 bash[22610]: audit 2024-08-31T06:21:04.493272+0000 mon.a (mon.0) 2198 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:21:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:04 smithi191 bash[24992]: cluster 2024-08-31T06:21:03.226226+0000 mgr.a (mgr.14388) 10801 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:05.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:04 smithi191 bash[24992]: audit 2024-08-31T06:21:04.493272+0000 mon.a (mon.0) 2198 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:21:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:04 smithi163 bash[24253]: cluster 2024-08-31T06:21:03.226226+0000 mgr.a (mgr.14388) 10801 : cluster [DBG] pgmap v7488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:04 smithi163 bash[24253]: audit 2024-08-31T06:21:04.493272+0000 mon.a (mon.0) 2198 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:21:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:05 smithi191 bash[24992]: audit 2024-08-31T06:21:05.336299+0000 mon.a (mon.0) 2199 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:21:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:05 smithi191 bash[24992]: audit 2024-08-31T06:21:05.338105+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:21:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:05 smithi191 bash[24992]: audit 2024-08-31T06:21:05.348688+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:21:06.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:05 smithi191 bash[24992]: audit 2024-08-31T06:21:05.351660+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:21:06.091 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:05 smithi027 bash[22610]: audit 2024-08-31T06:21:05.336299+0000 mon.a (mon.0) 2199 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:21:06.091 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:05 smithi027 bash[22610]: audit 2024-08-31T06:21:05.338105+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:21:06.091 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:05 smithi027 bash[22610]: audit 2024-08-31T06:21:05.348688+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:21:06.091 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:05 smithi027 bash[22610]: audit 2024-08-31T06:21:05.351660+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:21:06.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:06.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:06.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:05 smithi163 bash[24253]: audit 2024-08-31T06:21:05.336299+0000 mon.a (mon.0) 2199 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:21:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:05 smithi163 bash[24253]: audit 2024-08-31T06:21:05.338105+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:21:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:05 smithi163 bash[24253]: audit 2024-08-31T06:21:05.348688+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:21:06.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:05 smithi163 bash[24253]: audit 2024-08-31T06:21:05.351660+0000 mon.a (mon.0) 2202 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:21:06.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:21:06 smithi027 bash[22863]: debug 2024-08-31T06:21:06.082+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:21:06.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:21:06 smithi027 bash[22863]: debug 2024-08-31T06:21:06.086+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:21:06.934 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:06.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:06.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:06.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:06.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:07.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:06 smithi191 bash[24992]: cluster 2024-08-31T06:21:05.227019+0000 mgr.a (mgr.14388) 10802 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:07.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:06 smithi191 bash[24992]: audit 2024-08-31T06:21:05.352694+0000 mgr.a (mgr.14388) 10803 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:21:07.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:06 smithi191 bash[24992]: audit 2024-08-31T06:21:06.090232+0000 mgr.a (mgr.14388) 10804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:21:07.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:06 smithi191 bash[24992]: cephadm 2024-08-31T06:21:06.091478+0000 mgr.a (mgr.14388) 10805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:21:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:06 smithi163 bash[24253]: cluster 2024-08-31T06:21:05.227019+0000 mgr.a (mgr.14388) 10802 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:06 smithi163 bash[24253]: audit 2024-08-31T06:21:05.352694+0000 mgr.a (mgr.14388) 10803 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:21:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:06 smithi163 bash[24253]: audit 2024-08-31T06:21:06.090232+0000 mgr.a (mgr.14388) 10804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:21:07.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:06 smithi163 bash[24253]: cephadm 2024-08-31T06:21:06.091478+0000 mgr.a (mgr.14388) 10805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:21:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:06 smithi027 bash[22610]: cluster 2024-08-31T06:21:05.227019+0000 mgr.a (mgr.14388) 10802 : cluster [DBG] pgmap v7489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:06 smithi027 bash[22610]: audit 2024-08-31T06:21:05.352694+0000 mgr.a (mgr.14388) 10803 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:21:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:06 smithi027 bash[22610]: audit 2024-08-31T06:21:06.090232+0000 mgr.a (mgr.14388) 10804 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:21:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:06 smithi027 bash[22610]: cephadm 2024-08-31T06:21:06.091478+0000 mgr.a (mgr.14388) 10805 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:21:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:07 smithi191 bash[24992]: audit 2024-08-31T06:21:06.490804+0000 mgr.a (mgr.14388) 10806 : audit [DBG] from='client.238386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:07 smithi163 bash[24253]: audit 2024-08-31T06:21:06.490804+0000 mgr.a (mgr.14388) 10806 : audit [DBG] from='client.238386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:07 smithi027 bash[22610]: audit 2024-08-31T06:21:06.490804+0000 mgr.a (mgr.14388) 10806 : audit [DBG] from='client.238386 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:09.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:08 smithi191 bash[24992]: cluster 2024-08-31T06:21:07.227947+0000 mgr.a (mgr.14388) 10807 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:08 smithi163 bash[24253]: cluster 2024-08-31T06:21:07.227947+0000 mgr.a (mgr.14388) 10807 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:08 smithi027 bash[22610]: cluster 2024-08-31T06:21:07.227947+0000 mgr.a (mgr.14388) 10807 : cluster [DBG] pgmap v7490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:11.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:10 smithi191 bash[24992]: cluster 2024-08-31T06:21:09.230140+0000 mgr.a (mgr.14388) 10808 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:10 smithi163 bash[24253]: cluster 2024-08-31T06:21:09.230140+0000 mgr.a (mgr.14388) 10808 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:10 smithi027 bash[22610]: cluster 2024-08-31T06:21:09.230140+0000 mgr.a (mgr.14388) 10808 : cluster [DBG] pgmap v7491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:11.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:11.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:11.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:12.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:12.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:12.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:12.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:12.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:13.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:12 smithi191 bash[24992]: cluster 2024-08-31T06:21:11.230991+0000 mgr.a (mgr.14388) 10809 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:12 smithi163 bash[24253]: cluster 2024-08-31T06:21:11.230991+0000 mgr.a (mgr.14388) 10809 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:12 smithi027 bash[22610]: cluster 2024-08-31T06:21:11.230991+0000 mgr.a (mgr.14388) 10809 : cluster [DBG] pgmap v7492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:13 smithi191 bash[24992]: audit 2024-08-31T06:21:12.272296+0000 mgr.a (mgr.14388) 10810 : audit [DBG] from='client.238464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:13 smithi163 bash[24253]: audit 2024-08-31T06:21:12.272296+0000 mgr.a (mgr.14388) 10810 : audit [DBG] from='client.238464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:13 smithi027 bash[22610]: audit 2024-08-31T06:21:12.272296+0000 mgr.a (mgr.14388) 10810 : audit [DBG] from='client.238464 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:14 smithi191 bash[24992]: cluster 2024-08-31T06:21:13.233433+0000 mgr.a (mgr.14388) 10811 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:14 smithi163 bash[24253]: cluster 2024-08-31T06:21:13.233433+0000 mgr.a (mgr.14388) 10811 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:14 smithi027 bash[22610]: cluster 2024-08-31T06:21:13.233433+0000 mgr.a (mgr.14388) 10811 : cluster [DBG] pgmap v7493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:17.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:16 smithi191 bash[24992]: cluster 2024-08-31T06:21:15.234386+0000 mgr.a (mgr.14388) 10812 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:16 smithi163 bash[24253]: cluster 2024-08-31T06:21:15.234386+0000 mgr.a (mgr.14388) 10812 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:16 smithi027 bash[22610]: cluster 2024-08-31T06:21:15.234386+0000 mgr.a (mgr.14388) 10812 : cluster [DBG] pgmap v7494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:17.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:17.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:17.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:18.465 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:18.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:18.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:18.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:18.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:18 smithi191 bash[24992]: cluster 2024-08-31T06:21:17.235344+0000 mgr.a (mgr.14388) 10813 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:18 smithi191 bash[24992]: audit 2024-08-31T06:21:18.052374+0000 mgr.a (mgr.14388) 10814 : audit [DBG] from='client.238542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:18 smithi163 bash[24253]: cluster 2024-08-31T06:21:17.235344+0000 mgr.a (mgr.14388) 10813 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:18 smithi163 bash[24253]: audit 2024-08-31T06:21:18.052374+0000 mgr.a (mgr.14388) 10814 : audit [DBG] from='client.238542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:18 smithi027 bash[22610]: cluster 2024-08-31T06:21:17.235344+0000 mgr.a (mgr.14388) 10813 : cluster [DBG] pgmap v7495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:18 smithi027 bash[22610]: audit 2024-08-31T06:21:18.052374+0000 mgr.a (mgr.14388) 10814 : audit [DBG] from='client.238542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:20 smithi163 bash[24253]: cluster 2024-08-31T06:21:19.238156+0000 mgr.a (mgr.14388) 10815 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:20 smithi027 bash[22610]: cluster 2024-08-31T06:21:19.238156+0000 mgr.a (mgr.14388) 10815 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:20 smithi191 bash[24992]: cluster 2024-08-31T06:21:19.238156+0000 mgr.a (mgr.14388) 10815 : cluster [DBG] pgmap v7496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:21:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:22 smithi163 bash[24253]: cluster 2024-08-31T06:21:21.238993+0000 mgr.a (mgr.14388) 10816 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:21:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:22 smithi027 bash[22610]: cluster 2024-08-31T06:21:21.238993+0000 mgr.a (mgr.14388) 10816 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:21:23.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:22 smithi191 bash[24992]: cluster 2024-08-31T06:21:21.238993+0000 mgr.a (mgr.14388) 10816 : cluster [DBG] pgmap v7497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:21:23.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:23.467 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:23.467 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:24.206 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:24.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:24 smithi163 bash[24253]: cluster 2024-08-31T06:21:23.240918+0000 mgr.a (mgr.14388) 10817 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:24 smithi163 bash[24253]: audit 2024-08-31T06:21:23.796469+0000 mgr.a (mgr.14388) 10818 : audit [DBG] from='client.238620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:24 smithi027 bash[22610]: cluster 2024-08-31T06:21:23.240918+0000 mgr.a (mgr.14388) 10817 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:24 smithi027 bash[22610]: audit 2024-08-31T06:21:23.796469+0000 mgr.a (mgr.14388) 10818 : audit [DBG] from='client.238620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:25.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:24 smithi191 bash[24992]: cluster 2024-08-31T06:21:23.240918+0000 mgr.a (mgr.14388) 10817 : cluster [DBG] pgmap v7498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:25.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:24 smithi191 bash[24992]: audit 2024-08-31T06:21:23.796469+0000 mgr.a (mgr.14388) 10818 : audit [DBG] from='client.238620 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:26 smithi163 bash[24253]: cluster 2024-08-31T06:21:25.241986+0000 mgr.a (mgr.14388) 10819 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:21:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:26 smithi027 bash[22610]: cluster 2024-08-31T06:21:25.241986+0000 mgr.a (mgr.14388) 10819 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:21:27.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:26 smithi191 bash[24992]: cluster 2024-08-31T06:21:25.241986+0000 mgr.a (mgr.14388) 10819 : cluster [DBG] pgmap v7499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:21:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:28 smithi163 bash[24253]: cluster 2024-08-31T06:21:27.242985+0000 mgr.a (mgr.14388) 10820 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:21:29.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:29.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:29.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:28 smithi027 bash[22610]: cluster 2024-08-31T06:21:27.242985+0000 mgr.a (mgr.14388) 10820 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:21:29.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:28 smithi191 bash[24992]: cluster 2024-08-31T06:21:27.242985+0000 mgr.a (mgr.14388) 10820 : cluster [DBG] pgmap v7500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:21:29.968 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:29.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:29.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:29.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:29.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:30 smithi163 bash[24253]: cluster 2024-08-31T06:21:29.244483+0000 mgr.a (mgr.14388) 10821 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:30 smithi163 bash[24253]: audit 2024-08-31T06:21:29.546507+0000 mgr.a (mgr.14388) 10822 : audit [DBG] from='client.238698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:30 smithi027 bash[22610]: cluster 2024-08-31T06:21:29.244483+0000 mgr.a (mgr.14388) 10821 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:30 smithi027 bash[22610]: audit 2024-08-31T06:21:29.546507+0000 mgr.a (mgr.14388) 10822 : audit [DBG] from='client.238698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:31.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:30 smithi191 bash[24992]: cluster 2024-08-31T06:21:29.244483+0000 mgr.a (mgr.14388) 10821 : cluster [DBG] pgmap v7501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:31.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:30 smithi191 bash[24992]: audit 2024-08-31T06:21:29.546507+0000 mgr.a (mgr.14388) 10822 : audit [DBG] from='client.238698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:32 smithi163 bash[24253]: cluster 2024-08-31T06:21:31.245385+0000 mgr.a (mgr.14388) 10823 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:32 smithi027 bash[22610]: cluster 2024-08-31T06:21:31.245385+0000 mgr.a (mgr.14388) 10823 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:32 smithi191 bash[24992]: cluster 2024-08-31T06:21:31.245385+0000 mgr.a (mgr.14388) 10823 : cluster [DBG] pgmap v7502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:34.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:34.970 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:34.970 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:34 smithi163 bash[24253]: cluster 2024-08-31T06:21:33.247556+0000 mgr.a (mgr.14388) 10824 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:34 smithi027 bash[22610]: cluster 2024-08-31T06:21:33.247556+0000 mgr.a (mgr.14388) 10824 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:34 smithi191 bash[24992]: cluster 2024-08-31T06:21:33.247556+0000 mgr.a (mgr.14388) 10824 : cluster [DBG] pgmap v7503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:35.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:35.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:35.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:35.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:35.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:36 smithi163 bash[24253]: cluster 2024-08-31T06:21:35.248276+0000 mgr.a (mgr.14388) 10825 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:36 smithi163 bash[24253]: audit 2024-08-31T06:21:35.304026+0000 mgr.a (mgr.14388) 10826 : audit [DBG] from='client.238776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:36 smithi027 bash[22610]: cluster 2024-08-31T06:21:35.248276+0000 mgr.a (mgr.14388) 10825 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:36 smithi027 bash[22610]: audit 2024-08-31T06:21:35.304026+0000 mgr.a (mgr.14388) 10826 : audit [DBG] from='client.238776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:37.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:36 smithi191 bash[24992]: cluster 2024-08-31T06:21:35.248276+0000 mgr.a (mgr.14388) 10825 : cluster [DBG] pgmap v7504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:37.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:36 smithi191 bash[24992]: audit 2024-08-31T06:21:35.304026+0000 mgr.a (mgr.14388) 10826 : audit [DBG] from='client.238776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:38 smithi163 bash[24253]: cluster 2024-08-31T06:21:37.249182+0000 mgr.a (mgr.14388) 10827 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:38 smithi027 bash[22610]: cluster 2024-08-31T06:21:37.249182+0000 mgr.a (mgr.14388) 10827 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:39.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:38 smithi191 bash[24992]: cluster 2024-08-31T06:21:37.249182+0000 mgr.a (mgr.14388) 10827 : cluster [DBG] pgmap v7505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:40.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:40.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:40.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:40 smithi163 bash[24253]: cluster 2024-08-31T06:21:39.251432+0000 mgr.a (mgr.14388) 10828 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:40 smithi027 bash[22610]: cluster 2024-08-31T06:21:39.251432+0000 mgr.a (mgr.14388) 10828 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:41.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:40 smithi191 bash[24992]: cluster 2024-08-31T06:21:39.251432+0000 mgr.a (mgr.14388) 10828 : cluster [DBG] pgmap v7506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:41.507 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:41.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:41 smithi163 bash[24253]: audit 2024-08-31T06:21:41.066008+0000 mgr.a (mgr.14388) 10829 : audit [DBG] from='client.238851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:41 smithi027 bash[22610]: audit 2024-08-31T06:21:41.066008+0000 mgr.a (mgr.14388) 10829 : audit [DBG] from='client.238851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:42.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:41 smithi191 bash[24992]: audit 2024-08-31T06:21:41.066008+0000 mgr.a (mgr.14388) 10829 : audit [DBG] from='client.238851 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:42 smithi163 bash[24253]: cluster 2024-08-31T06:21:41.252028+0000 mgr.a (mgr.14388) 10830 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:42 smithi027 bash[22610]: cluster 2024-08-31T06:21:41.252028+0000 mgr.a (mgr.14388) 10830 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:43.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:42 smithi191 bash[24992]: cluster 2024-08-31T06:21:41.252028+0000 mgr.a (mgr.14388) 10830 : cluster [DBG] pgmap v7507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:44 smithi163 bash[24253]: cluster 2024-08-31T06:21:43.254304+0000 mgr.a (mgr.14388) 10831 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:44 smithi027 bash[22610]: cluster 2024-08-31T06:21:43.254304+0000 mgr.a (mgr.14388) 10831 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:45.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:44 smithi191 bash[24992]: cluster 2024-08-31T06:21:43.254304+0000 mgr.a (mgr.14388) 10831 : cluster [DBG] pgmap v7508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:46.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:46.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:46.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:46 smithi163 bash[24253]: cluster 2024-08-31T06:21:45.255131+0000 mgr.a (mgr.14388) 10832 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:46 smithi027 bash[22610]: cluster 2024-08-31T06:21:45.255131+0000 mgr.a (mgr.14388) 10832 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:47.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:46 smithi191 bash[24992]: cluster 2024-08-31T06:21:45.255131+0000 mgr.a (mgr.14388) 10832 : cluster [DBG] pgmap v7509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:47.293 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:47.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:47.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:47.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:47.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:47 smithi163 bash[24253]: audit 2024-08-31T06:21:46.841023+0000 mgr.a (mgr.14388) 10833 : audit [DBG] from='client.238929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:47 smithi027 bash[22610]: audit 2024-08-31T06:21:46.841023+0000 mgr.a (mgr.14388) 10833 : audit [DBG] from='client.238929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:48.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:47 smithi191 bash[24992]: audit 2024-08-31T06:21:46.841023+0000 mgr.a (mgr.14388) 10833 : audit [DBG] from='client.238929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:48 smithi163 bash[24253]: cluster 2024-08-31T06:21:47.255835+0000 mgr.a (mgr.14388) 10834 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:48 smithi027 bash[22610]: cluster 2024-08-31T06:21:47.255835+0000 mgr.a (mgr.14388) 10834 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:49.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:48 smithi191 bash[24992]: cluster 2024-08-31T06:21:47.255835+0000 mgr.a (mgr.14388) 10834 : cluster [DBG] pgmap v7510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:50 smithi163 bash[24253]: cluster 2024-08-31T06:21:49.258018+0000 mgr.a (mgr.14388) 10835 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:51.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:50 smithi027 bash[22610]: cluster 2024-08-31T06:21:49.258018+0000 mgr.a (mgr.14388) 10835 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:51.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:50 smithi191 bash[24992]: cluster 2024-08-31T06:21:49.258018+0000 mgr.a (mgr.14388) 10835 : cluster [DBG] pgmap v7511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:21:52.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:52.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:52.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:53.054 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:53.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:52 smithi163 bash[24253]: cluster 2024-08-31T06:21:51.258835+0000 mgr.a (mgr.14388) 10836 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:52 smithi027 bash[22610]: cluster 2024-08-31T06:21:51.258835+0000 mgr.a (mgr.14388) 10836 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:52 smithi191 bash[24992]: cluster 2024-08-31T06:21:51.258835+0000 mgr.a (mgr.14388) 10836 : cluster [DBG] pgmap v7512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:21:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:53 smithi163 bash[24253]: audit 2024-08-31T06:21:52.630138+0000 mgr.a (mgr.14388) 10837 : audit [DBG] from='client.239004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:53 smithi027 bash[22610]: audit 2024-08-31T06:21:52.630138+0000 mgr.a (mgr.14388) 10837 : audit [DBG] from='client.239004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:53 smithi191 bash[24992]: audit 2024-08-31T06:21:52.630138+0000 mgr.a (mgr.14388) 10837 : audit [DBG] from='client.239004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:21:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:54 smithi163 bash[24253]: cluster 2024-08-31T06:21:53.261611+0000 mgr.a (mgr.14388) 10838 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:21:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:54 smithi027 bash[22610]: cluster 2024-08-31T06:21:53.261611+0000 mgr.a (mgr.14388) 10838 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:21:55.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:54 smithi191 bash[24992]: cluster 2024-08-31T06:21:53.261611+0000 mgr.a (mgr.14388) 10838 : cluster [DBG] pgmap v7513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:21:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:56 smithi163 bash[24253]: cluster 2024-08-31T06:21:55.262406+0000 mgr.a (mgr.14388) 10839 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:21:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:56 smithi027 bash[22610]: cluster 2024-08-31T06:21:55.262406+0000 mgr.a (mgr.14388) 10839 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:21:57.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:56 smithi191 bash[24992]: cluster 2024-08-31T06:21:55.262406+0000 mgr.a (mgr.14388) 10839 : cluster [DBG] pgmap v7514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:21:58.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:21:58.057 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:21:58.057 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:21:58.839 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:21:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:21:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:21:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:21:58.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:21:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:58 smithi163 bash[24253]: cluster 2024-08-31T06:21:57.263222+0000 mgr.a (mgr.14388) 10840 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:21:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:58 smithi027 bash[22610]: cluster 2024-08-31T06:21:57.263222+0000 mgr.a (mgr.14388) 10840 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:21:59.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:58 smithi191 bash[24992]: cluster 2024-08-31T06:21:57.263222+0000 mgr.a (mgr.14388) 10840 : cluster [DBG] pgmap v7515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:22:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:21:59 smithi163 bash[24253]: audit 2024-08-31T06:21:58.391049+0000 mgr.a (mgr.14388) 10841 : audit [DBG] from='client.239082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:21:59 smithi027 bash[22610]: audit 2024-08-31T06:21:58.391049+0000 mgr.a (mgr.14388) 10841 : audit [DBG] from='client.239082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:00.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:21:59 smithi191 bash[24992]: audit 2024-08-31T06:21:58.391049+0000 mgr.a (mgr.14388) 10841 : audit [DBG] from='client.239082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:00 smithi163 bash[24253]: cluster 2024-08-31T06:21:59.265956+0000 mgr.a (mgr.14388) 10842 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:00 smithi027 bash[22610]: cluster 2024-08-31T06:21:59.265956+0000 mgr.a (mgr.14388) 10842 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:01.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:00 smithi191 bash[24992]: cluster 2024-08-31T06:21:59.265956+0000 mgr.a (mgr.14388) 10842 : cluster [DBG] pgmap v7516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:02 smithi163 bash[24253]: cluster 2024-08-31T06:22:01.266770+0000 mgr.a (mgr.14388) 10843 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:22:03.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:02 smithi027 bash[22610]: cluster 2024-08-31T06:22:01.266770+0000 mgr.a (mgr.14388) 10843 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:22:03.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:02 smithi191 bash[24992]: cluster 2024-08-31T06:22:01.266770+0000 mgr.a (mgr.14388) 10843 : cluster [DBG] pgmap v7517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:22:03.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:22:03.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:22:03.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:22:04.623 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:22:04.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:22:04.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:22:04.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:22:04.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:22:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:04 smithi163 bash[24253]: cluster 2024-08-31T06:22:03.268737+0000 mgr.a (mgr.14388) 10844 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:04 smithi027 bash[22610]: cluster 2024-08-31T06:22:03.268737+0000 mgr.a (mgr.14388) 10844 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:04 smithi191 bash[24992]: cluster 2024-08-31T06:22:03.268737+0000 mgr.a (mgr.14388) 10844 : cluster [DBG] pgmap v7518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:06.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:05 smithi163 bash[24253]: audit 2024-08-31T06:22:04.177809+0000 mgr.a (mgr.14388) 10845 : audit [DBG] from='client.239157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:05 smithi027 bash[22610]: audit 2024-08-31T06:22:04.177809+0000 mgr.a (mgr.14388) 10845 : audit [DBG] from='client.239157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:06.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:05 smithi191 bash[24992]: audit 2024-08-31T06:22:04.177809+0000 mgr.a (mgr.14388) 10845 : audit [DBG] from='client.239157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:06 smithi163 bash[24253]: cluster 2024-08-31T06:22:05.269637+0000 mgr.a (mgr.14388) 10846 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:22:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:06 smithi163 bash[24253]: audit 2024-08-31T06:22:06.144048+0000 mon.a (mon.0) 2203 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:22:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:06 smithi027 bash[22610]: cluster 2024-08-31T06:22:05.269637+0000 mgr.a (mgr.14388) 10846 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:22:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:06 smithi027 bash[22610]: audit 2024-08-31T06:22:06.144048+0000 mon.a (mon.0) 2203 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:22:07.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:06 smithi191 bash[24992]: cluster 2024-08-31T06:22:05.269637+0000 mgr.a (mgr.14388) 10846 : cluster [DBG] pgmap v7519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:22:07.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:06 smithi191 bash[24992]: audit 2024-08-31T06:22:06.144048+0000 mon.a (mon.0) 2203 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:22:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:07 smithi163 bash[24253]: audit 2024-08-31T06:22:06.988647+0000 mon.a (mon.0) 2204 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:22:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:07 smithi163 bash[24253]: audit 2024-08-31T06:22:06.990386+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:22:08.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:07 smithi163 bash[24253]: audit 2024-08-31T06:22:07.000752+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:22:08.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:07 smithi163 bash[24253]: audit 2024-08-31T06:22:07.005578+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:22:08.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:07 smithi163 bash[24253]: audit 2024-08-31T06:22:07.007975+0000 mgr.a (mgr.14388) 10847 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:22:08.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:22:07 smithi027 bash[22863]: debug 2024-08-31T06:22:07.741+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:22:08.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:22:07 smithi027 bash[22863]: debug 2024-08-31T06:22:07.741+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:22:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:07 smithi027 bash[22610]: audit 2024-08-31T06:22:06.988647+0000 mon.a (mon.0) 2204 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:22:08.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:07 smithi027 bash[22610]: audit 2024-08-31T06:22:06.990386+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:22:08.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:07 smithi027 bash[22610]: audit 2024-08-31T06:22:07.000752+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:22:08.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:07 smithi027 bash[22610]: audit 2024-08-31T06:22:07.005578+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:22:08.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:07 smithi027 bash[22610]: audit 2024-08-31T06:22:07.007975+0000 mgr.a (mgr.14388) 10847 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:22:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:07 smithi191 bash[24992]: audit 2024-08-31T06:22:06.988647+0000 mon.a (mon.0) 2204 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:22:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:07 smithi191 bash[24992]: audit 2024-08-31T06:22:06.990386+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:22:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:07 smithi191 bash[24992]: audit 2024-08-31T06:22:07.000752+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:22:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:07 smithi191 bash[24992]: audit 2024-08-31T06:22:07.005578+0000 mon.a (mon.0) 2207 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:22:08.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:07 smithi191 bash[24992]: audit 2024-08-31T06:22:07.007975+0000 mgr.a (mgr.14388) 10847 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:22:09.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:09 smithi191 bash[24992]: cluster 2024-08-31T06:22:07.270202+0000 mgr.a (mgr.14388) 10848 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:22:09.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:09 smithi191 bash[24992]: audit 2024-08-31T06:22:07.742768+0000 mgr.a (mgr.14388) 10849 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:22:09.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:09 smithi191 bash[24992]: cephadm 2024-08-31T06:22:07.743957+0000 mgr.a (mgr.14388) 10850 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:22:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:09 smithi163 bash[24253]: cluster 2024-08-31T06:22:07.270202+0000 mgr.a (mgr.14388) 10848 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:22:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:09 smithi163 bash[24253]: audit 2024-08-31T06:22:07.742768+0000 mgr.a (mgr.14388) 10849 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:22:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:09 smithi163 bash[24253]: cephadm 2024-08-31T06:22:07.743957+0000 mgr.a (mgr.14388) 10850 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:22:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:09 smithi027 bash[22610]: cluster 2024-08-31T06:22:07.270202+0000 mgr.a (mgr.14388) 10848 : cluster [DBG] pgmap v7520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:22:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:09 smithi027 bash[22610]: audit 2024-08-31T06:22:07.742768+0000 mgr.a (mgr.14388) 10849 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:22:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:09 smithi027 bash[22610]: cephadm 2024-08-31T06:22:07.743957+0000 mgr.a (mgr.14388) 10850 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:22:09.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:22:09.625 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:22:09.625 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:22:10.375 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:22:10.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:22:10.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:22:10.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:22:10.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:22:11.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:11 smithi191 bash[24992]: cluster 2024-08-31T06:22:09.272496+0000 mgr.a (mgr.14388) 10851 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:11.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:11 smithi191 bash[24992]: audit 2024-08-31T06:22:09.951549+0000 mgr.a (mgr.14388) 10852 : audit [DBG] from='client.239343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:11 smithi163 bash[24253]: cluster 2024-08-31T06:22:09.272496+0000 mgr.a (mgr.14388) 10851 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:11 smithi163 bash[24253]: audit 2024-08-31T06:22:09.951549+0000 mgr.a (mgr.14388) 10852 : audit [DBG] from='client.239343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:11 smithi027 bash[22610]: cluster 2024-08-31T06:22:09.272496+0000 mgr.a (mgr.14388) 10851 : cluster [DBG] pgmap v7521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:11 smithi027 bash[22610]: audit 2024-08-31T06:22:09.951549+0000 mgr.a (mgr.14388) 10852 : audit [DBG] from='client.239343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:13.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:13 smithi191 bash[24992]: cluster 2024-08-31T06:22:11.273405+0000 mgr.a (mgr.14388) 10853 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:13 smithi163 bash[24253]: cluster 2024-08-31T06:22:11.273405+0000 mgr.a (mgr.14388) 10853 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:13 smithi027 bash[22610]: cluster 2024-08-31T06:22:11.273405+0000 mgr.a (mgr.14388) 10853 : cluster [DBG] pgmap v7522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:15.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:15 smithi191 bash[24992]: cluster 2024-08-31T06:22:13.275621+0000 mgr.a (mgr.14388) 10854 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:15.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:22:15.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:22:15.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:22:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:15 smithi163 bash[24253]: cluster 2024-08-31T06:22:13.275621+0000 mgr.a (mgr.14388) 10854 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:15 smithi027 bash[22610]: cluster 2024-08-31T06:22:13.275621+0000 mgr.a (mgr.14388) 10854 : cluster [DBG] pgmap v7523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:16.150 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:22:16.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:22:16.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:22:16.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:22:16.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:22:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:17 smithi191 bash[24992]: cluster 2024-08-31T06:22:15.276376+0000 mgr.a (mgr.14388) 10855 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:17 smithi191 bash[24992]: audit 2024-08-31T06:22:15.712927+0000 mgr.a (mgr.14388) 10856 : audit [DBG] from='client.239418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:17 smithi163 bash[24253]: cluster 2024-08-31T06:22:15.276376+0000 mgr.a (mgr.14388) 10855 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:17 smithi163 bash[24253]: audit 2024-08-31T06:22:15.712927+0000 mgr.a (mgr.14388) 10856 : audit [DBG] from='client.239418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:17 smithi027 bash[22610]: cluster 2024-08-31T06:22:15.276376+0000 mgr.a (mgr.14388) 10855 : cluster [DBG] pgmap v7524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:17 smithi027 bash[22610]: audit 2024-08-31T06:22:15.712927+0000 mgr.a (mgr.14388) 10856 : audit [DBG] from='client.239418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:19.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:19 smithi191 bash[24992]: cluster 2024-08-31T06:22:17.277296+0000 mgr.a (mgr.14388) 10857 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:19 smithi163 bash[24253]: cluster 2024-08-31T06:22:17.277296+0000 mgr.a (mgr.14388) 10857 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:19 smithi027 bash[22610]: cluster 2024-08-31T06:22:17.277296+0000 mgr.a (mgr.14388) 10857 : cluster [DBG] pgmap v7525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:21.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:22:21.153 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:22:21.153 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:22:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:21 smithi191 bash[24992]: cluster 2024-08-31T06:22:19.279610+0000 mgr.a (mgr.14388) 10858 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:21 smithi163 bash[24253]: cluster 2024-08-31T06:22:19.279610+0000 mgr.a (mgr.14388) 10858 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:21 smithi027 bash[22610]: cluster 2024-08-31T06:22:19.279610+0000 mgr.a (mgr.14388) 10858 : cluster [DBG] pgmap v7526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:22:21.928 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:22:21.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:22:21.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:22:21.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:22:21.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:22:23.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:23 smithi191 bash[24992]: cluster 2024-08-31T06:22:21.280084+0000 mgr.a (mgr.14388) 10859 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:23.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:23 smithi191 bash[24992]: audit 2024-08-31T06:22:21.484152+0000 mgr.a (mgr.14388) 10860 : audit [DBG] from='client.239496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:23 smithi163 bash[24253]: cluster 2024-08-31T06:22:21.280084+0000 mgr.a (mgr.14388) 10859 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:23 smithi163 bash[24253]: audit 2024-08-31T06:22:21.484152+0000 mgr.a (mgr.14388) 10860 : audit [DBG] from='client.239496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:23 smithi027 bash[22610]: cluster 2024-08-31T06:22:21.280084+0000 mgr.a (mgr.14388) 10859 : cluster [DBG] pgmap v7527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:23 smithi027 bash[22610]: audit 2024-08-31T06:22:21.484152+0000 mgr.a (mgr.14388) 10860 : audit [DBG] from='client.239496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:25 smithi163 bash[24253]: cluster 2024-08-31T06:22:23.282431+0000 mgr.a (mgr.14388) 10861 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:25 smithi027 bash[22610]: cluster 2024-08-31T06:22:23.282431+0000 mgr.a (mgr.14388) 10861 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:25 smithi191 bash[24992]: cluster 2024-08-31T06:22:23.282431+0000 mgr.a (mgr.14388) 10861 : cluster [DBG] pgmap v7528: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:26.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:22:26.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:22:26.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:22:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:27 smithi163 bash[24253]: cluster 2024-08-31T06:22:25.283415+0000 mgr.a (mgr.14388) 10862 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:27 smithi027 bash[22610]: cluster 2024-08-31T06:22:25.283415+0000 mgr.a (mgr.14388) 10862 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:27 smithi191 bash[24992]: cluster 2024-08-31T06:22:25.283415+0000 mgr.a (mgr.14388) 10862 : cluster [DBG] pgmap v7529: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:27.673 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:22:27.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:22:27.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:22:27.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:22:27.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:22:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:29 smithi163 bash[24253]: audit 2024-08-31T06:22:27.260191+0000 mgr.a (mgr.14388) 10863 : audit [DBG] from='client.239574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:29 smithi163 bash[24253]: cluster 2024-08-31T06:22:27.284270+0000 mgr.a (mgr.14388) 10864 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:29 smithi027 bash[22610]: audit 2024-08-31T06:22:27.260191+0000 mgr.a (mgr.14388) 10863 : audit [DBG] from='client.239574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:29 smithi027 bash[22610]: cluster 2024-08-31T06:22:27.284270+0000 mgr.a (mgr.14388) 10864 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:29.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:29 smithi191 bash[24992]: audit 2024-08-31T06:22:27.260191+0000 mgr.a (mgr.14388) 10863 : audit [DBG] from='client.239574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:29.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:29 smithi191 bash[24992]: cluster 2024-08-31T06:22:27.284270+0000 mgr.a (mgr.14388) 10864 : cluster [DBG] pgmap v7530: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:31 smithi163 bash[24253]: cluster 2024-08-31T06:22:29.286616+0000 mgr.a (mgr.14388) 10865 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:31 smithi027 bash[22610]: cluster 2024-08-31T06:22:29.286616+0000 mgr.a (mgr.14388) 10865 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:31.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:31 smithi191 bash[24992]: cluster 2024-08-31T06:22:29.286616+0000 mgr.a (mgr.14388) 10865 : cluster [DBG] pgmap v7531: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:32.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:22:32.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:22:32.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:22:33.447 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:22:33.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:22:33.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:22:33.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:22:33.448 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:22:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:33 smithi163 bash[24253]: cluster 2024-08-31T06:22:31.287361+0000 mgr.a (mgr.14388) 10866 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:33 smithi027 bash[22610]: cluster 2024-08-31T06:22:31.287361+0000 mgr.a (mgr.14388) 10866 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:33.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:33 smithi191 bash[24992]: cluster 2024-08-31T06:22:31.287361+0000 mgr.a (mgr.14388) 10866 : cluster [DBG] pgmap v7532: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:34 smithi163 bash[24253]: audit 2024-08-31T06:22:33.012475+0000 mgr.a (mgr.14388) 10867 : audit [DBG] from='client.239652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:34 smithi027 bash[22610]: audit 2024-08-31T06:22:33.012475+0000 mgr.a (mgr.14388) 10867 : audit [DBG] from='client.239652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:34.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:34 smithi191 bash[24992]: audit 2024-08-31T06:22:33.012475+0000 mgr.a (mgr.14388) 10867 : audit [DBG] from='client.239652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:35 smithi163 bash[24253]: cluster 2024-08-31T06:22:33.288668+0000 mgr.a (mgr.14388) 10868 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:35 smithi027 bash[22610]: cluster 2024-08-31T06:22:33.288668+0000 mgr.a (mgr.14388) 10868 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:35 smithi191 bash[24992]: cluster 2024-08-31T06:22:33.288668+0000 mgr.a (mgr.14388) 10868 : cluster [DBG] pgmap v7533: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:22:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:37 smithi163 bash[24253]: cluster 2024-08-31T06:22:35.289700+0000 mgr.a (mgr.14388) 10869 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:22:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:37 smithi027 bash[22610]: cluster 2024-08-31T06:22:35.289700+0000 mgr.a (mgr.14388) 10869 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:22:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:37 smithi191 bash[24992]: cluster 2024-08-31T06:22:35.289700+0000 mgr.a (mgr.14388) 10869 : cluster [DBG] pgmap v7534: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:22:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:22:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:22:38.449 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:22:39.228 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:22:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:22:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:22:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:22:39.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:22:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:39 smithi163 bash[24253]: cluster 2024-08-31T06:22:37.290691+0000 mgr.a (mgr.14388) 10870 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:22:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:39 smithi027 bash[22610]: cluster 2024-08-31T06:22:37.290691+0000 mgr.a (mgr.14388) 10870 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:22:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:39 smithi191 bash[24992]: cluster 2024-08-31T06:22:37.290691+0000 mgr.a (mgr.14388) 10870 : cluster [DBG] pgmap v7535: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:22:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:40 smithi163 bash[24253]: audit 2024-08-31T06:22:38.786265+0000 mgr.a (mgr.14388) 10871 : audit [DBG] from='client.239730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:40 smithi027 bash[22610]: audit 2024-08-31T06:22:38.786265+0000 mgr.a (mgr.14388) 10871 : audit [DBG] from='client.239730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:40.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:40 smithi191 bash[24992]: audit 2024-08-31T06:22:38.786265+0000 mgr.a (mgr.14388) 10871 : audit [DBG] from='client.239730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:41 smithi163 bash[24253]: cluster 2024-08-31T06:22:39.292248+0000 mgr.a (mgr.14388) 10872 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:41 smithi027 bash[22610]: cluster 2024-08-31T06:22:39.292248+0000 mgr.a (mgr.14388) 10872 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:41 smithi191 bash[24992]: cluster 2024-08-31T06:22:39.292248+0000 mgr.a (mgr.14388) 10872 : cluster [DBG] pgmap v7536: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:43 smithi163 bash[24253]: cluster 2024-08-31T06:22:41.293005+0000 mgr.a (mgr.14388) 10873 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T06:22:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:43 smithi027 bash[22610]: cluster 2024-08-31T06:22:41.293005+0000 mgr.a (mgr.14388) 10873 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T06:22:43.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:43 smithi191 bash[24992]: cluster 2024-08-31T06:22:41.293005+0000 mgr.a (mgr.14388) 10873 : cluster [DBG] pgmap v7537: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T06:22:44.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:22:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:22:44.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:22:44.979 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:22:44.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:22:44.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:22:44.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:22:44.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:22:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:45 smithi163 bash[24253]: cluster 2024-08-31T06:22:43.295138+0000 mgr.a (mgr.14388) 10874 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:45 smithi027 bash[22610]: cluster 2024-08-31T06:22:43.295138+0000 mgr.a (mgr.14388) 10874 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:45.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:45 smithi191 bash[24992]: cluster 2024-08-31T06:22:43.295138+0000 mgr.a (mgr.14388) 10874 : cluster [DBG] pgmap v7538: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:46 smithi163 bash[24253]: audit 2024-08-31T06:22:44.559269+0000 mgr.a (mgr.14388) 10875 : audit [DBG] from='client.239808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:46 smithi027 bash[22610]: audit 2024-08-31T06:22:44.559269+0000 mgr.a (mgr.14388) 10875 : audit [DBG] from='client.239808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:46.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:46 smithi191 bash[24992]: audit 2024-08-31T06:22:44.559269+0000 mgr.a (mgr.14388) 10875 : audit [DBG] from='client.239808 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:47 smithi163 bash[24253]: cluster 2024-08-31T06:22:45.296040+0000 mgr.a (mgr.14388) 10876 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:47 smithi027 bash[22610]: cluster 2024-08-31T06:22:45.296040+0000 mgr.a (mgr.14388) 10876 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:47 smithi191 bash[24992]: cluster 2024-08-31T06:22:45.296040+0000 mgr.a (mgr.14388) 10876 : cluster [DBG] pgmap v7539: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:49 smithi163 bash[24253]: cluster 2024-08-31T06:22:47.296832+0000 mgr.a (mgr.14388) 10877 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:49 smithi027 bash[22610]: cluster 2024-08-31T06:22:47.296832+0000 mgr.a (mgr.14388) 10877 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:49.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:49 smithi191 bash[24992]: cluster 2024-08-31T06:22:47.296832+0000 mgr.a (mgr.14388) 10877 : cluster [DBG] pgmap v7540: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:22:49.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:22:49.982 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:22:49.982 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:22:50.761 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:22:50.761 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:22:50.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:22:50.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:22:50.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:22:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:51 smithi163 bash[24253]: cluster 2024-08-31T06:22:49.299069+0000 mgr.a (mgr.14388) 10878 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:22:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:51 smithi027 bash[22610]: cluster 2024-08-31T06:22:49.299069+0000 mgr.a (mgr.14388) 10878 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:22:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:51 smithi191 bash[24992]: cluster 2024-08-31T06:22:49.299069+0000 mgr.a (mgr.14388) 10878 : cluster [DBG] pgmap v7541: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:22:52.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:52 smithi163 bash[24253]: audit 2024-08-31T06:22:50.314862+0000 mgr.a (mgr.14388) 10879 : audit [DBG] from='client.239886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:52 smithi027 bash[22610]: audit 2024-08-31T06:22:50.314862+0000 mgr.a (mgr.14388) 10879 : audit [DBG] from='client.239886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:52.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:52 smithi191 bash[24992]: audit 2024-08-31T06:22:50.314862+0000 mgr.a (mgr.14388) 10879 : audit [DBG] from='client.239886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:53 smithi163 bash[24253]: cluster 2024-08-31T06:22:51.299981+0000 mgr.a (mgr.14388) 10880 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:53 smithi027 bash[22610]: cluster 2024-08-31T06:22:51.299981+0000 mgr.a (mgr.14388) 10880 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:53 smithi191 bash[24992]: cluster 2024-08-31T06:22:51.299981+0000 mgr.a (mgr.14388) 10880 : cluster [DBG] pgmap v7542: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:55 smithi163 bash[24253]: cluster 2024-08-31T06:22:53.302276+0000 mgr.a (mgr.14388) 10881 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:22:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:55 smithi027 bash[22610]: cluster 2024-08-31T06:22:53.302276+0000 mgr.a (mgr.14388) 10881 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:22:55.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:55 smithi191 bash[24992]: cluster 2024-08-31T06:22:53.302276+0000 mgr.a (mgr.14388) 10881 : cluster [DBG] pgmap v7543: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:22:55.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:22:55.763 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:22:55.763 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:22:56.524 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:22:56.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:22:56.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:22:56.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:22:56.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:22:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:57 smithi163 bash[24253]: cluster 2024-08-31T06:22:55.303258+0000 mgr.a (mgr.14388) 10882 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:57 smithi163 bash[24253]: audit 2024-08-31T06:22:56.093123+0000 mgr.a (mgr.14388) 10883 : audit [DBG] from='client.239964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:57 smithi027 bash[22610]: cluster 2024-08-31T06:22:55.303258+0000 mgr.a (mgr.14388) 10882 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:57 smithi027 bash[22610]: audit 2024-08-31T06:22:56.093123+0000 mgr.a (mgr.14388) 10883 : audit [DBG] from='client.239964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:57.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:57 smithi191 bash[24992]: cluster 2024-08-31T06:22:55.303258+0000 mgr.a (mgr.14388) 10882 : cluster [DBG] pgmap v7544: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:57.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:57 smithi191 bash[24992]: audit 2024-08-31T06:22:56.093123+0000 mgr.a (mgr.14388) 10883 : audit [DBG] from='client.239964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:22:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:22:59 smithi163 bash[24253]: cluster 2024-08-31T06:22:57.304193+0000 mgr.a (mgr.14388) 10884 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:22:59 smithi027 bash[22610]: cluster 2024-08-31T06:22:57.304193+0000 mgr.a (mgr.14388) 10884 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:22:59.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:22:59 smithi191 bash[24992]: cluster 2024-08-31T06:22:57.304193+0000 mgr.a (mgr.14388) 10884 : cluster [DBG] pgmap v7545: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:01 smithi163 bash[24253]: cluster 2024-08-31T06:22:59.306326+0000 mgr.a (mgr.14388) 10885 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:01 smithi027 bash[22610]: cluster 2024-08-31T06:22:59.306326+0000 mgr.a (mgr.14388) 10885 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:01.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:01.526 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:01.526 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:01 smithi191 bash[24992]: cluster 2024-08-31T06:22:59.306326+0000 mgr.a (mgr.14388) 10885 : cluster [DBG] pgmap v7546: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:02.310 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:02.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:02.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:02.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:23:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:03 smithi163 bash[24253]: cluster 2024-08-31T06:23:01.307107+0000 mgr.a (mgr.14388) 10886 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:03 smithi163 bash[24253]: audit 2024-08-31T06:23:01.859143+0000 mgr.a (mgr.14388) 10887 : audit [DBG] from='client.240042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:03 smithi027 bash[22610]: cluster 2024-08-31T06:23:01.307107+0000 mgr.a (mgr.14388) 10886 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:03 smithi027 bash[22610]: audit 2024-08-31T06:23:01.859143+0000 mgr.a (mgr.14388) 10887 : audit [DBG] from='client.240042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:03 smithi191 bash[24992]: cluster 2024-08-31T06:23:01.307107+0000 mgr.a (mgr.14388) 10886 : cluster [DBG] pgmap v7547: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:03 smithi191 bash[24992]: audit 2024-08-31T06:23:01.859143+0000 mgr.a (mgr.14388) 10887 : audit [DBG] from='client.240042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:05 smithi163 bash[24253]: cluster 2024-08-31T06:23:03.309405+0000 mgr.a (mgr.14388) 10888 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:05 smithi027 bash[22610]: cluster 2024-08-31T06:23:03.309405+0000 mgr.a (mgr.14388) 10888 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:05.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:05 smithi191 bash[24992]: cluster 2024-08-31T06:23:03.309405+0000 mgr.a (mgr.14388) 10888 : cluster [DBG] pgmap v7548: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:07.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:07.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:07.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:07 smithi163 bash[24253]: cluster 2024-08-31T06:23:05.310156+0000 mgr.a (mgr.14388) 10889 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:07 smithi027 bash[22610]: cluster 2024-08-31T06:23:05.310156+0000 mgr.a (mgr.14388) 10889 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:07.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:07 smithi191 bash[24992]: cluster 2024-08-31T06:23:05.310156+0000 mgr.a (mgr.14388) 10889 : cluster [DBG] pgmap v7549: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:08.117 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:08.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:08.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:08.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:08.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:23:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:08 smithi163 bash[24253]: audit 2024-08-31T06:23:07.800560+0000 mon.a (mon.0) 2208 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:23:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:08 smithi027 bash[22610]: audit 2024-08-31T06:23:07.800560+0000 mon.a (mon.0) 2208 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:23:08.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:08 smithi191 bash[24992]: audit 2024-08-31T06:23:07.800560+0000 mon.a (mon.0) 2208 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:23:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:09 smithi163 bash[24253]: cluster 2024-08-31T06:23:07.310978+0000 mgr.a (mgr.14388) 10890 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:09 smithi163 bash[24253]: audit 2024-08-31T06:23:07.653833+0000 mgr.a (mgr.14388) 10891 : audit [DBG] from='client.240117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:09.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:09 smithi163 bash[24253]: audit 2024-08-31T06:23:08.582690+0000 mon.a (mon.0) 2209 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:23:09.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:09 smithi163 bash[24253]: audit 2024-08-31T06:23:08.584627+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:23:09.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:09 smithi163 bash[24253]: audit 2024-08-31T06:23:08.595283+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:23:09.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:09 smithi163 bash[24253]: audit 2024-08-31T06:23:08.600138+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:23:09.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:23:09 smithi027 bash[22863]: debug 2024-08-31T06:23:09.311+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:23:09.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:23:09 smithi027 bash[22863]: debug 2024-08-31T06:23:09.311+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:23:09.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:09 smithi027 bash[22610]: cluster 2024-08-31T06:23:07.310978+0000 mgr.a (mgr.14388) 10890 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:09.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:09 smithi027 bash[22610]: audit 2024-08-31T06:23:07.653833+0000 mgr.a (mgr.14388) 10891 : audit [DBG] from='client.240117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:09.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:09 smithi027 bash[22610]: audit 2024-08-31T06:23:08.582690+0000 mon.a (mon.0) 2209 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:23:09.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:09 smithi027 bash[22610]: audit 2024-08-31T06:23:08.584627+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:23:09.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:09 smithi027 bash[22610]: audit 2024-08-31T06:23:08.595283+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:23:09.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:09 smithi027 bash[22610]: audit 2024-08-31T06:23:08.600138+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:23:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:09 smithi191 bash[24992]: cluster 2024-08-31T06:23:07.310978+0000 mgr.a (mgr.14388) 10890 : cluster [DBG] pgmap v7550: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:09 smithi191 bash[24992]: audit 2024-08-31T06:23:07.653833+0000 mgr.a (mgr.14388) 10891 : audit [DBG] from='client.240117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:09 smithi191 bash[24992]: audit 2024-08-31T06:23:08.582690+0000 mon.a (mon.0) 2209 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:23:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:09 smithi191 bash[24992]: audit 2024-08-31T06:23:08.584627+0000 mon.a (mon.0) 2210 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:23:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:09 smithi191 bash[24992]: audit 2024-08-31T06:23:08.595283+0000 mon.a (mon.0) 2211 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:23:09.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:09 smithi191 bash[24992]: audit 2024-08-31T06:23:08.600138+0000 mon.a (mon.0) 2212 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:23:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:10 smithi163 bash[24253]: audit 2024-08-31T06:23:08.601532+0000 mgr.a (mgr.14388) 10892 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:23:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:10 smithi027 bash[22610]: audit 2024-08-31T06:23:08.601532+0000 mgr.a (mgr.14388) 10892 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:23:10.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:10 smithi191 bash[24992]: audit 2024-08-31T06:23:08.601532+0000 mgr.a (mgr.14388) 10892 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:23:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:11 smithi163 bash[24253]: cluster 2024-08-31T06:23:09.312158+0000 mgr.a (mgr.14388) 10893 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:23:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:11 smithi163 bash[24253]: audit 2024-08-31T06:23:09.317126+0000 mgr.a (mgr.14388) 10894 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:23:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:11 smithi163 bash[24253]: cephadm 2024-08-31T06:23:09.318341+0000 mgr.a (mgr.14388) 10895 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:23:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:11 smithi027 bash[22610]: cluster 2024-08-31T06:23:09.312158+0000 mgr.a (mgr.14388) 10893 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:23:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:11 smithi027 bash[22610]: audit 2024-08-31T06:23:09.317126+0000 mgr.a (mgr.14388) 10894 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:23:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:11 smithi027 bash[22610]: cephadm 2024-08-31T06:23:09.318341+0000 mgr.a (mgr.14388) 10895 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:23:11.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:11 smithi191 bash[24992]: cluster 2024-08-31T06:23:09.312158+0000 mgr.a (mgr.14388) 10893 : cluster [DBG] pgmap v7551: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:23:11.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:11 smithi191 bash[24992]: audit 2024-08-31T06:23:09.317126+0000 mgr.a (mgr.14388) 10894 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:23:11.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:11 smithi191 bash[24992]: cephadm 2024-08-31T06:23:09.318341+0000 mgr.a (mgr.14388) 10895 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:23:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:12 smithi163 bash[24253]: cluster 2024-08-31T06:23:11.312896+0000 mgr.a (mgr.14388) 10896 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:23:12.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:12 smithi027 bash[22610]: cluster 2024-08-31T06:23:11.312896+0000 mgr.a (mgr.14388) 10896 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:23:12.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:12 smithi191 bash[24992]: cluster 2024-08-31T06:23:11.312896+0000 mgr.a (mgr.14388) 10896 : cluster [DBG] pgmap v7552: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:23:13.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:13.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:13.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:13.878 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:13.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:13.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:13.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:13.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:23:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:14 smithi163 bash[24253]: cluster 2024-08-31T06:23:13.314809+0000 mgr.a (mgr.14388) 10897 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:23:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:14 smithi163 bash[24253]: audit 2024-08-31T06:23:13.449562+0000 mgr.a (mgr.14388) 10898 : audit [DBG] from='client.240303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:14 smithi027 bash[22610]: cluster 2024-08-31T06:23:13.314809+0000 mgr.a (mgr.14388) 10897 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:23:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:14 smithi027 bash[22610]: audit 2024-08-31T06:23:13.449562+0000 mgr.a (mgr.14388) 10898 : audit [DBG] from='client.240303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:14.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:14 smithi191 bash[24992]: cluster 2024-08-31T06:23:13.314809+0000 mgr.a (mgr.14388) 10897 : cluster [DBG] pgmap v7553: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:23:14.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:14 smithi191 bash[24992]: audit 2024-08-31T06:23:13.449562+0000 mgr.a (mgr.14388) 10898 : audit [DBG] from='client.240303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:16.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:16 smithi163 bash[24253]: cluster 2024-08-31T06:23:15.315665+0000 mgr.a (mgr.14388) 10899 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:23:16.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:16 smithi027 bash[22610]: cluster 2024-08-31T06:23:15.315665+0000 mgr.a (mgr.14388) 10899 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:23:16.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:16 smithi191 bash[24992]: cluster 2024-08-31T06:23:15.315665+0000 mgr.a (mgr.14388) 10899 : cluster [DBG] pgmap v7554: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:23:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:18 smithi163 bash[24253]: cluster 2024-08-31T06:23:17.316421+0000 mgr.a (mgr.14388) 10900 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:23:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:18 smithi027 bash[22610]: cluster 2024-08-31T06:23:17.316421+0000 mgr.a (mgr.14388) 10900 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:23:18.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:18 smithi191 bash[24992]: cluster 2024-08-31T06:23:17.316421+0000 mgr.a (mgr.14388) 10900 : cluster [DBG] pgmap v7555: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:23:18.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:18.880 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:18.880 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:19.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:19.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:19.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:19.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:23:19.659 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:20.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:20 smithi163 bash[24253]: audit 2024-08-31T06:23:19.215565+0000 mgr.a (mgr.14388) 10901 : audit [DBG] from='client.240381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:20.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:20 smithi163 bash[24253]: cluster 2024-08-31T06:23:19.317685+0000 mgr.a (mgr.14388) 10902 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:23:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:20 smithi027 bash[22610]: audit 2024-08-31T06:23:19.215565+0000 mgr.a (mgr.14388) 10901 : audit [DBG] from='client.240381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:20 smithi027 bash[22610]: cluster 2024-08-31T06:23:19.317685+0000 mgr.a (mgr.14388) 10902 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:23:20.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:20 smithi191 bash[24992]: audit 2024-08-31T06:23:19.215565+0000 mgr.a (mgr.14388) 10901 : audit [DBG] from='client.240381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:20.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:20 smithi191 bash[24992]: cluster 2024-08-31T06:23:19.317685+0000 mgr.a (mgr.14388) 10902 : cluster [DBG] pgmap v7556: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:23:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:22 smithi163 bash[24253]: cluster 2024-08-31T06:23:21.318609+0000 mgr.a (mgr.14388) 10903 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:23:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:22 smithi027 bash[22610]: cluster 2024-08-31T06:23:21.318609+0000 mgr.a (mgr.14388) 10903 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:23:22.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:22 smithi191 bash[24992]: cluster 2024-08-31T06:23:21.318609+0000 mgr.a (mgr.14388) 10903 : cluster [DBG] pgmap v7557: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:23:24.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:24.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:24.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:24.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:24 smithi163 bash[24253]: cluster 2024-08-31T06:23:23.320866+0000 mgr.a (mgr.14388) 10904 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:23:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:24 smithi027 bash[22610]: cluster 2024-08-31T06:23:23.320866+0000 mgr.a (mgr.14388) 10904 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:23:24.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:24 smithi191 bash[24992]: cluster 2024-08-31T06:23:23.320866+0000 mgr.a (mgr.14388) 10904 : cluster [DBG] pgmap v7558: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:23:25.429 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:25.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:25.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:25.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:25.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:23:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:25 smithi163 bash[24253]: audit 2024-08-31T06:23:24.995831+0000 mgr.a (mgr.14388) 10905 : audit [DBG] from='client.240456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:25 smithi027 bash[22610]: audit 2024-08-31T06:23:24.995831+0000 mgr.a (mgr.14388) 10905 : audit [DBG] from='client.240456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:25 smithi191 bash[24992]: audit 2024-08-31T06:23:24.995831+0000 mgr.a (mgr.14388) 10905 : audit [DBG] from='client.240456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:26 smithi163 bash[24253]: cluster 2024-08-31T06:23:25.325952+0000 mgr.a (mgr.14388) 10906 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:26.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:26 smithi027 bash[22610]: cluster 2024-08-31T06:23:25.325952+0000 mgr.a (mgr.14388) 10906 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:26.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:26 smithi191 bash[24992]: cluster 2024-08-31T06:23:25.325952+0000 mgr.a (mgr.14388) 10906 : cluster [DBG] pgmap v7559: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:28 smithi163 bash[24253]: cluster 2024-08-31T06:23:27.326778+0000 mgr.a (mgr.14388) 10907 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:28.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:28 smithi027 bash[22610]: cluster 2024-08-31T06:23:27.326778+0000 mgr.a (mgr.14388) 10907 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:28.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:28 smithi191 bash[24992]: cluster 2024-08-31T06:23:27.326778+0000 mgr.a (mgr.14388) 10907 : cluster [DBG] pgmap v7560: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:30.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:30.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:30.431 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:30.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:30 smithi163 bash[24253]: cluster 2024-08-31T06:23:29.329443+0000 mgr.a (mgr.14388) 10908 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:30 smithi027 bash[22610]: cluster 2024-08-31T06:23:29.329443+0000 mgr.a (mgr.14388) 10908 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:30.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:30 smithi191 bash[24992]: cluster 2024-08-31T06:23:29.329443+0000 mgr.a (mgr.14388) 10908 : cluster [DBG] pgmap v7561: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:31.182 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:31.182 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:23:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:31 smithi163 bash[24253]: audit 2024-08-31T06:23:30.759727+0000 mgr.a (mgr.14388) 10909 : audit [DBG] from='client.240534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:31 smithi027 bash[22610]: audit 2024-08-31T06:23:30.759727+0000 mgr.a (mgr.14388) 10909 : audit [DBG] from='client.240534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:31.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:31 smithi191 bash[24992]: audit 2024-08-31T06:23:30.759727+0000 mgr.a (mgr.14388) 10909 : audit [DBG] from='client.240534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:32 smithi163 bash[24253]: cluster 2024-08-31T06:23:31.330452+0000 mgr.a (mgr.14388) 10910 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:32.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:32 smithi027 bash[22610]: cluster 2024-08-31T06:23:31.330452+0000 mgr.a (mgr.14388) 10910 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:32.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:32 smithi191 bash[24992]: cluster 2024-08-31T06:23:31.330452+0000 mgr.a (mgr.14388) 10910 : cluster [DBG] pgmap v7562: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:34 smithi163 bash[24253]: cluster 2024-08-31T06:23:33.332607+0000 mgr.a (mgr.14388) 10911 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:34 smithi027 bash[22610]: cluster 2024-08-31T06:23:33.332607+0000 mgr.a (mgr.14388) 10911 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:34.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:34 smithi191 bash[24992]: cluster 2024-08-31T06:23:33.332607+0000 mgr.a (mgr.14388) 10911 : cluster [DBG] pgmap v7563: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:36.183 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:36.184 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:36.184 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:36 smithi163 bash[24253]: cluster 2024-08-31T06:23:35.333380+0000 mgr.a (mgr.14388) 10912 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:36 smithi027 bash[22610]: cluster 2024-08-31T06:23:35.333380+0000 mgr.a (mgr.14388) 10912 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:36 smithi191 bash[24992]: cluster 2024-08-31T06:23:35.333380+0000 mgr.a (mgr.14388) 10912 : cluster [DBG] pgmap v7564: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:36.922 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:36.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:36.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:36.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:36.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:23:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:37 smithi163 bash[24253]: audit 2024-08-31T06:23:36.507096+0000 mgr.a (mgr.14388) 10913 : audit [DBG] from='client.240606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:37 smithi027 bash[22610]: audit 2024-08-31T06:23:36.507096+0000 mgr.a (mgr.14388) 10913 : audit [DBG] from='client.240606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:37.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:37 smithi191 bash[24992]: audit 2024-08-31T06:23:36.507096+0000 mgr.a (mgr.14388) 10913 : audit [DBG] from='client.240606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:38 smithi163 bash[24253]: cluster 2024-08-31T06:23:37.334284+0000 mgr.a (mgr.14388) 10914 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:38 smithi027 bash[22610]: cluster 2024-08-31T06:23:37.334284+0000 mgr.a (mgr.14388) 10914 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:38 smithi191 bash[24992]: cluster 2024-08-31T06:23:37.334284+0000 mgr.a (mgr.14388) 10914 : cluster [DBG] pgmap v7565: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:40 smithi163 bash[24253]: cluster 2024-08-31T06:23:39.336563+0000 mgr.a (mgr.14388) 10915 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:40 smithi027 bash[22610]: cluster 2024-08-31T06:23:39.336563+0000 mgr.a (mgr.14388) 10915 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:40.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:40 smithi191 bash[24992]: cluster 2024-08-31T06:23:39.336563+0000 mgr.a (mgr.14388) 10915 : cluster [DBG] pgmap v7566: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:42.681 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:42.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:42.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:42.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:42.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:23:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:42 smithi163 bash[24253]: cluster 2024-08-31T06:23:41.337346+0000 mgr.a (mgr.14388) 10916 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:42 smithi027 bash[22610]: cluster 2024-08-31T06:23:41.337346+0000 mgr.a (mgr.14388) 10916 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:42.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:42 smithi191 bash[24992]: cluster 2024-08-31T06:23:41.337346+0000 mgr.a (mgr.14388) 10916 : cluster [DBG] pgmap v7567: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:43 smithi027 bash[22610]: audit 2024-08-31T06:23:42.253788+0000 mgr.a (mgr.14388) 10917 : audit [DBG] from='client.240681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:43.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:43 smithi191 bash[24992]: audit 2024-08-31T06:23:42.253788+0000 mgr.a (mgr.14388) 10917 : audit [DBG] from='client.240681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:43.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:43 smithi163 bash[24253]: audit 2024-08-31T06:23:42.253788+0000 mgr.a (mgr.14388) 10917 : audit [DBG] from='client.240681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:44.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:44 smithi027 bash[22610]: cluster 2024-08-31T06:23:43.339695+0000 mgr.a (mgr.14388) 10918 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:44.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:44 smithi191 bash[24992]: cluster 2024-08-31T06:23:43.339695+0000 mgr.a (mgr.14388) 10918 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:44.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:44 smithi163 bash[24253]: cluster 2024-08-31T06:23:43.339695+0000 mgr.a (mgr.14388) 10918 : cluster [DBG] pgmap v7568: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:23:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:46 smithi027 bash[22610]: cluster 2024-08-31T06:23:45.340485+0000 mgr.a (mgr.14388) 10919 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:46.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:46 smithi191 bash[24992]: cluster 2024-08-31T06:23:45.340485+0000 mgr.a (mgr.14388) 10919 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:46 smithi163 bash[24253]: cluster 2024-08-31T06:23:45.340485+0000 mgr.a (mgr.14388) 10919 : cluster [DBG] pgmap v7569: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:47.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:47.683 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:47.683 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:48.427 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:48.427 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:48.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:48.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:48.428 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:23:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:48 smithi027 bash[22610]: cluster 2024-08-31T06:23:47.341409+0000 mgr.a (mgr.14388) 10920 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:48 smithi027 bash[22610]: audit 2024-08-31T06:23:48.013326+0000 mgr.a (mgr.14388) 10921 : audit [DBG] from='client.240756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:48 smithi191 bash[24992]: cluster 2024-08-31T06:23:47.341409+0000 mgr.a (mgr.14388) 10920 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:48.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:48 smithi191 bash[24992]: audit 2024-08-31T06:23:48.013326+0000 mgr.a (mgr.14388) 10921 : audit [DBG] from='client.240756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:48 smithi163 bash[24253]: cluster 2024-08-31T06:23:47.341409+0000 mgr.a (mgr.14388) 10920 : cluster [DBG] pgmap v7570: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:48.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:48 smithi163 bash[24253]: audit 2024-08-31T06:23:48.013326+0000 mgr.a (mgr.14388) 10921 : audit [DBG] from='client.240756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:50 smithi027 bash[22610]: cluster 2024-08-31T06:23:49.344237+0000 mgr.a (mgr.14388) 10922 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:50.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:50 smithi191 bash[24992]: cluster 2024-08-31T06:23:49.344237+0000 mgr.a (mgr.14388) 10922 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:50.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:50 smithi163 bash[24253]: cluster 2024-08-31T06:23:49.344237+0000 mgr.a (mgr.14388) 10922 : cluster [DBG] pgmap v7571: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:52 smithi027 bash[22610]: cluster 2024-08-31T06:23:51.345032+0000 mgr.a (mgr.14388) 10923 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:23:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:52 smithi191 bash[24992]: cluster 2024-08-31T06:23:51.345032+0000 mgr.a (mgr.14388) 10923 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:23:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:52 smithi163 bash[24253]: cluster 2024-08-31T06:23:51.345032+0000 mgr.a (mgr.14388) 10923 : cluster [DBG] pgmap v7572: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:23:53.429 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:53.429 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:53.430 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:54.178 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:54.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:54.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:54.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:54.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:23:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:54 smithi027 bash[22610]: cluster 2024-08-31T06:23:53.346937+0000 mgr.a (mgr.14388) 10924 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:54 smithi027 bash[22610]: audit 2024-08-31T06:23:53.752773+0000 mgr.a (mgr.14388) 10925 : audit [DBG] from='client.240831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:54.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:54 smithi191 bash[24992]: cluster 2024-08-31T06:23:53.346937+0000 mgr.a (mgr.14388) 10924 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:54.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:54 smithi191 bash[24992]: audit 2024-08-31T06:23:53.752773+0000 mgr.a (mgr.14388) 10925 : audit [DBG] from='client.240831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:54 smithi163 bash[24253]: cluster 2024-08-31T06:23:53.346937+0000 mgr.a (mgr.14388) 10924 : cluster [DBG] pgmap v7573: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:23:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:54 smithi163 bash[24253]: audit 2024-08-31T06:23:53.752773+0000 mgr.a (mgr.14388) 10925 : audit [DBG] from='client.240831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:23:56.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:56 smithi191 bash[24992]: cluster 2024-08-31T06:23:55.347896+0000 mgr.a (mgr.14388) 10926 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:23:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:56 smithi163 bash[24253]: cluster 2024-08-31T06:23:55.347896+0000 mgr.a (mgr.14388) 10926 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:23:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:56 smithi027 bash[22610]: cluster 2024-08-31T06:23:55.347896+0000 mgr.a (mgr.14388) 10926 : cluster [DBG] pgmap v7574: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:23:58.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:23:58 smithi191 bash[24992]: cluster 2024-08-31T06:23:57.348666+0000 mgr.a (mgr.14388) 10927 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:23:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:23:58 smithi163 bash[24253]: cluster 2024-08-31T06:23:57.348666+0000 mgr.a (mgr.14388) 10927 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:23:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:23:58 smithi027 bash[22610]: cluster 2024-08-31T06:23:57.348666+0000 mgr.a (mgr.14388) 10927 : cluster [DBG] pgmap v7575: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:23:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:23:59.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:23:59.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:23:59.940 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:23:59.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:23:59.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:23:59.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:23:59.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:00 smithi191 bash[24992]: cluster 2024-08-31T06:23:59.350533+0000 mgr.a (mgr.14388) 10928 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:00 smithi191 bash[24992]: audit 2024-08-31T06:23:59.510402+0000 mgr.a (mgr.14388) 10929 : audit [DBG] from='client.240906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:00 smithi163 bash[24253]: cluster 2024-08-31T06:23:59.350533+0000 mgr.a (mgr.14388) 10928 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:00 smithi163 bash[24253]: audit 2024-08-31T06:23:59.510402+0000 mgr.a (mgr.14388) 10929 : audit [DBG] from='client.240906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:00 smithi027 bash[22610]: cluster 2024-08-31T06:23:59.350533+0000 mgr.a (mgr.14388) 10928 : cluster [DBG] pgmap v7576: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:00 smithi027 bash[22610]: audit 2024-08-31T06:23:59.510402+0000 mgr.a (mgr.14388) 10929 : audit [DBG] from='client.240906 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:02.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:02 smithi191 bash[24992]: cluster 2024-08-31T06:24:01.351533+0000 mgr.a (mgr.14388) 10930 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:02.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:02 smithi163 bash[24253]: cluster 2024-08-31T06:24:01.351533+0000 mgr.a (mgr.14388) 10930 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:02 smithi027 bash[22610]: cluster 2024-08-31T06:24:01.351533+0000 mgr.a (mgr.14388) 10930 : cluster [DBG] pgmap v7577: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:04 smithi191 bash[24992]: cluster 2024-08-31T06:24:03.353683+0000 mgr.a (mgr.14388) 10931 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:04.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:24:04.942 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:24:04.943 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:24:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:04 smithi163 bash[24253]: cluster 2024-08-31T06:24:03.353683+0000 mgr.a (mgr.14388) 10931 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:04 smithi027 bash[22610]: cluster 2024-08-31T06:24:03.353683+0000 mgr.a (mgr.14388) 10931 : cluster [DBG] pgmap v7578: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:05.701 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:24:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:24:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:24:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:24:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:06.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:06 smithi191 bash[24992]: audit 2024-08-31T06:24:05.278745+0000 mgr.a (mgr.14388) 10932 : audit [DBG] from='client.240981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:06.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:06 smithi191 bash[24992]: cluster 2024-08-31T06:24:05.354229+0000 mgr.a (mgr.14388) 10933 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:06 smithi163 bash[24253]: audit 2024-08-31T06:24:05.278745+0000 mgr.a (mgr.14388) 10932 : audit [DBG] from='client.240981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:06 smithi163 bash[24253]: cluster 2024-08-31T06:24:05.354229+0000 mgr.a (mgr.14388) 10933 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:06 smithi027 bash[22610]: audit 2024-08-31T06:24:05.278745+0000 mgr.a (mgr.14388) 10932 : audit [DBG] from='client.240981 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:06 smithi027 bash[22610]: cluster 2024-08-31T06:24:05.354229+0000 mgr.a (mgr.14388) 10933 : cluster [DBG] pgmap v7579: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:08.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:08 smithi191 bash[24992]: cluster 2024-08-31T06:24:07.355108+0000 mgr.a (mgr.14388) 10934 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:08 smithi163 bash[24253]: cluster 2024-08-31T06:24:07.355108+0000 mgr.a (mgr.14388) 10934 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:08 smithi027 bash[22610]: cluster 2024-08-31T06:24:07.355108+0000 mgr.a (mgr.14388) 10934 : cluster [DBG] pgmap v7580: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:09.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:09 smithi191 bash[24992]: audit 2024-08-31T06:24:09.371198+0000 mon.a (mon.0) 2213 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:24:09.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:09 smithi163 bash[24253]: audit 2024-08-31T06:24:09.371198+0000 mon.a (mon.0) 2213 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:24:09.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:09 smithi027 bash[22610]: audit 2024-08-31T06:24:09.371198+0000 mon.a (mon.0) 2213 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:24:10.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:24:10.703 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:24:10.703 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:24:10.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:10 smithi191 bash[24992]: cluster 2024-08-31T06:24:09.357477+0000 mgr.a (mgr.14388) 10935 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:10 smithi163 bash[24253]: cluster 2024-08-31T06:24:09.357477+0000 mgr.a (mgr.14388) 10935 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:10 smithi027 bash[22610]: cluster 2024-08-31T06:24:09.357477+0000 mgr.a (mgr.14388) 10935 : cluster [DBG] pgmap v7581: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:11.461 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:24:11.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:24:11.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:24:11.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:24:11.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:11.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:11 smithi191 bash[24992]: audit 2024-08-31T06:24:11.039056+0000 mgr.a (mgr.14388) 10936 : audit [DBG] from='client.241059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:11 smithi163 bash[24253]: audit 2024-08-31T06:24:11.039056+0000 mgr.a (mgr.14388) 10936 : audit [DBG] from='client.241059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:11.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:11 smithi027 bash[22610]: audit 2024-08-31T06:24:11.039056+0000 mgr.a (mgr.14388) 10936 : audit [DBG] from='client.241059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:12.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:12 smithi191 bash[24992]: cluster 2024-08-31T06:24:11.366286+0000 mgr.a (mgr.14388) 10937 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:12 smithi163 bash[24253]: cluster 2024-08-31T06:24:11.366286+0000 mgr.a (mgr.14388) 10937 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:12 smithi027 bash[22610]: cluster 2024-08-31T06:24:11.366286+0000 mgr.a (mgr.14388) 10937 : cluster [DBG] pgmap v7582: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:14.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:14 smithi191 bash[24992]: cluster 2024-08-31T06:24:13.368699+0000 mgr.a (mgr.14388) 10938 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:14 smithi163 bash[24253]: cluster 2024-08-31T06:24:13.368699+0000 mgr.a (mgr.14388) 10938 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:14 smithi027 bash[22610]: cluster 2024-08-31T06:24:13.368699+0000 mgr.a (mgr.14388) 10938 : cluster [DBG] pgmap v7583: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:15 smithi027 bash[22610]: audit 2024-08-31T06:24:14.720906+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:15 smithi027 bash[22610]: audit 2024-08-31T06:24:14.726376+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:15.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:15 smithi027 bash[22610]: audit 2024-08-31T06:24:14.737820+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:15.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:15 smithi027 bash[22610]: audit 2024-08-31T06:24:14.742289+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:15.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:15 smithi027 bash[22610]: audit 2024-08-31T06:24:14.749242+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:15.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:15 smithi027 bash[22610]: audit 2024-08-31T06:24:14.753662+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:15.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:15 smithi027 bash[22610]: audit 2024-08-31T06:24:15.469151+0000 mon.a (mon.0) 2220 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:24:15.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:15 smithi027 bash[22610]: audit 2024-08-31T06:24:15.471010+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:24:15.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:15 smithi027 bash[22610]: audit 2024-08-31T06:24:15.481538+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:15.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:15 smithi027 bash[22610]: audit 2024-08-31T06:24:15.486319+0000 mon.a (mon.0) 2223 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:24:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:15 smithi191 bash[24992]: audit 2024-08-31T06:24:14.720906+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:15 smithi191 bash[24992]: audit 2024-08-31T06:24:14.726376+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:15 smithi191 bash[24992]: audit 2024-08-31T06:24:14.737820+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:15 smithi191 bash[24992]: audit 2024-08-31T06:24:14.742289+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:15 smithi191 bash[24992]: audit 2024-08-31T06:24:14.749242+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:15 smithi191 bash[24992]: audit 2024-08-31T06:24:14.753662+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:15 smithi191 bash[24992]: audit 2024-08-31T06:24:15.469151+0000 mon.a (mon.0) 2220 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:24:16.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:15 smithi191 bash[24992]: audit 2024-08-31T06:24:15.471010+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:24:16.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:15 smithi191 bash[24992]: audit 2024-08-31T06:24:15.481538+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:15 smithi191 bash[24992]: audit 2024-08-31T06:24:15.486319+0000 mon.a (mon.0) 2223 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:24:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:15 smithi163 bash[24253]: audit 2024-08-31T06:24:14.720906+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:15 smithi163 bash[24253]: audit 2024-08-31T06:24:14.726376+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:15 smithi163 bash[24253]: audit 2024-08-31T06:24:14.737820+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:15 smithi163 bash[24253]: audit 2024-08-31T06:24:14.742289+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:15 smithi163 bash[24253]: audit 2024-08-31T06:24:14.749242+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:15 smithi163 bash[24253]: audit 2024-08-31T06:24:14.753662+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:15 smithi163 bash[24253]: audit 2024-08-31T06:24:15.469151+0000 mon.a (mon.0) 2220 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:24:16.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:15 smithi163 bash[24253]: audit 2024-08-31T06:24:15.471010+0000 mon.a (mon.0) 2221 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:24:16.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:15 smithi163 bash[24253]: audit 2024-08-31T06:24:15.481538+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:24:16.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:15 smithi163 bash[24253]: audit 2024-08-31T06:24:15.486319+0000 mon.a (mon.0) 2223 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:24:16.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:24:16.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:24:16.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:24:16.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:24:16 smithi027 bash[22863]: debug 2024-08-31T06:24:16.225+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:24:16.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:24:16 smithi027 bash[22863]: debug 2024-08-31T06:24:16.225+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:24:17.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:16 smithi191 bash[24992]: cluster 2024-08-31T06:24:15.369170+0000 mgr.a (mgr.14388) 10939 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:17.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:16 smithi191 bash[24992]: audit 2024-08-31T06:24:15.488583+0000 mgr.a (mgr.14388) 10940 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:24:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:16 smithi163 bash[24253]: cluster 2024-08-31T06:24:15.369170+0000 mgr.a (mgr.14388) 10939 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:16 smithi163 bash[24253]: audit 2024-08-31T06:24:15.488583+0000 mgr.a (mgr.14388) 10940 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:24:17.215 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:24:17.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:24:17.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:24:17.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:24:17.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:16 smithi027 bash[22610]: cluster 2024-08-31T06:24:15.369170+0000 mgr.a (mgr.14388) 10939 : cluster [DBG] pgmap v7584: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:17.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:16 smithi027 bash[22610]: audit 2024-08-31T06:24:15.488583+0000 mgr.a (mgr.14388) 10940 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:24:18.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:17 smithi191 bash[24992]: audit 2024-08-31T06:24:16.228850+0000 mgr.a (mgr.14388) 10941 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:24:18.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:17 smithi191 bash[24992]: cephadm 2024-08-31T06:24:16.230384+0000 mgr.a (mgr.14388) 10942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:24:18.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:17 smithi191 bash[24992]: audit 2024-08-31T06:24:16.794924+0000 mgr.a (mgr.14388) 10943 : audit [DBG] from='client.241242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:17 smithi163 bash[24253]: audit 2024-08-31T06:24:16.228850+0000 mgr.a (mgr.14388) 10941 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:24:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:17 smithi163 bash[24253]: cephadm 2024-08-31T06:24:16.230384+0000 mgr.a (mgr.14388) 10942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:24:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:17 smithi163 bash[24253]: audit 2024-08-31T06:24:16.794924+0000 mgr.a (mgr.14388) 10943 : audit [DBG] from='client.241242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:17 smithi027 bash[22610]: audit 2024-08-31T06:24:16.228850+0000 mgr.a (mgr.14388) 10941 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:24:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:17 smithi027 bash[22610]: cephadm 2024-08-31T06:24:16.230384+0000 mgr.a (mgr.14388) 10942 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:24:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:17 smithi027 bash[22610]: audit 2024-08-31T06:24:16.794924+0000 mgr.a (mgr.14388) 10943 : audit [DBG] from='client.241242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:18 smithi191 bash[24992]: cluster 2024-08-31T06:24:17.370107+0000 mgr.a (mgr.14388) 10944 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:18 smithi163 bash[24253]: cluster 2024-08-31T06:24:17.370107+0000 mgr.a (mgr.14388) 10944 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:18 smithi027 bash[22610]: cluster 2024-08-31T06:24:17.370107+0000 mgr.a (mgr.14388) 10944 : cluster [DBG] pgmap v7585: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:21.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:20 smithi191 bash[24992]: cluster 2024-08-31T06:24:19.372350+0000 mgr.a (mgr.14388) 10945 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:20 smithi163 bash[24253]: cluster 2024-08-31T06:24:19.372350+0000 mgr.a (mgr.14388) 10945 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:20 smithi027 bash[22610]: cluster 2024-08-31T06:24:19.372350+0000 mgr.a (mgr.14388) 10945 : cluster [DBG] pgmap v7586: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:22.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:24:22.218 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:24:22.218 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:24:23.009 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:24:23.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:24:23.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:24:23.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:24:23.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:23.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:22 smithi191 bash[24992]: cluster 2024-08-31T06:24:21.373127+0000 mgr.a (mgr.14388) 10946 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:22 smithi163 bash[24253]: cluster 2024-08-31T06:24:21.373127+0000 mgr.a (mgr.14388) 10946 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:22 smithi027 bash[22610]: cluster 2024-08-31T06:24:21.373127+0000 mgr.a (mgr.14388) 10946 : cluster [DBG] pgmap v7587: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:23 smithi163 bash[24253]: audit 2024-08-31T06:24:22.552789+0000 mgr.a (mgr.14388) 10947 : audit [DBG] from='client.241317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:23 smithi027 bash[22610]: audit 2024-08-31T06:24:22.552789+0000 mgr.a (mgr.14388) 10947 : audit [DBG] from='client.241317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:24.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:23 smithi191 bash[24992]: audit 2024-08-31T06:24:22.552789+0000 mgr.a (mgr.14388) 10947 : audit [DBG] from='client.241317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:24 smithi163 bash[24253]: cluster 2024-08-31T06:24:23.375598+0000 mgr.a (mgr.14388) 10948 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:24 smithi027 bash[22610]: cluster 2024-08-31T06:24:23.375598+0000 mgr.a (mgr.14388) 10948 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:25.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:24 smithi191 bash[24992]: cluster 2024-08-31T06:24:23.375598+0000 mgr.a (mgr.14388) 10948 : cluster [DBG] pgmap v7588: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:26 smithi163 bash[24253]: cluster 2024-08-31T06:24:25.376388+0000 mgr.a (mgr.14388) 10949 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:24:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:26 smithi027 bash[22610]: cluster 2024-08-31T06:24:25.376388+0000 mgr.a (mgr.14388) 10949 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:24:27.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:26 smithi191 bash[24992]: cluster 2024-08-31T06:24:25.376388+0000 mgr.a (mgr.14388) 10949 : cluster [DBG] pgmap v7589: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:24:28.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:24:28.013 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:24:28.013 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:24:28.754 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:24:28.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:24:28.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:24:28.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:24:28.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:28 smithi163 bash[24253]: cluster 2024-08-31T06:24:27.377179+0000 mgr.a (mgr.14388) 10950 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:24:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:28 smithi027 bash[22610]: cluster 2024-08-31T06:24:27.377179+0000 mgr.a (mgr.14388) 10950 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:24:29.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:28 smithi191 bash[24992]: cluster 2024-08-31T06:24:27.377179+0000 mgr.a (mgr.14388) 10950 : cluster [DBG] pgmap v7590: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:24:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:29 smithi163 bash[24253]: audit 2024-08-31T06:24:28.338712+0000 mgr.a (mgr.14388) 10951 : audit [DBG] from='client.241395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:29 smithi027 bash[22610]: audit 2024-08-31T06:24:28.338712+0000 mgr.a (mgr.14388) 10951 : audit [DBG] from='client.241395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:29 smithi191 bash[24992]: audit 2024-08-31T06:24:28.338712+0000 mgr.a (mgr.14388) 10951 : audit [DBG] from='client.241395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:30 smithi163 bash[24253]: cluster 2024-08-31T06:24:29.380017+0000 mgr.a (mgr.14388) 10952 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:30 smithi027 bash[22610]: cluster 2024-08-31T06:24:29.380017+0000 mgr.a (mgr.14388) 10952 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:31.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:30 smithi191 bash[24992]: cluster 2024-08-31T06:24:29.380017+0000 mgr.a (mgr.14388) 10952 : cluster [DBG] pgmap v7591: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:24:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:32 smithi163 bash[24253]: cluster 2024-08-31T06:24:31.380805+0000 mgr.a (mgr.14388) 10953 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:24:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:32 smithi027 bash[22610]: cluster 2024-08-31T06:24:31.380805+0000 mgr.a (mgr.14388) 10953 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:24:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:32 smithi191 bash[24992]: cluster 2024-08-31T06:24:31.380805+0000 mgr.a (mgr.14388) 10953 : cluster [DBG] pgmap v7592: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:24:33.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:24:33.755 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:24:33.756 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:24:34.505 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:24:34.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:24:34.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:24:34.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:24:34.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:34 smithi163 bash[24253]: cluster 2024-08-31T06:24:33.382691+0000 mgr.a (mgr.14388) 10954 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:35.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:34 smithi163 bash[24253]: audit 2024-08-31T06:24:34.092742+0000 mgr.a (mgr.14388) 10955 : audit [DBG] from='client.241473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:34 smithi027 bash[22610]: cluster 2024-08-31T06:24:33.382691+0000 mgr.a (mgr.14388) 10954 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:34 smithi027 bash[22610]: audit 2024-08-31T06:24:34.092742+0000 mgr.a (mgr.14388) 10955 : audit [DBG] from='client.241473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:35.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:34 smithi191 bash[24992]: cluster 2024-08-31T06:24:33.382691+0000 mgr.a (mgr.14388) 10954 : cluster [DBG] pgmap v7593: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:35.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:34 smithi191 bash[24992]: audit 2024-08-31T06:24:34.092742+0000 mgr.a (mgr.14388) 10955 : audit [DBG] from='client.241473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:36 smithi163 bash[24253]: cluster 2024-08-31T06:24:35.383690+0000 mgr.a (mgr.14388) 10956 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:24:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:36 smithi027 bash[22610]: cluster 2024-08-31T06:24:35.383690+0000 mgr.a (mgr.14388) 10956 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:24:37.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:36 smithi191 bash[24992]: cluster 2024-08-31T06:24:35.383690+0000 mgr.a (mgr.14388) 10956 : cluster [DBG] pgmap v7594: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:24:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:38 smithi163 bash[24253]: cluster 2024-08-31T06:24:37.384505+0000 mgr.a (mgr.14388) 10957 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:24:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:38 smithi027 bash[22610]: cluster 2024-08-31T06:24:37.384505+0000 mgr.a (mgr.14388) 10957 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:24:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:38 smithi191 bash[24992]: cluster 2024-08-31T06:24:37.384505+0000 mgr.a (mgr.14388) 10957 : cluster [DBG] pgmap v7595: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:24:39.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:24:39.506 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:24:39.507 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:24:40.269 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:24:40.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:24:40.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:24:40.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:24:40.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:40 smithi163 bash[24253]: cluster 2024-08-31T06:24:39.386685+0000 mgr.a (mgr.14388) 10958 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:24:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:40 smithi163 bash[24253]: audit 2024-08-31T06:24:39.839601+0000 mgr.a (mgr.14388) 10959 : audit [DBG] from='client.241551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:40 smithi027 bash[22610]: cluster 2024-08-31T06:24:39.386685+0000 mgr.a (mgr.14388) 10958 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:24:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:40 smithi027 bash[22610]: audit 2024-08-31T06:24:39.839601+0000 mgr.a (mgr.14388) 10959 : audit [DBG] from='client.241551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:41.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:40 smithi191 bash[24992]: cluster 2024-08-31T06:24:39.386685+0000 mgr.a (mgr.14388) 10958 : cluster [DBG] pgmap v7596: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:24:41.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:40 smithi191 bash[24992]: audit 2024-08-31T06:24:39.839601+0000 mgr.a (mgr.14388) 10959 : audit [DBG] from='client.241551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:42 smithi163 bash[24253]: cluster 2024-08-31T06:24:41.387672+0000 mgr.a (mgr.14388) 10960 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:42 smithi027 bash[22610]: cluster 2024-08-31T06:24:41.387672+0000 mgr.a (mgr.14388) 10960 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:43.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:42 smithi191 bash[24992]: cluster 2024-08-31T06:24:41.387672+0000 mgr.a (mgr.14388) 10960 : cluster [DBG] pgmap v7597: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:44 smithi163 bash[24253]: cluster 2024-08-31T06:24:43.389813+0000 mgr.a (mgr.14388) 10961 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:44 smithi027 bash[22610]: cluster 2024-08-31T06:24:43.389813+0000 mgr.a (mgr.14388) 10961 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:45.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:24:45.271 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:24:45.271 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:24:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:44 smithi191 bash[24992]: cluster 2024-08-31T06:24:43.389813+0000 mgr.a (mgr.14388) 10961 : cluster [DBG] pgmap v7598: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:46.060 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:24:46.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:24:46.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:24:46.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:24:46.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:46 smithi163 bash[24253]: cluster 2024-08-31T06:24:45.390255+0000 mgr.a (mgr.14388) 10962 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:46 smithi163 bash[24253]: audit 2024-08-31T06:24:45.605409+0000 mgr.a (mgr.14388) 10963 : audit [DBG] from='client.241623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:46 smithi027 bash[22610]: cluster 2024-08-31T06:24:45.390255+0000 mgr.a (mgr.14388) 10962 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:46 smithi027 bash[22610]: audit 2024-08-31T06:24:45.605409+0000 mgr.a (mgr.14388) 10963 : audit [DBG] from='client.241623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:47.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:46 smithi191 bash[24992]: cluster 2024-08-31T06:24:45.390255+0000 mgr.a (mgr.14388) 10962 : cluster [DBG] pgmap v7599: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:47.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:46 smithi191 bash[24992]: audit 2024-08-31T06:24:45.605409+0000 mgr.a (mgr.14388) 10963 : audit [DBG] from='client.241623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:48 smithi163 bash[24253]: cluster 2024-08-31T06:24:47.391150+0000 mgr.a (mgr.14388) 10964 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:48 smithi027 bash[22610]: cluster 2024-08-31T06:24:47.391150+0000 mgr.a (mgr.14388) 10964 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:49.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:48 smithi191 bash[24992]: cluster 2024-08-31T06:24:47.391150+0000 mgr.a (mgr.14388) 10964 : cluster [DBG] pgmap v7600: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:24:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:24:51.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:24:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:50 smithi163 bash[24253]: cluster 2024-08-31T06:24:49.393419+0000 mgr.a (mgr.14388) 10965 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:50 smithi027 bash[22610]: cluster 2024-08-31T06:24:49.393419+0000 mgr.a (mgr.14388) 10965 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:51.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:50 smithi191 bash[24992]: cluster 2024-08-31T06:24:49.393419+0000 mgr.a (mgr.14388) 10965 : cluster [DBG] pgmap v7601: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:51.843 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:24:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:24:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:24:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:24:51.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:53.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:52 smithi163 bash[24253]: audit 2024-08-31T06:24:51.393944+0000 mgr.a (mgr.14388) 10966 : audit [DBG] from='client.241698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:53.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:52 smithi163 bash[24253]: cluster 2024-08-31T06:24:51.394535+0000 mgr.a (mgr.14388) 10967 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:52 smithi027 bash[22610]: audit 2024-08-31T06:24:51.393944+0000 mgr.a (mgr.14388) 10966 : audit [DBG] from='client.241698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:53.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:52 smithi027 bash[22610]: cluster 2024-08-31T06:24:51.394535+0000 mgr.a (mgr.14388) 10967 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:52 smithi191 bash[24992]: audit 2024-08-31T06:24:51.393944+0000 mgr.a (mgr.14388) 10966 : audit [DBG] from='client.241698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:52 smithi191 bash[24992]: cluster 2024-08-31T06:24:51.394535+0000 mgr.a (mgr.14388) 10967 : cluster [DBG] pgmap v7602: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:54 smithi163 bash[24253]: cluster 2024-08-31T06:24:53.396803+0000 mgr.a (mgr.14388) 10968 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:54 smithi027 bash[22610]: cluster 2024-08-31T06:24:53.396803+0000 mgr.a (mgr.14388) 10968 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:55.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:54 smithi191 bash[24992]: cluster 2024-08-31T06:24:53.396803+0000 mgr.a (mgr.14388) 10968 : cluster [DBG] pgmap v7603: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:24:56.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:24:56.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:24:56.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:24:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:56 smithi163 bash[24253]: cluster 2024-08-31T06:24:55.397603+0000 mgr.a (mgr.14388) 10969 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:56 smithi027 bash[22610]: cluster 2024-08-31T06:24:55.397603+0000 mgr.a (mgr.14388) 10969 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:57.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:56 smithi191 bash[24992]: cluster 2024-08-31T06:24:55.397603+0000 mgr.a (mgr.14388) 10969 : cluster [DBG] pgmap v7604: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:57.580 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:24:57.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:24:57.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:24:57.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:24:57.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:24:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:57 smithi163 bash[24253]: audit 2024-08-31T06:24:57.173721+0000 mgr.a (mgr.14388) 10970 : audit [DBG] from='client.241776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:57 smithi027 bash[22610]: audit 2024-08-31T06:24:57.173721+0000 mgr.a (mgr.14388) 10970 : audit [DBG] from='client.241776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:58.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:57 smithi191 bash[24992]: audit 2024-08-31T06:24:57.173721+0000 mgr.a (mgr.14388) 10970 : audit [DBG] from='client.241776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:24:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:24:58 smithi163 bash[24253]: cluster 2024-08-31T06:24:57.398141+0000 mgr.a (mgr.14388) 10971 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:24:58 smithi027 bash[22610]: cluster 2024-08-31T06:24:57.398141+0000 mgr.a (mgr.14388) 10971 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:24:59.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:24:58 smithi191 bash[24992]: cluster 2024-08-31T06:24:57.398141+0000 mgr.a (mgr.14388) 10971 : cluster [DBG] pgmap v7605: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:01.167 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:00 smithi163 bash[24253]: cluster 2024-08-31T06:24:59.400444+0000 mgr.a (mgr.14388) 10972 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:25:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:00 smithi027 bash[22610]: cluster 2024-08-31T06:24:59.400444+0000 mgr.a (mgr.14388) 10972 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:25:01.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:00 smithi191 bash[24992]: cluster 2024-08-31T06:24:59.400444+0000 mgr.a (mgr.14388) 10972 : cluster [DBG] pgmap v7606: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:25:02.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:25:02.582 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:25:02.582 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:25:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:02 smithi163 bash[24253]: cluster 2024-08-31T06:25:01.401218+0000 mgr.a (mgr.14388) 10973 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:03.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:02 smithi027 bash[22610]: cluster 2024-08-31T06:25:01.401218+0000 mgr.a (mgr.14388) 10973 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:02 smithi191 bash[24992]: cluster 2024-08-31T06:25:01.401218+0000 mgr.a (mgr.14388) 10973 : cluster [DBG] pgmap v7607: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:03.359 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:25:03.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:25:03.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:25:03.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:25:03.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:25:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:03 smithi163 bash[24253]: audit 2024-08-31T06:25:02.916285+0000 mgr.a (mgr.14388) 10974 : audit [DBG] from='client.241854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:03 smithi027 bash[22610]: audit 2024-08-31T06:25:02.916285+0000 mgr.a (mgr.14388) 10974 : audit [DBG] from='client.241854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:04.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:03 smithi191 bash[24992]: audit 2024-08-31T06:25:02.916285+0000 mgr.a (mgr.14388) 10974 : audit [DBG] from='client.241854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:04 smithi163 bash[24253]: cluster 2024-08-31T06:25:03.402789+0000 mgr.a (mgr.14388) 10975 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:04 smithi027 bash[22610]: cluster 2024-08-31T06:25:03.402789+0000 mgr.a (mgr.14388) 10975 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:04 smithi191 bash[24992]: cluster 2024-08-31T06:25:03.402789+0000 mgr.a (mgr.14388) 10975 : cluster [DBG] pgmap v7608: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:06 smithi163 bash[24253]: cluster 2024-08-31T06:25:05.403523+0000 mgr.a (mgr.14388) 10976 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:06 smithi027 bash[22610]: cluster 2024-08-31T06:25:05.403523+0000 mgr.a (mgr.14388) 10976 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:07.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:06 smithi191 bash[24992]: cluster 2024-08-31T06:25:05.403523+0000 mgr.a (mgr.14388) 10976 : cluster [DBG] pgmap v7609: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:08.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:25:08.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:25:08.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:25:09.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:25:09.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:25:09.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:25:09.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:25:09.147 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:25:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:08 smithi163 bash[24253]: cluster 2024-08-31T06:25:07.404410+0000 mgr.a (mgr.14388) 10977 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:08 smithi027 bash[22610]: cluster 2024-08-31T06:25:07.404410+0000 mgr.a (mgr.14388) 10977 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:09.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:08 smithi191 bash[24992]: cluster 2024-08-31T06:25:07.404410+0000 mgr.a (mgr.14388) 10977 : cluster [DBG] pgmap v7610: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:09 smithi163 bash[24253]: audit 2024-08-31T06:25:08.697807+0000 mgr.a (mgr.14388) 10978 : audit [DBG] from='client.241932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:09 smithi027 bash[22610]: audit 2024-08-31T06:25:08.697807+0000 mgr.a (mgr.14388) 10978 : audit [DBG] from='client.241932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:10.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:09 smithi191 bash[24992]: audit 2024-08-31T06:25:08.697807+0000 mgr.a (mgr.14388) 10978 : audit [DBG] from='client.241932 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:10 smithi163 bash[24253]: cluster 2024-08-31T06:25:09.407263+0000 mgr.a (mgr.14388) 10979 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:10 smithi027 bash[22610]: cluster 2024-08-31T06:25:09.407263+0000 mgr.a (mgr.14388) 10979 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:10 smithi191 bash[24992]: cluster 2024-08-31T06:25:09.407263+0000 mgr.a (mgr.14388) 10979 : cluster [DBG] pgmap v7611: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:12 smithi163 bash[24253]: cluster 2024-08-31T06:25:11.408090+0000 mgr.a (mgr.14388) 10980 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:25:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:12 smithi027 bash[22610]: cluster 2024-08-31T06:25:11.408090+0000 mgr.a (mgr.14388) 10980 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:25:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:12 smithi191 bash[24992]: cluster 2024-08-31T06:25:11.408090+0000 mgr.a (mgr.14388) 10980 : cluster [DBG] pgmap v7612: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:25:14.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:25:14.148 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:25:14.148 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:25:14.933 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:25:14.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:25:14.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:25:14.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:25:14.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:25:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:14 smithi163 bash[24253]: cluster 2024-08-31T06:25:13.410028+0000 mgr.a (mgr.14388) 10981 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:14 smithi027 bash[22610]: cluster 2024-08-31T06:25:13.410028+0000 mgr.a (mgr.14388) 10981 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:15.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:14 smithi191 bash[24992]: cluster 2024-08-31T06:25:13.410028+0000 mgr.a (mgr.14388) 10981 : cluster [DBG] pgmap v7613: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:15 smithi163 bash[24253]: audit 2024-08-31T06:25:14.485569+0000 mgr.a (mgr.14388) 10982 : audit [DBG] from='client.242010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:15 smithi027 bash[22610]: audit 2024-08-31T06:25:14.485569+0000 mgr.a (mgr.14388) 10982 : audit [DBG] from='client.242010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:16.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:15 smithi191 bash[24992]: audit 2024-08-31T06:25:14.485569+0000 mgr.a (mgr.14388) 10982 : audit [DBG] from='client.242010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:16 smithi163 bash[24253]: cluster 2024-08-31T06:25:15.411046+0000 mgr.a (mgr.14388) 10983 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:16 smithi163 bash[24253]: audit 2024-08-31T06:25:16.286442+0000 mon.a (mon.0) 2224 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:25:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:16 smithi027 bash[22610]: cluster 2024-08-31T06:25:15.411046+0000 mgr.a (mgr.14388) 10983 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:16 smithi027 bash[22610]: audit 2024-08-31T06:25:16.286442+0000 mon.a (mon.0) 2224 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:25:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:16 smithi191 bash[24992]: cluster 2024-08-31T06:25:15.411046+0000 mgr.a (mgr.14388) 10983 : cluster [DBG] pgmap v7614: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:16 smithi191 bash[24992]: audit 2024-08-31T06:25:16.286442+0000 mon.a (mon.0) 2224 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:25:18.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:25:17 smithi027 bash[22863]: debug 2024-08-31T06:25:17.860+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:25:18.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:25:17 smithi027 bash[22863]: debug 2024-08-31T06:25:17.860+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:25:18.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:17 smithi027 bash[22610]: audit 2024-08-31T06:25:17.111388+0000 mon.a (mon.0) 2225 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:25:18.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:17 smithi027 bash[22610]: audit 2024-08-31T06:25:17.113044+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:25:18.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:17 smithi027 bash[22610]: audit 2024-08-31T06:25:17.123273+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:25:18.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:17 smithi027 bash[22610]: audit 2024-08-31T06:25:17.128066+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:25:18.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:17 smithi027 bash[22610]: audit 2024-08-31T06:25:17.130531+0000 mgr.a (mgr.14388) 10984 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:25:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:17 smithi191 bash[24992]: audit 2024-08-31T06:25:17.111388+0000 mon.a (mon.0) 2225 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:25:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:17 smithi191 bash[24992]: audit 2024-08-31T06:25:17.113044+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:25:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:17 smithi191 bash[24992]: audit 2024-08-31T06:25:17.123273+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:25:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:17 smithi191 bash[24992]: audit 2024-08-31T06:25:17.128066+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:25:18.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:17 smithi191 bash[24992]: audit 2024-08-31T06:25:17.130531+0000 mgr.a (mgr.14388) 10984 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:25:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:17 smithi163 bash[24253]: audit 2024-08-31T06:25:17.111388+0000 mon.a (mon.0) 2225 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:25:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:17 smithi163 bash[24253]: audit 2024-08-31T06:25:17.113044+0000 mon.a (mon.0) 2226 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:25:18.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:17 smithi163 bash[24253]: audit 2024-08-31T06:25:17.123273+0000 mon.a (mon.0) 2227 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:25:18.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:17 smithi163 bash[24253]: audit 2024-08-31T06:25:17.128066+0000 mon.a (mon.0) 2228 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:25:18.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:17 smithi163 bash[24253]: audit 2024-08-31T06:25:17.130531+0000 mgr.a (mgr.14388) 10984 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:25:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:19 smithi163 bash[24253]: cluster 2024-08-31T06:25:17.411643+0000 mgr.a (mgr.14388) 10985 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:19 smithi163 bash[24253]: audit 2024-08-31T06:25:17.864732+0000 mgr.a (mgr.14388) 10986 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:25:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:19 smithi163 bash[24253]: cephadm 2024-08-31T06:25:17.866560+0000 mgr.a (mgr.14388) 10987 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:25:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:19 smithi027 bash[22610]: cluster 2024-08-31T06:25:17.411643+0000 mgr.a (mgr.14388) 10985 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:19 smithi027 bash[22610]: audit 2024-08-31T06:25:17.864732+0000 mgr.a (mgr.14388) 10986 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:25:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:19 smithi027 bash[22610]: cephadm 2024-08-31T06:25:17.866560+0000 mgr.a (mgr.14388) 10987 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:25:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:19 smithi191 bash[24992]: cluster 2024-08-31T06:25:17.411643+0000 mgr.a (mgr.14388) 10985 : cluster [DBG] pgmap v7615: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:19 smithi191 bash[24992]: audit 2024-08-31T06:25:17.864732+0000 mgr.a (mgr.14388) 10986 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:25:19.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:19 smithi191 bash[24992]: cephadm 2024-08-31T06:25:17.866560+0000 mgr.a (mgr.14388) 10987 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:25:19.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:25:19.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:25:19.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:25:20.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:25:20.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:25:20.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:25:20.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:25:20.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:25:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:21 smithi163 bash[24253]: cluster 2024-08-31T06:25:19.413997+0000 mgr.a (mgr.14388) 10988 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:21 smithi027 bash[22610]: cluster 2024-08-31T06:25:19.413997+0000 mgr.a (mgr.14388) 10988 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:21.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:21 smithi191 bash[24992]: cluster 2024-08-31T06:25:19.413997+0000 mgr.a (mgr.14388) 10988 : cluster [DBG] pgmap v7616: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:22 smithi163 bash[24253]: audit 2024-08-31T06:25:20.270254+0000 mgr.a (mgr.14388) 10989 : audit [DBG] from='client.242196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:22 smithi027 bash[22610]: audit 2024-08-31T06:25:20.270254+0000 mgr.a (mgr.14388) 10989 : audit [DBG] from='client.242196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:22 smithi191 bash[24992]: audit 2024-08-31T06:25:20.270254+0000 mgr.a (mgr.14388) 10989 : audit [DBG] from='client.242196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:23 smithi163 bash[24253]: cluster 2024-08-31T06:25:21.415000+0000 mgr.a (mgr.14388) 10990 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:23 smithi027 bash[22610]: cluster 2024-08-31T06:25:21.415000+0000 mgr.a (mgr.14388) 10990 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:23 smithi191 bash[24992]: cluster 2024-08-31T06:25:21.415000+0000 mgr.a (mgr.14388) 10990 : cluster [DBG] pgmap v7617: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:25 smithi163 bash[24253]: cluster 2024-08-31T06:25:23.417270+0000 mgr.a (mgr.14388) 10991 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:25 smithi027 bash[22610]: cluster 2024-08-31T06:25:23.417270+0000 mgr.a (mgr.14388) 10991 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:25 smithi191 bash[24992]: cluster 2024-08-31T06:25:23.417270+0000 mgr.a (mgr.14388) 10991 : cluster [DBG] pgmap v7618: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:25.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:25:25.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:25:25.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:25:26.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:25:26.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:25:26.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:25:26.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:25:26.474 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:25:27.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:27 smithi163 bash[24253]: cluster 2024-08-31T06:25:25.418058+0000 mgr.a (mgr.14388) 10992 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:27.473 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:27 smithi163 bash[24253]: audit 2024-08-31T06:25:26.049018+0000 mgr.a (mgr.14388) 10993 : audit [DBG] from='client.242274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:27 smithi027 bash[22610]: cluster 2024-08-31T06:25:25.418058+0000 mgr.a (mgr.14388) 10992 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:27 smithi027 bash[22610]: audit 2024-08-31T06:25:26.049018+0000 mgr.a (mgr.14388) 10993 : audit [DBG] from='client.242274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:27.555 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:27 smithi191 bash[24992]: cluster 2024-08-31T06:25:25.418058+0000 mgr.a (mgr.14388) 10992 : cluster [DBG] pgmap v7619: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:27.555 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:27 smithi191 bash[24992]: audit 2024-08-31T06:25:26.049018+0000 mgr.a (mgr.14388) 10993 : audit [DBG] from='client.242274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:29 smithi163 bash[24253]: cluster 2024-08-31T06:25:27.419017+0000 mgr.a (mgr.14388) 10994 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:29 smithi027 bash[22610]: cluster 2024-08-31T06:25:27.419017+0000 mgr.a (mgr.14388) 10994 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:29 smithi191 bash[24992]: cluster 2024-08-31T06:25:27.419017+0000 mgr.a (mgr.14388) 10994 : cluster [DBG] pgmap v7620: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:31 smithi163 bash[24253]: cluster 2024-08-31T06:25:29.421245+0000 mgr.a (mgr.14388) 10995 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:31.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:25:31.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:25:31.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:25:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:31 smithi027 bash[22610]: cluster 2024-08-31T06:25:29.421245+0000 mgr.a (mgr.14388) 10995 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:31 smithi191 bash[24992]: cluster 2024-08-31T06:25:29.421245+0000 mgr.a (mgr.14388) 10995 : cluster [DBG] pgmap v7621: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:25:32.242 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:25:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:25:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:25:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:25:32.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:25:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:33 smithi163 bash[24253]: cluster 2024-08-31T06:25:31.422055+0000 mgr.a (mgr.14388) 10996 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:33 smithi163 bash[24253]: audit 2024-08-31T06:25:31.816954+0000 mgr.a (mgr.14388) 10997 : audit [DBG] from='client.242349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:33 smithi027 bash[22610]: cluster 2024-08-31T06:25:31.422055+0000 mgr.a (mgr.14388) 10996 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:33 smithi027 bash[22610]: audit 2024-08-31T06:25:31.816954+0000 mgr.a (mgr.14388) 10997 : audit [DBG] from='client.242349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:33 smithi191 bash[24992]: cluster 2024-08-31T06:25:31.422055+0000 mgr.a (mgr.14388) 10996 : cluster [DBG] pgmap v7622: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:33.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:33 smithi191 bash[24992]: audit 2024-08-31T06:25:31.816954+0000 mgr.a (mgr.14388) 10997 : audit [DBG] from='client.242349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:35 smithi163 bash[24253]: cluster 2024-08-31T06:25:33.424440+0000 mgr.a (mgr.14388) 10998 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:25:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:35 smithi027 bash[22610]: cluster 2024-08-31T06:25:33.424440+0000 mgr.a (mgr.14388) 10998 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:25:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:35 smithi191 bash[24992]: cluster 2024-08-31T06:25:33.424440+0000 mgr.a (mgr.14388) 10998 : cluster [DBG] pgmap v7623: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:25:37.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:25:37.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:25:37.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:25:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:37 smithi163 bash[24253]: cluster 2024-08-31T06:25:35.425258+0000 mgr.a (mgr.14388) 10999 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:37 smithi027 bash[22610]: cluster 2024-08-31T06:25:35.425258+0000 mgr.a (mgr.14388) 10999 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:37 smithi191 bash[24992]: cluster 2024-08-31T06:25:35.425258+0000 mgr.a (mgr.14388) 10999 : cluster [DBG] pgmap v7624: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:38.024 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:25:38.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:25:38.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:25:38.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:25:38.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:25:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:39 smithi163 bash[24253]: cluster 2024-08-31T06:25:37.425996+0000 mgr.a (mgr.14388) 11000 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:39 smithi163 bash[24253]: audit 2024-08-31T06:25:37.578229+0000 mgr.a (mgr.14388) 11001 : audit [DBG] from='client.242427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:39 smithi027 bash[22610]: cluster 2024-08-31T06:25:37.425996+0000 mgr.a (mgr.14388) 11000 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:39 smithi027 bash[22610]: audit 2024-08-31T06:25:37.578229+0000 mgr.a (mgr.14388) 11001 : audit [DBG] from='client.242427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:39 smithi191 bash[24992]: cluster 2024-08-31T06:25:37.425996+0000 mgr.a (mgr.14388) 11000 : cluster [DBG] pgmap v7625: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:39 smithi191 bash[24992]: audit 2024-08-31T06:25:37.578229+0000 mgr.a (mgr.14388) 11001 : audit [DBG] from='client.242427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:41 smithi163 bash[24253]: cluster 2024-08-31T06:25:39.428333+0000 mgr.a (mgr.14388) 11002 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:25:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:41 smithi027 bash[22610]: cluster 2024-08-31T06:25:39.428333+0000 mgr.a (mgr.14388) 11002 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:25:41.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:41 smithi191 bash[24992]: cluster 2024-08-31T06:25:39.428333+0000 mgr.a (mgr.14388) 11002 : cluster [DBG] pgmap v7626: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:25:43.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:25:43.027 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:25:43.027 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:25:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:43 smithi163 bash[24253]: cluster 2024-08-31T06:25:41.429112+0000 mgr.a (mgr.14388) 11003 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:25:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:43 smithi027 bash[22610]: cluster 2024-08-31T06:25:41.429112+0000 mgr.a (mgr.14388) 11003 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:25:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:43 smithi191 bash[24992]: cluster 2024-08-31T06:25:41.429112+0000 mgr.a (mgr.14388) 11003 : cluster [DBG] pgmap v7627: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:25:43.811 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:25:43.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:25:43.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:25:43.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:25:43.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:25:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:45 smithi163 bash[24253]: audit 2024-08-31T06:25:43.365558+0000 mgr.a (mgr.14388) 11004 : audit [DBG] from='client.242502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:45 smithi163 bash[24253]: cluster 2024-08-31T06:25:43.430600+0000 mgr.a (mgr.14388) 11005 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:45 smithi027 bash[22610]: audit 2024-08-31T06:25:43.365558+0000 mgr.a (mgr.14388) 11004 : audit [DBG] from='client.242502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:45 smithi027 bash[22610]: cluster 2024-08-31T06:25:43.430600+0000 mgr.a (mgr.14388) 11005 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:45 smithi191 bash[24992]: audit 2024-08-31T06:25:43.365558+0000 mgr.a (mgr.14388) 11004 : audit [DBG] from='client.242502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:45.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:45 smithi191 bash[24992]: cluster 2024-08-31T06:25:43.430600+0000 mgr.a (mgr.14388) 11005 : cluster [DBG] pgmap v7628: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:47 smithi163 bash[24253]: cluster 2024-08-31T06:25:45.431482+0000 mgr.a (mgr.14388) 11006 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:47 smithi027 bash[22610]: cluster 2024-08-31T06:25:45.431482+0000 mgr.a (mgr.14388) 11006 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:47 smithi191 bash[24992]: cluster 2024-08-31T06:25:45.431482+0000 mgr.a (mgr.14388) 11006 : cluster [DBG] pgmap v7629: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:48.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:25:48.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:25:48.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:25:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:49 smithi163 bash[24253]: cluster 2024-08-31T06:25:47.432265+0000 mgr.a (mgr.14388) 11007 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:49 smithi027 bash[22610]: cluster 2024-08-31T06:25:47.432265+0000 mgr.a (mgr.14388) 11007 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:49 smithi191 bash[24992]: cluster 2024-08-31T06:25:47.432265+0000 mgr.a (mgr.14388) 11007 : cluster [DBG] pgmap v7630: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:25:49.559 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:25:49.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:25:49.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:25:49.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:25:49.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:25:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:50 smithi027 bash[22610]: audit 2024-08-31T06:25:49.146078+0000 mgr.a (mgr.14388) 11008 : audit [DBG] from='client.242580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:50 smithi191 bash[24992]: audit 2024-08-31T06:25:49.146078+0000 mgr.a (mgr.14388) 11008 : audit [DBG] from='client.242580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:50.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:50 smithi163 bash[24253]: audit 2024-08-31T06:25:49.146078+0000 mgr.a (mgr.14388) 11008 : audit [DBG] from='client.242580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:51 smithi027 bash[22610]: cluster 2024-08-31T06:25:49.433604+0000 mgr.a (mgr.14388) 11009 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:51 smithi191 bash[24992]: cluster 2024-08-31T06:25:49.433604+0000 mgr.a (mgr.14388) 11009 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:51 smithi163 bash[24253]: cluster 2024-08-31T06:25:49.433604+0000 mgr.a (mgr.14388) 11009 : cluster [DBG] pgmap v7631: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:52 smithi027 bash[22610]: cluster 2024-08-31T06:25:51.434464+0000 mgr.a (mgr.14388) 11010 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:25:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:52 smithi191 bash[24992]: cluster 2024-08-31T06:25:51.434464+0000 mgr.a (mgr.14388) 11010 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:25:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:52 smithi163 bash[24253]: cluster 2024-08-31T06:25:51.434464+0000 mgr.a (mgr.14388) 11010 : cluster [DBG] pgmap v7632: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:25:54.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:25:54.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:25:54.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:25:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:54 smithi191 bash[24992]: cluster 2024-08-31T06:25:53.436631+0000 mgr.a (mgr.14388) 11011 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:25:54.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:54 smithi163 bash[24253]: cluster 2024-08-31T06:25:53.436631+0000 mgr.a (mgr.14388) 11011 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:25:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:54 smithi027 bash[22610]: cluster 2024-08-31T06:25:53.436631+0000 mgr.a (mgr.14388) 11011 : cluster [DBG] pgmap v7633: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:25:55.318 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:25:55.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:25:55.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:25:55.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:25:55.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:25:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:55 smithi191 bash[24992]: audit 2024-08-31T06:25:54.888589+0000 mgr.a (mgr.14388) 11012 : audit [DBG] from='client.242658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:55 smithi163 bash[24253]: audit 2024-08-31T06:25:54.888589+0000 mgr.a (mgr.14388) 11012 : audit [DBG] from='client.242658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:55 smithi027 bash[22610]: audit 2024-08-31T06:25:54.888589+0000 mgr.a (mgr.14388) 11012 : audit [DBG] from='client.242658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:25:56.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:56 smithi191 bash[24992]: cluster 2024-08-31T06:25:55.437575+0000 mgr.a (mgr.14388) 11013 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:56 smithi163 bash[24253]: cluster 2024-08-31T06:25:55.437575+0000 mgr.a (mgr.14388) 11013 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:56 smithi027 bash[22610]: cluster 2024-08-31T06:25:55.437575+0000 mgr.a (mgr.14388) 11013 : cluster [DBG] pgmap v7634: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:25:58 smithi191 bash[24992]: cluster 2024-08-31T06:25:57.438378+0000 mgr.a (mgr.14388) 11014 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:25:58 smithi163 bash[24253]: cluster 2024-08-31T06:25:57.438378+0000 mgr.a (mgr.14388) 11014 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:25:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:25:58 smithi027 bash[22610]: cluster 2024-08-31T06:25:57.438378+0000 mgr.a (mgr.14388) 11014 : cluster [DBG] pgmap v7635: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:00.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:00.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:00.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:00 smithi191 bash[24992]: cluster 2024-08-31T06:25:59.440593+0000 mgr.a (mgr.14388) 11015 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:00 smithi163 bash[24253]: cluster 2024-08-31T06:25:59.440593+0000 mgr.a (mgr.14388) 11015 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:00 smithi027 bash[22610]: cluster 2024-08-31T06:25:59.440593+0000 mgr.a (mgr.14388) 11015 : cluster [DBG] pgmap v7636: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:01.103 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:01.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:01.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:01.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:01.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:01 smithi191 bash[24992]: audit 2024-08-31T06:26:00.661077+0000 mgr.a (mgr.14388) 11016 : audit [DBG] from='client.242736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:01.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:01 smithi163 bash[24253]: audit 2024-08-31T06:26:00.661077+0000 mgr.a (mgr.14388) 11016 : audit [DBG] from='client.242736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:01 smithi027 bash[22610]: audit 2024-08-31T06:26:00.661077+0000 mgr.a (mgr.14388) 11016 : audit [DBG] from='client.242736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:02.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:02 smithi191 bash[24992]: cluster 2024-08-31T06:26:01.441555+0000 mgr.a (mgr.14388) 11017 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:02.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:02 smithi163 bash[24253]: cluster 2024-08-31T06:26:01.441555+0000 mgr.a (mgr.14388) 11017 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:02 smithi027 bash[22610]: cluster 2024-08-31T06:26:01.441555+0000 mgr.a (mgr.14388) 11017 : cluster [DBG] pgmap v7637: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:04.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:04 smithi191 bash[24992]: cluster 2024-08-31T06:26:03.443872+0000 mgr.a (mgr.14388) 11018 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:04 smithi163 bash[24253]: cluster 2024-08-31T06:26:03.443872+0000 mgr.a (mgr.14388) 11018 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:04 smithi027 bash[22610]: cluster 2024-08-31T06:26:03.443872+0000 mgr.a (mgr.14388) 11018 : cluster [DBG] pgmap v7638: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:06.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:06.105 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:06.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:06 smithi191 bash[24992]: cluster 2024-08-31T06:26:05.444659+0000 mgr.a (mgr.14388) 11019 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:06.857 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:06.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:06.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:06.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:06.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:06 smithi163 bash[24253]: cluster 2024-08-31T06:26:05.444659+0000 mgr.a (mgr.14388) 11019 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:06 smithi027 bash[22610]: cluster 2024-08-31T06:26:05.444659+0000 mgr.a (mgr.14388) 11019 : cluster [DBG] pgmap v7639: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:07.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:07 smithi163 bash[24253]: audit 2024-08-31T06:26:06.435481+0000 mgr.a (mgr.14388) 11020 : audit [DBG] from='client.242814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:07.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:07 smithi027 bash[22610]: audit 2024-08-31T06:26:06.435481+0000 mgr.a (mgr.14388) 11020 : audit [DBG] from='client.242814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:07 smithi191 bash[24992]: audit 2024-08-31T06:26:06.435481+0000 mgr.a (mgr.14388) 11020 : audit [DBG] from='client.242814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:08 smithi163 bash[24253]: cluster 2024-08-31T06:26:07.445552+0000 mgr.a (mgr.14388) 11021 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:08 smithi027 bash[22610]: cluster 2024-08-31T06:26:07.445552+0000 mgr.a (mgr.14388) 11021 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:08 smithi191 bash[24992]: cluster 2024-08-31T06:26:07.445552+0000 mgr.a (mgr.14388) 11021 : cluster [DBG] pgmap v7640: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:10 smithi163 bash[24253]: cluster 2024-08-31T06:26:09.447794+0000 mgr.a (mgr.14388) 11022 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:10 smithi027 bash[22610]: cluster 2024-08-31T06:26:09.447794+0000 mgr.a (mgr.14388) 11022 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:10 smithi191 bash[24992]: cluster 2024-08-31T06:26:09.447794+0000 mgr.a (mgr.14388) 11022 : cluster [DBG] pgmap v7641: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:11.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:11.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:11.860 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:12.610 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:12.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:12.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:12.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:12.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:12 smithi163 bash[24253]: cluster 2024-08-31T06:26:11.448536+0000 mgr.a (mgr.14388) 11023 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:12 smithi163 bash[24253]: audit 2024-08-31T06:26:12.188486+0000 mgr.a (mgr.14388) 11024 : audit [DBG] from='client.242892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:12 smithi027 bash[22610]: cluster 2024-08-31T06:26:11.448536+0000 mgr.a (mgr.14388) 11023 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:12 smithi027 bash[22610]: audit 2024-08-31T06:26:12.188486+0000 mgr.a (mgr.14388) 11024 : audit [DBG] from='client.242892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:13.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:12 smithi191 bash[24992]: cluster 2024-08-31T06:26:11.448536+0000 mgr.a (mgr.14388) 11023 : cluster [DBG] pgmap v7642: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:13.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:12 smithi191 bash[24992]: audit 2024-08-31T06:26:12.188486+0000 mgr.a (mgr.14388) 11024 : audit [DBG] from='client.242892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:14 smithi163 bash[24253]: cluster 2024-08-31T06:26:13.450789+0000 mgr.a (mgr.14388) 11025 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:14 smithi027 bash[22610]: cluster 2024-08-31T06:26:13.450789+0000 mgr.a (mgr.14388) 11025 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:15.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:14 smithi191 bash[24992]: cluster 2024-08-31T06:26:13.450789+0000 mgr.a (mgr.14388) 11025 : cluster [DBG] pgmap v7643: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:16 smithi163 bash[24253]: cluster 2024-08-31T06:26:15.451520+0000 mgr.a (mgr.14388) 11026 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:16.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:16 smithi027 bash[22610]: cluster 2024-08-31T06:26:15.451520+0000 mgr.a (mgr.14388) 11026 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:16 smithi191 bash[24992]: cluster 2024-08-31T06:26:15.451520+0000 mgr.a (mgr.14388) 11026 : cluster [DBG] pgmap v7644: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:17.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:17.612 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:17.612 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:18.376 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:18.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:18.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:18.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:18.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:18 smithi163 bash[24253]: cluster 2024-08-31T06:26:17.452280+0000 mgr.a (mgr.14388) 11027 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:18 smithi163 bash[24253]: audit 2024-08-31T06:26:17.918661+0000 mon.a (mon.0) 2229 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:26:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:18 smithi163 bash[24253]: audit 2024-08-31T06:26:17.948438+0000 mgr.a (mgr.14388) 11028 : audit [DBG] from='client.242970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:18 smithi027 bash[22610]: cluster 2024-08-31T06:26:17.452280+0000 mgr.a (mgr.14388) 11027 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:18 smithi027 bash[22610]: audit 2024-08-31T06:26:17.918661+0000 mon.a (mon.0) 2229 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:26:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:18 smithi027 bash[22610]: audit 2024-08-31T06:26:17.948438+0000 mgr.a (mgr.14388) 11028 : audit [DBG] from='client.242970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:18 smithi191 bash[24992]: cluster 2024-08-31T06:26:17.452280+0000 mgr.a (mgr.14388) 11027 : cluster [DBG] pgmap v7645: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:18 smithi191 bash[24992]: audit 2024-08-31T06:26:17.918661+0000 mon.a (mon.0) 2229 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:26:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:18 smithi191 bash[24992]: audit 2024-08-31T06:26:17.948438+0000 mgr.a (mgr.14388) 11028 : audit [DBG] from='client.242970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:19 smithi163 bash[24253]: audit 2024-08-31T06:26:18.776156+0000 mon.a (mon.0) 2230 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:26:19.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:19 smithi163 bash[24253]: audit 2024-08-31T06:26:18.777894+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:26:19.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:19 smithi163 bash[24253]: audit 2024-08-31T06:26:18.788412+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:26:19.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:19 smithi163 bash[24253]: audit 2024-08-31T06:26:18.793484+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:26:19.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:19 smithi163 bash[24253]: audit 2024-08-31T06:26:18.796282+0000 mgr.a (mgr.14388) 11029 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:26:19.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:26:19 smithi027 bash[22863]: debug 2024-08-31T06:26:19.530+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:26:19.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:26:19 smithi027 bash[22863]: debug 2024-08-31T06:26:19.530+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:26:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:19 smithi027 bash[22610]: audit 2024-08-31T06:26:18.776156+0000 mon.a (mon.0) 2230 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:26:19.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:19 smithi027 bash[22610]: audit 2024-08-31T06:26:18.777894+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:26:19.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:19 smithi027 bash[22610]: audit 2024-08-31T06:26:18.788412+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:26:19.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:19 smithi027 bash[22610]: audit 2024-08-31T06:26:18.793484+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:26:19.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:19 smithi027 bash[22610]: audit 2024-08-31T06:26:18.796282+0000 mgr.a (mgr.14388) 11029 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:26:20.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:19 smithi191 bash[24992]: audit 2024-08-31T06:26:18.776156+0000 mon.a (mon.0) 2230 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:26:20.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:19 smithi191 bash[24992]: audit 2024-08-31T06:26:18.777894+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:26:20.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:19 smithi191 bash[24992]: audit 2024-08-31T06:26:18.788412+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:26:20.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:19 smithi191 bash[24992]: audit 2024-08-31T06:26:18.793484+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:26:20.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:19 smithi191 bash[24992]: audit 2024-08-31T06:26:18.796282+0000 mgr.a (mgr.14388) 11029 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:26:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:20 smithi163 bash[24253]: cluster 2024-08-31T06:26:19.454449+0000 mgr.a (mgr.14388) 11030 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:20 smithi163 bash[24253]: audit 2024-08-31T06:26:19.533199+0000 mgr.a (mgr.14388) 11031 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:26:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:20 smithi163 bash[24253]: cephadm 2024-08-31T06:26:19.534362+0000 mgr.a (mgr.14388) 11032 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:26:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:20 smithi027 bash[22610]: cluster 2024-08-31T06:26:19.454449+0000 mgr.a (mgr.14388) 11030 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:20 smithi027 bash[22610]: audit 2024-08-31T06:26:19.533199+0000 mgr.a (mgr.14388) 11031 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:26:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:20 smithi027 bash[22610]: cephadm 2024-08-31T06:26:19.534362+0000 mgr.a (mgr.14388) 11032 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:26:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:20 smithi191 bash[24992]: cluster 2024-08-31T06:26:19.454449+0000 mgr.a (mgr.14388) 11030 : cluster [DBG] pgmap v7646: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:20 smithi191 bash[24992]: audit 2024-08-31T06:26:19.533199+0000 mgr.a (mgr.14388) 11031 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:26:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:20 smithi191 bash[24992]: cephadm 2024-08-31T06:26:19.534362+0000 mgr.a (mgr.14388) 11032 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:26:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:22 smithi163 bash[24253]: cluster 2024-08-31T06:26:21.455204+0000 mgr.a (mgr.14388) 11033 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:26:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:22 smithi027 bash[22610]: cluster 2024-08-31T06:26:21.455204+0000 mgr.a (mgr.14388) 11033 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:26:23.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:22 smithi191 bash[24992]: cluster 2024-08-31T06:26:21.455204+0000 mgr.a (mgr.14388) 11033 : cluster [DBG] pgmap v7647: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:26:23.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:23.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:23.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:24.126 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:24.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:24.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:24.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:24.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:24 smithi163 bash[24253]: cluster 2024-08-31T06:26:23.457115+0000 mgr.a (mgr.14388) 11034 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:26:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:24 smithi163 bash[24253]: audit 2024-08-31T06:26:23.706258+0000 mgr.a (mgr.14388) 11035 : audit [DBG] from='client.243147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:24 smithi027 bash[22610]: cluster 2024-08-31T06:26:23.457115+0000 mgr.a (mgr.14388) 11034 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:26:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:24 smithi027 bash[22610]: audit 2024-08-31T06:26:23.706258+0000 mgr.a (mgr.14388) 11035 : audit [DBG] from='client.243147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:25.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:24 smithi191 bash[24992]: cluster 2024-08-31T06:26:23.457115+0000 mgr.a (mgr.14388) 11034 : cluster [DBG] pgmap v7648: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:26:25.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:24 smithi191 bash[24992]: audit 2024-08-31T06:26:23.706258+0000 mgr.a (mgr.14388) 11035 : audit [DBG] from='client.243147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:26 smithi163 bash[24253]: cluster 2024-08-31T06:26:25.458012+0000 mgr.a (mgr.14388) 11036 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:26:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:26 smithi027 bash[22610]: cluster 2024-08-31T06:26:25.458012+0000 mgr.a (mgr.14388) 11036 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:26:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:26 smithi191 bash[24992]: cluster 2024-08-31T06:26:25.458012+0000 mgr.a (mgr.14388) 11036 : cluster [DBG] pgmap v7649: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:26:29.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:29.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:29.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:28 smithi163 bash[24253]: cluster 2024-08-31T06:26:27.458855+0000 mgr.a (mgr.14388) 11037 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:26:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:28 smithi027 bash[22610]: cluster 2024-08-31T06:26:27.458855+0000 mgr.a (mgr.14388) 11037 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:26:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:28 smithi191 bash[24992]: cluster 2024-08-31T06:26:27.458855+0000 mgr.a (mgr.14388) 11037 : cluster [DBG] pgmap v7650: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:26:29.906 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:29.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:29.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:29.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:29.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:30 smithi163 bash[24253]: audit 2024-08-31T06:26:29.458849+0000 mgr.a (mgr.14388) 11038 : audit [DBG] from='client.243222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:30 smithi163 bash[24253]: cluster 2024-08-31T06:26:29.477877+0000 mgr.a (mgr.14388) 11039 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:26:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:30 smithi027 bash[22610]: audit 2024-08-31T06:26:29.458849+0000 mgr.a (mgr.14388) 11038 : audit [DBG] from='client.243222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:30 smithi027 bash[22610]: cluster 2024-08-31T06:26:29.477877+0000 mgr.a (mgr.14388) 11039 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:26:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:30 smithi191 bash[24992]: audit 2024-08-31T06:26:29.458849+0000 mgr.a (mgr.14388) 11038 : audit [DBG] from='client.243222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:31.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:30 smithi191 bash[24992]: cluster 2024-08-31T06:26:29.477877+0000 mgr.a (mgr.14388) 11039 : cluster [DBG] pgmap v7651: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:26:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:32 smithi163 bash[24253]: cluster 2024-08-31T06:26:31.478908+0000 mgr.a (mgr.14388) 11040 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T06:26:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:32 smithi027 bash[22610]: cluster 2024-08-31T06:26:31.478908+0000 mgr.a (mgr.14388) 11040 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T06:26:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:32 smithi191 bash[24992]: cluster 2024-08-31T06:26:31.478908+0000 mgr.a (mgr.14388) 11040 : cluster [DBG] pgmap v7652: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T06:26:34.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:34.908 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:34.908 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:34 smithi163 bash[24253]: cluster 2024-08-31T06:26:33.481057+0000 mgr.a (mgr.14388) 11041 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T06:26:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:34 smithi027 bash[22610]: cluster 2024-08-31T06:26:33.481057+0000 mgr.a (mgr.14388) 11041 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T06:26:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:34 smithi191 bash[24992]: cluster 2024-08-31T06:26:33.481057+0000 mgr.a (mgr.14388) 11041 : cluster [DBG] pgmap v7653: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T06:26:35.655 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:35.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:35.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:35.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:35.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:36 smithi163 bash[24253]: audit 2024-08-31T06:26:35.237459+0000 mgr.a (mgr.14388) 11042 : audit [DBG] from='client.243294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:36 smithi163 bash[24253]: cluster 2024-08-31T06:26:35.481645+0000 mgr.a (mgr.14388) 11043 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:36 smithi027 bash[22610]: audit 2024-08-31T06:26:35.237459+0000 mgr.a (mgr.14388) 11042 : audit [DBG] from='client.243294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:36 smithi027 bash[22610]: cluster 2024-08-31T06:26:35.481645+0000 mgr.a (mgr.14388) 11043 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:37.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:36 smithi191 bash[24992]: audit 2024-08-31T06:26:35.237459+0000 mgr.a (mgr.14388) 11042 : audit [DBG] from='client.243294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:37.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:36 smithi191 bash[24992]: cluster 2024-08-31T06:26:35.481645+0000 mgr.a (mgr.14388) 11043 : cluster [DBG] pgmap v7654: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:38 smithi163 bash[24253]: cluster 2024-08-31T06:26:37.482524+0000 mgr.a (mgr.14388) 11044 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:38 smithi027 bash[22610]: cluster 2024-08-31T06:26:37.482524+0000 mgr.a (mgr.14388) 11044 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:39.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:38 smithi191 bash[24992]: cluster 2024-08-31T06:26:37.482524+0000 mgr.a (mgr.14388) 11044 : cluster [DBG] pgmap v7655: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:40.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:40.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:40.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:40 smithi163 bash[24253]: cluster 2024-08-31T06:26:39.484732+0000 mgr.a (mgr.14388) 11045 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:41.238 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:40 smithi027 bash[22610]: cluster 2024-08-31T06:26:39.484732+0000 mgr.a (mgr.14388) 11045 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:40 smithi191 bash[24992]: cluster 2024-08-31T06:26:39.484732+0000 mgr.a (mgr.14388) 11045 : cluster [DBG] pgmap v7656: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:41.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:42.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:41 smithi163 bash[24253]: audit 2024-08-31T06:26:40.988202+0000 mgr.a (mgr.14388) 11046 : audit [DBG] from='client.243372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:41 smithi027 bash[22610]: audit 2024-08-31T06:26:40.988202+0000 mgr.a (mgr.14388) 11046 : audit [DBG] from='client.243372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:41 smithi191 bash[24992]: audit 2024-08-31T06:26:40.988202+0000 mgr.a (mgr.14388) 11046 : audit [DBG] from='client.243372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:42 smithi163 bash[24253]: cluster 2024-08-31T06:26:41.485627+0000 mgr.a (mgr.14388) 11047 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:42 smithi027 bash[22610]: cluster 2024-08-31T06:26:41.485627+0000 mgr.a (mgr.14388) 11047 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:42 smithi191 bash[24992]: cluster 2024-08-31T06:26:41.485627+0000 mgr.a (mgr.14388) 11047 : cluster [DBG] pgmap v7657: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:44 smithi163 bash[24253]: cluster 2024-08-31T06:26:43.487832+0000 mgr.a (mgr.14388) 11048 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:44 smithi027 bash[22610]: cluster 2024-08-31T06:26:43.487832+0000 mgr.a (mgr.14388) 11048 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:45.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:44 smithi191 bash[24992]: cluster 2024-08-31T06:26:43.487832+0000 mgr.a (mgr.14388) 11048 : cluster [DBG] pgmap v7658: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:46.400 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:46.401 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:46.401 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:47.180 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:47.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:47.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:47.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:47.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:46 smithi163 bash[24253]: cluster 2024-08-31T06:26:45.488602+0000 mgr.a (mgr.14388) 11049 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:46 smithi027 bash[22610]: cluster 2024-08-31T06:26:45.488602+0000 mgr.a (mgr.14388) 11049 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:47.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:46 smithi191 bash[24992]: cluster 2024-08-31T06:26:45.488602+0000 mgr.a (mgr.14388) 11049 : cluster [DBG] pgmap v7659: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:48.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:47 smithi163 bash[24253]: audit 2024-08-31T06:26:46.733801+0000 mgr.a (mgr.14388) 11050 : audit [DBG] from='client.243450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:47 smithi027 bash[22610]: audit 2024-08-31T06:26:46.733801+0000 mgr.a (mgr.14388) 11050 : audit [DBG] from='client.243450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:47 smithi191 bash[24992]: audit 2024-08-31T06:26:46.733801+0000 mgr.a (mgr.14388) 11050 : audit [DBG] from='client.243450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:48 smithi163 bash[24253]: cluster 2024-08-31T06:26:47.489498+0000 mgr.a (mgr.14388) 11051 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:48 smithi027 bash[22610]: cluster 2024-08-31T06:26:47.489498+0000 mgr.a (mgr.14388) 11051 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:48 smithi191 bash[24992]: cluster 2024-08-31T06:26:47.489498+0000 mgr.a (mgr.14388) 11051 : cluster [DBG] pgmap v7660: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:50 smithi163 bash[24253]: cluster 2024-08-31T06:26:49.491723+0000 mgr.a (mgr.14388) 11052 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:50 smithi027 bash[22610]: cluster 2024-08-31T06:26:49.491723+0000 mgr.a (mgr.14388) 11052 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:50 smithi191 bash[24992]: cluster 2024-08-31T06:26:49.491723+0000 mgr.a (mgr.14388) 11052 : cluster [DBG] pgmap v7661: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:52.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:52.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:52.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:52.917 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:52.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:52.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:52.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:52.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:52 smithi163 bash[24253]: cluster 2024-08-31T06:26:51.492475+0000 mgr.a (mgr.14388) 11053 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:52 smithi027 bash[22610]: cluster 2024-08-31T06:26:51.492475+0000 mgr.a (mgr.14388) 11053 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:52 smithi191 bash[24992]: cluster 2024-08-31T06:26:51.492475+0000 mgr.a (mgr.14388) 11053 : cluster [DBG] pgmap v7662: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:54.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:53 smithi163 bash[24253]: audit 2024-08-31T06:26:52.508461+0000 mgr.a (mgr.14388) 11054 : audit [DBG] from='client.243525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:53 smithi027 bash[22610]: audit 2024-08-31T06:26:52.508461+0000 mgr.a (mgr.14388) 11054 : audit [DBG] from='client.243525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:53 smithi191 bash[24992]: audit 2024-08-31T06:26:52.508461+0000 mgr.a (mgr.14388) 11054 : audit [DBG] from='client.243525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:26:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:54 smithi163 bash[24253]: cluster 2024-08-31T06:26:53.494702+0000 mgr.a (mgr.14388) 11055 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:54 smithi027 bash[22610]: cluster 2024-08-31T06:26:53.494702+0000 mgr.a (mgr.14388) 11055 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:55.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:54 smithi191 bash[24992]: cluster 2024-08-31T06:26:53.494702+0000 mgr.a (mgr.14388) 11055 : cluster [DBG] pgmap v7663: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:26:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:56 smithi163 bash[24253]: cluster 2024-08-31T06:26:55.495567+0000 mgr.a (mgr.14388) 11056 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:56 smithi027 bash[22610]: cluster 2024-08-31T06:26:55.495567+0000 mgr.a (mgr.14388) 11056 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:56 smithi191 bash[24992]: cluster 2024-08-31T06:26:55.495567+0000 mgr.a (mgr.14388) 11056 : cluster [DBG] pgmap v7664: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:57.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:26:57.920 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:26:57.920 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:26:58.693 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:26:58.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:26:58.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:26:58.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:26:58.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:26:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:58 smithi163 bash[24253]: cluster 2024-08-31T06:26:57.496371+0000 mgr.a (mgr.14388) 11057 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:59.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:58 smithi027 bash[22610]: cluster 2024-08-31T06:26:57.496371+0000 mgr.a (mgr.14388) 11057 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:26:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:58 smithi191 bash[24992]: cluster 2024-08-31T06:26:57.496371+0000 mgr.a (mgr.14388) 11057 : cluster [DBG] pgmap v7665: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:00.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:26:59 smithi163 bash[24253]: audit 2024-08-31T06:26:58.250619+0000 mgr.a (mgr.14388) 11058 : audit [DBG] from='client.243600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:26:59 smithi027 bash[22610]: audit 2024-08-31T06:26:58.250619+0000 mgr.a (mgr.14388) 11058 : audit [DBG] from='client.243600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:26:59 smithi191 bash[24992]: audit 2024-08-31T06:26:58.250619+0000 mgr.a (mgr.14388) 11058 : audit [DBG] from='client.243600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:00 smithi163 bash[24253]: cluster 2024-08-31T06:26:59.499074+0000 mgr.a (mgr.14388) 11059 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:00 smithi027 bash[22610]: cluster 2024-08-31T06:26:59.499074+0000 mgr.a (mgr.14388) 11059 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:00 smithi191 bash[24992]: cluster 2024-08-31T06:26:59.499074+0000 mgr.a (mgr.14388) 11059 : cluster [DBG] pgmap v7666: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:02 smithi163 bash[24253]: cluster 2024-08-31T06:27:01.499863+0000 mgr.a (mgr.14388) 11060 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:03.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:02 smithi027 bash[22610]: cluster 2024-08-31T06:27:01.499863+0000 mgr.a (mgr.14388) 11060 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:02 smithi191 bash[24992]: cluster 2024-08-31T06:27:01.499863+0000 mgr.a (mgr.14388) 11060 : cluster [DBG] pgmap v7667: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:03.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:27:03.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:27:03.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:27:04.481 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:27:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:27:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:27:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:27:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:27:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:04 smithi163 bash[24253]: cluster 2024-08-31T06:27:03.501852+0000 mgr.a (mgr.14388) 11061 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:04 smithi163 bash[24253]: audit 2024-08-31T06:27:04.031276+0000 mgr.a (mgr.14388) 11062 : audit [DBG] from='client.243678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:04 smithi027 bash[22610]: cluster 2024-08-31T06:27:03.501852+0000 mgr.a (mgr.14388) 11061 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:04 smithi027 bash[22610]: audit 2024-08-31T06:27:04.031276+0000 mgr.a (mgr.14388) 11062 : audit [DBG] from='client.243678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:04 smithi191 bash[24992]: cluster 2024-08-31T06:27:03.501852+0000 mgr.a (mgr.14388) 11061 : cluster [DBG] pgmap v7668: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:04 smithi191 bash[24992]: audit 2024-08-31T06:27:04.031276+0000 mgr.a (mgr.14388) 11062 : audit [DBG] from='client.243678 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:06 smithi163 bash[24253]: cluster 2024-08-31T06:27:05.502969+0000 mgr.a (mgr.14388) 11063 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:06 smithi027 bash[22610]: cluster 2024-08-31T06:27:05.502969+0000 mgr.a (mgr.14388) 11063 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:06 smithi191 bash[24992]: cluster 2024-08-31T06:27:05.502969+0000 mgr.a (mgr.14388) 11063 : cluster [DBG] pgmap v7669: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:08 smithi163 bash[24253]: cluster 2024-08-31T06:27:07.503827+0000 mgr.a (mgr.14388) 11064 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:27:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:08 smithi027 bash[22610]: cluster 2024-08-31T06:27:07.503827+0000 mgr.a (mgr.14388) 11064 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:27:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:08 smithi191 bash[24992]: cluster 2024-08-31T06:27:07.503827+0000 mgr.a (mgr.14388) 11064 : cluster [DBG] pgmap v7670: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:27:09.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:27:09.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:27:09.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:27:10.233 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:27:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:27:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:27:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:27:10.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:27:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:10 smithi163 bash[24253]: cluster 2024-08-31T06:27:09.505897+0000 mgr.a (mgr.14388) 11065 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:10 smithi163 bash[24253]: audit 2024-08-31T06:27:09.808534+0000 mgr.a (mgr.14388) 11066 : audit [DBG] from='client.243753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:10 smithi027 bash[22610]: cluster 2024-08-31T06:27:09.505897+0000 mgr.a (mgr.14388) 11065 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:10 smithi027 bash[22610]: audit 2024-08-31T06:27:09.808534+0000 mgr.a (mgr.14388) 11066 : audit [DBG] from='client.243753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:10 smithi191 bash[24992]: cluster 2024-08-31T06:27:09.505897+0000 mgr.a (mgr.14388) 11065 : cluster [DBG] pgmap v7671: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:10 smithi191 bash[24992]: audit 2024-08-31T06:27:09.808534+0000 mgr.a (mgr.14388) 11066 : audit [DBG] from='client.243753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:12 smithi163 bash[24253]: cluster 2024-08-31T06:27:11.506938+0000 mgr.a (mgr.14388) 11067 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:12 smithi027 bash[22610]: cluster 2024-08-31T06:27:11.506938+0000 mgr.a (mgr.14388) 11067 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:12 smithi191 bash[24992]: cluster 2024-08-31T06:27:11.506938+0000 mgr.a (mgr.14388) 11067 : cluster [DBG] pgmap v7672: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:14 smithi163 bash[24253]: cluster 2024-08-31T06:27:13.509125+0000 mgr.a (mgr.14388) 11068 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:14 smithi027 bash[22610]: cluster 2024-08-31T06:27:13.509125+0000 mgr.a (mgr.14388) 11068 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:15.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:27:15.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:27:15.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:27:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:14 smithi191 bash[24992]: cluster 2024-08-31T06:27:13.509125+0000 mgr.a (mgr.14388) 11068 : cluster [DBG] pgmap v7673: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:15.969 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:27:15.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:27:15.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:27:15.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:27:15.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:27:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:16 smithi163 bash[24253]: cluster 2024-08-31T06:27:15.509849+0000 mgr.a (mgr.14388) 11069 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:16 smithi163 bash[24253]: audit 2024-08-31T06:27:15.558808+0000 mgr.a (mgr.14388) 11070 : audit [DBG] from='client.243828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:16 smithi027 bash[22610]: cluster 2024-08-31T06:27:15.509849+0000 mgr.a (mgr.14388) 11069 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:16 smithi027 bash[22610]: audit 2024-08-31T06:27:15.558808+0000 mgr.a (mgr.14388) 11070 : audit [DBG] from='client.243828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:16 smithi191 bash[24992]: cluster 2024-08-31T06:27:15.509849+0000 mgr.a (mgr.14388) 11069 : cluster [DBG] pgmap v7674: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:16 smithi191 bash[24992]: audit 2024-08-31T06:27:15.558808+0000 mgr.a (mgr.14388) 11070 : audit [DBG] from='client.243828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:18 smithi163 bash[24253]: cluster 2024-08-31T06:27:17.510848+0000 mgr.a (mgr.14388) 11071 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:18 smithi027 bash[22610]: cluster 2024-08-31T06:27:17.510848+0000 mgr.a (mgr.14388) 11071 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:18 smithi191 bash[24992]: cluster 2024-08-31T06:27:17.510848+0000 mgr.a (mgr.14388) 11071 : cluster [DBG] pgmap v7675: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:19 smithi027 bash[22610]: audit 2024-08-31T06:27:19.587614+0000 mon.a (mon.0) 2234 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:27:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:19 smithi191 bash[24992]: audit 2024-08-31T06:27:19.587614+0000 mon.a (mon.0) 2234 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:27:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:19 smithi163 bash[24253]: audit 2024-08-31T06:27:19.587614+0000 mon.a (mon.0) 2234 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:27:20.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:27:20.970 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:27:20.970 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:27:21.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:27:21 smithi027 bash[22863]: debug 2024-08-31T06:27:21.184+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:27:21.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:27:21 smithi027 bash[22863]: debug 2024-08-31T06:27:21.184+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:27:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:20 smithi027 bash[22610]: cluster 2024-08-31T06:27:19.513059+0000 mgr.a (mgr.14388) 11072 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:20 smithi027 bash[22610]: audit 2024-08-31T06:27:20.430688+0000 mon.a (mon.0) 2235 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:27:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:20 smithi027 bash[22610]: audit 2024-08-31T06:27:20.431972+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:27:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:20 smithi027 bash[22610]: audit 2024-08-31T06:27:20.440439+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:27:21.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:20 smithi027 bash[22610]: audit 2024-08-31T06:27:20.445286+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:27:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:20 smithi191 bash[24992]: cluster 2024-08-31T06:27:19.513059+0000 mgr.a (mgr.14388) 11072 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:20 smithi191 bash[24992]: audit 2024-08-31T06:27:20.430688+0000 mon.a (mon.0) 2235 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:27:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:20 smithi191 bash[24992]: audit 2024-08-31T06:27:20.431972+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:27:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:20 smithi191 bash[24992]: audit 2024-08-31T06:27:20.440439+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:27:21.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:20 smithi191 bash[24992]: audit 2024-08-31T06:27:20.445286+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:27:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:20 smithi163 bash[24253]: cluster 2024-08-31T06:27:19.513059+0000 mgr.a (mgr.14388) 11072 : cluster [DBG] pgmap v7676: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:20 smithi163 bash[24253]: audit 2024-08-31T06:27:20.430688+0000 mon.a (mon.0) 2235 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:27:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:20 smithi163 bash[24253]: audit 2024-08-31T06:27:20.431972+0000 mon.a (mon.0) 2236 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:27:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:20 smithi163 bash[24253]: audit 2024-08-31T06:27:20.440439+0000 mon.a (mon.0) 2237 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:27:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:20 smithi163 bash[24253]: audit 2024-08-31T06:27:20.445286+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:27:21.730 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:27:21.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:27:21.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:27:21.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:27:21.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:27:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:21 smithi027 bash[22610]: audit 2024-08-31T06:27:20.447646+0000 mgr.a (mgr.14388) 11073 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:27:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:21 smithi027 bash[22610]: audit 2024-08-31T06:27:21.187466+0000 mgr.a (mgr.14388) 11074 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:27:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:21 smithi027 bash[22610]: cephadm 2024-08-31T06:27:21.189037+0000 mgr.a (mgr.14388) 11075 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:27:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:21 smithi191 bash[24992]: audit 2024-08-31T06:27:20.447646+0000 mgr.a (mgr.14388) 11073 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:27:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:21 smithi191 bash[24992]: audit 2024-08-31T06:27:21.187466+0000 mgr.a (mgr.14388) 11074 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:27:22.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:21 smithi191 bash[24992]: cephadm 2024-08-31T06:27:21.189037+0000 mgr.a (mgr.14388) 11075 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:27:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:21 smithi163 bash[24253]: audit 2024-08-31T06:27:20.447646+0000 mgr.a (mgr.14388) 11073 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:27:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:21 smithi163 bash[24253]: audit 2024-08-31T06:27:21.187466+0000 mgr.a (mgr.14388) 11074 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:27:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:21 smithi163 bash[24253]: cephadm 2024-08-31T06:27:21.189037+0000 mgr.a (mgr.14388) 11075 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:27:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:22 smithi027 bash[22610]: audit 2024-08-31T06:27:21.310005+0000 mgr.a (mgr.14388) 11076 : audit [DBG] from='client.244011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:22 smithi027 bash[22610]: cluster 2024-08-31T06:27:21.513687+0000 mgr.a (mgr.14388) 11077 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:22 smithi191 bash[24992]: audit 2024-08-31T06:27:21.310005+0000 mgr.a (mgr.14388) 11076 : audit [DBG] from='client.244011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:23.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:22 smithi191 bash[24992]: cluster 2024-08-31T06:27:21.513687+0000 mgr.a (mgr.14388) 11077 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:22 smithi163 bash[24253]: audit 2024-08-31T06:27:21.310005+0000 mgr.a (mgr.14388) 11076 : audit [DBG] from='client.244011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:22 smithi163 bash[24253]: cluster 2024-08-31T06:27:21.513687+0000 mgr.a (mgr.14388) 11077 : cluster [DBG] pgmap v7677: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:24 smithi027 bash[22610]: cluster 2024-08-31T06:27:23.516210+0000 mgr.a (mgr.14388) 11078 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:24 smithi191 bash[24992]: cluster 2024-08-31T06:27:23.516210+0000 mgr.a (mgr.14388) 11078 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:24 smithi163 bash[24253]: cluster 2024-08-31T06:27:23.516210+0000 mgr.a (mgr.14388) 11078 : cluster [DBG] pgmap v7678: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:26.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:27:26.732 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:27:26.732 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:27:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:26 smithi027 bash[22610]: cluster 2024-08-31T06:27:25.517220+0000 mgr.a (mgr.14388) 11079 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:26 smithi191 bash[24992]: cluster 2024-08-31T06:27:25.517220+0000 mgr.a (mgr.14388) 11079 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:27.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:26 smithi163 bash[24253]: cluster 2024-08-31T06:27:25.517220+0000 mgr.a (mgr.14388) 11079 : cluster [DBG] pgmap v7679: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:27.488 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:27:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:27:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:27:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:27:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:27:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:27 smithi027 bash[22610]: audit 2024-08-31T06:27:27.064302+0000 mgr.a (mgr.14388) 11080 : audit [DBG] from='client.244083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:27 smithi191 bash[24992]: audit 2024-08-31T06:27:27.064302+0000 mgr.a (mgr.14388) 11080 : audit [DBG] from='client.244083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:27 smithi163 bash[24253]: audit 2024-08-31T06:27:27.064302+0000 mgr.a (mgr.14388) 11080 : audit [DBG] from='client.244083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:28 smithi027 bash[22610]: cluster 2024-08-31T06:27:27.518230+0000 mgr.a (mgr.14388) 11081 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:28 smithi191 bash[24992]: cluster 2024-08-31T06:27:27.518230+0000 mgr.a (mgr.14388) 11081 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:28 smithi163 bash[24253]: cluster 2024-08-31T06:27:27.518230+0000 mgr.a (mgr.14388) 11081 : cluster [DBG] pgmap v7680: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:30 smithi191 bash[24992]: cluster 2024-08-31T06:27:29.520519+0000 mgr.a (mgr.14388) 11082 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:30 smithi163 bash[24253]: cluster 2024-08-31T06:27:29.520519+0000 mgr.a (mgr.14388) 11082 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:30 smithi027 bash[22610]: cluster 2024-08-31T06:27:29.520519+0000 mgr.a (mgr.14388) 11082 : cluster [DBG] pgmap v7681: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:32.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:27:32.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:27:32.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:27:33.234 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:27:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:27:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:27:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:27:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:27:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:32 smithi191 bash[24992]: cluster 2024-08-31T06:27:31.521301+0000 mgr.a (mgr.14388) 11083 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:32 smithi163 bash[24253]: cluster 2024-08-31T06:27:31.521301+0000 mgr.a (mgr.14388) 11083 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:32 smithi027 bash[22610]: cluster 2024-08-31T06:27:31.521301+0000 mgr.a (mgr.14388) 11083 : cluster [DBG] pgmap v7682: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:33 smithi191 bash[24992]: audit 2024-08-31T06:27:32.821389+0000 mgr.a (mgr.14388) 11084 : audit [DBG] from='client.244161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:34.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:33 smithi163 bash[24253]: audit 2024-08-31T06:27:32.821389+0000 mgr.a (mgr.14388) 11084 : audit [DBG] from='client.244161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:33 smithi027 bash[22610]: audit 2024-08-31T06:27:32.821389+0000 mgr.a (mgr.14388) 11084 : audit [DBG] from='client.244161 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:35 smithi191 bash[24992]: cluster 2024-08-31T06:27:33.524134+0000 mgr.a (mgr.14388) 11085 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:35 smithi163 bash[24253]: cluster 2024-08-31T06:27:33.524134+0000 mgr.a (mgr.14388) 11085 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:35 smithi027 bash[22610]: cluster 2024-08-31T06:27:33.524134+0000 mgr.a (mgr.14388) 11085 : cluster [DBG] pgmap v7683: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:27:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:37 smithi191 bash[24992]: cluster 2024-08-31T06:27:35.524945+0000 mgr.a (mgr.14388) 11086 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:37 smithi163 bash[24253]: cluster 2024-08-31T06:27:35.524945+0000 mgr.a (mgr.14388) 11086 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:37 smithi027 bash[22610]: cluster 2024-08-31T06:27:35.524945+0000 mgr.a (mgr.14388) 11086 : cluster [DBG] pgmap v7684: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:38.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:27:38.237 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:27:38.237 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:27:39.009 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:27:39.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:27:39.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:27:39.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:27:39.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:27:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:39 smithi191 bash[24992]: cluster 2024-08-31T06:27:37.525756+0000 mgr.a (mgr.14388) 11087 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:39 smithi163 bash[24253]: cluster 2024-08-31T06:27:37.525756+0000 mgr.a (mgr.14388) 11087 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:39 smithi027 bash[22610]: cluster 2024-08-31T06:27:37.525756+0000 mgr.a (mgr.14388) 11087 : cluster [DBG] pgmap v7685: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:40 smithi191 bash[24992]: audit 2024-08-31T06:27:38.574464+0000 mgr.a (mgr.14388) 11088 : audit [DBG] from='client.244239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:40 smithi163 bash[24253]: audit 2024-08-31T06:27:38.574464+0000 mgr.a (mgr.14388) 11088 : audit [DBG] from='client.244239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:40 smithi027 bash[22610]: audit 2024-08-31T06:27:38.574464+0000 mgr.a (mgr.14388) 11088 : audit [DBG] from='client.244239 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:41.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:41 smithi191 bash[24992]: cluster 2024-08-31T06:27:39.528635+0000 mgr.a (mgr.14388) 11089 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:41 smithi163 bash[24253]: cluster 2024-08-31T06:27:39.528635+0000 mgr.a (mgr.14388) 11089 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:41 smithi027 bash[22610]: cluster 2024-08-31T06:27:39.528635+0000 mgr.a (mgr.14388) 11089 : cluster [DBG] pgmap v7686: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:43 smithi191 bash[24992]: cluster 2024-08-31T06:27:41.529431+0000 mgr.a (mgr.14388) 11090 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:43 smithi163 bash[24253]: cluster 2024-08-31T06:27:41.529431+0000 mgr.a (mgr.14388) 11090 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:43 smithi027 bash[22610]: cluster 2024-08-31T06:27:41.529431+0000 mgr.a (mgr.14388) 11090 : cluster [DBG] pgmap v7687: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:27:44.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:27:44.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:27:44.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:27:44.762 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:27:44.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:27:44.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:27:44.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:27:44.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:27:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:45 smithi191 bash[24992]: cluster 2024-08-31T06:27:43.531462+0000 mgr.a (mgr.14388) 11091 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:45 smithi163 bash[24253]: cluster 2024-08-31T06:27:43.531462+0000 mgr.a (mgr.14388) 11091 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:45 smithi027 bash[22610]: cluster 2024-08-31T06:27:43.531462+0000 mgr.a (mgr.14388) 11091 : cluster [DBG] pgmap v7688: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:46.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:46 smithi163 bash[24253]: audit 2024-08-31T06:27:44.345872+0000 mgr.a (mgr.14388) 11092 : audit [DBG] from='client.244317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:46 smithi027 bash[22610]: audit 2024-08-31T06:27:44.345872+0000 mgr.a (mgr.14388) 11092 : audit [DBG] from='client.244317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:46 smithi191 bash[24992]: audit 2024-08-31T06:27:44.345872+0000 mgr.a (mgr.14388) 11092 : audit [DBG] from='client.244317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:47 smithi163 bash[24253]: cluster 2024-08-31T06:27:45.532448+0000 mgr.a (mgr.14388) 11093 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:47 smithi027 bash[22610]: cluster 2024-08-31T06:27:45.532448+0000 mgr.a (mgr.14388) 11093 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:47 smithi191 bash[24992]: cluster 2024-08-31T06:27:45.532448+0000 mgr.a (mgr.14388) 11093 : cluster [DBG] pgmap v7689: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:49 smithi163 bash[24253]: cluster 2024-08-31T06:27:47.533389+0000 mgr.a (mgr.14388) 11094 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:49 smithi027 bash[22610]: cluster 2024-08-31T06:27:47.533389+0000 mgr.a (mgr.14388) 11094 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:49 smithi191 bash[24992]: cluster 2024-08-31T06:27:47.533389+0000 mgr.a (mgr.14388) 11094 : cluster [DBG] pgmap v7690: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:49.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:27:49.765 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:27:49.765 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:27:50.518 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:27:50.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:27:50.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:27:50.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:27:50.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:27:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:51 smithi163 bash[24253]: cluster 2024-08-31T06:27:49.535718+0000 mgr.a (mgr.14388) 11095 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:51 smithi163 bash[24253]: audit 2024-08-31T06:27:50.094918+0000 mgr.a (mgr.14388) 11096 : audit [DBG] from='client.244395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:51 smithi027 bash[22610]: cluster 2024-08-31T06:27:49.535718+0000 mgr.a (mgr.14388) 11095 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:51 smithi027 bash[22610]: audit 2024-08-31T06:27:50.094918+0000 mgr.a (mgr.14388) 11096 : audit [DBG] from='client.244395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:51 smithi191 bash[24992]: cluster 2024-08-31T06:27:49.535718+0000 mgr.a (mgr.14388) 11095 : cluster [DBG] pgmap v7691: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:51.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:51 smithi191 bash[24992]: audit 2024-08-31T06:27:50.094918+0000 mgr.a (mgr.14388) 11096 : audit [DBG] from='client.244395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:53 smithi163 bash[24253]: cluster 2024-08-31T06:27:51.536700+0000 mgr.a (mgr.14388) 11097 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:53 smithi027 bash[22610]: cluster 2024-08-31T06:27:51.536700+0000 mgr.a (mgr.14388) 11097 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:53 smithi191 bash[24992]: cluster 2024-08-31T06:27:51.536700+0000 mgr.a (mgr.14388) 11097 : cluster [DBG] pgmap v7692: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:55 smithi163 bash[24253]: cluster 2024-08-31T06:27:53.538945+0000 mgr.a (mgr.14388) 11098 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:55 smithi027 bash[22610]: cluster 2024-08-31T06:27:53.538945+0000 mgr.a (mgr.14388) 11098 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:55.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:27:55.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:27:55.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:27:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:55 smithi191 bash[24992]: cluster 2024-08-31T06:27:53.538945+0000 mgr.a (mgr.14388) 11098 : cluster [DBG] pgmap v7693: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:27:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:27:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:27:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:27:56.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:27:56.293 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:27:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:57 smithi163 bash[24253]: cluster 2024-08-31T06:27:55.539621+0000 mgr.a (mgr.14388) 11099 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:57 smithi163 bash[24253]: audit 2024-08-31T06:27:55.856454+0000 mgr.a (mgr.14388) 11100 : audit [DBG] from='client.244473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:57 smithi027 bash[22610]: cluster 2024-08-31T06:27:55.539621+0000 mgr.a (mgr.14388) 11099 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:57 smithi027 bash[22610]: audit 2024-08-31T06:27:55.856454+0000 mgr.a (mgr.14388) 11100 : audit [DBG] from='client.244473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:57 smithi191 bash[24992]: cluster 2024-08-31T06:27:55.539621+0000 mgr.a (mgr.14388) 11099 : cluster [DBG] pgmap v7694: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:57 smithi191 bash[24992]: audit 2024-08-31T06:27:55.856454+0000 mgr.a (mgr.14388) 11100 : audit [DBG] from='client.244473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:27:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:27:59 smithi163 bash[24253]: cluster 2024-08-31T06:27:57.540542+0000 mgr.a (mgr.14388) 11101 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:27:59 smithi027 bash[22610]: cluster 2024-08-31T06:27:57.540542+0000 mgr.a (mgr.14388) 11101 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:27:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:27:59 smithi191 bash[24992]: cluster 2024-08-31T06:27:57.540542+0000 mgr.a (mgr.14388) 11101 : cluster [DBG] pgmap v7695: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:01.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:01.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:01.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:01 smithi163 bash[24253]: cluster 2024-08-31T06:27:59.542950+0000 mgr.a (mgr.14388) 11102 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:01 smithi027 bash[22610]: cluster 2024-08-31T06:27:59.542950+0000 mgr.a (mgr.14388) 11102 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:01 smithi191 bash[24992]: cluster 2024-08-31T06:27:59.542950+0000 mgr.a (mgr.14388) 11102 : cluster [DBG] pgmap v7696: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:02.045 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:02.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:02.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:02.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:02.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:03 smithi163 bash[24253]: cluster 2024-08-31T06:28:01.543486+0000 mgr.a (mgr.14388) 11103 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:03 smithi163 bash[24253]: audit 2024-08-31T06:28:01.628175+0000 mgr.a (mgr.14388) 11104 : audit [DBG] from='client.244551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:03 smithi027 bash[22610]: cluster 2024-08-31T06:28:01.543486+0000 mgr.a (mgr.14388) 11103 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:03 smithi027 bash[22610]: audit 2024-08-31T06:28:01.628175+0000 mgr.a (mgr.14388) 11104 : audit [DBG] from='client.244551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:03 smithi191 bash[24992]: cluster 2024-08-31T06:28:01.543486+0000 mgr.a (mgr.14388) 11103 : cluster [DBG] pgmap v7697: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:03 smithi191 bash[24992]: audit 2024-08-31T06:28:01.628175+0000 mgr.a (mgr.14388) 11104 : audit [DBG] from='client.244551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:05 smithi163 bash[24253]: cluster 2024-08-31T06:28:03.545696+0000 mgr.a (mgr.14388) 11105 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:05 smithi027 bash[22610]: cluster 2024-08-31T06:28:03.545696+0000 mgr.a (mgr.14388) 11105 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:05 smithi191 bash[24992]: cluster 2024-08-31T06:28:03.545696+0000 mgr.a (mgr.14388) 11105 : cluster [DBG] pgmap v7698: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:07.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:07.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:07.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:07 smithi163 bash[24253]: cluster 2024-08-31T06:28:05.546464+0000 mgr.a (mgr.14388) 11106 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:07 smithi027 bash[22610]: cluster 2024-08-31T06:28:05.546464+0000 mgr.a (mgr.14388) 11106 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:07 smithi191 bash[24992]: cluster 2024-08-31T06:28:05.546464+0000 mgr.a (mgr.14388) 11106 : cluster [DBG] pgmap v7699: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:07.818 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:07.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:07.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:07.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:07.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:09 smithi163 bash[24253]: audit 2024-08-31T06:28:07.384353+0000 mgr.a (mgr.14388) 11107 : audit [DBG] from='client.244629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:09 smithi163 bash[24253]: cluster 2024-08-31T06:28:07.547039+0000 mgr.a (mgr.14388) 11108 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:09 smithi027 bash[22610]: audit 2024-08-31T06:28:07.384353+0000 mgr.a (mgr.14388) 11107 : audit [DBG] from='client.244629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:09 smithi027 bash[22610]: cluster 2024-08-31T06:28:07.547039+0000 mgr.a (mgr.14388) 11108 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:09 smithi191 bash[24992]: audit 2024-08-31T06:28:07.384353+0000 mgr.a (mgr.14388) 11107 : audit [DBG] from='client.244629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:09 smithi191 bash[24992]: cluster 2024-08-31T06:28:07.547039+0000 mgr.a (mgr.14388) 11108 : cluster [DBG] pgmap v7700: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:11 smithi163 bash[24253]: cluster 2024-08-31T06:28:09.549337+0000 mgr.a (mgr.14388) 11109 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:11 smithi027 bash[22610]: cluster 2024-08-31T06:28:09.549337+0000 mgr.a (mgr.14388) 11109 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:11 smithi191 bash[24992]: cluster 2024-08-31T06:28:09.549337+0000 mgr.a (mgr.14388) 11109 : cluster [DBG] pgmap v7701: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:12.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:12.821 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:12.821 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:13 smithi163 bash[24253]: cluster 2024-08-31T06:28:11.550134+0000 mgr.a (mgr.14388) 11110 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:13 smithi027 bash[22610]: cluster 2024-08-31T06:28:11.550134+0000 mgr.a (mgr.14388) 11110 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:13 smithi191 bash[24992]: cluster 2024-08-31T06:28:11.550134+0000 mgr.a (mgr.14388) 11110 : cluster [DBG] pgmap v7702: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:13.598 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:13.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:13.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:13.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:13.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:14 smithi163 bash[24253]: audit 2024-08-31T06:28:13.161529+0000 mgr.a (mgr.14388) 11111 : audit [DBG] from='client.244707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:14 smithi027 bash[22610]: audit 2024-08-31T06:28:13.161529+0000 mgr.a (mgr.14388) 11111 : audit [DBG] from='client.244707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:14 smithi191 bash[24992]: audit 2024-08-31T06:28:13.161529+0000 mgr.a (mgr.14388) 11111 : audit [DBG] from='client.244707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:15 smithi163 bash[24253]: cluster 2024-08-31T06:28:13.551995+0000 mgr.a (mgr.14388) 11112 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:15 smithi027 bash[22610]: cluster 2024-08-31T06:28:13.551995+0000 mgr.a (mgr.14388) 11112 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:15 smithi191 bash[24992]: cluster 2024-08-31T06:28:13.551995+0000 mgr.a (mgr.14388) 11112 : cluster [DBG] pgmap v7703: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:17 smithi163 bash[24253]: cluster 2024-08-31T06:28:15.552778+0000 mgr.a (mgr.14388) 11113 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:17 smithi027 bash[22610]: cluster 2024-08-31T06:28:15.552778+0000 mgr.a (mgr.14388) 11113 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:17 smithi191 bash[24992]: cluster 2024-08-31T06:28:15.552778+0000 mgr.a (mgr.14388) 11113 : cluster [DBG] pgmap v7704: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:18.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:18.600 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:18.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:19.345 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:19.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:19.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:19.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:19.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:19 smithi163 bash[24253]: cluster 2024-08-31T06:28:17.553553+0000 mgr.a (mgr.14388) 11114 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:28:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:19 smithi027 bash[22610]: cluster 2024-08-31T06:28:17.553553+0000 mgr.a (mgr.14388) 11114 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:28:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:19 smithi191 bash[24992]: cluster 2024-08-31T06:28:17.553553+0000 mgr.a (mgr.14388) 11114 : cluster [DBG] pgmap v7705: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:28:20.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:20 smithi163 bash[24253]: audit 2024-08-31T06:28:18.923996+0000 mgr.a (mgr.14388) 11115 : audit [DBG] from='client.244785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:20 smithi027 bash[22610]: audit 2024-08-31T06:28:18.923996+0000 mgr.a (mgr.14388) 11115 : audit [DBG] from='client.244785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:20 smithi191 bash[24992]: audit 2024-08-31T06:28:18.923996+0000 mgr.a (mgr.14388) 11115 : audit [DBG] from='client.244785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:21 smithi163 bash[24253]: cluster 2024-08-31T06:28:19.556340+0000 mgr.a (mgr.14388) 11116 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:21 smithi027 bash[22610]: cluster 2024-08-31T06:28:19.556340+0000 mgr.a (mgr.14388) 11116 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:21 smithi191 bash[24992]: cluster 2024-08-31T06:28:19.556340+0000 mgr.a (mgr.14388) 11116 : cluster [DBG] pgmap v7706: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:22 smithi163 bash[24253]: audit 2024-08-31T06:28:21.240339+0000 mon.a (mon.0) 2239 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:28:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:22 smithi163 bash[24253]: audit 2024-08-31T06:28:21.864728+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:28:22.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:22 smithi163 bash[24253]: audit 2024-08-31T06:28:21.868684+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:28:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:22 smithi027 bash[22610]: audit 2024-08-31T06:28:21.240339+0000 mon.a (mon.0) 2239 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:28:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:22 smithi027 bash[22610]: audit 2024-08-31T06:28:21.864728+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:28:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:22 smithi027 bash[22610]: audit 2024-08-31T06:28:21.868684+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:28:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:22 smithi191 bash[24992]: audit 2024-08-31T06:28:21.240339+0000 mon.a (mon.0) 2239 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:28:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:22 smithi191 bash[24992]: audit 2024-08-31T06:28:21.864728+0000 mon.a (mon.0) 2240 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:28:22.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:22 smithi191 bash[24992]: audit 2024-08-31T06:28:21.868684+0000 mon.a (mon.0) 2241 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:28:23.399 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:23 smithi027 bash[22610]: cluster 2024-08-31T06:28:21.557102+0000 mgr.a (mgr.14388) 11117 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:23.399 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:23 smithi027 bash[22610]: audit 2024-08-31T06:28:22.645862+0000 mon.a (mon.0) 2242 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:28:23.399 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:23 smithi027 bash[22610]: audit 2024-08-31T06:28:22.647365+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:28:23.399 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:23 smithi027 bash[22610]: audit 2024-08-31T06:28:22.656108+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:28:23.399 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:23 smithi027 bash[22610]: audit 2024-08-31T06:28:22.660886+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:28:23.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:23 smithi163 bash[24253]: cluster 2024-08-31T06:28:21.557102+0000 mgr.a (mgr.14388) 11117 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:23.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:23 smithi163 bash[24253]: audit 2024-08-31T06:28:22.645862+0000 mon.a (mon.0) 2242 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:28:23.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:23 smithi163 bash[24253]: audit 2024-08-31T06:28:22.647365+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:28:23.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:23 smithi163 bash[24253]: audit 2024-08-31T06:28:22.656108+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:28:23.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:23 smithi163 bash[24253]: audit 2024-08-31T06:28:22.660886+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:28:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:23 smithi191 bash[24992]: cluster 2024-08-31T06:28:21.557102+0000 mgr.a (mgr.14388) 11117 : cluster [DBG] pgmap v7707: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:23 smithi191 bash[24992]: audit 2024-08-31T06:28:22.645862+0000 mon.a (mon.0) 2242 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:28:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:23 smithi191 bash[24992]: audit 2024-08-31T06:28:22.647365+0000 mon.a (mon.0) 2243 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:28:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:23 smithi191 bash[24992]: audit 2024-08-31T06:28:22.656108+0000 mon.a (mon.0) 2244 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:28:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:23 smithi191 bash[24992]: audit 2024-08-31T06:28:22.660886+0000 mon.a (mon.0) 2245 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:28:23.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:28:23 smithi027 bash[22863]: debug 2024-08-31T06:28:23.391+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:28:23.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:28:23 smithi027 bash[22863]: debug 2024-08-31T06:28:23.395+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:28:24.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:24.348 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:24.348 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:24.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:24 smithi163 bash[24253]: audit 2024-08-31T06:28:22.663292+0000 mgr.a (mgr.14388) 11118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:28:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:24 smithi027 bash[22610]: audit 2024-08-31T06:28:22.663292+0000 mgr.a (mgr.14388) 11118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:28:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:24 smithi191 bash[24992]: audit 2024-08-31T06:28:22.663292+0000 mgr.a (mgr.14388) 11118 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:28:25.115 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:25.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:25.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:25.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:25.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:25 smithi163 bash[24253]: audit 2024-08-31T06:28:23.398067+0000 mgr.a (mgr.14388) 11119 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:28:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:25 smithi163 bash[24253]: cephadm 2024-08-31T06:28:23.399224+0000 mgr.a (mgr.14388) 11120 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:28:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:25 smithi163 bash[24253]: cluster 2024-08-31T06:28:23.559882+0000 mgr.a (mgr.14388) 11121 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:28:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:25 smithi027 bash[22610]: audit 2024-08-31T06:28:23.398067+0000 mgr.a (mgr.14388) 11119 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:28:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:25 smithi027 bash[22610]: cephadm 2024-08-31T06:28:23.399224+0000 mgr.a (mgr.14388) 11120 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:28:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:25 smithi027 bash[22610]: cluster 2024-08-31T06:28:23.559882+0000 mgr.a (mgr.14388) 11121 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:28:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:25 smithi191 bash[24992]: audit 2024-08-31T06:28:23.398067+0000 mgr.a (mgr.14388) 11119 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:28:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:25 smithi191 bash[24992]: cephadm 2024-08-31T06:28:23.399224+0000 mgr.a (mgr.14388) 11120 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:28:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:25 smithi191 bash[24992]: cluster 2024-08-31T06:28:23.559882+0000 mgr.a (mgr.14388) 11121 : cluster [DBG] pgmap v7708: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:28:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:26 smithi163 bash[24253]: audit 2024-08-31T06:28:24.682446+0000 mgr.a (mgr.14388) 11122 : audit [DBG] from='client.244968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:26 smithi027 bash[22610]: audit 2024-08-31T06:28:24.682446+0000 mgr.a (mgr.14388) 11122 : audit [DBG] from='client.244968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:26 smithi191 bash[24992]: audit 2024-08-31T06:28:24.682446+0000 mgr.a (mgr.14388) 11122 : audit [DBG] from='client.244968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:27 smithi163 bash[24253]: cluster 2024-08-31T06:28:25.560819+0000 mgr.a (mgr.14388) 11123 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:28:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:27 smithi027 bash[22610]: cluster 2024-08-31T06:28:25.560819+0000 mgr.a (mgr.14388) 11123 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:28:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:27 smithi191 bash[24992]: cluster 2024-08-31T06:28:25.560819+0000 mgr.a (mgr.14388) 11123 : cluster [DBG] pgmap v7709: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:28:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:29 smithi163 bash[24253]: cluster 2024-08-31T06:28:27.561779+0000 mgr.a (mgr.14388) 11124 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:28:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:29 smithi027 bash[22610]: cluster 2024-08-31T06:28:27.561779+0000 mgr.a (mgr.14388) 11124 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:28:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:29 smithi191 bash[24992]: cluster 2024-08-31T06:28:27.561779+0000 mgr.a (mgr.14388) 11124 : cluster [DBG] pgmap v7710: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:28:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:30.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:30.118 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:30.878 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:30.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:31 smithi163 bash[24253]: cluster 2024-08-31T06:28:29.564203+0000 mgr.a (mgr.14388) 11125 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:31 smithi027 bash[22610]: cluster 2024-08-31T06:28:29.564203+0000 mgr.a (mgr.14388) 11125 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:31 smithi191 bash[24992]: cluster 2024-08-31T06:28:29.564203+0000 mgr.a (mgr.14388) 11125 : cluster [DBG] pgmap v7711: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:32.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:32 smithi163 bash[24253]: audit 2024-08-31T06:28:30.449246+0000 mgr.a (mgr.14388) 11126 : audit [DBG] from='client.245046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:32 smithi027 bash[22610]: audit 2024-08-31T06:28:30.449246+0000 mgr.a (mgr.14388) 11126 : audit [DBG] from='client.245046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:32 smithi191 bash[24992]: audit 2024-08-31T06:28:30.449246+0000 mgr.a (mgr.14388) 11126 : audit [DBG] from='client.245046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:33 smithi163 bash[24253]: cluster 2024-08-31T06:28:31.565232+0000 mgr.a (mgr.14388) 11127 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:33 smithi027 bash[22610]: cluster 2024-08-31T06:28:31.565232+0000 mgr.a (mgr.14388) 11127 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:33 smithi191 bash[24992]: cluster 2024-08-31T06:28:31.565232+0000 mgr.a (mgr.14388) 11127 : cluster [DBG] pgmap v7712: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:35 smithi163 bash[24253]: cluster 2024-08-31T06:28:33.567533+0000 mgr.a (mgr.14388) 11128 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:35 smithi027 bash[22610]: cluster 2024-08-31T06:28:33.567533+0000 mgr.a (mgr.14388) 11128 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:35 smithi191 bash[24992]: cluster 2024-08-31T06:28:33.567533+0000 mgr.a (mgr.14388) 11128 : cluster [DBG] pgmap v7713: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:35.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:35.880 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:35.880 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:36.632 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:36.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:36.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:36.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:36.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:37 smithi163 bash[24253]: cluster 2024-08-31T06:28:35.568296+0000 mgr.a (mgr.14388) 11129 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:28:37.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:37 smithi163 bash[24253]: audit 2024-08-31T06:28:36.219159+0000 mgr.a (mgr.14388) 11130 : audit [DBG] from='client.245124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:37 smithi027 bash[22610]: cluster 2024-08-31T06:28:35.568296+0000 mgr.a (mgr.14388) 11129 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:28:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:37 smithi027 bash[22610]: audit 2024-08-31T06:28:36.219159+0000 mgr.a (mgr.14388) 11130 : audit [DBG] from='client.245124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:37 smithi191 bash[24992]: cluster 2024-08-31T06:28:35.568296+0000 mgr.a (mgr.14388) 11129 : cluster [DBG] pgmap v7714: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:28:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:37 smithi191 bash[24992]: audit 2024-08-31T06:28:36.219159+0000 mgr.a (mgr.14388) 11130 : audit [DBG] from='client.245124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:39 smithi163 bash[24253]: cluster 2024-08-31T06:28:37.569316+0000 mgr.a (mgr.14388) 11131 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:28:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:39 smithi027 bash[22610]: cluster 2024-08-31T06:28:37.569316+0000 mgr.a (mgr.14388) 11131 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:28:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:39 smithi191 bash[24992]: cluster 2024-08-31T06:28:37.569316+0000 mgr.a (mgr.14388) 11131 : cluster [DBG] pgmap v7715: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:28:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:41 smithi163 bash[24253]: cluster 2024-08-31T06:28:39.571617+0000 mgr.a (mgr.14388) 11132 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:41 smithi027 bash[22610]: cluster 2024-08-31T06:28:39.571617+0000 mgr.a (mgr.14388) 11132 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:41 smithi191 bash[24992]: cluster 2024-08-31T06:28:39.571617+0000 mgr.a (mgr.14388) 11132 : cluster [DBG] pgmap v7716: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:28:41.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:41.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:41.635 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:42.424 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:42.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:42.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:42.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:42.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:43 smithi027 bash[22610]: cluster 2024-08-31T06:28:41.572422+0000 mgr.a (mgr.14388) 11133 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:43 smithi027 bash[22610]: audit 2024-08-31T06:28:41.970210+0000 mgr.a (mgr.14388) 11134 : audit [DBG] from='client.245202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:43 smithi191 bash[24992]: cluster 2024-08-31T06:28:41.572422+0000 mgr.a (mgr.14388) 11133 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:43.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:43 smithi191 bash[24992]: audit 2024-08-31T06:28:41.970210+0000 mgr.a (mgr.14388) 11134 : audit [DBG] from='client.245202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:43 smithi163 bash[24253]: cluster 2024-08-31T06:28:41.572422+0000 mgr.a (mgr.14388) 11133 : cluster [DBG] pgmap v7717: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:43 smithi163 bash[24253]: audit 2024-08-31T06:28:41.970210+0000 mgr.a (mgr.14388) 11134 : audit [DBG] from='client.245202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:45 smithi027 bash[22610]: cluster 2024-08-31T06:28:43.574833+0000 mgr.a (mgr.14388) 11135 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:45 smithi191 bash[24992]: cluster 2024-08-31T06:28:43.574833+0000 mgr.a (mgr.14388) 11135 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:45 smithi163 bash[24253]: cluster 2024-08-31T06:28:43.574833+0000 mgr.a (mgr.14388) 11135 : cluster [DBG] pgmap v7718: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:28:47.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:47.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:47.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:47 smithi027 bash[22610]: cluster 2024-08-31T06:28:45.575732+0000 mgr.a (mgr.14388) 11136 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:47 smithi191 bash[24992]: cluster 2024-08-31T06:28:45.575732+0000 mgr.a (mgr.14388) 11136 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:47 smithi163 bash[24253]: cluster 2024-08-31T06:28:45.575732+0000 mgr.a (mgr.14388) 11136 : cluster [DBG] pgmap v7719: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:48.197 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:48.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:48.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:48.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:48.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:49 smithi027 bash[22610]: cluster 2024-08-31T06:28:47.576308+0000 mgr.a (mgr.14388) 11137 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:49 smithi027 bash[22610]: audit 2024-08-31T06:28:47.762457+0000 mgr.a (mgr.14388) 11138 : audit [DBG] from='client.245277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:49 smithi191 bash[24992]: cluster 2024-08-31T06:28:47.576308+0000 mgr.a (mgr.14388) 11137 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:49 smithi191 bash[24992]: audit 2024-08-31T06:28:47.762457+0000 mgr.a (mgr.14388) 11138 : audit [DBG] from='client.245277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:49 smithi163 bash[24253]: cluster 2024-08-31T06:28:47.576308+0000 mgr.a (mgr.14388) 11137 : cluster [DBG] pgmap v7720: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:49 smithi163 bash[24253]: audit 2024-08-31T06:28:47.762457+0000 mgr.a (mgr.14388) 11138 : audit [DBG] from='client.245277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:51 smithi027 bash[22610]: cluster 2024-08-31T06:28:49.578985+0000 mgr.a (mgr.14388) 11139 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:51 smithi191 bash[24992]: cluster 2024-08-31T06:28:49.578985+0000 mgr.a (mgr.14388) 11139 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:51 smithi163 bash[24253]: cluster 2024-08-31T06:28:49.578985+0000 mgr.a (mgr.14388) 11139 : cluster [DBG] pgmap v7721: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:53.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:53.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:53.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:53 smithi027 bash[22610]: cluster 2024-08-31T06:28:51.579764+0000 mgr.a (mgr.14388) 11140 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:53 smithi191 bash[24992]: cluster 2024-08-31T06:28:51.579764+0000 mgr.a (mgr.14388) 11140 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:53 smithi163 bash[24253]: cluster 2024-08-31T06:28:51.579764+0000 mgr.a (mgr.14388) 11140 : cluster [DBG] pgmap v7722: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:53.957 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:53.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:53.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:53.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:53.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:55 smithi027 bash[22610]: audit 2024-08-31T06:28:53.528466+0000 mgr.a (mgr.14388) 11141 : audit [DBG] from='client.245352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:55 smithi027 bash[22610]: cluster 2024-08-31T06:28:53.582776+0000 mgr.a (mgr.14388) 11142 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:55 smithi191 bash[24992]: audit 2024-08-31T06:28:53.528466+0000 mgr.a (mgr.14388) 11141 : audit [DBG] from='client.245352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:55 smithi191 bash[24992]: cluster 2024-08-31T06:28:53.582776+0000 mgr.a (mgr.14388) 11142 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:55.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:55 smithi163 bash[24253]: audit 2024-08-31T06:28:53.528466+0000 mgr.a (mgr.14388) 11141 : audit [DBG] from='client.245352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:28:55.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:55 smithi163 bash[24253]: cluster 2024-08-31T06:28:53.582776+0000 mgr.a (mgr.14388) 11142 : cluster [DBG] pgmap v7723: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:28:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:57 smithi027 bash[22610]: cluster 2024-08-31T06:28:55.583850+0000 mgr.a (mgr.14388) 11143 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:57 smithi191 bash[24992]: cluster 2024-08-31T06:28:55.583850+0000 mgr.a (mgr.14388) 11143 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:57.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:57 smithi163 bash[24253]: cluster 2024-08-31T06:28:55.583850+0000 mgr.a (mgr.14388) 11143 : cluster [DBG] pgmap v7724: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:58.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:28:58.959 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:28:58.959 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:28:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:28:59 smithi191 bash[24992]: cluster 2024-08-31T06:28:57.584837+0000 mgr.a (mgr.14388) 11144 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:28:59 smithi163 bash[24253]: cluster 2024-08-31T06:28:57.584837+0000 mgr.a (mgr.14388) 11144 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:28:59.729 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:28:59.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:28:59.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:28:59.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:28:59.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:28:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:28:59 smithi027 bash[22610]: cluster 2024-08-31T06:28:57.584837+0000 mgr.a (mgr.14388) 11144 : cluster [DBG] pgmap v7725: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:29:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:01 smithi191 bash[24992]: audit 2024-08-31T06:28:59.293095+0000 mgr.a (mgr.14388) 11145 : audit [DBG] from='client.245430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:01 smithi191 bash[24992]: cluster 2024-08-31T06:28:59.586412+0000 mgr.a (mgr.14388) 11146 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:01.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:01 smithi163 bash[24253]: audit 2024-08-31T06:28:59.293095+0000 mgr.a (mgr.14388) 11145 : audit [DBG] from='client.245430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:01.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:01 smithi163 bash[24253]: cluster 2024-08-31T06:28:59.586412+0000 mgr.a (mgr.14388) 11146 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:01 smithi027 bash[22610]: audit 2024-08-31T06:28:59.293095+0000 mgr.a (mgr.14388) 11145 : audit [DBG] from='client.245430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:01 smithi027 bash[22610]: cluster 2024-08-31T06:28:59.586412+0000 mgr.a (mgr.14388) 11146 : cluster [DBG] pgmap v7726: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:02 smithi191 bash[24992]: cluster 2024-08-31T06:29:01.587304+0000 mgr.a (mgr.14388) 11147 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:02 smithi163 bash[24253]: cluster 2024-08-31T06:29:01.587304+0000 mgr.a (mgr.14388) 11147 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:02 smithi027 bash[22610]: cluster 2024-08-31T06:29:01.587304+0000 mgr.a (mgr.14388) 11147 : cluster [DBG] pgmap v7727: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:04.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:29:04.731 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:29:04.731 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:29:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:04 smithi163 bash[24253]: cluster 2024-08-31T06:29:03.589543+0000 mgr.a (mgr.14388) 11148 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:04 smithi027 bash[22610]: cluster 2024-08-31T06:29:03.589543+0000 mgr.a (mgr.14388) 11148 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:04 smithi191 bash[24992]: cluster 2024-08-31T06:29:03.589543+0000 mgr.a (mgr.14388) 11148 : cluster [DBG] pgmap v7728: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:05.513 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:29:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:29:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:29:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:29:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:29:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:05 smithi163 bash[24253]: audit 2024-08-31T06:29:05.066853+0000 mgr.a (mgr.14388) 11149 : audit [DBG] from='client.245508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:05 smithi027 bash[22610]: audit 2024-08-31T06:29:05.066853+0000 mgr.a (mgr.14388) 11149 : audit [DBG] from='client.245508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:05 smithi191 bash[24992]: audit 2024-08-31T06:29:05.066853+0000 mgr.a (mgr.14388) 11149 : audit [DBG] from='client.245508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:06.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:06 smithi163 bash[24253]: cluster 2024-08-31T06:29:05.590662+0000 mgr.a (mgr.14388) 11150 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:06 smithi027 bash[22610]: cluster 2024-08-31T06:29:05.590662+0000 mgr.a (mgr.14388) 11150 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:06 smithi191 bash[24992]: cluster 2024-08-31T06:29:05.590662+0000 mgr.a (mgr.14388) 11150 : cluster [DBG] pgmap v7729: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:08 smithi163 bash[24253]: cluster 2024-08-31T06:29:07.591520+0000 mgr.a (mgr.14388) 11151 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:08 smithi027 bash[22610]: cluster 2024-08-31T06:29:07.591520+0000 mgr.a (mgr.14388) 11151 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:08 smithi191 bash[24992]: cluster 2024-08-31T06:29:07.591520+0000 mgr.a (mgr.14388) 11151 : cluster [DBG] pgmap v7730: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:10.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:29:10.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:29:10.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:29:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:10 smithi163 bash[24253]: cluster 2024-08-31T06:29:09.593636+0000 mgr.a (mgr.14388) 11152 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:10 smithi027 bash[22610]: cluster 2024-08-31T06:29:09.593636+0000 mgr.a (mgr.14388) 11152 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:10 smithi191 bash[24992]: cluster 2024-08-31T06:29:09.593636+0000 mgr.a (mgr.14388) 11152 : cluster [DBG] pgmap v7731: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:11.258 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:29:11.258 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:29:11.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:29:11.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:29:11.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:29:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:11 smithi163 bash[24253]: audit 2024-08-31T06:29:10.847202+0000 mgr.a (mgr.14388) 11153 : audit [DBG] from='client.245583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:11.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:11 smithi027 bash[22610]: audit 2024-08-31T06:29:10.847202+0000 mgr.a (mgr.14388) 11153 : audit [DBG] from='client.245583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:11 smithi191 bash[24992]: audit 2024-08-31T06:29:10.847202+0000 mgr.a (mgr.14388) 11153 : audit [DBG] from='client.245583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:12.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:12 smithi163 bash[24253]: cluster 2024-08-31T06:29:11.594574+0000 mgr.a (mgr.14388) 11154 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:12 smithi027 bash[22610]: cluster 2024-08-31T06:29:11.594574+0000 mgr.a (mgr.14388) 11154 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:12 smithi191 bash[24992]: cluster 2024-08-31T06:29:11.594574+0000 mgr.a (mgr.14388) 11154 : cluster [DBG] pgmap v7732: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:14 smithi163 bash[24253]: cluster 2024-08-31T06:29:13.596752+0000 mgr.a (mgr.14388) 11155 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:14 smithi027 bash[22610]: cluster 2024-08-31T06:29:13.596752+0000 mgr.a (mgr.14388) 11155 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:14 smithi191 bash[24992]: cluster 2024-08-31T06:29:13.596752+0000 mgr.a (mgr.14388) 11155 : cluster [DBG] pgmap v7733: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:29:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:29:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:29:16.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:16 smithi163 bash[24253]: cluster 2024-08-31T06:29:15.597536+0000 mgr.a (mgr.14388) 11156 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:16 smithi027 bash[22610]: cluster 2024-08-31T06:29:15.597536+0000 mgr.a (mgr.14388) 11156 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:16 smithi191 bash[24992]: cluster 2024-08-31T06:29:15.597536+0000 mgr.a (mgr.14388) 11156 : cluster [DBG] pgmap v7734: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:17.044 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:29:17.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:29:17.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:29:17.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:29:17.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:29:17.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:17 smithi163 bash[24253]: audit 2024-08-31T06:29:16.597083+0000 mgr.a (mgr.14388) 11157 : audit [DBG] from='client.245655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:17 smithi027 bash[22610]: audit 2024-08-31T06:29:16.597083+0000 mgr.a (mgr.14388) 11157 : audit [DBG] from='client.245655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:17 smithi191 bash[24992]: audit 2024-08-31T06:29:16.597083+0000 mgr.a (mgr.14388) 11157 : audit [DBG] from='client.245655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:18 smithi163 bash[24253]: cluster 2024-08-31T06:29:17.598568+0000 mgr.a (mgr.14388) 11158 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:18.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:18 smithi027 bash[22610]: cluster 2024-08-31T06:29:17.598568+0000 mgr.a (mgr.14388) 11158 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:18 smithi191 bash[24992]: cluster 2024-08-31T06:29:17.598568+0000 mgr.a (mgr.14388) 11158 : cluster [DBG] pgmap v7735: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:20 smithi027 bash[22610]: cluster 2024-08-31T06:29:19.600798+0000 mgr.a (mgr.14388) 11159 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:20 smithi191 bash[24992]: cluster 2024-08-31T06:29:19.600798+0000 mgr.a (mgr.14388) 11159 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:21.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:20 smithi163 bash[24253]: cluster 2024-08-31T06:29:19.600798+0000 mgr.a (mgr.14388) 11159 : cluster [DBG] pgmap v7736: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:22.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:29:22.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:29:22.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:29:22.827 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:29:22.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:29:22.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:29:22.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:29:22.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:29:22.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:22 smithi027 bash[22610]: cluster 2024-08-31T06:29:21.601545+0000 mgr.a (mgr.14388) 11160 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:22 smithi191 bash[24992]: cluster 2024-08-31T06:29:21.601545+0000 mgr.a (mgr.14388) 11160 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:22 smithi163 bash[24253]: cluster 2024-08-31T06:29:21.601545+0000 mgr.a (mgr.14388) 11160 : cluster [DBG] pgmap v7737: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:23 smithi027 bash[22610]: audit 2024-08-31T06:29:22.381521+0000 mgr.a (mgr.14388) 11161 : audit [DBG] from='client.245733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:23 smithi027 bash[22610]: audit 2024-08-31T06:29:23.449303+0000 mon.a (mon.0) 2246 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:29:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:23 smithi191 bash[24992]: audit 2024-08-31T06:29:22.381521+0000 mgr.a (mgr.14388) 11161 : audit [DBG] from='client.245733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:23 smithi191 bash[24992]: audit 2024-08-31T06:29:23.449303+0000 mon.a (mon.0) 2246 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:29:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:23 smithi163 bash[24253]: audit 2024-08-31T06:29:22.381521+0000 mgr.a (mgr.14388) 11161 : audit [DBG] from='client.245733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:24.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:23 smithi163 bash[24253]: audit 2024-08-31T06:29:23.449303+0000 mon.a (mon.0) 2246 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:29:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:25 smithi163 bash[24253]: cluster 2024-08-31T06:29:23.603855+0000 mgr.a (mgr.14388) 11162 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:25 smithi163 bash[24253]: audit 2024-08-31T06:29:24.070853+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:25 smithi163 bash[24253]: audit 2024-08-31T06:29:24.078118+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:25 smithi163 bash[24253]: audit 2024-08-31T06:29:24.090395+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:25 smithi163 bash[24253]: audit 2024-08-31T06:29:24.096217+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:25 smithi163 bash[24253]: audit 2024-08-31T06:29:24.892186+0000 mon.a (mon.0) 2251 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:29:25.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:25 smithi163 bash[24253]: audit 2024-08-31T06:29:24.893584+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:29:25.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:25 smithi163 bash[24253]: audit 2024-08-31T06:29:24.904636+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:25 smithi163 bash[24253]: audit 2024-08-31T06:29:24.906933+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:29:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22610]: cluster 2024-08-31T06:29:23.603855+0000 mgr.a (mgr.14388) 11162 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22610]: audit 2024-08-31T06:29:24.070853+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22610]: audit 2024-08-31T06:29:24.078118+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22610]: audit 2024-08-31T06:29:24.090395+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22610]: audit 2024-08-31T06:29:24.096217+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22610]: audit 2024-08-31T06:29:24.892186+0000 mon.a (mon.0) 2251 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:29:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22610]: audit 2024-08-31T06:29:24.893584+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:29:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22610]: audit 2024-08-31T06:29:24.904636+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22610]: audit 2024-08-31T06:29:24.906933+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:29:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:25 smithi191 bash[24992]: cluster 2024-08-31T06:29:23.603855+0000 mgr.a (mgr.14388) 11162 : cluster [DBG] pgmap v7738: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:25 smithi191 bash[24992]: audit 2024-08-31T06:29:24.070853+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:25 smithi191 bash[24992]: audit 2024-08-31T06:29:24.078118+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:25 smithi191 bash[24992]: audit 2024-08-31T06:29:24.090395+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:25 smithi191 bash[24992]: audit 2024-08-31T06:29:24.096217+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:25 smithi191 bash[24992]: audit 2024-08-31T06:29:24.892186+0000 mon.a (mon.0) 2251 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:29:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:25 smithi191 bash[24992]: audit 2024-08-31T06:29:24.893584+0000 mon.a (mon.0) 2252 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:29:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:25 smithi191 bash[24992]: audit 2024-08-31T06:29:24.904636+0000 mon.a (mon.0) 2253 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:29:25.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:25 smithi191 bash[24992]: audit 2024-08-31T06:29:24.906933+0000 mon.a (mon.0) 2254 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:29:25.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22863]: debug 2024-08-31T06:29:25.625+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:29:25.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:29:25 smithi027 bash[22863]: debug 2024-08-31T06:29:25.629+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:29:26.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:26 smithi163 bash[24253]: audit 2024-08-31T06:29:24.907879+0000 mgr.a (mgr.14388) 11163 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:29:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:26 smithi027 bash[22610]: audit 2024-08-31T06:29:24.907879+0000 mgr.a (mgr.14388) 11163 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:29:26.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:26 smithi191 bash[24992]: audit 2024-08-31T06:29:24.907879+0000 mgr.a (mgr.14388) 11163 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:29:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:27 smithi163 bash[24253]: cluster 2024-08-31T06:29:25.604491+0000 mgr.a (mgr.14388) 11164 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:27 smithi163 bash[24253]: audit 2024-08-31T06:29:25.630530+0000 mgr.a (mgr.14388) 11165 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:29:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:27 smithi163 bash[24253]: cephadm 2024-08-31T06:29:25.631816+0000 mgr.a (mgr.14388) 11166 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:29:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:27 smithi027 bash[22610]: cluster 2024-08-31T06:29:25.604491+0000 mgr.a (mgr.14388) 11164 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:27 smithi027 bash[22610]: audit 2024-08-31T06:29:25.630530+0000 mgr.a (mgr.14388) 11165 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:29:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:27 smithi027 bash[22610]: cephadm 2024-08-31T06:29:25.631816+0000 mgr.a (mgr.14388) 11166 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:29:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:27 smithi191 bash[24992]: cluster 2024-08-31T06:29:25.604491+0000 mgr.a (mgr.14388) 11164 : cluster [DBG] pgmap v7739: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:27 smithi191 bash[24992]: audit 2024-08-31T06:29:25.630530+0000 mgr.a (mgr.14388) 11165 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:29:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:27 smithi191 bash[24992]: cephadm 2024-08-31T06:29:25.631816+0000 mgr.a (mgr.14388) 11166 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:29:27.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:29:27.830 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:29:27.830 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:29:28.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:29:28.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:29:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:29:28.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:29:28.600 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:29:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:29 smithi163 bash[24253]: cluster 2024-08-31T06:29:27.605258+0000 mgr.a (mgr.14388) 11167 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:29 smithi163 bash[24253]: audit 2024-08-31T06:29:28.166776+0000 mgr.a (mgr.14388) 11168 : audit [DBG] from='client.245916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:29 smithi027 bash[22610]: cluster 2024-08-31T06:29:27.605258+0000 mgr.a (mgr.14388) 11167 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:29 smithi027 bash[22610]: audit 2024-08-31T06:29:28.166776+0000 mgr.a (mgr.14388) 11168 : audit [DBG] from='client.245916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:29 smithi191 bash[24992]: cluster 2024-08-31T06:29:27.605258+0000 mgr.a (mgr.14388) 11167 : cluster [DBG] pgmap v7740: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:29 smithi191 bash[24992]: audit 2024-08-31T06:29:28.166776+0000 mgr.a (mgr.14388) 11168 : audit [DBG] from='client.245916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:31 smithi163 bash[24253]: cluster 2024-08-31T06:29:29.608035+0000 mgr.a (mgr.14388) 11169 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:29:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:31 smithi027 bash[22610]: cluster 2024-08-31T06:29:29.608035+0000 mgr.a (mgr.14388) 11169 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:29:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:31 smithi191 bash[24992]: cluster 2024-08-31T06:29:29.608035+0000 mgr.a (mgr.14388) 11169 : cluster [DBG] pgmap v7741: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:29:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:33 smithi163 bash[24253]: cluster 2024-08-31T06:29:31.608842+0000 mgr.a (mgr.14388) 11170 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:29:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:33 smithi027 bash[22610]: cluster 2024-08-31T06:29:31.608842+0000 mgr.a (mgr.14388) 11170 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:29:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:33 smithi191 bash[24992]: cluster 2024-08-31T06:29:31.608842+0000 mgr.a (mgr.14388) 11170 : cluster [DBG] pgmap v7742: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:29:33.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:29:33.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:29:33.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:29:34.354 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:29:34.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:29:34.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:29:34.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:29:34.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:29:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:35 smithi163 bash[24253]: cluster 2024-08-31T06:29:33.610929+0000 mgr.a (mgr.14388) 11171 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:29:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:35 smithi163 bash[24253]: audit 2024-08-31T06:29:33.928967+0000 mgr.a (mgr.14388) 11172 : audit [DBG] from='client.245991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:35 smithi027 bash[22610]: cluster 2024-08-31T06:29:33.610929+0000 mgr.a (mgr.14388) 11171 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:29:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:35 smithi027 bash[22610]: audit 2024-08-31T06:29:33.928967+0000 mgr.a (mgr.14388) 11172 : audit [DBG] from='client.245991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:35 smithi191 bash[24992]: cluster 2024-08-31T06:29:33.610929+0000 mgr.a (mgr.14388) 11171 : cluster [DBG] pgmap v7743: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:29:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:35 smithi191 bash[24992]: audit 2024-08-31T06:29:33.928967+0000 mgr.a (mgr.14388) 11172 : audit [DBG] from='client.245991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:37 smithi163 bash[24253]: cluster 2024-08-31T06:29:35.611847+0000 mgr.a (mgr.14388) 11173 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:29:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:37 smithi027 bash[22610]: cluster 2024-08-31T06:29:35.611847+0000 mgr.a (mgr.14388) 11173 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:29:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:37 smithi191 bash[24992]: cluster 2024-08-31T06:29:35.611847+0000 mgr.a (mgr.14388) 11173 : cluster [DBG] pgmap v7744: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:29:39.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:29:39.356 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:29:39.356 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:29:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:39 smithi163 bash[24253]: cluster 2024-08-31T06:29:37.612691+0000 mgr.a (mgr.14388) 11174 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:29:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:39 smithi027 bash[22610]: cluster 2024-08-31T06:29:37.612691+0000 mgr.a (mgr.14388) 11174 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:29:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:39 smithi191 bash[24992]: cluster 2024-08-31T06:29:37.612691+0000 mgr.a (mgr.14388) 11174 : cluster [DBG] pgmap v7745: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:29:40.121 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:29:40.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:29:40.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:29:40.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:29:40.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:29:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:41 smithi163 bash[24253]: cluster 2024-08-31T06:29:39.614887+0000 mgr.a (mgr.14388) 11175 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:29:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:41 smithi163 bash[24253]: audit 2024-08-31T06:29:39.693972+0000 mgr.a (mgr.14388) 11176 : audit [DBG] from='client.246069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:41 smithi027 bash[22610]: cluster 2024-08-31T06:29:39.614887+0000 mgr.a (mgr.14388) 11175 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:29:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:41 smithi027 bash[22610]: audit 2024-08-31T06:29:39.693972+0000 mgr.a (mgr.14388) 11176 : audit [DBG] from='client.246069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:41 smithi191 bash[24992]: cluster 2024-08-31T06:29:39.614887+0000 mgr.a (mgr.14388) 11175 : cluster [DBG] pgmap v7746: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:29:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:41 smithi191 bash[24992]: audit 2024-08-31T06:29:39.693972+0000 mgr.a (mgr.14388) 11176 : audit [DBG] from='client.246069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:43 smithi163 bash[24253]: cluster 2024-08-31T06:29:41.615776+0000 mgr.a (mgr.14388) 11177 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:43 smithi027 bash[22610]: cluster 2024-08-31T06:29:41.615776+0000 mgr.a (mgr.14388) 11177 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:43 smithi191 bash[24992]: cluster 2024-08-31T06:29:41.615776+0000 mgr.a (mgr.14388) 11177 : cluster [DBG] pgmap v7747: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:45.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:29:45.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:29:45.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:29:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:45 smithi163 bash[24253]: cluster 2024-08-31T06:29:43.618010+0000 mgr.a (mgr.14388) 11178 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:45 smithi027 bash[22610]: cluster 2024-08-31T06:29:43.618010+0000 mgr.a (mgr.14388) 11178 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:45 smithi191 bash[24992]: cluster 2024-08-31T06:29:43.618010+0000 mgr.a (mgr.14388) 11178 : cluster [DBG] pgmap v7748: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:45.909 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:29:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:29:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:29:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:29:45.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:29:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:47 smithi163 bash[24253]: audit 2024-08-31T06:29:45.462818+0000 mgr.a (mgr.14388) 11179 : audit [DBG] from='client.246147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:47 smithi163 bash[24253]: cluster 2024-08-31T06:29:45.618559+0000 mgr.a (mgr.14388) 11180 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:47 smithi027 bash[22610]: audit 2024-08-31T06:29:45.462818+0000 mgr.a (mgr.14388) 11179 : audit [DBG] from='client.246147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:47 smithi027 bash[22610]: cluster 2024-08-31T06:29:45.618559+0000 mgr.a (mgr.14388) 11180 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:47 smithi191 bash[24992]: audit 2024-08-31T06:29:45.462818+0000 mgr.a (mgr.14388) 11179 : audit [DBG] from='client.246147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:47 smithi191 bash[24992]: cluster 2024-08-31T06:29:45.618559+0000 mgr.a (mgr.14388) 11180 : cluster [DBG] pgmap v7749: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:49 smithi163 bash[24253]: cluster 2024-08-31T06:29:47.619615+0000 mgr.a (mgr.14388) 11181 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:49 smithi027 bash[22610]: cluster 2024-08-31T06:29:47.619615+0000 mgr.a (mgr.14388) 11181 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:49 smithi191 bash[24992]: cluster 2024-08-31T06:29:47.619615+0000 mgr.a (mgr.14388) 11181 : cluster [DBG] pgmap v7750: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:50.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:29:50.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:29:50.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:29:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:51 smithi163 bash[24253]: cluster 2024-08-31T06:29:49.621832+0000 mgr.a (mgr.14388) 11182 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:51 smithi027 bash[22610]: cluster 2024-08-31T06:29:49.621832+0000 mgr.a (mgr.14388) 11182 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:51 smithi191 bash[24992]: cluster 2024-08-31T06:29:49.621832+0000 mgr.a (mgr.14388) 11182 : cluster [DBG] pgmap v7751: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:51.665 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:29:51.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:29:51.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:29:51.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:29:51.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:29:52.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:52 smithi163 bash[24253]: audit 2024-08-31T06:29:51.245501+0000 mgr.a (mgr.14388) 11183 : audit [DBG] from='client.246225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:52 smithi027 bash[22610]: audit 2024-08-31T06:29:51.245501+0000 mgr.a (mgr.14388) 11183 : audit [DBG] from='client.246225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:52 smithi191 bash[24992]: audit 2024-08-31T06:29:51.245501+0000 mgr.a (mgr.14388) 11183 : audit [DBG] from='client.246225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:53.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:53 smithi163 bash[24253]: cluster 2024-08-31T06:29:51.622376+0000 mgr.a (mgr.14388) 11184 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:53 smithi027 bash[22610]: cluster 2024-08-31T06:29:51.622376+0000 mgr.a (mgr.14388) 11184 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:53 smithi191 bash[24992]: cluster 2024-08-31T06:29:51.622376+0000 mgr.a (mgr.14388) 11184 : cluster [DBG] pgmap v7752: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:55 smithi163 bash[24253]: cluster 2024-08-31T06:29:53.624685+0000 mgr.a (mgr.14388) 11185 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:55 smithi027 bash[22610]: cluster 2024-08-31T06:29:53.624685+0000 mgr.a (mgr.14388) 11185 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:55 smithi191 bash[24992]: cluster 2024-08-31T06:29:53.624685+0000 mgr.a (mgr.14388) 11185 : cluster [DBG] pgmap v7753: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:29:56.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:29:56.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:29:56.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:29:57.436 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:29:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:29:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:29:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:29:57.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:29:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:57 smithi163 bash[24253]: cluster 2024-08-31T06:29:55.625608+0000 mgr.a (mgr.14388) 11186 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:57 smithi027 bash[22610]: cluster 2024-08-31T06:29:55.625608+0000 mgr.a (mgr.14388) 11186 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:57 smithi191 bash[24992]: cluster 2024-08-31T06:29:55.625608+0000 mgr.a (mgr.14388) 11186 : cluster [DBG] pgmap v7754: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:58.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:58 smithi163 bash[24253]: audit 2024-08-31T06:29:57.001414+0000 mgr.a (mgr.14388) 11187 : audit [DBG] from='client.246300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:58 smithi027 bash[22610]: audit 2024-08-31T06:29:57.001414+0000 mgr.a (mgr.14388) 11187 : audit [DBG] from='client.246300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:58 smithi191 bash[24992]: audit 2024-08-31T06:29:57.001414+0000 mgr.a (mgr.14388) 11187 : audit [DBG] from='client.246300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:29:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:29:59 smithi163 bash[24253]: cluster 2024-08-31T06:29:57.626536+0000 mgr.a (mgr.14388) 11188 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:29:59 smithi027 bash[22610]: cluster 2024-08-31T06:29:57.626536+0000 mgr.a (mgr.14388) 11188 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:29:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:29:59 smithi191 bash[24992]: cluster 2024-08-31T06:29:57.626536+0000 mgr.a (mgr.14388) 11188 : cluster [DBG] pgmap v7755: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:00.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:00 smithi163 bash[24253]: cluster 2024-08-31T06:30:00.000147+0000 mon.a (mon.0) 2255 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:30:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:00 smithi027 bash[22610]: cluster 2024-08-31T06:30:00.000147+0000 mon.a (mon.0) 2255 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:30:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:00 smithi191 bash[24992]: cluster 2024-08-31T06:30:00.000147+0000 mon.a (mon.0) 2255 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:30:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:01 smithi163 bash[24253]: cluster 2024-08-31T06:29:59.628876+0000 mgr.a (mgr.14388) 11189 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:30:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:01 smithi027 bash[22610]: cluster 2024-08-31T06:29:59.628876+0000 mgr.a (mgr.14388) 11189 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:30:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:01 smithi191 bash[24992]: cluster 2024-08-31T06:29:59.628876+0000 mgr.a (mgr.14388) 11189 : cluster [DBG] pgmap v7756: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:30:02.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:30:02.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:30:02.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:30:03.220 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:30:03.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:30:03.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:30:03.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:30:03.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:30:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:03 smithi163 bash[24253]: cluster 2024-08-31T06:30:01.629684+0000 mgr.a (mgr.14388) 11190 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:03 smithi027 bash[22610]: cluster 2024-08-31T06:30:01.629684+0000 mgr.a (mgr.14388) 11190 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:03 smithi191 bash[24992]: cluster 2024-08-31T06:30:01.629684+0000 mgr.a (mgr.14388) 11190 : cluster [DBG] pgmap v7757: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:04 smithi163 bash[24253]: audit 2024-08-31T06:30:02.774289+0000 mgr.a (mgr.14388) 11191 : audit [DBG] from='client.246378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:04 smithi027 bash[22610]: audit 2024-08-31T06:30:02.774289+0000 mgr.a (mgr.14388) 11191 : audit [DBG] from='client.246378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:04 smithi191 bash[24992]: audit 2024-08-31T06:30:02.774289+0000 mgr.a (mgr.14388) 11191 : audit [DBG] from='client.246378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:05 smithi163 bash[24253]: cluster 2024-08-31T06:30:03.632366+0000 mgr.a (mgr.14388) 11192 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:05 smithi027 bash[22610]: cluster 2024-08-31T06:30:03.632366+0000 mgr.a (mgr.14388) 11192 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:05 smithi191 bash[24992]: cluster 2024-08-31T06:30:03.632366+0000 mgr.a (mgr.14388) 11192 : cluster [DBG] pgmap v7758: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:07 smithi163 bash[24253]: cluster 2024-08-31T06:30:05.633119+0000 mgr.a (mgr.14388) 11193 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:07 smithi027 bash[22610]: cluster 2024-08-31T06:30:05.633119+0000 mgr.a (mgr.14388) 11193 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:07 smithi191 bash[24992]: cluster 2024-08-31T06:30:05.633119+0000 mgr.a (mgr.14388) 11193 : cluster [DBG] pgmap v7759: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:08.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:30:08.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:30:08.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:30:08.983 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:30:08.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:30:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:09 smithi163 bash[24253]: cluster 2024-08-31T06:30:07.633874+0000 mgr.a (mgr.14388) 11194 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:30:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:09 smithi027 bash[22610]: cluster 2024-08-31T06:30:07.633874+0000 mgr.a (mgr.14388) 11194 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:30:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:09 smithi191 bash[24992]: cluster 2024-08-31T06:30:07.633874+0000 mgr.a (mgr.14388) 11194 : cluster [DBG] pgmap v7760: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:30:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:10 smithi027 bash[22610]: audit 2024-08-31T06:30:08.554759+0000 mgr.a (mgr.14388) 11195 : audit [DBG] from='client.246453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:10 smithi191 bash[24992]: audit 2024-08-31T06:30:08.554759+0000 mgr.a (mgr.14388) 11195 : audit [DBG] from='client.246453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:10.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:10 smithi163 bash[24253]: audit 2024-08-31T06:30:08.554759+0000 mgr.a (mgr.14388) 11195 : audit [DBG] from='client.246453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:11 smithi027 bash[22610]: cluster 2024-08-31T06:30:09.636789+0000 mgr.a (mgr.14388) 11196 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:11 smithi191 bash[24992]: cluster 2024-08-31T06:30:09.636789+0000 mgr.a (mgr.14388) 11196 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:11.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:11 smithi163 bash[24253]: cluster 2024-08-31T06:30:09.636789+0000 mgr.a (mgr.14388) 11196 : cluster [DBG] pgmap v7761: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:13 smithi027 bash[22610]: cluster 2024-08-31T06:30:11.637557+0000 mgr.a (mgr.14388) 11197 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:13 smithi191 bash[24992]: cluster 2024-08-31T06:30:11.637557+0000 mgr.a (mgr.14388) 11197 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:13 smithi163 bash[24253]: cluster 2024-08-31T06:30:11.637557+0000 mgr.a (mgr.14388) 11197 : cluster [DBG] pgmap v7762: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:13.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:30:13.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:30:13.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:30:14.761 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:30:14.761 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:30:14.761 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:30:14.761 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:30:14.761 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:30:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:15 smithi027 bash[22610]: cluster 2024-08-31T06:30:13.639733+0000 mgr.a (mgr.14388) 11198 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:15 smithi191 bash[24992]: cluster 2024-08-31T06:30:13.639733+0000 mgr.a (mgr.14388) 11198 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:15.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:15 smithi163 bash[24253]: cluster 2024-08-31T06:30:13.639733+0000 mgr.a (mgr.14388) 11198 : cluster [DBG] pgmap v7763: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:16 smithi027 bash[22610]: audit 2024-08-31T06:30:14.317833+0000 mgr.a (mgr.14388) 11199 : audit [DBG] from='client.246528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:16 smithi191 bash[24992]: audit 2024-08-31T06:30:14.317833+0000 mgr.a (mgr.14388) 11199 : audit [DBG] from='client.246528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:16.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:16 smithi163 bash[24253]: audit 2024-08-31T06:30:14.317833+0000 mgr.a (mgr.14388) 11199 : audit [DBG] from='client.246528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:17 smithi027 bash[22610]: cluster 2024-08-31T06:30:15.640806+0000 mgr.a (mgr.14388) 11200 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:17 smithi191 bash[24992]: cluster 2024-08-31T06:30:15.640806+0000 mgr.a (mgr.14388) 11200 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:17 smithi163 bash[24253]: cluster 2024-08-31T06:30:15.640806+0000 mgr.a (mgr.14388) 11200 : cluster [DBG] pgmap v7764: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:19 smithi027 bash[22610]: cluster 2024-08-31T06:30:17.641623+0000 mgr.a (mgr.14388) 11201 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:19 smithi191 bash[24992]: cluster 2024-08-31T06:30:17.641623+0000 mgr.a (mgr.14388) 11201 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:19 smithi163 bash[24253]: cluster 2024-08-31T06:30:17.641623+0000 mgr.a (mgr.14388) 11201 : cluster [DBG] pgmap v7765: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:19.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:30:19.763 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:30:19.763 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:30:20.543 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:30:20.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:30:20.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:30:20.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:30:20.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:30:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:21 smithi191 bash[24992]: cluster 2024-08-31T06:30:19.643852+0000 mgr.a (mgr.14388) 11202 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:30:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:21 smithi191 bash[24992]: audit 2024-08-31T06:30:20.095713+0000 mgr.a (mgr.14388) 11203 : audit [DBG] from='client.246600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:21 smithi163 bash[24253]: cluster 2024-08-31T06:30:19.643852+0000 mgr.a (mgr.14388) 11202 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:30:21.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:21 smithi163 bash[24253]: audit 2024-08-31T06:30:20.095713+0000 mgr.a (mgr.14388) 11203 : audit [DBG] from='client.246600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:21.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:21 smithi027 bash[22610]: cluster 2024-08-31T06:30:19.643852+0000 mgr.a (mgr.14388) 11202 : cluster [DBG] pgmap v7766: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:30:21.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:21 smithi027 bash[22610]: audit 2024-08-31T06:30:20.095713+0000 mgr.a (mgr.14388) 11203 : audit [DBG] from='client.246600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:23 smithi191 bash[24992]: cluster 2024-08-31T06:30:21.644723+0000 mgr.a (mgr.14388) 11204 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:23 smithi163 bash[24253]: cluster 2024-08-31T06:30:21.644723+0000 mgr.a (mgr.14388) 11204 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:23 smithi027 bash[22610]: cluster 2024-08-31T06:30:21.644723+0000 mgr.a (mgr.14388) 11204 : cluster [DBG] pgmap v7767: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:25 smithi191 bash[24992]: cluster 2024-08-31T06:30:23.646944+0000 mgr.a (mgr.14388) 11205 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:30:25.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:30:25.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:30:25.546 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:30:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:25 smithi163 bash[24253]: cluster 2024-08-31T06:30:23.646944+0000 mgr.a (mgr.14388) 11205 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:30:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:25 smithi027 bash[22610]: cluster 2024-08-31T06:30:23.646944+0000 mgr.a (mgr.14388) 11205 : cluster [DBG] pgmap v7768: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:30:26.324 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:30:26.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:30:26.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:30:26.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:30:26.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:30:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:26 smithi191 bash[24992]: audit 2024-08-31T06:30:25.680947+0000 mon.a (mon.0) 2256 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:30:26.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:26 smithi163 bash[24253]: audit 2024-08-31T06:30:25.680947+0000 mon.a (mon.0) 2256 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:30:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:26 smithi027 bash[22610]: audit 2024-08-31T06:30:25.680947+0000 mon.a (mon.0) 2256 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:30:27.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:30:27 smithi027 bash[22863]: debug 2024-08-31T06:30:27.184+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:30:27.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:30:27 smithi027 bash[22863]: debug 2024-08-31T06:30:27.184+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:30:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:27 smithi027 bash[22610]: cluster 2024-08-31T06:30:25.647444+0000 mgr.a (mgr.14388) 11206 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:27 smithi027 bash[22610]: audit 2024-08-31T06:30:25.879126+0000 mgr.a (mgr.14388) 11207 : audit [DBG] from='client.246672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:27 smithi027 bash[22610]: audit 2024-08-31T06:30:26.467218+0000 mon.a (mon.0) 2257 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:30:27.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:27 smithi027 bash[22610]: audit 2024-08-31T06:30:26.468736+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:30:27.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:27 smithi027 bash[22610]: audit 2024-08-31T06:30:26.478604+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:30:27.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:27 smithi027 bash[22610]: audit 2024-08-31T06:30:26.481525+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:30:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:27 smithi191 bash[24992]: cluster 2024-08-31T06:30:25.647444+0000 mgr.a (mgr.14388) 11206 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:27 smithi191 bash[24992]: audit 2024-08-31T06:30:25.879126+0000 mgr.a (mgr.14388) 11207 : audit [DBG] from='client.246672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:27 smithi191 bash[24992]: audit 2024-08-31T06:30:26.467218+0000 mon.a (mon.0) 2257 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:30:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:27 smithi191 bash[24992]: audit 2024-08-31T06:30:26.468736+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:30:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:27 smithi191 bash[24992]: audit 2024-08-31T06:30:26.478604+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:30:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:27 smithi191 bash[24992]: audit 2024-08-31T06:30:26.481525+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:30:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:27 smithi163 bash[24253]: cluster 2024-08-31T06:30:25.647444+0000 mgr.a (mgr.14388) 11206 : cluster [DBG] pgmap v7769: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:27 smithi163 bash[24253]: audit 2024-08-31T06:30:25.879126+0000 mgr.a (mgr.14388) 11207 : audit [DBG] from='client.246672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:27 smithi163 bash[24253]: audit 2024-08-31T06:30:26.467218+0000 mon.a (mon.0) 2257 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:30:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:27 smithi163 bash[24253]: audit 2024-08-31T06:30:26.468736+0000 mon.a (mon.0) 2258 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:30:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:27 smithi163 bash[24253]: audit 2024-08-31T06:30:26.478604+0000 mon.a (mon.0) 2259 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:30:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:27 smithi163 bash[24253]: audit 2024-08-31T06:30:26.481525+0000 mon.a (mon.0) 2260 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:30:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:28 smithi191 bash[24992]: audit 2024-08-31T06:30:26.483453+0000 mgr.a (mgr.14388) 11208 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:30:28.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:28 smithi191 bash[24992]: audit 2024-08-31T06:30:27.186906+0000 mgr.a (mgr.14388) 11209 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:30:28.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:28 smithi191 bash[24992]: cephadm 2024-08-31T06:30:27.188089+0000 mgr.a (mgr.14388) 11210 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:30:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:28 smithi163 bash[24253]: audit 2024-08-31T06:30:26.483453+0000 mgr.a (mgr.14388) 11208 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:30:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:28 smithi163 bash[24253]: audit 2024-08-31T06:30:27.186906+0000 mgr.a (mgr.14388) 11209 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:30:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:28 smithi163 bash[24253]: cephadm 2024-08-31T06:30:27.188089+0000 mgr.a (mgr.14388) 11210 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:30:28.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:28 smithi027 bash[22610]: audit 2024-08-31T06:30:26.483453+0000 mgr.a (mgr.14388) 11208 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:30:28.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:28 smithi027 bash[22610]: audit 2024-08-31T06:30:27.186906+0000 mgr.a (mgr.14388) 11209 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:30:28.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:28 smithi027 bash[22610]: cephadm 2024-08-31T06:30:27.188089+0000 mgr.a (mgr.14388) 11210 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:30:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:29 smithi191 bash[24992]: cluster 2024-08-31T06:30:27.648269+0000 mgr.a (mgr.14388) 11211 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:29.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:29 smithi163 bash[24253]: cluster 2024-08-31T06:30:27.648269+0000 mgr.a (mgr.14388) 11211 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:29 smithi027 bash[22610]: cluster 2024-08-31T06:30:27.648269+0000 mgr.a (mgr.14388) 11211 : cluster [DBG] pgmap v7770: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:31.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:30:31.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:30:31.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:30:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:31 smithi191 bash[24992]: cluster 2024-08-31T06:30:29.650481+0000 mgr.a (mgr.14388) 11212 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:31 smithi163 bash[24253]: cluster 2024-08-31T06:30:29.650481+0000 mgr.a (mgr.14388) 11212 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:31 smithi027 bash[22610]: cluster 2024-08-31T06:30:29.650481+0000 mgr.a (mgr.14388) 11212 : cluster [DBG] pgmap v7771: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:32.106 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:30:32.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:30:32.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:30:32.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:30:32.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:30:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:32 smithi163 bash[24253]: cluster 2024-08-31T06:30:31.650982+0000 mgr.a (mgr.14388) 11213 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:32.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:32 smithi163 bash[24253]: audit 2024-08-31T06:30:31.665741+0000 mgr.a (mgr.14388) 11214 : audit [DBG] from='client.246855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:32.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:32 smithi027 bash[22610]: cluster 2024-08-31T06:30:31.650982+0000 mgr.a (mgr.14388) 11213 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:32.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:32 smithi027 bash[22610]: audit 2024-08-31T06:30:31.665741+0000 mgr.a (mgr.14388) 11214 : audit [DBG] from='client.246855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:32 smithi191 bash[24992]: cluster 2024-08-31T06:30:31.650982+0000 mgr.a (mgr.14388) 11213 : cluster [DBG] pgmap v7772: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:32 smithi191 bash[24992]: audit 2024-08-31T06:30:31.665741+0000 mgr.a (mgr.14388) 11214 : audit [DBG] from='client.246855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:34.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:34 smithi027 bash[22610]: cluster 2024-08-31T06:30:33.653127+0000 mgr.a (mgr.14388) 11215 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:34 smithi191 bash[24992]: cluster 2024-08-31T06:30:33.653127+0000 mgr.a (mgr.14388) 11215 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:34 smithi163 bash[24253]: cluster 2024-08-31T06:30:33.653127+0000 mgr.a (mgr.14388) 11215 : cluster [DBG] pgmap v7773: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:36.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:36 smithi027 bash[22610]: cluster 2024-08-31T06:30:35.653890+0000 mgr.a (mgr.14388) 11216 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:36 smithi191 bash[24992]: cluster 2024-08-31T06:30:35.653890+0000 mgr.a (mgr.14388) 11216 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:37.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:30:37.108 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:30:37.109 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:30:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:36 smithi163 bash[24253]: cluster 2024-08-31T06:30:35.653890+0000 mgr.a (mgr.14388) 11216 : cluster [DBG] pgmap v7774: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:37.853 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:30:37.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:30:37.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:30:37.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:30:37.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:30:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:38 smithi027 bash[22610]: audit 2024-08-31T06:30:37.435192+0000 mgr.a (mgr.14388) 11217 : audit [DBG] from='client.246933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:38 smithi027 bash[22610]: cluster 2024-08-31T06:30:37.662871+0000 mgr.a (mgr.14388) 11218 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:38 smithi191 bash[24992]: audit 2024-08-31T06:30:37.435192+0000 mgr.a (mgr.14388) 11217 : audit [DBG] from='client.246933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:38 smithi191 bash[24992]: cluster 2024-08-31T06:30:37.662871+0000 mgr.a (mgr.14388) 11218 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:38 smithi163 bash[24253]: audit 2024-08-31T06:30:37.435192+0000 mgr.a (mgr.14388) 11217 : audit [DBG] from='client.246933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:38 smithi163 bash[24253]: cluster 2024-08-31T06:30:37.662871+0000 mgr.a (mgr.14388) 11218 : cluster [DBG] pgmap v7775: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:40 smithi027 bash[22610]: cluster 2024-08-31T06:30:39.665304+0000 mgr.a (mgr.14388) 11219 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:40 smithi191 bash[24992]: cluster 2024-08-31T06:30:39.665304+0000 mgr.a (mgr.14388) 11219 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:40 smithi163 bash[24253]: cluster 2024-08-31T06:30:39.665304+0000 mgr.a (mgr.14388) 11219 : cluster [DBG] pgmap v7776: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:30:42.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:30:42.855 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:30:42.855 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:30:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:42 smithi027 bash[22610]: cluster 2024-08-31T06:30:41.666129+0000 mgr.a (mgr.14388) 11220 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:42 smithi191 bash[24992]: cluster 2024-08-31T06:30:41.666129+0000 mgr.a (mgr.14388) 11220 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:42 smithi163 bash[24253]: cluster 2024-08-31T06:30:41.666129+0000 mgr.a (mgr.14388) 11220 : cluster [DBG] pgmap v7777: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:43.640 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:30:43.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:30:43.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:30:43.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:30:43.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:30:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:43 smithi191 bash[24992]: audit 2024-08-31T06:30:43.193369+0000 mgr.a (mgr.14388) 11221 : audit [DBG] from='client.247011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:44.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:43 smithi163 bash[24253]: audit 2024-08-31T06:30:43.193369+0000 mgr.a (mgr.14388) 11221 : audit [DBG] from='client.247011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:43 smithi027 bash[22610]: audit 2024-08-31T06:30:43.193369+0000 mgr.a (mgr.14388) 11221 : audit [DBG] from='client.247011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:44 smithi191 bash[24992]: cluster 2024-08-31T06:30:43.667749+0000 mgr.a (mgr.14388) 11222 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:44 smithi163 bash[24253]: cluster 2024-08-31T06:30:43.667749+0000 mgr.a (mgr.14388) 11222 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:44 smithi027 bash[22610]: cluster 2024-08-31T06:30:43.667749+0000 mgr.a (mgr.14388) 11222 : cluster [DBG] pgmap v7778: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:46 smithi191 bash[24992]: cluster 2024-08-31T06:30:45.668489+0000 mgr.a (mgr.14388) 11223 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:47.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:46 smithi163 bash[24253]: cluster 2024-08-31T06:30:45.668489+0000 mgr.a (mgr.14388) 11223 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:46 smithi027 bash[22610]: cluster 2024-08-31T06:30:45.668489+0000 mgr.a (mgr.14388) 11223 : cluster [DBG] pgmap v7779: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:48.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:30:48.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:30:48.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:30:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:48 smithi191 bash[24992]: cluster 2024-08-31T06:30:47.669286+0000 mgr.a (mgr.14388) 11224 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:48 smithi163 bash[24253]: cluster 2024-08-31T06:30:47.669286+0000 mgr.a (mgr.14388) 11224 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:48 smithi027 bash[22610]: cluster 2024-08-31T06:30:47.669286+0000 mgr.a (mgr.14388) 11224 : cluster [DBG] pgmap v7780: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:49.386 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:30:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:30:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:30:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:30:49.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:30:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:49 smithi191 bash[24992]: audit 2024-08-31T06:30:48.966250+0000 mgr.a (mgr.14388) 11225 : audit [DBG] from='client.247086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:50.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:49 smithi163 bash[24253]: audit 2024-08-31T06:30:48.966250+0000 mgr.a (mgr.14388) 11225 : audit [DBG] from='client.247086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:50.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:49 smithi027 bash[22610]: audit 2024-08-31T06:30:48.966250+0000 mgr.a (mgr.14388) 11225 : audit [DBG] from='client.247086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:50 smithi191 bash[24992]: cluster 2024-08-31T06:30:49.672152+0000 mgr.a (mgr.14388) 11226 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:50 smithi163 bash[24253]: cluster 2024-08-31T06:30:49.672152+0000 mgr.a (mgr.14388) 11226 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:50 smithi027 bash[22610]: cluster 2024-08-31T06:30:49.672152+0000 mgr.a (mgr.14388) 11226 : cluster [DBG] pgmap v7781: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:52 smithi191 bash[24992]: cluster 2024-08-31T06:30:51.672950+0000 mgr.a (mgr.14388) 11227 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:52 smithi163 bash[24253]: cluster 2024-08-31T06:30:51.672950+0000 mgr.a (mgr.14388) 11227 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:52 smithi027 bash[22610]: cluster 2024-08-31T06:30:51.672950+0000 mgr.a (mgr.14388) 11227 : cluster [DBG] pgmap v7782: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:30:54.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:30:54.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:30:54.389 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:30:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:54 smithi191 bash[24992]: cluster 2024-08-31T06:30:53.674931+0000 mgr.a (mgr.14388) 11228 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:55.154 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:30:55.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:30:55.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:30:55.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:30:55.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:30:55.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:54 smithi163 bash[24253]: cluster 2024-08-31T06:30:53.674931+0000 mgr.a (mgr.14388) 11228 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:54 smithi027 bash[22610]: cluster 2024-08-31T06:30:53.674931+0000 mgr.a (mgr.14388) 11228 : cluster [DBG] pgmap v7783: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:55 smithi191 bash[24992]: audit 2024-08-31T06:30:54.724074+0000 mgr.a (mgr.14388) 11229 : audit [DBG] from='client.247164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:56.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:55 smithi163 bash[24253]: audit 2024-08-31T06:30:54.724074+0000 mgr.a (mgr.14388) 11229 : audit [DBG] from='client.247164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:55 smithi027 bash[22610]: audit 2024-08-31T06:30:54.724074+0000 mgr.a (mgr.14388) 11229 : audit [DBG] from='client.247164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:30:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:56 smithi191 bash[24992]: cluster 2024-08-31T06:30:55.675866+0000 mgr.a (mgr.14388) 11230 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:56 smithi163 bash[24253]: cluster 2024-08-31T06:30:55.675866+0000 mgr.a (mgr.14388) 11230 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:56 smithi027 bash[22610]: cluster 2024-08-31T06:30:55.675866+0000 mgr.a (mgr.14388) 11230 : cluster [DBG] pgmap v7784: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:30:58 smithi191 bash[24992]: cluster 2024-08-31T06:30:57.676679+0000 mgr.a (mgr.14388) 11231 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:59.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:30:58 smithi163 bash[24253]: cluster 2024-08-31T06:30:57.676679+0000 mgr.a (mgr.14388) 11231 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:30:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:30:58 smithi027 bash[22610]: cluster 2024-08-31T06:30:57.676679+0000 mgr.a (mgr.14388) 11231 : cluster [DBG] pgmap v7785: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:00.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:00.156 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:00.156 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:00.929 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:00.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:00.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:00.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:00.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:00 smithi191 bash[24992]: cluster 2024-08-31T06:30:59.678917+0000 mgr.a (mgr.14388) 11232 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:01.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:00 smithi163 bash[24253]: cluster 2024-08-31T06:30:59.678917+0000 mgr.a (mgr.14388) 11232 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:00 smithi027 bash[22610]: cluster 2024-08-31T06:30:59.678917+0000 mgr.a (mgr.14388) 11232 : cluster [DBG] pgmap v7786: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:01 smithi163 bash[24253]: audit 2024-08-31T06:31:00.489205+0000 mgr.a (mgr.14388) 11233 : audit [DBG] from='client.247242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:01 smithi027 bash[22610]: audit 2024-08-31T06:31:00.489205+0000 mgr.a (mgr.14388) 11233 : audit [DBG] from='client.247242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:01 smithi191 bash[24992]: audit 2024-08-31T06:31:00.489205+0000 mgr.a (mgr.14388) 11233 : audit [DBG] from='client.247242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:02 smithi163 bash[24253]: cluster 2024-08-31T06:31:01.680062+0000 mgr.a (mgr.14388) 11234 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:03.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:02 smithi027 bash[22610]: cluster 2024-08-31T06:31:01.680062+0000 mgr.a (mgr.14388) 11234 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:02 smithi191 bash[24992]: cluster 2024-08-31T06:31:01.680062+0000 mgr.a (mgr.14388) 11234 : cluster [DBG] pgmap v7787: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:04 smithi163 bash[24253]: cluster 2024-08-31T06:31:03.682316+0000 mgr.a (mgr.14388) 11235 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:04 smithi027 bash[22610]: cluster 2024-08-31T06:31:03.682316+0000 mgr.a (mgr.14388) 11235 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:04 smithi191 bash[24992]: cluster 2024-08-31T06:31:03.682316+0000 mgr.a (mgr.14388) 11235 : cluster [DBG] pgmap v7788: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:05.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:05.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:05.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:06.714 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:06.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:06 smithi163 bash[24253]: cluster 2024-08-31T06:31:05.683228+0000 mgr.a (mgr.14388) 11236 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:07.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:06 smithi163 bash[24253]: audit 2024-08-31T06:31:06.266693+0000 mgr.a (mgr.14388) 11237 : audit [DBG] from='client.247317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:06 smithi027 bash[22610]: cluster 2024-08-31T06:31:05.683228+0000 mgr.a (mgr.14388) 11236 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:06 smithi027 bash[22610]: audit 2024-08-31T06:31:06.266693+0000 mgr.a (mgr.14388) 11237 : audit [DBG] from='client.247317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:06 smithi191 bash[24992]: cluster 2024-08-31T06:31:05.683228+0000 mgr.a (mgr.14388) 11236 : cluster [DBG] pgmap v7789: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:06 smithi191 bash[24992]: audit 2024-08-31T06:31:06.266693+0000 mgr.a (mgr.14388) 11237 : audit [DBG] from='client.247317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:09.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:08 smithi163 bash[24253]: cluster 2024-08-31T06:31:07.684236+0000 mgr.a (mgr.14388) 11238 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:08 smithi027 bash[22610]: cluster 2024-08-31T06:31:07.684236+0000 mgr.a (mgr.14388) 11238 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:08 smithi191 bash[24992]: cluster 2024-08-31T06:31:07.684236+0000 mgr.a (mgr.14388) 11238 : cluster [DBG] pgmap v7790: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:11.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:10 smithi163 bash[24253]: cluster 2024-08-31T06:31:09.686492+0000 mgr.a (mgr.14388) 11239 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:10 smithi027 bash[22610]: cluster 2024-08-31T06:31:09.686492+0000 mgr.a (mgr.14388) 11239 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:10 smithi191 bash[24992]: cluster 2024-08-31T06:31:09.686492+0000 mgr.a (mgr.14388) 11239 : cluster [DBG] pgmap v7791: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:11.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:11.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:12.460 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:12.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:12.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:12.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:12.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:12 smithi163 bash[24253]: cluster 2024-08-31T06:31:11.687308+0000 mgr.a (mgr.14388) 11240 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:13.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:12 smithi163 bash[24253]: audit 2024-08-31T06:31:12.045945+0000 mgr.a (mgr.14388) 11241 : audit [DBG] from='client.247395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:12 smithi027 bash[22610]: cluster 2024-08-31T06:31:11.687308+0000 mgr.a (mgr.14388) 11240 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:12 smithi027 bash[22610]: audit 2024-08-31T06:31:12.045945+0000 mgr.a (mgr.14388) 11241 : audit [DBG] from='client.247395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:12 smithi191 bash[24992]: cluster 2024-08-31T06:31:11.687308+0000 mgr.a (mgr.14388) 11240 : cluster [DBG] pgmap v7792: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:12 smithi191 bash[24992]: audit 2024-08-31T06:31:12.045945+0000 mgr.a (mgr.14388) 11241 : audit [DBG] from='client.247395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:14 smithi163 bash[24253]: cluster 2024-08-31T06:31:13.689775+0000 mgr.a (mgr.14388) 11242 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:14 smithi027 bash[22610]: cluster 2024-08-31T06:31:13.689775+0000 mgr.a (mgr.14388) 11242 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:14 smithi191 bash[24992]: cluster 2024-08-31T06:31:13.689775+0000 mgr.a (mgr.14388) 11242 : cluster [DBG] pgmap v7793: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:17.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:16 smithi163 bash[24253]: cluster 2024-08-31T06:31:15.690767+0000 mgr.a (mgr.14388) 11243 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:16 smithi027 bash[22610]: cluster 2024-08-31T06:31:15.690767+0000 mgr.a (mgr.14388) 11243 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:16 smithi191 bash[24992]: cluster 2024-08-31T06:31:15.690767+0000 mgr.a (mgr.14388) 11243 : cluster [DBG] pgmap v7794: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:17.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:17.462 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:17.462 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:18.202 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:18.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:18.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:18.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:18.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:18 smithi163 bash[24253]: cluster 2024-08-31T06:31:17.691548+0000 mgr.a (mgr.14388) 11244 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:18 smithi163 bash[24253]: audit 2024-08-31T06:31:17.797162+0000 mgr.a (mgr.14388) 11245 : audit [DBG] from='client.247473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:18 smithi027 bash[22610]: cluster 2024-08-31T06:31:17.691548+0000 mgr.a (mgr.14388) 11244 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:18 smithi027 bash[22610]: audit 2024-08-31T06:31:17.797162+0000 mgr.a (mgr.14388) 11245 : audit [DBG] from='client.247473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:18 smithi191 bash[24992]: cluster 2024-08-31T06:31:17.691548+0000 mgr.a (mgr.14388) 11244 : cluster [DBG] pgmap v7795: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:18 smithi191 bash[24992]: audit 2024-08-31T06:31:17.797162+0000 mgr.a (mgr.14388) 11245 : audit [DBG] from='client.247473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:20 smithi163 bash[24253]: cluster 2024-08-31T06:31:19.694311+0000 mgr.a (mgr.14388) 11246 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:20 smithi027 bash[22610]: cluster 2024-08-31T06:31:19.694311+0000 mgr.a (mgr.14388) 11246 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:20 smithi191 bash[24992]: cluster 2024-08-31T06:31:19.694311+0000 mgr.a (mgr.14388) 11246 : cluster [DBG] pgmap v7796: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:23.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:22 smithi163 bash[24253]: cluster 2024-08-31T06:31:21.695154+0000 mgr.a (mgr.14388) 11247 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:31:23.203 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:23.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:23.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:22 smithi027 bash[22610]: cluster 2024-08-31T06:31:21.695154+0000 mgr.a (mgr.14388) 11247 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:31:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:22 smithi191 bash[24992]: cluster 2024-08-31T06:31:21.695154+0000 mgr.a (mgr.14388) 11247 : cluster [DBG] pgmap v7797: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:31:23.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:23.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:23.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:23.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:23.950 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:25.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:24 smithi163 bash[24253]: audit 2024-08-31T06:31:23.538166+0000 mgr.a (mgr.14388) 11248 : audit [DBG] from='client.247545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:25.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:24 smithi163 bash[24253]: cluster 2024-08-31T06:31:23.696461+0000 mgr.a (mgr.14388) 11249 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:24 smithi027 bash[22610]: audit 2024-08-31T06:31:23.538166+0000 mgr.a (mgr.14388) 11248 : audit [DBG] from='client.247545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:24 smithi027 bash[22610]: cluster 2024-08-31T06:31:23.696461+0000 mgr.a (mgr.14388) 11249 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:24 smithi191 bash[24992]: audit 2024-08-31T06:31:23.538166+0000 mgr.a (mgr.14388) 11248 : audit [DBG] from='client.247545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:24 smithi191 bash[24992]: cluster 2024-08-31T06:31:23.696461+0000 mgr.a (mgr.14388) 11249 : cluster [DBG] pgmap v7798: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:26 smithi163 bash[24253]: cluster 2024-08-31T06:31:25.697329+0000 mgr.a (mgr.14388) 11250 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:31:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:26 smithi027 bash[22610]: cluster 2024-08-31T06:31:25.697329+0000 mgr.a (mgr.14388) 11250 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:31:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:26 smithi191 bash[24992]: cluster 2024-08-31T06:31:25.697329+0000 mgr.a (mgr.14388) 11250 : cluster [DBG] pgmap v7799: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:31:28.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:27 smithi163 bash[24253]: audit 2024-08-31T06:31:27.240906+0000 mon.a (mon.0) 2261 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:31:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:27 smithi027 bash[22610]: audit 2024-08-31T06:31:27.240906+0000 mon.a (mon.0) 2261 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:31:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:27 smithi191 bash[24992]: audit 2024-08-31T06:31:27.240906+0000 mon.a (mon.0) 2261 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:31:28.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:28.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:28.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:28 smithi163 bash[24253]: cluster 2024-08-31T06:31:27.698086+0000 mgr.a (mgr.14388) 11251 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:31:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:28 smithi163 bash[24253]: audit 2024-08-31T06:31:28.114113+0000 mon.a (mon.0) 2262 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:31:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:28 smithi163 bash[24253]: audit 2024-08-31T06:31:28.115470+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:31:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:28 smithi163 bash[24253]: audit 2024-08-31T06:31:28.125860+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:31:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:28 smithi163 bash[24253]: audit 2024-08-31T06:31:28.130085+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:31:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:28 smithi163 bash[24253]: audit 2024-08-31T06:31:28.132527+0000 mgr.a (mgr.14388) 11252 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:31:29.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:31:28 smithi027 bash[22863]: debug 2024-08-31T06:31:28.866+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:31:29.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:31:28 smithi027 bash[22863]: debug 2024-08-31T06:31:28.866+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:31:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:28 smithi027 bash[22610]: cluster 2024-08-31T06:31:27.698086+0000 mgr.a (mgr.14388) 11251 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:31:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:28 smithi027 bash[22610]: audit 2024-08-31T06:31:28.114113+0000 mon.a (mon.0) 2262 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:31:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:28 smithi027 bash[22610]: audit 2024-08-31T06:31:28.115470+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:31:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:28 smithi027 bash[22610]: audit 2024-08-31T06:31:28.125860+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:31:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:28 smithi027 bash[22610]: audit 2024-08-31T06:31:28.130085+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:31:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:28 smithi027 bash[22610]: audit 2024-08-31T06:31:28.132527+0000 mgr.a (mgr.14388) 11252 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:31:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:28 smithi191 bash[24992]: cluster 2024-08-31T06:31:27.698086+0000 mgr.a (mgr.14388) 11251 : cluster [DBG] pgmap v7800: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:31:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:28 smithi191 bash[24992]: audit 2024-08-31T06:31:28.114113+0000 mon.a (mon.0) 2262 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:31:29.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:28 smithi191 bash[24992]: audit 2024-08-31T06:31:28.115470+0000 mon.a (mon.0) 2263 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:31:29.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:28 smithi191 bash[24992]: audit 2024-08-31T06:31:28.125860+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:31:29.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:28 smithi191 bash[24992]: audit 2024-08-31T06:31:28.130085+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:31:29.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:28 smithi191 bash[24992]: audit 2024-08-31T06:31:28.132527+0000 mgr.a (mgr.14388) 11252 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:31:29.713 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:29.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:29.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:29.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:29.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:29 smithi163 bash[24253]: audit 2024-08-31T06:31:28.867440+0000 mgr.a (mgr.14388) 11253 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:31:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:29 smithi163 bash[24253]: cephadm 2024-08-31T06:31:28.868813+0000 mgr.a (mgr.14388) 11254 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:31:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:29 smithi163 bash[24253]: audit 2024-08-31T06:31:29.277231+0000 mgr.a (mgr.14388) 11255 : audit [DBG] from='client.247731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:29 smithi027 bash[22610]: audit 2024-08-31T06:31:28.867440+0000 mgr.a (mgr.14388) 11253 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:31:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:29 smithi027 bash[22610]: cephadm 2024-08-31T06:31:28.868813+0000 mgr.a (mgr.14388) 11254 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:31:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:29 smithi027 bash[22610]: audit 2024-08-31T06:31:29.277231+0000 mgr.a (mgr.14388) 11255 : audit [DBG] from='client.247731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:29 smithi191 bash[24992]: audit 2024-08-31T06:31:28.867440+0000 mgr.a (mgr.14388) 11253 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:31:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:29 smithi191 bash[24992]: cephadm 2024-08-31T06:31:28.868813+0000 mgr.a (mgr.14388) 11254 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:31:30.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:29 smithi191 bash[24992]: audit 2024-08-31T06:31:29.277231+0000 mgr.a (mgr.14388) 11255 : audit [DBG] from='client.247731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:30 smithi163 bash[24253]: cluster 2024-08-31T06:31:29.699330+0000 mgr.a (mgr.14388) 11256 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:30 smithi027 bash[22610]: cluster 2024-08-31T06:31:29.699330+0000 mgr.a (mgr.14388) 11256 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:30 smithi191 bash[24992]: cluster 2024-08-31T06:31:29.699330+0000 mgr.a (mgr.14388) 11256 : cluster [DBG] pgmap v7801: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:32 smithi163 bash[24253]: cluster 2024-08-31T06:31:31.700094+0000 mgr.a (mgr.14388) 11257 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:32 smithi027 bash[22610]: cluster 2024-08-31T06:31:31.700094+0000 mgr.a (mgr.14388) 11257 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:32 smithi191 bash[24992]: cluster 2024-08-31T06:31:31.700094+0000 mgr.a (mgr.14388) 11257 : cluster [DBG] pgmap v7802: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:34.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:34.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:34.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:34 smithi163 bash[24253]: cluster 2024-08-31T06:31:33.702126+0000 mgr.a (mgr.14388) 11258 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:34 smithi027 bash[22610]: cluster 2024-08-31T06:31:33.702126+0000 mgr.a (mgr.14388) 11258 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:34 smithi191 bash[24992]: cluster 2024-08-31T06:31:33.702126+0000 mgr.a (mgr.14388) 11258 : cluster [DBG] pgmap v7803: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:35.462 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:35.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:35.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:35.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:35.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:35 smithi163 bash[24253]: audit 2024-08-31T06:31:35.046302+0000 mgr.a (mgr.14388) 11259 : audit [DBG] from='client.247803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:35 smithi027 bash[22610]: audit 2024-08-31T06:31:35.046302+0000 mgr.a (mgr.14388) 11259 : audit [DBG] from='client.247803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:35 smithi191 bash[24992]: audit 2024-08-31T06:31:35.046302+0000 mgr.a (mgr.14388) 11259 : audit [DBG] from='client.247803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:36 smithi163 bash[24253]: cluster 2024-08-31T06:31:35.703113+0000 mgr.a (mgr.14388) 11260 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:36 smithi027 bash[22610]: cluster 2024-08-31T06:31:35.703113+0000 mgr.a (mgr.14388) 11260 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:36 smithi191 bash[24992]: cluster 2024-08-31T06:31:35.703113+0000 mgr.a (mgr.14388) 11260 : cluster [DBG] pgmap v7804: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:38 smithi163 bash[24253]: cluster 2024-08-31T06:31:37.703864+0000 mgr.a (mgr.14388) 11261 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:38 smithi027 bash[22610]: cluster 2024-08-31T06:31:37.703864+0000 mgr.a (mgr.14388) 11261 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:38 smithi191 bash[24992]: cluster 2024-08-31T06:31:37.703864+0000 mgr.a (mgr.14388) 11261 : cluster [DBG] pgmap v7805: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:40.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:40.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:40.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:40 smithi163 bash[24253]: cluster 2024-08-31T06:31:39.706098+0000 mgr.a (mgr.14388) 11262 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:40 smithi027 bash[22610]: cluster 2024-08-31T06:31:39.706098+0000 mgr.a (mgr.14388) 11262 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:41.244 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:40 smithi191 bash[24992]: cluster 2024-08-31T06:31:39.706098+0000 mgr.a (mgr.14388) 11262 : cluster [DBG] pgmap v7806: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:41 smithi163 bash[24253]: audit 2024-08-31T06:31:40.801023+0000 mgr.a (mgr.14388) 11263 : audit [DBG] from='client.247878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:41 smithi027 bash[22610]: audit 2024-08-31T06:31:40.801023+0000 mgr.a (mgr.14388) 11263 : audit [DBG] from='client.247878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:41 smithi191 bash[24992]: audit 2024-08-31T06:31:40.801023+0000 mgr.a (mgr.14388) 11263 : audit [DBG] from='client.247878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:42 smithi163 bash[24253]: cluster 2024-08-31T06:31:41.707112+0000 mgr.a (mgr.14388) 11264 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:42 smithi027 bash[22610]: cluster 2024-08-31T06:31:41.707112+0000 mgr.a (mgr.14388) 11264 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:42 smithi191 bash[24992]: cluster 2024-08-31T06:31:41.707112+0000 mgr.a (mgr.14388) 11264 : cluster [DBG] pgmap v7807: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:45.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:44 smithi163 bash[24253]: cluster 2024-08-31T06:31:43.709313+0000 mgr.a (mgr.14388) 11265 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:44 smithi027 bash[22610]: cluster 2024-08-31T06:31:43.709313+0000 mgr.a (mgr.14388) 11265 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:44 smithi191 bash[24992]: cluster 2024-08-31T06:31:43.709313+0000 mgr.a (mgr.14388) 11265 : cluster [DBG] pgmap v7808: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:31:46.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:46.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:46.247 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:46.989 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:46.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:46.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:46.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:46.990 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:46 smithi163 bash[24253]: cluster 2024-08-31T06:31:45.710098+0000 mgr.a (mgr.14388) 11266 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:46 smithi027 bash[22610]: cluster 2024-08-31T06:31:45.710098+0000 mgr.a (mgr.14388) 11266 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:46 smithi191 bash[24992]: cluster 2024-08-31T06:31:45.710098+0000 mgr.a (mgr.14388) 11266 : cluster [DBG] pgmap v7809: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:47 smithi163 bash[24253]: audit 2024-08-31T06:31:46.573433+0000 mgr.a (mgr.14388) 11267 : audit [DBG] from='client.247953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:47 smithi027 bash[22610]: audit 2024-08-31T06:31:46.573433+0000 mgr.a (mgr.14388) 11267 : audit [DBG] from='client.247953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:47 smithi191 bash[24992]: audit 2024-08-31T06:31:46.573433+0000 mgr.a (mgr.14388) 11267 : audit [DBG] from='client.247953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:48 smithi163 bash[24253]: cluster 2024-08-31T06:31:47.711101+0000 mgr.a (mgr.14388) 11268 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:48 smithi027 bash[22610]: cluster 2024-08-31T06:31:47.711101+0000 mgr.a (mgr.14388) 11268 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:48 smithi191 bash[24992]: cluster 2024-08-31T06:31:47.711101+0000 mgr.a (mgr.14388) 11268 : cluster [DBG] pgmap v7810: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:51.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:50 smithi163 bash[24253]: cluster 2024-08-31T06:31:49.713325+0000 mgr.a (mgr.14388) 11269 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:50 smithi027 bash[22610]: cluster 2024-08-31T06:31:49.713325+0000 mgr.a (mgr.14388) 11269 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:50 smithi191 bash[24992]: cluster 2024-08-31T06:31:49.713325+0000 mgr.a (mgr.14388) 11269 : cluster [DBG] pgmap v7811: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:51.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:51.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:51.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:52.724 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:52.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:52.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:52.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:52.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:52 smithi163 bash[24253]: cluster 2024-08-31T06:31:51.714107+0000 mgr.a (mgr.14388) 11270 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:52 smithi027 bash[22610]: cluster 2024-08-31T06:31:51.714107+0000 mgr.a (mgr.14388) 11270 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:52 smithi191 bash[24992]: cluster 2024-08-31T06:31:51.714107+0000 mgr.a (mgr.14388) 11270 : cluster [DBG] pgmap v7812: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:53 smithi163 bash[24253]: audit 2024-08-31T06:31:52.311933+0000 mgr.a (mgr.14388) 11271 : audit [DBG] from='client.248028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:53 smithi027 bash[22610]: audit 2024-08-31T06:31:52.311933+0000 mgr.a (mgr.14388) 11271 : audit [DBG] from='client.248028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:53 smithi191 bash[24992]: audit 2024-08-31T06:31:52.311933+0000 mgr.a (mgr.14388) 11271 : audit [DBG] from='client.248028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:54 smithi163 bash[24253]: cluster 2024-08-31T06:31:53.716509+0000 mgr.a (mgr.14388) 11272 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:54 smithi027 bash[22610]: cluster 2024-08-31T06:31:53.716509+0000 mgr.a (mgr.14388) 11272 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:54 smithi191 bash[24992]: cluster 2024-08-31T06:31:53.716509+0000 mgr.a (mgr.14388) 11272 : cluster [DBG] pgmap v7813: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:31:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:56 smithi163 bash[24253]: cluster 2024-08-31T06:31:55.717289+0000 mgr.a (mgr.14388) 11273 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:56 smithi027 bash[22610]: cluster 2024-08-31T06:31:55.717289+0000 mgr.a (mgr.14388) 11273 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:56 smithi191 bash[24992]: cluster 2024-08-31T06:31:55.717289+0000 mgr.a (mgr.14388) 11273 : cluster [DBG] pgmap v7814: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:57.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:31:57.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:31:57.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:31:58.464 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:31:58.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:31:58.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:31:58.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:31:58.465 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:31:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:58 smithi027 bash[22610]: cluster 2024-08-31T06:31:57.718070+0000 mgr.a (mgr.14388) 11274 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:31:58 smithi027 bash[22610]: audit 2024-08-31T06:31:58.058292+0000 mgr.a (mgr.14388) 11275 : audit [DBG] from='client.248103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:58 smithi191 bash[24992]: cluster 2024-08-31T06:31:57.718070+0000 mgr.a (mgr.14388) 11274 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:59.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:31:58 smithi191 bash[24992]: audit 2024-08-31T06:31:58.058292+0000 mgr.a (mgr.14388) 11275 : audit [DBG] from='client.248103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:31:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:58 smithi163 bash[24253]: cluster 2024-08-31T06:31:57.718070+0000 mgr.a (mgr.14388) 11274 : cluster [DBG] pgmap v7815: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:31:59.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:31:58 smithi163 bash[24253]: audit 2024-08-31T06:31:58.058292+0000 mgr.a (mgr.14388) 11275 : audit [DBG] from='client.248103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:00 smithi027 bash[22610]: cluster 2024-08-31T06:31:59.720810+0000 mgr.a (mgr.14388) 11276 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:00 smithi191 bash[24992]: cluster 2024-08-31T06:31:59.720810+0000 mgr.a (mgr.14388) 11276 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:00 smithi163 bash[24253]: cluster 2024-08-31T06:31:59.720810+0000 mgr.a (mgr.14388) 11276 : cluster [DBG] pgmap v7816: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:03.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:02 smithi027 bash[22610]: cluster 2024-08-31T06:32:01.721619+0000 mgr.a (mgr.14388) 11277 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:32:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:02 smithi191 bash[24992]: cluster 2024-08-31T06:32:01.721619+0000 mgr.a (mgr.14388) 11277 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:32:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:02 smithi163 bash[24253]: cluster 2024-08-31T06:32:01.721619+0000 mgr.a (mgr.14388) 11277 : cluster [DBG] pgmap v7817: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:32:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:32:03.466 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:32:03.467 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:32:04.205 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:32:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:32:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:32:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:32:04.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:32:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:04 smithi027 bash[22610]: cluster 2024-08-31T06:32:03.723598+0000 mgr.a (mgr.14388) 11278 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:04 smithi027 bash[22610]: audit 2024-08-31T06:32:03.797721+0000 mgr.a (mgr.14388) 11279 : audit [DBG] from='client.248181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:04 smithi191 bash[24992]: cluster 2024-08-31T06:32:03.723598+0000 mgr.a (mgr.14388) 11278 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:04 smithi191 bash[24992]: audit 2024-08-31T06:32:03.797721+0000 mgr.a (mgr.14388) 11279 : audit [DBG] from='client.248181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:04 smithi163 bash[24253]: cluster 2024-08-31T06:32:03.723598+0000 mgr.a (mgr.14388) 11278 : cluster [DBG] pgmap v7818: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:04 smithi163 bash[24253]: audit 2024-08-31T06:32:03.797721+0000 mgr.a (mgr.14388) 11279 : audit [DBG] from='client.248181 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:06 smithi027 bash[22610]: cluster 2024-08-31T06:32:05.724463+0000 mgr.a (mgr.14388) 11280 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:32:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:06 smithi191 bash[24992]: cluster 2024-08-31T06:32:05.724463+0000 mgr.a (mgr.14388) 11280 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:32:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:06 smithi163 bash[24253]: cluster 2024-08-31T06:32:05.724463+0000 mgr.a (mgr.14388) 11280 : cluster [DBG] pgmap v7819: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:32:09.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:32:09.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:32:09.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:32:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:08 smithi027 bash[22610]: cluster 2024-08-31T06:32:07.725239+0000 mgr.a (mgr.14388) 11281 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:32:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:08 smithi191 bash[24992]: cluster 2024-08-31T06:32:07.725239+0000 mgr.a (mgr.14388) 11281 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:32:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:08 smithi163 bash[24253]: cluster 2024-08-31T06:32:07.725239+0000 mgr.a (mgr.14388) 11281 : cluster [DBG] pgmap v7820: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:32:09.989 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:32:09.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:32:09.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:32:09.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:32:09.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:32:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:10 smithi191 bash[24992]: audit 2024-08-31T06:32:09.549523+0000 mgr.a (mgr.14388) 11282 : audit [DBG] from='client.248259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:10 smithi191 bash[24992]: cluster 2024-08-31T06:32:09.726550+0000 mgr.a (mgr.14388) 11283 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:10 smithi163 bash[24253]: audit 2024-08-31T06:32:09.549523+0000 mgr.a (mgr.14388) 11282 : audit [DBG] from='client.248259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:10 smithi163 bash[24253]: cluster 2024-08-31T06:32:09.726550+0000 mgr.a (mgr.14388) 11283 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:10 smithi027 bash[22610]: audit 2024-08-31T06:32:09.549523+0000 mgr.a (mgr.14388) 11282 : audit [DBG] from='client.248259 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:10 smithi027 bash[22610]: cluster 2024-08-31T06:32:09.726550+0000 mgr.a (mgr.14388) 11283 : cluster [DBG] pgmap v7821: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:12 smithi191 bash[24992]: cluster 2024-08-31T06:32:11.727444+0000 mgr.a (mgr.14388) 11284 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:12 smithi163 bash[24253]: cluster 2024-08-31T06:32:11.727444+0000 mgr.a (mgr.14388) 11284 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:12 smithi027 bash[22610]: cluster 2024-08-31T06:32:11.727444+0000 mgr.a (mgr.14388) 11284 : cluster [DBG] pgmap v7822: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:14.990 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:32:14.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:32:14.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:32:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:14 smithi191 bash[24992]: cluster 2024-08-31T06:32:13.729640+0000 mgr.a (mgr.14388) 11285 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:32:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:14 smithi163 bash[24253]: cluster 2024-08-31T06:32:13.729640+0000 mgr.a (mgr.14388) 11285 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:32:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:14 smithi027 bash[22610]: cluster 2024-08-31T06:32:13.729640+0000 mgr.a (mgr.14388) 11285 : cluster [DBG] pgmap v7823: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:32:15.745 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:32:15.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:32:15.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:32:15.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:32:15.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:32:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:17 smithi191 bash[24992]: audit 2024-08-31T06:32:15.321819+0000 mgr.a (mgr.14388) 11286 : audit [DBG] from='client.248334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:17 smithi191 bash[24992]: cluster 2024-08-31T06:32:15.730145+0000 mgr.a (mgr.14388) 11287 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:17 smithi163 bash[24253]: audit 2024-08-31T06:32:15.321819+0000 mgr.a (mgr.14388) 11286 : audit [DBG] from='client.248334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:17 smithi163 bash[24253]: cluster 2024-08-31T06:32:15.730145+0000 mgr.a (mgr.14388) 11287 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:16 smithi027 bash[22610]: audit 2024-08-31T06:32:15.321819+0000 mgr.a (mgr.14388) 11286 : audit [DBG] from='client.248334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:16 smithi027 bash[22610]: cluster 2024-08-31T06:32:15.730145+0000 mgr.a (mgr.14388) 11287 : cluster [DBG] pgmap v7824: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:19 smithi191 bash[24992]: cluster 2024-08-31T06:32:17.730854+0000 mgr.a (mgr.14388) 11288 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:19.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:19 smithi163 bash[24253]: cluster 2024-08-31T06:32:17.730854+0000 mgr.a (mgr.14388) 11288 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:19 smithi027 bash[22610]: cluster 2024-08-31T06:32:17.730854+0000 mgr.a (mgr.14388) 11288 : cluster [DBG] pgmap v7825: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:20.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:32:20.747 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:32:20.747 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:32:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:21 smithi191 bash[24992]: cluster 2024-08-31T06:32:19.733101+0000 mgr.a (mgr.14388) 11289 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:32:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:21 smithi163 bash[24253]: cluster 2024-08-31T06:32:19.733101+0000 mgr.a (mgr.14388) 11289 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:32:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:21 smithi027 bash[22610]: cluster 2024-08-31T06:32:19.733101+0000 mgr.a (mgr.14388) 11289 : cluster [DBG] pgmap v7826: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:32:21.515 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:32:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:32:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:32:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:32:21.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:32:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:22 smithi191 bash[24992]: audit 2024-08-31T06:32:21.083337+0000 mgr.a (mgr.14388) 11290 : audit [DBG] from='client.248409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:22 smithi163 bash[24253]: audit 2024-08-31T06:32:21.083337+0000 mgr.a (mgr.14388) 11290 : audit [DBG] from='client.248409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:22 smithi027 bash[22610]: audit 2024-08-31T06:32:21.083337+0000 mgr.a (mgr.14388) 11290 : audit [DBG] from='client.248409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:23 smithi191 bash[24992]: cluster 2024-08-31T06:32:21.734073+0000 mgr.a (mgr.14388) 11291 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:23 smithi163 bash[24253]: cluster 2024-08-31T06:32:21.734073+0000 mgr.a (mgr.14388) 11291 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:23 smithi027 bash[22610]: cluster 2024-08-31T06:32:21.734073+0000 mgr.a (mgr.14388) 11291 : cluster [DBG] pgmap v7827: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:25 smithi191 bash[24992]: cluster 2024-08-31T06:32:23.736336+0000 mgr.a (mgr.14388) 11292 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:32:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:25 smithi163 bash[24253]: cluster 2024-08-31T06:32:23.736336+0000 mgr.a (mgr.14388) 11292 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:32:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:25 smithi027 bash[22610]: cluster 2024-08-31T06:32:23.736336+0000 mgr.a (mgr.14388) 11292 : cluster [DBG] pgmap v7828: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:32:26.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:32:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:32:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:32:27.269 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:32:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:32:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:32:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:32:27.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:32:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:27 smithi191 bash[24992]: cluster 2024-08-31T06:32:25.737094+0000 mgr.a (mgr.14388) 11293 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:32:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:27 smithi163 bash[24253]: cluster 2024-08-31T06:32:25.737094+0000 mgr.a (mgr.14388) 11293 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:32:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:27 smithi027 bash[22610]: cluster 2024-08-31T06:32:25.737094+0000 mgr.a (mgr.14388) 11293 : cluster [DBG] pgmap v7829: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:32:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:28 smithi191 bash[24992]: audit 2024-08-31T06:32:26.848389+0000 mgr.a (mgr.14388) 11294 : audit [DBG] from='client.248487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:28.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:28 smithi163 bash[24253]: audit 2024-08-31T06:32:26.848389+0000 mgr.a (mgr.14388) 11294 : audit [DBG] from='client.248487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:28 smithi027 bash[22610]: audit 2024-08-31T06:32:26.848389+0000 mgr.a (mgr.14388) 11294 : audit [DBG] from='client.248487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:29 smithi163 bash[24253]: cluster 2024-08-31T06:32:27.738297+0000 mgr.a (mgr.14388) 11295 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:32:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:29 smithi163 bash[24253]: audit 2024-08-31T06:32:28.922112+0000 mon.a (mon.0) 2266 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:32:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:29 smithi027 bash[22610]: cluster 2024-08-31T06:32:27.738297+0000 mgr.a (mgr.14388) 11295 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:32:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:29 smithi027 bash[22610]: audit 2024-08-31T06:32:28.922112+0000 mon.a (mon.0) 2266 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:32:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:29 smithi191 bash[24992]: cluster 2024-08-31T06:32:27.738297+0000 mgr.a (mgr.14388) 11295 : cluster [DBG] pgmap v7830: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:32:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:29 smithi191 bash[24992]: audit 2024-08-31T06:32:28.922112+0000 mon.a (mon.0) 2266 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:32:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:30 smithi163 bash[24253]: audit 2024-08-31T06:32:29.742434+0000 mon.a (mon.0) 2267 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:32:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:30 smithi163 bash[24253]: audit 2024-08-31T06:32:29.743753+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:32:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:30 smithi163 bash[24253]: audit 2024-08-31T06:32:29.752887+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:32:30.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:30 smithi163 bash[24253]: audit 2024-08-31T06:32:29.755925+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:32:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:30 smithi027 bash[22610]: audit 2024-08-31T06:32:29.742434+0000 mon.a (mon.0) 2267 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:32:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:30 smithi027 bash[22610]: audit 2024-08-31T06:32:29.743753+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:32:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:30 smithi027 bash[22610]: audit 2024-08-31T06:32:29.752887+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:32:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:30 smithi027 bash[22610]: audit 2024-08-31T06:32:29.755925+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:32:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:30 smithi191 bash[24992]: audit 2024-08-31T06:32:29.742434+0000 mon.a (mon.0) 2267 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:32:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:30 smithi191 bash[24992]: audit 2024-08-31T06:32:29.743753+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:32:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:30 smithi191 bash[24992]: audit 2024-08-31T06:32:29.752887+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:32:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:30 smithi191 bash[24992]: audit 2024-08-31T06:32:29.755925+0000 mon.a (mon.0) 2270 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:32:30.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:32:30 smithi027 bash[22863]: debug 2024-08-31T06:32:30.492+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:32:30.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:32:30 smithi027 bash[22863]: debug 2024-08-31T06:32:30.496+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:32:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:31 smithi163 bash[24253]: cluster 2024-08-31T06:32:29.740666+0000 mgr.a (mgr.14388) 11296 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:32:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:31 smithi163 bash[24253]: audit 2024-08-31T06:32:29.758208+0000 mgr.a (mgr.14388) 11297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:32:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:31 smithi027 bash[22610]: cluster 2024-08-31T06:32:29.740666+0000 mgr.a (mgr.14388) 11296 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:32:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:31 smithi027 bash[22610]: audit 2024-08-31T06:32:29.758208+0000 mgr.a (mgr.14388) 11297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:32:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:31 smithi191 bash[24992]: cluster 2024-08-31T06:32:29.740666+0000 mgr.a (mgr.14388) 11296 : cluster [DBG] pgmap v7831: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:32:31.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:31 smithi191 bash[24992]: audit 2024-08-31T06:32:29.758208+0000 mgr.a (mgr.14388) 11297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:32:32.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:32:32.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:32:32.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:32:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:32 smithi163 bash[24253]: audit 2024-08-31T06:32:30.497414+0000 mgr.a (mgr.14388) 11298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:32:32.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:32 smithi163 bash[24253]: cephadm 2024-08-31T06:32:30.498777+0000 mgr.a (mgr.14388) 11299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:32:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:32 smithi027 bash[22610]: audit 2024-08-31T06:32:30.497414+0000 mgr.a (mgr.14388) 11298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:32:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:32 smithi027 bash[22610]: cephadm 2024-08-31T06:32:30.498777+0000 mgr.a (mgr.14388) 11299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:32:32.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:32 smithi191 bash[24992]: audit 2024-08-31T06:32:30.497414+0000 mgr.a (mgr.14388) 11298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:32:32.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:32 smithi191 bash[24992]: cephadm 2024-08-31T06:32:30.498777+0000 mgr.a (mgr.14388) 11299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:32:33.023 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:32:33.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:32:33.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:32:33.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:32:33.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:32:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:33 smithi163 bash[24253]: cluster 2024-08-31T06:32:31.741550+0000 mgr.a (mgr.14388) 11300 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:32:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:33 smithi027 bash[22610]: cluster 2024-08-31T06:32:31.741550+0000 mgr.a (mgr.14388) 11300 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:32:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:33 smithi191 bash[24992]: cluster 2024-08-31T06:32:31.741550+0000 mgr.a (mgr.14388) 11300 : cluster [DBG] pgmap v7832: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:32:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:34 smithi163 bash[24253]: audit 2024-08-31T06:32:32.601463+0000 mgr.a (mgr.14388) 11301 : audit [DBG] from='client.248670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:34 smithi027 bash[22610]: audit 2024-08-31T06:32:32.601463+0000 mgr.a (mgr.14388) 11301 : audit [DBG] from='client.248670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:34 smithi191 bash[24992]: audit 2024-08-31T06:32:32.601463+0000 mgr.a (mgr.14388) 11301 : audit [DBG] from='client.248670 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:35 smithi163 bash[24253]: cluster 2024-08-31T06:32:33.744432+0000 mgr.a (mgr.14388) 11302 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T06:32:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:35 smithi027 bash[22610]: cluster 2024-08-31T06:32:33.744432+0000 mgr.a (mgr.14388) 11302 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T06:32:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:35 smithi191 bash[24992]: cluster 2024-08-31T06:32:33.744432+0000 mgr.a (mgr.14388) 11302 : cluster [DBG] pgmap v7833: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T06:32:37.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:37 smithi163 bash[24253]: cluster 2024-08-31T06:32:35.745232+0000 mgr.a (mgr.14388) 11303 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:32:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:37 smithi027 bash[22610]: cluster 2024-08-31T06:32:35.745232+0000 mgr.a (mgr.14388) 11303 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:32:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:37 smithi191 bash[24992]: cluster 2024-08-31T06:32:35.745232+0000 mgr.a (mgr.14388) 11303 : cluster [DBG] pgmap v7834: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:32:38.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:32:38.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:32:38.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:32:38.805 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:32:38.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:32:38.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:32:38.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:32:38.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:32:39.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:39 smithi163 bash[24253]: cluster 2024-08-31T06:32:37.745988+0000 mgr.a (mgr.14388) 11304 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:32:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:39 smithi027 bash[22610]: cluster 2024-08-31T06:32:37.745988+0000 mgr.a (mgr.14388) 11304 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:32:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:39 smithi191 bash[24992]: cluster 2024-08-31T06:32:37.745988+0000 mgr.a (mgr.14388) 11304 : cluster [DBG] pgmap v7835: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:32:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:40 smithi163 bash[24253]: audit 2024-08-31T06:32:38.356839+0000 mgr.a (mgr.14388) 11305 : audit [DBG] from='client.248748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:40 smithi027 bash[22610]: audit 2024-08-31T06:32:38.356839+0000 mgr.a (mgr.14388) 11305 : audit [DBG] from='client.248748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:40 smithi191 bash[24992]: audit 2024-08-31T06:32:38.356839+0000 mgr.a (mgr.14388) 11305 : audit [DBG] from='client.248748 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:41 smithi163 bash[24253]: cluster 2024-08-31T06:32:39.748756+0000 mgr.a (mgr.14388) 11306 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T06:32:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:41 smithi027 bash[22610]: cluster 2024-08-31T06:32:39.748756+0000 mgr.a (mgr.14388) 11306 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T06:32:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:41 smithi191 bash[24992]: cluster 2024-08-31T06:32:39.748756+0000 mgr.a (mgr.14388) 11306 : cluster [DBG] pgmap v7836: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T06:32:43.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:43 smithi163 bash[24253]: cluster 2024-08-31T06:32:41.749566+0000 mgr.a (mgr.14388) 11307 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T06:32:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:43 smithi027 bash[22610]: cluster 2024-08-31T06:32:41.749566+0000 mgr.a (mgr.14388) 11307 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T06:32:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:43 smithi191 bash[24992]: cluster 2024-08-31T06:32:41.749566+0000 mgr.a (mgr.14388) 11307 : cluster [DBG] pgmap v7837: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T06:32:43.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:32:43.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:32:43.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:32:44.587 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:32:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:32:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:32:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:32:44.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:32:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:45 smithi163 bash[24253]: cluster 2024-08-31T06:32:43.751606+0000 mgr.a (mgr.14388) 11308 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T06:32:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:45 smithi163 bash[24253]: audit 2024-08-31T06:32:44.142126+0000 mgr.a (mgr.14388) 11309 : audit [DBG] from='client.248826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:45 smithi027 bash[22610]: cluster 2024-08-31T06:32:43.751606+0000 mgr.a (mgr.14388) 11308 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T06:32:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:45 smithi027 bash[22610]: audit 2024-08-31T06:32:44.142126+0000 mgr.a (mgr.14388) 11309 : audit [DBG] from='client.248826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:45 smithi191 bash[24992]: cluster 2024-08-31T06:32:43.751606+0000 mgr.a (mgr.14388) 11308 : cluster [DBG] pgmap v7838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T06:32:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:45 smithi191 bash[24992]: audit 2024-08-31T06:32:44.142126+0000 mgr.a (mgr.14388) 11309 : audit [DBG] from='client.248826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:47 smithi163 bash[24253]: cluster 2024-08-31T06:32:45.752544+0000 mgr.a (mgr.14388) 11310 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:32:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:47 smithi027 bash[22610]: cluster 2024-08-31T06:32:45.752544+0000 mgr.a (mgr.14388) 11310 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:32:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:47 smithi191 bash[24992]: cluster 2024-08-31T06:32:45.752544+0000 mgr.a (mgr.14388) 11310 : cluster [DBG] pgmap v7839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:32:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:49 smithi163 bash[24253]: cluster 2024-08-31T06:32:47.753320+0000 mgr.a (mgr.14388) 11311 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:32:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:49 smithi027 bash[22610]: cluster 2024-08-31T06:32:47.753320+0000 mgr.a (mgr.14388) 11311 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:32:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:49 smithi191 bash[24992]: cluster 2024-08-31T06:32:47.753320+0000 mgr.a (mgr.14388) 11311 : cluster [DBG] pgmap v7840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T06:32:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:32:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:32:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:32:50.351 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:32:50.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:32:50.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:32:50.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:32:50.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:32:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:51 smithi163 bash[24253]: cluster 2024-08-31T06:32:49.755483+0000 mgr.a (mgr.14388) 11312 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:32:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:51 smithi163 bash[24253]: audit 2024-08-31T06:32:49.922038+0000 mgr.a (mgr.14388) 11313 : audit [DBG] from='client.248898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:51 smithi027 bash[22610]: cluster 2024-08-31T06:32:49.755483+0000 mgr.a (mgr.14388) 11312 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:32:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:51 smithi027 bash[22610]: audit 2024-08-31T06:32:49.922038+0000 mgr.a (mgr.14388) 11313 : audit [DBG] from='client.248898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:51 smithi191 bash[24992]: cluster 2024-08-31T06:32:49.755483+0000 mgr.a (mgr.14388) 11312 : cluster [DBG] pgmap v7841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:32:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:51 smithi191 bash[24992]: audit 2024-08-31T06:32:49.922038+0000 mgr.a (mgr.14388) 11313 : audit [DBG] from='client.248898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:53 smithi163 bash[24253]: cluster 2024-08-31T06:32:51.756557+0000 mgr.a (mgr.14388) 11314 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:53 smithi027 bash[22610]: cluster 2024-08-31T06:32:51.756557+0000 mgr.a (mgr.14388) 11314 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:53 smithi191 bash[24992]: cluster 2024-08-31T06:32:51.756557+0000 mgr.a (mgr.14388) 11314 : cluster [DBG] pgmap v7842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:55.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:32:55.354 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:32:55.354 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:32:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:55 smithi163 bash[24253]: cluster 2024-08-31T06:32:53.758972+0000 mgr.a (mgr.14388) 11315 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:32:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:55 smithi027 bash[22610]: cluster 2024-08-31T06:32:53.758972+0000 mgr.a (mgr.14388) 11315 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:32:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:55 smithi191 bash[24992]: cluster 2024-08-31T06:32:53.758972+0000 mgr.a (mgr.14388) 11315 : cluster [DBG] pgmap v7843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:32:56.129 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:32:56.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:32:56.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:32:56.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:32:56.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:32:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:57 smithi163 bash[24253]: audit 2024-08-31T06:32:55.689698+0000 mgr.a (mgr.14388) 11316 : audit [DBG] from='client.248976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:57.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:57 smithi163 bash[24253]: cluster 2024-08-31T06:32:55.759556+0000 mgr.a (mgr.14388) 11317 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:57 smithi027 bash[22610]: audit 2024-08-31T06:32:55.689698+0000 mgr.a (mgr.14388) 11316 : audit [DBG] from='client.248976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:57 smithi027 bash[22610]: cluster 2024-08-31T06:32:55.759556+0000 mgr.a (mgr.14388) 11317 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:57 smithi191 bash[24992]: audit 2024-08-31T06:32:55.689698+0000 mgr.a (mgr.14388) 11316 : audit [DBG] from='client.248976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:32:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:57 smithi191 bash[24992]: cluster 2024-08-31T06:32:55.759556+0000 mgr.a (mgr.14388) 11317 : cluster [DBG] pgmap v7844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:32:59 smithi163 bash[24253]: cluster 2024-08-31T06:32:57.760440+0000 mgr.a (mgr.14388) 11318 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:32:59 smithi027 bash[22610]: cluster 2024-08-31T06:32:57.760440+0000 mgr.a (mgr.14388) 11318 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:32:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:32:59 smithi191 bash[24992]: cluster 2024-08-31T06:32:57.760440+0000 mgr.a (mgr.14388) 11318 : cluster [DBG] pgmap v7845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:01.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:01.131 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:01 smithi163 bash[24253]: cluster 2024-08-31T06:32:59.762707+0000 mgr.a (mgr.14388) 11319 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:01 smithi027 bash[22610]: cluster 2024-08-31T06:32:59.762707+0000 mgr.a (mgr.14388) 11319 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:01 smithi191 bash[24992]: cluster 2024-08-31T06:32:59.762707+0000 mgr.a (mgr.14388) 11319 : cluster [DBG] pgmap v7846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:01.875 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:01.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:01.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:01.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:01.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:33:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:03 smithi163 bash[24253]: audit 2024-08-31T06:33:01.459036+0000 mgr.a (mgr.14388) 11320 : audit [DBG] from='client.249054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:03.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:03 smithi163 bash[24253]: cluster 2024-08-31T06:33:01.763293+0000 mgr.a (mgr.14388) 11321 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:03 smithi027 bash[22610]: audit 2024-08-31T06:33:01.459036+0000 mgr.a (mgr.14388) 11320 : audit [DBG] from='client.249054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:03 smithi027 bash[22610]: cluster 2024-08-31T06:33:01.763293+0000 mgr.a (mgr.14388) 11321 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:03 smithi191 bash[24992]: audit 2024-08-31T06:33:01.459036+0000 mgr.a (mgr.14388) 11320 : audit [DBG] from='client.249054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:03 smithi191 bash[24992]: cluster 2024-08-31T06:33:01.763293+0000 mgr.a (mgr.14388) 11321 : cluster [DBG] pgmap v7847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:04.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:04 smithi163 bash[24253]: cluster 2024-08-31T06:33:03.765602+0000 mgr.a (mgr.14388) 11322 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:04 smithi027 bash[22610]: cluster 2024-08-31T06:33:03.765602+0000 mgr.a (mgr.14388) 11322 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:04 smithi191 bash[24992]: cluster 2024-08-31T06:33:03.765602+0000 mgr.a (mgr.14388) 11322 : cluster [DBG] pgmap v7848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:06.876 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:06.877 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:06.877 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:06 smithi163 bash[24253]: cluster 2024-08-31T06:33:05.766386+0000 mgr.a (mgr.14388) 11323 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:06 smithi027 bash[22610]: cluster 2024-08-31T06:33:05.766386+0000 mgr.a (mgr.14388) 11323 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:06 smithi191 bash[24992]: cluster 2024-08-31T06:33:05.766386+0000 mgr.a (mgr.14388) 11323 : cluster [DBG] pgmap v7849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:07.629 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:07.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:07.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:07.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:07.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:33:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:07 smithi163 bash[24253]: audit 2024-08-31T06:33:07.210073+0000 mgr.a (mgr.14388) 11324 : audit [DBG] from='client.249132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:07 smithi027 bash[22610]: audit 2024-08-31T06:33:07.210073+0000 mgr.a (mgr.14388) 11324 : audit [DBG] from='client.249132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:07 smithi191 bash[24992]: audit 2024-08-31T06:33:07.210073+0000 mgr.a (mgr.14388) 11324 : audit [DBG] from='client.249132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:08 smithi163 bash[24253]: cluster 2024-08-31T06:33:07.767273+0000 mgr.a (mgr.14388) 11325 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:08 smithi027 bash[22610]: cluster 2024-08-31T06:33:07.767273+0000 mgr.a (mgr.14388) 11325 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:08 smithi191 bash[24992]: cluster 2024-08-31T06:33:07.767273+0000 mgr.a (mgr.14388) 11325 : cluster [DBG] pgmap v7850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:10 smithi163 bash[24253]: cluster 2024-08-31T06:33:09.769507+0000 mgr.a (mgr.14388) 11326 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:10 smithi027 bash[22610]: cluster 2024-08-31T06:33:09.769507+0000 mgr.a (mgr.14388) 11326 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:10 smithi191 bash[24992]: cluster 2024-08-31T06:33:09.769507+0000 mgr.a (mgr.14388) 11326 : cluster [DBG] pgmap v7851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:12.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:12.631 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:12.631 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:12 smithi163 bash[24253]: cluster 2024-08-31T06:33:11.770259+0000 mgr.a (mgr.14388) 11327 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:12 smithi027 bash[22610]: cluster 2024-08-31T06:33:11.770259+0000 mgr.a (mgr.14388) 11327 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:12 smithi191 bash[24992]: cluster 2024-08-31T06:33:11.770259+0000 mgr.a (mgr.14388) 11327 : cluster [DBG] pgmap v7852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:13.380 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:13.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:13.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:13.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:13.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:33:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:13 smithi163 bash[24253]: audit 2024-08-31T06:33:12.959140+0000 mgr.a (mgr.14388) 11328 : audit [DBG] from='client.249210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:13 smithi027 bash[22610]: audit 2024-08-31T06:33:12.959140+0000 mgr.a (mgr.14388) 11328 : audit [DBG] from='client.249210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:13 smithi191 bash[24992]: audit 2024-08-31T06:33:12.959140+0000 mgr.a (mgr.14388) 11328 : audit [DBG] from='client.249210 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:14 smithi163 bash[24253]: cluster 2024-08-31T06:33:13.772974+0000 mgr.a (mgr.14388) 11329 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:14 smithi027 bash[22610]: cluster 2024-08-31T06:33:13.772974+0000 mgr.a (mgr.14388) 11329 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:14 smithi191 bash[24992]: cluster 2024-08-31T06:33:13.772974+0000 mgr.a (mgr.14388) 11329 : cluster [DBG] pgmap v7853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:16 smithi163 bash[24253]: cluster 2024-08-31T06:33:15.773747+0000 mgr.a (mgr.14388) 11330 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:33:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:16 smithi027 bash[22610]: cluster 2024-08-31T06:33:15.773747+0000 mgr.a (mgr.14388) 11330 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:33:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:16 smithi191 bash[24992]: cluster 2024-08-31T06:33:15.773747+0000 mgr.a (mgr.14388) 11330 : cluster [DBG] pgmap v7854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:33:18.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:18.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:18.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:19.116 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:19.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:19.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:19.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:19.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:33:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:18 smithi163 bash[24253]: cluster 2024-08-31T06:33:17.774512+0000 mgr.a (mgr.14388) 11331 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:33:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:18 smithi027 bash[22610]: cluster 2024-08-31T06:33:17.774512+0000 mgr.a (mgr.14388) 11331 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:33:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:18 smithi191 bash[24992]: cluster 2024-08-31T06:33:17.774512+0000 mgr.a (mgr.14388) 11331 : cluster [DBG] pgmap v7855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:33:20.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:19 smithi163 bash[24253]: audit 2024-08-31T06:33:18.708938+0000 mgr.a (mgr.14388) 11332 : audit [DBG] from='client.249285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:19 smithi027 bash[22610]: audit 2024-08-31T06:33:18.708938+0000 mgr.a (mgr.14388) 11332 : audit [DBG] from='client.249285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:19 smithi191 bash[24992]: audit 2024-08-31T06:33:18.708938+0000 mgr.a (mgr.14388) 11332 : audit [DBG] from='client.249285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:20 smithi163 bash[24253]: cluster 2024-08-31T06:33:19.777369+0000 mgr.a (mgr.14388) 11333 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:20 smithi027 bash[22610]: cluster 2024-08-31T06:33:19.777369+0000 mgr.a (mgr.14388) 11333 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:20 smithi191 bash[24992]: cluster 2024-08-31T06:33:19.777369+0000 mgr.a (mgr.14388) 11333 : cluster [DBG] pgmap v7856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:22 smithi163 bash[24253]: cluster 2024-08-31T06:33:21.778186+0000 mgr.a (mgr.14388) 11334 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:33:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:22 smithi027 bash[22610]: cluster 2024-08-31T06:33:21.778186+0000 mgr.a (mgr.14388) 11334 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:33:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:22 smithi191 bash[24992]: cluster 2024-08-31T06:33:21.778186+0000 mgr.a (mgr.14388) 11334 : cluster [DBG] pgmap v7857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:33:24.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:24.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:24.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:24.863 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:24.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:24.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:24.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:24.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:33:25.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:24 smithi163 bash[24253]: cluster 2024-08-31T06:33:23.780224+0000 mgr.a (mgr.14388) 11335 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:24 smithi027 bash[22610]: cluster 2024-08-31T06:33:23.780224+0000 mgr.a (mgr.14388) 11335 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:24 smithi191 bash[24992]: cluster 2024-08-31T06:33:23.780224+0000 mgr.a (mgr.14388) 11335 : cluster [DBG] pgmap v7858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:25 smithi163 bash[24253]: audit 2024-08-31T06:33:24.448684+0000 mgr.a (mgr.14388) 11336 : audit [DBG] from='client.249363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:25 smithi027 bash[22610]: audit 2024-08-31T06:33:24.448684+0000 mgr.a (mgr.14388) 11336 : audit [DBG] from='client.249363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:25 smithi191 bash[24992]: audit 2024-08-31T06:33:24.448684+0000 mgr.a (mgr.14388) 11336 : audit [DBG] from='client.249363 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:26 smithi163 bash[24253]: cluster 2024-08-31T06:33:25.781115+0000 mgr.a (mgr.14388) 11337 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:26 smithi027 bash[22610]: cluster 2024-08-31T06:33:25.781115+0000 mgr.a (mgr.14388) 11337 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:26 smithi191 bash[24992]: cluster 2024-08-31T06:33:25.781115+0000 mgr.a (mgr.14388) 11337 : cluster [DBG] pgmap v7859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:28 smithi163 bash[24253]: cluster 2024-08-31T06:33:27.782077+0000 mgr.a (mgr.14388) 11338 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:28 smithi027 bash[22610]: cluster 2024-08-31T06:33:27.782077+0000 mgr.a (mgr.14388) 11338 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:28 smithi191 bash[24992]: cluster 2024-08-31T06:33:27.782077+0000 mgr.a (mgr.14388) 11338 : cluster [DBG] pgmap v7860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:29.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:29.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:30.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:33:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:30 smithi163 bash[24253]: cluster 2024-08-31T06:33:29.784342+0000 mgr.a (mgr.14388) 11339 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:30 smithi163 bash[24253]: audit 2024-08-31T06:33:30.203633+0000 mgr.a (mgr.14388) 11340 : audit [DBG] from='client.249441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:30 smithi163 bash[24253]: audit 2024-08-31T06:33:30.550871+0000 mon.a (mon.0) 2271 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:33:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:30 smithi027 bash[22610]: cluster 2024-08-31T06:33:29.784342+0000 mgr.a (mgr.14388) 11339 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:30 smithi027 bash[22610]: audit 2024-08-31T06:33:30.203633+0000 mgr.a (mgr.14388) 11340 : audit [DBG] from='client.249441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:30 smithi027 bash[22610]: audit 2024-08-31T06:33:30.550871+0000 mon.a (mon.0) 2271 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:33:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:30 smithi191 bash[24992]: cluster 2024-08-31T06:33:29.784342+0000 mgr.a (mgr.14388) 11339 : cluster [DBG] pgmap v7861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:33:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:30 smithi191 bash[24992]: audit 2024-08-31T06:33:30.203633+0000 mgr.a (mgr.14388) 11340 : audit [DBG] from='client.249441 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:30 smithi191 bash[24992]: audit 2024-08-31T06:33:30.550871+0000 mon.a (mon.0) 2271 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:33:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:31 smithi163 bash[24253]: audit 2024-08-31T06:33:31.321258+0000 mon.a (mon.0) 2272 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:33:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:31 smithi163 bash[24253]: audit 2024-08-31T06:33:31.323027+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:33:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:31 smithi163 bash[24253]: audit 2024-08-31T06:33:31.333691+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:33:32.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:31 smithi163 bash[24253]: audit 2024-08-31T06:33:31.337054+0000 mon.a (mon.0) 2275 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:33:32.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:33:32 smithi027 bash[22863]: debug 2024-08-31T06:33:32.059+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:33:32.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:33:32 smithi027 bash[22863]: debug 2024-08-31T06:33:32.059+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:33:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:31 smithi027 bash[22610]: audit 2024-08-31T06:33:31.321258+0000 mon.a (mon.0) 2272 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:33:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:31 smithi027 bash[22610]: audit 2024-08-31T06:33:31.323027+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:33:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:31 smithi027 bash[22610]: audit 2024-08-31T06:33:31.333691+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:33:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:31 smithi027 bash[22610]: audit 2024-08-31T06:33:31.337054+0000 mon.a (mon.0) 2275 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:33:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:31 smithi191 bash[24992]: audit 2024-08-31T06:33:31.321258+0000 mon.a (mon.0) 2272 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:33:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:31 smithi191 bash[24992]: audit 2024-08-31T06:33:31.323027+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:33:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:31 smithi191 bash[24992]: audit 2024-08-31T06:33:31.333691+0000 mon.a (mon.0) 2274 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:33:32.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:31 smithi191 bash[24992]: audit 2024-08-31T06:33:31.337054+0000 mon.a (mon.0) 2275 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:33:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:32 smithi163 bash[24253]: audit 2024-08-31T06:33:31.339721+0000 mgr.a (mgr.14388) 11341 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:33:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:32 smithi163 bash[24253]: cluster 2024-08-31T06:33:31.784908+0000 mgr.a (mgr.14388) 11342 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:32 smithi163 bash[24253]: audit 2024-08-31T06:33:32.063657+0000 mgr.a (mgr.14388) 11343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:33:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:32 smithi163 bash[24253]: cephadm 2024-08-31T06:33:32.064892+0000 mgr.a (mgr.14388) 11344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:33:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:32 smithi027 bash[22610]: audit 2024-08-31T06:33:31.339721+0000 mgr.a (mgr.14388) 11341 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:33:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:32 smithi027 bash[22610]: cluster 2024-08-31T06:33:31.784908+0000 mgr.a (mgr.14388) 11342 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:32 smithi027 bash[22610]: audit 2024-08-31T06:33:32.063657+0000 mgr.a (mgr.14388) 11343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:33:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:32 smithi027 bash[22610]: cephadm 2024-08-31T06:33:32.064892+0000 mgr.a (mgr.14388) 11344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:33:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:32 smithi191 bash[24992]: audit 2024-08-31T06:33:31.339721+0000 mgr.a (mgr.14388) 11341 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:33:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:32 smithi191 bash[24992]: cluster 2024-08-31T06:33:31.784908+0000 mgr.a (mgr.14388) 11342 : cluster [DBG] pgmap v7862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:32 smithi191 bash[24992]: audit 2024-08-31T06:33:32.063657+0000 mgr.a (mgr.14388) 11343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:33:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:32 smithi191 bash[24992]: cephadm 2024-08-31T06:33:32.064892+0000 mgr.a (mgr.14388) 11344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:33:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:34 smithi163 bash[24253]: cluster 2024-08-31T06:33:33.787186+0000 mgr.a (mgr.14388) 11345 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:34 smithi027 bash[22610]: cluster 2024-08-31T06:33:33.787186+0000 mgr.a (mgr.14388) 11345 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:34 smithi191 bash[24992]: cluster 2024-08-31T06:33:33.787186+0000 mgr.a (mgr.14388) 11345 : cluster [DBG] pgmap v7863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:35.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:35.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:35.652 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:36.419 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:36.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:36.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:36.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:36.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:33:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:36 smithi163 bash[24253]: cluster 2024-08-31T06:33:35.787613+0000 mgr.a (mgr.14388) 11346 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:37.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:36 smithi163 bash[24253]: audit 2024-08-31T06:33:35.987842+0000 mgr.a (mgr.14388) 11347 : audit [DBG] from='client.249624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:36 smithi027 bash[22610]: cluster 2024-08-31T06:33:35.787613+0000 mgr.a (mgr.14388) 11346 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:36 smithi027 bash[22610]: audit 2024-08-31T06:33:35.987842+0000 mgr.a (mgr.14388) 11347 : audit [DBG] from='client.249624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:36 smithi191 bash[24992]: cluster 2024-08-31T06:33:35.787613+0000 mgr.a (mgr.14388) 11346 : cluster [DBG] pgmap v7864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:36 smithi191 bash[24992]: audit 2024-08-31T06:33:35.987842+0000 mgr.a (mgr.14388) 11347 : audit [DBG] from='client.249624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:39.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:38 smithi163 bash[24253]: cluster 2024-08-31T06:33:37.788462+0000 mgr.a (mgr.14388) 11348 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:38 smithi027 bash[22610]: cluster 2024-08-31T06:33:37.788462+0000 mgr.a (mgr.14388) 11348 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:38 smithi191 bash[24992]: cluster 2024-08-31T06:33:37.788462+0000 mgr.a (mgr.14388) 11348 : cluster [DBG] pgmap v7865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:40 smithi163 bash[24253]: cluster 2024-08-31T06:33:39.790678+0000 mgr.a (mgr.14388) 11349 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:40 smithi027 bash[22610]: cluster 2024-08-31T06:33:39.790678+0000 mgr.a (mgr.14388) 11349 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:40 smithi191 bash[24992]: cluster 2024-08-31T06:33:39.790678+0000 mgr.a (mgr.14388) 11349 : cluster [DBG] pgmap v7866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:41.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:41.421 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:41.421 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:42.161 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:42.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:42.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:42.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:42.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:33:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:42 smithi163 bash[24253]: audit 2024-08-31T06:33:41.750462+0000 mgr.a (mgr.14388) 11350 : audit [DBG] from='client.249702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:42 smithi163 bash[24253]: cluster 2024-08-31T06:33:41.791375+0000 mgr.a (mgr.14388) 11351 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:42 smithi027 bash[22610]: audit 2024-08-31T06:33:41.750462+0000 mgr.a (mgr.14388) 11350 : audit [DBG] from='client.249702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:42 smithi027 bash[22610]: cluster 2024-08-31T06:33:41.791375+0000 mgr.a (mgr.14388) 11351 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:42 smithi191 bash[24992]: audit 2024-08-31T06:33:41.750462+0000 mgr.a (mgr.14388) 11350 : audit [DBG] from='client.249702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:42 smithi191 bash[24992]: cluster 2024-08-31T06:33:41.791375+0000 mgr.a (mgr.14388) 11351 : cluster [DBG] pgmap v7867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:44 smithi163 bash[24253]: cluster 2024-08-31T06:33:43.793795+0000 mgr.a (mgr.14388) 11352 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:44 smithi027 bash[22610]: cluster 2024-08-31T06:33:43.793795+0000 mgr.a (mgr.14388) 11352 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:44 smithi191 bash[24992]: cluster 2024-08-31T06:33:43.793795+0000 mgr.a (mgr.14388) 11352 : cluster [DBG] pgmap v7868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:33:47.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:47.163 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:47.163 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:46 smithi163 bash[24253]: cluster 2024-08-31T06:33:45.794753+0000 mgr.a (mgr.14388) 11353 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:46 smithi027 bash[22610]: cluster 2024-08-31T06:33:45.794753+0000 mgr.a (mgr.14388) 11353 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:46 smithi191 bash[24992]: cluster 2024-08-31T06:33:45.794753+0000 mgr.a (mgr.14388) 11353 : cluster [DBG] pgmap v7869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:47.951 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:47.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:47.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:47.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:47.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:33:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:48 smithi163 bash[24253]: audit 2024-08-31T06:33:47.504552+0000 mgr.a (mgr.14388) 11354 : audit [DBG] from='client.249777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:49.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:48 smithi163 bash[24253]: cluster 2024-08-31T06:33:47.795311+0000 mgr.a (mgr.14388) 11355 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:48 smithi027 bash[22610]: audit 2024-08-31T06:33:47.504552+0000 mgr.a (mgr.14388) 11354 : audit [DBG] from='client.249777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:48 smithi027 bash[22610]: cluster 2024-08-31T06:33:47.795311+0000 mgr.a (mgr.14388) 11355 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:48 smithi191 bash[24992]: audit 2024-08-31T06:33:47.504552+0000 mgr.a (mgr.14388) 11354 : audit [DBG] from='client.249777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:48 smithi191 bash[24992]: cluster 2024-08-31T06:33:47.795311+0000 mgr.a (mgr.14388) 11355 : cluster [DBG] pgmap v7870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:50 smithi163 bash[24253]: cluster 2024-08-31T06:33:49.797578+0000 mgr.a (mgr.14388) 11356 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:33:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:50 smithi027 bash[22610]: cluster 2024-08-31T06:33:49.797578+0000 mgr.a (mgr.14388) 11356 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:33:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:50 smithi191 bash[24992]: cluster 2024-08-31T06:33:49.797578+0000 mgr.a (mgr.14388) 11356 : cluster [DBG] pgmap v7871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:33:52.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:52.953 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:52.954 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:52 smithi163 bash[24253]: cluster 2024-08-31T06:33:51.798318+0000 mgr.a (mgr.14388) 11357 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:33:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:52 smithi027 bash[22610]: cluster 2024-08-31T06:33:51.798318+0000 mgr.a (mgr.14388) 11357 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:33:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:52 smithi191 bash[24992]: cluster 2024-08-31T06:33:51.798318+0000 mgr.a (mgr.14388) 11357 : cluster [DBG] pgmap v7872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:33:53.736 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:53.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:53.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:53.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:53.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:33:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:53 smithi027 bash[22610]: audit 2024-08-31T06:33:53.286545+0000 mgr.a (mgr.14388) 11358 : audit [DBG] from='client.249852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:53 smithi191 bash[24992]: audit 2024-08-31T06:33:53.286545+0000 mgr.a (mgr.14388) 11358 : audit [DBG] from='client.249852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:53 smithi163 bash[24253]: audit 2024-08-31T06:33:53.286545+0000 mgr.a (mgr.14388) 11358 : audit [DBG] from='client.249852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:33:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:54 smithi027 bash[22610]: cluster 2024-08-31T06:33:53.799863+0000 mgr.a (mgr.14388) 11359 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:54 smithi191 bash[24992]: cluster 2024-08-31T06:33:53.799863+0000 mgr.a (mgr.14388) 11359 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:55.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:54 smithi163 bash[24253]: cluster 2024-08-31T06:33:53.799863+0000 mgr.a (mgr.14388) 11359 : cluster [DBG] pgmap v7873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:33:57.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:56 smithi027 bash[22610]: cluster 2024-08-31T06:33:55.800586+0000 mgr.a (mgr.14388) 11360 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:33:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:56 smithi191 bash[24992]: cluster 2024-08-31T06:33:55.800586+0000 mgr.a (mgr.14388) 11360 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:33:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:56 smithi163 bash[24253]: cluster 2024-08-31T06:33:55.800586+0000 mgr.a (mgr.14388) 11360 : cluster [DBG] pgmap v7874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:33:58.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:33:58.738 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:33:58.738 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:33:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:58 smithi027 bash[22610]: cluster 2024-08-31T06:33:57.801468+0000 mgr.a (mgr.14388) 11361 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:33:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:58 smithi191 bash[24992]: cluster 2024-08-31T06:33:57.801468+0000 mgr.a (mgr.14388) 11361 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:33:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:58 smithi163 bash[24253]: cluster 2024-08-31T06:33:57.801468+0000 mgr.a (mgr.14388) 11361 : cluster [DBG] pgmap v7875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:33:59.518 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:33:59.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:33:59.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:33:59.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:33:59.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:33:59 smithi027 bash[22610]: audit 2024-08-31T06:33:59.070750+0000 mgr.a (mgr.14388) 11362 : audit [DBG] from='client.249924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:33:59 smithi191 bash[24992]: audit 2024-08-31T06:33:59.070750+0000 mgr.a (mgr.14388) 11362 : audit [DBG] from='client.249924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:33:59 smithi163 bash[24253]: audit 2024-08-31T06:33:59.070750+0000 mgr.a (mgr.14388) 11362 : audit [DBG] from='client.249924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:00 smithi027 bash[22610]: cluster 2024-08-31T06:33:59.804304+0000 mgr.a (mgr.14388) 11363 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:00 smithi191 bash[24992]: cluster 2024-08-31T06:33:59.804304+0000 mgr.a (mgr.14388) 11363 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:00 smithi163 bash[24253]: cluster 2024-08-31T06:33:59.804304+0000 mgr.a (mgr.14388) 11363 : cluster [DBG] pgmap v7876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:02 smithi191 bash[24992]: cluster 2024-08-31T06:34:01.805048+0000 mgr.a (mgr.14388) 11364 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:34:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:02 smithi163 bash[24253]: cluster 2024-08-31T06:34:01.805048+0000 mgr.a (mgr.14388) 11364 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:34:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:02 smithi027 bash[22610]: cluster 2024-08-31T06:34:01.805048+0000 mgr.a (mgr.14388) 11364 : cluster [DBG] pgmap v7877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:34:04.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:34:04.520 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:34:04.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:34:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:04 smithi191 bash[24992]: cluster 2024-08-31T06:34:03.807072+0000 mgr.a (mgr.14388) 11365 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:34:05.301 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:34:05.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:34:05.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:34:05.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:34:05.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:04 smithi163 bash[24253]: cluster 2024-08-31T06:34:03.807072+0000 mgr.a (mgr.14388) 11365 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:34:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:04 smithi027 bash[22610]: cluster 2024-08-31T06:34:03.807072+0000 mgr.a (mgr.14388) 11365 : cluster [DBG] pgmap v7878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T06:34:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:06 smithi191 bash[24992]: audit 2024-08-31T06:34:04.861797+0000 mgr.a (mgr.14388) 11366 : audit [DBG] from='client.249999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:06 smithi163 bash[24253]: audit 2024-08-31T06:34:04.861797+0000 mgr.a (mgr.14388) 11366 : audit [DBG] from='client.249999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:06 smithi027 bash[22610]: audit 2024-08-31T06:34:04.861797+0000 mgr.a (mgr.14388) 11366 : audit [DBG] from='client.249999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:07 smithi191 bash[24992]: cluster 2024-08-31T06:34:05.807878+0000 mgr.a (mgr.14388) 11367 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:07 smithi163 bash[24253]: cluster 2024-08-31T06:34:05.807878+0000 mgr.a (mgr.14388) 11367 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:07 smithi027 bash[22610]: cluster 2024-08-31T06:34:05.807878+0000 mgr.a (mgr.14388) 11367 : cluster [DBG] pgmap v7879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:09 smithi191 bash[24992]: cluster 2024-08-31T06:34:07.808632+0000 mgr.a (mgr.14388) 11368 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:09 smithi163 bash[24253]: cluster 2024-08-31T06:34:07.808632+0000 mgr.a (mgr.14388) 11368 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:09 smithi027 bash[22610]: cluster 2024-08-31T06:34:07.808632+0000 mgr.a (mgr.14388) 11368 : cluster [DBG] pgmap v7880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:10.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:34:10.304 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:34:10.304 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:34:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:34:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:34:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:34:11.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:11.068 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:34:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:11 smithi191 bash[24992]: cluster 2024-08-31T06:34:09.810855+0000 mgr.a (mgr.14388) 11369 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:11 smithi163 bash[24253]: cluster 2024-08-31T06:34:09.810855+0000 mgr.a (mgr.14388) 11369 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:11 smithi027 bash[22610]: cluster 2024-08-31T06:34:09.810855+0000 mgr.a (mgr.14388) 11369 : cluster [DBG] pgmap v7881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:12 smithi191 bash[24992]: audit 2024-08-31T06:34:10.641535+0000 mgr.a (mgr.14388) 11370 : audit [DBG] from='client.250074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:12 smithi163 bash[24253]: audit 2024-08-31T06:34:10.641535+0000 mgr.a (mgr.14388) 11370 : audit [DBG] from='client.250074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:12 smithi027 bash[22610]: audit 2024-08-31T06:34:10.641535+0000 mgr.a (mgr.14388) 11370 : audit [DBG] from='client.250074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:13 smithi191 bash[24992]: cluster 2024-08-31T06:34:11.811843+0000 mgr.a (mgr.14388) 11371 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:13 smithi163 bash[24253]: cluster 2024-08-31T06:34:11.811843+0000 mgr.a (mgr.14388) 11371 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:13 smithi027 bash[22610]: cluster 2024-08-31T06:34:11.811843+0000 mgr.a (mgr.14388) 11371 : cluster [DBG] pgmap v7882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:15 smithi191 bash[24992]: cluster 2024-08-31T06:34:13.814103+0000 mgr.a (mgr.14388) 11372 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:15 smithi163 bash[24253]: cluster 2024-08-31T06:34:13.814103+0000 mgr.a (mgr.14388) 11372 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:15 smithi027 bash[22610]: cluster 2024-08-31T06:34:13.814103+0000 mgr.a (mgr.14388) 11372 : cluster [DBG] pgmap v7883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:16.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:34:16.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:34:16.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:34:16.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:34:16.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:34:16.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:34:16.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:16.838 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:34:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:17 smithi191 bash[24992]: cluster 2024-08-31T06:34:15.814913+0000 mgr.a (mgr.14388) 11373 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:17 smithi163 bash[24253]: cluster 2024-08-31T06:34:15.814913+0000 mgr.a (mgr.14388) 11373 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:17 smithi027 bash[22610]: cluster 2024-08-31T06:34:15.814913+0000 mgr.a (mgr.14388) 11373 : cluster [DBG] pgmap v7884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:18 smithi163 bash[24253]: audit 2024-08-31T06:34:16.404664+0000 mgr.a (mgr.14388) 11374 : audit [DBG] from='client.250152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:18 smithi027 bash[22610]: audit 2024-08-31T06:34:16.404664+0000 mgr.a (mgr.14388) 11374 : audit [DBG] from='client.250152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:18 smithi191 bash[24992]: audit 2024-08-31T06:34:16.404664+0000 mgr.a (mgr.14388) 11374 : audit [DBG] from='client.250152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:19 smithi163 bash[24253]: cluster 2024-08-31T06:34:17.815810+0000 mgr.a (mgr.14388) 11375 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:19 smithi027 bash[22610]: cluster 2024-08-31T06:34:17.815810+0000 mgr.a (mgr.14388) 11375 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:19 smithi191 bash[24992]: cluster 2024-08-31T06:34:17.815810+0000 mgr.a (mgr.14388) 11375 : cluster [DBG] pgmap v7885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:21 smithi163 bash[24253]: cluster 2024-08-31T06:34:19.818059+0000 mgr.a (mgr.14388) 11376 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:21 smithi027 bash[22610]: cluster 2024-08-31T06:34:19.818059+0000 mgr.a (mgr.14388) 11376 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:21 smithi191 bash[24992]: cluster 2024-08-31T06:34:19.818059+0000 mgr.a (mgr.14388) 11376 : cluster [DBG] pgmap v7886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:34:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:34:21.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:34:22.617 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:34:22.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:34:22.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:34:22.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:34:22.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:23 smithi163 bash[24253]: cluster 2024-08-31T06:34:21.818850+0000 mgr.a (mgr.14388) 11377 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:23 smithi163 bash[24253]: audit 2024-08-31T06:34:22.178051+0000 mgr.a (mgr.14388) 11378 : audit [DBG] from='client.250221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:23 smithi027 bash[22610]: cluster 2024-08-31T06:34:21.818850+0000 mgr.a (mgr.14388) 11377 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:23 smithi027 bash[22610]: audit 2024-08-31T06:34:22.178051+0000 mgr.a (mgr.14388) 11378 : audit [DBG] from='client.250221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:23 smithi191 bash[24992]: cluster 2024-08-31T06:34:21.818850+0000 mgr.a (mgr.14388) 11377 : cluster [DBG] pgmap v7887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:23 smithi191 bash[24992]: audit 2024-08-31T06:34:22.178051+0000 mgr.a (mgr.14388) 11378 : audit [DBG] from='client.250221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:25 smithi163 bash[24253]: cluster 2024-08-31T06:34:23.821185+0000 mgr.a (mgr.14388) 11379 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:25 smithi027 bash[22610]: cluster 2024-08-31T06:34:23.821185+0000 mgr.a (mgr.14388) 11379 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:25 smithi191 bash[24992]: cluster 2024-08-31T06:34:23.821185+0000 mgr.a (mgr.14388) 11379 : cluster [DBG] pgmap v7888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:34:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:27 smithi163 bash[24253]: cluster 2024-08-31T06:34:25.822034+0000 mgr.a (mgr.14388) 11380 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:27 smithi027 bash[22610]: cluster 2024-08-31T06:34:25.822034+0000 mgr.a (mgr.14388) 11380 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:27 smithi191 bash[24992]: cluster 2024-08-31T06:34:25.822034+0000 mgr.a (mgr.14388) 11380 : cluster [DBG] pgmap v7889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:27.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:34:27.620 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:34:27.620 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:34:28.397 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:34:28.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:34:28.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:34:28.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:34:28.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:29 smithi163 bash[24253]: cluster 2024-08-31T06:34:27.822542+0000 mgr.a (mgr.14388) 11381 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:29 smithi163 bash[24253]: audit 2024-08-31T06:34:27.955566+0000 mgr.a (mgr.14388) 11382 : audit [DBG] from='client.250296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:29 smithi027 bash[22610]: cluster 2024-08-31T06:34:27.822542+0000 mgr.a (mgr.14388) 11381 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:29 smithi027 bash[22610]: audit 2024-08-31T06:34:27.955566+0000 mgr.a (mgr.14388) 11382 : audit [DBG] from='client.250296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:29 smithi191 bash[24992]: cluster 2024-08-31T06:34:27.822542+0000 mgr.a (mgr.14388) 11381 : cluster [DBG] pgmap v7890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:29 smithi191 bash[24992]: audit 2024-08-31T06:34:27.955566+0000 mgr.a (mgr.14388) 11382 : audit [DBG] from='client.250296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:31 smithi163 bash[24253]: cluster 2024-08-31T06:34:29.825298+0000 mgr.a (mgr.14388) 11383 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:31 smithi027 bash[22610]: cluster 2024-08-31T06:34:29.825298+0000 mgr.a (mgr.14388) 11383 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:31 smithi191 bash[24992]: cluster 2024-08-31T06:34:29.825298+0000 mgr.a (mgr.14388) 11383 : cluster [DBG] pgmap v7891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:33.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:34:33.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:34:33.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:34:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:33 smithi163 bash[24253]: cluster 2024-08-31T06:34:31.826124+0000 mgr.a (mgr.14388) 11384 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:34:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:33 smithi163 bash[24253]: audit 2024-08-31T06:34:32.113635+0000 mon.a (mon.0) 2276 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:34:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:33 smithi027 bash[22610]: cluster 2024-08-31T06:34:31.826124+0000 mgr.a (mgr.14388) 11384 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:34:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:33 smithi027 bash[22610]: audit 2024-08-31T06:34:32.113635+0000 mon.a (mon.0) 2276 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:34:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:33 smithi191 bash[24992]: cluster 2024-08-31T06:34:31.826124+0000 mgr.a (mgr.14388) 11384 : cluster [DBG] pgmap v7892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:34:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:33 smithi191 bash[24992]: audit 2024-08-31T06:34:32.113635+0000 mon.a (mon.0) 2276 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:34:34.137 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:34:34.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:34:34.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:34:34.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:34:34.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:35 smithi163 bash[24253]: audit 2024-08-31T06:34:33.724215+0000 mgr.a (mgr.14388) 11385 : audit [DBG] from='client.250374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:35 smithi163 bash[24253]: cluster 2024-08-31T06:34:33.827385+0000 mgr.a (mgr.14388) 11386 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:35 smithi027 bash[22610]: audit 2024-08-31T06:34:33.724215+0000 mgr.a (mgr.14388) 11385 : audit [DBG] from='client.250374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:35 smithi027 bash[22610]: cluster 2024-08-31T06:34:33.827385+0000 mgr.a (mgr.14388) 11386 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:35 smithi191 bash[24992]: audit 2024-08-31T06:34:33.724215+0000 mgr.a (mgr.14388) 11385 : audit [DBG] from='client.250374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:35 smithi191 bash[24992]: cluster 2024-08-31T06:34:33.827385+0000 mgr.a (mgr.14388) 11386 : cluster [DBG] pgmap v7893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:37 smithi163 bash[24253]: cluster 2024-08-31T06:34:35.828206+0000 mgr.a (mgr.14388) 11387 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:34:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:37 smithi027 bash[22610]: cluster 2024-08-31T06:34:35.828206+0000 mgr.a (mgr.14388) 11387 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:34:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:37 smithi191 bash[24992]: cluster 2024-08-31T06:34:35.828206+0000 mgr.a (mgr.14388) 11387 : cluster [DBG] pgmap v7894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:34:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:37.442537+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:37.447748+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:37.488698+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:37.492535+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:37.497717+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:37.503991+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: cluster 2024-08-31T06:34:37.828909+0000 mgr.a (mgr.14388) 11388 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:34:38.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:38.187699+0000 mon.a (mon.0) 2283 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:34:38.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:38.189104+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:34:38.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:38.199206+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:38.204001+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:34:38.703 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:38 smithi163 bash[24253]: audit 2024-08-31T06:34:38.206290+0000 mgr.a (mgr.14388) 11389 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:34:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:37.442537+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:37.447748+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:37.488698+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:37.492535+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:37.497717+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:37.503991+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: cluster 2024-08-31T06:34:37.828909+0000 mgr.a (mgr.14388) 11388 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:34:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:38.187699+0000 mon.a (mon.0) 2283 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:34:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:38.189104+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:34:38.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:38.199206+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:38.204001+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:34:38.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22610]: audit 2024-08-31T06:34:38.206290+0000 mgr.a (mgr.14388) 11389 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:34:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:37.442537+0000 mon.a (mon.0) 2277 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:37.447748+0000 mon.a (mon.0) 2278 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:37.488698+0000 mon.a (mon.0) 2279 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:37.492535+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:37.497717+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:37.503991+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: cluster 2024-08-31T06:34:37.828909+0000 mgr.a (mgr.14388) 11388 : cluster [DBG] pgmap v7895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:38.187699+0000 mon.a (mon.0) 2283 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:38.189104+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:38.199206+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:38.204001+0000 mon.a (mon.0) 2286 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:34:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:38 smithi191 bash[24992]: audit 2024-08-31T06:34:38.206290+0000 mgr.a (mgr.14388) 11389 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:34:39.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:34:39.139 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:34:39.139 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:34:39.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22863]: debug 2024-08-31T06:34:38.965+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:34:39.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:34:38 smithi027 bash[22863]: debug 2024-08-31T06:34:38.965+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:34:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:39 smithi191 bash[24992]: audit 2024-08-31T06:34:38.969171+0000 mgr.a (mgr.14388) 11390 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:34:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:39 smithi191 bash[24992]: cephadm 2024-08-31T06:34:38.970467+0000 mgr.a (mgr.14388) 11391 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:34:39.883 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:34:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:34:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:34:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:34:39.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:39 smithi163 bash[24253]: audit 2024-08-31T06:34:38.969171+0000 mgr.a (mgr.14388) 11390 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:34:39.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:39 smithi163 bash[24253]: cephadm 2024-08-31T06:34:38.970467+0000 mgr.a (mgr.14388) 11391 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:34:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:39 smithi027 bash[22610]: audit 2024-08-31T06:34:38.969171+0000 mgr.a (mgr.14388) 11390 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:34:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:39 smithi027 bash[22610]: cephadm 2024-08-31T06:34:38.970467+0000 mgr.a (mgr.14388) 11391 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:34:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:40 smithi191 bash[24992]: audit 2024-08-31T06:34:39.469320+0000 mgr.a (mgr.14388) 11392 : audit [DBG] from='client.250551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:40 smithi191 bash[24992]: cluster 2024-08-31T06:34:39.830181+0000 mgr.a (mgr.14388) 11393 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:40 smithi163 bash[24253]: audit 2024-08-31T06:34:39.469320+0000 mgr.a (mgr.14388) 11392 : audit [DBG] from='client.250551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:40.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:40 smithi163 bash[24253]: cluster 2024-08-31T06:34:39.830181+0000 mgr.a (mgr.14388) 11393 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:40 smithi027 bash[22610]: audit 2024-08-31T06:34:39.469320+0000 mgr.a (mgr.14388) 11392 : audit [DBG] from='client.250551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:40 smithi027 bash[22610]: cluster 2024-08-31T06:34:39.830181+0000 mgr.a (mgr.14388) 11393 : cluster [DBG] pgmap v7896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:42 smithi163 bash[24253]: cluster 2024-08-31T06:34:41.830962+0000 mgr.a (mgr.14388) 11394 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:42 smithi027 bash[22610]: cluster 2024-08-31T06:34:41.830962+0000 mgr.a (mgr.14388) 11394 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:42 smithi191 bash[24992]: cluster 2024-08-31T06:34:41.830962+0000 mgr.a (mgr.14388) 11394 : cluster [DBG] pgmap v7897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:44.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:34:44.885 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:34:44.885 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:34:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:44 smithi163 bash[24253]: cluster 2024-08-31T06:34:43.832975+0000 mgr.a (mgr.14388) 11395 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:44 smithi027 bash[22610]: cluster 2024-08-31T06:34:43.832975+0000 mgr.a (mgr.14388) 11395 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:44 smithi191 bash[24992]: cluster 2024-08-31T06:34:43.832975+0000 mgr.a (mgr.14388) 11395 : cluster [DBG] pgmap v7898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:45.647 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:34:45.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:34:45.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:34:45.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:34:45.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:45 smithi163 bash[24253]: audit 2024-08-31T06:34:45.215459+0000 mgr.a (mgr.14388) 11396 : audit [DBG] from='client.250626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:45 smithi027 bash[22610]: audit 2024-08-31T06:34:45.215459+0000 mgr.a (mgr.14388) 11396 : audit [DBG] from='client.250626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:45 smithi191 bash[24992]: audit 2024-08-31T06:34:45.215459+0000 mgr.a (mgr.14388) 11396 : audit [DBG] from='client.250626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:46 smithi163 bash[24253]: cluster 2024-08-31T06:34:45.833921+0000 mgr.a (mgr.14388) 11397 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:46 smithi027 bash[22610]: cluster 2024-08-31T06:34:45.833921+0000 mgr.a (mgr.14388) 11397 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:46 smithi191 bash[24992]: cluster 2024-08-31T06:34:45.833921+0000 mgr.a (mgr.14388) 11397 : cluster [DBG] pgmap v7899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:48 smithi163 bash[24253]: cluster 2024-08-31T06:34:47.834701+0000 mgr.a (mgr.14388) 11398 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:48 smithi027 bash[22610]: cluster 2024-08-31T06:34:47.834701+0000 mgr.a (mgr.14388) 11398 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:48 smithi191 bash[24992]: cluster 2024-08-31T06:34:47.834701+0000 mgr.a (mgr.14388) 11398 : cluster [DBG] pgmap v7900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:50.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:34:50.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:34:50.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:34:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:50 smithi163 bash[24253]: cluster 2024-08-31T06:34:49.836944+0000 mgr.a (mgr.14388) 11399 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:50 smithi027 bash[22610]: cluster 2024-08-31T06:34:49.836944+0000 mgr.a (mgr.14388) 11399 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:50 smithi191 bash[24992]: cluster 2024-08-31T06:34:49.836944+0000 mgr.a (mgr.14388) 11399 : cluster [DBG] pgmap v7901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:51.392 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:34:51.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:34:51.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:34:51.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:34:51.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:51 smithi163 bash[24253]: audit 2024-08-31T06:34:50.977800+0000 mgr.a (mgr.14388) 11400 : audit [DBG] from='client.250698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:51 smithi027 bash[22610]: audit 2024-08-31T06:34:50.977800+0000 mgr.a (mgr.14388) 11400 : audit [DBG] from='client.250698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:51 smithi191 bash[24992]: audit 2024-08-31T06:34:50.977800+0000 mgr.a (mgr.14388) 11400 : audit [DBG] from='client.250698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:52 smithi163 bash[24253]: cluster 2024-08-31T06:34:51.837920+0000 mgr.a (mgr.14388) 11401 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:52 smithi027 bash[22610]: cluster 2024-08-31T06:34:51.837920+0000 mgr.a (mgr.14388) 11401 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:52 smithi191 bash[24992]: cluster 2024-08-31T06:34:51.837920+0000 mgr.a (mgr.14388) 11401 : cluster [DBG] pgmap v7902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:54 smithi163 bash[24253]: cluster 2024-08-31T06:34:53.840225+0000 mgr.a (mgr.14388) 11402 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:54 smithi027 bash[22610]: cluster 2024-08-31T06:34:53.840225+0000 mgr.a (mgr.14388) 11402 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:54 smithi191 bash[24992]: cluster 2024-08-31T06:34:53.840225+0000 mgr.a (mgr.14388) 11402 : cluster [DBG] pgmap v7903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:34:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:34:56.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:34:56.395 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:34:57.133 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:34:57.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:34:57.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:34:57.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:34:57.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:34:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:56 smithi163 bash[24253]: cluster 2024-08-31T06:34:55.840992+0000 mgr.a (mgr.14388) 11403 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:56 smithi027 bash[22610]: cluster 2024-08-31T06:34:55.840992+0000 mgr.a (mgr.14388) 11403 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:56 smithi191 bash[24992]: cluster 2024-08-31T06:34:55.840992+0000 mgr.a (mgr.14388) 11403 : cluster [DBG] pgmap v7904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:57 smithi163 bash[24253]: audit 2024-08-31T06:34:56.727377+0000 mgr.a (mgr.14388) 11404 : audit [DBG] from='client.250773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:57 smithi027 bash[22610]: audit 2024-08-31T06:34:56.727377+0000 mgr.a (mgr.14388) 11404 : audit [DBG] from='client.250773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:57 smithi191 bash[24992]: audit 2024-08-31T06:34:56.727377+0000 mgr.a (mgr.14388) 11404 : audit [DBG] from='client.250773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:34:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:34:58 smithi163 bash[24253]: cluster 2024-08-31T06:34:57.841937+0000 mgr.a (mgr.14388) 11405 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:34:58 smithi027 bash[22610]: cluster 2024-08-31T06:34:57.841937+0000 mgr.a (mgr.14388) 11405 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:34:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:34:58 smithi191 bash[24992]: cluster 2024-08-31T06:34:57.841937+0000 mgr.a (mgr.14388) 11405 : cluster [DBG] pgmap v7905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:00 smithi027 bash[22610]: cluster 2024-08-31T06:34:59.844187+0000 mgr.a (mgr.14388) 11406 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:00 smithi191 bash[24992]: cluster 2024-08-31T06:34:59.844187+0000 mgr.a (mgr.14388) 11406 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:01.346 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:00 smithi163 bash[24253]: cluster 2024-08-31T06:34:59.844187+0000 mgr.a (mgr.14388) 11406 : cluster [DBG] pgmap v7906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:02.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:35:02.914 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:35:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:35:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:35:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:35:02.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:35:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:02 smithi027 bash[22610]: cluster 2024-08-31T06:35:01.844970+0000 mgr.a (mgr.14388) 11407 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:02 smithi191 bash[24992]: cluster 2024-08-31T06:35:01.844970+0000 mgr.a (mgr.14388) 11407 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:02 smithi163 bash[24253]: cluster 2024-08-31T06:35:01.844970+0000 mgr.a (mgr.14388) 11407 : cluster [DBG] pgmap v7907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:03 smithi027 bash[22610]: audit 2024-08-31T06:35:02.472336+0000 mgr.a (mgr.14388) 11408 : audit [DBG] from='client.250848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:03 smithi191 bash[24992]: audit 2024-08-31T06:35:02.472336+0000 mgr.a (mgr.14388) 11408 : audit [DBG] from='client.250848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:03 smithi163 bash[24253]: audit 2024-08-31T06:35:02.472336+0000 mgr.a (mgr.14388) 11408 : audit [DBG] from='client.250848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:04 smithi027 bash[22610]: cluster 2024-08-31T06:35:03.847421+0000 mgr.a (mgr.14388) 11409 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:04 smithi191 bash[24992]: cluster 2024-08-31T06:35:03.847421+0000 mgr.a (mgr.14388) 11409 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:04 smithi163 bash[24253]: cluster 2024-08-31T06:35:03.847421+0000 mgr.a (mgr.14388) 11409 : cluster [DBG] pgmap v7908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:06 smithi027 bash[22610]: cluster 2024-08-31T06:35:05.848196+0000 mgr.a (mgr.14388) 11410 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:06 smithi191 bash[24992]: cluster 2024-08-31T06:35:05.848196+0000 mgr.a (mgr.14388) 11410 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:06 smithi163 bash[24253]: cluster 2024-08-31T06:35:05.848196+0000 mgr.a (mgr.14388) 11410 : cluster [DBG] pgmap v7909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:07.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:07.917 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:07.917 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:35:08.684 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:35:08.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:35:08.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:35:08.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:35:08.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:35:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:08 smithi027 bash[22610]: cluster 2024-08-31T06:35:07.848963+0000 mgr.a (mgr.14388) 11411 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:08 smithi027 bash[22610]: audit 2024-08-31T06:35:08.249045+0000 mgr.a (mgr.14388) 11412 : audit [DBG] from='client.250923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:08 smithi191 bash[24992]: cluster 2024-08-31T06:35:07.848963+0000 mgr.a (mgr.14388) 11411 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:08 smithi191 bash[24992]: audit 2024-08-31T06:35:08.249045+0000 mgr.a (mgr.14388) 11412 : audit [DBG] from='client.250923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:08 smithi163 bash[24253]: cluster 2024-08-31T06:35:07.848963+0000 mgr.a (mgr.14388) 11411 : cluster [DBG] pgmap v7910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:08 smithi163 bash[24253]: audit 2024-08-31T06:35:08.249045+0000 mgr.a (mgr.14388) 11412 : audit [DBG] from='client.250923 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:10 smithi027 bash[22610]: cluster 2024-08-31T06:35:09.851798+0000 mgr.a (mgr.14388) 11413 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:10 smithi191 bash[24992]: cluster 2024-08-31T06:35:09.851798+0000 mgr.a (mgr.14388) 11413 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:10 smithi163 bash[24253]: cluster 2024-08-31T06:35:09.851798+0000 mgr.a (mgr.14388) 11413 : cluster [DBG] pgmap v7911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:12 smithi027 bash[22610]: cluster 2024-08-31T06:35:11.852570+0000 mgr.a (mgr.14388) 11414 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:35:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:12 smithi191 bash[24992]: cluster 2024-08-31T06:35:11.852570+0000 mgr.a (mgr.14388) 11414 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:35:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:12 smithi163 bash[24253]: cluster 2024-08-31T06:35:11.852570+0000 mgr.a (mgr.14388) 11414 : cluster [DBG] pgmap v7912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:35:13.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:13.686 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:13.687 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:35:14.460 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:35:14.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:35:14.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:35:14.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:35:14.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:35:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:14 smithi191 bash[24992]: cluster 2024-08-31T06:35:13.854547+0000 mgr.a (mgr.14388) 11415 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:14 smithi191 bash[24992]: audit 2024-08-31T06:35:14.027815+0000 mgr.a (mgr.14388) 11416 : audit [DBG] from='client.251001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:14 smithi163 bash[24253]: cluster 2024-08-31T06:35:13.854547+0000 mgr.a (mgr.14388) 11415 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:15.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:14 smithi163 bash[24253]: audit 2024-08-31T06:35:14.027815+0000 mgr.a (mgr.14388) 11416 : audit [DBG] from='client.251001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:14 smithi027 bash[22610]: cluster 2024-08-31T06:35:13.854547+0000 mgr.a (mgr.14388) 11415 : cluster [DBG] pgmap v7913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:14 smithi027 bash[22610]: audit 2024-08-31T06:35:14.027815+0000 mgr.a (mgr.14388) 11416 : audit [DBG] from='client.251001 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:16 smithi191 bash[24992]: cluster 2024-08-31T06:35:15.855458+0000 mgr.a (mgr.14388) 11417 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:35:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:16 smithi163 bash[24253]: cluster 2024-08-31T06:35:15.855458+0000 mgr.a (mgr.14388) 11417 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:35:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:16 smithi027 bash[22610]: cluster 2024-08-31T06:35:15.855458+0000 mgr.a (mgr.14388) 11417 : cluster [DBG] pgmap v7914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:35:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:18 smithi191 bash[24992]: cluster 2024-08-31T06:35:17.856275+0000 mgr.a (mgr.14388) 11418 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:35:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:18 smithi163 bash[24253]: cluster 2024-08-31T06:35:17.856275+0000 mgr.a (mgr.14388) 11418 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:35:19.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:19.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:19.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:35:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:18 smithi027 bash[22610]: cluster 2024-08-31T06:35:17.856275+0000 mgr.a (mgr.14388) 11418 : cluster [DBG] pgmap v7915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:35:20.245 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:35:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:35:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:35:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:35:20.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:35:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:20 smithi191 bash[24992]: audit 2024-08-31T06:35:19.797891+0000 mgr.a (mgr.14388) 11419 : audit [DBG] from='client.251079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:20 smithi191 bash[24992]: cluster 2024-08-31T06:35:19.859317+0000 mgr.a (mgr.14388) 11420 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:20 smithi163 bash[24253]: audit 2024-08-31T06:35:19.797891+0000 mgr.a (mgr.14388) 11419 : audit [DBG] from='client.251079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:21.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:20 smithi163 bash[24253]: cluster 2024-08-31T06:35:19.859317+0000 mgr.a (mgr.14388) 11420 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:20 smithi027 bash[22610]: audit 2024-08-31T06:35:19.797891+0000 mgr.a (mgr.14388) 11419 : audit [DBG] from='client.251079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:20 smithi027 bash[22610]: cluster 2024-08-31T06:35:19.859317+0000 mgr.a (mgr.14388) 11420 : cluster [DBG] pgmap v7916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:23 smithi191 bash[24992]: cluster 2024-08-31T06:35:21.860240+0000 mgr.a (mgr.14388) 11421 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:23 smithi163 bash[24253]: cluster 2024-08-31T06:35:21.860240+0000 mgr.a (mgr.14388) 11421 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:23 smithi027 bash[22610]: cluster 2024-08-31T06:35:21.860240+0000 mgr.a (mgr.14388) 11421 : cluster [DBG] pgmap v7917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:25.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:25.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:35:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:25 smithi191 bash[24992]: cluster 2024-08-31T06:35:23.862470+0000 mgr.a (mgr.14388) 11422 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:25 smithi163 bash[24253]: cluster 2024-08-31T06:35:23.862470+0000 mgr.a (mgr.14388) 11422 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:25 smithi027 bash[22610]: cluster 2024-08-31T06:35:23.862470+0000 mgr.a (mgr.14388) 11422 : cluster [DBG] pgmap v7918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:26.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:35:26.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:35:26.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:35:26.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:35:26.021 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:35:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:27 smithi191 bash[24992]: audit 2024-08-31T06:35:25.583443+0000 mgr.a (mgr.14388) 11423 : audit [DBG] from='client.251154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:27 smithi191 bash[24992]: cluster 2024-08-31T06:35:25.863045+0000 mgr.a (mgr.14388) 11424 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:27 smithi163 bash[24253]: audit 2024-08-31T06:35:25.583443+0000 mgr.a (mgr.14388) 11423 : audit [DBG] from='client.251154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:27.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:27 smithi163 bash[24253]: cluster 2024-08-31T06:35:25.863045+0000 mgr.a (mgr.14388) 11424 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:27 smithi027 bash[22610]: audit 2024-08-31T06:35:25.583443+0000 mgr.a (mgr.14388) 11423 : audit [DBG] from='client.251154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:27 smithi027 bash[22610]: cluster 2024-08-31T06:35:25.863045+0000 mgr.a (mgr.14388) 11424 : cluster [DBG] pgmap v7919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:29 smithi191 bash[24992]: cluster 2024-08-31T06:35:27.863918+0000 mgr.a (mgr.14388) 11425 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:29 smithi163 bash[24253]: cluster 2024-08-31T06:35:27.863918+0000 mgr.a (mgr.14388) 11425 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:29 smithi027 bash[22610]: cluster 2024-08-31T06:35:27.863918+0000 mgr.a (mgr.14388) 11425 : cluster [DBG] pgmap v7920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:31.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:31.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:31.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:35:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:31 smithi191 bash[24992]: cluster 2024-08-31T06:35:29.866160+0000 mgr.a (mgr.14388) 11426 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:31 smithi163 bash[24253]: cluster 2024-08-31T06:35:29.866160+0000 mgr.a (mgr.14388) 11426 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:31 smithi027 bash[22610]: cluster 2024-08-31T06:35:29.866160+0000 mgr.a (mgr.14388) 11426 : cluster [DBG] pgmap v7921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:31.773 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:35:31.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:35:31.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:35:31.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:35:31.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:35:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:33 smithi191 bash[24992]: audit 2024-08-31T06:35:31.354591+0000 mgr.a (mgr.14388) 11427 : audit [DBG] from='client.251229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:33 smithi191 bash[24992]: cluster 2024-08-31T06:35:31.867127+0000 mgr.a (mgr.14388) 11428 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:33 smithi163 bash[24253]: audit 2024-08-31T06:35:31.354591+0000 mgr.a (mgr.14388) 11427 : audit [DBG] from='client.251229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:33.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:33 smithi163 bash[24253]: cluster 2024-08-31T06:35:31.867127+0000 mgr.a (mgr.14388) 11428 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:33 smithi027 bash[22610]: audit 2024-08-31T06:35:31.354591+0000 mgr.a (mgr.14388) 11427 : audit [DBG] from='client.251229 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:33 smithi027 bash[22610]: cluster 2024-08-31T06:35:31.867127+0000 mgr.a (mgr.14388) 11428 : cluster [DBG] pgmap v7922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:35 smithi191 bash[24992]: cluster 2024-08-31T06:35:33.869352+0000 mgr.a (mgr.14388) 11429 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:35 smithi163 bash[24253]: cluster 2024-08-31T06:35:33.869352+0000 mgr.a (mgr.14388) 11429 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:35 smithi027 bash[22610]: cluster 2024-08-31T06:35:33.869352+0000 mgr.a (mgr.14388) 11429 : cluster [DBG] pgmap v7923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:36.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:36.775 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:36.775 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:35:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:37 smithi191 bash[24992]: cluster 2024-08-31T06:35:35.870132+0000 mgr.a (mgr.14388) 11430 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:37 smithi163 bash[24253]: cluster 2024-08-31T06:35:35.870132+0000 mgr.a (mgr.14388) 11430 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:37 smithi027 bash[22610]: cluster 2024-08-31T06:35:35.870132+0000 mgr.a (mgr.14388) 11430 : cluster [DBG] pgmap v7924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:37.557 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:35:37.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:35:37.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:35:37.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:35:37.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:35:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:38 smithi163 bash[24253]: audit 2024-08-31T06:35:37.114945+0000 mgr.a (mgr.14388) 11431 : audit [DBG] from='client.251307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:38 smithi027 bash[22610]: audit 2024-08-31T06:35:37.114945+0000 mgr.a (mgr.14388) 11431 : audit [DBG] from='client.251307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:38 smithi191 bash[24992]: audit 2024-08-31T06:35:37.114945+0000 mgr.a (mgr.14388) 11431 : audit [DBG] from='client.251307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:39 smithi163 bash[24253]: cluster 2024-08-31T06:35:37.871097+0000 mgr.a (mgr.14388) 11432 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:39 smithi163 bash[24253]: audit 2024-08-31T06:35:39.027486+0000 mon.a (mon.0) 2287 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:35:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:39 smithi027 bash[22610]: cluster 2024-08-31T06:35:37.871097+0000 mgr.a (mgr.14388) 11432 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:39 smithi027 bash[22610]: audit 2024-08-31T06:35:39.027486+0000 mon.a (mon.0) 2287 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:35:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:39 smithi191 bash[24992]: cluster 2024-08-31T06:35:37.871097+0000 mgr.a (mgr.14388) 11432 : cluster [DBG] pgmap v7925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:39 smithi191 bash[24992]: audit 2024-08-31T06:35:39.027486+0000 mon.a (mon.0) 2287 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:35:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:40 smithi163 bash[24253]: audit 2024-08-31T06:35:39.892916+0000 mon.a (mon.0) 2288 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:35:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:40 smithi163 bash[24253]: audit 2024-08-31T06:35:39.894865+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:35:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:40 smithi163 bash[24253]: audit 2024-08-31T06:35:39.905664+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:35:40.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:40 smithi163 bash[24253]: audit 2024-08-31T06:35:39.911048+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:35:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:40 smithi027 bash[22610]: audit 2024-08-31T06:35:39.892916+0000 mon.a (mon.0) 2288 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:35:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:40 smithi027 bash[22610]: audit 2024-08-31T06:35:39.894865+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:35:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:40 smithi027 bash[22610]: audit 2024-08-31T06:35:39.905664+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:35:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:40 smithi027 bash[22610]: audit 2024-08-31T06:35:39.911048+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:35:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:40 smithi191 bash[24992]: audit 2024-08-31T06:35:39.892916+0000 mon.a (mon.0) 2288 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:35:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:40 smithi191 bash[24992]: audit 2024-08-31T06:35:39.894865+0000 mon.a (mon.0) 2289 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:35:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:40 smithi191 bash[24992]: audit 2024-08-31T06:35:39.905664+0000 mon.a (mon.0) 2290 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:35:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:40 smithi191 bash[24992]: audit 2024-08-31T06:35:39.911048+0000 mon.a (mon.0) 2291 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:35:40.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:35:40 smithi027 bash[22863]: debug 2024-08-31T06:35:40.647+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:35:40.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:35:40 smithi027 bash[22863]: debug 2024-08-31T06:35:40.651+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:35:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:41 smithi163 bash[24253]: cluster 2024-08-31T06:35:39.873242+0000 mgr.a (mgr.14388) 11433 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:41.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:41 smithi163 bash[24253]: audit 2024-08-31T06:35:39.913310+0000 mgr.a (mgr.14388) 11434 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:35:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:41 smithi027 bash[22610]: cluster 2024-08-31T06:35:39.873242+0000 mgr.a (mgr.14388) 11433 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:41 smithi027 bash[22610]: audit 2024-08-31T06:35:39.913310+0000 mgr.a (mgr.14388) 11434 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:35:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:41 smithi191 bash[24992]: cluster 2024-08-31T06:35:39.873242+0000 mgr.a (mgr.14388) 11433 : cluster [DBG] pgmap v7926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:35:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:41 smithi191 bash[24992]: audit 2024-08-31T06:35:39.913310+0000 mgr.a (mgr.14388) 11434 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:35:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:42 smithi163 bash[24253]: audit 2024-08-31T06:35:40.653335+0000 mgr.a (mgr.14388) 11435 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:35:42.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:42 smithi163 bash[24253]: cephadm 2024-08-31T06:35:40.654780+0000 mgr.a (mgr.14388) 11436 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:35:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:42 smithi027 bash[22610]: audit 2024-08-31T06:35:40.653335+0000 mgr.a (mgr.14388) 11435 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:35:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:42 smithi027 bash[22610]: cephadm 2024-08-31T06:35:40.654780+0000 mgr.a (mgr.14388) 11436 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:35:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:42 smithi191 bash[24992]: audit 2024-08-31T06:35:40.653335+0000 mgr.a (mgr.14388) 11435 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:35:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:42 smithi191 bash[24992]: cephadm 2024-08-31T06:35:40.654780+0000 mgr.a (mgr.14388) 11436 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:35:42.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:42.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:42.560 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:35:43.318 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:35:43.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:35:43.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:35:43.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:35:43.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:35:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:43 smithi163 bash[24253]: cluster 2024-08-31T06:35:41.874250+0000 mgr.a (mgr.14388) 11437 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:43 smithi027 bash[22610]: cluster 2024-08-31T06:35:41.874250+0000 mgr.a (mgr.14388) 11437 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:43 smithi191 bash[24992]: cluster 2024-08-31T06:35:41.874250+0000 mgr.a (mgr.14388) 11437 : cluster [DBG] pgmap v7927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:44 smithi163 bash[24253]: audit 2024-08-31T06:35:42.893099+0000 mgr.a (mgr.14388) 11438 : audit [DBG] from='client.251490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:44 smithi027 bash[22610]: audit 2024-08-31T06:35:42.893099+0000 mgr.a (mgr.14388) 11438 : audit [DBG] from='client.251490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:44 smithi191 bash[24992]: audit 2024-08-31T06:35:42.893099+0000 mgr.a (mgr.14388) 11438 : audit [DBG] from='client.251490 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:45 smithi163 bash[24253]: cluster 2024-08-31T06:35:43.877123+0000 mgr.a (mgr.14388) 11439 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:35:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:45 smithi027 bash[22610]: cluster 2024-08-31T06:35:43.877123+0000 mgr.a (mgr.14388) 11439 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:35:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:45 smithi191 bash[24992]: cluster 2024-08-31T06:35:43.877123+0000 mgr.a (mgr.14388) 11439 : cluster [DBG] pgmap v7928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:35:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:47 smithi163 bash[24253]: cluster 2024-08-31T06:35:45.878156+0000 mgr.a (mgr.14388) 11440 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:35:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:47 smithi027 bash[22610]: cluster 2024-08-31T06:35:45.878156+0000 mgr.a (mgr.14388) 11440 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:35:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:47 smithi191 bash[24992]: cluster 2024-08-31T06:35:45.878156+0000 mgr.a (mgr.14388) 11440 : cluster [DBG] pgmap v7929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:35:48.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:48.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:48.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:35:49.081 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:35:49.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:35:49.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:35:49.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:35:49.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:35:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:49 smithi163 bash[24253]: cluster 2024-08-31T06:35:47.879105+0000 mgr.a (mgr.14388) 11441 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:35:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:49 smithi027 bash[22610]: cluster 2024-08-31T06:35:47.879105+0000 mgr.a (mgr.14388) 11441 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:35:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:49 smithi191 bash[24992]: cluster 2024-08-31T06:35:47.879105+0000 mgr.a (mgr.14388) 11441 : cluster [DBG] pgmap v7930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:35:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:50 smithi163 bash[24253]: audit 2024-08-31T06:35:48.655149+0000 mgr.a (mgr.14388) 11442 : audit [DBG] from='client.251568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:50 smithi027 bash[22610]: audit 2024-08-31T06:35:48.655149+0000 mgr.a (mgr.14388) 11442 : audit [DBG] from='client.251568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:50 smithi191 bash[24992]: audit 2024-08-31T06:35:48.655149+0000 mgr.a (mgr.14388) 11442 : audit [DBG] from='client.251568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:51 smithi163 bash[24253]: cluster 2024-08-31T06:35:49.881998+0000 mgr.a (mgr.14388) 11443 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:35:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:51 smithi027 bash[22610]: cluster 2024-08-31T06:35:49.881998+0000 mgr.a (mgr.14388) 11443 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:35:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:51 smithi191 bash[24992]: cluster 2024-08-31T06:35:49.881998+0000 mgr.a (mgr.14388) 11443 : cluster [DBG] pgmap v7931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:35:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:53 smithi163 bash[24253]: cluster 2024-08-31T06:35:51.882880+0000 mgr.a (mgr.14388) 11444 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:35:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:53 smithi027 bash[22610]: cluster 2024-08-31T06:35:51.882880+0000 mgr.a (mgr.14388) 11444 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:35:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:53 smithi191 bash[24992]: cluster 2024-08-31T06:35:51.882880+0000 mgr.a (mgr.14388) 11444 : cluster [DBG] pgmap v7932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:35:54.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:54.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:54.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:35:54.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:35:54.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:35:54.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:35:54.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:35:54.829 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:35:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:55 smithi163 bash[24253]: cluster 2024-08-31T06:35:53.884828+0000 mgr.a (mgr.14388) 11445 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:35:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:55 smithi027 bash[22610]: cluster 2024-08-31T06:35:53.884828+0000 mgr.a (mgr.14388) 11445 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:35:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:55 smithi191 bash[24992]: cluster 2024-08-31T06:35:53.884828+0000 mgr.a (mgr.14388) 11445 : cluster [DBG] pgmap v7933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:35:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:56 smithi163 bash[24253]: audit 2024-08-31T06:35:54.412050+0000 mgr.a (mgr.14388) 11446 : audit [DBG] from='client.251646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:56 smithi027 bash[22610]: audit 2024-08-31T06:35:54.412050+0000 mgr.a (mgr.14388) 11446 : audit [DBG] from='client.251646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:56 smithi191 bash[24992]: audit 2024-08-31T06:35:54.412050+0000 mgr.a (mgr.14388) 11446 : audit [DBG] from='client.251646 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:35:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:57 smithi163 bash[24253]: cluster 2024-08-31T06:35:55.885739+0000 mgr.a (mgr.14388) 11447 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:57 smithi027 bash[22610]: cluster 2024-08-31T06:35:55.885739+0000 mgr.a (mgr.14388) 11447 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:57 smithi191 bash[24992]: cluster 2024-08-31T06:35:55.885739+0000 mgr.a (mgr.14388) 11447 : cluster [DBG] pgmap v7934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:35:59 smithi163 bash[24253]: cluster 2024-08-31T06:35:57.886512+0000 mgr.a (mgr.14388) 11448 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:35:59 smithi027 bash[22610]: cluster 2024-08-31T06:35:57.886512+0000 mgr.a (mgr.14388) 11448 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:35:59 smithi191 bash[24992]: cluster 2024-08-31T06:35:57.886512+0000 mgr.a (mgr.14388) 11448 : cluster [DBG] pgmap v7935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:35:59.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:35:59.831 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:35:59.831 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:00.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:00.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:00.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:00.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:00.609 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:01 smithi163 bash[24253]: cluster 2024-08-31T06:35:59.888712+0000 mgr.a (mgr.14388) 11449 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:01.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:01 smithi163 bash[24253]: audit 2024-08-31T06:36:00.172888+0000 mgr.a (mgr.14388) 11450 : audit [DBG] from='client.251724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:01 smithi027 bash[22610]: cluster 2024-08-31T06:35:59.888712+0000 mgr.a (mgr.14388) 11449 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:01 smithi027 bash[22610]: audit 2024-08-31T06:36:00.172888+0000 mgr.a (mgr.14388) 11450 : audit [DBG] from='client.251724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:01 smithi191 bash[24992]: cluster 2024-08-31T06:35:59.888712+0000 mgr.a (mgr.14388) 11449 : cluster [DBG] pgmap v7936: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:01 smithi191 bash[24992]: audit 2024-08-31T06:36:00.172888+0000 mgr.a (mgr.14388) 11450 : audit [DBG] from='client.251724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:03 smithi163 bash[24253]: cluster 2024-08-31T06:36:01.889602+0000 mgr.a (mgr.14388) 11451 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:03 smithi027 bash[22610]: cluster 2024-08-31T06:36:01.889602+0000 mgr.a (mgr.14388) 11451 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:03 smithi191 bash[24992]: cluster 2024-08-31T06:36:01.889602+0000 mgr.a (mgr.14388) 11451 : cluster [DBG] pgmap v7937: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:05 smithi163 bash[24253]: cluster 2024-08-31T06:36:03.891874+0000 mgr.a (mgr.14388) 11452 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:05 smithi027 bash[22610]: cluster 2024-08-31T06:36:03.891874+0000 mgr.a (mgr.14388) 11452 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:05 smithi191 bash[24992]: cluster 2024-08-31T06:36:03.891874+0000 mgr.a (mgr.14388) 11452 : cluster [DBG] pgmap v7938: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:05.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:36:05.611 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:36:05.611 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:06.356 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:06.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:07 smithi163 bash[24253]: cluster 2024-08-31T06:36:05.892579+0000 mgr.a (mgr.14388) 11453 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:07 smithi163 bash[24253]: audit 2024-08-31T06:36:05.943943+0000 mgr.a (mgr.14388) 11454 : audit [DBG] from='client.251802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:07 smithi027 bash[22610]: cluster 2024-08-31T06:36:05.892579+0000 mgr.a (mgr.14388) 11453 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:07 smithi027 bash[22610]: audit 2024-08-31T06:36:05.943943+0000 mgr.a (mgr.14388) 11454 : audit [DBG] from='client.251802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:07 smithi191 bash[24992]: cluster 2024-08-31T06:36:05.892579+0000 mgr.a (mgr.14388) 11453 : cluster [DBG] pgmap v7939: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:07 smithi191 bash[24992]: audit 2024-08-31T06:36:05.943943+0000 mgr.a (mgr.14388) 11454 : audit [DBG] from='client.251802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:09 smithi163 bash[24253]: cluster 2024-08-31T06:36:07.893461+0000 mgr.a (mgr.14388) 11455 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:09 smithi027 bash[22610]: cluster 2024-08-31T06:36:07.893461+0000 mgr.a (mgr.14388) 11455 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:09 smithi191 bash[24992]: cluster 2024-08-31T06:36:07.893461+0000 mgr.a (mgr.14388) 11455 : cluster [DBG] pgmap v7940: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:11.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:36:11.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:36:11.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:11 smithi163 bash[24253]: cluster 2024-08-31T06:36:09.895754+0000 mgr.a (mgr.14388) 11456 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:11 smithi027 bash[22610]: cluster 2024-08-31T06:36:09.895754+0000 mgr.a (mgr.14388) 11456 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:11 smithi191 bash[24992]: cluster 2024-08-31T06:36:09.895754+0000 mgr.a (mgr.14388) 11456 : cluster [DBG] pgmap v7941: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:12.120 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:12.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:12.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:12.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:12.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:13 smithi163 bash[24253]: audit 2024-08-31T06:36:11.683875+0000 mgr.a (mgr.14388) 11457 : audit [DBG] from='client.251877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:13.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:13 smithi163 bash[24253]: cluster 2024-08-31T06:36:11.896258+0000 mgr.a (mgr.14388) 11458 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:13 smithi027 bash[22610]: audit 2024-08-31T06:36:11.683875+0000 mgr.a (mgr.14388) 11457 : audit [DBG] from='client.251877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:13 smithi027 bash[22610]: cluster 2024-08-31T06:36:11.896258+0000 mgr.a (mgr.14388) 11458 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:13 smithi191 bash[24992]: audit 2024-08-31T06:36:11.683875+0000 mgr.a (mgr.14388) 11457 : audit [DBG] from='client.251877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:13 smithi191 bash[24992]: cluster 2024-08-31T06:36:11.896258+0000 mgr.a (mgr.14388) 11458 : cluster [DBG] pgmap v7942: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:15 smithi163 bash[24253]: cluster 2024-08-31T06:36:13.898504+0000 mgr.a (mgr.14388) 11459 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:15 smithi027 bash[22610]: cluster 2024-08-31T06:36:13.898504+0000 mgr.a (mgr.14388) 11459 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:15 smithi191 bash[24992]: cluster 2024-08-31T06:36:13.898504+0000 mgr.a (mgr.14388) 11459 : cluster [DBG] pgmap v7943: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:17.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:36:17.122 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:36:17.122 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:17 smithi163 bash[24253]: cluster 2024-08-31T06:36:15.899301+0000 mgr.a (mgr.14388) 11460 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:17 smithi027 bash[22610]: cluster 2024-08-31T06:36:15.899301+0000 mgr.a (mgr.14388) 11460 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:17 smithi191 bash[24992]: cluster 2024-08-31T06:36:15.899301+0000 mgr.a (mgr.14388) 11460 : cluster [DBG] pgmap v7944: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:17.895 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:17.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:17.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:17.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:17.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:19 smithi163 bash[24253]: audit 2024-08-31T06:36:17.463463+0000 mgr.a (mgr.14388) 11461 : audit [DBG] from='client.251952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:19 smithi163 bash[24253]: cluster 2024-08-31T06:36:17.899812+0000 mgr.a (mgr.14388) 11462 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:19 smithi027 bash[22610]: audit 2024-08-31T06:36:17.463463+0000 mgr.a (mgr.14388) 11461 : audit [DBG] from='client.251952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:19 smithi027 bash[22610]: cluster 2024-08-31T06:36:17.899812+0000 mgr.a (mgr.14388) 11462 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:19 smithi191 bash[24992]: audit 2024-08-31T06:36:17.463463+0000 mgr.a (mgr.14388) 11461 : audit [DBG] from='client.251952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:19 smithi191 bash[24992]: cluster 2024-08-31T06:36:17.899812+0000 mgr.a (mgr.14388) 11462 : cluster [DBG] pgmap v7945: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:21 smithi163 bash[24253]: cluster 2024-08-31T06:36:19.902008+0000 mgr.a (mgr.14388) 11463 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:21 smithi027 bash[22610]: cluster 2024-08-31T06:36:19.902008+0000 mgr.a (mgr.14388) 11463 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:21 smithi191 bash[24992]: cluster 2024-08-31T06:36:19.902008+0000 mgr.a (mgr.14388) 11463 : cluster [DBG] pgmap v7946: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:22.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:36:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:36:22.898 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:23 smithi163 bash[24253]: cluster 2024-08-31T06:36:21.902811+0000 mgr.a (mgr.14388) 11464 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:23 smithi027 bash[22610]: cluster 2024-08-31T06:36:21.902811+0000 mgr.a (mgr.14388) 11464 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:23 smithi191 bash[24992]: cluster 2024-08-31T06:36:21.902811+0000 mgr.a (mgr.14388) 11464 : cluster [DBG] pgmap v7947: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:23.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:23.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:23.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:23.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:23.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:24 smithi163 bash[24253]: audit 2024-08-31T06:36:23.231508+0000 mgr.a (mgr.14388) 11465 : audit [DBG] from='client.252030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:24 smithi027 bash[22610]: audit 2024-08-31T06:36:23.231508+0000 mgr.a (mgr.14388) 11465 : audit [DBG] from='client.252030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:24 smithi191 bash[24992]: audit 2024-08-31T06:36:23.231508+0000 mgr.a (mgr.14388) 11465 : audit [DBG] from='client.252030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:25 smithi163 bash[24253]: cluster 2024-08-31T06:36:23.905474+0000 mgr.a (mgr.14388) 11466 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:25 smithi027 bash[22610]: cluster 2024-08-31T06:36:23.905474+0000 mgr.a (mgr.14388) 11466 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:25 smithi191 bash[24992]: cluster 2024-08-31T06:36:23.905474+0000 mgr.a (mgr.14388) 11466 : cluster [DBG] pgmap v7948: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:27 smithi163 bash[24253]: cluster 2024-08-31T06:36:25.906398+0000 mgr.a (mgr.14388) 11467 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:36:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:27 smithi027 bash[22610]: cluster 2024-08-31T06:36:25.906398+0000 mgr.a (mgr.14388) 11467 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:36:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:27 smithi191 bash[24992]: cluster 2024-08-31T06:36:25.906398+0000 mgr.a (mgr.14388) 11467 : cluster [DBG] pgmap v7949: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:36:28.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:36:28.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:36:28.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:29.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:29 smithi163 bash[24253]: cluster 2024-08-31T06:36:27.907362+0000 mgr.a (mgr.14388) 11468 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:36:29.452 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:29.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:29.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:29.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:29.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:29.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:29 smithi027 bash[22610]: cluster 2024-08-31T06:36:27.907362+0000 mgr.a (mgr.14388) 11468 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:36:29.543 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:29 smithi191 bash[24992]: cluster 2024-08-31T06:36:27.907362+0000 mgr.a (mgr.14388) 11468 : cluster [DBG] pgmap v7950: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:36:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:30 smithi027 bash[22610]: audit 2024-08-31T06:36:29.007964+0000 mgr.a (mgr.14388) 11469 : audit [DBG] from='client.252108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:30 smithi191 bash[24992]: audit 2024-08-31T06:36:29.007964+0000 mgr.a (mgr.14388) 11469 : audit [DBG] from='client.252108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:30 smithi163 bash[24253]: audit 2024-08-31T06:36:29.007964+0000 mgr.a (mgr.14388) 11469 : audit [DBG] from='client.252108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:31 smithi027 bash[22610]: cluster 2024-08-31T06:36:29.910248+0000 mgr.a (mgr.14388) 11470 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:31 smithi191 bash[24992]: cluster 2024-08-31T06:36:29.910248+0000 mgr.a (mgr.14388) 11470 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:31 smithi163 bash[24253]: cluster 2024-08-31T06:36:29.910248+0000 mgr.a (mgr.14388) 11470 : cluster [DBG] pgmap v7951: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:33 smithi027 bash[22610]: cluster 2024-08-31T06:36:31.911195+0000 mgr.a (mgr.14388) 11471 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:36:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:33 smithi191 bash[24992]: cluster 2024-08-31T06:36:31.911195+0000 mgr.a (mgr.14388) 11471 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:36:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:33 smithi163 bash[24253]: cluster 2024-08-31T06:36:31.911195+0000 mgr.a (mgr.14388) 11471 : cluster [DBG] pgmap v7952: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:36:34.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:36:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:36:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:35.241 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:35.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:35.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:35.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:35.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:35 smithi027 bash[22610]: cluster 2024-08-31T06:36:33.913359+0000 mgr.a (mgr.14388) 11472 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:35 smithi191 bash[24992]: cluster 2024-08-31T06:36:33.913359+0000 mgr.a (mgr.14388) 11472 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:35 smithi163 bash[24253]: cluster 2024-08-31T06:36:33.913359+0000 mgr.a (mgr.14388) 11472 : cluster [DBG] pgmap v7953: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:36 smithi027 bash[22610]: audit 2024-08-31T06:36:34.788349+0000 mgr.a (mgr.14388) 11473 : audit [DBG] from='client.252186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:36 smithi191 bash[24992]: audit 2024-08-31T06:36:34.788349+0000 mgr.a (mgr.14388) 11473 : audit [DBG] from='client.252186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:36 smithi163 bash[24253]: audit 2024-08-31T06:36:34.788349+0000 mgr.a (mgr.14388) 11473 : audit [DBG] from='client.252186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:37 smithi027 bash[22610]: cluster 2024-08-31T06:36:35.914259+0000 mgr.a (mgr.14388) 11474 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:37 smithi191 bash[24992]: cluster 2024-08-31T06:36:35.914259+0000 mgr.a (mgr.14388) 11474 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:37 smithi163 bash[24253]: cluster 2024-08-31T06:36:35.914259+0000 mgr.a (mgr.14388) 11474 : cluster [DBG] pgmap v7954: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:39 smithi027 bash[22610]: cluster 2024-08-31T06:36:37.915658+0000 mgr.a (mgr.14388) 11475 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T06:36:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:39 smithi191 bash[24992]: cluster 2024-08-31T06:36:37.915658+0000 mgr.a (mgr.14388) 11475 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T06:36:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:39 smithi163 bash[24253]: cluster 2024-08-31T06:36:37.915658+0000 mgr.a (mgr.14388) 11475 : cluster [DBG] pgmap v7955: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T06:36:40.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:36:40.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:36:40.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:41.004 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:41.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:41.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:41.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:41.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:41 smithi191 bash[24992]: cluster 2024-08-31T06:36:39.917338+0000 mgr.a (mgr.14388) 11476 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:41 smithi191 bash[24992]: audit 2024-08-31T06:36:40.716708+0000 mon.a (mon.0) 2292 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:36:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:41 smithi163 bash[24253]: cluster 2024-08-31T06:36:39.917338+0000 mgr.a (mgr.14388) 11476 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:41 smithi163 bash[24253]: audit 2024-08-31T06:36:40.716708+0000 mon.a (mon.0) 2292 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:36:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:41 smithi027 bash[22610]: cluster 2024-08-31T06:36:39.917338+0000 mgr.a (mgr.14388) 11476 : cluster [DBG] pgmap v7956: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:36:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:41 smithi027 bash[22610]: audit 2024-08-31T06:36:40.716708+0000 mon.a (mon.0) 2292 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:36:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:42 smithi191 bash[24992]: audit 2024-08-31T06:36:40.575308+0000 mgr.a (mgr.14388) 11477 : audit [DBG] from='client.252264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:42 smithi191 bash[24992]: audit 2024-08-31T06:36:41.503594+0000 mon.a (mon.0) 2293 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:36:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:42 smithi191 bash[24992]: audit 2024-08-31T06:36:41.505760+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:36:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:42 smithi191 bash[24992]: audit 2024-08-31T06:36:41.514817+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:36:42.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:42 smithi191 bash[24992]: audit 2024-08-31T06:36:41.520096+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:36:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:42 smithi163 bash[24253]: audit 2024-08-31T06:36:40.575308+0000 mgr.a (mgr.14388) 11477 : audit [DBG] from='client.252264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:42 smithi163 bash[24253]: audit 2024-08-31T06:36:41.503594+0000 mon.a (mon.0) 2293 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:36:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:42 smithi163 bash[24253]: audit 2024-08-31T06:36:41.505760+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:36:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:42 smithi163 bash[24253]: audit 2024-08-31T06:36:41.514817+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:36:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:42 smithi163 bash[24253]: audit 2024-08-31T06:36:41.520096+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:36:42.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:36:42 smithi027 bash[22863]: debug 2024-08-31T06:36:42.238+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:36:42.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:36:42 smithi027 bash[22863]: debug 2024-08-31T06:36:42.238+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:36:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:42 smithi027 bash[22610]: audit 2024-08-31T06:36:40.575308+0000 mgr.a (mgr.14388) 11477 : audit [DBG] from='client.252264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:42 smithi027 bash[22610]: audit 2024-08-31T06:36:41.503594+0000 mon.a (mon.0) 2293 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:36:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:42 smithi027 bash[22610]: audit 2024-08-31T06:36:41.505760+0000 mon.a (mon.0) 2294 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:36:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:42 smithi027 bash[22610]: audit 2024-08-31T06:36:41.514817+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:36:42.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:42 smithi027 bash[22610]: audit 2024-08-31T06:36:41.520096+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:36:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:43 smithi191 bash[24992]: audit 2024-08-31T06:36:41.522527+0000 mgr.a (mgr.14388) 11478 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:36:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:43 smithi191 bash[24992]: cluster 2024-08-31T06:36:41.917950+0000 mgr.a (mgr.14388) 11479 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:43 smithi191 bash[24992]: audit 2024-08-31T06:36:42.240279+0000 mgr.a (mgr.14388) 11480 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:36:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:43 smithi191 bash[24992]: cephadm 2024-08-31T06:36:42.241376+0000 mgr.a (mgr.14388) 11481 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:36:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:43 smithi163 bash[24253]: audit 2024-08-31T06:36:41.522527+0000 mgr.a (mgr.14388) 11478 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:36:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:43 smithi163 bash[24253]: cluster 2024-08-31T06:36:41.917950+0000 mgr.a (mgr.14388) 11479 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:43 smithi163 bash[24253]: audit 2024-08-31T06:36:42.240279+0000 mgr.a (mgr.14388) 11480 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:36:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:43 smithi163 bash[24253]: cephadm 2024-08-31T06:36:42.241376+0000 mgr.a (mgr.14388) 11481 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:36:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:43 smithi027 bash[22610]: audit 2024-08-31T06:36:41.522527+0000 mgr.a (mgr.14388) 11478 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:36:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:43 smithi027 bash[22610]: cluster 2024-08-31T06:36:41.917950+0000 mgr.a (mgr.14388) 11479 : cluster [DBG] pgmap v7957: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:43 smithi027 bash[22610]: audit 2024-08-31T06:36:42.240279+0000 mgr.a (mgr.14388) 11480 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:36:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:43 smithi027 bash[22610]: cephadm 2024-08-31T06:36:42.241376+0000 mgr.a (mgr.14388) 11481 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:36:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:45 smithi191 bash[24992]: cluster 2024-08-31T06:36:43.920261+0000 mgr.a (mgr.14388) 11482 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:45 smithi163 bash[24253]: cluster 2024-08-31T06:36:43.920261+0000 mgr.a (mgr.14388) 11482 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:45 smithi027 bash[22610]: cluster 2024-08-31T06:36:43.920261+0000 mgr.a (mgr.14388) 11482 : cluster [DBG] pgmap v7958: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:46.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:36:46.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:36:46.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:46.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:46.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:46.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:46.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:46.755 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:47.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:47 smithi191 bash[24992]: cluster 2024-08-31T06:36:45.921047+0000 mgr.a (mgr.14388) 11483 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:47.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:47 smithi191 bash[24992]: audit 2024-08-31T06:36:46.337117+0000 mgr.a (mgr.14388) 11484 : audit [DBG] from='client.252447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:47 smithi163 bash[24253]: cluster 2024-08-31T06:36:45.921047+0000 mgr.a (mgr.14388) 11483 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:47 smithi163 bash[24253]: audit 2024-08-31T06:36:46.337117+0000 mgr.a (mgr.14388) 11484 : audit [DBG] from='client.252447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:47 smithi027 bash[22610]: cluster 2024-08-31T06:36:45.921047+0000 mgr.a (mgr.14388) 11483 : cluster [DBG] pgmap v7959: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:47 smithi027 bash[22610]: audit 2024-08-31T06:36:46.337117+0000 mgr.a (mgr.14388) 11484 : audit [DBG] from='client.252447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:49 smithi191 bash[24992]: cluster 2024-08-31T06:36:47.922489+0000 mgr.a (mgr.14388) 11485 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:49 smithi163 bash[24253]: cluster 2024-08-31T06:36:47.922489+0000 mgr.a (mgr.14388) 11485 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:49 smithi027 bash[22610]: cluster 2024-08-31T06:36:47.922489+0000 mgr.a (mgr.14388) 11485 : cluster [DBG] pgmap v7960: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:51 smithi191 bash[24992]: cluster 2024-08-31T06:36:49.924145+0000 mgr.a (mgr.14388) 11486 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:51 smithi163 bash[24253]: cluster 2024-08-31T06:36:49.924145+0000 mgr.a (mgr.14388) 11486 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:51 smithi027 bash[22610]: cluster 2024-08-31T06:36:49.924145+0000 mgr.a (mgr.14388) 11486 : cluster [DBG] pgmap v7961: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:51.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:36:51.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:36:51.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:52.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:52.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:52.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:52.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:52.501 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:53 smithi191 bash[24992]: cluster 2024-08-31T06:36:51.924686+0000 mgr.a (mgr.14388) 11487 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:53 smithi191 bash[24992]: audit 2024-08-31T06:36:52.086360+0000 mgr.a (mgr.14388) 11488 : audit [DBG] from='client.252522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:53 smithi163 bash[24253]: cluster 2024-08-31T06:36:51.924686+0000 mgr.a (mgr.14388) 11487 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:53 smithi163 bash[24253]: audit 2024-08-31T06:36:52.086360+0000 mgr.a (mgr.14388) 11488 : audit [DBG] from='client.252522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:53 smithi027 bash[22610]: cluster 2024-08-31T06:36:51.924686+0000 mgr.a (mgr.14388) 11487 : cluster [DBG] pgmap v7962: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:53 smithi027 bash[22610]: audit 2024-08-31T06:36:52.086360+0000 mgr.a (mgr.14388) 11488 : audit [DBG] from='client.252522 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:55 smithi191 bash[24992]: cluster 2024-08-31T06:36:53.926963+0000 mgr.a (mgr.14388) 11489 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:55 smithi163 bash[24253]: cluster 2024-08-31T06:36:53.926963+0000 mgr.a (mgr.14388) 11489 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:55 smithi027 bash[22610]: cluster 2024-08-31T06:36:53.926963+0000 mgr.a (mgr.14388) 11489 : cluster [DBG] pgmap v7963: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:36:57.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:36:57.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:36:57.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:36:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:57 smithi191 bash[24992]: cluster 2024-08-31T06:36:55.927738+0000 mgr.a (mgr.14388) 11490 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:57 smithi163 bash[24253]: cluster 2024-08-31T06:36:55.927738+0000 mgr.a (mgr.14388) 11490 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:57 smithi027 bash[22610]: cluster 2024-08-31T06:36:55.927738+0000 mgr.a (mgr.14388) 11490 : cluster [DBG] pgmap v7964: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:58.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:36:58.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:36:58.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:36:58.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:36:58.271 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:36:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:59 smithi191 bash[24992]: audit 2024-08-31T06:36:57.838166+0000 mgr.a (mgr.14388) 11491 : audit [DBG] from='client.252597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:36:59 smithi191 bash[24992]: cluster 2024-08-31T06:36:57.928659+0000 mgr.a (mgr.14388) 11492 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:59 smithi163 bash[24253]: audit 2024-08-31T06:36:57.838166+0000 mgr.a (mgr.14388) 11491 : audit [DBG] from='client.252597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:36:59 smithi163 bash[24253]: cluster 2024-08-31T06:36:57.928659+0000 mgr.a (mgr.14388) 11492 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:36:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:59 smithi027 bash[22610]: audit 2024-08-31T06:36:57.838166+0000 mgr.a (mgr.14388) 11491 : audit [DBG] from='client.252597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:36:59 smithi027 bash[22610]: cluster 2024-08-31T06:36:57.928659+0000 mgr.a (mgr.14388) 11492 : cluster [DBG] pgmap v7965: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:01 smithi191 bash[24992]: cluster 2024-08-31T06:36:59.930882+0000 mgr.a (mgr.14388) 11493 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:37:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:01 smithi163 bash[24253]: cluster 2024-08-31T06:36:59.930882+0000 mgr.a (mgr.14388) 11493 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:37:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:01 smithi027 bash[22610]: cluster 2024-08-31T06:36:59.930882+0000 mgr.a (mgr.14388) 11493 : cluster [DBG] pgmap v7966: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:37:03.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:37:03.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:37:03.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:37:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:03 smithi191 bash[24992]: cluster 2024-08-31T06:37:01.931647+0000 mgr.a (mgr.14388) 11494 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:03 smithi163 bash[24253]: cluster 2024-08-31T06:37:01.931647+0000 mgr.a (mgr.14388) 11494 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:03 smithi027 bash[22610]: cluster 2024-08-31T06:37:01.931647+0000 mgr.a (mgr.14388) 11494 : cluster [DBG] pgmap v7967: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:04.042 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:37:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:37:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:37:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:37:04.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:37:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:05 smithi191 bash[24992]: audit 2024-08-31T06:37:03.611108+0000 mgr.a (mgr.14388) 11495 : audit [DBG] from='client.252675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:05 smithi191 bash[24992]: cluster 2024-08-31T06:37:03.932951+0000 mgr.a (mgr.14388) 11496 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:05 smithi163 bash[24253]: audit 2024-08-31T06:37:03.611108+0000 mgr.a (mgr.14388) 11495 : audit [DBG] from='client.252675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:05.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:05 smithi163 bash[24253]: cluster 2024-08-31T06:37:03.932951+0000 mgr.a (mgr.14388) 11496 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:05 smithi027 bash[22610]: audit 2024-08-31T06:37:03.611108+0000 mgr.a (mgr.14388) 11495 : audit [DBG] from='client.252675 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:05.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:05 smithi027 bash[22610]: cluster 2024-08-31T06:37:03.932951+0000 mgr.a (mgr.14388) 11496 : cluster [DBG] pgmap v7968: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:07 smithi163 bash[24253]: cluster 2024-08-31T06:37:05.933797+0000 mgr.a (mgr.14388) 11497 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:07 smithi027 bash[22610]: cluster 2024-08-31T06:37:05.933797+0000 mgr.a (mgr.14388) 11497 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:07 smithi191 bash[24992]: cluster 2024-08-31T06:37:05.933797+0000 mgr.a (mgr.14388) 11497 : cluster [DBG] pgmap v7969: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:09.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:37:09.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:37:09.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:37:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:09 smithi163 bash[24253]: cluster 2024-08-31T06:37:07.935193+0000 mgr.a (mgr.14388) 11498 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:37:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:09 smithi027 bash[22610]: cluster 2024-08-31T06:37:07.935193+0000 mgr.a (mgr.14388) 11498 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:37:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:09 smithi191 bash[24992]: cluster 2024-08-31T06:37:07.935193+0000 mgr.a (mgr.14388) 11498 : cluster [DBG] pgmap v7970: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:37:09.811 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:37:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:37:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:37:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:37:09.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:37:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:11 smithi163 bash[24253]: audit 2024-08-31T06:37:09.379845+0000 mgr.a (mgr.14388) 11499 : audit [DBG] from='client.252753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:11 smithi163 bash[24253]: cluster 2024-08-31T06:37:09.937459+0000 mgr.a (mgr.14388) 11500 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:11 smithi027 bash[22610]: audit 2024-08-31T06:37:09.379845+0000 mgr.a (mgr.14388) 11499 : audit [DBG] from='client.252753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:11 smithi027 bash[22610]: cluster 2024-08-31T06:37:09.937459+0000 mgr.a (mgr.14388) 11500 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:11 smithi191 bash[24992]: audit 2024-08-31T06:37:09.379845+0000 mgr.a (mgr.14388) 11499 : audit [DBG] from='client.252753 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:11 smithi191 bash[24992]: cluster 2024-08-31T06:37:09.937459+0000 mgr.a (mgr.14388) 11500 : cluster [DBG] pgmap v7971: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:13 smithi163 bash[24253]: cluster 2024-08-31T06:37:11.938304+0000 mgr.a (mgr.14388) 11501 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:13 smithi027 bash[22610]: cluster 2024-08-31T06:37:11.938304+0000 mgr.a (mgr.14388) 11501 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:13 smithi191 bash[24992]: cluster 2024-08-31T06:37:11.938304+0000 mgr.a (mgr.14388) 11501 : cluster [DBG] pgmap v7972: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:14.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:37:14.813 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:37:14.813 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:37:15.549 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:37:15.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:37:15.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:37:15.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:37:15.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:37:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:15 smithi163 bash[24253]: cluster 2024-08-31T06:37:13.940352+0000 mgr.a (mgr.14388) 11502 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:15.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:15 smithi027 bash[22610]: cluster 2024-08-31T06:37:13.940352+0000 mgr.a (mgr.14388) 11502 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:15 smithi191 bash[24992]: cluster 2024-08-31T06:37:13.940352+0000 mgr.a (mgr.14388) 11502 : cluster [DBG] pgmap v7973: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:16 smithi163 bash[24253]: audit 2024-08-31T06:37:15.144500+0000 mgr.a (mgr.14388) 11503 : audit [DBG] from='client.252831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:16 smithi027 bash[22610]: audit 2024-08-31T06:37:15.144500+0000 mgr.a (mgr.14388) 11503 : audit [DBG] from='client.252831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:16 smithi191 bash[24992]: audit 2024-08-31T06:37:15.144500+0000 mgr.a (mgr.14388) 11503 : audit [DBG] from='client.252831 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:17 smithi163 bash[24253]: cluster 2024-08-31T06:37:15.941374+0000 mgr.a (mgr.14388) 11504 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:17.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:17 smithi027 bash[22610]: cluster 2024-08-31T06:37:15.941374+0000 mgr.a (mgr.14388) 11504 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:17 smithi191 bash[24992]: cluster 2024-08-31T06:37:15.941374+0000 mgr.a (mgr.14388) 11504 : cluster [DBG] pgmap v7974: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:19 smithi163 bash[24253]: cluster 2024-08-31T06:37:17.943707+0000 mgr.a (mgr.14388) 11505 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:19 smithi027 bash[22610]: cluster 2024-08-31T06:37:17.943707+0000 mgr.a (mgr.14388) 11505 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:19 smithi191 bash[24992]: cluster 2024-08-31T06:37:17.943707+0000 mgr.a (mgr.14388) 11505 : cluster [DBG] pgmap v7975: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:20.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:37:20.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:37:20.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:37:21.305 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:37:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:37:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:37:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:37:21.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:37:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:21 smithi163 bash[24253]: cluster 2024-08-31T06:37:19.944646+0000 mgr.a (mgr.14388) 11506 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:37:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:21 smithi027 bash[22610]: cluster 2024-08-31T06:37:19.944646+0000 mgr.a (mgr.14388) 11506 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:37:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:21 smithi191 bash[24992]: cluster 2024-08-31T06:37:19.944646+0000 mgr.a (mgr.14388) 11506 : cluster [DBG] pgmap v7976: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:37:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:22 smithi163 bash[24253]: audit 2024-08-31T06:37:20.886212+0000 mgr.a (mgr.14388) 11507 : audit [DBG] from='client.252909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:22 smithi027 bash[22610]: audit 2024-08-31T06:37:20.886212+0000 mgr.a (mgr.14388) 11507 : audit [DBG] from='client.252909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:22 smithi191 bash[24992]: audit 2024-08-31T06:37:20.886212+0000 mgr.a (mgr.14388) 11507 : audit [DBG] from='client.252909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:23 smithi163 bash[24253]: cluster 2024-08-31T06:37:21.945592+0000 mgr.a (mgr.14388) 11508 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:23 smithi027 bash[22610]: cluster 2024-08-31T06:37:21.945592+0000 mgr.a (mgr.14388) 11508 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:23 smithi191 bash[24992]: cluster 2024-08-31T06:37:21.945592+0000 mgr.a (mgr.14388) 11508 : cluster [DBG] pgmap v7977: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:25 smithi163 bash[24253]: cluster 2024-08-31T06:37:23.947856+0000 mgr.a (mgr.14388) 11509 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:25 smithi027 bash[22610]: cluster 2024-08-31T06:37:23.947856+0000 mgr.a (mgr.14388) 11509 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:25 smithi191 bash[24992]: cluster 2024-08-31T06:37:23.947856+0000 mgr.a (mgr.14388) 11509 : cluster [DBG] pgmap v7978: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:26.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:37:26.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:37:26.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:37:27.079 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:37:27.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:37:27.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:37:27.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:37:27.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:37:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:27 smithi163 bash[24253]: cluster 2024-08-31T06:37:25.948621+0000 mgr.a (mgr.14388) 11510 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:27 smithi027 bash[22610]: cluster 2024-08-31T06:37:25.948621+0000 mgr.a (mgr.14388) 11510 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:27 smithi191 bash[24992]: cluster 2024-08-31T06:37:25.948621+0000 mgr.a (mgr.14388) 11510 : cluster [DBG] pgmap v7979: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:28 smithi163 bash[24253]: audit 2024-08-31T06:37:26.637520+0000 mgr.a (mgr.14388) 11511 : audit [DBG] from='client.252984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:28 smithi027 bash[22610]: audit 2024-08-31T06:37:26.637520+0000 mgr.a (mgr.14388) 11511 : audit [DBG] from='client.252984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:28 smithi191 bash[24992]: audit 2024-08-31T06:37:26.637520+0000 mgr.a (mgr.14388) 11511 : audit [DBG] from='client.252984 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:29 smithi163 bash[24253]: cluster 2024-08-31T06:37:27.950852+0000 mgr.a (mgr.14388) 11512 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:29 smithi027 bash[22610]: cluster 2024-08-31T06:37:27.950852+0000 mgr.a (mgr.14388) 11512 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:29 smithi191 bash[24992]: cluster 2024-08-31T06:37:27.950852+0000 mgr.a (mgr.14388) 11512 : cluster [DBG] pgmap v7980: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:31 smithi163 bash[24253]: cluster 2024-08-31T06:37:29.951573+0000 mgr.a (mgr.14388) 11513 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:31.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:31 smithi027 bash[22610]: cluster 2024-08-31T06:37:29.951573+0000 mgr.a (mgr.14388) 11513 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:31.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:31 smithi191 bash[24992]: cluster 2024-08-31T06:37:29.951573+0000 mgr.a (mgr.14388) 11513 : cluster [DBG] pgmap v7981: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:32.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:37:32.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:37:32.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:37:32.862 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:37:32.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:37:32.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:37:32.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:37:32.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:37:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:33 smithi163 bash[24253]: cluster 2024-08-31T06:37:31.952346+0000 mgr.a (mgr.14388) 11514 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:33 smithi027 bash[22610]: cluster 2024-08-31T06:37:31.952346+0000 mgr.a (mgr.14388) 11514 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:33 smithi191 bash[24992]: cluster 2024-08-31T06:37:31.952346+0000 mgr.a (mgr.14388) 11514 : cluster [DBG] pgmap v7982: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:34 smithi163 bash[24253]: audit 2024-08-31T06:37:32.416369+0000 mgr.a (mgr.14388) 11515 : audit [DBG] from='client.253059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:34 smithi027 bash[22610]: audit 2024-08-31T06:37:32.416369+0000 mgr.a (mgr.14388) 11515 : audit [DBG] from='client.253059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:34 smithi191 bash[24992]: audit 2024-08-31T06:37:32.416369+0000 mgr.a (mgr.14388) 11515 : audit [DBG] from='client.253059 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:35 smithi163 bash[24253]: cluster 2024-08-31T06:37:33.954694+0000 mgr.a (mgr.14388) 11516 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:35 smithi027 bash[22610]: cluster 2024-08-31T06:37:33.954694+0000 mgr.a (mgr.14388) 11516 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:35 smithi191 bash[24992]: cluster 2024-08-31T06:37:33.954694+0000 mgr.a (mgr.14388) 11516 : cluster [DBG] pgmap v7983: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:37:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:36 smithi163 bash[24253]: cluster 2024-08-31T06:37:35.955657+0000 mgr.a (mgr.14388) 11517 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:36 smithi027 bash[22610]: cluster 2024-08-31T06:37:35.955657+0000 mgr.a (mgr.14388) 11517 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:36 smithi191 bash[24992]: cluster 2024-08-31T06:37:35.955657+0000 mgr.a (mgr.14388) 11517 : cluster [DBG] pgmap v7984: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:37.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:37:37.863 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:37:37.864 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:37:38.626 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:37:38.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:37:38.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:37:38.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:37:38.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:37:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:39 smithi191 bash[24992]: cluster 2024-08-31T06:37:37.956793+0000 mgr.a (mgr.14388) 11518 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:39 smithi191 bash[24992]: audit 2024-08-31T06:37:38.196293+0000 mgr.a (mgr.14388) 11519 : audit [DBG] from='client.253134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:39 smithi163 bash[24253]: cluster 2024-08-31T06:37:37.956793+0000 mgr.a (mgr.14388) 11518 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:39 smithi163 bash[24253]: audit 2024-08-31T06:37:38.196293+0000 mgr.a (mgr.14388) 11519 : audit [DBG] from='client.253134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:39 smithi027 bash[22610]: cluster 2024-08-31T06:37:37.956793+0000 mgr.a (mgr.14388) 11518 : cluster [DBG] pgmap v7985: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:39 smithi027 bash[22610]: audit 2024-08-31T06:37:38.196293+0000 mgr.a (mgr.14388) 11519 : audit [DBG] from='client.253134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:41 smithi191 bash[24992]: cluster 2024-08-31T06:37:39.957701+0000 mgr.a (mgr.14388) 11520 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:41 smithi163 bash[24253]: cluster 2024-08-31T06:37:39.957701+0000 mgr.a (mgr.14388) 11520 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:41 smithi027 bash[22610]: cluster 2024-08-31T06:37:39.957701+0000 mgr.a (mgr.14388) 11520 : cluster [DBG] pgmap v7986: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:43 smithi191 bash[24992]: cluster 2024-08-31T06:37:41.958613+0000 mgr.a (mgr.14388) 11521 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:43 smithi191 bash[24992]: audit 2024-08-31T06:37:42.292479+0000 mon.a (mon.0) 2297 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:37:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:43 smithi163 bash[24253]: cluster 2024-08-31T06:37:41.958613+0000 mgr.a (mgr.14388) 11521 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:43 smithi163 bash[24253]: audit 2024-08-31T06:37:42.292479+0000 mon.a (mon.0) 2297 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:37:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:43 smithi027 bash[22610]: cluster 2024-08-31T06:37:41.958613+0000 mgr.a (mgr.14388) 11521 : cluster [DBG] pgmap v7987: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:37:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:43 smithi027 bash[22610]: audit 2024-08-31T06:37:42.292479+0000 mon.a (mon.0) 2297 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:37:43.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:37:43.628 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:37:43.628 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:37:44.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:37:43 smithi027 bash[22863]: debug 2024-08-31T06:37:43.876+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:37:44.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:37:43 smithi027 bash[22863]: debug 2024-08-31T06:37:43.876+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:37:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:44 smithi027 bash[22610]: audit 2024-08-31T06:37:43.122030+0000 mon.a (mon.0) 2298 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:37:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:44 smithi027 bash[22610]: audit 2024-08-31T06:37:43.123828+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:37:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:44 smithi027 bash[22610]: audit 2024-08-31T06:37:43.132219+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:37:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:44 smithi027 bash[22610]: audit 2024-08-31T06:37:43.136935+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:37:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:44 smithi027 bash[22610]: audit 2024-08-31T06:37:43.139206+0000 mgr.a (mgr.14388) 11522 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:37:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:44 smithi191 bash[24992]: audit 2024-08-31T06:37:43.122030+0000 mon.a (mon.0) 2298 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:37:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:44 smithi191 bash[24992]: audit 2024-08-31T06:37:43.123828+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:37:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:44 smithi191 bash[24992]: audit 2024-08-31T06:37:43.132219+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:37:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:44 smithi191 bash[24992]: audit 2024-08-31T06:37:43.136935+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:37:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:44 smithi191 bash[24992]: audit 2024-08-31T06:37:43.139206+0000 mgr.a (mgr.14388) 11522 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:37:44.363 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:37:44.363 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:37:44.363 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:37:44.363 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:37:44.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:37:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:44 smithi163 bash[24253]: audit 2024-08-31T06:37:43.122030+0000 mon.a (mon.0) 2298 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:37:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:44 smithi163 bash[24253]: audit 2024-08-31T06:37:43.123828+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:37:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:44 smithi163 bash[24253]: audit 2024-08-31T06:37:43.132219+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:37:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:44 smithi163 bash[24253]: audit 2024-08-31T06:37:43.136935+0000 mon.a (mon.0) 2301 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:37:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:44 smithi163 bash[24253]: audit 2024-08-31T06:37:43.139206+0000 mgr.a (mgr.14388) 11522 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:37:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:45 smithi163 bash[24253]: audit 2024-08-31T06:37:43.880100+0000 mgr.a (mgr.14388) 11523 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:37:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:45 smithi163 bash[24253]: cephadm 2024-08-31T06:37:43.881301+0000 mgr.a (mgr.14388) 11524 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:37:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:45 smithi163 bash[24253]: audit 2024-08-31T06:37:43.950459+0000 mgr.a (mgr.14388) 11525 : audit [DBG] from='client.253302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:45 smithi163 bash[24253]: cluster 2024-08-31T06:37:43.963918+0000 mgr.a (mgr.14388) 11526 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:45 smithi027 bash[22610]: audit 2024-08-31T06:37:43.880100+0000 mgr.a (mgr.14388) 11523 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:37:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:45 smithi027 bash[22610]: cephadm 2024-08-31T06:37:43.881301+0000 mgr.a (mgr.14388) 11524 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:37:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:45 smithi027 bash[22610]: audit 2024-08-31T06:37:43.950459+0000 mgr.a (mgr.14388) 11525 : audit [DBG] from='client.253302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:45 smithi027 bash[22610]: cluster 2024-08-31T06:37:43.963918+0000 mgr.a (mgr.14388) 11526 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:45 smithi191 bash[24992]: audit 2024-08-31T06:37:43.880100+0000 mgr.a (mgr.14388) 11523 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:37:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:45 smithi191 bash[24992]: cephadm 2024-08-31T06:37:43.881301+0000 mgr.a (mgr.14388) 11524 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:37:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:45 smithi191 bash[24992]: audit 2024-08-31T06:37:43.950459+0000 mgr.a (mgr.14388) 11525 : audit [DBG] from='client.253302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:45 smithi191 bash[24992]: cluster 2024-08-31T06:37:43.963918+0000 mgr.a (mgr.14388) 11526 : cluster [DBG] pgmap v7988: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:37:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:47 smithi163 bash[24253]: cluster 2024-08-31T06:37:45.964954+0000 mgr.a (mgr.14388) 11527 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:37:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:47 smithi027 bash[22610]: cluster 2024-08-31T06:37:45.964954+0000 mgr.a (mgr.14388) 11527 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:37:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:47 smithi191 bash[24992]: cluster 2024-08-31T06:37:45.964954+0000 mgr.a (mgr.14388) 11527 : cluster [DBG] pgmap v7989: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:37:49.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:37:49.365 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:37:49.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:37:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:49 smithi163 bash[24253]: cluster 2024-08-31T06:37:47.967158+0000 mgr.a (mgr.14388) 11528 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:49 smithi027 bash[22610]: cluster 2024-08-31T06:37:47.967158+0000 mgr.a (mgr.14388) 11528 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:49 smithi191 bash[24992]: cluster 2024-08-31T06:37:47.967158+0000 mgr.a (mgr.14388) 11528 : cluster [DBG] pgmap v7990: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:50.135 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:37:50.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:37:50.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:37:50.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:37:50.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:37:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:51 smithi163 bash[24253]: audit 2024-08-31T06:37:49.701822+0000 mgr.a (mgr.14388) 11529 : audit [DBG] from='client.253395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:51 smithi163 bash[24253]: cluster 2024-08-31T06:37:49.967732+0000 mgr.a (mgr.14388) 11530 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:51 smithi027 bash[22610]: audit 2024-08-31T06:37:49.701822+0000 mgr.a (mgr.14388) 11529 : audit [DBG] from='client.253395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:51 smithi027 bash[22610]: cluster 2024-08-31T06:37:49.967732+0000 mgr.a (mgr.14388) 11530 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:51 smithi191 bash[24992]: audit 2024-08-31T06:37:49.701822+0000 mgr.a (mgr.14388) 11529 : audit [DBG] from='client.253395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:51 smithi191 bash[24992]: cluster 2024-08-31T06:37:49.967732+0000 mgr.a (mgr.14388) 11530 : cluster [DBG] pgmap v7991: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:53 smithi163 bash[24253]: cluster 2024-08-31T06:37:51.968632+0000 mgr.a (mgr.14388) 11531 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:53 smithi027 bash[22610]: cluster 2024-08-31T06:37:51.968632+0000 mgr.a (mgr.14388) 11531 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:53 smithi191 bash[24992]: cluster 2024-08-31T06:37:51.968632+0000 mgr.a (mgr.14388) 11531 : cluster [DBG] pgmap v7992: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:55.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:37:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:37:55.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:37:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:55 smithi163 bash[24253]: cluster 2024-08-31T06:37:53.970909+0000 mgr.a (mgr.14388) 11532 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:55 smithi027 bash[22610]: cluster 2024-08-31T06:37:53.970909+0000 mgr.a (mgr.14388) 11532 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:55 smithi191 bash[24992]: cluster 2024-08-31T06:37:53.970909+0000 mgr.a (mgr.14388) 11532 : cluster [DBG] pgmap v7993: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:55.916 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:37:55.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:37:55.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:37:55.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:37:55.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:37:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:57 smithi163 bash[24253]: audit 2024-08-31T06:37:55.475096+0000 mgr.a (mgr.14388) 11533 : audit [DBG] from='client.253470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:57 smithi163 bash[24253]: cluster 2024-08-31T06:37:55.971765+0000 mgr.a (mgr.14388) 11534 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:57 smithi027 bash[22610]: audit 2024-08-31T06:37:55.475096+0000 mgr.a (mgr.14388) 11533 : audit [DBG] from='client.253470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:57 smithi027 bash[22610]: cluster 2024-08-31T06:37:55.971765+0000 mgr.a (mgr.14388) 11534 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:57 smithi191 bash[24992]: audit 2024-08-31T06:37:55.475096+0000 mgr.a (mgr.14388) 11533 : audit [DBG] from='client.253470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:57 smithi191 bash[24992]: cluster 2024-08-31T06:37:55.971765+0000 mgr.a (mgr.14388) 11534 : cluster [DBG] pgmap v7994: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:37:59 smithi163 bash[24253]: cluster 2024-08-31T06:37:57.973926+0000 mgr.a (mgr.14388) 11535 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:37:59 smithi027 bash[22610]: cluster 2024-08-31T06:37:57.973926+0000 mgr.a (mgr.14388) 11535 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:37:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:37:59 smithi191 bash[24992]: cluster 2024-08-31T06:37:57.973926+0000 mgr.a (mgr.14388) 11535 : cluster [DBG] pgmap v7995: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:00.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:00.918 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:00.919 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:01 smithi163 bash[24253]: cluster 2024-08-31T06:37:59.974702+0000 mgr.a (mgr.14388) 11536 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:01 smithi027 bash[22610]: cluster 2024-08-31T06:37:59.974702+0000 mgr.a (mgr.14388) 11536 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:01 smithi191 bash[24992]: cluster 2024-08-31T06:37:59.974702+0000 mgr.a (mgr.14388) 11536 : cluster [DBG] pgmap v7996: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:01.680 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:01.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:01.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:01.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:01.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:02 smithi163 bash[24253]: audit 2024-08-31T06:38:01.252159+0000 mgr.a (mgr.14388) 11537 : audit [DBG] from='client.253545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:02 smithi027 bash[22610]: audit 2024-08-31T06:38:01.252159+0000 mgr.a (mgr.14388) 11537 : audit [DBG] from='client.253545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:02 smithi191 bash[24992]: audit 2024-08-31T06:38:01.252159+0000 mgr.a (mgr.14388) 11537 : audit [DBG] from='client.253545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:03 smithi163 bash[24253]: cluster 2024-08-31T06:38:01.975814+0000 mgr.a (mgr.14388) 11538 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:03 smithi027 bash[22610]: cluster 2024-08-31T06:38:01.975814+0000 mgr.a (mgr.14388) 11538 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:03 smithi191 bash[24992]: cluster 2024-08-31T06:38:01.975814+0000 mgr.a (mgr.14388) 11538 : cluster [DBG] pgmap v7997: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:05 smithi163 bash[24253]: cluster 2024-08-31T06:38:03.978114+0000 mgr.a (mgr.14388) 11539 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:05 smithi027 bash[22610]: cluster 2024-08-31T06:38:03.978114+0000 mgr.a (mgr.14388) 11539 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:05 smithi191 bash[24992]: cluster 2024-08-31T06:38:03.978114+0000 mgr.a (mgr.14388) 11539 : cluster [DBG] pgmap v7998: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:06.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:06.683 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:06.683 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:07.449 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:07.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:07.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:07.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:07.449 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:07 smithi163 bash[24253]: cluster 2024-08-31T06:38:05.978883+0000 mgr.a (mgr.14388) 11540 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:07 smithi027 bash[22610]: cluster 2024-08-31T06:38:05.978883+0000 mgr.a (mgr.14388) 11540 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:07 smithi191 bash[24992]: cluster 2024-08-31T06:38:05.978883+0000 mgr.a (mgr.14388) 11540 : cluster [DBG] pgmap v7999: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:08 smithi163 bash[24253]: audit 2024-08-31T06:38:07.017404+0000 mgr.a (mgr.14388) 11541 : audit [DBG] from='client.253623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:08 smithi027 bash[22610]: audit 2024-08-31T06:38:07.017404+0000 mgr.a (mgr.14388) 11541 : audit [DBG] from='client.253623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:08 smithi191 bash[24992]: audit 2024-08-31T06:38:07.017404+0000 mgr.a (mgr.14388) 11541 : audit [DBG] from='client.253623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:09 smithi027 bash[22610]: cluster 2024-08-31T06:38:07.981282+0000 mgr.a (mgr.14388) 11542 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:09 smithi191 bash[24992]: cluster 2024-08-31T06:38:07.981282+0000 mgr.a (mgr.14388) 11542 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:09 smithi163 bash[24253]: cluster 2024-08-31T06:38:07.981282+0000 mgr.a (mgr.14388) 11542 : cluster [DBG] pgmap v8000: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:11 smithi027 bash[22610]: cluster 2024-08-31T06:38:09.982091+0000 mgr.a (mgr.14388) 11543 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:11 smithi191 bash[24992]: cluster 2024-08-31T06:38:09.982091+0000 mgr.a (mgr.14388) 11543 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:11 smithi163 bash[24253]: cluster 2024-08-31T06:38:09.982091+0000 mgr.a (mgr.14388) 11543 : cluster [DBG] pgmap v8001: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:12.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:12.451 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:12.451 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:13.230 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:13.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:13.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:13.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:13.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:13 smithi027 bash[22610]: cluster 2024-08-31T06:38:11.983060+0000 mgr.a (mgr.14388) 11544 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:13 smithi191 bash[24992]: cluster 2024-08-31T06:38:11.983060+0000 mgr.a (mgr.14388) 11544 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:13 smithi163 bash[24253]: cluster 2024-08-31T06:38:11.983060+0000 mgr.a (mgr.14388) 11544 : cluster [DBG] pgmap v8002: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:14 smithi027 bash[22610]: audit 2024-08-31T06:38:12.786567+0000 mgr.a (mgr.14388) 11545 : audit [DBG] from='client.253701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:14 smithi191 bash[24992]: audit 2024-08-31T06:38:12.786567+0000 mgr.a (mgr.14388) 11545 : audit [DBG] from='client.253701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:14 smithi163 bash[24253]: audit 2024-08-31T06:38:12.786567+0000 mgr.a (mgr.14388) 11545 : audit [DBG] from='client.253701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:15 smithi027 bash[22610]: cluster 2024-08-31T06:38:13.985930+0000 mgr.a (mgr.14388) 11546 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:15 smithi191 bash[24992]: cluster 2024-08-31T06:38:13.985930+0000 mgr.a (mgr.14388) 11546 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:15 smithi163 bash[24253]: cluster 2024-08-31T06:38:13.985930+0000 mgr.a (mgr.14388) 11546 : cluster [DBG] pgmap v8003: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:17 smithi027 bash[22610]: cluster 2024-08-31T06:38:15.986769+0000 mgr.a (mgr.14388) 11547 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:38:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:17 smithi191 bash[24992]: cluster 2024-08-31T06:38:15.986769+0000 mgr.a (mgr.14388) 11547 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:38:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:17 smithi163 bash[24253]: cluster 2024-08-31T06:38:15.986769+0000 mgr.a (mgr.14388) 11547 : cluster [DBG] pgmap v8004: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:38:18.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:18.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:18.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:18.992 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:18.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:18.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:18.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:18.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:19 smithi027 bash[22610]: cluster 2024-08-31T06:38:17.988710+0000 mgr.a (mgr.14388) 11548 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:19 smithi191 bash[24992]: cluster 2024-08-31T06:38:17.988710+0000 mgr.a (mgr.14388) 11548 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:19 smithi163 bash[24253]: cluster 2024-08-31T06:38:17.988710+0000 mgr.a (mgr.14388) 11548 : cluster [DBG] pgmap v8005: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:20 smithi191 bash[24992]: audit 2024-08-31T06:38:18.569387+0000 mgr.a (mgr.14388) 11549 : audit [DBG] from='client.253779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:20 smithi163 bash[24253]: audit 2024-08-31T06:38:18.569387+0000 mgr.a (mgr.14388) 11549 : audit [DBG] from='client.253779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:20.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:20 smithi027 bash[22610]: audit 2024-08-31T06:38:18.569387+0000 mgr.a (mgr.14388) 11549 : audit [DBG] from='client.253779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:21 smithi191 bash[24992]: cluster 2024-08-31T06:38:19.989659+0000 mgr.a (mgr.14388) 11550 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:38:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:21 smithi163 bash[24253]: cluster 2024-08-31T06:38:19.989659+0000 mgr.a (mgr.14388) 11550 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:38:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:21 smithi027 bash[22610]: cluster 2024-08-31T06:38:19.989659+0000 mgr.a (mgr.14388) 11550 : cluster [DBG] pgmap v8006: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:38:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:23 smithi191 bash[24992]: cluster 2024-08-31T06:38:21.990503+0000 mgr.a (mgr.14388) 11551 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:38:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:23 smithi163 bash[24253]: cluster 2024-08-31T06:38:21.990503+0000 mgr.a (mgr.14388) 11551 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:38:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:23 smithi027 bash[22610]: cluster 2024-08-31T06:38:21.990503+0000 mgr.a (mgr.14388) 11551 : cluster [DBG] pgmap v8007: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:38:23.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:23.994 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:23.994 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:24.779 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:24.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:24.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:24.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:24.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:25 smithi191 bash[24992]: cluster 2024-08-31T06:38:23.992718+0000 mgr.a (mgr.14388) 11552 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:25 smithi191 bash[24992]: audit 2024-08-31T06:38:24.327805+0000 mgr.a (mgr.14388) 11553 : audit [DBG] from='client.253854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:25 smithi163 bash[24253]: cluster 2024-08-31T06:38:23.992718+0000 mgr.a (mgr.14388) 11552 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:25 smithi163 bash[24253]: audit 2024-08-31T06:38:24.327805+0000 mgr.a (mgr.14388) 11553 : audit [DBG] from='client.253854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:25 smithi027 bash[22610]: cluster 2024-08-31T06:38:23.992718+0000 mgr.a (mgr.14388) 11552 : cluster [DBG] pgmap v8008: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:25 smithi027 bash[22610]: audit 2024-08-31T06:38:24.327805+0000 mgr.a (mgr.14388) 11553 : audit [DBG] from='client.253854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:27 smithi191 bash[24992]: cluster 2024-08-31T06:38:25.993678+0000 mgr.a (mgr.14388) 11554 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:27 smithi163 bash[24253]: cluster 2024-08-31T06:38:25.993678+0000 mgr.a (mgr.14388) 11554 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:27 smithi027 bash[22610]: cluster 2024-08-31T06:38:25.993678+0000 mgr.a (mgr.14388) 11554 : cluster [DBG] pgmap v8009: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:29.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:29 smithi191 bash[24992]: cluster 2024-08-31T06:38:27.995881+0000 mgr.a (mgr.14388) 11555 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:29 smithi163 bash[24253]: cluster 2024-08-31T06:38:27.995881+0000 mgr.a (mgr.14388) 11555 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:29 smithi027 bash[22610]: cluster 2024-08-31T06:38:27.995881+0000 mgr.a (mgr.14388) 11555 : cluster [DBG] pgmap v8010: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:29.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:29.781 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:29.782 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:30.556 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:30.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:30.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:30.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:30.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:31 smithi191 bash[24992]: cluster 2024-08-31T06:38:29.996587+0000 mgr.a (mgr.14388) 11556 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:31 smithi191 bash[24992]: audit 2024-08-31T06:38:30.118404+0000 mgr.a (mgr.14388) 11557 : audit [DBG] from='client.253929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:31 smithi163 bash[24253]: cluster 2024-08-31T06:38:29.996587+0000 mgr.a (mgr.14388) 11556 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:31 smithi163 bash[24253]: audit 2024-08-31T06:38:30.118404+0000 mgr.a (mgr.14388) 11557 : audit [DBG] from='client.253929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:31 smithi027 bash[22610]: cluster 2024-08-31T06:38:29.996587+0000 mgr.a (mgr.14388) 11556 : cluster [DBG] pgmap v8011: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:31 smithi027 bash[22610]: audit 2024-08-31T06:38:30.118404+0000 mgr.a (mgr.14388) 11557 : audit [DBG] from='client.253929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:33 smithi191 bash[24992]: cluster 2024-08-31T06:38:31.997493+0000 mgr.a (mgr.14388) 11558 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:33 smithi163 bash[24253]: cluster 2024-08-31T06:38:31.997493+0000 mgr.a (mgr.14388) 11558 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:33 smithi027 bash[22610]: cluster 2024-08-31T06:38:31.997493+0000 mgr.a (mgr.14388) 11558 : cluster [DBG] pgmap v8012: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:35 smithi191 bash[24992]: cluster 2024-08-31T06:38:33.999754+0000 mgr.a (mgr.14388) 11559 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:35.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:35.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:35.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:35 smithi163 bash[24253]: cluster 2024-08-31T06:38:33.999754+0000 mgr.a (mgr.14388) 11559 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:35 smithi027 bash[22610]: cluster 2024-08-31T06:38:33.999754+0000 mgr.a (mgr.14388) 11559 : cluster [DBG] pgmap v8013: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:36.304 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:36.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:36.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:36.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:36.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:37 smithi191 bash[24992]: audit 2024-08-31T06:38:35.884200+0000 mgr.a (mgr.14388) 11560 : audit [DBG] from='client.254007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:37 smithi191 bash[24992]: cluster 2024-08-31T06:38:36.000252+0000 mgr.a (mgr.14388) 11561 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:37 smithi163 bash[24253]: audit 2024-08-31T06:38:35.884200+0000 mgr.a (mgr.14388) 11560 : audit [DBG] from='client.254007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:37 smithi163 bash[24253]: cluster 2024-08-31T06:38:36.000252+0000 mgr.a (mgr.14388) 11561 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:37.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:37 smithi027 bash[22610]: audit 2024-08-31T06:38:35.884200+0000 mgr.a (mgr.14388) 11560 : audit [DBG] from='client.254007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:37.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:37 smithi027 bash[22610]: cluster 2024-08-31T06:38:36.000252+0000 mgr.a (mgr.14388) 11561 : cluster [DBG] pgmap v8014: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:39 smithi191 bash[24992]: cluster 2024-08-31T06:38:38.002550+0000 mgr.a (mgr.14388) 11562 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:39 smithi163 bash[24253]: cluster 2024-08-31T06:38:38.002550+0000 mgr.a (mgr.14388) 11562 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:39 smithi027 bash[22610]: cluster 2024-08-31T06:38:38.002550+0000 mgr.a (mgr.14388) 11562 : cluster [DBG] pgmap v8015: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:41.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:41.305 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:41.305 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:41 smithi191 bash[24992]: cluster 2024-08-31T06:38:40.003372+0000 mgr.a (mgr.14388) 11563 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:41 smithi163 bash[24253]: cluster 2024-08-31T06:38:40.003372+0000 mgr.a (mgr.14388) 11563 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:41 smithi027 bash[22610]: cluster 2024-08-31T06:38:40.003372+0000 mgr.a (mgr.14388) 11563 : cluster [DBG] pgmap v8016: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:42.091 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:42.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:43 smithi191 bash[24992]: audit 2024-08-31T06:38:41.643301+0000 mgr.a (mgr.14388) 11564 : audit [DBG] from='client.254085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:43 smithi191 bash[24992]: cluster 2024-08-31T06:38:42.003954+0000 mgr.a (mgr.14388) 11565 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:43 smithi163 bash[24253]: audit 2024-08-31T06:38:41.643301+0000 mgr.a (mgr.14388) 11564 : audit [DBG] from='client.254085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:43 smithi163 bash[24253]: cluster 2024-08-31T06:38:42.003954+0000 mgr.a (mgr.14388) 11565 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:43 smithi027 bash[22610]: audit 2024-08-31T06:38:41.643301+0000 mgr.a (mgr.14388) 11564 : audit [DBG] from='client.254085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:43 smithi027 bash[22610]: cluster 2024-08-31T06:38:42.003954+0000 mgr.a (mgr.14388) 11565 : cluster [DBG] pgmap v8017: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:44 smithi163 bash[24253]: audit 2024-08-31T06:38:43.930663+0000 mon.a (mon.0) 2302 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:38:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:44 smithi027 bash[22610]: audit 2024-08-31T06:38:43.930663+0000 mon.a (mon.0) 2302 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:38:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:44 smithi191 bash[24992]: audit 2024-08-31T06:38:43.930663+0000 mon.a (mon.0) 2302 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:38:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:45 smithi163 bash[24253]: cluster 2024-08-31T06:38:44.006142+0000 mgr.a (mgr.14388) 11566 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:45 smithi163 bash[24253]: audit 2024-08-31T06:38:44.553872+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:38:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:45 smithi163 bash[24253]: audit 2024-08-31T06:38:44.558428+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:38:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:45 smithi027 bash[22610]: cluster 2024-08-31T06:38:44.006142+0000 mgr.a (mgr.14388) 11566 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:45 smithi027 bash[22610]: audit 2024-08-31T06:38:44.553872+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:38:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:45 smithi027 bash[22610]: audit 2024-08-31T06:38:44.558428+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:38:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:45 smithi191 bash[24992]: cluster 2024-08-31T06:38:44.006142+0000 mgr.a (mgr.14388) 11566 : cluster [DBG] pgmap v8018: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:38:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:45 smithi191 bash[24992]: audit 2024-08-31T06:38:44.553872+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:38:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:45 smithi191 bash[24992]: audit 2024-08-31T06:38:44.558428+0000 mon.a (mon.0) 2304 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:38:46.298 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:38:46 smithi027 bash[22863]: debug 2024-08-31T06:38:46.042+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:38:46.298 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:38:46 smithi027 bash[22863]: debug 2024-08-31T06:38:46.042+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:38:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:46 smithi163 bash[24253]: audit 2024-08-31T06:38:45.310621+0000 mon.a (mon.0) 2305 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:38:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:46 smithi163 bash[24253]: audit 2024-08-31T06:38:45.311580+0000 mon.a (mon.0) 2306 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:38:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:46 smithi163 bash[24253]: audit 2024-08-31T06:38:45.316697+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:38:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:46 smithi163 bash[24253]: audit 2024-08-31T06:38:45.318696+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:38:46.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:46 smithi163 bash[24253]: audit 2024-08-31T06:38:45.319747+0000 mgr.a (mgr.14388) 11567 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:38:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:46 smithi027 bash[22610]: audit 2024-08-31T06:38:45.310621+0000 mon.a (mon.0) 2305 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:38:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:46 smithi027 bash[22610]: audit 2024-08-31T06:38:45.311580+0000 mon.a (mon.0) 2306 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:38:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:46 smithi027 bash[22610]: audit 2024-08-31T06:38:45.316697+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:38:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:46 smithi027 bash[22610]: audit 2024-08-31T06:38:45.318696+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:38:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:46 smithi027 bash[22610]: audit 2024-08-31T06:38:45.319747+0000 mgr.a (mgr.14388) 11567 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:38:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:46 smithi191 bash[24992]: audit 2024-08-31T06:38:45.310621+0000 mon.a (mon.0) 2305 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:38:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:46 smithi191 bash[24992]: audit 2024-08-31T06:38:45.311580+0000 mon.a (mon.0) 2306 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:38:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:46 smithi191 bash[24992]: audit 2024-08-31T06:38:45.316697+0000 mon.a (mon.0) 2307 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:38:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:46 smithi191 bash[24992]: audit 2024-08-31T06:38:45.318696+0000 mon.a (mon.0) 2308 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:38:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:46 smithi191 bash[24992]: audit 2024-08-31T06:38:45.319747+0000 mgr.a (mgr.14388) 11567 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:38:47.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:47.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:47.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:47 smithi163 bash[24253]: cluster 2024-08-31T06:38:46.006864+0000 mgr.a (mgr.14388) 11568 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:47 smithi163 bash[24253]: audit 2024-08-31T06:38:46.047132+0000 mgr.a (mgr.14388) 11569 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:38:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:47 smithi163 bash[24253]: cephadm 2024-08-31T06:38:46.048734+0000 mgr.a (mgr.14388) 11570 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:38:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:47 smithi027 bash[22610]: cluster 2024-08-31T06:38:46.006864+0000 mgr.a (mgr.14388) 11568 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:47 smithi027 bash[22610]: audit 2024-08-31T06:38:46.047132+0000 mgr.a (mgr.14388) 11569 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:38:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:47 smithi027 bash[22610]: cephadm 2024-08-31T06:38:46.048734+0000 mgr.a (mgr.14388) 11570 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:38:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:47 smithi191 bash[24992]: cluster 2024-08-31T06:38:46.006864+0000 mgr.a (mgr.14388) 11568 : cluster [DBG] pgmap v8019: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:38:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:47 smithi191 bash[24992]: audit 2024-08-31T06:38:46.047132+0000 mgr.a (mgr.14388) 11569 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:38:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:47 smithi191 bash[24992]: cephadm 2024-08-31T06:38:46.048734+0000 mgr.a (mgr.14388) 11570 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:38:47.864 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:47.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:47.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:49 smithi163 bash[24253]: audit 2024-08-31T06:38:47.426648+0000 mgr.a (mgr.14388) 11571 : audit [DBG] from='client.254268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:49 smithi163 bash[24253]: cluster 2024-08-31T06:38:48.009086+0000 mgr.a (mgr.14388) 11572 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:49 smithi027 bash[22610]: audit 2024-08-31T06:38:47.426648+0000 mgr.a (mgr.14388) 11571 : audit [DBG] from='client.254268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:49 smithi027 bash[22610]: cluster 2024-08-31T06:38:48.009086+0000 mgr.a (mgr.14388) 11572 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:49 smithi191 bash[24992]: audit 2024-08-31T06:38:47.426648+0000 mgr.a (mgr.14388) 11571 : audit [DBG] from='client.254268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:49 smithi191 bash[24992]: cluster 2024-08-31T06:38:48.009086+0000 mgr.a (mgr.14388) 11572 : cluster [DBG] pgmap v8020: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:51 smithi163 bash[24253]: cluster 2024-08-31T06:38:50.009880+0000 mgr.a (mgr.14388) 11573 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:51 smithi027 bash[22610]: cluster 2024-08-31T06:38:50.009880+0000 mgr.a (mgr.14388) 11573 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:51 smithi191 bash[24992]: cluster 2024-08-31T06:38:50.009880+0000 mgr.a (mgr.14388) 11573 : cluster [DBG] pgmap v8021: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:52.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:52.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:52.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:53.616 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:53.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:53.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:53.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:53.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:53 smithi163 bash[24253]: cluster 2024-08-31T06:38:52.010830+0000 mgr.a (mgr.14388) 11574 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:53 smithi027 bash[22610]: cluster 2024-08-31T06:38:52.010830+0000 mgr.a (mgr.14388) 11574 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:53 smithi191 bash[24992]: cluster 2024-08-31T06:38:52.010830+0000 mgr.a (mgr.14388) 11574 : cluster [DBG] pgmap v8022: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:54 smithi163 bash[24253]: audit 2024-08-31T06:38:53.195822+0000 mgr.a (mgr.14388) 11575 : audit [DBG] from='client.254346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:54 smithi027 bash[22610]: audit 2024-08-31T06:38:53.195822+0000 mgr.a (mgr.14388) 11575 : audit [DBG] from='client.254346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:54 smithi191 bash[24992]: audit 2024-08-31T06:38:53.195822+0000 mgr.a (mgr.14388) 11575 : audit [DBG] from='client.254346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:55 smithi163 bash[24253]: cluster 2024-08-31T06:38:54.013601+0000 mgr.a (mgr.14388) 11576 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:55 smithi027 bash[22610]: cluster 2024-08-31T06:38:54.013601+0000 mgr.a (mgr.14388) 11576 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:55 smithi191 bash[24992]: cluster 2024-08-31T06:38:54.013601+0000 mgr.a (mgr.14388) 11576 : cluster [DBG] pgmap v8023: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:57 smithi163 bash[24253]: cluster 2024-08-31T06:38:56.014408+0000 mgr.a (mgr.14388) 11577 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:38:57.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:57 smithi027 bash[22610]: cluster 2024-08-31T06:38:56.014408+0000 mgr.a (mgr.14388) 11577 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:38:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:57 smithi191 bash[24992]: cluster 2024-08-31T06:38:56.014408+0000 mgr.a (mgr.14388) 11577 : cluster [DBG] pgmap v8024: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:38:58.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:38:58.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:38:58.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:38:59.365 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:38:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:38:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:38:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:38:59.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:38:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:38:59 smithi163 bash[24253]: cluster 2024-08-31T06:38:58.016335+0000 mgr.a (mgr.14388) 11578 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:38:59 smithi027 bash[22610]: cluster 2024-08-31T06:38:58.016335+0000 mgr.a (mgr.14388) 11578 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:38:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:38:59 smithi191 bash[24992]: cluster 2024-08-31T06:38:58.016335+0000 mgr.a (mgr.14388) 11578 : cluster [DBG] pgmap v8025: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:39:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:00 smithi163 bash[24253]: audit 2024-08-31T06:38:58.949503+0000 mgr.a (mgr.14388) 11579 : audit [DBG] from='client.254424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:00 smithi027 bash[22610]: audit 2024-08-31T06:38:58.949503+0000 mgr.a (mgr.14388) 11579 : audit [DBG] from='client.254424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:00 smithi191 bash[24992]: audit 2024-08-31T06:38:58.949503+0000 mgr.a (mgr.14388) 11579 : audit [DBG] from='client.254424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:01 smithi163 bash[24253]: cluster 2024-08-31T06:39:00.017306+0000 mgr.a (mgr.14388) 11580 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:39:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:01 smithi027 bash[22610]: cluster 2024-08-31T06:39:00.017306+0000 mgr.a (mgr.14388) 11580 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:39:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:01 smithi191 bash[24992]: cluster 2024-08-31T06:39:00.017306+0000 mgr.a (mgr.14388) 11580 : cluster [DBG] pgmap v8026: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:39:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:03 smithi163 bash[24253]: cluster 2024-08-31T06:39:02.018099+0000 mgr.a (mgr.14388) 11581 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:03 smithi027 bash[22610]: cluster 2024-08-31T06:39:02.018099+0000 mgr.a (mgr.14388) 11581 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:03 smithi191 bash[24992]: cluster 2024-08-31T06:39:02.018099+0000 mgr.a (mgr.14388) 11581 : cluster [DBG] pgmap v8027: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:04.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:39:04.368 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:39:04.368 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:39:05.135 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:39:05.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:39:05.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:39:05.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:39:05.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:39:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:05 smithi163 bash[24253]: cluster 2024-08-31T06:39:04.020334+0000 mgr.a (mgr.14388) 11582 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:05 smithi027 bash[22610]: cluster 2024-08-31T06:39:04.020334+0000 mgr.a (mgr.14388) 11582 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:05 smithi191 bash[24992]: cluster 2024-08-31T06:39:04.020334+0000 mgr.a (mgr.14388) 11582 : cluster [DBG] pgmap v8028: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:06 smithi163 bash[24253]: audit 2024-08-31T06:39:04.706317+0000 mgr.a (mgr.14388) 11583 : audit [DBG] from='client.254499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:06 smithi027 bash[22610]: audit 2024-08-31T06:39:04.706317+0000 mgr.a (mgr.14388) 11583 : audit [DBG] from='client.254499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:06 smithi191 bash[24992]: audit 2024-08-31T06:39:04.706317+0000 mgr.a (mgr.14388) 11583 : audit [DBG] from='client.254499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:07 smithi163 bash[24253]: cluster 2024-08-31T06:39:06.021243+0000 mgr.a (mgr.14388) 11584 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:07 smithi027 bash[22610]: cluster 2024-08-31T06:39:06.021243+0000 mgr.a (mgr.14388) 11584 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:07 smithi191 bash[24992]: cluster 2024-08-31T06:39:06.021243+0000 mgr.a (mgr.14388) 11584 : cluster [DBG] pgmap v8029: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:09 smithi163 bash[24253]: cluster 2024-08-31T06:39:08.023436+0000 mgr.a (mgr.14388) 11585 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:09 smithi027 bash[22610]: cluster 2024-08-31T06:39:08.023436+0000 mgr.a (mgr.14388) 11585 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:09 smithi191 bash[24992]: cluster 2024-08-31T06:39:08.023436+0000 mgr.a (mgr.14388) 11585 : cluster [DBG] pgmap v8030: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:10.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:39:10.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:39:10.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:39:10.928 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:39:10.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:39:10.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:39:10.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:39:10.928 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:39:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:11 smithi163 bash[24253]: cluster 2024-08-31T06:39:10.024211+0000 mgr.a (mgr.14388) 11586 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:11 smithi027 bash[22610]: cluster 2024-08-31T06:39:10.024211+0000 mgr.a (mgr.14388) 11586 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:11 smithi191 bash[24992]: cluster 2024-08-31T06:39:10.024211+0000 mgr.a (mgr.14388) 11586 : cluster [DBG] pgmap v8031: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:12 smithi163 bash[24253]: audit 2024-08-31T06:39:10.472769+0000 mgr.a (mgr.14388) 11587 : audit [DBG] from='client.254574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:12 smithi027 bash[22610]: audit 2024-08-31T06:39:10.472769+0000 mgr.a (mgr.14388) 11587 : audit [DBG] from='client.254574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:12 smithi191 bash[24992]: audit 2024-08-31T06:39:10.472769+0000 mgr.a (mgr.14388) 11587 : audit [DBG] from='client.254574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:13 smithi163 bash[24253]: cluster 2024-08-31T06:39:12.025110+0000 mgr.a (mgr.14388) 11588 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:13 smithi027 bash[22610]: cluster 2024-08-31T06:39:12.025110+0000 mgr.a (mgr.14388) 11588 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:13 smithi191 bash[24992]: cluster 2024-08-31T06:39:12.025110+0000 mgr.a (mgr.14388) 11588 : cluster [DBG] pgmap v8032: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:14 smithi027 bash[22610]: cluster 2024-08-31T06:39:14.027348+0000 mgr.a (mgr.14388) 11589 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:14 smithi191 bash[24992]: cluster 2024-08-31T06:39:14.027348+0000 mgr.a (mgr.14388) 11589 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:14 smithi163 bash[24253]: cluster 2024-08-31T06:39:14.027348+0000 mgr.a (mgr.14388) 11589 : cluster [DBG] pgmap v8033: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:39:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:39:15.930 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:39:16.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:39:16.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:39:16.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:39:16.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:39:16.711 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:39:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:17 smithi163 bash[24253]: cluster 2024-08-31T06:39:16.028003+0000 mgr.a (mgr.14388) 11590 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:17 smithi163 bash[24253]: audit 2024-08-31T06:39:16.263751+0000 mgr.a (mgr.14388) 11591 : audit [DBG] from='client.254649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:17 smithi027 bash[22610]: cluster 2024-08-31T06:39:16.028003+0000 mgr.a (mgr.14388) 11590 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:17 smithi027 bash[22610]: audit 2024-08-31T06:39:16.263751+0000 mgr.a (mgr.14388) 11591 : audit [DBG] from='client.254649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:17 smithi191 bash[24992]: cluster 2024-08-31T06:39:16.028003+0000 mgr.a (mgr.14388) 11590 : cluster [DBG] pgmap v8034: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:17 smithi191 bash[24992]: audit 2024-08-31T06:39:16.263751+0000 mgr.a (mgr.14388) 11591 : audit [DBG] from='client.254649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:19 smithi163 bash[24253]: cluster 2024-08-31T06:39:18.030232+0000 mgr.a (mgr.14388) 11592 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:19 smithi027 bash[22610]: cluster 2024-08-31T06:39:18.030232+0000 mgr.a (mgr.14388) 11592 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:19 smithi191 bash[24992]: cluster 2024-08-31T06:39:18.030232+0000 mgr.a (mgr.14388) 11592 : cluster [DBG] pgmap v8035: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:21 smithi163 bash[24253]: cluster 2024-08-31T06:39:20.031045+0000 mgr.a (mgr.14388) 11593 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:21 smithi027 bash[22610]: cluster 2024-08-31T06:39:20.031045+0000 mgr.a (mgr.14388) 11593 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:21 smithi191 bash[24992]: cluster 2024-08-31T06:39:20.031045+0000 mgr.a (mgr.14388) 11593 : cluster [DBG] pgmap v8036: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:21.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:39:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:39:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:39:22.488 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:39:22.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:39:22.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:39:22.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:39:22.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:39:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:23 smithi163 bash[24253]: cluster 2024-08-31T06:39:22.031909+0000 mgr.a (mgr.14388) 11594 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:23.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:23 smithi163 bash[24253]: audit 2024-08-31T06:39:22.047104+0000 mgr.a (mgr.14388) 11595 : audit [DBG] from='client.254724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:23 smithi027 bash[22610]: cluster 2024-08-31T06:39:22.031909+0000 mgr.a (mgr.14388) 11594 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:23 smithi027 bash[22610]: audit 2024-08-31T06:39:22.047104+0000 mgr.a (mgr.14388) 11595 : audit [DBG] from='client.254724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:23 smithi191 bash[24992]: cluster 2024-08-31T06:39:22.031909+0000 mgr.a (mgr.14388) 11594 : cluster [DBG] pgmap v8037: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:23 smithi191 bash[24992]: audit 2024-08-31T06:39:22.047104+0000 mgr.a (mgr.14388) 11595 : audit [DBG] from='client.254724 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:25 smithi163 bash[24253]: cluster 2024-08-31T06:39:24.034301+0000 mgr.a (mgr.14388) 11596 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:25 smithi027 bash[22610]: cluster 2024-08-31T06:39:24.034301+0000 mgr.a (mgr.14388) 11596 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:25 smithi191 bash[24992]: cluster 2024-08-31T06:39:24.034301+0000 mgr.a (mgr.14388) 11596 : cluster [DBG] pgmap v8038: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:27 smithi163 bash[24253]: cluster 2024-08-31T06:39:26.035108+0000 mgr.a (mgr.14388) 11597 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:27 smithi027 bash[22610]: cluster 2024-08-31T06:39:26.035108+0000 mgr.a (mgr.14388) 11597 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:27.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:39:27.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:39:27.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:39:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:27 smithi191 bash[24992]: cluster 2024-08-31T06:39:26.035108+0000 mgr.a (mgr.14388) 11597 : cluster [DBG] pgmap v8039: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:28.243 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:39:28.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:39:28.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:39:28.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:39:28.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:39:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:29 smithi163 bash[24253]: audit 2024-08-31T06:39:27.818643+0000 mgr.a (mgr.14388) 11598 : audit [DBG] from='client.254802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:29 smithi163 bash[24253]: cluster 2024-08-31T06:39:28.036163+0000 mgr.a (mgr.14388) 11599 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:29 smithi027 bash[22610]: audit 2024-08-31T06:39:27.818643+0000 mgr.a (mgr.14388) 11598 : audit [DBG] from='client.254802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:29 smithi027 bash[22610]: cluster 2024-08-31T06:39:28.036163+0000 mgr.a (mgr.14388) 11599 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:29 smithi191 bash[24992]: audit 2024-08-31T06:39:27.818643+0000 mgr.a (mgr.14388) 11598 : audit [DBG] from='client.254802 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:29 smithi191 bash[24992]: cluster 2024-08-31T06:39:28.036163+0000 mgr.a (mgr.14388) 11599 : cluster [DBG] pgmap v8040: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:31 smithi163 bash[24253]: cluster 2024-08-31T06:39:30.037036+0000 mgr.a (mgr.14388) 11600 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:31 smithi027 bash[22610]: cluster 2024-08-31T06:39:30.037036+0000 mgr.a (mgr.14388) 11600 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:31 smithi191 bash[24992]: cluster 2024-08-31T06:39:30.037036+0000 mgr.a (mgr.14388) 11600 : cluster [DBG] pgmap v8041: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:33.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:39:33.245 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:39:33.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:39:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:33 smithi163 bash[24253]: cluster 2024-08-31T06:39:32.037877+0000 mgr.a (mgr.14388) 11601 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:33 smithi027 bash[22610]: cluster 2024-08-31T06:39:32.037877+0000 mgr.a (mgr.14388) 11601 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:33 smithi191 bash[24992]: cluster 2024-08-31T06:39:32.037877+0000 mgr.a (mgr.14388) 11601 : cluster [DBG] pgmap v8042: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:33.992 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:39:33.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:39:33.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:39:33.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:39:33.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:39:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:35 smithi163 bash[24253]: audit 2024-08-31T06:39:33.576844+0000 mgr.a (mgr.14388) 11602 : audit [DBG] from='client.254874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:35 smithi163 bash[24253]: cluster 2024-08-31T06:39:34.039302+0000 mgr.a (mgr.14388) 11603 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:35 smithi027 bash[22610]: audit 2024-08-31T06:39:33.576844+0000 mgr.a (mgr.14388) 11602 : audit [DBG] from='client.254874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:35 smithi027 bash[22610]: cluster 2024-08-31T06:39:34.039302+0000 mgr.a (mgr.14388) 11603 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:35 smithi191 bash[24992]: audit 2024-08-31T06:39:33.576844+0000 mgr.a (mgr.14388) 11602 : audit [DBG] from='client.254874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:35 smithi191 bash[24992]: cluster 2024-08-31T06:39:34.039302+0000 mgr.a (mgr.14388) 11603 : cluster [DBG] pgmap v8043: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:37 smithi163 bash[24253]: cluster 2024-08-31T06:39:36.040034+0000 mgr.a (mgr.14388) 11604 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:37 smithi027 bash[22610]: cluster 2024-08-31T06:39:36.040034+0000 mgr.a (mgr.14388) 11604 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:37 smithi191 bash[24992]: cluster 2024-08-31T06:39:36.040034+0000 mgr.a (mgr.14388) 11604 : cluster [DBG] pgmap v8044: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:39:38.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:39:38.994 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:39:38.994 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:39:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:39 smithi163 bash[24253]: cluster 2024-08-31T06:39:38.041943+0000 mgr.a (mgr.14388) 11605 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:39 smithi027 bash[22610]: cluster 2024-08-31T06:39:38.041943+0000 mgr.a (mgr.14388) 11605 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:39 smithi191 bash[24992]: cluster 2024-08-31T06:39:38.041943+0000 mgr.a (mgr.14388) 11605 : cluster [DBG] pgmap v8045: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:39.733 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:39:39.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:39:39.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:39:39.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:39:39.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:39:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:40 smithi163 bash[24253]: audit 2024-08-31T06:39:39.322961+0000 mgr.a (mgr.14388) 11606 : audit [DBG] from='client.254949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:40 smithi027 bash[22610]: audit 2024-08-31T06:39:39.322961+0000 mgr.a (mgr.14388) 11606 : audit [DBG] from='client.254949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:40 smithi191 bash[24992]: audit 2024-08-31T06:39:39.322961+0000 mgr.a (mgr.14388) 11606 : audit [DBG] from='client.254949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:41 smithi163 bash[24253]: cluster 2024-08-31T06:39:40.042913+0000 mgr.a (mgr.14388) 11607 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:41 smithi027 bash[22610]: cluster 2024-08-31T06:39:40.042913+0000 mgr.a (mgr.14388) 11607 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:41 smithi191 bash[24992]: cluster 2024-08-31T06:39:40.042913+0000 mgr.a (mgr.14388) 11607 : cluster [DBG] pgmap v8046: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:43 smithi163 bash[24253]: cluster 2024-08-31T06:39:42.043795+0000 mgr.a (mgr.14388) 11608 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:43 smithi027 bash[22610]: cluster 2024-08-31T06:39:42.043795+0000 mgr.a (mgr.14388) 11608 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:43 smithi191 bash[24992]: cluster 2024-08-31T06:39:42.043795+0000 mgr.a (mgr.14388) 11608 : cluster [DBG] pgmap v8047: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:44.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:39:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:39:44.736 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:39:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:45 smithi163 bash[24253]: cluster 2024-08-31T06:39:44.046053+0000 mgr.a (mgr.14388) 11609 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:45 smithi027 bash[22610]: cluster 2024-08-31T06:39:44.046053+0000 mgr.a (mgr.14388) 11609 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:45.512 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:39:45.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:39:45.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:39:45.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:39:45.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:39:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:45 smithi191 bash[24992]: cluster 2024-08-31T06:39:44.046053+0000 mgr.a (mgr.14388) 11609 : cluster [DBG] pgmap v8048: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:39:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:46 smithi163 bash[24253]: audit 2024-08-31T06:39:45.071672+0000 mgr.a (mgr.14388) 11610 : audit [DBG] from='client.255027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:46 smithi163 bash[24253]: audit 2024-08-31T06:39:46.104174+0000 mon.a (mon.0) 2309 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:39:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:46 smithi027 bash[22610]: audit 2024-08-31T06:39:45.071672+0000 mgr.a (mgr.14388) 11610 : audit [DBG] from='client.255027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:46 smithi027 bash[22610]: audit 2024-08-31T06:39:46.104174+0000 mon.a (mon.0) 2309 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:39:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:46 smithi191 bash[24992]: audit 2024-08-31T06:39:45.071672+0000 mgr.a (mgr.14388) 11610 : audit [DBG] from='client.255027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:46 smithi191 bash[24992]: audit 2024-08-31T06:39:46.104174+0000 mon.a (mon.0) 2309 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:39:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:47 smithi163 bash[24253]: cluster 2024-08-31T06:39:46.047153+0000 mgr.a (mgr.14388) 11611 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:47 smithi163 bash[24253]: audit 2024-08-31T06:39:46.722425+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:47 smithi163 bash[24253]: audit 2024-08-31T06:39:46.730203+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:47 smithi163 bash[24253]: audit 2024-08-31T06:39:46.737149+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:47 smithi163 bash[24253]: audit 2024-08-31T06:39:46.745217+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:47 smithi027 bash[22610]: cluster 2024-08-31T06:39:46.047153+0000 mgr.a (mgr.14388) 11611 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:47 smithi027 bash[22610]: audit 2024-08-31T06:39:46.722425+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:47 smithi027 bash[22610]: audit 2024-08-31T06:39:46.730203+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:47 smithi027 bash[22610]: audit 2024-08-31T06:39:46.737149+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:47 smithi027 bash[22610]: audit 2024-08-31T06:39:46.745217+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:47 smithi191 bash[24992]: cluster 2024-08-31T06:39:46.047153+0000 mgr.a (mgr.14388) 11611 : cluster [DBG] pgmap v8049: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:39:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:47 smithi191 bash[24992]: audit 2024-08-31T06:39:46.722425+0000 mon.a (mon.0) 2310 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:47 smithi191 bash[24992]: audit 2024-08-31T06:39:46.730203+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:47 smithi191 bash[24992]: audit 2024-08-31T06:39:46.737149+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:47 smithi191 bash[24992]: audit 2024-08-31T06:39:46.745217+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:48 smithi163 bash[24253]: audit 2024-08-31T06:39:47.385227+0000 mon.a (mon.0) 2314 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:39:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:48 smithi163 bash[24253]: audit 2024-08-31T06:39:47.387081+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:39:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:48 smithi163 bash[24253]: audit 2024-08-31T06:39:47.397162+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:48 smithi163 bash[24253]: audit 2024-08-31T06:39:47.401923+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:39:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:48 smithi163 bash[24253]: audit 2024-08-31T06:39:47.403119+0000 mgr.a (mgr.14388) 11612 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:39:48.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:39:48 smithi027 bash[22863]: debug 2024-08-31T06:39:48.145+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:39:48.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:39:48 smithi027 bash[22863]: debug 2024-08-31T06:39:48.145+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:39:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:48 smithi027 bash[22610]: audit 2024-08-31T06:39:47.385227+0000 mon.a (mon.0) 2314 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:39:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:48 smithi027 bash[22610]: audit 2024-08-31T06:39:47.387081+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:39:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:48 smithi027 bash[22610]: audit 2024-08-31T06:39:47.397162+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:48.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:48 smithi027 bash[22610]: audit 2024-08-31T06:39:47.401923+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:39:48.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:48 smithi027 bash[22610]: audit 2024-08-31T06:39:47.403119+0000 mgr.a (mgr.14388) 11612 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:39:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:48 smithi191 bash[24992]: audit 2024-08-31T06:39:47.385227+0000 mon.a (mon.0) 2314 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:39:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:48 smithi191 bash[24992]: audit 2024-08-31T06:39:47.387081+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:39:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:48 smithi191 bash[24992]: audit 2024-08-31T06:39:47.397162+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:39:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:48 smithi191 bash[24992]: audit 2024-08-31T06:39:47.401923+0000 mon.a (mon.0) 2317 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:39:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:48 smithi191 bash[24992]: audit 2024-08-31T06:39:47.403119+0000 mgr.a (mgr.14388) 11612 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:39:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:49 smithi163 bash[24253]: cluster 2024-08-31T06:39:48.048667+0000 mgr.a (mgr.14388) 11613 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:39:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:49 smithi163 bash[24253]: audit 2024-08-31T06:39:48.148525+0000 mgr.a (mgr.14388) 11614 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:39:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:49 smithi163 bash[24253]: cephadm 2024-08-31T06:39:48.150288+0000 mgr.a (mgr.14388) 11615 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:39:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:49 smithi027 bash[22610]: cluster 2024-08-31T06:39:48.048667+0000 mgr.a (mgr.14388) 11613 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:39:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:49 smithi027 bash[22610]: audit 2024-08-31T06:39:48.148525+0000 mgr.a (mgr.14388) 11614 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:39:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:49 smithi027 bash[22610]: cephadm 2024-08-31T06:39:48.150288+0000 mgr.a (mgr.14388) 11615 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:39:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:49 smithi191 bash[24992]: cluster 2024-08-31T06:39:48.048667+0000 mgr.a (mgr.14388) 11613 : cluster [DBG] pgmap v8050: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:39:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:49 smithi191 bash[24992]: audit 2024-08-31T06:39:48.148525+0000 mgr.a (mgr.14388) 11614 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:39:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:49 smithi191 bash[24992]: cephadm 2024-08-31T06:39:48.150288+0000 mgr.a (mgr.14388) 11615 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:39:50.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:39:50.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:39:50.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:39:51.294 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:39:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:39:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:39:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:39:51.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:39:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:51 smithi163 bash[24253]: cluster 2024-08-31T06:39:50.049430+0000 mgr.a (mgr.14388) 11616 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:39:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:51 smithi027 bash[22610]: cluster 2024-08-31T06:39:50.049430+0000 mgr.a (mgr.14388) 11616 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:39:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:51 smithi191 bash[24992]: cluster 2024-08-31T06:39:50.049430+0000 mgr.a (mgr.14388) 11616 : cluster [DBG] pgmap v8051: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:39:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:52 smithi163 bash[24253]: audit 2024-08-31T06:39:50.854541+0000 mgr.a (mgr.14388) 11617 : audit [DBG] from='client.255201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:52.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:52 smithi027 bash[22610]: audit 2024-08-31T06:39:50.854541+0000 mgr.a (mgr.14388) 11617 : audit [DBG] from='client.255201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:52 smithi191 bash[24992]: audit 2024-08-31T06:39:50.854541+0000 mgr.a (mgr.14388) 11617 : audit [DBG] from='client.255201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:53 smithi163 bash[24253]: cluster 2024-08-31T06:39:52.050342+0000 mgr.a (mgr.14388) 11618 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:39:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:53 smithi027 bash[22610]: cluster 2024-08-31T06:39:52.050342+0000 mgr.a (mgr.14388) 11618 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:39:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:53 smithi191 bash[24992]: cluster 2024-08-31T06:39:52.050342+0000 mgr.a (mgr.14388) 11618 : cluster [DBG] pgmap v8052: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:39:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:55 smithi163 bash[24253]: cluster 2024-08-31T06:39:54.052586+0000 mgr.a (mgr.14388) 11619 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:39:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:55 smithi027 bash[22610]: cluster 2024-08-31T06:39:54.052586+0000 mgr.a (mgr.14388) 11619 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:39:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:55 smithi191 bash[24992]: cluster 2024-08-31T06:39:54.052586+0000 mgr.a (mgr.14388) 11619 : cluster [DBG] pgmap v8053: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:39:56.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:39:56.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:39:56.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:39:57.085 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:39:57.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:39:57.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:39:57.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:39:57.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:39:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:57 smithi163 bash[24253]: cluster 2024-08-31T06:39:56.053361+0000 mgr.a (mgr.14388) 11620 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:39:57.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:57 smithi027 bash[22610]: cluster 2024-08-31T06:39:56.053361+0000 mgr.a (mgr.14388) 11620 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:39:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:57 smithi191 bash[24992]: cluster 2024-08-31T06:39:56.053361+0000 mgr.a (mgr.14388) 11620 : cluster [DBG] pgmap v8054: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:39:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:58 smithi163 bash[24253]: audit 2024-08-31T06:39:56.632010+0000 mgr.a (mgr.14388) 11621 : audit [DBG] from='client.255276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:39:58 smithi163 bash[24253]: cluster 2024-08-31T06:39:58.055638+0000 mgr.a (mgr.14388) 11622 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:39:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:58 smithi027 bash[22610]: audit 2024-08-31T06:39:56.632010+0000 mgr.a (mgr.14388) 11621 : audit [DBG] from='client.255276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:39:58 smithi027 bash[22610]: cluster 2024-08-31T06:39:58.055638+0000 mgr.a (mgr.14388) 11622 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:39:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:58 smithi191 bash[24992]: audit 2024-08-31T06:39:56.632010+0000 mgr.a (mgr.14388) 11621 : audit [DBG] from='client.255276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:39:58 smithi191 bash[24992]: cluster 2024-08-31T06:39:58.055638+0000 mgr.a (mgr.14388) 11622 : cluster [DBG] pgmap v8055: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:40:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:00 smithi163 bash[24253]: cluster 2024-08-31T06:40:00.000132+0000 mon.a (mon.0) 2318 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:40:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:00 smithi027 bash[22610]: cluster 2024-08-31T06:40:00.000132+0000 mon.a (mon.0) 2318 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:40:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:00 smithi191 bash[24992]: cluster 2024-08-31T06:40:00.000132+0000 mon.a (mon.0) 2318 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:40:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:01 smithi163 bash[24253]: cluster 2024-08-31T06:40:00.056542+0000 mgr.a (mgr.14388) 11623 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:40:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:01 smithi027 bash[22610]: cluster 2024-08-31T06:40:00.056542+0000 mgr.a (mgr.14388) 11623 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:40:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:01 smithi191 bash[24992]: cluster 2024-08-31T06:40:00.056542+0000 mgr.a (mgr.14388) 11623 : cluster [DBG] pgmap v8056: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:40:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:02.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:02.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:02.848 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:40:02.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:40:02.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:40:02.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:40:02.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:40:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:03 smithi163 bash[24253]: cluster 2024-08-31T06:40:02.057319+0000 mgr.a (mgr.14388) 11624 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:40:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:03 smithi163 bash[24253]: audit 2024-08-31T06:40:02.418036+0000 mgr.a (mgr.14388) 11625 : audit [DBG] from='client.255348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:03 smithi027 bash[22610]: cluster 2024-08-31T06:40:02.057319+0000 mgr.a (mgr.14388) 11624 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:40:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:03 smithi027 bash[22610]: audit 2024-08-31T06:40:02.418036+0000 mgr.a (mgr.14388) 11625 : audit [DBG] from='client.255348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:03 smithi191 bash[24992]: cluster 2024-08-31T06:40:02.057319+0000 mgr.a (mgr.14388) 11624 : cluster [DBG] pgmap v8057: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:40:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:03 smithi191 bash[24992]: audit 2024-08-31T06:40:02.418036+0000 mgr.a (mgr.14388) 11625 : audit [DBG] from='client.255348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:05 smithi163 bash[24253]: cluster 2024-08-31T06:40:04.059626+0000 mgr.a (mgr.14388) 11626 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:40:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:05 smithi027 bash[22610]: cluster 2024-08-31T06:40:04.059626+0000 mgr.a (mgr.14388) 11626 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:40:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:05 smithi191 bash[24992]: cluster 2024-08-31T06:40:04.059626+0000 mgr.a (mgr.14388) 11626 : cluster [DBG] pgmap v8058: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:40:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:07 smithi163 bash[24253]: cluster 2024-08-31T06:40:06.060379+0000 mgr.a (mgr.14388) 11627 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:07 smithi027 bash[22610]: cluster 2024-08-31T06:40:06.060379+0000 mgr.a (mgr.14388) 11627 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:07 smithi191 bash[24992]: cluster 2024-08-31T06:40:06.060379+0000 mgr.a (mgr.14388) 11627 : cluster [DBG] pgmap v8059: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:07.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:07.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:07.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:08.618 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:40:08.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:40:08.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:40:08.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:40:08.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:40:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:09 smithi163 bash[24253]: cluster 2024-08-31T06:40:08.061915+0000 mgr.a (mgr.14388) 11628 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:09 smithi163 bash[24253]: audit 2024-08-31T06:40:08.186552+0000 mgr.a (mgr.14388) 11629 : audit [DBG] from='client.255423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:09 smithi027 bash[22610]: cluster 2024-08-31T06:40:08.061915+0000 mgr.a (mgr.14388) 11628 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:09 smithi027 bash[22610]: audit 2024-08-31T06:40:08.186552+0000 mgr.a (mgr.14388) 11629 : audit [DBG] from='client.255423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:09 smithi191 bash[24992]: cluster 2024-08-31T06:40:08.061915+0000 mgr.a (mgr.14388) 11628 : cluster [DBG] pgmap v8060: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:09 smithi191 bash[24992]: audit 2024-08-31T06:40:08.186552+0000 mgr.a (mgr.14388) 11629 : audit [DBG] from='client.255423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:11.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:11 smithi163 bash[24253]: cluster 2024-08-31T06:40:10.062814+0000 mgr.a (mgr.14388) 11630 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:11 smithi027 bash[22610]: cluster 2024-08-31T06:40:10.062814+0000 mgr.a (mgr.14388) 11630 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:11 smithi191 bash[24992]: cluster 2024-08-31T06:40:10.062814+0000 mgr.a (mgr.14388) 11630 : cluster [DBG] pgmap v8061: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:13 smithi163 bash[24253]: cluster 2024-08-31T06:40:12.063609+0000 mgr.a (mgr.14388) 11631 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:13 smithi027 bash[22610]: cluster 2024-08-31T06:40:12.063609+0000 mgr.a (mgr.14388) 11631 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:13 smithi191 bash[24992]: cluster 2024-08-31T06:40:12.063609+0000 mgr.a (mgr.14388) 11631 : cluster [DBG] pgmap v8062: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:13.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:13.620 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:13.620 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:14.371 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:40:14.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:40:14.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:40:14.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:40:14.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:40:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:15 smithi163 bash[24253]: audit 2024-08-31T06:40:13.949229+0000 mgr.a (mgr.14388) 11632 : audit [DBG] from='client.255501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:15 smithi163 bash[24253]: cluster 2024-08-31T06:40:14.065031+0000 mgr.a (mgr.14388) 11633 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:15 smithi027 bash[22610]: audit 2024-08-31T06:40:13.949229+0000 mgr.a (mgr.14388) 11632 : audit [DBG] from='client.255501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:15 smithi027 bash[22610]: cluster 2024-08-31T06:40:14.065031+0000 mgr.a (mgr.14388) 11633 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:15 smithi191 bash[24992]: audit 2024-08-31T06:40:13.949229+0000 mgr.a (mgr.14388) 11632 : audit [DBG] from='client.255501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:15 smithi191 bash[24992]: cluster 2024-08-31T06:40:14.065031+0000 mgr.a (mgr.14388) 11633 : cluster [DBG] pgmap v8063: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:17 smithi163 bash[24253]: cluster 2024-08-31T06:40:16.065898+0000 mgr.a (mgr.14388) 11634 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:17 smithi027 bash[22610]: cluster 2024-08-31T06:40:16.065898+0000 mgr.a (mgr.14388) 11634 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:17 smithi191 bash[24992]: cluster 2024-08-31T06:40:16.065898+0000 mgr.a (mgr.14388) 11634 : cluster [DBG] pgmap v8064: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:19.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:19.373 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:19.373 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:19 smithi163 bash[24253]: cluster 2024-08-31T06:40:18.068086+0000 mgr.a (mgr.14388) 11635 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:19 smithi027 bash[22610]: cluster 2024-08-31T06:40:18.068086+0000 mgr.a (mgr.14388) 11635 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:19 smithi191 bash[24992]: cluster 2024-08-31T06:40:18.068086+0000 mgr.a (mgr.14388) 11635 : cluster [DBG] pgmap v8065: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:20.114 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:40:20.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:40:20.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:40:20.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:40:20.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:40:21.456 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:21 smithi163 bash[24253]: audit 2024-08-31T06:40:19.701734+0000 mgr.a (mgr.14388) 11636 : audit [DBG] from='client.255579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:21.456 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:21 smithi163 bash[24253]: cluster 2024-08-31T06:40:20.068652+0000 mgr.a (mgr.14388) 11637 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:21.487 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:21 smithi027 bash[22610]: audit 2024-08-31T06:40:19.701734+0000 mgr.a (mgr.14388) 11636 : audit [DBG] from='client.255579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:21.488 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:21 smithi027 bash[22610]: cluster 2024-08-31T06:40:20.068652+0000 mgr.a (mgr.14388) 11637 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:21.745 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:21 smithi191 bash[24992]: audit 2024-08-31T06:40:19.701734+0000 mgr.a (mgr.14388) 11636 : audit [DBG] from='client.255579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:21.745 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:21 smithi191 bash[24992]: cluster 2024-08-31T06:40:20.068652+0000 mgr.a (mgr.14388) 11637 : cluster [DBG] pgmap v8066: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:23 smithi163 bash[24253]: cluster 2024-08-31T06:40:22.069381+0000 mgr.a (mgr.14388) 11638 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:23 smithi027 bash[22610]: cluster 2024-08-31T06:40:22.069381+0000 mgr.a (mgr.14388) 11638 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:23 smithi191 bash[24992]: cluster 2024-08-31T06:40:22.069381+0000 mgr.a (mgr.14388) 11638 : cluster [DBG] pgmap v8067: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:25.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:25.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:25.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:25 smithi163 bash[24253]: cluster 2024-08-31T06:40:24.071635+0000 mgr.a (mgr.14388) 11639 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:25 smithi027 bash[22610]: cluster 2024-08-31T06:40:24.071635+0000 mgr.a (mgr.14388) 11639 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:25 smithi191 bash[24992]: cluster 2024-08-31T06:40:24.071635+0000 mgr.a (mgr.14388) 11639 : cluster [DBG] pgmap v8068: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:25.879 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:40:25.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:40:25.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:40:25.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:40:25.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:40:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:27 smithi163 bash[24253]: audit 2024-08-31T06:40:25.450025+0000 mgr.a (mgr.14388) 11640 : audit [DBG] from='client.255654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:27 smithi163 bash[24253]: cluster 2024-08-31T06:40:26.072664+0000 mgr.a (mgr.14388) 11641 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:27 smithi027 bash[22610]: audit 2024-08-31T06:40:25.450025+0000 mgr.a (mgr.14388) 11640 : audit [DBG] from='client.255654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:27 smithi027 bash[22610]: cluster 2024-08-31T06:40:26.072664+0000 mgr.a (mgr.14388) 11641 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:27 smithi191 bash[24992]: audit 2024-08-31T06:40:25.450025+0000 mgr.a (mgr.14388) 11640 : audit [DBG] from='client.255654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:27 smithi191 bash[24992]: cluster 2024-08-31T06:40:26.072664+0000 mgr.a (mgr.14388) 11641 : cluster [DBG] pgmap v8069: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:29 smithi163 bash[24253]: cluster 2024-08-31T06:40:28.074837+0000 mgr.a (mgr.14388) 11642 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:29 smithi027 bash[22610]: cluster 2024-08-31T06:40:28.074837+0000 mgr.a (mgr.14388) 11642 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:29 smithi191 bash[24992]: cluster 2024-08-31T06:40:28.074837+0000 mgr.a (mgr.14388) 11642 : cluster [DBG] pgmap v8070: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:30.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:30.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:30.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:31 smithi163 bash[24253]: cluster 2024-08-31T06:40:30.075558+0000 mgr.a (mgr.14388) 11643 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:31 smithi027 bash[22610]: cluster 2024-08-31T06:40:30.075558+0000 mgr.a (mgr.14388) 11643 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:31 smithi191 bash[24992]: cluster 2024-08-31T06:40:30.075558+0000 mgr.a (mgr.14388) 11643 : cluster [DBG] pgmap v8071: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:31.640 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:40:31.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:40:31.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:40:31.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:40:31.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:40:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:32 smithi163 bash[24253]: audit 2024-08-31T06:40:31.213454+0000 mgr.a (mgr.14388) 11644 : audit [DBG] from='client.255732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:32 smithi027 bash[22610]: audit 2024-08-31T06:40:31.213454+0000 mgr.a (mgr.14388) 11644 : audit [DBG] from='client.255732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:32 smithi191 bash[24992]: audit 2024-08-31T06:40:31.213454+0000 mgr.a (mgr.14388) 11644 : audit [DBG] from='client.255732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:33 smithi163 bash[24253]: cluster 2024-08-31T06:40:32.076422+0000 mgr.a (mgr.14388) 11645 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:33 smithi027 bash[22610]: cluster 2024-08-31T06:40:32.076422+0000 mgr.a (mgr.14388) 11645 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:33 smithi191 bash[24992]: cluster 2024-08-31T06:40:32.076422+0000 mgr.a (mgr.14388) 11645 : cluster [DBG] pgmap v8072: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:35.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:35 smithi163 bash[24253]: cluster 2024-08-31T06:40:34.078604+0000 mgr.a (mgr.14388) 11646 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:35 smithi027 bash[22610]: cluster 2024-08-31T06:40:34.078604+0000 mgr.a (mgr.14388) 11646 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:35 smithi191 bash[24992]: cluster 2024-08-31T06:40:34.078604+0000 mgr.a (mgr.14388) 11646 : cluster [DBG] pgmap v8073: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:36.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:36.643 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:36.643 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:37.380 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:40:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:40:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:40:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:40:37.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:40:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:37 smithi163 bash[24253]: cluster 2024-08-31T06:40:36.079356+0000 mgr.a (mgr.14388) 11647 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:37 smithi027 bash[22610]: cluster 2024-08-31T06:40:36.079356+0000 mgr.a (mgr.14388) 11647 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:37 smithi191 bash[24992]: cluster 2024-08-31T06:40:36.079356+0000 mgr.a (mgr.14388) 11647 : cluster [DBG] pgmap v8074: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:38 smithi163 bash[24253]: audit 2024-08-31T06:40:36.972100+0000 mgr.a (mgr.14388) 11648 : audit [DBG] from='client.255810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:38 smithi027 bash[22610]: audit 2024-08-31T06:40:36.972100+0000 mgr.a (mgr.14388) 11648 : audit [DBG] from='client.255810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:38 smithi191 bash[24992]: audit 2024-08-31T06:40:36.972100+0000 mgr.a (mgr.14388) 11648 : audit [DBG] from='client.255810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:39 smithi163 bash[24253]: cluster 2024-08-31T06:40:38.081578+0000 mgr.a (mgr.14388) 11649 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:39 smithi027 bash[22610]: cluster 2024-08-31T06:40:38.081578+0000 mgr.a (mgr.14388) 11649 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:39 smithi191 bash[24992]: cluster 2024-08-31T06:40:38.081578+0000 mgr.a (mgr.14388) 11649 : cluster [DBG] pgmap v8075: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:40:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:41 smithi163 bash[24253]: cluster 2024-08-31T06:40:40.082361+0000 mgr.a (mgr.14388) 11650 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:41 smithi027 bash[22610]: cluster 2024-08-31T06:40:40.082361+0000 mgr.a (mgr.14388) 11650 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:41 smithi191 bash[24992]: cluster 2024-08-31T06:40:40.082361+0000 mgr.a (mgr.14388) 11650 : cluster [DBG] pgmap v8076: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:42.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:42.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:42.383 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:43.116 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:40:43.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:40:43.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:40:43.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:40:43.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:40:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:43 smithi163 bash[24253]: cluster 2024-08-31T06:40:42.083138+0000 mgr.a (mgr.14388) 11651 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:43 smithi027 bash[22610]: cluster 2024-08-31T06:40:42.083138+0000 mgr.a (mgr.14388) 11651 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:43 smithi191 bash[24992]: cluster 2024-08-31T06:40:42.083138+0000 mgr.a (mgr.14388) 11651 : cluster [DBG] pgmap v8077: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:44 smithi163 bash[24253]: audit 2024-08-31T06:40:42.701776+0000 mgr.a (mgr.14388) 11652 : audit [DBG] from='client.255888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:44 smithi027 bash[22610]: audit 2024-08-31T06:40:42.701776+0000 mgr.a (mgr.14388) 11652 : audit [DBG] from='client.255888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:44 smithi191 bash[24992]: audit 2024-08-31T06:40:42.701776+0000 mgr.a (mgr.14388) 11652 : audit [DBG] from='client.255888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:45 smithi163 bash[24253]: cluster 2024-08-31T06:40:44.085872+0000 mgr.a (mgr.14388) 11653 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:40:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:45 smithi027 bash[22610]: cluster 2024-08-31T06:40:44.085872+0000 mgr.a (mgr.14388) 11653 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:40:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:45 smithi191 bash[24992]: cluster 2024-08-31T06:40:44.085872+0000 mgr.a (mgr.14388) 11653 : cluster [DBG] pgmap v8078: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:40:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:47 smithi163 bash[24253]: cluster 2024-08-31T06:40:46.086643+0000 mgr.a (mgr.14388) 11654 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:40:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:47 smithi027 bash[22610]: cluster 2024-08-31T06:40:46.086643+0000 mgr.a (mgr.14388) 11654 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:40:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:47 smithi191 bash[24992]: cluster 2024-08-31T06:40:46.086643+0000 mgr.a (mgr.14388) 11654 : cluster [DBG] pgmap v8079: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:40:48.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:48.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:48.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:48.884 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:40:48.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:40:48.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:40:48.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:40:48.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:40:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:49 smithi163 bash[24253]: cluster 2024-08-31T06:40:48.088491+0000 mgr.a (mgr.14388) 11655 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:49 smithi163 bash[24253]: audit 2024-08-31T06:40:48.205945+0000 mon.a (mon.0) 2319 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:40:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:49 smithi163 bash[24253]: audit 2024-08-31T06:40:48.999714+0000 mon.a (mon.0) 2320 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:40:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:49 smithi163 bash[24253]: audit 2024-08-31T06:40:49.001625+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:40:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:49 smithi163 bash[24253]: audit 2024-08-31T06:40:49.010425+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:40:49.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:49 smithi163 bash[24253]: audit 2024-08-31T06:40:49.015751+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:40:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:49 smithi027 bash[22610]: cluster 2024-08-31T06:40:48.088491+0000 mgr.a (mgr.14388) 11655 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:49 smithi027 bash[22610]: audit 2024-08-31T06:40:48.205945+0000 mon.a (mon.0) 2319 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:40:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:49 smithi027 bash[22610]: audit 2024-08-31T06:40:48.999714+0000 mon.a (mon.0) 2320 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:40:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:49 smithi027 bash[22610]: audit 2024-08-31T06:40:49.001625+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:40:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:49 smithi027 bash[22610]: audit 2024-08-31T06:40:49.010425+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:40:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:49 smithi027 bash[22610]: audit 2024-08-31T06:40:49.015751+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:40:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:49 smithi191 bash[24992]: cluster 2024-08-31T06:40:48.088491+0000 mgr.a (mgr.14388) 11655 : cluster [DBG] pgmap v8080: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:40:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:49 smithi191 bash[24992]: audit 2024-08-31T06:40:48.205945+0000 mon.a (mon.0) 2319 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:40:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:49 smithi191 bash[24992]: audit 2024-08-31T06:40:48.999714+0000 mon.a (mon.0) 2320 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:40:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:49 smithi191 bash[24992]: audit 2024-08-31T06:40:49.001625+0000 mon.a (mon.0) 2321 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:40:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:49 smithi191 bash[24992]: audit 2024-08-31T06:40:49.010425+0000 mon.a (mon.0) 2322 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:40:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:49 smithi191 bash[24992]: audit 2024-08-31T06:40:49.015751+0000 mon.a (mon.0) 2323 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:40:50.193 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:40:49 smithi027 bash[22863]: debug 2024-08-31T06:40:49.739+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:40:50.193 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:40:49 smithi027 bash[22863]: debug 2024-08-31T06:40:49.743+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:40:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:50 smithi163 bash[24253]: audit 2024-08-31T06:40:48.450875+0000 mgr.a (mgr.14388) 11656 : audit [DBG] from='client.255966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:50 smithi163 bash[24253]: audit 2024-08-31T06:40:49.018491+0000 mgr.a (mgr.14388) 11657 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:40:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:50 smithi027 bash[22610]: audit 2024-08-31T06:40:48.450875+0000 mgr.a (mgr.14388) 11656 : audit [DBG] from='client.255966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:50 smithi027 bash[22610]: audit 2024-08-31T06:40:49.018491+0000 mgr.a (mgr.14388) 11657 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:40:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:50 smithi191 bash[24992]: audit 2024-08-31T06:40:48.450875+0000 mgr.a (mgr.14388) 11656 : audit [DBG] from='client.255966 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:50 smithi191 bash[24992]: audit 2024-08-31T06:40:49.018491+0000 mgr.a (mgr.14388) 11657 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:40:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:51 smithi163 bash[24253]: audit 2024-08-31T06:40:49.745842+0000 mgr.a (mgr.14388) 11658 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:40:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:51 smithi163 bash[24253]: cephadm 2024-08-31T06:40:49.747310+0000 mgr.a (mgr.14388) 11659 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:40:51.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:51 smithi163 bash[24253]: cluster 2024-08-31T06:40:50.089381+0000 mgr.a (mgr.14388) 11660 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:40:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:51 smithi027 bash[22610]: audit 2024-08-31T06:40:49.745842+0000 mgr.a (mgr.14388) 11658 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:40:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:51 smithi027 bash[22610]: cephadm 2024-08-31T06:40:49.747310+0000 mgr.a (mgr.14388) 11659 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:40:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:51 smithi027 bash[22610]: cluster 2024-08-31T06:40:50.089381+0000 mgr.a (mgr.14388) 11660 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:40:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:51 smithi191 bash[24992]: audit 2024-08-31T06:40:49.745842+0000 mgr.a (mgr.14388) 11658 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:40:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:51 smithi191 bash[24992]: cephadm 2024-08-31T06:40:49.747310+0000 mgr.a (mgr.14388) 11659 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:40:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:51 smithi191 bash[24992]: cluster 2024-08-31T06:40:50.089381+0000 mgr.a (mgr.14388) 11660 : cluster [DBG] pgmap v8081: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:40:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:53 smithi027 bash[22610]: cluster 2024-08-31T06:40:52.090290+0000 mgr.a (mgr.14388) 11661 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:53 smithi191 bash[24992]: cluster 2024-08-31T06:40:52.090290+0000 mgr.a (mgr.14388) 11661 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:53 smithi163 bash[24253]: cluster 2024-08-31T06:40:52.090290+0000 mgr.a (mgr.14388) 11661 : cluster [DBG] pgmap v8082: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:40:53.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:53.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:54.651 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:40:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:40:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:40:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:40:54.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:40:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:55 smithi027 bash[22610]: cluster 2024-08-31T06:40:54.092582+0000 mgr.a (mgr.14388) 11662 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:40:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:55 smithi027 bash[22610]: audit 2024-08-31T06:40:54.220116+0000 mgr.a (mgr.14388) 11663 : audit [DBG] from='client.256152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:55 smithi191 bash[24992]: cluster 2024-08-31T06:40:54.092582+0000 mgr.a (mgr.14388) 11662 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:40:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:55 smithi191 bash[24992]: audit 2024-08-31T06:40:54.220116+0000 mgr.a (mgr.14388) 11663 : audit [DBG] from='client.256152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:55 smithi163 bash[24253]: cluster 2024-08-31T06:40:54.092582+0000 mgr.a (mgr.14388) 11662 : cluster [DBG] pgmap v8083: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:40:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:55 smithi163 bash[24253]: audit 2024-08-31T06:40:54.220116+0000 mgr.a (mgr.14388) 11663 : audit [DBG] from='client.256152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:57 smithi027 bash[22610]: cluster 2024-08-31T06:40:56.093496+0000 mgr.a (mgr.14388) 11664 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:40:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:57 smithi191 bash[24992]: cluster 2024-08-31T06:40:56.093496+0000 mgr.a (mgr.14388) 11664 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:40:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:57 smithi163 bash[24253]: cluster 2024-08-31T06:40:56.093496+0000 mgr.a (mgr.14388) 11664 : cluster [DBG] pgmap v8084: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:40:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:40:59 smithi027 bash[22610]: cluster 2024-08-31T06:40:58.095619+0000 mgr.a (mgr.14388) 11665 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:40:59.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:40:59 smithi191 bash[24992]: cluster 2024-08-31T06:40:58.095619+0000 mgr.a (mgr.14388) 11665 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:40:59.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:40:59.653 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:40:59.653 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:40:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:40:59 smithi163 bash[24253]: cluster 2024-08-31T06:40:58.095619+0000 mgr.a (mgr.14388) 11665 : cluster [DBG] pgmap v8085: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:00.403 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:00.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:00.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:00.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:00.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:01 smithi027 bash[22610]: audit 2024-08-31T06:40:59.989385+0000 mgr.a (mgr.14388) 11666 : audit [DBG] from='client.256230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:01 smithi027 bash[22610]: cluster 2024-08-31T06:41:00.096080+0000 mgr.a (mgr.14388) 11667 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:01 smithi191 bash[24992]: audit 2024-08-31T06:40:59.989385+0000 mgr.a (mgr.14388) 11666 : audit [DBG] from='client.256230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:01 smithi191 bash[24992]: cluster 2024-08-31T06:41:00.096080+0000 mgr.a (mgr.14388) 11667 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:01 smithi163 bash[24253]: audit 2024-08-31T06:40:59.989385+0000 mgr.a (mgr.14388) 11666 : audit [DBG] from='client.256230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:01 smithi163 bash[24253]: cluster 2024-08-31T06:41:00.096080+0000 mgr.a (mgr.14388) 11667 : cluster [DBG] pgmap v8086: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:03 smithi027 bash[22610]: cluster 2024-08-31T06:41:02.096964+0000 mgr.a (mgr.14388) 11668 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:03 smithi191 bash[24992]: cluster 2024-08-31T06:41:02.096964+0000 mgr.a (mgr.14388) 11668 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:03 smithi163 bash[24253]: cluster 2024-08-31T06:41:02.096964+0000 mgr.a (mgr.14388) 11668 : cluster [DBG] pgmap v8087: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:41:05.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:41:05.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:41:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:05 smithi027 bash[22610]: cluster 2024-08-31T06:41:04.099185+0000 mgr.a (mgr.14388) 11669 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:05 smithi191 bash[24992]: cluster 2024-08-31T06:41:04.099185+0000 mgr.a (mgr.14388) 11669 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:05 smithi163 bash[24253]: cluster 2024-08-31T06:41:04.099185+0000 mgr.a (mgr.14388) 11669 : cluster [DBG] pgmap v8088: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:06.163 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:06.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:06.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:06.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:06.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:07 smithi027 bash[22610]: audit 2024-08-31T06:41:05.736497+0000 mgr.a (mgr.14388) 11670 : audit [DBG] from='client.256302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:07 smithi027 bash[22610]: cluster 2024-08-31T06:41:06.099691+0000 mgr.a (mgr.14388) 11671 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:07 smithi191 bash[24992]: audit 2024-08-31T06:41:05.736497+0000 mgr.a (mgr.14388) 11670 : audit [DBG] from='client.256302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:07 smithi191 bash[24992]: cluster 2024-08-31T06:41:06.099691+0000 mgr.a (mgr.14388) 11671 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:07 smithi163 bash[24253]: audit 2024-08-31T06:41:05.736497+0000 mgr.a (mgr.14388) 11670 : audit [DBG] from='client.256302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:07 smithi163 bash[24253]: cluster 2024-08-31T06:41:06.099691+0000 mgr.a (mgr.14388) 11671 : cluster [DBG] pgmap v8089: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:09 smithi027 bash[22610]: cluster 2024-08-31T06:41:08.101768+0000 mgr.a (mgr.14388) 11672 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:09.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:09 smithi191 bash[24992]: cluster 2024-08-31T06:41:08.101768+0000 mgr.a (mgr.14388) 11672 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:09 smithi163 bash[24253]: cluster 2024-08-31T06:41:08.101768+0000 mgr.a (mgr.14388) 11672 : cluster [DBG] pgmap v8090: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:11.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:41:11.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:41:11.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:41:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:11 smithi191 bash[24992]: cluster 2024-08-31T06:41:10.102529+0000 mgr.a (mgr.14388) 11673 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:11 smithi163 bash[24253]: cluster 2024-08-31T06:41:10.102529+0000 mgr.a (mgr.14388) 11673 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:11 smithi027 bash[22610]: cluster 2024-08-31T06:41:10.102529+0000 mgr.a (mgr.14388) 11673 : cluster [DBG] pgmap v8091: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:11.909 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:11.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:11.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:11.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:11.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:13 smithi191 bash[24992]: audit 2024-08-31T06:41:11.495494+0000 mgr.a (mgr.14388) 11674 : audit [DBG] from='client.256377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:13 smithi191 bash[24992]: cluster 2024-08-31T06:41:12.103389+0000 mgr.a (mgr.14388) 11675 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:13 smithi163 bash[24253]: audit 2024-08-31T06:41:11.495494+0000 mgr.a (mgr.14388) 11674 : audit [DBG] from='client.256377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:13.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:13 smithi163 bash[24253]: cluster 2024-08-31T06:41:12.103389+0000 mgr.a (mgr.14388) 11675 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:13 smithi027 bash[22610]: audit 2024-08-31T06:41:11.495494+0000 mgr.a (mgr.14388) 11674 : audit [DBG] from='client.256377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:13 smithi027 bash[22610]: cluster 2024-08-31T06:41:12.103389+0000 mgr.a (mgr.14388) 11675 : cluster [DBG] pgmap v8092: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:15 smithi191 bash[24992]: cluster 2024-08-31T06:41:14.105565+0000 mgr.a (mgr.14388) 11676 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:15 smithi163 bash[24253]: cluster 2024-08-31T06:41:14.105565+0000 mgr.a (mgr.14388) 11676 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:15 smithi027 bash[22610]: cluster 2024-08-31T06:41:14.105565+0000 mgr.a (mgr.14388) 11676 : cluster [DBG] pgmap v8093: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:16.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:41:16.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:41:16.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:41:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:17 smithi191 bash[24992]: cluster 2024-08-31T06:41:16.106324+0000 mgr.a (mgr.14388) 11677 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:17.695 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:17.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:17.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:17.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:17.696 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:17.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:17 smithi163 bash[24253]: cluster 2024-08-31T06:41:16.106324+0000 mgr.a (mgr.14388) 11677 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:17 smithi027 bash[22610]: cluster 2024-08-31T06:41:16.106324+0000 mgr.a (mgr.14388) 11677 : cluster [DBG] pgmap v8094: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:18 smithi191 bash[24992]: audit 2024-08-31T06:41:17.252497+0000 mgr.a (mgr.14388) 11678 : audit [DBG] from='client.256455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:18 smithi163 bash[24253]: audit 2024-08-31T06:41:17.252497+0000 mgr.a (mgr.14388) 11678 : audit [DBG] from='client.256455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:18 smithi027 bash[22610]: audit 2024-08-31T06:41:17.252497+0000 mgr.a (mgr.14388) 11678 : audit [DBG] from='client.256455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:19 smithi191 bash[24992]: cluster 2024-08-31T06:41:18.108648+0000 mgr.a (mgr.14388) 11679 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:19 smithi163 bash[24253]: cluster 2024-08-31T06:41:18.108648+0000 mgr.a (mgr.14388) 11679 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:19.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:19 smithi027 bash[22610]: cluster 2024-08-31T06:41:18.108648+0000 mgr.a (mgr.14388) 11679 : cluster [DBG] pgmap v8095: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:21 smithi191 bash[24992]: cluster 2024-08-31T06:41:20.109429+0000 mgr.a (mgr.14388) 11680 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:21 smithi163 bash[24253]: cluster 2024-08-31T06:41:20.109429+0000 mgr.a (mgr.14388) 11680 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:21 smithi027 bash[22610]: cluster 2024-08-31T06:41:20.109429+0000 mgr.a (mgr.14388) 11680 : cluster [DBG] pgmap v8096: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:22.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:41:22.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:41:22.698 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:41:23.442 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:23.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:23.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:23.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:23.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:23 smithi191 bash[24992]: cluster 2024-08-31T06:41:22.110189+0000 mgr.a (mgr.14388) 11681 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:23 smithi163 bash[24253]: cluster 2024-08-31T06:41:22.110189+0000 mgr.a (mgr.14388) 11681 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:23 smithi027 bash[22610]: cluster 2024-08-31T06:41:22.110189+0000 mgr.a (mgr.14388) 11681 : cluster [DBG] pgmap v8097: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:24 smithi191 bash[24992]: audit 2024-08-31T06:41:23.025200+0000 mgr.a (mgr.14388) 11682 : audit [DBG] from='client.256527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:24 smithi163 bash[24253]: audit 2024-08-31T06:41:23.025200+0000 mgr.a (mgr.14388) 11682 : audit [DBG] from='client.256527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:24 smithi027 bash[22610]: audit 2024-08-31T06:41:23.025200+0000 mgr.a (mgr.14388) 11682 : audit [DBG] from='client.256527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:25 smithi191 bash[24992]: cluster 2024-08-31T06:41:24.113017+0000 mgr.a (mgr.14388) 11683 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:25 smithi163 bash[24253]: cluster 2024-08-31T06:41:24.113017+0000 mgr.a (mgr.14388) 11683 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:25 smithi027 bash[22610]: cluster 2024-08-31T06:41:24.113017+0000 mgr.a (mgr.14388) 11683 : cluster [DBG] pgmap v8098: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:27 smithi191 bash[24992]: cluster 2024-08-31T06:41:26.113796+0000 mgr.a (mgr.14388) 11684 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:41:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:27 smithi163 bash[24253]: cluster 2024-08-31T06:41:26.113796+0000 mgr.a (mgr.14388) 11684 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:41:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:27 smithi027 bash[22610]: cluster 2024-08-31T06:41:26.113796+0000 mgr.a (mgr.14388) 11684 : cluster [DBG] pgmap v8099: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:41:28.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:41:28.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:41:28.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:41:29.223 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:29.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:29.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:29.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:29.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:29 smithi163 bash[24253]: cluster 2024-08-31T06:41:28.115708+0000 mgr.a (mgr.14388) 11685 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:29 smithi027 bash[22610]: cluster 2024-08-31T06:41:28.115708+0000 mgr.a (mgr.14388) 11685 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:29 smithi191 bash[24992]: cluster 2024-08-31T06:41:28.115708+0000 mgr.a (mgr.14388) 11685 : cluster [DBG] pgmap v8100: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:30 smithi163 bash[24253]: audit 2024-08-31T06:41:28.782930+0000 mgr.a (mgr.14388) 11686 : audit [DBG] from='client.256605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:30 smithi027 bash[22610]: audit 2024-08-31T06:41:28.782930+0000 mgr.a (mgr.14388) 11686 : audit [DBG] from='client.256605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:30 smithi191 bash[24992]: audit 2024-08-31T06:41:28.782930+0000 mgr.a (mgr.14388) 11686 : audit [DBG] from='client.256605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:31 smithi163 bash[24253]: cluster 2024-08-31T06:41:30.116810+0000 mgr.a (mgr.14388) 11687 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:41:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:31 smithi027 bash[22610]: cluster 2024-08-31T06:41:30.116810+0000 mgr.a (mgr.14388) 11687 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:41:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:31 smithi191 bash[24992]: cluster 2024-08-31T06:41:30.116810+0000 mgr.a (mgr.14388) 11687 : cluster [DBG] pgmap v8101: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:41:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:33 smithi163 bash[24253]: cluster 2024-08-31T06:41:32.117775+0000 mgr.a (mgr.14388) 11688 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:41:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:33 smithi027 bash[22610]: cluster 2024-08-31T06:41:32.117775+0000 mgr.a (mgr.14388) 11688 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:41:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:33 smithi191 bash[24992]: cluster 2024-08-31T06:41:32.117775+0000 mgr.a (mgr.14388) 11688 : cluster [DBG] pgmap v8102: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:41:34.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:41:34.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:41:34.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:41:34.972 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:34.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:34.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:34.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:34.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:35 smithi163 bash[24253]: cluster 2024-08-31T06:41:34.120144+0000 mgr.a (mgr.14388) 11689 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:35 smithi027 bash[22610]: cluster 2024-08-31T06:41:34.120144+0000 mgr.a (mgr.14388) 11689 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:35 smithi191 bash[24992]: cluster 2024-08-31T06:41:34.120144+0000 mgr.a (mgr.14388) 11689 : cluster [DBG] pgmap v8103: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:36 smithi163 bash[24253]: audit 2024-08-31T06:41:34.556657+0000 mgr.a (mgr.14388) 11690 : audit [DBG] from='client.256683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:36 smithi027 bash[22610]: audit 2024-08-31T06:41:34.556657+0000 mgr.a (mgr.14388) 11690 : audit [DBG] from='client.256683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:36 smithi191 bash[24992]: audit 2024-08-31T06:41:34.556657+0000 mgr.a (mgr.14388) 11690 : audit [DBG] from='client.256683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:37 smithi163 bash[24253]: cluster 2024-08-31T06:41:36.121131+0000 mgr.a (mgr.14388) 11691 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:37 smithi027 bash[22610]: cluster 2024-08-31T06:41:36.121131+0000 mgr.a (mgr.14388) 11691 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:37 smithi191 bash[24992]: cluster 2024-08-31T06:41:36.121131+0000 mgr.a (mgr.14388) 11691 : cluster [DBG] pgmap v8104: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:39 smithi163 bash[24253]: cluster 2024-08-31T06:41:38.123313+0000 mgr.a (mgr.14388) 11692 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:39.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:39 smithi027 bash[22610]: cluster 2024-08-31T06:41:38.123313+0000 mgr.a (mgr.14388) 11692 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:39 smithi191 bash[24992]: cluster 2024-08-31T06:41:38.123313+0000 mgr.a (mgr.14388) 11692 : cluster [DBG] pgmap v8105: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:39.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:41:39.974 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:41:39.974 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:41:40.756 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:40.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:40.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:40.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:40.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:41 smithi163 bash[24253]: cluster 2024-08-31T06:41:40.123955+0000 mgr.a (mgr.14388) 11693 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:41 smithi163 bash[24253]: audit 2024-08-31T06:41:40.310412+0000 mgr.a (mgr.14388) 11694 : audit [DBG] from='client.256758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:41 smithi027 bash[22610]: cluster 2024-08-31T06:41:40.123955+0000 mgr.a (mgr.14388) 11693 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:41 smithi027 bash[22610]: audit 2024-08-31T06:41:40.310412+0000 mgr.a (mgr.14388) 11694 : audit [DBG] from='client.256758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:41 smithi191 bash[24992]: cluster 2024-08-31T06:41:40.123955+0000 mgr.a (mgr.14388) 11693 : cluster [DBG] pgmap v8106: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:41 smithi191 bash[24992]: audit 2024-08-31T06:41:40.310412+0000 mgr.a (mgr.14388) 11694 : audit [DBG] from='client.256758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:43 smithi163 bash[24253]: cluster 2024-08-31T06:41:42.124932+0000 mgr.a (mgr.14388) 11695 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:43 smithi027 bash[22610]: cluster 2024-08-31T06:41:42.124932+0000 mgr.a (mgr.14388) 11695 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:43 smithi191 bash[24992]: cluster 2024-08-31T06:41:42.124932+0000 mgr.a (mgr.14388) 11695 : cluster [DBG] pgmap v8107: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:45 smithi163 bash[24253]: cluster 2024-08-31T06:41:44.127237+0000 mgr.a (mgr.14388) 11696 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:45.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:45 smithi027 bash[22610]: cluster 2024-08-31T06:41:44.127237+0000 mgr.a (mgr.14388) 11696 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:45.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:41:45.759 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:41:45.759 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:41:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:45 smithi191 bash[24992]: cluster 2024-08-31T06:41:44.127237+0000 mgr.a (mgr.14388) 11696 : cluster [DBG] pgmap v8108: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:46.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:46.525 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:47 smithi163 bash[24253]: audit 2024-08-31T06:41:46.091278+0000 mgr.a (mgr.14388) 11697 : audit [DBG] from='client.256836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:47.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:47 smithi163 bash[24253]: cluster 2024-08-31T06:41:46.128013+0000 mgr.a (mgr.14388) 11698 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:47 smithi027 bash[22610]: audit 2024-08-31T06:41:46.091278+0000 mgr.a (mgr.14388) 11697 : audit [DBG] from='client.256836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:47 smithi027 bash[22610]: cluster 2024-08-31T06:41:46.128013+0000 mgr.a (mgr.14388) 11698 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:47 smithi191 bash[24992]: audit 2024-08-31T06:41:46.091278+0000 mgr.a (mgr.14388) 11697 : audit [DBG] from='client.256836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:47 smithi191 bash[24992]: cluster 2024-08-31T06:41:46.128013+0000 mgr.a (mgr.14388) 11698 : cluster [DBG] pgmap v8109: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:49 smithi163 bash[24253]: cluster 2024-08-31T06:41:48.130298+0000 mgr.a (mgr.14388) 11699 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:49 smithi027 bash[22610]: cluster 2024-08-31T06:41:48.130298+0000 mgr.a (mgr.14388) 11699 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:49 smithi191 bash[24992]: cluster 2024-08-31T06:41:48.130298+0000 mgr.a (mgr.14388) 11699 : cluster [DBG] pgmap v8110: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:41:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:50 smithi163 bash[24253]: audit 2024-08-31T06:41:49.821930+0000 mon.a (mon.0) 2324 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:41:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:50 smithi027 bash[22610]: audit 2024-08-31T06:41:49.821930+0000 mon.a (mon.0) 2324 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:41:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:50 smithi191 bash[24992]: audit 2024-08-31T06:41:49.821930+0000 mon.a (mon.0) 2324 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:41:51.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:41:51.526 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:41:51.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:41:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:51 smithi163 bash[24253]: cluster 2024-08-31T06:41:50.130902+0000 mgr.a (mgr.14388) 11700 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:51 smithi163 bash[24253]: audit 2024-08-31T06:41:50.668098+0000 mon.a (mon.0) 2325 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:41:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:51 smithi163 bash[24253]: audit 2024-08-31T06:41:50.669633+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:41:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:51 smithi163 bash[24253]: audit 2024-08-31T06:41:50.679551+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:41:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:51 smithi163 bash[24253]: audit 2024-08-31T06:41:50.684353+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:41:51.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:41:51 smithi027 bash[22863]: debug 2024-08-31T06:41:51.414+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:41:51.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:41:51 smithi027 bash[22863]: debug 2024-08-31T06:41:51.414+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:41:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:51 smithi027 bash[22610]: cluster 2024-08-31T06:41:50.130902+0000 mgr.a (mgr.14388) 11700 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:51 smithi027 bash[22610]: audit 2024-08-31T06:41:50.668098+0000 mon.a (mon.0) 2325 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:41:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:51 smithi027 bash[22610]: audit 2024-08-31T06:41:50.669633+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:41:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:51 smithi027 bash[22610]: audit 2024-08-31T06:41:50.679551+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:41:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:51 smithi027 bash[22610]: audit 2024-08-31T06:41:50.684353+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:41:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:51 smithi191 bash[24992]: cluster 2024-08-31T06:41:50.130902+0000 mgr.a (mgr.14388) 11700 : cluster [DBG] pgmap v8111: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:51 smithi191 bash[24992]: audit 2024-08-31T06:41:50.668098+0000 mon.a (mon.0) 2325 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:41:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:51 smithi191 bash[24992]: audit 2024-08-31T06:41:50.669633+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:41:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:51 smithi191 bash[24992]: audit 2024-08-31T06:41:50.679551+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:41:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:51 smithi191 bash[24992]: audit 2024-08-31T06:41:50.684353+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:41:52.251 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:52 smithi163 bash[24253]: audit 2024-08-31T06:41:50.686689+0000 mgr.a (mgr.14388) 11701 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:41:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:52 smithi163 bash[24253]: audit 2024-08-31T06:41:51.416902+0000 mgr.a (mgr.14388) 11702 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:41:52.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:52 smithi163 bash[24253]: cephadm 2024-08-31T06:41:51.418160+0000 mgr.a (mgr.14388) 11703 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:41:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:52 smithi027 bash[22610]: audit 2024-08-31T06:41:50.686689+0000 mgr.a (mgr.14388) 11701 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:41:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:52 smithi027 bash[22610]: audit 2024-08-31T06:41:51.416902+0000 mgr.a (mgr.14388) 11702 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:41:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:52 smithi027 bash[22610]: cephadm 2024-08-31T06:41:51.418160+0000 mgr.a (mgr.14388) 11703 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:41:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:52 smithi191 bash[24992]: audit 2024-08-31T06:41:50.686689+0000 mgr.a (mgr.14388) 11701 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:41:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:52 smithi191 bash[24992]: audit 2024-08-31T06:41:51.416902+0000 mgr.a (mgr.14388) 11702 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:41:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:52 smithi191 bash[24992]: cephadm 2024-08-31T06:41:51.418160+0000 mgr.a (mgr.14388) 11703 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:41:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:53 smithi163 bash[24253]: audit 2024-08-31T06:41:51.844146+0000 mgr.a (mgr.14388) 11704 : audit [DBG] from='client.257019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:53 smithi163 bash[24253]: cluster 2024-08-31T06:41:52.131340+0000 mgr.a (mgr.14388) 11705 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:53 smithi027 bash[22610]: audit 2024-08-31T06:41:51.844146+0000 mgr.a (mgr.14388) 11704 : audit [DBG] from='client.257019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:53 smithi027 bash[22610]: cluster 2024-08-31T06:41:52.131340+0000 mgr.a (mgr.14388) 11705 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:53 smithi191 bash[24992]: audit 2024-08-31T06:41:51.844146+0000 mgr.a (mgr.14388) 11704 : audit [DBG] from='client.257019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:53 smithi191 bash[24992]: cluster 2024-08-31T06:41:52.131340+0000 mgr.a (mgr.14388) 11705 : cluster [DBG] pgmap v8112: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:41:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:55 smithi163 bash[24253]: cluster 2024-08-31T06:41:54.133747+0000 mgr.a (mgr.14388) 11706 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:55 smithi027 bash[22610]: cluster 2024-08-31T06:41:54.133747+0000 mgr.a (mgr.14388) 11706 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:55 smithi191 bash[24992]: cluster 2024-08-31T06:41:54.133747+0000 mgr.a (mgr.14388) 11706 : cluster [DBG] pgmap v8113: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:57.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:41:57.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:41:57.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:41:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:57 smithi163 bash[24253]: cluster 2024-08-31T06:41:56.134545+0000 mgr.a (mgr.14388) 11707 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:57 smithi027 bash[22610]: cluster 2024-08-31T06:41:56.134545+0000 mgr.a (mgr.14388) 11707 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:57 smithi191 bash[24992]: cluster 2024-08-31T06:41:56.134545+0000 mgr.a (mgr.14388) 11707 : cluster [DBG] pgmap v8114: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:58.037 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:41:58.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:41:58.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:41:58.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:41:58.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:41:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:59 smithi163 bash[24253]: audit 2024-08-31T06:41:57.589942+0000 mgr.a (mgr.14388) 11708 : audit [DBG] from='client.257097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:41:59 smithi163 bash[24253]: cluster 2024-08-31T06:41:58.136860+0000 mgr.a (mgr.14388) 11709 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:59 smithi027 bash[22610]: audit 2024-08-31T06:41:57.589942+0000 mgr.a (mgr.14388) 11708 : audit [DBG] from='client.257097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:41:59 smithi027 bash[22610]: cluster 2024-08-31T06:41:58.136860+0000 mgr.a (mgr.14388) 11709 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:41:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:59 smithi191 bash[24992]: audit 2024-08-31T06:41:57.589942+0000 mgr.a (mgr.14388) 11708 : audit [DBG] from='client.257097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:41:59 smithi191 bash[24992]: cluster 2024-08-31T06:41:58.136860+0000 mgr.a (mgr.14388) 11709 : cluster [DBG] pgmap v8115: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:42:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:01 smithi163 bash[24253]: cluster 2024-08-31T06:42:00.137643+0000 mgr.a (mgr.14388) 11710 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:42:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:01 smithi027 bash[22610]: cluster 2024-08-31T06:42:00.137643+0000 mgr.a (mgr.14388) 11710 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:42:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:01 smithi191 bash[24992]: cluster 2024-08-31T06:42:00.137643+0000 mgr.a (mgr.14388) 11710 : cluster [DBG] pgmap v8116: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:42:03.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:42:03.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:42:03.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:42:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:03 smithi163 bash[24253]: cluster 2024-08-31T06:42:02.138407+0000 mgr.a (mgr.14388) 11711 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:42:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:03 smithi027 bash[22610]: cluster 2024-08-31T06:42:02.138407+0000 mgr.a (mgr.14388) 11711 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:42:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:03 smithi191 bash[24992]: cluster 2024-08-31T06:42:02.138407+0000 mgr.a (mgr.14388) 11711 : cluster [DBG] pgmap v8117: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:42:03.805 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:42:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:42:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:42:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:42:03.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:42:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:04 smithi163 bash[24253]: audit 2024-08-31T06:42:03.374467+0000 mgr.a (mgr.14388) 11712 : audit [DBG] from='client.257175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:04 smithi027 bash[22610]: audit 2024-08-31T06:42:03.374467+0000 mgr.a (mgr.14388) 11712 : audit [DBG] from='client.257175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:04 smithi191 bash[24992]: audit 2024-08-31T06:42:03.374467+0000 mgr.a (mgr.14388) 11712 : audit [DBG] from='client.257175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:05 smithi163 bash[24253]: cluster 2024-08-31T06:42:04.141183+0000 mgr.a (mgr.14388) 11713 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:42:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:05 smithi027 bash[22610]: cluster 2024-08-31T06:42:04.141183+0000 mgr.a (mgr.14388) 11713 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:42:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:05 smithi191 bash[24992]: cluster 2024-08-31T06:42:04.141183+0000 mgr.a (mgr.14388) 11713 : cluster [DBG] pgmap v8118: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:42:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:07 smithi163 bash[24253]: cluster 2024-08-31T06:42:06.141972+0000 mgr.a (mgr.14388) 11714 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:42:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:07 smithi027 bash[22610]: cluster 2024-08-31T06:42:06.141972+0000 mgr.a (mgr.14388) 11714 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:42:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:07 smithi191 bash[24992]: cluster 2024-08-31T06:42:06.141972+0000 mgr.a (mgr.14388) 11714 : cluster [DBG] pgmap v8119: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:42:08.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:42:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:42:08.808 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:42:09.550 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:42:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:42:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:42:09.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:42:09.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:42:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:09 smithi163 bash[24253]: cluster 2024-08-31T06:42:08.143912+0000 mgr.a (mgr.14388) 11715 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:09 smithi027 bash[22610]: cluster 2024-08-31T06:42:08.143912+0000 mgr.a (mgr.14388) 11715 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:09 smithi191 bash[24992]: cluster 2024-08-31T06:42:08.143912+0000 mgr.a (mgr.14388) 11715 : cluster [DBG] pgmap v8120: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:10 smithi163 bash[24253]: audit 2024-08-31T06:42:09.133661+0000 mgr.a (mgr.14388) 11716 : audit [DBG] from='client.257247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:10 smithi027 bash[22610]: audit 2024-08-31T06:42:09.133661+0000 mgr.a (mgr.14388) 11716 : audit [DBG] from='client.257247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:10 smithi191 bash[24992]: audit 2024-08-31T06:42:09.133661+0000 mgr.a (mgr.14388) 11716 : audit [DBG] from='client.257247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:11 smithi163 bash[24253]: cluster 2024-08-31T06:42:10.144891+0000 mgr.a (mgr.14388) 11717 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:42:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:11 smithi027 bash[22610]: cluster 2024-08-31T06:42:10.144891+0000 mgr.a (mgr.14388) 11717 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:42:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:11 smithi191 bash[24992]: cluster 2024-08-31T06:42:10.144891+0000 mgr.a (mgr.14388) 11717 : cluster [DBG] pgmap v8121: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:42:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:13 smithi163 bash[24253]: cluster 2024-08-31T06:42:12.145711+0000 mgr.a (mgr.14388) 11718 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:42:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:13 smithi027 bash[22610]: cluster 2024-08-31T06:42:12.145711+0000 mgr.a (mgr.14388) 11718 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:42:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:13 smithi191 bash[24992]: cluster 2024-08-31T06:42:12.145711+0000 mgr.a (mgr.14388) 11718 : cluster [DBG] pgmap v8122: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:42:14.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:42:14.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:42:14.552 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:42:15.308 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:42:15.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:42:15.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:42:15.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:42:15.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:42:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:15 smithi163 bash[24253]: cluster 2024-08-31T06:42:14.147927+0000 mgr.a (mgr.14388) 11719 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:42:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:15 smithi027 bash[22610]: cluster 2024-08-31T06:42:14.147927+0000 mgr.a (mgr.14388) 11719 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:42:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:15 smithi191 bash[24992]: cluster 2024-08-31T06:42:14.147927+0000 mgr.a (mgr.14388) 11719 : cluster [DBG] pgmap v8123: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:42:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:16 smithi163 bash[24253]: audit 2024-08-31T06:42:14.890983+0000 mgr.a (mgr.14388) 11720 : audit [DBG] from='client.257322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:16 smithi027 bash[22610]: audit 2024-08-31T06:42:14.890983+0000 mgr.a (mgr.14388) 11720 : audit [DBG] from='client.257322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:16 smithi191 bash[24992]: audit 2024-08-31T06:42:14.890983+0000 mgr.a (mgr.14388) 11720 : audit [DBG] from='client.257322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:17 smithi163 bash[24253]: cluster 2024-08-31T06:42:16.148863+0000 mgr.a (mgr.14388) 11721 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:17.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:17 smithi027 bash[22610]: cluster 2024-08-31T06:42:16.148863+0000 mgr.a (mgr.14388) 11721 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:17 smithi191 bash[24992]: cluster 2024-08-31T06:42:16.148863+0000 mgr.a (mgr.14388) 11721 : cluster [DBG] pgmap v8124: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:19 smithi163 bash[24253]: cluster 2024-08-31T06:42:18.151022+0000 mgr.a (mgr.14388) 11722 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:42:19.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:19 smithi027 bash[22610]: cluster 2024-08-31T06:42:18.151022+0000 mgr.a (mgr.14388) 11722 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:42:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:19 smithi191 bash[24992]: cluster 2024-08-31T06:42:18.151022+0000 mgr.a (mgr.14388) 11722 : cluster [DBG] pgmap v8125: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:42:20.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:42:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:42:20.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:42:21.092 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:42:21.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:42:21.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:42:21.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:42:21.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:42:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:21 smithi163 bash[24253]: cluster 2024-08-31T06:42:20.151918+0000 mgr.a (mgr.14388) 11723 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:21 smithi027 bash[22610]: cluster 2024-08-31T06:42:20.151918+0000 mgr.a (mgr.14388) 11723 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:21 smithi191 bash[24992]: cluster 2024-08-31T06:42:20.151918+0000 mgr.a (mgr.14388) 11723 : cluster [DBG] pgmap v8126: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:22 smithi027 bash[22610]: audit 2024-08-31T06:42:20.645721+0000 mgr.a (mgr.14388) 11724 : audit [DBG] from='client.257400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:22 smithi191 bash[24992]: audit 2024-08-31T06:42:20.645721+0000 mgr.a (mgr.14388) 11724 : audit [DBG] from='client.257400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:22 smithi163 bash[24253]: audit 2024-08-31T06:42:20.645721+0000 mgr.a (mgr.14388) 11724 : audit [DBG] from='client.257400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:23 smithi027 bash[22610]: cluster 2024-08-31T06:42:22.152934+0000 mgr.a (mgr.14388) 11725 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:23 smithi191 bash[24992]: cluster 2024-08-31T06:42:22.152934+0000 mgr.a (mgr.14388) 11725 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:23 smithi163 bash[24253]: cluster 2024-08-31T06:42:22.152934+0000 mgr.a (mgr.14388) 11725 : cluster [DBG] pgmap v8127: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:25 smithi027 bash[22610]: cluster 2024-08-31T06:42:24.155221+0000 mgr.a (mgr.14388) 11726 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:42:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:25 smithi191 bash[24992]: cluster 2024-08-31T06:42:24.155221+0000 mgr.a (mgr.14388) 11726 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:42:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:25 smithi163 bash[24253]: cluster 2024-08-31T06:42:24.155221+0000 mgr.a (mgr.14388) 11726 : cluster [DBG] pgmap v8128: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:42:26.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:42:26.095 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:42:26.095 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:42:26.880 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:42:26.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:42:26.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:42:26.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:42:26.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:42:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:27 smithi027 bash[22610]: cluster 2024-08-31T06:42:26.155980+0000 mgr.a (mgr.14388) 11727 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:42:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:27 smithi027 bash[22610]: audit 2024-08-31T06:42:26.432388+0000 mgr.a (mgr.14388) 11728 : audit [DBG] from='client.257472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:27 smithi191 bash[24992]: cluster 2024-08-31T06:42:26.155980+0000 mgr.a (mgr.14388) 11727 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:42:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:27 smithi191 bash[24992]: audit 2024-08-31T06:42:26.432388+0000 mgr.a (mgr.14388) 11728 : audit [DBG] from='client.257472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:27 smithi163 bash[24253]: cluster 2024-08-31T06:42:26.155980+0000 mgr.a (mgr.14388) 11727 : cluster [DBG] pgmap v8129: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:42:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:27 smithi163 bash[24253]: audit 2024-08-31T06:42:26.432388+0000 mgr.a (mgr.14388) 11728 : audit [DBG] from='client.257472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:29 smithi027 bash[22610]: cluster 2024-08-31T06:42:28.158229+0000 mgr.a (mgr.14388) 11729 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:42:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:29 smithi191 bash[24992]: cluster 2024-08-31T06:42:28.158229+0000 mgr.a (mgr.14388) 11729 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:42:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:29 smithi163 bash[24253]: cluster 2024-08-31T06:42:28.158229+0000 mgr.a (mgr.14388) 11729 : cluster [DBG] pgmap v8130: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:42:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:31 smithi027 bash[22610]: cluster 2024-08-31T06:42:30.159039+0000 mgr.a (mgr.14388) 11730 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:42:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:31 smithi191 bash[24992]: cluster 2024-08-31T06:42:30.159039+0000 mgr.a (mgr.14388) 11730 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:42:31.881 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:42:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:42:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:42:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:31 smithi163 bash[24253]: cluster 2024-08-31T06:42:30.159039+0000 mgr.a (mgr.14388) 11730 : cluster [DBG] pgmap v8131: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:42:32.663 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:42:32.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:42:32.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:42:32.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:42:32.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:42:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:32 smithi191 bash[24992]: cluster 2024-08-31T06:42:32.159688+0000 mgr.a (mgr.14388) 11731 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:42:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:32 smithi191 bash[24992]: audit 2024-08-31T06:42:32.215201+0000 mgr.a (mgr.14388) 11732 : audit [DBG] from='client.257547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:32 smithi163 bash[24253]: cluster 2024-08-31T06:42:32.159688+0000 mgr.a (mgr.14388) 11731 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:42:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:32 smithi163 bash[24253]: audit 2024-08-31T06:42:32.215201+0000 mgr.a (mgr.14388) 11732 : audit [DBG] from='client.257547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:32 smithi027 bash[22610]: cluster 2024-08-31T06:42:32.159688+0000 mgr.a (mgr.14388) 11731 : cluster [DBG] pgmap v8132: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:42:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:32 smithi027 bash[22610]: audit 2024-08-31T06:42:32.215201+0000 mgr.a (mgr.14388) 11732 : audit [DBG] from='client.257547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:35 smithi027 bash[22610]: cluster 2024-08-31T06:42:34.161990+0000 mgr.a (mgr.14388) 11733 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:42:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:35 smithi191 bash[24992]: cluster 2024-08-31T06:42:34.161990+0000 mgr.a (mgr.14388) 11733 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:42:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:35 smithi163 bash[24253]: cluster 2024-08-31T06:42:34.161990+0000 mgr.a (mgr.14388) 11733 : cluster [DBG] pgmap v8133: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:42:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:37 smithi027 bash[22610]: cluster 2024-08-31T06:42:36.162778+0000 mgr.a (mgr.14388) 11734 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:37 smithi191 bash[24992]: cluster 2024-08-31T06:42:36.162778+0000 mgr.a (mgr.14388) 11734 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:37.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:42:37.666 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:42:37.666 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:42:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:37 smithi163 bash[24253]: cluster 2024-08-31T06:42:36.162778+0000 mgr.a (mgr.14388) 11734 : cluster [DBG] pgmap v8134: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:38.498 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:42:38.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:42:38.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:42:38.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:42:38.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:42:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:39 smithi027 bash[22610]: audit 2024-08-31T06:42:38.032313+0000 mgr.a (mgr.14388) 11735 : audit [DBG] from='client.257622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:39 smithi027 bash[22610]: cluster 2024-08-31T06:42:38.174064+0000 mgr.a (mgr.14388) 11736 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-31T06:42:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:39 smithi191 bash[24992]: audit 2024-08-31T06:42:38.032313+0000 mgr.a (mgr.14388) 11735 : audit [DBG] from='client.257622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:39 smithi191 bash[24992]: cluster 2024-08-31T06:42:38.174064+0000 mgr.a (mgr.14388) 11736 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-31T06:42:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:39 smithi163 bash[24253]: audit 2024-08-31T06:42:38.032313+0000 mgr.a (mgr.14388) 11735 : audit [DBG] from='client.257622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:39 smithi163 bash[24253]: cluster 2024-08-31T06:42:38.174064+0000 mgr.a (mgr.14388) 11736 : cluster [DBG] pgmap v8135: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-31T06:42:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:41 smithi027 bash[22610]: cluster 2024-08-31T06:42:40.175134+0000 mgr.a (mgr.14388) 11737 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-31T06:42:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:41 smithi191 bash[24992]: cluster 2024-08-31T06:42:40.175134+0000 mgr.a (mgr.14388) 11737 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-31T06:42:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:41 smithi163 bash[24253]: cluster 2024-08-31T06:42:40.175134+0000 mgr.a (mgr.14388) 11737 : cluster [DBG] pgmap v8136: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-31T06:42:43.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:42:43.500 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:42:43.501 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:42:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:43 smithi191 bash[24992]: cluster 2024-08-31T06:42:42.175930+0000 mgr.a (mgr.14388) 11738 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-31T06:42:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:43 smithi163 bash[24253]: cluster 2024-08-31T06:42:42.175930+0000 mgr.a (mgr.14388) 11738 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-31T06:42:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:43 smithi027 bash[22610]: cluster 2024-08-31T06:42:42.175930+0000 mgr.a (mgr.14388) 11738 : cluster [DBG] pgmap v8137: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-31T06:42:44.255 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:42:44.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:42:44.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:42:44.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:42:44.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:42:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:45 smithi191 bash[24992]: audit 2024-08-31T06:42:43.831042+0000 mgr.a (mgr.14388) 11739 : audit [DBG] from='client.257700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:45 smithi191 bash[24992]: cluster 2024-08-31T06:42:44.177264+0000 mgr.a (mgr.14388) 11740 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T06:42:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:45 smithi163 bash[24253]: audit 2024-08-31T06:42:43.831042+0000 mgr.a (mgr.14388) 11739 : audit [DBG] from='client.257700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:45.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:45 smithi163 bash[24253]: cluster 2024-08-31T06:42:44.177264+0000 mgr.a (mgr.14388) 11740 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T06:42:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:45 smithi027 bash[22610]: audit 2024-08-31T06:42:43.831042+0000 mgr.a (mgr.14388) 11739 : audit [DBG] from='client.257700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:45.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:45 smithi027 bash[22610]: cluster 2024-08-31T06:42:44.177264+0000 mgr.a (mgr.14388) 11740 : cluster [DBG] pgmap v8138: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T06:42:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:47 smithi191 bash[24992]: cluster 2024-08-31T06:42:46.178039+0000 mgr.a (mgr.14388) 11741 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:42:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:47 smithi163 bash[24253]: cluster 2024-08-31T06:42:46.178039+0000 mgr.a (mgr.14388) 11741 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:42:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:47 smithi027 bash[22610]: cluster 2024-08-31T06:42:46.178039+0000 mgr.a (mgr.14388) 11741 : cluster [DBG] pgmap v8139: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T06:42:49.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:42:49.258 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:42:49.258 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:42:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:49 smithi191 bash[24992]: cluster 2024-08-31T06:42:48.179988+0000 mgr.a (mgr.14388) 11742 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T06:42:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:49 smithi163 bash[24253]: cluster 2024-08-31T06:42:48.179988+0000 mgr.a (mgr.14388) 11742 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T06:42:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:49 smithi027 bash[22610]: cluster 2024-08-31T06:42:48.179988+0000 mgr.a (mgr.14388) 11742 : cluster [DBG] pgmap v8140: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T06:42:50.022 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:42:50.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:42:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:42:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:42:50.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:42:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:51 smithi191 bash[24992]: audit 2024-08-31T06:42:49.591132+0000 mgr.a (mgr.14388) 11743 : audit [DBG] from='client.257778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:51 smithi191 bash[24992]: cluster 2024-08-31T06:42:50.180905+0000 mgr.a (mgr.14388) 11744 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-08-31T06:42:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:51 smithi163 bash[24253]: audit 2024-08-31T06:42:49.591132+0000 mgr.a (mgr.14388) 11743 : audit [DBG] from='client.257778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:51.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:51 smithi163 bash[24253]: cluster 2024-08-31T06:42:50.180905+0000 mgr.a (mgr.14388) 11744 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-08-31T06:42:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:51 smithi027 bash[22610]: audit 2024-08-31T06:42:49.591132+0000 mgr.a (mgr.14388) 11743 : audit [DBG] from='client.257778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:51 smithi027 bash[22610]: cluster 2024-08-31T06:42:50.180905+0000 mgr.a (mgr.14388) 11744 : cluster [DBG] pgmap v8141: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-08-31T06:42:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:52 smithi191 bash[24992]: audit 2024-08-31T06:42:51.468372+0000 mon.a (mon.0) 2329 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:42:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:52 smithi163 bash[24253]: audit 2024-08-31T06:42:51.468372+0000 mon.a (mon.0) 2329 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:42:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:52 smithi027 bash[22610]: audit 2024-08-31T06:42:51.468372+0000 mon.a (mon.0) 2329 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:42:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:53 smithi191 bash[24992]: cluster 2024-08-31T06:42:52.181340+0000 mgr.a (mgr.14388) 11745 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-08-31T06:42:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:53 smithi163 bash[24253]: cluster 2024-08-31T06:42:52.181340+0000 mgr.a (mgr.14388) 11745 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-08-31T06:42:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:53 smithi027 bash[22610]: cluster 2024-08-31T06:42:52.181340+0000 mgr.a (mgr.14388) 11745 : cluster [DBG] pgmap v8142: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 37 op/s 2024-08-31T06:42:55.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:42:55.024 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:42:55.025 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:42:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:55 smithi191 bash[24992]: cluster 2024-08-31T06:42:54.183517+0000 mgr.a (mgr.14388) 11746 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-08-31T06:42:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:55 smithi163 bash[24253]: cluster 2024-08-31T06:42:54.183517+0000 mgr.a (mgr.14388) 11746 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-08-31T06:42:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:55 smithi027 bash[22610]: cluster 2024-08-31T06:42:54.183517+0000 mgr.a (mgr.14388) 11746 : cluster [DBG] pgmap v8143: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 24 KiB/s rd, 0 B/s wr, 38 op/s 2024-08-31T06:42:55.791 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:42:55.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:42:55.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:42:55.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:42:55.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:42:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:56 smithi191 bash[24992]: audit 2024-08-31T06:42:55.364169+0000 mgr.a (mgr.14388) 11747 : audit [DBG] from='client.257856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:56 smithi163 bash[24253]: audit 2024-08-31T06:42:55.364169+0000 mgr.a (mgr.14388) 11747 : audit [DBG] from='client.257856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:56 smithi027 bash[22610]: audit 2024-08-31T06:42:55.364169+0000 mgr.a (mgr.14388) 11747 : audit [DBG] from='client.257856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:57 smithi191 bash[24992]: cluster 2024-08-31T06:42:56.184487+0000 mgr.a (mgr.14388) 11748 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:57 smithi163 bash[24253]: cluster 2024-08-31T06:42:56.184487+0000 mgr.a (mgr.14388) 11748 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:57 smithi027 bash[22610]: cluster 2024-08-31T06:42:56.184487+0000 mgr.a (mgr.14388) 11748 : cluster [DBG] pgmap v8144: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:42:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:42:59 smithi163 bash[24253]: cluster 2024-08-31T06:42:58.186408+0000 mgr.a (mgr.14388) 11749 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:42:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:42:59 smithi027 bash[22610]: cluster 2024-08-31T06:42:58.186408+0000 mgr.a (mgr.14388) 11749 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:42:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:42:59 smithi191 bash[24992]: cluster 2024-08-31T06:42:58.186408+0000 mgr.a (mgr.14388) 11749 : cluster [DBG] pgmap v8145: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:00.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:00.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:00.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:01.546 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:01.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:01.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:01.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:01.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:01.565 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:01 smithi027 bash[22610]: cluster 2024-08-31T06:43:00.187178+0000 mgr.a (mgr.14388) 11750 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:01 smithi163 bash[24253]: cluster 2024-08-31T06:43:00.187178+0000 mgr.a (mgr.14388) 11750 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:01 smithi191 bash[24992]: cluster 2024-08-31T06:43:00.187178+0000 mgr.a (mgr.14388) 11750 : cluster [DBG] pgmap v8146: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:02 smithi163 bash[24253]: audit 2024-08-31T06:43:01.115634+0000 mgr.a (mgr.14388) 11751 : audit [DBG] from='client.257931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:02 smithi163 bash[24253]: audit 2024-08-31T06:43:02.126317+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:43:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:02 smithi163 bash[24253]: audit 2024-08-31T06:43:02.132721+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:43:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:02 smithi163 bash[24253]: audit 2024-08-31T06:43:02.135060+0000 mon.a (mon.0) 2332 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:43:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:02 smithi163 bash[24253]: audit 2024-08-31T06:43:02.136686+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:43:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:02 smithi163 bash[24253]: audit 2024-08-31T06:43:02.145441+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:43:02.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:02 smithi163 bash[24253]: audit 2024-08-31T06:43:02.150765+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:43:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:02 smithi027 bash[22610]: audit 2024-08-31T06:43:01.115634+0000 mgr.a (mgr.14388) 11751 : audit [DBG] from='client.257931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:02 smithi027 bash[22610]: audit 2024-08-31T06:43:02.126317+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:43:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:02 smithi027 bash[22610]: audit 2024-08-31T06:43:02.132721+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:43:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:02 smithi027 bash[22610]: audit 2024-08-31T06:43:02.135060+0000 mon.a (mon.0) 2332 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:43:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:02 smithi027 bash[22610]: audit 2024-08-31T06:43:02.136686+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:43:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:02 smithi027 bash[22610]: audit 2024-08-31T06:43:02.145441+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:43:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:02 smithi027 bash[22610]: audit 2024-08-31T06:43:02.150765+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:43:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:02 smithi191 bash[24992]: audit 2024-08-31T06:43:01.115634+0000 mgr.a (mgr.14388) 11751 : audit [DBG] from='client.257931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:02 smithi191 bash[24992]: audit 2024-08-31T06:43:02.126317+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:43:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:02 smithi191 bash[24992]: audit 2024-08-31T06:43:02.132721+0000 mon.a (mon.0) 2331 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:43:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:02 smithi191 bash[24992]: audit 2024-08-31T06:43:02.135060+0000 mon.a (mon.0) 2332 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:43:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:02 smithi191 bash[24992]: audit 2024-08-31T06:43:02.136686+0000 mon.a (mon.0) 2333 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:43:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:02 smithi191 bash[24992]: audit 2024-08-31T06:43:02.145441+0000 mon.a (mon.0) 2334 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:43:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:02 smithi191 bash[24992]: audit 2024-08-31T06:43:02.150765+0000 mon.a (mon.0) 2335 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:43:03.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:43:02 smithi027 bash[22863]: debug 2024-08-31T06:43:02.900+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:43:03.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:43:02 smithi027 bash[22863]: debug 2024-08-31T06:43:02.900+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:43:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:03 smithi163 bash[24253]: audit 2024-08-31T06:43:02.152781+0000 mgr.a (mgr.14388) 11752 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:43:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:03 smithi163 bash[24253]: cluster 2024-08-31T06:43:02.188232+0000 mgr.a (mgr.14388) 11753 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:03 smithi027 bash[22610]: audit 2024-08-31T06:43:02.152781+0000 mgr.a (mgr.14388) 11752 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:43:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:03 smithi027 bash[22610]: cluster 2024-08-31T06:43:02.188232+0000 mgr.a (mgr.14388) 11753 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:03 smithi191 bash[24992]: audit 2024-08-31T06:43:02.152781+0000 mgr.a (mgr.14388) 11752 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:43:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:03 smithi191 bash[24992]: cluster 2024-08-31T06:43:02.188232+0000 mgr.a (mgr.14388) 11753 : cluster [DBG] pgmap v8147: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:04 smithi163 bash[24253]: audit 2024-08-31T06:43:02.905042+0000 mgr.a (mgr.14388) 11754 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:43:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:04 smithi163 bash[24253]: cephadm 2024-08-31T06:43:02.906490+0000 mgr.a (mgr.14388) 11755 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:43:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:04 smithi027 bash[22610]: audit 2024-08-31T06:43:02.905042+0000 mgr.a (mgr.14388) 11754 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:43:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:04 smithi027 bash[22610]: cephadm 2024-08-31T06:43:02.906490+0000 mgr.a (mgr.14388) 11755 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:43:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:04 smithi191 bash[24992]: audit 2024-08-31T06:43:02.905042+0000 mgr.a (mgr.14388) 11754 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:43:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:04 smithi191 bash[24992]: cephadm 2024-08-31T06:43:02.906490+0000 mgr.a (mgr.14388) 11755 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:43:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:05 smithi163 bash[24253]: cluster 2024-08-31T06:43:04.190533+0000 mgr.a (mgr.14388) 11756 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:43:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:05 smithi027 bash[22610]: cluster 2024-08-31T06:43:04.190533+0000 mgr.a (mgr.14388) 11756 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:43:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:05 smithi191 bash[24992]: cluster 2024-08-31T06:43:04.190533+0000 mgr.a (mgr.14388) 11756 : cluster [DBG] pgmap v8148: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:43:06.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:06.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:06.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:07.302 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:07.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:07.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:07.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:07.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:07 smithi163 bash[24253]: cluster 2024-08-31T06:43:06.191290+0000 mgr.a (mgr.14388) 11757 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:43:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:07 smithi027 bash[22610]: cluster 2024-08-31T06:43:06.191290+0000 mgr.a (mgr.14388) 11757 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:43:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:07 smithi191 bash[24992]: cluster 2024-08-31T06:43:06.191290+0000 mgr.a (mgr.14388) 11757 : cluster [DBG] pgmap v8149: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:43:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:08 smithi163 bash[24253]: audit 2024-08-31T06:43:06.879084+0000 mgr.a (mgr.14388) 11758 : audit [DBG] from='client.258114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:08 smithi027 bash[22610]: audit 2024-08-31T06:43:06.879084+0000 mgr.a (mgr.14388) 11758 : audit [DBG] from='client.258114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:08 smithi191 bash[24992]: audit 2024-08-31T06:43:06.879084+0000 mgr.a (mgr.14388) 11758 : audit [DBG] from='client.258114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:09 smithi163 bash[24253]: cluster 2024-08-31T06:43:08.193500+0000 mgr.a (mgr.14388) 11759 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:09 smithi027 bash[22610]: cluster 2024-08-31T06:43:08.193500+0000 mgr.a (mgr.14388) 11759 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:09 smithi191 bash[24992]: cluster 2024-08-31T06:43:08.193500+0000 mgr.a (mgr.14388) 11759 : cluster [DBG] pgmap v8150: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:11 smithi163 bash[24253]: cluster 2024-08-31T06:43:10.194289+0000 mgr.a (mgr.14388) 11760 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:11 smithi027 bash[22610]: cluster 2024-08-31T06:43:10.194289+0000 mgr.a (mgr.14388) 11760 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:11.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:11 smithi191 bash[24992]: cluster 2024-08-31T06:43:10.194289+0000 mgr.a (mgr.14388) 11760 : cluster [DBG] pgmap v8151: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:12.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:12.303 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:12.303 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:13.046 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:13.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:13.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:13.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:13.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:13 smithi163 bash[24253]: cluster 2024-08-31T06:43:12.195128+0000 mgr.a (mgr.14388) 11761 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:13 smithi027 bash[22610]: cluster 2024-08-31T06:43:12.195128+0000 mgr.a (mgr.14388) 11761 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:13 smithi191 bash[24992]: cluster 2024-08-31T06:43:12.195128+0000 mgr.a (mgr.14388) 11761 : cluster [DBG] pgmap v8152: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:14 smithi163 bash[24253]: audit 2024-08-31T06:43:12.631928+0000 mgr.a (mgr.14388) 11762 : audit [DBG] from='client.258192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:14 smithi027 bash[22610]: audit 2024-08-31T06:43:12.631928+0000 mgr.a (mgr.14388) 11762 : audit [DBG] from='client.258192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:14 smithi191 bash[24992]: audit 2024-08-31T06:43:12.631928+0000 mgr.a (mgr.14388) 11762 : audit [DBG] from='client.258192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:15 smithi163 bash[24253]: cluster 2024-08-31T06:43:14.197463+0000 mgr.a (mgr.14388) 11763 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:15 smithi027 bash[22610]: cluster 2024-08-31T06:43:14.197463+0000 mgr.a (mgr.14388) 11763 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:15 smithi191 bash[24992]: cluster 2024-08-31T06:43:14.197463+0000 mgr.a (mgr.14388) 11763 : cluster [DBG] pgmap v8153: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:43:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:17 smithi163 bash[24253]: cluster 2024-08-31T06:43:16.198227+0000 mgr.a (mgr.14388) 11764 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 170 B/s wr, 1 op/s 2024-08-31T06:43:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:17 smithi027 bash[22610]: cluster 2024-08-31T06:43:16.198227+0000 mgr.a (mgr.14388) 11764 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 170 B/s wr, 1 op/s 2024-08-31T06:43:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:17 smithi191 bash[24992]: cluster 2024-08-31T06:43:16.198227+0000 mgr.a (mgr.14388) 11764 : cluster [DBG] pgmap v8154: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 170 B/s wr, 1 op/s 2024-08-31T06:43:18.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:18.048 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:18.048 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:18.831 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:18.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:18.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:18.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:18.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:19 smithi163 bash[24253]: cluster 2024-08-31T06:43:18.200094+0000 mgr.a (mgr.14388) 11765 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T06:43:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:19 smithi163 bash[24253]: audit 2024-08-31T06:43:18.382579+0000 mgr.a (mgr.14388) 11766 : audit [DBG] from='client.258270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:19 smithi027 bash[22610]: cluster 2024-08-31T06:43:18.200094+0000 mgr.a (mgr.14388) 11765 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T06:43:19.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:19 smithi027 bash[22610]: audit 2024-08-31T06:43:18.382579+0000 mgr.a (mgr.14388) 11766 : audit [DBG] from='client.258270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:19 smithi191 bash[24992]: cluster 2024-08-31T06:43:18.200094+0000 mgr.a (mgr.14388) 11765 : cluster [DBG] pgmap v8155: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T06:43:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:19 smithi191 bash[24992]: audit 2024-08-31T06:43:18.382579+0000 mgr.a (mgr.14388) 11766 : audit [DBG] from='client.258270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:21 smithi163 bash[24253]: cluster 2024-08-31T06:43:20.201012+0000 mgr.a (mgr.14388) 11767 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:43:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:21 smithi027 bash[22610]: cluster 2024-08-31T06:43:20.201012+0000 mgr.a (mgr.14388) 11767 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:43:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:21 smithi191 bash[24992]: cluster 2024-08-31T06:43:20.201012+0000 mgr.a (mgr.14388) 11767 : cluster [DBG] pgmap v8156: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:43:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:23 smithi163 bash[24253]: cluster 2024-08-31T06:43:22.201852+0000 mgr.a (mgr.14388) 11768 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:43:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:23 smithi027 bash[22610]: cluster 2024-08-31T06:43:22.201852+0000 mgr.a (mgr.14388) 11768 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:43:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:23 smithi191 bash[24992]: cluster 2024-08-31T06:43:22.201852+0000 mgr.a (mgr.14388) 11768 : cluster [DBG] pgmap v8157: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:43:23.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:23.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:24.619 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:24.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:24.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:24.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:24.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:25 smithi163 bash[24253]: audit 2024-08-31T06:43:24.174706+0000 mgr.a (mgr.14388) 11769 : audit [DBG] from='client.258348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:25 smithi163 bash[24253]: cluster 2024-08-31T06:43:24.204817+0000 mgr.a (mgr.14388) 11770 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:25 smithi027 bash[22610]: audit 2024-08-31T06:43:24.174706+0000 mgr.a (mgr.14388) 11769 : audit [DBG] from='client.258348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:25 smithi027 bash[22610]: cluster 2024-08-31T06:43:24.204817+0000 mgr.a (mgr.14388) 11770 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:25 smithi191 bash[24992]: audit 2024-08-31T06:43:24.174706+0000 mgr.a (mgr.14388) 11769 : audit [DBG] from='client.258348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:25 smithi191 bash[24992]: cluster 2024-08-31T06:43:24.204817+0000 mgr.a (mgr.14388) 11770 : cluster [DBG] pgmap v8158: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:27 smithi163 bash[24253]: cluster 2024-08-31T06:43:26.205911+0000 mgr.a (mgr.14388) 11771 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:43:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:27 smithi027 bash[22610]: cluster 2024-08-31T06:43:26.205911+0000 mgr.a (mgr.14388) 11771 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:43:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:27 smithi191 bash[24992]: cluster 2024-08-31T06:43:26.205911+0000 mgr.a (mgr.14388) 11771 : cluster [DBG] pgmap v8159: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:43:29.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:29 smithi163 bash[24253]: cluster 2024-08-31T06:43:28.208091+0000 mgr.a (mgr.14388) 11772 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:43:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:29 smithi027 bash[22610]: cluster 2024-08-31T06:43:28.208091+0000 mgr.a (mgr.14388) 11772 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:43:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:29 smithi191 bash[24992]: cluster 2024-08-31T06:43:28.208091+0000 mgr.a (mgr.14388) 11772 : cluster [DBG] pgmap v8160: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T06:43:30.392 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:30.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:31 smithi163 bash[24253]: audit 2024-08-31T06:43:29.955024+0000 mgr.a (mgr.14388) 11773 : audit [DBG] from='client.258423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:31.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:31 smithi163 bash[24253]: cluster 2024-08-31T06:43:30.208654+0000 mgr.a (mgr.14388) 11774 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:31 smithi027 bash[22610]: audit 2024-08-31T06:43:29.955024+0000 mgr.a (mgr.14388) 11773 : audit [DBG] from='client.258423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:31 smithi027 bash[22610]: cluster 2024-08-31T06:43:30.208654+0000 mgr.a (mgr.14388) 11774 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:31 smithi191 bash[24992]: audit 2024-08-31T06:43:29.955024+0000 mgr.a (mgr.14388) 11773 : audit [DBG] from='client.258423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:31 smithi191 bash[24992]: cluster 2024-08-31T06:43:30.208654+0000 mgr.a (mgr.14388) 11774 : cluster [DBG] pgmap v8161: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:33 smithi163 bash[24253]: cluster 2024-08-31T06:43:32.209582+0000 mgr.a (mgr.14388) 11775 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:33 smithi027 bash[22610]: cluster 2024-08-31T06:43:32.209582+0000 mgr.a (mgr.14388) 11775 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:33 smithi191 bash[24992]: cluster 2024-08-31T06:43:32.209582+0000 mgr.a (mgr.14388) 11775 : cluster [DBG] pgmap v8162: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:35.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:35.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:35.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:35 smithi163 bash[24253]: cluster 2024-08-31T06:43:34.211889+0000 mgr.a (mgr.14388) 11776 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:35 smithi027 bash[22610]: cluster 2024-08-31T06:43:34.211889+0000 mgr.a (mgr.14388) 11776 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:35 smithi191 bash[24992]: cluster 2024-08-31T06:43:34.211889+0000 mgr.a (mgr.14388) 11776 : cluster [DBG] pgmap v8163: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:36.138 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:36.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:36.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:36.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:36.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:37 smithi163 bash[24253]: audit 2024-08-31T06:43:35.724429+0000 mgr.a (mgr.14388) 11777 : audit [DBG] from='client.258501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:37 smithi163 bash[24253]: cluster 2024-08-31T06:43:36.212834+0000 mgr.a (mgr.14388) 11778 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:37 smithi027 bash[22610]: audit 2024-08-31T06:43:35.724429+0000 mgr.a (mgr.14388) 11777 : audit [DBG] from='client.258501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:37 smithi027 bash[22610]: cluster 2024-08-31T06:43:36.212834+0000 mgr.a (mgr.14388) 11778 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:37 smithi191 bash[24992]: audit 2024-08-31T06:43:35.724429+0000 mgr.a (mgr.14388) 11777 : audit [DBG] from='client.258501 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:37 smithi191 bash[24992]: cluster 2024-08-31T06:43:36.212834+0000 mgr.a (mgr.14388) 11778 : cluster [DBG] pgmap v8164: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:39 smithi163 bash[24253]: cluster 2024-08-31T06:43:38.215001+0000 mgr.a (mgr.14388) 11779 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:39 smithi027 bash[22610]: cluster 2024-08-31T06:43:38.215001+0000 mgr.a (mgr.14388) 11779 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:39 smithi191 bash[24992]: cluster 2024-08-31T06:43:38.215001+0000 mgr.a (mgr.14388) 11779 : cluster [DBG] pgmap v8165: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:41.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:41.140 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:41.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:41 smithi163 bash[24253]: cluster 2024-08-31T06:43:40.215767+0000 mgr.a (mgr.14388) 11780 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:41 smithi027 bash[22610]: cluster 2024-08-31T06:43:40.215767+0000 mgr.a (mgr.14388) 11780 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:41 smithi191 bash[24992]: cluster 2024-08-31T06:43:40.215767+0000 mgr.a (mgr.14388) 11780 : cluster [DBG] pgmap v8166: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:41.891 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:41.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:41.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:41.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:41.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:42 smithi163 bash[24253]: audit 2024-08-31T06:43:41.477075+0000 mgr.a (mgr.14388) 11781 : audit [DBG] from='client.258579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:42 smithi027 bash[22610]: audit 2024-08-31T06:43:41.477075+0000 mgr.a (mgr.14388) 11781 : audit [DBG] from='client.258579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:42 smithi191 bash[24992]: audit 2024-08-31T06:43:41.477075+0000 mgr.a (mgr.14388) 11781 : audit [DBG] from='client.258579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:43 smithi163 bash[24253]: cluster 2024-08-31T06:43:42.216736+0000 mgr.a (mgr.14388) 11782 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:43 smithi027 bash[22610]: cluster 2024-08-31T06:43:42.216736+0000 mgr.a (mgr.14388) 11782 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:43 smithi191 bash[24992]: cluster 2024-08-31T06:43:42.216736+0000 mgr.a (mgr.14388) 11782 : cluster [DBG] pgmap v8167: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:45 smithi163 bash[24253]: cluster 2024-08-31T06:43:44.219060+0000 mgr.a (mgr.14388) 11783 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:45 smithi027 bash[22610]: cluster 2024-08-31T06:43:44.219060+0000 mgr.a (mgr.14388) 11783 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:45 smithi191 bash[24992]: cluster 2024-08-31T06:43:44.219060+0000 mgr.a (mgr.14388) 11783 : cluster [DBG] pgmap v8168: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:46.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:46.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:46.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:47.680 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:47.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:47.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:47.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:47.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:47 smithi163 bash[24253]: cluster 2024-08-31T06:43:46.219805+0000 mgr.a (mgr.14388) 11784 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:47 smithi027 bash[22610]: cluster 2024-08-31T06:43:46.219805+0000 mgr.a (mgr.14388) 11784 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:47 smithi191 bash[24992]: cluster 2024-08-31T06:43:46.219805+0000 mgr.a (mgr.14388) 11784 : cluster [DBG] pgmap v8169: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:48 smithi163 bash[24253]: audit 2024-08-31T06:43:47.225834+0000 mgr.a (mgr.14388) 11785 : audit [DBG] from='client.258657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:48 smithi027 bash[22610]: audit 2024-08-31T06:43:47.225834+0000 mgr.a (mgr.14388) 11785 : audit [DBG] from='client.258657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:48 smithi191 bash[24992]: audit 2024-08-31T06:43:47.225834+0000 mgr.a (mgr.14388) 11785 : audit [DBG] from='client.258657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:49 smithi163 bash[24253]: cluster 2024-08-31T06:43:48.222058+0000 mgr.a (mgr.14388) 11786 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:49 smithi027 bash[22610]: cluster 2024-08-31T06:43:48.222058+0000 mgr.a (mgr.14388) 11786 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:49 smithi191 bash[24992]: cluster 2024-08-31T06:43:48.222058+0000 mgr.a (mgr.14388) 11786 : cluster [DBG] pgmap v8170: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:43:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:51 smithi163 bash[24253]: cluster 2024-08-31T06:43:50.222863+0000 mgr.a (mgr.14388) 11787 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:51 smithi027 bash[22610]: cluster 2024-08-31T06:43:50.222863+0000 mgr.a (mgr.14388) 11787 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:51 smithi191 bash[24992]: cluster 2024-08-31T06:43:50.222863+0000 mgr.a (mgr.14388) 11787 : cluster [DBG] pgmap v8171: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:52.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:52.683 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:52.683 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:53.473 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:53.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:53.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:53.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:53.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:53 smithi163 bash[24253]: cluster 2024-08-31T06:43:52.223640+0000 mgr.a (mgr.14388) 11788 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:53 smithi027 bash[22610]: cluster 2024-08-31T06:43:52.223640+0000 mgr.a (mgr.14388) 11788 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:53 smithi191 bash[24992]: cluster 2024-08-31T06:43:52.223640+0000 mgr.a (mgr.14388) 11788 : cluster [DBG] pgmap v8172: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:54 smithi163 bash[24253]: audit 2024-08-31T06:43:53.018101+0000 mgr.a (mgr.14388) 11789 : audit [DBG] from='client.258729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:54 smithi027 bash[22610]: audit 2024-08-31T06:43:53.018101+0000 mgr.a (mgr.14388) 11789 : audit [DBG] from='client.258729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:54 smithi191 bash[24992]: audit 2024-08-31T06:43:53.018101+0000 mgr.a (mgr.14388) 11789 : audit [DBG] from='client.258729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:55 smithi027 bash[22610]: cluster 2024-08-31T06:43:54.226327+0000 mgr.a (mgr.14388) 11790 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:55 smithi191 bash[24992]: cluster 2024-08-31T06:43:54.226327+0000 mgr.a (mgr.14388) 11790 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:55 smithi163 bash[24253]: cluster 2024-08-31T06:43:54.226327+0000 mgr.a (mgr.14388) 11790 : cluster [DBG] pgmap v8173: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:57 smithi027 bash[22610]: cluster 2024-08-31T06:43:56.227148+0000 mgr.a (mgr.14388) 11791 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:43:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:57 smithi191 bash[24992]: cluster 2024-08-31T06:43:56.227148+0000 mgr.a (mgr.14388) 11791 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:43:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:57 smithi163 bash[24253]: cluster 2024-08-31T06:43:56.227148+0000 mgr.a (mgr.14388) 11791 : cluster [DBG] pgmap v8174: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:43:58.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:43:58.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:43:58.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:43:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:43:59.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:43:59.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:43:59.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:43:59.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:43:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:43:59 smithi027 bash[22610]: cluster 2024-08-31T06:43:58.229054+0000 mgr.a (mgr.14388) 11792 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:43:59 smithi191 bash[24992]: cluster 2024-08-31T06:43:58.229054+0000 mgr.a (mgr.14388) 11792 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:43:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:43:59 smithi163 bash[24253]: cluster 2024-08-31T06:43:58.229054+0000 mgr.a (mgr.14388) 11792 : cluster [DBG] pgmap v8175: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:00 smithi027 bash[22610]: audit 2024-08-31T06:43:58.809408+0000 mgr.a (mgr.14388) 11793 : audit [DBG] from='client.258807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:00 smithi191 bash[24992]: audit 2024-08-31T06:43:58.809408+0000 mgr.a (mgr.14388) 11793 : audit [DBG] from='client.258807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:00 smithi163 bash[24253]: audit 2024-08-31T06:43:58.809408+0000 mgr.a (mgr.14388) 11793 : audit [DBG] from='client.258807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:01 smithi027 bash[22610]: cluster 2024-08-31T06:44:00.229940+0000 mgr.a (mgr.14388) 11794 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:44:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:01 smithi191 bash[24992]: cluster 2024-08-31T06:44:00.229940+0000 mgr.a (mgr.14388) 11794 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:44:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:01 smithi163 bash[24253]: cluster 2024-08-31T06:44:00.229940+0000 mgr.a (mgr.14388) 11794 : cluster [DBG] pgmap v8176: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:44:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:03 smithi027 bash[22610]: cluster 2024-08-31T06:44:02.230744+0000 mgr.a (mgr.14388) 11795 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:44:03.891 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:03 smithi027 bash[22610]: audit 2024-08-31T06:44:02.964017+0000 mon.a (mon.0) 2336 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:44:03.892 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:03 smithi191 bash[24992]: cluster 2024-08-31T06:44:02.230744+0000 mgr.a (mgr.14388) 11795 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:44:03.892 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:03 smithi191 bash[24992]: audit 2024-08-31T06:44:02.964017+0000 mon.a (mon.0) 2336 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:44:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:03 smithi163 bash[24253]: cluster 2024-08-31T06:44:02.230744+0000 mgr.a (mgr.14388) 11795 : cluster [DBG] pgmap v8177: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:44:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:03 smithi163 bash[24253]: audit 2024-08-31T06:44:02.964017+0000 mon.a (mon.0) 2336 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:44:04.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:44:04.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:44:04.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:44:04.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:44:04.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:44:04.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:44:04.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:44:04.988 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:44:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:05 smithi027 bash[22610]: cluster 2024-08-31T06:44:04.232866+0000 mgr.a (mgr.14388) 11796 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:05 smithi191 bash[24992]: cluster 2024-08-31T06:44:04.232866+0000 mgr.a (mgr.14388) 11796 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:05 smithi163 bash[24253]: cluster 2024-08-31T06:44:04.232866+0000 mgr.a (mgr.14388) 11796 : cluster [DBG] pgmap v8178: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:06 smithi191 bash[24992]: audit 2024-08-31T06:44:04.573990+0000 mgr.a (mgr.14388) 11797 : audit [DBG] from='client.258885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:06 smithi163 bash[24253]: audit 2024-08-31T06:44:04.573990+0000 mgr.a (mgr.14388) 11797 : audit [DBG] from='client.258885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:06 smithi027 bash[22610]: audit 2024-08-31T06:44:04.573990+0000 mgr.a (mgr.14388) 11797 : audit [DBG] from='client.258885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:07 smithi191 bash[24992]: cluster 2024-08-31T06:44:06.233715+0000 mgr.a (mgr.14388) 11798 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:07 smithi163 bash[24253]: cluster 2024-08-31T06:44:06.233715+0000 mgr.a (mgr.14388) 11798 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:07.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:07 smithi027 bash[22610]: cluster 2024-08-31T06:44:06.233715+0000 mgr.a (mgr.14388) 11798 : cluster [DBG] pgmap v8179: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:09.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:09 smithi191 bash[24992]: cluster 2024-08-31T06:44:08.235870+0000 mgr.a (mgr.14388) 11799 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:09 smithi163 bash[24253]: cluster 2024-08-31T06:44:08.235870+0000 mgr.a (mgr.14388) 11799 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:09 smithi027 bash[22610]: cluster 2024-08-31T06:44:08.235870+0000 mgr.a (mgr.14388) 11799 : cluster [DBG] pgmap v8180: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:09.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:44:09.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:44:09.990 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:44:10.683 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:10 smithi163 bash[24253]: cluster 2024-08-31T06:44:10.236615+0000 mgr.a (mgr.14388) 11800 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:10.683 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:10 smithi163 bash[24253]: audit 2024-08-31T06:44:10.323722+0000 mgr.a (mgr.14388) 11801 : audit [DBG] from='client.258963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:10.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:44:10.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:44:10.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:44:10.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:44:10.750 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:44:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:10 smithi191 bash[24992]: cluster 2024-08-31T06:44:10.236615+0000 mgr.a (mgr.14388) 11800 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:10 smithi191 bash[24992]: audit 2024-08-31T06:44:10.323722+0000 mgr.a (mgr.14388) 11801 : audit [DBG] from='client.258963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:10 smithi027 bash[22610]: cluster 2024-08-31T06:44:10.236615+0000 mgr.a (mgr.14388) 11800 : cluster [DBG] pgmap v8181: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:10 smithi027 bash[22610]: audit 2024-08-31T06:44:10.323722+0000 mgr.a (mgr.14388) 11801 : audit [DBG] from='client.258963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:13.633 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:13 smithi163 bash[24253]: cluster 2024-08-31T06:44:12.237512+0000 mgr.a (mgr.14388) 11802 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:13 smithi027 bash[22610]: cluster 2024-08-31T06:44:12.237512+0000 mgr.a (mgr.14388) 11802 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:13 smithi191 bash[24992]: cluster 2024-08-31T06:44:12.237512+0000 mgr.a (mgr.14388) 11802 : cluster [DBG] pgmap v8182: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:14 smithi191 bash[24992]: audit 2024-08-31T06:44:13.503605+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:14 smithi191 bash[24992]: audit 2024-08-31T06:44:13.511856+0000 mon.a (mon.0) 2338 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:14 smithi191 bash[24992]: cluster 2024-08-31T06:44:14.239758+0000 mgr.a (mgr.14388) 11803 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:14 smithi191 bash[24992]: audit 2024-08-31T06:44:14.265133+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:14 smithi191 bash[24992]: audit 2024-08-31T06:44:14.273866+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:14 smithi191 bash[24992]: audit 2024-08-31T06:44:14.276296+0000 mon.a (mon.0) 2341 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:44:14.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:14 smithi191 bash[24992]: audit 2024-08-31T06:44:14.278104+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:44:14.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:14 smithi191 bash[24992]: audit 2024-08-31T06:44:14.289662+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:14 smithi191 bash[24992]: audit 2024-08-31T06:44:14.294907+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:44:14.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:14 smithi191 bash[24992]: audit 2024-08-31T06:44:14.297249+0000 mgr.a (mgr.14388) 11804 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:44:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:14 smithi163 bash[24253]: audit 2024-08-31T06:44:13.503605+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:14 smithi163 bash[24253]: audit 2024-08-31T06:44:13.511856+0000 mon.a (mon.0) 2338 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:14 smithi163 bash[24253]: cluster 2024-08-31T06:44:14.239758+0000 mgr.a (mgr.14388) 11803 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:14 smithi163 bash[24253]: audit 2024-08-31T06:44:14.265133+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:14 smithi163 bash[24253]: audit 2024-08-31T06:44:14.273866+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:14 smithi163 bash[24253]: audit 2024-08-31T06:44:14.276296+0000 mon.a (mon.0) 2341 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:44:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:14 smithi163 bash[24253]: audit 2024-08-31T06:44:14.278104+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:44:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:14 smithi163 bash[24253]: audit 2024-08-31T06:44:14.289662+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:14 smithi163 bash[24253]: audit 2024-08-31T06:44:14.294907+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:44:14.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:14 smithi163 bash[24253]: audit 2024-08-31T06:44:14.297249+0000 mgr.a (mgr.14388) 11804 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:44:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:14 smithi027 bash[22610]: audit 2024-08-31T06:44:13.503605+0000 mon.a (mon.0) 2337 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:14 smithi027 bash[22610]: audit 2024-08-31T06:44:13.511856+0000 mon.a (mon.0) 2338 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:14 smithi027 bash[22610]: cluster 2024-08-31T06:44:14.239758+0000 mgr.a (mgr.14388) 11803 : cluster [DBG] pgmap v8183: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:14 smithi027 bash[22610]: audit 2024-08-31T06:44:14.265133+0000 mon.a (mon.0) 2339 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:14 smithi027 bash[22610]: audit 2024-08-31T06:44:14.273866+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:14 smithi027 bash[22610]: audit 2024-08-31T06:44:14.276296+0000 mon.a (mon.0) 2341 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:44:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:14 smithi027 bash[22610]: audit 2024-08-31T06:44:14.278104+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:44:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:14 smithi027 bash[22610]: audit 2024-08-31T06:44:14.289662+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:44:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:14 smithi027 bash[22610]: audit 2024-08-31T06:44:14.294907+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:44:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:14 smithi027 bash[22610]: audit 2024-08-31T06:44:14.297249+0000 mgr.a (mgr.14388) 11804 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:44:15.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:44:15 smithi027 bash[22863]: debug 2024-08-31T06:44:15.078+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:44:15.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:44:15 smithi027 bash[22863]: debug 2024-08-31T06:44:15.078+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:44:15.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:44:15.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:44:15.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:44:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:15 smithi191 bash[24992]: audit 2024-08-31T06:44:15.079775+0000 mgr.a (mgr.14388) 11805 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:44:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:15 smithi191 bash[24992]: cephadm 2024-08-31T06:44:15.081382+0000 mgr.a (mgr.14388) 11806 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:44:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:15 smithi163 bash[24253]: audit 2024-08-31T06:44:15.079775+0000 mgr.a (mgr.14388) 11805 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:44:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:15 smithi163 bash[24253]: cephadm 2024-08-31T06:44:15.081382+0000 mgr.a (mgr.14388) 11806 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:44:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:15 smithi027 bash[22610]: audit 2024-08-31T06:44:15.079775+0000 mgr.a (mgr.14388) 11805 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:44:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:15 smithi027 bash[22610]: cephadm 2024-08-31T06:44:15.081382+0000 mgr.a (mgr.14388) 11806 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:44:16.510 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:44:16.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:44:16.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:44:16.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:44:16.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:44:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:16 smithi191 bash[24992]: audit 2024-08-31T06:44:16.087327+0000 mgr.a (mgr.14388) 11807 : audit [DBG] from='client.259146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:16 smithi191 bash[24992]: cluster 2024-08-31T06:44:16.240344+0000 mgr.a (mgr.14388) 11808 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:16 smithi163 bash[24253]: audit 2024-08-31T06:44:16.087327+0000 mgr.a (mgr.14388) 11807 : audit [DBG] from='client.259146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:16 smithi163 bash[24253]: cluster 2024-08-31T06:44:16.240344+0000 mgr.a (mgr.14388) 11808 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:16 smithi027 bash[22610]: audit 2024-08-31T06:44:16.087327+0000 mgr.a (mgr.14388) 11807 : audit [DBG] from='client.259146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:16 smithi027 bash[22610]: cluster 2024-08-31T06:44:16.240344+0000 mgr.a (mgr.14388) 11808 : cluster [DBG] pgmap v8184: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:19 smithi163 bash[24253]: cluster 2024-08-31T06:44:18.242676+0000 mgr.a (mgr.14388) 11809 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:19 smithi027 bash[22610]: cluster 2024-08-31T06:44:18.242676+0000 mgr.a (mgr.14388) 11809 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:19 smithi191 bash[24992]: cluster 2024-08-31T06:44:18.242676+0000 mgr.a (mgr.14388) 11809 : cluster [DBG] pgmap v8185: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:21.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:44:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:44:21.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:44:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:21 smithi163 bash[24253]: cluster 2024-08-31T06:44:20.243539+0000 mgr.a (mgr.14388) 11810 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:21 smithi027 bash[22610]: cluster 2024-08-31T06:44:20.243539+0000 mgr.a (mgr.14388) 11810 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:21 smithi191 bash[24992]: cluster 2024-08-31T06:44:20.243539+0000 mgr.a (mgr.14388) 11810 : cluster [DBG] pgmap v8186: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:22.291 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:44:22.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:44:22.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:44:22.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:44:22.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:44:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:23 smithi163 bash[24253]: audit 2024-08-31T06:44:21.853264+0000 mgr.a (mgr.14388) 11811 : audit [DBG] from='client.259221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:23 smithi163 bash[24253]: cluster 2024-08-31T06:44:22.244064+0000 mgr.a (mgr.14388) 11812 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:23 smithi027 bash[22610]: audit 2024-08-31T06:44:21.853264+0000 mgr.a (mgr.14388) 11811 : audit [DBG] from='client.259221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:23 smithi027 bash[22610]: cluster 2024-08-31T06:44:22.244064+0000 mgr.a (mgr.14388) 11812 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:23 smithi191 bash[24992]: audit 2024-08-31T06:44:21.853264+0000 mgr.a (mgr.14388) 11811 : audit [DBG] from='client.259221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:23 smithi191 bash[24992]: cluster 2024-08-31T06:44:22.244064+0000 mgr.a (mgr.14388) 11812 : cluster [DBG] pgmap v8187: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:25 smithi163 bash[24253]: cluster 2024-08-31T06:44:24.246218+0000 mgr.a (mgr.14388) 11813 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:25 smithi027 bash[22610]: cluster 2024-08-31T06:44:24.246218+0000 mgr.a (mgr.14388) 11813 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:25 smithi191 bash[24992]: cluster 2024-08-31T06:44:24.246218+0000 mgr.a (mgr.14388) 11813 : cluster [DBG] pgmap v8188: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:27.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:44:27.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:44:27.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:44:27.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:27 smithi163 bash[24253]: cluster 2024-08-31T06:44:26.247005+0000 mgr.a (mgr.14388) 11814 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:27 smithi027 bash[22610]: cluster 2024-08-31T06:44:26.247005+0000 mgr.a (mgr.14388) 11814 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:27 smithi191 bash[24992]: cluster 2024-08-31T06:44:26.247005+0000 mgr.a (mgr.14388) 11814 : cluster [DBG] pgmap v8189: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:28.040 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:44:28.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:44:28.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:44:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:44:28.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:44:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:29 smithi163 bash[24253]: audit 2024-08-31T06:44:27.624874+0000 mgr.a (mgr.14388) 11815 : audit [DBG] from='client.259299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:29 smithi163 bash[24253]: cluster 2024-08-31T06:44:28.249175+0000 mgr.a (mgr.14388) 11816 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:29 smithi027 bash[22610]: audit 2024-08-31T06:44:27.624874+0000 mgr.a (mgr.14388) 11815 : audit [DBG] from='client.259299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:29 smithi027 bash[22610]: cluster 2024-08-31T06:44:28.249175+0000 mgr.a (mgr.14388) 11816 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:29 smithi191 bash[24992]: audit 2024-08-31T06:44:27.624874+0000 mgr.a (mgr.14388) 11815 : audit [DBG] from='client.259299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:29 smithi191 bash[24992]: cluster 2024-08-31T06:44:28.249175+0000 mgr.a (mgr.14388) 11816 : cluster [DBG] pgmap v8190: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:44:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:31 smithi163 bash[24253]: cluster 2024-08-31T06:44:30.249945+0000 mgr.a (mgr.14388) 11817 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:44:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:31 smithi027 bash[22610]: cluster 2024-08-31T06:44:30.249945+0000 mgr.a (mgr.14388) 11817 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:44:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:31 smithi191 bash[24992]: cluster 2024-08-31T06:44:30.249945+0000 mgr.a (mgr.14388) 11817 : cluster [DBG] pgmap v8191: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:44:33.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:44:33.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:44:33.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:44:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:33 smithi163 bash[24253]: cluster 2024-08-31T06:44:32.250714+0000 mgr.a (mgr.14388) 11818 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:44:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:33 smithi027 bash[22610]: cluster 2024-08-31T06:44:32.250714+0000 mgr.a (mgr.14388) 11818 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:44:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:33 smithi191 bash[24992]: cluster 2024-08-31T06:44:32.250714+0000 mgr.a (mgr.14388) 11818 : cluster [DBG] pgmap v8192: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:44:33.809 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:44:33.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:44:33.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:44:33.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:44:33.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:44:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:34 smithi163 bash[24253]: audit 2024-08-31T06:44:33.375487+0000 mgr.a (mgr.14388) 11819 : audit [DBG] from='client.259374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:34 smithi027 bash[22610]: audit 2024-08-31T06:44:33.375487+0000 mgr.a (mgr.14388) 11819 : audit [DBG] from='client.259374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:34 smithi191 bash[24992]: audit 2024-08-31T06:44:33.375487+0000 mgr.a (mgr.14388) 11819 : audit [DBG] from='client.259374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:35 smithi163 bash[24253]: cluster 2024-08-31T06:44:34.253424+0000 mgr.a (mgr.14388) 11820 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:35 smithi027 bash[22610]: cluster 2024-08-31T06:44:34.253424+0000 mgr.a (mgr.14388) 11820 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:35 smithi191 bash[24992]: cluster 2024-08-31T06:44:34.253424+0000 mgr.a (mgr.14388) 11820 : cluster [DBG] pgmap v8193: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:37 smithi163 bash[24253]: cluster 2024-08-31T06:44:36.254190+0000 mgr.a (mgr.14388) 11821 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:44:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:37 smithi027 bash[22610]: cluster 2024-08-31T06:44:36.254190+0000 mgr.a (mgr.14388) 11821 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:44:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:37 smithi191 bash[24992]: cluster 2024-08-31T06:44:36.254190+0000 mgr.a (mgr.14388) 11821 : cluster [DBG] pgmap v8194: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:44:38.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:44:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:44:38.812 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:44:39.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:44:39.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:44:39.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:44:39.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:44:39.579 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:44:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:39 smithi163 bash[24253]: cluster 2024-08-31T06:44:38.256089+0000 mgr.a (mgr.14388) 11822 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:39 smithi027 bash[22610]: cluster 2024-08-31T06:44:38.256089+0000 mgr.a (mgr.14388) 11822 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:39 smithi191 bash[24992]: cluster 2024-08-31T06:44:38.256089+0000 mgr.a (mgr.14388) 11822 : cluster [DBG] pgmap v8195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:40 smithi163 bash[24253]: audit 2024-08-31T06:44:39.146319+0000 mgr.a (mgr.14388) 11823 : audit [DBG] from='client.259452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:40 smithi027 bash[22610]: audit 2024-08-31T06:44:39.146319+0000 mgr.a (mgr.14388) 11823 : audit [DBG] from='client.259452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:40 smithi191 bash[24992]: audit 2024-08-31T06:44:39.146319+0000 mgr.a (mgr.14388) 11823 : audit [DBG] from='client.259452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:41 smithi163 bash[24253]: cluster 2024-08-31T06:44:40.256974+0000 mgr.a (mgr.14388) 11824 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:44:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:41 smithi027 bash[22610]: cluster 2024-08-31T06:44:40.256974+0000 mgr.a (mgr.14388) 11824 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:44:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:41 smithi191 bash[24992]: cluster 2024-08-31T06:44:40.256974+0000 mgr.a (mgr.14388) 11824 : cluster [DBG] pgmap v8196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:44:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:43 smithi163 bash[24253]: cluster 2024-08-31T06:44:42.257772+0000 mgr.a (mgr.14388) 11825 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:44:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:43 smithi027 bash[22610]: cluster 2024-08-31T06:44:42.257772+0000 mgr.a (mgr.14388) 11825 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:44:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:43 smithi191 bash[24992]: cluster 2024-08-31T06:44:42.257772+0000 mgr.a (mgr.14388) 11825 : cluster [DBG] pgmap v8197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:44:44.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:44:44.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:44:44.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:44:45.334 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:44:45.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:44:45.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:44:45.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:44:45.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:44:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:45 smithi163 bash[24253]: cluster 2024-08-31T06:44:44.260021+0000 mgr.a (mgr.14388) 11826 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T06:44:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:45 smithi027 bash[22610]: cluster 2024-08-31T06:44:44.260021+0000 mgr.a (mgr.14388) 11826 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T06:44:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:45 smithi191 bash[24992]: cluster 2024-08-31T06:44:44.260021+0000 mgr.a (mgr.14388) 11826 : cluster [DBG] pgmap v8198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T06:44:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:46 smithi163 bash[24253]: audit 2024-08-31T06:44:44.913796+0000 mgr.a (mgr.14388) 11827 : audit [DBG] from='client.259530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:46 smithi027 bash[22610]: audit 2024-08-31T06:44:44.913796+0000 mgr.a (mgr.14388) 11827 : audit [DBG] from='client.259530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:46 smithi191 bash[24992]: audit 2024-08-31T06:44:44.913796+0000 mgr.a (mgr.14388) 11827 : audit [DBG] from='client.259530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:47 smithi163 bash[24253]: cluster 2024-08-31T06:44:46.261020+0000 mgr.a (mgr.14388) 11828 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:47 smithi027 bash[22610]: cluster 2024-08-31T06:44:46.261020+0000 mgr.a (mgr.14388) 11828 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:47 smithi191 bash[24992]: cluster 2024-08-31T06:44:46.261020+0000 mgr.a (mgr.14388) 11828 : cluster [DBG] pgmap v8199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:49 smithi163 bash[24253]: cluster 2024-08-31T06:44:48.263331+0000 mgr.a (mgr.14388) 11829 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:49 smithi027 bash[22610]: cluster 2024-08-31T06:44:48.263331+0000 mgr.a (mgr.14388) 11829 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:49 smithi191 bash[24992]: cluster 2024-08-31T06:44:48.263331+0000 mgr.a (mgr.14388) 11829 : cluster [DBG] pgmap v8200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:50.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:44:50.336 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:44:50.336 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:44:51.086 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:44:51.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:44:51.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:44:51.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:44:51.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:44:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:51 smithi163 bash[24253]: cluster 2024-08-31T06:44:50.264108+0000 mgr.a (mgr.14388) 11830 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:51 smithi027 bash[22610]: cluster 2024-08-31T06:44:50.264108+0000 mgr.a (mgr.14388) 11830 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:51 smithi191 bash[24992]: cluster 2024-08-31T06:44:50.264108+0000 mgr.a (mgr.14388) 11830 : cluster [DBG] pgmap v8201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:52 smithi163 bash[24253]: audit 2024-08-31T06:44:50.669054+0000 mgr.a (mgr.14388) 11831 : audit [DBG] from='client.259608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:52 smithi027 bash[22610]: audit 2024-08-31T06:44:50.669054+0000 mgr.a (mgr.14388) 11831 : audit [DBG] from='client.259608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:52 smithi191 bash[24992]: audit 2024-08-31T06:44:50.669054+0000 mgr.a (mgr.14388) 11831 : audit [DBG] from='client.259608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:53 smithi163 bash[24253]: cluster 2024-08-31T06:44:52.265012+0000 mgr.a (mgr.14388) 11832 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:53 smithi027 bash[22610]: cluster 2024-08-31T06:44:52.265012+0000 mgr.a (mgr.14388) 11832 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:53 smithi191 bash[24992]: cluster 2024-08-31T06:44:52.265012+0000 mgr.a (mgr.14388) 11832 : cluster [DBG] pgmap v8202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:55 smithi163 bash[24253]: cluster 2024-08-31T06:44:54.267255+0000 mgr.a (mgr.14388) 11833 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:55.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:55 smithi027 bash[22610]: cluster 2024-08-31T06:44:54.267255+0000 mgr.a (mgr.14388) 11833 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:55 smithi191 bash[24992]: cluster 2024-08-31T06:44:54.267255+0000 mgr.a (mgr.14388) 11833 : cluster [DBG] pgmap v8203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:56.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:44:56.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:44:56.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:44:56.866 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:44:56.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:44:56.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:44:56.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:44:56.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:44:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:57 smithi163 bash[24253]: cluster 2024-08-31T06:44:56.267766+0000 mgr.a (mgr.14388) 11834 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:57 smithi163 bash[24253]: audit 2024-08-31T06:44:56.423399+0000 mgr.a (mgr.14388) 11835 : audit [DBG] from='client.259680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:57.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:57 smithi027 bash[22610]: cluster 2024-08-31T06:44:56.267766+0000 mgr.a (mgr.14388) 11834 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:57.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:57 smithi027 bash[22610]: audit 2024-08-31T06:44:56.423399+0000 mgr.a (mgr.14388) 11835 : audit [DBG] from='client.259680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:57 smithi191 bash[24992]: cluster 2024-08-31T06:44:56.267766+0000 mgr.a (mgr.14388) 11834 : cluster [DBG] pgmap v8204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:44:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:57 smithi191 bash[24992]: audit 2024-08-31T06:44:56.423399+0000 mgr.a (mgr.14388) 11835 : audit [DBG] from='client.259680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:44:59 smithi163 bash[24253]: cluster 2024-08-31T06:44:58.270048+0000 mgr.a (mgr.14388) 11836 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:44:59 smithi027 bash[22610]: cluster 2024-08-31T06:44:58.270048+0000 mgr.a (mgr.14388) 11836 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:44:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:44:59 smithi191 bash[24992]: cluster 2024-08-31T06:44:58.270048+0000 mgr.a (mgr.14388) 11836 : cluster [DBG] pgmap v8205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:45:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:01 smithi163 bash[24253]: cluster 2024-08-31T06:45:00.270834+0000 mgr.a (mgr.14388) 11837 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:01 smithi027 bash[22610]: cluster 2024-08-31T06:45:00.270834+0000 mgr.a (mgr.14388) 11837 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:01 smithi191 bash[24992]: cluster 2024-08-31T06:45:00.270834+0000 mgr.a (mgr.14388) 11837 : cluster [DBG] pgmap v8206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:01.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:01.869 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:01.869 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:02.618 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:45:02.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:45:02.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:45:02.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:45:02.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:45:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:03 smithi163 bash[24253]: audit 2024-08-31T06:45:02.199581+0000 mgr.a (mgr.14388) 11838 : audit [DBG] from='client.259758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:03 smithi163 bash[24253]: cluster 2024-08-31T06:45:02.271357+0000 mgr.a (mgr.14388) 11839 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:03 smithi027 bash[22610]: audit 2024-08-31T06:45:02.199581+0000 mgr.a (mgr.14388) 11838 : audit [DBG] from='client.259758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:03 smithi027 bash[22610]: cluster 2024-08-31T06:45:02.271357+0000 mgr.a (mgr.14388) 11839 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:03 smithi191 bash[24992]: audit 2024-08-31T06:45:02.199581+0000 mgr.a (mgr.14388) 11838 : audit [DBG] from='client.259758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:03 smithi191 bash[24992]: cluster 2024-08-31T06:45:02.271357+0000 mgr.a (mgr.14388) 11839 : cluster [DBG] pgmap v8207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:05 smithi163 bash[24253]: cluster 2024-08-31T06:45:04.273674+0000 mgr.a (mgr.14388) 11840 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:45:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:05 smithi027 bash[22610]: cluster 2024-08-31T06:45:04.273674+0000 mgr.a (mgr.14388) 11840 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:45:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:05 smithi191 bash[24992]: cluster 2024-08-31T06:45:04.273674+0000 mgr.a (mgr.14388) 11840 : cluster [DBG] pgmap v8208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:45:07.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:07.620 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:07.620 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:07 smithi163 bash[24253]: cluster 2024-08-31T06:45:06.274427+0000 mgr.a (mgr.14388) 11841 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:07 smithi027 bash[22610]: cluster 2024-08-31T06:45:06.274427+0000 mgr.a (mgr.14388) 11841 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:07 smithi191 bash[24992]: cluster 2024-08-31T06:45:06.274427+0000 mgr.a (mgr.14388) 11841 : cluster [DBG] pgmap v8209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:08.377 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:45:08.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:45:08.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:45:08.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:45:08.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:45:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:09 smithi163 bash[24253]: audit 2024-08-31T06:45:07.955419+0000 mgr.a (mgr.14388) 11842 : audit [DBG] from='client.259836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:09 smithi163 bash[24253]: cluster 2024-08-31T06:45:08.279925+0000 mgr.a (mgr.14388) 11843 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:09 smithi027 bash[22610]: audit 2024-08-31T06:45:07.955419+0000 mgr.a (mgr.14388) 11842 : audit [DBG] from='client.259836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:09 smithi027 bash[22610]: cluster 2024-08-31T06:45:08.279925+0000 mgr.a (mgr.14388) 11843 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:09 smithi191 bash[24992]: audit 2024-08-31T06:45:07.955419+0000 mgr.a (mgr.14388) 11842 : audit [DBG] from='client.259836 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:09 smithi191 bash[24992]: cluster 2024-08-31T06:45:08.279925+0000 mgr.a (mgr.14388) 11843 : cluster [DBG] pgmap v8210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:11 smithi163 bash[24253]: cluster 2024-08-31T06:45:10.280713+0000 mgr.a (mgr.14388) 11844 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:45:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:11 smithi027 bash[22610]: cluster 2024-08-31T06:45:10.280713+0000 mgr.a (mgr.14388) 11844 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:45:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:11 smithi191 bash[24992]: cluster 2024-08-31T06:45:10.280713+0000 mgr.a (mgr.14388) 11844 : cluster [DBG] pgmap v8211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:45:13.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:13.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:13.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:13 smithi163 bash[24253]: cluster 2024-08-31T06:45:12.281481+0000 mgr.a (mgr.14388) 11845 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:45:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:13 smithi027 bash[22610]: cluster 2024-08-31T06:45:12.281481+0000 mgr.a (mgr.14388) 11845 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:45:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:13 smithi191 bash[24992]: cluster 2024-08-31T06:45:12.281481+0000 mgr.a (mgr.14388) 11845 : cluster [DBG] pgmap v8212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:45:14.126 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:45:14.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:45:14.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:45:14.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:45:14.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:45:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:15 smithi027 bash[22610]: audit 2024-08-31T06:45:13.710504+0000 mgr.a (mgr.14388) 11846 : audit [DBG] from='client.259911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:15 smithi027 bash[22610]: cluster 2024-08-31T06:45:14.284266+0000 mgr.a (mgr.14388) 11847 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:15 smithi027 bash[22610]: audit 2024-08-31T06:45:15.163848+0000 mon.a (mon.0) 2345 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:45:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:15 smithi191 bash[24992]: audit 2024-08-31T06:45:13.710504+0000 mgr.a (mgr.14388) 11846 : audit [DBG] from='client.259911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:15 smithi191 bash[24992]: cluster 2024-08-31T06:45:14.284266+0000 mgr.a (mgr.14388) 11847 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:15 smithi191 bash[24992]: audit 2024-08-31T06:45:15.163848+0000 mon.a (mon.0) 2345 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:45:15.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:15 smithi163 bash[24253]: audit 2024-08-31T06:45:13.710504+0000 mgr.a (mgr.14388) 11846 : audit [DBG] from='client.259911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:15.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:15 smithi163 bash[24253]: cluster 2024-08-31T06:45:14.284266+0000 mgr.a (mgr.14388) 11847 : cluster [DBG] pgmap v8213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:15.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:15 smithi163 bash[24253]: audit 2024-08-31T06:45:15.163848+0000 mon.a (mon.0) 2345 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:45:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:17 smithi027 bash[22610]: cluster 2024-08-31T06:45:16.285088+0000 mgr.a (mgr.14388) 11848 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:45:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:17 smithi191 bash[24992]: cluster 2024-08-31T06:45:16.285088+0000 mgr.a (mgr.14388) 11848 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:45:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:17 smithi163 bash[24253]: cluster 2024-08-31T06:45:16.285088+0000 mgr.a (mgr.14388) 11848 : cluster [DBG] pgmap v8214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:45:19.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:19.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:19.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:19 smithi027 bash[22610]: cluster 2024-08-31T06:45:18.286087+0000 mgr.a (mgr.14388) 11849 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:19 smithi191 bash[24992]: cluster 2024-08-31T06:45:18.286087+0000 mgr.a (mgr.14388) 11849 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:19.892 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:45:19.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:45:19.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:45:19.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:45:19.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:45:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:19 smithi163 bash[24253]: cluster 2024-08-31T06:45:18.286087+0000 mgr.a (mgr.14388) 11849 : cluster [DBG] pgmap v8215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:20 smithi027 bash[22610]: audit 2024-08-31T06:45:19.463124+0000 mgr.a (mgr.14388) 11850 : audit [DBG] from='client.259989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:20 smithi191 bash[24992]: audit 2024-08-31T06:45:19.463124+0000 mgr.a (mgr.14388) 11850 : audit [DBG] from='client.259989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:20 smithi163 bash[24253]: audit 2024-08-31T06:45:19.463124+0000 mgr.a (mgr.14388) 11850 : audit [DBG] from='client.259989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: cluster 2024-08-31T06:45:20.287141+0000 mgr.a (mgr.14388) 11851 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: audit 2024-08-31T06:45:20.497703+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: audit 2024-08-31T06:45:20.502891+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: audit 2024-08-31T06:45:20.535580+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: audit 2024-08-31T06:45:20.539265+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: audit 2024-08-31T06:45:20.542286+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: audit 2024-08-31T06:45:20.555273+0000 mon.a (mon.0) 2351 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: audit 2024-08-31T06:45:21.248013+0000 mon.a (mon.0) 2352 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:45:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: audit 2024-08-31T06:45:21.249368+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:45:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: audit 2024-08-31T06:45:21.258463+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:21 smithi191 bash[24992]: audit 2024-08-31T06:45:21.263122+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:45:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: cluster 2024-08-31T06:45:20.287141+0000 mgr.a (mgr.14388) 11851 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: audit 2024-08-31T06:45:20.497703+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: audit 2024-08-31T06:45:20.502891+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: audit 2024-08-31T06:45:20.535580+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: audit 2024-08-31T06:45:20.539265+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: audit 2024-08-31T06:45:20.542286+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: audit 2024-08-31T06:45:20.555273+0000 mon.a (mon.0) 2351 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: audit 2024-08-31T06:45:21.248013+0000 mon.a (mon.0) 2352 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:45:21.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: audit 2024-08-31T06:45:21.249368+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:45:21.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: audit 2024-08-31T06:45:21.258463+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:21 smithi163 bash[24253]: audit 2024-08-31T06:45:21.263122+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: cluster 2024-08-31T06:45:20.287141+0000 mgr.a (mgr.14388) 11851 : cluster [DBG] pgmap v8216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: audit 2024-08-31T06:45:20.497703+0000 mon.a (mon.0) 2346 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: audit 2024-08-31T06:45:20.502891+0000 mon.a (mon.0) 2347 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: audit 2024-08-31T06:45:20.535580+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: audit 2024-08-31T06:45:20.539265+0000 mon.a (mon.0) 2349 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: audit 2024-08-31T06:45:20.542286+0000 mon.a (mon.0) 2350 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: audit 2024-08-31T06:45:20.555273+0000 mon.a (mon.0) 2351 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: audit 2024-08-31T06:45:21.248013+0000 mon.a (mon.0) 2352 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: audit 2024-08-31T06:45:21.249368+0000 mon.a (mon.0) 2353 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: audit 2024-08-31T06:45:21.258463+0000 mon.a (mon.0) 2354 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:45:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:21 smithi027 bash[22610]: audit 2024-08-31T06:45:21.263122+0000 mon.a (mon.0) 2355 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:45:22.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:45:22 smithi027 bash[22863]: debug 2024-08-31T06:45:22.004+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:45:22.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:45:22 smithi027 bash[22863]: debug 2024-08-31T06:45:22.004+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:45:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:22 smithi191 bash[24992]: audit 2024-08-31T06:45:21.265524+0000 mgr.a (mgr.14388) 11852 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:45:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:22 smithi163 bash[24253]: audit 2024-08-31T06:45:21.265524+0000 mgr.a (mgr.14388) 11852 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:45:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:22 smithi027 bash[22610]: audit 2024-08-31T06:45:21.265524+0000 mgr.a (mgr.14388) 11852 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:45:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:23 smithi191 bash[24992]: audit 2024-08-31T06:45:22.008483+0000 mgr.a (mgr.14388) 11853 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:45:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:23 smithi191 bash[24992]: cephadm 2024-08-31T06:45:22.009838+0000 mgr.a (mgr.14388) 11854 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:45:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:23 smithi191 bash[24992]: cluster 2024-08-31T06:45:22.288265+0000 mgr.a (mgr.14388) 11855 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:23 smithi163 bash[24253]: audit 2024-08-31T06:45:22.008483+0000 mgr.a (mgr.14388) 11853 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:45:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:23 smithi163 bash[24253]: cephadm 2024-08-31T06:45:22.009838+0000 mgr.a (mgr.14388) 11854 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:45:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:23 smithi163 bash[24253]: cluster 2024-08-31T06:45:22.288265+0000 mgr.a (mgr.14388) 11855 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:23 smithi027 bash[22610]: audit 2024-08-31T06:45:22.008483+0000 mgr.a (mgr.14388) 11853 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:45:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:23 smithi027 bash[22610]: cephadm 2024-08-31T06:45:22.009838+0000 mgr.a (mgr.14388) 11854 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:45:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:23 smithi027 bash[22610]: cluster 2024-08-31T06:45:22.288265+0000 mgr.a (mgr.14388) 11855 : cluster [DBG] pgmap v8217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:24 smithi191 bash[24992]: cluster 2024-08-31T06:45:24.290654+0000 mgr.a (mgr.14388) 11856 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:24.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:24.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:24.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:24 smithi163 bash[24253]: cluster 2024-08-31T06:45:24.290654+0000 mgr.a (mgr.14388) 11856 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:24 smithi027 bash[22610]: cluster 2024-08-31T06:45:24.290654+0000 mgr.a (mgr.14388) 11856 : cluster [DBG] pgmap v8218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:25.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:45:25.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:45:25.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:45:25.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:45:25.637 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:45:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:25 smithi191 bash[24992]: audit 2024-08-31T06:45:25.223122+0000 mgr.a (mgr.14388) 11857 : audit [DBG] from='client.260175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:25 smithi163 bash[24253]: audit 2024-08-31T06:45:25.223122+0000 mgr.a (mgr.14388) 11857 : audit [DBG] from='client.260175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:25 smithi027 bash[22610]: audit 2024-08-31T06:45:25.223122+0000 mgr.a (mgr.14388) 11857 : audit [DBG] from='client.260175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:26 smithi191 bash[24992]: cluster 2024-08-31T06:45:26.291672+0000 mgr.a (mgr.14388) 11858 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:26 smithi163 bash[24253]: cluster 2024-08-31T06:45:26.291672+0000 mgr.a (mgr.14388) 11858 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:26 smithi027 bash[22610]: cluster 2024-08-31T06:45:26.291672+0000 mgr.a (mgr.14388) 11858 : cluster [DBG] pgmap v8219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:29 smithi163 bash[24253]: cluster 2024-08-31T06:45:28.293817+0000 mgr.a (mgr.14388) 11859 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:29 smithi027 bash[22610]: cluster 2024-08-31T06:45:28.293817+0000 mgr.a (mgr.14388) 11859 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:29 smithi191 bash[24992]: cluster 2024-08-31T06:45:28.293817+0000 mgr.a (mgr.14388) 11859 : cluster [DBG] pgmap v8220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:30.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:30.639 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:30.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:31.420 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:45:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:45:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:45:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:45:31.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:45:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:31 smithi163 bash[24253]: cluster 2024-08-31T06:45:30.294653+0000 mgr.a (mgr.14388) 11860 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:31 smithi027 bash[22610]: cluster 2024-08-31T06:45:30.294653+0000 mgr.a (mgr.14388) 11860 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:31 smithi191 bash[24992]: cluster 2024-08-31T06:45:30.294653+0000 mgr.a (mgr.14388) 11860 : cluster [DBG] pgmap v8221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:32 smithi163 bash[24253]: audit 2024-08-31T06:45:30.978168+0000 mgr.a (mgr.14388) 11861 : audit [DBG] from='client.260253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:32 smithi027 bash[22610]: audit 2024-08-31T06:45:30.978168+0000 mgr.a (mgr.14388) 11861 : audit [DBG] from='client.260253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:32 smithi191 bash[24992]: audit 2024-08-31T06:45:30.978168+0000 mgr.a (mgr.14388) 11861 : audit [DBG] from='client.260253 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:33 smithi163 bash[24253]: cluster 2024-08-31T06:45:32.295647+0000 mgr.a (mgr.14388) 11862 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:33 smithi027 bash[22610]: cluster 2024-08-31T06:45:32.295647+0000 mgr.a (mgr.14388) 11862 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:33 smithi191 bash[24992]: cluster 2024-08-31T06:45:32.295647+0000 mgr.a (mgr.14388) 11862 : cluster [DBG] pgmap v8222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:35 smithi163 bash[24253]: cluster 2024-08-31T06:45:34.297855+0000 mgr.a (mgr.14388) 11863 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:35 smithi027 bash[22610]: cluster 2024-08-31T06:45:34.297855+0000 mgr.a (mgr.14388) 11863 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:35 smithi191 bash[24992]: cluster 2024-08-31T06:45:34.297855+0000 mgr.a (mgr.14388) 11863 : cluster [DBG] pgmap v8223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:45:36.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:36.422 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:36.422 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:37.211 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:45:37.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:45:37.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:45:37.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:45:37.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:45:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:37 smithi163 bash[24253]: cluster 2024-08-31T06:45:36.298650+0000 mgr.a (mgr.14388) 11864 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:37 smithi027 bash[22610]: cluster 2024-08-31T06:45:36.298650+0000 mgr.a (mgr.14388) 11864 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:37 smithi191 bash[24992]: cluster 2024-08-31T06:45:36.298650+0000 mgr.a (mgr.14388) 11864 : cluster [DBG] pgmap v8224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:38 smithi163 bash[24253]: audit 2024-08-31T06:45:36.758470+0000 mgr.a (mgr.14388) 11865 : audit [DBG] from='client.260331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:38 smithi027 bash[22610]: audit 2024-08-31T06:45:36.758470+0000 mgr.a (mgr.14388) 11865 : audit [DBG] from='client.260331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:38 smithi191 bash[24992]: audit 2024-08-31T06:45:36.758470+0000 mgr.a (mgr.14388) 11865 : audit [DBG] from='client.260331 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:39 smithi163 bash[24253]: cluster 2024-08-31T06:45:38.300930+0000 mgr.a (mgr.14388) 11866 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:45:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:39 smithi027 bash[22610]: cluster 2024-08-31T06:45:38.300930+0000 mgr.a (mgr.14388) 11866 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:45:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:39 smithi191 bash[24992]: cluster 2024-08-31T06:45:38.300930+0000 mgr.a (mgr.14388) 11866 : cluster [DBG] pgmap v8225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:45:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:41 smithi163 bash[24253]: cluster 2024-08-31T06:45:40.301747+0000 mgr.a (mgr.14388) 11867 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:41 smithi027 bash[22610]: cluster 2024-08-31T06:45:40.301747+0000 mgr.a (mgr.14388) 11867 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:41 smithi191 bash[24992]: cluster 2024-08-31T06:45:40.301747+0000 mgr.a (mgr.14388) 11867 : cluster [DBG] pgmap v8226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:42.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:42.213 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:42.213 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:42.963 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:45:42.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:45:42.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:45:42.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:45:42.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:45:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:43 smithi163 bash[24253]: cluster 2024-08-31T06:45:42.302362+0000 mgr.a (mgr.14388) 11868 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:43 smithi027 bash[22610]: cluster 2024-08-31T06:45:42.302362+0000 mgr.a (mgr.14388) 11868 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:43 smithi191 bash[24992]: cluster 2024-08-31T06:45:42.302362+0000 mgr.a (mgr.14388) 11868 : cluster [DBG] pgmap v8227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:44 smithi163 bash[24253]: audit 2024-08-31T06:45:42.549470+0000 mgr.a (mgr.14388) 11869 : audit [DBG] from='client.260403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:44 smithi027 bash[22610]: audit 2024-08-31T06:45:42.549470+0000 mgr.a (mgr.14388) 11869 : audit [DBG] from='client.260403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:44 smithi191 bash[24992]: audit 2024-08-31T06:45:42.549470+0000 mgr.a (mgr.14388) 11869 : audit [DBG] from='client.260403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:45 smithi163 bash[24253]: cluster 2024-08-31T06:45:44.304854+0000 mgr.a (mgr.14388) 11870 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:45:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:45 smithi027 bash[22610]: cluster 2024-08-31T06:45:44.304854+0000 mgr.a (mgr.14388) 11870 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:45:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:45 smithi191 bash[24992]: cluster 2024-08-31T06:45:44.304854+0000 mgr.a (mgr.14388) 11870 : cluster [DBG] pgmap v8228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:45:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:47 smithi163 bash[24253]: cluster 2024-08-31T06:45:46.305678+0000 mgr.a (mgr.14388) 11871 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:47 smithi027 bash[22610]: cluster 2024-08-31T06:45:46.305678+0000 mgr.a (mgr.14388) 11871 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:47 smithi191 bash[24992]: cluster 2024-08-31T06:45:46.305678+0000 mgr.a (mgr.14388) 11871 : cluster [DBG] pgmap v8229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:47.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:47.965 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:47.966 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:48.741 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:45:48.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:45:48.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:45:48.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:45:48.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:45:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:49 smithi163 bash[24253]: audit 2024-08-31T06:45:48.305542+0000 mgr.a (mgr.14388) 11872 : audit [DBG] from='client.260481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:49 smithi163 bash[24253]: cluster 2024-08-31T06:45:48.323719+0000 mgr.a (mgr.14388) 11873 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:49 smithi027 bash[22610]: audit 2024-08-31T06:45:48.305542+0000 mgr.a (mgr.14388) 11872 : audit [DBG] from='client.260481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:49 smithi027 bash[22610]: cluster 2024-08-31T06:45:48.323719+0000 mgr.a (mgr.14388) 11873 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:49 smithi191 bash[24992]: audit 2024-08-31T06:45:48.305542+0000 mgr.a (mgr.14388) 11872 : audit [DBG] from='client.260481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:49 smithi191 bash[24992]: cluster 2024-08-31T06:45:48.323719+0000 mgr.a (mgr.14388) 11873 : cluster [DBG] pgmap v8230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:51 smithi163 bash[24253]: cluster 2024-08-31T06:45:50.324879+0000 mgr.a (mgr.14388) 11874 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T06:45:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:51 smithi027 bash[22610]: cluster 2024-08-31T06:45:50.324879+0000 mgr.a (mgr.14388) 11874 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T06:45:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:51 smithi191 bash[24992]: cluster 2024-08-31T06:45:50.324879+0000 mgr.a (mgr.14388) 11874 : cluster [DBG] pgmap v8231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T06:45:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:53 smithi163 bash[24253]: cluster 2024-08-31T06:45:52.325714+0000 mgr.a (mgr.14388) 11875 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T06:45:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:53 smithi027 bash[22610]: cluster 2024-08-31T06:45:52.325714+0000 mgr.a (mgr.14388) 11875 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T06:45:53.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:53.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:53.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:53 smithi191 bash[24992]: cluster 2024-08-31T06:45:52.325714+0000 mgr.a (mgr.14388) 11875 : cluster [DBG] pgmap v8232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T06:45:54.509 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:45:54.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:45:54.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:45:54.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:45:54.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:45:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:55 smithi163 bash[24253]: audit 2024-08-31T06:45:54.078474+0000 mgr.a (mgr.14388) 11876 : audit [DBG] from='client.260559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:55 smithi163 bash[24253]: cluster 2024-08-31T06:45:54.327100+0000 mgr.a (mgr.14388) 11877 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:55 smithi027 bash[22610]: audit 2024-08-31T06:45:54.078474+0000 mgr.a (mgr.14388) 11876 : audit [DBG] from='client.260559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:55.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:55 smithi027 bash[22610]: cluster 2024-08-31T06:45:54.327100+0000 mgr.a (mgr.14388) 11877 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:55 smithi191 bash[24992]: audit 2024-08-31T06:45:54.078474+0000 mgr.a (mgr.14388) 11876 : audit [DBG] from='client.260559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:55 smithi191 bash[24992]: cluster 2024-08-31T06:45:54.327100+0000 mgr.a (mgr.14388) 11877 : cluster [DBG] pgmap v8233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:57 smithi163 bash[24253]: cluster 2024-08-31T06:45:56.328139+0000 mgr.a (mgr.14388) 11878 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T06:45:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:57 smithi027 bash[22610]: cluster 2024-08-31T06:45:56.328139+0000 mgr.a (mgr.14388) 11878 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T06:45:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:57 smithi191 bash[24992]: cluster 2024-08-31T06:45:56.328139+0000 mgr.a (mgr.14388) 11878 : cluster [DBG] pgmap v8234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T06:45:59.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:45:59.511 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:45:59.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:45:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:45:59 smithi163 bash[24253]: cluster 2024-08-31T06:45:58.330429+0000 mgr.a (mgr.14388) 11879 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:45:59 smithi027 bash[22610]: cluster 2024-08-31T06:45:58.330429+0000 mgr.a (mgr.14388) 11879 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:45:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:45:59 smithi191 bash[24992]: cluster 2024-08-31T06:45:58.330429+0000 mgr.a (mgr.14388) 11879 : cluster [DBG] pgmap v8235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:00.265 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:00.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:00.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:00.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:00.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:01 smithi163 bash[24253]: audit 2024-08-31T06:45:59.846004+0000 mgr.a (mgr.14388) 11880 : audit [DBG] from='client.260637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:01 smithi163 bash[24253]: cluster 2024-08-31T06:46:00.331470+0000 mgr.a (mgr.14388) 11881 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:01 smithi027 bash[22610]: audit 2024-08-31T06:45:59.846004+0000 mgr.a (mgr.14388) 11880 : audit [DBG] from='client.260637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:01 smithi027 bash[22610]: cluster 2024-08-31T06:46:00.331470+0000 mgr.a (mgr.14388) 11881 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:01 smithi191 bash[24992]: audit 2024-08-31T06:45:59.846004+0000 mgr.a (mgr.14388) 11880 : audit [DBG] from='client.260637 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:01 smithi191 bash[24992]: cluster 2024-08-31T06:46:00.331470+0000 mgr.a (mgr.14388) 11881 : cluster [DBG] pgmap v8236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:03 smithi163 bash[24253]: cluster 2024-08-31T06:46:02.332219+0000 mgr.a (mgr.14388) 11882 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:03 smithi027 bash[22610]: cluster 2024-08-31T06:46:02.332219+0000 mgr.a (mgr.14388) 11882 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:03 smithi191 bash[24992]: cluster 2024-08-31T06:46:02.332219+0000 mgr.a (mgr.14388) 11882 : cluster [DBG] pgmap v8237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:05.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:46:05.267 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:46:05.267 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:46:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:05 smithi163 bash[24253]: cluster 2024-08-31T06:46:04.334441+0000 mgr.a (mgr.14388) 11883 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:05 smithi027 bash[22610]: cluster 2024-08-31T06:46:04.334441+0000 mgr.a (mgr.14388) 11883 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:05 smithi191 bash[24992]: cluster 2024-08-31T06:46:04.334441+0000 mgr.a (mgr.14388) 11883 : cluster [DBG] pgmap v8238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:06.011 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:06.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:06.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:06.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:06.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:07 smithi027 bash[22610]: audit 2024-08-31T06:46:05.597913+0000 mgr.a (mgr.14388) 11884 : audit [DBG] from='client.260715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:07.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:07 smithi027 bash[22610]: cluster 2024-08-31T06:46:06.335420+0000 mgr.a (mgr.14388) 11885 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:07 smithi191 bash[24992]: audit 2024-08-31T06:46:05.597913+0000 mgr.a (mgr.14388) 11884 : audit [DBG] from='client.260715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:07 smithi191 bash[24992]: cluster 2024-08-31T06:46:06.335420+0000 mgr.a (mgr.14388) 11885 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:07 smithi163 bash[24253]: audit 2024-08-31T06:46:05.597913+0000 mgr.a (mgr.14388) 11884 : audit [DBG] from='client.260715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:07 smithi163 bash[24253]: cluster 2024-08-31T06:46:06.335420+0000 mgr.a (mgr.14388) 11885 : cluster [DBG] pgmap v8239: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:09 smithi027 bash[22610]: cluster 2024-08-31T06:46:08.337563+0000 mgr.a (mgr.14388) 11886 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:09 smithi191 bash[24992]: cluster 2024-08-31T06:46:08.337563+0000 mgr.a (mgr.14388) 11886 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:09 smithi163 bash[24253]: cluster 2024-08-31T06:46:08.337563+0000 mgr.a (mgr.14388) 11886 : cluster [DBG] pgmap v8240: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:11.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:46:11.013 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:46:11.014 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:46:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:11 smithi027 bash[22610]: cluster 2024-08-31T06:46:10.338334+0000 mgr.a (mgr.14388) 11887 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:11.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:11.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:11.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:11.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:11.758 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:11 smithi191 bash[24992]: cluster 2024-08-31T06:46:10.338334+0000 mgr.a (mgr.14388) 11887 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:11 smithi163 bash[24253]: cluster 2024-08-31T06:46:10.338334+0000 mgr.a (mgr.14388) 11887 : cluster [DBG] pgmap v8241: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:12 smithi027 bash[22610]: audit 2024-08-31T06:46:11.345619+0000 mgr.a (mgr.14388) 11888 : audit [DBG] from='client.260793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:12 smithi191 bash[24992]: audit 2024-08-31T06:46:11.345619+0000 mgr.a (mgr.14388) 11888 : audit [DBG] from='client.260793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:12 smithi163 bash[24253]: audit 2024-08-31T06:46:11.345619+0000 mgr.a (mgr.14388) 11888 : audit [DBG] from='client.260793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:13 smithi027 bash[22610]: cluster 2024-08-31T06:46:12.339351+0000 mgr.a (mgr.14388) 11889 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:13 smithi191 bash[24992]: cluster 2024-08-31T06:46:12.339351+0000 mgr.a (mgr.14388) 11889 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:13 smithi163 bash[24253]: cluster 2024-08-31T06:46:12.339351+0000 mgr.a (mgr.14388) 11889 : cluster [DBG] pgmap v8242: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:15 smithi027 bash[22610]: cluster 2024-08-31T06:46:14.341594+0000 mgr.a (mgr.14388) 11890 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:15 smithi191 bash[24992]: cluster 2024-08-31T06:46:14.341594+0000 mgr.a (mgr.14388) 11890 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:15 smithi163 bash[24253]: cluster 2024-08-31T06:46:14.341594+0000 mgr.a (mgr.14388) 11890 : cluster [DBG] pgmap v8243: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:16.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:46:16.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:46:16.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:46:17.511 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:17.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:17.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:17.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:17.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:17 smithi027 bash[22610]: cluster 2024-08-31T06:46:16.342369+0000 mgr.a (mgr.14388) 11891 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:17 smithi191 bash[24992]: cluster 2024-08-31T06:46:16.342369+0000 mgr.a (mgr.14388) 11891 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:17 smithi163 bash[24253]: cluster 2024-08-31T06:46:16.342369+0000 mgr.a (mgr.14388) 11891 : cluster [DBG] pgmap v8244: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:18 smithi191 bash[24992]: audit 2024-08-31T06:46:17.087420+0000 mgr.a (mgr.14388) 11892 : audit [DBG] from='client.260871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:18 smithi163 bash[24253]: audit 2024-08-31T06:46:17.087420+0000 mgr.a (mgr.14388) 11892 : audit [DBG] from='client.260871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:18 smithi027 bash[22610]: audit 2024-08-31T06:46:17.087420+0000 mgr.a (mgr.14388) 11892 : audit [DBG] from='client.260871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:19 smithi191 bash[24992]: cluster 2024-08-31T06:46:18.344867+0000 mgr.a (mgr.14388) 11893 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:19 smithi163 bash[24253]: cluster 2024-08-31T06:46:18.344867+0000 mgr.a (mgr.14388) 11893 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:19 smithi027 bash[22610]: cluster 2024-08-31T06:46:18.344867+0000 mgr.a (mgr.14388) 11893 : cluster [DBG] pgmap v8245: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:21 smithi191 bash[24992]: cluster 2024-08-31T06:46:20.345827+0000 mgr.a (mgr.14388) 11894 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:21 smithi163 bash[24253]: cluster 2024-08-31T06:46:20.345827+0000 mgr.a (mgr.14388) 11894 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:21 smithi027 bash[22610]: cluster 2024-08-31T06:46:20.345827+0000 mgr.a (mgr.14388) 11894 : cluster [DBG] pgmap v8246: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:46:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:46:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:46:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:22 smithi191 bash[24992]: audit 2024-08-31T06:46:22.061205+0000 mon.a (mon.0) 2356 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:46:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:22 smithi163 bash[24253]: audit 2024-08-31T06:46:22.061205+0000 mon.a (mon.0) 2356 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:46:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:22 smithi027 bash[22610]: audit 2024-08-31T06:46:22.061205+0000 mon.a (mon.0) 2356 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:46:23.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:23.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:23.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:23.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:23.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: cluster 2024-08-31T06:46:22.346606+0000 mgr.a (mgr.14388) 11895 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: audit 2024-08-31T06:46:23.409949+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: audit 2024-08-31T06:46:23.427292+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: audit 2024-08-31T06:46:23.447928+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: audit 2024-08-31T06:46:23.463005+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: audit 2024-08-31T06:46:23.466357+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: audit 2024-08-31T06:46:23.471994+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: audit 2024-08-31T06:46:23.472982+0000 mon.a (mon.0) 2363 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:46:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: audit 2024-08-31T06:46:23.473794+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:46:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: audit 2024-08-31T06:46:23.478679+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:23 smithi191 bash[24992]: audit 2024-08-31T06:46:23.480574+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: cluster 2024-08-31T06:46:22.346606+0000 mgr.a (mgr.14388) 11895 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: audit 2024-08-31T06:46:23.409949+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: audit 2024-08-31T06:46:23.427292+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: audit 2024-08-31T06:46:23.447928+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: audit 2024-08-31T06:46:23.463005+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: audit 2024-08-31T06:46:23.466357+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: audit 2024-08-31T06:46:23.471994+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: audit 2024-08-31T06:46:23.472982+0000 mon.a (mon.0) 2363 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: audit 2024-08-31T06:46:23.473794+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: audit 2024-08-31T06:46:23.478679+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:23 smithi163 bash[24253]: audit 2024-08-31T06:46:23.480574+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:46:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: cluster 2024-08-31T06:46:22.346606+0000 mgr.a (mgr.14388) 11895 : cluster [DBG] pgmap v8247: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: audit 2024-08-31T06:46:23.409949+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: audit 2024-08-31T06:46:23.427292+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: audit 2024-08-31T06:46:23.447928+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: audit 2024-08-31T06:46:23.463005+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: audit 2024-08-31T06:46:23.466357+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: audit 2024-08-31T06:46:23.471994+0000 mon.a (mon.0) 2362 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: audit 2024-08-31T06:46:23.472982+0000 mon.a (mon.0) 2363 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:46:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: audit 2024-08-31T06:46:23.473794+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:46:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: audit 2024-08-31T06:46:23.478679+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:46:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:23 smithi027 bash[22610]: audit 2024-08-31T06:46:23.480574+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:46:24.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:46:24 smithi027 bash[22863]: debug 2024-08-31T06:46:24.190+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:46:24.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:46:24 smithi027 bash[22863]: debug 2024-08-31T06:46:24.194+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:46:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:24 smithi191 bash[24992]: audit 2024-08-31T06:46:22.841678+0000 mgr.a (mgr.14388) 11896 : audit [DBG] from='client.260949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:24 smithi191 bash[24992]: audit 2024-08-31T06:46:23.482958+0000 mgr.a (mgr.14388) 11897 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:46:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:24 smithi163 bash[24253]: audit 2024-08-31T06:46:22.841678+0000 mgr.a (mgr.14388) 11896 : audit [DBG] from='client.260949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:24 smithi163 bash[24253]: audit 2024-08-31T06:46:23.482958+0000 mgr.a (mgr.14388) 11897 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:46:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:24 smithi027 bash[22610]: audit 2024-08-31T06:46:22.841678+0000 mgr.a (mgr.14388) 11896 : audit [DBG] from='client.260949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:24.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:24 smithi027 bash[22610]: audit 2024-08-31T06:46:23.482958+0000 mgr.a (mgr.14388) 11897 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:46:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:25 smithi191 bash[24992]: audit 2024-08-31T06:46:24.197871+0000 mgr.a (mgr.14388) 11898 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:46:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:25 smithi191 bash[24992]: cephadm 2024-08-31T06:46:24.199103+0000 mgr.a (mgr.14388) 11899 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:46:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:25 smithi191 bash[24992]: cluster 2024-08-31T06:46:24.349279+0000 mgr.a (mgr.14388) 11900 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:25 smithi163 bash[24253]: audit 2024-08-31T06:46:24.197871+0000 mgr.a (mgr.14388) 11898 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:46:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:25 smithi163 bash[24253]: cephadm 2024-08-31T06:46:24.199103+0000 mgr.a (mgr.14388) 11899 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:46:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:25 smithi163 bash[24253]: cluster 2024-08-31T06:46:24.349279+0000 mgr.a (mgr.14388) 11900 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:25 smithi027 bash[22610]: audit 2024-08-31T06:46:24.197871+0000 mgr.a (mgr.14388) 11898 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:46:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:25 smithi027 bash[22610]: cephadm 2024-08-31T06:46:24.199103+0000 mgr.a (mgr.14388) 11899 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:46:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:25 smithi027 bash[22610]: cluster 2024-08-31T06:46:24.349279+0000 mgr.a (mgr.14388) 11900 : cluster [DBG] pgmap v8248: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:27 smithi191 bash[24992]: cluster 2024-08-31T06:46:26.350055+0000 mgr.a (mgr.14388) 11901 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:46:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:27 smithi163 bash[24253]: cluster 2024-08-31T06:46:26.350055+0000 mgr.a (mgr.14388) 11901 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:46:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:27 smithi027 bash[22610]: cluster 2024-08-31T06:46:26.350055+0000 mgr.a (mgr.14388) 11901 : cluster [DBG] pgmap v8249: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:46:28.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:46:28.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:46:28.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:46:29.038 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:29.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:29.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:29.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:29.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:29 smithi191 bash[24992]: cluster 2024-08-31T06:46:28.352225+0000 mgr.a (mgr.14388) 11902 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:29 smithi163 bash[24253]: cluster 2024-08-31T06:46:28.352225+0000 mgr.a (mgr.14388) 11902 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:29 smithi027 bash[22610]: cluster 2024-08-31T06:46:28.352225+0000 mgr.a (mgr.14388) 11902 : cluster [DBG] pgmap v8250: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:30 smithi191 bash[24992]: audit 2024-08-31T06:46:28.624141+0000 mgr.a (mgr.14388) 11903 : audit [DBG] from='client.261126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:30 smithi163 bash[24253]: audit 2024-08-31T06:46:28.624141+0000 mgr.a (mgr.14388) 11903 : audit [DBG] from='client.261126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:30 smithi027 bash[22610]: audit 2024-08-31T06:46:28.624141+0000 mgr.a (mgr.14388) 11903 : audit [DBG] from='client.261126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:31 smithi191 bash[24992]: cluster 2024-08-31T06:46:30.353171+0000 mgr.a (mgr.14388) 11904 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:46:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:31 smithi163 bash[24253]: cluster 2024-08-31T06:46:30.353171+0000 mgr.a (mgr.14388) 11904 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:46:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:31 smithi027 bash[22610]: cluster 2024-08-31T06:46:30.353171+0000 mgr.a (mgr.14388) 11904 : cluster [DBG] pgmap v8251: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:46:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:32 smithi191 bash[24992]: cluster 2024-08-31T06:46:32.353960+0000 mgr.a (mgr.14388) 11905 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:46:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:32 smithi163 bash[24253]: cluster 2024-08-31T06:46:32.353960+0000 mgr.a (mgr.14388) 11905 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:46:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:32 smithi027 bash[22610]: cluster 2024-08-31T06:46:32.353960+0000 mgr.a (mgr.14388) 11905 : cluster [DBG] pgmap v8252: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:46:34.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:46:34.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:46:34.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:46:34.797 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:34.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:34.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:34.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:34.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:35 smithi163 bash[24253]: cluster 2024-08-31T06:46:34.356046+0000 mgr.a (mgr.14388) 11906 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:35 smithi163 bash[24253]: audit 2024-08-31T06:46:34.369259+0000 mgr.a (mgr.14388) 11907 : audit [DBG] from='client.261204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:35 smithi027 bash[22610]: cluster 2024-08-31T06:46:34.356046+0000 mgr.a (mgr.14388) 11906 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:35 smithi027 bash[22610]: audit 2024-08-31T06:46:34.369259+0000 mgr.a (mgr.14388) 11907 : audit [DBG] from='client.261204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:35 smithi191 bash[24992]: cluster 2024-08-31T06:46:34.356046+0000 mgr.a (mgr.14388) 11906 : cluster [DBG] pgmap v8253: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:35 smithi191 bash[24992]: audit 2024-08-31T06:46:34.369259+0000 mgr.a (mgr.14388) 11907 : audit [DBG] from='client.261204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:37 smithi163 bash[24253]: cluster 2024-08-31T06:46:36.356953+0000 mgr.a (mgr.14388) 11908 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:37 smithi027 bash[22610]: cluster 2024-08-31T06:46:36.356953+0000 mgr.a (mgr.14388) 11908 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:37 smithi191 bash[24992]: cluster 2024-08-31T06:46:36.356953+0000 mgr.a (mgr.14388) 11908 : cluster [DBG] pgmap v8254: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:39 smithi163 bash[24253]: cluster 2024-08-31T06:46:38.359127+0000 mgr.a (mgr.14388) 11909 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:39 smithi027 bash[22610]: cluster 2024-08-31T06:46:38.359127+0000 mgr.a (mgr.14388) 11909 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:39 smithi191 bash[24992]: cluster 2024-08-31T06:46:38.359127+0000 mgr.a (mgr.14388) 11909 : cluster [DBG] pgmap v8255: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:46:39.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:46:39.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:46:39.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:46:40.577 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:40.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:40.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:41 smithi163 bash[24253]: audit 2024-08-31T06:46:40.136225+0000 mgr.a (mgr.14388) 11910 : audit [DBG] from='client.261276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:41 smithi163 bash[24253]: cluster 2024-08-31T06:46:40.359711+0000 mgr.a (mgr.14388) 11911 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:41 smithi027 bash[22610]: audit 2024-08-31T06:46:40.136225+0000 mgr.a (mgr.14388) 11910 : audit [DBG] from='client.261276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:41 smithi027 bash[22610]: cluster 2024-08-31T06:46:40.359711+0000 mgr.a (mgr.14388) 11911 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:41 smithi191 bash[24992]: audit 2024-08-31T06:46:40.136225+0000 mgr.a (mgr.14388) 11910 : audit [DBG] from='client.261276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:41 smithi191 bash[24992]: cluster 2024-08-31T06:46:40.359711+0000 mgr.a (mgr.14388) 11911 : cluster [DBG] pgmap v8256: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:43 smithi163 bash[24253]: cluster 2024-08-31T06:46:42.360633+0000 mgr.a (mgr.14388) 11912 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:43 smithi027 bash[22610]: cluster 2024-08-31T06:46:42.360633+0000 mgr.a (mgr.14388) 11912 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:43 smithi191 bash[24992]: cluster 2024-08-31T06:46:42.360633+0000 mgr.a (mgr.14388) 11912 : cluster [DBG] pgmap v8257: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:45.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:46:45.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:46:45.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:46:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:45 smithi163 bash[24253]: cluster 2024-08-31T06:46:44.362877+0000 mgr.a (mgr.14388) 11913 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:45 smithi027 bash[22610]: cluster 2024-08-31T06:46:44.362877+0000 mgr.a (mgr.14388) 11913 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:45 smithi191 bash[24992]: cluster 2024-08-31T06:46:44.362877+0000 mgr.a (mgr.14388) 11913 : cluster [DBG] pgmap v8258: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:46.355 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:46.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:46.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:46.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:46.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:47 smithi163 bash[24253]: audit 2024-08-31T06:46:45.915142+0000 mgr.a (mgr.14388) 11914 : audit [DBG] from='client.261354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:47 smithi163 bash[24253]: cluster 2024-08-31T06:46:46.363360+0000 mgr.a (mgr.14388) 11915 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:47 smithi027 bash[22610]: audit 2024-08-31T06:46:45.915142+0000 mgr.a (mgr.14388) 11914 : audit [DBG] from='client.261354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:47 smithi027 bash[22610]: cluster 2024-08-31T06:46:46.363360+0000 mgr.a (mgr.14388) 11915 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:47 smithi191 bash[24992]: audit 2024-08-31T06:46:45.915142+0000 mgr.a (mgr.14388) 11914 : audit [DBG] from='client.261354 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:47 smithi191 bash[24992]: cluster 2024-08-31T06:46:46.363360+0000 mgr.a (mgr.14388) 11915 : cluster [DBG] pgmap v8259: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:49 smithi163 bash[24253]: cluster 2024-08-31T06:46:48.365427+0000 mgr.a (mgr.14388) 11916 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:49 smithi027 bash[22610]: cluster 2024-08-31T06:46:48.365427+0000 mgr.a (mgr.14388) 11916 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:49 smithi191 bash[24992]: cluster 2024-08-31T06:46:48.365427+0000 mgr.a (mgr.14388) 11916 : cluster [DBG] pgmap v8260: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:51.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:46:51.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:46:51.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:46:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:51 smithi163 bash[24253]: cluster 2024-08-31T06:46:50.366193+0000 mgr.a (mgr.14388) 11917 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:51 smithi027 bash[22610]: cluster 2024-08-31T06:46:50.366193+0000 mgr.a (mgr.14388) 11917 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:51 smithi191 bash[24992]: cluster 2024-08-31T06:46:50.366193+0000 mgr.a (mgr.14388) 11917 : cluster [DBG] pgmap v8261: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:52.117 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:52.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:52.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:52.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:52.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:53 smithi027 bash[22610]: audit 2024-08-31T06:46:51.689373+0000 mgr.a (mgr.14388) 11918 : audit [DBG] from='client.261432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:53 smithi027 bash[22610]: cluster 2024-08-31T06:46:52.367160+0000 mgr.a (mgr.14388) 11919 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:53 smithi191 bash[24992]: audit 2024-08-31T06:46:51.689373+0000 mgr.a (mgr.14388) 11918 : audit [DBG] from='client.261432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:53 smithi191 bash[24992]: cluster 2024-08-31T06:46:52.367160+0000 mgr.a (mgr.14388) 11919 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:53 smithi163 bash[24253]: audit 2024-08-31T06:46:51.689373+0000 mgr.a (mgr.14388) 11918 : audit [DBG] from='client.261432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:53 smithi163 bash[24253]: cluster 2024-08-31T06:46:52.367160+0000 mgr.a (mgr.14388) 11919 : cluster [DBG] pgmap v8262: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:55 smithi027 bash[22610]: cluster 2024-08-31T06:46:54.369504+0000 mgr.a (mgr.14388) 11920 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:55 smithi191 bash[24992]: cluster 2024-08-31T06:46:54.369504+0000 mgr.a (mgr.14388) 11920 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:55 smithi163 bash[24253]: cluster 2024-08-31T06:46:54.369504+0000 mgr.a (mgr.14388) 11920 : cluster [DBG] pgmap v8263: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:57.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:46:57.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:46:57.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:46:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:57 smithi027 bash[22610]: cluster 2024-08-31T06:46:56.370435+0000 mgr.a (mgr.14388) 11921 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:57 smithi191 bash[24992]: cluster 2024-08-31T06:46:56.370435+0000 mgr.a (mgr.14388) 11921 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:57.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:46:57.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:46:57.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:46:57.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:46:57.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:46:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:57 smithi163 bash[24253]: cluster 2024-08-31T06:46:56.370435+0000 mgr.a (mgr.14388) 11921 : cluster [DBG] pgmap v8264: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:46:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:58 smithi027 bash[22610]: audit 2024-08-31T06:46:57.448768+0000 mgr.a (mgr.14388) 11922 : audit [DBG] from='client.261507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:58 smithi191 bash[24992]: audit 2024-08-31T06:46:57.448768+0000 mgr.a (mgr.14388) 11922 : audit [DBG] from='client.261507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:58 smithi163 bash[24253]: audit 2024-08-31T06:46:57.448768+0000 mgr.a (mgr.14388) 11922 : audit [DBG] from='client.261507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:46:59 smithi027 bash[22610]: cluster 2024-08-31T06:46:58.372742+0000 mgr.a (mgr.14388) 11923 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:46:59 smithi191 bash[24992]: cluster 2024-08-31T06:46:58.372742+0000 mgr.a (mgr.14388) 11923 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:46:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:46:59 smithi163 bash[24253]: cluster 2024-08-31T06:46:58.372742+0000 mgr.a (mgr.14388) 11923 : cluster [DBG] pgmap v8265: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:47:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:01 smithi027 bash[22610]: cluster 2024-08-31T06:47:00.373528+0000 mgr.a (mgr.14388) 11924 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:01 smithi191 bash[24992]: cluster 2024-08-31T06:47:00.373528+0000 mgr.a (mgr.14388) 11924 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:01 smithi163 bash[24253]: cluster 2024-08-31T06:47:00.373528+0000 mgr.a (mgr.14388) 11924 : cluster [DBG] pgmap v8266: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:02.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:47:02.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:47:02.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:47:03.633 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:47:03.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:47:03.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:47:03.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:47:03.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:47:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:03 smithi027 bash[22610]: cluster 2024-08-31T06:47:02.374324+0000 mgr.a (mgr.14388) 11925 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:03 smithi191 bash[24992]: cluster 2024-08-31T06:47:02.374324+0000 mgr.a (mgr.14388) 11925 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:03 smithi163 bash[24253]: cluster 2024-08-31T06:47:02.374324+0000 mgr.a (mgr.14388) 11925 : cluster [DBG] pgmap v8267: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:04 smithi191 bash[24992]: audit 2024-08-31T06:47:03.211685+0000 mgr.a (mgr.14388) 11926 : audit [DBG] from='client.261585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:04 smithi163 bash[24253]: audit 2024-08-31T06:47:03.211685+0000 mgr.a (mgr.14388) 11926 : audit [DBG] from='client.261585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:04 smithi027 bash[22610]: audit 2024-08-31T06:47:03.211685+0000 mgr.a (mgr.14388) 11926 : audit [DBG] from='client.261585 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:05 smithi191 bash[24992]: cluster 2024-08-31T06:47:04.377062+0000 mgr.a (mgr.14388) 11927 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:05 smithi163 bash[24253]: cluster 2024-08-31T06:47:04.377062+0000 mgr.a (mgr.14388) 11927 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:05 smithi027 bash[22610]: cluster 2024-08-31T06:47:04.377062+0000 mgr.a (mgr.14388) 11927 : cluster [DBG] pgmap v8268: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:07 smithi191 bash[24992]: cluster 2024-08-31T06:47:06.377819+0000 mgr.a (mgr.14388) 11928 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:47:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:07 smithi163 bash[24253]: cluster 2024-08-31T06:47:06.377819+0000 mgr.a (mgr.14388) 11928 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:47:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:07 smithi027 bash[22610]: cluster 2024-08-31T06:47:06.377819+0000 mgr.a (mgr.14388) 11928 : cluster [DBG] pgmap v8269: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:47:08.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:47:08.635 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:47:08.635 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:47:09.404 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:47:09.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:47:09.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:47:09.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:47:09.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:47:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:09 smithi191 bash[24992]: cluster 2024-08-31T06:47:08.379727+0000 mgr.a (mgr.14388) 11929 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:09 smithi163 bash[24253]: cluster 2024-08-31T06:47:08.379727+0000 mgr.a (mgr.14388) 11929 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:09 smithi027 bash[22610]: cluster 2024-08-31T06:47:08.379727+0000 mgr.a (mgr.14388) 11929 : cluster [DBG] pgmap v8270: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:10 smithi191 bash[24992]: audit 2024-08-31T06:47:08.968867+0000 mgr.a (mgr.14388) 11930 : audit [DBG] from='client.261660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:10 smithi163 bash[24253]: audit 2024-08-31T06:47:08.968867+0000 mgr.a (mgr.14388) 11930 : audit [DBG] from='client.261660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:10 smithi027 bash[22610]: audit 2024-08-31T06:47:08.968867+0000 mgr.a (mgr.14388) 11930 : audit [DBG] from='client.261660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:11 smithi191 bash[24992]: cluster 2024-08-31T06:47:10.380628+0000 mgr.a (mgr.14388) 11931 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:47:11.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:11 smithi163 bash[24253]: cluster 2024-08-31T06:47:10.380628+0000 mgr.a (mgr.14388) 11931 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:47:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:11 smithi027 bash[22610]: cluster 2024-08-31T06:47:10.380628+0000 mgr.a (mgr.14388) 11931 : cluster [DBG] pgmap v8271: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:47:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:13 smithi191 bash[24992]: cluster 2024-08-31T06:47:12.381410+0000 mgr.a (mgr.14388) 11932 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:47:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:13 smithi163 bash[24253]: cluster 2024-08-31T06:47:12.381410+0000 mgr.a (mgr.14388) 11932 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:47:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:13 smithi027 bash[22610]: cluster 2024-08-31T06:47:12.381410+0000 mgr.a (mgr.14388) 11932 : cluster [DBG] pgmap v8272: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:47:14.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:47:14.407 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:47:14.407 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:47:15.158 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:47:15.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:47:15.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:47:15.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:47:15.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:47:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:15 smithi191 bash[24992]: cluster 2024-08-31T06:47:14.383630+0000 mgr.a (mgr.14388) 11933 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:15 smithi163 bash[24253]: cluster 2024-08-31T06:47:14.383630+0000 mgr.a (mgr.14388) 11933 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:15 smithi027 bash[22610]: cluster 2024-08-31T06:47:14.383630+0000 mgr.a (mgr.14388) 11933 : cluster [DBG] pgmap v8273: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:16 smithi191 bash[24992]: audit 2024-08-31T06:47:14.741142+0000 mgr.a (mgr.14388) 11934 : audit [DBG] from='client.261732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:16 smithi163 bash[24253]: audit 2024-08-31T06:47:14.741142+0000 mgr.a (mgr.14388) 11934 : audit [DBG] from='client.261732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:16 smithi027 bash[22610]: audit 2024-08-31T06:47:14.741142+0000 mgr.a (mgr.14388) 11934 : audit [DBG] from='client.261732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:17 smithi191 bash[24992]: cluster 2024-08-31T06:47:16.384515+0000 mgr.a (mgr.14388) 11935 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:17 smithi163 bash[24253]: cluster 2024-08-31T06:47:16.384515+0000 mgr.a (mgr.14388) 11935 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:17 smithi027 bash[22610]: cluster 2024-08-31T06:47:16.384515+0000 mgr.a (mgr.14388) 11935 : cluster [DBG] pgmap v8274: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:18 smithi163 bash[24253]: cluster 2024-08-31T06:47:18.386656+0000 mgr.a (mgr.14388) 11936 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:47:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:18 smithi027 bash[22610]: cluster 2024-08-31T06:47:18.386656+0000 mgr.a (mgr.14388) 11936 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:47:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:18 smithi191 bash[24992]: cluster 2024-08-31T06:47:18.386656+0000 mgr.a (mgr.14388) 11936 : cluster [DBG] pgmap v8275: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:47:20.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:47:20.160 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:47:20.160 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:47:20.938 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:47:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:47:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:47:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:47:20.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:47:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:21 smithi163 bash[24253]: cluster 2024-08-31T06:47:20.387415+0000 mgr.a (mgr.14388) 11937 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:21 smithi163 bash[24253]: audit 2024-08-31T06:47:20.502245+0000 mgr.a (mgr.14388) 11938 : audit [DBG] from='client.261807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:21 smithi027 bash[22610]: cluster 2024-08-31T06:47:20.387415+0000 mgr.a (mgr.14388) 11937 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:21.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:21 smithi027 bash[22610]: audit 2024-08-31T06:47:20.502245+0000 mgr.a (mgr.14388) 11938 : audit [DBG] from='client.261807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:21 smithi191 bash[24992]: cluster 2024-08-31T06:47:20.387415+0000 mgr.a (mgr.14388) 11937 : cluster [DBG] pgmap v8276: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:21 smithi191 bash[24992]: audit 2024-08-31T06:47:20.502245+0000 mgr.a (mgr.14388) 11938 : audit [DBG] from='client.261807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:23 smithi163 bash[24253]: cluster 2024-08-31T06:47:22.388467+0000 mgr.a (mgr.14388) 11939 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:23 smithi027 bash[22610]: cluster 2024-08-31T06:47:22.388467+0000 mgr.a (mgr.14388) 11939 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:23 smithi191 bash[24992]: cluster 2024-08-31T06:47:22.388467+0000 mgr.a (mgr.14388) 11939 : cluster [DBG] pgmap v8277: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:24 smithi027 bash[22610]: audit 2024-08-31T06:47:24.266494+0000 mon.a (mon.0) 2367 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:47:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:24 smithi191 bash[24992]: audit 2024-08-31T06:47:24.266494+0000 mon.a (mon.0) 2367 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:47:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:24 smithi163 bash[24253]: audit 2024-08-31T06:47:24.266494+0000 mon.a (mon.0) 2367 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:47:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:25 smithi027 bash[22610]: cluster 2024-08-31T06:47:24.390076+0000 mgr.a (mgr.14388) 11940 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:47:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:25 smithi027 bash[22610]: audit 2024-08-31T06:47:25.101733+0000 mon.a (mon.0) 2368 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:47:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:25 smithi027 bash[22610]: audit 2024-08-31T06:47:25.102999+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:47:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:25 smithi027 bash[22610]: audit 2024-08-31T06:47:25.112636+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:47:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:25 smithi027 bash[22610]: audit 2024-08-31T06:47:25.117485+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:47:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:25 smithi191 bash[24992]: cluster 2024-08-31T06:47:24.390076+0000 mgr.a (mgr.14388) 11940 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:47:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:25 smithi191 bash[24992]: audit 2024-08-31T06:47:25.101733+0000 mon.a (mon.0) 2368 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:47:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:25 smithi191 bash[24992]: audit 2024-08-31T06:47:25.102999+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:47:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:25 smithi191 bash[24992]: audit 2024-08-31T06:47:25.112636+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:47:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:25 smithi191 bash[24992]: audit 2024-08-31T06:47:25.117485+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:47:25.940 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:47:25.940 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:47:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:25 smithi163 bash[24253]: cluster 2024-08-31T06:47:24.390076+0000 mgr.a (mgr.14388) 11940 : cluster [DBG] pgmap v8278: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:47:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:25 smithi163 bash[24253]: audit 2024-08-31T06:47:25.101733+0000 mon.a (mon.0) 2368 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:47:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:25 smithi163 bash[24253]: audit 2024-08-31T06:47:25.102999+0000 mon.a (mon.0) 2369 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:47:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:25 smithi163 bash[24253]: audit 2024-08-31T06:47:25.112636+0000 mon.a (mon.0) 2370 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:47:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:25 smithi163 bash[24253]: audit 2024-08-31T06:47:25.117485+0000 mon.a (mon.0) 2371 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:47:26.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:47:25 smithi027 bash[22863]: debug 2024-08-31T06:47:25.853+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:47:26.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:47:25 smithi027 bash[22863]: debug 2024-08-31T06:47:25.853+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:47:26.687 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:47:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:47:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:47:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:47:26.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:47:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:26 smithi027 bash[22610]: audit 2024-08-31T06:47:25.119798+0000 mgr.a (mgr.14388) 11941 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:47:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:26 smithi191 bash[24992]: audit 2024-08-31T06:47:25.119798+0000 mgr.a (mgr.14388) 11941 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:47:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:26 smithi163 bash[24253]: audit 2024-08-31T06:47:25.119798+0000 mgr.a (mgr.14388) 11941 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:47:27.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:27 smithi027 bash[22610]: audit 2024-08-31T06:47:25.856979+0000 mgr.a (mgr.14388) 11942 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:47:27.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:27 smithi027 bash[22610]: cephadm 2024-08-31T06:47:25.858451+0000 mgr.a (mgr.14388) 11943 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:47:27.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:27 smithi027 bash[22610]: audit 2024-08-31T06:47:26.266341+0000 mgr.a (mgr.14388) 11944 : audit [DBG] from='client.261993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:27.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:27 smithi027 bash[22610]: cluster 2024-08-31T06:47:26.390573+0000 mgr.a (mgr.14388) 11945 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:27 smithi191 bash[24992]: audit 2024-08-31T06:47:25.856979+0000 mgr.a (mgr.14388) 11942 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:47:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:27 smithi191 bash[24992]: cephadm 2024-08-31T06:47:25.858451+0000 mgr.a (mgr.14388) 11943 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:47:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:27 smithi191 bash[24992]: audit 2024-08-31T06:47:26.266341+0000 mgr.a (mgr.14388) 11944 : audit [DBG] from='client.261993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:27 smithi191 bash[24992]: cluster 2024-08-31T06:47:26.390573+0000 mgr.a (mgr.14388) 11945 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:27 smithi163 bash[24253]: audit 2024-08-31T06:47:25.856979+0000 mgr.a (mgr.14388) 11942 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:47:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:27 smithi163 bash[24253]: cephadm 2024-08-31T06:47:25.858451+0000 mgr.a (mgr.14388) 11943 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:47:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:27 smithi163 bash[24253]: audit 2024-08-31T06:47:26.266341+0000 mgr.a (mgr.14388) 11944 : audit [DBG] from='client.261993 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:27 smithi163 bash[24253]: cluster 2024-08-31T06:47:26.390573+0000 mgr.a (mgr.14388) 11945 : cluster [DBG] pgmap v8279: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:29 smithi027 bash[22610]: cluster 2024-08-31T06:47:28.392907+0000 mgr.a (mgr.14388) 11946 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:29 smithi191 bash[24992]: cluster 2024-08-31T06:47:28.392907+0000 mgr.a (mgr.14388) 11946 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:29 smithi163 bash[24253]: cluster 2024-08-31T06:47:28.392907+0000 mgr.a (mgr.14388) 11946 : cluster [DBG] pgmap v8280: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:31.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:47:31.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:47:31.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:47:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:31 smithi027 bash[22610]: cluster 2024-08-31T06:47:30.393859+0000 mgr.a (mgr.14388) 11947 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:31 smithi191 bash[24992]: cluster 2024-08-31T06:47:30.393859+0000 mgr.a (mgr.14388) 11947 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:31 smithi163 bash[24253]: cluster 2024-08-31T06:47:30.393859+0000 mgr.a (mgr.14388) 11947 : cluster [DBG] pgmap v8281: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:32.457 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:47:32.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:47:32.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:47:32.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:47:32.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:47:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:33 smithi027 bash[22610]: audit 2024-08-31T06:47:32.023082+0000 mgr.a (mgr.14388) 11948 : audit [DBG] from='client.262068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:33 smithi027 bash[22610]: cluster 2024-08-31T06:47:32.394437+0000 mgr.a (mgr.14388) 11949 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:33 smithi191 bash[24992]: audit 2024-08-31T06:47:32.023082+0000 mgr.a (mgr.14388) 11948 : audit [DBG] from='client.262068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:33 smithi191 bash[24992]: cluster 2024-08-31T06:47:32.394437+0000 mgr.a (mgr.14388) 11949 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:33 smithi163 bash[24253]: audit 2024-08-31T06:47:32.023082+0000 mgr.a (mgr.14388) 11948 : audit [DBG] from='client.262068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:33 smithi163 bash[24253]: cluster 2024-08-31T06:47:32.394437+0000 mgr.a (mgr.14388) 11949 : cluster [DBG] pgmap v8282: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:35 smithi191 bash[24992]: cluster 2024-08-31T06:47:34.396714+0000 mgr.a (mgr.14388) 11950 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:35 smithi163 bash[24253]: cluster 2024-08-31T06:47:34.396714+0000 mgr.a (mgr.14388) 11950 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:35.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:35 smithi027 bash[22610]: cluster 2024-08-31T06:47:34.396714+0000 mgr.a (mgr.14388) 11950 : cluster [DBG] pgmap v8283: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:37.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:47:37.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:47:37.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:47:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:37 smithi191 bash[24992]: cluster 2024-08-31T06:47:36.397651+0000 mgr.a (mgr.14388) 11951 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:37 smithi163 bash[24253]: cluster 2024-08-31T06:47:36.397651+0000 mgr.a (mgr.14388) 11951 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:37 smithi027 bash[22610]: cluster 2024-08-31T06:47:36.397651+0000 mgr.a (mgr.14388) 11951 : cluster [DBG] pgmap v8284: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:38.226 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:47:38.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:47:38.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:47:38.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:47:38.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:47:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:39 smithi191 bash[24992]: audit 2024-08-31T06:47:37.792650+0000 mgr.a (mgr.14388) 11952 : audit [DBG] from='client.262143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:39 smithi191 bash[24992]: cluster 2024-08-31T06:47:38.400426+0000 mgr.a (mgr.14388) 11953 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:39 smithi163 bash[24253]: audit 2024-08-31T06:47:37.792650+0000 mgr.a (mgr.14388) 11952 : audit [DBG] from='client.262143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:39 smithi163 bash[24253]: cluster 2024-08-31T06:47:38.400426+0000 mgr.a (mgr.14388) 11953 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:39 smithi027 bash[22610]: audit 2024-08-31T06:47:37.792650+0000 mgr.a (mgr.14388) 11952 : audit [DBG] from='client.262143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:39 smithi027 bash[22610]: cluster 2024-08-31T06:47:38.400426+0000 mgr.a (mgr.14388) 11953 : cluster [DBG] pgmap v8285: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:47:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:41 smithi191 bash[24992]: cluster 2024-08-31T06:47:40.401358+0000 mgr.a (mgr.14388) 11954 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:47:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:41 smithi163 bash[24253]: cluster 2024-08-31T06:47:40.401358+0000 mgr.a (mgr.14388) 11954 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:47:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:41 smithi027 bash[22610]: cluster 2024-08-31T06:47:40.401358+0000 mgr.a (mgr.14388) 11954 : cluster [DBG] pgmap v8286: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:47:43.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:47:43.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:47:43.228 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:47:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:43 smithi191 bash[24992]: cluster 2024-08-31T06:47:42.402299+0000 mgr.a (mgr.14388) 11955 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:47:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:43 smithi163 bash[24253]: cluster 2024-08-31T06:47:42.402299+0000 mgr.a (mgr.14388) 11955 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:47:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:43 smithi027 bash[22610]: cluster 2024-08-31T06:47:42.402299+0000 mgr.a (mgr.14388) 11955 : cluster [DBG] pgmap v8287: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:47:44.009 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:47:44.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:47:44.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:47:44.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:47:44.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:47:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:45 smithi191 bash[24992]: audit 2024-08-31T06:47:43.561907+0000 mgr.a (mgr.14388) 11956 : audit [DBG] from='client.262218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:45 smithi191 bash[24992]: cluster 2024-08-31T06:47:44.405059+0000 mgr.a (mgr.14388) 11957 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:45 smithi163 bash[24253]: audit 2024-08-31T06:47:43.561907+0000 mgr.a (mgr.14388) 11956 : audit [DBG] from='client.262218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:45 smithi163 bash[24253]: cluster 2024-08-31T06:47:44.405059+0000 mgr.a (mgr.14388) 11957 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:45 smithi027 bash[22610]: audit 2024-08-31T06:47:43.561907+0000 mgr.a (mgr.14388) 11956 : audit [DBG] from='client.262218 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:45 smithi027 bash[22610]: cluster 2024-08-31T06:47:44.405059+0000 mgr.a (mgr.14388) 11957 : cluster [DBG] pgmap v8288: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:47 smithi191 bash[24992]: cluster 2024-08-31T06:47:46.405864+0000 mgr.a (mgr.14388) 11958 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:47:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:47 smithi163 bash[24253]: cluster 2024-08-31T06:47:46.405864+0000 mgr.a (mgr.14388) 11958 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:47:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:47 smithi027 bash[22610]: cluster 2024-08-31T06:47:46.405864+0000 mgr.a (mgr.14388) 11958 : cluster [DBG] pgmap v8289: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:47:49.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:47:49.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:47:49.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:47:49.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:47:49.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:47:49.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:47:49.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:47:49.777 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:47:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:49 smithi191 bash[24992]: cluster 2024-08-31T06:47:48.407757+0000 mgr.a (mgr.14388) 11959 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:49 smithi163 bash[24253]: cluster 2024-08-31T06:47:48.407757+0000 mgr.a (mgr.14388) 11959 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:49 smithi027 bash[22610]: cluster 2024-08-31T06:47:48.407757+0000 mgr.a (mgr.14388) 11959 : cluster [DBG] pgmap v8290: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:50 smithi191 bash[24992]: audit 2024-08-31T06:47:49.346137+0000 mgr.a (mgr.14388) 11960 : audit [DBG] from='client.262290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:50 smithi163 bash[24253]: audit 2024-08-31T06:47:49.346137+0000 mgr.a (mgr.14388) 11960 : audit [DBG] from='client.262290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:50 smithi027 bash[22610]: audit 2024-08-31T06:47:49.346137+0000 mgr.a (mgr.14388) 11960 : audit [DBG] from='client.262290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:51 smithi191 bash[24992]: cluster 2024-08-31T06:47:50.408667+0000 mgr.a (mgr.14388) 11961 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:47:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:51 smithi163 bash[24253]: cluster 2024-08-31T06:47:50.408667+0000 mgr.a (mgr.14388) 11961 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:47:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:51 smithi027 bash[22610]: cluster 2024-08-31T06:47:50.408667+0000 mgr.a (mgr.14388) 11961 : cluster [DBG] pgmap v8291: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:47:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:53 smithi191 bash[24992]: cluster 2024-08-31T06:47:52.409477+0000 mgr.a (mgr.14388) 11962 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:47:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:53 smithi163 bash[24253]: cluster 2024-08-31T06:47:52.409477+0000 mgr.a (mgr.14388) 11962 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:47:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:53 smithi027 bash[22610]: cluster 2024-08-31T06:47:52.409477+0000 mgr.a (mgr.14388) 11962 : cluster [DBG] pgmap v8292: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:47:54.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:47:54.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:47:54.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:47:55.569 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:47:55.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:47:55.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:47:55.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:47:55.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:47:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:55 smithi191 bash[24992]: cluster 2024-08-31T06:47:54.411664+0000 mgr.a (mgr.14388) 11963 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:47:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:55 smithi163 bash[24253]: cluster 2024-08-31T06:47:54.411664+0000 mgr.a (mgr.14388) 11963 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:47:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:55 smithi027 bash[22610]: cluster 2024-08-31T06:47:54.411664+0000 mgr.a (mgr.14388) 11963 : cluster [DBG] pgmap v8293: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:47:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:56 smithi191 bash[24992]: audit 2024-08-31T06:47:55.112319+0000 mgr.a (mgr.14388) 11964 : audit [DBG] from='client.262368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:56 smithi163 bash[24253]: audit 2024-08-31T06:47:55.112319+0000 mgr.a (mgr.14388) 11964 : audit [DBG] from='client.262368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:56 smithi027 bash[22610]: audit 2024-08-31T06:47:55.112319+0000 mgr.a (mgr.14388) 11964 : audit [DBG] from='client.262368 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:47:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:57 smithi163 bash[24253]: cluster 2024-08-31T06:47:56.412562+0000 mgr.a (mgr.14388) 11965 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:57 smithi027 bash[22610]: cluster 2024-08-31T06:47:56.412562+0000 mgr.a (mgr.14388) 11965 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:57 smithi191 bash[24992]: cluster 2024-08-31T06:47:56.412562+0000 mgr.a (mgr.14388) 11965 : cluster [DBG] pgmap v8294: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:47:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:47:58 smithi163 bash[24253]: cluster 2024-08-31T06:47:58.414681+0000 mgr.a (mgr.14388) 11966 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:47:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:47:58 smithi027 bash[22610]: cluster 2024-08-31T06:47:58.414681+0000 mgr.a (mgr.14388) 11966 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:47:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:47:58 smithi191 bash[24992]: cluster 2024-08-31T06:47:58.414681+0000 mgr.a (mgr.14388) 11966 : cluster [DBG] pgmap v8295: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:00.572 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:00.572 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:01.317 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:01.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:01.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:01.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:01.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:01 smithi027 bash[22610]: cluster 2024-08-31T06:48:00.415439+0000 mgr.a (mgr.14388) 11967 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:01 smithi191 bash[24992]: cluster 2024-08-31T06:48:00.415439+0000 mgr.a (mgr.14388) 11967 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:01 smithi163 bash[24253]: cluster 2024-08-31T06:48:00.415439+0000 mgr.a (mgr.14388) 11967 : cluster [DBG] pgmap v8296: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:02 smithi027 bash[22610]: audit 2024-08-31T06:48:00.907926+0000 mgr.a (mgr.14388) 11968 : audit [DBG] from='client.262446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:02 smithi191 bash[24992]: audit 2024-08-31T06:48:00.907926+0000 mgr.a (mgr.14388) 11968 : audit [DBG] from='client.262446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:02 smithi163 bash[24253]: audit 2024-08-31T06:48:00.907926+0000 mgr.a (mgr.14388) 11968 : audit [DBG] from='client.262446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:03 smithi027 bash[22610]: cluster 2024-08-31T06:48:02.416480+0000 mgr.a (mgr.14388) 11969 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:03 smithi191 bash[24992]: cluster 2024-08-31T06:48:02.416480+0000 mgr.a (mgr.14388) 11969 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:03 smithi163 bash[24253]: cluster 2024-08-31T06:48:02.416480+0000 mgr.a (mgr.14388) 11969 : cluster [DBG] pgmap v8297: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:05 smithi191 bash[24992]: cluster 2024-08-31T06:48:04.418886+0000 mgr.a (mgr.14388) 11970 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:05 smithi163 bash[24253]: cluster 2024-08-31T06:48:04.418886+0000 mgr.a (mgr.14388) 11970 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:05 smithi027 bash[22610]: cluster 2024-08-31T06:48:04.418886+0000 mgr.a (mgr.14388) 11970 : cluster [DBG] pgmap v8298: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:06.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:06.320 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:06.320 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:07.087 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:07.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:07.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:07.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:07.088 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:07 smithi191 bash[24992]: cluster 2024-08-31T06:48:06.419349+0000 mgr.a (mgr.14388) 11971 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:07 smithi163 bash[24253]: cluster 2024-08-31T06:48:06.419349+0000 mgr.a (mgr.14388) 11971 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:07 smithi027 bash[22610]: cluster 2024-08-31T06:48:06.419349+0000 mgr.a (mgr.14388) 11971 : cluster [DBG] pgmap v8299: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:08 smithi191 bash[24992]: audit 2024-08-31T06:48:06.658305+0000 mgr.a (mgr.14388) 11972 : audit [DBG] from='client.262524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:08 smithi163 bash[24253]: audit 2024-08-31T06:48:06.658305+0000 mgr.a (mgr.14388) 11972 : audit [DBG] from='client.262524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:08 smithi027 bash[22610]: audit 2024-08-31T06:48:06.658305+0000 mgr.a (mgr.14388) 11972 : audit [DBG] from='client.262524 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:09 smithi191 bash[24992]: cluster 2024-08-31T06:48:08.421685+0000 mgr.a (mgr.14388) 11973 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:09 smithi163 bash[24253]: cluster 2024-08-31T06:48:08.421685+0000 mgr.a (mgr.14388) 11973 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:09 smithi027 bash[22610]: cluster 2024-08-31T06:48:08.421685+0000 mgr.a (mgr.14388) 11973 : cluster [DBG] pgmap v8300: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:11 smithi191 bash[24992]: cluster 2024-08-31T06:48:10.422600+0000 mgr.a (mgr.14388) 11974 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:11 smithi163 bash[24253]: cluster 2024-08-31T06:48:10.422600+0000 mgr.a (mgr.14388) 11974 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:11 smithi027 bash[22610]: cluster 2024-08-31T06:48:10.422600+0000 mgr.a (mgr.14388) 11974 : cluster [DBG] pgmap v8301: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:12.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:12.090 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:12.090 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:12.860 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:13 smithi191 bash[24992]: audit 2024-08-31T06:48:12.423716+0000 mgr.a (mgr.14388) 11975 : audit [DBG] from='client.262602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:13 smithi191 bash[24992]: cluster 2024-08-31T06:48:12.424126+0000 mgr.a (mgr.14388) 11976 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:13 smithi163 bash[24253]: audit 2024-08-31T06:48:12.423716+0000 mgr.a (mgr.14388) 11975 : audit [DBG] from='client.262602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:13 smithi163 bash[24253]: cluster 2024-08-31T06:48:12.424126+0000 mgr.a (mgr.14388) 11976 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:13.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:13 smithi027 bash[22610]: audit 2024-08-31T06:48:12.423716+0000 mgr.a (mgr.14388) 11975 : audit [DBG] from='client.262602 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:13.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:13 smithi027 bash[22610]: cluster 2024-08-31T06:48:12.424126+0000 mgr.a (mgr.14388) 11976 : cluster [DBG] pgmap v8302: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:15 smithi191 bash[24992]: cluster 2024-08-31T06:48:14.426524+0000 mgr.a (mgr.14388) 11977 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:15 smithi163 bash[24253]: cluster 2024-08-31T06:48:14.426524+0000 mgr.a (mgr.14388) 11977 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:15 smithi027 bash[22610]: cluster 2024-08-31T06:48:14.426524+0000 mgr.a (mgr.14388) 11977 : cluster [DBG] pgmap v8303: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:17 smithi191 bash[24992]: cluster 2024-08-31T06:48:16.427492+0000 mgr.a (mgr.14388) 11978 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:17.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:17.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:17.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:17 smithi163 bash[24253]: cluster 2024-08-31T06:48:16.427492+0000 mgr.a (mgr.14388) 11978 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:17 smithi027 bash[22610]: cluster 2024-08-31T06:48:16.427492+0000 mgr.a (mgr.14388) 11978 : cluster [DBG] pgmap v8304: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:18.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:18.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:18.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:18.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:19 smithi191 bash[24992]: audit 2024-08-31T06:48:18.195369+0000 mgr.a (mgr.14388) 11979 : audit [DBG] from='client.262680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:19 smithi191 bash[24992]: cluster 2024-08-31T06:48:18.428800+0000 mgr.a (mgr.14388) 11980 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:19 smithi163 bash[24253]: audit 2024-08-31T06:48:18.195369+0000 mgr.a (mgr.14388) 11979 : audit [DBG] from='client.262680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:19 smithi163 bash[24253]: cluster 2024-08-31T06:48:18.428800+0000 mgr.a (mgr.14388) 11980 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:19 smithi027 bash[22610]: audit 2024-08-31T06:48:18.195369+0000 mgr.a (mgr.14388) 11979 : audit [DBG] from='client.262680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:19 smithi027 bash[22610]: cluster 2024-08-31T06:48:18.428800+0000 mgr.a (mgr.14388) 11980 : cluster [DBG] pgmap v8305: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:21 smithi191 bash[24992]: cluster 2024-08-31T06:48:20.429656+0000 mgr.a (mgr.14388) 11981 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:48:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:21 smithi163 bash[24253]: cluster 2024-08-31T06:48:20.429656+0000 mgr.a (mgr.14388) 11981 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:48:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:21 smithi027 bash[22610]: cluster 2024-08-31T06:48:20.429656+0000 mgr.a (mgr.14388) 11981 : cluster [DBG] pgmap v8306: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:48:23.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:23.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:23.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:23 smithi191 bash[24992]: cluster 2024-08-31T06:48:22.430425+0000 mgr.a (mgr.14388) 11982 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:48:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:23 smithi163 bash[24253]: cluster 2024-08-31T06:48:22.430425+0000 mgr.a (mgr.14388) 11982 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:48:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:23 smithi027 bash[22610]: cluster 2024-08-31T06:48:22.430425+0000 mgr.a (mgr.14388) 11982 : cluster [DBG] pgmap v8307: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:48:24.407 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:24.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:24.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:24.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:24.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:25 smithi191 bash[24992]: audit 2024-08-31T06:48:23.974771+0000 mgr.a (mgr.14388) 11983 : audit [DBG] from='client.262758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:25 smithi191 bash[24992]: cluster 2024-08-31T06:48:24.431650+0000 mgr.a (mgr.14388) 11984 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:25 smithi163 bash[24253]: audit 2024-08-31T06:48:23.974771+0000 mgr.a (mgr.14388) 11983 : audit [DBG] from='client.262758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:25 smithi163 bash[24253]: cluster 2024-08-31T06:48:24.431650+0000 mgr.a (mgr.14388) 11984 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:25 smithi027 bash[22610]: audit 2024-08-31T06:48:23.974771+0000 mgr.a (mgr.14388) 11983 : audit [DBG] from='client.262758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:25 smithi027 bash[22610]: cluster 2024-08-31T06:48:24.431650+0000 mgr.a (mgr.14388) 11984 : cluster [DBG] pgmap v8308: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:26 smithi163 bash[24253]: audit 2024-08-31T06:48:25.909072+0000 mon.a (mon.0) 2372 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:48:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:26 smithi027 bash[22610]: audit 2024-08-31T06:48:25.909072+0000 mon.a (mon.0) 2372 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:48:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:26 smithi191 bash[24992]: audit 2024-08-31T06:48:25.909072+0000 mon.a (mon.0) 2372 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:48:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:27 smithi163 bash[24253]: cluster 2024-08-31T06:48:26.432084+0000 mgr.a (mgr.14388) 11985 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:48:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:27 smithi163 bash[24253]: audit 2024-08-31T06:48:26.728193+0000 mon.a (mon.0) 2373 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:48:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:27 smithi163 bash[24253]: audit 2024-08-31T06:48:26.730091+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:48:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:27 smithi163 bash[24253]: audit 2024-08-31T06:48:26.740996+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:48:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:27 smithi163 bash[24253]: audit 2024-08-31T06:48:26.745842+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:48:27.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:48:27 smithi027 bash[22863]: debug 2024-08-31T06:48:27.479+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:48:27.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:48:27 smithi027 bash[22863]: debug 2024-08-31T06:48:27.479+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:48:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:27 smithi027 bash[22610]: cluster 2024-08-31T06:48:26.432084+0000 mgr.a (mgr.14388) 11985 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:48:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:27 smithi027 bash[22610]: audit 2024-08-31T06:48:26.728193+0000 mon.a (mon.0) 2373 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:48:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:27 smithi027 bash[22610]: audit 2024-08-31T06:48:26.730091+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:48:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:27 smithi027 bash[22610]: audit 2024-08-31T06:48:26.740996+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:48:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:27 smithi027 bash[22610]: audit 2024-08-31T06:48:26.745842+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:48:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:27 smithi191 bash[24992]: cluster 2024-08-31T06:48:26.432084+0000 mgr.a (mgr.14388) 11985 : cluster [DBG] pgmap v8309: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:48:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:27 smithi191 bash[24992]: audit 2024-08-31T06:48:26.728193+0000 mon.a (mon.0) 2373 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:48:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:27 smithi191 bash[24992]: audit 2024-08-31T06:48:26.730091+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:48:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:27 smithi191 bash[24992]: audit 2024-08-31T06:48:26.740996+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:48:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:27 smithi191 bash[24992]: audit 2024-08-31T06:48:26.745842+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:48:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:28 smithi163 bash[24253]: audit 2024-08-31T06:48:26.747141+0000 mgr.a (mgr.14388) 11986 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:48:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:28 smithi163 bash[24253]: audit 2024-08-31T06:48:27.483393+0000 mgr.a (mgr.14388) 11987 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:48:28.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:28 smithi163 bash[24253]: cephadm 2024-08-31T06:48:27.484659+0000 mgr.a (mgr.14388) 11988 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:48:28.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:28 smithi027 bash[22610]: audit 2024-08-31T06:48:26.747141+0000 mgr.a (mgr.14388) 11986 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:48:28.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:28 smithi027 bash[22610]: audit 2024-08-31T06:48:27.483393+0000 mgr.a (mgr.14388) 11987 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:48:28.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:28 smithi027 bash[22610]: cephadm 2024-08-31T06:48:27.484659+0000 mgr.a (mgr.14388) 11988 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:48:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:28 smithi191 bash[24992]: audit 2024-08-31T06:48:26.747141+0000 mgr.a (mgr.14388) 11986 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:48:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:28 smithi191 bash[24992]: audit 2024-08-31T06:48:27.483393+0000 mgr.a (mgr.14388) 11987 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:48:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:28 smithi191 bash[24992]: cephadm 2024-08-31T06:48:27.484659+0000 mgr.a (mgr.14388) 11988 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:48:29.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:29.409 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:29.409 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:29 smithi163 bash[24253]: cluster 2024-08-31T06:48:28.434289+0000 mgr.a (mgr.14388) 11989 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:29 smithi027 bash[22610]: cluster 2024-08-31T06:48:28.434289+0000 mgr.a (mgr.14388) 11989 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:29 smithi191 bash[24992]: cluster 2024-08-31T06:48:28.434289+0000 mgr.a (mgr.14388) 11989 : cluster [DBG] pgmap v8310: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:30.160 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:30.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:30 smithi163 bash[24253]: audit 2024-08-31T06:48:29.734494+0000 mgr.a (mgr.14388) 11990 : audit [DBG] from='client.262938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:30 smithi163 bash[24253]: cluster 2024-08-31T06:48:30.435282+0000 mgr.a (mgr.14388) 11991 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:30 smithi027 bash[22610]: audit 2024-08-31T06:48:29.734494+0000 mgr.a (mgr.14388) 11990 : audit [DBG] from='client.262938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:30 smithi027 bash[22610]: cluster 2024-08-31T06:48:30.435282+0000 mgr.a (mgr.14388) 11991 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:30 smithi191 bash[24992]: audit 2024-08-31T06:48:29.734494+0000 mgr.a (mgr.14388) 11990 : audit [DBG] from='client.262938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:30 smithi191 bash[24992]: cluster 2024-08-31T06:48:30.435282+0000 mgr.a (mgr.14388) 11991 : cluster [DBG] pgmap v8311: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:33 smithi191 bash[24992]: cluster 2024-08-31T06:48:32.436092+0000 mgr.a (mgr.14388) 11992 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:33 smithi163 bash[24253]: cluster 2024-08-31T06:48:32.436092+0000 mgr.a (mgr.14388) 11992 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:33 smithi027 bash[22610]: cluster 2024-08-31T06:48:32.436092+0000 mgr.a (mgr.14388) 11992 : cluster [DBG] pgmap v8312: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:35.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:35.162 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:35.162 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:35 smithi191 bash[24992]: cluster 2024-08-31T06:48:34.438306+0000 mgr.a (mgr.14388) 11993 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:35.944 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:35.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:35.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:35.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:35.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:35 smithi163 bash[24253]: cluster 2024-08-31T06:48:34.438306+0000 mgr.a (mgr.14388) 11993 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:35 smithi027 bash[22610]: cluster 2024-08-31T06:48:34.438306+0000 mgr.a (mgr.14388) 11993 : cluster [DBG] pgmap v8313: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:36 smithi191 bash[24992]: audit 2024-08-31T06:48:35.503254+0000 mgr.a (mgr.14388) 11994 : audit [DBG] from='client.263016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:36 smithi163 bash[24253]: audit 2024-08-31T06:48:35.503254+0000 mgr.a (mgr.14388) 11994 : audit [DBG] from='client.263016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:36 smithi027 bash[22610]: audit 2024-08-31T06:48:35.503254+0000 mgr.a (mgr.14388) 11994 : audit [DBG] from='client.263016 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:37 smithi191 bash[24992]: cluster 2024-08-31T06:48:36.439297+0000 mgr.a (mgr.14388) 11995 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:37 smithi163 bash[24253]: cluster 2024-08-31T06:48:36.439297+0000 mgr.a (mgr.14388) 11995 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:37 smithi027 bash[22610]: cluster 2024-08-31T06:48:36.439297+0000 mgr.a (mgr.14388) 11995 : cluster [DBG] pgmap v8314: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:39 smithi191 bash[24992]: cluster 2024-08-31T06:48:38.441424+0000 mgr.a (mgr.14388) 11996 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:39 smithi163 bash[24253]: cluster 2024-08-31T06:48:38.441424+0000 mgr.a (mgr.14388) 11996 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:39 smithi027 bash[22610]: cluster 2024-08-31T06:48:38.441424+0000 mgr.a (mgr.14388) 11996 : cluster [DBG] pgmap v8315: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:48:40.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:40.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:41.717 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:41.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:41.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:41.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:41.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:41 smithi191 bash[24992]: cluster 2024-08-31T06:48:40.442208+0000 mgr.a (mgr.14388) 11997 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:41 smithi163 bash[24253]: cluster 2024-08-31T06:48:40.442208+0000 mgr.a (mgr.14388) 11997 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:41 smithi027 bash[22610]: cluster 2024-08-31T06:48:40.442208+0000 mgr.a (mgr.14388) 11997 : cluster [DBG] pgmap v8316: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:42 smithi191 bash[24992]: audit 2024-08-31T06:48:41.281387+0000 mgr.a (mgr.14388) 11998 : audit [DBG] from='client.263094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:42 smithi163 bash[24253]: audit 2024-08-31T06:48:41.281387+0000 mgr.a (mgr.14388) 11998 : audit [DBG] from='client.263094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:42 smithi027 bash[22610]: audit 2024-08-31T06:48:41.281387+0000 mgr.a (mgr.14388) 11998 : audit [DBG] from='client.263094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:43 smithi191 bash[24992]: cluster 2024-08-31T06:48:42.443257+0000 mgr.a (mgr.14388) 11999 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:43 smithi163 bash[24253]: cluster 2024-08-31T06:48:42.443257+0000 mgr.a (mgr.14388) 11999 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:43 smithi027 bash[22610]: cluster 2024-08-31T06:48:42.443257+0000 mgr.a (mgr.14388) 11999 : cluster [DBG] pgmap v8317: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:45 smithi191 bash[24992]: cluster 2024-08-31T06:48:44.445488+0000 mgr.a (mgr.14388) 12000 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:45 smithi163 bash[24253]: cluster 2024-08-31T06:48:44.445488+0000 mgr.a (mgr.14388) 12000 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:45 smithi027 bash[22610]: cluster 2024-08-31T06:48:44.445488+0000 mgr.a (mgr.14388) 12000 : cluster [DBG] pgmap v8318: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:48:46.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:46.720 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:46.720 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:47.483 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:47.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:47.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:47 smithi163 bash[24253]: cluster 2024-08-31T06:48:46.446275+0000 mgr.a (mgr.14388) 12001 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:47 smithi027 bash[22610]: cluster 2024-08-31T06:48:46.446275+0000 mgr.a (mgr.14388) 12001 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:47 smithi191 bash[24992]: cluster 2024-08-31T06:48:46.446275+0000 mgr.a (mgr.14388) 12001 : cluster [DBG] pgmap v8319: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:48:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:48 smithi163 bash[24253]: audit 2024-08-31T06:48:47.055212+0000 mgr.a (mgr.14388) 12002 : audit [DBG] from='client.263172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:48 smithi027 bash[22610]: audit 2024-08-31T06:48:47.055212+0000 mgr.a (mgr.14388) 12002 : audit [DBG] from='client.263172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:48 smithi191 bash[24992]: audit 2024-08-31T06:48:47.055212+0000 mgr.a (mgr.14388) 12002 : audit [DBG] from='client.263172 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:49 smithi163 bash[24253]: cluster 2024-08-31T06:48:48.448596+0000 mgr.a (mgr.14388) 12003 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T06:48:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:49 smithi027 bash[22610]: cluster 2024-08-31T06:48:48.448596+0000 mgr.a (mgr.14388) 12003 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T06:48:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:49 smithi191 bash[24992]: cluster 2024-08-31T06:48:48.448596+0000 mgr.a (mgr.14388) 12003 : cluster [DBG] pgmap v8320: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T06:48:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:50 smithi163 bash[24253]: cluster 2024-08-31T06:48:50.449520+0000 mgr.a (mgr.14388) 12004 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:48:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:50 smithi027 bash[22610]: cluster 2024-08-31T06:48:50.449520+0000 mgr.a (mgr.14388) 12004 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:48:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:50 smithi191 bash[24992]: cluster 2024-08-31T06:48:50.449520+0000 mgr.a (mgr.14388) 12004 : cluster [DBG] pgmap v8321: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:48:52.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:52.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:52.486 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:53.228 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:53.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:53.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:53.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:53.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:53 smithi191 bash[24992]: cluster 2024-08-31T06:48:52.450308+0000 mgr.a (mgr.14388) 12005 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:48:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:53 smithi163 bash[24253]: cluster 2024-08-31T06:48:52.450308+0000 mgr.a (mgr.14388) 12005 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:48:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:53 smithi027 bash[22610]: cluster 2024-08-31T06:48:52.450308+0000 mgr.a (mgr.14388) 12005 : cluster [DBG] pgmap v8322: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:48:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:54 smithi191 bash[24992]: audit 2024-08-31T06:48:52.812526+0000 mgr.a (mgr.14388) 12006 : audit [DBG] from='client.263247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:54 smithi163 bash[24253]: audit 2024-08-31T06:48:52.812526+0000 mgr.a (mgr.14388) 12006 : audit [DBG] from='client.263247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:54 smithi027 bash[22610]: audit 2024-08-31T06:48:52.812526+0000 mgr.a (mgr.14388) 12006 : audit [DBG] from='client.263247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:48:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:55 smithi191 bash[24992]: cluster 2024-08-31T06:48:54.453117+0000 mgr.a (mgr.14388) 12007 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T06:48:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:55 smithi163 bash[24253]: cluster 2024-08-31T06:48:54.453117+0000 mgr.a (mgr.14388) 12007 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T06:48:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:55 smithi027 bash[22610]: cluster 2024-08-31T06:48:54.453117+0000 mgr.a (mgr.14388) 12007 : cluster [DBG] pgmap v8323: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T06:48:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:57 smithi191 bash[24992]: cluster 2024-08-31T06:48:56.453931+0000 mgr.a (mgr.14388) 12008 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:48:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:57 smithi163 bash[24253]: cluster 2024-08-31T06:48:56.453931+0000 mgr.a (mgr.14388) 12008 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:48:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:57 smithi027 bash[22610]: cluster 2024-08-31T06:48:56.453931+0000 mgr.a (mgr.14388) 12008 : cluster [DBG] pgmap v8324: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:48:58.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:48:58.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:48:58.231 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:48:58.982 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:48:58.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:48:58.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:48:58.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:48:58.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:48:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:48:59 smithi191 bash[24992]: cluster 2024-08-31T06:48:58.455876+0000 mgr.a (mgr.14388) 12009 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:48:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:48:59 smithi163 bash[24253]: cluster 2024-08-31T06:48:58.455876+0000 mgr.a (mgr.14388) 12009 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:48:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:48:59 smithi027 bash[22610]: cluster 2024-08-31T06:48:58.455876+0000 mgr.a (mgr.14388) 12009 : cluster [DBG] pgmap v8325: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:49:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:00 smithi191 bash[24992]: audit 2024-08-31T06:48:58.559051+0000 mgr.a (mgr.14388) 12010 : audit [DBG] from='client.263322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:00 smithi163 bash[24253]: audit 2024-08-31T06:48:58.559051+0000 mgr.a (mgr.14388) 12010 : audit [DBG] from='client.263322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:00 smithi027 bash[22610]: audit 2024-08-31T06:48:58.559051+0000 mgr.a (mgr.14388) 12010 : audit [DBG] from='client.263322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:01 smithi163 bash[24253]: cluster 2024-08-31T06:49:00.457017+0000 mgr.a (mgr.14388) 12011 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:49:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:01 smithi027 bash[22610]: cluster 2024-08-31T06:49:00.457017+0000 mgr.a (mgr.14388) 12011 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:49:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:01 smithi191 bash[24992]: cluster 2024-08-31T06:49:00.457017+0000 mgr.a (mgr.14388) 12011 : cluster [DBG] pgmap v8326: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:03 smithi163 bash[24253]: cluster 2024-08-31T06:49:02.457848+0000 mgr.a (mgr.14388) 12012 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:49:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:03 smithi027 bash[22610]: cluster 2024-08-31T06:49:02.457848+0000 mgr.a (mgr.14388) 12012 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:49:03.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:49:03.985 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:49:03.985 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:49:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:03 smithi191 bash[24992]: cluster 2024-08-31T06:49:02.457848+0000 mgr.a (mgr.14388) 12012 : cluster [DBG] pgmap v8327: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:49:04.742 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:49:04.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:49:04.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:49:04.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:49:04.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:49:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:05 smithi163 bash[24253]: audit 2024-08-31T06:49:04.320931+0000 mgr.a (mgr.14388) 12013 : audit [DBG] from='client.263397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:05 smithi163 bash[24253]: cluster 2024-08-31T06:49:04.460537+0000 mgr.a (mgr.14388) 12014 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:05 smithi027 bash[22610]: audit 2024-08-31T06:49:04.320931+0000 mgr.a (mgr.14388) 12013 : audit [DBG] from='client.263397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:05.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:05 smithi027 bash[22610]: cluster 2024-08-31T06:49:04.460537+0000 mgr.a (mgr.14388) 12014 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:05 smithi191 bash[24992]: audit 2024-08-31T06:49:04.320931+0000 mgr.a (mgr.14388) 12013 : audit [DBG] from='client.263397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:05 smithi191 bash[24992]: cluster 2024-08-31T06:49:04.460537+0000 mgr.a (mgr.14388) 12014 : cluster [DBG] pgmap v8328: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:07 smithi163 bash[24253]: cluster 2024-08-31T06:49:06.461434+0000 mgr.a (mgr.14388) 12015 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:49:07.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:07 smithi027 bash[22610]: cluster 2024-08-31T06:49:06.461434+0000 mgr.a (mgr.14388) 12015 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:49:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:07 smithi191 bash[24992]: cluster 2024-08-31T06:49:06.461434+0000 mgr.a (mgr.14388) 12015 : cluster [DBG] pgmap v8329: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:49:09.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:49:09.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:49:09.745 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:49:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:09 smithi163 bash[24253]: cluster 2024-08-31T06:49:08.463732+0000 mgr.a (mgr.14388) 12016 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:49:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:09 smithi027 bash[22610]: cluster 2024-08-31T06:49:08.463732+0000 mgr.a (mgr.14388) 12016 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:49:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:09 smithi191 bash[24992]: cluster 2024-08-31T06:49:08.463732+0000 mgr.a (mgr.14388) 12016 : cluster [DBG] pgmap v8330: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:49:10.505 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:49:10.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:49:10.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:49:10.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:49:10.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:49:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:10 smithi163 bash[24253]: audit 2024-08-31T06:49:10.075081+0000 mgr.a (mgr.14388) 12017 : audit [DBG] from='client.263475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:10.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:10 smithi163 bash[24253]: cluster 2024-08-31T06:49:10.464593+0000 mgr.a (mgr.14388) 12018 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:10 smithi027 bash[22610]: audit 2024-08-31T06:49:10.075081+0000 mgr.a (mgr.14388) 12017 : audit [DBG] from='client.263475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:10 smithi027 bash[22610]: cluster 2024-08-31T06:49:10.464593+0000 mgr.a (mgr.14388) 12018 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:11.044 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:10 smithi191 bash[24992]: audit 2024-08-31T06:49:10.075081+0000 mgr.a (mgr.14388) 12017 : audit [DBG] from='client.263475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:11.045 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:10 smithi191 bash[24992]: cluster 2024-08-31T06:49:10.464593+0000 mgr.a (mgr.14388) 12018 : cluster [DBG] pgmap v8331: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:13 smithi191 bash[24992]: cluster 2024-08-31T06:49:12.465361+0000 mgr.a (mgr.14388) 12019 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:13 smithi163 bash[24253]: cluster 2024-08-31T06:49:12.465361+0000 mgr.a (mgr.14388) 12019 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:13 smithi027 bash[22610]: cluster 2024-08-31T06:49:12.465361+0000 mgr.a (mgr.14388) 12019 : cluster [DBG] pgmap v8332: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:49:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:49:15.508 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:49:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:15 smithi191 bash[24992]: cluster 2024-08-31T06:49:14.467586+0000 mgr.a (mgr.14388) 12020 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:15 smithi163 bash[24253]: cluster 2024-08-31T06:49:14.467586+0000 mgr.a (mgr.14388) 12020 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:15 smithi027 bash[22610]: cluster 2024-08-31T06:49:14.467586+0000 mgr.a (mgr.14388) 12020 : cluster [DBG] pgmap v8333: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:16.250 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:49:16.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:49:16.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:49:16.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:49:16.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:49:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:17 smithi191 bash[24992]: audit 2024-08-31T06:49:15.838046+0000 mgr.a (mgr.14388) 12021 : audit [DBG] from='client.263550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:17 smithi191 bash[24992]: cluster 2024-08-31T06:49:16.468536+0000 mgr.a (mgr.14388) 12022 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:17 smithi163 bash[24253]: audit 2024-08-31T06:49:15.838046+0000 mgr.a (mgr.14388) 12021 : audit [DBG] from='client.263550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:17 smithi163 bash[24253]: cluster 2024-08-31T06:49:16.468536+0000 mgr.a (mgr.14388) 12022 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:17 smithi027 bash[22610]: audit 2024-08-31T06:49:15.838046+0000 mgr.a (mgr.14388) 12021 : audit [DBG] from='client.263550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:17 smithi027 bash[22610]: cluster 2024-08-31T06:49:16.468536+0000 mgr.a (mgr.14388) 12022 : cluster [DBG] pgmap v8334: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:19 smithi191 bash[24992]: cluster 2024-08-31T06:49:18.470668+0000 mgr.a (mgr.14388) 12023 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:19 smithi163 bash[24253]: cluster 2024-08-31T06:49:18.470668+0000 mgr.a (mgr.14388) 12023 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:19 smithi027 bash[22610]: cluster 2024-08-31T06:49:18.470668+0000 mgr.a (mgr.14388) 12023 : cluster [DBG] pgmap v8335: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:21.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:49:21.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:49:21.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:49:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:21 smithi163 bash[24253]: cluster 2024-08-31T06:49:20.471460+0000 mgr.a (mgr.14388) 12024 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:21 smithi027 bash[22610]: cluster 2024-08-31T06:49:20.471460+0000 mgr.a (mgr.14388) 12024 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:21.997 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:49:21.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:49:21.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:49:21.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:49:21.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:49:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:21 smithi191 bash[24992]: cluster 2024-08-31T06:49:20.471460+0000 mgr.a (mgr.14388) 12024 : cluster [DBG] pgmap v8336: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:23 smithi163 bash[24253]: audit 2024-08-31T06:49:21.586410+0000 mgr.a (mgr.14388) 12025 : audit [DBG] from='client.263628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:23 smithi163 bash[24253]: cluster 2024-08-31T06:49:22.472432+0000 mgr.a (mgr.14388) 12026 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:23 smithi027 bash[22610]: audit 2024-08-31T06:49:21.586410+0000 mgr.a (mgr.14388) 12025 : audit [DBG] from='client.263628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:23 smithi027 bash[22610]: cluster 2024-08-31T06:49:22.472432+0000 mgr.a (mgr.14388) 12026 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:23 smithi191 bash[24992]: audit 2024-08-31T06:49:21.586410+0000 mgr.a (mgr.14388) 12025 : audit [DBG] from='client.263628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:23 smithi191 bash[24992]: cluster 2024-08-31T06:49:22.472432+0000 mgr.a (mgr.14388) 12026 : cluster [DBG] pgmap v8337: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:25 smithi163 bash[24253]: cluster 2024-08-31T06:49:24.474673+0000 mgr.a (mgr.14388) 12027 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:25 smithi027 bash[22610]: cluster 2024-08-31T06:49:24.474673+0000 mgr.a (mgr.14388) 12027 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:25 smithi191 bash[24992]: cluster 2024-08-31T06:49:24.474673+0000 mgr.a (mgr.14388) 12027 : cluster [DBG] pgmap v8338: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:26.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:49:26.999 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:49:26.999 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:49:27.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:49:27.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:49:27.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:49:27.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:49:27.767 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:49:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:27 smithi163 bash[24253]: cluster 2024-08-31T06:49:26.475485+0000 mgr.a (mgr.14388) 12028 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:27 smithi163 bash[24253]: audit 2024-08-31T06:49:27.534185+0000 mon.a (mon.0) 2377 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:49:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:27 smithi027 bash[22610]: cluster 2024-08-31T06:49:26.475485+0000 mgr.a (mgr.14388) 12028 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:27 smithi027 bash[22610]: audit 2024-08-31T06:49:27.534185+0000 mon.a (mon.0) 2377 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:49:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:27 smithi191 bash[24992]: cluster 2024-08-31T06:49:26.475485+0000 mgr.a (mgr.14388) 12028 : cluster [DBG] pgmap v8339: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:27 smithi191 bash[24992]: audit 2024-08-31T06:49:27.534185+0000 mon.a (mon.0) 2377 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:49:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:28 smithi163 bash[24253]: audit 2024-08-31T06:49:27.332167+0000 mgr.a (mgr.14388) 12029 : audit [DBG] from='client.263703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:28 smithi163 bash[24253]: audit 2024-08-31T06:49:28.099169+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:49:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:28 smithi163 bash[24253]: audit 2024-08-31T06:49:28.104585+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:49:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:28 smithi027 bash[22610]: audit 2024-08-31T06:49:27.332167+0000 mgr.a (mgr.14388) 12029 : audit [DBG] from='client.263703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:28.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:28 smithi027 bash[22610]: audit 2024-08-31T06:49:28.099169+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:49:28.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:28 smithi027 bash[22610]: audit 2024-08-31T06:49:28.104585+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:49:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:28 smithi191 bash[24992]: audit 2024-08-31T06:49:27.332167+0000 mgr.a (mgr.14388) 12029 : audit [DBG] from='client.263703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:28 smithi191 bash[24992]: audit 2024-08-31T06:49:28.099169+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:49:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:28 smithi191 bash[24992]: audit 2024-08-31T06:49:28.104585+0000 mon.a (mon.0) 2379 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:49:29.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:49:29 smithi027 bash[22863]: debug 2024-08-31T06:49:29.450+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:49:29.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:49:29 smithi027 bash[22863]: debug 2024-08-31T06:49:29.450+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:49:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:29 smithi027 bash[22610]: cluster 2024-08-31T06:49:28.477667+0000 mgr.a (mgr.14388) 12030 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:29 smithi027 bash[22610]: audit 2024-08-31T06:49:28.722945+0000 mon.a (mon.0) 2380 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:49:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:29 smithi027 bash[22610]: audit 2024-08-31T06:49:28.724156+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:49:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:29 smithi027 bash[22610]: audit 2024-08-31T06:49:28.730965+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:49:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:29 smithi027 bash[22610]: audit 2024-08-31T06:49:28.733805+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:49:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:29 smithi163 bash[24253]: cluster 2024-08-31T06:49:28.477667+0000 mgr.a (mgr.14388) 12030 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:29 smithi163 bash[24253]: audit 2024-08-31T06:49:28.722945+0000 mon.a (mon.0) 2380 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:49:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:29 smithi163 bash[24253]: audit 2024-08-31T06:49:28.724156+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:49:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:29 smithi163 bash[24253]: audit 2024-08-31T06:49:28.730965+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:49:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:29 smithi163 bash[24253]: audit 2024-08-31T06:49:28.733805+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:49:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:29 smithi191 bash[24992]: cluster 2024-08-31T06:49:28.477667+0000 mgr.a (mgr.14388) 12030 : cluster [DBG] pgmap v8340: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:29 smithi191 bash[24992]: audit 2024-08-31T06:49:28.722945+0000 mon.a (mon.0) 2380 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:49:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:29 smithi191 bash[24992]: audit 2024-08-31T06:49:28.724156+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:49:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:29 smithi191 bash[24992]: audit 2024-08-31T06:49:28.730965+0000 mon.a (mon.0) 2382 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:49:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:29 smithi191 bash[24992]: audit 2024-08-31T06:49:28.733805+0000 mon.a (mon.0) 2383 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:49:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:30 smithi163 bash[24253]: audit 2024-08-31T06:49:28.736391+0000 mgr.a (mgr.14388) 12031 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:49:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:30 smithi163 bash[24253]: audit 2024-08-31T06:49:29.451274+0000 mgr.a (mgr.14388) 12032 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:49:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:30 smithi163 bash[24253]: cephadm 2024-08-31T06:49:29.452380+0000 mgr.a (mgr.14388) 12033 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:49:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:30 smithi027 bash[22610]: audit 2024-08-31T06:49:28.736391+0000 mgr.a (mgr.14388) 12031 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:49:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:30 smithi027 bash[22610]: audit 2024-08-31T06:49:29.451274+0000 mgr.a (mgr.14388) 12032 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:49:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:30 smithi027 bash[22610]: cephadm 2024-08-31T06:49:29.452380+0000 mgr.a (mgr.14388) 12033 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:49:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:30 smithi191 bash[24992]: audit 2024-08-31T06:49:28.736391+0000 mgr.a (mgr.14388) 12031 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:49:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:30 smithi191 bash[24992]: audit 2024-08-31T06:49:29.451274+0000 mgr.a (mgr.14388) 12032 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:49:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:30 smithi191 bash[24992]: cephadm 2024-08-31T06:49:29.452380+0000 mgr.a (mgr.14388) 12033 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:49:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:31 smithi163 bash[24253]: cluster 2024-08-31T06:49:30.478632+0000 mgr.a (mgr.14388) 12034 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:31 smithi027 bash[22610]: cluster 2024-08-31T06:49:30.478632+0000 mgr.a (mgr.14388) 12034 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:31 smithi191 bash[24992]: cluster 2024-08-31T06:49:30.478632+0000 mgr.a (mgr.14388) 12034 : cluster [DBG] pgmap v8341: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:32.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:49:32.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:49:32.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:49:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:32 smithi163 bash[24253]: cluster 2024-08-31T06:49:32.479463+0000 mgr.a (mgr.14388) 12035 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:32 smithi027 bash[22610]: cluster 2024-08-31T06:49:32.479463+0000 mgr.a (mgr.14388) 12035 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:32 smithi191 bash[24992]: cluster 2024-08-31T06:49:32.479463+0000 mgr.a (mgr.14388) 12035 : cluster [DBG] pgmap v8342: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:33.545 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:49:33.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:49:33.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:49:33.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:49:33.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:49:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:33 smithi163 bash[24253]: audit 2024-08-31T06:49:33.103249+0000 mgr.a (mgr.14388) 12036 : audit [DBG] from='client.263886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:33 smithi027 bash[22610]: audit 2024-08-31T06:49:33.103249+0000 mgr.a (mgr.14388) 12036 : audit [DBG] from='client.263886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:33 smithi191 bash[24992]: audit 2024-08-31T06:49:33.103249+0000 mgr.a (mgr.14388) 12036 : audit [DBG] from='client.263886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:34 smithi163 bash[24253]: cluster 2024-08-31T06:49:34.482271+0000 mgr.a (mgr.14388) 12037 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:49:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:34 smithi027 bash[22610]: cluster 2024-08-31T06:49:34.482271+0000 mgr.a (mgr.14388) 12037 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:49:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:34 smithi191 bash[24992]: cluster 2024-08-31T06:49:34.482271+0000 mgr.a (mgr.14388) 12037 : cluster [DBG] pgmap v8343: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:49:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:37 smithi163 bash[24253]: cluster 2024-08-31T06:49:36.483075+0000 mgr.a (mgr.14388) 12038 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:49:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:37 smithi027 bash[22610]: cluster 2024-08-31T06:49:36.483075+0000 mgr.a (mgr.14388) 12038 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:49:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:37 smithi191 bash[24992]: cluster 2024-08-31T06:49:36.483075+0000 mgr.a (mgr.14388) 12038 : cluster [DBG] pgmap v8344: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:49:38.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:49:38.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:49:38.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:49:39.294 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:49:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:49:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:49:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:49:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:49:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:39 smithi163 bash[24253]: cluster 2024-08-31T06:49:38.484990+0000 mgr.a (mgr.14388) 12039 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:49:39.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:39 smithi027 bash[22610]: cluster 2024-08-31T06:49:38.484990+0000 mgr.a (mgr.14388) 12039 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:49:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:39 smithi191 bash[24992]: cluster 2024-08-31T06:49:38.484990+0000 mgr.a (mgr.14388) 12039 : cluster [DBG] pgmap v8345: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:49:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:40 smithi163 bash[24253]: audit 2024-08-31T06:49:38.873626+0000 mgr.a (mgr.14388) 12040 : audit [DBG] from='client.263964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:40 smithi027 bash[22610]: audit 2024-08-31T06:49:38.873626+0000 mgr.a (mgr.14388) 12040 : audit [DBG] from='client.263964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:40 smithi191 bash[24992]: audit 2024-08-31T06:49:38.873626+0000 mgr.a (mgr.14388) 12040 : audit [DBG] from='client.263964 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:41 smithi163 bash[24253]: cluster 2024-08-31T06:49:40.485973+0000 mgr.a (mgr.14388) 12041 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:49:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:41 smithi027 bash[22610]: cluster 2024-08-31T06:49:40.485973+0000 mgr.a (mgr.14388) 12041 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:49:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:41 smithi191 bash[24992]: cluster 2024-08-31T06:49:40.485973+0000 mgr.a (mgr.14388) 12041 : cluster [DBG] pgmap v8346: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:49:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:43 smithi163 bash[24253]: cluster 2024-08-31T06:49:42.486953+0000 mgr.a (mgr.14388) 12042 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:49:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:43 smithi027 bash[22610]: cluster 2024-08-31T06:49:42.486953+0000 mgr.a (mgr.14388) 12042 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:49:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:43 smithi191 bash[24992]: cluster 2024-08-31T06:49:42.486953+0000 mgr.a (mgr.14388) 12042 : cluster [DBG] pgmap v8347: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:49:44.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:49:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:49:44.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:49:45.081 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:49:45.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:49:45.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:49:45.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:49:45.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:49:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:45 smithi163 bash[24253]: cluster 2024-08-31T06:49:44.489072+0000 mgr.a (mgr.14388) 12043 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:49:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:45 smithi027 bash[22610]: cluster 2024-08-31T06:49:44.489072+0000 mgr.a (mgr.14388) 12043 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:49:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:45 smithi191 bash[24992]: cluster 2024-08-31T06:49:44.489072+0000 mgr.a (mgr.14388) 12043 : cluster [DBG] pgmap v8348: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:49:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:46 smithi163 bash[24253]: audit 2024-08-31T06:49:44.634568+0000 mgr.a (mgr.14388) 12044 : audit [DBG] from='client.264039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:46 smithi027 bash[22610]: audit 2024-08-31T06:49:44.634568+0000 mgr.a (mgr.14388) 12044 : audit [DBG] from='client.264039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:46 smithi191 bash[24992]: audit 2024-08-31T06:49:44.634568+0000 mgr.a (mgr.14388) 12044 : audit [DBG] from='client.264039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:47 smithi163 bash[24253]: cluster 2024-08-31T06:49:46.490000+0000 mgr.a (mgr.14388) 12045 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:47 smithi027 bash[22610]: cluster 2024-08-31T06:49:46.490000+0000 mgr.a (mgr.14388) 12045 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:47 smithi191 bash[24992]: cluster 2024-08-31T06:49:46.490000+0000 mgr.a (mgr.14388) 12045 : cluster [DBG] pgmap v8349: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:48 smithi163 bash[24253]: cluster 2024-08-31T06:49:48.492183+0000 mgr.a (mgr.14388) 12046 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:48 smithi027 bash[22610]: cluster 2024-08-31T06:49:48.492183+0000 mgr.a (mgr.14388) 12046 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:48 smithi191 bash[24992]: cluster 2024-08-31T06:49:48.492183+0000 mgr.a (mgr.14388) 12046 : cluster [DBG] pgmap v8350: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:49:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:49:50.083 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:49:50.841 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:49:50.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:49:50.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:49:50.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:49:50.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:49:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:51 smithi163 bash[24253]: audit 2024-08-31T06:49:50.416213+0000 mgr.a (mgr.14388) 12047 : audit [DBG] from='client.264117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:51 smithi163 bash[24253]: cluster 2024-08-31T06:49:50.492740+0000 mgr.a (mgr.14388) 12048 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:51 smithi027 bash[22610]: audit 2024-08-31T06:49:50.416213+0000 mgr.a (mgr.14388) 12047 : audit [DBG] from='client.264117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:51 smithi027 bash[22610]: cluster 2024-08-31T06:49:50.492740+0000 mgr.a (mgr.14388) 12048 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:51 smithi191 bash[24992]: audit 2024-08-31T06:49:50.416213+0000 mgr.a (mgr.14388) 12047 : audit [DBG] from='client.264117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:51 smithi191 bash[24992]: cluster 2024-08-31T06:49:50.492740+0000 mgr.a (mgr.14388) 12048 : cluster [DBG] pgmap v8351: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:53 smithi163 bash[24253]: cluster 2024-08-31T06:49:52.493635+0000 mgr.a (mgr.14388) 12049 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:53 smithi027 bash[22610]: cluster 2024-08-31T06:49:52.493635+0000 mgr.a (mgr.14388) 12049 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:53 smithi191 bash[24992]: cluster 2024-08-31T06:49:52.493635+0000 mgr.a (mgr.14388) 12049 : cluster [DBG] pgmap v8352: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:55.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:49:55.843 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:49:55.843 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:49:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:55 smithi163 bash[24253]: cluster 2024-08-31T06:49:54.496008+0000 mgr.a (mgr.14388) 12050 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:55 smithi027 bash[22610]: cluster 2024-08-31T06:49:54.496008+0000 mgr.a (mgr.14388) 12050 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:55 smithi191 bash[24992]: cluster 2024-08-31T06:49:54.496008+0000 mgr.a (mgr.14388) 12050 : cluster [DBG] pgmap v8353: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:56.615 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:49:56.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:49:56.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:49:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:49:56.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:49:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:57 smithi163 bash[24253]: audit 2024-08-31T06:49:56.181172+0000 mgr.a (mgr.14388) 12051 : audit [DBG] from='client.264195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:57 smithi163 bash[24253]: cluster 2024-08-31T06:49:56.496583+0000 mgr.a (mgr.14388) 12052 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:57 smithi027 bash[22610]: audit 2024-08-31T06:49:56.181172+0000 mgr.a (mgr.14388) 12051 : audit [DBG] from='client.264195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:57 smithi027 bash[22610]: cluster 2024-08-31T06:49:56.496583+0000 mgr.a (mgr.14388) 12052 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:57 smithi191 bash[24992]: audit 2024-08-31T06:49:56.181172+0000 mgr.a (mgr.14388) 12051 : audit [DBG] from='client.264195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:49:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:57 smithi191 bash[24992]: cluster 2024-08-31T06:49:56.496583+0000 mgr.a (mgr.14388) 12052 : cluster [DBG] pgmap v8354: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:49:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:49:58 smithi163 bash[24253]: cluster 2024-08-31T06:49:58.498916+0000 mgr.a (mgr.14388) 12053 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:49:58 smithi027 bash[22610]: cluster 2024-08-31T06:49:58.498916+0000 mgr.a (mgr.14388) 12053 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:49:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:49:58 smithi191 bash[24992]: cluster 2024-08-31T06:49:58.498916+0000 mgr.a (mgr.14388) 12053 : cluster [DBG] pgmap v8355: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:50:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:00 smithi163 bash[24253]: cluster 2024-08-31T06:50:00.000147+0000 mon.a (mon.0) 2384 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:50:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:00 smithi027 bash[22610]: cluster 2024-08-31T06:50:00.000147+0000 mon.a (mon.0) 2384 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:50:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:00 smithi191 bash[24992]: cluster 2024-08-31T06:50:00.000147+0000 mon.a (mon.0) 2384 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T06:50:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:01 smithi163 bash[24253]: cluster 2024-08-31T06:50:00.499807+0000 mgr.a (mgr.14388) 12054 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:01 smithi027 bash[22610]: cluster 2024-08-31T06:50:00.499807+0000 mgr.a (mgr.14388) 12054 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:01 smithi191 bash[24992]: cluster 2024-08-31T06:50:00.499807+0000 mgr.a (mgr.14388) 12054 : cluster [DBG] pgmap v8356: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:01.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:50:01.617 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:50:01.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:50:02.402 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:50:02.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:50:02.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:50:02.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:50:02.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:50:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:03 smithi163 bash[24253]: audit 2024-08-31T06:50:01.954235+0000 mgr.a (mgr.14388) 12055 : audit [DBG] from='client.264273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:03 smithi163 bash[24253]: cluster 2024-08-31T06:50:02.500429+0000 mgr.a (mgr.14388) 12056 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:03 smithi027 bash[22610]: audit 2024-08-31T06:50:01.954235+0000 mgr.a (mgr.14388) 12055 : audit [DBG] from='client.264273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:03 smithi027 bash[22610]: cluster 2024-08-31T06:50:02.500429+0000 mgr.a (mgr.14388) 12056 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:03 smithi191 bash[24992]: audit 2024-08-31T06:50:01.954235+0000 mgr.a (mgr.14388) 12055 : audit [DBG] from='client.264273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:03 smithi191 bash[24992]: cluster 2024-08-31T06:50:02.500429+0000 mgr.a (mgr.14388) 12056 : cluster [DBG] pgmap v8357: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:05 smithi163 bash[24253]: cluster 2024-08-31T06:50:04.502622+0000 mgr.a (mgr.14388) 12057 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:50:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:05 smithi027 bash[22610]: cluster 2024-08-31T06:50:04.502622+0000 mgr.a (mgr.14388) 12057 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:50:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:05 smithi191 bash[24992]: cluster 2024-08-31T06:50:04.502622+0000 mgr.a (mgr.14388) 12057 : cluster [DBG] pgmap v8358: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:50:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:50:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:50:07.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:50:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:07 smithi163 bash[24253]: cluster 2024-08-31T06:50:06.503369+0000 mgr.a (mgr.14388) 12058 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:07 smithi027 bash[22610]: cluster 2024-08-31T06:50:06.503369+0000 mgr.a (mgr.14388) 12058 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:07 smithi191 bash[24992]: cluster 2024-08-31T06:50:06.503369+0000 mgr.a (mgr.14388) 12058 : cluster [DBG] pgmap v8359: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:08.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:50:08.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:50:08.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:50:08.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:50:08.186 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:50:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:09 smithi163 bash[24253]: audit 2024-08-31T06:50:07.746110+0000 mgr.a (mgr.14388) 12059 : audit [DBG] from='client.264351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:09 smithi163 bash[24253]: cluster 2024-08-31T06:50:08.505729+0000 mgr.a (mgr.14388) 12060 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T06:50:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:09 smithi027 bash[22610]: audit 2024-08-31T06:50:07.746110+0000 mgr.a (mgr.14388) 12059 : audit [DBG] from='client.264351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:09 smithi027 bash[22610]: cluster 2024-08-31T06:50:08.505729+0000 mgr.a (mgr.14388) 12060 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T06:50:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:09 smithi191 bash[24992]: audit 2024-08-31T06:50:07.746110+0000 mgr.a (mgr.14388) 12059 : audit [DBG] from='client.264351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:09 smithi191 bash[24992]: cluster 2024-08-31T06:50:08.505729+0000 mgr.a (mgr.14388) 12060 : cluster [DBG] pgmap v8360: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T06:50:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:11 smithi163 bash[24253]: cluster 2024-08-31T06:50:10.506521+0000 mgr.a (mgr.14388) 12061 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:50:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:11 smithi027 bash[22610]: cluster 2024-08-31T06:50:10.506521+0000 mgr.a (mgr.14388) 12061 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:50:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:11 smithi191 bash[24992]: cluster 2024-08-31T06:50:10.506521+0000 mgr.a (mgr.14388) 12061 : cluster [DBG] pgmap v8361: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:50:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:12 smithi163 bash[24253]: cluster 2024-08-31T06:50:12.507311+0000 mgr.a (mgr.14388) 12062 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:50:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:12 smithi027 bash[22610]: cluster 2024-08-31T06:50:12.507311+0000 mgr.a (mgr.14388) 12062 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:50:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:12 smithi191 bash[24992]: cluster 2024-08-31T06:50:12.507311+0000 mgr.a (mgr.14388) 12062 : cluster [DBG] pgmap v8362: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T06:50:13.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:50:13.188 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:50:13.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:50:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:13 smithi163 bash[24253]: audit 2024-08-31T06:50:13.523321+0000 mgr.a (mgr.14388) 12063 : audit [DBG] from='client.264429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:13.953 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:50:13.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:50:13.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:50:13.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:50:13.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:50:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:13 smithi027 bash[22610]: audit 2024-08-31T06:50:13.523321+0000 mgr.a (mgr.14388) 12063 : audit [DBG] from='client.264429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:13 smithi191 bash[24992]: audit 2024-08-31T06:50:13.523321+0000 mgr.a (mgr.14388) 12063 : audit [DBG] from='client.264429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:14 smithi163 bash[24253]: cluster 2024-08-31T06:50:14.510273+0000 mgr.a (mgr.14388) 12064 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:14 smithi027 bash[22610]: cluster 2024-08-31T06:50:14.510273+0000 mgr.a (mgr.14388) 12064 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:14 smithi191 bash[24992]: cluster 2024-08-31T06:50:14.510273+0000 mgr.a (mgr.14388) 12064 : cluster [DBG] pgmap v8363: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:17 smithi163 bash[24253]: cluster 2024-08-31T06:50:16.511268+0000 mgr.a (mgr.14388) 12065 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:50:17.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:17 smithi027 bash[22610]: cluster 2024-08-31T06:50:16.511268+0000 mgr.a (mgr.14388) 12065 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:50:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:17 smithi191 bash[24992]: cluster 2024-08-31T06:50:16.511268+0000 mgr.a (mgr.14388) 12065 : cluster [DBG] pgmap v8364: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:50:18.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:50:18.955 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:50:18.955 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:50:19.726 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:50:19.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:50:19.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:50:19.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:50:19.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:50:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:19 smithi163 bash[24253]: cluster 2024-08-31T06:50:18.513350+0000 mgr.a (mgr.14388) 12066 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:19 smithi027 bash[22610]: cluster 2024-08-31T06:50:18.513350+0000 mgr.a (mgr.14388) 12066 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:19 smithi191 bash[24992]: cluster 2024-08-31T06:50:18.513350+0000 mgr.a (mgr.14388) 12066 : cluster [DBG] pgmap v8365: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:20 smithi163 bash[24253]: audit 2024-08-31T06:50:19.294046+0000 mgr.a (mgr.14388) 12067 : audit [DBG] from='client.264507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:20 smithi027 bash[22610]: audit 2024-08-31T06:50:19.294046+0000 mgr.a (mgr.14388) 12067 : audit [DBG] from='client.264507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:20 smithi191 bash[24992]: audit 2024-08-31T06:50:19.294046+0000 mgr.a (mgr.14388) 12067 : audit [DBG] from='client.264507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:21 smithi163 bash[24253]: cluster 2024-08-31T06:50:20.514354+0000 mgr.a (mgr.14388) 12068 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:50:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:21 smithi027 bash[22610]: cluster 2024-08-31T06:50:20.514354+0000 mgr.a (mgr.14388) 12068 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:50:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:21 smithi191 bash[24992]: cluster 2024-08-31T06:50:20.514354+0000 mgr.a (mgr.14388) 12068 : cluster [DBG] pgmap v8366: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:50:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:22 smithi163 bash[24253]: cluster 2024-08-31T06:50:22.515296+0000 mgr.a (mgr.14388) 12069 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:50:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:22 smithi027 bash[22610]: cluster 2024-08-31T06:50:22.515296+0000 mgr.a (mgr.14388) 12069 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:50:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:22 smithi191 bash[24992]: cluster 2024-08-31T06:50:22.515296+0000 mgr.a (mgr.14388) 12069 : cluster [DBG] pgmap v8367: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:50:25.479 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:50:25.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:50:25.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:50:25.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:50:25.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:50:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:25 smithi163 bash[24253]: cluster 2024-08-31T06:50:24.517644+0000 mgr.a (mgr.14388) 12070 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:50:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:25 smithi027 bash[22610]: cluster 2024-08-31T06:50:24.517644+0000 mgr.a (mgr.14388) 12070 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:50:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:25 smithi191 bash[24992]: cluster 2024-08-31T06:50:24.517644+0000 mgr.a (mgr.14388) 12070 : cluster [DBG] pgmap v8368: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T06:50:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:26 smithi163 bash[24253]: audit 2024-08-31T06:50:25.052794+0000 mgr.a (mgr.14388) 12071 : audit [DBG] from='client.264582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:26 smithi027 bash[22610]: audit 2024-08-31T06:50:25.052794+0000 mgr.a (mgr.14388) 12071 : audit [DBG] from='client.264582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:26 smithi191 bash[24992]: audit 2024-08-31T06:50:25.052794+0000 mgr.a (mgr.14388) 12071 : audit [DBG] from='client.264582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:27 smithi163 bash[24253]: cluster 2024-08-31T06:50:26.518560+0000 mgr.a (mgr.14388) 12072 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:27 smithi027 bash[22610]: cluster 2024-08-31T06:50:26.518560+0000 mgr.a (mgr.14388) 12072 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:27 smithi191 bash[24992]: cluster 2024-08-31T06:50:26.518560+0000 mgr.a (mgr.14388) 12072 : cluster [DBG] pgmap v8369: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:28 smithi163 bash[24253]: cluster 2024-08-31T06:50:28.520683+0000 mgr.a (mgr.14388) 12073 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:50:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:28 smithi027 bash[22610]: cluster 2024-08-31T06:50:28.520683+0000 mgr.a (mgr.14388) 12073 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:50:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:28 smithi191 bash[24992]: cluster 2024-08-31T06:50:28.520683+0000 mgr.a (mgr.14388) 12073 : cluster [DBG] pgmap v8370: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:50:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:29 smithi163 bash[24253]: audit 2024-08-31T06:50:29.504235+0000 mon.a (mon.0) 2385 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:50:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:29 smithi027 bash[22610]: audit 2024-08-31T06:50:29.504235+0000 mon.a (mon.0) 2385 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:50:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:29 smithi191 bash[24992]: audit 2024-08-31T06:50:29.504235+0000 mon.a (mon.0) 2385 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:50:30.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:50:30.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:50:30.482 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:50:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:31 smithi163 bash[24253]: audit 2024-08-31T06:50:30.116092+0000 mon.a (mon.0) 2386 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:31 smithi163 bash[24253]: audit 2024-08-31T06:50:30.119203+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:31 smithi163 bash[24253]: audit 2024-08-31T06:50:30.124517+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:31 smithi163 bash[24253]: audit 2024-08-31T06:50:30.129790+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:31 smithi163 bash[24253]: cluster 2024-08-31T06:50:30.521285+0000 mgr.a (mgr.14388) 12074 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:31 smithi163 bash[24253]: audit 2024-08-31T06:50:30.880094+0000 mon.a (mon.0) 2390 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:50:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:31 smithi163 bash[24253]: audit 2024-08-31T06:50:30.881723+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:50:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:31 smithi163 bash[24253]: audit 2024-08-31T06:50:30.891629+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:31 smithi163 bash[24253]: audit 2024-08-31T06:50:30.896403+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:50:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22610]: audit 2024-08-31T06:50:30.116092+0000 mon.a (mon.0) 2386 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22610]: audit 2024-08-31T06:50:30.119203+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22610]: audit 2024-08-31T06:50:30.124517+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22610]: audit 2024-08-31T06:50:30.129790+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22610]: cluster 2024-08-31T06:50:30.521285+0000 mgr.a (mgr.14388) 12074 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22610]: audit 2024-08-31T06:50:30.880094+0000 mon.a (mon.0) 2390 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:50:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22610]: audit 2024-08-31T06:50:30.881723+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:50:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22610]: audit 2024-08-31T06:50:30.891629+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22610]: audit 2024-08-31T06:50:30.896403+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:50:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:31 smithi191 bash[24992]: audit 2024-08-31T06:50:30.116092+0000 mon.a (mon.0) 2386 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:31 smithi191 bash[24992]: audit 2024-08-31T06:50:30.119203+0000 mon.a (mon.0) 2387 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:31 smithi191 bash[24992]: audit 2024-08-31T06:50:30.124517+0000 mon.a (mon.0) 2388 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:31 smithi191 bash[24992]: audit 2024-08-31T06:50:30.129790+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:31 smithi191 bash[24992]: cluster 2024-08-31T06:50:30.521285+0000 mgr.a (mgr.14388) 12074 : cluster [DBG] pgmap v8371: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:31 smithi191 bash[24992]: audit 2024-08-31T06:50:30.880094+0000 mon.a (mon.0) 2390 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:50:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:31 smithi191 bash[24992]: audit 2024-08-31T06:50:30.881723+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:50:31.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:31 smithi191 bash[24992]: audit 2024-08-31T06:50:30.891629+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:50:31.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:31 smithi191 bash[24992]: audit 2024-08-31T06:50:30.896403+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:50:31.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22863]: debug 2024-08-31T06:50:31.612+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:50:31.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:50:31 smithi027 bash[22863]: debug 2024-08-31T06:50:31.624+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:50:32.018 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:50:32.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:50:32.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:50:32.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:50:32.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:50:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:32 smithi163 bash[24253]: audit 2024-08-31T06:50:30.898612+0000 mgr.a (mgr.14388) 12075 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:50:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:32 smithi163 bash[24253]: audit 2024-08-31T06:50:30.944667+0000 mgr.a (mgr.14388) 12076 : audit [DBG] from='client.264660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:32 smithi027 bash[22610]: audit 2024-08-31T06:50:30.898612+0000 mgr.a (mgr.14388) 12075 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:50:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:32 smithi027 bash[22610]: audit 2024-08-31T06:50:30.944667+0000 mgr.a (mgr.14388) 12076 : audit [DBG] from='client.264660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:32 smithi191 bash[24992]: audit 2024-08-31T06:50:30.898612+0000 mgr.a (mgr.14388) 12075 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:50:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:32 smithi191 bash[24992]: audit 2024-08-31T06:50:30.944667+0000 mgr.a (mgr.14388) 12076 : audit [DBG] from='client.264660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:33 smithi163 bash[24253]: audit 2024-08-31T06:50:31.615078+0000 mgr.a (mgr.14388) 12077 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:50:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:33 smithi163 bash[24253]: cephadm 2024-08-31T06:50:31.626865+0000 mgr.a (mgr.14388) 12078 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:50:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:33 smithi163 bash[24253]: cluster 2024-08-31T06:50:32.522220+0000 mgr.a (mgr.14388) 12079 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:33 smithi027 bash[22610]: audit 2024-08-31T06:50:31.615078+0000 mgr.a (mgr.14388) 12077 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:50:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:33 smithi027 bash[22610]: cephadm 2024-08-31T06:50:31.626865+0000 mgr.a (mgr.14388) 12078 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:50:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:33 smithi027 bash[22610]: cluster 2024-08-31T06:50:32.522220+0000 mgr.a (mgr.14388) 12079 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:33 smithi191 bash[24992]: audit 2024-08-31T06:50:31.615078+0000 mgr.a (mgr.14388) 12077 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:50:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:33 smithi191 bash[24992]: cephadm 2024-08-31T06:50:31.626865+0000 mgr.a (mgr.14388) 12078 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:50:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:33 smithi191 bash[24992]: cluster 2024-08-31T06:50:32.522220+0000 mgr.a (mgr.14388) 12079 : cluster [DBG] pgmap v8372: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:34 smithi163 bash[24253]: cluster 2024-08-31T06:50:34.524445+0000 mgr.a (mgr.14388) 12080 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:34 smithi027 bash[22610]: cluster 2024-08-31T06:50:34.524445+0000 mgr.a (mgr.14388) 12080 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:34 smithi191 bash[24992]: cluster 2024-08-31T06:50:34.524445+0000 mgr.a (mgr.14388) 12080 : cluster [DBG] pgmap v8373: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:36 smithi163 bash[24253]: cluster 2024-08-31T06:50:36.525194+0000 mgr.a (mgr.14388) 12081 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:36 smithi027 bash[22610]: cluster 2024-08-31T06:50:36.525194+0000 mgr.a (mgr.14388) 12081 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:37.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:50:37.021 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:50:37.021 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:50:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:36 smithi191 bash[24992]: cluster 2024-08-31T06:50:36.525194+0000 mgr.a (mgr.14388) 12081 : cluster [DBG] pgmap v8374: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:37.800 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:50:37.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:50:37.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:50:37.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:50:37.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:50:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:37 smithi163 bash[24253]: audit 2024-08-31T06:50:37.354490+0000 mgr.a (mgr.14388) 12082 : audit [DBG] from='client.264837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:37 smithi027 bash[22610]: audit 2024-08-31T06:50:37.354490+0000 mgr.a (mgr.14388) 12082 : audit [DBG] from='client.264837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:37 smithi191 bash[24992]: audit 2024-08-31T06:50:37.354490+0000 mgr.a (mgr.14388) 12082 : audit [DBG] from='client.264837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:38 smithi163 bash[24253]: cluster 2024-08-31T06:50:38.527469+0000 mgr.a (mgr.14388) 12083 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:38 smithi027 bash[22610]: cluster 2024-08-31T06:50:38.527469+0000 mgr.a (mgr.14388) 12083 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:38 smithi191 bash[24992]: cluster 2024-08-31T06:50:38.527469+0000 mgr.a (mgr.14388) 12083 : cluster [DBG] pgmap v8375: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:40 smithi163 bash[24253]: cluster 2024-08-31T06:50:40.528269+0000 mgr.a (mgr.14388) 12084 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:40 smithi027 bash[22610]: cluster 2024-08-31T06:50:40.528269+0000 mgr.a (mgr.14388) 12084 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:40 smithi191 bash[24992]: cluster 2024-08-31T06:50:40.528269+0000 mgr.a (mgr.14388) 12084 : cluster [DBG] pgmap v8376: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:42.801 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:50:42.802 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:50:42.802 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:50:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:42 smithi163 bash[24253]: cluster 2024-08-31T06:50:42.529010+0000 mgr.a (mgr.14388) 12085 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:42 smithi027 bash[22610]: cluster 2024-08-31T06:50:42.529010+0000 mgr.a (mgr.14388) 12085 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:42 smithi191 bash[24992]: cluster 2024-08-31T06:50:42.529010+0000 mgr.a (mgr.14388) 12085 : cluster [DBG] pgmap v8377: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:43.545 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:50:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:50:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:50:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:50:43.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:50:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:43 smithi163 bash[24253]: audit 2024-08-31T06:50:43.135155+0000 mgr.a (mgr.14388) 12086 : audit [DBG] from='client.264915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:43 smithi027 bash[22610]: audit 2024-08-31T06:50:43.135155+0000 mgr.a (mgr.14388) 12086 : audit [DBG] from='client.264915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:44.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:43 smithi191 bash[24992]: audit 2024-08-31T06:50:43.135155+0000 mgr.a (mgr.14388) 12086 : audit [DBG] from='client.264915 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:44 smithi163 bash[24253]: cluster 2024-08-31T06:50:44.531755+0000 mgr.a (mgr.14388) 12087 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:44 smithi027 bash[22610]: cluster 2024-08-31T06:50:44.531755+0000 mgr.a (mgr.14388) 12087 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:44 smithi191 bash[24992]: cluster 2024-08-31T06:50:44.531755+0000 mgr.a (mgr.14388) 12087 : cluster [DBG] pgmap v8378: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:50:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:46 smithi163 bash[24253]: cluster 2024-08-31T06:50:46.532536+0000 mgr.a (mgr.14388) 12088 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:50:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:46 smithi027 bash[22610]: cluster 2024-08-31T06:50:46.532536+0000 mgr.a (mgr.14388) 12088 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:50:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:46 smithi191 bash[24992]: cluster 2024-08-31T06:50:46.532536+0000 mgr.a (mgr.14388) 12088 : cluster [DBG] pgmap v8379: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:50:48.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:50:48.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:50:48.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:50:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:48 smithi163 bash[24253]: cluster 2024-08-31T06:50:48.534428+0000 mgr.a (mgr.14388) 12089 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:48 smithi027 bash[22610]: cluster 2024-08-31T06:50:48.534428+0000 mgr.a (mgr.14388) 12089 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:48 smithi191 bash[24992]: cluster 2024-08-31T06:50:48.534428+0000 mgr.a (mgr.14388) 12089 : cluster [DBG] pgmap v8380: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:49.296 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:50:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:50:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:50:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:50:49.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:50:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:49 smithi163 bash[24253]: audit 2024-08-31T06:50:48.880361+0000 mgr.a (mgr.14388) 12090 : audit [DBG] from='client.264990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:49 smithi027 bash[22610]: audit 2024-08-31T06:50:48.880361+0000 mgr.a (mgr.14388) 12090 : audit [DBG] from='client.264990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:49 smithi191 bash[24992]: audit 2024-08-31T06:50:48.880361+0000 mgr.a (mgr.14388) 12090 : audit [DBG] from='client.264990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:50 smithi163 bash[24253]: cluster 2024-08-31T06:50:50.535354+0000 mgr.a (mgr.14388) 12091 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:50:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:50 smithi027 bash[22610]: cluster 2024-08-31T06:50:50.535354+0000 mgr.a (mgr.14388) 12091 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:50:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:50 smithi191 bash[24992]: cluster 2024-08-31T06:50:50.535354+0000 mgr.a (mgr.14388) 12091 : cluster [DBG] pgmap v8381: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:50:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:52 smithi163 bash[24253]: cluster 2024-08-31T06:50:52.536127+0000 mgr.a (mgr.14388) 12092 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:50:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:52 smithi027 bash[22610]: cluster 2024-08-31T06:50:52.536127+0000 mgr.a (mgr.14388) 12092 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:50:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:52 smithi191 bash[24992]: cluster 2024-08-31T06:50:52.536127+0000 mgr.a (mgr.14388) 12092 : cluster [DBG] pgmap v8382: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:50:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:50:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:50:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:50:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:54 smithi163 bash[24253]: cluster 2024-08-31T06:50:54.537842+0000 mgr.a (mgr.14388) 12093 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:54 smithi027 bash[22610]: cluster 2024-08-31T06:50:54.537842+0000 mgr.a (mgr.14388) 12093 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:54 smithi191 bash[24992]: cluster 2024-08-31T06:50:54.537842+0000 mgr.a (mgr.14388) 12093 : cluster [DBG] pgmap v8383: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:55.074 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:50:55.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:50:55.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:50:55.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:50:55.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:50:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:55 smithi163 bash[24253]: audit 2024-08-31T06:50:54.633975+0000 mgr.a (mgr.14388) 12094 : audit [DBG] from='client.265068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:55 smithi027 bash[22610]: audit 2024-08-31T06:50:54.633975+0000 mgr.a (mgr.14388) 12094 : audit [DBG] from='client.265068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:55 smithi191 bash[24992]: audit 2024-08-31T06:50:54.633975+0000 mgr.a (mgr.14388) 12094 : audit [DBG] from='client.265068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:50:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:56 smithi163 bash[24253]: cluster 2024-08-31T06:50:56.538741+0000 mgr.a (mgr.14388) 12095 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:56 smithi027 bash[22610]: cluster 2024-08-31T06:50:56.538741+0000 mgr.a (mgr.14388) 12095 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:56 smithi191 bash[24992]: cluster 2024-08-31T06:50:56.538741+0000 mgr.a (mgr.14388) 12095 : cluster [DBG] pgmap v8384: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:50:58.962 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:50:58 smithi163 bash[24253]: cluster 2024-08-31T06:50:58.540844+0000 mgr.a (mgr.14388) 12096 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:50:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:50:58 smithi027 bash[22610]: cluster 2024-08-31T06:50:58.540844+0000 mgr.a (mgr.14388) 12096 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:50:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:50:58 smithi191 bash[24992]: cluster 2024-08-31T06:50:58.540844+0000 mgr.a (mgr.14388) 12096 : cluster [DBG] pgmap v8385: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:00.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:00.076 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:00.076 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:00.839 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:00.839 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:00.839 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:00.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:00.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:00 smithi163 bash[24253]: audit 2024-08-31T06:51:00.408004+0000 mgr.a (mgr.14388) 12097 : audit [DBG] from='client.265146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:00 smithi163 bash[24253]: cluster 2024-08-31T06:51:00.541626+0000 mgr.a (mgr.14388) 12098 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:00 smithi027 bash[22610]: audit 2024-08-31T06:51:00.408004+0000 mgr.a (mgr.14388) 12097 : audit [DBG] from='client.265146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:00 smithi027 bash[22610]: cluster 2024-08-31T06:51:00.541626+0000 mgr.a (mgr.14388) 12098 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:00 smithi191 bash[24992]: audit 2024-08-31T06:51:00.408004+0000 mgr.a (mgr.14388) 12097 : audit [DBG] from='client.265146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:00 smithi191 bash[24992]: cluster 2024-08-31T06:51:00.541626+0000 mgr.a (mgr.14388) 12098 : cluster [DBG] pgmap v8386: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:02 smithi163 bash[24253]: cluster 2024-08-31T06:51:02.542539+0000 mgr.a (mgr.14388) 12099 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:02 smithi027 bash[22610]: cluster 2024-08-31T06:51:02.542539+0000 mgr.a (mgr.14388) 12099 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:02 smithi191 bash[24992]: cluster 2024-08-31T06:51:02.542539+0000 mgr.a (mgr.14388) 12099 : cluster [DBG] pgmap v8387: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:04 smithi163 bash[24253]: cluster 2024-08-31T06:51:04.544732+0000 mgr.a (mgr.14388) 12100 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:04 smithi027 bash[22610]: cluster 2024-08-31T06:51:04.544732+0000 mgr.a (mgr.14388) 12100 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:04 smithi191 bash[24992]: cluster 2024-08-31T06:51:04.544732+0000 mgr.a (mgr.14388) 12100 : cluster [DBG] pgmap v8388: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:06.610 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:06.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:06.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:06.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:06.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:06 smithi163 bash[24253]: audit 2024-08-31T06:51:06.182992+0000 mgr.a (mgr.14388) 12101 : audit [DBG] from='client.265224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:06 smithi163 bash[24253]: cluster 2024-08-31T06:51:06.545257+0000 mgr.a (mgr.14388) 12102 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:06 smithi027 bash[22610]: audit 2024-08-31T06:51:06.182992+0000 mgr.a (mgr.14388) 12101 : audit [DBG] from='client.265224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:06 smithi027 bash[22610]: cluster 2024-08-31T06:51:06.545257+0000 mgr.a (mgr.14388) 12102 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:06 smithi191 bash[24992]: audit 2024-08-31T06:51:06.182992+0000 mgr.a (mgr.14388) 12101 : audit [DBG] from='client.265224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:06 smithi191 bash[24992]: cluster 2024-08-31T06:51:06.545257+0000 mgr.a (mgr.14388) 12102 : cluster [DBG] pgmap v8389: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:08 smithi163 bash[24253]: cluster 2024-08-31T06:51:08.547351+0000 mgr.a (mgr.14388) 12103 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:08 smithi027 bash[22610]: cluster 2024-08-31T06:51:08.547351+0000 mgr.a (mgr.14388) 12103 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:08 smithi191 bash[24992]: cluster 2024-08-31T06:51:08.547351+0000 mgr.a (mgr.14388) 12103 : cluster [DBG] pgmap v8390: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:10 smithi163 bash[24253]: cluster 2024-08-31T06:51:10.548123+0000 mgr.a (mgr.14388) 12104 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:10 smithi027 bash[22610]: cluster 2024-08-31T06:51:10.548123+0000 mgr.a (mgr.14388) 12104 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:10 smithi191 bash[24992]: cluster 2024-08-31T06:51:10.548123+0000 mgr.a (mgr.14388) 12104 : cluster [DBG] pgmap v8391: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:11.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:11.612 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:11.612 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:12.355 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:12.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:12.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:12.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:12.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:12 smithi163 bash[24253]: audit 2024-08-31T06:51:11.941546+0000 mgr.a (mgr.14388) 12105 : audit [DBG] from='client.265302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:12 smithi163 bash[24253]: cluster 2024-08-31T06:51:12.549219+0000 mgr.a (mgr.14388) 12106 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:12 smithi027 bash[22610]: audit 2024-08-31T06:51:11.941546+0000 mgr.a (mgr.14388) 12105 : audit [DBG] from='client.265302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:12 smithi027 bash[22610]: cluster 2024-08-31T06:51:12.549219+0000 mgr.a (mgr.14388) 12106 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:12 smithi191 bash[24992]: audit 2024-08-31T06:51:11.941546+0000 mgr.a (mgr.14388) 12105 : audit [DBG] from='client.265302 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:12 smithi191 bash[24992]: cluster 2024-08-31T06:51:12.549219+0000 mgr.a (mgr.14388) 12106 : cluster [DBG] pgmap v8392: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:14 smithi163 bash[24253]: cluster 2024-08-31T06:51:14.551622+0000 mgr.a (mgr.14388) 12107 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:14 smithi027 bash[22610]: cluster 2024-08-31T06:51:14.551622+0000 mgr.a (mgr.14388) 12107 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:14 smithi191 bash[24992]: cluster 2024-08-31T06:51:14.551622+0000 mgr.a (mgr.14388) 12107 : cluster [DBG] pgmap v8393: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:16 smithi163 bash[24253]: cluster 2024-08-31T06:51:16.552566+0000 mgr.a (mgr.14388) 12108 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:16 smithi027 bash[22610]: cluster 2024-08-31T06:51:16.552566+0000 mgr.a (mgr.14388) 12108 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:16 smithi191 bash[24992]: cluster 2024-08-31T06:51:16.552566+0000 mgr.a (mgr.14388) 12108 : cluster [DBG] pgmap v8394: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:17.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:17.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:17.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:18.130 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:18.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:18.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:18.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:18.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:18 smithi163 bash[24253]: audit 2024-08-31T06:51:17.689103+0000 mgr.a (mgr.14388) 12109 : audit [DBG] from='client.265380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:18 smithi163 bash[24253]: cluster 2024-08-31T06:51:18.554900+0000 mgr.a (mgr.14388) 12110 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:18 smithi027 bash[22610]: audit 2024-08-31T06:51:17.689103+0000 mgr.a (mgr.14388) 12109 : audit [DBG] from='client.265380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:18 smithi027 bash[22610]: cluster 2024-08-31T06:51:18.554900+0000 mgr.a (mgr.14388) 12110 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:18 smithi191 bash[24992]: audit 2024-08-31T06:51:17.689103+0000 mgr.a (mgr.14388) 12109 : audit [DBG] from='client.265380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:18 smithi191 bash[24992]: cluster 2024-08-31T06:51:18.554900+0000 mgr.a (mgr.14388) 12110 : cluster [DBG] pgmap v8395: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:20 smithi163 bash[24253]: cluster 2024-08-31T06:51:20.555635+0000 mgr.a (mgr.14388) 12111 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:51:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:20 smithi027 bash[22610]: cluster 2024-08-31T06:51:20.555635+0000 mgr.a (mgr.14388) 12111 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:51:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:20 smithi191 bash[24992]: cluster 2024-08-31T06:51:20.555635+0000 mgr.a (mgr.14388) 12111 : cluster [DBG] pgmap v8396: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:51:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:22 smithi163 bash[24253]: cluster 2024-08-31T06:51:22.556395+0000 mgr.a (mgr.14388) 12112 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:51:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:22 smithi027 bash[22610]: cluster 2024-08-31T06:51:22.556395+0000 mgr.a (mgr.14388) 12112 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:51:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:22 smithi191 bash[24992]: cluster 2024-08-31T06:51:22.556395+0000 mgr.a (mgr.14388) 12112 : cluster [DBG] pgmap v8397: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:51:23.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:23.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:23.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:23.923 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:23.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:23.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:23.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:23.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:23 smithi163 bash[24253]: audit 2024-08-31T06:51:23.469775+0000 mgr.a (mgr.14388) 12113 : audit [DBG] from='client.265455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:23 smithi027 bash[22610]: audit 2024-08-31T06:51:23.469775+0000 mgr.a (mgr.14388) 12113 : audit [DBG] from='client.265455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:23 smithi191 bash[24992]: audit 2024-08-31T06:51:23.469775+0000 mgr.a (mgr.14388) 12113 : audit [DBG] from='client.265455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:24 smithi163 bash[24253]: cluster 2024-08-31T06:51:24.559139+0000 mgr.a (mgr.14388) 12114 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:24 smithi027 bash[22610]: cluster 2024-08-31T06:51:24.559139+0000 mgr.a (mgr.14388) 12114 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:24 smithi191 bash[24992]: cluster 2024-08-31T06:51:24.559139+0000 mgr.a (mgr.14388) 12114 : cluster [DBG] pgmap v8398: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:26 smithi163 bash[24253]: cluster 2024-08-31T06:51:26.559903+0000 mgr.a (mgr.14388) 12115 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:51:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:26 smithi027 bash[22610]: cluster 2024-08-31T06:51:26.559903+0000 mgr.a (mgr.14388) 12115 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:51:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:26 smithi191 bash[24992]: cluster 2024-08-31T06:51:26.559903+0000 mgr.a (mgr.14388) 12115 : cluster [DBG] pgmap v8399: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:51:28.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:28.925 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:28.925 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:28 smithi163 bash[24253]: cluster 2024-08-31T06:51:28.561806+0000 mgr.a (mgr.14388) 12116 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:28 smithi027 bash[22610]: cluster 2024-08-31T06:51:28.561806+0000 mgr.a (mgr.14388) 12116 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:28 smithi191 bash[24992]: cluster 2024-08-31T06:51:28.561806+0000 mgr.a (mgr.14388) 12116 : cluster [DBG] pgmap v8400: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:29.677 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:29.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:29.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:29.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:29.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:29 smithi163 bash[24253]: audit 2024-08-31T06:51:29.255896+0000 mgr.a (mgr.14388) 12117 : audit [DBG] from='client.265533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:29 smithi027 bash[22610]: audit 2024-08-31T06:51:29.255896+0000 mgr.a (mgr.14388) 12117 : audit [DBG] from='client.265533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:29 smithi191 bash[24992]: audit 2024-08-31T06:51:29.255896+0000 mgr.a (mgr.14388) 12117 : audit [DBG] from='client.265533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:30 smithi163 bash[24253]: cluster 2024-08-31T06:51:30.562686+0000 mgr.a (mgr.14388) 12118 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:51:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:30 smithi027 bash[22610]: cluster 2024-08-31T06:51:30.562686+0000 mgr.a (mgr.14388) 12118 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:51:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:30 smithi191 bash[24992]: cluster 2024-08-31T06:51:30.562686+0000 mgr.a (mgr.14388) 12118 : cluster [DBG] pgmap v8401: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:51:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:31 smithi191 bash[24992]: audit 2024-08-31T06:51:31.688089+0000 mon.a (mon.0) 2394 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:51:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:31 smithi163 bash[24253]: audit 2024-08-31T06:51:31.688089+0000 mon.a (mon.0) 2394 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:51:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:31 smithi027 bash[22610]: audit 2024-08-31T06:51:31.688089+0000 mon.a (mon.0) 2394 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:51:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:32 smithi191 bash[24992]: audit 2024-08-31T06:51:32.531412+0000 mon.a (mon.0) 2395 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:51:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:32 smithi191 bash[24992]: audit 2024-08-31T06:51:32.533309+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:51:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:32 smithi191 bash[24992]: audit 2024-08-31T06:51:32.541850+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:51:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:32 smithi191 bash[24992]: audit 2024-08-31T06:51:32.544482+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:51:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:32 smithi191 bash[24992]: audit 2024-08-31T06:51:32.547007+0000 mgr.a (mgr.14388) 12119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:51:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:32 smithi191 bash[24992]: cluster 2024-08-31T06:51:32.565809+0000 mgr.a (mgr.14388) 12120 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:51:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:32 smithi163 bash[24253]: audit 2024-08-31T06:51:32.531412+0000 mon.a (mon.0) 2395 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:51:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:32 smithi163 bash[24253]: audit 2024-08-31T06:51:32.533309+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:51:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:32 smithi163 bash[24253]: audit 2024-08-31T06:51:32.541850+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:51:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:32 smithi163 bash[24253]: audit 2024-08-31T06:51:32.544482+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:51:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:32 smithi163 bash[24253]: audit 2024-08-31T06:51:32.547007+0000 mgr.a (mgr.14388) 12119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:51:33.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:32 smithi163 bash[24253]: cluster 2024-08-31T06:51:32.565809+0000 mgr.a (mgr.14388) 12120 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:51:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:32 smithi027 bash[22610]: audit 2024-08-31T06:51:32.531412+0000 mon.a (mon.0) 2395 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:51:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:32 smithi027 bash[22610]: audit 2024-08-31T06:51:32.533309+0000 mon.a (mon.0) 2396 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:51:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:32 smithi027 bash[22610]: audit 2024-08-31T06:51:32.541850+0000 mon.a (mon.0) 2397 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:51:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:32 smithi027 bash[22610]: audit 2024-08-31T06:51:32.544482+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:51:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:32 smithi027 bash[22610]: audit 2024-08-31T06:51:32.547007+0000 mgr.a (mgr.14388) 12119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:51:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:32 smithi027 bash[22610]: cluster 2024-08-31T06:51:32.565809+0000 mgr.a (mgr.14388) 12120 : cluster [DBG] pgmap v8402: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:51:33.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:51:33 smithi027 bash[22863]: debug 2024-08-31T06:51:33.286+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:51:33.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:51:33 smithi027 bash[22863]: debug 2024-08-31T06:51:33.286+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:51:34.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:34.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:34.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:34 smithi163 bash[24253]: audit 2024-08-31T06:51:33.291427+0000 mgr.a (mgr.14388) 12121 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:51:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:34 smithi163 bash[24253]: cephadm 2024-08-31T06:51:33.292687+0000 mgr.a (mgr.14388) 12122 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:51:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:34 smithi027 bash[22610]: audit 2024-08-31T06:51:33.291427+0000 mgr.a (mgr.14388) 12121 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:51:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:34 smithi027 bash[22610]: cephadm 2024-08-31T06:51:33.292687+0000 mgr.a (mgr.14388) 12122 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:51:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:34 smithi191 bash[24992]: audit 2024-08-31T06:51:33.291427+0000 mgr.a (mgr.14388) 12121 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:51:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:34 smithi191 bash[24992]: cephadm 2024-08-31T06:51:33.292687+0000 mgr.a (mgr.14388) 12122 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:51:35.462 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:35.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:35.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:35.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:35.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:35 smithi163 bash[24253]: cluster 2024-08-31T06:51:34.568278+0000 mgr.a (mgr.14388) 12123 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T06:51:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:35 smithi027 bash[22610]: cluster 2024-08-31T06:51:34.568278+0000 mgr.a (mgr.14388) 12123 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T06:51:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:35 smithi191 bash[24992]: cluster 2024-08-31T06:51:34.568278+0000 mgr.a (mgr.14388) 12123 : cluster [DBG] pgmap v8403: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T06:51:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:36 smithi163 bash[24253]: audit 2024-08-31T06:51:35.011923+0000 mgr.a (mgr.14388) 12124 : audit [DBG] from='client.265716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:36 smithi027 bash[22610]: audit 2024-08-31T06:51:35.011923+0000 mgr.a (mgr.14388) 12124 : audit [DBG] from='client.265716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:36 smithi191 bash[24992]: audit 2024-08-31T06:51:35.011923+0000 mgr.a (mgr.14388) 12124 : audit [DBG] from='client.265716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:37 smithi163 bash[24253]: cluster 2024-08-31T06:51:36.569127+0000 mgr.a (mgr.14388) 12125 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T06:51:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:37 smithi027 bash[22610]: cluster 2024-08-31T06:51:36.569127+0000 mgr.a (mgr.14388) 12125 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T06:51:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:37 smithi191 bash[24992]: cluster 2024-08-31T06:51:36.569127+0000 mgr.a (mgr.14388) 12125 : cluster [DBG] pgmap v8404: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T06:51:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:38 smithi163 bash[24253]: cluster 2024-08-31T06:51:38.571284+0000 mgr.a (mgr.14388) 12126 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:38 smithi027 bash[22610]: cluster 2024-08-31T06:51:38.571284+0000 mgr.a (mgr.14388) 12126 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:38 smithi191 bash[24992]: cluster 2024-08-31T06:51:38.571284+0000 mgr.a (mgr.14388) 12126 : cluster [DBG] pgmap v8405: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:40.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:40.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:40.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:40 smithi163 bash[24253]: cluster 2024-08-31T06:51:40.571704+0000 mgr.a (mgr.14388) 12127 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:40 smithi027 bash[22610]: cluster 2024-08-31T06:51:40.571704+0000 mgr.a (mgr.14388) 12127 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:40 smithi191 bash[24992]: cluster 2024-08-31T06:51:40.571704+0000 mgr.a (mgr.14388) 12127 : cluster [DBG] pgmap v8406: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:41.228 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:41.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:41.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:41.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:41.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:41 smithi163 bash[24253]: audit 2024-08-31T06:51:40.797191+0000 mgr.a (mgr.14388) 12128 : audit [DBG] from='client.265791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:41 smithi027 bash[22610]: audit 2024-08-31T06:51:40.797191+0000 mgr.a (mgr.14388) 12128 : audit [DBG] from='client.265791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:41 smithi191 bash[24992]: audit 2024-08-31T06:51:40.797191+0000 mgr.a (mgr.14388) 12128 : audit [DBG] from='client.265791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:42 smithi163 bash[24253]: cluster 2024-08-31T06:51:42.572570+0000 mgr.a (mgr.14388) 12129 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:42 smithi027 bash[22610]: cluster 2024-08-31T06:51:42.572570+0000 mgr.a (mgr.14388) 12129 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:42 smithi191 bash[24992]: cluster 2024-08-31T06:51:42.572570+0000 mgr.a (mgr.14388) 12129 : cluster [DBG] pgmap v8407: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:44 smithi163 bash[24253]: cluster 2024-08-31T06:51:44.574788+0000 mgr.a (mgr.14388) 12130 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:44 smithi027 bash[22610]: cluster 2024-08-31T06:51:44.574788+0000 mgr.a (mgr.14388) 12130 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:44 smithi191 bash[24992]: cluster 2024-08-31T06:51:44.574788+0000 mgr.a (mgr.14388) 12130 : cluster [DBG] pgmap v8408: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:51:46.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:46.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:46.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:46 smithi163 bash[24253]: audit 2024-08-31T06:51:46.558649+0000 mgr.a (mgr.14388) 12131 : audit [DBG] from='client.265866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:46 smithi163 bash[24253]: cluster 2024-08-31T06:51:46.577129+0000 mgr.a (mgr.14388) 12132 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:51:46.981 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:46.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:46.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:46.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:46.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:46 smithi027 bash[22610]: audit 2024-08-31T06:51:46.558649+0000 mgr.a (mgr.14388) 12131 : audit [DBG] from='client.265866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:46 smithi027 bash[22610]: cluster 2024-08-31T06:51:46.577129+0000 mgr.a (mgr.14388) 12132 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:51:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:46 smithi191 bash[24992]: audit 2024-08-31T06:51:46.558649+0000 mgr.a (mgr.14388) 12131 : audit [DBG] from='client.265866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:46 smithi191 bash[24992]: cluster 2024-08-31T06:51:46.577129+0000 mgr.a (mgr.14388) 12132 : cluster [DBG] pgmap v8409: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:51:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:48 smithi163 bash[24253]: cluster 2024-08-31T06:51:48.579461+0000 mgr.a (mgr.14388) 12133 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:51:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:48 smithi027 bash[22610]: cluster 2024-08-31T06:51:48.579461+0000 mgr.a (mgr.14388) 12133 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:51:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:48 smithi191 bash[24992]: cluster 2024-08-31T06:51:48.579461+0000 mgr.a (mgr.14388) 12133 : cluster [DBG] pgmap v8410: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:51:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:50 smithi163 bash[24253]: cluster 2024-08-31T06:51:50.580217+0000 mgr.a (mgr.14388) 12134 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:50 smithi027 bash[22610]: cluster 2024-08-31T06:51:50.580217+0000 mgr.a (mgr.14388) 12134 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:50 smithi191 bash[24992]: cluster 2024-08-31T06:51:50.580217+0000 mgr.a (mgr.14388) 12134 : cluster [DBG] pgmap v8411: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:51.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:51.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:52.762 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:52.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:52.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:52.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:52.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:52 smithi163 bash[24253]: audit 2024-08-31T06:51:52.320444+0000 mgr.a (mgr.14388) 12135 : audit [DBG] from='client.265944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:52 smithi163 bash[24253]: cluster 2024-08-31T06:51:52.580775+0000 mgr.a (mgr.14388) 12136 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:52 smithi027 bash[22610]: audit 2024-08-31T06:51:52.320444+0000 mgr.a (mgr.14388) 12135 : audit [DBG] from='client.265944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:52 smithi027 bash[22610]: cluster 2024-08-31T06:51:52.580775+0000 mgr.a (mgr.14388) 12136 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:52 smithi191 bash[24992]: audit 2024-08-31T06:51:52.320444+0000 mgr.a (mgr.14388) 12135 : audit [DBG] from='client.265944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:52 smithi191 bash[24992]: cluster 2024-08-31T06:51:52.580775+0000 mgr.a (mgr.14388) 12136 : cluster [DBG] pgmap v8412: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:54 smithi163 bash[24253]: cluster 2024-08-31T06:51:54.583235+0000 mgr.a (mgr.14388) 12137 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:54 smithi027 bash[22610]: cluster 2024-08-31T06:51:54.583235+0000 mgr.a (mgr.14388) 12137 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:54 smithi191 bash[24992]: cluster 2024-08-31T06:51:54.583235+0000 mgr.a (mgr.14388) 12137 : cluster [DBG] pgmap v8413: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:51:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:56 smithi163 bash[24253]: cluster 2024-08-31T06:51:56.584158+0000 mgr.a (mgr.14388) 12138 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:56 smithi027 bash[22610]: cluster 2024-08-31T06:51:56.584158+0000 mgr.a (mgr.14388) 12138 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:56 smithi191 bash[24992]: cluster 2024-08-31T06:51:56.584158+0000 mgr.a (mgr.14388) 12138 : cluster [DBG] pgmap v8414: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:57.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:51:57.765 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:51:57.765 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:51:58.541 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:51:58.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:51:58.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:51:58.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:51:58.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:51:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:58 smithi163 bash[24253]: audit 2024-08-31T06:51:58.100392+0000 mgr.a (mgr.14388) 12139 : audit [DBG] from='client.266019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:51:58 smithi163 bash[24253]: cluster 2024-08-31T06:51:58.585451+0000 mgr.a (mgr.14388) 12140 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:58 smithi027 bash[22610]: audit 2024-08-31T06:51:58.100392+0000 mgr.a (mgr.14388) 12139 : audit [DBG] from='client.266019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:51:58 smithi027 bash[22610]: cluster 2024-08-31T06:51:58.585451+0000 mgr.a (mgr.14388) 12140 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:51:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:58 smithi191 bash[24992]: audit 2024-08-31T06:51:58.100392+0000 mgr.a (mgr.14388) 12139 : audit [DBG] from='client.266019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:51:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:51:58 smithi191 bash[24992]: cluster 2024-08-31T06:51:58.585451+0000 mgr.a (mgr.14388) 12140 : cluster [DBG] pgmap v8415: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:00 smithi163 bash[24253]: cluster 2024-08-31T06:52:00.586177+0000 mgr.a (mgr.14388) 12141 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:52:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:00 smithi027 bash[22610]: cluster 2024-08-31T06:52:00.586177+0000 mgr.a (mgr.14388) 12141 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:52:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:00 smithi191 bash[24992]: cluster 2024-08-31T06:52:00.586177+0000 mgr.a (mgr.14388) 12141 : cluster [DBG] pgmap v8416: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:52:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:02 smithi163 bash[24253]: cluster 2024-08-31T06:52:02.586983+0000 mgr.a (mgr.14388) 12142 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:52:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:02 smithi027 bash[22610]: cluster 2024-08-31T06:52:02.586983+0000 mgr.a (mgr.14388) 12142 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:52:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:02 smithi191 bash[24992]: cluster 2024-08-31T06:52:02.586983+0000 mgr.a (mgr.14388) 12142 : cluster [DBG] pgmap v8417: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:52:03.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:52:03.543 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:52:03.543 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:52:04.317 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:52:04.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:52:04.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:52:04.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:52:04.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:52:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:04 smithi163 bash[24253]: audit 2024-08-31T06:52:03.882033+0000 mgr.a (mgr.14388) 12143 : audit [DBG] from='client.266094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:04 smithi163 bash[24253]: cluster 2024-08-31T06:52:04.589769+0000 mgr.a (mgr.14388) 12144 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:04 smithi027 bash[22610]: audit 2024-08-31T06:52:03.882033+0000 mgr.a (mgr.14388) 12143 : audit [DBG] from='client.266094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:04 smithi027 bash[22610]: cluster 2024-08-31T06:52:04.589769+0000 mgr.a (mgr.14388) 12144 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:04 smithi191 bash[24992]: audit 2024-08-31T06:52:03.882033+0000 mgr.a (mgr.14388) 12143 : audit [DBG] from='client.266094 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:04 smithi191 bash[24992]: cluster 2024-08-31T06:52:04.589769+0000 mgr.a (mgr.14388) 12144 : cluster [DBG] pgmap v8418: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:06 smithi163 bash[24253]: cluster 2024-08-31T06:52:06.590538+0000 mgr.a (mgr.14388) 12145 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:52:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:06 smithi027 bash[22610]: cluster 2024-08-31T06:52:06.590538+0000 mgr.a (mgr.14388) 12145 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:52:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:06 smithi191 bash[24992]: cluster 2024-08-31T06:52:06.590538+0000 mgr.a (mgr.14388) 12145 : cluster [DBG] pgmap v8419: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:52:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:08 smithi163 bash[24253]: cluster 2024-08-31T06:52:08.592445+0000 mgr.a (mgr.14388) 12146 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:08 smithi027 bash[22610]: cluster 2024-08-31T06:52:08.592445+0000 mgr.a (mgr.14388) 12146 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:08 smithi191 bash[24992]: cluster 2024-08-31T06:52:08.592445+0000 mgr.a (mgr.14388) 12146 : cluster [DBG] pgmap v8420: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:09.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:52:09.319 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:52:09.319 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:52:10.070 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:52:10.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:52:10.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:52:10.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:52:10.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:52:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:10 smithi163 bash[24253]: audit 2024-08-31T06:52:09.646474+0000 mgr.a (mgr.14388) 12147 : audit [DBG] from='client.266169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:10 smithi163 bash[24253]: cluster 2024-08-31T06:52:10.593386+0000 mgr.a (mgr.14388) 12148 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:10 smithi027 bash[22610]: audit 2024-08-31T06:52:09.646474+0000 mgr.a (mgr.14388) 12147 : audit [DBG] from='client.266169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:10 smithi027 bash[22610]: cluster 2024-08-31T06:52:10.593386+0000 mgr.a (mgr.14388) 12148 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:10 smithi191 bash[24992]: audit 2024-08-31T06:52:09.646474+0000 mgr.a (mgr.14388) 12147 : audit [DBG] from='client.266169 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:10 smithi191 bash[24992]: cluster 2024-08-31T06:52:10.593386+0000 mgr.a (mgr.14388) 12148 : cluster [DBG] pgmap v8421: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:12 smithi163 bash[24253]: cluster 2024-08-31T06:52:12.594198+0000 mgr.a (mgr.14388) 12149 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:12 smithi027 bash[22610]: cluster 2024-08-31T06:52:12.594198+0000 mgr.a (mgr.14388) 12149 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:12 smithi191 bash[24992]: cluster 2024-08-31T06:52:12.594198+0000 mgr.a (mgr.14388) 12149 : cluster [DBG] pgmap v8422: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:15.071 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:52:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:52:15.072 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:52:15.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:52:15.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:52:15.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:52:15.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:52:15.812 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:52:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:15 smithi163 bash[24253]: cluster 2024-08-31T06:52:14.596390+0000 mgr.a (mgr.14388) 12150 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:52:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:15 smithi163 bash[24253]: audit 2024-08-31T06:52:15.407318+0000 mgr.a (mgr.14388) 12151 : audit [DBG] from='client.266247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:15 smithi027 bash[22610]: cluster 2024-08-31T06:52:14.596390+0000 mgr.a (mgr.14388) 12150 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:52:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:15 smithi027 bash[22610]: audit 2024-08-31T06:52:15.407318+0000 mgr.a (mgr.14388) 12151 : audit [DBG] from='client.266247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:15 smithi191 bash[24992]: cluster 2024-08-31T06:52:14.596390+0000 mgr.a (mgr.14388) 12150 : cluster [DBG] pgmap v8423: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:52:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:15 smithi191 bash[24992]: audit 2024-08-31T06:52:15.407318+0000 mgr.a (mgr.14388) 12151 : audit [DBG] from='client.266247 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:17 smithi163 bash[24253]: cluster 2024-08-31T06:52:16.597371+0000 mgr.a (mgr.14388) 12152 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:17 smithi027 bash[22610]: cluster 2024-08-31T06:52:16.597371+0000 mgr.a (mgr.14388) 12152 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:17 smithi191 bash[24992]: cluster 2024-08-31T06:52:16.597371+0000 mgr.a (mgr.14388) 12152 : cluster [DBG] pgmap v8424: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:19 smithi163 bash[24253]: cluster 2024-08-31T06:52:18.599555+0000 mgr.a (mgr.14388) 12153 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:52:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:19 smithi027 bash[22610]: cluster 2024-08-31T06:52:18.599555+0000 mgr.a (mgr.14388) 12153 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:52:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:19 smithi191 bash[24992]: cluster 2024-08-31T06:52:18.599555+0000 mgr.a (mgr.14388) 12153 : cluster [DBG] pgmap v8425: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:52:20.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:52:20.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:52:20.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:52:21.564 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:52:21.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:52:21.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:52:21.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:52:21.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:52:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:21 smithi163 bash[24253]: cluster 2024-08-31T06:52:20.600323+0000 mgr.a (mgr.14388) 12154 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:21 smithi163 bash[24253]: audit 2024-08-31T06:52:21.142618+0000 mgr.a (mgr.14388) 12155 : audit [DBG] from='client.266322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:21 smithi027 bash[22610]: cluster 2024-08-31T06:52:20.600323+0000 mgr.a (mgr.14388) 12154 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:21 smithi027 bash[22610]: audit 2024-08-31T06:52:21.142618+0000 mgr.a (mgr.14388) 12155 : audit [DBG] from='client.266322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:21 smithi191 bash[24992]: cluster 2024-08-31T06:52:20.600323+0000 mgr.a (mgr.14388) 12154 : cluster [DBG] pgmap v8426: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:21 smithi191 bash[24992]: audit 2024-08-31T06:52:21.142618+0000 mgr.a (mgr.14388) 12155 : audit [DBG] from='client.266322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:23 smithi163 bash[24253]: cluster 2024-08-31T06:52:22.601310+0000 mgr.a (mgr.14388) 12156 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:23 smithi027 bash[22610]: cluster 2024-08-31T06:52:22.601310+0000 mgr.a (mgr.14388) 12156 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:23 smithi191 bash[24992]: cluster 2024-08-31T06:52:22.601310+0000 mgr.a (mgr.14388) 12156 : cluster [DBG] pgmap v8427: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:25 smithi163 bash[24253]: cluster 2024-08-31T06:52:24.603604+0000 mgr.a (mgr.14388) 12157 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:52:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:25 smithi027 bash[22610]: cluster 2024-08-31T06:52:24.603604+0000 mgr.a (mgr.14388) 12157 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:52:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:25 smithi191 bash[24992]: cluster 2024-08-31T06:52:24.603604+0000 mgr.a (mgr.14388) 12157 : cluster [DBG] pgmap v8428: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:52:26.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:52:26.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:52:26.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:52:27.311 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:52:27.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:52:27.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:52:27.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:52:27.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:52:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:27 smithi163 bash[24253]: cluster 2024-08-31T06:52:26.604181+0000 mgr.a (mgr.14388) 12158 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:52:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:27 smithi163 bash[24253]: audit 2024-08-31T06:52:26.895637+0000 mgr.a (mgr.14388) 12159 : audit [DBG] from='client.266400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:27 smithi027 bash[22610]: cluster 2024-08-31T06:52:26.604181+0000 mgr.a (mgr.14388) 12158 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:52:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:27 smithi027 bash[22610]: audit 2024-08-31T06:52:26.895637+0000 mgr.a (mgr.14388) 12159 : audit [DBG] from='client.266400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:27 smithi191 bash[24992]: cluster 2024-08-31T06:52:26.604181+0000 mgr.a (mgr.14388) 12158 : cluster [DBG] pgmap v8429: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:52:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:27 smithi191 bash[24992]: audit 2024-08-31T06:52:26.895637+0000 mgr.a (mgr.14388) 12159 : audit [DBG] from='client.266400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:29 smithi163 bash[24253]: cluster 2024-08-31T06:52:28.606502+0000 mgr.a (mgr.14388) 12160 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:52:29.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:29 smithi027 bash[22610]: cluster 2024-08-31T06:52:28.606502+0000 mgr.a (mgr.14388) 12160 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:52:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:29 smithi191 bash[24992]: cluster 2024-08-31T06:52:28.606502+0000 mgr.a (mgr.14388) 12160 : cluster [DBG] pgmap v8430: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:52:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:31 smithi163 bash[24253]: cluster 2024-08-31T06:52:30.607296+0000 mgr.a (mgr.14388) 12161 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:52:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:31 smithi027 bash[22610]: cluster 2024-08-31T06:52:30.607296+0000 mgr.a (mgr.14388) 12161 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:52:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:31 smithi191 bash[24992]: cluster 2024-08-31T06:52:30.607296+0000 mgr.a (mgr.14388) 12161 : cluster [DBG] pgmap v8431: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:52:32.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:52:32.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:52:32.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:52:33.092 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:52:33.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:52:33.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:52:33.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:52:33.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:52:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:33 smithi163 bash[24253]: cluster 2024-08-31T06:52:32.608052+0000 mgr.a (mgr.14388) 12162 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:52:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:33 smithi163 bash[24253]: audit 2024-08-31T06:52:32.648808+0000 mgr.a (mgr.14388) 12163 : audit [DBG] from='client.266478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:33 smithi163 bash[24253]: audit 2024-08-31T06:52:33.350138+0000 mon.a (mon.0) 2399 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:52:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:33 smithi027 bash[22610]: cluster 2024-08-31T06:52:32.608052+0000 mgr.a (mgr.14388) 12162 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:52:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:33 smithi027 bash[22610]: audit 2024-08-31T06:52:32.648808+0000 mgr.a (mgr.14388) 12163 : audit [DBG] from='client.266478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:33 smithi027 bash[22610]: audit 2024-08-31T06:52:33.350138+0000 mon.a (mon.0) 2399 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:52:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:33 smithi191 bash[24992]: cluster 2024-08-31T06:52:32.608052+0000 mgr.a (mgr.14388) 12162 : cluster [DBG] pgmap v8432: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:52:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:33 smithi191 bash[24992]: audit 2024-08-31T06:52:32.648808+0000 mgr.a (mgr.14388) 12163 : audit [DBG] from='client.266478 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:33 smithi191 bash[24992]: audit 2024-08-31T06:52:33.350138+0000 mon.a (mon.0) 2399 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:52:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:34 smithi163 bash[24253]: audit 2024-08-31T06:52:34.192016+0000 mon.a (mon.0) 2400 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:52:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:34 smithi163 bash[24253]: audit 2024-08-31T06:52:34.193769+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:52:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:34 smithi163 bash[24253]: audit 2024-08-31T06:52:34.203731+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:52:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:34 smithi163 bash[24253]: audit 2024-08-31T06:52:34.208771+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:52:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:34 smithi163 bash[24253]: audit 2024-08-31T06:52:34.211374+0000 mgr.a (mgr.14388) 12164 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:52:34.961 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:34 smithi027 bash[22610]: audit 2024-08-31T06:52:34.192016+0000 mon.a (mon.0) 2400 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:52:34.961 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:34 smithi027 bash[22610]: audit 2024-08-31T06:52:34.193769+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:52:34.962 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:34 smithi027 bash[22610]: audit 2024-08-31T06:52:34.203731+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:52:34.962 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:34 smithi027 bash[22610]: audit 2024-08-31T06:52:34.208771+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:52:34.962 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:34 smithi027 bash[22610]: audit 2024-08-31T06:52:34.211374+0000 mgr.a (mgr.14388) 12164 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:52:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:34 smithi191 bash[24992]: audit 2024-08-31T06:52:34.192016+0000 mon.a (mon.0) 2400 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:52:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:34 smithi191 bash[24992]: audit 2024-08-31T06:52:34.193769+0000 mon.a (mon.0) 2401 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:52:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:34 smithi191 bash[24992]: audit 2024-08-31T06:52:34.203731+0000 mon.a (mon.0) 2402 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:52:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:34 smithi191 bash[24992]: audit 2024-08-31T06:52:34.208771+0000 mon.a (mon.0) 2403 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:52:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:34 smithi191 bash[24992]: audit 2024-08-31T06:52:34.211374+0000 mgr.a (mgr.14388) 12164 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:52:35.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:52:34 smithi027 bash[22863]: debug 2024-08-31T06:52:34.957+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:52:35.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:52:34 smithi027 bash[22863]: debug 2024-08-31T06:52:34.957+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:52:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:36 smithi027 bash[22610]: cluster 2024-08-31T06:52:34.609564+0000 mgr.a (mgr.14388) 12165 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:52:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:36 smithi027 bash[22610]: audit 2024-08-31T06:52:34.961284+0000 mgr.a (mgr.14388) 12166 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:52:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:36 smithi027 bash[22610]: cephadm 2024-08-31T06:52:34.962487+0000 mgr.a (mgr.14388) 12167 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:52:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:36 smithi191 bash[24992]: cluster 2024-08-31T06:52:34.609564+0000 mgr.a (mgr.14388) 12165 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:52:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:36 smithi191 bash[24992]: audit 2024-08-31T06:52:34.961284+0000 mgr.a (mgr.14388) 12166 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:52:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:36 smithi191 bash[24992]: cephadm 2024-08-31T06:52:34.962487+0000 mgr.a (mgr.14388) 12167 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:52:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:36 smithi163 bash[24253]: cluster 2024-08-31T06:52:34.609564+0000 mgr.a (mgr.14388) 12165 : cluster [DBG] pgmap v8433: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:52:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:36 smithi163 bash[24253]: audit 2024-08-31T06:52:34.961284+0000 mgr.a (mgr.14388) 12166 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:52:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:36 smithi163 bash[24253]: cephadm 2024-08-31T06:52:34.962487+0000 mgr.a (mgr.14388) 12167 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:52:38.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:52:38.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:52:38.095 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:52:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:38 smithi027 bash[22610]: cluster 2024-08-31T06:52:36.610578+0000 mgr.a (mgr.14388) 12168 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:52:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:38 smithi191 bash[24992]: cluster 2024-08-31T06:52:36.610578+0000 mgr.a (mgr.14388) 12168 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:52:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:38 smithi163 bash[24253]: cluster 2024-08-31T06:52:36.610578+0000 mgr.a (mgr.14388) 12168 : cluster [DBG] pgmap v8434: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:52:38.884 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:52:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:52:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:52:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:52:38.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:52:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:39 smithi027 bash[22610]: audit 2024-08-31T06:52:38.431930+0000 mgr.a (mgr.14388) 12169 : audit [DBG] from='client.266661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:39 smithi191 bash[24992]: audit 2024-08-31T06:52:38.431930+0000 mgr.a (mgr.14388) 12169 : audit [DBG] from='client.266661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:39 smithi163 bash[24253]: audit 2024-08-31T06:52:38.431930+0000 mgr.a (mgr.14388) 12169 : audit [DBG] from='client.266661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:40 smithi027 bash[22610]: cluster 2024-08-31T06:52:38.611978+0000 mgr.a (mgr.14388) 12170 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:52:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:40 smithi191 bash[24992]: cluster 2024-08-31T06:52:38.611978+0000 mgr.a (mgr.14388) 12170 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:52:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:40 smithi163 bash[24253]: cluster 2024-08-31T06:52:38.611978+0000 mgr.a (mgr.14388) 12170 : cluster [DBG] pgmap v8435: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:52:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:42 smithi027 bash[22610]: cluster 2024-08-31T06:52:40.612878+0000 mgr.a (mgr.14388) 12171 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:52:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:42 smithi191 bash[24992]: cluster 2024-08-31T06:52:40.612878+0000 mgr.a (mgr.14388) 12171 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:52:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:42 smithi163 bash[24253]: cluster 2024-08-31T06:52:40.612878+0000 mgr.a (mgr.14388) 12171 : cluster [DBG] pgmap v8436: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:52:43.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:52:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:52:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:52:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:44 smithi027 bash[22610]: cluster 2024-08-31T06:52:42.613724+0000 mgr.a (mgr.14388) 12172 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:52:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:44 smithi191 bash[24992]: cluster 2024-08-31T06:52:42.613724+0000 mgr.a (mgr.14388) 12172 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:52:44.661 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:52:44.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:52:44.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:52:44.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:52:44.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:52:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:44 smithi163 bash[24253]: cluster 2024-08-31T06:52:42.613724+0000 mgr.a (mgr.14388) 12172 : cluster [DBG] pgmap v8437: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:52:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:45 smithi191 bash[24992]: audit 2024-08-31T06:52:44.224865+0000 mgr.a (mgr.14388) 12173 : audit [DBG] from='client.266733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:45 smithi163 bash[24253]: audit 2024-08-31T06:52:44.224865+0000 mgr.a (mgr.14388) 12173 : audit [DBG] from='client.266733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:45 smithi027 bash[22610]: audit 2024-08-31T06:52:44.224865+0000 mgr.a (mgr.14388) 12173 : audit [DBG] from='client.266733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:46 smithi191 bash[24992]: cluster 2024-08-31T06:52:44.615144+0000 mgr.a (mgr.14388) 12174 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:52:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:46 smithi163 bash[24253]: cluster 2024-08-31T06:52:44.615144+0000 mgr.a (mgr.14388) 12174 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:52:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:46 smithi027 bash[22610]: cluster 2024-08-31T06:52:44.615144+0000 mgr.a (mgr.14388) 12174 : cluster [DBG] pgmap v8438: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:52:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:48 smithi191 bash[24992]: cluster 2024-08-31T06:52:46.615930+0000 mgr.a (mgr.14388) 12175 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:52:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:48 smithi163 bash[24253]: cluster 2024-08-31T06:52:46.615930+0000 mgr.a (mgr.14388) 12175 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:52:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:48 smithi027 bash[22610]: cluster 2024-08-31T06:52:46.615930+0000 mgr.a (mgr.14388) 12175 : cluster [DBG] pgmap v8439: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 61 op/s 2024-08-31T06:52:49.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:52:49.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:52:49.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:52:50.421 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:52:50.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:52:50.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:52:50.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:52:50.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:52:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:50 smithi191 bash[24992]: cluster 2024-08-31T06:52:48.617885+0000 mgr.a (mgr.14388) 12176 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:52:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:50 smithi163 bash[24253]: cluster 2024-08-31T06:52:48.617885+0000 mgr.a (mgr.14388) 12176 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:52:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:50 smithi027 bash[22610]: cluster 2024-08-31T06:52:48.617885+0000 mgr.a (mgr.14388) 12176 : cluster [DBG] pgmap v8440: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 62 op/s 2024-08-31T06:52:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:51 smithi191 bash[24992]: audit 2024-08-31T06:52:49.995671+0000 mgr.a (mgr.14388) 12177 : audit [DBG] from='client.266811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:51 smithi163 bash[24253]: audit 2024-08-31T06:52:49.995671+0000 mgr.a (mgr.14388) 12177 : audit [DBG] from='client.266811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:51 smithi027 bash[22610]: audit 2024-08-31T06:52:49.995671+0000 mgr.a (mgr.14388) 12177 : audit [DBG] from='client.266811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:52 smithi191 bash[24992]: cluster 2024-08-31T06:52:50.618852+0000 mgr.a (mgr.14388) 12178 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T06:52:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:52 smithi163 bash[24253]: cluster 2024-08-31T06:52:50.618852+0000 mgr.a (mgr.14388) 12178 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T06:52:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:52 smithi027 bash[22610]: cluster 2024-08-31T06:52:50.618852+0000 mgr.a (mgr.14388) 12178 : cluster [DBG] pgmap v8441: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T06:52:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:54 smithi191 bash[24992]: cluster 2024-08-31T06:52:52.619672+0000 mgr.a (mgr.14388) 12179 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T06:52:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:54 smithi163 bash[24253]: cluster 2024-08-31T06:52:52.619672+0000 mgr.a (mgr.14388) 12179 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T06:52:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:54 smithi027 bash[22610]: cluster 2024-08-31T06:52:52.619672+0000 mgr.a (mgr.14388) 12179 : cluster [DBG] pgmap v8442: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T06:52:55.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:52:55.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:52:55.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:52:56.199 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:52:56.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:52:56.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:52:56.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:52:56.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:52:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:56 smithi191 bash[24992]: cluster 2024-08-31T06:52:54.621909+0000 mgr.a (mgr.14388) 12180 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T06:52:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:56 smithi163 bash[24253]: cluster 2024-08-31T06:52:54.621909+0000 mgr.a (mgr.14388) 12180 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T06:52:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:56 smithi027 bash[22610]: cluster 2024-08-31T06:52:54.621909+0000 mgr.a (mgr.14388) 12180 : cluster [DBG] pgmap v8443: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T06:52:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:57 smithi191 bash[24992]: audit 2024-08-31T06:52:55.758327+0000 mgr.a (mgr.14388) 12181 : audit [DBG] from='client.266886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:57 smithi163 bash[24253]: audit 2024-08-31T06:52:55.758327+0000 mgr.a (mgr.14388) 12181 : audit [DBG] from='client.266886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:57 smithi027 bash[22610]: audit 2024-08-31T06:52:55.758327+0000 mgr.a (mgr.14388) 12181 : audit [DBG] from='client.266886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:52:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:52:58 smithi191 bash[24992]: cluster 2024-08-31T06:52:56.622854+0000 mgr.a (mgr.14388) 12182 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:52:58 smithi163 bash[24253]: cluster 2024-08-31T06:52:56.622854+0000 mgr.a (mgr.14388) 12182 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:52:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:52:58 smithi027 bash[22610]: cluster 2024-08-31T06:52:56.622854+0000 mgr.a (mgr.14388) 12182 : cluster [DBG] pgmap v8444: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:00 smithi191 bash[24992]: cluster 2024-08-31T06:52:58.624996+0000 mgr.a (mgr.14388) 12183 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:00 smithi163 bash[24253]: cluster 2024-08-31T06:52:58.624996+0000 mgr.a (mgr.14388) 12183 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:00 smithi027 bash[22610]: cluster 2024-08-31T06:52:58.624996+0000 mgr.a (mgr.14388) 12183 : cluster [DBG] pgmap v8445: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:01.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:01.201 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:01.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:53:01.955 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:53:01.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:53:01.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:53:01.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:53:01.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:53:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:02 smithi163 bash[24253]: cluster 2024-08-31T06:53:00.625780+0000 mgr.a (mgr.14388) 12184 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:02 smithi163 bash[24253]: audit 2024-08-31T06:53:01.531329+0000 mgr.a (mgr.14388) 12185 : audit [DBG] from='client.266961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:02 smithi027 bash[22610]: cluster 2024-08-31T06:53:00.625780+0000 mgr.a (mgr.14388) 12184 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:02 smithi027 bash[22610]: audit 2024-08-31T06:53:01.531329+0000 mgr.a (mgr.14388) 12185 : audit [DBG] from='client.266961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:02 smithi191 bash[24992]: cluster 2024-08-31T06:53:00.625780+0000 mgr.a (mgr.14388) 12184 : cluster [DBG] pgmap v8446: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:02 smithi191 bash[24992]: audit 2024-08-31T06:53:01.531329+0000 mgr.a (mgr.14388) 12185 : audit [DBG] from='client.266961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:04 smithi163 bash[24253]: cluster 2024-08-31T06:53:02.626776+0000 mgr.a (mgr.14388) 12186 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:04.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:04 smithi027 bash[22610]: cluster 2024-08-31T06:53:02.626776+0000 mgr.a (mgr.14388) 12186 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:04 smithi191 bash[24992]: cluster 2024-08-31T06:53:02.626776+0000 mgr.a (mgr.14388) 12186 : cluster [DBG] pgmap v8447: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:06 smithi163 bash[24253]: cluster 2024-08-31T06:53:04.628957+0000 mgr.a (mgr.14388) 12187 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:06 smithi027 bash[22610]: cluster 2024-08-31T06:53:04.628957+0000 mgr.a (mgr.14388) 12187 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:06 smithi191 bash[24992]: cluster 2024-08-31T06:53:04.628957+0000 mgr.a (mgr.14388) 12187 : cluster [DBG] pgmap v8448: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:06.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:06.957 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:06.957 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:53:07.735 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:53:07.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:53:07.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:53:07.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:53:07.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:53:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:08 smithi163 bash[24253]: cluster 2024-08-31T06:53:06.629730+0000 mgr.a (mgr.14388) 12188 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:08.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:08 smithi163 bash[24253]: audit 2024-08-31T06:53:07.296484+0000 mgr.a (mgr.14388) 12189 : audit [DBG] from='client.267039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:08.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:08 smithi027 bash[22610]: cluster 2024-08-31T06:53:06.629730+0000 mgr.a (mgr.14388) 12188 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:08.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:08 smithi027 bash[22610]: audit 2024-08-31T06:53:07.296484+0000 mgr.a (mgr.14388) 12189 : audit [DBG] from='client.267039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:08 smithi191 bash[24992]: cluster 2024-08-31T06:53:06.629730+0000 mgr.a (mgr.14388) 12188 : cluster [DBG] pgmap v8449: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:08 smithi191 bash[24992]: audit 2024-08-31T06:53:07.296484+0000 mgr.a (mgr.14388) 12189 : audit [DBG] from='client.267039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:10 smithi163 bash[24253]: cluster 2024-08-31T06:53:08.632308+0000 mgr.a (mgr.14388) 12190 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:10 smithi027 bash[22610]: cluster 2024-08-31T06:53:08.632308+0000 mgr.a (mgr.14388) 12190 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:10 smithi191 bash[24992]: cluster 2024-08-31T06:53:08.632308+0000 mgr.a (mgr.14388) 12190 : cluster [DBG] pgmap v8450: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:12 smithi163 bash[24253]: cluster 2024-08-31T06:53:10.633278+0000 mgr.a (mgr.14388) 12191 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:12 smithi027 bash[22610]: cluster 2024-08-31T06:53:10.633278+0000 mgr.a (mgr.14388) 12191 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:12.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:12.737 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:12.738 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:53:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:12 smithi191 bash[24992]: cluster 2024-08-31T06:53:10.633278+0000 mgr.a (mgr.14388) 12191 : cluster [DBG] pgmap v8451: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:13.517 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:53:13.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:53:13.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:53:13.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:53:13.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:53:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:14 smithi163 bash[24253]: cluster 2024-08-31T06:53:12.634106+0000 mgr.a (mgr.14388) 12192 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:14 smithi163 bash[24253]: audit 2024-08-31T06:53:13.071312+0000 mgr.a (mgr.14388) 12193 : audit [DBG] from='client.267114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:14 smithi027 bash[22610]: cluster 2024-08-31T06:53:12.634106+0000 mgr.a (mgr.14388) 12192 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:14 smithi027 bash[22610]: audit 2024-08-31T06:53:13.071312+0000 mgr.a (mgr.14388) 12193 : audit [DBG] from='client.267114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:14 smithi191 bash[24992]: cluster 2024-08-31T06:53:12.634106+0000 mgr.a (mgr.14388) 12192 : cluster [DBG] pgmap v8452: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:14 smithi191 bash[24992]: audit 2024-08-31T06:53:13.071312+0000 mgr.a (mgr.14388) 12193 : audit [DBG] from='client.267114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:16 smithi163 bash[24253]: cluster 2024-08-31T06:53:14.636907+0000 mgr.a (mgr.14388) 12194 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:16 smithi027 bash[22610]: cluster 2024-08-31T06:53:14.636907+0000 mgr.a (mgr.14388) 12194 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:16 smithi191 bash[24992]: cluster 2024-08-31T06:53:14.636907+0000 mgr.a (mgr.14388) 12194 : cluster [DBG] pgmap v8453: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:18.520 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:53:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:18 smithi163 bash[24253]: cluster 2024-08-31T06:53:16.637675+0000 mgr.a (mgr.14388) 12195 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:18 smithi027 bash[22610]: cluster 2024-08-31T06:53:16.637675+0000 mgr.a (mgr.14388) 12195 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:18 smithi191 bash[24992]: cluster 2024-08-31T06:53:16.637675+0000 mgr.a (mgr.14388) 12195 : cluster [DBG] pgmap v8454: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:19.302 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:53:19.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:53:19.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:53:19.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:53:19.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:53:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:20 smithi163 bash[24253]: cluster 2024-08-31T06:53:18.638677+0000 mgr.a (mgr.14388) 12196 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:20 smithi163 bash[24253]: audit 2024-08-31T06:53:18.858597+0000 mgr.a (mgr.14388) 12197 : audit [DBG] from='client.267192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:20 smithi027 bash[22610]: cluster 2024-08-31T06:53:18.638677+0000 mgr.a (mgr.14388) 12196 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:20 smithi027 bash[22610]: audit 2024-08-31T06:53:18.858597+0000 mgr.a (mgr.14388) 12197 : audit [DBG] from='client.267192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:20 smithi191 bash[24992]: cluster 2024-08-31T06:53:18.638677+0000 mgr.a (mgr.14388) 12196 : cluster [DBG] pgmap v8455: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:20 smithi191 bash[24992]: audit 2024-08-31T06:53:18.858597+0000 mgr.a (mgr.14388) 12197 : audit [DBG] from='client.267192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:22 smithi163 bash[24253]: cluster 2024-08-31T06:53:20.639560+0000 mgr.a (mgr.14388) 12198 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:22 smithi027 bash[22610]: cluster 2024-08-31T06:53:20.639560+0000 mgr.a (mgr.14388) 12198 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:22 smithi191 bash[24992]: cluster 2024-08-31T06:53:20.639560+0000 mgr.a (mgr.14388) 12198 : cluster [DBG] pgmap v8456: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:24.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:24.305 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:24.305 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:53:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:24 smithi163 bash[24253]: cluster 2024-08-31T06:53:22.640345+0000 mgr.a (mgr.14388) 12199 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:53:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:24 smithi027 bash[22610]: cluster 2024-08-31T06:53:22.640345+0000 mgr.a (mgr.14388) 12199 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:53:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:24 smithi191 bash[24992]: cluster 2024-08-31T06:53:22.640345+0000 mgr.a (mgr.14388) 12199 : cluster [DBG] pgmap v8457: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:53:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:53:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:53:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:53:25.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:53:25.085 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:53:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:26 smithi163 bash[24253]: audit 2024-08-31T06:53:24.640319+0000 mgr.a (mgr.14388) 12200 : audit [DBG] from='client.267267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:26 smithi163 bash[24253]: cluster 2024-08-31T06:53:24.659082+0000 mgr.a (mgr.14388) 12201 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:26 smithi027 bash[22610]: audit 2024-08-31T06:53:24.640319+0000 mgr.a (mgr.14388) 12200 : audit [DBG] from='client.267267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:26.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:26 smithi027 bash[22610]: cluster 2024-08-31T06:53:24.659082+0000 mgr.a (mgr.14388) 12201 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:26 smithi191 bash[24992]: audit 2024-08-31T06:53:24.640319+0000 mgr.a (mgr.14388) 12200 : audit [DBG] from='client.267267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:26 smithi191 bash[24992]: cluster 2024-08-31T06:53:24.659082+0000 mgr.a (mgr.14388) 12201 : cluster [DBG] pgmap v8458: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:28 smithi163 bash[24253]: cluster 2024-08-31T06:53:26.660102+0000 mgr.a (mgr.14388) 12202 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:28 smithi027 bash[22610]: cluster 2024-08-31T06:53:26.660102+0000 mgr.a (mgr.14388) 12202 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:28 smithi191 bash[24992]: cluster 2024-08-31T06:53:26.660102+0000 mgr.a (mgr.14388) 12202 : cluster [DBG] pgmap v8459: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:30.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:30.086 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:30.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:53:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:30 smithi163 bash[24253]: cluster 2024-08-31T06:53:28.662279+0000 mgr.a (mgr.14388) 12203 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:30 smithi027 bash[22610]: cluster 2024-08-31T06:53:28.662279+0000 mgr.a (mgr.14388) 12203 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:30 smithi191 bash[24992]: cluster 2024-08-31T06:53:28.662279+0000 mgr.a (mgr.14388) 12203 : cluster [DBG] pgmap v8460: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:30.829 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:53:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:53:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:53:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:53:30.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:53:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:31 smithi163 bash[24253]: audit 2024-08-31T06:53:30.414932+0000 mgr.a (mgr.14388) 12204 : audit [DBG] from='client.267345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:31 smithi027 bash[22610]: audit 2024-08-31T06:53:30.414932+0000 mgr.a (mgr.14388) 12204 : audit [DBG] from='client.267345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:31 smithi191 bash[24992]: audit 2024-08-31T06:53:30.414932+0000 mgr.a (mgr.14388) 12204 : audit [DBG] from='client.267345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:32 smithi163 bash[24253]: cluster 2024-08-31T06:53:30.662904+0000 mgr.a (mgr.14388) 12205 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:32 smithi027 bash[22610]: cluster 2024-08-31T06:53:30.662904+0000 mgr.a (mgr.14388) 12205 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:32 smithi191 bash[24992]: cluster 2024-08-31T06:53:30.662904+0000 mgr.a (mgr.14388) 12205 : cluster [DBG] pgmap v8461: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:34 smithi163 bash[24253]: cluster 2024-08-31T06:53:32.663720+0000 mgr.a (mgr.14388) 12206 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:34 smithi027 bash[22610]: cluster 2024-08-31T06:53:32.663720+0000 mgr.a (mgr.14388) 12206 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:34 smithi191 bash[24992]: cluster 2024-08-31T06:53:32.663720+0000 mgr.a (mgr.14388) 12206 : cluster [DBG] pgmap v8462: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:35 smithi163 bash[24253]: audit 2024-08-31T06:53:35.013021+0000 mon.a (mon.0) 2404 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:53:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:35 smithi027 bash[22610]: audit 2024-08-31T06:53:35.013021+0000 mon.a (mon.0) 2404 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:53:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:35 smithi191 bash[24992]: audit 2024-08-31T06:53:35.013021+0000 mon.a (mon.0) 2404 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:53:35.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:35.831 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:35.832 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:53:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:36 smithi163 bash[24253]: cluster 2024-08-31T06:53:34.666007+0000 mgr.a (mgr.14388) 12207 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:36 smithi163 bash[24253]: audit 2024-08-31T06:53:35.864822+0000 mon.a (mon.0) 2405 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:53:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:36 smithi163 bash[24253]: audit 2024-08-31T06:53:35.866267+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:53:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:36 smithi163 bash[24253]: audit 2024-08-31T06:53:35.874201+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:53:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:36 smithi163 bash[24253]: audit 2024-08-31T06:53:35.877153+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:53:36.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:53:36 smithi027 bash[22863]: debug 2024-08-31T06:53:36.607+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:53:36.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:53:36 smithi027 bash[22863]: debug 2024-08-31T06:53:36.619+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:53:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:36 smithi027 bash[22610]: cluster 2024-08-31T06:53:34.666007+0000 mgr.a (mgr.14388) 12207 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:36 smithi027 bash[22610]: audit 2024-08-31T06:53:35.864822+0000 mon.a (mon.0) 2405 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:53:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:36 smithi027 bash[22610]: audit 2024-08-31T06:53:35.866267+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:53:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:36 smithi027 bash[22610]: audit 2024-08-31T06:53:35.874201+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:53:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:36 smithi027 bash[22610]: audit 2024-08-31T06:53:35.877153+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:53:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:36 smithi191 bash[24992]: cluster 2024-08-31T06:53:34.666007+0000 mgr.a (mgr.14388) 12207 : cluster [DBG] pgmap v8463: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:53:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:36 smithi191 bash[24992]: audit 2024-08-31T06:53:35.864822+0000 mon.a (mon.0) 2405 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:53:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:36 smithi191 bash[24992]: audit 2024-08-31T06:53:35.866267+0000 mon.a (mon.0) 2406 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:53:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:36 smithi191 bash[24992]: audit 2024-08-31T06:53:35.874201+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:53:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:36 smithi191 bash[24992]: audit 2024-08-31T06:53:35.877153+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:53:37.033 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:53:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:53:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:53:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:53:37.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:53:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:37 smithi163 bash[24253]: audit 2024-08-31T06:53:35.878193+0000 mgr.a (mgr.14388) 12208 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:53:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:37 smithi163 bash[24253]: audit 2024-08-31T06:53:36.174070+0000 mgr.a (mgr.14388) 12209 : audit [DBG] from='client.267423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:37 smithi027 bash[22610]: audit 2024-08-31T06:53:35.878193+0000 mgr.a (mgr.14388) 12208 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:53:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:37 smithi027 bash[22610]: audit 2024-08-31T06:53:36.174070+0000 mgr.a (mgr.14388) 12209 : audit [DBG] from='client.267423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:37 smithi191 bash[24992]: audit 2024-08-31T06:53:35.878193+0000 mgr.a (mgr.14388) 12208 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:53:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:37 smithi191 bash[24992]: audit 2024-08-31T06:53:36.174070+0000 mgr.a (mgr.14388) 12209 : audit [DBG] from='client.267423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:38 smithi163 bash[24253]: audit 2024-08-31T06:53:36.613386+0000 mgr.a (mgr.14388) 12210 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:53:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:38 smithi163 bash[24253]: cephadm 2024-08-31T06:53:36.625942+0000 mgr.a (mgr.14388) 12211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:53:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:38 smithi163 bash[24253]: cluster 2024-08-31T06:53:36.666589+0000 mgr.a (mgr.14388) 12212 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:38 smithi027 bash[22610]: audit 2024-08-31T06:53:36.613386+0000 mgr.a (mgr.14388) 12210 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:53:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:38 smithi027 bash[22610]: cephadm 2024-08-31T06:53:36.625942+0000 mgr.a (mgr.14388) 12211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:53:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:38 smithi027 bash[22610]: cluster 2024-08-31T06:53:36.666589+0000 mgr.a (mgr.14388) 12212 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:38 smithi191 bash[24992]: audit 2024-08-31T06:53:36.613386+0000 mgr.a (mgr.14388) 12210 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:53:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:38 smithi191 bash[24992]: cephadm 2024-08-31T06:53:36.625942+0000 mgr.a (mgr.14388) 12211 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:53:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:38 smithi191 bash[24992]: cluster 2024-08-31T06:53:36.666589+0000 mgr.a (mgr.14388) 12212 : cluster [DBG] pgmap v8464: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:40 smithi163 bash[24253]: cluster 2024-08-31T06:53:38.668835+0000 mgr.a (mgr.14388) 12213 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:40 smithi027 bash[22610]: cluster 2024-08-31T06:53:38.668835+0000 mgr.a (mgr.14388) 12213 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:40.793 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:40 smithi191 bash[24992]: cluster 2024-08-31T06:53:38.668835+0000 mgr.a (mgr.14388) 12213 : cluster [DBG] pgmap v8465: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:42.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:42.036 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:42.036 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:53:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:42 smithi163 bash[24253]: cluster 2024-08-31T06:53:40.669619+0000 mgr.a (mgr.14388) 12214 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:42 smithi027 bash[22610]: cluster 2024-08-31T06:53:40.669619+0000 mgr.a (mgr.14388) 12214 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:42 smithi191 bash[24992]: cluster 2024-08-31T06:53:40.669619+0000 mgr.a (mgr.14388) 12214 : cluster [DBG] pgmap v8466: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:42.816 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:53:42.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:53:42.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:53:42.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:53:42.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:53:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:43 smithi163 bash[24253]: audit 2024-08-31T06:53:42.371569+0000 mgr.a (mgr.14388) 12215 : audit [DBG] from='client.267609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:43 smithi027 bash[22610]: audit 2024-08-31T06:53:42.371569+0000 mgr.a (mgr.14388) 12215 : audit [DBG] from='client.267609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:43 smithi191 bash[24992]: audit 2024-08-31T06:53:42.371569+0000 mgr.a (mgr.14388) 12215 : audit [DBG] from='client.267609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:44 smithi163 bash[24253]: cluster 2024-08-31T06:53:42.670175+0000 mgr.a (mgr.14388) 12216 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:44 smithi027 bash[22610]: cluster 2024-08-31T06:53:42.670175+0000 mgr.a (mgr.14388) 12216 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:44 smithi191 bash[24992]: cluster 2024-08-31T06:53:42.670175+0000 mgr.a (mgr.14388) 12216 : cluster [DBG] pgmap v8467: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:46 smithi163 bash[24253]: cluster 2024-08-31T06:53:44.672485+0000 mgr.a (mgr.14388) 12217 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:46 smithi027 bash[22610]: cluster 2024-08-31T06:53:44.672485+0000 mgr.a (mgr.14388) 12217 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:46 smithi191 bash[24992]: cluster 2024-08-31T06:53:44.672485+0000 mgr.a (mgr.14388) 12217 : cluster [DBG] pgmap v8468: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:47.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:47.819 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:47.819 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:53:48.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:53:48.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:53:48.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:53:48.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:53:48.605 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:53:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:48 smithi163 bash[24253]: cluster 2024-08-31T06:53:46.673278+0000 mgr.a (mgr.14388) 12218 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:48 smithi027 bash[22610]: cluster 2024-08-31T06:53:46.673278+0000 mgr.a (mgr.14388) 12218 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:48 smithi191 bash[24992]: cluster 2024-08-31T06:53:46.673278+0000 mgr.a (mgr.14388) 12218 : cluster [DBG] pgmap v8469: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:49 smithi163 bash[24253]: audit 2024-08-31T06:53:48.157205+0000 mgr.a (mgr.14388) 12219 : audit [DBG] from='client.267687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:49 smithi027 bash[22610]: audit 2024-08-31T06:53:48.157205+0000 mgr.a (mgr.14388) 12219 : audit [DBG] from='client.267687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:49 smithi191 bash[24992]: audit 2024-08-31T06:53:48.157205+0000 mgr.a (mgr.14388) 12219 : audit [DBG] from='client.267687 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:50 smithi163 bash[24253]: cluster 2024-08-31T06:53:48.676090+0000 mgr.a (mgr.14388) 12220 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:50 smithi027 bash[22610]: cluster 2024-08-31T06:53:48.676090+0000 mgr.a (mgr.14388) 12220 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:50 smithi191 bash[24992]: cluster 2024-08-31T06:53:48.676090+0000 mgr.a (mgr.14388) 12220 : cluster [DBG] pgmap v8470: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:53:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:52 smithi163 bash[24253]: cluster 2024-08-31T06:53:50.676898+0000 mgr.a (mgr.14388) 12221 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:52 smithi027 bash[22610]: cluster 2024-08-31T06:53:50.676898+0000 mgr.a (mgr.14388) 12221 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:52 smithi191 bash[24992]: cluster 2024-08-31T06:53:50.676898+0000 mgr.a (mgr.14388) 12221 : cluster [DBG] pgmap v8471: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:53.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:53.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:53.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:53:54.357 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:53:54.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:53:54.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:53:54.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:53:54.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:53:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:54 smithi163 bash[24253]: cluster 2024-08-31T06:53:52.677682+0000 mgr.a (mgr.14388) 12222 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:53:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:54 smithi027 bash[22610]: cluster 2024-08-31T06:53:52.677682+0000 mgr.a (mgr.14388) 12222 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:53:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:54 smithi191 bash[24992]: cluster 2024-08-31T06:53:52.677682+0000 mgr.a (mgr.14388) 12222 : cluster [DBG] pgmap v8472: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:53:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:55 smithi027 bash[22610]: audit 2024-08-31T06:53:53.939761+0000 mgr.a (mgr.14388) 12223 : audit [DBG] from='client.267765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:55 smithi191 bash[24992]: audit 2024-08-31T06:53:53.939761+0000 mgr.a (mgr.14388) 12223 : audit [DBG] from='client.267765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:55 smithi163 bash[24253]: audit 2024-08-31T06:53:53.939761+0000 mgr.a (mgr.14388) 12223 : audit [DBG] from='client.267765 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:53:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:56 smithi027 bash[22610]: cluster 2024-08-31T06:53:54.680557+0000 mgr.a (mgr.14388) 12224 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:56 smithi191 bash[24992]: cluster 2024-08-31T06:53:54.680557+0000 mgr.a (mgr.14388) 12224 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:56 smithi163 bash[24253]: cluster 2024-08-31T06:53:54.680557+0000 mgr.a (mgr.14388) 12224 : cluster [DBG] pgmap v8473: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:53:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:53:58 smithi027 bash[22610]: cluster 2024-08-31T06:53:56.681364+0000 mgr.a (mgr.14388) 12225 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:53:58 smithi191 bash[24992]: cluster 2024-08-31T06:53:56.681364+0000 mgr.a (mgr.14388) 12225 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:53:58 smithi163 bash[24253]: cluster 2024-08-31T06:53:56.681364+0000 mgr.a (mgr.14388) 12225 : cluster [DBG] pgmap v8474: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:53:59.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:53:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:53:59.360 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:00.112 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:00.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:00.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:00.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:00.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:00 smithi027 bash[22610]: cluster 2024-08-31T06:53:58.683359+0000 mgr.a (mgr.14388) 12226 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:00 smithi191 bash[24992]: cluster 2024-08-31T06:53:58.683359+0000 mgr.a (mgr.14388) 12226 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:00 smithi163 bash[24253]: cluster 2024-08-31T06:53:58.683359+0000 mgr.a (mgr.14388) 12226 : cluster [DBG] pgmap v8475: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:01 smithi027 bash[22610]: audit 2024-08-31T06:53:59.692863+0000 mgr.a (mgr.14388) 12227 : audit [DBG] from='client.267843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:01 smithi191 bash[24992]: audit 2024-08-31T06:53:59.692863+0000 mgr.a (mgr.14388) 12227 : audit [DBG] from='client.267843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:01 smithi163 bash[24253]: audit 2024-08-31T06:53:59.692863+0000 mgr.a (mgr.14388) 12227 : audit [DBG] from='client.267843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:02 smithi027 bash[22610]: cluster 2024-08-31T06:54:00.684239+0000 mgr.a (mgr.14388) 12228 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:02 smithi191 bash[24992]: cluster 2024-08-31T06:54:00.684239+0000 mgr.a (mgr.14388) 12228 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:02 smithi163 bash[24253]: cluster 2024-08-31T06:54:00.684239+0000 mgr.a (mgr.14388) 12228 : cluster [DBG] pgmap v8476: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:04 smithi191 bash[24992]: cluster 2024-08-31T06:54:02.685033+0000 mgr.a (mgr.14388) 12229 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:04 smithi163 bash[24253]: cluster 2024-08-31T06:54:02.685033+0000 mgr.a (mgr.14388) 12229 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:04 smithi027 bash[22610]: cluster 2024-08-31T06:54:02.685033+0000 mgr.a (mgr.14388) 12229 : cluster [DBG] pgmap v8477: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:05.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:54:05.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:54:05.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:05.894 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:05.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:05.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:05.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:05.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:06 smithi191 bash[24992]: cluster 2024-08-31T06:54:04.687258+0000 mgr.a (mgr.14388) 12230 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:06 smithi191 bash[24992]: audit 2024-08-31T06:54:05.450846+0000 mgr.a (mgr.14388) 12231 : audit [DBG] from='client.267921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:06 smithi163 bash[24253]: cluster 2024-08-31T06:54:04.687258+0000 mgr.a (mgr.14388) 12230 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:06 smithi163 bash[24253]: audit 2024-08-31T06:54:05.450846+0000 mgr.a (mgr.14388) 12231 : audit [DBG] from='client.267921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:06 smithi027 bash[22610]: cluster 2024-08-31T06:54:04.687258+0000 mgr.a (mgr.14388) 12230 : cluster [DBG] pgmap v8478: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:06 smithi027 bash[22610]: audit 2024-08-31T06:54:05.450846+0000 mgr.a (mgr.14388) 12231 : audit [DBG] from='client.267921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:08 smithi191 bash[24992]: cluster 2024-08-31T06:54:06.688293+0000 mgr.a (mgr.14388) 12232 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:08.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:08 smithi163 bash[24253]: cluster 2024-08-31T06:54:06.688293+0000 mgr.a (mgr.14388) 12232 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:08 smithi027 bash[22610]: cluster 2024-08-31T06:54:06.688293+0000 mgr.a (mgr.14388) 12232 : cluster [DBG] pgmap v8479: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:10 smithi191 bash[24992]: cluster 2024-08-31T06:54:08.690620+0000 mgr.a (mgr.14388) 12233 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:10.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:54:10.896 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:54:10.896 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:10 smithi163 bash[24253]: cluster 2024-08-31T06:54:08.690620+0000 mgr.a (mgr.14388) 12233 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:10 smithi027 bash[22610]: cluster 2024-08-31T06:54:08.690620+0000 mgr.a (mgr.14388) 12233 : cluster [DBG] pgmap v8480: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:11.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:11.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:11.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:11.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:11.679 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:12 smithi191 bash[24992]: cluster 2024-08-31T06:54:10.691574+0000 mgr.a (mgr.14388) 12234 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:12 smithi191 bash[24992]: audit 2024-08-31T06:54:11.235237+0000 mgr.a (mgr.14388) 12235 : audit [DBG] from='client.267999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:12 smithi163 bash[24253]: cluster 2024-08-31T06:54:10.691574+0000 mgr.a (mgr.14388) 12234 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:12 smithi163 bash[24253]: audit 2024-08-31T06:54:11.235237+0000 mgr.a (mgr.14388) 12235 : audit [DBG] from='client.267999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:12 smithi027 bash[22610]: cluster 2024-08-31T06:54:10.691574+0000 mgr.a (mgr.14388) 12234 : cluster [DBG] pgmap v8481: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:12 smithi027 bash[22610]: audit 2024-08-31T06:54:11.235237+0000 mgr.a (mgr.14388) 12235 : audit [DBG] from='client.267999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:14 smithi191 bash[24992]: cluster 2024-08-31T06:54:12.692515+0000 mgr.a (mgr.14388) 12236 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:14 smithi163 bash[24253]: cluster 2024-08-31T06:54:12.692515+0000 mgr.a (mgr.14388) 12236 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:14 smithi027 bash[22610]: cluster 2024-08-31T06:54:12.692515+0000 mgr.a (mgr.14388) 12236 : cluster [DBG] pgmap v8482: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:16.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:54:16.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:54:16.682 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:16 smithi191 bash[24992]: cluster 2024-08-31T06:54:14.694772+0000 mgr.a (mgr.14388) 12237 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:16 smithi163 bash[24253]: cluster 2024-08-31T06:54:14.694772+0000 mgr.a (mgr.14388) 12237 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:16 smithi027 bash[22610]: cluster 2024-08-31T06:54:14.694772+0000 mgr.a (mgr.14388) 12237 : cluster [DBG] pgmap v8483: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:17.436 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:17.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:17.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:17.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:17.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:18 smithi191 bash[24992]: cluster 2024-08-31T06:54:16.695357+0000 mgr.a (mgr.14388) 12238 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:18 smithi191 bash[24992]: audit 2024-08-31T06:54:17.011432+0000 mgr.a (mgr.14388) 12239 : audit [DBG] from='client.268077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:18 smithi163 bash[24253]: cluster 2024-08-31T06:54:16.695357+0000 mgr.a (mgr.14388) 12238 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:18 smithi163 bash[24253]: audit 2024-08-31T06:54:17.011432+0000 mgr.a (mgr.14388) 12239 : audit [DBG] from='client.268077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:18 smithi027 bash[22610]: cluster 2024-08-31T06:54:16.695357+0000 mgr.a (mgr.14388) 12238 : cluster [DBG] pgmap v8484: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:18 smithi027 bash[22610]: audit 2024-08-31T06:54:17.011432+0000 mgr.a (mgr.14388) 12239 : audit [DBG] from='client.268077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:20 smithi191 bash[24992]: cluster 2024-08-31T06:54:18.697743+0000 mgr.a (mgr.14388) 12240 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:20 smithi163 bash[24253]: cluster 2024-08-31T06:54:18.697743+0000 mgr.a (mgr.14388) 12240 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:20 smithi027 bash[22610]: cluster 2024-08-31T06:54:18.697743+0000 mgr.a (mgr.14388) 12240 : cluster [DBG] pgmap v8485: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:54:22.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:54:22.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:54:22.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:22 smithi191 bash[24992]: cluster 2024-08-31T06:54:20.698563+0000 mgr.a (mgr.14388) 12241 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:22 smithi163 bash[24253]: cluster 2024-08-31T06:54:20.698563+0000 mgr.a (mgr.14388) 12241 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:22 smithi027 bash[22610]: cluster 2024-08-31T06:54:20.698563+0000 mgr.a (mgr.14388) 12241 : cluster [DBG] pgmap v8486: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:23.196 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:23.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:23.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:23.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:23.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:24 smithi191 bash[24992]: cluster 2024-08-31T06:54:22.699415+0000 mgr.a (mgr.14388) 12242 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:24 smithi191 bash[24992]: audit 2024-08-31T06:54:22.774124+0000 mgr.a (mgr.14388) 12243 : audit [DBG] from='client.268155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:24.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:24 smithi163 bash[24253]: cluster 2024-08-31T06:54:22.699415+0000 mgr.a (mgr.14388) 12242 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:24.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:24 smithi163 bash[24253]: audit 2024-08-31T06:54:22.774124+0000 mgr.a (mgr.14388) 12243 : audit [DBG] from='client.268155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:24 smithi027 bash[22610]: cluster 2024-08-31T06:54:22.699415+0000 mgr.a (mgr.14388) 12242 : cluster [DBG] pgmap v8487: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:24.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:24 smithi027 bash[22610]: audit 2024-08-31T06:54:22.774124+0000 mgr.a (mgr.14388) 12243 : audit [DBG] from='client.268155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:26.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:26 smithi191 bash[24992]: cluster 2024-08-31T06:54:24.701776+0000 mgr.a (mgr.14388) 12244 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:54:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:26 smithi163 bash[24253]: cluster 2024-08-31T06:54:24.701776+0000 mgr.a (mgr.14388) 12244 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:54:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:26 smithi027 bash[22610]: cluster 2024-08-31T06:54:24.701776+0000 mgr.a (mgr.14388) 12244 : cluster [DBG] pgmap v8488: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T06:54:28.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:54:28.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:54:28.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:28 smithi163 bash[24253]: cluster 2024-08-31T06:54:26.702541+0000 mgr.a (mgr.14388) 12245 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:54:28.957 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:28.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:28.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:28.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:28.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:28 smithi027 bash[22610]: cluster 2024-08-31T06:54:26.702541+0000 mgr.a (mgr.14388) 12245 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:54:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:28 smithi191 bash[24992]: cluster 2024-08-31T06:54:26.702541+0000 mgr.a (mgr.14388) 12245 : cluster [DBG] pgmap v8489: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T06:54:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:29 smithi163 bash[24253]: audit 2024-08-31T06:54:28.531754+0000 mgr.a (mgr.14388) 12246 : audit [DBG] from='client.268233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:29 smithi027 bash[22610]: audit 2024-08-31T06:54:28.531754+0000 mgr.a (mgr.14388) 12246 : audit [DBG] from='client.268233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:29 smithi191 bash[24992]: audit 2024-08-31T06:54:28.531754+0000 mgr.a (mgr.14388) 12246 : audit [DBG] from='client.268233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:30 smithi163 bash[24253]: cluster 2024-08-31T06:54:28.704059+0000 mgr.a (mgr.14388) 12247 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:30 smithi027 bash[22610]: cluster 2024-08-31T06:54:28.704059+0000 mgr.a (mgr.14388) 12247 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:30 smithi191 bash[24992]: cluster 2024-08-31T06:54:28.704059+0000 mgr.a (mgr.14388) 12247 : cluster [DBG] pgmap v8490: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:32 smithi163 bash[24253]: cluster 2024-08-31T06:54:30.704912+0000 mgr.a (mgr.14388) 12248 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:54:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:32 smithi027 bash[22610]: cluster 2024-08-31T06:54:30.704912+0000 mgr.a (mgr.14388) 12248 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:54:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:32 smithi191 bash[24992]: cluster 2024-08-31T06:54:30.704912+0000 mgr.a (mgr.14388) 12248 : cluster [DBG] pgmap v8491: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:54:33.959 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:54:33.960 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:54:33.960 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:34.712 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:34.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:34.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:34.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:34.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:34 smithi163 bash[24253]: cluster 2024-08-31T06:54:32.705676+0000 mgr.a (mgr.14388) 12249 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:54:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:34 smithi027 bash[22610]: cluster 2024-08-31T06:54:32.705676+0000 mgr.a (mgr.14388) 12249 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:54:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:34 smithi191 bash[24992]: cluster 2024-08-31T06:54:32.705676+0000 mgr.a (mgr.14388) 12249 : cluster [DBG] pgmap v8492: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:54:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:35 smithi163 bash[24253]: audit 2024-08-31T06:54:34.291474+0000 mgr.a (mgr.14388) 12250 : audit [DBG] from='client.268308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:35 smithi027 bash[22610]: audit 2024-08-31T06:54:34.291474+0000 mgr.a (mgr.14388) 12250 : audit [DBG] from='client.268308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:35 smithi191 bash[24992]: audit 2024-08-31T06:54:34.291474+0000 mgr.a (mgr.14388) 12250 : audit [DBG] from='client.268308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:36 smithi163 bash[24253]: cluster 2024-08-31T06:54:34.706896+0000 mgr.a (mgr.14388) 12251 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:36.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:36 smithi027 bash[22610]: cluster 2024-08-31T06:54:34.706896+0000 mgr.a (mgr.14388) 12251 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:36 smithi191 bash[24992]: cluster 2024-08-31T06:54:34.706896+0000 mgr.a (mgr.14388) 12251 : cluster [DBG] pgmap v8493: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:37 smithi163 bash[24253]: audit 2024-08-31T06:54:36.684017+0000 mon.a (mon.0) 2409 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:54:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:37 smithi163 bash[24253]: audit 2024-08-31T06:54:37.532437+0000 mon.a (mon.0) 2410 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:54:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:37 smithi163 bash[24253]: audit 2024-08-31T06:54:37.534259+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:54:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:37 smithi163 bash[24253]: audit 2024-08-31T06:54:37.544030+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:54:37.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:37 smithi163 bash[24253]: audit 2024-08-31T06:54:37.549030+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:54:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:37 smithi027 bash[22610]: audit 2024-08-31T06:54:36.684017+0000 mon.a (mon.0) 2409 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:54:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:37 smithi027 bash[22610]: audit 2024-08-31T06:54:37.532437+0000 mon.a (mon.0) 2410 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:54:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:37 smithi027 bash[22610]: audit 2024-08-31T06:54:37.534259+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:54:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:37 smithi027 bash[22610]: audit 2024-08-31T06:54:37.544030+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:54:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:37 smithi027 bash[22610]: audit 2024-08-31T06:54:37.549030+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:54:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:37 smithi191 bash[24992]: audit 2024-08-31T06:54:36.684017+0000 mon.a (mon.0) 2409 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:54:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:37 smithi191 bash[24992]: audit 2024-08-31T06:54:37.532437+0000 mon.a (mon.0) 2410 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:54:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:37 smithi191 bash[24992]: audit 2024-08-31T06:54:37.534259+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:54:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:37 smithi191 bash[24992]: audit 2024-08-31T06:54:37.544030+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:54:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:37 smithi191 bash[24992]: audit 2024-08-31T06:54:37.549030+0000 mon.a (mon.0) 2413 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:54:38.580 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:54:38 smithi027 bash[22863]: debug 2024-08-31T06:54:38.298+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:54:38.580 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:54:38 smithi027 bash[22863]: debug 2024-08-31T06:54:38.298+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:54:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:38 smithi163 bash[24253]: cluster 2024-08-31T06:54:36.707370+0000 mgr.a (mgr.14388) 12252 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:54:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:38 smithi163 bash[24253]: audit 2024-08-31T06:54:37.551422+0000 mgr.a (mgr.14388) 12253 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:54:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:38 smithi027 bash[22610]: cluster 2024-08-31T06:54:36.707370+0000 mgr.a (mgr.14388) 12252 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:54:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:38 smithi027 bash[22610]: audit 2024-08-31T06:54:37.551422+0000 mgr.a (mgr.14388) 12253 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:54:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:38 smithi191 bash[24992]: cluster 2024-08-31T06:54:36.707370+0000 mgr.a (mgr.14388) 12252 : cluster [DBG] pgmap v8494: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T06:54:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:38 smithi191 bash[24992]: audit 2024-08-31T06:54:37.551422+0000 mgr.a (mgr.14388) 12253 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:54:39.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:54:39.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:54:39.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:39 smithi163 bash[24253]: audit 2024-08-31T06:54:38.300103+0000 mgr.a (mgr.14388) 12254 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:54:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:39 smithi163 bash[24253]: cephadm 2024-08-31T06:54:38.301616+0000 mgr.a (mgr.14388) 12255 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:54:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:39 smithi027 bash[22610]: audit 2024-08-31T06:54:38.300103+0000 mgr.a (mgr.14388) 12254 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:54:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:39 smithi027 bash[22610]: cephadm 2024-08-31T06:54:38.301616+0000 mgr.a (mgr.14388) 12255 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:54:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:39 smithi191 bash[24992]: audit 2024-08-31T06:54:38.300103+0000 mgr.a (mgr.14388) 12254 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:54:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:39 smithi191 bash[24992]: cephadm 2024-08-31T06:54:38.301616+0000 mgr.a (mgr.14388) 12255 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:54:40.486 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:40.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:40.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:40.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:40.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:40 smithi163 bash[24253]: cluster 2024-08-31T06:54:38.709728+0000 mgr.a (mgr.14388) 12256 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:54:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:40 smithi027 bash[22610]: cluster 2024-08-31T06:54:38.709728+0000 mgr.a (mgr.14388) 12256 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:54:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:40 smithi191 bash[24992]: cluster 2024-08-31T06:54:38.709728+0000 mgr.a (mgr.14388) 12256 : cluster [DBG] pgmap v8495: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:54:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:41 smithi163 bash[24253]: audit 2024-08-31T06:54:40.049601+0000 mgr.a (mgr.14388) 12257 : audit [DBG] from='client.268494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:41 smithi027 bash[22610]: audit 2024-08-31T06:54:40.049601+0000 mgr.a (mgr.14388) 12257 : audit [DBG] from='client.268494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:41 smithi191 bash[24992]: audit 2024-08-31T06:54:40.049601+0000 mgr.a (mgr.14388) 12257 : audit [DBG] from='client.268494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:42 smithi163 bash[24253]: cluster 2024-08-31T06:54:40.710699+0000 mgr.a (mgr.14388) 12258 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:54:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:42 smithi027 bash[22610]: cluster 2024-08-31T06:54:40.710699+0000 mgr.a (mgr.14388) 12258 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:54:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:42 smithi191 bash[24992]: cluster 2024-08-31T06:54:40.710699+0000 mgr.a (mgr.14388) 12258 : cluster [DBG] pgmap v8496: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:54:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:44 smithi163 bash[24253]: cluster 2024-08-31T06:54:42.711445+0000 mgr.a (mgr.14388) 12259 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:54:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:44 smithi027 bash[22610]: cluster 2024-08-31T06:54:42.711445+0000 mgr.a (mgr.14388) 12259 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:54:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:44 smithi191 bash[24992]: cluster 2024-08-31T06:54:42.711445+0000 mgr.a (mgr.14388) 12259 : cluster [DBG] pgmap v8497: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T06:54:45.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:54:45.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:54:45.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:46.232 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:46.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:46.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:46.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:46.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:46 smithi163 bash[24253]: cluster 2024-08-31T06:54:44.713659+0000 mgr.a (mgr.14388) 12260 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:54:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:46 smithi027 bash[22610]: cluster 2024-08-31T06:54:44.713659+0000 mgr.a (mgr.14388) 12260 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:54:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:46 smithi191 bash[24992]: cluster 2024-08-31T06:54:44.713659+0000 mgr.a (mgr.14388) 12260 : cluster [DBG] pgmap v8498: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:54:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:47 smithi163 bash[24253]: audit 2024-08-31T06:54:45.818081+0000 mgr.a (mgr.14388) 12261 : audit [DBG] from='client.268572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:47 smithi027 bash[22610]: audit 2024-08-31T06:54:45.818081+0000 mgr.a (mgr.14388) 12261 : audit [DBG] from='client.268572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:47 smithi191 bash[24992]: audit 2024-08-31T06:54:45.818081+0000 mgr.a (mgr.14388) 12261 : audit [DBG] from='client.268572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:48 smithi163 bash[24253]: cluster 2024-08-31T06:54:46.714692+0000 mgr.a (mgr.14388) 12262 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:54:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:48 smithi027 bash[22610]: cluster 2024-08-31T06:54:46.714692+0000 mgr.a (mgr.14388) 12262 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:54:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:48 smithi191 bash[24992]: cluster 2024-08-31T06:54:46.714692+0000 mgr.a (mgr.14388) 12262 : cluster [DBG] pgmap v8499: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:54:50.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:50 smithi163 bash[24253]: cluster 2024-08-31T06:54:48.717064+0000 mgr.a (mgr.14388) 12263 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:54:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:50 smithi027 bash[22610]: cluster 2024-08-31T06:54:48.717064+0000 mgr.a (mgr.14388) 12263 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:54:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:50 smithi191 bash[24992]: cluster 2024-08-31T06:54:48.717064+0000 mgr.a (mgr.14388) 12263 : cluster [DBG] pgmap v8500: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:54:51.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:54:51.235 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:54:51.235 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:52.014 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:52 smithi163 bash[24253]: cluster 2024-08-31T06:54:50.717999+0000 mgr.a (mgr.14388) 12264 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T06:54:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:52 smithi163 bash[24253]: audit 2024-08-31T06:54:51.570171+0000 mgr.a (mgr.14388) 12265 : audit [DBG] from='client.268650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:52 smithi027 bash[22610]: cluster 2024-08-31T06:54:50.717999+0000 mgr.a (mgr.14388) 12264 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T06:54:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:52 smithi027 bash[22610]: audit 2024-08-31T06:54:51.570171+0000 mgr.a (mgr.14388) 12265 : audit [DBG] from='client.268650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:52 smithi191 bash[24992]: cluster 2024-08-31T06:54:50.717999+0000 mgr.a (mgr.14388) 12264 : cluster [DBG] pgmap v8501: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T06:54:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:52 smithi191 bash[24992]: audit 2024-08-31T06:54:51.570171+0000 mgr.a (mgr.14388) 12265 : audit [DBG] from='client.268650 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:53 smithi163 bash[24253]: cluster 2024-08-31T06:54:52.718957+0000 mgr.a (mgr.14388) 12266 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T06:54:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:53 smithi027 bash[22610]: cluster 2024-08-31T06:54:52.718957+0000 mgr.a (mgr.14388) 12266 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T06:54:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:53 smithi191 bash[24992]: cluster 2024-08-31T06:54:52.718957+0000 mgr.a (mgr.14388) 12266 : cluster [DBG] pgmap v8502: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T06:54:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:55 smithi191 bash[24992]: cluster 2024-08-31T06:54:54.721244+0000 mgr.a (mgr.14388) 12267 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:54:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:55 smithi163 bash[24253]: cluster 2024-08-31T06:54:54.721244+0000 mgr.a (mgr.14388) 12267 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:54:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:55 smithi027 bash[22610]: cluster 2024-08-31T06:54:54.721244+0000 mgr.a (mgr.14388) 12267 : cluster [DBG] pgmap v8503: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T06:54:57.016 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:54:57.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:54:57.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:54:57.784 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:54:57.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:54:57.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:54:57.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:54:57.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:54:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:57 smithi191 bash[24992]: cluster 2024-08-31T06:54:56.722018+0000 mgr.a (mgr.14388) 12268 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:57 smithi191 bash[24992]: audit 2024-08-31T06:54:57.349837+0000 mgr.a (mgr.14388) 12269 : audit [DBG] from='client.268728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:57 smithi163 bash[24253]: cluster 2024-08-31T06:54:56.722018+0000 mgr.a (mgr.14388) 12268 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:57 smithi163 bash[24253]: audit 2024-08-31T06:54:57.349837+0000 mgr.a (mgr.14388) 12269 : audit [DBG] from='client.268728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:54:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:57 smithi027 bash[22610]: cluster 2024-08-31T06:54:56.722018+0000 mgr.a (mgr.14388) 12268 : cluster [DBG] pgmap v8504: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:54:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:57 smithi027 bash[22610]: audit 2024-08-31T06:54:57.349837+0000 mgr.a (mgr.14388) 12269 : audit [DBG] from='client.268728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:54:59 smithi191 bash[24992]: cluster 2024-08-31T06:54:58.724279+0000 mgr.a (mgr.14388) 12270 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:54:59 smithi163 bash[24253]: cluster 2024-08-31T06:54:58.724279+0000 mgr.a (mgr.14388) 12270 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:54:59 smithi027 bash[22610]: cluster 2024-08-31T06:54:58.724279+0000 mgr.a (mgr.14388) 12270 : cluster [DBG] pgmap v8505: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:01 smithi163 bash[24253]: cluster 2024-08-31T06:55:00.725031+0000 mgr.a (mgr.14388) 12271 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:01 smithi027 bash[22610]: cluster 2024-08-31T06:55:00.725031+0000 mgr.a (mgr.14388) 12271 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:01 smithi191 bash[24992]: cluster 2024-08-31T06:55:00.725031+0000 mgr.a (mgr.14388) 12271 : cluster [DBG] pgmap v8506: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:02.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:55:02.787 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:55:02.787 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:55:03.535 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:55:03.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:55:03.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:55:03.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:55:03.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:55:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:03 smithi163 bash[24253]: cluster 2024-08-31T06:55:02.725777+0000 mgr.a (mgr.14388) 12272 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:03 smithi163 bash[24253]: audit 2024-08-31T06:55:03.120858+0000 mgr.a (mgr.14388) 12273 : audit [DBG] from='client.268806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:03 smithi027 bash[22610]: cluster 2024-08-31T06:55:02.725777+0000 mgr.a (mgr.14388) 12272 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:03 smithi027 bash[22610]: audit 2024-08-31T06:55:03.120858+0000 mgr.a (mgr.14388) 12273 : audit [DBG] from='client.268806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:03 smithi191 bash[24992]: cluster 2024-08-31T06:55:02.725777+0000 mgr.a (mgr.14388) 12272 : cluster [DBG] pgmap v8507: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:03 smithi191 bash[24992]: audit 2024-08-31T06:55:03.120858+0000 mgr.a (mgr.14388) 12273 : audit [DBG] from='client.268806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:05 smithi163 bash[24253]: cluster 2024-08-31T06:55:04.728490+0000 mgr.a (mgr.14388) 12274 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:05 smithi027 bash[22610]: cluster 2024-08-31T06:55:04.728490+0000 mgr.a (mgr.14388) 12274 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:05 smithi191 bash[24992]: cluster 2024-08-31T06:55:04.728490+0000 mgr.a (mgr.14388) 12274 : cluster [DBG] pgmap v8508: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:07 smithi163 bash[24253]: cluster 2024-08-31T06:55:06.729267+0000 mgr.a (mgr.14388) 12275 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:55:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:07 smithi027 bash[22610]: cluster 2024-08-31T06:55:06.729267+0000 mgr.a (mgr.14388) 12275 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:55:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:07 smithi191 bash[24992]: cluster 2024-08-31T06:55:06.729267+0000 mgr.a (mgr.14388) 12275 : cluster [DBG] pgmap v8509: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:55:08.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:55:08.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:55:08.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:55:09.318 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:55:09.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:55:09.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:55:09.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:55:09.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:55:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:09 smithi163 bash[24253]: cluster 2024-08-31T06:55:08.731231+0000 mgr.a (mgr.14388) 12276 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:09 smithi163 bash[24253]: audit 2024-08-31T06:55:08.875274+0000 mgr.a (mgr.14388) 12277 : audit [DBG] from='client.268884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:09 smithi027 bash[22610]: cluster 2024-08-31T06:55:08.731231+0000 mgr.a (mgr.14388) 12276 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:09 smithi027 bash[22610]: audit 2024-08-31T06:55:08.875274+0000 mgr.a (mgr.14388) 12277 : audit [DBG] from='client.268884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:09 smithi191 bash[24992]: cluster 2024-08-31T06:55:08.731231+0000 mgr.a (mgr.14388) 12276 : cluster [DBG] pgmap v8510: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:09 smithi191 bash[24992]: audit 2024-08-31T06:55:08.875274+0000 mgr.a (mgr.14388) 12277 : audit [DBG] from='client.268884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:11 smithi163 bash[24253]: cluster 2024-08-31T06:55:10.732102+0000 mgr.a (mgr.14388) 12278 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:55:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:11 smithi027 bash[22610]: cluster 2024-08-31T06:55:10.732102+0000 mgr.a (mgr.14388) 12278 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:55:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:11 smithi191 bash[24992]: cluster 2024-08-31T06:55:10.732102+0000 mgr.a (mgr.14388) 12278 : cluster [DBG] pgmap v8511: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:55:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:13 smithi163 bash[24253]: cluster 2024-08-31T06:55:12.732857+0000 mgr.a (mgr.14388) 12279 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:55:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:13 smithi027 bash[22610]: cluster 2024-08-31T06:55:12.732857+0000 mgr.a (mgr.14388) 12279 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:55:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:13 smithi191 bash[24992]: cluster 2024-08-31T06:55:12.732857+0000 mgr.a (mgr.14388) 12279 : cluster [DBG] pgmap v8512: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:55:14.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:55:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:55:14.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:55:15.090 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:55:15.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:55:15.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:55:15.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:55:15.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:55:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:15 smithi163 bash[24253]: audit 2024-08-31T06:55:14.656426+0000 mgr.a (mgr.14388) 12280 : audit [DBG] from='client.268962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:15 smithi163 bash[24253]: cluster 2024-08-31T06:55:14.734225+0000 mgr.a (mgr.14388) 12281 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:15 smithi027 bash[22610]: audit 2024-08-31T06:55:14.656426+0000 mgr.a (mgr.14388) 12280 : audit [DBG] from='client.268962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:15 smithi027 bash[22610]: cluster 2024-08-31T06:55:14.734225+0000 mgr.a (mgr.14388) 12281 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:15 smithi191 bash[24992]: audit 2024-08-31T06:55:14.656426+0000 mgr.a (mgr.14388) 12280 : audit [DBG] from='client.268962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:15 smithi191 bash[24992]: cluster 2024-08-31T06:55:14.734225+0000 mgr.a (mgr.14388) 12281 : cluster [DBG] pgmap v8513: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:17 smithi163 bash[24253]: cluster 2024-08-31T06:55:16.735090+0000 mgr.a (mgr.14388) 12282 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:17 smithi027 bash[22610]: cluster 2024-08-31T06:55:16.735090+0000 mgr.a (mgr.14388) 12282 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:17 smithi191 bash[24992]: cluster 2024-08-31T06:55:16.735090+0000 mgr.a (mgr.14388) 12282 : cluster [DBG] pgmap v8514: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:20.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:55:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:55:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:55:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:19 smithi163 bash[24253]: cluster 2024-08-31T06:55:18.737157+0000 mgr.a (mgr.14388) 12283 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:19 smithi027 bash[22610]: cluster 2024-08-31T06:55:18.737157+0000 mgr.a (mgr.14388) 12283 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:19 smithi191 bash[24992]: cluster 2024-08-31T06:55:18.737157+0000 mgr.a (mgr.14388) 12283 : cluster [DBG] pgmap v8515: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:20.856 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:55:20.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:55:20.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:55:20.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:55:20.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:55:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:20 smithi163 bash[24253]: audit 2024-08-31T06:55:20.423330+0000 mgr.a (mgr.14388) 12284 : audit [DBG] from='client.269040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:20 smithi027 bash[22610]: audit 2024-08-31T06:55:20.423330+0000 mgr.a (mgr.14388) 12284 : audit [DBG] from='client.269040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:20 smithi191 bash[24992]: audit 2024-08-31T06:55:20.423330+0000 mgr.a (mgr.14388) 12284 : audit [DBG] from='client.269040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:21 smithi163 bash[24253]: cluster 2024-08-31T06:55:20.737699+0000 mgr.a (mgr.14388) 12285 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:21 smithi027 bash[22610]: cluster 2024-08-31T06:55:20.737699+0000 mgr.a (mgr.14388) 12285 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:21 smithi191 bash[24992]: cluster 2024-08-31T06:55:20.737699+0000 mgr.a (mgr.14388) 12285 : cluster [DBG] pgmap v8516: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:23 smithi163 bash[24253]: cluster 2024-08-31T06:55:22.738570+0000 mgr.a (mgr.14388) 12286 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:23 smithi027 bash[22610]: cluster 2024-08-31T06:55:22.738570+0000 mgr.a (mgr.14388) 12286 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:23 smithi191 bash[24992]: cluster 2024-08-31T06:55:22.738570+0000 mgr.a (mgr.14388) 12286 : cluster [DBG] pgmap v8517: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:25.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:55:25.855 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:55:25.856 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:55:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:25 smithi027 bash[22610]: cluster 2024-08-31T06:55:24.740771+0000 mgr.a (mgr.14388) 12287 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:25 smithi191 bash[24992]: cluster 2024-08-31T06:55:24.740771+0000 mgr.a (mgr.14388) 12287 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:25 smithi163 bash[24253]: cluster 2024-08-31T06:55:24.740771+0000 mgr.a (mgr.14388) 12287 : cluster [DBG] pgmap v8518: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:26.630 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:55:26.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:55:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:55:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:55:26.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:55:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:26 smithi027 bash[22610]: audit 2024-08-31T06:55:26.191237+0000 mgr.a (mgr.14388) 12288 : audit [DBG] from='client.269118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:26 smithi191 bash[24992]: audit 2024-08-31T06:55:26.191237+0000 mgr.a (mgr.14388) 12288 : audit [DBG] from='client.269118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:26 smithi163 bash[24253]: audit 2024-08-31T06:55:26.191237+0000 mgr.a (mgr.14388) 12288 : audit [DBG] from='client.269118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:27 smithi027 bash[22610]: cluster 2024-08-31T06:55:26.741306+0000 mgr.a (mgr.14388) 12289 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:27 smithi191 bash[24992]: cluster 2024-08-31T06:55:26.741306+0000 mgr.a (mgr.14388) 12289 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:27 smithi163 bash[24253]: cluster 2024-08-31T06:55:26.741306+0000 mgr.a (mgr.14388) 12289 : cluster [DBG] pgmap v8519: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:29 smithi191 bash[24992]: cluster 2024-08-31T06:55:28.743408+0000 mgr.a (mgr.14388) 12290 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:29 smithi163 bash[24253]: cluster 2024-08-31T06:55:28.743408+0000 mgr.a (mgr.14388) 12290 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:29 smithi027 bash[22610]: cluster 2024-08-31T06:55:28.743408+0000 mgr.a (mgr.14388) 12290 : cluster [DBG] pgmap v8520: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:31.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:55:31.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:55:31.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:55:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:31 smithi191 bash[24992]: cluster 2024-08-31T06:55:30.744142+0000 mgr.a (mgr.14388) 12291 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:32.420 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:55:32.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:55:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:55:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:55:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:55:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:31 smithi163 bash[24253]: cluster 2024-08-31T06:55:30.744142+0000 mgr.a (mgr.14388) 12291 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:31 smithi027 bash[22610]: cluster 2024-08-31T06:55:30.744142+0000 mgr.a (mgr.14388) 12291 : cluster [DBG] pgmap v8521: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:33 smithi191 bash[24992]: audit 2024-08-31T06:55:31.968540+0000 mgr.a (mgr.14388) 12292 : audit [DBG] from='client.269196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:33 smithi163 bash[24253]: audit 2024-08-31T06:55:31.968540+0000 mgr.a (mgr.14388) 12292 : audit [DBG] from='client.269196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:33 smithi027 bash[22610]: audit 2024-08-31T06:55:31.968540+0000 mgr.a (mgr.14388) 12292 : audit [DBG] from='client.269196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:34 smithi191 bash[24992]: cluster 2024-08-31T06:55:32.745018+0000 mgr.a (mgr.14388) 12293 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:34 smithi163 bash[24253]: cluster 2024-08-31T06:55:32.745018+0000 mgr.a (mgr.14388) 12293 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:34 smithi027 bash[22610]: cluster 2024-08-31T06:55:32.745018+0000 mgr.a (mgr.14388) 12293 : cluster [DBG] pgmap v8522: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:36 smithi191 bash[24992]: cluster 2024-08-31T06:55:34.747270+0000 mgr.a (mgr.14388) 12294 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:36 smithi163 bash[24253]: cluster 2024-08-31T06:55:34.747270+0000 mgr.a (mgr.14388) 12294 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:36 smithi027 bash[22610]: cluster 2024-08-31T06:55:34.747270+0000 mgr.a (mgr.14388) 12294 : cluster [DBG] pgmap v8523: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:37.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:55:37.422 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:55:37.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:55:38.205 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:55:38.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:55:38.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:55:38.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:55:38.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:55:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:38 smithi191 bash[24992]: cluster 2024-08-31T06:55:36.748011+0000 mgr.a (mgr.14388) 12295 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:38 smithi163 bash[24253]: cluster 2024-08-31T06:55:36.748011+0000 mgr.a (mgr.14388) 12295 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:38 smithi027 bash[22610]: cluster 2024-08-31T06:55:36.748011+0000 mgr.a (mgr.14388) 12295 : cluster [DBG] pgmap v8524: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:39.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:39 smithi191 bash[24992]: audit 2024-08-31T06:55:37.758889+0000 mgr.a (mgr.14388) 12296 : audit [DBG] from='client.269274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:39 smithi191 bash[24992]: audit 2024-08-31T06:55:38.352612+0000 mon.a (mon.0) 2414 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:55:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:39 smithi163 bash[24253]: audit 2024-08-31T06:55:37.758889+0000 mgr.a (mgr.14388) 12296 : audit [DBG] from='client.269274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:39 smithi163 bash[24253]: audit 2024-08-31T06:55:38.352612+0000 mon.a (mon.0) 2414 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:55:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:39 smithi027 bash[22610]: audit 2024-08-31T06:55:37.758889+0000 mgr.a (mgr.14388) 12296 : audit [DBG] from='client.269274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:39 smithi027 bash[22610]: audit 2024-08-31T06:55:38.352612+0000 mon.a (mon.0) 2414 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:55:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:40 smithi191 bash[24992]: cluster 2024-08-31T06:55:38.750251+0000 mgr.a (mgr.14388) 12297 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:40 smithi163 bash[24253]: cluster 2024-08-31T06:55:38.750251+0000 mgr.a (mgr.14388) 12297 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:40 smithi027 bash[22610]: cluster 2024-08-31T06:55:38.750251+0000 mgr.a (mgr.14388) 12297 : cluster [DBG] pgmap v8525: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:55:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:42 smithi191 bash[24992]: cluster 2024-08-31T06:55:40.751075+0000 mgr.a (mgr.14388) 12298 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:55:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:42 smithi163 bash[24253]: cluster 2024-08-31T06:55:40.751075+0000 mgr.a (mgr.14388) 12298 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:55:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:42 smithi027 bash[22610]: cluster 2024-08-31T06:55:40.751075+0000 mgr.a (mgr.14388) 12298 : cluster [DBG] pgmap v8526: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:55:43.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:55:43.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:55:43.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:55:43.985 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:55:43.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:55:43.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:55:43.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:55:43.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:55:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:44 smithi191 bash[24992]: cluster 2024-08-31T06:55:42.751841+0000 mgr.a (mgr.14388) 12299 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:55:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:44 smithi191 bash[24992]: audit 2024-08-31T06:55:43.544351+0000 mgr.a (mgr.14388) 12300 : audit [DBG] from='client.269352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:44 smithi191 bash[24992]: audit 2024-08-31T06:55:43.697127+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:44 smithi191 bash[24992]: audit 2024-08-31T06:55:43.701490+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:44 smithi191 bash[24992]: audit 2024-08-31T06:55:43.736693+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:44 smithi191 bash[24992]: audit 2024-08-31T06:55:43.742911+0000 mon.a (mon.0) 2418 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:44 smithi191 bash[24992]: audit 2024-08-31T06:55:43.747138+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:44 smithi191 bash[24992]: audit 2024-08-31T06:55:43.752118+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:44 smithi163 bash[24253]: cluster 2024-08-31T06:55:42.751841+0000 mgr.a (mgr.14388) 12299 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:55:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:44 smithi163 bash[24253]: audit 2024-08-31T06:55:43.544351+0000 mgr.a (mgr.14388) 12300 : audit [DBG] from='client.269352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:44 smithi163 bash[24253]: audit 2024-08-31T06:55:43.697127+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:44 smithi163 bash[24253]: audit 2024-08-31T06:55:43.701490+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:44 smithi163 bash[24253]: audit 2024-08-31T06:55:43.736693+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:44 smithi163 bash[24253]: audit 2024-08-31T06:55:43.742911+0000 mon.a (mon.0) 2418 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:44 smithi163 bash[24253]: audit 2024-08-31T06:55:43.747138+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:44 smithi163 bash[24253]: audit 2024-08-31T06:55:43.752118+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:44 smithi027 bash[22610]: cluster 2024-08-31T06:55:42.751841+0000 mgr.a (mgr.14388) 12299 : cluster [DBG] pgmap v8527: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T06:55:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:44 smithi027 bash[22610]: audit 2024-08-31T06:55:43.544351+0000 mgr.a (mgr.14388) 12300 : audit [DBG] from='client.269352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:44 smithi027 bash[22610]: audit 2024-08-31T06:55:43.697127+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:44 smithi027 bash[22610]: audit 2024-08-31T06:55:43.701490+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:44 smithi027 bash[22610]: audit 2024-08-31T06:55:43.736693+0000 mon.a (mon.0) 2417 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:44 smithi027 bash[22610]: audit 2024-08-31T06:55:43.742911+0000 mon.a (mon.0) 2418 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:44 smithi027 bash[22610]: audit 2024-08-31T06:55:43.747138+0000 mon.a (mon.0) 2419 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:44 smithi027 bash[22610]: audit 2024-08-31T06:55:43.752118+0000 mon.a (mon.0) 2420 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:45 smithi191 bash[24992]: audit 2024-08-31T06:55:44.458973+0000 mon.a (mon.0) 2421 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:55:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:45 smithi191 bash[24992]: audit 2024-08-31T06:55:44.460376+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:55:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:45 smithi191 bash[24992]: audit 2024-08-31T06:55:44.470390+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:45 smithi191 bash[24992]: audit 2024-08-31T06:55:44.473148+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:55:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:45 smithi191 bash[24992]: audit 2024-08-31T06:55:44.474432+0000 mgr.a (mgr.14388) 12301 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:55:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:45 smithi163 bash[24253]: audit 2024-08-31T06:55:44.458973+0000 mon.a (mon.0) 2421 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:55:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:45 smithi163 bash[24253]: audit 2024-08-31T06:55:44.460376+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:55:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:45 smithi163 bash[24253]: audit 2024-08-31T06:55:44.470390+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:45 smithi163 bash[24253]: audit 2024-08-31T06:55:44.473148+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:55:45.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:45 smithi163 bash[24253]: audit 2024-08-31T06:55:44.474432+0000 mgr.a (mgr.14388) 12301 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:55:45.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:55:45 smithi027 bash[22863]: debug 2024-08-31T06:55:45.192+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:55:45.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:55:45 smithi027 bash[22863]: debug 2024-08-31T06:55:45.192+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:55:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:45 smithi027 bash[22610]: audit 2024-08-31T06:55:44.458973+0000 mon.a (mon.0) 2421 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:55:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:45 smithi027 bash[22610]: audit 2024-08-31T06:55:44.460376+0000 mon.a (mon.0) 2422 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:55:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:45 smithi027 bash[22610]: audit 2024-08-31T06:55:44.470390+0000 mon.a (mon.0) 2423 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:55:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:45 smithi027 bash[22610]: audit 2024-08-31T06:55:44.473148+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:55:45.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:45 smithi027 bash[22610]: audit 2024-08-31T06:55:44.474432+0000 mgr.a (mgr.14388) 12301 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:55:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:46 smithi027 bash[22610]: cluster 2024-08-31T06:55:44.753228+0000 mgr.a (mgr.14388) 12302 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:46 smithi027 bash[22610]: audit 2024-08-31T06:55:45.196911+0000 mgr.a (mgr.14388) 12303 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:55:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:46 smithi027 bash[22610]: cephadm 2024-08-31T06:55:45.198044+0000 mgr.a (mgr.14388) 12304 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:55:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:46 smithi191 bash[24992]: cluster 2024-08-31T06:55:44.753228+0000 mgr.a (mgr.14388) 12302 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:46 smithi191 bash[24992]: audit 2024-08-31T06:55:45.196911+0000 mgr.a (mgr.14388) 12303 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:55:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:46 smithi191 bash[24992]: cephadm 2024-08-31T06:55:45.198044+0000 mgr.a (mgr.14388) 12304 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:55:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:46 smithi163 bash[24253]: cluster 2024-08-31T06:55:44.753228+0000 mgr.a (mgr.14388) 12302 : cluster [DBG] pgmap v8528: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:55:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:46 smithi163 bash[24253]: audit 2024-08-31T06:55:45.196911+0000 mgr.a (mgr.14388) 12303 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:55:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:46 smithi163 bash[24253]: cephadm 2024-08-31T06:55:45.198044+0000 mgr.a (mgr.14388) 12304 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:55:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:48 smithi027 bash[22610]: cluster 2024-08-31T06:55:46.754146+0000 mgr.a (mgr.14388) 12305 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:55:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:48 smithi191 bash[24992]: cluster 2024-08-31T06:55:46.754146+0000 mgr.a (mgr.14388) 12305 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:55:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:48 smithi163 bash[24253]: cluster 2024-08-31T06:55:46.754146+0000 mgr.a (mgr.14388) 12305 : cluster [DBG] pgmap v8529: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:55:48.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:55:48.985 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:55:48.985 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:55:49.758 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:55:49.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:55:49.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:55:49.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:55:49.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:55:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:50 smithi027 bash[22610]: cluster 2024-08-31T06:55:48.756371+0000 mgr.a (mgr.14388) 12306 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:55:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:50 smithi027 bash[22610]: audit 2024-08-31T06:55:49.324138+0000 mgr.a (mgr.14388) 12307 : audit [DBG] from='client.269529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:50 smithi191 bash[24992]: cluster 2024-08-31T06:55:48.756371+0000 mgr.a (mgr.14388) 12306 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:55:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:50 smithi191 bash[24992]: audit 2024-08-31T06:55:49.324138+0000 mgr.a (mgr.14388) 12307 : audit [DBG] from='client.269529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:50 smithi163 bash[24253]: cluster 2024-08-31T06:55:48.756371+0000 mgr.a (mgr.14388) 12306 : cluster [DBG] pgmap v8530: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:55:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:50 smithi163 bash[24253]: audit 2024-08-31T06:55:49.324138+0000 mgr.a (mgr.14388) 12307 : audit [DBG] from='client.269529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:52 smithi191 bash[24992]: cluster 2024-08-31T06:55:50.757328+0000 mgr.a (mgr.14388) 12308 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:55:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:52 smithi163 bash[24253]: cluster 2024-08-31T06:55:50.757328+0000 mgr.a (mgr.14388) 12308 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:55:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:52 smithi027 bash[22610]: cluster 2024-08-31T06:55:50.757328+0000 mgr.a (mgr.14388) 12308 : cluster [DBG] pgmap v8531: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:55:54.760 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:55:54.761 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:55:54.761 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:55:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:54 smithi191 bash[24992]: cluster 2024-08-31T06:55:52.758141+0000 mgr.a (mgr.14388) 12309 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:55:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:54 smithi163 bash[24253]: cluster 2024-08-31T06:55:52.758141+0000 mgr.a (mgr.14388) 12309 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:55:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:54 smithi027 bash[22610]: cluster 2024-08-31T06:55:52.758141+0000 mgr.a (mgr.14388) 12309 : cluster [DBG] pgmap v8532: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:55:55.538 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:55:55.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:55:55.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:55:55.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:55:55.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:55:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:56 smithi191 bash[24992]: cluster 2024-08-31T06:55:54.760556+0000 mgr.a (mgr.14388) 12310 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:55:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:56 smithi191 bash[24992]: audit 2024-08-31T06:55:55.095944+0000 mgr.a (mgr.14388) 12311 : audit [DBG] from='client.269607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:56 smithi163 bash[24253]: cluster 2024-08-31T06:55:54.760556+0000 mgr.a (mgr.14388) 12310 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:55:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:56 smithi163 bash[24253]: audit 2024-08-31T06:55:55.095944+0000 mgr.a (mgr.14388) 12311 : audit [DBG] from='client.269607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:56 smithi027 bash[22610]: cluster 2024-08-31T06:55:54.760556+0000 mgr.a (mgr.14388) 12310 : cluster [DBG] pgmap v8533: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:55:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:56 smithi027 bash[22610]: audit 2024-08-31T06:55:55.095944+0000 mgr.a (mgr.14388) 12311 : audit [DBG] from='client.269607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:55:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:55:58 smithi191 bash[24992]: cluster 2024-08-31T06:55:56.761530+0000 mgr.a (mgr.14388) 12312 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:55:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:55:58 smithi163 bash[24253]: cluster 2024-08-31T06:55:56.761530+0000 mgr.a (mgr.14388) 12312 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:55:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:55:58 smithi027 bash[22610]: cluster 2024-08-31T06:55:56.761530+0000 mgr.a (mgr.14388) 12312 : cluster [DBG] pgmap v8534: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:00.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:00.540 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:00.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:00 smithi191 bash[24992]: cluster 2024-08-31T06:55:58.763738+0000 mgr.a (mgr.14388) 12313 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:00 smithi163 bash[24253]: cluster 2024-08-31T06:55:58.763738+0000 mgr.a (mgr.14388) 12313 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:00 smithi027 bash[22610]: cluster 2024-08-31T06:55:58.763738+0000 mgr.a (mgr.14388) 12313 : cluster [DBG] pgmap v8535: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:01.291 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:01.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:01.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:02 smithi191 bash[24992]: cluster 2024-08-31T06:56:00.764609+0000 mgr.a (mgr.14388) 12314 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:02 smithi191 bash[24992]: audit 2024-08-31T06:56:00.873279+0000 mgr.a (mgr.14388) 12315 : audit [DBG] from='client.269682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:02 smithi163 bash[24253]: cluster 2024-08-31T06:56:00.764609+0000 mgr.a (mgr.14388) 12314 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:02 smithi163 bash[24253]: audit 2024-08-31T06:56:00.873279+0000 mgr.a (mgr.14388) 12315 : audit [DBG] from='client.269682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:02 smithi027 bash[22610]: cluster 2024-08-31T06:56:00.764609+0000 mgr.a (mgr.14388) 12314 : cluster [DBG] pgmap v8536: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:02 smithi027 bash[22610]: audit 2024-08-31T06:56:00.873279+0000 mgr.a (mgr.14388) 12315 : audit [DBG] from='client.269682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:04 smithi191 bash[24992]: cluster 2024-08-31T06:56:02.765600+0000 mgr.a (mgr.14388) 12316 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:04 smithi163 bash[24253]: cluster 2024-08-31T06:56:02.765600+0000 mgr.a (mgr.14388) 12316 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:04 smithi027 bash[22610]: cluster 2024-08-31T06:56:02.765600+0000 mgr.a (mgr.14388) 12316 : cluster [DBG] pgmap v8537: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:06.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:06.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:06.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:06 smithi191 bash[24992]: cluster 2024-08-31T06:56:04.767890+0000 mgr.a (mgr.14388) 12317 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:06 smithi163 bash[24253]: cluster 2024-08-31T06:56:04.767890+0000 mgr.a (mgr.14388) 12317 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:06 smithi027 bash[22610]: cluster 2024-08-31T06:56:04.767890+0000 mgr.a (mgr.14388) 12317 : cluster [DBG] pgmap v8538: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:07.041 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:07.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:07.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:07.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:07.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:07 smithi191 bash[24992]: audit 2024-08-31T06:56:06.622575+0000 mgr.a (mgr.14388) 12318 : audit [DBG] from='client.269757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:07 smithi163 bash[24253]: audit 2024-08-31T06:56:06.622575+0000 mgr.a (mgr.14388) 12318 : audit [DBG] from='client.269757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:07 smithi027 bash[22610]: audit 2024-08-31T06:56:06.622575+0000 mgr.a (mgr.14388) 12318 : audit [DBG] from='client.269757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:08 smithi191 bash[24992]: cluster 2024-08-31T06:56:06.768453+0000 mgr.a (mgr.14388) 12319 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:08 smithi163 bash[24253]: cluster 2024-08-31T06:56:06.768453+0000 mgr.a (mgr.14388) 12319 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:08 smithi027 bash[22610]: cluster 2024-08-31T06:56:06.768453+0000 mgr.a (mgr.14388) 12319 : cluster [DBG] pgmap v8539: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:10 smithi191 bash[24992]: cluster 2024-08-31T06:56:08.771339+0000 mgr.a (mgr.14388) 12320 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:10 smithi163 bash[24253]: cluster 2024-08-31T06:56:08.771339+0000 mgr.a (mgr.14388) 12320 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:10 smithi027 bash[22610]: cluster 2024-08-31T06:56:08.771339+0000 mgr.a (mgr.14388) 12320 : cluster [DBG] pgmap v8540: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:12.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:12.043 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:12.043 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:12 smithi191 bash[24992]: cluster 2024-08-31T06:56:10.772165+0000 mgr.a (mgr.14388) 12321 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:12.802 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:12.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:12.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:12.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:12.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:12 smithi163 bash[24253]: cluster 2024-08-31T06:56:10.772165+0000 mgr.a (mgr.14388) 12321 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:12 smithi027 bash[22610]: cluster 2024-08-31T06:56:10.772165+0000 mgr.a (mgr.14388) 12321 : cluster [DBG] pgmap v8541: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:13 smithi163 bash[24253]: audit 2024-08-31T06:56:12.374617+0000 mgr.a (mgr.14388) 12322 : audit [DBG] from='client.269835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:13 smithi027 bash[22610]: audit 2024-08-31T06:56:12.374617+0000 mgr.a (mgr.14388) 12322 : audit [DBG] from='client.269835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:13 smithi191 bash[24992]: audit 2024-08-31T06:56:12.374617+0000 mgr.a (mgr.14388) 12322 : audit [DBG] from='client.269835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:14 smithi163 bash[24253]: cluster 2024-08-31T06:56:12.772633+0000 mgr.a (mgr.14388) 12323 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:14 smithi027 bash[22610]: cluster 2024-08-31T06:56:12.772633+0000 mgr.a (mgr.14388) 12323 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:14 smithi191 bash[24992]: cluster 2024-08-31T06:56:12.772633+0000 mgr.a (mgr.14388) 12323 : cluster [DBG] pgmap v8542: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:16 smithi163 bash[24253]: cluster 2024-08-31T06:56:14.774846+0000 mgr.a (mgr.14388) 12324 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:16 smithi027 bash[22610]: cluster 2024-08-31T06:56:14.774846+0000 mgr.a (mgr.14388) 12324 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:16 smithi191 bash[24992]: cluster 2024-08-31T06:56:14.774846+0000 mgr.a (mgr.14388) 12324 : cluster [DBG] pgmap v8543: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:17.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:17.805 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:17.805 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:18.581 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:18.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:18.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:18.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:18.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:18 smithi163 bash[24253]: cluster 2024-08-31T06:56:16.775566+0000 mgr.a (mgr.14388) 12325 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:18 smithi027 bash[22610]: cluster 2024-08-31T06:56:16.775566+0000 mgr.a (mgr.14388) 12325 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:18 smithi191 bash[24992]: cluster 2024-08-31T06:56:16.775566+0000 mgr.a (mgr.14388) 12325 : cluster [DBG] pgmap v8544: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:19 smithi163 bash[24253]: audit 2024-08-31T06:56:18.140063+0000 mgr.a (mgr.14388) 12326 : audit [DBG] from='client.269910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:19 smithi027 bash[22610]: audit 2024-08-31T06:56:18.140063+0000 mgr.a (mgr.14388) 12326 : audit [DBG] from='client.269910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:19 smithi191 bash[24992]: audit 2024-08-31T06:56:18.140063+0000 mgr.a (mgr.14388) 12326 : audit [DBG] from='client.269910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:20 smithi163 bash[24253]: cluster 2024-08-31T06:56:18.778327+0000 mgr.a (mgr.14388) 12327 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:20 smithi027 bash[22610]: cluster 2024-08-31T06:56:18.778327+0000 mgr.a (mgr.14388) 12327 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:20 smithi191 bash[24992]: cluster 2024-08-31T06:56:18.778327+0000 mgr.a (mgr.14388) 12327 : cluster [DBG] pgmap v8545: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:22 smithi163 bash[24253]: cluster 2024-08-31T06:56:20.779100+0000 mgr.a (mgr.14388) 12328 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:56:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:22 smithi027 bash[22610]: cluster 2024-08-31T06:56:20.779100+0000 mgr.a (mgr.14388) 12328 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:56:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:22 smithi191 bash[24992]: cluster 2024-08-31T06:56:20.779100+0000 mgr.a (mgr.14388) 12328 : cluster [DBG] pgmap v8546: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:56:23.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:23.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:23.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:24.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:24.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:24.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:24.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:24.360 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:24 smithi163 bash[24253]: cluster 2024-08-31T06:56:22.779863+0000 mgr.a (mgr.14388) 12329 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:56:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:24 smithi027 bash[22610]: cluster 2024-08-31T06:56:22.779863+0000 mgr.a (mgr.14388) 12329 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:56:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:24 smithi191 bash[24992]: cluster 2024-08-31T06:56:22.779863+0000 mgr.a (mgr.14388) 12329 : cluster [DBG] pgmap v8547: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:56:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:25 smithi163 bash[24253]: audit 2024-08-31T06:56:23.916385+0000 mgr.a (mgr.14388) 12330 : audit [DBG] from='client.269988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:25 smithi027 bash[22610]: audit 2024-08-31T06:56:23.916385+0000 mgr.a (mgr.14388) 12330 : audit [DBG] from='client.269988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:25 smithi191 bash[24992]: audit 2024-08-31T06:56:23.916385+0000 mgr.a (mgr.14388) 12330 : audit [DBG] from='client.269988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:26 smithi163 bash[24253]: cluster 2024-08-31T06:56:24.782636+0000 mgr.a (mgr.14388) 12331 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:26 smithi027 bash[22610]: cluster 2024-08-31T06:56:24.782636+0000 mgr.a (mgr.14388) 12331 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:26 smithi191 bash[24992]: cluster 2024-08-31T06:56:24.782636+0000 mgr.a (mgr.14388) 12331 : cluster [DBG] pgmap v8548: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:28 smithi163 bash[24253]: cluster 2024-08-31T06:56:26.783429+0000 mgr.a (mgr.14388) 12332 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:56:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:28 smithi027 bash[22610]: cluster 2024-08-31T06:56:26.783429+0000 mgr.a (mgr.14388) 12332 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:56:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:28 smithi191 bash[24992]: cluster 2024-08-31T06:56:26.783429+0000 mgr.a (mgr.14388) 12332 : cluster [DBG] pgmap v8549: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:56:29.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:29.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:29.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:30.134 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:30.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:30.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:30.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:30.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:30 smithi163 bash[24253]: cluster 2024-08-31T06:56:28.785350+0000 mgr.a (mgr.14388) 12333 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:30 smithi027 bash[22610]: cluster 2024-08-31T06:56:28.785350+0000 mgr.a (mgr.14388) 12333 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:30 smithi191 bash[24992]: cluster 2024-08-31T06:56:28.785350+0000 mgr.a (mgr.14388) 12333 : cluster [DBG] pgmap v8550: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:31 smithi163 bash[24253]: audit 2024-08-31T06:56:29.701715+0000 mgr.a (mgr.14388) 12334 : audit [DBG] from='client.270066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:31 smithi027 bash[22610]: audit 2024-08-31T06:56:29.701715+0000 mgr.a (mgr.14388) 12334 : audit [DBG] from='client.270066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:31 smithi191 bash[24992]: audit 2024-08-31T06:56:29.701715+0000 mgr.a (mgr.14388) 12334 : audit [DBG] from='client.270066 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:32 smithi163 bash[24253]: cluster 2024-08-31T06:56:30.786313+0000 mgr.a (mgr.14388) 12335 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:32 smithi027 bash[22610]: cluster 2024-08-31T06:56:30.786313+0000 mgr.a (mgr.14388) 12335 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:32 smithi191 bash[24992]: cluster 2024-08-31T06:56:30.786313+0000 mgr.a (mgr.14388) 12335 : cluster [DBG] pgmap v8551: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:34 smithi163 bash[24253]: cluster 2024-08-31T06:56:32.787108+0000 mgr.a (mgr.14388) 12336 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:34 smithi027 bash[22610]: cluster 2024-08-31T06:56:32.787108+0000 mgr.a (mgr.14388) 12336 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:34 smithi191 bash[24992]: cluster 2024-08-31T06:56:32.787108+0000 mgr.a (mgr.14388) 12336 : cluster [DBG] pgmap v8552: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:35.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:35.136 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:35.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:35.912 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:35.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:35.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:35.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:35.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:36 smithi163 bash[24253]: cluster 2024-08-31T06:56:34.789312+0000 mgr.a (mgr.14388) 12337 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:36 smithi163 bash[24253]: audit 2024-08-31T06:56:35.475390+0000 mgr.a (mgr.14388) 12338 : audit [DBG] from='client.270144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:36 smithi027 bash[22610]: cluster 2024-08-31T06:56:34.789312+0000 mgr.a (mgr.14388) 12337 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:36 smithi027 bash[22610]: audit 2024-08-31T06:56:35.475390+0000 mgr.a (mgr.14388) 12338 : audit [DBG] from='client.270144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:36 smithi191 bash[24992]: cluster 2024-08-31T06:56:34.789312+0000 mgr.a (mgr.14388) 12337 : cluster [DBG] pgmap v8553: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:36 smithi191 bash[24992]: audit 2024-08-31T06:56:35.475390+0000 mgr.a (mgr.14388) 12338 : audit [DBG] from='client.270144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:38 smithi163 bash[24253]: cluster 2024-08-31T06:56:36.790272+0000 mgr.a (mgr.14388) 12339 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:38 smithi027 bash[22610]: cluster 2024-08-31T06:56:36.790272+0000 mgr.a (mgr.14388) 12339 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:38 smithi191 bash[24992]: cluster 2024-08-31T06:56:36.790272+0000 mgr.a (mgr.14388) 12339 : cluster [DBG] pgmap v8554: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:40.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:40.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:40.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:40 smithi163 bash[24253]: cluster 2024-08-31T06:56:38.792496+0000 mgr.a (mgr.14388) 12340 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:40 smithi027 bash[22610]: cluster 2024-08-31T06:56:38.792496+0000 mgr.a (mgr.14388) 12340 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:40 smithi191 bash[24992]: cluster 2024-08-31T06:56:38.792496+0000 mgr.a (mgr.14388) 12340 : cluster [DBG] pgmap v8555: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:41.686 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:41.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:41.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:41.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:41.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:42 smithi163 bash[24253]: cluster 2024-08-31T06:56:40.793283+0000 mgr.a (mgr.14388) 12341 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:42 smithi163 bash[24253]: audit 2024-08-31T06:56:41.249387+0000 mgr.a (mgr.14388) 12342 : audit [DBG] from='client.270222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:42 smithi027 bash[22610]: cluster 2024-08-31T06:56:40.793283+0000 mgr.a (mgr.14388) 12341 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:42 smithi027 bash[22610]: audit 2024-08-31T06:56:41.249387+0000 mgr.a (mgr.14388) 12342 : audit [DBG] from='client.270222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:43.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:42 smithi191 bash[24992]: cluster 2024-08-31T06:56:40.793283+0000 mgr.a (mgr.14388) 12341 : cluster [DBG] pgmap v8556: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:43.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:42 smithi191 bash[24992]: audit 2024-08-31T06:56:41.249387+0000 mgr.a (mgr.14388) 12342 : audit [DBG] from='client.270222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:44 smithi163 bash[24253]: cluster 2024-08-31T06:56:42.794231+0000 mgr.a (mgr.14388) 12343 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:44 smithi027 bash[22610]: cluster 2024-08-31T06:56:42.794231+0000 mgr.a (mgr.14388) 12343 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:44 smithi191 bash[24992]: cluster 2024-08-31T06:56:42.794231+0000 mgr.a (mgr.14388) 12343 : cluster [DBG] pgmap v8557: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:45 smithi163 bash[24253]: audit 2024-08-31T06:56:45.249167+0000 mon.a (mon.0) 2425 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:56:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:45 smithi027 bash[22610]: audit 2024-08-31T06:56:45.249167+0000 mon.a (mon.0) 2425 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:56:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:45 smithi191 bash[24992]: audit 2024-08-31T06:56:45.249167+0000 mon.a (mon.0) 2425 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:56:46.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:46.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:46.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:46 smithi163 bash[24253]: cluster 2024-08-31T06:56:44.796494+0000 mgr.a (mgr.14388) 12344 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:46 smithi163 bash[24253]: audit 2024-08-31T06:56:46.074907+0000 mon.a (mon.0) 2426 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:56:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:46 smithi163 bash[24253]: audit 2024-08-31T06:56:46.076695+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:56:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:46 smithi163 bash[24253]: audit 2024-08-31T06:56:46.087163+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:56:46.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:46 smithi163 bash[24253]: audit 2024-08-31T06:56:46.089974+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:56:46.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:56:46 smithi027 bash[22863]: debug 2024-08-31T06:56:46.830+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:56:46.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:56:46 smithi027 bash[22863]: debug 2024-08-31T06:56:46.830+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:56:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:46 smithi027 bash[22610]: cluster 2024-08-31T06:56:44.796494+0000 mgr.a (mgr.14388) 12344 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:46 smithi027 bash[22610]: audit 2024-08-31T06:56:46.074907+0000 mon.a (mon.0) 2426 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:56:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:46 smithi027 bash[22610]: audit 2024-08-31T06:56:46.076695+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:56:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:46 smithi027 bash[22610]: audit 2024-08-31T06:56:46.087163+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:56:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:46 smithi027 bash[22610]: audit 2024-08-31T06:56:46.089974+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:56:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:46 smithi191 bash[24992]: cluster 2024-08-31T06:56:44.796494+0000 mgr.a (mgr.14388) 12344 : cluster [DBG] pgmap v8558: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:56:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:46 smithi191 bash[24992]: audit 2024-08-31T06:56:46.074907+0000 mon.a (mon.0) 2426 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:56:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:46 smithi191 bash[24992]: audit 2024-08-31T06:56:46.076695+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:56:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:46 smithi191 bash[24992]: audit 2024-08-31T06:56:46.087163+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:56:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:46 smithi191 bash[24992]: audit 2024-08-31T06:56:46.089974+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:56:47.410 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:47.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:47.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:47.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:47.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:47 smithi163 bash[24253]: audit 2024-08-31T06:56:46.092257+0000 mgr.a (mgr.14388) 12345 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:56:47.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:47 smithi027 bash[22610]: audit 2024-08-31T06:56:46.092257+0000 mgr.a (mgr.14388) 12345 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:56:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:47 smithi191 bash[24992]: audit 2024-08-31T06:56:46.092257+0000 mgr.a (mgr.14388) 12345 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:56:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:48 smithi163 bash[24253]: cluster 2024-08-31T06:56:46.797010+0000 mgr.a (mgr.14388) 12346 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:48 smithi163 bash[24253]: audit 2024-08-31T06:56:46.831036+0000 mgr.a (mgr.14388) 12347 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:56:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:48 smithi163 bash[24253]: cephadm 2024-08-31T06:56:46.832135+0000 mgr.a (mgr.14388) 12348 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:56:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:48 smithi163 bash[24253]: audit 2024-08-31T06:56:47.001204+0000 mgr.a (mgr.14388) 12349 : audit [DBG] from='client.270405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:48 smithi027 bash[22610]: cluster 2024-08-31T06:56:46.797010+0000 mgr.a (mgr.14388) 12346 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:48 smithi027 bash[22610]: audit 2024-08-31T06:56:46.831036+0000 mgr.a (mgr.14388) 12347 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:56:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:48 smithi027 bash[22610]: cephadm 2024-08-31T06:56:46.832135+0000 mgr.a (mgr.14388) 12348 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:56:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:48 smithi027 bash[22610]: audit 2024-08-31T06:56:47.001204+0000 mgr.a (mgr.14388) 12349 : audit [DBG] from='client.270405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:48 smithi191 bash[24992]: cluster 2024-08-31T06:56:46.797010+0000 mgr.a (mgr.14388) 12346 : cluster [DBG] pgmap v8559: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:56:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:48 smithi191 bash[24992]: audit 2024-08-31T06:56:46.831036+0000 mgr.a (mgr.14388) 12347 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:56:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:48 smithi191 bash[24992]: cephadm 2024-08-31T06:56:46.832135+0000 mgr.a (mgr.14388) 12348 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:56:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:48 smithi191 bash[24992]: audit 2024-08-31T06:56:47.001204+0000 mgr.a (mgr.14388) 12349 : audit [DBG] from='client.270405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:50 smithi163 bash[24253]: cluster 2024-08-31T06:56:48.799317+0000 mgr.a (mgr.14388) 12350 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:50 smithi027 bash[22610]: cluster 2024-08-31T06:56:48.799317+0000 mgr.a (mgr.14388) 12350 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:50 smithi191 bash[24992]: cluster 2024-08-31T06:56:48.799317+0000 mgr.a (mgr.14388) 12350 : cluster [DBG] pgmap v8560: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:51 smithi027 bash[22610]: cluster 2024-08-31T06:56:50.800107+0000 mgr.a (mgr.14388) 12351 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:51 smithi191 bash[24992]: cluster 2024-08-31T06:56:50.800107+0000 mgr.a (mgr.14388) 12351 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:51 smithi163 bash[24253]: cluster 2024-08-31T06:56:50.800107+0000 mgr.a (mgr.14388) 12351 : cluster [DBG] pgmap v8561: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:53.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:53.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:53.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:53.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:53.185 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:53 smithi163 bash[24253]: audit 2024-08-31T06:56:52.750104+0000 mgr.a (mgr.14388) 12352 : audit [DBG] from='client.270480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:53 smithi163 bash[24253]: cluster 2024-08-31T06:56:52.801118+0000 mgr.a (mgr.14388) 12353 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:53 smithi027 bash[22610]: audit 2024-08-31T06:56:52.750104+0000 mgr.a (mgr.14388) 12352 : audit [DBG] from='client.270480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:53 smithi027 bash[22610]: cluster 2024-08-31T06:56:52.801118+0000 mgr.a (mgr.14388) 12353 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:53 smithi191 bash[24992]: audit 2024-08-31T06:56:52.750104+0000 mgr.a (mgr.14388) 12352 : audit [DBG] from='client.270480 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:53 smithi191 bash[24992]: cluster 2024-08-31T06:56:52.801118+0000 mgr.a (mgr.14388) 12353 : cluster [DBG] pgmap v8562: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:55 smithi163 bash[24253]: cluster 2024-08-31T06:56:54.803504+0000 mgr.a (mgr.14388) 12354 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:55 smithi027 bash[22610]: cluster 2024-08-31T06:56:54.803504+0000 mgr.a (mgr.14388) 12354 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:55 smithi191 bash[24992]: cluster 2024-08-31T06:56:54.803504+0000 mgr.a (mgr.14388) 12354 : cluster [DBG] pgmap v8563: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:56:58.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:56:58.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:56:58.187 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:56:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:57 smithi163 bash[24253]: cluster 2024-08-31T06:56:56.804291+0000 mgr.a (mgr.14388) 12355 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:56:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:57 smithi027 bash[22610]: cluster 2024-08-31T06:56:56.804291+0000 mgr.a (mgr.14388) 12355 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:56:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:57 smithi191 bash[24992]: cluster 2024-08-31T06:56:56.804291+0000 mgr.a (mgr.14388) 12355 : cluster [DBG] pgmap v8564: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:56:58.931 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:56:58.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:56:58.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:56:58.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:56:58.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:56:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:58 smithi163 bash[24253]: audit 2024-08-31T06:56:58.516187+0000 mgr.a (mgr.14388) 12356 : audit [DBG] from='client.270558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:58 smithi027 bash[22610]: audit 2024-08-31T06:56:58.516187+0000 mgr.a (mgr.14388) 12356 : audit [DBG] from='client.270558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:58 smithi191 bash[24992]: audit 2024-08-31T06:56:58.516187+0000 mgr.a (mgr.14388) 12356 : audit [DBG] from='client.270558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:56:59 smithi163 bash[24253]: cluster 2024-08-31T06:56:58.806051+0000 mgr.a (mgr.14388) 12357 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:56:59 smithi027 bash[22610]: cluster 2024-08-31T06:56:58.806051+0000 mgr.a (mgr.14388) 12357 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:56:59 smithi191 bash[24992]: cluster 2024-08-31T06:56:58.806051+0000 mgr.a (mgr.14388) 12357 : cluster [DBG] pgmap v8565: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:01 smithi163 bash[24253]: cluster 2024-08-31T06:57:00.806932+0000 mgr.a (mgr.14388) 12358 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:57:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:01 smithi027 bash[22610]: cluster 2024-08-31T06:57:00.806932+0000 mgr.a (mgr.14388) 12358 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:57:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:01 smithi191 bash[24992]: cluster 2024-08-31T06:57:00.806932+0000 mgr.a (mgr.14388) 12358 : cluster [DBG] pgmap v8566: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:57:03.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:57:03.933 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:57:03.933 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:57:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:03 smithi163 bash[24253]: cluster 2024-08-31T06:57:02.809064+0000 mgr.a (mgr.14388) 12359 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:03 smithi027 bash[22610]: cluster 2024-08-31T06:57:02.809064+0000 mgr.a (mgr.14388) 12359 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:03 smithi191 bash[24992]: cluster 2024-08-31T06:57:02.809064+0000 mgr.a (mgr.14388) 12359 : cluster [DBG] pgmap v8567: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:04.677 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:57:04.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:57:04.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:57:04.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:57:04.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:57:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:04 smithi163 bash[24253]: audit 2024-08-31T06:57:04.259437+0000 mgr.a (mgr.14388) 12360 : audit [DBG] from='client.270636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:04 smithi027 bash[22610]: audit 2024-08-31T06:57:04.259437+0000 mgr.a (mgr.14388) 12360 : audit [DBG] from='client.270636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:04 smithi191 bash[24992]: audit 2024-08-31T06:57:04.259437+0000 mgr.a (mgr.14388) 12360 : audit [DBG] from='client.270636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:05 smithi163 bash[24253]: cluster 2024-08-31T06:57:04.810023+0000 mgr.a (mgr.14388) 12361 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:05 smithi027 bash[22610]: cluster 2024-08-31T06:57:04.810023+0000 mgr.a (mgr.14388) 12361 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:05 smithi191 bash[24992]: cluster 2024-08-31T06:57:04.810023+0000 mgr.a (mgr.14388) 12361 : cluster [DBG] pgmap v8568: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:07 smithi163 bash[24253]: cluster 2024-08-31T06:57:06.810835+0000 mgr.a (mgr.14388) 12362 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:57:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:07 smithi027 bash[22610]: cluster 2024-08-31T06:57:06.810835+0000 mgr.a (mgr.14388) 12362 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:57:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:07 smithi191 bash[24992]: cluster 2024-08-31T06:57:06.810835+0000 mgr.a (mgr.14388) 12362 : cluster [DBG] pgmap v8569: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 0 op/s 2024-08-31T06:57:09.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:57:09.680 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:57:09.680 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:57:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:09 smithi191 bash[24992]: cluster 2024-08-31T06:57:08.813114+0000 mgr.a (mgr.14388) 12363 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T06:57:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:09 smithi163 bash[24253]: cluster 2024-08-31T06:57:08.813114+0000 mgr.a (mgr.14388) 12363 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T06:57:10.454 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:57:10.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:57:10.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:57:10.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:57:10.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:57:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:09 smithi027 bash[22610]: cluster 2024-08-31T06:57:08.813114+0000 mgr.a (mgr.14388) 12363 : cluster [DBG] pgmap v8570: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T06:57:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:11 smithi191 bash[24992]: audit 2024-08-31T06:57:10.015760+0000 mgr.a (mgr.14388) 12364 : audit [DBG] from='client.270714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:10 smithi163 bash[24253]: audit 2024-08-31T06:57:10.015760+0000 mgr.a (mgr.14388) 12364 : audit [DBG] from='client.270714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:10 smithi027 bash[22610]: audit 2024-08-31T06:57:10.015760+0000 mgr.a (mgr.14388) 12364 : audit [DBG] from='client.270714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:12 smithi191 bash[24992]: cluster 2024-08-31T06:57:10.814137+0000 mgr.a (mgr.14388) 12365 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:12 smithi163 bash[24253]: cluster 2024-08-31T06:57:10.814137+0000 mgr.a (mgr.14388) 12365 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:12 smithi027 bash[22610]: cluster 2024-08-31T06:57:10.814137+0000 mgr.a (mgr.14388) 12365 : cluster [DBG] pgmap v8571: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:14 smithi191 bash[24992]: cluster 2024-08-31T06:57:12.816308+0000 mgr.a (mgr.14388) 12366 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:14 smithi163 bash[24253]: cluster 2024-08-31T06:57:12.816308+0000 mgr.a (mgr.14388) 12366 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:14 smithi027 bash[22610]: cluster 2024-08-31T06:57:12.816308+0000 mgr.a (mgr.14388) 12366 : cluster [DBG] pgmap v8572: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:15.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:57:15.456 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:57:15.457 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:57:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:57:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:57:16.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:57:16.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:57:16.215 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:57:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:16 smithi191 bash[24992]: cluster 2024-08-31T06:57:14.817068+0000 mgr.a (mgr.14388) 12367 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:16 smithi163 bash[24253]: cluster 2024-08-31T06:57:14.817068+0000 mgr.a (mgr.14388) 12367 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:16 smithi027 bash[22610]: cluster 2024-08-31T06:57:14.817068+0000 mgr.a (mgr.14388) 12367 : cluster [DBG] pgmap v8573: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:17 smithi191 bash[24992]: audit 2024-08-31T06:57:15.790320+0000 mgr.a (mgr.14388) 12368 : audit [DBG] from='client.270786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:17 smithi163 bash[24253]: audit 2024-08-31T06:57:15.790320+0000 mgr.a (mgr.14388) 12368 : audit [DBG] from='client.270786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:17 smithi027 bash[22610]: audit 2024-08-31T06:57:15.790320+0000 mgr.a (mgr.14388) 12368 : audit [DBG] from='client.270786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:18 smithi191 bash[24992]: cluster 2024-08-31T06:57:16.818053+0000 mgr.a (mgr.14388) 12369 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:18 smithi163 bash[24253]: cluster 2024-08-31T06:57:16.818053+0000 mgr.a (mgr.14388) 12369 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:18 smithi027 bash[22610]: cluster 2024-08-31T06:57:16.818053+0000 mgr.a (mgr.14388) 12369 : cluster [DBG] pgmap v8574: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:20 smithi191 bash[24992]: cluster 2024-08-31T06:57:18.820309+0000 mgr.a (mgr.14388) 12370 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:20 smithi163 bash[24253]: cluster 2024-08-31T06:57:18.820309+0000 mgr.a (mgr.14388) 12370 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:20 smithi027 bash[22610]: cluster 2024-08-31T06:57:18.820309+0000 mgr.a (mgr.14388) 12370 : cluster [DBG] pgmap v8575: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:21.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:57:21.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:57:21.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:57:21.968 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:57:21.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:57:21.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:57:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:57:21.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:57:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:22 smithi191 bash[24992]: cluster 2024-08-31T06:57:20.821098+0000 mgr.a (mgr.14388) 12371 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:22 smithi191 bash[24992]: audit 2024-08-31T06:57:21.549145+0000 mgr.a (mgr.14388) 12372 : audit [DBG] from='client.270861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:22 smithi163 bash[24253]: cluster 2024-08-31T06:57:20.821098+0000 mgr.a (mgr.14388) 12371 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:22 smithi163 bash[24253]: audit 2024-08-31T06:57:21.549145+0000 mgr.a (mgr.14388) 12372 : audit [DBG] from='client.270861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:22 smithi027 bash[22610]: cluster 2024-08-31T06:57:20.821098+0000 mgr.a (mgr.14388) 12371 : cluster [DBG] pgmap v8576: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:22 smithi027 bash[22610]: audit 2024-08-31T06:57:21.549145+0000 mgr.a (mgr.14388) 12372 : audit [DBG] from='client.270861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:24 smithi191 bash[24992]: cluster 2024-08-31T06:57:22.823453+0000 mgr.a (mgr.14388) 12373 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:24 smithi163 bash[24253]: cluster 2024-08-31T06:57:22.823453+0000 mgr.a (mgr.14388) 12373 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:24 smithi027 bash[22610]: cluster 2024-08-31T06:57:22.823453+0000 mgr.a (mgr.14388) 12373 : cluster [DBG] pgmap v8577: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:26 smithi191 bash[24992]: cluster 2024-08-31T06:57:24.824248+0000 mgr.a (mgr.14388) 12374 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:26 smithi163 bash[24253]: cluster 2024-08-31T06:57:24.824248+0000 mgr.a (mgr.14388) 12374 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:26 smithi027 bash[22610]: cluster 2024-08-31T06:57:24.824248+0000 mgr.a (mgr.14388) 12374 : cluster [DBG] pgmap v8578: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:26.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:57:26.970 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:57:26.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:57:27.763 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:57:27.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:57:27.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:57:27.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:57:27.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:57:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:28 smithi163 bash[24253]: cluster 2024-08-31T06:57:26.825029+0000 mgr.a (mgr.14388) 12375 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:28 smithi163 bash[24253]: audit 2024-08-31T06:57:27.310825+0000 mgr.a (mgr.14388) 12376 : audit [DBG] from='client.270939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:28 smithi027 bash[22610]: cluster 2024-08-31T06:57:26.825029+0000 mgr.a (mgr.14388) 12375 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:28 smithi027 bash[22610]: audit 2024-08-31T06:57:27.310825+0000 mgr.a (mgr.14388) 12376 : audit [DBG] from='client.270939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:28 smithi191 bash[24992]: cluster 2024-08-31T06:57:26.825029+0000 mgr.a (mgr.14388) 12375 : cluster [DBG] pgmap v8579: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:28 smithi191 bash[24992]: audit 2024-08-31T06:57:27.310825+0000 mgr.a (mgr.14388) 12376 : audit [DBG] from='client.270939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:30 smithi163 bash[24253]: cluster 2024-08-31T06:57:28.827324+0000 mgr.a (mgr.14388) 12377 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:30 smithi027 bash[22610]: cluster 2024-08-31T06:57:28.827324+0000 mgr.a (mgr.14388) 12377 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:30 smithi191 bash[24992]: cluster 2024-08-31T06:57:28.827324+0000 mgr.a (mgr.14388) 12377 : cluster [DBG] pgmap v8580: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:32 smithi163 bash[24253]: cluster 2024-08-31T06:57:30.828111+0000 mgr.a (mgr.14388) 12378 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:32 smithi027 bash[22610]: cluster 2024-08-31T06:57:30.828111+0000 mgr.a (mgr.14388) 12378 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:32 smithi191 bash[24992]: cluster 2024-08-31T06:57:30.828111+0000 mgr.a (mgr.14388) 12378 : cluster [DBG] pgmap v8581: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:32.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:57:32.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:57:32.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:57:33.541 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:57:33.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:57:33.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:57:33.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:57:33.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:57:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:34 smithi163 bash[24253]: cluster 2024-08-31T06:57:32.830102+0000 mgr.a (mgr.14388) 12379 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:34 smithi163 bash[24253]: audit 2024-08-31T06:57:33.098529+0000 mgr.a (mgr.14388) 12380 : audit [DBG] from='client.271014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:34 smithi027 bash[22610]: cluster 2024-08-31T06:57:32.830102+0000 mgr.a (mgr.14388) 12379 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:34 smithi027 bash[22610]: audit 2024-08-31T06:57:33.098529+0000 mgr.a (mgr.14388) 12380 : audit [DBG] from='client.271014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:34 smithi191 bash[24992]: cluster 2024-08-31T06:57:32.830102+0000 mgr.a (mgr.14388) 12379 : cluster [DBG] pgmap v8582: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:34 smithi191 bash[24992]: audit 2024-08-31T06:57:33.098529+0000 mgr.a (mgr.14388) 12380 : audit [DBG] from='client.271014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:36 smithi163 bash[24253]: cluster 2024-08-31T06:57:34.831051+0000 mgr.a (mgr.14388) 12381 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:57:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:36 smithi027 bash[22610]: cluster 2024-08-31T06:57:34.831051+0000 mgr.a (mgr.14388) 12381 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:57:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:36 smithi191 bash[24992]: cluster 2024-08-31T06:57:34.831051+0000 mgr.a (mgr.14388) 12381 : cluster [DBG] pgmap v8583: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:57:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:38 smithi163 bash[24253]: cluster 2024-08-31T06:57:36.831857+0000 mgr.a (mgr.14388) 12382 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:57:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:38 smithi027 bash[22610]: cluster 2024-08-31T06:57:36.831857+0000 mgr.a (mgr.14388) 12382 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:57:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:38 smithi191 bash[24992]: cluster 2024-08-31T06:57:36.831857+0000 mgr.a (mgr.14388) 12382 : cluster [DBG] pgmap v8584: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:57:38.543 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:57:38.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:57:38.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:57:39.295 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:57:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:57:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:57:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:57:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:57:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:40 smithi163 bash[24253]: cluster 2024-08-31T06:57:38.833949+0000 mgr.a (mgr.14388) 12383 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:40 smithi163 bash[24253]: audit 2024-08-31T06:57:38.877237+0000 mgr.a (mgr.14388) 12384 : audit [DBG] from='client.271089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:40 smithi027 bash[22610]: cluster 2024-08-31T06:57:38.833949+0000 mgr.a (mgr.14388) 12383 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:40 smithi027 bash[22610]: audit 2024-08-31T06:57:38.877237+0000 mgr.a (mgr.14388) 12384 : audit [DBG] from='client.271089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:40 smithi191 bash[24992]: cluster 2024-08-31T06:57:38.833949+0000 mgr.a (mgr.14388) 12383 : cluster [DBG] pgmap v8585: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:40 smithi191 bash[24992]: audit 2024-08-31T06:57:38.877237+0000 mgr.a (mgr.14388) 12384 : audit [DBG] from='client.271089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:42 smithi163 bash[24253]: cluster 2024-08-31T06:57:40.834859+0000 mgr.a (mgr.14388) 12385 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:57:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:42 smithi027 bash[22610]: cluster 2024-08-31T06:57:40.834859+0000 mgr.a (mgr.14388) 12385 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:57:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:42 smithi191 bash[24992]: cluster 2024-08-31T06:57:40.834859+0000 mgr.a (mgr.14388) 12385 : cluster [DBG] pgmap v8586: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:57:44.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:57:44.300 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:57:44.301 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:57:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:44 smithi163 bash[24253]: cluster 2024-08-31T06:57:42.837037+0000 mgr.a (mgr.14388) 12386 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:44 smithi027 bash[22610]: cluster 2024-08-31T06:57:42.837037+0000 mgr.a (mgr.14388) 12386 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:44 smithi191 bash[24992]: cluster 2024-08-31T06:57:42.837037+0000 mgr.a (mgr.14388) 12386 : cluster [DBG] pgmap v8587: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:45.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:57:45.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:57:45.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:57:45.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:57:45.049 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:57:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:45 smithi163 bash[24253]: audit 2024-08-31T06:57:44.624952+0000 mgr.a (mgr.14388) 12387 : audit [DBG] from='client.271167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:45 smithi027 bash[22610]: audit 2024-08-31T06:57:44.624952+0000 mgr.a (mgr.14388) 12387 : audit [DBG] from='client.271167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:45 smithi191 bash[24992]: audit 2024-08-31T06:57:44.624952+0000 mgr.a (mgr.14388) 12387 : audit [DBG] from='client.271167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:46 smithi163 bash[24253]: cluster 2024-08-31T06:57:44.837543+0000 mgr.a (mgr.14388) 12388 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:46 smithi027 bash[22610]: cluster 2024-08-31T06:57:44.837543+0000 mgr.a (mgr.14388) 12388 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:46 smithi191 bash[24992]: cluster 2024-08-31T06:57:44.837543+0000 mgr.a (mgr.14388) 12388 : cluster [DBG] pgmap v8588: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:47 smithi163 bash[24253]: audit 2024-08-31T06:57:46.881409+0000 mon.a (mon.0) 2430 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:57:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:47 smithi027 bash[22610]: audit 2024-08-31T06:57:46.881409+0000 mon.a (mon.0) 2430 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:57:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:47 smithi191 bash[24992]: audit 2024-08-31T06:57:46.881409+0000 mon.a (mon.0) 2430 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:57:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:48 smithi163 bash[24253]: cluster 2024-08-31T06:57:46.838395+0000 mgr.a (mgr.14388) 12389 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:48 smithi163 bash[24253]: audit 2024-08-31T06:57:47.747821+0000 mon.a (mon.0) 2431 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:57:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:48 smithi163 bash[24253]: audit 2024-08-31T06:57:47.749650+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:57:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:48 smithi163 bash[24253]: audit 2024-08-31T06:57:47.760619+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:57:48.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:48 smithi163 bash[24253]: audit 2024-08-31T06:57:47.765595+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:57:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:48 smithi027 bash[22610]: cluster 2024-08-31T06:57:46.838395+0000 mgr.a (mgr.14388) 12389 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:48 smithi027 bash[22610]: audit 2024-08-31T06:57:47.747821+0000 mon.a (mon.0) 2431 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:57:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:48 smithi027 bash[22610]: audit 2024-08-31T06:57:47.749650+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:57:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:48 smithi027 bash[22610]: audit 2024-08-31T06:57:47.760619+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:57:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:48 smithi027 bash[22610]: audit 2024-08-31T06:57:47.765595+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:57:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:48 smithi191 bash[24992]: cluster 2024-08-31T06:57:46.838395+0000 mgr.a (mgr.14388) 12389 : cluster [DBG] pgmap v8589: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:48 smithi191 bash[24992]: audit 2024-08-31T06:57:47.747821+0000 mon.a (mon.0) 2431 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:57:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:48 smithi191 bash[24992]: audit 2024-08-31T06:57:47.749650+0000 mon.a (mon.0) 2432 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:57:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:48 smithi191 bash[24992]: audit 2024-08-31T06:57:47.760619+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:57:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:48 smithi191 bash[24992]: audit 2024-08-31T06:57:47.765595+0000 mon.a (mon.0) 2434 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:57:48.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:57:48 smithi027 bash[22863]: debug 2024-08-31T06:57:48.513+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:57:48.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:57:48 smithi027 bash[22863]: debug 2024-08-31T06:57:48.517+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:57:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:49 smithi163 bash[24253]: audit 2024-08-31T06:57:47.768049+0000 mgr.a (mgr.14388) 12390 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:57:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:49 smithi163 bash[24253]: audit 2024-08-31T06:57:48.517467+0000 mgr.a (mgr.14388) 12391 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:57:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:49 smithi163 bash[24253]: cephadm 2024-08-31T06:57:48.518829+0000 mgr.a (mgr.14388) 12392 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:57:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:49 smithi027 bash[22610]: audit 2024-08-31T06:57:47.768049+0000 mgr.a (mgr.14388) 12390 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:57:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:49 smithi027 bash[22610]: audit 2024-08-31T06:57:48.517467+0000 mgr.a (mgr.14388) 12391 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:57:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:49 smithi027 bash[22610]: cephadm 2024-08-31T06:57:48.518829+0000 mgr.a (mgr.14388) 12392 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:57:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:49 smithi191 bash[24992]: audit 2024-08-31T06:57:47.768049+0000 mgr.a (mgr.14388) 12390 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:57:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:49 smithi191 bash[24992]: audit 2024-08-31T06:57:48.517467+0000 mgr.a (mgr.14388) 12391 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:57:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:49 smithi191 bash[24992]: cephadm 2024-08-31T06:57:48.518829+0000 mgr.a (mgr.14388) 12392 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:57:50.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:57:50.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:57:50.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:57:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:50 smithi163 bash[24253]: cluster 2024-08-31T06:57:48.841199+0000 mgr.a (mgr.14388) 12393 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:50 smithi027 bash[22610]: cluster 2024-08-31T06:57:48.841199+0000 mgr.a (mgr.14388) 12393 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:50 smithi191 bash[24992]: cluster 2024-08-31T06:57:48.841199+0000 mgr.a (mgr.14388) 12393 : cluster [DBG] pgmap v8590: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:57:50.811 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:57:50.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:57:50.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:57:50.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:57:50.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:57:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:51 smithi163 bash[24253]: audit 2024-08-31T06:57:50.383358+0000 mgr.a (mgr.14388) 12394 : audit [DBG] from='client.271350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:51 smithi027 bash[22610]: audit 2024-08-31T06:57:50.383358+0000 mgr.a (mgr.14388) 12394 : audit [DBG] from='client.271350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:51 smithi191 bash[24992]: audit 2024-08-31T06:57:50.383358+0000 mgr.a (mgr.14388) 12394 : audit [DBG] from='client.271350 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:52 smithi163 bash[24253]: cluster 2024-08-31T06:57:50.841941+0000 mgr.a (mgr.14388) 12395 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:52 smithi027 bash[22610]: cluster 2024-08-31T06:57:50.841941+0000 mgr.a (mgr.14388) 12395 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:52 smithi191 bash[24992]: cluster 2024-08-31T06:57:50.841941+0000 mgr.a (mgr.14388) 12395 : cluster [DBG] pgmap v8591: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:57:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:54 smithi163 bash[24253]: cluster 2024-08-31T06:57:52.844065+0000 mgr.a (mgr.14388) 12396 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:54 smithi027 bash[22610]: cluster 2024-08-31T06:57:52.844065+0000 mgr.a (mgr.14388) 12396 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:54 smithi191 bash[24992]: cluster 2024-08-31T06:57:52.844065+0000 mgr.a (mgr.14388) 12396 : cluster [DBG] pgmap v8592: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:55.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:57:55.813 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:57:55.813 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:57:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:56 smithi163 bash[24253]: cluster 2024-08-31T06:57:54.844852+0000 mgr.a (mgr.14388) 12397 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:56 smithi027 bash[22610]: cluster 2024-08-31T06:57:54.844852+0000 mgr.a (mgr.14388) 12397 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:56 smithi191 bash[24992]: cluster 2024-08-31T06:57:54.844852+0000 mgr.a (mgr.14388) 12397 : cluster [DBG] pgmap v8593: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:56.591 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:57:56.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:57:56.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:57:56.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:57:56.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:57:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:57 smithi163 bash[24253]: audit 2024-08-31T06:57:56.147714+0000 mgr.a (mgr.14388) 12398 : audit [DBG] from='client.271428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:57 smithi027 bash[22610]: audit 2024-08-31T06:57:56.147714+0000 mgr.a (mgr.14388) 12398 : audit [DBG] from='client.271428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:57 smithi191 bash[24992]: audit 2024-08-31T06:57:56.147714+0000 mgr.a (mgr.14388) 12398 : audit [DBG] from='client.271428 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:57:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:57:58 smithi163 bash[24253]: cluster 2024-08-31T06:57:56.845883+0000 mgr.a (mgr.14388) 12399 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:57:58 smithi027 bash[22610]: cluster 2024-08-31T06:57:56.845883+0000 mgr.a (mgr.14388) 12399 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:57:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:57:58 smithi191 bash[24992]: cluster 2024-08-31T06:57:56.845883+0000 mgr.a (mgr.14388) 12399 : cluster [DBG] pgmap v8594: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:00 smithi163 bash[24253]: cluster 2024-08-31T06:57:58.848230+0000 mgr.a (mgr.14388) 12400 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:00 smithi027 bash[22610]: cluster 2024-08-31T06:57:58.848230+0000 mgr.a (mgr.14388) 12400 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:00 smithi191 bash[24992]: cluster 2024-08-31T06:57:58.848230+0000 mgr.a (mgr.14388) 12400 : cluster [DBG] pgmap v8595: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:01.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:01.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:01.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:58:02.351 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:58:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:58:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:58:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:58:02.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:58:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:02 smithi163 bash[24253]: cluster 2024-08-31T06:58:00.849020+0000 mgr.a (mgr.14388) 12401 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:02 smithi027 bash[22610]: cluster 2024-08-31T06:58:00.849020+0000 mgr.a (mgr.14388) 12401 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:02 smithi191 bash[24992]: cluster 2024-08-31T06:58:00.849020+0000 mgr.a (mgr.14388) 12401 : cluster [DBG] pgmap v8596: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:03 smithi163 bash[24253]: audit 2024-08-31T06:58:01.925653+0000 mgr.a (mgr.14388) 12402 : audit [DBG] from='client.271500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:03 smithi027 bash[22610]: audit 2024-08-31T06:58:01.925653+0000 mgr.a (mgr.14388) 12402 : audit [DBG] from='client.271500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:03 smithi191 bash[24992]: audit 2024-08-31T06:58:01.925653+0000 mgr.a (mgr.14388) 12402 : audit [DBG] from='client.271500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:04 smithi163 bash[24253]: cluster 2024-08-31T06:58:02.851509+0000 mgr.a (mgr.14388) 12403 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:04 smithi027 bash[22610]: cluster 2024-08-31T06:58:02.851509+0000 mgr.a (mgr.14388) 12403 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:04 smithi191 bash[24992]: cluster 2024-08-31T06:58:02.851509+0000 mgr.a (mgr.14388) 12403 : cluster [DBG] pgmap v8597: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:06 smithi163 bash[24253]: cluster 2024-08-31T06:58:04.852274+0000 mgr.a (mgr.14388) 12404 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:06 smithi027 bash[22610]: cluster 2024-08-31T06:58:04.852274+0000 mgr.a (mgr.14388) 12404 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:06 smithi191 bash[24992]: cluster 2024-08-31T06:58:04.852274+0000 mgr.a (mgr.14388) 12404 : cluster [DBG] pgmap v8598: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:07.352 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:07.353 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:58:08.131 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:58:08.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:58:08.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:58:08.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:58:08.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:58:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:08 smithi163 bash[24253]: cluster 2024-08-31T06:58:06.853049+0000 mgr.a (mgr.14388) 12405 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:08 smithi027 bash[22610]: cluster 2024-08-31T06:58:06.853049+0000 mgr.a (mgr.14388) 12405 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:08 smithi191 bash[24992]: cluster 2024-08-31T06:58:06.853049+0000 mgr.a (mgr.14388) 12405 : cluster [DBG] pgmap v8599: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:09 smithi163 bash[24253]: audit 2024-08-31T06:58:07.688453+0000 mgr.a (mgr.14388) 12406 : audit [DBG] from='client.271578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:09 smithi027 bash[22610]: audit 2024-08-31T06:58:07.688453+0000 mgr.a (mgr.14388) 12406 : audit [DBG] from='client.271578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:09 smithi191 bash[24992]: audit 2024-08-31T06:58:07.688453+0000 mgr.a (mgr.14388) 12406 : audit [DBG] from='client.271578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:10 smithi163 bash[24253]: cluster 2024-08-31T06:58:08.855832+0000 mgr.a (mgr.14388) 12407 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:10 smithi027 bash[22610]: cluster 2024-08-31T06:58:08.855832+0000 mgr.a (mgr.14388) 12407 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:10 smithi191 bash[24992]: cluster 2024-08-31T06:58:08.855832+0000 mgr.a (mgr.14388) 12407 : cluster [DBG] pgmap v8600: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:12 smithi163 bash[24253]: cluster 2024-08-31T06:58:10.856618+0000 mgr.a (mgr.14388) 12408 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:58:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:12 smithi027 bash[22610]: cluster 2024-08-31T06:58:10.856618+0000 mgr.a (mgr.14388) 12408 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:58:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:12 smithi191 bash[24992]: cluster 2024-08-31T06:58:10.856618+0000 mgr.a (mgr.14388) 12408 : cluster [DBG] pgmap v8601: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:58:13.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:13.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:13.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:58:13.877 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:58:13.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:58:13.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:58:13.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:58:13.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:58:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:14 smithi163 bash[24253]: cluster 2024-08-31T06:58:12.858502+0000 mgr.a (mgr.14388) 12409 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:14 smithi163 bash[24253]: audit 2024-08-31T06:58:13.465811+0000 mgr.a (mgr.14388) 12410 : audit [DBG] from='client.271653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:14 smithi027 bash[22610]: cluster 2024-08-31T06:58:12.858502+0000 mgr.a (mgr.14388) 12409 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:14 smithi027 bash[22610]: audit 2024-08-31T06:58:13.465811+0000 mgr.a (mgr.14388) 12410 : audit [DBG] from='client.271653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:14 smithi191 bash[24992]: cluster 2024-08-31T06:58:12.858502+0000 mgr.a (mgr.14388) 12409 : cluster [DBG] pgmap v8602: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:14 smithi191 bash[24992]: audit 2024-08-31T06:58:13.465811+0000 mgr.a (mgr.14388) 12410 : audit [DBG] from='client.271653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:16 smithi163 bash[24253]: cluster 2024-08-31T06:58:14.859523+0000 mgr.a (mgr.14388) 12411 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:58:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:16 smithi027 bash[22610]: cluster 2024-08-31T06:58:14.859523+0000 mgr.a (mgr.14388) 12411 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:58:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:16 smithi191 bash[24992]: cluster 2024-08-31T06:58:14.859523+0000 mgr.a (mgr.14388) 12411 : cluster [DBG] pgmap v8603: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:58:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:18 smithi163 bash[24253]: cluster 2024-08-31T06:58:16.860356+0000 mgr.a (mgr.14388) 12412 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:58:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:18 smithi027 bash[22610]: cluster 2024-08-31T06:58:16.860356+0000 mgr.a (mgr.14388) 12412 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:58:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:18 smithi191 bash[24992]: cluster 2024-08-31T06:58:16.860356+0000 mgr.a (mgr.14388) 12412 : cluster [DBG] pgmap v8604: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:58:18.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:18.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:18.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:58:19.642 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:58:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:58:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:58:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:58:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:58:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:20 smithi163 bash[24253]: cluster 2024-08-31T06:58:18.862543+0000 mgr.a (mgr.14388) 12413 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:20 smithi163 bash[24253]: audit 2024-08-31T06:58:19.213220+0000 mgr.a (mgr.14388) 12414 : audit [DBG] from='client.271731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:20 smithi027 bash[22610]: cluster 2024-08-31T06:58:18.862543+0000 mgr.a (mgr.14388) 12413 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:20 smithi027 bash[22610]: audit 2024-08-31T06:58:19.213220+0000 mgr.a (mgr.14388) 12414 : audit [DBG] from='client.271731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:20 smithi191 bash[24992]: cluster 2024-08-31T06:58:18.862543+0000 mgr.a (mgr.14388) 12413 : cluster [DBG] pgmap v8605: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:20 smithi191 bash[24992]: audit 2024-08-31T06:58:19.213220+0000 mgr.a (mgr.14388) 12414 : audit [DBG] from='client.271731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:22 smithi027 bash[22610]: cluster 2024-08-31T06:58:20.863411+0000 mgr.a (mgr.14388) 12415 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:22 smithi191 bash[24992]: cluster 2024-08-31T06:58:20.863411+0000 mgr.a (mgr.14388) 12415 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:22 smithi163 bash[24253]: cluster 2024-08-31T06:58:20.863411+0000 mgr.a (mgr.14388) 12415 : cluster [DBG] pgmap v8606: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:24 smithi027 bash[22610]: cluster 2024-08-31T06:58:22.865535+0000 mgr.a (mgr.14388) 12416 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:24 smithi191 bash[24992]: cluster 2024-08-31T06:58:22.865535+0000 mgr.a (mgr.14388) 12416 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:24.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:58:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:24 smithi163 bash[24253]: cluster 2024-08-31T06:58:22.865535+0000 mgr.a (mgr.14388) 12416 : cluster [DBG] pgmap v8607: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:25.398 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:58:25.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:58:25.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:58:25.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:58:25.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:58:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:26 smithi027 bash[22610]: cluster 2024-08-31T06:58:24.866271+0000 mgr.a (mgr.14388) 12417 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:26 smithi027 bash[22610]: audit 2024-08-31T06:58:24.979447+0000 mgr.a (mgr.14388) 12418 : audit [DBG] from='client.271806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:26 smithi191 bash[24992]: cluster 2024-08-31T06:58:24.866271+0000 mgr.a (mgr.14388) 12417 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:26 smithi191 bash[24992]: audit 2024-08-31T06:58:24.979447+0000 mgr.a (mgr.14388) 12418 : audit [DBG] from='client.271806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:26 smithi163 bash[24253]: cluster 2024-08-31T06:58:24.866271+0000 mgr.a (mgr.14388) 12417 : cluster [DBG] pgmap v8608: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:26 smithi163 bash[24253]: audit 2024-08-31T06:58:24.979447+0000 mgr.a (mgr.14388) 12418 : audit [DBG] from='client.271806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:28 smithi027 bash[22610]: cluster 2024-08-31T06:58:26.867188+0000 mgr.a (mgr.14388) 12419 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:28 smithi191 bash[24992]: cluster 2024-08-31T06:58:26.867188+0000 mgr.a (mgr.14388) 12419 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:28 smithi163 bash[24253]: cluster 2024-08-31T06:58:26.867188+0000 mgr.a (mgr.14388) 12419 : cluster [DBG] pgmap v8609: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:30.400 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:30.400 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:30.400 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:58:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:30 smithi027 bash[22610]: cluster 2024-08-31T06:58:28.869370+0000 mgr.a (mgr.14388) 12420 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:30.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:30 smithi191 bash[24992]: cluster 2024-08-31T06:58:28.869370+0000 mgr.a (mgr.14388) 12420 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:30 smithi163 bash[24253]: cluster 2024-08-31T06:58:28.869370+0000 mgr.a (mgr.14388) 12420 : cluster [DBG] pgmap v8610: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:31.184 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:58:31.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:58:31.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:58:31.184 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:58:31.185 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:58:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:32 smithi027 bash[22610]: audit 2024-08-31T06:58:30.731493+0000 mgr.a (mgr.14388) 12421 : audit [DBG] from='client.271884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:32 smithi027 bash[22610]: cluster 2024-08-31T06:58:30.880154+0000 mgr.a (mgr.14388) 12422 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:32 smithi191 bash[24992]: audit 2024-08-31T06:58:30.731493+0000 mgr.a (mgr.14388) 12421 : audit [DBG] from='client.271884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:32 smithi191 bash[24992]: cluster 2024-08-31T06:58:30.880154+0000 mgr.a (mgr.14388) 12422 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:32 smithi163 bash[24253]: audit 2024-08-31T06:58:30.731493+0000 mgr.a (mgr.14388) 12421 : audit [DBG] from='client.271884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:32 smithi163 bash[24253]: cluster 2024-08-31T06:58:30.880154+0000 mgr.a (mgr.14388) 12422 : cluster [DBG] pgmap v8611: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:34 smithi027 bash[22610]: cluster 2024-08-31T06:58:32.882452+0000 mgr.a (mgr.14388) 12423 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:34 smithi191 bash[24992]: cluster 2024-08-31T06:58:32.882452+0000 mgr.a (mgr.14388) 12423 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:34 smithi163 bash[24253]: cluster 2024-08-31T06:58:32.882452+0000 mgr.a (mgr.14388) 12423 : cluster [DBG] pgmap v8612: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:36.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:36.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:36.186 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:58:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:36 smithi027 bash[22610]: cluster 2024-08-31T06:58:34.883381+0000 mgr.a (mgr.14388) 12424 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:36 smithi191 bash[24992]: cluster 2024-08-31T06:58:34.883381+0000 mgr.a (mgr.14388) 12424 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:36 smithi163 bash[24253]: cluster 2024-08-31T06:58:34.883381+0000 mgr.a (mgr.14388) 12424 : cluster [DBG] pgmap v8613: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:36.932 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:58:36.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:58:36.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:58:36.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:58:36.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:58:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:37 smithi191 bash[24992]: audit 2024-08-31T06:58:36.512685+0000 mgr.a (mgr.14388) 12425 : audit [DBG] from='client.271959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:37 smithi163 bash[24253]: audit 2024-08-31T06:58:36.512685+0000 mgr.a (mgr.14388) 12425 : audit [DBG] from='client.271959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:37 smithi027 bash[22610]: audit 2024-08-31T06:58:36.512685+0000 mgr.a (mgr.14388) 12425 : audit [DBG] from='client.271959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:38 smithi191 bash[24992]: cluster 2024-08-31T06:58:36.883936+0000 mgr.a (mgr.14388) 12426 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:38 smithi163 bash[24253]: cluster 2024-08-31T06:58:36.883936+0000 mgr.a (mgr.14388) 12426 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:38 smithi027 bash[22610]: cluster 2024-08-31T06:58:36.883936+0000 mgr.a (mgr.14388) 12426 : cluster [DBG] pgmap v8614: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:40 smithi191 bash[24992]: cluster 2024-08-31T06:58:38.886090+0000 mgr.a (mgr.14388) 12427 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:40 smithi163 bash[24253]: cluster 2024-08-31T06:58:38.886090+0000 mgr.a (mgr.14388) 12427 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:40 smithi027 bash[22610]: cluster 2024-08-31T06:58:38.886090+0000 mgr.a (mgr.14388) 12427 : cluster [DBG] pgmap v8615: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:41.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:41.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:41.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:58:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:42 smithi191 bash[24992]: cluster 2024-08-31T06:58:40.886863+0000 mgr.a (mgr.14388) 12428 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:42 smithi163 bash[24253]: cluster 2024-08-31T06:58:40.886863+0000 mgr.a (mgr.14388) 12428 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:42.713 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:58:42.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:58:42.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:58:42.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:58:42.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:58:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:42 smithi027 bash[22610]: cluster 2024-08-31T06:58:40.886863+0000 mgr.a (mgr.14388) 12428 : cluster [DBG] pgmap v8616: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:43 smithi191 bash[24992]: audit 2024-08-31T06:58:42.272436+0000 mgr.a (mgr.14388) 12429 : audit [DBG] from='client.272037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:43 smithi163 bash[24253]: audit 2024-08-31T06:58:42.272436+0000 mgr.a (mgr.14388) 12429 : audit [DBG] from='client.272037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:43 smithi027 bash[22610]: audit 2024-08-31T06:58:42.272436+0000 mgr.a (mgr.14388) 12429 : audit [DBG] from='client.272037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:44 smithi191 bash[24992]: cluster 2024-08-31T06:58:42.889091+0000 mgr.a (mgr.14388) 12430 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:44 smithi163 bash[24253]: cluster 2024-08-31T06:58:42.889091+0000 mgr.a (mgr.14388) 12430 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:44 smithi027 bash[22610]: cluster 2024-08-31T06:58:42.889091+0000 mgr.a (mgr.14388) 12430 : cluster [DBG] pgmap v8617: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:58:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:46 smithi191 bash[24992]: cluster 2024-08-31T06:58:44.890036+0000 mgr.a (mgr.14388) 12431 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:46 smithi163 bash[24253]: cluster 2024-08-31T06:58:44.890036+0000 mgr.a (mgr.14388) 12431 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:46 smithi027 bash[22610]: cluster 2024-08-31T06:58:44.890036+0000 mgr.a (mgr.14388) 12431 : cluster [DBG] pgmap v8618: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:47.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:47.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:47.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:58:48.460 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:58:48.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:58:48.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:58:48.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:58:48.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:58:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:48 smithi191 bash[24992]: cluster 2024-08-31T06:58:46.891006+0000 mgr.a (mgr.14388) 12432 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:48 smithi163 bash[24253]: cluster 2024-08-31T06:58:46.891006+0000 mgr.a (mgr.14388) 12432 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:48 smithi027 bash[22610]: cluster 2024-08-31T06:58:46.891006+0000 mgr.a (mgr.14388) 12432 : cluster [DBG] pgmap v8619: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:49 smithi191 bash[24992]: audit 2024-08-31T06:58:48.049266+0000 mgr.a (mgr.14388) 12433 : audit [DBG] from='client.272115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:49 smithi191 bash[24992]: audit 2024-08-31T06:58:48.569753+0000 mon.a (mon.0) 2435 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:58:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:49 smithi163 bash[24253]: audit 2024-08-31T06:58:48.049266+0000 mgr.a (mgr.14388) 12433 : audit [DBG] from='client.272115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:49 smithi163 bash[24253]: audit 2024-08-31T06:58:48.569753+0000 mon.a (mon.0) 2435 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:58:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:49 smithi027 bash[22610]: audit 2024-08-31T06:58:48.049266+0000 mgr.a (mgr.14388) 12433 : audit [DBG] from='client.272115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:49 smithi027 bash[22610]: audit 2024-08-31T06:58:48.569753+0000 mon.a (mon.0) 2435 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:58:50.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:58:50 smithi027 bash[22863]: debug 2024-08-31T06:58:50.143+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:58:50.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:58:50 smithi027 bash[22863]: debug 2024-08-31T06:58:50.143+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:58:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:50 smithi027 bash[22610]: cluster 2024-08-31T06:58:48.893706+0000 mgr.a (mgr.14388) 12434 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:50 smithi027 bash[22610]: audit 2024-08-31T06:58:49.389938+0000 mon.a (mon.0) 2436 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:58:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:50 smithi027 bash[22610]: audit 2024-08-31T06:58:49.391586+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:58:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:50 smithi027 bash[22610]: audit 2024-08-31T06:58:49.401909+0000 mon.a (mon.0) 2438 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:58:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:50 smithi027 bash[22610]: audit 2024-08-31T06:58:49.407149+0000 mon.a (mon.0) 2439 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:58:50.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:50 smithi027 bash[22610]: audit 2024-08-31T06:58:49.408374+0000 mgr.a (mgr.14388) 12435 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:58:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:50 smithi191 bash[24992]: cluster 2024-08-31T06:58:48.893706+0000 mgr.a (mgr.14388) 12434 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:50 smithi191 bash[24992]: audit 2024-08-31T06:58:49.389938+0000 mon.a (mon.0) 2436 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:58:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:50 smithi191 bash[24992]: audit 2024-08-31T06:58:49.391586+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:58:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:50 smithi191 bash[24992]: audit 2024-08-31T06:58:49.401909+0000 mon.a (mon.0) 2438 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:58:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:50 smithi191 bash[24992]: audit 2024-08-31T06:58:49.407149+0000 mon.a (mon.0) 2439 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:58:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:50 smithi191 bash[24992]: audit 2024-08-31T06:58:49.408374+0000 mgr.a (mgr.14388) 12435 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:58:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:50 smithi163 bash[24253]: cluster 2024-08-31T06:58:48.893706+0000 mgr.a (mgr.14388) 12434 : cluster [DBG] pgmap v8620: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:58:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:50 smithi163 bash[24253]: audit 2024-08-31T06:58:49.389938+0000 mon.a (mon.0) 2436 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:58:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:50 smithi163 bash[24253]: audit 2024-08-31T06:58:49.391586+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:58:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:50 smithi163 bash[24253]: audit 2024-08-31T06:58:49.401909+0000 mon.a (mon.0) 2438 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:58:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:50 smithi163 bash[24253]: audit 2024-08-31T06:58:49.407149+0000 mon.a (mon.0) 2439 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:58:50.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:50 smithi163 bash[24253]: audit 2024-08-31T06:58:49.408374+0000 mgr.a (mgr.14388) 12435 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:58:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:51 smithi163 bash[24253]: audit 2024-08-31T06:58:50.147834+0000 mgr.a (mgr.14388) 12436 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:58:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:51 smithi163 bash[24253]: cephadm 2024-08-31T06:58:50.149318+0000 mgr.a (mgr.14388) 12437 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:58:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:51 smithi027 bash[22610]: audit 2024-08-31T06:58:50.147834+0000 mgr.a (mgr.14388) 12436 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:58:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:51 smithi027 bash[22610]: cephadm 2024-08-31T06:58:50.149318+0000 mgr.a (mgr.14388) 12437 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:58:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:51 smithi191 bash[24992]: audit 2024-08-31T06:58:50.147834+0000 mgr.a (mgr.14388) 12436 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:58:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:51 smithi191 bash[24992]: cephadm 2024-08-31T06:58:50.149318+0000 mgr.a (mgr.14388) 12437 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:58:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:52 smithi163 bash[24253]: cluster 2024-08-31T06:58:50.894759+0000 mgr.a (mgr.14388) 12438 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:58:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:52 smithi027 bash[22610]: cluster 2024-08-31T06:58:50.894759+0000 mgr.a (mgr.14388) 12438 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:58:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:52 smithi191 bash[24992]: cluster 2024-08-31T06:58:50.894759+0000 mgr.a (mgr.14388) 12438 : cluster [DBG] pgmap v8621: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:58:53.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:53.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:53.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:58:54.246 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:58:54.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:58:54.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:58:54.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:58:54.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:58:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:54 smithi163 bash[24253]: cluster 2024-08-31T06:58:52.896984+0000 mgr.a (mgr.14388) 12439 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:54 smithi027 bash[22610]: cluster 2024-08-31T06:58:52.896984+0000 mgr.a (mgr.14388) 12439 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:54 smithi191 bash[24992]: cluster 2024-08-31T06:58:52.896984+0000 mgr.a (mgr.14388) 12439 : cluster [DBG] pgmap v8622: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:58:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:55 smithi163 bash[24253]: audit 2024-08-31T06:58:53.798294+0000 mgr.a (mgr.14388) 12440 : audit [DBG] from='client.272301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:55 smithi027 bash[22610]: audit 2024-08-31T06:58:53.798294+0000 mgr.a (mgr.14388) 12440 : audit [DBG] from='client.272301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:55 smithi191 bash[24992]: audit 2024-08-31T06:58:53.798294+0000 mgr.a (mgr.14388) 12440 : audit [DBG] from='client.272301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:58:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:56 smithi163 bash[24253]: cluster 2024-08-31T06:58:54.897853+0000 mgr.a (mgr.14388) 12441 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:58:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:56 smithi027 bash[22610]: cluster 2024-08-31T06:58:54.897853+0000 mgr.a (mgr.14388) 12441 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:58:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:56 smithi191 bash[24992]: cluster 2024-08-31T06:58:54.897853+0000 mgr.a (mgr.14388) 12441 : cluster [DBG] pgmap v8623: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:58:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:58:58 smithi163 bash[24253]: cluster 2024-08-31T06:58:56.898648+0000 mgr.a (mgr.14388) 12442 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:58:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:58:58 smithi027 bash[22610]: cluster 2024-08-31T06:58:56.898648+0000 mgr.a (mgr.14388) 12442 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:58:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:58:58 smithi191 bash[24992]: cluster 2024-08-31T06:58:56.898648+0000 mgr.a (mgr.14388) 12442 : cluster [DBG] pgmap v8624: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T06:58:59.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:58:59.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:58:59.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:00.033 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:00 smithi163 bash[24253]: cluster 2024-08-31T06:58:58.900850+0000 mgr.a (mgr.14388) 12443 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:00 smithi163 bash[24253]: audit 2024-08-31T06:58:59.587485+0000 mgr.a (mgr.14388) 12444 : audit [DBG] from='client.272379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:00 smithi027 bash[22610]: cluster 2024-08-31T06:58:58.900850+0000 mgr.a (mgr.14388) 12443 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:00 smithi027 bash[22610]: audit 2024-08-31T06:58:59.587485+0000 mgr.a (mgr.14388) 12444 : audit [DBG] from='client.272379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:00 smithi191 bash[24992]: cluster 2024-08-31T06:58:58.900850+0000 mgr.a (mgr.14388) 12443 : cluster [DBG] pgmap v8625: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:00 smithi191 bash[24992]: audit 2024-08-31T06:58:59.587485+0000 mgr.a (mgr.14388) 12444 : audit [DBG] from='client.272379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:02 smithi163 bash[24253]: cluster 2024-08-31T06:59:00.901736+0000 mgr.a (mgr.14388) 12445 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:02 smithi027 bash[22610]: cluster 2024-08-31T06:59:00.901736+0000 mgr.a (mgr.14388) 12445 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:02 smithi191 bash[24992]: cluster 2024-08-31T06:59:00.901736+0000 mgr.a (mgr.14388) 12445 : cluster [DBG] pgmap v8626: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:04 smithi163 bash[24253]: cluster 2024-08-31T06:59:02.904034+0000 mgr.a (mgr.14388) 12446 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:04 smithi027 bash[22610]: cluster 2024-08-31T06:59:02.904034+0000 mgr.a (mgr.14388) 12446 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:04 smithi191 bash[24992]: cluster 2024-08-31T06:59:02.904034+0000 mgr.a (mgr.14388) 12446 : cluster [DBG] pgmap v8627: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:05.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:59:05.036 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:59:05.036 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:05.795 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:05.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:05.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:05.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:05.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:06 smithi163 bash[24253]: cluster 2024-08-31T06:59:04.904970+0000 mgr.a (mgr.14388) 12447 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:06 smithi163 bash[24253]: audit 2024-08-31T06:59:05.368928+0000 mgr.a (mgr.14388) 12448 : audit [DBG] from='client.272457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:06 smithi027 bash[22610]: cluster 2024-08-31T06:59:04.904970+0000 mgr.a (mgr.14388) 12447 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:06 smithi027 bash[22610]: audit 2024-08-31T06:59:05.368928+0000 mgr.a (mgr.14388) 12448 : audit [DBG] from='client.272457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:06 smithi191 bash[24992]: cluster 2024-08-31T06:59:04.904970+0000 mgr.a (mgr.14388) 12447 : cluster [DBG] pgmap v8628: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:06 smithi191 bash[24992]: audit 2024-08-31T06:59:05.368928+0000 mgr.a (mgr.14388) 12448 : audit [DBG] from='client.272457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:08 smithi163 bash[24253]: cluster 2024-08-31T06:59:06.905864+0000 mgr.a (mgr.14388) 12449 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:08 smithi027 bash[22610]: cluster 2024-08-31T06:59:06.905864+0000 mgr.a (mgr.14388) 12449 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:08 smithi191 bash[24992]: cluster 2024-08-31T06:59:06.905864+0000 mgr.a (mgr.14388) 12449 : cluster [DBG] pgmap v8629: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:10 smithi163 bash[24253]: cluster 2024-08-31T06:59:08.908080+0000 mgr.a (mgr.14388) 12450 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:10 smithi027 bash[22610]: cluster 2024-08-31T06:59:08.908080+0000 mgr.a (mgr.14388) 12450 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:10 smithi191 bash[24992]: cluster 2024-08-31T06:59:08.908080+0000 mgr.a (mgr.14388) 12450 : cluster [DBG] pgmap v8630: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:10.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:59:10.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:59:10.797 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:11.564 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:11.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:12 smithi163 bash[24253]: cluster 2024-08-31T06:59:10.908587+0000 mgr.a (mgr.14388) 12451 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:12 smithi163 bash[24253]: audit 2024-08-31T06:59:11.133635+0000 mgr.a (mgr.14388) 12452 : audit [DBG] from='client.272535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:12 smithi027 bash[22610]: cluster 2024-08-31T06:59:10.908587+0000 mgr.a (mgr.14388) 12451 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:12 smithi027 bash[22610]: audit 2024-08-31T06:59:11.133635+0000 mgr.a (mgr.14388) 12452 : audit [DBG] from='client.272535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:12 smithi191 bash[24992]: cluster 2024-08-31T06:59:10.908587+0000 mgr.a (mgr.14388) 12451 : cluster [DBG] pgmap v8631: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:12 smithi191 bash[24992]: audit 2024-08-31T06:59:11.133635+0000 mgr.a (mgr.14388) 12452 : audit [DBG] from='client.272535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:14 smithi163 bash[24253]: cluster 2024-08-31T06:59:12.910784+0000 mgr.a (mgr.14388) 12453 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:14 smithi027 bash[22610]: cluster 2024-08-31T06:59:12.910784+0000 mgr.a (mgr.14388) 12453 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:14 smithi191 bash[24992]: cluster 2024-08-31T06:59:12.910784+0000 mgr.a (mgr.14388) 12453 : cluster [DBG] pgmap v8632: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:16.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:59:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:59:16.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:16 smithi163 bash[24253]: cluster 2024-08-31T06:59:14.911562+0000 mgr.a (mgr.14388) 12454 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:16 smithi027 bash[22610]: cluster 2024-08-31T06:59:14.911562+0000 mgr.a (mgr.14388) 12454 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:16 smithi191 bash[24992]: cluster 2024-08-31T06:59:14.911562+0000 mgr.a (mgr.14388) 12454 : cluster [DBG] pgmap v8633: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:17.336 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:17.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:17.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:17.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:17.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:18 smithi163 bash[24253]: audit 2024-08-31T06:59:16.896669+0000 mgr.a (mgr.14388) 12455 : audit [DBG] from='client.272613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:18 smithi163 bash[24253]: cluster 2024-08-31T06:59:16.915689+0000 mgr.a (mgr.14388) 12456 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:18 smithi027 bash[22610]: audit 2024-08-31T06:59:16.896669+0000 mgr.a (mgr.14388) 12455 : audit [DBG] from='client.272613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:18 smithi027 bash[22610]: cluster 2024-08-31T06:59:16.915689+0000 mgr.a (mgr.14388) 12456 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:18 smithi191 bash[24992]: audit 2024-08-31T06:59:16.896669+0000 mgr.a (mgr.14388) 12455 : audit [DBG] from='client.272613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:18 smithi191 bash[24992]: cluster 2024-08-31T06:59:16.915689+0000 mgr.a (mgr.14388) 12456 : cluster [DBG] pgmap v8634: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:20 smithi163 bash[24253]: cluster 2024-08-31T06:59:18.918159+0000 mgr.a (mgr.14388) 12457 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:20 smithi027 bash[22610]: cluster 2024-08-31T06:59:18.918159+0000 mgr.a (mgr.14388) 12457 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:20 smithi191 bash[24992]: cluster 2024-08-31T06:59:18.918159+0000 mgr.a (mgr.14388) 12457 : cluster [DBG] pgmap v8635: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:22.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:59:22.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:59:22.339 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:22 smithi163 bash[24253]: cluster 2024-08-31T06:59:20.918977+0000 mgr.a (mgr.14388) 12458 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:22 smithi027 bash[22610]: cluster 2024-08-31T06:59:20.918977+0000 mgr.a (mgr.14388) 12458 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:22 smithi191 bash[24992]: cluster 2024-08-31T06:59:20.918977+0000 mgr.a (mgr.14388) 12458 : cluster [DBG] pgmap v8636: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:23.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:23.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:23.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:23.120 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:23 smithi163 bash[24253]: audit 2024-08-31T06:59:22.672972+0000 mgr.a (mgr.14388) 12459 : audit [DBG] from='client.272691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:23 smithi027 bash[22610]: audit 2024-08-31T06:59:22.672972+0000 mgr.a (mgr.14388) 12459 : audit [DBG] from='client.272691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:23 smithi191 bash[24992]: audit 2024-08-31T06:59:22.672972+0000 mgr.a (mgr.14388) 12459 : audit [DBG] from='client.272691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:24 smithi163 bash[24253]: cluster 2024-08-31T06:59:22.920311+0000 mgr.a (mgr.14388) 12460 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:24 smithi027 bash[22610]: cluster 2024-08-31T06:59:22.920311+0000 mgr.a (mgr.14388) 12460 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:24 smithi191 bash[24992]: cluster 2024-08-31T06:59:22.920311+0000 mgr.a (mgr.14388) 12460 : cluster [DBG] pgmap v8637: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:26 smithi163 bash[24253]: cluster 2024-08-31T06:59:24.921196+0000 mgr.a (mgr.14388) 12461 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:59:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:26 smithi027 bash[22610]: cluster 2024-08-31T06:59:24.921196+0000 mgr.a (mgr.14388) 12461 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:59:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:26 smithi191 bash[24992]: cluster 2024-08-31T06:59:24.921196+0000 mgr.a (mgr.14388) 12461 : cluster [DBG] pgmap v8638: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:59:28.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:59:28.122 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:59:28.122 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:28 smithi163 bash[24253]: cluster 2024-08-31T06:59:26.921981+0000 mgr.a (mgr.14388) 12462 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:59:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:28 smithi027 bash[22610]: cluster 2024-08-31T06:59:26.921981+0000 mgr.a (mgr.14388) 12462 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:59:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:28 smithi191 bash[24992]: cluster 2024-08-31T06:59:26.921981+0000 mgr.a (mgr.14388) 12462 : cluster [DBG] pgmap v8639: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T06:59:28.868 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:28.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:28.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:28.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:28.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:29 smithi163 bash[24253]: audit 2024-08-31T06:59:28.457572+0000 mgr.a (mgr.14388) 12463 : audit [DBG] from='client.272763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:29 smithi027 bash[22610]: audit 2024-08-31T06:59:28.457572+0000 mgr.a (mgr.14388) 12463 : audit [DBG] from='client.272763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:29 smithi191 bash[24992]: audit 2024-08-31T06:59:28.457572+0000 mgr.a (mgr.14388) 12463 : audit [DBG] from='client.272763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:30 smithi163 bash[24253]: cluster 2024-08-31T06:59:28.923259+0000 mgr.a (mgr.14388) 12464 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:30 smithi027 bash[22610]: cluster 2024-08-31T06:59:28.923259+0000 mgr.a (mgr.14388) 12464 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:30 smithi191 bash[24992]: cluster 2024-08-31T06:59:28.923259+0000 mgr.a (mgr.14388) 12464 : cluster [DBG] pgmap v8640: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:32 smithi163 bash[24253]: cluster 2024-08-31T06:59:30.923946+0000 mgr.a (mgr.14388) 12465 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:59:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:32 smithi027 bash[22610]: cluster 2024-08-31T06:59:30.923946+0000 mgr.a (mgr.14388) 12465 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:59:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:32 smithi191 bash[24992]: cluster 2024-08-31T06:59:30.923946+0000 mgr.a (mgr.14388) 12465 : cluster [DBG] pgmap v8641: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T06:59:33.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:59:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:59:33.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:34.659 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:34.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:34.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:34.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:34.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:34 smithi163 bash[24253]: cluster 2024-08-31T06:59:32.925851+0000 mgr.a (mgr.14388) 12466 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:34 smithi027 bash[22610]: cluster 2024-08-31T06:59:32.925851+0000 mgr.a (mgr.14388) 12466 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:34 smithi191 bash[24992]: cluster 2024-08-31T06:59:32.925851+0000 mgr.a (mgr.14388) 12466 : cluster [DBG] pgmap v8642: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:35 smithi163 bash[24253]: audit 2024-08-31T06:59:34.205526+0000 mgr.a (mgr.14388) 12467 : audit [DBG] from='client.272838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:35 smithi027 bash[22610]: audit 2024-08-31T06:59:34.205526+0000 mgr.a (mgr.14388) 12467 : audit [DBG] from='client.272838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:35 smithi191 bash[24992]: audit 2024-08-31T06:59:34.205526+0000 mgr.a (mgr.14388) 12467 : audit [DBG] from='client.272838 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:36 smithi163 bash[24253]: cluster 2024-08-31T06:59:34.926811+0000 mgr.a (mgr.14388) 12468 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:36 smithi027 bash[22610]: cluster 2024-08-31T06:59:34.926811+0000 mgr.a (mgr.14388) 12468 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:36 smithi191 bash[24992]: cluster 2024-08-31T06:59:34.926811+0000 mgr.a (mgr.14388) 12468 : cluster [DBG] pgmap v8643: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:38 smithi163 bash[24253]: cluster 2024-08-31T06:59:36.927593+0000 mgr.a (mgr.14388) 12469 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:38 smithi027 bash[22610]: cluster 2024-08-31T06:59:36.927593+0000 mgr.a (mgr.14388) 12469 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:38 smithi191 bash[24992]: cluster 2024-08-31T06:59:36.927593+0000 mgr.a (mgr.14388) 12469 : cluster [DBG] pgmap v8644: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:39.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:59:39.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:59:39.661 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:40.457 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:40.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:40.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:40.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:40.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:40 smithi163 bash[24253]: cluster 2024-08-31T06:59:38.929782+0000 mgr.a (mgr.14388) 12470 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:40 smithi027 bash[22610]: cluster 2024-08-31T06:59:38.929782+0000 mgr.a (mgr.14388) 12470 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:40 smithi191 bash[24992]: cluster 2024-08-31T06:59:38.929782+0000 mgr.a (mgr.14388) 12470 : cluster [DBG] pgmap v8645: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:41 smithi163 bash[24253]: audit 2024-08-31T06:59:39.999115+0000 mgr.a (mgr.14388) 12471 : audit [DBG] from='client.272916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:41 smithi027 bash[22610]: audit 2024-08-31T06:59:39.999115+0000 mgr.a (mgr.14388) 12471 : audit [DBG] from='client.272916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:41 smithi191 bash[24992]: audit 2024-08-31T06:59:39.999115+0000 mgr.a (mgr.14388) 12471 : audit [DBG] from='client.272916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:42 smithi163 bash[24253]: cluster 2024-08-31T06:59:40.930768+0000 mgr.a (mgr.14388) 12472 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:42 smithi027 bash[22610]: cluster 2024-08-31T06:59:40.930768+0000 mgr.a (mgr.14388) 12472 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:42 smithi191 bash[24992]: cluster 2024-08-31T06:59:40.930768+0000 mgr.a (mgr.14388) 12472 : cluster [DBG] pgmap v8646: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:44 smithi163 bash[24253]: cluster 2024-08-31T06:59:42.932861+0000 mgr.a (mgr.14388) 12473 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:44 smithi027 bash[22610]: cluster 2024-08-31T06:59:42.932861+0000 mgr.a (mgr.14388) 12473 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:44 smithi191 bash[24992]: cluster 2024-08-31T06:59:42.932861+0000 mgr.a (mgr.14388) 12473 : cluster [DBG] pgmap v8647: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:45.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:59:45.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:59:45.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:46.216 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:46.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:46.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:46.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:46.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:46 smithi163 bash[24253]: cluster 2024-08-31T06:59:44.933666+0000 mgr.a (mgr.14388) 12474 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:46 smithi027 bash[22610]: cluster 2024-08-31T06:59:44.933666+0000 mgr.a (mgr.14388) 12474 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:46 smithi191 bash[24992]: cluster 2024-08-31T06:59:44.933666+0000 mgr.a (mgr.14388) 12474 : cluster [DBG] pgmap v8648: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:47 smithi027 bash[22610]: audit 2024-08-31T06:59:45.792187+0000 mgr.a (mgr.14388) 12475 : audit [DBG] from='client.272994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:47 smithi191 bash[24992]: audit 2024-08-31T06:59:45.792187+0000 mgr.a (mgr.14388) 12475 : audit [DBG] from='client.272994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:47 smithi163 bash[24253]: audit 2024-08-31T06:59:45.792187+0000 mgr.a (mgr.14388) 12475 : audit [DBG] from='client.272994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:48 smithi027 bash[22610]: cluster 2024-08-31T06:59:46.934632+0000 mgr.a (mgr.14388) 12476 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:48 smithi191 bash[24992]: cluster 2024-08-31T06:59:46.934632+0000 mgr.a (mgr.14388) 12476 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:48 smithi163 bash[24253]: cluster 2024-08-31T06:59:46.934632+0000 mgr.a (mgr.14388) 12476 : cluster [DBG] pgmap v8649: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:50 smithi027 bash[22610]: cluster 2024-08-31T06:59:48.936894+0000 mgr.a (mgr.14388) 12477 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:50 smithi027 bash[22610]: audit 2024-08-31T06:59:50.201560+0000 mon.a (mon.0) 2440 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:59:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:50 smithi191 bash[24992]: cluster 2024-08-31T06:59:48.936894+0000 mgr.a (mgr.14388) 12477 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:50 smithi191 bash[24992]: audit 2024-08-31T06:59:50.201560+0000 mon.a (mon.0) 2440 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:59:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:50 smithi163 bash[24253]: cluster 2024-08-31T06:59:48.936894+0000 mgr.a (mgr.14388) 12477 : cluster [DBG] pgmap v8650: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T06:59:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:50 smithi163 bash[24253]: audit 2024-08-31T06:59:50.201560+0000 mon.a (mon.0) 2440 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T06:59:51.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:59:51.218 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:59:51.219 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:51.968 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:51.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:51.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:51.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:51.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:51 smithi163 bash[24253]: audit 2024-08-31T06:59:50.821749+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:59:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:51 smithi163 bash[24253]: audit 2024-08-31T06:59:50.827758+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:59:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:51 smithi163 bash[24253]: cluster 2024-08-31T06:59:50.937573+0000 mgr.a (mgr.14388) 12478 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:51 smithi163 bash[24253]: audit 2024-08-31T06:59:51.537385+0000 mgr.a (mgr.14388) 12479 : audit [DBG] from='client.273069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:51 smithi163 bash[24253]: audit 2024-08-31T06:59:51.617091+0000 mon.a (mon.0) 2443 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:59:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:51 smithi163 bash[24253]: audit 2024-08-31T06:59:51.618031+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:59:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:51 smithi163 bash[24253]: audit 2024-08-31T06:59:51.623576+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:59:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:51 smithi163 bash[24253]: audit 2024-08-31T06:59:51.625900+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:59:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:51 smithi163 bash[24253]: audit 2024-08-31T06:59:51.627091+0000 mgr.a (mgr.14388) 12480 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:59:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:51 smithi027 bash[22610]: audit 2024-08-31T06:59:50.821749+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:59:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:51 smithi027 bash[22610]: audit 2024-08-31T06:59:50.827758+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:59:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:51 smithi027 bash[22610]: cluster 2024-08-31T06:59:50.937573+0000 mgr.a (mgr.14388) 12478 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:51 smithi027 bash[22610]: audit 2024-08-31T06:59:51.537385+0000 mgr.a (mgr.14388) 12479 : audit [DBG] from='client.273069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:51 smithi027 bash[22610]: audit 2024-08-31T06:59:51.617091+0000 mon.a (mon.0) 2443 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:59:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:51 smithi027 bash[22610]: audit 2024-08-31T06:59:51.618031+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:59:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:51 smithi027 bash[22610]: audit 2024-08-31T06:59:51.623576+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:59:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:51 smithi027 bash[22610]: audit 2024-08-31T06:59:51.625900+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:59:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:51 smithi027 bash[22610]: audit 2024-08-31T06:59:51.627091+0000 mgr.a (mgr.14388) 12480 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:59:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:51 smithi191 bash[24992]: audit 2024-08-31T06:59:50.821749+0000 mon.a (mon.0) 2441 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:59:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:51 smithi191 bash[24992]: audit 2024-08-31T06:59:50.827758+0000 mon.a (mon.0) 2442 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:59:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:51 smithi191 bash[24992]: cluster 2024-08-31T06:59:50.937573+0000 mgr.a (mgr.14388) 12478 : cluster [DBG] pgmap v8651: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T06:59:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:51 smithi191 bash[24992]: audit 2024-08-31T06:59:51.537385+0000 mgr.a (mgr.14388) 12479 : audit [DBG] from='client.273069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:51 smithi191 bash[24992]: audit 2024-08-31T06:59:51.617091+0000 mon.a (mon.0) 2443 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T06:59:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:51 smithi191 bash[24992]: audit 2024-08-31T06:59:51.618031+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T06:59:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:51 smithi191 bash[24992]: audit 2024-08-31T06:59:51.623576+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T06:59:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:51 smithi191 bash[24992]: audit 2024-08-31T06:59:51.625900+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:59:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:51 smithi191 bash[24992]: audit 2024-08-31T06:59:51.627091+0000 mgr.a (mgr.14388) 12480 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T06:59:52.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:59:52 smithi027 bash[22863]: debug 2024-08-31T06:59:52.669+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:59:52.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 06:59:52 smithi027 bash[22863]: debug 2024-08-31T06:59:52.673+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:59:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:52 smithi027 bash[22610]: audit 2024-08-31T06:59:52.673337+0000 mgr.a (mgr.14388) 12481 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:59:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:52 smithi027 bash[22610]: cephadm 2024-08-31T06:59:52.674885+0000 mgr.a (mgr.14388) 12482 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:59:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:52 smithi163 bash[24253]: audit 2024-08-31T06:59:52.673337+0000 mgr.a (mgr.14388) 12481 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:59:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:52 smithi163 bash[24253]: cephadm 2024-08-31T06:59:52.674885+0000 mgr.a (mgr.14388) 12482 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:59:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:52 smithi191 bash[24992]: audit 2024-08-31T06:59:52.673337+0000 mgr.a (mgr.14388) 12481 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T06:59:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:52 smithi191 bash[24992]: cephadm 2024-08-31T06:59:52.674885+0000 mgr.a (mgr.14388) 12482 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T06:59:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:53 smithi163 bash[24253]: cluster 2024-08-31T06:59:52.939855+0000 mgr.a (mgr.14388) 12483 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:53 smithi027 bash[22610]: cluster 2024-08-31T06:59:52.939855+0000 mgr.a (mgr.14388) 12483 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:53 smithi191 bash[24992]: cluster 2024-08-31T06:59:52.939855+0000 mgr.a (mgr.14388) 12483 : cluster [DBG] pgmap v8652: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:55 smithi191 bash[24992]: cluster 2024-08-31T06:59:54.940771+0000 mgr.a (mgr.14388) 12484 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:55 smithi163 bash[24253]: cluster 2024-08-31T06:59:54.940771+0000 mgr.a (mgr.14388) 12484 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:55 smithi027 bash[22610]: cluster 2024-08-31T06:59:54.940771+0000 mgr.a (mgr.14388) 12484 : cluster [DBG] pgmap v8653: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:56.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T06:59:56.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T06:59:56.971 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T06:59:57.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T06:59:57.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T06:59:57.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T06:59:57.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T06:59:57.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T06:59:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:58 smithi191 bash[24992]: cluster 2024-08-31T06:59:56.941574+0000 mgr.a (mgr.14388) 12485 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 06:59:58 smithi191 bash[24992]: audit 2024-08-31T06:59:57.300906+0000 mgr.a (mgr.14388) 12486 : audit [DBG] from='client.273255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:58 smithi163 bash[24253]: cluster 2024-08-31T06:59:56.941574+0000 mgr.a (mgr.14388) 12485 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 06:59:58 smithi163 bash[24253]: audit 2024-08-31T06:59:57.300906+0000 mgr.a (mgr.14388) 12486 : audit [DBG] from='client.273255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:59:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:58 smithi027 bash[22610]: cluster 2024-08-31T06:59:56.941574+0000 mgr.a (mgr.14388) 12485 : cluster [DBG] pgmap v8654: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T06:59:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 06:59:58 smithi027 bash[22610]: audit 2024-08-31T06:59:57.300906+0000 mgr.a (mgr.14388) 12486 : audit [DBG] from='client.273255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:00 smithi191 bash[24992]: cluster 2024-08-31T06:59:58.943906+0000 mgr.a (mgr.14388) 12487 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:00:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:00 smithi191 bash[24992]: cluster 2024-08-31T07:00:00.000147+0000 mon.a (mon.0) 2447 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:00:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:00 smithi163 bash[24253]: cluster 2024-08-31T06:59:58.943906+0000 mgr.a (mgr.14388) 12487 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:00:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:00 smithi163 bash[24253]: cluster 2024-08-31T07:00:00.000147+0000 mon.a (mon.0) 2447 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:00:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:00 smithi027 bash[22610]: cluster 2024-08-31T06:59:58.943906+0000 mgr.a (mgr.14388) 12487 : cluster [DBG] pgmap v8655: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:00:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:00 smithi027 bash[22610]: cluster 2024-08-31T07:00:00.000147+0000 mon.a (mon.0) 2447 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:00:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:02 smithi191 bash[24992]: cluster 2024-08-31T07:00:00.944712+0000 mgr.a (mgr.14388) 12488 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:00:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:02 smithi163 bash[24253]: cluster 2024-08-31T07:00:00.944712+0000 mgr.a (mgr.14388) 12488 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:00:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:02 smithi027 bash[22610]: cluster 2024-08-31T07:00:00.944712+0000 mgr.a (mgr.14388) 12488 : cluster [DBG] pgmap v8656: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:00:02.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:00:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:00:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:00:03.513 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:00:03.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:00:03.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:00:03.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:00:03.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:00:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:04 smithi191 bash[24992]: cluster 2024-08-31T07:00:02.946320+0000 mgr.a (mgr.14388) 12489 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:00:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:04 smithi191 bash[24992]: audit 2024-08-31T07:00:03.058736+0000 mgr.a (mgr.14388) 12490 : audit [DBG] from='client.273327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:04 smithi163 bash[24253]: cluster 2024-08-31T07:00:02.946320+0000 mgr.a (mgr.14388) 12489 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:00:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:04 smithi163 bash[24253]: audit 2024-08-31T07:00:03.058736+0000 mgr.a (mgr.14388) 12490 : audit [DBG] from='client.273327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:04 smithi027 bash[22610]: cluster 2024-08-31T07:00:02.946320+0000 mgr.a (mgr.14388) 12489 : cluster [DBG] pgmap v8657: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:00:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:04 smithi027 bash[22610]: audit 2024-08-31T07:00:03.058736+0000 mgr.a (mgr.14388) 12490 : audit [DBG] from='client.273327 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:06 smithi191 bash[24992]: cluster 2024-08-31T07:00:04.947229+0000 mgr.a (mgr.14388) 12491 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:06 smithi163 bash[24253]: cluster 2024-08-31T07:00:04.947229+0000 mgr.a (mgr.14388) 12491 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:06 smithi027 bash[22610]: cluster 2024-08-31T07:00:04.947229+0000 mgr.a (mgr.14388) 12491 : cluster [DBG] pgmap v8658: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:08 smithi191 bash[24992]: cluster 2024-08-31T07:00:06.947990+0000 mgr.a (mgr.14388) 12492 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:00:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:08 smithi163 bash[24253]: cluster 2024-08-31T07:00:06.947990+0000 mgr.a (mgr.14388) 12492 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:00:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:08 smithi027 bash[22610]: cluster 2024-08-31T07:00:06.947990+0000 mgr.a (mgr.14388) 12492 : cluster [DBG] pgmap v8659: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:00:08.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:00:08.516 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:00:08.516 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:00:09.297 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:00:09.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:00:09.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:00:09.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:00:09.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:00:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:10 smithi191 bash[24992]: audit 2024-08-31T07:00:08.855076+0000 mgr.a (mgr.14388) 12493 : audit [DBG] from='client.273405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:10 smithi191 bash[24992]: cluster 2024-08-31T07:00:08.949547+0000 mgr.a (mgr.14388) 12494 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:10 smithi163 bash[24253]: audit 2024-08-31T07:00:08.855076+0000 mgr.a (mgr.14388) 12493 : audit [DBG] from='client.273405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:10 smithi163 bash[24253]: cluster 2024-08-31T07:00:08.949547+0000 mgr.a (mgr.14388) 12494 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:10 smithi027 bash[22610]: audit 2024-08-31T07:00:08.855076+0000 mgr.a (mgr.14388) 12493 : audit [DBG] from='client.273405 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:10 smithi027 bash[22610]: cluster 2024-08-31T07:00:08.949547+0000 mgr.a (mgr.14388) 12494 : cluster [DBG] pgmap v8660: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:12 smithi191 bash[24992]: cluster 2024-08-31T07:00:10.950413+0000 mgr.a (mgr.14388) 12495 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:00:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:12 smithi163 bash[24253]: cluster 2024-08-31T07:00:10.950413+0000 mgr.a (mgr.14388) 12495 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:00:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:12 smithi027 bash[22610]: cluster 2024-08-31T07:00:10.950413+0000 mgr.a (mgr.14388) 12495 : cluster [DBG] pgmap v8661: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:00:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:14 smithi191 bash[24992]: cluster 2024-08-31T07:00:12.952635+0000 mgr.a (mgr.14388) 12496 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:14.299 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:00:14.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:00:14.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:00:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:14 smithi163 bash[24253]: cluster 2024-08-31T07:00:12.952635+0000 mgr.a (mgr.14388) 12496 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:14 smithi027 bash[22610]: cluster 2024-08-31T07:00:12.952635+0000 mgr.a (mgr.14388) 12496 : cluster [DBG] pgmap v8662: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:15.059 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:00:15.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:00:15.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:00:15.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:00:15.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:00:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:15 smithi163 bash[24253]: audit 2024-08-31T07:00:14.633545+0000 mgr.a (mgr.14388) 12497 : audit [DBG] from='client.273477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:15 smithi027 bash[22610]: audit 2024-08-31T07:00:14.633545+0000 mgr.a (mgr.14388) 12497 : audit [DBG] from='client.273477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:15 smithi191 bash[24992]: audit 2024-08-31T07:00:14.633545+0000 mgr.a (mgr.14388) 12497 : audit [DBG] from='client.273477 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:16 smithi163 bash[24253]: cluster 2024-08-31T07:00:14.961673+0000 mgr.a (mgr.14388) 12498 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:16 smithi027 bash[22610]: cluster 2024-08-31T07:00:14.961673+0000 mgr.a (mgr.14388) 12498 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:16 smithi191 bash[24992]: cluster 2024-08-31T07:00:14.961673+0000 mgr.a (mgr.14388) 12498 : cluster [DBG] pgmap v8663: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:18 smithi163 bash[24253]: cluster 2024-08-31T07:00:16.962461+0000 mgr.a (mgr.14388) 12499 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:18 smithi027 bash[22610]: cluster 2024-08-31T07:00:16.962461+0000 mgr.a (mgr.14388) 12499 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:18 smithi191 bash[24992]: cluster 2024-08-31T07:00:16.962461+0000 mgr.a (mgr.14388) 12499 : cluster [DBG] pgmap v8664: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:20.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:00:20.060 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:00:20.061 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:00:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:20 smithi163 bash[24253]: cluster 2024-08-31T07:00:18.964711+0000 mgr.a (mgr.14388) 12500 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:20 smithi027 bash[22610]: cluster 2024-08-31T07:00:18.964711+0000 mgr.a (mgr.14388) 12500 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:20 smithi191 bash[24992]: cluster 2024-08-31T07:00:18.964711+0000 mgr.a (mgr.14388) 12500 : cluster [DBG] pgmap v8665: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:20.832 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:00:20.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:00:20.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:00:20.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:00:20.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:00:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:21 smithi163 bash[24253]: audit 2024-08-31T07:00:20.397551+0000 mgr.a (mgr.14388) 12501 : audit [DBG] from='client.273555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:21 smithi027 bash[22610]: audit 2024-08-31T07:00:20.397551+0000 mgr.a (mgr.14388) 12501 : audit [DBG] from='client.273555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:21 smithi191 bash[24992]: audit 2024-08-31T07:00:20.397551+0000 mgr.a (mgr.14388) 12501 : audit [DBG] from='client.273555 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:22 smithi163 bash[24253]: cluster 2024-08-31T07:00:20.965681+0000 mgr.a (mgr.14388) 12502 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:22 smithi027 bash[22610]: cluster 2024-08-31T07:00:20.965681+0000 mgr.a (mgr.14388) 12502 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:22 smithi191 bash[24992]: cluster 2024-08-31T07:00:20.965681+0000 mgr.a (mgr.14388) 12502 : cluster [DBG] pgmap v8666: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:24 smithi163 bash[24253]: cluster 2024-08-31T07:00:22.967863+0000 mgr.a (mgr.14388) 12503 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:24 smithi027 bash[22610]: cluster 2024-08-31T07:00:22.967863+0000 mgr.a (mgr.14388) 12503 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:24 smithi191 bash[24992]: cluster 2024-08-31T07:00:22.967863+0000 mgr.a (mgr.14388) 12503 : cluster [DBG] pgmap v8667: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:25.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:00:25.835 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:00:25.835 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:00:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:26 smithi163 bash[24253]: cluster 2024-08-31T07:00:24.968640+0000 mgr.a (mgr.14388) 12504 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:26 smithi027 bash[22610]: cluster 2024-08-31T07:00:24.968640+0000 mgr.a (mgr.14388) 12504 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:26 smithi191 bash[24992]: cluster 2024-08-31T07:00:24.968640+0000 mgr.a (mgr.14388) 12504 : cluster [DBG] pgmap v8668: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:26.617 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:00:26.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:00:26.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:00:26.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:00:26.618 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:00:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:27 smithi163 bash[24253]: audit 2024-08-31T07:00:26.173179+0000 mgr.a (mgr.14388) 12505 : audit [DBG] from='client.273633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:27 smithi027 bash[22610]: audit 2024-08-31T07:00:26.173179+0000 mgr.a (mgr.14388) 12505 : audit [DBG] from='client.273633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:27 smithi191 bash[24992]: audit 2024-08-31T07:00:26.173179+0000 mgr.a (mgr.14388) 12505 : audit [DBG] from='client.273633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:28 smithi163 bash[24253]: cluster 2024-08-31T07:00:26.969624+0000 mgr.a (mgr.14388) 12506 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:28 smithi027 bash[22610]: cluster 2024-08-31T07:00:26.969624+0000 mgr.a (mgr.14388) 12506 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:28.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:28 smithi191 bash[24992]: cluster 2024-08-31T07:00:26.969624+0000 mgr.a (mgr.14388) 12506 : cluster [DBG] pgmap v8669: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:30 smithi163 bash[24253]: cluster 2024-08-31T07:00:28.971857+0000 mgr.a (mgr.14388) 12507 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:30 smithi027 bash[22610]: cluster 2024-08-31T07:00:28.971857+0000 mgr.a (mgr.14388) 12507 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:30 smithi191 bash[24992]: cluster 2024-08-31T07:00:28.971857+0000 mgr.a (mgr.14388) 12507 : cluster [DBG] pgmap v8670: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:31.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:00:31.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:00:31.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:00:32.396 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:00:32.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:00:32.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:00:32.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:00:32.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:00:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:32 smithi163 bash[24253]: cluster 2024-08-31T07:00:30.972627+0000 mgr.a (mgr.14388) 12508 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:32 smithi027 bash[22610]: cluster 2024-08-31T07:00:30.972627+0000 mgr.a (mgr.14388) 12508 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:32.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:32 smithi191 bash[24992]: cluster 2024-08-31T07:00:30.972627+0000 mgr.a (mgr.14388) 12508 : cluster [DBG] pgmap v8671: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:33 smithi163 bash[24253]: audit 2024-08-31T07:00:31.959110+0000 mgr.a (mgr.14388) 12509 : audit [DBG] from='client.273702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:33 smithi027 bash[22610]: audit 2024-08-31T07:00:31.959110+0000 mgr.a (mgr.14388) 12509 : audit [DBG] from='client.273702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:33 smithi191 bash[24992]: audit 2024-08-31T07:00:31.959110+0000 mgr.a (mgr.14388) 12509 : audit [DBG] from='client.273702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:34 smithi163 bash[24253]: cluster 2024-08-31T07:00:32.975131+0000 mgr.a (mgr.14388) 12510 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:34 smithi027 bash[22610]: cluster 2024-08-31T07:00:32.975131+0000 mgr.a (mgr.14388) 12510 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:34 smithi191 bash[24992]: cluster 2024-08-31T07:00:32.975131+0000 mgr.a (mgr.14388) 12510 : cluster [DBG] pgmap v8672: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:36 smithi163 bash[24253]: cluster 2024-08-31T07:00:34.976100+0000 mgr.a (mgr.14388) 12511 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:36 smithi027 bash[22610]: cluster 2024-08-31T07:00:34.976100+0000 mgr.a (mgr.14388) 12511 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:36 smithi191 bash[24992]: cluster 2024-08-31T07:00:34.976100+0000 mgr.a (mgr.14388) 12511 : cluster [DBG] pgmap v8673: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:37.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:00:37.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:00:37.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:00:38.169 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:00:38.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:00:38.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:00:38.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:00:38.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:00:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:38 smithi163 bash[24253]: cluster 2024-08-31T07:00:36.977051+0000 mgr.a (mgr.14388) 12512 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:38 smithi027 bash[22610]: cluster 2024-08-31T07:00:36.977051+0000 mgr.a (mgr.14388) 12512 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:38 smithi191 bash[24992]: cluster 2024-08-31T07:00:36.977051+0000 mgr.a (mgr.14388) 12512 : cluster [DBG] pgmap v8674: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:39 smithi163 bash[24253]: audit 2024-08-31T07:00:37.734456+0000 mgr.a (mgr.14388) 12513 : audit [DBG] from='client.273774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:39 smithi027 bash[22610]: audit 2024-08-31T07:00:37.734456+0000 mgr.a (mgr.14388) 12513 : audit [DBG] from='client.273774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:39 smithi191 bash[24992]: audit 2024-08-31T07:00:37.734456+0000 mgr.a (mgr.14388) 12513 : audit [DBG] from='client.273774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:40 smithi163 bash[24253]: cluster 2024-08-31T07:00:38.979991+0000 mgr.a (mgr.14388) 12514 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:40 smithi027 bash[22610]: cluster 2024-08-31T07:00:38.979991+0000 mgr.a (mgr.14388) 12514 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:40 smithi191 bash[24992]: cluster 2024-08-31T07:00:38.979991+0000 mgr.a (mgr.14388) 12514 : cluster [DBG] pgmap v8675: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:42 smithi163 bash[24253]: cluster 2024-08-31T07:00:40.980812+0000 mgr.a (mgr.14388) 12515 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:42 smithi027 bash[22610]: cluster 2024-08-31T07:00:40.980812+0000 mgr.a (mgr.14388) 12515 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:42 smithi191 bash[24992]: cluster 2024-08-31T07:00:40.980812+0000 mgr.a (mgr.14388) 12515 : cluster [DBG] pgmap v8676: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:43.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:00:43.171 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:00:43.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:00:43.950 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:00:43.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:00:43.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:00:43.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:00:43.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:00:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:44 smithi163 bash[24253]: cluster 2024-08-31T07:00:42.982777+0000 mgr.a (mgr.14388) 12516 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:44 smithi163 bash[24253]: audit 2024-08-31T07:00:43.507473+0000 mgr.a (mgr.14388) 12517 : audit [DBG] from='client.273849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:44 smithi027 bash[22610]: cluster 2024-08-31T07:00:42.982777+0000 mgr.a (mgr.14388) 12516 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:44 smithi027 bash[22610]: audit 2024-08-31T07:00:43.507473+0000 mgr.a (mgr.14388) 12517 : audit [DBG] from='client.273849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:44 smithi191 bash[24992]: cluster 2024-08-31T07:00:42.982777+0000 mgr.a (mgr.14388) 12516 : cluster [DBG] pgmap v8677: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:44 smithi191 bash[24992]: audit 2024-08-31T07:00:43.507473+0000 mgr.a (mgr.14388) 12517 : audit [DBG] from='client.273849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:46 smithi163 bash[24253]: cluster 2024-08-31T07:00:44.983859+0000 mgr.a (mgr.14388) 12518 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:46 smithi027 bash[22610]: cluster 2024-08-31T07:00:44.983859+0000 mgr.a (mgr.14388) 12518 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:46 smithi191 bash[24992]: cluster 2024-08-31T07:00:44.983859+0000 mgr.a (mgr.14388) 12518 : cluster [DBG] pgmap v8678: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:48 smithi163 bash[24253]: cluster 2024-08-31T07:00:46.984819+0000 mgr.a (mgr.14388) 12519 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:48 smithi027 bash[22610]: cluster 2024-08-31T07:00:46.984819+0000 mgr.a (mgr.14388) 12519 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:48 smithi191 bash[24992]: cluster 2024-08-31T07:00:46.984819+0000 mgr.a (mgr.14388) 12519 : cluster [DBG] pgmap v8679: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:00:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:00:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:00:48.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:00:49.699 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:00:49.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:00:49.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:00:49.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:00:49.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:00:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:50 smithi163 bash[24253]: cluster 2024-08-31T07:00:48.987092+0000 mgr.a (mgr.14388) 12520 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:50.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:50 smithi163 bash[24253]: audit 2024-08-31T07:00:49.283411+0000 mgr.a (mgr.14388) 12521 : audit [DBG] from='client.273924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:50 smithi027 bash[22610]: cluster 2024-08-31T07:00:48.987092+0000 mgr.a (mgr.14388) 12520 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:50 smithi027 bash[22610]: audit 2024-08-31T07:00:49.283411+0000 mgr.a (mgr.14388) 12521 : audit [DBG] from='client.273924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:50 smithi191 bash[24992]: cluster 2024-08-31T07:00:48.987092+0000 mgr.a (mgr.14388) 12520 : cluster [DBG] pgmap v8680: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:50 smithi191 bash[24992]: audit 2024-08-31T07:00:49.283411+0000 mgr.a (mgr.14388) 12521 : audit [DBG] from='client.273924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:52 smithi163 bash[24253]: cluster 2024-08-31T07:00:50.987973+0000 mgr.a (mgr.14388) 12522 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:52 smithi027 bash[22610]: cluster 2024-08-31T07:00:50.987973+0000 mgr.a (mgr.14388) 12522 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:52 smithi191 bash[24992]: cluster 2024-08-31T07:00:50.987973+0000 mgr.a (mgr.14388) 12522 : cluster [DBG] pgmap v8681: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:53 smithi163 bash[24253]: audit 2024-08-31T07:00:52.731460+0000 mon.a (mon.0) 2448 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:00:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:53 smithi027 bash[22610]: audit 2024-08-31T07:00:52.731460+0000 mon.a (mon.0) 2448 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:00:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:53 smithi191 bash[24992]: audit 2024-08-31T07:00:52.731460+0000 mon.a (mon.0) 2448 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:00:54.700 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:00:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:00:54.701 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:00:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:54 smithi163 bash[24253]: cluster 2024-08-31T07:00:52.990153+0000 mgr.a (mgr.14388) 12523 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:54 smithi163 bash[24253]: audit 2024-08-31T07:00:53.344673+0000 mon.a (mon.0) 2449 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:54 smithi163 bash[24253]: audit 2024-08-31T07:00:53.350108+0000 mon.a (mon.0) 2450 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:54 smithi163 bash[24253]: audit 2024-08-31T07:00:53.356045+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:54 smithi163 bash[24253]: audit 2024-08-31T07:00:53.361685+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:54 smithi163 bash[24253]: audit 2024-08-31T07:00:54.063490+0000 mon.a (mon.0) 2453 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:00:54.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:54 smithi163 bash[24253]: audit 2024-08-31T07:00:54.065192+0000 mon.a (mon.0) 2454 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:00:54.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:54 smithi163 bash[24253]: audit 2024-08-31T07:00:54.075268+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:54 smithi163 bash[24253]: audit 2024-08-31T07:00:54.077871+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:00:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22610]: cluster 2024-08-31T07:00:52.990153+0000 mgr.a (mgr.14388) 12523 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22610]: audit 2024-08-31T07:00:53.344673+0000 mon.a (mon.0) 2449 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22610]: audit 2024-08-31T07:00:53.350108+0000 mon.a (mon.0) 2450 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22610]: audit 2024-08-31T07:00:53.356045+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22610]: audit 2024-08-31T07:00:53.361685+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22610]: audit 2024-08-31T07:00:54.063490+0000 mon.a (mon.0) 2453 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:00:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22610]: audit 2024-08-31T07:00:54.065192+0000 mon.a (mon.0) 2454 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:00:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22610]: audit 2024-08-31T07:00:54.075268+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22610]: audit 2024-08-31T07:00:54.077871+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:00:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:54 smithi191 bash[24992]: cluster 2024-08-31T07:00:52.990153+0000 mgr.a (mgr.14388) 12523 : cluster [DBG] pgmap v8682: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:00:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:54 smithi191 bash[24992]: audit 2024-08-31T07:00:53.344673+0000 mon.a (mon.0) 2449 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:54 smithi191 bash[24992]: audit 2024-08-31T07:00:53.350108+0000 mon.a (mon.0) 2450 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:54 smithi191 bash[24992]: audit 2024-08-31T07:00:53.356045+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:54 smithi191 bash[24992]: audit 2024-08-31T07:00:53.361685+0000 mon.a (mon.0) 2452 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:54 smithi191 bash[24992]: audit 2024-08-31T07:00:54.063490+0000 mon.a (mon.0) 2453 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:00:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:54 smithi191 bash[24992]: audit 2024-08-31T07:00:54.065192+0000 mon.a (mon.0) 2454 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:00:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:54 smithi191 bash[24992]: audit 2024-08-31T07:00:54.075268+0000 mon.a (mon.0) 2455 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:00:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:54 smithi191 bash[24992]: audit 2024-08-31T07:00:54.077871+0000 mon.a (mon.0) 2456 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:00:55.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22863]: debug 2024-08-31T07:00:54.792+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:00:55.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:00:54 smithi027 bash[22863]: debug 2024-08-31T07:00:54.796+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:00:55.425 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:00:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:00:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:00:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:00:55.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:00:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:55 smithi163 bash[24253]: audit 2024-08-31T07:00:54.080087+0000 mgr.a (mgr.14388) 12524 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:00:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:55 smithi027 bash[22610]: audit 2024-08-31T07:00:54.080087+0000 mgr.a (mgr.14388) 12524 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:00:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:55 smithi191 bash[24992]: audit 2024-08-31T07:00:54.080087+0000 mgr.a (mgr.14388) 12524 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:00:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:56 smithi163 bash[24253]: audit 2024-08-31T07:00:54.797833+0000 mgr.a (mgr.14388) 12525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:00:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:56 smithi163 bash[24253]: cephadm 2024-08-31T07:00:54.798979+0000 mgr.a (mgr.14388) 12526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:00:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:56 smithi163 bash[24253]: cluster 2024-08-31T07:00:54.990768+0000 mgr.a (mgr.14388) 12527 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:56 smithi163 bash[24253]: audit 2024-08-31T07:00:55.013837+0000 mgr.a (mgr.14388) 12528 : audit [DBG] from='client.274104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:56 smithi027 bash[22610]: audit 2024-08-31T07:00:54.797833+0000 mgr.a (mgr.14388) 12525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:00:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:56 smithi027 bash[22610]: cephadm 2024-08-31T07:00:54.798979+0000 mgr.a (mgr.14388) 12526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:00:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:56 smithi027 bash[22610]: cluster 2024-08-31T07:00:54.990768+0000 mgr.a (mgr.14388) 12527 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:56 smithi027 bash[22610]: audit 2024-08-31T07:00:55.013837+0000 mgr.a (mgr.14388) 12528 : audit [DBG] from='client.274104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:56 smithi191 bash[24992]: audit 2024-08-31T07:00:54.797833+0000 mgr.a (mgr.14388) 12525 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:00:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:56 smithi191 bash[24992]: cephadm 2024-08-31T07:00:54.798979+0000 mgr.a (mgr.14388) 12526 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:00:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:56 smithi191 bash[24992]: cluster 2024-08-31T07:00:54.990768+0000 mgr.a (mgr.14388) 12527 : cluster [DBG] pgmap v8683: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:56 smithi191 bash[24992]: audit 2024-08-31T07:00:55.013837+0000 mgr.a (mgr.14388) 12528 : audit [DBG] from='client.274104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:00:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:00:58 smithi163 bash[24253]: cluster 2024-08-31T07:00:56.991789+0000 mgr.a (mgr.14388) 12529 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:00:58 smithi027 bash[22610]: cluster 2024-08-31T07:00:56.991789+0000 mgr.a (mgr.14388) 12529 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:00:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:00:58 smithi191 bash[24992]: cluster 2024-08-31T07:00:56.991789+0000 mgr.a (mgr.14388) 12529 : cluster [DBG] pgmap v8684: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:00.427 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:00.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:00.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:00 smithi163 bash[24253]: cluster 2024-08-31T07:00:58.994060+0000 mgr.a (mgr.14388) 12530 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:00 smithi027 bash[22610]: cluster 2024-08-31T07:00:58.994060+0000 mgr.a (mgr.14388) 12530 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:00 smithi191 bash[24992]: cluster 2024-08-31T07:00:58.994060+0000 mgr.a (mgr.14388) 12530 : cluster [DBG] pgmap v8685: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:01.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:01.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:01.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:01.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:01.197 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:02 smithi163 bash[24253]: audit 2024-08-31T07:01:00.761669+0000 mgr.a (mgr.14388) 12531 : audit [DBG] from='client.274182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:02 smithi163 bash[24253]: cluster 2024-08-31T07:01:00.999298+0000 mgr.a (mgr.14388) 12532 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:02.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:02 smithi027 bash[22610]: audit 2024-08-31T07:01:00.761669+0000 mgr.a (mgr.14388) 12531 : audit [DBG] from='client.274182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:02.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:02 smithi027 bash[22610]: cluster 2024-08-31T07:01:00.999298+0000 mgr.a (mgr.14388) 12532 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:02 smithi191 bash[24992]: audit 2024-08-31T07:01:00.761669+0000 mgr.a (mgr.14388) 12531 : audit [DBG] from='client.274182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:02 smithi191 bash[24992]: cluster 2024-08-31T07:01:00.999298+0000 mgr.a (mgr.14388) 12532 : cluster [DBG] pgmap v8686: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:04 smithi163 bash[24253]: cluster 2024-08-31T07:01:03.001473+0000 mgr.a (mgr.14388) 12533 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:04 smithi027 bash[22610]: cluster 2024-08-31T07:01:03.001473+0000 mgr.a (mgr.14388) 12533 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:04 smithi191 bash[24992]: cluster 2024-08-31T07:01:03.001473+0000 mgr.a (mgr.14388) 12533 : cluster [DBG] pgmap v8687: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:06.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:06.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:06.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:06 smithi163 bash[24253]: cluster 2024-08-31T07:01:05.002256+0000 mgr.a (mgr.14388) 12534 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:06 smithi027 bash[22610]: cluster 2024-08-31T07:01:05.002256+0000 mgr.a (mgr.14388) 12534 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:06 smithi191 bash[24992]: cluster 2024-08-31T07:01:05.002256+0000 mgr.a (mgr.14388) 12534 : cluster [DBG] pgmap v8688: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:06.976 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:06.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:06.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:06.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:06.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:07 smithi163 bash[24253]: audit 2024-08-31T07:01:06.534373+0000 mgr.a (mgr.14388) 12535 : audit [DBG] from='client.274254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:07 smithi027 bash[22610]: audit 2024-08-31T07:01:06.534373+0000 mgr.a (mgr.14388) 12535 : audit [DBG] from='client.274254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:07 smithi191 bash[24992]: audit 2024-08-31T07:01:06.534373+0000 mgr.a (mgr.14388) 12535 : audit [DBG] from='client.274254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:08 smithi163 bash[24253]: cluster 2024-08-31T07:01:07.002864+0000 mgr.a (mgr.14388) 12536 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:08.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:08 smithi027 bash[22610]: cluster 2024-08-31T07:01:07.002864+0000 mgr.a (mgr.14388) 12536 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:08 smithi191 bash[24992]: cluster 2024-08-31T07:01:07.002864+0000 mgr.a (mgr.14388) 12536 : cluster [DBG] pgmap v8689: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:10 smithi163 bash[24253]: cluster 2024-08-31T07:01:09.005038+0000 mgr.a (mgr.14388) 12537 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:10 smithi027 bash[22610]: cluster 2024-08-31T07:01:09.005038+0000 mgr.a (mgr.14388) 12537 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:10 smithi191 bash[24992]: cluster 2024-08-31T07:01:09.005038+0000 mgr.a (mgr.14388) 12537 : cluster [DBG] pgmap v8690: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:01:11.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:11.978 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:11.979 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:12 smithi163 bash[24253]: cluster 2024-08-31T07:01:11.005795+0000 mgr.a (mgr.14388) 12538 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:12.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:12.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:12.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:12.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:12.727 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:12 smithi027 bash[22610]: cluster 2024-08-31T07:01:11.005795+0000 mgr.a (mgr.14388) 12538 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:12 smithi191 bash[24992]: cluster 2024-08-31T07:01:11.005795+0000 mgr.a (mgr.14388) 12538 : cluster [DBG] pgmap v8691: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:13 smithi163 bash[24253]: audit 2024-08-31T07:01:12.306169+0000 mgr.a (mgr.14388) 12539 : audit [DBG] from='client.274332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:13 smithi027 bash[22610]: audit 2024-08-31T07:01:12.306169+0000 mgr.a (mgr.14388) 12539 : audit [DBG] from='client.274332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:13 smithi191 bash[24992]: audit 2024-08-31T07:01:12.306169+0000 mgr.a (mgr.14388) 12539 : audit [DBG] from='client.274332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:14 smithi163 bash[24253]: cluster 2024-08-31T07:01:13.008054+0000 mgr.a (mgr.14388) 12540 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:14 smithi027 bash[22610]: cluster 2024-08-31T07:01:13.008054+0000 mgr.a (mgr.14388) 12540 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:14 smithi191 bash[24992]: cluster 2024-08-31T07:01:13.008054+0000 mgr.a (mgr.14388) 12540 : cluster [DBG] pgmap v8692: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:16 smithi163 bash[24253]: cluster 2024-08-31T07:01:15.008878+0000 mgr.a (mgr.14388) 12541 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:16.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:16 smithi027 bash[22610]: cluster 2024-08-31T07:01:15.008878+0000 mgr.a (mgr.14388) 12541 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:16 smithi191 bash[24992]: cluster 2024-08-31T07:01:15.008878+0000 mgr.a (mgr.14388) 12541 : cluster [DBG] pgmap v8693: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:17.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:17.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:17.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:18.500 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:18 smithi163 bash[24253]: cluster 2024-08-31T07:01:17.009681+0000 mgr.a (mgr.14388) 12542 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:18 smithi027 bash[22610]: cluster 2024-08-31T07:01:17.009681+0000 mgr.a (mgr.14388) 12542 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:18 smithi191 bash[24992]: cluster 2024-08-31T07:01:17.009681+0000 mgr.a (mgr.14388) 12542 : cluster [DBG] pgmap v8694: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:19 smithi163 bash[24253]: audit 2024-08-31T07:01:18.069900+0000 mgr.a (mgr.14388) 12543 : audit [DBG] from='client.274410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:19.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:19 smithi027 bash[22610]: audit 2024-08-31T07:01:18.069900+0000 mgr.a (mgr.14388) 12543 : audit [DBG] from='client.274410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:19 smithi191 bash[24992]: audit 2024-08-31T07:01:18.069900+0000 mgr.a (mgr.14388) 12543 : audit [DBG] from='client.274410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:20 smithi163 bash[24253]: cluster 2024-08-31T07:01:19.012404+0000 mgr.a (mgr.14388) 12544 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:20 smithi027 bash[22610]: cluster 2024-08-31T07:01:19.012404+0000 mgr.a (mgr.14388) 12544 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:20 smithi191 bash[24992]: cluster 2024-08-31T07:01:19.012404+0000 mgr.a (mgr.14388) 12544 : cluster [DBG] pgmap v8695: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:22 smithi163 bash[24253]: cluster 2024-08-31T07:01:21.013218+0000 mgr.a (mgr.14388) 12545 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:01:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:22 smithi027 bash[22610]: cluster 2024-08-31T07:01:21.013218+0000 mgr.a (mgr.14388) 12545 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:01:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:22 smithi191 bash[24992]: cluster 2024-08-31T07:01:21.013218+0000 mgr.a (mgr.14388) 12545 : cluster [DBG] pgmap v8696: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:01:23.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:23.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:23.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:24.255 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:24.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:24.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:24.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:24.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:24 smithi163 bash[24253]: cluster 2024-08-31T07:01:23.015139+0000 mgr.a (mgr.14388) 12546 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:24 smithi027 bash[22610]: cluster 2024-08-31T07:01:23.015139+0000 mgr.a (mgr.14388) 12546 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:24 smithi191 bash[24992]: cluster 2024-08-31T07:01:23.015139+0000 mgr.a (mgr.14388) 12546 : cluster [DBG] pgmap v8697: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:25 smithi163 bash[24253]: audit 2024-08-31T07:01:23.832710+0000 mgr.a (mgr.14388) 12547 : audit [DBG] from='client.274482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:25 smithi027 bash[22610]: audit 2024-08-31T07:01:23.832710+0000 mgr.a (mgr.14388) 12547 : audit [DBG] from='client.274482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:25 smithi191 bash[24992]: audit 2024-08-31T07:01:23.832710+0000 mgr.a (mgr.14388) 12547 : audit [DBG] from='client.274482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:26 smithi163 bash[24253]: cluster 2024-08-31T07:01:25.016130+0000 mgr.a (mgr.14388) 12548 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:01:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:26 smithi027 bash[22610]: cluster 2024-08-31T07:01:25.016130+0000 mgr.a (mgr.14388) 12548 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:01:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:26 smithi191 bash[24992]: cluster 2024-08-31T07:01:25.016130+0000 mgr.a (mgr.14388) 12548 : cluster [DBG] pgmap v8698: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:01:28.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:28 smithi027 bash[22610]: cluster 2024-08-31T07:01:27.017105+0000 mgr.a (mgr.14388) 12549 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:01:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:28 smithi191 bash[24992]: cluster 2024-08-31T07:01:27.017105+0000 mgr.a (mgr.14388) 12549 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:01:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:28 smithi163 bash[24253]: cluster 2024-08-31T07:01:27.017105+0000 mgr.a (mgr.14388) 12549 : cluster [DBG] pgmap v8699: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:01:29.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:29.258 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:29.996 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:29.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:29.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:29.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:29.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:30 smithi027 bash[22610]: cluster 2024-08-31T07:01:29.019488+0000 mgr.a (mgr.14388) 12550 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:30 smithi027 bash[22610]: audit 2024-08-31T07:01:29.587733+0000 mgr.a (mgr.14388) 12551 : audit [DBG] from='client.274560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:30 smithi191 bash[24992]: cluster 2024-08-31T07:01:29.019488+0000 mgr.a (mgr.14388) 12550 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:30 smithi191 bash[24992]: audit 2024-08-31T07:01:29.587733+0000 mgr.a (mgr.14388) 12551 : audit [DBG] from='client.274560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:30 smithi163 bash[24253]: cluster 2024-08-31T07:01:29.019488+0000 mgr.a (mgr.14388) 12550 : cluster [DBG] pgmap v8700: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:30 smithi163 bash[24253]: audit 2024-08-31T07:01:29.587733+0000 mgr.a (mgr.14388) 12551 : audit [DBG] from='client.274560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:32 smithi027 bash[22610]: cluster 2024-08-31T07:01:31.020406+0000 mgr.a (mgr.14388) 12552 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:32 smithi191 bash[24992]: cluster 2024-08-31T07:01:31.020406+0000 mgr.a (mgr.14388) 12552 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:32 smithi163 bash[24253]: cluster 2024-08-31T07:01:31.020406+0000 mgr.a (mgr.14388) 12552 : cluster [DBG] pgmap v8701: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:34 smithi027 bash[22610]: cluster 2024-08-31T07:01:33.022564+0000 mgr.a (mgr.14388) 12553 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:34 smithi191 bash[24992]: cluster 2024-08-31T07:01:33.022564+0000 mgr.a (mgr.14388) 12553 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:34 smithi163 bash[24253]: cluster 2024-08-31T07:01:33.022564+0000 mgr.a (mgr.14388) 12553 : cluster [DBG] pgmap v8702: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:34.999 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:35.739 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:35.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:35.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:35.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:35.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:36 smithi027 bash[22610]: cluster 2024-08-31T07:01:35.023146+0000 mgr.a (mgr.14388) 12554 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:36 smithi027 bash[22610]: audit 2024-08-31T07:01:35.330206+0000 mgr.a (mgr.14388) 12555 : audit [DBG] from='client.274635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:36 smithi191 bash[24992]: cluster 2024-08-31T07:01:35.023146+0000 mgr.a (mgr.14388) 12554 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:36 smithi191 bash[24992]: audit 2024-08-31T07:01:35.330206+0000 mgr.a (mgr.14388) 12555 : audit [DBG] from='client.274635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:36 smithi163 bash[24253]: cluster 2024-08-31T07:01:35.023146+0000 mgr.a (mgr.14388) 12554 : cluster [DBG] pgmap v8703: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:36 smithi163 bash[24253]: audit 2024-08-31T07:01:35.330206+0000 mgr.a (mgr.14388) 12555 : audit [DBG] from='client.274635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:38 smithi027 bash[22610]: cluster 2024-08-31T07:01:37.024127+0000 mgr.a (mgr.14388) 12556 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:38 smithi191 bash[24992]: cluster 2024-08-31T07:01:37.024127+0000 mgr.a (mgr.14388) 12556 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:38 smithi163 bash[24253]: cluster 2024-08-31T07:01:37.024127+0000 mgr.a (mgr.14388) 12556 : cluster [DBG] pgmap v8704: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:40 smithi027 bash[22610]: cluster 2024-08-31T07:01:39.026519+0000 mgr.a (mgr.14388) 12557 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:40.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:40.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:40.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:40 smithi191 bash[24992]: cluster 2024-08-31T07:01:39.026519+0000 mgr.a (mgr.14388) 12557 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:40 smithi163 bash[24253]: cluster 2024-08-31T07:01:39.026519+0000 mgr.a (mgr.14388) 12557 : cluster [DBG] pgmap v8705: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:41.503 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:41.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:42 smithi027 bash[22610]: cluster 2024-08-31T07:01:41.027429+0000 mgr.a (mgr.14388) 12558 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:42 smithi027 bash[22610]: audit 2024-08-31T07:01:41.073607+0000 mgr.a (mgr.14388) 12559 : audit [DBG] from='client.274710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:42 smithi191 bash[24992]: cluster 2024-08-31T07:01:41.027429+0000 mgr.a (mgr.14388) 12558 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:42 smithi191 bash[24992]: audit 2024-08-31T07:01:41.073607+0000 mgr.a (mgr.14388) 12559 : audit [DBG] from='client.274710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:42 smithi163 bash[24253]: cluster 2024-08-31T07:01:41.027429+0000 mgr.a (mgr.14388) 12558 : cluster [DBG] pgmap v8706: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:42 smithi163 bash[24253]: audit 2024-08-31T07:01:41.073607+0000 mgr.a (mgr.14388) 12559 : audit [DBG] from='client.274710 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:44 smithi191 bash[24992]: cluster 2024-08-31T07:01:43.029661+0000 mgr.a (mgr.14388) 12560 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:44 smithi163 bash[24253]: cluster 2024-08-31T07:01:43.029661+0000 mgr.a (mgr.14388) 12560 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:44 smithi027 bash[22610]: cluster 2024-08-31T07:01:43.029661+0000 mgr.a (mgr.14388) 12560 : cluster [DBG] pgmap v8707: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:46.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:46.506 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:46.506 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:46 smithi191 bash[24992]: cluster 2024-08-31T07:01:45.030423+0000 mgr.a (mgr.14388) 12561 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:46 smithi163 bash[24253]: cluster 2024-08-31T07:01:45.030423+0000 mgr.a (mgr.14388) 12561 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:46 smithi027 bash[22610]: cluster 2024-08-31T07:01:45.030423+0000 mgr.a (mgr.14388) 12561 : cluster [DBG] pgmap v8708: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:47.255 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:47.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:47.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:47.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:47.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:48 smithi191 bash[24992]: audit 2024-08-31T07:01:46.833920+0000 mgr.a (mgr.14388) 12562 : audit [DBG] from='client.274785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:48 smithi191 bash[24992]: cluster 2024-08-31T07:01:47.031067+0000 mgr.a (mgr.14388) 12563 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:48 smithi163 bash[24253]: audit 2024-08-31T07:01:46.833920+0000 mgr.a (mgr.14388) 12562 : audit [DBG] from='client.274785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:48 smithi163 bash[24253]: cluster 2024-08-31T07:01:47.031067+0000 mgr.a (mgr.14388) 12563 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:48 smithi027 bash[22610]: audit 2024-08-31T07:01:46.833920+0000 mgr.a (mgr.14388) 12562 : audit [DBG] from='client.274785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:48 smithi027 bash[22610]: cluster 2024-08-31T07:01:47.031067+0000 mgr.a (mgr.14388) 12563 : cluster [DBG] pgmap v8709: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:50 smithi191 bash[24992]: cluster 2024-08-31T07:01:49.033376+0000 mgr.a (mgr.14388) 12564 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:50 smithi163 bash[24253]: cluster 2024-08-31T07:01:49.033376+0000 mgr.a (mgr.14388) 12564 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:50 smithi027 bash[22610]: cluster 2024-08-31T07:01:49.033376+0000 mgr.a (mgr.14388) 12564 : cluster [DBG] pgmap v8710: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:01:52.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:52.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:52.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:52 smithi191 bash[24992]: cluster 2024-08-31T07:01:51.034145+0000 mgr.a (mgr.14388) 12565 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:52 smithi163 bash[24253]: cluster 2024-08-31T07:01:51.034145+0000 mgr.a (mgr.14388) 12565 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:52 smithi027 bash[22610]: cluster 2024-08-31T07:01:51.034145+0000 mgr.a (mgr.14388) 12565 : cluster [DBG] pgmap v8711: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:01:53.042 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:53.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:53.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:53.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:53.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:53 smithi191 bash[24992]: audit 2024-08-31T07:01:52.591004+0000 mgr.a (mgr.14388) 12566 : audit [DBG] from='client.274860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:53 smithi163 bash[24253]: audit 2024-08-31T07:01:52.591004+0000 mgr.a (mgr.14388) 12566 : audit [DBG] from='client.274860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:53.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:53 smithi027 bash[22610]: audit 2024-08-31T07:01:52.591004+0000 mgr.a (mgr.14388) 12566 : audit [DBG] from='client.274860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:54 smithi191 bash[24992]: cluster 2024-08-31T07:01:53.035864+0000 mgr.a (mgr.14388) 12567 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:01:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:54 smithi163 bash[24253]: cluster 2024-08-31T07:01:53.035864+0000 mgr.a (mgr.14388) 12567 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:01:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:54 smithi027 bash[22610]: cluster 2024-08-31T07:01:53.035864+0000 mgr.a (mgr.14388) 12567 : cluster [DBG] pgmap v8712: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:01:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:55 smithi191 bash[24992]: audit 2024-08-31T07:01:54.850703+0000 mon.a (mon.0) 2457 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:01:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:55 smithi163 bash[24253]: audit 2024-08-31T07:01:54.850703+0000 mon.a (mon.0) 2457 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:01:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:55 smithi027 bash[22610]: audit 2024-08-31T07:01:54.850703+0000 mon.a (mon.0) 2457 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:01:56.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:01:56 smithi027 bash[22863]: debug 2024-08-31T07:01:56.454+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:01:56.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:01:56 smithi027 bash[22863]: debug 2024-08-31T07:01:56.454+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:01:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:56 smithi027 bash[22610]: cluster 2024-08-31T07:01:55.036600+0000 mgr.a (mgr.14388) 12568 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:01:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:56 smithi027 bash[22610]: audit 2024-08-31T07:01:55.693417+0000 mon.a (mon.0) 2458 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:01:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:56 smithi027 bash[22610]: audit 2024-08-31T07:01:55.695172+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:01:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:56 smithi027 bash[22610]: audit 2024-08-31T07:01:55.705686+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:01:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:56 smithi027 bash[22610]: audit 2024-08-31T07:01:55.710544+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:01:56.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:56 smithi027 bash[22610]: audit 2024-08-31T07:01:55.713000+0000 mgr.a (mgr.14388) 12569 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:01:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:56 smithi191 bash[24992]: cluster 2024-08-31T07:01:55.036600+0000 mgr.a (mgr.14388) 12568 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:01:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:56 smithi191 bash[24992]: audit 2024-08-31T07:01:55.693417+0000 mon.a (mon.0) 2458 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:01:56.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:56 smithi191 bash[24992]: audit 2024-08-31T07:01:55.695172+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:01:56.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:56 smithi191 bash[24992]: audit 2024-08-31T07:01:55.705686+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:01:56.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:56 smithi191 bash[24992]: audit 2024-08-31T07:01:55.710544+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:01:56.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:56 smithi191 bash[24992]: audit 2024-08-31T07:01:55.713000+0000 mgr.a (mgr.14388) 12569 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:01:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:56 smithi163 bash[24253]: cluster 2024-08-31T07:01:55.036600+0000 mgr.a (mgr.14388) 12568 : cluster [DBG] pgmap v8713: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:01:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:56 smithi163 bash[24253]: audit 2024-08-31T07:01:55.693417+0000 mon.a (mon.0) 2458 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:01:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:56 smithi163 bash[24253]: audit 2024-08-31T07:01:55.695172+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:01:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:56 smithi163 bash[24253]: audit 2024-08-31T07:01:55.705686+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:01:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:56 smithi163 bash[24253]: audit 2024-08-31T07:01:55.710544+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:01:56.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:56 smithi163 bash[24253]: audit 2024-08-31T07:01:55.713000+0000 mgr.a (mgr.14388) 12569 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:01:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:57 smithi191 bash[24992]: audit 2024-08-31T07:01:56.456216+0000 mgr.a (mgr.14388) 12570 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:01:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:57 smithi191 bash[24992]: cephadm 2024-08-31T07:01:56.457376+0000 mgr.a (mgr.14388) 12571 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:01:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:57 smithi163 bash[24253]: audit 2024-08-31T07:01:56.456216+0000 mgr.a (mgr.14388) 12570 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:01:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:57 smithi163 bash[24253]: cephadm 2024-08-31T07:01:56.457376+0000 mgr.a (mgr.14388) 12571 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:01:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:57 smithi027 bash[22610]: audit 2024-08-31T07:01:56.456216+0000 mgr.a (mgr.14388) 12570 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:01:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:57 smithi027 bash[22610]: cephadm 2024-08-31T07:01:56.457376+0000 mgr.a (mgr.14388) 12571 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:01:58.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:01:58.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:01:58.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:01:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:58 smithi191 bash[24992]: cluster 2024-08-31T07:01:57.037487+0000 mgr.a (mgr.14388) 12572 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:01:58.822 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:01:58.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:01:58.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:01:58.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:01:58.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:01:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:58 smithi163 bash[24253]: cluster 2024-08-31T07:01:57.037487+0000 mgr.a (mgr.14388) 12572 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:01:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:58 smithi027 bash[22610]: cluster 2024-08-31T07:01:57.037487+0000 mgr.a (mgr.14388) 12572 : cluster [DBG] pgmap v8714: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:01:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:01:59 smithi163 bash[24253]: audit 2024-08-31T07:01:58.381932+0000 mgr.a (mgr.14388) 12573 : audit [DBG] from='client.275043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:01:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:01:59 smithi027 bash[22610]: audit 2024-08-31T07:01:58.381932+0000 mgr.a (mgr.14388) 12573 : audit [DBG] from='client.275043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:01:59 smithi191 bash[24992]: audit 2024-08-31T07:01:58.381932+0000 mgr.a (mgr.14388) 12573 : audit [DBG] from='client.275043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:00 smithi163 bash[24253]: cluster 2024-08-31T07:01:59.040376+0000 mgr.a (mgr.14388) 12574 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:02:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:00 smithi027 bash[22610]: cluster 2024-08-31T07:01:59.040376+0000 mgr.a (mgr.14388) 12574 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:02:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:00 smithi191 bash[24992]: cluster 2024-08-31T07:01:59.040376+0000 mgr.a (mgr.14388) 12574 : cluster [DBG] pgmap v8715: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:02:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:02 smithi163 bash[24253]: cluster 2024-08-31T07:02:01.041155+0000 mgr.a (mgr.14388) 12575 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:02:03.066 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:02 smithi191 bash[24992]: cluster 2024-08-31T07:02:01.041155+0000 mgr.a (mgr.14388) 12575 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:02:03.066 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:02 smithi027 bash[22610]: cluster 2024-08-31T07:02:01.041155+0000 mgr.a (mgr.14388) 12575 : cluster [DBG] pgmap v8716: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:02:03.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:02:03.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:02:03.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:02:04.575 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:02:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:02:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:02:04.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:02:04.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:02:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:04 smithi163 bash[24253]: cluster 2024-08-31T07:02:03.043054+0000 mgr.a (mgr.14388) 12576 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:02:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:04 smithi027 bash[22610]: cluster 2024-08-31T07:02:03.043054+0000 mgr.a (mgr.14388) 12576 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:02:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:04 smithi191 bash[24992]: cluster 2024-08-31T07:02:03.043054+0000 mgr.a (mgr.14388) 12576 : cluster [DBG] pgmap v8717: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:02:05.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:05 smithi163 bash[24253]: audit 2024-08-31T07:02:04.160802+0000 mgr.a (mgr.14388) 12577 : audit [DBG] from='client.275121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:05 smithi027 bash[22610]: audit 2024-08-31T07:02:04.160802+0000 mgr.a (mgr.14388) 12577 : audit [DBG] from='client.275121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:05 smithi191 bash[24992]: audit 2024-08-31T07:02:04.160802+0000 mgr.a (mgr.14388) 12577 : audit [DBG] from='client.275121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:06 smithi163 bash[24253]: cluster 2024-08-31T07:02:05.043947+0000 mgr.a (mgr.14388) 12578 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:02:06.987 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:06 smithi027 bash[22610]: cluster 2024-08-31T07:02:05.043947+0000 mgr.a (mgr.14388) 12578 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:02:07.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:06 smithi191 bash[24992]: cluster 2024-08-31T07:02:05.043947+0000 mgr.a (mgr.14388) 12578 : cluster [DBG] pgmap v8718: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:02:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:08 smithi163 bash[24253]: cluster 2024-08-31T07:02:07.044715+0000 mgr.a (mgr.14388) 12579 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:02:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:08 smithi027 bash[22610]: cluster 2024-08-31T07:02:07.044715+0000 mgr.a (mgr.14388) 12579 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:02:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:08 smithi191 bash[24992]: cluster 2024-08-31T07:02:07.044715+0000 mgr.a (mgr.14388) 12579 : cluster [DBG] pgmap v8719: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:02:09.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:02:09.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:02:09.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:02:10.364 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:02:10.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:02:10.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:02:10.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:02:10.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:02:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:10 smithi163 bash[24253]: cluster 2024-08-31T07:02:09.046931+0000 mgr.a (mgr.14388) 12580 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:02:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:10 smithi027 bash[22610]: cluster 2024-08-31T07:02:09.046931+0000 mgr.a (mgr.14388) 12580 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:02:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:10 smithi191 bash[24992]: cluster 2024-08-31T07:02:09.046931+0000 mgr.a (mgr.14388) 12580 : cluster [DBG] pgmap v8720: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:02:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:11 smithi163 bash[24253]: audit 2024-08-31T07:02:09.913381+0000 mgr.a (mgr.14388) 12581 : audit [DBG] from='client.275199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:11 smithi027 bash[22610]: audit 2024-08-31T07:02:09.913381+0000 mgr.a (mgr.14388) 12581 : audit [DBG] from='client.275199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:11 smithi191 bash[24992]: audit 2024-08-31T07:02:09.913381+0000 mgr.a (mgr.14388) 12581 : audit [DBG] from='client.275199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:12 smithi163 bash[24253]: cluster 2024-08-31T07:02:11.047813+0000 mgr.a (mgr.14388) 12582 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:12 smithi027 bash[22610]: cluster 2024-08-31T07:02:11.047813+0000 mgr.a (mgr.14388) 12582 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:12 smithi191 bash[24992]: cluster 2024-08-31T07:02:11.047813+0000 mgr.a (mgr.14388) 12582 : cluster [DBG] pgmap v8721: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:14 smithi163 bash[24253]: cluster 2024-08-31T07:02:13.050081+0000 mgr.a (mgr.14388) 12583 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:02:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:14 smithi027 bash[22610]: cluster 2024-08-31T07:02:13.050081+0000 mgr.a (mgr.14388) 12583 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:02:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:14 smithi191 bash[24992]: cluster 2024-08-31T07:02:13.050081+0000 mgr.a (mgr.14388) 12583 : cluster [DBG] pgmap v8722: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:02:15.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:02:15.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:02:15.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:02:16.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:02:16.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:02:16.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:02:16.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:02:16.129 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:02:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:16 smithi163 bash[24253]: cluster 2024-08-31T07:02:15.050892+0000 mgr.a (mgr.14388) 12584 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:16 smithi163 bash[24253]: audit 2024-08-31T07:02:15.701575+0000 mgr.a (mgr.14388) 12585 : audit [DBG] from='client.275274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:16 smithi027 bash[22610]: cluster 2024-08-31T07:02:15.050892+0000 mgr.a (mgr.14388) 12584 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:16.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:16 smithi027 bash[22610]: audit 2024-08-31T07:02:15.701575+0000 mgr.a (mgr.14388) 12585 : audit [DBG] from='client.275274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:16 smithi191 bash[24992]: cluster 2024-08-31T07:02:15.050892+0000 mgr.a (mgr.14388) 12584 : cluster [DBG] pgmap v8723: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:16 smithi191 bash[24992]: audit 2024-08-31T07:02:15.701575+0000 mgr.a (mgr.14388) 12585 : audit [DBG] from='client.275274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:18 smithi163 bash[24253]: cluster 2024-08-31T07:02:17.051789+0000 mgr.a (mgr.14388) 12586 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:18 smithi027 bash[22610]: cluster 2024-08-31T07:02:17.051789+0000 mgr.a (mgr.14388) 12586 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:18 smithi191 bash[24992]: cluster 2024-08-31T07:02:17.051789+0000 mgr.a (mgr.14388) 12586 : cluster [DBG] pgmap v8724: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:20 smithi163 bash[24253]: cluster 2024-08-31T07:02:19.054006+0000 mgr.a (mgr.14388) 12587 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:02:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:20 smithi027 bash[22610]: cluster 2024-08-31T07:02:19.054006+0000 mgr.a (mgr.14388) 12587 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:02:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:20 smithi191 bash[24992]: cluster 2024-08-31T07:02:19.054006+0000 mgr.a (mgr.14388) 12587 : cluster [DBG] pgmap v8725: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:02:21.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:02:21.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:02:21.131 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:02:21.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:02:21.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:02:21.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:02:21.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:02:21.915 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:02:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:22 smithi163 bash[24253]: cluster 2024-08-31T07:02:21.054797+0000 mgr.a (mgr.14388) 12588 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:22 smithi163 bash[24253]: audit 2024-08-31T07:02:21.469069+0000 mgr.a (mgr.14388) 12589 : audit [DBG] from='client.275352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:22.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:22 smithi027 bash[22610]: cluster 2024-08-31T07:02:21.054797+0000 mgr.a (mgr.14388) 12588 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:22.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:22 smithi027 bash[22610]: audit 2024-08-31T07:02:21.469069+0000 mgr.a (mgr.14388) 12589 : audit [DBG] from='client.275352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:22 smithi191 bash[24992]: cluster 2024-08-31T07:02:21.054797+0000 mgr.a (mgr.14388) 12588 : cluster [DBG] pgmap v8726: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:22 smithi191 bash[24992]: audit 2024-08-31T07:02:21.469069+0000 mgr.a (mgr.14388) 12589 : audit [DBG] from='client.275352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:24 smithi163 bash[24253]: cluster 2024-08-31T07:02:23.057114+0000 mgr.a (mgr.14388) 12590 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:02:24.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:24 smithi027 bash[22610]: cluster 2024-08-31T07:02:23.057114+0000 mgr.a (mgr.14388) 12590 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:02:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:24 smithi191 bash[24992]: cluster 2024-08-31T07:02:23.057114+0000 mgr.a (mgr.14388) 12590 : cluster [DBG] pgmap v8727: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:02:26.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:02:26.916 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:02:26.917 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:02:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:26 smithi163 bash[24253]: cluster 2024-08-31T07:02:25.057907+0000 mgr.a (mgr.14388) 12591 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:26 smithi027 bash[22610]: cluster 2024-08-31T07:02:25.057907+0000 mgr.a (mgr.14388) 12591 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:26 smithi191 bash[24992]: cluster 2024-08-31T07:02:25.057907+0000 mgr.a (mgr.14388) 12591 : cluster [DBG] pgmap v8728: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:27.693 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:02:27.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:02:27.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:02:27.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:02:27.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:02:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:28 smithi163 bash[24253]: cluster 2024-08-31T07:02:27.058458+0000 mgr.a (mgr.14388) 12592 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:28 smithi163 bash[24253]: audit 2024-08-31T07:02:27.252443+0000 mgr.a (mgr.14388) 12593 : audit [DBG] from='client.275430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:28 smithi027 bash[22610]: cluster 2024-08-31T07:02:27.058458+0000 mgr.a (mgr.14388) 12592 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:28.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:28 smithi027 bash[22610]: audit 2024-08-31T07:02:27.252443+0000 mgr.a (mgr.14388) 12593 : audit [DBG] from='client.275430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:28 smithi191 bash[24992]: cluster 2024-08-31T07:02:27.058458+0000 mgr.a (mgr.14388) 12592 : cluster [DBG] pgmap v8729: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:28 smithi191 bash[24992]: audit 2024-08-31T07:02:27.252443+0000 mgr.a (mgr.14388) 12593 : audit [DBG] from='client.275430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:30 smithi163 bash[24253]: cluster 2024-08-31T07:02:29.060715+0000 mgr.a (mgr.14388) 12594 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:02:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:30 smithi027 bash[22610]: cluster 2024-08-31T07:02:29.060715+0000 mgr.a (mgr.14388) 12594 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:02:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:30 smithi191 bash[24992]: cluster 2024-08-31T07:02:29.060715+0000 mgr.a (mgr.14388) 12594 : cluster [DBG] pgmap v8730: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:02:32.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:02:32.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:02:32.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:02:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:32 smithi163 bash[24253]: cluster 2024-08-31T07:02:31.061493+0000 mgr.a (mgr.14388) 12595 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:32 smithi027 bash[22610]: cluster 2024-08-31T07:02:31.061493+0000 mgr.a (mgr.14388) 12595 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:32 smithi191 bash[24992]: cluster 2024-08-31T07:02:31.061493+0000 mgr.a (mgr.14388) 12595 : cluster [DBG] pgmap v8731: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:33.486 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:02:33.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:02:33.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:02:33.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:02:33.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:02:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:34 smithi163 bash[24253]: audit 2024-08-31T07:02:33.032992+0000 mgr.a (mgr.14388) 12596 : audit [DBG] from='client.275505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:34 smithi163 bash[24253]: cluster 2024-08-31T07:02:33.063953+0000 mgr.a (mgr.14388) 12597 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:34.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:34 smithi027 bash[22610]: audit 2024-08-31T07:02:33.032992+0000 mgr.a (mgr.14388) 12596 : audit [DBG] from='client.275505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:34.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:34 smithi027 bash[22610]: cluster 2024-08-31T07:02:33.063953+0000 mgr.a (mgr.14388) 12597 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:34 smithi191 bash[24992]: audit 2024-08-31T07:02:33.032992+0000 mgr.a (mgr.14388) 12596 : audit [DBG] from='client.275505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:34 smithi191 bash[24992]: cluster 2024-08-31T07:02:33.063953+0000 mgr.a (mgr.14388) 12597 : cluster [DBG] pgmap v8732: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:02:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:36 smithi163 bash[24253]: cluster 2024-08-31T07:02:35.064876+0000 mgr.a (mgr.14388) 12598 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:02:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:36 smithi027 bash[22610]: cluster 2024-08-31T07:02:35.064876+0000 mgr.a (mgr.14388) 12598 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:02:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:36 smithi191 bash[24992]: cluster 2024-08-31T07:02:35.064876+0000 mgr.a (mgr.14388) 12598 : cluster [DBG] pgmap v8733: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:02:38.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:02:38.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:02:38.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:02:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:38 smithi163 bash[24253]: cluster 2024-08-31T07:02:37.065633+0000 mgr.a (mgr.14388) 12599 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:02:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:38 smithi027 bash[22610]: cluster 2024-08-31T07:02:37.065633+0000 mgr.a (mgr.14388) 12599 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:02:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:38 smithi191 bash[24992]: cluster 2024-08-31T07:02:37.065633+0000 mgr.a (mgr.14388) 12599 : cluster [DBG] pgmap v8734: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:02:39.296 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:02:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:02:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:02:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:02:39.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:02:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:40 smithi163 bash[24253]: audit 2024-08-31T07:02:38.822065+0000 mgr.a (mgr.14388) 12600 : audit [DBG] from='client.275580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:40 smithi163 bash[24253]: cluster 2024-08-31T07:02:39.074911+0000 mgr.a (mgr.14388) 12601 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:40 smithi027 bash[22610]: audit 2024-08-31T07:02:38.822065+0000 mgr.a (mgr.14388) 12600 : audit [DBG] from='client.275580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:40 smithi027 bash[22610]: cluster 2024-08-31T07:02:39.074911+0000 mgr.a (mgr.14388) 12601 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:40 smithi191 bash[24992]: audit 2024-08-31T07:02:38.822065+0000 mgr.a (mgr.14388) 12600 : audit [DBG] from='client.275580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:40 smithi191 bash[24992]: cluster 2024-08-31T07:02:39.074911+0000 mgr.a (mgr.14388) 12601 : cluster [DBG] pgmap v8735: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:42 smithi163 bash[24253]: cluster 2024-08-31T07:02:41.075792+0000 mgr.a (mgr.14388) 12602 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:02:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:42 smithi027 bash[22610]: cluster 2024-08-31T07:02:41.075792+0000 mgr.a (mgr.14388) 12602 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:02:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:42 smithi191 bash[24992]: cluster 2024-08-31T07:02:41.075792+0000 mgr.a (mgr.14388) 12602 : cluster [DBG] pgmap v8736: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:02:44.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:02:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:02:44.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:02:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:44 smithi163 bash[24253]: cluster 2024-08-31T07:02:43.078005+0000 mgr.a (mgr.14388) 12603 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:44 smithi027 bash[22610]: cluster 2024-08-31T07:02:43.078005+0000 mgr.a (mgr.14388) 12603 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:45.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:02:45.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:02:45.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:02:45.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:02:45.041 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:02:45.042 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:44 smithi191 bash[24992]: cluster 2024-08-31T07:02:43.078005+0000 mgr.a (mgr.14388) 12603 : cluster [DBG] pgmap v8737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:45 smithi163 bash[24253]: audit 2024-08-31T07:02:44.625656+0000 mgr.a (mgr.14388) 12604 : audit [DBG] from='client.275658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:45 smithi027 bash[22610]: audit 2024-08-31T07:02:44.625656+0000 mgr.a (mgr.14388) 12604 : audit [DBG] from='client.275658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:45 smithi191 bash[24992]: audit 2024-08-31T07:02:44.625656+0000 mgr.a (mgr.14388) 12604 : audit [DBG] from='client.275658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:46 smithi163 bash[24253]: cluster 2024-08-31T07:02:45.078462+0000 mgr.a (mgr.14388) 12605 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:46 smithi027 bash[22610]: cluster 2024-08-31T07:02:45.078462+0000 mgr.a (mgr.14388) 12605 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:46 smithi191 bash[24992]: cluster 2024-08-31T07:02:45.078462+0000 mgr.a (mgr.14388) 12605 : cluster [DBG] pgmap v8738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:48 smithi163 bash[24253]: cluster 2024-08-31T07:02:47.079215+0000 mgr.a (mgr.14388) 12606 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:48 smithi027 bash[22610]: cluster 2024-08-31T07:02:47.079215+0000 mgr.a (mgr.14388) 12606 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:48 smithi191 bash[24992]: cluster 2024-08-31T07:02:47.079215+0000 mgr.a (mgr.14388) 12606 : cluster [DBG] pgmap v8739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:50.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:02:50.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:02:50.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:02:50.782 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:02:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:02:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:02:50.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:02:50.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:02:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:50 smithi163 bash[24253]: cluster 2024-08-31T07:02:49.081360+0000 mgr.a (mgr.14388) 12607 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-08-31T07:02:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:50 smithi027 bash[22610]: cluster 2024-08-31T07:02:49.081360+0000 mgr.a (mgr.14388) 12607 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-08-31T07:02:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:50 smithi191 bash[24992]: cluster 2024-08-31T07:02:49.081360+0000 mgr.a (mgr.14388) 12607 : cluster [DBG] pgmap v8740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-08-31T07:02:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:51 smithi163 bash[24253]: audit 2024-08-31T07:02:50.370550+0000 mgr.a (mgr.14388) 12608 : audit [DBG] from='client.275736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:51 smithi027 bash[22610]: audit 2024-08-31T07:02:50.370550+0000 mgr.a (mgr.14388) 12608 : audit [DBG] from='client.275736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:51 smithi191 bash[24992]: audit 2024-08-31T07:02:50.370550+0000 mgr.a (mgr.14388) 12608 : audit [DBG] from='client.275736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:52 smithi163 bash[24253]: cluster 2024-08-31T07:02:51.082407+0000 mgr.a (mgr.14388) 12609 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:52 smithi027 bash[22610]: cluster 2024-08-31T07:02:51.082407+0000 mgr.a (mgr.14388) 12609 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:52 smithi191 bash[24992]: cluster 2024-08-31T07:02:51.082407+0000 mgr.a (mgr.14388) 12609 : cluster [DBG] pgmap v8741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:02:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:54 smithi163 bash[24253]: cluster 2024-08-31T07:02:53.084590+0000 mgr.a (mgr.14388) 12610 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-08-31T07:02:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:54 smithi027 bash[22610]: cluster 2024-08-31T07:02:53.084590+0000 mgr.a (mgr.14388) 12610 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-08-31T07:02:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:54 smithi191 bash[24992]: cluster 2024-08-31T07:02:53.084590+0000 mgr.a (mgr.14388) 12610 : cluster [DBG] pgmap v8742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 58 op/s 2024-08-31T07:02:55.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:02:55.784 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:02:55.784 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:02:56.558 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:02:56.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:02:56.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:02:56.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:02:56.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:02:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:56 smithi163 bash[24253]: cluster 2024-08-31T07:02:55.085353+0000 mgr.a (mgr.14388) 12611 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:56 smithi163 bash[24253]: audit 2024-08-31T07:02:56.506408+0000 mon.a (mon.0) 2462 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:02:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:56 smithi027 bash[22610]: cluster 2024-08-31T07:02:55.085353+0000 mgr.a (mgr.14388) 12611 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:56 smithi027 bash[22610]: audit 2024-08-31T07:02:56.506408+0000 mon.a (mon.0) 2462 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:02:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:56 smithi191 bash[24992]: cluster 2024-08-31T07:02:55.085353+0000 mgr.a (mgr.14388) 12611 : cluster [DBG] pgmap v8743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:56 smithi191 bash[24992]: audit 2024-08-31T07:02:56.506408+0000 mon.a (mon.0) 2462 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:02:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:57 smithi163 bash[24253]: audit 2024-08-31T07:02:56.118575+0000 mgr.a (mgr.14388) 12612 : audit [DBG] from='client.275811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:57 smithi163 bash[24253]: audit 2024-08-31T07:02:57.280007+0000 mon.a (mon.0) 2463 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:02:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:57 smithi163 bash[24253]: audit 2024-08-31T07:02:57.281677+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:02:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:57 smithi163 bash[24253]: audit 2024-08-31T07:02:57.289575+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:02:57.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:57 smithi163 bash[24253]: audit 2024-08-31T07:02:57.294362+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:02:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:57 smithi027 bash[22610]: audit 2024-08-31T07:02:56.118575+0000 mgr.a (mgr.14388) 12612 : audit [DBG] from='client.275811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:57 smithi027 bash[22610]: audit 2024-08-31T07:02:57.280007+0000 mon.a (mon.0) 2463 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:02:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:57 smithi027 bash[22610]: audit 2024-08-31T07:02:57.281677+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:02:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:57 smithi027 bash[22610]: audit 2024-08-31T07:02:57.289575+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:02:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:57 smithi027 bash[22610]: audit 2024-08-31T07:02:57.294362+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:02:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:57 smithi191 bash[24992]: audit 2024-08-31T07:02:56.118575+0000 mgr.a (mgr.14388) 12612 : audit [DBG] from='client.275811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:02:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:57 smithi191 bash[24992]: audit 2024-08-31T07:02:57.280007+0000 mon.a (mon.0) 2463 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:02:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:57 smithi191 bash[24992]: audit 2024-08-31T07:02:57.281677+0000 mon.a (mon.0) 2464 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:02:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:57 smithi191 bash[24992]: audit 2024-08-31T07:02:57.289575+0000 mon.a (mon.0) 2465 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:02:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:57 smithi191 bash[24992]: audit 2024-08-31T07:02:57.294362+0000 mon.a (mon.0) 2466 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:02:58.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:02:58 smithi027 bash[22863]: debug 2024-08-31T07:02:58.009+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:02:58.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:02:58 smithi027 bash[22863]: debug 2024-08-31T07:02:58.013+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:02:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:58 smithi027 bash[22610]: cluster 2024-08-31T07:02:57.085888+0000 mgr.a (mgr.14388) 12613 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:58 smithi027 bash[22610]: audit 2024-08-31T07:02:57.296727+0000 mgr.a (mgr.14388) 12614 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:02:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:58 smithi191 bash[24992]: cluster 2024-08-31T07:02:57.085888+0000 mgr.a (mgr.14388) 12613 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:58 smithi191 bash[24992]: audit 2024-08-31T07:02:57.296727+0000 mgr.a (mgr.14388) 12614 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:02:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:58 smithi163 bash[24253]: cluster 2024-08-31T07:02:57.085888+0000 mgr.a (mgr.14388) 12613 : cluster [DBG] pgmap v8744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:02:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:58 smithi163 bash[24253]: audit 2024-08-31T07:02:57.296727+0000 mgr.a (mgr.14388) 12614 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:02:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:59 smithi027 bash[22610]: audit 2024-08-31T07:02:58.013923+0000 mgr.a (mgr.14388) 12615 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:02:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:02:59 smithi027 bash[22610]: cephadm 2024-08-31T07:02:58.015230+0000 mgr.a (mgr.14388) 12616 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:03:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:59 smithi191 bash[24992]: audit 2024-08-31T07:02:58.013923+0000 mgr.a (mgr.14388) 12615 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:03:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:02:59 smithi191 bash[24992]: cephadm 2024-08-31T07:02:58.015230+0000 mgr.a (mgr.14388) 12616 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:03:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:59 smithi163 bash[24253]: audit 2024-08-31T07:02:58.013923+0000 mgr.a (mgr.14388) 12615 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:03:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:02:59 smithi163 bash[24253]: cephadm 2024-08-31T07:02:58.015230+0000 mgr.a (mgr.14388) 12616 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:03:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:00 smithi027 bash[22610]: cluster 2024-08-31T07:02:59.088313+0000 mgr.a (mgr.14388) 12617 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T07:03:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:00 smithi191 bash[24992]: cluster 2024-08-31T07:02:59.088313+0000 mgr.a (mgr.14388) 12617 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T07:03:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:00 smithi163 bash[24253]: cluster 2024-08-31T07:02:59.088313+0000 mgr.a (mgr.14388) 12617 : cluster [DBG] pgmap v8745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T07:03:01.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:01.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:01.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:02.343 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:03:02.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:03:02.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:03:02.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:03:02.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:03:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:02 smithi027 bash[22610]: cluster 2024-08-31T07:03:01.089118+0000 mgr.a (mgr.14388) 12618 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:03:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:02 smithi191 bash[24992]: cluster 2024-08-31T07:03:01.089118+0000 mgr.a (mgr.14388) 12618 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:03:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:02 smithi163 bash[24253]: cluster 2024-08-31T07:03:01.089118+0000 mgr.a (mgr.14388) 12618 : cluster [DBG] pgmap v8746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:03:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:03 smithi191 bash[24992]: audit 2024-08-31T07:03:01.898563+0000 mgr.a (mgr.14388) 12619 : audit [DBG] from='client.275997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:03 smithi163 bash[24253]: audit 2024-08-31T07:03:01.898563+0000 mgr.a (mgr.14388) 12619 : audit [DBG] from='client.275997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:03 smithi027 bash[22610]: audit 2024-08-31T07:03:01.898563+0000 mgr.a (mgr.14388) 12619 : audit [DBG] from='client.275997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:04 smithi191 bash[24992]: cluster 2024-08-31T07:03:03.091429+0000 mgr.a (mgr.14388) 12620 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:04 smithi163 bash[24253]: cluster 2024-08-31T07:03:03.091429+0000 mgr.a (mgr.14388) 12620 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:04 smithi027 bash[22610]: cluster 2024-08-31T07:03:03.091429+0000 mgr.a (mgr.14388) 12620 : cluster [DBG] pgmap v8747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:06 smithi191 bash[24992]: cluster 2024-08-31T07:03:05.092251+0000 mgr.a (mgr.14388) 12621 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:06 smithi163 bash[24253]: cluster 2024-08-31T07:03:05.092251+0000 mgr.a (mgr.14388) 12621 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:06 smithi027 bash[22610]: cluster 2024-08-31T07:03:05.092251+0000 mgr.a (mgr.14388) 12621 : cluster [DBG] pgmap v8748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:07.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:07.346 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:07.346 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:03:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:03:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:03:08.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:03:08.093 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:03:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:08 smithi191 bash[24992]: cluster 2024-08-31T07:03:07.093186+0000 mgr.a (mgr.14388) 12622 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:08 smithi191 bash[24992]: audit 2024-08-31T07:03:07.680671+0000 mgr.a (mgr.14388) 12623 : audit [DBG] from='client.276075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:08 smithi163 bash[24253]: cluster 2024-08-31T07:03:07.093186+0000 mgr.a (mgr.14388) 12622 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:08 smithi163 bash[24253]: audit 2024-08-31T07:03:07.680671+0000 mgr.a (mgr.14388) 12623 : audit [DBG] from='client.276075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:08 smithi027 bash[22610]: cluster 2024-08-31T07:03:07.093186+0000 mgr.a (mgr.14388) 12622 : cluster [DBG] pgmap v8749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:08 smithi027 bash[22610]: audit 2024-08-31T07:03:07.680671+0000 mgr.a (mgr.14388) 12623 : audit [DBG] from='client.276075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:09 smithi163 bash[24253]: cluster 2024-08-31T07:03:09.096075+0000 mgr.a (mgr.14388) 12624 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:09 smithi027 bash[22610]: cluster 2024-08-31T07:03:09.096075+0000 mgr.a (mgr.14388) 12624 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:09 smithi191 bash[24992]: cluster 2024-08-31T07:03:09.096075+0000 mgr.a (mgr.14388) 12624 : cluster [DBG] pgmap v8750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:03:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:12 smithi163 bash[24253]: cluster 2024-08-31T07:03:11.097040+0000 mgr.a (mgr.14388) 12625 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:03:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:12 smithi027 bash[22610]: cluster 2024-08-31T07:03:11.097040+0000 mgr.a (mgr.14388) 12625 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:03:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:12 smithi191 bash[24992]: cluster 2024-08-31T07:03:11.097040+0000 mgr.a (mgr.14388) 12625 : cluster [DBG] pgmap v8751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:03:13.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:13.095 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:13.095 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:13.862 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:03:13.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:03:13.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:03:13.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:03:13.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:03:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:14 smithi163 bash[24253]: cluster 2024-08-31T07:03:13.098393+0000 mgr.a (mgr.14388) 12626 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:03:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:14 smithi163 bash[24253]: audit 2024-08-31T07:03:13.428273+0000 mgr.a (mgr.14388) 12627 : audit [DBG] from='client.276153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:14 smithi027 bash[22610]: cluster 2024-08-31T07:03:13.098393+0000 mgr.a (mgr.14388) 12626 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:03:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:14 smithi027 bash[22610]: audit 2024-08-31T07:03:13.428273+0000 mgr.a (mgr.14388) 12627 : audit [DBG] from='client.276153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:14 smithi191 bash[24992]: cluster 2024-08-31T07:03:13.098393+0000 mgr.a (mgr.14388) 12626 : cluster [DBG] pgmap v8752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:03:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:14 smithi191 bash[24992]: audit 2024-08-31T07:03:13.428273+0000 mgr.a (mgr.14388) 12627 : audit [DBG] from='client.276153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:16 smithi163 bash[24253]: cluster 2024-08-31T07:03:15.099351+0000 mgr.a (mgr.14388) 12628 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:03:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:16 smithi027 bash[22610]: cluster 2024-08-31T07:03:15.099351+0000 mgr.a (mgr.14388) 12628 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:03:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:16 smithi191 bash[24992]: cluster 2024-08-31T07:03:15.099351+0000 mgr.a (mgr.14388) 12628 : cluster [DBG] pgmap v8753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:03:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:18 smithi163 bash[24253]: cluster 2024-08-31T07:03:17.100301+0000 mgr.a (mgr.14388) 12629 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:03:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:18 smithi027 bash[22610]: cluster 2024-08-31T07:03:17.100301+0000 mgr.a (mgr.14388) 12629 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:03:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:18 smithi191 bash[24992]: cluster 2024-08-31T07:03:17.100301+0000 mgr.a (mgr.14388) 12629 : cluster [DBG] pgmap v8754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:03:18.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:18.864 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:18.864 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:19.642 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:03:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:03:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:03:19.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:03:19.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:03:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:20 smithi163 bash[24253]: cluster 2024-08-31T07:03:19.102435+0000 mgr.a (mgr.14388) 12630 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:20 smithi163 bash[24253]: audit 2024-08-31T07:03:19.201619+0000 mgr.a (mgr.14388) 12631 : audit [DBG] from='client.276231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:20 smithi027 bash[22610]: cluster 2024-08-31T07:03:19.102435+0000 mgr.a (mgr.14388) 12630 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:20 smithi027 bash[22610]: audit 2024-08-31T07:03:19.201619+0000 mgr.a (mgr.14388) 12631 : audit [DBG] from='client.276231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:20 smithi191 bash[24992]: cluster 2024-08-31T07:03:19.102435+0000 mgr.a (mgr.14388) 12630 : cluster [DBG] pgmap v8755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:20 smithi191 bash[24992]: audit 2024-08-31T07:03:19.201619+0000 mgr.a (mgr.14388) 12631 : audit [DBG] from='client.276231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:22 smithi163 bash[24253]: cluster 2024-08-31T07:03:21.103424+0000 mgr.a (mgr.14388) 12632 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:22 smithi027 bash[22610]: cluster 2024-08-31T07:03:21.103424+0000 mgr.a (mgr.14388) 12632 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:22 smithi191 bash[24992]: cluster 2024-08-31T07:03:21.103424+0000 mgr.a (mgr.14388) 12632 : cluster [DBG] pgmap v8756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:24 smithi163 bash[24253]: cluster 2024-08-31T07:03:23.105571+0000 mgr.a (mgr.14388) 12633 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:24 smithi027 bash[22610]: cluster 2024-08-31T07:03:23.105571+0000 mgr.a (mgr.14388) 12633 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:24 smithi191 bash[24992]: cluster 2024-08-31T07:03:23.105571+0000 mgr.a (mgr.14388) 12633 : cluster [DBG] pgmap v8757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:24.644 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:25.409 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:03:25.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:03:25.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:03:25.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:03:25.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:03:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:26 smithi163 bash[24253]: audit 2024-08-31T07:03:24.975989+0000 mgr.a (mgr.14388) 12634 : audit [DBG] from='client.276309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:26 smithi163 bash[24253]: cluster 2024-08-31T07:03:25.106093+0000 mgr.a (mgr.14388) 12635 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:26 smithi027 bash[22610]: audit 2024-08-31T07:03:24.975989+0000 mgr.a (mgr.14388) 12634 : audit [DBG] from='client.276309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:26 smithi027 bash[22610]: cluster 2024-08-31T07:03:25.106093+0000 mgr.a (mgr.14388) 12635 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:26 smithi191 bash[24992]: audit 2024-08-31T07:03:24.975989+0000 mgr.a (mgr.14388) 12634 : audit [DBG] from='client.276309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:26 smithi191 bash[24992]: cluster 2024-08-31T07:03:25.106093+0000 mgr.a (mgr.14388) 12635 : cluster [DBG] pgmap v8758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:28 smithi163 bash[24253]: cluster 2024-08-31T07:03:27.107164+0000 mgr.a (mgr.14388) 12636 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:28 smithi027 bash[22610]: cluster 2024-08-31T07:03:27.107164+0000 mgr.a (mgr.14388) 12636 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:28 smithi191 bash[24992]: cluster 2024-08-31T07:03:27.107164+0000 mgr.a (mgr.14388) 12636 : cluster [DBG] pgmap v8759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:30.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:30.412 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:30.412 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:30 smithi163 bash[24253]: cluster 2024-08-31T07:03:29.109554+0000 mgr.a (mgr.14388) 12637 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:30 smithi027 bash[22610]: cluster 2024-08-31T07:03:29.109554+0000 mgr.a (mgr.14388) 12637 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:30 smithi191 bash[24992]: cluster 2024-08-31T07:03:29.109554+0000 mgr.a (mgr.14388) 12637 : cluster [DBG] pgmap v8760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:31.195 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:03:31.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:03:31.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:03:31.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:03:31.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:03:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:32 smithi163 bash[24253]: audit 2024-08-31T07:03:30.752072+0000 mgr.a (mgr.14388) 12638 : audit [DBG] from='client.276387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:32 smithi163 bash[24253]: cluster 2024-08-31T07:03:31.110268+0000 mgr.a (mgr.14388) 12639 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:32 smithi027 bash[22610]: audit 2024-08-31T07:03:30.752072+0000 mgr.a (mgr.14388) 12638 : audit [DBG] from='client.276387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:32 smithi027 bash[22610]: cluster 2024-08-31T07:03:31.110268+0000 mgr.a (mgr.14388) 12639 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:32 smithi191 bash[24992]: audit 2024-08-31T07:03:30.752072+0000 mgr.a (mgr.14388) 12638 : audit [DBG] from='client.276387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:32 smithi191 bash[24992]: cluster 2024-08-31T07:03:31.110268+0000 mgr.a (mgr.14388) 12639 : cluster [DBG] pgmap v8761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:34 smithi027 bash[22610]: cluster 2024-08-31T07:03:33.112477+0000 mgr.a (mgr.14388) 12640 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:34 smithi191 bash[24992]: cluster 2024-08-31T07:03:33.112477+0000 mgr.a (mgr.14388) 12640 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:34 smithi163 bash[24253]: cluster 2024-08-31T07:03:33.112477+0000 mgr.a (mgr.14388) 12640 : cluster [DBG] pgmap v8762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:36.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:36.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:36.201 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:36 smithi027 bash[22610]: cluster 2024-08-31T07:03:35.113420+0000 mgr.a (mgr.14388) 12641 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:36 smithi191 bash[24992]: cluster 2024-08-31T07:03:35.113420+0000 mgr.a (mgr.14388) 12641 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:36 smithi163 bash[24253]: cluster 2024-08-31T07:03:35.113420+0000 mgr.a (mgr.14388) 12641 : cluster [DBG] pgmap v8763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:36.973 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:03:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:03:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:03:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:03:36.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:03:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:37 smithi027 bash[22610]: audit 2024-08-31T07:03:36.539193+0000 mgr.a (mgr.14388) 12642 : audit [DBG] from='client.276465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:37 smithi191 bash[24992]: audit 2024-08-31T07:03:36.539193+0000 mgr.a (mgr.14388) 12642 : audit [DBG] from='client.276465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:37 smithi163 bash[24253]: audit 2024-08-31T07:03:36.539193+0000 mgr.a (mgr.14388) 12642 : audit [DBG] from='client.276465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:38 smithi027 bash[22610]: cluster 2024-08-31T07:03:37.114354+0000 mgr.a (mgr.14388) 12643 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:38 smithi191 bash[24992]: cluster 2024-08-31T07:03:37.114354+0000 mgr.a (mgr.14388) 12643 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:38 smithi163 bash[24253]: cluster 2024-08-31T07:03:37.114354+0000 mgr.a (mgr.14388) 12643 : cluster [DBG] pgmap v8764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:40 smithi027 bash[22610]: cluster 2024-08-31T07:03:39.116564+0000 mgr.a (mgr.14388) 12644 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:40 smithi191 bash[24992]: cluster 2024-08-31T07:03:39.116564+0000 mgr.a (mgr.14388) 12644 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:40 smithi163 bash[24253]: cluster 2024-08-31T07:03:39.116564+0000 mgr.a (mgr.14388) 12644 : cluster [DBG] pgmap v8765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:41.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:41.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:41.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:42 smithi027 bash[22610]: cluster 2024-08-31T07:03:41.117341+0000 mgr.a (mgr.14388) 12645 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:42 smithi191 bash[24992]: cluster 2024-08-31T07:03:41.117341+0000 mgr.a (mgr.14388) 12645 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:42 smithi163 bash[24253]: cluster 2024-08-31T07:03:41.117341+0000 mgr.a (mgr.14388) 12645 : cluster [DBG] pgmap v8766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:42.721 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:03:42.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:03:42.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:03:42.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:03:42.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:03:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:43 smithi191 bash[24992]: audit 2024-08-31T07:03:42.308418+0000 mgr.a (mgr.14388) 12646 : audit [DBG] from='client.276543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:43 smithi163 bash[24253]: audit 2024-08-31T07:03:42.308418+0000 mgr.a (mgr.14388) 12646 : audit [DBG] from='client.276543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:43 smithi027 bash[22610]: audit 2024-08-31T07:03:42.308418+0000 mgr.a (mgr.14388) 12646 : audit [DBG] from='client.276543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:44 smithi191 bash[24992]: cluster 2024-08-31T07:03:43.119760+0000 mgr.a (mgr.14388) 12647 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:44 smithi163 bash[24253]: cluster 2024-08-31T07:03:43.119760+0000 mgr.a (mgr.14388) 12647 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:44.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:44 smithi027 bash[22610]: cluster 2024-08-31T07:03:43.119760+0000 mgr.a (mgr.14388) 12647 : cluster [DBG] pgmap v8767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:03:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:46 smithi191 bash[24992]: cluster 2024-08-31T07:03:45.120716+0000 mgr.a (mgr.14388) 12648 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:46 smithi163 bash[24253]: cluster 2024-08-31T07:03:45.120716+0000 mgr.a (mgr.14388) 12648 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:46 smithi027 bash[22610]: cluster 2024-08-31T07:03:45.120716+0000 mgr.a (mgr.14388) 12648 : cluster [DBG] pgmap v8768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:47.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:47.723 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:47.724 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:48.515 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:03:48.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:03:48.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:03:48.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:03:48.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:03:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:48 smithi191 bash[24992]: cluster 2024-08-31T07:03:47.121732+0000 mgr.a (mgr.14388) 12649 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:48 smithi163 bash[24253]: cluster 2024-08-31T07:03:47.121732+0000 mgr.a (mgr.14388) 12649 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:48 smithi027 bash[22610]: cluster 2024-08-31T07:03:47.121732+0000 mgr.a (mgr.14388) 12649 : cluster [DBG] pgmap v8769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:49 smithi191 bash[24992]: audit 2024-08-31T07:03:48.065586+0000 mgr.a (mgr.14388) 12650 : audit [DBG] from='client.276618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:49.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:49 smithi163 bash[24253]: audit 2024-08-31T07:03:48.065586+0000 mgr.a (mgr.14388) 12650 : audit [DBG] from='client.276618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:49 smithi027 bash[22610]: audit 2024-08-31T07:03:48.065586+0000 mgr.a (mgr.14388) 12650 : audit [DBG] from='client.276618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:50 smithi191 bash[24992]: cluster 2024-08-31T07:03:49.124583+0000 mgr.a (mgr.14388) 12651 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:50 smithi163 bash[24253]: cluster 2024-08-31T07:03:49.124583+0000 mgr.a (mgr.14388) 12651 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:50 smithi027 bash[22610]: cluster 2024-08-31T07:03:49.124583+0000 mgr.a (mgr.14388) 12651 : cluster [DBG] pgmap v8770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:52 smithi191 bash[24992]: cluster 2024-08-31T07:03:51.125377+0000 mgr.a (mgr.14388) 12652 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:03:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:52 smithi163 bash[24253]: cluster 2024-08-31T07:03:51.125377+0000 mgr.a (mgr.14388) 12652 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:03:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:52 smithi027 bash[22610]: cluster 2024-08-31T07:03:51.125377+0000 mgr.a (mgr.14388) 12652 : cluster [DBG] pgmap v8771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:03:53.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:53.517 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:53.518 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:54.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:03:54.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:03:54.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:03:54.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:03:54.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:03:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:54 smithi191 bash[24992]: cluster 2024-08-31T07:03:53.127305+0000 mgr.a (mgr.14388) 12653 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:54 smithi163 bash[24253]: cluster 2024-08-31T07:03:53.127305+0000 mgr.a (mgr.14388) 12653 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:54 smithi027 bash[22610]: cluster 2024-08-31T07:03:53.127305+0000 mgr.a (mgr.14388) 12653 : cluster [DBG] pgmap v8772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:03:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:55 smithi191 bash[24992]: audit 2024-08-31T07:03:53.851518+0000 mgr.a (mgr.14388) 12654 : audit [DBG] from='client.276690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:55 smithi163 bash[24253]: audit 2024-08-31T07:03:53.851518+0000 mgr.a (mgr.14388) 12654 : audit [DBG] from='client.276690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:55 smithi027 bash[22610]: audit 2024-08-31T07:03:53.851518+0000 mgr.a (mgr.14388) 12654 : audit [DBG] from='client.276690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:03:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:56 smithi191 bash[24992]: cluster 2024-08-31T07:03:55.128268+0000 mgr.a (mgr.14388) 12655 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:03:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:56 smithi163 bash[24253]: cluster 2024-08-31T07:03:55.128268+0000 mgr.a (mgr.14388) 12655 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:03:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:56 smithi027 bash[22610]: cluster 2024-08-31T07:03:55.128268+0000 mgr.a (mgr.14388) 12655 : cluster [DBG] pgmap v8773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:03:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:58 smithi191 bash[24992]: cluster 2024-08-31T07:03:57.129101+0000 mgr.a (mgr.14388) 12656 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:03:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:58 smithi191 bash[24992]: audit 2024-08-31T07:03:58.065527+0000 mon.a (mon.0) 2467 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:03:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:58 smithi163 bash[24253]: cluster 2024-08-31T07:03:57.129101+0000 mgr.a (mgr.14388) 12656 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:03:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:58 smithi163 bash[24253]: audit 2024-08-31T07:03:58.065527+0000 mon.a (mon.0) 2467 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:03:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:58 smithi027 bash[22610]: cluster 2024-08-31T07:03:57.129101+0000 mgr.a (mgr.14388) 12656 : cluster [DBG] pgmap v8774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:03:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:58 smithi027 bash[22610]: audit 2024-08-31T07:03:58.065527+0000 mon.a (mon.0) 2467 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:03:59.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:03:59.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:03:59.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:03:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:59 smithi191 bash[24992]: audit 2024-08-31T07:03:58.911901+0000 mon.a (mon.0) 2468 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:03:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:59 smithi191 bash[24992]: audit 2024-08-31T07:03:58.913618+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:03:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:59 smithi191 bash[24992]: audit 2024-08-31T07:03:58.923874+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:03:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:03:59 smithi191 bash[24992]: audit 2024-08-31T07:03:58.928654+0000 mon.a (mon.0) 2471 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:03:59.669 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:59 smithi027 bash[22610]: audit 2024-08-31T07:03:58.911901+0000 mon.a (mon.0) 2468 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:03:59.669 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:59 smithi027 bash[22610]: audit 2024-08-31T07:03:58.913618+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:03:59.670 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:59 smithi027 bash[22610]: audit 2024-08-31T07:03:58.923874+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:03:59.670 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:03:59 smithi027 bash[22610]: audit 2024-08-31T07:03:58.928654+0000 mon.a (mon.0) 2471 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:03:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:59 smithi163 bash[24253]: audit 2024-08-31T07:03:58.911901+0000 mon.a (mon.0) 2468 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:03:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:59 smithi163 bash[24253]: audit 2024-08-31T07:03:58.913618+0000 mon.a (mon.0) 2469 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:03:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:59 smithi163 bash[24253]: audit 2024-08-31T07:03:58.923874+0000 mon.a (mon.0) 2470 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:03:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:03:59 smithi163 bash[24253]: audit 2024-08-31T07:03:58.928654+0000 mon.a (mon.0) 2471 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:03:59.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:03:59 smithi027 bash[22863]: debug 2024-08-31T07:03:59.663+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:03:59.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:03:59 smithi027 bash[22863]: debug 2024-08-31T07:03:59.675+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:04:00.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:00.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:00.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:00.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:00.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:00 smithi191 bash[24992]: audit 2024-08-31T07:03:58.930973+0000 mgr.a (mgr.14388) 12657 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:04:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:00 smithi191 bash[24992]: cluster 2024-08-31T07:03:59.130441+0000 mgr.a (mgr.14388) 12658 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:00 smithi191 bash[24992]: audit 2024-08-31T07:03:59.617135+0000 mgr.a (mgr.14388) 12659 : audit [DBG] from='client.276834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:00 smithi191 bash[24992]: audit 2024-08-31T07:03:59.668793+0000 mgr.a (mgr.14388) 12660 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:04:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:00 smithi191 bash[24992]: cephadm 2024-08-31T07:03:59.679438+0000 mgr.a (mgr.14388) 12661 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:04:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:00 smithi163 bash[24253]: audit 2024-08-31T07:03:58.930973+0000 mgr.a (mgr.14388) 12657 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:04:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:00 smithi163 bash[24253]: cluster 2024-08-31T07:03:59.130441+0000 mgr.a (mgr.14388) 12658 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:00 smithi163 bash[24253]: audit 2024-08-31T07:03:59.617135+0000 mgr.a (mgr.14388) 12659 : audit [DBG] from='client.276834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:00 smithi163 bash[24253]: audit 2024-08-31T07:03:59.668793+0000 mgr.a (mgr.14388) 12660 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:04:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:00 smithi163 bash[24253]: cephadm 2024-08-31T07:03:59.679438+0000 mgr.a (mgr.14388) 12661 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:04:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:00 smithi027 bash[22610]: audit 2024-08-31T07:03:58.930973+0000 mgr.a (mgr.14388) 12657 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:04:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:00 smithi027 bash[22610]: cluster 2024-08-31T07:03:59.130441+0000 mgr.a (mgr.14388) 12658 : cluster [DBG] pgmap v8775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:00 smithi027 bash[22610]: audit 2024-08-31T07:03:59.617135+0000 mgr.a (mgr.14388) 12659 : audit [DBG] from='client.276834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:00 smithi027 bash[22610]: audit 2024-08-31T07:03:59.668793+0000 mgr.a (mgr.14388) 12660 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:04:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:00 smithi027 bash[22610]: cephadm 2024-08-31T07:03:59.679438+0000 mgr.a (mgr.14388) 12661 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:04:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:02 smithi191 bash[24992]: cluster 2024-08-31T07:04:01.131396+0000 mgr.a (mgr.14388) 12662 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:02 smithi163 bash[24253]: cluster 2024-08-31T07:04:01.131396+0000 mgr.a (mgr.14388) 12662 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:02 smithi027 bash[22610]: cluster 2024-08-31T07:04:01.131396+0000 mgr.a (mgr.14388) 12662 : cluster [DBG] pgmap v8776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:04 smithi163 bash[24253]: cluster 2024-08-31T07:04:03.133527+0000 mgr.a (mgr.14388) 12663 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:04 smithi027 bash[22610]: cluster 2024-08-31T07:04:03.133527+0000 mgr.a (mgr.14388) 12663 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:04 smithi191 bash[24992]: cluster 2024-08-31T07:04:03.133527+0000 mgr.a (mgr.14388) 12663 : cluster [DBG] pgmap v8777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:04:05.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:04:05.066 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:04:05.817 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:05.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:05.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:05.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:05.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:06 smithi163 bash[24253]: cluster 2024-08-31T07:04:05.134302+0000 mgr.a (mgr.14388) 12664 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:06 smithi163 bash[24253]: audit 2024-08-31T07:04:05.397075+0000 mgr.a (mgr.14388) 12665 : audit [DBG] from='client.276948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:06 smithi027 bash[22610]: cluster 2024-08-31T07:04:05.134302+0000 mgr.a (mgr.14388) 12664 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:06 smithi027 bash[22610]: audit 2024-08-31T07:04:05.397075+0000 mgr.a (mgr.14388) 12665 : audit [DBG] from='client.276948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:06 smithi191 bash[24992]: cluster 2024-08-31T07:04:05.134302+0000 mgr.a (mgr.14388) 12664 : cluster [DBG] pgmap v8778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:06 smithi191 bash[24992]: audit 2024-08-31T07:04:05.397075+0000 mgr.a (mgr.14388) 12665 : audit [DBG] from='client.276948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:08 smithi163 bash[24253]: cluster 2024-08-31T07:04:07.135226+0000 mgr.a (mgr.14388) 12666 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:08 smithi027 bash[22610]: cluster 2024-08-31T07:04:07.135226+0000 mgr.a (mgr.14388) 12666 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:08 smithi191 bash[24992]: cluster 2024-08-31T07:04:07.135226+0000 mgr.a (mgr.14388) 12666 : cluster [DBG] pgmap v8779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:10 smithi163 bash[24253]: cluster 2024-08-31T07:04:09.137430+0000 mgr.a (mgr.14388) 12667 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:10 smithi027 bash[22610]: cluster 2024-08-31T07:04:09.137430+0000 mgr.a (mgr.14388) 12667 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:10 smithi191 bash[24992]: cluster 2024-08-31T07:04:09.137430+0000 mgr.a (mgr.14388) 12667 : cluster [DBG] pgmap v8780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:10.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:04:10.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:04:10.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:04:11.593 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:11.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:11.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:11.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:11.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:12 smithi163 bash[24253]: cluster 2024-08-31T07:04:11.138214+0000 mgr.a (mgr.14388) 12668 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:12 smithi163 bash[24253]: audit 2024-08-31T07:04:11.156104+0000 mgr.a (mgr.14388) 12669 : audit [DBG] from='client.277026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:12 smithi027 bash[22610]: cluster 2024-08-31T07:04:11.138214+0000 mgr.a (mgr.14388) 12668 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:12 smithi027 bash[22610]: audit 2024-08-31T07:04:11.156104+0000 mgr.a (mgr.14388) 12669 : audit [DBG] from='client.277026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:12 smithi191 bash[24992]: cluster 2024-08-31T07:04:11.138214+0000 mgr.a (mgr.14388) 12668 : cluster [DBG] pgmap v8781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:12 smithi191 bash[24992]: audit 2024-08-31T07:04:11.156104+0000 mgr.a (mgr.14388) 12669 : audit [DBG] from='client.277026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:14 smithi163 bash[24253]: cluster 2024-08-31T07:04:13.140490+0000 mgr.a (mgr.14388) 12670 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:14 smithi027 bash[22610]: cluster 2024-08-31T07:04:13.140490+0000 mgr.a (mgr.14388) 12670 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:14 smithi191 bash[24992]: cluster 2024-08-31T07:04:13.140490+0000 mgr.a (mgr.14388) 12670 : cluster [DBG] pgmap v8782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:04:16.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:04:16.595 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:04:16.595 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:04:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:16 smithi163 bash[24253]: cluster 2024-08-31T07:04:15.141392+0000 mgr.a (mgr.14388) 12671 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:16 smithi027 bash[22610]: cluster 2024-08-31T07:04:15.141392+0000 mgr.a (mgr.14388) 12671 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:16 smithi191 bash[24992]: cluster 2024-08-31T07:04:15.141392+0000 mgr.a (mgr.14388) 12671 : cluster [DBG] pgmap v8783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:17.375 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:17.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:17.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:17.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:17.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:18 smithi163 bash[24253]: audit 2024-08-31T07:04:16.933074+0000 mgr.a (mgr.14388) 12672 : audit [DBG] from='client.277104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:18.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:18 smithi163 bash[24253]: cluster 2024-08-31T07:04:17.141976+0000 mgr.a (mgr.14388) 12673 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:18 smithi027 bash[22610]: audit 2024-08-31T07:04:16.933074+0000 mgr.a (mgr.14388) 12672 : audit [DBG] from='client.277104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:18 smithi027 bash[22610]: cluster 2024-08-31T07:04:17.141976+0000 mgr.a (mgr.14388) 12673 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:18 smithi191 bash[24992]: audit 2024-08-31T07:04:16.933074+0000 mgr.a (mgr.14388) 12672 : audit [DBG] from='client.277104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:18 smithi191 bash[24992]: cluster 2024-08-31T07:04:17.141976+0000 mgr.a (mgr.14388) 12673 : cluster [DBG] pgmap v8784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:20 smithi163 bash[24253]: cluster 2024-08-31T07:04:19.144271+0000 mgr.a (mgr.14388) 12674 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:20 smithi027 bash[22610]: cluster 2024-08-31T07:04:19.144271+0000 mgr.a (mgr.14388) 12674 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:20 smithi191 bash[24992]: cluster 2024-08-31T07:04:19.144271+0000 mgr.a (mgr.14388) 12674 : cluster [DBG] pgmap v8785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:22.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:04:22.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:04:22.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:04:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:22 smithi163 bash[24253]: cluster 2024-08-31T07:04:21.145060+0000 mgr.a (mgr.14388) 12675 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:22 smithi027 bash[22610]: cluster 2024-08-31T07:04:21.145060+0000 mgr.a (mgr.14388) 12675 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:22 smithi191 bash[24992]: cluster 2024-08-31T07:04:21.145060+0000 mgr.a (mgr.14388) 12675 : cluster [DBG] pgmap v8786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:23.158 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:23.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:23.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:23.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:23.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:23 smithi163 bash[24253]: audit 2024-08-31T07:04:22.713608+0000 mgr.a (mgr.14388) 12676 : audit [DBG] from='client.277173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:23 smithi027 bash[22610]: audit 2024-08-31T07:04:22.713608+0000 mgr.a (mgr.14388) 12676 : audit [DBG] from='client.277173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:23 smithi191 bash[24992]: audit 2024-08-31T07:04:22.713608+0000 mgr.a (mgr.14388) 12676 : audit [DBG] from='client.277173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:24 smithi163 bash[24253]: cluster 2024-08-31T07:04:23.146317+0000 mgr.a (mgr.14388) 12677 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:24 smithi027 bash[22610]: cluster 2024-08-31T07:04:23.146317+0000 mgr.a (mgr.14388) 12677 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:24 smithi191 bash[24992]: cluster 2024-08-31T07:04:23.146317+0000 mgr.a (mgr.14388) 12677 : cluster [DBG] pgmap v8787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:26 smithi163 bash[24253]: cluster 2024-08-31T07:04:25.147084+0000 mgr.a (mgr.14388) 12678 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:04:26.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:26 smithi027 bash[22610]: cluster 2024-08-31T07:04:25.147084+0000 mgr.a (mgr.14388) 12678 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:04:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:26 smithi191 bash[24992]: cluster 2024-08-31T07:04:25.147084+0000 mgr.a (mgr.14388) 12678 : cluster [DBG] pgmap v8788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:04:28.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:04:28.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:04:28.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:04:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:28 smithi163 bash[24253]: cluster 2024-08-31T07:04:27.147859+0000 mgr.a (mgr.14388) 12679 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:04:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:28 smithi027 bash[22610]: cluster 2024-08-31T07:04:27.147859+0000 mgr.a (mgr.14388) 12679 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:04:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:28 smithi191 bash[24992]: cluster 2024-08-31T07:04:27.147859+0000 mgr.a (mgr.14388) 12679 : cluster [DBG] pgmap v8789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:04:28.948 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:28.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:29 smithi163 bash[24253]: audit 2024-08-31T07:04:28.497084+0000 mgr.a (mgr.14388) 12680 : audit [DBG] from='client.277251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:29 smithi027 bash[22610]: audit 2024-08-31T07:04:28.497084+0000 mgr.a (mgr.14388) 12680 : audit [DBG] from='client.277251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:29 smithi191 bash[24992]: audit 2024-08-31T07:04:28.497084+0000 mgr.a (mgr.14388) 12680 : audit [DBG] from='client.277251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:30 smithi163 bash[24253]: cluster 2024-08-31T07:04:29.150696+0000 mgr.a (mgr.14388) 12681 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:30 smithi027 bash[22610]: cluster 2024-08-31T07:04:29.150696+0000 mgr.a (mgr.14388) 12681 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:30 smithi191 bash[24992]: cluster 2024-08-31T07:04:29.150696+0000 mgr.a (mgr.14388) 12681 : cluster [DBG] pgmap v8790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:32 smithi163 bash[24253]: cluster 2024-08-31T07:04:31.151524+0000 mgr.a (mgr.14388) 12682 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:04:32.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:32 smithi027 bash[22610]: cluster 2024-08-31T07:04:31.151524+0000 mgr.a (mgr.14388) 12682 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:04:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:32 smithi191 bash[24992]: cluster 2024-08-31T07:04:31.151524+0000 mgr.a (mgr.14388) 12682 : cluster [DBG] pgmap v8791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:04:33.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:04:33.951 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:04:33.951 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:04:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:34 smithi163 bash[24253]: cluster 2024-08-31T07:04:33.153422+0000 mgr.a (mgr.14388) 12683 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:34.711 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:34.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:34.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:34.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:34.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:34 smithi027 bash[22610]: cluster 2024-08-31T07:04:33.153422+0000 mgr.a (mgr.14388) 12683 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:34 smithi191 bash[24992]: cluster 2024-08-31T07:04:33.153422+0000 mgr.a (mgr.14388) 12683 : cluster [DBG] pgmap v8792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:35 smithi163 bash[24253]: audit 2024-08-31T07:04:34.285547+0000 mgr.a (mgr.14388) 12684 : audit [DBG] from='client.277329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:35 smithi027 bash[22610]: audit 2024-08-31T07:04:34.285547+0000 mgr.a (mgr.14388) 12684 : audit [DBG] from='client.277329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:35 smithi191 bash[24992]: audit 2024-08-31T07:04:34.285547+0000 mgr.a (mgr.14388) 12684 : audit [DBG] from='client.277329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:36 smithi163 bash[24253]: cluster 2024-08-31T07:04:35.154373+0000 mgr.a (mgr.14388) 12685 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:36 smithi027 bash[22610]: cluster 2024-08-31T07:04:35.154373+0000 mgr.a (mgr.14388) 12685 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:36 smithi191 bash[24992]: cluster 2024-08-31T07:04:35.154373+0000 mgr.a (mgr.14388) 12685 : cluster [DBG] pgmap v8793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:38 smithi163 bash[24253]: cluster 2024-08-31T07:04:37.155209+0000 mgr.a (mgr.14388) 12686 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:38 smithi027 bash[22610]: cluster 2024-08-31T07:04:37.155209+0000 mgr.a (mgr.14388) 12686 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:38 smithi191 bash[24992]: cluster 2024-08-31T07:04:37.155209+0000 mgr.a (mgr.14388) 12686 : cluster [DBG] pgmap v8794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:39.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:04:39.714 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:04:39.714 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:04:40.462 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:40.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:40.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:40.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:40.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:40 smithi163 bash[24253]: cluster 2024-08-31T07:04:39.157404+0000 mgr.a (mgr.14388) 12687 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:40 smithi027 bash[22610]: cluster 2024-08-31T07:04:39.157404+0000 mgr.a (mgr.14388) 12687 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:40 smithi191 bash[24992]: cluster 2024-08-31T07:04:39.157404+0000 mgr.a (mgr.14388) 12687 : cluster [DBG] pgmap v8795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:41 smithi163 bash[24253]: audit 2024-08-31T07:04:40.042240+0000 mgr.a (mgr.14388) 12688 : audit [DBG] from='client.277404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:41 smithi027 bash[22610]: audit 2024-08-31T07:04:40.042240+0000 mgr.a (mgr.14388) 12688 : audit [DBG] from='client.277404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:41 smithi191 bash[24992]: audit 2024-08-31T07:04:40.042240+0000 mgr.a (mgr.14388) 12688 : audit [DBG] from='client.277404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:42 smithi163 bash[24253]: cluster 2024-08-31T07:04:41.158362+0000 mgr.a (mgr.14388) 12689 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:42 smithi027 bash[22610]: cluster 2024-08-31T07:04:41.158362+0000 mgr.a (mgr.14388) 12689 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:42 smithi191 bash[24992]: cluster 2024-08-31T07:04:41.158362+0000 mgr.a (mgr.14388) 12689 : cluster [DBG] pgmap v8796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:44 smithi163 bash[24253]: cluster 2024-08-31T07:04:43.160429+0000 mgr.a (mgr.14388) 12690 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:44.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:44 smithi027 bash[22610]: cluster 2024-08-31T07:04:43.160429+0000 mgr.a (mgr.14388) 12690 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:44 smithi191 bash[24992]: cluster 2024-08-31T07:04:43.160429+0000 mgr.a (mgr.14388) 12690 : cluster [DBG] pgmap v8797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:45.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:04:45.465 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:04:45.465 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:04:46.210 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:46.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:46.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:46.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:46.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:46 smithi163 bash[24253]: cluster 2024-08-31T07:04:45.161178+0000 mgr.a (mgr.14388) 12691 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:46 smithi027 bash[22610]: cluster 2024-08-31T07:04:45.161178+0000 mgr.a (mgr.14388) 12691 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:46 smithi191 bash[24992]: cluster 2024-08-31T07:04:45.161178+0000 mgr.a (mgr.14388) 12691 : cluster [DBG] pgmap v8798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:47 smithi163 bash[24253]: audit 2024-08-31T07:04:45.794586+0000 mgr.a (mgr.14388) 12692 : audit [DBG] from='client.277482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:47 smithi027 bash[22610]: audit 2024-08-31T07:04:45.794586+0000 mgr.a (mgr.14388) 12692 : audit [DBG] from='client.277482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:47 smithi191 bash[24992]: audit 2024-08-31T07:04:45.794586+0000 mgr.a (mgr.14388) 12692 : audit [DBG] from='client.277482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:48 smithi163 bash[24253]: cluster 2024-08-31T07:04:47.162084+0000 mgr.a (mgr.14388) 12693 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:48 smithi027 bash[22610]: cluster 2024-08-31T07:04:47.162084+0000 mgr.a (mgr.14388) 12693 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:48 smithi191 bash[24992]: cluster 2024-08-31T07:04:47.162084+0000 mgr.a (mgr.14388) 12693 : cluster [DBG] pgmap v8799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:50 smithi163 bash[24253]: cluster 2024-08-31T07:04:49.164287+0000 mgr.a (mgr.14388) 12694 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:50 smithi027 bash[22610]: cluster 2024-08-31T07:04:49.164287+0000 mgr.a (mgr.14388) 12694 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:50 smithi191 bash[24992]: cluster 2024-08-31T07:04:49.164287+0000 mgr.a (mgr.14388) 12694 : cluster [DBG] pgmap v8800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:51.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:04:51.213 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:04:51.213 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:04:51.957 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:51.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:51.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:51.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:51.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:52 smithi163 bash[24253]: cluster 2024-08-31T07:04:51.165047+0000 mgr.a (mgr.14388) 12695 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:52 smithi163 bash[24253]: audit 2024-08-31T07:04:51.543219+0000 mgr.a (mgr.14388) 12696 : audit [DBG] from='client.277560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:52 smithi027 bash[22610]: cluster 2024-08-31T07:04:51.165047+0000 mgr.a (mgr.14388) 12695 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:52 smithi027 bash[22610]: audit 2024-08-31T07:04:51.543219+0000 mgr.a (mgr.14388) 12696 : audit [DBG] from='client.277560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:52 smithi191 bash[24992]: cluster 2024-08-31T07:04:51.165047+0000 mgr.a (mgr.14388) 12695 : cluster [DBG] pgmap v8801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:52 smithi191 bash[24992]: audit 2024-08-31T07:04:51.543219+0000 mgr.a (mgr.14388) 12696 : audit [DBG] from='client.277560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:54 smithi163 bash[24253]: cluster 2024-08-31T07:04:53.167271+0000 mgr.a (mgr.14388) 12697 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:54 smithi027 bash[22610]: cluster 2024-08-31T07:04:53.167271+0000 mgr.a (mgr.14388) 12697 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:54 smithi191 bash[24992]: cluster 2024-08-31T07:04:53.167271+0000 mgr.a (mgr.14388) 12697 : cluster [DBG] pgmap v8802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:04:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:56 smithi163 bash[24253]: cluster 2024-08-31T07:04:55.168052+0000 mgr.a (mgr.14388) 12698 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:56 smithi027 bash[22610]: cluster 2024-08-31T07:04:55.168052+0000 mgr.a (mgr.14388) 12698 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:56 smithi191 bash[24992]: cluster 2024-08-31T07:04:55.168052+0000 mgr.a (mgr.14388) 12698 : cluster [DBG] pgmap v8803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:56.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:04:56.960 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:04:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:04:57.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:04:57.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:04:57.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:04:57.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:04:57.743 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:04:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:58 smithi027 bash[22610]: cluster 2024-08-31T07:04:57.168700+0000 mgr.a (mgr.14388) 12699 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:04:58 smithi027 bash[22610]: audit 2024-08-31T07:04:57.296969+0000 mgr.a (mgr.14388) 12700 : audit [DBG] from='client.277638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:58 smithi191 bash[24992]: cluster 2024-08-31T07:04:57.168700+0000 mgr.a (mgr.14388) 12699 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:04:58 smithi191 bash[24992]: audit 2024-08-31T07:04:57.296969+0000 mgr.a (mgr.14388) 12700 : audit [DBG] from='client.277638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:04:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:58 smithi163 bash[24253]: cluster 2024-08-31T07:04:57.168700+0000 mgr.a (mgr.14388) 12699 : cluster [DBG] pgmap v8804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:04:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:04:58 smithi163 bash[24253]: audit 2024-08-31T07:04:57.296969+0000 mgr.a (mgr.14388) 12700 : audit [DBG] from='client.277638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:00 smithi027 bash[22610]: cluster 2024-08-31T07:04:59.170992+0000 mgr.a (mgr.14388) 12701 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:00 smithi027 bash[22610]: audit 2024-08-31T07:04:59.731492+0000 mon.a (mon.0) 2472 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:05:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:00 smithi191 bash[24992]: cluster 2024-08-31T07:04:59.170992+0000 mgr.a (mgr.14388) 12701 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:00 smithi191 bash[24992]: audit 2024-08-31T07:04:59.731492+0000 mon.a (mon.0) 2472 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:05:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:00 smithi163 bash[24253]: cluster 2024-08-31T07:04:59.170992+0000 mgr.a (mgr.14388) 12701 : cluster [DBG] pgmap v8805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:00 smithi163 bash[24253]: audit 2024-08-31T07:04:59.731492+0000 mon.a (mon.0) 2472 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:05:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:01 smithi163 bash[24253]: audit 2024-08-31T07:05:00.573511+0000 mon.a (mon.0) 2473 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:05:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:01 smithi163 bash[24253]: audit 2024-08-31T07:05:00.574891+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:05:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:01 smithi163 bash[24253]: audit 2024-08-31T07:05:00.584929+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:05:01.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:01 smithi163 bash[24253]: audit 2024-08-31T07:05:00.587462+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:05:01.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:01 smithi163 bash[24253]: audit 2024-08-31T07:05:00.589778+0000 mgr.a (mgr.14388) 12702 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:05:01.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:05:01 smithi027 bash[22863]: debug 2024-08-31T07:05:01.333+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:05:01.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:05:01 smithi027 bash[22863]: debug 2024-08-31T07:05:01.337+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:05:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:01 smithi027 bash[22610]: audit 2024-08-31T07:05:00.573511+0000 mon.a (mon.0) 2473 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:05:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:01 smithi027 bash[22610]: audit 2024-08-31T07:05:00.574891+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:05:01.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:01 smithi027 bash[22610]: audit 2024-08-31T07:05:00.584929+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:05:01.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:01 smithi027 bash[22610]: audit 2024-08-31T07:05:00.587462+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:05:01.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:01 smithi027 bash[22610]: audit 2024-08-31T07:05:00.589778+0000 mgr.a (mgr.14388) 12702 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:05:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:01 smithi191 bash[24992]: audit 2024-08-31T07:05:00.573511+0000 mon.a (mon.0) 2473 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:05:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:01 smithi191 bash[24992]: audit 2024-08-31T07:05:00.574891+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:05:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:01 smithi191 bash[24992]: audit 2024-08-31T07:05:00.584929+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:05:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:01 smithi191 bash[24992]: audit 2024-08-31T07:05:00.587462+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:05:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:01 smithi191 bash[24992]: audit 2024-08-31T07:05:00.589778+0000 mgr.a (mgr.14388) 12702 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:05:02.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:05:02.745 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:05:02.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:05:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:02 smithi163 bash[24253]: cluster 2024-08-31T07:05:01.171522+0000 mgr.a (mgr.14388) 12703 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:02 smithi163 bash[24253]: audit 2024-08-31T07:05:01.338070+0000 mgr.a (mgr.14388) 12704 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:05:02.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:02 smithi163 bash[24253]: cephadm 2024-08-31T07:05:01.339675+0000 mgr.a (mgr.14388) 12705 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:05:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:02 smithi027 bash[22610]: cluster 2024-08-31T07:05:01.171522+0000 mgr.a (mgr.14388) 12703 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:02 smithi027 bash[22610]: audit 2024-08-31T07:05:01.338070+0000 mgr.a (mgr.14388) 12704 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:05:02.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:02 smithi027 bash[22610]: cephadm 2024-08-31T07:05:01.339675+0000 mgr.a (mgr.14388) 12705 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:05:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:02 smithi191 bash[24992]: cluster 2024-08-31T07:05:01.171522+0000 mgr.a (mgr.14388) 12703 : cluster [DBG] pgmap v8806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:02 smithi191 bash[24992]: audit 2024-08-31T07:05:01.338070+0000 mgr.a (mgr.14388) 12704 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:05:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:02 smithi191 bash[24992]: cephadm 2024-08-31T07:05:01.339675+0000 mgr.a (mgr.14388) 12705 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:05:03.515 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:05:03.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:05:03.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:05:03.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:05:03.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:05:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:04 smithi163 bash[24253]: audit 2024-08-31T07:05:03.081440+0000 mgr.a (mgr.14388) 12706 : audit [DBG] from='client.277818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:04 smithi163 bash[24253]: cluster 2024-08-31T07:05:03.172934+0000 mgr.a (mgr.14388) 12707 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:05:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:04 smithi027 bash[22610]: audit 2024-08-31T07:05:03.081440+0000 mgr.a (mgr.14388) 12706 : audit [DBG] from='client.277818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:04 smithi027 bash[22610]: cluster 2024-08-31T07:05:03.172934+0000 mgr.a (mgr.14388) 12707 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:05:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:04 smithi191 bash[24992]: audit 2024-08-31T07:05:03.081440+0000 mgr.a (mgr.14388) 12706 : audit [DBG] from='client.277818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:04 smithi191 bash[24992]: cluster 2024-08-31T07:05:03.172934+0000 mgr.a (mgr.14388) 12707 : cluster [DBG] pgmap v8807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:05:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:06 smithi163 bash[24253]: cluster 2024-08-31T07:05:05.173816+0000 mgr.a (mgr.14388) 12708 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:05:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:06 smithi027 bash[22610]: cluster 2024-08-31T07:05:05.173816+0000 mgr.a (mgr.14388) 12708 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:05:07.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:06 smithi191 bash[24992]: cluster 2024-08-31T07:05:05.173816+0000 mgr.a (mgr.14388) 12708 : cluster [DBG] pgmap v8808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:05:08.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:05:08.518 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:05:08.518 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:05:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:08 smithi163 bash[24253]: cluster 2024-08-31T07:05:07.174618+0000 mgr.a (mgr.14388) 12709 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:05:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:08 smithi027 bash[22610]: cluster 2024-08-31T07:05:07.174618+0000 mgr.a (mgr.14388) 12709 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:05:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:08 smithi191 bash[24992]: cluster 2024-08-31T07:05:07.174618+0000 mgr.a (mgr.14388) 12709 : cluster [DBG] pgmap v8809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:05:09.267 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:05:09.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:05:09.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:05:09.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:05:09.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:05:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:10 smithi163 bash[24253]: audit 2024-08-31T07:05:08.848794+0000 mgr.a (mgr.14388) 12710 : audit [DBG] from='client.277893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:10 smithi163 bash[24253]: cluster 2024-08-31T07:05:09.176251+0000 mgr.a (mgr.14388) 12711 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:05:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:10 smithi027 bash[22610]: audit 2024-08-31T07:05:08.848794+0000 mgr.a (mgr.14388) 12710 : audit [DBG] from='client.277893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:10 smithi027 bash[22610]: cluster 2024-08-31T07:05:09.176251+0000 mgr.a (mgr.14388) 12711 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:05:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:10 smithi191 bash[24992]: audit 2024-08-31T07:05:08.848794+0000 mgr.a (mgr.14388) 12710 : audit [DBG] from='client.277893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:10 smithi191 bash[24992]: cluster 2024-08-31T07:05:09.176251+0000 mgr.a (mgr.14388) 12711 : cluster [DBG] pgmap v8810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:05:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:12 smithi191 bash[24992]: cluster 2024-08-31T07:05:11.177016+0000 mgr.a (mgr.14388) 12712 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:05:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:12 smithi163 bash[24253]: cluster 2024-08-31T07:05:11.177016+0000 mgr.a (mgr.14388) 12712 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:05:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:12 smithi027 bash[22610]: cluster 2024-08-31T07:05:11.177016+0000 mgr.a (mgr.14388) 12712 : cluster [DBG] pgmap v8811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:05:14.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:05:14.269 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:05:14.269 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:05:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:14 smithi191 bash[24992]: cluster 2024-08-31T07:05:13.178937+0000 mgr.a (mgr.14388) 12713 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:05:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:14 smithi163 bash[24253]: cluster 2024-08-31T07:05:13.178937+0000 mgr.a (mgr.14388) 12713 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:05:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:14 smithi027 bash[22610]: cluster 2024-08-31T07:05:13.178937+0000 mgr.a (mgr.14388) 12713 : cluster [DBG] pgmap v8812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:05:15.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:05:15.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:05:15.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:05:15.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:05:15.040 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:05:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:15 smithi191 bash[24992]: audit 2024-08-31T07:05:14.606432+0000 mgr.a (mgr.14388) 12714 : audit [DBG] from='client.277971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:15 smithi163 bash[24253]: audit 2024-08-31T07:05:14.606432+0000 mgr.a (mgr.14388) 12714 : audit [DBG] from='client.277971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:15.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:15 smithi027 bash[22610]: audit 2024-08-31T07:05:14.606432+0000 mgr.a (mgr.14388) 12714 : audit [DBG] from='client.277971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:16 smithi191 bash[24992]: cluster 2024-08-31T07:05:15.179882+0000 mgr.a (mgr.14388) 12715 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:16 smithi163 bash[24253]: cluster 2024-08-31T07:05:15.179882+0000 mgr.a (mgr.14388) 12715 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:16.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:16 smithi027 bash[22610]: cluster 2024-08-31T07:05:15.179882+0000 mgr.a (mgr.14388) 12715 : cluster [DBG] pgmap v8813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:18 smithi191 bash[24992]: cluster 2024-08-31T07:05:17.180671+0000 mgr.a (mgr.14388) 12716 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:18 smithi163 bash[24253]: cluster 2024-08-31T07:05:17.180671+0000 mgr.a (mgr.14388) 12716 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:18 smithi027 bash[22610]: cluster 2024-08-31T07:05:17.180671+0000 mgr.a (mgr.14388) 12716 : cluster [DBG] pgmap v8814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:20.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:05:20.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:05:20.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:05:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:20 smithi191 bash[24992]: cluster 2024-08-31T07:05:19.182897+0000 mgr.a (mgr.14388) 12717 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:20 smithi163 bash[24253]: cluster 2024-08-31T07:05:19.182897+0000 mgr.a (mgr.14388) 12717 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:20 smithi027 bash[22610]: cluster 2024-08-31T07:05:19.182897+0000 mgr.a (mgr.14388) 12717 : cluster [DBG] pgmap v8815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:20.821 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:05:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:05:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:05:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:05:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:05:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:21 smithi191 bash[24992]: audit 2024-08-31T07:05:20.370299+0000 mgr.a (mgr.14388) 12718 : audit [DBG] from='client.278049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:21 smithi163 bash[24253]: audit 2024-08-31T07:05:20.370299+0000 mgr.a (mgr.14388) 12718 : audit [DBG] from='client.278049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:21.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:21 smithi027 bash[22610]: audit 2024-08-31T07:05:20.370299+0000 mgr.a (mgr.14388) 12718 : audit [DBG] from='client.278049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:22 smithi191 bash[24992]: cluster 2024-08-31T07:05:21.183878+0000 mgr.a (mgr.14388) 12719 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:22 smithi163 bash[24253]: cluster 2024-08-31T07:05:21.183878+0000 mgr.a (mgr.14388) 12719 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:22 smithi027 bash[22610]: cluster 2024-08-31T07:05:21.183878+0000 mgr.a (mgr.14388) 12719 : cluster [DBG] pgmap v8816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:24.552 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:24 smithi191 bash[24992]: cluster 2024-08-31T07:05:23.186021+0000 mgr.a (mgr.14388) 12720 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:24.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:24 smithi163 bash[24253]: cluster 2024-08-31T07:05:23.186021+0000 mgr.a (mgr.14388) 12720 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:24 smithi027 bash[22610]: cluster 2024-08-31T07:05:23.186021+0000 mgr.a (mgr.14388) 12720 : cluster [DBG] pgmap v8817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:25.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:05:25.823 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:05:25.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:05:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:26 smithi191 bash[24992]: cluster 2024-08-31T07:05:25.186809+0000 mgr.a (mgr.14388) 12721 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:26.563 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:05:26.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:05:26.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:05:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:05:26.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:05:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:26 smithi163 bash[24253]: cluster 2024-08-31T07:05:25.186809+0000 mgr.a (mgr.14388) 12721 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:26 smithi027 bash[22610]: cluster 2024-08-31T07:05:25.186809+0000 mgr.a (mgr.14388) 12721 : cluster [DBG] pgmap v8818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:27 smithi191 bash[24992]: audit 2024-08-31T07:05:26.151134+0000 mgr.a (mgr.14388) 12722 : audit [DBG] from='client.278127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:27 smithi163 bash[24253]: audit 2024-08-31T07:05:26.151134+0000 mgr.a (mgr.14388) 12722 : audit [DBG] from='client.278127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:27 smithi027 bash[22610]: audit 2024-08-31T07:05:26.151134+0000 mgr.a (mgr.14388) 12722 : audit [DBG] from='client.278127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:28 smithi163 bash[24253]: cluster 2024-08-31T07:05:27.187697+0000 mgr.a (mgr.14388) 12723 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:28 smithi027 bash[22610]: cluster 2024-08-31T07:05:27.187697+0000 mgr.a (mgr.14388) 12723 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:28 smithi191 bash[24992]: cluster 2024-08-31T07:05:27.187697+0000 mgr.a (mgr.14388) 12723 : cluster [DBG] pgmap v8819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:30 smithi163 bash[24253]: cluster 2024-08-31T07:05:29.189971+0000 mgr.a (mgr.14388) 12724 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:30 smithi027 bash[22610]: cluster 2024-08-31T07:05:29.189971+0000 mgr.a (mgr.14388) 12724 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:30 smithi191 bash[24992]: cluster 2024-08-31T07:05:29.189971+0000 mgr.a (mgr.14388) 12724 : cluster [DBG] pgmap v8820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:31.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:05:31.565 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:05:31.565 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:05:32.325 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:05:32.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:05:32.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:05:32.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:05:32.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:05:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:32 smithi163 bash[24253]: cluster 2024-08-31T07:05:31.190814+0000 mgr.a (mgr.14388) 12725 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:32 smithi027 bash[22610]: cluster 2024-08-31T07:05:31.190814+0000 mgr.a (mgr.14388) 12725 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:32 smithi191 bash[24992]: cluster 2024-08-31T07:05:31.190814+0000 mgr.a (mgr.14388) 12725 : cluster [DBG] pgmap v8821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:33 smithi163 bash[24253]: audit 2024-08-31T07:05:31.896193+0000 mgr.a (mgr.14388) 12726 : audit [DBG] from='client.278205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:33 smithi027 bash[22610]: audit 2024-08-31T07:05:31.896193+0000 mgr.a (mgr.14388) 12726 : audit [DBG] from='client.278205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:33 smithi191 bash[24992]: audit 2024-08-31T07:05:31.896193+0000 mgr.a (mgr.14388) 12726 : audit [DBG] from='client.278205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:34 smithi163 bash[24253]: cluster 2024-08-31T07:05:33.193117+0000 mgr.a (mgr.14388) 12727 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:34 smithi027 bash[22610]: cluster 2024-08-31T07:05:33.193117+0000 mgr.a (mgr.14388) 12727 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:34 smithi191 bash[24992]: cluster 2024-08-31T07:05:33.193117+0000 mgr.a (mgr.14388) 12727 : cluster [DBG] pgmap v8822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:05:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:36 smithi163 bash[24253]: cluster 2024-08-31T07:05:35.193889+0000 mgr.a (mgr.14388) 12728 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:36 smithi027 bash[22610]: cluster 2024-08-31T07:05:35.193889+0000 mgr.a (mgr.14388) 12728 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:36 smithi191 bash[24992]: cluster 2024-08-31T07:05:35.193889+0000 mgr.a (mgr.14388) 12728 : cluster [DBG] pgmap v8823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:37.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:05:37.328 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:05:37.328 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:05:38.113 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:05:38.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:05:38.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:05:38.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:05:38.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:05:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:38 smithi163 bash[24253]: cluster 2024-08-31T07:05:37.194644+0000 mgr.a (mgr.14388) 12729 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:38 smithi163 bash[24253]: audit 2024-08-31T07:05:37.662389+0000 mgr.a (mgr.14388) 12730 : audit [DBG] from='client.278280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:38 smithi027 bash[22610]: cluster 2024-08-31T07:05:37.194644+0000 mgr.a (mgr.14388) 12729 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:38 smithi027 bash[22610]: audit 2024-08-31T07:05:37.662389+0000 mgr.a (mgr.14388) 12730 : audit [DBG] from='client.278280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:38 smithi191 bash[24992]: cluster 2024-08-31T07:05:37.194644+0000 mgr.a (mgr.14388) 12729 : cluster [DBG] pgmap v8824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:38 smithi191 bash[24992]: audit 2024-08-31T07:05:37.662389+0000 mgr.a (mgr.14388) 12730 : audit [DBG] from='client.278280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:40 smithi163 bash[24253]: cluster 2024-08-31T07:05:39.198259+0000 mgr.a (mgr.14388) 12731 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:05:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:40 smithi027 bash[22610]: cluster 2024-08-31T07:05:39.198259+0000 mgr.a (mgr.14388) 12731 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:05:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:40 smithi191 bash[24992]: cluster 2024-08-31T07:05:39.198259+0000 mgr.a (mgr.14388) 12731 : cluster [DBG] pgmap v8825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:05:42.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:42 smithi163 bash[24253]: cluster 2024-08-31T07:05:41.199076+0000 mgr.a (mgr.14388) 12732 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:05:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:42 smithi027 bash[22610]: cluster 2024-08-31T07:05:41.199076+0000 mgr.a (mgr.14388) 12732 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:05:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:42 smithi191 bash[24992]: cluster 2024-08-31T07:05:41.199076+0000 mgr.a (mgr.14388) 12732 : cluster [DBG] pgmap v8826: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:05:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:05:43.115 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:05:43.115 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:05:43.894 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:05:43.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:05:43.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:05:43.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:05:43.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:05:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:44 smithi163 bash[24253]: cluster 2024-08-31T07:05:43.200973+0000 mgr.a (mgr.14388) 12733 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:44 smithi163 bash[24253]: audit 2024-08-31T07:05:43.453891+0000 mgr.a (mgr.14388) 12734 : audit [DBG] from='client.278358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:44.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:44 smithi027 bash[22610]: cluster 2024-08-31T07:05:43.200973+0000 mgr.a (mgr.14388) 12733 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:44.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:44 smithi027 bash[22610]: audit 2024-08-31T07:05:43.453891+0000 mgr.a (mgr.14388) 12734 : audit [DBG] from='client.278358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:44 smithi191 bash[24992]: cluster 2024-08-31T07:05:43.200973+0000 mgr.a (mgr.14388) 12733 : cluster [DBG] pgmap v8827: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:44 smithi191 bash[24992]: audit 2024-08-31T07:05:43.453891+0000 mgr.a (mgr.14388) 12734 : audit [DBG] from='client.278358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:46 smithi163 bash[24253]: cluster 2024-08-31T07:05:45.201881+0000 mgr.a (mgr.14388) 12735 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:05:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:46 smithi027 bash[22610]: cluster 2024-08-31T07:05:45.201881+0000 mgr.a (mgr.14388) 12735 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:05:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:46 smithi191 bash[24992]: cluster 2024-08-31T07:05:45.201881+0000 mgr.a (mgr.14388) 12735 : cluster [DBG] pgmap v8828: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:05:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:48 smithi163 bash[24253]: cluster 2024-08-31T07:05:47.202638+0000 mgr.a (mgr.14388) 12736 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:05:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:48 smithi027 bash[22610]: cluster 2024-08-31T07:05:47.202638+0000 mgr.a (mgr.14388) 12736 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:05:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:48 smithi191 bash[24992]: cluster 2024-08-31T07:05:47.202638+0000 mgr.a (mgr.14388) 12736 : cluster [DBG] pgmap v8829: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:05:48.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:05:48.897 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:05:48.897 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:05:49.678 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:05:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:05:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:05:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:05:49.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:05:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:50 smithi163 bash[24253]: cluster 2024-08-31T07:05:49.204732+0000 mgr.a (mgr.14388) 12737 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:50 smithi163 bash[24253]: audit 2024-08-31T07:05:49.235002+0000 mgr.a (mgr.14388) 12738 : audit [DBG] from='client.278433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:50 smithi027 bash[22610]: cluster 2024-08-31T07:05:49.204732+0000 mgr.a (mgr.14388) 12737 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:50 smithi027 bash[22610]: audit 2024-08-31T07:05:49.235002+0000 mgr.a (mgr.14388) 12738 : audit [DBG] from='client.278433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:50 smithi191 bash[24992]: cluster 2024-08-31T07:05:49.204732+0000 mgr.a (mgr.14388) 12737 : cluster [DBG] pgmap v8830: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:50 smithi191 bash[24992]: audit 2024-08-31T07:05:49.235002+0000 mgr.a (mgr.14388) 12738 : audit [DBG] from='client.278433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:52 smithi163 bash[24253]: cluster 2024-08-31T07:05:51.205654+0000 mgr.a (mgr.14388) 12739 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:05:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:52 smithi027 bash[22610]: cluster 2024-08-31T07:05:51.205654+0000 mgr.a (mgr.14388) 12739 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:05:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:52 smithi191 bash[24992]: cluster 2024-08-31T07:05:51.205654+0000 mgr.a (mgr.14388) 12739 : cluster [DBG] pgmap v8831: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:05:54.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:05:54.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:05:54.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:05:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:54 smithi163 bash[24253]: cluster 2024-08-31T07:05:53.207780+0000 mgr.a (mgr.14388) 12740 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:05:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:54 smithi027 bash[22610]: cluster 2024-08-31T07:05:53.207780+0000 mgr.a (mgr.14388) 12740 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:05:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:54 smithi191 bash[24992]: cluster 2024-08-31T07:05:53.207780+0000 mgr.a (mgr.14388) 12740 : cluster [DBG] pgmap v8832: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:05:55.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:05:55.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:05:55.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:05:55.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:05:55.435 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:05:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:56 smithi163 bash[24253]: audit 2024-08-31T07:05:55.008443+0000 mgr.a (mgr.14388) 12741 : audit [DBG] from='client.278508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:56 smithi163 bash[24253]: cluster 2024-08-31T07:05:55.208373+0000 mgr.a (mgr.14388) 12742 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:56 smithi027 bash[22610]: audit 2024-08-31T07:05:55.008443+0000 mgr.a (mgr.14388) 12741 : audit [DBG] from='client.278508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:56 smithi027 bash[22610]: cluster 2024-08-31T07:05:55.208373+0000 mgr.a (mgr.14388) 12742 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:56 smithi191 bash[24992]: audit 2024-08-31T07:05:55.008443+0000 mgr.a (mgr.14388) 12741 : audit [DBG] from='client.278508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:05:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:56 smithi191 bash[24992]: cluster 2024-08-31T07:05:55.208373+0000 mgr.a (mgr.14388) 12742 : cluster [DBG] pgmap v8833: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:05:58 smithi163 bash[24253]: cluster 2024-08-31T07:05:57.209240+0000 mgr.a (mgr.14388) 12743 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:05:58 smithi027 bash[22610]: cluster 2024-08-31T07:05:57.209240+0000 mgr.a (mgr.14388) 12743 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:05:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:05:58 smithi191 bash[24992]: cluster 2024-08-31T07:05:57.209240+0000 mgr.a (mgr.14388) 12743 : cluster [DBG] pgmap v8834: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:00.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:00.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:00.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:00 smithi163 bash[24253]: cluster 2024-08-31T07:05:59.211464+0000 mgr.a (mgr.14388) 12744 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:00 smithi027 bash[22610]: cluster 2024-08-31T07:05:59.211464+0000 mgr.a (mgr.14388) 12744 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:00 smithi191 bash[24992]: cluster 2024-08-31T07:05:59.211464+0000 mgr.a (mgr.14388) 12744 : cluster [DBG] pgmap v8835: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:01.220 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:01.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:01.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:01.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:01.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:01 smithi163 bash[24253]: audit 2024-08-31T07:06:00.775652+0000 mgr.a (mgr.14388) 12745 : audit [DBG] from='client.278586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:01 smithi027 bash[22610]: audit 2024-08-31T07:06:00.775652+0000 mgr.a (mgr.14388) 12745 : audit [DBG] from='client.278586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:01 smithi191 bash[24992]: audit 2024-08-31T07:06:00.775652+0000 mgr.a (mgr.14388) 12745 : audit [DBG] from='client.278586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:02 smithi163 bash[24253]: cluster 2024-08-31T07:06:01.211947+0000 mgr.a (mgr.14388) 12746 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:02 smithi163 bash[24253]: audit 2024-08-31T07:06:01.393953+0000 mon.a (mon.0) 2477 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:06:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:02 smithi027 bash[22610]: cluster 2024-08-31T07:06:01.211947+0000 mgr.a (mgr.14388) 12746 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:02 smithi027 bash[22610]: audit 2024-08-31T07:06:01.393953+0000 mon.a (mon.0) 2477 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:06:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:02 smithi191 bash[24992]: cluster 2024-08-31T07:06:01.211947+0000 mgr.a (mgr.14388) 12746 : cluster [DBG] pgmap v8836: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:02 smithi191 bash[24992]: audit 2024-08-31T07:06:01.393953+0000 mon.a (mon.0) 2477 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:06:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:04 smithi163 bash[24253]: cluster 2024-08-31T07:06:03.214065+0000 mgr.a (mgr.14388) 12747 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:04 smithi027 bash[22610]: cluster 2024-08-31T07:06:03.214065+0000 mgr.a (mgr.14388) 12747 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:04 smithi191 bash[24992]: cluster 2024-08-31T07:06:03.214065+0000 mgr.a (mgr.14388) 12747 : cluster [DBG] pgmap v8837: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:06.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:06.223 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:06 smithi163 bash[24253]: cluster 2024-08-31T07:06:05.214910+0000 mgr.a (mgr.14388) 12748 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:06 smithi027 bash[22610]: cluster 2024-08-31T07:06:05.214910+0000 mgr.a (mgr.14388) 12748 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:06 smithi191 bash[24992]: cluster 2024-08-31T07:06:05.214910+0000 mgr.a (mgr.14388) 12748 : cluster [DBG] pgmap v8838: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:06.996 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:06.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:06.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:06.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:06.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:06.563154+0000 mgr.a (mgr.14388) 12749 : audit [DBG] from='client.278664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:06.742621+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:06.749937+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:06.781165+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:06.785862+0000 mon.a (mon.0) 2481 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:06.790248+0000 mon.a (mon.0) 2482 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:06.803787+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:07.508148+0000 mon.a (mon.0) 2484 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:06:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:07.510134+0000 mon.a (mon.0) 2485 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:06:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:07.518711+0000 mon.a (mon.0) 2486 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:07 smithi191 bash[24992]: audit 2024-08-31T07:06:07.521091+0000 mon.a (mon.0) 2487 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:06:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:06.563154+0000 mgr.a (mgr.14388) 12749 : audit [DBG] from='client.278664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:06.742621+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:06.749937+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:06.781165+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:06.785862+0000 mon.a (mon.0) 2481 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:06.790248+0000 mon.a (mon.0) 2482 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:06.803787+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:07.508148+0000 mon.a (mon.0) 2484 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:06:08.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:07.510134+0000 mon.a (mon.0) 2485 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:06:08.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:07.518711+0000 mon.a (mon.0) 2486 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:07 smithi163 bash[24253]: audit 2024-08-31T07:06:07.521091+0000 mon.a (mon.0) 2487 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:06.563154+0000 mgr.a (mgr.14388) 12749 : audit [DBG] from='client.278664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:06.742621+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:06.749937+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:06.781165+0000 mon.a (mon.0) 2480 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:06.785862+0000 mon.a (mon.0) 2481 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:06.790248+0000 mon.a (mon.0) 2482 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:06.803787+0000 mon.a (mon.0) 2483 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:07.508148+0000 mon.a (mon.0) 2484 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:07.510134+0000 mon.a (mon.0) 2485 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:07.518711+0000 mon.a (mon.0) 2486 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:06:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:07 smithi027 bash[22610]: audit 2024-08-31T07:06:07.521091+0000 mon.a (mon.0) 2487 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:06:08.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:06:08 smithi027 bash[22863]: debug 2024-08-31T07:06:08.256+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:06:08.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:06:08 smithi027 bash[22863]: debug 2024-08-31T07:06:08.256+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:06:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:08 smithi191 bash[24992]: cluster 2024-08-31T07:06:07.215770+0000 mgr.a (mgr.14388) 12750 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:08 smithi191 bash[24992]: audit 2024-08-31T07:06:07.523683+0000 mgr.a (mgr.14388) 12751 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:06:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:08 smithi163 bash[24253]: cluster 2024-08-31T07:06:07.215770+0000 mgr.a (mgr.14388) 12750 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:08 smithi163 bash[24253]: audit 2024-08-31T07:06:07.523683+0000 mgr.a (mgr.14388) 12751 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:06:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:08 smithi027 bash[22610]: cluster 2024-08-31T07:06:07.215770+0000 mgr.a (mgr.14388) 12750 : cluster [DBG] pgmap v8839: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:08 smithi027 bash[22610]: audit 2024-08-31T07:06:07.523683+0000 mgr.a (mgr.14388) 12751 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:06:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:09 smithi191 bash[24992]: audit 2024-08-31T07:06:08.259817+0000 mgr.a (mgr.14388) 12752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:06:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:09 smithi191 bash[24992]: cephadm 2024-08-31T07:06:08.261464+0000 mgr.a (mgr.14388) 12753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:06:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:09 smithi163 bash[24253]: audit 2024-08-31T07:06:08.259817+0000 mgr.a (mgr.14388) 12752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:06:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:09 smithi163 bash[24253]: cephadm 2024-08-31T07:06:08.261464+0000 mgr.a (mgr.14388) 12753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:06:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:09 smithi027 bash[22610]: audit 2024-08-31T07:06:08.259817+0000 mgr.a (mgr.14388) 12752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:06:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:09 smithi027 bash[22610]: cephadm 2024-08-31T07:06:08.261464+0000 mgr.a (mgr.14388) 12753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:06:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:10 smithi191 bash[24992]: cluster 2024-08-31T07:06:09.218550+0000 mgr.a (mgr.14388) 12754 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:06:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:10 smithi163 bash[24253]: cluster 2024-08-31T07:06:09.218550+0000 mgr.a (mgr.14388) 12754 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:06:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:10 smithi027 bash[22610]: cluster 2024-08-31T07:06:09.218550+0000 mgr.a (mgr.14388) 12754 : cluster [DBG] pgmap v8840: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:06:11.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:11.999 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:11.999 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:12.766 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:12.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:12.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:12.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:12.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:12 smithi191 bash[24992]: cluster 2024-08-31T07:06:11.219311+0000 mgr.a (mgr.14388) 12755 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:06:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:12 smithi163 bash[24253]: cluster 2024-08-31T07:06:11.219311+0000 mgr.a (mgr.14388) 12755 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:06:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:12 smithi027 bash[22610]: cluster 2024-08-31T07:06:11.219311+0000 mgr.a (mgr.14388) 12755 : cluster [DBG] pgmap v8841: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:06:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:13 smithi191 bash[24992]: audit 2024-08-31T07:06:12.332116+0000 mgr.a (mgr.14388) 12756 : audit [DBG] from='client.278847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:13 smithi163 bash[24253]: audit 2024-08-31T07:06:12.332116+0000 mgr.a (mgr.14388) 12756 : audit [DBG] from='client.278847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:13 smithi027 bash[22610]: audit 2024-08-31T07:06:12.332116+0000 mgr.a (mgr.14388) 12756 : audit [DBG] from='client.278847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:14 smithi191 bash[24992]: cluster 2024-08-31T07:06:13.221631+0000 mgr.a (mgr.14388) 12757 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:14 smithi163 bash[24253]: cluster 2024-08-31T07:06:13.221631+0000 mgr.a (mgr.14388) 12757 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:14 smithi027 bash[22610]: cluster 2024-08-31T07:06:13.221631+0000 mgr.a (mgr.14388) 12757 : cluster [DBG] pgmap v8842: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:16 smithi191 bash[24992]: cluster 2024-08-31T07:06:15.222554+0000 mgr.a (mgr.14388) 12758 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:16 smithi163 bash[24253]: cluster 2024-08-31T07:06:15.222554+0000 mgr.a (mgr.14388) 12758 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:16 smithi027 bash[22610]: cluster 2024-08-31T07:06:15.222554+0000 mgr.a (mgr.14388) 12758 : cluster [DBG] pgmap v8843: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:17.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:17.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:17.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:18.539 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:18.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:18.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:18.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:18.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:18 smithi191 bash[24992]: cluster 2024-08-31T07:06:17.223476+0000 mgr.a (mgr.14388) 12759 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:18 smithi163 bash[24253]: cluster 2024-08-31T07:06:17.223476+0000 mgr.a (mgr.14388) 12759 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:18 smithi027 bash[22610]: cluster 2024-08-31T07:06:17.223476+0000 mgr.a (mgr.14388) 12759 : cluster [DBG] pgmap v8844: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:19 smithi191 bash[24992]: audit 2024-08-31T07:06:18.104434+0000 mgr.a (mgr.14388) 12760 : audit [DBG] from='client.278925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:19 smithi163 bash[24253]: audit 2024-08-31T07:06:18.104434+0000 mgr.a (mgr.14388) 12760 : audit [DBG] from='client.278925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:19 smithi027 bash[22610]: audit 2024-08-31T07:06:18.104434+0000 mgr.a (mgr.14388) 12760 : audit [DBG] from='client.278925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:20 smithi163 bash[24253]: cluster 2024-08-31T07:06:19.226246+0000 mgr.a (mgr.14388) 12761 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:20 smithi027 bash[22610]: cluster 2024-08-31T07:06:19.226246+0000 mgr.a (mgr.14388) 12761 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:21.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:20 smithi191 bash[24992]: cluster 2024-08-31T07:06:19.226246+0000 mgr.a (mgr.14388) 12761 : cluster [DBG] pgmap v8845: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:06:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:22 smithi163 bash[24253]: cluster 2024-08-31T07:06:21.227025+0000 mgr.a (mgr.14388) 12762 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:06:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:22 smithi027 bash[22610]: cluster 2024-08-31T07:06:21.227025+0000 mgr.a (mgr.14388) 12762 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:06:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:22 smithi191 bash[24992]: cluster 2024-08-31T07:06:21.227025+0000 mgr.a (mgr.14388) 12762 : cluster [DBG] pgmap v8846: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:06:23.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:23.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:23.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:24.330 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:24.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:24.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:24.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:24.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:24 smithi163 bash[24253]: cluster 2024-08-31T07:06:23.228947+0000 mgr.a (mgr.14388) 12763 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:06:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:24 smithi027 bash[22610]: cluster 2024-08-31T07:06:23.228947+0000 mgr.a (mgr.14388) 12763 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:06:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:24 smithi191 bash[24992]: cluster 2024-08-31T07:06:23.228947+0000 mgr.a (mgr.14388) 12763 : cluster [DBG] pgmap v8847: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:06:26.202 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:25 smithi163 bash[24253]: audit 2024-08-31T07:06:23.876071+0000 mgr.a (mgr.14388) 12764 : audit [DBG] from='client.279003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:25 smithi027 bash[22610]: audit 2024-08-31T07:06:23.876071+0000 mgr.a (mgr.14388) 12764 : audit [DBG] from='client.279003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:25 smithi191 bash[24992]: audit 2024-08-31T07:06:23.876071+0000 mgr.a (mgr.14388) 12764 : audit [DBG] from='client.279003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:26 smithi163 bash[24253]: cluster 2024-08-31T07:06:25.229790+0000 mgr.a (mgr.14388) 12765 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:06:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:26 smithi027 bash[22610]: cluster 2024-08-31T07:06:25.229790+0000 mgr.a (mgr.14388) 12765 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:06:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:26 smithi191 bash[24992]: cluster 2024-08-31T07:06:25.229790+0000 mgr.a (mgr.14388) 12765 : cluster [DBG] pgmap v8848: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:06:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:27 smithi163 bash[24253]: cluster 2024-08-31T07:06:27.230611+0000 mgr.a (mgr.14388) 12766 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:06:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:27 smithi027 bash[22610]: cluster 2024-08-31T07:06:27.230611+0000 mgr.a (mgr.14388) 12766 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:06:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:27 smithi191 bash[24992]: cluster 2024-08-31T07:06:27.230611+0000 mgr.a (mgr.14388) 12766 : cluster [DBG] pgmap v8849: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:06:29.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:29.333 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:29.333 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:30.111 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:30.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:30.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:30.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:30.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:30 smithi163 bash[24253]: cluster 2024-08-31T07:06:29.232831+0000 mgr.a (mgr.14388) 12767 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:30 smithi163 bash[24253]: audit 2024-08-31T07:06:29.665976+0000 mgr.a (mgr.14388) 12768 : audit [DBG] from='client.279078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:30 smithi027 bash[22610]: cluster 2024-08-31T07:06:29.232831+0000 mgr.a (mgr.14388) 12767 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:30 smithi027 bash[22610]: audit 2024-08-31T07:06:29.665976+0000 mgr.a (mgr.14388) 12768 : audit [DBG] from='client.279078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:30 smithi191 bash[24992]: cluster 2024-08-31T07:06:29.232831+0000 mgr.a (mgr.14388) 12767 : cluster [DBG] pgmap v8850: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:30 smithi191 bash[24992]: audit 2024-08-31T07:06:29.665976+0000 mgr.a (mgr.14388) 12768 : audit [DBG] from='client.279078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:32 smithi163 bash[24253]: cluster 2024-08-31T07:06:31.233837+0000 mgr.a (mgr.14388) 12769 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:32 smithi027 bash[22610]: cluster 2024-08-31T07:06:31.233837+0000 mgr.a (mgr.14388) 12769 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:32 smithi191 bash[24992]: cluster 2024-08-31T07:06:31.233837+0000 mgr.a (mgr.14388) 12769 : cluster [DBG] pgmap v8851: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:34 smithi163 bash[24253]: cluster 2024-08-31T07:06:33.235977+0000 mgr.a (mgr.14388) 12770 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:34 smithi027 bash[22610]: cluster 2024-08-31T07:06:33.235977+0000 mgr.a (mgr.14388) 12770 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:34 smithi191 bash[24992]: cluster 2024-08-31T07:06:33.235977+0000 mgr.a (mgr.14388) 12770 : cluster [DBG] pgmap v8852: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:35.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:35.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:35.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:35.895 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:35.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:35.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:35.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:35.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:36 smithi163 bash[24253]: cluster 2024-08-31T07:06:35.236422+0000 mgr.a (mgr.14388) 12771 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:36.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:36 smithi163 bash[24253]: audit 2024-08-31T07:06:35.447739+0000 mgr.a (mgr.14388) 12772 : audit [DBG] from='client.279156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:36 smithi027 bash[22610]: cluster 2024-08-31T07:06:35.236422+0000 mgr.a (mgr.14388) 12771 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:36 smithi027 bash[22610]: audit 2024-08-31T07:06:35.447739+0000 mgr.a (mgr.14388) 12772 : audit [DBG] from='client.279156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:36 smithi191 bash[24992]: cluster 2024-08-31T07:06:35.236422+0000 mgr.a (mgr.14388) 12771 : cluster [DBG] pgmap v8853: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:36 smithi191 bash[24992]: audit 2024-08-31T07:06:35.447739+0000 mgr.a (mgr.14388) 12772 : audit [DBG] from='client.279156 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:38 smithi163 bash[24253]: cluster 2024-08-31T07:06:37.237406+0000 mgr.a (mgr.14388) 12773 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:38 smithi027 bash[22610]: cluster 2024-08-31T07:06:37.237406+0000 mgr.a (mgr.14388) 12773 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:38 smithi191 bash[24992]: cluster 2024-08-31T07:06:37.237406+0000 mgr.a (mgr.14388) 12773 : cluster [DBG] pgmap v8854: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:40 smithi163 bash[24253]: cluster 2024-08-31T07:06:39.239623+0000 mgr.a (mgr.14388) 12774 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:40 smithi027 bash[22610]: cluster 2024-08-31T07:06:39.239623+0000 mgr.a (mgr.14388) 12774 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:40 smithi191 bash[24992]: cluster 2024-08-31T07:06:39.239623+0000 mgr.a (mgr.14388) 12774 : cluster [DBG] pgmap v8855: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:40.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:40.897 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:40.897 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:41.677 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:41.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:41.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:41.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:41.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:42 smithi163 bash[24253]: audit 2024-08-31T07:06:41.234076+0000 mgr.a (mgr.14388) 12775 : audit [DBG] from='client.279228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:42 smithi163 bash[24253]: cluster 2024-08-31T07:06:41.252017+0000 mgr.a (mgr.14388) 12776 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:42 smithi027 bash[22610]: audit 2024-08-31T07:06:41.234076+0000 mgr.a (mgr.14388) 12775 : audit [DBG] from='client.279228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:42 smithi027 bash[22610]: cluster 2024-08-31T07:06:41.252017+0000 mgr.a (mgr.14388) 12776 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:42 smithi191 bash[24992]: audit 2024-08-31T07:06:41.234076+0000 mgr.a (mgr.14388) 12775 : audit [DBG] from='client.279228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:42 smithi191 bash[24992]: cluster 2024-08-31T07:06:41.252017+0000 mgr.a (mgr.14388) 12776 : cluster [DBG] pgmap v8856: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:44 smithi163 bash[24253]: cluster 2024-08-31T07:06:43.254413+0000 mgr.a (mgr.14388) 12777 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:44 smithi027 bash[22610]: cluster 2024-08-31T07:06:43.254413+0000 mgr.a (mgr.14388) 12777 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:44 smithi191 bash[24992]: cluster 2024-08-31T07:06:43.254413+0000 mgr.a (mgr.14388) 12777 : cluster [DBG] pgmap v8857: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:46.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:46.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:46.679 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:46 smithi163 bash[24253]: cluster 2024-08-31T07:06:45.255240+0000 mgr.a (mgr.14388) 12778 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:46 smithi027 bash[22610]: cluster 2024-08-31T07:06:45.255240+0000 mgr.a (mgr.14388) 12778 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:46 smithi191 bash[24992]: cluster 2024-08-31T07:06:45.255240+0000 mgr.a (mgr.14388) 12778 : cluster [DBG] pgmap v8858: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:47.425 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:47.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:47.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:47.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:47.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:48 smithi163 bash[24253]: audit 2024-08-31T07:06:47.003478+0000 mgr.a (mgr.14388) 12779 : audit [DBG] from='client.279300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:48 smithi163 bash[24253]: cluster 2024-08-31T07:06:47.255792+0000 mgr.a (mgr.14388) 12780 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:48 smithi027 bash[22610]: audit 2024-08-31T07:06:47.003478+0000 mgr.a (mgr.14388) 12779 : audit [DBG] from='client.279300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:48 smithi027 bash[22610]: cluster 2024-08-31T07:06:47.255792+0000 mgr.a (mgr.14388) 12780 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:48 smithi191 bash[24992]: audit 2024-08-31T07:06:47.003478+0000 mgr.a (mgr.14388) 12779 : audit [DBG] from='client.279300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:48 smithi191 bash[24992]: cluster 2024-08-31T07:06:47.255792+0000 mgr.a (mgr.14388) 12780 : cluster [DBG] pgmap v8859: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:50 smithi163 bash[24253]: cluster 2024-08-31T07:06:49.258061+0000 mgr.a (mgr.14388) 12781 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:50 smithi027 bash[22610]: cluster 2024-08-31T07:06:49.258061+0000 mgr.a (mgr.14388) 12781 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:50 smithi191 bash[24992]: cluster 2024-08-31T07:06:49.258061+0000 mgr.a (mgr.14388) 12781 : cluster [DBG] pgmap v8860: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:06:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:52 smithi163 bash[24253]: cluster 2024-08-31T07:06:51.258879+0000 mgr.a (mgr.14388) 12782 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:52 smithi027 bash[22610]: cluster 2024-08-31T07:06:51.258879+0000 mgr.a (mgr.14388) 12782 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:52 smithi191 bash[24992]: cluster 2024-08-31T07:06:51.258879+0000 mgr.a (mgr.14388) 12782 : cluster [DBG] pgmap v8861: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:53.192 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:53.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:53.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:53.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:53.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:53 smithi163 bash[24253]: audit 2024-08-31T07:06:52.759248+0000 mgr.a (mgr.14388) 12783 : audit [DBG] from='client.279375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:53 smithi027 bash[22610]: audit 2024-08-31T07:06:52.759248+0000 mgr.a (mgr.14388) 12783 : audit [DBG] from='client.279375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:53 smithi191 bash[24992]: audit 2024-08-31T07:06:52.759248+0000 mgr.a (mgr.14388) 12783 : audit [DBG] from='client.279375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:54 smithi163 bash[24253]: cluster 2024-08-31T07:06:53.260081+0000 mgr.a (mgr.14388) 12784 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:54 smithi027 bash[22610]: cluster 2024-08-31T07:06:53.260081+0000 mgr.a (mgr.14388) 12784 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:54 smithi191 bash[24992]: cluster 2024-08-31T07:06:53.260081+0000 mgr.a (mgr.14388) 12784 : cluster [DBG] pgmap v8862: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:06:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:56 smithi163 bash[24253]: cluster 2024-08-31T07:06:55.260950+0000 mgr.a (mgr.14388) 12785 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:06:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:56 smithi027 bash[22610]: cluster 2024-08-31T07:06:55.260950+0000 mgr.a (mgr.14388) 12785 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:06:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:56 smithi191 bash[24992]: cluster 2024-08-31T07:06:55.260950+0000 mgr.a (mgr.14388) 12785 : cluster [DBG] pgmap v8863: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:06:58.194 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:06:58.195 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:06:58.195 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:06:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:58 smithi163 bash[24253]: cluster 2024-08-31T07:06:57.261894+0000 mgr.a (mgr.14388) 12786 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:06:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:58 smithi027 bash[22610]: cluster 2024-08-31T07:06:57.261894+0000 mgr.a (mgr.14388) 12786 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:06:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:58 smithi191 bash[24992]: cluster 2024-08-31T07:06:57.261894+0000 mgr.a (mgr.14388) 12786 : cluster [DBG] pgmap v8864: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:06:58.962 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:06:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:06:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:06:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:06:58.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:06:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:06:59 smithi163 bash[24253]: audit 2024-08-31T07:06:58.528930+0000 mgr.a (mgr.14388) 12787 : audit [DBG] from='client.279450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:06:59 smithi027 bash[22610]: audit 2024-08-31T07:06:58.528930+0000 mgr.a (mgr.14388) 12787 : audit [DBG] from='client.279450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:06:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:06:59 smithi191 bash[24992]: audit 2024-08-31T07:06:58.528930+0000 mgr.a (mgr.14388) 12787 : audit [DBG] from='client.279450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:00 smithi163 bash[24253]: cluster 2024-08-31T07:06:59.264794+0000 mgr.a (mgr.14388) 12788 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:00 smithi027 bash[22610]: cluster 2024-08-31T07:06:59.264794+0000 mgr.a (mgr.14388) 12788 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:00 smithi191 bash[24992]: cluster 2024-08-31T07:06:59.264794+0000 mgr.a (mgr.14388) 12788 : cluster [DBG] pgmap v8865: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:02 smithi163 bash[24253]: cluster 2024-08-31T07:07:01.265601+0000 mgr.a (mgr.14388) 12789 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:07:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:02 smithi027 bash[22610]: cluster 2024-08-31T07:07:01.265601+0000 mgr.a (mgr.14388) 12789 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:07:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:02 smithi191 bash[24992]: cluster 2024-08-31T07:07:01.265601+0000 mgr.a (mgr.14388) 12789 : cluster [DBG] pgmap v8866: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:07:03.964 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:07:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:07:03.965 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:07:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:04 smithi163 bash[24253]: cluster 2024-08-31T07:07:03.267500+0000 mgr.a (mgr.14388) 12790 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:04 smithi027 bash[22610]: cluster 2024-08-31T07:07:03.267500+0000 mgr.a (mgr.14388) 12790 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:04.745 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:07:04.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:07:04.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:07:04.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:07:04.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:07:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:04 smithi191 bash[24992]: cluster 2024-08-31T07:07:03.267500+0000 mgr.a (mgr.14388) 12790 : cluster [DBG] pgmap v8867: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:05 smithi163 bash[24253]: audit 2024-08-31T07:07:04.301641+0000 mgr.a (mgr.14388) 12791 : audit [DBG] from='client.279528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:05 smithi027 bash[22610]: audit 2024-08-31T07:07:04.301641+0000 mgr.a (mgr.14388) 12791 : audit [DBG] from='client.279528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:05 smithi191 bash[24992]: audit 2024-08-31T07:07:04.301641+0000 mgr.a (mgr.14388) 12791 : audit [DBG] from='client.279528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:06 smithi163 bash[24253]: cluster 2024-08-31T07:07:05.268485+0000 mgr.a (mgr.14388) 12792 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:06 smithi027 bash[22610]: cluster 2024-08-31T07:07:05.268485+0000 mgr.a (mgr.14388) 12792 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:06 smithi191 bash[24992]: cluster 2024-08-31T07:07:05.268485+0000 mgr.a (mgr.14388) 12792 : cluster [DBG] pgmap v8868: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:08 smithi163 bash[24253]: cluster 2024-08-31T07:07:07.269240+0000 mgr.a (mgr.14388) 12793 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:08 smithi163 bash[24253]: audit 2024-08-31T07:07:08.314447+0000 mon.a (mon.0) 2488 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:07:08.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:08 smithi027 bash[22610]: cluster 2024-08-31T07:07:07.269240+0000 mgr.a (mgr.14388) 12793 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:08.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:08 smithi027 bash[22610]: audit 2024-08-31T07:07:08.314447+0000 mon.a (mon.0) 2488 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:07:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:08 smithi191 bash[24992]: cluster 2024-08-31T07:07:07.269240+0000 mgr.a (mgr.14388) 12793 : cluster [DBG] pgmap v8869: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:08 smithi191 bash[24992]: audit 2024-08-31T07:07:08.314447+0000 mon.a (mon.0) 2488 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:07:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:09 smithi163 bash[24253]: audit 2024-08-31T07:07:09.170872+0000 mon.a (mon.0) 2489 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:07:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:09 smithi163 bash[24253]: audit 2024-08-31T07:07:09.172697+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:07:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:09 smithi163 bash[24253]: audit 2024-08-31T07:07:09.180361+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:07:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:09 smithi163 bash[24253]: audit 2024-08-31T07:07:09.183229+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:07:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:09 smithi027 bash[22610]: audit 2024-08-31T07:07:09.170872+0000 mon.a (mon.0) 2489 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:07:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:09 smithi027 bash[22610]: audit 2024-08-31T07:07:09.172697+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:07:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:09 smithi027 bash[22610]: audit 2024-08-31T07:07:09.180361+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:07:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:09 smithi027 bash[22610]: audit 2024-08-31T07:07:09.183229+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:07:09.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:07:09.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:07:09.747 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:07:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:09 smithi191 bash[24992]: audit 2024-08-31T07:07:09.170872+0000 mon.a (mon.0) 2489 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:07:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:09 smithi191 bash[24992]: audit 2024-08-31T07:07:09.172697+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:07:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:09 smithi191 bash[24992]: audit 2024-08-31T07:07:09.180361+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:07:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:09 smithi191 bash[24992]: audit 2024-08-31T07:07:09.183229+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:07:10.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:07:09 smithi027 bash[22863]: debug 2024-08-31T07:07:09.906+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:07:10.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:07:09 smithi027 bash[22863]: debug 2024-08-31T07:07:09.906+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:07:10.480 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:07:10.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:07:10.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:07:10.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:07:10.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:07:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:10 smithi163 bash[24253]: audit 2024-08-31T07:07:09.185540+0000 mgr.a (mgr.14388) 12794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:07:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:10 smithi163 bash[24253]: cluster 2024-08-31T07:07:09.270676+0000 mgr.a (mgr.14388) 12795 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:10 smithi027 bash[22610]: audit 2024-08-31T07:07:09.185540+0000 mgr.a (mgr.14388) 12794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:07:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:10 smithi027 bash[22610]: cluster 2024-08-31T07:07:09.270676+0000 mgr.a (mgr.14388) 12795 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:10 smithi191 bash[24992]: audit 2024-08-31T07:07:09.185540+0000 mgr.a (mgr.14388) 12794 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:07:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:10 smithi191 bash[24992]: cluster 2024-08-31T07:07:09.270676+0000 mgr.a (mgr.14388) 12795 : cluster [DBG] pgmap v8870: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:11 smithi163 bash[24253]: audit 2024-08-31T07:07:09.909253+0000 mgr.a (mgr.14388) 12796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:07:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:11 smithi163 bash[24253]: cephadm 2024-08-31T07:07:09.910379+0000 mgr.a (mgr.14388) 12797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:07:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:11 smithi163 bash[24253]: audit 2024-08-31T07:07:10.071306+0000 mgr.a (mgr.14388) 12798 : audit [DBG] from='client.279711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:11 smithi027 bash[22610]: audit 2024-08-31T07:07:09.909253+0000 mgr.a (mgr.14388) 12796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:07:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:11 smithi027 bash[22610]: cephadm 2024-08-31T07:07:09.910379+0000 mgr.a (mgr.14388) 12797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:07:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:11 smithi027 bash[22610]: audit 2024-08-31T07:07:10.071306+0000 mgr.a (mgr.14388) 12798 : audit [DBG] from='client.279711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:11 smithi191 bash[24992]: audit 2024-08-31T07:07:09.909253+0000 mgr.a (mgr.14388) 12796 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:07:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:11 smithi191 bash[24992]: cephadm 2024-08-31T07:07:09.910379+0000 mgr.a (mgr.14388) 12797 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:07:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:11 smithi191 bash[24992]: audit 2024-08-31T07:07:10.071306+0000 mgr.a (mgr.14388) 12798 : audit [DBG] from='client.279711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:12 smithi163 bash[24253]: cluster 2024-08-31T07:07:11.271643+0000 mgr.a (mgr.14388) 12799 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:12 smithi027 bash[22610]: cluster 2024-08-31T07:07:11.271643+0000 mgr.a (mgr.14388) 12799 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:12 smithi191 bash[24992]: cluster 2024-08-31T07:07:11.271643+0000 mgr.a (mgr.14388) 12799 : cluster [DBG] pgmap v8871: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:14 smithi163 bash[24253]: cluster 2024-08-31T07:07:13.273819+0000 mgr.a (mgr.14388) 12800 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:14 smithi027 bash[22610]: cluster 2024-08-31T07:07:13.273819+0000 mgr.a (mgr.14388) 12800 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:14 smithi191 bash[24992]: cluster 2024-08-31T07:07:13.273819+0000 mgr.a (mgr.14388) 12800 : cluster [DBG] pgmap v8872: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:15.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:07:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:07:15.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:07:16.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:07:16.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:07:16.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:07:16.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:07:16.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:07:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:16 smithi163 bash[24253]: cluster 2024-08-31T07:07:15.274600+0000 mgr.a (mgr.14388) 12801 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:16 smithi163 bash[24253]: audit 2024-08-31T07:07:15.818329+0000 mgr.a (mgr.14388) 12802 : audit [DBG] from='client.279786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:16.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:16 smithi027 bash[22610]: cluster 2024-08-31T07:07:15.274600+0000 mgr.a (mgr.14388) 12801 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:16.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:16 smithi027 bash[22610]: audit 2024-08-31T07:07:15.818329+0000 mgr.a (mgr.14388) 12802 : audit [DBG] from='client.279786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:16 smithi191 bash[24992]: cluster 2024-08-31T07:07:15.274600+0000 mgr.a (mgr.14388) 12801 : cluster [DBG] pgmap v8873: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:16 smithi191 bash[24992]: audit 2024-08-31T07:07:15.818329+0000 mgr.a (mgr.14388) 12802 : audit [DBG] from='client.279786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:18 smithi163 bash[24253]: cluster 2024-08-31T07:07:17.275776+0000 mgr.a (mgr.14388) 12803 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:18 smithi027 bash[22610]: cluster 2024-08-31T07:07:17.275776+0000 mgr.a (mgr.14388) 12803 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:18 smithi191 bash[24992]: cluster 2024-08-31T07:07:17.275776+0000 mgr.a (mgr.14388) 12803 : cluster [DBG] pgmap v8874: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:20 smithi163 bash[24253]: cluster 2024-08-31T07:07:19.278011+0000 mgr.a (mgr.14388) 12804 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:20 smithi027 bash[22610]: cluster 2024-08-31T07:07:19.278011+0000 mgr.a (mgr.14388) 12804 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:20 smithi191 bash[24992]: cluster 2024-08-31T07:07:19.278011+0000 mgr.a (mgr.14388) 12804 : cluster [DBG] pgmap v8875: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:21.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:07:21.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:07:21.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:07:22.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:07:22.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:07:22.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:07:22.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:07:22.025 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:07:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:22 smithi163 bash[24253]: cluster 2024-08-31T07:07:21.278594+0000 mgr.a (mgr.14388) 12805 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:22 smithi163 bash[24253]: audit 2024-08-31T07:07:21.591843+0000 mgr.a (mgr.14388) 12806 : audit [DBG] from='client.279864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:22 smithi027 bash[22610]: cluster 2024-08-31T07:07:21.278594+0000 mgr.a (mgr.14388) 12805 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:22 smithi027 bash[22610]: audit 2024-08-31T07:07:21.591843+0000 mgr.a (mgr.14388) 12806 : audit [DBG] from='client.279864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:22 smithi191 bash[24992]: cluster 2024-08-31T07:07:21.278594+0000 mgr.a (mgr.14388) 12805 : cluster [DBG] pgmap v8876: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:22 smithi191 bash[24992]: audit 2024-08-31T07:07:21.591843+0000 mgr.a (mgr.14388) 12806 : audit [DBG] from='client.279864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:24 smithi163 bash[24253]: cluster 2024-08-31T07:07:23.281019+0000 mgr.a (mgr.14388) 12807 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:24 smithi027 bash[22610]: cluster 2024-08-31T07:07:23.281019+0000 mgr.a (mgr.14388) 12807 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:24 smithi191 bash[24992]: cluster 2024-08-31T07:07:23.281019+0000 mgr.a (mgr.14388) 12807 : cluster [DBG] pgmap v8877: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:07:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:26 smithi163 bash[24253]: cluster 2024-08-31T07:07:25.281784+0000 mgr.a (mgr.14388) 12808 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:26 smithi027 bash[22610]: cluster 2024-08-31T07:07:25.281784+0000 mgr.a (mgr.14388) 12808 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:26 smithi191 bash[24992]: cluster 2024-08-31T07:07:25.281784+0000 mgr.a (mgr.14388) 12808 : cluster [DBG] pgmap v8878: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:27.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:07:27.027 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:07:27.027 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:07:27.815 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:07:27.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:07:27.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:07:27.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:07:27.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:07:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:28 smithi163 bash[24253]: cluster 2024-08-31T07:07:27.282514+0000 mgr.a (mgr.14388) 12809 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:28 smithi163 bash[24253]: audit 2024-08-31T07:07:27.364845+0000 mgr.a (mgr.14388) 12810 : audit [DBG] from='client.279939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:28.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:28 smithi027 bash[22610]: cluster 2024-08-31T07:07:27.282514+0000 mgr.a (mgr.14388) 12809 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:28.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:28 smithi027 bash[22610]: audit 2024-08-31T07:07:27.364845+0000 mgr.a (mgr.14388) 12810 : audit [DBG] from='client.279939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:28 smithi191 bash[24992]: cluster 2024-08-31T07:07:27.282514+0000 mgr.a (mgr.14388) 12809 : cluster [DBG] pgmap v8879: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:28 smithi191 bash[24992]: audit 2024-08-31T07:07:27.364845+0000 mgr.a (mgr.14388) 12810 : audit [DBG] from='client.279939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:30 smithi027 bash[22610]: cluster 2024-08-31T07:07:29.284836+0000 mgr.a (mgr.14388) 12811 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:30 smithi191 bash[24992]: cluster 2024-08-31T07:07:29.284836+0000 mgr.a (mgr.14388) 12811 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:30 smithi163 bash[24253]: cluster 2024-08-31T07:07:29.284836+0000 mgr.a (mgr.14388) 12811 : cluster [DBG] pgmap v8880: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:32.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:32 smithi027 bash[22610]: cluster 2024-08-31T07:07:31.285632+0000 mgr.a (mgr.14388) 12812 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:32 smithi191 bash[24992]: cluster 2024-08-31T07:07:31.285632+0000 mgr.a (mgr.14388) 12812 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:07:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:07:32.817 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:07:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:32 smithi163 bash[24253]: cluster 2024-08-31T07:07:31.285632+0000 mgr.a (mgr.14388) 12812 : cluster [DBG] pgmap v8881: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:33.598 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:07:33.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:07:33.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:07:33.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:07:33.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:34 smithi027 bash[22610]: audit 2024-08-31T07:07:33.153160+0000 mgr.a (mgr.14388) 12813 : audit [DBG] from='client.280017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:34 smithi027 bash[22610]: cluster 2024-08-31T07:07:33.287274+0000 mgr.a (mgr.14388) 12814 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:34 smithi191 bash[24992]: audit 2024-08-31T07:07:33.153160+0000 mgr.a (mgr.14388) 12813 : audit [DBG] from='client.280017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:34 smithi191 bash[24992]: cluster 2024-08-31T07:07:33.287274+0000 mgr.a (mgr.14388) 12814 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:34 smithi163 bash[24253]: audit 2024-08-31T07:07:33.153160+0000 mgr.a (mgr.14388) 12813 : audit [DBG] from='client.280017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:34 smithi163 bash[24253]: cluster 2024-08-31T07:07:33.287274+0000 mgr.a (mgr.14388) 12814 : cluster [DBG] pgmap v8882: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:36 smithi027 bash[22610]: cluster 2024-08-31T07:07:35.288121+0000 mgr.a (mgr.14388) 12815 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:07:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:36 smithi191 bash[24992]: cluster 2024-08-31T07:07:35.288121+0000 mgr.a (mgr.14388) 12815 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:07:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:36 smithi163 bash[24253]: cluster 2024-08-31T07:07:35.288121+0000 mgr.a (mgr.14388) 12815 : cluster [DBG] pgmap v8883: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:07:38.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:07:38.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:07:38.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:07:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:38 smithi027 bash[22610]: cluster 2024-08-31T07:07:37.288908+0000 mgr.a (mgr.14388) 12816 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:07:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:38 smithi191 bash[24992]: cluster 2024-08-31T07:07:37.288908+0000 mgr.a (mgr.14388) 12816 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:07:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:38 smithi163 bash[24253]: cluster 2024-08-31T07:07:37.288908+0000 mgr.a (mgr.14388) 12816 : cluster [DBG] pgmap v8884: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:07:39.377 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:07:39.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:07:39.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:07:39.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:07:39.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:07:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:40 smithi027 bash[22610]: audit 2024-08-31T07:07:38.933748+0000 mgr.a (mgr.14388) 12817 : audit [DBG] from='client.280089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:40 smithi027 bash[22610]: cluster 2024-08-31T07:07:39.290269+0000 mgr.a (mgr.14388) 12818 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:40 smithi191 bash[24992]: audit 2024-08-31T07:07:38.933748+0000 mgr.a (mgr.14388) 12817 : audit [DBG] from='client.280089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:40 smithi191 bash[24992]: cluster 2024-08-31T07:07:39.290269+0000 mgr.a (mgr.14388) 12818 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:40 smithi163 bash[24253]: audit 2024-08-31T07:07:38.933748+0000 mgr.a (mgr.14388) 12817 : audit [DBG] from='client.280089 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:40 smithi163 bash[24253]: cluster 2024-08-31T07:07:39.290269+0000 mgr.a (mgr.14388) 12818 : cluster [DBG] pgmap v8885: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:42 smithi027 bash[22610]: cluster 2024-08-31T07:07:41.291047+0000 mgr.a (mgr.14388) 12819 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:07:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:42 smithi191 bash[24992]: cluster 2024-08-31T07:07:41.291047+0000 mgr.a (mgr.14388) 12819 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:07:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:42 smithi163 bash[24253]: cluster 2024-08-31T07:07:41.291047+0000 mgr.a (mgr.14388) 12819 : cluster [DBG] pgmap v8886: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:07:44.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:07:44.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:07:44.380 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:07:44.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:44 smithi027 bash[22610]: cluster 2024-08-31T07:07:43.292954+0000 mgr.a (mgr.14388) 12820 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:44 smithi191 bash[24992]: cluster 2024-08-31T07:07:43.292954+0000 mgr.a (mgr.14388) 12820 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:44 smithi163 bash[24253]: cluster 2024-08-31T07:07:43.292954+0000 mgr.a (mgr.14388) 12820 : cluster [DBG] pgmap v8887: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:45.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:07:45.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:07:45.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:07:45.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:07:45.154 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:07:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:45 smithi191 bash[24992]: audit 2024-08-31T07:07:44.716296+0000 mgr.a (mgr.14388) 12821 : audit [DBG] from='client.280167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:45 smithi163 bash[24253]: audit 2024-08-31T07:07:44.716296+0000 mgr.a (mgr.14388) 12821 : audit [DBG] from='client.280167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:45 smithi027 bash[22610]: audit 2024-08-31T07:07:44.716296+0000 mgr.a (mgr.14388) 12821 : audit [DBG] from='client.280167 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:46 smithi191 bash[24992]: cluster 2024-08-31T07:07:45.293876+0000 mgr.a (mgr.14388) 12822 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:46 smithi163 bash[24253]: cluster 2024-08-31T07:07:45.293876+0000 mgr.a (mgr.14388) 12822 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:46 smithi027 bash[22610]: cluster 2024-08-31T07:07:45.293876+0000 mgr.a (mgr.14388) 12822 : cluster [DBG] pgmap v8888: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:48 smithi191 bash[24992]: cluster 2024-08-31T07:07:47.294681+0000 mgr.a (mgr.14388) 12823 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:48 smithi163 bash[24253]: cluster 2024-08-31T07:07:47.294681+0000 mgr.a (mgr.14388) 12823 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:48 smithi027 bash[22610]: cluster 2024-08-31T07:07:47.294681+0000 mgr.a (mgr.14388) 12823 : cluster [DBG] pgmap v8889: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:50.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:07:50.156 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:07:50.156 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:07:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:50 smithi191 bash[24992]: cluster 2024-08-31T07:07:49.296969+0000 mgr.a (mgr.14388) 12824 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:50.933 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:07:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:07:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:07:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:07:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:07:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:50 smithi163 bash[24253]: cluster 2024-08-31T07:07:49.296969+0000 mgr.a (mgr.14388) 12824 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:50 smithi027 bash[22610]: cluster 2024-08-31T07:07:49.296969+0000 mgr.a (mgr.14388) 12824 : cluster [DBG] pgmap v8890: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:51 smithi191 bash[24992]: audit 2024-08-31T07:07:50.494077+0000 mgr.a (mgr.14388) 12825 : audit [DBG] from='client.280245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:51 smithi163 bash[24253]: audit 2024-08-31T07:07:50.494077+0000 mgr.a (mgr.14388) 12825 : audit [DBG] from='client.280245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:51 smithi027 bash[22610]: audit 2024-08-31T07:07:50.494077+0000 mgr.a (mgr.14388) 12825 : audit [DBG] from='client.280245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:52 smithi191 bash[24992]: cluster 2024-08-31T07:07:51.297920+0000 mgr.a (mgr.14388) 12826 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:52 smithi163 bash[24253]: cluster 2024-08-31T07:07:51.297920+0000 mgr.a (mgr.14388) 12826 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:52 smithi027 bash[22610]: cluster 2024-08-31T07:07:51.297920+0000 mgr.a (mgr.14388) 12826 : cluster [DBG] pgmap v8891: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:54 smithi191 bash[24992]: cluster 2024-08-31T07:07:53.300127+0000 mgr.a (mgr.14388) 12827 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:54 smithi163 bash[24253]: cluster 2024-08-31T07:07:53.300127+0000 mgr.a (mgr.14388) 12827 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:54 smithi027 bash[22610]: cluster 2024-08-31T07:07:53.300127+0000 mgr.a (mgr.14388) 12827 : cluster [DBG] pgmap v8892: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:07:55.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:07:55.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:07:55.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:07:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:07:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:07:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:07:56.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:07:56.709 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:07:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:56 smithi191 bash[24992]: cluster 2024-08-31T07:07:55.300932+0000 mgr.a (mgr.14388) 12828 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:56 smithi163 bash[24253]: cluster 2024-08-31T07:07:55.300932+0000 mgr.a (mgr.14388) 12828 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:56 smithi027 bash[22610]: cluster 2024-08-31T07:07:55.300932+0000 mgr.a (mgr.14388) 12828 : cluster [DBG] pgmap v8893: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:57 smithi191 bash[24992]: audit 2024-08-31T07:07:56.274853+0000 mgr.a (mgr.14388) 12829 : audit [DBG] from='client.280323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:57 smithi163 bash[24253]: audit 2024-08-31T07:07:56.274853+0000 mgr.a (mgr.14388) 12829 : audit [DBG] from='client.280323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:57 smithi027 bash[22610]: audit 2024-08-31T07:07:56.274853+0000 mgr.a (mgr.14388) 12829 : audit [DBG] from='client.280323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:07:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:07:58 smithi163 bash[24253]: cluster 2024-08-31T07:07:57.301893+0000 mgr.a (mgr.14388) 12830 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:07:58 smithi027 bash[22610]: cluster 2024-08-31T07:07:57.301893+0000 mgr.a (mgr.14388) 12830 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:07:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:07:58 smithi191 bash[24992]: cluster 2024-08-31T07:07:57.301893+0000 mgr.a (mgr.14388) 12830 : cluster [DBG] pgmap v8894: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:00 smithi163 bash[24253]: cluster 2024-08-31T07:07:59.304281+0000 mgr.a (mgr.14388) 12831 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:00 smithi027 bash[22610]: cluster 2024-08-31T07:07:59.304281+0000 mgr.a (mgr.14388) 12831 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:00 smithi191 bash[24992]: cluster 2024-08-31T07:07:59.304281+0000 mgr.a (mgr.14388) 12831 : cluster [DBG] pgmap v8895: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:01.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:01.711 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:01.711 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:08:02.488 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:08:02.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:08:02.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:08:02.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:08:02.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:08:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:02 smithi163 bash[24253]: cluster 2024-08-31T07:08:01.305221+0000 mgr.a (mgr.14388) 12832 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:02 smithi027 bash[22610]: cluster 2024-08-31T07:08:01.305221+0000 mgr.a (mgr.14388) 12832 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:02 smithi191 bash[24992]: cluster 2024-08-31T07:08:01.305221+0000 mgr.a (mgr.14388) 12832 : cluster [DBG] pgmap v8896: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:03 smithi163 bash[24253]: audit 2024-08-31T07:08:02.051965+0000 mgr.a (mgr.14388) 12833 : audit [DBG] from='client.280398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:03 smithi027 bash[22610]: audit 2024-08-31T07:08:02.051965+0000 mgr.a (mgr.14388) 12833 : audit [DBG] from='client.280398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:03 smithi191 bash[24992]: audit 2024-08-31T07:08:02.051965+0000 mgr.a (mgr.14388) 12833 : audit [DBG] from='client.280398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:04 smithi163 bash[24253]: cluster 2024-08-31T07:08:03.307707+0000 mgr.a (mgr.14388) 12834 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:04 smithi027 bash[22610]: cluster 2024-08-31T07:08:03.307707+0000 mgr.a (mgr.14388) 12834 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:04 smithi191 bash[24992]: cluster 2024-08-31T07:08:03.307707+0000 mgr.a (mgr.14388) 12834 : cluster [DBG] pgmap v8897: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:06 smithi163 bash[24253]: cluster 2024-08-31T07:08:05.308542+0000 mgr.a (mgr.14388) 12835 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:06 smithi027 bash[22610]: cluster 2024-08-31T07:08:05.308542+0000 mgr.a (mgr.14388) 12835 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:06 smithi191 bash[24992]: cluster 2024-08-31T07:08:05.308542+0000 mgr.a (mgr.14388) 12835 : cluster [DBG] pgmap v8898: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:07.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:07.491 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:07.491 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:08:08.254 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:08:08.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:08:08.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:08:08.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:08:08.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:08:08.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:08 smithi163 bash[24253]: cluster 2024-08-31T07:08:07.309310+0000 mgr.a (mgr.14388) 12836 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:08.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:08 smithi163 bash[24253]: audit 2024-08-31T07:08:07.824593+0000 mgr.a (mgr.14388) 12837 : audit [DBG] from='client.280476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:08 smithi027 bash[22610]: cluster 2024-08-31T07:08:07.309310+0000 mgr.a (mgr.14388) 12836 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:08 smithi027 bash[22610]: audit 2024-08-31T07:08:07.824593+0000 mgr.a (mgr.14388) 12837 : audit [DBG] from='client.280476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:08 smithi191 bash[24992]: cluster 2024-08-31T07:08:07.309310+0000 mgr.a (mgr.14388) 12836 : cluster [DBG] pgmap v8899: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:08 smithi191 bash[24992]: audit 2024-08-31T07:08:07.824593+0000 mgr.a (mgr.14388) 12837 : audit [DBG] from='client.280476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:10 smithi163 bash[24253]: cluster 2024-08-31T07:08:09.312039+0000 mgr.a (mgr.14388) 12838 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:10 smithi163 bash[24253]: audit 2024-08-31T07:08:09.960093+0000 mon.a (mon.0) 2493 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:08:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:10 smithi027 bash[22610]: cluster 2024-08-31T07:08:09.312039+0000 mgr.a (mgr.14388) 12838 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:10 smithi027 bash[22610]: audit 2024-08-31T07:08:09.960093+0000 mon.a (mon.0) 2493 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:08:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:10 smithi191 bash[24992]: cluster 2024-08-31T07:08:09.312039+0000 mgr.a (mgr.14388) 12838 : cluster [DBG] pgmap v8900: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:10 smithi191 bash[24992]: audit 2024-08-31T07:08:09.960093+0000 mon.a (mon.0) 2493 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:08:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:11 smithi163 bash[24253]: audit 2024-08-31T07:08:10.783706+0000 mon.a (mon.0) 2494 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:08:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:11 smithi163 bash[24253]: audit 2024-08-31T07:08:10.785238+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:08:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:11 smithi163 bash[24253]: audit 2024-08-31T07:08:10.794506+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:08:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:11 smithi163 bash[24253]: audit 2024-08-31T07:08:10.799241+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:08:11.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:11 smithi163 bash[24253]: audit 2024-08-31T07:08:10.801611+0000 mgr.a (mgr.14388) 12839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:08:11.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:08:11 smithi027 bash[22863]: debug 2024-08-31T07:08:11.532+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:08:11.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:08:11 smithi027 bash[22863]: debug 2024-08-31T07:08:11.532+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:08:11.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:11 smithi027 bash[22610]: audit 2024-08-31T07:08:10.783706+0000 mon.a (mon.0) 2494 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:08:11.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:11 smithi027 bash[22610]: audit 2024-08-31T07:08:10.785238+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:08:11.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:11 smithi027 bash[22610]: audit 2024-08-31T07:08:10.794506+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:08:11.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:11 smithi027 bash[22610]: audit 2024-08-31T07:08:10.799241+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:08:11.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:11 smithi027 bash[22610]: audit 2024-08-31T07:08:10.801611+0000 mgr.a (mgr.14388) 12839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:08:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:11 smithi191 bash[24992]: audit 2024-08-31T07:08:10.783706+0000 mon.a (mon.0) 2494 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:08:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:11 smithi191 bash[24992]: audit 2024-08-31T07:08:10.785238+0000 mon.a (mon.0) 2495 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:08:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:11 smithi191 bash[24992]: audit 2024-08-31T07:08:10.794506+0000 mon.a (mon.0) 2496 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:08:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:11 smithi191 bash[24992]: audit 2024-08-31T07:08:10.799241+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:08:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:11 smithi191 bash[24992]: audit 2024-08-31T07:08:10.801611+0000 mgr.a (mgr.14388) 12839 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:08:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:12 smithi163 bash[24253]: cluster 2024-08-31T07:08:11.312526+0000 mgr.a (mgr.14388) 12840 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:08:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:12 smithi163 bash[24253]: audit 2024-08-31T07:08:11.535865+0000 mgr.a (mgr.14388) 12841 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:08:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:12 smithi163 bash[24253]: cephadm 2024-08-31T07:08:11.537056+0000 mgr.a (mgr.14388) 12842 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:08:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:12 smithi027 bash[22610]: cluster 2024-08-31T07:08:11.312526+0000 mgr.a (mgr.14388) 12840 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:08:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:12 smithi027 bash[22610]: audit 2024-08-31T07:08:11.535865+0000 mgr.a (mgr.14388) 12841 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:08:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:12 smithi027 bash[22610]: cephadm 2024-08-31T07:08:11.537056+0000 mgr.a (mgr.14388) 12842 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:08:13.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:13.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:13.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:08:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:12 smithi191 bash[24992]: cluster 2024-08-31T07:08:11.312526+0000 mgr.a (mgr.14388) 12840 : cluster [DBG] pgmap v8901: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:08:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:12 smithi191 bash[24992]: audit 2024-08-31T07:08:11.535865+0000 mgr.a (mgr.14388) 12841 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:08:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:12 smithi191 bash[24992]: cephadm 2024-08-31T07:08:11.537056+0000 mgr.a (mgr.14388) 12842 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:08:14.032 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:08:14.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:08:14.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:08:14.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:08:14.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:08:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:14 smithi163 bash[24253]: cluster 2024-08-31T07:08:13.314776+0000 mgr.a (mgr.14388) 12843 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:14 smithi163 bash[24253]: audit 2024-08-31T07:08:13.587558+0000 mgr.a (mgr.14388) 12844 : audit [DBG] from='client.280659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:14 smithi027 bash[22610]: cluster 2024-08-31T07:08:13.314776+0000 mgr.a (mgr.14388) 12843 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:14 smithi027 bash[22610]: audit 2024-08-31T07:08:13.587558+0000 mgr.a (mgr.14388) 12844 : audit [DBG] from='client.280659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:14 smithi191 bash[24992]: cluster 2024-08-31T07:08:13.314776+0000 mgr.a (mgr.14388) 12843 : cluster [DBG] pgmap v8902: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:14 smithi191 bash[24992]: audit 2024-08-31T07:08:13.587558+0000 mgr.a (mgr.14388) 12844 : audit [DBG] from='client.280659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:16 smithi163 bash[24253]: cluster 2024-08-31T07:08:15.315900+0000 mgr.a (mgr.14388) 12845 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:08:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:16 smithi027 bash[22610]: cluster 2024-08-31T07:08:15.315900+0000 mgr.a (mgr.14388) 12845 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:08:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:16 smithi191 bash[24992]: cluster 2024-08-31T07:08:15.315900+0000 mgr.a (mgr.14388) 12845 : cluster [DBG] pgmap v8903: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:08:19.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:19.034 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:19.035 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:08:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:18 smithi163 bash[24253]: cluster 2024-08-31T07:08:17.316729+0000 mgr.a (mgr.14388) 12846 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:08:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:18 smithi027 bash[22610]: cluster 2024-08-31T07:08:17.316729+0000 mgr.a (mgr.14388) 12846 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:08:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:18 smithi191 bash[24992]: cluster 2024-08-31T07:08:17.316729+0000 mgr.a (mgr.14388) 12846 : cluster [DBG] pgmap v8904: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:08:19.804 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:08:19.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:08:19.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:08:19.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:08:19.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:08:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:20 smithi163 bash[24253]: cluster 2024-08-31T07:08:19.318896+0000 mgr.a (mgr.14388) 12847 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:20 smithi163 bash[24253]: audit 2024-08-31T07:08:19.374176+0000 mgr.a (mgr.14388) 12848 : audit [DBG] from='client.280734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:20 smithi027 bash[22610]: cluster 2024-08-31T07:08:19.318896+0000 mgr.a (mgr.14388) 12847 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:20 smithi027 bash[22610]: audit 2024-08-31T07:08:19.374176+0000 mgr.a (mgr.14388) 12848 : audit [DBG] from='client.280734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:20 smithi191 bash[24992]: cluster 2024-08-31T07:08:19.318896+0000 mgr.a (mgr.14388) 12847 : cluster [DBG] pgmap v8905: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:20 smithi191 bash[24992]: audit 2024-08-31T07:08:19.374176+0000 mgr.a (mgr.14388) 12848 : audit [DBG] from='client.280734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:22 smithi163 bash[24253]: cluster 2024-08-31T07:08:21.319787+0000 mgr.a (mgr.14388) 12849 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:22 smithi027 bash[22610]: cluster 2024-08-31T07:08:21.319787+0000 mgr.a (mgr.14388) 12849 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:22 smithi191 bash[24992]: cluster 2024-08-31T07:08:21.319787+0000 mgr.a (mgr.14388) 12849 : cluster [DBG] pgmap v8906: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:24.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:24.806 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:24.806 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:08:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:24 smithi163 bash[24253]: cluster 2024-08-31T07:08:23.321949+0000 mgr.a (mgr.14388) 12850 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:24 smithi027 bash[22610]: cluster 2024-08-31T07:08:23.321949+0000 mgr.a (mgr.14388) 12850 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:24 smithi191 bash[24992]: cluster 2024-08-31T07:08:23.321949+0000 mgr.a (mgr.14388) 12850 : cluster [DBG] pgmap v8907: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:08:25.568 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:08:25.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:08:25.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:08:25.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:08:25.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:08:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:26 smithi163 bash[24253]: audit 2024-08-31T07:08:25.144125+0000 mgr.a (mgr.14388) 12851 : audit [DBG] from='client.280812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:26 smithi163 bash[24253]: cluster 2024-08-31T07:08:25.322494+0000 mgr.a (mgr.14388) 12852 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:26 smithi027 bash[22610]: audit 2024-08-31T07:08:25.144125+0000 mgr.a (mgr.14388) 12851 : audit [DBG] from='client.280812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:26 smithi027 bash[22610]: cluster 2024-08-31T07:08:25.322494+0000 mgr.a (mgr.14388) 12852 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:26 smithi191 bash[24992]: audit 2024-08-31T07:08:25.144125+0000 mgr.a (mgr.14388) 12851 : audit [DBG] from='client.280812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:26 smithi191 bash[24992]: cluster 2024-08-31T07:08:25.322494+0000 mgr.a (mgr.14388) 12852 : cluster [DBG] pgmap v8908: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:28 smithi163 bash[24253]: cluster 2024-08-31T07:08:27.323561+0000 mgr.a (mgr.14388) 12853 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:28 smithi027 bash[22610]: cluster 2024-08-31T07:08:27.323561+0000 mgr.a (mgr.14388) 12853 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:28 smithi191 bash[24992]: cluster 2024-08-31T07:08:27.323561+0000 mgr.a (mgr.14388) 12853 : cluster [DBG] pgmap v8909: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:30.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:30.571 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:30.571 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:08:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:30 smithi163 bash[24253]: cluster 2024-08-31T07:08:29.325863+0000 mgr.a (mgr.14388) 12854 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:30 smithi027 bash[22610]: cluster 2024-08-31T07:08:29.325863+0000 mgr.a (mgr.14388) 12854 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:30 smithi191 bash[24992]: cluster 2024-08-31T07:08:29.325863+0000 mgr.a (mgr.14388) 12854 : cluster [DBG] pgmap v8910: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:31.305 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:08:31.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:08:31.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:08:31.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:08:31.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:08:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:32 smithi163 bash[24253]: audit 2024-08-31T07:08:30.896907+0000 mgr.a (mgr.14388) 12855 : audit [DBG] from='client.280887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:32 smithi163 bash[24253]: cluster 2024-08-31T07:08:31.326607+0000 mgr.a (mgr.14388) 12856 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:32 smithi027 bash[22610]: audit 2024-08-31T07:08:30.896907+0000 mgr.a (mgr.14388) 12855 : audit [DBG] from='client.280887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:32 smithi027 bash[22610]: cluster 2024-08-31T07:08:31.326607+0000 mgr.a (mgr.14388) 12856 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:32 smithi191 bash[24992]: audit 2024-08-31T07:08:30.896907+0000 mgr.a (mgr.14388) 12855 : audit [DBG] from='client.280887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:32 smithi191 bash[24992]: cluster 2024-08-31T07:08:31.326607+0000 mgr.a (mgr.14388) 12856 : cluster [DBG] pgmap v8911: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:33 smithi163 bash[24253]: cluster 2024-08-31T07:08:33.328700+0000 mgr.a (mgr.14388) 12857 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:34.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:33 smithi027 bash[22610]: cluster 2024-08-31T07:08:33.328700+0000 mgr.a (mgr.14388) 12857 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:33 smithi191 bash[24992]: cluster 2024-08-31T07:08:33.328700+0000 mgr.a (mgr.14388) 12857 : cluster [DBG] pgmap v8912: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:36.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:08:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:36 smithi163 bash[24253]: cluster 2024-08-31T07:08:35.329468+0000 mgr.a (mgr.14388) 12858 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:36 smithi027 bash[22610]: cluster 2024-08-31T07:08:35.329468+0000 mgr.a (mgr.14388) 12858 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:36 smithi191 bash[24992]: cluster 2024-08-31T07:08:35.329468+0000 mgr.a (mgr.14388) 12858 : cluster [DBG] pgmap v8913: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:37.056 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:08:37.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:08:37.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:08:37.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:08:37.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:08:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:37 smithi163 bash[24253]: audit 2024-08-31T07:08:36.640039+0000 mgr.a (mgr.14388) 12859 : audit [DBG] from='client.280962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:37 smithi027 bash[22610]: audit 2024-08-31T07:08:36.640039+0000 mgr.a (mgr.14388) 12859 : audit [DBG] from='client.280962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:37 smithi191 bash[24992]: audit 2024-08-31T07:08:36.640039+0000 mgr.a (mgr.14388) 12859 : audit [DBG] from='client.280962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:38 smithi163 bash[24253]: cluster 2024-08-31T07:08:37.330428+0000 mgr.a (mgr.14388) 12860 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:38 smithi027 bash[22610]: cluster 2024-08-31T07:08:37.330428+0000 mgr.a (mgr.14388) 12860 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:38 smithi191 bash[24992]: cluster 2024-08-31T07:08:37.330428+0000 mgr.a (mgr.14388) 12860 : cluster [DBG] pgmap v8914: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:40 smithi163 bash[24253]: cluster 2024-08-31T07:08:39.332688+0000 mgr.a (mgr.14388) 12861 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:40 smithi027 bash[22610]: cluster 2024-08-31T07:08:39.332688+0000 mgr.a (mgr.14388) 12861 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:40 smithi191 bash[24992]: cluster 2024-08-31T07:08:39.332688+0000 mgr.a (mgr.14388) 12861 : cluster [DBG] pgmap v8915: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:42.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:42.058 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:42.058 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:08:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:42 smithi163 bash[24253]: cluster 2024-08-31T07:08:41.333454+0000 mgr.a (mgr.14388) 12862 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:42 smithi027 bash[22610]: cluster 2024-08-31T07:08:41.333454+0000 mgr.a (mgr.14388) 12862 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:42 smithi191 bash[24992]: cluster 2024-08-31T07:08:41.333454+0000 mgr.a (mgr.14388) 12862 : cluster [DBG] pgmap v8916: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:42.830 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:08:42.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:08:42.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:08:42.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:08:42.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:08:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:43 smithi163 bash[24253]: audit 2024-08-31T07:08:42.388994+0000 mgr.a (mgr.14388) 12863 : audit [DBG] from='client.281040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:43 smithi027 bash[22610]: audit 2024-08-31T07:08:42.388994+0000 mgr.a (mgr.14388) 12863 : audit [DBG] from='client.281040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:43 smithi191 bash[24992]: audit 2024-08-31T07:08:42.388994+0000 mgr.a (mgr.14388) 12863 : audit [DBG] from='client.281040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:44 smithi163 bash[24253]: cluster 2024-08-31T07:08:43.335790+0000 mgr.a (mgr.14388) 12864 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:44 smithi027 bash[22610]: cluster 2024-08-31T07:08:43.335790+0000 mgr.a (mgr.14388) 12864 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:44 smithi191 bash[24992]: cluster 2024-08-31T07:08:43.335790+0000 mgr.a (mgr.14388) 12864 : cluster [DBG] pgmap v8917: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:08:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:46 smithi163 bash[24253]: cluster 2024-08-31T07:08:45.336556+0000 mgr.a (mgr.14388) 12865 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:46 smithi027 bash[22610]: cluster 2024-08-31T07:08:45.336556+0000 mgr.a (mgr.14388) 12865 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:46 smithi191 bash[24992]: cluster 2024-08-31T07:08:45.336556+0000 mgr.a (mgr.14388) 12865 : cluster [DBG] pgmap v8918: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:47.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:47.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:47.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:08:48.590 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:08:48.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:08:48.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:08:48.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:08:48.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:08:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:48 smithi163 bash[24253]: cluster 2024-08-31T07:08:47.337328+0000 mgr.a (mgr.14388) 12866 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:48.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:48 smithi027 bash[22610]: cluster 2024-08-31T07:08:47.337328+0000 mgr.a (mgr.14388) 12866 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:48 smithi191 bash[24992]: cluster 2024-08-31T07:08:47.337328+0000 mgr.a (mgr.14388) 12866 : cluster [DBG] pgmap v8919: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:49 smithi163 bash[24253]: audit 2024-08-31T07:08:48.171160+0000 mgr.a (mgr.14388) 12867 : audit [DBG] from='client.281118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:49 smithi027 bash[22610]: audit 2024-08-31T07:08:48.171160+0000 mgr.a (mgr.14388) 12867 : audit [DBG] from='client.281118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:49 smithi191 bash[24992]: audit 2024-08-31T07:08:48.171160+0000 mgr.a (mgr.14388) 12867 : audit [DBG] from='client.281118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:50 smithi163 bash[24253]: cluster 2024-08-31T07:08:49.340219+0000 mgr.a (mgr.14388) 12868 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:50 smithi027 bash[22610]: cluster 2024-08-31T07:08:49.340219+0000 mgr.a (mgr.14388) 12868 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:50 smithi191 bash[24992]: cluster 2024-08-31T07:08:49.340219+0000 mgr.a (mgr.14388) 12868 : cluster [DBG] pgmap v8920: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:52 smithi163 bash[24253]: cluster 2024-08-31T07:08:51.341188+0000 mgr.a (mgr.14388) 12869 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:08:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:52 smithi027 bash[22610]: cluster 2024-08-31T07:08:51.341188+0000 mgr.a (mgr.14388) 12869 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:08:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:52 smithi191 bash[24992]: cluster 2024-08-31T07:08:51.341188+0000 mgr.a (mgr.14388) 12869 : cluster [DBG] pgmap v8921: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:08:53.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:53.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:53.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:08:54.331 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:08:54.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:08:54.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:08:54.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:08:54.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:08:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:54 smithi163 bash[24253]: cluster 2024-08-31T07:08:53.343173+0000 mgr.a (mgr.14388) 12870 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:54 smithi027 bash[22610]: cluster 2024-08-31T07:08:53.343173+0000 mgr.a (mgr.14388) 12870 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:54 smithi191 bash[24992]: cluster 2024-08-31T07:08:53.343173+0000 mgr.a (mgr.14388) 12870 : cluster [DBG] pgmap v8922: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:08:55.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:55 smithi027 bash[22610]: audit 2024-08-31T07:08:53.926197+0000 mgr.a (mgr.14388) 12871 : audit [DBG] from='client.281196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:55 smithi191 bash[24992]: audit 2024-08-31T07:08:53.926197+0000 mgr.a (mgr.14388) 12871 : audit [DBG] from='client.281196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:55 smithi163 bash[24253]: audit 2024-08-31T07:08:53.926197+0000 mgr.a (mgr.14388) 12871 : audit [DBG] from='client.281196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:08:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:56 smithi027 bash[22610]: cluster 2024-08-31T07:08:55.344057+0000 mgr.a (mgr.14388) 12872 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:08:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:56 smithi191 bash[24992]: cluster 2024-08-31T07:08:55.344057+0000 mgr.a (mgr.14388) 12872 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:08:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:56 smithi163 bash[24253]: cluster 2024-08-31T07:08:55.344057+0000 mgr.a (mgr.14388) 12872 : cluster [DBG] pgmap v8923: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:08:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:08:58 smithi027 bash[22610]: cluster 2024-08-31T07:08:57.344837+0000 mgr.a (mgr.14388) 12873 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:08:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:08:58 smithi191 bash[24992]: cluster 2024-08-31T07:08:57.344837+0000 mgr.a (mgr.14388) 12873 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:08:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:08:58 smithi163 bash[24253]: cluster 2024-08-31T07:08:57.344837+0000 mgr.a (mgr.14388) 12873 : cluster [DBG] pgmap v8924: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:08:59.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:08:59.333 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:08:59.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:00.117 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:00.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:00.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:00.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:00.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:00 smithi027 bash[22610]: cluster 2024-08-31T07:08:59.347083+0000 mgr.a (mgr.14388) 12874 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:00 smithi027 bash[22610]: audit 2024-08-31T07:08:59.671601+0000 mgr.a (mgr.14388) 12875 : audit [DBG] from='client.281274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:00 smithi191 bash[24992]: cluster 2024-08-31T07:08:59.347083+0000 mgr.a (mgr.14388) 12874 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:00 smithi191 bash[24992]: audit 2024-08-31T07:08:59.671601+0000 mgr.a (mgr.14388) 12875 : audit [DBG] from='client.281274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:00 smithi163 bash[24253]: cluster 2024-08-31T07:08:59.347083+0000 mgr.a (mgr.14388) 12874 : cluster [DBG] pgmap v8925: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:00 smithi163 bash[24253]: audit 2024-08-31T07:08:59.671601+0000 mgr.a (mgr.14388) 12875 : audit [DBG] from='client.281274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:02 smithi027 bash[22610]: cluster 2024-08-31T07:09:01.347976+0000 mgr.a (mgr.14388) 12876 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:02 smithi191 bash[24992]: cluster 2024-08-31T07:09:01.347976+0000 mgr.a (mgr.14388) 12876 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:02 smithi163 bash[24253]: cluster 2024-08-31T07:09:01.347976+0000 mgr.a (mgr.14388) 12876 : cluster [DBG] pgmap v8926: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:04.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:04 smithi027 bash[22610]: cluster 2024-08-31T07:09:03.350072+0000 mgr.a (mgr.14388) 12877 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:04 smithi191 bash[24992]: cluster 2024-08-31T07:09:03.350072+0000 mgr.a (mgr.14388) 12877 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:04 smithi163 bash[24253]: cluster 2024-08-31T07:09:03.350072+0000 mgr.a (mgr.14388) 12877 : cluster [DBG] pgmap v8927: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:05.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:09:05.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:09:05.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:05.891 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:05.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:05.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:05.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:05.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:06 smithi027 bash[22610]: cluster 2024-08-31T07:09:05.350825+0000 mgr.a (mgr.14388) 12878 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:06 smithi027 bash[22610]: audit 2024-08-31T07:09:05.457281+0000 mgr.a (mgr.14388) 12879 : audit [DBG] from='client.281349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:06 smithi191 bash[24992]: cluster 2024-08-31T07:09:05.350825+0000 mgr.a (mgr.14388) 12878 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:06 smithi191 bash[24992]: audit 2024-08-31T07:09:05.457281+0000 mgr.a (mgr.14388) 12879 : audit [DBG] from='client.281349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:06 smithi163 bash[24253]: cluster 2024-08-31T07:09:05.350825+0000 mgr.a (mgr.14388) 12878 : cluster [DBG] pgmap v8928: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:06 smithi163 bash[24253]: audit 2024-08-31T07:09:05.457281+0000 mgr.a (mgr.14388) 12879 : audit [DBG] from='client.281349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:08.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:08 smithi027 bash[22610]: cluster 2024-08-31T07:09:07.351659+0000 mgr.a (mgr.14388) 12880 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:08 smithi191 bash[24992]: cluster 2024-08-31T07:09:07.351659+0000 mgr.a (mgr.14388) 12880 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:08 smithi163 bash[24253]: cluster 2024-08-31T07:09:07.351659+0000 mgr.a (mgr.14388) 12880 : cluster [DBG] pgmap v8929: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:10 smithi163 bash[24253]: cluster 2024-08-31T07:09:09.353914+0000 mgr.a (mgr.14388) 12881 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:10 smithi027 bash[22610]: cluster 2024-08-31T07:09:09.353914+0000 mgr.a (mgr.14388) 12881 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:10 smithi191 bash[24992]: cluster 2024-08-31T07:09:09.353914+0000 mgr.a (mgr.14388) 12881 : cluster [DBG] pgmap v8930: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:10.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:09:10.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:09:10.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:11.682 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:11.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:11.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:11.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:11.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:12 smithi163 bash[24253]: audit 2024-08-31T07:09:11.226843+0000 mgr.a (mgr.14388) 12882 : audit [DBG] from='client.281427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:12 smithi163 bash[24253]: cluster 2024-08-31T07:09:11.354532+0000 mgr.a (mgr.14388) 12883 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:12 smithi163 bash[24253]: audit 2024-08-31T07:09:11.591932+0000 mon.a (mon.0) 2498 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:09:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:12 smithi163 bash[24253]: audit 2024-08-31T07:09:12.377625+0000 mon.a (mon.0) 2499 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:09:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:12 smithi163 bash[24253]: audit 2024-08-31T07:09:12.379030+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:09:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:12 smithi163 bash[24253]: audit 2024-08-31T07:09:12.389542+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:09:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:12 smithi163 bash[24253]: audit 2024-08-31T07:09:12.394532+0000 mon.a (mon.0) 2502 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:09:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:12 smithi027 bash[22610]: audit 2024-08-31T07:09:11.226843+0000 mgr.a (mgr.14388) 12882 : audit [DBG] from='client.281427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:12 smithi027 bash[22610]: cluster 2024-08-31T07:09:11.354532+0000 mgr.a (mgr.14388) 12883 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:12 smithi027 bash[22610]: audit 2024-08-31T07:09:11.591932+0000 mon.a (mon.0) 2498 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:09:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:12 smithi027 bash[22610]: audit 2024-08-31T07:09:12.377625+0000 mon.a (mon.0) 2499 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:09:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:12 smithi027 bash[22610]: audit 2024-08-31T07:09:12.379030+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:09:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:12 smithi027 bash[22610]: audit 2024-08-31T07:09:12.389542+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:09:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:12 smithi027 bash[22610]: audit 2024-08-31T07:09:12.394532+0000 mon.a (mon.0) 2502 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:09:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:12 smithi191 bash[24992]: audit 2024-08-31T07:09:11.226843+0000 mgr.a (mgr.14388) 12882 : audit [DBG] from='client.281427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:12 smithi191 bash[24992]: cluster 2024-08-31T07:09:11.354532+0000 mgr.a (mgr.14388) 12883 : cluster [DBG] pgmap v8931: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:12 smithi191 bash[24992]: audit 2024-08-31T07:09:11.591932+0000 mon.a (mon.0) 2498 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:09:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:12 smithi191 bash[24992]: audit 2024-08-31T07:09:12.377625+0000 mon.a (mon.0) 2499 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:09:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:12 smithi191 bash[24992]: audit 2024-08-31T07:09:12.379030+0000 mon.a (mon.0) 2500 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:09:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:12 smithi191 bash[24992]: audit 2024-08-31T07:09:12.389542+0000 mon.a (mon.0) 2501 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:09:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:12 smithi191 bash[24992]: audit 2024-08-31T07:09:12.394532+0000 mon.a (mon.0) 2502 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:09:13.412 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:09:13 smithi027 bash[22863]: debug 2024-08-31T07:09:13.127+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:09:13.412 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:09:13 smithi027 bash[22863]: debug 2024-08-31T07:09:13.131+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:09:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:13 smithi163 bash[24253]: audit 2024-08-31T07:09:12.395846+0000 mgr.a (mgr.14388) 12884 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:09:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:13 smithi027 bash[22610]: audit 2024-08-31T07:09:12.395846+0000 mgr.a (mgr.14388) 12884 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:09:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:13 smithi191 bash[24992]: audit 2024-08-31T07:09:12.395846+0000 mgr.a (mgr.14388) 12884 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:09:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:14 smithi163 bash[24253]: audit 2024-08-31T07:09:13.133265+0000 mgr.a (mgr.14388) 12885 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:09:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:14 smithi163 bash[24253]: cephadm 2024-08-31T07:09:13.134748+0000 mgr.a (mgr.14388) 12886 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:09:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:14 smithi163 bash[24253]: cluster 2024-08-31T07:09:13.356864+0000 mgr.a (mgr.14388) 12887 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:09:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:14 smithi027 bash[22610]: audit 2024-08-31T07:09:13.133265+0000 mgr.a (mgr.14388) 12885 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:09:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:14 smithi027 bash[22610]: cephadm 2024-08-31T07:09:13.134748+0000 mgr.a (mgr.14388) 12886 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:09:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:14 smithi027 bash[22610]: cluster 2024-08-31T07:09:13.356864+0000 mgr.a (mgr.14388) 12887 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:09:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:14 smithi191 bash[24992]: audit 2024-08-31T07:09:13.133265+0000 mgr.a (mgr.14388) 12885 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:09:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:14 smithi191 bash[24992]: cephadm 2024-08-31T07:09:13.134748+0000 mgr.a (mgr.14388) 12886 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:09:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:14 smithi191 bash[24992]: cluster 2024-08-31T07:09:13.356864+0000 mgr.a (mgr.14388) 12887 : cluster [DBG] pgmap v8932: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.8 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:09:16.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:09:16.685 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:09:16.685 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:16 smithi163 bash[24253]: cluster 2024-08-31T07:09:15.357808+0000 mgr.a (mgr.14388) 12888 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:09:16.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:16 smithi027 bash[22610]: cluster 2024-08-31T07:09:15.357808+0000 mgr.a (mgr.14388) 12888 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:09:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:16 smithi191 bash[24992]: cluster 2024-08-31T07:09:15.357808+0000 mgr.a (mgr.14388) 12888 : cluster [DBG] pgmap v8933: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:09:17.467 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:17.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:17.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:17.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:17.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:18 smithi163 bash[24253]: audit 2024-08-31T07:09:17.023080+0000 mgr.a (mgr.14388) 12889 : audit [DBG] from='client.281610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:18 smithi163 bash[24253]: cluster 2024-08-31T07:09:17.363204+0000 mgr.a (mgr.14388) 12890 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:09:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:18 smithi027 bash[22610]: audit 2024-08-31T07:09:17.023080+0000 mgr.a (mgr.14388) 12889 : audit [DBG] from='client.281610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:18 smithi027 bash[22610]: cluster 2024-08-31T07:09:17.363204+0000 mgr.a (mgr.14388) 12890 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:09:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:18 smithi191 bash[24992]: audit 2024-08-31T07:09:17.023080+0000 mgr.a (mgr.14388) 12889 : audit [DBG] from='client.281610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:18 smithi191 bash[24992]: cluster 2024-08-31T07:09:17.363204+0000 mgr.a (mgr.14388) 12890 : cluster [DBG] pgmap v8934: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:09:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:20 smithi163 bash[24253]: cluster 2024-08-31T07:09:19.365430+0000 mgr.a (mgr.14388) 12891 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:09:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:20 smithi027 bash[22610]: cluster 2024-08-31T07:09:19.365430+0000 mgr.a (mgr.14388) 12891 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:09:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:20 smithi191 bash[24992]: cluster 2024-08-31T07:09:19.365430+0000 mgr.a (mgr.14388) 12891 : cluster [DBG] pgmap v8935: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:09:22.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:09:22.469 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:09:22.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:22 smithi163 bash[24253]: cluster 2024-08-31T07:09:21.366179+0000 mgr.a (mgr.14388) 12892 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:09:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:22 smithi027 bash[22610]: cluster 2024-08-31T07:09:21.366179+0000 mgr.a (mgr.14388) 12892 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:09:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:22 smithi191 bash[24992]: cluster 2024-08-31T07:09:21.366179+0000 mgr.a (mgr.14388) 12892 : cluster [DBG] pgmap v8936: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:09:23.229 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:23.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:23.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:23.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:23.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:23 smithi027 bash[22610]: audit 2024-08-31T07:09:22.800914+0000 mgr.a (mgr.14388) 12893 : audit [DBG] from='client.281688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:23 smithi191 bash[24992]: audit 2024-08-31T07:09:22.800914+0000 mgr.a (mgr.14388) 12893 : audit [DBG] from='client.281688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:23 smithi163 bash[24253]: audit 2024-08-31T07:09:22.800914+0000 mgr.a (mgr.14388) 12893 : audit [DBG] from='client.281688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:24 smithi027 bash[22610]: cluster 2024-08-31T07:09:23.368935+0000 mgr.a (mgr.14388) 12894 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:09:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:24 smithi191 bash[24992]: cluster 2024-08-31T07:09:23.368935+0000 mgr.a (mgr.14388) 12894 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:09:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:24 smithi163 bash[24253]: cluster 2024-08-31T07:09:23.368935+0000 mgr.a (mgr.14388) 12894 : cluster [DBG] pgmap v8937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:09:26.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:26 smithi027 bash[22610]: cluster 2024-08-31T07:09:25.369727+0000 mgr.a (mgr.14388) 12895 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:09:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:26 smithi191 bash[24992]: cluster 2024-08-31T07:09:25.369727+0000 mgr.a (mgr.14388) 12895 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:09:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:26 smithi163 bash[24253]: cluster 2024-08-31T07:09:25.369727+0000 mgr.a (mgr.14388) 12895 : cluster [DBG] pgmap v8938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:09:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:09:28.229 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:09:28.229 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:28 smithi027 bash[22610]: cluster 2024-08-31T07:09:27.370510+0000 mgr.a (mgr.14388) 12896 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:09:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:28 smithi191 bash[24992]: cluster 2024-08-31T07:09:27.370510+0000 mgr.a (mgr.14388) 12896 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:09:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:28 smithi163 bash[24253]: cluster 2024-08-31T07:09:27.370510+0000 mgr.a (mgr.14388) 12896 : cluster [DBG] pgmap v8939: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:09:28.992 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:28.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:29 smithi027 bash[22610]: audit 2024-08-31T07:09:28.557790+0000 mgr.a (mgr.14388) 12897 : audit [DBG] from='client.281763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:29 smithi191 bash[24992]: audit 2024-08-31T07:09:28.557790+0000 mgr.a (mgr.14388) 12897 : audit [DBG] from='client.281763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:29 smithi163 bash[24253]: audit 2024-08-31T07:09:28.557790+0000 mgr.a (mgr.14388) 12897 : audit [DBG] from='client.281763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:30 smithi027 bash[22610]: cluster 2024-08-31T07:09:29.373176+0000 mgr.a (mgr.14388) 12898 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:09:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:30 smithi191 bash[24992]: cluster 2024-08-31T07:09:29.373176+0000 mgr.a (mgr.14388) 12898 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:09:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:30 smithi163 bash[24253]: cluster 2024-08-31T07:09:29.373176+0000 mgr.a (mgr.14388) 12898 : cluster [DBG] pgmap v8940: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:09:32.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:32 smithi027 bash[22610]: cluster 2024-08-31T07:09:31.373985+0000 mgr.a (mgr.14388) 12899 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:09:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:32 smithi191 bash[24992]: cluster 2024-08-31T07:09:31.373985+0000 mgr.a (mgr.14388) 12899 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:09:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:32 smithi163 bash[24253]: cluster 2024-08-31T07:09:31.373985+0000 mgr.a (mgr.14388) 12899 : cluster [DBG] pgmap v8941: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:09:33.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:09:33.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:09:33.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:34 smithi027 bash[22610]: cluster 2024-08-31T07:09:33.375929+0000 mgr.a (mgr.14388) 12900 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:34.778 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:34.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:34 smithi191 bash[24992]: cluster 2024-08-31T07:09:33.375929+0000 mgr.a (mgr.14388) 12900 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:34 smithi163 bash[24253]: cluster 2024-08-31T07:09:33.375929+0000 mgr.a (mgr.14388) 12900 : cluster [DBG] pgmap v8942: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:35 smithi191 bash[24992]: audit 2024-08-31T07:09:34.331397+0000 mgr.a (mgr.14388) 12901 : audit [DBG] from='client.281841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:35 smithi163 bash[24253]: audit 2024-08-31T07:09:34.331397+0000 mgr.a (mgr.14388) 12901 : audit [DBG] from='client.281841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:35.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:35 smithi027 bash[22610]: audit 2024-08-31T07:09:34.331397+0000 mgr.a (mgr.14388) 12901 : audit [DBG] from='client.281841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:36 smithi191 bash[24992]: cluster 2024-08-31T07:09:35.376812+0000 mgr.a (mgr.14388) 12902 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:36 smithi163 bash[24253]: cluster 2024-08-31T07:09:35.376812+0000 mgr.a (mgr.14388) 12902 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:36.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:36 smithi027 bash[22610]: cluster 2024-08-31T07:09:35.376812+0000 mgr.a (mgr.14388) 12902 : cluster [DBG] pgmap v8943: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:38 smithi191 bash[24992]: cluster 2024-08-31T07:09:37.377570+0000 mgr.a (mgr.14388) 12903 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:38 smithi163 bash[24253]: cluster 2024-08-31T07:09:37.377570+0000 mgr.a (mgr.14388) 12903 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:38 smithi027 bash[22610]: cluster 2024-08-31T07:09:37.377570+0000 mgr.a (mgr.14388) 12903 : cluster [DBG] pgmap v8944: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:39.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:09:39.780 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:09:39.780 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:40.566 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:40.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:40.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:40.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:40.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:40 smithi191 bash[24992]: cluster 2024-08-31T07:09:39.379693+0000 mgr.a (mgr.14388) 12904 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:40 smithi163 bash[24253]: cluster 2024-08-31T07:09:39.379693+0000 mgr.a (mgr.14388) 12904 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:40 smithi027 bash[22610]: cluster 2024-08-31T07:09:39.379693+0000 mgr.a (mgr.14388) 12904 : cluster [DBG] pgmap v8945: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:41 smithi191 bash[24992]: audit 2024-08-31T07:09:40.117081+0000 mgr.a (mgr.14388) 12905 : audit [DBG] from='client.281919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:41 smithi163 bash[24253]: audit 2024-08-31T07:09:40.117081+0000 mgr.a (mgr.14388) 12905 : audit [DBG] from='client.281919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:41.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:41 smithi027 bash[22610]: audit 2024-08-31T07:09:40.117081+0000 mgr.a (mgr.14388) 12905 : audit [DBG] from='client.281919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:42 smithi191 bash[24992]: cluster 2024-08-31T07:09:41.380728+0000 mgr.a (mgr.14388) 12906 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:42 smithi163 bash[24253]: cluster 2024-08-31T07:09:41.380728+0000 mgr.a (mgr.14388) 12906 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:42 smithi027 bash[22610]: cluster 2024-08-31T07:09:41.380728+0000 mgr.a (mgr.14388) 12906 : cluster [DBG] pgmap v8946: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:44 smithi191 bash[24992]: cluster 2024-08-31T07:09:43.383085+0000 mgr.a (mgr.14388) 12907 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:44 smithi163 bash[24253]: cluster 2024-08-31T07:09:43.383085+0000 mgr.a (mgr.14388) 12907 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:44.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:44 smithi027 bash[22610]: cluster 2024-08-31T07:09:43.383085+0000 mgr.a (mgr.14388) 12907 : cluster [DBG] pgmap v8947: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:45.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:09:45.568 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:09:45.568 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:46.325 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:46.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:46.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:46.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:46.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:46 smithi191 bash[24992]: cluster 2024-08-31T07:09:45.383970+0000 mgr.a (mgr.14388) 12908 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:46 smithi163 bash[24253]: cluster 2024-08-31T07:09:45.383970+0000 mgr.a (mgr.14388) 12908 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:46 smithi027 bash[22610]: cluster 2024-08-31T07:09:45.383970+0000 mgr.a (mgr.14388) 12908 : cluster [DBG] pgmap v8948: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:47 smithi191 bash[24992]: audit 2024-08-31T07:09:45.899256+0000 mgr.a (mgr.14388) 12909 : audit [DBG] from='client.281997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:47 smithi163 bash[24253]: audit 2024-08-31T07:09:45.899256+0000 mgr.a (mgr.14388) 12909 : audit [DBG] from='client.281997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:47 smithi027 bash[22610]: audit 2024-08-31T07:09:45.899256+0000 mgr.a (mgr.14388) 12909 : audit [DBG] from='client.281997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:48 smithi191 bash[24992]: cluster 2024-08-31T07:09:47.384875+0000 mgr.a (mgr.14388) 12910 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:48 smithi163 bash[24253]: cluster 2024-08-31T07:09:47.384875+0000 mgr.a (mgr.14388) 12910 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:48 smithi027 bash[22610]: cluster 2024-08-31T07:09:47.384875+0000 mgr.a (mgr.14388) 12910 : cluster [DBG] pgmap v8949: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:50 smithi163 bash[24253]: cluster 2024-08-31T07:09:49.387018+0000 mgr.a (mgr.14388) 12911 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:50 smithi027 bash[22610]: cluster 2024-08-31T07:09:49.387018+0000 mgr.a (mgr.14388) 12911 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:50 smithi191 bash[24992]: cluster 2024-08-31T07:09:49.387018+0000 mgr.a (mgr.14388) 12911 : cluster [DBG] pgmap v8950: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:51.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:09:51.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:09:51.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:52.077 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:52.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:52.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:52.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:52.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:52 smithi163 bash[24253]: cluster 2024-08-31T07:09:51.387736+0000 mgr.a (mgr.14388) 12912 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:52 smithi163 bash[24253]: audit 2024-08-31T07:09:51.656743+0000 mgr.a (mgr.14388) 12913 : audit [DBG] from='client.282072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:52 smithi027 bash[22610]: cluster 2024-08-31T07:09:51.387736+0000 mgr.a (mgr.14388) 12912 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:52 smithi027 bash[22610]: audit 2024-08-31T07:09:51.656743+0000 mgr.a (mgr.14388) 12913 : audit [DBG] from='client.282072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:52 smithi191 bash[24992]: cluster 2024-08-31T07:09:51.387736+0000 mgr.a (mgr.14388) 12912 : cluster [DBG] pgmap v8951: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:52 smithi191 bash[24992]: audit 2024-08-31T07:09:51.656743+0000 mgr.a (mgr.14388) 12913 : audit [DBG] from='client.282072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:54 smithi163 bash[24253]: cluster 2024-08-31T07:09:53.390138+0000 mgr.a (mgr.14388) 12914 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:54 smithi027 bash[22610]: cluster 2024-08-31T07:09:53.390138+0000 mgr.a (mgr.14388) 12914 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:54 smithi191 bash[24992]: cluster 2024-08-31T07:09:53.390138+0000 mgr.a (mgr.14388) 12914 : cluster [DBG] pgmap v8952: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:09:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:56 smithi163 bash[24253]: cluster 2024-08-31T07:09:55.391078+0000 mgr.a (mgr.14388) 12915 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:56 smithi027 bash[22610]: cluster 2024-08-31T07:09:55.391078+0000 mgr.a (mgr.14388) 12915 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:56 smithi191 bash[24992]: cluster 2024-08-31T07:09:55.391078+0000 mgr.a (mgr.14388) 12915 : cluster [DBG] pgmap v8953: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:57.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:09:57.079 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:09:57.079 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:09:57.859 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:09:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:09:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:09:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:09:57.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:09:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:58 smithi163 bash[24253]: cluster 2024-08-31T07:09:57.391617+0000 mgr.a (mgr.14388) 12916 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:09:58 smithi163 bash[24253]: audit 2024-08-31T07:09:57.416358+0000 mgr.a (mgr.14388) 12917 : audit [DBG] from='client.282144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:58 smithi027 bash[22610]: cluster 2024-08-31T07:09:57.391617+0000 mgr.a (mgr.14388) 12916 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:09:58 smithi027 bash[22610]: audit 2024-08-31T07:09:57.416358+0000 mgr.a (mgr.14388) 12917 : audit [DBG] from='client.282144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:09:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:58 smithi191 bash[24992]: cluster 2024-08-31T07:09:57.391617+0000 mgr.a (mgr.14388) 12916 : cluster [DBG] pgmap v8954: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:09:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:09:58 smithi191 bash[24992]: audit 2024-08-31T07:09:57.416358+0000 mgr.a (mgr.14388) 12917 : audit [DBG] from='client.282144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:00 smithi163 bash[24253]: cluster 2024-08-31T07:09:59.393854+0000 mgr.a (mgr.14388) 12918 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:10:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:00 smithi163 bash[24253]: cluster 2024-08-31T07:10:00.000160+0000 mon.a (mon.0) 2503 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:10:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:00 smithi027 bash[22610]: cluster 2024-08-31T07:09:59.393854+0000 mgr.a (mgr.14388) 12918 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:10:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:00 smithi027 bash[22610]: cluster 2024-08-31T07:10:00.000160+0000 mon.a (mon.0) 2503 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:10:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:00 smithi191 bash[24992]: cluster 2024-08-31T07:09:59.393854+0000 mgr.a (mgr.14388) 12918 : cluster [DBG] pgmap v8955: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:10:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:00 smithi191 bash[24992]: cluster 2024-08-31T07:10:00.000160+0000 mon.a (mon.0) 2503 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:10:02.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:10:02.861 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:10:02.861 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:10:02.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:02 smithi163 bash[24253]: cluster 2024-08-31T07:10:01.394624+0000 mgr.a (mgr.14388) 12919 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:02 smithi027 bash[22610]: cluster 2024-08-31T07:10:01.394624+0000 mgr.a (mgr.14388) 12919 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:02 smithi191 bash[24992]: cluster 2024-08-31T07:10:01.394624+0000 mgr.a (mgr.14388) 12919 : cluster [DBG] pgmap v8956: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:03.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:10:03.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:10:03.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:10:03.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:10:03.618 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:10:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:04 smithi163 bash[24253]: audit 2024-08-31T07:10:03.195110+0000 mgr.a (mgr.14388) 12920 : audit [DBG] from='client.282222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:04 smithi163 bash[24253]: cluster 2024-08-31T07:10:03.396012+0000 mgr.a (mgr.14388) 12921 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:04 smithi027 bash[22610]: audit 2024-08-31T07:10:03.195110+0000 mgr.a (mgr.14388) 12920 : audit [DBG] from='client.282222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:04 smithi027 bash[22610]: cluster 2024-08-31T07:10:03.396012+0000 mgr.a (mgr.14388) 12921 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:04 smithi191 bash[24992]: audit 2024-08-31T07:10:03.195110+0000 mgr.a (mgr.14388) 12920 : audit [DBG] from='client.282222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:04 smithi191 bash[24992]: cluster 2024-08-31T07:10:03.396012+0000 mgr.a (mgr.14388) 12921 : cluster [DBG] pgmap v8957: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:06 smithi163 bash[24253]: cluster 2024-08-31T07:10:05.396902+0000 mgr.a (mgr.14388) 12922 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:10:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:06 smithi027 bash[22610]: cluster 2024-08-31T07:10:05.396902+0000 mgr.a (mgr.14388) 12922 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:10:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:06 smithi191 bash[24992]: cluster 2024-08-31T07:10:05.396902+0000 mgr.a (mgr.14388) 12922 : cluster [DBG] pgmap v8958: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:10:08.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:10:08.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:10:08.619 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:10:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:08 smithi163 bash[24253]: cluster 2024-08-31T07:10:07.397676+0000 mgr.a (mgr.14388) 12923 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:10:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:08 smithi027 bash[22610]: cluster 2024-08-31T07:10:07.397676+0000 mgr.a (mgr.14388) 12923 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:10:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:08 smithi191 bash[24992]: cluster 2024-08-31T07:10:07.397676+0000 mgr.a (mgr.14388) 12923 : cluster [DBG] pgmap v8959: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:10:09.368 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:10:09.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:10:09.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:10:09.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:10:09.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:10:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:10 smithi163 bash[24253]: audit 2024-08-31T07:10:08.949226+0000 mgr.a (mgr.14388) 12924 : audit [DBG] from='client.282300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:10 smithi163 bash[24253]: cluster 2024-08-31T07:10:09.399118+0000 mgr.a (mgr.14388) 12925 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:10 smithi027 bash[22610]: audit 2024-08-31T07:10:08.949226+0000 mgr.a (mgr.14388) 12924 : audit [DBG] from='client.282300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:10 smithi027 bash[22610]: cluster 2024-08-31T07:10:09.399118+0000 mgr.a (mgr.14388) 12925 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:10 smithi191 bash[24992]: audit 2024-08-31T07:10:08.949226+0000 mgr.a (mgr.14388) 12924 : audit [DBG] from='client.282300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:10 smithi191 bash[24992]: cluster 2024-08-31T07:10:09.399118+0000 mgr.a (mgr.14388) 12925 : cluster [DBG] pgmap v8960: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:12 smithi163 bash[24253]: cluster 2024-08-31T07:10:11.399870+0000 mgr.a (mgr.14388) 12926 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:10:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:12 smithi027 bash[22610]: cluster 2024-08-31T07:10:11.399870+0000 mgr.a (mgr.14388) 12926 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:10:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:12 smithi191 bash[24992]: cluster 2024-08-31T07:10:11.399870+0000 mgr.a (mgr.14388) 12926 : cluster [DBG] pgmap v8961: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:10:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:13 smithi163 bash[24253]: audit 2024-08-31T07:10:13.189218+0000 mon.a (mon.0) 2504 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:10:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:13 smithi027 bash[22610]: audit 2024-08-31T07:10:13.189218+0000 mon.a (mon.0) 2504 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:10:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:13 smithi191 bash[24992]: audit 2024-08-31T07:10:13.189218+0000 mon.a (mon.0) 2504 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:10:14.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:10:14.370 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:10:14.370 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:10:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:14 smithi163 bash[24253]: cluster 2024-08-31T07:10:13.401806+0000 mgr.a (mgr.14388) 12927 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:14 smithi163 bash[24253]: audit 2024-08-31T07:10:13.813855+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:10:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:14 smithi163 bash[24253]: audit 2024-08-31T07:10:13.818765+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:10:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:14 smithi163 bash[24253]: audit 2024-08-31T07:10:14.569924+0000 mon.a (mon.0) 2507 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:10:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:14 smithi163 bash[24253]: audit 2024-08-31T07:10:14.571382+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:10:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:14 smithi163 bash[24253]: audit 2024-08-31T07:10:14.578910+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:10:15.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:14 smithi163 bash[24253]: audit 2024-08-31T07:10:14.583439+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:10:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:14 smithi027 bash[22610]: cluster 2024-08-31T07:10:13.401806+0000 mgr.a (mgr.14388) 12927 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:14 smithi027 bash[22610]: audit 2024-08-31T07:10:13.813855+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:10:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:14 smithi027 bash[22610]: audit 2024-08-31T07:10:13.818765+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:10:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:14 smithi027 bash[22610]: audit 2024-08-31T07:10:14.569924+0000 mon.a (mon.0) 2507 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:10:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:14 smithi027 bash[22610]: audit 2024-08-31T07:10:14.571382+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:10:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:14 smithi027 bash[22610]: audit 2024-08-31T07:10:14.578910+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:10:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:14 smithi027 bash[22610]: audit 2024-08-31T07:10:14.583439+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:10:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:14 smithi191 bash[24992]: cluster 2024-08-31T07:10:13.401806+0000 mgr.a (mgr.14388) 12927 : cluster [DBG] pgmap v8962: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:14 smithi191 bash[24992]: audit 2024-08-31T07:10:13.813855+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:10:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:14 smithi191 bash[24992]: audit 2024-08-31T07:10:13.818765+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:10:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:14 smithi191 bash[24992]: audit 2024-08-31T07:10:14.569924+0000 mon.a (mon.0) 2507 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:10:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:14 smithi191 bash[24992]: audit 2024-08-31T07:10:14.571382+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:10:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:14 smithi191 bash[24992]: audit 2024-08-31T07:10:14.578910+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:10:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:14 smithi191 bash[24992]: audit 2024-08-31T07:10:14.583439+0000 mon.a (mon.0) 2510 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:10:15.712 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:10:15.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:10:15.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:10:15.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:10:15.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:10:15.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:10:15 smithi027 bash[22863]: debug 2024-08-31T07:10:15.305+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:10:15.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:10:15 smithi027 bash[22863]: debug 2024-08-31T07:10:15.321+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:10:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:15 smithi163 bash[24253]: audit 2024-08-31T07:10:14.585635+0000 mgr.a (mgr.14388) 12928 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:10:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:15 smithi163 bash[24253]: audit 2024-08-31T07:10:14.713074+0000 mgr.a (mgr.14388) 12929 : audit [DBG] from='client.282375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:15 smithi027 bash[22610]: audit 2024-08-31T07:10:14.585635+0000 mgr.a (mgr.14388) 12928 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:10:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:15 smithi027 bash[22610]: audit 2024-08-31T07:10:14.713074+0000 mgr.a (mgr.14388) 12929 : audit [DBG] from='client.282375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:15 smithi191 bash[24992]: audit 2024-08-31T07:10:14.585635+0000 mgr.a (mgr.14388) 12928 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:10:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:15 smithi191 bash[24992]: audit 2024-08-31T07:10:14.713074+0000 mgr.a (mgr.14388) 12929 : audit [DBG] from='client.282375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:16 smithi163 bash[24253]: audit 2024-08-31T07:10:15.310620+0000 mgr.a (mgr.14388) 12930 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:10:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:16 smithi163 bash[24253]: cephadm 2024-08-31T07:10:15.322817+0000 mgr.a (mgr.14388) 12931 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:10:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:16 smithi163 bash[24253]: cluster 2024-08-31T07:10:15.402300+0000 mgr.a (mgr.14388) 12932 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:16 smithi027 bash[22610]: audit 2024-08-31T07:10:15.310620+0000 mgr.a (mgr.14388) 12930 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:10:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:16 smithi027 bash[22610]: cephadm 2024-08-31T07:10:15.322817+0000 mgr.a (mgr.14388) 12931 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:10:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:16 smithi027 bash[22610]: cluster 2024-08-31T07:10:15.402300+0000 mgr.a (mgr.14388) 12932 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:16 smithi191 bash[24992]: audit 2024-08-31T07:10:15.310620+0000 mgr.a (mgr.14388) 12930 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:10:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:16 smithi191 bash[24992]: cephadm 2024-08-31T07:10:15.322817+0000 mgr.a (mgr.14388) 12931 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:10:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:16 smithi191 bash[24992]: cluster 2024-08-31T07:10:15.402300+0000 mgr.a (mgr.14388) 12932 : cluster [DBG] pgmap v8963: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:18 smithi163 bash[24253]: cluster 2024-08-31T07:10:17.403260+0000 mgr.a (mgr.14388) 12933 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:18 smithi027 bash[22610]: cluster 2024-08-31T07:10:17.403260+0000 mgr.a (mgr.14388) 12933 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:18 smithi191 bash[24992]: cluster 2024-08-31T07:10:17.403260+0000 mgr.a (mgr.14388) 12933 : cluster [DBG] pgmap v8964: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:20.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:10:20.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:10:20.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:10:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:20 smithi163 bash[24253]: cluster 2024-08-31T07:10:19.405495+0000 mgr.a (mgr.14388) 12934 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:20 smithi027 bash[22610]: cluster 2024-08-31T07:10:19.405495+0000 mgr.a (mgr.14388) 12934 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:20 smithi191 bash[24992]: cluster 2024-08-31T07:10:19.405495+0000 mgr.a (mgr.14388) 12934 : cluster [DBG] pgmap v8965: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:21.494 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:10:21.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:10:21.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:10:21.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:10:21.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:10:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:22 smithi163 bash[24253]: audit 2024-08-31T07:10:21.052521+0000 mgr.a (mgr.14388) 12935 : audit [DBG] from='client.282561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:22 smithi163 bash[24253]: cluster 2024-08-31T07:10:21.406285+0000 mgr.a (mgr.14388) 12936 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:22 smithi027 bash[22610]: audit 2024-08-31T07:10:21.052521+0000 mgr.a (mgr.14388) 12935 : audit [DBG] from='client.282561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:22 smithi027 bash[22610]: cluster 2024-08-31T07:10:21.406285+0000 mgr.a (mgr.14388) 12936 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:22 smithi191 bash[24992]: audit 2024-08-31T07:10:21.052521+0000 mgr.a (mgr.14388) 12935 : audit [DBG] from='client.282561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:22 smithi191 bash[24992]: cluster 2024-08-31T07:10:21.406285+0000 mgr.a (mgr.14388) 12936 : cluster [DBG] pgmap v8966: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:24 smithi163 bash[24253]: cluster 2024-08-31T07:10:23.408455+0000 mgr.a (mgr.14388) 12937 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:24 smithi027 bash[22610]: cluster 2024-08-31T07:10:23.408455+0000 mgr.a (mgr.14388) 12937 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:24 smithi191 bash[24992]: cluster 2024-08-31T07:10:23.408455+0000 mgr.a (mgr.14388) 12937 : cluster [DBG] pgmap v8967: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:26.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:10:26.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:10:26.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:10:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:26 smithi163 bash[24253]: cluster 2024-08-31T07:10:25.409222+0000 mgr.a (mgr.14388) 12938 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:26 smithi027 bash[22610]: cluster 2024-08-31T07:10:25.409222+0000 mgr.a (mgr.14388) 12938 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:27.253 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:10:27.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:10:27.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:10:27.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:10:27.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:10:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:26 smithi191 bash[24992]: cluster 2024-08-31T07:10:25.409222+0000 mgr.a (mgr.14388) 12938 : cluster [DBG] pgmap v8968: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:27 smithi163 bash[24253]: audit 2024-08-31T07:10:26.828130+0000 mgr.a (mgr.14388) 12939 : audit [DBG] from='client.282636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:27 smithi027 bash[22610]: audit 2024-08-31T07:10:26.828130+0000 mgr.a (mgr.14388) 12939 : audit [DBG] from='client.282636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:27 smithi191 bash[24992]: audit 2024-08-31T07:10:26.828130+0000 mgr.a (mgr.14388) 12939 : audit [DBG] from='client.282636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:28 smithi163 bash[24253]: cluster 2024-08-31T07:10:27.410146+0000 mgr.a (mgr.14388) 12940 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:28 smithi027 bash[22610]: cluster 2024-08-31T07:10:27.410146+0000 mgr.a (mgr.14388) 12940 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:28 smithi191 bash[24992]: cluster 2024-08-31T07:10:27.410146+0000 mgr.a (mgr.14388) 12940 : cluster [DBG] pgmap v8969: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:30 smithi163 bash[24253]: cluster 2024-08-31T07:10:29.412413+0000 mgr.a (mgr.14388) 12941 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:30 smithi027 bash[22610]: cluster 2024-08-31T07:10:29.412413+0000 mgr.a (mgr.14388) 12941 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:30 smithi191 bash[24992]: cluster 2024-08-31T07:10:29.412413+0000 mgr.a (mgr.14388) 12941 : cluster [DBG] pgmap v8970: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:10:32.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:10:32.256 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:10:32.256 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:10:33.025 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:10:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:10:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:10:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:10:33.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:10:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:32 smithi163 bash[24253]: cluster 2024-08-31T07:10:31.413183+0000 mgr.a (mgr.14388) 12942 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:32 smithi027 bash[22610]: cluster 2024-08-31T07:10:31.413183+0000 mgr.a (mgr.14388) 12942 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:32 smithi191 bash[24992]: cluster 2024-08-31T07:10:31.413183+0000 mgr.a (mgr.14388) 12942 : cluster [DBG] pgmap v8971: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:33 smithi163 bash[24253]: audit 2024-08-31T07:10:32.590019+0000 mgr.a (mgr.14388) 12943 : audit [DBG] from='client.282714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:33 smithi027 bash[22610]: audit 2024-08-31T07:10:32.590019+0000 mgr.a (mgr.14388) 12943 : audit [DBG] from='client.282714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:33 smithi191 bash[24992]: audit 2024-08-31T07:10:32.590019+0000 mgr.a (mgr.14388) 12943 : audit [DBG] from='client.282714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:34 smithi163 bash[24253]: cluster 2024-08-31T07:10:33.415508+0000 mgr.a (mgr.14388) 12944 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:10:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:34 smithi027 bash[22610]: cluster 2024-08-31T07:10:33.415508+0000 mgr.a (mgr.14388) 12944 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:10:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:34 smithi191 bash[24992]: cluster 2024-08-31T07:10:33.415508+0000 mgr.a (mgr.14388) 12944 : cluster [DBG] pgmap v8972: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:10:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:35 smithi163 bash[24253]: cluster 2024-08-31T07:10:35.416279+0000 mgr.a (mgr.14388) 12945 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:10:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:35 smithi027 bash[22610]: cluster 2024-08-31T07:10:35.416279+0000 mgr.a (mgr.14388) 12945 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:10:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:35 smithi191 bash[24992]: cluster 2024-08-31T07:10:35.416279+0000 mgr.a (mgr.14388) 12945 : cluster [DBG] pgmap v8973: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:10:38.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:10:38.027 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:10:38.027 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:10:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:38 smithi027 bash[22610]: cluster 2024-08-31T07:10:37.417054+0000 mgr.a (mgr.14388) 12946 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:10:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:38 smithi191 bash[24992]: cluster 2024-08-31T07:10:37.417054+0000 mgr.a (mgr.14388) 12946 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:10:38.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:10:38.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:10:38.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:10:38.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:10:38.800 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:10:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:38 smithi163 bash[24253]: cluster 2024-08-31T07:10:37.417054+0000 mgr.a (mgr.14388) 12946 : cluster [DBG] pgmap v8974: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:10:39.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:39 smithi027 bash[22610]: audit 2024-08-31T07:10:38.360009+0000 mgr.a (mgr.14388) 12947 : audit [DBG] from='client.282789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:39 smithi191 bash[24992]: audit 2024-08-31T07:10:38.360009+0000 mgr.a (mgr.14388) 12947 : audit [DBG] from='client.282789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:39 smithi163 bash[24253]: audit 2024-08-31T07:10:38.360009+0000 mgr.a (mgr.14388) 12947 : audit [DBG] from='client.282789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:40 smithi191 bash[24992]: cluster 2024-08-31T07:10:39.419868+0000 mgr.a (mgr.14388) 12948 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:40 smithi163 bash[24253]: cluster 2024-08-31T07:10:39.419868+0000 mgr.a (mgr.14388) 12948 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:40 smithi027 bash[22610]: cluster 2024-08-31T07:10:39.419868+0000 mgr.a (mgr.14388) 12948 : cluster [DBG] pgmap v8975: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:42 smithi191 bash[24992]: cluster 2024-08-31T07:10:41.420642+0000 mgr.a (mgr.14388) 12949 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:10:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:42 smithi163 bash[24253]: cluster 2024-08-31T07:10:41.420642+0000 mgr.a (mgr.14388) 12949 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:10:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:42 smithi027 bash[22610]: cluster 2024-08-31T07:10:41.420642+0000 mgr.a (mgr.14388) 12949 : cluster [DBG] pgmap v8976: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:10:43.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:10:43.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:10:43.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:10:44.538 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:10:44.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:10:44.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:10:44.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:10:44.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:10:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:44 smithi191 bash[24992]: cluster 2024-08-31T07:10:43.422595+0000 mgr.a (mgr.14388) 12950 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:44 smithi163 bash[24253]: cluster 2024-08-31T07:10:43.422595+0000 mgr.a (mgr.14388) 12950 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:44.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:44 smithi027 bash[22610]: cluster 2024-08-31T07:10:43.422595+0000 mgr.a (mgr.14388) 12950 : cluster [DBG] pgmap v8977: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:45 smithi191 bash[24992]: audit 2024-08-31T07:10:44.130653+0000 mgr.a (mgr.14388) 12951 : audit [DBG] from='client.282864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:45 smithi163 bash[24253]: audit 2024-08-31T07:10:44.130653+0000 mgr.a (mgr.14388) 12951 : audit [DBG] from='client.282864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:45 smithi027 bash[22610]: audit 2024-08-31T07:10:44.130653+0000 mgr.a (mgr.14388) 12951 : audit [DBG] from='client.282864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:46 smithi191 bash[24992]: cluster 2024-08-31T07:10:45.423554+0000 mgr.a (mgr.14388) 12952 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:10:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:46 smithi163 bash[24253]: cluster 2024-08-31T07:10:45.423554+0000 mgr.a (mgr.14388) 12952 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:10:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:46 smithi027 bash[22610]: cluster 2024-08-31T07:10:45.423554+0000 mgr.a (mgr.14388) 12952 : cluster [DBG] pgmap v8978: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:10:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:48 smithi191 bash[24992]: cluster 2024-08-31T07:10:47.424345+0000 mgr.a (mgr.14388) 12953 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:10:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:48 smithi163 bash[24253]: cluster 2024-08-31T07:10:47.424345+0000 mgr.a (mgr.14388) 12953 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:10:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:48 smithi027 bash[22610]: cluster 2024-08-31T07:10:47.424345+0000 mgr.a (mgr.14388) 12953 : cluster [DBG] pgmap v8979: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:10:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:10:49.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:10:49.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:10:50.286 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:10:50.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:10:50.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:10:50.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:10:50.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:10:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:50 smithi191 bash[24992]: cluster 2024-08-31T07:10:49.426551+0000 mgr.a (mgr.14388) 12954 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:10:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:50 smithi191 bash[24992]: audit 2024-08-31T07:10:49.868219+0000 mgr.a (mgr.14388) 12955 : audit [DBG] from='client.282942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:50 smithi163 bash[24253]: cluster 2024-08-31T07:10:49.426551+0000 mgr.a (mgr.14388) 12954 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:10:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:50 smithi163 bash[24253]: audit 2024-08-31T07:10:49.868219+0000 mgr.a (mgr.14388) 12955 : audit [DBG] from='client.282942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:50 smithi027 bash[22610]: cluster 2024-08-31T07:10:49.426551+0000 mgr.a (mgr.14388) 12954 : cluster [DBG] pgmap v8980: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:10:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:50 smithi027 bash[22610]: audit 2024-08-31T07:10:49.868219+0000 mgr.a (mgr.14388) 12955 : audit [DBG] from='client.282942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:52.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:52 smithi191 bash[24992]: cluster 2024-08-31T07:10:51.427474+0000 mgr.a (mgr.14388) 12956 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:52 smithi163 bash[24253]: cluster 2024-08-31T07:10:51.427474+0000 mgr.a (mgr.14388) 12956 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:52 smithi027 bash[22610]: cluster 2024-08-31T07:10:51.427474+0000 mgr.a (mgr.14388) 12956 : cluster [DBG] pgmap v8981: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:54 smithi191 bash[24992]: cluster 2024-08-31T07:10:53.429614+0000 mgr.a (mgr.14388) 12957 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:10:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:54 smithi163 bash[24253]: cluster 2024-08-31T07:10:53.429614+0000 mgr.a (mgr.14388) 12957 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:10:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:54 smithi027 bash[22610]: cluster 2024-08-31T07:10:53.429614+0000 mgr.a (mgr.14388) 12957 : cluster [DBG] pgmap v8982: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:10:55.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:10:55.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:10:55.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:10:56.036 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:10:56.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:10:56.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:10:56.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:10:56.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:10:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:56 smithi191 bash[24992]: cluster 2024-08-31T07:10:55.430308+0000 mgr.a (mgr.14388) 12958 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:56 smithi191 bash[24992]: audit 2024-08-31T07:10:55.615448+0000 mgr.a (mgr.14388) 12959 : audit [DBG] from='client.283020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:56 smithi163 bash[24253]: cluster 2024-08-31T07:10:55.430308+0000 mgr.a (mgr.14388) 12958 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:56 smithi163 bash[24253]: audit 2024-08-31T07:10:55.615448+0000 mgr.a (mgr.14388) 12959 : audit [DBG] from='client.283020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:56 smithi027 bash[22610]: cluster 2024-08-31T07:10:55.430308+0000 mgr.a (mgr.14388) 12958 : cluster [DBG] pgmap v8983: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:56 smithi027 bash[22610]: audit 2024-08-31T07:10:55.615448+0000 mgr.a (mgr.14388) 12959 : audit [DBG] from='client.283020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:10:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:10:58 smithi163 bash[24253]: cluster 2024-08-31T07:10:57.431370+0000 mgr.a (mgr.14388) 12960 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:10:58 smithi027 bash[22610]: cluster 2024-08-31T07:10:57.431370+0000 mgr.a (mgr.14388) 12960 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:10:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:10:58 smithi191 bash[24992]: cluster 2024-08-31T07:10:57.431370+0000 mgr.a (mgr.14388) 12960 : cluster [DBG] pgmap v8984: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:00 smithi163 bash[24253]: cluster 2024-08-31T07:10:59.433599+0000 mgr.a (mgr.14388) 12961 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:00 smithi027 bash[22610]: cluster 2024-08-31T07:10:59.433599+0000 mgr.a (mgr.14388) 12961 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:01.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:00 smithi191 bash[24992]: cluster 2024-08-31T07:10:59.433599+0000 mgr.a (mgr.14388) 12961 : cluster [DBG] pgmap v8985: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:01.820 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:11:01.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:01.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:01.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:01.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:02 smithi163 bash[24253]: audit 2024-08-31T07:11:01.376791+0000 mgr.a (mgr.14388) 12962 : audit [DBG] from='client.283098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:02 smithi163 bash[24253]: cluster 2024-08-31T07:11:01.434586+0000 mgr.a (mgr.14388) 12963 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:02 smithi027 bash[22610]: audit 2024-08-31T07:11:01.376791+0000 mgr.a (mgr.14388) 12962 : audit [DBG] from='client.283098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:02 smithi027 bash[22610]: cluster 2024-08-31T07:11:01.434586+0000 mgr.a (mgr.14388) 12963 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:02 smithi191 bash[24992]: audit 2024-08-31T07:11:01.376791+0000 mgr.a (mgr.14388) 12962 : audit [DBG] from='client.283098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:02 smithi191 bash[24992]: cluster 2024-08-31T07:11:01.434586+0000 mgr.a (mgr.14388) 12963 : cluster [DBG] pgmap v8986: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:04 smithi163 bash[24253]: cluster 2024-08-31T07:11:03.437410+0000 mgr.a (mgr.14388) 12964 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:04 smithi027 bash[22610]: cluster 2024-08-31T07:11:03.437410+0000 mgr.a (mgr.14388) 12964 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:04 smithi191 bash[24992]: cluster 2024-08-31T07:11:03.437410+0000 mgr.a (mgr.14388) 12964 : cluster [DBG] pgmap v8987: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:06.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:06 smithi163 bash[24253]: cluster 2024-08-31T07:11:05.438236+0000 mgr.a (mgr.14388) 12965 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:06 smithi027 bash[22610]: cluster 2024-08-31T07:11:05.438236+0000 mgr.a (mgr.14388) 12965 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:06 smithi191 bash[24992]: cluster 2024-08-31T07:11:05.438236+0000 mgr.a (mgr.14388) 12965 : cluster [DBG] pgmap v8988: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:07.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:07.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:07.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:07.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:07.556 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:11:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:08 smithi163 bash[24253]: audit 2024-08-31T07:11:07.145658+0000 mgr.a (mgr.14388) 12966 : audit [DBG] from='client.283176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:08 smithi163 bash[24253]: cluster 2024-08-31T07:11:07.438745+0000 mgr.a (mgr.14388) 12967 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:08 smithi027 bash[22610]: audit 2024-08-31T07:11:07.145658+0000 mgr.a (mgr.14388) 12966 : audit [DBG] from='client.283176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:08 smithi027 bash[22610]: cluster 2024-08-31T07:11:07.438745+0000 mgr.a (mgr.14388) 12967 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:08 smithi191 bash[24992]: audit 2024-08-31T07:11:07.145658+0000 mgr.a (mgr.14388) 12966 : audit [DBG] from='client.283176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:08 smithi191 bash[24992]: cluster 2024-08-31T07:11:07.438745+0000 mgr.a (mgr.14388) 12967 : cluster [DBG] pgmap v8989: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:10 smithi163 bash[24253]: cluster 2024-08-31T07:11:09.440991+0000 mgr.a (mgr.14388) 12968 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:10 smithi027 bash[22610]: cluster 2024-08-31T07:11:09.440991+0000 mgr.a (mgr.14388) 12968 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:10 smithi191 bash[24992]: cluster 2024-08-31T07:11:09.440991+0000 mgr.a (mgr.14388) 12968 : cluster [DBG] pgmap v8990: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:12.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:12.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:12.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:12 smithi163 bash[24253]: cluster 2024-08-31T07:11:11.441713+0000 mgr.a (mgr.14388) 12969 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:12 smithi027 bash[22610]: cluster 2024-08-31T07:11:11.441713+0000 mgr.a (mgr.14388) 12969 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:12 smithi191 bash[24992]: cluster 2024-08-31T07:11:11.441713+0000 mgr.a (mgr.14388) 12969 : cluster [DBG] pgmap v8991: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:13.297 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:11:13.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:13.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:13.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:13.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:14 smithi163 bash[24253]: audit 2024-08-31T07:11:12.884606+0000 mgr.a (mgr.14388) 12970 : audit [DBG] from='client.283254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:14 smithi163 bash[24253]: cluster 2024-08-31T07:11:13.444487+0000 mgr.a (mgr.14388) 12971 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:14 smithi027 bash[22610]: audit 2024-08-31T07:11:12.884606+0000 mgr.a (mgr.14388) 12970 : audit [DBG] from='client.283254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:14 smithi027 bash[22610]: cluster 2024-08-31T07:11:13.444487+0000 mgr.a (mgr.14388) 12971 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:14 smithi191 bash[24992]: audit 2024-08-31T07:11:12.884606+0000 mgr.a (mgr.14388) 12970 : audit [DBG] from='client.283254 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:14 smithi191 bash[24992]: cluster 2024-08-31T07:11:13.444487+0000 mgr.a (mgr.14388) 12971 : cluster [DBG] pgmap v8992: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:15 smithi163 bash[24253]: audit 2024-08-31T07:11:15.381515+0000 mon.a (mon.0) 2511 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:11:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:15 smithi027 bash[22610]: audit 2024-08-31T07:11:15.381515+0000 mon.a (mon.0) 2511 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:11:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:15 smithi191 bash[24992]: audit 2024-08-31T07:11:15.381515+0000 mon.a (mon.0) 2511 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:11:16.583 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:16 smithi027 bash[22610]: cluster 2024-08-31T07:11:15.445084+0000 mgr.a (mgr.14388) 12972 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:11:16.584 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:16 smithi027 bash[22610]: audit 2024-08-31T07:11:15.983959+0000 mon.a (mon.0) 2512 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:16 smithi163 bash[24253]: cluster 2024-08-31T07:11:15.445084+0000 mgr.a (mgr.14388) 12972 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:11:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:16 smithi163 bash[24253]: audit 2024-08-31T07:11:15.983959+0000 mon.a (mon.0) 2512 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:16 smithi163 bash[24253]: audit 2024-08-31T07:11:15.990560+0000 mon.a (mon.0) 2513 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:16 smithi163 bash[24253]: audit 2024-08-31T07:11:15.998905+0000 mon.a (mon.0) 2514 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:16 smithi163 bash[24253]: audit 2024-08-31T07:11:16.007077+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:16.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:16 smithi027 bash[22610]: audit 2024-08-31T07:11:15.990560+0000 mon.a (mon.0) 2513 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:16.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:16 smithi027 bash[22610]: audit 2024-08-31T07:11:15.998905+0000 mon.a (mon.0) 2514 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:16.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:16 smithi027 bash[22610]: audit 2024-08-31T07:11:16.007077+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:16 smithi191 bash[24992]: cluster 2024-08-31T07:11:15.445084+0000 mgr.a (mgr.14388) 12972 : cluster [DBG] pgmap v8993: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:11:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:16 smithi191 bash[24992]: audit 2024-08-31T07:11:15.983959+0000 mon.a (mon.0) 2512 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:16 smithi191 bash[24992]: audit 2024-08-31T07:11:15.990560+0000 mon.a (mon.0) 2513 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:16 smithi191 bash[24992]: audit 2024-08-31T07:11:15.998905+0000 mon.a (mon.0) 2514 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:16 smithi191 bash[24992]: audit 2024-08-31T07:11:16.007077+0000 mon.a (mon.0) 2515 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:17.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:11:17 smithi027 bash[22863]: debug 2024-08-31T07:11:17.396+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:11:17.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:11:17 smithi027 bash[22863]: debug 2024-08-31T07:11:17.396+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:11:17.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:17 smithi027 bash[22610]: audit 2024-08-31T07:11:16.637273+0000 mon.a (mon.0) 2516 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:11:17.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:17 smithi027 bash[22610]: audit 2024-08-31T07:11:16.638436+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:11:17.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:17 smithi027 bash[22610]: audit 2024-08-31T07:11:16.648187+0000 mon.a (mon.0) 2518 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:17.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:17 smithi027 bash[22610]: audit 2024-08-31T07:11:16.650782+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:11:17.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:17 smithi027 bash[22610]: audit 2024-08-31T07:11:16.653103+0000 mgr.a (mgr.14388) 12973 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:11:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:17 smithi163 bash[24253]: audit 2024-08-31T07:11:16.637273+0000 mon.a (mon.0) 2516 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:11:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:17 smithi163 bash[24253]: audit 2024-08-31T07:11:16.638436+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:11:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:17 smithi163 bash[24253]: audit 2024-08-31T07:11:16.648187+0000 mon.a (mon.0) 2518 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:17 smithi163 bash[24253]: audit 2024-08-31T07:11:16.650782+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:11:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:17 smithi163 bash[24253]: audit 2024-08-31T07:11:16.653103+0000 mgr.a (mgr.14388) 12973 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:11:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:17 smithi191 bash[24992]: audit 2024-08-31T07:11:16.637273+0000 mon.a (mon.0) 2516 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:11:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:17 smithi191 bash[24992]: audit 2024-08-31T07:11:16.638436+0000 mon.a (mon.0) 2517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:11:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:17 smithi191 bash[24992]: audit 2024-08-31T07:11:16.648187+0000 mon.a (mon.0) 2518 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:11:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:17 smithi191 bash[24992]: audit 2024-08-31T07:11:16.650782+0000 mon.a (mon.0) 2519 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:11:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:17 smithi191 bash[24992]: audit 2024-08-31T07:11:16.653103+0000 mgr.a (mgr.14388) 12973 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:11:18.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:18.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:18.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:18 smithi163 bash[24253]: audit 2024-08-31T07:11:17.399757+0000 mgr.a (mgr.14388) 12974 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:11:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:18 smithi163 bash[24253]: cephadm 2024-08-31T07:11:17.401097+0000 mgr.a (mgr.14388) 12975 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:11:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:18 smithi163 bash[24253]: cluster 2024-08-31T07:11:17.445677+0000 mgr.a (mgr.14388) 12976 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:11:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:18 smithi027 bash[22610]: audit 2024-08-31T07:11:17.399757+0000 mgr.a (mgr.14388) 12974 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:11:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:18 smithi027 bash[22610]: cephadm 2024-08-31T07:11:17.401097+0000 mgr.a (mgr.14388) 12975 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:11:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:18 smithi027 bash[22610]: cluster 2024-08-31T07:11:17.445677+0000 mgr.a (mgr.14388) 12976 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:11:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:18 smithi191 bash[24992]: audit 2024-08-31T07:11:17.399757+0000 mgr.a (mgr.14388) 12974 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:11:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:18 smithi191 bash[24992]: cephadm 2024-08-31T07:11:17.401097+0000 mgr.a (mgr.14388) 12975 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:11:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:18 smithi191 bash[24992]: cluster 2024-08-31T07:11:17.445677+0000 mgr.a (mgr.14388) 12976 : cluster [DBG] pgmap v8994: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:11:19.039 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:11:19.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:19.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:19.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:19.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:19 smithi163 bash[24253]: audit 2024-08-31T07:11:18.621299+0000 mgr.a (mgr.14388) 12977 : audit [DBG] from='client.283440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:19 smithi027 bash[22610]: audit 2024-08-31T07:11:18.621299+0000 mgr.a (mgr.14388) 12977 : audit [DBG] from='client.283440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:19 smithi191 bash[24992]: audit 2024-08-31T07:11:18.621299+0000 mgr.a (mgr.14388) 12977 : audit [DBG] from='client.283440 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:20 smithi163 bash[24253]: cluster 2024-08-31T07:11:19.448401+0000 mgr.a (mgr.14388) 12978 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:20 smithi027 bash[22610]: cluster 2024-08-31T07:11:19.448401+0000 mgr.a (mgr.14388) 12978 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:20 smithi191 bash[24992]: cluster 2024-08-31T07:11:19.448401+0000 mgr.a (mgr.14388) 12978 : cluster [DBG] pgmap v8995: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:22 smithi163 bash[24253]: cluster 2024-08-31T07:11:21.449197+0000 mgr.a (mgr.14388) 12979 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:11:22.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:22 smithi027 bash[22610]: cluster 2024-08-31T07:11:21.449197+0000 mgr.a (mgr.14388) 12979 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:11:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:22 smithi191 bash[24992]: cluster 2024-08-31T07:11:21.449197+0000 mgr.a (mgr.14388) 12979 : cluster [DBG] pgmap v8996: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:11:24.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:24.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:24.802 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:11:24.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:24.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:24.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:24.803 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:24 smithi163 bash[24253]: cluster 2024-08-31T07:11:23.451102+0000 mgr.a (mgr.14388) 12980 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:24 smithi027 bash[22610]: cluster 2024-08-31T07:11:23.451102+0000 mgr.a (mgr.14388) 12980 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:24 smithi191 bash[24992]: cluster 2024-08-31T07:11:23.451102+0000 mgr.a (mgr.14388) 12980 : cluster [DBG] pgmap v8997: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:25 smithi163 bash[24253]: audit 2024-08-31T07:11:24.370965+0000 mgr.a (mgr.14388) 12981 : audit [DBG] from='client.283512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:25 smithi027 bash[22610]: audit 2024-08-31T07:11:24.370965+0000 mgr.a (mgr.14388) 12981 : audit [DBG] from='client.283512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:25 smithi191 bash[24992]: audit 2024-08-31T07:11:24.370965+0000 mgr.a (mgr.14388) 12981 : audit [DBG] from='client.283512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:26 smithi163 bash[24253]: cluster 2024-08-31T07:11:25.452073+0000 mgr.a (mgr.14388) 12982 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:26 smithi027 bash[22610]: cluster 2024-08-31T07:11:25.452073+0000 mgr.a (mgr.14388) 12982 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:26 smithi191 bash[24992]: cluster 2024-08-31T07:11:25.452073+0000 mgr.a (mgr.14388) 12982 : cluster [DBG] pgmap v8998: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:28 smithi163 bash[24253]: cluster 2024-08-31T07:11:27.452802+0000 mgr.a (mgr.14388) 12983 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:28.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:28 smithi027 bash[22610]: cluster 2024-08-31T07:11:27.452802+0000 mgr.a (mgr.14388) 12983 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:28 smithi191 bash[24992]: cluster 2024-08-31T07:11:27.452802+0000 mgr.a (mgr.14388) 12983 : cluster [DBG] pgmap v8999: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:29.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:30.579 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:11:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:30.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:30 smithi163 bash[24253]: cluster 2024-08-31T07:11:29.455006+0000 mgr.a (mgr.14388) 12984 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:30 smithi027 bash[22610]: cluster 2024-08-31T07:11:29.455006+0000 mgr.a (mgr.14388) 12984 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:30 smithi191 bash[24992]: cluster 2024-08-31T07:11:29.455006+0000 mgr.a (mgr.14388) 12984 : cluster [DBG] pgmap v9000: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:11:31.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:31 smithi027 bash[22610]: audit 2024-08-31T07:11:30.138809+0000 mgr.a (mgr.14388) 12985 : audit [DBG] from='client.283590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:31 smithi191 bash[24992]: audit 2024-08-31T07:11:30.138809+0000 mgr.a (mgr.14388) 12985 : audit [DBG] from='client.283590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:31 smithi163 bash[24253]: audit 2024-08-31T07:11:30.138809+0000 mgr.a (mgr.14388) 12985 : audit [DBG] from='client.283590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:32 smithi027 bash[22610]: cluster 2024-08-31T07:11:31.455941+0000 mgr.a (mgr.14388) 12986 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:32 smithi191 bash[24992]: cluster 2024-08-31T07:11:31.455941+0000 mgr.a (mgr.14388) 12986 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:32 smithi163 bash[24253]: cluster 2024-08-31T07:11:31.455941+0000 mgr.a (mgr.14388) 12986 : cluster [DBG] pgmap v9001: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:34 smithi027 bash[22610]: cluster 2024-08-31T07:11:33.458067+0000 mgr.a (mgr.14388) 12987 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:34 smithi191 bash[24992]: cluster 2024-08-31T07:11:33.458067+0000 mgr.a (mgr.14388) 12987 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:34 smithi163 bash[24253]: cluster 2024-08-31T07:11:33.458067+0000 mgr.a (mgr.14388) 12987 : cluster [DBG] pgmap v9002: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:35.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:35.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:35.582 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:36.369 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:11:36.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:36.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:36.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:36 smithi027 bash[22610]: cluster 2024-08-31T07:11:35.458876+0000 mgr.a (mgr.14388) 12988 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:36 smithi191 bash[24992]: cluster 2024-08-31T07:11:35.458876+0000 mgr.a (mgr.14388) 12988 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:36 smithi163 bash[24253]: cluster 2024-08-31T07:11:35.458876+0000 mgr.a (mgr.14388) 12988 : cluster [DBG] pgmap v9003: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:37 smithi027 bash[22610]: audit 2024-08-31T07:11:35.919336+0000 mgr.a (mgr.14388) 12989 : audit [DBG] from='client.283662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:37 smithi191 bash[24992]: audit 2024-08-31T07:11:35.919336+0000 mgr.a (mgr.14388) 12989 : audit [DBG] from='client.283662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:37 smithi163 bash[24253]: audit 2024-08-31T07:11:35.919336+0000 mgr.a (mgr.14388) 12989 : audit [DBG] from='client.283662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:38 smithi027 bash[22610]: cluster 2024-08-31T07:11:37.459765+0000 mgr.a (mgr.14388) 12990 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:38 smithi191 bash[24992]: cluster 2024-08-31T07:11:37.459765+0000 mgr.a (mgr.14388) 12990 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:38 smithi163 bash[24253]: cluster 2024-08-31T07:11:37.459765+0000 mgr.a (mgr.14388) 12990 : cluster [DBG] pgmap v9004: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:40 smithi027 bash[22610]: cluster 2024-08-31T07:11:39.462134+0000 mgr.a (mgr.14388) 12991 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:40 smithi191 bash[24992]: cluster 2024-08-31T07:11:39.462134+0000 mgr.a (mgr.14388) 12991 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:40 smithi163 bash[24253]: cluster 2024-08-31T07:11:39.462134+0000 mgr.a (mgr.14388) 12991 : cluster [DBG] pgmap v9005: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:41.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:41.371 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:41.371 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:42.145 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:11:42.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:42.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:42.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:42.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:42 smithi027 bash[22610]: cluster 2024-08-31T07:11:41.463011+0000 mgr.a (mgr.14388) 12992 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:42 smithi027 bash[22610]: audit 2024-08-31T07:11:41.704654+0000 mgr.a (mgr.14388) 12993 : audit [DBG] from='client.283734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:42 smithi191 bash[24992]: cluster 2024-08-31T07:11:41.463011+0000 mgr.a (mgr.14388) 12992 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:42 smithi191 bash[24992]: audit 2024-08-31T07:11:41.704654+0000 mgr.a (mgr.14388) 12993 : audit [DBG] from='client.283734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:42 smithi163 bash[24253]: cluster 2024-08-31T07:11:41.463011+0000 mgr.a (mgr.14388) 12992 : cluster [DBG] pgmap v9006: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:42 smithi163 bash[24253]: audit 2024-08-31T07:11:41.704654+0000 mgr.a (mgr.14388) 12993 : audit [DBG] from='client.283734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:44 smithi191 bash[24992]: cluster 2024-08-31T07:11:43.465228+0000 mgr.a (mgr.14388) 12994 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:44 smithi163 bash[24253]: cluster 2024-08-31T07:11:43.465228+0000 mgr.a (mgr.14388) 12994 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:44 smithi027 bash[22610]: cluster 2024-08-31T07:11:43.465228+0000 mgr.a (mgr.14388) 12994 : cluster [DBG] pgmap v9007: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:46 smithi191 bash[24992]: cluster 2024-08-31T07:11:45.466015+0000 mgr.a (mgr.14388) 12995 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:47.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:47.147 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:47.147 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:46 smithi163 bash[24253]: cluster 2024-08-31T07:11:45.466015+0000 mgr.a (mgr.14388) 12995 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:46 smithi027 bash[22610]: cluster 2024-08-31T07:11:45.466015+0000 mgr.a (mgr.14388) 12995 : cluster [DBG] pgmap v9008: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:47.891 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:11:47.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:47.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:47.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:47.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:48 smithi191 bash[24992]: cluster 2024-08-31T07:11:47.466742+0000 mgr.a (mgr.14388) 12996 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:48 smithi191 bash[24992]: audit 2024-08-31T07:11:47.477754+0000 mgr.a (mgr.14388) 12997 : audit [DBG] from='client.283809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:48 smithi163 bash[24253]: cluster 2024-08-31T07:11:47.466742+0000 mgr.a (mgr.14388) 12996 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:48 smithi163 bash[24253]: audit 2024-08-31T07:11:47.477754+0000 mgr.a (mgr.14388) 12997 : audit [DBG] from='client.283809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:48 smithi027 bash[22610]: cluster 2024-08-31T07:11:47.466742+0000 mgr.a (mgr.14388) 12996 : cluster [DBG] pgmap v9009: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:48 smithi027 bash[22610]: audit 2024-08-31T07:11:47.477754+0000 mgr.a (mgr.14388) 12997 : audit [DBG] from='client.283809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:50 smithi191 bash[24992]: cluster 2024-08-31T07:11:49.469034+0000 mgr.a (mgr.14388) 12998 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:50 smithi163 bash[24253]: cluster 2024-08-31T07:11:49.469034+0000 mgr.a (mgr.14388) 12998 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:50 smithi027 bash[22610]: cluster 2024-08-31T07:11:49.469034+0000 mgr.a (mgr.14388) 12998 : cluster [DBG] pgmap v9010: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:11:52.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:52.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:52.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:52 smithi191 bash[24992]: cluster 2024-08-31T07:11:51.469825+0000 mgr.a (mgr.14388) 12999 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:52 smithi163 bash[24253]: cluster 2024-08-31T07:11:51.469825+0000 mgr.a (mgr.14388) 12999 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:52 smithi027 bash[22610]: cluster 2024-08-31T07:11:51.469825+0000 mgr.a (mgr.14388) 12999 : cluster [DBG] pgmap v9011: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:53.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:53.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:53.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:53.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:53.651 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:11:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:54 smithi191 bash[24992]: audit 2024-08-31T07:11:53.222501+0000 mgr.a (mgr.14388) 13000 : audit [DBG] from='client.283887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:54 smithi191 bash[24992]: cluster 2024-08-31T07:11:53.471187+0000 mgr.a (mgr.14388) 13001 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:54 smithi163 bash[24253]: audit 2024-08-31T07:11:53.222501+0000 mgr.a (mgr.14388) 13000 : audit [DBG] from='client.283887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:54 smithi163 bash[24253]: cluster 2024-08-31T07:11:53.471187+0000 mgr.a (mgr.14388) 13001 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:54 smithi027 bash[22610]: audit 2024-08-31T07:11:53.222501+0000 mgr.a (mgr.14388) 13000 : audit [DBG] from='client.283887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:11:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:54 smithi027 bash[22610]: cluster 2024-08-31T07:11:53.471187+0000 mgr.a (mgr.14388) 13001 : cluster [DBG] pgmap v9012: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:11:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:56 smithi191 bash[24992]: cluster 2024-08-31T07:11:55.472209+0000 mgr.a (mgr.14388) 13002 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:11:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:56 smithi163 bash[24253]: cluster 2024-08-31T07:11:55.472209+0000 mgr.a (mgr.14388) 13002 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:11:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:56 smithi027 bash[22610]: cluster 2024-08-31T07:11:55.472209+0000 mgr.a (mgr.14388) 13002 : cluster [DBG] pgmap v9013: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:11:58.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:11:58.653 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:11:58.653 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:11:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:11:58 smithi191 bash[24992]: cluster 2024-08-31T07:11:57.473182+0000 mgr.a (mgr.14388) 13003 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:11:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:11:58 smithi163 bash[24253]: cluster 2024-08-31T07:11:57.473182+0000 mgr.a (mgr.14388) 13003 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:11:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:11:58 smithi027 bash[22610]: cluster 2024-08-31T07:11:57.473182+0000 mgr.a (mgr.14388) 13003 : cluster [DBG] pgmap v9014: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:11:59.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:11:59.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:11:59.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:11:59.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:11:59.397 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:00 smithi191 bash[24992]: audit 2024-08-31T07:11:58.982583+0000 mgr.a (mgr.14388) 13004 : audit [DBG] from='client.283965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:00 smithi191 bash[24992]: cluster 2024-08-31T07:11:59.475342+0000 mgr.a (mgr.14388) 13005 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:00 smithi163 bash[24253]: audit 2024-08-31T07:11:58.982583+0000 mgr.a (mgr.14388) 13004 : audit [DBG] from='client.283965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:00 smithi163 bash[24253]: cluster 2024-08-31T07:11:59.475342+0000 mgr.a (mgr.14388) 13005 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:00 smithi027 bash[22610]: audit 2024-08-31T07:11:58.982583+0000 mgr.a (mgr.14388) 13004 : audit [DBG] from='client.283965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:00 smithi027 bash[22610]: cluster 2024-08-31T07:11:59.475342+0000 mgr.a (mgr.14388) 13005 : cluster [DBG] pgmap v9015: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:02 smithi191 bash[24992]: cluster 2024-08-31T07:12:01.476308+0000 mgr.a (mgr.14388) 13006 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:12:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:02 smithi163 bash[24253]: cluster 2024-08-31T07:12:01.476308+0000 mgr.a (mgr.14388) 13006 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:12:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:02 smithi027 bash[22610]: cluster 2024-08-31T07:12:01.476308+0000 mgr.a (mgr.14388) 13006 : cluster [DBG] pgmap v9016: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:12:04.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:12:04.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:12:04.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:12:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:04 smithi191 bash[24992]: cluster 2024-08-31T07:12:03.478416+0000 mgr.a (mgr.14388) 13007 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:05.142 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:12:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:12:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:12:05.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:12:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:04 smithi163 bash[24253]: cluster 2024-08-31T07:12:03.478416+0000 mgr.a (mgr.14388) 13007 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:04 smithi027 bash[22610]: cluster 2024-08-31T07:12:03.478416+0000 mgr.a (mgr.14388) 13007 : cluster [DBG] pgmap v9017: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:05 smithi191 bash[24992]: audit 2024-08-31T07:12:04.730662+0000 mgr.a (mgr.14388) 13008 : audit [DBG] from='client.284040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:05 smithi163 bash[24253]: audit 2024-08-31T07:12:04.730662+0000 mgr.a (mgr.14388) 13008 : audit [DBG] from='client.284040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:05 smithi027 bash[22610]: audit 2024-08-31T07:12:04.730662+0000 mgr.a (mgr.14388) 13008 : audit [DBG] from='client.284040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:06 smithi191 bash[24992]: cluster 2024-08-31T07:12:05.479386+0000 mgr.a (mgr.14388) 13009 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:06 smithi163 bash[24253]: cluster 2024-08-31T07:12:05.479386+0000 mgr.a (mgr.14388) 13009 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:06 smithi027 bash[22610]: cluster 2024-08-31T07:12:05.479386+0000 mgr.a (mgr.14388) 13009 : cluster [DBG] pgmap v9018: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:08 smithi163 bash[24253]: cluster 2024-08-31T07:12:07.480191+0000 mgr.a (mgr.14388) 13010 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:08 smithi027 bash[22610]: cluster 2024-08-31T07:12:07.480191+0000 mgr.a (mgr.14388) 13010 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:08 smithi191 bash[24992]: cluster 2024-08-31T07:12:07.480191+0000 mgr.a (mgr.14388) 13010 : cluster [DBG] pgmap v9019: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:10.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:12:10.144 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:12:10.144 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:12:10.920 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:10.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:12:10.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:12:10.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:12:10.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:12:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:10 smithi163 bash[24253]: cluster 2024-08-31T07:12:09.482396+0000 mgr.a (mgr.14388) 13011 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:12:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:10 smithi027 bash[22610]: cluster 2024-08-31T07:12:09.482396+0000 mgr.a (mgr.14388) 13011 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:12:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:10 smithi191 bash[24992]: cluster 2024-08-31T07:12:09.482396+0000 mgr.a (mgr.14388) 13011 : cluster [DBG] pgmap v9020: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:12:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:11 smithi163 bash[24253]: audit 2024-08-31T07:12:10.479442+0000 mgr.a (mgr.14388) 13012 : audit [DBG] from='client.284115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:11 smithi027 bash[22610]: audit 2024-08-31T07:12:10.479442+0000 mgr.a (mgr.14388) 13012 : audit [DBG] from='client.284115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:11 smithi191 bash[24992]: audit 2024-08-31T07:12:10.479442+0000 mgr.a (mgr.14388) 13012 : audit [DBG] from='client.284115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:12 smithi163 bash[24253]: cluster 2024-08-31T07:12:11.483604+0000 mgr.a (mgr.14388) 13013 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:12 smithi027 bash[22610]: cluster 2024-08-31T07:12:11.483604+0000 mgr.a (mgr.14388) 13013 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:12 smithi191 bash[24992]: cluster 2024-08-31T07:12:11.483604+0000 mgr.a (mgr.14388) 13013 : cluster [DBG] pgmap v9021: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:14 smithi163 bash[24253]: cluster 2024-08-31T07:12:13.486008+0000 mgr.a (mgr.14388) 13014 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:12:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:14 smithi027 bash[22610]: cluster 2024-08-31T07:12:13.486008+0000 mgr.a (mgr.14388) 13014 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:12:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:14 smithi191 bash[24992]: cluster 2024-08-31T07:12:13.486008+0000 mgr.a (mgr.14388) 13014 : cluster [DBG] pgmap v9022: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:12:15.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:12:15.923 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:12:15.923 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:12:16.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:12:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:12:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:12:16.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:12:16.692 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:16 smithi163 bash[24253]: cluster 2024-08-31T07:12:15.487000+0000 mgr.a (mgr.14388) 13015 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:16 smithi027 bash[22610]: cluster 2024-08-31T07:12:15.487000+0000 mgr.a (mgr.14388) 13015 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:16 smithi191 bash[24992]: cluster 2024-08-31T07:12:15.487000+0000 mgr.a (mgr.14388) 13015 : cluster [DBG] pgmap v9023: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:17 smithi163 bash[24253]: audit 2024-08-31T07:12:16.254914+0000 mgr.a (mgr.14388) 13016 : audit [DBG] from='client.284193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:18.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:17 smithi163 bash[24253]: audit 2024-08-31T07:12:17.456867+0000 mon.a (mon.0) 2520 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:12:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:17 smithi027 bash[22610]: audit 2024-08-31T07:12:16.254914+0000 mgr.a (mgr.14388) 13016 : audit [DBG] from='client.284193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:17 smithi027 bash[22610]: audit 2024-08-31T07:12:17.456867+0000 mon.a (mon.0) 2520 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:12:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:17 smithi191 bash[24992]: audit 2024-08-31T07:12:16.254914+0000 mgr.a (mgr.14388) 13016 : audit [DBG] from='client.284193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:17 smithi191 bash[24992]: audit 2024-08-31T07:12:17.456867+0000 mon.a (mon.0) 2520 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:12:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:18 smithi163 bash[24253]: cluster 2024-08-31T07:12:17.487897+0000 mgr.a (mgr.14388) 13017 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:18 smithi163 bash[24253]: audit 2024-08-31T07:12:18.310505+0000 mon.a (mon.0) 2521 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:12:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:18 smithi163 bash[24253]: audit 2024-08-31T07:12:18.312172+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:12:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:18 smithi163 bash[24253]: audit 2024-08-31T07:12:18.320324+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:12:19.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:18 smithi163 bash[24253]: audit 2024-08-31T07:12:18.324994+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:12:19.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:12:19 smithi027 bash[22863]: debug 2024-08-31T07:12:19.050+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:12:19.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:12:19 smithi027 bash[22863]: debug 2024-08-31T07:12:19.054+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:12:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:18 smithi027 bash[22610]: cluster 2024-08-31T07:12:17.487897+0000 mgr.a (mgr.14388) 13017 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:18 smithi027 bash[22610]: audit 2024-08-31T07:12:18.310505+0000 mon.a (mon.0) 2521 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:12:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:18 smithi027 bash[22610]: audit 2024-08-31T07:12:18.312172+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:12:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:18 smithi027 bash[22610]: audit 2024-08-31T07:12:18.320324+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:12:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:18 smithi027 bash[22610]: audit 2024-08-31T07:12:18.324994+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:12:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:18 smithi191 bash[24992]: cluster 2024-08-31T07:12:17.487897+0000 mgr.a (mgr.14388) 13017 : cluster [DBG] pgmap v9024: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:18 smithi191 bash[24992]: audit 2024-08-31T07:12:18.310505+0000 mon.a (mon.0) 2521 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:12:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:18 smithi191 bash[24992]: audit 2024-08-31T07:12:18.312172+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:12:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:18 smithi191 bash[24992]: audit 2024-08-31T07:12:18.320324+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:12:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:18 smithi191 bash[24992]: audit 2024-08-31T07:12:18.324994+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:12:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:19 smithi163 bash[24253]: audit 2024-08-31T07:12:18.327429+0000 mgr.a (mgr.14388) 13018 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:12:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:19 smithi027 bash[22610]: audit 2024-08-31T07:12:18.327429+0000 mgr.a (mgr.14388) 13018 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:12:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:19 smithi191 bash[24992]: audit 2024-08-31T07:12:18.327429+0000 mgr.a (mgr.14388) 13018 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:12:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:20 smithi163 bash[24253]: audit 2024-08-31T07:12:19.054480+0000 mgr.a (mgr.14388) 13019 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:12:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:20 smithi163 bash[24253]: cephadm 2024-08-31T07:12:19.055703+0000 mgr.a (mgr.14388) 13020 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:12:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:20 smithi163 bash[24253]: cluster 2024-08-31T07:12:19.490742+0000 mgr.a (mgr.14388) 13021 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:12:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:20 smithi027 bash[22610]: audit 2024-08-31T07:12:19.054480+0000 mgr.a (mgr.14388) 13019 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:12:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:20 smithi027 bash[22610]: cephadm 2024-08-31T07:12:19.055703+0000 mgr.a (mgr.14388) 13020 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:12:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:20 smithi027 bash[22610]: cluster 2024-08-31T07:12:19.490742+0000 mgr.a (mgr.14388) 13021 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:12:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:20 smithi191 bash[24992]: audit 2024-08-31T07:12:19.054480+0000 mgr.a (mgr.14388) 13019 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:12:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:20 smithi191 bash[24992]: cephadm 2024-08-31T07:12:19.055703+0000 mgr.a (mgr.14388) 13020 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:12:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:20 smithi191 bash[24992]: cluster 2024-08-31T07:12:19.490742+0000 mgr.a (mgr.14388) 13021 : cluster [DBG] pgmap v9025: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:12:21.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:12:21.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:12:21.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:12:22.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:12:22.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:12:22.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:12:22.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:12:22.488 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:22 smithi163 bash[24253]: cluster 2024-08-31T07:12:21.491541+0000 mgr.a (mgr.14388) 13022 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:22 smithi027 bash[22610]: cluster 2024-08-31T07:12:21.491541+0000 mgr.a (mgr.14388) 13022 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:22 smithi191 bash[24992]: cluster 2024-08-31T07:12:21.491541+0000 mgr.a (mgr.14388) 13022 : cluster [DBG] pgmap v9026: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:23 smithi163 bash[24253]: audit 2024-08-31T07:12:22.034785+0000 mgr.a (mgr.14388) 13023 : audit [DBG] from='client.284376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:23 smithi027 bash[22610]: audit 2024-08-31T07:12:22.034785+0000 mgr.a (mgr.14388) 13023 : audit [DBG] from='client.284376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:23 smithi191 bash[24992]: audit 2024-08-31T07:12:22.034785+0000 mgr.a (mgr.14388) 13023 : audit [DBG] from='client.284376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:24 smithi163 bash[24253]: cluster 2024-08-31T07:12:23.493873+0000 mgr.a (mgr.14388) 13024 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-08-31T07:12:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:24 smithi027 bash[22610]: cluster 2024-08-31T07:12:23.493873+0000 mgr.a (mgr.14388) 13024 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-08-31T07:12:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:24 smithi191 bash[24992]: cluster 2024-08-31T07:12:23.493873+0000 mgr.a (mgr.14388) 13024 : cluster [DBG] pgmap v9027: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 28 KiB/s rd, 426 B/s wr, 41 op/s 2024-08-31T07:12:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:26 smithi163 bash[24253]: cluster 2024-08-31T07:12:25.494830+0000 mgr.a (mgr.14388) 13025 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:26 smithi027 bash[22610]: cluster 2024-08-31T07:12:25.494830+0000 mgr.a (mgr.14388) 13025 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:26 smithi191 bash[24992]: cluster 2024-08-31T07:12:25.494830+0000 mgr.a (mgr.14388) 13025 : cluster [DBG] pgmap v9028: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:27.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:12:27.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:12:27.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:12:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:12:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:12:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:12:28.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:12:28.246 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:28 smithi163 bash[24253]: cluster 2024-08-31T07:12:27.495411+0000 mgr.a (mgr.14388) 13026 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:28 smithi163 bash[24253]: audit 2024-08-31T07:12:27.830298+0000 mgr.a (mgr.14388) 13027 : audit [DBG] from='client.284451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:28 smithi027 bash[22610]: cluster 2024-08-31T07:12:27.495411+0000 mgr.a (mgr.14388) 13026 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:28 smithi027 bash[22610]: audit 2024-08-31T07:12:27.830298+0000 mgr.a (mgr.14388) 13027 : audit [DBG] from='client.284451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:28 smithi191 bash[24992]: cluster 2024-08-31T07:12:27.495411+0000 mgr.a (mgr.14388) 13026 : cluster [DBG] pgmap v9029: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:28 smithi191 bash[24992]: audit 2024-08-31T07:12:27.830298+0000 mgr.a (mgr.14388) 13027 : audit [DBG] from='client.284451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:30 smithi163 bash[24253]: cluster 2024-08-31T07:12:29.498265+0000 mgr.a (mgr.14388) 13028 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:30 smithi027 bash[22610]: cluster 2024-08-31T07:12:29.498265+0000 mgr.a (mgr.14388) 13028 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:30 smithi191 bash[24992]: cluster 2024-08-31T07:12:29.498265+0000 mgr.a (mgr.14388) 13028 : cluster [DBG] pgmap v9030: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:32 smithi163 bash[24253]: cluster 2024-08-31T07:12:31.499127+0000 mgr.a (mgr.14388) 13029 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-08-31T07:12:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:32 smithi027 bash[22610]: cluster 2024-08-31T07:12:31.499127+0000 mgr.a (mgr.14388) 13029 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-08-31T07:12:33.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:12:33.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:12:33.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:12:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:32 smithi191 bash[24992]: cluster 2024-08-31T07:12:31.499127+0000 mgr.a (mgr.14388) 13029 : cluster [DBG] pgmap v9031: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 26 KiB/s rd, 426 B/s wr, 39 op/s 2024-08-31T07:12:34.036 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:34.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:12:34.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:12:34.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:12:34.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:12:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:34 smithi163 bash[24253]: cluster 2024-08-31T07:12:33.501182+0000 mgr.a (mgr.14388) 13030 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:34 smithi163 bash[24253]: audit 2024-08-31T07:12:33.591509+0000 mgr.a (mgr.14388) 13031 : audit [DBG] from='client.284529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:34 smithi027 bash[22610]: cluster 2024-08-31T07:12:33.501182+0000 mgr.a (mgr.14388) 13030 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:34 smithi027 bash[22610]: audit 2024-08-31T07:12:33.591509+0000 mgr.a (mgr.14388) 13031 : audit [DBG] from='client.284529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:34 smithi191 bash[24992]: cluster 2024-08-31T07:12:33.501182+0000 mgr.a (mgr.14388) 13030 : cluster [DBG] pgmap v9032: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 27 KiB/s rd, 426 B/s wr, 40 op/s 2024-08-31T07:12:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:34 smithi191 bash[24992]: audit 2024-08-31T07:12:33.591509+0000 mgr.a (mgr.14388) 13031 : audit [DBG] from='client.284529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:36 smithi163 bash[24253]: cluster 2024-08-31T07:12:35.502111+0000 mgr.a (mgr.14388) 13032 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:12:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:36 smithi027 bash[22610]: cluster 2024-08-31T07:12:35.502111+0000 mgr.a (mgr.14388) 13032 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:12:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:36 smithi191 bash[24992]: cluster 2024-08-31T07:12:35.502111+0000 mgr.a (mgr.14388) 13032 : cluster [DBG] pgmap v9033: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:12:39.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:12:39.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:12:39.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:12:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:38 smithi163 bash[24253]: cluster 2024-08-31T07:12:37.502967+0000 mgr.a (mgr.14388) 13033 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:12:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:38 smithi027 bash[22610]: cluster 2024-08-31T07:12:37.502967+0000 mgr.a (mgr.14388) 13033 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:12:39.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:38 smithi191 bash[24992]: cluster 2024-08-31T07:12:37.502967+0000 mgr.a (mgr.14388) 13033 : cluster [DBG] pgmap v9034: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:12:39.830 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:39.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:12:39.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:12:39.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:12:39.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:12:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:40 smithi163 bash[24253]: audit 2024-08-31T07:12:39.376389+0000 mgr.a (mgr.14388) 13034 : audit [DBG] from='client.284607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:40 smithi163 bash[24253]: cluster 2024-08-31T07:12:39.504257+0000 mgr.a (mgr.14388) 13035 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:40 smithi027 bash[22610]: audit 2024-08-31T07:12:39.376389+0000 mgr.a (mgr.14388) 13034 : audit [DBG] from='client.284607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:40 smithi027 bash[22610]: cluster 2024-08-31T07:12:39.504257+0000 mgr.a (mgr.14388) 13035 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:40 smithi191 bash[24992]: audit 2024-08-31T07:12:39.376389+0000 mgr.a (mgr.14388) 13034 : audit [DBG] from='client.284607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:40 smithi191 bash[24992]: cluster 2024-08-31T07:12:39.504257+0000 mgr.a (mgr.14388) 13035 : cluster [DBG] pgmap v9035: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:42 smithi163 bash[24253]: cluster 2024-08-31T07:12:41.505128+0000 mgr.a (mgr.14388) 13036 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:42 smithi027 bash[22610]: cluster 2024-08-31T07:12:41.505128+0000 mgr.a (mgr.14388) 13036 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:42 smithi191 bash[24992]: cluster 2024-08-31T07:12:41.505128+0000 mgr.a (mgr.14388) 13036 : cluster [DBG] pgmap v9036: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:44.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:12:44.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:12:44.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:12:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:44 smithi163 bash[24253]: cluster 2024-08-31T07:12:43.507358+0000 mgr.a (mgr.14388) 13037 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:12:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:44 smithi027 bash[22610]: cluster 2024-08-31T07:12:43.507358+0000 mgr.a (mgr.14388) 13037 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:12:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:44 smithi191 bash[24992]: cluster 2024-08-31T07:12:43.507358+0000 mgr.a (mgr.14388) 13037 : cluster [DBG] pgmap v9037: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:12:45.576 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:45.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:12:45.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:12:45.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:12:45.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:12:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:46 smithi163 bash[24253]: audit 2024-08-31T07:12:45.164342+0000 mgr.a (mgr.14388) 13038 : audit [DBG] from='client.284682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:46 smithi163 bash[24253]: cluster 2024-08-31T07:12:45.507881+0000 mgr.a (mgr.14388) 13039 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T07:12:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:46 smithi027 bash[22610]: audit 2024-08-31T07:12:45.164342+0000 mgr.a (mgr.14388) 13038 : audit [DBG] from='client.284682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:46 smithi027 bash[22610]: cluster 2024-08-31T07:12:45.507881+0000 mgr.a (mgr.14388) 13039 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T07:12:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:46 smithi191 bash[24992]: audit 2024-08-31T07:12:45.164342+0000 mgr.a (mgr.14388) 13038 : audit [DBG] from='client.284682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:46 smithi191 bash[24992]: cluster 2024-08-31T07:12:45.507881+0000 mgr.a (mgr.14388) 13039 : cluster [DBG] pgmap v9038: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T07:12:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:47 smithi163 bash[24253]: cluster 2024-08-31T07:12:47.508646+0000 mgr.a (mgr.14388) 13040 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T07:12:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:47 smithi027 bash[22610]: cluster 2024-08-31T07:12:47.508646+0000 mgr.a (mgr.14388) 13040 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T07:12:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:47 smithi191 bash[24992]: cluster 2024-08-31T07:12:47.508646+0000 mgr.a (mgr.14388) 13040 : cluster [DBG] pgmap v9039: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T07:12:50.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:12:50.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:12:50.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:12:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:50 smithi163 bash[24253]: cluster 2024-08-31T07:12:49.510888+0000 mgr.a (mgr.14388) 13041 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:12:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:50 smithi027 bash[22610]: cluster 2024-08-31T07:12:49.510888+0000 mgr.a (mgr.14388) 13041 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:12:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:50 smithi191 bash[24992]: cluster 2024-08-31T07:12:49.510888+0000 mgr.a (mgr.14388) 13041 : cluster [DBG] pgmap v9040: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:12:51.321 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:51.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:12:51.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:12:51.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:12:51.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:12:52.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:52 smithi163 bash[24253]: audit 2024-08-31T07:12:50.902487+0000 mgr.a (mgr.14388) 13042 : audit [DBG] from='client.284757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:52.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:52 smithi163 bash[24253]: cluster 2024-08-31T07:12:51.511830+0000 mgr.a (mgr.14388) 13043 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T07:12:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:52 smithi027 bash[22610]: audit 2024-08-31T07:12:50.902487+0000 mgr.a (mgr.14388) 13042 : audit [DBG] from='client.284757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:52 smithi027 bash[22610]: cluster 2024-08-31T07:12:51.511830+0000 mgr.a (mgr.14388) 13043 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T07:12:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:52 smithi191 bash[24992]: audit 2024-08-31T07:12:50.902487+0000 mgr.a (mgr.14388) 13042 : audit [DBG] from='client.284757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:52 smithi191 bash[24992]: cluster 2024-08-31T07:12:51.511830+0000 mgr.a (mgr.14388) 13043 : cluster [DBG] pgmap v9041: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 35 KiB/s rd, 0 B/s wr, 56 op/s 2024-08-31T07:12:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:54 smithi163 bash[24253]: cluster 2024-08-31T07:12:53.514046+0000 mgr.a (mgr.14388) 13044 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:12:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:54 smithi027 bash[22610]: cluster 2024-08-31T07:12:53.514046+0000 mgr.a (mgr.14388) 13044 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:12:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:54 smithi191 bash[24992]: cluster 2024-08-31T07:12:53.514046+0000 mgr.a (mgr.14388) 13044 : cluster [DBG] pgmap v9042: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 36 KiB/s rd, 0 B/s wr, 57 op/s 2024-08-31T07:12:56.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:12:56.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:12:56.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:12:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:56 smithi163 bash[24253]: cluster 2024-08-31T07:12:55.514842+0000 mgr.a (mgr.14388) 13045 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:56 smithi027 bash[22610]: cluster 2024-08-31T07:12:55.514842+0000 mgr.a (mgr.14388) 13045 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:56 smithi191 bash[24992]: cluster 2024-08-31T07:12:55.514842+0000 mgr.a (mgr.14388) 13045 : cluster [DBG] pgmap v9043: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:57.107 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:12:57.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:12:57.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:12:57.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:12:57.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:12:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:57 smithi163 bash[24253]: audit 2024-08-31T07:12:56.660736+0000 mgr.a (mgr.14388) 13046 : audit [DBG] from='client.284829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:57 smithi027 bash[22610]: audit 2024-08-31T07:12:56.660736+0000 mgr.a (mgr.14388) 13046 : audit [DBG] from='client.284829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:57 smithi191 bash[24992]: audit 2024-08-31T07:12:56.660736+0000 mgr.a (mgr.14388) 13046 : audit [DBG] from='client.284829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:12:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:12:58 smithi163 bash[24253]: cluster 2024-08-31T07:12:57.515721+0000 mgr.a (mgr.14388) 13047 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:12:58 smithi027 bash[22610]: cluster 2024-08-31T07:12:57.515721+0000 mgr.a (mgr.14388) 13047 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:12:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:12:58 smithi191 bash[24992]: cluster 2024-08-31T07:12:57.515721+0000 mgr.a (mgr.14388) 13047 : cluster [DBG] pgmap v9044: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:00 smithi163 bash[24253]: cluster 2024-08-31T07:12:59.518020+0000 mgr.a (mgr.14388) 13048 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:13:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:00 smithi027 bash[22610]: cluster 2024-08-31T07:12:59.518020+0000 mgr.a (mgr.14388) 13048 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:13:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:00 smithi191 bash[24992]: cluster 2024-08-31T07:12:59.518020+0000 mgr.a (mgr.14388) 13048 : cluster [DBG] pgmap v9045: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:13:02.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:02.109 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:02.109 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:13:02.878 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:13:02.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:13:02.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:13:02.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:13:02.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:13:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:02 smithi163 bash[24253]: cluster 2024-08-31T07:13:01.518811+0000 mgr.a (mgr.14388) 13049 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:02 smithi027 bash[22610]: cluster 2024-08-31T07:13:01.518811+0000 mgr.a (mgr.14388) 13049 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:02 smithi191 bash[24992]: cluster 2024-08-31T07:13:01.518811+0000 mgr.a (mgr.14388) 13049 : cluster [DBG] pgmap v9046: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:03 smithi163 bash[24253]: audit 2024-08-31T07:13:02.443884+0000 mgr.a (mgr.14388) 13050 : audit [DBG] from='client.284907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:03 smithi027 bash[22610]: audit 2024-08-31T07:13:02.443884+0000 mgr.a (mgr.14388) 13050 : audit [DBG] from='client.284907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:03 smithi191 bash[24992]: audit 2024-08-31T07:13:02.443884+0000 mgr.a (mgr.14388) 13050 : audit [DBG] from='client.284907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:04 smithi163 bash[24253]: cluster 2024-08-31T07:13:03.521145+0000 mgr.a (mgr.14388) 13051 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:13:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:04 smithi027 bash[22610]: cluster 2024-08-31T07:13:03.521145+0000 mgr.a (mgr.14388) 13051 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:13:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:04 smithi191 bash[24992]: cluster 2024-08-31T07:13:03.521145+0000 mgr.a (mgr.14388) 13051 : cluster [DBG] pgmap v9047: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:13:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:06 smithi163 bash[24253]: cluster 2024-08-31T07:13:05.521904+0000 mgr.a (mgr.14388) 13052 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:13:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:06 smithi027 bash[22610]: cluster 2024-08-31T07:13:05.521904+0000 mgr.a (mgr.14388) 13052 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:13:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:06 smithi191 bash[24992]: cluster 2024-08-31T07:13:05.521904+0000 mgr.a (mgr.14388) 13052 : cluster [DBG] pgmap v9048: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:13:07.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:07.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:07.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:13:08.660 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:13:08.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:13:08.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:13:08.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:13:08.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:13:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:08 smithi163 bash[24253]: cluster 2024-08-31T07:13:07.522656+0000 mgr.a (mgr.14388) 13053 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:13:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:08 smithi027 bash[22610]: cluster 2024-08-31T07:13:07.522656+0000 mgr.a (mgr.14388) 13053 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:13:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:08 smithi191 bash[24992]: cluster 2024-08-31T07:13:07.522656+0000 mgr.a (mgr.14388) 13053 : cluster [DBG] pgmap v9049: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:13:09.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:09 smithi163 bash[24253]: audit 2024-08-31T07:13:08.213444+0000 mgr.a (mgr.14388) 13054 : audit [DBG] from='client.284985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:09 smithi027 bash[22610]: audit 2024-08-31T07:13:08.213444+0000 mgr.a (mgr.14388) 13054 : audit [DBG] from='client.284985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:09 smithi191 bash[24992]: audit 2024-08-31T07:13:08.213444+0000 mgr.a (mgr.14388) 13054 : audit [DBG] from='client.284985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:10 smithi163 bash[24253]: cluster 2024-08-31T07:13:09.525444+0000 mgr.a (mgr.14388) 13055 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:10 smithi027 bash[22610]: cluster 2024-08-31T07:13:09.525444+0000 mgr.a (mgr.14388) 13055 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:10 smithi191 bash[24992]: cluster 2024-08-31T07:13:09.525444+0000 mgr.a (mgr.14388) 13055 : cluster [DBG] pgmap v9050: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:12 smithi163 bash[24253]: cluster 2024-08-31T07:13:11.526206+0000 mgr.a (mgr.14388) 13056 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:13:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:12 smithi027 bash[22610]: cluster 2024-08-31T07:13:11.526206+0000 mgr.a (mgr.14388) 13056 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:13:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:12 smithi191 bash[24992]: cluster 2024-08-31T07:13:11.526206+0000 mgr.a (mgr.14388) 13056 : cluster [DBG] pgmap v9051: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:13:13.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:13.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:13.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:13:14.426 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:13:14.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:13:14.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:13:14.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:13:14.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:13:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:14 smithi163 bash[24253]: cluster 2024-08-31T07:13:13.528188+0000 mgr.a (mgr.14388) 13057 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:14 smithi027 bash[22610]: cluster 2024-08-31T07:13:13.528188+0000 mgr.a (mgr.14388) 13057 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:14 smithi191 bash[24992]: cluster 2024-08-31T07:13:13.528188+0000 mgr.a (mgr.14388) 13057 : cluster [DBG] pgmap v9052: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:15 smithi163 bash[24253]: audit 2024-08-31T07:13:13.993043+0000 mgr.a (mgr.14388) 13058 : audit [DBG] from='client.285063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:15 smithi027 bash[22610]: audit 2024-08-31T07:13:13.993043+0000 mgr.a (mgr.14388) 13058 : audit [DBG] from='client.285063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:15 smithi191 bash[24992]: audit 2024-08-31T07:13:13.993043+0000 mgr.a (mgr.14388) 13058 : audit [DBG] from='client.285063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:16 smithi163 bash[24253]: cluster 2024-08-31T07:13:15.529082+0000 mgr.a (mgr.14388) 13059 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:13:16.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:16 smithi027 bash[22610]: cluster 2024-08-31T07:13:15.529082+0000 mgr.a (mgr.14388) 13059 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:13:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:16 smithi191 bash[24992]: cluster 2024-08-31T07:13:15.529082+0000 mgr.a (mgr.14388) 13059 : cluster [DBG] pgmap v9053: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:13:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:18 smithi163 bash[24253]: cluster 2024-08-31T07:13:17.529878+0000 mgr.a (mgr.14388) 13060 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:13:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:18 smithi027 bash[22610]: cluster 2024-08-31T07:13:17.529878+0000 mgr.a (mgr.14388) 13060 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:13:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:18 smithi191 bash[24992]: cluster 2024-08-31T07:13:17.529878+0000 mgr.a (mgr.14388) 13060 : cluster [DBG] pgmap v9054: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:13:19.427 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:19.428 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:19.428 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:13:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:19 smithi163 bash[24253]: audit 2024-08-31T07:13:19.108966+0000 mon.a (mon.0) 2525 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:13:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:19 smithi027 bash[22610]: audit 2024-08-31T07:13:19.108966+0000 mon.a (mon.0) 2525 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:13:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:19 smithi191 bash[24992]: audit 2024-08-31T07:13:19.108966+0000 mon.a (mon.0) 2525 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:13:20.208 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:13:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:13:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:13:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:13:20.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:13:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:20 smithi163 bash[24253]: cluster 2024-08-31T07:13:19.530946+0000 mgr.a (mgr.14388) 13061 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:13:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:20 smithi163 bash[24253]: audit 2024-08-31T07:13:19.759269+0000 mgr.a (mgr.14388) 13062 : audit [DBG] from='client.285141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:20 smithi027 bash[22610]: cluster 2024-08-31T07:13:19.530946+0000 mgr.a (mgr.14388) 13061 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:13:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:20 smithi027 bash[22610]: audit 2024-08-31T07:13:19.759269+0000 mgr.a (mgr.14388) 13062 : audit [DBG] from='client.285141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:20 smithi191 bash[24992]: cluster 2024-08-31T07:13:19.530946+0000 mgr.a (mgr.14388) 13061 : cluster [DBG] pgmap v9055: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:13:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:20 smithi191 bash[24992]: audit 2024-08-31T07:13:19.759269+0000 mgr.a (mgr.14388) 13062 : audit [DBG] from='client.285141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:22 smithi163 bash[24253]: cluster 2024-08-31T07:13:21.531816+0000 mgr.a (mgr.14388) 13063 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:22 smithi027 bash[22610]: cluster 2024-08-31T07:13:21.531816+0000 mgr.a (mgr.14388) 13063 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:22 smithi191 bash[24992]: cluster 2024-08-31T07:13:21.531816+0000 mgr.a (mgr.14388) 13063 : cluster [DBG] pgmap v9056: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:24 smithi163 bash[24253]: cluster 2024-08-31T07:13:23.534069+0000 mgr.a (mgr.14388) 13064 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:13:24.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:24 smithi027 bash[22610]: cluster 2024-08-31T07:13:23.534069+0000 mgr.a (mgr.14388) 13064 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:13:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:24 smithi191 bash[24992]: cluster 2024-08-31T07:13:23.534069+0000 mgr.a (mgr.14388) 13064 : cluster [DBG] pgmap v9057: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:13:25.209 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:25.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:25.210 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:13:25.950 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:13:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:13:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:13:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:13:25.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:13:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:26 smithi163 bash[24253]: cluster 2024-08-31T07:13:25.534793+0000 mgr.a (mgr.14388) 13065 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:26 smithi163 bash[24253]: audit 2024-08-31T07:13:25.539745+0000 mgr.a (mgr.14388) 13066 : audit [DBG] from='client.285219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:26 smithi027 bash[22610]: cluster 2024-08-31T07:13:25.534793+0000 mgr.a (mgr.14388) 13065 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:26 smithi027 bash[22610]: audit 2024-08-31T07:13:25.539745+0000 mgr.a (mgr.14388) 13066 : audit [DBG] from='client.285219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:26 smithi191 bash[24992]: cluster 2024-08-31T07:13:25.534793+0000 mgr.a (mgr.14388) 13065 : cluster [DBG] pgmap v9058: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:26 smithi191 bash[24992]: audit 2024-08-31T07:13:25.539745+0000 mgr.a (mgr.14388) 13066 : audit [DBG] from='client.285219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:28 smithi163 bash[24253]: cluster 2024-08-31T07:13:27.535792+0000 mgr.a (mgr.14388) 13067 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:28 smithi027 bash[22610]: cluster 2024-08-31T07:13:27.535792+0000 mgr.a (mgr.14388) 13067 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:28 smithi191 bash[24992]: cluster 2024-08-31T07:13:27.535792+0000 mgr.a (mgr.14388) 13067 : cluster [DBG] pgmap v9059: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:30.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:30.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:30.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:13:30.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:13:30 smithi027 bash[22863]: debug 2024-08-31T07:13:30.620+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:13:30.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:13:30 smithi027 bash[22863]: debug 2024-08-31T07:13:30.620+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:13:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:30 smithi027 bash[22610]: cluster 2024-08-31T07:13:29.538081+0000 mgr.a (mgr.14388) 13068 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:13:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:30 smithi027 bash[22610]: audit 2024-08-31T07:13:29.807808+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:13:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:30 smithi027 bash[22610]: audit 2024-08-31T07:13:29.815413+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:13:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:30 smithi027 bash[22610]: audit 2024-08-31T07:13:29.817545+0000 mon.a (mon.0) 2528 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:13:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:30 smithi027 bash[22610]: audit 2024-08-31T07:13:29.819253+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:13:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:30 smithi027 bash[22610]: audit 2024-08-31T07:13:29.829123+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:13:30.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:30 smithi027 bash[22610]: audit 2024-08-31T07:13:29.834251+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:13:30.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:30 smithi027 bash[22610]: audit 2024-08-31T07:13:29.836665+0000 mgr.a (mgr.14388) 13069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:13:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:30 smithi163 bash[24253]: cluster 2024-08-31T07:13:29.538081+0000 mgr.a (mgr.14388) 13068 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:13:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:30 smithi163 bash[24253]: audit 2024-08-31T07:13:29.807808+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:13:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:30 smithi163 bash[24253]: audit 2024-08-31T07:13:29.815413+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:13:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:30 smithi163 bash[24253]: audit 2024-08-31T07:13:29.817545+0000 mon.a (mon.0) 2528 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:13:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:30 smithi163 bash[24253]: audit 2024-08-31T07:13:29.819253+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:13:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:30 smithi163 bash[24253]: audit 2024-08-31T07:13:29.829123+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:13:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:30 smithi163 bash[24253]: audit 2024-08-31T07:13:29.834251+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:13:31.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:30 smithi163 bash[24253]: audit 2024-08-31T07:13:29.836665+0000 mgr.a (mgr.14388) 13069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:13:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:30 smithi191 bash[24992]: cluster 2024-08-31T07:13:29.538081+0000 mgr.a (mgr.14388) 13068 : cluster [DBG] pgmap v9060: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:13:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:30 smithi191 bash[24992]: audit 2024-08-31T07:13:29.807808+0000 mon.a (mon.0) 2526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:13:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:30 smithi191 bash[24992]: audit 2024-08-31T07:13:29.815413+0000 mon.a (mon.0) 2527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:13:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:30 smithi191 bash[24992]: audit 2024-08-31T07:13:29.817545+0000 mon.a (mon.0) 2528 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:13:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:30 smithi191 bash[24992]: audit 2024-08-31T07:13:29.819253+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:13:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:30 smithi191 bash[24992]: audit 2024-08-31T07:13:29.829123+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:13:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:30 smithi191 bash[24992]: audit 2024-08-31T07:13:29.834251+0000 mon.a (mon.0) 2531 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:13:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:30 smithi191 bash[24992]: audit 2024-08-31T07:13:29.836665+0000 mgr.a (mgr.14388) 13069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:13:31.751 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:13:31.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:13:31.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:13:31.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:13:31.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:13:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:31 smithi163 bash[24253]: audit 2024-08-31T07:13:30.623279+0000 mgr.a (mgr.14388) 13070 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:13:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:31 smithi163 bash[24253]: cephadm 2024-08-31T07:13:30.625137+0000 mgr.a (mgr.14388) 13071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:13:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:31 smithi027 bash[22610]: audit 2024-08-31T07:13:30.623279+0000 mgr.a (mgr.14388) 13070 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:13:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:31 smithi027 bash[22610]: cephadm 2024-08-31T07:13:30.625137+0000 mgr.a (mgr.14388) 13071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:13:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:31 smithi191 bash[24992]: audit 2024-08-31T07:13:30.623279+0000 mgr.a (mgr.14388) 13070 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:13:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:31 smithi191 bash[24992]: cephadm 2024-08-31T07:13:30.625137+0000 mgr.a (mgr.14388) 13071 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:13:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:32 smithi163 bash[24253]: audit 2024-08-31T07:13:31.295844+0000 mgr.a (mgr.14388) 13072 : audit [DBG] from='client.285399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:32 smithi163 bash[24253]: cluster 2024-08-31T07:13:31.542879+0000 mgr.a (mgr.14388) 13073 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:32 smithi027 bash[22610]: audit 2024-08-31T07:13:31.295844+0000 mgr.a (mgr.14388) 13072 : audit [DBG] from='client.285399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:32 smithi027 bash[22610]: cluster 2024-08-31T07:13:31.542879+0000 mgr.a (mgr.14388) 13073 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:32 smithi191 bash[24992]: audit 2024-08-31T07:13:31.295844+0000 mgr.a (mgr.14388) 13072 : audit [DBG] from='client.285399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:32 smithi191 bash[24992]: cluster 2024-08-31T07:13:31.542879+0000 mgr.a (mgr.14388) 13073 : cluster [DBG] pgmap v9061: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:34 smithi163 bash[24253]: cluster 2024-08-31T07:13:33.545294+0000 mgr.a (mgr.14388) 13074 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:34 smithi027 bash[22610]: cluster 2024-08-31T07:13:33.545294+0000 mgr.a (mgr.14388) 13074 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:34 smithi191 bash[24992]: cluster 2024-08-31T07:13:33.545294+0000 mgr.a (mgr.14388) 13074 : cluster [DBG] pgmap v9062: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:36.752 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:36.753 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:36.753 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:13:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:36 smithi163 bash[24253]: cluster 2024-08-31T07:13:35.546235+0000 mgr.a (mgr.14388) 13075 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:36 smithi027 bash[22610]: cluster 2024-08-31T07:13:35.546235+0000 mgr.a (mgr.14388) 13075 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:36 smithi191 bash[24992]: cluster 2024-08-31T07:13:35.546235+0000 mgr.a (mgr.14388) 13075 : cluster [DBG] pgmap v9063: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:37.528 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:13:37.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:13:37.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:13:37.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:13:37.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:13:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:38 smithi163 bash[24253]: audit 2024-08-31T07:13:37.087002+0000 mgr.a (mgr.14388) 13076 : audit [DBG] from='client.285471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:38 smithi163 bash[24253]: cluster 2024-08-31T07:13:37.546939+0000 mgr.a (mgr.14388) 13077 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:38 smithi027 bash[22610]: audit 2024-08-31T07:13:37.087002+0000 mgr.a (mgr.14388) 13076 : audit [DBG] from='client.285471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:38 smithi027 bash[22610]: cluster 2024-08-31T07:13:37.546939+0000 mgr.a (mgr.14388) 13077 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:39.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:38 smithi191 bash[24992]: audit 2024-08-31T07:13:37.087002+0000 mgr.a (mgr.14388) 13076 : audit [DBG] from='client.285471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:38 smithi191 bash[24992]: cluster 2024-08-31T07:13:37.546939+0000 mgr.a (mgr.14388) 13077 : cluster [DBG] pgmap v9064: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:40 smithi163 bash[24253]: cluster 2024-08-31T07:13:39.549123+0000 mgr.a (mgr.14388) 13078 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:40 smithi027 bash[22610]: cluster 2024-08-31T07:13:39.549123+0000 mgr.a (mgr.14388) 13078 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:40 smithi191 bash[24992]: cluster 2024-08-31T07:13:39.549123+0000 mgr.a (mgr.14388) 13078 : cluster [DBG] pgmap v9065: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:42.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:42.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:42.531 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:13:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:42 smithi163 bash[24253]: cluster 2024-08-31T07:13:41.549877+0000 mgr.a (mgr.14388) 13079 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:42 smithi027 bash[22610]: cluster 2024-08-31T07:13:41.549877+0000 mgr.a (mgr.14388) 13079 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:42 smithi191 bash[24992]: cluster 2024-08-31T07:13:41.549877+0000 mgr.a (mgr.14388) 13079 : cluster [DBG] pgmap v9066: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:43.309 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:13:43.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:13:43.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:13:43.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:13:43.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:13:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:43 smithi163 bash[24253]: audit 2024-08-31T07:13:42.869795+0000 mgr.a (mgr.14388) 13080 : audit [DBG] from='client.285549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:43 smithi027 bash[22610]: audit 2024-08-31T07:13:42.869795+0000 mgr.a (mgr.14388) 13080 : audit [DBG] from='client.285549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:43 smithi191 bash[24992]: audit 2024-08-31T07:13:42.869795+0000 mgr.a (mgr.14388) 13080 : audit [DBG] from='client.285549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:44 smithi163 bash[24253]: cluster 2024-08-31T07:13:43.552741+0000 mgr.a (mgr.14388) 13081 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:44 smithi027 bash[22610]: cluster 2024-08-31T07:13:43.552741+0000 mgr.a (mgr.14388) 13081 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:44 smithi191 bash[24992]: cluster 2024-08-31T07:13:43.552741+0000 mgr.a (mgr.14388) 13081 : cluster [DBG] pgmap v9067: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:13:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:46 smithi163 bash[24253]: cluster 2024-08-31T07:13:45.553557+0000 mgr.a (mgr.14388) 13082 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:13:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:46 smithi027 bash[22610]: cluster 2024-08-31T07:13:45.553557+0000 mgr.a (mgr.14388) 13082 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:13:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:46 smithi191 bash[24992]: cluster 2024-08-31T07:13:45.553557+0000 mgr.a (mgr.14388) 13082 : cluster [DBG] pgmap v9068: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:13:48.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:48.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:48.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:13:49.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:13:49.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:13:49.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:13:49.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:13:49.062 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:13:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:48 smithi163 bash[24253]: cluster 2024-08-31T07:13:47.554341+0000 mgr.a (mgr.14388) 13083 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:13:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:48 smithi027 bash[22610]: cluster 2024-08-31T07:13:47.554341+0000 mgr.a (mgr.14388) 13083 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:13:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:48 smithi191 bash[24992]: cluster 2024-08-31T07:13:47.554341+0000 mgr.a (mgr.14388) 13083 : cluster [DBG] pgmap v9069: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:13:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:49 smithi163 bash[24253]: audit 2024-08-31T07:13:48.641313+0000 mgr.a (mgr.14388) 13084 : audit [DBG] from='client.285627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:49 smithi027 bash[22610]: audit 2024-08-31T07:13:48.641313+0000 mgr.a (mgr.14388) 13084 : audit [DBG] from='client.285627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:49 smithi191 bash[24992]: audit 2024-08-31T07:13:48.641313+0000 mgr.a (mgr.14388) 13084 : audit [DBG] from='client.285627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:50 smithi163 bash[24253]: cluster 2024-08-31T07:13:49.557224+0000 mgr.a (mgr.14388) 13085 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:50 smithi027 bash[22610]: cluster 2024-08-31T07:13:49.557224+0000 mgr.a (mgr.14388) 13085 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:51.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:50 smithi191 bash[24992]: cluster 2024-08-31T07:13:49.557224+0000 mgr.a (mgr.14388) 13085 : cluster [DBG] pgmap v9070: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:52 smithi163 bash[24253]: cluster 2024-08-31T07:13:51.558021+0000 mgr.a (mgr.14388) 13086 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:13:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:52 smithi027 bash[22610]: cluster 2024-08-31T07:13:51.558021+0000 mgr.a (mgr.14388) 13086 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:13:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:52 smithi191 bash[24992]: cluster 2024-08-31T07:13:51.558021+0000 mgr.a (mgr.14388) 13086 : cluster [DBG] pgmap v9071: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:13:54.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:54.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:54.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:13:54.848 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:13:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:13:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:13:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:13:54.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:13:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:54 smithi163 bash[24253]: cluster 2024-08-31T07:13:53.560062+0000 mgr.a (mgr.14388) 13087 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:54 smithi027 bash[22610]: cluster 2024-08-31T07:13:53.560062+0000 mgr.a (mgr.14388) 13087 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:54 smithi191 bash[24992]: cluster 2024-08-31T07:13:53.560062+0000 mgr.a (mgr.14388) 13087 : cluster [DBG] pgmap v9072: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:55 smithi163 bash[24253]: audit 2024-08-31T07:13:54.398042+0000 mgr.a (mgr.14388) 13088 : audit [DBG] from='client.285699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:55 smithi027 bash[22610]: audit 2024-08-31T07:13:54.398042+0000 mgr.a (mgr.14388) 13088 : audit [DBG] from='client.285699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:55 smithi191 bash[24992]: audit 2024-08-31T07:13:54.398042+0000 mgr.a (mgr.14388) 13088 : audit [DBG] from='client.285699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:13:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:56 smithi163 bash[24253]: cluster 2024-08-31T07:13:55.561031+0000 mgr.a (mgr.14388) 13089 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:56 smithi027 bash[22610]: cluster 2024-08-31T07:13:55.561031+0000 mgr.a (mgr.14388) 13089 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:56 smithi191 bash[24992]: cluster 2024-08-31T07:13:55.561031+0000 mgr.a (mgr.14388) 13089 : cluster [DBG] pgmap v9073: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:13:58 smithi163 bash[24253]: cluster 2024-08-31T07:13:57.561826+0000 mgr.a (mgr.14388) 13090 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:13:58 smithi027 bash[22610]: cluster 2024-08-31T07:13:57.561826+0000 mgr.a (mgr.14388) 13090 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:13:58 smithi191 bash[24992]: cluster 2024-08-31T07:13:57.561826+0000 mgr.a (mgr.14388) 13090 : cluster [DBG] pgmap v9074: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:13:59.850 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:13:59.851 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:13:59.851 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:00.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:00.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:00.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:00.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:00.637 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:00 smithi163 bash[24253]: cluster 2024-08-31T07:13:59.564094+0000 mgr.a (mgr.14388) 13091 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:00 smithi027 bash[22610]: cluster 2024-08-31T07:13:59.564094+0000 mgr.a (mgr.14388) 13091 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:00 smithi191 bash[24992]: cluster 2024-08-31T07:13:59.564094+0000 mgr.a (mgr.14388) 13091 : cluster [DBG] pgmap v9075: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:01 smithi163 bash[24253]: audit 2024-08-31T07:14:00.216973+0000 mgr.a (mgr.14388) 13092 : audit [DBG] from='client.285777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:01 smithi027 bash[22610]: audit 2024-08-31T07:14:00.216973+0000 mgr.a (mgr.14388) 13092 : audit [DBG] from='client.285777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:01 smithi191 bash[24992]: audit 2024-08-31T07:14:00.216973+0000 mgr.a (mgr.14388) 13092 : audit [DBG] from='client.285777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:02 smithi163 bash[24253]: cluster 2024-08-31T07:14:01.565046+0000 mgr.a (mgr.14388) 13093 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:03.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:02 smithi027 bash[22610]: cluster 2024-08-31T07:14:01.565046+0000 mgr.a (mgr.14388) 13093 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:02 smithi191 bash[24992]: cluster 2024-08-31T07:14:01.565046+0000 mgr.a (mgr.14388) 13093 : cluster [DBG] pgmap v9076: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:04 smithi163 bash[24253]: cluster 2024-08-31T07:14:03.567936+0000 mgr.a (mgr.14388) 13094 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:04 smithi027 bash[22610]: cluster 2024-08-31T07:14:03.567936+0000 mgr.a (mgr.14388) 13094 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:04 smithi191 bash[24992]: cluster 2024-08-31T07:14:03.567936+0000 mgr.a (mgr.14388) 13094 : cluster [DBG] pgmap v9077: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:05.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:14:05.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:14:05.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:06.424 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:06.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:06.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:06.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:06.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:06 smithi163 bash[24253]: cluster 2024-08-31T07:14:05.568736+0000 mgr.a (mgr.14388) 13095 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:06 smithi027 bash[22610]: cluster 2024-08-31T07:14:05.568736+0000 mgr.a (mgr.14388) 13095 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:06 smithi191 bash[24992]: cluster 2024-08-31T07:14:05.568736+0000 mgr.a (mgr.14388) 13095 : cluster [DBG] pgmap v9078: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:07 smithi163 bash[24253]: audit 2024-08-31T07:14:05.978448+0000 mgr.a (mgr.14388) 13096 : audit [DBG] from='client.285852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:07 smithi027 bash[22610]: audit 2024-08-31T07:14:05.978448+0000 mgr.a (mgr.14388) 13096 : audit [DBG] from='client.285852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:07 smithi191 bash[24992]: audit 2024-08-31T07:14:05.978448+0000 mgr.a (mgr.14388) 13096 : audit [DBG] from='client.285852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:08 smithi163 bash[24253]: cluster 2024-08-31T07:14:07.569680+0000 mgr.a (mgr.14388) 13097 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:08 smithi027 bash[22610]: cluster 2024-08-31T07:14:07.569680+0000 mgr.a (mgr.14388) 13097 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:08 smithi191 bash[24992]: cluster 2024-08-31T07:14:07.569680+0000 mgr.a (mgr.14388) 13097 : cluster [DBG] pgmap v9079: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:09 smithi163 bash[24253]: cluster 2024-08-31T07:14:09.571959+0000 mgr.a (mgr.14388) 13098 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:09 smithi027 bash[22610]: cluster 2024-08-31T07:14:09.571959+0000 mgr.a (mgr.14388) 13098 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:09 smithi191 bash[24992]: cluster 2024-08-31T07:14:09.571959+0000 mgr.a (mgr.14388) 13098 : cluster [DBG] pgmap v9080: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:14:11.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:14:11.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:12.178 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:12.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:12.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:12.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:12.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:12 smithi163 bash[24253]: cluster 2024-08-31T07:14:11.572675+0000 mgr.a (mgr.14388) 13099 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:12 smithi163 bash[24253]: audit 2024-08-31T07:14:11.759284+0000 mgr.a (mgr.14388) 13100 : audit [DBG] from='client.285927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:12 smithi027 bash[22610]: cluster 2024-08-31T07:14:11.572675+0000 mgr.a (mgr.14388) 13099 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:12 smithi027 bash[22610]: audit 2024-08-31T07:14:11.759284+0000 mgr.a (mgr.14388) 13100 : audit [DBG] from='client.285927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:12 smithi191 bash[24992]: cluster 2024-08-31T07:14:11.572675+0000 mgr.a (mgr.14388) 13099 : cluster [DBG] pgmap v9081: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:12 smithi191 bash[24992]: audit 2024-08-31T07:14:11.759284+0000 mgr.a (mgr.14388) 13100 : audit [DBG] from='client.285927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:14 smithi163 bash[24253]: cluster 2024-08-31T07:14:13.575031+0000 mgr.a (mgr.14388) 13101 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:14 smithi027 bash[22610]: cluster 2024-08-31T07:14:13.575031+0000 mgr.a (mgr.14388) 13101 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:14 smithi191 bash[24992]: cluster 2024-08-31T07:14:13.575031+0000 mgr.a (mgr.14388) 13101 : cluster [DBG] pgmap v9082: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:16 smithi163 bash[24253]: cluster 2024-08-31T07:14:15.575809+0000 mgr.a (mgr.14388) 13102 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:16.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:16 smithi027 bash[22610]: cluster 2024-08-31T07:14:15.575809+0000 mgr.a (mgr.14388) 13102 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:16 smithi191 bash[24992]: cluster 2024-08-31T07:14:15.575809+0000 mgr.a (mgr.14388) 13102 : cluster [DBG] pgmap v9083: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:17.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:14:17.180 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:14:17.180 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:17.933 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:17.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:18 smithi163 bash[24253]: audit 2024-08-31T07:14:17.512518+0000 mgr.a (mgr.14388) 13103 : audit [DBG] from='client.286002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:18 smithi163 bash[24253]: cluster 2024-08-31T07:14:17.576332+0000 mgr.a (mgr.14388) 13104 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:18 smithi027 bash[22610]: audit 2024-08-31T07:14:17.512518+0000 mgr.a (mgr.14388) 13103 : audit [DBG] from='client.286002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:18 smithi027 bash[22610]: cluster 2024-08-31T07:14:17.576332+0000 mgr.a (mgr.14388) 13104 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:18 smithi191 bash[24992]: audit 2024-08-31T07:14:17.512518+0000 mgr.a (mgr.14388) 13103 : audit [DBG] from='client.286002 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:18 smithi191 bash[24992]: cluster 2024-08-31T07:14:17.576332+0000 mgr.a (mgr.14388) 13104 : cluster [DBG] pgmap v9084: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:20 smithi163 bash[24253]: cluster 2024-08-31T07:14:19.578662+0000 mgr.a (mgr.14388) 13105 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:14:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:20 smithi027 bash[22610]: cluster 2024-08-31T07:14:19.578662+0000 mgr.a (mgr.14388) 13105 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:14:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:20 smithi191 bash[24992]: cluster 2024-08-31T07:14:19.578662+0000 mgr.a (mgr.14388) 13105 : cluster [DBG] pgmap v9085: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:14:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:14:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:14:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:22 smithi163 bash[24253]: cluster 2024-08-31T07:14:21.579442+0000 mgr.a (mgr.14388) 13106 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:14:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:22 smithi027 bash[22610]: cluster 2024-08-31T07:14:21.579442+0000 mgr.a (mgr.14388) 13106 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:14:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:22 smithi191 bash[24992]: cluster 2024-08-31T07:14:21.579442+0000 mgr.a (mgr.14388) 13106 : cluster [DBG] pgmap v9086: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:14:23.707 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:23.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:23.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:23.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:23.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:24 smithi163 bash[24253]: audit 2024-08-31T07:14:23.268069+0000 mgr.a (mgr.14388) 13107 : audit [DBG] from='client.286077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:24 smithi163 bash[24253]: cluster 2024-08-31T07:14:23.580655+0000 mgr.a (mgr.14388) 13108 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:24.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:24 smithi027 bash[22610]: audit 2024-08-31T07:14:23.268069+0000 mgr.a (mgr.14388) 13107 : audit [DBG] from='client.286077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:24.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:24 smithi027 bash[22610]: cluster 2024-08-31T07:14:23.580655+0000 mgr.a (mgr.14388) 13108 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:24 smithi191 bash[24992]: audit 2024-08-31T07:14:23.268069+0000 mgr.a (mgr.14388) 13107 : audit [DBG] from='client.286077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:24 smithi191 bash[24992]: cluster 2024-08-31T07:14:23.580655+0000 mgr.a (mgr.14388) 13108 : cluster [DBG] pgmap v9087: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:26 smithi163 bash[24253]: cluster 2024-08-31T07:14:25.581525+0000 mgr.a (mgr.14388) 13109 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:14:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:26 smithi027 bash[22610]: cluster 2024-08-31T07:14:25.581525+0000 mgr.a (mgr.14388) 13109 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:14:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:26 smithi191 bash[24992]: cluster 2024-08-31T07:14:25.581525+0000 mgr.a (mgr.14388) 13109 : cluster [DBG] pgmap v9088: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:14:28.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:14:28.709 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:14:28.710 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:28 smithi163 bash[24253]: cluster 2024-08-31T07:14:27.582291+0000 mgr.a (mgr.14388) 13110 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:14:28.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:28 smithi027 bash[22610]: cluster 2024-08-31T07:14:27.582291+0000 mgr.a (mgr.14388) 13110 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:14:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:28 smithi191 bash[24992]: cluster 2024-08-31T07:14:27.582291+0000 mgr.a (mgr.14388) 13110 : cluster [DBG] pgmap v9089: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:14:29.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:29.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:30 smithi191 bash[24992]: audit 2024-08-31T07:14:29.042036+0000 mgr.a (mgr.14388) 13111 : audit [DBG] from='client.286152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:30 smithi191 bash[24992]: cluster 2024-08-31T07:14:29.585116+0000 mgr.a (mgr.14388) 13112 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:30 smithi163 bash[24253]: audit 2024-08-31T07:14:29.042036+0000 mgr.a (mgr.14388) 13111 : audit [DBG] from='client.286152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:30 smithi163 bash[24253]: cluster 2024-08-31T07:14:29.585116+0000 mgr.a (mgr.14388) 13112 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:30 smithi027 bash[22610]: audit 2024-08-31T07:14:29.042036+0000 mgr.a (mgr.14388) 13111 : audit [DBG] from='client.286152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:30 smithi027 bash[22610]: cluster 2024-08-31T07:14:29.585116+0000 mgr.a (mgr.14388) 13112 : cluster [DBG] pgmap v9090: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:31 smithi191 bash[24992]: audit 2024-08-31T07:14:30.695759+0000 mon.a (mon.0) 2532 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:14:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:31 smithi163 bash[24253]: audit 2024-08-31T07:14:30.695759+0000 mon.a (mon.0) 2532 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:14:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:31 smithi027 bash[22610]: audit 2024-08-31T07:14:30.695759+0000 mon.a (mon.0) 2532 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:14:32.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:32 smithi191 bash[24992]: cluster 2024-08-31T07:14:31.585902+0000 mgr.a (mgr.14388) 13113 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:14:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:32 smithi163 bash[24253]: cluster 2024-08-31T07:14:31.585902+0000 mgr.a (mgr.14388) 13113 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:14:32.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:32 smithi027 bash[22610]: cluster 2024-08-31T07:14:31.585902+0000 mgr.a (mgr.14388) 13113 : cluster [DBG] pgmap v9091: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:14:34.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:14:34.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:14:34.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:34 smithi163 bash[24253]: cluster 2024-08-31T07:14:33.587820+0000 mgr.a (mgr.14388) 13114 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:14:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:34 smithi027 bash[22610]: cluster 2024-08-31T07:14:33.587820+0000 mgr.a (mgr.14388) 13114 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:14:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:34 smithi191 bash[24992]: cluster 2024-08-31T07:14:33.587820+0000 mgr.a (mgr.14388) 13114 : cluster [DBG] pgmap v9092: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:14:35.259 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:35.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:35.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:35.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:35.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:35 smithi163 bash[24253]: audit 2024-08-31T07:14:34.818470+0000 mgr.a (mgr.14388) 13115 : audit [DBG] from='client.286230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:35.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:35 smithi027 bash[22610]: audit 2024-08-31T07:14:34.818470+0000 mgr.a (mgr.14388) 13115 : audit [DBG] from='client.286230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:35 smithi191 bash[24992]: audit 2024-08-31T07:14:34.818470+0000 mgr.a (mgr.14388) 13115 : audit [DBG] from='client.286230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:36 smithi163 bash[24253]: cluster 2024-08-31T07:14:35.588687+0000 mgr.a (mgr.14388) 13116 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:36.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:36 smithi027 bash[22610]: cluster 2024-08-31T07:14:35.588687+0000 mgr.a (mgr.14388) 13116 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:36 smithi191 bash[24992]: cluster 2024-08-31T07:14:35.588687+0000 mgr.a (mgr.14388) 13116 : cluster [DBG] pgmap v9093: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:38 smithi191 bash[24992]: cluster 2024-08-31T07:14:37.589491+0000 mgr.a (mgr.14388) 13117 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:38 smithi163 bash[24253]: cluster 2024-08-31T07:14:37.589491+0000 mgr.a (mgr.14388) 13117 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:38 smithi027 bash[22610]: cluster 2024-08-31T07:14:37.589491+0000 mgr.a (mgr.14388) 13117 : cluster [DBG] pgmap v9094: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:40.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:14:40.262 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:14:40.262 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:40.937 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:40 smithi163 bash[24253]: cluster 2024-08-31T07:14:39.591737+0000 mgr.a (mgr.14388) 13118 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:40 smithi027 bash[22610]: cluster 2024-08-31T07:14:39.591737+0000 mgr.a (mgr.14388) 13118 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:41.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:41.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:41.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:41.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:41.007 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:40 smithi191 bash[24992]: cluster 2024-08-31T07:14:39.591737+0000 mgr.a (mgr.14388) 13118 : cluster [DBG] pgmap v9095: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:14:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:41 smithi163 bash[24253]: audit 2024-08-31T07:14:40.595833+0000 mgr.a (mgr.14388) 13119 : audit [DBG] from='client.286308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:41 smithi163 bash[24253]: audit 2024-08-31T07:14:41.060199+0000 mon.a (mon.0) 2533 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:41 smithi163 bash[24253]: audit 2024-08-31T07:14:41.068244+0000 mon.a (mon.0) 2534 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:41 smithi027 bash[22610]: audit 2024-08-31T07:14:40.595833+0000 mgr.a (mgr.14388) 13119 : audit [DBG] from='client.286308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:41.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:41 smithi027 bash[22610]: audit 2024-08-31T07:14:41.060199+0000 mon.a (mon.0) 2533 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:41.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:41 smithi027 bash[22610]: audit 2024-08-31T07:14:41.068244+0000 mon.a (mon.0) 2534 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:41 smithi191 bash[24992]: audit 2024-08-31T07:14:40.595833+0000 mgr.a (mgr.14388) 13119 : audit [DBG] from='client.286308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:41 smithi191 bash[24992]: audit 2024-08-31T07:14:41.060199+0000 mon.a (mon.0) 2533 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:41 smithi191 bash[24992]: audit 2024-08-31T07:14:41.068244+0000 mon.a (mon.0) 2534 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:42.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:14:42 smithi027 bash[22863]: debug 2024-08-31T07:14:42.470+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:14:42.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:14:42 smithi027 bash[22863]: debug 2024-08-31T07:14:42.474+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:14:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:42 smithi027 bash[22610]: cluster 2024-08-31T07:14:41.592669+0000 mgr.a (mgr.14388) 13120 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:42 smithi027 bash[22610]: audit 2024-08-31T07:14:41.700741+0000 mon.a (mon.0) 2535 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:42 smithi027 bash[22610]: audit 2024-08-31T07:14:41.710520+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:42 smithi027 bash[22610]: audit 2024-08-31T07:14:41.712877+0000 mon.a (mon.0) 2537 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:14:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:42 smithi027 bash[22610]: audit 2024-08-31T07:14:41.714893+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:14:42.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:42 smithi027 bash[22610]: audit 2024-08-31T07:14:41.726745+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:42.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:42 smithi027 bash[22610]: audit 2024-08-31T07:14:41.731895+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:14:42.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:42 smithi027 bash[22610]: audit 2024-08-31T07:14:41.734579+0000 mgr.a (mgr.14388) 13121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:14:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:42 smithi191 bash[24992]: cluster 2024-08-31T07:14:41.592669+0000 mgr.a (mgr.14388) 13120 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:42 smithi191 bash[24992]: audit 2024-08-31T07:14:41.700741+0000 mon.a (mon.0) 2535 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:42 smithi191 bash[24992]: audit 2024-08-31T07:14:41.710520+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:42 smithi191 bash[24992]: audit 2024-08-31T07:14:41.712877+0000 mon.a (mon.0) 2537 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:14:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:42 smithi191 bash[24992]: audit 2024-08-31T07:14:41.714893+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:14:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:42 smithi191 bash[24992]: audit 2024-08-31T07:14:41.726745+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:42 smithi191 bash[24992]: audit 2024-08-31T07:14:41.731895+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:14:43.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:42 smithi191 bash[24992]: audit 2024-08-31T07:14:41.734579+0000 mgr.a (mgr.14388) 13121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:14:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:42 smithi163 bash[24253]: cluster 2024-08-31T07:14:41.592669+0000 mgr.a (mgr.14388) 13120 : cluster [DBG] pgmap v9096: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:42 smithi163 bash[24253]: audit 2024-08-31T07:14:41.700741+0000 mon.a (mon.0) 2535 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:42 smithi163 bash[24253]: audit 2024-08-31T07:14:41.710520+0000 mon.a (mon.0) 2536 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:42 smithi163 bash[24253]: audit 2024-08-31T07:14:41.712877+0000 mon.a (mon.0) 2537 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:14:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:42 smithi163 bash[24253]: audit 2024-08-31T07:14:41.714893+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:14:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:42 smithi163 bash[24253]: audit 2024-08-31T07:14:41.726745+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:14:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:42 smithi163 bash[24253]: audit 2024-08-31T07:14:41.731895+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:14:43.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:42 smithi163 bash[24253]: audit 2024-08-31T07:14:41.734579+0000 mgr.a (mgr.14388) 13121 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:14:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:43 smithi027 bash[22610]: audit 2024-08-31T07:14:42.474064+0000 mgr.a (mgr.14388) 13122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:14:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:43 smithi027 bash[22610]: cephadm 2024-08-31T07:14:42.475948+0000 mgr.a (mgr.14388) 13123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:14:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:43 smithi191 bash[24992]: audit 2024-08-31T07:14:42.474064+0000 mgr.a (mgr.14388) 13122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:14:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:43 smithi191 bash[24992]: cephadm 2024-08-31T07:14:42.475948+0000 mgr.a (mgr.14388) 13123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:14:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:43 smithi163 bash[24253]: audit 2024-08-31T07:14:42.474064+0000 mgr.a (mgr.14388) 13122 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:14:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:43 smithi163 bash[24253]: cephadm 2024-08-31T07:14:42.475948+0000 mgr.a (mgr.14388) 13123 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:14:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:44 smithi027 bash[22610]: cluster 2024-08-31T07:14:43.594988+0000 mgr.a (mgr.14388) 13124 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:44 smithi191 bash[24992]: cluster 2024-08-31T07:14:43.594988+0000 mgr.a (mgr.14388) 13124 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:44 smithi163 bash[24253]: cluster 2024-08-31T07:14:43.594988+0000 mgr.a (mgr.14388) 13124 : cluster [DBG] pgmap v9097: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:46.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:14:46.009 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:14:46.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:46.793 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:46.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:46.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:46.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:46 smithi027 bash[22610]: cluster 2024-08-31T07:14:45.595784+0000 mgr.a (mgr.14388) 13125 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:46 smithi191 bash[24992]: cluster 2024-08-31T07:14:45.595784+0000 mgr.a (mgr.14388) 13125 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:46 smithi163 bash[24253]: cluster 2024-08-31T07:14:45.595784+0000 mgr.a (mgr.14388) 13125 : cluster [DBG] pgmap v9098: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:47.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:47 smithi027 bash[22610]: audit 2024-08-31T07:14:46.345654+0000 mgr.a (mgr.14388) 13126 : audit [DBG] from='client.286491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:47 smithi191 bash[24992]: audit 2024-08-31T07:14:46.345654+0000 mgr.a (mgr.14388) 13126 : audit [DBG] from='client.286491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:47 smithi163 bash[24253]: audit 2024-08-31T07:14:46.345654+0000 mgr.a (mgr.14388) 13126 : audit [DBG] from='client.286491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:48 smithi027 bash[22610]: cluster 2024-08-31T07:14:47.596762+0000 mgr.a (mgr.14388) 13127 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:48 smithi191 bash[24992]: cluster 2024-08-31T07:14:47.596762+0000 mgr.a (mgr.14388) 13127 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:48 smithi163 bash[24253]: cluster 2024-08-31T07:14:47.596762+0000 mgr.a (mgr.14388) 13127 : cluster [DBG] pgmap v9099: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:50 smithi027 bash[22610]: cluster 2024-08-31T07:14:49.599025+0000 mgr.a (mgr.14388) 13128 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:50 smithi191 bash[24992]: cluster 2024-08-31T07:14:49.599025+0000 mgr.a (mgr.14388) 13128 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:50 smithi163 bash[24253]: cluster 2024-08-31T07:14:49.599025+0000 mgr.a (mgr.14388) 13128 : cluster [DBG] pgmap v9100: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:51.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:14:51.795 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:14:51.795 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:52.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:52.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:52.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:52.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:52.558 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:52 smithi027 bash[22610]: cluster 2024-08-31T07:14:51.599814+0000 mgr.a (mgr.14388) 13129 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:52 smithi191 bash[24992]: cluster 2024-08-31T07:14:51.599814+0000 mgr.a (mgr.14388) 13129 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:52 smithi163 bash[24253]: cluster 2024-08-31T07:14:51.599814+0000 mgr.a (mgr.14388) 13129 : cluster [DBG] pgmap v9101: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:53 smithi191 bash[24992]: audit 2024-08-31T07:14:52.129292+0000 mgr.a (mgr.14388) 13130 : audit [DBG] from='client.286569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:53 smithi163 bash[24253]: audit 2024-08-31T07:14:52.129292+0000 mgr.a (mgr.14388) 13130 : audit [DBG] from='client.286569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:53 smithi027 bash[22610]: audit 2024-08-31T07:14:52.129292+0000 mgr.a (mgr.14388) 13130 : audit [DBG] from='client.286569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:54 smithi191 bash[24992]: cluster 2024-08-31T07:14:53.602141+0000 mgr.a (mgr.14388) 13131 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:54 smithi163 bash[24253]: cluster 2024-08-31T07:14:53.602141+0000 mgr.a (mgr.14388) 13131 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:54 smithi027 bash[22610]: cluster 2024-08-31T07:14:53.602141+0000 mgr.a (mgr.14388) 13131 : cluster [DBG] pgmap v9102: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:14:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:56 smithi191 bash[24992]: cluster 2024-08-31T07:14:55.602938+0000 mgr.a (mgr.14388) 13132 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:56 smithi163 bash[24253]: cluster 2024-08-31T07:14:55.602938+0000 mgr.a (mgr.14388) 13132 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:56 smithi027 bash[22610]: cluster 2024-08-31T07:14:55.602938+0000 mgr.a (mgr.14388) 13132 : cluster [DBG] pgmap v9103: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:57.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:14:57.560 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:14:57.560 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:14:58.322 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:14:58.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:14:58.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:14:58.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:14:58.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:14:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:58 smithi191 bash[24992]: cluster 2024-08-31T07:14:57.603683+0000 mgr.a (mgr.14388) 13133 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:14:58 smithi191 bash[24992]: audit 2024-08-31T07:14:57.892637+0000 mgr.a (mgr.14388) 13134 : audit [DBG] from='client.286647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:58 smithi163 bash[24253]: cluster 2024-08-31T07:14:57.603683+0000 mgr.a (mgr.14388) 13133 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:14:58 smithi163 bash[24253]: audit 2024-08-31T07:14:57.892637+0000 mgr.a (mgr.14388) 13134 : audit [DBG] from='client.286647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:14:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:58 smithi027 bash[22610]: cluster 2024-08-31T07:14:57.603683+0000 mgr.a (mgr.14388) 13133 : cluster [DBG] pgmap v9104: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:14:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:14:58 smithi027 bash[22610]: audit 2024-08-31T07:14:57.892637+0000 mgr.a (mgr.14388) 13134 : audit [DBG] from='client.286647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:00 smithi191 bash[24992]: cluster 2024-08-31T07:14:59.606379+0000 mgr.a (mgr.14388) 13135 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:00 smithi163 bash[24253]: cluster 2024-08-31T07:14:59.606379+0000 mgr.a (mgr.14388) 13135 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:01.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:00 smithi027 bash[22610]: cluster 2024-08-31T07:14:59.606379+0000 mgr.a (mgr.14388) 13135 : cluster [DBG] pgmap v9105: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:02 smithi191 bash[24992]: cluster 2024-08-31T07:15:01.607189+0000 mgr.a (mgr.14388) 13136 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:15:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:02 smithi163 bash[24253]: cluster 2024-08-31T07:15:01.607189+0000 mgr.a (mgr.14388) 13136 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:15:03.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:02 smithi027 bash[22610]: cluster 2024-08-31T07:15:01.607189+0000 mgr.a (mgr.14388) 13136 : cluster [DBG] pgmap v9106: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:15:03.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:15:03.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:15:03.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:15:04.108 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:15:04.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:15:04.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:15:04.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:15:04.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:15:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:04 smithi191 bash[24992]: cluster 2024-08-31T07:15:03.609134+0000 mgr.a (mgr.14388) 13137 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:04 smithi191 bash[24992]: audit 2024-08-31T07:15:03.665831+0000 mgr.a (mgr.14388) 13138 : audit [DBG] from='client.286722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:04 smithi163 bash[24253]: cluster 2024-08-31T07:15:03.609134+0000 mgr.a (mgr.14388) 13137 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:04 smithi163 bash[24253]: audit 2024-08-31T07:15:03.665831+0000 mgr.a (mgr.14388) 13138 : audit [DBG] from='client.286722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:04 smithi027 bash[22610]: cluster 2024-08-31T07:15:03.609134+0000 mgr.a (mgr.14388) 13137 : cluster [DBG] pgmap v9107: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:04 smithi027 bash[22610]: audit 2024-08-31T07:15:03.665831+0000 mgr.a (mgr.14388) 13138 : audit [DBG] from='client.286722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:06 smithi191 bash[24992]: cluster 2024-08-31T07:15:05.610037+0000 mgr.a (mgr.14388) 13139 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:15:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:06 smithi163 bash[24253]: cluster 2024-08-31T07:15:05.610037+0000 mgr.a (mgr.14388) 13139 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:15:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:06 smithi027 bash[22610]: cluster 2024-08-31T07:15:05.610037+0000 mgr.a (mgr.14388) 13139 : cluster [DBG] pgmap v9108: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:15:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:08 smithi191 bash[24992]: cluster 2024-08-31T07:15:07.610818+0000 mgr.a (mgr.14388) 13140 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:15:09.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:15:09.111 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:15:09.111 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:15:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:08 smithi163 bash[24253]: cluster 2024-08-31T07:15:07.610818+0000 mgr.a (mgr.14388) 13140 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:15:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:08 smithi027 bash[22610]: cluster 2024-08-31T07:15:07.610818+0000 mgr.a (mgr.14388) 13140 : cluster [DBG] pgmap v9109: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:15:09.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:15:09.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:15:09.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:15:09.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:15:09.888 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:15:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:10 smithi191 bash[24992]: audit 2024-08-31T07:15:09.448543+0000 mgr.a (mgr.14388) 13141 : audit [DBG] from='client.286800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:10 smithi191 bash[24992]: cluster 2024-08-31T07:15:09.612621+0000 mgr.a (mgr.14388) 13142 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:10 smithi163 bash[24253]: audit 2024-08-31T07:15:09.448543+0000 mgr.a (mgr.14388) 13141 : audit [DBG] from='client.286800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:10 smithi163 bash[24253]: cluster 2024-08-31T07:15:09.612621+0000 mgr.a (mgr.14388) 13142 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:10 smithi027 bash[22610]: audit 2024-08-31T07:15:09.448543+0000 mgr.a (mgr.14388) 13141 : audit [DBG] from='client.286800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:10 smithi027 bash[22610]: cluster 2024-08-31T07:15:09.612621+0000 mgr.a (mgr.14388) 13142 : cluster [DBG] pgmap v9110: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:12 smithi163 bash[24253]: cluster 2024-08-31T07:15:11.613660+0000 mgr.a (mgr.14388) 13143 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:12 smithi027 bash[22610]: cluster 2024-08-31T07:15:11.613660+0000 mgr.a (mgr.14388) 13143 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:12 smithi191 bash[24992]: cluster 2024-08-31T07:15:11.613660+0000 mgr.a (mgr.14388) 13143 : cluster [DBG] pgmap v9111: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:14.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:15:14.890 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:15:14.890 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:15:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:14 smithi163 bash[24253]: cluster 2024-08-31T07:15:13.615876+0000 mgr.a (mgr.14388) 13144 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:14 smithi027 bash[22610]: cluster 2024-08-31T07:15:13.615876+0000 mgr.a (mgr.14388) 13144 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:14 smithi191 bash[24992]: cluster 2024-08-31T07:15:13.615876+0000 mgr.a (mgr.14388) 13144 : cluster [DBG] pgmap v9112: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:15.653 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:15:15.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:15:15.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:15:15.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:15:15.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:15:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:16 smithi163 bash[24253]: audit 2024-08-31T07:15:15.223861+0000 mgr.a (mgr.14388) 13145 : audit [DBG] from='client.286878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:16 smithi163 bash[24253]: cluster 2024-08-31T07:15:15.616385+0000 mgr.a (mgr.14388) 13146 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:16 smithi027 bash[22610]: audit 2024-08-31T07:15:15.223861+0000 mgr.a (mgr.14388) 13145 : audit [DBG] from='client.286878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:16 smithi027 bash[22610]: cluster 2024-08-31T07:15:15.616385+0000 mgr.a (mgr.14388) 13146 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:16 smithi191 bash[24992]: audit 2024-08-31T07:15:15.223861+0000 mgr.a (mgr.14388) 13145 : audit [DBG] from='client.286878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:16 smithi191 bash[24992]: cluster 2024-08-31T07:15:15.616385+0000 mgr.a (mgr.14388) 13146 : cluster [DBG] pgmap v9113: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:18 smithi163 bash[24253]: cluster 2024-08-31T07:15:17.617156+0000 mgr.a (mgr.14388) 13147 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:18 smithi027 bash[22610]: cluster 2024-08-31T07:15:17.617156+0000 mgr.a (mgr.14388) 13147 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:19.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:18 smithi191 bash[24992]: cluster 2024-08-31T07:15:17.617156+0000 mgr.a (mgr.14388) 13147 : cluster [DBG] pgmap v9114: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:20.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:15:20.655 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:15:20.655 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:15:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:20 smithi163 bash[24253]: cluster 2024-08-31T07:15:19.619420+0000 mgr.a (mgr.14388) 13148 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:20 smithi027 bash[22610]: cluster 2024-08-31T07:15:19.619420+0000 mgr.a (mgr.14388) 13148 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:20 smithi191 bash[24992]: cluster 2024-08-31T07:15:19.619420+0000 mgr.a (mgr.14388) 13148 : cluster [DBG] pgmap v9115: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:21.439 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:15:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:15:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:15:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:15:21.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:15:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:22 smithi163 bash[24253]: audit 2024-08-31T07:15:20.992749+0000 mgr.a (mgr.14388) 13149 : audit [DBG] from='client.286956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:22 smithi163 bash[24253]: cluster 2024-08-31T07:15:21.620438+0000 mgr.a (mgr.14388) 13150 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:22 smithi027 bash[22610]: audit 2024-08-31T07:15:20.992749+0000 mgr.a (mgr.14388) 13149 : audit [DBG] from='client.286956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:22 smithi027 bash[22610]: cluster 2024-08-31T07:15:21.620438+0000 mgr.a (mgr.14388) 13150 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:22 smithi191 bash[24992]: audit 2024-08-31T07:15:20.992749+0000 mgr.a (mgr.14388) 13149 : audit [DBG] from='client.286956 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:22 smithi191 bash[24992]: cluster 2024-08-31T07:15:21.620438+0000 mgr.a (mgr.14388) 13150 : cluster [DBG] pgmap v9116: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:24 smithi163 bash[24253]: cluster 2024-08-31T07:15:23.622632+0000 mgr.a (mgr.14388) 13151 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:24 smithi027 bash[22610]: cluster 2024-08-31T07:15:23.622632+0000 mgr.a (mgr.14388) 13151 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:24 smithi191 bash[24992]: cluster 2024-08-31T07:15:23.622632+0000 mgr.a (mgr.14388) 13151 : cluster [DBG] pgmap v9117: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:26.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:15:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:15:26.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:15:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:26 smithi163 bash[24253]: cluster 2024-08-31T07:15:25.623420+0000 mgr.a (mgr.14388) 13152 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:27.222 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:15:27.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:15:27.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:15:27.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:15:27.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:15:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:26 smithi027 bash[22610]: cluster 2024-08-31T07:15:25.623420+0000 mgr.a (mgr.14388) 13152 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:26 smithi191 bash[24992]: cluster 2024-08-31T07:15:25.623420+0000 mgr.a (mgr.14388) 13152 : cluster [DBG] pgmap v9118: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:27 smithi163 bash[24253]: audit 2024-08-31T07:15:26.775671+0000 mgr.a (mgr.14388) 13153 : audit [DBG] from='client.287034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:27 smithi027 bash[22610]: audit 2024-08-31T07:15:26.775671+0000 mgr.a (mgr.14388) 13153 : audit [DBG] from='client.287034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:27 smithi191 bash[24992]: audit 2024-08-31T07:15:26.775671+0000 mgr.a (mgr.14388) 13153 : audit [DBG] from='client.287034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:28 smithi163 bash[24253]: cluster 2024-08-31T07:15:27.624354+0000 mgr.a (mgr.14388) 13154 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:28 smithi027 bash[22610]: cluster 2024-08-31T07:15:27.624354+0000 mgr.a (mgr.14388) 13154 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:28 smithi191 bash[24992]: cluster 2024-08-31T07:15:27.624354+0000 mgr.a (mgr.14388) 13154 : cluster [DBG] pgmap v9119: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:30 smithi163 bash[24253]: cluster 2024-08-31T07:15:29.626593+0000 mgr.a (mgr.14388) 13155 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:30 smithi027 bash[22610]: cluster 2024-08-31T07:15:29.626593+0000 mgr.a (mgr.14388) 13155 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:30 smithi191 bash[24992]: cluster 2024-08-31T07:15:29.626593+0000 mgr.a (mgr.14388) 13155 : cluster [DBG] pgmap v9120: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:15:32.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:15:32.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:15:32.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:15:32.979 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:15:32.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:15:32.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:15:32.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:15:32.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:15:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:32 smithi163 bash[24253]: cluster 2024-08-31T07:15:31.627377+0000 mgr.a (mgr.14388) 13156 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:32 smithi027 bash[22610]: cluster 2024-08-31T07:15:31.627377+0000 mgr.a (mgr.14388) 13156 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:32 smithi191 bash[24992]: cluster 2024-08-31T07:15:31.627377+0000 mgr.a (mgr.14388) 13156 : cluster [DBG] pgmap v9121: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:33 smithi163 bash[24253]: audit 2024-08-31T07:15:32.556203+0000 mgr.a (mgr.14388) 13157 : audit [DBG] from='client.287112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:34.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:33 smithi027 bash[22610]: audit 2024-08-31T07:15:32.556203+0000 mgr.a (mgr.14388) 13157 : audit [DBG] from='client.287112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:33 smithi191 bash[24992]: audit 2024-08-31T07:15:32.556203+0000 mgr.a (mgr.14388) 13157 : audit [DBG] from='client.287112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:35.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:34 smithi163 bash[24253]: cluster 2024-08-31T07:15:33.630283+0000 mgr.a (mgr.14388) 13158 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:15:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:34 smithi027 bash[22610]: cluster 2024-08-31T07:15:33.630283+0000 mgr.a (mgr.14388) 13158 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:15:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:34 smithi191 bash[24992]: cluster 2024-08-31T07:15:33.630283+0000 mgr.a (mgr.14388) 13158 : cluster [DBG] pgmap v9122: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:15:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:36 smithi163 bash[24253]: cluster 2024-08-31T07:15:35.631136+0000 mgr.a (mgr.14388) 13159 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:15:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:36 smithi027 bash[22610]: cluster 2024-08-31T07:15:35.631136+0000 mgr.a (mgr.14388) 13159 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:15:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:36 smithi191 bash[24992]: cluster 2024-08-31T07:15:35.631136+0000 mgr.a (mgr.14388) 13159 : cluster [DBG] pgmap v9123: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:15:37.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:15:37.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:15:37.982 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:15:38.745 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:15:38.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:15:38.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:15:38.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:15:38.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:15:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:38 smithi163 bash[24253]: cluster 2024-08-31T07:15:37.631944+0000 mgr.a (mgr.14388) 13160 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:15:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:38 smithi027 bash[22610]: cluster 2024-08-31T07:15:37.631944+0000 mgr.a (mgr.14388) 13160 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:15:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:38 smithi191 bash[24992]: cluster 2024-08-31T07:15:37.631944+0000 mgr.a (mgr.14388) 13160 : cluster [DBG] pgmap v9124: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:15:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:39 smithi163 bash[24253]: audit 2024-08-31T07:15:38.313882+0000 mgr.a (mgr.14388) 13161 : audit [DBG] from='client.287190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:39 smithi027 bash[22610]: audit 2024-08-31T07:15:38.313882+0000 mgr.a (mgr.14388) 13161 : audit [DBG] from='client.287190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:39 smithi191 bash[24992]: audit 2024-08-31T07:15:38.313882+0000 mgr.a (mgr.14388) 13161 : audit [DBG] from='client.287190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:40 smithi163 bash[24253]: cluster 2024-08-31T07:15:39.634707+0000 mgr.a (mgr.14388) 13162 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:40 smithi027 bash[22610]: cluster 2024-08-31T07:15:39.634707+0000 mgr.a (mgr.14388) 13162 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:40 smithi191 bash[24992]: cluster 2024-08-31T07:15:39.634707+0000 mgr.a (mgr.14388) 13162 : cluster [DBG] pgmap v9125: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:42 smithi163 bash[24253]: cluster 2024-08-31T07:15:41.635523+0000 mgr.a (mgr.14388) 13163 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:15:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:42 smithi163 bash[24253]: audit 2024-08-31T07:15:42.531059+0000 mon.a (mon.0) 2541 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:15:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:42 smithi027 bash[22610]: cluster 2024-08-31T07:15:41.635523+0000 mgr.a (mgr.14388) 13163 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:15:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:42 smithi027 bash[22610]: audit 2024-08-31T07:15:42.531059+0000 mon.a (mon.0) 2541 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:15:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:42 smithi191 bash[24992]: cluster 2024-08-31T07:15:41.635523+0000 mgr.a (mgr.14388) 13163 : cluster [DBG] pgmap v9126: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:15:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:42 smithi191 bash[24992]: audit 2024-08-31T07:15:42.531059+0000 mon.a (mon.0) 2541 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:15:43.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:15:43.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:15:43.747 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:15:44.137 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:15:44 smithi027 bash[22863]: debug 2024-08-31T07:15:44.121+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:15:44.137 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:43 smithi027 bash[22610]: audit 2024-08-31T07:15:43.363354+0000 mon.a (mon.0) 2542 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:15:44.137 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:43 smithi027 bash[22610]: audit 2024-08-31T07:15:43.365072+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:15:44.138 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:43 smithi027 bash[22610]: audit 2024-08-31T07:15:43.375744+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:15:44.138 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:43 smithi027 bash[22610]: audit 2024-08-31T07:15:43.380578+0000 mon.a (mon.0) 2545 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:15:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:43 smithi163 bash[24253]: audit 2024-08-31T07:15:43.363354+0000 mon.a (mon.0) 2542 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:15:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:43 smithi163 bash[24253]: audit 2024-08-31T07:15:43.365072+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:15:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:43 smithi163 bash[24253]: audit 2024-08-31T07:15:43.375744+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:15:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:43 smithi163 bash[24253]: audit 2024-08-31T07:15:43.380578+0000 mon.a (mon.0) 2545 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:15:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:43 smithi191 bash[24992]: audit 2024-08-31T07:15:43.363354+0000 mon.a (mon.0) 2542 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:15:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:43 smithi191 bash[24992]: audit 2024-08-31T07:15:43.365072+0000 mon.a (mon.0) 2543 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:15:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:43 smithi191 bash[24992]: audit 2024-08-31T07:15:43.375744+0000 mon.a (mon.0) 2544 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:15:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:43 smithi191 bash[24992]: audit 2024-08-31T07:15:43.380578+0000 mon.a (mon.0) 2545 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:15:44.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:15:44 smithi027 bash[22863]: debug 2024-08-31T07:15:44.133+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:15:44.524 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:15:44.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:15:44.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:15:44.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:15:44.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:15:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:44 smithi163 bash[24253]: audit 2024-08-31T07:15:43.382012+0000 mgr.a (mgr.14388) 13164 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:15:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:44 smithi163 bash[24253]: cluster 2024-08-31T07:15:43.636848+0000 mgr.a (mgr.14388) 13165 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:44 smithi027 bash[22610]: audit 2024-08-31T07:15:43.382012+0000 mgr.a (mgr.14388) 13164 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:15:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:44 smithi027 bash[22610]: cluster 2024-08-31T07:15:43.636848+0000 mgr.a (mgr.14388) 13165 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:44 smithi191 bash[24992]: audit 2024-08-31T07:15:43.382012+0000 mgr.a (mgr.14388) 13164 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:15:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:44 smithi191 bash[24992]: cluster 2024-08-31T07:15:43.636848+0000 mgr.a (mgr.14388) 13165 : cluster [DBG] pgmap v9127: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:15:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:45 smithi163 bash[24253]: audit 2024-08-31T07:15:44.073700+0000 mgr.a (mgr.14388) 13166 : audit [DBG] from='client.287337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:45 smithi163 bash[24253]: audit 2024-08-31T07:15:44.126302+0000 mgr.a (mgr.14388) 13167 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:15:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:45 smithi163 bash[24253]: cephadm 2024-08-31T07:15:44.136511+0000 mgr.a (mgr.14388) 13168 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:15:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:45 smithi027 bash[22610]: audit 2024-08-31T07:15:44.073700+0000 mgr.a (mgr.14388) 13166 : audit [DBG] from='client.287337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:45 smithi027 bash[22610]: audit 2024-08-31T07:15:44.126302+0000 mgr.a (mgr.14388) 13167 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:15:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:45 smithi027 bash[22610]: cephadm 2024-08-31T07:15:44.136511+0000 mgr.a (mgr.14388) 13168 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:15:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:45 smithi191 bash[24992]: audit 2024-08-31T07:15:44.073700+0000 mgr.a (mgr.14388) 13166 : audit [DBG] from='client.287337 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:45 smithi191 bash[24992]: audit 2024-08-31T07:15:44.126302+0000 mgr.a (mgr.14388) 13167 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:15:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:45 smithi191 bash[24992]: cephadm 2024-08-31T07:15:44.136511+0000 mgr.a (mgr.14388) 13168 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:15:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:46 smithi163 bash[24253]: cluster 2024-08-31T07:15:45.637695+0000 mgr.a (mgr.14388) 13169 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:15:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:46 smithi027 bash[22610]: cluster 2024-08-31T07:15:45.637695+0000 mgr.a (mgr.14388) 13169 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:15:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:46 smithi191 bash[24992]: cluster 2024-08-31T07:15:45.637695+0000 mgr.a (mgr.14388) 13169 : cluster [DBG] pgmap v9128: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:15:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:48 smithi163 bash[24253]: cluster 2024-08-31T07:15:47.638497+0000 mgr.a (mgr.14388) 13170 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:15:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:48 smithi027 bash[22610]: cluster 2024-08-31T07:15:47.638497+0000 mgr.a (mgr.14388) 13170 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:15:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:48 smithi191 bash[24992]: cluster 2024-08-31T07:15:47.638497+0000 mgr.a (mgr.14388) 13170 : cluster [DBG] pgmap v9129: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:15:49.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:15:49.526 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:15:49.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:15:50.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:15:50.299 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:15:50.299 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:15:50.299 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:15:50.299 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:15:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:50 smithi191 bash[24992]: cluster 2024-08-31T07:15:49.639609+0000 mgr.a (mgr.14388) 13171 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:50 smithi191 bash[24992]: audit 2024-08-31T07:15:49.860104+0000 mgr.a (mgr.14388) 13172 : audit [DBG] from='client.287448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:50 smithi163 bash[24253]: cluster 2024-08-31T07:15:49.639609+0000 mgr.a (mgr.14388) 13171 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:50 smithi163 bash[24253]: audit 2024-08-31T07:15:49.860104+0000 mgr.a (mgr.14388) 13172 : audit [DBG] from='client.287448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:50 smithi027 bash[22610]: cluster 2024-08-31T07:15:49.639609+0000 mgr.a (mgr.14388) 13171 : cluster [DBG] pgmap v9130: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:50 smithi027 bash[22610]: audit 2024-08-31T07:15:49.860104+0000 mgr.a (mgr.14388) 13172 : audit [DBG] from='client.287448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:52 smithi163 bash[24253]: cluster 2024-08-31T07:15:51.640476+0000 mgr.a (mgr.14388) 13173 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:52 smithi027 bash[22610]: cluster 2024-08-31T07:15:51.640476+0000 mgr.a (mgr.14388) 13173 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:53.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:52 smithi191 bash[24992]: cluster 2024-08-31T07:15:51.640476+0000 mgr.a (mgr.14388) 13173 : cluster [DBG] pgmap v9131: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:54 smithi027 bash[22610]: cluster 2024-08-31T07:15:53.642675+0000 mgr.a (mgr.14388) 13174 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:54 smithi191 bash[24992]: cluster 2024-08-31T07:15:53.642675+0000 mgr.a (mgr.14388) 13174 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:54 smithi163 bash[24253]: cluster 2024-08-31T07:15:53.642675+0000 mgr.a (mgr.14388) 13174 : cluster [DBG] pgmap v9132: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:55.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:15:55.301 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:15:55.301 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:15:56.075 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:15:56.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:15:56.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:15:56.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:15:56.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:15:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:56 smithi027 bash[22610]: audit 2024-08-31T07:15:55.638341+0000 mgr.a (mgr.14388) 13175 : audit [DBG] from='client.287526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:56 smithi027 bash[22610]: cluster 2024-08-31T07:15:55.649056+0000 mgr.a (mgr.14388) 13176 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:56 smithi191 bash[24992]: audit 2024-08-31T07:15:55.638341+0000 mgr.a (mgr.14388) 13175 : audit [DBG] from='client.287526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:56 smithi191 bash[24992]: cluster 2024-08-31T07:15:55.649056+0000 mgr.a (mgr.14388) 13176 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:56 smithi163 bash[24253]: audit 2024-08-31T07:15:55.638341+0000 mgr.a (mgr.14388) 13175 : audit [DBG] from='client.287526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:15:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:56 smithi163 bash[24253]: cluster 2024-08-31T07:15:55.649056+0000 mgr.a (mgr.14388) 13176 : cluster [DBG] pgmap v9133: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:15:58 smithi027 bash[22610]: cluster 2024-08-31T07:15:57.649961+0000 mgr.a (mgr.14388) 13177 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:15:58 smithi191 bash[24992]: cluster 2024-08-31T07:15:57.649961+0000 mgr.a (mgr.14388) 13177 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:15:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:15:58 smithi163 bash[24253]: cluster 2024-08-31T07:15:57.649961+0000 mgr.a (mgr.14388) 13177 : cluster [DBG] pgmap v9134: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:16:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:00 smithi027 bash[22610]: cluster 2024-08-31T07:15:59.652204+0000 mgr.a (mgr.14388) 13178 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:16:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:00 smithi191 bash[24992]: cluster 2024-08-31T07:15:59.652204+0000 mgr.a (mgr.14388) 13178 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:16:01.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:01.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:01.078 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:00 smithi163 bash[24253]: cluster 2024-08-31T07:15:59.652204+0000 mgr.a (mgr.14388) 13178 : cluster [DBG] pgmap v9135: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:16:01.819 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:01.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:01.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:01.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:01.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:16:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:02 smithi027 bash[22610]: audit 2024-08-31T07:16:01.404659+0000 mgr.a (mgr.14388) 13179 : audit [DBG] from='client.287598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:02.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:02 smithi027 bash[22610]: cluster 2024-08-31T07:16:01.652722+0000 mgr.a (mgr.14388) 13180 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:02 smithi191 bash[24992]: audit 2024-08-31T07:16:01.404659+0000 mgr.a (mgr.14388) 13179 : audit [DBG] from='client.287598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:02 smithi191 bash[24992]: cluster 2024-08-31T07:16:01.652722+0000 mgr.a (mgr.14388) 13180 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:02 smithi163 bash[24253]: audit 2024-08-31T07:16:01.404659+0000 mgr.a (mgr.14388) 13179 : audit [DBG] from='client.287598 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:02 smithi163 bash[24253]: cluster 2024-08-31T07:16:01.652722+0000 mgr.a (mgr.14388) 13180 : cluster [DBG] pgmap v9136: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:04.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:04 smithi027 bash[22610]: cluster 2024-08-31T07:16:03.654995+0000 mgr.a (mgr.14388) 13181 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:04 smithi191 bash[24992]: cluster 2024-08-31T07:16:03.654995+0000 mgr.a (mgr.14388) 13181 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:04 smithi163 bash[24253]: cluster 2024-08-31T07:16:03.654995+0000 mgr.a (mgr.14388) 13181 : cluster [DBG] pgmap v9137: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:06 smithi027 bash[22610]: cluster 2024-08-31T07:16:05.655781+0000 mgr.a (mgr.14388) 13182 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:06 smithi191 bash[24992]: cluster 2024-08-31T07:16:05.655781+0000 mgr.a (mgr.14388) 13182 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:06 smithi163 bash[24253]: cluster 2024-08-31T07:16:05.655781+0000 mgr.a (mgr.14388) 13182 : cluster [DBG] pgmap v9138: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:07.590 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:07.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:07.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:07.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:07.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:16:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:08 smithi027 bash[22610]: audit 2024-08-31T07:16:07.157788+0000 mgr.a (mgr.14388) 13183 : audit [DBG] from='client.287676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:08 smithi027 bash[22610]: cluster 2024-08-31T07:16:07.656538+0000 mgr.a (mgr.14388) 13184 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:08 smithi191 bash[24992]: audit 2024-08-31T07:16:07.157788+0000 mgr.a (mgr.14388) 13183 : audit [DBG] from='client.287676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:08 smithi191 bash[24992]: cluster 2024-08-31T07:16:07.656538+0000 mgr.a (mgr.14388) 13184 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:08 smithi163 bash[24253]: audit 2024-08-31T07:16:07.157788+0000 mgr.a (mgr.14388) 13183 : audit [DBG] from='client.287676 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:08 smithi163 bash[24253]: cluster 2024-08-31T07:16:07.656538+0000 mgr.a (mgr.14388) 13184 : cluster [DBG] pgmap v9139: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:10 smithi191 bash[24992]: cluster 2024-08-31T07:16:09.658771+0000 mgr.a (mgr.14388) 13185 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:10 smithi163 bash[24253]: cluster 2024-08-31T07:16:09.658771+0000 mgr.a (mgr.14388) 13185 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:10 smithi027 bash[22610]: cluster 2024-08-31T07:16:09.658771+0000 mgr.a (mgr.14388) 13185 : cluster [DBG] pgmap v9140: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:12.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:12.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:12.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:12 smithi191 bash[24992]: cluster 2024-08-31T07:16:11.659566+0000 mgr.a (mgr.14388) 13186 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:12 smithi163 bash[24253]: cluster 2024-08-31T07:16:11.659566+0000 mgr.a (mgr.14388) 13186 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:12 smithi027 bash[22610]: cluster 2024-08-31T07:16:11.659566+0000 mgr.a (mgr.14388) 13186 : cluster [DBG] pgmap v9141: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:13.349 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:13.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:16:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:13 smithi191 bash[24992]: audit 2024-08-31T07:16:12.925332+0000 mgr.a (mgr.14388) 13187 : audit [DBG] from='client.287751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:13 smithi163 bash[24253]: audit 2024-08-31T07:16:12.925332+0000 mgr.a (mgr.14388) 13187 : audit [DBG] from='client.287751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:13 smithi027 bash[22610]: audit 2024-08-31T07:16:12.925332+0000 mgr.a (mgr.14388) 13187 : audit [DBG] from='client.287751 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:14 smithi191 bash[24992]: cluster 2024-08-31T07:16:13.662313+0000 mgr.a (mgr.14388) 13188 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:14 smithi163 bash[24253]: cluster 2024-08-31T07:16:13.662313+0000 mgr.a (mgr.14388) 13188 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:14 smithi027 bash[22610]: cluster 2024-08-31T07:16:13.662313+0000 mgr.a (mgr.14388) 13188 : cluster [DBG] pgmap v9142: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:16 smithi191 bash[24992]: cluster 2024-08-31T07:16:15.663135+0000 mgr.a (mgr.14388) 13189 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:16:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:16 smithi163 bash[24253]: cluster 2024-08-31T07:16:15.663135+0000 mgr.a (mgr.14388) 13189 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:16:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:16 smithi027 bash[22610]: cluster 2024-08-31T07:16:15.663135+0000 mgr.a (mgr.14388) 13189 : cluster [DBG] pgmap v9143: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:16:18.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:18.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:18.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:18 smithi191 bash[24992]: cluster 2024-08-31T07:16:17.663896+0000 mgr.a (mgr.14388) 13190 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:16:19.123 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:19.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:19.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:19.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:19.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:16:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:18 smithi163 bash[24253]: cluster 2024-08-31T07:16:17.663896+0000 mgr.a (mgr.14388) 13190 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:16:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:18 smithi027 bash[22610]: cluster 2024-08-31T07:16:17.663896+0000 mgr.a (mgr.14388) 13190 : cluster [DBG] pgmap v9144: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:16:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:19 smithi191 bash[24992]: audit 2024-08-31T07:16:18.691870+0000 mgr.a (mgr.14388) 13191 : audit [DBG] from='client.287826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:19 smithi163 bash[24253]: audit 2024-08-31T07:16:18.691870+0000 mgr.a (mgr.14388) 13191 : audit [DBG] from='client.287826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:19 smithi027 bash[22610]: audit 2024-08-31T07:16:18.691870+0000 mgr.a (mgr.14388) 13191 : audit [DBG] from='client.287826 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:20 smithi191 bash[24992]: cluster 2024-08-31T07:16:19.666649+0000 mgr.a (mgr.14388) 13192 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:20 smithi163 bash[24253]: cluster 2024-08-31T07:16:19.666649+0000 mgr.a (mgr.14388) 13192 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:20 smithi027 bash[22610]: cluster 2024-08-31T07:16:19.666649+0000 mgr.a (mgr.14388) 13192 : cluster [DBG] pgmap v9145: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:22 smithi191 bash[24992]: cluster 2024-08-31T07:16:21.667458+0000 mgr.a (mgr.14388) 13193 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:16:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:22 smithi163 bash[24253]: cluster 2024-08-31T07:16:21.667458+0000 mgr.a (mgr.14388) 13193 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:16:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:22 smithi027 bash[22610]: cluster 2024-08-31T07:16:21.667458+0000 mgr.a (mgr.14388) 13193 : cluster [DBG] pgmap v9146: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:16:24.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:24.126 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:24.126 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:24.905 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:24.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:24.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:24.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:24.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:16:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:24 smithi191 bash[24992]: cluster 2024-08-31T07:16:23.669404+0000 mgr.a (mgr.14388) 13194 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:24 smithi163 bash[24253]: cluster 2024-08-31T07:16:23.669404+0000 mgr.a (mgr.14388) 13194 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:24 smithi027 bash[22610]: cluster 2024-08-31T07:16:23.669404+0000 mgr.a (mgr.14388) 13194 : cluster [DBG] pgmap v9147: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:25 smithi191 bash[24992]: audit 2024-08-31T07:16:24.462090+0000 mgr.a (mgr.14388) 13195 : audit [DBG] from='client.287898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:25 smithi163 bash[24253]: audit 2024-08-31T07:16:24.462090+0000 mgr.a (mgr.14388) 13195 : audit [DBG] from='client.287898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:25 smithi027 bash[22610]: audit 2024-08-31T07:16:24.462090+0000 mgr.a (mgr.14388) 13195 : audit [DBG] from='client.287898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:26 smithi163 bash[24253]: cluster 2024-08-31T07:16:25.670291+0000 mgr.a (mgr.14388) 13196 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:26 smithi027 bash[22610]: cluster 2024-08-31T07:16:25.670291+0000 mgr.a (mgr.14388) 13196 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:26 smithi191 bash[24992]: cluster 2024-08-31T07:16:25.670291+0000 mgr.a (mgr.14388) 13196 : cluster [DBG] pgmap v9148: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:28 smithi163 bash[24253]: cluster 2024-08-31T07:16:27.671105+0000 mgr.a (mgr.14388) 13197 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:28 smithi027 bash[22610]: cluster 2024-08-31T07:16:27.671105+0000 mgr.a (mgr.14388) 13197 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:28 smithi191 bash[24992]: cluster 2024-08-31T07:16:27.671105+0000 mgr.a (mgr.14388) 13197 : cluster [DBG] pgmap v9149: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:29.907 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:29.908 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:29.908 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:30.687 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:30.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:30.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:30.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:30.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:16:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:30 smithi163 bash[24253]: cluster 2024-08-31T07:16:29.673282+0000 mgr.a (mgr.14388) 13198 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:30 smithi027 bash[22610]: cluster 2024-08-31T07:16:29.673282+0000 mgr.a (mgr.14388) 13198 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:30 smithi191 bash[24992]: cluster 2024-08-31T07:16:29.673282+0000 mgr.a (mgr.14388) 13198 : cluster [DBG] pgmap v9150: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:31 smithi163 bash[24253]: audit 2024-08-31T07:16:30.244354+0000 mgr.a (mgr.14388) 13199 : audit [DBG] from='client.287973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:31 smithi027 bash[22610]: audit 2024-08-31T07:16:30.244354+0000 mgr.a (mgr.14388) 13199 : audit [DBG] from='client.287973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:31 smithi191 bash[24992]: audit 2024-08-31T07:16:30.244354+0000 mgr.a (mgr.14388) 13199 : audit [DBG] from='client.287973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:32 smithi163 bash[24253]: cluster 2024-08-31T07:16:31.674167+0000 mgr.a (mgr.14388) 13200 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:32 smithi027 bash[22610]: cluster 2024-08-31T07:16:31.674167+0000 mgr.a (mgr.14388) 13200 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:32 smithi191 bash[24992]: cluster 2024-08-31T07:16:31.674167+0000 mgr.a (mgr.14388) 13200 : cluster [DBG] pgmap v9151: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:34 smithi163 bash[24253]: cluster 2024-08-31T07:16:33.676414+0000 mgr.a (mgr.14388) 13201 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:34 smithi027 bash[22610]: cluster 2024-08-31T07:16:33.676414+0000 mgr.a (mgr.14388) 13201 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:34 smithi191 bash[24992]: cluster 2024-08-31T07:16:33.676414+0000 mgr.a (mgr.14388) 13201 : cluster [DBG] pgmap v9152: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:35.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:35.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:35.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:36.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:36.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:36.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:36.455 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:16:36.455 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:36 smithi163 bash[24253]: cluster 2024-08-31T07:16:35.677160+0000 mgr.a (mgr.14388) 13202 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:36 smithi027 bash[22610]: cluster 2024-08-31T07:16:35.677160+0000 mgr.a (mgr.14388) 13202 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:36 smithi191 bash[24992]: cluster 2024-08-31T07:16:35.677160+0000 mgr.a (mgr.14388) 13202 : cluster [DBG] pgmap v9153: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:37 smithi163 bash[24253]: audit 2024-08-31T07:16:36.019662+0000 mgr.a (mgr.14388) 13203 : audit [DBG] from='client.288051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:38.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:37 smithi027 bash[22610]: audit 2024-08-31T07:16:36.019662+0000 mgr.a (mgr.14388) 13203 : audit [DBG] from='client.288051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:37 smithi191 bash[24992]: audit 2024-08-31T07:16:36.019662+0000 mgr.a (mgr.14388) 13203 : audit [DBG] from='client.288051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:38 smithi163 bash[24253]: cluster 2024-08-31T07:16:37.678046+0000 mgr.a (mgr.14388) 13204 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:38 smithi027 bash[22610]: cluster 2024-08-31T07:16:37.678046+0000 mgr.a (mgr.14388) 13204 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:38 smithi191 bash[24992]: cluster 2024-08-31T07:16:37.678046+0000 mgr.a (mgr.14388) 13204 : cluster [DBG] pgmap v9154: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:40 smithi163 bash[24253]: cluster 2024-08-31T07:16:39.680443+0000 mgr.a (mgr.14388) 13205 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:40 smithi027 bash[22610]: cluster 2024-08-31T07:16:39.680443+0000 mgr.a (mgr.14388) 13205 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:40 smithi191 bash[24992]: cluster 2024-08-31T07:16:39.680443+0000 mgr.a (mgr.14388) 13205 : cluster [DBG] pgmap v9155: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:41.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:41.457 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:42.235 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:42.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:42.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:42.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:42.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:16:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:42 smithi163 bash[24253]: cluster 2024-08-31T07:16:41.680983+0000 mgr.a (mgr.14388) 13206 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:42 smithi163 bash[24253]: audit 2024-08-31T07:16:41.790091+0000 mgr.a (mgr.14388) 13207 : audit [DBG] from='client.288129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:42 smithi027 bash[22610]: cluster 2024-08-31T07:16:41.680983+0000 mgr.a (mgr.14388) 13206 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:42 smithi027 bash[22610]: audit 2024-08-31T07:16:41.790091+0000 mgr.a (mgr.14388) 13207 : audit [DBG] from='client.288129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:42 smithi191 bash[24992]: cluster 2024-08-31T07:16:41.680983+0000 mgr.a (mgr.14388) 13206 : cluster [DBG] pgmap v9156: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:42 smithi191 bash[24992]: audit 2024-08-31T07:16:41.790091+0000 mgr.a (mgr.14388) 13207 : audit [DBG] from='client.288129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:44 smithi163 bash[24253]: cluster 2024-08-31T07:16:43.683293+0000 mgr.a (mgr.14388) 13208 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:44 smithi163 bash[24253]: audit 2024-08-31T07:16:44.190420+0000 mon.a (mon.0) 2546 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:16:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:44 smithi027 bash[22610]: cluster 2024-08-31T07:16:43.683293+0000 mgr.a (mgr.14388) 13208 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:44 smithi027 bash[22610]: audit 2024-08-31T07:16:44.190420+0000 mon.a (mon.0) 2546 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:16:45.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:44 smithi191 bash[24992]: cluster 2024-08-31T07:16:43.683293+0000 mgr.a (mgr.14388) 13208 : cluster [DBG] pgmap v9157: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:16:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:44 smithi191 bash[24992]: audit 2024-08-31T07:16:44.190420+0000 mon.a (mon.0) 2546 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:16:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:46 smithi163 bash[24253]: cluster 2024-08-31T07:16:45.684044+0000 mgr.a (mgr.14388) 13209 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:46 smithi027 bash[22610]: cluster 2024-08-31T07:16:45.684044+0000 mgr.a (mgr.14388) 13209 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:47.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:47.237 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:47.237 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:46 smithi191 bash[24992]: cluster 2024-08-31T07:16:45.684044+0000 mgr.a (mgr.14388) 13209 : cluster [DBG] pgmap v9158: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:47.985 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:47.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:47.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:47.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:47.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:16:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:48 smithi163 bash[24253]: audit 2024-08-31T07:16:47.563365+0000 mgr.a (mgr.14388) 13210 : audit [DBG] from='client.288204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:48 smithi163 bash[24253]: cluster 2024-08-31T07:16:47.684640+0000 mgr.a (mgr.14388) 13211 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:48 smithi027 bash[22610]: audit 2024-08-31T07:16:47.563365+0000 mgr.a (mgr.14388) 13210 : audit [DBG] from='client.288204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:48 smithi027 bash[22610]: cluster 2024-08-31T07:16:47.684640+0000 mgr.a (mgr.14388) 13211 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:49.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:48 smithi191 bash[24992]: audit 2024-08-31T07:16:47.563365+0000 mgr.a (mgr.14388) 13210 : audit [DBG] from='client.288204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:48 smithi191 bash[24992]: cluster 2024-08-31T07:16:47.684640+0000 mgr.a (mgr.14388) 13211 : cluster [DBG] pgmap v9159: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:16:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:50 smithi191 bash[24992]: audit 2024-08-31T07:16:49.527275+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:50 smithi191 bash[24992]: audit 2024-08-31T07:16:49.536763+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:50 smithi191 bash[24992]: audit 2024-08-31T07:16:49.555040+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:50 smithi191 bash[24992]: audit 2024-08-31T07:16:49.560751+0000 mon.a (mon.0) 2550 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:50 smithi191 bash[24992]: audit 2024-08-31T07:16:49.565964+0000 mon.a (mon.0) 2551 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:50 smithi191 bash[24992]: audit 2024-08-31T07:16:49.571708+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:50 smithi191 bash[24992]: cluster 2024-08-31T07:16:49.685877+0000 mgr.a (mgr.14388) 13212 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:16:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:50 smithi163 bash[24253]: audit 2024-08-31T07:16:49.527275+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:50 smithi163 bash[24253]: audit 2024-08-31T07:16:49.536763+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:50 smithi163 bash[24253]: audit 2024-08-31T07:16:49.555040+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:50 smithi163 bash[24253]: audit 2024-08-31T07:16:49.560751+0000 mon.a (mon.0) 2550 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:50 smithi163 bash[24253]: audit 2024-08-31T07:16:49.565964+0000 mon.a (mon.0) 2551 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:50 smithi163 bash[24253]: audit 2024-08-31T07:16:49.571708+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:50 smithi163 bash[24253]: cluster 2024-08-31T07:16:49.685877+0000 mgr.a (mgr.14388) 13212 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:16:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:50 smithi027 bash[22610]: audit 2024-08-31T07:16:49.527275+0000 mon.a (mon.0) 2547 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:50 smithi027 bash[22610]: audit 2024-08-31T07:16:49.536763+0000 mon.a (mon.0) 2548 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:50 smithi027 bash[22610]: audit 2024-08-31T07:16:49.555040+0000 mon.a (mon.0) 2549 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:50 smithi027 bash[22610]: audit 2024-08-31T07:16:49.560751+0000 mon.a (mon.0) 2550 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:50 smithi027 bash[22610]: audit 2024-08-31T07:16:49.565964+0000 mon.a (mon.0) 2551 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:50 smithi027 bash[22610]: audit 2024-08-31T07:16:49.571708+0000 mon.a (mon.0) 2552 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:50 smithi027 bash[22610]: cluster 2024-08-31T07:16:49.685877+0000 mgr.a (mgr.14388) 13212 : cluster [DBG] pgmap v9160: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:16:51.793 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.790643+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:51.793 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22863]: debug 2024-08-31T07:16:51.535+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:16:51.793 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22863]: debug 2024-08-31T07:16:51.539+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:16:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.790643+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.795933+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.800341+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.804699+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.809268+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.813843+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.815794+0000 mon.a (mon.0) 2559 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:16:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.817189+0000 mon.a (mon.0) 2560 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:16:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.824409+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.829352+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:16:52.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:51 smithi163 bash[24253]: audit 2024-08-31T07:16:50.830646+0000 mgr.a (mgr.14388) 13213 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:16:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.795933+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.800341+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.804699+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.809268+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.813843+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.815794+0000 mon.a (mon.0) 2559 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:16:52.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.817189+0000 mon.a (mon.0) 2560 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:16:52.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.824409+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.829352+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:16:52.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:51 smithi027 bash[22610]: audit 2024-08-31T07:16:50.830646+0000 mgr.a (mgr.14388) 13213 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:16:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.790643+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.795933+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.800341+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.804699+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.809268+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.813843+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.815794+0000 mon.a (mon.0) 2559 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:16:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.817189+0000 mon.a (mon.0) 2560 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:16:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.824409+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:16:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.829352+0000 mon.a (mon.0) 2562 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:16:52.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:51 smithi191 bash[24992]: audit 2024-08-31T07:16:50.830646+0000 mgr.a (mgr.14388) 13213 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:16:52.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:52.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:52.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:52 smithi163 bash[24253]: audit 2024-08-31T07:16:51.542224+0000 mgr.a (mgr.14388) 13214 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:16:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:52 smithi163 bash[24253]: cephadm 2024-08-31T07:16:51.543513+0000 mgr.a (mgr.14388) 13215 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:16:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:52 smithi163 bash[24253]: cluster 2024-08-31T07:16:51.686714+0000 mgr.a (mgr.14388) 13216 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:16:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:52 smithi027 bash[22610]: audit 2024-08-31T07:16:51.542224+0000 mgr.a (mgr.14388) 13214 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:16:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:52 smithi027 bash[22610]: cephadm 2024-08-31T07:16:51.543513+0000 mgr.a (mgr.14388) 13215 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:16:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:52 smithi027 bash[22610]: cluster 2024-08-31T07:16:51.686714+0000 mgr.a (mgr.14388) 13216 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:16:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:52 smithi191 bash[24992]: audit 2024-08-31T07:16:51.542224+0000 mgr.a (mgr.14388) 13214 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:16:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:52 smithi191 bash[24992]: cephadm 2024-08-31T07:16:51.543513+0000 mgr.a (mgr.14388) 13215 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:16:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:52 smithi191 bash[24992]: cluster 2024-08-31T07:16:51.686714+0000 mgr.a (mgr.14388) 13216 : cluster [DBG] pgmap v9161: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:16:53.770 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:53.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:53.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:53.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:53.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:16:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:54 smithi163 bash[24253]: audit 2024-08-31T07:16:53.323378+0000 mgr.a (mgr.14388) 13217 : audit [DBG] from='client.288390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:54 smithi163 bash[24253]: cluster 2024-08-31T07:16:53.688127+0000 mgr.a (mgr.14388) 13218 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:16:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:54 smithi027 bash[22610]: audit 2024-08-31T07:16:53.323378+0000 mgr.a (mgr.14388) 13217 : audit [DBG] from='client.288390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:54 smithi027 bash[22610]: cluster 2024-08-31T07:16:53.688127+0000 mgr.a (mgr.14388) 13218 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:16:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:54 smithi191 bash[24992]: audit 2024-08-31T07:16:53.323378+0000 mgr.a (mgr.14388) 13217 : audit [DBG] from='client.288390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:16:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:54 smithi191 bash[24992]: cluster 2024-08-31T07:16:53.688127+0000 mgr.a (mgr.14388) 13218 : cluster [DBG] pgmap v9162: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:16:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:56 smithi163 bash[24253]: cluster 2024-08-31T07:16:55.688885+0000 mgr.a (mgr.14388) 13219 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:16:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:56 smithi027 bash[22610]: cluster 2024-08-31T07:16:55.688885+0000 mgr.a (mgr.14388) 13219 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:16:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:56 smithi191 bash[24992]: cluster 2024-08-31T07:16:55.688885+0000 mgr.a (mgr.14388) 13219 : cluster [DBG] pgmap v9163: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:16:58.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:16:58.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:16:58.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:16:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:16:58 smithi163 bash[24253]: cluster 2024-08-31T07:16:57.689645+0000 mgr.a (mgr.14388) 13220 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:16:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:16:58 smithi027 bash[22610]: cluster 2024-08-31T07:16:57.689645+0000 mgr.a (mgr.14388) 13220 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:16:59.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:16:58 smithi191 bash[24992]: cluster 2024-08-31T07:16:57.689645+0000 mgr.a (mgr.14388) 13220 : cluster [DBG] pgmap v9164: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:16:59.526 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:16:59.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:16:59.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:16:59.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:16:59.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:00 smithi163 bash[24253]: audit 2024-08-31T07:16:59.100106+0000 mgr.a (mgr.14388) 13221 : audit [DBG] from='client.288468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:00 smithi163 bash[24253]: cluster 2024-08-31T07:16:59.692331+0000 mgr.a (mgr.14388) 13222 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:17:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:00 smithi027 bash[22610]: audit 2024-08-31T07:16:59.100106+0000 mgr.a (mgr.14388) 13221 : audit [DBG] from='client.288468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:00 smithi027 bash[22610]: cluster 2024-08-31T07:16:59.692331+0000 mgr.a (mgr.14388) 13222 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:17:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:00 smithi191 bash[24992]: audit 2024-08-31T07:16:59.100106+0000 mgr.a (mgr.14388) 13221 : audit [DBG] from='client.288468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:00 smithi191 bash[24992]: cluster 2024-08-31T07:16:59.692331+0000 mgr.a (mgr.14388) 13222 : cluster [DBG] pgmap v9165: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:17:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:02 smithi163 bash[24253]: cluster 2024-08-31T07:17:01.693122+0000 mgr.a (mgr.14388) 13223 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:17:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:02 smithi027 bash[22610]: cluster 2024-08-31T07:17:01.693122+0000 mgr.a (mgr.14388) 13223 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:17:03.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:02 smithi191 bash[24992]: cluster 2024-08-31T07:17:01.693122+0000 mgr.a (mgr.14388) 13223 : cluster [DBG] pgmap v9166: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:17:04.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:17:04.528 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:17:04.529 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:17:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:04 smithi163 bash[24253]: cluster 2024-08-31T07:17:03.695126+0000 mgr.a (mgr.14388) 13224 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:17:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:04 smithi027 bash[22610]: cluster 2024-08-31T07:17:03.695126+0000 mgr.a (mgr.14388) 13224 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:17:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:04 smithi191 bash[24992]: cluster 2024-08-31T07:17:03.695126+0000 mgr.a (mgr.14388) 13224 : cluster [DBG] pgmap v9167: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:17:05.303 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:17:05.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:17:05.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:17:05.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:17:05.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:05 smithi163 bash[24253]: audit 2024-08-31T07:17:04.865491+0000 mgr.a (mgr.14388) 13225 : audit [DBG] from='client.288546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:05 smithi027 bash[22610]: audit 2024-08-31T07:17:04.865491+0000 mgr.a (mgr.14388) 13225 : audit [DBG] from='client.288546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:05 smithi191 bash[24992]: audit 2024-08-31T07:17:04.865491+0000 mgr.a (mgr.14388) 13225 : audit [DBG] from='client.288546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:06 smithi163 bash[24253]: cluster 2024-08-31T07:17:05.695981+0000 mgr.a (mgr.14388) 13226 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:06 smithi027 bash[22610]: cluster 2024-08-31T07:17:05.695981+0000 mgr.a (mgr.14388) 13226 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:06 smithi191 bash[24992]: cluster 2024-08-31T07:17:05.695981+0000 mgr.a (mgr.14388) 13226 : cluster [DBG] pgmap v9168: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:08 smithi163 bash[24253]: cluster 2024-08-31T07:17:07.696752+0000 mgr.a (mgr.14388) 13227 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:08 smithi027 bash[22610]: cluster 2024-08-31T07:17:07.696752+0000 mgr.a (mgr.14388) 13227 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:08 smithi191 bash[24992]: cluster 2024-08-31T07:17:07.696752+0000 mgr.a (mgr.14388) 13227 : cluster [DBG] pgmap v9169: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:10.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:17:10.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:17:10.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:17:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:10 smithi163 bash[24253]: cluster 2024-08-31T07:17:09.698988+0000 mgr.a (mgr.14388) 13228 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:10 smithi027 bash[22610]: cluster 2024-08-31T07:17:09.698988+0000 mgr.a (mgr.14388) 13228 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:10 smithi191 bash[24992]: cluster 2024-08-31T07:17:09.698988+0000 mgr.a (mgr.14388) 13228 : cluster [DBG] pgmap v9170: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:11.074 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:17:11.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:17:11.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:17:11.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:17:11.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:11 smithi163 bash[24253]: audit 2024-08-31T07:17:10.638111+0000 mgr.a (mgr.14388) 13229 : audit [DBG] from='client.288621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:11 smithi027 bash[22610]: audit 2024-08-31T07:17:10.638111+0000 mgr.a (mgr.14388) 13229 : audit [DBG] from='client.288621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:11 smithi191 bash[24992]: audit 2024-08-31T07:17:10.638111+0000 mgr.a (mgr.14388) 13229 : audit [DBG] from='client.288621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:12 smithi163 bash[24253]: cluster 2024-08-31T07:17:11.699865+0000 mgr.a (mgr.14388) 13230 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:12 smithi027 bash[22610]: cluster 2024-08-31T07:17:11.699865+0000 mgr.a (mgr.14388) 13230 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:12 smithi191 bash[24992]: cluster 2024-08-31T07:17:11.699865+0000 mgr.a (mgr.14388) 13230 : cluster [DBG] pgmap v9171: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:14 smithi191 bash[24992]: cluster 2024-08-31T07:17:13.702007+0000 mgr.a (mgr.14388) 13231 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:14 smithi163 bash[24253]: cluster 2024-08-31T07:17:13.702007+0000 mgr.a (mgr.14388) 13231 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:14 smithi027 bash[22610]: cluster 2024-08-31T07:17:13.702007+0000 mgr.a (mgr.14388) 13231 : cluster [DBG] pgmap v9172: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:16.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:17:16.076 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:17:16.076 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:17:16.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:17:16.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:17:16.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:17:16.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:16.834 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:17:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:16 smithi191 bash[24992]: cluster 2024-08-31T07:17:15.702785+0000 mgr.a (mgr.14388) 13232 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:16 smithi163 bash[24253]: cluster 2024-08-31T07:17:15.702785+0000 mgr.a (mgr.14388) 13232 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:16 smithi027 bash[22610]: cluster 2024-08-31T07:17:15.702785+0000 mgr.a (mgr.14388) 13232 : cluster [DBG] pgmap v9173: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:17 smithi191 bash[24992]: audit 2024-08-31T07:17:16.405113+0000 mgr.a (mgr.14388) 13233 : audit [DBG] from='client.288696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:17 smithi163 bash[24253]: audit 2024-08-31T07:17:16.405113+0000 mgr.a (mgr.14388) 13233 : audit [DBG] from='client.288696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:17 smithi027 bash[22610]: audit 2024-08-31T07:17:16.405113+0000 mgr.a (mgr.14388) 13233 : audit [DBG] from='client.288696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:18 smithi191 bash[24992]: cluster 2024-08-31T07:17:17.703626+0000 mgr.a (mgr.14388) 13234 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:18 smithi163 bash[24253]: cluster 2024-08-31T07:17:17.703626+0000 mgr.a (mgr.14388) 13234 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:18 smithi027 bash[22610]: cluster 2024-08-31T07:17:17.703626+0000 mgr.a (mgr.14388) 13234 : cluster [DBG] pgmap v9174: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:20 smithi191 bash[24992]: cluster 2024-08-31T07:17:19.705843+0000 mgr.a (mgr.14388) 13235 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:20 smithi163 bash[24253]: cluster 2024-08-31T07:17:19.705843+0000 mgr.a (mgr.14388) 13235 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:20 smithi027 bash[22610]: cluster 2024-08-31T07:17:19.705843+0000 mgr.a (mgr.14388) 13235 : cluster [DBG] pgmap v9175: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:21.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:17:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:17:21.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:17:22.606 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:17:22.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:17:22.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:17:22.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:17:22.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:22 smithi191 bash[24992]: cluster 2024-08-31T07:17:21.706626+0000 mgr.a (mgr.14388) 13236 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:22 smithi163 bash[24253]: cluster 2024-08-31T07:17:21.706626+0000 mgr.a (mgr.14388) 13236 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:22 smithi027 bash[22610]: cluster 2024-08-31T07:17:21.706626+0000 mgr.a (mgr.14388) 13236 : cluster [DBG] pgmap v9176: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:23 smithi163 bash[24253]: audit 2024-08-31T07:17:22.167408+0000 mgr.a (mgr.14388) 13237 : audit [DBG] from='client.288771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:23 smithi027 bash[22610]: audit 2024-08-31T07:17:22.167408+0000 mgr.a (mgr.14388) 13237 : audit [DBG] from='client.288771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:23 smithi191 bash[24992]: audit 2024-08-31T07:17:22.167408+0000 mgr.a (mgr.14388) 13237 : audit [DBG] from='client.288771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:24 smithi163 bash[24253]: cluster 2024-08-31T07:17:23.708962+0000 mgr.a (mgr.14388) 13238 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:24 smithi027 bash[22610]: cluster 2024-08-31T07:17:23.708962+0000 mgr.a (mgr.14388) 13238 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:24 smithi191 bash[24992]: cluster 2024-08-31T07:17:23.708962+0000 mgr.a (mgr.14388) 13238 : cluster [DBG] pgmap v9177: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:26 smithi163 bash[24253]: cluster 2024-08-31T07:17:25.709766+0000 mgr.a (mgr.14388) 13239 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:26 smithi027 bash[22610]: cluster 2024-08-31T07:17:25.709766+0000 mgr.a (mgr.14388) 13239 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:26 smithi191 bash[24992]: cluster 2024-08-31T07:17:25.709766+0000 mgr.a (mgr.14388) 13239 : cluster [DBG] pgmap v9178: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:27.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:17:27.609 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:17:27.609 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:17:28.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:17:28.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:17:28.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:17:28.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:28.348 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:17:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:28 smithi163 bash[24253]: cluster 2024-08-31T07:17:27.710249+0000 mgr.a (mgr.14388) 13240 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:28 smithi163 bash[24253]: audit 2024-08-31T07:17:27.938845+0000 mgr.a (mgr.14388) 13241 : audit [DBG] from='client.288846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:28 smithi027 bash[22610]: cluster 2024-08-31T07:17:27.710249+0000 mgr.a (mgr.14388) 13240 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:28 smithi027 bash[22610]: audit 2024-08-31T07:17:27.938845+0000 mgr.a (mgr.14388) 13241 : audit [DBG] from='client.288846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:28 smithi191 bash[24992]: cluster 2024-08-31T07:17:27.710249+0000 mgr.a (mgr.14388) 13240 : cluster [DBG] pgmap v9179: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:28 smithi191 bash[24992]: audit 2024-08-31T07:17:27.938845+0000 mgr.a (mgr.14388) 13241 : audit [DBG] from='client.288846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:30 smithi163 bash[24253]: cluster 2024-08-31T07:17:29.713063+0000 mgr.a (mgr.14388) 13242 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:30 smithi027 bash[22610]: cluster 2024-08-31T07:17:29.713063+0000 mgr.a (mgr.14388) 13242 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:30 smithi191 bash[24992]: cluster 2024-08-31T07:17:29.713063+0000 mgr.a (mgr.14388) 13242 : cluster [DBG] pgmap v9180: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:32 smithi163 bash[24253]: cluster 2024-08-31T07:17:31.713871+0000 mgr.a (mgr.14388) 13243 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:17:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:32 smithi027 bash[22610]: cluster 2024-08-31T07:17:31.713871+0000 mgr.a (mgr.14388) 13243 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:17:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:32 smithi191 bash[24992]: cluster 2024-08-31T07:17:31.713871+0000 mgr.a (mgr.14388) 13243 : cluster [DBG] pgmap v9181: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:17:33.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:17:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:17:33.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:17:34.126 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:17:34.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:17:34.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:17:34.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:17:34.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:34 smithi163 bash[24253]: audit 2024-08-31T07:17:33.683991+0000 mgr.a (mgr.14388) 13244 : audit [DBG] from='client.288924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:34 smithi163 bash[24253]: cluster 2024-08-31T07:17:33.715688+0000 mgr.a (mgr.14388) 13245 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:34 smithi027 bash[22610]: audit 2024-08-31T07:17:33.683991+0000 mgr.a (mgr.14388) 13244 : audit [DBG] from='client.288924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:34 smithi027 bash[22610]: cluster 2024-08-31T07:17:33.715688+0000 mgr.a (mgr.14388) 13245 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:34 smithi191 bash[24992]: audit 2024-08-31T07:17:33.683991+0000 mgr.a (mgr.14388) 13244 : audit [DBG] from='client.288924 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:34 smithi191 bash[24992]: cluster 2024-08-31T07:17:33.715688+0000 mgr.a (mgr.14388) 13245 : cluster [DBG] pgmap v9182: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:36 smithi163 bash[24253]: cluster 2024-08-31T07:17:35.716599+0000 mgr.a (mgr.14388) 13246 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:17:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:36 smithi027 bash[22610]: cluster 2024-08-31T07:17:35.716599+0000 mgr.a (mgr.14388) 13246 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:17:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:36 smithi191 bash[24992]: cluster 2024-08-31T07:17:35.716599+0000 mgr.a (mgr.14388) 13246 : cluster [DBG] pgmap v9183: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:17:39.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:17:39.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:17:39.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:17:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:38 smithi163 bash[24253]: cluster 2024-08-31T07:17:37.717394+0000 mgr.a (mgr.14388) 13247 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:17:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:38 smithi027 bash[22610]: cluster 2024-08-31T07:17:37.717394+0000 mgr.a (mgr.14388) 13247 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:17:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:38 smithi191 bash[24992]: cluster 2024-08-31T07:17:37.717394+0000 mgr.a (mgr.14388) 13247 : cluster [DBG] pgmap v9184: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:17:39.897 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:17:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:17:39.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:17:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:17:39.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:40 smithi163 bash[24253]: audit 2024-08-31T07:17:39.463363+0000 mgr.a (mgr.14388) 13248 : audit [DBG] from='client.288999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:40 smithi163 bash[24253]: cluster 2024-08-31T07:17:39.718942+0000 mgr.a (mgr.14388) 13249 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:40 smithi027 bash[22610]: audit 2024-08-31T07:17:39.463363+0000 mgr.a (mgr.14388) 13248 : audit [DBG] from='client.288999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:40 smithi027 bash[22610]: cluster 2024-08-31T07:17:39.718942+0000 mgr.a (mgr.14388) 13249 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:40 smithi191 bash[24992]: audit 2024-08-31T07:17:39.463363+0000 mgr.a (mgr.14388) 13248 : audit [DBG] from='client.288999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:40 smithi191 bash[24992]: cluster 2024-08-31T07:17:39.718942+0000 mgr.a (mgr.14388) 13249 : cluster [DBG] pgmap v9185: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:42 smithi163 bash[24253]: cluster 2024-08-31T07:17:41.719755+0000 mgr.a (mgr.14388) 13250 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:42 smithi027 bash[22610]: cluster 2024-08-31T07:17:41.719755+0000 mgr.a (mgr.14388) 13250 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:42 smithi191 bash[24992]: cluster 2024-08-31T07:17:41.719755+0000 mgr.a (mgr.14388) 13250 : cluster [DBG] pgmap v9186: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:44.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:17:44.899 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:17:44.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:17:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:44 smithi163 bash[24253]: cluster 2024-08-31T07:17:43.721961+0000 mgr.a (mgr.14388) 13251 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:44 smithi027 bash[22610]: cluster 2024-08-31T07:17:43.721961+0000 mgr.a (mgr.14388) 13251 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:44 smithi191 bash[24992]: cluster 2024-08-31T07:17:43.721961+0000 mgr.a (mgr.14388) 13251 : cluster [DBG] pgmap v9187: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:45.647 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:17:45.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:17:45.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:17:45.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:17:45.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:46 smithi163 bash[24253]: audit 2024-08-31T07:17:45.224469+0000 mgr.a (mgr.14388) 13252 : audit [DBG] from='client.289077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:46 smithi163 bash[24253]: cluster 2024-08-31T07:17:45.722618+0000 mgr.a (mgr.14388) 13253 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:46 smithi027 bash[22610]: audit 2024-08-31T07:17:45.224469+0000 mgr.a (mgr.14388) 13252 : audit [DBG] from='client.289077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:46 smithi027 bash[22610]: cluster 2024-08-31T07:17:45.722618+0000 mgr.a (mgr.14388) 13253 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:46 smithi191 bash[24992]: audit 2024-08-31T07:17:45.224469+0000 mgr.a (mgr.14388) 13252 : audit [DBG] from='client.289077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:46 smithi191 bash[24992]: cluster 2024-08-31T07:17:45.722618+0000 mgr.a (mgr.14388) 13253 : cluster [DBG] pgmap v9188: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:48 smithi163 bash[24253]: cluster 2024-08-31T07:17:47.723356+0000 mgr.a (mgr.14388) 13254 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:48 smithi027 bash[22610]: cluster 2024-08-31T07:17:47.723356+0000 mgr.a (mgr.14388) 13254 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:49.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:48 smithi191 bash[24992]: cluster 2024-08-31T07:17:47.723356+0000 mgr.a (mgr.14388) 13254 : cluster [DBG] pgmap v9189: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:50.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:17:50.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:17:50.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:17:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:50 smithi163 bash[24253]: cluster 2024-08-31T07:17:49.725692+0000 mgr.a (mgr.14388) 13255 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:50 smithi027 bash[22610]: cluster 2024-08-31T07:17:49.725692+0000 mgr.a (mgr.14388) 13255 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:50 smithi191 bash[24992]: cluster 2024-08-31T07:17:49.725692+0000 mgr.a (mgr.14388) 13255 : cluster [DBG] pgmap v9190: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:17:51.421 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:17:51.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:17:51.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:17:51.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:17:51.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:51 smithi163 bash[24253]: audit 2024-08-31T07:17:51.594422+0000 mon.a (mon.0) 2563 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:17:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:51 smithi027 bash[22610]: audit 2024-08-31T07:17:51.594422+0000 mon.a (mon.0) 2563 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:17:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:51 smithi191 bash[24992]: audit 2024-08-31T07:17:51.594422+0000 mon.a (mon.0) 2563 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:17:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:52 smithi163 bash[24253]: audit 2024-08-31T07:17:50.982416+0000 mgr.a (mgr.14388) 13256 : audit [DBG] from='client.289155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:52 smithi163 bash[24253]: cluster 2024-08-31T07:17:51.726648+0000 mgr.a (mgr.14388) 13257 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:52 smithi163 bash[24253]: audit 2024-08-31T07:17:52.435402+0000 mon.a (mon.0) 2564 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:17:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:52 smithi163 bash[24253]: audit 2024-08-31T07:17:52.437107+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:17:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:52 smithi163 bash[24253]: audit 2024-08-31T07:17:52.447017+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:17:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:52 smithi163 bash[24253]: audit 2024-08-31T07:17:52.451942+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:17:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:52 smithi027 bash[22610]: audit 2024-08-31T07:17:50.982416+0000 mgr.a (mgr.14388) 13256 : audit [DBG] from='client.289155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:52 smithi027 bash[22610]: cluster 2024-08-31T07:17:51.726648+0000 mgr.a (mgr.14388) 13257 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:52 smithi027 bash[22610]: audit 2024-08-31T07:17:52.435402+0000 mon.a (mon.0) 2564 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:17:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:52 smithi027 bash[22610]: audit 2024-08-31T07:17:52.437107+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:17:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:52 smithi027 bash[22610]: audit 2024-08-31T07:17:52.447017+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:17:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:52 smithi027 bash[22610]: audit 2024-08-31T07:17:52.451942+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:17:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:52 smithi191 bash[24992]: audit 2024-08-31T07:17:50.982416+0000 mgr.a (mgr.14388) 13256 : audit [DBG] from='client.289155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:52 smithi191 bash[24992]: cluster 2024-08-31T07:17:51.726648+0000 mgr.a (mgr.14388) 13257 : cluster [DBG] pgmap v9191: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:17:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:52 smithi191 bash[24992]: audit 2024-08-31T07:17:52.435402+0000 mon.a (mon.0) 2564 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:17:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:52 smithi191 bash[24992]: audit 2024-08-31T07:17:52.437107+0000 mon.a (mon.0) 2565 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:17:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:52 smithi191 bash[24992]: audit 2024-08-31T07:17:52.447017+0000 mon.a (mon.0) 2566 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:17:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:52 smithi191 bash[24992]: audit 2024-08-31T07:17:52.451942+0000 mon.a (mon.0) 2567 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:17:53.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:17:53 smithi027 bash[22863]: debug 2024-08-31T07:17:53.181+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:17:53.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:17:53 smithi027 bash[22863]: debug 2024-08-31T07:17:53.185+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:17:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:53 smithi163 bash[24253]: audit 2024-08-31T07:17:52.454403+0000 mgr.a (mgr.14388) 13258 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:17:53.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:53 smithi027 bash[22610]: audit 2024-08-31T07:17:52.454403+0000 mgr.a (mgr.14388) 13258 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:17:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:53 smithi191 bash[24992]: audit 2024-08-31T07:17:52.454403+0000 mgr.a (mgr.14388) 13258 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:17:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:54 smithi163 bash[24253]: audit 2024-08-31T07:17:53.185949+0000 mgr.a (mgr.14388) 13259 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:17:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:54 smithi163 bash[24253]: cephadm 2024-08-31T07:17:53.187400+0000 mgr.a (mgr.14388) 13260 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:17:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:54 smithi163 bash[24253]: cluster 2024-08-31T07:17:53.729519+0000 mgr.a (mgr.14388) 13261 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:17:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:54 smithi027 bash[22610]: audit 2024-08-31T07:17:53.185949+0000 mgr.a (mgr.14388) 13259 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:17:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:54 smithi027 bash[22610]: cephadm 2024-08-31T07:17:53.187400+0000 mgr.a (mgr.14388) 13260 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:17:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:54 smithi027 bash[22610]: cluster 2024-08-31T07:17:53.729519+0000 mgr.a (mgr.14388) 13261 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:17:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:54 smithi191 bash[24992]: audit 2024-08-31T07:17:53.185949+0000 mgr.a (mgr.14388) 13259 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:17:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:54 smithi191 bash[24992]: cephadm 2024-08-31T07:17:53.187400+0000 mgr.a (mgr.14388) 13260 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:17:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:54 smithi191 bash[24992]: cluster 2024-08-31T07:17:53.729519+0000 mgr.a (mgr.14388) 13261 : cluster [DBG] pgmap v9192: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:17:56.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:17:56.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:17:56.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:17:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:56 smithi191 bash[24992]: cluster 2024-08-31T07:17:55.730325+0000 mgr.a (mgr.14388) 13262 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:17:57.200 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:17:57.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:17:57.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:17:57.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:17:57.200 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:17:57.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:56 smithi163 bash[24253]: cluster 2024-08-31T07:17:55.730325+0000 mgr.a (mgr.14388) 13262 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:17:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:56 smithi027 bash[22610]: cluster 2024-08-31T07:17:55.730325+0000 mgr.a (mgr.14388) 13262 : cluster [DBG] pgmap v9193: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:17:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:57 smithi163 bash[24253]: audit 2024-08-31T07:17:56.757830+0000 mgr.a (mgr.14388) 13263 : audit [DBG] from='client.289341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:57 smithi027 bash[22610]: audit 2024-08-31T07:17:56.757830+0000 mgr.a (mgr.14388) 13263 : audit [DBG] from='client.289341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:57 smithi191 bash[24992]: audit 2024-08-31T07:17:56.757830+0000 mgr.a (mgr.14388) 13263 : audit [DBG] from='client.289341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:17:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:17:58 smithi163 bash[24253]: cluster 2024-08-31T07:17:57.731495+0000 mgr.a (mgr.14388) 13264 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:17:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:17:58 smithi027 bash[22610]: cluster 2024-08-31T07:17:57.731495+0000 mgr.a (mgr.14388) 13264 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:17:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:17:58 smithi191 bash[24992]: cluster 2024-08-31T07:17:57.731495+0000 mgr.a (mgr.14388) 13264 : cluster [DBG] pgmap v9194: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:18:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:00 smithi163 bash[24253]: cluster 2024-08-31T07:17:59.733782+0000 mgr.a (mgr.14388) 13265 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:18:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:00 smithi027 bash[22610]: cluster 2024-08-31T07:17:59.733782+0000 mgr.a (mgr.14388) 13265 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:18:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:00 smithi191 bash[24992]: cluster 2024-08-31T07:17:59.733782+0000 mgr.a (mgr.14388) 13265 : cluster [DBG] pgmap v9195: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:18:02.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:18:02.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:18:02.202 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:18:02.938 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:18:02.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:18:02.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:18:02.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:18:02.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:18:03.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:02 smithi163 bash[24253]: cluster 2024-08-31T07:18:01.734558+0000 mgr.a (mgr.14388) 13266 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:18:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:02 smithi027 bash[22610]: cluster 2024-08-31T07:18:01.734558+0000 mgr.a (mgr.14388) 13266 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:18:03.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:02 smithi191 bash[24992]: cluster 2024-08-31T07:18:01.734558+0000 mgr.a (mgr.14388) 13266 : cluster [DBG] pgmap v9196: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:18:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:03 smithi163 bash[24253]: audit 2024-08-31T07:18:02.532374+0000 mgr.a (mgr.14388) 13267 : audit [DBG] from='client.289419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:03 smithi027 bash[22610]: audit 2024-08-31T07:18:02.532374+0000 mgr.a (mgr.14388) 13267 : audit [DBG] from='client.289419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:03 smithi191 bash[24992]: audit 2024-08-31T07:18:02.532374+0000 mgr.a (mgr.14388) 13267 : audit [DBG] from='client.289419 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:04 smithi163 bash[24253]: cluster 2024-08-31T07:18:03.736980+0000 mgr.a (mgr.14388) 13268 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:18:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:04 smithi027 bash[22610]: cluster 2024-08-31T07:18:03.736980+0000 mgr.a (mgr.14388) 13268 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:18:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:04 smithi191 bash[24992]: cluster 2024-08-31T07:18:03.736980+0000 mgr.a (mgr.14388) 13268 : cluster [DBG] pgmap v9197: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:18:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:06 smithi163 bash[24253]: cluster 2024-08-31T07:18:05.737739+0000 mgr.a (mgr.14388) 13269 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:18:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:06 smithi027 bash[22610]: cluster 2024-08-31T07:18:05.737739+0000 mgr.a (mgr.14388) 13269 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:18:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:06 smithi191 bash[24992]: cluster 2024-08-31T07:18:05.737739+0000 mgr.a (mgr.14388) 13269 : cluster [DBG] pgmap v9198: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:18:07.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:18:07.940 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:18:07.940 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:18:08.683 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:18:08.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:18:08.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:18:08.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:18:08.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:18:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:08 smithi163 bash[24253]: cluster 2024-08-31T07:18:07.738496+0000 mgr.a (mgr.14388) 13270 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:18:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:08 smithi027 bash[22610]: cluster 2024-08-31T07:18:07.738496+0000 mgr.a (mgr.14388) 13270 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:18:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:08 smithi191 bash[24992]: cluster 2024-08-31T07:18:07.738496+0000 mgr.a (mgr.14388) 13270 : cluster [DBG] pgmap v9199: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:18:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:09 smithi163 bash[24253]: audit 2024-08-31T07:18:08.269663+0000 mgr.a (mgr.14388) 13271 : audit [DBG] from='client.289494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:09 smithi027 bash[22610]: audit 2024-08-31T07:18:08.269663+0000 mgr.a (mgr.14388) 13271 : audit [DBG] from='client.289494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:09 smithi191 bash[24992]: audit 2024-08-31T07:18:08.269663+0000 mgr.a (mgr.14388) 13271 : audit [DBG] from='client.289494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:10 smithi163 bash[24253]: cluster 2024-08-31T07:18:09.741340+0000 mgr.a (mgr.14388) 13272 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:18:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:10 smithi027 bash[22610]: cluster 2024-08-31T07:18:09.741340+0000 mgr.a (mgr.14388) 13272 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:18:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:10 smithi191 bash[24992]: cluster 2024-08-31T07:18:09.741340+0000 mgr.a (mgr.14388) 13272 : cluster [DBG] pgmap v9200: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:18:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:12 smithi163 bash[24253]: cluster 2024-08-31T07:18:11.742133+0000 mgr.a (mgr.14388) 13273 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:18:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:12 smithi027 bash[22610]: cluster 2024-08-31T07:18:11.742133+0000 mgr.a (mgr.14388) 13273 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:18:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:12 smithi191 bash[24992]: cluster 2024-08-31T07:18:11.742133+0000 mgr.a (mgr.14388) 13273 : cluster [DBG] pgmap v9201: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:18:13.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:18:13.685 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:18:13.685 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:18:14.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:18:14.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:18:14.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:18:14.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:18:14.470 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:18:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:14 smithi163 bash[24253]: cluster 2024-08-31T07:18:13.744138+0000 mgr.a (mgr.14388) 13274 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:14 smithi027 bash[22610]: cluster 2024-08-31T07:18:13.744138+0000 mgr.a (mgr.14388) 13274 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:14 smithi191 bash[24992]: cluster 2024-08-31T07:18:13.744138+0000 mgr.a (mgr.14388) 13274 : cluster [DBG] pgmap v9202: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:15 smithi163 bash[24253]: audit 2024-08-31T07:18:14.022910+0000 mgr.a (mgr.14388) 13275 : audit [DBG] from='client.289572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:15 smithi027 bash[22610]: audit 2024-08-31T07:18:14.022910+0000 mgr.a (mgr.14388) 13275 : audit [DBG] from='client.289572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:15 smithi191 bash[24992]: audit 2024-08-31T07:18:14.022910+0000 mgr.a (mgr.14388) 13275 : audit [DBG] from='client.289572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:16 smithi163 bash[24253]: cluster 2024-08-31T07:18:15.745253+0000 mgr.a (mgr.14388) 13276 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:18:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:16 smithi027 bash[22610]: cluster 2024-08-31T07:18:15.745253+0000 mgr.a (mgr.14388) 13276 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:18:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:16 smithi191 bash[24992]: cluster 2024-08-31T07:18:15.745253+0000 mgr.a (mgr.14388) 13276 : cluster [DBG] pgmap v9203: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:18:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:18 smithi163 bash[24253]: cluster 2024-08-31T07:18:17.746238+0000 mgr.a (mgr.14388) 13277 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:18:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:18 smithi027 bash[22610]: cluster 2024-08-31T07:18:17.746238+0000 mgr.a (mgr.14388) 13277 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:18:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:18 smithi191 bash[24992]: cluster 2024-08-31T07:18:17.746238+0000 mgr.a (mgr.14388) 13277 : cluster [DBG] pgmap v9204: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:18:19.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:18:19.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:18:19.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:18:20.239 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:18:20.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:18:20.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:18:20.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:18:20.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:18:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:20 smithi163 bash[24253]: cluster 2024-08-31T07:18:19.747651+0000 mgr.a (mgr.14388) 13278 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:18:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:20 smithi163 bash[24253]: audit 2024-08-31T07:18:19.806183+0000 mgr.a (mgr.14388) 13279 : audit [DBG] from='client.289647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:20 smithi027 bash[22610]: cluster 2024-08-31T07:18:19.747651+0000 mgr.a (mgr.14388) 13278 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:18:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:20 smithi027 bash[22610]: audit 2024-08-31T07:18:19.806183+0000 mgr.a (mgr.14388) 13279 : audit [DBG] from='client.289647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:20 smithi191 bash[24992]: cluster 2024-08-31T07:18:19.747651+0000 mgr.a (mgr.14388) 13278 : cluster [DBG] pgmap v9205: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T07:18:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:20 smithi191 bash[24992]: audit 2024-08-31T07:18:19.806183+0000 mgr.a (mgr.14388) 13279 : audit [DBG] from='client.289647 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:22 smithi163 bash[24253]: cluster 2024-08-31T07:18:21.748561+0000 mgr.a (mgr.14388) 13280 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:22 smithi027 bash[22610]: cluster 2024-08-31T07:18:21.748561+0000 mgr.a (mgr.14388) 13280 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:22 smithi191 bash[24992]: cluster 2024-08-31T07:18:21.748561+0000 mgr.a (mgr.14388) 13280 : cluster [DBG] pgmap v9206: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:24 smithi163 bash[24253]: cluster 2024-08-31T07:18:23.750801+0000 mgr.a (mgr.14388) 13281 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:24 smithi027 bash[22610]: cluster 2024-08-31T07:18:23.750801+0000 mgr.a (mgr.14388) 13281 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:25.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:18:25.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:18:25.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:18:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:24 smithi191 bash[24992]: cluster 2024-08-31T07:18:23.750801+0000 mgr.a (mgr.14388) 13281 : cluster [DBG] pgmap v9207: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:25.973 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:18:25.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:18:25.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:18:25.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:18:25.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:18:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:26 smithi163 bash[24253]: audit 2024-08-31T07:18:25.568269+0000 mgr.a (mgr.14388) 13282 : audit [DBG] from='client.289725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:26 smithi163 bash[24253]: cluster 2024-08-31T07:18:25.751305+0000 mgr.a (mgr.14388) 13283 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:26 smithi027 bash[22610]: audit 2024-08-31T07:18:25.568269+0000 mgr.a (mgr.14388) 13282 : audit [DBG] from='client.289725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:26 smithi027 bash[22610]: cluster 2024-08-31T07:18:25.751305+0000 mgr.a (mgr.14388) 13283 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:26 smithi191 bash[24992]: audit 2024-08-31T07:18:25.568269+0000 mgr.a (mgr.14388) 13282 : audit [DBG] from='client.289725 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:26 smithi191 bash[24992]: cluster 2024-08-31T07:18:25.751305+0000 mgr.a (mgr.14388) 13283 : cluster [DBG] pgmap v9208: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:28 smithi163 bash[24253]: cluster 2024-08-31T07:18:27.752339+0000 mgr.a (mgr.14388) 13284 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:28 smithi027 bash[22610]: cluster 2024-08-31T07:18:27.752339+0000 mgr.a (mgr.14388) 13284 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:28 smithi191 bash[24992]: cluster 2024-08-31T07:18:27.752339+0000 mgr.a (mgr.14388) 13284 : cluster [DBG] pgmap v9209: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:30.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:18:30.975 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:18:30.975 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:18:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:30 smithi163 bash[24253]: cluster 2024-08-31T07:18:29.754801+0000 mgr.a (mgr.14388) 13285 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:30 smithi027 bash[22610]: cluster 2024-08-31T07:18:29.754801+0000 mgr.a (mgr.14388) 13285 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:30 smithi191 bash[24992]: cluster 2024-08-31T07:18:29.754801+0000 mgr.a (mgr.14388) 13285 : cluster [DBG] pgmap v9210: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:31.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:18:31.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:18:31.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:18:31.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:18:31.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:18:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:32 smithi163 bash[24253]: audit 2024-08-31T07:18:31.310186+0000 mgr.a (mgr.14388) 13286 : audit [DBG] from='client.289803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:32 smithi163 bash[24253]: cluster 2024-08-31T07:18:31.755411+0000 mgr.a (mgr.14388) 13287 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:32 smithi027 bash[22610]: audit 2024-08-31T07:18:31.310186+0000 mgr.a (mgr.14388) 13286 : audit [DBG] from='client.289803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:32 smithi027 bash[22610]: cluster 2024-08-31T07:18:31.755411+0000 mgr.a (mgr.14388) 13287 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:32 smithi191 bash[24992]: audit 2024-08-31T07:18:31.310186+0000 mgr.a (mgr.14388) 13286 : audit [DBG] from='client.289803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:32 smithi191 bash[24992]: cluster 2024-08-31T07:18:31.755411+0000 mgr.a (mgr.14388) 13287 : cluster [DBG] pgmap v9211: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:34 smithi163 bash[24253]: cluster 2024-08-31T07:18:33.757615+0000 mgr.a (mgr.14388) 13288 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:34 smithi027 bash[22610]: cluster 2024-08-31T07:18:33.757615+0000 mgr.a (mgr.14388) 13288 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:34 smithi191 bash[24992]: cluster 2024-08-31T07:18:33.757615+0000 mgr.a (mgr.14388) 13288 : cluster [DBG] pgmap v9212: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:36.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:18:36.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:18:36.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:18:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:36 smithi163 bash[24253]: cluster 2024-08-31T07:18:35.758387+0000 mgr.a (mgr.14388) 13289 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:36 smithi027 bash[22610]: cluster 2024-08-31T07:18:35.758387+0000 mgr.a (mgr.14388) 13289 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:36 smithi191 bash[24992]: cluster 2024-08-31T07:18:35.758387+0000 mgr.a (mgr.14388) 13289 : cluster [DBG] pgmap v9213: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:37.472 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:18:37.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:18:37.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:18:37.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:18:37.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:18:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:38 smithi163 bash[24253]: audit 2024-08-31T07:18:37.054524+0000 mgr.a (mgr.14388) 13290 : audit [DBG] from='client.289881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:38 smithi163 bash[24253]: cluster 2024-08-31T07:18:37.759320+0000 mgr.a (mgr.14388) 13291 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:38 smithi027 bash[22610]: audit 2024-08-31T07:18:37.054524+0000 mgr.a (mgr.14388) 13290 : audit [DBG] from='client.289881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:38 smithi027 bash[22610]: cluster 2024-08-31T07:18:37.759320+0000 mgr.a (mgr.14388) 13291 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:38 smithi191 bash[24992]: audit 2024-08-31T07:18:37.054524+0000 mgr.a (mgr.14388) 13290 : audit [DBG] from='client.289881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:38 smithi191 bash[24992]: cluster 2024-08-31T07:18:37.759320+0000 mgr.a (mgr.14388) 13291 : cluster [DBG] pgmap v9214: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:40 smithi163 bash[24253]: cluster 2024-08-31T07:18:39.761566+0000 mgr.a (mgr.14388) 13292 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:40 smithi027 bash[22610]: cluster 2024-08-31T07:18:39.761566+0000 mgr.a (mgr.14388) 13292 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:40 smithi191 bash[24992]: cluster 2024-08-31T07:18:39.761566+0000 mgr.a (mgr.14388) 13292 : cluster [DBG] pgmap v9215: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:18:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:18:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:18:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:18:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:42 smithi163 bash[24253]: cluster 2024-08-31T07:18:41.762343+0000 mgr.a (mgr.14388) 13293 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:42 smithi027 bash[22610]: cluster 2024-08-31T07:18:41.762343+0000 mgr.a (mgr.14388) 13293 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:43.254 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:18:43.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:18:43.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:18:43.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:18:43.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:18:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:42 smithi191 bash[24992]: cluster 2024-08-31T07:18:41.762343+0000 mgr.a (mgr.14388) 13293 : cluster [DBG] pgmap v9216: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:43 smithi163 bash[24253]: audit 2024-08-31T07:18:42.809126+0000 mgr.a (mgr.14388) 13294 : audit [DBG] from='client.289959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:43 smithi027 bash[22610]: audit 2024-08-31T07:18:42.809126+0000 mgr.a (mgr.14388) 13294 : audit [DBG] from='client.289959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:43 smithi191 bash[24992]: audit 2024-08-31T07:18:42.809126+0000 mgr.a (mgr.14388) 13294 : audit [DBG] from='client.289959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:44 smithi163 bash[24253]: cluster 2024-08-31T07:18:43.765276+0000 mgr.a (mgr.14388) 13295 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:44 smithi027 bash[22610]: cluster 2024-08-31T07:18:43.765276+0000 mgr.a (mgr.14388) 13295 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:44 smithi191 bash[24992]: cluster 2024-08-31T07:18:43.765276+0000 mgr.a (mgr.14388) 13295 : cluster [DBG] pgmap v9217: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:46 smithi163 bash[24253]: cluster 2024-08-31T07:18:45.766049+0000 mgr.a (mgr.14388) 13296 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:18:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:46 smithi027 bash[22610]: cluster 2024-08-31T07:18:45.766049+0000 mgr.a (mgr.14388) 13296 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:18:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:46 smithi191 bash[24992]: cluster 2024-08-31T07:18:45.766049+0000 mgr.a (mgr.14388) 13296 : cluster [DBG] pgmap v9218: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:18:48.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:18:48.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:18:48.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:18:49.035 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:18:49.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:18:49.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:18:49.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:18:49.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:18:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:48 smithi163 bash[24253]: cluster 2024-08-31T07:18:47.766860+0000 mgr.a (mgr.14388) 13297 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:18:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:48 smithi027 bash[22610]: cluster 2024-08-31T07:18:47.766860+0000 mgr.a (mgr.14388) 13297 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:18:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:48 smithi191 bash[24992]: cluster 2024-08-31T07:18:47.766860+0000 mgr.a (mgr.14388) 13297 : cluster [DBG] pgmap v9219: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:18:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:49 smithi163 bash[24253]: audit 2024-08-31T07:18:48.595599+0000 mgr.a (mgr.14388) 13298 : audit [DBG] from='client.290034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:50.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:49 smithi027 bash[22610]: audit 2024-08-31T07:18:48.595599+0000 mgr.a (mgr.14388) 13298 : audit [DBG] from='client.290034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:49 smithi191 bash[24992]: audit 2024-08-31T07:18:48.595599+0000 mgr.a (mgr.14388) 13298 : audit [DBG] from='client.290034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:50 smithi027 bash[22610]: cluster 2024-08-31T07:18:49.769648+0000 mgr.a (mgr.14388) 13299 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:50 smithi191 bash[24992]: cluster 2024-08-31T07:18:49.769648+0000 mgr.a (mgr.14388) 13299 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:50 smithi163 bash[24253]: cluster 2024-08-31T07:18:49.769648+0000 mgr.a (mgr.14388) 13299 : cluster [DBG] pgmap v9220: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:52 smithi027 bash[22610]: cluster 2024-08-31T07:18:51.770407+0000 mgr.a (mgr.14388) 13300 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:18:53.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:52 smithi191 bash[24992]: cluster 2024-08-31T07:18:51.770407+0000 mgr.a (mgr.14388) 13300 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:18:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:52 smithi163 bash[24253]: cluster 2024-08-31T07:18:51.770407+0000 mgr.a (mgr.14388) 13300 : cluster [DBG] pgmap v9221: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:18:54.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:18:54.037 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:18:54.037 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:18:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:53 smithi027 bash[22610]: audit 2024-08-31T07:18:53.239960+0000 mon.a (mon.0) 2568 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:18:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:53 smithi191 bash[24992]: audit 2024-08-31T07:18:53.239960+0000 mon.a (mon.0) 2568 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:18:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:53 smithi163 bash[24253]: audit 2024-08-31T07:18:53.239960+0000 mon.a (mon.0) 2568 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:18:55.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:18:54 smithi027 bash[22863]: debug 2024-08-31T07:18:54.836+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:18:55.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:18:54 smithi027 bash[22863]: debug 2024-08-31T07:18:54.848+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:18:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:54 smithi027 bash[22610]: cluster 2024-08-31T07:18:53.772374+0000 mgr.a (mgr.14388) 13301 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:54 smithi027 bash[22610]: audit 2024-08-31T07:18:54.091979+0000 mon.a (mon.0) 2569 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:18:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:54 smithi027 bash[22610]: audit 2024-08-31T07:18:54.093414+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:18:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:54 smithi027 bash[22610]: audit 2024-08-31T07:18:54.103627+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:18:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:54 smithi027 bash[22610]: audit 2024-08-31T07:18:54.106606+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:18:55.253 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:18:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:18:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:18:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:18:55.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:18:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:54 smithi191 bash[24992]: cluster 2024-08-31T07:18:53.772374+0000 mgr.a (mgr.14388) 13301 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:54 smithi191 bash[24992]: audit 2024-08-31T07:18:54.091979+0000 mon.a (mon.0) 2569 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:18:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:54 smithi191 bash[24992]: audit 2024-08-31T07:18:54.093414+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:18:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:54 smithi191 bash[24992]: audit 2024-08-31T07:18:54.103627+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:18:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:54 smithi191 bash[24992]: audit 2024-08-31T07:18:54.106606+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:18:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:54 smithi163 bash[24253]: cluster 2024-08-31T07:18:53.772374+0000 mgr.a (mgr.14388) 13301 : cluster [DBG] pgmap v9222: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:54 smithi163 bash[24253]: audit 2024-08-31T07:18:54.091979+0000 mon.a (mon.0) 2569 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:18:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:54 smithi163 bash[24253]: audit 2024-08-31T07:18:54.093414+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:18:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:54 smithi163 bash[24253]: audit 2024-08-31T07:18:54.103627+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:18:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:54 smithi163 bash[24253]: audit 2024-08-31T07:18:54.106606+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:18:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:55 smithi027 bash[22610]: audit 2024-08-31T07:18:54.107875+0000 mgr.a (mgr.14388) 13302 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:18:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:55 smithi027 bash[22610]: audit 2024-08-31T07:18:54.401685+0000 mgr.a (mgr.14388) 13303 : audit [DBG] from='client.290109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:55 smithi027 bash[22610]: audit 2024-08-31T07:18:54.840039+0000 mgr.a (mgr.14388) 13304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:18:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:55 smithi027 bash[22610]: cephadm 2024-08-31T07:18:54.853551+0000 mgr.a (mgr.14388) 13305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:18:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:55 smithi191 bash[24992]: audit 2024-08-31T07:18:54.107875+0000 mgr.a (mgr.14388) 13302 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:18:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:55 smithi191 bash[24992]: audit 2024-08-31T07:18:54.401685+0000 mgr.a (mgr.14388) 13303 : audit [DBG] from='client.290109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:55 smithi191 bash[24992]: audit 2024-08-31T07:18:54.840039+0000 mgr.a (mgr.14388) 13304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:18:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:55 smithi191 bash[24992]: cephadm 2024-08-31T07:18:54.853551+0000 mgr.a (mgr.14388) 13305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:18:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:55 smithi163 bash[24253]: audit 2024-08-31T07:18:54.107875+0000 mgr.a (mgr.14388) 13302 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:18:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:55 smithi163 bash[24253]: audit 2024-08-31T07:18:54.401685+0000 mgr.a (mgr.14388) 13303 : audit [DBG] from='client.290109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:18:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:55 smithi163 bash[24253]: audit 2024-08-31T07:18:54.840039+0000 mgr.a (mgr.14388) 13304 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:18:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:55 smithi163 bash[24253]: cephadm 2024-08-31T07:18:54.853551+0000 mgr.a (mgr.14388) 13305 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:18:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:56 smithi027 bash[22610]: cluster 2024-08-31T07:18:55.773320+0000 mgr.a (mgr.14388) 13306 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:56 smithi191 bash[24992]: cluster 2024-08-31T07:18:55.773320+0000 mgr.a (mgr.14388) 13306 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:56 smithi163 bash[24253]: cluster 2024-08-31T07:18:55.773320+0000 mgr.a (mgr.14388) 13306 : cluster [DBG] pgmap v9223: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:18:58 smithi191 bash[24992]: cluster 2024-08-31T07:18:57.774146+0000 mgr.a (mgr.14388) 13307 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:18:58 smithi163 bash[24253]: cluster 2024-08-31T07:18:57.774146+0000 mgr.a (mgr.14388) 13307 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:18:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:18:58 smithi027 bash[22610]: cluster 2024-08-31T07:18:57.774146+0000 mgr.a (mgr.14388) 13307 : cluster [DBG] pgmap v9224: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:00.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:00.256 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:00.256 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:01.011 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:01.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:01.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:01.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:01.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:00 smithi163 bash[24253]: cluster 2024-08-31T07:18:59.776350+0000 mgr.a (mgr.14388) 13308 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:00 smithi027 bash[22610]: cluster 2024-08-31T07:18:59.776350+0000 mgr.a (mgr.14388) 13308 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:00 smithi191 bash[24992]: cluster 2024-08-31T07:18:59.776350+0000 mgr.a (mgr.14388) 13308 : cluster [DBG] pgmap v9225: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:01 smithi163 bash[24253]: audit 2024-08-31T07:19:00.586494+0000 mgr.a (mgr.14388) 13309 : audit [DBG] from='client.290286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:01 smithi027 bash[22610]: audit 2024-08-31T07:19:00.586494+0000 mgr.a (mgr.14388) 13309 : audit [DBG] from='client.290286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:01 smithi191 bash[24992]: audit 2024-08-31T07:19:00.586494+0000 mgr.a (mgr.14388) 13309 : audit [DBG] from='client.290286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:02 smithi163 bash[24253]: cluster 2024-08-31T07:19:01.777329+0000 mgr.a (mgr.14388) 13310 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:03.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:02 smithi027 bash[22610]: cluster 2024-08-31T07:19:01.777329+0000 mgr.a (mgr.14388) 13310 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:03.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:02 smithi191 bash[24992]: cluster 2024-08-31T07:19:01.777329+0000 mgr.a (mgr.14388) 13310 : cluster [DBG] pgmap v9226: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:04 smithi163 bash[24253]: cluster 2024-08-31T07:19:03.779559+0000 mgr.a (mgr.14388) 13311 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:04 smithi027 bash[22610]: cluster 2024-08-31T07:19:03.779559+0000 mgr.a (mgr.14388) 13311 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:04 smithi191 bash[24992]: cluster 2024-08-31T07:19:03.779559+0000 mgr.a (mgr.14388) 13311 : cluster [DBG] pgmap v9227: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:06.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:06.013 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:06.013 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:06.759 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:06.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:06.760 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:06 smithi163 bash[24253]: cluster 2024-08-31T07:19:05.780312+0000 mgr.a (mgr.14388) 13312 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:06 smithi027 bash[22610]: cluster 2024-08-31T07:19:05.780312+0000 mgr.a (mgr.14388) 13312 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:06 smithi191 bash[24992]: cluster 2024-08-31T07:19:05.780312+0000 mgr.a (mgr.14388) 13312 : cluster [DBG] pgmap v9228: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:07 smithi163 bash[24253]: audit 2024-08-31T07:19:06.340168+0000 mgr.a (mgr.14388) 13313 : audit [DBG] from='client.290364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:07 smithi027 bash[22610]: audit 2024-08-31T07:19:06.340168+0000 mgr.a (mgr.14388) 13313 : audit [DBG] from='client.290364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:07 smithi191 bash[24992]: audit 2024-08-31T07:19:06.340168+0000 mgr.a (mgr.14388) 13313 : audit [DBG] from='client.290364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:08 smithi163 bash[24253]: cluster 2024-08-31T07:19:07.781206+0000 mgr.a (mgr.14388) 13314 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:08 smithi027 bash[22610]: cluster 2024-08-31T07:19:07.781206+0000 mgr.a (mgr.14388) 13314 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:08 smithi191 bash[24992]: cluster 2024-08-31T07:19:07.781206+0000 mgr.a (mgr.14388) 13314 : cluster [DBG] pgmap v9229: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:10 smithi163 bash[24253]: cluster 2024-08-31T07:19:09.783480+0000 mgr.a (mgr.14388) 13315 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:10 smithi027 bash[22610]: cluster 2024-08-31T07:19:09.783480+0000 mgr.a (mgr.14388) 13315 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:10 smithi191 bash[24992]: cluster 2024-08-31T07:19:09.783480+0000 mgr.a (mgr.14388) 13315 : cluster [DBG] pgmap v9230: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:19:11.761 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:11.761 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:11.762 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:12.519 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:12.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:12.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:12.519 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:12.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:12 smithi163 bash[24253]: cluster 2024-08-31T07:19:11.784276+0000 mgr.a (mgr.14388) 13316 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:12 smithi027 bash[22610]: cluster 2024-08-31T07:19:11.784276+0000 mgr.a (mgr.14388) 13316 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:12 smithi191 bash[24992]: cluster 2024-08-31T07:19:11.784276+0000 mgr.a (mgr.14388) 13316 : cluster [DBG] pgmap v9231: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:13 smithi163 bash[24253]: audit 2024-08-31T07:19:12.090948+0000 mgr.a (mgr.14388) 13317 : audit [DBG] from='client.290442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:13 smithi027 bash[22610]: audit 2024-08-31T07:19:12.090948+0000 mgr.a (mgr.14388) 13317 : audit [DBG] from='client.290442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:13 smithi191 bash[24992]: audit 2024-08-31T07:19:12.090948+0000 mgr.a (mgr.14388) 13317 : audit [DBG] from='client.290442 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:14 smithi163 bash[24253]: cluster 2024-08-31T07:19:13.786549+0000 mgr.a (mgr.14388) 13318 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:14 smithi027 bash[22610]: cluster 2024-08-31T07:19:13.786549+0000 mgr.a (mgr.14388) 13318 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:14 smithi191 bash[24992]: cluster 2024-08-31T07:19:13.786549+0000 mgr.a (mgr.14388) 13318 : cluster [DBG] pgmap v9232: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:16 smithi163 bash[24253]: cluster 2024-08-31T07:19:15.787325+0000 mgr.a (mgr.14388) 13319 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:16 smithi027 bash[22610]: cluster 2024-08-31T07:19:15.787325+0000 mgr.a (mgr.14388) 13319 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:16 smithi191 bash[24992]: cluster 2024-08-31T07:19:15.787325+0000 mgr.a (mgr.14388) 13319 : cluster [DBG] pgmap v9233: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:17.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:17.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:17.521 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:18.305 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:18.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:18.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:18.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:18.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:18 smithi163 bash[24253]: cluster 2024-08-31T07:19:17.788040+0000 mgr.a (mgr.14388) 13320 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:18 smithi163 bash[24253]: audit 2024-08-31T07:19:17.860159+0000 mgr.a (mgr.14388) 13321 : audit [DBG] from='client.290514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:18 smithi027 bash[22610]: cluster 2024-08-31T07:19:17.788040+0000 mgr.a (mgr.14388) 13320 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:18 smithi027 bash[22610]: audit 2024-08-31T07:19:17.860159+0000 mgr.a (mgr.14388) 13321 : audit [DBG] from='client.290514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:18 smithi191 bash[24992]: cluster 2024-08-31T07:19:17.788040+0000 mgr.a (mgr.14388) 13320 : cluster [DBG] pgmap v9234: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:18 smithi191 bash[24992]: audit 2024-08-31T07:19:17.860159+0000 mgr.a (mgr.14388) 13321 : audit [DBG] from='client.290514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:20 smithi163 bash[24253]: cluster 2024-08-31T07:19:19.790815+0000 mgr.a (mgr.14388) 13322 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:20 smithi027 bash[22610]: cluster 2024-08-31T07:19:19.790815+0000 mgr.a (mgr.14388) 13322 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:20 smithi191 bash[24992]: cluster 2024-08-31T07:19:19.790815+0000 mgr.a (mgr.14388) 13322 : cluster [DBG] pgmap v9235: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:22 smithi163 bash[24253]: cluster 2024-08-31T07:19:21.791613+0000 mgr.a (mgr.14388) 13323 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:19:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:22 smithi027 bash[22610]: cluster 2024-08-31T07:19:21.791613+0000 mgr.a (mgr.14388) 13323 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:19:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:22 smithi191 bash[24992]: cluster 2024-08-31T07:19:21.791613+0000 mgr.a (mgr.14388) 13323 : cluster [DBG] pgmap v9236: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:19:23.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:23.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:23.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:24.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:24.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:24.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:24.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:24.059 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:24 smithi163 bash[24253]: audit 2024-08-31T07:19:23.641968+0000 mgr.a (mgr.14388) 13324 : audit [DBG] from='client.290592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:24 smithi163 bash[24253]: cluster 2024-08-31T07:19:23.792925+0000 mgr.a (mgr.14388) 13325 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:24 smithi027 bash[22610]: audit 2024-08-31T07:19:23.641968+0000 mgr.a (mgr.14388) 13324 : audit [DBG] from='client.290592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:24 smithi027 bash[22610]: cluster 2024-08-31T07:19:23.792925+0000 mgr.a (mgr.14388) 13325 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:24 smithi191 bash[24992]: audit 2024-08-31T07:19:23.641968+0000 mgr.a (mgr.14388) 13324 : audit [DBG] from='client.290592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:24 smithi191 bash[24992]: cluster 2024-08-31T07:19:23.792925+0000 mgr.a (mgr.14388) 13325 : cluster [DBG] pgmap v9237: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:26 smithi163 bash[24253]: cluster 2024-08-31T07:19:25.793930+0000 mgr.a (mgr.14388) 13326 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:19:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:26 smithi027 bash[22610]: cluster 2024-08-31T07:19:25.793930+0000 mgr.a (mgr.14388) 13326 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:19:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:26 smithi191 bash[24992]: cluster 2024-08-31T07:19:25.793930+0000 mgr.a (mgr.14388) 13326 : cluster [DBG] pgmap v9238: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:19:29.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:29.061 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:29.061 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:28 smithi163 bash[24253]: cluster 2024-08-31T07:19:27.794932+0000 mgr.a (mgr.14388) 13327 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:19:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:28 smithi027 bash[22610]: cluster 2024-08-31T07:19:27.794932+0000 mgr.a (mgr.14388) 13327 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:19:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:28 smithi191 bash[24992]: cluster 2024-08-31T07:19:27.794932+0000 mgr.a (mgr.14388) 13327 : cluster [DBG] pgmap v9239: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:19:29.841 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:29.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:29.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:29.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:29.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:30 smithi163 bash[24253]: audit 2024-08-31T07:19:29.399643+0000 mgr.a (mgr.14388) 13328 : audit [DBG] from='client.290667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:30 smithi163 bash[24253]: cluster 2024-08-31T07:19:29.796317+0000 mgr.a (mgr.14388) 13329 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:30 smithi027 bash[22610]: audit 2024-08-31T07:19:29.399643+0000 mgr.a (mgr.14388) 13328 : audit [DBG] from='client.290667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:30 smithi027 bash[22610]: cluster 2024-08-31T07:19:29.796317+0000 mgr.a (mgr.14388) 13329 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:30 smithi191 bash[24992]: audit 2024-08-31T07:19:29.399643+0000 mgr.a (mgr.14388) 13328 : audit [DBG] from='client.290667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:30 smithi191 bash[24992]: cluster 2024-08-31T07:19:29.796317+0000 mgr.a (mgr.14388) 13329 : cluster [DBG] pgmap v9240: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:32 smithi163 bash[24253]: cluster 2024-08-31T07:19:31.797053+0000 mgr.a (mgr.14388) 13330 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:32 smithi027 bash[22610]: cluster 2024-08-31T07:19:31.797053+0000 mgr.a (mgr.14388) 13330 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:32 smithi191 bash[24992]: cluster 2024-08-31T07:19:31.797053+0000 mgr.a (mgr.14388) 13330 : cluster [DBG] pgmap v9241: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:34.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:34.843 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:34.844 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:34 smithi163 bash[24253]: cluster 2024-08-31T07:19:33.799108+0000 mgr.a (mgr.14388) 13331 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:34 smithi027 bash[22610]: cluster 2024-08-31T07:19:33.799108+0000 mgr.a (mgr.14388) 13331 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:34 smithi191 bash[24992]: cluster 2024-08-31T07:19:33.799108+0000 mgr.a (mgr.14388) 13331 : cluster [DBG] pgmap v9242: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:35.626 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:36 smithi163 bash[24253]: audit 2024-08-31T07:19:35.179439+0000 mgr.a (mgr.14388) 13332 : audit [DBG] from='client.290745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:36 smithi163 bash[24253]: cluster 2024-08-31T07:19:35.800053+0000 mgr.a (mgr.14388) 13333 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:36 smithi027 bash[22610]: audit 2024-08-31T07:19:35.179439+0000 mgr.a (mgr.14388) 13332 : audit [DBG] from='client.290745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:36 smithi027 bash[22610]: cluster 2024-08-31T07:19:35.800053+0000 mgr.a (mgr.14388) 13333 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:36 smithi191 bash[24992]: audit 2024-08-31T07:19:35.179439+0000 mgr.a (mgr.14388) 13332 : audit [DBG] from='client.290745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:36 smithi191 bash[24992]: cluster 2024-08-31T07:19:35.800053+0000 mgr.a (mgr.14388) 13333 : cluster [DBG] pgmap v9243: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:38 smithi163 bash[24253]: cluster 2024-08-31T07:19:37.800858+0000 mgr.a (mgr.14388) 13334 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:39.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:38 smithi027 bash[22610]: cluster 2024-08-31T07:19:37.800858+0000 mgr.a (mgr.14388) 13334 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:38 smithi191 bash[24992]: cluster 2024-08-31T07:19:37.800858+0000 mgr.a (mgr.14388) 13334 : cluster [DBG] pgmap v9244: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:40.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:40.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:40.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:40 smithi163 bash[24253]: cluster 2024-08-31T07:19:39.803081+0000 mgr.a (mgr.14388) 13335 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:40 smithi027 bash[22610]: cluster 2024-08-31T07:19:39.803081+0000 mgr.a (mgr.14388) 13335 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:40 smithi191 bash[24992]: cluster 2024-08-31T07:19:39.803081+0000 mgr.a (mgr.14388) 13335 : cluster [DBG] pgmap v9245: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:41.402 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:41.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:41.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:41.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:41.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:41 smithi027 bash[22610]: audit 2024-08-31T07:19:40.964595+0000 mgr.a (mgr.14388) 13336 : audit [DBG] from='client.290823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:41 smithi191 bash[24992]: audit 2024-08-31T07:19:40.964595+0000 mgr.a (mgr.14388) 13336 : audit [DBG] from='client.290823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:41 smithi163 bash[24253]: audit 2024-08-31T07:19:40.964595+0000 mgr.a (mgr.14388) 13336 : audit [DBG] from='client.290823 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:42 smithi027 bash[22610]: cluster 2024-08-31T07:19:41.803996+0000 mgr.a (mgr.14388) 13337 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:42 smithi191 bash[24992]: cluster 2024-08-31T07:19:41.803996+0000 mgr.a (mgr.14388) 13337 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:42 smithi163 bash[24253]: cluster 2024-08-31T07:19:41.803996+0000 mgr.a (mgr.14388) 13337 : cluster [DBG] pgmap v9246: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:44 smithi027 bash[22610]: cluster 2024-08-31T07:19:43.806238+0000 mgr.a (mgr.14388) 13338 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:44 smithi191 bash[24992]: cluster 2024-08-31T07:19:43.806238+0000 mgr.a (mgr.14388) 13338 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:44 smithi163 bash[24253]: cluster 2024-08-31T07:19:43.806238+0000 mgr.a (mgr.14388) 13338 : cluster [DBG] pgmap v9247: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:46.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:46.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:46.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:47.179 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:47.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:47.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:47.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:47.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:46 smithi027 bash[22610]: cluster 2024-08-31T07:19:45.807007+0000 mgr.a (mgr.14388) 13339 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:46 smithi191 bash[24992]: cluster 2024-08-31T07:19:45.807007+0000 mgr.a (mgr.14388) 13339 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:46 smithi163 bash[24253]: cluster 2024-08-31T07:19:45.807007+0000 mgr.a (mgr.14388) 13339 : cluster [DBG] pgmap v9248: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:47 smithi027 bash[22610]: audit 2024-08-31T07:19:46.735535+0000 mgr.a (mgr.14388) 13340 : audit [DBG] from='client.290901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:47 smithi191 bash[24992]: audit 2024-08-31T07:19:46.735535+0000 mgr.a (mgr.14388) 13340 : audit [DBG] from='client.290901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:47 smithi163 bash[24253]: audit 2024-08-31T07:19:46.735535+0000 mgr.a (mgr.14388) 13340 : audit [DBG] from='client.290901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:48 smithi027 bash[22610]: cluster 2024-08-31T07:19:47.807894+0000 mgr.a (mgr.14388) 13341 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:49.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:48 smithi191 bash[24992]: cluster 2024-08-31T07:19:47.807894+0000 mgr.a (mgr.14388) 13341 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:48 smithi163 bash[24253]: cluster 2024-08-31T07:19:47.807894+0000 mgr.a (mgr.14388) 13341 : cluster [DBG] pgmap v9249: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:50 smithi027 bash[22610]: cluster 2024-08-31T07:19:49.810109+0000 mgr.a (mgr.14388) 13342 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:51.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:50 smithi191 bash[24992]: cluster 2024-08-31T07:19:49.810109+0000 mgr.a (mgr.14388) 13342 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:50 smithi163 bash[24253]: cluster 2024-08-31T07:19:49.810109+0000 mgr.a (mgr.14388) 13342 : cluster [DBG] pgmap v9250: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:19:52.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:52.181 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:52.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:52.933 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:52.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:52.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:52.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:52.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:52 smithi027 bash[22610]: cluster 2024-08-31T07:19:51.810936+0000 mgr.a (mgr.14388) 13343 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:53.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:52 smithi191 bash[24992]: cluster 2024-08-31T07:19:51.810936+0000 mgr.a (mgr.14388) 13343 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:52 smithi163 bash[24253]: cluster 2024-08-31T07:19:51.810936+0000 mgr.a (mgr.14388) 13343 : cluster [DBG] pgmap v9251: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:19:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:53 smithi027 bash[22610]: audit 2024-08-31T07:19:52.511220+0000 mgr.a (mgr.14388) 13344 : audit [DBG] from='client.290979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:53 smithi191 bash[24992]: audit 2024-08-31T07:19:52.511220+0000 mgr.a (mgr.14388) 13344 : audit [DBG] from='client.290979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:53 smithi163 bash[24253]: audit 2024-08-31T07:19:52.511220+0000 mgr.a (mgr.14388) 13344 : audit [DBG] from='client.290979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:19:55.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:54 smithi191 bash[24992]: cluster 2024-08-31T07:19:53.813256+0000 mgr.a (mgr.14388) 13345 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T07:19:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:54 smithi191 bash[24992]: audit 2024-08-31T07:19:54.911927+0000 mon.a (mon.0) 2573 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:19:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:54 smithi163 bash[24253]: cluster 2024-08-31T07:19:53.813256+0000 mgr.a (mgr.14388) 13345 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T07:19:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:54 smithi163 bash[24253]: audit 2024-08-31T07:19:54.911927+0000 mon.a (mon.0) 2573 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:19:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:54 smithi027 bash[22610]: cluster 2024-08-31T07:19:53.813256+0000 mgr.a (mgr.14388) 13345 : cluster [DBG] pgmap v9252: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T07:19:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:54 smithi027 bash[22610]: audit 2024-08-31T07:19:54.911927+0000 mon.a (mon.0) 2573 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:19:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:55 smithi191 bash[24992]: audit 2024-08-31T07:19:55.716182+0000 mon.a (mon.0) 2574 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:19:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:55 smithi191 bash[24992]: audit 2024-08-31T07:19:55.717307+0000 mon.a (mon.0) 2575 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:19:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:55 smithi191 bash[24992]: audit 2024-08-31T07:19:55.727376+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:19:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:55 smithi191 bash[24992]: audit 2024-08-31T07:19:55.729704+0000 mon.a (mon.0) 2577 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:19:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:55 smithi191 bash[24992]: audit 2024-08-31T07:19:55.731993+0000 mgr.a (mgr.14388) 13346 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:19:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:55 smithi191 bash[24992]: cluster 2024-08-31T07:19:55.813927+0000 mgr.a (mgr.14388) 13347 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T07:19:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:55 smithi163 bash[24253]: audit 2024-08-31T07:19:55.716182+0000 mon.a (mon.0) 2574 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:19:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:55 smithi163 bash[24253]: audit 2024-08-31T07:19:55.717307+0000 mon.a (mon.0) 2575 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:19:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:55 smithi163 bash[24253]: audit 2024-08-31T07:19:55.727376+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:19:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:55 smithi163 bash[24253]: audit 2024-08-31T07:19:55.729704+0000 mon.a (mon.0) 2577 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:19:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:55 smithi163 bash[24253]: audit 2024-08-31T07:19:55.731993+0000 mgr.a (mgr.14388) 13346 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:19:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:55 smithi163 bash[24253]: cluster 2024-08-31T07:19:55.813927+0000 mgr.a (mgr.14388) 13347 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T07:19:56.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:55 smithi027 bash[22610]: audit 2024-08-31T07:19:55.716182+0000 mon.a (mon.0) 2574 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:19:56.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:55 smithi027 bash[22610]: audit 2024-08-31T07:19:55.717307+0000 mon.a (mon.0) 2575 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:19:56.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:55 smithi027 bash[22610]: audit 2024-08-31T07:19:55.727376+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:19:56.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:55 smithi027 bash[22610]: audit 2024-08-31T07:19:55.729704+0000 mon.a (mon.0) 2577 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:19:56.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:55 smithi027 bash[22610]: audit 2024-08-31T07:19:55.731993+0000 mgr.a (mgr.14388) 13346 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:19:56.479 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:55 smithi027 bash[22610]: cluster 2024-08-31T07:19:55.813927+0000 mgr.a (mgr.14388) 13347 : cluster [DBG] pgmap v9253: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T07:19:56.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:19:56 smithi027 bash[22863]: debug 2024-08-31T07:19:56.474+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:19:56.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:19:56 smithi027 bash[22863]: debug 2024-08-31T07:19:56.478+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:19:57.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:19:57.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:19:57.936 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:19:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:57 smithi027 bash[22610]: audit 2024-08-31T07:19:56.478444+0000 mgr.a (mgr.14388) 13348 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:19:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:57 smithi027 bash[22610]: cephadm 2024-08-31T07:19:56.480066+0000 mgr.a (mgr.14388) 13349 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:19:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:57 smithi191 bash[24992]: audit 2024-08-31T07:19:56.478444+0000 mgr.a (mgr.14388) 13348 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:19:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:57 smithi191 bash[24992]: cephadm 2024-08-31T07:19:56.480066+0000 mgr.a (mgr.14388) 13349 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:19:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:57 smithi163 bash[24253]: audit 2024-08-31T07:19:56.478444+0000 mgr.a (mgr.14388) 13348 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:19:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:57 smithi163 bash[24253]: cephadm 2024-08-31T07:19:56.480066+0000 mgr.a (mgr.14388) 13349 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:19:58.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:19:58.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:19:58.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:19:58.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:19:58.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:19:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:58 smithi191 bash[24992]: cluster 2024-08-31T07:19:57.814841+0000 mgr.a (mgr.14388) 13350 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T07:19:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:58 smithi163 bash[24253]: cluster 2024-08-31T07:19:57.814841+0000 mgr.a (mgr.14388) 13350 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T07:19:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:58 smithi027 bash[22610]: cluster 2024-08-31T07:19:57.814841+0000 mgr.a (mgr.14388) 13350 : cluster [DBG] pgmap v9254: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T07:20:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:19:59 smithi191 bash[24992]: audit 2024-08-31T07:19:58.265316+0000 mgr.a (mgr.14388) 13351 : audit [DBG] from='client.291162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:19:59 smithi163 bash[24253]: audit 2024-08-31T07:19:58.265316+0000 mgr.a (mgr.14388) 13351 : audit [DBG] from='client.291162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:19:59 smithi027 bash[22610]: audit 2024-08-31T07:19:58.265316+0000 mgr.a (mgr.14388) 13351 : audit [DBG] from='client.291162 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:00 smithi191 bash[24992]: cluster 2024-08-31T07:19:59.817571+0000 mgr.a (mgr.14388) 13352 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:20:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:00 smithi191 bash[24992]: cluster 2024-08-31T07:20:00.000130+0000 mon.a (mon.0) 2578 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:20:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:00 smithi163 bash[24253]: cluster 2024-08-31T07:19:59.817571+0000 mgr.a (mgr.14388) 13352 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:20:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:00 smithi163 bash[24253]: cluster 2024-08-31T07:20:00.000130+0000 mon.a (mon.0) 2578 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:20:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:00 smithi027 bash[22610]: cluster 2024-08-31T07:19:59.817571+0000 mgr.a (mgr.14388) 13352 : cluster [DBG] pgmap v9255: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:20:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:00 smithi027 bash[22610]: cluster 2024-08-31T07:20:00.000130+0000 mon.a (mon.0) 2578 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:20:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:02 smithi163 bash[24253]: cluster 2024-08-31T07:20:01.818426+0000 mgr.a (mgr.14388) 13353 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:20:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:02 smithi027 bash[22610]: cluster 2024-08-31T07:20:01.818426+0000 mgr.a (mgr.14388) 13353 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:20:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:02 smithi191 bash[24992]: cluster 2024-08-31T07:20:01.818426+0000 mgr.a (mgr.14388) 13353 : cluster [DBG] pgmap v9256: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:20:03.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:20:03.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:20:03.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:20:04.456 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:20:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:20:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:20:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:20:04.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:20:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:04 smithi163 bash[24253]: cluster 2024-08-31T07:20:03.819889+0000 mgr.a (mgr.14388) 13354 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:20:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:04 smithi027 bash[22610]: cluster 2024-08-31T07:20:03.819889+0000 mgr.a (mgr.14388) 13354 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:20:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:04 smithi191 bash[24992]: cluster 2024-08-31T07:20:03.819889+0000 mgr.a (mgr.14388) 13354 : cluster [DBG] pgmap v9257: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:20:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:05 smithi163 bash[24253]: audit 2024-08-31T07:20:04.016641+0000 mgr.a (mgr.14388) 13355 : audit [DBG] from='client.291240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:05 smithi027 bash[22610]: audit 2024-08-31T07:20:04.016641+0000 mgr.a (mgr.14388) 13355 : audit [DBG] from='client.291240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:05 smithi191 bash[24992]: audit 2024-08-31T07:20:04.016641+0000 mgr.a (mgr.14388) 13355 : audit [DBG] from='client.291240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:06 smithi163 bash[24253]: cluster 2024-08-31T07:20:05.820741+0000 mgr.a (mgr.14388) 13356 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:20:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:06 smithi027 bash[22610]: cluster 2024-08-31T07:20:05.820741+0000 mgr.a (mgr.14388) 13356 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:20:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:06 smithi191 bash[24992]: cluster 2024-08-31T07:20:05.820741+0000 mgr.a (mgr.14388) 13356 : cluster [DBG] pgmap v9258: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:20:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:08 smithi163 bash[24253]: cluster 2024-08-31T07:20:07.821490+0000 mgr.a (mgr.14388) 13357 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:20:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:08 smithi027 bash[22610]: cluster 2024-08-31T07:20:07.821490+0000 mgr.a (mgr.14388) 13357 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:20:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:08 smithi191 bash[24992]: cluster 2024-08-31T07:20:07.821490+0000 mgr.a (mgr.14388) 13357 : cluster [DBG] pgmap v9259: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:20:09.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:20:09.458 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:20:09.458 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:20:10.206 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:20:10.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:20:10.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:20:10.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:20:10.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:20:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:10 smithi163 bash[24253]: audit 2024-08-31T07:20:09.786611+0000 mgr.a (mgr.14388) 13358 : audit [DBG] from='client.291315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:10 smithi163 bash[24253]: cluster 2024-08-31T07:20:09.824537+0000 mgr.a (mgr.14388) 13359 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:20:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:10 smithi027 bash[22610]: audit 2024-08-31T07:20:09.786611+0000 mgr.a (mgr.14388) 13358 : audit [DBG] from='client.291315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:10 smithi027 bash[22610]: cluster 2024-08-31T07:20:09.824537+0000 mgr.a (mgr.14388) 13359 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:20:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:10 smithi191 bash[24992]: audit 2024-08-31T07:20:09.786611+0000 mgr.a (mgr.14388) 13358 : audit [DBG] from='client.291315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:10 smithi191 bash[24992]: cluster 2024-08-31T07:20:09.824537+0000 mgr.a (mgr.14388) 13359 : cluster [DBG] pgmap v9260: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:20:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:12 smithi163 bash[24253]: cluster 2024-08-31T07:20:11.825467+0000 mgr.a (mgr.14388) 13360 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:12 smithi027 bash[22610]: cluster 2024-08-31T07:20:11.825467+0000 mgr.a (mgr.14388) 13360 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:12 smithi191 bash[24992]: cluster 2024-08-31T07:20:11.825467+0000 mgr.a (mgr.14388) 13360 : cluster [DBG] pgmap v9261: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:14 smithi163 bash[24253]: cluster 2024-08-31T07:20:13.827691+0000 mgr.a (mgr.14388) 13361 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:15.208 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:20:15.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:20:15.209 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:20:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:14 smithi027 bash[22610]: cluster 2024-08-31T07:20:13.827691+0000 mgr.a (mgr.14388) 13361 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:14 smithi191 bash[24992]: cluster 2024-08-31T07:20:13.827691+0000 mgr.a (mgr.14388) 13361 : cluster [DBG] pgmap v9262: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:15.956 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:20:15.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:20:15.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:20:15.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:20:15.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:20:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:16 smithi163 bash[24253]: audit 2024-08-31T07:20:15.540724+0000 mgr.a (mgr.14388) 13362 : audit [DBG] from='client.291393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:16 smithi163 bash[24253]: cluster 2024-08-31T07:20:15.828235+0000 mgr.a (mgr.14388) 13363 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:16 smithi027 bash[22610]: audit 2024-08-31T07:20:15.540724+0000 mgr.a (mgr.14388) 13362 : audit [DBG] from='client.291393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:16 smithi027 bash[22610]: cluster 2024-08-31T07:20:15.828235+0000 mgr.a (mgr.14388) 13363 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:16 smithi191 bash[24992]: audit 2024-08-31T07:20:15.540724+0000 mgr.a (mgr.14388) 13362 : audit [DBG] from='client.291393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:16 smithi191 bash[24992]: cluster 2024-08-31T07:20:15.828235+0000 mgr.a (mgr.14388) 13363 : cluster [DBG] pgmap v9263: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:18 smithi163 bash[24253]: cluster 2024-08-31T07:20:17.829090+0000 mgr.a (mgr.14388) 13364 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:18 smithi027 bash[22610]: cluster 2024-08-31T07:20:17.829090+0000 mgr.a (mgr.14388) 13364 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:19.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:18 smithi191 bash[24992]: cluster 2024-08-31T07:20:17.829090+0000 mgr.a (mgr.14388) 13364 : cluster [DBG] pgmap v9264: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:20.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:20:20.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:20:20.959 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:20:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:20 smithi163 bash[24253]: cluster 2024-08-31T07:20:19.831345+0000 mgr.a (mgr.14388) 13365 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:20 smithi027 bash[22610]: cluster 2024-08-31T07:20:19.831345+0000 mgr.a (mgr.14388) 13365 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:20 smithi191 bash[24992]: cluster 2024-08-31T07:20:19.831345+0000 mgr.a (mgr.14388) 13365 : cluster [DBG] pgmap v9265: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:21.716 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:20:21.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:20:21.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:20:21.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:20:21.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:20:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:22 smithi163 bash[24253]: audit 2024-08-31T07:20:21.290321+0000 mgr.a (mgr.14388) 13366 : audit [DBG] from='client.291471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:22 smithi163 bash[24253]: cluster 2024-08-31T07:20:21.832081+0000 mgr.a (mgr.14388) 13367 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:22 smithi027 bash[22610]: audit 2024-08-31T07:20:21.290321+0000 mgr.a (mgr.14388) 13366 : audit [DBG] from='client.291471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:22 smithi027 bash[22610]: cluster 2024-08-31T07:20:21.832081+0000 mgr.a (mgr.14388) 13367 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:22 smithi191 bash[24992]: audit 2024-08-31T07:20:21.290321+0000 mgr.a (mgr.14388) 13366 : audit [DBG] from='client.291471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:22 smithi191 bash[24992]: cluster 2024-08-31T07:20:21.832081+0000 mgr.a (mgr.14388) 13367 : cluster [DBG] pgmap v9266: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:24 smithi163 bash[24253]: cluster 2024-08-31T07:20:23.834306+0000 mgr.a (mgr.14388) 13368 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:24 smithi027 bash[22610]: cluster 2024-08-31T07:20:23.834306+0000 mgr.a (mgr.14388) 13368 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:24 smithi191 bash[24992]: cluster 2024-08-31T07:20:23.834306+0000 mgr.a (mgr.14388) 13368 : cluster [DBG] pgmap v9267: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:26.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:20:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:20:26.719 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:20:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:26 smithi163 bash[24253]: cluster 2024-08-31T07:20:25.835092+0000 mgr.a (mgr.14388) 13369 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:26 smithi027 bash[22610]: cluster 2024-08-31T07:20:25.835092+0000 mgr.a (mgr.14388) 13369 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:26 smithi191 bash[24992]: cluster 2024-08-31T07:20:25.835092+0000 mgr.a (mgr.14388) 13369 : cluster [DBG] pgmap v9268: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:27.501 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:20:27.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:20:27.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:20:27.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:20:27.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:20:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:28 smithi163 bash[24253]: audit 2024-08-31T07:20:27.056563+0000 mgr.a (mgr.14388) 13370 : audit [DBG] from='client.291549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:28 smithi163 bash[24253]: cluster 2024-08-31T07:20:27.836115+0000 mgr.a (mgr.14388) 13371 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:28 smithi027 bash[22610]: audit 2024-08-31T07:20:27.056563+0000 mgr.a (mgr.14388) 13370 : audit [DBG] from='client.291549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:28 smithi027 bash[22610]: cluster 2024-08-31T07:20:27.836115+0000 mgr.a (mgr.14388) 13371 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:28 smithi191 bash[24992]: audit 2024-08-31T07:20:27.056563+0000 mgr.a (mgr.14388) 13370 : audit [DBG] from='client.291549 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:28 smithi191 bash[24992]: cluster 2024-08-31T07:20:27.836115+0000 mgr.a (mgr.14388) 13371 : cluster [DBG] pgmap v9269: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:30 smithi163 bash[24253]: cluster 2024-08-31T07:20:29.838355+0000 mgr.a (mgr.14388) 13372 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:30 smithi027 bash[22610]: cluster 2024-08-31T07:20:29.838355+0000 mgr.a (mgr.14388) 13372 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:30 smithi191 bash[24992]: cluster 2024-08-31T07:20:29.838355+0000 mgr.a (mgr.14388) 13372 : cluster [DBG] pgmap v9270: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:32.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:20:32.504 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:20:32.504 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:20:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:32 smithi163 bash[24253]: cluster 2024-08-31T07:20:31.839144+0000 mgr.a (mgr.14388) 13373 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:32 smithi027 bash[22610]: cluster 2024-08-31T07:20:31.839144+0000 mgr.a (mgr.14388) 13373 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:33.268 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:20:33.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:20:33.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:20:33.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:20:33.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:20:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:32 smithi191 bash[24992]: cluster 2024-08-31T07:20:31.839144+0000 mgr.a (mgr.14388) 13373 : cluster [DBG] pgmap v9271: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:34.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:33 smithi027 bash[22610]: audit 2024-08-31T07:20:32.835852+0000 mgr.a (mgr.14388) 13374 : audit [DBG] from='client.291627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:33 smithi191 bash[24992]: audit 2024-08-31T07:20:32.835852+0000 mgr.a (mgr.14388) 13374 : audit [DBG] from='client.291627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:33 smithi163 bash[24253]: audit 2024-08-31T07:20:32.835852+0000 mgr.a (mgr.14388) 13374 : audit [DBG] from='client.291627 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:34 smithi027 bash[22610]: cluster 2024-08-31T07:20:33.841948+0000 mgr.a (mgr.14388) 13375 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:34 smithi191 bash[24992]: cluster 2024-08-31T07:20:33.841948+0000 mgr.a (mgr.14388) 13375 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:34 smithi163 bash[24253]: cluster 2024-08-31T07:20:33.841948+0000 mgr.a (mgr.14388) 13375 : cluster [DBG] pgmap v9272: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:36 smithi027 bash[22610]: cluster 2024-08-31T07:20:35.842749+0000 mgr.a (mgr.14388) 13376 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:20:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:36 smithi191 bash[24992]: cluster 2024-08-31T07:20:35.842749+0000 mgr.a (mgr.14388) 13376 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:20:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:36 smithi163 bash[24253]: cluster 2024-08-31T07:20:35.842749+0000 mgr.a (mgr.14388) 13376 : cluster [DBG] pgmap v9273: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:20:38.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:20:38.271 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:20:38.271 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:20:39.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:20:39.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:20:39.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:20:39.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:20:39.045 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:20:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:38 smithi027 bash[22610]: cluster 2024-08-31T07:20:37.843500+0000 mgr.a (mgr.14388) 13377 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:20:39.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:38 smithi191 bash[24992]: cluster 2024-08-31T07:20:37.843500+0000 mgr.a (mgr.14388) 13377 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:20:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:38 smithi163 bash[24253]: cluster 2024-08-31T07:20:37.843500+0000 mgr.a (mgr.14388) 13377 : cluster [DBG] pgmap v9274: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:20:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:39 smithi027 bash[22610]: audit 2024-08-31T07:20:38.606934+0000 mgr.a (mgr.14388) 13378 : audit [DBG] from='client.291705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:39 smithi191 bash[24992]: audit 2024-08-31T07:20:38.606934+0000 mgr.a (mgr.14388) 13378 : audit [DBG] from='client.291705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:39 smithi163 bash[24253]: audit 2024-08-31T07:20:38.606934+0000 mgr.a (mgr.14388) 13378 : audit [DBG] from='client.291705 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:40 smithi027 bash[22610]: cluster 2024-08-31T07:20:39.846211+0000 mgr.a (mgr.14388) 13379 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:40 smithi191 bash[24992]: cluster 2024-08-31T07:20:39.846211+0000 mgr.a (mgr.14388) 13379 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:40 smithi163 bash[24253]: cluster 2024-08-31T07:20:39.846211+0000 mgr.a (mgr.14388) 13379 : cluster [DBG] pgmap v9275: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:42 smithi191 bash[24992]: cluster 2024-08-31T07:20:41.847072+0000 mgr.a (mgr.14388) 13380 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:20:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:42 smithi163 bash[24253]: cluster 2024-08-31T07:20:41.847072+0000 mgr.a (mgr.14388) 13380 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:20:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:42 smithi027 bash[22610]: cluster 2024-08-31T07:20:41.847072+0000 mgr.a (mgr.14388) 13380 : cluster [DBG] pgmap v9276: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:20:44.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:20:44.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:20:44.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:20:44.805 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:20:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:20:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:20:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:20:44.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:20:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:44 smithi191 bash[24992]: cluster 2024-08-31T07:20:43.849056+0000 mgr.a (mgr.14388) 13381 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:44 smithi163 bash[24253]: cluster 2024-08-31T07:20:43.849056+0000 mgr.a (mgr.14388) 13381 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:44 smithi027 bash[22610]: cluster 2024-08-31T07:20:43.849056+0000 mgr.a (mgr.14388) 13381 : cluster [DBG] pgmap v9277: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:46.293 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:45 smithi191 bash[24992]: audit 2024-08-31T07:20:44.379022+0000 mgr.a (mgr.14388) 13382 : audit [DBG] from='client.291780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:45 smithi163 bash[24253]: audit 2024-08-31T07:20:44.379022+0000 mgr.a (mgr.14388) 13382 : audit [DBG] from='client.291780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:45 smithi027 bash[22610]: audit 2024-08-31T07:20:44.379022+0000 mgr.a (mgr.14388) 13382 : audit [DBG] from='client.291780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:46 smithi191 bash[24992]: cluster 2024-08-31T07:20:45.849937+0000 mgr.a (mgr.14388) 13383 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:46 smithi163 bash[24253]: cluster 2024-08-31T07:20:45.849937+0000 mgr.a (mgr.14388) 13383 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:46 smithi027 bash[22610]: cluster 2024-08-31T07:20:45.849937+0000 mgr.a (mgr.14388) 13383 : cluster [DBG] pgmap v9278: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:48 smithi191 bash[24992]: cluster 2024-08-31T07:20:47.850715+0000 mgr.a (mgr.14388) 13384 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:48 smithi163 bash[24253]: cluster 2024-08-31T07:20:47.850715+0000 mgr.a (mgr.14388) 13384 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:48 smithi027 bash[22610]: cluster 2024-08-31T07:20:47.850715+0000 mgr.a (mgr.14388) 13384 : cluster [DBG] pgmap v9279: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:49.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:20:49.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:20:49.808 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:20:50.586 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:20:50.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:20:50.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:20:50.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:20:50.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:20:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:50 smithi163 bash[24253]: cluster 2024-08-31T07:20:49.852136+0000 mgr.a (mgr.14388) 13385 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:50 smithi027 bash[22610]: cluster 2024-08-31T07:20:49.852136+0000 mgr.a (mgr.14388) 13385 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:51.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:50 smithi191 bash[24992]: cluster 2024-08-31T07:20:49.852136+0000 mgr.a (mgr.14388) 13385 : cluster [DBG] pgmap v9280: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:51 smithi163 bash[24253]: audit 2024-08-31T07:20:50.152884+0000 mgr.a (mgr.14388) 13386 : audit [DBG] from='client.291858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:51 smithi027 bash[22610]: audit 2024-08-31T07:20:50.152884+0000 mgr.a (mgr.14388) 13386 : audit [DBG] from='client.291858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:51 smithi191 bash[24992]: audit 2024-08-31T07:20:50.152884+0000 mgr.a (mgr.14388) 13386 : audit [DBG] from='client.291858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:52 smithi163 bash[24253]: cluster 2024-08-31T07:20:51.852992+0000 mgr.a (mgr.14388) 13387 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:52 smithi027 bash[22610]: cluster 2024-08-31T07:20:51.852992+0000 mgr.a (mgr.14388) 13387 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:53.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:52 smithi191 bash[24992]: cluster 2024-08-31T07:20:51.852992+0000 mgr.a (mgr.14388) 13387 : cluster [DBG] pgmap v9281: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:54 smithi163 bash[24253]: cluster 2024-08-31T07:20:53.855178+0000 mgr.a (mgr.14388) 13388 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:54 smithi027 bash[22610]: cluster 2024-08-31T07:20:53.855178+0000 mgr.a (mgr.14388) 13388 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:55.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:54 smithi191 bash[24992]: cluster 2024-08-31T07:20:53.855178+0000 mgr.a (mgr.14388) 13388 : cluster [DBG] pgmap v9282: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:20:55.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:20:55.588 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:20:55.588 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:20:56.331 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:20:56.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:20:56.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:20:56.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:20:56.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:20:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:56 smithi163 bash[24253]: cluster 2024-08-31T07:20:55.855661+0000 mgr.a (mgr.14388) 13389 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:56 smithi163 bash[24253]: audit 2024-08-31T07:20:55.916773+0000 mgr.a (mgr.14388) 13390 : audit [DBG] from='client.291936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:56 smithi163 bash[24253]: audit 2024-08-31T07:20:56.535710+0000 mon.a (mon.0) 2579 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:20:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:56 smithi027 bash[22610]: cluster 2024-08-31T07:20:55.855661+0000 mgr.a (mgr.14388) 13389 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:56 smithi027 bash[22610]: audit 2024-08-31T07:20:55.916773+0000 mgr.a (mgr.14388) 13390 : audit [DBG] from='client.291936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:56 smithi027 bash[22610]: audit 2024-08-31T07:20:56.535710+0000 mon.a (mon.0) 2579 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:20:57.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:56 smithi191 bash[24992]: cluster 2024-08-31T07:20:55.855661+0000 mgr.a (mgr.14388) 13389 : cluster [DBG] pgmap v9283: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:56 smithi191 bash[24992]: audit 2024-08-31T07:20:55.916773+0000 mgr.a (mgr.14388) 13390 : audit [DBG] from='client.291936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:20:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:56 smithi191 bash[24992]: audit 2024-08-31T07:20:56.535710+0000 mon.a (mon.0) 2579 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:20:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:58 smithi163 bash[24253]: audit 2024-08-31T07:20:57.159842+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:20:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:58 smithi163 bash[24253]: audit 2024-08-31T07:20:57.165523+0000 mon.a (mon.0) 2581 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:20:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:58 smithi163 bash[24253]: cluster 2024-08-31T07:20:57.856071+0000 mgr.a (mgr.14388) 13391 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:58.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:58 smithi163 bash[24253]: audit 2024-08-31T07:20:57.957302+0000 mon.a (mon.0) 2582 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:20:58.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:58 smithi163 bash[24253]: audit 2024-08-31T07:20:57.959051+0000 mon.a (mon.0) 2583 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:20:58.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:58 smithi163 bash[24253]: audit 2024-08-31T07:20:57.968162+0000 mon.a (mon.0) 2584 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:20:58.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:58 smithi163 bash[24253]: audit 2024-08-31T07:20:57.973208+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:20:58.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:58 smithi163 bash[24253]: audit 2024-08-31T07:20:57.975720+0000 mgr.a (mgr.14388) 13392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:20:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:58 smithi027 bash[22610]: audit 2024-08-31T07:20:57.159842+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:20:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:58 smithi027 bash[22610]: audit 2024-08-31T07:20:57.165523+0000 mon.a (mon.0) 2581 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:20:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:58 smithi027 bash[22610]: cluster 2024-08-31T07:20:57.856071+0000 mgr.a (mgr.14388) 13391 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:58 smithi027 bash[22610]: audit 2024-08-31T07:20:57.957302+0000 mon.a (mon.0) 2582 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:20:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:58 smithi027 bash[22610]: audit 2024-08-31T07:20:57.959051+0000 mon.a (mon.0) 2583 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:20:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:58 smithi027 bash[22610]: audit 2024-08-31T07:20:57.968162+0000 mon.a (mon.0) 2584 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:20:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:58 smithi027 bash[22610]: audit 2024-08-31T07:20:57.973208+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:20:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:58 smithi027 bash[22610]: audit 2024-08-31T07:20:57.975720+0000 mgr.a (mgr.14388) 13392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:20:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:58 smithi191 bash[24992]: audit 2024-08-31T07:20:57.159842+0000 mon.a (mon.0) 2580 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:20:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:58 smithi191 bash[24992]: audit 2024-08-31T07:20:57.165523+0000 mon.a (mon.0) 2581 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:20:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:58 smithi191 bash[24992]: cluster 2024-08-31T07:20:57.856071+0000 mgr.a (mgr.14388) 13391 : cluster [DBG] pgmap v9284: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:20:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:58 smithi191 bash[24992]: audit 2024-08-31T07:20:57.957302+0000 mon.a (mon.0) 2582 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:20:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:58 smithi191 bash[24992]: audit 2024-08-31T07:20:57.959051+0000 mon.a (mon.0) 2583 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:20:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:58 smithi191 bash[24992]: audit 2024-08-31T07:20:57.968162+0000 mon.a (mon.0) 2584 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:20:58.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:58 smithi191 bash[24992]: audit 2024-08-31T07:20:57.973208+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:20:58.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:58 smithi191 bash[24992]: audit 2024-08-31T07:20:57.975720+0000 mgr.a (mgr.14388) 13392 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:20:58.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:20:58 smithi027 bash[22863]: debug 2024-08-31T07:20:58.704+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:20:58.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:20:58 smithi027 bash[22863]: debug 2024-08-31T07:20:58.708+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:20:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:59 smithi163 bash[24253]: audit 2024-08-31T07:20:58.709605+0000 mgr.a (mgr.14388) 13393 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:20:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:20:59 smithi163 bash[24253]: cephadm 2024-08-31T07:20:58.711127+0000 mgr.a (mgr.14388) 13394 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:20:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:59 smithi027 bash[22610]: audit 2024-08-31T07:20:58.709605+0000 mgr.a (mgr.14388) 13393 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:20:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:20:59 smithi027 bash[22610]: cephadm 2024-08-31T07:20:58.711127+0000 mgr.a (mgr.14388) 13394 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:20:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:59 smithi191 bash[24992]: audit 2024-08-31T07:20:58.709605+0000 mgr.a (mgr.14388) 13393 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:20:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:20:59 smithi191 bash[24992]: cephadm 2024-08-31T07:20:58.711127+0000 mgr.a (mgr.14388) 13394 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:21:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:00 smithi163 bash[24253]: cluster 2024-08-31T07:20:59.858830+0000 mgr.a (mgr.14388) 13395 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:00 smithi027 bash[22610]: cluster 2024-08-31T07:20:59.858830+0000 mgr.a (mgr.14388) 13395 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:00 smithi191 bash[24992]: cluster 2024-08-31T07:20:59.858830+0000 mgr.a (mgr.14388) 13395 : cluster [DBG] pgmap v9285: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:01.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:01.333 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:01.333 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:02.105 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:02.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:02.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:02.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:02.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:21:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:02 smithi163 bash[24253]: audit 2024-08-31T07:21:01.665434+0000 mgr.a (mgr.14388) 13396 : audit [DBG] from='client.292122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:02 smithi163 bash[24253]: cluster 2024-08-31T07:21:01.859439+0000 mgr.a (mgr.14388) 13397 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:02 smithi027 bash[22610]: audit 2024-08-31T07:21:01.665434+0000 mgr.a (mgr.14388) 13396 : audit [DBG] from='client.292122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:03.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:02 smithi027 bash[22610]: cluster 2024-08-31T07:21:01.859439+0000 mgr.a (mgr.14388) 13397 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:03.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:02 smithi191 bash[24992]: audit 2024-08-31T07:21:01.665434+0000 mgr.a (mgr.14388) 13396 : audit [DBG] from='client.292122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:02 smithi191 bash[24992]: cluster 2024-08-31T07:21:01.859439+0000 mgr.a (mgr.14388) 13397 : cluster [DBG] pgmap v9286: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:04 smithi163 bash[24253]: cluster 2024-08-31T07:21:03.861801+0000 mgr.a (mgr.14388) 13398 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:04 smithi027 bash[22610]: cluster 2024-08-31T07:21:03.861801+0000 mgr.a (mgr.14388) 13398 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:04 smithi191 bash[24992]: cluster 2024-08-31T07:21:03.861801+0000 mgr.a (mgr.14388) 13398 : cluster [DBG] pgmap v9287: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:07.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:07.107 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:07.108 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:06 smithi163 bash[24253]: cluster 2024-08-31T07:21:05.862577+0000 mgr.a (mgr.14388) 13399 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:06 smithi027 bash[22610]: cluster 2024-08-31T07:21:05.862577+0000 mgr.a (mgr.14388) 13399 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:06 smithi191 bash[24992]: cluster 2024-08-31T07:21:05.862577+0000 mgr.a (mgr.14388) 13399 : cluster [DBG] pgmap v9288: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:07.891 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:07.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:07.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:21:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:08 smithi163 bash[24253]: audit 2024-08-31T07:21:07.445764+0000 mgr.a (mgr.14388) 13400 : audit [DBG] from='client.292200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:08 smithi163 bash[24253]: cluster 2024-08-31T07:21:07.863061+0000 mgr.a (mgr.14388) 13401 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:08 smithi027 bash[22610]: audit 2024-08-31T07:21:07.445764+0000 mgr.a (mgr.14388) 13400 : audit [DBG] from='client.292200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:08 smithi027 bash[22610]: cluster 2024-08-31T07:21:07.863061+0000 mgr.a (mgr.14388) 13401 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:08 smithi191 bash[24992]: audit 2024-08-31T07:21:07.445764+0000 mgr.a (mgr.14388) 13400 : audit [DBG] from='client.292200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:08 smithi191 bash[24992]: cluster 2024-08-31T07:21:07.863061+0000 mgr.a (mgr.14388) 13401 : cluster [DBG] pgmap v9289: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:10 smithi163 bash[24253]: cluster 2024-08-31T07:21:09.865267+0000 mgr.a (mgr.14388) 13402 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:10 smithi027 bash[22610]: cluster 2024-08-31T07:21:09.865267+0000 mgr.a (mgr.14388) 13402 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:10 smithi191 bash[24992]: cluster 2024-08-31T07:21:09.865267+0000 mgr.a (mgr.14388) 13402 : cluster [DBG] pgmap v9290: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:12.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:12.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:12 smithi163 bash[24253]: cluster 2024-08-31T07:21:11.866048+0000 mgr.a (mgr.14388) 13403 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:12 smithi027 bash[22610]: cluster 2024-08-31T07:21:11.866048+0000 mgr.a (mgr.14388) 13403 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:12 smithi191 bash[24992]: cluster 2024-08-31T07:21:11.866048+0000 mgr.a (mgr.14388) 13403 : cluster [DBG] pgmap v9291: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:13.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:13.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:13.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:13.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:21:13.646 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:14 smithi163 bash[24253]: audit 2024-08-31T07:21:13.217525+0000 mgr.a (mgr.14388) 13404 : audit [DBG] from='client.292278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:14 smithi163 bash[24253]: cluster 2024-08-31T07:21:13.868881+0000 mgr.a (mgr.14388) 13405 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:14 smithi027 bash[22610]: audit 2024-08-31T07:21:13.217525+0000 mgr.a (mgr.14388) 13404 : audit [DBG] from='client.292278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:14 smithi027 bash[22610]: cluster 2024-08-31T07:21:13.868881+0000 mgr.a (mgr.14388) 13405 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:14 smithi191 bash[24992]: audit 2024-08-31T07:21:13.217525+0000 mgr.a (mgr.14388) 13404 : audit [DBG] from='client.292278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:14 smithi191 bash[24992]: cluster 2024-08-31T07:21:13.868881+0000 mgr.a (mgr.14388) 13405 : cluster [DBG] pgmap v9292: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:21:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:16 smithi163 bash[24253]: cluster 2024-08-31T07:21:15.869671+0000 mgr.a (mgr.14388) 13406 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:16 smithi027 bash[22610]: cluster 2024-08-31T07:21:15.869671+0000 mgr.a (mgr.14388) 13406 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:16 smithi191 bash[24992]: cluster 2024-08-31T07:21:15.869671+0000 mgr.a (mgr.14388) 13406 : cluster [DBG] pgmap v9293: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:18.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:18.648 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:18.649 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:18 smithi163 bash[24253]: cluster 2024-08-31T07:21:17.870438+0000 mgr.a (mgr.14388) 13407 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:21:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:18 smithi027 bash[22610]: cluster 2024-08-31T07:21:17.870438+0000 mgr.a (mgr.14388) 13407 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:21:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:18 smithi191 bash[24992]: cluster 2024-08-31T07:21:17.870438+0000 mgr.a (mgr.14388) 13407 : cluster [DBG] pgmap v9294: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:21:19.418 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:21:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:19 smithi163 bash[24253]: audit 2024-08-31T07:21:18.983535+0000 mgr.a (mgr.14388) 13408 : audit [DBG] from='client.292353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:19 smithi027 bash[22610]: audit 2024-08-31T07:21:18.983535+0000 mgr.a (mgr.14388) 13408 : audit [DBG] from='client.292353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:19 smithi191 bash[24992]: audit 2024-08-31T07:21:18.983535+0000 mgr.a (mgr.14388) 13408 : audit [DBG] from='client.292353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:20 smithi163 bash[24253]: cluster 2024-08-31T07:21:19.873244+0000 mgr.a (mgr.14388) 13409 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:20 smithi027 bash[22610]: cluster 2024-08-31T07:21:19.873244+0000 mgr.a (mgr.14388) 13409 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:21.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:20 smithi191 bash[24992]: cluster 2024-08-31T07:21:19.873244+0000 mgr.a (mgr.14388) 13409 : cluster [DBG] pgmap v9295: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:22 smithi163 bash[24253]: cluster 2024-08-31T07:21:21.874061+0000 mgr.a (mgr.14388) 13410 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:22 smithi027 bash[22610]: cluster 2024-08-31T07:21:21.874061+0000 mgr.a (mgr.14388) 13410 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:22 smithi191 bash[24992]: cluster 2024-08-31T07:21:21.874061+0000 mgr.a (mgr.14388) 13410 : cluster [DBG] pgmap v9296: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:24.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:25.188 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:25.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:25.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:25.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:25.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:21:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:24 smithi027 bash[22610]: cluster 2024-08-31T07:21:23.876152+0000 mgr.a (mgr.14388) 13411 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:24 smithi191 bash[24992]: cluster 2024-08-31T07:21:23.876152+0000 mgr.a (mgr.14388) 13411 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:24 smithi163 bash[24253]: cluster 2024-08-31T07:21:23.876152+0000 mgr.a (mgr.14388) 13411 : cluster [DBG] pgmap v9297: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:25 smithi027 bash[22610]: audit 2024-08-31T07:21:24.755261+0000 mgr.a (mgr.14388) 13412 : audit [DBG] from='client.292431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:25 smithi191 bash[24992]: audit 2024-08-31T07:21:24.755261+0000 mgr.a (mgr.14388) 13412 : audit [DBG] from='client.292431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:25 smithi163 bash[24253]: audit 2024-08-31T07:21:24.755261+0000 mgr.a (mgr.14388) 13412 : audit [DBG] from='client.292431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:26 smithi027 bash[22610]: cluster 2024-08-31T07:21:25.877092+0000 mgr.a (mgr.14388) 13413 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:26 smithi191 bash[24992]: cluster 2024-08-31T07:21:25.877092+0000 mgr.a (mgr.14388) 13413 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:26 smithi163 bash[24253]: cluster 2024-08-31T07:21:25.877092+0000 mgr.a (mgr.14388) 13413 : cluster [DBG] pgmap v9298: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:28 smithi027 bash[22610]: cluster 2024-08-31T07:21:27.877916+0000 mgr.a (mgr.14388) 13414 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:28 smithi191 bash[24992]: cluster 2024-08-31T07:21:27.877916+0000 mgr.a (mgr.14388) 13414 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:28 smithi163 bash[24253]: cluster 2024-08-31T07:21:27.877916+0000 mgr.a (mgr.14388) 13414 : cluster [DBG] pgmap v9299: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:30.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:30.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:30.191 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:30.960 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:30.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:30.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:30.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:30.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:21:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:30 smithi027 bash[22610]: cluster 2024-08-31T07:21:29.880170+0000 mgr.a (mgr.14388) 13415 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:30 smithi191 bash[24992]: cluster 2024-08-31T07:21:29.880170+0000 mgr.a (mgr.14388) 13415 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:30 smithi163 bash[24253]: cluster 2024-08-31T07:21:29.880170+0000 mgr.a (mgr.14388) 13415 : cluster [DBG] pgmap v9300: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:31 smithi027 bash[22610]: audit 2024-08-31T07:21:30.523462+0000 mgr.a (mgr.14388) 13416 : audit [DBG] from='client.292509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:31 smithi191 bash[24992]: audit 2024-08-31T07:21:30.523462+0000 mgr.a (mgr.14388) 13416 : audit [DBG] from='client.292509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:31 smithi163 bash[24253]: audit 2024-08-31T07:21:30.523462+0000 mgr.a (mgr.14388) 13416 : audit [DBG] from='client.292509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:32 smithi027 bash[22610]: cluster 2024-08-31T07:21:31.881201+0000 mgr.a (mgr.14388) 13417 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:32 smithi191 bash[24992]: cluster 2024-08-31T07:21:31.881201+0000 mgr.a (mgr.14388) 13417 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:32 smithi163 bash[24253]: cluster 2024-08-31T07:21:31.881201+0000 mgr.a (mgr.14388) 13417 : cluster [DBG] pgmap v9301: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:34 smithi027 bash[22610]: cluster 2024-08-31T07:21:33.883488+0000 mgr.a (mgr.14388) 13418 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:34 smithi191 bash[24992]: cluster 2024-08-31T07:21:33.883488+0000 mgr.a (mgr.14388) 13418 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:34 smithi163 bash[24253]: cluster 2024-08-31T07:21:33.883488+0000 mgr.a (mgr.14388) 13418 : cluster [DBG] pgmap v9302: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:35.962 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:35.962 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:35.963 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:36.714 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:36.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:21:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:36 smithi191 bash[24992]: cluster 2024-08-31T07:21:35.884389+0000 mgr.a (mgr.14388) 13419 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:36 smithi163 bash[24253]: cluster 2024-08-31T07:21:35.884389+0000 mgr.a (mgr.14388) 13419 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:36 smithi027 bash[22610]: cluster 2024-08-31T07:21:35.884389+0000 mgr.a (mgr.14388) 13419 : cluster [DBG] pgmap v9303: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:37 smithi191 bash[24992]: audit 2024-08-31T07:21:36.292552+0000 mgr.a (mgr.14388) 13420 : audit [DBG] from='client.292587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:37 smithi163 bash[24253]: audit 2024-08-31T07:21:36.292552+0000 mgr.a (mgr.14388) 13420 : audit [DBG] from='client.292587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:37 smithi027 bash[22610]: audit 2024-08-31T07:21:36.292552+0000 mgr.a (mgr.14388) 13420 : audit [DBG] from='client.292587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:38 smithi191 bash[24992]: cluster 2024-08-31T07:21:37.885511+0000 mgr.a (mgr.14388) 13421 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:38 smithi163 bash[24253]: cluster 2024-08-31T07:21:37.885511+0000 mgr.a (mgr.14388) 13421 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:38 smithi027 bash[22610]: cluster 2024-08-31T07:21:37.885511+0000 mgr.a (mgr.14388) 13421 : cluster [DBG] pgmap v9304: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:41 smithi191 bash[24992]: cluster 2024-08-31T07:21:39.887914+0000 mgr.a (mgr.14388) 13422 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:41 smithi163 bash[24253]: cluster 2024-08-31T07:21:39.887914+0000 mgr.a (mgr.14388) 13422 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:41 smithi027 bash[22610]: cluster 2024-08-31T07:21:39.887914+0000 mgr.a (mgr.14388) 13422 : cluster [DBG] pgmap v9305: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:41.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:41.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:41.717 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:42.473 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:21:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:43 smithi191 bash[24992]: cluster 2024-08-31T07:21:41.888833+0000 mgr.a (mgr.14388) 13423 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:43 smithi163 bash[24253]: cluster 2024-08-31T07:21:41.888833+0000 mgr.a (mgr.14388) 13423 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:43 smithi027 bash[22610]: cluster 2024-08-31T07:21:41.888833+0000 mgr.a (mgr.14388) 13423 : cluster [DBG] pgmap v9306: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:44 smithi191 bash[24992]: audit 2024-08-31T07:21:42.058922+0000 mgr.a (mgr.14388) 13424 : audit [DBG] from='client.110905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:44 smithi163 bash[24253]: audit 2024-08-31T07:21:42.058922+0000 mgr.a (mgr.14388) 13424 : audit [DBG] from='client.110905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:44 smithi027 bash[22610]: audit 2024-08-31T07:21:42.058922+0000 mgr.a (mgr.14388) 13424 : audit [DBG] from='client.110905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:45.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:45 smithi191 bash[24992]: cluster 2024-08-31T07:21:43.891288+0000 mgr.a (mgr.14388) 13425 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:45 smithi163 bash[24253]: cluster 2024-08-31T07:21:43.891288+0000 mgr.a (mgr.14388) 13425 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:45 smithi027 bash[22610]: cluster 2024-08-31T07:21:43.891288+0000 mgr.a (mgr.14388) 13425 : cluster [DBG] pgmap v9307: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:21:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:46 smithi191 bash[24992]: cluster 2024-08-31T07:21:45.892043+0000 mgr.a (mgr.14388) 13426 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:46 smithi163 bash[24253]: cluster 2024-08-31T07:21:45.892043+0000 mgr.a (mgr.14388) 13426 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:46 smithi027 bash[22610]: cluster 2024-08-31T07:21:45.892043+0000 mgr.a (mgr.14388) 13426 : cluster [DBG] pgmap v9308: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:47.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:47.476 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:47.476 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:48.226 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:48.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:48.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:48.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:48.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:21:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:48 smithi163 bash[24253]: audit 2024-08-31T07:21:47.807661+0000 mgr.a (mgr.14388) 13427 : audit [DBG] from='client.292743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:48 smithi163 bash[24253]: cluster 2024-08-31T07:21:47.892567+0000 mgr.a (mgr.14388) 13428 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:48 smithi027 bash[22610]: audit 2024-08-31T07:21:47.807661+0000 mgr.a (mgr.14388) 13427 : audit [DBG] from='client.292743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:48 smithi027 bash[22610]: cluster 2024-08-31T07:21:47.892567+0000 mgr.a (mgr.14388) 13428 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:49.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:48 smithi191 bash[24992]: audit 2024-08-31T07:21:47.807661+0000 mgr.a (mgr.14388) 13427 : audit [DBG] from='client.292743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:48 smithi191 bash[24992]: cluster 2024-08-31T07:21:47.892567+0000 mgr.a (mgr.14388) 13428 : cluster [DBG] pgmap v9309: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:50 smithi027 bash[22610]: cluster 2024-08-31T07:21:49.895267+0000 mgr.a (mgr.14388) 13429 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:51.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:50 smithi191 bash[24992]: cluster 2024-08-31T07:21:49.895267+0000 mgr.a (mgr.14388) 13429 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:50 smithi163 bash[24253]: cluster 2024-08-31T07:21:49.895267+0000 mgr.a (mgr.14388) 13429 : cluster [DBG] pgmap v9310: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:53.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:53.228 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:53.228 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:52 smithi027 bash[22610]: cluster 2024-08-31T07:21:51.896060+0000 mgr.a (mgr.14388) 13430 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:52 smithi191 bash[24992]: cluster 2024-08-31T07:21:51.896060+0000 mgr.a (mgr.14388) 13430 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:52 smithi163 bash[24253]: cluster 2024-08-31T07:21:51.896060+0000 mgr.a (mgr.14388) 13430 : cluster [DBG] pgmap v9311: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:53.981 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:53.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:53.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:53.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:53.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:21:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:54 smithi027 bash[22610]: audit 2024-08-31T07:21:53.556300+0000 mgr.a (mgr.14388) 13431 : audit [DBG] from='client.292821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:54 smithi027 bash[22610]: cluster 2024-08-31T07:21:53.897822+0000 mgr.a (mgr.14388) 13432 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:54 smithi191 bash[24992]: audit 2024-08-31T07:21:53.556300+0000 mgr.a (mgr.14388) 13431 : audit [DBG] from='client.292821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:54 smithi191 bash[24992]: cluster 2024-08-31T07:21:53.897822+0000 mgr.a (mgr.14388) 13432 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:54 smithi163 bash[24253]: audit 2024-08-31T07:21:53.556300+0000 mgr.a (mgr.14388) 13431 : audit [DBG] from='client.292821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:21:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:54 smithi163 bash[24253]: cluster 2024-08-31T07:21:53.897822+0000 mgr.a (mgr.14388) 13432 : cluster [DBG] pgmap v9312: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:21:57.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:56 smithi027 bash[22610]: cluster 2024-08-31T07:21:55.898567+0000 mgr.a (mgr.14388) 13433 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:56 smithi191 bash[24992]: cluster 2024-08-31T07:21:55.898567+0000 mgr.a (mgr.14388) 13433 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:56 smithi163 bash[24253]: cluster 2024-08-31T07:21:55.898567+0000 mgr.a (mgr.14388) 13433 : cluster [DBG] pgmap v9313: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:21:58.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:21:58.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:21:58.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:21:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:58 smithi027 bash[22610]: cluster 2024-08-31T07:21:57.899324+0000 mgr.a (mgr.14388) 13434 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:21:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:21:58 smithi027 bash[22610]: audit 2024-08-31T07:21:58.768231+0000 mon.a (mon.0) 2586 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:21:59.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:58 smithi191 bash[24992]: cluster 2024-08-31T07:21:57.899324+0000 mgr.a (mgr.14388) 13434 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:21:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:21:58 smithi191 bash[24992]: audit 2024-08-31T07:21:58.768231+0000 mon.a (mon.0) 2586 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:21:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:58 smithi163 bash[24253]: cluster 2024-08-31T07:21:57.899324+0000 mgr.a (mgr.14388) 13434 : cluster [DBG] pgmap v9314: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:21:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:21:58 smithi163 bash[24253]: audit 2024-08-31T07:21:58.768231+0000 mon.a (mon.0) 2586 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:21:59.730 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:21:59.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:21:59.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:21:59.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:21:59.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:00 smithi163 bash[24253]: audit 2024-08-31T07:21:59.310102+0000 mgr.a (mgr.14388) 13435 : audit [DBG] from='client.292899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:00 smithi163 bash[24253]: audit 2024-08-31T07:21:59.377554+0000 mon.a (mon.0) 2587 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:00 smithi163 bash[24253]: audit 2024-08-31T07:21:59.386854+0000 mon.a (mon.0) 2588 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:00 smithi163 bash[24253]: audit 2024-08-31T07:21:59.393553+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:00 smithi163 bash[24253]: audit 2024-08-31T07:21:59.401244+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:00 smithi163 bash[24253]: cluster 2024-08-31T07:21:59.902091+0000 mgr.a (mgr.14388) 13436 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:00 smithi163 bash[24253]: audit 2024-08-31T07:22:00.049433+0000 mon.a (mon.0) 2591 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:22:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:00 smithi163 bash[24253]: audit 2024-08-31T07:22:00.051120+0000 mon.a (mon.0) 2592 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:22:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:00 smithi163 bash[24253]: audit 2024-08-31T07:22:00.057844+0000 mon.a (mon.0) 2593 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:00 smithi163 bash[24253]: audit 2024-08-31T07:22:00.062824+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:22:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22610]: audit 2024-08-31T07:21:59.310102+0000 mgr.a (mgr.14388) 13435 : audit [DBG] from='client.292899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22610]: audit 2024-08-31T07:21:59.377554+0000 mon.a (mon.0) 2587 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22610]: audit 2024-08-31T07:21:59.386854+0000 mon.a (mon.0) 2588 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22610]: audit 2024-08-31T07:21:59.393553+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22610]: audit 2024-08-31T07:21:59.401244+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22610]: cluster 2024-08-31T07:21:59.902091+0000 mgr.a (mgr.14388) 13436 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:00.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22610]: audit 2024-08-31T07:22:00.049433+0000 mon.a (mon.0) 2591 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:22:00.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22610]: audit 2024-08-31T07:22:00.051120+0000 mon.a (mon.0) 2592 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:22:00.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22610]: audit 2024-08-31T07:22:00.057844+0000 mon.a (mon.0) 2593 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22610]: audit 2024-08-31T07:22:00.062824+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:22:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:00 smithi191 bash[24992]: audit 2024-08-31T07:21:59.310102+0000 mgr.a (mgr.14388) 13435 : audit [DBG] from='client.292899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:00 smithi191 bash[24992]: audit 2024-08-31T07:21:59.377554+0000 mon.a (mon.0) 2587 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:00 smithi191 bash[24992]: audit 2024-08-31T07:21:59.386854+0000 mon.a (mon.0) 2588 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:00 smithi191 bash[24992]: audit 2024-08-31T07:21:59.393553+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:00 smithi191 bash[24992]: audit 2024-08-31T07:21:59.401244+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:00 smithi191 bash[24992]: cluster 2024-08-31T07:21:59.902091+0000 mgr.a (mgr.14388) 13436 : cluster [DBG] pgmap v9315: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:00 smithi191 bash[24992]: audit 2024-08-31T07:22:00.049433+0000 mon.a (mon.0) 2591 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:22:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:00 smithi191 bash[24992]: audit 2024-08-31T07:22:00.051120+0000 mon.a (mon.0) 2592 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:22:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:00 smithi191 bash[24992]: audit 2024-08-31T07:22:00.057844+0000 mon.a (mon.0) 2593 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:22:00.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:00 smithi191 bash[24992]: audit 2024-08-31T07:22:00.062824+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:22:01.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22863]: debug 2024-08-31T07:22:00.783+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:22:01.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:22:00 smithi027 bash[22863]: debug 2024-08-31T07:22:00.783+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:22:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:01 smithi163 bash[24253]: audit 2024-08-31T07:22:00.065793+0000 mgr.a (mgr.14388) 13437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:22:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:01 smithi163 bash[24253]: audit 2024-08-31T07:22:00.787339+0000 mgr.a (mgr.14388) 13438 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:22:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:01 smithi163 bash[24253]: cephadm 2024-08-31T07:22:00.788683+0000 mgr.a (mgr.14388) 13439 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:22:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:01 smithi027 bash[22610]: audit 2024-08-31T07:22:00.065793+0000 mgr.a (mgr.14388) 13437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:22:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:01 smithi027 bash[22610]: audit 2024-08-31T07:22:00.787339+0000 mgr.a (mgr.14388) 13438 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:22:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:01 smithi027 bash[22610]: cephadm 2024-08-31T07:22:00.788683+0000 mgr.a (mgr.14388) 13439 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:22:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:01 smithi191 bash[24992]: audit 2024-08-31T07:22:00.065793+0000 mgr.a (mgr.14388) 13437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:22:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:01 smithi191 bash[24992]: audit 2024-08-31T07:22:00.787339+0000 mgr.a (mgr.14388) 13438 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:22:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:01 smithi191 bash[24992]: cephadm 2024-08-31T07:22:00.788683+0000 mgr.a (mgr.14388) 13439 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:22:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:02 smithi163 bash[24253]: cluster 2024-08-31T07:22:01.903095+0000 mgr.a (mgr.14388) 13440 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:02 smithi027 bash[22610]: cluster 2024-08-31T07:22:01.903095+0000 mgr.a (mgr.14388) 13440 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:02 smithi191 bash[24992]: cluster 2024-08-31T07:22:01.903095+0000 mgr.a (mgr.14388) 13440 : cluster [DBG] pgmap v9316: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:04.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:22:04.732 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:22:04.733 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:22:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:04 smithi027 bash[22610]: cluster 2024-08-31T07:22:03.905264+0000 mgr.a (mgr.14388) 13441 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:04 smithi191 bash[24992]: cluster 2024-08-31T07:22:03.905264+0000 mgr.a (mgr.14388) 13441 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:04 smithi163 bash[24253]: cluster 2024-08-31T07:22:03.905264+0000 mgr.a (mgr.14388) 13441 : cluster [DBG] pgmap v9317: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:05.489 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:22:05.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:22:05.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:22:05.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:22:05.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:06 smithi027 bash[22610]: audit 2024-08-31T07:22:05.064385+0000 mgr.a (mgr.14388) 13442 : audit [DBG] from='client.293073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:06 smithi027 bash[22610]: cluster 2024-08-31T07:22:05.906187+0000 mgr.a (mgr.14388) 13443 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:06 smithi191 bash[24992]: audit 2024-08-31T07:22:05.064385+0000 mgr.a (mgr.14388) 13442 : audit [DBG] from='client.293073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:06 smithi191 bash[24992]: cluster 2024-08-31T07:22:05.906187+0000 mgr.a (mgr.14388) 13443 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:06 smithi163 bash[24253]: audit 2024-08-31T07:22:05.064385+0000 mgr.a (mgr.14388) 13442 : audit [DBG] from='client.293073 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:06 smithi163 bash[24253]: cluster 2024-08-31T07:22:05.906187+0000 mgr.a (mgr.14388) 13443 : cluster [DBG] pgmap v9318: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:08 smithi027 bash[22610]: cluster 2024-08-31T07:22:07.906970+0000 mgr.a (mgr.14388) 13444 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:08 smithi191 bash[24992]: cluster 2024-08-31T07:22:07.906970+0000 mgr.a (mgr.14388) 13444 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:08 smithi163 bash[24253]: cluster 2024-08-31T07:22:07.906970+0000 mgr.a (mgr.14388) 13444 : cluster [DBG] pgmap v9319: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:10.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:22:10.492 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:22:10.492 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:22:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:10 smithi027 bash[22610]: cluster 2024-08-31T07:22:09.909196+0000 mgr.a (mgr.14388) 13445 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:11.249 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:22:11.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:22:11.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:22:11.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:22:11.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:10 smithi191 bash[24992]: cluster 2024-08-31T07:22:09.909196+0000 mgr.a (mgr.14388) 13445 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:10 smithi163 bash[24253]: cluster 2024-08-31T07:22:09.909196+0000 mgr.a (mgr.14388) 13445 : cluster [DBG] pgmap v9320: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:11 smithi027 bash[22610]: audit 2024-08-31T07:22:10.822458+0000 mgr.a (mgr.14388) 13446 : audit [DBG] from='client.293151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:11 smithi191 bash[24992]: audit 2024-08-31T07:22:10.822458+0000 mgr.a (mgr.14388) 13446 : audit [DBG] from='client.293151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:11 smithi163 bash[24253]: audit 2024-08-31T07:22:10.822458+0000 mgr.a (mgr.14388) 13446 : audit [DBG] from='client.293151 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:12 smithi191 bash[24992]: cluster 2024-08-31T07:22:11.910176+0000 mgr.a (mgr.14388) 13447 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:12 smithi163 bash[24253]: cluster 2024-08-31T07:22:11.910176+0000 mgr.a (mgr.14388) 13447 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:12 smithi027 bash[22610]: cluster 2024-08-31T07:22:11.910176+0000 mgr.a (mgr.14388) 13447 : cluster [DBG] pgmap v9321: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:14 smithi191 bash[24992]: cluster 2024-08-31T07:22:13.912456+0000 mgr.a (mgr.14388) 13448 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:14 smithi163 bash[24253]: cluster 2024-08-31T07:22:13.912456+0000 mgr.a (mgr.14388) 13448 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:14 smithi027 bash[22610]: cluster 2024-08-31T07:22:13.912456+0000 mgr.a (mgr.14388) 13448 : cluster [DBG] pgmap v9322: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:22:16.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:22:16.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:22:16.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:22:17.029 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:22:17.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:22:17.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:22:17.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:22:17.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:17 smithi191 bash[24992]: cluster 2024-08-31T07:22:15.913207+0000 mgr.a (mgr.14388) 13449 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:17 smithi163 bash[24253]: cluster 2024-08-31T07:22:15.913207+0000 mgr.a (mgr.14388) 13449 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:17 smithi027 bash[22610]: cluster 2024-08-31T07:22:15.913207+0000 mgr.a (mgr.14388) 13449 : cluster [DBG] pgmap v9323: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:18 smithi191 bash[24992]: audit 2024-08-31T07:22:16.585294+0000 mgr.a (mgr.14388) 13450 : audit [DBG] from='client.293226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:18 smithi163 bash[24253]: audit 2024-08-31T07:22:16.585294+0000 mgr.a (mgr.14388) 13450 : audit [DBG] from='client.293226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:18 smithi027 bash[22610]: audit 2024-08-31T07:22:16.585294+0000 mgr.a (mgr.14388) 13450 : audit [DBG] from='client.293226 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:19.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:19 smithi191 bash[24992]: cluster 2024-08-31T07:22:17.914146+0000 mgr.a (mgr.14388) 13451 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:19 smithi163 bash[24253]: cluster 2024-08-31T07:22:17.914146+0000 mgr.a (mgr.14388) 13451 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:19 smithi027 bash[22610]: cluster 2024-08-31T07:22:17.914146+0000 mgr.a (mgr.14388) 13451 : cluster [DBG] pgmap v9324: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:20 smithi163 bash[24253]: cluster 2024-08-31T07:22:19.916385+0000 mgr.a (mgr.14388) 13452 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:22:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:20 smithi027 bash[22610]: cluster 2024-08-31T07:22:19.916385+0000 mgr.a (mgr.14388) 13452 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:22:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:20 smithi191 bash[24992]: cluster 2024-08-31T07:22:19.916385+0000 mgr.a (mgr.14388) 13452 : cluster [DBG] pgmap v9325: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:22:22.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:22:22.032 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:22:22.032 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:22:22.782 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:22:22.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:22:22.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:22:22.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:22:22.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:22 smithi027 bash[22610]: cluster 2024-08-31T07:22:21.917153+0000 mgr.a (mgr.14388) 13453 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:22 smithi191 bash[24992]: cluster 2024-08-31T07:22:21.917153+0000 mgr.a (mgr.14388) 13453 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:22 smithi163 bash[24253]: cluster 2024-08-31T07:22:21.917153+0000 mgr.a (mgr.14388) 13453 : cluster [DBG] pgmap v9326: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:23 smithi027 bash[22610]: audit 2024-08-31T07:22:22.361167+0000 mgr.a (mgr.14388) 13454 : audit [DBG] from='client.293301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:23 smithi191 bash[24992]: audit 2024-08-31T07:22:22.361167+0000 mgr.a (mgr.14388) 13454 : audit [DBG] from='client.293301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:23 smithi163 bash[24253]: audit 2024-08-31T07:22:22.361167+0000 mgr.a (mgr.14388) 13454 : audit [DBG] from='client.293301 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:24 smithi191 bash[24992]: cluster 2024-08-31T07:22:23.919514+0000 mgr.a (mgr.14388) 13455 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:22:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:24 smithi163 bash[24253]: cluster 2024-08-31T07:22:23.919514+0000 mgr.a (mgr.14388) 13455 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:22:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:24 smithi027 bash[22610]: cluster 2024-08-31T07:22:23.919514+0000 mgr.a (mgr.14388) 13455 : cluster [DBG] pgmap v9327: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:22:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:26 smithi191 bash[24992]: cluster 2024-08-31T07:22:25.920286+0000 mgr.a (mgr.14388) 13456 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:26 smithi163 bash[24253]: cluster 2024-08-31T07:22:25.920286+0000 mgr.a (mgr.14388) 13456 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:27.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:26 smithi027 bash[22610]: cluster 2024-08-31T07:22:25.920286+0000 mgr.a (mgr.14388) 13456 : cluster [DBG] pgmap v9328: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:27.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:22:27.785 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:22:27.785 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:22:28.548 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:22:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:22:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:22:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:22:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:28 smithi191 bash[24992]: cluster 2024-08-31T07:22:27.920824+0000 mgr.a (mgr.14388) 13457 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:28 smithi163 bash[24253]: cluster 2024-08-31T07:22:27.920824+0000 mgr.a (mgr.14388) 13457 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:28 smithi027 bash[22610]: cluster 2024-08-31T07:22:27.920824+0000 mgr.a (mgr.14388) 13457 : cluster [DBG] pgmap v9329: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:30 smithi191 bash[24992]: audit 2024-08-31T07:22:28.123128+0000 mgr.a (mgr.14388) 13458 : audit [DBG] from='client.293379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:30 smithi163 bash[24253]: audit 2024-08-31T07:22:28.123128+0000 mgr.a (mgr.14388) 13458 : audit [DBG] from='client.293379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:30 smithi027 bash[22610]: audit 2024-08-31T07:22:28.123128+0000 mgr.a (mgr.14388) 13458 : audit [DBG] from='client.293379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:31 smithi191 bash[24992]: cluster 2024-08-31T07:22:29.923525+0000 mgr.a (mgr.14388) 13459 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:31 smithi163 bash[24253]: cluster 2024-08-31T07:22:29.923525+0000 mgr.a (mgr.14388) 13459 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:31 smithi027 bash[22610]: cluster 2024-08-31T07:22:29.923525+0000 mgr.a (mgr.14388) 13459 : cluster [DBG] pgmap v9330: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:33 smithi191 bash[24992]: cluster 2024-08-31T07:22:31.924318+0000 mgr.a (mgr.14388) 13460 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:22:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:33 smithi163 bash[24253]: cluster 2024-08-31T07:22:31.924318+0000 mgr.a (mgr.14388) 13460 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:22:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:33 smithi027 bash[22610]: cluster 2024-08-31T07:22:31.924318+0000 mgr.a (mgr.14388) 13460 : cluster [DBG] pgmap v9331: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:22:33.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:22:33.550 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:22:33.551 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:22:34.293 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:22:34.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:22:34.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:22:34.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:22:34.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:35 smithi191 bash[24992]: audit 2024-08-31T07:22:33.878753+0000 mgr.a (mgr.14388) 13461 : audit [DBG] from='client.293454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:35 smithi191 bash[24992]: cluster 2024-08-31T07:22:33.926335+0000 mgr.a (mgr.14388) 13462 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:35 smithi163 bash[24253]: audit 2024-08-31T07:22:33.878753+0000 mgr.a (mgr.14388) 13461 : audit [DBG] from='client.293454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:35 smithi163 bash[24253]: cluster 2024-08-31T07:22:33.926335+0000 mgr.a (mgr.14388) 13462 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:35 smithi027 bash[22610]: audit 2024-08-31T07:22:33.878753+0000 mgr.a (mgr.14388) 13461 : audit [DBG] from='client.293454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:35 smithi027 bash[22610]: cluster 2024-08-31T07:22:33.926335+0000 mgr.a (mgr.14388) 13462 : cluster [DBG] pgmap v9332: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:22:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:37 smithi191 bash[24992]: cluster 2024-08-31T07:22:35.927258+0000 mgr.a (mgr.14388) 13463 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:22:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:37 smithi163 bash[24253]: cluster 2024-08-31T07:22:35.927258+0000 mgr.a (mgr.14388) 13463 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:22:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:37 smithi027 bash[22610]: cluster 2024-08-31T07:22:35.927258+0000 mgr.a (mgr.14388) 13463 : cluster [DBG] pgmap v9333: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:22:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:38 smithi163 bash[24253]: cluster 2024-08-31T07:22:37.928053+0000 mgr.a (mgr.14388) 13464 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:22:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:38 smithi027 bash[22610]: cluster 2024-08-31T07:22:37.928053+0000 mgr.a (mgr.14388) 13464 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:22:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:38 smithi191 bash[24992]: cluster 2024-08-31T07:22:37.928053+0000 mgr.a (mgr.14388) 13464 : cluster [DBG] pgmap v9334: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:22:39.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:22:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:22:39.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:22:40.066 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:22:40.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:22:40.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:22:40.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:22:40.067 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:40 smithi191 bash[24992]: audit 2024-08-31T07:22:39.633085+0000 mgr.a (mgr.14388) 13465 : audit [DBG] from='client.293532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:40 smithi191 bash[24992]: cluster 2024-08-31T07:22:39.929361+0000 mgr.a (mgr.14388) 13466 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:40 smithi163 bash[24253]: audit 2024-08-31T07:22:39.633085+0000 mgr.a (mgr.14388) 13465 : audit [DBG] from='client.293532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:40 smithi163 bash[24253]: cluster 2024-08-31T07:22:39.929361+0000 mgr.a (mgr.14388) 13466 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:40 smithi027 bash[22610]: audit 2024-08-31T07:22:39.633085+0000 mgr.a (mgr.14388) 13465 : audit [DBG] from='client.293532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:40 smithi027 bash[22610]: cluster 2024-08-31T07:22:39.929361+0000 mgr.a (mgr.14388) 13466 : cluster [DBG] pgmap v9335: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:42 smithi191 bash[24992]: cluster 2024-08-31T07:22:41.930304+0000 mgr.a (mgr.14388) 13467 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:42 smithi163 bash[24253]: cluster 2024-08-31T07:22:41.930304+0000 mgr.a (mgr.14388) 13467 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:42 smithi027 bash[22610]: cluster 2024-08-31T07:22:41.930304+0000 mgr.a (mgr.14388) 13467 : cluster [DBG] pgmap v9336: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:45.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:22:45.069 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:22:45.069 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:22:45.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:44 smithi191 bash[24992]: cluster 2024-08-31T07:22:43.932531+0000 mgr.a (mgr.14388) 13468 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:22:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:44 smithi163 bash[24253]: cluster 2024-08-31T07:22:43.932531+0000 mgr.a (mgr.14388) 13468 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:22:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:44 smithi027 bash[22610]: cluster 2024-08-31T07:22:43.932531+0000 mgr.a (mgr.14388) 13468 : cluster [DBG] pgmap v9337: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:22:45.821 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:22:45.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:22:45.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:22:45.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:22:45.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:46 smithi191 bash[24992]: audit 2024-08-31T07:22:45.404766+0000 mgr.a (mgr.14388) 13469 : audit [DBG] from='client.293610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:46 smithi191 bash[24992]: cluster 2024-08-31T07:22:45.933664+0000 mgr.a (mgr.14388) 13470 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:22:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:46 smithi163 bash[24253]: audit 2024-08-31T07:22:45.404766+0000 mgr.a (mgr.14388) 13469 : audit [DBG] from='client.293610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:46 smithi163 bash[24253]: cluster 2024-08-31T07:22:45.933664+0000 mgr.a (mgr.14388) 13470 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:22:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:46 smithi027 bash[22610]: audit 2024-08-31T07:22:45.404766+0000 mgr.a (mgr.14388) 13469 : audit [DBG] from='client.293610 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:46 smithi027 bash[22610]: cluster 2024-08-31T07:22:45.933664+0000 mgr.a (mgr.14388) 13470 : cluster [DBG] pgmap v9338: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:22:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:49 smithi191 bash[24992]: cluster 2024-08-31T07:22:47.934515+0000 mgr.a (mgr.14388) 13471 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:22:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:49 smithi163 bash[24253]: cluster 2024-08-31T07:22:47.934515+0000 mgr.a (mgr.14388) 13471 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:22:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:49 smithi027 bash[22610]: cluster 2024-08-31T07:22:47.934515+0000 mgr.a (mgr.14388) 13471 : cluster [DBG] pgmap v9339: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:22:50.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:22:50.823 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:22:50.823 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:22:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:51 smithi191 bash[24992]: cluster 2024-08-31T07:22:49.936749+0000 mgr.a (mgr.14388) 13472 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:22:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:51 smithi163 bash[24253]: cluster 2024-08-31T07:22:49.936749+0000 mgr.a (mgr.14388) 13472 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:22:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:51 smithi027 bash[22610]: cluster 2024-08-31T07:22:49.936749+0000 mgr.a (mgr.14388) 13472 : cluster [DBG] pgmap v9340: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:22:51.581 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:22:51.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:22:51.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:22:51.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:22:51.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:53 smithi191 bash[24992]: audit 2024-08-31T07:22:51.154639+0000 mgr.a (mgr.14388) 13473 : audit [DBG] from='client.293688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:53 smithi191 bash[24992]: cluster 2024-08-31T07:22:51.937712+0000 mgr.a (mgr.14388) 13474 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:22:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:53 smithi163 bash[24253]: audit 2024-08-31T07:22:51.154639+0000 mgr.a (mgr.14388) 13473 : audit [DBG] from='client.293688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:53 smithi163 bash[24253]: cluster 2024-08-31T07:22:51.937712+0000 mgr.a (mgr.14388) 13474 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:22:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:53 smithi027 bash[22610]: audit 2024-08-31T07:22:51.154639+0000 mgr.a (mgr.14388) 13473 : audit [DBG] from='client.293688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:53 smithi027 bash[22610]: cluster 2024-08-31T07:22:51.937712+0000 mgr.a (mgr.14388) 13474 : cluster [DBG] pgmap v9341: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:22:55.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:55 smithi191 bash[24992]: cluster 2024-08-31T07:22:53.940018+0000 mgr.a (mgr.14388) 13475 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:22:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:55 smithi163 bash[24253]: cluster 2024-08-31T07:22:53.940018+0000 mgr.a (mgr.14388) 13475 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:22:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:55 smithi027 bash[22610]: cluster 2024-08-31T07:22:53.940018+0000 mgr.a (mgr.14388) 13475 : cluster [DBG] pgmap v9342: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:22:56.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:22:56.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:22:56.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:22:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:57 smithi191 bash[24992]: cluster 2024-08-31T07:22:55.940775+0000 mgr.a (mgr.14388) 13476 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:57.366 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:22:57.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:22:57.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:22:57.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:22:57.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:22:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:57 smithi163 bash[24253]: cluster 2024-08-31T07:22:55.940775+0000 mgr.a (mgr.14388) 13476 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:57 smithi027 bash[22610]: cluster 2024-08-31T07:22:55.940775+0000 mgr.a (mgr.14388) 13476 : cluster [DBG] pgmap v9343: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:58 smithi191 bash[24992]: audit 2024-08-31T07:22:56.926454+0000 mgr.a (mgr.14388) 13477 : audit [DBG] from='client.293766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:58 smithi163 bash[24253]: audit 2024-08-31T07:22:56.926454+0000 mgr.a (mgr.14388) 13477 : audit [DBG] from='client.293766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:58 smithi027 bash[22610]: audit 2024-08-31T07:22:56.926454+0000 mgr.a (mgr.14388) 13477 : audit [DBG] from='client.293766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:22:59.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:22:59 smithi191 bash[24992]: cluster 2024-08-31T07:22:57.941693+0000 mgr.a (mgr.14388) 13478 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:22:59 smithi163 bash[24253]: cluster 2024-08-31T07:22:57.941693+0000 mgr.a (mgr.14388) 13478 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:22:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:22:59 smithi027 bash[22610]: cluster 2024-08-31T07:22:57.941693+0000 mgr.a (mgr.14388) 13478 : cluster [DBG] pgmap v9344: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:00 smithi191 bash[24992]: cluster 2024-08-31T07:22:59.943954+0000 mgr.a (mgr.14388) 13479 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:00 smithi163 bash[24253]: cluster 2024-08-31T07:22:59.943954+0000 mgr.a (mgr.14388) 13479 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:00 smithi027 bash[22610]: cluster 2024-08-31T07:22:59.943954+0000 mgr.a (mgr.14388) 13479 : cluster [DBG] pgmap v9345: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:01 smithi191 bash[24992]: audit 2024-08-31T07:23:00.841454+0000 mon.a (mon.0) 2595 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:23:01.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:01 smithi163 bash[24253]: audit 2024-08-31T07:23:00.841454+0000 mon.a (mon.0) 2595 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:23:01.486 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:01 smithi027 bash[22610]: audit 2024-08-31T07:23:00.841454+0000 mon.a (mon.0) 2595 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:23:02.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:23:02.368 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:23:02.368 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:23:02.426 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:02 smithi027 bash[22610]: audit 2024-08-31T07:23:01.675449+0000 mon.a (mon.0) 2596 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:23:02.426 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:02 smithi027 bash[22610]: audit 2024-08-31T07:23:01.677272+0000 mon.a (mon.0) 2597 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:23:02.426 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:02 smithi027 bash[22610]: audit 2024-08-31T07:23:01.685512+0000 mon.a (mon.0) 2598 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:23:02.426 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:02 smithi027 bash[22610]: audit 2024-08-31T07:23:01.690306+0000 mon.a (mon.0) 2599 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:23:02.426 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:02 smithi027 bash[22610]: audit 2024-08-31T07:23:01.692592+0000 mgr.a (mgr.14388) 13480 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:23:02.426 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:02 smithi027 bash[22610]: cluster 2024-08-31T07:23:01.944475+0000 mgr.a (mgr.14388) 13481 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:02 smithi163 bash[24253]: audit 2024-08-31T07:23:01.675449+0000 mon.a (mon.0) 2596 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:23:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:02 smithi163 bash[24253]: audit 2024-08-31T07:23:01.677272+0000 mon.a (mon.0) 2597 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:23:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:02 smithi163 bash[24253]: audit 2024-08-31T07:23:01.685512+0000 mon.a (mon.0) 2598 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:23:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:02 smithi163 bash[24253]: audit 2024-08-31T07:23:01.690306+0000 mon.a (mon.0) 2599 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:23:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:02 smithi163 bash[24253]: audit 2024-08-31T07:23:01.692592+0000 mgr.a (mgr.14388) 13480 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:23:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:02 smithi163 bash[24253]: cluster 2024-08-31T07:23:01.944475+0000 mgr.a (mgr.14388) 13481 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:02 smithi191 bash[24992]: audit 2024-08-31T07:23:01.675449+0000 mon.a (mon.0) 2596 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:23:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:02 smithi191 bash[24992]: audit 2024-08-31T07:23:01.677272+0000 mon.a (mon.0) 2597 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:23:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:02 smithi191 bash[24992]: audit 2024-08-31T07:23:01.685512+0000 mon.a (mon.0) 2598 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:23:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:02 smithi191 bash[24992]: audit 2024-08-31T07:23:01.690306+0000 mon.a (mon.0) 2599 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:23:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:02 smithi191 bash[24992]: audit 2024-08-31T07:23:01.692592+0000 mgr.a (mgr.14388) 13480 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:23:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:02 smithi191 bash[24992]: cluster 2024-08-31T07:23:01.944475+0000 mgr.a (mgr.14388) 13481 : cluster [DBG] pgmap v9346: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:02.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:23:02 smithi027 bash[22863]: debug 2024-08-31T07:23:02.421+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:23:02.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:23:02 smithi027 bash[22863]: debug 2024-08-31T07:23:02.425+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:23:03.097 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:23:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:23:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:23:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:23:03.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:23:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:03 smithi163 bash[24253]: audit 2024-08-31T07:23:02.425511+0000 mgr.a (mgr.14388) 13482 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:23:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:03 smithi163 bash[24253]: cephadm 2024-08-31T07:23:02.426748+0000 mgr.a (mgr.14388) 13483 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:23:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:03 smithi163 bash[24253]: audit 2024-08-31T07:23:02.679061+0000 mgr.a (mgr.14388) 13484 : audit [DBG] from='client.293949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:03 smithi027 bash[22610]: audit 2024-08-31T07:23:02.425511+0000 mgr.a (mgr.14388) 13482 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:23:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:03 smithi027 bash[22610]: cephadm 2024-08-31T07:23:02.426748+0000 mgr.a (mgr.14388) 13483 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:23:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:03 smithi027 bash[22610]: audit 2024-08-31T07:23:02.679061+0000 mgr.a (mgr.14388) 13484 : audit [DBG] from='client.293949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:03 smithi191 bash[24992]: audit 2024-08-31T07:23:02.425511+0000 mgr.a (mgr.14388) 13482 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:23:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:03 smithi191 bash[24992]: cephadm 2024-08-31T07:23:02.426748+0000 mgr.a (mgr.14388) 13483 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:23:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:03 smithi191 bash[24992]: audit 2024-08-31T07:23:02.679061+0000 mgr.a (mgr.14388) 13484 : audit [DBG] from='client.293949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:04 smithi027 bash[22610]: cluster 2024-08-31T07:23:03.947222+0000 mgr.a (mgr.14388) 13485 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:23:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:04 smithi191 bash[24992]: cluster 2024-08-31T07:23:03.947222+0000 mgr.a (mgr.14388) 13485 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:23:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:04 smithi163 bash[24253]: cluster 2024-08-31T07:23:03.947222+0000 mgr.a (mgr.14388) 13485 : cluster [DBG] pgmap v9347: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:23:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:07 smithi191 bash[24992]: cluster 2024-08-31T07:23:05.948035+0000 mgr.a (mgr.14388) 13486 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:23:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:07 smithi163 bash[24253]: cluster 2024-08-31T07:23:05.948035+0000 mgr.a (mgr.14388) 13486 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:23:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:07 smithi027 bash[22610]: cluster 2024-08-31T07:23:05.948035+0000 mgr.a (mgr.14388) 13486 : cluster [DBG] pgmap v9348: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:23:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:23:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:23:08.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:23:08.861 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:23:08.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:23:08.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:23:08.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:23:08.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:23:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:09 smithi191 bash[24992]: cluster 2024-08-31T07:23:07.949200+0000 mgr.a (mgr.14388) 13487 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:23:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:09 smithi163 bash[24253]: cluster 2024-08-31T07:23:07.949200+0000 mgr.a (mgr.14388) 13487 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:23:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:09 smithi027 bash[22610]: cluster 2024-08-31T07:23:07.949200+0000 mgr.a (mgr.14388) 13487 : cluster [DBG] pgmap v9349: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:23:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:10 smithi191 bash[24992]: audit 2024-08-31T07:23:08.434109+0000 mgr.a (mgr.14388) 13488 : audit [DBG] from='client.294027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:10 smithi163 bash[24253]: audit 2024-08-31T07:23:08.434109+0000 mgr.a (mgr.14388) 13488 : audit [DBG] from='client.294027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:10 smithi027 bash[22610]: audit 2024-08-31T07:23:08.434109+0000 mgr.a (mgr.14388) 13488 : audit [DBG] from='client.294027 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:11 smithi191 bash[24992]: cluster 2024-08-31T07:23:09.951463+0000 mgr.a (mgr.14388) 13489 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:23:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:11 smithi163 bash[24253]: cluster 2024-08-31T07:23:09.951463+0000 mgr.a (mgr.14388) 13489 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:23:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:11 smithi027 bash[22610]: cluster 2024-08-31T07:23:09.951463+0000 mgr.a (mgr.14388) 13489 : cluster [DBG] pgmap v9350: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:23:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:13 smithi191 bash[24992]: cluster 2024-08-31T07:23:11.952234+0000 mgr.a (mgr.14388) 13490 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:23:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:13 smithi163 bash[24253]: cluster 2024-08-31T07:23:11.952234+0000 mgr.a (mgr.14388) 13490 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:23:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:13 smithi027 bash[22610]: cluster 2024-08-31T07:23:11.952234+0000 mgr.a (mgr.14388) 13490 : cluster [DBG] pgmap v9351: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:23:13.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:23:13.863 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:23:13.863 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:23:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:14 smithi163 bash[24253]: cluster 2024-08-31T07:23:13.953231+0000 mgr.a (mgr.14388) 13491 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:23:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:14 smithi027 bash[22610]: cluster 2024-08-31T07:23:13.953231+0000 mgr.a (mgr.14388) 13491 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:23:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:14 smithi191 bash[24992]: cluster 2024-08-31T07:23:13.953231+0000 mgr.a (mgr.14388) 13491 : cluster [DBG] pgmap v9352: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:23:14.615 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:23:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:23:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:23:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:23:14.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:23:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:15 smithi163 bash[24253]: audit 2024-08-31T07:23:14.198351+0000 mgr.a (mgr.14388) 13492 : audit [DBG] from='client.294105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:15 smithi027 bash[22610]: audit 2024-08-31T07:23:14.198351+0000 mgr.a (mgr.14388) 13492 : audit [DBG] from='client.294105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:15.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:15 smithi191 bash[24992]: audit 2024-08-31T07:23:14.198351+0000 mgr.a (mgr.14388) 13492 : audit [DBG] from='client.294105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:16 smithi163 bash[24253]: cluster 2024-08-31T07:23:15.954080+0000 mgr.a (mgr.14388) 13493 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:23:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:16 smithi027 bash[22610]: cluster 2024-08-31T07:23:15.954080+0000 mgr.a (mgr.14388) 13493 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:23:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:16 smithi191 bash[24992]: cluster 2024-08-31T07:23:15.954080+0000 mgr.a (mgr.14388) 13493 : cluster [DBG] pgmap v9353: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:23:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:19 smithi191 bash[24992]: cluster 2024-08-31T07:23:17.955471+0000 mgr.a (mgr.14388) 13494 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T07:23:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:19 smithi163 bash[24253]: cluster 2024-08-31T07:23:17.955471+0000 mgr.a (mgr.14388) 13494 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T07:23:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:19 smithi027 bash[22610]: cluster 2024-08-31T07:23:17.955471+0000 mgr.a (mgr.14388) 13494 : cluster [DBG] pgmap v9354: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T07:23:19.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:23:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:23:19.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:23:20.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:23:20.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:23:20.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:23:20.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:23:20.384 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:23:21.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:21 smithi191 bash[24992]: audit 2024-08-31T07:23:19.947668+0000 mgr.a (mgr.14388) 13495 : audit [DBG] from='client.294180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:21 smithi191 bash[24992]: cluster 2024-08-31T07:23:19.963379+0000 mgr.a (mgr.14388) 13496 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:23:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:21 smithi163 bash[24253]: audit 2024-08-31T07:23:19.947668+0000 mgr.a (mgr.14388) 13495 : audit [DBG] from='client.294180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:21 smithi163 bash[24253]: cluster 2024-08-31T07:23:19.963379+0000 mgr.a (mgr.14388) 13496 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:23:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:21 smithi027 bash[22610]: audit 2024-08-31T07:23:19.947668+0000 mgr.a (mgr.14388) 13495 : audit [DBG] from='client.294180 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:21 smithi027 bash[22610]: cluster 2024-08-31T07:23:19.963379+0000 mgr.a (mgr.14388) 13496 : cluster [DBG] pgmap v9355: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:23:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:23 smithi191 bash[24992]: cluster 2024-08-31T07:23:21.964361+0000 mgr.a (mgr.14388) 13497 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:23 smithi163 bash[24253]: cluster 2024-08-31T07:23:21.964361+0000 mgr.a (mgr.14388) 13497 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:23 smithi027 bash[22610]: cluster 2024-08-31T07:23:21.964361+0000 mgr.a (mgr.14388) 13497 : cluster [DBG] pgmap v9356: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:25 smithi191 bash[24992]: cluster 2024-08-31T07:23:23.966617+0000 mgr.a (mgr.14388) 13498 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:25.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:23:25.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:23:25.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:23:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:25 smithi163 bash[24253]: cluster 2024-08-31T07:23:23.966617+0000 mgr.a (mgr.14388) 13498 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:25 smithi027 bash[22610]: cluster 2024-08-31T07:23:23.966617+0000 mgr.a (mgr.14388) 13498 : cluster [DBG] pgmap v9357: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:26.156 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:23:26.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:23:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:23:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:23:26.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:23:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:26 smithi163 bash[24253]: audit 2024-08-31T07:23:25.718663+0000 mgr.a (mgr.14388) 13499 : audit [DBG] from='client.294255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:26 smithi163 bash[24253]: cluster 2024-08-31T07:23:25.967402+0000 mgr.a (mgr.14388) 13500 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:26 smithi027 bash[22610]: audit 2024-08-31T07:23:25.718663+0000 mgr.a (mgr.14388) 13499 : audit [DBG] from='client.294255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:26 smithi027 bash[22610]: cluster 2024-08-31T07:23:25.967402+0000 mgr.a (mgr.14388) 13500 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:26 smithi191 bash[24992]: audit 2024-08-31T07:23:25.718663+0000 mgr.a (mgr.14388) 13499 : audit [DBG] from='client.294255 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:26 smithi191 bash[24992]: cluster 2024-08-31T07:23:25.967402+0000 mgr.a (mgr.14388) 13500 : cluster [DBG] pgmap v9358: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:29 smithi191 bash[24992]: cluster 2024-08-31T07:23:27.969598+0000 mgr.a (mgr.14388) 13501 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:29 smithi163 bash[24253]: cluster 2024-08-31T07:23:27.969598+0000 mgr.a (mgr.14388) 13501 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:29 smithi027 bash[22610]: cluster 2024-08-31T07:23:27.969598+0000 mgr.a (mgr.14388) 13501 : cluster [DBG] pgmap v9359: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:30 smithi163 bash[24253]: cluster 2024-08-31T07:23:29.970389+0000 mgr.a (mgr.14388) 13502 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:23:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:30 smithi027 bash[22610]: cluster 2024-08-31T07:23:29.970389+0000 mgr.a (mgr.14388) 13502 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:23:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:30 smithi191 bash[24992]: cluster 2024-08-31T07:23:29.970389+0000 mgr.a (mgr.14388) 13502 : cluster [DBG] pgmap v9360: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:23:31.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:23:31.158 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:23:31.158 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:23:31.938 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:23:31.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:23:31.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:23:31.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:23:31.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:23:33.291 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:33 smithi191 bash[24992]: audit 2024-08-31T07:23:31.489355+0000 mgr.a (mgr.14388) 13503 : audit [DBG] from='client.294333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:33.292 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:33 smithi191 bash[24992]: cluster 2024-08-31T07:23:31.970936+0000 mgr.a (mgr.14388) 13504 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:33 smithi163 bash[24253]: audit 2024-08-31T07:23:31.489355+0000 mgr.a (mgr.14388) 13503 : audit [DBG] from='client.294333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:33 smithi163 bash[24253]: cluster 2024-08-31T07:23:31.970936+0000 mgr.a (mgr.14388) 13504 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:33.488 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:33 smithi027 bash[22610]: audit 2024-08-31T07:23:31.489355+0000 mgr.a (mgr.14388) 13503 : audit [DBG] from='client.294333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:33.488 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:33 smithi027 bash[22610]: cluster 2024-08-31T07:23:31.970936+0000 mgr.a (mgr.14388) 13504 : cluster [DBG] pgmap v9361: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:34 smithi163 bash[24253]: cluster 2024-08-31T07:23:33.973134+0000 mgr.a (mgr.14388) 13505 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:34 smithi027 bash[22610]: cluster 2024-08-31T07:23:33.973134+0000 mgr.a (mgr.14388) 13505 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:34 smithi191 bash[24992]: cluster 2024-08-31T07:23:33.973134+0000 mgr.a (mgr.14388) 13505 : cluster [DBG] pgmap v9362: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:36 smithi163 bash[24253]: cluster 2024-08-31T07:23:35.973889+0000 mgr.a (mgr.14388) 13506 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:36 smithi027 bash[22610]: cluster 2024-08-31T07:23:35.973889+0000 mgr.a (mgr.14388) 13506 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:36 smithi191 bash[24992]: cluster 2024-08-31T07:23:35.973889+0000 mgr.a (mgr.14388) 13506 : cluster [DBG] pgmap v9363: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:36.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:23:36.940 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:23:36.940 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:23:37.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:23:37.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:23:37.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:23:37.735 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:23:37.735 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:23:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:38 smithi163 bash[24253]: audit 2024-08-31T07:23:37.272826+0000 mgr.a (mgr.14388) 13507 : audit [DBG] from='client.294411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:38 smithi163 bash[24253]: cluster 2024-08-31T07:23:37.976355+0000 mgr.a (mgr.14388) 13508 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:38 smithi027 bash[22610]: audit 2024-08-31T07:23:37.272826+0000 mgr.a (mgr.14388) 13507 : audit [DBG] from='client.294411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:38 smithi027 bash[22610]: cluster 2024-08-31T07:23:37.976355+0000 mgr.a (mgr.14388) 13508 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:38 smithi191 bash[24992]: audit 2024-08-31T07:23:37.272826+0000 mgr.a (mgr.14388) 13507 : audit [DBG] from='client.294411 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:38 smithi191 bash[24992]: cluster 2024-08-31T07:23:37.976355+0000 mgr.a (mgr.14388) 13508 : cluster [DBG] pgmap v9364: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:40 smithi163 bash[24253]: cluster 2024-08-31T07:23:39.977153+0000 mgr.a (mgr.14388) 13509 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:40 smithi027 bash[22610]: cluster 2024-08-31T07:23:39.977153+0000 mgr.a (mgr.14388) 13509 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:40 smithi191 bash[24992]: cluster 2024-08-31T07:23:39.977153+0000 mgr.a (mgr.14388) 13509 : cluster [DBG] pgmap v9365: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:42 smithi163 bash[24253]: cluster 2024-08-31T07:23:41.977900+0000 mgr.a (mgr.14388) 13510 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:42 smithi027 bash[22610]: cluster 2024-08-31T07:23:41.977900+0000 mgr.a (mgr.14388) 13510 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:42 smithi191 bash[24992]: cluster 2024-08-31T07:23:41.977900+0000 mgr.a (mgr.14388) 13510 : cluster [DBG] pgmap v9366: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:42.736 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:23:42.737 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:23:42.737 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:23:43.491 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:23:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:23:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:23:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:23:43.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:23:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:44 smithi163 bash[24253]: audit 2024-08-31T07:23:43.069646+0000 mgr.a (mgr.14388) 13511 : audit [DBG] from='client.294489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:44 smithi163 bash[24253]: cluster 2024-08-31T07:23:43.980609+0000 mgr.a (mgr.14388) 13512 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:44 smithi027 bash[22610]: audit 2024-08-31T07:23:43.069646+0000 mgr.a (mgr.14388) 13511 : audit [DBG] from='client.294489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:44 smithi027 bash[22610]: cluster 2024-08-31T07:23:43.980609+0000 mgr.a (mgr.14388) 13512 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:44 smithi191 bash[24992]: audit 2024-08-31T07:23:43.069646+0000 mgr.a (mgr.14388) 13511 : audit [DBG] from='client.294489 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:44 smithi191 bash[24992]: cluster 2024-08-31T07:23:43.980609+0000 mgr.a (mgr.14388) 13512 : cluster [DBG] pgmap v9367: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:46 smithi163 bash[24253]: cluster 2024-08-31T07:23:45.981389+0000 mgr.a (mgr.14388) 13513 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:23:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:46 smithi027 bash[22610]: cluster 2024-08-31T07:23:45.981389+0000 mgr.a (mgr.14388) 13513 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:23:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:46 smithi191 bash[24992]: cluster 2024-08-31T07:23:45.981389+0000 mgr.a (mgr.14388) 13513 : cluster [DBG] pgmap v9368: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:23:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:48 smithi163 bash[24253]: cluster 2024-08-31T07:23:47.983320+0000 mgr.a (mgr.14388) 13514 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:48 smithi027 bash[22610]: cluster 2024-08-31T07:23:47.983320+0000 mgr.a (mgr.14388) 13514 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:48.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:23:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:23:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:23:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:48 smithi191 bash[24992]: cluster 2024-08-31T07:23:47.983320+0000 mgr.a (mgr.14388) 13514 : cluster [DBG] pgmap v9369: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:49.294 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:23:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:23:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:23:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:23:49.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:23:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:49 smithi163 bash[24253]: audit 2024-08-31T07:23:48.829871+0000 mgr.a (mgr.14388) 13515 : audit [DBG] from='client.294567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:49 smithi027 bash[22610]: audit 2024-08-31T07:23:48.829871+0000 mgr.a (mgr.14388) 13515 : audit [DBG] from='client.294567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:49 smithi191 bash[24992]: audit 2024-08-31T07:23:48.829871+0000 mgr.a (mgr.14388) 13515 : audit [DBG] from='client.294567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:50 smithi163 bash[24253]: cluster 2024-08-31T07:23:49.984202+0000 mgr.a (mgr.14388) 13516 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:23:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:50 smithi027 bash[22610]: cluster 2024-08-31T07:23:49.984202+0000 mgr.a (mgr.14388) 13516 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:23:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:50 smithi191 bash[24992]: cluster 2024-08-31T07:23:49.984202+0000 mgr.a (mgr.14388) 13516 : cluster [DBG] pgmap v9370: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:23:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:52 smithi163 bash[24253]: cluster 2024-08-31T07:23:51.984980+0000 mgr.a (mgr.14388) 13517 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:23:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:52 smithi027 bash[22610]: cluster 2024-08-31T07:23:51.984980+0000 mgr.a (mgr.14388) 13517 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:23:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:52 smithi191 bash[24992]: cluster 2024-08-31T07:23:51.984980+0000 mgr.a (mgr.14388) 13517 : cluster [DBG] pgmap v9371: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:23:54.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:23:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:23:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:23:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:54 smithi163 bash[24253]: cluster 2024-08-31T07:23:53.987145+0000 mgr.a (mgr.14388) 13518 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:54 smithi027 bash[22610]: cluster 2024-08-31T07:23:53.987145+0000 mgr.a (mgr.14388) 13518 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:54 smithi191 bash[24992]: cluster 2024-08-31T07:23:53.987145+0000 mgr.a (mgr.14388) 13518 : cluster [DBG] pgmap v9372: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:55.073 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:23:55.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:23:55.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:23:55.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:23:55.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:23:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:55 smithi163 bash[24253]: audit 2024-08-31T07:23:54.632757+0000 mgr.a (mgr.14388) 13519 : audit [DBG] from='client.294645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:55 smithi027 bash[22610]: audit 2024-08-31T07:23:54.632757+0000 mgr.a (mgr.14388) 13519 : audit [DBG] from='client.294645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:55 smithi191 bash[24992]: audit 2024-08-31T07:23:54.632757+0000 mgr.a (mgr.14388) 13519 : audit [DBG] from='client.294645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:23:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:56 smithi163 bash[24253]: cluster 2024-08-31T07:23:55.988045+0000 mgr.a (mgr.14388) 13520 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:56 smithi027 bash[22610]: cluster 2024-08-31T07:23:55.988045+0000 mgr.a (mgr.14388) 13520 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:56 smithi191 bash[24992]: cluster 2024-08-31T07:23:55.988045+0000 mgr.a (mgr.14388) 13520 : cluster [DBG] pgmap v9373: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:23:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:23:58 smithi163 bash[24253]: cluster 2024-08-31T07:23:57.990193+0000 mgr.a (mgr.14388) 13521 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:23:58 smithi027 bash[22610]: cluster 2024-08-31T07:23:57.990193+0000 mgr.a (mgr.14388) 13521 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:23:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:23:58 smithi191 bash[24992]: cluster 2024-08-31T07:23:57.990193+0000 mgr.a (mgr.14388) 13521 : cluster [DBG] pgmap v9374: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:00.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:00.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:00.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:00 smithi163 bash[24253]: cluster 2024-08-31T07:23:59.991104+0000 mgr.a (mgr.14388) 13522 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:00 smithi027 bash[22610]: cluster 2024-08-31T07:23:59.991104+0000 mgr.a (mgr.14388) 13522 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:00 smithi191 bash[24992]: cluster 2024-08-31T07:23:59.991104+0000 mgr.a (mgr.14388) 13522 : cluster [DBG] pgmap v9375: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:00.842 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:00.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:00.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:00.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:00.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:01 smithi163 bash[24253]: audit 2024-08-31T07:24:00.406201+0000 mgr.a (mgr.14388) 13523 : audit [DBG] from='client.294723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:01 smithi027 bash[22610]: audit 2024-08-31T07:24:00.406201+0000 mgr.a (mgr.14388) 13523 : audit [DBG] from='client.294723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:01 smithi191 bash[24992]: audit 2024-08-31T07:24:00.406201+0000 mgr.a (mgr.14388) 13523 : audit [DBG] from='client.294723 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:02 smithi163 bash[24253]: cluster 2024-08-31T07:24:01.992136+0000 mgr.a (mgr.14388) 13524 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:02.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:02 smithi027 bash[22610]: cluster 2024-08-31T07:24:01.992136+0000 mgr.a (mgr.14388) 13524 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:02 smithi191 bash[24992]: cluster 2024-08-31T07:24:01.992136+0000 mgr.a (mgr.14388) 13524 : cluster [DBG] pgmap v9376: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:03 smithi163 bash[24253]: audit 2024-08-31T07:24:02.479177+0000 mon.a (mon.0) 2600 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:24:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:03 smithi027 bash[22610]: audit 2024-08-31T07:24:02.479177+0000 mon.a (mon.0) 2600 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:24:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:03 smithi191 bash[24992]: audit 2024-08-31T07:24:02.479177+0000 mon.a (mon.0) 2600 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:24:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:04 smithi163 bash[24253]: audit 2024-08-31T07:24:03.320592+0000 mon.a (mon.0) 2601 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:24:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:04 smithi163 bash[24253]: audit 2024-08-31T07:24:03.322137+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:24:04.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:04 smithi163 bash[24253]: audit 2024-08-31T07:24:03.332013+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:24:04.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:04 smithi163 bash[24253]: audit 2024-08-31T07:24:03.336817+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:24:04.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:04 smithi163 bash[24253]: audit 2024-08-31T07:24:03.339158+0000 mgr.a (mgr.14388) 13525 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:24:04.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:04 smithi163 bash[24253]: cluster 2024-08-31T07:24:03.993487+0000 mgr.a (mgr.14388) 13526 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:04.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:24:04 smithi027 bash[22863]: debug 2024-08-31T07:24:04.084+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:24:04.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:24:04 smithi027 bash[22863]: debug 2024-08-31T07:24:04.088+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:24:04.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:04 smithi027 bash[22610]: audit 2024-08-31T07:24:03.320592+0000 mon.a (mon.0) 2601 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:24:04.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:04 smithi027 bash[22610]: audit 2024-08-31T07:24:03.322137+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:24:04.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:04 smithi027 bash[22610]: audit 2024-08-31T07:24:03.332013+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:24:04.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:04 smithi027 bash[22610]: audit 2024-08-31T07:24:03.336817+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:24:04.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:04 smithi027 bash[22610]: audit 2024-08-31T07:24:03.339158+0000 mgr.a (mgr.14388) 13525 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:24:04.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:04 smithi027 bash[22610]: cluster 2024-08-31T07:24:03.993487+0000 mgr.a (mgr.14388) 13526 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:04 smithi191 bash[24992]: audit 2024-08-31T07:24:03.320592+0000 mon.a (mon.0) 2601 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:24:04.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:04 smithi191 bash[24992]: audit 2024-08-31T07:24:03.322137+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:24:04.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:04 smithi191 bash[24992]: audit 2024-08-31T07:24:03.332013+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:24:04.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:04 smithi191 bash[24992]: audit 2024-08-31T07:24:03.336817+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:24:04.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:04 smithi191 bash[24992]: audit 2024-08-31T07:24:03.339158+0000 mgr.a (mgr.14388) 13525 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:24:04.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:04 smithi191 bash[24992]: cluster 2024-08-31T07:24:03.993487+0000 mgr.a (mgr.14388) 13526 : cluster [DBG] pgmap v9377: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:05 smithi163 bash[24253]: audit 2024-08-31T07:24:04.090291+0000 mgr.a (mgr.14388) 13527 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:24:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:05 smithi163 bash[24253]: cephadm 2024-08-31T07:24:04.091747+0000 mgr.a (mgr.14388) 13528 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:24:05.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:05 smithi027 bash[22610]: audit 2024-08-31T07:24:04.090291+0000 mgr.a (mgr.14388) 13527 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:24:05.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:05 smithi027 bash[22610]: cephadm 2024-08-31T07:24:04.091747+0000 mgr.a (mgr.14388) 13528 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:24:05.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:05 smithi191 bash[24992]: audit 2024-08-31T07:24:04.090291+0000 mgr.a (mgr.14388) 13527 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:24:05.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:05 smithi191 bash[24992]: cephadm 2024-08-31T07:24:04.091747+0000 mgr.a (mgr.14388) 13528 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:24:05.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:05.844 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:06.624 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:06.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:06.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:06 smithi163 bash[24253]: cluster 2024-08-31T07:24:05.994031+0000 mgr.a (mgr.14388) 13529 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:06 smithi027 bash[22610]: cluster 2024-08-31T07:24:05.994031+0000 mgr.a (mgr.14388) 13529 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:06 smithi191 bash[24992]: cluster 2024-08-31T07:24:05.994031+0000 mgr.a (mgr.14388) 13529 : cluster [DBG] pgmap v9378: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:07 smithi163 bash[24253]: audit 2024-08-31T07:24:06.178242+0000 mgr.a (mgr.14388) 13530 : audit [DBG] from='client.294909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:07 smithi027 bash[22610]: audit 2024-08-31T07:24:06.178242+0000 mgr.a (mgr.14388) 13530 : audit [DBG] from='client.294909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:07 smithi191 bash[24992]: audit 2024-08-31T07:24:06.178242+0000 mgr.a (mgr.14388) 13530 : audit [DBG] from='client.294909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:08 smithi163 bash[24253]: cluster 2024-08-31T07:24:07.996232+0000 mgr.a (mgr.14388) 13531 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:08 smithi027 bash[22610]: cluster 2024-08-31T07:24:07.996232+0000 mgr.a (mgr.14388) 13531 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:08 smithi191 bash[24992]: cluster 2024-08-31T07:24:07.996232+0000 mgr.a (mgr.14388) 13531 : cluster [DBG] pgmap v9379: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:10 smithi163 bash[24253]: cluster 2024-08-31T07:24:09.996984+0000 mgr.a (mgr.14388) 13532 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:10 smithi027 bash[22610]: cluster 2024-08-31T07:24:09.996984+0000 mgr.a (mgr.14388) 13532 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:10 smithi191 bash[24992]: cluster 2024-08-31T07:24:09.996984+0000 mgr.a (mgr.14388) 13532 : cluster [DBG] pgmap v9380: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:11.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:11.626 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:11.626 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:12.397 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:12.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:12.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:12.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:12.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:12 smithi163 bash[24253]: audit 2024-08-31T07:24:11.958474+0000 mgr.a (mgr.14388) 13533 : audit [DBG] from='client.294987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:12.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:12 smithi163 bash[24253]: cluster 2024-08-31T07:24:11.998004+0000 mgr.a (mgr.14388) 13534 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:12 smithi027 bash[22610]: audit 2024-08-31T07:24:11.958474+0000 mgr.a (mgr.14388) 13533 : audit [DBG] from='client.294987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:12 smithi027 bash[22610]: cluster 2024-08-31T07:24:11.998004+0000 mgr.a (mgr.14388) 13534 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:12 smithi191 bash[24992]: audit 2024-08-31T07:24:11.958474+0000 mgr.a (mgr.14388) 13533 : audit [DBG] from='client.294987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:12 smithi191 bash[24992]: cluster 2024-08-31T07:24:11.998004+0000 mgr.a (mgr.14388) 13534 : cluster [DBG] pgmap v9381: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:14 smithi163 bash[24253]: cluster 2024-08-31T07:24:14.000311+0000 mgr.a (mgr.14388) 13535 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:14 smithi027 bash[22610]: cluster 2024-08-31T07:24:14.000311+0000 mgr.a (mgr.14388) 13535 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:14 smithi191 bash[24992]: cluster 2024-08-31T07:24:14.000311+0000 mgr.a (mgr.14388) 13535 : cluster [DBG] pgmap v9382: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:16 smithi163 bash[24253]: cluster 2024-08-31T07:24:16.001059+0000 mgr.a (mgr.14388) 13536 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:16 smithi027 bash[22610]: cluster 2024-08-31T07:24:16.001059+0000 mgr.a (mgr.14388) 13536 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:16 smithi191 bash[24992]: cluster 2024-08-31T07:24:16.001059+0000 mgr.a (mgr.14388) 13536 : cluster [DBG] pgmap v9383: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:17.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:17.400 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:17.400 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:18.158 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:18.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:18.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:18.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:18.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:18 smithi163 bash[24253]: audit 2024-08-31T07:24:17.730219+0000 mgr.a (mgr.14388) 13537 : audit [DBG] from='client.295065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:18 smithi163 bash[24253]: cluster 2024-08-31T07:24:18.002259+0000 mgr.a (mgr.14388) 13538 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:18 smithi027 bash[22610]: audit 2024-08-31T07:24:17.730219+0000 mgr.a (mgr.14388) 13537 : audit [DBG] from='client.295065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:18 smithi027 bash[22610]: cluster 2024-08-31T07:24:18.002259+0000 mgr.a (mgr.14388) 13538 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:18 smithi191 bash[24992]: audit 2024-08-31T07:24:17.730219+0000 mgr.a (mgr.14388) 13537 : audit [DBG] from='client.295065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:18 smithi191 bash[24992]: cluster 2024-08-31T07:24:18.002259+0000 mgr.a (mgr.14388) 13538 : cluster [DBG] pgmap v9384: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:24:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:20 smithi163 bash[24253]: cluster 2024-08-31T07:24:20.003134+0000 mgr.a (mgr.14388) 13539 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:24:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:20 smithi027 bash[22610]: cluster 2024-08-31T07:24:20.003134+0000 mgr.a (mgr.14388) 13539 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:24:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:20 smithi191 bash[24992]: cluster 2024-08-31T07:24:20.003134+0000 mgr.a (mgr.14388) 13539 : cluster [DBG] pgmap v9385: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:24:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:22 smithi163 bash[24253]: cluster 2024-08-31T07:24:22.003910+0000 mgr.a (mgr.14388) 13540 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:24:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:22 smithi027 bash[22610]: cluster 2024-08-31T07:24:22.003910+0000 mgr.a (mgr.14388) 13540 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:24:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:22 smithi191 bash[24992]: cluster 2024-08-31T07:24:22.003910+0000 mgr.a (mgr.14388) 13540 : cluster [DBG] pgmap v9386: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:24:23.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:23.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:23.161 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:23.940 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:23.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:23.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:23.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:23.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:24 smithi163 bash[24253]: audit 2024-08-31T07:24:23.501480+0000 mgr.a (mgr.14388) 13541 : audit [DBG] from='client.295143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:24 smithi163 bash[24253]: cluster 2024-08-31T07:24:24.005538+0000 mgr.a (mgr.14388) 13542 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:24 smithi027 bash[22610]: audit 2024-08-31T07:24:23.501480+0000 mgr.a (mgr.14388) 13541 : audit [DBG] from='client.295143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:24 smithi027 bash[22610]: cluster 2024-08-31T07:24:24.005538+0000 mgr.a (mgr.14388) 13542 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:24 smithi191 bash[24992]: audit 2024-08-31T07:24:23.501480+0000 mgr.a (mgr.14388) 13541 : audit [DBG] from='client.295143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:24 smithi191 bash[24992]: cluster 2024-08-31T07:24:24.005538+0000 mgr.a (mgr.14388) 13542 : cluster [DBG] pgmap v9387: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:26 smithi163 bash[24253]: cluster 2024-08-31T07:24:26.006236+0000 mgr.a (mgr.14388) 13543 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:24:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:26 smithi027 bash[22610]: cluster 2024-08-31T07:24:26.006236+0000 mgr.a (mgr.14388) 13543 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:24:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:26 smithi191 bash[24992]: cluster 2024-08-31T07:24:26.006236+0000 mgr.a (mgr.14388) 13543 : cluster [DBG] pgmap v9388: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:24:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:28 smithi163 bash[24253]: cluster 2024-08-31T07:24:28.008345+0000 mgr.a (mgr.14388) 13544 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:28 smithi027 bash[22610]: cluster 2024-08-31T07:24:28.008345+0000 mgr.a (mgr.14388) 13544 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:28 smithi191 bash[24992]: cluster 2024-08-31T07:24:28.008345+0000 mgr.a (mgr.14388) 13544 : cluster [DBG] pgmap v9389: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:28.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:28.942 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:29.722 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:29.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:29.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:29.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:29.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:30 smithi163 bash[24253]: audit 2024-08-31T07:24:29.280214+0000 mgr.a (mgr.14388) 13545 : audit [DBG] from='client.295221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:30 smithi163 bash[24253]: cluster 2024-08-31T07:24:30.009269+0000 mgr.a (mgr.14388) 13546 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:24:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:30 smithi027 bash[22610]: audit 2024-08-31T07:24:29.280214+0000 mgr.a (mgr.14388) 13545 : audit [DBG] from='client.295221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:30 smithi027 bash[22610]: cluster 2024-08-31T07:24:30.009269+0000 mgr.a (mgr.14388) 13546 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:24:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:30 smithi191 bash[24992]: audit 2024-08-31T07:24:29.280214+0000 mgr.a (mgr.14388) 13545 : audit [DBG] from='client.295221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:30 smithi191 bash[24992]: cluster 2024-08-31T07:24:30.009269+0000 mgr.a (mgr.14388) 13546 : cluster [DBG] pgmap v9390: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:24:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:32 smithi163 bash[24253]: cluster 2024-08-31T07:24:32.010097+0000 mgr.a (mgr.14388) 13547 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:24:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:32 smithi027 bash[22610]: cluster 2024-08-31T07:24:32.010097+0000 mgr.a (mgr.14388) 13547 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:24:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:32 smithi191 bash[24992]: cluster 2024-08-31T07:24:32.010097+0000 mgr.a (mgr.14388) 13547 : cluster [DBG] pgmap v9391: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:24:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:34 smithi163 bash[24253]: cluster 2024-08-31T07:24:34.012368+0000 mgr.a (mgr.14388) 13548 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:24:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:34 smithi027 bash[22610]: cluster 2024-08-31T07:24:34.012368+0000 mgr.a (mgr.14388) 13548 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:24:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:34 smithi191 bash[24992]: cluster 2024-08-31T07:24:34.012368+0000 mgr.a (mgr.14388) 13548 : cluster [DBG] pgmap v9392: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:24:34.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:34.724 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:34.724 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:35.469 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:35.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:35.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:35.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:35.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:36 smithi163 bash[24253]: audit 2024-08-31T07:24:35.056517+0000 mgr.a (mgr.14388) 13549 : audit [DBG] from='client.295299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:36.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:36 smithi163 bash[24253]: cluster 2024-08-31T07:24:36.013316+0000 mgr.a (mgr.14388) 13550 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:36 smithi027 bash[22610]: audit 2024-08-31T07:24:35.056517+0000 mgr.a (mgr.14388) 13549 : audit [DBG] from='client.295299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:36 smithi027 bash[22610]: cluster 2024-08-31T07:24:36.013316+0000 mgr.a (mgr.14388) 13550 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:36 smithi191 bash[24992]: audit 2024-08-31T07:24:35.056517+0000 mgr.a (mgr.14388) 13549 : audit [DBG] from='client.295299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:36 smithi191 bash[24992]: cluster 2024-08-31T07:24:36.013316+0000 mgr.a (mgr.14388) 13550 : cluster [DBG] pgmap v9393: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:38 smithi163 bash[24253]: cluster 2024-08-31T07:24:38.015515+0000 mgr.a (mgr.14388) 13551 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:38 smithi027 bash[22610]: cluster 2024-08-31T07:24:38.015515+0000 mgr.a (mgr.14388) 13551 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:38 smithi191 bash[24992]: cluster 2024-08-31T07:24:38.015515+0000 mgr.a (mgr.14388) 13551 : cluster [DBG] pgmap v9394: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:40 smithi163 bash[24253]: cluster 2024-08-31T07:24:40.016272+0000 mgr.a (mgr.14388) 13552 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:40.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:40.471 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:40 smithi027 bash[22610]: cluster 2024-08-31T07:24:40.016272+0000 mgr.a (mgr.14388) 13552 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:40 smithi191 bash[24992]: cluster 2024-08-31T07:24:40.016272+0000 mgr.a (mgr.14388) 13552 : cluster [DBG] pgmap v9395: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:41.258 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:41.258 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:41.258 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:41.258 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:41.258 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:41 smithi163 bash[24253]: audit 2024-08-31T07:24:40.806003+0000 mgr.a (mgr.14388) 13553 : audit [DBG] from='client.295371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:41 smithi027 bash[22610]: audit 2024-08-31T07:24:40.806003+0000 mgr.a (mgr.14388) 13553 : audit [DBG] from='client.295371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:41 smithi191 bash[24992]: audit 2024-08-31T07:24:40.806003+0000 mgr.a (mgr.14388) 13553 : audit [DBG] from='client.295371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:42 smithi163 bash[24253]: cluster 2024-08-31T07:24:42.017406+0000 mgr.a (mgr.14388) 13554 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:42 smithi027 bash[22610]: cluster 2024-08-31T07:24:42.017406+0000 mgr.a (mgr.14388) 13554 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:42 smithi191 bash[24992]: cluster 2024-08-31T07:24:42.017406+0000 mgr.a (mgr.14388) 13554 : cluster [DBG] pgmap v9396: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:44 smithi163 bash[24253]: cluster 2024-08-31T07:24:44.019780+0000 mgr.a (mgr.14388) 13555 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:44 smithi027 bash[22610]: cluster 2024-08-31T07:24:44.019780+0000 mgr.a (mgr.14388) 13555 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:44 smithi191 bash[24992]: cluster 2024-08-31T07:24:44.019780+0000 mgr.a (mgr.14388) 13555 : cluster [DBG] pgmap v9397: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:46.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:46.260 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:46 smithi163 bash[24253]: cluster 2024-08-31T07:24:46.020572+0000 mgr.a (mgr.14388) 13556 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:46 smithi027 bash[22610]: cluster 2024-08-31T07:24:46.020572+0000 mgr.a (mgr.14388) 13556 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:46 smithi191 bash[24992]: cluster 2024-08-31T07:24:46.020572+0000 mgr.a (mgr.14388) 13556 : cluster [DBG] pgmap v9398: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:47.014 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:47.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:47.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:47.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:47.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:47 smithi163 bash[24253]: audit 2024-08-31T07:24:46.588048+0000 mgr.a (mgr.14388) 13557 : audit [DBG] from='client.295446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:47 smithi027 bash[22610]: audit 2024-08-31T07:24:46.588048+0000 mgr.a (mgr.14388) 13557 : audit [DBG] from='client.295446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:47 smithi191 bash[24992]: audit 2024-08-31T07:24:46.588048+0000 mgr.a (mgr.14388) 13557 : audit [DBG] from='client.295446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:48 smithi163 bash[24253]: cluster 2024-08-31T07:24:48.022858+0000 mgr.a (mgr.14388) 13558 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:48 smithi027 bash[22610]: cluster 2024-08-31T07:24:48.022858+0000 mgr.a (mgr.14388) 13558 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:48 smithi191 bash[24992]: cluster 2024-08-31T07:24:48.022858+0000 mgr.a (mgr.14388) 13558 : cluster [DBG] pgmap v9399: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:50 smithi163 bash[24253]: cluster 2024-08-31T07:24:50.023617+0000 mgr.a (mgr.14388) 13559 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:50 smithi027 bash[22610]: cluster 2024-08-31T07:24:50.023617+0000 mgr.a (mgr.14388) 13559 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:50 smithi191 bash[24992]: cluster 2024-08-31T07:24:50.023617+0000 mgr.a (mgr.14388) 13559 : cluster [DBG] pgmap v9400: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:52 smithi163 bash[24253]: cluster 2024-08-31T07:24:52.024163+0000 mgr.a (mgr.14388) 13560 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:52 smithi027 bash[22610]: cluster 2024-08-31T07:24:52.024163+0000 mgr.a (mgr.14388) 13560 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:52 smithi191 bash[24992]: cluster 2024-08-31T07:24:52.024163+0000 mgr.a (mgr.14388) 13560 : cluster [DBG] pgmap v9401: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:52.762 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:52.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:52.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:52.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:52.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:53 smithi163 bash[24253]: audit 2024-08-31T07:24:52.348051+0000 mgr.a (mgr.14388) 13561 : audit [DBG] from='client.295518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:53 smithi027 bash[22610]: audit 2024-08-31T07:24:52.348051+0000 mgr.a (mgr.14388) 13561 : audit [DBG] from='client.295518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:53 smithi191 bash[24992]: audit 2024-08-31T07:24:52.348051+0000 mgr.a (mgr.14388) 13561 : audit [DBG] from='client.295518 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:54 smithi163 bash[24253]: cluster 2024-08-31T07:24:54.026457+0000 mgr.a (mgr.14388) 13562 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:54 smithi027 bash[22610]: cluster 2024-08-31T07:24:54.026457+0000 mgr.a (mgr.14388) 13562 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:54 smithi191 bash[24992]: cluster 2024-08-31T07:24:54.026457+0000 mgr.a (mgr.14388) 13562 : cluster [DBG] pgmap v9402: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:24:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:56 smithi163 bash[24253]: cluster 2024-08-31T07:24:56.027261+0000 mgr.a (mgr.14388) 13563 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:56 smithi027 bash[22610]: cluster 2024-08-31T07:24:56.027261+0000 mgr.a (mgr.14388) 13563 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:56 smithi191 bash[24992]: cluster 2024-08-31T07:24:56.027261+0000 mgr.a (mgr.14388) 13563 : cluster [DBG] pgmap v9403: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:57.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:24:57.764 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:24:57.765 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:24:58.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:58 smithi163 bash[24253]: cluster 2024-08-31T07:24:58.028400+0000 mgr.a (mgr.14388) 13564 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:58 smithi027 bash[22610]: cluster 2024-08-31T07:24:58.028400+0000 mgr.a (mgr.14388) 13564 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:58 smithi191 bash[24992]: cluster 2024-08-31T07:24:58.028400+0000 mgr.a (mgr.14388) 13564 : cluster [DBG] pgmap v9404: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:24:58.539 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:24:58.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:24:58.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:24:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:24:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:24:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:24:59 smithi163 bash[24253]: audit 2024-08-31T07:24:58.102271+0000 mgr.a (mgr.14388) 13565 : audit [DBG] from='client.295596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:24:59 smithi027 bash[22610]: audit 2024-08-31T07:24:58.102271+0000 mgr.a (mgr.14388) 13565 : audit [DBG] from='client.295596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:24:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:24:59 smithi191 bash[24992]: audit 2024-08-31T07:24:58.102271+0000 mgr.a (mgr.14388) 13565 : audit [DBG] from='client.295596 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:00 smithi163 bash[24253]: cluster 2024-08-31T07:25:00.029269+0000 mgr.a (mgr.14388) 13566 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:00 smithi027 bash[22610]: cluster 2024-08-31T07:25:00.029269+0000 mgr.a (mgr.14388) 13566 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:00 smithi191 bash[24992]: cluster 2024-08-31T07:25:00.029269+0000 mgr.a (mgr.14388) 13566 : cluster [DBG] pgmap v9405: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:02 smithi191 bash[24992]: cluster 2024-08-31T07:25:02.030064+0000 mgr.a (mgr.14388) 13567 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:02 smithi163 bash[24253]: cluster 2024-08-31T07:25:02.030064+0000 mgr.a (mgr.14388) 13567 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:02 smithi027 bash[22610]: cluster 2024-08-31T07:25:02.030064+0000 mgr.a (mgr.14388) 13567 : cluster [DBG] pgmap v9406: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:03.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:25:03.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:25:03.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:25:04.331 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:25:04.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:25:04.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:25:04.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:25:04.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:25:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:04 smithi163 bash[24253]: audit 2024-08-31T07:25:03.874093+0000 mgr.a (mgr.14388) 13568 : audit [DBG] from='client.295671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:04 smithi163 bash[24253]: cluster 2024-08-31T07:25:04.031501+0000 mgr.a (mgr.14388) 13569 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:04 smithi027 bash[22610]: audit 2024-08-31T07:25:03.874093+0000 mgr.a (mgr.14388) 13568 : audit [DBG] from='client.295671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:04 smithi027 bash[22610]: cluster 2024-08-31T07:25:04.031501+0000 mgr.a (mgr.14388) 13569 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:04 smithi191 bash[24992]: audit 2024-08-31T07:25:03.874093+0000 mgr.a (mgr.14388) 13568 : audit [DBG] from='client.295671 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:04 smithi191 bash[24992]: cluster 2024-08-31T07:25:04.031501+0000 mgr.a (mgr.14388) 13569 : cluster [DBG] pgmap v9407: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:05 smithi163 bash[24253]: audit 2024-08-31T07:25:04.155552+0000 mon.a (mon.0) 2605 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:25:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:05 smithi163 bash[24253]: audit 2024-08-31T07:25:04.926488+0000 mon.a (mon.0) 2606 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:25:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:05 smithi163 bash[24253]: audit 2024-08-31T07:25:04.928449+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:25:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:05 smithi163 bash[24253]: audit 2024-08-31T07:25:04.937050+0000 mon.a (mon.0) 2608 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:25:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:05 smithi163 bash[24253]: audit 2024-08-31T07:25:04.941804+0000 mon.a (mon.0) 2609 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:25:05.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:05 smithi163 bash[24253]: audit 2024-08-31T07:25:04.942883+0000 mgr.a (mgr.14388) 13570 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:25:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:05 smithi027 bash[22610]: audit 2024-08-31T07:25:04.155552+0000 mon.a (mon.0) 2605 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:25:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:05 smithi027 bash[22610]: audit 2024-08-31T07:25:04.926488+0000 mon.a (mon.0) 2606 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:25:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:05 smithi027 bash[22610]: audit 2024-08-31T07:25:04.928449+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:25:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:05 smithi027 bash[22610]: audit 2024-08-31T07:25:04.937050+0000 mon.a (mon.0) 2608 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:25:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:05 smithi027 bash[22610]: audit 2024-08-31T07:25:04.941804+0000 mon.a (mon.0) 2609 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:25:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:05 smithi027 bash[22610]: audit 2024-08-31T07:25:04.942883+0000 mgr.a (mgr.14388) 13570 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:25:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:05 smithi191 bash[24992]: audit 2024-08-31T07:25:04.155552+0000 mon.a (mon.0) 2605 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:25:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:05 smithi191 bash[24992]: audit 2024-08-31T07:25:04.926488+0000 mon.a (mon.0) 2606 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:25:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:05 smithi191 bash[24992]: audit 2024-08-31T07:25:04.928449+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:25:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:05 smithi191 bash[24992]: audit 2024-08-31T07:25:04.937050+0000 mon.a (mon.0) 2608 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:25:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:05 smithi191 bash[24992]: audit 2024-08-31T07:25:04.941804+0000 mon.a (mon.0) 2609 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:25:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:05 smithi191 bash[24992]: audit 2024-08-31T07:25:04.942883+0000 mgr.a (mgr.14388) 13570 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:25:05.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:25:05 smithi027 bash[22863]: debug 2024-08-31T07:25:05.686+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:25:05.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:25:05 smithi027 bash[22863]: debug 2024-08-31T07:25:05.686+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:25:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:06 smithi163 bash[24253]: audit 2024-08-31T07:25:05.688712+0000 mgr.a (mgr.14388) 13571 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:25:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:06 smithi163 bash[24253]: cephadm 2024-08-31T07:25:05.690427+0000 mgr.a (mgr.14388) 13572 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:25:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:06 smithi163 bash[24253]: cluster 2024-08-31T07:25:06.032369+0000 mgr.a (mgr.14388) 13573 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:06 smithi027 bash[22610]: audit 2024-08-31T07:25:05.688712+0000 mgr.a (mgr.14388) 13571 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:25:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:06 smithi027 bash[22610]: cephadm 2024-08-31T07:25:05.690427+0000 mgr.a (mgr.14388) 13572 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:25:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:06 smithi027 bash[22610]: cluster 2024-08-31T07:25:06.032369+0000 mgr.a (mgr.14388) 13573 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:06 smithi191 bash[24992]: audit 2024-08-31T07:25:05.688712+0000 mgr.a (mgr.14388) 13571 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:25:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:06 smithi191 bash[24992]: cephadm 2024-08-31T07:25:05.690427+0000 mgr.a (mgr.14388) 13572 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:25:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:06 smithi191 bash[24992]: cluster 2024-08-31T07:25:06.032369+0000 mgr.a (mgr.14388) 13573 : cluster [DBG] pgmap v9408: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:08 smithi163 bash[24253]: cluster 2024-08-31T07:25:08.034637+0000 mgr.a (mgr.14388) 13574 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:08 smithi027 bash[22610]: cluster 2024-08-31T07:25:08.034637+0000 mgr.a (mgr.14388) 13574 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:08 smithi191 bash[24992]: cluster 2024-08-31T07:25:08.034637+0000 mgr.a (mgr.14388) 13574 : cluster [DBG] pgmap v9409: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:09.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:25:09.333 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:25:09.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:25:10.102 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:25:10.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:25:10.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:25:10.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:25:10.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:25:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:10 smithi163 bash[24253]: audit 2024-08-31T07:25:09.665960+0000 mgr.a (mgr.14388) 13575 : audit [DBG] from='client.295857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:10 smithi163 bash[24253]: cluster 2024-08-31T07:25:10.035279+0000 mgr.a (mgr.14388) 13576 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:10 smithi027 bash[22610]: audit 2024-08-31T07:25:09.665960+0000 mgr.a (mgr.14388) 13575 : audit [DBG] from='client.295857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:10 smithi027 bash[22610]: cluster 2024-08-31T07:25:10.035279+0000 mgr.a (mgr.14388) 13576 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:10 smithi191 bash[24992]: audit 2024-08-31T07:25:09.665960+0000 mgr.a (mgr.14388) 13575 : audit [DBG] from='client.295857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:10 smithi191 bash[24992]: cluster 2024-08-31T07:25:10.035279+0000 mgr.a (mgr.14388) 13576 : cluster [DBG] pgmap v9410: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:12 smithi163 bash[24253]: cluster 2024-08-31T07:25:12.036039+0000 mgr.a (mgr.14388) 13577 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:12 smithi027 bash[22610]: cluster 2024-08-31T07:25:12.036039+0000 mgr.a (mgr.14388) 13577 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:12 smithi191 bash[24992]: cluster 2024-08-31T07:25:12.036039+0000 mgr.a (mgr.14388) 13577 : cluster [DBG] pgmap v9411: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:14 smithi163 bash[24253]: cluster 2024-08-31T07:25:14.038185+0000 mgr.a (mgr.14388) 13578 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:14 smithi027 bash[22610]: cluster 2024-08-31T07:25:14.038185+0000 mgr.a (mgr.14388) 13578 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:14 smithi191 bash[24992]: cluster 2024-08-31T07:25:14.038185+0000 mgr.a (mgr.14388) 13578 : cluster [DBG] pgmap v9412: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:15.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:25:15.105 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:25:15.105 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:25:15.886 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:25:15.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:25:15.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:25:15.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:25:15.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:25:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:16 smithi163 bash[24253]: audit 2024-08-31T07:25:15.440668+0000 mgr.a (mgr.14388) 13579 : audit [DBG] from='client.295929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:16 smithi163 bash[24253]: cluster 2024-08-31T07:25:16.039138+0000 mgr.a (mgr.14388) 13580 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:16 smithi027 bash[22610]: audit 2024-08-31T07:25:15.440668+0000 mgr.a (mgr.14388) 13579 : audit [DBG] from='client.295929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:16 smithi027 bash[22610]: cluster 2024-08-31T07:25:16.039138+0000 mgr.a (mgr.14388) 13580 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:16 smithi191 bash[24992]: audit 2024-08-31T07:25:15.440668+0000 mgr.a (mgr.14388) 13579 : audit [DBG] from='client.295929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:16 smithi191 bash[24992]: cluster 2024-08-31T07:25:16.039138+0000 mgr.a (mgr.14388) 13580 : cluster [DBG] pgmap v9413: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:18 smithi163 bash[24253]: cluster 2024-08-31T07:25:18.041294+0000 mgr.a (mgr.14388) 13581 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:18 smithi027 bash[22610]: cluster 2024-08-31T07:25:18.041294+0000 mgr.a (mgr.14388) 13581 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:18 smithi191 bash[24992]: cluster 2024-08-31T07:25:18.041294+0000 mgr.a (mgr.14388) 13581 : cluster [DBG] pgmap v9414: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:25:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:20 smithi163 bash[24253]: cluster 2024-08-31T07:25:20.042098+0000 mgr.a (mgr.14388) 13582 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:20 smithi027 bash[22610]: cluster 2024-08-31T07:25:20.042098+0000 mgr.a (mgr.14388) 13582 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:20 smithi191 bash[24992]: cluster 2024-08-31T07:25:20.042098+0000 mgr.a (mgr.14388) 13582 : cluster [DBG] pgmap v9415: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:20.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:25:20.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:25:20.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:25:21.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:25:21.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:25:21.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:25:21.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:25:21.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:25:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:22 smithi163 bash[24253]: audit 2024-08-31T07:25:21.223403+0000 mgr.a (mgr.14388) 13583 : audit [DBG] from='client.296007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:22 smithi163 bash[24253]: cluster 2024-08-31T07:25:22.043237+0000 mgr.a (mgr.14388) 13584 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:22 smithi027 bash[22610]: audit 2024-08-31T07:25:21.223403+0000 mgr.a (mgr.14388) 13583 : audit [DBG] from='client.296007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:22 smithi027 bash[22610]: cluster 2024-08-31T07:25:22.043237+0000 mgr.a (mgr.14388) 13584 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:22 smithi191 bash[24992]: audit 2024-08-31T07:25:21.223403+0000 mgr.a (mgr.14388) 13583 : audit [DBG] from='client.296007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:22 smithi191 bash[24992]: cluster 2024-08-31T07:25:22.043237+0000 mgr.a (mgr.14388) 13584 : cluster [DBG] pgmap v9416: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:24 smithi163 bash[24253]: cluster 2024-08-31T07:25:24.045615+0000 mgr.a (mgr.14388) 13585 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:24 smithi027 bash[22610]: cluster 2024-08-31T07:25:24.045615+0000 mgr.a (mgr.14388) 13585 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:24 smithi191 bash[24992]: cluster 2024-08-31T07:25:24.045615+0000 mgr.a (mgr.14388) 13585 : cluster [DBG] pgmap v9417: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:26 smithi163 bash[24253]: cluster 2024-08-31T07:25:26.046567+0000 mgr.a (mgr.14388) 13586 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:26 smithi027 bash[22610]: cluster 2024-08-31T07:25:26.046567+0000 mgr.a (mgr.14388) 13586 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:26 smithi191 bash[24992]: cluster 2024-08-31T07:25:26.046567+0000 mgr.a (mgr.14388) 13586 : cluster [DBG] pgmap v9418: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:26.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:25:26.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:25:26.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:25:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:27 smithi163 bash[24253]: audit 2024-08-31T07:25:27.008059+0000 mgr.a (mgr.14388) 13587 : audit [DBG] from='client.296082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:27.459 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:25:27.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:25:27.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:25:27.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:25:27.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:25:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:27 smithi027 bash[22610]: audit 2024-08-31T07:25:27.008059+0000 mgr.a (mgr.14388) 13587 : audit [DBG] from='client.296082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:27 smithi191 bash[24992]: audit 2024-08-31T07:25:27.008059+0000 mgr.a (mgr.14388) 13587 : audit [DBG] from='client.296082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:28 smithi163 bash[24253]: cluster 2024-08-31T07:25:28.048886+0000 mgr.a (mgr.14388) 13588 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:28 smithi027 bash[22610]: cluster 2024-08-31T07:25:28.048886+0000 mgr.a (mgr.14388) 13588 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:28 smithi191 bash[24992]: cluster 2024-08-31T07:25:28.048886+0000 mgr.a (mgr.14388) 13588 : cluster [DBG] pgmap v9419: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:30 smithi163 bash[24253]: cluster 2024-08-31T07:25:30.049699+0000 mgr.a (mgr.14388) 13589 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:30 smithi027 bash[22610]: cluster 2024-08-31T07:25:30.049699+0000 mgr.a (mgr.14388) 13589 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:30 smithi191 bash[24992]: cluster 2024-08-31T07:25:30.049699+0000 mgr.a (mgr.14388) 13589 : cluster [DBG] pgmap v9420: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:32 smithi163 bash[24253]: cluster 2024-08-31T07:25:32.050502+0000 mgr.a (mgr.14388) 13590 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:32.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:25:32.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:25:32.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:25:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:32 smithi027 bash[22610]: cluster 2024-08-31T07:25:32.050502+0000 mgr.a (mgr.14388) 13590 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:32 smithi191 bash[24992]: cluster 2024-08-31T07:25:32.050502+0000 mgr.a (mgr.14388) 13590 : cluster [DBG] pgmap v9421: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:33.204 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:25:33.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:25:33.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:25:33.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:25:33.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:25:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:33 smithi163 bash[24253]: audit 2024-08-31T07:25:32.789086+0000 mgr.a (mgr.14388) 13591 : audit [DBG] from='client.296157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:33 smithi027 bash[22610]: audit 2024-08-31T07:25:32.789086+0000 mgr.a (mgr.14388) 13591 : audit [DBG] from='client.296157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:33 smithi191 bash[24992]: audit 2024-08-31T07:25:32.789086+0000 mgr.a (mgr.14388) 13591 : audit [DBG] from='client.296157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:34.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:34 smithi163 bash[24253]: cluster 2024-08-31T07:25:34.053401+0000 mgr.a (mgr.14388) 13592 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:34 smithi027 bash[22610]: cluster 2024-08-31T07:25:34.053401+0000 mgr.a (mgr.14388) 13592 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:34 smithi191 bash[24992]: cluster 2024-08-31T07:25:34.053401+0000 mgr.a (mgr.14388) 13592 : cluster [DBG] pgmap v9422: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:36 smithi163 bash[24253]: cluster 2024-08-31T07:25:36.054191+0000 mgr.a (mgr.14388) 13593 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:25:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:36 smithi027 bash[22610]: cluster 2024-08-31T07:25:36.054191+0000 mgr.a (mgr.14388) 13593 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:25:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:36 smithi191 bash[24992]: cluster 2024-08-31T07:25:36.054191+0000 mgr.a (mgr.14388) 13593 : cluster [DBG] pgmap v9423: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:25:38.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:25:38.206 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:25:38.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:25:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:38 smithi163 bash[24253]: cluster 2024-08-31T07:25:38.056108+0000 mgr.a (mgr.14388) 13594 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:38 smithi027 bash[22610]: cluster 2024-08-31T07:25:38.056108+0000 mgr.a (mgr.14388) 13594 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:38 smithi191 bash[24992]: cluster 2024-08-31T07:25:38.056108+0000 mgr.a (mgr.14388) 13594 : cluster [DBG] pgmap v9424: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:38.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:25:38.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:25:38.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:25:38.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:25:38.950 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:25:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:39 smithi163 bash[24253]: audit 2024-08-31T07:25:38.533063+0000 mgr.a (mgr.14388) 13595 : audit [DBG] from='client.296235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:39 smithi027 bash[22610]: audit 2024-08-31T07:25:38.533063+0000 mgr.a (mgr.14388) 13595 : audit [DBG] from='client.296235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:39 smithi191 bash[24992]: audit 2024-08-31T07:25:38.533063+0000 mgr.a (mgr.14388) 13595 : audit [DBG] from='client.296235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:40 smithi163 bash[24253]: cluster 2024-08-31T07:25:40.057155+0000 mgr.a (mgr.14388) 13596 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:25:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:40 smithi027 bash[22610]: cluster 2024-08-31T07:25:40.057155+0000 mgr.a (mgr.14388) 13596 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:25:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:40 smithi191 bash[24992]: cluster 2024-08-31T07:25:40.057155+0000 mgr.a (mgr.14388) 13596 : cluster [DBG] pgmap v9425: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:25:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:42 smithi163 bash[24253]: cluster 2024-08-31T07:25:42.057981+0000 mgr.a (mgr.14388) 13597 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:42 smithi027 bash[22610]: cluster 2024-08-31T07:25:42.057981+0000 mgr.a (mgr.14388) 13597 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:42 smithi191 bash[24992]: cluster 2024-08-31T07:25:42.057981+0000 mgr.a (mgr.14388) 13597 : cluster [DBG] pgmap v9426: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:25:43.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:25:43.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:25:43.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:25:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:44 smithi163 bash[24253]: cluster 2024-08-31T07:25:44.059056+0000 mgr.a (mgr.14388) 13598 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:44 smithi027 bash[22610]: cluster 2024-08-31T07:25:44.059056+0000 mgr.a (mgr.14388) 13598 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:44 smithi191 bash[24992]: cluster 2024-08-31T07:25:44.059056+0000 mgr.a (mgr.14388) 13598 : cluster [DBG] pgmap v9427: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:44.709 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:25:44.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:25:44.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:25:44.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:25:44.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:25:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:45 smithi163 bash[24253]: audit 2024-08-31T07:25:44.279055+0000 mgr.a (mgr.14388) 13599 : audit [DBG] from='client.296313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:45 smithi027 bash[22610]: audit 2024-08-31T07:25:44.279055+0000 mgr.a (mgr.14388) 13599 : audit [DBG] from='client.296313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:45 smithi191 bash[24992]: audit 2024-08-31T07:25:44.279055+0000 mgr.a (mgr.14388) 13599 : audit [DBG] from='client.296313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:46 smithi163 bash[24253]: cluster 2024-08-31T07:25:46.059898+0000 mgr.a (mgr.14388) 13600 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:46 smithi027 bash[22610]: cluster 2024-08-31T07:25:46.059898+0000 mgr.a (mgr.14388) 13600 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:46 smithi191 bash[24992]: cluster 2024-08-31T07:25:46.059898+0000 mgr.a (mgr.14388) 13600 : cluster [DBG] pgmap v9428: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:48 smithi163 bash[24253]: cluster 2024-08-31T07:25:48.062012+0000 mgr.a (mgr.14388) 13601 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:48 smithi027 bash[22610]: cluster 2024-08-31T07:25:48.062012+0000 mgr.a (mgr.14388) 13601 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:48 smithi191 bash[24992]: cluster 2024-08-31T07:25:48.062012+0000 mgr.a (mgr.14388) 13601 : cluster [DBG] pgmap v9429: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:49.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:25:49.712 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:25:49.712 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:25:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:50 smithi163 bash[24253]: audit 2024-08-31T07:25:50.045572+0000 mgr.a (mgr.14388) 13602 : audit [DBG] from='client.296388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:50 smithi163 bash[24253]: cluster 2024-08-31T07:25:50.063251+0000 mgr.a (mgr.14388) 13603 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:50.474 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:25:50.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:25:50.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:25:50.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:25:50.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:25:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:50 smithi027 bash[22610]: audit 2024-08-31T07:25:50.045572+0000 mgr.a (mgr.14388) 13602 : audit [DBG] from='client.296388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:50 smithi027 bash[22610]: cluster 2024-08-31T07:25:50.063251+0000 mgr.a (mgr.14388) 13603 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:50 smithi191 bash[24992]: audit 2024-08-31T07:25:50.045572+0000 mgr.a (mgr.14388) 13602 : audit [DBG] from='client.296388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:50 smithi191 bash[24992]: cluster 2024-08-31T07:25:50.063251+0000 mgr.a (mgr.14388) 13603 : cluster [DBG] pgmap v9430: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:52 smithi163 bash[24253]: cluster 2024-08-31T07:25:52.064246+0000 mgr.a (mgr.14388) 13604 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:52 smithi027 bash[22610]: cluster 2024-08-31T07:25:52.064246+0000 mgr.a (mgr.14388) 13604 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:52 smithi191 bash[24992]: cluster 2024-08-31T07:25:52.064246+0000 mgr.a (mgr.14388) 13604 : cluster [DBG] pgmap v9431: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:55 smithi163 bash[24253]: cluster 2024-08-31T07:25:54.066433+0000 mgr.a (mgr.14388) 13605 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:55.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:25:55.477 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:25:55.477 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:25:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:55 smithi027 bash[22610]: cluster 2024-08-31T07:25:54.066433+0000 mgr.a (mgr.14388) 13605 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:55 smithi191 bash[24992]: cluster 2024-08-31T07:25:54.066433+0000 mgr.a (mgr.14388) 13605 : cluster [DBG] pgmap v9432: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:56.217 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:25:56.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:25:56.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:25:56.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:25:56.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:25:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:56 smithi163 bash[24253]: audit 2024-08-31T07:25:55.804609+0000 mgr.a (mgr.14388) 13606 : audit [DBG] from='client.296463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:56 smithi027 bash[22610]: audit 2024-08-31T07:25:55.804609+0000 mgr.a (mgr.14388) 13606 : audit [DBG] from='client.296463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:56 smithi191 bash[24992]: audit 2024-08-31T07:25:55.804609+0000 mgr.a (mgr.14388) 13606 : audit [DBG] from='client.296463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:25:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:57 smithi163 bash[24253]: cluster 2024-08-31T07:25:56.066922+0000 mgr.a (mgr.14388) 13607 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:57 smithi027 bash[22610]: cluster 2024-08-31T07:25:56.066922+0000 mgr.a (mgr.14388) 13607 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:57 smithi191 bash[24992]: cluster 2024-08-31T07:25:56.066922+0000 mgr.a (mgr.14388) 13607 : cluster [DBG] pgmap v9433: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:25:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:25:59 smithi163 bash[24253]: cluster 2024-08-31T07:25:58.069035+0000 mgr.a (mgr.14388) 13608 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:25:59 smithi027 bash[22610]: cluster 2024-08-31T07:25:58.069035+0000 mgr.a (mgr.14388) 13608 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:25:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:25:59 smithi191 bash[24992]: cluster 2024-08-31T07:25:58.069035+0000 mgr.a (mgr.14388) 13608 : cluster [DBG] pgmap v9434: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:01.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:01.220 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:01.220 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:01 smithi163 bash[24253]: cluster 2024-08-31T07:26:00.069780+0000 mgr.a (mgr.14388) 13609 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:01 smithi027 bash[22610]: cluster 2024-08-31T07:26:00.069780+0000 mgr.a (mgr.14388) 13609 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:01 smithi191 bash[24992]: cluster 2024-08-31T07:26:00.069780+0000 mgr.a (mgr.14388) 13609 : cluster [DBG] pgmap v9435: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:02.009 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:02.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:02.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:02 smithi163 bash[24253]: audit 2024-08-31T07:26:01.563951+0000 mgr.a (mgr.14388) 13610 : audit [DBG] from='client.296541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:02 smithi027 bash[22610]: audit 2024-08-31T07:26:01.563951+0000 mgr.a (mgr.14388) 13610 : audit [DBG] from='client.296541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:02 smithi191 bash[24992]: audit 2024-08-31T07:26:01.563951+0000 mgr.a (mgr.14388) 13610 : audit [DBG] from='client.296541 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:03 smithi163 bash[24253]: cluster 2024-08-31T07:26:02.070299+0000 mgr.a (mgr.14388) 13611 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:03 smithi027 bash[22610]: cluster 2024-08-31T07:26:02.070299+0000 mgr.a (mgr.14388) 13611 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:03 smithi191 bash[24992]: cluster 2024-08-31T07:26:02.070299+0000 mgr.a (mgr.14388) 13611 : cluster [DBG] pgmap v9436: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:05 smithi163 bash[24253]: cluster 2024-08-31T07:26:04.072473+0000 mgr.a (mgr.14388) 13612 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:05 smithi027 bash[22610]: cluster 2024-08-31T07:26:04.072473+0000 mgr.a (mgr.14388) 13612 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:05 smithi191 bash[24992]: cluster 2024-08-31T07:26:04.072473+0000 mgr.a (mgr.14388) 13612 : cluster [DBG] pgmap v9437: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:06 smithi163 bash[24253]: audit 2024-08-31T07:26:05.745218+0000 mon.a (mon.0) 2610 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:26:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:06 smithi027 bash[22610]: audit 2024-08-31T07:26:05.745218+0000 mon.a (mon.0) 2610 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:26:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:06 smithi191 bash[24992]: audit 2024-08-31T07:26:05.745218+0000 mon.a (mon.0) 2610 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:26:07.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:07.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:07.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:07 smithi163 bash[24253]: cluster 2024-08-31T07:26:06.073197+0000 mgr.a (mgr.14388) 13613 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:07 smithi163 bash[24253]: audit 2024-08-31T07:26:06.572943+0000 mon.a (mon.0) 2611 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:26:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:07 smithi163 bash[24253]: audit 2024-08-31T07:26:06.574682+0000 mon.a (mon.0) 2612 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:26:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:07 smithi163 bash[24253]: audit 2024-08-31T07:26:06.584546+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:26:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:07 smithi163 bash[24253]: audit 2024-08-31T07:26:06.587048+0000 mon.a (mon.0) 2614 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:26:07.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:07 smithi163 bash[24253]: audit 2024-08-31T07:26:06.589300+0000 mgr.a (mgr.14388) 13614 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:26:07.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:26:07 smithi027 bash[22863]: debug 2024-08-31T07:26:07.316+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:26:07.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:26:07 smithi027 bash[22863]: debug 2024-08-31T07:26:07.316+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:26:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:07 smithi027 bash[22610]: cluster 2024-08-31T07:26:06.073197+0000 mgr.a (mgr.14388) 13613 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:07 smithi027 bash[22610]: audit 2024-08-31T07:26:06.572943+0000 mon.a (mon.0) 2611 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:26:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:07 smithi027 bash[22610]: audit 2024-08-31T07:26:06.574682+0000 mon.a (mon.0) 2612 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:26:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:07 smithi027 bash[22610]: audit 2024-08-31T07:26:06.584546+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:26:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:07 smithi027 bash[22610]: audit 2024-08-31T07:26:06.587048+0000 mon.a (mon.0) 2614 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:26:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:07 smithi027 bash[22610]: audit 2024-08-31T07:26:06.589300+0000 mgr.a (mgr.14388) 13614 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:26:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:07 smithi191 bash[24992]: cluster 2024-08-31T07:26:06.073197+0000 mgr.a (mgr.14388) 13613 : cluster [DBG] pgmap v9438: 225 pgs: 225 active+clean; 589 KiB data, 140 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:07 smithi191 bash[24992]: audit 2024-08-31T07:26:06.572943+0000 mon.a (mon.0) 2611 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:26:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:07 smithi191 bash[24992]: audit 2024-08-31T07:26:06.574682+0000 mon.a (mon.0) 2612 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:26:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:07 smithi191 bash[24992]: audit 2024-08-31T07:26:06.584546+0000 mon.a (mon.0) 2613 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:26:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:07 smithi191 bash[24992]: audit 2024-08-31T07:26:06.587048+0000 mon.a (mon.0) 2614 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:26:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:07 smithi191 bash[24992]: audit 2024-08-31T07:26:06.589300+0000 mgr.a (mgr.14388) 13614 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:26:07.733 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:07.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:07.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:07.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:07.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:08 smithi163 bash[24253]: audit 2024-08-31T07:26:07.319383+0000 mgr.a (mgr.14388) 13615 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:26:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:08 smithi163 bash[24253]: cephadm 2024-08-31T07:26:07.320501+0000 mgr.a (mgr.14388) 13616 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:26:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:08 smithi163 bash[24253]: audit 2024-08-31T07:26:07.338427+0000 mgr.a (mgr.14388) 13617 : audit [DBG] from='client.296709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:08 smithi027 bash[22610]: audit 2024-08-31T07:26:07.319383+0000 mgr.a (mgr.14388) 13615 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:26:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:08 smithi027 bash[22610]: cephadm 2024-08-31T07:26:07.320501+0000 mgr.a (mgr.14388) 13616 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:26:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:08 smithi027 bash[22610]: audit 2024-08-31T07:26:07.338427+0000 mgr.a (mgr.14388) 13617 : audit [DBG] from='client.296709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:08 smithi191 bash[24992]: audit 2024-08-31T07:26:07.319383+0000 mgr.a (mgr.14388) 13615 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:26:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:08 smithi191 bash[24992]: cephadm 2024-08-31T07:26:07.320501+0000 mgr.a (mgr.14388) 13616 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:26:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:08 smithi191 bash[24992]: audit 2024-08-31T07:26:07.338427+0000 mgr.a (mgr.14388) 13617 : audit [DBG] from='client.296709 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:09 smithi163 bash[24253]: cluster 2024-08-31T07:26:08.075460+0000 mgr.a (mgr.14388) 13618 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:09 smithi027 bash[22610]: cluster 2024-08-31T07:26:08.075460+0000 mgr.a (mgr.14388) 13618 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:09 smithi191 bash[24992]: cluster 2024-08-31T07:26:08.075460+0000 mgr.a (mgr.14388) 13618 : cluster [DBG] pgmap v9439: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:11.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:11 smithi163 bash[24253]: cluster 2024-08-31T07:26:10.076236+0000 mgr.a (mgr.14388) 13619 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:11.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:11 smithi027 bash[22610]: cluster 2024-08-31T07:26:10.076236+0000 mgr.a (mgr.14388) 13619 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:11.544 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:11 smithi191 bash[24992]: cluster 2024-08-31T07:26:10.076236+0000 mgr.a (mgr.14388) 13619 : cluster [DBG] pgmap v9440: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:12.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:12.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:12.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:13 smithi163 bash[24253]: cluster 2024-08-31T07:26:12.077014+0000 mgr.a (mgr.14388) 13620 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:13 smithi027 bash[22610]: cluster 2024-08-31T07:26:12.077014+0000 mgr.a (mgr.14388) 13620 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:13.517 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:13.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:13.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:13.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:13.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:13 smithi191 bash[24992]: cluster 2024-08-31T07:26:12.077014+0000 mgr.a (mgr.14388) 13620 : cluster [DBG] pgmap v9441: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:14 smithi163 bash[24253]: audit 2024-08-31T07:26:13.071255+0000 mgr.a (mgr.14388) 13621 : audit [DBG] from='client.296805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:14 smithi027 bash[22610]: audit 2024-08-31T07:26:13.071255+0000 mgr.a (mgr.14388) 13621 : audit [DBG] from='client.296805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:14 smithi191 bash[24992]: audit 2024-08-31T07:26:13.071255+0000 mgr.a (mgr.14388) 13621 : audit [DBG] from='client.296805 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:15 smithi163 bash[24253]: cluster 2024-08-31T07:26:14.079868+0000 mgr.a (mgr.14388) 13622 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:15 smithi027 bash[22610]: cluster 2024-08-31T07:26:14.079868+0000 mgr.a (mgr.14388) 13622 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:15 smithi191 bash[24992]: cluster 2024-08-31T07:26:14.079868+0000 mgr.a (mgr.14388) 13622 : cluster [DBG] pgmap v9442: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:17 smithi163 bash[24253]: cluster 2024-08-31T07:26:16.080658+0000 mgr.a (mgr.14388) 13623 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:26:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:17 smithi027 bash[22610]: cluster 2024-08-31T07:26:16.080658+0000 mgr.a (mgr.14388) 13623 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:26:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:17 smithi191 bash[24992]: cluster 2024-08-31T07:26:16.080658+0000 mgr.a (mgr.14388) 13623 : cluster [DBG] pgmap v9443: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:26:18.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:18.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:19.286 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:19 smithi027 bash[22610]: cluster 2024-08-31T07:26:18.082562+0000 mgr.a (mgr.14388) 13624 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:19 smithi027 bash[22610]: audit 2024-08-31T07:26:18.850069+0000 mgr.a (mgr.14388) 13625 : audit [DBG] from='client.296883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:19 smithi191 bash[24992]: cluster 2024-08-31T07:26:18.082562+0000 mgr.a (mgr.14388) 13624 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:19 smithi191 bash[24992]: audit 2024-08-31T07:26:18.850069+0000 mgr.a (mgr.14388) 13625 : audit [DBG] from='client.296883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:19 smithi163 bash[24253]: cluster 2024-08-31T07:26:18.082562+0000 mgr.a (mgr.14388) 13624 : cluster [DBG] pgmap v9444: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:26:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:19 smithi163 bash[24253]: audit 2024-08-31T07:26:18.850069+0000 mgr.a (mgr.14388) 13625 : audit [DBG] from='client.296883 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:21 smithi027 bash[22610]: cluster 2024-08-31T07:26:20.083530+0000 mgr.a (mgr.14388) 13626 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:26:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:21 smithi191 bash[24992]: cluster 2024-08-31T07:26:20.083530+0000 mgr.a (mgr.14388) 13626 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:26:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:21 smithi163 bash[24253]: cluster 2024-08-31T07:26:20.083530+0000 mgr.a (mgr.14388) 13626 : cluster [DBG] pgmap v9445: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:26:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:23 smithi027 bash[22610]: cluster 2024-08-31T07:26:22.084321+0000 mgr.a (mgr.14388) 13627 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:26:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:23 smithi191 bash[24992]: cluster 2024-08-31T07:26:22.084321+0000 mgr.a (mgr.14388) 13627 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:26:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:23 smithi163 bash[24253]: cluster 2024-08-31T07:26:22.084321+0000 mgr.a (mgr.14388) 13627 : cluster [DBG] pgmap v9446: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:26:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:24.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:24.289 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:25.043 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:25.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:25.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:25.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:25.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:25 smithi027 bash[22610]: cluster 2024-08-31T07:26:24.086523+0000 mgr.a (mgr.14388) 13628 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:25 smithi027 bash[22610]: audit 2024-08-31T07:26:24.621145+0000 mgr.a (mgr.14388) 13629 : audit [DBG] from='client.296961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:25 smithi191 bash[24992]: cluster 2024-08-31T07:26:24.086523+0000 mgr.a (mgr.14388) 13628 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:25 smithi191 bash[24992]: audit 2024-08-31T07:26:24.621145+0000 mgr.a (mgr.14388) 13629 : audit [DBG] from='client.296961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:25.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:25 smithi163 bash[24253]: cluster 2024-08-31T07:26:24.086523+0000 mgr.a (mgr.14388) 13628 : cluster [DBG] pgmap v9447: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:25.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:25 smithi163 bash[24253]: audit 2024-08-31T07:26:24.621145+0000 mgr.a (mgr.14388) 13629 : audit [DBG] from='client.296961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:27 smithi027 bash[22610]: cluster 2024-08-31T07:26:26.087483+0000 mgr.a (mgr.14388) 13630 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:27 smithi191 bash[24992]: cluster 2024-08-31T07:26:26.087483+0000 mgr.a (mgr.14388) 13630 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:27 smithi163 bash[24253]: cluster 2024-08-31T07:26:26.087483+0000 mgr.a (mgr.14388) 13630 : cluster [DBG] pgmap v9448: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:29 smithi027 bash[22610]: cluster 2024-08-31T07:26:28.089656+0000 mgr.a (mgr.14388) 13631 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:29 smithi191 bash[24992]: cluster 2024-08-31T07:26:28.089656+0000 mgr.a (mgr.14388) 13631 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:29 smithi163 bash[24253]: cluster 2024-08-31T07:26:28.089656+0000 mgr.a (mgr.14388) 13631 : cluster [DBG] pgmap v9449: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:30.047 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:30.048 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:30.048 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:30.822 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:30.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:30.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:30.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:30.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:31 smithi027 bash[22610]: cluster 2024-08-31T07:26:30.090251+0000 mgr.a (mgr.14388) 13632 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:31 smithi027 bash[22610]: audit 2024-08-31T07:26:30.383711+0000 mgr.a (mgr.14388) 13633 : audit [DBG] from='client.297039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:31 smithi191 bash[24992]: cluster 2024-08-31T07:26:30.090251+0000 mgr.a (mgr.14388) 13632 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:31 smithi191 bash[24992]: audit 2024-08-31T07:26:30.383711+0000 mgr.a (mgr.14388) 13633 : audit [DBG] from='client.297039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:31 smithi163 bash[24253]: cluster 2024-08-31T07:26:30.090251+0000 mgr.a (mgr.14388) 13632 : cluster [DBG] pgmap v9450: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:31 smithi163 bash[24253]: audit 2024-08-31T07:26:30.383711+0000 mgr.a (mgr.14388) 13633 : audit [DBG] from='client.297039 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:33 smithi027 bash[22610]: cluster 2024-08-31T07:26:32.091174+0000 mgr.a (mgr.14388) 13634 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:33 smithi191 bash[24992]: cluster 2024-08-31T07:26:32.091174+0000 mgr.a (mgr.14388) 13634 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:33 smithi163 bash[24253]: cluster 2024-08-31T07:26:32.091174+0000 mgr.a (mgr.14388) 13634 : cluster [DBG] pgmap v9451: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:35 smithi191 bash[24992]: cluster 2024-08-31T07:26:34.093458+0000 mgr.a (mgr.14388) 13635 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:35 smithi163 bash[24253]: cluster 2024-08-31T07:26:34.093458+0000 mgr.a (mgr.14388) 13635 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:35 smithi027 bash[22610]: cluster 2024-08-31T07:26:34.093458+0000 mgr.a (mgr.14388) 13635 : cluster [DBG] pgmap v9452: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:35.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:35.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:35.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:36.564 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:36.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:36.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:36.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:36.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:37 smithi191 bash[24992]: cluster 2024-08-31T07:26:36.094350+0000 mgr.a (mgr.14388) 13636 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:37 smithi191 bash[24992]: audit 2024-08-31T07:26:36.152407+0000 mgr.a (mgr.14388) 13637 : audit [DBG] from='client.297117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:37 smithi163 bash[24253]: cluster 2024-08-31T07:26:36.094350+0000 mgr.a (mgr.14388) 13636 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:37 smithi163 bash[24253]: audit 2024-08-31T07:26:36.152407+0000 mgr.a (mgr.14388) 13637 : audit [DBG] from='client.297117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:37 smithi027 bash[22610]: cluster 2024-08-31T07:26:36.094350+0000 mgr.a (mgr.14388) 13636 : cluster [DBG] pgmap v9453: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:37.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:37 smithi027 bash[22610]: audit 2024-08-31T07:26:36.152407+0000 mgr.a (mgr.14388) 13637 : audit [DBG] from='client.297117 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:39 smithi191 bash[24992]: cluster 2024-08-31T07:26:38.096639+0000 mgr.a (mgr.14388) 13638 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:39 smithi163 bash[24253]: cluster 2024-08-31T07:26:38.096639+0000 mgr.a (mgr.14388) 13638 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:39.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:39 smithi027 bash[22610]: cluster 2024-08-31T07:26:38.096639+0000 mgr.a (mgr.14388) 13638 : cluster [DBG] pgmap v9454: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:41 smithi191 bash[24992]: cluster 2024-08-31T07:26:40.097459+0000 mgr.a (mgr.14388) 13639 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:41.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:41.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:41.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:41 smithi163 bash[24253]: cluster 2024-08-31T07:26:40.097459+0000 mgr.a (mgr.14388) 13639 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:41 smithi027 bash[22610]: cluster 2024-08-31T07:26:40.097459+0000 mgr.a (mgr.14388) 13639 : cluster [DBG] pgmap v9455: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:42.355 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:42.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:42.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:42.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:42.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:42 smithi191 bash[24992]: audit 2024-08-31T07:26:41.898646+0000 mgr.a (mgr.14388) 13640 : audit [DBG] from='client.297195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:42 smithi163 bash[24253]: audit 2024-08-31T07:26:41.898646+0000 mgr.a (mgr.14388) 13640 : audit [DBG] from='client.297195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:42 smithi027 bash[22610]: audit 2024-08-31T07:26:41.898646+0000 mgr.a (mgr.14388) 13640 : audit [DBG] from='client.297195 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:43.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:43 smithi191 bash[24992]: cluster 2024-08-31T07:26:42.098014+0000 mgr.a (mgr.14388) 13641 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:43 smithi163 bash[24253]: cluster 2024-08-31T07:26:42.098014+0000 mgr.a (mgr.14388) 13641 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:43 smithi027 bash[22610]: cluster 2024-08-31T07:26:42.098014+0000 mgr.a (mgr.14388) 13641 : cluster [DBG] pgmap v9456: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:45 smithi191 bash[24992]: cluster 2024-08-31T07:26:44.100449+0000 mgr.a (mgr.14388) 13642 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:45 smithi163 bash[24253]: cluster 2024-08-31T07:26:44.100449+0000 mgr.a (mgr.14388) 13642 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:45.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:45 smithi027 bash[22610]: cluster 2024-08-31T07:26:44.100449+0000 mgr.a (mgr.14388) 13642 : cluster [DBG] pgmap v9457: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:26:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:47.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:47 smithi191 bash[24992]: cluster 2024-08-31T07:26:46.101379+0000 mgr.a (mgr.14388) 13643 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:47 smithi163 bash[24253]: cluster 2024-08-31T07:26:46.101379+0000 mgr.a (mgr.14388) 13643 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:47 smithi027 bash[22610]: cluster 2024-08-31T07:26:46.101379+0000 mgr.a (mgr.14388) 13643 : cluster [DBG] pgmap v9458: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:48.145 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:48.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:48 smithi191 bash[24992]: audit 2024-08-31T07:26:47.694530+0000 mgr.a (mgr.14388) 13644 : audit [DBG] from='client.297267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:48 smithi163 bash[24253]: audit 2024-08-31T07:26:47.694530+0000 mgr.a (mgr.14388) 13644 : audit [DBG] from='client.297267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:48 smithi027 bash[22610]: audit 2024-08-31T07:26:47.694530+0000 mgr.a (mgr.14388) 13644 : audit [DBG] from='client.297267 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:49 smithi191 bash[24992]: cluster 2024-08-31T07:26:48.102954+0000 mgr.a (mgr.14388) 13645 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:26:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:49 smithi163 bash[24253]: cluster 2024-08-31T07:26:48.102954+0000 mgr.a (mgr.14388) 13645 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:26:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:49 smithi027 bash[22610]: cluster 2024-08-31T07:26:48.102954+0000 mgr.a (mgr.14388) 13645 : cluster [DBG] pgmap v9459: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:26:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:51 smithi191 bash[24992]: cluster 2024-08-31T07:26:50.103700+0000 mgr.a (mgr.14388) 13646 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:26:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:51 smithi163 bash[24253]: cluster 2024-08-31T07:26:50.103700+0000 mgr.a (mgr.14388) 13646 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:26:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:51 smithi027 bash[22610]: cluster 2024-08-31T07:26:50.103700+0000 mgr.a (mgr.14388) 13646 : cluster [DBG] pgmap v9460: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:26:53.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:53.148 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:53.149 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:53 smithi191 bash[24992]: cluster 2024-08-31T07:26:52.104477+0000 mgr.a (mgr.14388) 13647 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:26:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:53 smithi163 bash[24253]: cluster 2024-08-31T07:26:52.104477+0000 mgr.a (mgr.14388) 13647 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:26:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:53 smithi027 bash[22610]: cluster 2024-08-31T07:26:52.104477+0000 mgr.a (mgr.14388) 13647 : cluster [DBG] pgmap v9461: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:26:53.895 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:53.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:53.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:53.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:53.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:54 smithi163 bash[24253]: audit 2024-08-31T07:26:53.478127+0000 mgr.a (mgr.14388) 13648 : audit [DBG] from='client.297345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:54 smithi027 bash[22610]: audit 2024-08-31T07:26:53.478127+0000 mgr.a (mgr.14388) 13648 : audit [DBG] from='client.297345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:54 smithi191 bash[24992]: audit 2024-08-31T07:26:53.478127+0000 mgr.a (mgr.14388) 13648 : audit [DBG] from='client.297345 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:26:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:55 smithi163 bash[24253]: cluster 2024-08-31T07:26:54.107303+0000 mgr.a (mgr.14388) 13649 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:55 smithi027 bash[22610]: cluster 2024-08-31T07:26:54.107303+0000 mgr.a (mgr.14388) 13649 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:55 smithi191 bash[24992]: cluster 2024-08-31T07:26:54.107303+0000 mgr.a (mgr.14388) 13649 : cluster [DBG] pgmap v9462: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:57 smithi163 bash[24253]: cluster 2024-08-31T07:26:56.108080+0000 mgr.a (mgr.14388) 13650 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:26:57.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:57 smithi027 bash[22610]: cluster 2024-08-31T07:26:56.108080+0000 mgr.a (mgr.14388) 13650 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:26:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:57 smithi191 bash[24992]: cluster 2024-08-31T07:26:56.108080+0000 mgr.a (mgr.14388) 13650 : cluster [DBG] pgmap v9463: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:26:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:26:58.897 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:26:58.898 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:26:59.681 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:26:59.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:26:59.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:26:59.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:26:59.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:26:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:26:59 smithi163 bash[24253]: cluster 2024-08-31T07:26:58.109964+0000 mgr.a (mgr.14388) 13651 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:26:59 smithi027 bash[22610]: cluster 2024-08-31T07:26:58.109964+0000 mgr.a (mgr.14388) 13651 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:26:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:26:59 smithi191 bash[24992]: cluster 2024-08-31T07:26:58.109964+0000 mgr.a (mgr.14388) 13651 : cluster [DBG] pgmap v9464: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:00 smithi163 bash[24253]: audit 2024-08-31T07:26:59.233946+0000 mgr.a (mgr.14388) 13652 : audit [DBG] from='client.297420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:00 smithi027 bash[22610]: audit 2024-08-31T07:26:59.233946+0000 mgr.a (mgr.14388) 13652 : audit [DBG] from='client.297420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:00 smithi191 bash[24992]: audit 2024-08-31T07:26:59.233946+0000 mgr.a (mgr.14388) 13652 : audit [DBG] from='client.297420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:01 smithi163 bash[24253]: cluster 2024-08-31T07:27:00.110940+0000 mgr.a (mgr.14388) 13653 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:27:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:01 smithi027 bash[22610]: cluster 2024-08-31T07:27:00.110940+0000 mgr.a (mgr.14388) 13653 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:27:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:01 smithi191 bash[24992]: cluster 2024-08-31T07:27:00.110940+0000 mgr.a (mgr.14388) 13653 : cluster [DBG] pgmap v9465: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:27:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:03 smithi163 bash[24253]: cluster 2024-08-31T07:27:02.111921+0000 mgr.a (mgr.14388) 13654 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:27:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:03 smithi027 bash[22610]: cluster 2024-08-31T07:27:02.111921+0000 mgr.a (mgr.14388) 13654 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:27:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:03 smithi191 bash[24992]: cluster 2024-08-31T07:27:02.111921+0000 mgr.a (mgr.14388) 13654 : cluster [DBG] pgmap v9466: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:27:04.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:27:04.684 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:27:04.684 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:27:05.422 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:27:05.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:27:05.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:27:05.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:27:05.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:27:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:05 smithi163 bash[24253]: cluster 2024-08-31T07:27:04.114155+0000 mgr.a (mgr.14388) 13655 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:27:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:05 smithi163 bash[24253]: audit 2024-08-31T07:27:05.013212+0000 mgr.a (mgr.14388) 13656 : audit [DBG] from='client.297498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:05 smithi027 bash[22610]: cluster 2024-08-31T07:27:04.114155+0000 mgr.a (mgr.14388) 13655 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:27:05.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:05 smithi027 bash[22610]: audit 2024-08-31T07:27:05.013212+0000 mgr.a (mgr.14388) 13656 : audit [DBG] from='client.297498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:05 smithi191 bash[24992]: cluster 2024-08-31T07:27:04.114155+0000 mgr.a (mgr.14388) 13655 : cluster [DBG] pgmap v9467: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:27:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:05 smithi191 bash[24992]: audit 2024-08-31T07:27:05.013212+0000 mgr.a (mgr.14388) 13656 : audit [DBG] from='client.297498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:07 smithi163 bash[24253]: cluster 2024-08-31T07:27:06.115093+0000 mgr.a (mgr.14388) 13657 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:07 smithi027 bash[22610]: cluster 2024-08-31T07:27:06.115093+0000 mgr.a (mgr.14388) 13657 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:07 smithi191 bash[24992]: cluster 2024-08-31T07:27:06.115093+0000 mgr.a (mgr.14388) 13657 : cluster [DBG] pgmap v9468: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:08 smithi163 bash[24253]: audit 2024-08-31T07:27:07.381424+0000 mon.a (mon.0) 2615 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:27:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:08 smithi027 bash[22610]: audit 2024-08-31T07:27:07.381424+0000 mon.a (mon.0) 2615 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:27:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:08 smithi191 bash[24992]: audit 2024-08-31T07:27:07.381424+0000 mon.a (mon.0) 2615 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:27:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:09 smithi163 bash[24253]: cluster 2024-08-31T07:27:08.117230+0000 mgr.a (mgr.14388) 13658 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:09 smithi027 bash[22610]: cluster 2024-08-31T07:27:08.117230+0000 mgr.a (mgr.14388) 13658 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:09 smithi191 bash[24992]: cluster 2024-08-31T07:27:08.117230+0000 mgr.a (mgr.14388) 13658 : cluster [DBG] pgmap v9469: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:10.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:27:10.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:27:10.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:27:11.186 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:27:11.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:27:11.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:27:11.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:27:11.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:27:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:11 smithi163 bash[24253]: cluster 2024-08-31T07:27:10.117983+0000 mgr.a (mgr.14388) 13659 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:11 smithi163 bash[24253]: audit 2024-08-31T07:27:10.755528+0000 mgr.a (mgr.14388) 13660 : audit [DBG] from='client.297573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:11 smithi027 bash[22610]: cluster 2024-08-31T07:27:10.117983+0000 mgr.a (mgr.14388) 13659 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:11 smithi027 bash[22610]: audit 2024-08-31T07:27:10.755528+0000 mgr.a (mgr.14388) 13660 : audit [DBG] from='client.297573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:11 smithi191 bash[24992]: cluster 2024-08-31T07:27:10.117983+0000 mgr.a (mgr.14388) 13659 : cluster [DBG] pgmap v9470: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:11 smithi191 bash[24992]: audit 2024-08-31T07:27:10.755528+0000 mgr.a (mgr.14388) 13660 : audit [DBG] from='client.297573 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: cluster 2024-08-31T07:27:12.118951+0000 mgr.a (mgr.14388) 13661 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: audit 2024-08-31T07:27:12.714946+0000 mon.a (mon.0) 2616 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: audit 2024-08-31T07:27:12.720109+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: audit 2024-08-31T07:27:12.725289+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: audit 2024-08-31T07:27:12.730604+0000 mon.a (mon.0) 2619 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: audit 2024-08-31T07:27:12.752344+0000 mon.a (mon.0) 2620 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: audit 2024-08-31T07:27:12.756966+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: audit 2024-08-31T07:27:13.479690+0000 mon.a (mon.0) 2622 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:27:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: audit 2024-08-31T07:27:13.481261+0000 mon.a (mon.0) 2623 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:27:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: audit 2024-08-31T07:27:13.490420+0000 mon.a (mon.0) 2624 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:13 smithi027 bash[22610]: audit 2024-08-31T07:27:13.492983+0000 mon.a (mon.0) 2625 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:27:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: cluster 2024-08-31T07:27:12.118951+0000 mgr.a (mgr.14388) 13661 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: audit 2024-08-31T07:27:12.714946+0000 mon.a (mon.0) 2616 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: audit 2024-08-31T07:27:12.720109+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: audit 2024-08-31T07:27:12.725289+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: audit 2024-08-31T07:27:12.730604+0000 mon.a (mon.0) 2619 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: audit 2024-08-31T07:27:12.752344+0000 mon.a (mon.0) 2620 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: audit 2024-08-31T07:27:12.756966+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: audit 2024-08-31T07:27:13.479690+0000 mon.a (mon.0) 2622 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:27:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: audit 2024-08-31T07:27:13.481261+0000 mon.a (mon.0) 2623 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:27:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: audit 2024-08-31T07:27:13.490420+0000 mon.a (mon.0) 2624 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:13 smithi191 bash[24992]: audit 2024-08-31T07:27:13.492983+0000 mon.a (mon.0) 2625 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:27:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: cluster 2024-08-31T07:27:12.118951+0000 mgr.a (mgr.14388) 13661 : cluster [DBG] pgmap v9471: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: audit 2024-08-31T07:27:12.714946+0000 mon.a (mon.0) 2616 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: audit 2024-08-31T07:27:12.720109+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: audit 2024-08-31T07:27:12.725289+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: audit 2024-08-31T07:27:12.730604+0000 mon.a (mon.0) 2619 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: audit 2024-08-31T07:27:12.752344+0000 mon.a (mon.0) 2620 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: audit 2024-08-31T07:27:12.756966+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: audit 2024-08-31T07:27:13.479690+0000 mon.a (mon.0) 2622 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:27:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: audit 2024-08-31T07:27:13.481261+0000 mon.a (mon.0) 2623 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:27:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: audit 2024-08-31T07:27:13.490420+0000 mon.a (mon.0) 2624 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:27:14.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:13 smithi163 bash[24253]: audit 2024-08-31T07:27:13.492983+0000 mon.a (mon.0) 2625 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:27:14.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:27:14 smithi027 bash[22863]: debug 2024-08-31T07:27:14.223+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:27:14.485 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:27:14 smithi027 bash[22863]: debug 2024-08-31T07:27:14.227+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:27:14.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:14 smithi027 bash[22610]: audit 2024-08-31T07:27:13.495309+0000 mgr.a (mgr.14388) 13662 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:27:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:14 smithi191 bash[24992]: audit 2024-08-31T07:27:13.495309+0000 mgr.a (mgr.14388) 13662 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:27:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:14 smithi163 bash[24253]: audit 2024-08-31T07:27:13.495309+0000 mgr.a (mgr.14388) 13662 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:27:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:15 smithi027 bash[22610]: cluster 2024-08-31T07:27:14.120347+0000 mgr.a (mgr.14388) 13663 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:15 smithi027 bash[22610]: audit 2024-08-31T07:27:14.230121+0000 mgr.a (mgr.14388) 13664 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:27:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:15 smithi027 bash[22610]: cephadm 2024-08-31T07:27:14.231352+0000 mgr.a (mgr.14388) 13665 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:27:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:15 smithi191 bash[24992]: cluster 2024-08-31T07:27:14.120347+0000 mgr.a (mgr.14388) 13663 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:15 smithi191 bash[24992]: audit 2024-08-31T07:27:14.230121+0000 mgr.a (mgr.14388) 13664 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:27:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:15 smithi191 bash[24992]: cephadm 2024-08-31T07:27:14.231352+0000 mgr.a (mgr.14388) 13665 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:27:16.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:27:16.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:27:16.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:27:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:15 smithi163 bash[24253]: cluster 2024-08-31T07:27:14.120347+0000 mgr.a (mgr.14388) 13663 : cluster [DBG] pgmap v9472: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:15 smithi163 bash[24253]: audit 2024-08-31T07:27:14.230121+0000 mgr.a (mgr.14388) 13664 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:27:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:15 smithi163 bash[24253]: cephadm 2024-08-31T07:27:14.231352+0000 mgr.a (mgr.14388) 13665 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:27:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:27:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:27:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:27:16.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:27:16.975 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:27:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:17 smithi027 bash[22610]: cluster 2024-08-31T07:27:16.121071+0000 mgr.a (mgr.14388) 13666 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:17 smithi027 bash[22610]: audit 2024-08-31T07:27:16.522761+0000 mgr.a (mgr.14388) 13667 : audit [DBG] from='client.297756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:17 smithi191 bash[24992]: cluster 2024-08-31T07:27:16.121071+0000 mgr.a (mgr.14388) 13666 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:17 smithi191 bash[24992]: audit 2024-08-31T07:27:16.522761+0000 mgr.a (mgr.14388) 13667 : audit [DBG] from='client.297756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:17 smithi163 bash[24253]: cluster 2024-08-31T07:27:16.121071+0000 mgr.a (mgr.14388) 13666 : cluster [DBG] pgmap v9473: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:17 smithi163 bash[24253]: audit 2024-08-31T07:27:16.522761+0000 mgr.a (mgr.14388) 13667 : audit [DBG] from='client.297756 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:19 smithi191 bash[24992]: cluster 2024-08-31T07:27:18.123349+0000 mgr.a (mgr.14388) 13668 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:19 smithi163 bash[24253]: cluster 2024-08-31T07:27:18.123349+0000 mgr.a (mgr.14388) 13668 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:19 smithi027 bash[22610]: cluster 2024-08-31T07:27:18.123349+0000 mgr.a (mgr.14388) 13668 : cluster [DBG] pgmap v9474: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:21.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:27:21.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:27:21.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:27:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:21 smithi191 bash[24992]: cluster 2024-08-31T07:27:20.124122+0000 mgr.a (mgr.14388) 13669 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:21 smithi163 bash[24253]: cluster 2024-08-31T07:27:20.124122+0000 mgr.a (mgr.14388) 13669 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:21 smithi027 bash[22610]: cluster 2024-08-31T07:27:20.124122+0000 mgr.a (mgr.14388) 13669 : cluster [DBG] pgmap v9475: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:27:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:27:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:27:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:27:22.726 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:27:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:23 smithi191 bash[24992]: cluster 2024-08-31T07:27:22.124844+0000 mgr.a (mgr.14388) 13670 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:23 smithi191 bash[24992]: audit 2024-08-31T07:27:22.306237+0000 mgr.a (mgr.14388) 13671 : audit [DBG] from='client.297828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:23 smithi163 bash[24253]: cluster 2024-08-31T07:27:22.124844+0000 mgr.a (mgr.14388) 13670 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:23 smithi163 bash[24253]: audit 2024-08-31T07:27:22.306237+0000 mgr.a (mgr.14388) 13671 : audit [DBG] from='client.297828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:23 smithi027 bash[22610]: cluster 2024-08-31T07:27:22.124844+0000 mgr.a (mgr.14388) 13670 : cluster [DBG] pgmap v9476: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:23 smithi027 bash[22610]: audit 2024-08-31T07:27:22.306237+0000 mgr.a (mgr.14388) 13671 : audit [DBG] from='client.297828 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:25 smithi191 bash[24992]: cluster 2024-08-31T07:27:24.127165+0000 mgr.a (mgr.14388) 13672 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:25 smithi163 bash[24253]: cluster 2024-08-31T07:27:24.127165+0000 mgr.a (mgr.14388) 13672 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:25 smithi027 bash[22610]: cluster 2024-08-31T07:27:24.127165+0000 mgr.a (mgr.14388) 13672 : cluster [DBG] pgmap v9477: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:27.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:27:27.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:27:27.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:27:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:27 smithi191 bash[24992]: cluster 2024-08-31T07:27:26.127971+0000 mgr.a (mgr.14388) 13673 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:27 smithi163 bash[24253]: cluster 2024-08-31T07:27:26.127971+0000 mgr.a (mgr.14388) 13673 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:27 smithi027 bash[22610]: cluster 2024-08-31T07:27:26.127971+0000 mgr.a (mgr.14388) 13673 : cluster [DBG] pgmap v9478: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:28.481 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:27:28.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:27:28.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:27:28.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:27:28.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:27:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:28 smithi191 bash[24992]: audit 2024-08-31T07:27:28.061993+0000 mgr.a (mgr.14388) 13674 : audit [DBG] from='client.297903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:28 smithi163 bash[24253]: audit 2024-08-31T07:27:28.061993+0000 mgr.a (mgr.14388) 13674 : audit [DBG] from='client.297903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:28 smithi027 bash[22610]: audit 2024-08-31T07:27:28.061993+0000 mgr.a (mgr.14388) 13674 : audit [DBG] from='client.297903 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:29 smithi191 bash[24992]: cluster 2024-08-31T07:27:28.129312+0000 mgr.a (mgr.14388) 13675 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:29 smithi163 bash[24253]: cluster 2024-08-31T07:27:28.129312+0000 mgr.a (mgr.14388) 13675 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:29 smithi027 bash[22610]: cluster 2024-08-31T07:27:28.129312+0000 mgr.a (mgr.14388) 13675 : cluster [DBG] pgmap v9479: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:27:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:31 smithi191 bash[24992]: cluster 2024-08-31T07:27:30.130180+0000 mgr.a (mgr.14388) 13676 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:27:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:31 smithi163 bash[24253]: cluster 2024-08-31T07:27:30.130180+0000 mgr.a (mgr.14388) 13676 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:27:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:31 smithi027 bash[22610]: cluster 2024-08-31T07:27:30.130180+0000 mgr.a (mgr.14388) 13676 : cluster [DBG] pgmap v9480: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:27:33.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:27:33.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:27:33.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:27:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:33 smithi191 bash[24992]: cluster 2024-08-31T07:27:32.130999+0000 mgr.a (mgr.14388) 13677 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:27:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:33 smithi163 bash[24253]: cluster 2024-08-31T07:27:32.130999+0000 mgr.a (mgr.14388) 13677 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:27:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:33 smithi027 bash[22610]: cluster 2024-08-31T07:27:32.130999+0000 mgr.a (mgr.14388) 13677 : cluster [DBG] pgmap v9481: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:27:34.248 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:27:34.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:27:34.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:27:34.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:27:34.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:27:35.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:34 smithi191 bash[24992]: audit 2024-08-31T07:27:33.816099+0000 mgr.a (mgr.14388) 13678 : audit [DBG] from='client.297978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:34 smithi163 bash[24253]: audit 2024-08-31T07:27:33.816099+0000 mgr.a (mgr.14388) 13678 : audit [DBG] from='client.297978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:34 smithi027 bash[22610]: audit 2024-08-31T07:27:33.816099+0000 mgr.a (mgr.14388) 13678 : audit [DBG] from='client.297978 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:35 smithi191 bash[24992]: cluster 2024-08-31T07:27:34.132180+0000 mgr.a (mgr.14388) 13679 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:35 smithi163 bash[24253]: cluster 2024-08-31T07:27:34.132180+0000 mgr.a (mgr.14388) 13679 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:35 smithi027 bash[22610]: cluster 2024-08-31T07:27:34.132180+0000 mgr.a (mgr.14388) 13679 : cluster [DBG] pgmap v9482: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:37 smithi163 bash[24253]: cluster 2024-08-31T07:27:36.133048+0000 mgr.a (mgr.14388) 13680 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:27:38.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:37 smithi027 bash[22610]: cluster 2024-08-31T07:27:36.133048+0000 mgr.a (mgr.14388) 13680 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:27:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:37 smithi191 bash[24992]: cluster 2024-08-31T07:27:36.133048+0000 mgr.a (mgr.14388) 13680 : cluster [DBG] pgmap v9483: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:27:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:27:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:27:39.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:27:40.004 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:27:40.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:27:40.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:27:40.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:27:40.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:27:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:39 smithi163 bash[24253]: cluster 2024-08-31T07:27:38.135194+0000 mgr.a (mgr.14388) 13681 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:39 smithi027 bash[22610]: cluster 2024-08-31T07:27:38.135194+0000 mgr.a (mgr.14388) 13681 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:39 smithi191 bash[24992]: cluster 2024-08-31T07:27:38.135194+0000 mgr.a (mgr.14388) 13681 : cluster [DBG] pgmap v9484: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:40 smithi163 bash[24253]: audit 2024-08-31T07:27:39.587382+0000 mgr.a (mgr.14388) 13682 : audit [DBG] from='client.298053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:40 smithi027 bash[22610]: audit 2024-08-31T07:27:39.587382+0000 mgr.a (mgr.14388) 13682 : audit [DBG] from='client.298053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:40 smithi191 bash[24992]: audit 2024-08-31T07:27:39.587382+0000 mgr.a (mgr.14388) 13682 : audit [DBG] from='client.298053 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:41 smithi163 bash[24253]: cluster 2024-08-31T07:27:40.136116+0000 mgr.a (mgr.14388) 13683 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:41 smithi027 bash[22610]: cluster 2024-08-31T07:27:40.136116+0000 mgr.a (mgr.14388) 13683 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:41 smithi191 bash[24992]: cluster 2024-08-31T07:27:40.136116+0000 mgr.a (mgr.14388) 13683 : cluster [DBG] pgmap v9485: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:43 smithi163 bash[24253]: cluster 2024-08-31T07:27:42.136897+0000 mgr.a (mgr.14388) 13684 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:43 smithi027 bash[22610]: cluster 2024-08-31T07:27:42.136897+0000 mgr.a (mgr.14388) 13684 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:43 smithi191 bash[24992]: cluster 2024-08-31T07:27:42.136897+0000 mgr.a (mgr.14388) 13684 : cluster [DBG] pgmap v9486: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:45.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:27:45.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:27:45.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:27:45.792 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:27:45.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:27:45.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:27:45.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:27:45.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:27:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:45 smithi163 bash[24253]: cluster 2024-08-31T07:27:44.139125+0000 mgr.a (mgr.14388) 13685 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:45 smithi027 bash[22610]: cluster 2024-08-31T07:27:44.139125+0000 mgr.a (mgr.14388) 13685 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:45 smithi191 bash[24992]: cluster 2024-08-31T07:27:44.139125+0000 mgr.a (mgr.14388) 13685 : cluster [DBG] pgmap v9487: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:46 smithi163 bash[24253]: audit 2024-08-31T07:27:45.344317+0000 mgr.a (mgr.14388) 13686 : audit [DBG] from='client.298128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:46 smithi027 bash[22610]: audit 2024-08-31T07:27:45.344317+0000 mgr.a (mgr.14388) 13686 : audit [DBG] from='client.298128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:46 smithi191 bash[24992]: audit 2024-08-31T07:27:45.344317+0000 mgr.a (mgr.14388) 13686 : audit [DBG] from='client.298128 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:47 smithi163 bash[24253]: cluster 2024-08-31T07:27:46.140004+0000 mgr.a (mgr.14388) 13687 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:47 smithi027 bash[22610]: cluster 2024-08-31T07:27:46.140004+0000 mgr.a (mgr.14388) 13687 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:47 smithi191 bash[24992]: cluster 2024-08-31T07:27:46.140004+0000 mgr.a (mgr.14388) 13687 : cluster [DBG] pgmap v9488: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:49 smithi163 bash[24253]: cluster 2024-08-31T07:27:48.142203+0000 mgr.a (mgr.14388) 13688 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:49 smithi027 bash[22610]: cluster 2024-08-31T07:27:48.142203+0000 mgr.a (mgr.14388) 13688 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:49 smithi191 bash[24992]: cluster 2024-08-31T07:27:48.142203+0000 mgr.a (mgr.14388) 13688 : cluster [DBG] pgmap v9489: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:50.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:27:50.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:27:50.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:27:51.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:27:51.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:27:51.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:27:51.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:27:51.537 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:27:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:51 smithi163 bash[24253]: cluster 2024-08-31T07:27:50.142994+0000 mgr.a (mgr.14388) 13689 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:51 smithi027 bash[22610]: cluster 2024-08-31T07:27:50.142994+0000 mgr.a (mgr.14388) 13689 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:51 smithi191 bash[24992]: cluster 2024-08-31T07:27:50.142994+0000 mgr.a (mgr.14388) 13689 : cluster [DBG] pgmap v9490: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:52 smithi163 bash[24253]: audit 2024-08-31T07:27:51.125215+0000 mgr.a (mgr.14388) 13690 : audit [DBG] from='client.298206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:52 smithi027 bash[22610]: audit 2024-08-31T07:27:51.125215+0000 mgr.a (mgr.14388) 13690 : audit [DBG] from='client.298206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:52 smithi191 bash[24992]: audit 2024-08-31T07:27:51.125215+0000 mgr.a (mgr.14388) 13690 : audit [DBG] from='client.298206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:53 smithi163 bash[24253]: cluster 2024-08-31T07:27:52.143876+0000 mgr.a (mgr.14388) 13691 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:53 smithi027 bash[22610]: cluster 2024-08-31T07:27:52.143876+0000 mgr.a (mgr.14388) 13691 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:53 smithi191 bash[24992]: cluster 2024-08-31T07:27:52.143876+0000 mgr.a (mgr.14388) 13691 : cluster [DBG] pgmap v9491: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:55 smithi163 bash[24253]: cluster 2024-08-31T07:27:54.146079+0000 mgr.a (mgr.14388) 13692 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:55 smithi027 bash[22610]: cluster 2024-08-31T07:27:54.146079+0000 mgr.a (mgr.14388) 13692 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:55 smithi191 bash[24992]: cluster 2024-08-31T07:27:54.146079+0000 mgr.a (mgr.14388) 13692 : cluster [DBG] pgmap v9492: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:27:56.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:27:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:27:56.539 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:27:57.315 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:27:57.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:27:57.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:27:57.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:27:57.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:27:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:57 smithi163 bash[24253]: cluster 2024-08-31T07:27:56.146848+0000 mgr.a (mgr.14388) 13693 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:57 smithi163 bash[24253]: audit 2024-08-31T07:27:56.876170+0000 mgr.a (mgr.14388) 13694 : audit [DBG] from='client.298284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:57 smithi027 bash[22610]: cluster 2024-08-31T07:27:56.146848+0000 mgr.a (mgr.14388) 13693 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:57 smithi027 bash[22610]: audit 2024-08-31T07:27:56.876170+0000 mgr.a (mgr.14388) 13694 : audit [DBG] from='client.298284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:27:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:57 smithi191 bash[24992]: cluster 2024-08-31T07:27:56.146848+0000 mgr.a (mgr.14388) 13693 : cluster [DBG] pgmap v9493: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:27:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:57 smithi191 bash[24992]: audit 2024-08-31T07:27:56.876170+0000 mgr.a (mgr.14388) 13694 : audit [DBG] from='client.298284 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:27:59 smithi163 bash[24253]: cluster 2024-08-31T07:27:58.149216+0000 mgr.a (mgr.14388) 13695 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:28:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:27:59 smithi027 bash[22610]: cluster 2024-08-31T07:27:58.149216+0000 mgr.a (mgr.14388) 13695 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:28:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:27:59 smithi191 bash[24992]: cluster 2024-08-31T07:27:58.149216+0000 mgr.a (mgr.14388) 13695 : cluster [DBG] pgmap v9494: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:28:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:01 smithi163 bash[24253]: cluster 2024-08-31T07:28:00.149950+0000 mgr.a (mgr.14388) 13696 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:01 smithi027 bash[22610]: cluster 2024-08-31T07:28:00.149950+0000 mgr.a (mgr.14388) 13696 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:01 smithi191 bash[24992]: cluster 2024-08-31T07:28:00.149950+0000 mgr.a (mgr.14388) 13696 : cluster [DBG] pgmap v9495: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:02.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:28:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:28:02.317 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:28:03.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:28:03.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:28:03.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:28:03.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:28:03.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:28:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:03 smithi163 bash[24253]: cluster 2024-08-31T07:28:02.150700+0000 mgr.a (mgr.14388) 13697 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:03 smithi163 bash[24253]: audit 2024-08-31T07:28:02.652006+0000 mgr.a (mgr.14388) 13698 : audit [DBG] from='client.298362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:03 smithi027 bash[22610]: cluster 2024-08-31T07:28:02.150700+0000 mgr.a (mgr.14388) 13697 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:03 smithi027 bash[22610]: audit 2024-08-31T07:28:02.652006+0000 mgr.a (mgr.14388) 13698 : audit [DBG] from='client.298362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:03 smithi191 bash[24992]: cluster 2024-08-31T07:28:02.150700+0000 mgr.a (mgr.14388) 13697 : cluster [DBG] pgmap v9496: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:03 smithi191 bash[24992]: audit 2024-08-31T07:28:02.652006+0000 mgr.a (mgr.14388) 13698 : audit [DBG] from='client.298362 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:05 smithi163 bash[24253]: cluster 2024-08-31T07:28:04.153350+0000 mgr.a (mgr.14388) 13699 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:05 smithi027 bash[22610]: cluster 2024-08-31T07:28:04.153350+0000 mgr.a (mgr.14388) 13699 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:05 smithi191 bash[24992]: cluster 2024-08-31T07:28:04.153350+0000 mgr.a (mgr.14388) 13699 : cluster [DBG] pgmap v9497: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:08.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:28:08.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:28:08.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:28:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:07 smithi163 bash[24253]: cluster 2024-08-31T07:28:06.154109+0000 mgr.a (mgr.14388) 13700 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:07 smithi027 bash[22610]: cluster 2024-08-31T07:28:06.154109+0000 mgr.a (mgr.14388) 13700 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:07 smithi191 bash[24992]: cluster 2024-08-31T07:28:06.154109+0000 mgr.a (mgr.14388) 13700 : cluster [DBG] pgmap v9498: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:08.885 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:28:08.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:28:08.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:28:08.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:28:08.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:28:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:09 smithi163 bash[24253]: cluster 2024-08-31T07:28:08.155484+0000 mgr.a (mgr.14388) 13701 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:09 smithi163 bash[24253]: audit 2024-08-31T07:28:08.439677+0000 mgr.a (mgr.14388) 13702 : audit [DBG] from='client.298434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:09 smithi027 bash[22610]: cluster 2024-08-31T07:28:08.155484+0000 mgr.a (mgr.14388) 13701 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:09 smithi027 bash[22610]: audit 2024-08-31T07:28:08.439677+0000 mgr.a (mgr.14388) 13702 : audit [DBG] from='client.298434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:09 smithi191 bash[24992]: cluster 2024-08-31T07:28:08.155484+0000 mgr.a (mgr.14388) 13701 : cluster [DBG] pgmap v9499: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:09 smithi191 bash[24992]: audit 2024-08-31T07:28:08.439677+0000 mgr.a (mgr.14388) 13702 : audit [DBG] from='client.298434 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:11 smithi163 bash[24253]: cluster 2024-08-31T07:28:10.156399+0000 mgr.a (mgr.14388) 13703 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:11 smithi027 bash[22610]: cluster 2024-08-31T07:28:10.156399+0000 mgr.a (mgr.14388) 13703 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:11 smithi191 bash[24992]: cluster 2024-08-31T07:28:10.156399+0000 mgr.a (mgr.14388) 13703 : cluster [DBG] pgmap v9500: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:13.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:28:13.887 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:28:13.887 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:28:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:13 smithi163 bash[24253]: cluster 2024-08-31T07:28:12.157188+0000 mgr.a (mgr.14388) 13704 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:28:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:13 smithi027 bash[22610]: cluster 2024-08-31T07:28:12.157188+0000 mgr.a (mgr.14388) 13704 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:28:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:13 smithi191 bash[24992]: cluster 2024-08-31T07:28:12.157188+0000 mgr.a (mgr.14388) 13704 : cluster [DBG] pgmap v9501: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:28:14.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:28:14.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:28:14.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:28:14.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:28:14.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:28:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:14 smithi163 bash[24253]: audit 2024-08-31T07:28:14.280692+0000 mon.a (mon.0) 2626 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:28:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:14 smithi027 bash[22610]: audit 2024-08-31T07:28:14.280692+0000 mon.a (mon.0) 2626 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:28:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:14 smithi191 bash[24992]: audit 2024-08-31T07:28:14.280692+0000 mon.a (mon.0) 2626 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:28:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:15 smithi163 bash[24253]: cluster 2024-08-31T07:28:14.159283+0000 mgr.a (mgr.14388) 13705 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:15 smithi163 bash[24253]: audit 2024-08-31T07:28:14.222545+0000 mgr.a (mgr.14388) 13706 : audit [DBG] from='client.298512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:15 smithi163 bash[24253]: audit 2024-08-31T07:28:15.058128+0000 mon.a (mon.0) 2627 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:28:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:15 smithi163 bash[24253]: audit 2024-08-31T07:28:15.059455+0000 mon.a (mon.0) 2628 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:28:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:15 smithi163 bash[24253]: audit 2024-08-31T07:28:15.065800+0000 mon.a (mon.0) 2629 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:28:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:15 smithi163 bash[24253]: audit 2024-08-31T07:28:15.070549+0000 mon.a (mon.0) 2630 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:28:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:15 smithi163 bash[24253]: audit 2024-08-31T07:28:15.073268+0000 mgr.a (mgr.14388) 13707 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:28:16.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:28:15 smithi027 bash[22863]: debug 2024-08-31T07:28:15.801+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:28:16.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:28:15 smithi027 bash[22863]: debug 2024-08-31T07:28:15.801+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:28:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:15 smithi027 bash[22610]: cluster 2024-08-31T07:28:14.159283+0000 mgr.a (mgr.14388) 13705 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:15 smithi027 bash[22610]: audit 2024-08-31T07:28:14.222545+0000 mgr.a (mgr.14388) 13706 : audit [DBG] from='client.298512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:15 smithi027 bash[22610]: audit 2024-08-31T07:28:15.058128+0000 mon.a (mon.0) 2627 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:28:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:15 smithi027 bash[22610]: audit 2024-08-31T07:28:15.059455+0000 mon.a (mon.0) 2628 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:28:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:15 smithi027 bash[22610]: audit 2024-08-31T07:28:15.065800+0000 mon.a (mon.0) 2629 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:28:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:15 smithi027 bash[22610]: audit 2024-08-31T07:28:15.070549+0000 mon.a (mon.0) 2630 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:28:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:15 smithi027 bash[22610]: audit 2024-08-31T07:28:15.073268+0000 mgr.a (mgr.14388) 13707 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:28:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:15 smithi191 bash[24992]: cluster 2024-08-31T07:28:14.159283+0000 mgr.a (mgr.14388) 13705 : cluster [DBG] pgmap v9502: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:15 smithi191 bash[24992]: audit 2024-08-31T07:28:14.222545+0000 mgr.a (mgr.14388) 13706 : audit [DBG] from='client.298512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:15 smithi191 bash[24992]: audit 2024-08-31T07:28:15.058128+0000 mon.a (mon.0) 2627 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:28:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:15 smithi191 bash[24992]: audit 2024-08-31T07:28:15.059455+0000 mon.a (mon.0) 2628 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:28:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:15 smithi191 bash[24992]: audit 2024-08-31T07:28:15.065800+0000 mon.a (mon.0) 2629 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:28:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:15 smithi191 bash[24992]: audit 2024-08-31T07:28:15.070549+0000 mon.a (mon.0) 2630 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:28:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:15 smithi191 bash[24992]: audit 2024-08-31T07:28:15.073268+0000 mgr.a (mgr.14388) 13707 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:28:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:16 smithi163 bash[24253]: audit 2024-08-31T07:28:15.802712+0000 mgr.a (mgr.14388) 13708 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:28:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:16 smithi163 bash[24253]: cephadm 2024-08-31T07:28:15.803859+0000 mgr.a (mgr.14388) 13709 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:28:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:16 smithi027 bash[22610]: audit 2024-08-31T07:28:15.802712+0000 mgr.a (mgr.14388) 13708 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:28:17.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:16 smithi027 bash[22610]: cephadm 2024-08-31T07:28:15.803859+0000 mgr.a (mgr.14388) 13709 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:28:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:16 smithi191 bash[24992]: audit 2024-08-31T07:28:15.802712+0000 mgr.a (mgr.14388) 13708 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:28:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:16 smithi191 bash[24992]: cephadm 2024-08-31T07:28:15.803859+0000 mgr.a (mgr.14388) 13709 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:28:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:17 smithi163 bash[24253]: cluster 2024-08-31T07:28:16.160128+0000 mgr.a (mgr.14388) 13710 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:17 smithi027 bash[22610]: cluster 2024-08-31T07:28:16.160128+0000 mgr.a (mgr.14388) 13710 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:17 smithi191 bash[24992]: cluster 2024-08-31T07:28:16.160128+0000 mgr.a (mgr.14388) 13710 : cluster [DBG] pgmap v9503: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:19.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:28:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:28:19.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:28:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:19 smithi163 bash[24253]: cluster 2024-08-31T07:28:18.162347+0000 mgr.a (mgr.14388) 13711 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:19 smithi027 bash[22610]: cluster 2024-08-31T07:28:18.162347+0000 mgr.a (mgr.14388) 13711 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:19 smithi191 bash[24992]: cluster 2024-08-31T07:28:18.162347+0000 mgr.a (mgr.14388) 13711 : cluster [DBG] pgmap v9504: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:20.451 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:28:20.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:28:20.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:28:20.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:28:20.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:28:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:20 smithi163 bash[24253]: audit 2024-08-31T07:28:20.008937+0000 mgr.a (mgr.14388) 13712 : audit [DBG] from='client.298698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:20 smithi027 bash[22610]: audit 2024-08-31T07:28:20.008937+0000 mgr.a (mgr.14388) 13712 : audit [DBG] from='client.298698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:20 smithi191 bash[24992]: audit 2024-08-31T07:28:20.008937+0000 mgr.a (mgr.14388) 13712 : audit [DBG] from='client.298698 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:21 smithi163 bash[24253]: cluster 2024-08-31T07:28:20.163048+0000 mgr.a (mgr.14388) 13713 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:21 smithi027 bash[22610]: cluster 2024-08-31T07:28:20.163048+0000 mgr.a (mgr.14388) 13713 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:21 smithi191 bash[24992]: cluster 2024-08-31T07:28:20.163048+0000 mgr.a (mgr.14388) 13713 : cluster [DBG] pgmap v9505: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:23 smithi163 bash[24253]: cluster 2024-08-31T07:28:22.163928+0000 mgr.a (mgr.14388) 13714 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:23 smithi027 bash[22610]: cluster 2024-08-31T07:28:22.163928+0000 mgr.a (mgr.14388) 13714 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:23 smithi191 bash[24992]: cluster 2024-08-31T07:28:22.163928+0000 mgr.a (mgr.14388) 13714 : cluster [DBG] pgmap v9506: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:25.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:28:25.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:28:25.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:28:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:25 smithi163 bash[24253]: cluster 2024-08-31T07:28:24.166196+0000 mgr.a (mgr.14388) 13715 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:26.215 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:28:26.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:28:26.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:28:26.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:28:26.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:28:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:25 smithi027 bash[22610]: cluster 2024-08-31T07:28:24.166196+0000 mgr.a (mgr.14388) 13715 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:25 smithi191 bash[24992]: cluster 2024-08-31T07:28:24.166196+0000 mgr.a (mgr.14388) 13715 : cluster [DBG] pgmap v9507: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:26 smithi163 bash[24253]: audit 2024-08-31T07:28:25.784292+0000 mgr.a (mgr.14388) 13716 : audit [DBG] from='client.298773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:26 smithi027 bash[22610]: audit 2024-08-31T07:28:25.784292+0000 mgr.a (mgr.14388) 13716 : audit [DBG] from='client.298773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:26 smithi191 bash[24992]: audit 2024-08-31T07:28:25.784292+0000 mgr.a (mgr.14388) 13716 : audit [DBG] from='client.298773 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:27 smithi163 bash[24253]: cluster 2024-08-31T07:28:26.166794+0000 mgr.a (mgr.14388) 13717 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:27 smithi027 bash[22610]: cluster 2024-08-31T07:28:26.166794+0000 mgr.a (mgr.14388) 13717 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:27 smithi191 bash[24992]: cluster 2024-08-31T07:28:26.166794+0000 mgr.a (mgr.14388) 13717 : cluster [DBG] pgmap v9508: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:29 smithi027 bash[22610]: cluster 2024-08-31T07:28:28.168941+0000 mgr.a (mgr.14388) 13718 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:29 smithi191 bash[24992]: cluster 2024-08-31T07:28:28.168941+0000 mgr.a (mgr.14388) 13718 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:29 smithi163 bash[24253]: cluster 2024-08-31T07:28:28.168941+0000 mgr.a (mgr.14388) 13718 : cluster [DBG] pgmap v9509: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:28:31.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:28:31.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:28:31.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:28:31.999 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:28:32.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:28:32.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:28:32.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:28:32.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:28:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:31 smithi027 bash[22610]: cluster 2024-08-31T07:28:30.169768+0000 mgr.a (mgr.14388) 13719 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:31 smithi191 bash[24992]: cluster 2024-08-31T07:28:30.169768+0000 mgr.a (mgr.14388) 13719 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:31 smithi163 bash[24253]: cluster 2024-08-31T07:28:30.169768+0000 mgr.a (mgr.14388) 13719 : cluster [DBG] pgmap v9510: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:32 smithi027 bash[22610]: audit 2024-08-31T07:28:31.557258+0000 mgr.a (mgr.14388) 13720 : audit [DBG] from='client.298848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:32 smithi191 bash[24992]: audit 2024-08-31T07:28:31.557258+0000 mgr.a (mgr.14388) 13720 : audit [DBG] from='client.298848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:32 smithi163 bash[24253]: audit 2024-08-31T07:28:31.557258+0000 mgr.a (mgr.14388) 13720 : audit [DBG] from='client.298848 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:33 smithi027 bash[22610]: cluster 2024-08-31T07:28:32.170713+0000 mgr.a (mgr.14388) 13721 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:33 smithi191 bash[24992]: cluster 2024-08-31T07:28:32.170713+0000 mgr.a (mgr.14388) 13721 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:33 smithi163 bash[24253]: cluster 2024-08-31T07:28:32.170713+0000 mgr.a (mgr.14388) 13721 : cluster [DBG] pgmap v9511: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:35 smithi027 bash[22610]: cluster 2024-08-31T07:28:34.172926+0000 mgr.a (mgr.14388) 13722 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:28:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:35 smithi191 bash[24992]: cluster 2024-08-31T07:28:34.172926+0000 mgr.a (mgr.14388) 13722 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:28:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:35 smithi163 bash[24253]: cluster 2024-08-31T07:28:34.172926+0000 mgr.a (mgr.14388) 13722 : cluster [DBG] pgmap v9512: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:28:37.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:28:37.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:28:37.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:28:37.740 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:28:37.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:28:37.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:28:37.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:28:37.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:28:38.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:37 smithi027 bash[22610]: cluster 2024-08-31T07:28:36.173707+0000 mgr.a (mgr.14388) 13723 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:37 smithi191 bash[24992]: cluster 2024-08-31T07:28:36.173707+0000 mgr.a (mgr.14388) 13723 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:37 smithi163 bash[24253]: cluster 2024-08-31T07:28:36.173707+0000 mgr.a (mgr.14388) 13723 : cluster [DBG] pgmap v9513: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:38 smithi027 bash[22610]: audit 2024-08-31T07:28:37.332454+0000 mgr.a (mgr.14388) 13724 : audit [DBG] from='client.298926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:39.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:38 smithi191 bash[24992]: audit 2024-08-31T07:28:37.332454+0000 mgr.a (mgr.14388) 13724 : audit [DBG] from='client.298926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:38 smithi163 bash[24253]: audit 2024-08-31T07:28:37.332454+0000 mgr.a (mgr.14388) 13724 : audit [DBG] from='client.298926 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:39 smithi191 bash[24992]: cluster 2024-08-31T07:28:38.176059+0000 mgr.a (mgr.14388) 13725 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:28:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:39 smithi163 bash[24253]: cluster 2024-08-31T07:28:38.176059+0000 mgr.a (mgr.14388) 13725 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:28:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:39 smithi027 bash[22610]: cluster 2024-08-31T07:28:38.176059+0000 mgr.a (mgr.14388) 13725 : cluster [DBG] pgmap v9514: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:28:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:41 smithi191 bash[24992]: cluster 2024-08-31T07:28:40.176995+0000 mgr.a (mgr.14388) 13726 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:41 smithi163 bash[24253]: cluster 2024-08-31T07:28:40.176995+0000 mgr.a (mgr.14388) 13726 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:41 smithi027 bash[22610]: cluster 2024-08-31T07:28:40.176995+0000 mgr.a (mgr.14388) 13726 : cluster [DBG] pgmap v9515: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:42.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:28:42.745 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:28:42.745 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:28:43.500 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:28:43.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:28:43.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:28:43.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:28:43.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:28:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:43 smithi191 bash[24992]: cluster 2024-08-31T07:28:42.177963+0000 mgr.a (mgr.14388) 13727 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:43 smithi191 bash[24992]: audit 2024-08-31T07:28:43.076230+0000 mgr.a (mgr.14388) 13728 : audit [DBG] from='client.299004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:43 smithi163 bash[24253]: cluster 2024-08-31T07:28:42.177963+0000 mgr.a (mgr.14388) 13727 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:43 smithi163 bash[24253]: audit 2024-08-31T07:28:43.076230+0000 mgr.a (mgr.14388) 13728 : audit [DBG] from='client.299004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:43 smithi027 bash[22610]: cluster 2024-08-31T07:28:42.177963+0000 mgr.a (mgr.14388) 13727 : cluster [DBG] pgmap v9516: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:43 smithi027 bash[22610]: audit 2024-08-31T07:28:43.076230+0000 mgr.a (mgr.14388) 13728 : audit [DBG] from='client.299004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:45 smithi191 bash[24992]: cluster 2024-08-31T07:28:44.180945+0000 mgr.a (mgr.14388) 13729 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:45 smithi163 bash[24253]: cluster 2024-08-31T07:28:44.180945+0000 mgr.a (mgr.14388) 13729 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:45 smithi027 bash[22610]: cluster 2024-08-31T07:28:44.180945+0000 mgr.a (mgr.14388) 13729 : cluster [DBG] pgmap v9517: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:48 smithi191 bash[24992]: cluster 2024-08-31T07:28:46.181767+0000 mgr.a (mgr.14388) 13730 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:48 smithi163 bash[24253]: cluster 2024-08-31T07:28:46.181767+0000 mgr.a (mgr.14388) 13730 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:48 smithi027 bash[22610]: cluster 2024-08-31T07:28:46.181767+0000 mgr.a (mgr.14388) 13730 : cluster [DBG] pgmap v9518: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:48.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:28:48.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:28:48.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:28:49.260 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:28:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:28:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:28:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:28:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:28:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:50 smithi191 bash[24992]: cluster 2024-08-31T07:28:48.183774+0000 mgr.a (mgr.14388) 13731 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:50 smithi191 bash[24992]: audit 2024-08-31T07:28:48.835288+0000 mgr.a (mgr.14388) 13732 : audit [DBG] from='client.299079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:50 smithi163 bash[24253]: cluster 2024-08-31T07:28:48.183774+0000 mgr.a (mgr.14388) 13731 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:50 smithi163 bash[24253]: audit 2024-08-31T07:28:48.835288+0000 mgr.a (mgr.14388) 13732 : audit [DBG] from='client.299079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:50 smithi027 bash[22610]: cluster 2024-08-31T07:28:48.183774+0000 mgr.a (mgr.14388) 13731 : cluster [DBG] pgmap v9519: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:50 smithi027 bash[22610]: audit 2024-08-31T07:28:48.835288+0000 mgr.a (mgr.14388) 13732 : audit [DBG] from='client.299079 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:52 smithi191 bash[24992]: cluster 2024-08-31T07:28:50.184727+0000 mgr.a (mgr.14388) 13733 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:52 smithi163 bash[24253]: cluster 2024-08-31T07:28:50.184727+0000 mgr.a (mgr.14388) 13733 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:52 smithi027 bash[22610]: cluster 2024-08-31T07:28:50.184727+0000 mgr.a (mgr.14388) 13733 : cluster [DBG] pgmap v9520: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:54.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:28:54.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:28:54.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:28:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:54 smithi191 bash[24992]: cluster 2024-08-31T07:28:52.185538+0000 mgr.a (mgr.14388) 13734 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:54 smithi163 bash[24253]: cluster 2024-08-31T07:28:52.185538+0000 mgr.a (mgr.14388) 13734 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:54 smithi027 bash[22610]: cluster 2024-08-31T07:28:52.185538+0000 mgr.a (mgr.14388) 13734 : cluster [DBG] pgmap v9521: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:28:55.032 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:28:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:28:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:28:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:28:55.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:28:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:56 smithi191 bash[24992]: cluster 2024-08-31T07:28:54.187738+0000 mgr.a (mgr.14388) 13735 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:56 smithi191 bash[24992]: audit 2024-08-31T07:28:54.597254+0000 mgr.a (mgr.14388) 13736 : audit [DBG] from='client.299157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:56 smithi163 bash[24253]: cluster 2024-08-31T07:28:54.187738+0000 mgr.a (mgr.14388) 13735 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:56 smithi163 bash[24253]: audit 2024-08-31T07:28:54.597254+0000 mgr.a (mgr.14388) 13736 : audit [DBG] from='client.299157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:56 smithi027 bash[22610]: cluster 2024-08-31T07:28:54.187738+0000 mgr.a (mgr.14388) 13735 : cluster [DBG] pgmap v9522: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:56 smithi027 bash[22610]: audit 2024-08-31T07:28:54.597254+0000 mgr.a (mgr.14388) 13736 : audit [DBG] from='client.299157 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:28:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:28:58 smithi191 bash[24992]: cluster 2024-08-31T07:28:56.188695+0000 mgr.a (mgr.14388) 13737 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:28:58 smithi163 bash[24253]: cluster 2024-08-31T07:28:56.188695+0000 mgr.a (mgr.14388) 13737 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:28:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:28:58 smithi027 bash[22610]: cluster 2024-08-31T07:28:56.188695+0000 mgr.a (mgr.14388) 13737 : cluster [DBG] pgmap v9523: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:00.033 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:00.034 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:00 smithi191 bash[24992]: cluster 2024-08-31T07:28:58.190966+0000 mgr.a (mgr.14388) 13738 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:00 smithi163 bash[24253]: cluster 2024-08-31T07:28:58.190966+0000 mgr.a (mgr.14388) 13738 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:00 smithi027 bash[22610]: cluster 2024-08-31T07:28:58.190966+0000 mgr.a (mgr.14388) 13738 : cluster [DBG] pgmap v9524: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:00.822 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:00.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:00.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:00.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:00.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:02 smithi191 bash[24992]: cluster 2024-08-31T07:29:00.191705+0000 mgr.a (mgr.14388) 13739 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:02 smithi191 bash[24992]: audit 2024-08-31T07:29:00.371738+0000 mgr.a (mgr.14388) 13740 : audit [DBG] from='client.299232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:02 smithi163 bash[24253]: cluster 2024-08-31T07:29:00.191705+0000 mgr.a (mgr.14388) 13739 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:02 smithi163 bash[24253]: audit 2024-08-31T07:29:00.371738+0000 mgr.a (mgr.14388) 13740 : audit [DBG] from='client.299232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:02 smithi027 bash[22610]: cluster 2024-08-31T07:29:00.191705+0000 mgr.a (mgr.14388) 13739 : cluster [DBG] pgmap v9525: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:02.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:02 smithi027 bash[22610]: audit 2024-08-31T07:29:00.371738+0000 mgr.a (mgr.14388) 13740 : audit [DBG] from='client.299232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:04 smithi163 bash[24253]: cluster 2024-08-31T07:29:02.192610+0000 mgr.a (mgr.14388) 13741 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:04 smithi027 bash[22610]: cluster 2024-08-31T07:29:02.192610+0000 mgr.a (mgr.14388) 13741 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:04 smithi191 bash[24992]: cluster 2024-08-31T07:29:02.192610+0000 mgr.a (mgr.14388) 13741 : cluster [DBG] pgmap v9526: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:05.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:05.825 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:05.825 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:06 smithi163 bash[24253]: cluster 2024-08-31T07:29:04.194944+0000 mgr.a (mgr.14388) 13742 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:06 smithi027 bash[22610]: cluster 2024-08-31T07:29:04.194944+0000 mgr.a (mgr.14388) 13742 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:06 smithi191 bash[24992]: cluster 2024-08-31T07:29:04.194944+0000 mgr.a (mgr.14388) 13742 : cluster [DBG] pgmap v9527: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:06.601 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:06.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:06.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:06.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:08 smithi163 bash[24253]: audit 2024-08-31T07:29:06.158841+0000 mgr.a (mgr.14388) 13743 : audit [DBG] from='client.299307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:08 smithi163 bash[24253]: cluster 2024-08-31T07:29:06.195695+0000 mgr.a (mgr.14388) 13744 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:08 smithi027 bash[22610]: audit 2024-08-31T07:29:06.158841+0000 mgr.a (mgr.14388) 13743 : audit [DBG] from='client.299307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:08 smithi027 bash[22610]: cluster 2024-08-31T07:29:06.195695+0000 mgr.a (mgr.14388) 13744 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:08 smithi191 bash[24992]: audit 2024-08-31T07:29:06.158841+0000 mgr.a (mgr.14388) 13743 : audit [DBG] from='client.299307 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:08 smithi191 bash[24992]: cluster 2024-08-31T07:29:06.195695+0000 mgr.a (mgr.14388) 13744 : cluster [DBG] pgmap v9528: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:10 smithi163 bash[24253]: cluster 2024-08-31T07:29:08.198088+0000 mgr.a (mgr.14388) 13745 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:10 smithi027 bash[22610]: cluster 2024-08-31T07:29:08.198088+0000 mgr.a (mgr.14388) 13745 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:10 smithi191 bash[24992]: cluster 2024-08-31T07:29:08.198088+0000 mgr.a (mgr.14388) 13745 : cluster [DBG] pgmap v9529: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:11.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:11.603 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:11.603 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:12.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:12.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:12.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:12.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:12.346 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:12 smithi163 bash[24253]: cluster 2024-08-31T07:29:10.199055+0000 mgr.a (mgr.14388) 13746 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:12 smithi027 bash[22610]: cluster 2024-08-31T07:29:10.199055+0000 mgr.a (mgr.14388) 13746 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:12 smithi191 bash[24992]: cluster 2024-08-31T07:29:10.199055+0000 mgr.a (mgr.14388) 13746 : cluster [DBG] pgmap v9530: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:13 smithi163 bash[24253]: audit 2024-08-31T07:29:11.931880+0000 mgr.a (mgr.14388) 13747 : audit [DBG] from='client.299385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:13 smithi027 bash[22610]: audit 2024-08-31T07:29:11.931880+0000 mgr.a (mgr.14388) 13747 : audit [DBG] from='client.299385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:13 smithi191 bash[24992]: audit 2024-08-31T07:29:11.931880+0000 mgr.a (mgr.14388) 13747 : audit [DBG] from='client.299385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:14 smithi163 bash[24253]: cluster 2024-08-31T07:29:12.199604+0000 mgr.a (mgr.14388) 13748 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:14 smithi027 bash[22610]: cluster 2024-08-31T07:29:12.199604+0000 mgr.a (mgr.14388) 13748 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:14 smithi191 bash[24992]: cluster 2024-08-31T07:29:12.199604+0000 mgr.a (mgr.14388) 13748 : cluster [DBG] pgmap v9531: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:16 smithi163 bash[24253]: cluster 2024-08-31T07:29:14.201871+0000 mgr.a (mgr.14388) 13749 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:16 smithi163 bash[24253]: audit 2024-08-31T07:29:15.856674+0000 mon.a (mon.0) 2631 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:29:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:16 smithi027 bash[22610]: cluster 2024-08-31T07:29:14.201871+0000 mgr.a (mgr.14388) 13749 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:16 smithi027 bash[22610]: audit 2024-08-31T07:29:15.856674+0000 mon.a (mon.0) 2631 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:29:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:16 smithi191 bash[24992]: cluster 2024-08-31T07:29:14.201871+0000 mgr.a (mgr.14388) 13749 : cluster [DBG] pgmap v9532: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:16 smithi191 bash[24992]: audit 2024-08-31T07:29:15.856674+0000 mon.a (mon.0) 2631 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:29:17.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:17.347 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:17.347 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:17 smithi163 bash[24253]: audit 2024-08-31T07:29:16.707332+0000 mon.a (mon.0) 2632 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:29:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:17 smithi163 bash[24253]: audit 2024-08-31T07:29:16.708966+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:29:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:17 smithi163 bash[24253]: audit 2024-08-31T07:29:16.719385+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:29:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:17 smithi163 bash[24253]: audit 2024-08-31T07:29:16.724156+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:29:17.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:17 smithi027 bash[22610]: audit 2024-08-31T07:29:16.707332+0000 mon.a (mon.0) 2632 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:29:17.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:17 smithi027 bash[22610]: audit 2024-08-31T07:29:16.708966+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:29:17.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:17 smithi027 bash[22610]: audit 2024-08-31T07:29:16.719385+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:29:17.476 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:17 smithi027 bash[22610]: audit 2024-08-31T07:29:16.724156+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:29:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:17 smithi191 bash[24992]: audit 2024-08-31T07:29:16.707332+0000 mon.a (mon.0) 2632 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:29:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:17 smithi191 bash[24992]: audit 2024-08-31T07:29:16.708966+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:29:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:17 smithi191 bash[24992]: audit 2024-08-31T07:29:16.719385+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:29:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:17 smithi191 bash[24992]: audit 2024-08-31T07:29:16.724156+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:29:17.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:29:17 smithi027 bash[22863]: debug 2024-08-31T07:29:17.472+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:29:17.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:29:17 smithi027 bash[22863]: debug 2024-08-31T07:29:17.472+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:29:18.082 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:18.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:18.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:18.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:18.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:18 smithi163 bash[24253]: cluster 2024-08-31T07:29:16.202616+0000 mgr.a (mgr.14388) 13750 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:18 smithi163 bash[24253]: audit 2024-08-31T07:29:16.726592+0000 mgr.a (mgr.14388) 13751 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:29:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:18 smithi027 bash[22610]: cluster 2024-08-31T07:29:16.202616+0000 mgr.a (mgr.14388) 13750 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:18 smithi027 bash[22610]: audit 2024-08-31T07:29:16.726592+0000 mgr.a (mgr.14388) 13751 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:29:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:18 smithi191 bash[24992]: cluster 2024-08-31T07:29:16.202616+0000 mgr.a (mgr.14388) 13750 : cluster [DBG] pgmap v9533: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:18 smithi191 bash[24992]: audit 2024-08-31T07:29:16.726592+0000 mgr.a (mgr.14388) 13751 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:29:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:19 smithi163 bash[24253]: audit 2024-08-31T07:29:17.475305+0000 mgr.a (mgr.14388) 13752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:29:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:19 smithi163 bash[24253]: cephadm 2024-08-31T07:29:17.476610+0000 mgr.a (mgr.14388) 13753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:29:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:19 smithi163 bash[24253]: audit 2024-08-31T07:29:17.666871+0000 mgr.a (mgr.14388) 13754 : audit [DBG] from='client.299565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:19 smithi027 bash[22610]: audit 2024-08-31T07:29:17.475305+0000 mgr.a (mgr.14388) 13752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:29:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:19 smithi027 bash[22610]: cephadm 2024-08-31T07:29:17.476610+0000 mgr.a (mgr.14388) 13753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:29:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:19 smithi027 bash[22610]: audit 2024-08-31T07:29:17.666871+0000 mgr.a (mgr.14388) 13754 : audit [DBG] from='client.299565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:19 smithi191 bash[24992]: audit 2024-08-31T07:29:17.475305+0000 mgr.a (mgr.14388) 13752 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:29:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:19 smithi191 bash[24992]: cephadm 2024-08-31T07:29:17.476610+0000 mgr.a (mgr.14388) 13753 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:29:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:19 smithi191 bash[24992]: audit 2024-08-31T07:29:17.666871+0000 mgr.a (mgr.14388) 13754 : audit [DBG] from='client.299565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:20 smithi163 bash[24253]: cluster 2024-08-31T07:29:18.205389+0000 mgr.a (mgr.14388) 13755 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:29:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:20 smithi027 bash[22610]: cluster 2024-08-31T07:29:18.205389+0000 mgr.a (mgr.14388) 13755 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:29:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:20 smithi191 bash[24992]: cluster 2024-08-31T07:29:18.205389+0000 mgr.a (mgr.14388) 13755 : cluster [DBG] pgmap v9534: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:29:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:22 smithi163 bash[24253]: cluster 2024-08-31T07:29:20.206178+0000 mgr.a (mgr.14388) 13756 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:29:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:22 smithi027 bash[22610]: cluster 2024-08-31T07:29:20.206178+0000 mgr.a (mgr.14388) 13756 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:29:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:22 smithi191 bash[24992]: cluster 2024-08-31T07:29:20.206178+0000 mgr.a (mgr.14388) 13756 : cluster [DBG] pgmap v9535: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:29:23.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:23.084 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:23.084 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:23.876 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:24 smithi163 bash[24253]: cluster 2024-08-31T07:29:22.207118+0000 mgr.a (mgr.14388) 13757 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:29:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:24 smithi027 bash[22610]: cluster 2024-08-31T07:29:22.207118+0000 mgr.a (mgr.14388) 13757 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:29:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:24 smithi191 bash[24992]: cluster 2024-08-31T07:29:22.207118+0000 mgr.a (mgr.14388) 13757 : cluster [DBG] pgmap v9536: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:29:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:25 smithi163 bash[24253]: audit 2024-08-31T07:29:23.423051+0000 mgr.a (mgr.14388) 13758 : audit [DBG] from='client.299643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:25 smithi027 bash[22610]: audit 2024-08-31T07:29:23.423051+0000 mgr.a (mgr.14388) 13758 : audit [DBG] from='client.299643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:25 smithi191 bash[24992]: audit 2024-08-31T07:29:23.423051+0000 mgr.a (mgr.14388) 13758 : audit [DBG] from='client.299643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:26 smithi163 bash[24253]: cluster 2024-08-31T07:29:24.210005+0000 mgr.a (mgr.14388) 13759 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:29:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:26 smithi027 bash[22610]: cluster 2024-08-31T07:29:24.210005+0000 mgr.a (mgr.14388) 13759 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:29:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:26 smithi191 bash[24992]: cluster 2024-08-31T07:29:24.210005+0000 mgr.a (mgr.14388) 13759 : cluster [DBG] pgmap v9537: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:29:28.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:28 smithi163 bash[24253]: cluster 2024-08-31T07:29:26.210965+0000 mgr.a (mgr.14388) 13760 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:29:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:28 smithi027 bash[22610]: cluster 2024-08-31T07:29:26.210965+0000 mgr.a (mgr.14388) 13760 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:29:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:28 smithi191 bash[24992]: cluster 2024-08-31T07:29:26.210965+0000 mgr.a (mgr.14388) 13760 : cluster [DBG] pgmap v9538: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:29:28.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:28.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:28.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:29 smithi163 bash[24253]: cluster 2024-08-31T07:29:28.213083+0000 mgr.a (mgr.14388) 13761 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:29:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:29 smithi027 bash[22610]: cluster 2024-08-31T07:29:28.213083+0000 mgr.a (mgr.14388) 13761 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:29:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:29 smithi191 bash[24992]: cluster 2024-08-31T07:29:28.213083+0000 mgr.a (mgr.14388) 13761 : cluster [DBG] pgmap v9539: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:29:29.661 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:29.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:29.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:29.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:29.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:30 smithi163 bash[24253]: audit 2024-08-31T07:29:29.213250+0000 mgr.a (mgr.14388) 13762 : audit [DBG] from='client.299718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:30 smithi027 bash[22610]: audit 2024-08-31T07:29:29.213250+0000 mgr.a (mgr.14388) 13762 : audit [DBG] from='client.299718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:30 smithi191 bash[24992]: audit 2024-08-31T07:29:29.213250+0000 mgr.a (mgr.14388) 13762 : audit [DBG] from='client.299718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:31 smithi163 bash[24253]: cluster 2024-08-31T07:29:30.214060+0000 mgr.a (mgr.14388) 13763 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:31 smithi027 bash[22610]: cluster 2024-08-31T07:29:30.214060+0000 mgr.a (mgr.14388) 13763 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:31 smithi191 bash[24992]: cluster 2024-08-31T07:29:30.214060+0000 mgr.a (mgr.14388) 13763 : cluster [DBG] pgmap v9540: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:33 smithi191 bash[24992]: cluster 2024-08-31T07:29:32.215055+0000 mgr.a (mgr.14388) 13764 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:33 smithi163 bash[24253]: cluster 2024-08-31T07:29:32.215055+0000 mgr.a (mgr.14388) 13764 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:33 smithi027 bash[22610]: cluster 2024-08-31T07:29:32.215055+0000 mgr.a (mgr.14388) 13764 : cluster [DBG] pgmap v9541: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:34.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:34.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:34.664 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:35.413 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:35.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:35.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:35 smithi191 bash[24992]: cluster 2024-08-31T07:29:34.217335+0000 mgr.a (mgr.14388) 13765 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:35 smithi191 bash[24992]: audit 2024-08-31T07:29:34.992443+0000 mgr.a (mgr.14388) 13766 : audit [DBG] from='client.299796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:35 smithi163 bash[24253]: cluster 2024-08-31T07:29:34.217335+0000 mgr.a (mgr.14388) 13765 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:35 smithi163 bash[24253]: audit 2024-08-31T07:29:34.992443+0000 mgr.a (mgr.14388) 13766 : audit [DBG] from='client.299796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:35 smithi027 bash[22610]: cluster 2024-08-31T07:29:34.217335+0000 mgr.a (mgr.14388) 13765 : cluster [DBG] pgmap v9542: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:35 smithi027 bash[22610]: audit 2024-08-31T07:29:34.992443+0000 mgr.a (mgr.14388) 13766 : audit [DBG] from='client.299796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:37 smithi191 bash[24992]: cluster 2024-08-31T07:29:36.218487+0000 mgr.a (mgr.14388) 13767 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:37 smithi163 bash[24253]: cluster 2024-08-31T07:29:36.218487+0000 mgr.a (mgr.14388) 13767 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:37 smithi027 bash[22610]: cluster 2024-08-31T07:29:36.218487+0000 mgr.a (mgr.14388) 13767 : cluster [DBG] pgmap v9543: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:39 smithi191 bash[24992]: cluster 2024-08-31T07:29:38.220718+0000 mgr.a (mgr.14388) 13768 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:39 smithi163 bash[24253]: cluster 2024-08-31T07:29:38.220718+0000 mgr.a (mgr.14388) 13768 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:39 smithi027 bash[22610]: cluster 2024-08-31T07:29:38.220718+0000 mgr.a (mgr.14388) 13768 : cluster [DBG] pgmap v9544: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:40.415 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:40.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:40.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:41.197 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:41.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:41.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:41.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:41.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:41 smithi163 bash[24253]: cluster 2024-08-31T07:29:40.221465+0000 mgr.a (mgr.14388) 13769 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:41 smithi163 bash[24253]: audit 2024-08-31T07:29:40.753809+0000 mgr.a (mgr.14388) 13770 : audit [DBG] from='client.299871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:41 smithi027 bash[22610]: cluster 2024-08-31T07:29:40.221465+0000 mgr.a (mgr.14388) 13769 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:41 smithi027 bash[22610]: audit 2024-08-31T07:29:40.753809+0000 mgr.a (mgr.14388) 13770 : audit [DBG] from='client.299871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:41 smithi191 bash[24992]: cluster 2024-08-31T07:29:40.221465+0000 mgr.a (mgr.14388) 13769 : cluster [DBG] pgmap v9545: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:41 smithi191 bash[24992]: audit 2024-08-31T07:29:40.753809+0000 mgr.a (mgr.14388) 13770 : audit [DBG] from='client.299871 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:43 smithi163 bash[24253]: cluster 2024-08-31T07:29:42.222366+0000 mgr.a (mgr.14388) 13771 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:43 smithi027 bash[22610]: cluster 2024-08-31T07:29:42.222366+0000 mgr.a (mgr.14388) 13771 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:43 smithi191 bash[24992]: cluster 2024-08-31T07:29:42.222366+0000 mgr.a (mgr.14388) 13771 : cluster [DBG] pgmap v9546: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:45 smithi163 bash[24253]: cluster 2024-08-31T07:29:44.224602+0000 mgr.a (mgr.14388) 13772 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:45.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:45 smithi027 bash[22610]: cluster 2024-08-31T07:29:44.224602+0000 mgr.a (mgr.14388) 13772 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:45 smithi191 bash[24992]: cluster 2024-08-31T07:29:44.224602+0000 mgr.a (mgr.14388) 13772 : cluster [DBG] pgmap v9547: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:46.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:46.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:46.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:46.983 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:46.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:46.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:46.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:46.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:47 smithi163 bash[24253]: cluster 2024-08-31T07:29:46.225276+0000 mgr.a (mgr.14388) 13773 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:47 smithi163 bash[24253]: audit 2024-08-31T07:29:46.538269+0000 mgr.a (mgr.14388) 13774 : audit [DBG] from='client.299946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:47 smithi027 bash[22610]: cluster 2024-08-31T07:29:46.225276+0000 mgr.a (mgr.14388) 13773 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:47 smithi027 bash[22610]: audit 2024-08-31T07:29:46.538269+0000 mgr.a (mgr.14388) 13774 : audit [DBG] from='client.299946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:47 smithi191 bash[24992]: cluster 2024-08-31T07:29:46.225276+0000 mgr.a (mgr.14388) 13773 : cluster [DBG] pgmap v9548: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:47 smithi191 bash[24992]: audit 2024-08-31T07:29:46.538269+0000 mgr.a (mgr.14388) 13774 : audit [DBG] from='client.299946 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:49 smithi163 bash[24253]: cluster 2024-08-31T07:29:48.227535+0000 mgr.a (mgr.14388) 13775 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:49 smithi027 bash[22610]: cluster 2024-08-31T07:29:48.227535+0000 mgr.a (mgr.14388) 13775 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:49 smithi191 bash[24992]: cluster 2024-08-31T07:29:48.227535+0000 mgr.a (mgr.14388) 13775 : cluster [DBG] pgmap v9549: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:51 smithi163 bash[24253]: cluster 2024-08-31T07:29:50.228312+0000 mgr.a (mgr.14388) 13776 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:51 smithi027 bash[22610]: cluster 2024-08-31T07:29:50.228312+0000 mgr.a (mgr.14388) 13776 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:51 smithi191 bash[24992]: cluster 2024-08-31T07:29:50.228312+0000 mgr.a (mgr.14388) 13776 : cluster [DBG] pgmap v9550: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:51.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:51.985 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:51.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:52.748 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:52.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:52.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:52.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:52.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:53 smithi163 bash[24253]: cluster 2024-08-31T07:29:52.229017+0000 mgr.a (mgr.14388) 13777 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:53 smithi163 bash[24253]: audit 2024-08-31T07:29:52.306513+0000 mgr.a (mgr.14388) 13778 : audit [DBG] from='client.300024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:53 smithi027 bash[22610]: cluster 2024-08-31T07:29:52.229017+0000 mgr.a (mgr.14388) 13777 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:53 smithi027 bash[22610]: audit 2024-08-31T07:29:52.306513+0000 mgr.a (mgr.14388) 13778 : audit [DBG] from='client.300024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:53 smithi191 bash[24992]: cluster 2024-08-31T07:29:52.229017+0000 mgr.a (mgr.14388) 13777 : cluster [DBG] pgmap v9551: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:53 smithi191 bash[24992]: audit 2024-08-31T07:29:52.306513+0000 mgr.a (mgr.14388) 13778 : audit [DBG] from='client.300024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:55 smithi163 bash[24253]: cluster 2024-08-31T07:29:54.231358+0000 mgr.a (mgr.14388) 13779 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:55 smithi027 bash[22610]: cluster 2024-08-31T07:29:54.231358+0000 mgr.a (mgr.14388) 13779 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:55 smithi191 bash[24992]: cluster 2024-08-31T07:29:54.231358+0000 mgr.a (mgr.14388) 13779 : cluster [DBG] pgmap v9552: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:29:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:57 smithi163 bash[24253]: cluster 2024-08-31T07:29:56.232133+0000 mgr.a (mgr.14388) 13780 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:57 smithi027 bash[22610]: cluster 2024-08-31T07:29:56.232133+0000 mgr.a (mgr.14388) 13780 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:57.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:29:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:29:57.751 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:29:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:57 smithi191 bash[24992]: cluster 2024-08-31T07:29:56.232133+0000 mgr.a (mgr.14388) 13780 : cluster [DBG] pgmap v9553: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:58.498 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:29:58.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:29:58.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:29:58.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:29:58.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:29:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:58 smithi163 bash[24253]: audit 2024-08-31T07:29:58.079583+0000 mgr.a (mgr.14388) 13781 : audit [DBG] from='client.300102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:58 smithi027 bash[22610]: audit 2024-08-31T07:29:58.079583+0000 mgr.a (mgr.14388) 13781 : audit [DBG] from='client.300102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:58 smithi191 bash[24992]: audit 2024-08-31T07:29:58.079583+0000 mgr.a (mgr.14388) 13781 : audit [DBG] from='client.300102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:29:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:29:59 smithi163 bash[24253]: cluster 2024-08-31T07:29:58.233468+0000 mgr.a (mgr.14388) 13782 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:29:59 smithi027 bash[22610]: cluster 2024-08-31T07:29:58.233468+0000 mgr.a (mgr.14388) 13782 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:29:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:29:59 smithi191 bash[24992]: cluster 2024-08-31T07:29:58.233468+0000 mgr.a (mgr.14388) 13782 : cluster [DBG] pgmap v9554: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:00 smithi163 bash[24253]: cluster 2024-08-31T07:30:00.000146+0000 mon.a (mon.0) 2636 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:30:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:00 smithi027 bash[22610]: cluster 2024-08-31T07:30:00.000146+0000 mon.a (mon.0) 2636 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:30:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:00 smithi191 bash[24992]: cluster 2024-08-31T07:30:00.000146+0000 mon.a (mon.0) 2636 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:30:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:01 smithi163 bash[24253]: cluster 2024-08-31T07:30:00.234306+0000 mgr.a (mgr.14388) 13783 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:01 smithi027 bash[22610]: cluster 2024-08-31T07:30:00.234306+0000 mgr.a (mgr.14388) 13783 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:01 smithi191 bash[24992]: cluster 2024-08-31T07:30:00.234306+0000 mgr.a (mgr.14388) 13783 : cluster [DBG] pgmap v9555: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:03.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:30:03.501 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:30:03.501 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:30:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:03 smithi163 bash[24253]: cluster 2024-08-31T07:30:02.235133+0000 mgr.a (mgr.14388) 13784 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:03 smithi027 bash[22610]: cluster 2024-08-31T07:30:02.235133+0000 mgr.a (mgr.14388) 13784 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:03 smithi191 bash[24992]: cluster 2024-08-31T07:30:02.235133+0000 mgr.a (mgr.14388) 13784 : cluster [DBG] pgmap v9556: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:04.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:30:04.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:30:04.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:30:04.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:30:04.283 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:30:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:04 smithi163 bash[24253]: audit 2024-08-31T07:30:03.835669+0000 mgr.a (mgr.14388) 13785 : audit [DBG] from='client.300174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:04 smithi027 bash[22610]: audit 2024-08-31T07:30:03.835669+0000 mgr.a (mgr.14388) 13785 : audit [DBG] from='client.300174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:04 smithi191 bash[24992]: audit 2024-08-31T07:30:03.835669+0000 mgr.a (mgr.14388) 13785 : audit [DBG] from='client.300174 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:05 smithi163 bash[24253]: cluster 2024-08-31T07:30:04.236487+0000 mgr.a (mgr.14388) 13786 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:05 smithi027 bash[22610]: cluster 2024-08-31T07:30:04.236487+0000 mgr.a (mgr.14388) 13786 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:05 smithi191 bash[24992]: cluster 2024-08-31T07:30:04.236487+0000 mgr.a (mgr.14388) 13786 : cluster [DBG] pgmap v9557: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:07 smithi163 bash[24253]: cluster 2024-08-31T07:30:06.237240+0000 mgr.a (mgr.14388) 13787 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:07.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:07 smithi027 bash[22610]: cluster 2024-08-31T07:30:06.237240+0000 mgr.a (mgr.14388) 13787 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:07 smithi191 bash[24992]: cluster 2024-08-31T07:30:06.237240+0000 mgr.a (mgr.14388) 13787 : cluster [DBG] pgmap v9558: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:09.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:30:09.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:30:09.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:30:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:09 smithi163 bash[24253]: cluster 2024-08-31T07:30:08.239205+0000 mgr.a (mgr.14388) 13788 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:09 smithi027 bash[22610]: cluster 2024-08-31T07:30:08.239205+0000 mgr.a (mgr.14388) 13788 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:09 smithi191 bash[24992]: cluster 2024-08-31T07:30:08.239205+0000 mgr.a (mgr.14388) 13788 : cluster [DBG] pgmap v9559: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:10.055 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:30:10.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:30:10.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:30:10.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:30:10.056 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:30:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:10 smithi163 bash[24253]: audit 2024-08-31T07:30:09.625728+0000 mgr.a (mgr.14388) 13789 : audit [DBG] from='client.300249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:10 smithi027 bash[22610]: audit 2024-08-31T07:30:09.625728+0000 mgr.a (mgr.14388) 13789 : audit [DBG] from='client.300249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:10 smithi191 bash[24992]: audit 2024-08-31T07:30:09.625728+0000 mgr.a (mgr.14388) 13789 : audit [DBG] from='client.300249 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:11 smithi163 bash[24253]: cluster 2024-08-31T07:30:10.240083+0000 mgr.a (mgr.14388) 13790 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:11 smithi027 bash[22610]: cluster 2024-08-31T07:30:10.240083+0000 mgr.a (mgr.14388) 13790 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:11 smithi191 bash[24992]: cluster 2024-08-31T07:30:10.240083+0000 mgr.a (mgr.14388) 13790 : cluster [DBG] pgmap v9560: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:13 smithi163 bash[24253]: cluster 2024-08-31T07:30:12.240869+0000 mgr.a (mgr.14388) 13791 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:13 smithi027 bash[22610]: cluster 2024-08-31T07:30:12.240869+0000 mgr.a (mgr.14388) 13791 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:13 smithi191 bash[24992]: cluster 2024-08-31T07:30:12.240869+0000 mgr.a (mgr.14388) 13791 : cluster [DBG] pgmap v9561: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:15.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:30:15.058 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:30:15.058 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:30:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:15 smithi163 bash[24253]: cluster 2024-08-31T07:30:14.243098+0000 mgr.a (mgr.14388) 13792 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:15 smithi027 bash[22610]: cluster 2024-08-31T07:30:14.243098+0000 mgr.a (mgr.14388) 13792 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:15 smithi191 bash[24992]: cluster 2024-08-31T07:30:14.243098+0000 mgr.a (mgr.14388) 13792 : cluster [DBG] pgmap v9562: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:15.842 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:30:15.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:30:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:30:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:30:15.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:30:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:16 smithi163 bash[24253]: audit 2024-08-31T07:30:15.394171+0000 mgr.a (mgr.14388) 13793 : audit [DBG] from='client.300324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:16 smithi027 bash[22610]: audit 2024-08-31T07:30:15.394171+0000 mgr.a (mgr.14388) 13793 : audit [DBG] from='client.300324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:16 smithi191 bash[24992]: audit 2024-08-31T07:30:15.394171+0000 mgr.a (mgr.14388) 13793 : audit [DBG] from='client.300324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:17 smithi163 bash[24253]: cluster 2024-08-31T07:30:16.244067+0000 mgr.a (mgr.14388) 13794 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:17 smithi027 bash[22610]: cluster 2024-08-31T07:30:16.244067+0000 mgr.a (mgr.14388) 13794 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:17 smithi191 bash[24992]: cluster 2024-08-31T07:30:16.244067+0000 mgr.a (mgr.14388) 13794 : cluster [DBG] pgmap v9563: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:18 smithi163 bash[24253]: audit 2024-08-31T07:30:17.529435+0000 mon.a (mon.0) 2637 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:30:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:18 smithi163 bash[24253]: audit 2024-08-31T07:30:18.380493+0000 mon.a (mon.0) 2638 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:30:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:18 smithi163 bash[24253]: audit 2024-08-31T07:30:18.381725+0000 mon.a (mon.0) 2639 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:30:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:18 smithi163 bash[24253]: audit 2024-08-31T07:30:18.390214+0000 mon.a (mon.0) 2640 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:30:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:18 smithi163 bash[24253]: audit 2024-08-31T07:30:18.392599+0000 mon.a (mon.0) 2641 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:30:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:18 smithi027 bash[22610]: audit 2024-08-31T07:30:17.529435+0000 mon.a (mon.0) 2637 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:30:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:18 smithi027 bash[22610]: audit 2024-08-31T07:30:18.380493+0000 mon.a (mon.0) 2638 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:30:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:18 smithi027 bash[22610]: audit 2024-08-31T07:30:18.381725+0000 mon.a (mon.0) 2639 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:30:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:18 smithi027 bash[22610]: audit 2024-08-31T07:30:18.390214+0000 mon.a (mon.0) 2640 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:30:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:18 smithi027 bash[22610]: audit 2024-08-31T07:30:18.392599+0000 mon.a (mon.0) 2641 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:30:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:18 smithi191 bash[24992]: audit 2024-08-31T07:30:17.529435+0000 mon.a (mon.0) 2637 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:30:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:18 smithi191 bash[24992]: audit 2024-08-31T07:30:18.380493+0000 mon.a (mon.0) 2638 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:30:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:18 smithi191 bash[24992]: audit 2024-08-31T07:30:18.381725+0000 mon.a (mon.0) 2639 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:30:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:18 smithi191 bash[24992]: audit 2024-08-31T07:30:18.390214+0000 mon.a (mon.0) 2640 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:30:18.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:18 smithi191 bash[24992]: audit 2024-08-31T07:30:18.392599+0000 mon.a (mon.0) 2641 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:30:19.407 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:30:19 smithi027 bash[22863]: debug 2024-08-31T07:30:19.118+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:30:19.407 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:30:19 smithi027 bash[22863]: debug 2024-08-31T07:30:19.118+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:30:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:19 smithi163 bash[24253]: cluster 2024-08-31T07:30:18.245250+0000 mgr.a (mgr.14388) 13795 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:19 smithi163 bash[24253]: audit 2024-08-31T07:30:18.394930+0000 mgr.a (mgr.14388) 13796 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:30:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:19 smithi027 bash[22610]: cluster 2024-08-31T07:30:18.245250+0000 mgr.a (mgr.14388) 13795 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:19.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:19 smithi027 bash[22610]: audit 2024-08-31T07:30:18.394930+0000 mgr.a (mgr.14388) 13796 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:30:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:19 smithi191 bash[24992]: cluster 2024-08-31T07:30:18.245250+0000 mgr.a (mgr.14388) 13795 : cluster [DBG] pgmap v9564: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:19 smithi191 bash[24992]: audit 2024-08-31T07:30:18.394930+0000 mgr.a (mgr.14388) 13796 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:30:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:20 smithi163 bash[24253]: audit 2024-08-31T07:30:19.119392+0000 mgr.a (mgr.14388) 13797 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:30:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:20 smithi163 bash[24253]: cephadm 2024-08-31T07:30:19.120620+0000 mgr.a (mgr.14388) 13798 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:30:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:20 smithi027 bash[22610]: audit 2024-08-31T07:30:19.119392+0000 mgr.a (mgr.14388) 13797 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:30:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:20 smithi027 bash[22610]: cephadm 2024-08-31T07:30:19.120620+0000 mgr.a (mgr.14388) 13798 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:30:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:20 smithi191 bash[24992]: audit 2024-08-31T07:30:19.119392+0000 mgr.a (mgr.14388) 13797 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:30:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:20 smithi191 bash[24992]: cephadm 2024-08-31T07:30:19.120620+0000 mgr.a (mgr.14388) 13798 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:30:20.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:30:20.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:30:20.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:30:21.642 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:30:21.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:30:21.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:30:21.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:30:21.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:30:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:21 smithi163 bash[24253]: cluster 2024-08-31T07:30:20.246077+0000 mgr.a (mgr.14388) 13799 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:21 smithi027 bash[22610]: cluster 2024-08-31T07:30:20.246077+0000 mgr.a (mgr.14388) 13799 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:21 smithi191 bash[24992]: cluster 2024-08-31T07:30:20.246077+0000 mgr.a (mgr.14388) 13799 : cluster [DBG] pgmap v9565: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:22 smithi163 bash[24253]: audit 2024-08-31T07:30:21.185720+0000 mgr.a (mgr.14388) 13800 : audit [DBG] from='client.300504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:22 smithi027 bash[22610]: audit 2024-08-31T07:30:21.185720+0000 mgr.a (mgr.14388) 13800 : audit [DBG] from='client.300504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:22 smithi191 bash[24992]: audit 2024-08-31T07:30:21.185720+0000 mgr.a (mgr.14388) 13800 : audit [DBG] from='client.300504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:23 smithi163 bash[24253]: cluster 2024-08-31T07:30:22.246633+0000 mgr.a (mgr.14388) 13801 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:23 smithi027 bash[22610]: cluster 2024-08-31T07:30:22.246633+0000 mgr.a (mgr.14388) 13801 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:23 smithi191 bash[24992]: cluster 2024-08-31T07:30:22.246633+0000 mgr.a (mgr.14388) 13801 : cluster [DBG] pgmap v9566: 225 pgs: 225 active+clean; 589 KiB data, 144 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:25 smithi163 bash[24253]: cluster 2024-08-31T07:30:24.248811+0000 mgr.a (mgr.14388) 13802 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:25 smithi027 bash[22610]: cluster 2024-08-31T07:30:24.248811+0000 mgr.a (mgr.14388) 13802 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:25 smithi191 bash[24992]: cluster 2024-08-31T07:30:24.248811+0000 mgr.a (mgr.14388) 13802 : cluster [DBG] pgmap v9567: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:26.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:30:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:30:26.644 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:30:27.391 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:30:27.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:30:27.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:30:27.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:30:27.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:30:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:27 smithi163 bash[24253]: cluster 2024-08-31T07:30:26.249575+0000 mgr.a (mgr.14388) 13803 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:27 smithi163 bash[24253]: audit 2024-08-31T07:30:26.973524+0000 mgr.a (mgr.14388) 13804 : audit [DBG] from='client.300582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:27 smithi027 bash[22610]: cluster 2024-08-31T07:30:26.249575+0000 mgr.a (mgr.14388) 13803 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:27 smithi027 bash[22610]: audit 2024-08-31T07:30:26.973524+0000 mgr.a (mgr.14388) 13804 : audit [DBG] from='client.300582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:27 smithi191 bash[24992]: cluster 2024-08-31T07:30:26.249575+0000 mgr.a (mgr.14388) 13803 : cluster [DBG] pgmap v9568: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:27 smithi191 bash[24992]: audit 2024-08-31T07:30:26.973524+0000 mgr.a (mgr.14388) 13804 : audit [DBG] from='client.300582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:29 smithi163 bash[24253]: cluster 2024-08-31T07:30:28.251814+0000 mgr.a (mgr.14388) 13805 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:29 smithi027 bash[22610]: cluster 2024-08-31T07:30:28.251814+0000 mgr.a (mgr.14388) 13805 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:29 smithi191 bash[24992]: cluster 2024-08-31T07:30:28.251814+0000 mgr.a (mgr.14388) 13805 : cluster [DBG] pgmap v9569: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:31 smithi163 bash[24253]: cluster 2024-08-31T07:30:30.252573+0000 mgr.a (mgr.14388) 13806 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:31.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:31 smithi027 bash[22610]: cluster 2024-08-31T07:30:30.252573+0000 mgr.a (mgr.14388) 13806 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:31 smithi191 bash[24992]: cluster 2024-08-31T07:30:30.252573+0000 mgr.a (mgr.14388) 13806 : cluster [DBG] pgmap v9570: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:32.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:30:32.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:30:32.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:30:33.135 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:30:33.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:30:33.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:30:33.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:30:33.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:30:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:33 smithi027 bash[22610]: cluster 2024-08-31T07:30:32.253347+0000 mgr.a (mgr.14388) 13807 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:33 smithi027 bash[22610]: audit 2024-08-31T07:30:32.723768+0000 mgr.a (mgr.14388) 13808 : audit [DBG] from='client.300660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:33 smithi191 bash[24992]: cluster 2024-08-31T07:30:32.253347+0000 mgr.a (mgr.14388) 13807 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:33 smithi191 bash[24992]: audit 2024-08-31T07:30:32.723768+0000 mgr.a (mgr.14388) 13808 : audit [DBG] from='client.300660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:33 smithi163 bash[24253]: cluster 2024-08-31T07:30:32.253347+0000 mgr.a (mgr.14388) 13807 : cluster [DBG] pgmap v9571: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:33 smithi163 bash[24253]: audit 2024-08-31T07:30:32.723768+0000 mgr.a (mgr.14388) 13808 : audit [DBG] from='client.300660 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:35 smithi027 bash[22610]: cluster 2024-08-31T07:30:34.256070+0000 mgr.a (mgr.14388) 13809 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:35 smithi191 bash[24992]: cluster 2024-08-31T07:30:34.256070+0000 mgr.a (mgr.14388) 13809 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:35 smithi163 bash[24253]: cluster 2024-08-31T07:30:34.256070+0000 mgr.a (mgr.14388) 13809 : cluster [DBG] pgmap v9572: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:30:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:37 smithi027 bash[22610]: cluster 2024-08-31T07:30:36.256850+0000 mgr.a (mgr.14388) 13810 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:30:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:37 smithi191 bash[24992]: cluster 2024-08-31T07:30:36.256850+0000 mgr.a (mgr.14388) 13810 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:30:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:37 smithi163 bash[24253]: cluster 2024-08-31T07:30:36.256850+0000 mgr.a (mgr.14388) 13810 : cluster [DBG] pgmap v9573: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:30:38.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:30:38.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:30:38.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:30:38.917 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:30:38.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:30:38.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:30:38.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:30:38.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:30:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:39 smithi027 bash[22610]: cluster 2024-08-31T07:30:38.257942+0000 mgr.a (mgr.14388) 13811 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:39.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:39 smithi027 bash[22610]: audit 2024-08-31T07:30:38.473135+0000 mgr.a (mgr.14388) 13812 : audit [DBG] from='client.300738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:39 smithi191 bash[24992]: cluster 2024-08-31T07:30:38.257942+0000 mgr.a (mgr.14388) 13811 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:39 smithi191 bash[24992]: audit 2024-08-31T07:30:38.473135+0000 mgr.a (mgr.14388) 13812 : audit [DBG] from='client.300738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:39 smithi163 bash[24253]: cluster 2024-08-31T07:30:38.257942+0000 mgr.a (mgr.14388) 13811 : cluster [DBG] pgmap v9574: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:39 smithi163 bash[24253]: audit 2024-08-31T07:30:38.473135+0000 mgr.a (mgr.14388) 13812 : audit [DBG] from='client.300738 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:41 smithi027 bash[22610]: cluster 2024-08-31T07:30:40.258866+0000 mgr.a (mgr.14388) 13813 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:41 smithi191 bash[24992]: cluster 2024-08-31T07:30:40.258866+0000 mgr.a (mgr.14388) 13813 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:41 smithi163 bash[24253]: cluster 2024-08-31T07:30:40.258866+0000 mgr.a (mgr.14388) 13813 : cluster [DBG] pgmap v9575: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:43 smithi027 bash[22610]: cluster 2024-08-31T07:30:42.259632+0000 mgr.a (mgr.14388) 13814 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:43 smithi191 bash[24992]: cluster 2024-08-31T07:30:42.259632+0000 mgr.a (mgr.14388) 13814 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:43.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:30:43.919 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:30:43.919 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:30:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:43 smithi163 bash[24253]: cluster 2024-08-31T07:30:42.259632+0000 mgr.a (mgr.14388) 13814 : cluster [DBG] pgmap v9576: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:30:44.662 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:30:44.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:30:44.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:30:44.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:30:44.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:30:45.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:45 smithi027 bash[22610]: audit 2024-08-31T07:30:44.249933+0000 mgr.a (mgr.14388) 13815 : audit [DBG] from='client.300816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:45.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:45 smithi027 bash[22610]: cluster 2024-08-31T07:30:44.264677+0000 mgr.a (mgr.14388) 13816 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:45 smithi191 bash[24992]: audit 2024-08-31T07:30:44.249933+0000 mgr.a (mgr.14388) 13815 : audit [DBG] from='client.300816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:45 smithi191 bash[24992]: cluster 2024-08-31T07:30:44.264677+0000 mgr.a (mgr.14388) 13816 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:45 smithi163 bash[24253]: audit 2024-08-31T07:30:44.249933+0000 mgr.a (mgr.14388) 13815 : audit [DBG] from='client.300816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:45 smithi163 bash[24253]: cluster 2024-08-31T07:30:44.264677+0000 mgr.a (mgr.14388) 13816 : cluster [DBG] pgmap v9577: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:47 smithi027 bash[22610]: cluster 2024-08-31T07:30:46.265566+0000 mgr.a (mgr.14388) 13817 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:47 smithi191 bash[24992]: cluster 2024-08-31T07:30:46.265566+0000 mgr.a (mgr.14388) 13817 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:47 smithi163 bash[24253]: cluster 2024-08-31T07:30:46.265566+0000 mgr.a (mgr.14388) 13817 : cluster [DBG] pgmap v9578: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:49.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:30:49.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:30:49.665 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:30:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:49 smithi191 bash[24992]: cluster 2024-08-31T07:30:48.267712+0000 mgr.a (mgr.14388) 13818 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:49 smithi163 bash[24253]: cluster 2024-08-31T07:30:48.267712+0000 mgr.a (mgr.14388) 13818 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:49 smithi027 bash[22610]: cluster 2024-08-31T07:30:48.267712+0000 mgr.a (mgr.14388) 13818 : cluster [DBG] pgmap v9579: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:50.413 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:30:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:30:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:30:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:30:50.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:30:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:50 smithi191 bash[24992]: audit 2024-08-31T07:30:49.994664+0000 mgr.a (mgr.14388) 13819 : audit [DBG] from='client.300891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:50 smithi163 bash[24253]: audit 2024-08-31T07:30:49.994664+0000 mgr.a (mgr.14388) 13819 : audit [DBG] from='client.300891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:50 smithi027 bash[22610]: audit 2024-08-31T07:30:49.994664+0000 mgr.a (mgr.14388) 13819 : audit [DBG] from='client.300891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:51 smithi191 bash[24992]: cluster 2024-08-31T07:30:50.268419+0000 mgr.a (mgr.14388) 13820 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:51 smithi163 bash[24253]: cluster 2024-08-31T07:30:50.268419+0000 mgr.a (mgr.14388) 13820 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:51 smithi027 bash[22610]: cluster 2024-08-31T07:30:50.268419+0000 mgr.a (mgr.14388) 13820 : cluster [DBG] pgmap v9580: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:53 smithi191 bash[24992]: cluster 2024-08-31T07:30:52.269326+0000 mgr.a (mgr.14388) 13821 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:53 smithi163 bash[24253]: cluster 2024-08-31T07:30:52.269326+0000 mgr.a (mgr.14388) 13821 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:53 smithi027 bash[22610]: cluster 2024-08-31T07:30:52.269326+0000 mgr.a (mgr.14388) 13821 : cluster [DBG] pgmap v9581: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:55.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:30:55.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:30:55.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:30:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:55 smithi191 bash[24992]: cluster 2024-08-31T07:30:54.271567+0000 mgr.a (mgr.14388) 13822 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:55 smithi163 bash[24253]: cluster 2024-08-31T07:30:54.271567+0000 mgr.a (mgr.14388) 13822 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:55 smithi027 bash[22610]: cluster 2024-08-31T07:30:54.271567+0000 mgr.a (mgr.14388) 13822 : cluster [DBG] pgmap v9582: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:56.162 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:30:56.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:30:56.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:30:56.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:30:56.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:30:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:56 smithi191 bash[24992]: audit 2024-08-31T07:30:55.745039+0000 mgr.a (mgr.14388) 13823 : audit [DBG] from='client.300969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:56 smithi163 bash[24253]: audit 2024-08-31T07:30:55.745039+0000 mgr.a (mgr.14388) 13823 : audit [DBG] from='client.300969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:56 smithi027 bash[22610]: audit 2024-08-31T07:30:55.745039+0000 mgr.a (mgr.14388) 13823 : audit [DBG] from='client.300969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:30:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:57 smithi191 bash[24992]: cluster 2024-08-31T07:30:56.272661+0000 mgr.a (mgr.14388) 13824 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:57 smithi163 bash[24253]: cluster 2024-08-31T07:30:56.272661+0000 mgr.a (mgr.14388) 13824 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:57 smithi027 bash[22610]: cluster 2024-08-31T07:30:56.272661+0000 mgr.a (mgr.14388) 13824 : cluster [DBG] pgmap v9583: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:30:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:30:59 smithi191 bash[24992]: cluster 2024-08-31T07:30:58.274840+0000 mgr.a (mgr.14388) 13825 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:30:59 smithi163 bash[24253]: cluster 2024-08-31T07:30:58.274840+0000 mgr.a (mgr.14388) 13825 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:30:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:30:59 smithi027 bash[22610]: cluster 2024-08-31T07:30:58.274840+0000 mgr.a (mgr.14388) 13825 : cluster [DBG] pgmap v9584: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:01.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:01.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:01 smithi191 bash[24992]: cluster 2024-08-31T07:31:00.275555+0000 mgr.a (mgr.14388) 13826 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:01.932 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:31:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:01 smithi163 bash[24253]: cluster 2024-08-31T07:31:00.275555+0000 mgr.a (mgr.14388) 13826 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:01 smithi027 bash[22610]: cluster 2024-08-31T07:31:00.275555+0000 mgr.a (mgr.14388) 13826 : cluster [DBG] pgmap v9585: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:02 smithi191 bash[24992]: audit 2024-08-31T07:31:01.503227+0000 mgr.a (mgr.14388) 13827 : audit [DBG] from='client.301047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:02 smithi163 bash[24253]: audit 2024-08-31T07:31:01.503227+0000 mgr.a (mgr.14388) 13827 : audit [DBG] from='client.301047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:02 smithi027 bash[22610]: audit 2024-08-31T07:31:01.503227+0000 mgr.a (mgr.14388) 13827 : audit [DBG] from='client.301047 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:03 smithi163 bash[24253]: cluster 2024-08-31T07:31:02.276428+0000 mgr.a (mgr.14388) 13828 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:03 smithi027 bash[22610]: cluster 2024-08-31T07:31:02.276428+0000 mgr.a (mgr.14388) 13828 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:03 smithi191 bash[24992]: cluster 2024-08-31T07:31:02.276428+0000 mgr.a (mgr.14388) 13828 : cluster [DBG] pgmap v9586: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:05 smithi163 bash[24253]: cluster 2024-08-31T07:31:04.278616+0000 mgr.a (mgr.14388) 13829 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:05 smithi027 bash[22610]: cluster 2024-08-31T07:31:04.278616+0000 mgr.a (mgr.14388) 13829 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:05 smithi191 bash[24992]: cluster 2024-08-31T07:31:04.278616+0000 mgr.a (mgr.14388) 13829 : cluster [DBG] pgmap v9587: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:06.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:06.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:06.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:07.688 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:07.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:07.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:07.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:07.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:31:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:07 smithi163 bash[24253]: cluster 2024-08-31T07:31:06.279372+0000 mgr.a (mgr.14388) 13830 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:07 smithi027 bash[22610]: cluster 2024-08-31T07:31:06.279372+0000 mgr.a (mgr.14388) 13830 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:07 smithi191 bash[24992]: cluster 2024-08-31T07:31:06.279372+0000 mgr.a (mgr.14388) 13830 : cluster [DBG] pgmap v9588: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:08 smithi163 bash[24253]: audit 2024-08-31T07:31:07.264440+0000 mgr.a (mgr.14388) 13831 : audit [DBG] from='client.301125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:08 smithi027 bash[22610]: audit 2024-08-31T07:31:07.264440+0000 mgr.a (mgr.14388) 13831 : audit [DBG] from='client.301125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:08 smithi191 bash[24992]: audit 2024-08-31T07:31:07.264440+0000 mgr.a (mgr.14388) 13831 : audit [DBG] from='client.301125 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:09 smithi163 bash[24253]: cluster 2024-08-31T07:31:08.281638+0000 mgr.a (mgr.14388) 13832 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:09 smithi027 bash[22610]: cluster 2024-08-31T07:31:08.281638+0000 mgr.a (mgr.14388) 13832 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:09 smithi191 bash[24992]: cluster 2024-08-31T07:31:08.281638+0000 mgr.a (mgr.14388) 13832 : cluster [DBG] pgmap v9589: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:11 smithi163 bash[24253]: cluster 2024-08-31T07:31:10.282391+0000 mgr.a (mgr.14388) 13833 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:11 smithi027 bash[22610]: cluster 2024-08-31T07:31:10.282391+0000 mgr.a (mgr.14388) 13833 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:11 smithi191 bash[24992]: cluster 2024-08-31T07:31:10.282391+0000 mgr.a (mgr.14388) 13833 : cluster [DBG] pgmap v9590: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:12.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:12.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:12.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:13.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:31:13.444 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:13 smithi163 bash[24253]: cluster 2024-08-31T07:31:12.283158+0000 mgr.a (mgr.14388) 13834 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:13 smithi163 bash[24253]: audit 2024-08-31T07:31:13.023112+0000 mgr.a (mgr.14388) 13835 : audit [DBG] from='client.301200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:13 smithi027 bash[22610]: cluster 2024-08-31T07:31:12.283158+0000 mgr.a (mgr.14388) 13834 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:13 smithi027 bash[22610]: audit 2024-08-31T07:31:13.023112+0000 mgr.a (mgr.14388) 13835 : audit [DBG] from='client.301200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:13 smithi191 bash[24992]: cluster 2024-08-31T07:31:12.283158+0000 mgr.a (mgr.14388) 13834 : cluster [DBG] pgmap v9591: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:13 smithi191 bash[24992]: audit 2024-08-31T07:31:13.023112+0000 mgr.a (mgr.14388) 13835 : audit [DBG] from='client.301200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:15 smithi163 bash[24253]: cluster 2024-08-31T07:31:14.285894+0000 mgr.a (mgr.14388) 13836 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:15 smithi027 bash[22610]: cluster 2024-08-31T07:31:14.285894+0000 mgr.a (mgr.14388) 13836 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:15 smithi191 bash[24992]: cluster 2024-08-31T07:31:14.285894+0000 mgr.a (mgr.14388) 13836 : cluster [DBG] pgmap v9592: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:17 smithi163 bash[24253]: cluster 2024-08-31T07:31:16.286679+0000 mgr.a (mgr.14388) 13837 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:17 smithi027 bash[22610]: cluster 2024-08-31T07:31:16.286679+0000 mgr.a (mgr.14388) 13837 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:17 smithi191 bash[24992]: cluster 2024-08-31T07:31:16.286679+0000 mgr.a (mgr.14388) 13837 : cluster [DBG] pgmap v9593: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:18.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:18.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:18.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:19.226 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:19.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:19.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:19.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:19.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:31:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:19 smithi163 bash[24253]: cluster 2024-08-31T07:31:18.288564+0000 mgr.a (mgr.14388) 13838 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:19 smithi163 bash[24253]: audit 2024-08-31T07:31:18.778492+0000 mgr.a (mgr.14388) 13839 : audit [DBG] from='client.301275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:19 smithi163 bash[24253]: audit 2024-08-31T07:31:19.169135+0000 mon.a (mon.0) 2642 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:31:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:19 smithi027 bash[22610]: cluster 2024-08-31T07:31:18.288564+0000 mgr.a (mgr.14388) 13838 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:19 smithi027 bash[22610]: audit 2024-08-31T07:31:18.778492+0000 mgr.a (mgr.14388) 13839 : audit [DBG] from='client.301275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:19 smithi027 bash[22610]: audit 2024-08-31T07:31:19.169135+0000 mon.a (mon.0) 2642 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:31:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:19 smithi191 bash[24992]: cluster 2024-08-31T07:31:18.288564+0000 mgr.a (mgr.14388) 13838 : cluster [DBG] pgmap v9594: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:19 smithi191 bash[24992]: audit 2024-08-31T07:31:18.778492+0000 mgr.a (mgr.14388) 13839 : audit [DBG] from='client.301275 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:19 smithi191 bash[24992]: audit 2024-08-31T07:31:19.169135+0000 mon.a (mon.0) 2642 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:31:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:20 smithi027 bash[22610]: audit 2024-08-31T07:31:19.715465+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:31:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:20 smithi027 bash[22610]: audit 2024-08-31T07:31:19.720705+0000 mon.a (mon.0) 2644 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:31:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:20 smithi027 bash[22610]: audit 2024-08-31T07:31:20.353119+0000 mon.a (mon.0) 2645 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:31:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:20 smithi027 bash[22610]: audit 2024-08-31T07:31:20.354082+0000 mon.a (mon.0) 2646 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:31:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:20 smithi027 bash[22610]: audit 2024-08-31T07:31:20.359995+0000 mon.a (mon.0) 2647 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:31:20.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:20 smithi027 bash[22610]: audit 2024-08-31T07:31:20.364706+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:31:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:20 smithi191 bash[24992]: audit 2024-08-31T07:31:19.715465+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:31:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:20 smithi191 bash[24992]: audit 2024-08-31T07:31:19.720705+0000 mon.a (mon.0) 2644 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:31:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:20 smithi191 bash[24992]: audit 2024-08-31T07:31:20.353119+0000 mon.a (mon.0) 2645 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:31:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:20 smithi191 bash[24992]: audit 2024-08-31T07:31:20.354082+0000 mon.a (mon.0) 2646 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:31:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:20 smithi191 bash[24992]: audit 2024-08-31T07:31:20.359995+0000 mon.a (mon.0) 2647 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:31:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:20 smithi191 bash[24992]: audit 2024-08-31T07:31:20.364706+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:31:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:20 smithi163 bash[24253]: audit 2024-08-31T07:31:19.715465+0000 mon.a (mon.0) 2643 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:31:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:20 smithi163 bash[24253]: audit 2024-08-31T07:31:19.720705+0000 mon.a (mon.0) 2644 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:31:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:20 smithi163 bash[24253]: audit 2024-08-31T07:31:20.353119+0000 mon.a (mon.0) 2645 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:31:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:20 smithi163 bash[24253]: audit 2024-08-31T07:31:20.354082+0000 mon.a (mon.0) 2646 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:31:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:20 smithi163 bash[24253]: audit 2024-08-31T07:31:20.359995+0000 mon.a (mon.0) 2647 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:31:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:20 smithi163 bash[24253]: audit 2024-08-31T07:31:20.364706+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:31:21.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:31:21 smithi027 bash[22863]: debug 2024-08-31T07:31:21.088+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:31:21.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:31:21 smithi027 bash[22863]: debug 2024-08-31T07:31:21.092+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:31:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:21 smithi027 bash[22610]: cluster 2024-08-31T07:31:20.289212+0000 mgr.a (mgr.14388) 13840 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:21 smithi027 bash[22610]: audit 2024-08-31T07:31:20.367173+0000 mgr.a (mgr.14388) 13841 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:31:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:21 smithi027 bash[22610]: audit 2024-08-31T07:31:21.093093+0000 mgr.a (mgr.14388) 13842 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:31:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:21 smithi027 bash[22610]: cephadm 2024-08-31T07:31:21.095135+0000 mgr.a (mgr.14388) 13843 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:31:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:21 smithi191 bash[24992]: cluster 2024-08-31T07:31:20.289212+0000 mgr.a (mgr.14388) 13840 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:21 smithi191 bash[24992]: audit 2024-08-31T07:31:20.367173+0000 mgr.a (mgr.14388) 13841 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:31:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:21 smithi191 bash[24992]: audit 2024-08-31T07:31:21.093093+0000 mgr.a (mgr.14388) 13842 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:31:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:21 smithi191 bash[24992]: cephadm 2024-08-31T07:31:21.095135+0000 mgr.a (mgr.14388) 13843 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:31:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:21 smithi163 bash[24253]: cluster 2024-08-31T07:31:20.289212+0000 mgr.a (mgr.14388) 13840 : cluster [DBG] pgmap v9595: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:21 smithi163 bash[24253]: audit 2024-08-31T07:31:20.367173+0000 mgr.a (mgr.14388) 13841 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:31:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:21 smithi163 bash[24253]: audit 2024-08-31T07:31:21.093093+0000 mgr.a (mgr.14388) 13842 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:31:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:21 smithi163 bash[24253]: cephadm 2024-08-31T07:31:21.095135+0000 mgr.a (mgr.14388) 13843 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:31:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:23 smithi027 bash[22610]: cluster 2024-08-31T07:31:22.290061+0000 mgr.a (mgr.14388) 13844 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:31:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:23 smithi191 bash[24992]: cluster 2024-08-31T07:31:22.290061+0000 mgr.a (mgr.14388) 13844 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:31:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:23 smithi163 bash[24253]: cluster 2024-08-31T07:31:22.290061+0000 mgr.a (mgr.14388) 13844 : cluster [DBG] pgmap v9596: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:31:24.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:24.228 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:24.228 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:24.977 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:24.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:24.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:24.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:24.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:31:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:25 smithi191 bash[24992]: cluster 2024-08-31T07:31:24.291529+0000 mgr.a (mgr.14388) 13845 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:25 smithi191 bash[24992]: audit 2024-08-31T07:31:24.559704+0000 mgr.a (mgr.14388) 13846 : audit [DBG] from='client.301455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:25 smithi163 bash[24253]: cluster 2024-08-31T07:31:24.291529+0000 mgr.a (mgr.14388) 13845 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:25 smithi163 bash[24253]: audit 2024-08-31T07:31:24.559704+0000 mgr.a (mgr.14388) 13846 : audit [DBG] from='client.301455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:25 smithi027 bash[22610]: cluster 2024-08-31T07:31:24.291529+0000 mgr.a (mgr.14388) 13845 : cluster [DBG] pgmap v9597: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:25 smithi027 bash[22610]: audit 2024-08-31T07:31:24.559704+0000 mgr.a (mgr.14388) 13846 : audit [DBG] from='client.301455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:27 smithi191 bash[24992]: cluster 2024-08-31T07:31:26.292312+0000 mgr.a (mgr.14388) 13847 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:27 smithi163 bash[24253]: cluster 2024-08-31T07:31:26.292312+0000 mgr.a (mgr.14388) 13847 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:27 smithi027 bash[22610]: cluster 2024-08-31T07:31:26.292312+0000 mgr.a (mgr.14388) 13847 : cluster [DBG] pgmap v9598: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:29.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:29.979 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:29.979 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:29 smithi191 bash[24992]: cluster 2024-08-31T07:31:28.294481+0000 mgr.a (mgr.14388) 13848 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:29 smithi163 bash[24253]: cluster 2024-08-31T07:31:28.294481+0000 mgr.a (mgr.14388) 13848 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:29 smithi027 bash[22610]: cluster 2024-08-31T07:31:28.294481+0000 mgr.a (mgr.14388) 13848 : cluster [DBG] pgmap v9599: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:30.764 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:30.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:30.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:30.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:30.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:31:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:31 smithi191 bash[24992]: cluster 2024-08-31T07:31:30.295213+0000 mgr.a (mgr.14388) 13849 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:31 smithi191 bash[24992]: audit 2024-08-31T07:31:30.309456+0000 mgr.a (mgr.14388) 13850 : audit [DBG] from='client.301533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:31 smithi163 bash[24253]: cluster 2024-08-31T07:31:30.295213+0000 mgr.a (mgr.14388) 13849 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:31 smithi163 bash[24253]: audit 2024-08-31T07:31:30.309456+0000 mgr.a (mgr.14388) 13850 : audit [DBG] from='client.301533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:31 smithi027 bash[22610]: cluster 2024-08-31T07:31:30.295213+0000 mgr.a (mgr.14388) 13849 : cluster [DBG] pgmap v9600: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:31 smithi027 bash[22610]: audit 2024-08-31T07:31:30.309456+0000 mgr.a (mgr.14388) 13850 : audit [DBG] from='client.301533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:33 smithi191 bash[24992]: cluster 2024-08-31T07:31:32.296088+0000 mgr.a (mgr.14388) 13851 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:33 smithi163 bash[24253]: cluster 2024-08-31T07:31:32.296088+0000 mgr.a (mgr.14388) 13851 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:33 smithi027 bash[22610]: cluster 2024-08-31T07:31:32.296088+0000 mgr.a (mgr.14388) 13851 : cluster [DBG] pgmap v9601: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:35 smithi191 bash[24992]: cluster 2024-08-31T07:31:34.298303+0000 mgr.a (mgr.14388) 13852 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:35 smithi163 bash[24253]: cluster 2024-08-31T07:31:34.298303+0000 mgr.a (mgr.14388) 13852 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:35 smithi027 bash[22610]: cluster 2024-08-31T07:31:34.298303+0000 mgr.a (mgr.14388) 13852 : cluster [DBG] pgmap v9602: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:31:36.534 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:36.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:36.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:36.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:36.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:31:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:36 smithi191 bash[24992]: audit 2024-08-31T07:31:36.105477+0000 mgr.a (mgr.14388) 13853 : audit [DBG] from='client.301608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:36 smithi163 bash[24253]: audit 2024-08-31T07:31:36.105477+0000 mgr.a (mgr.14388) 13853 : audit [DBG] from='client.301608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:36 smithi027 bash[22610]: audit 2024-08-31T07:31:36.105477+0000 mgr.a (mgr.14388) 13853 : audit [DBG] from='client.301608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:37 smithi191 bash[24992]: cluster 2024-08-31T07:31:36.298920+0000 mgr.a (mgr.14388) 13854 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:37 smithi163 bash[24253]: cluster 2024-08-31T07:31:36.298920+0000 mgr.a (mgr.14388) 13854 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:37 smithi027 bash[22610]: cluster 2024-08-31T07:31:36.298920+0000 mgr.a (mgr.14388) 13854 : cluster [DBG] pgmap v9603: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:39 smithi191 bash[24992]: cluster 2024-08-31T07:31:38.301059+0000 mgr.a (mgr.14388) 13855 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:39 smithi163 bash[24253]: cluster 2024-08-31T07:31:38.301059+0000 mgr.a (mgr.14388) 13855 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:39 smithi027 bash[22610]: cluster 2024-08-31T07:31:38.301059+0000 mgr.a (mgr.14388) 13855 : cluster [DBG] pgmap v9604: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:41.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:41.536 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:41.536 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:41 smithi191 bash[24992]: cluster 2024-08-31T07:31:40.301809+0000 mgr.a (mgr.14388) 13856 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:41 smithi163 bash[24253]: cluster 2024-08-31T07:31:40.301809+0000 mgr.a (mgr.14388) 13856 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:41 smithi027 bash[22610]: cluster 2024-08-31T07:31:40.301809+0000 mgr.a (mgr.14388) 13856 : cluster [DBG] pgmap v9605: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:42.310 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:42.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:42.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:42.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:42.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:31:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:42 smithi191 bash[24992]: audit 2024-08-31T07:31:41.870414+0000 mgr.a (mgr.14388) 13857 : audit [DBG] from='client.301686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:42 smithi163 bash[24253]: audit 2024-08-31T07:31:41.870414+0000 mgr.a (mgr.14388) 13857 : audit [DBG] from='client.301686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:42 smithi027 bash[22610]: audit 2024-08-31T07:31:41.870414+0000 mgr.a (mgr.14388) 13857 : audit [DBG] from='client.301686 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:43 smithi163 bash[24253]: cluster 2024-08-31T07:31:42.302287+0000 mgr.a (mgr.14388) 13858 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:43 smithi027 bash[22610]: cluster 2024-08-31T07:31:42.302287+0000 mgr.a (mgr.14388) 13858 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:43 smithi191 bash[24992]: cluster 2024-08-31T07:31:42.302287+0000 mgr.a (mgr.14388) 13858 : cluster [DBG] pgmap v9606: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:45 smithi163 bash[24253]: cluster 2024-08-31T07:31:44.304483+0000 mgr.a (mgr.14388) 13859 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:45 smithi027 bash[22610]: cluster 2024-08-31T07:31:44.304483+0000 mgr.a (mgr.14388) 13859 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:45 smithi191 bash[24992]: cluster 2024-08-31T07:31:44.304483+0000 mgr.a (mgr.14388) 13859 : cluster [DBG] pgmap v9607: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:31:47.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:47.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:47.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:48.077 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:48.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:48.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:48.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:48.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:31:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:47 smithi163 bash[24253]: cluster 2024-08-31T07:31:46.305264+0000 mgr.a (mgr.14388) 13860 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:47 smithi027 bash[22610]: cluster 2024-08-31T07:31:46.305264+0000 mgr.a (mgr.14388) 13860 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:47 smithi191 bash[24992]: cluster 2024-08-31T07:31:46.305264+0000 mgr.a (mgr.14388) 13860 : cluster [DBG] pgmap v9608: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:48 smithi163 bash[24253]: audit 2024-08-31T07:31:47.646660+0000 mgr.a (mgr.14388) 13861 : audit [DBG] from='client.301764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:48 smithi027 bash[22610]: audit 2024-08-31T07:31:47.646660+0000 mgr.a (mgr.14388) 13861 : audit [DBG] from='client.301764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:49.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:48 smithi191 bash[24992]: audit 2024-08-31T07:31:47.646660+0000 mgr.a (mgr.14388) 13861 : audit [DBG] from='client.301764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:49 smithi163 bash[24253]: cluster 2024-08-31T07:31:48.308051+0000 mgr.a (mgr.14388) 13862 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:49 smithi027 bash[22610]: cluster 2024-08-31T07:31:48.308051+0000 mgr.a (mgr.14388) 13862 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:49 smithi191 bash[24992]: cluster 2024-08-31T07:31:48.308051+0000 mgr.a (mgr.14388) 13862 : cluster [DBG] pgmap v9609: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:51 smithi163 bash[24253]: cluster 2024-08-31T07:31:50.308969+0000 mgr.a (mgr.14388) 13863 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:51 smithi027 bash[22610]: cluster 2024-08-31T07:31:50.308969+0000 mgr.a (mgr.14388) 13863 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:52.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:51 smithi191 bash[24992]: cluster 2024-08-31T07:31:50.308969+0000 mgr.a (mgr.14388) 13863 : cluster [DBG] pgmap v9610: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:53.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:53.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:53.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:53.830 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:53.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:53.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:53.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:53.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:31:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:53 smithi163 bash[24253]: cluster 2024-08-31T07:31:52.309790+0000 mgr.a (mgr.14388) 13864 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:31:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:53 smithi027 bash[22610]: cluster 2024-08-31T07:31:52.309790+0000 mgr.a (mgr.14388) 13864 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:31:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:53 smithi191 bash[24992]: cluster 2024-08-31T07:31:52.309790+0000 mgr.a (mgr.14388) 13864 : cluster [DBG] pgmap v9611: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:31:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:54 smithi163 bash[24253]: audit 2024-08-31T07:31:53.413707+0000 mgr.a (mgr.14388) 13865 : audit [DBG] from='client.301842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:54 smithi027 bash[22610]: audit 2024-08-31T07:31:53.413707+0000 mgr.a (mgr.14388) 13865 : audit [DBG] from='client.301842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:54 smithi191 bash[24992]: audit 2024-08-31T07:31:53.413707+0000 mgr.a (mgr.14388) 13865 : audit [DBG] from='client.301842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:31:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:55 smithi163 bash[24253]: cluster 2024-08-31T07:31:54.312581+0000 mgr.a (mgr.14388) 13866 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:55 smithi027 bash[22610]: cluster 2024-08-31T07:31:54.312581+0000 mgr.a (mgr.14388) 13866 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:55 smithi191 bash[24992]: cluster 2024-08-31T07:31:54.312581+0000 mgr.a (mgr.14388) 13866 : cluster [DBG] pgmap v9612: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:31:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:57 smithi163 bash[24253]: cluster 2024-08-31T07:31:56.313355+0000 mgr.a (mgr.14388) 13867 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:58.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:57 smithi027 bash[22610]: cluster 2024-08-31T07:31:56.313355+0000 mgr.a (mgr.14388) 13867 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:57 smithi191 bash[24992]: cluster 2024-08-31T07:31:56.313355+0000 mgr.a (mgr.14388) 13867 : cluster [DBG] pgmap v9613: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:31:58.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:31:58.832 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:31:58.832 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:31:59.607 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:31:59.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:31:59.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:31:59.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:31:59.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:31:59 smithi163 bash[24253]: cluster 2024-08-31T07:31:58.315305+0000 mgr.a (mgr.14388) 13868 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:31:59 smithi027 bash[22610]: cluster 2024-08-31T07:31:58.315305+0000 mgr.a (mgr.14388) 13868 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:31:59 smithi191 bash[24992]: cluster 2024-08-31T07:31:58.315305+0000 mgr.a (mgr.14388) 13868 : cluster [DBG] pgmap v9614: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:00 smithi163 bash[24253]: audit 2024-08-31T07:31:59.172350+0000 mgr.a (mgr.14388) 13869 : audit [DBG] from='client.301914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:00 smithi027 bash[22610]: audit 2024-08-31T07:31:59.172350+0000 mgr.a (mgr.14388) 13869 : audit [DBG] from='client.301914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:00 smithi191 bash[24992]: audit 2024-08-31T07:31:59.172350+0000 mgr.a (mgr.14388) 13869 : audit [DBG] from='client.301914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:01 smithi163 bash[24253]: cluster 2024-08-31T07:32:00.316293+0000 mgr.a (mgr.14388) 13870 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:01 smithi027 bash[22610]: cluster 2024-08-31T07:32:00.316293+0000 mgr.a (mgr.14388) 13870 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:01 smithi191 bash[24992]: cluster 2024-08-31T07:32:00.316293+0000 mgr.a (mgr.14388) 13870 : cluster [DBG] pgmap v9615: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:03 smithi163 bash[24253]: cluster 2024-08-31T07:32:02.317133+0000 mgr.a (mgr.14388) 13871 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:03 smithi027 bash[22610]: cluster 2024-08-31T07:32:02.317133+0000 mgr.a (mgr.14388) 13871 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:03 smithi191 bash[24992]: cluster 2024-08-31T07:32:02.317133+0000 mgr.a (mgr.14388) 13871 : cluster [DBG] pgmap v9616: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:04.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:32:04.609 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:32:04.610 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:32:05.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:32:05.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:32:05.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:32:05.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:05.347 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:32:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:05 smithi163 bash[24253]: cluster 2024-08-31T07:32:04.319508+0000 mgr.a (mgr.14388) 13872 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:05 smithi163 bash[24253]: audit 2024-08-31T07:32:04.940337+0000 mgr.a (mgr.14388) 13873 : audit [DBG] from='client.301992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:05 smithi027 bash[22610]: cluster 2024-08-31T07:32:04.319508+0000 mgr.a (mgr.14388) 13872 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:05 smithi027 bash[22610]: audit 2024-08-31T07:32:04.940337+0000 mgr.a (mgr.14388) 13873 : audit [DBG] from='client.301992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:05 smithi191 bash[24992]: cluster 2024-08-31T07:32:04.319508+0000 mgr.a (mgr.14388) 13872 : cluster [DBG] pgmap v9617: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:05 smithi191 bash[24992]: audit 2024-08-31T07:32:04.940337+0000 mgr.a (mgr.14388) 13873 : audit [DBG] from='client.301992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:07 smithi163 bash[24253]: cluster 2024-08-31T07:32:06.320525+0000 mgr.a (mgr.14388) 13874 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:07 smithi027 bash[22610]: cluster 2024-08-31T07:32:06.320525+0000 mgr.a (mgr.14388) 13874 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:07 smithi191 bash[24992]: cluster 2024-08-31T07:32:06.320525+0000 mgr.a (mgr.14388) 13874 : cluster [DBG] pgmap v9618: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:09 smithi163 bash[24253]: cluster 2024-08-31T07:32:08.322649+0000 mgr.a (mgr.14388) 13875 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:09 smithi027 bash[22610]: cluster 2024-08-31T07:32:08.322649+0000 mgr.a (mgr.14388) 13875 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:09 smithi191 bash[24992]: cluster 2024-08-31T07:32:08.322649+0000 mgr.a (mgr.14388) 13875 : cluster [DBG] pgmap v9619: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:10.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:32:10.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:32:10.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:32:11.124 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:32:11.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:32:11.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:32:11.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:32:11.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:11 smithi163 bash[24253]: cluster 2024-08-31T07:32:10.323430+0000 mgr.a (mgr.14388) 13876 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:11 smithi163 bash[24253]: audit 2024-08-31T07:32:10.683574+0000 mgr.a (mgr.14388) 13877 : audit [DBG] from='client.302067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:11 smithi027 bash[22610]: cluster 2024-08-31T07:32:10.323430+0000 mgr.a (mgr.14388) 13876 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:11 smithi027 bash[22610]: audit 2024-08-31T07:32:10.683574+0000 mgr.a (mgr.14388) 13877 : audit [DBG] from='client.302067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:11 smithi191 bash[24992]: cluster 2024-08-31T07:32:10.323430+0000 mgr.a (mgr.14388) 13876 : cluster [DBG] pgmap v9620: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:11 smithi191 bash[24992]: audit 2024-08-31T07:32:10.683574+0000 mgr.a (mgr.14388) 13877 : audit [DBG] from='client.302067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:13 smithi163 bash[24253]: cluster 2024-08-31T07:32:12.324425+0000 mgr.a (mgr.14388) 13878 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:13 smithi027 bash[22610]: cluster 2024-08-31T07:32:12.324425+0000 mgr.a (mgr.14388) 13878 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:13 smithi191 bash[24992]: cluster 2024-08-31T07:32:12.324425+0000 mgr.a (mgr.14388) 13878 : cluster [DBG] pgmap v9621: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:16.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:32:16.126 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:32:16.126 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:32:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:15 smithi163 bash[24253]: cluster 2024-08-31T07:32:14.326668+0000 mgr.a (mgr.14388) 13879 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:15 smithi027 bash[22610]: cluster 2024-08-31T07:32:14.326668+0000 mgr.a (mgr.14388) 13879 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:15 smithi191 bash[24992]: cluster 2024-08-31T07:32:14.326668+0000 mgr.a (mgr.14388) 13879 : cluster [DBG] pgmap v9622: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:16.864 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:32:16.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:32:16.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:32:16.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:32:16.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:17 smithi163 bash[24253]: cluster 2024-08-31T07:32:16.327141+0000 mgr.a (mgr.14388) 13880 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:17 smithi163 bash[24253]: audit 2024-08-31T07:32:16.454830+0000 mgr.a (mgr.14388) 13881 : audit [DBG] from='client.302145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:17 smithi027 bash[22610]: cluster 2024-08-31T07:32:16.327141+0000 mgr.a (mgr.14388) 13880 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:17 smithi027 bash[22610]: audit 2024-08-31T07:32:16.454830+0000 mgr.a (mgr.14388) 13881 : audit [DBG] from='client.302145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:17 smithi191 bash[24992]: cluster 2024-08-31T07:32:16.327141+0000 mgr.a (mgr.14388) 13880 : cluster [DBG] pgmap v9623: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:17 smithi191 bash[24992]: audit 2024-08-31T07:32:16.454830+0000 mgr.a (mgr.14388) 13881 : audit [DBG] from='client.302145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:19 smithi163 bash[24253]: cluster 2024-08-31T07:32:18.329485+0000 mgr.a (mgr.14388) 13882 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:19 smithi027 bash[22610]: cluster 2024-08-31T07:32:18.329485+0000 mgr.a (mgr.14388) 13882 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:19 smithi191 bash[24992]: cluster 2024-08-31T07:32:18.329485+0000 mgr.a (mgr.14388) 13882 : cluster [DBG] pgmap v9624: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:32:21.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:32:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:32:21.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:32:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:21 smithi163 bash[24253]: cluster 2024-08-31T07:32:20.330266+0000 mgr.a (mgr.14388) 13883 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:21 smithi163 bash[24253]: audit 2024-08-31T07:32:21.148331+0000 mon.a (mon.0) 2649 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:32:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:21 smithi163 bash[24253]: audit 2024-08-31T07:32:21.758319+0000 mon.a (mon.0) 2650 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:21 smithi163 bash[24253]: audit 2024-08-31T07:32:21.763890+0000 mon.a (mon.0) 2651 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:21 smithi163 bash[24253]: audit 2024-08-31T07:32:21.774268+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:21 smithi163 bash[24253]: audit 2024-08-31T07:32:21.780449+0000 mon.a (mon.0) 2653 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:21 smithi027 bash[22610]: cluster 2024-08-31T07:32:20.330266+0000 mgr.a (mgr.14388) 13883 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:21 smithi027 bash[22610]: audit 2024-08-31T07:32:21.148331+0000 mon.a (mon.0) 2649 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:32:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:21 smithi027 bash[22610]: audit 2024-08-31T07:32:21.758319+0000 mon.a (mon.0) 2650 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:21 smithi027 bash[22610]: audit 2024-08-31T07:32:21.763890+0000 mon.a (mon.0) 2651 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:21 smithi027 bash[22610]: audit 2024-08-31T07:32:21.774268+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:21 smithi027 bash[22610]: audit 2024-08-31T07:32:21.780449+0000 mon.a (mon.0) 2653 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:21 smithi191 bash[24992]: cluster 2024-08-31T07:32:20.330266+0000 mgr.a (mgr.14388) 13883 : cluster [DBG] pgmap v9625: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:21 smithi191 bash[24992]: audit 2024-08-31T07:32:21.148331+0000 mon.a (mon.0) 2649 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:32:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:21 smithi191 bash[24992]: audit 2024-08-31T07:32:21.758319+0000 mon.a (mon.0) 2650 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:21 smithi191 bash[24992]: audit 2024-08-31T07:32:21.763890+0000 mon.a (mon.0) 2651 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:21 smithi191 bash[24992]: audit 2024-08-31T07:32:21.774268+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:21 smithi191 bash[24992]: audit 2024-08-31T07:32:21.780449+0000 mon.a (mon.0) 2653 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:22.649 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:32:22.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:32:22.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:32:22.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:32:22.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:22 smithi163 bash[24253]: audit 2024-08-31T07:32:22.578604+0000 mon.a (mon.0) 2654 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:32:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:22 smithi163 bash[24253]: audit 2024-08-31T07:32:22.579730+0000 mon.a (mon.0) 2655 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:32:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:22 smithi163 bash[24253]: audit 2024-08-31T07:32:22.585466+0000 mon.a (mon.0) 2656 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:22 smithi163 bash[24253]: audit 2024-08-31T07:32:22.587732+0000 mon.a (mon.0) 2657 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:32:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:22 smithi027 bash[22610]: audit 2024-08-31T07:32:22.578604+0000 mon.a (mon.0) 2654 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:32:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:22 smithi027 bash[22610]: audit 2024-08-31T07:32:22.579730+0000 mon.a (mon.0) 2655 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:32:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:22 smithi027 bash[22610]: audit 2024-08-31T07:32:22.585466+0000 mon.a (mon.0) 2656 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:22 smithi027 bash[22610]: audit 2024-08-31T07:32:22.587732+0000 mon.a (mon.0) 2657 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:32:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:22 smithi191 bash[24992]: audit 2024-08-31T07:32:22.578604+0000 mon.a (mon.0) 2654 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:32:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:22 smithi191 bash[24992]: audit 2024-08-31T07:32:22.579730+0000 mon.a (mon.0) 2655 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:32:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:22 smithi191 bash[24992]: audit 2024-08-31T07:32:22.585466+0000 mon.a (mon.0) 2656 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:32:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:22 smithi191 bash[24992]: audit 2024-08-31T07:32:22.587732+0000 mon.a (mon.0) 2657 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:32:23.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:32:23 smithi027 bash[22863]: debug 2024-08-31T07:32:23.343+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:32:23.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:32:23 smithi027 bash[22863]: debug 2024-08-31T07:32:23.347+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:32:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:23 smithi163 bash[24253]: audit 2024-08-31T07:32:22.197459+0000 mgr.a (mgr.14388) 13884 : audit [DBG] from='client.302220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:23 smithi163 bash[24253]: cluster 2024-08-31T07:32:22.330794+0000 mgr.a (mgr.14388) 13885 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:23 smithi163 bash[24253]: audit 2024-08-31T07:32:22.589025+0000 mgr.a (mgr.14388) 13886 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:32:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:23 smithi027 bash[22610]: audit 2024-08-31T07:32:22.197459+0000 mgr.a (mgr.14388) 13884 : audit [DBG] from='client.302220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:23 smithi027 bash[22610]: cluster 2024-08-31T07:32:22.330794+0000 mgr.a (mgr.14388) 13885 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:23 smithi027 bash[22610]: audit 2024-08-31T07:32:22.589025+0000 mgr.a (mgr.14388) 13886 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:32:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:23 smithi191 bash[24992]: audit 2024-08-31T07:32:22.197459+0000 mgr.a (mgr.14388) 13884 : audit [DBG] from='client.302220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:23 smithi191 bash[24992]: cluster 2024-08-31T07:32:22.330794+0000 mgr.a (mgr.14388) 13885 : cluster [DBG] pgmap v9626: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:23 smithi191 bash[24992]: audit 2024-08-31T07:32:22.589025+0000 mgr.a (mgr.14388) 13886 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:32:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:24 smithi163 bash[24253]: audit 2024-08-31T07:32:23.350455+0000 mgr.a (mgr.14388) 13887 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:32:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:24 smithi163 bash[24253]: cephadm 2024-08-31T07:32:23.352065+0000 mgr.a (mgr.14388) 13888 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:32:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:24 smithi027 bash[22610]: audit 2024-08-31T07:32:23.350455+0000 mgr.a (mgr.14388) 13887 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:32:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:24 smithi027 bash[22610]: cephadm 2024-08-31T07:32:23.352065+0000 mgr.a (mgr.14388) 13888 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:32:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:24 smithi191 bash[24992]: audit 2024-08-31T07:32:23.350455+0000 mgr.a (mgr.14388) 13887 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:32:25.293 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:24 smithi191 bash[24992]: cephadm 2024-08-31T07:32:23.352065+0000 mgr.a (mgr.14388) 13888 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:32:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:25 smithi163 bash[24253]: cluster 2024-08-31T07:32:24.333690+0000 mgr.a (mgr.14388) 13889 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-31T07:32:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:25 smithi027 bash[22610]: cluster 2024-08-31T07:32:24.333690+0000 mgr.a (mgr.14388) 13889 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-31T07:32:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:25 smithi191 bash[24992]: cluster 2024-08-31T07:32:24.333690+0000 mgr.a (mgr.14388) 13889 : cluster [DBG] pgmap v9627: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-31T07:32:27.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:32:27.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:32:27.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:32:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:27 smithi163 bash[24253]: cluster 2024-08-31T07:32:26.334519+0000 mgr.a (mgr.14388) 13890 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:32:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:27 smithi027 bash[22610]: cluster 2024-08-31T07:32:26.334519+0000 mgr.a (mgr.14388) 13890 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:32:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:27 smithi191 bash[24992]: cluster 2024-08-31T07:32:26.334519+0000 mgr.a (mgr.14388) 13890 : cluster [DBG] pgmap v9628: 225 pgs: 225 active+clean; 589 KiB data, 148 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:32:28.435 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:32:28.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:32:28.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:32:28.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:32:28.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:28 smithi163 bash[24253]: audit 2024-08-31T07:32:27.989740+0000 mgr.a (mgr.14388) 13891 : audit [DBG] from='client.302403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:28 smithi027 bash[22610]: audit 2024-08-31T07:32:27.989740+0000 mgr.a (mgr.14388) 13891 : audit [DBG] from='client.302403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:28 smithi191 bash[24992]: audit 2024-08-31T07:32:27.989740+0000 mgr.a (mgr.14388) 13891 : audit [DBG] from='client.302403 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:29 smithi163 bash[24253]: cluster 2024-08-31T07:32:28.336420+0000 mgr.a (mgr.14388) 13892 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T07:32:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:29 smithi027 bash[22610]: cluster 2024-08-31T07:32:28.336420+0000 mgr.a (mgr.14388) 13892 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T07:32:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:29 smithi191 bash[24992]: cluster 2024-08-31T07:32:28.336420+0000 mgr.a (mgr.14388) 13892 : cluster [DBG] pgmap v9629: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T07:32:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:31 smithi163 bash[24253]: cluster 2024-08-31T07:32:30.337186+0000 mgr.a (mgr.14388) 13893 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T07:32:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:31 smithi027 bash[22610]: cluster 2024-08-31T07:32:30.337186+0000 mgr.a (mgr.14388) 13893 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T07:32:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:31 smithi191 bash[24992]: cluster 2024-08-31T07:32:30.337186+0000 mgr.a (mgr.14388) 13893 : cluster [DBG] pgmap v9630: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T07:32:33.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:32:33.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:32:33.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:32:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:33 smithi163 bash[24253]: cluster 2024-08-31T07:32:32.337966+0000 mgr.a (mgr.14388) 13894 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T07:32:34.213 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:32:34.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:32:34.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:32:34.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:32:34.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:33 smithi027 bash[22610]: cluster 2024-08-31T07:32:32.337966+0000 mgr.a (mgr.14388) 13894 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T07:32:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:33 smithi191 bash[24992]: cluster 2024-08-31T07:32:32.337966+0000 mgr.a (mgr.14388) 13894 : cluster [DBG] pgmap v9631: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 10 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T07:32:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:34 smithi163 bash[24253]: audit 2024-08-31T07:32:33.773615+0000 mgr.a (mgr.14388) 13895 : audit [DBG] from='client.302481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:34 smithi027 bash[22610]: audit 2024-08-31T07:32:33.773615+0000 mgr.a (mgr.14388) 13895 : audit [DBG] from='client.302481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:34 smithi191 bash[24992]: audit 2024-08-31T07:32:33.773615+0000 mgr.a (mgr.14388) 13895 : audit [DBG] from='client.302481 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:35 smithi027 bash[22610]: cluster 2024-08-31T07:32:34.340796+0000 mgr.a (mgr.14388) 13896 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T07:32:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:35 smithi191 bash[24992]: cluster 2024-08-31T07:32:34.340796+0000 mgr.a (mgr.14388) 13896 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T07:32:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:35 smithi163 bash[24253]: cluster 2024-08-31T07:32:34.340796+0000 mgr.a (mgr.14388) 13896 : cluster [DBG] pgmap v9632: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T07:32:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:37 smithi027 bash[22610]: cluster 2024-08-31T07:32:36.341601+0000 mgr.a (mgr.14388) 13897 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T07:32:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:37 smithi191 bash[24992]: cluster 2024-08-31T07:32:36.341601+0000 mgr.a (mgr.14388) 13897 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T07:32:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:37 smithi163 bash[24253]: cluster 2024-08-31T07:32:36.341601+0000 mgr.a (mgr.14388) 13897 : cluster [DBG] pgmap v9633: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T07:32:39.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:32:39.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:32:39.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:32:39.975 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:32:39.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:32:39.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:32:39.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:32:39.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:39 smithi027 bash[22610]: cluster 2024-08-31T07:32:38.343601+0000 mgr.a (mgr.14388) 13898 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:32:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:39 smithi191 bash[24992]: cluster 2024-08-31T07:32:38.343601+0000 mgr.a (mgr.14388) 13898 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:32:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:39 smithi163 bash[24253]: cluster 2024-08-31T07:32:38.343601+0000 mgr.a (mgr.14388) 13898 : cluster [DBG] pgmap v9634: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:32:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:40 smithi027 bash[22610]: audit 2024-08-31T07:32:39.544926+0000 mgr.a (mgr.14388) 13899 : audit [DBG] from='client.302559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:40 smithi191 bash[24992]: audit 2024-08-31T07:32:39.544926+0000 mgr.a (mgr.14388) 13899 : audit [DBG] from='client.302559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:40 smithi163 bash[24253]: audit 2024-08-31T07:32:39.544926+0000 mgr.a (mgr.14388) 13899 : audit [DBG] from='client.302559 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:41 smithi027 bash[22610]: cluster 2024-08-31T07:32:40.344479+0000 mgr.a (mgr.14388) 13900 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:41 smithi191 bash[24992]: cluster 2024-08-31T07:32:40.344479+0000 mgr.a (mgr.14388) 13900 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:41 smithi163 bash[24253]: cluster 2024-08-31T07:32:40.344479+0000 mgr.a (mgr.14388) 13900 : cluster [DBG] pgmap v9635: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:43 smithi027 bash[22610]: cluster 2024-08-31T07:32:42.345296+0000 mgr.a (mgr.14388) 13901 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:43 smithi191 bash[24992]: cluster 2024-08-31T07:32:42.345296+0000 mgr.a (mgr.14388) 13901 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:43 smithi163 bash[24253]: cluster 2024-08-31T07:32:42.345296+0000 mgr.a (mgr.14388) 13901 : cluster [DBG] pgmap v9636: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:32:44.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:32:44.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:32:45.756 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:32:45.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:32:45.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:32:45.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:32:45.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:45 smithi191 bash[24992]: cluster 2024-08-31T07:32:44.347565+0000 mgr.a (mgr.14388) 13902 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:32:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:45 smithi163 bash[24253]: cluster 2024-08-31T07:32:44.347565+0000 mgr.a (mgr.14388) 13902 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:32:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:45 smithi027 bash[22610]: cluster 2024-08-31T07:32:44.347565+0000 mgr.a (mgr.14388) 13902 : cluster [DBG] pgmap v9637: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:32:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:46 smithi191 bash[24992]: audit 2024-08-31T07:32:45.312036+0000 mgr.a (mgr.14388) 13903 : audit [DBG] from='client.302634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:46 smithi163 bash[24253]: audit 2024-08-31T07:32:45.312036+0000 mgr.a (mgr.14388) 13903 : audit [DBG] from='client.302634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:46 smithi027 bash[22610]: audit 2024-08-31T07:32:45.312036+0000 mgr.a (mgr.14388) 13903 : audit [DBG] from='client.302634 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:47 smithi191 bash[24992]: cluster 2024-08-31T07:32:46.348540+0000 mgr.a (mgr.14388) 13904 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:32:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:47 smithi163 bash[24253]: cluster 2024-08-31T07:32:46.348540+0000 mgr.a (mgr.14388) 13904 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:32:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:47 smithi027 bash[22610]: cluster 2024-08-31T07:32:46.348540+0000 mgr.a (mgr.14388) 13904 : cluster [DBG] pgmap v9638: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:32:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:49 smithi191 bash[24992]: cluster 2024-08-31T07:32:48.350828+0000 mgr.a (mgr.14388) 13905 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:32:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:50 smithi163 bash[24253]: cluster 2024-08-31T07:32:48.350828+0000 mgr.a (mgr.14388) 13905 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:32:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:49 smithi027 bash[22610]: cluster 2024-08-31T07:32:48.350828+0000 mgr.a (mgr.14388) 13905 : cluster [DBG] pgmap v9639: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:32:50.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:32:50.758 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:32:50.758 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:32:51.516 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:32:51.516 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:32:51.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:32:51.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:32:51.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:52.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:52 smithi191 bash[24992]: cluster 2024-08-31T07:32:50.351623+0000 mgr.a (mgr.14388) 13906 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:32:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:52 smithi191 bash[24992]: audit 2024-08-31T07:32:51.087452+0000 mgr.a (mgr.14388) 13907 : audit [DBG] from='client.302706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:52 smithi163 bash[24253]: cluster 2024-08-31T07:32:50.351623+0000 mgr.a (mgr.14388) 13906 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:32:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:52 smithi163 bash[24253]: audit 2024-08-31T07:32:51.087452+0000 mgr.a (mgr.14388) 13907 : audit [DBG] from='client.302706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:52 smithi027 bash[22610]: cluster 2024-08-31T07:32:50.351623+0000 mgr.a (mgr.14388) 13906 : cluster [DBG] pgmap v9640: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:32:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:52 smithi027 bash[22610]: audit 2024-08-31T07:32:51.087452+0000 mgr.a (mgr.14388) 13907 : audit [DBG] from='client.302706 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:54 smithi191 bash[24992]: cluster 2024-08-31T07:32:52.352651+0000 mgr.a (mgr.14388) 13908 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:32:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:54 smithi163 bash[24253]: cluster 2024-08-31T07:32:52.352651+0000 mgr.a (mgr.14388) 13908 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:32:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:54 smithi027 bash[22610]: cluster 2024-08-31T07:32:52.352651+0000 mgr.a (mgr.14388) 13908 : cluster [DBG] pgmap v9641: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:32:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:56 smithi191 bash[24992]: cluster 2024-08-31T07:32:54.354909+0000 mgr.a (mgr.14388) 13909 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:32:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:56 smithi163 bash[24253]: cluster 2024-08-31T07:32:54.354909+0000 mgr.a (mgr.14388) 13909 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:32:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:56 smithi027 bash[22610]: cluster 2024-08-31T07:32:54.354909+0000 mgr.a (mgr.14388) 13909 : cluster [DBG] pgmap v9642: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:32:56.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:32:56.518 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:32:56.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:32:57.265 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:32:57.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:32:57.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:32:57.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:32:57.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:32:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:58 smithi191 bash[24992]: cluster 2024-08-31T07:32:56.355653+0000 mgr.a (mgr.14388) 13910 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:32:58 smithi191 bash[24992]: audit 2024-08-31T07:32:56.848826+0000 mgr.a (mgr.14388) 13911 : audit [DBG] from='client.302784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:58 smithi163 bash[24253]: cluster 2024-08-31T07:32:56.355653+0000 mgr.a (mgr.14388) 13910 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:32:58 smithi163 bash[24253]: audit 2024-08-31T07:32:56.848826+0000 mgr.a (mgr.14388) 13911 : audit [DBG] from='client.302784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:32:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:58 smithi027 bash[22610]: cluster 2024-08-31T07:32:56.355653+0000 mgr.a (mgr.14388) 13910 : cluster [DBG] pgmap v9643: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:32:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:32:58 smithi027 bash[22610]: audit 2024-08-31T07:32:56.848826+0000 mgr.a (mgr.14388) 13911 : audit [DBG] from='client.302784 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:00 smithi191 bash[24992]: cluster 2024-08-31T07:32:58.357997+0000 mgr.a (mgr.14388) 13912 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:33:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:00 smithi163 bash[24253]: cluster 2024-08-31T07:32:58.357997+0000 mgr.a (mgr.14388) 13912 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:33:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:00 smithi027 bash[22610]: cluster 2024-08-31T07:32:58.357997+0000 mgr.a (mgr.14388) 13912 : cluster [DBG] pgmap v9644: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:33:02.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:33:02.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:33:02.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:33:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:02 smithi191 bash[24992]: cluster 2024-08-31T07:33:00.358828+0000 mgr.a (mgr.14388) 13913 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:02 smithi163 bash[24253]: cluster 2024-08-31T07:33:00.358828+0000 mgr.a (mgr.14388) 13913 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:02 smithi027 bash[22610]: cluster 2024-08-31T07:33:00.358828+0000 mgr.a (mgr.14388) 13913 : cluster [DBG] pgmap v9645: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:03.043 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:33:03.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:33:03.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:33:03.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:33:03.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:33:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:04 smithi191 bash[24992]: cluster 2024-08-31T07:33:02.359426+0000 mgr.a (mgr.14388) 13914 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:04 smithi191 bash[24992]: audit 2024-08-31T07:33:02.602827+0000 mgr.a (mgr.14388) 13915 : audit [DBG] from='client.302859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:04 smithi163 bash[24253]: cluster 2024-08-31T07:33:02.359426+0000 mgr.a (mgr.14388) 13914 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:04 smithi163 bash[24253]: audit 2024-08-31T07:33:02.602827+0000 mgr.a (mgr.14388) 13915 : audit [DBG] from='client.302859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:04 smithi027 bash[22610]: cluster 2024-08-31T07:33:02.359426+0000 mgr.a (mgr.14388) 13914 : cluster [DBG] pgmap v9646: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:04 smithi027 bash[22610]: audit 2024-08-31T07:33:02.602827+0000 mgr.a (mgr.14388) 13915 : audit [DBG] from='client.302859 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:06 smithi163 bash[24253]: cluster 2024-08-31T07:33:04.362084+0000 mgr.a (mgr.14388) 13916 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:33:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:06 smithi027 bash[22610]: cluster 2024-08-31T07:33:04.362084+0000 mgr.a (mgr.14388) 13916 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:33:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:06 smithi191 bash[24992]: cluster 2024-08-31T07:33:04.362084+0000 mgr.a (mgr.14388) 13916 : cluster [DBG] pgmap v9647: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:33:08.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:33:08.045 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:33:08.046 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:33:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:08 smithi163 bash[24253]: cluster 2024-08-31T07:33:06.363087+0000 mgr.a (mgr.14388) 13917 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:33:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:08 smithi027 bash[22610]: cluster 2024-08-31T07:33:06.363087+0000 mgr.a (mgr.14388) 13917 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:33:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:08 smithi191 bash[24992]: cluster 2024-08-31T07:33:06.363087+0000 mgr.a (mgr.14388) 13917 : cluster [DBG] pgmap v9648: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:33:08.827 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:33:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:33:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:33:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:33:08.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:10 smithi163 bash[24253]: cluster 2024-08-31T07:33:08.365063+0000 mgr.a (mgr.14388) 13918 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:10 smithi163 bash[24253]: audit 2024-08-31T07:33:08.379567+0000 mgr.a (mgr.14388) 13919 : audit [DBG] from='client.302937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:10 smithi027 bash[22610]: cluster 2024-08-31T07:33:08.365063+0000 mgr.a (mgr.14388) 13918 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:10 smithi027 bash[22610]: audit 2024-08-31T07:33:08.379567+0000 mgr.a (mgr.14388) 13919 : audit [DBG] from='client.302937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:10 smithi191 bash[24992]: cluster 2024-08-31T07:33:08.365063+0000 mgr.a (mgr.14388) 13918 : cluster [DBG] pgmap v9649: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:10 smithi191 bash[24992]: audit 2024-08-31T07:33:08.379567+0000 mgr.a (mgr.14388) 13919 : audit [DBG] from='client.302937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:12 smithi163 bash[24253]: cluster 2024-08-31T07:33:10.366140+0000 mgr.a (mgr.14388) 13920 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:33:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:12 smithi027 bash[22610]: cluster 2024-08-31T07:33:10.366140+0000 mgr.a (mgr.14388) 13920 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:33:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:12 smithi191 bash[24992]: cluster 2024-08-31T07:33:10.366140+0000 mgr.a (mgr.14388) 13920 : cluster [DBG] pgmap v9650: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:33:13.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:33:13.829 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:33:13.829 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:33:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:14 smithi163 bash[24253]: cluster 2024-08-31T07:33:12.367002+0000 mgr.a (mgr.14388) 13921 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:33:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:14 smithi027 bash[22610]: cluster 2024-08-31T07:33:12.367002+0000 mgr.a (mgr.14388) 13921 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:33:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:14 smithi191 bash[24992]: cluster 2024-08-31T07:33:12.367002+0000 mgr.a (mgr.14388) 13921 : cluster [DBG] pgmap v9651: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:33:14.587 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:33:14.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:33:14.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:33:14.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:33:14.588 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:33:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:16 smithi163 bash[24253]: audit 2024-08-31T07:33:14.161128+0000 mgr.a (mgr.14388) 13922 : audit [DBG] from='client.303015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:16 smithi163 bash[24253]: cluster 2024-08-31T07:33:14.368355+0000 mgr.a (mgr.14388) 13923 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:16 smithi027 bash[22610]: audit 2024-08-31T07:33:14.161128+0000 mgr.a (mgr.14388) 13922 : audit [DBG] from='client.303015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:16 smithi027 bash[22610]: cluster 2024-08-31T07:33:14.368355+0000 mgr.a (mgr.14388) 13923 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:16 smithi191 bash[24992]: audit 2024-08-31T07:33:14.161128+0000 mgr.a (mgr.14388) 13922 : audit [DBG] from='client.303015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:16 smithi191 bash[24992]: cluster 2024-08-31T07:33:14.368355+0000 mgr.a (mgr.14388) 13923 : cluster [DBG] pgmap v9652: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:18 smithi163 bash[24253]: cluster 2024-08-31T07:33:16.369373+0000 mgr.a (mgr.14388) 13924 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:33:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:18 smithi027 bash[22610]: cluster 2024-08-31T07:33:16.369373+0000 mgr.a (mgr.14388) 13924 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:33:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:18 smithi191 bash[24992]: cluster 2024-08-31T07:33:16.369373+0000 mgr.a (mgr.14388) 13924 : cluster [DBG] pgmap v9653: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:33:19.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:33:19.590 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:33:19.590 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:33:20.345 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:33:20.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:33:20.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:33:20.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:33:20.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:33:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:20 smithi163 bash[24253]: cluster 2024-08-31T07:33:18.371767+0000 mgr.a (mgr.14388) 13925 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:33:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:20 smithi027 bash[22610]: cluster 2024-08-31T07:33:18.371767+0000 mgr.a (mgr.14388) 13925 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:33:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:20 smithi191 bash[24992]: cluster 2024-08-31T07:33:18.371767+0000 mgr.a (mgr.14388) 13925 : cluster [DBG] pgmap v9654: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:33:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:21 smithi163 bash[24253]: audit 2024-08-31T07:33:19.917614+0000 mgr.a (mgr.14388) 13926 : audit [DBG] from='client.303093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:21 smithi027 bash[22610]: audit 2024-08-31T07:33:19.917614+0000 mgr.a (mgr.14388) 13926 : audit [DBG] from='client.303093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:21 smithi191 bash[24992]: audit 2024-08-31T07:33:19.917614+0000 mgr.a (mgr.14388) 13926 : audit [DBG] from='client.303093 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:22 smithi163 bash[24253]: cluster 2024-08-31T07:33:20.372573+0000 mgr.a (mgr.14388) 13927 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:22 smithi027 bash[22610]: cluster 2024-08-31T07:33:20.372573+0000 mgr.a (mgr.14388) 13927 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:22 smithi191 bash[24992]: cluster 2024-08-31T07:33:20.372573+0000 mgr.a (mgr.14388) 13927 : cluster [DBG] pgmap v9655: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:24 smithi163 bash[24253]: cluster 2024-08-31T07:33:22.373292+0000 mgr.a (mgr.14388) 13928 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:24 smithi163 bash[24253]: audit 2024-08-31T07:33:23.409885+0000 mon.a (mon.0) 2658 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:33:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:24 smithi027 bash[22610]: cluster 2024-08-31T07:33:22.373292+0000 mgr.a (mgr.14388) 13928 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:24 smithi027 bash[22610]: audit 2024-08-31T07:33:23.409885+0000 mon.a (mon.0) 2658 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:33:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:24 smithi191 bash[24992]: cluster 2024-08-31T07:33:22.373292+0000 mgr.a (mgr.14388) 13928 : cluster [DBG] pgmap v9656: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:24 smithi191 bash[24992]: audit 2024-08-31T07:33:23.409885+0000 mon.a (mon.0) 2658 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:33:25.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:33:25.347 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:33:25.347 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:33:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:25 smithi163 bash[24253]: audit 2024-08-31T07:33:24.259078+0000 mon.a (mon.0) 2659 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:33:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:25 smithi163 bash[24253]: audit 2024-08-31T07:33:24.260461+0000 mon.a (mon.0) 2660 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:33:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:25 smithi163 bash[24253]: audit 2024-08-31T07:33:24.270067+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:33:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:25 smithi163 bash[24253]: audit 2024-08-31T07:33:24.275321+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:33:25.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:33:25 smithi027 bash[22863]: debug 2024-08-31T07:33:25.013+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:33:25.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:33:25 smithi027 bash[22863]: debug 2024-08-31T07:33:25.017+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:33:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:25 smithi027 bash[22610]: audit 2024-08-31T07:33:24.259078+0000 mon.a (mon.0) 2659 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:33:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:25 smithi027 bash[22610]: audit 2024-08-31T07:33:24.260461+0000 mon.a (mon.0) 2660 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:33:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:25 smithi027 bash[22610]: audit 2024-08-31T07:33:24.270067+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:33:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:25 smithi027 bash[22610]: audit 2024-08-31T07:33:24.275321+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:33:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:25 smithi191 bash[24992]: audit 2024-08-31T07:33:24.259078+0000 mon.a (mon.0) 2659 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:33:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:25 smithi191 bash[24992]: audit 2024-08-31T07:33:24.260461+0000 mon.a (mon.0) 2660 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:33:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:25 smithi191 bash[24992]: audit 2024-08-31T07:33:24.270067+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:33:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:25 smithi191 bash[24992]: audit 2024-08-31T07:33:24.275321+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:33:26.081 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:33:26.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:33:26.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:33:26.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:33:26.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:33:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:26 smithi163 bash[24253]: audit 2024-08-31T07:33:24.277564+0000 mgr.a (mgr.14388) 13929 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:33:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:26 smithi163 bash[24253]: cluster 2024-08-31T07:33:24.374555+0000 mgr.a (mgr.14388) 13930 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:33:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:26 smithi163 bash[24253]: audit 2024-08-31T07:33:25.018548+0000 mgr.a (mgr.14388) 13931 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:33:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:26 smithi163 bash[24253]: cephadm 2024-08-31T07:33:25.019892+0000 mgr.a (mgr.14388) 13932 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:33:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:26 smithi027 bash[22610]: audit 2024-08-31T07:33:24.277564+0000 mgr.a (mgr.14388) 13929 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:33:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:26 smithi027 bash[22610]: cluster 2024-08-31T07:33:24.374555+0000 mgr.a (mgr.14388) 13930 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:33:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:26 smithi027 bash[22610]: audit 2024-08-31T07:33:25.018548+0000 mgr.a (mgr.14388) 13931 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:33:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:26 smithi027 bash[22610]: cephadm 2024-08-31T07:33:25.019892+0000 mgr.a (mgr.14388) 13932 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:33:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:26 smithi191 bash[24992]: audit 2024-08-31T07:33:24.277564+0000 mgr.a (mgr.14388) 13929 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:33:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:26 smithi191 bash[24992]: cluster 2024-08-31T07:33:24.374555+0000 mgr.a (mgr.14388) 13930 : cluster [DBG] pgmap v9657: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:33:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:26 smithi191 bash[24992]: audit 2024-08-31T07:33:25.018548+0000 mgr.a (mgr.14388) 13931 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:33:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:26 smithi191 bash[24992]: cephadm 2024-08-31T07:33:25.019892+0000 mgr.a (mgr.14388) 13932 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:33:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:27 smithi163 bash[24253]: audit 2024-08-31T07:33:25.666649+0000 mgr.a (mgr.14388) 13933 : audit [DBG] from='client.303276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:27 smithi027 bash[22610]: audit 2024-08-31T07:33:25.666649+0000 mgr.a (mgr.14388) 13933 : audit [DBG] from='client.303276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:27 smithi191 bash[24992]: audit 2024-08-31T07:33:25.666649+0000 mgr.a (mgr.14388) 13933 : audit [DBG] from='client.303276 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:28 smithi163 bash[24253]: cluster 2024-08-31T07:33:26.375488+0000 mgr.a (mgr.14388) 13934 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:28 smithi027 bash[22610]: cluster 2024-08-31T07:33:26.375488+0000 mgr.a (mgr.14388) 13934 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:28 smithi191 bash[24992]: cluster 2024-08-31T07:33:26.375488+0000 mgr.a (mgr.14388) 13934 : cluster [DBG] pgmap v9658: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:30 smithi163 bash[24253]: cluster 2024-08-31T07:33:28.377654+0000 mgr.a (mgr.14388) 13935 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:30 smithi027 bash[22610]: cluster 2024-08-31T07:33:28.377654+0000 mgr.a (mgr.14388) 13935 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:30 smithi191 bash[24992]: cluster 2024-08-31T07:33:28.377654+0000 mgr.a (mgr.14388) 13935 : cluster [DBG] pgmap v9659: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:31.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:33:31.084 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:33:31.084 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:33:31.864 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:33:31.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:33:31.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:33:31.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:33:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:33:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:32 smithi163 bash[24253]: cluster 2024-08-31T07:33:30.378417+0000 mgr.a (mgr.14388) 13936 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:32 smithi027 bash[22610]: cluster 2024-08-31T07:33:30.378417+0000 mgr.a (mgr.14388) 13936 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:32 smithi191 bash[24992]: cluster 2024-08-31T07:33:30.378417+0000 mgr.a (mgr.14388) 13936 : cluster [DBG] pgmap v9660: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:33 smithi163 bash[24253]: audit 2024-08-31T07:33:31.419570+0000 mgr.a (mgr.14388) 13937 : audit [DBG] from='client.303348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:33 smithi027 bash[22610]: audit 2024-08-31T07:33:31.419570+0000 mgr.a (mgr.14388) 13937 : audit [DBG] from='client.303348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:33 smithi191 bash[24992]: audit 2024-08-31T07:33:31.419570+0000 mgr.a (mgr.14388) 13937 : audit [DBG] from='client.303348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:34 smithi163 bash[24253]: cluster 2024-08-31T07:33:32.379408+0000 mgr.a (mgr.14388) 13938 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:34 smithi027 bash[22610]: cluster 2024-08-31T07:33:32.379408+0000 mgr.a (mgr.14388) 13938 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:34 smithi191 bash[24992]: cluster 2024-08-31T07:33:32.379408+0000 mgr.a (mgr.14388) 13938 : cluster [DBG] pgmap v9661: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:36 smithi163 bash[24253]: cluster 2024-08-31T07:33:34.381673+0000 mgr.a (mgr.14388) 13939 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:36 smithi027 bash[22610]: cluster 2024-08-31T07:33:34.381673+0000 mgr.a (mgr.14388) 13939 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:36 smithi191 bash[24992]: cluster 2024-08-31T07:33:34.381673+0000 mgr.a (mgr.14388) 13939 : cluster [DBG] pgmap v9662: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:36.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:33:36.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:33:36.867 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:33:37.649 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:33:37.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:33:37.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:33:37.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:33:37.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:33:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:38 smithi163 bash[24253]: cluster 2024-08-31T07:33:36.382470+0000 mgr.a (mgr.14388) 13940 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:38 smithi027 bash[22610]: cluster 2024-08-31T07:33:36.382470+0000 mgr.a (mgr.14388) 13940 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:38 smithi191 bash[24992]: cluster 2024-08-31T07:33:36.382470+0000 mgr.a (mgr.14388) 13940 : cluster [DBG] pgmap v9663: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:39 smithi163 bash[24253]: audit 2024-08-31T07:33:37.202830+0000 mgr.a (mgr.14388) 13941 : audit [DBG] from='client.303426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:39 smithi027 bash[22610]: audit 2024-08-31T07:33:37.202830+0000 mgr.a (mgr.14388) 13941 : audit [DBG] from='client.303426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:39 smithi191 bash[24992]: audit 2024-08-31T07:33:37.202830+0000 mgr.a (mgr.14388) 13941 : audit [DBG] from='client.303426 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:40 smithi163 bash[24253]: cluster 2024-08-31T07:33:38.384864+0000 mgr.a (mgr.14388) 13942 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:40 smithi027 bash[22610]: cluster 2024-08-31T07:33:38.384864+0000 mgr.a (mgr.14388) 13942 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:40 smithi191 bash[24992]: cluster 2024-08-31T07:33:38.384864+0000 mgr.a (mgr.14388) 13942 : cluster [DBG] pgmap v9664: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:33:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:42 smithi163 bash[24253]: cluster 2024-08-31T07:33:40.385658+0000 mgr.a (mgr.14388) 13943 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:42 smithi027 bash[22610]: cluster 2024-08-31T07:33:40.385658+0000 mgr.a (mgr.14388) 13943 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:42 smithi191 bash[24992]: cluster 2024-08-31T07:33:40.385658+0000 mgr.a (mgr.14388) 13943 : cluster [DBG] pgmap v9665: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:42.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:33:42.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:33:42.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:33:43.433 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:33:43.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:33:43.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:33:43.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:33:43.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:33:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:44 smithi163 bash[24253]: cluster 2024-08-31T07:33:42.386421+0000 mgr.a (mgr.14388) 13944 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:44 smithi163 bash[24253]: audit 2024-08-31T07:33:42.990418+0000 mgr.a (mgr.14388) 13945 : audit [DBG] from='client.303504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:44 smithi027 bash[22610]: cluster 2024-08-31T07:33:42.386421+0000 mgr.a (mgr.14388) 13944 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:44 smithi027 bash[22610]: audit 2024-08-31T07:33:42.990418+0000 mgr.a (mgr.14388) 13945 : audit [DBG] from='client.303504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:44 smithi191 bash[24992]: cluster 2024-08-31T07:33:42.386421+0000 mgr.a (mgr.14388) 13944 : cluster [DBG] pgmap v9666: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:44 smithi191 bash[24992]: audit 2024-08-31T07:33:42.990418+0000 mgr.a (mgr.14388) 13945 : audit [DBG] from='client.303504 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:46 smithi163 bash[24253]: cluster 2024-08-31T07:33:44.389174+0000 mgr.a (mgr.14388) 13946 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:46 smithi027 bash[22610]: cluster 2024-08-31T07:33:44.389174+0000 mgr.a (mgr.14388) 13946 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:46 smithi191 bash[24992]: cluster 2024-08-31T07:33:44.389174+0000 mgr.a (mgr.14388) 13946 : cluster [DBG] pgmap v9667: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:48.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:33:48.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:33:48.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:33:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:48 smithi163 bash[24253]: cluster 2024-08-31T07:33:46.389944+0000 mgr.a (mgr.14388) 13947 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:33:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:48 smithi027 bash[22610]: cluster 2024-08-31T07:33:46.389944+0000 mgr.a (mgr.14388) 13947 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:33:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:48 smithi191 bash[24992]: cluster 2024-08-31T07:33:46.389944+0000 mgr.a (mgr.14388) 13947 : cluster [DBG] pgmap v9668: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:33:49.211 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:33:49.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:33:49.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:33:49.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:33:49.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:33:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:50 smithi163 bash[24253]: cluster 2024-08-31T07:33:48.391920+0000 mgr.a (mgr.14388) 13948 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:50 smithi163 bash[24253]: audit 2024-08-31T07:33:48.770651+0000 mgr.a (mgr.14388) 13949 : audit [DBG] from='client.303582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:50 smithi027 bash[22610]: cluster 2024-08-31T07:33:48.391920+0000 mgr.a (mgr.14388) 13948 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:50 smithi027 bash[22610]: audit 2024-08-31T07:33:48.770651+0000 mgr.a (mgr.14388) 13949 : audit [DBG] from='client.303582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:50 smithi191 bash[24992]: cluster 2024-08-31T07:33:48.391920+0000 mgr.a (mgr.14388) 13948 : cluster [DBG] pgmap v9669: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:50 smithi191 bash[24992]: audit 2024-08-31T07:33:48.770651+0000 mgr.a (mgr.14388) 13949 : audit [DBG] from='client.303582 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:52 smithi163 bash[24253]: cluster 2024-08-31T07:33:50.392832+0000 mgr.a (mgr.14388) 13950 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:33:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:52 smithi027 bash[22610]: cluster 2024-08-31T07:33:50.392832+0000 mgr.a (mgr.14388) 13950 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:33:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:52 smithi191 bash[24992]: cluster 2024-08-31T07:33:50.392832+0000 mgr.a (mgr.14388) 13950 : cluster [DBG] pgmap v9670: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:33:54.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:33:54.213 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:33:54.214 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:33:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:54 smithi163 bash[24253]: cluster 2024-08-31T07:33:52.393599+0000 mgr.a (mgr.14388) 13951 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:33:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:54 smithi027 bash[22610]: cluster 2024-08-31T07:33:52.393599+0000 mgr.a (mgr.14388) 13951 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:33:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:54 smithi191 bash[24992]: cluster 2024-08-31T07:33:52.393599+0000 mgr.a (mgr.14388) 13951 : cluster [DBG] pgmap v9671: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:33:55.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:33:55.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:33:55.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:33:55.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:33:55.003 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:33:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:55 smithi027 bash[22610]: cluster 2024-08-31T07:33:54.394996+0000 mgr.a (mgr.14388) 13952 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:55 smithi027 bash[22610]: audit 2024-08-31T07:33:54.558294+0000 mgr.a (mgr.14388) 13953 : audit [DBG] from='client.303651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:55 smithi191 bash[24992]: cluster 2024-08-31T07:33:54.394996+0000 mgr.a (mgr.14388) 13952 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:55 smithi191 bash[24992]: audit 2024-08-31T07:33:54.558294+0000 mgr.a (mgr.14388) 13953 : audit [DBG] from='client.303651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:55 smithi163 bash[24253]: cluster 2024-08-31T07:33:54.394996+0000 mgr.a (mgr.14388) 13952 : cluster [DBG] pgmap v9672: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:55 smithi163 bash[24253]: audit 2024-08-31T07:33:54.558294+0000 mgr.a (mgr.14388) 13953 : audit [DBG] from='client.303651 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:33:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:57 smithi027 bash[22610]: cluster 2024-08-31T07:33:56.395864+0000 mgr.a (mgr.14388) 13954 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:57 smithi191 bash[24992]: cluster 2024-08-31T07:33:56.395864+0000 mgr.a (mgr.14388) 13954 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:57 smithi163 bash[24253]: cluster 2024-08-31T07:33:56.395864+0000 mgr.a (mgr.14388) 13954 : cluster [DBG] pgmap v9673: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:33:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:33:59 smithi027 bash[22610]: cluster 2024-08-31T07:33:58.397993+0000 mgr.a (mgr.14388) 13955 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:33:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:33:59 smithi191 bash[24992]: cluster 2024-08-31T07:33:58.397993+0000 mgr.a (mgr.14388) 13955 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:33:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:33:59 smithi163 bash[24253]: cluster 2024-08-31T07:33:58.397993+0000 mgr.a (mgr.14388) 13955 : cluster [DBG] pgmap v9674: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:00.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:00.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:00.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:00.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:00.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:00.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:00.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:00.758 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:01 smithi027 bash[22610]: audit 2024-08-31T07:34:00.338241+0000 mgr.a (mgr.14388) 13956 : audit [DBG] from='client.303729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:01 smithi027 bash[22610]: cluster 2024-08-31T07:34:00.398619+0000 mgr.a (mgr.14388) 13957 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:01 smithi191 bash[24992]: audit 2024-08-31T07:34:00.338241+0000 mgr.a (mgr.14388) 13956 : audit [DBG] from='client.303729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:01 smithi191 bash[24992]: cluster 2024-08-31T07:34:00.398619+0000 mgr.a (mgr.14388) 13957 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:01 smithi163 bash[24253]: audit 2024-08-31T07:34:00.338241+0000 mgr.a (mgr.14388) 13956 : audit [DBG] from='client.303729 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:01 smithi163 bash[24253]: cluster 2024-08-31T07:34:00.398619+0000 mgr.a (mgr.14388) 13957 : cluster [DBG] pgmap v9675: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:03 smithi027 bash[22610]: cluster 2024-08-31T07:34:02.399487+0000 mgr.a (mgr.14388) 13958 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:03 smithi191 bash[24992]: cluster 2024-08-31T07:34:02.399487+0000 mgr.a (mgr.14388) 13958 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:03 smithi163 bash[24253]: cluster 2024-08-31T07:34:02.399487+0000 mgr.a (mgr.14388) 13958 : cluster [DBG] pgmap v9676: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:05 smithi027 bash[22610]: cluster 2024-08-31T07:34:04.401681+0000 mgr.a (mgr.14388) 13959 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:05.759 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:05.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:05.760 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:05 smithi191 bash[24992]: cluster 2024-08-31T07:34:04.401681+0000 mgr.a (mgr.14388) 13959 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:05 smithi163 bash[24253]: cluster 2024-08-31T07:34:04.401681+0000 mgr.a (mgr.14388) 13959 : cluster [DBG] pgmap v9677: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:06.503 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:06.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:06.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:06.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:06.504 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:06 smithi027 bash[22610]: audit 2024-08-31T07:34:06.087674+0000 mgr.a (mgr.14388) 13960 : audit [DBG] from='client.303807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:06 smithi191 bash[24992]: audit 2024-08-31T07:34:06.087674+0000 mgr.a (mgr.14388) 13960 : audit [DBG] from='client.303807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:06 smithi163 bash[24253]: audit 2024-08-31T07:34:06.087674+0000 mgr.a (mgr.14388) 13960 : audit [DBG] from='client.303807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:07 smithi027 bash[22610]: cluster 2024-08-31T07:34:06.405544+0000 mgr.a (mgr.14388) 13961 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:07 smithi191 bash[24992]: cluster 2024-08-31T07:34:06.405544+0000 mgr.a (mgr.14388) 13961 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:07 smithi163 bash[24253]: cluster 2024-08-31T07:34:06.405544+0000 mgr.a (mgr.14388) 13961 : cluster [DBG] pgmap v9678: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:09 smithi027 bash[22610]: cluster 2024-08-31T07:34:08.407650+0000 mgr.a (mgr.14388) 13962 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:09 smithi191 bash[24992]: cluster 2024-08-31T07:34:08.407650+0000 mgr.a (mgr.14388) 13962 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:09 smithi163 bash[24253]: cluster 2024-08-31T07:34:08.407650+0000 mgr.a (mgr.14388) 13962 : cluster [DBG] pgmap v9679: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:11.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:11.506 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:11.506 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:11 smithi191 bash[24992]: cluster 2024-08-31T07:34:10.408413+0000 mgr.a (mgr.14388) 13963 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:11 smithi163 bash[24253]: cluster 2024-08-31T07:34:10.408413+0000 mgr.a (mgr.14388) 13963 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:11 smithi027 bash[22610]: cluster 2024-08-31T07:34:10.408413+0000 mgr.a (mgr.14388) 13963 : cluster [DBG] pgmap v9680: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:12.266 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:12.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:12.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:12.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:12.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:12 smithi191 bash[24992]: audit 2024-08-31T07:34:11.839089+0000 mgr.a (mgr.14388) 13964 : audit [DBG] from='client.303885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:12 smithi163 bash[24253]: audit 2024-08-31T07:34:11.839089+0000 mgr.a (mgr.14388) 13964 : audit [DBG] from='client.303885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:12 smithi027 bash[22610]: audit 2024-08-31T07:34:11.839089+0000 mgr.a (mgr.14388) 13964 : audit [DBG] from='client.303885 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:13 smithi191 bash[24992]: cluster 2024-08-31T07:34:12.408971+0000 mgr.a (mgr.14388) 13965 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:13 smithi163 bash[24253]: cluster 2024-08-31T07:34:12.408971+0000 mgr.a (mgr.14388) 13965 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:13 smithi027 bash[22610]: cluster 2024-08-31T07:34:12.408971+0000 mgr.a (mgr.14388) 13965 : cluster [DBG] pgmap v9681: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:15 smithi191 bash[24992]: cluster 2024-08-31T07:34:14.411282+0000 mgr.a (mgr.14388) 13966 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:15 smithi163 bash[24253]: cluster 2024-08-31T07:34:14.411282+0000 mgr.a (mgr.14388) 13966 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:15 smithi027 bash[22610]: cluster 2024-08-31T07:34:14.411282+0000 mgr.a (mgr.14388) 13966 : cluster [DBG] pgmap v9682: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:17.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:17.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:17.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:17 smithi191 bash[24992]: cluster 2024-08-31T07:34:16.412225+0000 mgr.a (mgr.14388) 13967 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:17 smithi163 bash[24253]: cluster 2024-08-31T07:34:16.412225+0000 mgr.a (mgr.14388) 13967 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:17 smithi027 bash[22610]: cluster 2024-08-31T07:34:16.412225+0000 mgr.a (mgr.14388) 13967 : cluster [DBG] pgmap v9683: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:18.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:18.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:18.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:18.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:18.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:18 smithi191 bash[24992]: audit 2024-08-31T07:34:17.593637+0000 mgr.a (mgr.14388) 13968 : audit [DBG] from='client.303963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:18 smithi163 bash[24253]: audit 2024-08-31T07:34:17.593637+0000 mgr.a (mgr.14388) 13968 : audit [DBG] from='client.303963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:18 smithi027 bash[22610]: audit 2024-08-31T07:34:17.593637+0000 mgr.a (mgr.14388) 13968 : audit [DBG] from='client.303963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:19 smithi191 bash[24992]: cluster 2024-08-31T07:34:18.415082+0000 mgr.a (mgr.14388) 13969 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:34:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:19 smithi163 bash[24253]: cluster 2024-08-31T07:34:18.415082+0000 mgr.a (mgr.14388) 13969 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:34:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:19 smithi027 bash[22610]: cluster 2024-08-31T07:34:18.415082+0000 mgr.a (mgr.14388) 13969 : cluster [DBG] pgmap v9684: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:34:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:21 smithi191 bash[24992]: cluster 2024-08-31T07:34:20.415834+0000 mgr.a (mgr.14388) 13970 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:34:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:21 smithi163 bash[24253]: cluster 2024-08-31T07:34:20.415834+0000 mgr.a (mgr.14388) 13970 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:34:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:21 smithi027 bash[22610]: cluster 2024-08-31T07:34:20.415834+0000 mgr.a (mgr.14388) 13970 : cluster [DBG] pgmap v9685: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:34:23.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:23.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:23.015 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:23.787 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:23.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:23.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:23.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:23.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:23 smithi191 bash[24992]: cluster 2024-08-31T07:34:22.416596+0000 mgr.a (mgr.14388) 13971 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:34:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:23 smithi163 bash[24253]: cluster 2024-08-31T07:34:22.416596+0000 mgr.a (mgr.14388) 13971 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:34:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:23 smithi027 bash[22610]: cluster 2024-08-31T07:34:22.416596+0000 mgr.a (mgr.14388) 13971 : cluster [DBG] pgmap v9686: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:34:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:24 smithi191 bash[24992]: audit 2024-08-31T07:34:23.356628+0000 mgr.a (mgr.14388) 13972 : audit [DBG] from='client.304041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:24 smithi163 bash[24253]: audit 2024-08-31T07:34:23.356628+0000 mgr.a (mgr.14388) 13972 : audit [DBG] from='client.304041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:24 smithi027 bash[22610]: audit 2024-08-31T07:34:23.356628+0000 mgr.a (mgr.14388) 13972 : audit [DBG] from='client.304041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:25 smithi163 bash[24253]: cluster 2024-08-31T07:34:24.419360+0000 mgr.a (mgr.14388) 13973 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:25 smithi163 bash[24253]: audit 2024-08-31T07:34:25.070689+0000 mon.a (mon.0) 2663 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:34:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:25 smithi027 bash[22610]: cluster 2024-08-31T07:34:24.419360+0000 mgr.a (mgr.14388) 13973 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:25.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:25 smithi027 bash[22610]: audit 2024-08-31T07:34:25.070689+0000 mon.a (mon.0) 2663 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:34:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:25 smithi191 bash[24992]: cluster 2024-08-31T07:34:24.419360+0000 mgr.a (mgr.14388) 13973 : cluster [DBG] pgmap v9687: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:25 smithi191 bash[24992]: audit 2024-08-31T07:34:25.070689+0000 mon.a (mon.0) 2663 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:34:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:26 smithi163 bash[24253]: audit 2024-08-31T07:34:25.913779+0000 mon.a (mon.0) 2664 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:34:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:26 smithi163 bash[24253]: audit 2024-08-31T07:34:25.915252+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:34:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:26 smithi163 bash[24253]: audit 2024-08-31T07:34:25.925772+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:34:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:26 smithi163 bash[24253]: audit 2024-08-31T07:34:25.928930+0000 mon.a (mon.0) 2667 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:34:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:26 smithi163 bash[24253]: audit 2024-08-31T07:34:25.930349+0000 mgr.a (mgr.14388) 13974 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:34:26.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:34:26 smithi027 bash[22863]: debug 2024-08-31T07:34:26.656+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:34:26.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:34:26 smithi027 bash[22863]: debug 2024-08-31T07:34:26.656+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:34:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:26 smithi027 bash[22610]: audit 2024-08-31T07:34:25.913779+0000 mon.a (mon.0) 2664 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:34:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:26 smithi027 bash[22610]: audit 2024-08-31T07:34:25.915252+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:34:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:26 smithi027 bash[22610]: audit 2024-08-31T07:34:25.925772+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:34:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:26 smithi027 bash[22610]: audit 2024-08-31T07:34:25.928930+0000 mon.a (mon.0) 2667 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:34:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:26 smithi027 bash[22610]: audit 2024-08-31T07:34:25.930349+0000 mgr.a (mgr.14388) 13974 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:34:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:26 smithi191 bash[24992]: audit 2024-08-31T07:34:25.913779+0000 mon.a (mon.0) 2664 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:34:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:26 smithi191 bash[24992]: audit 2024-08-31T07:34:25.915252+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:34:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:26 smithi191 bash[24992]: audit 2024-08-31T07:34:25.925772+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:34:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:26 smithi191 bash[24992]: audit 2024-08-31T07:34:25.928930+0000 mon.a (mon.0) 2667 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:34:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:26 smithi191 bash[24992]: audit 2024-08-31T07:34:25.930349+0000 mgr.a (mgr.14388) 13974 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:34:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:27 smithi163 bash[24253]: cluster 2024-08-31T07:34:26.419879+0000 mgr.a (mgr.14388) 13975 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:34:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:27 smithi163 bash[24253]: audit 2024-08-31T07:34:26.659289+0000 mgr.a (mgr.14388) 13976 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:34:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:27 smithi163 bash[24253]: cephadm 2024-08-31T07:34:26.660511+0000 mgr.a (mgr.14388) 13977 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:34:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:27 smithi027 bash[22610]: cluster 2024-08-31T07:34:26.419879+0000 mgr.a (mgr.14388) 13975 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:34:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:27 smithi027 bash[22610]: audit 2024-08-31T07:34:26.659289+0000 mgr.a (mgr.14388) 13976 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:34:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:27 smithi027 bash[22610]: cephadm 2024-08-31T07:34:26.660511+0000 mgr.a (mgr.14388) 13977 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:34:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:27 smithi191 bash[24992]: cluster 2024-08-31T07:34:26.419879+0000 mgr.a (mgr.14388) 13975 : cluster [DBG] pgmap v9688: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:34:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:27 smithi191 bash[24992]: audit 2024-08-31T07:34:26.659289+0000 mgr.a (mgr.14388) 13976 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:34:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:27 smithi191 bash[24992]: cephadm 2024-08-31T07:34:26.660511+0000 mgr.a (mgr.14388) 13977 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:34:28.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:28.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:28.790 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:29.565 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:29.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:29.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:29.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:29.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:29 smithi163 bash[24253]: cluster 2024-08-31T07:34:28.422129+0000 mgr.a (mgr.14388) 13978 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:29 smithi163 bash[24253]: audit 2024-08-31T07:34:29.133060+0000 mgr.a (mgr.14388) 13979 : audit [DBG] from='client.304227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:29 smithi027 bash[22610]: cluster 2024-08-31T07:34:28.422129+0000 mgr.a (mgr.14388) 13978 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:29 smithi027 bash[22610]: audit 2024-08-31T07:34:29.133060+0000 mgr.a (mgr.14388) 13979 : audit [DBG] from='client.304227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:29 smithi191 bash[24992]: cluster 2024-08-31T07:34:28.422129+0000 mgr.a (mgr.14388) 13978 : cluster [DBG] pgmap v9689: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:29 smithi191 bash[24992]: audit 2024-08-31T07:34:29.133060+0000 mgr.a (mgr.14388) 13979 : audit [DBG] from='client.304227 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:31 smithi163 bash[24253]: cluster 2024-08-31T07:34:30.423047+0000 mgr.a (mgr.14388) 13980 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:34:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:31 smithi027 bash[22610]: cluster 2024-08-31T07:34:30.423047+0000 mgr.a (mgr.14388) 13980 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:34:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:31 smithi191 bash[24992]: cluster 2024-08-31T07:34:30.423047+0000 mgr.a (mgr.14388) 13980 : cluster [DBG] pgmap v9690: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:34:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:33 smithi163 bash[24253]: cluster 2024-08-31T07:34:32.423826+0000 mgr.a (mgr.14388) 13981 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:34:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:33 smithi027 bash[22610]: cluster 2024-08-31T07:34:32.423826+0000 mgr.a (mgr.14388) 13981 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:34:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:33 smithi191 bash[24992]: cluster 2024-08-31T07:34:32.423826+0000 mgr.a (mgr.14388) 13981 : cluster [DBG] pgmap v9691: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:34:34.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:34.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:34.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:35.321 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:35.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:35.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:35.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:35.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:35 smithi163 bash[24253]: cluster 2024-08-31T07:34:34.426008+0000 mgr.a (mgr.14388) 13982 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:35 smithi163 bash[24253]: audit 2024-08-31T07:34:34.893237+0000 mgr.a (mgr.14388) 13983 : audit [DBG] from='client.304305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:35 smithi027 bash[22610]: cluster 2024-08-31T07:34:34.426008+0000 mgr.a (mgr.14388) 13982 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:35 smithi027 bash[22610]: audit 2024-08-31T07:34:34.893237+0000 mgr.a (mgr.14388) 13983 : audit [DBG] from='client.304305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:35 smithi191 bash[24992]: cluster 2024-08-31T07:34:34.426008+0000 mgr.a (mgr.14388) 13982 : cluster [DBG] pgmap v9692: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:35 smithi191 bash[24992]: audit 2024-08-31T07:34:34.893237+0000 mgr.a (mgr.14388) 13983 : audit [DBG] from='client.304305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:37 smithi027 bash[22610]: cluster 2024-08-31T07:34:36.426919+0000 mgr.a (mgr.14388) 13984 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:37 smithi191 bash[24992]: cluster 2024-08-31T07:34:36.426919+0000 mgr.a (mgr.14388) 13984 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:37 smithi163 bash[24253]: cluster 2024-08-31T07:34:36.426919+0000 mgr.a (mgr.14388) 13984 : cluster [DBG] pgmap v9693: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:39 smithi027 bash[22610]: cluster 2024-08-31T07:34:38.429124+0000 mgr.a (mgr.14388) 13985 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:39 smithi191 bash[24992]: cluster 2024-08-31T07:34:38.429124+0000 mgr.a (mgr.14388) 13985 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:40.323 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:40.323 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:40.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:39 smithi163 bash[24253]: cluster 2024-08-31T07:34:38.429124+0000 mgr.a (mgr.14388) 13985 : cluster [DBG] pgmap v9694: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:34:41.085 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:41.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:41.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:41.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:41.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:41 smithi027 bash[22610]: cluster 2024-08-31T07:34:40.429522+0000 mgr.a (mgr.14388) 13986 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:41 smithi027 bash[22610]: audit 2024-08-31T07:34:40.661238+0000 mgr.a (mgr.14388) 13987 : audit [DBG] from='client.304377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:41 smithi191 bash[24992]: cluster 2024-08-31T07:34:40.429522+0000 mgr.a (mgr.14388) 13986 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:41 smithi191 bash[24992]: audit 2024-08-31T07:34:40.661238+0000 mgr.a (mgr.14388) 13987 : audit [DBG] from='client.304377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:41 smithi163 bash[24253]: cluster 2024-08-31T07:34:40.429522+0000 mgr.a (mgr.14388) 13986 : cluster [DBG] pgmap v9695: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:41 smithi163 bash[24253]: audit 2024-08-31T07:34:40.661238+0000 mgr.a (mgr.14388) 13987 : audit [DBG] from='client.304377 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:43 smithi027 bash[22610]: cluster 2024-08-31T07:34:42.430357+0000 mgr.a (mgr.14388) 13988 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:43 smithi191 bash[24992]: cluster 2024-08-31T07:34:42.430357+0000 mgr.a (mgr.14388) 13988 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:43 smithi163 bash[24253]: cluster 2024-08-31T07:34:42.430357+0000 mgr.a (mgr.14388) 13988 : cluster [DBG] pgmap v9696: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:46.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:46.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:46.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:45 smithi027 bash[22610]: cluster 2024-08-31T07:34:44.432602+0000 mgr.a (mgr.14388) 13989 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:45 smithi191 bash[24992]: cluster 2024-08-31T07:34:44.432602+0000 mgr.a (mgr.14388) 13989 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:46.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:45 smithi163 bash[24253]: cluster 2024-08-31T07:34:44.432602+0000 mgr.a (mgr.14388) 13989 : cluster [DBG] pgmap v9697: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:46.851 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:46.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:46.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:46.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:46.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:47 smithi027 bash[22610]: audit 2024-08-31T07:34:46.426170+0000 mgr.a (mgr.14388) 13990 : audit [DBG] from='client.304449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:47 smithi027 bash[22610]: cluster 2024-08-31T07:34:46.443648+0000 mgr.a (mgr.14388) 13991 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:47 smithi191 bash[24992]: audit 2024-08-31T07:34:46.426170+0000 mgr.a (mgr.14388) 13990 : audit [DBG] from='client.304449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:47 smithi191 bash[24992]: cluster 2024-08-31T07:34:46.443648+0000 mgr.a (mgr.14388) 13991 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:47 smithi163 bash[24253]: audit 2024-08-31T07:34:46.426170+0000 mgr.a (mgr.14388) 13990 : audit [DBG] from='client.304449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:47 smithi163 bash[24253]: cluster 2024-08-31T07:34:46.443648+0000 mgr.a (mgr.14388) 13991 : cluster [DBG] pgmap v9698: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:50.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:49 smithi027 bash[22610]: cluster 2024-08-31T07:34:48.446056+0000 mgr.a (mgr.14388) 13992 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:49 smithi191 bash[24992]: cluster 2024-08-31T07:34:48.446056+0000 mgr.a (mgr.14388) 13992 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:49 smithi163 bash[24253]: cluster 2024-08-31T07:34:48.446056+0000 mgr.a (mgr.14388) 13992 : cluster [DBG] pgmap v9699: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:51.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:51.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:51.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:51 smithi027 bash[22610]: cluster 2024-08-31T07:34:50.446860+0000 mgr.a (mgr.14388) 13993 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:52.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:51 smithi191 bash[24992]: cluster 2024-08-31T07:34:50.446860+0000 mgr.a (mgr.14388) 13993 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:51 smithi163 bash[24253]: cluster 2024-08-31T07:34:50.446860+0000 mgr.a (mgr.14388) 13993 : cluster [DBG] pgmap v9700: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:52.602 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:52.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:52.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:52.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:52.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:53 smithi191 bash[24992]: audit 2024-08-31T07:34:52.183539+0000 mgr.a (mgr.14388) 13994 : audit [DBG] from='client.304521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:53 smithi191 bash[24992]: cluster 2024-08-31T07:34:52.447359+0000 mgr.a (mgr.14388) 13995 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:53 smithi163 bash[24253]: audit 2024-08-31T07:34:52.183539+0000 mgr.a (mgr.14388) 13994 : audit [DBG] from='client.304521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:53 smithi163 bash[24253]: cluster 2024-08-31T07:34:52.447359+0000 mgr.a (mgr.14388) 13995 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:53 smithi027 bash[22610]: audit 2024-08-31T07:34:52.183539+0000 mgr.a (mgr.14388) 13994 : audit [DBG] from='client.304521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:54.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:53 smithi027 bash[22610]: cluster 2024-08-31T07:34:52.447359+0000 mgr.a (mgr.14388) 13995 : cluster [DBG] pgmap v9701: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:55 smithi191 bash[24992]: cluster 2024-08-31T07:34:54.449639+0000 mgr.a (mgr.14388) 13996 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:55 smithi163 bash[24253]: cluster 2024-08-31T07:34:54.449639+0000 mgr.a (mgr.14388) 13996 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:55 smithi027 bash[22610]: cluster 2024-08-31T07:34:54.449639+0000 mgr.a (mgr.14388) 13996 : cluster [DBG] pgmap v9702: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:34:57.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:34:57.604 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:34:57.604 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:34:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:57 smithi191 bash[24992]: cluster 2024-08-31T07:34:56.450432+0000 mgr.a (mgr.14388) 13997 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:58.376 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:34:58.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:34:58.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:34:58.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:34:58.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:34:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:57 smithi163 bash[24253]: cluster 2024-08-31T07:34:56.450432+0000 mgr.a (mgr.14388) 13997 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:57 smithi027 bash[22610]: cluster 2024-08-31T07:34:56.450432+0000 mgr.a (mgr.14388) 13997 : cluster [DBG] pgmap v9703: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:34:59.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:34:59 smithi191 bash[24992]: audit 2024-08-31T07:34:57.937994+0000 mgr.a (mgr.14388) 13998 : audit [DBG] from='client.304593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:34:59 smithi163 bash[24253]: audit 2024-08-31T07:34:57.937994+0000 mgr.a (mgr.14388) 13998 : audit [DBG] from='client.304593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:34:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:34:59 smithi027 bash[22610]: audit 2024-08-31T07:34:57.937994+0000 mgr.a (mgr.14388) 13998 : audit [DBG] from='client.304593 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:00 smithi191 bash[24992]: cluster 2024-08-31T07:34:58.451890+0000 mgr.a (mgr.14388) 13999 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:00 smithi163 bash[24253]: cluster 2024-08-31T07:34:58.451890+0000 mgr.a (mgr.14388) 13999 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:00 smithi027 bash[22610]: cluster 2024-08-31T07:34:58.451890+0000 mgr.a (mgr.14388) 13999 : cluster [DBG] pgmap v9704: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:02 smithi191 bash[24992]: cluster 2024-08-31T07:35:00.452589+0000 mgr.a (mgr.14388) 14000 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:35:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:02 smithi163 bash[24253]: cluster 2024-08-31T07:35:00.452589+0000 mgr.a (mgr.14388) 14000 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:35:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:02 smithi027 bash[22610]: cluster 2024-08-31T07:35:00.452589+0000 mgr.a (mgr.14388) 14000 : cluster [DBG] pgmap v9705: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:35:03.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:35:03.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:35:03.378 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:35:04.125 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:35:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:35:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:35:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:35:04.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:35:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:04 smithi191 bash[24992]: cluster 2024-08-31T07:35:02.453337+0000 mgr.a (mgr.14388) 14001 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:35:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:04 smithi163 bash[24253]: cluster 2024-08-31T07:35:02.453337+0000 mgr.a (mgr.14388) 14001 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:35:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:04 smithi027 bash[22610]: cluster 2024-08-31T07:35:02.453337+0000 mgr.a (mgr.14388) 14001 : cluster [DBG] pgmap v9706: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:35:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:05 smithi191 bash[24992]: audit 2024-08-31T07:35:03.707234+0000 mgr.a (mgr.14388) 14002 : audit [DBG] from='client.304668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:05 smithi163 bash[24253]: audit 2024-08-31T07:35:03.707234+0000 mgr.a (mgr.14388) 14002 : audit [DBG] from='client.304668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:05 smithi027 bash[22610]: audit 2024-08-31T07:35:03.707234+0000 mgr.a (mgr.14388) 14002 : audit [DBG] from='client.304668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:06 smithi191 bash[24992]: cluster 2024-08-31T07:35:04.455974+0000 mgr.a (mgr.14388) 14003 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:06 smithi163 bash[24253]: cluster 2024-08-31T07:35:04.455974+0000 mgr.a (mgr.14388) 14003 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:06 smithi027 bash[22610]: cluster 2024-08-31T07:35:04.455974+0000 mgr.a (mgr.14388) 14003 : cluster [DBG] pgmap v9707: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:08 smithi191 bash[24992]: cluster 2024-08-31T07:35:06.456719+0000 mgr.a (mgr.14388) 14004 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:35:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:08 smithi163 bash[24253]: cluster 2024-08-31T07:35:06.456719+0000 mgr.a (mgr.14388) 14004 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:35:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:08 smithi027 bash[22610]: cluster 2024-08-31T07:35:06.456719+0000 mgr.a (mgr.14388) 14004 : cluster [DBG] pgmap v9708: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:35:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:35:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:35:09.127 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:35:09.896 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:35:09.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:35:09.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:35:09.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:35:09.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:35:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:10 smithi191 bash[24992]: cluster 2024-08-31T07:35:08.458663+0000 mgr.a (mgr.14388) 14005 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:10 smithi163 bash[24253]: cluster 2024-08-31T07:35:08.458663+0000 mgr.a (mgr.14388) 14005 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:10 smithi027 bash[22610]: cluster 2024-08-31T07:35:08.458663+0000 mgr.a (mgr.14388) 14005 : cluster [DBG] pgmap v9709: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:11 smithi163 bash[24253]: audit 2024-08-31T07:35:09.464071+0000 mgr.a (mgr.14388) 14006 : audit [DBG] from='client.304746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:11 smithi027 bash[22610]: audit 2024-08-31T07:35:09.464071+0000 mgr.a (mgr.14388) 14006 : audit [DBG] from='client.304746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:11 smithi191 bash[24992]: audit 2024-08-31T07:35:09.464071+0000 mgr.a (mgr.14388) 14006 : audit [DBG] from='client.304746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:12 smithi163 bash[24253]: cluster 2024-08-31T07:35:10.459598+0000 mgr.a (mgr.14388) 14007 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:12 smithi027 bash[22610]: cluster 2024-08-31T07:35:10.459598+0000 mgr.a (mgr.14388) 14007 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:12 smithi191 bash[24992]: cluster 2024-08-31T07:35:10.459598+0000 mgr.a (mgr.14388) 14007 : cluster [DBG] pgmap v9710: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:14 smithi163 bash[24253]: cluster 2024-08-31T07:35:12.460350+0000 mgr.a (mgr.14388) 14008 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:14 smithi027 bash[22610]: cluster 2024-08-31T07:35:12.460350+0000 mgr.a (mgr.14388) 14008 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:14 smithi191 bash[24992]: cluster 2024-08-31T07:35:12.460350+0000 mgr.a (mgr.14388) 14008 : cluster [DBG] pgmap v9711: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:14.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:35:14.898 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:35:14.898 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:35:15.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:35:15.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:35:15.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:35:15.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:35:15.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:35:16.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:16 smithi163 bash[24253]: cluster 2024-08-31T07:35:14.462522+0000 mgr.a (mgr.14388) 14009 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:16 smithi027 bash[22610]: cluster 2024-08-31T07:35:14.462522+0000 mgr.a (mgr.14388) 14009 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:16 smithi191 bash[24992]: cluster 2024-08-31T07:35:14.462522+0000 mgr.a (mgr.14388) 14009 : cluster [DBG] pgmap v9712: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:17 smithi163 bash[24253]: audit 2024-08-31T07:35:15.232529+0000 mgr.a (mgr.14388) 14010 : audit [DBG] from='client.304824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:17 smithi027 bash[22610]: audit 2024-08-31T07:35:15.232529+0000 mgr.a (mgr.14388) 14010 : audit [DBG] from='client.304824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:17 smithi191 bash[24992]: audit 2024-08-31T07:35:15.232529+0000 mgr.a (mgr.14388) 14010 : audit [DBG] from='client.304824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:18 smithi163 bash[24253]: cluster 2024-08-31T07:35:16.463561+0000 mgr.a (mgr.14388) 14011 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:18 smithi027 bash[22610]: cluster 2024-08-31T07:35:16.463561+0000 mgr.a (mgr.14388) 14011 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:18 smithi191 bash[24992]: cluster 2024-08-31T07:35:16.463561+0000 mgr.a (mgr.14388) 14011 : cluster [DBG] pgmap v9713: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:20 smithi163 bash[24253]: cluster 2024-08-31T07:35:18.465799+0000 mgr.a (mgr.14388) 14012 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:20 smithi027 bash[22610]: cluster 2024-08-31T07:35:18.465799+0000 mgr.a (mgr.14388) 14012 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:20 smithi191 bash[24992]: cluster 2024-08-31T07:35:18.465799+0000 mgr.a (mgr.14388) 14012 : cluster [DBG] pgmap v9714: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:20.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:35:20.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:35:20.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:35:21.424 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:35:21.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:35:21.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:35:21.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:35:21.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:35:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:22 smithi163 bash[24253]: cluster 2024-08-31T07:35:20.466575+0000 mgr.a (mgr.14388) 14013 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:22 smithi163 bash[24253]: audit 2024-08-31T07:35:21.000010+0000 mgr.a (mgr.14388) 14014 : audit [DBG] from='client.304902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:22 smithi027 bash[22610]: cluster 2024-08-31T07:35:20.466575+0000 mgr.a (mgr.14388) 14013 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:22 smithi027 bash[22610]: audit 2024-08-31T07:35:21.000010+0000 mgr.a (mgr.14388) 14014 : audit [DBG] from='client.304902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:22 smithi191 bash[24992]: cluster 2024-08-31T07:35:20.466575+0000 mgr.a (mgr.14388) 14013 : cluster [DBG] pgmap v9715: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:22 smithi191 bash[24992]: audit 2024-08-31T07:35:21.000010+0000 mgr.a (mgr.14388) 14014 : audit [DBG] from='client.304902 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:24 smithi163 bash[24253]: cluster 2024-08-31T07:35:22.467559+0000 mgr.a (mgr.14388) 14015 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:24 smithi027 bash[22610]: cluster 2024-08-31T07:35:22.467559+0000 mgr.a (mgr.14388) 14015 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:24 smithi191 bash[24992]: cluster 2024-08-31T07:35:22.467559+0000 mgr.a (mgr.14388) 14015 : cluster [DBG] pgmap v9716: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:26.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:35:26.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:35:26.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:35:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:26 smithi163 bash[24253]: cluster 2024-08-31T07:35:24.469816+0000 mgr.a (mgr.14388) 14016 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:26 smithi027 bash[22610]: cluster 2024-08-31T07:35:24.469816+0000 mgr.a (mgr.14388) 14016 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:26 smithi191 bash[24992]: cluster 2024-08-31T07:35:24.469816+0000 mgr.a (mgr.14388) 14016 : cluster [DBG] pgmap v9717: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:27.170 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:35:27.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:35:27.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:35:27.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:35:27.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:35:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:27 smithi163 bash[24253]: audit 2024-08-31T07:35:26.710401+0000 mon.a (mon.0) 2668 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:35:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:27 smithi027 bash[22610]: audit 2024-08-31T07:35:26.710401+0000 mon.a (mon.0) 2668 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:35:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:27 smithi191 bash[24992]: audit 2024-08-31T07:35:26.710401+0000 mon.a (mon.0) 2668 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:35:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:28 smithi163 bash[24253]: cluster 2024-08-31T07:35:26.470377+0000 mgr.a (mgr.14388) 14017 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:28 smithi163 bash[24253]: audit 2024-08-31T07:35:26.758270+0000 mgr.a (mgr.14388) 14018 : audit [DBG] from='client.304974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:28 smithi163 bash[24253]: audit 2024-08-31T07:35:27.574279+0000 mon.a (mon.0) 2669 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:35:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:28 smithi163 bash[24253]: audit 2024-08-31T07:35:27.576312+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:35:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:28 smithi163 bash[24253]: audit 2024-08-31T07:35:27.588179+0000 mon.a (mon.0) 2671 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:35:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:28 smithi163 bash[24253]: audit 2024-08-31T07:35:27.593244+0000 mon.a (mon.0) 2672 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:35:28.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:35:28 smithi027 bash[22863]: debug 2024-08-31T07:35:28.322+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:35:28.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:35:28 smithi027 bash[22863]: debug 2024-08-31T07:35:28.322+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:35:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:28 smithi027 bash[22610]: cluster 2024-08-31T07:35:26.470377+0000 mgr.a (mgr.14388) 14017 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:28 smithi027 bash[22610]: audit 2024-08-31T07:35:26.758270+0000 mgr.a (mgr.14388) 14018 : audit [DBG] from='client.304974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:28 smithi027 bash[22610]: audit 2024-08-31T07:35:27.574279+0000 mon.a (mon.0) 2669 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:35:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:28 smithi027 bash[22610]: audit 2024-08-31T07:35:27.576312+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:35:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:28 smithi027 bash[22610]: audit 2024-08-31T07:35:27.588179+0000 mon.a (mon.0) 2671 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:35:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:28 smithi027 bash[22610]: audit 2024-08-31T07:35:27.593244+0000 mon.a (mon.0) 2672 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:35:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:28 smithi191 bash[24992]: cluster 2024-08-31T07:35:26.470377+0000 mgr.a (mgr.14388) 14017 : cluster [DBG] pgmap v9718: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:28 smithi191 bash[24992]: audit 2024-08-31T07:35:26.758270+0000 mgr.a (mgr.14388) 14018 : audit [DBG] from='client.304974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:28 smithi191 bash[24992]: audit 2024-08-31T07:35:27.574279+0000 mon.a (mon.0) 2669 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:35:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:28 smithi191 bash[24992]: audit 2024-08-31T07:35:27.576312+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:35:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:28 smithi191 bash[24992]: audit 2024-08-31T07:35:27.588179+0000 mon.a (mon.0) 2671 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:35:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:28 smithi191 bash[24992]: audit 2024-08-31T07:35:27.593244+0000 mon.a (mon.0) 2672 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:35:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:29 smithi163 bash[24253]: audit 2024-08-31T07:35:27.595993+0000 mgr.a (mgr.14388) 14019 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:35:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:29 smithi027 bash[22610]: audit 2024-08-31T07:35:27.595993+0000 mgr.a (mgr.14388) 14019 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:35:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:29 smithi191 bash[24992]: audit 2024-08-31T07:35:27.595993+0000 mgr.a (mgr.14388) 14019 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:35:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:30 smithi163 bash[24253]: audit 2024-08-31T07:35:28.323387+0000 mgr.a (mgr.14388) 14020 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:35:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:30 smithi163 bash[24253]: cephadm 2024-08-31T07:35:28.324491+0000 mgr.a (mgr.14388) 14021 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:35:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:30 smithi163 bash[24253]: cluster 2024-08-31T07:35:28.473102+0000 mgr.a (mgr.14388) 14022 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:35:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:30 smithi027 bash[22610]: audit 2024-08-31T07:35:28.323387+0000 mgr.a (mgr.14388) 14020 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:35:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:30 smithi027 bash[22610]: cephadm 2024-08-31T07:35:28.324491+0000 mgr.a (mgr.14388) 14021 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:35:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:30 smithi027 bash[22610]: cluster 2024-08-31T07:35:28.473102+0000 mgr.a (mgr.14388) 14022 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:35:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:30 smithi191 bash[24992]: audit 2024-08-31T07:35:28.323387+0000 mgr.a (mgr.14388) 14020 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:35:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:30 smithi191 bash[24992]: cephadm 2024-08-31T07:35:28.324491+0000 mgr.a (mgr.14388) 14021 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:35:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:30 smithi191 bash[24992]: cluster 2024-08-31T07:35:28.473102+0000 mgr.a (mgr.14388) 14022 : cluster [DBG] pgmap v9719: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:35:32.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:35:32.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:35:32.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:35:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:32 smithi163 bash[24253]: cluster 2024-08-31T07:35:30.473880+0000 mgr.a (mgr.14388) 14023 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:35:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:32 smithi027 bash[22610]: cluster 2024-08-31T07:35:30.473880+0000 mgr.a (mgr.14388) 14023 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:35:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:32 smithi191 bash[24992]: cluster 2024-08-31T07:35:30.473880+0000 mgr.a (mgr.14388) 14023 : cluster [DBG] pgmap v9720: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:35:32.923 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:35:32.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:35:32.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:35:32.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:35:32.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:35:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:34 smithi163 bash[24253]: cluster 2024-08-31T07:35:32.474611+0000 mgr.a (mgr.14388) 14024 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:35:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:34 smithi163 bash[24253]: audit 2024-08-31T07:35:32.502463+0000 mgr.a (mgr.14388) 14025 : audit [DBG] from='client.305160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:34 smithi027 bash[22610]: cluster 2024-08-31T07:35:32.474611+0000 mgr.a (mgr.14388) 14024 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:35:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:34 smithi027 bash[22610]: audit 2024-08-31T07:35:32.502463+0000 mgr.a (mgr.14388) 14025 : audit [DBG] from='client.305160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:34 smithi191 bash[24992]: cluster 2024-08-31T07:35:32.474611+0000 mgr.a (mgr.14388) 14024 : cluster [DBG] pgmap v9721: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:35:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:34 smithi191 bash[24992]: audit 2024-08-31T07:35:32.502463+0000 mgr.a (mgr.14388) 14025 : audit [DBG] from='client.305160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:36 smithi163 bash[24253]: cluster 2024-08-31T07:35:34.477148+0000 mgr.a (mgr.14388) 14026 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:35:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:36 smithi027 bash[22610]: cluster 2024-08-31T07:35:34.477148+0000 mgr.a (mgr.14388) 14026 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:35:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:36 smithi191 bash[24992]: cluster 2024-08-31T07:35:34.477148+0000 mgr.a (mgr.14388) 14026 : cluster [DBG] pgmap v9722: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:35:37.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:35:37.925 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:35:37.925 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:35:38.456 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:38 smithi163 bash[24253]: cluster 2024-08-31T07:35:36.478118+0000 mgr.a (mgr.14388) 14027 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:35:38.501 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:38 smithi027 bash[22610]: cluster 2024-08-31T07:35:36.478118+0000 mgr.a (mgr.14388) 14027 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:35:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:38 smithi191 bash[24992]: cluster 2024-08-31T07:35:36.478118+0000 mgr.a (mgr.14388) 14027 : cluster [DBG] pgmap v9723: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:35:38.713 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:35:38.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:35:38.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:35:38.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:35:38.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:35:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:40 smithi163 bash[24253]: audit 2024-08-31T07:35:38.260502+0000 mgr.a (mgr.14388) 14028 : audit [DBG] from='client.305238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:40 smithi163 bash[24253]: cluster 2024-08-31T07:35:38.479547+0000 mgr.a (mgr.14388) 14029 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:35:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:40 smithi027 bash[22610]: audit 2024-08-31T07:35:38.260502+0000 mgr.a (mgr.14388) 14028 : audit [DBG] from='client.305238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:40 smithi027 bash[22610]: cluster 2024-08-31T07:35:38.479547+0000 mgr.a (mgr.14388) 14029 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:35:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:40 smithi191 bash[24992]: audit 2024-08-31T07:35:38.260502+0000 mgr.a (mgr.14388) 14028 : audit [DBG] from='client.305238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:40 smithi191 bash[24992]: cluster 2024-08-31T07:35:38.479547+0000 mgr.a (mgr.14388) 14029 : cluster [DBG] pgmap v9724: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:35:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:42 smithi163 bash[24253]: cluster 2024-08-31T07:35:40.480413+0000 mgr.a (mgr.14388) 14030 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:35:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:42 smithi027 bash[22610]: cluster 2024-08-31T07:35:40.480413+0000 mgr.a (mgr.14388) 14030 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:35:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:42 smithi191 bash[24992]: cluster 2024-08-31T07:35:40.480413+0000 mgr.a (mgr.14388) 14030 : cluster [DBG] pgmap v9725: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:35:43.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:35:43.714 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:35:43.714 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:35:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:44 smithi163 bash[24253]: cluster 2024-08-31T07:35:42.481226+0000 mgr.a (mgr.14388) 14031 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:35:44.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:35:44.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:35:44.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:35:44.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:35:44.474 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:35:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:44 smithi027 bash[22610]: cluster 2024-08-31T07:35:42.481226+0000 mgr.a (mgr.14388) 14031 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:35:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:44 smithi191 bash[24992]: cluster 2024-08-31T07:35:42.481226+0000 mgr.a (mgr.14388) 14031 : cluster [DBG] pgmap v9726: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T07:35:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:45 smithi163 bash[24253]: audit 2024-08-31T07:35:44.046542+0000 mgr.a (mgr.14388) 14032 : audit [DBG] from='client.305313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:45 smithi027 bash[22610]: audit 2024-08-31T07:35:44.046542+0000 mgr.a (mgr.14388) 14032 : audit [DBG] from='client.305313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:45 smithi191 bash[24992]: audit 2024-08-31T07:35:44.046542+0000 mgr.a (mgr.14388) 14032 : audit [DBG] from='client.305313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:46 smithi163 bash[24253]: cluster 2024-08-31T07:35:44.482520+0000 mgr.a (mgr.14388) 14033 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T07:35:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:46 smithi027 bash[22610]: cluster 2024-08-31T07:35:44.482520+0000 mgr.a (mgr.14388) 14033 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T07:35:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:46 smithi191 bash[24992]: cluster 2024-08-31T07:35:44.482520+0000 mgr.a (mgr.14388) 14033 : cluster [DBG] pgmap v9727: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T07:35:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:48 smithi163 bash[24253]: cluster 2024-08-31T07:35:46.483265+0000 mgr.a (mgr.14388) 14034 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:35:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:48 smithi027 bash[22610]: cluster 2024-08-31T07:35:46.483265+0000 mgr.a (mgr.14388) 14034 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:35:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:48 smithi191 bash[24992]: cluster 2024-08-31T07:35:46.483265+0000 mgr.a (mgr.14388) 14034 : cluster [DBG] pgmap v9728: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:35:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:35:49.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:35:49.476 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:35:50.249 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:35:50.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:35:50.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:35:50.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:35:50.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:35:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:50 smithi163 bash[24253]: cluster 2024-08-31T07:35:48.485338+0000 mgr.a (mgr.14388) 14035 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:50 smithi027 bash[22610]: cluster 2024-08-31T07:35:48.485338+0000 mgr.a (mgr.14388) 14035 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:50 smithi191 bash[24992]: cluster 2024-08-31T07:35:48.485338+0000 mgr.a (mgr.14388) 14035 : cluster [DBG] pgmap v9729: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:51 smithi163 bash[24253]: audit 2024-08-31T07:35:49.810460+0000 mgr.a (mgr.14388) 14036 : audit [DBG] from='client.305391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:51 smithi027 bash[22610]: audit 2024-08-31T07:35:49.810460+0000 mgr.a (mgr.14388) 14036 : audit [DBG] from='client.305391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:51 smithi191 bash[24992]: audit 2024-08-31T07:35:49.810460+0000 mgr.a (mgr.14388) 14036 : audit [DBG] from='client.305391 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:52 smithi163 bash[24253]: cluster 2024-08-31T07:35:50.486309+0000 mgr.a (mgr.14388) 14037 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:52 smithi027 bash[22610]: cluster 2024-08-31T07:35:50.486309+0000 mgr.a (mgr.14388) 14037 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:52 smithi191 bash[24992]: cluster 2024-08-31T07:35:50.486309+0000 mgr.a (mgr.14388) 14037 : cluster [DBG] pgmap v9730: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:54 smithi163 bash[24253]: cluster 2024-08-31T07:35:52.487154+0000 mgr.a (mgr.14388) 14038 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:54 smithi027 bash[22610]: cluster 2024-08-31T07:35:52.487154+0000 mgr.a (mgr.14388) 14038 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:54 smithi191 bash[24992]: cluster 2024-08-31T07:35:52.487154+0000 mgr.a (mgr.14388) 14038 : cluster [DBG] pgmap v9731: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:35:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:35:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:35:55.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:35:55.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:35:55.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:35:55.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:35:55.999 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:35:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:56 smithi163 bash[24253]: cluster 2024-08-31T07:35:54.489285+0000 mgr.a (mgr.14388) 14039 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:56 smithi027 bash[22610]: cluster 2024-08-31T07:35:54.489285+0000 mgr.a (mgr.14388) 14039 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:56 smithi191 bash[24992]: cluster 2024-08-31T07:35:54.489285+0000 mgr.a (mgr.14388) 14039 : cluster [DBG] pgmap v9732: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:35:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:57 smithi163 bash[24253]: audit 2024-08-31T07:35:55.581651+0000 mgr.a (mgr.14388) 14040 : audit [DBG] from='client.305469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:57 smithi027 bash[22610]: audit 2024-08-31T07:35:55.581651+0000 mgr.a (mgr.14388) 14040 : audit [DBG] from='client.305469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:57 smithi191 bash[24992]: audit 2024-08-31T07:35:55.581651+0000 mgr.a (mgr.14388) 14040 : audit [DBG] from='client.305469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:35:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:35:58 smithi163 bash[24253]: cluster 2024-08-31T07:35:56.490246+0000 mgr.a (mgr.14388) 14041 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:35:58 smithi027 bash[22610]: cluster 2024-08-31T07:35:56.490246+0000 mgr.a (mgr.14388) 14041 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:35:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:35:58 smithi191 bash[24992]: cluster 2024-08-31T07:35:56.490246+0000 mgr.a (mgr.14388) 14041 : cluster [DBG] pgmap v9733: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:00 smithi163 bash[24253]: cluster 2024-08-31T07:35:58.492485+0000 mgr.a (mgr.14388) 14042 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:00 smithi027 bash[22610]: cluster 2024-08-31T07:35:58.492485+0000 mgr.a (mgr.14388) 14042 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:00 smithi191 bash[24992]: cluster 2024-08-31T07:35:58.492485+0000 mgr.a (mgr.14388) 14042 : cluster [DBG] pgmap v9734: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:01.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:01.001 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:01.001 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:01.791 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:01.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:01.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:01.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:01.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:02 smithi163 bash[24253]: cluster 2024-08-31T07:36:00.493239+0000 mgr.a (mgr.14388) 14043 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:02 smithi027 bash[22610]: cluster 2024-08-31T07:36:00.493239+0000 mgr.a (mgr.14388) 14043 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:02 smithi191 bash[24992]: cluster 2024-08-31T07:36:00.493239+0000 mgr.a (mgr.14388) 14043 : cluster [DBG] pgmap v9735: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:03 smithi163 bash[24253]: audit 2024-08-31T07:36:01.342367+0000 mgr.a (mgr.14388) 14044 : audit [DBG] from='client.305547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:03 smithi027 bash[22610]: audit 2024-08-31T07:36:01.342367+0000 mgr.a (mgr.14388) 14044 : audit [DBG] from='client.305547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:03 smithi191 bash[24992]: audit 2024-08-31T07:36:01.342367+0000 mgr.a (mgr.14388) 14044 : audit [DBG] from='client.305547 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:04 smithi163 bash[24253]: cluster 2024-08-31T07:36:02.494215+0000 mgr.a (mgr.14388) 14045 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:04 smithi027 bash[22610]: cluster 2024-08-31T07:36:02.494215+0000 mgr.a (mgr.14388) 14045 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:04 smithi191 bash[24992]: cluster 2024-08-31T07:36:02.494215+0000 mgr.a (mgr.14388) 14045 : cluster [DBG] pgmap v9736: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:05 smithi027 bash[22610]: cluster 2024-08-31T07:36:04.496463+0000 mgr.a (mgr.14388) 14046 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:05 smithi191 bash[24992]: cluster 2024-08-31T07:36:04.496463+0000 mgr.a (mgr.14388) 14046 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:05 smithi163 bash[24253]: cluster 2024-08-31T07:36:04.496463+0000 mgr.a (mgr.14388) 14046 : cluster [DBG] pgmap v9737: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:06.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:06.793 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:06.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:07.574 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:07.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:07.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:07.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:07.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:07 smithi163 bash[24253]: cluster 2024-08-31T07:36:06.497238+0000 mgr.a (mgr.14388) 14047 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:07 smithi163 bash[24253]: audit 2024-08-31T07:36:07.129365+0000 mgr.a (mgr.14388) 14048 : audit [DBG] from='client.305622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:07 smithi027 bash[22610]: cluster 2024-08-31T07:36:06.497238+0000 mgr.a (mgr.14388) 14047 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:07 smithi027 bash[22610]: audit 2024-08-31T07:36:07.129365+0000 mgr.a (mgr.14388) 14048 : audit [DBG] from='client.305622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:07 smithi191 bash[24992]: cluster 2024-08-31T07:36:06.497238+0000 mgr.a (mgr.14388) 14047 : cluster [DBG] pgmap v9738: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:07 smithi191 bash[24992]: audit 2024-08-31T07:36:07.129365+0000 mgr.a (mgr.14388) 14048 : audit [DBG] from='client.305622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:09 smithi163 bash[24253]: cluster 2024-08-31T07:36:08.499506+0000 mgr.a (mgr.14388) 14049 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:09 smithi027 bash[22610]: cluster 2024-08-31T07:36:08.499506+0000 mgr.a (mgr.14388) 14049 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:09 smithi191 bash[24992]: cluster 2024-08-31T07:36:08.499506+0000 mgr.a (mgr.14388) 14049 : cluster [DBG] pgmap v9739: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:11 smithi163 bash[24253]: cluster 2024-08-31T07:36:10.500321+0000 mgr.a (mgr.14388) 14050 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:11 smithi027 bash[22610]: cluster 2024-08-31T07:36:10.500321+0000 mgr.a (mgr.14388) 14050 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:11 smithi191 bash[24992]: cluster 2024-08-31T07:36:10.500321+0000 mgr.a (mgr.14388) 14050 : cluster [DBG] pgmap v9740: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:12.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:12.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:12.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:13.313 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:13.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:13.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:13.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:13.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:13 smithi163 bash[24253]: cluster 2024-08-31T07:36:12.501087+0000 mgr.a (mgr.14388) 14051 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:13 smithi163 bash[24253]: audit 2024-08-31T07:36:12.898334+0000 mgr.a (mgr.14388) 14052 : audit [DBG] from='client.305700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:13 smithi027 bash[22610]: cluster 2024-08-31T07:36:12.501087+0000 mgr.a (mgr.14388) 14051 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:13 smithi027 bash[22610]: audit 2024-08-31T07:36:12.898334+0000 mgr.a (mgr.14388) 14052 : audit [DBG] from='client.305700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:13 smithi191 bash[24992]: cluster 2024-08-31T07:36:12.501087+0000 mgr.a (mgr.14388) 14051 : cluster [DBG] pgmap v9741: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:13 smithi191 bash[24992]: audit 2024-08-31T07:36:12.898334+0000 mgr.a (mgr.14388) 14052 : audit [DBG] from='client.305700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:15 smithi163 bash[24253]: cluster 2024-08-31T07:36:14.504000+0000 mgr.a (mgr.14388) 14053 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:15 smithi027 bash[22610]: cluster 2024-08-31T07:36:14.504000+0000 mgr.a (mgr.14388) 14053 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:15 smithi191 bash[24992]: cluster 2024-08-31T07:36:14.504000+0000 mgr.a (mgr.14388) 14053 : cluster [DBG] pgmap v9742: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:17 smithi163 bash[24253]: cluster 2024-08-31T07:36:16.504827+0000 mgr.a (mgr.14388) 14054 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:36:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:17 smithi027 bash[22610]: cluster 2024-08-31T07:36:16.504827+0000 mgr.a (mgr.14388) 14054 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:36:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:17 smithi191 bash[24992]: cluster 2024-08-31T07:36:16.504827+0000 mgr.a (mgr.14388) 14054 : cluster [DBG] pgmap v9743: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:36:18.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:18.316 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:18.316 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:19.085 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:19.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:19.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:19.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:19.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:19 smithi163 bash[24253]: cluster 2024-08-31T07:36:18.506809+0000 mgr.a (mgr.14388) 14055 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:19 smithi163 bash[24253]: audit 2024-08-31T07:36:18.655852+0000 mgr.a (mgr.14388) 14056 : audit [DBG] from='client.305778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:19 smithi027 bash[22610]: cluster 2024-08-31T07:36:18.506809+0000 mgr.a (mgr.14388) 14055 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:19 smithi027 bash[22610]: audit 2024-08-31T07:36:18.655852+0000 mgr.a (mgr.14388) 14056 : audit [DBG] from='client.305778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:19 smithi191 bash[24992]: cluster 2024-08-31T07:36:18.506809+0000 mgr.a (mgr.14388) 14055 : cluster [DBG] pgmap v9744: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:19 smithi191 bash[24992]: audit 2024-08-31T07:36:18.655852+0000 mgr.a (mgr.14388) 14056 : audit [DBG] from='client.305778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:21 smithi163 bash[24253]: cluster 2024-08-31T07:36:20.507687+0000 mgr.a (mgr.14388) 14057 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:36:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:21 smithi027 bash[22610]: cluster 2024-08-31T07:36:20.507687+0000 mgr.a (mgr.14388) 14057 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:36:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:21 smithi191 bash[24992]: cluster 2024-08-31T07:36:20.507687+0000 mgr.a (mgr.14388) 14057 : cluster [DBG] pgmap v9745: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:36:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:23 smithi163 bash[24253]: cluster 2024-08-31T07:36:22.508475+0000 mgr.a (mgr.14388) 14058 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:36:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:23 smithi027 bash[22610]: cluster 2024-08-31T07:36:22.508475+0000 mgr.a (mgr.14388) 14058 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:36:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:23 smithi191 bash[24992]: cluster 2024-08-31T07:36:22.508475+0000 mgr.a (mgr.14388) 14058 : cluster [DBG] pgmap v9746: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:36:24.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:24.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:24.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:24.861 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:24.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:24.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:24.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:24.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:25.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:25 smithi163 bash[24253]: audit 2024-08-31T07:36:24.422062+0000 mgr.a (mgr.14388) 14059 : audit [DBG] from='client.305856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:25.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:25 smithi163 bash[24253]: cluster 2024-08-31T07:36:24.509937+0000 mgr.a (mgr.14388) 14060 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:25 smithi027 bash[22610]: audit 2024-08-31T07:36:24.422062+0000 mgr.a (mgr.14388) 14059 : audit [DBG] from='client.305856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:25 smithi027 bash[22610]: cluster 2024-08-31T07:36:24.509937+0000 mgr.a (mgr.14388) 14060 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:25 smithi191 bash[24992]: audit 2024-08-31T07:36:24.422062+0000 mgr.a (mgr.14388) 14059 : audit [DBG] from='client.305856 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:25 smithi191 bash[24992]: cluster 2024-08-31T07:36:24.509937+0000 mgr.a (mgr.14388) 14060 : cluster [DBG] pgmap v9747: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:27 smithi163 bash[24253]: cluster 2024-08-31T07:36:26.510825+0000 mgr.a (mgr.14388) 14061 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:27 smithi027 bash[22610]: cluster 2024-08-31T07:36:26.510825+0000 mgr.a (mgr.14388) 14061 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:27 smithi191 bash[24992]: cluster 2024-08-31T07:36:26.510825+0000 mgr.a (mgr.14388) 14061 : cluster [DBG] pgmap v9748: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:28 smithi163 bash[24253]: audit 2024-08-31T07:36:28.376016+0000 mon.a (mon.0) 2673 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:36:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:28 smithi027 bash[22610]: audit 2024-08-31T07:36:28.376016+0000 mon.a (mon.0) 2673 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:36:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:28 smithi191 bash[24992]: audit 2024-08-31T07:36:28.376016+0000 mon.a (mon.0) 2673 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:36:29.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:29.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:29.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:29 smithi163 bash[24253]: cluster 2024-08-31T07:36:28.512994+0000 mgr.a (mgr.14388) 14062 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:29 smithi163 bash[24253]: audit 2024-08-31T07:36:29.220154+0000 mon.a (mon.0) 2674 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:36:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:29 smithi163 bash[24253]: audit 2024-08-31T07:36:29.221480+0000 mon.a (mon.0) 2675 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:36:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:29 smithi163 bash[24253]: audit 2024-08-31T07:36:29.231208+0000 mon.a (mon.0) 2676 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:36:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:29 smithi163 bash[24253]: audit 2024-08-31T07:36:29.235886+0000 mon.a (mon.0) 2677 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:36:29.955 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:29 smithi027 bash[22610]: cluster 2024-08-31T07:36:28.512994+0000 mgr.a (mgr.14388) 14062 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:29.955 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:29 smithi027 bash[22610]: audit 2024-08-31T07:36:29.220154+0000 mon.a (mon.0) 2674 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:36:29.955 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:29 smithi027 bash[22610]: audit 2024-08-31T07:36:29.221480+0000 mon.a (mon.0) 2675 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:36:29.955 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:29 smithi027 bash[22610]: audit 2024-08-31T07:36:29.231208+0000 mon.a (mon.0) 2676 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:36:29.955 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:29 smithi027 bash[22610]: audit 2024-08-31T07:36:29.235886+0000 mon.a (mon.0) 2677 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:36:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:29 smithi191 bash[24992]: cluster 2024-08-31T07:36:28.512994+0000 mgr.a (mgr.14388) 14062 : cluster [DBG] pgmap v9749: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:29 smithi191 bash[24992]: audit 2024-08-31T07:36:29.220154+0000 mon.a (mon.0) 2674 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:36:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:29 smithi191 bash[24992]: audit 2024-08-31T07:36:29.221480+0000 mon.a (mon.0) 2675 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:36:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:29 smithi191 bash[24992]: audit 2024-08-31T07:36:29.231208+0000 mon.a (mon.0) 2676 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:36:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:29 smithi191 bash[24992]: audit 2024-08-31T07:36:29.235886+0000 mon.a (mon.0) 2677 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:36:30.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:36:29 smithi027 bash[22863]: debug 2024-08-31T07:36:29.952+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:36:30.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:36:29 smithi027 bash[22863]: debug 2024-08-31T07:36:29.952+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:36:30.576 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:30.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:30.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:30.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:30.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:30 smithi163 bash[24253]: audit 2024-08-31T07:36:29.236962+0000 mgr.a (mgr.14388) 14063 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:36:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:30 smithi163 bash[24253]: audit 2024-08-31T07:36:29.955067+0000 mgr.a (mgr.14388) 14064 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:36:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:30 smithi163 bash[24253]: cephadm 2024-08-31T07:36:29.956183+0000 mgr.a (mgr.14388) 14065 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:36:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:30 smithi163 bash[24253]: audit 2024-08-31T07:36:30.169255+0000 mgr.a (mgr.14388) 14066 : audit [DBG] from='client.306042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:30 smithi027 bash[22610]: audit 2024-08-31T07:36:29.236962+0000 mgr.a (mgr.14388) 14063 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:36:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:30 smithi027 bash[22610]: audit 2024-08-31T07:36:29.955067+0000 mgr.a (mgr.14388) 14064 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:36:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:30 smithi027 bash[22610]: cephadm 2024-08-31T07:36:29.956183+0000 mgr.a (mgr.14388) 14065 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:36:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:30 smithi027 bash[22610]: audit 2024-08-31T07:36:30.169255+0000 mgr.a (mgr.14388) 14066 : audit [DBG] from='client.306042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:30 smithi191 bash[24992]: audit 2024-08-31T07:36:29.236962+0000 mgr.a (mgr.14388) 14063 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:36:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:30 smithi191 bash[24992]: audit 2024-08-31T07:36:29.955067+0000 mgr.a (mgr.14388) 14064 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:36:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:30 smithi191 bash[24992]: cephadm 2024-08-31T07:36:29.956183+0000 mgr.a (mgr.14388) 14065 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:36:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:30 smithi191 bash[24992]: audit 2024-08-31T07:36:30.169255+0000 mgr.a (mgr.14388) 14066 : audit [DBG] from='client.306042 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:31 smithi163 bash[24253]: cluster 2024-08-31T07:36:30.513806+0000 mgr.a (mgr.14388) 14067 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:31 smithi027 bash[22610]: cluster 2024-08-31T07:36:30.513806+0000 mgr.a (mgr.14388) 14067 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:31 smithi191 bash[24992]: cluster 2024-08-31T07:36:30.513806+0000 mgr.a (mgr.14388) 14067 : cluster [DBG] pgmap v9750: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:33 smithi163 bash[24253]: cluster 2024-08-31T07:36:32.514603+0000 mgr.a (mgr.14388) 14068 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:33 smithi027 bash[22610]: cluster 2024-08-31T07:36:32.514603+0000 mgr.a (mgr.14388) 14068 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:33 smithi191 bash[24992]: cluster 2024-08-31T07:36:32.514603+0000 mgr.a (mgr.14388) 14068 : cluster [DBG] pgmap v9751: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:35.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:35.578 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:35.578 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:35 smithi163 bash[24253]: cluster 2024-08-31T07:36:34.516834+0000 mgr.a (mgr.14388) 14069 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:35 smithi027 bash[22610]: cluster 2024-08-31T07:36:34.516834+0000 mgr.a (mgr.14388) 14069 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:35 smithi191 bash[24992]: cluster 2024-08-31T07:36:34.516834+0000 mgr.a (mgr.14388) 14069 : cluster [DBG] pgmap v9752: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:36.359 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:36.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:36.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:36.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:36.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:36 smithi163 bash[24253]: audit 2024-08-31T07:36:35.916666+0000 mgr.a (mgr.14388) 14070 : audit [DBG] from='client.306120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:36 smithi027 bash[22610]: audit 2024-08-31T07:36:35.916666+0000 mgr.a (mgr.14388) 14070 : audit [DBG] from='client.306120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:36 smithi191 bash[24992]: audit 2024-08-31T07:36:35.916666+0000 mgr.a (mgr.14388) 14070 : audit [DBG] from='client.306120 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:37 smithi163 bash[24253]: cluster 2024-08-31T07:36:36.517738+0000 mgr.a (mgr.14388) 14071 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:37 smithi027 bash[22610]: cluster 2024-08-31T07:36:36.517738+0000 mgr.a (mgr.14388) 14071 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:37 smithi191 bash[24992]: cluster 2024-08-31T07:36:36.517738+0000 mgr.a (mgr.14388) 14071 : cluster [DBG] pgmap v9753: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:39 smithi163 bash[24253]: cluster 2024-08-31T07:36:38.519960+0000 mgr.a (mgr.14388) 14072 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:39 smithi027 bash[22610]: cluster 2024-08-31T07:36:38.519960+0000 mgr.a (mgr.14388) 14072 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:39 smithi191 bash[24992]: cluster 2024-08-31T07:36:38.519960+0000 mgr.a (mgr.14388) 14072 : cluster [DBG] pgmap v9754: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:41.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:41.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:41.362 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:41 smithi163 bash[24253]: cluster 2024-08-31T07:36:40.520747+0000 mgr.a (mgr.14388) 14073 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:41 smithi027 bash[22610]: cluster 2024-08-31T07:36:40.520747+0000 mgr.a (mgr.14388) 14073 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:41 smithi191 bash[24992]: cluster 2024-08-31T07:36:40.520747+0000 mgr.a (mgr.14388) 14073 : cluster [DBG] pgmap v9755: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:42.121 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:42.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:42.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:42.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:42.122 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:42 smithi163 bash[24253]: audit 2024-08-31T07:36:41.697025+0000 mgr.a (mgr.14388) 14074 : audit [DBG] from='client.306192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:42 smithi027 bash[22610]: audit 2024-08-31T07:36:41.697025+0000 mgr.a (mgr.14388) 14074 : audit [DBG] from='client.306192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:42 smithi191 bash[24992]: audit 2024-08-31T07:36:41.697025+0000 mgr.a (mgr.14388) 14074 : audit [DBG] from='client.306192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:43 smithi163 bash[24253]: cluster 2024-08-31T07:36:42.521696+0000 mgr.a (mgr.14388) 14075 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:43 smithi027 bash[22610]: cluster 2024-08-31T07:36:42.521696+0000 mgr.a (mgr.14388) 14075 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:43 smithi191 bash[24992]: cluster 2024-08-31T07:36:42.521696+0000 mgr.a (mgr.14388) 14075 : cluster [DBG] pgmap v9756: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:45 smithi163 bash[24253]: cluster 2024-08-31T07:36:44.523951+0000 mgr.a (mgr.14388) 14076 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:45 smithi027 bash[22610]: cluster 2024-08-31T07:36:44.523951+0000 mgr.a (mgr.14388) 14076 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:45 smithi191 bash[24992]: cluster 2024-08-31T07:36:44.523951+0000 mgr.a (mgr.14388) 14076 : cluster [DBG] pgmap v9757: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:36:47.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:47.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:47.124 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:47.909 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:47.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:47.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:47.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:47.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:47 smithi163 bash[24253]: cluster 2024-08-31T07:36:46.524713+0000 mgr.a (mgr.14388) 14077 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:47 smithi027 bash[22610]: cluster 2024-08-31T07:36:46.524713+0000 mgr.a (mgr.14388) 14077 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:47 smithi191 bash[24992]: cluster 2024-08-31T07:36:46.524713+0000 mgr.a (mgr.14388) 14077 : cluster [DBG] pgmap v9758: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:48 smithi163 bash[24253]: audit 2024-08-31T07:36:47.459703+0000 mgr.a (mgr.14388) 14078 : audit [DBG] from='client.306270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:48 smithi027 bash[22610]: audit 2024-08-31T07:36:47.459703+0000 mgr.a (mgr.14388) 14078 : audit [DBG] from='client.306270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:48 smithi191 bash[24992]: audit 2024-08-31T07:36:47.459703+0000 mgr.a (mgr.14388) 14078 : audit [DBG] from='client.306270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:49 smithi163 bash[24253]: cluster 2024-08-31T07:36:48.527061+0000 mgr.a (mgr.14388) 14079 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:49 smithi027 bash[22610]: cluster 2024-08-31T07:36:48.527061+0000 mgr.a (mgr.14388) 14079 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:49 smithi191 bash[24992]: cluster 2024-08-31T07:36:48.527061+0000 mgr.a (mgr.14388) 14079 : cluster [DBG] pgmap v9759: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:36:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:51 smithi163 bash[24253]: cluster 2024-08-31T07:36:50.527850+0000 mgr.a (mgr.14388) 14080 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:51 smithi027 bash[22610]: cluster 2024-08-31T07:36:50.527850+0000 mgr.a (mgr.14388) 14080 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:51 smithi191 bash[24992]: cluster 2024-08-31T07:36:50.527850+0000 mgr.a (mgr.14388) 14080 : cluster [DBG] pgmap v9760: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:52.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:52.912 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:52.912 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:53.702 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:53.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:53.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:53.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:53.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:53 smithi163 bash[24253]: cluster 2024-08-31T07:36:52.528633+0000 mgr.a (mgr.14388) 14081 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:53 smithi027 bash[22610]: cluster 2024-08-31T07:36:52.528633+0000 mgr.a (mgr.14388) 14081 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:53 smithi191 bash[24992]: cluster 2024-08-31T07:36:52.528633+0000 mgr.a (mgr.14388) 14081 : cluster [DBG] pgmap v9761: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:54 smithi027 bash[22610]: audit 2024-08-31T07:36:53.250084+0000 mgr.a (mgr.14388) 14082 : audit [DBG] from='client.306348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:54 smithi191 bash[24992]: audit 2024-08-31T07:36:53.250084+0000 mgr.a (mgr.14388) 14082 : audit [DBG] from='client.306348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:54 smithi163 bash[24253]: audit 2024-08-31T07:36:53.250084+0000 mgr.a (mgr.14388) 14082 : audit [DBG] from='client.306348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:36:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:55 smithi027 bash[22610]: cluster 2024-08-31T07:36:54.531498+0000 mgr.a (mgr.14388) 14083 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:55 smithi191 bash[24992]: cluster 2024-08-31T07:36:54.531498+0000 mgr.a (mgr.14388) 14083 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:55 smithi163 bash[24253]: cluster 2024-08-31T07:36:54.531498+0000 mgr.a (mgr.14388) 14083 : cluster [DBG] pgmap v9762: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:57 smithi027 bash[22610]: cluster 2024-08-31T07:36:56.532278+0000 mgr.a (mgr.14388) 14084 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:36:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:57 smithi191 bash[24992]: cluster 2024-08-31T07:36:56.532278+0000 mgr.a (mgr.14388) 14084 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:36:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:57 smithi163 bash[24253]: cluster 2024-08-31T07:36:56.532278+0000 mgr.a (mgr.14388) 14084 : cluster [DBG] pgmap v9763: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:36:58.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:36:58.704 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:36:58.705 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:36:59.479 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:36:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:36:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:36:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:36:59.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:36:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:59 smithi027 bash[22610]: cluster 2024-08-31T07:36:58.534355+0000 mgr.a (mgr.14388) 14085 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:36:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:36:59 smithi027 bash[22610]: audit 2024-08-31T07:36:59.038662+0000 mgr.a (mgr.14388) 14086 : audit [DBG] from='client.306423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:59 smithi191 bash[24992]: cluster 2024-08-31T07:36:58.534355+0000 mgr.a (mgr.14388) 14085 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:36:59 smithi191 bash[24992]: audit 2024-08-31T07:36:59.038662+0000 mgr.a (mgr.14388) 14086 : audit [DBG] from='client.306423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:59 smithi163 bash[24253]: cluster 2024-08-31T07:36:58.534355+0000 mgr.a (mgr.14388) 14085 : cluster [DBG] pgmap v9764: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:36:59 smithi163 bash[24253]: audit 2024-08-31T07:36:59.038662+0000 mgr.a (mgr.14388) 14086 : audit [DBG] from='client.306423 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:01 smithi027 bash[22610]: cluster 2024-08-31T07:37:00.535328+0000 mgr.a (mgr.14388) 14087 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:37:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:01 smithi191 bash[24992]: cluster 2024-08-31T07:37:00.535328+0000 mgr.a (mgr.14388) 14087 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:37:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:01 smithi163 bash[24253]: cluster 2024-08-31T07:37:00.535328+0000 mgr.a (mgr.14388) 14087 : cluster [DBG] pgmap v9765: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:37:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:03 smithi027 bash[22610]: cluster 2024-08-31T07:37:02.536117+0000 mgr.a (mgr.14388) 14088 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:37:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:03 smithi191 bash[24992]: cluster 2024-08-31T07:37:02.536117+0000 mgr.a (mgr.14388) 14088 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:37:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:03 smithi163 bash[24253]: cluster 2024-08-31T07:37:02.536117+0000 mgr.a (mgr.14388) 14088 : cluster [DBG] pgmap v9766: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:37:04.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:37:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:37:04.482 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:37:05.250 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:37:05.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:37:05.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:37:05.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:37:05.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:37:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:05 smithi027 bash[22610]: cluster 2024-08-31T07:37:04.537614+0000 mgr.a (mgr.14388) 14089 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:05 smithi027 bash[22610]: audit 2024-08-31T07:37:04.818820+0000 mgr.a (mgr.14388) 14090 : audit [DBG] from='client.306498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:05 smithi191 bash[24992]: cluster 2024-08-31T07:37:04.537614+0000 mgr.a (mgr.14388) 14089 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:05 smithi191 bash[24992]: audit 2024-08-31T07:37:04.818820+0000 mgr.a (mgr.14388) 14090 : audit [DBG] from='client.306498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:05 smithi163 bash[24253]: cluster 2024-08-31T07:37:04.537614+0000 mgr.a (mgr.14388) 14089 : cluster [DBG] pgmap v9767: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:05 smithi163 bash[24253]: audit 2024-08-31T07:37:04.818820+0000 mgr.a (mgr.14388) 14090 : audit [DBG] from='client.306498 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:07 smithi027 bash[22610]: cluster 2024-08-31T07:37:06.538634+0000 mgr.a (mgr.14388) 14091 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:07 smithi191 bash[24992]: cluster 2024-08-31T07:37:06.538634+0000 mgr.a (mgr.14388) 14091 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:07 smithi163 bash[24253]: cluster 2024-08-31T07:37:06.538634+0000 mgr.a (mgr.14388) 14091 : cluster [DBG] pgmap v9768: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:09 smithi191 bash[24992]: cluster 2024-08-31T07:37:08.540966+0000 mgr.a (mgr.14388) 14092 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:09 smithi163 bash[24253]: cluster 2024-08-31T07:37:08.540966+0000 mgr.a (mgr.14388) 14092 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:09 smithi027 bash[22610]: cluster 2024-08-31T07:37:08.540966+0000 mgr.a (mgr.14388) 14092 : cluster [DBG] pgmap v9769: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:10.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:37:10.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:37:10.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:37:11.038 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:37:11.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:37:11.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:37:11.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:37:11.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:37:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:11 smithi191 bash[24992]: cluster 2024-08-31T07:37:10.541889+0000 mgr.a (mgr.14388) 14093 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:11 smithi191 bash[24992]: audit 2024-08-31T07:37:10.590795+0000 mgr.a (mgr.14388) 14094 : audit [DBG] from='client.306576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:11 smithi163 bash[24253]: cluster 2024-08-31T07:37:10.541889+0000 mgr.a (mgr.14388) 14093 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:11 smithi163 bash[24253]: audit 2024-08-31T07:37:10.590795+0000 mgr.a (mgr.14388) 14094 : audit [DBG] from='client.306576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:11 smithi027 bash[22610]: cluster 2024-08-31T07:37:10.541889+0000 mgr.a (mgr.14388) 14093 : cluster [DBG] pgmap v9770: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:11 smithi027 bash[22610]: audit 2024-08-31T07:37:10.590795+0000 mgr.a (mgr.14388) 14094 : audit [DBG] from='client.306576 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:13 smithi191 bash[24992]: cluster 2024-08-31T07:37:12.543002+0000 mgr.a (mgr.14388) 14095 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:13 smithi163 bash[24253]: cluster 2024-08-31T07:37:12.543002+0000 mgr.a (mgr.14388) 14095 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:13 smithi027 bash[22610]: cluster 2024-08-31T07:37:12.543002+0000 mgr.a (mgr.14388) 14095 : cluster [DBG] pgmap v9771: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:15 smithi191 bash[24992]: cluster 2024-08-31T07:37:14.545417+0000 mgr.a (mgr.14388) 14096 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:16.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:37:16.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:37:16.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:37:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:15 smithi163 bash[24253]: cluster 2024-08-31T07:37:14.545417+0000 mgr.a (mgr.14388) 14096 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:15 smithi027 bash[22610]: cluster 2024-08-31T07:37:14.545417+0000 mgr.a (mgr.14388) 14096 : cluster [DBG] pgmap v9772: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:16.804 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:37:16.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:37:16.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:37:16.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:37:16.804 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:37:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:17 smithi191 bash[24992]: audit 2024-08-31T07:37:16.371014+0000 mgr.a (mgr.14388) 14097 : audit [DBG] from='client.306654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:17 smithi191 bash[24992]: cluster 2024-08-31T07:37:16.545993+0000 mgr.a (mgr.14388) 14098 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:17 smithi163 bash[24253]: audit 2024-08-31T07:37:16.371014+0000 mgr.a (mgr.14388) 14097 : audit [DBG] from='client.306654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:17 smithi163 bash[24253]: cluster 2024-08-31T07:37:16.545993+0000 mgr.a (mgr.14388) 14098 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:17 smithi027 bash[22610]: audit 2024-08-31T07:37:16.371014+0000 mgr.a (mgr.14388) 14097 : audit [DBG] from='client.306654 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:17 smithi027 bash[22610]: cluster 2024-08-31T07:37:16.545993+0000 mgr.a (mgr.14388) 14098 : cluster [DBG] pgmap v9773: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:19 smithi191 bash[24992]: cluster 2024-08-31T07:37:18.548196+0000 mgr.a (mgr.14388) 14099 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:19 smithi163 bash[24253]: cluster 2024-08-31T07:37:18.548196+0000 mgr.a (mgr.14388) 14099 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:19 smithi027 bash[22610]: cluster 2024-08-31T07:37:18.548196+0000 mgr.a (mgr.14388) 14099 : cluster [DBG] pgmap v9774: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:21.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:37:21.806 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:37:21.806 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:37:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:21 smithi191 bash[24992]: cluster 2024-08-31T07:37:20.549004+0000 mgr.a (mgr.14388) 14100 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:21 smithi163 bash[24253]: cluster 2024-08-31T07:37:20.549004+0000 mgr.a (mgr.14388) 14100 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:21 smithi027 bash[22610]: cluster 2024-08-31T07:37:20.549004+0000 mgr.a (mgr.14388) 14100 : cluster [DBG] pgmap v9775: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:22.578 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:37:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:37:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:37:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:37:22.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:37:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:22 smithi191 bash[24992]: audit 2024-08-31T07:37:22.139412+0000 mgr.a (mgr.14388) 14101 : audit [DBG] from='client.306732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:22 smithi163 bash[24253]: audit 2024-08-31T07:37:22.139412+0000 mgr.a (mgr.14388) 14101 : audit [DBG] from='client.306732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:22 smithi027 bash[22610]: audit 2024-08-31T07:37:22.139412+0000 mgr.a (mgr.14388) 14101 : audit [DBG] from='client.306732 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:23 smithi191 bash[24992]: cluster 2024-08-31T07:37:22.549507+0000 mgr.a (mgr.14388) 14102 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:23 smithi163 bash[24253]: cluster 2024-08-31T07:37:22.549507+0000 mgr.a (mgr.14388) 14102 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:23 smithi027 bash[22610]: cluster 2024-08-31T07:37:22.549507+0000 mgr.a (mgr.14388) 14102 : cluster [DBG] pgmap v9776: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:25 smithi191 bash[24992]: cluster 2024-08-31T07:37:24.551710+0000 mgr.a (mgr.14388) 14103 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:25 smithi163 bash[24253]: cluster 2024-08-31T07:37:24.551710+0000 mgr.a (mgr.14388) 14103 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:25 smithi027 bash[22610]: cluster 2024-08-31T07:37:24.551710+0000 mgr.a (mgr.14388) 14103 : cluster [DBG] pgmap v9777: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:27.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:37:27.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:37:27.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:37:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:27 smithi191 bash[24992]: cluster 2024-08-31T07:37:26.552482+0000 mgr.a (mgr.14388) 14104 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:27 smithi163 bash[24253]: cluster 2024-08-31T07:37:26.552482+0000 mgr.a (mgr.14388) 14104 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:27 smithi027 bash[22610]: cluster 2024-08-31T07:37:26.552482+0000 mgr.a (mgr.14388) 14104 : cluster [DBG] pgmap v9778: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:28.356 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:37:28.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:37:28.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:37:28.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:37:28.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:37:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:28 smithi191 bash[24992]: audit 2024-08-31T07:37:27.915116+0000 mgr.a (mgr.14388) 14105 : audit [DBG] from='client.306810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:28 smithi163 bash[24253]: audit 2024-08-31T07:37:27.915116+0000 mgr.a (mgr.14388) 14105 : audit [DBG] from='client.306810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:28 smithi027 bash[22610]: audit 2024-08-31T07:37:27.915116+0000 mgr.a (mgr.14388) 14105 : audit [DBG] from='client.306810 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:29 smithi163 bash[24253]: cluster 2024-08-31T07:37:28.555382+0000 mgr.a (mgr.14388) 14106 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:29 smithi027 bash[22610]: cluster 2024-08-31T07:37:28.555382+0000 mgr.a (mgr.14388) 14106 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:29 smithi191 bash[24992]: cluster 2024-08-31T07:37:28.555382+0000 mgr.a (mgr.14388) 14106 : cluster [DBG] pgmap v9779: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:30 smithi163 bash[24253]: audit 2024-08-31T07:37:30.005161+0000 mon.a (mon.0) 2678 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:37:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:30 smithi027 bash[22610]: audit 2024-08-31T07:37:30.005161+0000 mon.a (mon.0) 2678 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:37:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:30 smithi191 bash[24992]: audit 2024-08-31T07:37:30.005161+0000 mon.a (mon.0) 2678 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:37:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:31 smithi163 bash[24253]: cluster 2024-08-31T07:37:30.556081+0000 mgr.a (mgr.14388) 14107 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:37:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:31 smithi027 bash[22610]: cluster 2024-08-31T07:37:30.556081+0000 mgr.a (mgr.14388) 14107 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:37:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:31 smithi191 bash[24992]: cluster 2024-08-31T07:37:30.556081+0000 mgr.a (mgr.14388) 14107 : cluster [DBG] pgmap v9780: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:37:33.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:37:33.359 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:37:33.359 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:37:34.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:37:34.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:37:34.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:37:34.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:37:34.102 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:37:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:33 smithi163 bash[24253]: cluster 2024-08-31T07:37:32.556838+0000 mgr.a (mgr.14388) 14108 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:37:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:33 smithi027 bash[22610]: cluster 2024-08-31T07:37:32.556838+0000 mgr.a (mgr.14388) 14108 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:37:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:33 smithi191 bash[24992]: cluster 2024-08-31T07:37:32.556838+0000 mgr.a (mgr.14388) 14108 : cluster [DBG] pgmap v9781: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:37:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:34 smithi163 bash[24253]: audit 2024-08-31T07:37:33.690023+0000 mgr.a (mgr.14388) 14109 : audit [DBG] from='client.306888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:34 smithi027 bash[22610]: audit 2024-08-31T07:37:33.690023+0000 mgr.a (mgr.14388) 14109 : audit [DBG] from='client.306888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:34 smithi191 bash[24992]: audit 2024-08-31T07:37:33.690023+0000 mgr.a (mgr.14388) 14109 : audit [DBG] from='client.306888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:35 smithi163 bash[24253]: cluster 2024-08-31T07:37:34.559694+0000 mgr.a (mgr.14388) 14110 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:35 smithi163 bash[24253]: audit 2024-08-31T07:37:35.356372+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:35 smithi163 bash[24253]: audit 2024-08-31T07:37:35.360780+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:35 smithi163 bash[24253]: audit 2024-08-31T07:37:35.377225+0000 mon.a (mon.0) 2681 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:35 smithi163 bash[24253]: audit 2024-08-31T07:37:35.383296+0000 mon.a (mon.0) 2682 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:35 smithi163 bash[24253]: audit 2024-08-31T07:37:35.389034+0000 mon.a (mon.0) 2683 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:35 smithi163 bash[24253]: audit 2024-08-31T07:37:35.394240+0000 mon.a (mon.0) 2684 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:35 smithi027 bash[22610]: cluster 2024-08-31T07:37:34.559694+0000 mgr.a (mgr.14388) 14110 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:35 smithi027 bash[22610]: audit 2024-08-31T07:37:35.356372+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:35 smithi027 bash[22610]: audit 2024-08-31T07:37:35.360780+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:35 smithi027 bash[22610]: audit 2024-08-31T07:37:35.377225+0000 mon.a (mon.0) 2681 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:35 smithi027 bash[22610]: audit 2024-08-31T07:37:35.383296+0000 mon.a (mon.0) 2682 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:35 smithi027 bash[22610]: audit 2024-08-31T07:37:35.389034+0000 mon.a (mon.0) 2683 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:35 smithi027 bash[22610]: audit 2024-08-31T07:37:35.394240+0000 mon.a (mon.0) 2684 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:35 smithi191 bash[24992]: cluster 2024-08-31T07:37:34.559694+0000 mgr.a (mgr.14388) 14110 : cluster [DBG] pgmap v9782: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:35 smithi191 bash[24992]: audit 2024-08-31T07:37:35.356372+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:35 smithi191 bash[24992]: audit 2024-08-31T07:37:35.360780+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:35 smithi191 bash[24992]: audit 2024-08-31T07:37:35.377225+0000 mon.a (mon.0) 2681 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:35 smithi191 bash[24992]: audit 2024-08-31T07:37:35.383296+0000 mon.a (mon.0) 2682 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:35 smithi191 bash[24992]: audit 2024-08-31T07:37:35.389034+0000 mon.a (mon.0) 2683 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:35 smithi191 bash[24992]: audit 2024-08-31T07:37:35.394240+0000 mon.a (mon.0) 2684 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:36 smithi163 bash[24253]: audit 2024-08-31T07:37:36.106005+0000 mon.a (mon.0) 2685 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:37:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:36 smithi163 bash[24253]: audit 2024-08-31T07:37:36.107369+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:37:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:36 smithi163 bash[24253]: audit 2024-08-31T07:37:36.116168+0000 mon.a (mon.0) 2687 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:36 smithi163 bash[24253]: audit 2024-08-31T07:37:36.118497+0000 mon.a (mon.0) 2688 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:37:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:36 smithi163 bash[24253]: audit 2024-08-31T07:37:36.120837+0000 mgr.a (mgr.14388) 14111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:37:37.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:37:36 smithi027 bash[22863]: debug 2024-08-31T07:37:36.859+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:37:37.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:37:36 smithi027 bash[22863]: debug 2024-08-31T07:37:36.859+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:37:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:36 smithi027 bash[22610]: audit 2024-08-31T07:37:36.106005+0000 mon.a (mon.0) 2685 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:37:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:36 smithi027 bash[22610]: audit 2024-08-31T07:37:36.107369+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:37:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:36 smithi027 bash[22610]: audit 2024-08-31T07:37:36.116168+0000 mon.a (mon.0) 2687 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:36 smithi027 bash[22610]: audit 2024-08-31T07:37:36.118497+0000 mon.a (mon.0) 2688 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:37:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:36 smithi027 bash[22610]: audit 2024-08-31T07:37:36.120837+0000 mgr.a (mgr.14388) 14111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:37:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:36 smithi191 bash[24992]: audit 2024-08-31T07:37:36.106005+0000 mon.a (mon.0) 2685 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:37:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:36 smithi191 bash[24992]: audit 2024-08-31T07:37:36.107369+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:37:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:36 smithi191 bash[24992]: audit 2024-08-31T07:37:36.116168+0000 mon.a (mon.0) 2687 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:37:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:36 smithi191 bash[24992]: audit 2024-08-31T07:37:36.118497+0000 mon.a (mon.0) 2688 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:37:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:36 smithi191 bash[24992]: audit 2024-08-31T07:37:36.120837+0000 mgr.a (mgr.14388) 14111 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:37:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:38 smithi163 bash[24253]: cluster 2024-08-31T07:37:36.560293+0000 mgr.a (mgr.14388) 14112 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:37:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:38 smithi163 bash[24253]: audit 2024-08-31T07:37:36.863431+0000 mgr.a (mgr.14388) 14113 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:37:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:38 smithi163 bash[24253]: cephadm 2024-08-31T07:37:36.864775+0000 mgr.a (mgr.14388) 14114 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:37:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:38 smithi027 bash[22610]: cluster 2024-08-31T07:37:36.560293+0000 mgr.a (mgr.14388) 14112 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:37:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:38 smithi027 bash[22610]: audit 2024-08-31T07:37:36.863431+0000 mgr.a (mgr.14388) 14113 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:37:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:38 smithi027 bash[22610]: cephadm 2024-08-31T07:37:36.864775+0000 mgr.a (mgr.14388) 14114 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:37:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:38 smithi191 bash[24992]: cluster 2024-08-31T07:37:36.560293+0000 mgr.a (mgr.14388) 14112 : cluster [DBG] pgmap v9783: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:37:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:38 smithi191 bash[24992]: audit 2024-08-31T07:37:36.863431+0000 mgr.a (mgr.14388) 14113 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:37:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:38 smithi191 bash[24992]: cephadm 2024-08-31T07:37:36.864775+0000 mgr.a (mgr.14388) 14114 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:37:39.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:37:39.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:37:39.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:37:39.848 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:37:39.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:37:39.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:37:39.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:37:39.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:37:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:40 smithi163 bash[24253]: cluster 2024-08-31T07:37:38.562588+0000 mgr.a (mgr.14388) 14115 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:40 smithi027 bash[22610]: cluster 2024-08-31T07:37:38.562588+0000 mgr.a (mgr.14388) 14115 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:40 smithi191 bash[24992]: cluster 2024-08-31T07:37:38.562588+0000 mgr.a (mgr.14388) 14115 : cluster [DBG] pgmap v9784: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:41 smithi163 bash[24253]: audit 2024-08-31T07:37:39.433903+0000 mgr.a (mgr.14388) 14116 : audit [DBG] from='client.307074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:41.519 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:41 smithi027 bash[22610]: audit 2024-08-31T07:37:39.433903+0000 mgr.a (mgr.14388) 14116 : audit [DBG] from='client.307074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:41 smithi191 bash[24992]: audit 2024-08-31T07:37:39.433903+0000 mgr.a (mgr.14388) 14116 : audit [DBG] from='client.307074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:42 smithi163 bash[24253]: cluster 2024-08-31T07:37:40.563622+0000 mgr.a (mgr.14388) 14117 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:42 smithi027 bash[22610]: cluster 2024-08-31T07:37:40.563622+0000 mgr.a (mgr.14388) 14117 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:42 smithi191 bash[24992]: cluster 2024-08-31T07:37:40.563622+0000 mgr.a (mgr.14388) 14117 : cluster [DBG] pgmap v9785: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:44 smithi163 bash[24253]: cluster 2024-08-31T07:37:42.564622+0000 mgr.a (mgr.14388) 14118 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:44 smithi027 bash[22610]: cluster 2024-08-31T07:37:42.564622+0000 mgr.a (mgr.14388) 14118 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:44 smithi191 bash[24992]: cluster 2024-08-31T07:37:42.564622+0000 mgr.a (mgr.14388) 14118 : cluster [DBG] pgmap v9786: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:44.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:37:44.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:37:44.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:37:45.633 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:37:45.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:37:45.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:37:45.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:37:45.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:37:46.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:46 smithi163 bash[24253]: cluster 2024-08-31T07:37:44.567005+0000 mgr.a (mgr.14388) 14119 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:46.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:46 smithi163 bash[24253]: audit 2024-08-31T07:37:45.184817+0000 mgr.a (mgr.14388) 14120 : audit [DBG] from='client.307146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:46 smithi027 bash[22610]: cluster 2024-08-31T07:37:44.567005+0000 mgr.a (mgr.14388) 14119 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:46 smithi027 bash[22610]: audit 2024-08-31T07:37:45.184817+0000 mgr.a (mgr.14388) 14120 : audit [DBG] from='client.307146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:46 smithi191 bash[24992]: cluster 2024-08-31T07:37:44.567005+0000 mgr.a (mgr.14388) 14119 : cluster [DBG] pgmap v9787: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:46 smithi191 bash[24992]: audit 2024-08-31T07:37:45.184817+0000 mgr.a (mgr.14388) 14120 : audit [DBG] from='client.307146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:48 smithi163 bash[24253]: cluster 2024-08-31T07:37:46.568093+0000 mgr.a (mgr.14388) 14121 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:48 smithi027 bash[22610]: cluster 2024-08-31T07:37:46.568093+0000 mgr.a (mgr.14388) 14121 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:48 smithi191 bash[24992]: cluster 2024-08-31T07:37:46.568093+0000 mgr.a (mgr.14388) 14121 : cluster [DBG] pgmap v9788: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:50 smithi163 bash[24253]: cluster 2024-08-31T07:37:48.570483+0000 mgr.a (mgr.14388) 14122 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:50 smithi027 bash[22610]: cluster 2024-08-31T07:37:48.570483+0000 mgr.a (mgr.14388) 14122 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:50.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:50 smithi191 bash[24992]: cluster 2024-08-31T07:37:48.570483+0000 mgr.a (mgr.14388) 14122 : cluster [DBG] pgmap v9789: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:37:50.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:37:50.635 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:37:50.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:37:51.383 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:37:51.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:37:51.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:37:51.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:37:51.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:37:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:52 smithi163 bash[24253]: cluster 2024-08-31T07:37:50.571446+0000 mgr.a (mgr.14388) 14123 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:52 smithi163 bash[24253]: audit 2024-08-31T07:37:50.958615+0000 mgr.a (mgr.14388) 14124 : audit [DBG] from='client.307221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:52 smithi027 bash[22610]: cluster 2024-08-31T07:37:50.571446+0000 mgr.a (mgr.14388) 14123 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:52 smithi027 bash[22610]: audit 2024-08-31T07:37:50.958615+0000 mgr.a (mgr.14388) 14124 : audit [DBG] from='client.307221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:52 smithi191 bash[24992]: cluster 2024-08-31T07:37:50.571446+0000 mgr.a (mgr.14388) 14123 : cluster [DBG] pgmap v9790: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:52 smithi191 bash[24992]: audit 2024-08-31T07:37:50.958615+0000 mgr.a (mgr.14388) 14124 : audit [DBG] from='client.307221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:54 smithi163 bash[24253]: cluster 2024-08-31T07:37:52.572366+0000 mgr.a (mgr.14388) 14125 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:54 smithi027 bash[22610]: cluster 2024-08-31T07:37:52.572366+0000 mgr.a (mgr.14388) 14125 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:54 smithi191 bash[24992]: cluster 2024-08-31T07:37:52.572366+0000 mgr.a (mgr.14388) 14125 : cluster [DBG] pgmap v9791: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:56.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:37:56.385 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:37:56.385 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:37:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:56 smithi163 bash[24253]: cluster 2024-08-31T07:37:54.574579+0000 mgr.a (mgr.14388) 14126 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:56 smithi027 bash[22610]: cluster 2024-08-31T07:37:54.574579+0000 mgr.a (mgr.14388) 14126 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:56 smithi191 bash[24992]: cluster 2024-08-31T07:37:54.574579+0000 mgr.a (mgr.14388) 14126 : cluster [DBG] pgmap v9792: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:37:57.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:37:57.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:37:57.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:37:57.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:37:57.136 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:37:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:58 smithi163 bash[24253]: cluster 2024-08-31T07:37:56.575030+0000 mgr.a (mgr.14388) 14127 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:37:58 smithi163 bash[24253]: audit 2024-08-31T07:37:56.713758+0000 mgr.a (mgr.14388) 14128 : audit [DBG] from='client.307296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:58 smithi027 bash[22610]: cluster 2024-08-31T07:37:56.575030+0000 mgr.a (mgr.14388) 14127 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:37:58 smithi027 bash[22610]: audit 2024-08-31T07:37:56.713758+0000 mgr.a (mgr.14388) 14128 : audit [DBG] from='client.307296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:37:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:58 smithi191 bash[24992]: cluster 2024-08-31T07:37:56.575030+0000 mgr.a (mgr.14388) 14127 : cluster [DBG] pgmap v9793: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:37:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:37:58 smithi191 bash[24992]: audit 2024-08-31T07:37:56.713758+0000 mgr.a (mgr.14388) 14128 : audit [DBG] from='client.307296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:00 smithi163 bash[24253]: cluster 2024-08-31T07:37:58.577316+0000 mgr.a (mgr.14388) 14129 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:00 smithi027 bash[22610]: cluster 2024-08-31T07:37:58.577316+0000 mgr.a (mgr.14388) 14129 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:00 smithi191 bash[24992]: cluster 2024-08-31T07:37:58.577316+0000 mgr.a (mgr.14388) 14129 : cluster [DBG] pgmap v9794: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:02.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:02.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:02.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:38:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:02 smithi163 bash[24253]: cluster 2024-08-31T07:38:00.578090+0000 mgr.a (mgr.14388) 14130 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:02 smithi027 bash[22610]: cluster 2024-08-31T07:38:00.578090+0000 mgr.a (mgr.14388) 14130 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:02 smithi191 bash[24992]: cluster 2024-08-31T07:38:00.578090+0000 mgr.a (mgr.14388) 14130 : cluster [DBG] pgmap v9795: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:02.923 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:38:02.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:38:02.923 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:38:02.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:38:02.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:38:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:04 smithi163 bash[24253]: audit 2024-08-31T07:38:02.471194+0000 mgr.a (mgr.14388) 14131 : audit [DBG] from='client.307371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:04 smithi163 bash[24253]: cluster 2024-08-31T07:38:02.578587+0000 mgr.a (mgr.14388) 14132 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:04 smithi027 bash[22610]: audit 2024-08-31T07:38:02.471194+0000 mgr.a (mgr.14388) 14131 : audit [DBG] from='client.307371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:04 smithi027 bash[22610]: cluster 2024-08-31T07:38:02.578587+0000 mgr.a (mgr.14388) 14132 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:04 smithi191 bash[24992]: audit 2024-08-31T07:38:02.471194+0000 mgr.a (mgr.14388) 14131 : audit [DBG] from='client.307371 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:04 smithi191 bash[24992]: cluster 2024-08-31T07:38:02.578587+0000 mgr.a (mgr.14388) 14132 : cluster [DBG] pgmap v9796: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:06 smithi163 bash[24253]: cluster 2024-08-31T07:38:04.580930+0000 mgr.a (mgr.14388) 14133 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:06 smithi027 bash[22610]: cluster 2024-08-31T07:38:04.580930+0000 mgr.a (mgr.14388) 14133 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:06 smithi191 bash[24992]: cluster 2024-08-31T07:38:04.580930+0000 mgr.a (mgr.14388) 14133 : cluster [DBG] pgmap v9797: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:07.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:07.928 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:07.928 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:38:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:08 smithi163 bash[24253]: cluster 2024-08-31T07:38:06.581855+0000 mgr.a (mgr.14388) 14134 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:08 smithi027 bash[22610]: cluster 2024-08-31T07:38:06.581855+0000 mgr.a (mgr.14388) 14134 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:08 smithi191 bash[24992]: cluster 2024-08-31T07:38:06.581855+0000 mgr.a (mgr.14388) 14134 : cluster [DBG] pgmap v9798: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:08.683 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:38:08.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:38:08.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:38:08.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:38:08.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:38:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:10 smithi163 bash[24253]: audit 2024-08-31T07:38:08.261904+0000 mgr.a (mgr.14388) 14135 : audit [DBG] from='client.307449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:10 smithi163 bash[24253]: cluster 2024-08-31T07:38:08.589399+0000 mgr.a (mgr.14388) 14136 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:10 smithi027 bash[22610]: audit 2024-08-31T07:38:08.261904+0000 mgr.a (mgr.14388) 14135 : audit [DBG] from='client.307449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:10 smithi027 bash[22610]: cluster 2024-08-31T07:38:08.589399+0000 mgr.a (mgr.14388) 14136 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:10 smithi191 bash[24992]: audit 2024-08-31T07:38:08.261904+0000 mgr.a (mgr.14388) 14135 : audit [DBG] from='client.307449 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:10 smithi191 bash[24992]: cluster 2024-08-31T07:38:08.589399+0000 mgr.a (mgr.14388) 14136 : cluster [DBG] pgmap v9799: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:12 smithi163 bash[24253]: cluster 2024-08-31T07:38:10.590153+0000 mgr.a (mgr.14388) 14137 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:38:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:12 smithi027 bash[22610]: cluster 2024-08-31T07:38:10.590153+0000 mgr.a (mgr.14388) 14137 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:38:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:12 smithi191 bash[24992]: cluster 2024-08-31T07:38:10.590153+0000 mgr.a (mgr.14388) 14137 : cluster [DBG] pgmap v9800: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:38:13.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:13.685 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:13.685 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:38:14.461 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:38:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:38:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:38:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:38:14.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:38:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:14 smithi027 bash[22610]: cluster 2024-08-31T07:38:12.590965+0000 mgr.a (mgr.14388) 14138 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:38:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:14 smithi191 bash[24992]: cluster 2024-08-31T07:38:12.590965+0000 mgr.a (mgr.14388) 14138 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:38:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:14 smithi163 bash[24253]: cluster 2024-08-31T07:38:12.590965+0000 mgr.a (mgr.14388) 14138 : cluster [DBG] pgmap v9801: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:38:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:15 smithi027 bash[22610]: audit 2024-08-31T07:38:14.018850+0000 mgr.a (mgr.14388) 14139 : audit [DBG] from='client.307527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:15 smithi191 bash[24992]: audit 2024-08-31T07:38:14.018850+0000 mgr.a (mgr.14388) 14139 : audit [DBG] from='client.307527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:15 smithi163 bash[24253]: audit 2024-08-31T07:38:14.018850+0000 mgr.a (mgr.14388) 14139 : audit [DBG] from='client.307527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:16 smithi027 bash[22610]: cluster 2024-08-31T07:38:14.593714+0000 mgr.a (mgr.14388) 14140 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:16 smithi191 bash[24992]: cluster 2024-08-31T07:38:14.593714+0000 mgr.a (mgr.14388) 14140 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:16 smithi163 bash[24253]: cluster 2024-08-31T07:38:14.593714+0000 mgr.a (mgr.14388) 14140 : cluster [DBG] pgmap v9802: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:18 smithi027 bash[22610]: cluster 2024-08-31T07:38:16.594501+0000 mgr.a (mgr.14388) 14141 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:38:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:18 smithi191 bash[24992]: cluster 2024-08-31T07:38:16.594501+0000 mgr.a (mgr.14388) 14141 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:38:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:18 smithi163 bash[24253]: cluster 2024-08-31T07:38:16.594501+0000 mgr.a (mgr.14388) 14141 : cluster [DBG] pgmap v9803: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:38:19.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:19.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:19.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:38:20.225 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:38:20.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:38:20.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:38:20.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:38:20.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:38:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:20 smithi027 bash[22610]: cluster 2024-08-31T07:38:18.596475+0000 mgr.a (mgr.14388) 14142 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:20 smithi191 bash[24992]: cluster 2024-08-31T07:38:18.596475+0000 mgr.a (mgr.14388) 14142 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:20 smithi163 bash[24253]: cluster 2024-08-31T07:38:18.596475+0000 mgr.a (mgr.14388) 14142 : cluster [DBG] pgmap v9804: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:21 smithi027 bash[22610]: audit 2024-08-31T07:38:19.795942+0000 mgr.a (mgr.14388) 14143 : audit [DBG] from='client.307605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:21 smithi027 bash[22610]: cluster 2024-08-31T07:38:20.597398+0000 mgr.a (mgr.14388) 14144 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:21 smithi191 bash[24992]: audit 2024-08-31T07:38:19.795942+0000 mgr.a (mgr.14388) 14143 : audit [DBG] from='client.307605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:21 smithi191 bash[24992]: cluster 2024-08-31T07:38:20.597398+0000 mgr.a (mgr.14388) 14144 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:21 smithi163 bash[24253]: audit 2024-08-31T07:38:19.795942+0000 mgr.a (mgr.14388) 14143 : audit [DBG] from='client.307605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:21 smithi163 bash[24253]: cluster 2024-08-31T07:38:20.597398+0000 mgr.a (mgr.14388) 14144 : cluster [DBG] pgmap v9805: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:23 smithi163 bash[24253]: cluster 2024-08-31T07:38:22.598219+0000 mgr.a (mgr.14388) 14145 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:23 smithi027 bash[22610]: cluster 2024-08-31T07:38:22.598219+0000 mgr.a (mgr.14388) 14145 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:23 smithi191 bash[24992]: cluster 2024-08-31T07:38:22.598219+0000 mgr.a (mgr.14388) 14145 : cluster [DBG] pgmap v9806: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:25.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:25.228 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:25.228 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:38:25.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:25 smithi163 bash[24253]: cluster 2024-08-31T07:38:24.600444+0000 mgr.a (mgr.14388) 14146 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:25.975 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:38:25.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:38:25.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:38:25.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:38:25.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:38:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:25 smithi027 bash[22610]: cluster 2024-08-31T07:38:24.600444+0000 mgr.a (mgr.14388) 14146 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:25 smithi191 bash[24992]: cluster 2024-08-31T07:38:24.600444+0000 mgr.a (mgr.14388) 14146 : cluster [DBG] pgmap v9807: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:26 smithi163 bash[24253]: audit 2024-08-31T07:38:25.558289+0000 mgr.a (mgr.14388) 14147 : audit [DBG] from='client.307680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:26 smithi027 bash[22610]: audit 2024-08-31T07:38:25.558289+0000 mgr.a (mgr.14388) 14147 : audit [DBG] from='client.307680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:26 smithi191 bash[24992]: audit 2024-08-31T07:38:25.558289+0000 mgr.a (mgr.14388) 14147 : audit [DBG] from='client.307680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:27 smithi163 bash[24253]: cluster 2024-08-31T07:38:26.601479+0000 mgr.a (mgr.14388) 14148 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:27 smithi027 bash[22610]: cluster 2024-08-31T07:38:26.601479+0000 mgr.a (mgr.14388) 14148 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:27 smithi191 bash[24992]: cluster 2024-08-31T07:38:26.601479+0000 mgr.a (mgr.14388) 14148 : cluster [DBG] pgmap v9808: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:29 smithi163 bash[24253]: cluster 2024-08-31T07:38:28.603801+0000 mgr.a (mgr.14388) 14149 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:29 smithi027 bash[22610]: cluster 2024-08-31T07:38:28.603801+0000 mgr.a (mgr.14388) 14149 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:29 smithi191 bash[24992]: cluster 2024-08-31T07:38:28.603801+0000 mgr.a (mgr.14388) 14149 : cluster [DBG] pgmap v9809: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:30.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:30.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:30.978 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:38:31.737 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:38:31.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:38:31.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:38:31.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:38:31.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:38:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:31 smithi163 bash[24253]: cluster 2024-08-31T07:38:30.604702+0000 mgr.a (mgr.14388) 14150 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:31 smithi027 bash[22610]: cluster 2024-08-31T07:38:30.604702+0000 mgr.a (mgr.14388) 14150 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:31 smithi191 bash[24992]: cluster 2024-08-31T07:38:30.604702+0000 mgr.a (mgr.14388) 14150 : cluster [DBG] pgmap v9810: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:32 smithi163 bash[24253]: audit 2024-08-31T07:38:31.310058+0000 mgr.a (mgr.14388) 14151 : audit [DBG] from='client.307758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:32 smithi027 bash[22610]: audit 2024-08-31T07:38:31.310058+0000 mgr.a (mgr.14388) 14151 : audit [DBG] from='client.307758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:32 smithi191 bash[24992]: audit 2024-08-31T07:38:31.310058+0000 mgr.a (mgr.14388) 14151 : audit [DBG] from='client.307758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:33 smithi163 bash[24253]: cluster 2024-08-31T07:38:32.605612+0000 mgr.a (mgr.14388) 14152 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:33.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:33 smithi027 bash[22610]: cluster 2024-08-31T07:38:32.605612+0000 mgr.a (mgr.14388) 14152 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:33 smithi191 bash[24992]: cluster 2024-08-31T07:38:32.605612+0000 mgr.a (mgr.14388) 14152 : cluster [DBG] pgmap v9811: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:35 smithi163 bash[24253]: cluster 2024-08-31T07:38:34.607898+0000 mgr.a (mgr.14388) 14153 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:35.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:35 smithi027 bash[22610]: cluster 2024-08-31T07:38:34.607898+0000 mgr.a (mgr.14388) 14153 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:35 smithi191 bash[24992]: cluster 2024-08-31T07:38:34.607898+0000 mgr.a (mgr.14388) 14153 : cluster [DBG] pgmap v9812: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:38:36.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:36.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:36.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:38:37.591 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:38:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:38:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:38:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:38:37.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:38:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:37 smithi163 bash[24253]: cluster 2024-08-31T07:38:36.608675+0000 mgr.a (mgr.14388) 14154 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:37 smithi163 bash[24253]: audit 2024-08-31T07:38:36.914326+0000 mon.a (mon.0) 2689 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:38:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:37 smithi163 bash[24253]: audit 2024-08-31T07:38:37.106273+0000 mgr.a (mgr.14388) 14155 : audit [DBG] from='client.307833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:37 smithi027 bash[22610]: cluster 2024-08-31T07:38:36.608675+0000 mgr.a (mgr.14388) 14154 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:37 smithi027 bash[22610]: audit 2024-08-31T07:38:36.914326+0000 mon.a (mon.0) 2689 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:38:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:37 smithi027 bash[22610]: audit 2024-08-31T07:38:37.106273+0000 mgr.a (mgr.14388) 14155 : audit [DBG] from='client.307833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:37 smithi191 bash[24992]: cluster 2024-08-31T07:38:36.608675+0000 mgr.a (mgr.14388) 14154 : cluster [DBG] pgmap v9813: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:37 smithi191 bash[24992]: audit 2024-08-31T07:38:36.914326+0000 mon.a (mon.0) 2689 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:38:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:37 smithi191 bash[24992]: audit 2024-08-31T07:38:37.106273+0000 mgr.a (mgr.14388) 14155 : audit [DBG] from='client.307833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:38.700 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:38:38 smithi027 bash[22863]: debug 2024-08-31T07:38:38.433+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:38:38.700 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:38:38 smithi027 bash[22863]: debug 2024-08-31T07:38:38.433+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:38:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:38 smithi027 bash[22610]: audit 2024-08-31T07:38:37.707018+0000 mon.a (mon.0) 2690 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:38:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:38 smithi027 bash[22610]: audit 2024-08-31T07:38:37.708222+0000 mon.a (mon.0) 2691 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:38:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:38 smithi027 bash[22610]: audit 2024-08-31T07:38:37.715828+0000 mon.a (mon.0) 2692 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:38:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:38 smithi027 bash[22610]: audit 2024-08-31T07:38:37.718286+0000 mon.a (mon.0) 2693 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:38:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:38 smithi027 bash[22610]: audit 2024-08-31T07:38:37.720980+0000 mgr.a (mgr.14388) 14156 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:38:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:38 smithi191 bash[24992]: audit 2024-08-31T07:38:37.707018+0000 mon.a (mon.0) 2690 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:38:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:38 smithi191 bash[24992]: audit 2024-08-31T07:38:37.708222+0000 mon.a (mon.0) 2691 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:38:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:38 smithi191 bash[24992]: audit 2024-08-31T07:38:37.715828+0000 mon.a (mon.0) 2692 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:38:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:38 smithi191 bash[24992]: audit 2024-08-31T07:38:37.718286+0000 mon.a (mon.0) 2693 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:38:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:38 smithi191 bash[24992]: audit 2024-08-31T07:38:37.720980+0000 mgr.a (mgr.14388) 14156 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:38:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:38 smithi163 bash[24253]: audit 2024-08-31T07:38:37.707018+0000 mon.a (mon.0) 2690 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:38:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:38 smithi163 bash[24253]: audit 2024-08-31T07:38:37.708222+0000 mon.a (mon.0) 2691 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:38:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:38 smithi163 bash[24253]: audit 2024-08-31T07:38:37.715828+0000 mon.a (mon.0) 2692 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:38:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:38 smithi163 bash[24253]: audit 2024-08-31T07:38:37.718286+0000 mon.a (mon.0) 2693 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:38:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:38 smithi163 bash[24253]: audit 2024-08-31T07:38:37.720980+0000 mgr.a (mgr.14388) 14156 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:38:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:39 smithi027 bash[22610]: audit 2024-08-31T07:38:38.434912+0000 mgr.a (mgr.14388) 14157 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:38:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:39 smithi027 bash[22610]: cephadm 2024-08-31T07:38:38.436113+0000 mgr.a (mgr.14388) 14158 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:38:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:39 smithi027 bash[22610]: cluster 2024-08-31T07:38:38.611334+0000 mgr.a (mgr.14388) 14159 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-08-31T07:38:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:39 smithi191 bash[24992]: audit 2024-08-31T07:38:38.434912+0000 mgr.a (mgr.14388) 14157 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:38:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:39 smithi191 bash[24992]: cephadm 2024-08-31T07:38:38.436113+0000 mgr.a (mgr.14388) 14158 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:38:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:39 smithi191 bash[24992]: cluster 2024-08-31T07:38:38.611334+0000 mgr.a (mgr.14388) 14159 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-08-31T07:38:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:39 smithi163 bash[24253]: audit 2024-08-31T07:38:38.434912+0000 mgr.a (mgr.14388) 14157 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:38:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:39 smithi163 bash[24253]: cephadm 2024-08-31T07:38:38.436113+0000 mgr.a (mgr.14388) 14158 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:38:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:39 smithi163 bash[24253]: cluster 2024-08-31T07:38:38.611334+0000 mgr.a (mgr.14388) 14159 : cluster [DBG] pgmap v9814: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 3 op/s 2024-08-31T07:38:41.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:41 smithi027 bash[22610]: cluster 2024-08-31T07:38:40.612089+0000 mgr.a (mgr.14388) 14160 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:38:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:41 smithi191 bash[24992]: cluster 2024-08-31T07:38:40.612089+0000 mgr.a (mgr.14388) 14160 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:38:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:41 smithi163 bash[24253]: cluster 2024-08-31T07:38:40.612089+0000 mgr.a (mgr.14388) 14160 : cluster [DBG] pgmap v9815: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:38:42.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:42.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:42.593 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:38:43.363 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:38:43.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:38:43.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:38:43.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:38:43.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:38:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:43 smithi027 bash[22610]: cluster 2024-08-31T07:38:42.612850+0000 mgr.a (mgr.14388) 14161 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:38:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:43 smithi027 bash[22610]: audit 2024-08-31T07:38:42.927582+0000 mgr.a (mgr.14388) 14162 : audit [DBG] from='client.308013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:43 smithi191 bash[24992]: cluster 2024-08-31T07:38:42.612850+0000 mgr.a (mgr.14388) 14161 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:38:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:43 smithi191 bash[24992]: audit 2024-08-31T07:38:42.927582+0000 mgr.a (mgr.14388) 14162 : audit [DBG] from='client.308013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:43 smithi163 bash[24253]: cluster 2024-08-31T07:38:42.612850+0000 mgr.a (mgr.14388) 14161 : cluster [DBG] pgmap v9816: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:38:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:43 smithi163 bash[24253]: audit 2024-08-31T07:38:42.927582+0000 mgr.a (mgr.14388) 14162 : audit [DBG] from='client.308013 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:45 smithi027 bash[22610]: cluster 2024-08-31T07:38:44.615619+0000 mgr.a (mgr.14388) 14163 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:38:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:45 smithi191 bash[24992]: cluster 2024-08-31T07:38:44.615619+0000 mgr.a (mgr.14388) 14163 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:38:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:45 smithi163 bash[24253]: cluster 2024-08-31T07:38:44.615619+0000 mgr.a (mgr.14388) 14163 : cluster [DBG] pgmap v9817: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:38:47.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:47 smithi027 bash[22610]: cluster 2024-08-31T07:38:46.616416+0000 mgr.a (mgr.14388) 14164 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:38:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:47 smithi191 bash[24992]: cluster 2024-08-31T07:38:46.616416+0000 mgr.a (mgr.14388) 14164 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:38:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:47 smithi163 bash[24253]: cluster 2024-08-31T07:38:46.616416+0000 mgr.a (mgr.14388) 14164 : cluster [DBG] pgmap v9818: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:38:48.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:48.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:48.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:38:49.108 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:38:49.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:38:49.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:38:49.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:38:49.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:38:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:49 smithi191 bash[24992]: cluster 2024-08-31T07:38:48.617562+0000 mgr.a (mgr.14388) 14165 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:38:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:49 smithi191 bash[24992]: audit 2024-08-31T07:38:48.695159+0000 mgr.a (mgr.14388) 14166 : audit [DBG] from='client.308088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:49 smithi163 bash[24253]: cluster 2024-08-31T07:38:48.617562+0000 mgr.a (mgr.14388) 14165 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:38:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:49 smithi163 bash[24253]: audit 2024-08-31T07:38:48.695159+0000 mgr.a (mgr.14388) 14166 : audit [DBG] from='client.308088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:49 smithi027 bash[22610]: cluster 2024-08-31T07:38:48.617562+0000 mgr.a (mgr.14388) 14165 : cluster [DBG] pgmap v9819: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:38:50.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:49 smithi027 bash[22610]: audit 2024-08-31T07:38:48.695159+0000 mgr.a (mgr.14388) 14166 : audit [DBG] from='client.308088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:51 smithi191 bash[24992]: cluster 2024-08-31T07:38:50.618416+0000 mgr.a (mgr.14388) 14167 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T07:38:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:51 smithi163 bash[24253]: cluster 2024-08-31T07:38:50.618416+0000 mgr.a (mgr.14388) 14167 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T07:38:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:51 smithi027 bash[22610]: cluster 2024-08-31T07:38:50.618416+0000 mgr.a (mgr.14388) 14167 : cluster [DBG] pgmap v9820: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T07:38:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:53 smithi191 bash[24992]: cluster 2024-08-31T07:38:52.619190+0000 mgr.a (mgr.14388) 14168 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T07:38:54.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:54.110 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:54.110 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:38:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:53 smithi163 bash[24253]: cluster 2024-08-31T07:38:52.619190+0000 mgr.a (mgr.14388) 14168 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T07:38:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:53 smithi027 bash[22610]: cluster 2024-08-31T07:38:52.619190+0000 mgr.a (mgr.14388) 14168 : cluster [DBG] pgmap v9821: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T07:38:54.887 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:38:54.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:38:54.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:38:54.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:38:54.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:38:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:55 smithi191 bash[24992]: audit 2024-08-31T07:38:54.441954+0000 mgr.a (mgr.14388) 14169 : audit [DBG] from='client.308166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:55 smithi191 bash[24992]: cluster 2024-08-31T07:38:54.620503+0000 mgr.a (mgr.14388) 14170 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:38:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:55 smithi163 bash[24253]: audit 2024-08-31T07:38:54.441954+0000 mgr.a (mgr.14388) 14169 : audit [DBG] from='client.308166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:55 smithi163 bash[24253]: cluster 2024-08-31T07:38:54.620503+0000 mgr.a (mgr.14388) 14170 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:38:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:55 smithi027 bash[22610]: audit 2024-08-31T07:38:54.441954+0000 mgr.a (mgr.14388) 14169 : audit [DBG] from='client.308166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:38:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:55 smithi027 bash[22610]: cluster 2024-08-31T07:38:54.620503+0000 mgr.a (mgr.14388) 14170 : cluster [DBG] pgmap v9822: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:38:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:57 smithi191 bash[24992]: cluster 2024-08-31T07:38:56.621449+0000 mgr.a (mgr.14388) 14171 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:57 smithi163 bash[24253]: cluster 2024-08-31T07:38:56.621449+0000 mgr.a (mgr.14388) 14171 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:57 smithi027 bash[22610]: cluster 2024-08-31T07:38:56.621449+0000 mgr.a (mgr.14388) 14171 : cluster [DBG] pgmap v9823: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:38:59.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:38:59.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:38:59.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:38:59 smithi191 bash[24992]: cluster 2024-08-31T07:38:58.623596+0000 mgr.a (mgr.14388) 14172 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:38:59 smithi163 bash[24253]: cluster 2024-08-31T07:38:58.623596+0000 mgr.a (mgr.14388) 14172 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:38:59 smithi027 bash[22610]: cluster 2024-08-31T07:38:58.623596+0000 mgr.a (mgr.14388) 14172 : cluster [DBG] pgmap v9824: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:00.650 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:00.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:00.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:00.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:00.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:00 smithi191 bash[24992]: audit 2024-08-31T07:39:00.222535+0000 mgr.a (mgr.14388) 14173 : audit [DBG] from='client.308244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:00 smithi163 bash[24253]: audit 2024-08-31T07:39:00.222535+0000 mgr.a (mgr.14388) 14173 : audit [DBG] from='client.308244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:00 smithi027 bash[22610]: audit 2024-08-31T07:39:00.222535+0000 mgr.a (mgr.14388) 14173 : audit [DBG] from='client.308244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:01 smithi191 bash[24992]: cluster 2024-08-31T07:39:00.624172+0000 mgr.a (mgr.14388) 14174 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:01 smithi163 bash[24253]: cluster 2024-08-31T07:39:00.624172+0000 mgr.a (mgr.14388) 14174 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:01 smithi027 bash[22610]: cluster 2024-08-31T07:39:00.624172+0000 mgr.a (mgr.14388) 14174 : cluster [DBG] pgmap v9825: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:03 smithi191 bash[24992]: cluster 2024-08-31T07:39:02.625075+0000 mgr.a (mgr.14388) 14175 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:03 smithi163 bash[24253]: cluster 2024-08-31T07:39:02.625075+0000 mgr.a (mgr.14388) 14175 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:03 smithi027 bash[22610]: cluster 2024-08-31T07:39:02.625075+0000 mgr.a (mgr.14388) 14175 : cluster [DBG] pgmap v9826: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:05.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:39:05.653 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:39:05.653 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:05 smithi191 bash[24992]: cluster 2024-08-31T07:39:04.627285+0000 mgr.a (mgr.14388) 14176 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:05 smithi163 bash[24253]: cluster 2024-08-31T07:39:04.627285+0000 mgr.a (mgr.14388) 14176 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:05 smithi027 bash[22610]: cluster 2024-08-31T07:39:04.627285+0000 mgr.a (mgr.14388) 14176 : cluster [DBG] pgmap v9827: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:06.437 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:06.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:06.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:06.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:06.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:06 smithi191 bash[24992]: audit 2024-08-31T07:39:05.994041+0000 mgr.a (mgr.14388) 14177 : audit [DBG] from='client.308319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:06 smithi163 bash[24253]: audit 2024-08-31T07:39:05.994041+0000 mgr.a (mgr.14388) 14177 : audit [DBG] from='client.308319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:06 smithi027 bash[22610]: audit 2024-08-31T07:39:05.994041+0000 mgr.a (mgr.14388) 14177 : audit [DBG] from='client.308319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:07 smithi163 bash[24253]: cluster 2024-08-31T07:39:06.628400+0000 mgr.a (mgr.14388) 14178 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:07 smithi027 bash[22610]: cluster 2024-08-31T07:39:06.628400+0000 mgr.a (mgr.14388) 14178 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:07 smithi191 bash[24992]: cluster 2024-08-31T07:39:06.628400+0000 mgr.a (mgr.14388) 14178 : cluster [DBG] pgmap v9828: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:09 smithi163 bash[24253]: cluster 2024-08-31T07:39:08.630587+0000 mgr.a (mgr.14388) 14179 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:09 smithi027 bash[22610]: cluster 2024-08-31T07:39:08.630587+0000 mgr.a (mgr.14388) 14179 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:09 smithi191 bash[24992]: cluster 2024-08-31T07:39:08.630587+0000 mgr.a (mgr.14388) 14179 : cluster [DBG] pgmap v9829: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:11.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:39:11.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:39:11.440 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:11 smithi163 bash[24253]: cluster 2024-08-31T07:39:10.631367+0000 mgr.a (mgr.14388) 14180 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:12.214 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:12.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:12.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:12.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:12.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:11 smithi027 bash[22610]: cluster 2024-08-31T07:39:10.631367+0000 mgr.a (mgr.14388) 14180 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:11 smithi191 bash[24992]: cluster 2024-08-31T07:39:10.631367+0000 mgr.a (mgr.14388) 14180 : cluster [DBG] pgmap v9830: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:12 smithi163 bash[24253]: audit 2024-08-31T07:39:11.778021+0000 mgr.a (mgr.14388) 14181 : audit [DBG] from='client.308397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:12 smithi027 bash[22610]: audit 2024-08-31T07:39:11.778021+0000 mgr.a (mgr.14388) 14181 : audit [DBG] from='client.308397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:12 smithi191 bash[24992]: audit 2024-08-31T07:39:11.778021+0000 mgr.a (mgr.14388) 14181 : audit [DBG] from='client.308397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:13 smithi163 bash[24253]: cluster 2024-08-31T07:39:12.632344+0000 mgr.a (mgr.14388) 14182 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:13 smithi027 bash[22610]: cluster 2024-08-31T07:39:12.632344+0000 mgr.a (mgr.14388) 14182 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:13 smithi191 bash[24992]: cluster 2024-08-31T07:39:12.632344+0000 mgr.a (mgr.14388) 14182 : cluster [DBG] pgmap v9831: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:15 smithi163 bash[24253]: cluster 2024-08-31T07:39:14.634668+0000 mgr.a (mgr.14388) 14183 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:15 smithi027 bash[22610]: cluster 2024-08-31T07:39:14.634668+0000 mgr.a (mgr.14388) 14183 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:15 smithi191 bash[24992]: cluster 2024-08-31T07:39:14.634668+0000 mgr.a (mgr.14388) 14183 : cluster [DBG] pgmap v9832: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:17.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:39:17.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:39:17.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:17.974 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:17.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:17.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:17.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:17.974 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:17 smithi163 bash[24253]: cluster 2024-08-31T07:39:16.635616+0000 mgr.a (mgr.14388) 14184 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:17 smithi027 bash[22610]: cluster 2024-08-31T07:39:16.635616+0000 mgr.a (mgr.14388) 14184 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:17 smithi191 bash[24992]: cluster 2024-08-31T07:39:16.635616+0000 mgr.a (mgr.14388) 14184 : cluster [DBG] pgmap v9833: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:18 smithi163 bash[24253]: audit 2024-08-31T07:39:17.547480+0000 mgr.a (mgr.14388) 14185 : audit [DBG] from='client.308475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:19.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:18 smithi027 bash[22610]: audit 2024-08-31T07:39:17.547480+0000 mgr.a (mgr.14388) 14185 : audit [DBG] from='client.308475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:19.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:18 smithi191 bash[24992]: audit 2024-08-31T07:39:17.547480+0000 mgr.a (mgr.14388) 14185 : audit [DBG] from='client.308475 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:19 smithi163 bash[24253]: cluster 2024-08-31T07:39:18.637907+0000 mgr.a (mgr.14388) 14186 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:19 smithi027 bash[22610]: cluster 2024-08-31T07:39:18.637907+0000 mgr.a (mgr.14388) 14186 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:19 smithi191 bash[24992]: cluster 2024-08-31T07:39:18.637907+0000 mgr.a (mgr.14388) 14186 : cluster [DBG] pgmap v9834: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:21 smithi163 bash[24253]: cluster 2024-08-31T07:39:20.638756+0000 mgr.a (mgr.14388) 14187 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:21 smithi027 bash[22610]: cluster 2024-08-31T07:39:20.638756+0000 mgr.a (mgr.14388) 14187 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:21 smithi191 bash[24992]: cluster 2024-08-31T07:39:20.638756+0000 mgr.a (mgr.14388) 14187 : cluster [DBG] pgmap v9835: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:22.975 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:39:22.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:39:22.976 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:23.763 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:23.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:23.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:23.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:23.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:23 smithi163 bash[24253]: cluster 2024-08-31T07:39:22.639515+0000 mgr.a (mgr.14388) 14188 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:23 smithi027 bash[22610]: cluster 2024-08-31T07:39:22.639515+0000 mgr.a (mgr.14388) 14188 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:23 smithi191 bash[24992]: cluster 2024-08-31T07:39:22.639515+0000 mgr.a (mgr.14388) 14188 : cluster [DBG] pgmap v9836: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:24 smithi163 bash[24253]: audit 2024-08-31T07:39:23.313778+0000 mgr.a (mgr.14388) 14189 : audit [DBG] from='client.308544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:24 smithi027 bash[22610]: audit 2024-08-31T07:39:23.313778+0000 mgr.a (mgr.14388) 14189 : audit [DBG] from='client.308544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:24 smithi191 bash[24992]: audit 2024-08-31T07:39:23.313778+0000 mgr.a (mgr.14388) 14189 : audit [DBG] from='client.308544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:25 smithi163 bash[24253]: cluster 2024-08-31T07:39:24.642461+0000 mgr.a (mgr.14388) 14190 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:25 smithi027 bash[22610]: cluster 2024-08-31T07:39:24.642461+0000 mgr.a (mgr.14388) 14190 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:25 smithi191 bash[24992]: cluster 2024-08-31T07:39:24.642461+0000 mgr.a (mgr.14388) 14190 : cluster [DBG] pgmap v9837: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:27 smithi163 bash[24253]: cluster 2024-08-31T07:39:26.643452+0000 mgr.a (mgr.14388) 14191 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:39:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:27 smithi027 bash[22610]: cluster 2024-08-31T07:39:26.643452+0000 mgr.a (mgr.14388) 14191 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:39:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:27 smithi191 bash[24992]: cluster 2024-08-31T07:39:26.643452+0000 mgr.a (mgr.14388) 14191 : cluster [DBG] pgmap v9838: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:39:28.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:39:28.765 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:39:28.765 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:29.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:29.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:29.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:29.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:29.526 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:29 smithi163 bash[24253]: cluster 2024-08-31T07:39:28.645388+0000 mgr.a (mgr.14388) 14192 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:29 smithi163 bash[24253]: audit 2024-08-31T07:39:29.093678+0000 mgr.a (mgr.14388) 14193 : audit [DBG] from='client.308619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:29 smithi027 bash[22610]: cluster 2024-08-31T07:39:28.645388+0000 mgr.a (mgr.14388) 14192 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:29 smithi027 bash[22610]: audit 2024-08-31T07:39:29.093678+0000 mgr.a (mgr.14388) 14193 : audit [DBG] from='client.308619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:29 smithi191 bash[24992]: cluster 2024-08-31T07:39:28.645388+0000 mgr.a (mgr.14388) 14192 : cluster [DBG] pgmap v9839: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:29 smithi191 bash[24992]: audit 2024-08-31T07:39:29.093678+0000 mgr.a (mgr.14388) 14193 : audit [DBG] from='client.308619 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:31 smithi163 bash[24253]: cluster 2024-08-31T07:39:30.646379+0000 mgr.a (mgr.14388) 14194 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:39:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:31 smithi027 bash[22610]: cluster 2024-08-31T07:39:30.646379+0000 mgr.a (mgr.14388) 14194 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:39:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:31 smithi191 bash[24992]: cluster 2024-08-31T07:39:30.646379+0000 mgr.a (mgr.14388) 14194 : cluster [DBG] pgmap v9840: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:39:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:33 smithi163 bash[24253]: cluster 2024-08-31T07:39:32.647223+0000 mgr.a (mgr.14388) 14195 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:39:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:33 smithi027 bash[22610]: cluster 2024-08-31T07:39:32.647223+0000 mgr.a (mgr.14388) 14195 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:39:34.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:33 smithi191 bash[24992]: cluster 2024-08-31T07:39:32.647223+0000 mgr.a (mgr.14388) 14195 : cluster [DBG] pgmap v9841: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:39:34.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:39:34.528 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:39:34.528 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:35.308 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:35.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:35.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:35.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:35.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:35 smithi163 bash[24253]: cluster 2024-08-31T07:39:34.648290+0000 mgr.a (mgr.14388) 14196 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:35 smithi163 bash[24253]: audit 2024-08-31T07:39:34.860788+0000 mgr.a (mgr.14388) 14197 : audit [DBG] from='client.308697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:35 smithi027 bash[22610]: cluster 2024-08-31T07:39:34.648290+0000 mgr.a (mgr.14388) 14196 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:35 smithi027 bash[22610]: audit 2024-08-31T07:39:34.860788+0000 mgr.a (mgr.14388) 14197 : audit [DBG] from='client.308697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:35 smithi191 bash[24992]: cluster 2024-08-31T07:39:34.648290+0000 mgr.a (mgr.14388) 14196 : cluster [DBG] pgmap v9842: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:35 smithi191 bash[24992]: audit 2024-08-31T07:39:34.860788+0000 mgr.a (mgr.14388) 14197 : audit [DBG] from='client.308697 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:37 smithi163 bash[24253]: cluster 2024-08-31T07:39:36.649254+0000 mgr.a (mgr.14388) 14198 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:37 smithi027 bash[22610]: cluster 2024-08-31T07:39:36.649254+0000 mgr.a (mgr.14388) 14198 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:37 smithi191 bash[24992]: cluster 2024-08-31T07:39:36.649254+0000 mgr.a (mgr.14388) 14198 : cluster [DBG] pgmap v9843: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:38 smithi163 bash[24253]: audit 2024-08-31T07:39:38.485647+0000 mon.a (mon.0) 2694 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:39:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:38 smithi027 bash[22610]: audit 2024-08-31T07:39:38.485647+0000 mon.a (mon.0) 2694 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:39:39.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:38 smithi191 bash[24992]: audit 2024-08-31T07:39:38.485647+0000 mon.a (mon.0) 2694 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:39:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:39 smithi163 bash[24253]: cluster 2024-08-31T07:39:38.651599+0000 mgr.a (mgr.14388) 14199 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:39 smithi163 bash[24253]: audit 2024-08-31T07:39:39.357171+0000 mon.a (mon.0) 2695 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:39:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:39 smithi163 bash[24253]: audit 2024-08-31T07:39:39.358976+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:39:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:39 smithi163 bash[24253]: audit 2024-08-31T07:39:39.369806+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:39:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:39 smithi163 bash[24253]: audit 2024-08-31T07:39:39.374668+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:39:40.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:39:40 smithi027 bash[22863]: debug 2024-08-31T07:39:40.104+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:39:40.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:39:40 smithi027 bash[22863]: debug 2024-08-31T07:39:40.108+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:39:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:39 smithi027 bash[22610]: cluster 2024-08-31T07:39:38.651599+0000 mgr.a (mgr.14388) 14199 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:39 smithi027 bash[22610]: audit 2024-08-31T07:39:39.357171+0000 mon.a (mon.0) 2695 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:39:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:39 smithi027 bash[22610]: audit 2024-08-31T07:39:39.358976+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:39:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:39 smithi027 bash[22610]: audit 2024-08-31T07:39:39.369806+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:39:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:39 smithi027 bash[22610]: audit 2024-08-31T07:39:39.374668+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:39:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:39 smithi191 bash[24992]: cluster 2024-08-31T07:39:38.651599+0000 mgr.a (mgr.14388) 14199 : cluster [DBG] pgmap v9844: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:39:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:39 smithi191 bash[24992]: audit 2024-08-31T07:39:39.357171+0000 mon.a (mon.0) 2695 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:39:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:39 smithi191 bash[24992]: audit 2024-08-31T07:39:39.358976+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:39:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:39 smithi191 bash[24992]: audit 2024-08-31T07:39:39.369806+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:39:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:39 smithi191 bash[24992]: audit 2024-08-31T07:39:39.374668+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:39:40.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:39:40.310 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:39:40.310 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:41.072 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:41.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:41.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:41.072 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:41.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:40 smithi163 bash[24253]: audit 2024-08-31T07:39:39.376954+0000 mgr.a (mgr.14388) 14200 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:39:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:40 smithi163 bash[24253]: audit 2024-08-31T07:39:40.109765+0000 mgr.a (mgr.14388) 14201 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:39:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:40 smithi163 bash[24253]: cephadm 2024-08-31T07:39:40.111221+0000 mgr.a (mgr.14388) 14202 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:39:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:40 smithi027 bash[22610]: audit 2024-08-31T07:39:39.376954+0000 mgr.a (mgr.14388) 14200 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:39:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:40 smithi027 bash[22610]: audit 2024-08-31T07:39:40.109765+0000 mgr.a (mgr.14388) 14201 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:39:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:40 smithi027 bash[22610]: cephadm 2024-08-31T07:39:40.111221+0000 mgr.a (mgr.14388) 14202 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:39:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:40 smithi191 bash[24992]: audit 2024-08-31T07:39:39.376954+0000 mgr.a (mgr.14388) 14200 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:39:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:40 smithi191 bash[24992]: audit 2024-08-31T07:39:40.109765+0000 mgr.a (mgr.14388) 14201 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:39:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:40 smithi191 bash[24992]: cephadm 2024-08-31T07:39:40.111221+0000 mgr.a (mgr.14388) 14202 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:39:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:41 smithi163 bash[24253]: audit 2024-08-31T07:39:40.647838+0000 mgr.a (mgr.14388) 14203 : audit [DBG] from='client.308874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:41 smithi163 bash[24253]: cluster 2024-08-31T07:39:40.664895+0000 mgr.a (mgr.14388) 14204 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:41 smithi027 bash[22610]: audit 2024-08-31T07:39:40.647838+0000 mgr.a (mgr.14388) 14203 : audit [DBG] from='client.308874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:41 smithi027 bash[22610]: cluster 2024-08-31T07:39:40.664895+0000 mgr.a (mgr.14388) 14204 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:41 smithi191 bash[24992]: audit 2024-08-31T07:39:40.647838+0000 mgr.a (mgr.14388) 14203 : audit [DBG] from='client.308874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:41 smithi191 bash[24992]: cluster 2024-08-31T07:39:40.664895+0000 mgr.a (mgr.14388) 14204 : cluster [DBG] pgmap v9845: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:43 smithi163 bash[24253]: cluster 2024-08-31T07:39:42.665920+0000 mgr.a (mgr.14388) 14205 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:43 smithi027 bash[22610]: cluster 2024-08-31T07:39:42.665920+0000 mgr.a (mgr.14388) 14205 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:43 smithi191 bash[24992]: cluster 2024-08-31T07:39:42.665920+0000 mgr.a (mgr.14388) 14205 : cluster [DBG] pgmap v9846: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:46.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:39:46.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:39:46.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:45 smithi163 bash[24253]: cluster 2024-08-31T07:39:44.668149+0000 mgr.a (mgr.14388) 14206 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:45 smithi027 bash[22610]: cluster 2024-08-31T07:39:44.668149+0000 mgr.a (mgr.14388) 14206 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:45 smithi191 bash[24992]: cluster 2024-08-31T07:39:44.668149+0000 mgr.a (mgr.14388) 14206 : cluster [DBG] pgmap v9847: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:46.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:46.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:46.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:46.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:46.818 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:47 smithi163 bash[24253]: audit 2024-08-31T07:39:46.403386+0000 mgr.a (mgr.14388) 14207 : audit [DBG] from='client.308952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:47 smithi163 bash[24253]: cluster 2024-08-31T07:39:46.668672+0000 mgr.a (mgr.14388) 14208 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:47 smithi027 bash[22610]: audit 2024-08-31T07:39:46.403386+0000 mgr.a (mgr.14388) 14207 : audit [DBG] from='client.308952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:47 smithi027 bash[22610]: cluster 2024-08-31T07:39:46.668672+0000 mgr.a (mgr.14388) 14208 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:47 smithi191 bash[24992]: audit 2024-08-31T07:39:46.403386+0000 mgr.a (mgr.14388) 14207 : audit [DBG] from='client.308952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:47 smithi191 bash[24992]: cluster 2024-08-31T07:39:46.668672+0000 mgr.a (mgr.14388) 14208 : cluster [DBG] pgmap v9848: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:49 smithi163 bash[24253]: cluster 2024-08-31T07:39:48.670890+0000 mgr.a (mgr.14388) 14209 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:49 smithi027 bash[22610]: cluster 2024-08-31T07:39:48.670890+0000 mgr.a (mgr.14388) 14209 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:49 smithi191 bash[24992]: cluster 2024-08-31T07:39:48.670890+0000 mgr.a (mgr.14388) 14209 : cluster [DBG] pgmap v9849: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:51.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:39:51.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:39:51.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:51 smithi163 bash[24253]: cluster 2024-08-31T07:39:50.671623+0000 mgr.a (mgr.14388) 14210 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:51 smithi027 bash[22610]: cluster 2024-08-31T07:39:50.671623+0000 mgr.a (mgr.14388) 14210 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:51 smithi191 bash[24992]: cluster 2024-08-31T07:39:50.671623+0000 mgr.a (mgr.14388) 14210 : cluster [DBG] pgmap v9850: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T07:39:52.573 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:52.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:52 smithi163 bash[24253]: audit 2024-08-31T07:39:52.154658+0000 mgr.a (mgr.14388) 14211 : audit [DBG] from='client.309024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:52 smithi027 bash[22610]: audit 2024-08-31T07:39:52.154658+0000 mgr.a (mgr.14388) 14211 : audit [DBG] from='client.309024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:53.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:52 smithi191 bash[24992]: audit 2024-08-31T07:39:52.154658+0000 mgr.a (mgr.14388) 14211 : audit [DBG] from='client.309024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:53 smithi163 bash[24253]: cluster 2024-08-31T07:39:52.672714+0000 mgr.a (mgr.14388) 14212 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:39:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:53 smithi027 bash[22610]: cluster 2024-08-31T07:39:52.672714+0000 mgr.a (mgr.14388) 14212 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:39:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:53 smithi191 bash[24992]: cluster 2024-08-31T07:39:52.672714+0000 mgr.a (mgr.14388) 14212 : cluster [DBG] pgmap v9851: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:39:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:55 smithi163 bash[24253]: cluster 2024-08-31T07:39:54.675007+0000 mgr.a (mgr.14388) 14213 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:39:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:55 smithi027 bash[22610]: cluster 2024-08-31T07:39:54.675007+0000 mgr.a (mgr.14388) 14213 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:39:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:55 smithi191 bash[24992]: cluster 2024-08-31T07:39:54.675007+0000 mgr.a (mgr.14388) 14213 : cluster [DBG] pgmap v9852: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:39:57.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:39:57.575 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:39:57.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:39:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:57 smithi163 bash[24253]: cluster 2024-08-31T07:39:56.675789+0000 mgr.a (mgr.14388) 14214 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:57 smithi027 bash[22610]: cluster 2024-08-31T07:39:56.675789+0000 mgr.a (mgr.14388) 14214 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:57 smithi191 bash[24992]: cluster 2024-08-31T07:39:56.675789+0000 mgr.a (mgr.14388) 14214 : cluster [DBG] pgmap v9853: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:39:58.355 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:39:58.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:39:58.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:39:58.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:39:58.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:39:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:58 smithi163 bash[24253]: audit 2024-08-31T07:39:57.913171+0000 mgr.a (mgr.14388) 14215 : audit [DBG] from='client.309096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:58 smithi027 bash[22610]: audit 2024-08-31T07:39:57.913171+0000 mgr.a (mgr.14388) 14215 : audit [DBG] from='client.309096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:39:59.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:58 smithi191 bash[24992]: audit 2024-08-31T07:39:57.913171+0000 mgr.a (mgr.14388) 14215 : audit [DBG] from='client.309096 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:39:59 smithi163 bash[24253]: cluster 2024-08-31T07:39:58.678530+0000 mgr.a (mgr.14388) 14216 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:39:59 smithi027 bash[22610]: cluster 2024-08-31T07:39:58.678530+0000 mgr.a (mgr.14388) 14216 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:39:59 smithi191 bash[24992]: cluster 2024-08-31T07:39:58.678530+0000 mgr.a (mgr.14388) 14216 : cluster [DBG] pgmap v9854: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:00 smithi027 bash[22610]: cluster 2024-08-31T07:40:00.000138+0000 mon.a (mon.0) 2699 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:40:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:00 smithi191 bash[24992]: cluster 2024-08-31T07:40:00.000138+0000 mon.a (mon.0) 2699 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:40:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:00 smithi163 bash[24253]: cluster 2024-08-31T07:40:00.000138+0000 mon.a (mon.0) 2699 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:40:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:01 smithi027 bash[22610]: cluster 2024-08-31T07:40:00.679457+0000 mgr.a (mgr.14388) 14217 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:40:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:01 smithi191 bash[24992]: cluster 2024-08-31T07:40:00.679457+0000 mgr.a (mgr.14388) 14217 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:40:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:01 smithi163 bash[24253]: cluster 2024-08-31T07:40:00.679457+0000 mgr.a (mgr.14388) 14217 : cluster [DBG] pgmap v9855: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:40:03.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:40:03.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:40:03.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:40:04.140 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:40:04.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:40:04.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:40:04.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:40:04.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:40:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:03 smithi027 bash[22610]: cluster 2024-08-31T07:40:02.680376+0000 mgr.a (mgr.14388) 14218 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:40:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:03 smithi191 bash[24992]: cluster 2024-08-31T07:40:02.680376+0000 mgr.a (mgr.14388) 14218 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:40:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:03 smithi163 bash[24253]: cluster 2024-08-31T07:40:02.680376+0000 mgr.a (mgr.14388) 14218 : cluster [DBG] pgmap v9856: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:40:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:04 smithi027 bash[22610]: audit 2024-08-31T07:40:03.690406+0000 mgr.a (mgr.14388) 14219 : audit [DBG] from='client.309168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:04 smithi191 bash[24992]: audit 2024-08-31T07:40:03.690406+0000 mgr.a (mgr.14388) 14219 : audit [DBG] from='client.309168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:04 smithi163 bash[24253]: audit 2024-08-31T07:40:03.690406+0000 mgr.a (mgr.14388) 14219 : audit [DBG] from='client.309168 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:05 smithi027 bash[22610]: cluster 2024-08-31T07:40:04.683351+0000 mgr.a (mgr.14388) 14220 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:05 smithi191 bash[24992]: cluster 2024-08-31T07:40:04.683351+0000 mgr.a (mgr.14388) 14220 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:05 smithi163 bash[24253]: cluster 2024-08-31T07:40:04.683351+0000 mgr.a (mgr.14388) 14220 : cluster [DBG] pgmap v9857: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:07 smithi027 bash[22610]: cluster 2024-08-31T07:40:06.684319+0000 mgr.a (mgr.14388) 14221 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:40:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:07 smithi191 bash[24992]: cluster 2024-08-31T07:40:06.684319+0000 mgr.a (mgr.14388) 14221 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:40:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:07 smithi163 bash[24253]: cluster 2024-08-31T07:40:06.684319+0000 mgr.a (mgr.14388) 14221 : cluster [DBG] pgmap v9858: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:40:09.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:40:09.142 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:40:09.142 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:40:09.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:40:09.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:40:09.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:40:09.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:40:09.925 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:40:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:09 smithi027 bash[22610]: cluster 2024-08-31T07:40:08.686453+0000 mgr.a (mgr.14388) 14222 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:09 smithi191 bash[24992]: cluster 2024-08-31T07:40:08.686453+0000 mgr.a (mgr.14388) 14222 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:09 smithi163 bash[24253]: cluster 2024-08-31T07:40:08.686453+0000 mgr.a (mgr.14388) 14222 : cluster [DBG] pgmap v9859: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:10 smithi191 bash[24992]: audit 2024-08-31T07:40:09.481366+0000 mgr.a (mgr.14388) 14223 : audit [DBG] from='client.309243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:10 smithi163 bash[24253]: audit 2024-08-31T07:40:09.481366+0000 mgr.a (mgr.14388) 14223 : audit [DBG] from='client.309243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:10 smithi027 bash[22610]: audit 2024-08-31T07:40:09.481366+0000 mgr.a (mgr.14388) 14223 : audit [DBG] from='client.309243 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:11 smithi191 bash[24992]: cluster 2024-08-31T07:40:10.687484+0000 mgr.a (mgr.14388) 14224 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:11 smithi163 bash[24253]: cluster 2024-08-31T07:40:10.687484+0000 mgr.a (mgr.14388) 14224 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:11 smithi027 bash[22610]: cluster 2024-08-31T07:40:10.687484+0000 mgr.a (mgr.14388) 14224 : cluster [DBG] pgmap v9860: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:13 smithi191 bash[24992]: cluster 2024-08-31T07:40:12.688285+0000 mgr.a (mgr.14388) 14225 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:13 smithi163 bash[24253]: cluster 2024-08-31T07:40:12.688285+0000 mgr.a (mgr.14388) 14225 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:13 smithi027 bash[22610]: cluster 2024-08-31T07:40:12.688285+0000 mgr.a (mgr.14388) 14225 : cluster [DBG] pgmap v9861: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:14.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:40:14.927 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:40:14.927 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:40:15.697 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:40:15.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:40:15.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:40:15.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:40:15.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:40:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:16 smithi191 bash[24992]: cluster 2024-08-31T07:40:14.690500+0000 mgr.a (mgr.14388) 14226 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:16 smithi163 bash[24253]: cluster 2024-08-31T07:40:14.690500+0000 mgr.a (mgr.14388) 14226 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:16 smithi027 bash[22610]: cluster 2024-08-31T07:40:14.690500+0000 mgr.a (mgr.14388) 14226 : cluster [DBG] pgmap v9862: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:17 smithi191 bash[24992]: audit 2024-08-31T07:40:15.261981+0000 mgr.a (mgr.14388) 14227 : audit [DBG] from='client.309318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:17 smithi163 bash[24253]: audit 2024-08-31T07:40:15.261981+0000 mgr.a (mgr.14388) 14227 : audit [DBG] from='client.309318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:17 smithi027 bash[22610]: audit 2024-08-31T07:40:15.261981+0000 mgr.a (mgr.14388) 14227 : audit [DBG] from='client.309318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:18 smithi191 bash[24992]: cluster 2024-08-31T07:40:16.691472+0000 mgr.a (mgr.14388) 14228 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:18 smithi163 bash[24253]: cluster 2024-08-31T07:40:16.691472+0000 mgr.a (mgr.14388) 14228 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:18 smithi027 bash[22610]: cluster 2024-08-31T07:40:16.691472+0000 mgr.a (mgr.14388) 14228 : cluster [DBG] pgmap v9863: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:20 smithi191 bash[24992]: cluster 2024-08-31T07:40:18.693697+0000 mgr.a (mgr.14388) 14229 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:20 smithi163 bash[24253]: cluster 2024-08-31T07:40:18.693697+0000 mgr.a (mgr.14388) 14229 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:20 smithi027 bash[22610]: cluster 2024-08-31T07:40:18.693697+0000 mgr.a (mgr.14388) 14229 : cluster [DBG] pgmap v9864: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:20.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:40:20.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:40:20.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:40:21.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:40:21.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:40:21.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:40:21.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:40:21.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:40:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:22 smithi191 bash[24992]: cluster 2024-08-31T07:40:20.694451+0000 mgr.a (mgr.14388) 14230 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:22 smithi191 bash[24992]: audit 2024-08-31T07:40:21.040941+0000 mgr.a (mgr.14388) 14231 : audit [DBG] from='client.309396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:22 smithi163 bash[24253]: cluster 2024-08-31T07:40:20.694451+0000 mgr.a (mgr.14388) 14230 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:22 smithi163 bash[24253]: audit 2024-08-31T07:40:21.040941+0000 mgr.a (mgr.14388) 14231 : audit [DBG] from='client.309396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:22 smithi027 bash[22610]: cluster 2024-08-31T07:40:20.694451+0000 mgr.a (mgr.14388) 14230 : cluster [DBG] pgmap v9865: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:22 smithi027 bash[22610]: audit 2024-08-31T07:40:21.040941+0000 mgr.a (mgr.14388) 14231 : audit [DBG] from='client.309396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:24 smithi191 bash[24992]: cluster 2024-08-31T07:40:22.695532+0000 mgr.a (mgr.14388) 14232 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:24 smithi163 bash[24253]: cluster 2024-08-31T07:40:22.695532+0000 mgr.a (mgr.14388) 14232 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:24 smithi027 bash[22610]: cluster 2024-08-31T07:40:22.695532+0000 mgr.a (mgr.14388) 14232 : cluster [DBG] pgmap v9866: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:26 smithi191 bash[24992]: cluster 2024-08-31T07:40:24.697793+0000 mgr.a (mgr.14388) 14233 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:26 smithi163 bash[24253]: cluster 2024-08-31T07:40:24.697793+0000 mgr.a (mgr.14388) 14233 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:26 smithi027 bash[22610]: cluster 2024-08-31T07:40:24.697793+0000 mgr.a (mgr.14388) 14233 : cluster [DBG] pgmap v9867: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:26.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:40:26.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:40:26.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:40:27.257 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:40:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:40:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:40:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:40:27.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:40:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:28 smithi163 bash[24253]: cluster 2024-08-31T07:40:26.698539+0000 mgr.a (mgr.14388) 14234 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:28 smithi163 bash[24253]: audit 2024-08-31T07:40:26.823138+0000 mgr.a (mgr.14388) 14235 : audit [DBG] from='client.309471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:28 smithi027 bash[22610]: cluster 2024-08-31T07:40:26.698539+0000 mgr.a (mgr.14388) 14234 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:28 smithi027 bash[22610]: audit 2024-08-31T07:40:26.823138+0000 mgr.a (mgr.14388) 14235 : audit [DBG] from='client.309471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:28 smithi191 bash[24992]: cluster 2024-08-31T07:40:26.698539+0000 mgr.a (mgr.14388) 14234 : cluster [DBG] pgmap v9868: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:28 smithi191 bash[24992]: audit 2024-08-31T07:40:26.823138+0000 mgr.a (mgr.14388) 14235 : audit [DBG] from='client.309471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:30 smithi163 bash[24253]: cluster 2024-08-31T07:40:28.700855+0000 mgr.a (mgr.14388) 14236 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:30 smithi027 bash[22610]: cluster 2024-08-31T07:40:28.700855+0000 mgr.a (mgr.14388) 14236 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:30 smithi191 bash[24992]: cluster 2024-08-31T07:40:28.700855+0000 mgr.a (mgr.14388) 14236 : cluster [DBG] pgmap v9869: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:40:32.258 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:40:32.259 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:40:32.259 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:40:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:32 smithi163 bash[24253]: cluster 2024-08-31T07:40:30.701675+0000 mgr.a (mgr.14388) 14237 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:32 smithi027 bash[22610]: cluster 2024-08-31T07:40:30.701675+0000 mgr.a (mgr.14388) 14237 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:32 smithi191 bash[24992]: cluster 2024-08-31T07:40:30.701675+0000 mgr.a (mgr.14388) 14237 : cluster [DBG] pgmap v9870: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:33.021 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:40:33.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:40:33.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:40:33.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:40:33.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:40:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:34 smithi163 bash[24253]: audit 2024-08-31T07:40:32.590801+0000 mgr.a (mgr.14388) 14238 : audit [DBG] from='client.309546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:34 smithi163 bash[24253]: cluster 2024-08-31T07:40:32.702152+0000 mgr.a (mgr.14388) 14239 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:34 smithi027 bash[22610]: audit 2024-08-31T07:40:32.590801+0000 mgr.a (mgr.14388) 14238 : audit [DBG] from='client.309546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:34 smithi027 bash[22610]: cluster 2024-08-31T07:40:32.702152+0000 mgr.a (mgr.14388) 14239 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:34 smithi191 bash[24992]: audit 2024-08-31T07:40:32.590801+0000 mgr.a (mgr.14388) 14238 : audit [DBG] from='client.309546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:34 smithi191 bash[24992]: cluster 2024-08-31T07:40:32.702152+0000 mgr.a (mgr.14388) 14239 : cluster [DBG] pgmap v9871: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:36 smithi163 bash[24253]: cluster 2024-08-31T07:40:34.704495+0000 mgr.a (mgr.14388) 14240 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T07:40:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:36 smithi027 bash[22610]: cluster 2024-08-31T07:40:34.704495+0000 mgr.a (mgr.14388) 14240 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T07:40:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:36 smithi191 bash[24992]: cluster 2024-08-31T07:40:34.704495+0000 mgr.a (mgr.14388) 14240 : cluster [DBG] pgmap v9872: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T07:40:38.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:40:38.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:40:38.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:40:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:38 smithi163 bash[24253]: cluster 2024-08-31T07:40:36.705279+0000 mgr.a (mgr.14388) 14241 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T07:40:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:38 smithi027 bash[22610]: cluster 2024-08-31T07:40:36.705279+0000 mgr.a (mgr.14388) 14241 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T07:40:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:38 smithi191 bash[24992]: cluster 2024-08-31T07:40:36.705279+0000 mgr.a (mgr.14388) 14241 : cluster [DBG] pgmap v9873: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T07:40:38.778 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:40:38.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:40:38.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:40:38.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:40:38.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:40:40.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:40 smithi163 bash[24253]: audit 2024-08-31T07:40:38.354547+0000 mgr.a (mgr.14388) 14242 : audit [DBG] from='client.309621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:40.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:40 smithi163 bash[24253]: cluster 2024-08-31T07:40:38.706639+0000 mgr.a (mgr.14388) 14243 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:40 smithi027 bash[22610]: audit 2024-08-31T07:40:38.354547+0000 mgr.a (mgr.14388) 14242 : audit [DBG] from='client.309621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:40 smithi027 bash[22610]: cluster 2024-08-31T07:40:38.706639+0000 mgr.a (mgr.14388) 14243 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:40 smithi191 bash[24992]: audit 2024-08-31T07:40:38.354547+0000 mgr.a (mgr.14388) 14242 : audit [DBG] from='client.309621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:40 smithi191 bash[24992]: cluster 2024-08-31T07:40:38.706639+0000 mgr.a (mgr.14388) 14243 : cluster [DBG] pgmap v9874: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:41 smithi163 bash[24253]: audit 2024-08-31T07:40:40.171306+0000 mon.a (mon.0) 2700 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:40:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:41 smithi163 bash[24253]: audit 2024-08-31T07:40:41.030567+0000 mon.a (mon.0) 2701 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:40:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:41 smithi163 bash[24253]: audit 2024-08-31T07:40:41.031839+0000 mon.a (mon.0) 2702 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:40:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:41 smithi163 bash[24253]: audit 2024-08-31T07:40:41.043786+0000 mon.a (mon.0) 2703 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:40:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:41 smithi163 bash[24253]: audit 2024-08-31T07:40:41.048743+0000 mon.a (mon.0) 2704 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:40:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:41 smithi027 bash[22610]: audit 2024-08-31T07:40:40.171306+0000 mon.a (mon.0) 2700 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:40:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:41 smithi027 bash[22610]: audit 2024-08-31T07:40:41.030567+0000 mon.a (mon.0) 2701 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:40:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:41 smithi027 bash[22610]: audit 2024-08-31T07:40:41.031839+0000 mon.a (mon.0) 2702 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:40:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:41 smithi027 bash[22610]: audit 2024-08-31T07:40:41.043786+0000 mon.a (mon.0) 2703 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:40:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:41 smithi027 bash[22610]: audit 2024-08-31T07:40:41.048743+0000 mon.a (mon.0) 2704 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:40:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:41 smithi191 bash[24992]: audit 2024-08-31T07:40:40.171306+0000 mon.a (mon.0) 2700 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:40:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:41 smithi191 bash[24992]: audit 2024-08-31T07:40:41.030567+0000 mon.a (mon.0) 2701 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:40:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:41 smithi191 bash[24992]: audit 2024-08-31T07:40:41.031839+0000 mon.a (mon.0) 2702 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:40:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:41 smithi191 bash[24992]: audit 2024-08-31T07:40:41.043786+0000 mon.a (mon.0) 2703 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:40:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:41 smithi191 bash[24992]: audit 2024-08-31T07:40:41.048743+0000 mon.a (mon.0) 2704 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:40:42.077 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:40:41 smithi027 bash[22863]: debug 2024-08-31T07:40:41.790+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:40:42.077 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:40:41 smithi027 bash[22863]: debug 2024-08-31T07:40:41.790+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:40:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:42 smithi163 bash[24253]: cluster 2024-08-31T07:40:40.707320+0000 mgr.a (mgr.14388) 14244 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:40:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:42 smithi163 bash[24253]: audit 2024-08-31T07:40:41.051182+0000 mgr.a (mgr.14388) 14245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:40:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:42 smithi027 bash[22610]: cluster 2024-08-31T07:40:40.707320+0000 mgr.a (mgr.14388) 14244 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:40:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:42 smithi027 bash[22610]: audit 2024-08-31T07:40:41.051182+0000 mgr.a (mgr.14388) 14245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:40:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:42 smithi191 bash[24992]: cluster 2024-08-31T07:40:40.707320+0000 mgr.a (mgr.14388) 14244 : cluster [DBG] pgmap v9875: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:40:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:42 smithi191 bash[24992]: audit 2024-08-31T07:40:41.051182+0000 mgr.a (mgr.14388) 14245 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:40:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:43 smithi163 bash[24253]: audit 2024-08-31T07:40:41.793294+0000 mgr.a (mgr.14388) 14246 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:40:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:43 smithi163 bash[24253]: cephadm 2024-08-31T07:40:41.794639+0000 mgr.a (mgr.14388) 14247 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:40:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:43 smithi027 bash[22610]: audit 2024-08-31T07:40:41.793294+0000 mgr.a (mgr.14388) 14246 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:40:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:43 smithi027 bash[22610]: cephadm 2024-08-31T07:40:41.794639+0000 mgr.a (mgr.14388) 14247 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:40:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:43 smithi191 bash[24992]: audit 2024-08-31T07:40:41.793294+0000 mgr.a (mgr.14388) 14246 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:40:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:43 smithi191 bash[24992]: cephadm 2024-08-31T07:40:41.794639+0000 mgr.a (mgr.14388) 14247 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:40:43.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:40:43.780 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:40:43.780 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:40:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:44 smithi163 bash[24253]: cluster 2024-08-31T07:40:42.708200+0000 mgr.a (mgr.14388) 14248 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:40:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:44 smithi027 bash[22610]: cluster 2024-08-31T07:40:42.708200+0000 mgr.a (mgr.14388) 14248 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:40:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:44 smithi191 bash[24992]: cluster 2024-08-31T07:40:42.708200+0000 mgr.a (mgr.14388) 14248 : cluster [DBG] pgmap v9876: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:40:44.565 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:40:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:40:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:40:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:40:44.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:40:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:45 smithi163 bash[24253]: audit 2024-08-31T07:40:44.116756+0000 mgr.a (mgr.14388) 14249 : audit [DBG] from='client.309807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:45 smithi027 bash[22610]: audit 2024-08-31T07:40:44.116756+0000 mgr.a (mgr.14388) 14249 : audit [DBG] from='client.309807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:45 smithi191 bash[24992]: audit 2024-08-31T07:40:44.116756+0000 mgr.a (mgr.14388) 14249 : audit [DBG] from='client.309807 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:46 smithi163 bash[24253]: cluster 2024-08-31T07:40:44.711086+0000 mgr.a (mgr.14388) 14250 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:46 smithi027 bash[22610]: cluster 2024-08-31T07:40:44.711086+0000 mgr.a (mgr.14388) 14250 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:46 smithi191 bash[24992]: cluster 2024-08-31T07:40:44.711086+0000 mgr.a (mgr.14388) 14250 : cluster [DBG] pgmap v9877: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:48 smithi163 bash[24253]: cluster 2024-08-31T07:40:46.711871+0000 mgr.a (mgr.14388) 14251 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:40:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:48 smithi027 bash[22610]: cluster 2024-08-31T07:40:46.711871+0000 mgr.a (mgr.14388) 14251 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:40:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:48 smithi191 bash[24992]: cluster 2024-08-31T07:40:46.711871+0000 mgr.a (mgr.14388) 14251 : cluster [DBG] pgmap v9878: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:40:49.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:40:49.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:40:49.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:40:50.335 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:40:50.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:40:50.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:40:50.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:40:50.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:40:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:50 smithi163 bash[24253]: cluster 2024-08-31T07:40:48.713822+0000 mgr.a (mgr.14388) 14252 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:50 smithi027 bash[22610]: cluster 2024-08-31T07:40:48.713822+0000 mgr.a (mgr.14388) 14252 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:50 smithi191 bash[24992]: cluster 2024-08-31T07:40:48.713822+0000 mgr.a (mgr.14388) 14252 : cluster [DBG] pgmap v9879: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:51 smithi163 bash[24253]: audit 2024-08-31T07:40:49.902503+0000 mgr.a (mgr.14388) 14253 : audit [DBG] from='client.309882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:51 smithi027 bash[22610]: audit 2024-08-31T07:40:49.902503+0000 mgr.a (mgr.14388) 14253 : audit [DBG] from='client.309882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:51 smithi191 bash[24992]: audit 2024-08-31T07:40:49.902503+0000 mgr.a (mgr.14388) 14253 : audit [DBG] from='client.309882 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:52 smithi163 bash[24253]: cluster 2024-08-31T07:40:50.714830+0000 mgr.a (mgr.14388) 14254 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:52 smithi027 bash[22610]: cluster 2024-08-31T07:40:50.714830+0000 mgr.a (mgr.14388) 14254 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:52 smithi191 bash[24992]: cluster 2024-08-31T07:40:50.714830+0000 mgr.a (mgr.14388) 14254 : cluster [DBG] pgmap v9880: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:54 smithi163 bash[24253]: cluster 2024-08-31T07:40:52.715578+0000 mgr.a (mgr.14388) 14255 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:54 smithi027 bash[22610]: cluster 2024-08-31T07:40:52.715578+0000 mgr.a (mgr.14388) 14255 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:54 smithi191 bash[24992]: cluster 2024-08-31T07:40:52.715578+0000 mgr.a (mgr.14388) 14255 : cluster [DBG] pgmap v9881: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:55.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:40:55.337 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:40:55.337 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:40:56.088 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:40:56.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:40:56.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:40:56.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:40:56.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:40:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:56 smithi163 bash[24253]: cluster 2024-08-31T07:40:54.717781+0000 mgr.a (mgr.14388) 14256 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:56 smithi027 bash[22610]: cluster 2024-08-31T07:40:54.717781+0000 mgr.a (mgr.14388) 14256 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:56 smithi191 bash[24992]: cluster 2024-08-31T07:40:54.717781+0000 mgr.a (mgr.14388) 14256 : cluster [DBG] pgmap v9882: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:40:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:57 smithi163 bash[24253]: audit 2024-08-31T07:40:55.668083+0000 mgr.a (mgr.14388) 14257 : audit [DBG] from='client.309957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:57 smithi027 bash[22610]: audit 2024-08-31T07:40:55.668083+0000 mgr.a (mgr.14388) 14257 : audit [DBG] from='client.309957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:57 smithi191 bash[24992]: audit 2024-08-31T07:40:55.668083+0000 mgr.a (mgr.14388) 14257 : audit [DBG] from='client.309957 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:40:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:40:58 smithi163 bash[24253]: cluster 2024-08-31T07:40:56.718772+0000 mgr.a (mgr.14388) 14258 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:40:58 smithi027 bash[22610]: cluster 2024-08-31T07:40:56.718772+0000 mgr.a (mgr.14388) 14258 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:40:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:40:58 smithi191 bash[24992]: cluster 2024-08-31T07:40:56.718772+0000 mgr.a (mgr.14388) 14258 : cluster [DBG] pgmap v9883: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:00 smithi163 bash[24253]: cluster 2024-08-31T07:40:58.720986+0000 mgr.a (mgr.14388) 14259 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:00 smithi027 bash[22610]: cluster 2024-08-31T07:40:58.720986+0000 mgr.a (mgr.14388) 14259 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:00 smithi191 bash[24992]: cluster 2024-08-31T07:40:58.720986+0000 mgr.a (mgr.14388) 14259 : cluster [DBG] pgmap v9884: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:01.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:01.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:01.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:01.864 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:01.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:01.864 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:01.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:01.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:41:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:02 smithi163 bash[24253]: cluster 2024-08-31T07:41:00.721737+0000 mgr.a (mgr.14388) 14260 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:02 smithi027 bash[22610]: cluster 2024-08-31T07:41:00.721737+0000 mgr.a (mgr.14388) 14260 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:02 smithi191 bash[24992]: cluster 2024-08-31T07:41:00.721737+0000 mgr.a (mgr.14388) 14260 : cluster [DBG] pgmap v9885: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:03 smithi163 bash[24253]: audit 2024-08-31T07:41:01.426360+0000 mgr.a (mgr.14388) 14261 : audit [DBG] from='client.310032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:03 smithi027 bash[22610]: audit 2024-08-31T07:41:01.426360+0000 mgr.a (mgr.14388) 14261 : audit [DBG] from='client.310032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:03 smithi191 bash[24992]: audit 2024-08-31T07:41:01.426360+0000 mgr.a (mgr.14388) 14261 : audit [DBG] from='client.310032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:04 smithi163 bash[24253]: cluster 2024-08-31T07:41:02.722650+0000 mgr.a (mgr.14388) 14262 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:04 smithi027 bash[22610]: cluster 2024-08-31T07:41:02.722650+0000 mgr.a (mgr.14388) 14262 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:04 smithi191 bash[24992]: cluster 2024-08-31T07:41:02.722650+0000 mgr.a (mgr.14388) 14262 : cluster [DBG] pgmap v9886: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:06 smithi163 bash[24253]: cluster 2024-08-31T07:41:04.724810+0000 mgr.a (mgr.14388) 14263 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:06 smithi027 bash[22610]: cluster 2024-08-31T07:41:04.724810+0000 mgr.a (mgr.14388) 14263 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:06 smithi191 bash[24992]: cluster 2024-08-31T07:41:04.724810+0000 mgr.a (mgr.14388) 14263 : cluster [DBG] pgmap v9887: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:06.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:06.867 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:06.867 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:07.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:07.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:07.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:07.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:41:07.649 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:08 smithi163 bash[24253]: cluster 2024-08-31T07:41:06.725578+0000 mgr.a (mgr.14388) 14264 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:08 smithi163 bash[24253]: audit 2024-08-31T07:41:07.199536+0000 mgr.a (mgr.14388) 14265 : audit [DBG] from='client.310110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:08 smithi027 bash[22610]: cluster 2024-08-31T07:41:06.725578+0000 mgr.a (mgr.14388) 14264 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:08 smithi027 bash[22610]: audit 2024-08-31T07:41:07.199536+0000 mgr.a (mgr.14388) 14265 : audit [DBG] from='client.310110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:08 smithi191 bash[24992]: cluster 2024-08-31T07:41:06.725578+0000 mgr.a (mgr.14388) 14264 : cluster [DBG] pgmap v9888: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:08 smithi191 bash[24992]: audit 2024-08-31T07:41:07.199536+0000 mgr.a (mgr.14388) 14265 : audit [DBG] from='client.310110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:10 smithi163 bash[24253]: cluster 2024-08-31T07:41:08.727919+0000 mgr.a (mgr.14388) 14266 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:10 smithi027 bash[22610]: cluster 2024-08-31T07:41:08.727919+0000 mgr.a (mgr.14388) 14266 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:10 smithi191 bash[24992]: cluster 2024-08-31T07:41:08.727919+0000 mgr.a (mgr.14388) 14266 : cluster [DBG] pgmap v9889: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:12 smithi163 bash[24253]: cluster 2024-08-31T07:41:10.728680+0000 mgr.a (mgr.14388) 14267 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:12 smithi027 bash[22610]: cluster 2024-08-31T07:41:10.728680+0000 mgr.a (mgr.14388) 14267 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:12 smithi191 bash[24992]: cluster 2024-08-31T07:41:10.728680+0000 mgr.a (mgr.14388) 14267 : cluster [DBG] pgmap v9890: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:12.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:12.650 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:12.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:13.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:13.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:13.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:13.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:41:13.425 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:14 smithi163 bash[24253]: cluster 2024-08-31T07:41:12.729426+0000 mgr.a (mgr.14388) 14268 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:14 smithi163 bash[24253]: audit 2024-08-31T07:41:12.987770+0000 mgr.a (mgr.14388) 14269 : audit [DBG] from='client.310188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:14 smithi027 bash[22610]: cluster 2024-08-31T07:41:12.729426+0000 mgr.a (mgr.14388) 14268 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:14.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:14 smithi027 bash[22610]: audit 2024-08-31T07:41:12.987770+0000 mgr.a (mgr.14388) 14269 : audit [DBG] from='client.310188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:14 smithi191 bash[24992]: cluster 2024-08-31T07:41:12.729426+0000 mgr.a (mgr.14388) 14268 : cluster [DBG] pgmap v9891: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:14 smithi191 bash[24992]: audit 2024-08-31T07:41:12.987770+0000 mgr.a (mgr.14388) 14269 : audit [DBG] from='client.310188 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:16 smithi163 bash[24253]: cluster 2024-08-31T07:41:14.732173+0000 mgr.a (mgr.14388) 14270 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:16 smithi027 bash[22610]: cluster 2024-08-31T07:41:14.732173+0000 mgr.a (mgr.14388) 14270 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:16 smithi191 bash[24992]: cluster 2024-08-31T07:41:14.732173+0000 mgr.a (mgr.14388) 14270 : cluster [DBG] pgmap v9892: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:18.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:18.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:18.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:18 smithi163 bash[24253]: cluster 2024-08-31T07:41:16.732965+0000 mgr.a (mgr.14388) 14271 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:41:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:18 smithi027 bash[22610]: cluster 2024-08-31T07:41:16.732965+0000 mgr.a (mgr.14388) 14271 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:41:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:18 smithi191 bash[24992]: cluster 2024-08-31T07:41:16.732965+0000 mgr.a (mgr.14388) 14271 : cluster [DBG] pgmap v9893: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:41:19.170 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:19.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:19.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:19.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:19.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:41:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:20 smithi163 bash[24253]: cluster 2024-08-31T07:41:18.734881+0000 mgr.a (mgr.14388) 14272 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:20 smithi163 bash[24253]: audit 2024-08-31T07:41:18.755385+0000 mgr.a (mgr.14388) 14273 : audit [DBG] from='client.310266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:20 smithi027 bash[22610]: cluster 2024-08-31T07:41:18.734881+0000 mgr.a (mgr.14388) 14272 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:20 smithi027 bash[22610]: audit 2024-08-31T07:41:18.755385+0000 mgr.a (mgr.14388) 14273 : audit [DBG] from='client.310266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:20 smithi191 bash[24992]: cluster 2024-08-31T07:41:18.734881+0000 mgr.a (mgr.14388) 14272 : cluster [DBG] pgmap v9894: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:20 smithi191 bash[24992]: audit 2024-08-31T07:41:18.755385+0000 mgr.a (mgr.14388) 14273 : audit [DBG] from='client.310266 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:22 smithi027 bash[22610]: cluster 2024-08-31T07:41:20.735765+0000 mgr.a (mgr.14388) 14274 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:41:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:22 smithi191 bash[24992]: cluster 2024-08-31T07:41:20.735765+0000 mgr.a (mgr.14388) 14274 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:41:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:22 smithi163 bash[24253]: cluster 2024-08-31T07:41:20.735765+0000 mgr.a (mgr.14388) 14274 : cluster [DBG] pgmap v9895: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:41:24.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:24.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:24.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:24 smithi027 bash[22610]: cluster 2024-08-31T07:41:22.736563+0000 mgr.a (mgr.14388) 14275 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:41:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:24 smithi191 bash[24992]: cluster 2024-08-31T07:41:22.736563+0000 mgr.a (mgr.14388) 14275 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:41:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:24 smithi163 bash[24253]: cluster 2024-08-31T07:41:22.736563+0000 mgr.a (mgr.14388) 14275 : cluster [DBG] pgmap v9896: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:41:24.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:24.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:24.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:24.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:41:24.947 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:26 smithi027 bash[22610]: audit 2024-08-31T07:41:24.508034+0000 mgr.a (mgr.14388) 14276 : audit [DBG] from='client.310344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:26 smithi027 bash[22610]: cluster 2024-08-31T07:41:24.746547+0000 mgr.a (mgr.14388) 14277 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:26 smithi191 bash[24992]: audit 2024-08-31T07:41:24.508034+0000 mgr.a (mgr.14388) 14276 : audit [DBG] from='client.310344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:26 smithi191 bash[24992]: cluster 2024-08-31T07:41:24.746547+0000 mgr.a (mgr.14388) 14277 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:26 smithi163 bash[24253]: audit 2024-08-31T07:41:24.508034+0000 mgr.a (mgr.14388) 14276 : audit [DBG] from='client.310344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:26 smithi163 bash[24253]: cluster 2024-08-31T07:41:24.746547+0000 mgr.a (mgr.14388) 14277 : cluster [DBG] pgmap v9897: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:28 smithi027 bash[22610]: cluster 2024-08-31T07:41:26.747468+0000 mgr.a (mgr.14388) 14278 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:28 smithi191 bash[24992]: cluster 2024-08-31T07:41:26.747468+0000 mgr.a (mgr.14388) 14278 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:28 smithi163 bash[24253]: cluster 2024-08-31T07:41:26.747468+0000 mgr.a (mgr.14388) 14278 : cluster [DBG] pgmap v9898: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:29.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:29.949 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:29.949 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:30 smithi027 bash[22610]: cluster 2024-08-31T07:41:28.749657+0000 mgr.a (mgr.14388) 14279 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:30 smithi191 bash[24992]: cluster 2024-08-31T07:41:28.749657+0000 mgr.a (mgr.14388) 14279 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:30.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:30.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:30.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:30.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:41:30.689 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:30 smithi163 bash[24253]: cluster 2024-08-31T07:41:28.749657+0000 mgr.a (mgr.14388) 14279 : cluster [DBG] pgmap v9899: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:31 smithi027 bash[22610]: audit 2024-08-31T07:41:30.276775+0000 mgr.a (mgr.14388) 14280 : audit [DBG] from='client.310416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:31 smithi191 bash[24992]: audit 2024-08-31T07:41:30.276775+0000 mgr.a (mgr.14388) 14280 : audit [DBG] from='client.310416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:31 smithi163 bash[24253]: audit 2024-08-31T07:41:30.276775+0000 mgr.a (mgr.14388) 14280 : audit [DBG] from='client.310416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:32 smithi027 bash[22610]: cluster 2024-08-31T07:41:30.750616+0000 mgr.a (mgr.14388) 14281 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:32 smithi191 bash[24992]: cluster 2024-08-31T07:41:30.750616+0000 mgr.a (mgr.14388) 14281 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:32 smithi163 bash[24253]: cluster 2024-08-31T07:41:30.750616+0000 mgr.a (mgr.14388) 14281 : cluster [DBG] pgmap v9900: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:34 smithi191 bash[24992]: cluster 2024-08-31T07:41:32.751437+0000 mgr.a (mgr.14388) 14282 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:34 smithi163 bash[24253]: cluster 2024-08-31T07:41:32.751437+0000 mgr.a (mgr.14388) 14282 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:34 smithi027 bash[22610]: cluster 2024-08-31T07:41:32.751437+0000 mgr.a (mgr.14388) 14282 : cluster [DBG] pgmap v9901: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:35.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:35.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:35.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:36.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:36.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:36.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:36.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:41:36.489 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:36 smithi191 bash[24992]: cluster 2024-08-31T07:41:34.753669+0000 mgr.a (mgr.14388) 14283 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:36 smithi163 bash[24253]: cluster 2024-08-31T07:41:34.753669+0000 mgr.a (mgr.14388) 14283 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:36 smithi027 bash[22610]: cluster 2024-08-31T07:41:34.753669+0000 mgr.a (mgr.14388) 14283 : cluster [DBG] pgmap v9902: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:37 smithi191 bash[24992]: audit 2024-08-31T07:41:36.027559+0000 mgr.a (mgr.14388) 14284 : audit [DBG] from='client.310494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:37 smithi163 bash[24253]: audit 2024-08-31T07:41:36.027559+0000 mgr.a (mgr.14388) 14284 : audit [DBG] from='client.310494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:37 smithi027 bash[22610]: audit 2024-08-31T07:41:36.027559+0000 mgr.a (mgr.14388) 14284 : audit [DBG] from='client.310494 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:38 smithi191 bash[24992]: cluster 2024-08-31T07:41:36.754657+0000 mgr.a (mgr.14388) 14285 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:38 smithi163 bash[24253]: cluster 2024-08-31T07:41:36.754657+0000 mgr.a (mgr.14388) 14285 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:38 smithi027 bash[22610]: cluster 2024-08-31T07:41:36.754657+0000 mgr.a (mgr.14388) 14285 : cluster [DBG] pgmap v9903: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:40 smithi191 bash[24992]: cluster 2024-08-31T07:41:38.756961+0000 mgr.a (mgr.14388) 14286 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:40 smithi163 bash[24253]: cluster 2024-08-31T07:41:38.756961+0000 mgr.a (mgr.14388) 14286 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:40 smithi027 bash[22610]: cluster 2024-08-31T07:41:38.756961+0000 mgr.a (mgr.14388) 14286 : cluster [DBG] pgmap v9904: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:41.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:41.491 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:41.491 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:42.243 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:42.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:41:42.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:42 smithi191 bash[24992]: cluster 2024-08-31T07:41:40.757732+0000 mgr.a (mgr.14388) 14287 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:42.542 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:42 smithi191 bash[24992]: audit 2024-08-31T07:41:41.853631+0000 mon.a (mon.0) 2705 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:41:42.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:42 smithi163 bash[24253]: cluster 2024-08-31T07:41:40.757732+0000 mgr.a (mgr.14388) 14287 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:42.705 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:42 smithi163 bash[24253]: audit 2024-08-31T07:41:41.853631+0000 mon.a (mon.0) 2705 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:41:42.739 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:42 smithi027 bash[22610]: cluster 2024-08-31T07:41:40.757732+0000 mgr.a (mgr.14388) 14287 : cluster [DBG] pgmap v9905: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:42.739 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:42 smithi027 bash[22610]: audit 2024-08-31T07:41:41.853631+0000 mon.a (mon.0) 2705 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:41:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:43 smithi191 bash[24992]: audit 2024-08-31T07:41:41.820338+0000 mgr.a (mgr.14388) 14288 : audit [DBG] from='client.310572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:43 smithi191 bash[24992]: audit 2024-08-31T07:41:42.439292+0000 mon.a (mon.0) 2706 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:41:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:43 smithi191 bash[24992]: audit 2024-08-31T07:41:42.444549+0000 mon.a (mon.0) 2707 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:41:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:43 smithi191 bash[24992]: audit 2024-08-31T07:41:43.229468+0000 mon.a (mon.0) 2708 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:41:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:43 smithi191 bash[24992]: audit 2024-08-31T07:41:43.231257+0000 mon.a (mon.0) 2709 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:41:43.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:43 smithi191 bash[24992]: audit 2024-08-31T07:41:43.241114+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:41:43.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:43 smithi191 bash[24992]: audit 2024-08-31T07:41:43.244468+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:41:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:43 smithi163 bash[24253]: audit 2024-08-31T07:41:41.820338+0000 mgr.a (mgr.14388) 14288 : audit [DBG] from='client.310572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:43 smithi163 bash[24253]: audit 2024-08-31T07:41:42.439292+0000 mon.a (mon.0) 2706 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:41:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:43 smithi163 bash[24253]: audit 2024-08-31T07:41:42.444549+0000 mon.a (mon.0) 2707 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:41:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:43 smithi163 bash[24253]: audit 2024-08-31T07:41:43.229468+0000 mon.a (mon.0) 2708 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:41:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:43 smithi163 bash[24253]: audit 2024-08-31T07:41:43.231257+0000 mon.a (mon.0) 2709 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:41:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:43 smithi163 bash[24253]: audit 2024-08-31T07:41:43.241114+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:41:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:43 smithi163 bash[24253]: audit 2024-08-31T07:41:43.244468+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:41:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:43 smithi027 bash[22610]: audit 2024-08-31T07:41:41.820338+0000 mgr.a (mgr.14388) 14288 : audit [DBG] from='client.310572 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:43 smithi027 bash[22610]: audit 2024-08-31T07:41:42.439292+0000 mon.a (mon.0) 2706 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:41:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:43 smithi027 bash[22610]: audit 2024-08-31T07:41:42.444549+0000 mon.a (mon.0) 2707 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:41:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:43 smithi027 bash[22610]: audit 2024-08-31T07:41:43.229468+0000 mon.a (mon.0) 2708 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:41:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:43 smithi027 bash[22610]: audit 2024-08-31T07:41:43.231257+0000 mon.a (mon.0) 2709 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:41:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:43 smithi027 bash[22610]: audit 2024-08-31T07:41:43.241114+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:41:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:43 smithi027 bash[22610]: audit 2024-08-31T07:41:43.244468+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:41:44.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:41:43 smithi027 bash[22863]: debug 2024-08-31T07:41:43.976+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:41:44.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:41:43 smithi027 bash[22863]: debug 2024-08-31T07:41:43.976+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:41:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:44 smithi191 bash[24992]: cluster 2024-08-31T07:41:42.758589+0000 mgr.a (mgr.14388) 14289 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:44 smithi191 bash[24992]: audit 2024-08-31T07:41:43.246662+0000 mgr.a (mgr.14388) 14290 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:41:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:44 smithi163 bash[24253]: cluster 2024-08-31T07:41:42.758589+0000 mgr.a (mgr.14388) 14289 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:44 smithi163 bash[24253]: audit 2024-08-31T07:41:43.246662+0000 mgr.a (mgr.14388) 14290 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:41:44.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:44 smithi027 bash[22610]: cluster 2024-08-31T07:41:42.758589+0000 mgr.a (mgr.14388) 14289 : cluster [DBG] pgmap v9906: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:44.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:44 smithi027 bash[22610]: audit 2024-08-31T07:41:43.246662+0000 mgr.a (mgr.14388) 14290 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:41:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:45 smithi191 bash[24992]: audit 2024-08-31T07:41:43.978912+0000 mgr.a (mgr.14388) 14291 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:41:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:45 smithi191 bash[24992]: cephadm 2024-08-31T07:41:43.980959+0000 mgr.a (mgr.14388) 14292 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:41:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:45 smithi163 bash[24253]: audit 2024-08-31T07:41:43.978912+0000 mgr.a (mgr.14388) 14291 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:41:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:45 smithi163 bash[24253]: cephadm 2024-08-31T07:41:43.980959+0000 mgr.a (mgr.14388) 14292 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:41:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:45 smithi027 bash[22610]: audit 2024-08-31T07:41:43.978912+0000 mgr.a (mgr.14388) 14291 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:41:45.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:45 smithi027 bash[22610]: cephadm 2024-08-31T07:41:43.980959+0000 mgr.a (mgr.14388) 14292 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:41:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:46 smithi191 bash[24992]: cluster 2024-08-31T07:41:44.761297+0000 mgr.a (mgr.14388) 14293 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:46 smithi163 bash[24253]: cluster 2024-08-31T07:41:44.761297+0000 mgr.a (mgr.14388) 14293 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:46 smithi027 bash[22610]: cluster 2024-08-31T07:41:44.761297+0000 mgr.a (mgr.14388) 14293 : cluster [DBG] pgmap v9907: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:41:47.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:47.245 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:47.245 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:48.006 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:48.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:48.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:48.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:48.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:41:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:48 smithi191 bash[24992]: cluster 2024-08-31T07:41:46.762060+0000 mgr.a (mgr.14388) 14294 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:48 smithi163 bash[24253]: cluster 2024-08-31T07:41:46.762060+0000 mgr.a (mgr.14388) 14294 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:48 smithi027 bash[22610]: cluster 2024-08-31T07:41:46.762060+0000 mgr.a (mgr.14388) 14294 : cluster [DBG] pgmap v9908: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:41:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:49 smithi191 bash[24992]: audit 2024-08-31T07:41:47.582284+0000 mgr.a (mgr.14388) 14295 : audit [DBG] from='client.310755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:49 smithi163 bash[24253]: audit 2024-08-31T07:41:47.582284+0000 mgr.a (mgr.14388) 14295 : audit [DBG] from='client.310755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:49 smithi027 bash[22610]: audit 2024-08-31T07:41:47.582284+0000 mgr.a (mgr.14388) 14295 : audit [DBG] from='client.310755 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:50 smithi191 bash[24992]: cluster 2024-08-31T07:41:48.764389+0000 mgr.a (mgr.14388) 14296 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:50 smithi163 bash[24253]: cluster 2024-08-31T07:41:48.764389+0000 mgr.a (mgr.14388) 14296 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:50 smithi027 bash[22610]: cluster 2024-08-31T07:41:48.764389+0000 mgr.a (mgr.14388) 14296 : cluster [DBG] pgmap v9909: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:52 smithi163 bash[24253]: cluster 2024-08-31T07:41:50.765142+0000 mgr.a (mgr.14388) 14297 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:52 smithi027 bash[22610]: cluster 2024-08-31T07:41:50.765142+0000 mgr.a (mgr.14388) 14297 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:52 smithi191 bash[24992]: cluster 2024-08-31T07:41:50.765142+0000 mgr.a (mgr.14388) 14297 : cluster [DBG] pgmap v9910: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:53.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:53.008 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:53.009 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:53.794 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:53.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:53.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:53.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:53.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:41:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:54 smithi163 bash[24253]: cluster 2024-08-31T07:41:52.765896+0000 mgr.a (mgr.14388) 14298 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:54 smithi027 bash[22610]: cluster 2024-08-31T07:41:52.765896+0000 mgr.a (mgr.14388) 14298 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:54 smithi191 bash[24992]: cluster 2024-08-31T07:41:52.765896+0000 mgr.a (mgr.14388) 14298 : cluster [DBG] pgmap v9911: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:55 smithi163 bash[24253]: audit 2024-08-31T07:41:53.347906+0000 mgr.a (mgr.14388) 14299 : audit [DBG] from='client.310833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:55 smithi163 bash[24253]: cluster 2024-08-31T07:41:54.768765+0000 mgr.a (mgr.14388) 14300 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:55 smithi027 bash[22610]: audit 2024-08-31T07:41:53.347906+0000 mgr.a (mgr.14388) 14299 : audit [DBG] from='client.310833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:55.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:55 smithi027 bash[22610]: cluster 2024-08-31T07:41:54.768765+0000 mgr.a (mgr.14388) 14300 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:55 smithi191 bash[24992]: audit 2024-08-31T07:41:53.347906+0000 mgr.a (mgr.14388) 14299 : audit [DBG] from='client.310833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:41:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:55 smithi191 bash[24992]: cluster 2024-08-31T07:41:54.768765+0000 mgr.a (mgr.14388) 14300 : cluster [DBG] pgmap v9912: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:41:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:57 smithi163 bash[24253]: cluster 2024-08-31T07:41:56.769556+0000 mgr.a (mgr.14388) 14301 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:41:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:57 smithi027 bash[22610]: cluster 2024-08-31T07:41:56.769556+0000 mgr.a (mgr.14388) 14301 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:41:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:57 smithi191 bash[24992]: cluster 2024-08-31T07:41:56.769556+0000 mgr.a (mgr.14388) 14301 : cluster [DBG] pgmap v9913: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:41:58.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:41:58.796 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:41:58.796 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:41:59.538 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:41:59.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:41:59.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:41:59.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:41:59.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:59 smithi163 bash[24253]: cluster 2024-08-31T07:41:58.771548+0000 mgr.a (mgr.14388) 14302 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:42:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:41:59 smithi163 bash[24253]: audit 2024-08-31T07:41:59.118485+0000 mgr.a (mgr.14388) 14303 : audit [DBG] from='client.310911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:59 smithi027 bash[22610]: cluster 2024-08-31T07:41:58.771548+0000 mgr.a (mgr.14388) 14302 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:42:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:41:59 smithi027 bash[22610]: audit 2024-08-31T07:41:59.118485+0000 mgr.a (mgr.14388) 14303 : audit [DBG] from='client.310911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:59 smithi191 bash[24992]: cluster 2024-08-31T07:41:58.771548+0000 mgr.a (mgr.14388) 14302 : cluster [DBG] pgmap v9914: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:42:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:41:59 smithi191 bash[24992]: audit 2024-08-31T07:41:59.118485+0000 mgr.a (mgr.14388) 14303 : audit [DBG] from='client.310911 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:01 smithi163 bash[24253]: cluster 2024-08-31T07:42:00.772424+0000 mgr.a (mgr.14388) 14304 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:42:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:01 smithi027 bash[22610]: cluster 2024-08-31T07:42:00.772424+0000 mgr.a (mgr.14388) 14304 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:42:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:01 smithi191 bash[24992]: cluster 2024-08-31T07:42:00.772424+0000 mgr.a (mgr.14388) 14304 : cluster [DBG] pgmap v9915: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:42:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:03 smithi163 bash[24253]: cluster 2024-08-31T07:42:02.773218+0000 mgr.a (mgr.14388) 14305 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:42:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:03 smithi027 bash[22610]: cluster 2024-08-31T07:42:02.773218+0000 mgr.a (mgr.14388) 14305 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:42:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:03 smithi191 bash[24992]: cluster 2024-08-31T07:42:02.773218+0000 mgr.a (mgr.14388) 14305 : cluster [DBG] pgmap v9916: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:42:04.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:42:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:42:04.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:42:05.326 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:42:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:42:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:42:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:42:05.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:05 smithi163 bash[24253]: cluster 2024-08-31T07:42:04.775463+0000 mgr.a (mgr.14388) 14306 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:05 smithi163 bash[24253]: audit 2024-08-31T07:42:04.876147+0000 mgr.a (mgr.14388) 14307 : audit [DBG] from='client.310989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:05 smithi027 bash[22610]: cluster 2024-08-31T07:42:04.775463+0000 mgr.a (mgr.14388) 14306 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:05 smithi027 bash[22610]: audit 2024-08-31T07:42:04.876147+0000 mgr.a (mgr.14388) 14307 : audit [DBG] from='client.310989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:05 smithi191 bash[24992]: cluster 2024-08-31T07:42:04.775463+0000 mgr.a (mgr.14388) 14306 : cluster [DBG] pgmap v9917: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:05 smithi191 bash[24992]: audit 2024-08-31T07:42:04.876147+0000 mgr.a (mgr.14388) 14307 : audit [DBG] from='client.310989 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:07 smithi163 bash[24253]: cluster 2024-08-31T07:42:06.776406+0000 mgr.a (mgr.14388) 14308 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:08.665 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:07 smithi191 bash[24992]: cluster 2024-08-31T07:42:06.776406+0000 mgr.a (mgr.14388) 14308 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:08.665 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:07 smithi027 bash[22610]: cluster 2024-08-31T07:42:06.776406+0000 mgr.a (mgr.14388) 14308 : cluster [DBG] pgmap v9918: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:09 smithi163 bash[24253]: cluster 2024-08-31T07:42:08.778624+0000 mgr.a (mgr.14388) 14309 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:42:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:09 smithi027 bash[22610]: cluster 2024-08-31T07:42:08.778624+0000 mgr.a (mgr.14388) 14309 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:42:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:09 smithi191 bash[24992]: cluster 2024-08-31T07:42:08.778624+0000 mgr.a (mgr.14388) 14309 : cluster [DBG] pgmap v9919: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:42:10.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:42:10.328 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:42:10.328 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:42:11.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:42:11.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:42:11.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:42:11.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:42:11.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:11 smithi163 bash[24253]: audit 2024-08-31T07:42:10.666784+0000 mgr.a (mgr.14388) 14310 : audit [DBG] from='client.311067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:11 smithi163 bash[24253]: cluster 2024-08-31T07:42:10.779374+0000 mgr.a (mgr.14388) 14311 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:11 smithi027 bash[22610]: audit 2024-08-31T07:42:10.666784+0000 mgr.a (mgr.14388) 14310 : audit [DBG] from='client.311067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:11 smithi027 bash[22610]: cluster 2024-08-31T07:42:10.779374+0000 mgr.a (mgr.14388) 14311 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:11 smithi191 bash[24992]: audit 2024-08-31T07:42:10.666784+0000 mgr.a (mgr.14388) 14310 : audit [DBG] from='client.311067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:11 smithi191 bash[24992]: cluster 2024-08-31T07:42:10.779374+0000 mgr.a (mgr.14388) 14311 : cluster [DBG] pgmap v9920: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:13 smithi163 bash[24253]: cluster 2024-08-31T07:42:12.780291+0000 mgr.a (mgr.14388) 14312 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:13 smithi027 bash[22610]: cluster 2024-08-31T07:42:12.780291+0000 mgr.a (mgr.14388) 14312 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:13 smithi191 bash[24992]: cluster 2024-08-31T07:42:12.780291+0000 mgr.a (mgr.14388) 14312 : cluster [DBG] pgmap v9921: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:16.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:42:16.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:42:16.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:42:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:15 smithi163 bash[24253]: cluster 2024-08-31T07:42:14.782486+0000 mgr.a (mgr.14388) 14313 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:42:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:15 smithi027 bash[22610]: cluster 2024-08-31T07:42:14.782486+0000 mgr.a (mgr.14388) 14313 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:42:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:15 smithi191 bash[24992]: cluster 2024-08-31T07:42:14.782486+0000 mgr.a (mgr.14388) 14313 : cluster [DBG] pgmap v9922: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:42:16.857 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:42:16.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:42:16.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:42:16.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:42:16.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:17 smithi163 bash[24253]: audit 2024-08-31T07:42:16.433879+0000 mgr.a (mgr.14388) 14314 : audit [DBG] from='client.311145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:17 smithi163 bash[24253]: cluster 2024-08-31T07:42:16.783183+0000 mgr.a (mgr.14388) 14315 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:17 smithi027 bash[22610]: audit 2024-08-31T07:42:16.433879+0000 mgr.a (mgr.14388) 14314 : audit [DBG] from='client.311145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:17 smithi027 bash[22610]: cluster 2024-08-31T07:42:16.783183+0000 mgr.a (mgr.14388) 14315 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:17 smithi191 bash[24992]: audit 2024-08-31T07:42:16.433879+0000 mgr.a (mgr.14388) 14314 : audit [DBG] from='client.311145 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:17 smithi191 bash[24992]: cluster 2024-08-31T07:42:16.783183+0000 mgr.a (mgr.14388) 14315 : cluster [DBG] pgmap v9923: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:19 smithi163 bash[24253]: cluster 2024-08-31T07:42:18.785341+0000 mgr.a (mgr.14388) 14316 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:42:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:19 smithi027 bash[22610]: cluster 2024-08-31T07:42:18.785341+0000 mgr.a (mgr.14388) 14316 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:42:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:19 smithi191 bash[24992]: cluster 2024-08-31T07:42:18.785341+0000 mgr.a (mgr.14388) 14316 : cluster [DBG] pgmap v9924: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:42:21.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:42:21.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:42:21.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:42:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:21 smithi163 bash[24253]: cluster 2024-08-31T07:42:20.786103+0000 mgr.a (mgr.14388) 14317 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:21 smithi027 bash[22610]: cluster 2024-08-31T07:42:20.786103+0000 mgr.a (mgr.14388) 14317 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:21 smithi191 bash[24992]: cluster 2024-08-31T07:42:20.786103+0000 mgr.a (mgr.14388) 14317 : cluster [DBG] pgmap v9925: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:22.635 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:42:22.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:42:22.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:42:22.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:42:22.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:22 smithi163 bash[24253]: audit 2024-08-31T07:42:22.197256+0000 mgr.a (mgr.14388) 14318 : audit [DBG] from='client.311220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:22 smithi027 bash[22610]: audit 2024-08-31T07:42:22.197256+0000 mgr.a (mgr.14388) 14318 : audit [DBG] from='client.311220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:22 smithi191 bash[24992]: audit 2024-08-31T07:42:22.197256+0000 mgr.a (mgr.14388) 14318 : audit [DBG] from='client.311220 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:23 smithi163 bash[24253]: cluster 2024-08-31T07:42:22.787033+0000 mgr.a (mgr.14388) 14319 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:23 smithi027 bash[22610]: cluster 2024-08-31T07:42:22.787033+0000 mgr.a (mgr.14388) 14319 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:23 smithi191 bash[24992]: cluster 2024-08-31T07:42:22.787033+0000 mgr.a (mgr.14388) 14319 : cluster [DBG] pgmap v9926: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:25 smithi163 bash[24253]: cluster 2024-08-31T07:42:24.789158+0000 mgr.a (mgr.14388) 14320 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:42:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:25 smithi027 bash[22610]: cluster 2024-08-31T07:42:24.789158+0000 mgr.a (mgr.14388) 14320 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:42:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:25 smithi191 bash[24992]: cluster 2024-08-31T07:42:24.789158+0000 mgr.a (mgr.14388) 14320 : cluster [DBG] pgmap v9927: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T07:42:27.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:42:27.637 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:42:27.637 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:42:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:27 smithi163 bash[24253]: cluster 2024-08-31T07:42:26.789916+0000 mgr.a (mgr.14388) 14321 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:42:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:27 smithi027 bash[22610]: cluster 2024-08-31T07:42:26.789916+0000 mgr.a (mgr.14388) 14321 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:42:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:27 smithi191 bash[24992]: cluster 2024-08-31T07:42:26.789916+0000 mgr.a (mgr.14388) 14321 : cluster [DBG] pgmap v9928: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:42:28.403 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:42:28.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:42:28.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:42:28.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:42:28.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:29.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:28 smithi163 bash[24253]: audit 2024-08-31T07:42:27.970045+0000 mgr.a (mgr.14388) 14322 : audit [DBG] from='client.311298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:28 smithi027 bash[22610]: audit 2024-08-31T07:42:27.970045+0000 mgr.a (mgr.14388) 14322 : audit [DBG] from='client.311298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:28 smithi191 bash[24992]: audit 2024-08-31T07:42:27.970045+0000 mgr.a (mgr.14388) 14322 : audit [DBG] from='client.311298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:29 smithi163 bash[24253]: cluster 2024-08-31T07:42:28.792630+0000 mgr.a (mgr.14388) 14323 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:42:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:29 smithi027 bash[22610]: cluster 2024-08-31T07:42:28.792630+0000 mgr.a (mgr.14388) 14323 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:42:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:29 smithi191 bash[24992]: cluster 2024-08-31T07:42:28.792630+0000 mgr.a (mgr.14388) 14323 : cluster [DBG] pgmap v9929: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:42:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:31 smithi163 bash[24253]: cluster 2024-08-31T07:42:30.793400+0000 mgr.a (mgr.14388) 14324 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:42:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:31 smithi027 bash[22610]: cluster 2024-08-31T07:42:30.793400+0000 mgr.a (mgr.14388) 14324 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:42:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:31 smithi191 bash[24992]: cluster 2024-08-31T07:42:30.793400+0000 mgr.a (mgr.14388) 14324 : cluster [DBG] pgmap v9930: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:42:33.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:42:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:42:33.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:42:34.192 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:42:34.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:42:34.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:42:34.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:42:34.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:33 smithi163 bash[24253]: cluster 2024-08-31T07:42:32.794858+0000 mgr.a (mgr.14388) 14325 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:42:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:33 smithi027 bash[22610]: cluster 2024-08-31T07:42:32.794858+0000 mgr.a (mgr.14388) 14325 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:42:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:33 smithi191 bash[24992]: cluster 2024-08-31T07:42:32.794858+0000 mgr.a (mgr.14388) 14325 : cluster [DBG] pgmap v9931: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:42:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:34 smithi163 bash[24253]: audit 2024-08-31T07:42:33.741245+0000 mgr.a (mgr.14388) 14326 : audit [DBG] from='client.311376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:34 smithi027 bash[22610]: audit 2024-08-31T07:42:33.741245+0000 mgr.a (mgr.14388) 14326 : audit [DBG] from='client.311376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:34 smithi191 bash[24992]: audit 2024-08-31T07:42:33.741245+0000 mgr.a (mgr.14388) 14326 : audit [DBG] from='client.311376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:35 smithi163 bash[24253]: cluster 2024-08-31T07:42:34.797184+0000 mgr.a (mgr.14388) 14327 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:42:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:35 smithi027 bash[22610]: cluster 2024-08-31T07:42:34.797184+0000 mgr.a (mgr.14388) 14327 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:42:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:35 smithi191 bash[24992]: cluster 2024-08-31T07:42:34.797184+0000 mgr.a (mgr.14388) 14327 : cluster [DBG] pgmap v9932: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:42:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:37 smithi163 bash[24253]: cluster 2024-08-31T07:42:36.797967+0000 mgr.a (mgr.14388) 14328 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:42:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:37 smithi027 bash[22610]: cluster 2024-08-31T07:42:36.797967+0000 mgr.a (mgr.14388) 14328 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:42:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:37 smithi191 bash[24992]: cluster 2024-08-31T07:42:36.797967+0000 mgr.a (mgr.14388) 14328 : cluster [DBG] pgmap v9933: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:42:39.194 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:42:39.195 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:42:39.195 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:42:39.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:42:39.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:42:39.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:42:39.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:39.936 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:42:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:39 smithi163 bash[24253]: cluster 2024-08-31T07:42:38.799995+0000 mgr.a (mgr.14388) 14329 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:40.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:39 smithi027 bash[22610]: cluster 2024-08-31T07:42:38.799995+0000 mgr.a (mgr.14388) 14329 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:39 smithi191 bash[24992]: cluster 2024-08-31T07:42:38.799995+0000 mgr.a (mgr.14388) 14329 : cluster [DBG] pgmap v9934: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:40 smithi163 bash[24253]: audit 2024-08-31T07:42:39.525308+0000 mgr.a (mgr.14388) 14330 : audit [DBG] from='client.311454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:40 smithi027 bash[22610]: audit 2024-08-31T07:42:39.525308+0000 mgr.a (mgr.14388) 14330 : audit [DBG] from='client.311454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:40 smithi191 bash[24992]: audit 2024-08-31T07:42:39.525308+0000 mgr.a (mgr.14388) 14330 : audit [DBG] from='client.311454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:41 smithi163 bash[24253]: cluster 2024-08-31T07:42:40.800990+0000 mgr.a (mgr.14388) 14331 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:41 smithi027 bash[22610]: cluster 2024-08-31T07:42:40.800990+0000 mgr.a (mgr.14388) 14331 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:41 smithi191 bash[24992]: cluster 2024-08-31T07:42:40.800990+0000 mgr.a (mgr.14388) 14331 : cluster [DBG] pgmap v9935: 225 pgs: 225 active+clean; 589 KiB data, 152 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:42:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:43 smithi027 bash[22610]: cluster 2024-08-31T07:42:42.802377+0000 mgr.a (mgr.14388) 14332 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:42:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:43 smithi191 bash[24992]: cluster 2024-08-31T07:42:42.802377+0000 mgr.a (mgr.14388) 14332 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:42:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:43 smithi163 bash[24253]: cluster 2024-08-31T07:42:42.802377+0000 mgr.a (mgr.14388) 14332 : cluster [DBG] pgmap v9936: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:42:44.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:42:44.938 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:42:44.938 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:42:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:44 smithi027 bash[22610]: audit 2024-08-31T07:42:44.031803+0000 mon.a (mon.0) 2712 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:42:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:44 smithi027 bash[22610]: audit 2024-08-31T07:42:44.643538+0000 mon.a (mon.0) 2713 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:44 smithi027 bash[22610]: audit 2024-08-31T07:42:44.651001+0000 mon.a (mon.0) 2714 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:44 smithi027 bash[22610]: audit 2024-08-31T07:42:44.665679+0000 mon.a (mon.0) 2715 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:44 smithi027 bash[22610]: audit 2024-08-31T07:42:44.673483+0000 mon.a (mon.0) 2716 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:44 smithi191 bash[24992]: audit 2024-08-31T07:42:44.031803+0000 mon.a (mon.0) 2712 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:42:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:44 smithi191 bash[24992]: audit 2024-08-31T07:42:44.643538+0000 mon.a (mon.0) 2713 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:44 smithi191 bash[24992]: audit 2024-08-31T07:42:44.651001+0000 mon.a (mon.0) 2714 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:44 smithi191 bash[24992]: audit 2024-08-31T07:42:44.665679+0000 mon.a (mon.0) 2715 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:44 smithi191 bash[24992]: audit 2024-08-31T07:42:44.673483+0000 mon.a (mon.0) 2716 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:44 smithi163 bash[24253]: audit 2024-08-31T07:42:44.031803+0000 mon.a (mon.0) 2712 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:42:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:44 smithi163 bash[24253]: audit 2024-08-31T07:42:44.643538+0000 mon.a (mon.0) 2713 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:44 smithi163 bash[24253]: audit 2024-08-31T07:42:44.651001+0000 mon.a (mon.0) 2714 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:44 smithi163 bash[24253]: audit 2024-08-31T07:42:44.665679+0000 mon.a (mon.0) 2715 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:44 smithi163 bash[24253]: audit 2024-08-31T07:42:44.673483+0000 mon.a (mon.0) 2716 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:45.731 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:42:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:42:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:42:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:42:45.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:45 smithi027 bash[22610]: cluster 2024-08-31T07:42:44.803425+0000 mgr.a (mgr.14388) 14333 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:42:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:45 smithi027 bash[22610]: audit 2024-08-31T07:42:45.270001+0000 mgr.a (mgr.14388) 14334 : audit [DBG] from='client.311532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:45 smithi027 bash[22610]: audit 2024-08-31T07:42:45.318685+0000 mon.a (mon.0) 2717 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:42:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:45 smithi027 bash[22610]: audit 2024-08-31T07:42:45.320422+0000 mon.a (mon.0) 2718 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:42:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:45 smithi027 bash[22610]: audit 2024-08-31T07:42:45.329569+0000 mon.a (mon.0) 2719 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:45 smithi027 bash[22610]: audit 2024-08-31T07:42:45.334940+0000 mon.a (mon.0) 2720 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:42:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:45 smithi191 bash[24992]: cluster 2024-08-31T07:42:44.803425+0000 mgr.a (mgr.14388) 14333 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:42:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:45 smithi191 bash[24992]: audit 2024-08-31T07:42:45.270001+0000 mgr.a (mgr.14388) 14334 : audit [DBG] from='client.311532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:45 smithi191 bash[24992]: audit 2024-08-31T07:42:45.318685+0000 mon.a (mon.0) 2717 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:42:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:45 smithi191 bash[24992]: audit 2024-08-31T07:42:45.320422+0000 mon.a (mon.0) 2718 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:42:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:45 smithi191 bash[24992]: audit 2024-08-31T07:42:45.329569+0000 mon.a (mon.0) 2719 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:45 smithi191 bash[24992]: audit 2024-08-31T07:42:45.334940+0000 mon.a (mon.0) 2720 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:42:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:45 smithi163 bash[24253]: cluster 2024-08-31T07:42:44.803425+0000 mgr.a (mgr.14388) 14333 : cluster [DBG] pgmap v9937: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:42:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:45 smithi163 bash[24253]: audit 2024-08-31T07:42:45.270001+0000 mgr.a (mgr.14388) 14334 : audit [DBG] from='client.311532 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:45 smithi163 bash[24253]: audit 2024-08-31T07:42:45.318685+0000 mon.a (mon.0) 2717 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:42:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:45 smithi163 bash[24253]: audit 2024-08-31T07:42:45.320422+0000 mon.a (mon.0) 2718 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:42:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:45 smithi163 bash[24253]: audit 2024-08-31T07:42:45.329569+0000 mon.a (mon.0) 2719 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:42:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:45 smithi163 bash[24253]: audit 2024-08-31T07:42:45.334940+0000 mon.a (mon.0) 2720 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:42:46.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:42:46 smithi027 bash[22863]: debug 2024-08-31T07:42:46.427+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:42:46.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:42:46 smithi027 bash[22863]: debug 2024-08-31T07:42:46.431+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:42:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:46 smithi027 bash[22610]: audit 2024-08-31T07:42:45.336280+0000 mgr.a (mgr.14388) 14335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:42:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:46 smithi191 bash[24992]: audit 2024-08-31T07:42:45.336280+0000 mgr.a (mgr.14388) 14335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:42:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:46 smithi163 bash[24253]: audit 2024-08-31T07:42:45.336280+0000 mgr.a (mgr.14388) 14335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:42:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:47 smithi027 bash[22610]: audit 2024-08-31T07:42:46.433722+0000 mgr.a (mgr.14388) 14336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:42:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:47 smithi027 bash[22610]: cephadm 2024-08-31T07:42:46.435267+0000 mgr.a (mgr.14388) 14337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:42:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:47 smithi027 bash[22610]: cluster 2024-08-31T07:42:46.804374+0000 mgr.a (mgr.14388) 14338 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:42:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:47 smithi191 bash[24992]: audit 2024-08-31T07:42:46.433722+0000 mgr.a (mgr.14388) 14336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:42:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:47 smithi191 bash[24992]: cephadm 2024-08-31T07:42:46.435267+0000 mgr.a (mgr.14388) 14337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:42:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:47 smithi191 bash[24992]: cluster 2024-08-31T07:42:46.804374+0000 mgr.a (mgr.14388) 14338 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:42:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:47 smithi163 bash[24253]: audit 2024-08-31T07:42:46.433722+0000 mgr.a (mgr.14388) 14336 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:42:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:47 smithi163 bash[24253]: cephadm 2024-08-31T07:42:46.435267+0000 mgr.a (mgr.14388) 14337 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:42:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:47 smithi163 bash[24253]: cluster 2024-08-31T07:42:46.804374+0000 mgr.a (mgr.14388) 14338 : cluster [DBG] pgmap v9938: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:42:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:49 smithi027 bash[22610]: cluster 2024-08-31T07:42:48.806583+0000 mgr.a (mgr.14388) 14339 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T07:42:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:49 smithi191 bash[24992]: cluster 2024-08-31T07:42:48.806583+0000 mgr.a (mgr.14388) 14339 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T07:42:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:49 smithi163 bash[24253]: cluster 2024-08-31T07:42:48.806583+0000 mgr.a (mgr.14388) 14339 : cluster [DBG] pgmap v9939: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T07:42:50.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:42:50.734 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:42:50.734 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:42:51.500 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:42:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:42:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:42:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:42:51.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:51 smithi027 bash[22610]: cluster 2024-08-31T07:42:50.807134+0000 mgr.a (mgr.14388) 14340 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T07:42:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:51 smithi027 bash[22610]: audit 2024-08-31T07:42:51.070129+0000 mgr.a (mgr.14388) 14341 : audit [DBG] from='client.311715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:52.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:51 smithi191 bash[24992]: cluster 2024-08-31T07:42:50.807134+0000 mgr.a (mgr.14388) 14340 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T07:42:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:51 smithi191 bash[24992]: audit 2024-08-31T07:42:51.070129+0000 mgr.a (mgr.14388) 14341 : audit [DBG] from='client.311715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:51 smithi163 bash[24253]: cluster 2024-08-31T07:42:50.807134+0000 mgr.a (mgr.14388) 14340 : cluster [DBG] pgmap v9940: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T07:42:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:51 smithi163 bash[24253]: audit 2024-08-31T07:42:51.070129+0000 mgr.a (mgr.14388) 14341 : audit [DBG] from='client.311715 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:53 smithi191 bash[24992]: cluster 2024-08-31T07:42:52.808683+0000 mgr.a (mgr.14388) 14342 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T07:42:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:53 smithi163 bash[24253]: cluster 2024-08-31T07:42:52.808683+0000 mgr.a (mgr.14388) 14342 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T07:42:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:53 smithi027 bash[22610]: cluster 2024-08-31T07:42:52.808683+0000 mgr.a (mgr.14388) 14342 : cluster [DBG] pgmap v9941: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T07:42:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:55 smithi191 bash[24992]: cluster 2024-08-31T07:42:54.810371+0000 mgr.a (mgr.14388) 14343 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 426 B/s wr, 36 op/s 2024-08-31T07:42:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:55 smithi163 bash[24253]: cluster 2024-08-31T07:42:54.810371+0000 mgr.a (mgr.14388) 14343 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 426 B/s wr, 36 op/s 2024-08-31T07:42:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:55 smithi027 bash[22610]: cluster 2024-08-31T07:42:54.810371+0000 mgr.a (mgr.14388) 14343 : cluster [DBG] pgmap v9942: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 25 KiB/s rd, 426 B/s wr, 36 op/s 2024-08-31T07:42:56.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:42:56.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:42:56.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:42:57.269 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:42:57.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:42:57.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:42:57.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:42:57.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:42:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:57 smithi191 bash[24992]: cluster 2024-08-31T07:42:56.811288+0000 mgr.a (mgr.14388) 14344 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:42:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:57 smithi191 bash[24992]: audit 2024-08-31T07:42:56.838436+0000 mgr.a (mgr.14388) 14345 : audit [DBG] from='client.311787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:57 smithi163 bash[24253]: cluster 2024-08-31T07:42:56.811288+0000 mgr.a (mgr.14388) 14344 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:42:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:57 smithi163 bash[24253]: audit 2024-08-31T07:42:56.838436+0000 mgr.a (mgr.14388) 14345 : audit [DBG] from='client.311787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:42:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:57 smithi027 bash[22610]: cluster 2024-08-31T07:42:56.811288+0000 mgr.a (mgr.14388) 14344 : cluster [DBG] pgmap v9943: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:42:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:57 smithi027 bash[22610]: audit 2024-08-31T07:42:56.838436+0000 mgr.a (mgr.14388) 14345 : audit [DBG] from='client.311787 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:42:59 smithi191 bash[24992]: cluster 2024-08-31T07:42:58.813746+0000 mgr.a (mgr.14388) 14346 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:43:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:42:59 smithi163 bash[24253]: cluster 2024-08-31T07:42:58.813746+0000 mgr.a (mgr.14388) 14346 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:43:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:42:59 smithi027 bash[22610]: cluster 2024-08-31T07:42:58.813746+0000 mgr.a (mgr.14388) 14346 : cluster [DBG] pgmap v9944: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:43:02.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:43:02.271 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:43:02.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:43:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:02 smithi191 bash[24992]: cluster 2024-08-31T07:43:00.814538+0000 mgr.a (mgr.14388) 14347 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:02 smithi163 bash[24253]: cluster 2024-08-31T07:43:00.814538+0000 mgr.a (mgr.14388) 14347 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:02 smithi027 bash[22610]: cluster 2024-08-31T07:43:00.814538+0000 mgr.a (mgr.14388) 14347 : cluster [DBG] pgmap v9945: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:03.027 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:43:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:43:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:43:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:43:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:43:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:04 smithi191 bash[24992]: audit 2024-08-31T07:43:02.606898+0000 mgr.a (mgr.14388) 14348 : audit [DBG] from='client.311862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:04 smithi191 bash[24992]: cluster 2024-08-31T07:43:02.815507+0000 mgr.a (mgr.14388) 14349 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:04 smithi163 bash[24253]: audit 2024-08-31T07:43:02.606898+0000 mgr.a (mgr.14388) 14348 : audit [DBG] from='client.311862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:04 smithi163 bash[24253]: cluster 2024-08-31T07:43:02.815507+0000 mgr.a (mgr.14388) 14349 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:04 smithi027 bash[22610]: audit 2024-08-31T07:43:02.606898+0000 mgr.a (mgr.14388) 14348 : audit [DBG] from='client.311862 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:04 smithi027 bash[22610]: cluster 2024-08-31T07:43:02.815507+0000 mgr.a (mgr.14388) 14349 : cluster [DBG] pgmap v9946: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:06 smithi191 bash[24992]: cluster 2024-08-31T07:43:04.817647+0000 mgr.a (mgr.14388) 14350 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:43:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:06 smithi163 bash[24253]: cluster 2024-08-31T07:43:04.817647+0000 mgr.a (mgr.14388) 14350 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:43:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:06 smithi027 bash[22610]: cluster 2024-08-31T07:43:04.817647+0000 mgr.a (mgr.14388) 14350 : cluster [DBG] pgmap v9947: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:43:08.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:43:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:43:08.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:43:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:08 smithi191 bash[24992]: cluster 2024-08-31T07:43:06.818435+0000 mgr.a (mgr.14388) 14351 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:43:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:08 smithi163 bash[24253]: cluster 2024-08-31T07:43:06.818435+0000 mgr.a (mgr.14388) 14351 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:43:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:08 smithi027 bash[22610]: cluster 2024-08-31T07:43:06.818435+0000 mgr.a (mgr.14388) 14351 : cluster [DBG] pgmap v9948: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:43:08.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:43:08.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:43:08.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:43:08.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:43:08.816 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:43:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:10 smithi191 bash[24992]: audit 2024-08-31T07:43:08.362987+0000 mgr.a (mgr.14388) 14352 : audit [DBG] from='client.311931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:10 smithi191 bash[24992]: cluster 2024-08-31T07:43:08.819696+0000 mgr.a (mgr.14388) 14353 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:10 smithi163 bash[24253]: audit 2024-08-31T07:43:08.362987+0000 mgr.a (mgr.14388) 14352 : audit [DBG] from='client.311931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:10 smithi163 bash[24253]: cluster 2024-08-31T07:43:08.819696+0000 mgr.a (mgr.14388) 14353 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:10 smithi027 bash[22610]: audit 2024-08-31T07:43:08.362987+0000 mgr.a (mgr.14388) 14352 : audit [DBG] from='client.311931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:10 smithi027 bash[22610]: cluster 2024-08-31T07:43:08.819696+0000 mgr.a (mgr.14388) 14353 : cluster [DBG] pgmap v9949: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:12 smithi191 bash[24992]: cluster 2024-08-31T07:43:10.820422+0000 mgr.a (mgr.14388) 14354 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:43:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:12 smithi163 bash[24253]: cluster 2024-08-31T07:43:10.820422+0000 mgr.a (mgr.14388) 14354 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:43:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:12 smithi027 bash[22610]: cluster 2024-08-31T07:43:10.820422+0000 mgr.a (mgr.14388) 14354 : cluster [DBG] pgmap v9950: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:43:13.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:43:13.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:43:13.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:43:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:14 smithi191 bash[24992]: cluster 2024-08-31T07:43:12.821605+0000 mgr.a (mgr.14388) 14355 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:43:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:14 smithi163 bash[24253]: cluster 2024-08-31T07:43:12.821605+0000 mgr.a (mgr.14388) 14355 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:43:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:14 smithi027 bash[22610]: cluster 2024-08-31T07:43:12.821605+0000 mgr.a (mgr.14388) 14355 : cluster [DBG] pgmap v9951: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:43:14.581 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:43:14.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:43:14.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:43:14.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:43:14.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:43:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:15 smithi191 bash[24992]: audit 2024-08-31T07:43:14.151426+0000 mgr.a (mgr.14388) 14356 : audit [DBG] from='client.312009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:15 smithi163 bash[24253]: audit 2024-08-31T07:43:14.151426+0000 mgr.a (mgr.14388) 14356 : audit [DBG] from='client.312009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:15 smithi027 bash[22610]: audit 2024-08-31T07:43:14.151426+0000 mgr.a (mgr.14388) 14356 : audit [DBG] from='client.312009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:16 smithi163 bash[24253]: cluster 2024-08-31T07:43:14.823888+0000 mgr.a (mgr.14388) 14357 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:16 smithi027 bash[22610]: cluster 2024-08-31T07:43:14.823888+0000 mgr.a (mgr.14388) 14357 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:16 smithi191 bash[24992]: cluster 2024-08-31T07:43:14.823888+0000 mgr.a (mgr.14388) 14357 : cluster [DBG] pgmap v9952: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:18 smithi163 bash[24253]: cluster 2024-08-31T07:43:16.824687+0000 mgr.a (mgr.14388) 14358 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:18 smithi027 bash[22610]: cluster 2024-08-31T07:43:16.824687+0000 mgr.a (mgr.14388) 14358 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:18 smithi191 bash[24992]: cluster 2024-08-31T07:43:16.824687+0000 mgr.a (mgr.14388) 14358 : cluster [DBG] pgmap v9953: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:19.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:43:19.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:43:19.584 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:43:20.329 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:43:20.330 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:43:20.330 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:43:20.330 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:43:20.330 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:43:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:20 smithi163 bash[24253]: cluster 2024-08-31T07:43:18.826685+0000 mgr.a (mgr.14388) 14359 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:20 smithi027 bash[22610]: cluster 2024-08-31T07:43:18.826685+0000 mgr.a (mgr.14388) 14359 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:20 smithi191 bash[24992]: cluster 2024-08-31T07:43:18.826685+0000 mgr.a (mgr.14388) 14359 : cluster [DBG] pgmap v9954: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:21 smithi163 bash[24253]: audit 2024-08-31T07:43:19.914197+0000 mgr.a (mgr.14388) 14360 : audit [DBG] from='client.312081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:21 smithi027 bash[22610]: audit 2024-08-31T07:43:19.914197+0000 mgr.a (mgr.14388) 14360 : audit [DBG] from='client.312081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:21 smithi191 bash[24992]: audit 2024-08-31T07:43:19.914197+0000 mgr.a (mgr.14388) 14360 : audit [DBG] from='client.312081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:22 smithi163 bash[24253]: cluster 2024-08-31T07:43:20.827788+0000 mgr.a (mgr.14388) 14361 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:22 smithi027 bash[22610]: cluster 2024-08-31T07:43:20.827788+0000 mgr.a (mgr.14388) 14361 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:22 smithi191 bash[24992]: cluster 2024-08-31T07:43:20.827788+0000 mgr.a (mgr.14388) 14361 : cluster [DBG] pgmap v9955: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:24 smithi163 bash[24253]: cluster 2024-08-31T07:43:22.829792+0000 mgr.a (mgr.14388) 14362 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:24 smithi027 bash[22610]: cluster 2024-08-31T07:43:22.829792+0000 mgr.a (mgr.14388) 14362 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:24 smithi191 bash[24992]: cluster 2024-08-31T07:43:22.829792+0000 mgr.a (mgr.14388) 14362 : cluster [DBG] pgmap v9956: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:25.331 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:43:25.331 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:43:25.332 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:43:26.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:43:26.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:43:26.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:43:26.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:43:26.098 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:43:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:26 smithi163 bash[24253]: cluster 2024-08-31T07:43:24.831209+0000 mgr.a (mgr.14388) 14363 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:43:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:26 smithi027 bash[22610]: cluster 2024-08-31T07:43:24.831209+0000 mgr.a (mgr.14388) 14363 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:43:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:26 smithi191 bash[24992]: cluster 2024-08-31T07:43:24.831209+0000 mgr.a (mgr.14388) 14363 : cluster [DBG] pgmap v9957: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:43:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:27 smithi163 bash[24253]: audit 2024-08-31T07:43:25.667713+0000 mgr.a (mgr.14388) 14364 : audit [DBG] from='client.312159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:27 smithi027 bash[22610]: audit 2024-08-31T07:43:25.667713+0000 mgr.a (mgr.14388) 14364 : audit [DBG] from='client.312159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:27 smithi191 bash[24992]: audit 2024-08-31T07:43:25.667713+0000 mgr.a (mgr.14388) 14364 : audit [DBG] from='client.312159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:28 smithi163 bash[24253]: cluster 2024-08-31T07:43:26.832235+0000 mgr.a (mgr.14388) 14365 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:28 smithi027 bash[22610]: cluster 2024-08-31T07:43:26.832235+0000 mgr.a (mgr.14388) 14365 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:28 smithi191 bash[24992]: cluster 2024-08-31T07:43:26.832235+0000 mgr.a (mgr.14388) 14365 : cluster [DBG] pgmap v9958: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:30 smithi163 bash[24253]: cluster 2024-08-31T07:43:28.834572+0000 mgr.a (mgr.14388) 14366 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:30 smithi027 bash[22610]: cluster 2024-08-31T07:43:28.834572+0000 mgr.a (mgr.14388) 14366 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:30 smithi191 bash[24992]: cluster 2024-08-31T07:43:28.834572+0000 mgr.a (mgr.14388) 14366 : cluster [DBG] pgmap v9959: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:31.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:43:31.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:43:31.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:43:31.883 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:43:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:43:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:43:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:43:31.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:43:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:32 smithi163 bash[24253]: cluster 2024-08-31T07:43:30.835397+0000 mgr.a (mgr.14388) 14367 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:32 smithi027 bash[22610]: cluster 2024-08-31T07:43:30.835397+0000 mgr.a (mgr.14388) 14367 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:32 smithi191 bash[24992]: cluster 2024-08-31T07:43:30.835397+0000 mgr.a (mgr.14388) 14367 : cluster [DBG] pgmap v9960: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:33 smithi163 bash[24253]: audit 2024-08-31T07:43:31.439107+0000 mgr.a (mgr.14388) 14368 : audit [DBG] from='client.312234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:33 smithi027 bash[22610]: audit 2024-08-31T07:43:31.439107+0000 mgr.a (mgr.14388) 14368 : audit [DBG] from='client.312234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:33 smithi191 bash[24992]: audit 2024-08-31T07:43:31.439107+0000 mgr.a (mgr.14388) 14368 : audit [DBG] from='client.312234 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:34 smithi163 bash[24253]: cluster 2024-08-31T07:43:32.837816+0000 mgr.a (mgr.14388) 14369 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:34 smithi027 bash[22610]: cluster 2024-08-31T07:43:32.837816+0000 mgr.a (mgr.14388) 14369 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:34 smithi191 bash[24992]: cluster 2024-08-31T07:43:32.837816+0000 mgr.a (mgr.14388) 14369 : cluster [DBG] pgmap v9961: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:36 smithi163 bash[24253]: cluster 2024-08-31T07:43:34.838613+0000 mgr.a (mgr.14388) 14370 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T07:43:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:36 smithi027 bash[22610]: cluster 2024-08-31T07:43:34.838613+0000 mgr.a (mgr.14388) 14370 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T07:43:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:36 smithi191 bash[24992]: cluster 2024-08-31T07:43:34.838613+0000 mgr.a (mgr.14388) 14370 : cluster [DBG] pgmap v9962: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.9 KiB/s rd, 1 op/s 2024-08-31T07:43:36.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:43:36.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:43:36.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:43:37.664 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:43:37.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:43:37.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:43:37.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:43:37.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:43:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:38 smithi163 bash[24253]: cluster 2024-08-31T07:43:36.839505+0000 mgr.a (mgr.14388) 14371 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:38 smithi163 bash[24253]: audit 2024-08-31T07:43:37.220660+0000 mgr.a (mgr.14388) 14372 : audit [DBG] from='client.312312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:38 smithi027 bash[22610]: cluster 2024-08-31T07:43:36.839505+0000 mgr.a (mgr.14388) 14371 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:38 smithi027 bash[22610]: audit 2024-08-31T07:43:37.220660+0000 mgr.a (mgr.14388) 14372 : audit [DBG] from='client.312312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:38 smithi191 bash[24992]: cluster 2024-08-31T07:43:36.839505+0000 mgr.a (mgr.14388) 14371 : cluster [DBG] pgmap v9963: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:38 smithi191 bash[24992]: audit 2024-08-31T07:43:37.220660+0000 mgr.a (mgr.14388) 14372 : audit [DBG] from='client.312312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:40 smithi163 bash[24253]: cluster 2024-08-31T07:43:38.841891+0000 mgr.a (mgr.14388) 14373 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:40 smithi027 bash[22610]: cluster 2024-08-31T07:43:38.841891+0000 mgr.a (mgr.14388) 14373 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:40 smithi191 bash[24992]: cluster 2024-08-31T07:43:38.841891+0000 mgr.a (mgr.14388) 14373 : cluster [DBG] pgmap v9964: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:43:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:42 smithi163 bash[24253]: cluster 2024-08-31T07:43:40.842665+0000 mgr.a (mgr.14388) 14374 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:42 smithi027 bash[22610]: cluster 2024-08-31T07:43:40.842665+0000 mgr.a (mgr.14388) 14374 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:42 smithi191 bash[24992]: cluster 2024-08-31T07:43:40.842665+0000 mgr.a (mgr.14388) 14374 : cluster [DBG] pgmap v9965: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:42.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:43:42.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:43:42.667 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:43:43.457 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:43:43.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:43:43.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:43:43.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:43:43.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:43:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:44 smithi163 bash[24253]: cluster 2024-08-31T07:43:42.844324+0000 mgr.a (mgr.14388) 14375 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:44 smithi163 bash[24253]: audit 2024-08-31T07:43:43.006168+0000 mgr.a (mgr.14388) 14376 : audit [DBG] from='client.312384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:44 smithi027 bash[22610]: cluster 2024-08-31T07:43:42.844324+0000 mgr.a (mgr.14388) 14375 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:44 smithi027 bash[22610]: audit 2024-08-31T07:43:43.006168+0000 mgr.a (mgr.14388) 14376 : audit [DBG] from='client.312384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:44 smithi191 bash[24992]: cluster 2024-08-31T07:43:42.844324+0000 mgr.a (mgr.14388) 14375 : cluster [DBG] pgmap v9966: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:44 smithi191 bash[24992]: audit 2024-08-31T07:43:43.006168+0000 mgr.a (mgr.14388) 14376 : audit [DBG] from='client.312384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:46 smithi163 bash[24253]: cluster 2024-08-31T07:43:44.845221+0000 mgr.a (mgr.14388) 14377 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:43:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:46 smithi027 bash[22610]: cluster 2024-08-31T07:43:44.845221+0000 mgr.a (mgr.14388) 14377 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:43:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:46 smithi191 bash[24992]: cluster 2024-08-31T07:43:44.845221+0000 mgr.a (mgr.14388) 14377 : cluster [DBG] pgmap v9967: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:43:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:47 smithi163 bash[24253]: audit 2024-08-31T07:43:46.496172+0000 mon.a (mon.0) 2721 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:43:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:47 smithi027 bash[22610]: audit 2024-08-31T07:43:46.496172+0000 mon.a (mon.0) 2721 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:43:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:47 smithi191 bash[24992]: audit 2024-08-31T07:43:46.496172+0000 mon.a (mon.0) 2721 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:43:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:48 smithi163 bash[24253]: cluster 2024-08-31T07:43:46.845950+0000 mgr.a (mgr.14388) 14378 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:43:48.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:43:48.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:43:48.460 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:43:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:48 smithi027 bash[22610]: cluster 2024-08-31T07:43:46.845950+0000 mgr.a (mgr.14388) 14378 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:43:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:48 smithi191 bash[24992]: cluster 2024-08-31T07:43:46.845950+0000 mgr.a (mgr.14388) 14378 : cluster [DBG] pgmap v9968: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:43:49.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:43:49.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:43:49.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:43:49.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:43:49.229 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:43:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:50 smithi163 bash[24253]: audit 2024-08-31T07:43:48.789912+0000 mgr.a (mgr.14388) 14379 : audit [DBG] from='client.312459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:50 smithi163 bash[24253]: cluster 2024-08-31T07:43:48.850989+0000 mgr.a (mgr.14388) 14380 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:50 smithi027 bash[22610]: audit 2024-08-31T07:43:48.789912+0000 mgr.a (mgr.14388) 14379 : audit [DBG] from='client.312459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:50 smithi027 bash[22610]: cluster 2024-08-31T07:43:48.850989+0000 mgr.a (mgr.14388) 14380 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:50 smithi191 bash[24992]: audit 2024-08-31T07:43:48.789912+0000 mgr.a (mgr.14388) 14379 : audit [DBG] from='client.312459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:50 smithi191 bash[24992]: cluster 2024-08-31T07:43:48.850989+0000 mgr.a (mgr.14388) 14380 : cluster [DBG] pgmap v9969: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:52 smithi163 bash[24253]: cluster 2024-08-31T07:43:50.851884+0000 mgr.a (mgr.14388) 14381 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:43:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:52 smithi027 bash[22610]: cluster 2024-08-31T07:43:50.851884+0000 mgr.a (mgr.14388) 14381 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:43:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:52 smithi191 bash[24992]: cluster 2024-08-31T07:43:50.851884+0000 mgr.a (mgr.14388) 14381 : cluster [DBG] pgmap v9970: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:43:54.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:43:54.231 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:43:54.231 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:43:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:54 smithi027 bash[22610]: cluster 2024-08-31T07:43:52.854019+0000 mgr.a (mgr.14388) 14382 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:54 smithi163 bash[24253]: cluster 2024-08-31T07:43:52.854019+0000 mgr.a (mgr.14388) 14382 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:54 smithi191 bash[24992]: cluster 2024-08-31T07:43:52.854019+0000 mgr.a (mgr.14388) 14382 : cluster [DBG] pgmap v9971: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:55.009 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:43:55.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:43:55.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:43:55.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:43:55.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:43:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:56 smithi163 bash[24253]: audit 2024-08-31T07:43:54.566594+0000 mgr.a (mgr.14388) 14383 : audit [DBG] from='client.312537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:56 smithi163 bash[24253]: cluster 2024-08-31T07:43:54.854631+0000 mgr.a (mgr.14388) 14384 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:56 smithi027 bash[22610]: audit 2024-08-31T07:43:54.566594+0000 mgr.a (mgr.14388) 14383 : audit [DBG] from='client.312537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:56 smithi027 bash[22610]: cluster 2024-08-31T07:43:54.854631+0000 mgr.a (mgr.14388) 14384 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:56 smithi191 bash[24992]: audit 2024-08-31T07:43:54.566594+0000 mgr.a (mgr.14388) 14383 : audit [DBG] from='client.312537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:43:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:56 smithi191 bash[24992]: cluster 2024-08-31T07:43:54.854631+0000 mgr.a (mgr.14388) 14384 : cluster [DBG] pgmap v9972: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:58.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:43:58 smithi027 bash[22863]: debug 2024-08-31T07:43:58.137+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:43:58.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:43:58 smithi027 bash[22863]: debug 2024-08-31T07:43:58.141+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:43:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:58 smithi027 bash[22610]: cluster 2024-08-31T07:43:56.855720+0000 mgr.a (mgr.14388) 14385 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:58 smithi027 bash[22610]: audit 2024-08-31T07:43:57.325511+0000 mon.a (mon.0) 2722 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:43:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:58 smithi027 bash[22610]: audit 2024-08-31T07:43:57.333456+0000 mon.a (mon.0) 2723 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:43:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:58 smithi027 bash[22610]: audit 2024-08-31T07:43:57.335831+0000 mon.a (mon.0) 2724 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:43:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:58 smithi027 bash[22610]: audit 2024-08-31T07:43:57.337642+0000 mon.a (mon.0) 2725 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:43:58.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:58 smithi027 bash[22610]: audit 2024-08-31T07:43:57.347755+0000 mon.a (mon.0) 2726 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:43:58.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:58 smithi027 bash[22610]: audit 2024-08-31T07:43:57.353167+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:43:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:58 smithi163 bash[24253]: cluster 2024-08-31T07:43:56.855720+0000 mgr.a (mgr.14388) 14385 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:58 smithi163 bash[24253]: audit 2024-08-31T07:43:57.325511+0000 mon.a (mon.0) 2722 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:43:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:58 smithi163 bash[24253]: audit 2024-08-31T07:43:57.333456+0000 mon.a (mon.0) 2723 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:43:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:58 smithi163 bash[24253]: audit 2024-08-31T07:43:57.335831+0000 mon.a (mon.0) 2724 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:43:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:58 smithi163 bash[24253]: audit 2024-08-31T07:43:57.337642+0000 mon.a (mon.0) 2725 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:43:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:58 smithi163 bash[24253]: audit 2024-08-31T07:43:57.347755+0000 mon.a (mon.0) 2726 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:43:58.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:58 smithi163 bash[24253]: audit 2024-08-31T07:43:57.353167+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:43:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:58 smithi191 bash[24992]: cluster 2024-08-31T07:43:56.855720+0000 mgr.a (mgr.14388) 14385 : cluster [DBG] pgmap v9973: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:43:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:58 smithi191 bash[24992]: audit 2024-08-31T07:43:57.325511+0000 mon.a (mon.0) 2722 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:43:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:58 smithi191 bash[24992]: audit 2024-08-31T07:43:57.333456+0000 mon.a (mon.0) 2723 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:43:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:58 smithi191 bash[24992]: audit 2024-08-31T07:43:57.335831+0000 mon.a (mon.0) 2724 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:43:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:58 smithi191 bash[24992]: audit 2024-08-31T07:43:57.337642+0000 mon.a (mon.0) 2725 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:43:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:58 smithi191 bash[24992]: audit 2024-08-31T07:43:57.347755+0000 mon.a (mon.0) 2726 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:43:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:58 smithi191 bash[24992]: audit 2024-08-31T07:43:57.353167+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:43:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:59 smithi163 bash[24253]: audit 2024-08-31T07:43:57.356518+0000 mgr.a (mgr.14388) 14386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:43:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:59 smithi163 bash[24253]: audit 2024-08-31T07:43:58.141338+0000 mgr.a (mgr.14388) 14387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:43:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:59 smithi163 bash[24253]: cephadm 2024-08-31T07:43:58.143059+0000 mgr.a (mgr.14388) 14388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:43:59.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:43:59 smithi163 bash[24253]: cluster 2024-08-31T07:43:58.858568+0000 mgr.a (mgr.14388) 14389 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:43:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:59 smithi027 bash[22610]: audit 2024-08-31T07:43:57.356518+0000 mgr.a (mgr.14388) 14386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:43:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:59 smithi027 bash[22610]: audit 2024-08-31T07:43:58.141338+0000 mgr.a (mgr.14388) 14387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:43:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:59 smithi027 bash[22610]: cephadm 2024-08-31T07:43:58.143059+0000 mgr.a (mgr.14388) 14388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:43:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:43:59 smithi027 bash[22610]: cluster 2024-08-31T07:43:58.858568+0000 mgr.a (mgr.14388) 14389 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:43:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:59 smithi191 bash[24992]: audit 2024-08-31T07:43:57.356518+0000 mgr.a (mgr.14388) 14386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:43:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:59 smithi191 bash[24992]: audit 2024-08-31T07:43:58.141338+0000 mgr.a (mgr.14388) 14387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:43:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:59 smithi191 bash[24992]: cephadm 2024-08-31T07:43:58.143059+0000 mgr.a (mgr.14388) 14388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:43:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:43:59 smithi191 bash[24992]: cluster 2024-08-31T07:43:58.858568+0000 mgr.a (mgr.14388) 14389 : cluster [DBG] pgmap v9974: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T07:44:00.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:00.009 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:00.009 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:00.789 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:00.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:00.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:00.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:00.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:01 smithi163 bash[24253]: audit 2024-08-31T07:44:00.347173+0000 mgr.a (mgr.14388) 14390 : audit [DBG] from='client.312720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:01 smithi163 bash[24253]: cluster 2024-08-31T07:44:00.859326+0000 mgr.a (mgr.14388) 14391 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:44:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:01 smithi027 bash[22610]: audit 2024-08-31T07:44:00.347173+0000 mgr.a (mgr.14388) 14390 : audit [DBG] from='client.312720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:01 smithi027 bash[22610]: cluster 2024-08-31T07:44:00.859326+0000 mgr.a (mgr.14388) 14391 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:44:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:01 smithi191 bash[24992]: audit 2024-08-31T07:44:00.347173+0000 mgr.a (mgr.14388) 14390 : audit [DBG] from='client.312720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:01 smithi191 bash[24992]: cluster 2024-08-31T07:44:00.859326+0000 mgr.a (mgr.14388) 14391 : cluster [DBG] pgmap v9975: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T07:44:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:03 smithi163 bash[24253]: cluster 2024-08-31T07:44:02.861416+0000 mgr.a (mgr.14388) 14392 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:44:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:03 smithi027 bash[22610]: cluster 2024-08-31T07:44:02.861416+0000 mgr.a (mgr.14388) 14392 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:44:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:03 smithi191 bash[24992]: cluster 2024-08-31T07:44:02.861416+0000 mgr.a (mgr.14388) 14392 : cluster [DBG] pgmap v9976: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:44:05.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:05.791 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:05.791 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:05 smithi163 bash[24253]: cluster 2024-08-31T07:44:04.862163+0000 mgr.a (mgr.14388) 14393 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:44:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:05 smithi027 bash[22610]: cluster 2024-08-31T07:44:04.862163+0000 mgr.a (mgr.14388) 14393 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:44:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:05 smithi191 bash[24992]: cluster 2024-08-31T07:44:04.862163+0000 mgr.a (mgr.14388) 14393 : cluster [DBG] pgmap v9977: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:44:06.565 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:06.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:06.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:06.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:06.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:06 smithi163 bash[24253]: audit 2024-08-31T07:44:06.129357+0000 mgr.a (mgr.14388) 14394 : audit [DBG] from='client.312798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:06 smithi027 bash[22610]: audit 2024-08-31T07:44:06.129357+0000 mgr.a (mgr.14388) 14394 : audit [DBG] from='client.312798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:06 smithi191 bash[24992]: audit 2024-08-31T07:44:06.129357+0000 mgr.a (mgr.14388) 14394 : audit [DBG] from='client.312798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:07 smithi163 bash[24253]: cluster 2024-08-31T07:44:06.863104+0000 mgr.a (mgr.14388) 14395 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:44:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:07 smithi027 bash[22610]: cluster 2024-08-31T07:44:06.863104+0000 mgr.a (mgr.14388) 14395 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:44:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:07 smithi191 bash[24992]: cluster 2024-08-31T07:44:06.863104+0000 mgr.a (mgr.14388) 14395 : cluster [DBG] pgmap v9978: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:44:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:09 smithi163 bash[24253]: cluster 2024-08-31T07:44:08.865444+0000 mgr.a (mgr.14388) 14396 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T07:44:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:09 smithi027 bash[22610]: cluster 2024-08-31T07:44:08.865444+0000 mgr.a (mgr.14388) 14396 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T07:44:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:09 smithi191 bash[24992]: cluster 2024-08-31T07:44:08.865444+0000 mgr.a (mgr.14388) 14396 : cluster [DBG] pgmap v9979: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T07:44:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:11.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:11 smithi163 bash[24253]: cluster 2024-08-31T07:44:10.866378+0000 mgr.a (mgr.14388) 14397 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T07:44:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:11 smithi027 bash[22610]: cluster 2024-08-31T07:44:10.866378+0000 mgr.a (mgr.14388) 14397 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T07:44:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:11 smithi191 bash[24992]: cluster 2024-08-31T07:44:10.866378+0000 mgr.a (mgr.14388) 14397 : cluster [DBG] pgmap v9980: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T07:44:12.332 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:12.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:12.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:12.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:12.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:12 smithi027 bash[22610]: audit 2024-08-31T07:44:11.900518+0000 mgr.a (mgr.14388) 14398 : audit [DBG] from='client.312876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:12 smithi191 bash[24992]: audit 2024-08-31T07:44:11.900518+0000 mgr.a (mgr.14388) 14398 : audit [DBG] from='client.312876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:12 smithi163 bash[24253]: audit 2024-08-31T07:44:11.900518+0000 mgr.a (mgr.14388) 14398 : audit [DBG] from='client.312876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:13 smithi027 bash[22610]: cluster 2024-08-31T07:44:12.868723+0000 mgr.a (mgr.14388) 14399 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T07:44:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:13 smithi191 bash[24992]: cluster 2024-08-31T07:44:12.868723+0000 mgr.a (mgr.14388) 14399 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T07:44:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:13 smithi163 bash[24253]: cluster 2024-08-31T07:44:12.868723+0000 mgr.a (mgr.14388) 14399 : cluster [DBG] pgmap v9981: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T07:44:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:15 smithi027 bash[22610]: cluster 2024-08-31T07:44:14.869476+0000 mgr.a (mgr.14388) 14400 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:44:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:15 smithi191 bash[24992]: cluster 2024-08-31T07:44:14.869476+0000 mgr.a (mgr.14388) 14400 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:44:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:15 smithi163 bash[24253]: cluster 2024-08-31T07:44:14.869476+0000 mgr.a (mgr.14388) 14400 : cluster [DBG] pgmap v9982: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:44:17.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:17.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:17.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:18.094 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:18.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:18.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:18.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:18.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:17 smithi027 bash[22610]: cluster 2024-08-31T07:44:16.870245+0000 mgr.a (mgr.14388) 14401 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:44:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:17 smithi191 bash[24992]: cluster 2024-08-31T07:44:16.870245+0000 mgr.a (mgr.14388) 14401 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:44:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:17 smithi163 bash[24253]: cluster 2024-08-31T07:44:16.870245+0000 mgr.a (mgr.14388) 14401 : cluster [DBG] pgmap v9983: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:44:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:18 smithi027 bash[22610]: audit 2024-08-31T07:44:17.664139+0000 mgr.a (mgr.14388) 14402 : audit [DBG] from='client.312954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:19.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:18 smithi191 bash[24992]: audit 2024-08-31T07:44:17.664139+0000 mgr.a (mgr.14388) 14402 : audit [DBG] from='client.312954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:18 smithi163 bash[24253]: audit 2024-08-31T07:44:17.664139+0000 mgr.a (mgr.14388) 14402 : audit [DBG] from='client.312954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:19 smithi027 bash[22610]: cluster 2024-08-31T07:44:18.873102+0000 mgr.a (mgr.14388) 14403 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:44:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:19 smithi191 bash[24992]: cluster 2024-08-31T07:44:18.873102+0000 mgr.a (mgr.14388) 14403 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:44:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:19 smithi163 bash[24253]: cluster 2024-08-31T07:44:18.873102+0000 mgr.a (mgr.14388) 14403 : cluster [DBG] pgmap v9984: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T07:44:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:21 smithi191 bash[24992]: cluster 2024-08-31T07:44:20.874020+0000 mgr.a (mgr.14388) 14404 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:44:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:21 smithi163 bash[24253]: cluster 2024-08-31T07:44:20.874020+0000 mgr.a (mgr.14388) 14404 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:44:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:21 smithi027 bash[22610]: cluster 2024-08-31T07:44:20.874020+0000 mgr.a (mgr.14388) 14404 : cluster [DBG] pgmap v9985: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:44:23.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:23.096 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:23.096 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:23.869 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:23 smithi191 bash[24992]: cluster 2024-08-31T07:44:22.876118+0000 mgr.a (mgr.14388) 14405 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:23 smithi163 bash[24253]: cluster 2024-08-31T07:44:22.876118+0000 mgr.a (mgr.14388) 14405 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:23 smithi027 bash[22610]: cluster 2024-08-31T07:44:22.876118+0000 mgr.a (mgr.14388) 14405 : cluster [DBG] pgmap v9986: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:25 smithi191 bash[24992]: audit 2024-08-31T07:44:23.431967+0000 mgr.a (mgr.14388) 14406 : audit [DBG] from='client.313029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:25 smithi163 bash[24253]: audit 2024-08-31T07:44:23.431967+0000 mgr.a (mgr.14388) 14406 : audit [DBG] from='client.313029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:25 smithi027 bash[22610]: audit 2024-08-31T07:44:23.431967+0000 mgr.a (mgr.14388) 14406 : audit [DBG] from='client.313029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:26 smithi191 bash[24992]: cluster 2024-08-31T07:44:24.877025+0000 mgr.a (mgr.14388) 14407 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:44:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:26 smithi163 bash[24253]: cluster 2024-08-31T07:44:24.877025+0000 mgr.a (mgr.14388) 14407 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:44:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:26 smithi027 bash[22610]: cluster 2024-08-31T07:44:24.877025+0000 mgr.a (mgr.14388) 14407 : cluster [DBG] pgmap v9987: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:44:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:28 smithi191 bash[24992]: cluster 2024-08-31T07:44:26.877814+0000 mgr.a (mgr.14388) 14408 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:44:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:28 smithi163 bash[24253]: cluster 2024-08-31T07:44:26.877814+0000 mgr.a (mgr.14388) 14408 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:44:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:28 smithi027 bash[22610]: cluster 2024-08-31T07:44:26.877814+0000 mgr.a (mgr.14388) 14408 : cluster [DBG] pgmap v9988: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:44:28.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:28.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:28.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:29.606 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:29.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:29.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:29.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:29.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:30.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:30 smithi191 bash[24992]: cluster 2024-08-31T07:44:28.879917+0000 mgr.a (mgr.14388) 14409 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:30 smithi191 bash[24992]: audit 2024-08-31T07:44:29.201966+0000 mgr.a (mgr.14388) 14410 : audit [DBG] from='client.313107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:30 smithi163 bash[24253]: cluster 2024-08-31T07:44:28.879917+0000 mgr.a (mgr.14388) 14409 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:30 smithi163 bash[24253]: audit 2024-08-31T07:44:29.201966+0000 mgr.a (mgr.14388) 14410 : audit [DBG] from='client.313107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:30 smithi027 bash[22610]: cluster 2024-08-31T07:44:28.879917+0000 mgr.a (mgr.14388) 14409 : cluster [DBG] pgmap v9989: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:30 smithi027 bash[22610]: audit 2024-08-31T07:44:29.201966+0000 mgr.a (mgr.14388) 14410 : audit [DBG] from='client.313107 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:32 smithi191 bash[24992]: cluster 2024-08-31T07:44:30.880809+0000 mgr.a (mgr.14388) 14411 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:32 smithi163 bash[24253]: cluster 2024-08-31T07:44:30.880809+0000 mgr.a (mgr.14388) 14411 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:32 smithi027 bash[22610]: cluster 2024-08-31T07:44:30.880809+0000 mgr.a (mgr.14388) 14411 : cluster [DBG] pgmap v9990: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:34 smithi191 bash[24992]: cluster 2024-08-31T07:44:32.882962+0000 mgr.a (mgr.14388) 14412 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:34 smithi163 bash[24253]: cluster 2024-08-31T07:44:32.882962+0000 mgr.a (mgr.14388) 14412 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:34 smithi027 bash[22610]: cluster 2024-08-31T07:44:32.882962+0000 mgr.a (mgr.14388) 14412 : cluster [DBG] pgmap v9991: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:34.608 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:34.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:34.609 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:35.355 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:35.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:35.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:35.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:35.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:36 smithi191 bash[24992]: cluster 2024-08-31T07:44:34.883446+0000 mgr.a (mgr.14388) 14413 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:36 smithi191 bash[24992]: audit 2024-08-31T07:44:34.933032+0000 mgr.a (mgr.14388) 14414 : audit [DBG] from='client.313185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:36 smithi163 bash[24253]: cluster 2024-08-31T07:44:34.883446+0000 mgr.a (mgr.14388) 14413 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:36 smithi163 bash[24253]: audit 2024-08-31T07:44:34.933032+0000 mgr.a (mgr.14388) 14414 : audit [DBG] from='client.313185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:36 smithi027 bash[22610]: cluster 2024-08-31T07:44:34.883446+0000 mgr.a (mgr.14388) 14413 : cluster [DBG] pgmap v9992: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:36 smithi027 bash[22610]: audit 2024-08-31T07:44:34.933032+0000 mgr.a (mgr.14388) 14414 : audit [DBG] from='client.313185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:38 smithi191 bash[24992]: cluster 2024-08-31T07:44:36.884299+0000 mgr.a (mgr.14388) 14415 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:38 smithi163 bash[24253]: cluster 2024-08-31T07:44:36.884299+0000 mgr.a (mgr.14388) 14415 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:38 smithi027 bash[22610]: cluster 2024-08-31T07:44:36.884299+0000 mgr.a (mgr.14388) 14415 : cluster [DBG] pgmap v9993: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:40 smithi191 bash[24992]: cluster 2024-08-31T07:44:38.886549+0000 mgr.a (mgr.14388) 14416 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:40.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:40.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:40.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:40 smithi163 bash[24253]: cluster 2024-08-31T07:44:38.886549+0000 mgr.a (mgr.14388) 14416 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:40 smithi027 bash[22610]: cluster 2024-08-31T07:44:38.886549+0000 mgr.a (mgr.14388) 14416 : cluster [DBG] pgmap v9994: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:41.123 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:41.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:41.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:41.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:41.123 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:42 smithi191 bash[24992]: audit 2024-08-31T07:44:40.690776+0000 mgr.a (mgr.14388) 14417 : audit [DBG] from='client.313263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:42 smithi191 bash[24992]: cluster 2024-08-31T07:44:40.887184+0000 mgr.a (mgr.14388) 14418 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:42 smithi163 bash[24253]: audit 2024-08-31T07:44:40.690776+0000 mgr.a (mgr.14388) 14417 : audit [DBG] from='client.313263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:42 smithi163 bash[24253]: cluster 2024-08-31T07:44:40.887184+0000 mgr.a (mgr.14388) 14418 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:42 smithi027 bash[22610]: audit 2024-08-31T07:44:40.690776+0000 mgr.a (mgr.14388) 14417 : audit [DBG] from='client.313263 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:42 smithi027 bash[22610]: cluster 2024-08-31T07:44:40.887184+0000 mgr.a (mgr.14388) 14418 : cluster [DBG] pgmap v9995: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:44 smithi163 bash[24253]: cluster 2024-08-31T07:44:42.889375+0000 mgr.a (mgr.14388) 14419 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:44 smithi027 bash[22610]: cluster 2024-08-31T07:44:42.889375+0000 mgr.a (mgr.14388) 14419 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:44 smithi191 bash[24992]: cluster 2024-08-31T07:44:42.889375+0000 mgr.a (mgr.14388) 14419 : cluster [DBG] pgmap v9996: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:46.124 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:46.125 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:46.125 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:46 smithi163 bash[24253]: cluster 2024-08-31T07:44:44.890131+0000 mgr.a (mgr.14388) 14420 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:46 smithi027 bash[22610]: cluster 2024-08-31T07:44:44.890131+0000 mgr.a (mgr.14388) 14420 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:46 smithi191 bash[24992]: cluster 2024-08-31T07:44:44.890131+0000 mgr.a (mgr.14388) 14420 : cluster [DBG] pgmap v9997: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:46.913 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:46.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:46.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:46.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:46.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:48 smithi163 bash[24253]: audit 2024-08-31T07:44:46.463119+0000 mgr.a (mgr.14388) 14421 : audit [DBG] from='client.313341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:48 smithi163 bash[24253]: cluster 2024-08-31T07:44:46.890747+0000 mgr.a (mgr.14388) 14422 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:48 smithi027 bash[22610]: audit 2024-08-31T07:44:46.463119+0000 mgr.a (mgr.14388) 14421 : audit [DBG] from='client.313341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:48 smithi027 bash[22610]: cluster 2024-08-31T07:44:46.890747+0000 mgr.a (mgr.14388) 14422 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:48 smithi191 bash[24992]: audit 2024-08-31T07:44:46.463119+0000 mgr.a (mgr.14388) 14421 : audit [DBG] from='client.313341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:48 smithi191 bash[24992]: cluster 2024-08-31T07:44:46.890747+0000 mgr.a (mgr.14388) 14422 : cluster [DBG] pgmap v9998: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:50 smithi163 bash[24253]: cluster 2024-08-31T07:44:48.892946+0000 mgr.a (mgr.14388) 14423 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:50 smithi027 bash[22610]: cluster 2024-08-31T07:44:48.892946+0000 mgr.a (mgr.14388) 14423 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:50 smithi191 bash[24992]: cluster 2024-08-31T07:44:48.892946+0000 mgr.a (mgr.14388) 14423 : cluster [DBG] pgmap v9999: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:51.916 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:52 smithi163 bash[24253]: cluster 2024-08-31T07:44:50.893715+0000 mgr.a (mgr.14388) 14424 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:52 smithi027 bash[22610]: cluster 2024-08-31T07:44:50.893715+0000 mgr.a (mgr.14388) 14424 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:52 smithi191 bash[24992]: cluster 2024-08-31T07:44:50.893715+0000 mgr.a (mgr.14388) 14424 : cluster [DBG] pgmap v10000: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:52.692 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:52.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:52.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:52.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:52.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:53 smithi163 bash[24253]: audit 2024-08-31T07:44:52.251181+0000 mgr.a (mgr.14388) 14425 : audit [DBG] from='client.313413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:53 smithi027 bash[22610]: audit 2024-08-31T07:44:52.251181+0000 mgr.a (mgr.14388) 14425 : audit [DBG] from='client.313413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:53 smithi191 bash[24992]: audit 2024-08-31T07:44:52.251181+0000 mgr.a (mgr.14388) 14425 : audit [DBG] from='client.313413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:54 smithi163 bash[24253]: cluster 2024-08-31T07:44:52.895951+0000 mgr.a (mgr.14388) 14426 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:54.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:54 smithi027 bash[22610]: cluster 2024-08-31T07:44:52.895951+0000 mgr.a (mgr.14388) 14426 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:54 smithi191 bash[24992]: cluster 2024-08-31T07:44:52.895951+0000 mgr.a (mgr.14388) 14426 : cluster [DBG] pgmap v10001: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:44:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:56 smithi163 bash[24253]: cluster 2024-08-31T07:44:54.896866+0000 mgr.a (mgr.14388) 14427 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:56 smithi027 bash[22610]: cluster 2024-08-31T07:44:54.896866+0000 mgr.a (mgr.14388) 14427 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:56 smithi191 bash[24992]: cluster 2024-08-31T07:44:54.896866+0000 mgr.a (mgr.14388) 14427 : cluster [DBG] pgmap v10002: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:57.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:44:57.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:44:57.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:44:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:58 smithi163 bash[24253]: cluster 2024-08-31T07:44:56.897656+0000 mgr.a (mgr.14388) 14428 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:58.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:44:58.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:44:58.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:44:58.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:44:58.483 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:44:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:58 smithi027 bash[22610]: cluster 2024-08-31T07:44:56.897656+0000 mgr.a (mgr.14388) 14428 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:58 smithi191 bash[24992]: cluster 2024-08-31T07:44:56.897656+0000 mgr.a (mgr.14388) 14428 : cluster [DBG] pgmap v10003: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:44:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:59 smithi163 bash[24253]: audit 2024-08-31T07:44:58.030837+0000 mgr.a (mgr.14388) 14429 : audit [DBG] from='client.313491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:44:59 smithi163 bash[24253]: audit 2024-08-31T07:44:58.214901+0000 mon.a (mon.0) 2728 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:44:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:59 smithi027 bash[22610]: audit 2024-08-31T07:44:58.030837+0000 mgr.a (mgr.14388) 14429 : audit [DBG] from='client.313491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:44:59 smithi027 bash[22610]: audit 2024-08-31T07:44:58.214901+0000 mon.a (mon.0) 2728 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:44:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:59 smithi191 bash[24992]: audit 2024-08-31T07:44:58.030837+0000 mgr.a (mgr.14388) 14429 : audit [DBG] from='client.313491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:44:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:44:59 smithi191 bash[24992]: audit 2024-08-31T07:44:58.214901+0000 mon.a (mon.0) 2728 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:45:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:00 smithi163 bash[24253]: cluster 2024-08-31T07:44:58.900398+0000 mgr.a (mgr.14388) 14430 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:00 smithi027 bash[22610]: cluster 2024-08-31T07:44:58.900398+0000 mgr.a (mgr.14388) 14430 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:00 smithi191 bash[24992]: cluster 2024-08-31T07:44:58.900398+0000 mgr.a (mgr.14388) 14430 : cluster [DBG] pgmap v10004: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:02 smithi191 bash[24992]: cluster 2024-08-31T07:45:00.901173+0000 mgr.a (mgr.14388) 14431 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:02 smithi163 bash[24253]: cluster 2024-08-31T07:45:00.901173+0000 mgr.a (mgr.14388) 14431 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:02 smithi027 bash[22610]: cluster 2024-08-31T07:45:00.901173+0000 mgr.a (mgr.14388) 14431 : cluster [DBG] pgmap v10005: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:03.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:45:03.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:45:03.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:45:04.246 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:45:04.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:45:04.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:45:04.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:45:04.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:45:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:04 smithi163 bash[24253]: cluster 2024-08-31T07:45:02.903078+0000 mgr.a (mgr.14388) 14432 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:04 smithi027 bash[22610]: cluster 2024-08-31T07:45:02.903078+0000 mgr.a (mgr.14388) 14432 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:04 smithi191 bash[24992]: cluster 2024-08-31T07:45:02.903078+0000 mgr.a (mgr.14388) 14432 : cluster [DBG] pgmap v10006: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:05.373 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:05 smithi163 bash[24253]: audit 2024-08-31T07:45:03.820751+0000 mgr.a (mgr.14388) 14433 : audit [DBG] from='client.313563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:05.397 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:05 smithi191 bash[24992]: audit 2024-08-31T07:45:03.820751+0000 mgr.a (mgr.14388) 14433 : audit [DBG] from='client.313563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:05 smithi027 bash[22610]: audit 2024-08-31T07:45:03.820751+0000 mgr.a (mgr.14388) 14433 : audit [DBG] from='client.313563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:06.408 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:06 smithi163 bash[24253]: cluster 2024-08-31T07:45:04.903932+0000 mgr.a (mgr.14388) 14434 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:06 smithi027 bash[22610]: cluster 2024-08-31T07:45:04.903932+0000 mgr.a (mgr.14388) 14434 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:06 smithi191 bash[24992]: cluster 2024-08-31T07:45:04.903932+0000 mgr.a (mgr.14388) 14434 : cluster [DBG] pgmap v10007: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:08 smithi163 bash[24253]: cluster 2024-08-31T07:45:06.904738+0000 mgr.a (mgr.14388) 14435 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:45:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:08 smithi027 bash[22610]: cluster 2024-08-31T07:45:06.904738+0000 mgr.a (mgr.14388) 14435 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:45:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:08 smithi191 bash[24992]: cluster 2024-08-31T07:45:06.904738+0000 mgr.a (mgr.14388) 14435 : cluster [DBG] pgmap v10008: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:45:09.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:45:09.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:45:09.249 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:45:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:09 smithi191 bash[24992]: audit 2024-08-31T07:45:08.757710+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:09 smithi191 bash[24992]: audit 2024-08-31T07:45:08.766445+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:09 smithi191 bash[24992]: cluster 2024-08-31T07:45:08.906956+0000 mgr.a (mgr.14388) 14436 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:09 smithi191 bash[24992]: audit 2024-08-31T07:45:09.344605+0000 mon.a (mon.0) 2731 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:09 smithi191 bash[24992]: audit 2024-08-31T07:45:09.350685+0000 mon.a (mon.0) 2732 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:09 smithi191 bash[24992]: audit 2024-08-31T07:45:09.351780+0000 mon.a (mon.0) 2733 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:45:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:09 smithi191 bash[24992]: audit 2024-08-31T07:45:09.352757+0000 mon.a (mon.0) 2734 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:45:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:09 smithi191 bash[24992]: audit 2024-08-31T07:45:09.365312+0000 mon.a (mon.0) 2735 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:09 smithi191 bash[24992]: audit 2024-08-31T07:45:09.367635+0000 mon.a (mon.0) 2736 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:45:10.098 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:09 smithi027 bash[22610]: audit 2024-08-31T07:45:08.757710+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.098 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:09 smithi027 bash[22610]: audit 2024-08-31T07:45:08.766445+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.098 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:09 smithi027 bash[22610]: cluster 2024-08-31T07:45:08.906956+0000 mgr.a (mgr.14388) 14436 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:10.098 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:09 smithi027 bash[22610]: audit 2024-08-31T07:45:09.344605+0000 mon.a (mon.0) 2731 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.099 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:09 smithi027 bash[22610]: audit 2024-08-31T07:45:09.350685+0000 mon.a (mon.0) 2732 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.099 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:09 smithi027 bash[22610]: audit 2024-08-31T07:45:09.351780+0000 mon.a (mon.0) 2733 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:45:10.099 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:09 smithi027 bash[22610]: audit 2024-08-31T07:45:09.352757+0000 mon.a (mon.0) 2734 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:45:10.099 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:09 smithi027 bash[22610]: audit 2024-08-31T07:45:09.365312+0000 mon.a (mon.0) 2735 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.099 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:09 smithi027 bash[22610]: audit 2024-08-31T07:45:09.367635+0000 mon.a (mon.0) 2736 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:45:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:09 smithi163 bash[24253]: audit 2024-08-31T07:45:08.757710+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:09 smithi163 bash[24253]: audit 2024-08-31T07:45:08.766445+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:09 smithi163 bash[24253]: cluster 2024-08-31T07:45:08.906956+0000 mgr.a (mgr.14388) 14436 : cluster [DBG] pgmap v10009: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:09 smithi163 bash[24253]: audit 2024-08-31T07:45:09.344605+0000 mon.a (mon.0) 2731 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:09 smithi163 bash[24253]: audit 2024-08-31T07:45:09.350685+0000 mon.a (mon.0) 2732 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:09 smithi163 bash[24253]: audit 2024-08-31T07:45:09.351780+0000 mon.a (mon.0) 2733 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:45:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:09 smithi163 bash[24253]: audit 2024-08-31T07:45:09.352757+0000 mon.a (mon.0) 2734 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:45:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:09 smithi163 bash[24253]: audit 2024-08-31T07:45:09.365312+0000 mon.a (mon.0) 2735 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:45:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:09 smithi163 bash[24253]: audit 2024-08-31T07:45:09.367635+0000 mon.a (mon.0) 2736 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:45:10.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:45:10 smithi027 bash[22863]: debug 2024-08-31T07:45:10.091+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:45:10.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:45:10 smithi027 bash[22863]: debug 2024-08-31T07:45:10.103+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:45:10.511 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:45:10.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:45:10.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:45:10.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:45:10.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:45:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:10 smithi191 bash[24992]: audit 2024-08-31T07:45:09.368589+0000 mgr.a (mgr.14388) 14437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:45:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:10 smithi191 bash[24992]: audit 2024-08-31T07:45:09.604935+0000 mgr.a (mgr.14388) 14438 : audit [DBG] from='client.313641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:10 smithi191 bash[24992]: audit 2024-08-31T07:45:10.097788+0000 mgr.a (mgr.14388) 14439 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:45:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:10 smithi191 bash[24992]: cephadm 2024-08-31T07:45:10.110205+0000 mgr.a (mgr.14388) 14440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:45:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:10 smithi163 bash[24253]: audit 2024-08-31T07:45:09.368589+0000 mgr.a (mgr.14388) 14437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:45:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:10 smithi163 bash[24253]: audit 2024-08-31T07:45:09.604935+0000 mgr.a (mgr.14388) 14438 : audit [DBG] from='client.313641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:10 smithi163 bash[24253]: audit 2024-08-31T07:45:10.097788+0000 mgr.a (mgr.14388) 14439 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:45:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:10 smithi163 bash[24253]: cephadm 2024-08-31T07:45:10.110205+0000 mgr.a (mgr.14388) 14440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:45:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:10 smithi027 bash[22610]: audit 2024-08-31T07:45:09.368589+0000 mgr.a (mgr.14388) 14437 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:45:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:10 smithi027 bash[22610]: audit 2024-08-31T07:45:09.604935+0000 mgr.a (mgr.14388) 14438 : audit [DBG] from='client.313641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:10 smithi027 bash[22610]: audit 2024-08-31T07:45:10.097788+0000 mgr.a (mgr.14388) 14439 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:45:11.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:10 smithi027 bash[22610]: cephadm 2024-08-31T07:45:10.110205+0000 mgr.a (mgr.14388) 14440 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:45:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:11 smithi191 bash[24992]: cluster 2024-08-31T07:45:10.907876+0000 mgr.a (mgr.14388) 14441 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:11 smithi163 bash[24253]: cluster 2024-08-31T07:45:10.907876+0000 mgr.a (mgr.14388) 14441 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:11 smithi027 bash[22610]: cluster 2024-08-31T07:45:10.907876+0000 mgr.a (mgr.14388) 14441 : cluster [DBG] pgmap v10010: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:13 smithi027 bash[22610]: cluster 2024-08-31T07:45:12.909982+0000 mgr.a (mgr.14388) 14442 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:13 smithi191 bash[24992]: cluster 2024-08-31T07:45:12.909982+0000 mgr.a (mgr.14388) 14442 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:13 smithi163 bash[24253]: cluster 2024-08-31T07:45:12.909982+0000 mgr.a (mgr.14388) 14442 : cluster [DBG] pgmap v10011: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:15.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:45:15.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:45:15.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:45:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:15 smithi027 bash[22610]: cluster 2024-08-31T07:45:14.910793+0000 mgr.a (mgr.14388) 14443 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:15 smithi191 bash[24992]: cluster 2024-08-31T07:45:14.910793+0000 mgr.a (mgr.14388) 14443 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:16.297 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:45:16.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:45:16.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:45:16.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:45:16.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:45:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:15 smithi163 bash[24253]: cluster 2024-08-31T07:45:14.910793+0000 mgr.a (mgr.14388) 14443 : cluster [DBG] pgmap v10012: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:16 smithi027 bash[22610]: audit 2024-08-31T07:45:15.854801+0000 mgr.a (mgr.14388) 14444 : audit [DBG] from='client.313827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:16 smithi191 bash[24992]: audit 2024-08-31T07:45:15.854801+0000 mgr.a (mgr.14388) 14444 : audit [DBG] from='client.313827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:16 smithi163 bash[24253]: audit 2024-08-31T07:45:15.854801+0000 mgr.a (mgr.14388) 14444 : audit [DBG] from='client.313827 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:17 smithi027 bash[22610]: cluster 2024-08-31T07:45:16.911720+0000 mgr.a (mgr.14388) 14445 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:17 smithi191 bash[24992]: cluster 2024-08-31T07:45:16.911720+0000 mgr.a (mgr.14388) 14445 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:17 smithi163 bash[24253]: cluster 2024-08-31T07:45:16.911720+0000 mgr.a (mgr.14388) 14445 : cluster [DBG] pgmap v10013: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:19 smithi191 bash[24992]: cluster 2024-08-31T07:45:18.913920+0000 mgr.a (mgr.14388) 14446 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:19 smithi163 bash[24253]: cluster 2024-08-31T07:45:18.913920+0000 mgr.a (mgr.14388) 14446 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:19 smithi027 bash[22610]: cluster 2024-08-31T07:45:18.913920+0000 mgr.a (mgr.14388) 14446 : cluster [DBG] pgmap v10014: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:45:21.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:45:21.300 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:45:22.050 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:45:22.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:45:22.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:45:22.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:45:22.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:45:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:21 smithi191 bash[24992]: cluster 2024-08-31T07:45:20.914678+0000 mgr.a (mgr.14388) 14447 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:21 smithi163 bash[24253]: cluster 2024-08-31T07:45:20.914678+0000 mgr.a (mgr.14388) 14447 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:21 smithi027 bash[22610]: cluster 2024-08-31T07:45:20.914678+0000 mgr.a (mgr.14388) 14447 : cluster [DBG] pgmap v10015: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:23 smithi191 bash[24992]: audit 2024-08-31T07:45:21.632458+0000 mgr.a (mgr.14388) 14448 : audit [DBG] from='client.313905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:23 smithi163 bash[24253]: audit 2024-08-31T07:45:21.632458+0000 mgr.a (mgr.14388) 14448 : audit [DBG] from='client.313905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:23 smithi027 bash[22610]: audit 2024-08-31T07:45:21.632458+0000 mgr.a (mgr.14388) 14448 : audit [DBG] from='client.313905 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:24 smithi191 bash[24992]: cluster 2024-08-31T07:45:22.916875+0000 mgr.a (mgr.14388) 14449 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:24 smithi163 bash[24253]: cluster 2024-08-31T07:45:22.916875+0000 mgr.a (mgr.14388) 14449 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:24 smithi027 bash[22610]: cluster 2024-08-31T07:45:22.916875+0000 mgr.a (mgr.14388) 14449 : cluster [DBG] pgmap v10016: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:45:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:26 smithi163 bash[24253]: cluster 2024-08-31T07:45:24.917778+0000 mgr.a (mgr.14388) 14450 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:26 smithi027 bash[22610]: cluster 2024-08-31T07:45:24.917778+0000 mgr.a (mgr.14388) 14450 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:27.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:45:27.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:45:27.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:45:27.798 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:45:27.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:45:27.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:45:27.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:45:27.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:45:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:26 smithi191 bash[24992]: cluster 2024-08-31T07:45:24.917778+0000 mgr.a (mgr.14388) 14450 : cluster [DBG] pgmap v10017: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:28 smithi191 bash[24992]: cluster 2024-08-31T07:45:26.918706+0000 mgr.a (mgr.14388) 14451 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:28 smithi163 bash[24253]: cluster 2024-08-31T07:45:26.918706+0000 mgr.a (mgr.14388) 14451 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:28 smithi027 bash[22610]: cluster 2024-08-31T07:45:26.918706+0000 mgr.a (mgr.14388) 14451 : cluster [DBG] pgmap v10018: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:29 smithi191 bash[24992]: audit 2024-08-31T07:45:27.382627+0000 mgr.a (mgr.14388) 14452 : audit [DBG] from='client.313983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:29 smithi163 bash[24253]: audit 2024-08-31T07:45:27.382627+0000 mgr.a (mgr.14388) 14452 : audit [DBG] from='client.313983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:29 smithi027 bash[22610]: audit 2024-08-31T07:45:27.382627+0000 mgr.a (mgr.14388) 14452 : audit [DBG] from='client.313983 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:30 smithi191 bash[24992]: cluster 2024-08-31T07:45:28.921029+0000 mgr.a (mgr.14388) 14453 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:45:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:30 smithi163 bash[24253]: cluster 2024-08-31T07:45:28.921029+0000 mgr.a (mgr.14388) 14453 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:45:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:30 smithi027 bash[22610]: cluster 2024-08-31T07:45:28.921029+0000 mgr.a (mgr.14388) 14453 : cluster [DBG] pgmap v10019: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:45:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:32 smithi191 bash[24992]: cluster 2024-08-31T07:45:30.921792+0000 mgr.a (mgr.14388) 14454 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:32 smithi163 bash[24253]: cluster 2024-08-31T07:45:30.921792+0000 mgr.a (mgr.14388) 14454 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:32 smithi027 bash[22610]: cluster 2024-08-31T07:45:30.921792+0000 mgr.a (mgr.14388) 14454 : cluster [DBG] pgmap v10020: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:32.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:45:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:45:32.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:45:33.567 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:45:33.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:45:33.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:45:33.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:45:33.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:45:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:34 smithi191 bash[24992]: cluster 2024-08-31T07:45:32.923217+0000 mgr.a (mgr.14388) 14455 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:34 smithi191 bash[24992]: audit 2024-08-31T07:45:33.137591+0000 mgr.a (mgr.14388) 14456 : audit [DBG] from='client.314061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:34 smithi163 bash[24253]: cluster 2024-08-31T07:45:32.923217+0000 mgr.a (mgr.14388) 14455 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:34 smithi163 bash[24253]: audit 2024-08-31T07:45:33.137591+0000 mgr.a (mgr.14388) 14456 : audit [DBG] from='client.314061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:34 smithi027 bash[22610]: cluster 2024-08-31T07:45:32.923217+0000 mgr.a (mgr.14388) 14455 : cluster [DBG] pgmap v10021: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:34.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:34 smithi027 bash[22610]: audit 2024-08-31T07:45:33.137591+0000 mgr.a (mgr.14388) 14456 : audit [DBG] from='client.314061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:36 smithi191 bash[24992]: cluster 2024-08-31T07:45:34.924238+0000 mgr.a (mgr.14388) 14457 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:36 smithi163 bash[24253]: cluster 2024-08-31T07:45:34.924238+0000 mgr.a (mgr.14388) 14457 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:36.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:36 smithi027 bash[22610]: cluster 2024-08-31T07:45:34.924238+0000 mgr.a (mgr.14388) 14457 : cluster [DBG] pgmap v10022: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:38 smithi163 bash[24253]: cluster 2024-08-31T07:45:36.925032+0000 mgr.a (mgr.14388) 14458 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:45:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:38 smithi027 bash[22610]: cluster 2024-08-31T07:45:36.925032+0000 mgr.a (mgr.14388) 14458 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:45:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:38 smithi191 bash[24992]: cluster 2024-08-31T07:45:36.925032+0000 mgr.a (mgr.14388) 14458 : cluster [DBG] pgmap v10023: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:45:38.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:45:38.570 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:45:38.570 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:45:39.341 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:45:39.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:45:39.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:45:39.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:45:39.342 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:45:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:40 smithi163 bash[24253]: audit 2024-08-31T07:45:38.908996+0000 mgr.a (mgr.14388) 14459 : audit [DBG] from='client.314139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:40 smithi163 bash[24253]: cluster 2024-08-31T07:45:38.927277+0000 mgr.a (mgr.14388) 14460 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:40 smithi027 bash[22610]: audit 2024-08-31T07:45:38.908996+0000 mgr.a (mgr.14388) 14459 : audit [DBG] from='client.314139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:40 smithi027 bash[22610]: cluster 2024-08-31T07:45:38.927277+0000 mgr.a (mgr.14388) 14460 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:40 smithi191 bash[24992]: audit 2024-08-31T07:45:38.908996+0000 mgr.a (mgr.14388) 14459 : audit [DBG] from='client.314139 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:40 smithi191 bash[24992]: cluster 2024-08-31T07:45:38.927277+0000 mgr.a (mgr.14388) 14460 : cluster [DBG] pgmap v10024: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:42 smithi163 bash[24253]: cluster 2024-08-31T07:45:40.928193+0000 mgr.a (mgr.14388) 14461 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:42 smithi027 bash[22610]: cluster 2024-08-31T07:45:40.928193+0000 mgr.a (mgr.14388) 14461 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:42 smithi191 bash[24992]: cluster 2024-08-31T07:45:40.928193+0000 mgr.a (mgr.14388) 14461 : cluster [DBG] pgmap v10025: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:45:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:45:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:45:44.343 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:45:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:44 smithi163 bash[24253]: cluster 2024-08-31T07:45:42.930312+0000 mgr.a (mgr.14388) 14462 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:44 smithi027 bash[22610]: cluster 2024-08-31T07:45:42.930312+0000 mgr.a (mgr.14388) 14462 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:44 smithi191 bash[24992]: cluster 2024-08-31T07:45:42.930312+0000 mgr.a (mgr.14388) 14462 : cluster [DBG] pgmap v10026: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:45.096 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:45:45.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:45:45.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:45:45.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:45:45.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:45:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:46 smithi163 bash[24253]: audit 2024-08-31T07:45:44.679382+0000 mgr.a (mgr.14388) 14463 : audit [DBG] from='client.314217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:46 smithi163 bash[24253]: cluster 2024-08-31T07:45:44.930987+0000 mgr.a (mgr.14388) 14464 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:46 smithi027 bash[22610]: audit 2024-08-31T07:45:44.679382+0000 mgr.a (mgr.14388) 14463 : audit [DBG] from='client.314217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:46 smithi027 bash[22610]: cluster 2024-08-31T07:45:44.930987+0000 mgr.a (mgr.14388) 14464 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:46 smithi191 bash[24992]: audit 2024-08-31T07:45:44.679382+0000 mgr.a (mgr.14388) 14463 : audit [DBG] from='client.314217 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:46 smithi191 bash[24992]: cluster 2024-08-31T07:45:44.930987+0000 mgr.a (mgr.14388) 14464 : cluster [DBG] pgmap v10027: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:48 smithi163 bash[24253]: cluster 2024-08-31T07:45:46.931819+0000 mgr.a (mgr.14388) 14465 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:48 smithi027 bash[22610]: cluster 2024-08-31T07:45:46.931819+0000 mgr.a (mgr.14388) 14465 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:48 smithi191 bash[24992]: cluster 2024-08-31T07:45:46.931819+0000 mgr.a (mgr.14388) 14465 : cluster [DBG] pgmap v10028: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:45:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:45:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:45:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:50 smithi163 bash[24253]: cluster 2024-08-31T07:45:48.934013+0000 mgr.a (mgr.14388) 14466 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:45:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:50 smithi027 bash[22610]: cluster 2024-08-31T07:45:48.934013+0000 mgr.a (mgr.14388) 14466 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:45:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:50 smithi191 bash[24992]: cluster 2024-08-31T07:45:48.934013+0000 mgr.a (mgr.14388) 14466 : cluster [DBG] pgmap v10029: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:45:50.863 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:45:50.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:45:50.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:45:50.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:45:50.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:45:52.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:52 smithi163 bash[24253]: audit 2024-08-31T07:45:50.428428+0000 mgr.a (mgr.14388) 14467 : audit [DBG] from='client.314289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:52.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:52 smithi163 bash[24253]: cluster 2024-08-31T07:45:50.934934+0000 mgr.a (mgr.14388) 14468 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:52 smithi027 bash[22610]: audit 2024-08-31T07:45:50.428428+0000 mgr.a (mgr.14388) 14467 : audit [DBG] from='client.314289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:52 smithi027 bash[22610]: cluster 2024-08-31T07:45:50.934934+0000 mgr.a (mgr.14388) 14468 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:52 smithi191 bash[24992]: audit 2024-08-31T07:45:50.428428+0000 mgr.a (mgr.14388) 14467 : audit [DBG] from='client.314289 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:52 smithi191 bash[24992]: cluster 2024-08-31T07:45:50.934934+0000 mgr.a (mgr.14388) 14468 : cluster [DBG] pgmap v10030: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:54 smithi163 bash[24253]: cluster 2024-08-31T07:45:52.937058+0000 mgr.a (mgr.14388) 14469 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:45:54.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:54 smithi027 bash[22610]: cluster 2024-08-31T07:45:52.937058+0000 mgr.a (mgr.14388) 14469 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:45:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:54 smithi191 bash[24992]: cluster 2024-08-31T07:45:52.937058+0000 mgr.a (mgr.14388) 14469 : cluster [DBG] pgmap v10031: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:45:55.865 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:45:55.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:45:55.865 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:45:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:56 smithi163 bash[24253]: cluster 2024-08-31T07:45:54.937798+0000 mgr.a (mgr.14388) 14470 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:56 smithi027 bash[22610]: cluster 2024-08-31T07:45:54.937798+0000 mgr.a (mgr.14388) 14470 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:56 smithi191 bash[24992]: cluster 2024-08-31T07:45:54.937798+0000 mgr.a (mgr.14388) 14470 : cluster [DBG] pgmap v10032: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:56.635 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:45:56.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:45:56.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:45:56.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:45:56.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:45:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:57 smithi163 bash[24253]: audit 2024-08-31T07:45:56.199050+0000 mgr.a (mgr.14388) 14471 : audit [DBG] from='client.314367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:57 smithi027 bash[22610]: audit 2024-08-31T07:45:56.199050+0000 mgr.a (mgr.14388) 14471 : audit [DBG] from='client.314367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:57 smithi191 bash[24992]: audit 2024-08-31T07:45:56.199050+0000 mgr.a (mgr.14388) 14471 : audit [DBG] from='client.314367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:45:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:45:58 smithi163 bash[24253]: cluster 2024-08-31T07:45:56.938669+0000 mgr.a (mgr.14388) 14472 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:45:58 smithi027 bash[22610]: cluster 2024-08-31T07:45:56.938669+0000 mgr.a (mgr.14388) 14472 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:45:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:45:58 smithi191 bash[24992]: cluster 2024-08-31T07:45:56.938669+0000 mgr.a (mgr.14388) 14472 : cluster [DBG] pgmap v10033: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:00 smithi163 bash[24253]: cluster 2024-08-31T07:45:58.940795+0000 mgr.a (mgr.14388) 14473 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:00 smithi027 bash[22610]: cluster 2024-08-31T07:45:58.940795+0000 mgr.a (mgr.14388) 14473 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:00 smithi191 bash[24992]: cluster 2024-08-31T07:45:58.940795+0000 mgr.a (mgr.14388) 14473 : cluster [DBG] pgmap v10034: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:01.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:01.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:46:01.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:02.405 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:46:02.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:46:02.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:46:02.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:46:02.406 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:46:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:02 smithi163 bash[24253]: cluster 2024-08-31T07:46:00.941547+0000 mgr.a (mgr.14388) 14474 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:02 smithi027 bash[22610]: cluster 2024-08-31T07:46:00.941547+0000 mgr.a (mgr.14388) 14474 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:02 smithi191 bash[24992]: cluster 2024-08-31T07:46:00.941547+0000 mgr.a (mgr.14388) 14474 : cluster [DBG] pgmap v10035: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:03 smithi163 bash[24253]: audit 2024-08-31T07:46:01.968923+0000 mgr.a (mgr.14388) 14475 : audit [DBG] from='client.314445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:03.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:03 smithi027 bash[22610]: audit 2024-08-31T07:46:01.968923+0000 mgr.a (mgr.14388) 14475 : audit [DBG] from='client.314445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:03 smithi191 bash[24992]: audit 2024-08-31T07:46:01.968923+0000 mgr.a (mgr.14388) 14475 : audit [DBG] from='client.314445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:04 smithi163 bash[24253]: cluster 2024-08-31T07:46:02.943753+0000 mgr.a (mgr.14388) 14476 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:04 smithi027 bash[22610]: cluster 2024-08-31T07:46:02.943753+0000 mgr.a (mgr.14388) 14476 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:04 smithi191 bash[24992]: cluster 2024-08-31T07:46:02.943753+0000 mgr.a (mgr.14388) 14476 : cluster [DBG] pgmap v10036: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:06 smithi163 bash[24253]: cluster 2024-08-31T07:46:04.944495+0000 mgr.a (mgr.14388) 14477 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:06 smithi027 bash[22610]: cluster 2024-08-31T07:46:04.944495+0000 mgr.a (mgr.14388) 14477 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:06 smithi191 bash[24992]: cluster 2024-08-31T07:46:04.944495+0000 mgr.a (mgr.14388) 14477 : cluster [DBG] pgmap v10037: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:07.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:07.407 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:46:07.408 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:08.164 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:46:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:46:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:46:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:46:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:46:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:08 smithi163 bash[24253]: cluster 2024-08-31T07:46:06.945231+0000 mgr.a (mgr.14388) 14478 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:08 smithi027 bash[22610]: cluster 2024-08-31T07:46:06.945231+0000 mgr.a (mgr.14388) 14478 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:08 smithi191 bash[24992]: cluster 2024-08-31T07:46:06.945231+0000 mgr.a (mgr.14388) 14478 : cluster [DBG] pgmap v10038: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:09 smithi163 bash[24253]: audit 2024-08-31T07:46:07.738326+0000 mgr.a (mgr.14388) 14479 : audit [DBG] from='client.314517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:09 smithi027 bash[22610]: audit 2024-08-31T07:46:07.738326+0000 mgr.a (mgr.14388) 14479 : audit [DBG] from='client.314517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:09 smithi191 bash[24992]: audit 2024-08-31T07:46:07.738326+0000 mgr.a (mgr.14388) 14479 : audit [DBG] from='client.314517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:10 smithi163 bash[24253]: cluster 2024-08-31T07:46:08.948594+0000 mgr.a (mgr.14388) 14480 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:10 smithi027 bash[22610]: cluster 2024-08-31T07:46:08.948594+0000 mgr.a (mgr.14388) 14480 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:10 smithi191 bash[24992]: cluster 2024-08-31T07:46:08.948594+0000 mgr.a (mgr.14388) 14480 : cluster [DBG] pgmap v10039: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:11 smithi163 bash[24253]: audit 2024-08-31T07:46:10.177176+0000 mon.a (mon.0) 2737 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:46:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:11 smithi163 bash[24253]: audit 2024-08-31T07:46:11.022276+0000 mon.a (mon.0) 2738 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:46:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:11 smithi163 bash[24253]: audit 2024-08-31T07:46:11.023867+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:46:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:11 smithi163 bash[24253]: audit 2024-08-31T07:46:11.033554+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:46:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:11 smithi163 bash[24253]: audit 2024-08-31T07:46:11.038523+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:46:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:11 smithi027 bash[22610]: audit 2024-08-31T07:46:10.177176+0000 mon.a (mon.0) 2737 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:46:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:11 smithi027 bash[22610]: audit 2024-08-31T07:46:11.022276+0000 mon.a (mon.0) 2738 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:46:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:11 smithi027 bash[22610]: audit 2024-08-31T07:46:11.023867+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:46:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:11 smithi027 bash[22610]: audit 2024-08-31T07:46:11.033554+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:46:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:11 smithi027 bash[22610]: audit 2024-08-31T07:46:11.038523+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:46:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:11 smithi191 bash[24992]: audit 2024-08-31T07:46:10.177176+0000 mon.a (mon.0) 2737 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:46:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:11 smithi191 bash[24992]: audit 2024-08-31T07:46:11.022276+0000 mon.a (mon.0) 2738 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:46:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:11 smithi191 bash[24992]: audit 2024-08-31T07:46:11.023867+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:46:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:11 smithi191 bash[24992]: audit 2024-08-31T07:46:11.033554+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:46:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:11 smithi191 bash[24992]: audit 2024-08-31T07:46:11.038523+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:46:12.142 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:46:11 smithi027 bash[22863]: debug 2024-08-31T07:46:11.805+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:46:12.142 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:46:11 smithi027 bash[22863]: debug 2024-08-31T07:46:11.805+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:46:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:12 smithi163 bash[24253]: cluster 2024-08-31T07:46:10.949396+0000 mgr.a (mgr.14388) 14481 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:46:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:12 smithi163 bash[24253]: audit 2024-08-31T07:46:11.040971+0000 mgr.a (mgr.14388) 14482 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:46:12.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:12 smithi027 bash[22610]: cluster 2024-08-31T07:46:10.949396+0000 mgr.a (mgr.14388) 14481 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:46:12.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:12 smithi027 bash[22610]: audit 2024-08-31T07:46:11.040971+0000 mgr.a (mgr.14388) 14482 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:46:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:12 smithi191 bash[24992]: cluster 2024-08-31T07:46:10.949396+0000 mgr.a (mgr.14388) 14481 : cluster [DBG] pgmap v10040: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:46:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:12 smithi191 bash[24992]: audit 2024-08-31T07:46:11.040971+0000 mgr.a (mgr.14388) 14482 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:46:13.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:13.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:46:13.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:13 smithi163 bash[24253]: audit 2024-08-31T07:46:11.806797+0000 mgr.a (mgr.14388) 14483 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:46:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:13 smithi163 bash[24253]: cephadm 2024-08-31T07:46:11.808711+0000 mgr.a (mgr.14388) 14484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:46:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:13 smithi027 bash[22610]: audit 2024-08-31T07:46:11.806797+0000 mgr.a (mgr.14388) 14483 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:46:13.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:13 smithi027 bash[22610]: cephadm 2024-08-31T07:46:11.808711+0000 mgr.a (mgr.14388) 14484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:46:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:13 smithi191 bash[24992]: audit 2024-08-31T07:46:11.806797+0000 mgr.a (mgr.14388) 14483 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:46:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:13 smithi191 bash[24992]: cephadm 2024-08-31T07:46:11.808711+0000 mgr.a (mgr.14388) 14484 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:46:13.912 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:46:13.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:46:13.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:46:13.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:46:13.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:46:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:14 smithi163 bash[24253]: cluster 2024-08-31T07:46:12.951672+0000 mgr.a (mgr.14388) 14485 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:14 smithi027 bash[22610]: cluster 2024-08-31T07:46:12.951672+0000 mgr.a (mgr.14388) 14485 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:14 smithi191 bash[24992]: cluster 2024-08-31T07:46:12.951672+0000 mgr.a (mgr.14388) 14485 : cluster [DBG] pgmap v10041: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:15 smithi163 bash[24253]: audit 2024-08-31T07:46:13.489965+0000 mgr.a (mgr.14388) 14486 : audit [DBG] from='client.314694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:15 smithi027 bash[22610]: audit 2024-08-31T07:46:13.489965+0000 mgr.a (mgr.14388) 14486 : audit [DBG] from='client.314694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:15 smithi191 bash[24992]: audit 2024-08-31T07:46:13.489965+0000 mgr.a (mgr.14388) 14486 : audit [DBG] from='client.314694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:16 smithi163 bash[24253]: cluster 2024-08-31T07:46:14.952610+0000 mgr.a (mgr.14388) 14487 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:46:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:16 smithi027 bash[22610]: cluster 2024-08-31T07:46:14.952610+0000 mgr.a (mgr.14388) 14487 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:46:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:16 smithi191 bash[24992]: cluster 2024-08-31T07:46:14.952610+0000 mgr.a (mgr.14388) 14487 : cluster [DBG] pgmap v10042: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:46:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:18 smithi163 bash[24253]: cluster 2024-08-31T07:46:16.953346+0000 mgr.a (mgr.14388) 14488 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:46:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:18 smithi027 bash[22610]: cluster 2024-08-31T07:46:16.953346+0000 mgr.a (mgr.14388) 14488 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:46:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:18 smithi191 bash[24992]: cluster 2024-08-31T07:46:16.953346+0000 mgr.a (mgr.14388) 14488 : cluster [DBG] pgmap v10043: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:46:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:46:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:19.645 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:46:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:46:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:46:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:46:19.646 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:46:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:20 smithi163 bash[24253]: cluster 2024-08-31T07:46:18.955542+0000 mgr.a (mgr.14388) 14489 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:20 smithi163 bash[24253]: audit 2024-08-31T07:46:19.240913+0000 mgr.a (mgr.14388) 14490 : audit [DBG] from='client.314772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:20 smithi027 bash[22610]: cluster 2024-08-31T07:46:18.955542+0000 mgr.a (mgr.14388) 14489 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:20 smithi027 bash[22610]: audit 2024-08-31T07:46:19.240913+0000 mgr.a (mgr.14388) 14490 : audit [DBG] from='client.314772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:20 smithi191 bash[24992]: cluster 2024-08-31T07:46:18.955542+0000 mgr.a (mgr.14388) 14489 : cluster [DBG] pgmap v10044: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:20 smithi191 bash[24992]: audit 2024-08-31T07:46:19.240913+0000 mgr.a (mgr.14388) 14490 : audit [DBG] from='client.314772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:22 smithi163 bash[24253]: cluster 2024-08-31T07:46:20.956469+0000 mgr.a (mgr.14388) 14491 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:22 smithi027 bash[22610]: cluster 2024-08-31T07:46:20.956469+0000 mgr.a (mgr.14388) 14491 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:22 smithi191 bash[24992]: cluster 2024-08-31T07:46:20.956469+0000 mgr.a (mgr.14388) 14491 : cluster [DBG] pgmap v10045: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:24 smithi163 bash[24253]: cluster 2024-08-31T07:46:22.958705+0000 mgr.a (mgr.14388) 14492 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:24 smithi027 bash[22610]: cluster 2024-08-31T07:46:22.958705+0000 mgr.a (mgr.14388) 14492 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:24 smithi191 bash[24992]: cluster 2024-08-31T07:46:22.958705+0000 mgr.a (mgr.14388) 14492 : cluster [DBG] pgmap v10046: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:46:24.647 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:24.647 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:46:24.648 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:25.425 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:46:25.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:46:25.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:46:25.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:46:25.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:46:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:26 smithi163 bash[24253]: cluster 2024-08-31T07:46:24.959598+0000 mgr.a (mgr.14388) 14493 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:26 smithi163 bash[24253]: audit 2024-08-31T07:46:24.988892+0000 mgr.a (mgr.14388) 14494 : audit [DBG] from='client.314850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:26 smithi027 bash[22610]: cluster 2024-08-31T07:46:24.959598+0000 mgr.a (mgr.14388) 14493 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:26 smithi027 bash[22610]: audit 2024-08-31T07:46:24.988892+0000 mgr.a (mgr.14388) 14494 : audit [DBG] from='client.314850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:26 smithi191 bash[24992]: cluster 2024-08-31T07:46:24.959598+0000 mgr.a (mgr.14388) 14493 : cluster [DBG] pgmap v10047: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:26 smithi191 bash[24992]: audit 2024-08-31T07:46:24.988892+0000 mgr.a (mgr.14388) 14494 : audit [DBG] from='client.314850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:28 smithi163 bash[24253]: cluster 2024-08-31T07:46:26.960568+0000 mgr.a (mgr.14388) 14495 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:28 smithi027 bash[22610]: cluster 2024-08-31T07:46:26.960568+0000 mgr.a (mgr.14388) 14495 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:28 smithi191 bash[24992]: cluster 2024-08-31T07:46:26.960568+0000 mgr.a (mgr.14388) 14495 : cluster [DBG] pgmap v10048: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:30.427 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:30.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:46:30.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:30 smithi163 bash[24253]: cluster 2024-08-31T07:46:28.962807+0000 mgr.a (mgr.14388) 14496 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:30 smithi027 bash[22610]: cluster 2024-08-31T07:46:28.962807+0000 mgr.a (mgr.14388) 14496 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:30 smithi191 bash[24992]: cluster 2024-08-31T07:46:28.962807+0000 mgr.a (mgr.14388) 14496 : cluster [DBG] pgmap v10049: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:31.213 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:46:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:46:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:46:31.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:46:31.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:46:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:32 smithi163 bash[24253]: audit 2024-08-31T07:46:30.762709+0000 mgr.a (mgr.14388) 14497 : audit [DBG] from='client.314925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:32 smithi163 bash[24253]: cluster 2024-08-31T07:46:30.963350+0000 mgr.a (mgr.14388) 14498 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:32 smithi027 bash[22610]: audit 2024-08-31T07:46:30.762709+0000 mgr.a (mgr.14388) 14497 : audit [DBG] from='client.314925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:32.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:32 smithi027 bash[22610]: cluster 2024-08-31T07:46:30.963350+0000 mgr.a (mgr.14388) 14498 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:32 smithi191 bash[24992]: audit 2024-08-31T07:46:30.762709+0000 mgr.a (mgr.14388) 14497 : audit [DBG] from='client.314925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:32 smithi191 bash[24992]: cluster 2024-08-31T07:46:30.963350+0000 mgr.a (mgr.14388) 14498 : cluster [DBG] pgmap v10050: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:34 smithi027 bash[22610]: cluster 2024-08-31T07:46:32.965517+0000 mgr.a (mgr.14388) 14499 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:34 smithi191 bash[24992]: cluster 2024-08-31T07:46:32.965517+0000 mgr.a (mgr.14388) 14499 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:34 smithi163 bash[24253]: cluster 2024-08-31T07:46:32.965517+0000 mgr.a (mgr.14388) 14499 : cluster [DBG] pgmap v10051: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:36.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:36.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:46:36.215 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:36 smithi027 bash[22610]: cluster 2024-08-31T07:46:34.966306+0000 mgr.a (mgr.14388) 14500 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:36 smithi191 bash[24992]: cluster 2024-08-31T07:46:34.966306+0000 mgr.a (mgr.14388) 14500 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:36 smithi163 bash[24253]: cluster 2024-08-31T07:46:34.966306+0000 mgr.a (mgr.14388) 14500 : cluster [DBG] pgmap v10052: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:36.991 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:46:36.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:46:36.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:46:36.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:46:36.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:46:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:38 smithi027 bash[22610]: audit 2024-08-31T07:46:36.547857+0000 mgr.a (mgr.14388) 14501 : audit [DBG] from='client.315000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:38 smithi027 bash[22610]: cluster 2024-08-31T07:46:36.966783+0000 mgr.a (mgr.14388) 14502 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:38 smithi191 bash[24992]: audit 2024-08-31T07:46:36.547857+0000 mgr.a (mgr.14388) 14501 : audit [DBG] from='client.315000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:38 smithi191 bash[24992]: cluster 2024-08-31T07:46:36.966783+0000 mgr.a (mgr.14388) 14502 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:38 smithi163 bash[24253]: audit 2024-08-31T07:46:36.547857+0000 mgr.a (mgr.14388) 14501 : audit [DBG] from='client.315000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:38 smithi163 bash[24253]: cluster 2024-08-31T07:46:36.966783+0000 mgr.a (mgr.14388) 14502 : cluster [DBG] pgmap v10053: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:40 smithi027 bash[22610]: cluster 2024-08-31T07:46:38.968940+0000 mgr.a (mgr.14388) 14503 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:40 smithi191 bash[24992]: cluster 2024-08-31T07:46:38.968940+0000 mgr.a (mgr.14388) 14503 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:40.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:40 smithi163 bash[24253]: cluster 2024-08-31T07:46:38.968940+0000 mgr.a (mgr.14388) 14503 : cluster [DBG] pgmap v10054: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:41.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:41.993 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:46:41.993 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:42 smithi027 bash[22610]: cluster 2024-08-31T07:46:40.969748+0000 mgr.a (mgr.14388) 14504 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:42 smithi191 bash[24992]: cluster 2024-08-31T07:46:40.969748+0000 mgr.a (mgr.14388) 14504 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:42 smithi163 bash[24253]: cluster 2024-08-31T07:46:40.969748+0000 mgr.a (mgr.14388) 14504 : cluster [DBG] pgmap v10055: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:42.779 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:46:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:46:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:46:42.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:46:42.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:46:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:43 smithi027 bash[22610]: audit 2024-08-31T07:46:42.327742+0000 mgr.a (mgr.14388) 14505 : audit [DBG] from='client.315075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:43 smithi191 bash[24992]: audit 2024-08-31T07:46:42.327742+0000 mgr.a (mgr.14388) 14505 : audit [DBG] from='client.315075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:43 smithi163 bash[24253]: audit 2024-08-31T07:46:42.327742+0000 mgr.a (mgr.14388) 14505 : audit [DBG] from='client.315075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:44 smithi027 bash[22610]: cluster 2024-08-31T07:46:42.972060+0000 mgr.a (mgr.14388) 14506 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:44 smithi191 bash[24992]: cluster 2024-08-31T07:46:42.972060+0000 mgr.a (mgr.14388) 14506 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:44 smithi163 bash[24253]: cluster 2024-08-31T07:46:42.972060+0000 mgr.a (mgr.14388) 14506 : cluster [DBG] pgmap v10056: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:46:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:46 smithi191 bash[24992]: cluster 2024-08-31T07:46:44.972786+0000 mgr.a (mgr.14388) 14507 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:46 smithi163 bash[24253]: cluster 2024-08-31T07:46:44.972786+0000 mgr.a (mgr.14388) 14507 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:46 smithi027 bash[22610]: cluster 2024-08-31T07:46:44.972786+0000 mgr.a (mgr.14388) 14507 : cluster [DBG] pgmap v10057: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:47.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:46:47.781 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:48.531 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:46:48.532 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:46:48.532 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:46:48.532 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:46:48.532 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:46:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:48 smithi191 bash[24992]: cluster 2024-08-31T07:46:46.973538+0000 mgr.a (mgr.14388) 14508 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:48 smithi163 bash[24253]: cluster 2024-08-31T07:46:46.973538+0000 mgr.a (mgr.14388) 14508 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:48 smithi027 bash[22610]: cluster 2024-08-31T07:46:46.973538+0000 mgr.a (mgr.14388) 14508 : cluster [DBG] pgmap v10058: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:49 smithi191 bash[24992]: audit 2024-08-31T07:46:48.112291+0000 mgr.a (mgr.14388) 14509 : audit [DBG] from='client.315150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:49.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:49 smithi163 bash[24253]: audit 2024-08-31T07:46:48.112291+0000 mgr.a (mgr.14388) 14509 : audit [DBG] from='client.315150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:49 smithi027 bash[22610]: audit 2024-08-31T07:46:48.112291+0000 mgr.a (mgr.14388) 14509 : audit [DBG] from='client.315150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:50 smithi191 bash[24992]: cluster 2024-08-31T07:46:48.976382+0000 mgr.a (mgr.14388) 14510 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:50 smithi163 bash[24253]: cluster 2024-08-31T07:46:48.976382+0000 mgr.a (mgr.14388) 14510 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:50 smithi027 bash[22610]: cluster 2024-08-31T07:46:48.976382+0000 mgr.a (mgr.14388) 14510 : cluster [DBG] pgmap v10059: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:52 smithi191 bash[24992]: cluster 2024-08-31T07:46:50.977186+0000 mgr.a (mgr.14388) 14511 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:46:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:52 smithi163 bash[24253]: cluster 2024-08-31T07:46:50.977186+0000 mgr.a (mgr.14388) 14511 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:46:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:52 smithi027 bash[22610]: cluster 2024-08-31T07:46:50.977186+0000 mgr.a (mgr.14388) 14511 : cluster [DBG] pgmap v10060: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:46:53.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:53.534 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:46:53.534 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:54.281 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:46:54.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:46:54.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:46:54.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:46:54.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:46:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:54 smithi191 bash[24992]: cluster 2024-08-31T07:46:52.979093+0000 mgr.a (mgr.14388) 14512 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:54 smithi163 bash[24253]: cluster 2024-08-31T07:46:52.979093+0000 mgr.a (mgr.14388) 14512 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:54 smithi027 bash[22610]: cluster 2024-08-31T07:46:52.979093+0000 mgr.a (mgr.14388) 14512 : cluster [DBG] pgmap v10061: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:46:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:55 smithi191 bash[24992]: audit 2024-08-31T07:46:53.870453+0000 mgr.a (mgr.14388) 14513 : audit [DBG] from='client.315228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:55 smithi163 bash[24253]: audit 2024-08-31T07:46:53.870453+0000 mgr.a (mgr.14388) 14513 : audit [DBG] from='client.315228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:55 smithi027 bash[22610]: audit 2024-08-31T07:46:53.870453+0000 mgr.a (mgr.14388) 14513 : audit [DBG] from='client.315228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:46:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:56 smithi191 bash[24992]: cluster 2024-08-31T07:46:54.980040+0000 mgr.a (mgr.14388) 14514 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:46:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:56 smithi163 bash[24253]: cluster 2024-08-31T07:46:54.980040+0000 mgr.a (mgr.14388) 14514 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:46:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:56 smithi027 bash[22610]: cluster 2024-08-31T07:46:54.980040+0000 mgr.a (mgr.14388) 14514 : cluster [DBG] pgmap v10062: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:46:58.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:46:58 smithi191 bash[24992]: cluster 2024-08-31T07:46:56.980851+0000 mgr.a (mgr.14388) 14515 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:46:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:46:58 smithi163 bash[24253]: cluster 2024-08-31T07:46:56.980851+0000 mgr.a (mgr.14388) 14515 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:46:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:46:58 smithi027 bash[22610]: cluster 2024-08-31T07:46:56.980851+0000 mgr.a (mgr.14388) 14515 : cluster [DBG] pgmap v10063: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:46:59.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:46:59.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:46:59.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:00.056 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:00.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:00.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:00.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:00.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:00 smithi191 bash[24992]: cluster 2024-08-31T07:46:58.983047+0000 mgr.a (mgr.14388) 14516 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:00 smithi163 bash[24253]: cluster 2024-08-31T07:46:58.983047+0000 mgr.a (mgr.14388) 14516 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:00 smithi027 bash[22610]: cluster 2024-08-31T07:46:58.983047+0000 mgr.a (mgr.14388) 14516 : cluster [DBG] pgmap v10064: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:01 smithi163 bash[24253]: audit 2024-08-31T07:46:59.618865+0000 mgr.a (mgr.14388) 14517 : audit [DBG] from='client.315300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:01 smithi027 bash[22610]: audit 2024-08-31T07:46:59.618865+0000 mgr.a (mgr.14388) 14517 : audit [DBG] from='client.315300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:01 smithi191 bash[24992]: audit 2024-08-31T07:46:59.618865+0000 mgr.a (mgr.14388) 14517 : audit [DBG] from='client.315300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:02 smithi163 bash[24253]: cluster 2024-08-31T07:47:00.984134+0000 mgr.a (mgr.14388) 14518 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:02 smithi027 bash[22610]: cluster 2024-08-31T07:47:00.984134+0000 mgr.a (mgr.14388) 14518 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:02 smithi191 bash[24992]: cluster 2024-08-31T07:47:00.984134+0000 mgr.a (mgr.14388) 14518 : cluster [DBG] pgmap v10065: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:04 smithi163 bash[24253]: cluster 2024-08-31T07:47:02.986316+0000 mgr.a (mgr.14388) 14519 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:04 smithi027 bash[22610]: cluster 2024-08-31T07:47:02.986316+0000 mgr.a (mgr.14388) 14519 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:04 smithi191 bash[24992]: cluster 2024-08-31T07:47:02.986316+0000 mgr.a (mgr.14388) 14519 : cluster [DBG] pgmap v10066: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:05.058 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:47:05.058 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:05.059 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:47:05.806 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:05.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:06 smithi163 bash[24253]: cluster 2024-08-31T07:47:04.987069+0000 mgr.a (mgr.14388) 14520 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:06 smithi027 bash[22610]: cluster 2024-08-31T07:47:04.987069+0000 mgr.a (mgr.14388) 14520 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:06 smithi191 bash[24992]: cluster 2024-08-31T07:47:04.987069+0000 mgr.a (mgr.14388) 14520 : cluster [DBG] pgmap v10067: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:07 smithi163 bash[24253]: audit 2024-08-31T07:47:05.390270+0000 mgr.a (mgr.14388) 14521 : audit [DBG] from='client.315375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:07 smithi027 bash[22610]: audit 2024-08-31T07:47:05.390270+0000 mgr.a (mgr.14388) 14521 : audit [DBG] from='client.315375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:07 smithi191 bash[24992]: audit 2024-08-31T07:47:05.390270+0000 mgr.a (mgr.14388) 14521 : audit [DBG] from='client.315375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:08 smithi163 bash[24253]: cluster 2024-08-31T07:47:06.988122+0000 mgr.a (mgr.14388) 14522 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:08 smithi027 bash[22610]: cluster 2024-08-31T07:47:06.988122+0000 mgr.a (mgr.14388) 14522 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:08 smithi191 bash[24992]: cluster 2024-08-31T07:47:06.988122+0000 mgr.a (mgr.14388) 14522 : cluster [DBG] pgmap v10068: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:10 smithi163 bash[24253]: cluster 2024-08-31T07:47:08.990393+0000 mgr.a (mgr.14388) 14523 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:10 smithi027 bash[22610]: cluster 2024-08-31T07:47:08.990393+0000 mgr.a (mgr.14388) 14523 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:10 smithi191 bash[24992]: cluster 2024-08-31T07:47:08.990393+0000 mgr.a (mgr.14388) 14523 : cluster [DBG] pgmap v10069: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:10.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:47:10.809 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:10.809 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:47:11.593 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:11.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:11.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:11.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:11.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:12 smithi163 bash[24253]: cluster 2024-08-31T07:47:10.991151+0000 mgr.a (mgr.14388) 14524 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:12 smithi163 bash[24253]: audit 2024-08-31T07:47:11.144962+0000 mgr.a (mgr.14388) 14525 : audit [DBG] from='client.315453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:12 smithi163 bash[24253]: audit 2024-08-31T07:47:11.862248+0000 mon.a (mon.0) 2742 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:47:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:12 smithi027 bash[22610]: cluster 2024-08-31T07:47:10.991151+0000 mgr.a (mgr.14388) 14524 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:12 smithi027 bash[22610]: audit 2024-08-31T07:47:11.144962+0000 mgr.a (mgr.14388) 14525 : audit [DBG] from='client.315453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:12 smithi027 bash[22610]: audit 2024-08-31T07:47:11.862248+0000 mon.a (mon.0) 2742 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:47:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:12 smithi191 bash[24992]: cluster 2024-08-31T07:47:10.991151+0000 mgr.a (mgr.14388) 14524 : cluster [DBG] pgmap v10070: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:12 smithi191 bash[24992]: audit 2024-08-31T07:47:11.144962+0000 mgr.a (mgr.14388) 14525 : audit [DBG] from='client.315453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:12 smithi191 bash[24992]: audit 2024-08-31T07:47:11.862248+0000 mon.a (mon.0) 2742 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:47:14.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:47:13 smithi027 bash[22863]: debug 2024-08-31T07:47:13.968+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:47:14.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:47:13 smithi027 bash[22863]: debug 2024-08-31T07:47:13.968+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:47:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: cluster 2024-08-31T07:47:12.993339+0000 mgr.a (mgr.14388) 14526 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.213029+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.219951+0000 mon.a (mon.0) 2744 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.224560+0000 mon.a (mon.0) 2745 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.228309+0000 mon.a (mon.0) 2746 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.231154+0000 mon.a (mon.0) 2747 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.234797+0000 mon.a (mon.0) 2748 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.235551+0000 mon.a (mon.0) 2749 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:47:14.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.236346+0000 mon.a (mon.0) 2750 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:47:14.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.243442+0000 mon.a (mon.0) 2751 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.245365+0000 mon.a (mon.0) 2752 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:47:14.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:14 smithi027 bash[22610]: audit 2024-08-31T07:47:13.246289+0000 mgr.a (mgr.14388) 14527 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:47:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: cluster 2024-08-31T07:47:12.993339+0000 mgr.a (mgr.14388) 14526 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.213029+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.219951+0000 mon.a (mon.0) 2744 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.224560+0000 mon.a (mon.0) 2745 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.228309+0000 mon.a (mon.0) 2746 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.231154+0000 mon.a (mon.0) 2747 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.234797+0000 mon.a (mon.0) 2748 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.235551+0000 mon.a (mon.0) 2749 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:47:14.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.236346+0000 mon.a (mon.0) 2750 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:47:14.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.243442+0000 mon.a (mon.0) 2751 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.245365+0000 mon.a (mon.0) 2752 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:47:14.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:14 smithi191 bash[24992]: audit 2024-08-31T07:47:13.246289+0000 mgr.a (mgr.14388) 14527 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:47:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: cluster 2024-08-31T07:47:12.993339+0000 mgr.a (mgr.14388) 14526 : cluster [DBG] pgmap v10071: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.213029+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.219951+0000 mon.a (mon.0) 2744 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.224560+0000 mon.a (mon.0) 2745 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.228309+0000 mon.a (mon.0) 2746 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.231154+0000 mon.a (mon.0) 2747 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.234797+0000 mon.a (mon.0) 2748 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.235551+0000 mon.a (mon.0) 2749 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:47:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.236346+0000 mon.a (mon.0) 2750 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:47:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.243442+0000 mon.a (mon.0) 2751 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:47:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.245365+0000 mon.a (mon.0) 2752 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:47:14.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:14 smithi163 bash[24253]: audit 2024-08-31T07:47:13.246289+0000 mgr.a (mgr.14388) 14527 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:47:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:15 smithi027 bash[22610]: audit 2024-08-31T07:47:13.972677+0000 mgr.a (mgr.14388) 14528 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:47:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:15 smithi027 bash[22610]: cephadm 2024-08-31T07:47:13.973909+0000 mgr.a (mgr.14388) 14529 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:47:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:15 smithi191 bash[24992]: audit 2024-08-31T07:47:13.972677+0000 mgr.a (mgr.14388) 14528 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:47:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:15 smithi191 bash[24992]: cephadm 2024-08-31T07:47:13.973909+0000 mgr.a (mgr.14388) 14529 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:47:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:15 smithi163 bash[24253]: audit 2024-08-31T07:47:13.972677+0000 mgr.a (mgr.14388) 14528 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:47:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:15 smithi163 bash[24253]: cephadm 2024-08-31T07:47:13.973909+0000 mgr.a (mgr.14388) 14529 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:47:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:16 smithi027 bash[22610]: cluster 2024-08-31T07:47:14.994239+0000 mgr.a (mgr.14388) 14530 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:16 smithi191 bash[24992]: cluster 2024-08-31T07:47:14.994239+0000 mgr.a (mgr.14388) 14530 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:16.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:47:16.595 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:16.595 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:47:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:16 smithi163 bash[24253]: cluster 2024-08-31T07:47:14.994239+0000 mgr.a (mgr.14388) 14530 : cluster [DBG] pgmap v10072: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:17.374 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:17.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:17.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:17.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:17.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:18 smithi027 bash[22610]: audit 2024-08-31T07:47:16.930146+0000 mgr.a (mgr.14388) 14531 : audit [DBG] from='client.315636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:18 smithi027 bash[22610]: cluster 2024-08-31T07:47:16.994957+0000 mgr.a (mgr.14388) 14532 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:18 smithi191 bash[24992]: audit 2024-08-31T07:47:16.930146+0000 mgr.a (mgr.14388) 14531 : audit [DBG] from='client.315636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:18 smithi191 bash[24992]: cluster 2024-08-31T07:47:16.994957+0000 mgr.a (mgr.14388) 14532 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:18 smithi163 bash[24253]: audit 2024-08-31T07:47:16.930146+0000 mgr.a (mgr.14388) 14531 : audit [DBG] from='client.315636 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:18 smithi163 bash[24253]: cluster 2024-08-31T07:47:16.994957+0000 mgr.a (mgr.14388) 14532 : cluster [DBG] pgmap v10073: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:20 smithi191 bash[24992]: cluster 2024-08-31T07:47:18.997316+0000 mgr.a (mgr.14388) 14533 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:20 smithi163 bash[24253]: cluster 2024-08-31T07:47:18.997316+0000 mgr.a (mgr.14388) 14533 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:20 smithi027 bash[22610]: cluster 2024-08-31T07:47:18.997316+0000 mgr.a (mgr.14388) 14533 : cluster [DBG] pgmap v10074: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:22.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:47:22.377 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:22.377 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:47:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:22 smithi191 bash[24992]: cluster 2024-08-31T07:47:20.998106+0000 mgr.a (mgr.14388) 14534 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:22 smithi163 bash[24253]: cluster 2024-08-31T07:47:20.998106+0000 mgr.a (mgr.14388) 14534 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:22 smithi027 bash[22610]: cluster 2024-08-31T07:47:20.998106+0000 mgr.a (mgr.14388) 14534 : cluster [DBG] pgmap v10075: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:23.129 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:23.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:23.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:23.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:23.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:24 smithi191 bash[24992]: audit 2024-08-31T07:47:22.705694+0000 mgr.a (mgr.14388) 14535 : audit [DBG] from='client.315714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:24 smithi191 bash[24992]: cluster 2024-08-31T07:47:22.999530+0000 mgr.a (mgr.14388) 14536 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:24 smithi163 bash[24253]: audit 2024-08-31T07:47:22.705694+0000 mgr.a (mgr.14388) 14535 : audit [DBG] from='client.315714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:24 smithi163 bash[24253]: cluster 2024-08-31T07:47:22.999530+0000 mgr.a (mgr.14388) 14536 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:24 smithi027 bash[22610]: audit 2024-08-31T07:47:22.705694+0000 mgr.a (mgr.14388) 14535 : audit [DBG] from='client.315714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:24 smithi027 bash[22610]: cluster 2024-08-31T07:47:22.999530+0000 mgr.a (mgr.14388) 14536 : cluster [DBG] pgmap v10076: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:26 smithi191 bash[24992]: cluster 2024-08-31T07:47:25.000374+0000 mgr.a (mgr.14388) 14537 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:47:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:26 smithi163 bash[24253]: cluster 2024-08-31T07:47:25.000374+0000 mgr.a (mgr.14388) 14537 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:47:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:26 smithi027 bash[22610]: cluster 2024-08-31T07:47:25.000374+0000 mgr.a (mgr.14388) 14537 : cluster [DBG] pgmap v10077: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:47:28.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:47:28.131 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:28.131 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:47:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:28 smithi191 bash[24992]: cluster 2024-08-31T07:47:27.001150+0000 mgr.a (mgr.14388) 14538 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:47:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:28 smithi163 bash[24253]: cluster 2024-08-31T07:47:27.001150+0000 mgr.a (mgr.14388) 14538 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:47:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:28 smithi027 bash[22610]: cluster 2024-08-31T07:47:27.001150+0000 mgr.a (mgr.14388) 14538 : cluster [DBG] pgmap v10078: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:47:28.890 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:28.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:28.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:28.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:28.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:30 smithi191 bash[24992]: audit 2024-08-31T07:47:28.466553+0000 mgr.a (mgr.14388) 14539 : audit [DBG] from='client.315792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:30 smithi191 bash[24992]: cluster 2024-08-31T07:47:29.003989+0000 mgr.a (mgr.14388) 14540 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:30 smithi163 bash[24253]: audit 2024-08-31T07:47:28.466553+0000 mgr.a (mgr.14388) 14539 : audit [DBG] from='client.315792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:30 smithi163 bash[24253]: cluster 2024-08-31T07:47:29.003989+0000 mgr.a (mgr.14388) 14540 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:30 smithi027 bash[22610]: audit 2024-08-31T07:47:28.466553+0000 mgr.a (mgr.14388) 14539 : audit [DBG] from='client.315792 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:30.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:30 smithi027 bash[22610]: cluster 2024-08-31T07:47:29.003989+0000 mgr.a (mgr.14388) 14540 : cluster [DBG] pgmap v10079: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:47:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:32 smithi191 bash[24992]: cluster 2024-08-31T07:47:31.004785+0000 mgr.a (mgr.14388) 14541 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:47:32.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:32 smithi163 bash[24253]: cluster 2024-08-31T07:47:31.004785+0000 mgr.a (mgr.14388) 14541 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:47:32.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:32 smithi027 bash[22610]: cluster 2024-08-31T07:47:31.004785+0000 mgr.a (mgr.14388) 14541 : cluster [DBG] pgmap v10080: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:47:33.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:47:33.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:33.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:47:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:34 smithi191 bash[24992]: cluster 2024-08-31T07:47:33.006673+0000 mgr.a (mgr.14388) 14542 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:34.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:34.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:34.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:34.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:34.672 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:34 smithi163 bash[24253]: cluster 2024-08-31T07:47:33.006673+0000 mgr.a (mgr.14388) 14542 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:34 smithi027 bash[22610]: cluster 2024-08-31T07:47:33.006673+0000 mgr.a (mgr.14388) 14542 : cluster [DBG] pgmap v10081: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:35 smithi191 bash[24992]: audit 2024-08-31T07:47:34.225671+0000 mgr.a (mgr.14388) 14543 : audit [DBG] from='client.315867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:35 smithi163 bash[24253]: audit 2024-08-31T07:47:34.225671+0000 mgr.a (mgr.14388) 14543 : audit [DBG] from='client.315867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:35 smithi027 bash[22610]: audit 2024-08-31T07:47:34.225671+0000 mgr.a (mgr.14388) 14543 : audit [DBG] from='client.315867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:36 smithi191 bash[24992]: cluster 2024-08-31T07:47:35.007608+0000 mgr.a (mgr.14388) 14544 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:36 smithi163 bash[24253]: cluster 2024-08-31T07:47:35.007608+0000 mgr.a (mgr.14388) 14544 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:36 smithi027 bash[22610]: cluster 2024-08-31T07:47:35.007608+0000 mgr.a (mgr.14388) 14544 : cluster [DBG] pgmap v10082: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:38 smithi163 bash[24253]: cluster 2024-08-31T07:47:37.008433+0000 mgr.a (mgr.14388) 14545 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:38 smithi027 bash[22610]: cluster 2024-08-31T07:47:37.008433+0000 mgr.a (mgr.14388) 14545 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:38 smithi191 bash[24992]: cluster 2024-08-31T07:47:37.008433+0000 mgr.a (mgr.14388) 14545 : cluster [DBG] pgmap v10083: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:39.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:47:39.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:39.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:47:40.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:40.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:40.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:40.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:40.453 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:40 smithi163 bash[24253]: cluster 2024-08-31T07:47:39.010639+0000 mgr.a (mgr.14388) 14546 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:40 smithi027 bash[22610]: cluster 2024-08-31T07:47:39.010639+0000 mgr.a (mgr.14388) 14546 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:40 smithi191 bash[24992]: cluster 2024-08-31T07:47:39.010639+0000 mgr.a (mgr.14388) 14546 : cluster [DBG] pgmap v10084: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:41 smithi163 bash[24253]: audit 2024-08-31T07:47:40.012060+0000 mgr.a (mgr.14388) 14547 : audit [DBG] from='client.315945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:41 smithi027 bash[22610]: audit 2024-08-31T07:47:40.012060+0000 mgr.a (mgr.14388) 14547 : audit [DBG] from='client.315945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:41 smithi191 bash[24992]: audit 2024-08-31T07:47:40.012060+0000 mgr.a (mgr.14388) 14547 : audit [DBG] from='client.315945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:42 smithi163 bash[24253]: cluster 2024-08-31T07:47:41.011601+0000 mgr.a (mgr.14388) 14548 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:42 smithi027 bash[22610]: cluster 2024-08-31T07:47:41.011601+0000 mgr.a (mgr.14388) 14548 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:42 smithi191 bash[24992]: cluster 2024-08-31T07:47:41.011601+0000 mgr.a (mgr.14388) 14548 : cluster [DBG] pgmap v10085: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:44 smithi163 bash[24253]: cluster 2024-08-31T07:47:43.013732+0000 mgr.a (mgr.14388) 14549 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:44 smithi027 bash[22610]: cluster 2024-08-31T07:47:43.013732+0000 mgr.a (mgr.14388) 14549 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:44 smithi191 bash[24992]: cluster 2024-08-31T07:47:43.013732+0000 mgr.a (mgr.14388) 14549 : cluster [DBG] pgmap v10086: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:45.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:47:45.455 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:45.455 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:47:46.197 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:46.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:46.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:46.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:46.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:46 smithi163 bash[24253]: cluster 2024-08-31T07:47:45.014481+0000 mgr.a (mgr.14388) 14550 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:46 smithi027 bash[22610]: cluster 2024-08-31T07:47:45.014481+0000 mgr.a (mgr.14388) 14550 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:46 smithi191 bash[24992]: cluster 2024-08-31T07:47:45.014481+0000 mgr.a (mgr.14388) 14550 : cluster [DBG] pgmap v10087: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:47 smithi163 bash[24253]: audit 2024-08-31T07:47:45.785137+0000 mgr.a (mgr.14388) 14551 : audit [DBG] from='client.316020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:47 smithi027 bash[22610]: audit 2024-08-31T07:47:45.785137+0000 mgr.a (mgr.14388) 14551 : audit [DBG] from='client.316020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:47 smithi191 bash[24992]: audit 2024-08-31T07:47:45.785137+0000 mgr.a (mgr.14388) 14551 : audit [DBG] from='client.316020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:48 smithi163 bash[24253]: cluster 2024-08-31T07:47:47.015471+0000 mgr.a (mgr.14388) 14552 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:48 smithi027 bash[22610]: cluster 2024-08-31T07:47:47.015471+0000 mgr.a (mgr.14388) 14552 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:48 smithi191 bash[24992]: cluster 2024-08-31T07:47:47.015471+0000 mgr.a (mgr.14388) 14552 : cluster [DBG] pgmap v10088: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:50 smithi163 bash[24253]: cluster 2024-08-31T07:47:49.017705+0000 mgr.a (mgr.14388) 14553 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:50 smithi027 bash[22610]: cluster 2024-08-31T07:47:49.017705+0000 mgr.a (mgr.14388) 14553 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:50 smithi191 bash[24992]: cluster 2024-08-31T07:47:49.017705+0000 mgr.a (mgr.14388) 14553 : cluster [DBG] pgmap v10089: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:51.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:47:51.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:51.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:47:51.945 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:51.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:51.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:51.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:51.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:52 smithi163 bash[24253]: cluster 2024-08-31T07:47:51.018466+0000 mgr.a (mgr.14388) 14554 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:52 smithi027 bash[22610]: cluster 2024-08-31T07:47:51.018466+0000 mgr.a (mgr.14388) 14554 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:52 smithi191 bash[24992]: cluster 2024-08-31T07:47:51.018466+0000 mgr.a (mgr.14388) 14554 : cluster [DBG] pgmap v10090: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:53 smithi163 bash[24253]: audit 2024-08-31T07:47:51.534901+0000 mgr.a (mgr.14388) 14555 : audit [DBG] from='client.316098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:53 smithi027 bash[22610]: audit 2024-08-31T07:47:51.534901+0000 mgr.a (mgr.14388) 14555 : audit [DBG] from='client.316098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:53 smithi191 bash[24992]: audit 2024-08-31T07:47:51.534901+0000 mgr.a (mgr.14388) 14555 : audit [DBG] from='client.316098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:54 smithi163 bash[24253]: cluster 2024-08-31T07:47:53.020742+0000 mgr.a (mgr.14388) 14556 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:54 smithi027 bash[22610]: cluster 2024-08-31T07:47:53.020742+0000 mgr.a (mgr.14388) 14556 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:54 smithi191 bash[24992]: cluster 2024-08-31T07:47:53.020742+0000 mgr.a (mgr.14388) 14556 : cluster [DBG] pgmap v10091: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:47:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:56 smithi163 bash[24253]: cluster 2024-08-31T07:47:55.021516+0000 mgr.a (mgr.14388) 14557 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:56 smithi027 bash[22610]: cluster 2024-08-31T07:47:55.021516+0000 mgr.a (mgr.14388) 14557 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:56 smithi191 bash[24992]: cluster 2024-08-31T07:47:55.021516+0000 mgr.a (mgr.14388) 14557 : cluster [DBG] pgmap v10092: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:56.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:47:56.948 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:47:56.948 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:47:57.693 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:47:57.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:47:57.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:47:57.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:47:57.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:47:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:58 smithi163 bash[24253]: cluster 2024-08-31T07:47:57.022079+0000 mgr.a (mgr.14388) 14558 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:47:58 smithi163 bash[24253]: audit 2024-08-31T07:47:57.278855+0000 mgr.a (mgr.14388) 14559 : audit [DBG] from='client.316176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:58 smithi027 bash[22610]: cluster 2024-08-31T07:47:57.022079+0000 mgr.a (mgr.14388) 14558 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:47:58 smithi027 bash[22610]: audit 2024-08-31T07:47:57.278855+0000 mgr.a (mgr.14388) 14559 : audit [DBG] from='client.316176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:47:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:58 smithi191 bash[24992]: cluster 2024-08-31T07:47:57.022079+0000 mgr.a (mgr.14388) 14558 : cluster [DBG] pgmap v10093: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:47:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:47:58 smithi191 bash[24992]: audit 2024-08-31T07:47:57.278855+0000 mgr.a (mgr.14388) 14559 : audit [DBG] from='client.316176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:00 smithi163 bash[24253]: cluster 2024-08-31T07:47:59.024364+0000 mgr.a (mgr.14388) 14560 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:48:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:00 smithi027 bash[22610]: cluster 2024-08-31T07:47:59.024364+0000 mgr.a (mgr.14388) 14560 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:48:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:00 smithi191 bash[24992]: cluster 2024-08-31T07:47:59.024364+0000 mgr.a (mgr.14388) 14560 : cluster [DBG] pgmap v10094: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:48:02.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:48:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:48:02.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:48:02.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:02 smithi163 bash[24253]: cluster 2024-08-31T07:48:01.025181+0000 mgr.a (mgr.14388) 14561 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:02 smithi027 bash[22610]: cluster 2024-08-31T07:48:01.025181+0000 mgr.a (mgr.14388) 14561 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:02 smithi191 bash[24992]: cluster 2024-08-31T07:48:01.025181+0000 mgr.a (mgr.14388) 14561 : cluster [DBG] pgmap v10095: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:03.472 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:48:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:48:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:48:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:48:03.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:48:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:04 smithi163 bash[24253]: cluster 2024-08-31T07:48:03.027120+0000 mgr.a (mgr.14388) 14562 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:04 smithi163 bash[24253]: audit 2024-08-31T07:48:03.036637+0000 mgr.a (mgr.14388) 14563 : audit [DBG] from='client.316251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:04 smithi027 bash[22610]: cluster 2024-08-31T07:48:03.027120+0000 mgr.a (mgr.14388) 14562 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:04.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:04 smithi027 bash[22610]: audit 2024-08-31T07:48:03.036637+0000 mgr.a (mgr.14388) 14563 : audit [DBG] from='client.316251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:04 smithi191 bash[24992]: cluster 2024-08-31T07:48:03.027120+0000 mgr.a (mgr.14388) 14562 : cluster [DBG] pgmap v10096: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:04 smithi191 bash[24992]: audit 2024-08-31T07:48:03.036637+0000 mgr.a (mgr.14388) 14563 : audit [DBG] from='client.316251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:06 smithi163 bash[24253]: cluster 2024-08-31T07:48:05.027950+0000 mgr.a (mgr.14388) 14564 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:48:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:06 smithi027 bash[22610]: cluster 2024-08-31T07:48:05.027950+0000 mgr.a (mgr.14388) 14564 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:48:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:06 smithi191 bash[24992]: cluster 2024-08-31T07:48:05.027950+0000 mgr.a (mgr.14388) 14564 : cluster [DBG] pgmap v10097: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:48:08.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:48:08.474 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:48:08.474 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:48:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:08 smithi163 bash[24253]: cluster 2024-08-31T07:48:07.028817+0000 mgr.a (mgr.14388) 14565 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:48:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:08 smithi027 bash[22610]: cluster 2024-08-31T07:48:07.028817+0000 mgr.a (mgr.14388) 14565 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:48:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:08 smithi191 bash[24992]: cluster 2024-08-31T07:48:07.028817+0000 mgr.a (mgr.14388) 14565 : cluster [DBG] pgmap v10098: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:48:09.244 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:48:09.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:48:09.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:48:09.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:48:09.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:48:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:10 smithi163 bash[24253]: audit 2024-08-31T07:48:08.807109+0000 mgr.a (mgr.14388) 14566 : audit [DBG] from='client.316326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:10 smithi163 bash[24253]: cluster 2024-08-31T07:48:09.030094+0000 mgr.a (mgr.14388) 14567 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:10 smithi027 bash[22610]: audit 2024-08-31T07:48:08.807109+0000 mgr.a (mgr.14388) 14566 : audit [DBG] from='client.316326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:10 smithi027 bash[22610]: cluster 2024-08-31T07:48:09.030094+0000 mgr.a (mgr.14388) 14567 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:10 smithi191 bash[24992]: audit 2024-08-31T07:48:08.807109+0000 mgr.a (mgr.14388) 14566 : audit [DBG] from='client.316326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:10 smithi191 bash[24992]: cluster 2024-08-31T07:48:09.030094+0000 mgr.a (mgr.14388) 14567 : cluster [DBG] pgmap v10099: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:11 smithi163 bash[24253]: cluster 2024-08-31T07:48:11.030961+0000 mgr.a (mgr.14388) 14568 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:48:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:11 smithi027 bash[22610]: cluster 2024-08-31T07:48:11.030961+0000 mgr.a (mgr.14388) 14568 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:48:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:11 smithi191 bash[24992]: cluster 2024-08-31T07:48:11.030961+0000 mgr.a (mgr.14388) 14568 : cluster [DBG] pgmap v10100: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:48:14.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:48:14.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:48:14.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:48:14.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:14 smithi163 bash[24253]: cluster 2024-08-31T07:48:13.033004+0000 mgr.a (mgr.14388) 14569 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:15.584 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:14 smithi163 bash[24253]: audit 2024-08-31T07:48:14.044020+0000 mon.a (mon.0) 2753 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:48:15.584 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:14 smithi027 bash[22610]: cluster 2024-08-31T07:48:13.033004+0000 mgr.a (mgr.14388) 14569 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:15.585 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:14 smithi027 bash[22610]: audit 2024-08-31T07:48:14.044020+0000 mon.a (mon.0) 2753 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:48:15.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:14 smithi191 bash[24992]: cluster 2024-08-31T07:48:13.033004+0000 mgr.a (mgr.14388) 14569 : cluster [DBG] pgmap v10101: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:15.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:14 smithi191 bash[24992]: audit 2024-08-31T07:48:14.044020+0000 mon.a (mon.0) 2753 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:48:15.585 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:48:15.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:48:15.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:48:15.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:48:15.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:48:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:16 smithi163 bash[24253]: audit 2024-08-31T07:48:14.578301+0000 mgr.a (mgr.14388) 14570 : audit [DBG] from='client.316404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:16 smithi163 bash[24253]: cluster 2024-08-31T07:48:15.033635+0000 mgr.a (mgr.14388) 14571 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:16 smithi027 bash[22610]: audit 2024-08-31T07:48:14.578301+0000 mgr.a (mgr.14388) 14570 : audit [DBG] from='client.316404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:16.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:16 smithi027 bash[22610]: cluster 2024-08-31T07:48:15.033635+0000 mgr.a (mgr.14388) 14571 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:16 smithi191 bash[24992]: audit 2024-08-31T07:48:14.578301+0000 mgr.a (mgr.14388) 14570 : audit [DBG] from='client.316404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:16 smithi191 bash[24992]: cluster 2024-08-31T07:48:15.033635+0000 mgr.a (mgr.14388) 14571 : cluster [DBG] pgmap v10102: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:18 smithi163 bash[24253]: cluster 2024-08-31T07:48:17.034426+0000 mgr.a (mgr.14388) 14572 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:18 smithi027 bash[22610]: cluster 2024-08-31T07:48:17.034426+0000 mgr.a (mgr.14388) 14572 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:18 smithi191 bash[24992]: cluster 2024-08-31T07:48:17.034426+0000 mgr.a (mgr.14388) 14572 : cluster [DBG] pgmap v10103: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:19.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:48:19.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:48:19.984 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:48:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:20 smithi163 bash[24253]: cluster 2024-08-31T07:48:19.036659+0000 mgr.a (mgr.14388) 14573 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:48:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:20 smithi163 bash[24253]: audit 2024-08-31T07:48:19.382678+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:20 smithi163 bash[24253]: audit 2024-08-31T07:48:19.387998+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:20 smithi163 bash[24253]: audit 2024-08-31T07:48:19.409216+0000 mon.a (mon.0) 2756 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:20 smithi163 bash[24253]: audit 2024-08-31T07:48:19.413015+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:20 smithi163 bash[24253]: audit 2024-08-31T07:48:19.429568+0000 mon.a (mon.0) 2758 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:20 smithi163 bash[24253]: audit 2024-08-31T07:48:19.433793+0000 mon.a (mon.0) 2759 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:20 smithi027 bash[22610]: cluster 2024-08-31T07:48:19.036659+0000 mgr.a (mgr.14388) 14573 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:48:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:20 smithi027 bash[22610]: audit 2024-08-31T07:48:19.382678+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:20 smithi027 bash[22610]: audit 2024-08-31T07:48:19.387998+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:20 smithi027 bash[22610]: audit 2024-08-31T07:48:19.409216+0000 mon.a (mon.0) 2756 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:20 smithi027 bash[22610]: audit 2024-08-31T07:48:19.413015+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:20 smithi027 bash[22610]: audit 2024-08-31T07:48:19.429568+0000 mon.a (mon.0) 2758 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:20 smithi027 bash[22610]: audit 2024-08-31T07:48:19.433793+0000 mon.a (mon.0) 2759 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:20 smithi191 bash[24992]: cluster 2024-08-31T07:48:19.036659+0000 mgr.a (mgr.14388) 14573 : cluster [DBG] pgmap v10104: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:48:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:20 smithi191 bash[24992]: audit 2024-08-31T07:48:19.382678+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:20 smithi191 bash[24992]: audit 2024-08-31T07:48:19.387998+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:20 smithi191 bash[24992]: audit 2024-08-31T07:48:19.409216+0000 mon.a (mon.0) 2756 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:20 smithi191 bash[24992]: audit 2024-08-31T07:48:19.413015+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:20 smithi191 bash[24992]: audit 2024-08-31T07:48:19.429568+0000 mon.a (mon.0) 2758 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:20 smithi191 bash[24992]: audit 2024-08-31T07:48:19.433793+0000 mon.a (mon.0) 2759 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:21.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:48:20 smithi027 bash[22863]: debug 2024-08-31T07:48:20.862+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:48:21.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:48:20 smithi027 bash[22863]: debug 2024-08-31T07:48:20.874+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:48:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:21 smithi027 bash[22610]: audit 2024-08-31T07:48:20.131991+0000 mon.a (mon.0) 2760 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:48:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:21 smithi027 bash[22610]: audit 2024-08-31T07:48:20.133218+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:48:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:21 smithi027 bash[22610]: audit 2024-08-31T07:48:20.141097+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:21 smithi027 bash[22610]: audit 2024-08-31T07:48:20.143642+0000 mon.a (mon.0) 2763 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:48:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:21 smithi027 bash[22610]: audit 2024-08-31T07:48:20.145500+0000 mgr.a (mgr.14388) 14574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:48:21.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:21 smithi027 bash[22610]: audit 2024-08-31T07:48:20.300779+0000 mgr.a (mgr.14388) 14575 : audit [DBG] from='client.316476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:21.270 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:48:21.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:48:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:48:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:48:21.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:48:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:21 smithi163 bash[24253]: audit 2024-08-31T07:48:20.131991+0000 mon.a (mon.0) 2760 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:48:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:21 smithi163 bash[24253]: audit 2024-08-31T07:48:20.133218+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:48:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:21 smithi163 bash[24253]: audit 2024-08-31T07:48:20.141097+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:21 smithi163 bash[24253]: audit 2024-08-31T07:48:20.143642+0000 mon.a (mon.0) 2763 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:48:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:21 smithi163 bash[24253]: audit 2024-08-31T07:48:20.145500+0000 mgr.a (mgr.14388) 14574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:48:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:21 smithi163 bash[24253]: audit 2024-08-31T07:48:20.300779+0000 mgr.a (mgr.14388) 14575 : audit [DBG] from='client.316476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:21 smithi191 bash[24992]: audit 2024-08-31T07:48:20.131991+0000 mon.a (mon.0) 2760 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:48:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:21 smithi191 bash[24992]: audit 2024-08-31T07:48:20.133218+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:48:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:21 smithi191 bash[24992]: audit 2024-08-31T07:48:20.141097+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:48:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:21 smithi191 bash[24992]: audit 2024-08-31T07:48:20.143642+0000 mon.a (mon.0) 2763 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:48:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:21 smithi191 bash[24992]: audit 2024-08-31T07:48:20.145500+0000 mgr.a (mgr.14388) 14574 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:48:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:21 smithi191 bash[24992]: audit 2024-08-31T07:48:20.300779+0000 mgr.a (mgr.14388) 14575 : audit [DBG] from='client.316476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:22 smithi163 bash[24253]: audit 2024-08-31T07:48:20.865547+0000 mgr.a (mgr.14388) 14576 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:48:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:22 smithi163 bash[24253]: cephadm 2024-08-31T07:48:20.878337+0000 mgr.a (mgr.14388) 14577 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:48:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:22 smithi163 bash[24253]: cluster 2024-08-31T07:48:21.037229+0000 mgr.a (mgr.14388) 14578 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:22 smithi027 bash[22610]: audit 2024-08-31T07:48:20.865547+0000 mgr.a (mgr.14388) 14576 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:48:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:22 smithi027 bash[22610]: cephadm 2024-08-31T07:48:20.878337+0000 mgr.a (mgr.14388) 14577 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:48:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:22 smithi027 bash[22610]: cluster 2024-08-31T07:48:21.037229+0000 mgr.a (mgr.14388) 14578 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:22 smithi191 bash[24992]: audit 2024-08-31T07:48:20.865547+0000 mgr.a (mgr.14388) 14576 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:48:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:22 smithi191 bash[24992]: cephadm 2024-08-31T07:48:20.878337+0000 mgr.a (mgr.14388) 14577 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:48:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:22 smithi191 bash[24992]: cluster 2024-08-31T07:48:21.037229+0000 mgr.a (mgr.14388) 14578 : cluster [DBG] pgmap v10105: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:24 smithi163 bash[24253]: cluster 2024-08-31T07:48:23.039463+0000 mgr.a (mgr.14388) 14579 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:24 smithi027 bash[22610]: cluster 2024-08-31T07:48:23.039463+0000 mgr.a (mgr.14388) 14579 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:24 smithi191 bash[24992]: cluster 2024-08-31T07:48:23.039463+0000 mgr.a (mgr.14388) 14579 : cluster [DBG] pgmap v10106: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:26.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:48:26.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:48:26.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:48:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:26 smithi163 bash[24253]: cluster 2024-08-31T07:48:25.040224+0000 mgr.a (mgr.14388) 14580 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:26 smithi027 bash[22610]: cluster 2024-08-31T07:48:25.040224+0000 mgr.a (mgr.14388) 14580 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:26 smithi191 bash[24992]: cluster 2024-08-31T07:48:25.040224+0000 mgr.a (mgr.14388) 14580 : cluster [DBG] pgmap v10107: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:27.044 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:48:27.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:48:27.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:48:27.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:48:27.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:48:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:28 smithi163 bash[24253]: audit 2024-08-31T07:48:26.607255+0000 mgr.a (mgr.14388) 14581 : audit [DBG] from='client.316659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:28 smithi163 bash[24253]: cluster 2024-08-31T07:48:27.040723+0000 mgr.a (mgr.14388) 14582 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:28 smithi027 bash[22610]: audit 2024-08-31T07:48:26.607255+0000 mgr.a (mgr.14388) 14581 : audit [DBG] from='client.316659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:28 smithi027 bash[22610]: cluster 2024-08-31T07:48:27.040723+0000 mgr.a (mgr.14388) 14582 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:28 smithi191 bash[24992]: audit 2024-08-31T07:48:26.607255+0000 mgr.a (mgr.14388) 14581 : audit [DBG] from='client.316659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:28 smithi191 bash[24992]: cluster 2024-08-31T07:48:27.040723+0000 mgr.a (mgr.14388) 14582 : cluster [DBG] pgmap v10108: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:30 smithi163 bash[24253]: cluster 2024-08-31T07:48:29.042915+0000 mgr.a (mgr.14388) 14583 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:30 smithi027 bash[22610]: cluster 2024-08-31T07:48:29.042915+0000 mgr.a (mgr.14388) 14583 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:30 smithi191 bash[24992]: cluster 2024-08-31T07:48:29.042915+0000 mgr.a (mgr.14388) 14583 : cluster [DBG] pgmap v10109: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:32.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:48:32.046 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:48:32.046 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:48:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:32 smithi163 bash[24253]: cluster 2024-08-31T07:48:31.043618+0000 mgr.a (mgr.14388) 14584 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:32 smithi027 bash[22610]: cluster 2024-08-31T07:48:31.043618+0000 mgr.a (mgr.14388) 14584 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:32 smithi191 bash[24992]: cluster 2024-08-31T07:48:31.043618+0000 mgr.a (mgr.14388) 14584 : cluster [DBG] pgmap v10110: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:32.794 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:48:32.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:48:32.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:48:32.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:48:32.795 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:48:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:33 smithi163 bash[24253]: audit 2024-08-31T07:48:32.375183+0000 mgr.a (mgr.14388) 14585 : audit [DBG] from='client.316731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:33 smithi027 bash[22610]: audit 2024-08-31T07:48:32.375183+0000 mgr.a (mgr.14388) 14585 : audit [DBG] from='client.316731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:33 smithi191 bash[24992]: audit 2024-08-31T07:48:32.375183+0000 mgr.a (mgr.14388) 14585 : audit [DBG] from='client.316731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:34 smithi163 bash[24253]: cluster 2024-08-31T07:48:33.045860+0000 mgr.a (mgr.14388) 14586 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:34 smithi027 bash[22610]: cluster 2024-08-31T07:48:33.045860+0000 mgr.a (mgr.14388) 14586 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:34 smithi191 bash[24992]: cluster 2024-08-31T07:48:33.045860+0000 mgr.a (mgr.14388) 14586 : cluster [DBG] pgmap v10111: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:48:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:36 smithi163 bash[24253]: cluster 2024-08-31T07:48:35.046627+0000 mgr.a (mgr.14388) 14587 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:36 smithi027 bash[22610]: cluster 2024-08-31T07:48:35.046627+0000 mgr.a (mgr.14388) 14587 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:36 smithi191 bash[24992]: cluster 2024-08-31T07:48:35.046627+0000 mgr.a (mgr.14388) 14587 : cluster [DBG] pgmap v10112: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:37.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:48:37.796 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:48:37.796 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:48:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:38 smithi163 bash[24253]: cluster 2024-08-31T07:48:37.047372+0000 mgr.a (mgr.14388) 14588 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:38 smithi027 bash[22610]: cluster 2024-08-31T07:48:37.047372+0000 mgr.a (mgr.14388) 14588 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:38 smithi191 bash[24992]: cluster 2024-08-31T07:48:37.047372+0000 mgr.a (mgr.14388) 14588 : cluster [DBG] pgmap v10113: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:38.577 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:48:38.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:48:38.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:48:38.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:48:38.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:48:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:39 smithi163 bash[24253]: audit 2024-08-31T07:48:38.133812+0000 mgr.a (mgr.14388) 14589 : audit [DBG] from='client.316809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:39 smithi027 bash[22610]: audit 2024-08-31T07:48:38.133812+0000 mgr.a (mgr.14388) 14589 : audit [DBG] from='client.316809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:39 smithi191 bash[24992]: audit 2024-08-31T07:48:38.133812+0000 mgr.a (mgr.14388) 14589 : audit [DBG] from='client.316809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:40.454 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:40 smithi163 bash[24253]: cluster 2024-08-31T07:48:39.050091+0000 mgr.a (mgr.14388) 14590 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:40 smithi027 bash[22610]: cluster 2024-08-31T07:48:39.050091+0000 mgr.a (mgr.14388) 14590 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:40 smithi191 bash[24992]: cluster 2024-08-31T07:48:39.050091+0000 mgr.a (mgr.14388) 14590 : cluster [DBG] pgmap v10114: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:42.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:42 smithi027 bash[22610]: cluster 2024-08-31T07:48:41.050901+0000 mgr.a (mgr.14388) 14591 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:48:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:42 smithi191 bash[24992]: cluster 2024-08-31T07:48:41.050901+0000 mgr.a (mgr.14388) 14591 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:48:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:42 smithi163 bash[24253]: cluster 2024-08-31T07:48:41.050901+0000 mgr.a (mgr.14388) 14591 : cluster [DBG] pgmap v10115: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:48:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:48:43.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:48:43.580 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:48:44.338 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:48:44.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:48:44.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:48:44.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:48:44.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:48:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:44 smithi027 bash[22610]: cluster 2024-08-31T07:48:43.052753+0000 mgr.a (mgr.14388) 14592 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:44 smithi191 bash[24992]: cluster 2024-08-31T07:48:43.052753+0000 mgr.a (mgr.14388) 14592 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:44 smithi163 bash[24253]: cluster 2024-08-31T07:48:43.052753+0000 mgr.a (mgr.14388) 14592 : cluster [DBG] pgmap v10116: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:45 smithi027 bash[22610]: audit 2024-08-31T07:48:43.907164+0000 mgr.a (mgr.14388) 14593 : audit [DBG] from='client.316887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:45 smithi191 bash[24992]: audit 2024-08-31T07:48:43.907164+0000 mgr.a (mgr.14388) 14593 : audit [DBG] from='client.316887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:45 smithi163 bash[24253]: audit 2024-08-31T07:48:43.907164+0000 mgr.a (mgr.14388) 14593 : audit [DBG] from='client.316887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:46 smithi027 bash[22610]: cluster 2024-08-31T07:48:45.053640+0000 mgr.a (mgr.14388) 14594 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:48:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:46 smithi191 bash[24992]: cluster 2024-08-31T07:48:45.053640+0000 mgr.a (mgr.14388) 14594 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:48:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:46 smithi163 bash[24253]: cluster 2024-08-31T07:48:45.053640+0000 mgr.a (mgr.14388) 14594 : cluster [DBG] pgmap v10117: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:48:48.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:48 smithi027 bash[22610]: cluster 2024-08-31T07:48:47.054406+0000 mgr.a (mgr.14388) 14595 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:48:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:48 smithi191 bash[24992]: cluster 2024-08-31T07:48:47.054406+0000 mgr.a (mgr.14388) 14595 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:48:48.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:48 smithi163 bash[24253]: cluster 2024-08-31T07:48:47.054406+0000 mgr.a (mgr.14388) 14595 : cluster [DBG] pgmap v10118: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:48:49.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:48:49.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:48:49.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:48:50.097 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:48:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:48:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:48:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:48:50.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:48:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:50 smithi027 bash[22610]: cluster 2024-08-31T07:48:49.056612+0000 mgr.a (mgr.14388) 14596 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:50 smithi191 bash[24992]: cluster 2024-08-31T07:48:49.056612+0000 mgr.a (mgr.14388) 14596 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:50 smithi163 bash[24253]: cluster 2024-08-31T07:48:49.056612+0000 mgr.a (mgr.14388) 14596 : cluster [DBG] pgmap v10119: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:51 smithi191 bash[24992]: audit 2024-08-31T07:48:49.674799+0000 mgr.a (mgr.14388) 14597 : audit [DBG] from='client.316965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:51 smithi163 bash[24253]: audit 2024-08-31T07:48:49.674799+0000 mgr.a (mgr.14388) 14597 : audit [DBG] from='client.316965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:51 smithi027 bash[22610]: audit 2024-08-31T07:48:49.674799+0000 mgr.a (mgr.14388) 14597 : audit [DBG] from='client.316965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:52 smithi191 bash[24992]: cluster 2024-08-31T07:48:51.057491+0000 mgr.a (mgr.14388) 14598 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:52 smithi163 bash[24253]: cluster 2024-08-31T07:48:51.057491+0000 mgr.a (mgr.14388) 14598 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:52 smithi027 bash[22610]: cluster 2024-08-31T07:48:51.057491+0000 mgr.a (mgr.14388) 14598 : cluster [DBG] pgmap v10120: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:54 smithi191 bash[24992]: cluster 2024-08-31T07:48:53.059630+0000 mgr.a (mgr.14388) 14599 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:48:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:54 smithi163 bash[24253]: cluster 2024-08-31T07:48:53.059630+0000 mgr.a (mgr.14388) 14599 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:48:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:54 smithi027 bash[22610]: cluster 2024-08-31T07:48:53.059630+0000 mgr.a (mgr.14388) 14599 : cluster [DBG] pgmap v10121: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:48:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:48:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:48:55.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:48:55.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:48:55.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:48:55.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:48:55.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:48:55.857 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:48:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:56 smithi191 bash[24992]: cluster 2024-08-31T07:48:55.060373+0000 mgr.a (mgr.14388) 14600 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:56 smithi163 bash[24253]: cluster 2024-08-31T07:48:55.060373+0000 mgr.a (mgr.14388) 14600 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:56 smithi027 bash[22610]: cluster 2024-08-31T07:48:55.060373+0000 mgr.a (mgr.14388) 14600 : cluster [DBG] pgmap v10122: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:57 smithi191 bash[24992]: audit 2024-08-31T07:48:55.431397+0000 mgr.a (mgr.14388) 14601 : audit [DBG] from='client.317040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:57 smithi163 bash[24253]: audit 2024-08-31T07:48:55.431397+0000 mgr.a (mgr.14388) 14601 : audit [DBG] from='client.317040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:57 smithi027 bash[22610]: audit 2024-08-31T07:48:55.431397+0000 mgr.a (mgr.14388) 14601 : audit [DBG] from='client.317040 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:48:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:48:58 smithi191 bash[24992]: cluster 2024-08-31T07:48:57.061270+0000 mgr.a (mgr.14388) 14602 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:48:58 smithi163 bash[24253]: cluster 2024-08-31T07:48:57.061270+0000 mgr.a (mgr.14388) 14602 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:48:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:48:58 smithi027 bash[22610]: cluster 2024-08-31T07:48:57.061270+0000 mgr.a (mgr.14388) 14602 : cluster [DBG] pgmap v10123: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:00 smithi191 bash[24992]: cluster 2024-08-31T07:48:59.063518+0000 mgr.a (mgr.14388) 14603 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:00 smithi163 bash[24253]: cluster 2024-08-31T07:48:59.063518+0000 mgr.a (mgr.14388) 14603 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:00 smithi027 bash[22610]: cluster 2024-08-31T07:48:59.063518+0000 mgr.a (mgr.14388) 14603 : cluster [DBG] pgmap v10124: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:00.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:00.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:00.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:01.626 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:01.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:01.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:01.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:01.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:49:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:02 smithi191 bash[24992]: cluster 2024-08-31T07:49:01.064402+0000 mgr.a (mgr.14388) 14604 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:02 smithi191 bash[24992]: audit 2024-08-31T07:49:01.196009+0000 mgr.a (mgr.14388) 14605 : audit [DBG] from='client.317118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:02 smithi163 bash[24253]: cluster 2024-08-31T07:49:01.064402+0000 mgr.a (mgr.14388) 14604 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:02 smithi163 bash[24253]: audit 2024-08-31T07:49:01.196009+0000 mgr.a (mgr.14388) 14605 : audit [DBG] from='client.317118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:02 smithi027 bash[22610]: cluster 2024-08-31T07:49:01.064402+0000 mgr.a (mgr.14388) 14604 : cluster [DBG] pgmap v10125: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:02 smithi027 bash[22610]: audit 2024-08-31T07:49:01.196009+0000 mgr.a (mgr.14388) 14605 : audit [DBG] from='client.317118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:04 smithi191 bash[24992]: cluster 2024-08-31T07:49:03.066655+0000 mgr.a (mgr.14388) 14606 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:04 smithi163 bash[24253]: cluster 2024-08-31T07:49:03.066655+0000 mgr.a (mgr.14388) 14606 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:04 smithi027 bash[22610]: cluster 2024-08-31T07:49:03.066655+0000 mgr.a (mgr.14388) 14606 : cluster [DBG] pgmap v10126: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:06 smithi191 bash[24992]: cluster 2024-08-31T07:49:05.067421+0000 mgr.a (mgr.14388) 14607 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:06.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:06.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:06.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:06 smithi163 bash[24253]: cluster 2024-08-31T07:49:05.067421+0000 mgr.a (mgr.14388) 14607 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:06 smithi027 bash[22610]: cluster 2024-08-31T07:49:05.067421+0000 mgr.a (mgr.14388) 14607 : cluster [DBG] pgmap v10127: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:07.389 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:07.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:07.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:07.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:07.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:49:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:08 smithi191 bash[24992]: audit 2024-08-31T07:49:06.963542+0000 mgr.a (mgr.14388) 14608 : audit [DBG] from='client.317193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:08 smithi191 bash[24992]: cluster 2024-08-31T07:49:07.067891+0000 mgr.a (mgr.14388) 14609 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:08 smithi163 bash[24253]: audit 2024-08-31T07:49:06.963542+0000 mgr.a (mgr.14388) 14608 : audit [DBG] from='client.317193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:08 smithi163 bash[24253]: cluster 2024-08-31T07:49:07.067891+0000 mgr.a (mgr.14388) 14609 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:08 smithi027 bash[22610]: audit 2024-08-31T07:49:06.963542+0000 mgr.a (mgr.14388) 14608 : audit [DBG] from='client.317193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:08.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:08 smithi027 bash[22610]: cluster 2024-08-31T07:49:07.067891+0000 mgr.a (mgr.14388) 14609 : cluster [DBG] pgmap v10128: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:10 smithi163 bash[24253]: cluster 2024-08-31T07:49:09.070192+0000 mgr.a (mgr.14388) 14610 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:10 smithi027 bash[22610]: cluster 2024-08-31T07:49:09.070192+0000 mgr.a (mgr.14388) 14610 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:10 smithi191 bash[24992]: cluster 2024-08-31T07:49:09.070192+0000 mgr.a (mgr.14388) 14610 : cluster [DBG] pgmap v10129: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:12.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:12.391 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:12.391 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:12 smithi163 bash[24253]: cluster 2024-08-31T07:49:11.070991+0000 mgr.a (mgr.14388) 14611 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:12 smithi027 bash[22610]: cluster 2024-08-31T07:49:11.070991+0000 mgr.a (mgr.14388) 14611 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:12 smithi191 bash[24992]: cluster 2024-08-31T07:49:11.070991+0000 mgr.a (mgr.14388) 14611 : cluster [DBG] pgmap v10130: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:13.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:13.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:13.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:13.153 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:49:13.153 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:14 smithi163 bash[24253]: audit 2024-08-31T07:49:12.723979+0000 mgr.a (mgr.14388) 14612 : audit [DBG] from='client.317265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:14 smithi163 bash[24253]: cluster 2024-08-31T07:49:13.072446+0000 mgr.a (mgr.14388) 14613 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:14 smithi027 bash[22610]: audit 2024-08-31T07:49:12.723979+0000 mgr.a (mgr.14388) 14612 : audit [DBG] from='client.317265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:14 smithi027 bash[22610]: cluster 2024-08-31T07:49:13.072446+0000 mgr.a (mgr.14388) 14613 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:14 smithi191 bash[24992]: audit 2024-08-31T07:49:12.723979+0000 mgr.a (mgr.14388) 14612 : audit [DBG] from='client.317265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:14 smithi191 bash[24992]: cluster 2024-08-31T07:49:13.072446+0000 mgr.a (mgr.14388) 14613 : cluster [DBG] pgmap v10131: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:16 smithi163 bash[24253]: cluster 2024-08-31T07:49:15.073178+0000 mgr.a (mgr.14388) 14614 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:49:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:16 smithi027 bash[22610]: cluster 2024-08-31T07:49:15.073178+0000 mgr.a (mgr.14388) 14614 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:49:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:16 smithi191 bash[24992]: cluster 2024-08-31T07:49:15.073178+0000 mgr.a (mgr.14388) 14614 : cluster [DBG] pgmap v10132: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:49:18.154 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:18.155 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:18.155 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:18 smithi163 bash[24253]: cluster 2024-08-31T07:49:17.073983+0000 mgr.a (mgr.14388) 14615 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:49:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:18 smithi027 bash[22610]: cluster 2024-08-31T07:49:17.073983+0000 mgr.a (mgr.14388) 14615 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:49:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:18 smithi191 bash[24992]: cluster 2024-08-31T07:49:17.073983+0000 mgr.a (mgr.14388) 14615 : cluster [DBG] pgmap v10133: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:49:18.947 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:18.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:49:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:20 smithi163 bash[24253]: audit 2024-08-31T07:49:18.494278+0000 mgr.a (mgr.14388) 14616 : audit [DBG] from='client.317343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:20 smithi163 bash[24253]: cluster 2024-08-31T07:49:19.076725+0000 mgr.a (mgr.14388) 14617 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:20 smithi027 bash[22610]: audit 2024-08-31T07:49:18.494278+0000 mgr.a (mgr.14388) 14616 : audit [DBG] from='client.317343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:20 smithi027 bash[22610]: cluster 2024-08-31T07:49:19.076725+0000 mgr.a (mgr.14388) 14617 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:20 smithi191 bash[24992]: audit 2024-08-31T07:49:18.494278+0000 mgr.a (mgr.14388) 14616 : audit [DBG] from='client.317343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:20 smithi191 bash[24992]: cluster 2024-08-31T07:49:19.076725+0000 mgr.a (mgr.14388) 14617 : cluster [DBG] pgmap v10134: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:21 smithi163 bash[24253]: audit 2024-08-31T07:49:20.935302+0000 mon.a (mon.0) 2764 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:49:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:21 smithi027 bash[22610]: audit 2024-08-31T07:49:20.935302+0000 mon.a (mon.0) 2764 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:49:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:21 smithi191 bash[24992]: audit 2024-08-31T07:49:20.935302+0000 mon.a (mon.0) 2764 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:49:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:22 smithi163 bash[24253]: cluster 2024-08-31T07:49:21.077491+0000 mgr.a (mgr.14388) 14618 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:49:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:22 smithi163 bash[24253]: audit 2024-08-31T07:49:21.778132+0000 mon.a (mon.0) 2765 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:49:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:22 smithi163 bash[24253]: audit 2024-08-31T07:49:21.779900+0000 mon.a (mon.0) 2766 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:49:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:22 smithi163 bash[24253]: audit 2024-08-31T07:49:21.791623+0000 mon.a (mon.0) 2767 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:49:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:22 smithi163 bash[24253]: audit 2024-08-31T07:49:21.796496+0000 mon.a (mon.0) 2768 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:49:22.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:49:22 smithi027 bash[22863]: debug 2024-08-31T07:49:22.536+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:49:22.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:49:22 smithi027 bash[22863]: debug 2024-08-31T07:49:22.540+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:49:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:22 smithi027 bash[22610]: cluster 2024-08-31T07:49:21.077491+0000 mgr.a (mgr.14388) 14618 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:49:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:22 smithi027 bash[22610]: audit 2024-08-31T07:49:21.778132+0000 mon.a (mon.0) 2765 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:49:22.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:22 smithi027 bash[22610]: audit 2024-08-31T07:49:21.779900+0000 mon.a (mon.0) 2766 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:49:22.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:22 smithi027 bash[22610]: audit 2024-08-31T07:49:21.791623+0000 mon.a (mon.0) 2767 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:49:22.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:22 smithi027 bash[22610]: audit 2024-08-31T07:49:21.796496+0000 mon.a (mon.0) 2768 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:49:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:22 smithi191 bash[24992]: cluster 2024-08-31T07:49:21.077491+0000 mgr.a (mgr.14388) 14618 : cluster [DBG] pgmap v10135: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:49:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:22 smithi191 bash[24992]: audit 2024-08-31T07:49:21.778132+0000 mon.a (mon.0) 2765 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:49:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:22 smithi191 bash[24992]: audit 2024-08-31T07:49:21.779900+0000 mon.a (mon.0) 2766 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:49:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:22 smithi191 bash[24992]: audit 2024-08-31T07:49:21.791623+0000 mon.a (mon.0) 2767 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:49:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:22 smithi191 bash[24992]: audit 2024-08-31T07:49:21.796496+0000 mon.a (mon.0) 2768 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:49:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:23 smithi163 bash[24253]: audit 2024-08-31T07:49:21.798944+0000 mgr.a (mgr.14388) 14619 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:49:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:23 smithi027 bash[22610]: audit 2024-08-31T07:49:21.798944+0000 mgr.a (mgr.14388) 14619 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:49:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:23 smithi191 bash[24992]: audit 2024-08-31T07:49:21.798944+0000 mgr.a (mgr.14388) 14619 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:49:23.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:23.950 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:23.950 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:24 smithi163 bash[24253]: audit 2024-08-31T07:49:22.542516+0000 mgr.a (mgr.14388) 14620 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:49:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:24 smithi163 bash[24253]: cephadm 2024-08-31T07:49:22.543675+0000 mgr.a (mgr.14388) 14621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:49:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:24 smithi163 bash[24253]: cluster 2024-08-31T07:49:23.079817+0000 mgr.a (mgr.14388) 14622 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:24.727 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:24.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:24.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:24.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:24.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:49:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:24 smithi027 bash[22610]: audit 2024-08-31T07:49:22.542516+0000 mgr.a (mgr.14388) 14620 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:49:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:24 smithi027 bash[22610]: cephadm 2024-08-31T07:49:22.543675+0000 mgr.a (mgr.14388) 14621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:49:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:24 smithi027 bash[22610]: cluster 2024-08-31T07:49:23.079817+0000 mgr.a (mgr.14388) 14622 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:24 smithi191 bash[24992]: audit 2024-08-31T07:49:22.542516+0000 mgr.a (mgr.14388) 14620 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:49:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:24 smithi191 bash[24992]: cephadm 2024-08-31T07:49:22.543675+0000 mgr.a (mgr.14388) 14621 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:49:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:24 smithi191 bash[24992]: cluster 2024-08-31T07:49:23.079817+0000 mgr.a (mgr.14388) 14622 : cluster [DBG] pgmap v10136: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:25 smithi163 bash[24253]: audit 2024-08-31T07:49:24.281488+0000 mgr.a (mgr.14388) 14623 : audit [DBG] from='client.317526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:25 smithi027 bash[22610]: audit 2024-08-31T07:49:24.281488+0000 mgr.a (mgr.14388) 14623 : audit [DBG] from='client.317526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:25 smithi191 bash[24992]: audit 2024-08-31T07:49:24.281488+0000 mgr.a (mgr.14388) 14623 : audit [DBG] from='client.317526 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:26 smithi163 bash[24253]: cluster 2024-08-31T07:49:25.080716+0000 mgr.a (mgr.14388) 14624 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:26 smithi027 bash[22610]: cluster 2024-08-31T07:49:25.080716+0000 mgr.a (mgr.14388) 14624 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:26 smithi191 bash[24992]: cluster 2024-08-31T07:49:25.080716+0000 mgr.a (mgr.14388) 14624 : cluster [DBG] pgmap v10137: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:28.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:28 smithi163 bash[24253]: cluster 2024-08-31T07:49:27.081494+0000 mgr.a (mgr.14388) 14625 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:28 smithi027 bash[22610]: cluster 2024-08-31T07:49:27.081494+0000 mgr.a (mgr.14388) 14625 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:28 smithi191 bash[24992]: cluster 2024-08-31T07:49:27.081494+0000 mgr.a (mgr.14388) 14625 : cluster [DBG] pgmap v10138: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:29.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:29.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:29.729 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:30.484 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:30.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:30.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:30.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:30.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:49:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:30 smithi163 bash[24253]: cluster 2024-08-31T07:49:29.083693+0000 mgr.a (mgr.14388) 14626 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:30 smithi027 bash[22610]: cluster 2024-08-31T07:49:29.083693+0000 mgr.a (mgr.14388) 14626 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:30 smithi191 bash[24992]: cluster 2024-08-31T07:49:29.083693+0000 mgr.a (mgr.14388) 14626 : cluster [DBG] pgmap v10139: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:31 smithi163 bash[24253]: audit 2024-08-31T07:49:30.058828+0000 mgr.a (mgr.14388) 14627 : audit [DBG] from='client.317604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:31 smithi027 bash[22610]: audit 2024-08-31T07:49:30.058828+0000 mgr.a (mgr.14388) 14627 : audit [DBG] from='client.317604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:31 smithi191 bash[24992]: audit 2024-08-31T07:49:30.058828+0000 mgr.a (mgr.14388) 14627 : audit [DBG] from='client.317604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:32 smithi163 bash[24253]: cluster 2024-08-31T07:49:31.084555+0000 mgr.a (mgr.14388) 14628 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:32 smithi027 bash[22610]: cluster 2024-08-31T07:49:31.084555+0000 mgr.a (mgr.14388) 14628 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:32 smithi191 bash[24992]: cluster 2024-08-31T07:49:31.084555+0000 mgr.a (mgr.14388) 14628 : cluster [DBG] pgmap v10140: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:34 smithi163 bash[24253]: cluster 2024-08-31T07:49:33.086683+0000 mgr.a (mgr.14388) 14629 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:34 smithi027 bash[22610]: cluster 2024-08-31T07:49:33.086683+0000 mgr.a (mgr.14388) 14629 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:34 smithi191 bash[24992]: cluster 2024-08-31T07:49:33.086683+0000 mgr.a (mgr.14388) 14629 : cluster [DBG] pgmap v10141: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:49:35.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:35.486 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:35.486 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:36.242 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:36.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:36.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:36.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:36.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:49:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:36 smithi163 bash[24253]: cluster 2024-08-31T07:49:35.087478+0000 mgr.a (mgr.14388) 14630 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:36 smithi027 bash[22610]: cluster 2024-08-31T07:49:35.087478+0000 mgr.a (mgr.14388) 14630 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:36 smithi191 bash[24992]: cluster 2024-08-31T07:49:35.087478+0000 mgr.a (mgr.14388) 14630 : cluster [DBG] pgmap v10142: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:37 smithi163 bash[24253]: audit 2024-08-31T07:49:35.821707+0000 mgr.a (mgr.14388) 14631 : audit [DBG] from='client.317682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:37 smithi027 bash[22610]: audit 2024-08-31T07:49:35.821707+0000 mgr.a (mgr.14388) 14631 : audit [DBG] from='client.317682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:37 smithi191 bash[24992]: audit 2024-08-31T07:49:35.821707+0000 mgr.a (mgr.14388) 14631 : audit [DBG] from='client.317682 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:38 smithi163 bash[24253]: cluster 2024-08-31T07:49:37.088368+0000 mgr.a (mgr.14388) 14632 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:38 smithi027 bash[22610]: cluster 2024-08-31T07:49:37.088368+0000 mgr.a (mgr.14388) 14632 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:38 smithi191 bash[24992]: cluster 2024-08-31T07:49:37.088368+0000 mgr.a (mgr.14388) 14632 : cluster [DBG] pgmap v10143: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:40 smithi163 bash[24253]: cluster 2024-08-31T07:49:39.090588+0000 mgr.a (mgr.14388) 14633 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:40 smithi027 bash[22610]: cluster 2024-08-31T07:49:39.090588+0000 mgr.a (mgr.14388) 14633 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:40 smithi191 bash[24992]: cluster 2024-08-31T07:49:39.090588+0000 mgr.a (mgr.14388) 14633 : cluster [DBG] pgmap v10144: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:41.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:41.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:41.999 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:41.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:41.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:41.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:42.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:49:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:42 smithi163 bash[24253]: cluster 2024-08-31T07:49:41.091332+0000 mgr.a (mgr.14388) 14634 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:42 smithi027 bash[22610]: cluster 2024-08-31T07:49:41.091332+0000 mgr.a (mgr.14388) 14634 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:42 smithi191 bash[24992]: cluster 2024-08-31T07:49:41.091332+0000 mgr.a (mgr.14388) 14634 : cluster [DBG] pgmap v10145: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:43 smithi163 bash[24253]: audit 2024-08-31T07:49:41.575576+0000 mgr.a (mgr.14388) 14635 : audit [DBG] from='client.317754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:43 smithi027 bash[22610]: audit 2024-08-31T07:49:41.575576+0000 mgr.a (mgr.14388) 14635 : audit [DBG] from='client.317754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:43 smithi191 bash[24992]: audit 2024-08-31T07:49:41.575576+0000 mgr.a (mgr.14388) 14635 : audit [DBG] from='client.317754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:44 smithi163 bash[24253]: cluster 2024-08-31T07:49:43.093640+0000 mgr.a (mgr.14388) 14636 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:44 smithi027 bash[22610]: cluster 2024-08-31T07:49:43.093640+0000 mgr.a (mgr.14388) 14636 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:44 smithi191 bash[24992]: cluster 2024-08-31T07:49:43.093640+0000 mgr.a (mgr.14388) 14636 : cluster [DBG] pgmap v10146: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:46 smithi163 bash[24253]: cluster 2024-08-31T07:49:45.094443+0000 mgr.a (mgr.14388) 14637 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:46 smithi027 bash[22610]: cluster 2024-08-31T07:49:45.094443+0000 mgr.a (mgr.14388) 14637 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:46 smithi191 bash[24992]: cluster 2024-08-31T07:49:45.094443+0000 mgr.a (mgr.14388) 14637 : cluster [DBG] pgmap v10147: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:47.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:47.001 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:47.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:47 smithi027 bash[22610]: cluster 2024-08-31T07:49:47.094927+0000 mgr.a (mgr.14388) 14638 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:47 smithi027 bash[22610]: audit 2024-08-31T07:49:47.333669+0000 mgr.a (mgr.14388) 14639 : audit [DBG] from='client.317832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:47.775 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:47.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:49:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:47 smithi191 bash[24992]: cluster 2024-08-31T07:49:47.094927+0000 mgr.a (mgr.14388) 14638 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:47 smithi191 bash[24992]: audit 2024-08-31T07:49:47.333669+0000 mgr.a (mgr.14388) 14639 : audit [DBG] from='client.317832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:47 smithi163 bash[24253]: cluster 2024-08-31T07:49:47.094927+0000 mgr.a (mgr.14388) 14638 : cluster [DBG] pgmap v10148: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:47 smithi163 bash[24253]: audit 2024-08-31T07:49:47.333669+0000 mgr.a (mgr.14388) 14639 : audit [DBG] from='client.317832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:50 smithi163 bash[24253]: cluster 2024-08-31T07:49:49.097199+0000 mgr.a (mgr.14388) 14640 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:50 smithi027 bash[22610]: cluster 2024-08-31T07:49:49.097199+0000 mgr.a (mgr.14388) 14640 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:50 smithi191 bash[24992]: cluster 2024-08-31T07:49:49.097199+0000 mgr.a (mgr.14388) 14640 : cluster [DBG] pgmap v10149: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:49:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:52 smithi163 bash[24253]: cluster 2024-08-31T07:49:51.097996+0000 mgr.a (mgr.14388) 14641 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:52 smithi027 bash[22610]: cluster 2024-08-31T07:49:51.097996+0000 mgr.a (mgr.14388) 14641 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:52 smithi191 bash[24992]: cluster 2024-08-31T07:49:51.097996+0000 mgr.a (mgr.14388) 14641 : cluster [DBG] pgmap v10150: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:52.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:52.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:52.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:53.539 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:49:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:54 smithi163 bash[24253]: cluster 2024-08-31T07:49:53.099907+0000 mgr.a (mgr.14388) 14642 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:54 smithi163 bash[24253]: audit 2024-08-31T07:49:53.108831+0000 mgr.a (mgr.14388) 14643 : audit [DBG] from='client.317910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:54 smithi027 bash[22610]: cluster 2024-08-31T07:49:53.099907+0000 mgr.a (mgr.14388) 14642 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:54 smithi027 bash[22610]: audit 2024-08-31T07:49:53.108831+0000 mgr.a (mgr.14388) 14643 : audit [DBG] from='client.317910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:54 smithi191 bash[24992]: cluster 2024-08-31T07:49:53.099907+0000 mgr.a (mgr.14388) 14642 : cluster [DBG] pgmap v10151: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:49:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:54 smithi191 bash[24992]: audit 2024-08-31T07:49:53.108831+0000 mgr.a (mgr.14388) 14643 : audit [DBG] from='client.317910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:49:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:56 smithi163 bash[24253]: cluster 2024-08-31T07:49:55.100827+0000 mgr.a (mgr.14388) 14644 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:49:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:56 smithi027 bash[22610]: cluster 2024-08-31T07:49:55.100827+0000 mgr.a (mgr.14388) 14644 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:49:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:56 smithi191 bash[24992]: cluster 2024-08-31T07:49:55.100827+0000 mgr.a (mgr.14388) 14644 : cluster [DBG] pgmap v10152: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:49:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:49:58 smithi163 bash[24253]: cluster 2024-08-31T07:49:57.101632+0000 mgr.a (mgr.14388) 14645 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:49:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:49:58 smithi027 bash[22610]: cluster 2024-08-31T07:49:57.101632+0000 mgr.a (mgr.14388) 14645 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:49:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:49:58 smithi191 bash[24992]: cluster 2024-08-31T07:49:57.101632+0000 mgr.a (mgr.14388) 14645 : cluster [DBG] pgmap v10153: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:49:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:49:58.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:49:58.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:49:59.283 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:49:59.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:49:59.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:49:59.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:49:59.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:00 smithi163 bash[24253]: audit 2024-08-31T07:49:58.869496+0000 mgr.a (mgr.14388) 14646 : audit [DBG] from='client.317985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:00 smithi163 bash[24253]: cluster 2024-08-31T07:49:59.103013+0000 mgr.a (mgr.14388) 14647 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:00 smithi163 bash[24253]: cluster 2024-08-31T07:50:00.000145+0000 mon.a (mon.0) 2769 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:50:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:00 smithi027 bash[22610]: audit 2024-08-31T07:49:58.869496+0000 mgr.a (mgr.14388) 14646 : audit [DBG] from='client.317985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:00 smithi027 bash[22610]: cluster 2024-08-31T07:49:59.103013+0000 mgr.a (mgr.14388) 14647 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:00 smithi027 bash[22610]: cluster 2024-08-31T07:50:00.000145+0000 mon.a (mon.0) 2769 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:50:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:00 smithi191 bash[24992]: audit 2024-08-31T07:49:58.869496+0000 mgr.a (mgr.14388) 14646 : audit [DBG] from='client.317985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:00 smithi191 bash[24992]: cluster 2024-08-31T07:49:59.103013+0000 mgr.a (mgr.14388) 14647 : cluster [DBG] pgmap v10154: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:00 smithi191 bash[24992]: cluster 2024-08-31T07:50:00.000145+0000 mon.a (mon.0) 2769 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T07:50:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:02 smithi163 bash[24253]: cluster 2024-08-31T07:50:01.103866+0000 mgr.a (mgr.14388) 14648 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:50:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:02 smithi027 bash[22610]: cluster 2024-08-31T07:50:01.103866+0000 mgr.a (mgr.14388) 14648 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:50:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:02 smithi191 bash[24992]: cluster 2024-08-31T07:50:01.103866+0000 mgr.a (mgr.14388) 14648 : cluster [DBG] pgmap v10155: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:50:04.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:50:04.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:50:04.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:50:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:04 smithi163 bash[24253]: cluster 2024-08-31T07:50:03.106010+0000 mgr.a (mgr.14388) 14649 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:04 smithi027 bash[22610]: cluster 2024-08-31T07:50:03.106010+0000 mgr.a (mgr.14388) 14649 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:04 smithi191 bash[24992]: cluster 2024-08-31T07:50:03.106010+0000 mgr.a (mgr.14388) 14649 : cluster [DBG] pgmap v10156: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:05.060 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:50:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:50:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:50:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:50:05.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:06 smithi163 bash[24253]: audit 2024-08-31T07:50:04.618280+0000 mgr.a (mgr.14388) 14650 : audit [DBG] from='client.318063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:06 smithi163 bash[24253]: cluster 2024-08-31T07:50:05.106910+0000 mgr.a (mgr.14388) 14651 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:06 smithi027 bash[22610]: audit 2024-08-31T07:50:04.618280+0000 mgr.a (mgr.14388) 14650 : audit [DBG] from='client.318063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:06.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:06 smithi027 bash[22610]: cluster 2024-08-31T07:50:05.106910+0000 mgr.a (mgr.14388) 14651 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:06 smithi191 bash[24992]: audit 2024-08-31T07:50:04.618280+0000 mgr.a (mgr.14388) 14650 : audit [DBG] from='client.318063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:06 smithi191 bash[24992]: cluster 2024-08-31T07:50:05.106910+0000 mgr.a (mgr.14388) 14651 : cluster [DBG] pgmap v10157: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:08 smithi163 bash[24253]: cluster 2024-08-31T07:50:07.107650+0000 mgr.a (mgr.14388) 14652 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:08 smithi027 bash[22610]: cluster 2024-08-31T07:50:07.107650+0000 mgr.a (mgr.14388) 14652 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:08 smithi191 bash[24992]: cluster 2024-08-31T07:50:07.107650+0000 mgr.a (mgr.14388) 14652 : cluster [DBG] pgmap v10158: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:10.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:50:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:50:10.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:50:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:10 smithi027 bash[22610]: cluster 2024-08-31T07:50:09.109854+0000 mgr.a (mgr.14388) 14653 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:10 smithi191 bash[24992]: cluster 2024-08-31T07:50:09.109854+0000 mgr.a (mgr.14388) 14653 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:10 smithi163 bash[24253]: cluster 2024-08-31T07:50:09.109854+0000 mgr.a (mgr.14388) 14653 : cluster [DBG] pgmap v10159: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:10.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:50:10.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:50:10.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:50:10.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:10.807 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:50:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:11 smithi027 bash[22610]: audit 2024-08-31T07:50:10.392774+0000 mgr.a (mgr.14388) 14654 : audit [DBG] from='client.318141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:11 smithi191 bash[24992]: audit 2024-08-31T07:50:10.392774+0000 mgr.a (mgr.14388) 14654 : audit [DBG] from='client.318141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:11 smithi163 bash[24253]: audit 2024-08-31T07:50:10.392774+0000 mgr.a (mgr.14388) 14654 : audit [DBG] from='client.318141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:12 smithi027 bash[22610]: cluster 2024-08-31T07:50:11.110784+0000 mgr.a (mgr.14388) 14655 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:12 smithi191 bash[24992]: cluster 2024-08-31T07:50:11.110784+0000 mgr.a (mgr.14388) 14655 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:12 smithi163 bash[24253]: cluster 2024-08-31T07:50:11.110784+0000 mgr.a (mgr.14388) 14655 : cluster [DBG] pgmap v10160: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:14 smithi027 bash[22610]: cluster 2024-08-31T07:50:13.112929+0000 mgr.a (mgr.14388) 14656 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:14 smithi191 bash[24992]: cluster 2024-08-31T07:50:13.112929+0000 mgr.a (mgr.14388) 14656 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:14 smithi163 bash[24253]: cluster 2024-08-31T07:50:13.112929+0000 mgr.a (mgr.14388) 14656 : cluster [DBG] pgmap v10161: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:15.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:50:15.809 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:50:15.809 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:50:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:16 smithi027 bash[22610]: cluster 2024-08-31T07:50:15.113702+0000 mgr.a (mgr.14388) 14657 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:16.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:16 smithi191 bash[24992]: cluster 2024-08-31T07:50:15.113702+0000 mgr.a (mgr.14388) 14657 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:16.571 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:50:16.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:50:16.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:50:16.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:50:16.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:16 smithi163 bash[24253]: cluster 2024-08-31T07:50:15.113702+0000 mgr.a (mgr.14388) 14657 : cluster [DBG] pgmap v10162: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:17 smithi027 bash[22610]: audit 2024-08-31T07:50:16.139605+0000 mgr.a (mgr.14388) 14658 : audit [DBG] from='client.318216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:17 smithi191 bash[24992]: audit 2024-08-31T07:50:16.139605+0000 mgr.a (mgr.14388) 14658 : audit [DBG] from='client.318216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:17 smithi163 bash[24253]: audit 2024-08-31T07:50:16.139605+0000 mgr.a (mgr.14388) 14658 : audit [DBG] from='client.318216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:18 smithi027 bash[22610]: cluster 2024-08-31T07:50:17.114660+0000 mgr.a (mgr.14388) 14659 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:18 smithi191 bash[24992]: cluster 2024-08-31T07:50:17.114660+0000 mgr.a (mgr.14388) 14659 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:18 smithi163 bash[24253]: cluster 2024-08-31T07:50:17.114660+0000 mgr.a (mgr.14388) 14659 : cluster [DBG] pgmap v10163: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:20 smithi191 bash[24992]: cluster 2024-08-31T07:50:19.116900+0000 mgr.a (mgr.14388) 14660 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:20 smithi163 bash[24253]: cluster 2024-08-31T07:50:19.116900+0000 mgr.a (mgr.14388) 14660 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:20 smithi027 bash[22610]: cluster 2024-08-31T07:50:19.116900+0000 mgr.a (mgr.14388) 14660 : cluster [DBG] pgmap v10164: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:21.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:50:21.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:50:21.623 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:50:22.364 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:50:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:50:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:50:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:50:22.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:22 smithi191 bash[24992]: cluster 2024-08-31T07:50:21.117679+0000 mgr.a (mgr.14388) 14661 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:22 smithi163 bash[24253]: cluster 2024-08-31T07:50:21.117679+0000 mgr.a (mgr.14388) 14661 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:22 smithi027 bash[22610]: cluster 2024-08-31T07:50:21.117679+0000 mgr.a (mgr.14388) 14661 : cluster [DBG] pgmap v10165: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:23 smithi191 bash[24992]: audit 2024-08-31T07:50:21.912897+0000 mgr.a (mgr.14388) 14662 : audit [DBG] from='client.318288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:23 smithi191 bash[24992]: audit 2024-08-31T07:50:22.593983+0000 mon.a (mon.0) 2770 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:50:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:23 smithi163 bash[24253]: audit 2024-08-31T07:50:21.912897+0000 mgr.a (mgr.14388) 14662 : audit [DBG] from='client.318288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:23 smithi163 bash[24253]: audit 2024-08-31T07:50:22.593983+0000 mon.a (mon.0) 2770 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:50:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:23 smithi027 bash[22610]: audit 2024-08-31T07:50:21.912897+0000 mgr.a (mgr.14388) 14662 : audit [DBG] from='client.318288 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:23 smithi027 bash[22610]: audit 2024-08-31T07:50:22.593983+0000 mon.a (mon.0) 2770 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:50:24.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:50:24 smithi027 bash[22863]: debug 2024-08-31T07:50:24.199+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:50:24.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:50:24 smithi027 bash[22863]: debug 2024-08-31T07:50:24.199+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:50:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:24 smithi027 bash[22610]: cluster 2024-08-31T07:50:23.119990+0000 mgr.a (mgr.14388) 14663 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:24 smithi027 bash[22610]: audit 2024-08-31T07:50:23.440848+0000 mon.a (mon.0) 2771 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:50:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:24 smithi027 bash[22610]: audit 2024-08-31T07:50:23.442559+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:50:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:24 smithi027 bash[22610]: audit 2024-08-31T07:50:23.453188+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:50:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:24 smithi027 bash[22610]: audit 2024-08-31T07:50:23.458153+0000 mon.a (mon.0) 2774 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:50:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:24 smithi191 bash[24992]: cluster 2024-08-31T07:50:23.119990+0000 mgr.a (mgr.14388) 14663 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:24 smithi191 bash[24992]: audit 2024-08-31T07:50:23.440848+0000 mon.a (mon.0) 2771 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:50:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:24 smithi191 bash[24992]: audit 2024-08-31T07:50:23.442559+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:50:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:24 smithi191 bash[24992]: audit 2024-08-31T07:50:23.453188+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:50:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:24 smithi191 bash[24992]: audit 2024-08-31T07:50:23.458153+0000 mon.a (mon.0) 2774 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:50:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:24 smithi163 bash[24253]: cluster 2024-08-31T07:50:23.119990+0000 mgr.a (mgr.14388) 14663 : cluster [DBG] pgmap v10166: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:24 smithi163 bash[24253]: audit 2024-08-31T07:50:23.440848+0000 mon.a (mon.0) 2771 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:50:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:24 smithi163 bash[24253]: audit 2024-08-31T07:50:23.442559+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:50:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:24 smithi163 bash[24253]: audit 2024-08-31T07:50:23.453188+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:50:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:24 smithi163 bash[24253]: audit 2024-08-31T07:50:23.458153+0000 mon.a (mon.0) 2774 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:50:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:25 smithi191 bash[24992]: audit 2024-08-31T07:50:23.459475+0000 mgr.a (mgr.14388) 14664 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:50:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:25 smithi191 bash[24992]: audit 2024-08-31T07:50:24.204618+0000 mgr.a (mgr.14388) 14665 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:50:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:25 smithi191 bash[24992]: cephadm 2024-08-31T07:50:24.206036+0000 mgr.a (mgr.14388) 14666 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:50:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:25 smithi163 bash[24253]: audit 2024-08-31T07:50:23.459475+0000 mgr.a (mgr.14388) 14664 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:50:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:25 smithi163 bash[24253]: audit 2024-08-31T07:50:24.204618+0000 mgr.a (mgr.14388) 14665 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:50:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:25 smithi163 bash[24253]: cephadm 2024-08-31T07:50:24.206036+0000 mgr.a (mgr.14388) 14666 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:50:25.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:25 smithi027 bash[22610]: audit 2024-08-31T07:50:23.459475+0000 mgr.a (mgr.14388) 14664 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:50:25.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:25 smithi027 bash[22610]: audit 2024-08-31T07:50:24.204618+0000 mgr.a (mgr.14388) 14665 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:50:25.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:25 smithi027 bash[22610]: cephadm 2024-08-31T07:50:24.206036+0000 mgr.a (mgr.14388) 14666 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:50:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:26 smithi191 bash[24992]: cluster 2024-08-31T07:50:25.120909+0000 mgr.a (mgr.14388) 14667 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:26 smithi163 bash[24253]: cluster 2024-08-31T07:50:25.120909+0000 mgr.a (mgr.14388) 14667 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:26 smithi027 bash[22610]: cluster 2024-08-31T07:50:25.120909+0000 mgr.a (mgr.14388) 14667 : cluster [DBG] pgmap v10167: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:27.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:50:27.369 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:50:27.369 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:50:28.118 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:50:28.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:50:28.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:50:28.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:50:28.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:28 smithi191 bash[24992]: cluster 2024-08-31T07:50:27.121709+0000 mgr.a (mgr.14388) 14668 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:28 smithi163 bash[24253]: cluster 2024-08-31T07:50:27.121709+0000 mgr.a (mgr.14388) 14668 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:28 smithi027 bash[22610]: cluster 2024-08-31T07:50:27.121709+0000 mgr.a (mgr.14388) 14668 : cluster [DBG] pgmap v10168: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:29 smithi191 bash[24992]: audit 2024-08-31T07:50:27.696296+0000 mgr.a (mgr.14388) 14669 : audit [DBG] from='client.318468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:29 smithi163 bash[24253]: audit 2024-08-31T07:50:27.696296+0000 mgr.a (mgr.14388) 14669 : audit [DBG] from='client.318468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:29 smithi027 bash[22610]: audit 2024-08-31T07:50:27.696296+0000 mgr.a (mgr.14388) 14669 : audit [DBG] from='client.318468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:30 smithi191 bash[24992]: cluster 2024-08-31T07:50:29.124612+0000 mgr.a (mgr.14388) 14670 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:50:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:30 smithi163 bash[24253]: cluster 2024-08-31T07:50:29.124612+0000 mgr.a (mgr.14388) 14670 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:50:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:30 smithi027 bash[22610]: cluster 2024-08-31T07:50:29.124612+0000 mgr.a (mgr.14388) 14670 : cluster [DBG] pgmap v10169: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:50:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:32 smithi191 bash[24992]: cluster 2024-08-31T07:50:31.125400+0000 mgr.a (mgr.14388) 14671 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:50:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:32 smithi163 bash[24253]: cluster 2024-08-31T07:50:31.125400+0000 mgr.a (mgr.14388) 14671 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:50:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:32 smithi027 bash[22610]: cluster 2024-08-31T07:50:31.125400+0000 mgr.a (mgr.14388) 14671 : cluster [DBG] pgmap v10170: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:50:33.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:50:33.121 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:50:33.121 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:50:33.911 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:50:33.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:50:33.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:50:33.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:50:33.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:34 smithi191 bash[24992]: cluster 2024-08-31T07:50:33.126688+0000 mgr.a (mgr.14388) 14672 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:50:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:34 smithi163 bash[24253]: cluster 2024-08-31T07:50:33.126688+0000 mgr.a (mgr.14388) 14672 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:50:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:34 smithi027 bash[22610]: cluster 2024-08-31T07:50:33.126688+0000 mgr.a (mgr.14388) 14672 : cluster [DBG] pgmap v10171: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:50:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:35 smithi163 bash[24253]: audit 2024-08-31T07:50:33.460457+0000 mgr.a (mgr.14388) 14673 : audit [DBG] from='client.318546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:35 smithi027 bash[22610]: audit 2024-08-31T07:50:33.460457+0000 mgr.a (mgr.14388) 14673 : audit [DBG] from='client.318546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:35 smithi191 bash[24992]: audit 2024-08-31T07:50:33.460457+0000 mgr.a (mgr.14388) 14673 : audit [DBG] from='client.318546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:36 smithi163 bash[24253]: cluster 2024-08-31T07:50:35.127632+0000 mgr.a (mgr.14388) 14674 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:50:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:36 smithi027 bash[22610]: cluster 2024-08-31T07:50:35.127632+0000 mgr.a (mgr.14388) 14674 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:50:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:36 smithi191 bash[24992]: cluster 2024-08-31T07:50:35.127632+0000 mgr.a (mgr.14388) 14674 : cluster [DBG] pgmap v10172: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:50:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:38 smithi163 bash[24253]: cluster 2024-08-31T07:50:37.128582+0000 mgr.a (mgr.14388) 14675 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:50:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:38 smithi027 bash[22610]: cluster 2024-08-31T07:50:37.128582+0000 mgr.a (mgr.14388) 14675 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:50:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:38 smithi191 bash[24992]: cluster 2024-08-31T07:50:37.128582+0000 mgr.a (mgr.14388) 14675 : cluster [DBG] pgmap v10173: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:50:38.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:50:38.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:50:38.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:50:39.661 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:50:39.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:50:39.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:50:39.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:50:39.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:40 smithi163 bash[24253]: cluster 2024-08-31T07:50:39.130915+0000 mgr.a (mgr.14388) 14676 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:50:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:40 smithi163 bash[24253]: audit 2024-08-31T07:50:39.242243+0000 mgr.a (mgr.14388) 14677 : audit [DBG] from='client.318621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:40 smithi027 bash[22610]: cluster 2024-08-31T07:50:39.130915+0000 mgr.a (mgr.14388) 14676 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:50:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:40 smithi027 bash[22610]: audit 2024-08-31T07:50:39.242243+0000 mgr.a (mgr.14388) 14677 : audit [DBG] from='client.318621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:40 smithi191 bash[24992]: cluster 2024-08-31T07:50:39.130915+0000 mgr.a (mgr.14388) 14676 : cluster [DBG] pgmap v10174: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:50:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:40 smithi191 bash[24992]: audit 2024-08-31T07:50:39.242243+0000 mgr.a (mgr.14388) 14677 : audit [DBG] from='client.318621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:42 smithi163 bash[24253]: cluster 2024-08-31T07:50:41.131836+0000 mgr.a (mgr.14388) 14678 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:50:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:42 smithi027 bash[22610]: cluster 2024-08-31T07:50:41.131836+0000 mgr.a (mgr.14388) 14678 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:50:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:42 smithi191 bash[24992]: cluster 2024-08-31T07:50:41.131836+0000 mgr.a (mgr.14388) 14678 : cluster [DBG] pgmap v10175: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:50:44.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:50:44.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:50:44.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:50:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:44 smithi163 bash[24253]: cluster 2024-08-31T07:50:43.134123+0000 mgr.a (mgr.14388) 14679 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:50:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:44 smithi027 bash[22610]: cluster 2024-08-31T07:50:43.134123+0000 mgr.a (mgr.14388) 14679 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:50:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:44 smithi191 bash[24992]: cluster 2024-08-31T07:50:43.134123+0000 mgr.a (mgr.14388) 14679 : cluster [DBG] pgmap v10176: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:50:45.412 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:50:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:50:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:50:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:50:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:46 smithi163 bash[24253]: audit 2024-08-31T07:50:44.996797+0000 mgr.a (mgr.14388) 14680 : audit [DBG] from='client.318699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:46 smithi163 bash[24253]: cluster 2024-08-31T07:50:45.134789+0000 mgr.a (mgr.14388) 14681 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:46 smithi027 bash[22610]: audit 2024-08-31T07:50:44.996797+0000 mgr.a (mgr.14388) 14680 : audit [DBG] from='client.318699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:46 smithi027 bash[22610]: cluster 2024-08-31T07:50:45.134789+0000 mgr.a (mgr.14388) 14681 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:46 smithi191 bash[24992]: audit 2024-08-31T07:50:44.996797+0000 mgr.a (mgr.14388) 14680 : audit [DBG] from='client.318699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:46 smithi191 bash[24992]: cluster 2024-08-31T07:50:45.134789+0000 mgr.a (mgr.14388) 14681 : cluster [DBG] pgmap v10177: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:48 smithi163 bash[24253]: cluster 2024-08-31T07:50:47.135670+0000 mgr.a (mgr.14388) 14682 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:48 smithi027 bash[22610]: cluster 2024-08-31T07:50:47.135670+0000 mgr.a (mgr.14388) 14682 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:48 smithi191 bash[24992]: cluster 2024-08-31T07:50:47.135670+0000 mgr.a (mgr.14388) 14682 : cluster [DBG] pgmap v10178: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:50.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:50:50.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:50:50.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:50:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:50 smithi163 bash[24253]: cluster 2024-08-31T07:50:49.137907+0000 mgr.a (mgr.14388) 14683 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:50 smithi027 bash[22610]: cluster 2024-08-31T07:50:49.137907+0000 mgr.a (mgr.14388) 14683 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:50 smithi191 bash[24992]: cluster 2024-08-31T07:50:49.137907+0000 mgr.a (mgr.14388) 14683 : cluster [DBG] pgmap v10179: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:51.169 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:50:51.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:50:51.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:50:51.169 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:50:51.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:52 smithi163 bash[24253]: audit 2024-08-31T07:50:50.743442+0000 mgr.a (mgr.14388) 14684 : audit [DBG] from='client.318774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:52 smithi163 bash[24253]: cluster 2024-08-31T07:50:51.138493+0000 mgr.a (mgr.14388) 14685 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:52 smithi027 bash[22610]: audit 2024-08-31T07:50:50.743442+0000 mgr.a (mgr.14388) 14684 : audit [DBG] from='client.318774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:52 smithi027 bash[22610]: cluster 2024-08-31T07:50:51.138493+0000 mgr.a (mgr.14388) 14685 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:52 smithi191 bash[24992]: audit 2024-08-31T07:50:50.743442+0000 mgr.a (mgr.14388) 14684 : audit [DBG] from='client.318774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:52 smithi191 bash[24992]: cluster 2024-08-31T07:50:51.138493+0000 mgr.a (mgr.14388) 14685 : cluster [DBG] pgmap v10180: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:54 smithi163 bash[24253]: cluster 2024-08-31T07:50:53.140597+0000 mgr.a (mgr.14388) 14686 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:54 smithi027 bash[22610]: cluster 2024-08-31T07:50:53.140597+0000 mgr.a (mgr.14388) 14686 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:54 smithi191 bash[24992]: cluster 2024-08-31T07:50:53.140597+0000 mgr.a (mgr.14388) 14686 : cluster [DBG] pgmap v10181: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:50:56.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:50:56.171 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:50:56.171 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:50:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:56 smithi163 bash[24253]: cluster 2024-08-31T07:50:55.141330+0000 mgr.a (mgr.14388) 14687 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:56 smithi027 bash[22610]: cluster 2024-08-31T07:50:55.141330+0000 mgr.a (mgr.14388) 14687 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:56 smithi191 bash[24992]: cluster 2024-08-31T07:50:55.141330+0000 mgr.a (mgr.14388) 14687 : cluster [DBG] pgmap v10182: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:56.938 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:50:56.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:50:56.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:50:56.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:50:56.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:50:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:58 smithi163 bash[24253]: audit 2024-08-31T07:50:56.508154+0000 mgr.a (mgr.14388) 14688 : audit [DBG] from='client.318852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:50:58 smithi163 bash[24253]: cluster 2024-08-31T07:50:57.142276+0000 mgr.a (mgr.14388) 14689 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:58 smithi027 bash[22610]: audit 2024-08-31T07:50:56.508154+0000 mgr.a (mgr.14388) 14688 : audit [DBG] from='client.318852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:50:58 smithi027 bash[22610]: cluster 2024-08-31T07:50:57.142276+0000 mgr.a (mgr.14388) 14689 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:50:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:58 smithi191 bash[24992]: audit 2024-08-31T07:50:56.508154+0000 mgr.a (mgr.14388) 14688 : audit [DBG] from='client.318852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:50:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:50:58 smithi191 bash[24992]: cluster 2024-08-31T07:50:57.142276+0000 mgr.a (mgr.14388) 14689 : cluster [DBG] pgmap v10183: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:00 smithi163 bash[24253]: cluster 2024-08-31T07:50:59.144494+0000 mgr.a (mgr.14388) 14690 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:51:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:00 smithi027 bash[22610]: cluster 2024-08-31T07:50:59.144494+0000 mgr.a (mgr.14388) 14690 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:51:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:00 smithi191 bash[24992]: cluster 2024-08-31T07:50:59.144494+0000 mgr.a (mgr.14388) 14690 : cluster [DBG] pgmap v10184: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:51:01.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:51:01.940 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:51:01.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:51:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:02 smithi163 bash[24253]: cluster 2024-08-31T07:51:01.145246+0000 mgr.a (mgr.14388) 14691 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:02.721 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:51:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:51:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:51:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:51:02.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:51:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:02 smithi027 bash[22610]: cluster 2024-08-31T07:51:01.145246+0000 mgr.a (mgr.14388) 14691 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:02 smithi191 bash[24992]: cluster 2024-08-31T07:51:01.145246+0000 mgr.a (mgr.14388) 14691 : cluster [DBG] pgmap v10185: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:03 smithi163 bash[24253]: audit 2024-08-31T07:51:02.275169+0000 mgr.a (mgr.14388) 14692 : audit [DBG] from='client.318930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:03 smithi027 bash[22610]: audit 2024-08-31T07:51:02.275169+0000 mgr.a (mgr.14388) 14692 : audit [DBG] from='client.318930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:03 smithi191 bash[24992]: audit 2024-08-31T07:51:02.275169+0000 mgr.a (mgr.14388) 14692 : audit [DBG] from='client.318930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:04 smithi163 bash[24253]: cluster 2024-08-31T07:51:03.147595+0000 mgr.a (mgr.14388) 14693 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:51:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:04 smithi027 bash[22610]: cluster 2024-08-31T07:51:03.147595+0000 mgr.a (mgr.14388) 14693 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:51:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:04 smithi191 bash[24992]: cluster 2024-08-31T07:51:03.147595+0000 mgr.a (mgr.14388) 14693 : cluster [DBG] pgmap v10186: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:51:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:06 smithi163 bash[24253]: cluster 2024-08-31T07:51:05.148357+0000 mgr.a (mgr.14388) 14694 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:06 smithi027 bash[22610]: cluster 2024-08-31T07:51:05.148357+0000 mgr.a (mgr.14388) 14694 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:06 smithi191 bash[24992]: cluster 2024-08-31T07:51:05.148357+0000 mgr.a (mgr.14388) 14694 : cluster [DBG] pgmap v10187: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:07.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:51:07.723 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:51:07.723 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:51:08.508 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:51:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:51:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:51:08.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:51:08.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:51:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:08 smithi163 bash[24253]: cluster 2024-08-31T07:51:07.149132+0000 mgr.a (mgr.14388) 14695 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:08 smithi027 bash[22610]: cluster 2024-08-31T07:51:07.149132+0000 mgr.a (mgr.14388) 14695 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:08 smithi191 bash[24992]: cluster 2024-08-31T07:51:07.149132+0000 mgr.a (mgr.14388) 14695 : cluster [DBG] pgmap v10188: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:09 smithi163 bash[24253]: audit 2024-08-31T07:51:08.060745+0000 mgr.a (mgr.14388) 14696 : audit [DBG] from='client.319008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:09 smithi027 bash[22610]: audit 2024-08-31T07:51:08.060745+0000 mgr.a (mgr.14388) 14696 : audit [DBG] from='client.319008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:09 smithi191 bash[24992]: audit 2024-08-31T07:51:08.060745+0000 mgr.a (mgr.14388) 14696 : audit [DBG] from='client.319008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:10 smithi163 bash[24253]: cluster 2024-08-31T07:51:09.152021+0000 mgr.a (mgr.14388) 14697 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:10 smithi027 bash[22610]: cluster 2024-08-31T07:51:09.152021+0000 mgr.a (mgr.14388) 14697 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:10 smithi191 bash[24992]: cluster 2024-08-31T07:51:09.152021+0000 mgr.a (mgr.14388) 14697 : cluster [DBG] pgmap v10189: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:12 smithi163 bash[24253]: cluster 2024-08-31T07:51:11.152786+0000 mgr.a (mgr.14388) 14698 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:12 smithi027 bash[22610]: cluster 2024-08-31T07:51:11.152786+0000 mgr.a (mgr.14388) 14698 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:12 smithi191 bash[24992]: cluster 2024-08-31T07:51:11.152786+0000 mgr.a (mgr.14388) 14698 : cluster [DBG] pgmap v10190: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:13.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:51:13.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:51:13.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:51:14.284 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:51:14.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:51:14.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:51:14.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:51:14.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:51:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:14 smithi163 bash[24253]: cluster 2024-08-31T07:51:13.154864+0000 mgr.a (mgr.14388) 14699 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:14 smithi027 bash[22610]: cluster 2024-08-31T07:51:13.154864+0000 mgr.a (mgr.14388) 14699 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:14 smithi191 bash[24992]: cluster 2024-08-31T07:51:13.154864+0000 mgr.a (mgr.14388) 14699 : cluster [DBG] pgmap v10191: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:15 smithi163 bash[24253]: audit 2024-08-31T07:51:13.844047+0000 mgr.a (mgr.14388) 14700 : audit [DBG] from='client.319083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:15 smithi027 bash[22610]: audit 2024-08-31T07:51:13.844047+0000 mgr.a (mgr.14388) 14700 : audit [DBG] from='client.319083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:15 smithi191 bash[24992]: audit 2024-08-31T07:51:13.844047+0000 mgr.a (mgr.14388) 14700 : audit [DBG] from='client.319083 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:16 smithi163 bash[24253]: cluster 2024-08-31T07:51:15.155852+0000 mgr.a (mgr.14388) 14701 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:16.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:16 smithi027 bash[22610]: cluster 2024-08-31T07:51:15.155852+0000 mgr.a (mgr.14388) 14701 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:16 smithi191 bash[24992]: cluster 2024-08-31T07:51:15.155852+0000 mgr.a (mgr.14388) 14701 : cluster [DBG] pgmap v10192: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:18 smithi163 bash[24253]: cluster 2024-08-31T07:51:17.156658+0000 mgr.a (mgr.14388) 14702 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:51:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:18 smithi027 bash[22610]: cluster 2024-08-31T07:51:17.156658+0000 mgr.a (mgr.14388) 14702 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:51:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:18 smithi191 bash[24992]: cluster 2024-08-31T07:51:17.156658+0000 mgr.a (mgr.14388) 14702 : cluster [DBG] pgmap v10193: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:51:19.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:51:19.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:51:19.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:51:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:51:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:51:20.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:51:20.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:51:20.064 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:51:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:20 smithi163 bash[24253]: cluster 2024-08-31T07:51:19.158892+0000 mgr.a (mgr.14388) 14703 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:20 smithi027 bash[22610]: cluster 2024-08-31T07:51:19.158892+0000 mgr.a (mgr.14388) 14703 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:20 smithi191 bash[24992]: cluster 2024-08-31T07:51:19.158892+0000 mgr.a (mgr.14388) 14703 : cluster [DBG] pgmap v10194: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:21 smithi163 bash[24253]: audit 2024-08-31T07:51:19.622766+0000 mgr.a (mgr.14388) 14704 : audit [DBG] from='client.319158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:21 smithi027 bash[22610]: audit 2024-08-31T07:51:19.622766+0000 mgr.a (mgr.14388) 14704 : audit [DBG] from='client.319158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:21 smithi191 bash[24992]: audit 2024-08-31T07:51:19.622766+0000 mgr.a (mgr.14388) 14704 : audit [DBG] from='client.319158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:22 smithi163 bash[24253]: cluster 2024-08-31T07:51:21.159959+0000 mgr.a (mgr.14388) 14705 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:22 smithi027 bash[22610]: cluster 2024-08-31T07:51:21.159959+0000 mgr.a (mgr.14388) 14705 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:22 smithi191 bash[24992]: cluster 2024-08-31T07:51:21.159959+0000 mgr.a (mgr.14388) 14705 : cluster [DBG] pgmap v10195: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:24 smithi163 bash[24253]: cluster 2024-08-31T07:51:23.162116+0000 mgr.a (mgr.14388) 14706 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:51:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:24 smithi163 bash[24253]: audit 2024-08-31T07:51:24.264694+0000 mon.a (mon.0) 2775 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:51:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:24 smithi027 bash[22610]: cluster 2024-08-31T07:51:23.162116+0000 mgr.a (mgr.14388) 14706 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:51:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:24 smithi027 bash[22610]: audit 2024-08-31T07:51:24.264694+0000 mon.a (mon.0) 2775 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:51:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:24 smithi191 bash[24992]: cluster 2024-08-31T07:51:23.162116+0000 mgr.a (mgr.14388) 14706 : cluster [DBG] pgmap v10196: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:51:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:24 smithi191 bash[24992]: audit 2024-08-31T07:51:24.264694+0000 mon.a (mon.0) 2775 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:51:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:51:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:51:25.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:51:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:25 smithi163 bash[24253]: audit 2024-08-31T07:51:25.111595+0000 mon.a (mon.0) 2776 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:51:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:25 smithi163 bash[24253]: audit 2024-08-31T07:51:25.112450+0000 mon.a (mon.0) 2777 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:51:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:25 smithi163 bash[24253]: audit 2024-08-31T07:51:25.118115+0000 mon.a (mon.0) 2778 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:51:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:25 smithi163 bash[24253]: audit 2024-08-31T07:51:25.122776+0000 mon.a (mon.0) 2779 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:51:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:25 smithi163 bash[24253]: audit 2024-08-31T07:51:25.124035+0000 mgr.a (mgr.14388) 14707 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:51:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:25 smithi163 bash[24253]: cluster 2024-08-31T07:51:25.162745+0000 mgr.a (mgr.14388) 14708 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:25.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:25 smithi163 bash[24253]: audit 2024-08-31T07:51:25.401028+0000 mgr.a (mgr.14388) 14709 : audit [DBG] from='client.319233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:25 smithi027 bash[22610]: audit 2024-08-31T07:51:25.111595+0000 mon.a (mon.0) 2776 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:51:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:25 smithi027 bash[22610]: audit 2024-08-31T07:51:25.112450+0000 mon.a (mon.0) 2777 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:51:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:25 smithi027 bash[22610]: audit 2024-08-31T07:51:25.118115+0000 mon.a (mon.0) 2778 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:51:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:25 smithi027 bash[22610]: audit 2024-08-31T07:51:25.122776+0000 mon.a (mon.0) 2779 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:51:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:25 smithi027 bash[22610]: audit 2024-08-31T07:51:25.124035+0000 mgr.a (mgr.14388) 14707 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:51:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:25 smithi027 bash[22610]: cluster 2024-08-31T07:51:25.162745+0000 mgr.a (mgr.14388) 14708 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:25 smithi027 bash[22610]: audit 2024-08-31T07:51:25.401028+0000 mgr.a (mgr.14388) 14709 : audit [DBG] from='client.319233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:25 smithi191 bash[24992]: audit 2024-08-31T07:51:25.111595+0000 mon.a (mon.0) 2776 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:51:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:25 smithi191 bash[24992]: audit 2024-08-31T07:51:25.112450+0000 mon.a (mon.0) 2777 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:51:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:25 smithi191 bash[24992]: audit 2024-08-31T07:51:25.118115+0000 mon.a (mon.0) 2778 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:51:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:25 smithi191 bash[24992]: audit 2024-08-31T07:51:25.122776+0000 mon.a (mon.0) 2779 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:51:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:25 smithi191 bash[24992]: audit 2024-08-31T07:51:25.124035+0000 mgr.a (mgr.14388) 14707 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:51:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:25 smithi191 bash[24992]: cluster 2024-08-31T07:51:25.162745+0000 mgr.a (mgr.14388) 14708 : cluster [DBG] pgmap v10197: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:25 smithi191 bash[24992]: audit 2024-08-31T07:51:25.401028+0000 mgr.a (mgr.14388) 14709 : audit [DBG] from='client.319233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:26.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:51:25 smithi027 bash[22863]: debug 2024-08-31T07:51:25.857+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:51:26.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:51:25 smithi027 bash[22863]: debug 2024-08-31T07:51:25.869+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:51:26.270 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:51:26.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:51:26.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:51:26.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:51:26.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:51:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:27 smithi163 bash[24253]: audit 2024-08-31T07:51:25.859031+0000 mgr.a (mgr.14388) 14710 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:51:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:27 smithi163 bash[24253]: cephadm 2024-08-31T07:51:25.871748+0000 mgr.a (mgr.14388) 14711 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:51:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:27 smithi027 bash[22610]: audit 2024-08-31T07:51:25.859031+0000 mgr.a (mgr.14388) 14710 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:51:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:27 smithi027 bash[22610]: cephadm 2024-08-31T07:51:25.871748+0000 mgr.a (mgr.14388) 14711 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:51:27.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:27 smithi191 bash[24992]: audit 2024-08-31T07:51:25.859031+0000 mgr.a (mgr.14388) 14710 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:51:27.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:27 smithi191 bash[24992]: cephadm 2024-08-31T07:51:25.871748+0000 mgr.a (mgr.14388) 14711 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:51:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:28 smithi163 bash[24253]: cluster 2024-08-31T07:51:27.163685+0000 mgr.a (mgr.14388) 14712 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:28 smithi027 bash[22610]: cluster 2024-08-31T07:51:27.163685+0000 mgr.a (mgr.14388) 14712 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:28 smithi191 bash[24992]: cluster 2024-08-31T07:51:27.163685+0000 mgr.a (mgr.14388) 14712 : cluster [DBG] pgmap v10198: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:30 smithi027 bash[22610]: cluster 2024-08-31T07:51:29.165959+0000 mgr.a (mgr.14388) 14713 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:30 smithi191 bash[24992]: cluster 2024-08-31T07:51:29.165959+0000 mgr.a (mgr.14388) 14713 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:30 smithi163 bash[24253]: cluster 2024-08-31T07:51:29.165959+0000 mgr.a (mgr.14388) 14713 : cluster [DBG] pgmap v10199: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:31.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:51:31.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:51:31.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:51:32.038 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:51:32.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:51:32.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:51:32.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:51:32.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:51:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:32 smithi027 bash[22610]: cluster 2024-08-31T07:51:31.166739+0000 mgr.a (mgr.14388) 14714 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:32 smithi191 bash[24992]: cluster 2024-08-31T07:51:31.166739+0000 mgr.a (mgr.14388) 14714 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:32 smithi163 bash[24253]: cluster 2024-08-31T07:51:31.166739+0000 mgr.a (mgr.14388) 14714 : cluster [DBG] pgmap v10200: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:33 smithi191 bash[24992]: audit 2024-08-31T07:51:31.612895+0000 mgr.a (mgr.14388) 14715 : audit [DBG] from='client.319413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:33 smithi163 bash[24253]: audit 2024-08-31T07:51:31.612895+0000 mgr.a (mgr.14388) 14715 : audit [DBG] from='client.319413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:33 smithi027 bash[22610]: audit 2024-08-31T07:51:31.612895+0000 mgr.a (mgr.14388) 14715 : audit [DBG] from='client.319413 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:34 smithi191 bash[24992]: cluster 2024-08-31T07:51:33.168951+0000 mgr.a (mgr.14388) 14716 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:34 smithi163 bash[24253]: cluster 2024-08-31T07:51:33.168951+0000 mgr.a (mgr.14388) 14716 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:34 smithi027 bash[22610]: cluster 2024-08-31T07:51:33.168951+0000 mgr.a (mgr.14388) 14716 : cluster [DBG] pgmap v10201: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:36 smithi191 bash[24992]: cluster 2024-08-31T07:51:35.169717+0000 mgr.a (mgr.14388) 14717 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:36 smithi163 bash[24253]: cluster 2024-08-31T07:51:35.169717+0000 mgr.a (mgr.14388) 14717 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:36 smithi027 bash[22610]: cluster 2024-08-31T07:51:35.169717+0000 mgr.a (mgr.14388) 14717 : cluster [DBG] pgmap v10202: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:37.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:51:37.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:51:37.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:51:37.809 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:51:37.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:51:37.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:51:37.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:51:37.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:51:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:38 smithi191 bash[24992]: cluster 2024-08-31T07:51:37.170161+0000 mgr.a (mgr.14388) 14718 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:38 smithi191 bash[24992]: audit 2024-08-31T07:51:37.378293+0000 mgr.a (mgr.14388) 14719 : audit [DBG] from='client.319491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:38 smithi163 bash[24253]: cluster 2024-08-31T07:51:37.170161+0000 mgr.a (mgr.14388) 14718 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:38.809 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:38 smithi163 bash[24253]: audit 2024-08-31T07:51:37.378293+0000 mgr.a (mgr.14388) 14719 : audit [DBG] from='client.319491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:38.810 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:38 smithi027 bash[22610]: cluster 2024-08-31T07:51:37.170161+0000 mgr.a (mgr.14388) 14718 : cluster [DBG] pgmap v10203: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:38.810 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:38 smithi027 bash[22610]: audit 2024-08-31T07:51:37.378293+0000 mgr.a (mgr.14388) 14719 : audit [DBG] from='client.319491 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:40 smithi191 bash[24992]: cluster 2024-08-31T07:51:39.172477+0000 mgr.a (mgr.14388) 14720 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:40 smithi163 bash[24253]: cluster 2024-08-31T07:51:39.172477+0000 mgr.a (mgr.14388) 14720 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:40 smithi027 bash[22610]: cluster 2024-08-31T07:51:39.172477+0000 mgr.a (mgr.14388) 14720 : cluster [DBG] pgmap v10204: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:51:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:42 smithi191 bash[24992]: cluster 2024-08-31T07:51:41.173253+0000 mgr.a (mgr.14388) 14721 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:42 smithi163 bash[24253]: cluster 2024-08-31T07:51:41.173253+0000 mgr.a (mgr.14388) 14721 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:42 smithi027 bash[22610]: cluster 2024-08-31T07:51:41.173253+0000 mgr.a (mgr.14388) 14721 : cluster [DBG] pgmap v10205: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:42.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:51:42.811 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:51:42.812 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:51:43.567 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:51:43.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:51:43.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:51:43.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:51:43.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:51:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:44 smithi191 bash[24992]: audit 2024-08-31T07:51:43.144196+0000 mgr.a (mgr.14388) 14722 : audit [DBG] from='client.319566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:44 smithi191 bash[24992]: cluster 2024-08-31T07:51:43.176345+0000 mgr.a (mgr.14388) 14723 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:44 smithi163 bash[24253]: audit 2024-08-31T07:51:43.144196+0000 mgr.a (mgr.14388) 14722 : audit [DBG] from='client.319566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:44 smithi163 bash[24253]: cluster 2024-08-31T07:51:43.176345+0000 mgr.a (mgr.14388) 14723 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:44 smithi027 bash[22610]: audit 2024-08-31T07:51:43.144196+0000 mgr.a (mgr.14388) 14722 : audit [DBG] from='client.319566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:44.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:44 smithi027 bash[22610]: cluster 2024-08-31T07:51:43.176345+0000 mgr.a (mgr.14388) 14723 : cluster [DBG] pgmap v10206: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:46 smithi191 bash[24992]: cluster 2024-08-31T07:51:45.177293+0000 mgr.a (mgr.14388) 14724 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:46 smithi163 bash[24253]: cluster 2024-08-31T07:51:45.177293+0000 mgr.a (mgr.14388) 14724 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:46 smithi027 bash[22610]: cluster 2024-08-31T07:51:45.177293+0000 mgr.a (mgr.14388) 14724 : cluster [DBG] pgmap v10207: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:48 smithi191 bash[24992]: cluster 2024-08-31T07:51:47.178090+0000 mgr.a (mgr.14388) 14725 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:51:48.568 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:51:48.569 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:51:48.569 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:51:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:48 smithi163 bash[24253]: cluster 2024-08-31T07:51:47.178090+0000 mgr.a (mgr.14388) 14725 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:51:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:48 smithi027 bash[22610]: cluster 2024-08-31T07:51:47.178090+0000 mgr.a (mgr.14388) 14725 : cluster [DBG] pgmap v10208: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:51:49.325 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:51:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:51:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:51:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:51:49.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:51:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:50 smithi191 bash[24992]: audit 2024-08-31T07:51:48.896390+0000 mgr.a (mgr.14388) 14726 : audit [DBG] from='client.319644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:50 smithi191 bash[24992]: cluster 2024-08-31T07:51:49.179478+0000 mgr.a (mgr.14388) 14727 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:50 smithi163 bash[24253]: audit 2024-08-31T07:51:48.896390+0000 mgr.a (mgr.14388) 14726 : audit [DBG] from='client.319644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:50 smithi163 bash[24253]: cluster 2024-08-31T07:51:49.179478+0000 mgr.a (mgr.14388) 14727 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:50 smithi027 bash[22610]: audit 2024-08-31T07:51:48.896390+0000 mgr.a (mgr.14388) 14726 : audit [DBG] from='client.319644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:50 smithi027 bash[22610]: cluster 2024-08-31T07:51:49.179478+0000 mgr.a (mgr.14388) 14727 : cluster [DBG] pgmap v10209: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:52 smithi191 bash[24992]: cluster 2024-08-31T07:51:51.180328+0000 mgr.a (mgr.14388) 14728 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:52 smithi163 bash[24253]: cluster 2024-08-31T07:51:51.180328+0000 mgr.a (mgr.14388) 14728 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:52 smithi027 bash[22610]: cluster 2024-08-31T07:51:51.180328+0000 mgr.a (mgr.14388) 14728 : cluster [DBG] pgmap v10210: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:51:54.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:51:54.328 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:51:54.328 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:51:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:54 smithi191 bash[24992]: cluster 2024-08-31T07:51:53.182631+0000 mgr.a (mgr.14388) 14729 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:54 smithi163 bash[24253]: cluster 2024-08-31T07:51:53.182631+0000 mgr.a (mgr.14388) 14729 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:54 smithi027 bash[22610]: cluster 2024-08-31T07:51:53.182631+0000 mgr.a (mgr.14388) 14729 : cluster [DBG] pgmap v10211: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:55.115 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:51:55.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:51:55.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:51:55.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:51:55.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:51:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:56 smithi191 bash[24992]: audit 2024-08-31T07:51:54.666101+0000 mgr.a (mgr.14388) 14730 : audit [DBG] from='client.319719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:56 smithi191 bash[24992]: cluster 2024-08-31T07:51:55.183343+0000 mgr.a (mgr.14388) 14731 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:56 smithi163 bash[24253]: audit 2024-08-31T07:51:54.666101+0000 mgr.a (mgr.14388) 14730 : audit [DBG] from='client.319719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:56 smithi163 bash[24253]: cluster 2024-08-31T07:51:55.183343+0000 mgr.a (mgr.14388) 14731 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:56 smithi027 bash[22610]: audit 2024-08-31T07:51:54.666101+0000 mgr.a (mgr.14388) 14730 : audit [DBG] from='client.319719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:51:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:56 smithi027 bash[22610]: cluster 2024-08-31T07:51:55.183343+0000 mgr.a (mgr.14388) 14731 : cluster [DBG] pgmap v10212: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:51:58 smithi163 bash[24253]: cluster 2024-08-31T07:51:57.184086+0000 mgr.a (mgr.14388) 14732 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:51:58 smithi027 bash[22610]: cluster 2024-08-31T07:51:57.184086+0000 mgr.a (mgr.14388) 14732 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:51:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:51:58 smithi191 bash[24992]: cluster 2024-08-31T07:51:57.184086+0000 mgr.a (mgr.14388) 14732 : cluster [DBG] pgmap v10213: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:00.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:00.118 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:00.118 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:00 smithi163 bash[24253]: cluster 2024-08-31T07:51:59.186289+0000 mgr.a (mgr.14388) 14733 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:00 smithi027 bash[22610]: cluster 2024-08-31T07:51:59.186289+0000 mgr.a (mgr.14388) 14733 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:00 smithi191 bash[24992]: cluster 2024-08-31T07:51:59.186289+0000 mgr.a (mgr.14388) 14733 : cluster [DBG] pgmap v10214: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:00.854 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:00.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:00.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:00.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:00.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:02 smithi163 bash[24253]: audit 2024-08-31T07:52:00.437119+0000 mgr.a (mgr.14388) 14734 : audit [DBG] from='client.319797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:02 smithi163 bash[24253]: cluster 2024-08-31T07:52:01.187203+0000 mgr.a (mgr.14388) 14735 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:02 smithi027 bash[22610]: audit 2024-08-31T07:52:00.437119+0000 mgr.a (mgr.14388) 14734 : audit [DBG] from='client.319797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:02 smithi027 bash[22610]: cluster 2024-08-31T07:52:01.187203+0000 mgr.a (mgr.14388) 14735 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:02 smithi191 bash[24992]: audit 2024-08-31T07:52:00.437119+0000 mgr.a (mgr.14388) 14734 : audit [DBG] from='client.319797 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:02 smithi191 bash[24992]: cluster 2024-08-31T07:52:01.187203+0000 mgr.a (mgr.14388) 14735 : cluster [DBG] pgmap v10215: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:04 smithi163 bash[24253]: cluster 2024-08-31T07:52:03.189355+0000 mgr.a (mgr.14388) 14736 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:04 smithi027 bash[22610]: cluster 2024-08-31T07:52:03.189355+0000 mgr.a (mgr.14388) 14736 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:04 smithi191 bash[24992]: cluster 2024-08-31T07:52:03.189355+0000 mgr.a (mgr.14388) 14736 : cluster [DBG] pgmap v10216: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:05.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:05.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:05.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:06.630 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:06.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:06.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:06.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:06.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:06 smithi163 bash[24253]: cluster 2024-08-31T07:52:05.190089+0000 mgr.a (mgr.14388) 14737 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:06 smithi027 bash[22610]: cluster 2024-08-31T07:52:05.190089+0000 mgr.a (mgr.14388) 14737 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:06 smithi191 bash[24992]: cluster 2024-08-31T07:52:05.190089+0000 mgr.a (mgr.14388) 14737 : cluster [DBG] pgmap v10217: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:07 smithi163 bash[24253]: audit 2024-08-31T07:52:06.192837+0000 mgr.a (mgr.14388) 14738 : audit [DBG] from='client.319872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:07 smithi027 bash[22610]: audit 2024-08-31T07:52:06.192837+0000 mgr.a (mgr.14388) 14738 : audit [DBG] from='client.319872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:07 smithi191 bash[24992]: audit 2024-08-31T07:52:06.192837+0000 mgr.a (mgr.14388) 14738 : audit [DBG] from='client.319872 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:08 smithi163 bash[24253]: cluster 2024-08-31T07:52:07.191026+0000 mgr.a (mgr.14388) 14739 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:08 smithi027 bash[22610]: cluster 2024-08-31T07:52:07.191026+0000 mgr.a (mgr.14388) 14739 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:08 smithi191 bash[24992]: cluster 2024-08-31T07:52:07.191026+0000 mgr.a (mgr.14388) 14739 : cluster [DBG] pgmap v10218: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:10 smithi163 bash[24253]: cluster 2024-08-31T07:52:09.193246+0000 mgr.a (mgr.14388) 14740 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:10 smithi027 bash[22610]: cluster 2024-08-31T07:52:09.193246+0000 mgr.a (mgr.14388) 14740 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:10 smithi191 bash[24992]: cluster 2024-08-31T07:52:09.193246+0000 mgr.a (mgr.14388) 14740 : cluster [DBG] pgmap v10219: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:11.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:11.632 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:11.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:12.413 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:12.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:12.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:12.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:12.413 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:12 smithi163 bash[24253]: cluster 2024-08-31T07:52:11.194006+0000 mgr.a (mgr.14388) 14741 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:12 smithi027 bash[22610]: cluster 2024-08-31T07:52:11.194006+0000 mgr.a (mgr.14388) 14741 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:12 smithi191 bash[24992]: cluster 2024-08-31T07:52:11.194006+0000 mgr.a (mgr.14388) 14741 : cluster [DBG] pgmap v10220: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:13 smithi163 bash[24253]: audit 2024-08-31T07:52:11.967575+0000 mgr.a (mgr.14388) 14742 : audit [DBG] from='client.319947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:13 smithi027 bash[22610]: audit 2024-08-31T07:52:11.967575+0000 mgr.a (mgr.14388) 14742 : audit [DBG] from='client.319947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:13 smithi191 bash[24992]: audit 2024-08-31T07:52:11.967575+0000 mgr.a (mgr.14388) 14742 : audit [DBG] from='client.319947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:14 smithi163 bash[24253]: cluster 2024-08-31T07:52:13.196230+0000 mgr.a (mgr.14388) 14743 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:14 smithi027 bash[22610]: cluster 2024-08-31T07:52:13.196230+0000 mgr.a (mgr.14388) 14743 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:14 smithi191 bash[24992]: cluster 2024-08-31T07:52:13.196230+0000 mgr.a (mgr.14388) 14743 : cluster [DBG] pgmap v10221: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:52:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:16 smithi163 bash[24253]: cluster 2024-08-31T07:52:15.196993+0000 mgr.a (mgr.14388) 14744 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:16 smithi027 bash[22610]: cluster 2024-08-31T07:52:15.196993+0000 mgr.a (mgr.14388) 14744 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:16 smithi191 bash[24992]: cluster 2024-08-31T07:52:15.196993+0000 mgr.a (mgr.14388) 14744 : cluster [DBG] pgmap v10222: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:17.414 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:17.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:17.415 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:18.162 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:18.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:18.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:18.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:18.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:18 smithi163 bash[24253]: cluster 2024-08-31T07:52:17.197769+0000 mgr.a (mgr.14388) 14745 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:18 smithi027 bash[22610]: cluster 2024-08-31T07:52:17.197769+0000 mgr.a (mgr.14388) 14745 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:18 smithi191 bash[24992]: cluster 2024-08-31T07:52:17.197769+0000 mgr.a (mgr.14388) 14745 : cluster [DBG] pgmap v10223: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:19 smithi163 bash[24253]: audit 2024-08-31T07:52:17.744868+0000 mgr.a (mgr.14388) 14746 : audit [DBG] from='client.320025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:19 smithi027 bash[22610]: audit 2024-08-31T07:52:17.744868+0000 mgr.a (mgr.14388) 14746 : audit [DBG] from='client.320025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:19 smithi191 bash[24992]: audit 2024-08-31T07:52:17.744868+0000 mgr.a (mgr.14388) 14746 : audit [DBG] from='client.320025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:20 smithi163 bash[24253]: cluster 2024-08-31T07:52:19.200545+0000 mgr.a (mgr.14388) 14747 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:20 smithi027 bash[22610]: cluster 2024-08-31T07:52:19.200545+0000 mgr.a (mgr.14388) 14747 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:20 smithi191 bash[24992]: cluster 2024-08-31T07:52:19.200545+0000 mgr.a (mgr.14388) 14747 : cluster [DBG] pgmap v10224: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:52:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:22 smithi163 bash[24253]: cluster 2024-08-31T07:52:21.201322+0000 mgr.a (mgr.14388) 14748 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:52:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:22 smithi027 bash[22610]: cluster 2024-08-31T07:52:21.201322+0000 mgr.a (mgr.14388) 14748 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:52:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:22 smithi191 bash[24992]: cluster 2024-08-31T07:52:21.201322+0000 mgr.a (mgr.14388) 14748 : cluster [DBG] pgmap v10225: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:52:23.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:23.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:23.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:23.945 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:23.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:23.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:23.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:23.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:24 smithi163 bash[24253]: cluster 2024-08-31T07:52:23.203469+0000 mgr.a (mgr.14388) 14749 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:52:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:24 smithi027 bash[22610]: cluster 2024-08-31T07:52:23.203469+0000 mgr.a (mgr.14388) 14749 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:52:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:24 smithi191 bash[24992]: cluster 2024-08-31T07:52:23.203469+0000 mgr.a (mgr.14388) 14749 : cluster [DBG] pgmap v10226: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T07:52:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:25 smithi163 bash[24253]: audit 2024-08-31T07:52:23.499815+0000 mgr.a (mgr.14388) 14750 : audit [DBG] from='client.320103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:25 smithi027 bash[22610]: audit 2024-08-31T07:52:23.499815+0000 mgr.a (mgr.14388) 14750 : audit [DBG] from='client.320103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:25 smithi191 bash[24992]: audit 2024-08-31T07:52:23.499815+0000 mgr.a (mgr.14388) 14750 : audit [DBG] from='client.320103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:26 smithi163 bash[24253]: cluster 2024-08-31T07:52:25.204397+0000 mgr.a (mgr.14388) 14751 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:52:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:26 smithi163 bash[24253]: audit 2024-08-31T07:52:25.925456+0000 mon.a (mon.0) 2780 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:52:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:26 smithi027 bash[22610]: cluster 2024-08-31T07:52:25.204397+0000 mgr.a (mgr.14388) 14751 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:52:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:26 smithi027 bash[22610]: audit 2024-08-31T07:52:25.925456+0000 mon.a (mon.0) 2780 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:52:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:26 smithi191 bash[24992]: cluster 2024-08-31T07:52:25.204397+0000 mgr.a (mgr.14388) 14751 : cluster [DBG] pgmap v10227: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:52:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:26 smithi191 bash[24992]: audit 2024-08-31T07:52:25.925456+0000 mon.a (mon.0) 2780 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:52:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:27 smithi163 bash[24253]: audit 2024-08-31T07:52:26.554902+0000 mon.a (mon.0) 2781 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:52:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:27 smithi163 bash[24253]: audit 2024-08-31T07:52:26.560854+0000 mon.a (mon.0) 2782 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:52:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:27 smithi163 bash[24253]: cluster 2024-08-31T07:52:27.204905+0000 mgr.a (mgr.14388) 14752 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:52:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:27 smithi163 bash[24253]: audit 2024-08-31T07:52:27.326675+0000 mon.a (mon.0) 2783 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:52:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:27 smithi163 bash[24253]: audit 2024-08-31T07:52:27.327614+0000 mon.a (mon.0) 2784 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:52:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:27 smithi163 bash[24253]: audit 2024-08-31T07:52:27.332979+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:52:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:27 smithi163 bash[24253]: audit 2024-08-31T07:52:27.336745+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:52:27.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:27 smithi163 bash[24253]: audit 2024-08-31T07:52:27.338976+0000 mgr.a (mgr.14388) 14753 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:52:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:27 smithi027 bash[22610]: audit 2024-08-31T07:52:26.554902+0000 mon.a (mon.0) 2781 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:52:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:27 smithi027 bash[22610]: audit 2024-08-31T07:52:26.560854+0000 mon.a (mon.0) 2782 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:52:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:27 smithi027 bash[22610]: cluster 2024-08-31T07:52:27.204905+0000 mgr.a (mgr.14388) 14752 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:52:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:27 smithi027 bash[22610]: audit 2024-08-31T07:52:27.326675+0000 mon.a (mon.0) 2783 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:52:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:27 smithi027 bash[22610]: audit 2024-08-31T07:52:27.327614+0000 mon.a (mon.0) 2784 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:52:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:27 smithi027 bash[22610]: audit 2024-08-31T07:52:27.332979+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:52:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:27 smithi027 bash[22610]: audit 2024-08-31T07:52:27.336745+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:52:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:27 smithi027 bash[22610]: audit 2024-08-31T07:52:27.338976+0000 mgr.a (mgr.14388) 14753 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:52:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:27 smithi191 bash[24992]: audit 2024-08-31T07:52:26.554902+0000 mon.a (mon.0) 2781 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:52:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:27 smithi191 bash[24992]: audit 2024-08-31T07:52:26.560854+0000 mon.a (mon.0) 2782 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:52:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:27 smithi191 bash[24992]: cluster 2024-08-31T07:52:27.204905+0000 mgr.a (mgr.14388) 14752 : cluster [DBG] pgmap v10228: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T07:52:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:27 smithi191 bash[24992]: audit 2024-08-31T07:52:27.326675+0000 mon.a (mon.0) 2783 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:52:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:27 smithi191 bash[24992]: audit 2024-08-31T07:52:27.327614+0000 mon.a (mon.0) 2784 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:52:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:27 smithi191 bash[24992]: audit 2024-08-31T07:52:27.332979+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:52:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:27 smithi191 bash[24992]: audit 2024-08-31T07:52:27.336745+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:52:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:27 smithi191 bash[24992]: audit 2024-08-31T07:52:27.338976+0000 mgr.a (mgr.14388) 14753 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:52:28.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:52:28 smithi027 bash[22863]: debug 2024-08-31T07:52:28.044+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:52:28.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:52:28 smithi027 bash[22863]: debug 2024-08-31T07:52:28.044+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:52:28.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:28.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:28.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:28 smithi163 bash[24253]: audit 2024-08-31T07:52:28.047266+0000 mgr.a (mgr.14388) 14754 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:52:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:28 smithi163 bash[24253]: cephadm 2024-08-31T07:52:28.048494+0000 mgr.a (mgr.14388) 14755 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:52:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:28 smithi027 bash[22610]: audit 2024-08-31T07:52:28.047266+0000 mgr.a (mgr.14388) 14754 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:52:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:28 smithi027 bash[22610]: cephadm 2024-08-31T07:52:28.048494+0000 mgr.a (mgr.14388) 14755 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:52:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:28 smithi191 bash[24992]: audit 2024-08-31T07:52:28.047266+0000 mgr.a (mgr.14388) 14754 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:52:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:28 smithi191 bash[24992]: cephadm 2024-08-31T07:52:28.048494+0000 mgr.a (mgr.14388) 14755 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:52:29.697 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:29.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:29.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:29.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:29.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:29 smithi163 bash[24253]: cluster 2024-08-31T07:52:29.207084+0000 mgr.a (mgr.14388) 14756 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 9.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T07:52:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:29 smithi163 bash[24253]: audit 2024-08-31T07:52:29.274679+0000 mgr.a (mgr.14388) 14757 : audit [DBG] from='client.320286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:29 smithi027 bash[22610]: cluster 2024-08-31T07:52:29.207084+0000 mgr.a (mgr.14388) 14756 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 9.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T07:52:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:29 smithi027 bash[22610]: audit 2024-08-31T07:52:29.274679+0000 mgr.a (mgr.14388) 14757 : audit [DBG] from='client.320286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:29 smithi191 bash[24992]: cluster 2024-08-31T07:52:29.207084+0000 mgr.a (mgr.14388) 14756 : cluster [DBG] pgmap v10229: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 9.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T07:52:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:29 smithi191 bash[24992]: audit 2024-08-31T07:52:29.274679+0000 mgr.a (mgr.14388) 14757 : audit [DBG] from='client.320286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:32 smithi191 bash[24992]: cluster 2024-08-31T07:52:31.207980+0000 mgr.a (mgr.14388) 14758 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 9.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T07:52:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:32 smithi163 bash[24253]: cluster 2024-08-31T07:52:31.207980+0000 mgr.a (mgr.14388) 14758 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 9.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T07:52:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:32 smithi027 bash[22610]: cluster 2024-08-31T07:52:31.207980+0000 mgr.a (mgr.14388) 14758 : cluster [DBG] pgmap v10230: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 9.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-08-31T07:52:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:34 smithi191 bash[24992]: cluster 2024-08-31T07:52:33.210198+0000 mgr.a (mgr.14388) 14759 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T07:52:34.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:34.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:34.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:34 smithi163 bash[24253]: cluster 2024-08-31T07:52:33.210198+0000 mgr.a (mgr.14388) 14759 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T07:52:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:34 smithi027 bash[22610]: cluster 2024-08-31T07:52:33.210198+0000 mgr.a (mgr.14388) 14759 : cluster [DBG] pgmap v10231: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T07:52:35.474 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:35.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:35.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:35.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:35.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:36 smithi191 bash[24992]: audit 2024-08-31T07:52:35.032324+0000 mgr.a (mgr.14388) 14760 : audit [DBG] from='client.320361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:36 smithi191 bash[24992]: cluster 2024-08-31T07:52:35.210765+0000 mgr.a (mgr.14388) 14761 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:52:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:36 smithi163 bash[24253]: audit 2024-08-31T07:52:35.032324+0000 mgr.a (mgr.14388) 14760 : audit [DBG] from='client.320361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:36 smithi163 bash[24253]: cluster 2024-08-31T07:52:35.210765+0000 mgr.a (mgr.14388) 14761 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:52:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:36 smithi027 bash[22610]: audit 2024-08-31T07:52:35.032324+0000 mgr.a (mgr.14388) 14760 : audit [DBG] from='client.320361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:36 smithi027 bash[22610]: cluster 2024-08-31T07:52:35.210765+0000 mgr.a (mgr.14388) 14761 : cluster [DBG] pgmap v10232: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:52:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:38 smithi191 bash[24992]: cluster 2024-08-31T07:52:37.211705+0000 mgr.a (mgr.14388) 14762 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:52:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:38 smithi163 bash[24253]: cluster 2024-08-31T07:52:37.211705+0000 mgr.a (mgr.14388) 14762 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:52:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:38 smithi027 bash[22610]: cluster 2024-08-31T07:52:37.211705+0000 mgr.a (mgr.14388) 14762 : cluster [DBG] pgmap v10233: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:52:40.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:40.476 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:40.476 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:40 smithi191 bash[24992]: cluster 2024-08-31T07:52:39.214081+0000 mgr.a (mgr.14388) 14763 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:52:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:40 smithi163 bash[24253]: cluster 2024-08-31T07:52:39.214081+0000 mgr.a (mgr.14388) 14763 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:52:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:40 smithi027 bash[22610]: cluster 2024-08-31T07:52:39.214081+0000 mgr.a (mgr.14388) 14763 : cluster [DBG] pgmap v10234: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:52:41.218 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:41.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:41.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:41.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:41.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:42 smithi191 bash[24992]: audit 2024-08-31T07:52:40.806383+0000 mgr.a (mgr.14388) 14764 : audit [DBG] from='client.320436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:42 smithi191 bash[24992]: cluster 2024-08-31T07:52:41.214585+0000 mgr.a (mgr.14388) 14765 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:52:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:42 smithi163 bash[24253]: audit 2024-08-31T07:52:40.806383+0000 mgr.a (mgr.14388) 14764 : audit [DBG] from='client.320436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:42 smithi163 bash[24253]: cluster 2024-08-31T07:52:41.214585+0000 mgr.a (mgr.14388) 14765 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:52:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:42 smithi027 bash[22610]: audit 2024-08-31T07:52:40.806383+0000 mgr.a (mgr.14388) 14764 : audit [DBG] from='client.320436 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:42 smithi027 bash[22610]: cluster 2024-08-31T07:52:41.214585+0000 mgr.a (mgr.14388) 14765 : cluster [DBG] pgmap v10235: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T07:52:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:44 smithi163 bash[24253]: cluster 2024-08-31T07:52:43.216888+0000 mgr.a (mgr.14388) 14766 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 170 B/s wr, 33 op/s 2024-08-31T07:52:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:44 smithi027 bash[22610]: cluster 2024-08-31T07:52:43.216888+0000 mgr.a (mgr.14388) 14766 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 170 B/s wr, 33 op/s 2024-08-31T07:52:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:44 smithi191 bash[24992]: cluster 2024-08-31T07:52:43.216888+0000 mgr.a (mgr.14388) 14766 : cluster [DBG] pgmap v10236: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 170 B/s wr, 33 op/s 2024-08-31T07:52:46.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:46.220 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:46.221 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:46 smithi163 bash[24253]: cluster 2024-08-31T07:52:45.217662+0000 mgr.a (mgr.14388) 14767 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-08-31T07:52:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:46 smithi027 bash[22610]: cluster 2024-08-31T07:52:45.217662+0000 mgr.a (mgr.14388) 14767 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-08-31T07:52:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:46 smithi191 bash[24992]: cluster 2024-08-31T07:52:45.217662+0000 mgr.a (mgr.14388) 14767 : cluster [DBG] pgmap v10237: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-08-31T07:52:47.004 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:47.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:47.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:47.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:47.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:48 smithi163 bash[24253]: audit 2024-08-31T07:52:46.558233+0000 mgr.a (mgr.14388) 14768 : audit [DBG] from='client.320514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:48 smithi163 bash[24253]: cluster 2024-08-31T07:52:47.218688+0000 mgr.a (mgr.14388) 14769 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-08-31T07:52:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:48 smithi027 bash[22610]: audit 2024-08-31T07:52:46.558233+0000 mgr.a (mgr.14388) 14768 : audit [DBG] from='client.320514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:48 smithi027 bash[22610]: cluster 2024-08-31T07:52:47.218688+0000 mgr.a (mgr.14388) 14769 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-08-31T07:52:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:48 smithi191 bash[24992]: audit 2024-08-31T07:52:46.558233+0000 mgr.a (mgr.14388) 14768 : audit [DBG] from='client.320514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:48 smithi191 bash[24992]: cluster 2024-08-31T07:52:47.218688+0000 mgr.a (mgr.14388) 14769 : cluster [DBG] pgmap v10238: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 30 op/s 2024-08-31T07:52:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:50 smithi163 bash[24253]: cluster 2024-08-31T07:52:49.220954+0000 mgr.a (mgr.14388) 14770 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:52:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:50 smithi027 bash[22610]: cluster 2024-08-31T07:52:49.220954+0000 mgr.a (mgr.14388) 14770 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:52:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:50 smithi191 bash[24992]: cluster 2024-08-31T07:52:49.220954+0000 mgr.a (mgr.14388) 14770 : cluster [DBG] pgmap v10239: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:52:52.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:52.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:52.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:52 smithi163 bash[24253]: cluster 2024-08-31T07:52:51.221883+0000 mgr.a (mgr.14388) 14771 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:52:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:52 smithi027 bash[22610]: cluster 2024-08-31T07:52:51.221883+0000 mgr.a (mgr.14388) 14771 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:52:52.756 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:52.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:52.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:52.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:52.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:52 smithi191 bash[24992]: cluster 2024-08-31T07:52:51.221883+0000 mgr.a (mgr.14388) 14771 : cluster [DBG] pgmap v10240: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T07:52:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:53 smithi163 bash[24253]: audit 2024-08-31T07:52:52.333071+0000 mgr.a (mgr.14388) 14772 : audit [DBG] from='client.320589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:53 smithi027 bash[22610]: audit 2024-08-31T07:52:52.333071+0000 mgr.a (mgr.14388) 14772 : audit [DBG] from='client.320589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:53 smithi191 bash[24992]: audit 2024-08-31T07:52:52.333071+0000 mgr.a (mgr.14388) 14772 : audit [DBG] from='client.320589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:54 smithi163 bash[24253]: cluster 2024-08-31T07:52:53.224092+0000 mgr.a (mgr.14388) 14773 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:52:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:54 smithi027 bash[22610]: cluster 2024-08-31T07:52:53.224092+0000 mgr.a (mgr.14388) 14773 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:52:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:54 smithi191 bash[24992]: cluster 2024-08-31T07:52:53.224092+0000 mgr.a (mgr.14388) 14773 : cluster [DBG] pgmap v10241: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T07:52:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:56 smithi163 bash[24253]: cluster 2024-08-31T07:52:55.224905+0000 mgr.a (mgr.14388) 14774 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:52:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:56 smithi027 bash[22610]: cluster 2024-08-31T07:52:55.224905+0000 mgr.a (mgr.14388) 14774 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:52:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:56 smithi191 bash[24992]: cluster 2024-08-31T07:52:55.224905+0000 mgr.a (mgr.14388) 14774 : cluster [DBG] pgmap v10242: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:52:57.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:52:57.758 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:52:57.759 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:52:58.527 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:52:58.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:52:58.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:52:58.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:52:58.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:52:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:58 smithi163 bash[24253]: cluster 2024-08-31T07:52:57.225652+0000 mgr.a (mgr.14388) 14775 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:52:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:58 smithi027 bash[22610]: cluster 2024-08-31T07:52:57.225652+0000 mgr.a (mgr.14388) 14775 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:52:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:58 smithi191 bash[24992]: cluster 2024-08-31T07:52:57.225652+0000 mgr.a (mgr.14388) 14775 : cluster [DBG] pgmap v10243: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:52:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:52:59 smithi163 bash[24253]: audit 2024-08-31T07:52:58.090338+0000 mgr.a (mgr.14388) 14776 : audit [DBG] from='client.320664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:52:59 smithi027 bash[22610]: audit 2024-08-31T07:52:58.090338+0000 mgr.a (mgr.14388) 14776 : audit [DBG] from='client.320664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:52:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:52:59 smithi191 bash[24992]: audit 2024-08-31T07:52:58.090338+0000 mgr.a (mgr.14388) 14776 : audit [DBG] from='client.320664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:00 smithi163 bash[24253]: cluster 2024-08-31T07:52:59.228377+0000 mgr.a (mgr.14388) 14777 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:53:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:00 smithi027 bash[22610]: cluster 2024-08-31T07:52:59.228377+0000 mgr.a (mgr.14388) 14777 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:53:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:00 smithi191 bash[24992]: cluster 2024-08-31T07:52:59.228377+0000 mgr.a (mgr.14388) 14777 : cluster [DBG] pgmap v10244: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 0 B/s wr, 25 op/s 2024-08-31T07:53:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:02 smithi163 bash[24253]: cluster 2024-08-31T07:53:01.229142+0000 mgr.a (mgr.14388) 14778 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:53:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:02 smithi027 bash[22610]: cluster 2024-08-31T07:53:01.229142+0000 mgr.a (mgr.14388) 14778 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:53:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:02 smithi191 bash[24992]: cluster 2024-08-31T07:53:01.229142+0000 mgr.a (mgr.14388) 14778 : cluster [DBG] pgmap v10245: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:53:03.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:53:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:53:03.529 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:53:04.310 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:53:04.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:53:04.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:53:04.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:53:04.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:53:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:04 smithi163 bash[24253]: cluster 2024-08-31T07:53:03.231210+0000 mgr.a (mgr.14388) 14779 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:04 smithi027 bash[22610]: cluster 2024-08-31T07:53:03.231210+0000 mgr.a (mgr.14388) 14779 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:04 smithi191 bash[24992]: cluster 2024-08-31T07:53:03.231210+0000 mgr.a (mgr.14388) 14779 : cluster [DBG] pgmap v10246: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:05 smithi163 bash[24253]: audit 2024-08-31T07:53:03.871029+0000 mgr.a (mgr.14388) 14780 : audit [DBG] from='client.320742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:05 smithi027 bash[22610]: audit 2024-08-31T07:53:03.871029+0000 mgr.a (mgr.14388) 14780 : audit [DBG] from='client.320742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:05 smithi191 bash[24992]: audit 2024-08-31T07:53:03.871029+0000 mgr.a (mgr.14388) 14780 : audit [DBG] from='client.320742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:06 smithi163 bash[24253]: cluster 2024-08-31T07:53:05.232109+0000 mgr.a (mgr.14388) 14781 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:53:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:06 smithi027 bash[22610]: cluster 2024-08-31T07:53:05.232109+0000 mgr.a (mgr.14388) 14781 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:53:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:06 smithi191 bash[24992]: cluster 2024-08-31T07:53:05.232109+0000 mgr.a (mgr.14388) 14781 : cluster [DBG] pgmap v10247: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:53:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:08 smithi163 bash[24253]: cluster 2024-08-31T07:53:07.232921+0000 mgr.a (mgr.14388) 14782 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:53:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:08 smithi027 bash[22610]: cluster 2024-08-31T07:53:07.232921+0000 mgr.a (mgr.14388) 14782 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:53:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:08 smithi191 bash[24992]: cluster 2024-08-31T07:53:07.232921+0000 mgr.a (mgr.14388) 14782 : cluster [DBG] pgmap v10248: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:53:09.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:53:09.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:53:09.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:53:10.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:53:10.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:53:10.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:53:10.057 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:53:10.058 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:53:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:10 smithi163 bash[24253]: cluster 2024-08-31T07:53:09.235110+0000 mgr.a (mgr.14388) 14783 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:10 smithi027 bash[22610]: cluster 2024-08-31T07:53:09.235110+0000 mgr.a (mgr.14388) 14783 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:10.822 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:10 smithi191 bash[24992]: cluster 2024-08-31T07:53:09.235110+0000 mgr.a (mgr.14388) 14783 : cluster [DBG] pgmap v10249: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:11 smithi163 bash[24253]: audit 2024-08-31T07:53:09.642831+0000 mgr.a (mgr.14388) 14784 : audit [DBG] from='client.320820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:11 smithi027 bash[22610]: audit 2024-08-31T07:53:09.642831+0000 mgr.a (mgr.14388) 14784 : audit [DBG] from='client.320820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:11 smithi191 bash[24992]: audit 2024-08-31T07:53:09.642831+0000 mgr.a (mgr.14388) 14784 : audit [DBG] from='client.320820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:12 smithi163 bash[24253]: cluster 2024-08-31T07:53:11.236013+0000 mgr.a (mgr.14388) 14785 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:12 smithi027 bash[22610]: cluster 2024-08-31T07:53:11.236013+0000 mgr.a (mgr.14388) 14785 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:12 smithi191 bash[24992]: cluster 2024-08-31T07:53:11.236013+0000 mgr.a (mgr.14388) 14785 : cluster [DBG] pgmap v10250: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:14 smithi163 bash[24253]: cluster 2024-08-31T07:53:13.238138+0000 mgr.a (mgr.14388) 14786 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:14 smithi027 bash[22610]: cluster 2024-08-31T07:53:13.238138+0000 mgr.a (mgr.14388) 14786 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:14 smithi191 bash[24992]: cluster 2024-08-31T07:53:13.238138+0000 mgr.a (mgr.14388) 14786 : cluster [DBG] pgmap v10251: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:15.059 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:53:15.059 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:53:15.060 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:53:15.805 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:53:15.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:53:15.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:53:15.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:53:15.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:53:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:16 smithi163 bash[24253]: cluster 2024-08-31T07:53:15.238860+0000 mgr.a (mgr.14388) 14787 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:16 smithi163 bash[24253]: audit 2024-08-31T07:53:15.391166+0000 mgr.a (mgr.14388) 14788 : audit [DBG] from='client.320898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:16 smithi027 bash[22610]: cluster 2024-08-31T07:53:15.238860+0000 mgr.a (mgr.14388) 14787 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:16 smithi027 bash[22610]: audit 2024-08-31T07:53:15.391166+0000 mgr.a (mgr.14388) 14788 : audit [DBG] from='client.320898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:16 smithi191 bash[24992]: cluster 2024-08-31T07:53:15.238860+0000 mgr.a (mgr.14388) 14787 : cluster [DBG] pgmap v10252: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:16.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:16 smithi191 bash[24992]: audit 2024-08-31T07:53:15.391166+0000 mgr.a (mgr.14388) 14788 : audit [DBG] from='client.320898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:18 smithi163 bash[24253]: cluster 2024-08-31T07:53:17.239746+0000 mgr.a (mgr.14388) 14789 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:18 smithi027 bash[22610]: cluster 2024-08-31T07:53:17.239746+0000 mgr.a (mgr.14388) 14789 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:18 smithi191 bash[24992]: cluster 2024-08-31T07:53:17.239746+0000 mgr.a (mgr.14388) 14789 : cluster [DBG] pgmap v10253: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:20 smithi163 bash[24253]: cluster 2024-08-31T07:53:19.241954+0000 mgr.a (mgr.14388) 14790 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:20 smithi027 bash[22610]: cluster 2024-08-31T07:53:19.241954+0000 mgr.a (mgr.14388) 14790 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:20 smithi191 bash[24992]: cluster 2024-08-31T07:53:19.241954+0000 mgr.a (mgr.14388) 14790 : cluster [DBG] pgmap v10254: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:20.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:53:20.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:53:20.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:53:21.597 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:53:21.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:53:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:53:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:53:21.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:53:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:22 smithi163 bash[24253]: audit 2024-08-31T07:53:21.146349+0000 mgr.a (mgr.14388) 14791 : audit [DBG] from='client.320976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:22.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:22 smithi163 bash[24253]: cluster 2024-08-31T07:53:21.242443+0000 mgr.a (mgr.14388) 14792 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:22 smithi027 bash[22610]: audit 2024-08-31T07:53:21.146349+0000 mgr.a (mgr.14388) 14791 : audit [DBG] from='client.320976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:22 smithi027 bash[22610]: cluster 2024-08-31T07:53:21.242443+0000 mgr.a (mgr.14388) 14792 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:22 smithi191 bash[24992]: audit 2024-08-31T07:53:21.146349+0000 mgr.a (mgr.14388) 14791 : audit [DBG] from='client.320976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:22 smithi191 bash[24992]: cluster 2024-08-31T07:53:21.242443+0000 mgr.a (mgr.14388) 14792 : cluster [DBG] pgmap v10255: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:24 smithi163 bash[24253]: cluster 2024-08-31T07:53:23.244863+0000 mgr.a (mgr.14388) 14793 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:24 smithi027 bash[22610]: cluster 2024-08-31T07:53:23.244863+0000 mgr.a (mgr.14388) 14793 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:24 smithi191 bash[24992]: cluster 2024-08-31T07:53:23.244863+0000 mgr.a (mgr.14388) 14793 : cluster [DBG] pgmap v10256: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:26.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:53:26.599 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:53:26.600 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:53:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:26 smithi163 bash[24253]: cluster 2024-08-31T07:53:25.245816+0000 mgr.a (mgr.14388) 14794 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:26 smithi027 bash[22610]: cluster 2024-08-31T07:53:25.245816+0000 mgr.a (mgr.14388) 14794 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:26 smithi191 bash[24992]: cluster 2024-08-31T07:53:25.245816+0000 mgr.a (mgr.14388) 14794 : cluster [DBG] pgmap v10257: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:27.384 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:53:27.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:53:27.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:53:27.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:53:27.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:53:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:28 smithi163 bash[24253]: audit 2024-08-31T07:53:26.936238+0000 mgr.a (mgr.14388) 14795 : audit [DBG] from='client.321054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:28 smithi163 bash[24253]: cluster 2024-08-31T07:53:27.246404+0000 mgr.a (mgr.14388) 14796 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:28 smithi163 bash[24253]: audit 2024-08-31T07:53:28.101064+0000 mon.a (mon.0) 2787 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:53:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:28 smithi027 bash[22610]: audit 2024-08-31T07:53:26.936238+0000 mgr.a (mgr.14388) 14795 : audit [DBG] from='client.321054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:28 smithi027 bash[22610]: cluster 2024-08-31T07:53:27.246404+0000 mgr.a (mgr.14388) 14796 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:28 smithi027 bash[22610]: audit 2024-08-31T07:53:28.101064+0000 mon.a (mon.0) 2787 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:53:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:28 smithi191 bash[24992]: audit 2024-08-31T07:53:26.936238+0000 mgr.a (mgr.14388) 14795 : audit [DBG] from='client.321054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:28 smithi191 bash[24992]: cluster 2024-08-31T07:53:27.246404+0000 mgr.a (mgr.14388) 14796 : cluster [DBG] pgmap v10258: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:28 smithi191 bash[24992]: audit 2024-08-31T07:53:28.101064+0000 mon.a (mon.0) 2787 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:53:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:29 smithi027 bash[22610]: audit 2024-08-31T07:53:28.721767+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:29 smithi027 bash[22610]: audit 2024-08-31T07:53:28.726958+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:29 smithi027 bash[22610]: audit 2024-08-31T07:53:28.731791+0000 mon.a (mon.0) 2790 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:29 smithi027 bash[22610]: audit 2024-08-31T07:53:28.736614+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:29 smithi027 bash[22610]: cluster 2024-08-31T07:53:29.248680+0000 mgr.a (mgr.14388) 14797 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:29 smithi027 bash[22610]: audit 2024-08-31T07:53:29.512090+0000 mon.a (mon.0) 2792 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:53:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:29 smithi027 bash[22610]: audit 2024-08-31T07:53:29.513798+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:53:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:29 smithi027 bash[22610]: audit 2024-08-31T07:53:29.523758+0000 mon.a (mon.0) 2794 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:29 smithi027 bash[22610]: audit 2024-08-31T07:53:29.528716+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:53:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:29 smithi191 bash[24992]: audit 2024-08-31T07:53:28.721767+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:29 smithi191 bash[24992]: audit 2024-08-31T07:53:28.726958+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:29 smithi191 bash[24992]: audit 2024-08-31T07:53:28.731791+0000 mon.a (mon.0) 2790 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:29 smithi191 bash[24992]: audit 2024-08-31T07:53:28.736614+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:29 smithi191 bash[24992]: cluster 2024-08-31T07:53:29.248680+0000 mgr.a (mgr.14388) 14797 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:30.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:29 smithi191 bash[24992]: audit 2024-08-31T07:53:29.512090+0000 mon.a (mon.0) 2792 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:53:30.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:29 smithi191 bash[24992]: audit 2024-08-31T07:53:29.513798+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:53:30.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:29 smithi191 bash[24992]: audit 2024-08-31T07:53:29.523758+0000 mon.a (mon.0) 2794 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:30.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:29 smithi191 bash[24992]: audit 2024-08-31T07:53:29.528716+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:53:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:29 smithi163 bash[24253]: audit 2024-08-31T07:53:28.721767+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:29 smithi163 bash[24253]: audit 2024-08-31T07:53:28.726958+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:29 smithi163 bash[24253]: audit 2024-08-31T07:53:28.731791+0000 mon.a (mon.0) 2790 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:29 smithi163 bash[24253]: audit 2024-08-31T07:53:28.736614+0000 mon.a (mon.0) 2791 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:29 smithi163 bash[24253]: cluster 2024-08-31T07:53:29.248680+0000 mgr.a (mgr.14388) 14797 : cluster [DBG] pgmap v10259: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:29 smithi163 bash[24253]: audit 2024-08-31T07:53:29.512090+0000 mon.a (mon.0) 2792 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:53:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:29 smithi163 bash[24253]: audit 2024-08-31T07:53:29.513798+0000 mon.a (mon.0) 2793 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:53:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:29 smithi163 bash[24253]: audit 2024-08-31T07:53:29.523758+0000 mon.a (mon.0) 2794 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:53:30.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:29 smithi163 bash[24253]: audit 2024-08-31T07:53:29.528716+0000 mon.a (mon.0) 2795 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:53:30.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:53:30 smithi027 bash[22863]: debug 2024-08-31T07:53:30.282+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:53:30.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:53:30 smithi027 bash[22863]: debug 2024-08-31T07:53:30.282+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:53:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:30 smithi191 bash[24992]: audit 2024-08-31T07:53:29.531066+0000 mgr.a (mgr.14388) 14798 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:53:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:30 smithi191 bash[24992]: audit 2024-08-31T07:53:30.283166+0000 mgr.a (mgr.14388) 14799 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:53:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:30 smithi191 bash[24992]: cephadm 2024-08-31T07:53:30.284687+0000 mgr.a (mgr.14388) 14800 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:53:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:30 smithi163 bash[24253]: audit 2024-08-31T07:53:29.531066+0000 mgr.a (mgr.14388) 14798 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:53:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:30 smithi163 bash[24253]: audit 2024-08-31T07:53:30.283166+0000 mgr.a (mgr.14388) 14799 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:53:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:30 smithi163 bash[24253]: cephadm 2024-08-31T07:53:30.284687+0000 mgr.a (mgr.14388) 14800 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:53:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:30 smithi027 bash[22610]: audit 2024-08-31T07:53:29.531066+0000 mgr.a (mgr.14388) 14798 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:53:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:30 smithi027 bash[22610]: audit 2024-08-31T07:53:30.283166+0000 mgr.a (mgr.14388) 14799 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:53:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:30 smithi027 bash[22610]: cephadm 2024-08-31T07:53:30.284687+0000 mgr.a (mgr.14388) 14800 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:53:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:31 smithi191 bash[24992]: cluster 2024-08-31T07:53:31.249649+0000 mgr.a (mgr.14388) 14801 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:31 smithi163 bash[24253]: cluster 2024-08-31T07:53:31.249649+0000 mgr.a (mgr.14388) 14801 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:31 smithi027 bash[22610]: cluster 2024-08-31T07:53:31.249649+0000 mgr.a (mgr.14388) 14801 : cluster [DBG] pgmap v10260: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:32.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:53:32.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:53:32.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:53:33.140 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:53:33.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:53:33.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:53:33.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:53:33.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:53:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:34 smithi163 bash[24253]: audit 2024-08-31T07:53:32.715327+0000 mgr.a (mgr.14388) 14802 : audit [DBG] from='client.321240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:34 smithi163 bash[24253]: cluster 2024-08-31T07:53:33.252643+0000 mgr.a (mgr.14388) 14803 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:53:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:34 smithi027 bash[22610]: audit 2024-08-31T07:53:32.715327+0000 mgr.a (mgr.14388) 14802 : audit [DBG] from='client.321240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:34 smithi027 bash[22610]: cluster 2024-08-31T07:53:33.252643+0000 mgr.a (mgr.14388) 14803 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:53:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:34 smithi191 bash[24992]: audit 2024-08-31T07:53:32.715327+0000 mgr.a (mgr.14388) 14802 : audit [DBG] from='client.321240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:34 smithi191 bash[24992]: cluster 2024-08-31T07:53:33.252643+0000 mgr.a (mgr.14388) 14803 : cluster [DBG] pgmap v10261: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:53:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:36 smithi163 bash[24253]: cluster 2024-08-31T07:53:35.253617+0000 mgr.a (mgr.14388) 14804 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:53:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:36 smithi027 bash[22610]: cluster 2024-08-31T07:53:35.253617+0000 mgr.a (mgr.14388) 14804 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:53:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:36 smithi191 bash[24992]: cluster 2024-08-31T07:53:35.253617+0000 mgr.a (mgr.14388) 14804 : cluster [DBG] pgmap v10262: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:53:38.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:53:38.145 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:53:38.145 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:53:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:38 smithi163 bash[24253]: cluster 2024-08-31T07:53:37.254589+0000 mgr.a (mgr.14388) 14805 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:53:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:38 smithi027 bash[22610]: cluster 2024-08-31T07:53:37.254589+0000 mgr.a (mgr.14388) 14805 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:53:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:38 smithi191 bash[24992]: cluster 2024-08-31T07:53:37.254589+0000 mgr.a (mgr.14388) 14805 : cluster [DBG] pgmap v10263: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:53:38.894 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:53:38.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:53:38.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:53:38.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:53:38.895 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:53:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:40 smithi163 bash[24253]: audit 2024-08-31T07:53:38.474000+0000 mgr.a (mgr.14388) 14806 : audit [DBG] from='client.321318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:40 smithi163 bash[24253]: cluster 2024-08-31T07:53:39.257363+0000 mgr.a (mgr.14388) 14807 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:53:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:40 smithi027 bash[22610]: audit 2024-08-31T07:53:38.474000+0000 mgr.a (mgr.14388) 14806 : audit [DBG] from='client.321318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:40 smithi027 bash[22610]: cluster 2024-08-31T07:53:39.257363+0000 mgr.a (mgr.14388) 14807 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:53:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:40 smithi191 bash[24992]: audit 2024-08-31T07:53:38.474000+0000 mgr.a (mgr.14388) 14806 : audit [DBG] from='client.321318 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:40 smithi191 bash[24992]: cluster 2024-08-31T07:53:39.257363+0000 mgr.a (mgr.14388) 14807 : cluster [DBG] pgmap v10264: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:53:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:42 smithi163 bash[24253]: cluster 2024-08-31T07:53:41.258163+0000 mgr.a (mgr.14388) 14808 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:53:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:42 smithi027 bash[22610]: cluster 2024-08-31T07:53:41.258163+0000 mgr.a (mgr.14388) 14808 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:53:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:42 smithi191 bash[24992]: cluster 2024-08-31T07:53:41.258163+0000 mgr.a (mgr.14388) 14808 : cluster [DBG] pgmap v10265: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:53:43.896 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:53:43.897 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:53:43.897 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:53:44.668 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:53:44.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:53:44.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:53:44.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:53:44.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:53:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:44 smithi163 bash[24253]: cluster 2024-08-31T07:53:43.260133+0000 mgr.a (mgr.14388) 14809 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:53:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:44 smithi027 bash[22610]: cluster 2024-08-31T07:53:43.260133+0000 mgr.a (mgr.14388) 14809 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:53:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:44 smithi191 bash[24992]: cluster 2024-08-31T07:53:43.260133+0000 mgr.a (mgr.14388) 14809 : cluster [DBG] pgmap v10266: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:53:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:45 smithi163 bash[24253]: audit 2024-08-31T07:53:44.230043+0000 mgr.a (mgr.14388) 14810 : audit [DBG] from='client.321396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:45 smithi027 bash[22610]: audit 2024-08-31T07:53:44.230043+0000 mgr.a (mgr.14388) 14810 : audit [DBG] from='client.321396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:45 smithi191 bash[24992]: audit 2024-08-31T07:53:44.230043+0000 mgr.a (mgr.14388) 14810 : audit [DBG] from='client.321396 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:46 smithi163 bash[24253]: cluster 2024-08-31T07:53:45.261104+0000 mgr.a (mgr.14388) 14811 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:53:46.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:46 smithi027 bash[22610]: cluster 2024-08-31T07:53:45.261104+0000 mgr.a (mgr.14388) 14811 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:53:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:46 smithi191 bash[24992]: cluster 2024-08-31T07:53:45.261104+0000 mgr.a (mgr.14388) 14811 : cluster [DBG] pgmap v10267: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:53:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:48 smithi163 bash[24253]: cluster 2024-08-31T07:53:47.261921+0000 mgr.a (mgr.14388) 14812 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:53:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:48 smithi027 bash[22610]: cluster 2024-08-31T07:53:47.261921+0000 mgr.a (mgr.14388) 14812 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:53:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:48 smithi191 bash[24992]: cluster 2024-08-31T07:53:47.261921+0000 mgr.a (mgr.14388) 14812 : cluster [DBG] pgmap v10268: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:53:49.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:53:49.670 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:53:49.670 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:53:50.460 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:53:50.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:53:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:53:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:53:50.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:53:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:50 smithi163 bash[24253]: cluster 2024-08-31T07:53:49.264178+0000 mgr.a (mgr.14388) 14813 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:53:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:50 smithi027 bash[22610]: cluster 2024-08-31T07:53:49.264178+0000 mgr.a (mgr.14388) 14813 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:53:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:50 smithi191 bash[24992]: cluster 2024-08-31T07:53:49.264178+0000 mgr.a (mgr.14388) 14813 : cluster [DBG] pgmap v10269: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:53:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:51 smithi163 bash[24253]: audit 2024-08-31T07:53:50.006076+0000 mgr.a (mgr.14388) 14814 : audit [DBG] from='client.321465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:51 smithi027 bash[22610]: audit 2024-08-31T07:53:50.006076+0000 mgr.a (mgr.14388) 14814 : audit [DBG] from='client.321465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:51 smithi191 bash[24992]: audit 2024-08-31T07:53:50.006076+0000 mgr.a (mgr.14388) 14814 : audit [DBG] from='client.321465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:52 smithi163 bash[24253]: cluster 2024-08-31T07:53:51.265138+0000 mgr.a (mgr.14388) 14815 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:52 smithi027 bash[22610]: cluster 2024-08-31T07:53:51.265138+0000 mgr.a (mgr.14388) 14815 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:52 smithi191 bash[24992]: cluster 2024-08-31T07:53:51.265138+0000 mgr.a (mgr.14388) 14815 : cluster [DBG] pgmap v10270: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:54 smithi163 bash[24253]: cluster 2024-08-31T07:53:53.267331+0000 mgr.a (mgr.14388) 14816 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:54 smithi027 bash[22610]: cluster 2024-08-31T07:53:53.267331+0000 mgr.a (mgr.14388) 14816 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:54 smithi191 bash[24992]: cluster 2024-08-31T07:53:53.267331+0000 mgr.a (mgr.14388) 14816 : cluster [DBG] pgmap v10271: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:53:55.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:53:55.462 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:53:55.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:53:56.206 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:53:56.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:53:56.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:53:56.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:53:56.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:53:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:56 smithi163 bash[24253]: cluster 2024-08-31T07:53:55.268090+0000 mgr.a (mgr.14388) 14817 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:56 smithi027 bash[22610]: cluster 2024-08-31T07:53:55.268090+0000 mgr.a (mgr.14388) 14817 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:56 smithi191 bash[24992]: cluster 2024-08-31T07:53:55.268090+0000 mgr.a (mgr.14388) 14817 : cluster [DBG] pgmap v10272: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:57 smithi163 bash[24253]: audit 2024-08-31T07:53:55.789306+0000 mgr.a (mgr.14388) 14818 : audit [DBG] from='client.321543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:57 smithi027 bash[22610]: audit 2024-08-31T07:53:55.789306+0000 mgr.a (mgr.14388) 14818 : audit [DBG] from='client.321543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:57 smithi191 bash[24992]: audit 2024-08-31T07:53:55.789306+0000 mgr.a (mgr.14388) 14818 : audit [DBG] from='client.321543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:53:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:53:58 smithi163 bash[24253]: cluster 2024-08-31T07:53:57.269035+0000 mgr.a (mgr.14388) 14819 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:53:58 smithi027 bash[22610]: cluster 2024-08-31T07:53:57.269035+0000 mgr.a (mgr.14388) 14819 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:53:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:53:58 smithi191 bash[24992]: cluster 2024-08-31T07:53:57.269035+0000 mgr.a (mgr.14388) 14819 : cluster [DBG] pgmap v10273: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:00 smithi163 bash[24253]: cluster 2024-08-31T07:53:59.271274+0000 mgr.a (mgr.14388) 14820 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:00 smithi027 bash[22610]: cluster 2024-08-31T07:53:59.271274+0000 mgr.a (mgr.14388) 14820 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:00 smithi191 bash[24992]: cluster 2024-08-31T07:53:59.271274+0000 mgr.a (mgr.14388) 14820 : cluster [DBG] pgmap v10274: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:01.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:01.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:01.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:01.976 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:54:01.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:01.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:01.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:01.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:02 smithi163 bash[24253]: cluster 2024-08-31T07:54:01.271898+0000 mgr.a (mgr.14388) 14821 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:02 smithi027 bash[22610]: cluster 2024-08-31T07:54:01.271898+0000 mgr.a (mgr.14388) 14821 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:02 smithi191 bash[24992]: cluster 2024-08-31T07:54:01.271898+0000 mgr.a (mgr.14388) 14821 : cluster [DBG] pgmap v10275: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:03 smithi163 bash[24253]: audit 2024-08-31T07:54:01.542449+0000 mgr.a (mgr.14388) 14822 : audit [DBG] from='client.321621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:03 smithi027 bash[22610]: audit 2024-08-31T07:54:01.542449+0000 mgr.a (mgr.14388) 14822 : audit [DBG] from='client.321621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:03 smithi191 bash[24992]: audit 2024-08-31T07:54:01.542449+0000 mgr.a (mgr.14388) 14822 : audit [DBG] from='client.321621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:04 smithi163 bash[24253]: cluster 2024-08-31T07:54:03.274237+0000 mgr.a (mgr.14388) 14823 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:04 smithi027 bash[22610]: cluster 2024-08-31T07:54:03.274237+0000 mgr.a (mgr.14388) 14823 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:04 smithi191 bash[24992]: cluster 2024-08-31T07:54:03.274237+0000 mgr.a (mgr.14388) 14823 : cluster [DBG] pgmap v10276: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:06 smithi163 bash[24253]: cluster 2024-08-31T07:54:05.275166+0000 mgr.a (mgr.14388) 14824 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:06 smithi027 bash[22610]: cluster 2024-08-31T07:54:05.275166+0000 mgr.a (mgr.14388) 14824 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:06 smithi191 bash[24992]: cluster 2024-08-31T07:54:05.275166+0000 mgr.a (mgr.14388) 14824 : cluster [DBG] pgmap v10277: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:06.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:06.978 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:06.979 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:07.769 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:07.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:08 smithi163 bash[24253]: cluster 2024-08-31T07:54:07.276080+0000 mgr.a (mgr.14388) 14825 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:08 smithi163 bash[24253]: audit 2024-08-31T07:54:07.321093+0000 mgr.a (mgr.14388) 14826 : audit [DBG] from='client.321696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:08 smithi027 bash[22610]: cluster 2024-08-31T07:54:07.276080+0000 mgr.a (mgr.14388) 14825 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:08.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:08 smithi027 bash[22610]: audit 2024-08-31T07:54:07.321093+0000 mgr.a (mgr.14388) 14826 : audit [DBG] from='client.321696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:08 smithi191 bash[24992]: cluster 2024-08-31T07:54:07.276080+0000 mgr.a (mgr.14388) 14825 : cluster [DBG] pgmap v10278: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:08 smithi191 bash[24992]: audit 2024-08-31T07:54:07.321093+0000 mgr.a (mgr.14388) 14826 : audit [DBG] from='client.321696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:10 smithi163 bash[24253]: cluster 2024-08-31T07:54:09.278415+0000 mgr.a (mgr.14388) 14827 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:10 smithi027 bash[22610]: cluster 2024-08-31T07:54:09.278415+0000 mgr.a (mgr.14388) 14827 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:10 smithi191 bash[24992]: cluster 2024-08-31T07:54:09.278415+0000 mgr.a (mgr.14388) 14827 : cluster [DBG] pgmap v10279: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:12 smithi163 bash[24253]: cluster 2024-08-31T07:54:11.279217+0000 mgr.a (mgr.14388) 14828 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:12 smithi027 bash[22610]: cluster 2024-08-31T07:54:11.279217+0000 mgr.a (mgr.14388) 14828 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:12 smithi191 bash[24992]: cluster 2024-08-31T07:54:11.279217+0000 mgr.a (mgr.14388) 14828 : cluster [DBG] pgmap v10280: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:13.533 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:54:13.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:13.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:13.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:13.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:14 smithi163 bash[24253]: audit 2024-08-31T07:54:13.104597+0000 mgr.a (mgr.14388) 14829 : audit [DBG] from='client.321774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:14 smithi163 bash[24253]: cluster 2024-08-31T07:54:13.280936+0000 mgr.a (mgr.14388) 14830 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:14 smithi027 bash[22610]: audit 2024-08-31T07:54:13.104597+0000 mgr.a (mgr.14388) 14829 : audit [DBG] from='client.321774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:14 smithi027 bash[22610]: cluster 2024-08-31T07:54:13.280936+0000 mgr.a (mgr.14388) 14830 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:14 smithi191 bash[24992]: audit 2024-08-31T07:54:13.104597+0000 mgr.a (mgr.14388) 14829 : audit [DBG] from='client.321774 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:14 smithi191 bash[24992]: cluster 2024-08-31T07:54:13.280936+0000 mgr.a (mgr.14388) 14830 : cluster [DBG] pgmap v10281: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:16 smithi163 bash[24253]: cluster 2024-08-31T07:54:15.281989+0000 mgr.a (mgr.14388) 14831 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:54:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:16 smithi027 bash[22610]: cluster 2024-08-31T07:54:15.281989+0000 mgr.a (mgr.14388) 14831 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:54:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:16 smithi191 bash[24992]: cluster 2024-08-31T07:54:15.281989+0000 mgr.a (mgr.14388) 14831 : cluster [DBG] pgmap v10282: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:54:18.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:18.536 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:18.536 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:18 smithi163 bash[24253]: cluster 2024-08-31T07:54:17.283001+0000 mgr.a (mgr.14388) 14832 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:54:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:18 smithi027 bash[22610]: cluster 2024-08-31T07:54:17.283001+0000 mgr.a (mgr.14388) 14832 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:54:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:18 smithi191 bash[24992]: cluster 2024-08-31T07:54:17.283001+0000 mgr.a (mgr.14388) 14832 : cluster [DBG] pgmap v10283: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:54:19.316 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:19.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:19.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:20 smithi163 bash[24253]: audit 2024-08-31T07:54:18.868853+0000 mgr.a (mgr.14388) 14833 : audit [DBG] from='client.321849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:20 smithi163 bash[24253]: cluster 2024-08-31T07:54:19.284348+0000 mgr.a (mgr.14388) 14834 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:20 smithi027 bash[22610]: audit 2024-08-31T07:54:18.868853+0000 mgr.a (mgr.14388) 14833 : audit [DBG] from='client.321849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:20 smithi027 bash[22610]: cluster 2024-08-31T07:54:19.284348+0000 mgr.a (mgr.14388) 14834 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:20 smithi191 bash[24992]: audit 2024-08-31T07:54:18.868853+0000 mgr.a (mgr.14388) 14833 : audit [DBG] from='client.321849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:20 smithi191 bash[24992]: cluster 2024-08-31T07:54:19.284348+0000 mgr.a (mgr.14388) 14834 : cluster [DBG] pgmap v10284: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:22 smithi163 bash[24253]: cluster 2024-08-31T07:54:21.285213+0000 mgr.a (mgr.14388) 14835 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:54:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:22 smithi027 bash[22610]: cluster 2024-08-31T07:54:21.285213+0000 mgr.a (mgr.14388) 14835 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:54:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:22 smithi191 bash[24992]: cluster 2024-08-31T07:54:21.285213+0000 mgr.a (mgr.14388) 14835 : cluster [DBG] pgmap v10285: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:54:24.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:24.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:24.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:24 smithi163 bash[24253]: cluster 2024-08-31T07:54:23.287197+0000 mgr.a (mgr.14388) 14836 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:24 smithi027 bash[22610]: cluster 2024-08-31T07:54:23.287197+0000 mgr.a (mgr.14388) 14836 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:24 smithi191 bash[24992]: cluster 2024-08-31T07:54:23.287197+0000 mgr.a (mgr.14388) 14836 : cluster [DBG] pgmap v10286: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:25.067 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:54:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:25.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:26 smithi027 bash[22610]: audit 2024-08-31T07:54:24.653041+0000 mgr.a (mgr.14388) 14837 : audit [DBG] from='client.321927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:26.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:26 smithi027 bash[22610]: cluster 2024-08-31T07:54:25.288233+0000 mgr.a (mgr.14388) 14838 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:26 smithi191 bash[24992]: audit 2024-08-31T07:54:24.653041+0000 mgr.a (mgr.14388) 14837 : audit [DBG] from='client.321927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:26 smithi191 bash[24992]: cluster 2024-08-31T07:54:25.288233+0000 mgr.a (mgr.14388) 14838 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:26 smithi163 bash[24253]: audit 2024-08-31T07:54:24.653041+0000 mgr.a (mgr.14388) 14837 : audit [DBG] from='client.321927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:26 smithi163 bash[24253]: cluster 2024-08-31T07:54:25.288233+0000 mgr.a (mgr.14388) 14838 : cluster [DBG] pgmap v10287: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:28 smithi027 bash[22610]: cluster 2024-08-31T07:54:27.289214+0000 mgr.a (mgr.14388) 14839 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:28 smithi191 bash[24992]: cluster 2024-08-31T07:54:27.289214+0000 mgr.a (mgr.14388) 14839 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:28 smithi163 bash[24253]: cluster 2024-08-31T07:54:27.289214+0000 mgr.a (mgr.14388) 14839 : cluster [DBG] pgmap v10288: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:30.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:30.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:30.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:30 smithi027 bash[22610]: cluster 2024-08-31T07:54:29.291480+0000 mgr.a (mgr.14388) 14840 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:30 smithi027 bash[22610]: audit 2024-08-31T07:54:30.341570+0000 mon.a (mon.0) 2796 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:54:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:30 smithi191 bash[24992]: cluster 2024-08-31T07:54:29.291480+0000 mgr.a (mgr.14388) 14840 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:30 smithi191 bash[24992]: audit 2024-08-31T07:54:30.341570+0000 mon.a (mon.0) 2796 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:54:30.836 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:54:30.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:30.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:30.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:30.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:30 smithi163 bash[24253]: cluster 2024-08-31T07:54:29.291480+0000 mgr.a (mgr.14388) 14840 : cluster [DBG] pgmap v10289: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:54:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:30 smithi163 bash[24253]: audit 2024-08-31T07:54:30.341570+0000 mon.a (mon.0) 2796 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:54:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:31 smithi027 bash[22610]: audit 2024-08-31T07:54:30.404552+0000 mgr.a (mgr.14388) 14841 : audit [DBG] from='client.321999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:31 smithi027 bash[22610]: audit 2024-08-31T07:54:31.221854+0000 mon.a (mon.0) 2797 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:54:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:31 smithi027 bash[22610]: audit 2024-08-31T07:54:31.223695+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:54:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:31 smithi027 bash[22610]: audit 2024-08-31T07:54:31.234436+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:54:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:31 smithi027 bash[22610]: audit 2024-08-31T07:54:31.239348+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:54:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:31 smithi191 bash[24992]: audit 2024-08-31T07:54:30.404552+0000 mgr.a (mgr.14388) 14841 : audit [DBG] from='client.321999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:31 smithi191 bash[24992]: audit 2024-08-31T07:54:31.221854+0000 mon.a (mon.0) 2797 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:54:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:31 smithi191 bash[24992]: audit 2024-08-31T07:54:31.223695+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:54:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:31 smithi191 bash[24992]: audit 2024-08-31T07:54:31.234436+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:54:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:31 smithi191 bash[24992]: audit 2024-08-31T07:54:31.239348+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:54:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:31 smithi163 bash[24253]: audit 2024-08-31T07:54:30.404552+0000 mgr.a (mgr.14388) 14841 : audit [DBG] from='client.321999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:31 smithi163 bash[24253]: audit 2024-08-31T07:54:31.221854+0000 mon.a (mon.0) 2797 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:54:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:31 smithi163 bash[24253]: audit 2024-08-31T07:54:31.223695+0000 mon.a (mon.0) 2798 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:54:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:31 smithi163 bash[24253]: audit 2024-08-31T07:54:31.234436+0000 mon.a (mon.0) 2799 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:54:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:31 smithi163 bash[24253]: audit 2024-08-31T07:54:31.239348+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:54:32.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:54:31 smithi027 bash[22863]: debug 2024-08-31T07:54:31.976+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:54:32.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:54:31 smithi027 bash[22863]: debug 2024-08-31T07:54:31.980+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:54:32.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:32 smithi027 bash[22610]: audit 2024-08-31T07:54:31.242065+0000 mgr.a (mgr.14388) 14842 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:54:32.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:32 smithi027 bash[22610]: cluster 2024-08-31T07:54:31.292491+0000 mgr.a (mgr.14388) 14843 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:32 smithi191 bash[24992]: audit 2024-08-31T07:54:31.242065+0000 mgr.a (mgr.14388) 14842 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:54:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:32 smithi191 bash[24992]: cluster 2024-08-31T07:54:31.292491+0000 mgr.a (mgr.14388) 14843 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:32 smithi163 bash[24253]: audit 2024-08-31T07:54:31.242065+0000 mgr.a (mgr.14388) 14842 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:54:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:32 smithi163 bash[24253]: cluster 2024-08-31T07:54:31.292491+0000 mgr.a (mgr.14388) 14843 : cluster [DBG] pgmap v10290: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:33 smithi027 bash[22610]: audit 2024-08-31T07:54:31.981901+0000 mgr.a (mgr.14388) 14844 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:54:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:33 smithi027 bash[22610]: cephadm 2024-08-31T07:54:31.983448+0000 mgr.a (mgr.14388) 14845 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:54:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:33 smithi191 bash[24992]: audit 2024-08-31T07:54:31.981901+0000 mgr.a (mgr.14388) 14844 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:54:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:33 smithi191 bash[24992]: cephadm 2024-08-31T07:54:31.983448+0000 mgr.a (mgr.14388) 14845 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:54:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:33 smithi163 bash[24253]: audit 2024-08-31T07:54:31.981901+0000 mgr.a (mgr.14388) 14844 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:54:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:33 smithi163 bash[24253]: cephadm 2024-08-31T07:54:31.983448+0000 mgr.a (mgr.14388) 14845 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:54:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:34 smithi027 bash[22610]: cluster 2024-08-31T07:54:33.294781+0000 mgr.a (mgr.14388) 14846 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:34 smithi191 bash[24992]: cluster 2024-08-31T07:54:33.294781+0000 mgr.a (mgr.14388) 14846 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:34 smithi163 bash[24253]: cluster 2024-08-31T07:54:33.294781+0000 mgr.a (mgr.14388) 14846 : cluster [DBG] pgmap v10291: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:35 smithi191 bash[24992]: cluster 2024-08-31T07:54:35.295693+0000 mgr.a (mgr.14388) 14847 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:35.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:35.838 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:35.838 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:35 smithi163 bash[24253]: cluster 2024-08-31T07:54:35.295693+0000 mgr.a (mgr.14388) 14847 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:35 smithi027 bash[22610]: cluster 2024-08-31T07:54:35.295693+0000 mgr.a (mgr.14388) 14847 : cluster [DBG] pgmap v10292: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:36.588 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:54:36.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:36.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:36.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:36.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:36 smithi191 bash[24992]: audit 2024-08-31T07:54:36.171388+0000 mgr.a (mgr.14388) 14848 : audit [DBG] from='client.322182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:36 smithi163 bash[24253]: audit 2024-08-31T07:54:36.171388+0000 mgr.a (mgr.14388) 14848 : audit [DBG] from='client.322182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:36 smithi027 bash[22610]: audit 2024-08-31T07:54:36.171388+0000 mgr.a (mgr.14388) 14848 : audit [DBG] from='client.322182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:37 smithi191 bash[24992]: cluster 2024-08-31T07:54:37.296680+0000 mgr.a (mgr.14388) 14849 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:37 smithi163 bash[24253]: cluster 2024-08-31T07:54:37.296680+0000 mgr.a (mgr.14388) 14849 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:37 smithi027 bash[22610]: cluster 2024-08-31T07:54:37.296680+0000 mgr.a (mgr.14388) 14849 : cluster [DBG] pgmap v10293: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:40 smithi163 bash[24253]: cluster 2024-08-31T07:54:39.298946+0000 mgr.a (mgr.14388) 14850 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:40 smithi027 bash[22610]: cluster 2024-08-31T07:54:39.298946+0000 mgr.a (mgr.14388) 14850 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:40 smithi191 bash[24992]: cluster 2024-08-31T07:54:39.298946+0000 mgr.a (mgr.14388) 14850 : cluster [DBG] pgmap v10294: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:41.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:41.591 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:41.591 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:42.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:42.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:42.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:42.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:42.369 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:54:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:42 smithi163 bash[24253]: cluster 2024-08-31T07:54:41.299864+0000 mgr.a (mgr.14388) 14851 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:42 smithi027 bash[22610]: cluster 2024-08-31T07:54:41.299864+0000 mgr.a (mgr.14388) 14851 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:42 smithi191 bash[24992]: cluster 2024-08-31T07:54:41.299864+0000 mgr.a (mgr.14388) 14851 : cluster [DBG] pgmap v10295: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:43 smithi163 bash[24253]: audit 2024-08-31T07:54:41.924034+0000 mgr.a (mgr.14388) 14852 : audit [DBG] from='client.322257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:43 smithi027 bash[22610]: audit 2024-08-31T07:54:41.924034+0000 mgr.a (mgr.14388) 14852 : audit [DBG] from='client.322257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:43 smithi191 bash[24992]: audit 2024-08-31T07:54:41.924034+0000 mgr.a (mgr.14388) 14852 : audit [DBG] from='client.322257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:44 smithi163 bash[24253]: cluster 2024-08-31T07:54:43.302209+0000 mgr.a (mgr.14388) 14853 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:44 smithi027 bash[22610]: cluster 2024-08-31T07:54:43.302209+0000 mgr.a (mgr.14388) 14853 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:44 smithi191 bash[24992]: cluster 2024-08-31T07:54:43.302209+0000 mgr.a (mgr.14388) 14853 : cluster [DBG] pgmap v10296: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:54:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:46 smithi163 bash[24253]: cluster 2024-08-31T07:54:45.303056+0000 mgr.a (mgr.14388) 14854 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:46 smithi027 bash[22610]: cluster 2024-08-31T07:54:45.303056+0000 mgr.a (mgr.14388) 14854 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:46 smithi191 bash[24992]: cluster 2024-08-31T07:54:45.303056+0000 mgr.a (mgr.14388) 14854 : cluster [DBG] pgmap v10297: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:47.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:47.371 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:48.164 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:54:48.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:48.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:48.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:48.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:48 smithi163 bash[24253]: cluster 2024-08-31T07:54:47.303815+0000 mgr.a (mgr.14388) 14855 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:48 smithi027 bash[22610]: cluster 2024-08-31T07:54:47.303815+0000 mgr.a (mgr.14388) 14855 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:48 smithi191 bash[24992]: cluster 2024-08-31T07:54:47.303815+0000 mgr.a (mgr.14388) 14855 : cluster [DBG] pgmap v10298: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:49 smithi163 bash[24253]: audit 2024-08-31T07:54:47.716943+0000 mgr.a (mgr.14388) 14856 : audit [DBG] from='client.322335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:49 smithi027 bash[22610]: audit 2024-08-31T07:54:47.716943+0000 mgr.a (mgr.14388) 14856 : audit [DBG] from='client.322335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:49 smithi191 bash[24992]: audit 2024-08-31T07:54:47.716943+0000 mgr.a (mgr.14388) 14856 : audit [DBG] from='client.322335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:50 smithi163 bash[24253]: cluster 2024-08-31T07:54:49.306715+0000 mgr.a (mgr.14388) 14857 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:54:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:50 smithi027 bash[22610]: cluster 2024-08-31T07:54:49.306715+0000 mgr.a (mgr.14388) 14857 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:54:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:50 smithi191 bash[24992]: cluster 2024-08-31T07:54:49.306715+0000 mgr.a (mgr.14388) 14857 : cluster [DBG] pgmap v10299: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:54:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:52 smithi163 bash[24253]: cluster 2024-08-31T07:54:51.307714+0000 mgr.a (mgr.14388) 14858 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:54:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:52 smithi027 bash[22610]: cluster 2024-08-31T07:54:51.307714+0000 mgr.a (mgr.14388) 14858 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:54:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:52 smithi191 bash[24992]: cluster 2024-08-31T07:54:51.307714+0000 mgr.a (mgr.14388) 14858 : cluster [DBG] pgmap v10300: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:54:53.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:53.166 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:53.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:53.942 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:54:53.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:53.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:53.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:53.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:54 smithi163 bash[24253]: cluster 2024-08-31T07:54:53.308790+0000 mgr.a (mgr.14388) 14859 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:54 smithi027 bash[22610]: cluster 2024-08-31T07:54:53.308790+0000 mgr.a (mgr.14388) 14859 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:54 smithi191 bash[24992]: cluster 2024-08-31T07:54:53.308790+0000 mgr.a (mgr.14388) 14859 : cluster [DBG] pgmap v10301: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:54:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:55 smithi163 bash[24253]: audit 2024-08-31T07:54:53.505198+0000 mgr.a (mgr.14388) 14860 : audit [DBG] from='client.322410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:55 smithi027 bash[22610]: audit 2024-08-31T07:54:53.505198+0000 mgr.a (mgr.14388) 14860 : audit [DBG] from='client.322410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:55 smithi191 bash[24992]: audit 2024-08-31T07:54:53.505198+0000 mgr.a (mgr.14388) 14860 : audit [DBG] from='client.322410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:54:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:56 smithi163 bash[24253]: cluster 2024-08-31T07:54:55.309643+0000 mgr.a (mgr.14388) 14861 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:54:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:56 smithi027 bash[22610]: cluster 2024-08-31T07:54:55.309643+0000 mgr.a (mgr.14388) 14861 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:54:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:56 smithi191 bash[24992]: cluster 2024-08-31T07:54:55.309643+0000 mgr.a (mgr.14388) 14861 : cluster [DBG] pgmap v10302: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:54:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:54:58 smithi163 bash[24253]: cluster 2024-08-31T07:54:57.310592+0000 mgr.a (mgr.14388) 14862 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:54:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:54:58 smithi027 bash[22610]: cluster 2024-08-31T07:54:57.310592+0000 mgr.a (mgr.14388) 14862 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:54:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:54:58 smithi191 bash[24992]: cluster 2024-08-31T07:54:57.310592+0000 mgr.a (mgr.14388) 14862 : cluster [DBG] pgmap v10303: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:54:58.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:54:58.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:54:58.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:54:59.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:54:59.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:54:59.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:54:59.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:54:59.714 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:00 smithi163 bash[24253]: audit 2024-08-31T07:54:59.276945+0000 mgr.a (mgr.14388) 14863 : audit [DBG] from='client.322485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:00 smithi163 bash[24253]: cluster 2024-08-31T07:54:59.313716+0000 mgr.a (mgr.14388) 14864 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:00 smithi027 bash[22610]: audit 2024-08-31T07:54:59.276945+0000 mgr.a (mgr.14388) 14863 : audit [DBG] from='client.322485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:00 smithi027 bash[22610]: cluster 2024-08-31T07:54:59.313716+0000 mgr.a (mgr.14388) 14864 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:00 smithi191 bash[24992]: audit 2024-08-31T07:54:59.276945+0000 mgr.a (mgr.14388) 14863 : audit [DBG] from='client.322485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:00 smithi191 bash[24992]: cluster 2024-08-31T07:54:59.313716+0000 mgr.a (mgr.14388) 14864 : cluster [DBG] pgmap v10304: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:02 smithi163 bash[24253]: cluster 2024-08-31T07:55:01.314797+0000 mgr.a (mgr.14388) 14865 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:55:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:02 smithi027 bash[22610]: cluster 2024-08-31T07:55:01.314797+0000 mgr.a (mgr.14388) 14865 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:55:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:02 smithi191 bash[24992]: cluster 2024-08-31T07:55:01.314797+0000 mgr.a (mgr.14388) 14865 : cluster [DBG] pgmap v10305: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:55:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:04 smithi163 bash[24253]: cluster 2024-08-31T07:55:03.317110+0000 mgr.a (mgr.14388) 14866 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:55:04.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:55:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:55:04.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:55:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:04 smithi027 bash[22610]: cluster 2024-08-31T07:55:03.317110+0000 mgr.a (mgr.14388) 14866 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:55:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:04 smithi191 bash[24992]: cluster 2024-08-31T07:55:03.317110+0000 mgr.a (mgr.14388) 14866 : cluster [DBG] pgmap v10306: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:55:05.506 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:05.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:55:05.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:55:05.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:55:05.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:55:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:06 smithi163 bash[24253]: audit 2024-08-31T07:55:05.056939+0000 mgr.a (mgr.14388) 14867 : audit [DBG] from='client.322560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:06 smithi163 bash[24253]: cluster 2024-08-31T07:55:05.317799+0000 mgr.a (mgr.14388) 14868 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:06 smithi027 bash[22610]: audit 2024-08-31T07:55:05.056939+0000 mgr.a (mgr.14388) 14867 : audit [DBG] from='client.322560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:06 smithi027 bash[22610]: cluster 2024-08-31T07:55:05.317799+0000 mgr.a (mgr.14388) 14868 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:06 smithi191 bash[24992]: audit 2024-08-31T07:55:05.056939+0000 mgr.a (mgr.14388) 14867 : audit [DBG] from='client.322560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:06 smithi191 bash[24992]: cluster 2024-08-31T07:55:05.317799+0000 mgr.a (mgr.14388) 14868 : cluster [DBG] pgmap v10307: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:08 smithi163 bash[24253]: cluster 2024-08-31T07:55:07.318709+0000 mgr.a (mgr.14388) 14869 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:08 smithi027 bash[22610]: cluster 2024-08-31T07:55:07.318709+0000 mgr.a (mgr.14388) 14869 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:08 smithi191 bash[24992]: cluster 2024-08-31T07:55:07.318709+0000 mgr.a (mgr.14388) 14869 : cluster [DBG] pgmap v10308: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:10.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:55:10.509 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:55:10.509 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:55:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:10 smithi163 bash[24253]: cluster 2024-08-31T07:55:09.320956+0000 mgr.a (mgr.14388) 14870 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:10 smithi027 bash[22610]: cluster 2024-08-31T07:55:09.320956+0000 mgr.a (mgr.14388) 14870 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:10 smithi191 bash[24992]: cluster 2024-08-31T07:55:09.320956+0000 mgr.a (mgr.14388) 14870 : cluster [DBG] pgmap v10309: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:11.261 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:11.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:55:11.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:55:11.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:55:11.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:55:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:12 smithi163 bash[24253]: audit 2024-08-31T07:55:10.841634+0000 mgr.a (mgr.14388) 14871 : audit [DBG] from='client.322629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:12 smithi163 bash[24253]: cluster 2024-08-31T07:55:11.321580+0000 mgr.a (mgr.14388) 14872 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:12 smithi027 bash[22610]: audit 2024-08-31T07:55:10.841634+0000 mgr.a (mgr.14388) 14871 : audit [DBG] from='client.322629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:12 smithi027 bash[22610]: cluster 2024-08-31T07:55:11.321580+0000 mgr.a (mgr.14388) 14872 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:12 smithi191 bash[24992]: audit 2024-08-31T07:55:10.841634+0000 mgr.a (mgr.14388) 14871 : audit [DBG] from='client.322629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:12 smithi191 bash[24992]: cluster 2024-08-31T07:55:11.321580+0000 mgr.a (mgr.14388) 14872 : cluster [DBG] pgmap v10310: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:14 smithi027 bash[22610]: cluster 2024-08-31T07:55:13.323693+0000 mgr.a (mgr.14388) 14873 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:14 smithi191 bash[24992]: cluster 2024-08-31T07:55:13.323693+0000 mgr.a (mgr.14388) 14873 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:14 smithi163 bash[24253]: cluster 2024-08-31T07:55:13.323693+0000 mgr.a (mgr.14388) 14873 : cluster [DBG] pgmap v10311: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:16.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:55:16.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:55:16.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:55:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:16 smithi027 bash[22610]: cluster 2024-08-31T07:55:15.324450+0000 mgr.a (mgr.14388) 14874 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:16 smithi191 bash[24992]: cluster 2024-08-31T07:55:15.324450+0000 mgr.a (mgr.14388) 14874 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:16 smithi163 bash[24253]: cluster 2024-08-31T07:55:15.324450+0000 mgr.a (mgr.14388) 14874 : cluster [DBG] pgmap v10312: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:17.038 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:17.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:55:17.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:55:17.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:55:17.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:55:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:18 smithi027 bash[22610]: audit 2024-08-31T07:55:16.603978+0000 mgr.a (mgr.14388) 14875 : audit [DBG] from='client.322707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:18 smithi027 bash[22610]: cluster 2024-08-31T07:55:17.325394+0000 mgr.a (mgr.14388) 14876 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:18 smithi191 bash[24992]: audit 2024-08-31T07:55:16.603978+0000 mgr.a (mgr.14388) 14875 : audit [DBG] from='client.322707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:18 smithi191 bash[24992]: cluster 2024-08-31T07:55:17.325394+0000 mgr.a (mgr.14388) 14876 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:18 smithi163 bash[24253]: audit 2024-08-31T07:55:16.603978+0000 mgr.a (mgr.14388) 14875 : audit [DBG] from='client.322707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:18 smithi163 bash[24253]: cluster 2024-08-31T07:55:17.325394+0000 mgr.a (mgr.14388) 14876 : cluster [DBG] pgmap v10313: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:20 smithi027 bash[22610]: cluster 2024-08-31T07:55:19.327687+0000 mgr.a (mgr.14388) 14877 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:20 smithi191 bash[24992]: cluster 2024-08-31T07:55:19.327687+0000 mgr.a (mgr.14388) 14877 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:20 smithi163 bash[24253]: cluster 2024-08-31T07:55:19.327687+0000 mgr.a (mgr.14388) 14877 : cluster [DBG] pgmap v10314: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:22.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:55:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:55:22.041 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:55:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:22 smithi027 bash[22610]: cluster 2024-08-31T07:55:21.328616+0000 mgr.a (mgr.14388) 14878 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:22 smithi191 bash[24992]: cluster 2024-08-31T07:55:21.328616+0000 mgr.a (mgr.14388) 14878 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:22.812 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:22.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:55:22.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:55:22.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:55:22.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:55:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:22 smithi163 bash[24253]: cluster 2024-08-31T07:55:21.328616+0000 mgr.a (mgr.14388) 14878 : cluster [DBG] pgmap v10315: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:23 smithi027 bash[22610]: audit 2024-08-31T07:55:22.377174+0000 mgr.a (mgr.14388) 14879 : audit [DBG] from='client.322779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:23 smithi191 bash[24992]: audit 2024-08-31T07:55:22.377174+0000 mgr.a (mgr.14388) 14879 : audit [DBG] from='client.322779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:23 smithi163 bash[24253]: audit 2024-08-31T07:55:22.377174+0000 mgr.a (mgr.14388) 14879 : audit [DBG] from='client.322779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:24 smithi027 bash[22610]: cluster 2024-08-31T07:55:23.330929+0000 mgr.a (mgr.14388) 14880 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:24 smithi191 bash[24992]: cluster 2024-08-31T07:55:23.330929+0000 mgr.a (mgr.14388) 14880 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:24 smithi163 bash[24253]: cluster 2024-08-31T07:55:23.330929+0000 mgr.a (mgr.14388) 14880 : cluster [DBG] pgmap v10316: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:26 smithi191 bash[24992]: cluster 2024-08-31T07:55:25.331728+0000 mgr.a (mgr.14388) 14881 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:26 smithi163 bash[24253]: cluster 2024-08-31T07:55:25.331728+0000 mgr.a (mgr.14388) 14881 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:26 smithi027 bash[22610]: cluster 2024-08-31T07:55:25.331728+0000 mgr.a (mgr.14388) 14881 : cluster [DBG] pgmap v10317: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:27 smithi191 bash[24992]: cluster 2024-08-31T07:55:27.332475+0000 mgr.a (mgr.14388) 14882 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:27.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:55:27.815 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:55:27.815 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:55:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:27 smithi163 bash[24253]: cluster 2024-08-31T07:55:27.332475+0000 mgr.a (mgr.14388) 14882 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:27 smithi027 bash[22610]: cluster 2024-08-31T07:55:27.332475+0000 mgr.a (mgr.14388) 14882 : cluster [DBG] pgmap v10318: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:28.581 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:55:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:55:28.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:55:28.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:55:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:28 smithi191 bash[24992]: audit 2024-08-31T07:55:28.152003+0000 mgr.a (mgr.14388) 14883 : audit [DBG] from='client.322854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:28 smithi163 bash[24253]: audit 2024-08-31T07:55:28.152003+0000 mgr.a (mgr.14388) 14883 : audit [DBG] from='client.322854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:28 smithi027 bash[22610]: audit 2024-08-31T07:55:28.152003+0000 mgr.a (mgr.14388) 14883 : audit [DBG] from='client.322854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:29 smithi191 bash[24992]: cluster 2024-08-31T07:55:29.335278+0000 mgr.a (mgr.14388) 14884 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:29 smithi163 bash[24253]: cluster 2024-08-31T07:55:29.335278+0000 mgr.a (mgr.14388) 14884 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:29 smithi027 bash[22610]: cluster 2024-08-31T07:55:29.335278+0000 mgr.a (mgr.14388) 14884 : cluster [DBG] pgmap v10319: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:32 smithi163 bash[24253]: cluster 2024-08-31T07:55:31.336059+0000 mgr.a (mgr.14388) 14885 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:55:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:32 smithi163 bash[24253]: audit 2024-08-31T07:55:32.037693+0000 mon.a (mon.0) 2801 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:55:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:32 smithi027 bash[22610]: cluster 2024-08-31T07:55:31.336059+0000 mgr.a (mgr.14388) 14885 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:55:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:32 smithi027 bash[22610]: audit 2024-08-31T07:55:32.037693+0000 mon.a (mon.0) 2801 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:55:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:32 smithi191 bash[24992]: cluster 2024-08-31T07:55:31.336059+0000 mgr.a (mgr.14388) 14885 : cluster [DBG] pgmap v10320: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:55:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:32 smithi191 bash[24992]: audit 2024-08-31T07:55:32.037693+0000 mon.a (mon.0) 2801 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:55:33.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:55:33.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:55:33.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:55:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:33 smithi163 bash[24253]: audit 2024-08-31T07:55:32.883972+0000 mon.a (mon.0) 2802 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:55:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:33 smithi163 bash[24253]: audit 2024-08-31T07:55:32.885548+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:55:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:33 smithi163 bash[24253]: audit 2024-08-31T07:55:32.893817+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:55:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:33 smithi163 bash[24253]: audit 2024-08-31T07:55:32.898435+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:55:33.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:55:33 smithi027 bash[22863]: debug 2024-08-31T07:55:33.635+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:55:33.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:55:33 smithi027 bash[22863]: debug 2024-08-31T07:55:33.635+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:55:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:33 smithi027 bash[22610]: audit 2024-08-31T07:55:32.883972+0000 mon.a (mon.0) 2802 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:55:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:33 smithi027 bash[22610]: audit 2024-08-31T07:55:32.885548+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:55:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:33 smithi027 bash[22610]: audit 2024-08-31T07:55:32.893817+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:55:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:33 smithi027 bash[22610]: audit 2024-08-31T07:55:32.898435+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:55:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:33 smithi191 bash[24992]: audit 2024-08-31T07:55:32.883972+0000 mon.a (mon.0) 2802 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:55:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:33 smithi191 bash[24992]: audit 2024-08-31T07:55:32.885548+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:55:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:33 smithi191 bash[24992]: audit 2024-08-31T07:55:32.893817+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:55:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:33 smithi191 bash[24992]: audit 2024-08-31T07:55:32.898435+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:55:34.320 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:55:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:55:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:55:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:55:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:34 smithi163 bash[24253]: audit 2024-08-31T07:55:32.900803+0000 mgr.a (mgr.14388) 14886 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:55:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:34 smithi163 bash[24253]: cluster 2024-08-31T07:55:33.337398+0000 mgr.a (mgr.14388) 14887 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:55:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:34 smithi027 bash[22610]: audit 2024-08-31T07:55:32.900803+0000 mgr.a (mgr.14388) 14886 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:55:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:34 smithi027 bash[22610]: cluster 2024-08-31T07:55:33.337398+0000 mgr.a (mgr.14388) 14887 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:55:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:34 smithi191 bash[24992]: audit 2024-08-31T07:55:32.900803+0000 mgr.a (mgr.14388) 14886 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:55:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:34 smithi191 bash[24992]: cluster 2024-08-31T07:55:33.337398+0000 mgr.a (mgr.14388) 14887 : cluster [DBG] pgmap v10321: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:55:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:35 smithi163 bash[24253]: audit 2024-08-31T07:55:33.640818+0000 mgr.a (mgr.14388) 14888 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:55:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:35 smithi163 bash[24253]: cephadm 2024-08-31T07:55:33.641980+0000 mgr.a (mgr.14388) 14889 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:55:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:35 smithi163 bash[24253]: audit 2024-08-31T07:55:33.902426+0000 mgr.a (mgr.14388) 14890 : audit [DBG] from='client.323034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:35 smithi027 bash[22610]: audit 2024-08-31T07:55:33.640818+0000 mgr.a (mgr.14388) 14888 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:55:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:35 smithi027 bash[22610]: cephadm 2024-08-31T07:55:33.641980+0000 mgr.a (mgr.14388) 14889 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:55:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:35 smithi027 bash[22610]: audit 2024-08-31T07:55:33.902426+0000 mgr.a (mgr.14388) 14890 : audit [DBG] from='client.323034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:35 smithi191 bash[24992]: audit 2024-08-31T07:55:33.640818+0000 mgr.a (mgr.14388) 14888 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:55:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:35 smithi191 bash[24992]: cephadm 2024-08-31T07:55:33.641980+0000 mgr.a (mgr.14388) 14889 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:55:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:35 smithi191 bash[24992]: audit 2024-08-31T07:55:33.902426+0000 mgr.a (mgr.14388) 14890 : audit [DBG] from='client.323034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:36 smithi163 bash[24253]: cluster 2024-08-31T07:55:35.338302+0000 mgr.a (mgr.14388) 14891 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T07:55:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:36 smithi027 bash[22610]: cluster 2024-08-31T07:55:35.338302+0000 mgr.a (mgr.14388) 14891 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T07:55:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:36 smithi191 bash[24992]: cluster 2024-08-31T07:55:35.338302+0000 mgr.a (mgr.14388) 14891 : cluster [DBG] pgmap v10322: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T07:55:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:38 smithi163 bash[24253]: cluster 2024-08-31T07:55:37.339252+0000 mgr.a (mgr.14388) 14892 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T07:55:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:38 smithi027 bash[22610]: cluster 2024-08-31T07:55:37.339252+0000 mgr.a (mgr.14388) 14892 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T07:55:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:38 smithi191 bash[24992]: cluster 2024-08-31T07:55:37.339252+0000 mgr.a (mgr.14388) 14892 : cluster [DBG] pgmap v10323: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T07:55:39.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:55:39.322 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:55:39.322 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:55:40.090 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:40.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:55:40.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:55:40.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:55:40.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:55:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:40 smithi163 bash[24253]: cluster 2024-08-31T07:55:39.341027+0000 mgr.a (mgr.14388) 14893 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:40 smithi027 bash[22610]: cluster 2024-08-31T07:55:39.341027+0000 mgr.a (mgr.14388) 14893 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:40 smithi191 bash[24992]: cluster 2024-08-31T07:55:39.341027+0000 mgr.a (mgr.14388) 14893 : cluster [DBG] pgmap v10324: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:41 smithi163 bash[24253]: audit 2024-08-31T07:55:39.661157+0000 mgr.a (mgr.14388) 14894 : audit [DBG] from='client.323112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:41 smithi027 bash[22610]: audit 2024-08-31T07:55:39.661157+0000 mgr.a (mgr.14388) 14894 : audit [DBG] from='client.323112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:41 smithi191 bash[24992]: audit 2024-08-31T07:55:39.661157+0000 mgr.a (mgr.14388) 14894 : audit [DBG] from='client.323112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:42 smithi163 bash[24253]: cluster 2024-08-31T07:55:41.341932+0000 mgr.a (mgr.14388) 14895 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:42 smithi027 bash[22610]: cluster 2024-08-31T07:55:41.341932+0000 mgr.a (mgr.14388) 14895 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:42 smithi191 bash[24992]: cluster 2024-08-31T07:55:41.341932+0000 mgr.a (mgr.14388) 14895 : cluster [DBG] pgmap v10325: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:44 smithi163 bash[24253]: cluster 2024-08-31T07:55:43.344257+0000 mgr.a (mgr.14388) 14896 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:44 smithi027 bash[22610]: cluster 2024-08-31T07:55:43.344257+0000 mgr.a (mgr.14388) 14896 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:44 smithi191 bash[24992]: cluster 2024-08-31T07:55:43.344257+0000 mgr.a (mgr.14388) 14896 : cluster [DBG] pgmap v10326: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:45.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:55:45.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:55:45.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:55:45.835 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:45.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:55:45.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:55:45.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:55:45.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:55:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:46 smithi163 bash[24253]: cluster 2024-08-31T07:55:45.345017+0000 mgr.a (mgr.14388) 14897 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:55:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:46 smithi163 bash[24253]: audit 2024-08-31T07:55:45.423456+0000 mgr.a (mgr.14388) 14898 : audit [DBG] from='client.323190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:46 smithi027 bash[22610]: cluster 2024-08-31T07:55:45.345017+0000 mgr.a (mgr.14388) 14897 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:55:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:46 smithi027 bash[22610]: audit 2024-08-31T07:55:45.423456+0000 mgr.a (mgr.14388) 14898 : audit [DBG] from='client.323190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:46 smithi191 bash[24992]: cluster 2024-08-31T07:55:45.345017+0000 mgr.a (mgr.14388) 14897 : cluster [DBG] pgmap v10327: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:55:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:46 smithi191 bash[24992]: audit 2024-08-31T07:55:45.423456+0000 mgr.a (mgr.14388) 14898 : audit [DBG] from='client.323190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:48 smithi163 bash[24253]: cluster 2024-08-31T07:55:47.345923+0000 mgr.a (mgr.14388) 14899 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:55:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:48 smithi027 bash[22610]: cluster 2024-08-31T07:55:47.345923+0000 mgr.a (mgr.14388) 14899 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:55:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:48 smithi191 bash[24992]: cluster 2024-08-31T07:55:47.345923+0000 mgr.a (mgr.14388) 14899 : cluster [DBG] pgmap v10328: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:55:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:50 smithi163 bash[24253]: cluster 2024-08-31T07:55:49.348219+0000 mgr.a (mgr.14388) 14900 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:50 smithi027 bash[22610]: cluster 2024-08-31T07:55:49.348219+0000 mgr.a (mgr.14388) 14900 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:50 smithi191 bash[24992]: cluster 2024-08-31T07:55:49.348219+0000 mgr.a (mgr.14388) 14900 : cluster [DBG] pgmap v10329: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:55:50.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:55:50.837 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:55:50.838 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:55:51.612 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:51.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:55:51.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:55:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:55:51.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:55:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:52 smithi163 bash[24253]: audit 2024-08-31T07:55:51.172099+0000 mgr.a (mgr.14388) 14901 : audit [DBG] from='client.323268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:52 smithi163 bash[24253]: cluster 2024-08-31T07:55:51.348802+0000 mgr.a (mgr.14388) 14902 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:52 smithi027 bash[22610]: audit 2024-08-31T07:55:51.172099+0000 mgr.a (mgr.14388) 14901 : audit [DBG] from='client.323268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:52 smithi027 bash[22610]: cluster 2024-08-31T07:55:51.348802+0000 mgr.a (mgr.14388) 14902 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:52 smithi191 bash[24992]: audit 2024-08-31T07:55:51.172099+0000 mgr.a (mgr.14388) 14901 : audit [DBG] from='client.323268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:52 smithi191 bash[24992]: cluster 2024-08-31T07:55:51.348802+0000 mgr.a (mgr.14388) 14902 : cluster [DBG] pgmap v10330: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:54 smithi163 bash[24253]: cluster 2024-08-31T07:55:53.351038+0000 mgr.a (mgr.14388) 14903 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:54 smithi027 bash[22610]: cluster 2024-08-31T07:55:53.351038+0000 mgr.a (mgr.14388) 14903 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:54 smithi191 bash[24992]: cluster 2024-08-31T07:55:53.351038+0000 mgr.a (mgr.14388) 14903 : cluster [DBG] pgmap v10331: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:55:56.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:55:56.615 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:55:56.615 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:55:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:56 smithi027 bash[22610]: cluster 2024-08-31T07:55:55.351804+0000 mgr.a (mgr.14388) 14904 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:56 smithi191 bash[24992]: cluster 2024-08-31T07:55:55.351804+0000 mgr.a (mgr.14388) 14904 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:56 smithi163 bash[24253]: cluster 2024-08-31T07:55:55.351804+0000 mgr.a (mgr.14388) 14904 : cluster [DBG] pgmap v10332: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:57.402 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:55:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:55:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:55:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:55:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:55:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:58 smithi027 bash[22610]: audit 2024-08-31T07:55:56.951775+0000 mgr.a (mgr.14388) 14905 : audit [DBG] from='client.323343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:55:58 smithi027 bash[22610]: cluster 2024-08-31T07:55:57.352528+0000 mgr.a (mgr.14388) 14906 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:58 smithi191 bash[24992]: audit 2024-08-31T07:55:56.951775+0000 mgr.a (mgr.14388) 14905 : audit [DBG] from='client.323343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:55:58 smithi191 bash[24992]: cluster 2024-08-31T07:55:57.352528+0000 mgr.a (mgr.14388) 14906 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:55:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:58 smithi163 bash[24253]: audit 2024-08-31T07:55:56.951775+0000 mgr.a (mgr.14388) 14905 : audit [DBG] from='client.323343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:55:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:55:58 smithi163 bash[24253]: cluster 2024-08-31T07:55:57.352528+0000 mgr.a (mgr.14388) 14906 : cluster [DBG] pgmap v10333: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:00 smithi027 bash[22610]: cluster 2024-08-31T07:55:59.354790+0000 mgr.a (mgr.14388) 14907 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:00 smithi191 bash[24992]: cluster 2024-08-31T07:55:59.354790+0000 mgr.a (mgr.14388) 14907 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:00 smithi163 bash[24253]: cluster 2024-08-31T07:55:59.354790+0000 mgr.a (mgr.14388) 14907 : cluster [DBG] pgmap v10334: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:02.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:56:02.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:56:02.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:56:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:02 smithi027 bash[22610]: cluster 2024-08-31T07:56:01.355563+0000 mgr.a (mgr.14388) 14908 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:02 smithi191 bash[24992]: cluster 2024-08-31T07:56:01.355563+0000 mgr.a (mgr.14388) 14908 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:02 smithi163 bash[24253]: cluster 2024-08-31T07:56:01.355563+0000 mgr.a (mgr.14388) 14908 : cluster [DBG] pgmap v10335: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:03.193 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:56:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:56:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:56:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:56:03.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:56:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:04 smithi027 bash[22610]: audit 2024-08-31T07:56:02.739652+0000 mgr.a (mgr.14388) 14909 : audit [DBG] from='client.323421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:04.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:04 smithi027 bash[22610]: cluster 2024-08-31T07:56:03.358432+0000 mgr.a (mgr.14388) 14910 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:56:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:04 smithi191 bash[24992]: audit 2024-08-31T07:56:02.739652+0000 mgr.a (mgr.14388) 14909 : audit [DBG] from='client.323421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:04 smithi191 bash[24992]: cluster 2024-08-31T07:56:03.358432+0000 mgr.a (mgr.14388) 14910 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:56:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:04 smithi163 bash[24253]: audit 2024-08-31T07:56:02.739652+0000 mgr.a (mgr.14388) 14909 : audit [DBG] from='client.323421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:04 smithi163 bash[24253]: cluster 2024-08-31T07:56:03.358432+0000 mgr.a (mgr.14388) 14910 : cluster [DBG] pgmap v10336: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:56:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:06 smithi027 bash[22610]: cluster 2024-08-31T07:56:05.359391+0000 mgr.a (mgr.14388) 14911 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:56:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:06 smithi191 bash[24992]: cluster 2024-08-31T07:56:05.359391+0000 mgr.a (mgr.14388) 14911 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:56:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:06 smithi163 bash[24253]: cluster 2024-08-31T07:56:05.359391+0000 mgr.a (mgr.14388) 14911 : cluster [DBG] pgmap v10337: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:56:08.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:56:08.195 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:56:08.195 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:56:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:08 smithi027 bash[22610]: cluster 2024-08-31T07:56:07.360341+0000 mgr.a (mgr.14388) 14912 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:56:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:08 smithi191 bash[24992]: cluster 2024-08-31T07:56:07.360341+0000 mgr.a (mgr.14388) 14912 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:56:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:08 smithi163 bash[24253]: cluster 2024-08-31T07:56:07.360341+0000 mgr.a (mgr.14388) 14912 : cluster [DBG] pgmap v10338: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:56:08.950 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:56:08.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:56:08.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:56:08.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:56:08.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:56:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:10 smithi027 bash[22610]: audit 2024-08-31T07:56:08.528503+0000 mgr.a (mgr.14388) 14913 : audit [DBG] from='client.323493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:10.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:10 smithi027 bash[22610]: cluster 2024-08-31T07:56:09.363099+0000 mgr.a (mgr.14388) 14914 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:10 smithi191 bash[24992]: audit 2024-08-31T07:56:08.528503+0000 mgr.a (mgr.14388) 14913 : audit [DBG] from='client.323493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:10 smithi191 bash[24992]: cluster 2024-08-31T07:56:09.363099+0000 mgr.a (mgr.14388) 14914 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:10 smithi163 bash[24253]: audit 2024-08-31T07:56:08.528503+0000 mgr.a (mgr.14388) 14913 : audit [DBG] from='client.323493 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:10 smithi163 bash[24253]: cluster 2024-08-31T07:56:09.363099+0000 mgr.a (mgr.14388) 14914 : cluster [DBG] pgmap v10339: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:12 smithi191 bash[24992]: cluster 2024-08-31T07:56:11.363864+0000 mgr.a (mgr.14388) 14915 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:56:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:12 smithi163 bash[24253]: cluster 2024-08-31T07:56:11.363864+0000 mgr.a (mgr.14388) 14915 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:56:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:12 smithi027 bash[22610]: cluster 2024-08-31T07:56:11.363864+0000 mgr.a (mgr.14388) 14915 : cluster [DBG] pgmap v10340: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:56:13.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:56:13.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:56:13.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:56:14.702 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:56:14.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:56:14.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:56:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:56:14.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:56:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:14 smithi191 bash[24992]: cluster 2024-08-31T07:56:13.365787+0000 mgr.a (mgr.14388) 14916 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:14 smithi163 bash[24253]: cluster 2024-08-31T07:56:13.365787+0000 mgr.a (mgr.14388) 14916 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:14 smithi027 bash[22610]: cluster 2024-08-31T07:56:13.365787+0000 mgr.a (mgr.14388) 14916 : cluster [DBG] pgmap v10341: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:15 smithi191 bash[24992]: audit 2024-08-31T07:56:14.282672+0000 mgr.a (mgr.14388) 14917 : audit [DBG] from='client.323568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:15 smithi163 bash[24253]: audit 2024-08-31T07:56:14.282672+0000 mgr.a (mgr.14388) 14917 : audit [DBG] from='client.323568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:15 smithi027 bash[22610]: audit 2024-08-31T07:56:14.282672+0000 mgr.a (mgr.14388) 14917 : audit [DBG] from='client.323568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:16 smithi191 bash[24992]: cluster 2024-08-31T07:56:15.366665+0000 mgr.a (mgr.14388) 14918 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:56:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:16 smithi163 bash[24253]: cluster 2024-08-31T07:56:15.366665+0000 mgr.a (mgr.14388) 14918 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:56:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:16 smithi027 bash[22610]: cluster 2024-08-31T07:56:15.366665+0000 mgr.a (mgr.14388) 14918 : cluster [DBG] pgmap v10342: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:56:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:18 smithi191 bash[24992]: cluster 2024-08-31T07:56:17.367478+0000 mgr.a (mgr.14388) 14919 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:56:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:18 smithi163 bash[24253]: cluster 2024-08-31T07:56:17.367478+0000 mgr.a (mgr.14388) 14919 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:56:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:18 smithi027 bash[22610]: cluster 2024-08-31T07:56:17.367478+0000 mgr.a (mgr.14388) 14919 : cluster [DBG] pgmap v10343: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:56:19.704 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:56:19.704 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:56:19.706 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:56:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:19 smithi163 bash[24253]: cluster 2024-08-31T07:56:19.369664+0000 mgr.a (mgr.14388) 14920 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:56:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:19 smithi027 bash[22610]: cluster 2024-08-31T07:56:19.369664+0000 mgr.a (mgr.14388) 14920 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:56:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:19 smithi191 bash[24992]: cluster 2024-08-31T07:56:19.369664+0000 mgr.a (mgr.14388) 14920 : cluster [DBG] pgmap v10344: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:56:20.480 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:56:20.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:56:20.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:56:20.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:56:20.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:56:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:20 smithi163 bash[24253]: audit 2024-08-31T07:56:20.039042+0000 mgr.a (mgr.14388) 14921 : audit [DBG] from='client.323643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:20 smithi027 bash[22610]: audit 2024-08-31T07:56:20.039042+0000 mgr.a (mgr.14388) 14921 : audit [DBG] from='client.323643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:20 smithi191 bash[24992]: audit 2024-08-31T07:56:20.039042+0000 mgr.a (mgr.14388) 14921 : audit [DBG] from='client.323643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:21 smithi163 bash[24253]: cluster 2024-08-31T07:56:21.370594+0000 mgr.a (mgr.14388) 14922 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:21 smithi027 bash[22610]: cluster 2024-08-31T07:56:21.370594+0000 mgr.a (mgr.14388) 14922 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:21 smithi191 bash[24992]: cluster 2024-08-31T07:56:21.370594+0000 mgr.a (mgr.14388) 14922 : cluster [DBG] pgmap v10345: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:24 smithi163 bash[24253]: cluster 2024-08-31T07:56:23.372729+0000 mgr.a (mgr.14388) 14923 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:24 smithi027 bash[22610]: cluster 2024-08-31T07:56:23.372729+0000 mgr.a (mgr.14388) 14923 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:24 smithi191 bash[24992]: cluster 2024-08-31T07:56:23.372729+0000 mgr.a (mgr.14388) 14923 : cluster [DBG] pgmap v10346: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:25.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:56:25.482 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:56:25.482 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:56:26.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:56:26.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:56:26.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:56:26.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:56:26.227 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:56:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:26 smithi163 bash[24253]: cluster 2024-08-31T07:56:25.373490+0000 mgr.a (mgr.14388) 14924 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:26 smithi027 bash[22610]: cluster 2024-08-31T07:56:25.373490+0000 mgr.a (mgr.14388) 14924 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:26 smithi191 bash[24992]: cluster 2024-08-31T07:56:25.373490+0000 mgr.a (mgr.14388) 14924 : cluster [DBG] pgmap v10347: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:27 smithi163 bash[24253]: audit 2024-08-31T07:56:25.814423+0000 mgr.a (mgr.14388) 14925 : audit [DBG] from='client.323718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:27 smithi027 bash[22610]: audit 2024-08-31T07:56:25.814423+0000 mgr.a (mgr.14388) 14925 : audit [DBG] from='client.323718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:27 smithi191 bash[24992]: audit 2024-08-31T07:56:25.814423+0000 mgr.a (mgr.14388) 14925 : audit [DBG] from='client.323718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:28 smithi163 bash[24253]: cluster 2024-08-31T07:56:27.374393+0000 mgr.a (mgr.14388) 14926 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:28 smithi027 bash[22610]: cluster 2024-08-31T07:56:27.374393+0000 mgr.a (mgr.14388) 14926 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:28 smithi191 bash[24992]: cluster 2024-08-31T07:56:27.374393+0000 mgr.a (mgr.14388) 14926 : cluster [DBG] pgmap v10348: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:30 smithi163 bash[24253]: cluster 2024-08-31T07:56:29.376635+0000 mgr.a (mgr.14388) 14927 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:30 smithi027 bash[22610]: cluster 2024-08-31T07:56:29.376635+0000 mgr.a (mgr.14388) 14927 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:30 smithi191 bash[24992]: cluster 2024-08-31T07:56:29.376635+0000 mgr.a (mgr.14388) 14927 : cluster [DBG] pgmap v10349: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:31.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:56:31.229 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:56:31.229 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:56:31.986 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:56:31.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:56:31.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:56:31.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:56:31.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:56:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:32 smithi027 bash[22610]: cluster 2024-08-31T07:56:31.377207+0000 mgr.a (mgr.14388) 14928 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:32 smithi191 bash[24992]: cluster 2024-08-31T07:56:31.377207+0000 mgr.a (mgr.14388) 14928 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:32 smithi163 bash[24253]: cluster 2024-08-31T07:56:31.377207+0000 mgr.a (mgr.14388) 14928 : cluster [DBG] pgmap v10350: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:33 smithi027 bash[22610]: audit 2024-08-31T07:56:31.558372+0000 mgr.a (mgr.14388) 14929 : audit [DBG] from='client.323796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:33 smithi191 bash[24992]: audit 2024-08-31T07:56:31.558372+0000 mgr.a (mgr.14388) 14929 : audit [DBG] from='client.323796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:33 smithi163 bash[24253]: audit 2024-08-31T07:56:31.558372+0000 mgr.a (mgr.14388) 14929 : audit [DBG] from='client.323796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:34 smithi027 bash[22610]: cluster 2024-08-31T07:56:33.379406+0000 mgr.a (mgr.14388) 14930 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:34 smithi027 bash[22610]: audit 2024-08-31T07:56:33.692851+0000 mon.a (mon.0) 2806 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:56:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:34 smithi191 bash[24992]: cluster 2024-08-31T07:56:33.379406+0000 mgr.a (mgr.14388) 14930 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:34 smithi191 bash[24992]: audit 2024-08-31T07:56:33.692851+0000 mon.a (mon.0) 2806 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:56:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:34 smithi163 bash[24253]: cluster 2024-08-31T07:56:33.379406+0000 mgr.a (mgr.14388) 14930 : cluster [DBG] pgmap v10351: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:56:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:34 smithi163 bash[24253]: audit 2024-08-31T07:56:33.692851+0000 mon.a (mon.0) 2806 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:56:35.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:56:35 smithi027 bash[22863]: debug 2024-08-31T07:56:35.273+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:56:35.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:56:35 smithi027 bash[22863]: debug 2024-08-31T07:56:35.273+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:56:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:35 smithi027 bash[22610]: audit 2024-08-31T07:56:34.524623+0000 mon.a (mon.0) 2807 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:56:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:35 smithi027 bash[22610]: audit 2024-08-31T07:56:34.526256+0000 mon.a (mon.0) 2808 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:56:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:35 smithi027 bash[22610]: audit 2024-08-31T07:56:34.536834+0000 mon.a (mon.0) 2809 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:56:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:35 smithi027 bash[22610]: audit 2024-08-31T07:56:34.541463+0000 mon.a (mon.0) 2810 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:56:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:35 smithi191 bash[24992]: audit 2024-08-31T07:56:34.524623+0000 mon.a (mon.0) 2807 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:56:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:35 smithi191 bash[24992]: audit 2024-08-31T07:56:34.526256+0000 mon.a (mon.0) 2808 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:56:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:35 smithi191 bash[24992]: audit 2024-08-31T07:56:34.536834+0000 mon.a (mon.0) 2809 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:56:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:35 smithi191 bash[24992]: audit 2024-08-31T07:56:34.541463+0000 mon.a (mon.0) 2810 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:56:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:35 smithi163 bash[24253]: audit 2024-08-31T07:56:34.524623+0000 mon.a (mon.0) 2807 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:56:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:35 smithi163 bash[24253]: audit 2024-08-31T07:56:34.526256+0000 mon.a (mon.0) 2808 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:56:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:35 smithi163 bash[24253]: audit 2024-08-31T07:56:34.536834+0000 mon.a (mon.0) 2809 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:56:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:35 smithi163 bash[24253]: audit 2024-08-31T07:56:34.541463+0000 mon.a (mon.0) 2810 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:56:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:36 smithi027 bash[22610]: audit 2024-08-31T07:56:34.543770+0000 mgr.a (mgr.14388) 14931 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:56:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:36 smithi027 bash[22610]: audit 2024-08-31T07:56:35.275480+0000 mgr.a (mgr.14388) 14932 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:56:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:36 smithi027 bash[22610]: cephadm 2024-08-31T07:56:35.276642+0000 mgr.a (mgr.14388) 14933 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:56:36.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:36 smithi027 bash[22610]: cluster 2024-08-31T07:56:35.380233+0000 mgr.a (mgr.14388) 14934 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:36 smithi191 bash[24992]: audit 2024-08-31T07:56:34.543770+0000 mgr.a (mgr.14388) 14931 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:56:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:36 smithi191 bash[24992]: audit 2024-08-31T07:56:35.275480+0000 mgr.a (mgr.14388) 14932 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:56:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:36 smithi191 bash[24992]: cephadm 2024-08-31T07:56:35.276642+0000 mgr.a (mgr.14388) 14933 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:56:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:36 smithi191 bash[24992]: cluster 2024-08-31T07:56:35.380233+0000 mgr.a (mgr.14388) 14934 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:36 smithi163 bash[24253]: audit 2024-08-31T07:56:34.543770+0000 mgr.a (mgr.14388) 14931 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:56:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:36 smithi163 bash[24253]: audit 2024-08-31T07:56:35.275480+0000 mgr.a (mgr.14388) 14932 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:56:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:36 smithi163 bash[24253]: cephadm 2024-08-31T07:56:35.276642+0000 mgr.a (mgr.14388) 14933 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:56:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:36 smithi163 bash[24253]: cluster 2024-08-31T07:56:35.380233+0000 mgr.a (mgr.14388) 14934 : cluster [DBG] pgmap v10352: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:36.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:56:36.988 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:56:36.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:56:37.734 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:56:37.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:56:37.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:56:37.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:56:37.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:56:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:38 smithi027 bash[22610]: audit 2024-08-31T07:56:37.316150+0000 mgr.a (mgr.14388) 14935 : audit [DBG] from='client.323979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:38 smithi027 bash[22610]: cluster 2024-08-31T07:56:37.380771+0000 mgr.a (mgr.14388) 14936 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:38 smithi191 bash[24992]: audit 2024-08-31T07:56:37.316150+0000 mgr.a (mgr.14388) 14935 : audit [DBG] from='client.323979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:38 smithi191 bash[24992]: cluster 2024-08-31T07:56:37.380771+0000 mgr.a (mgr.14388) 14936 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:38 smithi163 bash[24253]: audit 2024-08-31T07:56:37.316150+0000 mgr.a (mgr.14388) 14935 : audit [DBG] from='client.323979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:38 smithi163 bash[24253]: cluster 2024-08-31T07:56:37.380771+0000 mgr.a (mgr.14388) 14936 : cluster [DBG] pgmap v10353: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:40 smithi027 bash[22610]: cluster 2024-08-31T07:56:39.383086+0000 mgr.a (mgr.14388) 14937 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:40 smithi191 bash[24992]: cluster 2024-08-31T07:56:39.383086+0000 mgr.a (mgr.14388) 14937 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:40 smithi163 bash[24253]: cluster 2024-08-31T07:56:39.383086+0000 mgr.a (mgr.14388) 14937 : cluster [DBG] pgmap v10354: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:42.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:42 smithi027 bash[22610]: cluster 2024-08-31T07:56:41.383806+0000 mgr.a (mgr.14388) 14938 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:42.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:56:42.737 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:56:42.737 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:56:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:42 smithi191 bash[24992]: cluster 2024-08-31T07:56:41.383806+0000 mgr.a (mgr.14388) 14938 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:42 smithi163 bash[24253]: cluster 2024-08-31T07:56:41.383806+0000 mgr.a (mgr.14388) 14938 : cluster [DBG] pgmap v10355: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:56:43.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:56:43.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:56:43.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:56:43.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:56:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:44 smithi191 bash[24992]: audit 2024-08-31T07:56:43.075457+0000 mgr.a (mgr.14388) 14939 : audit [DBG] from='client.324054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:44 smithi191 bash[24992]: cluster 2024-08-31T07:56:43.385402+0000 mgr.a (mgr.14388) 14940 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:44 smithi163 bash[24253]: audit 2024-08-31T07:56:43.075457+0000 mgr.a (mgr.14388) 14939 : audit [DBG] from='client.324054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:44 smithi163 bash[24253]: cluster 2024-08-31T07:56:43.385402+0000 mgr.a (mgr.14388) 14940 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:44 smithi027 bash[22610]: audit 2024-08-31T07:56:43.075457+0000 mgr.a (mgr.14388) 14939 : audit [DBG] from='client.324054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:44.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:44 smithi027 bash[22610]: cluster 2024-08-31T07:56:43.385402+0000 mgr.a (mgr.14388) 14940 : cluster [DBG] pgmap v10356: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:46 smithi191 bash[24992]: cluster 2024-08-31T07:56:45.386266+0000 mgr.a (mgr.14388) 14941 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:56:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:46 smithi163 bash[24253]: cluster 2024-08-31T07:56:45.386266+0000 mgr.a (mgr.14388) 14941 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:56:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:46 smithi027 bash[22610]: cluster 2024-08-31T07:56:45.386266+0000 mgr.a (mgr.14388) 14941 : cluster [DBG] pgmap v10357: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:56:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:56:48.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:56:48.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:56:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:48 smithi191 bash[24992]: cluster 2024-08-31T07:56:47.387077+0000 mgr.a (mgr.14388) 14942 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:56:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:48 smithi163 bash[24253]: cluster 2024-08-31T07:56:47.387077+0000 mgr.a (mgr.14388) 14942 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:56:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:48 smithi027 bash[22610]: cluster 2024-08-31T07:56:47.387077+0000 mgr.a (mgr.14388) 14942 : cluster [DBG] pgmap v10358: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:56:49.260 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:56:49.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:56:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:56:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:56:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:56:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:50 smithi191 bash[24992]: audit 2024-08-31T07:56:48.849667+0000 mgr.a (mgr.14388) 14943 : audit [DBG] from='client.324132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:50 smithi191 bash[24992]: cluster 2024-08-31T07:56:49.389706+0000 mgr.a (mgr.14388) 14944 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:50 smithi163 bash[24253]: audit 2024-08-31T07:56:48.849667+0000 mgr.a (mgr.14388) 14943 : audit [DBG] from='client.324132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:50 smithi163 bash[24253]: cluster 2024-08-31T07:56:49.389706+0000 mgr.a (mgr.14388) 14944 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:50 smithi027 bash[22610]: audit 2024-08-31T07:56:48.849667+0000 mgr.a (mgr.14388) 14943 : audit [DBG] from='client.324132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:50 smithi027 bash[22610]: cluster 2024-08-31T07:56:49.389706+0000 mgr.a (mgr.14388) 14944 : cluster [DBG] pgmap v10359: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:56:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:52 smithi191 bash[24992]: cluster 2024-08-31T07:56:51.390436+0000 mgr.a (mgr.14388) 14945 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:56:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:52 smithi163 bash[24253]: cluster 2024-08-31T07:56:51.390436+0000 mgr.a (mgr.14388) 14945 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:56:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:52 smithi027 bash[22610]: cluster 2024-08-31T07:56:51.390436+0000 mgr.a (mgr.14388) 14945 : cluster [DBG] pgmap v10360: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:56:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:53 smithi163 bash[24253]: cluster 2024-08-31T07:56:53.392565+0000 mgr.a (mgr.14388) 14946 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:53.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:53 smithi027 bash[22610]: cluster 2024-08-31T07:56:53.392565+0000 mgr.a (mgr.14388) 14946 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:53 smithi191 bash[24992]: cluster 2024-08-31T07:56:53.392565+0000 mgr.a (mgr.14388) 14946 : cluster [DBG] pgmap v10361: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:54.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:56:54.262 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:56:54.262 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:56:55.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:56:55.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:56:55.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:56:55.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:56:55.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:56:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:56 smithi027 bash[22610]: audit 2024-08-31T07:56:54.589634+0000 mgr.a (mgr.14388) 14947 : audit [DBG] from='client.324207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:56 smithi027 bash[22610]: cluster 2024-08-31T07:56:55.393446+0000 mgr.a (mgr.14388) 14948 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:56 smithi191 bash[24992]: audit 2024-08-31T07:56:54.589634+0000 mgr.a (mgr.14388) 14947 : audit [DBG] from='client.324207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:56 smithi191 bash[24992]: cluster 2024-08-31T07:56:55.393446+0000 mgr.a (mgr.14388) 14948 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:56 smithi163 bash[24253]: audit 2024-08-31T07:56:54.589634+0000 mgr.a (mgr.14388) 14947 : audit [DBG] from='client.324207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:56:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:56 smithi163 bash[24253]: cluster 2024-08-31T07:56:55.393446+0000 mgr.a (mgr.14388) 14948 : cluster [DBG] pgmap v10362: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:56:58 smithi027 bash[22610]: cluster 2024-08-31T07:56:57.394262+0000 mgr.a (mgr.14388) 14949 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:56:58 smithi191 bash[24992]: cluster 2024-08-31T07:56:57.394262+0000 mgr.a (mgr.14388) 14949 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:56:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:56:58 smithi163 bash[24253]: cluster 2024-08-31T07:56:57.394262+0000 mgr.a (mgr.14388) 14949 : cluster [DBG] pgmap v10363: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:00.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:00.012 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:00.012 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:00 smithi027 bash[22610]: cluster 2024-08-31T07:56:59.396470+0000 mgr.a (mgr.14388) 14950 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:00.762 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:00.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:00 smithi191 bash[24992]: cluster 2024-08-31T07:56:59.396470+0000 mgr.a (mgr.14388) 14950 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:00 smithi163 bash[24253]: cluster 2024-08-31T07:56:59.396470+0000 mgr.a (mgr.14388) 14950 : cluster [DBG] pgmap v10364: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:01 smithi027 bash[22610]: audit 2024-08-31T07:57:00.345393+0000 mgr.a (mgr.14388) 14951 : audit [DBG] from='client.324282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:01 smithi191 bash[24992]: audit 2024-08-31T07:57:00.345393+0000 mgr.a (mgr.14388) 14951 : audit [DBG] from='client.324282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:01 smithi163 bash[24253]: audit 2024-08-31T07:57:00.345393+0000 mgr.a (mgr.14388) 14951 : audit [DBG] from='client.324282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:02 smithi027 bash[22610]: cluster 2024-08-31T07:57:01.397459+0000 mgr.a (mgr.14388) 14952 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:02 smithi191 bash[24992]: cluster 2024-08-31T07:57:01.397459+0000 mgr.a (mgr.14388) 14952 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:02 smithi163 bash[24253]: cluster 2024-08-31T07:57:01.397459+0000 mgr.a (mgr.14388) 14952 : cluster [DBG] pgmap v10365: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:04 smithi027 bash[22610]: cluster 2024-08-31T07:57:03.399695+0000 mgr.a (mgr.14388) 14953 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:04 smithi191 bash[24992]: cluster 2024-08-31T07:57:03.399695+0000 mgr.a (mgr.14388) 14953 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:04 smithi163 bash[24253]: cluster 2024-08-31T07:57:03.399695+0000 mgr.a (mgr.14388) 14953 : cluster [DBG] pgmap v10366: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:05.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:05.764 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:06.549 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:06.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:06 smithi027 bash[22610]: cluster 2024-08-31T07:57:05.400431+0000 mgr.a (mgr.14388) 14954 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:06 smithi191 bash[24992]: cluster 2024-08-31T07:57:05.400431+0000 mgr.a (mgr.14388) 14954 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:06 smithi163 bash[24253]: cluster 2024-08-31T07:57:05.400431+0000 mgr.a (mgr.14388) 14954 : cluster [DBG] pgmap v10367: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:07 smithi027 bash[22610]: audit 2024-08-31T07:57:06.101034+0000 mgr.a (mgr.14388) 14955 : audit [DBG] from='client.324360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:07 smithi191 bash[24992]: audit 2024-08-31T07:57:06.101034+0000 mgr.a (mgr.14388) 14955 : audit [DBG] from='client.324360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:07 smithi163 bash[24253]: audit 2024-08-31T07:57:06.101034+0000 mgr.a (mgr.14388) 14955 : audit [DBG] from='client.324360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:08 smithi191 bash[24992]: cluster 2024-08-31T07:57:07.401355+0000 mgr.a (mgr.14388) 14956 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:08 smithi163 bash[24253]: cluster 2024-08-31T07:57:07.401355+0000 mgr.a (mgr.14388) 14956 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:08 smithi027 bash[22610]: cluster 2024-08-31T07:57:07.401355+0000 mgr.a (mgr.14388) 14956 : cluster [DBG] pgmap v10368: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:10 smithi191 bash[24992]: cluster 2024-08-31T07:57:09.403837+0000 mgr.a (mgr.14388) 14957 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:10 smithi163 bash[24253]: cluster 2024-08-31T07:57:09.403837+0000 mgr.a (mgr.14388) 14957 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:10 smithi027 bash[22610]: cluster 2024-08-31T07:57:09.403837+0000 mgr.a (mgr.14388) 14957 : cluster [DBG] pgmap v10369: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:11.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:11.551 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:11.551 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:12.325 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:12.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:12.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:12.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:12.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:12 smithi191 bash[24992]: cluster 2024-08-31T07:57:11.404640+0000 mgr.a (mgr.14388) 14958 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:12 smithi163 bash[24253]: cluster 2024-08-31T07:57:11.404640+0000 mgr.a (mgr.14388) 14958 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:12 smithi027 bash[22610]: cluster 2024-08-31T07:57:11.404640+0000 mgr.a (mgr.14388) 14958 : cluster [DBG] pgmap v10370: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:13 smithi191 bash[24992]: audit 2024-08-31T07:57:11.888369+0000 mgr.a (mgr.14388) 14959 : audit [DBG] from='client.324438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:13 smithi163 bash[24253]: audit 2024-08-31T07:57:11.888369+0000 mgr.a (mgr.14388) 14959 : audit [DBG] from='client.324438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:13 smithi027 bash[22610]: audit 2024-08-31T07:57:11.888369+0000 mgr.a (mgr.14388) 14959 : audit [DBG] from='client.324438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:14 smithi191 bash[24992]: cluster 2024-08-31T07:57:13.407095+0000 mgr.a (mgr.14388) 14960 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:14 smithi163 bash[24253]: cluster 2024-08-31T07:57:13.407095+0000 mgr.a (mgr.14388) 14960 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:14 smithi027 bash[22610]: cluster 2024-08-31T07:57:13.407095+0000 mgr.a (mgr.14388) 14960 : cluster [DBG] pgmap v10371: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:15 smithi191 bash[24992]: cluster 2024-08-31T07:57:15.407936+0000 mgr.a (mgr.14388) 14961 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:15 smithi163 bash[24253]: cluster 2024-08-31T07:57:15.407936+0000 mgr.a (mgr.14388) 14961 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:15 smithi027 bash[22610]: cluster 2024-08-31T07:57:15.407936+0000 mgr.a (mgr.14388) 14961 : cluster [DBG] pgmap v10372: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:17.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:17.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:17.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:18.078 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:18.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:18.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:18 smithi027 bash[22610]: cluster 2024-08-31T07:57:17.408662+0000 mgr.a (mgr.14388) 14962 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:18 smithi191 bash[24992]: cluster 2024-08-31T07:57:17.408662+0000 mgr.a (mgr.14388) 14962 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:18 smithi163 bash[24253]: cluster 2024-08-31T07:57:17.408662+0000 mgr.a (mgr.14388) 14962 : cluster [DBG] pgmap v10373: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:19 smithi027 bash[22610]: audit 2024-08-31T07:57:17.660337+0000 mgr.a (mgr.14388) 14963 : audit [DBG] from='client.324516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:19 smithi191 bash[24992]: audit 2024-08-31T07:57:17.660337+0000 mgr.a (mgr.14388) 14963 : audit [DBG] from='client.324516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:19 smithi163 bash[24253]: audit 2024-08-31T07:57:17.660337+0000 mgr.a (mgr.14388) 14963 : audit [DBG] from='client.324516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:20 smithi027 bash[22610]: cluster 2024-08-31T07:57:19.411222+0000 mgr.a (mgr.14388) 14964 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:57:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:20 smithi191 bash[24992]: cluster 2024-08-31T07:57:19.411222+0000 mgr.a (mgr.14388) 14964 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:57:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:20 smithi163 bash[24253]: cluster 2024-08-31T07:57:19.411222+0000 mgr.a (mgr.14388) 14964 : cluster [DBG] pgmap v10374: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T07:57:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:22 smithi027 bash[22610]: cluster 2024-08-31T07:57:21.412148+0000 mgr.a (mgr.14388) 14965 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:57:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:22 smithi191 bash[24992]: cluster 2024-08-31T07:57:21.412148+0000 mgr.a (mgr.14388) 14965 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:57:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:22 smithi163 bash[24253]: cluster 2024-08-31T07:57:21.412148+0000 mgr.a (mgr.14388) 14965 : cluster [DBG] pgmap v10375: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T07:57:23.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:23.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:23.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:23.828 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:23.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:24 smithi191 bash[24992]: audit 2024-08-31T07:57:23.410809+0000 mgr.a (mgr.14388) 14966 : audit [DBG] from='client.324594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:24 smithi191 bash[24992]: cluster 2024-08-31T07:57:23.428940+0000 mgr.a (mgr.14388) 14967 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:24 smithi163 bash[24253]: audit 2024-08-31T07:57:23.410809+0000 mgr.a (mgr.14388) 14966 : audit [DBG] from='client.324594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:24 smithi163 bash[24253]: cluster 2024-08-31T07:57:23.428940+0000 mgr.a (mgr.14388) 14967 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:24 smithi027 bash[22610]: audit 2024-08-31T07:57:23.410809+0000 mgr.a (mgr.14388) 14966 : audit [DBG] from='client.324594 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:24.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:24 smithi027 bash[22610]: cluster 2024-08-31T07:57:23.428940+0000 mgr.a (mgr.14388) 14967 : cluster [DBG] pgmap v10376: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:26 smithi191 bash[24992]: cluster 2024-08-31T07:57:25.429992+0000 mgr.a (mgr.14388) 14968 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T07:57:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:26 smithi163 bash[24253]: cluster 2024-08-31T07:57:25.429992+0000 mgr.a (mgr.14388) 14968 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T07:57:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:26 smithi027 bash[22610]: cluster 2024-08-31T07:57:25.429992+0000 mgr.a (mgr.14388) 14968 : cluster [DBG] pgmap v10377: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T07:57:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:28 smithi191 bash[24992]: cluster 2024-08-31T07:57:27.430810+0000 mgr.a (mgr.14388) 14969 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T07:57:28.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:28.830 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:28.830 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:28 smithi163 bash[24253]: cluster 2024-08-31T07:57:27.430810+0000 mgr.a (mgr.14388) 14969 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T07:57:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:28 smithi027 bash[22610]: cluster 2024-08-31T07:57:27.430810+0000 mgr.a (mgr.14388) 14969 : cluster [DBG] pgmap v10378: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 936 B/s rd, 0 op/s 2024-08-31T07:57:29.606 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:29.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:29.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:29.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:29.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:30 smithi191 bash[24992]: audit 2024-08-31T07:57:29.163069+0000 mgr.a (mgr.14388) 14970 : audit [DBG] from='client.324672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:30 smithi191 bash[24992]: cluster 2024-08-31T07:57:29.432137+0000 mgr.a (mgr.14388) 14971 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:30 smithi163 bash[24253]: audit 2024-08-31T07:57:29.163069+0000 mgr.a (mgr.14388) 14970 : audit [DBG] from='client.324672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:30 smithi163 bash[24253]: cluster 2024-08-31T07:57:29.432137+0000 mgr.a (mgr.14388) 14971 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:30 smithi027 bash[22610]: audit 2024-08-31T07:57:29.163069+0000 mgr.a (mgr.14388) 14970 : audit [DBG] from='client.324672 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:30 smithi027 bash[22610]: cluster 2024-08-31T07:57:29.432137+0000 mgr.a (mgr.14388) 14971 : cluster [DBG] pgmap v10379: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:32 smithi191 bash[24992]: cluster 2024-08-31T07:57:31.433027+0000 mgr.a (mgr.14388) 14972 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:57:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:32 smithi163 bash[24253]: cluster 2024-08-31T07:57:31.433027+0000 mgr.a (mgr.14388) 14972 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:57:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:32 smithi027 bash[22610]: cluster 2024-08-31T07:57:31.433027+0000 mgr.a (mgr.14388) 14972 : cluster [DBG] pgmap v10380: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T07:57:34.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:34.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:34.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:34 smithi191 bash[24992]: cluster 2024-08-31T07:57:33.435261+0000 mgr.a (mgr.14388) 14973 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:57:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:34 smithi163 bash[24253]: cluster 2024-08-31T07:57:33.435261+0000 mgr.a (mgr.14388) 14973 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:57:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:34 smithi027 bash[22610]: cluster 2024-08-31T07:57:33.435261+0000 mgr.a (mgr.14388) 14973 : cluster [DBG] pgmap v10381: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T07:57:35.391 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:35.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:35.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:35.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:35.391 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:35 smithi191 bash[24992]: audit 2024-08-31T07:57:35.327081+0000 mon.a (mon.0) 2811 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:57:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:35 smithi163 bash[24253]: audit 2024-08-31T07:57:35.327081+0000 mon.a (mon.0) 2811 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:57:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:35 smithi027 bash[22610]: audit 2024-08-31T07:57:35.327081+0000 mon.a (mon.0) 2811 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:57:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:36 smithi191 bash[24992]: audit 2024-08-31T07:57:34.945827+0000 mgr.a (mgr.14388) 14974 : audit [DBG] from='client.324747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:36 smithi191 bash[24992]: cluster 2024-08-31T07:57:35.435788+0000 mgr.a (mgr.14388) 14975 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:36 smithi191 bash[24992]: audit 2024-08-31T07:57:36.088946+0000 mon.a (mon.0) 2812 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:57:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:36 smithi191 bash[24992]: audit 2024-08-31T07:57:36.090683+0000 mon.a (mon.0) 2813 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:57:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:36 smithi191 bash[24992]: audit 2024-08-31T07:57:36.102500+0000 mon.a (mon.0) 2814 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:57:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:36 smithi191 bash[24992]: audit 2024-08-31T07:57:36.104995+0000 mon.a (mon.0) 2815 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:57:36.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:36 smithi191 bash[24992]: audit 2024-08-31T07:57:36.106116+0000 mgr.a (mgr.14388) 14976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:57:36.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:36 smithi027 bash[22610]: audit 2024-08-31T07:57:34.945827+0000 mgr.a (mgr.14388) 14974 : audit [DBG] from='client.324747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:36.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:36 smithi027 bash[22610]: cluster 2024-08-31T07:57:35.435788+0000 mgr.a (mgr.14388) 14975 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:36.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:36 smithi027 bash[22610]: audit 2024-08-31T07:57:36.088946+0000 mon.a (mon.0) 2812 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:57:36.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:36 smithi027 bash[22610]: audit 2024-08-31T07:57:36.090683+0000 mon.a (mon.0) 2813 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:57:36.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:36 smithi027 bash[22610]: audit 2024-08-31T07:57:36.102500+0000 mon.a (mon.0) 2814 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:57:36.858 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:36 smithi027 bash[22610]: audit 2024-08-31T07:57:36.104995+0000 mon.a (mon.0) 2815 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:57:36.859 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:36 smithi027 bash[22610]: audit 2024-08-31T07:57:36.106116+0000 mgr.a (mgr.14388) 14976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:57:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:36 smithi163 bash[24253]: audit 2024-08-31T07:57:34.945827+0000 mgr.a (mgr.14388) 14974 : audit [DBG] from='client.324747 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:36 smithi163 bash[24253]: cluster 2024-08-31T07:57:35.435788+0000 mgr.a (mgr.14388) 14975 : cluster [DBG] pgmap v10382: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:36 smithi163 bash[24253]: audit 2024-08-31T07:57:36.088946+0000 mon.a (mon.0) 2812 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:57:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:36 smithi163 bash[24253]: audit 2024-08-31T07:57:36.090683+0000 mon.a (mon.0) 2813 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:57:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:36 smithi163 bash[24253]: audit 2024-08-31T07:57:36.102500+0000 mon.a (mon.0) 2814 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:57:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:36 smithi163 bash[24253]: audit 2024-08-31T07:57:36.104995+0000 mon.a (mon.0) 2815 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:57:36.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:36 smithi163 bash[24253]: audit 2024-08-31T07:57:36.106116+0000 mgr.a (mgr.14388) 14976 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:57:37.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:57:36 smithi027 bash[22863]: debug 2024-08-31T07:57:36.852+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:57:37.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:57:36 smithi027 bash[22863]: debug 2024-08-31T07:57:36.856+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:57:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:37 smithi191 bash[24992]: audit 2024-08-31T07:57:36.857868+0000 mgr.a (mgr.14388) 14977 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:57:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:37 smithi191 bash[24992]: cephadm 2024-08-31T07:57:36.859219+0000 mgr.a (mgr.14388) 14978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:57:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:37 smithi191 bash[24992]: cluster 2024-08-31T07:57:37.436727+0000 mgr.a (mgr.14388) 14979 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:37 smithi163 bash[24253]: audit 2024-08-31T07:57:36.857868+0000 mgr.a (mgr.14388) 14977 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:57:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:37 smithi163 bash[24253]: cephadm 2024-08-31T07:57:36.859219+0000 mgr.a (mgr.14388) 14978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:57:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:37 smithi163 bash[24253]: cluster 2024-08-31T07:57:37.436727+0000 mgr.a (mgr.14388) 14979 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:37 smithi027 bash[22610]: audit 2024-08-31T07:57:36.857868+0000 mgr.a (mgr.14388) 14977 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:57:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:37 smithi027 bash[22610]: cephadm 2024-08-31T07:57:36.859219+0000 mgr.a (mgr.14388) 14978 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:57:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:37 smithi027 bash[22610]: cluster 2024-08-31T07:57:37.436727+0000 mgr.a (mgr.14388) 14979 : cluster [DBG] pgmap v10383: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:40.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:40.393 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:40.393 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:40 smithi191 bash[24992]: cluster 2024-08-31T07:57:39.438990+0000 mgr.a (mgr.14388) 14980 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:40 smithi163 bash[24253]: cluster 2024-08-31T07:57:39.438990+0000 mgr.a (mgr.14388) 14980 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:40 smithi027 bash[22610]: cluster 2024-08-31T07:57:39.438990+0000 mgr.a (mgr.14388) 14980 : cluster [DBG] pgmap v10384: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:41.137 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:41.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:41.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:41.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:41.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:42 smithi191 bash[24992]: audit 2024-08-31T07:57:40.723567+0000 mgr.a (mgr.14388) 14981 : audit [DBG] from='client.324927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:42 smithi191 bash[24992]: cluster 2024-08-31T07:57:41.439948+0000 mgr.a (mgr.14388) 14982 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:42 smithi163 bash[24253]: audit 2024-08-31T07:57:40.723567+0000 mgr.a (mgr.14388) 14981 : audit [DBG] from='client.324927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:42 smithi163 bash[24253]: cluster 2024-08-31T07:57:41.439948+0000 mgr.a (mgr.14388) 14982 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:42 smithi027 bash[22610]: audit 2024-08-31T07:57:40.723567+0000 mgr.a (mgr.14388) 14981 : audit [DBG] from='client.324927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:42 smithi027 bash[22610]: cluster 2024-08-31T07:57:41.439948+0000 mgr.a (mgr.14388) 14982 : cluster [DBG] pgmap v10385: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:44 smithi191 bash[24992]: cluster 2024-08-31T07:57:43.442712+0000 mgr.a (mgr.14388) 14983 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:44 smithi163 bash[24253]: cluster 2024-08-31T07:57:43.442712+0000 mgr.a (mgr.14388) 14983 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:44 smithi027 bash[22610]: cluster 2024-08-31T07:57:43.442712+0000 mgr.a (mgr.14388) 14983 : cluster [DBG] pgmap v10386: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:46.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:46.139 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:46.140 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:46 smithi191 bash[24992]: cluster 2024-08-31T07:57:45.443473+0000 mgr.a (mgr.14388) 14984 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:46.913 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:46.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:46.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:46.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:46.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:46 smithi163 bash[24253]: cluster 2024-08-31T07:57:45.443473+0000 mgr.a (mgr.14388) 14984 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:46 smithi027 bash[22610]: cluster 2024-08-31T07:57:45.443473+0000 mgr.a (mgr.14388) 14984 : cluster [DBG] pgmap v10387: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:47 smithi191 bash[24992]: audit 2024-08-31T07:57:46.472656+0000 mgr.a (mgr.14388) 14985 : audit [DBG] from='client.325005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:47 smithi163 bash[24253]: audit 2024-08-31T07:57:46.472656+0000 mgr.a (mgr.14388) 14985 : audit [DBG] from='client.325005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:47 smithi027 bash[22610]: audit 2024-08-31T07:57:46.472656+0000 mgr.a (mgr.14388) 14985 : audit [DBG] from='client.325005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:48 smithi191 bash[24992]: cluster 2024-08-31T07:57:47.444453+0000 mgr.a (mgr.14388) 14986 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:48 smithi163 bash[24253]: cluster 2024-08-31T07:57:47.444453+0000 mgr.a (mgr.14388) 14986 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:48 smithi027 bash[22610]: cluster 2024-08-31T07:57:47.444453+0000 mgr.a (mgr.14388) 14986 : cluster [DBG] pgmap v10388: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:49 smithi191 bash[24992]: cluster 2024-08-31T07:57:49.446703+0000 mgr.a (mgr.14388) 14987 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:49 smithi163 bash[24253]: cluster 2024-08-31T07:57:49.446703+0000 mgr.a (mgr.14388) 14987 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:49 smithi027 bash[22610]: cluster 2024-08-31T07:57:49.446703+0000 mgr.a (mgr.14388) 14987 : cluster [DBG] pgmap v10389: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:57:51.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:51.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:52.676 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:52.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:52.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:52.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:52.677 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:52 smithi191 bash[24992]: cluster 2024-08-31T07:57:51.447464+0000 mgr.a (mgr.14388) 14988 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:52 smithi163 bash[24253]: cluster 2024-08-31T07:57:51.447464+0000 mgr.a (mgr.14388) 14988 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:52 smithi027 bash[22610]: cluster 2024-08-31T07:57:51.447464+0000 mgr.a (mgr.14388) 14988 : cluster [DBG] pgmap v10390: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:53 smithi191 bash[24992]: audit 2024-08-31T07:57:52.253601+0000 mgr.a (mgr.14388) 14989 : audit [DBG] from='client.325080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:53 smithi163 bash[24253]: audit 2024-08-31T07:57:52.253601+0000 mgr.a (mgr.14388) 14989 : audit [DBG] from='client.325080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:53 smithi027 bash[22610]: audit 2024-08-31T07:57:52.253601+0000 mgr.a (mgr.14388) 14989 : audit [DBG] from='client.325080 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:54 smithi191 bash[24992]: cluster 2024-08-31T07:57:53.449851+0000 mgr.a (mgr.14388) 14990 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:54 smithi163 bash[24253]: cluster 2024-08-31T07:57:53.449851+0000 mgr.a (mgr.14388) 14990 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:54 smithi027 bash[22610]: cluster 2024-08-31T07:57:53.449851+0000 mgr.a (mgr.14388) 14990 : cluster [DBG] pgmap v10391: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:57:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:55 smithi163 bash[24253]: cluster 2024-08-31T07:57:55.450798+0000 mgr.a (mgr.14388) 14991 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:55 smithi027 bash[22610]: cluster 2024-08-31T07:57:55.450798+0000 mgr.a (mgr.14388) 14991 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:55 smithi191 bash[24992]: cluster 2024-08-31T07:57:55.450798+0000 mgr.a (mgr.14388) 14991 : cluster [DBG] pgmap v10392: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:57.678 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:57:57.678 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:57:57.678 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:57:58.422 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:57:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:57:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:57:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:57:58.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:57:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:58 smithi191 bash[24992]: cluster 2024-08-31T07:57:57.451708+0000 mgr.a (mgr.14388) 14992 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:58 smithi163 bash[24253]: cluster 2024-08-31T07:57:57.451708+0000 mgr.a (mgr.14388) 14992 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:58 smithi027 bash[22610]: cluster 2024-08-31T07:57:57.451708+0000 mgr.a (mgr.14388) 14992 : cluster [DBG] pgmap v10393: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:57:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:57:59 smithi191 bash[24992]: audit 2024-08-31T07:57:58.008621+0000 mgr.a (mgr.14388) 14993 : audit [DBG] from='client.325158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:57:59 smithi163 bash[24253]: audit 2024-08-31T07:57:58.008621+0000 mgr.a (mgr.14388) 14993 : audit [DBG] from='client.325158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:57:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:57:59 smithi027 bash[22610]: audit 2024-08-31T07:57:58.008621+0000 mgr.a (mgr.14388) 14993 : audit [DBG] from='client.325158 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:00 smithi191 bash[24992]: cluster 2024-08-31T07:57:59.454683+0000 mgr.a (mgr.14388) 14994 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:00 smithi163 bash[24253]: cluster 2024-08-31T07:57:59.454683+0000 mgr.a (mgr.14388) 14994 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:00 smithi027 bash[22610]: cluster 2024-08-31T07:57:59.454683+0000 mgr.a (mgr.14388) 14994 : cluster [DBG] pgmap v10394: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:01 smithi191 bash[24992]: cluster 2024-08-31T07:58:01.455492+0000 mgr.a (mgr.14388) 14995 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:58:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:01 smithi163 bash[24253]: cluster 2024-08-31T07:58:01.455492+0000 mgr.a (mgr.14388) 14995 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:58:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:01 smithi027 bash[22610]: cluster 2024-08-31T07:58:01.455492+0000 mgr.a (mgr.14388) 14995 : cluster [DBG] pgmap v10395: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:58:03.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:58:03.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:58:03.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:58:04.205 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:58:04.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:58:04.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:58:04.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:58:04.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:58:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:04 smithi191 bash[24992]: cluster 2024-08-31T07:58:03.457183+0000 mgr.a (mgr.14388) 14996 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:04 smithi163 bash[24253]: cluster 2024-08-31T07:58:03.457183+0000 mgr.a (mgr.14388) 14996 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:04 smithi027 bash[22610]: cluster 2024-08-31T07:58:03.457183+0000 mgr.a (mgr.14388) 14996 : cluster [DBG] pgmap v10396: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:05 smithi191 bash[24992]: audit 2024-08-31T07:58:03.763925+0000 mgr.a (mgr.14388) 14997 : audit [DBG] from='client.325233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:05 smithi163 bash[24253]: audit 2024-08-31T07:58:03.763925+0000 mgr.a (mgr.14388) 14997 : audit [DBG] from='client.325233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:05 smithi027 bash[22610]: audit 2024-08-31T07:58:03.763925+0000 mgr.a (mgr.14388) 14997 : audit [DBG] from='client.325233 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:06 smithi191 bash[24992]: cluster 2024-08-31T07:58:05.458043+0000 mgr.a (mgr.14388) 14998 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:58:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:06 smithi163 bash[24253]: cluster 2024-08-31T07:58:05.458043+0000 mgr.a (mgr.14388) 14998 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:58:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:06 smithi027 bash[22610]: cluster 2024-08-31T07:58:05.458043+0000 mgr.a (mgr.14388) 14998 : cluster [DBG] pgmap v10397: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:58:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:07 smithi191 bash[24992]: cluster 2024-08-31T07:58:07.458984+0000 mgr.a (mgr.14388) 14999 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:58:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:07 smithi163 bash[24253]: cluster 2024-08-31T07:58:07.458984+0000 mgr.a (mgr.14388) 14999 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:58:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:07 smithi027 bash[22610]: cluster 2024-08-31T07:58:07.458984+0000 mgr.a (mgr.14388) 14999 : cluster [DBG] pgmap v10398: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:58:09.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:58:09.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:58:09.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:58:09.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:58:09.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:58:09.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:58:09.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:58:09.984 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:58:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:10 smithi191 bash[24992]: cluster 2024-08-31T07:58:09.461254+0000 mgr.a (mgr.14388) 15000 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:10 smithi163 bash[24253]: cluster 2024-08-31T07:58:09.461254+0000 mgr.a (mgr.14388) 15000 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:10 smithi027 bash[22610]: cluster 2024-08-31T07:58:09.461254+0000 mgr.a (mgr.14388) 15000 : cluster [DBG] pgmap v10399: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:11 smithi191 bash[24992]: audit 2024-08-31T07:58:09.542146+0000 mgr.a (mgr.14388) 15001 : audit [DBG] from='client.325311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:11 smithi163 bash[24253]: audit 2024-08-31T07:58:09.542146+0000 mgr.a (mgr.14388) 15001 : audit [DBG] from='client.325311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:11 smithi027 bash[22610]: audit 2024-08-31T07:58:09.542146+0000 mgr.a (mgr.14388) 15001 : audit [DBG] from='client.325311 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:12 smithi191 bash[24992]: cluster 2024-08-31T07:58:11.462192+0000 mgr.a (mgr.14388) 15002 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:12 smithi163 bash[24253]: cluster 2024-08-31T07:58:11.462192+0000 mgr.a (mgr.14388) 15002 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:12 smithi027 bash[22610]: cluster 2024-08-31T07:58:11.462192+0000 mgr.a (mgr.14388) 15002 : cluster [DBG] pgmap v10400: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:13 smithi191 bash[24992]: cluster 2024-08-31T07:58:13.464413+0000 mgr.a (mgr.14388) 15003 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:13 smithi163 bash[24253]: cluster 2024-08-31T07:58:13.464413+0000 mgr.a (mgr.14388) 15003 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:13 smithi027 bash[22610]: cluster 2024-08-31T07:58:13.464413+0000 mgr.a (mgr.14388) 15003 : cluster [DBG] pgmap v10401: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:14.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:58:14.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:58:14.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:58:15.755 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:58:15.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:58:15.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:58:15.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:58:15.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:58:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:16 smithi191 bash[24992]: audit 2024-08-31T07:58:15.317763+0000 mgr.a (mgr.14388) 15004 : audit [DBG] from='client.325389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:16 smithi191 bash[24992]: cluster 2024-08-31T07:58:15.465193+0000 mgr.a (mgr.14388) 15005 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:16 smithi163 bash[24253]: audit 2024-08-31T07:58:15.317763+0000 mgr.a (mgr.14388) 15004 : audit [DBG] from='client.325389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:16 smithi163 bash[24253]: cluster 2024-08-31T07:58:15.465193+0000 mgr.a (mgr.14388) 15005 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:16 smithi027 bash[22610]: audit 2024-08-31T07:58:15.317763+0000 mgr.a (mgr.14388) 15004 : audit [DBG] from='client.325389 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:16.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:16 smithi027 bash[22610]: cluster 2024-08-31T07:58:15.465193+0000 mgr.a (mgr.14388) 15005 : cluster [DBG] pgmap v10402: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:17 smithi191 bash[24992]: cluster 2024-08-31T07:58:17.466107+0000 mgr.a (mgr.14388) 15006 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:17 smithi163 bash[24253]: cluster 2024-08-31T07:58:17.466107+0000 mgr.a (mgr.14388) 15006 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:17 smithi027 bash[22610]: cluster 2024-08-31T07:58:17.466107+0000 mgr.a (mgr.14388) 15006 : cluster [DBG] pgmap v10403: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:19 smithi163 bash[24253]: cluster 2024-08-31T07:58:19.468340+0000 mgr.a (mgr.14388) 15007 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:19 smithi027 bash[22610]: cluster 2024-08-31T07:58:19.468340+0000 mgr.a (mgr.14388) 15007 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:19 smithi191 bash[24992]: cluster 2024-08-31T07:58:19.468340+0000 mgr.a (mgr.14388) 15007 : cluster [DBG] pgmap v10404: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:20.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:58:20.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:58:20.758 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:58:21.500 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:58:21.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:58:21.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:58:21.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:58:21.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:58:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:21 smithi163 bash[24253]: audit 2024-08-31T07:58:21.087806+0000 mgr.a (mgr.14388) 15008 : audit [DBG] from='client.325467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:21 smithi163 bash[24253]: cluster 2024-08-31T07:58:21.468867+0000 mgr.a (mgr.14388) 15009 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:21 smithi027 bash[22610]: audit 2024-08-31T07:58:21.087806+0000 mgr.a (mgr.14388) 15008 : audit [DBG] from='client.325467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:21 smithi027 bash[22610]: cluster 2024-08-31T07:58:21.468867+0000 mgr.a (mgr.14388) 15009 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:21 smithi191 bash[24992]: audit 2024-08-31T07:58:21.087806+0000 mgr.a (mgr.14388) 15008 : audit [DBG] from='client.325467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:21 smithi191 bash[24992]: cluster 2024-08-31T07:58:21.468867+0000 mgr.a (mgr.14388) 15009 : cluster [DBG] pgmap v10405: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:23 smithi163 bash[24253]: cluster 2024-08-31T07:58:23.471183+0000 mgr.a (mgr.14388) 15010 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:23 smithi027 bash[22610]: cluster 2024-08-31T07:58:23.471183+0000 mgr.a (mgr.14388) 15010 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:23 smithi191 bash[24992]: cluster 2024-08-31T07:58:23.471183+0000 mgr.a (mgr.14388) 15010 : cluster [DBG] pgmap v10406: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:25.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:25 smithi163 bash[24253]: cluster 2024-08-31T07:58:25.471982+0000 mgr.a (mgr.14388) 15011 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:25 smithi027 bash[22610]: cluster 2024-08-31T07:58:25.471982+0000 mgr.a (mgr.14388) 15011 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:25 smithi191 bash[24992]: cluster 2024-08-31T07:58:25.471982+0000 mgr.a (mgr.14388) 15011 : cluster [DBG] pgmap v10407: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:26.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:58:26.502 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:58:26.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:58:27.249 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:58:27.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:58:27.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:58:27.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:58:27.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:58:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:27 smithi163 bash[24253]: audit 2024-08-31T07:58:26.830301+0000 mgr.a (mgr.14388) 15012 : audit [DBG] from='client.325545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:27 smithi163 bash[24253]: cluster 2024-08-31T07:58:27.472944+0000 mgr.a (mgr.14388) 15013 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:27 smithi027 bash[22610]: audit 2024-08-31T07:58:26.830301+0000 mgr.a (mgr.14388) 15012 : audit [DBG] from='client.325545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:27 smithi027 bash[22610]: cluster 2024-08-31T07:58:27.472944+0000 mgr.a (mgr.14388) 15013 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:27 smithi191 bash[24992]: audit 2024-08-31T07:58:26.830301+0000 mgr.a (mgr.14388) 15012 : audit [DBG] from='client.325545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:27 smithi191 bash[24992]: cluster 2024-08-31T07:58:27.472944+0000 mgr.a (mgr.14388) 15013 : cluster [DBG] pgmap v10408: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:29 smithi163 bash[24253]: cluster 2024-08-31T07:58:29.475226+0000 mgr.a (mgr.14388) 15014 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:29 smithi027 bash[22610]: cluster 2024-08-31T07:58:29.475226+0000 mgr.a (mgr.14388) 15014 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:29 smithi191 bash[24992]: cluster 2024-08-31T07:58:29.475226+0000 mgr.a (mgr.14388) 15014 : cluster [DBG] pgmap v10409: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:58:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:31 smithi163 bash[24253]: cluster 2024-08-31T07:58:31.476020+0000 mgr.a (mgr.14388) 15015 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:31 smithi027 bash[22610]: cluster 2024-08-31T07:58:31.476020+0000 mgr.a (mgr.14388) 15015 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:31 smithi191 bash[24992]: cluster 2024-08-31T07:58:31.476020+0000 mgr.a (mgr.14388) 15015 : cluster [DBG] pgmap v10410: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:32.251 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:58:32.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:58:32.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:58:33.008 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:58:33.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:58:33.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:58:33.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:58:33.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:58:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:33 smithi163 bash[24253]: audit 2024-08-31T07:58:32.581016+0000 mgr.a (mgr.14388) 15016 : audit [DBG] from='client.325623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:33 smithi163 bash[24253]: cluster 2024-08-31T07:58:33.478378+0000 mgr.a (mgr.14388) 15017 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T07:58:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:33 smithi027 bash[22610]: audit 2024-08-31T07:58:32.581016+0000 mgr.a (mgr.14388) 15016 : audit [DBG] from='client.325623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:33 smithi027 bash[22610]: cluster 2024-08-31T07:58:33.478378+0000 mgr.a (mgr.14388) 15017 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T07:58:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:33 smithi191 bash[24992]: audit 2024-08-31T07:58:32.581016+0000 mgr.a (mgr.14388) 15016 : audit [DBG] from='client.325623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:33 smithi191 bash[24992]: cluster 2024-08-31T07:58:33.478378+0000 mgr.a (mgr.14388) 15017 : cluster [DBG] pgmap v10411: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T07:58:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:35 smithi163 bash[24253]: cluster 2024-08-31T07:58:35.479216+0000 mgr.a (mgr.14388) 15018 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:58:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:35 smithi027 bash[22610]: cluster 2024-08-31T07:58:35.479216+0000 mgr.a (mgr.14388) 15018 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:58:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:35 smithi191 bash[24992]: cluster 2024-08-31T07:58:35.479216+0000 mgr.a (mgr.14388) 15018 : cluster [DBG] pgmap v10412: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:58:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:36 smithi027 bash[22610]: audit 2024-08-31T07:58:36.912550+0000 mon.a (mon.0) 2816 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:58:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:36 smithi191 bash[24992]: audit 2024-08-31T07:58:36.912550+0000 mon.a (mon.0) 2816 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:58:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:36 smithi163 bash[24253]: audit 2024-08-31T07:58:36.912550+0000 mon.a (mon.0) 2816 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:58:38.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:58:38.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:58:38.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:58:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:37 smithi027 bash[22610]: cluster 2024-08-31T07:58:37.479734+0000 mgr.a (mgr.14388) 15019 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:58:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:37 smithi191 bash[24992]: cluster 2024-08-31T07:58:37.479734+0000 mgr.a (mgr.14388) 15019 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:58:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:37 smithi163 bash[24253]: cluster 2024-08-31T07:58:37.479734+0000 mgr.a (mgr.14388) 15019 : cluster [DBG] pgmap v10413: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T07:58:38.747 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:58:38.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:58:38.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:58:38.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:58:38.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:58:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:38 smithi027 bash[22610]: audit 2024-08-31T07:58:38.341776+0000 mgr.a (mgr.14388) 15020 : audit [DBG] from='client.325701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:39.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:38 smithi191 bash[24992]: audit 2024-08-31T07:58:38.341776+0000 mgr.a (mgr.14388) 15020 : audit [DBG] from='client.325701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:38 smithi163 bash[24253]: audit 2024-08-31T07:58:38.341776+0000 mgr.a (mgr.14388) 15020 : audit [DBG] from='client.325701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:39 smithi191 bash[24992]: cluster 2024-08-31T07:58:39.482496+0000 mgr.a (mgr.14388) 15021 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:39 smithi163 bash[24253]: cluster 2024-08-31T07:58:39.482496+0000 mgr.a (mgr.14388) 15021 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:39 smithi027 bash[22610]: cluster 2024-08-31T07:58:39.482496+0000 mgr.a (mgr.14388) 15021 : cluster [DBG] pgmap v10414: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:41 smithi163 bash[24253]: cluster 2024-08-31T07:58:41.483309+0000 mgr.a (mgr.14388) 15022 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:58:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:41 smithi027 bash[22610]: cluster 2024-08-31T07:58:41.483309+0000 mgr.a (mgr.14388) 15022 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:58:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:41 smithi191 bash[24992]: cluster 2024-08-31T07:58:41.483309+0000 mgr.a (mgr.14388) 15022 : cluster [DBG] pgmap v10415: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:58:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:43 smithi191 bash[24992]: audit 2024-08-31T07:58:42.265255+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:43 smithi191 bash[24992]: audit 2024-08-31T07:58:42.275660+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:43 smithi191 bash[24992]: audit 2024-08-31T07:58:42.302397+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:43 smithi191 bash[24992]: audit 2024-08-31T07:58:42.307487+0000 mon.a (mon.0) 2820 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:43 smithi191 bash[24992]: audit 2024-08-31T07:58:42.315422+0000 mon.a (mon.0) 2821 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:43 smithi191 bash[24992]: audit 2024-08-31T07:58:42.323450+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:43 smithi191 bash[24992]: audit 2024-08-31T07:58:43.046626+0000 mon.a (mon.0) 2823 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:58:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:43 smithi191 bash[24992]: audit 2024-08-31T07:58:43.047915+0000 mon.a (mon.0) 2824 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:58:43.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:43 smithi191 bash[24992]: audit 2024-08-31T07:58:43.057213+0000 mon.a (mon.0) 2825 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:43 smithi191 bash[24992]: audit 2024-08-31T07:58:43.062051+0000 mon.a (mon.0) 2826 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:58:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:43 smithi163 bash[24253]: audit 2024-08-31T07:58:42.265255+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:43 smithi163 bash[24253]: audit 2024-08-31T07:58:42.275660+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:43 smithi163 bash[24253]: audit 2024-08-31T07:58:42.302397+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:43 smithi163 bash[24253]: audit 2024-08-31T07:58:42.307487+0000 mon.a (mon.0) 2820 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:43 smithi163 bash[24253]: audit 2024-08-31T07:58:42.315422+0000 mon.a (mon.0) 2821 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:43 smithi163 bash[24253]: audit 2024-08-31T07:58:42.323450+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:43 smithi163 bash[24253]: audit 2024-08-31T07:58:43.046626+0000 mon.a (mon.0) 2823 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:58:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:43 smithi163 bash[24253]: audit 2024-08-31T07:58:43.047915+0000 mon.a (mon.0) 2824 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:58:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:43 smithi163 bash[24253]: audit 2024-08-31T07:58:43.057213+0000 mon.a (mon.0) 2825 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:43 smithi163 bash[24253]: audit 2024-08-31T07:58:43.062051+0000 mon.a (mon.0) 2826 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:58:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22610]: audit 2024-08-31T07:58:42.265255+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22610]: audit 2024-08-31T07:58:42.275660+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22610]: audit 2024-08-31T07:58:42.302397+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22610]: audit 2024-08-31T07:58:42.307487+0000 mon.a (mon.0) 2820 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22610]: audit 2024-08-31T07:58:42.315422+0000 mon.a (mon.0) 2821 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22610]: audit 2024-08-31T07:58:42.323450+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22610]: audit 2024-08-31T07:58:43.046626+0000 mon.a (mon.0) 2823 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:58:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22610]: audit 2024-08-31T07:58:43.047915+0000 mon.a (mon.0) 2824 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:58:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22610]: audit 2024-08-31T07:58:43.057213+0000 mon.a (mon.0) 2825 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:58:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22610]: audit 2024-08-31T07:58:43.062051+0000 mon.a (mon.0) 2826 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:58:43.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:58:43.749 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:58:43.749 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:58:44.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22863]: debug 2024-08-31T07:58:43.806+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:58:44.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:58:43 smithi027 bash[22863]: debug 2024-08-31T07:58:43.810+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:58:44.481 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:58:44.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:58:44.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:58:44.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:58:44.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:58:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:44 smithi191 bash[24992]: audit 2024-08-31T07:58:43.064782+0000 mgr.a (mgr.14388) 15023 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:58:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:44 smithi191 bash[24992]: cluster 2024-08-31T07:58:43.484859+0000 mgr.a (mgr.14388) 15024 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:44 smithi163 bash[24253]: audit 2024-08-31T07:58:43.064782+0000 mgr.a (mgr.14388) 15023 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:58:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:44 smithi163 bash[24253]: cluster 2024-08-31T07:58:43.484859+0000 mgr.a (mgr.14388) 15024 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:44 smithi027 bash[22610]: audit 2024-08-31T07:58:43.064782+0000 mgr.a (mgr.14388) 15023 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:58:44.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:44 smithi027 bash[22610]: cluster 2024-08-31T07:58:43.484859+0000 mgr.a (mgr.14388) 15024 : cluster [DBG] pgmap v10416: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:58:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:45 smithi191 bash[24992]: audit 2024-08-31T07:58:43.809109+0000 mgr.a (mgr.14388) 15025 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:58:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:45 smithi191 bash[24992]: cephadm 2024-08-31T07:58:43.810807+0000 mgr.a (mgr.14388) 15026 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:58:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:45 smithi191 bash[24992]: audit 2024-08-31T07:58:44.066943+0000 mgr.a (mgr.14388) 15027 : audit [DBG] from='client.325881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:45 smithi163 bash[24253]: audit 2024-08-31T07:58:43.809109+0000 mgr.a (mgr.14388) 15025 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:58:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:45 smithi163 bash[24253]: cephadm 2024-08-31T07:58:43.810807+0000 mgr.a (mgr.14388) 15026 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:58:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:45 smithi163 bash[24253]: audit 2024-08-31T07:58:44.066943+0000 mgr.a (mgr.14388) 15027 : audit [DBG] from='client.325881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:45 smithi027 bash[22610]: audit 2024-08-31T07:58:43.809109+0000 mgr.a (mgr.14388) 15025 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:58:45.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:45 smithi027 bash[22610]: cephadm 2024-08-31T07:58:43.810807+0000 mgr.a (mgr.14388) 15026 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:58:45.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:45 smithi027 bash[22610]: audit 2024-08-31T07:58:44.066943+0000 mgr.a (mgr.14388) 15027 : audit [DBG] from='client.325881 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:46 smithi191 bash[24992]: cluster 2024-08-31T07:58:45.485875+0000 mgr.a (mgr.14388) 15028 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:58:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:46 smithi163 bash[24253]: cluster 2024-08-31T07:58:45.485875+0000 mgr.a (mgr.14388) 15028 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:58:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:46 smithi027 bash[22610]: cluster 2024-08-31T07:58:45.485875+0000 mgr.a (mgr.14388) 15028 : cluster [DBG] pgmap v10417: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:58:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:47 smithi163 bash[24253]: cluster 2024-08-31T07:58:47.486705+0000 mgr.a (mgr.14388) 15029 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:58:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:47 smithi027 bash[22610]: cluster 2024-08-31T07:58:47.486705+0000 mgr.a (mgr.14388) 15029 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:58:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:47 smithi191 bash[24992]: cluster 2024-08-31T07:58:47.486705+0000 mgr.a (mgr.14388) 15029 : cluster [DBG] pgmap v10418: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T07:58:49.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:58:49.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:58:49.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:58:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:49 smithi163 bash[24253]: cluster 2024-08-31T07:58:49.488086+0000 mgr.a (mgr.14388) 15030 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:49 smithi027 bash[22610]: cluster 2024-08-31T07:58:49.488086+0000 mgr.a (mgr.14388) 15030 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:49 smithi191 bash[24992]: cluster 2024-08-31T07:58:49.488086+0000 mgr.a (mgr.14388) 15030 : cluster [DBG] pgmap v10419: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:50.249 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:58:50.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:58:50.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:58:50.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:58:50.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:58:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:50 smithi163 bash[24253]: audit 2024-08-31T07:58:49.821147+0000 mgr.a (mgr.14388) 15031 : audit [DBG] from='client.325959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:50 smithi027 bash[22610]: audit 2024-08-31T07:58:49.821147+0000 mgr.a (mgr.14388) 15031 : audit [DBG] from='client.325959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:50 smithi191 bash[24992]: audit 2024-08-31T07:58:49.821147+0000 mgr.a (mgr.14388) 15031 : audit [DBG] from='client.325959 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:51 smithi163 bash[24253]: cluster 2024-08-31T07:58:51.489122+0000 mgr.a (mgr.14388) 15032 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:51 smithi027 bash[22610]: cluster 2024-08-31T07:58:51.489122+0000 mgr.a (mgr.14388) 15032 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:51 smithi191 bash[24992]: cluster 2024-08-31T07:58:51.489122+0000 mgr.a (mgr.14388) 15032 : cluster [DBG] pgmap v10420: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:53 smithi163 bash[24253]: cluster 2024-08-31T07:58:53.491390+0000 mgr.a (mgr.14388) 15033 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:53 smithi027 bash[22610]: cluster 2024-08-31T07:58:53.491390+0000 mgr.a (mgr.14388) 15033 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:53 smithi191 bash[24992]: cluster 2024-08-31T07:58:53.491390+0000 mgr.a (mgr.14388) 15033 : cluster [DBG] pgmap v10421: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:55.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:58:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:58:55.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:58:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:55 smithi163 bash[24253]: cluster 2024-08-31T07:58:55.492256+0000 mgr.a (mgr.14388) 15034 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:55 smithi027 bash[22610]: cluster 2024-08-31T07:58:55.492256+0000 mgr.a (mgr.14388) 15034 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:55.997 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:58:55.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:58:55.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:58:55.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:58:55.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:58:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:55 smithi191 bash[24992]: cluster 2024-08-31T07:58:55.492256+0000 mgr.a (mgr.14388) 15034 : cluster [DBG] pgmap v10422: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:56 smithi163 bash[24253]: audit 2024-08-31T07:58:55.572644+0000 mgr.a (mgr.14388) 15035 : audit [DBG] from='client.326034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:56 smithi027 bash[22610]: audit 2024-08-31T07:58:55.572644+0000 mgr.a (mgr.14388) 15035 : audit [DBG] from='client.326034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:56 smithi191 bash[24992]: audit 2024-08-31T07:58:55.572644+0000 mgr.a (mgr.14388) 15035 : audit [DBG] from='client.326034 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:58:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:57 smithi163 bash[24253]: cluster 2024-08-31T07:58:57.493192+0000 mgr.a (mgr.14388) 15036 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:57 smithi027 bash[22610]: cluster 2024-08-31T07:58:57.493192+0000 mgr.a (mgr.14388) 15036 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:57 smithi191 bash[24992]: cluster 2024-08-31T07:58:57.493192+0000 mgr.a (mgr.14388) 15036 : cluster [DBG] pgmap v10423: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:58:59 smithi163 bash[24253]: cluster 2024-08-31T07:58:59.495421+0000 mgr.a (mgr.14388) 15037 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:58:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:58:59 smithi027 bash[22610]: cluster 2024-08-31T07:58:59.495421+0000 mgr.a (mgr.14388) 15037 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:58:59 smithi191 bash[24992]: cluster 2024-08-31T07:58:59.495421+0000 mgr.a (mgr.14388) 15037 : cluster [DBG] pgmap v10424: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:00.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:01.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:01.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:01.757 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:01 smithi163 bash[24253]: audit 2024-08-31T07:59:01.333184+0000 mgr.a (mgr.14388) 15038 : audit [DBG] from='client.326112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:01 smithi163 bash[24253]: cluster 2024-08-31T07:59:01.495980+0000 mgr.a (mgr.14388) 15039 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:01 smithi027 bash[22610]: audit 2024-08-31T07:59:01.333184+0000 mgr.a (mgr.14388) 15038 : audit [DBG] from='client.326112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:01 smithi027 bash[22610]: cluster 2024-08-31T07:59:01.495980+0000 mgr.a (mgr.14388) 15039 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:01 smithi191 bash[24992]: audit 2024-08-31T07:59:01.333184+0000 mgr.a (mgr.14388) 15038 : audit [DBG] from='client.326112 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:01 smithi191 bash[24992]: cluster 2024-08-31T07:59:01.495980+0000 mgr.a (mgr.14388) 15039 : cluster [DBG] pgmap v10425: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:03 smithi163 bash[24253]: cluster 2024-08-31T07:59:03.498218+0000 mgr.a (mgr.14388) 15040 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:03 smithi027 bash[22610]: cluster 2024-08-31T07:59:03.498218+0000 mgr.a (mgr.14388) 15040 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:03 smithi191 bash[24992]: cluster 2024-08-31T07:59:03.498218+0000 mgr.a (mgr.14388) 15040 : cluster [DBG] pgmap v10426: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:05 smithi163 bash[24253]: cluster 2024-08-31T07:59:05.499012+0000 mgr.a (mgr.14388) 15041 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:05 smithi027 bash[22610]: cluster 2024-08-31T07:59:05.499012+0000 mgr.a (mgr.14388) 15041 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:05 smithi191 bash[24992]: cluster 2024-08-31T07:59:05.499012+0000 mgr.a (mgr.14388) 15041 : cluster [DBG] pgmap v10427: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:06.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:06.759 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:06.759 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:07.527 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:07.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:07 smithi163 bash[24253]: audit 2024-08-31T07:59:07.099473+0000 mgr.a (mgr.14388) 15042 : audit [DBG] from='client.326190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:07 smithi163 bash[24253]: cluster 2024-08-31T07:59:07.499544+0000 mgr.a (mgr.14388) 15043 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:07 smithi027 bash[22610]: audit 2024-08-31T07:59:07.099473+0000 mgr.a (mgr.14388) 15042 : audit [DBG] from='client.326190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:07 smithi027 bash[22610]: cluster 2024-08-31T07:59:07.499544+0000 mgr.a (mgr.14388) 15043 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:07 smithi191 bash[24992]: audit 2024-08-31T07:59:07.099473+0000 mgr.a (mgr.14388) 15042 : audit [DBG] from='client.326190 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:07 smithi191 bash[24992]: cluster 2024-08-31T07:59:07.499544+0000 mgr.a (mgr.14388) 15043 : cluster [DBG] pgmap v10428: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:09 smithi163 bash[24253]: cluster 2024-08-31T07:59:09.501723+0000 mgr.a (mgr.14388) 15044 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:09 smithi027 bash[22610]: cluster 2024-08-31T07:59:09.501723+0000 mgr.a (mgr.14388) 15044 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:09 smithi191 bash[24992]: cluster 2024-08-31T07:59:09.501723+0000 mgr.a (mgr.14388) 15044 : cluster [DBG] pgmap v10429: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:11 smithi163 bash[24253]: cluster 2024-08-31T07:59:11.502480+0000 mgr.a (mgr.14388) 15045 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:11 smithi027 bash[22610]: cluster 2024-08-31T07:59:11.502480+0000 mgr.a (mgr.14388) 15045 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:11 smithi191 bash[24992]: cluster 2024-08-31T07:59:11.502480+0000 mgr.a (mgr.14388) 15045 : cluster [DBG] pgmap v10430: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:12.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:12.529 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:12.529 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:13.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:13.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:13.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:13.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:13.298 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:13 smithi163 bash[24253]: audit 2024-08-31T07:59:12.864394+0000 mgr.a (mgr.14388) 15046 : audit [DBG] from='client.326268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:13 smithi163 bash[24253]: cluster 2024-08-31T07:59:13.505272+0000 mgr.a (mgr.14388) 15047 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:13 smithi027 bash[22610]: audit 2024-08-31T07:59:12.864394+0000 mgr.a (mgr.14388) 15046 : audit [DBG] from='client.326268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:13 smithi027 bash[22610]: cluster 2024-08-31T07:59:13.505272+0000 mgr.a (mgr.14388) 15047 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:14.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:13 smithi191 bash[24992]: audit 2024-08-31T07:59:12.864394+0000 mgr.a (mgr.14388) 15046 : audit [DBG] from='client.326268 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:14.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:13 smithi191 bash[24992]: cluster 2024-08-31T07:59:13.505272+0000 mgr.a (mgr.14388) 15047 : cluster [DBG] pgmap v10431: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:15 smithi163 bash[24253]: cluster 2024-08-31T07:59:15.506212+0000 mgr.a (mgr.14388) 15048 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:59:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:15 smithi027 bash[22610]: cluster 2024-08-31T07:59:15.506212+0000 mgr.a (mgr.14388) 15048 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:59:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:15 smithi191 bash[24992]: cluster 2024-08-31T07:59:15.506212+0000 mgr.a (mgr.14388) 15048 : cluster [DBG] pgmap v10432: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:59:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:17 smithi163 bash[24253]: cluster 2024-08-31T07:59:17.507191+0000 mgr.a (mgr.14388) 15049 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:59:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:17 smithi027 bash[22610]: cluster 2024-08-31T07:59:17.507191+0000 mgr.a (mgr.14388) 15049 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:59:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:17 smithi191 bash[24992]: cluster 2024-08-31T07:59:17.507191+0000 mgr.a (mgr.14388) 15049 : cluster [DBG] pgmap v10433: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T07:59:18.299 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:18.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:18.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:19.049 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:19.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:19.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:19.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:19.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:19 smithi163 bash[24253]: audit 2024-08-31T07:59:18.629235+0000 mgr.a (mgr.14388) 15050 : audit [DBG] from='client.326346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:19 smithi163 bash[24253]: cluster 2024-08-31T07:59:19.510026+0000 mgr.a (mgr.14388) 15051 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:19 smithi027 bash[22610]: audit 2024-08-31T07:59:18.629235+0000 mgr.a (mgr.14388) 15050 : audit [DBG] from='client.326346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:19 smithi027 bash[22610]: cluster 2024-08-31T07:59:19.510026+0000 mgr.a (mgr.14388) 15051 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:19 smithi191 bash[24992]: audit 2024-08-31T07:59:18.629235+0000 mgr.a (mgr.14388) 15050 : audit [DBG] from='client.326346 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:19 smithi191 bash[24992]: cluster 2024-08-31T07:59:19.510026+0000 mgr.a (mgr.14388) 15051 : cluster [DBG] pgmap v10434: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:21 smithi163 bash[24253]: cluster 2024-08-31T07:59:21.510813+0000 mgr.a (mgr.14388) 15052 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:59:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:21 smithi027 bash[22610]: cluster 2024-08-31T07:59:21.510813+0000 mgr.a (mgr.14388) 15052 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:59:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:21 smithi191 bash[24992]: cluster 2024-08-31T07:59:21.510813+0000 mgr.a (mgr.14388) 15052 : cluster [DBG] pgmap v10435: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T07:59:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:23 smithi163 bash[24253]: cluster 2024-08-31T07:59:23.512740+0000 mgr.a (mgr.14388) 15053 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:23 smithi027 bash[22610]: cluster 2024-08-31T07:59:23.512740+0000 mgr.a (mgr.14388) 15053 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:23 smithi191 bash[24992]: cluster 2024-08-31T07:59:23.512740+0000 mgr.a (mgr.14388) 15053 : cluster [DBG] pgmap v10436: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:24.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:24.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:24.052 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:24.833 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:24.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:24.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:24.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:24.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:24 smithi163 bash[24253]: audit 2024-08-31T07:59:24.384907+0000 mgr.a (mgr.14388) 15054 : audit [DBG] from='client.326424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:24 smithi027 bash[22610]: audit 2024-08-31T07:59:24.384907+0000 mgr.a (mgr.14388) 15054 : audit [DBG] from='client.326424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:24 smithi191 bash[24992]: audit 2024-08-31T07:59:24.384907+0000 mgr.a (mgr.14388) 15054 : audit [DBG] from='client.326424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:25 smithi163 bash[24253]: cluster 2024-08-31T07:59:25.513637+0000 mgr.a (mgr.14388) 15055 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:25 smithi027 bash[22610]: cluster 2024-08-31T07:59:25.513637+0000 mgr.a (mgr.14388) 15055 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:25 smithi191 bash[24992]: cluster 2024-08-31T07:59:25.513637+0000 mgr.a (mgr.14388) 15055 : cluster [DBG] pgmap v10437: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:27 smithi163 bash[24253]: cluster 2024-08-31T07:59:27.514372+0000 mgr.a (mgr.14388) 15056 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:27 smithi027 bash[22610]: cluster 2024-08-31T07:59:27.514372+0000 mgr.a (mgr.14388) 15056 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:27 smithi191 bash[24992]: cluster 2024-08-31T07:59:27.514372+0000 mgr.a (mgr.14388) 15056 : cluster [DBG] pgmap v10438: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:29.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:29.836 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:29.836 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:29 smithi163 bash[24253]: cluster 2024-08-31T07:59:29.516590+0000 mgr.a (mgr.14388) 15057 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:29.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:29 smithi027 bash[22610]: cluster 2024-08-31T07:59:29.516590+0000 mgr.a (mgr.14388) 15057 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:29 smithi191 bash[24992]: cluster 2024-08-31T07:59:29.516590+0000 mgr.a (mgr.14388) 15057 : cluster [DBG] pgmap v10439: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:30.574 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:30.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:30.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:30.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:30.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:30 smithi163 bash[24253]: audit 2024-08-31T07:59:30.168415+0000 mgr.a (mgr.14388) 15058 : audit [DBG] from='client.326499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:30 smithi027 bash[22610]: audit 2024-08-31T07:59:30.168415+0000 mgr.a (mgr.14388) 15058 : audit [DBG] from='client.326499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:30 smithi191 bash[24992]: audit 2024-08-31T07:59:30.168415+0000 mgr.a (mgr.14388) 15058 : audit [DBG] from='client.326499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:31 smithi163 bash[24253]: cluster 2024-08-31T07:59:31.517488+0000 mgr.a (mgr.14388) 15059 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:31 smithi027 bash[22610]: cluster 2024-08-31T07:59:31.517488+0000 mgr.a (mgr.14388) 15059 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:31 smithi191 bash[24992]: cluster 2024-08-31T07:59:31.517488+0000 mgr.a (mgr.14388) 15059 : cluster [DBG] pgmap v10440: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:33 smithi163 bash[24253]: cluster 2024-08-31T07:59:33.519748+0000 mgr.a (mgr.14388) 15060 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:33 smithi027 bash[22610]: cluster 2024-08-31T07:59:33.519748+0000 mgr.a (mgr.14388) 15060 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:33 smithi191 bash[24992]: cluster 2024-08-31T07:59:33.519748+0000 mgr.a (mgr.14388) 15060 : cluster [DBG] pgmap v10441: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:35.576 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:35.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:35.577 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:35 smithi163 bash[24253]: cluster 2024-08-31T07:59:35.520511+0000 mgr.a (mgr.14388) 15061 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:35 smithi027 bash[22610]: cluster 2024-08-31T07:59:35.520511+0000 mgr.a (mgr.14388) 15061 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:35 smithi191 bash[24992]: cluster 2024-08-31T07:59:35.520511+0000 mgr.a (mgr.14388) 15061 : cluster [DBG] pgmap v10442: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:36.332 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:36.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:36.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:36.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:36.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:36 smithi163 bash[24253]: audit 2024-08-31T07:59:35.910462+0000 mgr.a (mgr.14388) 15062 : audit [DBG] from='client.326577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:36 smithi027 bash[22610]: audit 2024-08-31T07:59:35.910462+0000 mgr.a (mgr.14388) 15062 : audit [DBG] from='client.326577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:36 smithi191 bash[24992]: audit 2024-08-31T07:59:35.910462+0000 mgr.a (mgr.14388) 15062 : audit [DBG] from='client.326577 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:37 smithi163 bash[24253]: cluster 2024-08-31T07:59:37.521400+0000 mgr.a (mgr.14388) 15063 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:37 smithi027 bash[22610]: cluster 2024-08-31T07:59:37.521400+0000 mgr.a (mgr.14388) 15063 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:37 smithi191 bash[24992]: cluster 2024-08-31T07:59:37.521400+0000 mgr.a (mgr.14388) 15063 : cluster [DBG] pgmap v10443: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:39 smithi163 bash[24253]: cluster 2024-08-31T07:59:39.523608+0000 mgr.a (mgr.14388) 15064 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:39 smithi027 bash[22610]: cluster 2024-08-31T07:59:39.523608+0000 mgr.a (mgr.14388) 15064 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:39 smithi191 bash[24992]: cluster 2024-08-31T07:59:39.523608+0000 mgr.a (mgr.14388) 15064 : cluster [DBG] pgmap v10444: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:41.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:41.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:41.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:41 smithi163 bash[24253]: cluster 2024-08-31T07:59:41.524086+0000 mgr.a (mgr.14388) 15065 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:41 smithi027 bash[22610]: cluster 2024-08-31T07:59:41.524086+0000 mgr.a (mgr.14388) 15065 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:41 smithi191 bash[24992]: cluster 2024-08-31T07:59:41.524086+0000 mgr.a (mgr.14388) 15065 : cluster [DBG] pgmap v10445: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:42.085 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:42.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:42.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:42.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:42.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:42 smithi163 bash[24253]: audit 2024-08-31T07:59:41.665245+0000 mgr.a (mgr.14388) 15066 : audit [DBG] from='client.326655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:42 smithi027 bash[22610]: audit 2024-08-31T07:59:41.665245+0000 mgr.a (mgr.14388) 15066 : audit [DBG] from='client.326655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:43.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:42 smithi191 bash[24992]: audit 2024-08-31T07:59:41.665245+0000 mgr.a (mgr.14388) 15066 : audit [DBG] from='client.326655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:43 smithi163 bash[24253]: cluster 2024-08-31T07:59:43.526393+0000 mgr.a (mgr.14388) 15067 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:43 smithi027 bash[22610]: cluster 2024-08-31T07:59:43.526393+0000 mgr.a (mgr.14388) 15067 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:43 smithi191 bash[24992]: cluster 2024-08-31T07:59:43.526393+0000 mgr.a (mgr.14388) 15067 : cluster [DBG] pgmap v10446: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T07:59:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:44 smithi163 bash[24253]: audit 2024-08-31T07:59:43.862535+0000 mon.a (mon.0) 2827 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:59:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:44 smithi027 bash[22610]: audit 2024-08-31T07:59:43.862535+0000 mon.a (mon.0) 2827 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:59:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:44 smithi191 bash[24992]: audit 2024-08-31T07:59:43.862535+0000 mon.a (mon.0) 2827 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T07:59:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:45 smithi163 bash[24253]: audit 2024-08-31T07:59:44.706890+0000 mon.a (mon.0) 2828 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:59:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:45 smithi163 bash[24253]: audit 2024-08-31T07:59:44.708534+0000 mon.a (mon.0) 2829 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:59:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:45 smithi163 bash[24253]: audit 2024-08-31T07:59:44.718651+0000 mon.a (mon.0) 2830 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:59:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:45 smithi163 bash[24253]: audit 2024-08-31T07:59:44.723543+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:59:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:45 smithi163 bash[24253]: audit 2024-08-31T07:59:44.725844+0000 mgr.a (mgr.14388) 15068 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:59:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:45 smithi163 bash[24253]: audit 2024-08-31T07:59:45.497334+0000 mgr.a (mgr.14388) 15069 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:59:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:45 smithi163 bash[24253]: cephadm 2024-08-31T07:59:45.498979+0000 mgr.a (mgr.14388) 15070 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:59:45.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:45 smithi163 bash[24253]: cluster 2024-08-31T07:59:45.527226+0000 mgr.a (mgr.14388) 15071 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:45.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:59:45 smithi027 bash[22863]: debug 2024-08-31T07:59:45.492+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:59:45.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 07:59:45 smithi027 bash[22863]: debug 2024-08-31T07:59:45.496+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:59:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:45 smithi027 bash[22610]: audit 2024-08-31T07:59:44.706890+0000 mon.a (mon.0) 2828 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:59:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:45 smithi027 bash[22610]: audit 2024-08-31T07:59:44.708534+0000 mon.a (mon.0) 2829 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:59:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:45 smithi027 bash[22610]: audit 2024-08-31T07:59:44.718651+0000 mon.a (mon.0) 2830 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:59:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:45 smithi027 bash[22610]: audit 2024-08-31T07:59:44.723543+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:59:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:45 smithi027 bash[22610]: audit 2024-08-31T07:59:44.725844+0000 mgr.a (mgr.14388) 15068 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:59:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:45 smithi027 bash[22610]: audit 2024-08-31T07:59:45.497334+0000 mgr.a (mgr.14388) 15069 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:59:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:45 smithi027 bash[22610]: cephadm 2024-08-31T07:59:45.498979+0000 mgr.a (mgr.14388) 15070 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:59:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:45 smithi027 bash[22610]: cluster 2024-08-31T07:59:45.527226+0000 mgr.a (mgr.14388) 15071 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:45 smithi191 bash[24992]: audit 2024-08-31T07:59:44.706890+0000 mon.a (mon.0) 2828 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T07:59:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:45 smithi191 bash[24992]: audit 2024-08-31T07:59:44.708534+0000 mon.a (mon.0) 2829 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T07:59:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:45 smithi191 bash[24992]: audit 2024-08-31T07:59:44.718651+0000 mon.a (mon.0) 2830 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T07:59:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:45 smithi191 bash[24992]: audit 2024-08-31T07:59:44.723543+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:59:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:45 smithi191 bash[24992]: audit 2024-08-31T07:59:44.725844+0000 mgr.a (mgr.14388) 15068 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T07:59:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:45 smithi191 bash[24992]: audit 2024-08-31T07:59:45.497334+0000 mgr.a (mgr.14388) 15069 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T07:59:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:45 smithi191 bash[24992]: cephadm 2024-08-31T07:59:45.498979+0000 mgr.a (mgr.14388) 15070 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T07:59:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:45 smithi191 bash[24992]: cluster 2024-08-31T07:59:45.527226+0000 mgr.a (mgr.14388) 15071 : cluster [DBG] pgmap v10447: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:47.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:47.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:47.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:47.850 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:47.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:47 smithi163 bash[24253]: audit 2024-08-31T07:59:47.423062+0000 mgr.a (mgr.14388) 15072 : audit [DBG] from='client.326835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:47 smithi163 bash[24253]: cluster 2024-08-31T07:59:47.527645+0000 mgr.a (mgr.14388) 15073 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:47 smithi027 bash[22610]: audit 2024-08-31T07:59:47.423062+0000 mgr.a (mgr.14388) 15072 : audit [DBG] from='client.326835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:47 smithi027 bash[22610]: cluster 2024-08-31T07:59:47.527645+0000 mgr.a (mgr.14388) 15073 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:47 smithi191 bash[24992]: audit 2024-08-31T07:59:47.423062+0000 mgr.a (mgr.14388) 15072 : audit [DBG] from='client.326835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:47 smithi191 bash[24992]: cluster 2024-08-31T07:59:47.527645+0000 mgr.a (mgr.14388) 15073 : cluster [DBG] pgmap v10448: 225 pgs: 225 active+clean; 589 KiB data, 168 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T07:59:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:49 smithi163 bash[24253]: cluster 2024-08-31T07:59:49.529923+0000 mgr.a (mgr.14388) 15074 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:49 smithi027 bash[22610]: cluster 2024-08-31T07:59:49.529923+0000 mgr.a (mgr.14388) 15074 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:49 smithi191 bash[24992]: cluster 2024-08-31T07:59:49.529923+0000 mgr.a (mgr.14388) 15074 : cluster [DBG] pgmap v10449: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:51 smithi163 bash[24253]: cluster 2024-08-31T07:59:51.530739+0000 mgr.a (mgr.14388) 15075 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:51 smithi027 bash[22610]: cluster 2024-08-31T07:59:51.530739+0000 mgr.a (mgr.14388) 15075 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:51 smithi191 bash[24992]: cluster 2024-08-31T07:59:51.530739+0000 mgr.a (mgr.14388) 15075 : cluster [DBG] pgmap v10450: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:52.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:52.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:52.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:53.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:53.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:53.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:53.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:53.601 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:53 smithi163 bash[24253]: audit 2024-08-31T07:59:53.183635+0000 mgr.a (mgr.14388) 15076 : audit [DBG] from='client.326907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:53 smithi163 bash[24253]: cluster 2024-08-31T07:59:53.532036+0000 mgr.a (mgr.14388) 15077 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:53 smithi027 bash[22610]: audit 2024-08-31T07:59:53.183635+0000 mgr.a (mgr.14388) 15076 : audit [DBG] from='client.326907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:53 smithi027 bash[22610]: cluster 2024-08-31T07:59:53.532036+0000 mgr.a (mgr.14388) 15077 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:53 smithi191 bash[24992]: audit 2024-08-31T07:59:53.183635+0000 mgr.a (mgr.14388) 15076 : audit [DBG] from='client.326907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:53 smithi191 bash[24992]: cluster 2024-08-31T07:59:53.532036+0000 mgr.a (mgr.14388) 15077 : cluster [DBG] pgmap v10451: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:55 smithi163 bash[24253]: cluster 2024-08-31T07:59:55.532756+0000 mgr.a (mgr.14388) 15078 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:59:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:55 smithi027 bash[22610]: cluster 2024-08-31T07:59:55.532756+0000 mgr.a (mgr.14388) 15078 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:59:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:55 smithi191 bash[24992]: cluster 2024-08-31T07:59:55.532756+0000 mgr.a (mgr.14388) 15078 : cluster [DBG] pgmap v10452: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:59:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:57 smithi163 bash[24253]: cluster 2024-08-31T07:59:57.533509+0000 mgr.a (mgr.14388) 15079 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:59:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:57 smithi027 bash[22610]: cluster 2024-08-31T07:59:57.533509+0000 mgr.a (mgr.14388) 15079 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:59:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:57 smithi191 bash[24992]: cluster 2024-08-31T07:59:57.533509+0000 mgr.a (mgr.14388) 15079 : cluster [DBG] pgmap v10453: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T07:59:58.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T07:59:58.603 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T07:59:58.603 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T07:59:59.386 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T07:59:59.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T07:59:59.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T07:59:59.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T07:59:59.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T07:59:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:59 smithi163 bash[24253]: audit 2024-08-31T07:59:58.940466+0000 mgr.a (mgr.14388) 15080 : audit [DBG] from='client.326979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 07:59:59 smithi163 bash[24253]: cluster 2024-08-31T07:59:59.536353+0000 mgr.a (mgr.14388) 15081 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T07:59:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:59 smithi027 bash[22610]: audit 2024-08-31T07:59:58.940466+0000 mgr.a (mgr.14388) 15080 : audit [DBG] from='client.326979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T07:59:59.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 07:59:59 smithi027 bash[22610]: cluster 2024-08-31T07:59:59.536353+0000 mgr.a (mgr.14388) 15081 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:59 smithi191 bash[24992]: audit 2024-08-31T07:59:58.940466+0000 mgr.a (mgr.14388) 15080 : audit [DBG] from='client.326979 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 07:59:59 smithi191 bash[24992]: cluster 2024-08-31T07:59:59.536353+0000 mgr.a (mgr.14388) 15081 : cluster [DBG] pgmap v10454: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:00 smithi163 bash[24253]: cluster 2024-08-31T08:00:00.000144+0000 mon.a (mon.0) 2832 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:00:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:00 smithi027 bash[22610]: cluster 2024-08-31T08:00:00.000144+0000 mon.a (mon.0) 2832 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:00:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:00 smithi191 bash[24992]: cluster 2024-08-31T08:00:00.000144+0000 mon.a (mon.0) 2832 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:00:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:01 smithi163 bash[24253]: cluster 2024-08-31T08:00:01.537188+0000 mgr.a (mgr.14388) 15082 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:00:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:01 smithi027 bash[22610]: cluster 2024-08-31T08:00:01.537188+0000 mgr.a (mgr.14388) 15082 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:00:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:01 smithi191 bash[24992]: cluster 2024-08-31T08:00:01.537188+0000 mgr.a (mgr.14388) 15082 : cluster [DBG] pgmap v10455: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:00:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:03 smithi163 bash[24253]: cluster 2024-08-31T08:00:03.539280+0000 mgr.a (mgr.14388) 15083 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:03 smithi027 bash[22610]: cluster 2024-08-31T08:00:03.539280+0000 mgr.a (mgr.14388) 15083 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:03 smithi191 bash[24992]: cluster 2024-08-31T08:00:03.539280+0000 mgr.a (mgr.14388) 15083 : cluster [DBG] pgmap v10456: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:04.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:00:04.389 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:00:04.389 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:00:05.170 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:00:05.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:00:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:05 smithi163 bash[24253]: audit 2024-08-31T08:00:04.726457+0000 mgr.a (mgr.14388) 15084 : audit [DBG] from='client.327057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:05 smithi163 bash[24253]: cluster 2024-08-31T08:00:05.540161+0000 mgr.a (mgr.14388) 15085 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:05 smithi027 bash[22610]: audit 2024-08-31T08:00:04.726457+0000 mgr.a (mgr.14388) 15084 : audit [DBG] from='client.327057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:05 smithi027 bash[22610]: cluster 2024-08-31T08:00:05.540161+0000 mgr.a (mgr.14388) 15085 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:05 smithi191 bash[24992]: audit 2024-08-31T08:00:04.726457+0000 mgr.a (mgr.14388) 15084 : audit [DBG] from='client.327057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:05 smithi191 bash[24992]: cluster 2024-08-31T08:00:05.540161+0000 mgr.a (mgr.14388) 15085 : cluster [DBG] pgmap v10457: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:07 smithi163 bash[24253]: cluster 2024-08-31T08:00:07.540981+0000 mgr.a (mgr.14388) 15086 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:07 smithi027 bash[22610]: cluster 2024-08-31T08:00:07.540981+0000 mgr.a (mgr.14388) 15086 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:07 smithi191 bash[24992]: cluster 2024-08-31T08:00:07.540981+0000 mgr.a (mgr.14388) 15086 : cluster [DBG] pgmap v10458: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:10.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:00:10.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:00:10.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:00:10.947 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:00:10.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:00:10.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:00:10.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:00:10.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:00:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:10 smithi163 bash[24253]: cluster 2024-08-31T08:00:09.543252+0000 mgr.a (mgr.14388) 15087 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:10 smithi163 bash[24253]: audit 2024-08-31T08:00:10.508035+0000 mgr.a (mgr.14388) 15088 : audit [DBG] from='client.327129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:10 smithi027 bash[22610]: cluster 2024-08-31T08:00:09.543252+0000 mgr.a (mgr.14388) 15087 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:10 smithi027 bash[22610]: audit 2024-08-31T08:00:10.508035+0000 mgr.a (mgr.14388) 15088 : audit [DBG] from='client.327129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:10 smithi191 bash[24992]: cluster 2024-08-31T08:00:09.543252+0000 mgr.a (mgr.14388) 15087 : cluster [DBG] pgmap v10459: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:10 smithi191 bash[24992]: audit 2024-08-31T08:00:10.508035+0000 mgr.a (mgr.14388) 15088 : audit [DBG] from='client.327129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:12 smithi163 bash[24253]: cluster 2024-08-31T08:00:11.544141+0000 mgr.a (mgr.14388) 15089 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:12 smithi027 bash[22610]: cluster 2024-08-31T08:00:11.544141+0000 mgr.a (mgr.14388) 15089 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:12 smithi191 bash[24992]: cluster 2024-08-31T08:00:11.544141+0000 mgr.a (mgr.14388) 15089 : cluster [DBG] pgmap v10460: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:14 smithi163 bash[24253]: cluster 2024-08-31T08:00:13.546283+0000 mgr.a (mgr.14388) 15090 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:14 smithi027 bash[22610]: cluster 2024-08-31T08:00:13.546283+0000 mgr.a (mgr.14388) 15090 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:14 smithi191 bash[24992]: cluster 2024-08-31T08:00:13.546283+0000 mgr.a (mgr.14388) 15090 : cluster [DBG] pgmap v10461: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:00:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:00:15.949 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:00:16.712 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:00:16.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:00:16.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:00:16.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:00:16.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:00:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:16 smithi163 bash[24253]: cluster 2024-08-31T08:00:15.547040+0000 mgr.a (mgr.14388) 15091 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:16 smithi163 bash[24253]: audit 2024-08-31T08:00:16.284093+0000 mgr.a (mgr.14388) 15092 : audit [DBG] from='client.327207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:16 smithi027 bash[22610]: cluster 2024-08-31T08:00:15.547040+0000 mgr.a (mgr.14388) 15091 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:16 smithi027 bash[22610]: audit 2024-08-31T08:00:16.284093+0000 mgr.a (mgr.14388) 15092 : audit [DBG] from='client.327207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:16 smithi191 bash[24992]: cluster 2024-08-31T08:00:15.547040+0000 mgr.a (mgr.14388) 15091 : cluster [DBG] pgmap v10462: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:16 smithi191 bash[24992]: audit 2024-08-31T08:00:16.284093+0000 mgr.a (mgr.14388) 15092 : audit [DBG] from='client.327207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:18 smithi163 bash[24253]: cluster 2024-08-31T08:00:17.548032+0000 mgr.a (mgr.14388) 15093 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:18 smithi027 bash[22610]: cluster 2024-08-31T08:00:17.548032+0000 mgr.a (mgr.14388) 15093 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:18 smithi191 bash[24992]: cluster 2024-08-31T08:00:17.548032+0000 mgr.a (mgr.14388) 15093 : cluster [DBG] pgmap v10463: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:20 smithi163 bash[24253]: cluster 2024-08-31T08:00:19.550419+0000 mgr.a (mgr.14388) 15094 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:20 smithi027 bash[22610]: cluster 2024-08-31T08:00:19.550419+0000 mgr.a (mgr.14388) 15094 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:20 smithi191 bash[24992]: cluster 2024-08-31T08:00:19.550419+0000 mgr.a (mgr.14388) 15094 : cluster [DBG] pgmap v10464: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:00:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:00:21.714 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:00:22.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:00:22.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:00:22.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:00:22.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:00:22.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:00:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:22 smithi163 bash[24253]: cluster 2024-08-31T08:00:21.551228+0000 mgr.a (mgr.14388) 15095 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:22 smithi163 bash[24253]: audit 2024-08-31T08:00:22.053777+0000 mgr.a (mgr.14388) 15096 : audit [DBG] from='client.327282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:22 smithi027 bash[22610]: cluster 2024-08-31T08:00:21.551228+0000 mgr.a (mgr.14388) 15095 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:22 smithi027 bash[22610]: audit 2024-08-31T08:00:22.053777+0000 mgr.a (mgr.14388) 15096 : audit [DBG] from='client.327282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:22 smithi191 bash[24992]: cluster 2024-08-31T08:00:21.551228+0000 mgr.a (mgr.14388) 15095 : cluster [DBG] pgmap v10465: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:22 smithi191 bash[24992]: audit 2024-08-31T08:00:22.053777+0000 mgr.a (mgr.14388) 15096 : audit [DBG] from='client.327282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:24 smithi163 bash[24253]: cluster 2024-08-31T08:00:23.553465+0000 mgr.a (mgr.14388) 15097 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:24 smithi027 bash[22610]: cluster 2024-08-31T08:00:23.553465+0000 mgr.a (mgr.14388) 15097 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:24 smithi191 bash[24992]: cluster 2024-08-31T08:00:23.553465+0000 mgr.a (mgr.14388) 15097 : cluster [DBG] pgmap v10466: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:00:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:26 smithi163 bash[24253]: cluster 2024-08-31T08:00:25.554240+0000 mgr.a (mgr.14388) 15098 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:26 smithi027 bash[22610]: cluster 2024-08-31T08:00:25.554240+0000 mgr.a (mgr.14388) 15098 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:26 smithi191 bash[24992]: cluster 2024-08-31T08:00:25.554240+0000 mgr.a (mgr.14388) 15098 : cluster [DBG] pgmap v10467: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:27.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:00:27.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:00:27.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:00:28.264 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:00:28.264 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:00:28.264 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:00:28.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:00:28.265 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:00:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:28 smithi163 bash[24253]: cluster 2024-08-31T08:00:27.555023+0000 mgr.a (mgr.14388) 15099 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:28 smithi163 bash[24253]: audit 2024-08-31T08:00:27.827096+0000 mgr.a (mgr.14388) 15100 : audit [DBG] from='client.327360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:28 smithi027 bash[22610]: cluster 2024-08-31T08:00:27.555023+0000 mgr.a (mgr.14388) 15099 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:28 smithi027 bash[22610]: audit 2024-08-31T08:00:27.827096+0000 mgr.a (mgr.14388) 15100 : audit [DBG] from='client.327360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:28 smithi191 bash[24992]: cluster 2024-08-31T08:00:27.555023+0000 mgr.a (mgr.14388) 15099 : cluster [DBG] pgmap v10468: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:28 smithi191 bash[24992]: audit 2024-08-31T08:00:27.827096+0000 mgr.a (mgr.14388) 15100 : audit [DBG] from='client.327360 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:30 smithi163 bash[24253]: cluster 2024-08-31T08:00:29.557737+0000 mgr.a (mgr.14388) 15101 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:00:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:30 smithi027 bash[22610]: cluster 2024-08-31T08:00:29.557737+0000 mgr.a (mgr.14388) 15101 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:00:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:30 smithi191 bash[24992]: cluster 2024-08-31T08:00:29.557737+0000 mgr.a (mgr.14388) 15101 : cluster [DBG] pgmap v10469: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:00:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:32 smithi163 bash[24253]: cluster 2024-08-31T08:00:31.558519+0000 mgr.a (mgr.14388) 15102 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:00:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:32 smithi027 bash[22610]: cluster 2024-08-31T08:00:31.558519+0000 mgr.a (mgr.14388) 15102 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:00:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:32 smithi191 bash[24992]: cluster 2024-08-31T08:00:31.558519+0000 mgr.a (mgr.14388) 15102 : cluster [DBG] pgmap v10470: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:00:33.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:00:33.267 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:00:33.267 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:00:34.044 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:00:34.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:00:34.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:00:34.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:00:34.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:00:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:34 smithi163 bash[24253]: cluster 2024-08-31T08:00:33.560444+0000 mgr.a (mgr.14388) 15103 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:34 smithi163 bash[24253]: audit 2024-08-31T08:00:33.598147+0000 mgr.a (mgr.14388) 15104 : audit [DBG] from='client.327438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:34 smithi027 bash[22610]: cluster 2024-08-31T08:00:33.560444+0000 mgr.a (mgr.14388) 15103 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:34 smithi027 bash[22610]: audit 2024-08-31T08:00:33.598147+0000 mgr.a (mgr.14388) 15104 : audit [DBG] from='client.327438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:34 smithi191 bash[24992]: cluster 2024-08-31T08:00:33.560444+0000 mgr.a (mgr.14388) 15103 : cluster [DBG] pgmap v10471: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:34 smithi191 bash[24992]: audit 2024-08-31T08:00:33.598147+0000 mgr.a (mgr.14388) 15104 : audit [DBG] from='client.327438 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:36 smithi163 bash[24253]: cluster 2024-08-31T08:00:35.561381+0000 mgr.a (mgr.14388) 15105 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:00:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:36 smithi027 bash[22610]: cluster 2024-08-31T08:00:35.561381+0000 mgr.a (mgr.14388) 15105 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:00:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:36 smithi191 bash[24992]: cluster 2024-08-31T08:00:35.561381+0000 mgr.a (mgr.14388) 15105 : cluster [DBG] pgmap v10472: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:00:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:38 smithi163 bash[24253]: cluster 2024-08-31T08:00:37.562170+0000 mgr.a (mgr.14388) 15106 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:00:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:38 smithi027 bash[22610]: cluster 2024-08-31T08:00:37.562170+0000 mgr.a (mgr.14388) 15106 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:00:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:38 smithi191 bash[24992]: cluster 2024-08-31T08:00:37.562170+0000 mgr.a (mgr.14388) 15106 : cluster [DBG] pgmap v10473: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:00:39.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:00:39.046 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:00:39.046 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:00:39.804 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:00:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:00:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:00:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:00:39.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:00:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:39 smithi163 bash[24253]: audit 2024-08-31T08:00:39.380386+0000 mgr.a (mgr.14388) 15107 : audit [DBG] from='client.327516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:39 smithi027 bash[22610]: audit 2024-08-31T08:00:39.380386+0000 mgr.a (mgr.14388) 15107 : audit [DBG] from='client.327516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:39 smithi191 bash[24992]: audit 2024-08-31T08:00:39.380386+0000 mgr.a (mgr.14388) 15107 : audit [DBG] from='client.327516 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:40 smithi163 bash[24253]: cluster 2024-08-31T08:00:39.563568+0000 mgr.a (mgr.14388) 15108 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:40 smithi027 bash[22610]: cluster 2024-08-31T08:00:39.563568+0000 mgr.a (mgr.14388) 15108 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:41.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:40 smithi191 bash[24992]: cluster 2024-08-31T08:00:39.563568+0000 mgr.a (mgr.14388) 15108 : cluster [DBG] pgmap v10474: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:42 smithi163 bash[24253]: cluster 2024-08-31T08:00:41.564499+0000 mgr.a (mgr.14388) 15109 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:00:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:42 smithi027 bash[22610]: cluster 2024-08-31T08:00:41.564499+0000 mgr.a (mgr.14388) 15109 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:00:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:42 smithi191 bash[24992]: cluster 2024-08-31T08:00:41.564499+0000 mgr.a (mgr.14388) 15109 : cluster [DBG] pgmap v10475: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:00:44.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:00:44.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:00:44.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:00:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:44 smithi163 bash[24253]: cluster 2024-08-31T08:00:43.566662+0000 mgr.a (mgr.14388) 15110 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:00:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:44 smithi027 bash[22610]: cluster 2024-08-31T08:00:43.566662+0000 mgr.a (mgr.14388) 15110 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:00:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:44 smithi191 bash[24992]: cluster 2024-08-31T08:00:43.566662+0000 mgr.a (mgr.14388) 15110 : cluster [DBG] pgmap v10476: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:00:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:00:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:00:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:00:45.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:00:45.604 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:00:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:45 smithi163 bash[24253]: audit 2024-08-31T08:00:45.150579+0000 mgr.a (mgr.14388) 15111 : audit [DBG] from='client.327591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:45 smithi163 bash[24253]: audit 2024-08-31T08:00:45.550961+0000 mon.a (mon.0) 2833 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:00:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:45 smithi027 bash[22610]: audit 2024-08-31T08:00:45.150579+0000 mgr.a (mgr.14388) 15111 : audit [DBG] from='client.327591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:45 smithi027 bash[22610]: audit 2024-08-31T08:00:45.550961+0000 mon.a (mon.0) 2833 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:00:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:45 smithi191 bash[24992]: audit 2024-08-31T08:00:45.150579+0000 mgr.a (mgr.14388) 15111 : audit [DBG] from='client.327591 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:45 smithi191 bash[24992]: audit 2024-08-31T08:00:45.550961+0000 mon.a (mon.0) 2833 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:00:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:46 smithi163 bash[24253]: cluster 2024-08-31T08:00:45.567176+0000 mgr.a (mgr.14388) 15112 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:46 smithi163 bash[24253]: audit 2024-08-31T08:00:46.311181+0000 mon.a (mon.0) 2834 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:00:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:46 smithi163 bash[24253]: audit 2024-08-31T08:00:46.312815+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:00:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:46 smithi163 bash[24253]: audit 2024-08-31T08:00:46.321964+0000 mon.a (mon.0) 2836 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:00:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:46 smithi163 bash[24253]: audit 2024-08-31T08:00:46.324967+0000 mon.a (mon.0) 2837 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:00:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:46 smithi163 bash[24253]: audit 2024-08-31T08:00:46.327429+0000 mgr.a (mgr.14388) 15113 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:00:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:46 smithi027 bash[22610]: cluster 2024-08-31T08:00:45.567176+0000 mgr.a (mgr.14388) 15112 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:46 smithi027 bash[22610]: audit 2024-08-31T08:00:46.311181+0000 mon.a (mon.0) 2834 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:00:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:46 smithi027 bash[22610]: audit 2024-08-31T08:00:46.312815+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:00:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:46 smithi027 bash[22610]: audit 2024-08-31T08:00:46.321964+0000 mon.a (mon.0) 2836 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:00:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:46 smithi027 bash[22610]: audit 2024-08-31T08:00:46.324967+0000 mon.a (mon.0) 2837 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:00:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:46 smithi027 bash[22610]: audit 2024-08-31T08:00:46.327429+0000 mgr.a (mgr.14388) 15113 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:00:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:46 smithi191 bash[24992]: cluster 2024-08-31T08:00:45.567176+0000 mgr.a (mgr.14388) 15112 : cluster [DBG] pgmap v10477: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:46 smithi191 bash[24992]: audit 2024-08-31T08:00:46.311181+0000 mon.a (mon.0) 2834 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:00:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:46 smithi191 bash[24992]: audit 2024-08-31T08:00:46.312815+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:00:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:46 smithi191 bash[24992]: audit 2024-08-31T08:00:46.321964+0000 mon.a (mon.0) 2836 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:00:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:46 smithi191 bash[24992]: audit 2024-08-31T08:00:46.324967+0000 mon.a (mon.0) 2837 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:00:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:46 smithi191 bash[24992]: audit 2024-08-31T08:00:46.327429+0000 mgr.a (mgr.14388) 15113 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:00:47.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:00:47 smithi027 bash[22863]: debug 2024-08-31T08:00:47.063+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:00:47.605 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:00:47 smithi027 bash[22863]: debug 2024-08-31T08:00:47.063+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:00:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:47 smithi163 bash[24253]: audit 2024-08-31T08:00:47.068044+0000 mgr.a (mgr.14388) 15114 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:00:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:47 smithi163 bash[24253]: cephadm 2024-08-31T08:00:47.069383+0000 mgr.a (mgr.14388) 15115 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:00:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:47 smithi027 bash[22610]: audit 2024-08-31T08:00:47.068044+0000 mgr.a (mgr.14388) 15114 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:00:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:47 smithi027 bash[22610]: cephadm 2024-08-31T08:00:47.069383+0000 mgr.a (mgr.14388) 15115 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:00:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:47 smithi191 bash[24992]: audit 2024-08-31T08:00:47.068044+0000 mgr.a (mgr.14388) 15114 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:00:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:47 smithi191 bash[24992]: cephadm 2024-08-31T08:00:47.069383+0000 mgr.a (mgr.14388) 15115 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:00:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:48 smithi163 bash[24253]: cluster 2024-08-31T08:00:47.568088+0000 mgr.a (mgr.14388) 15116 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:48 smithi027 bash[22610]: cluster 2024-08-31T08:00:47.568088+0000 mgr.a (mgr.14388) 15116 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:48 smithi191 bash[24992]: cluster 2024-08-31T08:00:47.568088+0000 mgr.a (mgr.14388) 15116 : cluster [DBG] pgmap v10478: 225 pgs: 225 active+clean; 589 KiB data, 172 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:00:50.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:00:50.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:00:50.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:00:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:50 smithi027 bash[22610]: cluster 2024-08-31T08:00:49.570306+0000 mgr.a (mgr.14388) 15117 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:50 smithi191 bash[24992]: cluster 2024-08-31T08:00:49.570306+0000 mgr.a (mgr.14388) 15117 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:50 smithi163 bash[24253]: cluster 2024-08-31T08:00:49.570306+0000 mgr.a (mgr.14388) 15117 : cluster [DBG] pgmap v10479: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:51.358 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:00:51.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:00:51.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:00:51.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:00:51.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:00:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:51 smithi027 bash[22610]: audit 2024-08-31T08:00:50.937451+0000 mgr.a (mgr.14388) 15118 : audit [DBG] from='client.327768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:51 smithi191 bash[24992]: audit 2024-08-31T08:00:50.937451+0000 mgr.a (mgr.14388) 15118 : audit [DBG] from='client.327768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:51 smithi163 bash[24253]: audit 2024-08-31T08:00:50.937451+0000 mgr.a (mgr.14388) 15118 : audit [DBG] from='client.327768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:52 smithi027 bash[22610]: cluster 2024-08-31T08:00:51.571262+0000 mgr.a (mgr.14388) 15119 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:52 smithi191 bash[24992]: cluster 2024-08-31T08:00:51.571262+0000 mgr.a (mgr.14388) 15119 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:52 smithi163 bash[24253]: cluster 2024-08-31T08:00:51.571262+0000 mgr.a (mgr.14388) 15119 : cluster [DBG] pgmap v10480: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:54 smithi027 bash[22610]: cluster 2024-08-31T08:00:53.573399+0000 mgr.a (mgr.14388) 15120 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:54 smithi191 bash[24992]: cluster 2024-08-31T08:00:53.573399+0000 mgr.a (mgr.14388) 15120 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:54 smithi163 bash[24253]: cluster 2024-08-31T08:00:53.573399+0000 mgr.a (mgr.14388) 15120 : cluster [DBG] pgmap v10481: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:56.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:00:56.360 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:00:56.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:00:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:56 smithi027 bash[22610]: cluster 2024-08-31T08:00:55.574171+0000 mgr.a (mgr.14388) 15121 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:56 smithi191 bash[24992]: cluster 2024-08-31T08:00:55.574171+0000 mgr.a (mgr.14388) 15121 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:57.130 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:00:57.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:00:57.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:00:57.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:00:57.130 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:00:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:56 smithi163 bash[24253]: cluster 2024-08-31T08:00:55.574171+0000 mgr.a (mgr.14388) 15121 : cluster [DBG] pgmap v10482: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:57 smithi027 bash[22610]: audit 2024-08-31T08:00:56.692842+0000 mgr.a (mgr.14388) 15122 : audit [DBG] from='client.327846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:57 smithi191 bash[24992]: audit 2024-08-31T08:00:56.692842+0000 mgr.a (mgr.14388) 15122 : audit [DBG] from='client.327846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:57 smithi163 bash[24253]: audit 2024-08-31T08:00:56.692842+0000 mgr.a (mgr.14388) 15122 : audit [DBG] from='client.327846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:00:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:00:58 smithi027 bash[22610]: cluster 2024-08-31T08:00:57.575146+0000 mgr.a (mgr.14388) 15123 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:00:58 smithi191 bash[24992]: cluster 2024-08-31T08:00:57.575146+0000 mgr.a (mgr.14388) 15123 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:00:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:00:58 smithi163 bash[24253]: cluster 2024-08-31T08:00:57.575146+0000 mgr.a (mgr.14388) 15123 : cluster [DBG] pgmap v10483: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:00 smithi191 bash[24992]: cluster 2024-08-31T08:00:59.577366+0000 mgr.a (mgr.14388) 15124 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:00 smithi163 bash[24253]: cluster 2024-08-31T08:00:59.577366+0000 mgr.a (mgr.14388) 15124 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:00 smithi027 bash[22610]: cluster 2024-08-31T08:00:59.577366+0000 mgr.a (mgr.14388) 15124 : cluster [DBG] pgmap v10484: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:02.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:02.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:02.132 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:01:02.902 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:01:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:01:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:01:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:01:02.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:01:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:02 smithi191 bash[24992]: cluster 2024-08-31T08:01:01.578139+0000 mgr.a (mgr.14388) 15125 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:02 smithi191 bash[24992]: audit 2024-08-31T08:01:02.464809+0000 mgr.a (mgr.14388) 15126 : audit [DBG] from='client.327921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:02 smithi163 bash[24253]: cluster 2024-08-31T08:01:01.578139+0000 mgr.a (mgr.14388) 15125 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:02 smithi163 bash[24253]: audit 2024-08-31T08:01:02.464809+0000 mgr.a (mgr.14388) 15126 : audit [DBG] from='client.327921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:02 smithi027 bash[22610]: cluster 2024-08-31T08:01:01.578139+0000 mgr.a (mgr.14388) 15125 : cluster [DBG] pgmap v10485: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:02 smithi027 bash[22610]: audit 2024-08-31T08:01:02.464809+0000 mgr.a (mgr.14388) 15126 : audit [DBG] from='client.327921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:04 smithi191 bash[24992]: cluster 2024-08-31T08:01:03.580638+0000 mgr.a (mgr.14388) 15127 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:01:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:04 smithi163 bash[24253]: cluster 2024-08-31T08:01:03.580638+0000 mgr.a (mgr.14388) 15127 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:01:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:04 smithi027 bash[22610]: cluster 2024-08-31T08:01:03.580638+0000 mgr.a (mgr.14388) 15127 : cluster [DBG] pgmap v10486: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:01:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:06 smithi191 bash[24992]: cluster 2024-08-31T08:01:05.581610+0000 mgr.a (mgr.14388) 15128 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:01:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:06 smithi163 bash[24253]: cluster 2024-08-31T08:01:05.581610+0000 mgr.a (mgr.14388) 15128 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:01:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:06 smithi027 bash[22610]: cluster 2024-08-31T08:01:05.581610+0000 mgr.a (mgr.14388) 15128 : cluster [DBG] pgmap v10487: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:01:07.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:07.905 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:07.905 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:01:08.689 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:01:08.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:01:08.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:01:08.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:01:08.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:01:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:08 smithi191 bash[24992]: cluster 2024-08-31T08:01:07.582564+0000 mgr.a (mgr.14388) 15129 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:01:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:08 smithi191 bash[24992]: audit 2024-08-31T08:01:08.238535+0000 mgr.a (mgr.14388) 15130 : audit [DBG] from='client.327999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:08 smithi163 bash[24253]: cluster 2024-08-31T08:01:07.582564+0000 mgr.a (mgr.14388) 15129 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:01:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:08 smithi163 bash[24253]: audit 2024-08-31T08:01:08.238535+0000 mgr.a (mgr.14388) 15130 : audit [DBG] from='client.327999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:08 smithi027 bash[22610]: cluster 2024-08-31T08:01:07.582564+0000 mgr.a (mgr.14388) 15129 : cluster [DBG] pgmap v10488: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:01:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:08 smithi027 bash[22610]: audit 2024-08-31T08:01:08.238535+0000 mgr.a (mgr.14388) 15130 : audit [DBG] from='client.327999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:10 smithi163 bash[24253]: cluster 2024-08-31T08:01:09.585566+0000 mgr.a (mgr.14388) 15131 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:10 smithi027 bash[22610]: cluster 2024-08-31T08:01:09.585566+0000 mgr.a (mgr.14388) 15131 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:10 smithi191 bash[24992]: cluster 2024-08-31T08:01:09.585566+0000 mgr.a (mgr.14388) 15131 : cluster [DBG] pgmap v10489: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:12 smithi163 bash[24253]: cluster 2024-08-31T08:01:11.586525+0000 mgr.a (mgr.14388) 15132 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:01:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:12 smithi027 bash[22610]: cluster 2024-08-31T08:01:11.586525+0000 mgr.a (mgr.14388) 15132 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:01:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:12 smithi191 bash[24992]: cluster 2024-08-31T08:01:11.586525+0000 mgr.a (mgr.14388) 15132 : cluster [DBG] pgmap v10490: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:01:13.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:13.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:13.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:01:14.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:01:14.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:01:14.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:01:14.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:01:14.444 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:01:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:14 smithi163 bash[24253]: cluster 2024-08-31T08:01:13.588657+0000 mgr.a (mgr.14388) 15133 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:14 smithi163 bash[24253]: audit 2024-08-31T08:01:14.025596+0000 mgr.a (mgr.14388) 15134 : audit [DBG] from='client.328077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:14 smithi027 bash[22610]: cluster 2024-08-31T08:01:13.588657+0000 mgr.a (mgr.14388) 15133 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:14 smithi027 bash[22610]: audit 2024-08-31T08:01:14.025596+0000 mgr.a (mgr.14388) 15134 : audit [DBG] from='client.328077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:14 smithi191 bash[24992]: cluster 2024-08-31T08:01:13.588657+0000 mgr.a (mgr.14388) 15133 : cluster [DBG] pgmap v10491: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:14 smithi191 bash[24992]: audit 2024-08-31T08:01:14.025596+0000 mgr.a (mgr.14388) 15134 : audit [DBG] from='client.328077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:16 smithi163 bash[24253]: cluster 2024-08-31T08:01:15.589733+0000 mgr.a (mgr.14388) 15135 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T08:01:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:16 smithi027 bash[22610]: cluster 2024-08-31T08:01:15.589733+0000 mgr.a (mgr.14388) 15135 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T08:01:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:16 smithi191 bash[24992]: cluster 2024-08-31T08:01:15.589733+0000 mgr.a (mgr.14388) 15135 : cluster [DBG] pgmap v10492: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T08:01:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:18 smithi163 bash[24253]: cluster 2024-08-31T08:01:17.590531+0000 mgr.a (mgr.14388) 15136 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T08:01:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:18 smithi027 bash[22610]: cluster 2024-08-31T08:01:17.590531+0000 mgr.a (mgr.14388) 15136 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T08:01:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:18 smithi191 bash[24992]: cluster 2024-08-31T08:01:17.590531+0000 mgr.a (mgr.14388) 15136 : cluster [DBG] pgmap v10493: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T08:01:19.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:19.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:19.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:01:20.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:01:20.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:01:20.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:01:20.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:01:20.215 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:01:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:20 smithi163 bash[24253]: cluster 2024-08-31T08:01:19.592212+0000 mgr.a (mgr.14388) 15137 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:01:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:20 smithi163 bash[24253]: audit 2024-08-31T08:01:19.782317+0000 mgr.a (mgr.14388) 15138 : audit [DBG] from='client.328152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:20 smithi027 bash[22610]: cluster 2024-08-31T08:01:19.592212+0000 mgr.a (mgr.14388) 15137 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:01:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:20 smithi027 bash[22610]: audit 2024-08-31T08:01:19.782317+0000 mgr.a (mgr.14388) 15138 : audit [DBG] from='client.328152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:21.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:20 smithi191 bash[24992]: cluster 2024-08-31T08:01:19.592212+0000 mgr.a (mgr.14388) 15137 : cluster [DBG] pgmap v10494: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:01:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:20 smithi191 bash[24992]: audit 2024-08-31T08:01:19.782317+0000 mgr.a (mgr.14388) 15138 : audit [DBG] from='client.328152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:22 smithi163 bash[24253]: cluster 2024-08-31T08:01:21.593178+0000 mgr.a (mgr.14388) 15139 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:22 smithi027 bash[22610]: cluster 2024-08-31T08:01:21.593178+0000 mgr.a (mgr.14388) 15139 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:22 smithi191 bash[24992]: cluster 2024-08-31T08:01:21.593178+0000 mgr.a (mgr.14388) 15139 : cluster [DBG] pgmap v10495: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:24 smithi163 bash[24253]: cluster 2024-08-31T08:01:23.595356+0000 mgr.a (mgr.14388) 15140 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:25.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:25.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:25.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:01:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:24 smithi027 bash[22610]: cluster 2024-08-31T08:01:23.595356+0000 mgr.a (mgr.14388) 15140 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:24 smithi191 bash[24992]: cluster 2024-08-31T08:01:23.595356+0000 mgr.a (mgr.14388) 15140 : cluster [DBG] pgmap v10496: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:26.004 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:01:26.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:01:26.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:01:26.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:01:26.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:01:26.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:25 smithi163 bash[24253]: audit 2024-08-31T08:01:25.556867+0000 mgr.a (mgr.14388) 15141 : audit [DBG] from='client.328230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:25 smithi027 bash[22610]: audit 2024-08-31T08:01:25.556867+0000 mgr.a (mgr.14388) 15141 : audit [DBG] from='client.328230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:25 smithi191 bash[24992]: audit 2024-08-31T08:01:25.556867+0000 mgr.a (mgr.14388) 15141 : audit [DBG] from='client.328230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:27.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:26 smithi163 bash[24253]: cluster 2024-08-31T08:01:25.596123+0000 mgr.a (mgr.14388) 15142 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:26 smithi027 bash[22610]: cluster 2024-08-31T08:01:25.596123+0000 mgr.a (mgr.14388) 15142 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:26 smithi191 bash[24992]: cluster 2024-08-31T08:01:25.596123+0000 mgr.a (mgr.14388) 15142 : cluster [DBG] pgmap v10497: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:28 smithi027 bash[22610]: cluster 2024-08-31T08:01:27.597230+0000 mgr.a (mgr.14388) 15143 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:28 smithi191 bash[24992]: cluster 2024-08-31T08:01:27.597230+0000 mgr.a (mgr.14388) 15143 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:28 smithi163 bash[24253]: cluster 2024-08-31T08:01:27.597230+0000 mgr.a (mgr.14388) 15143 : cluster [DBG] pgmap v10498: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:31.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:31.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:01:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:30 smithi027 bash[22610]: cluster 2024-08-31T08:01:29.599509+0000 mgr.a (mgr.14388) 15144 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:30 smithi191 bash[24992]: cluster 2024-08-31T08:01:29.599509+0000 mgr.a (mgr.14388) 15144 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:30 smithi163 bash[24253]: cluster 2024-08-31T08:01:29.599509+0000 mgr.a (mgr.14388) 15144 : cluster [DBG] pgmap v10499: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:31.784 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:01:31.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:01:31.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:01:31.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:01:31.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:01:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:31 smithi027 bash[22610]: audit 2024-08-31T08:01:31.339874+0000 mgr.a (mgr.14388) 15145 : audit [DBG] from='client.328305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:31 smithi191 bash[24992]: audit 2024-08-31T08:01:31.339874+0000 mgr.a (mgr.14388) 15145 : audit [DBG] from='client.328305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:31 smithi163 bash[24253]: audit 2024-08-31T08:01:31.339874+0000 mgr.a (mgr.14388) 15145 : audit [DBG] from='client.328305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:32 smithi027 bash[22610]: cluster 2024-08-31T08:01:31.600158+0000 mgr.a (mgr.14388) 15146 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:32 smithi191 bash[24992]: cluster 2024-08-31T08:01:31.600158+0000 mgr.a (mgr.14388) 15146 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:32 smithi163 bash[24253]: cluster 2024-08-31T08:01:31.600158+0000 mgr.a (mgr.14388) 15146 : cluster [DBG] pgmap v10500: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:34 smithi027 bash[22610]: cluster 2024-08-31T08:01:33.602408+0000 mgr.a (mgr.14388) 15147 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:34 smithi191 bash[24992]: cluster 2024-08-31T08:01:33.602408+0000 mgr.a (mgr.14388) 15147 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:34 smithi163 bash[24253]: cluster 2024-08-31T08:01:33.602408+0000 mgr.a (mgr.14388) 15147 : cluster [DBG] pgmap v10501: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:36.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:36.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:36.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:01:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:36 smithi027 bash[22610]: cluster 2024-08-31T08:01:35.603164+0000 mgr.a (mgr.14388) 15148 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:36 smithi191 bash[24992]: cluster 2024-08-31T08:01:35.603164+0000 mgr.a (mgr.14388) 15148 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:36 smithi163 bash[24253]: cluster 2024-08-31T08:01:35.603164+0000 mgr.a (mgr.14388) 15148 : cluster [DBG] pgmap v10502: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:37.577 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:01:37.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:01:37.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:01:37.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:01:37.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:01:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:37 smithi191 bash[24992]: audit 2024-08-31T08:01:37.130906+0000 mgr.a (mgr.14388) 15149 : audit [DBG] from='client.328380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:37 smithi163 bash[24253]: audit 2024-08-31T08:01:37.130906+0000 mgr.a (mgr.14388) 15149 : audit [DBG] from='client.328380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:37 smithi027 bash[22610]: audit 2024-08-31T08:01:37.130906+0000 mgr.a (mgr.14388) 15149 : audit [DBG] from='client.328380 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:39.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:38 smithi191 bash[24992]: cluster 2024-08-31T08:01:37.603666+0000 mgr.a (mgr.14388) 15150 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:38 smithi163 bash[24253]: cluster 2024-08-31T08:01:37.603666+0000 mgr.a (mgr.14388) 15150 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:38 smithi027 bash[22610]: cluster 2024-08-31T08:01:37.603666+0000 mgr.a (mgr.14388) 15150 : cluster [DBG] pgmap v10503: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:40 smithi191 bash[24992]: cluster 2024-08-31T08:01:39.605853+0000 mgr.a (mgr.14388) 15151 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:40 smithi163 bash[24253]: cluster 2024-08-31T08:01:39.605853+0000 mgr.a (mgr.14388) 15151 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:40 smithi027 bash[22610]: cluster 2024-08-31T08:01:39.605853+0000 mgr.a (mgr.14388) 15151 : cluster [DBG] pgmap v10504: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:01:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:42.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:42.580 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:01:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:42 smithi191 bash[24992]: cluster 2024-08-31T08:01:41.606644+0000 mgr.a (mgr.14388) 15152 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:43.314 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:01:43.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:01:43.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:01:43.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:01:43.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:01:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:42 smithi163 bash[24253]: cluster 2024-08-31T08:01:41.606644+0000 mgr.a (mgr.14388) 15152 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:42 smithi027 bash[22610]: cluster 2024-08-31T08:01:41.606644+0000 mgr.a (mgr.14388) 15152 : cluster [DBG] pgmap v10505: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:44 smithi191 bash[24992]: audit 2024-08-31T08:01:42.906065+0000 mgr.a (mgr.14388) 15153 : audit [DBG] from='client.328458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:44 smithi163 bash[24253]: audit 2024-08-31T08:01:42.906065+0000 mgr.a (mgr.14388) 15153 : audit [DBG] from='client.328458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:44 smithi027 bash[22610]: audit 2024-08-31T08:01:42.906065+0000 mgr.a (mgr.14388) 15153 : audit [DBG] from='client.328458 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:45 smithi191 bash[24992]: cluster 2024-08-31T08:01:43.609554+0000 mgr.a (mgr.14388) 15154 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:45 smithi163 bash[24253]: cluster 2024-08-31T08:01:43.609554+0000 mgr.a (mgr.14388) 15154 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:45 smithi027 bash[22610]: cluster 2024-08-31T08:01:43.609554+0000 mgr.a (mgr.14388) 15154 : cluster [DBG] pgmap v10506: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:47 smithi191 bash[24992]: cluster 2024-08-31T08:01:45.610368+0000 mgr.a (mgr.14388) 15155 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:01:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:47 smithi163 bash[24253]: cluster 2024-08-31T08:01:45.610368+0000 mgr.a (mgr.14388) 15155 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:01:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:47 smithi027 bash[22610]: cluster 2024-08-31T08:01:45.610368+0000 mgr.a (mgr.14388) 15155 : cluster [DBG] pgmap v10507: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:01:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:48 smithi191 bash[24992]: audit 2024-08-31T08:01:47.119184+0000 mon.a (mon.0) 2838 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:01:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:48 smithi191 bash[24992]: audit 2024-08-31T08:01:47.963039+0000 mon.a (mon.0) 2839 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:01:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:48 smithi191 bash[24992]: audit 2024-08-31T08:01:47.964387+0000 mon.a (mon.0) 2840 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:01:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:48 smithi191 bash[24992]: audit 2024-08-31T08:01:47.973138+0000 mon.a (mon.0) 2841 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:01:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:48 smithi191 bash[24992]: audit 2024-08-31T08:01:47.975534+0000 mon.a (mon.0) 2842 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:01:48.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:48.316 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:48.316 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:01:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:48 smithi163 bash[24253]: audit 2024-08-31T08:01:47.119184+0000 mon.a (mon.0) 2838 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:01:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:48 smithi163 bash[24253]: audit 2024-08-31T08:01:47.963039+0000 mon.a (mon.0) 2839 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:01:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:48 smithi163 bash[24253]: audit 2024-08-31T08:01:47.964387+0000 mon.a (mon.0) 2840 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:01:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:48 smithi163 bash[24253]: audit 2024-08-31T08:01:47.973138+0000 mon.a (mon.0) 2841 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:01:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:48 smithi163 bash[24253]: audit 2024-08-31T08:01:47.975534+0000 mon.a (mon.0) 2842 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:01:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:48 smithi027 bash[22610]: audit 2024-08-31T08:01:47.119184+0000 mon.a (mon.0) 2838 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:01:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:48 smithi027 bash[22610]: audit 2024-08-31T08:01:47.963039+0000 mon.a (mon.0) 2839 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:01:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:48 smithi027 bash[22610]: audit 2024-08-31T08:01:47.964387+0000 mon.a (mon.0) 2840 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:01:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:48 smithi027 bash[22610]: audit 2024-08-31T08:01:47.973138+0000 mon.a (mon.0) 2841 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:01:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:48 smithi027 bash[22610]: audit 2024-08-31T08:01:47.975534+0000 mon.a (mon.0) 2842 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:01:48.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:01:48 smithi027 bash[22863]: debug 2024-08-31T08:01:48.729+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:01:48.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:01:48 smithi027 bash[22863]: debug 2024-08-31T08:01:48.741+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:01:49.150 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:01:49.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:01:49.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:01:49.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:01:49.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:01:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:49 smithi191 bash[24992]: cluster 2024-08-31T08:01:47.610914+0000 mgr.a (mgr.14388) 15156 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:01:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:49 smithi191 bash[24992]: audit 2024-08-31T08:01:47.977732+0000 mgr.a (mgr.14388) 15157 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:01:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:49 smithi163 bash[24253]: cluster 2024-08-31T08:01:47.610914+0000 mgr.a (mgr.14388) 15156 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:01:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:49 smithi163 bash[24253]: audit 2024-08-31T08:01:47.977732+0000 mgr.a (mgr.14388) 15157 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:01:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:49 smithi027 bash[22610]: cluster 2024-08-31T08:01:47.610914+0000 mgr.a (mgr.14388) 15156 : cluster [DBG] pgmap v10508: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:01:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:49 smithi027 bash[22610]: audit 2024-08-31T08:01:47.977732+0000 mgr.a (mgr.14388) 15157 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:01:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:50 smithi163 bash[24253]: audit 2024-08-31T08:01:48.654273+0000 mgr.a (mgr.14388) 15158 : audit [DBG] from='client.328608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:50 smithi163 bash[24253]: audit 2024-08-31T08:01:48.731261+0000 mgr.a (mgr.14388) 15159 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:01:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:50 smithi163 bash[24253]: cephadm 2024-08-31T08:01:48.744245+0000 mgr.a (mgr.14388) 15160 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:01:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:50 smithi027 bash[22610]: audit 2024-08-31T08:01:48.654273+0000 mgr.a (mgr.14388) 15158 : audit [DBG] from='client.328608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:50 smithi027 bash[22610]: audit 2024-08-31T08:01:48.731261+0000 mgr.a (mgr.14388) 15159 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:01:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:50 smithi027 bash[22610]: cephadm 2024-08-31T08:01:48.744245+0000 mgr.a (mgr.14388) 15160 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:01:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:50 smithi191 bash[24992]: audit 2024-08-31T08:01:48.654273+0000 mgr.a (mgr.14388) 15158 : audit [DBG] from='client.328608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:50 smithi191 bash[24992]: audit 2024-08-31T08:01:48.731261+0000 mgr.a (mgr.14388) 15159 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:01:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:50 smithi191 bash[24992]: cephadm 2024-08-31T08:01:48.744245+0000 mgr.a (mgr.14388) 15160 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:01:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:51 smithi163 bash[24253]: cluster 2024-08-31T08:01:49.613701+0000 mgr.a (mgr.14388) 15161 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:51 smithi027 bash[22610]: cluster 2024-08-31T08:01:49.613701+0000 mgr.a (mgr.14388) 15161 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:51 smithi191 bash[24992]: cluster 2024-08-31T08:01:49.613701+0000 mgr.a (mgr.14388) 15161 : cluster [DBG] pgmap v10509: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:01:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:53 smithi163 bash[24253]: cluster 2024-08-31T08:01:51.614476+0000 mgr.a (mgr.14388) 15162 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:01:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:53 smithi027 bash[22610]: cluster 2024-08-31T08:01:51.614476+0000 mgr.a (mgr.14388) 15162 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:01:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:53 smithi191 bash[24992]: cluster 2024-08-31T08:01:51.614476+0000 mgr.a (mgr.14388) 15162 : cluster [DBG] pgmap v10510: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:01:54.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:54.153 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:54.153 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:01:54.908 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:01:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:01:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:01:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:01:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:01:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:55 smithi163 bash[24253]: cluster 2024-08-31T08:01:53.616441+0000 mgr.a (mgr.14388) 15163 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:55 smithi163 bash[24253]: audit 2024-08-31T08:01:54.482604+0000 mgr.a (mgr.14388) 15164 : audit [DBG] from='client.328713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:55 smithi027 bash[22610]: cluster 2024-08-31T08:01:53.616441+0000 mgr.a (mgr.14388) 15163 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:55 smithi027 bash[22610]: audit 2024-08-31T08:01:54.482604+0000 mgr.a (mgr.14388) 15164 : audit [DBG] from='client.328713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:55 smithi191 bash[24992]: cluster 2024-08-31T08:01:53.616441+0000 mgr.a (mgr.14388) 15163 : cluster [DBG] pgmap v10511: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:55 smithi191 bash[24992]: audit 2024-08-31T08:01:54.482604+0000 mgr.a (mgr.14388) 15164 : audit [DBG] from='client.328713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:01:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:57 smithi163 bash[24253]: cluster 2024-08-31T08:01:55.617384+0000 mgr.a (mgr.14388) 15165 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:57 smithi027 bash[22610]: cluster 2024-08-31T08:01:55.617384+0000 mgr.a (mgr.14388) 15165 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:57 smithi191 bash[24992]: cluster 2024-08-31T08:01:55.617384+0000 mgr.a (mgr.14388) 15165 : cluster [DBG] pgmap v10512: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:01:59 smithi163 bash[24253]: cluster 2024-08-31T08:01:57.618161+0000 mgr.a (mgr.14388) 15166 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:01:59 smithi027 bash[22610]: cluster 2024-08-31T08:01:57.618161+0000 mgr.a (mgr.14388) 15166 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:01:59 smithi191 bash[24992]: cluster 2024-08-31T08:01:57.618161+0000 mgr.a (mgr.14388) 15166 : cluster [DBG] pgmap v10513: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:01:59.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:01:59.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:01:59.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:00.715 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:00.716 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:01 smithi163 bash[24253]: cluster 2024-08-31T08:01:59.620385+0000 mgr.a (mgr.14388) 15167 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:02:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:01 smithi163 bash[24253]: audit 2024-08-31T08:02:00.261499+0000 mgr.a (mgr.14388) 15168 : audit [DBG] from='client.328788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:01 smithi027 bash[22610]: cluster 2024-08-31T08:01:59.620385+0000 mgr.a (mgr.14388) 15167 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:02:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:01 smithi027 bash[22610]: audit 2024-08-31T08:02:00.261499+0000 mgr.a (mgr.14388) 15168 : audit [DBG] from='client.328788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:01 smithi191 bash[24992]: cluster 2024-08-31T08:01:59.620385+0000 mgr.a (mgr.14388) 15167 : cluster [DBG] pgmap v10514: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:02:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:01 smithi191 bash[24992]: audit 2024-08-31T08:02:00.261499+0000 mgr.a (mgr.14388) 15168 : audit [DBG] from='client.328788 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:03 smithi163 bash[24253]: cluster 2024-08-31T08:02:01.621358+0000 mgr.a (mgr.14388) 15169 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:02:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:03 smithi027 bash[22610]: cluster 2024-08-31T08:02:01.621358+0000 mgr.a (mgr.14388) 15169 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:02:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:03 smithi191 bash[24992]: cluster 2024-08-31T08:02:01.621358+0000 mgr.a (mgr.14388) 15169 : cluster [DBG] pgmap v10515: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:02:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:05 smithi163 bash[24253]: cluster 2024-08-31T08:02:03.623595+0000 mgr.a (mgr.14388) 15170 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:02:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:05 smithi027 bash[22610]: cluster 2024-08-31T08:02:03.623595+0000 mgr.a (mgr.14388) 15170 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:02:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:05 smithi191 bash[24992]: cluster 2024-08-31T08:02:03.623595+0000 mgr.a (mgr.14388) 15170 : cluster [DBG] pgmap v10516: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:02:05.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:02:05.717 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:02:05.717 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:06.501 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:06.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:06.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:06.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:06.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:07 smithi163 bash[24253]: cluster 2024-08-31T08:02:05.624367+0000 mgr.a (mgr.14388) 15171 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:07 smithi163 bash[24253]: audit 2024-08-31T08:02:06.054765+0000 mgr.a (mgr.14388) 15172 : audit [DBG] from='client.328866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:07 smithi027 bash[22610]: cluster 2024-08-31T08:02:05.624367+0000 mgr.a (mgr.14388) 15171 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:07 smithi027 bash[22610]: audit 2024-08-31T08:02:06.054765+0000 mgr.a (mgr.14388) 15172 : audit [DBG] from='client.328866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:07 smithi191 bash[24992]: cluster 2024-08-31T08:02:05.624367+0000 mgr.a (mgr.14388) 15171 : cluster [DBG] pgmap v10517: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:07 smithi191 bash[24992]: audit 2024-08-31T08:02:06.054765+0000 mgr.a (mgr.14388) 15172 : audit [DBG] from='client.328866 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:09 smithi163 bash[24253]: cluster 2024-08-31T08:02:07.625253+0000 mgr.a (mgr.14388) 15173 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:09 smithi027 bash[22610]: cluster 2024-08-31T08:02:07.625253+0000 mgr.a (mgr.14388) 15173 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:09 smithi191 bash[24992]: cluster 2024-08-31T08:02:07.625253+0000 mgr.a (mgr.14388) 15173 : cluster [DBG] pgmap v10518: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:11 smithi163 bash[24253]: cluster 2024-08-31T08:02:09.627507+0000 mgr.a (mgr.14388) 15174 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:02:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:11 smithi027 bash[22610]: cluster 2024-08-31T08:02:09.627507+0000 mgr.a (mgr.14388) 15174 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:02:11.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:02:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:02:11.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:11 smithi191 bash[24992]: cluster 2024-08-31T08:02:09.627507+0000 mgr.a (mgr.14388) 15174 : cluster [DBG] pgmap v10519: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:02:12.284 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:12.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:12.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:12.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:12.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:13 smithi163 bash[24253]: cluster 2024-08-31T08:02:11.628022+0000 mgr.a (mgr.14388) 15175 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:13 smithi163 bash[24253]: audit 2024-08-31T08:02:11.835695+0000 mgr.a (mgr.14388) 15176 : audit [DBG] from='client.328944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:13 smithi027 bash[22610]: cluster 2024-08-31T08:02:11.628022+0000 mgr.a (mgr.14388) 15175 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:13 smithi027 bash[22610]: audit 2024-08-31T08:02:11.835695+0000 mgr.a (mgr.14388) 15176 : audit [DBG] from='client.328944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:13 smithi191 bash[24992]: cluster 2024-08-31T08:02:11.628022+0000 mgr.a (mgr.14388) 15175 : cluster [DBG] pgmap v10520: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:13 smithi191 bash[24992]: audit 2024-08-31T08:02:11.835695+0000 mgr.a (mgr.14388) 15176 : audit [DBG] from='client.328944 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:15 smithi163 bash[24253]: cluster 2024-08-31T08:02:13.630368+0000 mgr.a (mgr.14388) 15177 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:02:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:15 smithi027 bash[22610]: cluster 2024-08-31T08:02:13.630368+0000 mgr.a (mgr.14388) 15177 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:02:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:15 smithi191 bash[24992]: cluster 2024-08-31T08:02:13.630368+0000 mgr.a (mgr.14388) 15177 : cluster [DBG] pgmap v10521: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:02:17.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:02:17.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:02:17.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:17 smithi163 bash[24253]: cluster 2024-08-31T08:02:15.631185+0000 mgr.a (mgr.14388) 15178 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:17 smithi027 bash[22610]: cluster 2024-08-31T08:02:15.631185+0000 mgr.a (mgr.14388) 15178 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:17 smithi191 bash[24992]: cluster 2024-08-31T08:02:15.631185+0000 mgr.a (mgr.14388) 15178 : cluster [DBG] pgmap v10522: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:18.072 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:18.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:18.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:18.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:18.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:19 smithi163 bash[24253]: audit 2024-08-31T08:02:17.619004+0000 mgr.a (mgr.14388) 15179 : audit [DBG] from='client.329022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:19 smithi163 bash[24253]: cluster 2024-08-31T08:02:17.632747+0000 mgr.a (mgr.14388) 15180 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:19 smithi027 bash[22610]: audit 2024-08-31T08:02:17.619004+0000 mgr.a (mgr.14388) 15179 : audit [DBG] from='client.329022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:19 smithi027 bash[22610]: cluster 2024-08-31T08:02:17.632747+0000 mgr.a (mgr.14388) 15180 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:19 smithi191 bash[24992]: audit 2024-08-31T08:02:17.619004+0000 mgr.a (mgr.14388) 15179 : audit [DBG] from='client.329022 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:19 smithi191 bash[24992]: cluster 2024-08-31T08:02:17.632747+0000 mgr.a (mgr.14388) 15180 : cluster [DBG] pgmap v10523: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:21 smithi163 bash[24253]: cluster 2024-08-31T08:02:19.635274+0000 mgr.a (mgr.14388) 15181 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:02:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:21 smithi027 bash[22610]: cluster 2024-08-31T08:02:19.635274+0000 mgr.a (mgr.14388) 15181 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:02:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:21 smithi191 bash[24992]: cluster 2024-08-31T08:02:19.635274+0000 mgr.a (mgr.14388) 15181 : cluster [DBG] pgmap v10524: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:02:23.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:02:23.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:02:23.075 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:23 smithi163 bash[24253]: cluster 2024-08-31T08:02:21.636063+0000 mgr.a (mgr.14388) 15182 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:02:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:23 smithi027 bash[22610]: cluster 2024-08-31T08:02:21.636063+0000 mgr.a (mgr.14388) 15182 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:02:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:23 smithi191 bash[24992]: cluster 2024-08-31T08:02:21.636063+0000 mgr.a (mgr.14388) 15182 : cluster [DBG] pgmap v10525: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:02:23.860 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:23.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:23.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:23.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:23.860 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:24 smithi163 bash[24253]: audit 2024-08-31T08:02:23.407843+0000 mgr.a (mgr.14388) 15183 : audit [DBG] from='client.329100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:24 smithi027 bash[22610]: audit 2024-08-31T08:02:23.407843+0000 mgr.a (mgr.14388) 15183 : audit [DBG] from='client.329100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:24 smithi191 bash[24992]: audit 2024-08-31T08:02:23.407843+0000 mgr.a (mgr.14388) 15183 : audit [DBG] from='client.329100 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:25 smithi163 bash[24253]: cluster 2024-08-31T08:02:23.637356+0000 mgr.a (mgr.14388) 15184 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:25 smithi027 bash[22610]: cluster 2024-08-31T08:02:23.637356+0000 mgr.a (mgr.14388) 15184 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:25 smithi191 bash[24992]: cluster 2024-08-31T08:02:23.637356+0000 mgr.a (mgr.14388) 15184 : cluster [DBG] pgmap v10526: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 5.6 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:27 smithi163 bash[24253]: cluster 2024-08-31T08:02:25.638227+0000 mgr.a (mgr.14388) 15185 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:27 smithi027 bash[22610]: cluster 2024-08-31T08:02:25.638227+0000 mgr.a (mgr.14388) 15185 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:27 smithi191 bash[24992]: cluster 2024-08-31T08:02:25.638227+0000 mgr.a (mgr.14388) 15185 : cluster [DBG] pgmap v10527: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:28.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:02:28.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:02:28.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:29 smithi163 bash[24253]: cluster 2024-08-31T08:02:27.639039+0000 mgr.a (mgr.14388) 15186 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:29 smithi027 bash[22610]: cluster 2024-08-31T08:02:27.639039+0000 mgr.a (mgr.14388) 15186 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:29 smithi191 bash[24992]: cluster 2024-08-31T08:02:27.639039+0000 mgr.a (mgr.14388) 15186 : cluster [DBG] pgmap v10528: 225 pgs: 225 active+clean; 589 KiB data, 156 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:29.649 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:29.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:29.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:29.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:29.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:30 smithi163 bash[24253]: audit 2024-08-31T08:02:29.198130+0000 mgr.a (mgr.14388) 15187 : audit [DBG] from='client.329175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:30 smithi027 bash[22610]: audit 2024-08-31T08:02:29.198130+0000 mgr.a (mgr.14388) 15187 : audit [DBG] from='client.329175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:30 smithi191 bash[24992]: audit 2024-08-31T08:02:29.198130+0000 mgr.a (mgr.14388) 15187 : audit [DBG] from='client.329175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:31 smithi163 bash[24253]: cluster 2024-08-31T08:02:29.640359+0000 mgr.a (mgr.14388) 15188 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:02:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:31 smithi027 bash[22610]: cluster 2024-08-31T08:02:29.640359+0000 mgr.a (mgr.14388) 15188 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:02:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:31 smithi191 bash[24992]: cluster 2024-08-31T08:02:29.640359+0000 mgr.a (mgr.14388) 15188 : cluster [DBG] pgmap v10529: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:02:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:33 smithi163 bash[24253]: cluster 2024-08-31T08:02:31.641108+0000 mgr.a (mgr.14388) 15189 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:33 smithi027 bash[22610]: cluster 2024-08-31T08:02:31.641108+0000 mgr.a (mgr.14388) 15189 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:33 smithi191 bash[24992]: cluster 2024-08-31T08:02:31.641108+0000 mgr.a (mgr.14388) 15189 : cluster [DBG] pgmap v10530: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T08:02:34.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:02:34.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:02:34.652 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:35.421 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:35.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:35.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:35.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:35.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:35 smithi163 bash[24253]: cluster 2024-08-31T08:02:33.643102+0000 mgr.a (mgr.14388) 15190 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:02:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:35 smithi027 bash[22610]: cluster 2024-08-31T08:02:33.643102+0000 mgr.a (mgr.14388) 15190 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:02:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:35 smithi191 bash[24992]: cluster 2024-08-31T08:02:33.643102+0000 mgr.a (mgr.14388) 15190 : cluster [DBG] pgmap v10531: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:02:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:36 smithi163 bash[24253]: audit 2024-08-31T08:02:34.988013+0000 mgr.a (mgr.14388) 15191 : audit [DBG] from='client.329250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:36 smithi027 bash[22610]: audit 2024-08-31T08:02:34.988013+0000 mgr.a (mgr.14388) 15191 : audit [DBG] from='client.329250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:36 smithi191 bash[24992]: audit 2024-08-31T08:02:34.988013+0000 mgr.a (mgr.14388) 15191 : audit [DBG] from='client.329250 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:37 smithi163 bash[24253]: cluster 2024-08-31T08:02:35.644018+0000 mgr.a (mgr.14388) 15192 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T08:02:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:37 smithi027 bash[22610]: cluster 2024-08-31T08:02:35.644018+0000 mgr.a (mgr.14388) 15192 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T08:02:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:37 smithi191 bash[24992]: cluster 2024-08-31T08:02:35.644018+0000 mgr.a (mgr.14388) 15192 : cluster [DBG] pgmap v10532: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T08:02:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:39 smithi163 bash[24253]: cluster 2024-08-31T08:02:37.644815+0000 mgr.a (mgr.14388) 15193 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T08:02:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:39 smithi027 bash[22610]: cluster 2024-08-31T08:02:37.644815+0000 mgr.a (mgr.14388) 15193 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T08:02:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:39 smithi191 bash[24992]: cluster 2024-08-31T08:02:37.644815+0000 mgr.a (mgr.14388) 15193 : cluster [DBG] pgmap v10533: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T08:02:40.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:02:40.437 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:02:40.437 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:41.176 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:41 smithi163 bash[24253]: cluster 2024-08-31T08:02:39.647056+0000 mgr.a (mgr.14388) 15194 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T08:02:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:41 smithi027 bash[22610]: cluster 2024-08-31T08:02:39.647056+0000 mgr.a (mgr.14388) 15194 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T08:02:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:41 smithi191 bash[24992]: cluster 2024-08-31T08:02:39.647056+0000 mgr.a (mgr.14388) 15194 : cluster [DBG] pgmap v10534: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-08-31T08:02:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:42 smithi163 bash[24253]: audit 2024-08-31T08:02:40.753859+0000 mgr.a (mgr.14388) 15195 : audit [DBG] from='client.329325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:42 smithi027 bash[22610]: audit 2024-08-31T08:02:40.753859+0000 mgr.a (mgr.14388) 15195 : audit [DBG] from='client.329325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:42 smithi191 bash[24992]: audit 2024-08-31T08:02:40.753859+0000 mgr.a (mgr.14388) 15195 : audit [DBG] from='client.329325 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:43 smithi163 bash[24253]: cluster 2024-08-31T08:02:41.648019+0000 mgr.a (mgr.14388) 15196 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:43 smithi027 bash[22610]: cluster 2024-08-31T08:02:41.648019+0000 mgr.a (mgr.14388) 15196 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:43 smithi191 bash[24992]: cluster 2024-08-31T08:02:41.648019+0000 mgr.a (mgr.14388) 15196 : cluster [DBG] pgmap v10535: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:45 smithi163 bash[24253]: cluster 2024-08-31T08:02:43.650300+0000 mgr.a (mgr.14388) 15197 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:02:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:45 smithi027 bash[22610]: cluster 2024-08-31T08:02:43.650300+0000 mgr.a (mgr.14388) 15197 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:02:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:45 smithi191 bash[24992]: cluster 2024-08-31T08:02:43.650300+0000 mgr.a (mgr.14388) 15197 : cluster [DBG] pgmap v10536: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:02:46.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:02:46.179 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:02:46.179 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:46.948 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:46.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:46.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:46.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:46.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:47 smithi163 bash[24253]: cluster 2024-08-31T08:02:45.651088+0000 mgr.a (mgr.14388) 15198 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:47 smithi163 bash[24253]: audit 2024-08-31T08:02:46.514167+0000 mgr.a (mgr.14388) 15199 : audit [DBG] from='client.329400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:47 smithi027 bash[22610]: cluster 2024-08-31T08:02:45.651088+0000 mgr.a (mgr.14388) 15198 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:47 smithi027 bash[22610]: audit 2024-08-31T08:02:46.514167+0000 mgr.a (mgr.14388) 15199 : audit [DBG] from='client.329400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:47 smithi191 bash[24992]: cluster 2024-08-31T08:02:45.651088+0000 mgr.a (mgr.14388) 15198 : cluster [DBG] pgmap v10537: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:47 smithi191 bash[24992]: audit 2024-08-31T08:02:46.514167+0000 mgr.a (mgr.14388) 15199 : audit [DBG] from='client.329400 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:49 smithi163 bash[24253]: cluster 2024-08-31T08:02:47.651938+0000 mgr.a (mgr.14388) 15200 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:49 smithi163 bash[24253]: audit 2024-08-31T08:02:48.799976+0000 mon.a (mon.0) 2843 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:02:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:49 smithi027 bash[22610]: cluster 2024-08-31T08:02:47.651938+0000 mgr.a (mgr.14388) 15200 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:49 smithi027 bash[22610]: audit 2024-08-31T08:02:48.799976+0000 mon.a (mon.0) 2843 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:02:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:49 smithi191 bash[24992]: cluster 2024-08-31T08:02:47.651938+0000 mgr.a (mgr.14388) 15200 : cluster [DBG] pgmap v10538: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:02:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:49 smithi191 bash[24992]: audit 2024-08-31T08:02:48.799976+0000 mon.a (mon.0) 2843 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:02:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:50 smithi163 bash[24253]: audit 2024-08-31T08:02:49.424936+0000 mon.a (mon.0) 2844 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:02:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:50 smithi163 bash[24253]: audit 2024-08-31T08:02:49.428634+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:02:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:50 smithi163 bash[24253]: audit 2024-08-31T08:02:50.182957+0000 mon.a (mon.0) 2846 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:02:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:50 smithi163 bash[24253]: audit 2024-08-31T08:02:50.184245+0000 mon.a (mon.0) 2847 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:02:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:50 smithi163 bash[24253]: audit 2024-08-31T08:02:50.192627+0000 mon.a (mon.0) 2848 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:02:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:50 smithi163 bash[24253]: audit 2024-08-31T08:02:50.195440+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:02:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:50 smithi027 bash[22610]: audit 2024-08-31T08:02:49.424936+0000 mon.a (mon.0) 2844 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:02:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:50 smithi027 bash[22610]: audit 2024-08-31T08:02:49.428634+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:02:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:50 smithi027 bash[22610]: audit 2024-08-31T08:02:50.182957+0000 mon.a (mon.0) 2846 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:02:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:50 smithi027 bash[22610]: audit 2024-08-31T08:02:50.184245+0000 mon.a (mon.0) 2847 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:02:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:50 smithi027 bash[22610]: audit 2024-08-31T08:02:50.192627+0000 mon.a (mon.0) 2848 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:02:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:50 smithi027 bash[22610]: audit 2024-08-31T08:02:50.195440+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:02:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:50 smithi191 bash[24992]: audit 2024-08-31T08:02:49.424936+0000 mon.a (mon.0) 2844 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:02:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:50 smithi191 bash[24992]: audit 2024-08-31T08:02:49.428634+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:02:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:50 smithi191 bash[24992]: audit 2024-08-31T08:02:50.182957+0000 mon.a (mon.0) 2846 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:02:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:50 smithi191 bash[24992]: audit 2024-08-31T08:02:50.184245+0000 mon.a (mon.0) 2847 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:02:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:50 smithi191 bash[24992]: audit 2024-08-31T08:02:50.192627+0000 mon.a (mon.0) 2848 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:02:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:50 smithi191 bash[24992]: audit 2024-08-31T08:02:50.195440+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:02:51.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:02:50 smithi027 bash[22863]: debug 2024-08-31T08:02:50.916+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:02:51.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:02:50 smithi027 bash[22863]: debug 2024-08-31T08:02:50.916+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:02:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:51 smithi163 bash[24253]: cluster 2024-08-31T08:02:49.654209+0000 mgr.a (mgr.14388) 15201 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:02:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:51 smithi163 bash[24253]: audit 2024-08-31T08:02:50.197717+0000 mgr.a (mgr.14388) 15202 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:02:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:51 smithi027 bash[22610]: cluster 2024-08-31T08:02:49.654209+0000 mgr.a (mgr.14388) 15201 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:02:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:51 smithi027 bash[22610]: audit 2024-08-31T08:02:50.197717+0000 mgr.a (mgr.14388) 15202 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:02:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:51 smithi191 bash[24992]: cluster 2024-08-31T08:02:49.654209+0000 mgr.a (mgr.14388) 15201 : cluster [DBG] pgmap v10539: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:02:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:51 smithi191 bash[24992]: audit 2024-08-31T08:02:50.197717+0000 mgr.a (mgr.14388) 15202 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:02:51.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:02:51.950 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:02:51.951 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:52 smithi163 bash[24253]: audit 2024-08-31T08:02:50.921432+0000 mgr.a (mgr.14388) 15203 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:02:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:52 smithi163 bash[24253]: cephadm 2024-08-31T08:02:50.922678+0000 mgr.a (mgr.14388) 15204 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:02:52.728 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:52.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:52.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:52.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:52.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:52.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:52 smithi027 bash[22610]: audit 2024-08-31T08:02:50.921432+0000 mgr.a (mgr.14388) 15203 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:02:52.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:52 smithi027 bash[22610]: cephadm 2024-08-31T08:02:50.922678+0000 mgr.a (mgr.14388) 15204 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:02:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:52 smithi191 bash[24992]: audit 2024-08-31T08:02:50.921432+0000 mgr.a (mgr.14388) 15203 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:02:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:52 smithi191 bash[24992]: cephadm 2024-08-31T08:02:50.922678+0000 mgr.a (mgr.14388) 15204 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:02:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:53 smithi163 bash[24253]: cluster 2024-08-31T08:02:51.655151+0000 mgr.a (mgr.14388) 15205 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:02:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:53 smithi163 bash[24253]: audit 2024-08-31T08:02:52.283556+0000 mgr.a (mgr.14388) 15206 : audit [DBG] from='client.329586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:53 smithi027 bash[22610]: cluster 2024-08-31T08:02:51.655151+0000 mgr.a (mgr.14388) 15205 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:02:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:53 smithi027 bash[22610]: audit 2024-08-31T08:02:52.283556+0000 mgr.a (mgr.14388) 15206 : audit [DBG] from='client.329586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:53 smithi191 bash[24992]: cluster 2024-08-31T08:02:51.655151+0000 mgr.a (mgr.14388) 15205 : cluster [DBG] pgmap v10540: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:02:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:53 smithi191 bash[24992]: audit 2024-08-31T08:02:52.283556+0000 mgr.a (mgr.14388) 15206 : audit [DBG] from='client.329586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:55 smithi163 bash[24253]: cluster 2024-08-31T08:02:53.657409+0000 mgr.a (mgr.14388) 15207 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T08:02:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:55 smithi027 bash[22610]: cluster 2024-08-31T08:02:53.657409+0000 mgr.a (mgr.14388) 15207 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T08:02:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:55 smithi191 bash[24992]: cluster 2024-08-31T08:02:53.657409+0000 mgr.a (mgr.14388) 15207 : cluster [DBG] pgmap v10541: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 40 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T08:02:57.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:02:57.731 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:02:57.731 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:02:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:57 smithi027 bash[22610]: cluster 2024-08-31T08:02:55.658186+0000 mgr.a (mgr.14388) 15208 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:02:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:57 smithi191 bash[24992]: cluster 2024-08-31T08:02:55.658186+0000 mgr.a (mgr.14388) 15208 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:02:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:57 smithi163 bash[24253]: cluster 2024-08-31T08:02:55.658186+0000 mgr.a (mgr.14388) 15208 : cluster [DBG] pgmap v10542: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:02:58.513 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:02:58.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:02:58.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:02:58.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:02:58.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:02:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:59 smithi027 bash[22610]: cluster 2024-08-31T08:02:57.658984+0000 mgr.a (mgr.14388) 15209 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:02:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:02:59 smithi027 bash[22610]: audit 2024-08-31T08:02:58.071088+0000 mgr.a (mgr.14388) 15210 : audit [DBG] from='client.329664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:59 smithi191 bash[24992]: cluster 2024-08-31T08:02:57.658984+0000 mgr.a (mgr.14388) 15209 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:02:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:02:59 smithi191 bash[24992]: audit 2024-08-31T08:02:58.071088+0000 mgr.a (mgr.14388) 15210 : audit [DBG] from='client.329664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:02:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:59 smithi163 bash[24253]: cluster 2024-08-31T08:02:57.658984+0000 mgr.a (mgr.14388) 15209 : cluster [DBG] pgmap v10543: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:02:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:02:59 smithi163 bash[24253]: audit 2024-08-31T08:02:58.071088+0000 mgr.a (mgr.14388) 15210 : audit [DBG] from='client.329664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:01.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:01 smithi027 bash[22610]: cluster 2024-08-31T08:02:59.661749+0000 mgr.a (mgr.14388) 15211 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:03:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:01 smithi191 bash[24992]: cluster 2024-08-31T08:02:59.661749+0000 mgr.a (mgr.14388) 15211 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:03:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:01 smithi163 bash[24253]: cluster 2024-08-31T08:02:59.661749+0000 mgr.a (mgr.14388) 15211 : cluster [DBG] pgmap v10544: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:03:03.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:03:03.516 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:03:03.516 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:03:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:03 smithi027 bash[22610]: cluster 2024-08-31T08:03:01.662521+0000 mgr.a (mgr.14388) 15212 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:03:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:03 smithi191 bash[24992]: cluster 2024-08-31T08:03:01.662521+0000 mgr.a (mgr.14388) 15212 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:03:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:03 smithi163 bash[24253]: cluster 2024-08-31T08:03:01.662521+0000 mgr.a (mgr.14388) 15212 : cluster [DBG] pgmap v10545: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:03:04.275 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:03:04.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:03:04.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:03:04.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:03:04.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:03:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:05 smithi027 bash[22610]: cluster 2024-08-31T08:03:03.663997+0000 mgr.a (mgr.14388) 15213 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:03:05.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:05 smithi027 bash[22610]: audit 2024-08-31T08:03:03.847701+0000 mgr.a (mgr.14388) 15214 : audit [DBG] from='client.329742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:05 smithi191 bash[24992]: cluster 2024-08-31T08:03:03.663997+0000 mgr.a (mgr.14388) 15213 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:03:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:05 smithi191 bash[24992]: audit 2024-08-31T08:03:03.847701+0000 mgr.a (mgr.14388) 15214 : audit [DBG] from='client.329742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:05 smithi163 bash[24253]: cluster 2024-08-31T08:03:03.663997+0000 mgr.a (mgr.14388) 15213 : cluster [DBG] pgmap v10546: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:03:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:05 smithi163 bash[24253]: audit 2024-08-31T08:03:03.847701+0000 mgr.a (mgr.14388) 15214 : audit [DBG] from='client.329742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:07 smithi027 bash[22610]: cluster 2024-08-31T08:03:05.664867+0000 mgr.a (mgr.14388) 15215 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:03:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:07 smithi191 bash[24992]: cluster 2024-08-31T08:03:05.664867+0000 mgr.a (mgr.14388) 15215 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:03:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:07 smithi163 bash[24253]: cluster 2024-08-31T08:03:05.664867+0000 mgr.a (mgr.14388) 15215 : cluster [DBG] pgmap v10547: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:03:09.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:03:09.277 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:03:09.277 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:03:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:09 smithi027 bash[22610]: cluster 2024-08-31T08:03:07.665671+0000 mgr.a (mgr.14388) 15216 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:03:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:09 smithi191 bash[24992]: cluster 2024-08-31T08:03:07.665671+0000 mgr.a (mgr.14388) 15216 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:03:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:09 smithi163 bash[24253]: cluster 2024-08-31T08:03:07.665671+0000 mgr.a (mgr.14388) 15216 : cluster [DBG] pgmap v10548: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:03:10.030 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:03:10.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:03:10.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:03:10.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:03:10.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:03:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:11 smithi027 bash[22610]: audit 2024-08-31T08:03:09.612886+0000 mgr.a (mgr.14388) 15217 : audit [DBG] from='client.329820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:11 smithi027 bash[22610]: cluster 2024-08-31T08:03:09.667025+0000 mgr.a (mgr.14388) 15218 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:11 smithi191 bash[24992]: audit 2024-08-31T08:03:09.612886+0000 mgr.a (mgr.14388) 15217 : audit [DBG] from='client.329820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:11 smithi191 bash[24992]: cluster 2024-08-31T08:03:09.667025+0000 mgr.a (mgr.14388) 15218 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:11 smithi163 bash[24253]: audit 2024-08-31T08:03:09.612886+0000 mgr.a (mgr.14388) 15217 : audit [DBG] from='client.329820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:11 smithi163 bash[24253]: cluster 2024-08-31T08:03:09.667025+0000 mgr.a (mgr.14388) 15218 : cluster [DBG] pgmap v10549: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:13 smithi191 bash[24992]: cluster 2024-08-31T08:03:11.667847+0000 mgr.a (mgr.14388) 15219 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:13 smithi163 bash[24253]: cluster 2024-08-31T08:03:11.667847+0000 mgr.a (mgr.14388) 15219 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:13 smithi027 bash[22610]: cluster 2024-08-31T08:03:11.667847+0000 mgr.a (mgr.14388) 15219 : cluster [DBG] pgmap v10550: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:15.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:03:15.033 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:03:15.033 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:03:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:15 smithi191 bash[24992]: cluster 2024-08-31T08:03:13.670758+0000 mgr.a (mgr.14388) 15220 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:15.816 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:03:15.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:03:15.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:03:15.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:03:15.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:03:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:15 smithi163 bash[24253]: cluster 2024-08-31T08:03:13.670758+0000 mgr.a (mgr.14388) 15220 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:15 smithi027 bash[22610]: cluster 2024-08-31T08:03:13.670758+0000 mgr.a (mgr.14388) 15220 : cluster [DBG] pgmap v10551: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:16 smithi191 bash[24992]: audit 2024-08-31T08:03:15.378878+0000 mgr.a (mgr.14388) 15221 : audit [DBG] from='client.329898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:16 smithi163 bash[24253]: audit 2024-08-31T08:03:15.378878+0000 mgr.a (mgr.14388) 15221 : audit [DBG] from='client.329898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:16 smithi027 bash[22610]: audit 2024-08-31T08:03:15.378878+0000 mgr.a (mgr.14388) 15221 : audit [DBG] from='client.329898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:17 smithi191 bash[24992]: cluster 2024-08-31T08:03:15.671304+0000 mgr.a (mgr.14388) 15222 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:17 smithi163 bash[24253]: cluster 2024-08-31T08:03:15.671304+0000 mgr.a (mgr.14388) 15222 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:17 smithi027 bash[22610]: cluster 2024-08-31T08:03:15.671304+0000 mgr.a (mgr.14388) 15222 : cluster [DBG] pgmap v10552: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:19 smithi191 bash[24992]: cluster 2024-08-31T08:03:17.672157+0000 mgr.a (mgr.14388) 15223 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:19 smithi163 bash[24253]: cluster 2024-08-31T08:03:17.672157+0000 mgr.a (mgr.14388) 15223 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:19 smithi027 bash[22610]: cluster 2024-08-31T08:03:17.672157+0000 mgr.a (mgr.14388) 15223 : cluster [DBG] pgmap v10553: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:20.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:03:20.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:03:20.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:03:21.605 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:03:21.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:03:21.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:03:21.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:03:21.606 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:03:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:21 smithi191 bash[24992]: cluster 2024-08-31T08:03:19.674615+0000 mgr.a (mgr.14388) 15224 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:21 smithi163 bash[24253]: cluster 2024-08-31T08:03:19.674615+0000 mgr.a (mgr.14388) 15224 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:21 smithi027 bash[22610]: cluster 2024-08-31T08:03:19.674615+0000 mgr.a (mgr.14388) 15224 : cluster [DBG] pgmap v10554: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:22 smithi191 bash[24992]: audit 2024-08-31T08:03:21.156768+0000 mgr.a (mgr.14388) 15225 : audit [DBG] from='client.329976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:22 smithi163 bash[24253]: audit 2024-08-31T08:03:21.156768+0000 mgr.a (mgr.14388) 15225 : audit [DBG] from='client.329976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:22.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:22 smithi027 bash[22610]: audit 2024-08-31T08:03:21.156768+0000 mgr.a (mgr.14388) 15225 : audit [DBG] from='client.329976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:23 smithi191 bash[24992]: cluster 2024-08-31T08:03:21.675706+0000 mgr.a (mgr.14388) 15226 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:23 smithi163 bash[24253]: cluster 2024-08-31T08:03:21.675706+0000 mgr.a (mgr.14388) 15226 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:23 smithi027 bash[22610]: cluster 2024-08-31T08:03:21.675706+0000 mgr.a (mgr.14388) 15226 : cluster [DBG] pgmap v10555: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:25 smithi191 bash[24992]: cluster 2024-08-31T08:03:23.678052+0000 mgr.a (mgr.14388) 15227 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:25 smithi163 bash[24253]: cluster 2024-08-31T08:03:23.678052+0000 mgr.a (mgr.14388) 15227 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:25 smithi027 bash[22610]: cluster 2024-08-31T08:03:23.678052+0000 mgr.a (mgr.14388) 15227 : cluster [DBG] pgmap v10556: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:26.607 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:03:26.607 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:03:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:03:27.393 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:03:27.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:03:27.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:03:27.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:03:27.394 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:03:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:27 smithi191 bash[24992]: cluster 2024-08-31T08:03:25.679005+0000 mgr.a (mgr.14388) 15228 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:27 smithi163 bash[24253]: cluster 2024-08-31T08:03:25.679005+0000 mgr.a (mgr.14388) 15228 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:27 smithi027 bash[22610]: cluster 2024-08-31T08:03:25.679005+0000 mgr.a (mgr.14388) 15228 : cluster [DBG] pgmap v10557: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:28 smithi191 bash[24992]: audit 2024-08-31T08:03:26.941782+0000 mgr.a (mgr.14388) 15229 : audit [DBG] from='client.330051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:28 smithi163 bash[24253]: audit 2024-08-31T08:03:26.941782+0000 mgr.a (mgr.14388) 15229 : audit [DBG] from='client.330051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:28 smithi027 bash[22610]: audit 2024-08-31T08:03:26.941782+0000 mgr.a (mgr.14388) 15229 : audit [DBG] from='client.330051 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:29 smithi163 bash[24253]: cluster 2024-08-31T08:03:27.679951+0000 mgr.a (mgr.14388) 15230 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:29 smithi027 bash[22610]: cluster 2024-08-31T08:03:27.679951+0000 mgr.a (mgr.14388) 15230 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:29 smithi191 bash[24992]: cluster 2024-08-31T08:03:27.679951+0000 mgr.a (mgr.14388) 15230 : cluster [DBG] pgmap v10558: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:31 smithi163 bash[24253]: cluster 2024-08-31T08:03:29.682176+0000 mgr.a (mgr.14388) 15231 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:32.179 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:31 smithi191 bash[24992]: cluster 2024-08-31T08:03:29.682176+0000 mgr.a (mgr.14388) 15231 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:32.179 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:31 smithi027 bash[22610]: cluster 2024-08-31T08:03:29.682176+0000 mgr.a (mgr.14388) 15231 : cluster [DBG] pgmap v10559: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:03:32.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:03:32.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:03:32.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:03:33.174 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:03:33.174 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:03:33.174 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:03:33.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:03:33.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:03:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:33 smithi163 bash[24253]: cluster 2024-08-31T08:03:31.683016+0000 mgr.a (mgr.14388) 15232 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:33 smithi027 bash[22610]: cluster 2024-08-31T08:03:31.683016+0000 mgr.a (mgr.14388) 15232 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:33 smithi191 bash[24992]: cluster 2024-08-31T08:03:31.683016+0000 mgr.a (mgr.14388) 15232 : cluster [DBG] pgmap v10560: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:34 smithi163 bash[24253]: audit 2024-08-31T08:03:32.731064+0000 mgr.a (mgr.14388) 15233 : audit [DBG] from='client.330129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:34 smithi027 bash[22610]: audit 2024-08-31T08:03:32.731064+0000 mgr.a (mgr.14388) 15233 : audit [DBG] from='client.330129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:34 smithi191 bash[24992]: audit 2024-08-31T08:03:32.731064+0000 mgr.a (mgr.14388) 15233 : audit [DBG] from='client.330129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:35 smithi163 bash[24253]: cluster 2024-08-31T08:03:33.685396+0000 mgr.a (mgr.14388) 15234 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:03:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:35 smithi027 bash[22610]: cluster 2024-08-31T08:03:33.685396+0000 mgr.a (mgr.14388) 15234 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:03:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:35 smithi191 bash[24992]: cluster 2024-08-31T08:03:33.685396+0000 mgr.a (mgr.14388) 15234 : cluster [DBG] pgmap v10561: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:03:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:37 smithi163 bash[24253]: cluster 2024-08-31T08:03:35.686188+0000 mgr.a (mgr.14388) 15235 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:03:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:37 smithi027 bash[22610]: cluster 2024-08-31T08:03:35.686188+0000 mgr.a (mgr.14388) 15235 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:03:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:37 smithi191 bash[24992]: cluster 2024-08-31T08:03:35.686188+0000 mgr.a (mgr.14388) 15235 : cluster [DBG] pgmap v10562: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:03:38.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:03:38.176 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:03:38.177 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:03:38.948 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:03:38.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:03:38.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:03:38.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:03:38.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:03:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:39 smithi163 bash[24253]: cluster 2024-08-31T08:03:37.687103+0000 mgr.a (mgr.14388) 15236 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:03:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:39 smithi163 bash[24253]: audit 2024-08-31T08:03:38.511914+0000 mgr.a (mgr.14388) 15237 : audit [DBG] from='client.330207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:39 smithi027 bash[22610]: cluster 2024-08-31T08:03:37.687103+0000 mgr.a (mgr.14388) 15236 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:03:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:39 smithi027 bash[22610]: audit 2024-08-31T08:03:38.511914+0000 mgr.a (mgr.14388) 15237 : audit [DBG] from='client.330207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:39 smithi191 bash[24992]: cluster 2024-08-31T08:03:37.687103+0000 mgr.a (mgr.14388) 15236 : cluster [DBG] pgmap v10563: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:03:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:39 smithi191 bash[24992]: audit 2024-08-31T08:03:38.511914+0000 mgr.a (mgr.14388) 15237 : audit [DBG] from='client.330207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:41 smithi163 bash[24253]: cluster 2024-08-31T08:03:39.689891+0000 mgr.a (mgr.14388) 15238 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:41 smithi027 bash[22610]: cluster 2024-08-31T08:03:39.689891+0000 mgr.a (mgr.14388) 15238 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:41 smithi191 bash[24992]: cluster 2024-08-31T08:03:39.689891+0000 mgr.a (mgr.14388) 15238 : cluster [DBG] pgmap v10564: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:43.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:03:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:43 smithi163 bash[24253]: cluster 2024-08-31T08:03:41.690852+0000 mgr.a (mgr.14388) 15239 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:03:43.950 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:03:43.951 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:03:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:43 smithi027 bash[22610]: cluster 2024-08-31T08:03:41.690852+0000 mgr.a (mgr.14388) 15239 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:03:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:43 smithi191 bash[24992]: cluster 2024-08-31T08:03:41.690852+0000 mgr.a (mgr.14388) 15239 : cluster [DBG] pgmap v10565: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:03:44.733 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:03:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:03:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:03:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:03:44.733 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:03:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:45 smithi163 bash[24253]: cluster 2024-08-31T08:03:43.693019+0000 mgr.a (mgr.14388) 15240 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:45 smithi163 bash[24253]: audit 2024-08-31T08:03:44.288832+0000 mgr.a (mgr.14388) 15241 : audit [DBG] from='client.330285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:45 smithi027 bash[22610]: cluster 2024-08-31T08:03:43.693019+0000 mgr.a (mgr.14388) 15240 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:45 smithi027 bash[22610]: audit 2024-08-31T08:03:44.288832+0000 mgr.a (mgr.14388) 15241 : audit [DBG] from='client.330285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:45 smithi191 bash[24992]: cluster 2024-08-31T08:03:43.693019+0000 mgr.a (mgr.14388) 15240 : cluster [DBG] pgmap v10566: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:45 smithi191 bash[24992]: audit 2024-08-31T08:03:44.288832+0000 mgr.a (mgr.14388) 15241 : audit [DBG] from='client.330285 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:47 smithi163 bash[24253]: cluster 2024-08-31T08:03:45.693955+0000 mgr.a (mgr.14388) 15242 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:03:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:47 smithi027 bash[22610]: cluster 2024-08-31T08:03:45.693955+0000 mgr.a (mgr.14388) 15242 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:03:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:47 smithi191 bash[24992]: cluster 2024-08-31T08:03:45.693955+0000 mgr.a (mgr.14388) 15242 : cluster [DBG] pgmap v10567: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:03:49.734 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:03:49.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:03:49.735 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:03:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:49 smithi163 bash[24253]: cluster 2024-08-31T08:03:47.694772+0000 mgr.a (mgr.14388) 15243 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:03:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:49 smithi027 bash[22610]: cluster 2024-08-31T08:03:47.694772+0000 mgr.a (mgr.14388) 15243 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:03:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:49 smithi191 bash[24992]: cluster 2024-08-31T08:03:47.694772+0000 mgr.a (mgr.14388) 15243 : cluster [DBG] pgmap v10568: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:03:50.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:03:50.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:03:50.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:03:50.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:03:50.482 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:03:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:51 smithi163 bash[24253]: cluster 2024-08-31T08:03:49.696998+0000 mgr.a (mgr.14388) 15244 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:03:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:51 smithi163 bash[24253]: audit 2024-08-31T08:03:50.068195+0000 mgr.a (mgr.14388) 15245 : audit [DBG] from='client.330357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:51 smithi163 bash[24253]: audit 2024-08-31T08:03:50.972881+0000 mon.a (mon.0) 2850 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:03:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:51 smithi027 bash[22610]: cluster 2024-08-31T08:03:49.696998+0000 mgr.a (mgr.14388) 15244 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:03:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:51 smithi027 bash[22610]: audit 2024-08-31T08:03:50.068195+0000 mgr.a (mgr.14388) 15245 : audit [DBG] from='client.330357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:51 smithi027 bash[22610]: audit 2024-08-31T08:03:50.972881+0000 mon.a (mon.0) 2850 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:03:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:51 smithi191 bash[24992]: cluster 2024-08-31T08:03:49.696998+0000 mgr.a (mgr.14388) 15244 : cluster [DBG] pgmap v10569: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:03:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:51 smithi191 bash[24992]: audit 2024-08-31T08:03:50.068195+0000 mgr.a (mgr.14388) 15245 : audit [DBG] from='client.330357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:51 smithi191 bash[24992]: audit 2024-08-31T08:03:50.972881+0000 mon.a (mon.0) 2850 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:03:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:52 smithi163 bash[24253]: audit 2024-08-31T08:03:51.588817+0000 mon.a (mon.0) 2851 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:52 smithi163 bash[24253]: audit 2024-08-31T08:03:51.601449+0000 mon.a (mon.0) 2852 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:52 smithi163 bash[24253]: audit 2024-08-31T08:03:51.606487+0000 mon.a (mon.0) 2853 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:52 smithi163 bash[24253]: audit 2024-08-31T08:03:51.612026+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:52 smithi163 bash[24253]: audit 2024-08-31T08:03:52.333756+0000 mon.a (mon.0) 2855 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:03:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:52 smithi163 bash[24253]: audit 2024-08-31T08:03:52.335604+0000 mon.a (mon.0) 2856 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:03:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:52 smithi163 bash[24253]: audit 2024-08-31T08:03:52.345862+0000 mon.a (mon.0) 2857 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:52.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:52 smithi163 bash[24253]: audit 2024-08-31T08:03:52.350885+0000 mon.a (mon.0) 2858 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:03:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:52 smithi027 bash[22610]: audit 2024-08-31T08:03:51.588817+0000 mon.a (mon.0) 2851 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:52 smithi027 bash[22610]: audit 2024-08-31T08:03:51.601449+0000 mon.a (mon.0) 2852 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:52 smithi027 bash[22610]: audit 2024-08-31T08:03:51.606487+0000 mon.a (mon.0) 2853 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:52 smithi027 bash[22610]: audit 2024-08-31T08:03:51.612026+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:52 smithi027 bash[22610]: audit 2024-08-31T08:03:52.333756+0000 mon.a (mon.0) 2855 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:03:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:52 smithi027 bash[22610]: audit 2024-08-31T08:03:52.335604+0000 mon.a (mon.0) 2856 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:03:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:52 smithi027 bash[22610]: audit 2024-08-31T08:03:52.345862+0000 mon.a (mon.0) 2857 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:52 smithi027 bash[22610]: audit 2024-08-31T08:03:52.350885+0000 mon.a (mon.0) 2858 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:03:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:52 smithi191 bash[24992]: audit 2024-08-31T08:03:51.588817+0000 mon.a (mon.0) 2851 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:52 smithi191 bash[24992]: audit 2024-08-31T08:03:51.601449+0000 mon.a (mon.0) 2852 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:52 smithi191 bash[24992]: audit 2024-08-31T08:03:51.606487+0000 mon.a (mon.0) 2853 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:52 smithi191 bash[24992]: audit 2024-08-31T08:03:51.612026+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:52 smithi191 bash[24992]: audit 2024-08-31T08:03:52.333756+0000 mon.a (mon.0) 2855 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:03:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:52 smithi191 bash[24992]: audit 2024-08-31T08:03:52.335604+0000 mon.a (mon.0) 2856 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:03:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:52 smithi191 bash[24992]: audit 2024-08-31T08:03:52.345862+0000 mon.a (mon.0) 2857 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:03:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:52 smithi191 bash[24992]: audit 2024-08-31T08:03:52.350885+0000 mon.a (mon.0) 2858 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:03:53.490 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:03:53 smithi027 bash[22863]: debug 2024-08-31T08:03:53.090+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:03:53.490 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:03:53 smithi027 bash[22863]: debug 2024-08-31T08:03:53.090+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:03:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:53 smithi163 bash[24253]: cluster 2024-08-31T08:03:51.697828+0000 mgr.a (mgr.14388) 15246 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:53 smithi163 bash[24253]: audit 2024-08-31T08:03:52.352272+0000 mgr.a (mgr.14388) 15247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:03:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:53 smithi027 bash[22610]: cluster 2024-08-31T08:03:51.697828+0000 mgr.a (mgr.14388) 15246 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:53.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:53 smithi027 bash[22610]: audit 2024-08-31T08:03:52.352272+0000 mgr.a (mgr.14388) 15247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:03:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:53 smithi191 bash[24992]: cluster 2024-08-31T08:03:51.697828+0000 mgr.a (mgr.14388) 15246 : cluster [DBG] pgmap v10570: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:03:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:53 smithi191 bash[24992]: audit 2024-08-31T08:03:52.352272+0000 mgr.a (mgr.14388) 15247 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:03:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:54 smithi163 bash[24253]: audit 2024-08-31T08:03:53.091609+0000 mgr.a (mgr.14388) 15248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:03:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:54 smithi163 bash[24253]: cephadm 2024-08-31T08:03:53.092812+0000 mgr.a (mgr.14388) 15249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:03:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:54 smithi027 bash[22610]: audit 2024-08-31T08:03:53.091609+0000 mgr.a (mgr.14388) 15248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:03:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:54 smithi027 bash[22610]: cephadm 2024-08-31T08:03:53.092812+0000 mgr.a (mgr.14388) 15249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:03:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:54 smithi191 bash[24992]: audit 2024-08-31T08:03:53.091609+0000 mgr.a (mgr.14388) 15248 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:03:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:54 smithi191 bash[24992]: cephadm 2024-08-31T08:03:53.092812+0000 mgr.a (mgr.14388) 15249 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:03:55.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:03:55.484 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:03:55.484 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:03:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:55 smithi163 bash[24253]: cluster 2024-08-31T08:03:53.700214+0000 mgr.a (mgr.14388) 15250 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T08:03:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:55 smithi027 bash[22610]: cluster 2024-08-31T08:03:53.700214+0000 mgr.a (mgr.14388) 15250 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T08:03:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:55 smithi191 bash[24992]: cluster 2024-08-31T08:03:53.700214+0000 mgr.a (mgr.14388) 15250 : cluster [DBG] pgmap v10571: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T08:03:56.245 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:03:56.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:03:56.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:03:56.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:03:56.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:03:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:57 smithi163 bash[24253]: cluster 2024-08-31T08:03:55.701089+0000 mgr.a (mgr.14388) 15251 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:03:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:57 smithi163 bash[24253]: audit 2024-08-31T08:03:55.813792+0000 mgr.a (mgr.14388) 15252 : audit [DBG] from='client.330543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:57 smithi027 bash[22610]: cluster 2024-08-31T08:03:55.701089+0000 mgr.a (mgr.14388) 15251 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:03:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:57 smithi027 bash[22610]: audit 2024-08-31T08:03:55.813792+0000 mgr.a (mgr.14388) 15252 : audit [DBG] from='client.330543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:57 smithi191 bash[24992]: cluster 2024-08-31T08:03:55.701089+0000 mgr.a (mgr.14388) 15251 : cluster [DBG] pgmap v10572: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:03:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:57 smithi191 bash[24992]: audit 2024-08-31T08:03:55.813792+0000 mgr.a (mgr.14388) 15252 : audit [DBG] from='client.330543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:03:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:03:58 smithi163 bash[24253]: cluster 2024-08-31T08:03:57.702049+0000 mgr.a (mgr.14388) 15253 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:03:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:03:58 smithi027 bash[22610]: cluster 2024-08-31T08:03:57.702049+0000 mgr.a (mgr.14388) 15253 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:03:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:03:58 smithi191 bash[24992]: cluster 2024-08-31T08:03:57.702049+0000 mgr.a (mgr.14388) 15253 : cluster [DBG] pgmap v10573: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:04:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:00 smithi191 bash[24992]: cluster 2024-08-31T08:03:59.704262+0000 mgr.a (mgr.14388) 15254 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:04:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:00 smithi163 bash[24253]: cluster 2024-08-31T08:03:59.704262+0000 mgr.a (mgr.14388) 15254 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:04:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:00 smithi027 bash[22610]: cluster 2024-08-31T08:03:59.704262+0000 mgr.a (mgr.14388) 15254 : cluster [DBG] pgmap v10574: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:04:01.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:01.247 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:01.248 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:01.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:01.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:01.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:01.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:04:01.987 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:01 smithi191 bash[24992]: audit 2024-08-31T08:04:01.573626+0000 mgr.a (mgr.14388) 15255 : audit [DBG] from='client.330621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:01 smithi163 bash[24253]: audit 2024-08-31T08:04:01.573626+0000 mgr.a (mgr.14388) 15255 : audit [DBG] from='client.330621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:01 smithi027 bash[22610]: audit 2024-08-31T08:04:01.573626+0000 mgr.a (mgr.14388) 15255 : audit [DBG] from='client.330621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:02 smithi191 bash[24992]: cluster 2024-08-31T08:04:01.707672+0000 mgr.a (mgr.14388) 15256 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:04:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:02 smithi163 bash[24253]: cluster 2024-08-31T08:04:01.707672+0000 mgr.a (mgr.14388) 15256 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:04:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:02 smithi027 bash[22610]: cluster 2024-08-31T08:04:01.707672+0000 mgr.a (mgr.14388) 15256 : cluster [DBG] pgmap v10575: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:04:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:04 smithi191 bash[24992]: cluster 2024-08-31T08:04:03.710074+0000 mgr.a (mgr.14388) 15257 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:04:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:04 smithi163 bash[24253]: cluster 2024-08-31T08:04:03.710074+0000 mgr.a (mgr.14388) 15257 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:04:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:04 smithi027 bash[22610]: cluster 2024-08-31T08:04:03.710074+0000 mgr.a (mgr.14388) 15257 : cluster [DBG] pgmap v10576: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:04:06.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:06.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:06.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:06 smithi191 bash[24992]: cluster 2024-08-31T08:04:05.711021+0000 mgr.a (mgr.14388) 15258 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T08:04:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:06 smithi163 bash[24253]: cluster 2024-08-31T08:04:05.711021+0000 mgr.a (mgr.14388) 15258 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T08:04:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:06 smithi027 bash[22610]: cluster 2024-08-31T08:04:05.711021+0000 mgr.a (mgr.14388) 15258 : cluster [DBG] pgmap v10577: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T08:04:07.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:07.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:07.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:07.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:04:07.773 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:07 smithi191 bash[24992]: audit 2024-08-31T08:04:07.324089+0000 mgr.a (mgr.14388) 15259 : audit [DBG] from='client.330699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:07 smithi163 bash[24253]: audit 2024-08-31T08:04:07.324089+0000 mgr.a (mgr.14388) 15259 : audit [DBG] from='client.330699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:07 smithi027 bash[22610]: audit 2024-08-31T08:04:07.324089+0000 mgr.a (mgr.14388) 15259 : audit [DBG] from='client.330699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:08 smithi163 bash[24253]: cluster 2024-08-31T08:04:07.711602+0000 mgr.a (mgr.14388) 15260 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T08:04:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:08 smithi027 bash[22610]: cluster 2024-08-31T08:04:07.711602+0000 mgr.a (mgr.14388) 15260 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T08:04:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:08 smithi191 bash[24992]: cluster 2024-08-31T08:04:07.711602+0000 mgr.a (mgr.14388) 15260 : cluster [DBG] pgmap v10578: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T08:04:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:10 smithi163 bash[24253]: cluster 2024-08-31T08:04:09.713781+0000 mgr.a (mgr.14388) 15261 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:04:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:10 smithi027 bash[22610]: cluster 2024-08-31T08:04:09.713781+0000 mgr.a (mgr.14388) 15261 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:04:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:10 smithi191 bash[24992]: cluster 2024-08-31T08:04:09.713781+0000 mgr.a (mgr.14388) 15261 : cluster [DBG] pgmap v10579: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:04:12.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:12.775 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:12.775 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:12 smithi163 bash[24253]: cluster 2024-08-31T08:04:11.714577+0000 mgr.a (mgr.14388) 15262 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:12 smithi027 bash[22610]: cluster 2024-08-31T08:04:11.714577+0000 mgr.a (mgr.14388) 15262 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:12 smithi191 bash[24992]: cluster 2024-08-31T08:04:11.714577+0000 mgr.a (mgr.14388) 15262 : cluster [DBG] pgmap v10580: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:13.499 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:13.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:13.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:13.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:13.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:04:14.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:13 smithi163 bash[24253]: audit 2024-08-31T08:04:13.096743+0000 mgr.a (mgr.14388) 15263 : audit [DBG] from='client.330777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:13 smithi027 bash[22610]: audit 2024-08-31T08:04:13.096743+0000 mgr.a (mgr.14388) 15263 : audit [DBG] from='client.330777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:13 smithi191 bash[24992]: audit 2024-08-31T08:04:13.096743+0000 mgr.a (mgr.14388) 15263 : audit [DBG] from='client.330777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:14 smithi163 bash[24253]: cluster 2024-08-31T08:04:13.717295+0000 mgr.a (mgr.14388) 15264 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:14 smithi027 bash[22610]: cluster 2024-08-31T08:04:13.717295+0000 mgr.a (mgr.14388) 15264 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:14 smithi191 bash[24992]: cluster 2024-08-31T08:04:13.717295+0000 mgr.a (mgr.14388) 15264 : cluster [DBG] pgmap v10581: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:16 smithi163 bash[24253]: cluster 2024-08-31T08:04:15.718060+0000 mgr.a (mgr.14388) 15265 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:16 smithi027 bash[22610]: cluster 2024-08-31T08:04:15.718060+0000 mgr.a (mgr.14388) 15265 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:16 smithi191 bash[24992]: cluster 2024-08-31T08:04:15.718060+0000 mgr.a (mgr.14388) 15265 : cluster [DBG] pgmap v10582: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:18 smithi163 bash[24253]: cluster 2024-08-31T08:04:17.718854+0000 mgr.a (mgr.14388) 15266 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:04:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:18 smithi027 bash[22610]: cluster 2024-08-31T08:04:17.718854+0000 mgr.a (mgr.14388) 15266 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:04:19.256 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:19.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:19.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:19.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:19.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:04:19.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:18 smithi191 bash[24992]: cluster 2024-08-31T08:04:17.718854+0000 mgr.a (mgr.14388) 15266 : cluster [DBG] pgmap v10583: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:04:20.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:19 smithi163 bash[24253]: audit 2024-08-31T08:04:18.835901+0000 mgr.a (mgr.14388) 15267 : audit [DBG] from='client.330855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:19 smithi027 bash[22610]: audit 2024-08-31T08:04:18.835901+0000 mgr.a (mgr.14388) 15267 : audit [DBG] from='client.330855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:20.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:19 smithi191 bash[24992]: audit 2024-08-31T08:04:18.835901+0000 mgr.a (mgr.14388) 15267 : audit [DBG] from='client.330855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:20 smithi163 bash[24253]: cluster 2024-08-31T08:04:19.721659+0000 mgr.a (mgr.14388) 15268 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:20 smithi027 bash[22610]: cluster 2024-08-31T08:04:19.721659+0000 mgr.a (mgr.14388) 15268 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:21.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:20 smithi191 bash[24992]: cluster 2024-08-31T08:04:19.721659+0000 mgr.a (mgr.14388) 15268 : cluster [DBG] pgmap v10584: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:22 smithi163 bash[24253]: cluster 2024-08-31T08:04:21.722426+0000 mgr.a (mgr.14388) 15269 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:22 smithi027 bash[22610]: cluster 2024-08-31T08:04:21.722426+0000 mgr.a (mgr.14388) 15269 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:22 smithi191 bash[24992]: cluster 2024-08-31T08:04:21.722426+0000 mgr.a (mgr.14388) 15269 : cluster [DBG] pgmap v10585: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:24.258 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:24.259 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:24.259 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:25.003 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:25.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:25.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:25.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:25.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:04:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:24 smithi163 bash[24253]: cluster 2024-08-31T08:04:23.724358+0000 mgr.a (mgr.14388) 15270 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:24 smithi163 bash[24253]: audit 2024-08-31T08:04:24.583994+0000 mgr.a (mgr.14388) 15271 : audit [DBG] from='client.330933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:24 smithi027 bash[22610]: cluster 2024-08-31T08:04:23.724358+0000 mgr.a (mgr.14388) 15270 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:24 smithi027 bash[22610]: audit 2024-08-31T08:04:24.583994+0000 mgr.a (mgr.14388) 15271 : audit [DBG] from='client.330933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:24 smithi191 bash[24992]: cluster 2024-08-31T08:04:23.724358+0000 mgr.a (mgr.14388) 15270 : cluster [DBG] pgmap v10586: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:24 smithi191 bash[24992]: audit 2024-08-31T08:04:24.583994+0000 mgr.a (mgr.14388) 15271 : audit [DBG] from='client.330933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:26 smithi163 bash[24253]: cluster 2024-08-31T08:04:25.725330+0000 mgr.a (mgr.14388) 15272 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:26 smithi027 bash[22610]: cluster 2024-08-31T08:04:25.725330+0000 mgr.a (mgr.14388) 15272 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:26 smithi191 bash[24992]: cluster 2024-08-31T08:04:25.725330+0000 mgr.a (mgr.14388) 15272 : cluster [DBG] pgmap v10587: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:28 smithi163 bash[24253]: cluster 2024-08-31T08:04:27.726109+0000 mgr.a (mgr.14388) 15273 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:28 smithi027 bash[22610]: cluster 2024-08-31T08:04:27.726109+0000 mgr.a (mgr.14388) 15273 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:28 smithi191 bash[24992]: cluster 2024-08-31T08:04:27.726109+0000 mgr.a (mgr.14388) 15273 : cluster [DBG] pgmap v10588: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:30.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:30.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:30.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:30.784 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:30.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:30.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:30.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:30.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:04:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:30 smithi163 bash[24253]: cluster 2024-08-31T08:04:29.728342+0000 mgr.a (mgr.14388) 15274 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:30 smithi163 bash[24253]: audit 2024-08-31T08:04:30.341250+0000 mgr.a (mgr.14388) 15275 : audit [DBG] from='client.331011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:30 smithi027 bash[22610]: cluster 2024-08-31T08:04:29.728342+0000 mgr.a (mgr.14388) 15274 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:30 smithi027 bash[22610]: audit 2024-08-31T08:04:30.341250+0000 mgr.a (mgr.14388) 15275 : audit [DBG] from='client.331011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:30 smithi191 bash[24992]: cluster 2024-08-31T08:04:29.728342+0000 mgr.a (mgr.14388) 15274 : cluster [DBG] pgmap v10589: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:30 smithi191 bash[24992]: audit 2024-08-31T08:04:30.341250+0000 mgr.a (mgr.14388) 15275 : audit [DBG] from='client.331011 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:32 smithi163 bash[24253]: cluster 2024-08-31T08:04:31.729325+0000 mgr.a (mgr.14388) 15276 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:32 smithi027 bash[22610]: cluster 2024-08-31T08:04:31.729325+0000 mgr.a (mgr.14388) 15276 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:32 smithi191 bash[24992]: cluster 2024-08-31T08:04:31.729325+0000 mgr.a (mgr.14388) 15276 : cluster [DBG] pgmap v10590: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:34 smithi163 bash[24253]: cluster 2024-08-31T08:04:33.731587+0000 mgr.a (mgr.14388) 15277 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:34 smithi027 bash[22610]: cluster 2024-08-31T08:04:33.731587+0000 mgr.a (mgr.14388) 15277 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:34 smithi191 bash[24992]: cluster 2024-08-31T08:04:33.731587+0000 mgr.a (mgr.14388) 15277 : cluster [DBG] pgmap v10591: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:35.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:35.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:35.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:36.529 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:36.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:36.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:36.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:36.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:04:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:36 smithi163 bash[24253]: cluster 2024-08-31T08:04:35.732349+0000 mgr.a (mgr.14388) 15278 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:36 smithi163 bash[24253]: audit 2024-08-31T08:04:36.109992+0000 mgr.a (mgr.14388) 15279 : audit [DBG] from='client.331086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:36 smithi027 bash[22610]: cluster 2024-08-31T08:04:35.732349+0000 mgr.a (mgr.14388) 15278 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:36 smithi027 bash[22610]: audit 2024-08-31T08:04:36.109992+0000 mgr.a (mgr.14388) 15279 : audit [DBG] from='client.331086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:36 smithi191 bash[24992]: cluster 2024-08-31T08:04:35.732349+0000 mgr.a (mgr.14388) 15278 : cluster [DBG] pgmap v10592: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:36 smithi191 bash[24992]: audit 2024-08-31T08:04:36.109992+0000 mgr.a (mgr.14388) 15279 : audit [DBG] from='client.331086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:38 smithi163 bash[24253]: cluster 2024-08-31T08:04:37.733344+0000 mgr.a (mgr.14388) 15280 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:38 smithi027 bash[22610]: cluster 2024-08-31T08:04:37.733344+0000 mgr.a (mgr.14388) 15280 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:38 smithi191 bash[24992]: cluster 2024-08-31T08:04:37.733344+0000 mgr.a (mgr.14388) 15280 : cluster [DBG] pgmap v10593: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:40 smithi163 bash[24253]: cluster 2024-08-31T08:04:39.735618+0000 mgr.a (mgr.14388) 15281 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:40 smithi027 bash[22610]: cluster 2024-08-31T08:04:39.735618+0000 mgr.a (mgr.14388) 15281 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:40 smithi191 bash[24992]: cluster 2024-08-31T08:04:39.735618+0000 mgr.a (mgr.14388) 15281 : cluster [DBG] pgmap v10594: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:41.531 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:41.531 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:41.531 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:42.316 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:42.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:42.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:42.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:42.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:04:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:42 smithi163 bash[24253]: cluster 2024-08-31T08:04:41.736363+0000 mgr.a (mgr.14388) 15282 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:42 smithi163 bash[24253]: audit 2024-08-31T08:04:41.868092+0000 mgr.a (mgr.14388) 15283 : audit [DBG] from='client.331164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:42 smithi027 bash[22610]: cluster 2024-08-31T08:04:41.736363+0000 mgr.a (mgr.14388) 15282 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:42 smithi027 bash[22610]: audit 2024-08-31T08:04:41.868092+0000 mgr.a (mgr.14388) 15283 : audit [DBG] from='client.331164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:42 smithi191 bash[24992]: cluster 2024-08-31T08:04:41.736363+0000 mgr.a (mgr.14388) 15282 : cluster [DBG] pgmap v10595: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:42 smithi191 bash[24992]: audit 2024-08-31T08:04:41.868092+0000 mgr.a (mgr.14388) 15283 : audit [DBG] from='client.331164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:44 smithi163 bash[24253]: cluster 2024-08-31T08:04:43.738704+0000 mgr.a (mgr.14388) 15284 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:44 smithi027 bash[22610]: cluster 2024-08-31T08:04:43.738704+0000 mgr.a (mgr.14388) 15284 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:45.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:44 smithi191 bash[24992]: cluster 2024-08-31T08:04:43.738704+0000 mgr.a (mgr.14388) 15284 : cluster [DBG] pgmap v10596: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:04:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:46 smithi163 bash[24253]: cluster 2024-08-31T08:04:45.739444+0000 mgr.a (mgr.14388) 15285 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:46 smithi027 bash[22610]: cluster 2024-08-31T08:04:45.739444+0000 mgr.a (mgr.14388) 15285 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:46 smithi191 bash[24992]: cluster 2024-08-31T08:04:45.739444+0000 mgr.a (mgr.14388) 15285 : cluster [DBG] pgmap v10597: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:47.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:47.319 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:48.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:48.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:04:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:48 smithi163 bash[24253]: audit 2024-08-31T08:04:47.653848+0000 mgr.a (mgr.14388) 15286 : audit [DBG] from='client.331242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:48 smithi163 bash[24253]: cluster 2024-08-31T08:04:47.740121+0000 mgr.a (mgr.14388) 15287 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:48 smithi027 bash[22610]: audit 2024-08-31T08:04:47.653848+0000 mgr.a (mgr.14388) 15286 : audit [DBG] from='client.331242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:48 smithi027 bash[22610]: cluster 2024-08-31T08:04:47.740121+0000 mgr.a (mgr.14388) 15287 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:49.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:48 smithi191 bash[24992]: audit 2024-08-31T08:04:47.653848+0000 mgr.a (mgr.14388) 15286 : audit [DBG] from='client.331242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:48 smithi191 bash[24992]: cluster 2024-08-31T08:04:47.740121+0000 mgr.a (mgr.14388) 15287 : cluster [DBG] pgmap v10598: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:50 smithi163 bash[24253]: cluster 2024-08-31T08:04:49.742506+0000 mgr.a (mgr.14388) 15288 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:04:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:50 smithi027 bash[22610]: cluster 2024-08-31T08:04:49.742506+0000 mgr.a (mgr.14388) 15288 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:04:51.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:50 smithi191 bash[24992]: cluster 2024-08-31T08:04:49.742506+0000 mgr.a (mgr.14388) 15288 : cluster [DBG] pgmap v10599: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:04:53.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:53.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:53.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:52 smithi163 bash[24253]: cluster 2024-08-31T08:04:51.743425+0000 mgr.a (mgr.14388) 15289 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:04:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:52 smithi027 bash[22610]: cluster 2024-08-31T08:04:51.743425+0000 mgr.a (mgr.14388) 15289 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:04:53.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:52 smithi191 bash[24992]: cluster 2024-08-31T08:04:51.743425+0000 mgr.a (mgr.14388) 15289 : cluster [DBG] pgmap v10600: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:04:53.855 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:53.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:04:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:53 smithi163 bash[24253]: audit 2024-08-31T08:04:53.143389+0000 mon.a (mon.0) 2859 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:04:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:53 smithi163 bash[24253]: audit 2024-08-31T08:04:53.438274+0000 mgr.a (mgr.14388) 15290 : audit [DBG] from='client.331320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:53 smithi027 bash[22610]: audit 2024-08-31T08:04:53.143389+0000 mon.a (mon.0) 2859 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:04:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:53 smithi027 bash[22610]: audit 2024-08-31T08:04:53.438274+0000 mgr.a (mgr.14388) 15290 : audit [DBG] from='client.331320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:53 smithi191 bash[24992]: audit 2024-08-31T08:04:53.143389+0000 mon.a (mon.0) 2859 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:04:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:53 smithi191 bash[24992]: audit 2024-08-31T08:04:53.438274+0000 mgr.a (mgr.14388) 15290 : audit [DBG] from='client.331320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:04:54.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:04:54 smithi027 bash[22863]: debug 2024-08-31T08:04:54.728+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:04:54.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:04:54 smithi027 bash[22863]: debug 2024-08-31T08:04:54.728+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:04:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:54 smithi027 bash[22610]: cluster 2024-08-31T08:04:53.749558+0000 mgr.a (mgr.14388) 15291 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:54 smithi027 bash[22610]: audit 2024-08-31T08:04:53.975081+0000 mon.a (mon.0) 2860 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:04:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:54 smithi027 bash[22610]: audit 2024-08-31T08:04:53.976907+0000 mon.a (mon.0) 2861 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:04:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:54 smithi027 bash[22610]: audit 2024-08-31T08:04:53.987139+0000 mon.a (mon.0) 2862 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:04:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:54 smithi027 bash[22610]: audit 2024-08-31T08:04:53.992085+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:04:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:54 smithi027 bash[22610]: audit 2024-08-31T08:04:53.994773+0000 mgr.a (mgr.14388) 15292 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:04:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:54 smithi163 bash[24253]: cluster 2024-08-31T08:04:53.749558+0000 mgr.a (mgr.14388) 15291 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:54 smithi163 bash[24253]: audit 2024-08-31T08:04:53.975081+0000 mon.a (mon.0) 2860 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:04:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:54 smithi163 bash[24253]: audit 2024-08-31T08:04:53.976907+0000 mon.a (mon.0) 2861 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:04:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:54 smithi163 bash[24253]: audit 2024-08-31T08:04:53.987139+0000 mon.a (mon.0) 2862 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:04:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:54 smithi163 bash[24253]: audit 2024-08-31T08:04:53.992085+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:04:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:54 smithi163 bash[24253]: audit 2024-08-31T08:04:53.994773+0000 mgr.a (mgr.14388) 15292 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:04:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:54 smithi191 bash[24992]: cluster 2024-08-31T08:04:53.749558+0000 mgr.a (mgr.14388) 15291 : cluster [DBG] pgmap v10601: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:04:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:54 smithi191 bash[24992]: audit 2024-08-31T08:04:53.975081+0000 mon.a (mon.0) 2860 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:04:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:54 smithi191 bash[24992]: audit 2024-08-31T08:04:53.976907+0000 mon.a (mon.0) 2861 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:04:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:54 smithi191 bash[24992]: audit 2024-08-31T08:04:53.987139+0000 mon.a (mon.0) 2862 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:04:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:54 smithi191 bash[24992]: audit 2024-08-31T08:04:53.992085+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:04:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:54 smithi191 bash[24992]: audit 2024-08-31T08:04:53.994773+0000 mgr.a (mgr.14388) 15292 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:04:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:55 smithi163 bash[24253]: audit 2024-08-31T08:04:54.730952+0000 mgr.a (mgr.14388) 15293 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:04:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:55 smithi163 bash[24253]: cephadm 2024-08-31T08:04:54.732286+0000 mgr.a (mgr.14388) 15294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:04:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:55 smithi027 bash[22610]: audit 2024-08-31T08:04:54.730952+0000 mgr.a (mgr.14388) 15293 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:04:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:55 smithi027 bash[22610]: cephadm 2024-08-31T08:04:54.732286+0000 mgr.a (mgr.14388) 15294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:04:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:55 smithi191 bash[24992]: audit 2024-08-31T08:04:54.730952+0000 mgr.a (mgr.14388) 15293 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:04:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:55 smithi191 bash[24992]: cephadm 2024-08-31T08:04:54.732286+0000 mgr.a (mgr.14388) 15294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:04:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:56 smithi163 bash[24253]: cluster 2024-08-31T08:04:55.750459+0000 mgr.a (mgr.14388) 15295 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:57.699 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:56 smithi191 bash[24992]: cluster 2024-08-31T08:04:55.750459+0000 mgr.a (mgr.14388) 15295 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:57.699 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:56 smithi027 bash[22610]: cluster 2024-08-31T08:04:55.750459+0000 mgr.a (mgr.14388) 15295 : cluster [DBG] pgmap v10602: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:58.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:04:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:04:58.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:04:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:58 smithi163 bash[24253]: cluster 2024-08-31T08:04:57.751275+0000 mgr.a (mgr.14388) 15296 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:58 smithi027 bash[22610]: cluster 2024-08-31T08:04:57.751275+0000 mgr.a (mgr.14388) 15296 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:59.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:58 smithi191 bash[24992]: cluster 2024-08-31T08:04:57.751275+0000 mgr.a (mgr.14388) 15296 : cluster [DBG] pgmap v10603: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:04:59.642 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:04:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:04:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:04:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:04:59.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:04:59 smithi163 bash[24253]: audit 2024-08-31T08:04:59.196049+0000 mgr.a (mgr.14388) 15297 : audit [DBG] from='client.331506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:04:59 smithi027 bash[22610]: audit 2024-08-31T08:04:59.196049+0000 mgr.a (mgr.14388) 15297 : audit [DBG] from='client.331506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:04:59 smithi191 bash[24992]: audit 2024-08-31T08:04:59.196049+0000 mgr.a (mgr.14388) 15297 : audit [DBG] from='client.331506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:00 smithi163 bash[24253]: cluster 2024-08-31T08:04:59.754107+0000 mgr.a (mgr.14388) 15298 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:01.237 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:00 smithi027 bash[22610]: cluster 2024-08-31T08:04:59.754107+0000 mgr.a (mgr.14388) 15298 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:00 smithi191 bash[24992]: cluster 2024-08-31T08:04:59.754107+0000 mgr.a (mgr.14388) 15298 : cluster [DBG] pgmap v10604: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:02 smithi163 bash[24253]: cluster 2024-08-31T08:05:01.755007+0000 mgr.a (mgr.14388) 15299 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:05:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:02 smithi027 bash[22610]: cluster 2024-08-31T08:05:01.755007+0000 mgr.a (mgr.14388) 15299 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:05:03.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:02 smithi191 bash[24992]: cluster 2024-08-31T08:05:01.755007+0000 mgr.a (mgr.14388) 15299 : cluster [DBG] pgmap v10605: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:05:04.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:05:04.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:05:04.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:05:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:04 smithi163 bash[24253]: cluster 2024-08-31T08:05:03.757013+0000 mgr.a (mgr.14388) 15300 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:04 smithi027 bash[22610]: cluster 2024-08-31T08:05:03.757013+0000 mgr.a (mgr.14388) 15300 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:04 smithi191 bash[24992]: cluster 2024-08-31T08:05:03.757013+0000 mgr.a (mgr.14388) 15300 : cluster [DBG] pgmap v10606: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:05.436 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:05:05.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:05:05.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:05:05.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:05:05.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:05 smithi027 bash[22610]: audit 2024-08-31T08:05:04.987765+0000 mgr.a (mgr.14388) 15301 : audit [DBG] from='client.331584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:06.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:05 smithi191 bash[24992]: audit 2024-08-31T08:05:04.987765+0000 mgr.a (mgr.14388) 15301 : audit [DBG] from='client.331584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:05 smithi163 bash[24253]: audit 2024-08-31T08:05:04.987765+0000 mgr.a (mgr.14388) 15301 : audit [DBG] from='client.331584 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:06 smithi027 bash[22610]: cluster 2024-08-31T08:05:05.757999+0000 mgr.a (mgr.14388) 15302 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:06 smithi191 bash[24992]: cluster 2024-08-31T08:05:05.757999+0000 mgr.a (mgr.14388) 15302 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:06 smithi163 bash[24253]: cluster 2024-08-31T08:05:05.757999+0000 mgr.a (mgr.14388) 15302 : cluster [DBG] pgmap v10607: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:08 smithi027 bash[22610]: cluster 2024-08-31T08:05:07.758830+0000 mgr.a (mgr.14388) 15303 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:08 smithi191 bash[24992]: cluster 2024-08-31T08:05:07.758830+0000 mgr.a (mgr.14388) 15303 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:08 smithi163 bash[24253]: cluster 2024-08-31T08:05:07.758830+0000 mgr.a (mgr.14388) 15303 : cluster [DBG] pgmap v10608: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:10.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:05:10.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:05:10.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:05:11.215 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:05:11.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:05:11.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:05:11.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:05:11.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:10 smithi027 bash[22610]: cluster 2024-08-31T08:05:09.761021+0000 mgr.a (mgr.14388) 15304 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:10 smithi191 bash[24992]: cluster 2024-08-31T08:05:09.761021+0000 mgr.a (mgr.14388) 15304 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:10 smithi163 bash[24253]: cluster 2024-08-31T08:05:09.761021+0000 mgr.a (mgr.14388) 15304 : cluster [DBG] pgmap v10609: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:05:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:11 smithi027 bash[22610]: audit 2024-08-31T08:05:10.776933+0000 mgr.a (mgr.14388) 15305 : audit [DBG] from='client.331659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:11 smithi191 bash[24992]: audit 2024-08-31T08:05:10.776933+0000 mgr.a (mgr.14388) 15305 : audit [DBG] from='client.331659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:11 smithi163 bash[24253]: audit 2024-08-31T08:05:10.776933+0000 mgr.a (mgr.14388) 15305 : audit [DBG] from='client.331659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:12 smithi027 bash[22610]: cluster 2024-08-31T08:05:11.761991+0000 mgr.a (mgr.14388) 15306 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:12 smithi191 bash[24992]: cluster 2024-08-31T08:05:11.761991+0000 mgr.a (mgr.14388) 15306 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:12 smithi163 bash[24253]: cluster 2024-08-31T08:05:11.761991+0000 mgr.a (mgr.14388) 15306 : cluster [DBG] pgmap v10610: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:14 smithi191 bash[24992]: cluster 2024-08-31T08:05:13.764232+0000 mgr.a (mgr.14388) 15307 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:14 smithi163 bash[24253]: cluster 2024-08-31T08:05:13.764232+0000 mgr.a (mgr.14388) 15307 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:14 smithi027 bash[22610]: cluster 2024-08-31T08:05:13.764232+0000 mgr.a (mgr.14388) 15307 : cluster [DBG] pgmap v10611: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:16.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:05:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:05:16.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:05:16.980 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:05:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:05:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:05:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:05:16.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:16 smithi191 bash[24992]: cluster 2024-08-31T08:05:15.765003+0000 mgr.a (mgr.14388) 15308 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:16 smithi191 bash[24992]: audit 2024-08-31T08:05:16.545985+0000 mgr.a (mgr.14388) 15309 : audit [DBG] from='client.331737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:16 smithi163 bash[24253]: cluster 2024-08-31T08:05:15.765003+0000 mgr.a (mgr.14388) 15308 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:16 smithi163 bash[24253]: audit 2024-08-31T08:05:16.545985+0000 mgr.a (mgr.14388) 15309 : audit [DBG] from='client.331737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:16 smithi027 bash[22610]: cluster 2024-08-31T08:05:15.765003+0000 mgr.a (mgr.14388) 15308 : cluster [DBG] pgmap v10612: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:16 smithi027 bash[22610]: audit 2024-08-31T08:05:16.545985+0000 mgr.a (mgr.14388) 15309 : audit [DBG] from='client.331737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:19.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:18 smithi191 bash[24992]: cluster 2024-08-31T08:05:17.765988+0000 mgr.a (mgr.14388) 15310 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:18 smithi163 bash[24253]: cluster 2024-08-31T08:05:17.765988+0000 mgr.a (mgr.14388) 15310 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:18 smithi027 bash[22610]: cluster 2024-08-31T08:05:17.765988+0000 mgr.a (mgr.14388) 15310 : cluster [DBG] pgmap v10613: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:21.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:21 smithi191 bash[24992]: cluster 2024-08-31T08:05:19.768339+0000 mgr.a (mgr.14388) 15311 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:21 smithi163 bash[24253]: cluster 2024-08-31T08:05:19.768339+0000 mgr.a (mgr.14388) 15311 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:20 smithi027 bash[22610]: cluster 2024-08-31T08:05:19.768339+0000 mgr.a (mgr.14388) 15311 : cluster [DBG] pgmap v10614: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:21.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:05:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:05:21.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:05:22.724 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:05:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:05:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:05:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:05:22.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:23 smithi191 bash[24992]: cluster 2024-08-31T08:05:21.769181+0000 mgr.a (mgr.14388) 15312 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:23 smithi191 bash[24992]: audit 2024-08-31T08:05:22.312081+0000 mgr.a (mgr.14388) 15313 : audit [DBG] from='client.331815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:23 smithi163 bash[24253]: cluster 2024-08-31T08:05:21.769181+0000 mgr.a (mgr.14388) 15312 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:23 smithi163 bash[24253]: audit 2024-08-31T08:05:22.312081+0000 mgr.a (mgr.14388) 15313 : audit [DBG] from='client.331815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:23 smithi027 bash[22610]: cluster 2024-08-31T08:05:21.769181+0000 mgr.a (mgr.14388) 15312 : cluster [DBG] pgmap v10615: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:23 smithi027 bash[22610]: audit 2024-08-31T08:05:22.312081+0000 mgr.a (mgr.14388) 15313 : audit [DBG] from='client.331815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:25 smithi191 bash[24992]: cluster 2024-08-31T08:05:23.771562+0000 mgr.a (mgr.14388) 15314 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:25 smithi163 bash[24253]: cluster 2024-08-31T08:05:23.771562+0000 mgr.a (mgr.14388) 15314 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:25 smithi027 bash[22610]: cluster 2024-08-31T08:05:23.771562+0000 mgr.a (mgr.14388) 15314 : cluster [DBG] pgmap v10616: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:27 smithi191 bash[24992]: cluster 2024-08-31T08:05:25.772343+0000 mgr.a (mgr.14388) 15315 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:27 smithi163 bash[24253]: cluster 2024-08-31T08:05:25.772343+0000 mgr.a (mgr.14388) 15315 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:27 smithi027 bash[22610]: cluster 2024-08-31T08:05:25.772343+0000 mgr.a (mgr.14388) 15315 : cluster [DBG] pgmap v10617: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:27.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:05:27.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:05:27.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:05:28.473 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:05:28.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:05:28.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:05:28.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:05:28.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:29 smithi191 bash[24992]: cluster 2024-08-31T08:05:27.772936+0000 mgr.a (mgr.14388) 15316 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:29 smithi191 bash[24992]: audit 2024-08-31T08:05:28.058644+0000 mgr.a (mgr.14388) 15317 : audit [DBG] from='client.331890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:29 smithi163 bash[24253]: cluster 2024-08-31T08:05:27.772936+0000 mgr.a (mgr.14388) 15316 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:29 smithi163 bash[24253]: audit 2024-08-31T08:05:28.058644+0000 mgr.a (mgr.14388) 15317 : audit [DBG] from='client.331890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:29 smithi027 bash[22610]: cluster 2024-08-31T08:05:27.772936+0000 mgr.a (mgr.14388) 15316 : cluster [DBG] pgmap v10618: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:29 smithi027 bash[22610]: audit 2024-08-31T08:05:28.058644+0000 mgr.a (mgr.14388) 15317 : audit [DBG] from='client.331890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:31.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:31 smithi191 bash[24992]: cluster 2024-08-31T08:05:29.775785+0000 mgr.a (mgr.14388) 15318 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:31 smithi163 bash[24253]: cluster 2024-08-31T08:05:29.775785+0000 mgr.a (mgr.14388) 15318 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:31 smithi027 bash[22610]: cluster 2024-08-31T08:05:29.775785+0000 mgr.a (mgr.14388) 15318 : cluster [DBG] pgmap v10619: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:33 smithi191 bash[24992]: cluster 2024-08-31T08:05:31.776750+0000 mgr.a (mgr.14388) 15319 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:05:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:33 smithi163 bash[24253]: cluster 2024-08-31T08:05:31.776750+0000 mgr.a (mgr.14388) 15319 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:05:33.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:05:33.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:05:33.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:05:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:33 smithi027 bash[22610]: cluster 2024-08-31T08:05:31.776750+0000 mgr.a (mgr.14388) 15319 : cluster [DBG] pgmap v10620: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:05:34.230 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:05:34.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:05:34.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:05:34.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:05:34.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:35 smithi163 bash[24253]: cluster 2024-08-31T08:05:33.778698+0000 mgr.a (mgr.14388) 15320 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:35 smithi163 bash[24253]: audit 2024-08-31T08:05:33.804630+0000 mgr.a (mgr.14388) 15321 : audit [DBG] from='client.331968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:35 smithi027 bash[22610]: cluster 2024-08-31T08:05:33.778698+0000 mgr.a (mgr.14388) 15320 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:35 smithi027 bash[22610]: audit 2024-08-31T08:05:33.804630+0000 mgr.a (mgr.14388) 15321 : audit [DBG] from='client.331968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:35 smithi191 bash[24992]: cluster 2024-08-31T08:05:33.778698+0000 mgr.a (mgr.14388) 15320 : cluster [DBG] pgmap v10621: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:35 smithi191 bash[24992]: audit 2024-08-31T08:05:33.804630+0000 mgr.a (mgr.14388) 15321 : audit [DBG] from='client.331968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:37 smithi163 bash[24253]: cluster 2024-08-31T08:05:35.779659+0000 mgr.a (mgr.14388) 15322 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:05:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:37 smithi027 bash[22610]: cluster 2024-08-31T08:05:35.779659+0000 mgr.a (mgr.14388) 15322 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:05:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:37 smithi191 bash[24992]: cluster 2024-08-31T08:05:35.779659+0000 mgr.a (mgr.14388) 15322 : cluster [DBG] pgmap v10622: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:05:39.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:05:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:05:39.233 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:05:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:39 smithi163 bash[24253]: cluster 2024-08-31T08:05:37.780436+0000 mgr.a (mgr.14388) 15323 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:05:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:39 smithi027 bash[22610]: cluster 2024-08-31T08:05:37.780436+0000 mgr.a (mgr.14388) 15323 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:05:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:39 smithi191 bash[24992]: cluster 2024-08-31T08:05:37.780436+0000 mgr.a (mgr.14388) 15323 : cluster [DBG] pgmap v10623: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:05:40.022 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:05:40.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:05:40.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:05:40.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:05:40.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:40.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:40 smithi163 bash[24253]: audit 2024-08-31T08:05:39.566900+0000 mgr.a (mgr.14388) 15324 : audit [DBG] from='client.332046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:40 smithi027 bash[22610]: audit 2024-08-31T08:05:39.566900+0000 mgr.a (mgr.14388) 15324 : audit [DBG] from='client.332046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:40 smithi191 bash[24992]: audit 2024-08-31T08:05:39.566900+0000 mgr.a (mgr.14388) 15324 : audit [DBG] from='client.332046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:41 smithi163 bash[24253]: cluster 2024-08-31T08:05:39.782004+0000 mgr.a (mgr.14388) 15325 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:41 smithi027 bash[22610]: cluster 2024-08-31T08:05:39.782004+0000 mgr.a (mgr.14388) 15325 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:41 smithi191 bash[24992]: cluster 2024-08-31T08:05:39.782004+0000 mgr.a (mgr.14388) 15325 : cluster [DBG] pgmap v10624: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:43 smithi163 bash[24253]: cluster 2024-08-31T08:05:41.783072+0000 mgr.a (mgr.14388) 15326 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:43 smithi027 bash[22610]: cluster 2024-08-31T08:05:41.783072+0000 mgr.a (mgr.14388) 15326 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:43 smithi191 bash[24992]: cluster 2024-08-31T08:05:41.783072+0000 mgr.a (mgr.14388) 15326 : cluster [DBG] pgmap v10625: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:45.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:05:45.024 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:05:45.024 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:05:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:45 smithi163 bash[24253]: cluster 2024-08-31T08:05:43.785407+0000 mgr.a (mgr.14388) 15327 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:45 smithi027 bash[22610]: cluster 2024-08-31T08:05:43.785407+0000 mgr.a (mgr.14388) 15327 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:45 smithi191 bash[24992]: cluster 2024-08-31T08:05:43.785407+0000 mgr.a (mgr.14388) 15327 : cluster [DBG] pgmap v10626: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:45.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:05:45.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:05:45.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:05:45.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:45.785 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:05:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:46 smithi163 bash[24253]: audit 2024-08-31T08:05:45.358671+0000 mgr.a (mgr.14388) 15328 : audit [DBG] from='client.332118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:46 smithi027 bash[22610]: audit 2024-08-31T08:05:45.358671+0000 mgr.a (mgr.14388) 15328 : audit [DBG] from='client.332118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:46 smithi191 bash[24992]: audit 2024-08-31T08:05:45.358671+0000 mgr.a (mgr.14388) 15328 : audit [DBG] from='client.332118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:47 smithi163 bash[24253]: cluster 2024-08-31T08:05:45.785918+0000 mgr.a (mgr.14388) 15329 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:47 smithi027 bash[22610]: cluster 2024-08-31T08:05:45.785918+0000 mgr.a (mgr.14388) 15329 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:47 smithi191 bash[24992]: cluster 2024-08-31T08:05:45.785918+0000 mgr.a (mgr.14388) 15329 : cluster [DBG] pgmap v10627: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:49 smithi163 bash[24253]: cluster 2024-08-31T08:05:47.786679+0000 mgr.a (mgr.14388) 15330 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:49 smithi027 bash[22610]: cluster 2024-08-31T08:05:47.786679+0000 mgr.a (mgr.14388) 15330 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:49 smithi191 bash[24992]: cluster 2024-08-31T08:05:47.786679+0000 mgr.a (mgr.14388) 15330 : cluster [DBG] pgmap v10628: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:50.786 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:05:50.787 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:05:50.787 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:05:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:51 smithi163 bash[24253]: cluster 2024-08-31T08:05:49.788918+0000 mgr.a (mgr.14388) 15331 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:51 smithi027 bash[22610]: cluster 2024-08-31T08:05:49.788918+0000 mgr.a (mgr.14388) 15331 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:51.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:51 smithi191 bash[24992]: cluster 2024-08-31T08:05:49.788918+0000 mgr.a (mgr.14388) 15331 : cluster [DBG] pgmap v10629: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:51.548 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:05:51.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:05:51.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:05:51.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:05:51.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:52 smithi163 bash[24253]: audit 2024-08-31T08:05:51.122871+0000 mgr.a (mgr.14388) 15332 : audit [DBG] from='client.332196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:52 smithi027 bash[22610]: audit 2024-08-31T08:05:51.122871+0000 mgr.a (mgr.14388) 15332 : audit [DBG] from='client.332196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:52 smithi191 bash[24992]: audit 2024-08-31T08:05:51.122871+0000 mgr.a (mgr.14388) 15332 : audit [DBG] from='client.332196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:53 smithi163 bash[24253]: cluster 2024-08-31T08:05:51.789843+0000 mgr.a (mgr.14388) 15333 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:53 smithi027 bash[22610]: cluster 2024-08-31T08:05:51.789843+0000 mgr.a (mgr.14388) 15333 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:53 smithi191 bash[24992]: cluster 2024-08-31T08:05:51.789843+0000 mgr.a (mgr.14388) 15333 : cluster [DBG] pgmap v10630: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:55 smithi163 bash[24253]: cluster 2024-08-31T08:05:53.792055+0000 mgr.a (mgr.14388) 15334 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:55 smithi163 bash[24253]: audit 2024-08-31T08:05:54.783831+0000 mon.a (mon.0) 2864 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:05:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:55 smithi027 bash[22610]: cluster 2024-08-31T08:05:53.792055+0000 mgr.a (mgr.14388) 15334 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:55 smithi027 bash[22610]: audit 2024-08-31T08:05:54.783831+0000 mon.a (mon.0) 2864 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:05:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:55 smithi191 bash[24992]: cluster 2024-08-31T08:05:53.792055+0000 mgr.a (mgr.14388) 15334 : cluster [DBG] pgmap v10631: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:05:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:55 smithi191 bash[24992]: audit 2024-08-31T08:05:54.783831+0000 mon.a (mon.0) 2864 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:05:56.400 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:56 smithi027 bash[22610]: audit 2024-08-31T08:05:55.632219+0000 mon.a (mon.0) 2865 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:05:56.455 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:56 smithi027 bash[22610]: audit 2024-08-31T08:05:55.633927+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:05:56.455 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:56 smithi027 bash[22610]: audit 2024-08-31T08:05:55.644863+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:05:56.455 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:56 smithi027 bash[22610]: audit 2024-08-31T08:05:55.649804+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:05:56.456 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:56 smithi163 bash[24253]: audit 2024-08-31T08:05:55.632219+0000 mon.a (mon.0) 2865 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:05:56.456 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:56 smithi163 bash[24253]: audit 2024-08-31T08:05:55.633927+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:05:56.456 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:56 smithi163 bash[24253]: audit 2024-08-31T08:05:55.644863+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:05:56.456 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:56 smithi163 bash[24253]: audit 2024-08-31T08:05:55.649804+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:05:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:56 smithi191 bash[24992]: audit 2024-08-31T08:05:55.632219+0000 mon.a (mon.0) 2865 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:05:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:56 smithi191 bash[24992]: audit 2024-08-31T08:05:55.633927+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:05:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:56 smithi191 bash[24992]: audit 2024-08-31T08:05:55.644863+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:05:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:56 smithi191 bash[24992]: audit 2024-08-31T08:05:55.649804+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:05:56.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:05:56.551 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:05:56.551 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:05:56.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:05:56 smithi027 bash[22863]: debug 2024-08-31T08:05:56.395+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:05:56.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:05:56 smithi027 bash[22863]: debug 2024-08-31T08:05:56.395+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:05:57.289 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:05:57.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:05:57.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:05:57.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:05:57.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:05:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:57 smithi163 bash[24253]: audit 2024-08-31T08:05:55.652096+0000 mgr.a (mgr.14388) 15335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:05:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:57 smithi163 bash[24253]: cluster 2024-08-31T08:05:55.792739+0000 mgr.a (mgr.14388) 15336 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:57 smithi163 bash[24253]: audit 2024-08-31T08:05:56.399868+0000 mgr.a (mgr.14388) 15337 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:05:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:57 smithi163 bash[24253]: cephadm 2024-08-31T08:05:56.401042+0000 mgr.a (mgr.14388) 15338 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:05:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:57 smithi027 bash[22610]: audit 2024-08-31T08:05:55.652096+0000 mgr.a (mgr.14388) 15335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:05:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:57 smithi027 bash[22610]: cluster 2024-08-31T08:05:55.792739+0000 mgr.a (mgr.14388) 15336 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:57 smithi027 bash[22610]: audit 2024-08-31T08:05:56.399868+0000 mgr.a (mgr.14388) 15337 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:05:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:57 smithi027 bash[22610]: cephadm 2024-08-31T08:05:56.401042+0000 mgr.a (mgr.14388) 15338 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:05:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:57 smithi191 bash[24992]: audit 2024-08-31T08:05:55.652096+0000 mgr.a (mgr.14388) 15335 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:05:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:57 smithi191 bash[24992]: cluster 2024-08-31T08:05:55.792739+0000 mgr.a (mgr.14388) 15336 : cluster [DBG] pgmap v10632: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:57 smithi191 bash[24992]: audit 2024-08-31T08:05:56.399868+0000 mgr.a (mgr.14388) 15337 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:05:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:57 smithi191 bash[24992]: cephadm 2024-08-31T08:05:56.401042+0000 mgr.a (mgr.14388) 15338 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:05:58.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:58 smithi163 bash[24253]: audit 2024-08-31T08:05:56.879784+0000 mgr.a (mgr.14388) 15339 : audit [DBG] from='client.332379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:58 smithi027 bash[22610]: audit 2024-08-31T08:05:56.879784+0000 mgr.a (mgr.14388) 15339 : audit [DBG] from='client.332379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:58 smithi191 bash[24992]: audit 2024-08-31T08:05:56.879784+0000 mgr.a (mgr.14388) 15339 : audit [DBG] from='client.332379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:05:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:05:59 smithi163 bash[24253]: cluster 2024-08-31T08:05:57.793691+0000 mgr.a (mgr.14388) 15340 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:59.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:05:59 smithi027 bash[22610]: cluster 2024-08-31T08:05:57.793691+0000 mgr.a (mgr.14388) 15340 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:05:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:05:59 smithi191 bash[24992]: cluster 2024-08-31T08:05:57.793691+0000 mgr.a (mgr.14388) 15340 : cluster [DBG] pgmap v10633: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:01 smithi163 bash[24253]: cluster 2024-08-31T08:05:59.795964+0000 mgr.a (mgr.14388) 15341 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:01 smithi027 bash[22610]: cluster 2024-08-31T08:05:59.795964+0000 mgr.a (mgr.14388) 15341 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:01 smithi191 bash[24992]: cluster 2024-08-31T08:05:59.795964+0000 mgr.a (mgr.14388) 15341 : cluster [DBG] pgmap v10634: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:02.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:02.292 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:02.292 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:06:03.062 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:06:03.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:06:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:06:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:06:03.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:06:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:03 smithi163 bash[24253]: cluster 2024-08-31T08:06:01.796792+0000 mgr.a (mgr.14388) 15342 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:03 smithi163 bash[24253]: audit 2024-08-31T08:06:02.630525+0000 mgr.a (mgr.14388) 15343 : audit [DBG] from='client.332457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:03 smithi027 bash[22610]: cluster 2024-08-31T08:06:01.796792+0000 mgr.a (mgr.14388) 15342 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:03 smithi027 bash[22610]: audit 2024-08-31T08:06:02.630525+0000 mgr.a (mgr.14388) 15343 : audit [DBG] from='client.332457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:03 smithi191 bash[24992]: cluster 2024-08-31T08:06:01.796792+0000 mgr.a (mgr.14388) 15342 : cluster [DBG] pgmap v10635: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:03 smithi191 bash[24992]: audit 2024-08-31T08:06:02.630525+0000 mgr.a (mgr.14388) 15343 : audit [DBG] from='client.332457 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:05 smithi163 bash[24253]: cluster 2024-08-31T08:06:03.799289+0000 mgr.a (mgr.14388) 15344 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:05 smithi027 bash[22610]: cluster 2024-08-31T08:06:03.799289+0000 mgr.a (mgr.14388) 15344 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:05 smithi191 bash[24992]: cluster 2024-08-31T08:06:03.799289+0000 mgr.a (mgr.14388) 15344 : cluster [DBG] pgmap v10636: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:07 smithi163 bash[24253]: cluster 2024-08-31T08:06:05.800096+0000 mgr.a (mgr.14388) 15345 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:06:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:07 smithi027 bash[22610]: cluster 2024-08-31T08:06:05.800096+0000 mgr.a (mgr.14388) 15345 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:06:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:07 smithi191 bash[24992]: cluster 2024-08-31T08:06:05.800096+0000 mgr.a (mgr.14388) 15345 : cluster [DBG] pgmap v10637: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:06:08.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:08.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:08.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:06:08.810 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:06:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:06:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:06:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:06:08.810 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:06:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:09 smithi163 bash[24253]: cluster 2024-08-31T08:06:07.800871+0000 mgr.a (mgr.14388) 15346 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:06:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:09 smithi163 bash[24253]: audit 2024-08-31T08:06:08.399540+0000 mgr.a (mgr.14388) 15347 : audit [DBG] from='client.332535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:09 smithi027 bash[22610]: cluster 2024-08-31T08:06:07.800871+0000 mgr.a (mgr.14388) 15346 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:06:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:09 smithi027 bash[22610]: audit 2024-08-31T08:06:08.399540+0000 mgr.a (mgr.14388) 15347 : audit [DBG] from='client.332535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:09 smithi191 bash[24992]: cluster 2024-08-31T08:06:07.800871+0000 mgr.a (mgr.14388) 15346 : cluster [DBG] pgmap v10638: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:06:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:09 smithi191 bash[24992]: audit 2024-08-31T08:06:08.399540+0000 mgr.a (mgr.14388) 15347 : audit [DBG] from='client.332535 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:11 smithi163 bash[24253]: cluster 2024-08-31T08:06:09.803667+0000 mgr.a (mgr.14388) 15348 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:11 smithi027 bash[22610]: cluster 2024-08-31T08:06:09.803667+0000 mgr.a (mgr.14388) 15348 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:11 smithi191 bash[24992]: cluster 2024-08-31T08:06:09.803667+0000 mgr.a (mgr.14388) 15348 : cluster [DBG] pgmap v10639: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:06:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:13 smithi163 bash[24253]: cluster 2024-08-31T08:06:11.804468+0000 mgr.a (mgr.14388) 15349 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:06:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:13 smithi027 bash[22610]: cluster 2024-08-31T08:06:11.804468+0000 mgr.a (mgr.14388) 15349 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:06:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:13 smithi191 bash[24992]: cluster 2024-08-31T08:06:11.804468+0000 mgr.a (mgr.14388) 15349 : cluster [DBG] pgmap v10640: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:06:13.811 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:13.812 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:13.812 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:06:14.561 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:06:14.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:06:14.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:06:14.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:06:14.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:06:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:15 smithi163 bash[24253]: cluster 2024-08-31T08:06:13.806481+0000 mgr.a (mgr.14388) 15350 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:15 smithi163 bash[24253]: audit 2024-08-31T08:06:14.145862+0000 mgr.a (mgr.14388) 15351 : audit [DBG] from='client.332613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:15 smithi027 bash[22610]: cluster 2024-08-31T08:06:13.806481+0000 mgr.a (mgr.14388) 15350 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:15 smithi027 bash[22610]: audit 2024-08-31T08:06:14.145862+0000 mgr.a (mgr.14388) 15351 : audit [DBG] from='client.332613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:15 smithi191 bash[24992]: cluster 2024-08-31T08:06:13.806481+0000 mgr.a (mgr.14388) 15350 : cluster [DBG] pgmap v10641: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:15 smithi191 bash[24992]: audit 2024-08-31T08:06:14.145862+0000 mgr.a (mgr.14388) 15351 : audit [DBG] from='client.332613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:17 smithi163 bash[24253]: cluster 2024-08-31T08:06:15.807553+0000 mgr.a (mgr.14388) 15352 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:06:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:17 smithi027 bash[22610]: cluster 2024-08-31T08:06:15.807553+0000 mgr.a (mgr.14388) 15352 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:06:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:17 smithi191 bash[24992]: cluster 2024-08-31T08:06:15.807553+0000 mgr.a (mgr.14388) 15352 : cluster [DBG] pgmap v10642: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:06:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:19 smithi163 bash[24253]: cluster 2024-08-31T08:06:17.808399+0000 mgr.a (mgr.14388) 15353 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:06:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:19 smithi027 bash[22610]: cluster 2024-08-31T08:06:17.808399+0000 mgr.a (mgr.14388) 15353 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:06:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:19 smithi191 bash[24992]: cluster 2024-08-31T08:06:17.808399+0000 mgr.a (mgr.14388) 15353 : cluster [DBG] pgmap v10643: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:06:19.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:19.563 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:19.563 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:06:20.315 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:06:20.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:06:20.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:06:20.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:06:20.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:06:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:21 smithi163 bash[24253]: cluster 2024-08-31T08:06:19.809712+0000 mgr.a (mgr.14388) 15354 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:06:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:21 smithi163 bash[24253]: audit 2024-08-31T08:06:19.893859+0000 mgr.a (mgr.14388) 15355 : audit [DBG] from='client.332688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:21 smithi027 bash[22610]: cluster 2024-08-31T08:06:19.809712+0000 mgr.a (mgr.14388) 15354 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:06:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:21 smithi027 bash[22610]: audit 2024-08-31T08:06:19.893859+0000 mgr.a (mgr.14388) 15355 : audit [DBG] from='client.332688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:21 smithi191 bash[24992]: cluster 2024-08-31T08:06:19.809712+0000 mgr.a (mgr.14388) 15354 : cluster [DBG] pgmap v10644: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:06:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:21 smithi191 bash[24992]: audit 2024-08-31T08:06:19.893859+0000 mgr.a (mgr.14388) 15355 : audit [DBG] from='client.332688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:23 smithi163 bash[24253]: cluster 2024-08-31T08:06:21.810571+0000 mgr.a (mgr.14388) 15356 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:23 smithi027 bash[22610]: cluster 2024-08-31T08:06:21.810571+0000 mgr.a (mgr.14388) 15356 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:23 smithi191 bash[24992]: cluster 2024-08-31T08:06:21.810571+0000 mgr.a (mgr.14388) 15356 : cluster [DBG] pgmap v10645: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:25.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:25.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:25.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:06:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:25 smithi163 bash[24253]: cluster 2024-08-31T08:06:23.812797+0000 mgr.a (mgr.14388) 15357 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:25 smithi027 bash[22610]: cluster 2024-08-31T08:06:23.812797+0000 mgr.a (mgr.14388) 15357 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:25 smithi191 bash[24992]: cluster 2024-08-31T08:06:23.812797+0000 mgr.a (mgr.14388) 15357 : cluster [DBG] pgmap v10646: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:06:26.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:06:26.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:06:26.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:06:26.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:06:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:26 smithi163 bash[24253]: audit 2024-08-31T08:06:25.647615+0000 mgr.a (mgr.14388) 15358 : audit [DBG] from='client.332766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:26 smithi027 bash[22610]: audit 2024-08-31T08:06:25.647615+0000 mgr.a (mgr.14388) 15358 : audit [DBG] from='client.332766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:26 smithi191 bash[24992]: audit 2024-08-31T08:06:25.647615+0000 mgr.a (mgr.14388) 15358 : audit [DBG] from='client.332766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:27 smithi163 bash[24253]: cluster 2024-08-31T08:06:25.813361+0000 mgr.a (mgr.14388) 15359 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:27 smithi027 bash[22610]: cluster 2024-08-31T08:06:25.813361+0000 mgr.a (mgr.14388) 15359 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:27 smithi191 bash[24992]: cluster 2024-08-31T08:06:25.813361+0000 mgr.a (mgr.14388) 15359 : cluster [DBG] pgmap v10647: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:29 smithi163 bash[24253]: cluster 2024-08-31T08:06:27.814397+0000 mgr.a (mgr.14388) 15360 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:29 smithi027 bash[22610]: cluster 2024-08-31T08:06:27.814397+0000 mgr.a (mgr.14388) 15360 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:29 smithi191 bash[24992]: cluster 2024-08-31T08:06:27.814397+0000 mgr.a (mgr.14388) 15360 : cluster [DBG] pgmap v10648: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:31.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:31.092 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:31.093 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:06:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:31 smithi163 bash[24253]: cluster 2024-08-31T08:06:29.816843+0000 mgr.a (mgr.14388) 15361 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:31 smithi027 bash[22610]: cluster 2024-08-31T08:06:29.816843+0000 mgr.a (mgr.14388) 15361 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:31 smithi191 bash[24992]: cluster 2024-08-31T08:06:29.816843+0000 mgr.a (mgr.14388) 15361 : cluster [DBG] pgmap v10649: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:31.855 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:06:31.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:06:31.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:06:31.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:06:31.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:06:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:32 smithi163 bash[24253]: audit 2024-08-31T08:06:31.425937+0000 mgr.a (mgr.14388) 15362 : audit [DBG] from='client.332844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:32 smithi027 bash[22610]: audit 2024-08-31T08:06:31.425937+0000 mgr.a (mgr.14388) 15362 : audit [DBG] from='client.332844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:32 smithi191 bash[24992]: audit 2024-08-31T08:06:31.425937+0000 mgr.a (mgr.14388) 15362 : audit [DBG] from='client.332844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:33 smithi027 bash[22610]: cluster 2024-08-31T08:06:31.817516+0000 mgr.a (mgr.14388) 15363 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:33 smithi191 bash[24992]: cluster 2024-08-31T08:06:31.817516+0000 mgr.a (mgr.14388) 15363 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:33 smithi163 bash[24253]: cluster 2024-08-31T08:06:31.817516+0000 mgr.a (mgr.14388) 15363 : cluster [DBG] pgmap v10650: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:35 smithi027 bash[22610]: cluster 2024-08-31T08:06:33.819766+0000 mgr.a (mgr.14388) 15364 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:35 smithi191 bash[24992]: cluster 2024-08-31T08:06:33.819766+0000 mgr.a (mgr.14388) 15364 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:35 smithi163 bash[24253]: cluster 2024-08-31T08:06:33.819766+0000 mgr.a (mgr.14388) 15364 : cluster [DBG] pgmap v10651: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:36.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:36.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:36.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:06:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:37 smithi027 bash[22610]: cluster 2024-08-31T08:06:35.820543+0000 mgr.a (mgr.14388) 15365 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:37 smithi191 bash[24992]: cluster 2024-08-31T08:06:35.820543+0000 mgr.a (mgr.14388) 15365 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:37.600 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:06:37.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:06:37.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:06:37.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:06:37.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:06:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:37 smithi163 bash[24253]: cluster 2024-08-31T08:06:35.820543+0000 mgr.a (mgr.14388) 15365 : cluster [DBG] pgmap v10652: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:38 smithi027 bash[22610]: audit 2024-08-31T08:06:37.185297+0000 mgr.a (mgr.14388) 15366 : audit [DBG] from='client.332919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:38 smithi191 bash[24992]: audit 2024-08-31T08:06:37.185297+0000 mgr.a (mgr.14388) 15366 : audit [DBG] from='client.332919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:38 smithi163 bash[24253]: audit 2024-08-31T08:06:37.185297+0000 mgr.a (mgr.14388) 15366 : audit [DBG] from='client.332919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:39 smithi027 bash[22610]: cluster 2024-08-31T08:06:37.821463+0000 mgr.a (mgr.14388) 15367 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:39 smithi191 bash[24992]: cluster 2024-08-31T08:06:37.821463+0000 mgr.a (mgr.14388) 15367 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:39 smithi163 bash[24253]: cluster 2024-08-31T08:06:37.821463+0000 mgr.a (mgr.14388) 15367 : cluster [DBG] pgmap v10653: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:41 smithi027 bash[22610]: cluster 2024-08-31T08:06:39.823724+0000 mgr.a (mgr.14388) 15368 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:41 smithi191 bash[24992]: cluster 2024-08-31T08:06:39.823724+0000 mgr.a (mgr.14388) 15368 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:41 smithi163 bash[24253]: cluster 2024-08-31T08:06:39.823724+0000 mgr.a (mgr.14388) 15368 : cluster [DBG] pgmap v10654: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:06:42.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:42.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:42.603 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:06:43.365 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:06:43.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:06:43.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:06:43.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:06:43.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:06:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:43 smithi027 bash[22610]: cluster 2024-08-31T08:06:41.824503+0000 mgr.a (mgr.14388) 15369 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:43 smithi191 bash[24992]: cluster 2024-08-31T08:06:41.824503+0000 mgr.a (mgr.14388) 15369 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:43 smithi163 bash[24253]: cluster 2024-08-31T08:06:41.824503+0000 mgr.a (mgr.14388) 15369 : cluster [DBG] pgmap v10655: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:44 smithi191 bash[24992]: audit 2024-08-31T08:06:42.932584+0000 mgr.a (mgr.14388) 15370 : audit [DBG] from='client.332997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:44 smithi163 bash[24253]: audit 2024-08-31T08:06:42.932584+0000 mgr.a (mgr.14388) 15370 : audit [DBG] from='client.332997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:44 smithi027 bash[22610]: audit 2024-08-31T08:06:42.932584+0000 mgr.a (mgr.14388) 15370 : audit [DBG] from='client.332997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:45 smithi191 bash[24992]: cluster 2024-08-31T08:06:43.827241+0000 mgr.a (mgr.14388) 15371 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:45 smithi163 bash[24253]: cluster 2024-08-31T08:06:43.827241+0000 mgr.a (mgr.14388) 15371 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:45 smithi027 bash[22610]: cluster 2024-08-31T08:06:43.827241+0000 mgr.a (mgr.14388) 15371 : cluster [DBG] pgmap v10656: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:47 smithi191 bash[24992]: cluster 2024-08-31T08:06:45.828036+0000 mgr.a (mgr.14388) 15372 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:06:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:47 smithi163 bash[24253]: cluster 2024-08-31T08:06:45.828036+0000 mgr.a (mgr.14388) 15372 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:06:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:47 smithi027 bash[22610]: cluster 2024-08-31T08:06:45.828036+0000 mgr.a (mgr.14388) 15372 : cluster [DBG] pgmap v10657: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:06:48.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:48.368 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:48.368 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:06:49.125 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:06:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:06:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:06:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:06:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:06:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:49 smithi191 bash[24992]: cluster 2024-08-31T08:06:47.828825+0000 mgr.a (mgr.14388) 15373 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:06:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:49 smithi163 bash[24253]: cluster 2024-08-31T08:06:47.828825+0000 mgr.a (mgr.14388) 15373 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:06:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:49 smithi027 bash[22610]: cluster 2024-08-31T08:06:47.828825+0000 mgr.a (mgr.14388) 15373 : cluster [DBG] pgmap v10658: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:06:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:50 smithi191 bash[24992]: audit 2024-08-31T08:06:48.701693+0000 mgr.a (mgr.14388) 15374 : audit [DBG] from='client.333072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:50 smithi163 bash[24253]: audit 2024-08-31T08:06:48.701693+0000 mgr.a (mgr.14388) 15374 : audit [DBG] from='client.333072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:50 smithi027 bash[22610]: audit 2024-08-31T08:06:48.701693+0000 mgr.a (mgr.14388) 15374 : audit [DBG] from='client.333072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:51 smithi191 bash[24992]: cluster 2024-08-31T08:06:49.831635+0000 mgr.a (mgr.14388) 15375 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:51 smithi163 bash[24253]: cluster 2024-08-31T08:06:49.831635+0000 mgr.a (mgr.14388) 15375 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:51 smithi027 bash[22610]: cluster 2024-08-31T08:06:49.831635+0000 mgr.a (mgr.14388) 15375 : cluster [DBG] pgmap v10659: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:53 smithi191 bash[24992]: cluster 2024-08-31T08:06:51.832429+0000 mgr.a (mgr.14388) 15376 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:06:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:53 smithi163 bash[24253]: cluster 2024-08-31T08:06:51.832429+0000 mgr.a (mgr.14388) 15376 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:06:53.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:53 smithi027 bash[22610]: cluster 2024-08-31T08:06:51.832429+0000 mgr.a (mgr.14388) 15376 : cluster [DBG] pgmap v10660: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:06:54.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:54.127 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:54.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:06:54.908 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:06:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:06:54.908 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:06:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:06:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:06:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:55 smithi191 bash[24992]: cluster 2024-08-31T08:06:53.834440+0000 mgr.a (mgr.14388) 15377 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:55 smithi191 bash[24992]: audit 2024-08-31T08:06:54.462939+0000 mgr.a (mgr.14388) 15378 : audit [DBG] from='client.333147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:55 smithi163 bash[24253]: cluster 2024-08-31T08:06:53.834440+0000 mgr.a (mgr.14388) 15377 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:55 smithi163 bash[24253]: audit 2024-08-31T08:06:54.462939+0000 mgr.a (mgr.14388) 15378 : audit [DBG] from='client.333147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:55 smithi027 bash[22610]: cluster 2024-08-31T08:06:53.834440+0000 mgr.a (mgr.14388) 15377 : cluster [DBG] pgmap v10661: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:55 smithi027 bash[22610]: audit 2024-08-31T08:06:54.462939+0000 mgr.a (mgr.14388) 15378 : audit [DBG] from='client.333147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:06:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:57 smithi191 bash[24992]: cluster 2024-08-31T08:06:55.835365+0000 mgr.a (mgr.14388) 15379 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:57 smithi191 bash[24992]: audit 2024-08-31T08:06:56.453472+0000 mon.a (mon.0) 2869 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:06:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:57 smithi163 bash[24253]: cluster 2024-08-31T08:06:55.835365+0000 mgr.a (mgr.14388) 15379 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:57 smithi163 bash[24253]: audit 2024-08-31T08:06:56.453472+0000 mon.a (mon.0) 2869 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:06:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:57 smithi027 bash[22610]: cluster 2024-08-31T08:06:55.835365+0000 mgr.a (mgr.14388) 15379 : cluster [DBG] pgmap v10662: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:57 smithi027 bash[22610]: audit 2024-08-31T08:06:56.453472+0000 mon.a (mon.0) 2869 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:06:58.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:06:58 smithi027 bash[22863]: debug 2024-08-31T08:06:58.077+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:06:58.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:06:58 smithi027 bash[22863]: debug 2024-08-31T08:06:58.081+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:06:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:58 smithi027 bash[22610]: audit 2024-08-31T08:06:57.286391+0000 mon.a (mon.0) 2870 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:06:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:58 smithi027 bash[22610]: audit 2024-08-31T08:06:57.287923+0000 mon.a (mon.0) 2871 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:06:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:58 smithi027 bash[22610]: audit 2024-08-31T08:06:57.297602+0000 mon.a (mon.0) 2872 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:06:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:58 smithi027 bash[22610]: audit 2024-08-31T08:06:57.302419+0000 mon.a (mon.0) 2873 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:06:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:58 smithi027 bash[22610]: audit 2024-08-31T08:06:57.304827+0000 mgr.a (mgr.14388) 15380 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:06:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:58 smithi191 bash[24992]: audit 2024-08-31T08:06:57.286391+0000 mon.a (mon.0) 2870 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:06:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:58 smithi191 bash[24992]: audit 2024-08-31T08:06:57.287923+0000 mon.a (mon.0) 2871 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:06:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:58 smithi191 bash[24992]: audit 2024-08-31T08:06:57.297602+0000 mon.a (mon.0) 2872 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:06:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:58 smithi191 bash[24992]: audit 2024-08-31T08:06:57.302419+0000 mon.a (mon.0) 2873 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:06:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:58 smithi191 bash[24992]: audit 2024-08-31T08:06:57.304827+0000 mgr.a (mgr.14388) 15380 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:06:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:58 smithi163 bash[24253]: audit 2024-08-31T08:06:57.286391+0000 mon.a (mon.0) 2870 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:06:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:58 smithi163 bash[24253]: audit 2024-08-31T08:06:57.287923+0000 mon.a (mon.0) 2871 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:06:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:58 smithi163 bash[24253]: audit 2024-08-31T08:06:57.297602+0000 mon.a (mon.0) 2872 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:06:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:58 smithi163 bash[24253]: audit 2024-08-31T08:06:57.302419+0000 mon.a (mon.0) 2873 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:06:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:58 smithi163 bash[24253]: audit 2024-08-31T08:06:57.304827+0000 mgr.a (mgr.14388) 15380 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:06:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:59 smithi163 bash[24253]: cluster 2024-08-31T08:06:57.835838+0000 mgr.a (mgr.14388) 15381 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:59 smithi163 bash[24253]: audit 2024-08-31T08:06:58.081709+0000 mgr.a (mgr.14388) 15382 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:06:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:06:59 smithi163 bash[24253]: cephadm 2024-08-31T08:06:58.083165+0000 mgr.a (mgr.14388) 15383 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:06:59.742 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:59 smithi027 bash[22610]: cluster 2024-08-31T08:06:57.835838+0000 mgr.a (mgr.14388) 15381 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:59.742 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:59 smithi027 bash[22610]: audit 2024-08-31T08:06:58.081709+0000 mgr.a (mgr.14388) 15382 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:06:59.742 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:06:59 smithi027 bash[22610]: cephadm 2024-08-31T08:06:58.083165+0000 mgr.a (mgr.14388) 15383 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:06:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:59 smithi191 bash[24992]: cluster 2024-08-31T08:06:57.835838+0000 mgr.a (mgr.14388) 15381 : cluster [DBG] pgmap v10663: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:06:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:59 smithi191 bash[24992]: audit 2024-08-31T08:06:58.081709+0000 mgr.a (mgr.14388) 15382 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:06:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:06:59 smithi191 bash[24992]: cephadm 2024-08-31T08:06:58.083165+0000 mgr.a (mgr.14388) 15383 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:06:59.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:06:59.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:06:59.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:00.748 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:00.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:00.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:00.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:00.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:01 smithi163 bash[24253]: cluster 2024-08-31T08:06:59.838130+0000 mgr.a (mgr.14388) 15384 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T08:07:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:01 smithi163 bash[24253]: audit 2024-08-31T08:07:00.310615+0000 mgr.a (mgr.14388) 15385 : audit [DBG] from='client.333333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:01 smithi027 bash[22610]: cluster 2024-08-31T08:06:59.838130+0000 mgr.a (mgr.14388) 15384 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T08:07:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:01 smithi027 bash[22610]: audit 2024-08-31T08:07:00.310615+0000 mgr.a (mgr.14388) 15385 : audit [DBG] from='client.333333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:01 smithi191 bash[24992]: cluster 2024-08-31T08:06:59.838130+0000 mgr.a (mgr.14388) 15384 : cluster [DBG] pgmap v10664: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T08:07:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:01 smithi191 bash[24992]: audit 2024-08-31T08:07:00.310615+0000 mgr.a (mgr.14388) 15385 : audit [DBG] from='client.333333 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:03 smithi163 bash[24253]: cluster 2024-08-31T08:07:01.839098+0000 mgr.a (mgr.14388) 15386 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:07:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:03 smithi027 bash[22610]: cluster 2024-08-31T08:07:01.839098+0000 mgr.a (mgr.14388) 15386 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:07:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:03 smithi191 bash[24992]: cluster 2024-08-31T08:07:01.839098+0000 mgr.a (mgr.14388) 15386 : cluster [DBG] pgmap v10665: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:07:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:05 smithi163 bash[24253]: cluster 2024-08-31T08:07:03.841362+0000 mgr.a (mgr.14388) 15387 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:05 smithi027 bash[22610]: cluster 2024-08-31T08:07:03.841362+0000 mgr.a (mgr.14388) 15387 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:05.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:07:05.751 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:07:05.751 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:05 smithi191 bash[24992]: cluster 2024-08-31T08:07:03.841362+0000 mgr.a (mgr.14388) 15387 : cluster [DBG] pgmap v10666: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:06.539 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:06.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:06.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:06.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:06.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:07 smithi163 bash[24253]: cluster 2024-08-31T08:07:05.842115+0000 mgr.a (mgr.14388) 15388 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:07 smithi163 bash[24253]: audit 2024-08-31T08:07:06.086715+0000 mgr.a (mgr.14388) 15389 : audit [DBG] from='client.333408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:07 smithi027 bash[22610]: cluster 2024-08-31T08:07:05.842115+0000 mgr.a (mgr.14388) 15388 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:07 smithi027 bash[22610]: audit 2024-08-31T08:07:06.086715+0000 mgr.a (mgr.14388) 15389 : audit [DBG] from='client.333408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:07 smithi191 bash[24992]: cluster 2024-08-31T08:07:05.842115+0000 mgr.a (mgr.14388) 15388 : cluster [DBG] pgmap v10667: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:07 smithi191 bash[24992]: audit 2024-08-31T08:07:06.086715+0000 mgr.a (mgr.14388) 15389 : audit [DBG] from='client.333408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:09 smithi163 bash[24253]: cluster 2024-08-31T08:07:07.843040+0000 mgr.a (mgr.14388) 15390 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:09 smithi027 bash[22610]: cluster 2024-08-31T08:07:07.843040+0000 mgr.a (mgr.14388) 15390 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:09 smithi191 bash[24992]: cluster 2024-08-31T08:07:07.843040+0000 mgr.a (mgr.14388) 15390 : cluster [DBG] pgmap v10668: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:11.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:07:11.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:07:11.541 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:11 smithi163 bash[24253]: cluster 2024-08-31T08:07:09.845229+0000 mgr.a (mgr.14388) 15391 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:11.737 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:11 smithi027 bash[22610]: cluster 2024-08-31T08:07:09.845229+0000 mgr.a (mgr.14388) 15391 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:11 smithi191 bash[24992]: cluster 2024-08-31T08:07:09.845229+0000 mgr.a (mgr.14388) 15391 : cluster [DBG] pgmap v10669: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:07:12.310 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:12.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:12.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:12.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:12.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:13 smithi163 bash[24253]: cluster 2024-08-31T08:07:11.845962+0000 mgr.a (mgr.14388) 15392 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T08:07:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:13 smithi163 bash[24253]: audit 2024-08-31T08:07:11.877068+0000 mgr.a (mgr.14388) 15393 : audit [DBG] from='client.333486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:13 smithi027 bash[22610]: cluster 2024-08-31T08:07:11.845962+0000 mgr.a (mgr.14388) 15392 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T08:07:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:13 smithi027 bash[22610]: audit 2024-08-31T08:07:11.877068+0000 mgr.a (mgr.14388) 15393 : audit [DBG] from='client.333486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:13 smithi191 bash[24992]: cluster 2024-08-31T08:07:11.845962+0000 mgr.a (mgr.14388) 15392 : cluster [DBG] pgmap v10670: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 170 B/s wr, 2 op/s 2024-08-31T08:07:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:13 smithi191 bash[24992]: audit 2024-08-31T08:07:11.877068+0000 mgr.a (mgr.14388) 15393 : audit [DBG] from='client.333486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:15 smithi163 bash[24253]: cluster 2024-08-31T08:07:13.848317+0000 mgr.a (mgr.14388) 15394 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T08:07:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:15 smithi027 bash[22610]: cluster 2024-08-31T08:07:13.848317+0000 mgr.a (mgr.14388) 15394 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T08:07:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:15 smithi191 bash[24992]: cluster 2024-08-31T08:07:13.848317+0000 mgr.a (mgr.14388) 15394 : cluster [DBG] pgmap v10671: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T08:07:17.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:07:17.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:07:17.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:17 smithi163 bash[24253]: cluster 2024-08-31T08:07:15.849087+0000 mgr.a (mgr.14388) 15395 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:17 smithi027 bash[22610]: cluster 2024-08-31T08:07:15.849087+0000 mgr.a (mgr.14388) 15395 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:17 smithi191 bash[24992]: cluster 2024-08-31T08:07:15.849087+0000 mgr.a (mgr.14388) 15395 : cluster [DBG] pgmap v10672: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:18.095 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:18.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:18.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:18.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:18.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:18 smithi163 bash[24253]: audit 2024-08-31T08:07:17.652279+0000 mgr.a (mgr.14388) 15396 : audit [DBG] from='client.333558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:18 smithi027 bash[22610]: audit 2024-08-31T08:07:17.652279+0000 mgr.a (mgr.14388) 15396 : audit [DBG] from='client.333558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:18 smithi191 bash[24992]: audit 2024-08-31T08:07:17.652279+0000 mgr.a (mgr.14388) 15396 : audit [DBG] from='client.333558 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:19.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:19 smithi163 bash[24253]: cluster 2024-08-31T08:07:17.849614+0000 mgr.a (mgr.14388) 15397 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:19 smithi027 bash[22610]: cluster 2024-08-31T08:07:17.849614+0000 mgr.a (mgr.14388) 15397 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:19 smithi191 bash[24992]: cluster 2024-08-31T08:07:17.849614+0000 mgr.a (mgr.14388) 15397 : cluster [DBG] pgmap v10673: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:21 smithi163 bash[24253]: cluster 2024-08-31T08:07:19.851971+0000 mgr.a (mgr.14388) 15398 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:07:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:21 smithi027 bash[22610]: cluster 2024-08-31T08:07:19.851971+0000 mgr.a (mgr.14388) 15398 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:07:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:21 smithi191 bash[24992]: cluster 2024-08-31T08:07:19.851971+0000 mgr.a (mgr.14388) 15398 : cluster [DBG] pgmap v10674: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:07:23.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:07:23.098 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:07:23.098 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:23 smithi163 bash[24253]: cluster 2024-08-31T08:07:21.852739+0000 mgr.a (mgr.14388) 15399 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:07:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:23 smithi027 bash[22610]: cluster 2024-08-31T08:07:21.852739+0000 mgr.a (mgr.14388) 15399 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:07:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:23 smithi191 bash[24992]: cluster 2024-08-31T08:07:21.852739+0000 mgr.a (mgr.14388) 15399 : cluster [DBG] pgmap v10675: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:07:23.839 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:23.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:24 smithi163 bash[24253]: audit 2024-08-31T08:07:23.428619+0000 mgr.a (mgr.14388) 15400 : audit [DBG] from='client.333633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:24 smithi027 bash[22610]: audit 2024-08-31T08:07:23.428619+0000 mgr.a (mgr.14388) 15400 : audit [DBG] from='client.333633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:24 smithi191 bash[24992]: audit 2024-08-31T08:07:23.428619+0000 mgr.a (mgr.14388) 15400 : audit [DBG] from='client.333633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:25 smithi163 bash[24253]: cluster 2024-08-31T08:07:23.854035+0000 mgr.a (mgr.14388) 15401 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:25 smithi027 bash[22610]: cluster 2024-08-31T08:07:23.854035+0000 mgr.a (mgr.14388) 15401 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:25 smithi191 bash[24992]: cluster 2024-08-31T08:07:23.854035+0000 mgr.a (mgr.14388) 15401 : cluster [DBG] pgmap v10676: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:27 smithi163 bash[24253]: cluster 2024-08-31T08:07:25.854794+0000 mgr.a (mgr.14388) 15402 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:07:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:27 smithi027 bash[22610]: cluster 2024-08-31T08:07:25.854794+0000 mgr.a (mgr.14388) 15402 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:07:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:27 smithi191 bash[24992]: cluster 2024-08-31T08:07:25.854794+0000 mgr.a (mgr.14388) 15402 : cluster [DBG] pgmap v10677: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:07:28.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:07:28.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:07:28.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:29.632 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:29.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:29.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:29.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:29.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:29 smithi163 bash[24253]: cluster 2024-08-31T08:07:27.855498+0000 mgr.a (mgr.14388) 15403 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:07:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:29 smithi027 bash[22610]: cluster 2024-08-31T08:07:27.855498+0000 mgr.a (mgr.14388) 15403 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:07:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:29 smithi191 bash[24992]: cluster 2024-08-31T08:07:27.855498+0000 mgr.a (mgr.14388) 15403 : cluster [DBG] pgmap v10678: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:07:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:30 smithi163 bash[24253]: audit 2024-08-31T08:07:29.179868+0000 mgr.a (mgr.14388) 15404 : audit [DBG] from='client.333711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:30 smithi027 bash[22610]: audit 2024-08-31T08:07:29.179868+0000 mgr.a (mgr.14388) 15404 : audit [DBG] from='client.333711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:30 smithi191 bash[24992]: audit 2024-08-31T08:07:29.179868+0000 mgr.a (mgr.14388) 15404 : audit [DBG] from='client.333711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:31 smithi163 bash[24253]: cluster 2024-08-31T08:07:29.858317+0000 mgr.a (mgr.14388) 15405 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:31 smithi027 bash[22610]: cluster 2024-08-31T08:07:29.858317+0000 mgr.a (mgr.14388) 15405 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:31 smithi191 bash[24992]: cluster 2024-08-31T08:07:29.858317+0000 mgr.a (mgr.14388) 15405 : cluster [DBG] pgmap v10679: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:33 smithi163 bash[24253]: cluster 2024-08-31T08:07:31.859108+0000 mgr.a (mgr.14388) 15406 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:07:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:33 smithi027 bash[22610]: cluster 2024-08-31T08:07:31.859108+0000 mgr.a (mgr.14388) 15406 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:33 smithi191 bash[24992]: cluster 2024-08-31T08:07:31.859108+0000 mgr.a (mgr.14388) 15406 : cluster [DBG] pgmap v10680: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:07:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:07:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:07:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:35.409 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:35.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:35.409 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:35.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:35.410 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:35 smithi163 bash[24253]: cluster 2024-08-31T08:07:33.861113+0000 mgr.a (mgr.14388) 15407 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:07:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:35 smithi027 bash[22610]: cluster 2024-08-31T08:07:33.861113+0000 mgr.a (mgr.14388) 15407 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:07:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:35 smithi191 bash[24992]: cluster 2024-08-31T08:07:33.861113+0000 mgr.a (mgr.14388) 15407 : cluster [DBG] pgmap v10681: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:07:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:36 smithi163 bash[24253]: audit 2024-08-31T08:07:34.965434+0000 mgr.a (mgr.14388) 15408 : audit [DBG] from='client.333786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:36 smithi027 bash[22610]: audit 2024-08-31T08:07:34.965434+0000 mgr.a (mgr.14388) 15408 : audit [DBG] from='client.333786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:36 smithi191 bash[24992]: audit 2024-08-31T08:07:34.965434+0000 mgr.a (mgr.14388) 15408 : audit [DBG] from='client.333786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:37 smithi163 bash[24253]: cluster 2024-08-31T08:07:35.861992+0000 mgr.a (mgr.14388) 15409 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:37 smithi027 bash[22610]: cluster 2024-08-31T08:07:35.861992+0000 mgr.a (mgr.14388) 15409 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:37 smithi191 bash[24992]: cluster 2024-08-31T08:07:35.861992+0000 mgr.a (mgr.14388) 15409 : cluster [DBG] pgmap v10682: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:39 smithi163 bash[24253]: cluster 2024-08-31T08:07:37.862833+0000 mgr.a (mgr.14388) 15410 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:39 smithi027 bash[22610]: cluster 2024-08-31T08:07:37.862833+0000 mgr.a (mgr.14388) 15410 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:39 smithi191 bash[24992]: cluster 2024-08-31T08:07:37.862833+0000 mgr.a (mgr.14388) 15410 : cluster [DBG] pgmap v10683: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:40.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:07:40.411 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:07:40.411 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:41.162 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:41.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:41.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:41.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:41.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:41 smithi163 bash[24253]: cluster 2024-08-31T08:07:39.865017+0000 mgr.a (mgr.14388) 15411 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:41 smithi027 bash[22610]: cluster 2024-08-31T08:07:39.865017+0000 mgr.a (mgr.14388) 15411 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:41 smithi191 bash[24992]: cluster 2024-08-31T08:07:39.865017+0000 mgr.a (mgr.14388) 15411 : cluster [DBG] pgmap v10684: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:42 smithi163 bash[24253]: audit 2024-08-31T08:07:40.744043+0000 mgr.a (mgr.14388) 15412 : audit [DBG] from='client.333861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:42 smithi027 bash[22610]: audit 2024-08-31T08:07:40.744043+0000 mgr.a (mgr.14388) 15412 : audit [DBG] from='client.333861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:42 smithi191 bash[24992]: audit 2024-08-31T08:07:40.744043+0000 mgr.a (mgr.14388) 15412 : audit [DBG] from='client.333861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:43 smithi163 bash[24253]: cluster 2024-08-31T08:07:41.865936+0000 mgr.a (mgr.14388) 15413 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:43 smithi027 bash[22610]: cluster 2024-08-31T08:07:41.865936+0000 mgr.a (mgr.14388) 15413 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:43 smithi191 bash[24992]: cluster 2024-08-31T08:07:41.865936+0000 mgr.a (mgr.14388) 15413 : cluster [DBG] pgmap v10685: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:45 smithi163 bash[24253]: cluster 2024-08-31T08:07:43.868339+0000 mgr.a (mgr.14388) 15414 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:45 smithi027 bash[22610]: cluster 2024-08-31T08:07:43.868339+0000 mgr.a (mgr.14388) 15414 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:45 smithi191 bash[24992]: cluster 2024-08-31T08:07:43.868339+0000 mgr.a (mgr.14388) 15414 : cluster [DBG] pgmap v10686: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:46.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:07:46.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:07:46.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:46.917 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:46.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:46.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:46.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:46.918 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:47 smithi163 bash[24253]: cluster 2024-08-31T08:07:45.869296+0000 mgr.a (mgr.14388) 15415 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:47 smithi163 bash[24253]: audit 2024-08-31T08:07:46.496149+0000 mgr.a (mgr.14388) 15416 : audit [DBG] from='client.333936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:47 smithi027 bash[22610]: cluster 2024-08-31T08:07:45.869296+0000 mgr.a (mgr.14388) 15415 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:47 smithi027 bash[22610]: audit 2024-08-31T08:07:46.496149+0000 mgr.a (mgr.14388) 15416 : audit [DBG] from='client.333936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:47 smithi191 bash[24992]: cluster 2024-08-31T08:07:45.869296+0000 mgr.a (mgr.14388) 15415 : cluster [DBG] pgmap v10687: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:47 smithi191 bash[24992]: audit 2024-08-31T08:07:46.496149+0000 mgr.a (mgr.14388) 15416 : audit [DBG] from='client.333936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:49 smithi163 bash[24253]: cluster 2024-08-31T08:07:47.870455+0000 mgr.a (mgr.14388) 15417 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:49 smithi027 bash[22610]: cluster 2024-08-31T08:07:47.870455+0000 mgr.a (mgr.14388) 15417 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:49 smithi191 bash[24992]: cluster 2024-08-31T08:07:47.870455+0000 mgr.a (mgr.14388) 15417 : cluster [DBG] pgmap v10688: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:51 smithi027 bash[22610]: cluster 2024-08-31T08:07:49.872701+0000 mgr.a (mgr.14388) 15418 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:51 smithi191 bash[24992]: cluster 2024-08-31T08:07:49.872701+0000 mgr.a (mgr.14388) 15418 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:51.919 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:07:51.920 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:07:51.920 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:51 smithi163 bash[24253]: cluster 2024-08-31T08:07:49.872701+0000 mgr.a (mgr.14388) 15418 : cluster [DBG] pgmap v10689: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:52.709 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:52.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:52.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:52.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:52.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:53 smithi027 bash[22610]: cluster 2024-08-31T08:07:51.873528+0000 mgr.a (mgr.14388) 15419 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:53 smithi027 bash[22610]: audit 2024-08-31T08:07:52.259805+0000 mgr.a (mgr.14388) 15420 : audit [DBG] from='client.334008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:53 smithi191 bash[24992]: cluster 2024-08-31T08:07:51.873528+0000 mgr.a (mgr.14388) 15419 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:53 smithi191 bash[24992]: audit 2024-08-31T08:07:52.259805+0000 mgr.a (mgr.14388) 15420 : audit [DBG] from='client.334008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:53 smithi163 bash[24253]: cluster 2024-08-31T08:07:51.873528+0000 mgr.a (mgr.14388) 15419 : cluster [DBG] pgmap v10690: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:53 smithi163 bash[24253]: audit 2024-08-31T08:07:52.259805+0000 mgr.a (mgr.14388) 15420 : audit [DBG] from='client.334008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:55 smithi027 bash[22610]: cluster 2024-08-31T08:07:53.875966+0000 mgr.a (mgr.14388) 15421 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:55 smithi191 bash[24992]: cluster 2024-08-31T08:07:53.875966+0000 mgr.a (mgr.14388) 15421 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:55 smithi163 bash[24253]: cluster 2024-08-31T08:07:53.875966+0000 mgr.a (mgr.14388) 15421 : cluster [DBG] pgmap v10691: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:07:57.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:07:57.712 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:07:57.712 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:07:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:57 smithi027 bash[22610]: cluster 2024-08-31T08:07:55.876758+0000 mgr.a (mgr.14388) 15422 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:57 smithi191 bash[24992]: cluster 2024-08-31T08:07:55.876758+0000 mgr.a (mgr.14388) 15422 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:57 smithi163 bash[24253]: cluster 2024-08-31T08:07:55.876758+0000 mgr.a (mgr.14388) 15422 : cluster [DBG] pgmap v10692: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:58.505 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:07:58.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:07:58.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:07:58.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:07:58.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:07:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:58 smithi027 bash[22610]: audit 2024-08-31T08:07:58.134702+0000 mon.a (mon.0) 2874 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:07:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:58 smithi191 bash[24992]: audit 2024-08-31T08:07:58.134702+0000 mon.a (mon.0) 2874 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:07:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:58 smithi163 bash[24253]: audit 2024-08-31T08:07:58.134702+0000 mon.a (mon.0) 2874 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:07:59.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:07:59 smithi027 bash[22863]: debug 2024-08-31T08:07:59.716+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:07:59.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:07:59 smithi027 bash[22863]: debug 2024-08-31T08:07:59.716+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:07:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:59 smithi027 bash[22610]: cluster 2024-08-31T08:07:57.877385+0000 mgr.a (mgr.14388) 15423 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:59 smithi027 bash[22610]: audit 2024-08-31T08:07:58.047710+0000 mgr.a (mgr.14388) 15424 : audit [DBG] from='client.334086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:59 smithi027 bash[22610]: audit 2024-08-31T08:07:58.960202+0000 mon.a (mon.0) 2875 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:07:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:59 smithi027 bash[22610]: audit 2024-08-31T08:07:58.961865+0000 mon.a (mon.0) 2876 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:07:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:59 smithi027 bash[22610]: audit 2024-08-31T08:07:58.971385+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:07:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:07:59 smithi027 bash[22610]: audit 2024-08-31T08:07:58.976236+0000 mon.a (mon.0) 2878 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:07:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:59 smithi191 bash[24992]: cluster 2024-08-31T08:07:57.877385+0000 mgr.a (mgr.14388) 15423 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:59 smithi191 bash[24992]: audit 2024-08-31T08:07:58.047710+0000 mgr.a (mgr.14388) 15424 : audit [DBG] from='client.334086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:59 smithi191 bash[24992]: audit 2024-08-31T08:07:58.960202+0000 mon.a (mon.0) 2875 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:07:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:59 smithi191 bash[24992]: audit 2024-08-31T08:07:58.961865+0000 mon.a (mon.0) 2876 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:07:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:59 smithi191 bash[24992]: audit 2024-08-31T08:07:58.971385+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:07:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:07:59 smithi191 bash[24992]: audit 2024-08-31T08:07:58.976236+0000 mon.a (mon.0) 2878 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:59 smithi163 bash[24253]: cluster 2024-08-31T08:07:57.877385+0000 mgr.a (mgr.14388) 15423 : cluster [DBG] pgmap v10693: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:59 smithi163 bash[24253]: audit 2024-08-31T08:07:58.047710+0000 mgr.a (mgr.14388) 15424 : audit [DBG] from='client.334086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:59 smithi163 bash[24253]: audit 2024-08-31T08:07:58.960202+0000 mon.a (mon.0) 2875 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:59 smithi163 bash[24253]: audit 2024-08-31T08:07:58.961865+0000 mon.a (mon.0) 2876 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:59 smithi163 bash[24253]: audit 2024-08-31T08:07:58.971385+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:07:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:07:59 smithi163 bash[24253]: audit 2024-08-31T08:07:58.976236+0000 mon.a (mon.0) 2878 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:08:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:00 smithi027 bash[22610]: audit 2024-08-31T08:07:58.978966+0000 mgr.a (mgr.14388) 15425 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:08:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:00 smithi191 bash[24992]: audit 2024-08-31T08:07:58.978966+0000 mgr.a (mgr.14388) 15425 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:08:00.954 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:00 smithi163 bash[24253]: audit 2024-08-31T08:07:58.978966+0000 mgr.a (mgr.14388) 15425 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:08:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:01 smithi191 bash[24992]: audit 2024-08-31T08:07:59.719448+0000 mgr.a (mgr.14388) 15426 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:08:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:01 smithi191 bash[24992]: cephadm 2024-08-31T08:07:59.720595+0000 mgr.a (mgr.14388) 15427 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:08:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:01 smithi191 bash[24992]: cluster 2024-08-31T08:07:59.880114+0000 mgr.a (mgr.14388) 15428 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:01 smithi163 bash[24253]: audit 2024-08-31T08:07:59.719448+0000 mgr.a (mgr.14388) 15426 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:08:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:01 smithi163 bash[24253]: cephadm 2024-08-31T08:07:59.720595+0000 mgr.a (mgr.14388) 15427 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:08:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:01 smithi163 bash[24253]: cluster 2024-08-31T08:07:59.880114+0000 mgr.a (mgr.14388) 15428 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:01 smithi027 bash[22610]: audit 2024-08-31T08:07:59.719448+0000 mgr.a (mgr.14388) 15426 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:08:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:01 smithi027 bash[22610]: cephadm 2024-08-31T08:07:59.720595+0000 mgr.a (mgr.14388) 15427 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:08:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:01 smithi027 bash[22610]: cluster 2024-08-31T08:07:59.880114+0000 mgr.a (mgr.14388) 15428 : cluster [DBG] pgmap v10694: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:03.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:08:03.507 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:08:03.507 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:08:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:03 smithi191 bash[24992]: cluster 2024-08-31T08:08:01.880879+0000 mgr.a (mgr.14388) 15429 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:08:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:03 smithi163 bash[24253]: cluster 2024-08-31T08:08:01.880879+0000 mgr.a (mgr.14388) 15429 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:08:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:03 smithi027 bash[22610]: cluster 2024-08-31T08:08:01.880879+0000 mgr.a (mgr.14388) 15429 : cluster [DBG] pgmap v10695: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:08:04.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:08:04.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:08:04.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:08:04.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:08:04.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:08:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:05 smithi191 bash[24992]: audit 2024-08-31T08:08:03.845284+0000 mgr.a (mgr.14388) 15430 : audit [DBG] from='client.334269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:05 smithi191 bash[24992]: cluster 2024-08-31T08:08:03.883726+0000 mgr.a (mgr.14388) 15431 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:05 smithi163 bash[24253]: audit 2024-08-31T08:08:03.845284+0000 mgr.a (mgr.14388) 15430 : audit [DBG] from='client.334269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:05 smithi163 bash[24253]: cluster 2024-08-31T08:08:03.883726+0000 mgr.a (mgr.14388) 15431 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:05 smithi027 bash[22610]: audit 2024-08-31T08:08:03.845284+0000 mgr.a (mgr.14388) 15430 : audit [DBG] from='client.334269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:05 smithi027 bash[22610]: cluster 2024-08-31T08:08:03.883726+0000 mgr.a (mgr.14388) 15431 : cluster [DBG] pgmap v10696: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:07 smithi191 bash[24992]: cluster 2024-08-31T08:08:05.884688+0000 mgr.a (mgr.14388) 15432 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:08:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:07 smithi163 bash[24253]: cluster 2024-08-31T08:08:05.884688+0000 mgr.a (mgr.14388) 15432 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:08:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:07 smithi027 bash[22610]: cluster 2024-08-31T08:08:05.884688+0000 mgr.a (mgr.14388) 15432 : cluster [DBG] pgmap v10697: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:08:09.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:08:09.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:08:09.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:08:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:09 smithi191 bash[24992]: cluster 2024-08-31T08:08:07.885462+0000 mgr.a (mgr.14388) 15433 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:08:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:09 smithi163 bash[24253]: cluster 2024-08-31T08:08:07.885462+0000 mgr.a (mgr.14388) 15433 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:08:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:09 smithi027 bash[22610]: cluster 2024-08-31T08:08:07.885462+0000 mgr.a (mgr.14388) 15433 : cluster [DBG] pgmap v10698: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:08:10.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:08:10.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:08:10.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:08:10.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:08:10.080 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:08:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:10 smithi191 bash[24992]: audit 2024-08-31T08:08:09.628764+0000 mgr.a (mgr.14388) 15434 : audit [DBG] from='client.334344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:10 smithi163 bash[24253]: audit 2024-08-31T08:08:09.628764+0000 mgr.a (mgr.14388) 15434 : audit [DBG] from='client.334344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:10 smithi027 bash[22610]: audit 2024-08-31T08:08:09.628764+0000 mgr.a (mgr.14388) 15434 : audit [DBG] from='client.334344 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:11 smithi191 bash[24992]: cluster 2024-08-31T08:08:09.886863+0000 mgr.a (mgr.14388) 15435 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:11 smithi163 bash[24253]: cluster 2024-08-31T08:08:09.886863+0000 mgr.a (mgr.14388) 15435 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:11 smithi027 bash[22610]: cluster 2024-08-31T08:08:09.886863+0000 mgr.a (mgr.14388) 15435 : cluster [DBG] pgmap v10699: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:13 smithi191 bash[24992]: cluster 2024-08-31T08:08:11.887732+0000 mgr.a (mgr.14388) 15436 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:13 smithi163 bash[24253]: cluster 2024-08-31T08:08:11.887732+0000 mgr.a (mgr.14388) 15436 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:14.108 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:13 smithi027 bash[22610]: cluster 2024-08-31T08:08:11.887732+0000 mgr.a (mgr.14388) 15436 : cluster [DBG] pgmap v10700: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:15.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:08:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:08:15.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:08:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:15 smithi191 bash[24992]: cluster 2024-08-31T08:08:13.889977+0000 mgr.a (mgr.14388) 15437 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:15.831 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:08:15.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:08:15.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:08:15.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:08:15.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:08:15.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:15 smithi163 bash[24253]: cluster 2024-08-31T08:08:13.889977+0000 mgr.a (mgr.14388) 15437 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:15 smithi027 bash[22610]: cluster 2024-08-31T08:08:13.889977+0000 mgr.a (mgr.14388) 15437 : cluster [DBG] pgmap v10701: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:08:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:16 smithi191 bash[24992]: audit 2024-08-31T08:08:15.411330+0000 mgr.a (mgr.14388) 15438 : audit [DBG] from='client.334422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:16 smithi163 bash[24253]: audit 2024-08-31T08:08:15.411330+0000 mgr.a (mgr.14388) 15438 : audit [DBG] from='client.334422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:16.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:16 smithi027 bash[22610]: audit 2024-08-31T08:08:15.411330+0000 mgr.a (mgr.14388) 15438 : audit [DBG] from='client.334422 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:17 smithi191 bash[24992]: cluster 2024-08-31T08:08:15.890907+0000 mgr.a (mgr.14388) 15439 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:17 smithi163 bash[24253]: cluster 2024-08-31T08:08:15.890907+0000 mgr.a (mgr.14388) 15439 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:17 smithi027 bash[22610]: cluster 2024-08-31T08:08:15.890907+0000 mgr.a (mgr.14388) 15439 : cluster [DBG] pgmap v10702: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:19 smithi191 bash[24992]: cluster 2024-08-31T08:08:17.891701+0000 mgr.a (mgr.14388) 15440 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:19 smithi163 bash[24253]: cluster 2024-08-31T08:08:17.891701+0000 mgr.a (mgr.14388) 15440 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:19 smithi027 bash[22610]: cluster 2024-08-31T08:08:17.891701+0000 mgr.a (mgr.14388) 15440 : cluster [DBG] pgmap v10703: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:20.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:08:20.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:08:20.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:08:21.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:08:21.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:08:21.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:08:21.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:08:21.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:08:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:21 smithi163 bash[24253]: cluster 2024-08-31T08:08:19.893932+0000 mgr.a (mgr.14388) 15441 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:21 smithi027 bash[22610]: cluster 2024-08-31T08:08:19.893932+0000 mgr.a (mgr.14388) 15441 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:21 smithi191 bash[24992]: cluster 2024-08-31T08:08:19.893932+0000 mgr.a (mgr.14388) 15441 : cluster [DBG] pgmap v10704: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:22 smithi163 bash[24253]: audit 2024-08-31T08:08:21.166644+0000 mgr.a (mgr.14388) 15442 : audit [DBG] from='client.334500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:22 smithi027 bash[22610]: audit 2024-08-31T08:08:21.166644+0000 mgr.a (mgr.14388) 15442 : audit [DBG] from='client.334500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:22 smithi191 bash[24992]: audit 2024-08-31T08:08:21.166644+0000 mgr.a (mgr.14388) 15442 : audit [DBG] from='client.334500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:23 smithi163 bash[24253]: cluster 2024-08-31T08:08:21.894869+0000 mgr.a (mgr.14388) 15443 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:23 smithi027 bash[22610]: cluster 2024-08-31T08:08:21.894869+0000 mgr.a (mgr.14388) 15443 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:23 smithi191 bash[24992]: cluster 2024-08-31T08:08:21.894869+0000 mgr.a (mgr.14388) 15443 : cluster [DBG] pgmap v10705: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:25 smithi163 bash[24253]: cluster 2024-08-31T08:08:23.897073+0000 mgr.a (mgr.14388) 15444 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:25 smithi027 bash[22610]: cluster 2024-08-31T08:08:23.897073+0000 mgr.a (mgr.14388) 15444 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:25 smithi191 bash[24992]: cluster 2024-08-31T08:08:23.897073+0000 mgr.a (mgr.14388) 15444 : cluster [DBG] pgmap v10706: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:26.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:08:26.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:08:26.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:08:27.347 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:08:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:08:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:08:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:08:27.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:08:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:27 smithi163 bash[24253]: cluster 2024-08-31T08:08:25.897999+0000 mgr.a (mgr.14388) 15445 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:27 smithi027 bash[22610]: cluster 2024-08-31T08:08:25.897999+0000 mgr.a (mgr.14388) 15445 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:27 smithi191 bash[24992]: cluster 2024-08-31T08:08:25.897999+0000 mgr.a (mgr.14388) 15445 : cluster [DBG] pgmap v10707: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:28 smithi163 bash[24253]: audit 2024-08-31T08:08:26.932137+0000 mgr.a (mgr.14388) 15446 : audit [DBG] from='client.334578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:28 smithi027 bash[22610]: audit 2024-08-31T08:08:26.932137+0000 mgr.a (mgr.14388) 15446 : audit [DBG] from='client.334578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:28 smithi191 bash[24992]: audit 2024-08-31T08:08:26.932137+0000 mgr.a (mgr.14388) 15446 : audit [DBG] from='client.334578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:29 smithi163 bash[24253]: cluster 2024-08-31T08:08:27.899003+0000 mgr.a (mgr.14388) 15447 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:29 smithi027 bash[22610]: cluster 2024-08-31T08:08:27.899003+0000 mgr.a (mgr.14388) 15447 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:29 smithi191 bash[24992]: cluster 2024-08-31T08:08:27.899003+0000 mgr.a (mgr.14388) 15447 : cluster [DBG] pgmap v10708: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:31 smithi163 bash[24253]: cluster 2024-08-31T08:08:29.901227+0000 mgr.a (mgr.14388) 15448 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:31 smithi027 bash[22610]: cluster 2024-08-31T08:08:29.901227+0000 mgr.a (mgr.14388) 15448 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:31 smithi191 bash[24992]: cluster 2024-08-31T08:08:29.901227+0000 mgr.a (mgr.14388) 15448 : cluster [DBG] pgmap v10709: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:32.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:08:32.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:08:32.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:08:33.125 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:08:33.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:08:33.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:08:33.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:08:33.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:08:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:33 smithi163 bash[24253]: cluster 2024-08-31T08:08:31.902017+0000 mgr.a (mgr.14388) 15449 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:33 smithi163 bash[24253]: audit 2024-08-31T08:08:32.684036+0000 mgr.a (mgr.14388) 15450 : audit [DBG] from='client.334656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:33.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:33 smithi027 bash[22610]: cluster 2024-08-31T08:08:31.902017+0000 mgr.a (mgr.14388) 15449 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:33.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:33 smithi027 bash[22610]: audit 2024-08-31T08:08:32.684036+0000 mgr.a (mgr.14388) 15450 : audit [DBG] from='client.334656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:33 smithi191 bash[24992]: cluster 2024-08-31T08:08:31.902017+0000 mgr.a (mgr.14388) 15449 : cluster [DBG] pgmap v10710: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:33 smithi191 bash[24992]: audit 2024-08-31T08:08:32.684036+0000 mgr.a (mgr.14388) 15450 : audit [DBG] from='client.334656 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:35 smithi163 bash[24253]: cluster 2024-08-31T08:08:33.904488+0000 mgr.a (mgr.14388) 15451 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:08:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:35 smithi027 bash[22610]: cluster 2024-08-31T08:08:33.904488+0000 mgr.a (mgr.14388) 15451 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:08:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:35 smithi191 bash[24992]: cluster 2024-08-31T08:08:33.904488+0000 mgr.a (mgr.14388) 15451 : cluster [DBG] pgmap v10711: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:08:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:37 smithi163 bash[24253]: cluster 2024-08-31T08:08:35.905279+0000 mgr.a (mgr.14388) 15452 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:08:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:37 smithi027 bash[22610]: cluster 2024-08-31T08:08:35.905279+0000 mgr.a (mgr.14388) 15452 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:08:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:37 smithi191 bash[24992]: cluster 2024-08-31T08:08:35.905279+0000 mgr.a (mgr.14388) 15452 : cluster [DBG] pgmap v10712: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:08:38.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:08:38.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:08:38.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:08:38.904 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:08:38.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:08:38.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:08:38.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:08:38.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:08:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:39 smithi163 bash[24253]: cluster 2024-08-31T08:08:37.906060+0000 mgr.a (mgr.14388) 15453 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:08:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:39 smithi163 bash[24253]: audit 2024-08-31T08:08:38.465040+0000 mgr.a (mgr.14388) 15454 : audit [DBG] from='client.334728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:39 smithi027 bash[22610]: cluster 2024-08-31T08:08:37.906060+0000 mgr.a (mgr.14388) 15453 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:08:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:39 smithi027 bash[22610]: audit 2024-08-31T08:08:38.465040+0000 mgr.a (mgr.14388) 15454 : audit [DBG] from='client.334728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:39 smithi191 bash[24992]: cluster 2024-08-31T08:08:37.906060+0000 mgr.a (mgr.14388) 15453 : cluster [DBG] pgmap v10713: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:08:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:39 smithi191 bash[24992]: audit 2024-08-31T08:08:38.465040+0000 mgr.a (mgr.14388) 15454 : audit [DBG] from='client.334728 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:41 smithi163 bash[24253]: cluster 2024-08-31T08:08:39.908884+0000 mgr.a (mgr.14388) 15455 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:41 smithi027 bash[22610]: cluster 2024-08-31T08:08:39.908884+0000 mgr.a (mgr.14388) 15455 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:41 smithi191 bash[24992]: cluster 2024-08-31T08:08:39.908884+0000 mgr.a (mgr.14388) 15455 : cluster [DBG] pgmap v10714: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:43.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:08:43.906 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:08:43.906 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:08:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:43 smithi163 bash[24253]: cluster 2024-08-31T08:08:41.909664+0000 mgr.a (mgr.14388) 15456 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:08:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:43 smithi027 bash[22610]: cluster 2024-08-31T08:08:41.909664+0000 mgr.a (mgr.14388) 15456 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:08:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:43 smithi191 bash[24992]: cluster 2024-08-31T08:08:41.909664+0000 mgr.a (mgr.14388) 15456 : cluster [DBG] pgmap v10715: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:08:44.690 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:08:44.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:08:44.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:08:44.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:08:44.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:08:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:45 smithi163 bash[24253]: cluster 2024-08-31T08:08:43.911709+0000 mgr.a (mgr.14388) 15457 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:45 smithi163 bash[24253]: audit 2024-08-31T08:08:44.245557+0000 mgr.a (mgr.14388) 15458 : audit [DBG] from='client.334803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:45 smithi027 bash[22610]: cluster 2024-08-31T08:08:43.911709+0000 mgr.a (mgr.14388) 15457 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:45 smithi027 bash[22610]: audit 2024-08-31T08:08:44.245557+0000 mgr.a (mgr.14388) 15458 : audit [DBG] from='client.334803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:45 smithi191 bash[24992]: cluster 2024-08-31T08:08:43.911709+0000 mgr.a (mgr.14388) 15457 : cluster [DBG] pgmap v10716: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:45 smithi191 bash[24992]: audit 2024-08-31T08:08:44.245557+0000 mgr.a (mgr.14388) 15458 : audit [DBG] from='client.334803 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:47 smithi163 bash[24253]: cluster 2024-08-31T08:08:45.912676+0000 mgr.a (mgr.14388) 15459 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:08:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:47 smithi027 bash[22610]: cluster 2024-08-31T08:08:45.912676+0000 mgr.a (mgr.14388) 15459 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:08:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:47 smithi191 bash[24992]: cluster 2024-08-31T08:08:45.912676+0000 mgr.a (mgr.14388) 15459 : cluster [DBG] pgmap v10717: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:08:49.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:08:49.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:08:49.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:08:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:49 smithi163 bash[24253]: cluster 2024-08-31T08:08:47.913483+0000 mgr.a (mgr.14388) 15460 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:08:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:49 smithi027 bash[22610]: cluster 2024-08-31T08:08:47.913483+0000 mgr.a (mgr.14388) 15460 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:08:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:49 smithi191 bash[24992]: cluster 2024-08-31T08:08:47.913483+0000 mgr.a (mgr.14388) 15460 : cluster [DBG] pgmap v10718: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:08:50.443 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:08:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:08:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:08:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:08:50.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:08:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:51 smithi163 bash[24253]: cluster 2024-08-31T08:08:49.915668+0000 mgr.a (mgr.14388) 15461 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:08:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:51 smithi163 bash[24253]: audit 2024-08-31T08:08:50.029744+0000 mgr.a (mgr.14388) 15462 : audit [DBG] from='client.334878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:51 smithi027 bash[22610]: cluster 2024-08-31T08:08:49.915668+0000 mgr.a (mgr.14388) 15461 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:08:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:51 smithi027 bash[22610]: audit 2024-08-31T08:08:50.029744+0000 mgr.a (mgr.14388) 15462 : audit [DBG] from='client.334878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:51 smithi191 bash[24992]: cluster 2024-08-31T08:08:49.915668+0000 mgr.a (mgr.14388) 15461 : cluster [DBG] pgmap v10719: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:08:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:51 smithi191 bash[24992]: audit 2024-08-31T08:08:50.029744+0000 mgr.a (mgr.14388) 15462 : audit [DBG] from='client.334878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:53 smithi163 bash[24253]: cluster 2024-08-31T08:08:51.916518+0000 mgr.a (mgr.14388) 15463 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:53 smithi027 bash[22610]: cluster 2024-08-31T08:08:51.916518+0000 mgr.a (mgr.14388) 15463 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:53 smithi191 bash[24992]: cluster 2024-08-31T08:08:51.916518+0000 mgr.a (mgr.14388) 15463 : cluster [DBG] pgmap v10720: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:55.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:08:55.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:08:55.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:08:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:55 smithi163 bash[24253]: cluster 2024-08-31T08:08:53.918780+0000 mgr.a (mgr.14388) 15464 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:55 smithi027 bash[22610]: cluster 2024-08-31T08:08:53.918780+0000 mgr.a (mgr.14388) 15464 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:55 smithi191 bash[24992]: cluster 2024-08-31T08:08:53.918780+0000 mgr.a (mgr.14388) 15464 : cluster [DBG] pgmap v10721: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:08:56.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:08:56.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:08:56.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:08:56.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:08:56.227 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:08:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:57 smithi163 bash[24253]: audit 2024-08-31T08:08:55.781527+0000 mgr.a (mgr.14388) 15465 : audit [DBG] from='client.334953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:57 smithi163 bash[24253]: cluster 2024-08-31T08:08:55.922942+0000 mgr.a (mgr.14388) 15466 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:57 smithi027 bash[22610]: audit 2024-08-31T08:08:55.781527+0000 mgr.a (mgr.14388) 15465 : audit [DBG] from='client.334953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:57 smithi027 bash[22610]: cluster 2024-08-31T08:08:55.922942+0000 mgr.a (mgr.14388) 15466 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:57 smithi191 bash[24992]: audit 2024-08-31T08:08:55.781527+0000 mgr.a (mgr.14388) 15465 : audit [DBG] from='client.334953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:08:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:57 smithi191 bash[24992]: cluster 2024-08-31T08:08:55.922942+0000 mgr.a (mgr.14388) 15466 : cluster [DBG] pgmap v10722: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:08:59 smithi163 bash[24253]: cluster 2024-08-31T08:08:57.923855+0000 mgr.a (mgr.14388) 15467 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:08:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:08:59 smithi027 bash[22610]: cluster 2024-08-31T08:08:57.923855+0000 mgr.a (mgr.14388) 15467 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:08:59 smithi191 bash[24992]: cluster 2024-08-31T08:08:57.923855+0000 mgr.a (mgr.14388) 15467 : cluster [DBG] pgmap v10723: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:00 smithi163 bash[24253]: audit 2024-08-31T08:08:59.775347+0000 mon.a (mon.0) 2879 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:09:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:00 smithi027 bash[22610]: audit 2024-08-31T08:08:59.775347+0000 mon.a (mon.0) 2879 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:09:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:00 smithi191 bash[24992]: audit 2024-08-31T08:08:59.775347+0000 mon.a (mon.0) 2879 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:09:01.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:01.229 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:01.229 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:01 smithi163 bash[24253]: cluster 2024-08-31T08:08:59.926056+0000 mgr.a (mgr.14388) 15468 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:01 smithi027 bash[22610]: cluster 2024-08-31T08:08:59.926056+0000 mgr.a (mgr.14388) 15468 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:01.989 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:01.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:01.990 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:01.990 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:01.990 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:09:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:01 smithi191 bash[24992]: cluster 2024-08-31T08:08:59.926056+0000 mgr.a (mgr.14388) 15468 : cluster [DBG] pgmap v10724: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:02 smithi163 bash[24253]: audit 2024-08-31T08:09:01.570448+0000 mgr.a (mgr.14388) 15469 : audit [DBG] from='client.335028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:02 smithi027 bash[22610]: audit 2024-08-31T08:09:01.570448+0000 mgr.a (mgr.14388) 15469 : audit [DBG] from='client.335028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:02 smithi191 bash[24992]: audit 2024-08-31T08:09:01.570448+0000 mgr.a (mgr.14388) 15469 : audit [DBG] from='client.335028 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:03 smithi163 bash[24253]: cluster 2024-08-31T08:09:01.926659+0000 mgr.a (mgr.14388) 15470 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:03 smithi027 bash[22610]: cluster 2024-08-31T08:09:01.926659+0000 mgr.a (mgr.14388) 15470 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:03 smithi191 bash[24992]: cluster 2024-08-31T08:09:01.926659+0000 mgr.a (mgr.14388) 15470 : cluster [DBG] pgmap v10725: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:05 smithi163 bash[24253]: cluster 2024-08-31T08:09:03.928882+0000 mgr.a (mgr.14388) 15471 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:05 smithi163 bash[24253]: audit 2024-08-31T08:09:05.113732+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:05 smithi163 bash[24253]: audit 2024-08-31T08:09:05.128216+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:05 smithi163 bash[24253]: audit 2024-08-31T08:09:05.162681+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:05 smithi163 bash[24253]: audit 2024-08-31T08:09:05.173931+0000 mon.a (mon.0) 2883 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:05 smithi163 bash[24253]: audit 2024-08-31T08:09:05.177728+0000 mon.a (mon.0) 2884 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:05 smithi163 bash[24253]: audit 2024-08-31T08:09:05.181583+0000 mon.a (mon.0) 2885 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:05 smithi027 bash[22610]: cluster 2024-08-31T08:09:03.928882+0000 mgr.a (mgr.14388) 15471 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:05 smithi027 bash[22610]: audit 2024-08-31T08:09:05.113732+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:05 smithi027 bash[22610]: audit 2024-08-31T08:09:05.128216+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:05 smithi027 bash[22610]: audit 2024-08-31T08:09:05.162681+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:05 smithi027 bash[22610]: audit 2024-08-31T08:09:05.173931+0000 mon.a (mon.0) 2883 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:05 smithi027 bash[22610]: audit 2024-08-31T08:09:05.177728+0000 mon.a (mon.0) 2884 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:05 smithi027 bash[22610]: audit 2024-08-31T08:09:05.181583+0000 mon.a (mon.0) 2885 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:05 smithi191 bash[24992]: cluster 2024-08-31T08:09:03.928882+0000 mgr.a (mgr.14388) 15471 : cluster [DBG] pgmap v10726: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:05 smithi191 bash[24992]: audit 2024-08-31T08:09:05.113732+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:05 smithi191 bash[24992]: audit 2024-08-31T08:09:05.128216+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:05 smithi191 bash[24992]: audit 2024-08-31T08:09:05.162681+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:05 smithi191 bash[24992]: audit 2024-08-31T08:09:05.173931+0000 mon.a (mon.0) 2883 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:05 smithi191 bash[24992]: audit 2024-08-31T08:09:05.177728+0000 mon.a (mon.0) 2884 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:05 smithi191 bash[24992]: audit 2024-08-31T08:09:05.181583+0000 mon.a (mon.0) 2885 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:06 smithi163 bash[24253]: audit 2024-08-31T08:09:05.881970+0000 mon.a (mon.0) 2886 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:09:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:06 smithi163 bash[24253]: audit 2024-08-31T08:09:05.883730+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:09:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:06 smithi163 bash[24253]: audit 2024-08-31T08:09:05.893935+0000 mon.a (mon.0) 2888 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:06 smithi163 bash[24253]: audit 2024-08-31T08:09:05.898793+0000 mon.a (mon.0) 2889 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:09:06.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:09:06 smithi027 bash[22863]: debug 2024-08-31T08:09:06.654+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:09:06.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:09:06 smithi027 bash[22863]: debug 2024-08-31T08:09:06.654+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:09:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:06 smithi027 bash[22610]: audit 2024-08-31T08:09:05.881970+0000 mon.a (mon.0) 2886 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:09:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:06 smithi027 bash[22610]: audit 2024-08-31T08:09:05.883730+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:09:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:06 smithi027 bash[22610]: audit 2024-08-31T08:09:05.893935+0000 mon.a (mon.0) 2888 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:06 smithi027 bash[22610]: audit 2024-08-31T08:09:05.898793+0000 mon.a (mon.0) 2889 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:09:06.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:06.992 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:06.992 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:06 smithi191 bash[24992]: audit 2024-08-31T08:09:05.881970+0000 mon.a (mon.0) 2886 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:09:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:06 smithi191 bash[24992]: audit 2024-08-31T08:09:05.883730+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:09:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:06 smithi191 bash[24992]: audit 2024-08-31T08:09:05.893935+0000 mon.a (mon.0) 2888 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:09:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:06 smithi191 bash[24992]: audit 2024-08-31T08:09:05.898793+0000 mon.a (mon.0) 2889 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:09:07.749 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:07.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:07.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:07.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:07.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:09:07.954 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:07 smithi163 bash[24253]: audit 2024-08-31T08:09:05.901053+0000 mgr.a (mgr.14388) 15472 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:09:07.954 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:07 smithi163 bash[24253]: cluster 2024-08-31T08:09:05.930268+0000 mgr.a (mgr.14388) 15473 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:07.955 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:07 smithi163 bash[24253]: audit 2024-08-31T08:09:06.655670+0000 mgr.a (mgr.14388) 15474 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:09:07.955 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:07 smithi163 bash[24253]: cephadm 2024-08-31T08:09:06.657421+0000 mgr.a (mgr.14388) 15475 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:09:07.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:07 smithi027 bash[22610]: audit 2024-08-31T08:09:05.901053+0000 mgr.a (mgr.14388) 15472 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:09:07.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:07 smithi027 bash[22610]: cluster 2024-08-31T08:09:05.930268+0000 mgr.a (mgr.14388) 15473 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:07.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:07 smithi027 bash[22610]: audit 2024-08-31T08:09:06.655670+0000 mgr.a (mgr.14388) 15474 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:09:07.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:07 smithi027 bash[22610]: cephadm 2024-08-31T08:09:06.657421+0000 mgr.a (mgr.14388) 15475 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:09:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:07 smithi191 bash[24992]: audit 2024-08-31T08:09:05.901053+0000 mgr.a (mgr.14388) 15472 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:09:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:07 smithi191 bash[24992]: cluster 2024-08-31T08:09:05.930268+0000 mgr.a (mgr.14388) 15473 : cluster [DBG] pgmap v10727: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:07 smithi191 bash[24992]: audit 2024-08-31T08:09:06.655670+0000 mgr.a (mgr.14388) 15474 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:09:08.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:07 smithi191 bash[24992]: cephadm 2024-08-31T08:09:06.657421+0000 mgr.a (mgr.14388) 15475 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:09:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:08 smithi163 bash[24253]: audit 2024-08-31T08:09:07.328579+0000 mgr.a (mgr.14388) 15476 : audit [DBG] from='client.335205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:08 smithi027 bash[22610]: audit 2024-08-31T08:09:07.328579+0000 mgr.a (mgr.14388) 15476 : audit [DBG] from='client.335205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:08 smithi191 bash[24992]: audit 2024-08-31T08:09:07.328579+0000 mgr.a (mgr.14388) 15476 : audit [DBG] from='client.335205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:09 smithi163 bash[24253]: cluster 2024-08-31T08:09:07.931243+0000 mgr.a (mgr.14388) 15477 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:09 smithi027 bash[22610]: cluster 2024-08-31T08:09:07.931243+0000 mgr.a (mgr.14388) 15477 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:09 smithi191 bash[24992]: cluster 2024-08-31T08:09:07.931243+0000 mgr.a (mgr.14388) 15477 : cluster [DBG] pgmap v10728: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:11 smithi163 bash[24253]: cluster 2024-08-31T08:09:09.933414+0000 mgr.a (mgr.14388) 15478 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:11 smithi027 bash[22610]: cluster 2024-08-31T08:09:09.933414+0000 mgr.a (mgr.14388) 15478 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:11 smithi191 bash[24992]: cluster 2024-08-31T08:09:09.933414+0000 mgr.a (mgr.14388) 15478 : cluster [DBG] pgmap v10729: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:12.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:12.747 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:12.747 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:13.502 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:13.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:13.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:13.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:13.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:09:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:13 smithi163 bash[24253]: cluster 2024-08-31T08:09:11.934204+0000 mgr.a (mgr.14388) 15479 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:13 smithi027 bash[22610]: cluster 2024-08-31T08:09:11.934204+0000 mgr.a (mgr.14388) 15479 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:13 smithi191 bash[24992]: cluster 2024-08-31T08:09:11.934204+0000 mgr.a (mgr.14388) 15479 : cluster [DBG] pgmap v10730: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:14 smithi163 bash[24253]: audit 2024-08-31T08:09:13.076170+0000 mgr.a (mgr.14388) 15480 : audit [DBG] from='client.335280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:14 smithi027 bash[22610]: audit 2024-08-31T08:09:13.076170+0000 mgr.a (mgr.14388) 15480 : audit [DBG] from='client.335280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:14 smithi191 bash[24992]: audit 2024-08-31T08:09:13.076170+0000 mgr.a (mgr.14388) 15480 : audit [DBG] from='client.335280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:15 smithi163 bash[24253]: cluster 2024-08-31T08:09:13.937044+0000 mgr.a (mgr.14388) 15481 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:15 smithi027 bash[22610]: cluster 2024-08-31T08:09:13.937044+0000 mgr.a (mgr.14388) 15481 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:15 smithi191 bash[24992]: cluster 2024-08-31T08:09:13.937044+0000 mgr.a (mgr.14388) 15481 : cluster [DBG] pgmap v10731: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:17 smithi027 bash[22610]: cluster 2024-08-31T08:09:15.937843+0000 mgr.a (mgr.14388) 15482 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:09:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:17 smithi191 bash[24992]: cluster 2024-08-31T08:09:15.937843+0000 mgr.a (mgr.14388) 15482 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:09:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:17 smithi163 bash[24253]: cluster 2024-08-31T08:09:15.937843+0000 mgr.a (mgr.14388) 15482 : cluster [DBG] pgmap v10732: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:09:18.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:18.504 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:19.254 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:19.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:19.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:19.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:19.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:09:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:19 smithi027 bash[22610]: cluster 2024-08-31T08:09:17.938617+0000 mgr.a (mgr.14388) 15483 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:09:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:19 smithi191 bash[24992]: cluster 2024-08-31T08:09:17.938617+0000 mgr.a (mgr.14388) 15483 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:09:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:19 smithi163 bash[24253]: cluster 2024-08-31T08:09:17.938617+0000 mgr.a (mgr.14388) 15483 : cluster [DBG] pgmap v10733: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:09:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:20 smithi027 bash[22610]: audit 2024-08-31T08:09:18.832555+0000 mgr.a (mgr.14388) 15484 : audit [DBG] from='client.335355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:20 smithi191 bash[24992]: audit 2024-08-31T08:09:18.832555+0000 mgr.a (mgr.14388) 15484 : audit [DBG] from='client.335355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:20 smithi163 bash[24253]: audit 2024-08-31T08:09:18.832555+0000 mgr.a (mgr.14388) 15484 : audit [DBG] from='client.335355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:21 smithi027 bash[22610]: cluster 2024-08-31T08:09:19.941469+0000 mgr.a (mgr.14388) 15485 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:21 smithi191 bash[24992]: cluster 2024-08-31T08:09:19.941469+0000 mgr.a (mgr.14388) 15485 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:21 smithi163 bash[24253]: cluster 2024-08-31T08:09:19.941469+0000 mgr.a (mgr.14388) 15485 : cluster [DBG] pgmap v10734: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:09:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:22 smithi027 bash[22610]: cluster 2024-08-31T08:09:21.942260+0000 mgr.a (mgr.14388) 15486 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:09:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:22 smithi191 bash[24992]: cluster 2024-08-31T08:09:21.942260+0000 mgr.a (mgr.14388) 15486 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:09:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:22 smithi163 bash[24253]: cluster 2024-08-31T08:09:21.942260+0000 mgr.a (mgr.14388) 15486 : cluster [DBG] pgmap v10735: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:09:24.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:24.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:24.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:25.014 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:25.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:25.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:25.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:25.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:09:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:25 smithi191 bash[24992]: cluster 2024-08-31T08:09:23.944209+0000 mgr.a (mgr.14388) 15487 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:25 smithi191 bash[24992]: audit 2024-08-31T08:09:24.586397+0000 mgr.a (mgr.14388) 15488 : audit [DBG] from='client.335430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:25 smithi163 bash[24253]: cluster 2024-08-31T08:09:23.944209+0000 mgr.a (mgr.14388) 15487 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:25 smithi163 bash[24253]: audit 2024-08-31T08:09:24.586397+0000 mgr.a (mgr.14388) 15488 : audit [DBG] from='client.335430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:24 smithi027 bash[22610]: cluster 2024-08-31T08:09:23.944209+0000 mgr.a (mgr.14388) 15487 : cluster [DBG] pgmap v10736: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:24 smithi027 bash[22610]: audit 2024-08-31T08:09:24.586397+0000 mgr.a (mgr.14388) 15488 : audit [DBG] from='client.335430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:27 smithi191 bash[24992]: cluster 2024-08-31T08:09:25.945095+0000 mgr.a (mgr.14388) 15489 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:27 smithi163 bash[24253]: cluster 2024-08-31T08:09:25.945095+0000 mgr.a (mgr.14388) 15489 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:27 smithi027 bash[22610]: cluster 2024-08-31T08:09:25.945095+0000 mgr.a (mgr.14388) 15489 : cluster [DBG] pgmap v10737: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:29 smithi163 bash[24253]: cluster 2024-08-31T08:09:27.945882+0000 mgr.a (mgr.14388) 15490 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:29 smithi027 bash[22610]: cluster 2024-08-31T08:09:27.945882+0000 mgr.a (mgr.14388) 15490 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:29 smithi191 bash[24992]: cluster 2024-08-31T08:09:27.945882+0000 mgr.a (mgr.14388) 15490 : cluster [DBG] pgmap v10738: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:30.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:30.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:30.774 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:30.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:30.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:30.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:30.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:09:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:31 smithi163 bash[24253]: cluster 2024-08-31T08:09:29.948124+0000 mgr.a (mgr.14388) 15491 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:31 smithi163 bash[24253]: audit 2024-08-31T08:09:30.346294+0000 mgr.a (mgr.14388) 15492 : audit [DBG] from='client.335508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:31 smithi027 bash[22610]: cluster 2024-08-31T08:09:29.948124+0000 mgr.a (mgr.14388) 15491 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:31 smithi027 bash[22610]: audit 2024-08-31T08:09:30.346294+0000 mgr.a (mgr.14388) 15492 : audit [DBG] from='client.335508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:31 smithi191 bash[24992]: cluster 2024-08-31T08:09:29.948124+0000 mgr.a (mgr.14388) 15491 : cluster [DBG] pgmap v10739: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:31 smithi191 bash[24992]: audit 2024-08-31T08:09:30.346294+0000 mgr.a (mgr.14388) 15492 : audit [DBG] from='client.335508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:33 smithi163 bash[24253]: cluster 2024-08-31T08:09:31.949035+0000 mgr.a (mgr.14388) 15493 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:33 smithi027 bash[22610]: cluster 2024-08-31T08:09:31.949035+0000 mgr.a (mgr.14388) 15493 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:33 smithi191 bash[24992]: cluster 2024-08-31T08:09:31.949035+0000 mgr.a (mgr.14388) 15493 : cluster [DBG] pgmap v10740: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:35 smithi163 bash[24253]: cluster 2024-08-31T08:09:33.951229+0000 mgr.a (mgr.14388) 15494 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:35 smithi027 bash[22610]: cluster 2024-08-31T08:09:33.951229+0000 mgr.a (mgr.14388) 15494 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:35 smithi191 bash[24992]: cluster 2024-08-31T08:09:33.951229+0000 mgr.a (mgr.14388) 15494 : cluster [DBG] pgmap v10741: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:35.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:35.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:35.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:36.557 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:36.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:36.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:36.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:36.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:09:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:37 smithi163 bash[24253]: cluster 2024-08-31T08:09:35.951953+0000 mgr.a (mgr.14388) 15495 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:37 smithi163 bash[24253]: audit 2024-08-31T08:09:36.116671+0000 mgr.a (mgr.14388) 15496 : audit [DBG] from='client.335583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:37 smithi027 bash[22610]: cluster 2024-08-31T08:09:35.951953+0000 mgr.a (mgr.14388) 15495 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:37 smithi027 bash[22610]: audit 2024-08-31T08:09:36.116671+0000 mgr.a (mgr.14388) 15496 : audit [DBG] from='client.335583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:37 smithi191 bash[24992]: cluster 2024-08-31T08:09:35.951953+0000 mgr.a (mgr.14388) 15495 : cluster [DBG] pgmap v10742: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:37 smithi191 bash[24992]: audit 2024-08-31T08:09:36.116671+0000 mgr.a (mgr.14388) 15496 : audit [DBG] from='client.335583 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:39 smithi163 bash[24253]: cluster 2024-08-31T08:09:37.952839+0000 mgr.a (mgr.14388) 15497 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:39 smithi027 bash[22610]: cluster 2024-08-31T08:09:37.952839+0000 mgr.a (mgr.14388) 15497 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:39 smithi191 bash[24992]: cluster 2024-08-31T08:09:37.952839+0000 mgr.a (mgr.14388) 15497 : cluster [DBG] pgmap v10743: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:41 smithi163 bash[24253]: cluster 2024-08-31T08:09:39.955209+0000 mgr.a (mgr.14388) 15498 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:41 smithi027 bash[22610]: cluster 2024-08-31T08:09:39.955209+0000 mgr.a (mgr.14388) 15498 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:41 smithi191 bash[24992]: cluster 2024-08-31T08:09:39.955209+0000 mgr.a (mgr.14388) 15498 : cluster [DBG] pgmap v10744: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:41.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:41.560 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:41.560 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:42.337 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:42.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:42.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:42.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:42.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:09:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:43 smithi163 bash[24253]: audit 2024-08-31T08:09:41.894767+0000 mgr.a (mgr.14388) 15499 : audit [DBG] from='client.335661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:43 smithi163 bash[24253]: cluster 2024-08-31T08:09:41.955876+0000 mgr.a (mgr.14388) 15500 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:43 smithi027 bash[22610]: audit 2024-08-31T08:09:41.894767+0000 mgr.a (mgr.14388) 15499 : audit [DBG] from='client.335661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:43 smithi027 bash[22610]: cluster 2024-08-31T08:09:41.955876+0000 mgr.a (mgr.14388) 15500 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:43 smithi191 bash[24992]: audit 2024-08-31T08:09:41.894767+0000 mgr.a (mgr.14388) 15499 : audit [DBG] from='client.335661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:43 smithi191 bash[24992]: cluster 2024-08-31T08:09:41.955876+0000 mgr.a (mgr.14388) 15500 : cluster [DBG] pgmap v10745: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:45 smithi163 bash[24253]: cluster 2024-08-31T08:09:43.958111+0000 mgr.a (mgr.14388) 15501 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:45 smithi027 bash[22610]: cluster 2024-08-31T08:09:43.958111+0000 mgr.a (mgr.14388) 15501 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:45 smithi191 bash[24992]: cluster 2024-08-31T08:09:43.958111+0000 mgr.a (mgr.14388) 15501 : cluster [DBG] pgmap v10746: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:09:47.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:47.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:47.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:47 smithi163 bash[24253]: cluster 2024-08-31T08:09:45.958932+0000 mgr.a (mgr.14388) 15502 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:47 smithi027 bash[22610]: cluster 2024-08-31T08:09:45.958932+0000 mgr.a (mgr.14388) 15502 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:47 smithi191 bash[24992]: cluster 2024-08-31T08:09:45.958932+0000 mgr.a (mgr.14388) 15502 : cluster [DBG] pgmap v10747: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:48.131 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:48.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:09:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:48 smithi163 bash[24253]: audit 2024-08-31T08:09:47.677617+0000 mgr.a (mgr.14388) 15503 : audit [DBG] from='client.335739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:48 smithi027 bash[22610]: audit 2024-08-31T08:09:47.677617+0000 mgr.a (mgr.14388) 15503 : audit [DBG] from='client.335739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:48 smithi191 bash[24992]: audit 2024-08-31T08:09:47.677617+0000 mgr.a (mgr.14388) 15503 : audit [DBG] from='client.335739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:49 smithi163 bash[24253]: cluster 2024-08-31T08:09:47.959431+0000 mgr.a (mgr.14388) 15504 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:49 smithi027 bash[22610]: cluster 2024-08-31T08:09:47.959431+0000 mgr.a (mgr.14388) 15504 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:49 smithi191 bash[24992]: cluster 2024-08-31T08:09:47.959431+0000 mgr.a (mgr.14388) 15504 : cluster [DBG] pgmap v10748: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:51 smithi163 bash[24253]: cluster 2024-08-31T08:09:49.961730+0000 mgr.a (mgr.14388) 15505 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:09:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:51 smithi027 bash[22610]: cluster 2024-08-31T08:09:49.961730+0000 mgr.a (mgr.14388) 15505 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:09:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:51 smithi191 bash[24992]: cluster 2024-08-31T08:09:49.961730+0000 mgr.a (mgr.14388) 15505 : cluster [DBG] pgmap v10749: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:09:53.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:53.134 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:53.134 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:53 smithi163 bash[24253]: cluster 2024-08-31T08:09:51.962494+0000 mgr.a (mgr.14388) 15506 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:09:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:53 smithi027 bash[22610]: cluster 2024-08-31T08:09:51.962494+0000 mgr.a (mgr.14388) 15506 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:09:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:53 smithi191 bash[24992]: cluster 2024-08-31T08:09:51.962494+0000 mgr.a (mgr.14388) 15506 : cluster [DBG] pgmap v10750: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:09:53.904 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:53.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:09:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:54 smithi163 bash[24253]: audit 2024-08-31T08:09:53.465916+0000 mgr.a (mgr.14388) 15507 : audit [DBG] from='client.335817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:54 smithi027 bash[22610]: audit 2024-08-31T08:09:53.465916+0000 mgr.a (mgr.14388) 15507 : audit [DBG] from='client.335817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:54 smithi191 bash[24992]: audit 2024-08-31T08:09:53.465916+0000 mgr.a (mgr.14388) 15507 : audit [DBG] from='client.335817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:09:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:55 smithi163 bash[24253]: cluster 2024-08-31T08:09:53.963866+0000 mgr.a (mgr.14388) 15508 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:55 smithi027 bash[22610]: cluster 2024-08-31T08:09:53.963866+0000 mgr.a (mgr.14388) 15508 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:55 smithi191 bash[24992]: cluster 2024-08-31T08:09:53.963866+0000 mgr.a (mgr.14388) 15508 : cluster [DBG] pgmap v10751: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:09:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:57 smithi163 bash[24253]: cluster 2024-08-31T08:09:55.964608+0000 mgr.a (mgr.14388) 15509 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:09:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:57 smithi027 bash[22610]: cluster 2024-08-31T08:09:55.964608+0000 mgr.a (mgr.14388) 15509 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:09:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:57 smithi191 bash[24992]: cluster 2024-08-31T08:09:55.964608+0000 mgr.a (mgr.14388) 15509 : cluster [DBG] pgmap v10752: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:09:58.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:09:58.907 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:09:58.907 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:09:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:09:59 smithi163 bash[24253]: cluster 2024-08-31T08:09:57.965350+0000 mgr.a (mgr.14388) 15510 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:09:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:09:59 smithi027 bash[22610]: cluster 2024-08-31T08:09:57.965350+0000 mgr.a (mgr.14388) 15510 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:09:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:09:59 smithi191 bash[24992]: cluster 2024-08-31T08:09:57.965350+0000 mgr.a (mgr.14388) 15510 : cluster [DBG] pgmap v10753: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:09:59.684 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:09:59.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:09:59.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:09:59.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:09:59.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:00 smithi163 bash[24253]: audit 2024-08-31T08:09:59.241581+0000 mgr.a (mgr.14388) 15511 : audit [DBG] from='client.335889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:00 smithi163 bash[24253]: cluster 2024-08-31T08:10:00.000160+0000 mon.a (mon.0) 2890 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:10:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:00 smithi027 bash[22610]: audit 2024-08-31T08:09:59.241581+0000 mgr.a (mgr.14388) 15511 : audit [DBG] from='client.335889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:00 smithi027 bash[22610]: cluster 2024-08-31T08:10:00.000160+0000 mon.a (mon.0) 2890 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:10:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:00 smithi191 bash[24992]: audit 2024-08-31T08:09:59.241581+0000 mgr.a (mgr.14388) 15511 : audit [DBG] from='client.335889 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:00 smithi191 bash[24992]: cluster 2024-08-31T08:10:00.000160+0000 mon.a (mon.0) 2890 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:10:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:01 smithi163 bash[24253]: cluster 2024-08-31T08:09:59.968217+0000 mgr.a (mgr.14388) 15512 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:01 smithi027 bash[22610]: cluster 2024-08-31T08:09:59.968217+0000 mgr.a (mgr.14388) 15512 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:01 smithi191 bash[24992]: cluster 2024-08-31T08:09:59.968217+0000 mgr.a (mgr.14388) 15512 : cluster [DBG] pgmap v10754: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:03 smithi163 bash[24253]: cluster 2024-08-31T08:10:01.969001+0000 mgr.a (mgr.14388) 15513 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:10:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:03 smithi027 bash[22610]: cluster 2024-08-31T08:10:01.969001+0000 mgr.a (mgr.14388) 15513 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:10:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:03 smithi191 bash[24992]: cluster 2024-08-31T08:10:01.969001+0000 mgr.a (mgr.14388) 15513 : cluster [DBG] pgmap v10755: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:10:04.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:10:04.686 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:10:04.686 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:10:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:05 smithi163 bash[24253]: cluster 2024-08-31T08:10:03.971015+0000 mgr.a (mgr.14388) 15514 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:10:05.450 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:10:05.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:10:05.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:10:05.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:10:05.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:05 smithi027 bash[22610]: cluster 2024-08-31T08:10:03.971015+0000 mgr.a (mgr.14388) 15514 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:10:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:05 smithi191 bash[24992]: cluster 2024-08-31T08:10:03.971015+0000 mgr.a (mgr.14388) 15514 : cluster [DBG] pgmap v10756: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:10:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:06 smithi163 bash[24253]: audit 2024-08-31T08:10:05.023049+0000 mgr.a (mgr.14388) 15515 : audit [DBG] from='client.335967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:06 smithi027 bash[22610]: audit 2024-08-31T08:10:05.023049+0000 mgr.a (mgr.14388) 15515 : audit [DBG] from='client.335967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:06 smithi191 bash[24992]: audit 2024-08-31T08:10:05.023049+0000 mgr.a (mgr.14388) 15515 : audit [DBG] from='client.335967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:07 smithi163 bash[24253]: cluster 2024-08-31T08:10:05.971968+0000 mgr.a (mgr.14388) 15516 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:07 smithi163 bash[24253]: audit 2024-08-31T08:10:06.717482+0000 mon.a (mon.0) 2891 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:10:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:07 smithi027 bash[22610]: cluster 2024-08-31T08:10:05.971968+0000 mgr.a (mgr.14388) 15516 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:07 smithi027 bash[22610]: audit 2024-08-31T08:10:06.717482+0000 mon.a (mon.0) 2891 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:10:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:07 smithi191 bash[24992]: cluster 2024-08-31T08:10:05.971968+0000 mgr.a (mgr.14388) 15516 : cluster [DBG] pgmap v10757: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:07 smithi191 bash[24992]: audit 2024-08-31T08:10:06.717482+0000 mon.a (mon.0) 2891 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:10:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:08 smithi163 bash[24253]: audit 2024-08-31T08:10:07.543657+0000 mon.a (mon.0) 2892 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:10:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:08 smithi163 bash[24253]: audit 2024-08-31T08:10:07.545173+0000 mon.a (mon.0) 2893 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:10:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:08 smithi163 bash[24253]: audit 2024-08-31T08:10:07.556835+0000 mon.a (mon.0) 2894 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:10:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:08 smithi163 bash[24253]: audit 2024-08-31T08:10:07.562143+0000 mon.a (mon.0) 2895 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:10:08.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:08 smithi163 bash[24253]: audit 2024-08-31T08:10:07.563773+0000 mgr.a (mgr.14388) 15517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:10:08.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:10:08 smithi027 bash[22863]: debug 2024-08-31T08:10:08.288+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:10:08.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:10:08 smithi027 bash[22863]: debug 2024-08-31T08:10:08.288+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:10:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:08 smithi027 bash[22610]: audit 2024-08-31T08:10:07.543657+0000 mon.a (mon.0) 2892 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:10:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:08 smithi027 bash[22610]: audit 2024-08-31T08:10:07.545173+0000 mon.a (mon.0) 2893 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:10:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:08 smithi027 bash[22610]: audit 2024-08-31T08:10:07.556835+0000 mon.a (mon.0) 2894 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:10:08.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:08 smithi027 bash[22610]: audit 2024-08-31T08:10:07.562143+0000 mon.a (mon.0) 2895 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:10:08.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:08 smithi027 bash[22610]: audit 2024-08-31T08:10:07.563773+0000 mgr.a (mgr.14388) 15517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:10:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:08 smithi191 bash[24992]: audit 2024-08-31T08:10:07.543657+0000 mon.a (mon.0) 2892 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:10:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:08 smithi191 bash[24992]: audit 2024-08-31T08:10:07.545173+0000 mon.a (mon.0) 2893 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:10:08.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:08 smithi191 bash[24992]: audit 2024-08-31T08:10:07.556835+0000 mon.a (mon.0) 2894 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:10:08.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:08 smithi191 bash[24992]: audit 2024-08-31T08:10:07.562143+0000 mon.a (mon.0) 2895 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:10:08.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:08 smithi191 bash[24992]: audit 2024-08-31T08:10:07.563773+0000 mgr.a (mgr.14388) 15517 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:10:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:09 smithi163 bash[24253]: cluster 2024-08-31T08:10:07.972519+0000 mgr.a (mgr.14388) 15518 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:09 smithi163 bash[24253]: audit 2024-08-31T08:10:08.293173+0000 mgr.a (mgr.14388) 15519 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:10:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:09 smithi163 bash[24253]: cephadm 2024-08-31T08:10:08.294279+0000 mgr.a (mgr.14388) 15520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:10:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:09 smithi027 bash[22610]: cluster 2024-08-31T08:10:07.972519+0000 mgr.a (mgr.14388) 15518 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:09 smithi027 bash[22610]: audit 2024-08-31T08:10:08.293173+0000 mgr.a (mgr.14388) 15519 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:10:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:09 smithi027 bash[22610]: cephadm 2024-08-31T08:10:08.294279+0000 mgr.a (mgr.14388) 15520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:10:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:09 smithi191 bash[24992]: cluster 2024-08-31T08:10:07.972519+0000 mgr.a (mgr.14388) 15518 : cluster [DBG] pgmap v10758: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:09 smithi191 bash[24992]: audit 2024-08-31T08:10:08.293173+0000 mgr.a (mgr.14388) 15519 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:10:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:09 smithi191 bash[24992]: cephadm 2024-08-31T08:10:08.294279+0000 mgr.a (mgr.14388) 15520 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:10:10.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:10:10.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:10:10.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:10:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:10:11.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:10:11.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:10:11.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:10:11.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:11 smithi163 bash[24253]: cluster 2024-08-31T08:10:09.974815+0000 mgr.a (mgr.14388) 15521 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:10:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:11 smithi027 bash[22610]: cluster 2024-08-31T08:10:09.974815+0000 mgr.a (mgr.14388) 15521 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:10:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:11 smithi191 bash[24992]: cluster 2024-08-31T08:10:09.974815+0000 mgr.a (mgr.14388) 15521 : cluster [DBG] pgmap v10759: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T08:10:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:12 smithi163 bash[24253]: audit 2024-08-31T08:10:10.785405+0000 mgr.a (mgr.14388) 15522 : audit [DBG] from='client.336153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:12 smithi027 bash[22610]: audit 2024-08-31T08:10:10.785405+0000 mgr.a (mgr.14388) 15522 : audit [DBG] from='client.336153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:12 smithi191 bash[24992]: audit 2024-08-31T08:10:10.785405+0000 mgr.a (mgr.14388) 15522 : audit [DBG] from='client.336153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:13 smithi163 bash[24253]: cluster 2024-08-31T08:10:11.975736+0000 mgr.a (mgr.14388) 15523 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:10:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:13 smithi027 bash[22610]: cluster 2024-08-31T08:10:11.975736+0000 mgr.a (mgr.14388) 15523 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:10:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:13 smithi191 bash[24992]: cluster 2024-08-31T08:10:11.975736+0000 mgr.a (mgr.14388) 15523 : cluster [DBG] pgmap v10760: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.3 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:10:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:15 smithi163 bash[24253]: cluster 2024-08-31T08:10:13.977950+0000 mgr.a (mgr.14388) 15524 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:15 smithi027 bash[22610]: cluster 2024-08-31T08:10:13.977950+0000 mgr.a (mgr.14388) 15524 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:15 smithi191 bash[24992]: cluster 2024-08-31T08:10:13.977950+0000 mgr.a (mgr.14388) 15524 : cluster [DBG] pgmap v10761: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:16.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:10:16.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:10:16.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:10:17.004 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:10:17.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:10:17.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:10:17.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:10:17.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:17 smithi163 bash[24253]: cluster 2024-08-31T08:10:15.978703+0000 mgr.a (mgr.14388) 15525 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:17 smithi163 bash[24253]: audit 2024-08-31T08:10:16.577042+0000 mgr.a (mgr.14388) 15526 : audit [DBG] from='client.336231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:17 smithi027 bash[22610]: cluster 2024-08-31T08:10:15.978703+0000 mgr.a (mgr.14388) 15525 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:17 smithi027 bash[22610]: audit 2024-08-31T08:10:16.577042+0000 mgr.a (mgr.14388) 15526 : audit [DBG] from='client.336231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:17 smithi191 bash[24992]: cluster 2024-08-31T08:10:15.978703+0000 mgr.a (mgr.14388) 15525 : cluster [DBG] pgmap v10762: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:17 smithi191 bash[24992]: audit 2024-08-31T08:10:16.577042+0000 mgr.a (mgr.14388) 15526 : audit [DBG] from='client.336231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:19 smithi163 bash[24253]: cluster 2024-08-31T08:10:17.979615+0000 mgr.a (mgr.14388) 15527 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:19 smithi027 bash[22610]: cluster 2024-08-31T08:10:17.979615+0000 mgr.a (mgr.14388) 15527 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:19 smithi191 bash[24992]: cluster 2024-08-31T08:10:17.979615+0000 mgr.a (mgr.14388) 15527 : cluster [DBG] pgmap v10763: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:21 smithi163 bash[24253]: cluster 2024-08-31T08:10:19.981818+0000 mgr.a (mgr.14388) 15528 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:21 smithi027 bash[22610]: cluster 2024-08-31T08:10:19.981818+0000 mgr.a (mgr.14388) 15528 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:22.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:10:22.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:10:22.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:10:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:21 smithi191 bash[24992]: cluster 2024-08-31T08:10:19.981818+0000 mgr.a (mgr.14388) 15528 : cluster [DBG] pgmap v10764: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:10:22.780 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:10:22.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:10:22.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:10:22.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:10:22.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:23 smithi163 bash[24253]: cluster 2024-08-31T08:10:21.982586+0000 mgr.a (mgr.14388) 15529 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:10:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:23 smithi163 bash[24253]: audit 2024-08-31T08:10:22.344209+0000 mgr.a (mgr.14388) 15530 : audit [DBG] from='client.336309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:23 smithi027 bash[22610]: cluster 2024-08-31T08:10:21.982586+0000 mgr.a (mgr.14388) 15529 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:10:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:23 smithi027 bash[22610]: audit 2024-08-31T08:10:22.344209+0000 mgr.a (mgr.14388) 15530 : audit [DBG] from='client.336309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:23 smithi191 bash[24992]: cluster 2024-08-31T08:10:21.982586+0000 mgr.a (mgr.14388) 15529 : cluster [DBG] pgmap v10765: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:10:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:23 smithi191 bash[24992]: audit 2024-08-31T08:10:22.344209+0000 mgr.a (mgr.14388) 15530 : audit [DBG] from='client.336309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:25 smithi163 bash[24253]: cluster 2024-08-31T08:10:23.984996+0000 mgr.a (mgr.14388) 15531 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T08:10:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:25 smithi027 bash[22610]: cluster 2024-08-31T08:10:23.984996+0000 mgr.a (mgr.14388) 15531 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T08:10:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:25 smithi191 bash[24992]: cluster 2024-08-31T08:10:23.984996+0000 mgr.a (mgr.14388) 15531 : cluster [DBG] pgmap v10766: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 5.4 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T08:10:27.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:10:27.782 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:10:27.782 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:10:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:27 smithi163 bash[24253]: cluster 2024-08-31T08:10:25.985800+0000 mgr.a (mgr.14388) 15532 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:27 smithi027 bash[22610]: cluster 2024-08-31T08:10:25.985800+0000 mgr.a (mgr.14388) 15532 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:27 smithi191 bash[24992]: cluster 2024-08-31T08:10:25.985800+0000 mgr.a (mgr.14388) 15532 : cluster [DBG] pgmap v10767: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:28.532 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:10:28.532 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:10:28.532 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:10:28.532 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:10:28.532 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:29 smithi163 bash[24253]: cluster 2024-08-31T08:10:27.986564+0000 mgr.a (mgr.14388) 15533 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:29 smithi163 bash[24253]: audit 2024-08-31T08:10:28.113960+0000 mgr.a (mgr.14388) 15534 : audit [DBG] from='client.336387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:29 smithi027 bash[22610]: cluster 2024-08-31T08:10:27.986564+0000 mgr.a (mgr.14388) 15533 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:29 smithi027 bash[22610]: audit 2024-08-31T08:10:28.113960+0000 mgr.a (mgr.14388) 15534 : audit [DBG] from='client.336387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:29 smithi191 bash[24992]: cluster 2024-08-31T08:10:27.986564+0000 mgr.a (mgr.14388) 15533 : cluster [DBG] pgmap v10768: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:29 smithi191 bash[24992]: audit 2024-08-31T08:10:28.113960+0000 mgr.a (mgr.14388) 15534 : audit [DBG] from='client.336387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:31 smithi163 bash[24253]: cluster 2024-08-31T08:10:29.989453+0000 mgr.a (mgr.14388) 15535 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:31 smithi027 bash[22610]: cluster 2024-08-31T08:10:29.989453+0000 mgr.a (mgr.14388) 15535 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:31 smithi191 bash[24992]: cluster 2024-08-31T08:10:29.989453+0000 mgr.a (mgr.14388) 15535 : cluster [DBG] pgmap v10769: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:33.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:10:33.534 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:10:33.534 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:10:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:33 smithi163 bash[24253]: cluster 2024-08-31T08:10:31.990271+0000 mgr.a (mgr.14388) 15536 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:10:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:33 smithi027 bash[22610]: cluster 2024-08-31T08:10:31.990271+0000 mgr.a (mgr.14388) 15536 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:10:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:33 smithi191 bash[24992]: cluster 2024-08-31T08:10:31.990271+0000 mgr.a (mgr.14388) 15536 : cluster [DBG] pgmap v10770: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:10:34.285 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:10:34.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:10:34.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:10:34.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:10:34.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:35 smithi163 bash[24253]: audit 2024-08-31T08:10:33.864342+0000 mgr.a (mgr.14388) 15537 : audit [DBG] from='client.336465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:35 smithi163 bash[24253]: cluster 2024-08-31T08:10:33.993067+0000 mgr.a (mgr.14388) 15538 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:35 smithi027 bash[22610]: audit 2024-08-31T08:10:33.864342+0000 mgr.a (mgr.14388) 15537 : audit [DBG] from='client.336465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:35.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:35 smithi027 bash[22610]: cluster 2024-08-31T08:10:33.993067+0000 mgr.a (mgr.14388) 15538 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:35 smithi191 bash[24992]: audit 2024-08-31T08:10:33.864342+0000 mgr.a (mgr.14388) 15537 : audit [DBG] from='client.336465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:35 smithi191 bash[24992]: cluster 2024-08-31T08:10:33.993067+0000 mgr.a (mgr.14388) 15538 : cluster [DBG] pgmap v10771: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:37 smithi163 bash[24253]: cluster 2024-08-31T08:10:35.993964+0000 mgr.a (mgr.14388) 15539 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:10:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:37 smithi027 bash[22610]: cluster 2024-08-31T08:10:35.993964+0000 mgr.a (mgr.14388) 15539 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:10:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:37 smithi191 bash[24992]: cluster 2024-08-31T08:10:35.993964+0000 mgr.a (mgr.14388) 15539 : cluster [DBG] pgmap v10772: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:10:39.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:10:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:10:39.287 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:10:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:39 smithi163 bash[24253]: cluster 2024-08-31T08:10:37.994757+0000 mgr.a (mgr.14388) 15540 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:10:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:39 smithi027 bash[22610]: cluster 2024-08-31T08:10:37.994757+0000 mgr.a (mgr.14388) 15540 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:10:40.032 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:10:40.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:10:40.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:10:40.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:10:40.032 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:39 smithi191 bash[24992]: cluster 2024-08-31T08:10:37.994757+0000 mgr.a (mgr.14388) 15540 : cluster [DBG] pgmap v10773: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:10:40.962 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:40 smithi163 bash[24253]: audit 2024-08-31T08:10:39.618212+0000 mgr.a (mgr.14388) 15541 : audit [DBG] from='client.336540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:40 smithi027 bash[22610]: audit 2024-08-31T08:10:39.618212+0000 mgr.a (mgr.14388) 15541 : audit [DBG] from='client.336540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:41.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:40 smithi191 bash[24992]: audit 2024-08-31T08:10:39.618212+0000 mgr.a (mgr.14388) 15541 : audit [DBG] from='client.336540 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:41 smithi163 bash[24253]: cluster 2024-08-31T08:10:39.996110+0000 mgr.a (mgr.14388) 15542 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:41 smithi027 bash[22610]: cluster 2024-08-31T08:10:39.996110+0000 mgr.a (mgr.14388) 15542 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:41 smithi191 bash[24992]: cluster 2024-08-31T08:10:39.996110+0000 mgr.a (mgr.14388) 15542 : cluster [DBG] pgmap v10774: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:43 smithi163 bash[24253]: cluster 2024-08-31T08:10:41.996836+0000 mgr.a (mgr.14388) 15543 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:43 smithi027 bash[22610]: cluster 2024-08-31T08:10:41.996836+0000 mgr.a (mgr.14388) 15543 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:43 smithi191 bash[24992]: cluster 2024-08-31T08:10:41.996836+0000 mgr.a (mgr.14388) 15543 : cluster [DBG] pgmap v10775: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:45.033 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:10:45.034 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:10:45.034 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:10:45.817 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:10:45.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:10:45.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:10:45.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:10:45.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:45 smithi163 bash[24253]: cluster 2024-08-31T08:10:43.998833+0000 mgr.a (mgr.14388) 15544 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:10:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:45 smithi027 bash[22610]: cluster 2024-08-31T08:10:43.998833+0000 mgr.a (mgr.14388) 15544 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:10:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:45 smithi191 bash[24992]: cluster 2024-08-31T08:10:43.998833+0000 mgr.a (mgr.14388) 15544 : cluster [DBG] pgmap v10776: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:10:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:46 smithi163 bash[24253]: audit 2024-08-31T08:10:45.372565+0000 mgr.a (mgr.14388) 15545 : audit [DBG] from='client.336618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:46 smithi027 bash[22610]: audit 2024-08-31T08:10:45.372565+0000 mgr.a (mgr.14388) 15545 : audit [DBG] from='client.336618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:46 smithi191 bash[24992]: audit 2024-08-31T08:10:45.372565+0000 mgr.a (mgr.14388) 15545 : audit [DBG] from='client.336618 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:47 smithi163 bash[24253]: cluster 2024-08-31T08:10:45.999680+0000 mgr.a (mgr.14388) 15546 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:47 smithi027 bash[22610]: cluster 2024-08-31T08:10:45.999680+0000 mgr.a (mgr.14388) 15546 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:47 smithi191 bash[24992]: cluster 2024-08-31T08:10:45.999680+0000 mgr.a (mgr.14388) 15546 : cluster [DBG] pgmap v10777: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:49 smithi163 bash[24253]: cluster 2024-08-31T08:10:48.000448+0000 mgr.a (mgr.14388) 15547 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:49 smithi027 bash[22610]: cluster 2024-08-31T08:10:48.000448+0000 mgr.a (mgr.14388) 15547 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:49 smithi191 bash[24992]: cluster 2024-08-31T08:10:48.000448+0000 mgr.a (mgr.14388) 15547 : cluster [DBG] pgmap v10778: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:50.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:10:50.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:10:50.820 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:10:51.561 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:10:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:10:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:10:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:10:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:51 smithi163 bash[24253]: cluster 2024-08-31T08:10:50.002689+0000 mgr.a (mgr.14388) 15548 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:10:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:51 smithi027 bash[22610]: cluster 2024-08-31T08:10:50.002689+0000 mgr.a (mgr.14388) 15548 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:10:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:51 smithi191 bash[24992]: cluster 2024-08-31T08:10:50.002689+0000 mgr.a (mgr.14388) 15548 : cluster [DBG] pgmap v10779: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:10:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:52 smithi163 bash[24253]: audit 2024-08-31T08:10:51.149567+0000 mgr.a (mgr.14388) 15549 : audit [DBG] from='client.336696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:52 smithi027 bash[22610]: audit 2024-08-31T08:10:51.149567+0000 mgr.a (mgr.14388) 15549 : audit [DBG] from='client.336696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:52 smithi191 bash[24992]: audit 2024-08-31T08:10:51.149567+0000 mgr.a (mgr.14388) 15549 : audit [DBG] from='client.336696 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:53 smithi163 bash[24253]: cluster 2024-08-31T08:10:52.003594+0000 mgr.a (mgr.14388) 15550 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:53 smithi027 bash[22610]: cluster 2024-08-31T08:10:52.003594+0000 mgr.a (mgr.14388) 15550 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:53 smithi191 bash[24992]: cluster 2024-08-31T08:10:52.003594+0000 mgr.a (mgr.14388) 15550 : cluster [DBG] pgmap v10780: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:55 smithi163 bash[24253]: cluster 2024-08-31T08:10:54.005802+0000 mgr.a (mgr.14388) 15551 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:10:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:55 smithi027 bash[22610]: cluster 2024-08-31T08:10:54.005802+0000 mgr.a (mgr.14388) 15551 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:10:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:55 smithi191 bash[24992]: cluster 2024-08-31T08:10:54.005802+0000 mgr.a (mgr.14388) 15551 : cluster [DBG] pgmap v10781: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:10:56.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:10:56.563 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:10:56.563 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:10:57.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:10:57.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:10:57.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:10:57.322 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:10:57.322 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:10:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:57 smithi163 bash[24253]: cluster 2024-08-31T08:10:56.006547+0000 mgr.a (mgr.14388) 15552 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:57 smithi027 bash[22610]: cluster 2024-08-31T08:10:56.006547+0000 mgr.a (mgr.14388) 15552 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:57 smithi191 bash[24992]: cluster 2024-08-31T08:10:56.006547+0000 mgr.a (mgr.14388) 15552 : cluster [DBG] pgmap v10782: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:58 smithi163 bash[24253]: audit 2024-08-31T08:10:56.898210+0000 mgr.a (mgr.14388) 15553 : audit [DBG] from='client.336771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:58 smithi027 bash[22610]: audit 2024-08-31T08:10:56.898210+0000 mgr.a (mgr.14388) 15553 : audit [DBG] from='client.336771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:58 smithi191 bash[24992]: audit 2024-08-31T08:10:56.898210+0000 mgr.a (mgr.14388) 15553 : audit [DBG] from='client.336771 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:10:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:10:59 smithi163 bash[24253]: cluster 2024-08-31T08:10:58.007618+0000 mgr.a (mgr.14388) 15554 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:10:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:10:59 smithi027 bash[22610]: cluster 2024-08-31T08:10:58.007618+0000 mgr.a (mgr.14388) 15554 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:10:59 smithi191 bash[24992]: cluster 2024-08-31T08:10:58.007618+0000 mgr.a (mgr.14388) 15554 : cluster [DBG] pgmap v10783: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:01 smithi027 bash[22610]: cluster 2024-08-31T08:11:00.009851+0000 mgr.a (mgr.14388) 15555 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:11:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:01 smithi191 bash[24992]: cluster 2024-08-31T08:11:00.009851+0000 mgr.a (mgr.14388) 15555 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:11:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:01 smithi163 bash[24253]: cluster 2024-08-31T08:11:00.009851+0000 mgr.a (mgr.14388) 15555 : cluster [DBG] pgmap v10784: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:11:02.324 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:02.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:02.324 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:11:03.079 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:11:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:11:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:11:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:11:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:11:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:03 smithi027 bash[22610]: cluster 2024-08-31T08:11:02.010631+0000 mgr.a (mgr.14388) 15556 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:03 smithi027 bash[22610]: audit 2024-08-31T08:11:02.654457+0000 mgr.a (mgr.14388) 15557 : audit [DBG] from='client.336849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:03 smithi191 bash[24992]: cluster 2024-08-31T08:11:02.010631+0000 mgr.a (mgr.14388) 15556 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:03 smithi191 bash[24992]: audit 2024-08-31T08:11:02.654457+0000 mgr.a (mgr.14388) 15557 : audit [DBG] from='client.336849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:03 smithi163 bash[24253]: cluster 2024-08-31T08:11:02.010631+0000 mgr.a (mgr.14388) 15556 : cluster [DBG] pgmap v10785: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:04.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:03 smithi163 bash[24253]: audit 2024-08-31T08:11:02.654457+0000 mgr.a (mgr.14388) 15557 : audit [DBG] from='client.336849 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:05 smithi027 bash[22610]: cluster 2024-08-31T08:11:04.012937+0000 mgr.a (mgr.14388) 15558 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:11:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:05 smithi191 bash[24992]: cluster 2024-08-31T08:11:04.012937+0000 mgr.a (mgr.14388) 15558 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:11:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:05 smithi163 bash[24253]: cluster 2024-08-31T08:11:04.012937+0000 mgr.a (mgr.14388) 15558 : cluster [DBG] pgmap v10786: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:11:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:07 smithi027 bash[22610]: cluster 2024-08-31T08:11:06.013729+0000 mgr.a (mgr.14388) 15559 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:11:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:07 smithi191 bash[24992]: cluster 2024-08-31T08:11:06.013729+0000 mgr.a (mgr.14388) 15559 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:11:08.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:08.081 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:08.081 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:11:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:07 smithi163 bash[24253]: cluster 2024-08-31T08:11:06.013729+0000 mgr.a (mgr.14388) 15559 : cluster [DBG] pgmap v10787: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:11:08.828 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:11:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:11:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:11:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:11:08.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:11:08.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:08 smithi027 bash[22610]: audit 2024-08-31T08:11:08.345879+0000 mon.a (mon.0) 2896 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:11:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:08 smithi191 bash[24992]: audit 2024-08-31T08:11:08.345879+0000 mon.a (mon.0) 2896 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:11:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:08 smithi163 bash[24253]: audit 2024-08-31T08:11:08.345879+0000 mon.a (mon.0) 2896 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:11:09.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:11:09 smithi027 bash[22863]: debug 2024-08-31T08:11:09.963+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:11:09.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:11:09 smithi027 bash[22863]: debug 2024-08-31T08:11:09.963+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:11:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:09 smithi027 bash[22610]: cluster 2024-08-31T08:11:08.014895+0000 mgr.a (mgr.14388) 15560 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:09 smithi027 bash[22610]: audit 2024-08-31T08:11:08.412958+0000 mgr.a (mgr.14388) 15561 : audit [DBG] from='client.336927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:09 smithi027 bash[22610]: audit 2024-08-31T08:11:09.205068+0000 mon.a (mon.0) 2897 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:11:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:09 smithi027 bash[22610]: audit 2024-08-31T08:11:09.207075+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:11:09.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:09 smithi027 bash[22610]: audit 2024-08-31T08:11:09.217797+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:11:09.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:09 smithi027 bash[22610]: audit 2024-08-31T08:11:09.221669+0000 mon.a (mon.0) 2900 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:11:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:09 smithi191 bash[24992]: cluster 2024-08-31T08:11:08.014895+0000 mgr.a (mgr.14388) 15560 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:09 smithi191 bash[24992]: audit 2024-08-31T08:11:08.412958+0000 mgr.a (mgr.14388) 15561 : audit [DBG] from='client.336927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:09 smithi191 bash[24992]: audit 2024-08-31T08:11:09.205068+0000 mon.a (mon.0) 2897 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:11:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:09 smithi191 bash[24992]: audit 2024-08-31T08:11:09.207075+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:11:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:09 smithi191 bash[24992]: audit 2024-08-31T08:11:09.217797+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:11:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:09 smithi191 bash[24992]: audit 2024-08-31T08:11:09.221669+0000 mon.a (mon.0) 2900 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:11:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:09 smithi163 bash[24253]: cluster 2024-08-31T08:11:08.014895+0000 mgr.a (mgr.14388) 15560 : cluster [DBG] pgmap v10788: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:09 smithi163 bash[24253]: audit 2024-08-31T08:11:08.412958+0000 mgr.a (mgr.14388) 15561 : audit [DBG] from='client.336927 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:09 smithi163 bash[24253]: audit 2024-08-31T08:11:09.205068+0000 mon.a (mon.0) 2897 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:11:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:09 smithi163 bash[24253]: audit 2024-08-31T08:11:09.207075+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:11:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:09 smithi163 bash[24253]: audit 2024-08-31T08:11:09.217797+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:11:10.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:09 smithi163 bash[24253]: audit 2024-08-31T08:11:09.221669+0000 mon.a (mon.0) 2900 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:11:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:10 smithi027 bash[22610]: audit 2024-08-31T08:11:09.224496+0000 mgr.a (mgr.14388) 15562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:11:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:10 smithi191 bash[24992]: audit 2024-08-31T08:11:09.224496+0000 mgr.a (mgr.14388) 15562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:11:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:10 smithi163 bash[24253]: audit 2024-08-31T08:11:09.224496+0000 mgr.a (mgr.14388) 15562 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:11:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:11 smithi191 bash[24992]: audit 2024-08-31T08:11:09.968643+0000 mgr.a (mgr.14388) 15563 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:11:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:11 smithi191 bash[24992]: cephadm 2024-08-31T08:11:09.969763+0000 mgr.a (mgr.14388) 15564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:11:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:11 smithi191 bash[24992]: cluster 2024-08-31T08:11:10.016480+0000 mgr.a (mgr.14388) 15565 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:11 smithi163 bash[24253]: audit 2024-08-31T08:11:09.968643+0000 mgr.a (mgr.14388) 15563 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:11:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:11 smithi163 bash[24253]: cephadm 2024-08-31T08:11:09.969763+0000 mgr.a (mgr.14388) 15564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:11:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:11 smithi163 bash[24253]: cluster 2024-08-31T08:11:10.016480+0000 mgr.a (mgr.14388) 15565 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:11 smithi027 bash[22610]: audit 2024-08-31T08:11:09.968643+0000 mgr.a (mgr.14388) 15563 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:11:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:11 smithi027 bash[22610]: cephadm 2024-08-31T08:11:09.969763+0000 mgr.a (mgr.14388) 15564 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:11:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:11 smithi027 bash[22610]: cluster 2024-08-31T08:11:10.016480+0000 mgr.a (mgr.14388) 15565 : cluster [DBG] pgmap v10789: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:12 smithi163 bash[24253]: cluster 2024-08-31T08:11:12.017197+0000 mgr.a (mgr.14388) 15566 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:11:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:12 smithi027 bash[22610]: cluster 2024-08-31T08:11:12.017197+0000 mgr.a (mgr.14388) 15566 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:11:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:12 smithi191 bash[24992]: cluster 2024-08-31T08:11:12.017197+0000 mgr.a (mgr.14388) 15566 : cluster [DBG] pgmap v10790: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:11:13.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:13.831 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:13.831 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:11:14.590 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:11:14.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:11:14.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:11:14.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:11:14.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:11:15.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:15 smithi163 bash[24253]: cluster 2024-08-31T08:11:14.019128+0000 mgr.a (mgr.14388) 15567 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:15.453 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:15 smithi163 bash[24253]: audit 2024-08-31T08:11:14.163123+0000 mgr.a (mgr.14388) 15568 : audit [DBG] from='client.337110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:15 smithi027 bash[22610]: cluster 2024-08-31T08:11:14.019128+0000 mgr.a (mgr.14388) 15567 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:15 smithi027 bash[22610]: audit 2024-08-31T08:11:14.163123+0000 mgr.a (mgr.14388) 15568 : audit [DBG] from='client.337110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:15 smithi191 bash[24992]: cluster 2024-08-31T08:11:14.019128+0000 mgr.a (mgr.14388) 15567 : cluster [DBG] pgmap v10791: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:15 smithi191 bash[24992]: audit 2024-08-31T08:11:14.163123+0000 mgr.a (mgr.14388) 15568 : audit [DBG] from='client.337110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:17.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:17 smithi163 bash[24253]: cluster 2024-08-31T08:11:16.019922+0000 mgr.a (mgr.14388) 15569 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:11:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:17 smithi027 bash[22610]: cluster 2024-08-31T08:11:16.019922+0000 mgr.a (mgr.14388) 15569 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:11:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:17 smithi191 bash[24992]: cluster 2024-08-31T08:11:16.019922+0000 mgr.a (mgr.14388) 15569 : cluster [DBG] pgmap v10792: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:11:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:19 smithi163 bash[24253]: cluster 2024-08-31T08:11:18.021563+0000 mgr.a (mgr.14388) 15570 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:11:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:19 smithi027 bash[22610]: cluster 2024-08-31T08:11:18.021563+0000 mgr.a (mgr.14388) 15570 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:11:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:19 smithi191 bash[24992]: cluster 2024-08-31T08:11:18.021563+0000 mgr.a (mgr.14388) 15570 : cluster [DBG] pgmap v10793: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.8 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:11:19.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:19.592 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:19.592 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:11:20.343 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:11:20.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:11:20.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:11:20.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:11:20.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:11:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:21 smithi163 bash[24253]: audit 2024-08-31T08:11:19.914444+0000 mgr.a (mgr.14388) 15571 : audit [DBG] from='client.337182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:21 smithi163 bash[24253]: cluster 2024-08-31T08:11:20.022396+0000 mgr.a (mgr.14388) 15572 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:21 smithi027 bash[22610]: audit 2024-08-31T08:11:19.914444+0000 mgr.a (mgr.14388) 15571 : audit [DBG] from='client.337182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:21 smithi027 bash[22610]: cluster 2024-08-31T08:11:20.022396+0000 mgr.a (mgr.14388) 15572 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:21 smithi191 bash[24992]: audit 2024-08-31T08:11:19.914444+0000 mgr.a (mgr.14388) 15571 : audit [DBG] from='client.337182 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:21 smithi191 bash[24992]: cluster 2024-08-31T08:11:20.022396+0000 mgr.a (mgr.14388) 15572 : cluster [DBG] pgmap v10794: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:23 smithi163 bash[24253]: cluster 2024-08-31T08:11:22.023524+0000 mgr.a (mgr.14388) 15573 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:23 smithi027 bash[22610]: cluster 2024-08-31T08:11:22.023524+0000 mgr.a (mgr.14388) 15573 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:23 smithi191 bash[24992]: cluster 2024-08-31T08:11:22.023524+0000 mgr.a (mgr.14388) 15573 : cluster [DBG] pgmap v10795: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:25.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:25.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:25.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:11:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:25 smithi163 bash[24253]: cluster 2024-08-31T08:11:24.026087+0000 mgr.a (mgr.14388) 15574 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:25 smithi027 bash[22610]: cluster 2024-08-31T08:11:24.026087+0000 mgr.a (mgr.14388) 15574 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:25 smithi191 bash[24992]: cluster 2024-08-31T08:11:24.026087+0000 mgr.a (mgr.14388) 15574 : cluster [DBG] pgmap v10796: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:11:26.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:11:26.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:11:26.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:11:26.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:11:26.108 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:11:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:26 smithi163 bash[24253]: audit 2024-08-31T08:11:25.675045+0000 mgr.a (mgr.14388) 15575 : audit [DBG] from='client.337257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:26 smithi027 bash[22610]: audit 2024-08-31T08:11:25.675045+0000 mgr.a (mgr.14388) 15575 : audit [DBG] from='client.337257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:26 smithi191 bash[24992]: audit 2024-08-31T08:11:25.675045+0000 mgr.a (mgr.14388) 15575 : audit [DBG] from='client.337257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:27 smithi163 bash[24253]: cluster 2024-08-31T08:11:26.026671+0000 mgr.a (mgr.14388) 15576 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:27 smithi027 bash[22610]: cluster 2024-08-31T08:11:26.026671+0000 mgr.a (mgr.14388) 15576 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:27 smithi191 bash[24992]: cluster 2024-08-31T08:11:26.026671+0000 mgr.a (mgr.14388) 15576 : cluster [DBG] pgmap v10797: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:29 smithi163 bash[24253]: cluster 2024-08-31T08:11:28.028481+0000 mgr.a (mgr.14388) 15577 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:11:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:29 smithi027 bash[22610]: cluster 2024-08-31T08:11:28.028481+0000 mgr.a (mgr.14388) 15577 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:11:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:29 smithi191 bash[24992]: cluster 2024-08-31T08:11:28.028481+0000 mgr.a (mgr.14388) 15577 : cluster [DBG] pgmap v10798: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:11:31.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:31.110 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:31.110 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:11:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:31 smithi163 bash[24253]: cluster 2024-08-31T08:11:30.029907+0000 mgr.a (mgr.14388) 15578 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:11:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:31 smithi027 bash[22610]: cluster 2024-08-31T08:11:30.029907+0000 mgr.a (mgr.14388) 15578 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:11:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:31 smithi191 bash[24992]: cluster 2024-08-31T08:11:30.029907+0000 mgr.a (mgr.14388) 15578 : cluster [DBG] pgmap v10799: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:11:31.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:11:31.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:11:31.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:11:31.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:11:31.897 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:11:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:32 smithi163 bash[24253]: audit 2024-08-31T08:11:31.445829+0000 mgr.a (mgr.14388) 15579 : audit [DBG] from='client.337332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:32 smithi027 bash[22610]: audit 2024-08-31T08:11:31.445829+0000 mgr.a (mgr.14388) 15579 : audit [DBG] from='client.337332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:32 smithi191 bash[24992]: audit 2024-08-31T08:11:31.445829+0000 mgr.a (mgr.14388) 15579 : audit [DBG] from='client.337332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:33 smithi163 bash[24253]: cluster 2024-08-31T08:11:32.030911+0000 mgr.a (mgr.14388) 15580 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:33 smithi027 bash[22610]: cluster 2024-08-31T08:11:32.030911+0000 mgr.a (mgr.14388) 15580 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:33 smithi191 bash[24992]: cluster 2024-08-31T08:11:32.030911+0000 mgr.a (mgr.14388) 15580 : cluster [DBG] pgmap v10800: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:35 smithi163 bash[24253]: cluster 2024-08-31T08:11:34.033119+0000 mgr.a (mgr.14388) 15581 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:11:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:35 smithi027 bash[22610]: cluster 2024-08-31T08:11:34.033119+0000 mgr.a (mgr.14388) 15581 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:11:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:35 smithi191 bash[24992]: cluster 2024-08-31T08:11:34.033119+0000 mgr.a (mgr.14388) 15581 : cluster [DBG] pgmap v10801: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:11:36.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:36.899 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:36.899 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:11:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:37 smithi163 bash[24253]: cluster 2024-08-31T08:11:36.033887+0000 mgr.a (mgr.14388) 15582 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:37 smithi027 bash[22610]: cluster 2024-08-31T08:11:36.033887+0000 mgr.a (mgr.14388) 15582 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:37 smithi191 bash[24992]: cluster 2024-08-31T08:11:36.033887+0000 mgr.a (mgr.14388) 15582 : cluster [DBG] pgmap v10802: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:37.649 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:11:37.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:11:37.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:11:37.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:11:37.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:11:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:38 smithi163 bash[24253]: audit 2024-08-31T08:11:37.230444+0000 mgr.a (mgr.14388) 15583 : audit [DBG] from='client.337410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:38 smithi027 bash[22610]: audit 2024-08-31T08:11:37.230444+0000 mgr.a (mgr.14388) 15583 : audit [DBG] from='client.337410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:38 smithi191 bash[24992]: audit 2024-08-31T08:11:37.230444+0000 mgr.a (mgr.14388) 15583 : audit [DBG] from='client.337410 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:39 smithi163 bash[24253]: cluster 2024-08-31T08:11:38.035749+0000 mgr.a (mgr.14388) 15584 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:11:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:39 smithi027 bash[22610]: cluster 2024-08-31T08:11:38.035749+0000 mgr.a (mgr.14388) 15584 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:11:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:39 smithi191 bash[24992]: cluster 2024-08-31T08:11:38.035749+0000 mgr.a (mgr.14388) 15584 : cluster [DBG] pgmap v10803: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:11:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:41 smithi163 bash[24253]: cluster 2024-08-31T08:11:40.037011+0000 mgr.a (mgr.14388) 15585 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:11:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:41 smithi027 bash[22610]: cluster 2024-08-31T08:11:40.037011+0000 mgr.a (mgr.14388) 15585 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:11:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:41 smithi191 bash[24992]: cluster 2024-08-31T08:11:40.037011+0000 mgr.a (mgr.14388) 15585 : cluster [DBG] pgmap v10804: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:11:42.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:42.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:42.652 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:11:43.395 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:11:43.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:11:43.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:11:43.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:11:43.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:11:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:43 smithi163 bash[24253]: cluster 2024-08-31T08:11:42.037808+0000 mgr.a (mgr.14388) 15586 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:43 smithi027 bash[22610]: cluster 2024-08-31T08:11:42.037808+0000 mgr.a (mgr.14388) 15586 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:43 smithi191 bash[24992]: cluster 2024-08-31T08:11:42.037808+0000 mgr.a (mgr.14388) 15586 : cluster [DBG] pgmap v10805: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:44 smithi163 bash[24253]: audit 2024-08-31T08:11:42.982793+0000 mgr.a (mgr.14388) 15587 : audit [DBG] from='client.337488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:44.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:44 smithi027 bash[22610]: audit 2024-08-31T08:11:42.982793+0000 mgr.a (mgr.14388) 15587 : audit [DBG] from='client.337488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:44.547 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:44 smithi191 bash[24992]: audit 2024-08-31T08:11:42.982793+0000 mgr.a (mgr.14388) 15587 : audit [DBG] from='client.337488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:45 smithi163 bash[24253]: cluster 2024-08-31T08:11:44.040684+0000 mgr.a (mgr.14388) 15588 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:11:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:45 smithi027 bash[22610]: cluster 2024-08-31T08:11:44.040684+0000 mgr.a (mgr.14388) 15588 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:11:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:45 smithi191 bash[24992]: cluster 2024-08-31T08:11:44.040684+0000 mgr.a (mgr.14388) 15588 : cluster [DBG] pgmap v10806: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:11:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:47 smithi163 bash[24253]: cluster 2024-08-31T08:11:46.041463+0000 mgr.a (mgr.14388) 15589 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:11:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:47 smithi027 bash[22610]: cluster 2024-08-31T08:11:46.041463+0000 mgr.a (mgr.14388) 15589 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:11:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:47 smithi191 bash[24992]: cluster 2024-08-31T08:11:46.041463+0000 mgr.a (mgr.14388) 15589 : cluster [DBG] pgmap v10807: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:11:48.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:48.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:48.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:11:49.172 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:11:49.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:11:49.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:11:49.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:11:49.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:11:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:49 smithi163 bash[24253]: cluster 2024-08-31T08:11:48.042998+0000 mgr.a (mgr.14388) 15590 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:11:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:49 smithi163 bash[24253]: audit 2024-08-31T08:11:48.731047+0000 mgr.a (mgr.14388) 15591 : audit [DBG] from='client.337566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:49 smithi027 bash[22610]: cluster 2024-08-31T08:11:48.042998+0000 mgr.a (mgr.14388) 15590 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:11:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:49 smithi027 bash[22610]: audit 2024-08-31T08:11:48.731047+0000 mgr.a (mgr.14388) 15591 : audit [DBG] from='client.337566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:49 smithi191 bash[24992]: cluster 2024-08-31T08:11:48.042998+0000 mgr.a (mgr.14388) 15590 : cluster [DBG] pgmap v10808: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:11:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:49 smithi191 bash[24992]: audit 2024-08-31T08:11:48.731047+0000 mgr.a (mgr.14388) 15591 : audit [DBG] from='client.337566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:51 smithi163 bash[24253]: cluster 2024-08-31T08:11:50.044888+0000 mgr.a (mgr.14388) 15592 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:11:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:51 smithi027 bash[22610]: cluster 2024-08-31T08:11:50.044888+0000 mgr.a (mgr.14388) 15592 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:11:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:51 smithi191 bash[24992]: cluster 2024-08-31T08:11:50.044888+0000 mgr.a (mgr.14388) 15592 : cluster [DBG] pgmap v10809: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:11:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:53 smithi163 bash[24253]: cluster 2024-08-31T08:11:52.045730+0000 mgr.a (mgr.14388) 15593 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:11:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:53 smithi027 bash[22610]: cluster 2024-08-31T08:11:52.045730+0000 mgr.a (mgr.14388) 15593 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:11:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:53 smithi191 bash[24992]: cluster 2024-08-31T08:11:52.045730+0000 mgr.a (mgr.14388) 15593 : cluster [DBG] pgmap v10810: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:11:54.174 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:54.175 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:54.175 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:11:54.958 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:11:54.959 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:11:54.959 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:11:54.959 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:11:54.959 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:11:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:55 smithi163 bash[24253]: cluster 2024-08-31T08:11:54.047832+0000 mgr.a (mgr.14388) 15594 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:55 smithi163 bash[24253]: audit 2024-08-31T08:11:54.513936+0000 mgr.a (mgr.14388) 15595 : audit [DBG] from='client.337644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:55 smithi027 bash[22610]: cluster 2024-08-31T08:11:54.047832+0000 mgr.a (mgr.14388) 15594 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:55 smithi027 bash[22610]: audit 2024-08-31T08:11:54.513936+0000 mgr.a (mgr.14388) 15595 : audit [DBG] from='client.337644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:55 smithi191 bash[24992]: cluster 2024-08-31T08:11:54.047832+0000 mgr.a (mgr.14388) 15594 : cluster [DBG] pgmap v10811: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:11:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:55 smithi191 bash[24992]: audit 2024-08-31T08:11:54.513936+0000 mgr.a (mgr.14388) 15595 : audit [DBG] from='client.337644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:11:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:57 smithi163 bash[24253]: cluster 2024-08-31T08:11:56.048780+0000 mgr.a (mgr.14388) 15596 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:11:57.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:57 smithi027 bash[22610]: cluster 2024-08-31T08:11:56.048780+0000 mgr.a (mgr.14388) 15596 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:11:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:57 smithi191 bash[24992]: cluster 2024-08-31T08:11:56.048780+0000 mgr.a (mgr.14388) 15596 : cluster [DBG] pgmap v10812: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:11:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:11:59 smithi027 bash[22610]: cluster 2024-08-31T08:11:58.050932+0000 mgr.a (mgr.14388) 15597 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:11:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:11:59 smithi191 bash[24992]: cluster 2024-08-31T08:11:58.050932+0000 mgr.a (mgr.14388) 15597 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:11:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:11:59 smithi163 bash[24253]: cluster 2024-08-31T08:11:58.050932+0000 mgr.a (mgr.14388) 15597 : cluster [DBG] pgmap v10813: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:11:59.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:11:59.960 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:11:59.961 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:00.728 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:00.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:00.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:00.728 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:00.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:01 smithi027 bash[22610]: cluster 2024-08-31T08:12:00.051452+0000 mgr.a (mgr.14388) 15598 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T08:12:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:01 smithi027 bash[22610]: audit 2024-08-31T08:12:00.296380+0000 mgr.a (mgr.14388) 15599 : audit [DBG] from='client.337719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:01 smithi191 bash[24992]: cluster 2024-08-31T08:12:00.051452+0000 mgr.a (mgr.14388) 15598 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T08:12:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:01 smithi191 bash[24992]: audit 2024-08-31T08:12:00.296380+0000 mgr.a (mgr.14388) 15599 : audit [DBG] from='client.337719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:01 smithi163 bash[24253]: cluster 2024-08-31T08:12:00.051452+0000 mgr.a (mgr.14388) 15598 : cluster [DBG] pgmap v10814: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T08:12:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:01 smithi163 bash[24253]: audit 2024-08-31T08:12:00.296380+0000 mgr.a (mgr.14388) 15599 : audit [DBG] from='client.337719 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:03 smithi027 bash[22610]: cluster 2024-08-31T08:12:02.052548+0000 mgr.a (mgr.14388) 15600 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:03 smithi191 bash[24992]: cluster 2024-08-31T08:12:02.052548+0000 mgr.a (mgr.14388) 15600 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:03 smithi163 bash[24253]: cluster 2024-08-31T08:12:02.052548+0000 mgr.a (mgr.14388) 15600 : cluster [DBG] pgmap v10815: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:05 smithi027 bash[22610]: cluster 2024-08-31T08:12:04.054879+0000 mgr.a (mgr.14388) 15601 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:12:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:05 smithi191 bash[24992]: cluster 2024-08-31T08:12:04.054879+0000 mgr.a (mgr.14388) 15601 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:12:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:05 smithi163 bash[24253]: cluster 2024-08-31T08:12:04.054879+0000 mgr.a (mgr.14388) 15601 : cluster [DBG] pgmap v10816: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:12:05.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:12:05.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:12:05.730 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:06.462 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:06.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:06.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:06.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:06.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:07 smithi027 bash[22610]: audit 2024-08-31T08:12:06.050928+0000 mgr.a (mgr.14388) 15602 : audit [DBG] from='client.337791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:07.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:07 smithi027 bash[22610]: cluster 2024-08-31T08:12:06.063125+0000 mgr.a (mgr.14388) 15603 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:07 smithi191 bash[24992]: audit 2024-08-31T08:12:06.050928+0000 mgr.a (mgr.14388) 15602 : audit [DBG] from='client.337791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:07 smithi191 bash[24992]: cluster 2024-08-31T08:12:06.063125+0000 mgr.a (mgr.14388) 15603 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:07 smithi163 bash[24253]: audit 2024-08-31T08:12:06.050928+0000 mgr.a (mgr.14388) 15602 : audit [DBG] from='client.337791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:07 smithi163 bash[24253]: cluster 2024-08-31T08:12:06.063125+0000 mgr.a (mgr.14388) 15603 : cluster [DBG] pgmap v10817: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:09.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:09 smithi027 bash[22610]: cluster 2024-08-31T08:12:08.065299+0000 mgr.a (mgr.14388) 15604 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:12:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:09 smithi191 bash[24992]: cluster 2024-08-31T08:12:08.065299+0000 mgr.a (mgr.14388) 15604 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:12:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:09 smithi163 bash[24253]: cluster 2024-08-31T08:12:08.065299+0000 mgr.a (mgr.14388) 15604 : cluster [DBG] pgmap v10818: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:12:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:10 smithi027 bash[22610]: audit 2024-08-31T08:12:10.021383+0000 mon.a (mon.0) 2901 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:12:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:10 smithi191 bash[24992]: audit 2024-08-31T08:12:10.021383+0000 mon.a (mon.0) 2901 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:12:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:10 smithi163 bash[24253]: audit 2024-08-31T08:12:10.021383+0000 mon.a (mon.0) 2901 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:12:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:12:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:12:11.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:11 smithi191 bash[24992]: cluster 2024-08-31T08:12:10.066191+0000 mgr.a (mgr.14388) 15605 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:11 smithi191 bash[24992]: audit 2024-08-31T08:12:10.859626+0000 mon.a (mon.0) 2902 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:12:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:11 smithi191 bash[24992]: audit 2024-08-31T08:12:10.861099+0000 mon.a (mon.0) 2903 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:12:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:11 smithi191 bash[24992]: audit 2024-08-31T08:12:10.868539+0000 mon.a (mon.0) 2904 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:12:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:11 smithi191 bash[24992]: audit 2024-08-31T08:12:10.870711+0000 mon.a (mon.0) 2905 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:12:11.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:11 smithi027 bash[22610]: cluster 2024-08-31T08:12:10.066191+0000 mgr.a (mgr.14388) 15605 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:11.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:11 smithi027 bash[22610]: audit 2024-08-31T08:12:10.859626+0000 mon.a (mon.0) 2902 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:12:11.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:11 smithi027 bash[22610]: audit 2024-08-31T08:12:10.861099+0000 mon.a (mon.0) 2903 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:12:11.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:11 smithi027 bash[22610]: audit 2024-08-31T08:12:10.868539+0000 mon.a (mon.0) 2904 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:12:11.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:11 smithi027 bash[22610]: audit 2024-08-31T08:12:10.870711+0000 mon.a (mon.0) 2905 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:12:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:11 smithi163 bash[24253]: cluster 2024-08-31T08:12:10.066191+0000 mgr.a (mgr.14388) 15605 : cluster [DBG] pgmap v10819: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:11 smithi163 bash[24253]: audit 2024-08-31T08:12:10.859626+0000 mon.a (mon.0) 2902 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:12:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:11 smithi163 bash[24253]: audit 2024-08-31T08:12:10.861099+0000 mon.a (mon.0) 2903 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:12:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:11 smithi163 bash[24253]: audit 2024-08-31T08:12:10.868539+0000 mon.a (mon.0) 2904 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:12:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:11 smithi163 bash[24253]: audit 2024-08-31T08:12:10.870711+0000 mon.a (mon.0) 2905 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:12:11.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:12:11 smithi027 bash[22863]: debug 2024-08-31T08:12:11.597+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:12:11.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:12:11 smithi027 bash[22863]: debug 2024-08-31T08:12:11.597+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:12:12.180 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:12.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:12.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:12.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:12.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:12 smithi191 bash[24992]: audit 2024-08-31T08:12:10.872931+0000 mgr.a (mgr.14388) 15606 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:12:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:12 smithi191 bash[24992]: audit 2024-08-31T08:12:11.599820+0000 mgr.a (mgr.14388) 15607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:12:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:12 smithi191 bash[24992]: cephadm 2024-08-31T08:12:11.600968+0000 mgr.a (mgr.14388) 15608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:12:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:12 smithi163 bash[24253]: audit 2024-08-31T08:12:10.872931+0000 mgr.a (mgr.14388) 15606 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:12:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:12 smithi163 bash[24253]: audit 2024-08-31T08:12:11.599820+0000 mgr.a (mgr.14388) 15607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:12:12.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:12 smithi163 bash[24253]: cephadm 2024-08-31T08:12:11.600968+0000 mgr.a (mgr.14388) 15608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:12:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:12 smithi027 bash[22610]: audit 2024-08-31T08:12:10.872931+0000 mgr.a (mgr.14388) 15606 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:12:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:12 smithi027 bash[22610]: audit 2024-08-31T08:12:11.599820+0000 mgr.a (mgr.14388) 15607 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:12:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:12 smithi027 bash[22610]: cephadm 2024-08-31T08:12:11.600968+0000 mgr.a (mgr.14388) 15608 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:12:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:13 smithi191 bash[24992]: audit 2024-08-31T08:12:11.772295+0000 mgr.a (mgr.14388) 15609 : audit [DBG] from='client.337974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:13 smithi191 bash[24992]: cluster 2024-08-31T08:12:12.066875+0000 mgr.a (mgr.14388) 15610 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:13 smithi163 bash[24253]: audit 2024-08-31T08:12:11.772295+0000 mgr.a (mgr.14388) 15609 : audit [DBG] from='client.337974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:13 smithi163 bash[24253]: cluster 2024-08-31T08:12:12.066875+0000 mgr.a (mgr.14388) 15610 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:13 smithi027 bash[22610]: audit 2024-08-31T08:12:11.772295+0000 mgr.a (mgr.14388) 15609 : audit [DBG] from='client.337974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:13 smithi027 bash[22610]: cluster 2024-08-31T08:12:12.066875+0000 mgr.a (mgr.14388) 15610 : cluster [DBG] pgmap v10820: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:15 smithi191 bash[24992]: cluster 2024-08-31T08:12:14.069108+0000 mgr.a (mgr.14388) 15611 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:12:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:15 smithi163 bash[24253]: cluster 2024-08-31T08:12:14.069108+0000 mgr.a (mgr.14388) 15611 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:12:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:15 smithi027 bash[22610]: cluster 2024-08-31T08:12:14.069108+0000 mgr.a (mgr.14388) 15611 : cluster [DBG] pgmap v10821: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:12:17.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:12:17.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:12:17.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:17 smithi191 bash[24992]: cluster 2024-08-31T08:12:16.069886+0000 mgr.a (mgr.14388) 15612 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:12:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:17 smithi163 bash[24253]: cluster 2024-08-31T08:12:16.069886+0000 mgr.a (mgr.14388) 15612 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:12:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:17 smithi027 bash[22610]: cluster 2024-08-31T08:12:16.069886+0000 mgr.a (mgr.14388) 15612 : cluster [DBG] pgmap v10822: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:12:17.932 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:17.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:18 smithi191 bash[24992]: audit 2024-08-31T08:12:17.513082+0000 mgr.a (mgr.14388) 15613 : audit [DBG] from='client.338052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:18 smithi163 bash[24253]: audit 2024-08-31T08:12:17.513082+0000 mgr.a (mgr.14388) 15613 : audit [DBG] from='client.338052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:18 smithi027 bash[22610]: audit 2024-08-31T08:12:17.513082+0000 mgr.a (mgr.14388) 15613 : audit [DBG] from='client.338052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:19 smithi191 bash[24992]: cluster 2024-08-31T08:12:18.072131+0000 mgr.a (mgr.14388) 15614 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:12:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:19 smithi163 bash[24253]: cluster 2024-08-31T08:12:18.072131+0000 mgr.a (mgr.14388) 15614 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:12:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:19 smithi027 bash[22610]: cluster 2024-08-31T08:12:18.072131+0000 mgr.a (mgr.14388) 15614 : cluster [DBG] pgmap v10823: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:12:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:21 smithi191 bash[24992]: cluster 2024-08-31T08:12:20.073068+0000 mgr.a (mgr.14388) 15615 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:12:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:21 smithi163 bash[24253]: cluster 2024-08-31T08:12:20.073068+0000 mgr.a (mgr.14388) 15615 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:12:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:21 smithi027 bash[22610]: cluster 2024-08-31T08:12:20.073068+0000 mgr.a (mgr.14388) 15615 : cluster [DBG] pgmap v10824: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:12:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:12:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:12:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:23 smithi191 bash[24992]: cluster 2024-08-31T08:12:22.074001+0000 mgr.a (mgr.14388) 15616 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:12:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:23 smithi163 bash[24253]: cluster 2024-08-31T08:12:22.074001+0000 mgr.a (mgr.14388) 15616 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:12:23.713 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:23.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:23.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:23.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:23.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:23 smithi027 bash[22610]: cluster 2024-08-31T08:12:22.074001+0000 mgr.a (mgr.14388) 15616 : cluster [DBG] pgmap v10825: 225 pgs: 225 active+clean; 589 KiB data, 160 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:12:24.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:24 smithi191 bash[24992]: audit 2024-08-31T08:12:23.267206+0000 mgr.a (mgr.14388) 15617 : audit [DBG] from='client.338127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:24 smithi163 bash[24253]: audit 2024-08-31T08:12:23.267206+0000 mgr.a (mgr.14388) 15617 : audit [DBG] from='client.338127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:24 smithi027 bash[22610]: audit 2024-08-31T08:12:23.267206+0000 mgr.a (mgr.14388) 15617 : audit [DBG] from='client.338127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:25 smithi191 bash[24992]: cluster 2024-08-31T08:12:24.076947+0000 mgr.a (mgr.14388) 15618 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-08-31T08:12:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:25 smithi163 bash[24253]: cluster 2024-08-31T08:12:24.076947+0000 mgr.a (mgr.14388) 15618 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-08-31T08:12:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:25 smithi027 bash[22610]: cluster 2024-08-31T08:12:24.076947+0000 mgr.a (mgr.14388) 15618 : cluster [DBG] pgmap v10826: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 426 B/s wr, 33 op/s 2024-08-31T08:12:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:27 smithi163 bash[24253]: cluster 2024-08-31T08:12:26.077729+0000 mgr.a (mgr.14388) 15619 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 27 op/s 2024-08-31T08:12:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:27 smithi027 bash[22610]: cluster 2024-08-31T08:12:26.077729+0000 mgr.a (mgr.14388) 15619 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 27 op/s 2024-08-31T08:12:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:27 smithi191 bash[24992]: cluster 2024-08-31T08:12:26.077729+0000 mgr.a (mgr.14388) 15619 : cluster [DBG] pgmap v10827: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 27 op/s 2024-08-31T08:12:28.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:12:28.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:12:28.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:29.472 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:29.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:29.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:29.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:29.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:29 smithi163 bash[24253]: cluster 2024-08-31T08:12:28.079725+0000 mgr.a (mgr.14388) 15620 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T08:12:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:29 smithi027 bash[22610]: cluster 2024-08-31T08:12:28.079725+0000 mgr.a (mgr.14388) 15620 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T08:12:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:29 smithi191 bash[24992]: cluster 2024-08-31T08:12:28.079725+0000 mgr.a (mgr.14388) 15620 : cluster [DBG] pgmap v10828: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T08:12:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:30 smithi163 bash[24253]: audit 2024-08-31T08:12:29.049558+0000 mgr.a (mgr.14388) 15621 : audit [DBG] from='client.338199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:30 smithi027 bash[22610]: audit 2024-08-31T08:12:29.049558+0000 mgr.a (mgr.14388) 15621 : audit [DBG] from='client.338199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:30 smithi191 bash[24992]: audit 2024-08-31T08:12:29.049558+0000 mgr.a (mgr.14388) 15621 : audit [DBG] from='client.338199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:31 smithi163 bash[24253]: cluster 2024-08-31T08:12:30.080704+0000 mgr.a (mgr.14388) 15622 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T08:12:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:31 smithi027 bash[22610]: cluster 2024-08-31T08:12:30.080704+0000 mgr.a (mgr.14388) 15622 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T08:12:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:31 smithi191 bash[24992]: cluster 2024-08-31T08:12:30.080704+0000 mgr.a (mgr.14388) 15622 : cluster [DBG] pgmap v10829: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T08:12:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:33 smithi163 bash[24253]: cluster 2024-08-31T08:12:32.081475+0000 mgr.a (mgr.14388) 15623 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T08:12:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:33 smithi027 bash[22610]: cluster 2024-08-31T08:12:32.081475+0000 mgr.a (mgr.14388) 15623 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T08:12:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:33 smithi191 bash[24992]: cluster 2024-08-31T08:12:32.081475+0000 mgr.a (mgr.14388) 15623 : cluster [DBG] pgmap v10830: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T08:12:34.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:12:34.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:12:34.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:35.260 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:35.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:35.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:35.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:35.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:35 smithi163 bash[24253]: cluster 2024-08-31T08:12:34.083720+0000 mgr.a (mgr.14388) 15624 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T08:12:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:35 smithi027 bash[22610]: cluster 2024-08-31T08:12:34.083720+0000 mgr.a (mgr.14388) 15624 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T08:12:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:35 smithi191 bash[24992]: cluster 2024-08-31T08:12:34.083720+0000 mgr.a (mgr.14388) 15624 : cluster [DBG] pgmap v10831: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T08:12:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:36 smithi163 bash[24253]: audit 2024-08-31T08:12:34.808849+0000 mgr.a (mgr.14388) 15625 : audit [DBG] from='client.338271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:36 smithi027 bash[22610]: audit 2024-08-31T08:12:34.808849+0000 mgr.a (mgr.14388) 15625 : audit [DBG] from='client.338271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:36 smithi191 bash[24992]: audit 2024-08-31T08:12:34.808849+0000 mgr.a (mgr.14388) 15625 : audit [DBG] from='client.338271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:37 smithi163 bash[24253]: cluster 2024-08-31T08:12:36.084711+0000 mgr.a (mgr.14388) 15626 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:12:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:37 smithi027 bash[22610]: cluster 2024-08-31T08:12:36.084711+0000 mgr.a (mgr.14388) 15626 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:12:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:37 smithi191 bash[24992]: cluster 2024-08-31T08:12:36.084711+0000 mgr.a (mgr.14388) 15626 : cluster [DBG] pgmap v10832: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:12:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:39 smithi163 bash[24253]: cluster 2024-08-31T08:12:38.086889+0000 mgr.a (mgr.14388) 15627 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:12:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:39 smithi027 bash[22610]: cluster 2024-08-31T08:12:38.086889+0000 mgr.a (mgr.14388) 15627 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:12:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:39 smithi191 bash[24992]: cluster 2024-08-31T08:12:38.086889+0000 mgr.a (mgr.14388) 15627 : cluster [DBG] pgmap v10833: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:12:40.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:12:40.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:12:40.263 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:41.036 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:41.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:41.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:41.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:41.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:41 smithi163 bash[24253]: cluster 2024-08-31T08:12:40.087649+0000 mgr.a (mgr.14388) 15628 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:41 smithi163 bash[24253]: audit 2024-08-31T08:12:40.598753+0000 mgr.a (mgr.14388) 15629 : audit [DBG] from='client.338349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:41 smithi027 bash[22610]: cluster 2024-08-31T08:12:40.087649+0000 mgr.a (mgr.14388) 15628 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:41 smithi027 bash[22610]: audit 2024-08-31T08:12:40.598753+0000 mgr.a (mgr.14388) 15629 : audit [DBG] from='client.338349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:41 smithi191 bash[24992]: cluster 2024-08-31T08:12:40.087649+0000 mgr.a (mgr.14388) 15628 : cluster [DBG] pgmap v10834: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:41 smithi191 bash[24992]: audit 2024-08-31T08:12:40.598753+0000 mgr.a (mgr.14388) 15629 : audit [DBG] from='client.338349 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:43 smithi163 bash[24253]: cluster 2024-08-31T08:12:42.088643+0000 mgr.a (mgr.14388) 15630 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:43 smithi027 bash[22610]: cluster 2024-08-31T08:12:42.088643+0000 mgr.a (mgr.14388) 15630 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:43 smithi191 bash[24992]: cluster 2024-08-31T08:12:42.088643+0000 mgr.a (mgr.14388) 15630 : cluster [DBG] pgmap v10835: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:45 smithi163 bash[24253]: cluster 2024-08-31T08:12:44.091126+0000 mgr.a (mgr.14388) 15631 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:12:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:45 smithi027 bash[22610]: cluster 2024-08-31T08:12:44.091126+0000 mgr.a (mgr.14388) 15631 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:12:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:45 smithi191 bash[24992]: cluster 2024-08-31T08:12:44.091126+0000 mgr.a (mgr.14388) 15631 : cluster [DBG] pgmap v10836: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:12:46.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:12:46.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:12:46.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:46.820 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:46.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:46.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:46.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:46.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:47 smithi163 bash[24253]: cluster 2024-08-31T08:12:46.091732+0000 mgr.a (mgr.14388) 15632 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:47 smithi163 bash[24253]: audit 2024-08-31T08:12:46.379906+0000 mgr.a (mgr.14388) 15633 : audit [DBG] from='client.338427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:47 smithi027 bash[22610]: cluster 2024-08-31T08:12:46.091732+0000 mgr.a (mgr.14388) 15632 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:47 smithi027 bash[22610]: audit 2024-08-31T08:12:46.379906+0000 mgr.a (mgr.14388) 15633 : audit [DBG] from='client.338427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:47 smithi191 bash[24992]: cluster 2024-08-31T08:12:46.091732+0000 mgr.a (mgr.14388) 15632 : cluster [DBG] pgmap v10837: 225 pgs: 225 active+clean; 589 KiB data, 164 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:12:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:47 smithi191 bash[24992]: audit 2024-08-31T08:12:46.379906+0000 mgr.a (mgr.14388) 15633 : audit [DBG] from='client.338427 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:49 smithi163 bash[24253]: cluster 2024-08-31T08:12:48.093956+0000 mgr.a (mgr.14388) 15634 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:12:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:49 smithi027 bash[22610]: cluster 2024-08-31T08:12:48.093956+0000 mgr.a (mgr.14388) 15634 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:12:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:49 smithi191 bash[24992]: cluster 2024-08-31T08:12:48.093956+0000 mgr.a (mgr.14388) 15634 : cluster [DBG] pgmap v10838: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:12:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:51 smithi163 bash[24253]: cluster 2024-08-31T08:12:50.094760+0000 mgr.a (mgr.14388) 15635 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:51 smithi027 bash[22610]: cluster 2024-08-31T08:12:50.094760+0000 mgr.a (mgr.14388) 15635 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:51 smithi191 bash[24992]: cluster 2024-08-31T08:12:50.094760+0000 mgr.a (mgr.14388) 15635 : cluster [DBG] pgmap v10839: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:51.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:12:51.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:12:51.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:52.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:52.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:52.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:52.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:52.596 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:53 smithi163 bash[24253]: cluster 2024-08-31T08:12:52.095509+0000 mgr.a (mgr.14388) 15636 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:53 smithi163 bash[24253]: audit 2024-08-31T08:12:52.158448+0000 mgr.a (mgr.14388) 15637 : audit [DBG] from='client.338502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:53 smithi027 bash[22610]: cluster 2024-08-31T08:12:52.095509+0000 mgr.a (mgr.14388) 15636 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:53 smithi027 bash[22610]: audit 2024-08-31T08:12:52.158448+0000 mgr.a (mgr.14388) 15637 : audit [DBG] from='client.338502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:53 smithi191 bash[24992]: cluster 2024-08-31T08:12:52.095509+0000 mgr.a (mgr.14388) 15636 : cluster [DBG] pgmap v10840: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:53 smithi191 bash[24992]: audit 2024-08-31T08:12:52.158448+0000 mgr.a (mgr.14388) 15637 : audit [DBG] from='client.338502 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:55 smithi163 bash[24253]: cluster 2024-08-31T08:12:54.097814+0000 mgr.a (mgr.14388) 15638 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:12:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:55 smithi027 bash[22610]: cluster 2024-08-31T08:12:54.097814+0000 mgr.a (mgr.14388) 15638 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:12:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:55 smithi191 bash[24992]: cluster 2024-08-31T08:12:54.097814+0000 mgr.a (mgr.14388) 15638 : cluster [DBG] pgmap v10841: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:12:57.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:12:57.598 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:12:57.598 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:12:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:57 smithi163 bash[24253]: cluster 2024-08-31T08:12:56.098631+0000 mgr.a (mgr.14388) 15639 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:57 smithi027 bash[22610]: cluster 2024-08-31T08:12:56.098631+0000 mgr.a (mgr.14388) 15639 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:57 smithi191 bash[24992]: cluster 2024-08-31T08:12:56.098631+0000 mgr.a (mgr.14388) 15639 : cluster [DBG] pgmap v10842: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:58.349 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:12:58.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:12:58.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:12:58.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:12:58.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:12:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:59 smithi163 bash[24253]: audit 2024-08-31T08:12:57.929714+0000 mgr.a (mgr.14388) 15640 : audit [DBG] from='client.338580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:12:59 smithi163 bash[24253]: cluster 2024-08-31T08:12:58.101711+0000 mgr.a (mgr.14388) 15641 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:59 smithi027 bash[22610]: audit 2024-08-31T08:12:57.929714+0000 mgr.a (mgr.14388) 15640 : audit [DBG] from='client.338580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:12:59 smithi027 bash[22610]: cluster 2024-08-31T08:12:58.101711+0000 mgr.a (mgr.14388) 15641 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:12:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:59 smithi191 bash[24992]: audit 2024-08-31T08:12:57.929714+0000 mgr.a (mgr.14388) 15640 : audit [DBG] from='client.338580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:12:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:12:59 smithi191 bash[24992]: cluster 2024-08-31T08:12:58.101711+0000 mgr.a (mgr.14388) 15641 : cluster [DBG] pgmap v10843: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:13:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:01 smithi163 bash[24253]: cluster 2024-08-31T08:13:00.102441+0000 mgr.a (mgr.14388) 15642 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:13:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:01 smithi027 bash[22610]: cluster 2024-08-31T08:13:00.102441+0000 mgr.a (mgr.14388) 15642 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:13:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:01 smithi191 bash[24992]: cluster 2024-08-31T08:13:00.102441+0000 mgr.a (mgr.14388) 15642 : cluster [DBG] pgmap v10844: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:13:03.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:13:03.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:13:03.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:13:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:03 smithi163 bash[24253]: cluster 2024-08-31T08:13:02.103246+0000 mgr.a (mgr.14388) 15643 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:13:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:03 smithi027 bash[22610]: cluster 2024-08-31T08:13:02.103246+0000 mgr.a (mgr.14388) 15643 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:13:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:03 smithi191 bash[24992]: cluster 2024-08-31T08:13:02.103246+0000 mgr.a (mgr.14388) 15643 : cluster [DBG] pgmap v10845: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:13:04.097 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:13:04.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:13:04.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:13:04.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:13:04.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:13:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:04 smithi163 bash[24253]: audit 2024-08-31T08:13:03.685486+0000 mgr.a (mgr.14388) 15644 : audit [DBG] from='client.338655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:04 smithi027 bash[22610]: audit 2024-08-31T08:13:03.685486+0000 mgr.a (mgr.14388) 15644 : audit [DBG] from='client.338655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:04 smithi191 bash[24992]: audit 2024-08-31T08:13:03.685486+0000 mgr.a (mgr.14388) 15644 : audit [DBG] from='client.338655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:05 smithi163 bash[24253]: cluster 2024-08-31T08:13:04.104617+0000 mgr.a (mgr.14388) 15645 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:05 smithi027 bash[22610]: cluster 2024-08-31T08:13:04.104617+0000 mgr.a (mgr.14388) 15645 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:05 smithi191 bash[24992]: cluster 2024-08-31T08:13:04.104617+0000 mgr.a (mgr.14388) 15645 : cluster [DBG] pgmap v10846: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:07 smithi163 bash[24253]: cluster 2024-08-31T08:13:06.105371+0000 mgr.a (mgr.14388) 15646 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:13:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:07 smithi027 bash[22610]: cluster 2024-08-31T08:13:06.105371+0000 mgr.a (mgr.14388) 15646 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:13:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:07 smithi191 bash[24992]: cluster 2024-08-31T08:13:06.105371+0000 mgr.a (mgr.14388) 15646 : cluster [DBG] pgmap v10847: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:13:09.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:13:09.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:13:09.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:13:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:09 smithi163 bash[24253]: cluster 2024-08-31T08:13:08.107328+0000 mgr.a (mgr.14388) 15647 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:09 smithi027 bash[22610]: cluster 2024-08-31T08:13:08.107328+0000 mgr.a (mgr.14388) 15647 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:09 smithi191 bash[24992]: cluster 2024-08-31T08:13:08.107328+0000 mgr.a (mgr.14388) 15647 : cluster [DBG] pgmap v10848: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:09.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:13:09.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:13:09.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:13:09.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:13:09.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:13:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:10 smithi163 bash[24253]: audit 2024-08-31T08:13:09.434920+0000 mgr.a (mgr.14388) 15648 : audit [DBG] from='client.338730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:10 smithi027 bash[22610]: audit 2024-08-31T08:13:09.434920+0000 mgr.a (mgr.14388) 15648 : audit [DBG] from='client.338730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:10 smithi191 bash[24992]: audit 2024-08-31T08:13:09.434920+0000 mgr.a (mgr.14388) 15648 : audit [DBG] from='client.338730 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:11 smithi163 bash[24253]: cluster 2024-08-31T08:13:10.108236+0000 mgr.a (mgr.14388) 15649 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:11 smithi027 bash[22610]: cluster 2024-08-31T08:13:10.108236+0000 mgr.a (mgr.14388) 15649 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:11 smithi191 bash[24992]: cluster 2024-08-31T08:13:10.108236+0000 mgr.a (mgr.14388) 15649 : cluster [DBG] pgmap v10849: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:12 smithi163 bash[24253]: audit 2024-08-31T08:13:11.650697+0000 mon.a (mon.0) 2906 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:13:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:12 smithi163 bash[24253]: audit 2024-08-31T08:13:12.272651+0000 mon.a (mon.0) 2907 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:13:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:12 smithi163 bash[24253]: audit 2024-08-31T08:13:12.278358+0000 mon.a (mon.0) 2908 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:13:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:12 smithi027 bash[22610]: audit 2024-08-31T08:13:11.650697+0000 mon.a (mon.0) 2906 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:13:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:12 smithi027 bash[22610]: audit 2024-08-31T08:13:12.272651+0000 mon.a (mon.0) 2907 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:13:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:12 smithi027 bash[22610]: audit 2024-08-31T08:13:12.278358+0000 mon.a (mon.0) 2908 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:13:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:12 smithi191 bash[24992]: audit 2024-08-31T08:13:11.650697+0000 mon.a (mon.0) 2906 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:13:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:12 smithi191 bash[24992]: audit 2024-08-31T08:13:12.272651+0000 mon.a (mon.0) 2907 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:13:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:12 smithi191 bash[24992]: audit 2024-08-31T08:13:12.278358+0000 mon.a (mon.0) 2908 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:13:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:13 smithi163 bash[24253]: cluster 2024-08-31T08:13:12.108982+0000 mgr.a (mgr.14388) 15650 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:13 smithi163 bash[24253]: audit 2024-08-31T08:13:13.066869+0000 mon.a (mon.0) 2909 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:13:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:13 smithi163 bash[24253]: audit 2024-08-31T08:13:13.068443+0000 mon.a (mon.0) 2910 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:13:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:13 smithi163 bash[24253]: audit 2024-08-31T08:13:13.076107+0000 mon.a (mon.0) 2911 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:13:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:13 smithi163 bash[24253]: audit 2024-08-31T08:13:13.078878+0000 mon.a (mon.0) 2912 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:13:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:13 smithi027 bash[22610]: cluster 2024-08-31T08:13:12.108982+0000 mgr.a (mgr.14388) 15650 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:13 smithi027 bash[22610]: audit 2024-08-31T08:13:13.066869+0000 mon.a (mon.0) 2909 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:13:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:13 smithi027 bash[22610]: audit 2024-08-31T08:13:13.068443+0000 mon.a (mon.0) 2910 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:13:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:13 smithi027 bash[22610]: audit 2024-08-31T08:13:13.076107+0000 mon.a (mon.0) 2911 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:13:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:13 smithi027 bash[22610]: audit 2024-08-31T08:13:13.078878+0000 mon.a (mon.0) 2912 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:13:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:13 smithi191 bash[24992]: cluster 2024-08-31T08:13:12.108982+0000 mgr.a (mgr.14388) 15650 : cluster [DBG] pgmap v10850: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:13 smithi191 bash[24992]: audit 2024-08-31T08:13:13.066869+0000 mon.a (mon.0) 2909 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:13:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:13 smithi191 bash[24992]: audit 2024-08-31T08:13:13.068443+0000 mon.a (mon.0) 2910 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:13:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:13 smithi191 bash[24992]: audit 2024-08-31T08:13:13.076107+0000 mon.a (mon.0) 2911 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:13:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:13 smithi191 bash[24992]: audit 2024-08-31T08:13:13.078878+0000 mon.a (mon.0) 2912 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:13:14.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:13:13 smithi027 bash[22863]: debug 2024-08-31T08:13:13.804+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:13:14.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:13:13 smithi027 bash[22863]: debug 2024-08-31T08:13:13.808+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:13:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:14 smithi163 bash[24253]: audit 2024-08-31T08:13:13.081068+0000 mgr.a (mgr.14388) 15651 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:13:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:14 smithi027 bash[22610]: audit 2024-08-31T08:13:13.081068+0000 mgr.a (mgr.14388) 15651 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:13:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:14 smithi191 bash[24992]: audit 2024-08-31T08:13:13.081068+0000 mgr.a (mgr.14388) 15651 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:13:14.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:13:14.876 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:13:14.876 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:13:15.640 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:13:15.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:13:15.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:13:15.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:13:15.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:13:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:15 smithi163 bash[24253]: audit 2024-08-31T08:13:13.810332+0000 mgr.a (mgr.14388) 15652 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:13:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:15 smithi163 bash[24253]: cephadm 2024-08-31T08:13:13.811810+0000 mgr.a (mgr.14388) 15653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:13:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:15 smithi163 bash[24253]: cluster 2024-08-31T08:13:14.111785+0000 mgr.a (mgr.14388) 15654 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:13:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:15 smithi027 bash[22610]: audit 2024-08-31T08:13:13.810332+0000 mgr.a (mgr.14388) 15652 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:13:15.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:15 smithi027 bash[22610]: cephadm 2024-08-31T08:13:13.811810+0000 mgr.a (mgr.14388) 15653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:13:15.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:15 smithi027 bash[22610]: cluster 2024-08-31T08:13:14.111785+0000 mgr.a (mgr.14388) 15654 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:13:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:15 smithi191 bash[24992]: audit 2024-08-31T08:13:13.810332+0000 mgr.a (mgr.14388) 15652 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:13:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:15 smithi191 bash[24992]: cephadm 2024-08-31T08:13:13.811810+0000 mgr.a (mgr.14388) 15653 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:13:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:15 smithi191 bash[24992]: cluster 2024-08-31T08:13:14.111785+0000 mgr.a (mgr.14388) 15654 : cluster [DBG] pgmap v10851: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:13:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:16 smithi163 bash[24253]: audit 2024-08-31T08:13:15.213150+0000 mgr.a (mgr.14388) 15655 : audit [DBG] from='client.338913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:16 smithi027 bash[22610]: audit 2024-08-31T08:13:15.213150+0000 mgr.a (mgr.14388) 15655 : audit [DBG] from='client.338913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:16 smithi191 bash[24992]: audit 2024-08-31T08:13:15.213150+0000 mgr.a (mgr.14388) 15655 : audit [DBG] from='client.338913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:17 smithi163 bash[24253]: cluster 2024-08-31T08:13:16.112913+0000 mgr.a (mgr.14388) 15656 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:17 smithi027 bash[22610]: cluster 2024-08-31T08:13:16.112913+0000 mgr.a (mgr.14388) 15656 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:17 smithi191 bash[24992]: cluster 2024-08-31T08:13:16.112913+0000 mgr.a (mgr.14388) 15656 : cluster [DBG] pgmap v10852: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:19 smithi027 bash[22610]: cluster 2024-08-31T08:13:18.115255+0000 mgr.a (mgr.14388) 15657 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:19 smithi191 bash[24992]: cluster 2024-08-31T08:13:18.115255+0000 mgr.a (mgr.14388) 15657 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:19 smithi163 bash[24253]: cluster 2024-08-31T08:13:18.115255+0000 mgr.a (mgr.14388) 15657 : cluster [DBG] pgmap v10853: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:20.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:13:20.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:13:20.642 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:13:21.385 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:13:21.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:13:21.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:13:21.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:13:21.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:13:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:21 smithi027 bash[22610]: cluster 2024-08-31T08:13:20.116067+0000 mgr.a (mgr.14388) 15658 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:21 smithi191 bash[24992]: cluster 2024-08-31T08:13:20.116067+0000 mgr.a (mgr.14388) 15658 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:21 smithi163 bash[24253]: cluster 2024-08-31T08:13:20.116067+0000 mgr.a (mgr.14388) 15658 : cluster [DBG] pgmap v10854: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:22 smithi027 bash[22610]: audit 2024-08-31T08:13:20.969887+0000 mgr.a (mgr.14388) 15659 : audit [DBG] from='client.338991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:22 smithi191 bash[24992]: audit 2024-08-31T08:13:20.969887+0000 mgr.a (mgr.14388) 15659 : audit [DBG] from='client.338991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:22 smithi163 bash[24253]: audit 2024-08-31T08:13:20.969887+0000 mgr.a (mgr.14388) 15659 : audit [DBG] from='client.338991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:23 smithi027 bash[22610]: cluster 2024-08-31T08:13:22.117025+0000 mgr.a (mgr.14388) 15660 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:23 smithi191 bash[24992]: cluster 2024-08-31T08:13:22.117025+0000 mgr.a (mgr.14388) 15660 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:23 smithi163 bash[24253]: cluster 2024-08-31T08:13:22.117025+0000 mgr.a (mgr.14388) 15660 : cluster [DBG] pgmap v10855: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:25 smithi027 bash[22610]: cluster 2024-08-31T08:13:24.119298+0000 mgr.a (mgr.14388) 15661 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:25 smithi191 bash[24992]: cluster 2024-08-31T08:13:24.119298+0000 mgr.a (mgr.14388) 15661 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:25 smithi163 bash[24253]: cluster 2024-08-31T08:13:24.119298+0000 mgr.a (mgr.14388) 15661 : cluster [DBG] pgmap v10856: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:26.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:13:26.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:13:26.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:13:27.171 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:13:27.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:13:27.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:13:27.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:13:27.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:13:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:27 smithi027 bash[22610]: cluster 2024-08-31T08:13:26.120128+0000 mgr.a (mgr.14388) 15662 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:27.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:27 smithi027 bash[22610]: audit 2024-08-31T08:13:26.727395+0000 mgr.a (mgr.14388) 15663 : audit [DBG] from='client.339069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:27 smithi191 bash[24992]: cluster 2024-08-31T08:13:26.120128+0000 mgr.a (mgr.14388) 15662 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:27 smithi191 bash[24992]: audit 2024-08-31T08:13:26.727395+0000 mgr.a (mgr.14388) 15663 : audit [DBG] from='client.339069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:27 smithi163 bash[24253]: cluster 2024-08-31T08:13:26.120128+0000 mgr.a (mgr.14388) 15662 : cluster [DBG] pgmap v10857: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:27 smithi163 bash[24253]: audit 2024-08-31T08:13:26.727395+0000 mgr.a (mgr.14388) 15663 : audit [DBG] from='client.339069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:29 smithi027 bash[22610]: cluster 2024-08-31T08:13:28.122353+0000 mgr.a (mgr.14388) 15664 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:29 smithi191 bash[24992]: cluster 2024-08-31T08:13:28.122353+0000 mgr.a (mgr.14388) 15664 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:29 smithi163 bash[24253]: cluster 2024-08-31T08:13:28.122353+0000 mgr.a (mgr.14388) 15664 : cluster [DBG] pgmap v10858: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:13:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:31 smithi163 bash[24253]: cluster 2024-08-31T08:13:30.123144+0000 mgr.a (mgr.14388) 15665 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:31 smithi027 bash[22610]: cluster 2024-08-31T08:13:30.123144+0000 mgr.a (mgr.14388) 15665 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:31.541 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:31 smithi191 bash[24992]: cluster 2024-08-31T08:13:30.123144+0000 mgr.a (mgr.14388) 15665 : cluster [DBG] pgmap v10859: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:32.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:13:32.173 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:13:32.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:13:32.950 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:13:32.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:13:32.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:13:32.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:13:32.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:13:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:33 smithi163 bash[24253]: cluster 2024-08-31T08:13:32.123919+0000 mgr.a (mgr.14388) 15666 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:33 smithi163 bash[24253]: audit 2024-08-31T08:13:32.504158+0000 mgr.a (mgr.14388) 15667 : audit [DBG] from='client.339144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:33 smithi027 bash[22610]: cluster 2024-08-31T08:13:32.123919+0000 mgr.a (mgr.14388) 15666 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:33 smithi027 bash[22610]: audit 2024-08-31T08:13:32.504158+0000 mgr.a (mgr.14388) 15667 : audit [DBG] from='client.339144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:33 smithi191 bash[24992]: cluster 2024-08-31T08:13:32.123919+0000 mgr.a (mgr.14388) 15666 : cluster [DBG] pgmap v10860: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:33 smithi191 bash[24992]: audit 2024-08-31T08:13:32.504158+0000 mgr.a (mgr.14388) 15667 : audit [DBG] from='client.339144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:35 smithi163 bash[24253]: cluster 2024-08-31T08:13:34.126303+0000 mgr.a (mgr.14388) 15668 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:13:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:35 smithi027 bash[22610]: cluster 2024-08-31T08:13:34.126303+0000 mgr.a (mgr.14388) 15668 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:13:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:35 smithi191 bash[24992]: cluster 2024-08-31T08:13:34.126303+0000 mgr.a (mgr.14388) 15668 : cluster [DBG] pgmap v10861: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:13:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:37 smithi163 bash[24253]: cluster 2024-08-31T08:13:36.127163+0000 mgr.a (mgr.14388) 15669 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:13:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:37 smithi027 bash[22610]: cluster 2024-08-31T08:13:36.127163+0000 mgr.a (mgr.14388) 15669 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:13:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:37 smithi191 bash[24992]: cluster 2024-08-31T08:13:36.127163+0000 mgr.a (mgr.14388) 15669 : cluster [DBG] pgmap v10862: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:13:37.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:13:37.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:13:37.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:13:38.720 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:13:38.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:13:38.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:13:38.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:13:38.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:13:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:39 smithi163 bash[24253]: cluster 2024-08-31T08:13:38.129099+0000 mgr.a (mgr.14388) 15670 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:39 smithi163 bash[24253]: audit 2024-08-31T08:13:38.289460+0000 mgr.a (mgr.14388) 15671 : audit [DBG] from='client.339222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:39 smithi027 bash[22610]: cluster 2024-08-31T08:13:38.129099+0000 mgr.a (mgr.14388) 15670 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:39 smithi027 bash[22610]: audit 2024-08-31T08:13:38.289460+0000 mgr.a (mgr.14388) 15671 : audit [DBG] from='client.339222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:39 smithi191 bash[24992]: cluster 2024-08-31T08:13:38.129099+0000 mgr.a (mgr.14388) 15670 : cluster [DBG] pgmap v10863: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:39 smithi191 bash[24992]: audit 2024-08-31T08:13:38.289460+0000 mgr.a (mgr.14388) 15671 : audit [DBG] from='client.339222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:41 smithi027 bash[22610]: cluster 2024-08-31T08:13:40.130159+0000 mgr.a (mgr.14388) 15672 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:13:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:41 smithi191 bash[24992]: cluster 2024-08-31T08:13:40.130159+0000 mgr.a (mgr.14388) 15672 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:13:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:41 smithi163 bash[24253]: cluster 2024-08-31T08:13:40.130159+0000 mgr.a (mgr.14388) 15672 : cluster [DBG] pgmap v10864: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:13:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:43 smithi027 bash[22610]: cluster 2024-08-31T08:13:42.131026+0000 mgr.a (mgr.14388) 15673 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:13:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:43 smithi191 bash[24992]: cluster 2024-08-31T08:13:42.131026+0000 mgr.a (mgr.14388) 15673 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:13:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:43 smithi163 bash[24253]: cluster 2024-08-31T08:13:42.131026+0000 mgr.a (mgr.14388) 15673 : cluster [DBG] pgmap v10865: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:13:43.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:13:43.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:13:43.723 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:13:44.484 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:13:44.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:13:44.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:13:44.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:13:44.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:13:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:45 smithi027 bash[22610]: audit 2024-08-31T08:13:44.054135+0000 mgr.a (mgr.14388) 15674 : audit [DBG] from='client.339300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:45 smithi027 bash[22610]: cluster 2024-08-31T08:13:44.132478+0000 mgr.a (mgr.14388) 15675 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:45 smithi191 bash[24992]: audit 2024-08-31T08:13:44.054135+0000 mgr.a (mgr.14388) 15674 : audit [DBG] from='client.339300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:45 smithi191 bash[24992]: cluster 2024-08-31T08:13:44.132478+0000 mgr.a (mgr.14388) 15675 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:45 smithi163 bash[24253]: audit 2024-08-31T08:13:44.054135+0000 mgr.a (mgr.14388) 15674 : audit [DBG] from='client.339300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:45 smithi163 bash[24253]: cluster 2024-08-31T08:13:44.132478+0000 mgr.a (mgr.14388) 15675 : cluster [DBG] pgmap v10866: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:47 smithi027 bash[22610]: cluster 2024-08-31T08:13:46.133369+0000 mgr.a (mgr.14388) 15676 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:13:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:47 smithi191 bash[24992]: cluster 2024-08-31T08:13:46.133369+0000 mgr.a (mgr.14388) 15676 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:13:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:47 smithi163 bash[24253]: cluster 2024-08-31T08:13:46.133369+0000 mgr.a (mgr.14388) 15676 : cluster [DBG] pgmap v10867: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:13:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:49 smithi027 bash[22610]: cluster 2024-08-31T08:13:48.135421+0000 mgr.a (mgr.14388) 15677 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:13:49.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:13:49.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:13:49.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:13:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:49 smithi191 bash[24992]: cluster 2024-08-31T08:13:48.135421+0000 mgr.a (mgr.14388) 15677 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:13:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:49 smithi163 bash[24253]: cluster 2024-08-31T08:13:48.135421+0000 mgr.a (mgr.14388) 15677 : cluster [DBG] pgmap v10868: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:13:50.229 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:13:50.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:13:50.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:13:50.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:13:50.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:13:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:51 smithi027 bash[22610]: audit 2024-08-31T08:13:49.818964+0000 mgr.a (mgr.14388) 15678 : audit [DBG] from='client.339375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:51.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:51 smithi027 bash[22610]: cluster 2024-08-31T08:13:50.136104+0000 mgr.a (mgr.14388) 15679 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:51 smithi191 bash[24992]: audit 2024-08-31T08:13:49.818964+0000 mgr.a (mgr.14388) 15678 : audit [DBG] from='client.339375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:51 smithi191 bash[24992]: cluster 2024-08-31T08:13:50.136104+0000 mgr.a (mgr.14388) 15679 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:51 smithi163 bash[24253]: audit 2024-08-31T08:13:49.818964+0000 mgr.a (mgr.14388) 15678 : audit [DBG] from='client.339375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:51 smithi163 bash[24253]: cluster 2024-08-31T08:13:50.136104+0000 mgr.a (mgr.14388) 15679 : cluster [DBG] pgmap v10869: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:53 smithi027 bash[22610]: cluster 2024-08-31T08:13:52.136884+0000 mgr.a (mgr.14388) 15680 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:53 smithi191 bash[24992]: cluster 2024-08-31T08:13:52.136884+0000 mgr.a (mgr.14388) 15680 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:53 smithi163 bash[24253]: cluster 2024-08-31T08:13:52.136884+0000 mgr.a (mgr.14388) 15680 : cluster [DBG] pgmap v10870: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:55.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:13:55.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:13:55.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:13:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:55 smithi027 bash[22610]: cluster 2024-08-31T08:13:54.139108+0000 mgr.a (mgr.14388) 15681 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:13:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:55 smithi191 bash[24992]: cluster 2024-08-31T08:13:54.139108+0000 mgr.a (mgr.14388) 15681 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:13:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:55 smithi163 bash[24253]: cluster 2024-08-31T08:13:54.139108+0000 mgr.a (mgr.14388) 15681 : cluster [DBG] pgmap v10871: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:13:55.986 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:13:55.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:13:55.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:13:55.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:13:55.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:13:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:56 smithi191 bash[24992]: audit 2024-08-31T08:13:55.563231+0000 mgr.a (mgr.14388) 15682 : audit [DBG] from='client.339453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:56 smithi163 bash[24253]: audit 2024-08-31T08:13:55.563231+0000 mgr.a (mgr.14388) 15682 : audit [DBG] from='client.339453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:56 smithi027 bash[22610]: audit 2024-08-31T08:13:55.563231+0000 mgr.a (mgr.14388) 15682 : audit [DBG] from='client.339453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:13:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:57 smithi191 bash[24992]: cluster 2024-08-31T08:13:56.140034+0000 mgr.a (mgr.14388) 15683 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:57 smithi163 bash[24253]: cluster 2024-08-31T08:13:56.140034+0000 mgr.a (mgr.14388) 15683 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:57 smithi027 bash[22610]: cluster 2024-08-31T08:13:56.140034+0000 mgr.a (mgr.14388) 15683 : cluster [DBG] pgmap v10872: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:13:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:13:59 smithi191 bash[24992]: cluster 2024-08-31T08:13:58.142177+0000 mgr.a (mgr.14388) 15684 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:13:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:13:59 smithi163 bash[24253]: cluster 2024-08-31T08:13:58.142177+0000 mgr.a (mgr.14388) 15684 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:13:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:13:59 smithi027 bash[22610]: cluster 2024-08-31T08:13:58.142177+0000 mgr.a (mgr.14388) 15684 : cluster [DBG] pgmap v10873: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:14:00.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:00.988 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:00.988 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:01 smithi191 bash[24992]: cluster 2024-08-31T08:14:00.142904+0000 mgr.a (mgr.14388) 15685 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:01 smithi163 bash[24253]: cluster 2024-08-31T08:14:00.142904+0000 mgr.a (mgr.14388) 15685 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:01 smithi027 bash[22610]: cluster 2024-08-31T08:14:00.142904+0000 mgr.a (mgr.14388) 15685 : cluster [DBG] pgmap v10874: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:01.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:01.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:01.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:01.754 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:01.754 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:02 smithi191 bash[24992]: audit 2024-08-31T08:14:01.323450+0000 mgr.a (mgr.14388) 15686 : audit [DBG] from='client.339528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:02 smithi163 bash[24253]: audit 2024-08-31T08:14:01.323450+0000 mgr.a (mgr.14388) 15686 : audit [DBG] from='client.339528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:02 smithi027 bash[22610]: audit 2024-08-31T08:14:01.323450+0000 mgr.a (mgr.14388) 15686 : audit [DBG] from='client.339528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:03 smithi191 bash[24992]: cluster 2024-08-31T08:14:02.143741+0000 mgr.a (mgr.14388) 15687 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:03 smithi163 bash[24253]: cluster 2024-08-31T08:14:02.143741+0000 mgr.a (mgr.14388) 15687 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:03 smithi027 bash[22610]: cluster 2024-08-31T08:14:02.143741+0000 mgr.a (mgr.14388) 15687 : cluster [DBG] pgmap v10875: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:05 smithi191 bash[24992]: cluster 2024-08-31T08:14:04.145937+0000 mgr.a (mgr.14388) 15688 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:14:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:05 smithi163 bash[24253]: cluster 2024-08-31T08:14:04.145937+0000 mgr.a (mgr.14388) 15688 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:14:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:05 smithi027 bash[22610]: cluster 2024-08-31T08:14:04.145937+0000 mgr.a (mgr.14388) 15688 : cluster [DBG] pgmap v10876: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:14:06.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:06.756 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:06.756 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:07.495 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:07.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:07.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:07.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:07.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:07 smithi191 bash[24992]: cluster 2024-08-31T08:14:06.146707+0000 mgr.a (mgr.14388) 15689 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:07 smithi163 bash[24253]: cluster 2024-08-31T08:14:06.146707+0000 mgr.a (mgr.14388) 15689 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:07 smithi027 bash[22610]: cluster 2024-08-31T08:14:06.146707+0000 mgr.a (mgr.14388) 15689 : cluster [DBG] pgmap v10877: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:08 smithi191 bash[24992]: audit 2024-08-31T08:14:07.083116+0000 mgr.a (mgr.14388) 15690 : audit [DBG] from='client.339606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:08 smithi163 bash[24253]: audit 2024-08-31T08:14:07.083116+0000 mgr.a (mgr.14388) 15690 : audit [DBG] from='client.339606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:08 smithi027 bash[22610]: audit 2024-08-31T08:14:07.083116+0000 mgr.a (mgr.14388) 15690 : audit [DBG] from='client.339606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:09 smithi191 bash[24992]: cluster 2024-08-31T08:14:08.148922+0000 mgr.a (mgr.14388) 15691 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:14:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:09 smithi163 bash[24253]: cluster 2024-08-31T08:14:08.148922+0000 mgr.a (mgr.14388) 15691 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:14:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:09 smithi027 bash[22610]: cluster 2024-08-31T08:14:08.148922+0000 mgr.a (mgr.14388) 15691 : cluster [DBG] pgmap v10878: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:14:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:11 smithi191 bash[24992]: cluster 2024-08-31T08:14:10.149690+0000 mgr.a (mgr.14388) 15692 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:11 smithi163 bash[24253]: cluster 2024-08-31T08:14:10.149690+0000 mgr.a (mgr.14388) 15692 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:11 smithi027 bash[22610]: cluster 2024-08-31T08:14:10.149690+0000 mgr.a (mgr.14388) 15692 : cluster [DBG] pgmap v10879: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:12.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:12.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:12.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:13.232 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:13.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:13.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:13.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:13.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:13 smithi163 bash[24253]: cluster 2024-08-31T08:14:12.150449+0000 mgr.a (mgr.14388) 15693 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:13 smithi027 bash[22610]: cluster 2024-08-31T08:14:12.150449+0000 mgr.a (mgr.14388) 15693 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:13 smithi191 bash[24992]: cluster 2024-08-31T08:14:12.150449+0000 mgr.a (mgr.14388) 15693 : cluster [DBG] pgmap v10880: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:14 smithi163 bash[24253]: audit 2024-08-31T08:14:12.821214+0000 mgr.a (mgr.14388) 15694 : audit [DBG] from='client.339684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:14 smithi163 bash[24253]: audit 2024-08-31T08:14:13.863537+0000 mon.a (mon.0) 2913 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:14:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:14 smithi027 bash[22610]: audit 2024-08-31T08:14:12.821214+0000 mgr.a (mgr.14388) 15694 : audit [DBG] from='client.339684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:14.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:14 smithi027 bash[22610]: audit 2024-08-31T08:14:13.863537+0000 mon.a (mon.0) 2913 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:14:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:14 smithi191 bash[24992]: audit 2024-08-31T08:14:12.821214+0000 mgr.a (mgr.14388) 15694 : audit [DBG] from='client.339684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:14 smithi191 bash[24992]: audit 2024-08-31T08:14:13.863537+0000 mon.a (mon.0) 2913 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:14:15.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:15 smithi027 bash[22610]: cluster 2024-08-31T08:14:14.153209+0000 mgr.a (mgr.14388) 15695 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:15.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:15 smithi027 bash[22610]: audit 2024-08-31T08:14:14.479589+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:15 smithi027 bash[22610]: audit 2024-08-31T08:14:14.483690+0000 mon.a (mon.0) 2915 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:15 smithi027 bash[22610]: audit 2024-08-31T08:14:14.487712+0000 mon.a (mon.0) 2916 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:15 smithi027 bash[22610]: audit 2024-08-31T08:14:14.491619+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:15 smithi191 bash[24992]: cluster 2024-08-31T08:14:14.153209+0000 mgr.a (mgr.14388) 15695 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:15 smithi191 bash[24992]: audit 2024-08-31T08:14:14.479589+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:15 smithi191 bash[24992]: audit 2024-08-31T08:14:14.483690+0000 mon.a (mon.0) 2915 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:15 smithi191 bash[24992]: audit 2024-08-31T08:14:14.487712+0000 mon.a (mon.0) 2916 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:15 smithi191 bash[24992]: audit 2024-08-31T08:14:14.491619+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:15 smithi163 bash[24253]: cluster 2024-08-31T08:14:14.153209+0000 mgr.a (mgr.14388) 15695 : cluster [DBG] pgmap v10881: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:15 smithi163 bash[24253]: audit 2024-08-31T08:14:14.479589+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:15 smithi163 bash[24253]: audit 2024-08-31T08:14:14.483690+0000 mon.a (mon.0) 2915 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:15 smithi163 bash[24253]: audit 2024-08-31T08:14:14.487712+0000 mon.a (mon.0) 2916 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:15 smithi163 bash[24253]: audit 2024-08-31T08:14:14.491619+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:17 smithi191 bash[24992]: cluster 2024-08-31T08:14:16.154055+0000 mgr.a (mgr.14388) 15696 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:14:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:17 smithi163 bash[24253]: cluster 2024-08-31T08:14:16.154055+0000 mgr.a (mgr.14388) 15696 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:14:17.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:17 smithi027 bash[22610]: cluster 2024-08-31T08:14:16.154055+0000 mgr.a (mgr.14388) 15696 : cluster [DBG] pgmap v10882: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:14:18.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:18.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:18.987 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:18.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:18.988 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:18.988 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:19 smithi191 bash[24992]: cluster 2024-08-31T08:14:18.156032+0000 mgr.a (mgr.14388) 15697 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:19 smithi191 bash[24992]: audit 2024-08-31T08:14:18.565650+0000 mgr.a (mgr.14388) 15698 : audit [DBG] from='client.339759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:19 smithi163 bash[24253]: cluster 2024-08-31T08:14:18.156032+0000 mgr.a (mgr.14388) 15697 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:19 smithi163 bash[24253]: audit 2024-08-31T08:14:18.565650+0000 mgr.a (mgr.14388) 15698 : audit [DBG] from='client.339759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:19 smithi027 bash[22610]: cluster 2024-08-31T08:14:18.156032+0000 mgr.a (mgr.14388) 15697 : cluster [DBG] pgmap v10883: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:19 smithi027 bash[22610]: audit 2024-08-31T08:14:18.565650+0000 mgr.a (mgr.14388) 15698 : audit [DBG] from='client.339759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:21.788 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:21 smithi027 bash[22610]: cluster 2024-08-31T08:14:20.156903+0000 mgr.a (mgr.14388) 15699 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:14:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:21 smithi191 bash[24992]: cluster 2024-08-31T08:14:20.156903+0000 mgr.a (mgr.14388) 15699 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:14:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:21 smithi163 bash[24253]: cluster 2024-08-31T08:14:20.156903+0000 mgr.a (mgr.14388) 15699 : cluster [DBG] pgmap v10884: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:14:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:23 smithi191 bash[24992]: cluster 2024-08-31T08:14:22.157674+0000 mgr.a (mgr.14388) 15700 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:14:23.841 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:23 smithi027 bash[22610]: cluster 2024-08-31T08:14:22.157674+0000 mgr.a (mgr.14388) 15700 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:14:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:23 smithi163 bash[24253]: cluster 2024-08-31T08:14:22.157674+0000 mgr.a (mgr.14388) 15700 : cluster [DBG] pgmap v10885: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:14:23.989 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:23.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:23.989 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:24.779 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:24.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:24.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:24.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:24.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:25.746 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22863]: debug 2024-08-31T08:14:25.490+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:14:25.746 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22863]: debug 2024-08-31T08:14:25.494+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:14:25.746 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22610]: cluster 2024-08-31T08:14:24.159759+0000 mgr.a (mgr.14388) 15701 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:25.746 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22610]: audit 2024-08-31T08:14:24.323937+0000 mgr.a (mgr.14388) 15702 : audit [DBG] from='client.339834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:25.746 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22610]: audit 2024-08-31T08:14:24.742540+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:25.746 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22610]: audit 2024-08-31T08:14:24.748383+0000 mon.a (mon.0) 2919 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:25.746 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22610]: audit 2024-08-31T08:14:24.749388+0000 mon.a (mon.0) 2920 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:14:25.747 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22610]: audit 2024-08-31T08:14:24.750273+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:14:25.747 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22610]: audit 2024-08-31T08:14:24.756974+0000 mon.a (mon.0) 2922 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:25 smithi191 bash[24992]: cluster 2024-08-31T08:14:24.159759+0000 mgr.a (mgr.14388) 15701 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:25 smithi191 bash[24992]: audit 2024-08-31T08:14:24.323937+0000 mgr.a (mgr.14388) 15702 : audit [DBG] from='client.339834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:25 smithi191 bash[24992]: audit 2024-08-31T08:14:24.742540+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:25 smithi191 bash[24992]: audit 2024-08-31T08:14:24.748383+0000 mon.a (mon.0) 2919 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:25 smithi191 bash[24992]: audit 2024-08-31T08:14:24.749388+0000 mon.a (mon.0) 2920 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:14:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:25 smithi191 bash[24992]: audit 2024-08-31T08:14:24.750273+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:14:26.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:25 smithi191 bash[24992]: audit 2024-08-31T08:14:24.756974+0000 mon.a (mon.0) 2922 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:26.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:25 smithi191 bash[24992]: audit 2024-08-31T08:14:24.759597+0000 mon.a (mon.0) 2923 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:14:26.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:25 smithi191 bash[24992]: audit 2024-08-31T08:14:24.760710+0000 mgr.a (mgr.14388) 15703 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:14:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:25 smithi163 bash[24253]: cluster 2024-08-31T08:14:24.159759+0000 mgr.a (mgr.14388) 15701 : cluster [DBG] pgmap v10886: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:25 smithi163 bash[24253]: audit 2024-08-31T08:14:24.323937+0000 mgr.a (mgr.14388) 15702 : audit [DBG] from='client.339834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:25 smithi163 bash[24253]: audit 2024-08-31T08:14:24.742540+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:25 smithi163 bash[24253]: audit 2024-08-31T08:14:24.748383+0000 mon.a (mon.0) 2919 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:25 smithi163 bash[24253]: audit 2024-08-31T08:14:24.749388+0000 mon.a (mon.0) 2920 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:14:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:25 smithi163 bash[24253]: audit 2024-08-31T08:14:24.750273+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:14:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:25 smithi163 bash[24253]: audit 2024-08-31T08:14:24.756974+0000 mon.a (mon.0) 2922 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:14:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:25 smithi163 bash[24253]: audit 2024-08-31T08:14:24.759597+0000 mon.a (mon.0) 2923 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:14:26.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:25 smithi163 bash[24253]: audit 2024-08-31T08:14:24.760710+0000 mgr.a (mgr.14388) 15703 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:14:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22610]: audit 2024-08-31T08:14:24.759597+0000 mon.a (mon.0) 2923 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:14:26.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:25 smithi027 bash[22610]: audit 2024-08-31T08:14:24.760710+0000 mgr.a (mgr.14388) 15703 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:14:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:26 smithi191 bash[24992]: audit 2024-08-31T08:14:25.494266+0000 mgr.a (mgr.14388) 15704 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:14:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:26 smithi191 bash[24992]: cephadm 2024-08-31T08:14:25.495808+0000 mgr.a (mgr.14388) 15705 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:14:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:26 smithi163 bash[24253]: audit 2024-08-31T08:14:25.494266+0000 mgr.a (mgr.14388) 15704 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:14:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:26 smithi163 bash[24253]: cephadm 2024-08-31T08:14:25.495808+0000 mgr.a (mgr.14388) 15705 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:14:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:26 smithi027 bash[22610]: audit 2024-08-31T08:14:25.494266+0000 mgr.a (mgr.14388) 15704 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:14:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:26 smithi027 bash[22610]: cephadm 2024-08-31T08:14:25.495808+0000 mgr.a (mgr.14388) 15705 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:14:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:27 smithi191 bash[24992]: cluster 2024-08-31T08:14:26.160647+0000 mgr.a (mgr.14388) 15706 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:27 smithi163 bash[24253]: cluster 2024-08-31T08:14:26.160647+0000 mgr.a (mgr.14388) 15706 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:27 smithi027 bash[22610]: cluster 2024-08-31T08:14:26.160647+0000 mgr.a (mgr.14388) 15706 : cluster [DBG] pgmap v10887: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:29.781 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:29.781 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:29 smithi191 bash[24992]: cluster 2024-08-31T08:14:28.162927+0000 mgr.a (mgr.14388) 15707 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:29 smithi163 bash[24253]: cluster 2024-08-31T08:14:28.162927+0000 mgr.a (mgr.14388) 15707 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:29 smithi027 bash[22610]: cluster 2024-08-31T08:14:28.162927+0000 mgr.a (mgr.14388) 15707 : cluster [DBG] pgmap v10888: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:30.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:30.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:30.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:30.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:30.526 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:31 smithi191 bash[24992]: audit 2024-08-31T08:14:30.110886+0000 mgr.a (mgr.14388) 15708 : audit [DBG] from='client.340020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:31 smithi191 bash[24992]: cluster 2024-08-31T08:14:30.163949+0000 mgr.a (mgr.14388) 15709 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:31 smithi163 bash[24253]: audit 2024-08-31T08:14:30.110886+0000 mgr.a (mgr.14388) 15708 : audit [DBG] from='client.340020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:31 smithi163 bash[24253]: cluster 2024-08-31T08:14:30.163949+0000 mgr.a (mgr.14388) 15709 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:31 smithi027 bash[22610]: audit 2024-08-31T08:14:30.110886+0000 mgr.a (mgr.14388) 15708 : audit [DBG] from='client.340020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:31 smithi027 bash[22610]: cluster 2024-08-31T08:14:30.163949+0000 mgr.a (mgr.14388) 15709 : cluster [DBG] pgmap v10889: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:33 smithi191 bash[24992]: cluster 2024-08-31T08:14:32.164985+0000 mgr.a (mgr.14388) 15710 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:33 smithi163 bash[24253]: cluster 2024-08-31T08:14:32.164985+0000 mgr.a (mgr.14388) 15710 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:33 smithi027 bash[22610]: cluster 2024-08-31T08:14:32.164985+0000 mgr.a (mgr.14388) 15710 : cluster [DBG] pgmap v10890: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:35.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:35.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:35.528 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:35 smithi191 bash[24992]: cluster 2024-08-31T08:14:34.167399+0000 mgr.a (mgr.14388) 15711 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:35 smithi163 bash[24253]: cluster 2024-08-31T08:14:34.167399+0000 mgr.a (mgr.14388) 15711 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:35 smithi027 bash[22610]: cluster 2024-08-31T08:14:34.167399+0000 mgr.a (mgr.14388) 15711 : cluster [DBG] pgmap v10891: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:36.311 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:37 smithi191 bash[24992]: audit 2024-08-31T08:14:35.863378+0000 mgr.a (mgr.14388) 15712 : audit [DBG] from='client.340098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:37 smithi191 bash[24992]: cluster 2024-08-31T08:14:36.168040+0000 mgr.a (mgr.14388) 15713 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:37 smithi163 bash[24253]: audit 2024-08-31T08:14:35.863378+0000 mgr.a (mgr.14388) 15712 : audit [DBG] from='client.340098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:37 smithi163 bash[24253]: cluster 2024-08-31T08:14:36.168040+0000 mgr.a (mgr.14388) 15713 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:37 smithi027 bash[22610]: audit 2024-08-31T08:14:35.863378+0000 mgr.a (mgr.14388) 15712 : audit [DBG] from='client.340098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:38.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:37 smithi027 bash[22610]: cluster 2024-08-31T08:14:36.168040+0000 mgr.a (mgr.14388) 15713 : cluster [DBG] pgmap v10892: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:39 smithi191 bash[24992]: cluster 2024-08-31T08:14:38.170226+0000 mgr.a (mgr.14388) 15714 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:39 smithi163 bash[24253]: cluster 2024-08-31T08:14:38.170226+0000 mgr.a (mgr.14388) 15714 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:39 smithi027 bash[22610]: cluster 2024-08-31T08:14:38.170226+0000 mgr.a (mgr.14388) 15714 : cluster [DBG] pgmap v10893: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:14:41.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:41.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:41.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:41 smithi191 bash[24992]: cluster 2024-08-31T08:14:40.170998+0000 mgr.a (mgr.14388) 15715 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:42.098 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:42.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:42.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:42.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:42.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:41 smithi163 bash[24253]: cluster 2024-08-31T08:14:40.170998+0000 mgr.a (mgr.14388) 15715 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:41 smithi027 bash[22610]: cluster 2024-08-31T08:14:40.170998+0000 mgr.a (mgr.14388) 15715 : cluster [DBG] pgmap v10894: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:42 smithi191 bash[24992]: audit 2024-08-31T08:14:41.650928+0000 mgr.a (mgr.14388) 15716 : audit [DBG] from='client.340173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:42 smithi163 bash[24253]: audit 2024-08-31T08:14:41.650928+0000 mgr.a (mgr.14388) 15716 : audit [DBG] from='client.340173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:42 smithi027 bash[22610]: audit 2024-08-31T08:14:41.650928+0000 mgr.a (mgr.14388) 15716 : audit [DBG] from='client.340173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:43 smithi163 bash[24253]: cluster 2024-08-31T08:14:42.171800+0000 mgr.a (mgr.14388) 15717 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:43 smithi027 bash[22610]: cluster 2024-08-31T08:14:42.171800+0000 mgr.a (mgr.14388) 15717 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:43 smithi191 bash[24992]: cluster 2024-08-31T08:14:42.171800+0000 mgr.a (mgr.14388) 15717 : cluster [DBG] pgmap v10895: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:45 smithi163 bash[24253]: cluster 2024-08-31T08:14:44.174122+0000 mgr.a (mgr.14388) 15718 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:14:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:45 smithi027 bash[22610]: cluster 2024-08-31T08:14:44.174122+0000 mgr.a (mgr.14388) 15718 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:14:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:45 smithi191 bash[24992]: cluster 2024-08-31T08:14:44.174122+0000 mgr.a (mgr.14388) 15718 : cluster [DBG] pgmap v10896: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:14:47.100 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:47.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:47.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:46 smithi163 bash[24253]: cluster 2024-08-31T08:14:46.175069+0000 mgr.a (mgr.14388) 15719 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:46 smithi027 bash[22610]: cluster 2024-08-31T08:14:46.175069+0000 mgr.a (mgr.14388) 15719 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:46 smithi191 bash[24992]: cluster 2024-08-31T08:14:46.175069+0000 mgr.a (mgr.14388) 15719 : cluster [DBG] pgmap v10897: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:47.879 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:47.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:47.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:47.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:47.879 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:47 smithi163 bash[24253]: audit 2024-08-31T08:14:47.431842+0000 mgr.a (mgr.14388) 15720 : audit [DBG] from='client.340248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:47 smithi027 bash[22610]: audit 2024-08-31T08:14:47.431842+0000 mgr.a (mgr.14388) 15720 : audit [DBG] from='client.340248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:47 smithi191 bash[24992]: audit 2024-08-31T08:14:47.431842+0000 mgr.a (mgr.14388) 15720 : audit [DBG] from='client.340248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:48 smithi163 bash[24253]: cluster 2024-08-31T08:14:48.177297+0000 mgr.a (mgr.14388) 15721 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T08:14:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:48 smithi027 bash[22610]: cluster 2024-08-31T08:14:48.177297+0000 mgr.a (mgr.14388) 15721 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T08:14:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:48 smithi191 bash[24992]: cluster 2024-08-31T08:14:48.177297+0000 mgr.a (mgr.14388) 15721 : cluster [DBG] pgmap v10898: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T08:14:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:51 smithi191 bash[24992]: cluster 2024-08-31T08:14:50.178051+0000 mgr.a (mgr.14388) 15722 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:14:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:51 smithi163 bash[24253]: cluster 2024-08-31T08:14:50.178051+0000 mgr.a (mgr.14388) 15722 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:14:51.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:51 smithi027 bash[22610]: cluster 2024-08-31T08:14:50.178051+0000 mgr.a (mgr.14388) 15722 : cluster [DBG] pgmap v10899: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:14:52.880 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:52.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:52.881 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:53 smithi191 bash[24992]: cluster 2024-08-31T08:14:52.178800+0000 mgr.a (mgr.14388) 15723 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:14:53.660 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:53.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:53.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:53.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:53.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:53 smithi163 bash[24253]: cluster 2024-08-31T08:14:52.178800+0000 mgr.a (mgr.14388) 15723 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:14:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:53 smithi027 bash[22610]: cluster 2024-08-31T08:14:52.178800+0000 mgr.a (mgr.14388) 15723 : cluster [DBG] pgmap v10900: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:14:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:54 smithi191 bash[24992]: audit 2024-08-31T08:14:53.217289+0000 mgr.a (mgr.14388) 15724 : audit [DBG] from='client.340326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:54 smithi163 bash[24253]: audit 2024-08-31T08:14:53.217289+0000 mgr.a (mgr.14388) 15724 : audit [DBG] from='client.340326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:54 smithi027 bash[22610]: audit 2024-08-31T08:14:53.217289+0000 mgr.a (mgr.14388) 15724 : audit [DBG] from='client.340326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:14:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:55 smithi191 bash[24992]: cluster 2024-08-31T08:14:54.181483+0000 mgr.a (mgr.14388) 15725 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:55 smithi163 bash[24253]: cluster 2024-08-31T08:14:54.181483+0000 mgr.a (mgr.14388) 15725 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:55 smithi027 bash[22610]: cluster 2024-08-31T08:14:54.181483+0000 mgr.a (mgr.14388) 15725 : cluster [DBG] pgmap v10901: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:57 smithi191 bash[24992]: cluster 2024-08-31T08:14:56.182248+0000 mgr.a (mgr.14388) 15726 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:14:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:57 smithi163 bash[24253]: cluster 2024-08-31T08:14:56.182248+0000 mgr.a (mgr.14388) 15726 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:14:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:57 smithi027 bash[22610]: cluster 2024-08-31T08:14:56.182248+0000 mgr.a (mgr.14388) 15726 : cluster [DBG] pgmap v10902: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:14:58.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:14:58.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:14:58.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:14:59.435 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:14:59.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:14:59.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:14:59.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:14:59.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:14:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:14:59 smithi191 bash[24992]: cluster 2024-08-31T08:14:58.184093+0000 mgr.a (mgr.14388) 15727 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:14:59 smithi163 bash[24253]: cluster 2024-08-31T08:14:58.184093+0000 mgr.a (mgr.14388) 15727 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:14:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:14:59 smithi027 bash[22610]: cluster 2024-08-31T08:14:58.184093+0000 mgr.a (mgr.14388) 15727 : cluster [DBG] pgmap v10903: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:00 smithi191 bash[24992]: audit 2024-08-31T08:14:58.995981+0000 mgr.a (mgr.14388) 15728 : audit [DBG] from='client.340404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:00 smithi163 bash[24253]: audit 2024-08-31T08:14:58.995981+0000 mgr.a (mgr.14388) 15728 : audit [DBG] from='client.340404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:00 smithi027 bash[22610]: audit 2024-08-31T08:14:58.995981+0000 mgr.a (mgr.14388) 15728 : audit [DBG] from='client.340404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:01 smithi191 bash[24992]: cluster 2024-08-31T08:15:00.185021+0000 mgr.a (mgr.14388) 15729 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T08:15:01.629 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:01 smithi027 bash[22610]: cluster 2024-08-31T08:15:00.185021+0000 mgr.a (mgr.14388) 15729 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T08:15:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:01 smithi163 bash[24253]: cluster 2024-08-31T08:15:00.185021+0000 mgr.a (mgr.14388) 15729 : cluster [DBG] pgmap v10904: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T08:15:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:03 smithi191 bash[24992]: cluster 2024-08-31T08:15:02.185945+0000 mgr.a (mgr.14388) 15730 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T08:15:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:03 smithi163 bash[24253]: cluster 2024-08-31T08:15:02.185945+0000 mgr.a (mgr.14388) 15730 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T08:15:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:03 smithi027 bash[22610]: cluster 2024-08-31T08:15:02.185945+0000 mgr.a (mgr.14388) 15730 : cluster [DBG] pgmap v10905: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T08:15:04.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:15:04.437 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:15:04.437 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:15:05.165 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:15:05.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:15:05.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:15:05.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:15:05.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:15:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:05 smithi191 bash[24992]: cluster 2024-08-31T08:15:04.188332+0000 mgr.a (mgr.14388) 15731 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T08:15:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:05 smithi191 bash[24992]: audit 2024-08-31T08:15:04.759446+0000 mgr.a (mgr.14388) 15732 : audit [DBG] from='client.340482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:05 smithi163 bash[24253]: cluster 2024-08-31T08:15:04.188332+0000 mgr.a (mgr.14388) 15731 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T08:15:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:05 smithi163 bash[24253]: audit 2024-08-31T08:15:04.759446+0000 mgr.a (mgr.14388) 15732 : audit [DBG] from='client.340482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:05 smithi027 bash[22610]: cluster 2024-08-31T08:15:04.188332+0000 mgr.a (mgr.14388) 15731 : cluster [DBG] pgmap v10906: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T08:15:05.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:05 smithi027 bash[22610]: audit 2024-08-31T08:15:04.759446+0000 mgr.a (mgr.14388) 15732 : audit [DBG] from='client.340482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:07 smithi191 bash[24992]: cluster 2024-08-31T08:15:06.189428+0000 mgr.a (mgr.14388) 15733 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:07 smithi163 bash[24253]: cluster 2024-08-31T08:15:06.189428+0000 mgr.a (mgr.14388) 15733 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:07 smithi027 bash[22610]: cluster 2024-08-31T08:15:06.189428+0000 mgr.a (mgr.14388) 15733 : cluster [DBG] pgmap v10907: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:09 smithi163 bash[24253]: cluster 2024-08-31T08:15:08.191613+0000 mgr.a (mgr.14388) 15734 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:09 smithi027 bash[22610]: cluster 2024-08-31T08:15:08.191613+0000 mgr.a (mgr.14388) 15734 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:09 smithi191 bash[24992]: cluster 2024-08-31T08:15:08.191613+0000 mgr.a (mgr.14388) 15734 : cluster [DBG] pgmap v10908: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:10.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:15:10.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:15:10.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:15:10.944 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:15:10.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:15:10.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:15:10.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:15:10.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:15:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:11 smithi163 bash[24253]: cluster 2024-08-31T08:15:10.192374+0000 mgr.a (mgr.14388) 15735 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:11 smithi163 bash[24253]: audit 2024-08-31T08:15:10.501810+0000 mgr.a (mgr.14388) 15736 : audit [DBG] from='client.340560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:11 smithi027 bash[22610]: cluster 2024-08-31T08:15:10.192374+0000 mgr.a (mgr.14388) 15735 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:11 smithi027 bash[22610]: audit 2024-08-31T08:15:10.501810+0000 mgr.a (mgr.14388) 15736 : audit [DBG] from='client.340560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:11 smithi191 bash[24992]: cluster 2024-08-31T08:15:10.192374+0000 mgr.a (mgr.14388) 15735 : cluster [DBG] pgmap v10909: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:11 smithi191 bash[24992]: audit 2024-08-31T08:15:10.501810+0000 mgr.a (mgr.14388) 15736 : audit [DBG] from='client.340560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:13 smithi163 bash[24253]: cluster 2024-08-31T08:15:12.193367+0000 mgr.a (mgr.14388) 15737 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:13.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:13 smithi027 bash[22610]: cluster 2024-08-31T08:15:12.193367+0000 mgr.a (mgr.14388) 15737 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:13 smithi191 bash[24992]: cluster 2024-08-31T08:15:12.193367+0000 mgr.a (mgr.14388) 15737 : cluster [DBG] pgmap v10910: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:15 smithi163 bash[24253]: cluster 2024-08-31T08:15:14.195602+0000 mgr.a (mgr.14388) 15738 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:15 smithi027 bash[22610]: cluster 2024-08-31T08:15:14.195602+0000 mgr.a (mgr.14388) 15738 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:15 smithi191 bash[24992]: cluster 2024-08-31T08:15:14.195602+0000 mgr.a (mgr.14388) 15738 : cluster [DBG] pgmap v10911: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:15:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:15:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:15:16.697 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:15:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:15:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:15:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:15:16.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:15:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:17 smithi163 bash[24253]: cluster 2024-08-31T08:15:16.196310+0000 mgr.a (mgr.14388) 15739 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:17 smithi163 bash[24253]: audit 2024-08-31T08:15:16.275135+0000 mgr.a (mgr.14388) 15740 : audit [DBG] from='client.340638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:17.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:17 smithi027 bash[22610]: cluster 2024-08-31T08:15:16.196310+0000 mgr.a (mgr.14388) 15739 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:17.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:17 smithi027 bash[22610]: audit 2024-08-31T08:15:16.275135+0000 mgr.a (mgr.14388) 15740 : audit [DBG] from='client.340638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:17 smithi191 bash[24992]: cluster 2024-08-31T08:15:16.196310+0000 mgr.a (mgr.14388) 15739 : cluster [DBG] pgmap v10912: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:17 smithi191 bash[24992]: audit 2024-08-31T08:15:16.275135+0000 mgr.a (mgr.14388) 15740 : audit [DBG] from='client.340638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:19 smithi163 bash[24253]: cluster 2024-08-31T08:15:18.198565+0000 mgr.a (mgr.14388) 15741 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:19 smithi027 bash[22610]: cluster 2024-08-31T08:15:18.198565+0000 mgr.a (mgr.14388) 15741 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:19 smithi191 bash[24992]: cluster 2024-08-31T08:15:18.198565+0000 mgr.a (mgr.14388) 15741 : cluster [DBG] pgmap v10913: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:21.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:15:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:21 smithi163 bash[24253]: cluster 2024-08-31T08:15:20.199346+0000 mgr.a (mgr.14388) 15742 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:21.700 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:15:21.700 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:15:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:21 smithi027 bash[22610]: cluster 2024-08-31T08:15:20.199346+0000 mgr.a (mgr.14388) 15742 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:21 smithi191 bash[24992]: cluster 2024-08-31T08:15:20.199346+0000 mgr.a (mgr.14388) 15742 : cluster [DBG] pgmap v10914: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:22.482 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:15:22.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:15:22.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:15:22.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:15:22.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:15:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:23 smithi163 bash[24253]: audit 2024-08-31T08:15:22.037379+0000 mgr.a (mgr.14388) 15743 : audit [DBG] from='client.340716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:23 smithi163 bash[24253]: cluster 2024-08-31T08:15:22.199894+0000 mgr.a (mgr.14388) 15744 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:23 smithi027 bash[22610]: audit 2024-08-31T08:15:22.037379+0000 mgr.a (mgr.14388) 15743 : audit [DBG] from='client.340716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:23 smithi027 bash[22610]: cluster 2024-08-31T08:15:22.199894+0000 mgr.a (mgr.14388) 15744 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:23 smithi191 bash[24992]: audit 2024-08-31T08:15:22.037379+0000 mgr.a (mgr.14388) 15743 : audit [DBG] from='client.340716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:23 smithi191 bash[24992]: cluster 2024-08-31T08:15:22.199894+0000 mgr.a (mgr.14388) 15744 : cluster [DBG] pgmap v10915: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:25 smithi163 bash[24253]: cluster 2024-08-31T08:15:24.202305+0000 mgr.a (mgr.14388) 15745 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:25 smithi027 bash[22610]: cluster 2024-08-31T08:15:24.202305+0000 mgr.a (mgr.14388) 15745 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:25 smithi191 bash[24992]: cluster 2024-08-31T08:15:24.202305+0000 mgr.a (mgr.14388) 15745 : cluster [DBG] pgmap v10916: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:26 smithi163 bash[24253]: audit 2024-08-31T08:15:25.557187+0000 mon.a (mon.0) 2924 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:15:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:26 smithi027 bash[22610]: audit 2024-08-31T08:15:25.557187+0000 mon.a (mon.0) 2924 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:15:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:26 smithi191 bash[24992]: audit 2024-08-31T08:15:25.557187+0000 mon.a (mon.0) 2924 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:15:27.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:15:27.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:15:27.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:15:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:27 smithi163 bash[24253]: cluster 2024-08-31T08:15:26.203151+0000 mgr.a (mgr.14388) 15746 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:27 smithi027 bash[22610]: cluster 2024-08-31T08:15:26.203151+0000 mgr.a (mgr.14388) 15746 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:27 smithi191 bash[24992]: cluster 2024-08-31T08:15:26.203151+0000 mgr.a (mgr.14388) 15746 : cluster [DBG] pgmap v10917: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:28.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:15:28.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:15:28.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:15:28.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:15:28.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:15:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:29 smithi163 bash[24253]: audit 2024-08-31T08:15:27.822175+0000 mgr.a (mgr.14388) 15747 : audit [DBG] from='client.340791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:29 smithi163 bash[24253]: cluster 2024-08-31T08:15:28.204426+0000 mgr.a (mgr.14388) 15748 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:29 smithi027 bash[22610]: audit 2024-08-31T08:15:27.822175+0000 mgr.a (mgr.14388) 15747 : audit [DBG] from='client.340791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:29.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:29 smithi027 bash[22610]: cluster 2024-08-31T08:15:28.204426+0000 mgr.a (mgr.14388) 15748 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:29 smithi191 bash[24992]: audit 2024-08-31T08:15:27.822175+0000 mgr.a (mgr.14388) 15747 : audit [DBG] from='client.340791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:29 smithi191 bash[24992]: cluster 2024-08-31T08:15:28.204426+0000 mgr.a (mgr.14388) 15748 : cluster [DBG] pgmap v10918: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:31 smithi163 bash[24253]: cluster 2024-08-31T08:15:30.205150+0000 mgr.a (mgr.14388) 15749 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:15:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:31 smithi027 bash[22610]: cluster 2024-08-31T08:15:30.205150+0000 mgr.a (mgr.14388) 15749 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:15:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:31 smithi191 bash[24992]: cluster 2024-08-31T08:15:30.205150+0000 mgr.a (mgr.14388) 15749 : cluster [DBG] pgmap v10919: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:15:33.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:15:33.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:15:33.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:15:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:33 smithi163 bash[24253]: cluster 2024-08-31T08:15:32.205933+0000 mgr.a (mgr.14388) 15750 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:15:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:33 smithi027 bash[22610]: cluster 2024-08-31T08:15:32.205933+0000 mgr.a (mgr.14388) 15750 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:15:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:33 smithi191 bash[24992]: cluster 2024-08-31T08:15:32.205933+0000 mgr.a (mgr.14388) 15750 : cluster [DBG] pgmap v10920: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:15:34.037 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:15:34.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:15:34.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:15:34.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:15:34.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:15:34.619 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:34 smithi163 bash[24253]: audit 2024-08-31T08:15:33.594976+0000 mgr.a (mgr.14388) 15751 : audit [DBG] from='client.340869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:34 smithi027 bash[22610]: audit 2024-08-31T08:15:33.594976+0000 mgr.a (mgr.14388) 15751 : audit [DBG] from='client.340869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:34 smithi191 bash[24992]: audit 2024-08-31T08:15:33.594976+0000 mgr.a (mgr.14388) 15751 : audit [DBG] from='client.340869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:35.681 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:35 smithi163 bash[24253]: cluster 2024-08-31T08:15:34.208692+0000 mgr.a (mgr.14388) 15752 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:35.709 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:35 smithi191 bash[24992]: cluster 2024-08-31T08:15:34.208692+0000 mgr.a (mgr.14388) 15752 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:35 smithi027 bash[22610]: cluster 2024-08-31T08:15:34.208692+0000 mgr.a (mgr.14388) 15752 : cluster [DBG] pgmap v10921: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:37.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22863]: debug 2024-08-31T08:15:37.304+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:15:37.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22863]: debug 2024-08-31T08:15:37.304+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:15:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22610]: cluster 2024-08-31T08:15:36.209518+0000 mgr.a (mgr.14388) 15753 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:15:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22610]: audit 2024-08-31T08:15:36.226549+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22610]: audit 2024-08-31T08:15:36.235282+0000 mon.a (mon.0) 2926 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22610]: audit 2024-08-31T08:15:36.504291+0000 mon.a (mon.0) 2927 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22610]: audit 2024-08-31T08:15:36.512986+0000 mon.a (mon.0) 2928 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22610]: audit 2024-08-31T08:15:36.515438+0000 mon.a (mon.0) 2929 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:15:37.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22610]: audit 2024-08-31T08:15:36.517387+0000 mon.a (mon.0) 2930 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:15:37.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22610]: audit 2024-08-31T08:15:36.528251+0000 mon.a (mon.0) 2931 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22610]: audit 2024-08-31T08:15:36.533333+0000 mon.a (mon.0) 2932 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:15:37.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:37 smithi027 bash[22610]: audit 2024-08-31T08:15:36.535816+0000 mgr.a (mgr.14388) 15754 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:15:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:37 smithi191 bash[24992]: cluster 2024-08-31T08:15:36.209518+0000 mgr.a (mgr.14388) 15753 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:15:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:37 smithi191 bash[24992]: audit 2024-08-31T08:15:36.226549+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:37 smithi191 bash[24992]: audit 2024-08-31T08:15:36.235282+0000 mon.a (mon.0) 2926 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:37 smithi191 bash[24992]: audit 2024-08-31T08:15:36.504291+0000 mon.a (mon.0) 2927 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:37 smithi191 bash[24992]: audit 2024-08-31T08:15:36.512986+0000 mon.a (mon.0) 2928 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:37 smithi191 bash[24992]: audit 2024-08-31T08:15:36.515438+0000 mon.a (mon.0) 2929 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:15:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:37 smithi191 bash[24992]: audit 2024-08-31T08:15:36.517387+0000 mon.a (mon.0) 2930 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:15:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:37 smithi191 bash[24992]: audit 2024-08-31T08:15:36.528251+0000 mon.a (mon.0) 2931 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:37 smithi191 bash[24992]: audit 2024-08-31T08:15:36.533333+0000 mon.a (mon.0) 2932 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:15:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:37 smithi191 bash[24992]: audit 2024-08-31T08:15:36.535816+0000 mgr.a (mgr.14388) 15754 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:15:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:37 smithi163 bash[24253]: cluster 2024-08-31T08:15:36.209518+0000 mgr.a (mgr.14388) 15753 : cluster [DBG] pgmap v10922: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:15:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:37 smithi163 bash[24253]: audit 2024-08-31T08:15:36.226549+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:37 smithi163 bash[24253]: audit 2024-08-31T08:15:36.235282+0000 mon.a (mon.0) 2926 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:37 smithi163 bash[24253]: audit 2024-08-31T08:15:36.504291+0000 mon.a (mon.0) 2927 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:37 smithi163 bash[24253]: audit 2024-08-31T08:15:36.512986+0000 mon.a (mon.0) 2928 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:37 smithi163 bash[24253]: audit 2024-08-31T08:15:36.515438+0000 mon.a (mon.0) 2929 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:15:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:37 smithi163 bash[24253]: audit 2024-08-31T08:15:36.517387+0000 mon.a (mon.0) 2930 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:15:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:37 smithi163 bash[24253]: audit 2024-08-31T08:15:36.528251+0000 mon.a (mon.0) 2931 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:15:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:37 smithi163 bash[24253]: audit 2024-08-31T08:15:36.533333+0000 mon.a (mon.0) 2932 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:15:37.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:37 smithi163 bash[24253]: audit 2024-08-31T08:15:36.535816+0000 mgr.a (mgr.14388) 15754 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:15:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:38 smithi027 bash[22610]: audit 2024-08-31T08:15:37.308624+0000 mgr.a (mgr.14388) 15755 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:15:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:38 smithi027 bash[22610]: cephadm 2024-08-31T08:15:37.309806+0000 mgr.a (mgr.14388) 15756 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:15:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:38 smithi191 bash[24992]: audit 2024-08-31T08:15:37.308624+0000 mgr.a (mgr.14388) 15755 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:15:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:38 smithi191 bash[24992]: cephadm 2024-08-31T08:15:37.309806+0000 mgr.a (mgr.14388) 15756 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:15:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:38 smithi163 bash[24253]: audit 2024-08-31T08:15:37.308624+0000 mgr.a (mgr.14388) 15755 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:15:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:38 smithi163 bash[24253]: cephadm 2024-08-31T08:15:37.309806+0000 mgr.a (mgr.14388) 15756 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:15:39.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:15:39.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:15:39.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:15:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:39 smithi191 bash[24992]: cluster 2024-08-31T08:15:38.211864+0000 mgr.a (mgr.14388) 15757 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:39 smithi163 bash[24253]: cluster 2024-08-31T08:15:38.211864+0000 mgr.a (mgr.14388) 15757 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:39 smithi027 bash[22610]: cluster 2024-08-31T08:15:38.211864+0000 mgr.a (mgr.14388) 15757 : cluster [DBG] pgmap v10923: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:39.789 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:15:39.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:15:39.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:15:39.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:15:39.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:15:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:40 smithi191 bash[24992]: audit 2024-08-31T08:15:39.372785+0000 mgr.a (mgr.14388) 15758 : audit [DBG] from='client.341052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:40 smithi163 bash[24253]: audit 2024-08-31T08:15:39.372785+0000 mgr.a (mgr.14388) 15758 : audit [DBG] from='client.341052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:40 smithi027 bash[22610]: audit 2024-08-31T08:15:39.372785+0000 mgr.a (mgr.14388) 15758 : audit [DBG] from='client.341052 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:41 smithi191 bash[24992]: cluster 2024-08-31T08:15:40.212763+0000 mgr.a (mgr.14388) 15759 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:41 smithi163 bash[24253]: cluster 2024-08-31T08:15:40.212763+0000 mgr.a (mgr.14388) 15759 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:41 smithi027 bash[22610]: cluster 2024-08-31T08:15:40.212763+0000 mgr.a (mgr.14388) 15759 : cluster [DBG] pgmap v10924: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:43 smithi191 bash[24992]: cluster 2024-08-31T08:15:42.213562+0000 mgr.a (mgr.14388) 15760 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:43 smithi163 bash[24253]: cluster 2024-08-31T08:15:42.213562+0000 mgr.a (mgr.14388) 15760 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:43 smithi027 bash[22610]: cluster 2024-08-31T08:15:42.213562+0000 mgr.a (mgr.14388) 15760 : cluster [DBG] pgmap v10925: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:44.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:15:44.792 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:15:44.792 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:15:45.538 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:15:45.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:15:45.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:15:45.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:15:45.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:15:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:45 smithi191 bash[24992]: cluster 2024-08-31T08:15:44.215787+0000 mgr.a (mgr.14388) 15761 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:45 smithi163 bash[24253]: cluster 2024-08-31T08:15:44.215787+0000 mgr.a (mgr.14388) 15761 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:45 smithi027 bash[22610]: cluster 2024-08-31T08:15:44.215787+0000 mgr.a (mgr.14388) 15761 : cluster [DBG] pgmap v10926: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:46 smithi191 bash[24992]: audit 2024-08-31T08:15:45.123666+0000 mgr.a (mgr.14388) 15762 : audit [DBG] from='client.341127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:46 smithi163 bash[24253]: audit 2024-08-31T08:15:45.123666+0000 mgr.a (mgr.14388) 15762 : audit [DBG] from='client.341127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:46 smithi027 bash[22610]: audit 2024-08-31T08:15:45.123666+0000 mgr.a (mgr.14388) 15762 : audit [DBG] from='client.341127 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:47 smithi191 bash[24992]: cluster 2024-08-31T08:15:46.216720+0000 mgr.a (mgr.14388) 15763 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:47 smithi163 bash[24253]: cluster 2024-08-31T08:15:46.216720+0000 mgr.a (mgr.14388) 15763 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:47 smithi027 bash[22610]: cluster 2024-08-31T08:15:46.216720+0000 mgr.a (mgr.14388) 15763 : cluster [DBG] pgmap v10927: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:49 smithi191 bash[24992]: cluster 2024-08-31T08:15:48.218882+0000 mgr.a (mgr.14388) 15764 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:49 smithi163 bash[24253]: cluster 2024-08-31T08:15:48.218882+0000 mgr.a (mgr.14388) 15764 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:49 smithi027 bash[22610]: cluster 2024-08-31T08:15:48.218882+0000 mgr.a (mgr.14388) 15764 : cluster [DBG] pgmap v10928: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:15:50.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:15:50.540 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:15:50.540 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:15:51.318 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:15:51.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:15:51.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:15:51.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:15:51.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:15:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:51 smithi191 bash[24992]: cluster 2024-08-31T08:15:50.219652+0000 mgr.a (mgr.14388) 15765 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:51 smithi163 bash[24253]: cluster 2024-08-31T08:15:50.219652+0000 mgr.a (mgr.14388) 15765 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:51 smithi027 bash[22610]: cluster 2024-08-31T08:15:50.219652+0000 mgr.a (mgr.14388) 15765 : cluster [DBG] pgmap v10929: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:52 smithi191 bash[24992]: audit 2024-08-31T08:15:50.876030+0000 mgr.a (mgr.14388) 15766 : audit [DBG] from='client.341205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:52 smithi163 bash[24253]: audit 2024-08-31T08:15:50.876030+0000 mgr.a (mgr.14388) 15766 : audit [DBG] from='client.341205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:52 smithi027 bash[22610]: audit 2024-08-31T08:15:50.876030+0000 mgr.a (mgr.14388) 15766 : audit [DBG] from='client.341205 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:53 smithi191 bash[24992]: cluster 2024-08-31T08:15:52.220735+0000 mgr.a (mgr.14388) 15767 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:53 smithi163 bash[24253]: cluster 2024-08-31T08:15:52.220735+0000 mgr.a (mgr.14388) 15767 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:53 smithi027 bash[22610]: cluster 2024-08-31T08:15:52.220735+0000 mgr.a (mgr.14388) 15767 : cluster [DBG] pgmap v10930: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:55 smithi163 bash[24253]: cluster 2024-08-31T08:15:54.223160+0000 mgr.a (mgr.14388) 15768 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:55.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:55 smithi027 bash[22610]: cluster 2024-08-31T08:15:54.223160+0000 mgr.a (mgr.14388) 15768 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:55 smithi191 bash[24992]: cluster 2024-08-31T08:15:54.223160+0000 mgr.a (mgr.14388) 15768 : cluster [DBG] pgmap v10931: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:56.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:15:56.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:15:56.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:15:57.091 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:15:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:15:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:15:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:15:57.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:15:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:57 smithi163 bash[24253]: cluster 2024-08-31T08:15:56.224079+0000 mgr.a (mgr.14388) 15769 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:57 smithi163 bash[24253]: audit 2024-08-31T08:15:56.654236+0000 mgr.a (mgr.14388) 15770 : audit [DBG] from='client.341283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:57.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:57 smithi027 bash[22610]: cluster 2024-08-31T08:15:56.224079+0000 mgr.a (mgr.14388) 15769 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:57.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:57 smithi027 bash[22610]: audit 2024-08-31T08:15:56.654236+0000 mgr.a (mgr.14388) 15770 : audit [DBG] from='client.341283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:57 smithi191 bash[24992]: cluster 2024-08-31T08:15:56.224079+0000 mgr.a (mgr.14388) 15769 : cluster [DBG] pgmap v10932: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:15:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:57 smithi191 bash[24992]: audit 2024-08-31T08:15:56.654236+0000 mgr.a (mgr.14388) 15770 : audit [DBG] from='client.341283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:15:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:15:59 smithi163 bash[24253]: cluster 2024-08-31T08:15:58.226537+0000 mgr.a (mgr.14388) 15771 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:15:59 smithi027 bash[22610]: cluster 2024-08-31T08:15:58.226537+0000 mgr.a (mgr.14388) 15771 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:15:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:15:59 smithi191 bash[24992]: cluster 2024-08-31T08:15:58.226537+0000 mgr.a (mgr.14388) 15771 : cluster [DBG] pgmap v10933: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:01 smithi163 bash[24253]: cluster 2024-08-31T08:16:00.227357+0000 mgr.a (mgr.14388) 15772 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:01 smithi027 bash[22610]: cluster 2024-08-31T08:16:00.227357+0000 mgr.a (mgr.14388) 15772 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:01 smithi191 bash[24992]: cluster 2024-08-31T08:16:00.227357+0000 mgr.a (mgr.14388) 15772 : cluster [DBG] pgmap v10934: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:02.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:02.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:02.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:02.846 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:16:02.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:16:02.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:16:02.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:16:02.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:16:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:03 smithi163 bash[24253]: cluster 2024-08-31T08:16:02.227788+0000 mgr.a (mgr.14388) 15773 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:03 smithi163 bash[24253]: audit 2024-08-31T08:16:02.425127+0000 mgr.a (mgr.14388) 15774 : audit [DBG] from='client.341361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:03 smithi027 bash[22610]: cluster 2024-08-31T08:16:02.227788+0000 mgr.a (mgr.14388) 15773 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:03 smithi027 bash[22610]: audit 2024-08-31T08:16:02.425127+0000 mgr.a (mgr.14388) 15774 : audit [DBG] from='client.341361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:03 smithi191 bash[24992]: cluster 2024-08-31T08:16:02.227788+0000 mgr.a (mgr.14388) 15773 : cluster [DBG] pgmap v10935: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:03 smithi191 bash[24992]: audit 2024-08-31T08:16:02.425127+0000 mgr.a (mgr.14388) 15774 : audit [DBG] from='client.341361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:05 smithi163 bash[24253]: cluster 2024-08-31T08:16:04.230034+0000 mgr.a (mgr.14388) 15775 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:05.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:05 smithi027 bash[22610]: cluster 2024-08-31T08:16:04.230034+0000 mgr.a (mgr.14388) 15775 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:05 smithi191 bash[24992]: cluster 2024-08-31T08:16:04.230034+0000 mgr.a (mgr.14388) 15775 : cluster [DBG] pgmap v10936: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:07 smithi163 bash[24253]: cluster 2024-08-31T08:16:06.230821+0000 mgr.a (mgr.14388) 15776 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:07 smithi027 bash[22610]: cluster 2024-08-31T08:16:06.230821+0000 mgr.a (mgr.14388) 15776 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:07 smithi191 bash[24992]: cluster 2024-08-31T08:16:06.230821+0000 mgr.a (mgr.14388) 15776 : cluster [DBG] pgmap v10937: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:07.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:07.849 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:07.849 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:08.596 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:16:08.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:16:08.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:16:08.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:16:08.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:16:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:09 smithi163 bash[24253]: audit 2024-08-31T08:16:08.180925+0000 mgr.a (mgr.14388) 15777 : audit [DBG] from='client.341433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:09 smithi163 bash[24253]: cluster 2024-08-31T08:16:08.233650+0000 mgr.a (mgr.14388) 15778 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:09 smithi027 bash[22610]: audit 2024-08-31T08:16:08.180925+0000 mgr.a (mgr.14388) 15777 : audit [DBG] from='client.341433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:09 smithi027 bash[22610]: cluster 2024-08-31T08:16:08.233650+0000 mgr.a (mgr.14388) 15778 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:09 smithi191 bash[24992]: audit 2024-08-31T08:16:08.180925+0000 mgr.a (mgr.14388) 15777 : audit [DBG] from='client.341433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:09 smithi191 bash[24992]: cluster 2024-08-31T08:16:08.233650+0000 mgr.a (mgr.14388) 15778 : cluster [DBG] pgmap v10938: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:11 smithi163 bash[24253]: cluster 2024-08-31T08:16:10.234603+0000 mgr.a (mgr.14388) 15779 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:16:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:11 smithi027 bash[22610]: cluster 2024-08-31T08:16:10.234603+0000 mgr.a (mgr.14388) 15779 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:16:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:11 smithi191 bash[24992]: cluster 2024-08-31T08:16:10.234603+0000 mgr.a (mgr.14388) 15779 : cluster [DBG] pgmap v10939: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:16:13.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:13.596 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:13.597 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:13 smithi163 bash[24253]: cluster 2024-08-31T08:16:12.235401+0000 mgr.a (mgr.14388) 15780 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:16:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:13 smithi027 bash[22610]: cluster 2024-08-31T08:16:12.235401+0000 mgr.a (mgr.14388) 15780 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:16:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:13 smithi191 bash[24992]: cluster 2024-08-31T08:16:12.235401+0000 mgr.a (mgr.14388) 15780 : cluster [DBG] pgmap v10940: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:16:14.364 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:16:14.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:16:14.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:16:14.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:16:14.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:16:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:15 smithi163 bash[24253]: audit 2024-08-31T08:16:13.928574+0000 mgr.a (mgr.14388) 15781 : audit [DBG] from='client.341511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:15 smithi163 bash[24253]: cluster 2024-08-31T08:16:14.236714+0000 mgr.a (mgr.14388) 15782 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:15.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:15 smithi027 bash[22610]: audit 2024-08-31T08:16:13.928574+0000 mgr.a (mgr.14388) 15781 : audit [DBG] from='client.341511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:15.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:15 smithi027 bash[22610]: cluster 2024-08-31T08:16:14.236714+0000 mgr.a (mgr.14388) 15782 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:15 smithi191 bash[24992]: audit 2024-08-31T08:16:13.928574+0000 mgr.a (mgr.14388) 15781 : audit [DBG] from='client.341511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:15 smithi191 bash[24992]: cluster 2024-08-31T08:16:14.236714+0000 mgr.a (mgr.14388) 15782 : cluster [DBG] pgmap v10941: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:17 smithi163 bash[24253]: cluster 2024-08-31T08:16:16.237582+0000 mgr.a (mgr.14388) 15783 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:16:17.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:17 smithi027 bash[22610]: cluster 2024-08-31T08:16:16.237582+0000 mgr.a (mgr.14388) 15783 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:16:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:17 smithi191 bash[24992]: cluster 2024-08-31T08:16:16.237582+0000 mgr.a (mgr.14388) 15783 : cluster [DBG] pgmap v10942: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:16:19.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:19.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:19.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:19 smithi163 bash[24253]: cluster 2024-08-31T08:16:18.239736+0000 mgr.a (mgr.14388) 15784 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:19 smithi027 bash[22610]: cluster 2024-08-31T08:16:18.239736+0000 mgr.a (mgr.14388) 15784 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:19 smithi191 bash[24992]: cluster 2024-08-31T08:16:18.239736+0000 mgr.a (mgr.14388) 15784 : cluster [DBG] pgmap v10943: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:20.116 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:16:20.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:16:20.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:16:20.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:16:20.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:16:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:20 smithi163 bash[24253]: audit 2024-08-31T08:16:19.697522+0000 mgr.a (mgr.14388) 15785 : audit [DBG] from='client.341589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:20 smithi027 bash[22610]: audit 2024-08-31T08:16:19.697522+0000 mgr.a (mgr.14388) 15785 : audit [DBG] from='client.341589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:20 smithi191 bash[24992]: audit 2024-08-31T08:16:19.697522+0000 mgr.a (mgr.14388) 15785 : audit [DBG] from='client.341589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:21 smithi163 bash[24253]: cluster 2024-08-31T08:16:20.240643+0000 mgr.a (mgr.14388) 15786 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:21.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:21 smithi027 bash[22610]: cluster 2024-08-31T08:16:20.240643+0000 mgr.a (mgr.14388) 15786 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:21 smithi191 bash[24992]: cluster 2024-08-31T08:16:20.240643+0000 mgr.a (mgr.14388) 15786 : cluster [DBG] pgmap v10944: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:23 smithi163 bash[24253]: cluster 2024-08-31T08:16:22.241449+0000 mgr.a (mgr.14388) 15787 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:23.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:23 smithi027 bash[22610]: cluster 2024-08-31T08:16:22.241449+0000 mgr.a (mgr.14388) 15787 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:23 smithi191 bash[24992]: cluster 2024-08-31T08:16:22.241449+0000 mgr.a (mgr.14388) 15787 : cluster [DBG] pgmap v10945: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:25.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:25.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:25.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:25 smithi163 bash[24253]: cluster 2024-08-31T08:16:24.243704+0000 mgr.a (mgr.14388) 15788 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:25 smithi027 bash[22610]: cluster 2024-08-31T08:16:24.243704+0000 mgr.a (mgr.14388) 15788 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:25 smithi191 bash[24992]: cluster 2024-08-31T08:16:24.243704+0000 mgr.a (mgr.14388) 15788 : cluster [DBG] pgmap v10946: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:25.870 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:16:25.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:16:25.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:16:25.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:16:25.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:16:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:26 smithi163 bash[24253]: audit 2024-08-31T08:16:25.450093+0000 mgr.a (mgr.14388) 15789 : audit [DBG] from='client.341664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:26 smithi027 bash[22610]: audit 2024-08-31T08:16:25.450093+0000 mgr.a (mgr.14388) 15789 : audit [DBG] from='client.341664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:26 smithi191 bash[24992]: audit 2024-08-31T08:16:25.450093+0000 mgr.a (mgr.14388) 15789 : audit [DBG] from='client.341664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:27 smithi163 bash[24253]: cluster 2024-08-31T08:16:26.244766+0000 mgr.a (mgr.14388) 15790 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:27 smithi027 bash[22610]: cluster 2024-08-31T08:16:26.244766+0000 mgr.a (mgr.14388) 15790 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:27 smithi191 bash[24992]: cluster 2024-08-31T08:16:26.244766+0000 mgr.a (mgr.14388) 15790 : cluster [DBG] pgmap v10947: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:29 smithi163 bash[24253]: cluster 2024-08-31T08:16:28.247111+0000 mgr.a (mgr.14388) 15791 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:29 smithi027 bash[22610]: cluster 2024-08-31T08:16:28.247111+0000 mgr.a (mgr.14388) 15791 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:29 smithi191 bash[24992]: cluster 2024-08-31T08:16:28.247111+0000 mgr.a (mgr.14388) 15791 : cluster [DBG] pgmap v10948: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:30.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:30.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:30.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:31.655 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:16:31.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:16:31.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:16:31.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:16:31.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:16:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:31 smithi163 bash[24253]: cluster 2024-08-31T08:16:30.248039+0000 mgr.a (mgr.14388) 15792 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:31 smithi027 bash[22610]: cluster 2024-08-31T08:16:30.248039+0000 mgr.a (mgr.14388) 15792 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:31 smithi191 bash[24992]: cluster 2024-08-31T08:16:30.248039+0000 mgr.a (mgr.14388) 15792 : cluster [DBG] pgmap v10949: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:32 smithi163 bash[24253]: audit 2024-08-31T08:16:31.206439+0000 mgr.a (mgr.14388) 15793 : audit [DBG] from='client.341736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:32 smithi027 bash[22610]: audit 2024-08-31T08:16:31.206439+0000 mgr.a (mgr.14388) 15793 : audit [DBG] from='client.341736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:32 smithi191 bash[24992]: audit 2024-08-31T08:16:31.206439+0000 mgr.a (mgr.14388) 15793 : audit [DBG] from='client.341736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:33 smithi163 bash[24253]: cluster 2024-08-31T08:16:32.249051+0000 mgr.a (mgr.14388) 15794 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:33 smithi027 bash[22610]: cluster 2024-08-31T08:16:32.249051+0000 mgr.a (mgr.14388) 15794 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:33 smithi191 bash[24992]: cluster 2024-08-31T08:16:32.249051+0000 mgr.a (mgr.14388) 15794 : cluster [DBG] pgmap v10950: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:35 smithi163 bash[24253]: cluster 2024-08-31T08:16:34.251307+0000 mgr.a (mgr.14388) 15795 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:35 smithi027 bash[22610]: cluster 2024-08-31T08:16:34.251307+0000 mgr.a (mgr.14388) 15795 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:35 smithi191 bash[24992]: cluster 2024-08-31T08:16:34.251307+0000 mgr.a (mgr.14388) 15795 : cluster [DBG] pgmap v10951: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:36.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:36.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:36.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:37.406 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:16:37.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:16:37.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:16:37.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:16:37.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:16:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:37 smithi163 bash[24253]: cluster 2024-08-31T08:16:36.252076+0000 mgr.a (mgr.14388) 15796 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:37 smithi163 bash[24253]: audit 2024-08-31T08:16:37.366464+0000 mon.a (mon.0) 2933 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:16:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:37 smithi027 bash[22610]: cluster 2024-08-31T08:16:36.252076+0000 mgr.a (mgr.14388) 15796 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:37 smithi027 bash[22610]: audit 2024-08-31T08:16:37.366464+0000 mon.a (mon.0) 2933 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:16:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:37 smithi191 bash[24992]: cluster 2024-08-31T08:16:36.252076+0000 mgr.a (mgr.14388) 15796 : cluster [DBG] pgmap v10952: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:37 smithi191 bash[24992]: audit 2024-08-31T08:16:37.366464+0000 mon.a (mon.0) 2933 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:16:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:38 smithi163 bash[24253]: audit 2024-08-31T08:16:36.983524+0000 mgr.a (mgr.14388) 15797 : audit [DBG] from='client.341814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:38 smithi163 bash[24253]: audit 2024-08-31T08:16:38.133285+0000 mon.a (mon.0) 2934 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:16:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:38 smithi163 bash[24253]: audit 2024-08-31T08:16:38.134941+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:16:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:38 smithi163 bash[24253]: audit 2024-08-31T08:16:38.144789+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:16:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:38 smithi163 bash[24253]: audit 2024-08-31T08:16:38.149578+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:16:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:38 smithi027 bash[22610]: audit 2024-08-31T08:16:36.983524+0000 mgr.a (mgr.14388) 15797 : audit [DBG] from='client.341814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:38 smithi027 bash[22610]: audit 2024-08-31T08:16:38.133285+0000 mon.a (mon.0) 2934 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:16:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:38 smithi027 bash[22610]: audit 2024-08-31T08:16:38.134941+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:16:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:38 smithi027 bash[22610]: audit 2024-08-31T08:16:38.144789+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:16:38.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:38 smithi027 bash[22610]: audit 2024-08-31T08:16:38.149578+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:16:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:38 smithi191 bash[24992]: audit 2024-08-31T08:16:36.983524+0000 mgr.a (mgr.14388) 15797 : audit [DBG] from='client.341814 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:38 smithi191 bash[24992]: audit 2024-08-31T08:16:38.133285+0000 mon.a (mon.0) 2934 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:16:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:38 smithi191 bash[24992]: audit 2024-08-31T08:16:38.134941+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:16:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:38 smithi191 bash[24992]: audit 2024-08-31T08:16:38.144789+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:16:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:38 smithi191 bash[24992]: audit 2024-08-31T08:16:38.149578+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:16:39.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:16:38 smithi027 bash[22863]: debug 2024-08-31T08:16:38.878+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:16:39.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:16:38 smithi027 bash[22863]: debug 2024-08-31T08:16:38.878+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:16:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:39 smithi163 bash[24253]: audit 2024-08-31T08:16:38.152174+0000 mgr.a (mgr.14388) 15798 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:16:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:39 smithi163 bash[24253]: cluster 2024-08-31T08:16:38.253583+0000 mgr.a (mgr.14388) 15799 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:39 smithi027 bash[22610]: audit 2024-08-31T08:16:38.152174+0000 mgr.a (mgr.14388) 15798 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:16:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:39 smithi027 bash[22610]: cluster 2024-08-31T08:16:38.253583+0000 mgr.a (mgr.14388) 15799 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:39 smithi191 bash[24992]: audit 2024-08-31T08:16:38.152174+0000 mgr.a (mgr.14388) 15798 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:16:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:39 smithi191 bash[24992]: cluster 2024-08-31T08:16:38.253583+0000 mgr.a (mgr.14388) 15799 : cluster [DBG] pgmap v10953: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:40 smithi163 bash[24253]: audit 2024-08-31T08:16:38.885459+0000 mgr.a (mgr.14388) 15800 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:16:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:40 smithi163 bash[24253]: cephadm 2024-08-31T08:16:38.886690+0000 mgr.a (mgr.14388) 15801 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:16:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:40 smithi027 bash[22610]: audit 2024-08-31T08:16:38.885459+0000 mgr.a (mgr.14388) 15800 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:16:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:40 smithi027 bash[22610]: cephadm 2024-08-31T08:16:38.886690+0000 mgr.a (mgr.14388) 15801 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:16:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:40 smithi191 bash[24992]: audit 2024-08-31T08:16:38.885459+0000 mgr.a (mgr.14388) 15800 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:16:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:40 smithi191 bash[24992]: cephadm 2024-08-31T08:16:38.886690+0000 mgr.a (mgr.14388) 15801 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:16:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:41 smithi163 bash[24253]: cluster 2024-08-31T08:16:40.254461+0000 mgr.a (mgr.14388) 15802 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:41 smithi027 bash[22610]: cluster 2024-08-31T08:16:40.254461+0000 mgr.a (mgr.14388) 15802 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:41 smithi191 bash[24992]: cluster 2024-08-31T08:16:40.254461+0000 mgr.a (mgr.14388) 15802 : cluster [DBG] pgmap v10954: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:42.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:42.409 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:43.157 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:16:43.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:16:43.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:16:43.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:16:43.157 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:16:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:43 smithi163 bash[24253]: cluster 2024-08-31T08:16:42.255266+0000 mgr.a (mgr.14388) 15803 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:43 smithi163 bash[24253]: audit 2024-08-31T08:16:42.737433+0000 mgr.a (mgr.14388) 15804 : audit [DBG] from='client.341997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:43 smithi027 bash[22610]: cluster 2024-08-31T08:16:42.255266+0000 mgr.a (mgr.14388) 15803 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:43 smithi027 bash[22610]: audit 2024-08-31T08:16:42.737433+0000 mgr.a (mgr.14388) 15804 : audit [DBG] from='client.341997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:43 smithi191 bash[24992]: cluster 2024-08-31T08:16:42.255266+0000 mgr.a (mgr.14388) 15803 : cluster [DBG] pgmap v10955: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:43 smithi191 bash[24992]: audit 2024-08-31T08:16:42.737433+0000 mgr.a (mgr.14388) 15804 : audit [DBG] from='client.341997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:45 smithi163 bash[24253]: cluster 2024-08-31T08:16:44.257984+0000 mgr.a (mgr.14388) 15805 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:16:45.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:45 smithi027 bash[22610]: cluster 2024-08-31T08:16:44.257984+0000 mgr.a (mgr.14388) 15805 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:16:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:45 smithi191 bash[24992]: cluster 2024-08-31T08:16:44.257984+0000 mgr.a (mgr.14388) 15805 : cluster [DBG] pgmap v10956: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:16:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:47 smithi163 bash[24253]: cluster 2024-08-31T08:16:46.258815+0000 mgr.a (mgr.14388) 15806 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:16:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:47 smithi027 bash[22610]: cluster 2024-08-31T08:16:46.258815+0000 mgr.a (mgr.14388) 15806 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:16:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:47 smithi191 bash[24992]: cluster 2024-08-31T08:16:46.258815+0000 mgr.a (mgr.14388) 15806 : cluster [DBG] pgmap v10957: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:16:48.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:48.159 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:48.159 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:48.909 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:16:48.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:16:48.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:16:48.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:16:48.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:16:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:49 smithi163 bash[24253]: cluster 2024-08-31T08:16:48.259814+0000 mgr.a (mgr.14388) 15807 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:16:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:49 smithi163 bash[24253]: audit 2024-08-31T08:16:48.494309+0000 mgr.a (mgr.14388) 15808 : audit [DBG] from='client.342075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:49 smithi027 bash[22610]: cluster 2024-08-31T08:16:48.259814+0000 mgr.a (mgr.14388) 15807 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:16:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:49 smithi027 bash[22610]: audit 2024-08-31T08:16:48.494309+0000 mgr.a (mgr.14388) 15808 : audit [DBG] from='client.342075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:49 smithi191 bash[24992]: cluster 2024-08-31T08:16:48.259814+0000 mgr.a (mgr.14388) 15807 : cluster [DBG] pgmap v10958: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:16:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:49 smithi191 bash[24992]: audit 2024-08-31T08:16:48.494309+0000 mgr.a (mgr.14388) 15808 : audit [DBG] from='client.342075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:51 smithi163 bash[24253]: cluster 2024-08-31T08:16:50.260646+0000 mgr.a (mgr.14388) 15809 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:16:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:51 smithi027 bash[22610]: cluster 2024-08-31T08:16:50.260646+0000 mgr.a (mgr.14388) 15809 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:16:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:51 smithi191 bash[24992]: cluster 2024-08-31T08:16:50.260646+0000 mgr.a (mgr.14388) 15809 : cluster [DBG] pgmap v10959: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:16:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:53 smithi027 bash[22610]: cluster 2024-08-31T08:16:52.261445+0000 mgr.a (mgr.14388) 15810 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:16:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:53 smithi191 bash[24992]: cluster 2024-08-31T08:16:52.261445+0000 mgr.a (mgr.14388) 15810 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:16:53.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:53 smithi163 bash[24253]: cluster 2024-08-31T08:16:52.261445+0000 mgr.a (mgr.14388) 15810 : cluster [DBG] pgmap v10960: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:16:54.697 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:16:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:16:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:16:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:16:54.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:16:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:55 smithi027 bash[22610]: audit 2024-08-31T08:16:54.249559+0000 mgr.a (mgr.14388) 15811 : audit [DBG] from='client.342147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:55.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:55 smithi027 bash[22610]: cluster 2024-08-31T08:16:54.270541+0000 mgr.a (mgr.14388) 15812 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:16:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:55 smithi191 bash[24992]: audit 2024-08-31T08:16:54.249559+0000 mgr.a (mgr.14388) 15811 : audit [DBG] from='client.342147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:55 smithi191 bash[24992]: cluster 2024-08-31T08:16:54.270541+0000 mgr.a (mgr.14388) 15812 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:16:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:55 smithi163 bash[24253]: audit 2024-08-31T08:16:54.249559+0000 mgr.a (mgr.14388) 15811 : audit [DBG] from='client.342147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:16:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:55 smithi163 bash[24253]: cluster 2024-08-31T08:16:54.270541+0000 mgr.a (mgr.14388) 15812 : cluster [DBG] pgmap v10961: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:16:57.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:57 smithi027 bash[22610]: cluster 2024-08-31T08:16:56.271559+0000 mgr.a (mgr.14388) 15813 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:57 smithi191 bash[24992]: cluster 2024-08-31T08:16:56.271559+0000 mgr.a (mgr.14388) 15813 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:57 smithi163 bash[24253]: cluster 2024-08-31T08:16:56.271559+0000 mgr.a (mgr.14388) 15813 : cluster [DBG] pgmap v10962: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:16:59.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:16:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:16:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:16:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:16:59 smithi027 bash[22610]: cluster 2024-08-31T08:16:58.273695+0000 mgr.a (mgr.14388) 15814 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:16:59 smithi191 bash[24992]: cluster 2024-08-31T08:16:58.273695+0000 mgr.a (mgr.14388) 15814 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:16:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:16:59 smithi163 bash[24253]: cluster 2024-08-31T08:16:58.273695+0000 mgr.a (mgr.14388) 15814 : cluster [DBG] pgmap v10963: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:00.510 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:00.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:01 smithi027 bash[22610]: audit 2024-08-31T08:17:00.067073+0000 mgr.a (mgr.14388) 15815 : audit [DBG] from='client.342225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:01.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:01 smithi027 bash[22610]: cluster 2024-08-31T08:17:00.274223+0000 mgr.a (mgr.14388) 15816 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:01 smithi191 bash[24992]: audit 2024-08-31T08:17:00.067073+0000 mgr.a (mgr.14388) 15815 : audit [DBG] from='client.342225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:01 smithi191 bash[24992]: cluster 2024-08-31T08:17:00.274223+0000 mgr.a (mgr.14388) 15816 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:01 smithi163 bash[24253]: audit 2024-08-31T08:17:00.067073+0000 mgr.a (mgr.14388) 15815 : audit [DBG] from='client.342225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:01 smithi163 bash[24253]: cluster 2024-08-31T08:17:00.274223+0000 mgr.a (mgr.14388) 15816 : cluster [DBG] pgmap v10964: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:03.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:03 smithi027 bash[22610]: cluster 2024-08-31T08:17:02.275065+0000 mgr.a (mgr.14388) 15817 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:03 smithi191 bash[24992]: cluster 2024-08-31T08:17:02.275065+0000 mgr.a (mgr.14388) 15817 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:03 smithi163 bash[24253]: cluster 2024-08-31T08:17:02.275065+0000 mgr.a (mgr.14388) 15817 : cluster [DBG] pgmap v10965: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:05.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:17:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:17:05.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:17:05.736 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:05 smithi027 bash[22610]: cluster 2024-08-31T08:17:04.277317+0000 mgr.a (mgr.14388) 15818 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:05 smithi191 bash[24992]: cluster 2024-08-31T08:17:04.277317+0000 mgr.a (mgr.14388) 15818 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:05 smithi163 bash[24253]: cluster 2024-08-31T08:17:04.277317+0000 mgr.a (mgr.14388) 15818 : cluster [DBG] pgmap v10966: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:06.290 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:06.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:06.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:06.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:06.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:07 smithi027 bash[22610]: audit 2024-08-31T08:17:05.850947+0000 mgr.a (mgr.14388) 15819 : audit [DBG] from='client.342300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:07.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:07 smithi027 bash[22610]: cluster 2024-08-31T08:17:06.277832+0000 mgr.a (mgr.14388) 15820 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:07 smithi191 bash[24992]: audit 2024-08-31T08:17:05.850947+0000 mgr.a (mgr.14388) 15819 : audit [DBG] from='client.342300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:07 smithi191 bash[24992]: cluster 2024-08-31T08:17:06.277832+0000 mgr.a (mgr.14388) 15820 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:07 smithi163 bash[24253]: audit 2024-08-31T08:17:05.850947+0000 mgr.a (mgr.14388) 15819 : audit [DBG] from='client.342300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:07 smithi163 bash[24253]: cluster 2024-08-31T08:17:06.277832+0000 mgr.a (mgr.14388) 15820 : cluster [DBG] pgmap v10967: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:09.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:09 smithi027 bash[22610]: cluster 2024-08-31T08:17:08.279963+0000 mgr.a (mgr.14388) 15821 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:09 smithi191 bash[24992]: cluster 2024-08-31T08:17:08.279963+0000 mgr.a (mgr.14388) 15821 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:09 smithi163 bash[24253]: cluster 2024-08-31T08:17:08.279963+0000 mgr.a (mgr.14388) 15821 : cluster [DBG] pgmap v10968: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:11.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:17:11.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:17:11.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:17:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:11 smithi163 bash[24253]: cluster 2024-08-31T08:17:10.280730+0000 mgr.a (mgr.14388) 15822 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:11 smithi027 bash[22610]: cluster 2024-08-31T08:17:10.280730+0000 mgr.a (mgr.14388) 15822 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:11 smithi191 bash[24992]: cluster 2024-08-31T08:17:10.280730+0000 mgr.a (mgr.14388) 15822 : cluster [DBG] pgmap v10969: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:12.041 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:12.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:12.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:12.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:12.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:12 smithi163 bash[24253]: audit 2024-08-31T08:17:11.626853+0000 mgr.a (mgr.14388) 15823 : audit [DBG] from='client.342378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:12 smithi027 bash[22610]: audit 2024-08-31T08:17:11.626853+0000 mgr.a (mgr.14388) 15823 : audit [DBG] from='client.342378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:12 smithi191 bash[24992]: audit 2024-08-31T08:17:11.626853+0000 mgr.a (mgr.14388) 15823 : audit [DBG] from='client.342378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:13 smithi163 bash[24253]: cluster 2024-08-31T08:17:12.281657+0000 mgr.a (mgr.14388) 15824 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:13 smithi027 bash[22610]: cluster 2024-08-31T08:17:12.281657+0000 mgr.a (mgr.14388) 15824 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:13 smithi191 bash[24992]: cluster 2024-08-31T08:17:12.281657+0000 mgr.a (mgr.14388) 15824 : cluster [DBG] pgmap v10970: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:15 smithi163 bash[24253]: cluster 2024-08-31T08:17:14.283921+0000 mgr.a (mgr.14388) 15825 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:15 smithi027 bash[22610]: cluster 2024-08-31T08:17:14.283921+0000 mgr.a (mgr.14388) 15825 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:15 smithi191 bash[24992]: cluster 2024-08-31T08:17:14.283921+0000 mgr.a (mgr.14388) 15825 : cluster [DBG] pgmap v10971: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:17.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:17:17.044 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:17:17.044 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:17:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:17 smithi163 bash[24253]: cluster 2024-08-31T08:17:16.284669+0000 mgr.a (mgr.14388) 15826 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:17 smithi027 bash[22610]: cluster 2024-08-31T08:17:16.284669+0000 mgr.a (mgr.14388) 15826 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:17 smithi191 bash[24992]: cluster 2024-08-31T08:17:16.284669+0000 mgr.a (mgr.14388) 15826 : cluster [DBG] pgmap v10972: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:17.824 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:17.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:17.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:17.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:17.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:18 smithi163 bash[24253]: audit 2024-08-31T08:17:17.383664+0000 mgr.a (mgr.14388) 15827 : audit [DBG] from='client.342453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:18 smithi027 bash[22610]: audit 2024-08-31T08:17:17.383664+0000 mgr.a (mgr.14388) 15827 : audit [DBG] from='client.342453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:18 smithi191 bash[24992]: audit 2024-08-31T08:17:17.383664+0000 mgr.a (mgr.14388) 15827 : audit [DBG] from='client.342453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:19 smithi163 bash[24253]: cluster 2024-08-31T08:17:18.287124+0000 mgr.a (mgr.14388) 15828 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:19 smithi027 bash[22610]: cluster 2024-08-31T08:17:18.287124+0000 mgr.a (mgr.14388) 15828 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:19 smithi191 bash[24992]: cluster 2024-08-31T08:17:18.287124+0000 mgr.a (mgr.14388) 15828 : cluster [DBG] pgmap v10973: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:21 smithi163 bash[24253]: cluster 2024-08-31T08:17:20.287913+0000 mgr.a (mgr.14388) 15829 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:21 smithi027 bash[22610]: cluster 2024-08-31T08:17:20.287913+0000 mgr.a (mgr.14388) 15829 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:21 smithi191 bash[24992]: cluster 2024-08-31T08:17:20.287913+0000 mgr.a (mgr.14388) 15829 : cluster [DBG] pgmap v10974: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:22.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:17:22.826 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:17:22.826 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:17:23.595 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:23.595 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:23.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:23.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:23.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:23 smithi163 bash[24253]: cluster 2024-08-31T08:17:22.288669+0000 mgr.a (mgr.14388) 15830 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:23 smithi027 bash[22610]: cluster 2024-08-31T08:17:22.288669+0000 mgr.a (mgr.14388) 15830 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:23 smithi191 bash[24992]: cluster 2024-08-31T08:17:22.288669+0000 mgr.a (mgr.14388) 15830 : cluster [DBG] pgmap v10975: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:24 smithi163 bash[24253]: audit 2024-08-31T08:17:23.158100+0000 mgr.a (mgr.14388) 15831 : audit [DBG] from='client.342531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:24 smithi027 bash[22610]: audit 2024-08-31T08:17:23.158100+0000 mgr.a (mgr.14388) 15831 : audit [DBG] from='client.342531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:24 smithi191 bash[24992]: audit 2024-08-31T08:17:23.158100+0000 mgr.a (mgr.14388) 15831 : audit [DBG] from='client.342531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:25 smithi163 bash[24253]: cluster 2024-08-31T08:17:24.291413+0000 mgr.a (mgr.14388) 15832 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:25 smithi027 bash[22610]: cluster 2024-08-31T08:17:24.291413+0000 mgr.a (mgr.14388) 15832 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:25 smithi191 bash[24992]: cluster 2024-08-31T08:17:24.291413+0000 mgr.a (mgr.14388) 15832 : cluster [DBG] pgmap v10976: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:27 smithi163 bash[24253]: cluster 2024-08-31T08:17:26.292172+0000 mgr.a (mgr.14388) 15833 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:17:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:27 smithi027 bash[22610]: cluster 2024-08-31T08:17:26.292172+0000 mgr.a (mgr.14388) 15833 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:17:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:27 smithi191 bash[24992]: cluster 2024-08-31T08:17:26.292172+0000 mgr.a (mgr.14388) 15833 : cluster [DBG] pgmap v10977: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:17:28.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:17:28.598 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:17:28.598 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:17:29.368 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:29.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:29.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:29.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:29.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:29 smithi163 bash[24253]: cluster 2024-08-31T08:17:28.294099+0000 mgr.a (mgr.14388) 15834 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:29 smithi027 bash[22610]: cluster 2024-08-31T08:17:28.294099+0000 mgr.a (mgr.14388) 15834 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:29 smithi191 bash[24992]: cluster 2024-08-31T08:17:28.294099+0000 mgr.a (mgr.14388) 15834 : cluster [DBG] pgmap v10978: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:30 smithi163 bash[24253]: audit 2024-08-31T08:17:28.935250+0000 mgr.a (mgr.14388) 15835 : audit [DBG] from='client.342606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:30 smithi027 bash[22610]: audit 2024-08-31T08:17:28.935250+0000 mgr.a (mgr.14388) 15835 : audit [DBG] from='client.342606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:30 smithi191 bash[24992]: audit 2024-08-31T08:17:28.935250+0000 mgr.a (mgr.14388) 15835 : audit [DBG] from='client.342606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:31 smithi163 bash[24253]: cluster 2024-08-31T08:17:30.295026+0000 mgr.a (mgr.14388) 15836 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:17:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:31 smithi027 bash[22610]: cluster 2024-08-31T08:17:30.295026+0000 mgr.a (mgr.14388) 15836 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:17:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:31 smithi191 bash[24992]: cluster 2024-08-31T08:17:30.295026+0000 mgr.a (mgr.14388) 15836 : cluster [DBG] pgmap v10979: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:17:33.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:33 smithi163 bash[24253]: cluster 2024-08-31T08:17:32.295826+0000 mgr.a (mgr.14388) 15837 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:17:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:33 smithi027 bash[22610]: cluster 2024-08-31T08:17:32.295826+0000 mgr.a (mgr.14388) 15837 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:17:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:33 smithi191 bash[24992]: cluster 2024-08-31T08:17:32.295826+0000 mgr.a (mgr.14388) 15837 : cluster [DBG] pgmap v10980: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:17:34.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:17:34.370 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:17:34.370 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:17:35.128 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:35.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:35.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:35.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:35.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:35 smithi163 bash[24253]: cluster 2024-08-31T08:17:34.298032+0000 mgr.a (mgr.14388) 15838 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:35 smithi163 bash[24253]: audit 2024-08-31T08:17:34.701262+0000 mgr.a (mgr.14388) 15839 : audit [DBG] from='client.342684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:35 smithi027 bash[22610]: cluster 2024-08-31T08:17:34.298032+0000 mgr.a (mgr.14388) 15838 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:35 smithi027 bash[22610]: audit 2024-08-31T08:17:34.701262+0000 mgr.a (mgr.14388) 15839 : audit [DBG] from='client.342684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:35 smithi191 bash[24992]: cluster 2024-08-31T08:17:34.298032+0000 mgr.a (mgr.14388) 15838 : cluster [DBG] pgmap v10981: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:35 smithi191 bash[24992]: audit 2024-08-31T08:17:34.701262+0000 mgr.a (mgr.14388) 15839 : audit [DBG] from='client.342684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:37 smithi163 bash[24253]: cluster 2024-08-31T08:17:36.298936+0000 mgr.a (mgr.14388) 15840 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:37 smithi027 bash[22610]: cluster 2024-08-31T08:17:36.298936+0000 mgr.a (mgr.14388) 15840 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:37 smithi191 bash[24992]: cluster 2024-08-31T08:17:36.298936+0000 mgr.a (mgr.14388) 15840 : cluster [DBG] pgmap v10982: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:39 smithi163 bash[24253]: cluster 2024-08-31T08:17:38.301076+0000 mgr.a (mgr.14388) 15841 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:39.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:39 smithi163 bash[24253]: audit 2024-08-31T08:17:38.937259+0000 mon.a (mon.0) 2938 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:17:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:39 smithi027 bash[22610]: cluster 2024-08-31T08:17:38.301076+0000 mgr.a (mgr.14388) 15841 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:39 smithi027 bash[22610]: audit 2024-08-31T08:17:38.937259+0000 mon.a (mon.0) 2938 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:17:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:39 smithi191 bash[24992]: cluster 2024-08-31T08:17:38.301076+0000 mgr.a (mgr.14388) 15841 : cluster [DBG] pgmap v10983: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:17:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:39 smithi191 bash[24992]: audit 2024-08-31T08:17:38.937259+0000 mon.a (mon.0) 2938 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:17:40.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:17:40.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:17:40.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:17:41.297 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22863]: debug 2024-08-31T08:17:41.033+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:17:41.297 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22863]: debug 2024-08-31T08:17:41.045+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:17:41.440 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:41.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:41.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:41.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:41.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.297062+0000 mon.a (mon.0) 2939 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.300294+0000 mon.a (mon.0) 2940 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: cluster 2024-08-31T08:17:40.301492+0000 mgr.a (mgr.14388) 15842 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.303038+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.305774+0000 mon.a (mon.0) 2942 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.308357+0000 mon.a (mon.0) 2943 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.310972+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.311805+0000 mon.a (mon.0) 2945 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.312540+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.317103+0000 mon.a (mon.0) 2947 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.319120+0000 mon.a (mon.0) 2948 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.320062+0000 mgr.a (mgr.14388) 15843 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:17:41.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:41 smithi163 bash[24253]: audit 2024-08-31T08:17:40.466987+0000 mgr.a (mgr.14388) 15844 : audit [DBG] from='client.342762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.297062+0000 mon.a (mon.0) 2939 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.300294+0000 mon.a (mon.0) 2940 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: cluster 2024-08-31T08:17:40.301492+0000 mgr.a (mgr.14388) 15842 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.303038+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.305774+0000 mon.a (mon.0) 2942 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.308357+0000 mon.a (mon.0) 2943 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.310972+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.311805+0000 mon.a (mon.0) 2945 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:17:41.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.312540+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:17:41.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.317103+0000 mon.a (mon.0) 2947 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.319120+0000 mon.a (mon.0) 2948 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:17:41.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.320062+0000 mgr.a (mgr.14388) 15843 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:17:41.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:41 smithi027 bash[22610]: audit 2024-08-31T08:17:40.466987+0000 mgr.a (mgr.14388) 15844 : audit [DBG] from='client.342762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.297062+0000 mon.a (mon.0) 2939 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.300294+0000 mon.a (mon.0) 2940 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: cluster 2024-08-31T08:17:40.301492+0000 mgr.a (mgr.14388) 15842 : cluster [DBG] pgmap v10984: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.303038+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.305774+0000 mon.a (mon.0) 2942 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.308357+0000 mon.a (mon.0) 2943 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.310972+0000 mon.a (mon.0) 2944 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.311805+0000 mon.a (mon.0) 2945 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:17:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.312540+0000 mon.a (mon.0) 2946 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:17:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.317103+0000 mon.a (mon.0) 2947 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:17:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.319120+0000 mon.a (mon.0) 2948 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:17:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.320062+0000 mgr.a (mgr.14388) 15843 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:17:41.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:41 smithi191 bash[24992]: audit 2024-08-31T08:17:40.466987+0000 mgr.a (mgr.14388) 15844 : audit [DBG] from='client.342762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:42 smithi163 bash[24253]: audit 2024-08-31T08:17:41.036058+0000 mgr.a (mgr.14388) 15845 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:17:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:42 smithi163 bash[24253]: cephadm 2024-08-31T08:17:41.049605+0000 mgr.a (mgr.14388) 15846 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:17:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:42 smithi027 bash[22610]: audit 2024-08-31T08:17:41.036058+0000 mgr.a (mgr.14388) 15845 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:17:42.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:42 smithi027 bash[22610]: cephadm 2024-08-31T08:17:41.049605+0000 mgr.a (mgr.14388) 15846 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:17:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:42 smithi191 bash[24992]: audit 2024-08-31T08:17:41.036058+0000 mgr.a (mgr.14388) 15845 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:17:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:42 smithi191 bash[24992]: cephadm 2024-08-31T08:17:41.049605+0000 mgr.a (mgr.14388) 15846 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:17:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:43 smithi163 bash[24253]: cluster 2024-08-31T08:17:42.302484+0000 mgr.a (mgr.14388) 15847 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:43 smithi027 bash[22610]: cluster 2024-08-31T08:17:42.302484+0000 mgr.a (mgr.14388) 15847 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:43 smithi191 bash[24992]: cluster 2024-08-31T08:17:42.302484+0000 mgr.a (mgr.14388) 15847 : cluster [DBG] pgmap v10985: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:45 smithi163 bash[24253]: cluster 2024-08-31T08:17:44.304754+0000 mgr.a (mgr.14388) 15848 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:45 smithi027 bash[22610]: cluster 2024-08-31T08:17:44.304754+0000 mgr.a (mgr.14388) 15848 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:45 smithi191 bash[24992]: cluster 2024-08-31T08:17:44.304754+0000 mgr.a (mgr.14388) 15848 : cluster [DBG] pgmap v10986: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:46.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:17:46.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:17:46.443 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:17:47.235 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:47.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:47.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:47.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:47.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:47 smithi163 bash[24253]: cluster 2024-08-31T08:17:46.305690+0000 mgr.a (mgr.14388) 15849 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:47 smithi163 bash[24253]: audit 2024-08-31T08:17:46.779944+0000 mgr.a (mgr.14388) 15850 : audit [DBG] from='client.342942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:47 smithi027 bash[22610]: cluster 2024-08-31T08:17:46.305690+0000 mgr.a (mgr.14388) 15849 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:47.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:47 smithi027 bash[22610]: audit 2024-08-31T08:17:46.779944+0000 mgr.a (mgr.14388) 15850 : audit [DBG] from='client.342942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:47 smithi191 bash[24992]: cluster 2024-08-31T08:17:46.305690+0000 mgr.a (mgr.14388) 15849 : cluster [DBG] pgmap v10987: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:47 smithi191 bash[24992]: audit 2024-08-31T08:17:46.779944+0000 mgr.a (mgr.14388) 15850 : audit [DBG] from='client.342942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:49 smithi163 bash[24253]: cluster 2024-08-31T08:17:48.308122+0000 mgr.a (mgr.14388) 15851 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:49 smithi027 bash[22610]: cluster 2024-08-31T08:17:48.308122+0000 mgr.a (mgr.14388) 15851 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:49 smithi191 bash[24992]: cluster 2024-08-31T08:17:48.308122+0000 mgr.a (mgr.14388) 15851 : cluster [DBG] pgmap v10988: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:51 smithi163 bash[24253]: cluster 2024-08-31T08:17:50.308935+0000 mgr.a (mgr.14388) 15852 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:51 smithi027 bash[22610]: cluster 2024-08-31T08:17:50.308935+0000 mgr.a (mgr.14388) 15852 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:51 smithi191 bash[24992]: cluster 2024-08-31T08:17:50.308935+0000 mgr.a (mgr.14388) 15852 : cluster [DBG] pgmap v10989: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:52.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:17:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:17:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:17:52.978 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:52.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:52.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:52.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:52.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:53 smithi163 bash[24253]: cluster 2024-08-31T08:17:52.309594+0000 mgr.a (mgr.14388) 15853 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:53 smithi163 bash[24253]: audit 2024-08-31T08:17:52.565220+0000 mgr.a (mgr.14388) 15854 : audit [DBG] from='client.343017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:53 smithi027 bash[22610]: cluster 2024-08-31T08:17:52.309594+0000 mgr.a (mgr.14388) 15853 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:53 smithi027 bash[22610]: audit 2024-08-31T08:17:52.565220+0000 mgr.a (mgr.14388) 15854 : audit [DBG] from='client.343017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:53 smithi191 bash[24992]: cluster 2024-08-31T08:17:52.309594+0000 mgr.a (mgr.14388) 15853 : cluster [DBG] pgmap v10990: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:53 smithi191 bash[24992]: audit 2024-08-31T08:17:52.565220+0000 mgr.a (mgr.14388) 15854 : audit [DBG] from='client.343017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:55 smithi163 bash[24253]: cluster 2024-08-31T08:17:54.311961+0000 mgr.a (mgr.14388) 15855 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:55 smithi027 bash[22610]: cluster 2024-08-31T08:17:54.311961+0000 mgr.a (mgr.14388) 15855 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:55 smithi191 bash[24992]: cluster 2024-08-31T08:17:54.311961+0000 mgr.a (mgr.14388) 15855 : cluster [DBG] pgmap v10991: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:17:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:57 smithi163 bash[24253]: cluster 2024-08-31T08:17:56.312731+0000 mgr.a (mgr.14388) 15856 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:17:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:57 smithi027 bash[22610]: cluster 2024-08-31T08:17:56.312731+0000 mgr.a (mgr.14388) 15856 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:17:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:57 smithi191 bash[24992]: cluster 2024-08-31T08:17:56.312731+0000 mgr.a (mgr.14388) 15856 : cluster [DBG] pgmap v10992: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:17:57.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:17:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:17:57.980 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:17:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:17:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:17:58.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:17:58.722 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:17:58.722 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:17:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:59 smithi163 bash[24253]: audit 2024-08-31T08:17:58.301314+0000 mgr.a (mgr.14388) 15857 : audit [DBG] from='client.343095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:17:59 smithi163 bash[24253]: cluster 2024-08-31T08:17:58.321176+0000 mgr.a (mgr.14388) 15858 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:59 smithi027 bash[22610]: audit 2024-08-31T08:17:58.301314+0000 mgr.a (mgr.14388) 15857 : audit [DBG] from='client.343095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:59.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:17:59 smithi027 bash[22610]: cluster 2024-08-31T08:17:58.321176+0000 mgr.a (mgr.14388) 15858 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:17:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:59 smithi191 bash[24992]: audit 2024-08-31T08:17:58.301314+0000 mgr.a (mgr.14388) 15857 : audit [DBG] from='client.343095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:17:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:17:59 smithi191 bash[24992]: cluster 2024-08-31T08:17:58.321176+0000 mgr.a (mgr.14388) 15858 : cluster [DBG] pgmap v10993: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:01.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:01 smithi163 bash[24253]: cluster 2024-08-31T08:18:00.322056+0000 mgr.a (mgr.14388) 15859 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:01 smithi027 bash[22610]: cluster 2024-08-31T08:18:00.322056+0000 mgr.a (mgr.14388) 15859 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:01 smithi191 bash[24992]: cluster 2024-08-31T08:18:00.322056+0000 mgr.a (mgr.14388) 15859 : cluster [DBG] pgmap v10994: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:03.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:03 smithi163 bash[24253]: cluster 2024-08-31T08:18:02.322857+0000 mgr.a (mgr.14388) 15860 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:03.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:18:03.724 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:18:03.724 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:18:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:03 smithi027 bash[22610]: cluster 2024-08-31T08:18:02.322857+0000 mgr.a (mgr.14388) 15860 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:03 smithi191 bash[24992]: cluster 2024-08-31T08:18:02.322857+0000 mgr.a (mgr.14388) 15860 : cluster [DBG] pgmap v10995: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:04.467 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:18:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:18:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:18:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:18:04.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:18:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:05 smithi163 bash[24253]: audit 2024-08-31T08:18:04.052149+0000 mgr.a (mgr.14388) 15861 : audit [DBG] from='client.343173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:05.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:05 smithi163 bash[24253]: cluster 2024-08-31T08:18:04.324230+0000 mgr.a (mgr.14388) 15862 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:05 smithi027 bash[22610]: audit 2024-08-31T08:18:04.052149+0000 mgr.a (mgr.14388) 15861 : audit [DBG] from='client.343173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:05 smithi027 bash[22610]: cluster 2024-08-31T08:18:04.324230+0000 mgr.a (mgr.14388) 15862 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:05 smithi191 bash[24992]: audit 2024-08-31T08:18:04.052149+0000 mgr.a (mgr.14388) 15861 : audit [DBG] from='client.343173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:05 smithi191 bash[24992]: cluster 2024-08-31T08:18:04.324230+0000 mgr.a (mgr.14388) 15862 : cluster [DBG] pgmap v10996: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:07 smithi163 bash[24253]: cluster 2024-08-31T08:18:06.325094+0000 mgr.a (mgr.14388) 15863 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:18:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:07 smithi027 bash[22610]: cluster 2024-08-31T08:18:06.325094+0000 mgr.a (mgr.14388) 15863 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:18:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:07 smithi191 bash[24992]: cluster 2024-08-31T08:18:06.325094+0000 mgr.a (mgr.14388) 15863 : cluster [DBG] pgmap v10997: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:18:09.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:18:09.469 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:18:09.469 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:18:09.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:09 smithi163 bash[24253]: cluster 2024-08-31T08:18:08.327214+0000 mgr.a (mgr.14388) 15864 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:18:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:09 smithi027 bash[22610]: cluster 2024-08-31T08:18:08.327214+0000 mgr.a (mgr.14388) 15864 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:18:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:09 smithi191 bash[24992]: cluster 2024-08-31T08:18:08.327214+0000 mgr.a (mgr.14388) 15864 : cluster [DBG] pgmap v10998: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:18:10.222 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:18:10.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:18:10.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:18:10.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:18:10.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:18:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:10 smithi163 bash[24253]: audit 2024-08-31T08:18:09.800774+0000 mgr.a (mgr.14388) 15865 : audit [DBG] from='client.343251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:10 smithi027 bash[22610]: audit 2024-08-31T08:18:09.800774+0000 mgr.a (mgr.14388) 15865 : audit [DBG] from='client.343251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:10 smithi191 bash[24992]: audit 2024-08-31T08:18:09.800774+0000 mgr.a (mgr.14388) 15865 : audit [DBG] from='client.343251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:11 smithi163 bash[24253]: cluster 2024-08-31T08:18:10.328128+0000 mgr.a (mgr.14388) 15866 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:11 smithi027 bash[22610]: cluster 2024-08-31T08:18:10.328128+0000 mgr.a (mgr.14388) 15866 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:11 smithi191 bash[24992]: cluster 2024-08-31T08:18:10.328128+0000 mgr.a (mgr.14388) 15866 : cluster [DBG] pgmap v10999: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:13 smithi163 bash[24253]: cluster 2024-08-31T08:18:12.328918+0000 mgr.a (mgr.14388) 15867 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:13 smithi027 bash[22610]: cluster 2024-08-31T08:18:12.328918+0000 mgr.a (mgr.14388) 15867 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:13 smithi191 bash[24992]: cluster 2024-08-31T08:18:12.328918+0000 mgr.a (mgr.14388) 15867 : cluster [DBG] pgmap v11000: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:15.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:18:15.224 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:18:15.224 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:18:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:15 smithi163 bash[24253]: cluster 2024-08-31T08:18:14.331139+0000 mgr.a (mgr.14388) 15868 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:15 smithi027 bash[22610]: cluster 2024-08-31T08:18:14.331139+0000 mgr.a (mgr.14388) 15868 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:15 smithi191 bash[24992]: cluster 2024-08-31T08:18:14.331139+0000 mgr.a (mgr.14388) 15868 : cluster [DBG] pgmap v11001: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:16.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:18:16.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:18:16.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:18:16.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:18:16.002 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:18:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:16 smithi163 bash[24253]: audit 2024-08-31T08:18:15.556890+0000 mgr.a (mgr.14388) 15869 : audit [DBG] from='client.343329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:16 smithi027 bash[22610]: audit 2024-08-31T08:18:15.556890+0000 mgr.a (mgr.14388) 15869 : audit [DBG] from='client.343329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:16 smithi191 bash[24992]: audit 2024-08-31T08:18:15.556890+0000 mgr.a (mgr.14388) 15869 : audit [DBG] from='client.343329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:17 smithi163 bash[24253]: cluster 2024-08-31T08:18:16.331986+0000 mgr.a (mgr.14388) 15870 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:17 smithi027 bash[22610]: cluster 2024-08-31T08:18:16.331986+0000 mgr.a (mgr.14388) 15870 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:17 smithi191 bash[24992]: cluster 2024-08-31T08:18:16.331986+0000 mgr.a (mgr.14388) 15870 : cluster [DBG] pgmap v11002: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:19 smithi027 bash[22610]: cluster 2024-08-31T08:18:18.334091+0000 mgr.a (mgr.14388) 15871 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:19 smithi191 bash[24992]: cluster 2024-08-31T08:18:18.334091+0000 mgr.a (mgr.14388) 15871 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:19 smithi163 bash[24253]: cluster 2024-08-31T08:18:18.334091+0000 mgr.a (mgr.14388) 15871 : cluster [DBG] pgmap v11003: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:21.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:18:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:18:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:18:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:21 smithi027 bash[22610]: cluster 2024-08-31T08:18:20.334899+0000 mgr.a (mgr.14388) 15872 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:21.780 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:18:21.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:18:21.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:18:21.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:18:21.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:18:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:21 smithi191 bash[24992]: cluster 2024-08-31T08:18:20.334899+0000 mgr.a (mgr.14388) 15872 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:21 smithi163 bash[24253]: cluster 2024-08-31T08:18:20.334899+0000 mgr.a (mgr.14388) 15872 : cluster [DBG] pgmap v11004: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:22.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:22 smithi027 bash[22610]: audit 2024-08-31T08:18:21.338498+0000 mgr.a (mgr.14388) 15873 : audit [DBG] from='client.343407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:22 smithi191 bash[24992]: audit 2024-08-31T08:18:21.338498+0000 mgr.a (mgr.14388) 15873 : audit [DBG] from='client.343407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:22 smithi163 bash[24253]: audit 2024-08-31T08:18:21.338498+0000 mgr.a (mgr.14388) 15873 : audit [DBG] from='client.343407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:23 smithi027 bash[22610]: cluster 2024-08-31T08:18:22.335773+0000 mgr.a (mgr.14388) 15874 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:23 smithi191 bash[24992]: cluster 2024-08-31T08:18:22.335773+0000 mgr.a (mgr.14388) 15874 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:23 smithi163 bash[24253]: cluster 2024-08-31T08:18:22.335773+0000 mgr.a (mgr.14388) 15874 : cluster [DBG] pgmap v11005: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:25 smithi027 bash[22610]: cluster 2024-08-31T08:18:24.337984+0000 mgr.a (mgr.14388) 15875 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:25 smithi191 bash[24992]: cluster 2024-08-31T08:18:24.337984+0000 mgr.a (mgr.14388) 15875 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:25 smithi163 bash[24253]: cluster 2024-08-31T08:18:24.337984+0000 mgr.a (mgr.14388) 15875 : cluster [DBG] pgmap v11006: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:26.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:18:26.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:18:26.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:18:27.542 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:18:27.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:18:27.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:18:27.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:18:27.542 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:18:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:27 smithi027 bash[22610]: cluster 2024-08-31T08:18:26.338757+0000 mgr.a (mgr.14388) 15876 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:27 smithi191 bash[24992]: cluster 2024-08-31T08:18:26.338757+0000 mgr.a (mgr.14388) 15876 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:27 smithi163 bash[24253]: cluster 2024-08-31T08:18:26.338757+0000 mgr.a (mgr.14388) 15876 : cluster [DBG] pgmap v11007: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:28 smithi191 bash[24992]: audit 2024-08-31T08:18:27.108561+0000 mgr.a (mgr.14388) 15877 : audit [DBG] from='client.343482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:28 smithi163 bash[24253]: audit 2024-08-31T08:18:27.108561+0000 mgr.a (mgr.14388) 15877 : audit [DBG] from='client.343482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:28 smithi027 bash[22610]: audit 2024-08-31T08:18:27.108561+0000 mgr.a (mgr.14388) 15877 : audit [DBG] from='client.343482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:29 smithi191 bash[24992]: cluster 2024-08-31T08:18:28.340963+0000 mgr.a (mgr.14388) 15878 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:29 smithi163 bash[24253]: cluster 2024-08-31T08:18:28.340963+0000 mgr.a (mgr.14388) 15878 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:29 smithi027 bash[22610]: cluster 2024-08-31T08:18:28.340963+0000 mgr.a (mgr.14388) 15878 : cluster [DBG] pgmap v11008: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:31 smithi191 bash[24992]: cluster 2024-08-31T08:18:30.341733+0000 mgr.a (mgr.14388) 15879 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:31 smithi163 bash[24253]: cluster 2024-08-31T08:18:30.341733+0000 mgr.a (mgr.14388) 15879 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:31 smithi027 bash[22610]: cluster 2024-08-31T08:18:30.341733+0000 mgr.a (mgr.14388) 15879 : cluster [DBG] pgmap v11009: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:32.544 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:18:32.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:18:32.544 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:18:33.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:18:33.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:18:33.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:18:33.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:18:33.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:18:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:33 smithi191 bash[24992]: cluster 2024-08-31T08:18:32.342478+0000 mgr.a (mgr.14388) 15880 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:33 smithi163 bash[24253]: cluster 2024-08-31T08:18:32.342478+0000 mgr.a (mgr.14388) 15880 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:33 smithi027 bash[22610]: cluster 2024-08-31T08:18:32.342478+0000 mgr.a (mgr.14388) 15880 : cluster [DBG] pgmap v11010: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:34 smithi191 bash[24992]: audit 2024-08-31T08:18:32.874751+0000 mgr.a (mgr.14388) 15881 : audit [DBG] from='client.343560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:34 smithi163 bash[24253]: audit 2024-08-31T08:18:32.874751+0000 mgr.a (mgr.14388) 15881 : audit [DBG] from='client.343560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:34 smithi027 bash[22610]: audit 2024-08-31T08:18:32.874751+0000 mgr.a (mgr.14388) 15881 : audit [DBG] from='client.343560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:35 smithi191 bash[24992]: cluster 2024-08-31T08:18:34.345229+0000 mgr.a (mgr.14388) 15882 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:35 smithi163 bash[24253]: cluster 2024-08-31T08:18:34.345229+0000 mgr.a (mgr.14388) 15882 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:35.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:35 smithi027 bash[22610]: cluster 2024-08-31T08:18:34.345229+0000 mgr.a (mgr.14388) 15882 : cluster [DBG] pgmap v11011: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:37 smithi191 bash[24992]: cluster 2024-08-31T08:18:36.346149+0000 mgr.a (mgr.14388) 15883 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:37 smithi163 bash[24253]: cluster 2024-08-31T08:18:36.346149+0000 mgr.a (mgr.14388) 15883 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:37 smithi027 bash[22610]: cluster 2024-08-31T08:18:36.346149+0000 mgr.a (mgr.14388) 15883 : cluster [DBG] pgmap v11012: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:38.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:18:38.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:18:38.294 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:18:39.036 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:18:39.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:18:39.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:18:39.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:18:39.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:18:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:39 smithi191 bash[24992]: cluster 2024-08-31T08:18:38.348455+0000 mgr.a (mgr.14388) 15884 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:39 smithi191 bash[24992]: audit 2024-08-31T08:18:38.624400+0000 mgr.a (mgr.14388) 15885 : audit [DBG] from='client.343638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:39 smithi163 bash[24253]: cluster 2024-08-31T08:18:38.348455+0000 mgr.a (mgr.14388) 15884 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:39 smithi163 bash[24253]: audit 2024-08-31T08:18:38.624400+0000 mgr.a (mgr.14388) 15885 : audit [DBG] from='client.343638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:39 smithi027 bash[22610]: cluster 2024-08-31T08:18:38.348455+0000 mgr.a (mgr.14388) 15884 : cluster [DBG] pgmap v11013: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:39 smithi027 bash[22610]: audit 2024-08-31T08:18:38.624400+0000 mgr.a (mgr.14388) 15885 : audit [DBG] from='client.343638 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:41 smithi191 bash[24992]: cluster 2024-08-31T08:18:40.349407+0000 mgr.a (mgr.14388) 15886 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:41 smithi191 bash[24992]: audit 2024-08-31T08:18:41.111879+0000 mon.a (mon.0) 2949 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:18:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:41 smithi163 bash[24253]: cluster 2024-08-31T08:18:40.349407+0000 mgr.a (mgr.14388) 15886 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:41 smithi163 bash[24253]: audit 2024-08-31T08:18:41.111879+0000 mon.a (mon.0) 2949 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:18:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:41 smithi027 bash[22610]: cluster 2024-08-31T08:18:40.349407+0000 mgr.a (mgr.14388) 15886 : cluster [DBG] pgmap v11014: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:18:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:41 smithi027 bash[22610]: audit 2024-08-31T08:18:41.111879+0000 mon.a (mon.0) 2949 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:18:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:42 smithi191 bash[24992]: audit 2024-08-31T08:18:41.956417+0000 mon.a (mon.0) 2950 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:18:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:42 smithi191 bash[24992]: audit 2024-08-31T08:18:41.958088+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:18:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:42 smithi191 bash[24992]: audit 2024-08-31T08:18:41.968632+0000 mon.a (mon.0) 2952 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:18:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:42 smithi191 bash[24992]: audit 2024-08-31T08:18:41.973540+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:18:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:42 smithi163 bash[24253]: audit 2024-08-31T08:18:41.956417+0000 mon.a (mon.0) 2950 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:18:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:42 smithi163 bash[24253]: audit 2024-08-31T08:18:41.958088+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:18:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:42 smithi163 bash[24253]: audit 2024-08-31T08:18:41.968632+0000 mon.a (mon.0) 2952 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:18:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:42 smithi163 bash[24253]: audit 2024-08-31T08:18:41.973540+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:18:42.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:18:42 smithi027 bash[22863]: debug 2024-08-31T08:18:42.703+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:18:42.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:18:42 smithi027 bash[22863]: debug 2024-08-31T08:18:42.703+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:18:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:42 smithi027 bash[22610]: audit 2024-08-31T08:18:41.956417+0000 mon.a (mon.0) 2950 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:18:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:42 smithi027 bash[22610]: audit 2024-08-31T08:18:41.958088+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:18:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:42 smithi027 bash[22610]: audit 2024-08-31T08:18:41.968632+0000 mon.a (mon.0) 2952 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:18:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:42 smithi027 bash[22610]: audit 2024-08-31T08:18:41.973540+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:18:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:43 smithi191 bash[24992]: audit 2024-08-31T08:18:41.975988+0000 mgr.a (mgr.14388) 15887 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:18:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:43 smithi191 bash[24992]: cluster 2024-08-31T08:18:42.349928+0000 mgr.a (mgr.14388) 15888 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:18:43.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:43 smithi191 bash[24992]: audit 2024-08-31T08:18:42.707558+0000 mgr.a (mgr.14388) 15889 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:18:43.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:43 smithi191 bash[24992]: cephadm 2024-08-31T08:18:42.708901+0000 mgr.a (mgr.14388) 15890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:18:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:43 smithi163 bash[24253]: audit 2024-08-31T08:18:41.975988+0000 mgr.a (mgr.14388) 15887 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:18:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:43 smithi163 bash[24253]: cluster 2024-08-31T08:18:42.349928+0000 mgr.a (mgr.14388) 15888 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:18:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:43 smithi163 bash[24253]: audit 2024-08-31T08:18:42.707558+0000 mgr.a (mgr.14388) 15889 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:18:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:43 smithi163 bash[24253]: cephadm 2024-08-31T08:18:42.708901+0000 mgr.a (mgr.14388) 15890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:18:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:43 smithi027 bash[22610]: audit 2024-08-31T08:18:41.975988+0000 mgr.a (mgr.14388) 15887 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:18:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:43 smithi027 bash[22610]: cluster 2024-08-31T08:18:42.349928+0000 mgr.a (mgr.14388) 15888 : cluster [DBG] pgmap v11015: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:18:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:43 smithi027 bash[22610]: audit 2024-08-31T08:18:42.707558+0000 mgr.a (mgr.14388) 15889 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:18:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:43 smithi027 bash[22610]: cephadm 2024-08-31T08:18:42.708901+0000 mgr.a (mgr.14388) 15890 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:18:44.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:18:44.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:18:44.039 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:18:44.813 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:18:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:18:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:18:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:18:44.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:18:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:45 smithi191 bash[24992]: cluster 2024-08-31T08:18:44.352142+0000 mgr.a (mgr.14388) 15891 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:45 smithi191 bash[24992]: audit 2024-08-31T08:18:44.370561+0000 mgr.a (mgr.14388) 15892 : audit [DBG] from='client.343821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:45 smithi163 bash[24253]: cluster 2024-08-31T08:18:44.352142+0000 mgr.a (mgr.14388) 15891 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:45 smithi163 bash[24253]: audit 2024-08-31T08:18:44.370561+0000 mgr.a (mgr.14388) 15892 : audit [DBG] from='client.343821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:45 smithi027 bash[22610]: cluster 2024-08-31T08:18:44.352142+0000 mgr.a (mgr.14388) 15891 : cluster [DBG] pgmap v11016: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:45 smithi027 bash[22610]: audit 2024-08-31T08:18:44.370561+0000 mgr.a (mgr.14388) 15892 : audit [DBG] from='client.343821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:47 smithi191 bash[24992]: cluster 2024-08-31T08:18:46.353079+0000 mgr.a (mgr.14388) 15893 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:47 smithi163 bash[24253]: cluster 2024-08-31T08:18:46.353079+0000 mgr.a (mgr.14388) 15893 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:47 smithi027 bash[22610]: cluster 2024-08-31T08:18:46.353079+0000 mgr.a (mgr.14388) 15893 : cluster [DBG] pgmap v11017: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:49 smithi191 bash[24992]: cluster 2024-08-31T08:18:48.355242+0000 mgr.a (mgr.14388) 15894 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:49.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:18:49.816 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:18:49.816 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:18:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:49 smithi163 bash[24253]: cluster 2024-08-31T08:18:48.355242+0000 mgr.a (mgr.14388) 15894 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:49 smithi027 bash[22610]: cluster 2024-08-31T08:18:48.355242+0000 mgr.a (mgr.14388) 15894 : cluster [DBG] pgmap v11018: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:50.577 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:18:50.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:18:50.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:18:50.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:18:50.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:18:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:51 smithi163 bash[24253]: audit 2024-08-31T08:18:50.149135+0000 mgr.a (mgr.14388) 15895 : audit [DBG] from='client.343896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:51 smithi163 bash[24253]: cluster 2024-08-31T08:18:50.355743+0000 mgr.a (mgr.14388) 15896 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:51 smithi027 bash[22610]: audit 2024-08-31T08:18:50.149135+0000 mgr.a (mgr.14388) 15895 : audit [DBG] from='client.343896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:51 smithi027 bash[22610]: cluster 2024-08-31T08:18:50.355743+0000 mgr.a (mgr.14388) 15896 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:51 smithi191 bash[24992]: audit 2024-08-31T08:18:50.149135+0000 mgr.a (mgr.14388) 15895 : audit [DBG] from='client.343896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:51 smithi191 bash[24992]: cluster 2024-08-31T08:18:50.355743+0000 mgr.a (mgr.14388) 15896 : cluster [DBG] pgmap v11019: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:53 smithi163 bash[24253]: cluster 2024-08-31T08:18:52.356637+0000 mgr.a (mgr.14388) 15897 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:53 smithi027 bash[22610]: cluster 2024-08-31T08:18:52.356637+0000 mgr.a (mgr.14388) 15897 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:53 smithi191 bash[24992]: cluster 2024-08-31T08:18:52.356637+0000 mgr.a (mgr.14388) 15897 : cluster [DBG] pgmap v11020: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:55.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:18:55.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:18:55.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:18:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:55 smithi163 bash[24253]: cluster 2024-08-31T08:18:54.358921+0000 mgr.a (mgr.14388) 15898 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:55 smithi027 bash[22610]: cluster 2024-08-31T08:18:54.358921+0000 mgr.a (mgr.14388) 15898 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:55 smithi191 bash[24992]: cluster 2024-08-31T08:18:54.358921+0000 mgr.a (mgr.14388) 15898 : cluster [DBG] pgmap v11021: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:18:56.349 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:18:56.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:18:56.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:18:56.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:18:56.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:18:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:57 smithi163 bash[24253]: audit 2024-08-31T08:18:55.919894+0000 mgr.a (mgr.14388) 15899 : audit [DBG] from='client.343974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:57 smithi163 bash[24253]: cluster 2024-08-31T08:18:56.359415+0000 mgr.a (mgr.14388) 15900 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:57 smithi027 bash[22610]: audit 2024-08-31T08:18:55.919894+0000 mgr.a (mgr.14388) 15899 : audit [DBG] from='client.343974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:57.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:57 smithi027 bash[22610]: cluster 2024-08-31T08:18:56.359415+0000 mgr.a (mgr.14388) 15900 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:57 smithi191 bash[24992]: audit 2024-08-31T08:18:55.919894+0000 mgr.a (mgr.14388) 15899 : audit [DBG] from='client.343974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:18:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:57 smithi191 bash[24992]: cluster 2024-08-31T08:18:56.359415+0000 mgr.a (mgr.14388) 15900 : cluster [DBG] pgmap v11022: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:18:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:18:59 smithi163 bash[24253]: cluster 2024-08-31T08:18:58.361475+0000 mgr.a (mgr.14388) 15901 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:18:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:18:59 smithi027 bash[22610]: cluster 2024-08-31T08:18:58.361475+0000 mgr.a (mgr.14388) 15901 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:18:59 smithi191 bash[24992]: cluster 2024-08-31T08:18:58.361475+0000 mgr.a (mgr.14388) 15901 : cluster [DBG] pgmap v11023: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:01.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:01.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:01.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:01 smithi163 bash[24253]: cluster 2024-08-31T08:19:00.362231+0000 mgr.a (mgr.14388) 15902 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:01 smithi027 bash[22610]: cluster 2024-08-31T08:19:00.362231+0000 mgr.a (mgr.14388) 15902 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:01 smithi191 bash[24992]: cluster 2024-08-31T08:19:00.362231+0000 mgr.a (mgr.14388) 15902 : cluster [DBG] pgmap v11024: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:02.109 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:02.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:02.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:02.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:02.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:02 smithi163 bash[24253]: audit 2024-08-31T08:19:01.680736+0000 mgr.a (mgr.14388) 15903 : audit [DBG] from='client.344046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:02 smithi027 bash[22610]: audit 2024-08-31T08:19:01.680736+0000 mgr.a (mgr.14388) 15903 : audit [DBG] from='client.344046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:02 smithi191 bash[24992]: audit 2024-08-31T08:19:01.680736+0000 mgr.a (mgr.14388) 15903 : audit [DBG] from='client.344046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:03 smithi163 bash[24253]: cluster 2024-08-31T08:19:02.363194+0000 mgr.a (mgr.14388) 15904 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:03 smithi027 bash[22610]: cluster 2024-08-31T08:19:02.363194+0000 mgr.a (mgr.14388) 15904 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:03 smithi191 bash[24992]: cluster 2024-08-31T08:19:02.363194+0000 mgr.a (mgr.14388) 15904 : cluster [DBG] pgmap v11025: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:05 smithi163 bash[24253]: cluster 2024-08-31T08:19:04.365429+0000 mgr.a (mgr.14388) 15905 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:05 smithi027 bash[22610]: cluster 2024-08-31T08:19:04.365429+0000 mgr.a (mgr.14388) 15905 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:05 smithi191 bash[24992]: cluster 2024-08-31T08:19:04.365429+0000 mgr.a (mgr.14388) 15905 : cluster [DBG] pgmap v11026: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:07.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:07.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:07.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:07.869 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:07.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:07.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:07.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:07.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:07 smithi163 bash[24253]: cluster 2024-08-31T08:19:06.366185+0000 mgr.a (mgr.14388) 15906 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:07 smithi027 bash[22610]: cluster 2024-08-31T08:19:06.366185+0000 mgr.a (mgr.14388) 15906 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:07 smithi191 bash[24992]: cluster 2024-08-31T08:19:06.366185+0000 mgr.a (mgr.14388) 15906 : cluster [DBG] pgmap v11027: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:08 smithi163 bash[24253]: audit 2024-08-31T08:19:07.443294+0000 mgr.a (mgr.14388) 15907 : audit [DBG] from='client.344118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:08 smithi027 bash[22610]: audit 2024-08-31T08:19:07.443294+0000 mgr.a (mgr.14388) 15907 : audit [DBG] from='client.344118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:08 smithi191 bash[24992]: audit 2024-08-31T08:19:07.443294+0000 mgr.a (mgr.14388) 15907 : audit [DBG] from='client.344118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:09 smithi163 bash[24253]: cluster 2024-08-31T08:19:08.368449+0000 mgr.a (mgr.14388) 15908 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:09 smithi027 bash[22610]: cluster 2024-08-31T08:19:08.368449+0000 mgr.a (mgr.14388) 15908 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:09 smithi191 bash[24992]: cluster 2024-08-31T08:19:08.368449+0000 mgr.a (mgr.14388) 15908 : cluster [DBG] pgmap v11028: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:11 smithi163 bash[24253]: cluster 2024-08-31T08:19:10.369235+0000 mgr.a (mgr.14388) 15909 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:11 smithi027 bash[22610]: cluster 2024-08-31T08:19:10.369235+0000 mgr.a (mgr.14388) 15909 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:11 smithi191 bash[24992]: cluster 2024-08-31T08:19:10.369235+0000 mgr.a (mgr.14388) 15909 : cluster [DBG] pgmap v11029: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:12.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:12.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:12.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:13.654 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:13.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:13.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:13.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:13.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:13 smithi163 bash[24253]: cluster 2024-08-31T08:19:12.370000+0000 mgr.a (mgr.14388) 15910 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:13 smithi027 bash[22610]: cluster 2024-08-31T08:19:12.370000+0000 mgr.a (mgr.14388) 15910 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:13 smithi191 bash[24992]: cluster 2024-08-31T08:19:12.370000+0000 mgr.a (mgr.14388) 15910 : cluster [DBG] pgmap v11030: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:14 smithi163 bash[24253]: audit 2024-08-31T08:19:13.212977+0000 mgr.a (mgr.14388) 15911 : audit [DBG] from='client.344196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:14 smithi027 bash[22610]: audit 2024-08-31T08:19:13.212977+0000 mgr.a (mgr.14388) 15911 : audit [DBG] from='client.344196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:14 smithi191 bash[24992]: audit 2024-08-31T08:19:13.212977+0000 mgr.a (mgr.14388) 15911 : audit [DBG] from='client.344196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:15.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:15 smithi163 bash[24253]: cluster 2024-08-31T08:19:14.372916+0000 mgr.a (mgr.14388) 15912 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:15 smithi027 bash[22610]: cluster 2024-08-31T08:19:14.372916+0000 mgr.a (mgr.14388) 15912 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:15 smithi191 bash[24992]: cluster 2024-08-31T08:19:14.372916+0000 mgr.a (mgr.14388) 15912 : cluster [DBG] pgmap v11031: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:17.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:17 smithi163 bash[24253]: cluster 2024-08-31T08:19:16.373740+0000 mgr.a (mgr.14388) 15913 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:19:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:17 smithi027 bash[22610]: cluster 2024-08-31T08:19:16.373740+0000 mgr.a (mgr.14388) 15913 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:19:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:17 smithi191 bash[24992]: cluster 2024-08-31T08:19:16.373740+0000 mgr.a (mgr.14388) 15913 : cluster [DBG] pgmap v11032: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:19:18.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:18.656 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:18.656 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:19.417 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:19.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:19 smithi163 bash[24253]: cluster 2024-08-31T08:19:18.375653+0000 mgr.a (mgr.14388) 15914 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:19 smithi027 bash[22610]: cluster 2024-08-31T08:19:18.375653+0000 mgr.a (mgr.14388) 15914 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:19 smithi191 bash[24992]: cluster 2024-08-31T08:19:18.375653+0000 mgr.a (mgr.14388) 15914 : cluster [DBG] pgmap v11033: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:20 smithi027 bash[22610]: audit 2024-08-31T08:19:18.991254+0000 mgr.a (mgr.14388) 15915 : audit [DBG] from='client.344274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:20 smithi191 bash[24992]: audit 2024-08-31T08:19:18.991254+0000 mgr.a (mgr.14388) 15915 : audit [DBG] from='client.344274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:20 smithi163 bash[24253]: audit 2024-08-31T08:19:18.991254+0000 mgr.a (mgr.14388) 15915 : audit [DBG] from='client.344274 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:21 smithi027 bash[22610]: cluster 2024-08-31T08:19:20.376585+0000 mgr.a (mgr.14388) 15916 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:19:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:21 smithi191 bash[24992]: cluster 2024-08-31T08:19:20.376585+0000 mgr.a (mgr.14388) 15916 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:19:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:21 smithi163 bash[24253]: cluster 2024-08-31T08:19:20.376585+0000 mgr.a (mgr.14388) 15916 : cluster [DBG] pgmap v11034: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:19:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:23 smithi027 bash[22610]: cluster 2024-08-31T08:19:22.377366+0000 mgr.a (mgr.14388) 15917 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:19:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:23 smithi191 bash[24992]: cluster 2024-08-31T08:19:22.377366+0000 mgr.a (mgr.14388) 15917 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:19:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:23 smithi163 bash[24253]: cluster 2024-08-31T08:19:22.377366+0000 mgr.a (mgr.14388) 15917 : cluster [DBG] pgmap v11035: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:19:24.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:24.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:25.162 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:25.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:25.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:25.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:25.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:25 smithi027 bash[22610]: cluster 2024-08-31T08:19:24.379708+0000 mgr.a (mgr.14388) 15918 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:25.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:25 smithi027 bash[22610]: audit 2024-08-31T08:19:24.747714+0000 mgr.a (mgr.14388) 15919 : audit [DBG] from='client.344352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:25 smithi191 bash[24992]: cluster 2024-08-31T08:19:24.379708+0000 mgr.a (mgr.14388) 15918 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:25 smithi191 bash[24992]: audit 2024-08-31T08:19:24.747714+0000 mgr.a (mgr.14388) 15919 : audit [DBG] from='client.344352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:25 smithi163 bash[24253]: cluster 2024-08-31T08:19:24.379708+0000 mgr.a (mgr.14388) 15918 : cluster [DBG] pgmap v11036: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:25 smithi163 bash[24253]: audit 2024-08-31T08:19:24.747714+0000 mgr.a (mgr.14388) 15919 : audit [DBG] from='client.344352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:27 smithi027 bash[22610]: cluster 2024-08-31T08:19:26.380686+0000 mgr.a (mgr.14388) 15920 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:27 smithi191 bash[24992]: cluster 2024-08-31T08:19:26.380686+0000 mgr.a (mgr.14388) 15920 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:27 smithi163 bash[24253]: cluster 2024-08-31T08:19:26.380686+0000 mgr.a (mgr.14388) 15920 : cluster [DBG] pgmap v11037: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:29 smithi027 bash[22610]: cluster 2024-08-31T08:19:28.382859+0000 mgr.a (mgr.14388) 15921 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:29 smithi191 bash[24992]: cluster 2024-08-31T08:19:28.382859+0000 mgr.a (mgr.14388) 15921 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:29 smithi163 bash[24253]: cluster 2024-08-31T08:19:28.382859+0000 mgr.a (mgr.14388) 15921 : cluster [DBG] pgmap v11038: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:30.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:30.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:30.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:30.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:30.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:30.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:30.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:30.930 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:31 smithi027 bash[22610]: cluster 2024-08-31T08:19:30.383398+0000 mgr.a (mgr.14388) 15922 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:31 smithi027 bash[22610]: audit 2024-08-31T08:19:30.499515+0000 mgr.a (mgr.14388) 15923 : audit [DBG] from='client.344430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:31 smithi191 bash[24992]: cluster 2024-08-31T08:19:30.383398+0000 mgr.a (mgr.14388) 15922 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:31 smithi191 bash[24992]: audit 2024-08-31T08:19:30.499515+0000 mgr.a (mgr.14388) 15923 : audit [DBG] from='client.344430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:31 smithi163 bash[24253]: cluster 2024-08-31T08:19:30.383398+0000 mgr.a (mgr.14388) 15922 : cluster [DBG] pgmap v11039: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:31 smithi163 bash[24253]: audit 2024-08-31T08:19:30.499515+0000 mgr.a (mgr.14388) 15923 : audit [DBG] from='client.344430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:33 smithi027 bash[22610]: cluster 2024-08-31T08:19:32.384272+0000 mgr.a (mgr.14388) 15924 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:33 smithi191 bash[24992]: cluster 2024-08-31T08:19:32.384272+0000 mgr.a (mgr.14388) 15924 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:33 smithi163 bash[24253]: cluster 2024-08-31T08:19:32.384272+0000 mgr.a (mgr.14388) 15924 : cluster [DBG] pgmap v11040: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:35 smithi191 bash[24992]: cluster 2024-08-31T08:19:34.386492+0000 mgr.a (mgr.14388) 15925 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:35.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:35.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:35.932 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:35 smithi163 bash[24253]: cluster 2024-08-31T08:19:34.386492+0000 mgr.a (mgr.14388) 15925 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:35 smithi027 bash[22610]: cluster 2024-08-31T08:19:34.386492+0000 mgr.a (mgr.14388) 15925 : cluster [DBG] pgmap v11041: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:36.705 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:36.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:36.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:36.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:36.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:37 smithi191 bash[24992]: audit 2024-08-31T08:19:36.273255+0000 mgr.a (mgr.14388) 15926 : audit [DBG] from='client.344499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:37 smithi191 bash[24992]: cluster 2024-08-31T08:19:36.387013+0000 mgr.a (mgr.14388) 15927 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:37 smithi163 bash[24253]: audit 2024-08-31T08:19:36.273255+0000 mgr.a (mgr.14388) 15926 : audit [DBG] from='client.344499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:37 smithi163 bash[24253]: cluster 2024-08-31T08:19:36.387013+0000 mgr.a (mgr.14388) 15927 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:37 smithi027 bash[22610]: audit 2024-08-31T08:19:36.273255+0000 mgr.a (mgr.14388) 15926 : audit [DBG] from='client.344499 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:37 smithi027 bash[22610]: cluster 2024-08-31T08:19:36.387013+0000 mgr.a (mgr.14388) 15927 : cluster [DBG] pgmap v11042: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:39 smithi191 bash[24992]: cluster 2024-08-31T08:19:38.389132+0000 mgr.a (mgr.14388) 15928 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:39 smithi163 bash[24253]: cluster 2024-08-31T08:19:38.389132+0000 mgr.a (mgr.14388) 15928 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:39 smithi027 bash[22610]: cluster 2024-08-31T08:19:38.389132+0000 mgr.a (mgr.14388) 15928 : cluster [DBG] pgmap v11043: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:41.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:41.707 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:41.707 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:41 smithi191 bash[24992]: cluster 2024-08-31T08:19:40.389924+0000 mgr.a (mgr.14388) 15929 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:41 smithi163 bash[24253]: cluster 2024-08-31T08:19:40.389924+0000 mgr.a (mgr.14388) 15929 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:41.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:41 smithi027 bash[22610]: cluster 2024-08-31T08:19:40.389924+0000 mgr.a (mgr.14388) 15929 : cluster [DBG] pgmap v11044: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:42.493 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:42.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:42.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:43 smithi191 bash[24992]: audit 2024-08-31T08:19:42.043276+0000 mgr.a (mgr.14388) 15930 : audit [DBG] from='client.344574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:43 smithi191 bash[24992]: cluster 2024-08-31T08:19:42.390726+0000 mgr.a (mgr.14388) 15931 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:43 smithi191 bash[24992]: audit 2024-08-31T08:19:42.760960+0000 mon.a (mon.0) 2954 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:19:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:43 smithi163 bash[24253]: audit 2024-08-31T08:19:42.043276+0000 mgr.a (mgr.14388) 15930 : audit [DBG] from='client.344574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:43 smithi163 bash[24253]: cluster 2024-08-31T08:19:42.390726+0000 mgr.a (mgr.14388) 15931 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:43 smithi163 bash[24253]: audit 2024-08-31T08:19:42.760960+0000 mon.a (mon.0) 2954 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:19:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:43 smithi027 bash[22610]: audit 2024-08-31T08:19:42.043276+0000 mgr.a (mgr.14388) 15930 : audit [DBG] from='client.344574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:43 smithi027 bash[22610]: cluster 2024-08-31T08:19:42.390726+0000 mgr.a (mgr.14388) 15931 : cluster [DBG] pgmap v11045: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:43 smithi027 bash[22610]: audit 2024-08-31T08:19:42.760960+0000 mon.a (mon.0) 2954 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:19:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:45 smithi191 bash[24992]: cluster 2024-08-31T08:19:44.392858+0000 mgr.a (mgr.14388) 15932 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:45 smithi163 bash[24253]: cluster 2024-08-31T08:19:44.392858+0000 mgr.a (mgr.14388) 15932 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:45 smithi027 bash[22610]: cluster 2024-08-31T08:19:44.392858+0000 mgr.a (mgr.14388) 15932 : cluster [DBG] pgmap v11046: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:19:47.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:47.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:47.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:47 smithi191 bash[24992]: cluster 2024-08-31T08:19:46.393651+0000 mgr.a (mgr.14388) 15933 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:47 smithi163 bash[24253]: cluster 2024-08-31T08:19:46.393651+0000 mgr.a (mgr.14388) 15933 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:47 smithi027 bash[22610]: cluster 2024-08-31T08:19:46.393651+0000 mgr.a (mgr.14388) 15933 : cluster [DBG] pgmap v11047: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:48.286 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:48.286 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:48 smithi191 bash[24992]: audit 2024-08-31T08:19:47.832897+0000 mgr.a (mgr.14388) 15934 : audit [DBG] from='client.344652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:48 smithi191 bash[24992]: audit 2024-08-31T08:19:48.089934+0000 mon.a (mon.0) 2955 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:48 smithi191 bash[24992]: audit 2024-08-31T08:19:48.095823+0000 mon.a (mon.0) 2956 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:48 smithi191 bash[24992]: audit 2024-08-31T08:19:48.140111+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:48 smithi191 bash[24992]: audit 2024-08-31T08:19:48.143154+0000 mon.a (mon.0) 2958 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:48 smithi191 bash[24992]: audit 2024-08-31T08:19:48.146878+0000 mon.a (mon.0) 2959 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:48 smithi191 bash[24992]: audit 2024-08-31T08:19:48.150097+0000 mon.a (mon.0) 2960 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:48 smithi163 bash[24253]: audit 2024-08-31T08:19:47.832897+0000 mgr.a (mgr.14388) 15934 : audit [DBG] from='client.344652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:48 smithi163 bash[24253]: audit 2024-08-31T08:19:48.089934+0000 mon.a (mon.0) 2955 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:48 smithi163 bash[24253]: audit 2024-08-31T08:19:48.095823+0000 mon.a (mon.0) 2956 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:48 smithi163 bash[24253]: audit 2024-08-31T08:19:48.140111+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:48 smithi163 bash[24253]: audit 2024-08-31T08:19:48.143154+0000 mon.a (mon.0) 2958 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:48 smithi163 bash[24253]: audit 2024-08-31T08:19:48.146878+0000 mon.a (mon.0) 2959 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:48 smithi163 bash[24253]: audit 2024-08-31T08:19:48.150097+0000 mon.a (mon.0) 2960 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:48 smithi027 bash[22610]: audit 2024-08-31T08:19:47.832897+0000 mgr.a (mgr.14388) 15934 : audit [DBG] from='client.344652 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:48 smithi027 bash[22610]: audit 2024-08-31T08:19:48.089934+0000 mon.a (mon.0) 2955 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:48 smithi027 bash[22610]: audit 2024-08-31T08:19:48.095823+0000 mon.a (mon.0) 2956 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:48 smithi027 bash[22610]: audit 2024-08-31T08:19:48.140111+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:48 smithi027 bash[22610]: audit 2024-08-31T08:19:48.143154+0000 mon.a (mon.0) 2958 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:48 smithi027 bash[22610]: audit 2024-08-31T08:19:48.146878+0000 mon.a (mon.0) 2959 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:48 smithi027 bash[22610]: audit 2024-08-31T08:19:48.150097+0000 mon.a (mon.0) 2960 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:49 smithi191 bash[24992]: cluster 2024-08-31T08:19:48.396372+0000 mgr.a (mgr.14388) 15935 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:49 smithi191 bash[24992]: audit 2024-08-31T08:19:48.873267+0000 mon.a (mon.0) 2961 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:19:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:49 smithi191 bash[24992]: audit 2024-08-31T08:19:48.875027+0000 mon.a (mon.0) 2962 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:19:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:49 smithi191 bash[24992]: audit 2024-08-31T08:19:48.885684+0000 mon.a (mon.0) 2963 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:49 smithi191 bash[24992]: audit 2024-08-31T08:19:48.890878+0000 mon.a (mon.0) 2964 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:19:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:49 smithi163 bash[24253]: cluster 2024-08-31T08:19:48.396372+0000 mgr.a (mgr.14388) 15935 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:49 smithi163 bash[24253]: audit 2024-08-31T08:19:48.873267+0000 mon.a (mon.0) 2961 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:19:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:49 smithi163 bash[24253]: audit 2024-08-31T08:19:48.875027+0000 mon.a (mon.0) 2962 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:19:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:49 smithi163 bash[24253]: audit 2024-08-31T08:19:48.885684+0000 mon.a (mon.0) 2963 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:49 smithi163 bash[24253]: audit 2024-08-31T08:19:48.890878+0000 mon.a (mon.0) 2964 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:19:49.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:19:49 smithi027 bash[22863]: debug 2024-08-31T08:19:49.625+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:19:49.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:19:49 smithi027 bash[22863]: debug 2024-08-31T08:19:49.629+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:19:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:49 smithi027 bash[22610]: cluster 2024-08-31T08:19:48.396372+0000 mgr.a (mgr.14388) 15935 : cluster [DBG] pgmap v11048: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:19:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:49 smithi027 bash[22610]: audit 2024-08-31T08:19:48.873267+0000 mon.a (mon.0) 2961 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:19:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:49 smithi027 bash[22610]: audit 2024-08-31T08:19:48.875027+0000 mon.a (mon.0) 2962 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:19:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:49 smithi027 bash[22610]: audit 2024-08-31T08:19:48.885684+0000 mon.a (mon.0) 2963 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:19:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:49 smithi027 bash[22610]: audit 2024-08-31T08:19:48.890878+0000 mon.a (mon.0) 2964 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:19:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:50 smithi191 bash[24992]: audit 2024-08-31T08:19:48.893474+0000 mgr.a (mgr.14388) 15936 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:19:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:50 smithi191 bash[24992]: audit 2024-08-31T08:19:49.630382+0000 mgr.a (mgr.14388) 15937 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:19:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:50 smithi191 bash[24992]: cephadm 2024-08-31T08:19:49.631588+0000 mgr.a (mgr.14388) 15938 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:19:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:50 smithi163 bash[24253]: audit 2024-08-31T08:19:48.893474+0000 mgr.a (mgr.14388) 15936 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:19:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:50 smithi163 bash[24253]: audit 2024-08-31T08:19:49.630382+0000 mgr.a (mgr.14388) 15937 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:19:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:50 smithi163 bash[24253]: cephadm 2024-08-31T08:19:49.631588+0000 mgr.a (mgr.14388) 15938 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:19:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:50 smithi027 bash[22610]: audit 2024-08-31T08:19:48.893474+0000 mgr.a (mgr.14388) 15936 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:19:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:50 smithi027 bash[22610]: audit 2024-08-31T08:19:49.630382+0000 mgr.a (mgr.14388) 15937 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:19:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:50 smithi027 bash[22610]: cephadm 2024-08-31T08:19:49.631588+0000 mgr.a (mgr.14388) 15938 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:19:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:51 smithi191 bash[24992]: cluster 2024-08-31T08:19:50.397352+0000 mgr.a (mgr.14388) 15939 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:19:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:51 smithi163 bash[24253]: cluster 2024-08-31T08:19:50.397352+0000 mgr.a (mgr.14388) 15939 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:19:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:51 smithi027 bash[22610]: cluster 2024-08-31T08:19:50.397352+0000 mgr.a (mgr.14388) 15939 : cluster [DBG] pgmap v11049: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:19:53.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:53.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:53.288 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:53 smithi163 bash[24253]: cluster 2024-08-31T08:19:52.398158+0000 mgr.a (mgr.14388) 15940 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:19:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:53 smithi027 bash[22610]: cluster 2024-08-31T08:19:52.398158+0000 mgr.a (mgr.14388) 15940 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:19:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:53 smithi191 bash[24992]: cluster 2024-08-31T08:19:52.398158+0000 mgr.a (mgr.14388) 15940 : cluster [DBG] pgmap v11050: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:19:54.077 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:54.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:54.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:54.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:54.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:54 smithi163 bash[24253]: audit 2024-08-31T08:19:53.627681+0000 mgr.a (mgr.14388) 15941 : audit [DBG] from='client.344835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:54 smithi027 bash[22610]: audit 2024-08-31T08:19:53.627681+0000 mgr.a (mgr.14388) 15941 : audit [DBG] from='client.344835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:54 smithi191 bash[24992]: audit 2024-08-31T08:19:53.627681+0000 mgr.a (mgr.14388) 15941 : audit [DBG] from='client.344835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:19:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:55 smithi163 bash[24253]: cluster 2024-08-31T08:19:54.401012+0000 mgr.a (mgr.14388) 15942 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:19:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:55 smithi027 bash[22610]: cluster 2024-08-31T08:19:54.401012+0000 mgr.a (mgr.14388) 15942 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:19:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:55 smithi191 bash[24992]: cluster 2024-08-31T08:19:54.401012+0000 mgr.a (mgr.14388) 15942 : cluster [DBG] pgmap v11051: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:19:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:57 smithi163 bash[24253]: cluster 2024-08-31T08:19:56.401814+0000 mgr.a (mgr.14388) 15943 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:19:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:57 smithi027 bash[22610]: cluster 2024-08-31T08:19:56.401814+0000 mgr.a (mgr.14388) 15943 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:19:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:57 smithi191 bash[24992]: cluster 2024-08-31T08:19:56.401814+0000 mgr.a (mgr.14388) 15943 : cluster [DBG] pgmap v11052: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:19:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:19:59.079 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:19:59.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:19:59.848 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:19:59.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:19:59.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:19:59.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:19:59.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:19:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:19:59 smithi163 bash[24253]: cluster 2024-08-31T08:19:58.403743+0000 mgr.a (mgr.14388) 15944 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:19:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:19:59 smithi027 bash[22610]: cluster 2024-08-31T08:19:58.403743+0000 mgr.a (mgr.14388) 15944 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:19:59 smithi191 bash[24992]: cluster 2024-08-31T08:19:58.403743+0000 mgr.a (mgr.14388) 15944 : cluster [DBG] pgmap v11053: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:00 smithi163 bash[24253]: audit 2024-08-31T08:19:59.416207+0000 mgr.a (mgr.14388) 15945 : audit [DBG] from='client.344913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:00 smithi163 bash[24253]: cluster 2024-08-31T08:20:00.000123+0000 mon.a (mon.0) 2965 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:20:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:00 smithi027 bash[22610]: audit 2024-08-31T08:19:59.416207+0000 mgr.a (mgr.14388) 15945 : audit [DBG] from='client.344913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:00.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:00 smithi027 bash[22610]: cluster 2024-08-31T08:20:00.000123+0000 mon.a (mon.0) 2965 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:20:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:00 smithi191 bash[24992]: audit 2024-08-31T08:19:59.416207+0000 mgr.a (mgr.14388) 15945 : audit [DBG] from='client.344913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:00 smithi191 bash[24992]: cluster 2024-08-31T08:20:00.000123+0000 mon.a (mon.0) 2965 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:20:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:01 smithi163 bash[24253]: cluster 2024-08-31T08:20:00.404698+0000 mgr.a (mgr.14388) 15946 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:01 smithi027 bash[22610]: cluster 2024-08-31T08:20:00.404698+0000 mgr.a (mgr.14388) 15946 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:01 smithi191 bash[24992]: cluster 2024-08-31T08:20:00.404698+0000 mgr.a (mgr.14388) 15946 : cluster [DBG] pgmap v11054: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:03 smithi163 bash[24253]: cluster 2024-08-31T08:20:02.405495+0000 mgr.a (mgr.14388) 15947 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:03 smithi027 bash[22610]: cluster 2024-08-31T08:20:02.405495+0000 mgr.a (mgr.14388) 15947 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:03 smithi191 bash[24992]: cluster 2024-08-31T08:20:02.405495+0000 mgr.a (mgr.14388) 15947 : cluster [DBG] pgmap v11055: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:04.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:20:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:20:04.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:20:05.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:20:05.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:20:05.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:20:05.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:20:05.621 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:20:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:05 smithi163 bash[24253]: cluster 2024-08-31T08:20:04.407706+0000 mgr.a (mgr.14388) 15948 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:05 smithi027 bash[22610]: cluster 2024-08-31T08:20:04.407706+0000 mgr.a (mgr.14388) 15948 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:05 smithi191 bash[24992]: cluster 2024-08-31T08:20:04.407706+0000 mgr.a (mgr.14388) 15948 : cluster [DBG] pgmap v11056: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:06 smithi163 bash[24253]: audit 2024-08-31T08:20:05.182987+0000 mgr.a (mgr.14388) 15949 : audit [DBG] from='client.344988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:06.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:06 smithi027 bash[22610]: audit 2024-08-31T08:20:05.182987+0000 mgr.a (mgr.14388) 15949 : audit [DBG] from='client.344988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:06 smithi191 bash[24992]: audit 2024-08-31T08:20:05.182987+0000 mgr.a (mgr.14388) 15949 : audit [DBG] from='client.344988 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:07 smithi163 bash[24253]: cluster 2024-08-31T08:20:06.408670+0000 mgr.a (mgr.14388) 15950 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:07 smithi027 bash[22610]: cluster 2024-08-31T08:20:06.408670+0000 mgr.a (mgr.14388) 15950 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:07 smithi191 bash[24992]: cluster 2024-08-31T08:20:06.408670+0000 mgr.a (mgr.14388) 15950 : cluster [DBG] pgmap v11057: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:09 smithi163 bash[24253]: cluster 2024-08-31T08:20:08.410831+0000 mgr.a (mgr.14388) 15951 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:09 smithi027 bash[22610]: cluster 2024-08-31T08:20:08.410831+0000 mgr.a (mgr.14388) 15951 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:09 smithi191 bash[24992]: cluster 2024-08-31T08:20:08.410831+0000 mgr.a (mgr.14388) 15951 : cluster [DBG] pgmap v11058: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:10.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:20:10.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:20:10.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:20:11.398 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:20:11.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:20:11.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:20:11.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:20:11.399 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:20:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:11 smithi163 bash[24253]: cluster 2024-08-31T08:20:10.411596+0000 mgr.a (mgr.14388) 15952 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:11 smithi027 bash[22610]: cluster 2024-08-31T08:20:10.411596+0000 mgr.a (mgr.14388) 15952 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:11 smithi191 bash[24992]: cluster 2024-08-31T08:20:10.411596+0000 mgr.a (mgr.14388) 15952 : cluster [DBG] pgmap v11059: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:12 smithi163 bash[24253]: audit 2024-08-31T08:20:10.959107+0000 mgr.a (mgr.14388) 15953 : audit [DBG] from='client.345060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:12 smithi027 bash[22610]: audit 2024-08-31T08:20:10.959107+0000 mgr.a (mgr.14388) 15953 : audit [DBG] from='client.345060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:12 smithi191 bash[24992]: audit 2024-08-31T08:20:10.959107+0000 mgr.a (mgr.14388) 15953 : audit [DBG] from='client.345060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:13 smithi163 bash[24253]: cluster 2024-08-31T08:20:12.412486+0000 mgr.a (mgr.14388) 15954 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:13 smithi027 bash[22610]: cluster 2024-08-31T08:20:12.412486+0000 mgr.a (mgr.14388) 15954 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:13 smithi191 bash[24992]: cluster 2024-08-31T08:20:12.412486+0000 mgr.a (mgr.14388) 15954 : cluster [DBG] pgmap v11060: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:15 smithi163 bash[24253]: cluster 2024-08-31T08:20:14.414682+0000 mgr.a (mgr.14388) 15955 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:15 smithi027 bash[22610]: cluster 2024-08-31T08:20:14.414682+0000 mgr.a (mgr.14388) 15955 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:15 smithi191 bash[24992]: cluster 2024-08-31T08:20:14.414682+0000 mgr.a (mgr.14388) 15955 : cluster [DBG] pgmap v11061: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:16.400 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:20:16.401 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:20:16.401 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:20:17.146 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:20:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:20:17.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:20:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:20:17.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:20:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:17 smithi163 bash[24253]: cluster 2024-08-31T08:20:16.415362+0000 mgr.a (mgr.14388) 15956 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:17 smithi163 bash[24253]: audit 2024-08-31T08:20:16.730295+0000 mgr.a (mgr.14388) 15957 : audit [DBG] from='client.345138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:17 smithi027 bash[22610]: cluster 2024-08-31T08:20:16.415362+0000 mgr.a (mgr.14388) 15956 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:17 smithi027 bash[22610]: audit 2024-08-31T08:20:16.730295+0000 mgr.a (mgr.14388) 15957 : audit [DBG] from='client.345138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:17 smithi191 bash[24992]: cluster 2024-08-31T08:20:16.415362+0000 mgr.a (mgr.14388) 15956 : cluster [DBG] pgmap v11062: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:17 smithi191 bash[24992]: audit 2024-08-31T08:20:16.730295+0000 mgr.a (mgr.14388) 15957 : audit [DBG] from='client.345138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:19 smithi163 bash[24253]: cluster 2024-08-31T08:20:18.417580+0000 mgr.a (mgr.14388) 15958 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:19 smithi027 bash[22610]: cluster 2024-08-31T08:20:18.417580+0000 mgr.a (mgr.14388) 15958 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:19 smithi191 bash[24992]: cluster 2024-08-31T08:20:18.417580+0000 mgr.a (mgr.14388) 15958 : cluster [DBG] pgmap v11063: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:21 smithi163 bash[24253]: cluster 2024-08-31T08:20:20.418351+0000 mgr.a (mgr.14388) 15959 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:21 smithi027 bash[22610]: cluster 2024-08-31T08:20:20.418351+0000 mgr.a (mgr.14388) 15959 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:21 smithi191 bash[24992]: cluster 2024-08-31T08:20:20.418351+0000 mgr.a (mgr.14388) 15959 : cluster [DBG] pgmap v11064: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:22.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:20:22.148 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:20:22.149 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:20:22.936 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:20:22.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:20:22.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:20:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:20:22.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:20:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:23 smithi163 bash[24253]: cluster 2024-08-31T08:20:22.419126+0000 mgr.a (mgr.14388) 15960 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:23 smithi163 bash[24253]: audit 2024-08-31T08:20:22.487636+0000 mgr.a (mgr.14388) 15961 : audit [DBG] from='client.345216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:23 smithi027 bash[22610]: cluster 2024-08-31T08:20:22.419126+0000 mgr.a (mgr.14388) 15960 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:23 smithi027 bash[22610]: audit 2024-08-31T08:20:22.487636+0000 mgr.a (mgr.14388) 15961 : audit [DBG] from='client.345216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:23 smithi191 bash[24992]: cluster 2024-08-31T08:20:22.419126+0000 mgr.a (mgr.14388) 15960 : cluster [DBG] pgmap v11065: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:23 smithi191 bash[24992]: audit 2024-08-31T08:20:22.487636+0000 mgr.a (mgr.14388) 15961 : audit [DBG] from='client.345216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:25 smithi163 bash[24253]: cluster 2024-08-31T08:20:24.421444+0000 mgr.a (mgr.14388) 15962 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T08:20:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:25 smithi027 bash[22610]: cluster 2024-08-31T08:20:24.421444+0000 mgr.a (mgr.14388) 15962 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T08:20:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:25 smithi191 bash[24992]: cluster 2024-08-31T08:20:24.421444+0000 mgr.a (mgr.14388) 15962 : cluster [DBG] pgmap v11066: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T08:20:27.938 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:20:27.939 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:20:27.939 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:20:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:27 smithi163 bash[24253]: cluster 2024-08-31T08:20:26.422195+0000 mgr.a (mgr.14388) 15963 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:20:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:27 smithi027 bash[22610]: cluster 2024-08-31T08:20:26.422195+0000 mgr.a (mgr.14388) 15963 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:20:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:27 smithi191 bash[24992]: cluster 2024-08-31T08:20:26.422195+0000 mgr.a (mgr.14388) 15963 : cluster [DBG] pgmap v11067: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:20:28.693 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:20:28.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:20:28.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:20:28.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:20:28.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:20:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:29 smithi163 bash[24253]: audit 2024-08-31T08:20:28.269602+0000 mgr.a (mgr.14388) 15964 : audit [DBG] from='client.345294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:29 smithi163 bash[24253]: cluster 2024-08-31T08:20:28.423550+0000 mgr.a (mgr.14388) 15965 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:29 smithi027 bash[22610]: audit 2024-08-31T08:20:28.269602+0000 mgr.a (mgr.14388) 15964 : audit [DBG] from='client.345294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:29 smithi027 bash[22610]: cluster 2024-08-31T08:20:28.423550+0000 mgr.a (mgr.14388) 15965 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:29 smithi191 bash[24992]: audit 2024-08-31T08:20:28.269602+0000 mgr.a (mgr.14388) 15964 : audit [DBG] from='client.345294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:29 smithi191 bash[24992]: cluster 2024-08-31T08:20:28.423550+0000 mgr.a (mgr.14388) 15965 : cluster [DBG] pgmap v11068: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:31 smithi163 bash[24253]: cluster 2024-08-31T08:20:30.424422+0000 mgr.a (mgr.14388) 15966 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:20:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:31 smithi027 bash[22610]: cluster 2024-08-31T08:20:30.424422+0000 mgr.a (mgr.14388) 15966 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:20:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:31 smithi191 bash[24992]: cluster 2024-08-31T08:20:30.424422+0000 mgr.a (mgr.14388) 15966 : cluster [DBG] pgmap v11069: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:20:33.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:20:33.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:20:33.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:20:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:33 smithi163 bash[24253]: cluster 2024-08-31T08:20:32.425257+0000 mgr.a (mgr.14388) 15967 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:20:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:33 smithi027 bash[22610]: cluster 2024-08-31T08:20:32.425257+0000 mgr.a (mgr.14388) 15967 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:20:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:33 smithi191 bash[24992]: cluster 2024-08-31T08:20:32.425257+0000 mgr.a (mgr.14388) 15967 : cluster [DBG] pgmap v11070: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:20:34.442 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:20:34.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:20:34.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:20:34.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:20:34.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:20:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:35 smithi163 bash[24253]: audit 2024-08-31T08:20:34.023842+0000 mgr.a (mgr.14388) 15968 : audit [DBG] from='client.345372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:35 smithi163 bash[24253]: cluster 2024-08-31T08:20:34.426839+0000 mgr.a (mgr.14388) 15969 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:35 smithi027 bash[22610]: audit 2024-08-31T08:20:34.023842+0000 mgr.a (mgr.14388) 15968 : audit [DBG] from='client.345372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:35.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:35 smithi027 bash[22610]: cluster 2024-08-31T08:20:34.426839+0000 mgr.a (mgr.14388) 15969 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:35 smithi191 bash[24992]: audit 2024-08-31T08:20:34.023842+0000 mgr.a (mgr.14388) 15968 : audit [DBG] from='client.345372 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:35 smithi191 bash[24992]: cluster 2024-08-31T08:20:34.426839+0000 mgr.a (mgr.14388) 15969 : cluster [DBG] pgmap v11071: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:37 smithi163 bash[24253]: cluster 2024-08-31T08:20:36.427564+0000 mgr.a (mgr.14388) 15970 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T08:20:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:37 smithi027 bash[22610]: cluster 2024-08-31T08:20:36.427564+0000 mgr.a (mgr.14388) 15970 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T08:20:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:37 smithi191 bash[24992]: cluster 2024-08-31T08:20:36.427564+0000 mgr.a (mgr.14388) 15970 : cluster [DBG] pgmap v11072: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-31T08:20:39.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:20:39.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:20:39.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:20:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:39 smithi163 bash[24253]: cluster 2024-08-31T08:20:38.429595+0000 mgr.a (mgr.14388) 15971 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T08:20:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:39 smithi027 bash[22610]: cluster 2024-08-31T08:20:38.429595+0000 mgr.a (mgr.14388) 15971 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T08:20:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:39 smithi191 bash[24992]: cluster 2024-08-31T08:20:38.429595+0000 mgr.a (mgr.14388) 15971 : cluster [DBG] pgmap v11073: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-08-31T08:20:40.228 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:20:40.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:20:40.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:20:40.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:20:40.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:20:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:40 smithi163 bash[24253]: audit 2024-08-31T08:20:39.785194+0000 mgr.a (mgr.14388) 15972 : audit [DBG] from='client.345450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:40 smithi027 bash[22610]: audit 2024-08-31T08:20:39.785194+0000 mgr.a (mgr.14388) 15972 : audit [DBG] from='client.345450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:40 smithi191 bash[24992]: audit 2024-08-31T08:20:39.785194+0000 mgr.a (mgr.14388) 15972 : audit [DBG] from='client.345450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:41 smithi163 bash[24253]: cluster 2024-08-31T08:20:40.430615+0000 mgr.a (mgr.14388) 15973 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:41 smithi027 bash[22610]: cluster 2024-08-31T08:20:40.430615+0000 mgr.a (mgr.14388) 15973 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:41 smithi191 bash[24992]: cluster 2024-08-31T08:20:40.430615+0000 mgr.a (mgr.14388) 15973 : cluster [DBG] pgmap v11074: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:43 smithi163 bash[24253]: cluster 2024-08-31T08:20:42.431486+0000 mgr.a (mgr.14388) 15974 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:43 smithi027 bash[22610]: cluster 2024-08-31T08:20:42.431486+0000 mgr.a (mgr.14388) 15974 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:43 smithi191 bash[24992]: cluster 2024-08-31T08:20:42.431486+0000 mgr.a (mgr.14388) 15974 : cluster [DBG] pgmap v11075: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:45.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:20:45.231 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:20:45.231 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:20:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:45 smithi163 bash[24253]: cluster 2024-08-31T08:20:44.433693+0000 mgr.a (mgr.14388) 15975 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:45.975 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:20:45.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:20:45.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:20:45.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:20:45.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:20:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:45 smithi027 bash[22610]: cluster 2024-08-31T08:20:44.433693+0000 mgr.a (mgr.14388) 15975 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:45 smithi191 bash[24992]: cluster 2024-08-31T08:20:44.433693+0000 mgr.a (mgr.14388) 15975 : cluster [DBG] pgmap v11076: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:46 smithi163 bash[24253]: audit 2024-08-31T08:20:45.562114+0000 mgr.a (mgr.14388) 15976 : audit [DBG] from='client.345528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:46 smithi027 bash[22610]: audit 2024-08-31T08:20:45.562114+0000 mgr.a (mgr.14388) 15976 : audit [DBG] from='client.345528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:46 smithi191 bash[24992]: audit 2024-08-31T08:20:45.562114+0000 mgr.a (mgr.14388) 15976 : audit [DBG] from='client.345528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:47 smithi163 bash[24253]: cluster 2024-08-31T08:20:46.434839+0000 mgr.a (mgr.14388) 15977 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:47 smithi027 bash[22610]: cluster 2024-08-31T08:20:46.434839+0000 mgr.a (mgr.14388) 15977 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:47 smithi191 bash[24992]: cluster 2024-08-31T08:20:46.434839+0000 mgr.a (mgr.14388) 15977 : cluster [DBG] pgmap v11077: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:49 smithi027 bash[22610]: cluster 2024-08-31T08:20:48.437178+0000 mgr.a (mgr.14388) 15978 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:49 smithi027 bash[22610]: audit 2024-08-31T08:20:49.681467+0000 mon.a (mon.0) 2966 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:20:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:49 smithi191 bash[24992]: cluster 2024-08-31T08:20:48.437178+0000 mgr.a (mgr.14388) 15978 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:49 smithi191 bash[24992]: audit 2024-08-31T08:20:49.681467+0000 mon.a (mon.0) 2966 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:20:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:49 smithi163 bash[24253]: cluster 2024-08-31T08:20:48.437178+0000 mgr.a (mgr.14388) 15978 : cluster [DBG] pgmap v11078: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:20:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:49 smithi163 bash[24253]: audit 2024-08-31T08:20:49.681467+0000 mon.a (mon.0) 2966 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:20:50.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:20:50.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:20:50.977 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:20:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:50 smithi027 bash[22610]: audit 2024-08-31T08:20:50.516127+0000 mon.a (mon.0) 2967 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:20:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:50 smithi027 bash[22610]: audit 2024-08-31T08:20:50.518124+0000 mon.a (mon.0) 2968 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:20:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:50 smithi027 bash[22610]: audit 2024-08-31T08:20:50.529419+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:20:50.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:50 smithi027 bash[22610]: audit 2024-08-31T08:20:50.534833+0000 mon.a (mon.0) 2970 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:20:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:50 smithi191 bash[24992]: audit 2024-08-31T08:20:50.516127+0000 mon.a (mon.0) 2967 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:20:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:50 smithi191 bash[24992]: audit 2024-08-31T08:20:50.518124+0000 mon.a (mon.0) 2968 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:20:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:50 smithi191 bash[24992]: audit 2024-08-31T08:20:50.529419+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:20:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:50 smithi191 bash[24992]: audit 2024-08-31T08:20:50.534833+0000 mon.a (mon.0) 2970 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:20:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:50 smithi163 bash[24253]: audit 2024-08-31T08:20:50.516127+0000 mon.a (mon.0) 2967 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:20:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:50 smithi163 bash[24253]: audit 2024-08-31T08:20:50.518124+0000 mon.a (mon.0) 2968 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:20:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:50 smithi163 bash[24253]: audit 2024-08-31T08:20:50.529419+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:20:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:50 smithi163 bash[24253]: audit 2024-08-31T08:20:50.534833+0000 mon.a (mon.0) 2970 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:20:51.705 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:20:51.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:20:51.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:20:51.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:20:51.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:20:51.709 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:20:51 smithi027 bash[22863]: debug 2024-08-31T08:20:51.272+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:20:51.709 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:20:51 smithi027 bash[22863]: debug 2024-08-31T08:20:51.272+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:20:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:51 smithi027 bash[22610]: cluster 2024-08-31T08:20:50.438097+0000 mgr.a (mgr.14388) 15979 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:51 smithi027 bash[22610]: audit 2024-08-31T08:20:50.537169+0000 mgr.a (mgr.14388) 15980 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:20:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:51 smithi191 bash[24992]: cluster 2024-08-31T08:20:50.438097+0000 mgr.a (mgr.14388) 15979 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:51 smithi191 bash[24992]: audit 2024-08-31T08:20:50.537169+0000 mgr.a (mgr.14388) 15980 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:20:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:51 smithi163 bash[24253]: cluster 2024-08-31T08:20:50.438097+0000 mgr.a (mgr.14388) 15979 : cluster [DBG] pgmap v11079: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:51 smithi163 bash[24253]: audit 2024-08-31T08:20:50.537169+0000 mgr.a (mgr.14388) 15980 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:20:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:52 smithi027 bash[22610]: audit 2024-08-31T08:20:51.275850+0000 mgr.a (mgr.14388) 15981 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:20:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:52 smithi027 bash[22610]: cephadm 2024-08-31T08:20:51.277055+0000 mgr.a (mgr.14388) 15982 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:20:52.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:52 smithi027 bash[22610]: audit 2024-08-31T08:20:51.299595+0000 mgr.a (mgr.14388) 15983 : audit [DBG] from='client.345690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:52 smithi191 bash[24992]: audit 2024-08-31T08:20:51.275850+0000 mgr.a (mgr.14388) 15981 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:20:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:52 smithi191 bash[24992]: cephadm 2024-08-31T08:20:51.277055+0000 mgr.a (mgr.14388) 15982 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:20:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:52 smithi191 bash[24992]: audit 2024-08-31T08:20:51.299595+0000 mgr.a (mgr.14388) 15983 : audit [DBG] from='client.345690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:52 smithi163 bash[24253]: audit 2024-08-31T08:20:51.275850+0000 mgr.a (mgr.14388) 15981 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:20:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:52 smithi163 bash[24253]: cephadm 2024-08-31T08:20:51.277055+0000 mgr.a (mgr.14388) 15982 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:20:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:52 smithi163 bash[24253]: audit 2024-08-31T08:20:51.299595+0000 mgr.a (mgr.14388) 15983 : audit [DBG] from='client.345690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:53 smithi027 bash[22610]: cluster 2024-08-31T08:20:52.439198+0000 mgr.a (mgr.14388) 15984 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:53 smithi191 bash[24992]: cluster 2024-08-31T08:20:52.439198+0000 mgr.a (mgr.14388) 15984 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:53 smithi163 bash[24253]: cluster 2024-08-31T08:20:52.439198+0000 mgr.a (mgr.14388) 15984 : cluster [DBG] pgmap v11080: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:20:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:55 smithi027 bash[22610]: cluster 2024-08-31T08:20:54.441468+0000 mgr.a (mgr.14388) 15985 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:55 smithi191 bash[24992]: cluster 2024-08-31T08:20:54.441468+0000 mgr.a (mgr.14388) 15985 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:55 smithi163 bash[24253]: cluster 2024-08-31T08:20:54.441468+0000 mgr.a (mgr.14388) 15985 : cluster [DBG] pgmap v11081: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:56.705 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:20:56.706 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:20:56.706 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:20:57.483 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:20:57.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:20:57.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:20:57.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:20:57.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:20:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:57 smithi027 bash[22610]: cluster 2024-08-31T08:20:56.442236+0000 mgr.a (mgr.14388) 15986 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:57 smithi191 bash[24992]: cluster 2024-08-31T08:20:56.442236+0000 mgr.a (mgr.14388) 15986 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:57 smithi163 bash[24253]: cluster 2024-08-31T08:20:56.442236+0000 mgr.a (mgr.14388) 15986 : cluster [DBG] pgmap v11082: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:20:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:58 smithi191 bash[24992]: audit 2024-08-31T08:20:57.041956+0000 mgr.a (mgr.14388) 15987 : audit [DBG] from='client.345786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:58 smithi163 bash[24253]: audit 2024-08-31T08:20:57.041956+0000 mgr.a (mgr.14388) 15987 : audit [DBG] from='client.345786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:20:59.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:58 smithi027 bash[22610]: audit 2024-08-31T08:20:57.041956+0000 mgr.a (mgr.14388) 15987 : audit [DBG] from='client.345786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:20:59 smithi191 bash[24992]: cluster 2024-08-31T08:20:58.444453+0000 mgr.a (mgr.14388) 15988 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:20:59 smithi163 bash[24253]: cluster 2024-08-31T08:20:58.444453+0000 mgr.a (mgr.14388) 15988 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:20:59 smithi027 bash[22610]: cluster 2024-08-31T08:20:58.444453+0000 mgr.a (mgr.14388) 15988 : cluster [DBG] pgmap v11083: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:01 smithi191 bash[24992]: cluster 2024-08-31T08:21:00.445225+0000 mgr.a (mgr.14388) 15989 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:01 smithi163 bash[24253]: cluster 2024-08-31T08:21:00.445225+0000 mgr.a (mgr.14388) 15989 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:01 smithi027 bash[22610]: cluster 2024-08-31T08:21:00.445225+0000 mgr.a (mgr.14388) 15989 : cluster [DBG] pgmap v11084: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:02.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:21:02.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:21:02.486 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:21:03.261 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:21:03.261 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:21:03.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:21:03.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:21:03.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:21:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:03 smithi191 bash[24992]: cluster 2024-08-31T08:21:02.446022+0000 mgr.a (mgr.14388) 15990 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:03 smithi191 bash[24992]: audit 2024-08-31T08:21:02.818949+0000 mgr.a (mgr.14388) 15991 : audit [DBG] from='client.345864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:03 smithi163 bash[24253]: cluster 2024-08-31T08:21:02.446022+0000 mgr.a (mgr.14388) 15990 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:03 smithi163 bash[24253]: audit 2024-08-31T08:21:02.818949+0000 mgr.a (mgr.14388) 15991 : audit [DBG] from='client.345864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:03 smithi027 bash[22610]: cluster 2024-08-31T08:21:02.446022+0000 mgr.a (mgr.14388) 15990 : cluster [DBG] pgmap v11085: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:03 smithi027 bash[22610]: audit 2024-08-31T08:21:02.818949+0000 mgr.a (mgr.14388) 15991 : audit [DBG] from='client.345864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:05 smithi191 bash[24992]: cluster 2024-08-31T08:21:04.448757+0000 mgr.a (mgr.14388) 15992 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:05 smithi163 bash[24253]: cluster 2024-08-31T08:21:04.448757+0000 mgr.a (mgr.14388) 15992 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:05 smithi027 bash[22610]: cluster 2024-08-31T08:21:04.448757+0000 mgr.a (mgr.14388) 15992 : cluster [DBG] pgmap v11086: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:07 smithi191 bash[24992]: cluster 2024-08-31T08:21:06.449676+0000 mgr.a (mgr.14388) 15993 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:07 smithi163 bash[24253]: cluster 2024-08-31T08:21:06.449676+0000 mgr.a (mgr.14388) 15993 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:07 smithi027 bash[22610]: cluster 2024-08-31T08:21:06.449676+0000 mgr.a (mgr.14388) 15993 : cluster [DBG] pgmap v11087: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:08.263 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:21:08.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:21:08.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:21:09.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:21:09.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:21:09.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:21:09.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:21:09.043 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:21:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:09 smithi191 bash[24992]: cluster 2024-08-31T08:21:08.451803+0000 mgr.a (mgr.14388) 15994 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:09 smithi191 bash[24992]: audit 2024-08-31T08:21:08.597830+0000 mgr.a (mgr.14388) 15995 : audit [DBG] from='client.345939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:09 smithi163 bash[24253]: cluster 2024-08-31T08:21:08.451803+0000 mgr.a (mgr.14388) 15994 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:09 smithi163 bash[24253]: audit 2024-08-31T08:21:08.597830+0000 mgr.a (mgr.14388) 15995 : audit [DBG] from='client.345939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:09 smithi027 bash[22610]: cluster 2024-08-31T08:21:08.451803+0000 mgr.a (mgr.14388) 15994 : cluster [DBG] pgmap v11088: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:09 smithi027 bash[22610]: audit 2024-08-31T08:21:08.597830+0000 mgr.a (mgr.14388) 15995 : audit [DBG] from='client.345939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:11 smithi163 bash[24253]: cluster 2024-08-31T08:21:10.452725+0000 mgr.a (mgr.14388) 15996 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:11 smithi027 bash[22610]: cluster 2024-08-31T08:21:10.452725+0000 mgr.a (mgr.14388) 15996 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:11 smithi191 bash[24992]: cluster 2024-08-31T08:21:10.452725+0000 mgr.a (mgr.14388) 15996 : cluster [DBG] pgmap v11089: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:13 smithi191 bash[24992]: cluster 2024-08-31T08:21:12.453571+0000 mgr.a (mgr.14388) 15997 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:21:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:13 smithi163 bash[24253]: cluster 2024-08-31T08:21:12.453571+0000 mgr.a (mgr.14388) 15997 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:21:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:13 smithi027 bash[22610]: cluster 2024-08-31T08:21:12.453571+0000 mgr.a (mgr.14388) 15997 : cluster [DBG] pgmap v11090: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:21:14.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:21:14.044 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:21:14.044 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:21:14.821 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:21:14.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:21:14.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:21:14.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:21:14.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:21:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:15 smithi191 bash[24992]: audit 2024-08-31T08:21:14.376306+0000 mgr.a (mgr.14388) 15998 : audit [DBG] from='client.346017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:15 smithi191 bash[24992]: cluster 2024-08-31T08:21:14.455236+0000 mgr.a (mgr.14388) 15999 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:15 smithi163 bash[24253]: audit 2024-08-31T08:21:14.376306+0000 mgr.a (mgr.14388) 15998 : audit [DBG] from='client.346017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:15 smithi163 bash[24253]: cluster 2024-08-31T08:21:14.455236+0000 mgr.a (mgr.14388) 15999 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:15 smithi027 bash[22610]: audit 2024-08-31T08:21:14.376306+0000 mgr.a (mgr.14388) 15998 : audit [DBG] from='client.346017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:15 smithi027 bash[22610]: cluster 2024-08-31T08:21:14.455236+0000 mgr.a (mgr.14388) 15999 : cluster [DBG] pgmap v11091: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:17 smithi191 bash[24992]: cluster 2024-08-31T08:21:16.456238+0000 mgr.a (mgr.14388) 16000 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:17 smithi163 bash[24253]: cluster 2024-08-31T08:21:16.456238+0000 mgr.a (mgr.14388) 16000 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:17 smithi027 bash[22610]: cluster 2024-08-31T08:21:16.456238+0000 mgr.a (mgr.14388) 16000 : cluster [DBG] pgmap v11092: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:19 smithi191 bash[24992]: cluster 2024-08-31T08:21:18.458530+0000 mgr.a (mgr.14388) 16001 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:19.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:21:19.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:21:19.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:21:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:19 smithi163 bash[24253]: cluster 2024-08-31T08:21:18.458530+0000 mgr.a (mgr.14388) 16001 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:19 smithi027 bash[22610]: cluster 2024-08-31T08:21:18.458530+0000 mgr.a (mgr.14388) 16001 : cluster [DBG] pgmap v11093: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:20.602 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:21:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:21:20.602 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:21:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:21:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:21:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:21 smithi191 bash[24992]: audit 2024-08-31T08:21:20.161943+0000 mgr.a (mgr.14388) 16002 : audit [DBG] from='client.346092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:21 smithi191 bash[24992]: cluster 2024-08-31T08:21:20.459156+0000 mgr.a (mgr.14388) 16003 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:21 smithi163 bash[24253]: audit 2024-08-31T08:21:20.161943+0000 mgr.a (mgr.14388) 16002 : audit [DBG] from='client.346092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:21 smithi163 bash[24253]: cluster 2024-08-31T08:21:20.459156+0000 mgr.a (mgr.14388) 16003 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:21 smithi027 bash[22610]: audit 2024-08-31T08:21:20.161943+0000 mgr.a (mgr.14388) 16002 : audit [DBG] from='client.346092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:21 smithi027 bash[22610]: cluster 2024-08-31T08:21:20.459156+0000 mgr.a (mgr.14388) 16003 : cluster [DBG] pgmap v11094: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:23 smithi191 bash[24992]: cluster 2024-08-31T08:21:22.459969+0000 mgr.a (mgr.14388) 16004 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:23 smithi163 bash[24253]: cluster 2024-08-31T08:21:22.459969+0000 mgr.a (mgr.14388) 16004 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:23 smithi027 bash[22610]: cluster 2024-08-31T08:21:22.459969+0000 mgr.a (mgr.14388) 16004 : cluster [DBG] pgmap v11095: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:25.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:21:25.604 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:21:25.605 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:21:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:25 smithi191 bash[24992]: cluster 2024-08-31T08:21:24.462172+0000 mgr.a (mgr.14388) 16005 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:25 smithi163 bash[24253]: cluster 2024-08-31T08:21:24.462172+0000 mgr.a (mgr.14388) 16005 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:25 smithi027 bash[22610]: cluster 2024-08-31T08:21:24.462172+0000 mgr.a (mgr.14388) 16005 : cluster [DBG] pgmap v11096: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:21:26.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:21:26.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:21:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:27 smithi163 bash[24253]: audit 2024-08-31T08:21:25.936491+0000 mgr.a (mgr.14388) 16006 : audit [DBG] from='client.346170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:27 smithi163 bash[24253]: cluster 2024-08-31T08:21:26.463126+0000 mgr.a (mgr.14388) 16007 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:27 smithi027 bash[22610]: audit 2024-08-31T08:21:25.936491+0000 mgr.a (mgr.14388) 16006 : audit [DBG] from='client.346170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:27 smithi027 bash[22610]: cluster 2024-08-31T08:21:26.463126+0000 mgr.a (mgr.14388) 16007 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:27 smithi191 bash[24992]: audit 2024-08-31T08:21:25.936491+0000 mgr.a (mgr.14388) 16006 : audit [DBG] from='client.346170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:27 smithi191 bash[24992]: cluster 2024-08-31T08:21:26.463126+0000 mgr.a (mgr.14388) 16007 : cluster [DBG] pgmap v11097: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:29 smithi163 bash[24253]: cluster 2024-08-31T08:21:28.465284+0000 mgr.a (mgr.14388) 16008 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:29 smithi027 bash[22610]: cluster 2024-08-31T08:21:28.465284+0000 mgr.a (mgr.14388) 16008 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:29 smithi191 bash[24992]: cluster 2024-08-31T08:21:28.465284+0000 mgr.a (mgr.14388) 16008 : cluster [DBG] pgmap v11098: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:31.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:21:31.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:21:31.361 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:21:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:31 smithi163 bash[24253]: cluster 2024-08-31T08:21:30.466051+0000 mgr.a (mgr.14388) 16009 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:31 smithi027 bash[22610]: cluster 2024-08-31T08:21:30.466051+0000 mgr.a (mgr.14388) 16009 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:31 smithi191 bash[24992]: cluster 2024-08-31T08:21:30.466051+0000 mgr.a (mgr.14388) 16009 : cluster [DBG] pgmap v11099: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:32.143 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:21:32.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:21:32.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:21:32.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:21:32.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:21:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:32 smithi163 bash[24253]: audit 2024-08-31T08:21:31.695263+0000 mgr.a (mgr.14388) 16010 : audit [DBG] from='client.346245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:32 smithi027 bash[22610]: audit 2024-08-31T08:21:31.695263+0000 mgr.a (mgr.14388) 16010 : audit [DBG] from='client.346245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:32 smithi191 bash[24992]: audit 2024-08-31T08:21:31.695263+0000 mgr.a (mgr.14388) 16010 : audit [DBG] from='client.346245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:33 smithi163 bash[24253]: cluster 2024-08-31T08:21:32.466969+0000 mgr.a (mgr.14388) 16011 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:33.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:33 smithi027 bash[22610]: cluster 2024-08-31T08:21:32.466969+0000 mgr.a (mgr.14388) 16011 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:33 smithi191 bash[24992]: cluster 2024-08-31T08:21:32.466969+0000 mgr.a (mgr.14388) 16011 : cluster [DBG] pgmap v11100: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:35 smithi163 bash[24253]: cluster 2024-08-31T08:21:34.469173+0000 mgr.a (mgr.14388) 16012 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:35 smithi027 bash[22610]: cluster 2024-08-31T08:21:34.469173+0000 mgr.a (mgr.14388) 16012 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:35 smithi191 bash[24992]: cluster 2024-08-31T08:21:34.469173+0000 mgr.a (mgr.14388) 16012 : cluster [DBG] pgmap v11101: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:37.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:21:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:21:37.145 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:21:37.932 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:21:37.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:21:37.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:21:37.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:21:37.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:21:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:37 smithi163 bash[24253]: cluster 2024-08-31T08:21:36.469909+0000 mgr.a (mgr.14388) 16013 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:37 smithi027 bash[22610]: cluster 2024-08-31T08:21:36.469909+0000 mgr.a (mgr.14388) 16013 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:37 smithi191 bash[24992]: cluster 2024-08-31T08:21:36.469909+0000 mgr.a (mgr.14388) 16013 : cluster [DBG] pgmap v11102: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:38 smithi163 bash[24253]: audit 2024-08-31T08:21:37.483630+0000 mgr.a (mgr.14388) 16014 : audit [DBG] from='client.346323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:38 smithi027 bash[22610]: audit 2024-08-31T08:21:37.483630+0000 mgr.a (mgr.14388) 16014 : audit [DBG] from='client.346323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:38 smithi191 bash[24992]: audit 2024-08-31T08:21:37.483630+0000 mgr.a (mgr.14388) 16014 : audit [DBG] from='client.346323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:39 smithi163 bash[24253]: cluster 2024-08-31T08:21:38.472182+0000 mgr.a (mgr.14388) 16015 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:39 smithi027 bash[22610]: cluster 2024-08-31T08:21:38.472182+0000 mgr.a (mgr.14388) 16015 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:39 smithi191 bash[24992]: cluster 2024-08-31T08:21:38.472182+0000 mgr.a (mgr.14388) 16015 : cluster [DBG] pgmap v11103: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:21:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:41 smithi163 bash[24253]: cluster 2024-08-31T08:21:40.472956+0000 mgr.a (mgr.14388) 16016 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:41 smithi027 bash[22610]: cluster 2024-08-31T08:21:40.472956+0000 mgr.a (mgr.14388) 16016 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:41 smithi191 bash[24992]: cluster 2024-08-31T08:21:40.472956+0000 mgr.a (mgr.14388) 16016 : cluster [DBG] pgmap v11104: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:42.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:21:42.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:21:42.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:21:43.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:21:43.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:21:43.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:21:43.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:21:43.720 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:21:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:43 smithi163 bash[24253]: cluster 2024-08-31T08:21:42.473731+0000 mgr.a (mgr.14388) 16017 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:43 smithi027 bash[22610]: cluster 2024-08-31T08:21:42.473731+0000 mgr.a (mgr.14388) 16017 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:43 smithi191 bash[24992]: cluster 2024-08-31T08:21:42.473731+0000 mgr.a (mgr.14388) 16017 : cluster [DBG] pgmap v11105: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:44 smithi163 bash[24253]: audit 2024-08-31T08:21:43.271266+0000 mgr.a (mgr.14388) 16018 : audit [DBG] from='client.346398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:44 smithi027 bash[22610]: audit 2024-08-31T08:21:43.271266+0000 mgr.a (mgr.14388) 16018 : audit [DBG] from='client.346398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:44 smithi191 bash[24992]: audit 2024-08-31T08:21:43.271266+0000 mgr.a (mgr.14388) 16018 : audit [DBG] from='client.346398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:45 smithi163 bash[24253]: cluster 2024-08-31T08:21:44.476474+0000 mgr.a (mgr.14388) 16019 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:45 smithi027 bash[22610]: cluster 2024-08-31T08:21:44.476474+0000 mgr.a (mgr.14388) 16019 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:45 smithi191 bash[24992]: cluster 2024-08-31T08:21:44.476474+0000 mgr.a (mgr.14388) 16019 : cluster [DBG] pgmap v11106: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:47 smithi163 bash[24253]: cluster 2024-08-31T08:21:46.477244+0000 mgr.a (mgr.14388) 16020 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:47 smithi027 bash[22610]: cluster 2024-08-31T08:21:46.477244+0000 mgr.a (mgr.14388) 16020 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:47 smithi191 bash[24992]: cluster 2024-08-31T08:21:46.477244+0000 mgr.a (mgr.14388) 16020 : cluster [DBG] pgmap v11107: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:48.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:21:48.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:21:48.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:21:49.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:21:49.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:21:49.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:21:49.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:21:49.487 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:21:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:49 smithi163 bash[24253]: cluster 2024-08-31T08:21:48.479177+0000 mgr.a (mgr.14388) 16021 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:49 smithi027 bash[22610]: cluster 2024-08-31T08:21:48.479177+0000 mgr.a (mgr.14388) 16021 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:49 smithi191 bash[24992]: cluster 2024-08-31T08:21:48.479177+0000 mgr.a (mgr.14388) 16021 : cluster [DBG] pgmap v11108: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:21:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:50 smithi163 bash[24253]: audit 2024-08-31T08:21:49.061926+0000 mgr.a (mgr.14388) 16022 : audit [DBG] from='client.346473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:50 smithi027 bash[22610]: audit 2024-08-31T08:21:49.061926+0000 mgr.a (mgr.14388) 16022 : audit [DBG] from='client.346473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:50 smithi191 bash[24992]: audit 2024-08-31T08:21:49.061926+0000 mgr.a (mgr.14388) 16022 : audit [DBG] from='client.346473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:51 smithi163 bash[24253]: cluster 2024-08-31T08:21:50.480025+0000 mgr.a (mgr.14388) 16023 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:51 smithi163 bash[24253]: audit 2024-08-31T08:21:51.337859+0000 mon.a (mon.0) 2971 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:21:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:51 smithi027 bash[22610]: cluster 2024-08-31T08:21:50.480025+0000 mgr.a (mgr.14388) 16023 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:51 smithi027 bash[22610]: audit 2024-08-31T08:21:51.337859+0000 mon.a (mon.0) 2971 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:21:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:51 smithi191 bash[24992]: cluster 2024-08-31T08:21:50.480025+0000 mgr.a (mgr.14388) 16023 : cluster [DBG] pgmap v11109: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:21:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:51 smithi191 bash[24992]: audit 2024-08-31T08:21:51.337859+0000 mon.a (mon.0) 2971 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:21:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:52 smithi163 bash[24253]: audit 2024-08-31T08:21:52.183818+0000 mon.a (mon.0) 2972 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:21:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:52 smithi163 bash[24253]: audit 2024-08-31T08:21:52.185212+0000 mon.a (mon.0) 2973 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:21:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:52 smithi163 bash[24253]: audit 2024-08-31T08:21:52.195485+0000 mon.a (mon.0) 2974 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:21:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:52 smithi163 bash[24253]: audit 2024-08-31T08:21:52.200511+0000 mon.a (mon.0) 2975 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:21:52.954 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:52 smithi027 bash[22610]: audit 2024-08-31T08:21:52.183818+0000 mon.a (mon.0) 2972 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:21:52.954 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:52 smithi027 bash[22610]: audit 2024-08-31T08:21:52.185212+0000 mon.a (mon.0) 2973 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:21:52.954 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:52 smithi027 bash[22610]: audit 2024-08-31T08:21:52.195485+0000 mon.a (mon.0) 2974 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:21:52.954 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:52 smithi027 bash[22610]: audit 2024-08-31T08:21:52.200511+0000 mon.a (mon.0) 2975 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:21:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:52 smithi191 bash[24992]: audit 2024-08-31T08:21:52.183818+0000 mon.a (mon.0) 2972 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:21:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:52 smithi191 bash[24992]: audit 2024-08-31T08:21:52.185212+0000 mon.a (mon.0) 2973 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:21:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:52 smithi191 bash[24992]: audit 2024-08-31T08:21:52.195485+0000 mon.a (mon.0) 2974 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:21:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:52 smithi191 bash[24992]: audit 2024-08-31T08:21:52.200511+0000 mon.a (mon.0) 2975 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:21:53.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:21:52 smithi027 bash[22863]: debug 2024-08-31T08:21:52.950+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:21:53.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:21:52 smithi027 bash[22863]: debug 2024-08-31T08:21:52.954+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:21:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:53 smithi163 bash[24253]: audit 2024-08-31T08:21:52.202981+0000 mgr.a (mgr.14388) 16024 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:21:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:53 smithi163 bash[24253]: cluster 2024-08-31T08:21:52.480713+0000 mgr.a (mgr.14388) 16025 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:21:53.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:53 smithi027 bash[22610]: audit 2024-08-31T08:21:52.202981+0000 mgr.a (mgr.14388) 16024 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:21:53.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:53 smithi027 bash[22610]: cluster 2024-08-31T08:21:52.480713+0000 mgr.a (mgr.14388) 16025 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:21:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:53 smithi191 bash[24992]: audit 2024-08-31T08:21:52.202981+0000 mgr.a (mgr.14388) 16024 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:21:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:53 smithi191 bash[24992]: cluster 2024-08-31T08:21:52.480713+0000 mgr.a (mgr.14388) 16025 : cluster [DBG] pgmap v11110: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:21:54.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:21:54.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:21:54.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:21:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:54 smithi163 bash[24253]: audit 2024-08-31T08:21:52.953602+0000 mgr.a (mgr.14388) 16026 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:21:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:54 smithi163 bash[24253]: cephadm 2024-08-31T08:21:52.954941+0000 mgr.a (mgr.14388) 16027 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:21:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:54 smithi027 bash[22610]: audit 2024-08-31T08:21:52.953602+0000 mgr.a (mgr.14388) 16026 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:21:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:54 smithi027 bash[22610]: cephadm 2024-08-31T08:21:52.954941+0000 mgr.a (mgr.14388) 16027 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:21:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:54 smithi191 bash[24992]: audit 2024-08-31T08:21:52.953602+0000 mgr.a (mgr.14388) 16026 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:21:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:54 smithi191 bash[24992]: cephadm 2024-08-31T08:21:52.954941+0000 mgr.a (mgr.14388) 16027 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:21:55.266 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:21:55.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:21:55.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:21:55.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:21:55.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:21:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:55 smithi163 bash[24253]: cluster 2024-08-31T08:21:54.483007+0000 mgr.a (mgr.14388) 16028 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:55 smithi163 bash[24253]: audit 2024-08-31T08:21:54.818418+0000 mgr.a (mgr.14388) 16029 : audit [DBG] from='client.346659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:55 smithi027 bash[22610]: cluster 2024-08-31T08:21:54.483007+0000 mgr.a (mgr.14388) 16028 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:55 smithi027 bash[22610]: audit 2024-08-31T08:21:54.818418+0000 mgr.a (mgr.14388) 16029 : audit [DBG] from='client.346659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:55 smithi191 bash[24992]: cluster 2024-08-31T08:21:54.483007+0000 mgr.a (mgr.14388) 16028 : cluster [DBG] pgmap v11111: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:55 smithi191 bash[24992]: audit 2024-08-31T08:21:54.818418+0000 mgr.a (mgr.14388) 16029 : audit [DBG] from='client.346659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:21:57.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:57 smithi163 bash[24253]: cluster 2024-08-31T08:21:56.483877+0000 mgr.a (mgr.14388) 16030 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:57 smithi027 bash[22610]: cluster 2024-08-31T08:21:56.483877+0000 mgr.a (mgr.14388) 16030 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:57 smithi191 bash[24992]: cluster 2024-08-31T08:21:56.483877+0000 mgr.a (mgr.14388) 16030 : cluster [DBG] pgmap v11112: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:21:59 smithi163 bash[24253]: cluster 2024-08-31T08:21:58.486008+0000 mgr.a (mgr.14388) 16031 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:21:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:21:59 smithi027 bash[22610]: cluster 2024-08-31T08:21:58.486008+0000 mgr.a (mgr.14388) 16031 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:21:59 smithi191 bash[24992]: cluster 2024-08-31T08:21:58.486008+0000 mgr.a (mgr.14388) 16031 : cluster [DBG] pgmap v11113: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:00.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:00.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:00.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:01.038 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:01.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:22:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:01 smithi163 bash[24253]: cluster 2024-08-31T08:22:00.486762+0000 mgr.a (mgr.14388) 16032 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:01.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:01 smithi163 bash[24253]: audit 2024-08-31T08:22:00.606506+0000 mgr.a (mgr.14388) 16033 : audit [DBG] from='client.346737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:01 smithi027 bash[22610]: cluster 2024-08-31T08:22:00.486762+0000 mgr.a (mgr.14388) 16032 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:01 smithi027 bash[22610]: audit 2024-08-31T08:22:00.606506+0000 mgr.a (mgr.14388) 16033 : audit [DBG] from='client.346737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:01 smithi191 bash[24992]: cluster 2024-08-31T08:22:00.486762+0000 mgr.a (mgr.14388) 16032 : cluster [DBG] pgmap v11114: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:01 smithi191 bash[24992]: audit 2024-08-31T08:22:00.606506+0000 mgr.a (mgr.14388) 16033 : audit [DBG] from='client.346737 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:03 smithi163 bash[24253]: cluster 2024-08-31T08:22:02.487609+0000 mgr.a (mgr.14388) 16034 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:03 smithi027 bash[22610]: cluster 2024-08-31T08:22:02.487609+0000 mgr.a (mgr.14388) 16034 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:03 smithi191 bash[24992]: cluster 2024-08-31T08:22:02.487609+0000 mgr.a (mgr.14388) 16034 : cluster [DBG] pgmap v11115: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:05 smithi163 bash[24253]: cluster 2024-08-31T08:22:04.489801+0000 mgr.a (mgr.14388) 16035 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:05 smithi027 bash[22610]: cluster 2024-08-31T08:22:04.489801+0000 mgr.a (mgr.14388) 16035 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:05 smithi191 bash[24992]: cluster 2024-08-31T08:22:04.489801+0000 mgr.a (mgr.14388) 16035 : cluster [DBG] pgmap v11116: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:22:06.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:06.826 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:06.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:06.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:06.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:06.827 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:22:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:07 smithi163 bash[24253]: audit 2024-08-31T08:22:06.378669+0000 mgr.a (mgr.14388) 16036 : audit [DBG] from='client.346815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:07 smithi163 bash[24253]: cluster 2024-08-31T08:22:06.490307+0000 mgr.a (mgr.14388) 16037 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:07 smithi027 bash[22610]: audit 2024-08-31T08:22:06.378669+0000 mgr.a (mgr.14388) 16036 : audit [DBG] from='client.346815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:07.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:07 smithi027 bash[22610]: cluster 2024-08-31T08:22:06.490307+0000 mgr.a (mgr.14388) 16037 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:07 smithi191 bash[24992]: audit 2024-08-31T08:22:06.378669+0000 mgr.a (mgr.14388) 16036 : audit [DBG] from='client.346815 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:07 smithi191 bash[24992]: cluster 2024-08-31T08:22:06.490307+0000 mgr.a (mgr.14388) 16037 : cluster [DBG] pgmap v11117: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:09 smithi163 bash[24253]: cluster 2024-08-31T08:22:08.492523+0000 mgr.a (mgr.14388) 16038 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:22:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:09 smithi027 bash[22610]: cluster 2024-08-31T08:22:08.492523+0000 mgr.a (mgr.14388) 16038 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:22:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:09 smithi191 bash[24992]: cluster 2024-08-31T08:22:08.492523+0000 mgr.a (mgr.14388) 16038 : cluster [DBG] pgmap v11118: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:22:11.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:11.828 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:11.828 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:11 smithi163 bash[24253]: cluster 2024-08-31T08:22:10.493290+0000 mgr.a (mgr.14388) 16039 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:11 smithi027 bash[22610]: cluster 2024-08-31T08:22:10.493290+0000 mgr.a (mgr.14388) 16039 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:11 smithi191 bash[24992]: cluster 2024-08-31T08:22:10.493290+0000 mgr.a (mgr.14388) 16039 : cluster [DBG] pgmap v11119: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:12.604 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:12.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:12.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:12.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:12.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:22:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:13 smithi163 bash[24253]: audit 2024-08-31T08:22:12.161710+0000 mgr.a (mgr.14388) 16040 : audit [DBG] from='client.346890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:13 smithi163 bash[24253]: cluster 2024-08-31T08:22:12.503069+0000 mgr.a (mgr.14388) 16041 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:13 smithi027 bash[22610]: audit 2024-08-31T08:22:12.161710+0000 mgr.a (mgr.14388) 16040 : audit [DBG] from='client.346890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:13.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:13 smithi027 bash[22610]: cluster 2024-08-31T08:22:12.503069+0000 mgr.a (mgr.14388) 16041 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:13 smithi191 bash[24992]: audit 2024-08-31T08:22:12.161710+0000 mgr.a (mgr.14388) 16040 : audit [DBG] from='client.346890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:13 smithi191 bash[24992]: cluster 2024-08-31T08:22:12.503069+0000 mgr.a (mgr.14388) 16041 : cluster [DBG] pgmap v11120: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:15 smithi163 bash[24253]: cluster 2024-08-31T08:22:14.505482+0000 mgr.a (mgr.14388) 16042 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:22:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:15 smithi027 bash[22610]: cluster 2024-08-31T08:22:14.505482+0000 mgr.a (mgr.14388) 16042 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:22:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:15 smithi191 bash[24992]: cluster 2024-08-31T08:22:14.505482+0000 mgr.a (mgr.14388) 16042 : cluster [DBG] pgmap v11121: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:22:17.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:17.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:17 smithi163 bash[24253]: cluster 2024-08-31T08:22:16.506245+0000 mgr.a (mgr.14388) 16043 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:17 smithi027 bash[22610]: cluster 2024-08-31T08:22:16.506245+0000 mgr.a (mgr.14388) 16043 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:17 smithi191 bash[24992]: cluster 2024-08-31T08:22:16.506245+0000 mgr.a (mgr.14388) 16043 : cluster [DBG] pgmap v11122: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:18.356 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:18.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:18.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:18.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:18.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:22:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:19 smithi163 bash[24253]: audit 2024-08-31T08:22:17.939437+0000 mgr.a (mgr.14388) 16044 : audit [DBG] from='client.346965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:19 smithi163 bash[24253]: cluster 2024-08-31T08:22:18.507729+0000 mgr.a (mgr.14388) 16045 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:19 smithi027 bash[22610]: audit 2024-08-31T08:22:17.939437+0000 mgr.a (mgr.14388) 16044 : audit [DBG] from='client.346965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:19 smithi027 bash[22610]: cluster 2024-08-31T08:22:18.507729+0000 mgr.a (mgr.14388) 16045 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:19 smithi191 bash[24992]: audit 2024-08-31T08:22:17.939437+0000 mgr.a (mgr.14388) 16044 : audit [DBG] from='client.346965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:19 smithi191 bash[24992]: cluster 2024-08-31T08:22:18.507729+0000 mgr.a (mgr.14388) 16045 : cluster [DBG] pgmap v11123: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:21 smithi163 bash[24253]: cluster 2024-08-31T08:22:20.508484+0000 mgr.a (mgr.14388) 16046 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:22:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:21 smithi027 bash[22610]: cluster 2024-08-31T08:22:20.508484+0000 mgr.a (mgr.14388) 16046 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:22:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:21 smithi191 bash[24992]: cluster 2024-08-31T08:22:20.508484+0000 mgr.a (mgr.14388) 16046 : cluster [DBG] pgmap v11124: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:22:23.358 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:23.359 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:23.359 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:23 smithi027 bash[22610]: cluster 2024-08-31T08:22:22.509274+0000 mgr.a (mgr.14388) 16047 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:22:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:23 smithi191 bash[24992]: cluster 2024-08-31T08:22:22.509274+0000 mgr.a (mgr.14388) 16047 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:22:24.148 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:24.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:22:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:23 smithi163 bash[24253]: cluster 2024-08-31T08:22:22.509274+0000 mgr.a (mgr.14388) 16047 : cluster [DBG] pgmap v11125: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:22:24.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:24 smithi027 bash[22610]: audit 2024-08-31T08:22:23.697324+0000 mgr.a (mgr.14388) 16048 : audit [DBG] from='client.347043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:24 smithi191 bash[24992]: audit 2024-08-31T08:22:23.697324+0000 mgr.a (mgr.14388) 16048 : audit [DBG] from='client.347043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:24 smithi163 bash[24253]: audit 2024-08-31T08:22:23.697324+0000 mgr.a (mgr.14388) 16048 : audit [DBG] from='client.347043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:25 smithi027 bash[22610]: cluster 2024-08-31T08:22:24.512275+0000 mgr.a (mgr.14388) 16049 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:25 smithi191 bash[24992]: cluster 2024-08-31T08:22:24.512275+0000 mgr.a (mgr.14388) 16049 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:25 smithi163 bash[24253]: cluster 2024-08-31T08:22:24.512275+0000 mgr.a (mgr.14388) 16049 : cluster [DBG] pgmap v11126: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:27 smithi027 bash[22610]: cluster 2024-08-31T08:22:26.513290+0000 mgr.a (mgr.14388) 16050 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:22:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:27 smithi191 bash[24992]: cluster 2024-08-31T08:22:26.513290+0000 mgr.a (mgr.14388) 16050 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:22:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:27 smithi163 bash[24253]: cluster 2024-08-31T08:22:26.513290+0000 mgr.a (mgr.14388) 16050 : cluster [DBG] pgmap v11127: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:22:29.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:29.151 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:29.151 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:29.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:29.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:29.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:29.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:22:29.902 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:29 smithi027 bash[22610]: cluster 2024-08-31T08:22:28.515417+0000 mgr.a (mgr.14388) 16051 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:29 smithi191 bash[24992]: cluster 2024-08-31T08:22:28.515417+0000 mgr.a (mgr.14388) 16051 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:29 smithi163 bash[24253]: cluster 2024-08-31T08:22:28.515417+0000 mgr.a (mgr.14388) 16051 : cluster [DBG] pgmap v11128: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:30 smithi027 bash[22610]: audit 2024-08-31T08:22:29.480071+0000 mgr.a (mgr.14388) 16052 : audit [DBG] from='client.347118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:30 smithi191 bash[24992]: audit 2024-08-31T08:22:29.480071+0000 mgr.a (mgr.14388) 16052 : audit [DBG] from='client.347118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:30 smithi163 bash[24253]: audit 2024-08-31T08:22:29.480071+0000 mgr.a (mgr.14388) 16052 : audit [DBG] from='client.347118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:31 smithi027 bash[22610]: cluster 2024-08-31T08:22:30.516399+0000 mgr.a (mgr.14388) 16053 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:31 smithi191 bash[24992]: cluster 2024-08-31T08:22:30.516399+0000 mgr.a (mgr.14388) 16053 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:31 smithi163 bash[24253]: cluster 2024-08-31T08:22:30.516399+0000 mgr.a (mgr.14388) 16053 : cluster [DBG] pgmap v11129: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:33 smithi191 bash[24992]: cluster 2024-08-31T08:22:32.517180+0000 mgr.a (mgr.14388) 16054 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:33 smithi163 bash[24253]: cluster 2024-08-31T08:22:32.517180+0000 mgr.a (mgr.14388) 16054 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:34.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:33 smithi027 bash[22610]: cluster 2024-08-31T08:22:32.517180+0000 mgr.a (mgr.14388) 16054 : cluster [DBG] pgmap v11130: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:34.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:34.904 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:34.904 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:35.711 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:35.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:35.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:35.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:35.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:22:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:35 smithi191 bash[24992]: cluster 2024-08-31T08:22:34.519416+0000 mgr.a (mgr.14388) 16055 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:22:36.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:35 smithi163 bash[24253]: cluster 2024-08-31T08:22:34.519416+0000 mgr.a (mgr.14388) 16055 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:22:36.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:35 smithi027 bash[22610]: cluster 2024-08-31T08:22:34.519416+0000 mgr.a (mgr.14388) 16055 : cluster [DBG] pgmap v11131: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:22:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:36 smithi191 bash[24992]: audit 2024-08-31T08:22:35.261752+0000 mgr.a (mgr.14388) 16056 : audit [DBG] from='client.347196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:36 smithi163 bash[24253]: audit 2024-08-31T08:22:35.261752+0000 mgr.a (mgr.14388) 16056 : audit [DBG] from='client.347196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:36 smithi027 bash[22610]: audit 2024-08-31T08:22:35.261752+0000 mgr.a (mgr.14388) 16056 : audit [DBG] from='client.347196 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:37 smithi191 bash[24992]: cluster 2024-08-31T08:22:36.520393+0000 mgr.a (mgr.14388) 16057 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:37 smithi163 bash[24253]: cluster 2024-08-31T08:22:36.520393+0000 mgr.a (mgr.14388) 16057 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:37 smithi027 bash[22610]: cluster 2024-08-31T08:22:36.520393+0000 mgr.a (mgr.14388) 16057 : cluster [DBG] pgmap v11132: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:22:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:39 smithi191 bash[24992]: cluster 2024-08-31T08:22:38.522683+0000 mgr.a (mgr.14388) 16058 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:22:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:39 smithi163 bash[24253]: cluster 2024-08-31T08:22:38.522683+0000 mgr.a (mgr.14388) 16058 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:22:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:39 smithi027 bash[22610]: cluster 2024-08-31T08:22:38.522683+0000 mgr.a (mgr.14388) 16058 : cluster [DBG] pgmap v11133: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:22:40.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:40.713 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:40.713 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:41.466 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:41.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:41.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:41.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:41.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:22:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:41 smithi191 bash[24992]: cluster 2024-08-31T08:22:40.523501+0000 mgr.a (mgr.14388) 16059 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:41 smithi163 bash[24253]: cluster 2024-08-31T08:22:40.523501+0000 mgr.a (mgr.14388) 16059 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:41 smithi027 bash[22610]: cluster 2024-08-31T08:22:40.523501+0000 mgr.a (mgr.14388) 16059 : cluster [DBG] pgmap v11134: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:42 smithi191 bash[24992]: audit 2024-08-31T08:22:41.045110+0000 mgr.a (mgr.14388) 16060 : audit [DBG] from='client.347271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:42 smithi163 bash[24253]: audit 2024-08-31T08:22:41.045110+0000 mgr.a (mgr.14388) 16060 : audit [DBG] from='client.347271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:42 smithi027 bash[22610]: audit 2024-08-31T08:22:41.045110+0000 mgr.a (mgr.14388) 16060 : audit [DBG] from='client.347271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:43 smithi191 bash[24992]: cluster 2024-08-31T08:22:42.524641+0000 mgr.a (mgr.14388) 16061 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:43 smithi163 bash[24253]: cluster 2024-08-31T08:22:42.524641+0000 mgr.a (mgr.14388) 16061 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:43 smithi027 bash[22610]: cluster 2024-08-31T08:22:42.524641+0000 mgr.a (mgr.14388) 16061 : cluster [DBG] pgmap v11135: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:45 smithi191 bash[24992]: cluster 2024-08-31T08:22:44.526927+0000 mgr.a (mgr.14388) 16062 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:22:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:45 smithi163 bash[24253]: cluster 2024-08-31T08:22:44.526927+0000 mgr.a (mgr.14388) 16062 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:22:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:45 smithi027 bash[22610]: cluster 2024-08-31T08:22:44.526927+0000 mgr.a (mgr.14388) 16062 : cluster [DBG] pgmap v11136: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:22:46.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:46.467 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:46.468 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:47.249 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:47.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:47.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:47.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:47.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:22:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:47 smithi191 bash[24992]: cluster 2024-08-31T08:22:46.527873+0000 mgr.a (mgr.14388) 16063 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:47 smithi191 bash[24992]: audit 2024-08-31T08:22:46.805752+0000 mgr.a (mgr.14388) 16064 : audit [DBG] from='client.347343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:47 smithi163 bash[24253]: cluster 2024-08-31T08:22:46.527873+0000 mgr.a (mgr.14388) 16063 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:47 smithi163 bash[24253]: audit 2024-08-31T08:22:46.805752+0000 mgr.a (mgr.14388) 16064 : audit [DBG] from='client.347343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:47 smithi027 bash[22610]: cluster 2024-08-31T08:22:46.527873+0000 mgr.a (mgr.14388) 16063 : cluster [DBG] pgmap v11137: 225 pgs: 225 active+clean; 589 KiB data, 157 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:22:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:47 smithi027 bash[22610]: audit 2024-08-31T08:22:46.805752+0000 mgr.a (mgr.14388) 16064 : audit [DBG] from='client.347343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:49 smithi191 bash[24992]: cluster 2024-08-31T08:22:48.530375+0000 mgr.a (mgr.14388) 16065 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:22:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:49 smithi163 bash[24253]: cluster 2024-08-31T08:22:48.530375+0000 mgr.a (mgr.14388) 16065 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:22:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:49 smithi027 bash[22610]: cluster 2024-08-31T08:22:48.530375+0000 mgr.a (mgr.14388) 16065 : cluster [DBG] pgmap v11138: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:22:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:51 smithi163 bash[24253]: cluster 2024-08-31T08:22:50.531377+0000 mgr.a (mgr.14388) 16066 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:22:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:51 smithi027 bash[22610]: cluster 2024-08-31T08:22:50.531377+0000 mgr.a (mgr.14388) 16066 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:22:52.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:51 smithi191 bash[24992]: cluster 2024-08-31T08:22:50.531377+0000 mgr.a (mgr.14388) 16066 : cluster [DBG] pgmap v11139: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:22:53.034 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:53.034 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:53.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:53.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:22:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:53 smithi163 bash[24253]: cluster 2024-08-31T08:22:52.532310+0000 mgr.a (mgr.14388) 16067 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:22:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:53 smithi163 bash[24253]: audit 2024-08-31T08:22:52.591775+0000 mgr.a (mgr.14388) 16068 : audit [DBG] from='client.347421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:53 smithi163 bash[24253]: audit 2024-08-31T08:22:53.004802+0000 mon.a (mon.0) 2976 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:22:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:53 smithi163 bash[24253]: audit 2024-08-31T08:22:53.780246+0000 mon.a (mon.0) 2977 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:22:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:53 smithi163 bash[24253]: audit 2024-08-31T08:22:53.781649+0000 mon.a (mon.0) 2978 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:22:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:53 smithi027 bash[22610]: cluster 2024-08-31T08:22:52.532310+0000 mgr.a (mgr.14388) 16067 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:22:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:53 smithi027 bash[22610]: audit 2024-08-31T08:22:52.591775+0000 mgr.a (mgr.14388) 16068 : audit [DBG] from='client.347421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:53 smithi027 bash[22610]: audit 2024-08-31T08:22:53.004802+0000 mon.a (mon.0) 2976 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:22:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:53 smithi027 bash[22610]: audit 2024-08-31T08:22:53.780246+0000 mon.a (mon.0) 2977 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:22:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:53 smithi027 bash[22610]: audit 2024-08-31T08:22:53.781649+0000 mon.a (mon.0) 2978 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:22:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:53 smithi191 bash[24992]: cluster 2024-08-31T08:22:52.532310+0000 mgr.a (mgr.14388) 16067 : cluster [DBG] pgmap v11140: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:22:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:53 smithi191 bash[24992]: audit 2024-08-31T08:22:52.591775+0000 mgr.a (mgr.14388) 16068 : audit [DBG] from='client.347421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:22:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:53 smithi191 bash[24992]: audit 2024-08-31T08:22:53.004802+0000 mon.a (mon.0) 2976 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:22:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:53 smithi191 bash[24992]: audit 2024-08-31T08:22:53.780246+0000 mon.a (mon.0) 2977 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:22:54.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:53 smithi191 bash[24992]: audit 2024-08-31T08:22:53.781649+0000 mon.a (mon.0) 2978 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:22:54.805 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:22:54 smithi027 bash[22863]: debug 2024-08-31T08:22:54.545+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:22:54.805 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:22:54 smithi027 bash[22863]: debug 2024-08-31T08:22:54.549+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:22:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:54 smithi163 bash[24253]: audit 2024-08-31T08:22:53.791872+0000 mon.a (mon.0) 2979 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:22:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:54 smithi163 bash[24253]: audit 2024-08-31T08:22:53.800043+0000 mon.a (mon.0) 2980 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:22:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:54 smithi163 bash[24253]: audit 2024-08-31T08:22:53.802394+0000 mgr.a (mgr.14388) 16069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:22:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:54 smithi027 bash[22610]: audit 2024-08-31T08:22:53.791872+0000 mon.a (mon.0) 2979 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:22:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:54 smithi027 bash[22610]: audit 2024-08-31T08:22:53.800043+0000 mon.a (mon.0) 2980 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:22:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:54 smithi027 bash[22610]: audit 2024-08-31T08:22:53.802394+0000 mgr.a (mgr.14388) 16069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:22:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:54 smithi191 bash[24992]: audit 2024-08-31T08:22:53.791872+0000 mon.a (mon.0) 2979 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:22:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:54 smithi191 bash[24992]: audit 2024-08-31T08:22:53.800043+0000 mon.a (mon.0) 2980 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:22:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:54 smithi191 bash[24992]: audit 2024-08-31T08:22:53.802394+0000 mgr.a (mgr.14388) 16069 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:22:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:55 smithi163 bash[24253]: cluster 2024-08-31T08:22:54.535646+0000 mgr.a (mgr.14388) 16070 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:22:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:55 smithi163 bash[24253]: audit 2024-08-31T08:22:54.549237+0000 mgr.a (mgr.14388) 16071 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:22:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:55 smithi163 bash[24253]: cephadm 2024-08-31T08:22:54.550928+0000 mgr.a (mgr.14388) 16072 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:22:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:55 smithi027 bash[22610]: cluster 2024-08-31T08:22:54.535646+0000 mgr.a (mgr.14388) 16070 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:22:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:55 smithi027 bash[22610]: audit 2024-08-31T08:22:54.549237+0000 mgr.a (mgr.14388) 16071 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:22:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:55 smithi027 bash[22610]: cephadm 2024-08-31T08:22:54.550928+0000 mgr.a (mgr.14388) 16072 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:22:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:55 smithi191 bash[24992]: cluster 2024-08-31T08:22:54.535646+0000 mgr.a (mgr.14388) 16070 : cluster [DBG] pgmap v11141: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:22:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:55 smithi191 bash[24992]: audit 2024-08-31T08:22:54.549237+0000 mgr.a (mgr.14388) 16071 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:22:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:55 smithi191 bash[24992]: cephadm 2024-08-31T08:22:54.550928+0000 mgr.a (mgr.14388) 16072 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:22:58.035 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:22:58.036 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:22:58.036 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:22:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:57 smithi163 bash[24253]: cluster 2024-08-31T08:22:56.536482+0000 mgr.a (mgr.14388) 16073 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:22:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:57 smithi027 bash[22610]: cluster 2024-08-31T08:22:56.536482+0000 mgr.a (mgr.14388) 16073 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:22:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:57 smithi191 bash[24992]: cluster 2024-08-31T08:22:56.536482+0000 mgr.a (mgr.14388) 16073 : cluster [DBG] pgmap v11142: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:22:58.812 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:22:58.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:22:58.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:22:58.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:22:58.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:59 smithi163 bash[24253]: audit 2024-08-31T08:22:58.369859+0000 mgr.a (mgr.14388) 16074 : audit [DBG] from='client.347604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:22:59 smithi163 bash[24253]: cluster 2024-08-31T08:22:58.538292+0000 mgr.a (mgr.14388) 16075 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:23:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:59 smithi027 bash[22610]: audit 2024-08-31T08:22:58.369859+0000 mgr.a (mgr.14388) 16074 : audit [DBG] from='client.347604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:22:59 smithi027 bash[22610]: cluster 2024-08-31T08:22:58.538292+0000 mgr.a (mgr.14388) 16075 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:23:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:59 smithi191 bash[24992]: audit 2024-08-31T08:22:58.369859+0000 mgr.a (mgr.14388) 16074 : audit [DBG] from='client.347604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:22:59 smithi191 bash[24992]: cluster 2024-08-31T08:22:58.538292+0000 mgr.a (mgr.14388) 16075 : cluster [DBG] pgmap v11143: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:23:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:01 smithi163 bash[24253]: cluster 2024-08-31T08:23:00.539162+0000 mgr.a (mgr.14388) 16076 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:23:02.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:01 smithi027 bash[22610]: cluster 2024-08-31T08:23:00.539162+0000 mgr.a (mgr.14388) 16076 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:23:02.292 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:01 smithi191 bash[24992]: cluster 2024-08-31T08:23:00.539162+0000 mgr.a (mgr.14388) 16076 : cluster [DBG] pgmap v11144: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:23:03.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:23:03.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:23:03.815 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:23:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:03 smithi163 bash[24253]: cluster 2024-08-31T08:23:02.539946+0000 mgr.a (mgr.14388) 16077 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:23:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:03 smithi027 bash[22610]: cluster 2024-08-31T08:23:02.539946+0000 mgr.a (mgr.14388) 16077 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:23:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:03 smithi191 bash[24992]: cluster 2024-08-31T08:23:02.539946+0000 mgr.a (mgr.14388) 16077 : cluster [DBG] pgmap v11145: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:23:04.569 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:23:04.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:23:04.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:23:04.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:23:04.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:05 smithi163 bash[24253]: audit 2024-08-31T08:23:04.147172+0000 mgr.a (mgr.14388) 16078 : audit [DBG] from='client.347679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:05 smithi163 bash[24253]: cluster 2024-08-31T08:23:04.541228+0000 mgr.a (mgr.14388) 16079 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:23:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:05 smithi027 bash[22610]: audit 2024-08-31T08:23:04.147172+0000 mgr.a (mgr.14388) 16078 : audit [DBG] from='client.347679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:05 smithi027 bash[22610]: cluster 2024-08-31T08:23:04.541228+0000 mgr.a (mgr.14388) 16079 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:23:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:05 smithi191 bash[24992]: audit 2024-08-31T08:23:04.147172+0000 mgr.a (mgr.14388) 16078 : audit [DBG] from='client.347679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:05 smithi191 bash[24992]: cluster 2024-08-31T08:23:04.541228+0000 mgr.a (mgr.14388) 16079 : cluster [DBG] pgmap v11146: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:23:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:07 smithi163 bash[24253]: cluster 2024-08-31T08:23:06.541964+0000 mgr.a (mgr.14388) 16080 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:23:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:07 smithi027 bash[22610]: cluster 2024-08-31T08:23:06.541964+0000 mgr.a (mgr.14388) 16080 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:23:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:07 smithi191 bash[24992]: cluster 2024-08-31T08:23:06.541964+0000 mgr.a (mgr.14388) 16080 : cluster [DBG] pgmap v11147: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:23:09.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:23:09.571 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:23:09.571 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:23:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:09 smithi163 bash[24253]: cluster 2024-08-31T08:23:08.543877+0000 mgr.a (mgr.14388) 16081 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:23:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:09 smithi027 bash[22610]: cluster 2024-08-31T08:23:08.543877+0000 mgr.a (mgr.14388) 16081 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:23:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:09 smithi191 bash[24992]: cluster 2024-08-31T08:23:08.543877+0000 mgr.a (mgr.14388) 16081 : cluster [DBG] pgmap v11148: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:23:10.312 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:23:10.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:23:10.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:23:10.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:23:10.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:10 smithi163 bash[24253]: audit 2024-08-31T08:23:09.903922+0000 mgr.a (mgr.14388) 16082 : audit [DBG] from='client.347757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:10 smithi027 bash[22610]: audit 2024-08-31T08:23:09.903922+0000 mgr.a (mgr.14388) 16082 : audit [DBG] from='client.347757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:10 smithi191 bash[24992]: audit 2024-08-31T08:23:09.903922+0000 mgr.a (mgr.14388) 16082 : audit [DBG] from='client.347757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:11 smithi163 bash[24253]: cluster 2024-08-31T08:23:10.544812+0000 mgr.a (mgr.14388) 16083 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:11 smithi027 bash[22610]: cluster 2024-08-31T08:23:10.544812+0000 mgr.a (mgr.14388) 16083 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:11 smithi191 bash[24992]: cluster 2024-08-31T08:23:10.544812+0000 mgr.a (mgr.14388) 16083 : cluster [DBG] pgmap v11149: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:13 smithi163 bash[24253]: cluster 2024-08-31T08:23:12.545584+0000 mgr.a (mgr.14388) 16084 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:13 smithi027 bash[22610]: cluster 2024-08-31T08:23:12.545584+0000 mgr.a (mgr.14388) 16084 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:13 smithi191 bash[24992]: cluster 2024-08-31T08:23:12.545584+0000 mgr.a (mgr.14388) 16084 : cluster [DBG] pgmap v11150: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:15.313 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:23:15.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:23:15.314 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:23:16.078 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:23:16.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:23:16.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:23:16.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:23:16.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:15 smithi163 bash[24253]: cluster 2024-08-31T08:23:14.547811+0000 mgr.a (mgr.14388) 16085 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:15 smithi027 bash[22610]: cluster 2024-08-31T08:23:14.547811+0000 mgr.a (mgr.14388) 16085 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:15 smithi191 bash[24992]: cluster 2024-08-31T08:23:14.547811+0000 mgr.a (mgr.14388) 16085 : cluster [DBG] pgmap v11151: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:16 smithi163 bash[24253]: audit 2024-08-31T08:23:15.643695+0000 mgr.a (mgr.14388) 16086 : audit [DBG] from='client.347835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:16 smithi027 bash[22610]: audit 2024-08-31T08:23:15.643695+0000 mgr.a (mgr.14388) 16086 : audit [DBG] from='client.347835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:16 smithi191 bash[24992]: audit 2024-08-31T08:23:15.643695+0000 mgr.a (mgr.14388) 16086 : audit [DBG] from='client.347835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:17 smithi163 bash[24253]: cluster 2024-08-31T08:23:16.548754+0000 mgr.a (mgr.14388) 16087 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:17 smithi027 bash[22610]: cluster 2024-08-31T08:23:16.548754+0000 mgr.a (mgr.14388) 16087 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:17 smithi191 bash[24992]: cluster 2024-08-31T08:23:16.548754+0000 mgr.a (mgr.14388) 16087 : cluster [DBG] pgmap v11152: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:19 smithi163 bash[24253]: cluster 2024-08-31T08:23:18.550936+0000 mgr.a (mgr.14388) 16088 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:19 smithi027 bash[22610]: cluster 2024-08-31T08:23:18.550936+0000 mgr.a (mgr.14388) 16088 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:19 smithi191 bash[24992]: cluster 2024-08-31T08:23:18.550936+0000 mgr.a (mgr.14388) 16088 : cluster [DBG] pgmap v11153: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:21.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:23:21.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:23:21.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:23:21.886 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:23:21.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:23:21.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:23:21.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:23:21.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:21 smithi163 bash[24253]: cluster 2024-08-31T08:23:20.551701+0000 mgr.a (mgr.14388) 16089 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:21 smithi027 bash[22610]: cluster 2024-08-31T08:23:20.551701+0000 mgr.a (mgr.14388) 16089 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:21 smithi191 bash[24992]: cluster 2024-08-31T08:23:20.551701+0000 mgr.a (mgr.14388) 16089 : cluster [DBG] pgmap v11154: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:22 smithi163 bash[24253]: audit 2024-08-31T08:23:21.439413+0000 mgr.a (mgr.14388) 16090 : audit [DBG] from='client.347913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:22 smithi027 bash[22610]: audit 2024-08-31T08:23:21.439413+0000 mgr.a (mgr.14388) 16090 : audit [DBG] from='client.347913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:22 smithi191 bash[24992]: audit 2024-08-31T08:23:21.439413+0000 mgr.a (mgr.14388) 16090 : audit [DBG] from='client.347913 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:23 smithi163 bash[24253]: cluster 2024-08-31T08:23:22.552691+0000 mgr.a (mgr.14388) 16091 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:23 smithi027 bash[22610]: cluster 2024-08-31T08:23:22.552691+0000 mgr.a (mgr.14388) 16091 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:23 smithi191 bash[24992]: cluster 2024-08-31T08:23:22.552691+0000 mgr.a (mgr.14388) 16091 : cluster [DBG] pgmap v11155: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:25 smithi163 bash[24253]: cluster 2024-08-31T08:23:24.554920+0000 mgr.a (mgr.14388) 16092 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:25 smithi027 bash[22610]: cluster 2024-08-31T08:23:24.554920+0000 mgr.a (mgr.14388) 16092 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:25 smithi191 bash[24992]: cluster 2024-08-31T08:23:24.554920+0000 mgr.a (mgr.14388) 16092 : cluster [DBG] pgmap v11156: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:26.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:23:26.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:23:26.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:23:27.666 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:23:27.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:23:27.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:23:27.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:23:27.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:27 smithi163 bash[24253]: cluster 2024-08-31T08:23:26.555692+0000 mgr.a (mgr.14388) 16093 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:27 smithi027 bash[22610]: cluster 2024-08-31T08:23:26.555692+0000 mgr.a (mgr.14388) 16093 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:27 smithi191 bash[24992]: cluster 2024-08-31T08:23:26.555692+0000 mgr.a (mgr.14388) 16093 : cluster [DBG] pgmap v11157: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:28 smithi163 bash[24253]: audit 2024-08-31T08:23:27.232196+0000 mgr.a (mgr.14388) 16094 : audit [DBG] from='client.347991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:28 smithi027 bash[22610]: audit 2024-08-31T08:23:27.232196+0000 mgr.a (mgr.14388) 16094 : audit [DBG] from='client.347991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:28 smithi191 bash[24992]: audit 2024-08-31T08:23:27.232196+0000 mgr.a (mgr.14388) 16094 : audit [DBG] from='client.347991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:29 smithi163 bash[24253]: cluster 2024-08-31T08:23:28.557991+0000 mgr.a (mgr.14388) 16095 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:29 smithi027 bash[22610]: cluster 2024-08-31T08:23:28.557991+0000 mgr.a (mgr.14388) 16095 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:29 smithi191 bash[24992]: cluster 2024-08-31T08:23:28.557991+0000 mgr.a (mgr.14388) 16095 : cluster [DBG] pgmap v11158: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:31 smithi163 bash[24253]: cluster 2024-08-31T08:23:30.558766+0000 mgr.a (mgr.14388) 16096 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:31 smithi027 bash[22610]: cluster 2024-08-31T08:23:30.558766+0000 mgr.a (mgr.14388) 16096 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:31 smithi191 bash[24992]: cluster 2024-08-31T08:23:30.558766+0000 mgr.a (mgr.14388) 16096 : cluster [DBG] pgmap v11159: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:32.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:23:32.668 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:23:32.668 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:23:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:32 smithi027 bash[22610]: cluster 2024-08-31T08:23:32.559552+0000 mgr.a (mgr.14388) 16097 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:32 smithi191 bash[24992]: cluster 2024-08-31T08:23:32.559552+0000 mgr.a (mgr.14388) 16097 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:33.438 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:23:33.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:23:33.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:23:33.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:23:33.439 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:32 smithi163 bash[24253]: cluster 2024-08-31T08:23:32.559552+0000 mgr.a (mgr.14388) 16097 : cluster [DBG] pgmap v11160: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:33 smithi027 bash[22610]: audit 2024-08-31T08:23:33.004445+0000 mgr.a (mgr.14388) 16098 : audit [DBG] from='client.348069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:33 smithi191 bash[24992]: audit 2024-08-31T08:23:33.004445+0000 mgr.a (mgr.14388) 16098 : audit [DBG] from='client.348069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:33 smithi163 bash[24253]: audit 2024-08-31T08:23:33.004445+0000 mgr.a (mgr.14388) 16098 : audit [DBG] from='client.348069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:34 smithi027 bash[22610]: cluster 2024-08-31T08:23:34.562353+0000 mgr.a (mgr.14388) 16099 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:34 smithi191 bash[24992]: cluster 2024-08-31T08:23:34.562353+0000 mgr.a (mgr.14388) 16099 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:34 smithi163 bash[24253]: cluster 2024-08-31T08:23:34.562353+0000 mgr.a (mgr.14388) 16099 : cluster [DBG] pgmap v11161: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:37 smithi163 bash[24253]: cluster 2024-08-31T08:23:36.563167+0000 mgr.a (mgr.14388) 16100 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:23:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:37 smithi027 bash[22610]: cluster 2024-08-31T08:23:36.563167+0000 mgr.a (mgr.14388) 16100 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:23:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:37 smithi191 bash[24992]: cluster 2024-08-31T08:23:36.563167+0000 mgr.a (mgr.14388) 16100 : cluster [DBG] pgmap v11162: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:23:38.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:23:38.441 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:23:38.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:23:39.186 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:23:39.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:23:39.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:23:39.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:23:39.186 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:39 smithi163 bash[24253]: cluster 2024-08-31T08:23:38.564093+0000 mgr.a (mgr.14388) 16101 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:39 smithi163 bash[24253]: audit 2024-08-31T08:23:38.768617+0000 mgr.a (mgr.14388) 16102 : audit [DBG] from='client.348147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:39 smithi027 bash[22610]: cluster 2024-08-31T08:23:38.564093+0000 mgr.a (mgr.14388) 16101 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:39 smithi027 bash[22610]: audit 2024-08-31T08:23:38.768617+0000 mgr.a (mgr.14388) 16102 : audit [DBG] from='client.348147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:39 smithi191 bash[24992]: cluster 2024-08-31T08:23:38.564093+0000 mgr.a (mgr.14388) 16101 : cluster [DBG] pgmap v11163: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:39 smithi191 bash[24992]: audit 2024-08-31T08:23:38.768617+0000 mgr.a (mgr.14388) 16102 : audit [DBG] from='client.348147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:41 smithi163 bash[24253]: cluster 2024-08-31T08:23:40.564937+0000 mgr.a (mgr.14388) 16103 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:23:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:41 smithi027 bash[22610]: cluster 2024-08-31T08:23:40.564937+0000 mgr.a (mgr.14388) 16103 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:23:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:41 smithi191 bash[24992]: cluster 2024-08-31T08:23:40.564937+0000 mgr.a (mgr.14388) 16103 : cluster [DBG] pgmap v11164: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:23:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:43 smithi163 bash[24253]: cluster 2024-08-31T08:23:42.565721+0000 mgr.a (mgr.14388) 16104 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:23:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:43 smithi027 bash[22610]: cluster 2024-08-31T08:23:42.565721+0000 mgr.a (mgr.14388) 16104 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:23:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:43 smithi191 bash[24992]: cluster 2024-08-31T08:23:42.565721+0000 mgr.a (mgr.14388) 16104 : cluster [DBG] pgmap v11165: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:23:44.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:23:44.188 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:23:44.188 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:23:44.971 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:23:44.971 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:23:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:23:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:23:44.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:45 smithi163 bash[24253]: audit 2024-08-31T08:23:44.527641+0000 mgr.a (mgr.14388) 16105 : audit [DBG] from='client.348225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:45.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:45 smithi163 bash[24253]: cluster 2024-08-31T08:23:44.568763+0000 mgr.a (mgr.14388) 16106 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:45 smithi027 bash[22610]: audit 2024-08-31T08:23:44.527641+0000 mgr.a (mgr.14388) 16105 : audit [DBG] from='client.348225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:45.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:45 smithi027 bash[22610]: cluster 2024-08-31T08:23:44.568763+0000 mgr.a (mgr.14388) 16106 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:45 smithi191 bash[24992]: audit 2024-08-31T08:23:44.527641+0000 mgr.a (mgr.14388) 16105 : audit [DBG] from='client.348225 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:45 smithi191 bash[24992]: cluster 2024-08-31T08:23:44.568763+0000 mgr.a (mgr.14388) 16106 : cluster [DBG] pgmap v11166: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:47.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:47 smithi163 bash[24253]: cluster 2024-08-31T08:23:46.569678+0000 mgr.a (mgr.14388) 16107 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:47 smithi027 bash[22610]: cluster 2024-08-31T08:23:46.569678+0000 mgr.a (mgr.14388) 16107 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:47 smithi191 bash[24992]: cluster 2024-08-31T08:23:46.569678+0000 mgr.a (mgr.14388) 16107 : cluster [DBG] pgmap v11167: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:49.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:49 smithi163 bash[24253]: cluster 2024-08-31T08:23:48.571858+0000 mgr.a (mgr.14388) 16108 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:49.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:23:49.973 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:23:49.974 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:23:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:49 smithi027 bash[22610]: cluster 2024-08-31T08:23:48.571858+0000 mgr.a (mgr.14388) 16108 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:49 smithi191 bash[24992]: cluster 2024-08-31T08:23:48.571858+0000 mgr.a (mgr.14388) 16108 : cluster [DBG] pgmap v11168: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:50.729 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:23:50.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:23:50.729 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:23:50.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:23:50.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:51 smithi163 bash[24253]: audit 2024-08-31T08:23:50.301799+0000 mgr.a (mgr.14388) 16109 : audit [DBG] from='client.348297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:51.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:51 smithi163 bash[24253]: cluster 2024-08-31T08:23:50.572383+0000 mgr.a (mgr.14388) 16110 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:51 smithi027 bash[22610]: audit 2024-08-31T08:23:50.301799+0000 mgr.a (mgr.14388) 16109 : audit [DBG] from='client.348297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:51.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:51 smithi027 bash[22610]: cluster 2024-08-31T08:23:50.572383+0000 mgr.a (mgr.14388) 16110 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:51 smithi191 bash[24992]: audit 2024-08-31T08:23:50.301799+0000 mgr.a (mgr.14388) 16109 : audit [DBG] from='client.348297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:51 smithi191 bash[24992]: cluster 2024-08-31T08:23:50.572383+0000 mgr.a (mgr.14388) 16110 : cluster [DBG] pgmap v11169: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:53.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:53 smithi163 bash[24253]: cluster 2024-08-31T08:23:52.573266+0000 mgr.a (mgr.14388) 16111 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:53 smithi027 bash[22610]: cluster 2024-08-31T08:23:52.573266+0000 mgr.a (mgr.14388) 16111 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:53 smithi191 bash[24992]: cluster 2024-08-31T08:23:52.573266+0000 mgr.a (mgr.14388) 16111 : cluster [DBG] pgmap v11170: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:54 smithi163 bash[24253]: audit 2024-08-31T08:23:54.604183+0000 mon.a (mon.0) 2981 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:23:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:54 smithi027 bash[22610]: audit 2024-08-31T08:23:54.604183+0000 mon.a (mon.0) 2981 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:23:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:54 smithi191 bash[24992]: audit 2024-08-31T08:23:54.604183+0000 mon.a (mon.0) 2981 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:23:55.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:23:55.731 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:23:55.731 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:23:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:55 smithi163 bash[24253]: cluster 2024-08-31T08:23:54.575511+0000 mgr.a (mgr.14388) 16112 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:55 smithi163 bash[24253]: audit 2024-08-31T08:23:55.226536+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:23:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:55 smithi163 bash[24253]: audit 2024-08-31T08:23:55.230092+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:23:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:55 smithi027 bash[22610]: cluster 2024-08-31T08:23:54.575511+0000 mgr.a (mgr.14388) 16112 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:55 smithi027 bash[22610]: audit 2024-08-31T08:23:55.226536+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:23:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:55 smithi027 bash[22610]: audit 2024-08-31T08:23:55.230092+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:23:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:55 smithi191 bash[24992]: cluster 2024-08-31T08:23:54.575511+0000 mgr.a (mgr.14388) 16112 : cluster [DBG] pgmap v11171: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:23:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:55 smithi191 bash[24992]: audit 2024-08-31T08:23:55.226536+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:23:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:55 smithi191 bash[24992]: audit 2024-08-31T08:23:55.230092+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:23:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:56 smithi163 bash[24253]: audit 2024-08-31T08:23:55.871998+0000 mon.a (mon.0) 2984 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:23:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:56 smithi163 bash[24253]: audit 2024-08-31T08:23:55.872848+0000 mon.a (mon.0) 2985 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:23:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:56 smithi163 bash[24253]: audit 2024-08-31T08:23:55.878030+0000 mon.a (mon.0) 2986 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:23:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:56 smithi163 bash[24253]: audit 2024-08-31T08:23:55.879994+0000 mon.a (mon.0) 2987 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:23:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:56 smithi163 bash[24253]: audit 2024-08-31T08:23:55.881929+0000 mgr.a (mgr.14388) 16113 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:23:56.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:23:56 smithi027 bash[22863]: debug 2024-08-31T08:23:56.607+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:23:56.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:23:56 smithi027 bash[22863]: debug 2024-08-31T08:23:56.619+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:23:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:56 smithi027 bash[22610]: audit 2024-08-31T08:23:55.871998+0000 mon.a (mon.0) 2984 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:23:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:56 smithi027 bash[22610]: audit 2024-08-31T08:23:55.872848+0000 mon.a (mon.0) 2985 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:23:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:56 smithi027 bash[22610]: audit 2024-08-31T08:23:55.878030+0000 mon.a (mon.0) 2986 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:23:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:56 smithi027 bash[22610]: audit 2024-08-31T08:23:55.879994+0000 mon.a (mon.0) 2987 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:23:56.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:56 smithi027 bash[22610]: audit 2024-08-31T08:23:55.881929+0000 mgr.a (mgr.14388) 16113 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:23:57.023 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:23:57.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:23:57.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:23:57.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:23:57.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:23:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:56 smithi191 bash[24992]: audit 2024-08-31T08:23:55.871998+0000 mon.a (mon.0) 2984 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:23:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:56 smithi191 bash[24992]: audit 2024-08-31T08:23:55.872848+0000 mon.a (mon.0) 2985 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:23:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:56 smithi191 bash[24992]: audit 2024-08-31T08:23:55.878030+0000 mon.a (mon.0) 2986 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:23:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:56 smithi191 bash[24992]: audit 2024-08-31T08:23:55.879994+0000 mon.a (mon.0) 2987 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:23:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:56 smithi191 bash[24992]: audit 2024-08-31T08:23:55.881929+0000 mgr.a (mgr.14388) 16113 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:23:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:57 smithi163 bash[24253]: audit 2024-08-31T08:23:56.069617+0000 mgr.a (mgr.14388) 16114 : audit [DBG] from='client.348375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:57 smithi163 bash[24253]: cluster 2024-08-31T08:23:56.576121+0000 mgr.a (mgr.14388) 16115 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:57 smithi163 bash[24253]: audit 2024-08-31T08:23:56.613905+0000 mgr.a (mgr.14388) 16116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:23:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:57 smithi163 bash[24253]: cephadm 2024-08-31T08:23:56.626488+0000 mgr.a (mgr.14388) 16117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:23:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:57 smithi027 bash[22610]: audit 2024-08-31T08:23:56.069617+0000 mgr.a (mgr.14388) 16114 : audit [DBG] from='client.348375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:57 smithi027 bash[22610]: cluster 2024-08-31T08:23:56.576121+0000 mgr.a (mgr.14388) 16115 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:57 smithi027 bash[22610]: audit 2024-08-31T08:23:56.613905+0000 mgr.a (mgr.14388) 16116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:23:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:57 smithi027 bash[22610]: cephadm 2024-08-31T08:23:56.626488+0000 mgr.a (mgr.14388) 16117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:23:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:57 smithi191 bash[24992]: audit 2024-08-31T08:23:56.069617+0000 mgr.a (mgr.14388) 16114 : audit [DBG] from='client.348375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:23:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:57 smithi191 bash[24992]: cluster 2024-08-31T08:23:56.576121+0000 mgr.a (mgr.14388) 16115 : cluster [DBG] pgmap v11172: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:23:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:57 smithi191 bash[24992]: audit 2024-08-31T08:23:56.613905+0000 mgr.a (mgr.14388) 16116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:23:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:57 smithi191 bash[24992]: cephadm 2024-08-31T08:23:56.626488+0000 mgr.a (mgr.14388) 16117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:24:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:23:59 smithi163 bash[24253]: cluster 2024-08-31T08:23:58.578296+0000 mgr.a (mgr.14388) 16118 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:23:59 smithi027 bash[22610]: cluster 2024-08-31T08:23:58.578296+0000 mgr.a (mgr.14388) 16118 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:23:59 smithi191 bash[24992]: cluster 2024-08-31T08:23:58.578296+0000 mgr.a (mgr.14388) 16118 : cluster [DBG] pgmap v11173: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:02.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:02.026 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:02.026 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:24:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:01 smithi163 bash[24253]: cluster 2024-08-31T08:24:00.579096+0000 mgr.a (mgr.14388) 16119 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:01 smithi027 bash[22610]: cluster 2024-08-31T08:24:00.579096+0000 mgr.a (mgr.14388) 16119 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:01 smithi191 bash[24992]: cluster 2024-08-31T08:24:00.579096+0000 mgr.a (mgr.14388) 16119 : cluster [DBG] pgmap v11174: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:02.774 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:24:02.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:24:02.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:24:02.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:24:02.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:24:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:03 smithi163 bash[24253]: audit 2024-08-31T08:24:02.354320+0000 mgr.a (mgr.14388) 16120 : audit [DBG] from='client.348552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:03 smithi163 bash[24253]: cluster 2024-08-31T08:24:02.583028+0000 mgr.a (mgr.14388) 16121 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:04.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:03 smithi027 bash[22610]: audit 2024-08-31T08:24:02.354320+0000 mgr.a (mgr.14388) 16120 : audit [DBG] from='client.348552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:04.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:03 smithi027 bash[22610]: cluster 2024-08-31T08:24:02.583028+0000 mgr.a (mgr.14388) 16121 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:03 smithi191 bash[24992]: audit 2024-08-31T08:24:02.354320+0000 mgr.a (mgr.14388) 16120 : audit [DBG] from='client.348552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:03 smithi191 bash[24992]: cluster 2024-08-31T08:24:02.583028+0000 mgr.a (mgr.14388) 16121 : cluster [DBG] pgmap v11175: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:05 smithi163 bash[24253]: cluster 2024-08-31T08:24:04.585351+0000 mgr.a (mgr.14388) 16122 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:05 smithi027 bash[22610]: cluster 2024-08-31T08:24:04.585351+0000 mgr.a (mgr.14388) 16122 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:05 smithi191 bash[24992]: cluster 2024-08-31T08:24:04.585351+0000 mgr.a (mgr.14388) 16122 : cluster [DBG] pgmap v11176: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:07.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:07.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:07.776 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:24:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:07 smithi163 bash[24253]: cluster 2024-08-31T08:24:06.586112+0000 mgr.a (mgr.14388) 16123 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:07 smithi027 bash[22610]: cluster 2024-08-31T08:24:06.586112+0000 mgr.a (mgr.14388) 16123 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:07 smithi191 bash[24992]: cluster 2024-08-31T08:24:06.586112+0000 mgr.a (mgr.14388) 16123 : cluster [DBG] pgmap v11177: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:08.527 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:24:08.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:24:08.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:24:08.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:24:08.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:24:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:09 smithi163 bash[24253]: audit 2024-08-31T08:24:08.110515+0000 mgr.a (mgr.14388) 16124 : audit [DBG] from='client.348630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:09 smithi163 bash[24253]: cluster 2024-08-31T08:24:08.589086+0000 mgr.a (mgr.14388) 16125 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:09 smithi027 bash[22610]: audit 2024-08-31T08:24:08.110515+0000 mgr.a (mgr.14388) 16124 : audit [DBG] from='client.348630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:09 smithi027 bash[22610]: cluster 2024-08-31T08:24:08.589086+0000 mgr.a (mgr.14388) 16125 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:09 smithi191 bash[24992]: audit 2024-08-31T08:24:08.110515+0000 mgr.a (mgr.14388) 16124 : audit [DBG] from='client.348630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:09 smithi191 bash[24992]: cluster 2024-08-31T08:24:08.589086+0000 mgr.a (mgr.14388) 16125 : cluster [DBG] pgmap v11178: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:24:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:11 smithi163 bash[24253]: cluster 2024-08-31T08:24:10.589921+0000 mgr.a (mgr.14388) 16126 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:11 smithi027 bash[22610]: cluster 2024-08-31T08:24:10.589921+0000 mgr.a (mgr.14388) 16126 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:11 smithi191 bash[24992]: cluster 2024-08-31T08:24:10.589921+0000 mgr.a (mgr.14388) 16126 : cluster [DBG] pgmap v11179: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:13.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:13.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:13.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:24:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:13 smithi163 bash[24253]: cluster 2024-08-31T08:24:12.590691+0000 mgr.a (mgr.14388) 16127 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:13 smithi027 bash[22610]: cluster 2024-08-31T08:24:12.590691+0000 mgr.a (mgr.14388) 16127 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:14.287 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:24:14.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:24:14.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:24:14.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:24:14.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:24:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:13 smithi191 bash[24992]: cluster 2024-08-31T08:24:12.590691+0000 mgr.a (mgr.14388) 16127 : cluster [DBG] pgmap v11180: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:14 smithi163 bash[24253]: audit 2024-08-31T08:24:13.860321+0000 mgr.a (mgr.14388) 16128 : audit [DBG] from='client.348708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:14 smithi027 bash[22610]: audit 2024-08-31T08:24:13.860321+0000 mgr.a (mgr.14388) 16128 : audit [DBG] from='client.348708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:14 smithi191 bash[24992]: audit 2024-08-31T08:24:13.860321+0000 mgr.a (mgr.14388) 16128 : audit [DBG] from='client.348708 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:15 smithi163 bash[24253]: cluster 2024-08-31T08:24:14.593511+0000 mgr.a (mgr.14388) 16129 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:15 smithi027 bash[22610]: cluster 2024-08-31T08:24:14.593511+0000 mgr.a (mgr.14388) 16129 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:15 smithi191 bash[24992]: cluster 2024-08-31T08:24:14.593511+0000 mgr.a (mgr.14388) 16129 : cluster [DBG] pgmap v11181: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:17 smithi163 bash[24253]: cluster 2024-08-31T08:24:16.594309+0000 mgr.a (mgr.14388) 16130 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:17 smithi027 bash[22610]: cluster 2024-08-31T08:24:16.594309+0000 mgr.a (mgr.14388) 16130 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:17 smithi191 bash[24992]: cluster 2024-08-31T08:24:16.594309+0000 mgr.a (mgr.14388) 16130 : cluster [DBG] pgmap v11182: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:18 smithi191 bash[24992]: cluster 2024-08-31T08:24:18.596259+0000 mgr.a (mgr.14388) 16131 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:19.289 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:19.290 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:19.290 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:24:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:18 smithi163 bash[24253]: cluster 2024-08-31T08:24:18.596259+0000 mgr.a (mgr.14388) 16131 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:18 smithi027 bash[22610]: cluster 2024-08-31T08:24:18.596259+0000 mgr.a (mgr.14388) 16131 : cluster [DBG] pgmap v11183: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:20.070 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:24:20.071 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:24:20.071 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:24:20.071 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:24:20.071 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:24:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:19 smithi191 bash[24992]: audit 2024-08-31T08:24:19.626131+0000 mgr.a (mgr.14388) 16132 : audit [DBG] from='client.348786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:19 smithi163 bash[24253]: audit 2024-08-31T08:24:19.626131+0000 mgr.a (mgr.14388) 16132 : audit [DBG] from='client.348786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:19 smithi027 bash[22610]: audit 2024-08-31T08:24:19.626131+0000 mgr.a (mgr.14388) 16132 : audit [DBG] from='client.348786 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:20 smithi191 bash[24992]: cluster 2024-08-31T08:24:20.597232+0000 mgr.a (mgr.14388) 16133 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:20 smithi163 bash[24253]: cluster 2024-08-31T08:24:20.597232+0000 mgr.a (mgr.14388) 16133 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:20 smithi027 bash[22610]: cluster 2024-08-31T08:24:20.597232+0000 mgr.a (mgr.14388) 16133 : cluster [DBG] pgmap v11184: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:23 smithi163 bash[24253]: cluster 2024-08-31T08:24:22.598030+0000 mgr.a (mgr.14388) 16134 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:23 smithi027 bash[22610]: cluster 2024-08-31T08:24:22.598030+0000 mgr.a (mgr.14388) 16134 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:23 smithi191 bash[24992]: cluster 2024-08-31T08:24:22.598030+0000 mgr.a (mgr.14388) 16134 : cluster [DBG] pgmap v11185: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:25.073 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:25.073 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:25.073 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:24:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:24:25.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:24:25.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:24:25.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:24:25.833 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:24:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:25 smithi163 bash[24253]: cluster 2024-08-31T08:24:24.600274+0000 mgr.a (mgr.14388) 16135 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:25 smithi027 bash[22610]: cluster 2024-08-31T08:24:24.600274+0000 mgr.a (mgr.14388) 16135 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:25 smithi191 bash[24992]: cluster 2024-08-31T08:24:24.600274+0000 mgr.a (mgr.14388) 16135 : cluster [DBG] pgmap v11186: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:26 smithi163 bash[24253]: audit 2024-08-31T08:24:25.407377+0000 mgr.a (mgr.14388) 16136 : audit [DBG] from='client.348864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:26 smithi027 bash[22610]: audit 2024-08-31T08:24:25.407377+0000 mgr.a (mgr.14388) 16136 : audit [DBG] from='client.348864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:26 smithi191 bash[24992]: audit 2024-08-31T08:24:25.407377+0000 mgr.a (mgr.14388) 16136 : audit [DBG] from='client.348864 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:27.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:27 smithi163 bash[24253]: cluster 2024-08-31T08:24:26.601201+0000 mgr.a (mgr.14388) 16137 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:27 smithi027 bash[22610]: cluster 2024-08-31T08:24:26.601201+0000 mgr.a (mgr.14388) 16137 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:27 smithi191 bash[24992]: cluster 2024-08-31T08:24:26.601201+0000 mgr.a (mgr.14388) 16137 : cluster [DBG] pgmap v11187: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:29 smithi163 bash[24253]: cluster 2024-08-31T08:24:28.603336+0000 mgr.a (mgr.14388) 16138 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:29.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:29 smithi027 bash[22610]: cluster 2024-08-31T08:24:28.603336+0000 mgr.a (mgr.14388) 16138 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:29 smithi191 bash[24992]: cluster 2024-08-31T08:24:28.603336+0000 mgr.a (mgr.14388) 16138 : cluster [DBG] pgmap v11188: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:30.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:30.835 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:24:31.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:24:31.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:24:31.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:24:31.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:24:31.583 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:24:31.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:31 smithi163 bash[24253]: cluster 2024-08-31T08:24:30.604080+0000 mgr.a (mgr.14388) 16139 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:31 smithi027 bash[22610]: cluster 2024-08-31T08:24:30.604080+0000 mgr.a (mgr.14388) 16139 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:31 smithi191 bash[24992]: cluster 2024-08-31T08:24:30.604080+0000 mgr.a (mgr.14388) 16139 : cluster [DBG] pgmap v11189: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:32 smithi163 bash[24253]: audit 2024-08-31T08:24:31.163325+0000 mgr.a (mgr.14388) 16140 : audit [DBG] from='client.348942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:32 smithi027 bash[22610]: audit 2024-08-31T08:24:31.163325+0000 mgr.a (mgr.14388) 16140 : audit [DBG] from='client.348942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:32 smithi191 bash[24992]: audit 2024-08-31T08:24:31.163325+0000 mgr.a (mgr.14388) 16140 : audit [DBG] from='client.348942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:33.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:33 smithi163 bash[24253]: cluster 2024-08-31T08:24:32.604982+0000 mgr.a (mgr.14388) 16141 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:33 smithi027 bash[22610]: cluster 2024-08-31T08:24:32.604982+0000 mgr.a (mgr.14388) 16141 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:33 smithi191 bash[24992]: cluster 2024-08-31T08:24:32.604982+0000 mgr.a (mgr.14388) 16141 : cluster [DBG] pgmap v11190: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:35.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:35 smithi163 bash[24253]: cluster 2024-08-31T08:24:34.607220+0000 mgr.a (mgr.14388) 16142 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:35 smithi027 bash[22610]: cluster 2024-08-31T08:24:34.607220+0000 mgr.a (mgr.14388) 16142 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:35 smithi191 bash[24992]: cluster 2024-08-31T08:24:34.607220+0000 mgr.a (mgr.14388) 16142 : cluster [DBG] pgmap v11191: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:36.584 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:36.585 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:36.585 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:24:37.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:24:37.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:24:37.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:24:37.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:24:37.367 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:24:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:37 smithi163 bash[24253]: cluster 2024-08-31T08:24:36.607976+0000 mgr.a (mgr.14388) 16143 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:37.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:37 smithi163 bash[24253]: audit 2024-08-31T08:24:36.923027+0000 mgr.a (mgr.14388) 16144 : audit [DBG] from='client.349020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:37 smithi027 bash[22610]: cluster 2024-08-31T08:24:36.607976+0000 mgr.a (mgr.14388) 16143 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:37.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:37 smithi027 bash[22610]: audit 2024-08-31T08:24:36.923027+0000 mgr.a (mgr.14388) 16144 : audit [DBG] from='client.349020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:37 smithi191 bash[24992]: cluster 2024-08-31T08:24:36.607976+0000 mgr.a (mgr.14388) 16143 : cluster [DBG] pgmap v11192: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:37 smithi191 bash[24992]: audit 2024-08-31T08:24:36.923027+0000 mgr.a (mgr.14388) 16144 : audit [DBG] from='client.349020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:39 smithi027 bash[22610]: cluster 2024-08-31T08:24:38.610208+0000 mgr.a (mgr.14388) 16145 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:39 smithi191 bash[24992]: cluster 2024-08-31T08:24:38.610208+0000 mgr.a (mgr.14388) 16145 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:39 smithi163 bash[24253]: cluster 2024-08-31T08:24:38.610208+0000 mgr.a (mgr.14388) 16145 : cluster [DBG] pgmap v11193: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:24:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:41 smithi027 bash[22610]: cluster 2024-08-31T08:24:40.611034+0000 mgr.a (mgr.14388) 16146 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:41 smithi191 bash[24992]: cluster 2024-08-31T08:24:40.611034+0000 mgr.a (mgr.14388) 16146 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:41 smithi163 bash[24253]: cluster 2024-08-31T08:24:40.611034+0000 mgr.a (mgr.14388) 16146 : cluster [DBG] pgmap v11194: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:42.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:42.373 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:42.374 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:24:43.112 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:24:43.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:24:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:24:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:24:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:24:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:43 smithi027 bash[22610]: cluster 2024-08-31T08:24:42.611908+0000 mgr.a (mgr.14388) 16147 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:43.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:43 smithi027 bash[22610]: audit 2024-08-31T08:24:42.696432+0000 mgr.a (mgr.14388) 16148 : audit [DBG] from='client.349095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:43 smithi191 bash[24992]: cluster 2024-08-31T08:24:42.611908+0000 mgr.a (mgr.14388) 16147 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:43 smithi191 bash[24992]: audit 2024-08-31T08:24:42.696432+0000 mgr.a (mgr.14388) 16148 : audit [DBG] from='client.349095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:43 smithi163 bash[24253]: cluster 2024-08-31T08:24:42.611908+0000 mgr.a (mgr.14388) 16147 : cluster [DBG] pgmap v11195: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:43 smithi163 bash[24253]: audit 2024-08-31T08:24:42.696432+0000 mgr.a (mgr.14388) 16148 : audit [DBG] from='client.349095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:45 smithi027 bash[22610]: cluster 2024-08-31T08:24:44.614645+0000 mgr.a (mgr.14388) 16149 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:24:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:45 smithi191 bash[24992]: cluster 2024-08-31T08:24:44.614645+0000 mgr.a (mgr.14388) 16149 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:24:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:45 smithi163 bash[24253]: cluster 2024-08-31T08:24:44.614645+0000 mgr.a (mgr.14388) 16149 : cluster [DBG] pgmap v11196: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:24:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:47 smithi027 bash[22610]: cluster 2024-08-31T08:24:46.615612+0000 mgr.a (mgr.14388) 16150 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:24:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:47 smithi191 bash[24992]: cluster 2024-08-31T08:24:46.615612+0000 mgr.a (mgr.14388) 16150 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:24:48.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:48.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:48.115 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:24:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:47 smithi163 bash[24253]: cluster 2024-08-31T08:24:46.615612+0000 mgr.a (mgr.14388) 16150 : cluster [DBG] pgmap v11197: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:24:48.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:24:48.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:24:48.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:24:48.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:24:48.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:24:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:49 smithi027 bash[22610]: audit 2024-08-31T08:24:48.443310+0000 mgr.a (mgr.14388) 16151 : audit [DBG] from='client.349173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:49.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:49 smithi027 bash[22610]: cluster 2024-08-31T08:24:48.616917+0000 mgr.a (mgr.14388) 16152 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:49 smithi191 bash[24992]: audit 2024-08-31T08:24:48.443310+0000 mgr.a (mgr.14388) 16151 : audit [DBG] from='client.349173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:49 smithi191 bash[24992]: cluster 2024-08-31T08:24:48.616917+0000 mgr.a (mgr.14388) 16152 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:49 smithi163 bash[24253]: audit 2024-08-31T08:24:48.443310+0000 mgr.a (mgr.14388) 16151 : audit [DBG] from='client.349173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:49 smithi163 bash[24253]: cluster 2024-08-31T08:24:48.616917+0000 mgr.a (mgr.14388) 16152 : cluster [DBG] pgmap v11198: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:51 smithi027 bash[22610]: cluster 2024-08-31T08:24:50.617764+0000 mgr.a (mgr.14388) 16153 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:51 smithi191 bash[24992]: cluster 2024-08-31T08:24:50.617764+0000 mgr.a (mgr.14388) 16153 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:51 smithi163 bash[24253]: cluster 2024-08-31T08:24:50.617764+0000 mgr.a (mgr.14388) 16153 : cluster [DBG] pgmap v11199: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:24:53.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:53.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:53.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:24:54.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:53 smithi191 bash[24992]: cluster 2024-08-31T08:24:52.618520+0000 mgr.a (mgr.14388) 16154 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:24:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:53 smithi163 bash[24253]: cluster 2024-08-31T08:24:52.618520+0000 mgr.a (mgr.14388) 16154 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:24:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:53 smithi027 bash[22610]: cluster 2024-08-31T08:24:52.618520+0000 mgr.a (mgr.14388) 16154 : cluster [DBG] pgmap v11200: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:24:54.648 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:24:54.648 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:24:54.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:24:54.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:24:54.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:24:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:55 smithi191 bash[24992]: audit 2024-08-31T08:24:54.210745+0000 mgr.a (mgr.14388) 16155 : audit [DBG] from='client.349248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:55 smithi191 bash[24992]: cluster 2024-08-31T08:24:54.619769+0000 mgr.a (mgr.14388) 16156 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:55 smithi163 bash[24253]: audit 2024-08-31T08:24:54.210745+0000 mgr.a (mgr.14388) 16155 : audit [DBG] from='client.349248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:55 smithi163 bash[24253]: cluster 2024-08-31T08:24:54.619769+0000 mgr.a (mgr.14388) 16156 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:55 smithi027 bash[22610]: audit 2024-08-31T08:24:54.210745+0000 mgr.a (mgr.14388) 16155 : audit [DBG] from='client.349248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:24:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:55 smithi027 bash[22610]: cluster 2024-08-31T08:24:54.619769+0000 mgr.a (mgr.14388) 16156 : cluster [DBG] pgmap v11201: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:24:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:56 smithi191 bash[24992]: audit 2024-08-31T08:24:56.681264+0000 mon.a (mon.0) 2988 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:24:57.282 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:56 smithi027 bash[22610]: audit 2024-08-31T08:24:56.681264+0000 mon.a (mon.0) 2988 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:24:57.282 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:56 smithi163 bash[24253]: audit 2024-08-31T08:24:56.681264+0000 mon.a (mon.0) 2988 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:24:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:57 smithi191 bash[24992]: cluster 2024-08-31T08:24:56.620521+0000 mgr.a (mgr.14388) 16157 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:24:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:57 smithi191 bash[24992]: audit 2024-08-31T08:24:57.288850+0000 mon.a (mon.0) 2989 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:57 smithi191 bash[24992]: audit 2024-08-31T08:24:57.294609+0000 mon.a (mon.0) 2990 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:57 smithi191 bash[24992]: audit 2024-08-31T08:24:57.300601+0000 mon.a (mon.0) 2991 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:57 smithi191 bash[24992]: audit 2024-08-31T08:24:57.304265+0000 mon.a (mon.0) 2992 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:57 smithi163 bash[24253]: cluster 2024-08-31T08:24:56.620521+0000 mgr.a (mgr.14388) 16157 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:24:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:57 smithi163 bash[24253]: audit 2024-08-31T08:24:57.288850+0000 mon.a (mon.0) 2989 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:57 smithi163 bash[24253]: audit 2024-08-31T08:24:57.294609+0000 mon.a (mon.0) 2990 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:57 smithi163 bash[24253]: audit 2024-08-31T08:24:57.300601+0000 mon.a (mon.0) 2991 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:57 smithi163 bash[24253]: audit 2024-08-31T08:24:57.304265+0000 mon.a (mon.0) 2992 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:57 smithi027 bash[22610]: cluster 2024-08-31T08:24:56.620521+0000 mgr.a (mgr.14388) 16157 : cluster [DBG] pgmap v11202: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:24:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:57 smithi027 bash[22610]: audit 2024-08-31T08:24:57.288850+0000 mon.a (mon.0) 2989 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:57 smithi027 bash[22610]: audit 2024-08-31T08:24:57.294609+0000 mon.a (mon.0) 2990 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:57 smithi027 bash[22610]: audit 2024-08-31T08:24:57.300601+0000 mon.a (mon.0) 2991 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:57 smithi027 bash[22610]: audit 2024-08-31T08:24:57.304265+0000 mon.a (mon.0) 2992 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:24:58 smithi027 bash[22863]: debug 2024-08-31T08:24:58.725+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:24:58.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:24:58 smithi027 bash[22863]: debug 2024-08-31T08:24:58.725+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:24:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:58 smithi027 bash[22610]: audit 2024-08-31T08:24:57.957954+0000 mon.a (mon.0) 2993 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:24:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:58 smithi027 bash[22610]: audit 2024-08-31T08:24:57.959673+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:24:58.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:58 smithi027 bash[22610]: audit 2024-08-31T08:24:57.969593+0000 mon.a (mon.0) 2995 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:58.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:58 smithi027 bash[22610]: audit 2024-08-31T08:24:57.972281+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:24:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:58 smithi191 bash[24992]: audit 2024-08-31T08:24:57.957954+0000 mon.a (mon.0) 2993 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:24:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:58 smithi191 bash[24992]: audit 2024-08-31T08:24:57.959673+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:24:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:58 smithi191 bash[24992]: audit 2024-08-31T08:24:57.969593+0000 mon.a (mon.0) 2995 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:58 smithi191 bash[24992]: audit 2024-08-31T08:24:57.972281+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:24:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:58 smithi163 bash[24253]: audit 2024-08-31T08:24:57.957954+0000 mon.a (mon.0) 2993 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:24:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:58 smithi163 bash[24253]: audit 2024-08-31T08:24:57.959673+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:24:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:58 smithi163 bash[24253]: audit 2024-08-31T08:24:57.969593+0000 mon.a (mon.0) 2995 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:24:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:58 smithi163 bash[24253]: audit 2024-08-31T08:24:57.972281+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:24:59.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:24:59.650 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:24:59.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:59 smithi191 bash[24992]: audit 2024-08-31T08:24:57.974481+0000 mgr.a (mgr.14388) 16158 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:25:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:59 smithi191 bash[24992]: cluster 2024-08-31T08:24:58.621813+0000 mgr.a (mgr.14388) 16159 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:25:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:59 smithi191 bash[24992]: audit 2024-08-31T08:24:58.727603+0000 mgr.a (mgr.14388) 16160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:25:00.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:24:59 smithi191 bash[24992]: cephadm 2024-08-31T08:24:58.729046+0000 mgr.a (mgr.14388) 16161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:25:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:59 smithi163 bash[24253]: audit 2024-08-31T08:24:57.974481+0000 mgr.a (mgr.14388) 16158 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:25:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:59 smithi163 bash[24253]: cluster 2024-08-31T08:24:58.621813+0000 mgr.a (mgr.14388) 16159 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:25:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:59 smithi163 bash[24253]: audit 2024-08-31T08:24:58.727603+0000 mgr.a (mgr.14388) 16160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:25:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:24:59 smithi163 bash[24253]: cephadm 2024-08-31T08:24:58.729046+0000 mgr.a (mgr.14388) 16161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:25:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:59 smithi027 bash[22610]: audit 2024-08-31T08:24:57.974481+0000 mgr.a (mgr.14388) 16158 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:25:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:59 smithi027 bash[22610]: cluster 2024-08-31T08:24:58.621813+0000 mgr.a (mgr.14388) 16159 : cluster [DBG] pgmap v11203: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:25:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:59 smithi027 bash[22610]: audit 2024-08-31T08:24:58.727603+0000 mgr.a (mgr.14388) 16160 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:25:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:24:59 smithi027 bash[22610]: cephadm 2024-08-31T08:24:58.729046+0000 mgr.a (mgr.14388) 16161 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:25:00.396 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:00.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:00.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:00.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:00.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:01 smithi027 bash[22610]: audit 2024-08-31T08:24:59.981165+0000 mgr.a (mgr.14388) 16162 : audit [DBG] from='client.349431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:01.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:01 smithi027 bash[22610]: cluster 2024-08-31T08:25:00.622751+0000 mgr.a (mgr.14388) 16163 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:01 smithi191 bash[24992]: audit 2024-08-31T08:24:59.981165+0000 mgr.a (mgr.14388) 16162 : audit [DBG] from='client.349431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:01 smithi191 bash[24992]: cluster 2024-08-31T08:25:00.622751+0000 mgr.a (mgr.14388) 16163 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:01 smithi163 bash[24253]: audit 2024-08-31T08:24:59.981165+0000 mgr.a (mgr.14388) 16162 : audit [DBG] from='client.349431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:01 smithi163 bash[24253]: cluster 2024-08-31T08:25:00.622751+0000 mgr.a (mgr.14388) 16163 : cluster [DBG] pgmap v11204: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:03 smithi191 bash[24992]: cluster 2024-08-31T08:25:02.623547+0000 mgr.a (mgr.14388) 16164 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:03 smithi163 bash[24253]: cluster 2024-08-31T08:25:02.623547+0000 mgr.a (mgr.14388) 16164 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:03 smithi027 bash[22610]: cluster 2024-08-31T08:25:02.623547+0000 mgr.a (mgr.14388) 16164 : cluster [DBG] pgmap v11205: 225 pgs: 225 active+clean; 589 KiB data, 165 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:05.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:25:05.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:25:05.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:05 smithi191 bash[24992]: cluster 2024-08-31T08:25:04.625720+0000 mgr.a (mgr.14388) 16165 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:06.187 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:06.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:05 smithi163 bash[24253]: cluster 2024-08-31T08:25:04.625720+0000 mgr.a (mgr.14388) 16165 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:05 smithi027 bash[22610]: cluster 2024-08-31T08:25:04.625720+0000 mgr.a (mgr.14388) 16165 : cluster [DBG] pgmap v11206: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:06 smithi191 bash[24992]: audit 2024-08-31T08:25:05.736021+0000 mgr.a (mgr.14388) 16166 : audit [DBG] from='client.349509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:06 smithi163 bash[24253]: audit 2024-08-31T08:25:05.736021+0000 mgr.a (mgr.14388) 16166 : audit [DBG] from='client.349509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:06 smithi027 bash[22610]: audit 2024-08-31T08:25:05.736021+0000 mgr.a (mgr.14388) 16166 : audit [DBG] from='client.349509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:07 smithi191 bash[24992]: cluster 2024-08-31T08:25:06.626548+0000 mgr.a (mgr.14388) 16167 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:07 smithi163 bash[24253]: cluster 2024-08-31T08:25:06.626548+0000 mgr.a (mgr.14388) 16167 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:07 smithi027 bash[22610]: cluster 2024-08-31T08:25:06.626548+0000 mgr.a (mgr.14388) 16167 : cluster [DBG] pgmap v11207: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:09 smithi191 bash[24992]: cluster 2024-08-31T08:25:08.628791+0000 mgr.a (mgr.14388) 16168 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:09 smithi163 bash[24253]: cluster 2024-08-31T08:25:08.628791+0000 mgr.a (mgr.14388) 16168 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:10.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:09 smithi027 bash[22610]: cluster 2024-08-31T08:25:08.628791+0000 mgr.a (mgr.14388) 16168 : cluster [DBG] pgmap v11208: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:11.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:25:11.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:25:11.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:11 smithi191 bash[24992]: cluster 2024-08-31T08:25:10.629557+0000 mgr.a (mgr.14388) 16169 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:11 smithi163 bash[24253]: cluster 2024-08-31T08:25:10.629557+0000 mgr.a (mgr.14388) 16169 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:11 smithi027 bash[22610]: cluster 2024-08-31T08:25:10.629557+0000 mgr.a (mgr.14388) 16169 : cluster [DBG] pgmap v11209: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:11.961 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:11.962 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:11.962 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:11.962 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:11.962 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:12 smithi191 bash[24992]: audit 2024-08-31T08:25:11.525142+0000 mgr.a (mgr.14388) 16170 : audit [DBG] from='client.349587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:12 smithi163 bash[24253]: audit 2024-08-31T08:25:11.525142+0000 mgr.a (mgr.14388) 16170 : audit [DBG] from='client.349587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:12 smithi027 bash[22610]: audit 2024-08-31T08:25:11.525142+0000 mgr.a (mgr.14388) 16170 : audit [DBG] from='client.349587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:13 smithi191 bash[24992]: cluster 2024-08-31T08:25:12.630441+0000 mgr.a (mgr.14388) 16171 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:13 smithi163 bash[24253]: cluster 2024-08-31T08:25:12.630441+0000 mgr.a (mgr.14388) 16171 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:13 smithi027 bash[22610]: cluster 2024-08-31T08:25:12.630441+0000 mgr.a (mgr.14388) 16171 : cluster [DBG] pgmap v11210: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:15.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:15 smithi163 bash[24253]: cluster 2024-08-31T08:25:14.632672+0000 mgr.a (mgr.14388) 16172 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:15.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:15 smithi027 bash[22610]: cluster 2024-08-31T08:25:14.632672+0000 mgr.a (mgr.14388) 16172 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:15 smithi191 bash[24992]: cluster 2024-08-31T08:25:14.632672+0000 mgr.a (mgr.14388) 16172 : cluster [DBG] pgmap v11211: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:25:16.963 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:25:16.963 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:25:16.963 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:17.709 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:17.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:17.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:17.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:17.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:17 smithi163 bash[24253]: cluster 2024-08-31T08:25:16.633415+0000 mgr.a (mgr.14388) 16173 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:17 smithi027 bash[22610]: cluster 2024-08-31T08:25:16.633415+0000 mgr.a (mgr.14388) 16173 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:17 smithi191 bash[24992]: cluster 2024-08-31T08:25:16.633415+0000 mgr.a (mgr.14388) 16173 : cluster [DBG] pgmap v11212: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:18 smithi027 bash[22610]: audit 2024-08-31T08:25:17.283806+0000 mgr.a (mgr.14388) 16174 : audit [DBG] from='client.349662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:18 smithi191 bash[24992]: audit 2024-08-31T08:25:17.283806+0000 mgr.a (mgr.14388) 16174 : audit [DBG] from='client.349662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:18 smithi163 bash[24253]: audit 2024-08-31T08:25:17.283806+0000 mgr.a (mgr.14388) 16174 : audit [DBG] from='client.349662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:19.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:19 smithi027 bash[22610]: cluster 2024-08-31T08:25:18.635733+0000 mgr.a (mgr.14388) 16175 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:19 smithi191 bash[24992]: cluster 2024-08-31T08:25:18.635733+0000 mgr.a (mgr.14388) 16175 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:19 smithi163 bash[24253]: cluster 2024-08-31T08:25:18.635733+0000 mgr.a (mgr.14388) 16175 : cluster [DBG] pgmap v11213: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:21 smithi027 bash[22610]: cluster 2024-08-31T08:25:20.636520+0000 mgr.a (mgr.14388) 16176 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:21 smithi191 bash[24992]: cluster 2024-08-31T08:25:20.636520+0000 mgr.a (mgr.14388) 16176 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:21 smithi163 bash[24253]: cluster 2024-08-31T08:25:20.636520+0000 mgr.a (mgr.14388) 16176 : cluster [DBG] pgmap v11214: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:22.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:25:22.711 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:25:22.711 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:23.487 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:23.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:23.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:23.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:23.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:23 smithi027 bash[22610]: cluster 2024-08-31T08:25:22.637273+0000 mgr.a (mgr.14388) 16177 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:23 smithi191 bash[24992]: cluster 2024-08-31T08:25:22.637273+0000 mgr.a (mgr.14388) 16177 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:23 smithi163 bash[24253]: cluster 2024-08-31T08:25:22.637273+0000 mgr.a (mgr.14388) 16177 : cluster [DBG] pgmap v11215: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:24 smithi027 bash[22610]: audit 2024-08-31T08:25:23.046888+0000 mgr.a (mgr.14388) 16178 : audit [DBG] from='client.349734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:24 smithi191 bash[24992]: audit 2024-08-31T08:25:23.046888+0000 mgr.a (mgr.14388) 16178 : audit [DBG] from='client.349734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:24 smithi163 bash[24253]: audit 2024-08-31T08:25:23.046888+0000 mgr.a (mgr.14388) 16178 : audit [DBG] from='client.349734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:25 smithi027 bash[22610]: cluster 2024-08-31T08:25:24.640023+0000 mgr.a (mgr.14388) 16179 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:25 smithi191 bash[24992]: cluster 2024-08-31T08:25:24.640023+0000 mgr.a (mgr.14388) 16179 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:25 smithi163 bash[24253]: cluster 2024-08-31T08:25:24.640023+0000 mgr.a (mgr.14388) 16179 : cluster [DBG] pgmap v11216: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:27 smithi027 bash[22610]: cluster 2024-08-31T08:25:26.640800+0000 mgr.a (mgr.14388) 16180 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:25:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:27 smithi191 bash[24992]: cluster 2024-08-31T08:25:26.640800+0000 mgr.a (mgr.14388) 16180 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:25:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:27 smithi163 bash[24253]: cluster 2024-08-31T08:25:26.640800+0000 mgr.a (mgr.14388) 16180 : cluster [DBG] pgmap v11217: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:25:28.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:25:28.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:25:28.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:29.234 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:29.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:29.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:29.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:29.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:29 smithi191 bash[24992]: cluster 2024-08-31T08:25:28.642317+0000 mgr.a (mgr.14388) 16181 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:29 smithi191 bash[24992]: audit 2024-08-31T08:25:28.819377+0000 mgr.a (mgr.14388) 16182 : audit [DBG] from='client.349809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:29 smithi163 bash[24253]: cluster 2024-08-31T08:25:28.642317+0000 mgr.a (mgr.14388) 16181 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:29 smithi163 bash[24253]: audit 2024-08-31T08:25:28.819377+0000 mgr.a (mgr.14388) 16182 : audit [DBG] from='client.349809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:29 smithi027 bash[22610]: cluster 2024-08-31T08:25:28.642317+0000 mgr.a (mgr.14388) 16181 : cluster [DBG] pgmap v11218: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:29 smithi027 bash[22610]: audit 2024-08-31T08:25:28.819377+0000 mgr.a (mgr.14388) 16182 : audit [DBG] from='client.349809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:31 smithi191 bash[24992]: cluster 2024-08-31T08:25:30.643225+0000 mgr.a (mgr.14388) 16183 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:25:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:31 smithi163 bash[24253]: cluster 2024-08-31T08:25:30.643225+0000 mgr.a (mgr.14388) 16183 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:25:32.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:31 smithi027 bash[22610]: cluster 2024-08-31T08:25:30.643225+0000 mgr.a (mgr.14388) 16183 : cluster [DBG] pgmap v11219: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:25:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:33 smithi191 bash[24992]: cluster 2024-08-31T08:25:32.644047+0000 mgr.a (mgr.14388) 16184 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:25:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:33 smithi163 bash[24253]: cluster 2024-08-31T08:25:32.644047+0000 mgr.a (mgr.14388) 16184 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:25:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:33 smithi027 bash[22610]: cluster 2024-08-31T08:25:32.644047+0000 mgr.a (mgr.14388) 16184 : cluster [DBG] pgmap v11220: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:25:34.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:25:34.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:25:34.237 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:35.021 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:35.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:35.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:35.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:35.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:35 smithi191 bash[24992]: audit 2024-08-31T08:25:34.572260+0000 mgr.a (mgr.14388) 16185 : audit [DBG] from='client.349887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:35 smithi191 bash[24992]: cluster 2024-08-31T08:25:34.645447+0000 mgr.a (mgr.14388) 16186 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:35 smithi163 bash[24253]: audit 2024-08-31T08:25:34.572260+0000 mgr.a (mgr.14388) 16185 : audit [DBG] from='client.349887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:35 smithi163 bash[24253]: cluster 2024-08-31T08:25:34.645447+0000 mgr.a (mgr.14388) 16186 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:36.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:35 smithi027 bash[22610]: audit 2024-08-31T08:25:34.572260+0000 mgr.a (mgr.14388) 16185 : audit [DBG] from='client.349887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:36.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:35 smithi027 bash[22610]: cluster 2024-08-31T08:25:34.645447+0000 mgr.a (mgr.14388) 16186 : cluster [DBG] pgmap v11221: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:37 smithi191 bash[24992]: cluster 2024-08-31T08:25:36.646260+0000 mgr.a (mgr.14388) 16187 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:37 smithi163 bash[24253]: cluster 2024-08-31T08:25:36.646260+0000 mgr.a (mgr.14388) 16187 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:37 smithi027 bash[22610]: cluster 2024-08-31T08:25:36.646260+0000 mgr.a (mgr.14388) 16187 : cluster [DBG] pgmap v11222: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:40.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:25:40.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:25:40.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:39 smithi191 bash[24992]: cluster 2024-08-31T08:25:38.648452+0000 mgr.a (mgr.14388) 16188 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:39 smithi163 bash[24253]: cluster 2024-08-31T08:25:38.648452+0000 mgr.a (mgr.14388) 16188 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:39 smithi027 bash[22610]: cluster 2024-08-31T08:25:38.648452+0000 mgr.a (mgr.14388) 16188 : cluster [DBG] pgmap v11223: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:40.804 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:40.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:40.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:40.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:40.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:41 smithi191 bash[24992]: audit 2024-08-31T08:25:40.356909+0000 mgr.a (mgr.14388) 16189 : audit [DBG] from='client.349965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:41 smithi191 bash[24992]: cluster 2024-08-31T08:25:40.648960+0000 mgr.a (mgr.14388) 16190 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:41 smithi163 bash[24253]: audit 2024-08-31T08:25:40.356909+0000 mgr.a (mgr.14388) 16189 : audit [DBG] from='client.349965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:41 smithi163 bash[24253]: cluster 2024-08-31T08:25:40.648960+0000 mgr.a (mgr.14388) 16190 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:41 smithi027 bash[22610]: audit 2024-08-31T08:25:40.356909+0000 mgr.a (mgr.14388) 16189 : audit [DBG] from='client.349965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:42.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:41 smithi027 bash[22610]: cluster 2024-08-31T08:25:40.648960+0000 mgr.a (mgr.14388) 16190 : cluster [DBG] pgmap v11224: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:43 smithi191 bash[24992]: cluster 2024-08-31T08:25:42.649803+0000 mgr.a (mgr.14388) 16191 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:43 smithi163 bash[24253]: cluster 2024-08-31T08:25:42.649803+0000 mgr.a (mgr.14388) 16191 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:43 smithi027 bash[22610]: cluster 2024-08-31T08:25:42.649803+0000 mgr.a (mgr.14388) 16191 : cluster [DBG] pgmap v11225: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:45.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:25:45.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:25:45.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:45 smithi191 bash[24992]: cluster 2024-08-31T08:25:44.652017+0000 mgr.a (mgr.14388) 16192 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:45 smithi163 bash[24253]: cluster 2024-08-31T08:25:44.652017+0000 mgr.a (mgr.14388) 16192 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:45 smithi027 bash[22610]: cluster 2024-08-31T08:25:44.652017+0000 mgr.a (mgr.14388) 16192 : cluster [DBG] pgmap v11226: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:46.565 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:46.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:46.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:46.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:46.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:47 smithi191 bash[24992]: audit 2024-08-31T08:25:46.139413+0000 mgr.a (mgr.14388) 16193 : audit [DBG] from='client.350043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:47 smithi191 bash[24992]: cluster 2024-08-31T08:25:46.652509+0000 mgr.a (mgr.14388) 16194 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:47 smithi163 bash[24253]: audit 2024-08-31T08:25:46.139413+0000 mgr.a (mgr.14388) 16193 : audit [DBG] from='client.350043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:47 smithi163 bash[24253]: cluster 2024-08-31T08:25:46.652509+0000 mgr.a (mgr.14388) 16194 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:47 smithi027 bash[22610]: audit 2024-08-31T08:25:46.139413+0000 mgr.a (mgr.14388) 16193 : audit [DBG] from='client.350043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:47 smithi027 bash[22610]: cluster 2024-08-31T08:25:46.652509+0000 mgr.a (mgr.14388) 16194 : cluster [DBG] pgmap v11227: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:49 smithi191 bash[24992]: cluster 2024-08-31T08:25:48.654738+0000 mgr.a (mgr.14388) 16195 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:49 smithi163 bash[24253]: cluster 2024-08-31T08:25:48.654738+0000 mgr.a (mgr.14388) 16195 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:49 smithi027 bash[22610]: cluster 2024-08-31T08:25:48.654738+0000 mgr.a (mgr.14388) 16195 : cluster [DBG] pgmap v11228: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:25:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:25:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:51 smithi191 bash[24992]: cluster 2024-08-31T08:25:50.655509+0000 mgr.a (mgr.14388) 16196 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:51 smithi163 bash[24253]: cluster 2024-08-31T08:25:50.655509+0000 mgr.a (mgr.14388) 16196 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:51 smithi027 bash[22610]: cluster 2024-08-31T08:25:50.655509+0000 mgr.a (mgr.14388) 16196 : cluster [DBG] pgmap v11229: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:52.354 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:52.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:52.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:52.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:52.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:52 smithi163 bash[24253]: audit 2024-08-31T08:25:51.905380+0000 mgr.a (mgr.14388) 16197 : audit [DBG] from='client.350118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:53.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:52 smithi027 bash[22610]: audit 2024-08-31T08:25:51.905380+0000 mgr.a (mgr.14388) 16197 : audit [DBG] from='client.350118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:52 smithi191 bash[24992]: audit 2024-08-31T08:25:51.905380+0000 mgr.a (mgr.14388) 16197 : audit [DBG] from='client.350118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:53 smithi163 bash[24253]: cluster 2024-08-31T08:25:52.656501+0000 mgr.a (mgr.14388) 16198 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:53 smithi027 bash[22610]: cluster 2024-08-31T08:25:52.656501+0000 mgr.a (mgr.14388) 16198 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:53 smithi191 bash[24992]: cluster 2024-08-31T08:25:52.656501+0000 mgr.a (mgr.14388) 16198 : cluster [DBG] pgmap v11230: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:55 smithi163 bash[24253]: cluster 2024-08-31T08:25:54.658775+0000 mgr.a (mgr.14388) 16199 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:55 smithi027 bash[22610]: cluster 2024-08-31T08:25:54.658775+0000 mgr.a (mgr.14388) 16199 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:55 smithi191 bash[24992]: cluster 2024-08-31T08:25:54.658775+0000 mgr.a (mgr.14388) 16199 : cluster [DBG] pgmap v11231: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:25:57.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:25:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:25:57.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:25:58.113 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:25:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:25:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:25:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:25:58.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:25:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:57 smithi163 bash[24253]: cluster 2024-08-31T08:25:56.659534+0000 mgr.a (mgr.14388) 16200 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:57 smithi027 bash[22610]: cluster 2024-08-31T08:25:56.659534+0000 mgr.a (mgr.14388) 16200 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:57 smithi191 bash[24992]: cluster 2024-08-31T08:25:56.659534+0000 mgr.a (mgr.14388) 16200 : cluster [DBG] pgmap v11232: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:25:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:58 smithi163 bash[24253]: audit 2024-08-31T08:25:57.690385+0000 mgr.a (mgr.14388) 16201 : audit [DBG] from='client.350193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:58 smithi163 bash[24253]: audit 2024-08-31T08:25:58.795889+0000 mon.a (mon.0) 2997 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:25:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:58 smithi027 bash[22610]: audit 2024-08-31T08:25:57.690385+0000 mgr.a (mgr.14388) 16201 : audit [DBG] from='client.350193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:58 smithi027 bash[22610]: audit 2024-08-31T08:25:58.795889+0000 mon.a (mon.0) 2997 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:25:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:58 smithi191 bash[24992]: audit 2024-08-31T08:25:57.690385+0000 mgr.a (mgr.14388) 16201 : audit [DBG] from='client.350193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:25:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:58 smithi191 bash[24992]: audit 2024-08-31T08:25:58.795889+0000 mon.a (mon.0) 2997 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:26:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:59 smithi163 bash[24253]: cluster 2024-08-31T08:25:58.662095+0000 mgr.a (mgr.14388) 16202 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:26:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:59 smithi163 bash[24253]: audit 2024-08-31T08:25:59.639388+0000 mon.a (mon.0) 2998 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:26:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:59 smithi163 bash[24253]: audit 2024-08-31T08:25:59.641235+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:26:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:59 smithi163 bash[24253]: audit 2024-08-31T08:25:59.651755+0000 mon.a (mon.0) 3000 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:26:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:25:59 smithi163 bash[24253]: audit 2024-08-31T08:25:59.656530+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:26:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:59 smithi027 bash[22610]: cluster 2024-08-31T08:25:58.662095+0000 mgr.a (mgr.14388) 16202 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:26:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:59 smithi027 bash[22610]: audit 2024-08-31T08:25:59.639388+0000 mon.a (mon.0) 2998 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:26:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:59 smithi027 bash[22610]: audit 2024-08-31T08:25:59.641235+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:26:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:59 smithi027 bash[22610]: audit 2024-08-31T08:25:59.651755+0000 mon.a (mon.0) 3000 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:26:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:25:59 smithi027 bash[22610]: audit 2024-08-31T08:25:59.656530+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:26:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:59 smithi191 bash[24992]: cluster 2024-08-31T08:25:58.662095+0000 mgr.a (mgr.14388) 16202 : cluster [DBG] pgmap v11233: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:26:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:59 smithi191 bash[24992]: audit 2024-08-31T08:25:59.639388+0000 mon.a (mon.0) 2998 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:26:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:59 smithi191 bash[24992]: audit 2024-08-31T08:25:59.641235+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:26:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:59 smithi191 bash[24992]: audit 2024-08-31T08:25:59.651755+0000 mon.a (mon.0) 3000 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:26:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:25:59 smithi191 bash[24992]: audit 2024-08-31T08:25:59.656530+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:26:00.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:26:00 smithi027 bash[22863]: debug 2024-08-31T08:26:00.392+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:26:00.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:26:00 smithi027 bash[22863]: debug 2024-08-31T08:26:00.396+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:26:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:00 smithi163 bash[24253]: audit 2024-08-31T08:25:59.658862+0000 mgr.a (mgr.14388) 16203 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:26:01.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:00 smithi027 bash[22610]: audit 2024-08-31T08:25:59.658862+0000 mgr.a (mgr.14388) 16203 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:26:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:00 smithi191 bash[24992]: audit 2024-08-31T08:25:59.658862+0000 mgr.a (mgr.14388) 16203 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:26:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:01 smithi163 bash[24253]: audit 2024-08-31T08:26:00.398165+0000 mgr.a (mgr.14388) 16204 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:26:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:01 smithi163 bash[24253]: cephadm 2024-08-31T08:26:00.399460+0000 mgr.a (mgr.14388) 16205 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:26:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:01 smithi163 bash[24253]: cluster 2024-08-31T08:26:00.663124+0000 mgr.a (mgr.14388) 16206 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:26:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:01 smithi027 bash[22610]: audit 2024-08-31T08:26:00.398165+0000 mgr.a (mgr.14388) 16204 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:26:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:01 smithi027 bash[22610]: cephadm 2024-08-31T08:26:00.399460+0000 mgr.a (mgr.14388) 16205 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:26:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:01 smithi027 bash[22610]: cluster 2024-08-31T08:26:00.663124+0000 mgr.a (mgr.14388) 16206 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:26:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:01 smithi191 bash[24992]: audit 2024-08-31T08:26:00.398165+0000 mgr.a (mgr.14388) 16204 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:26:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:01 smithi191 bash[24992]: cephadm 2024-08-31T08:26:00.399460+0000 mgr.a (mgr.14388) 16205 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:26:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:01 smithi191 bash[24992]: cluster 2024-08-31T08:26:00.663124+0000 mgr.a (mgr.14388) 16206 : cluster [DBG] pgmap v11234: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:26:03.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:26:03.115 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:26:03.115 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:26:03.902 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:26:03.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:26:03.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:26:03.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:26:03.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:26:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:03 smithi163 bash[24253]: cluster 2024-08-31T08:26:02.663898+0000 mgr.a (mgr.14388) 16207 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:26:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:03 smithi027 bash[22610]: cluster 2024-08-31T08:26:02.663898+0000 mgr.a (mgr.14388) 16207 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:26:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:03 smithi191 bash[24992]: cluster 2024-08-31T08:26:02.663898+0000 mgr.a (mgr.14388) 16207 : cluster [DBG] pgmap v11235: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:26:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:04 smithi163 bash[24253]: audit 2024-08-31T08:26:03.453324+0000 mgr.a (mgr.14388) 16208 : audit [DBG] from='client.350379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:04 smithi027 bash[22610]: audit 2024-08-31T08:26:03.453324+0000 mgr.a (mgr.14388) 16208 : audit [DBG] from='client.350379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:04 smithi191 bash[24992]: audit 2024-08-31T08:26:03.453324+0000 mgr.a (mgr.14388) 16208 : audit [DBG] from='client.350379 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:05 smithi163 bash[24253]: cluster 2024-08-31T08:26:04.666748+0000 mgr.a (mgr.14388) 16209 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:26:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:05 smithi027 bash[22610]: cluster 2024-08-31T08:26:04.666748+0000 mgr.a (mgr.14388) 16209 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:26:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:05 smithi191 bash[24992]: cluster 2024-08-31T08:26:04.666748+0000 mgr.a (mgr.14388) 16209 : cluster [DBG] pgmap v11236: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:26:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:07 smithi163 bash[24253]: cluster 2024-08-31T08:26:06.667528+0000 mgr.a (mgr.14388) 16210 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:26:08.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:07 smithi027 bash[22610]: cluster 2024-08-31T08:26:06.667528+0000 mgr.a (mgr.14388) 16210 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:26:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:07 smithi191 bash[24992]: cluster 2024-08-31T08:26:06.667528+0000 mgr.a (mgr.14388) 16210 : cluster [DBG] pgmap v11237: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:26:08.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:26:08.905 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:26:08.905 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:26:09.669 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:26:09.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:26:09.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:26:09.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:26:09.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:26:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:09 smithi163 bash[24253]: cluster 2024-08-31T08:26:08.669487+0000 mgr.a (mgr.14388) 16211 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:26:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:09 smithi027 bash[22610]: cluster 2024-08-31T08:26:08.669487+0000 mgr.a (mgr.14388) 16211 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:26:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:09 smithi191 bash[24992]: cluster 2024-08-31T08:26:08.669487+0000 mgr.a (mgr.14388) 16211 : cluster [DBG] pgmap v11238: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:26:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:10 smithi163 bash[24253]: audit 2024-08-31T08:26:09.237235+0000 mgr.a (mgr.14388) 16212 : audit [DBG] from='client.350454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:10 smithi027 bash[22610]: audit 2024-08-31T08:26:09.237235+0000 mgr.a (mgr.14388) 16212 : audit [DBG] from='client.350454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:10 smithi191 bash[24992]: audit 2024-08-31T08:26:09.237235+0000 mgr.a (mgr.14388) 16212 : audit [DBG] from='client.350454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:11 smithi163 bash[24253]: cluster 2024-08-31T08:26:10.670422+0000 mgr.a (mgr.14388) 16213 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:26:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:11 smithi027 bash[22610]: cluster 2024-08-31T08:26:10.670422+0000 mgr.a (mgr.14388) 16213 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:26:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:11 smithi191 bash[24992]: cluster 2024-08-31T08:26:10.670422+0000 mgr.a (mgr.14388) 16213 : cluster [DBG] pgmap v11239: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:26:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:13 smithi163 bash[24253]: cluster 2024-08-31T08:26:12.671261+0000 mgr.a (mgr.14388) 16214 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:26:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:13 smithi027 bash[22610]: cluster 2024-08-31T08:26:12.671261+0000 mgr.a (mgr.14388) 16214 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:26:14.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:13 smithi191 bash[24992]: cluster 2024-08-31T08:26:12.671261+0000 mgr.a (mgr.14388) 16214 : cluster [DBG] pgmap v11240: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:26:14.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:26:14.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:26:14.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:26:15.436 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:26:15.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:26:15.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:26:15.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:26:15.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:26:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:15 smithi163 bash[24253]: cluster 2024-08-31T08:26:14.672701+0000 mgr.a (mgr.14388) 16215 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:26:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:15 smithi027 bash[22610]: cluster 2024-08-31T08:26:14.672701+0000 mgr.a (mgr.14388) 16215 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:26:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:15 smithi191 bash[24992]: cluster 2024-08-31T08:26:14.672701+0000 mgr.a (mgr.14388) 16215 : cluster [DBG] pgmap v11241: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:26:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:16 smithi163 bash[24253]: audit 2024-08-31T08:26:15.005501+0000 mgr.a (mgr.14388) 16216 : audit [DBG] from='client.350529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:16 smithi027 bash[22610]: audit 2024-08-31T08:26:15.005501+0000 mgr.a (mgr.14388) 16216 : audit [DBG] from='client.350529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:16 smithi191 bash[24992]: audit 2024-08-31T08:26:15.005501+0000 mgr.a (mgr.14388) 16216 : audit [DBG] from='client.350529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:17 smithi163 bash[24253]: cluster 2024-08-31T08:26:16.673631+0000 mgr.a (mgr.14388) 16217 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:17 smithi027 bash[22610]: cluster 2024-08-31T08:26:16.673631+0000 mgr.a (mgr.14388) 16217 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:17 smithi191 bash[24992]: cluster 2024-08-31T08:26:16.673631+0000 mgr.a (mgr.14388) 16217 : cluster [DBG] pgmap v11242: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:19 smithi163 bash[24253]: cluster 2024-08-31T08:26:18.675863+0000 mgr.a (mgr.14388) 16218 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:19 smithi027 bash[22610]: cluster 2024-08-31T08:26:18.675863+0000 mgr.a (mgr.14388) 16218 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:19 smithi191 bash[24992]: cluster 2024-08-31T08:26:18.675863+0000 mgr.a (mgr.14388) 16218 : cluster [DBG] pgmap v11243: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:20.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:26:20.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:26:20.439 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:26:21.205 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:26:21.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:26:21.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:26:21.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:26:21.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:26:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:21 smithi163 bash[24253]: cluster 2024-08-31T08:26:20.676606+0000 mgr.a (mgr.14388) 16219 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:21 smithi163 bash[24253]: audit 2024-08-31T08:26:20.778672+0000 mgr.a (mgr.14388) 16220 : audit [DBG] from='client.350607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:21 smithi027 bash[22610]: cluster 2024-08-31T08:26:20.676606+0000 mgr.a (mgr.14388) 16219 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:21 smithi027 bash[22610]: audit 2024-08-31T08:26:20.778672+0000 mgr.a (mgr.14388) 16220 : audit [DBG] from='client.350607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:21 smithi191 bash[24992]: cluster 2024-08-31T08:26:20.676606+0000 mgr.a (mgr.14388) 16219 : cluster [DBG] pgmap v11244: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:21 smithi191 bash[24992]: audit 2024-08-31T08:26:20.778672+0000 mgr.a (mgr.14388) 16220 : audit [DBG] from='client.350607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:23 smithi163 bash[24253]: cluster 2024-08-31T08:26:22.677574+0000 mgr.a (mgr.14388) 16221 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:23 smithi027 bash[22610]: cluster 2024-08-31T08:26:22.677574+0000 mgr.a (mgr.14388) 16221 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:23 smithi191 bash[24992]: cluster 2024-08-31T08:26:22.677574+0000 mgr.a (mgr.14388) 16221 : cluster [DBG] pgmap v11245: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:25 smithi163 bash[24253]: cluster 2024-08-31T08:26:24.679845+0000 mgr.a (mgr.14388) 16222 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:26:26.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:26:26.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:26:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:25 smithi027 bash[22610]: cluster 2024-08-31T08:26:24.679845+0000 mgr.a (mgr.14388) 16222 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:25 smithi191 bash[24992]: cluster 2024-08-31T08:26:24.679845+0000 mgr.a (mgr.14388) 16222 : cluster [DBG] pgmap v11246: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:26.948 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:26:26.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:26:26.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:26:26.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:26:26.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:26:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:27 smithi163 bash[24253]: audit 2024-08-31T08:26:26.540327+0000 mgr.a (mgr.14388) 16223 : audit [DBG] from='client.350685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:27 smithi163 bash[24253]: cluster 2024-08-31T08:26:26.680417+0000 mgr.a (mgr.14388) 16224 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:27 smithi027 bash[22610]: audit 2024-08-31T08:26:26.540327+0000 mgr.a (mgr.14388) 16223 : audit [DBG] from='client.350685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:27 smithi027 bash[22610]: cluster 2024-08-31T08:26:26.680417+0000 mgr.a (mgr.14388) 16224 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:27 smithi191 bash[24992]: audit 2024-08-31T08:26:26.540327+0000 mgr.a (mgr.14388) 16223 : audit [DBG] from='client.350685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:27 smithi191 bash[24992]: cluster 2024-08-31T08:26:26.680417+0000 mgr.a (mgr.14388) 16224 : cluster [DBG] pgmap v11247: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:29 smithi163 bash[24253]: cluster 2024-08-31T08:26:28.682698+0000 mgr.a (mgr.14388) 16225 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:29 smithi027 bash[22610]: cluster 2024-08-31T08:26:28.682698+0000 mgr.a (mgr.14388) 16225 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:29 smithi191 bash[24992]: cluster 2024-08-31T08:26:28.682698+0000 mgr.a (mgr.14388) 16225 : cluster [DBG] pgmap v11248: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:31.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:26:31.950 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:26:31.951 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:26:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:31 smithi163 bash[24253]: cluster 2024-08-31T08:26:30.683474+0000 mgr.a (mgr.14388) 16226 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:31 smithi027 bash[22610]: cluster 2024-08-31T08:26:30.683474+0000 mgr.a (mgr.14388) 16226 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:31 smithi191 bash[24992]: cluster 2024-08-31T08:26:30.683474+0000 mgr.a (mgr.14388) 16226 : cluster [DBG] pgmap v11249: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:32.726 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:26:32.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:26:32.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:26:32.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:26:32.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:26:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:33 smithi163 bash[24253]: audit 2024-08-31T08:26:32.287959+0000 mgr.a (mgr.14388) 16227 : audit [DBG] from='client.350763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:33 smithi163 bash[24253]: cluster 2024-08-31T08:26:32.684069+0000 mgr.a (mgr.14388) 16228 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:33 smithi027 bash[22610]: audit 2024-08-31T08:26:32.287959+0000 mgr.a (mgr.14388) 16227 : audit [DBG] from='client.350763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:33 smithi027 bash[22610]: cluster 2024-08-31T08:26:32.684069+0000 mgr.a (mgr.14388) 16228 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:33 smithi191 bash[24992]: audit 2024-08-31T08:26:32.287959+0000 mgr.a (mgr.14388) 16227 : audit [DBG] from='client.350763 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:33 smithi191 bash[24992]: cluster 2024-08-31T08:26:32.684069+0000 mgr.a (mgr.14388) 16228 : cluster [DBG] pgmap v11250: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:35 smithi163 bash[24253]: cluster 2024-08-31T08:26:34.686232+0000 mgr.a (mgr.14388) 16229 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:35 smithi027 bash[22610]: cluster 2024-08-31T08:26:34.686232+0000 mgr.a (mgr.14388) 16229 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:35 smithi191 bash[24992]: cluster 2024-08-31T08:26:34.686232+0000 mgr.a (mgr.14388) 16229 : cluster [DBG] pgmap v11251: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:37.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:26:37.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:26:37.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:26:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:37 smithi163 bash[24253]: cluster 2024-08-31T08:26:36.687033+0000 mgr.a (mgr.14388) 16230 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:37 smithi027 bash[22610]: cluster 2024-08-31T08:26:36.687033+0000 mgr.a (mgr.14388) 16230 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:37 smithi191 bash[24992]: cluster 2024-08-31T08:26:36.687033+0000 mgr.a (mgr.14388) 16230 : cluster [DBG] pgmap v11252: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:38.478 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:26:38.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:26:38.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:26:38.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:26:38.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:26:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:39 smithi163 bash[24253]: audit 2024-08-31T08:26:38.059542+0000 mgr.a (mgr.14388) 16231 : audit [DBG] from='client.350841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:39 smithi163 bash[24253]: cluster 2024-08-31T08:26:38.689792+0000 mgr.a (mgr.14388) 16232 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:39 smithi027 bash[22610]: audit 2024-08-31T08:26:38.059542+0000 mgr.a (mgr.14388) 16231 : audit [DBG] from='client.350841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:39 smithi027 bash[22610]: cluster 2024-08-31T08:26:38.689792+0000 mgr.a (mgr.14388) 16232 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:39 smithi191 bash[24992]: audit 2024-08-31T08:26:38.059542+0000 mgr.a (mgr.14388) 16231 : audit [DBG] from='client.350841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:39 smithi191 bash[24992]: cluster 2024-08-31T08:26:38.689792+0000 mgr.a (mgr.14388) 16232 : cluster [DBG] pgmap v11253: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:41 smithi163 bash[24253]: cluster 2024-08-31T08:26:40.690586+0000 mgr.a (mgr.14388) 16233 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:26:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:41 smithi027 bash[22610]: cluster 2024-08-31T08:26:40.690586+0000 mgr.a (mgr.14388) 16233 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:26:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:41 smithi191 bash[24992]: cluster 2024-08-31T08:26:40.690586+0000 mgr.a (mgr.14388) 16233 : cluster [DBG] pgmap v11254: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:26:43.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:26:43.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:26:43.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:26:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:43 smithi163 bash[24253]: cluster 2024-08-31T08:26:42.691361+0000 mgr.a (mgr.14388) 16234 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:26:44.220 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:26:44.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:26:44.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:26:44.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:26:44.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:26:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:43 smithi027 bash[22610]: cluster 2024-08-31T08:26:42.691361+0000 mgr.a (mgr.14388) 16234 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:26:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:43 smithi191 bash[24992]: cluster 2024-08-31T08:26:42.691361+0000 mgr.a (mgr.14388) 16234 : cluster [DBG] pgmap v11255: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:26:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:44 smithi163 bash[24253]: audit 2024-08-31T08:26:43.811429+0000 mgr.a (mgr.14388) 16235 : audit [DBG] from='client.350919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:44 smithi027 bash[22610]: audit 2024-08-31T08:26:43.811429+0000 mgr.a (mgr.14388) 16235 : audit [DBG] from='client.350919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:44 smithi191 bash[24992]: audit 2024-08-31T08:26:43.811429+0000 mgr.a (mgr.14388) 16235 : audit [DBG] from='client.350919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:46.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:45 smithi027 bash[22610]: cluster 2024-08-31T08:26:44.694157+0000 mgr.a (mgr.14388) 16236 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:45 smithi191 bash[24992]: cluster 2024-08-31T08:26:44.694157+0000 mgr.a (mgr.14388) 16236 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:45 smithi163 bash[24253]: cluster 2024-08-31T08:26:44.694157+0000 mgr.a (mgr.14388) 16236 : cluster [DBG] pgmap v11256: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:47 smithi027 bash[22610]: cluster 2024-08-31T08:26:46.694972+0000 mgr.a (mgr.14388) 16237 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:26:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:47 smithi191 bash[24992]: cluster 2024-08-31T08:26:46.694972+0000 mgr.a (mgr.14388) 16237 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:26:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:47 smithi163 bash[24253]: cluster 2024-08-31T08:26:46.694972+0000 mgr.a (mgr.14388) 16237 : cluster [DBG] pgmap v11257: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:26:49.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:26:49.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:26:49.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:26:49.997 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:26:49.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:26:49.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:26:49.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:26:49.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:26:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:49 smithi027 bash[22610]: cluster 2024-08-31T08:26:48.696876+0000 mgr.a (mgr.14388) 16238 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:49 smithi191 bash[24992]: cluster 2024-08-31T08:26:48.696876+0000 mgr.a (mgr.14388) 16238 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:49 smithi163 bash[24253]: cluster 2024-08-31T08:26:48.696876+0000 mgr.a (mgr.14388) 16238 : cluster [DBG] pgmap v11258: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:50 smithi027 bash[22610]: audit 2024-08-31T08:26:49.558496+0000 mgr.a (mgr.14388) 16239 : audit [DBG] from='client.350991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:50 smithi191 bash[24992]: audit 2024-08-31T08:26:49.558496+0000 mgr.a (mgr.14388) 16239 : audit [DBG] from='client.350991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:50 smithi163 bash[24253]: audit 2024-08-31T08:26:49.558496+0000 mgr.a (mgr.14388) 16239 : audit [DBG] from='client.350991 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:51 smithi027 bash[22610]: cluster 2024-08-31T08:26:50.697824+0000 mgr.a (mgr.14388) 16240 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:51 smithi191 bash[24992]: cluster 2024-08-31T08:26:50.697824+0000 mgr.a (mgr.14388) 16240 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:51 smithi163 bash[24253]: cluster 2024-08-31T08:26:50.697824+0000 mgr.a (mgr.14388) 16240 : cluster [DBG] pgmap v11259: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:53 smithi027 bash[22610]: cluster 2024-08-31T08:26:52.698614+0000 mgr.a (mgr.14388) 16241 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:53 smithi191 bash[24992]: cluster 2024-08-31T08:26:52.698614+0000 mgr.a (mgr.14388) 16241 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:53 smithi163 bash[24253]: cluster 2024-08-31T08:26:52.698614+0000 mgr.a (mgr.14388) 16241 : cluster [DBG] pgmap v11260: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:54.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:26:55.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:26:55.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:26:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:55 smithi191 bash[24992]: cluster 2024-08-31T08:26:54.700855+0000 mgr.a (mgr.14388) 16242 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:55 smithi163 bash[24253]: cluster 2024-08-31T08:26:54.700855+0000 mgr.a (mgr.14388) 16242 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:55 smithi027 bash[22610]: cluster 2024-08-31T08:26:54.700855+0000 mgr.a (mgr.14388) 16242 : cluster [DBG] pgmap v11261: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:26:55.762 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:26:55.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:26:55.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:26:55.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:26:55.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:26:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:56 smithi191 bash[24992]: audit 2024-08-31T08:26:55.339540+0000 mgr.a (mgr.14388) 16243 : audit [DBG] from='client.351069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:56 smithi163 bash[24253]: audit 2024-08-31T08:26:55.339540+0000 mgr.a (mgr.14388) 16243 : audit [DBG] from='client.351069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:56 smithi027 bash[22610]: audit 2024-08-31T08:26:55.339540+0000 mgr.a (mgr.14388) 16243 : audit [DBG] from='client.351069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:26:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:57 smithi163 bash[24253]: cluster 2024-08-31T08:26:56.701803+0000 mgr.a (mgr.14388) 16244 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:57 smithi027 bash[22610]: cluster 2024-08-31T08:26:56.701803+0000 mgr.a (mgr.14388) 16244 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:26:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:57 smithi191 bash[24992]: cluster 2024-08-31T08:26:56.701803+0000 mgr.a (mgr.14388) 16244 : cluster [DBG] pgmap v11262: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:26:59 smithi191 bash[24992]: cluster 2024-08-31T08:26:58.703988+0000 mgr.a (mgr.14388) 16245 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:26:59 smithi163 bash[24253]: cluster 2024-08-31T08:26:58.703988+0000 mgr.a (mgr.14388) 16245 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:26:59 smithi027 bash[22610]: cluster 2024-08-31T08:26:58.703988+0000 mgr.a (mgr.14388) 16245 : cluster [DBG] pgmap v11263: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:00.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:00.764 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:00 smithi191 bash[24992]: audit 2024-08-31T08:27:00.452350+0000 mon.a (mon.0) 3002 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:27:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:00 smithi163 bash[24253]: audit 2024-08-31T08:27:00.452350+0000 mon.a (mon.0) 3002 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:27:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:00 smithi027 bash[22610]: audit 2024-08-31T08:27:00.452350+0000 mon.a (mon.0) 3002 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:27:01.513 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:27:01.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:01.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:01.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:01.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:01 smithi191 bash[24992]: cluster 2024-08-31T08:27:00.704751+0000 mgr.a (mgr.14388) 16246 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:01 smithi191 bash[24992]: audit 2024-08-31T08:27:01.325569+0000 mon.a (mon.0) 3003 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:27:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:01 smithi191 bash[24992]: audit 2024-08-31T08:27:01.326468+0000 mon.a (mon.0) 3004 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:27:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:01 smithi191 bash[24992]: audit 2024-08-31T08:27:01.333416+0000 mon.a (mon.0) 3005 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:27:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:01 smithi191 bash[24992]: audit 2024-08-31T08:27:01.335647+0000 mon.a (mon.0) 3006 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:27:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:01 smithi163 bash[24253]: cluster 2024-08-31T08:27:00.704751+0000 mgr.a (mgr.14388) 16246 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:01 smithi163 bash[24253]: audit 2024-08-31T08:27:01.325569+0000 mon.a (mon.0) 3003 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:27:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:01 smithi163 bash[24253]: audit 2024-08-31T08:27:01.326468+0000 mon.a (mon.0) 3004 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:27:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:01 smithi163 bash[24253]: audit 2024-08-31T08:27:01.333416+0000 mon.a (mon.0) 3005 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:27:02.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:01 smithi163 bash[24253]: audit 2024-08-31T08:27:01.335647+0000 mon.a (mon.0) 3006 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:27:02.211 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:01 smithi027 bash[22610]: cluster 2024-08-31T08:27:00.704751+0000 mgr.a (mgr.14388) 16246 : cluster [DBG] pgmap v11264: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:02.212 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:01 smithi027 bash[22610]: audit 2024-08-31T08:27:01.325569+0000 mon.a (mon.0) 3003 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:27:02.212 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:01 smithi027 bash[22610]: audit 2024-08-31T08:27:01.326468+0000 mon.a (mon.0) 3004 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:27:02.212 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:01 smithi027 bash[22610]: audit 2024-08-31T08:27:01.333416+0000 mon.a (mon.0) 3005 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:27:02.212 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:01 smithi027 bash[22610]: audit 2024-08-31T08:27:01.335647+0000 mon.a (mon.0) 3006 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:27:02.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:27:02 smithi027 bash[22863]: debug 2024-08-31T08:27:02.210+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:27:02.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:27:02 smithi027 bash[22863]: debug 2024-08-31T08:27:02.210+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:27:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:02 smithi191 bash[24992]: audit 2024-08-31T08:27:01.089150+0000 mgr.a (mgr.14388) 16247 : audit [DBG] from='client.351144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:02 smithi191 bash[24992]: audit 2024-08-31T08:27:01.336841+0000 mgr.a (mgr.14388) 16248 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:27:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:02 smithi163 bash[24253]: audit 2024-08-31T08:27:01.089150+0000 mgr.a (mgr.14388) 16247 : audit [DBG] from='client.351144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:02 smithi163 bash[24253]: audit 2024-08-31T08:27:01.336841+0000 mgr.a (mgr.14388) 16248 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:27:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:02 smithi027 bash[22610]: audit 2024-08-31T08:27:01.089150+0000 mgr.a (mgr.14388) 16247 : audit [DBG] from='client.351144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:02 smithi027 bash[22610]: audit 2024-08-31T08:27:01.336841+0000 mgr.a (mgr.14388) 16248 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:27:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:03 smithi191 bash[24992]: audit 2024-08-31T08:27:02.211326+0000 mgr.a (mgr.14388) 16249 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:27:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:03 smithi191 bash[24992]: cephadm 2024-08-31T08:27:02.212650+0000 mgr.a (mgr.14388) 16250 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:27:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:03 smithi191 bash[24992]: cluster 2024-08-31T08:27:02.705722+0000 mgr.a (mgr.14388) 16251 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:03 smithi163 bash[24253]: audit 2024-08-31T08:27:02.211326+0000 mgr.a (mgr.14388) 16249 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:27:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:03 smithi163 bash[24253]: cephadm 2024-08-31T08:27:02.212650+0000 mgr.a (mgr.14388) 16250 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:27:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:03 smithi163 bash[24253]: cluster 2024-08-31T08:27:02.705722+0000 mgr.a (mgr.14388) 16251 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:03 smithi027 bash[22610]: audit 2024-08-31T08:27:02.211326+0000 mgr.a (mgr.14388) 16249 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:27:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:03 smithi027 bash[22610]: cephadm 2024-08-31T08:27:02.212650+0000 mgr.a (mgr.14388) 16250 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:27:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:03 smithi027 bash[22610]: cluster 2024-08-31T08:27:02.705722+0000 mgr.a (mgr.14388) 16251 : cluster [DBG] pgmap v11265: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:05 smithi163 bash[24253]: cluster 2024-08-31T08:27:04.708046+0000 mgr.a (mgr.14388) 16252 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:05 smithi027 bash[22610]: cluster 2024-08-31T08:27:04.708046+0000 mgr.a (mgr.14388) 16252 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:05 smithi191 bash[24992]: cluster 2024-08-31T08:27:04.708046+0000 mgr.a (mgr.14388) 16252 : cluster [DBG] pgmap v11266: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:06.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:06.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:06.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:07.270 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:27:07.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:07.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:07.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:07.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:07 smithi163 bash[24253]: cluster 2024-08-31T08:27:06.708773+0000 mgr.a (mgr.14388) 16253 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:07 smithi163 bash[24253]: audit 2024-08-31T08:27:06.842596+0000 mgr.a (mgr.14388) 16254 : audit [DBG] from='client.351324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:07 smithi027 bash[22610]: cluster 2024-08-31T08:27:06.708773+0000 mgr.a (mgr.14388) 16253 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:07 smithi027 bash[22610]: audit 2024-08-31T08:27:06.842596+0000 mgr.a (mgr.14388) 16254 : audit [DBG] from='client.351324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:07 smithi191 bash[24992]: cluster 2024-08-31T08:27:06.708773+0000 mgr.a (mgr.14388) 16253 : cluster [DBG] pgmap v11267: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:07 smithi191 bash[24992]: audit 2024-08-31T08:27:06.842596+0000 mgr.a (mgr.14388) 16254 : audit [DBG] from='client.351324 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:09 smithi163 bash[24253]: cluster 2024-08-31T08:27:08.711082+0000 mgr.a (mgr.14388) 16255 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:09 smithi027 bash[22610]: cluster 2024-08-31T08:27:08.711082+0000 mgr.a (mgr.14388) 16255 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:09 smithi191 bash[24992]: cluster 2024-08-31T08:27:08.711082+0000 mgr.a (mgr.14388) 16255 : cluster [DBG] pgmap v11268: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:11 smithi163 bash[24253]: cluster 2024-08-31T08:27:10.711805+0000 mgr.a (mgr.14388) 16256 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:11 smithi027 bash[22610]: cluster 2024-08-31T08:27:10.711805+0000 mgr.a (mgr.14388) 16256 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:12.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:12.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:12.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:11 smithi191 bash[24992]: cluster 2024-08-31T08:27:10.711805+0000 mgr.a (mgr.14388) 16256 : cluster [DBG] pgmap v11269: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:13.048 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:27:13.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:13.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:13.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:13.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:13 smithi163 bash[24253]: audit 2024-08-31T08:27:12.605527+0000 mgr.a (mgr.14388) 16257 : audit [DBG] from='client.351399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:13 smithi163 bash[24253]: cluster 2024-08-31T08:27:12.712316+0000 mgr.a (mgr.14388) 16258 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:13 smithi027 bash[22610]: audit 2024-08-31T08:27:12.605527+0000 mgr.a (mgr.14388) 16257 : audit [DBG] from='client.351399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:13 smithi027 bash[22610]: cluster 2024-08-31T08:27:12.712316+0000 mgr.a (mgr.14388) 16258 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:13 smithi191 bash[24992]: audit 2024-08-31T08:27:12.605527+0000 mgr.a (mgr.14388) 16257 : audit [DBG] from='client.351399 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:13 smithi191 bash[24992]: cluster 2024-08-31T08:27:12.712316+0000 mgr.a (mgr.14388) 16258 : cluster [DBG] pgmap v11270: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:15 smithi163 bash[24253]: cluster 2024-08-31T08:27:14.715102+0000 mgr.a (mgr.14388) 16259 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:15 smithi027 bash[22610]: cluster 2024-08-31T08:27:14.715102+0000 mgr.a (mgr.14388) 16259 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:15 smithi191 bash[24992]: cluster 2024-08-31T08:27:14.715102+0000 mgr.a (mgr.14388) 16259 : cluster [DBG] pgmap v11271: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:27:18.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:18.050 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:18.050 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:17 smithi163 bash[24253]: cluster 2024-08-31T08:27:16.715854+0000 mgr.a (mgr.14388) 16260 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:27:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:17 smithi027 bash[22610]: cluster 2024-08-31T08:27:16.715854+0000 mgr.a (mgr.14388) 16260 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:27:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:17 smithi191 bash[24992]: cluster 2024-08-31T08:27:16.715854+0000 mgr.a (mgr.14388) 16260 : cluster [DBG] pgmap v11272: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:27:18.824 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:27:18.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:18.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:18.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:18.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:19 smithi163 bash[24253]: audit 2024-08-31T08:27:18.388829+0000 mgr.a (mgr.14388) 16261 : audit [DBG] from='client.351474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:19 smithi163 bash[24253]: cluster 2024-08-31T08:27:18.717332+0000 mgr.a (mgr.14388) 16262 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:19 smithi027 bash[22610]: audit 2024-08-31T08:27:18.388829+0000 mgr.a (mgr.14388) 16261 : audit [DBG] from='client.351474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:19 smithi027 bash[22610]: cluster 2024-08-31T08:27:18.717332+0000 mgr.a (mgr.14388) 16262 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:19 smithi191 bash[24992]: audit 2024-08-31T08:27:18.388829+0000 mgr.a (mgr.14388) 16261 : audit [DBG] from='client.351474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:19 smithi191 bash[24992]: cluster 2024-08-31T08:27:18.717332+0000 mgr.a (mgr.14388) 16262 : cluster [DBG] pgmap v11273: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:21 smithi163 bash[24253]: cluster 2024-08-31T08:27:20.718188+0000 mgr.a (mgr.14388) 16263 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:27:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:21 smithi027 bash[22610]: cluster 2024-08-31T08:27:20.718188+0000 mgr.a (mgr.14388) 16263 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:27:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:21 smithi191 bash[24992]: cluster 2024-08-31T08:27:20.718188+0000 mgr.a (mgr.14388) 16263 : cluster [DBG] pgmap v11274: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:27:23.826 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:23.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:23 smithi163 bash[24253]: cluster 2024-08-31T08:27:22.719045+0000 mgr.a (mgr.14388) 16264 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:27:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:23 smithi027 bash[22610]: cluster 2024-08-31T08:27:22.719045+0000 mgr.a (mgr.14388) 16264 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:27:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:23 smithi191 bash[24992]: cluster 2024-08-31T08:27:22.719045+0000 mgr.a (mgr.14388) 16264 : cluster [DBG] pgmap v11275: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:27:24.593 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:27:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:24.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:25 smithi163 bash[24253]: audit 2024-08-31T08:27:24.156161+0000 mgr.a (mgr.14388) 16265 : audit [DBG] from='client.351552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:25 smithi163 bash[24253]: cluster 2024-08-31T08:27:24.721848+0000 mgr.a (mgr.14388) 16266 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:25 smithi027 bash[22610]: audit 2024-08-31T08:27:24.156161+0000 mgr.a (mgr.14388) 16265 : audit [DBG] from='client.351552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:25 smithi027 bash[22610]: cluster 2024-08-31T08:27:24.721848+0000 mgr.a (mgr.14388) 16266 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:25 smithi191 bash[24992]: audit 2024-08-31T08:27:24.156161+0000 mgr.a (mgr.14388) 16265 : audit [DBG] from='client.351552 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:25 smithi191 bash[24992]: cluster 2024-08-31T08:27:24.721848+0000 mgr.a (mgr.14388) 16266 : cluster [DBG] pgmap v11276: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:27 smithi163 bash[24253]: cluster 2024-08-31T08:27:26.722633+0000 mgr.a (mgr.14388) 16267 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:27 smithi027 bash[22610]: cluster 2024-08-31T08:27:26.722633+0000 mgr.a (mgr.14388) 16267 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:27 smithi191 bash[24992]: cluster 2024-08-31T08:27:26.722633+0000 mgr.a (mgr.14388) 16267 : cluster [DBG] pgmap v11277: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:29.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:29.595 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:29.595 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:29 smithi163 bash[24253]: cluster 2024-08-31T08:27:28.724666+0000 mgr.a (mgr.14388) 16268 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:29 smithi027 bash[22610]: cluster 2024-08-31T08:27:28.724666+0000 mgr.a (mgr.14388) 16268 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:29 smithi191 bash[24992]: cluster 2024-08-31T08:27:28.724666+0000 mgr.a (mgr.14388) 16268 : cluster [DBG] pgmap v11278: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:30.353 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:27:30.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:30.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:30.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:30.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:30 smithi163 bash[24253]: audit 2024-08-31T08:27:29.927874+0000 mgr.a (mgr.14388) 16269 : audit [DBG] from='client.351630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:31.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:30 smithi027 bash[22610]: audit 2024-08-31T08:27:29.927874+0000 mgr.a (mgr.14388) 16269 : audit [DBG] from='client.351630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:30 smithi191 bash[24992]: audit 2024-08-31T08:27:29.927874+0000 mgr.a (mgr.14388) 16269 : audit [DBG] from='client.351630 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:31 smithi163 bash[24253]: cluster 2024-08-31T08:27:30.725762+0000 mgr.a (mgr.14388) 16270 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:31 smithi027 bash[22610]: cluster 2024-08-31T08:27:30.725762+0000 mgr.a (mgr.14388) 16270 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:31 smithi191 bash[24992]: cluster 2024-08-31T08:27:30.725762+0000 mgr.a (mgr.14388) 16270 : cluster [DBG] pgmap v11279: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:33 smithi163 bash[24253]: cluster 2024-08-31T08:27:32.726617+0000 mgr.a (mgr.14388) 16271 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:33 smithi027 bash[22610]: cluster 2024-08-31T08:27:32.726617+0000 mgr.a (mgr.14388) 16271 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:33 smithi191 bash[24992]: cluster 2024-08-31T08:27:32.726617+0000 mgr.a (mgr.14388) 16271 : cluster [DBG] pgmap v11280: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:35.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:35.355 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:35.356 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:36.109 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:27:36.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:36.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:36.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:36.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:35 smithi163 bash[24253]: cluster 2024-08-31T08:27:34.728832+0000 mgr.a (mgr.14388) 16272 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:35 smithi027 bash[22610]: cluster 2024-08-31T08:27:34.728832+0000 mgr.a (mgr.14388) 16272 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:35 smithi191 bash[24992]: cluster 2024-08-31T08:27:34.728832+0000 mgr.a (mgr.14388) 16272 : cluster [DBG] pgmap v11281: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:36 smithi163 bash[24253]: audit 2024-08-31T08:27:35.691224+0000 mgr.a (mgr.14388) 16273 : audit [DBG] from='client.351702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:36 smithi027 bash[22610]: audit 2024-08-31T08:27:35.691224+0000 mgr.a (mgr.14388) 16273 : audit [DBG] from='client.351702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:36 smithi191 bash[24992]: audit 2024-08-31T08:27:35.691224+0000 mgr.a (mgr.14388) 16273 : audit [DBG] from='client.351702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:37 smithi163 bash[24253]: cluster 2024-08-31T08:27:36.729851+0000 mgr.a (mgr.14388) 16274 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:37 smithi027 bash[22610]: cluster 2024-08-31T08:27:36.729851+0000 mgr.a (mgr.14388) 16274 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:37 smithi191 bash[24992]: cluster 2024-08-31T08:27:36.729851+0000 mgr.a (mgr.14388) 16274 : cluster [DBG] pgmap v11282: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:39 smithi163 bash[24253]: cluster 2024-08-31T08:27:38.732145+0000 mgr.a (mgr.14388) 16275 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:39 smithi027 bash[22610]: cluster 2024-08-31T08:27:38.732145+0000 mgr.a (mgr.14388) 16275 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:39 smithi191 bash[24992]: cluster 2024-08-31T08:27:38.732145+0000 mgr.a (mgr.14388) 16275 : cluster [DBG] pgmap v11283: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:41.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:41.111 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:41.111 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:41.882 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:27:41.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:41.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:41.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:41.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:41 smithi163 bash[24253]: cluster 2024-08-31T08:27:40.732952+0000 mgr.a (mgr.14388) 16276 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:41 smithi027 bash[22610]: cluster 2024-08-31T08:27:40.732952+0000 mgr.a (mgr.14388) 16276 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:41 smithi191 bash[24992]: cluster 2024-08-31T08:27:40.732952+0000 mgr.a (mgr.14388) 16276 : cluster [DBG] pgmap v11284: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:42 smithi163 bash[24253]: audit 2024-08-31T08:27:41.445299+0000 mgr.a (mgr.14388) 16277 : audit [DBG] from='client.351780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:42 smithi027 bash[22610]: audit 2024-08-31T08:27:41.445299+0000 mgr.a (mgr.14388) 16277 : audit [DBG] from='client.351780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:42 smithi191 bash[24992]: audit 2024-08-31T08:27:41.445299+0000 mgr.a (mgr.14388) 16277 : audit [DBG] from='client.351780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:43 smithi163 bash[24253]: cluster 2024-08-31T08:27:42.733920+0000 mgr.a (mgr.14388) 16278 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:43 smithi027 bash[22610]: cluster 2024-08-31T08:27:42.733920+0000 mgr.a (mgr.14388) 16278 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:43 smithi191 bash[24992]: cluster 2024-08-31T08:27:42.733920+0000 mgr.a (mgr.14388) 16278 : cluster [DBG] pgmap v11285: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:45 smithi163 bash[24253]: cluster 2024-08-31T08:27:44.736235+0000 mgr.a (mgr.14388) 16279 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:45 smithi027 bash[22610]: cluster 2024-08-31T08:27:44.736235+0000 mgr.a (mgr.14388) 16279 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:45 smithi191 bash[24992]: cluster 2024-08-31T08:27:44.736235+0000 mgr.a (mgr.14388) 16279 : cluster [DBG] pgmap v11286: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:46.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:46.884 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:46.884 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:47.636 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:27:47.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:47.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:47.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:47.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:47 smithi163 bash[24253]: cluster 2024-08-31T08:27:46.737012+0000 mgr.a (mgr.14388) 16280 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:47 smithi027 bash[22610]: cluster 2024-08-31T08:27:46.737012+0000 mgr.a (mgr.14388) 16280 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:47 smithi191 bash[24992]: cluster 2024-08-31T08:27:46.737012+0000 mgr.a (mgr.14388) 16280 : cluster [DBG] pgmap v11287: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:48 smithi163 bash[24253]: audit 2024-08-31T08:27:47.213830+0000 mgr.a (mgr.14388) 16281 : audit [DBG] from='client.351858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:48 smithi027 bash[22610]: audit 2024-08-31T08:27:47.213830+0000 mgr.a (mgr.14388) 16281 : audit [DBG] from='client.351858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:49.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:48 smithi191 bash[24992]: audit 2024-08-31T08:27:47.213830+0000 mgr.a (mgr.14388) 16281 : audit [DBG] from='client.351858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:49 smithi163 bash[24253]: cluster 2024-08-31T08:27:48.739389+0000 mgr.a (mgr.14388) 16282 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:49 smithi027 bash[22610]: cluster 2024-08-31T08:27:48.739389+0000 mgr.a (mgr.14388) 16282 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:49 smithi191 bash[24992]: cluster 2024-08-31T08:27:48.739389+0000 mgr.a (mgr.14388) 16282 : cluster [DBG] pgmap v11288: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:27:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:51 smithi163 bash[24253]: cluster 2024-08-31T08:27:50.740163+0000 mgr.a (mgr.14388) 16283 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:51 smithi027 bash[22610]: cluster 2024-08-31T08:27:50.740163+0000 mgr.a (mgr.14388) 16283 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:51 smithi191 bash[24992]: cluster 2024-08-31T08:27:50.740163+0000 mgr.a (mgr.14388) 16283 : cluster [DBG] pgmap v11289: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:52.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:52.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:52.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:53.419 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:53.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:53 smithi163 bash[24253]: cluster 2024-08-31T08:27:52.740616+0000 mgr.a (mgr.14388) 16284 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:53 smithi163 bash[24253]: audit 2024-08-31T08:27:52.974076+0000 mgr.a (mgr.14388) 16285 : audit [DBG] from='client.351936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:53 smithi027 bash[22610]: cluster 2024-08-31T08:27:52.740616+0000 mgr.a (mgr.14388) 16284 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:53 smithi027 bash[22610]: audit 2024-08-31T08:27:52.974076+0000 mgr.a (mgr.14388) 16285 : audit [DBG] from='client.351936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:53 smithi191 bash[24992]: cluster 2024-08-31T08:27:52.740616+0000 mgr.a (mgr.14388) 16284 : cluster [DBG] pgmap v11290: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:53 smithi191 bash[24992]: audit 2024-08-31T08:27:52.974076+0000 mgr.a (mgr.14388) 16285 : audit [DBG] from='client.351936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:27:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:55 smithi163 bash[24253]: cluster 2024-08-31T08:27:54.743355+0000 mgr.a (mgr.14388) 16286 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:55 smithi027 bash[22610]: cluster 2024-08-31T08:27:54.743355+0000 mgr.a (mgr.14388) 16286 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:55 smithi191 bash[24992]: cluster 2024-08-31T08:27:54.743355+0000 mgr.a (mgr.14388) 16286 : cluster [DBG] pgmap v11291: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:27:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:57 smithi163 bash[24253]: cluster 2024-08-31T08:27:56.744111+0000 mgr.a (mgr.14388) 16287 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:27:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:57 smithi027 bash[22610]: cluster 2024-08-31T08:27:56.744111+0000 mgr.a (mgr.14388) 16287 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:27:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:57 smithi191 bash[24992]: cluster 2024-08-31T08:27:56.744111+0000 mgr.a (mgr.14388) 16287 : cluster [DBG] pgmap v11292: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:27:58.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:27:58.421 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:27:58.421 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:27:59.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:27:59.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:27:59.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:27:59.195 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:27:59.195 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:59 smithi163 bash[24253]: cluster 2024-08-31T08:27:58.746165+0000 mgr.a (mgr.14388) 16288 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:27:59 smithi163 bash[24253]: audit 2024-08-31T08:27:58.754594+0000 mgr.a (mgr.14388) 16289 : audit [DBG] from='client.352014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:59 smithi027 bash[22610]: cluster 2024-08-31T08:27:58.746165+0000 mgr.a (mgr.14388) 16288 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:00.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:27:59 smithi027 bash[22610]: audit 2024-08-31T08:27:58.754594+0000 mgr.a (mgr.14388) 16289 : audit [DBG] from='client.352014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:59 smithi191 bash[24992]: cluster 2024-08-31T08:27:58.746165+0000 mgr.a (mgr.14388) 16288 : cluster [DBG] pgmap v11293: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:27:59 smithi191 bash[24992]: audit 2024-08-31T08:27:58.754594+0000 mgr.a (mgr.14388) 16289 : audit [DBG] from='client.352014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:01 smithi163 bash[24253]: cluster 2024-08-31T08:28:00.747069+0000 mgr.a (mgr.14388) 16290 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:28:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:01 smithi027 bash[22610]: cluster 2024-08-31T08:28:00.747069+0000 mgr.a (mgr.14388) 16290 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:28:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:01 smithi191 bash[24992]: cluster 2024-08-31T08:28:00.747069+0000 mgr.a (mgr.14388) 16290 : cluster [DBG] pgmap v11294: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:28:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:02 smithi163 bash[24253]: audit 2024-08-31T08:28:02.267253+0000 mon.a (mon.0) 3007 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:28:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:02 smithi027 bash[22610]: audit 2024-08-31T08:28:02.267253+0000 mon.a (mon.0) 3007 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:28:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:02 smithi191 bash[24992]: audit 2024-08-31T08:28:02.267253+0000 mon.a (mon.0) 3007 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:28:04.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:28:04.197 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:28:04.197 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:28:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:03 smithi163 bash[24253]: cluster 2024-08-31T08:28:02.747631+0000 mgr.a (mgr.14388) 16291 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:28:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:03 smithi163 bash[24253]: audit 2024-08-31T08:28:03.108623+0000 mon.a (mon.0) 3008 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:28:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:03 smithi163 bash[24253]: audit 2024-08-31T08:28:03.110234+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:28:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:03 smithi163 bash[24253]: audit 2024-08-31T08:28:03.120791+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:28:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:03 smithi163 bash[24253]: audit 2024-08-31T08:28:03.123847+0000 mon.a (mon.0) 3011 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:28:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:03 smithi027 bash[22610]: cluster 2024-08-31T08:28:02.747631+0000 mgr.a (mgr.14388) 16291 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:28:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:03 smithi027 bash[22610]: audit 2024-08-31T08:28:03.108623+0000 mon.a (mon.0) 3008 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:28:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:03 smithi027 bash[22610]: audit 2024-08-31T08:28:03.110234+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:28:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:03 smithi027 bash[22610]: audit 2024-08-31T08:28:03.120791+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:28:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:03 smithi027 bash[22610]: audit 2024-08-31T08:28:03.123847+0000 mon.a (mon.0) 3011 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:28:04.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:28:03 smithi027 bash[22863]: debug 2024-08-31T08:28:03.861+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:28:04.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:28:03 smithi027 bash[22863]: debug 2024-08-31T08:28:03.865+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:28:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:03 smithi191 bash[24992]: cluster 2024-08-31T08:28:02.747631+0000 mgr.a (mgr.14388) 16291 : cluster [DBG] pgmap v11295: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:28:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:03 smithi191 bash[24992]: audit 2024-08-31T08:28:03.108623+0000 mon.a (mon.0) 3008 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:28:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:03 smithi191 bash[24992]: audit 2024-08-31T08:28:03.110234+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:28:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:03 smithi191 bash[24992]: audit 2024-08-31T08:28:03.120791+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:28:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:03 smithi191 bash[24992]: audit 2024-08-31T08:28:03.123847+0000 mon.a (mon.0) 3011 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:28:04.938 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:04.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:28:04.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:28:04.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:28:04.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:28:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:04 smithi027 bash[22610]: audit 2024-08-31T08:28:03.126093+0000 mgr.a (mgr.14388) 16292 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:28:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:04 smithi027 bash[22610]: audit 2024-08-31T08:28:03.866365+0000 mgr.a (mgr.14388) 16293 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:28:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:04 smithi027 bash[22610]: cephadm 2024-08-31T08:28:03.867573+0000 mgr.a (mgr.14388) 16294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:28:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:04 smithi191 bash[24992]: audit 2024-08-31T08:28:03.126093+0000 mgr.a (mgr.14388) 16292 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:28:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:04 smithi191 bash[24992]: audit 2024-08-31T08:28:03.866365+0000 mgr.a (mgr.14388) 16293 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:28:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:04 smithi191 bash[24992]: cephadm 2024-08-31T08:28:03.867573+0000 mgr.a (mgr.14388) 16294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:28:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:04 smithi163 bash[24253]: audit 2024-08-31T08:28:03.126093+0000 mgr.a (mgr.14388) 16292 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:28:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:04 smithi163 bash[24253]: audit 2024-08-31T08:28:03.866365+0000 mgr.a (mgr.14388) 16293 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:28:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:04 smithi163 bash[24253]: cephadm 2024-08-31T08:28:03.867573+0000 mgr.a (mgr.14388) 16294 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:28:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:05 smithi027 bash[22610]: audit 2024-08-31T08:28:04.524249+0000 mgr.a (mgr.14388) 16295 : audit [DBG] from='client.352200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:05 smithi027 bash[22610]: cluster 2024-08-31T08:28:04.749408+0000 mgr.a (mgr.14388) 16296 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:05 smithi191 bash[24992]: audit 2024-08-31T08:28:04.524249+0000 mgr.a (mgr.14388) 16295 : audit [DBG] from='client.352200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:05 smithi191 bash[24992]: cluster 2024-08-31T08:28:04.749408+0000 mgr.a (mgr.14388) 16296 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:05 smithi163 bash[24253]: audit 2024-08-31T08:28:04.524249+0000 mgr.a (mgr.14388) 16295 : audit [DBG] from='client.352200 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:05 smithi163 bash[24253]: cluster 2024-08-31T08:28:04.749408+0000 mgr.a (mgr.14388) 16296 : cluster [DBG] pgmap v11296: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:07 smithi027 bash[22610]: cluster 2024-08-31T08:28:06.750295+0000 mgr.a (mgr.14388) 16297 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:07 smithi191 bash[24992]: cluster 2024-08-31T08:28:06.750295+0000 mgr.a (mgr.14388) 16297 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:07 smithi163 bash[24253]: cluster 2024-08-31T08:28:06.750295+0000 mgr.a (mgr.14388) 16297 : cluster [DBG] pgmap v11297: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:09.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:28:09.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:28:09.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:28:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:09 smithi027 bash[22610]: cluster 2024-08-31T08:28:08.752570+0000 mgr.a (mgr.14388) 16298 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:09 smithi191 bash[24992]: cluster 2024-08-31T08:28:08.752570+0000 mgr.a (mgr.14388) 16298 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:09 smithi163 bash[24253]: cluster 2024-08-31T08:28:08.752570+0000 mgr.a (mgr.14388) 16298 : cluster [DBG] pgmap v11298: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:10.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:28:10.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:28:10.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:28:10.710 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:28:10.710 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:11 smithi027 bash[22610]: audit 2024-08-31T08:28:10.275337+0000 mgr.a (mgr.14388) 16299 : audit [DBG] from='client.352278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:11 smithi027 bash[22610]: cluster 2024-08-31T08:28:10.753197+0000 mgr.a (mgr.14388) 16300 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:11 smithi191 bash[24992]: audit 2024-08-31T08:28:10.275337+0000 mgr.a (mgr.14388) 16299 : audit [DBG] from='client.352278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:11 smithi191 bash[24992]: cluster 2024-08-31T08:28:10.753197+0000 mgr.a (mgr.14388) 16300 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:11 smithi163 bash[24253]: audit 2024-08-31T08:28:10.275337+0000 mgr.a (mgr.14388) 16299 : audit [DBG] from='client.352278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:11 smithi163 bash[24253]: cluster 2024-08-31T08:28:10.753197+0000 mgr.a (mgr.14388) 16300 : cluster [DBG] pgmap v11299: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:13 smithi027 bash[22610]: cluster 2024-08-31T08:28:12.754015+0000 mgr.a (mgr.14388) 16301 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:13 smithi191 bash[24992]: cluster 2024-08-31T08:28:12.754015+0000 mgr.a (mgr.14388) 16301 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:13 smithi163 bash[24253]: cluster 2024-08-31T08:28:12.754015+0000 mgr.a (mgr.14388) 16301 : cluster [DBG] pgmap v11300: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:15.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:28:15.712 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:28:15.712 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:28:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:15 smithi027 bash[22610]: cluster 2024-08-31T08:28:14.756217+0000 mgr.a (mgr.14388) 16302 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:15 smithi191 bash[24992]: cluster 2024-08-31T08:28:14.756217+0000 mgr.a (mgr.14388) 16302 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:15 smithi163 bash[24253]: cluster 2024-08-31T08:28:14.756217+0000 mgr.a (mgr.14388) 16302 : cluster [DBG] pgmap v11301: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:16.495 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:16.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:28:16.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:28:16.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:28:16.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:28:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:17 smithi027 bash[22610]: audit 2024-08-31T08:28:16.046261+0000 mgr.a (mgr.14388) 16303 : audit [DBG] from='client.352356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:17 smithi027 bash[22610]: cluster 2024-08-31T08:28:16.757210+0000 mgr.a (mgr.14388) 16304 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:17 smithi191 bash[24992]: audit 2024-08-31T08:28:16.046261+0000 mgr.a (mgr.14388) 16303 : audit [DBG] from='client.352356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:17 smithi191 bash[24992]: cluster 2024-08-31T08:28:16.757210+0000 mgr.a (mgr.14388) 16304 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:17 smithi163 bash[24253]: audit 2024-08-31T08:28:16.046261+0000 mgr.a (mgr.14388) 16303 : audit [DBG] from='client.352356 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:17 smithi163 bash[24253]: cluster 2024-08-31T08:28:16.757210+0000 mgr.a (mgr.14388) 16304 : cluster [DBG] pgmap v11302: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:19 smithi191 bash[24992]: cluster 2024-08-31T08:28:18.759524+0000 mgr.a (mgr.14388) 16305 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:19 smithi163 bash[24253]: cluster 2024-08-31T08:28:18.759524+0000 mgr.a (mgr.14388) 16305 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:19 smithi027 bash[22610]: cluster 2024-08-31T08:28:18.759524+0000 mgr.a (mgr.14388) 16305 : cluster [DBG] pgmap v11303: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:28:21.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:28:21.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:28:21.498 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:28:22.242 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:22.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:28:22.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:28:22.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:28:22.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:28:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:21 smithi191 bash[24992]: cluster 2024-08-31T08:28:20.760412+0000 mgr.a (mgr.14388) 16306 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:21 smithi163 bash[24253]: cluster 2024-08-31T08:28:20.760412+0000 mgr.a (mgr.14388) 16306 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:21 smithi027 bash[22610]: cluster 2024-08-31T08:28:20.760412+0000 mgr.a (mgr.14388) 16306 : cluster [DBG] pgmap v11304: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:22 smithi191 bash[24992]: audit 2024-08-31T08:28:21.829924+0000 mgr.a (mgr.14388) 16307 : audit [DBG] from='client.352431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:22 smithi163 bash[24253]: audit 2024-08-31T08:28:21.829924+0000 mgr.a (mgr.14388) 16307 : audit [DBG] from='client.352431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:22 smithi027 bash[22610]: audit 2024-08-31T08:28:21.829924+0000 mgr.a (mgr.14388) 16307 : audit [DBG] from='client.352431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:23 smithi191 bash[24992]: cluster 2024-08-31T08:28:22.761340+0000 mgr.a (mgr.14388) 16308 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:23 smithi163 bash[24253]: cluster 2024-08-31T08:28:22.761340+0000 mgr.a (mgr.14388) 16308 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:23 smithi027 bash[22610]: cluster 2024-08-31T08:28:22.761340+0000 mgr.a (mgr.14388) 16308 : cluster [DBG] pgmap v11305: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:25 smithi191 bash[24992]: cluster 2024-08-31T08:28:24.763598+0000 mgr.a (mgr.14388) 16309 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:28:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:25 smithi163 bash[24253]: cluster 2024-08-31T08:28:24.763598+0000 mgr.a (mgr.14388) 16309 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:28:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:25 smithi027 bash[22610]: cluster 2024-08-31T08:28:24.763598+0000 mgr.a (mgr.14388) 16309 : cluster [DBG] pgmap v11306: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:28:27.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:28:27.245 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:28:27.245 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:28:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:27 smithi163 bash[24253]: cluster 2024-08-31T08:28:26.764368+0000 mgr.a (mgr.14388) 16310 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:27 smithi027 bash[22610]: cluster 2024-08-31T08:28:26.764368+0000 mgr.a (mgr.14388) 16310 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:27 smithi191 bash[24992]: cluster 2024-08-31T08:28:26.764368+0000 mgr.a (mgr.14388) 16310 : cluster [DBG] pgmap v11307: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:28.027 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:28:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:28:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:28:28.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:28:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:28 smithi163 bash[24253]: audit 2024-08-31T08:28:27.578249+0000 mgr.a (mgr.14388) 16311 : audit [DBG] from='client.352509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:28.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:28 smithi027 bash[22610]: audit 2024-08-31T08:28:27.578249+0000 mgr.a (mgr.14388) 16311 : audit [DBG] from='client.352509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:28 smithi191 bash[24992]: audit 2024-08-31T08:28:27.578249+0000 mgr.a (mgr.14388) 16311 : audit [DBG] from='client.352509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:29 smithi163 bash[24253]: cluster 2024-08-31T08:28:28.767190+0000 mgr.a (mgr.14388) 16312 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:28:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:29 smithi027 bash[22610]: cluster 2024-08-31T08:28:28.767190+0000 mgr.a (mgr.14388) 16312 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:28:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:29 smithi191 bash[24992]: cluster 2024-08-31T08:28:28.767190+0000 mgr.a (mgr.14388) 16312 : cluster [DBG] pgmap v11308: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:28:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:31 smithi163 bash[24253]: cluster 2024-08-31T08:28:30.767970+0000 mgr.a (mgr.14388) 16313 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:28:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:31 smithi027 bash[22610]: cluster 2024-08-31T08:28:30.767970+0000 mgr.a (mgr.14388) 16313 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:28:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:31 smithi191 bash[24992]: cluster 2024-08-31T08:28:30.767970+0000 mgr.a (mgr.14388) 16313 : cluster [DBG] pgmap v11309: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:28:33.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:28:33.030 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:28:33.030 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:28:33.800 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:33.801 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:28:33.801 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:28:33.801 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:28:33.801 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:28:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:33 smithi163 bash[24253]: cluster 2024-08-31T08:28:32.768743+0000 mgr.a (mgr.14388) 16314 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:28:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:33 smithi027 bash[22610]: cluster 2024-08-31T08:28:32.768743+0000 mgr.a (mgr.14388) 16314 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:28:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:33 smithi191 bash[24992]: cluster 2024-08-31T08:28:32.768743+0000 mgr.a (mgr.14388) 16314 : cluster [DBG] pgmap v11310: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:28:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:34 smithi163 bash[24253]: audit 2024-08-31T08:28:33.364328+0000 mgr.a (mgr.14388) 16315 : audit [DBG] from='client.352587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:34 smithi027 bash[22610]: audit 2024-08-31T08:28:33.364328+0000 mgr.a (mgr.14388) 16315 : audit [DBG] from='client.352587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:35.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:34 smithi191 bash[24992]: audit 2024-08-31T08:28:33.364328+0000 mgr.a (mgr.14388) 16315 : audit [DBG] from='client.352587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:35 smithi163 bash[24253]: cluster 2024-08-31T08:28:34.771473+0000 mgr.a (mgr.14388) 16316 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:35 smithi027 bash[22610]: cluster 2024-08-31T08:28:34.771473+0000 mgr.a (mgr.14388) 16316 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:35 smithi191 bash[24992]: cluster 2024-08-31T08:28:34.771473+0000 mgr.a (mgr.14388) 16316 : cluster [DBG] pgmap v11311: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:37 smithi163 bash[24253]: cluster 2024-08-31T08:28:36.772210+0000 mgr.a (mgr.14388) 16317 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:28:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:37 smithi027 bash[22610]: cluster 2024-08-31T08:28:36.772210+0000 mgr.a (mgr.14388) 16317 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:28:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:37 smithi191 bash[24992]: cluster 2024-08-31T08:28:36.772210+0000 mgr.a (mgr.14388) 16317 : cluster [DBG] pgmap v11312: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:28:38.802 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:28:38.802 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:28:38.802 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:28:39.554 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:39.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:28:39.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:28:39.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:28:39.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:28:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:39 smithi163 bash[24253]: cluster 2024-08-31T08:28:38.774242+0000 mgr.a (mgr.14388) 16318 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:39 smithi027 bash[22610]: cluster 2024-08-31T08:28:38.774242+0000 mgr.a (mgr.14388) 16318 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:39 smithi191 bash[24992]: cluster 2024-08-31T08:28:38.774242+0000 mgr.a (mgr.14388) 16318 : cluster [DBG] pgmap v11313: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:40 smithi163 bash[24253]: audit 2024-08-31T08:28:39.139564+0000 mgr.a (mgr.14388) 16319 : audit [DBG] from='client.352662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:40 smithi027 bash[22610]: audit 2024-08-31T08:28:39.139564+0000 mgr.a (mgr.14388) 16319 : audit [DBG] from='client.352662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:40 smithi191 bash[24992]: audit 2024-08-31T08:28:39.139564+0000 mgr.a (mgr.14388) 16319 : audit [DBG] from='client.352662 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:41 smithi163 bash[24253]: cluster 2024-08-31T08:28:40.775135+0000 mgr.a (mgr.14388) 16320 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:28:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:41 smithi027 bash[22610]: cluster 2024-08-31T08:28:40.775135+0000 mgr.a (mgr.14388) 16320 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:28:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:41 smithi191 bash[24992]: cluster 2024-08-31T08:28:40.775135+0000 mgr.a (mgr.14388) 16320 : cluster [DBG] pgmap v11314: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:28:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:43 smithi163 bash[24253]: cluster 2024-08-31T08:28:42.775907+0000 mgr.a (mgr.14388) 16321 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:28:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:43 smithi027 bash[22610]: cluster 2024-08-31T08:28:42.775907+0000 mgr.a (mgr.14388) 16321 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:28:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:43 smithi191 bash[24992]: cluster 2024-08-31T08:28:42.775907+0000 mgr.a (mgr.14388) 16321 : cluster [DBG] pgmap v11315: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:28:44.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:28:44.557 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:28:44.557 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:28:45.331 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:28:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:28:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:28:45.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:28:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:45 smithi163 bash[24253]: cluster 2024-08-31T08:28:44.778081+0000 mgr.a (mgr.14388) 16322 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:28:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:45 smithi163 bash[24253]: audit 2024-08-31T08:28:44.895195+0000 mgr.a (mgr.14388) 16323 : audit [DBG] from='client.352734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:45 smithi027 bash[22610]: cluster 2024-08-31T08:28:44.778081+0000 mgr.a (mgr.14388) 16322 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:28:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:45 smithi027 bash[22610]: audit 2024-08-31T08:28:44.895195+0000 mgr.a (mgr.14388) 16323 : audit [DBG] from='client.352734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:45 smithi191 bash[24992]: cluster 2024-08-31T08:28:44.778081+0000 mgr.a (mgr.14388) 16322 : cluster [DBG] pgmap v11316: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:28:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:45 smithi191 bash[24992]: audit 2024-08-31T08:28:44.895195+0000 mgr.a (mgr.14388) 16323 : audit [DBG] from='client.352734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:47 smithi163 bash[24253]: cluster 2024-08-31T08:28:46.779159+0000 mgr.a (mgr.14388) 16324 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:47 smithi027 bash[22610]: cluster 2024-08-31T08:28:46.779159+0000 mgr.a (mgr.14388) 16324 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:47 smithi191 bash[24992]: cluster 2024-08-31T08:28:46.779159+0000 mgr.a (mgr.14388) 16324 : cluster [DBG] pgmap v11317: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:50.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:49 smithi163 bash[24253]: cluster 2024-08-31T08:28:48.781559+0000 mgr.a (mgr.14388) 16325 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:28:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:49 smithi027 bash[22610]: cluster 2024-08-31T08:28:48.781559+0000 mgr.a (mgr.14388) 16325 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:28:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:49 smithi191 bash[24992]: cluster 2024-08-31T08:28:48.781559+0000 mgr.a (mgr.14388) 16325 : cluster [DBG] pgmap v11318: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:28:50.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:28:50.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:28:50.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:28:51.115 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:51.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:28:51.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:28:51.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:28:51.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:28:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:51 smithi163 bash[24253]: audit 2024-08-31T08:28:50.670351+0000 mgr.a (mgr.14388) 16326 : audit [DBG] from='client.352812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:52.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:51 smithi163 bash[24253]: cluster 2024-08-31T08:28:50.782115+0000 mgr.a (mgr.14388) 16327 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:51 smithi027 bash[22610]: audit 2024-08-31T08:28:50.670351+0000 mgr.a (mgr.14388) 16326 : audit [DBG] from='client.352812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:52.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:51 smithi027 bash[22610]: cluster 2024-08-31T08:28:50.782115+0000 mgr.a (mgr.14388) 16327 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:51 smithi191 bash[24992]: audit 2024-08-31T08:28:50.670351+0000 mgr.a (mgr.14388) 16326 : audit [DBG] from='client.352812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:51 smithi191 bash[24992]: cluster 2024-08-31T08:28:50.782115+0000 mgr.a (mgr.14388) 16327 : cluster [DBG] pgmap v11319: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:53 smithi163 bash[24253]: cluster 2024-08-31T08:28:52.783147+0000 mgr.a (mgr.14388) 16328 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:53 smithi027 bash[22610]: cluster 2024-08-31T08:28:52.783147+0000 mgr.a (mgr.14388) 16328 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:53 smithi191 bash[24992]: cluster 2024-08-31T08:28:52.783147+0000 mgr.a (mgr.14388) 16328 : cluster [DBG] pgmap v11320: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:56.116 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:28:56.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:28:56.117 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:28:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:55 smithi163 bash[24253]: cluster 2024-08-31T08:28:54.785541+0000 mgr.a (mgr.14388) 16329 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:28:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:55 smithi027 bash[22610]: cluster 2024-08-31T08:28:54.785541+0000 mgr.a (mgr.14388) 16329 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:28:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:55 smithi191 bash[24992]: cluster 2024-08-31T08:28:54.785541+0000 mgr.a (mgr.14388) 16329 : cluster [DBG] pgmap v11321: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:28:56.901 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:28:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:28:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:28:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:28:56.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:28:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:57 smithi163 bash[24253]: audit 2024-08-31T08:28:56.452383+0000 mgr.a (mgr.14388) 16330 : audit [DBG] from='client.352890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:57 smithi163 bash[24253]: cluster 2024-08-31T08:28:56.786175+0000 mgr.a (mgr.14388) 16331 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:57 smithi027 bash[22610]: audit 2024-08-31T08:28:56.452383+0000 mgr.a (mgr.14388) 16330 : audit [DBG] from='client.352890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:57 smithi027 bash[22610]: cluster 2024-08-31T08:28:56.786175+0000 mgr.a (mgr.14388) 16331 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:28:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:57 smithi191 bash[24992]: audit 2024-08-31T08:28:56.452383+0000 mgr.a (mgr.14388) 16330 : audit [DBG] from='client.352890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:28:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:57 smithi191 bash[24992]: cluster 2024-08-31T08:28:56.786175+0000 mgr.a (mgr.14388) 16331 : cluster [DBG] pgmap v11322: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:28:59 smithi163 bash[24253]: cluster 2024-08-31T08:28:58.788636+0000 mgr.a (mgr.14388) 16332 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:28:59 smithi027 bash[22610]: cluster 2024-08-31T08:28:58.788636+0000 mgr.a (mgr.14388) 16332 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:28:59 smithi191 bash[24992]: cluster 2024-08-31T08:28:58.788636+0000 mgr.a (mgr.14388) 16332 : cluster [DBG] pgmap v11323: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:01.903 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:29:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:01 smithi163 bash[24253]: cluster 2024-08-31T08:29:00.789596+0000 mgr.a (mgr.14388) 16333 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:01 smithi027 bash[22610]: cluster 2024-08-31T08:29:00.789596+0000 mgr.a (mgr.14388) 16333 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:01 smithi191 bash[24992]: cluster 2024-08-31T08:29:00.789596+0000 mgr.a (mgr.14388) 16333 : cluster [DBG] pgmap v11324: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:02.678 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:29:02.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:29:02.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:29:02.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:29:02.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:29:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:03 smithi163 bash[24253]: audit 2024-08-31T08:29:02.239063+0000 mgr.a (mgr.14388) 16334 : audit [DBG] from='client.352968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:04.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:03 smithi163 bash[24253]: cluster 2024-08-31T08:29:02.790510+0000 mgr.a (mgr.14388) 16335 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:03 smithi027 bash[22610]: audit 2024-08-31T08:29:02.239063+0000 mgr.a (mgr.14388) 16334 : audit [DBG] from='client.352968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:04.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:03 smithi027 bash[22610]: cluster 2024-08-31T08:29:02.790510+0000 mgr.a (mgr.14388) 16335 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:03 smithi191 bash[24992]: audit 2024-08-31T08:29:02.239063+0000 mgr.a (mgr.14388) 16334 : audit [DBG] from='client.352968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:03 smithi191 bash[24992]: cluster 2024-08-31T08:29:02.790510+0000 mgr.a (mgr.14388) 16335 : cluster [DBG] pgmap v11325: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:04 smithi163 bash[24253]: audit 2024-08-31T08:29:03.917677+0000 mon.a (mon.0) 3012 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:29:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:04 smithi163 bash[24253]: audit 2024-08-31T08:29:04.752546+0000 mon.a (mon.0) 3013 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:29:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:04 smithi163 bash[24253]: audit 2024-08-31T08:29:04.754367+0000 mon.a (mon.0) 3014 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:29:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:04 smithi163 bash[24253]: audit 2024-08-31T08:29:04.764884+0000 mon.a (mon.0) 3015 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:29:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:04 smithi163 bash[24253]: audit 2024-08-31T08:29:04.769915+0000 mon.a (mon.0) 3016 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:29:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:04 smithi027 bash[22610]: audit 2024-08-31T08:29:03.917677+0000 mon.a (mon.0) 3012 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:29:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:04 smithi027 bash[22610]: audit 2024-08-31T08:29:04.752546+0000 mon.a (mon.0) 3013 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:29:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:04 smithi027 bash[22610]: audit 2024-08-31T08:29:04.754367+0000 mon.a (mon.0) 3014 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:29:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:04 smithi027 bash[22610]: audit 2024-08-31T08:29:04.764884+0000 mon.a (mon.0) 3015 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:29:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:04 smithi027 bash[22610]: audit 2024-08-31T08:29:04.769915+0000 mon.a (mon.0) 3016 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:29:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:04 smithi191 bash[24992]: audit 2024-08-31T08:29:03.917677+0000 mon.a (mon.0) 3012 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:29:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:04 smithi191 bash[24992]: audit 2024-08-31T08:29:04.752546+0000 mon.a (mon.0) 3013 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:29:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:04 smithi191 bash[24992]: audit 2024-08-31T08:29:04.754367+0000 mon.a (mon.0) 3014 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:29:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:04 smithi191 bash[24992]: audit 2024-08-31T08:29:04.764884+0000 mon.a (mon.0) 3015 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:29:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:04 smithi191 bash[24992]: audit 2024-08-31T08:29:04.769915+0000 mon.a (mon.0) 3016 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:29:05.910 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:29:05 smithi027 bash[22863]: debug 2024-08-31T08:29:05.503+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:29:05.910 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:29:05 smithi027 bash[22863]: debug 2024-08-31T08:29:05.507+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:29:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:05 smithi163 bash[24253]: audit 2024-08-31T08:29:04.771362+0000 mgr.a (mgr.14388) 16336 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:29:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:05 smithi163 bash[24253]: cluster 2024-08-31T08:29:04.793910+0000 mgr.a (mgr.14388) 16337 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:05 smithi027 bash[22610]: audit 2024-08-31T08:29:04.771362+0000 mgr.a (mgr.14388) 16336 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:29:06.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:05 smithi027 bash[22610]: cluster 2024-08-31T08:29:04.793910+0000 mgr.a (mgr.14388) 16337 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:05 smithi191 bash[24992]: audit 2024-08-31T08:29:04.771362+0000 mgr.a (mgr.14388) 16336 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:29:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:05 smithi191 bash[24992]: cluster 2024-08-31T08:29:04.793910+0000 mgr.a (mgr.14388) 16337 : cluster [DBG] pgmap v11326: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:06 smithi163 bash[24253]: audit 2024-08-31T08:29:05.510250+0000 mgr.a (mgr.14388) 16338 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:29:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:06 smithi163 bash[24253]: cephadm 2024-08-31T08:29:05.511513+0000 mgr.a (mgr.14388) 16339 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:29:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:06 smithi027 bash[22610]: audit 2024-08-31T08:29:05.510250+0000 mgr.a (mgr.14388) 16338 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:29:07.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:06 smithi027 bash[22610]: cephadm 2024-08-31T08:29:05.511513+0000 mgr.a (mgr.14388) 16339 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:29:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:06 smithi191 bash[24992]: audit 2024-08-31T08:29:05.510250+0000 mgr.a (mgr.14388) 16338 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:29:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:06 smithi191 bash[24992]: cephadm 2024-08-31T08:29:05.511513+0000 mgr.a (mgr.14388) 16339 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:29:07.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:07.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:07.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:29:08.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:07 smithi163 bash[24253]: cluster 2024-08-31T08:29:06.795014+0000 mgr.a (mgr.14388) 16340 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:07 smithi027 bash[22610]: cluster 2024-08-31T08:29:06.795014+0000 mgr.a (mgr.14388) 16340 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:07 smithi191 bash[24992]: cluster 2024-08-31T08:29:06.795014+0000 mgr.a (mgr.14388) 16340 : cluster [DBG] pgmap v11327: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:08.468 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:29:08.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:29:08.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:29:08.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:29:08.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:29:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:09 smithi163 bash[24253]: audit 2024-08-31T08:29:08.021226+0000 mgr.a (mgr.14388) 16341 : audit [DBG] from='client.353148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:10.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:09 smithi163 bash[24253]: cluster 2024-08-31T08:29:08.797872+0000 mgr.a (mgr.14388) 16342 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:29:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:09 smithi027 bash[22610]: audit 2024-08-31T08:29:08.021226+0000 mgr.a (mgr.14388) 16341 : audit [DBG] from='client.353148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:09 smithi027 bash[22610]: cluster 2024-08-31T08:29:08.797872+0000 mgr.a (mgr.14388) 16342 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:29:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:09 smithi191 bash[24992]: audit 2024-08-31T08:29:08.021226+0000 mgr.a (mgr.14388) 16341 : audit [DBG] from='client.353148 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:09 smithi191 bash[24992]: cluster 2024-08-31T08:29:08.797872+0000 mgr.a (mgr.14388) 16342 : cluster [DBG] pgmap v11328: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:29:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:11 smithi163 bash[24253]: cluster 2024-08-31T08:29:10.798757+0000 mgr.a (mgr.14388) 16343 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:29:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:11 smithi027 bash[22610]: cluster 2024-08-31T08:29:10.798757+0000 mgr.a (mgr.14388) 16343 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:29:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:11 smithi191 bash[24992]: cluster 2024-08-31T08:29:10.798757+0000 mgr.a (mgr.14388) 16343 : cluster [DBG] pgmap v11329: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:29:13.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:13.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:13.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:29:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:13 smithi163 bash[24253]: cluster 2024-08-31T08:29:12.799429+0000 mgr.a (mgr.14388) 16344 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:29:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:13 smithi027 bash[22610]: cluster 2024-08-31T08:29:12.799429+0000 mgr.a (mgr.14388) 16344 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:29:14.258 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:29:14.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:29:14.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:29:14.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:29:14.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:29:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:13 smithi191 bash[24992]: cluster 2024-08-31T08:29:12.799429+0000 mgr.a (mgr.14388) 16344 : cluster [DBG] pgmap v11330: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:29:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:14 smithi163 bash[24253]: audit 2024-08-31T08:29:13.810567+0000 mgr.a (mgr.14388) 16345 : audit [DBG] from='client.353223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:14 smithi027 bash[22610]: audit 2024-08-31T08:29:13.810567+0000 mgr.a (mgr.14388) 16345 : audit [DBG] from='client.353223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:14 smithi191 bash[24992]: audit 2024-08-31T08:29:13.810567+0000 mgr.a (mgr.14388) 16345 : audit [DBG] from='client.353223 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:15 smithi163 bash[24253]: cluster 2024-08-31T08:29:14.802266+0000 mgr.a (mgr.14388) 16346 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:29:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:15 smithi027 bash[22610]: cluster 2024-08-31T08:29:14.802266+0000 mgr.a (mgr.14388) 16346 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:29:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:15 smithi191 bash[24992]: cluster 2024-08-31T08:29:14.802266+0000 mgr.a (mgr.14388) 16346 : cluster [DBG] pgmap v11331: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:29:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:17 smithi163 bash[24253]: cluster 2024-08-31T08:29:16.803266+0000 mgr.a (mgr.14388) 16347 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:29:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:17 smithi027 bash[22610]: cluster 2024-08-31T08:29:16.803266+0000 mgr.a (mgr.14388) 16347 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:29:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:17 smithi191 bash[24992]: cluster 2024-08-31T08:29:16.803266+0000 mgr.a (mgr.14388) 16347 : cluster [DBG] pgmap v11332: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:29:19.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:19.261 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:19.261 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:29:20.053 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:29:20.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:29:20.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:29:20.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:29:20.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:29:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:19 smithi163 bash[24253]: cluster 2024-08-31T08:29:18.805426+0000 mgr.a (mgr.14388) 16348 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:29:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:19 smithi027 bash[22610]: cluster 2024-08-31T08:29:18.805426+0000 mgr.a (mgr.14388) 16348 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:29:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:19 smithi191 bash[24992]: cluster 2024-08-31T08:29:18.805426+0000 mgr.a (mgr.14388) 16348 : cluster [DBG] pgmap v11333: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:29:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:20 smithi163 bash[24253]: audit 2024-08-31T08:29:19.595696+0000 mgr.a (mgr.14388) 16349 : audit [DBG] from='client.353298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:20 smithi027 bash[22610]: audit 2024-08-31T08:29:19.595696+0000 mgr.a (mgr.14388) 16349 : audit [DBG] from='client.353298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:20 smithi191 bash[24992]: audit 2024-08-31T08:29:19.595696+0000 mgr.a (mgr.14388) 16349 : audit [DBG] from='client.353298 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:21 smithi163 bash[24253]: cluster 2024-08-31T08:29:20.806281+0000 mgr.a (mgr.14388) 16350 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:21 smithi027 bash[22610]: cluster 2024-08-31T08:29:20.806281+0000 mgr.a (mgr.14388) 16350 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:21 smithi191 bash[24992]: cluster 2024-08-31T08:29:20.806281+0000 mgr.a (mgr.14388) 16350 : cluster [DBG] pgmap v11334: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:23 smithi163 bash[24253]: cluster 2024-08-31T08:29:22.807096+0000 mgr.a (mgr.14388) 16351 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:23 smithi027 bash[22610]: cluster 2024-08-31T08:29:22.807096+0000 mgr.a (mgr.14388) 16351 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:23 smithi191 bash[24992]: cluster 2024-08-31T08:29:22.807096+0000 mgr.a (mgr.14388) 16351 : cluster [DBG] pgmap v11335: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:25.054 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:25.055 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:25.055 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:29:25.831 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:29:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:29:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:29:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:29:25.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:29:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:25 smithi163 bash[24253]: cluster 2024-08-31T08:29:24.809325+0000 mgr.a (mgr.14388) 16352 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:25 smithi027 bash[22610]: cluster 2024-08-31T08:29:24.809325+0000 mgr.a (mgr.14388) 16352 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:25 smithi191 bash[24992]: cluster 2024-08-31T08:29:24.809325+0000 mgr.a (mgr.14388) 16352 : cluster [DBG] pgmap v11336: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:26 smithi163 bash[24253]: audit 2024-08-31T08:29:25.389851+0000 mgr.a (mgr.14388) 16353 : audit [DBG] from='client.353376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:26 smithi027 bash[22610]: audit 2024-08-31T08:29:25.389851+0000 mgr.a (mgr.14388) 16353 : audit [DBG] from='client.353376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:26 smithi191 bash[24992]: audit 2024-08-31T08:29:25.389851+0000 mgr.a (mgr.14388) 16353 : audit [DBG] from='client.353376 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:27 smithi163 bash[24253]: cluster 2024-08-31T08:29:26.810325+0000 mgr.a (mgr.14388) 16354 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:27 smithi027 bash[22610]: cluster 2024-08-31T08:29:26.810325+0000 mgr.a (mgr.14388) 16354 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:27 smithi191 bash[24992]: cluster 2024-08-31T08:29:26.810325+0000 mgr.a (mgr.14388) 16354 : cluster [DBG] pgmap v11337: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:29 smithi163 bash[24253]: cluster 2024-08-31T08:29:28.812643+0000 mgr.a (mgr.14388) 16355 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:29 smithi027 bash[22610]: cluster 2024-08-31T08:29:28.812643+0000 mgr.a (mgr.14388) 16355 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:29 smithi191 bash[24992]: cluster 2024-08-31T08:29:28.812643+0000 mgr.a (mgr.14388) 16355 : cluster [DBG] pgmap v11338: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:30.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:30.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:30.834 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:29:31.613 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:29:31.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:29:31.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:29:31.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:29:31.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:29:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:31 smithi163 bash[24253]: cluster 2024-08-31T08:29:30.813420+0000 mgr.a (mgr.14388) 16356 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:31 smithi027 bash[22610]: cluster 2024-08-31T08:29:30.813420+0000 mgr.a (mgr.14388) 16356 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:31 smithi191 bash[24992]: cluster 2024-08-31T08:29:30.813420+0000 mgr.a (mgr.14388) 16356 : cluster [DBG] pgmap v11339: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:32 smithi163 bash[24253]: audit 2024-08-31T08:29:31.168274+0000 mgr.a (mgr.14388) 16357 : audit [DBG] from='client.353448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:32 smithi027 bash[22610]: audit 2024-08-31T08:29:31.168274+0000 mgr.a (mgr.14388) 16357 : audit [DBG] from='client.353448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:32 smithi191 bash[24992]: audit 2024-08-31T08:29:31.168274+0000 mgr.a (mgr.14388) 16357 : audit [DBG] from='client.353448 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:33 smithi163 bash[24253]: cluster 2024-08-31T08:29:32.814382+0000 mgr.a (mgr.14388) 16358 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:33 smithi027 bash[22610]: cluster 2024-08-31T08:29:32.814382+0000 mgr.a (mgr.14388) 16358 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:33 smithi191 bash[24992]: cluster 2024-08-31T08:29:32.814382+0000 mgr.a (mgr.14388) 16358 : cluster [DBG] pgmap v11340: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:35 smithi163 bash[24253]: cluster 2024-08-31T08:29:34.816670+0000 mgr.a (mgr.14388) 16359 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:35 smithi027 bash[22610]: cluster 2024-08-31T08:29:34.816670+0000 mgr.a (mgr.14388) 16359 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:35 smithi191 bash[24992]: cluster 2024-08-31T08:29:34.816670+0000 mgr.a (mgr.14388) 16359 : cluster [DBG] pgmap v11341: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:36.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:36.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:36.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:29:37.382 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:29:37.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:29:37.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:29:37.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:29:37.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:29:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:37 smithi163 bash[24253]: cluster 2024-08-31T08:29:36.817136+0000 mgr.a (mgr.14388) 16360 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:37 smithi163 bash[24253]: audit 2024-08-31T08:29:36.953133+0000 mgr.a (mgr.14388) 16361 : audit [DBG] from='client.353523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:37 smithi027 bash[22610]: cluster 2024-08-31T08:29:36.817136+0000 mgr.a (mgr.14388) 16360 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:37 smithi027 bash[22610]: audit 2024-08-31T08:29:36.953133+0000 mgr.a (mgr.14388) 16361 : audit [DBG] from='client.353523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:37 smithi191 bash[24992]: cluster 2024-08-31T08:29:36.817136+0000 mgr.a (mgr.14388) 16360 : cluster [DBG] pgmap v11342: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:37 smithi191 bash[24992]: audit 2024-08-31T08:29:36.953133+0000 mgr.a (mgr.14388) 16361 : audit [DBG] from='client.353523 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:39 smithi163 bash[24253]: cluster 2024-08-31T08:29:38.819545+0000 mgr.a (mgr.14388) 16362 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:39 smithi027 bash[22610]: cluster 2024-08-31T08:29:38.819545+0000 mgr.a (mgr.14388) 16362 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:39 smithi191 bash[24992]: cluster 2024-08-31T08:29:38.819545+0000 mgr.a (mgr.14388) 16362 : cluster [DBG] pgmap v11343: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:29:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:41 smithi163 bash[24253]: cluster 2024-08-31T08:29:40.820390+0000 mgr.a (mgr.14388) 16363 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:41 smithi027 bash[22610]: cluster 2024-08-31T08:29:40.820390+0000 mgr.a (mgr.14388) 16363 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:41 smithi191 bash[24992]: cluster 2024-08-31T08:29:40.820390+0000 mgr.a (mgr.14388) 16363 : cluster [DBG] pgmap v11344: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:42.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:42.384 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:42.384 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:29:43.155 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:29:43.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:29:43.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:29:43.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:29:43.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:29:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:43 smithi163 bash[24253]: audit 2024-08-31T08:29:42.719222+0000 mgr.a (mgr.14388) 16364 : audit [DBG] from='client.353601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:43 smithi163 bash[24253]: cluster 2024-08-31T08:29:42.821066+0000 mgr.a (mgr.14388) 16365 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:43 smithi027 bash[22610]: audit 2024-08-31T08:29:42.719222+0000 mgr.a (mgr.14388) 16364 : audit [DBG] from='client.353601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:44.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:43 smithi027 bash[22610]: cluster 2024-08-31T08:29:42.821066+0000 mgr.a (mgr.14388) 16365 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:43 smithi191 bash[24992]: audit 2024-08-31T08:29:42.719222+0000 mgr.a (mgr.14388) 16364 : audit [DBG] from='client.353601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:43 smithi191 bash[24992]: cluster 2024-08-31T08:29:42.821066+0000 mgr.a (mgr.14388) 16365 : cluster [DBG] pgmap v11345: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:45 smithi027 bash[22610]: cluster 2024-08-31T08:29:44.823994+0000 mgr.a (mgr.14388) 16366 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:45 smithi191 bash[24992]: cluster 2024-08-31T08:29:44.823994+0000 mgr.a (mgr.14388) 16366 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:45 smithi163 bash[24253]: cluster 2024-08-31T08:29:44.823994+0000 mgr.a (mgr.14388) 16366 : cluster [DBG] pgmap v11346: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:48.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:48.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:48.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:29:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:47 smithi027 bash[22610]: cluster 2024-08-31T08:29:46.824822+0000 mgr.a (mgr.14388) 16367 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:29:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:47 smithi191 bash[24992]: cluster 2024-08-31T08:29:46.824822+0000 mgr.a (mgr.14388) 16367 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:29:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:47 smithi163 bash[24253]: cluster 2024-08-31T08:29:46.824822+0000 mgr.a (mgr.14388) 16367 : cluster [DBG] pgmap v11347: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:29:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:29:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:29:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:29:48.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:29:48.940 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:29:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:49 smithi027 bash[22610]: audit 2024-08-31T08:29:48.492794+0000 mgr.a (mgr.14388) 16368 : audit [DBG] from='client.353679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:50.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:49 smithi027 bash[22610]: cluster 2024-08-31T08:29:48.826117+0000 mgr.a (mgr.14388) 16369 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:49 smithi191 bash[24992]: audit 2024-08-31T08:29:48.492794+0000 mgr.a (mgr.14388) 16368 : audit [DBG] from='client.353679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:49 smithi191 bash[24992]: cluster 2024-08-31T08:29:48.826117+0000 mgr.a (mgr.14388) 16369 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:49 smithi163 bash[24253]: audit 2024-08-31T08:29:48.492794+0000 mgr.a (mgr.14388) 16368 : audit [DBG] from='client.353679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:49 smithi163 bash[24253]: cluster 2024-08-31T08:29:48.826117+0000 mgr.a (mgr.14388) 16369 : cluster [DBG] pgmap v11348: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:51 smithi027 bash[22610]: cluster 2024-08-31T08:29:50.827004+0000 mgr.a (mgr.14388) 16370 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:29:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:51 smithi191 bash[24992]: cluster 2024-08-31T08:29:50.827004+0000 mgr.a (mgr.14388) 16370 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:29:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:51 smithi163 bash[24253]: cluster 2024-08-31T08:29:50.827004+0000 mgr.a (mgr.14388) 16370 : cluster [DBG] pgmap v11349: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:29:53.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:53.942 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:53.942 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:29:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:53 smithi027 bash[22610]: cluster 2024-08-31T08:29:52.827879+0000 mgr.a (mgr.14388) 16371 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:29:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:53 smithi191 bash[24992]: cluster 2024-08-31T08:29:52.827879+0000 mgr.a (mgr.14388) 16371 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:29:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:53 smithi163 bash[24253]: cluster 2024-08-31T08:29:52.827879+0000 mgr.a (mgr.14388) 16371 : cluster [DBG] pgmap v11350: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:29:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:29:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:29:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:29:54.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:29:54.697 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:29:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:55 smithi027 bash[22610]: audit 2024-08-31T08:29:54.276483+0000 mgr.a (mgr.14388) 16372 : audit [DBG] from='client.353754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:56.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:55 smithi027 bash[22610]: cluster 2024-08-31T08:29:54.830700+0000 mgr.a (mgr.14388) 16373 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:55 smithi191 bash[24992]: audit 2024-08-31T08:29:54.276483+0000 mgr.a (mgr.14388) 16372 : audit [DBG] from='client.353754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:55 smithi191 bash[24992]: cluster 2024-08-31T08:29:54.830700+0000 mgr.a (mgr.14388) 16373 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:55 smithi163 bash[24253]: audit 2024-08-31T08:29:54.276483+0000 mgr.a (mgr.14388) 16372 : audit [DBG] from='client.353754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:29:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:55 smithi163 bash[24253]: cluster 2024-08-31T08:29:54.830700+0000 mgr.a (mgr.14388) 16373 : cluster [DBG] pgmap v11351: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:58.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:57 smithi027 bash[22610]: cluster 2024-08-31T08:29:56.831510+0000 mgr.a (mgr.14388) 16374 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:57 smithi191 bash[24992]: cluster 2024-08-31T08:29:56.831510+0000 mgr.a (mgr.14388) 16374 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:57 smithi163 bash[24253]: cluster 2024-08-31T08:29:56.831510+0000 mgr.a (mgr.14388) 16374 : cluster [DBG] pgmap v11352: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:29:59.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:29:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:29:59.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:29:59 smithi027 bash[22610]: cluster 2024-08-31T08:29:58.833439+0000 mgr.a (mgr.14388) 16375 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:29:59 smithi191 bash[24992]: cluster 2024-08-31T08:29:58.833439+0000 mgr.a (mgr.14388) 16375 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:29:59 smithi163 bash[24253]: cluster 2024-08-31T08:29:58.833439+0000 mgr.a (mgr.14388) 16375 : cluster [DBG] pgmap v11353: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:00.456 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:00.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:00.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:00.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:00.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:00 smithi191 bash[24992]: cluster 2024-08-31T08:30:00.000138+0000 mon.a (mon.0) 3017 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:30:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:00 smithi163 bash[24253]: cluster 2024-08-31T08:30:00.000138+0000 mon.a (mon.0) 3017 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:30:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:00 smithi027 bash[22610]: cluster 2024-08-31T08:30:00.000138+0000 mon.a (mon.0) 3017 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:30:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:01 smithi191 bash[24992]: audit 2024-08-31T08:30:00.036290+0000 mgr.a (mgr.14388) 16376 : audit [DBG] from='client.353829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:01 smithi191 bash[24992]: cluster 2024-08-31T08:30:00.834375+0000 mgr.a (mgr.14388) 16377 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:01 smithi163 bash[24253]: audit 2024-08-31T08:30:00.036290+0000 mgr.a (mgr.14388) 16376 : audit [DBG] from='client.353829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:01 smithi163 bash[24253]: cluster 2024-08-31T08:30:00.834375+0000 mgr.a (mgr.14388) 16377 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:01 smithi027 bash[22610]: audit 2024-08-31T08:30:00.036290+0000 mgr.a (mgr.14388) 16376 : audit [DBG] from='client.353829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:02.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:01 smithi027 bash[22610]: cluster 2024-08-31T08:30:00.834375+0000 mgr.a (mgr.14388) 16377 : cluster [DBG] pgmap v11354: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:03 smithi191 bash[24992]: cluster 2024-08-31T08:30:02.835840+0000 mgr.a (mgr.14388) 16378 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:30:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:03 smithi163 bash[24253]: cluster 2024-08-31T08:30:02.835840+0000 mgr.a (mgr.14388) 16378 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:30:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:03 smithi027 bash[22610]: cluster 2024-08-31T08:30:02.835840+0000 mgr.a (mgr.14388) 16378 : cluster [DBG] pgmap v11355: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:30:05.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:30:05.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:30:05.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:06.214 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:06.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:06.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:06.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:06.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:06 smithi191 bash[24992]: cluster 2024-08-31T08:30:04.837506+0000 mgr.a (mgr.14388) 16379 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:06 smithi191 bash[24992]: audit 2024-08-31T08:30:05.562894+0000 mon.a (mon.0) 3018 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:30:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:06 smithi163 bash[24253]: cluster 2024-08-31T08:30:04.837506+0000 mgr.a (mgr.14388) 16379 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:06 smithi163 bash[24253]: audit 2024-08-31T08:30:05.562894+0000 mon.a (mon.0) 3018 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:30:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:06 smithi027 bash[22610]: cluster 2024-08-31T08:30:04.837506+0000 mgr.a (mgr.14388) 16379 : cluster [DBG] pgmap v11356: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:06 smithi027 bash[22610]: audit 2024-08-31T08:30:05.562894+0000 mon.a (mon.0) 3018 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:30:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:07 smithi191 bash[24992]: audit 2024-08-31T08:30:05.794240+0000 mgr.a (mgr.14388) 16380 : audit [DBG] from='client.353901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:07 smithi163 bash[24253]: audit 2024-08-31T08:30:05.794240+0000 mgr.a (mgr.14388) 16380 : audit [DBG] from='client.353901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:07 smithi027 bash[22610]: audit 2024-08-31T08:30:05.794240+0000 mgr.a (mgr.14388) 16380 : audit [DBG] from='client.353901 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:08 smithi191 bash[24992]: cluster 2024-08-31T08:30:06.838648+0000 mgr.a (mgr.14388) 16381 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:08 smithi163 bash[24253]: cluster 2024-08-31T08:30:06.838648+0000 mgr.a (mgr.14388) 16381 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:08 smithi027 bash[22610]: cluster 2024-08-31T08:30:06.838648+0000 mgr.a (mgr.14388) 16381 : cluster [DBG] pgmap v11357: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:10 smithi191 bash[24992]: cluster 2024-08-31T08:30:08.841128+0000 mgr.a (mgr.14388) 16382 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:10 smithi163 bash[24253]: cluster 2024-08-31T08:30:08.841128+0000 mgr.a (mgr.14388) 16382 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:10 smithi027 bash[22610]: cluster 2024-08-31T08:30:08.841128+0000 mgr.a (mgr.14388) 16382 : cluster [DBG] pgmap v11358: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:11.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:30:11.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:30:11.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:11.982 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:11.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:11.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:11.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:11.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: cluster 2024-08-31T08:30:10.841675+0000 mgr.a (mgr.14388) 16383 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: audit 2024-08-31T08:30:10.855674+0000 mon.a (mon.0) 3019 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: audit 2024-08-31T08:30:10.861032+0000 mon.a (mon.0) 3020 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: audit 2024-08-31T08:30:10.897372+0000 mon.a (mon.0) 3021 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: audit 2024-08-31T08:30:10.903474+0000 mon.a (mon.0) 3022 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: audit 2024-08-31T08:30:10.907041+0000 mon.a (mon.0) 3023 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: audit 2024-08-31T08:30:10.912419+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: audit 2024-08-31T08:30:11.615984+0000 mon.a (mon.0) 3025 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:30:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: audit 2024-08-31T08:30:11.617130+0000 mon.a (mon.0) 3026 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:30:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: audit 2024-08-31T08:30:11.623661+0000 mon.a (mon.0) 3027 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:11 smithi163 bash[24253]: audit 2024-08-31T08:30:11.626843+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:30:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: cluster 2024-08-31T08:30:10.841675+0000 mgr.a (mgr.14388) 16383 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: audit 2024-08-31T08:30:10.855674+0000 mon.a (mon.0) 3019 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: audit 2024-08-31T08:30:10.861032+0000 mon.a (mon.0) 3020 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: audit 2024-08-31T08:30:10.897372+0000 mon.a (mon.0) 3021 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: audit 2024-08-31T08:30:10.903474+0000 mon.a (mon.0) 3022 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: audit 2024-08-31T08:30:10.907041+0000 mon.a (mon.0) 3023 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: audit 2024-08-31T08:30:10.912419+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: audit 2024-08-31T08:30:11.615984+0000 mon.a (mon.0) 3025 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:30:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: audit 2024-08-31T08:30:11.617130+0000 mon.a (mon.0) 3026 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:30:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: audit 2024-08-31T08:30:11.623661+0000 mon.a (mon.0) 3027 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:11 smithi027 bash[22610]: audit 2024-08-31T08:30:11.626843+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:30:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: cluster 2024-08-31T08:30:10.841675+0000 mgr.a (mgr.14388) 16383 : cluster [DBG] pgmap v11359: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: audit 2024-08-31T08:30:10.855674+0000 mon.a (mon.0) 3019 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: audit 2024-08-31T08:30:10.861032+0000 mon.a (mon.0) 3020 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: audit 2024-08-31T08:30:10.897372+0000 mon.a (mon.0) 3021 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: audit 2024-08-31T08:30:10.903474+0000 mon.a (mon.0) 3022 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: audit 2024-08-31T08:30:10.907041+0000 mon.a (mon.0) 3023 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: audit 2024-08-31T08:30:10.912419+0000 mon.a (mon.0) 3024 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: audit 2024-08-31T08:30:11.615984+0000 mon.a (mon.0) 3025 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:30:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: audit 2024-08-31T08:30:11.617130+0000 mon.a (mon.0) 3026 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:30:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: audit 2024-08-31T08:30:11.623661+0000 mon.a (mon.0) 3027 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:30:12.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:11 smithi191 bash[24992]: audit 2024-08-31T08:30:11.626843+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:30:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:12 smithi027 bash[22610]: audit 2024-08-31T08:30:11.542935+0000 mgr.a (mgr.14388) 16384 : audit [DBG] from='client.353970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:12.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:12 smithi027 bash[22610]: audit 2024-08-31T08:30:11.628011+0000 mgr.a (mgr.14388) 16385 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:30:12.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:30:12 smithi027 bash[22863]: debug 2024-08-31T08:30:12.681+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:30:12.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:30:12 smithi027 bash[22863]: debug 2024-08-31T08:30:12.681+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:30:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:12 smithi163 bash[24253]: audit 2024-08-31T08:30:11.542935+0000 mgr.a (mgr.14388) 16384 : audit [DBG] from='client.353970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:12 smithi163 bash[24253]: audit 2024-08-31T08:30:11.628011+0000 mgr.a (mgr.14388) 16385 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:30:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:12 smithi191 bash[24992]: audit 2024-08-31T08:30:11.542935+0000 mgr.a (mgr.14388) 16384 : audit [DBG] from='client.353970 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:12 smithi191 bash[24992]: audit 2024-08-31T08:30:11.628011+0000 mgr.a (mgr.14388) 16385 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:30:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:13 smithi163 bash[24253]: audit 2024-08-31T08:30:12.682988+0000 mgr.a (mgr.14388) 16386 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:30:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:13 smithi163 bash[24253]: cephadm 2024-08-31T08:30:12.684466+0000 mgr.a (mgr.14388) 16387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:30:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:13 smithi163 bash[24253]: cluster 2024-08-31T08:30:12.843152+0000 mgr.a (mgr.14388) 16388 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 3 op/s 2024-08-31T08:30:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:13 smithi027 bash[22610]: audit 2024-08-31T08:30:12.682988+0000 mgr.a (mgr.14388) 16386 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:30:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:13 smithi027 bash[22610]: cephadm 2024-08-31T08:30:12.684466+0000 mgr.a (mgr.14388) 16387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:30:14.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:13 smithi027 bash[22610]: cluster 2024-08-31T08:30:12.843152+0000 mgr.a (mgr.14388) 16388 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 3 op/s 2024-08-31T08:30:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:13 smithi191 bash[24992]: audit 2024-08-31T08:30:12.682988+0000 mgr.a (mgr.14388) 16386 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:30:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:13 smithi191 bash[24992]: cephadm 2024-08-31T08:30:12.684466+0000 mgr.a (mgr.14388) 16387 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:30:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:13 smithi191 bash[24992]: cluster 2024-08-31T08:30:12.843152+0000 mgr.a (mgr.14388) 16388 : cluster [DBG] pgmap v11360: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 3.8 KiB/s rd, 3 op/s 2024-08-31T08:30:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:15 smithi163 bash[24253]: cluster 2024-08-31T08:30:14.844826+0000 mgr.a (mgr.14388) 16389 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:15 smithi027 bash[22610]: cluster 2024-08-31T08:30:14.844826+0000 mgr.a (mgr.14388) 16389 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:15 smithi191 bash[24992]: cluster 2024-08-31T08:30:14.844826+0000 mgr.a (mgr.14388) 16389 : cluster [DBG] pgmap v11361: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:16.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:30:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:30:16.984 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:17.718 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:17.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:17.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:17.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:17.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:17 smithi163 bash[24253]: cluster 2024-08-31T08:30:16.845608+0000 mgr.a (mgr.14388) 16390 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:17 smithi027 bash[22610]: cluster 2024-08-31T08:30:16.845608+0000 mgr.a (mgr.14388) 16390 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:17 smithi191 bash[24992]: cluster 2024-08-31T08:30:16.845608+0000 mgr.a (mgr.14388) 16390 : cluster [DBG] pgmap v11362: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:18 smithi163 bash[24253]: audit 2024-08-31T08:30:17.312288+0000 mgr.a (mgr.14388) 16391 : audit [DBG] from='client.354150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:18 smithi027 bash[22610]: audit 2024-08-31T08:30:17.312288+0000 mgr.a (mgr.14388) 16391 : audit [DBG] from='client.354150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:18 smithi191 bash[24992]: audit 2024-08-31T08:30:17.312288+0000 mgr.a (mgr.14388) 16391 : audit [DBG] from='client.354150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:19 smithi163 bash[24253]: cluster 2024-08-31T08:30:18.848057+0000 mgr.a (mgr.14388) 16392 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:19 smithi027 bash[22610]: cluster 2024-08-31T08:30:18.848057+0000 mgr.a (mgr.14388) 16392 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:19 smithi191 bash[24992]: cluster 2024-08-31T08:30:18.848057+0000 mgr.a (mgr.14388) 16392 : cluster [DBG] pgmap v11363: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:21 smithi163 bash[24253]: cluster 2024-08-31T08:30:20.848829+0000 mgr.a (mgr.14388) 16393 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:21 smithi027 bash[22610]: cluster 2024-08-31T08:30:20.848829+0000 mgr.a (mgr.14388) 16393 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:21 smithi191 bash[24992]: cluster 2024-08-31T08:30:20.848829+0000 mgr.a (mgr.14388) 16393 : cluster [DBG] pgmap v11364: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:22.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:30:22.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:30:22.721 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:23.479 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:23.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:23.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:23.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:23.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:24.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:23 smithi163 bash[24253]: cluster 2024-08-31T08:30:22.849807+0000 mgr.a (mgr.14388) 16394 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:23 smithi027 bash[22610]: cluster 2024-08-31T08:30:22.849807+0000 mgr.a (mgr.14388) 16394 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:23 smithi191 bash[24992]: cluster 2024-08-31T08:30:22.849807+0000 mgr.a (mgr.14388) 16394 : cluster [DBG] pgmap v11365: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:30:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:24 smithi163 bash[24253]: audit 2024-08-31T08:30:23.055867+0000 mgr.a (mgr.14388) 16395 : audit [DBG] from='client.354228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:24 smithi027 bash[22610]: audit 2024-08-31T08:30:23.055867+0000 mgr.a (mgr.14388) 16395 : audit [DBG] from='client.354228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:24 smithi191 bash[24992]: audit 2024-08-31T08:30:23.055867+0000 mgr.a (mgr.14388) 16395 : audit [DBG] from='client.354228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:26.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:25 smithi163 bash[24253]: cluster 2024-08-31T08:30:24.852069+0000 mgr.a (mgr.14388) 16396 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T08:30:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:25 smithi027 bash[22610]: cluster 2024-08-31T08:30:24.852069+0000 mgr.a (mgr.14388) 16396 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T08:30:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:25 smithi191 bash[24992]: cluster 2024-08-31T08:30:24.852069+0000 mgr.a (mgr.14388) 16396 : cluster [DBG] pgmap v11366: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T08:30:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:27 smithi163 bash[24253]: cluster 2024-08-31T08:30:26.852853+0000 mgr.a (mgr.14388) 16397 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:30:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:27 smithi027 bash[22610]: cluster 2024-08-31T08:30:26.852853+0000 mgr.a (mgr.14388) 16397 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:30:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:27 smithi191 bash[24992]: cluster 2024-08-31T08:30:26.852853+0000 mgr.a (mgr.14388) 16397 : cluster [DBG] pgmap v11367: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:30:28.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:30:28.482 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:30:28.482 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:29.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:29.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:29.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:29.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:29.262 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:29 smithi163 bash[24253]: audit 2024-08-31T08:30:28.815289+0000 mgr.a (mgr.14388) 16398 : audit [DBG] from='client.354303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:29 smithi163 bash[24253]: cluster 2024-08-31T08:30:28.855314+0000 mgr.a (mgr.14388) 16399 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:29 smithi027 bash[22610]: audit 2024-08-31T08:30:28.815289+0000 mgr.a (mgr.14388) 16398 : audit [DBG] from='client.354303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:29 smithi027 bash[22610]: cluster 2024-08-31T08:30:28.855314+0000 mgr.a (mgr.14388) 16399 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:29 smithi191 bash[24992]: audit 2024-08-31T08:30:28.815289+0000 mgr.a (mgr.14388) 16398 : audit [DBG] from='client.354303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:29 smithi191 bash[24992]: cluster 2024-08-31T08:30:28.855314+0000 mgr.a (mgr.14388) 16399 : cluster [DBG] pgmap v11368: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:31 smithi163 bash[24253]: cluster 2024-08-31T08:30:30.856159+0000 mgr.a (mgr.14388) 16400 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:30:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:31 smithi027 bash[22610]: cluster 2024-08-31T08:30:30.856159+0000 mgr.a (mgr.14388) 16400 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:30:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:31 smithi191 bash[24992]: cluster 2024-08-31T08:30:30.856159+0000 mgr.a (mgr.14388) 16400 : cluster [DBG] pgmap v11369: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:30:34.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:33 smithi163 bash[24253]: cluster 2024-08-31T08:30:32.857563+0000 mgr.a (mgr.14388) 16401 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:30:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:33 smithi027 bash[22610]: cluster 2024-08-31T08:30:32.857563+0000 mgr.a (mgr.14388) 16401 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:30:34.264 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:30:34.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:30:34.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:33 smithi191 bash[24992]: cluster 2024-08-31T08:30:32.857563+0000 mgr.a (mgr.14388) 16401 : cluster [DBG] pgmap v11370: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:30:35.050 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:35.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:35.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:35.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:35.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:35 smithi163 bash[24253]: audit 2024-08-31T08:30:34.598502+0000 mgr.a (mgr.14388) 16402 : audit [DBG] from='client.354375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:36.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:35 smithi163 bash[24253]: cluster 2024-08-31T08:30:34.858778+0000 mgr.a (mgr.14388) 16403 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:35 smithi027 bash[22610]: audit 2024-08-31T08:30:34.598502+0000 mgr.a (mgr.14388) 16402 : audit [DBG] from='client.354375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:35 smithi027 bash[22610]: cluster 2024-08-31T08:30:34.858778+0000 mgr.a (mgr.14388) 16403 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:35 smithi191 bash[24992]: audit 2024-08-31T08:30:34.598502+0000 mgr.a (mgr.14388) 16402 : audit [DBG] from='client.354375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:35 smithi191 bash[24992]: cluster 2024-08-31T08:30:34.858778+0000 mgr.a (mgr.14388) 16403 : cluster [DBG] pgmap v11371: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:38.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:37 smithi163 bash[24253]: cluster 2024-08-31T08:30:36.859620+0000 mgr.a (mgr.14388) 16404 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:37 smithi027 bash[22610]: cluster 2024-08-31T08:30:36.859620+0000 mgr.a (mgr.14388) 16404 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:37 smithi191 bash[24992]: cluster 2024-08-31T08:30:36.859620+0000 mgr.a (mgr.14388) 16404 : cluster [DBG] pgmap v11372: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:40.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:30:40.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:30:40.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:40.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:39 smithi163 bash[24253]: cluster 2024-08-31T08:30:38.861835+0000 mgr.a (mgr.14388) 16405 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:39 smithi027 bash[22610]: cluster 2024-08-31T08:30:38.861835+0000 mgr.a (mgr.14388) 16405 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:39 smithi191 bash[24992]: cluster 2024-08-31T08:30:38.861835+0000 mgr.a (mgr.14388) 16405 : cluster [DBG] pgmap v11373: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:40.807 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:40.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:41 smithi163 bash[24253]: audit 2024-08-31T08:30:40.388274+0000 mgr.a (mgr.14388) 16406 : audit [DBG] from='client.354453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:41 smithi163 bash[24253]: cluster 2024-08-31T08:30:40.862792+0000 mgr.a (mgr.14388) 16407 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:41 smithi027 bash[22610]: audit 2024-08-31T08:30:40.388274+0000 mgr.a (mgr.14388) 16406 : audit [DBG] from='client.354453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:41 smithi027 bash[22610]: cluster 2024-08-31T08:30:40.862792+0000 mgr.a (mgr.14388) 16407 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:41 smithi191 bash[24992]: audit 2024-08-31T08:30:40.388274+0000 mgr.a (mgr.14388) 16406 : audit [DBG] from='client.354453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:41 smithi191 bash[24992]: cluster 2024-08-31T08:30:40.862792+0000 mgr.a (mgr.14388) 16407 : cluster [DBG] pgmap v11374: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:43 smithi163 bash[24253]: cluster 2024-08-31T08:30:42.864126+0000 mgr.a (mgr.14388) 16408 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:30:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:43 smithi027 bash[22610]: cluster 2024-08-31T08:30:42.864126+0000 mgr.a (mgr.14388) 16408 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:30:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:43 smithi191 bash[24992]: cluster 2024-08-31T08:30:42.864126+0000 mgr.a (mgr.14388) 16408 : cluster [DBG] pgmap v11375: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:30:45.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:30:45.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:30:45.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:45 smithi027 bash[22610]: cluster 2024-08-31T08:30:44.865795+0000 mgr.a (mgr.14388) 16409 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:30:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:45 smithi191 bash[24992]: cluster 2024-08-31T08:30:44.865795+0000 mgr.a (mgr.14388) 16409 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:30:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:45 smithi163 bash[24253]: cluster 2024-08-31T08:30:44.865795+0000 mgr.a (mgr.14388) 16409 : cluster [DBG] pgmap v11376: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:30:46.563 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:46.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:46.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:46.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:46.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:47 smithi027 bash[22610]: audit 2024-08-31T08:30:46.139881+0000 mgr.a (mgr.14388) 16410 : audit [DBG] from='client.354528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:48.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:47 smithi027 bash[22610]: cluster 2024-08-31T08:30:46.866788+0000 mgr.a (mgr.14388) 16411 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:47 smithi191 bash[24992]: audit 2024-08-31T08:30:46.139881+0000 mgr.a (mgr.14388) 16410 : audit [DBG] from='client.354528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:47 smithi191 bash[24992]: cluster 2024-08-31T08:30:46.866788+0000 mgr.a (mgr.14388) 16411 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:47 smithi163 bash[24253]: audit 2024-08-31T08:30:46.139881+0000 mgr.a (mgr.14388) 16410 : audit [DBG] from='client.354528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:47 smithi163 bash[24253]: cluster 2024-08-31T08:30:46.866788+0000 mgr.a (mgr.14388) 16411 : cluster [DBG] pgmap v11377: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:49 smithi027 bash[22610]: cluster 2024-08-31T08:30:48.869029+0000 mgr.a (mgr.14388) 16412 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:49 smithi191 bash[24992]: cluster 2024-08-31T08:30:48.869029+0000 mgr.a (mgr.14388) 16412 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:49 smithi163 bash[24253]: cluster 2024-08-31T08:30:48.869029+0000 mgr.a (mgr.14388) 16412 : cluster [DBG] pgmap v11378: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:30:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:30:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:30:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:51 smithi027 bash[22610]: cluster 2024-08-31T08:30:50.869771+0000 mgr.a (mgr.14388) 16413 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:51 smithi191 bash[24992]: cluster 2024-08-31T08:30:50.869771+0000 mgr.a (mgr.14388) 16413 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:52.343 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:52.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:52.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:52.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:52.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:51 smithi163 bash[24253]: cluster 2024-08-31T08:30:50.869771+0000 mgr.a (mgr.14388) 16413 : cluster [DBG] pgmap v11379: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:52 smithi027 bash[22610]: audit 2024-08-31T08:30:51.900390+0000 mgr.a (mgr.14388) 16414 : audit [DBG] from='client.354606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:52 smithi191 bash[24992]: audit 2024-08-31T08:30:51.900390+0000 mgr.a (mgr.14388) 16414 : audit [DBG] from='client.354606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:52 smithi163 bash[24253]: audit 2024-08-31T08:30:51.900390+0000 mgr.a (mgr.14388) 16414 : audit [DBG] from='client.354606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:54.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:53 smithi027 bash[22610]: cluster 2024-08-31T08:30:52.871385+0000 mgr.a (mgr.14388) 16415 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:30:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:53 smithi191 bash[24992]: cluster 2024-08-31T08:30:52.871385+0000 mgr.a (mgr.14388) 16415 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:30:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:53 smithi163 bash[24253]: cluster 2024-08-31T08:30:52.871385+0000 mgr.a (mgr.14388) 16415 : cluster [DBG] pgmap v11380: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T08:30:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:55 smithi027 bash[22610]: cluster 2024-08-31T08:30:54.873066+0000 mgr.a (mgr.14388) 16416 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:30:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:55 smithi191 bash[24992]: cluster 2024-08-31T08:30:54.873066+0000 mgr.a (mgr.14388) 16416 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:30:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:55 smithi163 bash[24253]: cluster 2024-08-31T08:30:54.873066+0000 mgr.a (mgr.14388) 16416 : cluster [DBG] pgmap v11381: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:30:57.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:30:57.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:30:57.345 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:30:58.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:30:58.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:30:58.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:30:58.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:30:58.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:30:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:57 smithi027 bash[22610]: cluster 2024-08-31T08:30:56.873834+0000 mgr.a (mgr.14388) 16417 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:57 smithi191 bash[24992]: cluster 2024-08-31T08:30:56.873834+0000 mgr.a (mgr.14388) 16417 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:57 smithi163 bash[24253]: cluster 2024-08-31T08:30:56.873834+0000 mgr.a (mgr.14388) 16417 : cluster [DBG] pgmap v11382: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:30:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:58 smithi191 bash[24992]: audit 2024-08-31T08:30:57.673524+0000 mgr.a (mgr.14388) 16418 : audit [DBG] from='client.354684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:58 smithi163 bash[24253]: audit 2024-08-31T08:30:57.673524+0000 mgr.a (mgr.14388) 16418 : audit [DBG] from='client.354684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:30:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:58 smithi027 bash[22610]: audit 2024-08-31T08:30:57.673524+0000 mgr.a (mgr.14388) 16418 : audit [DBG] from='client.354684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:30:59 smithi191 bash[24992]: cluster 2024-08-31T08:30:58.876742+0000 mgr.a (mgr.14388) 16419 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:30:59 smithi163 bash[24253]: cluster 2024-08-31T08:30:58.876742+0000 mgr.a (mgr.14388) 16419 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:30:59 smithi027 bash[22610]: cluster 2024-08-31T08:30:58.876742+0000 mgr.a (mgr.14388) 16419 : cluster [DBG] pgmap v11383: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:02 smithi191 bash[24992]: cluster 2024-08-31T08:31:00.877545+0000 mgr.a (mgr.14388) 16420 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:02 smithi163 bash[24253]: cluster 2024-08-31T08:31:00.877545+0000 mgr.a (mgr.14388) 16420 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:02 smithi027 bash[22610]: cluster 2024-08-31T08:31:00.877545+0000 mgr.a (mgr.14388) 16420 : cluster [DBG] pgmap v11384: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:03.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:31:03.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:31:03.104 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:31:03.885 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:31:03.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:31:03.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:31:03.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:31:03.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:31:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:04 smithi191 bash[24992]: cluster 2024-08-31T08:31:02.879441+0000 mgr.a (mgr.14388) 16421 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:04 smithi163 bash[24253]: cluster 2024-08-31T08:31:02.879441+0000 mgr.a (mgr.14388) 16421 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:04 smithi027 bash[22610]: cluster 2024-08-31T08:31:02.879441+0000 mgr.a (mgr.14388) 16421 : cluster [DBG] pgmap v11385: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:05 smithi191 bash[24992]: audit 2024-08-31T08:31:03.443380+0000 mgr.a (mgr.14388) 16422 : audit [DBG] from='client.354762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:05 smithi163 bash[24253]: audit 2024-08-31T08:31:03.443380+0000 mgr.a (mgr.14388) 16422 : audit [DBG] from='client.354762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:05 smithi027 bash[22610]: audit 2024-08-31T08:31:03.443380+0000 mgr.a (mgr.14388) 16422 : audit [DBG] from='client.354762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:06 smithi191 bash[24992]: cluster 2024-08-31T08:31:04.880332+0000 mgr.a (mgr.14388) 16423 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:31:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:06 smithi163 bash[24253]: cluster 2024-08-31T08:31:04.880332+0000 mgr.a (mgr.14388) 16423 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:31:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:06 smithi027 bash[22610]: cluster 2024-08-31T08:31:04.880332+0000 mgr.a (mgr.14388) 16423 : cluster [DBG] pgmap v11386: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:31:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:08 smithi191 bash[24992]: cluster 2024-08-31T08:31:06.881110+0000 mgr.a (mgr.14388) 16424 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:08 smithi163 bash[24253]: cluster 2024-08-31T08:31:06.881110+0000 mgr.a (mgr.14388) 16424 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:08 smithi027 bash[22610]: cluster 2024-08-31T08:31:06.881110+0000 mgr.a (mgr.14388) 16424 : cluster [DBG] pgmap v11387: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:08.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:31:08.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:31:08.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:31:09.661 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:31:09.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:31:09.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:31:09.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:31:09.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:31:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:10 smithi191 bash[24992]: cluster 2024-08-31T08:31:08.883360+0000 mgr.a (mgr.14388) 16425 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:10 smithi163 bash[24253]: cluster 2024-08-31T08:31:08.883360+0000 mgr.a (mgr.14388) 16425 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:10 smithi027 bash[22610]: cluster 2024-08-31T08:31:08.883360+0000 mgr.a (mgr.14388) 16425 : cluster [DBG] pgmap v11388: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:11 smithi191 bash[24992]: audit 2024-08-31T08:31:09.220509+0000 mgr.a (mgr.14388) 16426 : audit [DBG] from='client.354840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:11 smithi163 bash[24253]: audit 2024-08-31T08:31:09.220509+0000 mgr.a (mgr.14388) 16426 : audit [DBG] from='client.354840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:11 smithi027 bash[22610]: audit 2024-08-31T08:31:09.220509+0000 mgr.a (mgr.14388) 16426 : audit [DBG] from='client.354840 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:12 smithi191 bash[24992]: cluster 2024-08-31T08:31:10.884245+0000 mgr.a (mgr.14388) 16427 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:12 smithi163 bash[24253]: cluster 2024-08-31T08:31:10.884245+0000 mgr.a (mgr.14388) 16427 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:12 smithi027 bash[22610]: cluster 2024-08-31T08:31:10.884245+0000 mgr.a (mgr.14388) 16427 : cluster [DBG] pgmap v11389: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:13 smithi163 bash[24253]: audit 2024-08-31T08:31:12.741104+0000 mon.a (mon.0) 3029 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:31:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:13 smithi163 bash[24253]: cluster 2024-08-31T08:31:12.885626+0000 mgr.a (mgr.14388) 16428 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:13 smithi027 bash[22610]: audit 2024-08-31T08:31:12.741104+0000 mon.a (mon.0) 3029 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:31:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:13 smithi027 bash[22610]: cluster 2024-08-31T08:31:12.885626+0000 mgr.a (mgr.14388) 16428 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:13 smithi191 bash[24992]: audit 2024-08-31T08:31:12.741104+0000 mon.a (mon.0) 3029 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:31:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:13 smithi191 bash[24992]: cluster 2024-08-31T08:31:12.885626+0000 mgr.a (mgr.14388) 16428 : cluster [DBG] pgmap v11390: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:14.333 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:14 smithi027 bash[22610]: audit 2024-08-31T08:31:13.587365+0000 mon.a (mon.0) 3030 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:31:14.333 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:14 smithi027 bash[22610]: audit 2024-08-31T08:31:13.588568+0000 mon.a (mon.0) 3031 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:31:14.333 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:14 smithi027 bash[22610]: audit 2024-08-31T08:31:13.597828+0000 mon.a (mon.0) 3032 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:31:14.334 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:14 smithi027 bash[22610]: audit 2024-08-31T08:31:13.603102+0000 mon.a (mon.0) 3033 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:31:14.334 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:14 smithi027 bash[22610]: audit 2024-08-31T08:31:13.604296+0000 mgr.a (mgr.14388) 16429 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:31:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:14 smithi163 bash[24253]: audit 2024-08-31T08:31:13.587365+0000 mon.a (mon.0) 3030 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:31:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:14 smithi163 bash[24253]: audit 2024-08-31T08:31:13.588568+0000 mon.a (mon.0) 3031 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:31:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:14 smithi163 bash[24253]: audit 2024-08-31T08:31:13.597828+0000 mon.a (mon.0) 3032 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:31:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:14 smithi163 bash[24253]: audit 2024-08-31T08:31:13.603102+0000 mon.a (mon.0) 3033 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:31:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:14 smithi163 bash[24253]: audit 2024-08-31T08:31:13.604296+0000 mgr.a (mgr.14388) 16429 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:31:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:14 smithi191 bash[24992]: audit 2024-08-31T08:31:13.587365+0000 mon.a (mon.0) 3030 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:31:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:14 smithi191 bash[24992]: audit 2024-08-31T08:31:13.588568+0000 mon.a (mon.0) 3031 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:31:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:14 smithi191 bash[24992]: audit 2024-08-31T08:31:13.597828+0000 mon.a (mon.0) 3032 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:31:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:14 smithi191 bash[24992]: audit 2024-08-31T08:31:13.603102+0000 mon.a (mon.0) 3033 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:31:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:14 smithi191 bash[24992]: audit 2024-08-31T08:31:13.604296+0000 mgr.a (mgr.14388) 16429 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:31:14.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:31:14.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:31:14.663 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:31:14.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:31:14 smithi027 bash[22863]: debug 2024-08-31T08:31:14.328+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:31:14.734 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:31:14 smithi027 bash[22863]: debug 2024-08-31T08:31:14.328+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:31:15.410 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:31:15.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:31:15.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:31:15.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:31:15.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:31:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:15 smithi163 bash[24253]: audit 2024-08-31T08:31:14.332695+0000 mgr.a (mgr.14388) 16430 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:31:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:15 smithi163 bash[24253]: cephadm 2024-08-31T08:31:14.334174+0000 mgr.a (mgr.14388) 16431 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:31:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:15 smithi163 bash[24253]: cluster 2024-08-31T08:31:14.886194+0000 mgr.a (mgr.14388) 16432 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:15 smithi163 bash[24253]: audit 2024-08-31T08:31:14.989454+0000 mgr.a (mgr.14388) 16433 : audit [DBG] from='client.355026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:15 smithi027 bash[22610]: audit 2024-08-31T08:31:14.332695+0000 mgr.a (mgr.14388) 16430 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:31:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:15 smithi027 bash[22610]: cephadm 2024-08-31T08:31:14.334174+0000 mgr.a (mgr.14388) 16431 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:31:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:15 smithi027 bash[22610]: cluster 2024-08-31T08:31:14.886194+0000 mgr.a (mgr.14388) 16432 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:15 smithi027 bash[22610]: audit 2024-08-31T08:31:14.989454+0000 mgr.a (mgr.14388) 16433 : audit [DBG] from='client.355026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:15 smithi191 bash[24992]: audit 2024-08-31T08:31:14.332695+0000 mgr.a (mgr.14388) 16430 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:31:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:15 smithi191 bash[24992]: cephadm 2024-08-31T08:31:14.334174+0000 mgr.a (mgr.14388) 16431 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:31:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:15 smithi191 bash[24992]: cluster 2024-08-31T08:31:14.886194+0000 mgr.a (mgr.14388) 16432 : cluster [DBG] pgmap v11391: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:15 smithi191 bash[24992]: audit 2024-08-31T08:31:14.989454+0000 mgr.a (mgr.14388) 16433 : audit [DBG] from='client.355026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:17 smithi163 bash[24253]: cluster 2024-08-31T08:31:16.887092+0000 mgr.a (mgr.14388) 16434 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:17 smithi027 bash[22610]: cluster 2024-08-31T08:31:16.887092+0000 mgr.a (mgr.14388) 16434 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:17 smithi191 bash[24992]: cluster 2024-08-31T08:31:16.887092+0000 mgr.a (mgr.14388) 16434 : cluster [DBG] pgmap v11392: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:19 smithi163 bash[24253]: cluster 2024-08-31T08:31:18.889329+0000 mgr.a (mgr.14388) 16435 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:19 smithi027 bash[22610]: cluster 2024-08-31T08:31:18.889329+0000 mgr.a (mgr.14388) 16435 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:19 smithi191 bash[24992]: cluster 2024-08-31T08:31:18.889329+0000 mgr.a (mgr.14388) 16435 : cluster [DBG] pgmap v11393: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:20.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:31:20.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:31:20.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:31:21.163 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:31:21.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:31:21.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:31:21.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:31:21.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:31:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:21 smithi027 bash[22610]: audit 2024-08-31T08:31:20.742481+0000 mgr.a (mgr.14388) 16436 : audit [DBG] from='client.355098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:22.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:21 smithi027 bash[22610]: cluster 2024-08-31T08:31:20.889896+0000 mgr.a (mgr.14388) 16437 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:21 smithi191 bash[24992]: audit 2024-08-31T08:31:20.742481+0000 mgr.a (mgr.14388) 16436 : audit [DBG] from='client.355098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:21 smithi191 bash[24992]: cluster 2024-08-31T08:31:20.889896+0000 mgr.a (mgr.14388) 16437 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:21 smithi163 bash[24253]: audit 2024-08-31T08:31:20.742481+0000 mgr.a (mgr.14388) 16436 : audit [DBG] from='client.355098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:21 smithi163 bash[24253]: cluster 2024-08-31T08:31:20.889896+0000 mgr.a (mgr.14388) 16437 : cluster [DBG] pgmap v11394: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:24.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:23 smithi027 bash[22610]: cluster 2024-08-31T08:31:22.892127+0000 mgr.a (mgr.14388) 16438 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:23 smithi191 bash[24992]: cluster 2024-08-31T08:31:22.892127+0000 mgr.a (mgr.14388) 16438 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:23 smithi163 bash[24253]: cluster 2024-08-31T08:31:22.892127+0000 mgr.a (mgr.14388) 16438 : cluster [DBG] pgmap v11395: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:26.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:31:26.166 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:31:26.166 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:31:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:25 smithi027 bash[22610]: cluster 2024-08-31T08:31:24.892939+0000 mgr.a (mgr.14388) 16439 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:25 smithi191 bash[24992]: cluster 2024-08-31T08:31:24.892939+0000 mgr.a (mgr.14388) 16439 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:25 smithi163 bash[24253]: cluster 2024-08-31T08:31:24.892939+0000 mgr.a (mgr.14388) 16439 : cluster [DBG] pgmap v11396: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:26.932 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:31:26.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:31:26.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:31:26.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:31:26.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:31:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:27 smithi027 bash[22610]: audit 2024-08-31T08:31:26.497419+0000 mgr.a (mgr.14388) 16440 : audit [DBG] from='client.355173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:28.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:27 smithi027 bash[22610]: cluster 2024-08-31T08:31:26.893535+0000 mgr.a (mgr.14388) 16441 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:27 smithi191 bash[24992]: audit 2024-08-31T08:31:26.497419+0000 mgr.a (mgr.14388) 16440 : audit [DBG] from='client.355173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:27 smithi191 bash[24992]: cluster 2024-08-31T08:31:26.893535+0000 mgr.a (mgr.14388) 16441 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:27 smithi163 bash[24253]: audit 2024-08-31T08:31:26.497419+0000 mgr.a (mgr.14388) 16440 : audit [DBG] from='client.355173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:27 smithi163 bash[24253]: cluster 2024-08-31T08:31:26.893535+0000 mgr.a (mgr.14388) 16441 : cluster [DBG] pgmap v11397: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:30.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:29 smithi027 bash[22610]: cluster 2024-08-31T08:31:28.895751+0000 mgr.a (mgr.14388) 16442 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:29 smithi191 bash[24992]: cluster 2024-08-31T08:31:28.895751+0000 mgr.a (mgr.14388) 16442 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:29 smithi163 bash[24253]: cluster 2024-08-31T08:31:28.895751+0000 mgr.a (mgr.14388) 16442 : cluster [DBG] pgmap v11398: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:31:31.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:31:31.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:31:31.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:31:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:31 smithi027 bash[22610]: cluster 2024-08-31T08:31:30.896679+0000 mgr.a (mgr.14388) 16443 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:31 smithi191 bash[24992]: cluster 2024-08-31T08:31:30.896679+0000 mgr.a (mgr.14388) 16443 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:31 smithi163 bash[24253]: cluster 2024-08-31T08:31:30.896679+0000 mgr.a (mgr.14388) 16443 : cluster [DBG] pgmap v11399: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:32.711 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:31:32.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:31:32.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:31:32.711 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:31:32.712 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:31:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:33 smithi027 bash[22610]: audit 2024-08-31T08:31:32.269778+0000 mgr.a (mgr.14388) 16444 : audit [DBG] from='client.355251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:34.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:33 smithi027 bash[22610]: cluster 2024-08-31T08:31:32.899005+0000 mgr.a (mgr.14388) 16445 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:33 smithi191 bash[24992]: audit 2024-08-31T08:31:32.269778+0000 mgr.a (mgr.14388) 16444 : audit [DBG] from='client.355251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:33 smithi191 bash[24992]: cluster 2024-08-31T08:31:32.899005+0000 mgr.a (mgr.14388) 16445 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:33 smithi163 bash[24253]: audit 2024-08-31T08:31:32.269778+0000 mgr.a (mgr.14388) 16444 : audit [DBG] from='client.355251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:33 smithi163 bash[24253]: cluster 2024-08-31T08:31:32.899005+0000 mgr.a (mgr.14388) 16445 : cluster [DBG] pgmap v11400: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:35 smithi027 bash[22610]: cluster 2024-08-31T08:31:34.899789+0000 mgr.a (mgr.14388) 16446 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:35 smithi191 bash[24992]: cluster 2024-08-31T08:31:34.899789+0000 mgr.a (mgr.14388) 16446 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:35 smithi163 bash[24253]: cluster 2024-08-31T08:31:34.899789+0000 mgr.a (mgr.14388) 16446 : cluster [DBG] pgmap v11401: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:37.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:31:37.713 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:31:37.713 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:31:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:37 smithi191 bash[24992]: cluster 2024-08-31T08:31:36.900536+0000 mgr.a (mgr.14388) 16447 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:37 smithi163 bash[24253]: cluster 2024-08-31T08:31:36.900536+0000 mgr.a (mgr.14388) 16447 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:38.462 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:31:38.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:31:38.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:31:38.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:31:38.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:31:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:37 smithi027 bash[22610]: cluster 2024-08-31T08:31:36.900536+0000 mgr.a (mgr.14388) 16447 : cluster [DBG] pgmap v11402: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:39 smithi191 bash[24992]: audit 2024-08-31T08:31:38.043483+0000 mgr.a (mgr.14388) 16448 : audit [DBG] from='client.355329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:39 smithi191 bash[24992]: cluster 2024-08-31T08:31:38.903405+0000 mgr.a (mgr.14388) 16449 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:39 smithi163 bash[24253]: audit 2024-08-31T08:31:38.043483+0000 mgr.a (mgr.14388) 16448 : audit [DBG] from='client.355329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:39 smithi163 bash[24253]: cluster 2024-08-31T08:31:38.903405+0000 mgr.a (mgr.14388) 16449 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:39 smithi027 bash[22610]: audit 2024-08-31T08:31:38.043483+0000 mgr.a (mgr.14388) 16448 : audit [DBG] from='client.355329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:40.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:39 smithi027 bash[22610]: cluster 2024-08-31T08:31:38.903405+0000 mgr.a (mgr.14388) 16449 : cluster [DBG] pgmap v11403: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:41 smithi191 bash[24992]: cluster 2024-08-31T08:31:40.904193+0000 mgr.a (mgr.14388) 16450 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:41 smithi163 bash[24253]: cluster 2024-08-31T08:31:40.904193+0000 mgr.a (mgr.14388) 16450 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:41 smithi027 bash[22610]: cluster 2024-08-31T08:31:40.904193+0000 mgr.a (mgr.14388) 16450 : cluster [DBG] pgmap v11404: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:43.464 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:31:43.465 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:31:43.465 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:31:44.225 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:31:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:31:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:31:44.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:31:44.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:31:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:43 smithi191 bash[24992]: cluster 2024-08-31T08:31:42.906121+0000 mgr.a (mgr.14388) 16451 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:43 smithi163 bash[24253]: cluster 2024-08-31T08:31:42.906121+0000 mgr.a (mgr.14388) 16451 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:43 smithi027 bash[22610]: cluster 2024-08-31T08:31:42.906121+0000 mgr.a (mgr.14388) 16451 : cluster [DBG] pgmap v11405: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:45 smithi191 bash[24992]: audit 2024-08-31T08:31:43.797322+0000 mgr.a (mgr.14388) 16452 : audit [DBG] from='client.355407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:45 smithi163 bash[24253]: audit 2024-08-31T08:31:43.797322+0000 mgr.a (mgr.14388) 16452 : audit [DBG] from='client.355407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:45 smithi027 bash[22610]: audit 2024-08-31T08:31:43.797322+0000 mgr.a (mgr.14388) 16452 : audit [DBG] from='client.355407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:46 smithi191 bash[24992]: cluster 2024-08-31T08:31:44.907043+0000 mgr.a (mgr.14388) 16453 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:46 smithi163 bash[24253]: cluster 2024-08-31T08:31:44.907043+0000 mgr.a (mgr.14388) 16453 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:46 smithi027 bash[22610]: cluster 2024-08-31T08:31:44.907043+0000 mgr.a (mgr.14388) 16453 : cluster [DBG] pgmap v11406: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:31:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:48 smithi191 bash[24992]: cluster 2024-08-31T08:31:46.907829+0000 mgr.a (mgr.14388) 16454 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:31:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:48 smithi163 bash[24253]: cluster 2024-08-31T08:31:46.907829+0000 mgr.a (mgr.14388) 16454 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:31:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:48 smithi027 bash[22610]: cluster 2024-08-31T08:31:46.907829+0000 mgr.a (mgr.14388) 16454 : cluster [DBG] pgmap v11407: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:31:49.227 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:31:49.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:31:49.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:31:50.014 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:31:50.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:31:50.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:31:50.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:31:50.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:31:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:50 smithi191 bash[24992]: cluster 2024-08-31T08:31:48.910066+0000 mgr.a (mgr.14388) 16455 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:50 smithi163 bash[24253]: cluster 2024-08-31T08:31:48.910066+0000 mgr.a (mgr.14388) 16455 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:50 smithi027 bash[22610]: cluster 2024-08-31T08:31:48.910066+0000 mgr.a (mgr.14388) 16455 : cluster [DBG] pgmap v11408: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:51 smithi191 bash[24992]: audit 2024-08-31T08:31:49.567353+0000 mgr.a (mgr.14388) 16456 : audit [DBG] from='client.355485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:51 smithi163 bash[24253]: audit 2024-08-31T08:31:49.567353+0000 mgr.a (mgr.14388) 16456 : audit [DBG] from='client.355485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:51 smithi027 bash[22610]: audit 2024-08-31T08:31:49.567353+0000 mgr.a (mgr.14388) 16456 : audit [DBG] from='client.355485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:52 smithi191 bash[24992]: cluster 2024-08-31T08:31:50.911219+0000 mgr.a (mgr.14388) 16457 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:52 smithi163 bash[24253]: cluster 2024-08-31T08:31:50.911219+0000 mgr.a (mgr.14388) 16457 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:52 smithi027 bash[22610]: cluster 2024-08-31T08:31:50.911219+0000 mgr.a (mgr.14388) 16457 : cluster [DBG] pgmap v11409: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:54 smithi191 bash[24992]: cluster 2024-08-31T08:31:52.913476+0000 mgr.a (mgr.14388) 16458 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:54 smithi163 bash[24253]: cluster 2024-08-31T08:31:52.913476+0000 mgr.a (mgr.14388) 16458 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:54 smithi027 bash[22610]: cluster 2024-08-31T08:31:52.913476+0000 mgr.a (mgr.14388) 16458 : cluster [DBG] pgmap v11410: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:55.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:31:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:31:55.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:31:55.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:31:55.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:31:55.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:31:55.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:31:55.743 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:31:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:56 smithi191 bash[24992]: cluster 2024-08-31T08:31:54.914441+0000 mgr.a (mgr.14388) 16459 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:56 smithi163 bash[24253]: cluster 2024-08-31T08:31:54.914441+0000 mgr.a (mgr.14388) 16459 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:56 smithi027 bash[22610]: cluster 2024-08-31T08:31:54.914441+0000 mgr.a (mgr.14388) 16459 : cluster [DBG] pgmap v11411: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:57 smithi163 bash[24253]: audit 2024-08-31T08:31:55.342180+0000 mgr.a (mgr.14388) 16460 : audit [DBG] from='client.355563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:57 smithi027 bash[22610]: audit 2024-08-31T08:31:55.342180+0000 mgr.a (mgr.14388) 16460 : audit [DBG] from='client.355563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:57 smithi191 bash[24992]: audit 2024-08-31T08:31:55.342180+0000 mgr.a (mgr.14388) 16460 : audit [DBG] from='client.355563 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:31:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:58 smithi163 bash[24253]: cluster 2024-08-31T08:31:56.915373+0000 mgr.a (mgr.14388) 16461 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:58 smithi027 bash[22610]: cluster 2024-08-31T08:31:56.915373+0000 mgr.a (mgr.14388) 16461 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:58 smithi191 bash[24992]: cluster 2024-08-31T08:31:56.915373+0000 mgr.a (mgr.14388) 16461 : cluster [DBG] pgmap v11412: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:31:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:31:59 smithi163 bash[24253]: cluster 2024-08-31T08:31:58.917692+0000 mgr.a (mgr.14388) 16462 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:31:59 smithi027 bash[22610]: cluster 2024-08-31T08:31:58.917692+0000 mgr.a (mgr.14388) 16462 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:31:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:31:59 smithi191 bash[24992]: cluster 2024-08-31T08:31:58.917692+0000 mgr.a (mgr.14388) 16462 : cluster [DBG] pgmap v11413: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:32:00.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:00.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:00.745 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:01.488 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:01.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:01.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:01.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:01.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:32:02.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:01 smithi027 bash[22610]: cluster 2024-08-31T08:32:00.918326+0000 mgr.a (mgr.14388) 16463 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:01 smithi191 bash[24992]: cluster 2024-08-31T08:32:00.918326+0000 mgr.a (mgr.14388) 16463 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:01 smithi163 bash[24253]: cluster 2024-08-31T08:32:00.918326+0000 mgr.a (mgr.14388) 16463 : cluster [DBG] pgmap v11414: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:02 smithi191 bash[24992]: audit 2024-08-31T08:32:01.074667+0000 mgr.a (mgr.14388) 16464 : audit [DBG] from='client.355635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:02 smithi163 bash[24253]: audit 2024-08-31T08:32:01.074667+0000 mgr.a (mgr.14388) 16464 : audit [DBG] from='client.355635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:02 smithi027 bash[22610]: audit 2024-08-31T08:32:01.074667+0000 mgr.a (mgr.14388) 16464 : audit [DBG] from='client.355635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:03 smithi191 bash[24992]: cluster 2024-08-31T08:32:02.920599+0000 mgr.a (mgr.14388) 16465 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:32:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:03 smithi163 bash[24253]: cluster 2024-08-31T08:32:02.920599+0000 mgr.a (mgr.14388) 16465 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:32:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:03 smithi027 bash[22610]: cluster 2024-08-31T08:32:02.920599+0000 mgr.a (mgr.14388) 16465 : cluster [DBG] pgmap v11415: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:32:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:05 smithi191 bash[24992]: cluster 2024-08-31T08:32:04.921361+0000 mgr.a (mgr.14388) 16466 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:05 smithi163 bash[24253]: cluster 2024-08-31T08:32:04.921361+0000 mgr.a (mgr.14388) 16466 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:05 smithi027 bash[22610]: cluster 2024-08-31T08:32:04.921361+0000 mgr.a (mgr.14388) 16466 : cluster [DBG] pgmap v11416: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:06.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:06.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:06.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:07.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:32:07.233 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:07 smithi191 bash[24992]: audit 2024-08-31T08:32:06.822772+0000 mgr.a (mgr.14388) 16467 : audit [DBG] from='client.355713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:07 smithi191 bash[24992]: cluster 2024-08-31T08:32:06.921810+0000 mgr.a (mgr.14388) 16468 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:07 smithi163 bash[24253]: audit 2024-08-31T08:32:06.822772+0000 mgr.a (mgr.14388) 16467 : audit [DBG] from='client.355713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:07 smithi163 bash[24253]: cluster 2024-08-31T08:32:06.921810+0000 mgr.a (mgr.14388) 16468 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:08.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:07 smithi027 bash[22610]: audit 2024-08-31T08:32:06.822772+0000 mgr.a (mgr.14388) 16467 : audit [DBG] from='client.355713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:08.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:07 smithi027 bash[22610]: cluster 2024-08-31T08:32:06.921810+0000 mgr.a (mgr.14388) 16468 : cluster [DBG] pgmap v11417: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:10 smithi191 bash[24992]: cluster 2024-08-31T08:32:08.924109+0000 mgr.a (mgr.14388) 16469 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:32:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:10 smithi163 bash[24253]: cluster 2024-08-31T08:32:08.924109+0000 mgr.a (mgr.14388) 16469 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:32:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:09 smithi027 bash[22610]: cluster 2024-08-31T08:32:08.924109+0000 mgr.a (mgr.14388) 16469 : cluster [DBG] pgmap v11418: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:32:12.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:12.235 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:12.235 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:12 smithi191 bash[24992]: cluster 2024-08-31T08:32:10.924852+0000 mgr.a (mgr.14388) 16470 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:12 smithi163 bash[24253]: cluster 2024-08-31T08:32:10.924852+0000 mgr.a (mgr.14388) 16470 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:12 smithi027 bash[22610]: cluster 2024-08-31T08:32:10.924852+0000 mgr.a (mgr.14388) 16470 : cluster [DBG] pgmap v11419: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:12.991 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:12.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:12.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:12.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:32:12.992 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:14 smithi191 bash[24992]: audit 2024-08-31T08:32:12.563570+0000 mgr.a (mgr.14388) 16471 : audit [DBG] from='client.355785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:14 smithi191 bash[24992]: cluster 2024-08-31T08:32:12.925999+0000 mgr.a (mgr.14388) 16472 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:32:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:14 smithi163 bash[24253]: audit 2024-08-31T08:32:12.563570+0000 mgr.a (mgr.14388) 16471 : audit [DBG] from='client.355785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:14 smithi163 bash[24253]: cluster 2024-08-31T08:32:12.925999+0000 mgr.a (mgr.14388) 16472 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:32:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:14 smithi027 bash[22610]: audit 2024-08-31T08:32:12.563570+0000 mgr.a (mgr.14388) 16471 : audit [DBG] from='client.355785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:14 smithi027 bash[22610]: cluster 2024-08-31T08:32:12.925999+0000 mgr.a (mgr.14388) 16472 : cluster [DBG] pgmap v11420: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:32:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:15 smithi191 bash[24992]: audit 2024-08-31T08:32:14.389919+0000 mon.a (mon.0) 3034 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:32:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:15 smithi163 bash[24253]: audit 2024-08-31T08:32:14.389919+0000 mon.a (mon.0) 3034 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:32:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:15 smithi027 bash[22610]: audit 2024-08-31T08:32:14.389919+0000 mon.a (mon.0) 3034 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:32:16.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:32:15 smithi027 bash[22863]: debug 2024-08-31T08:32:15.978+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:32:16.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:32:15 smithi027 bash[22863]: debug 2024-08-31T08:32:15.978+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:32:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:16 smithi027 bash[22610]: cluster 2024-08-31T08:32:14.926742+0000 mgr.a (mgr.14388) 16473 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:32:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:16 smithi027 bash[22610]: audit 2024-08-31T08:32:15.226354+0000 mon.a (mon.0) 3035 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:32:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:16 smithi027 bash[22610]: audit 2024-08-31T08:32:15.228051+0000 mon.a (mon.0) 3036 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:32:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:16 smithi027 bash[22610]: audit 2024-08-31T08:32:15.238554+0000 mon.a (mon.0) 3037 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:32:16.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:16 smithi027 bash[22610]: audit 2024-08-31T08:32:15.243391+0000 mon.a (mon.0) 3038 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:32:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:16 smithi191 bash[24992]: cluster 2024-08-31T08:32:14.926742+0000 mgr.a (mgr.14388) 16473 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:32:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:16 smithi191 bash[24992]: audit 2024-08-31T08:32:15.226354+0000 mon.a (mon.0) 3035 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:32:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:16 smithi191 bash[24992]: audit 2024-08-31T08:32:15.228051+0000 mon.a (mon.0) 3036 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:32:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:16 smithi191 bash[24992]: audit 2024-08-31T08:32:15.238554+0000 mon.a (mon.0) 3037 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:32:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:16 smithi191 bash[24992]: audit 2024-08-31T08:32:15.243391+0000 mon.a (mon.0) 3038 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:32:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:16 smithi163 bash[24253]: cluster 2024-08-31T08:32:14.926742+0000 mgr.a (mgr.14388) 16473 : cluster [DBG] pgmap v11421: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:32:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:16 smithi163 bash[24253]: audit 2024-08-31T08:32:15.226354+0000 mon.a (mon.0) 3035 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:32:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:16 smithi163 bash[24253]: audit 2024-08-31T08:32:15.228051+0000 mon.a (mon.0) 3036 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:32:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:16 smithi163 bash[24253]: audit 2024-08-31T08:32:15.238554+0000 mon.a (mon.0) 3037 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:32:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:16 smithi163 bash[24253]: audit 2024-08-31T08:32:15.243391+0000 mon.a (mon.0) 3038 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:32:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:17 smithi191 bash[24992]: audit 2024-08-31T08:32:15.245679+0000 mgr.a (mgr.14388) 16474 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:32:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:17 smithi191 bash[24992]: audit 2024-08-31T08:32:15.979715+0000 mgr.a (mgr.14388) 16475 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:32:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:17 smithi191 bash[24992]: cephadm 2024-08-31T08:32:15.981179+0000 mgr.a (mgr.14388) 16476 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:32:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:17 smithi163 bash[24253]: audit 2024-08-31T08:32:15.245679+0000 mgr.a (mgr.14388) 16474 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:32:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:17 smithi163 bash[24253]: audit 2024-08-31T08:32:15.979715+0000 mgr.a (mgr.14388) 16475 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:32:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:17 smithi163 bash[24253]: cephadm 2024-08-31T08:32:15.981179+0000 mgr.a (mgr.14388) 16476 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:32:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:17 smithi027 bash[22610]: audit 2024-08-31T08:32:15.245679+0000 mgr.a (mgr.14388) 16474 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:32:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:17 smithi027 bash[22610]: audit 2024-08-31T08:32:15.979715+0000 mgr.a (mgr.14388) 16475 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:32:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:17 smithi027 bash[22610]: cephadm 2024-08-31T08:32:15.981179+0000 mgr.a (mgr.14388) 16476 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:32:17.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:17.994 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:17.994 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:18 smithi191 bash[24992]: cluster 2024-08-31T08:32:16.927601+0000 mgr.a (mgr.14388) 16477 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:32:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:18 smithi163 bash[24253]: cluster 2024-08-31T08:32:16.927601+0000 mgr.a (mgr.14388) 16477 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:32:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:18 smithi027 bash[22610]: cluster 2024-08-31T08:32:16.927601+0000 mgr.a (mgr.14388) 16477 : cluster [DBG] pgmap v11422: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:32:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:18.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:32:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:20 smithi191 bash[24992]: audit 2024-08-31T08:32:18.330301+0000 mgr.a (mgr.14388) 16478 : audit [DBG] from='client.355971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:20 smithi191 bash[24992]: cluster 2024-08-31T08:32:18.930427+0000 mgr.a (mgr.14388) 16479 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:32:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:20 smithi163 bash[24253]: audit 2024-08-31T08:32:18.330301+0000 mgr.a (mgr.14388) 16478 : audit [DBG] from='client.355971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:20 smithi163 bash[24253]: cluster 2024-08-31T08:32:18.930427+0000 mgr.a (mgr.14388) 16479 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:32:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:20 smithi027 bash[22610]: audit 2024-08-31T08:32:18.330301+0000 mgr.a (mgr.14388) 16478 : audit [DBG] from='client.355971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:20 smithi027 bash[22610]: cluster 2024-08-31T08:32:18.930427+0000 mgr.a (mgr.14388) 16479 : cluster [DBG] pgmap v11423: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:32:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:22 smithi191 bash[24992]: cluster 2024-08-31T08:32:20.931253+0000 mgr.a (mgr.14388) 16480 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:32:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:22 smithi163 bash[24253]: cluster 2024-08-31T08:32:20.931253+0000 mgr.a (mgr.14388) 16480 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:32:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:22 smithi027 bash[22610]: cluster 2024-08-31T08:32:20.931253+0000 mgr.a (mgr.14388) 16480 : cluster [DBG] pgmap v11424: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:32:23.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:23.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:23.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:24 smithi163 bash[24253]: cluster 2024-08-31T08:32:22.933180+0000 mgr.a (mgr.14388) 16481 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:32:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:24 smithi027 bash[22610]: cluster 2024-08-31T08:32:22.933180+0000 mgr.a (mgr.14388) 16481 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:32:24.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:24.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:24.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:24.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:32:24.488 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:24 smithi191 bash[24992]: cluster 2024-08-31T08:32:22.933180+0000 mgr.a (mgr.14388) 16481 : cluster [DBG] pgmap v11425: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:32:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:26 smithi163 bash[24253]: audit 2024-08-31T08:32:24.071338+0000 mgr.a (mgr.14388) 16482 : audit [DBG] from='client.356046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:26 smithi163 bash[24253]: cluster 2024-08-31T08:32:24.934051+0000 mgr.a (mgr.14388) 16483 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:32:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:26 smithi027 bash[22610]: audit 2024-08-31T08:32:24.071338+0000 mgr.a (mgr.14388) 16482 : audit [DBG] from='client.356046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:26 smithi027 bash[22610]: cluster 2024-08-31T08:32:24.934051+0000 mgr.a (mgr.14388) 16483 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:32:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:26 smithi191 bash[24992]: audit 2024-08-31T08:32:24.071338+0000 mgr.a (mgr.14388) 16482 : audit [DBG] from='client.356046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:26 smithi191 bash[24992]: cluster 2024-08-31T08:32:24.934051+0000 mgr.a (mgr.14388) 16483 : cluster [DBG] pgmap v11426: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:32:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:28 smithi163 bash[24253]: cluster 2024-08-31T08:32:26.934842+0000 mgr.a (mgr.14388) 16484 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:32:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:28 smithi027 bash[22610]: cluster 2024-08-31T08:32:26.934842+0000 mgr.a (mgr.14388) 16484 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:32:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:28 smithi191 bash[24992]: cluster 2024-08-31T08:32:26.934842+0000 mgr.a (mgr.14388) 16484 : cluster [DBG] pgmap v11427: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:32:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:29 smithi163 bash[24253]: cluster 2024-08-31T08:32:28.937025+0000 mgr.a (mgr.14388) 16485 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T08:32:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:29 smithi027 bash[22610]: cluster 2024-08-31T08:32:28.937025+0000 mgr.a (mgr.14388) 16485 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T08:32:29.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:29.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:29.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:29 smithi191 bash[24992]: cluster 2024-08-31T08:32:28.937025+0000 mgr.a (mgr.14388) 16485 : cluster [DBG] pgmap v11428: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T08:32:30.265 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:30.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:30.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:30.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:30.266 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:32:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:30 smithi163 bash[24253]: audit 2024-08-31T08:32:29.828140+0000 mgr.a (mgr.14388) 16486 : audit [DBG] from='client.356124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:30 smithi027 bash[22610]: audit 2024-08-31T08:32:29.828140+0000 mgr.a (mgr.14388) 16486 : audit [DBG] from='client.356124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:30 smithi191 bash[24992]: audit 2024-08-31T08:32:29.828140+0000 mgr.a (mgr.14388) 16486 : audit [DBG] from='client.356124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:31 smithi163 bash[24253]: cluster 2024-08-31T08:32:30.937913+0000 mgr.a (mgr.14388) 16487 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:32:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:31 smithi027 bash[22610]: cluster 2024-08-31T08:32:30.937913+0000 mgr.a (mgr.14388) 16487 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:32:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:31 smithi191 bash[24992]: cluster 2024-08-31T08:32:30.937913+0000 mgr.a (mgr.14388) 16487 : cluster [DBG] pgmap v11429: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:32:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:33 smithi191 bash[24992]: cluster 2024-08-31T08:32:32.940004+0000 mgr.a (mgr.14388) 16488 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:32:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:33 smithi163 bash[24253]: cluster 2024-08-31T08:32:32.940004+0000 mgr.a (mgr.14388) 16488 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:32:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:33 smithi027 bash[22610]: cluster 2024-08-31T08:32:32.940004+0000 mgr.a (mgr.14388) 16488 : cluster [DBG] pgmap v11430: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:32:35.267 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:35.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:35.268 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:36.021 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:36.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:36.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:36.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:36.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:32:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:36 smithi191 bash[24992]: cluster 2024-08-31T08:32:34.940906+0000 mgr.a (mgr.14388) 16489 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:32:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:36 smithi163 bash[24253]: cluster 2024-08-31T08:32:34.940906+0000 mgr.a (mgr.14388) 16489 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:32:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:36 smithi027 bash[22610]: cluster 2024-08-31T08:32:34.940906+0000 mgr.a (mgr.14388) 16489 : cluster [DBG] pgmap v11431: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:32:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:37 smithi191 bash[24992]: audit 2024-08-31T08:32:35.599094+0000 mgr.a (mgr.14388) 16490 : audit [DBG] from='client.356202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:37 smithi163 bash[24253]: audit 2024-08-31T08:32:35.599094+0000 mgr.a (mgr.14388) 16490 : audit [DBG] from='client.356202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:37 smithi027 bash[22610]: audit 2024-08-31T08:32:35.599094+0000 mgr.a (mgr.14388) 16490 : audit [DBG] from='client.356202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:38 smithi191 bash[24992]: cluster 2024-08-31T08:32:36.941991+0000 mgr.a (mgr.14388) 16491 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:32:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:38 smithi163 bash[24253]: cluster 2024-08-31T08:32:36.941991+0000 mgr.a (mgr.14388) 16491 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:32:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:38 smithi027 bash[22610]: cluster 2024-08-31T08:32:36.941991+0000 mgr.a (mgr.14388) 16491 : cluster [DBG] pgmap v11432: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:32:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:40 smithi191 bash[24992]: cluster 2024-08-31T08:32:38.944266+0000 mgr.a (mgr.14388) 16492 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:32:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:40 smithi163 bash[24253]: cluster 2024-08-31T08:32:38.944266+0000 mgr.a (mgr.14388) 16492 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:32:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:40 smithi027 bash[22610]: cluster 2024-08-31T08:32:38.944266+0000 mgr.a (mgr.14388) 16492 : cluster [DBG] pgmap v11433: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:32:41.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:41.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:41.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:41.796 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:41.796 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:41.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:41.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:41.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:32:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:42 smithi191 bash[24992]: cluster 2024-08-31T08:32:40.945002+0000 mgr.a (mgr.14388) 16493 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:42 smithi163 bash[24253]: cluster 2024-08-31T08:32:40.945002+0000 mgr.a (mgr.14388) 16493 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:42 smithi027 bash[22610]: cluster 2024-08-31T08:32:40.945002+0000 mgr.a (mgr.14388) 16493 : cluster [DBG] pgmap v11434: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:43 smithi191 bash[24992]: audit 2024-08-31T08:32:41.359343+0000 mgr.a (mgr.14388) 16494 : audit [DBG] from='client.356280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:43 smithi163 bash[24253]: audit 2024-08-31T08:32:41.359343+0000 mgr.a (mgr.14388) 16494 : audit [DBG] from='client.356280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:43 smithi027 bash[22610]: audit 2024-08-31T08:32:41.359343+0000 mgr.a (mgr.14388) 16494 : audit [DBG] from='client.356280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:44 smithi191 bash[24992]: cluster 2024-08-31T08:32:42.947218+0000 mgr.a (mgr.14388) 16495 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:32:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:44 smithi163 bash[24253]: cluster 2024-08-31T08:32:42.947218+0000 mgr.a (mgr.14388) 16495 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:32:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:44 smithi027 bash[22610]: cluster 2024-08-31T08:32:42.947218+0000 mgr.a (mgr.14388) 16495 : cluster [DBG] pgmap v11435: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:32:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:46 smithi191 bash[24992]: cluster 2024-08-31T08:32:44.947973+0000 mgr.a (mgr.14388) 16496 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:46 smithi163 bash[24253]: cluster 2024-08-31T08:32:44.947973+0000 mgr.a (mgr.14388) 16496 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:46 smithi027 bash[22610]: cluster 2024-08-31T08:32:44.947973+0000 mgr.a (mgr.14388) 16496 : cluster [DBG] pgmap v11436: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:46.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:46.798 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:46.798 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:47.578 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:47.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:47.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:47.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:32:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:48 smithi163 bash[24253]: cluster 2024-08-31T08:32:46.948526+0000 mgr.a (mgr.14388) 16497 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:48 smithi027 bash[22610]: cluster 2024-08-31T08:32:46.948526+0000 mgr.a (mgr.14388) 16497 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:48 smithi191 bash[24992]: cluster 2024-08-31T08:32:46.948526+0000 mgr.a (mgr.14388) 16497 : cluster [DBG] pgmap v11437: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:32:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:49 smithi163 bash[24253]: audit 2024-08-31T08:32:47.136923+0000 mgr.a (mgr.14388) 16498 : audit [DBG] from='client.356358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:49.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:49 smithi027 bash[22610]: audit 2024-08-31T08:32:47.136923+0000 mgr.a (mgr.14388) 16498 : audit [DBG] from='client.356358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:49 smithi191 bash[24992]: audit 2024-08-31T08:32:47.136923+0000 mgr.a (mgr.14388) 16498 : audit [DBG] from='client.356358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:50 smithi163 bash[24253]: cluster 2024-08-31T08:32:48.950865+0000 mgr.a (mgr.14388) 16499 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:32:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:50 smithi027 bash[22610]: cluster 2024-08-31T08:32:48.950865+0000 mgr.a (mgr.14388) 16499 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:32:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:50 smithi191 bash[24992]: cluster 2024-08-31T08:32:48.950865+0000 mgr.a (mgr.14388) 16499 : cluster [DBG] pgmap v11438: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:32:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:51 smithi163 bash[24253]: cluster 2024-08-31T08:32:50.951630+0000 mgr.a (mgr.14388) 16500 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:32:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:51 smithi027 bash[22610]: cluster 2024-08-31T08:32:50.951630+0000 mgr.a (mgr.14388) 16500 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:32:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:51 smithi191 bash[24992]: cluster 2024-08-31T08:32:50.951630+0000 mgr.a (mgr.14388) 16500 : cluster [DBG] pgmap v11439: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:32:52.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:52.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:52.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:53.354 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:53.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:32:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:54 smithi191 bash[24992]: audit 2024-08-31T08:32:52.916137+0000 mgr.a (mgr.14388) 16501 : audit [DBG] from='client.356433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:54 smithi191 bash[24992]: cluster 2024-08-31T08:32:52.953494+0000 mgr.a (mgr.14388) 16502 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:32:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:54 smithi163 bash[24253]: audit 2024-08-31T08:32:52.916137+0000 mgr.a (mgr.14388) 16501 : audit [DBG] from='client.356433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:54 smithi163 bash[24253]: cluster 2024-08-31T08:32:52.953494+0000 mgr.a (mgr.14388) 16502 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:32:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:54 smithi027 bash[22610]: audit 2024-08-31T08:32:52.916137+0000 mgr.a (mgr.14388) 16501 : audit [DBG] from='client.356433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:32:54.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:54 smithi027 bash[22610]: cluster 2024-08-31T08:32:52.953494+0000 mgr.a (mgr.14388) 16502 : cluster [DBG] pgmap v11440: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:32:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:56 smithi191 bash[24992]: cluster 2024-08-31T08:32:54.954384+0000 mgr.a (mgr.14388) 16503 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:32:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:56 smithi163 bash[24253]: cluster 2024-08-31T08:32:54.954384+0000 mgr.a (mgr.14388) 16503 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:32:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:56 smithi027 bash[22610]: cluster 2024-08-31T08:32:54.954384+0000 mgr.a (mgr.14388) 16503 : cluster [DBG] pgmap v11441: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:32:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:32:58 smithi191 bash[24992]: cluster 2024-08-31T08:32:56.955225+0000 mgr.a (mgr.14388) 16504 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:32:58.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:32:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:32:58.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:32:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:32:58 smithi163 bash[24253]: cluster 2024-08-31T08:32:56.955225+0000 mgr.a (mgr.14388) 16504 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:32:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:32:58 smithi027 bash[22610]: cluster 2024-08-31T08:32:56.955225+0000 mgr.a (mgr.14388) 16504 : cluster [DBG] pgmap v11442: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:32:59.092 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:32:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:32:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:32:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:32:59.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:00 smithi191 bash[24992]: audit 2024-08-31T08:32:58.685672+0000 mgr.a (mgr.14388) 16505 : audit [DBG] from='client.356505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:00 smithi191 bash[24992]: cluster 2024-08-31T08:32:58.956543+0000 mgr.a (mgr.14388) 16506 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:33:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:00 smithi163 bash[24253]: audit 2024-08-31T08:32:58.685672+0000 mgr.a (mgr.14388) 16505 : audit [DBG] from='client.356505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:00 smithi163 bash[24253]: cluster 2024-08-31T08:32:58.956543+0000 mgr.a (mgr.14388) 16506 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:33:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:00 smithi027 bash[22610]: audit 2024-08-31T08:32:58.685672+0000 mgr.a (mgr.14388) 16505 : audit [DBG] from='client.356505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:00.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:00 smithi027 bash[22610]: cluster 2024-08-31T08:32:58.956543+0000 mgr.a (mgr.14388) 16506 : cluster [DBG] pgmap v11443: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:33:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:02 smithi191 bash[24992]: cluster 2024-08-31T08:33:00.957394+0000 mgr.a (mgr.14388) 16507 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:33:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:02 smithi163 bash[24253]: cluster 2024-08-31T08:33:00.957394+0000 mgr.a (mgr.14388) 16507 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:33:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:02 smithi027 bash[22610]: cluster 2024-08-31T08:33:00.957394+0000 mgr.a (mgr.14388) 16507 : cluster [DBG] pgmap v11444: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:33:04.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:33:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:33:04.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:33:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:04 smithi191 bash[24992]: cluster 2024-08-31T08:33:02.959555+0000 mgr.a (mgr.14388) 16508 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:04 smithi163 bash[24253]: cluster 2024-08-31T08:33:02.959555+0000 mgr.a (mgr.14388) 16508 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:04 smithi027 bash[22610]: cluster 2024-08-31T08:33:02.959555+0000 mgr.a (mgr.14388) 16508 : cluster [DBG] pgmap v11445: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:04.876 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:33:04.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:33:04.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:33:04.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:33:04.877 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:06 smithi191 bash[24992]: audit 2024-08-31T08:33:04.429064+0000 mgr.a (mgr.14388) 16509 : audit [DBG] from='client.356580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:06 smithi191 bash[24992]: cluster 2024-08-31T08:33:04.960545+0000 mgr.a (mgr.14388) 16510 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:06 smithi163 bash[24253]: audit 2024-08-31T08:33:04.429064+0000 mgr.a (mgr.14388) 16509 : audit [DBG] from='client.356580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:06 smithi163 bash[24253]: cluster 2024-08-31T08:33:04.960545+0000 mgr.a (mgr.14388) 16510 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:06 smithi027 bash[22610]: audit 2024-08-31T08:33:04.429064+0000 mgr.a (mgr.14388) 16509 : audit [DBG] from='client.356580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:06 smithi027 bash[22610]: cluster 2024-08-31T08:33:04.960545+0000 mgr.a (mgr.14388) 16510 : cluster [DBG] pgmap v11446: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:08 smithi163 bash[24253]: cluster 2024-08-31T08:33:06.961366+0000 mgr.a (mgr.14388) 16511 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:08 smithi027 bash[22610]: cluster 2024-08-31T08:33:06.961366+0000 mgr.a (mgr.14388) 16511 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:08.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:08 smithi191 bash[24992]: cluster 2024-08-31T08:33:06.961366+0000 mgr.a (mgr.14388) 16511 : cluster [DBG] pgmap v11447: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:09.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:33:09.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:33:09.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:10 smithi163 bash[24253]: cluster 2024-08-31T08:33:08.963634+0000 mgr.a (mgr.14388) 16512 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:10 smithi027 bash[22610]: cluster 2024-08-31T08:33:08.963634+0000 mgr.a (mgr.14388) 16512 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:10 smithi191 bash[24992]: cluster 2024-08-31T08:33:08.963634+0000 mgr.a (mgr.14388) 16512 : cluster [DBG] pgmap v11448: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:10.650 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:33:10.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:33:10.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:33:10.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:33:10.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:11 smithi163 bash[24253]: audit 2024-08-31T08:33:10.218318+0000 mgr.a (mgr.14388) 16513 : audit [DBG] from='client.356655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:11 smithi163 bash[24253]: cluster 2024-08-31T08:33:10.964577+0000 mgr.a (mgr.14388) 16514 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:11 smithi027 bash[22610]: audit 2024-08-31T08:33:10.218318+0000 mgr.a (mgr.14388) 16513 : audit [DBG] from='client.356655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:11.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:11 smithi027 bash[22610]: cluster 2024-08-31T08:33:10.964577+0000 mgr.a (mgr.14388) 16514 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:11 smithi191 bash[24992]: audit 2024-08-31T08:33:10.218318+0000 mgr.a (mgr.14388) 16513 : audit [DBG] from='client.356655 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:11 smithi191 bash[24992]: cluster 2024-08-31T08:33:10.964577+0000 mgr.a (mgr.14388) 16514 : cluster [DBG] pgmap v11449: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:14 smithi191 bash[24992]: cluster 2024-08-31T08:33:12.966714+0000 mgr.a (mgr.14388) 16515 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:14 smithi163 bash[24253]: cluster 2024-08-31T08:33:12.966714+0000 mgr.a (mgr.14388) 16515 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:14 smithi027 bash[22610]: cluster 2024-08-31T08:33:12.966714+0000 mgr.a (mgr.14388) 16515 : cluster [DBG] pgmap v11450: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:15.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:33:15.652 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:33:15.652 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:33:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:16 smithi191 bash[24992]: cluster 2024-08-31T08:33:14.967498+0000 mgr.a (mgr.14388) 16516 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:16.442 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:33:16.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:33:16.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:33:16.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:33:16.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:16 smithi163 bash[24253]: cluster 2024-08-31T08:33:14.967498+0000 mgr.a (mgr.14388) 16516 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:16 smithi027 bash[22610]: cluster 2024-08-31T08:33:14.967498+0000 mgr.a (mgr.14388) 16516 : cluster [DBG] pgmap v11451: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:17 smithi191 bash[24992]: audit 2024-08-31T08:33:15.989398+0000 mgr.a (mgr.14388) 16517 : audit [DBG] from='client.356733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:17 smithi191 bash[24992]: audit 2024-08-31T08:33:16.033032+0000 mon.a (mon.0) 3039 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:33:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:17 smithi191 bash[24992]: audit 2024-08-31T08:33:16.847554+0000 mon.a (mon.0) 3040 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:33:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:17 smithi191 bash[24992]: audit 2024-08-31T08:33:16.849374+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:33:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:17 smithi191 bash[24992]: audit 2024-08-31T08:33:16.860059+0000 mon.a (mon.0) 3042 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:33:17.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:17 smithi191 bash[24992]: audit 2024-08-31T08:33:16.865016+0000 mon.a (mon.0) 3043 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:33:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:17 smithi163 bash[24253]: audit 2024-08-31T08:33:15.989398+0000 mgr.a (mgr.14388) 16517 : audit [DBG] from='client.356733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:17 smithi163 bash[24253]: audit 2024-08-31T08:33:16.033032+0000 mon.a (mon.0) 3039 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:33:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:17 smithi163 bash[24253]: audit 2024-08-31T08:33:16.847554+0000 mon.a (mon.0) 3040 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:33:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:17 smithi163 bash[24253]: audit 2024-08-31T08:33:16.849374+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:33:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:17 smithi163 bash[24253]: audit 2024-08-31T08:33:16.860059+0000 mon.a (mon.0) 3042 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:33:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:17 smithi163 bash[24253]: audit 2024-08-31T08:33:16.865016+0000 mon.a (mon.0) 3043 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:33:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:17 smithi027 bash[22610]: audit 2024-08-31T08:33:15.989398+0000 mgr.a (mgr.14388) 16517 : audit [DBG] from='client.356733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:17 smithi027 bash[22610]: audit 2024-08-31T08:33:16.033032+0000 mon.a (mon.0) 3039 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:33:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:17 smithi027 bash[22610]: audit 2024-08-31T08:33:16.847554+0000 mon.a (mon.0) 3040 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:33:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:17 smithi027 bash[22610]: audit 2024-08-31T08:33:16.849374+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:33:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:17 smithi027 bash[22610]: audit 2024-08-31T08:33:16.860059+0000 mon.a (mon.0) 3042 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:33:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:17 smithi027 bash[22610]: audit 2024-08-31T08:33:16.865016+0000 mon.a (mon.0) 3043 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:33:17.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:33:17 smithi027 bash[22863]: debug 2024-08-31T08:33:17.620+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:33:17.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:33:17 smithi027 bash[22863]: debug 2024-08-31T08:33:17.620+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:33:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:18 smithi191 bash[24992]: audit 2024-08-31T08:33:16.867870+0000 mgr.a (mgr.14388) 16518 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:33:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:18 smithi191 bash[24992]: cluster 2024-08-31T08:33:16.967995+0000 mgr.a (mgr.14388) 16519 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:18 smithi163 bash[24253]: audit 2024-08-31T08:33:16.867870+0000 mgr.a (mgr.14388) 16518 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:33:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:18 smithi163 bash[24253]: cluster 2024-08-31T08:33:16.967995+0000 mgr.a (mgr.14388) 16519 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:18 smithi027 bash[22610]: audit 2024-08-31T08:33:16.867870+0000 mgr.a (mgr.14388) 16518 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:33:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:18 smithi027 bash[22610]: cluster 2024-08-31T08:33:16.967995+0000 mgr.a (mgr.14388) 16519 : cluster [DBG] pgmap v11452: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:19 smithi163 bash[24253]: audit 2024-08-31T08:33:17.623615+0000 mgr.a (mgr.14388) 16520 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:33:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:19 smithi163 bash[24253]: cephadm 2024-08-31T08:33:17.625130+0000 mgr.a (mgr.14388) 16521 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:33:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:19 smithi027 bash[22610]: audit 2024-08-31T08:33:17.623615+0000 mgr.a (mgr.14388) 16520 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:33:19.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:19 smithi027 bash[22610]: cephadm 2024-08-31T08:33:17.625130+0000 mgr.a (mgr.14388) 16521 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:33:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:19 smithi191 bash[24992]: audit 2024-08-31T08:33:17.623615+0000 mgr.a (mgr.14388) 16520 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:33:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:19 smithi191 bash[24992]: cephadm 2024-08-31T08:33:17.625130+0000 mgr.a (mgr.14388) 16521 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:33:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:20 smithi163 bash[24253]: cluster 2024-08-31T08:33:18.970333+0000 mgr.a (mgr.14388) 16522 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:20 smithi027 bash[22610]: cluster 2024-08-31T08:33:18.970333+0000 mgr.a (mgr.14388) 16522 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:20 smithi191 bash[24992]: cluster 2024-08-31T08:33:18.970333+0000 mgr.a (mgr.14388) 16522 : cluster [DBG] pgmap v11453: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:21.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:33:21.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:33:21.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:33:22.214 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:33:22.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:33:22.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:33:22.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:33:22.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:22 smithi163 bash[24253]: cluster 2024-08-31T08:33:20.971120+0000 mgr.a (mgr.14388) 16523 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:22 smithi027 bash[22610]: cluster 2024-08-31T08:33:20.971120+0000 mgr.a (mgr.14388) 16523 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:22 smithi191 bash[24992]: cluster 2024-08-31T08:33:20.971120+0000 mgr.a (mgr.14388) 16523 : cluster [DBG] pgmap v11454: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:23 smithi163 bash[24253]: audit 2024-08-31T08:33:21.781073+0000 mgr.a (mgr.14388) 16524 : audit [DBG] from='client.356919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:23 smithi027 bash[22610]: audit 2024-08-31T08:33:21.781073+0000 mgr.a (mgr.14388) 16524 : audit [DBG] from='client.356919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:23 smithi191 bash[24992]: audit 2024-08-31T08:33:21.781073+0000 mgr.a (mgr.14388) 16524 : audit [DBG] from='client.356919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:24 smithi163 bash[24253]: cluster 2024-08-31T08:33:22.973436+0000 mgr.a (mgr.14388) 16525 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:24 smithi027 bash[22610]: cluster 2024-08-31T08:33:22.973436+0000 mgr.a (mgr.14388) 16525 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:24 smithi191 bash[24992]: cluster 2024-08-31T08:33:22.973436+0000 mgr.a (mgr.14388) 16525 : cluster [DBG] pgmap v11455: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:25 smithi163 bash[24253]: cluster 2024-08-31T08:33:24.974236+0000 mgr.a (mgr.14388) 16526 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:25 smithi027 bash[22610]: cluster 2024-08-31T08:33:24.974236+0000 mgr.a (mgr.14388) 16526 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:25 smithi191 bash[24992]: cluster 2024-08-31T08:33:24.974236+0000 mgr.a (mgr.14388) 16526 : cluster [DBG] pgmap v11456: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:27.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:33:27.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:33:27.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:33:28.000 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:33:28.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:33:28.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:33:28.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:33:28.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:28 smithi191 bash[24992]: cluster 2024-08-31T08:33:26.975006+0000 mgr.a (mgr.14388) 16527 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:28 smithi163 bash[24253]: cluster 2024-08-31T08:33:26.975006+0000 mgr.a (mgr.14388) 16527 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:28 smithi027 bash[22610]: cluster 2024-08-31T08:33:26.975006+0000 mgr.a (mgr.14388) 16527 : cluster [DBG] pgmap v11457: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:29 smithi191 bash[24992]: audit 2024-08-31T08:33:27.553607+0000 mgr.a (mgr.14388) 16528 : audit [DBG] from='client.356997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:29 smithi163 bash[24253]: audit 2024-08-31T08:33:27.553607+0000 mgr.a (mgr.14388) 16528 : audit [DBG] from='client.356997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:29 smithi027 bash[22610]: audit 2024-08-31T08:33:27.553607+0000 mgr.a (mgr.14388) 16528 : audit [DBG] from='client.356997 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:30 smithi163 bash[24253]: cluster 2024-08-31T08:33:28.977453+0000 mgr.a (mgr.14388) 16529 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:30 smithi027 bash[22610]: cluster 2024-08-31T08:33:28.977453+0000 mgr.a (mgr.14388) 16529 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:30 smithi191 bash[24992]: cluster 2024-08-31T08:33:28.977453+0000 mgr.a (mgr.14388) 16529 : cluster [DBG] pgmap v11458: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:33:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:32 smithi163 bash[24253]: cluster 2024-08-31T08:33:30.978216+0000 mgr.a (mgr.14388) 16530 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:33:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:32 smithi027 bash[22610]: cluster 2024-08-31T08:33:30.978216+0000 mgr.a (mgr.14388) 16530 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:33:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:32 smithi191 bash[24992]: cluster 2024-08-31T08:33:30.978216+0000 mgr.a (mgr.14388) 16530 : cluster [DBG] pgmap v11459: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:33:33.002 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:33:33.003 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:33:33.003 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:33:33.780 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:33:33.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:33:33.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:33:33.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:33:33.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:34 smithi163 bash[24253]: cluster 2024-08-31T08:33:32.980148+0000 mgr.a (mgr.14388) 16531 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:34 smithi027 bash[22610]: cluster 2024-08-31T08:33:32.980148+0000 mgr.a (mgr.14388) 16531 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:34 smithi191 bash[24992]: cluster 2024-08-31T08:33:32.980148+0000 mgr.a (mgr.14388) 16531 : cluster [DBG] pgmap v11460: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:35 smithi163 bash[24253]: audit 2024-08-31T08:33:33.340983+0000 mgr.a (mgr.14388) 16532 : audit [DBG] from='client.357069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:35 smithi027 bash[22610]: audit 2024-08-31T08:33:33.340983+0000 mgr.a (mgr.14388) 16532 : audit [DBG] from='client.357069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:35 smithi191 bash[24992]: audit 2024-08-31T08:33:33.340983+0000 mgr.a (mgr.14388) 16532 : audit [DBG] from='client.357069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:36 smithi163 bash[24253]: cluster 2024-08-31T08:33:34.981115+0000 mgr.a (mgr.14388) 16533 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:33:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:36 smithi027 bash[22610]: cluster 2024-08-31T08:33:34.981115+0000 mgr.a (mgr.14388) 16533 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:33:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:36 smithi191 bash[24992]: cluster 2024-08-31T08:33:34.981115+0000 mgr.a (mgr.14388) 16533 : cluster [DBG] pgmap v11461: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:33:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:38 smithi163 bash[24253]: cluster 2024-08-31T08:33:36.981891+0000 mgr.a (mgr.14388) 16534 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:33:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:38 smithi027 bash[22610]: cluster 2024-08-31T08:33:36.981891+0000 mgr.a (mgr.14388) 16534 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:33:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:38 smithi191 bash[24992]: cluster 2024-08-31T08:33:36.981891+0000 mgr.a (mgr.14388) 16534 : cluster [DBG] pgmap v11462: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:33:38.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:33:38.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:33:38.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:33:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:39 smithi163 bash[24253]: cluster 2024-08-31T08:33:38.984090+0000 mgr.a (mgr.14388) 16535 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:39 smithi027 bash[22610]: cluster 2024-08-31T08:33:38.984090+0000 mgr.a (mgr.14388) 16535 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:39 smithi191 bash[24992]: cluster 2024-08-31T08:33:38.984090+0000 mgr.a (mgr.14388) 16535 : cluster [DBG] pgmap v11463: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:39.561 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:33:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:33:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:33:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:33:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:40.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:40 smithi163 bash[24253]: audit 2024-08-31T08:33:39.119534+0000 mgr.a (mgr.14388) 16536 : audit [DBG] from='client.357147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:40 smithi027 bash[22610]: audit 2024-08-31T08:33:39.119534+0000 mgr.a (mgr.14388) 16536 : audit [DBG] from='client.357147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:40 smithi191 bash[24992]: audit 2024-08-31T08:33:39.119534+0000 mgr.a (mgr.14388) 16536 : audit [DBG] from='client.357147 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:41 smithi163 bash[24253]: cluster 2024-08-31T08:33:40.985033+0000 mgr.a (mgr.14388) 16537 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:33:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:41 smithi027 bash[22610]: cluster 2024-08-31T08:33:40.985033+0000 mgr.a (mgr.14388) 16537 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:33:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:41 smithi191 bash[24992]: cluster 2024-08-31T08:33:40.985033+0000 mgr.a (mgr.14388) 16537 : cluster [DBG] pgmap v11464: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:33:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:44 smithi163 bash[24253]: cluster 2024-08-31T08:33:42.987205+0000 mgr.a (mgr.14388) 16538 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:33:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:44 smithi027 bash[22610]: cluster 2024-08-31T08:33:42.987205+0000 mgr.a (mgr.14388) 16538 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:33:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:44 smithi191 bash[24992]: cluster 2024-08-31T08:33:42.987205+0000 mgr.a (mgr.14388) 16538 : cluster [DBG] pgmap v11465: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:33:44.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:33:44.564 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:33:44.564 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:33:45.309 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:33:45.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:33:45.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:33:45.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:33:45.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:46 smithi163 bash[24253]: audit 2024-08-31T08:33:44.892260+0000 mgr.a (mgr.14388) 16539 : audit [DBG] from='client.357222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:46 smithi163 bash[24253]: cluster 2024-08-31T08:33:44.987680+0000 mgr.a (mgr.14388) 16540 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:46 smithi027 bash[22610]: audit 2024-08-31T08:33:44.892260+0000 mgr.a (mgr.14388) 16539 : audit [DBG] from='client.357222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:46.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:46 smithi027 bash[22610]: cluster 2024-08-31T08:33:44.987680+0000 mgr.a (mgr.14388) 16540 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:46 smithi191 bash[24992]: audit 2024-08-31T08:33:44.892260+0000 mgr.a (mgr.14388) 16539 : audit [DBG] from='client.357222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:46 smithi191 bash[24992]: cluster 2024-08-31T08:33:44.987680+0000 mgr.a (mgr.14388) 16540 : cluster [DBG] pgmap v11466: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:48 smithi163 bash[24253]: cluster 2024-08-31T08:33:46.988554+0000 mgr.a (mgr.14388) 16541 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:48 smithi027 bash[22610]: cluster 2024-08-31T08:33:46.988554+0000 mgr.a (mgr.14388) 16541 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:48 smithi191 bash[24992]: cluster 2024-08-31T08:33:46.988554+0000 mgr.a (mgr.14388) 16541 : cluster [DBG] pgmap v11467: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:50.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:33:50.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:33:50.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:33:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:50 smithi163 bash[24253]: cluster 2024-08-31T08:33:48.990807+0000 mgr.a (mgr.14388) 16542 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:50 smithi027 bash[22610]: cluster 2024-08-31T08:33:48.990807+0000 mgr.a (mgr.14388) 16542 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:50 smithi191 bash[24992]: cluster 2024-08-31T08:33:48.990807+0000 mgr.a (mgr.14388) 16542 : cluster [DBG] pgmap v11468: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:51.076 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:33:51.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:33:51.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:33:51.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:33:51.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:52 smithi163 bash[24253]: audit 2024-08-31T08:33:50.645677+0000 mgr.a (mgr.14388) 16543 : audit [DBG] from='client.357300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:52 smithi163 bash[24253]: cluster 2024-08-31T08:33:50.991317+0000 mgr.a (mgr.14388) 16544 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:52 smithi027 bash[22610]: audit 2024-08-31T08:33:50.645677+0000 mgr.a (mgr.14388) 16543 : audit [DBG] from='client.357300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:52.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:52 smithi027 bash[22610]: cluster 2024-08-31T08:33:50.991317+0000 mgr.a (mgr.14388) 16544 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:52 smithi191 bash[24992]: audit 2024-08-31T08:33:50.645677+0000 mgr.a (mgr.14388) 16543 : audit [DBG] from='client.357300 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:52 smithi191 bash[24992]: cluster 2024-08-31T08:33:50.991317+0000 mgr.a (mgr.14388) 16544 : cluster [DBG] pgmap v11469: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:54 smithi163 bash[24253]: cluster 2024-08-31T08:33:52.993390+0000 mgr.a (mgr.14388) 16545 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:54 smithi027 bash[22610]: cluster 2024-08-31T08:33:52.993390+0000 mgr.a (mgr.14388) 16545 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:54 smithi191 bash[24992]: cluster 2024-08-31T08:33:52.993390+0000 mgr.a (mgr.14388) 16545 : cluster [DBG] pgmap v11470: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:56.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:33:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:33:56.079 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:33:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:56 smithi163 bash[24253]: cluster 2024-08-31T08:33:54.994156+0000 mgr.a (mgr.14388) 16546 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:56 smithi027 bash[22610]: cluster 2024-08-31T08:33:54.994156+0000 mgr.a (mgr.14388) 16546 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:56 smithi191 bash[24992]: cluster 2024-08-31T08:33:54.994156+0000 mgr.a (mgr.14388) 16546 : cluster [DBG] pgmap v11471: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:56.837 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:33:56.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:33:56.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:33:56.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:33:56.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:33:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:58 smithi163 bash[24253]: audit 2024-08-31T08:33:56.406871+0000 mgr.a (mgr.14388) 16547 : audit [DBG] from='client.357378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:58 smithi163 bash[24253]: cluster 2024-08-31T08:33:56.995138+0000 mgr.a (mgr.14388) 16548 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:58 smithi027 bash[22610]: audit 2024-08-31T08:33:56.406871+0000 mgr.a (mgr.14388) 16547 : audit [DBG] from='client.357378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:58.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:58 smithi027 bash[22610]: cluster 2024-08-31T08:33:56.995138+0000 mgr.a (mgr.14388) 16548 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:58 smithi191 bash[24992]: audit 2024-08-31T08:33:56.406871+0000 mgr.a (mgr.14388) 16547 : audit [DBG] from='client.357378 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:33:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:58 smithi191 bash[24992]: cluster 2024-08-31T08:33:56.995138+0000 mgr.a (mgr.14388) 16548 : cluster [DBG] pgmap v11472: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:33:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:33:59 smithi163 bash[24253]: cluster 2024-08-31T08:33:58.997381+0000 mgr.a (mgr.14388) 16549 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:33:59 smithi027 bash[22610]: cluster 2024-08-31T08:33:58.997381+0000 mgr.a (mgr.14388) 16549 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:33:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:33:59 smithi191 bash[24992]: cluster 2024-08-31T08:33:58.997381+0000 mgr.a (mgr.14388) 16549 : cluster [DBG] pgmap v11473: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:34:01.838 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:01.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:01.839 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:34:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:02 smithi163 bash[24253]: cluster 2024-08-31T08:34:00.998141+0000 mgr.a (mgr.14388) 16550 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:02 smithi027 bash[22610]: cluster 2024-08-31T08:34:00.998141+0000 mgr.a (mgr.14388) 16550 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:02 smithi191 bash[24992]: cluster 2024-08-31T08:34:00.998141+0000 mgr.a (mgr.14388) 16550 : cluster [DBG] pgmap v11474: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:02.625 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:34:02.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:34:02.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:34:02.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:34:02.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:34:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:04 smithi163 bash[24253]: audit 2024-08-31T08:34:02.177570+0000 mgr.a (mgr.14388) 16551 : audit [DBG] from='client.357456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:04 smithi163 bash[24253]: cluster 2024-08-31T08:34:03.000627+0000 mgr.a (mgr.14388) 16552 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:34:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:04 smithi027 bash[22610]: audit 2024-08-31T08:34:02.177570+0000 mgr.a (mgr.14388) 16551 : audit [DBG] from='client.357456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:04 smithi027 bash[22610]: cluster 2024-08-31T08:34:03.000627+0000 mgr.a (mgr.14388) 16552 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:34:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:04 smithi191 bash[24992]: audit 2024-08-31T08:34:02.177570+0000 mgr.a (mgr.14388) 16551 : audit [DBG] from='client.357456 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:04 smithi191 bash[24992]: cluster 2024-08-31T08:34:03.000627+0000 mgr.a (mgr.14388) 16552 : cluster [DBG] pgmap v11475: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:34:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:06 smithi163 bash[24253]: cluster 2024-08-31T08:34:05.001598+0000 mgr.a (mgr.14388) 16553 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:06 smithi027 bash[22610]: cluster 2024-08-31T08:34:05.001598+0000 mgr.a (mgr.14388) 16553 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:06 smithi191 bash[24992]: cluster 2024-08-31T08:34:05.001598+0000 mgr.a (mgr.14388) 16553 : cluster [DBG] pgmap v11476: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:07.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:07.627 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:07.628 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:34:08.404 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:34:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:34:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:34:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:34:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:34:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:08 smithi163 bash[24253]: cluster 2024-08-31T08:34:07.002549+0000 mgr.a (mgr.14388) 16554 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:08 smithi027 bash[22610]: cluster 2024-08-31T08:34:07.002549+0000 mgr.a (mgr.14388) 16554 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:08 smithi191 bash[24992]: cluster 2024-08-31T08:34:07.002549+0000 mgr.a (mgr.14388) 16554 : cluster [DBG] pgmap v11477: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:09 smithi163 bash[24253]: audit 2024-08-31T08:34:07.963278+0000 mgr.a (mgr.14388) 16555 : audit [DBG] from='client.357531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:09 smithi027 bash[22610]: audit 2024-08-31T08:34:07.963278+0000 mgr.a (mgr.14388) 16555 : audit [DBG] from='client.357531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:09 smithi191 bash[24992]: audit 2024-08-31T08:34:07.963278+0000 mgr.a (mgr.14388) 16555 : audit [DBG] from='client.357531 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:10 smithi163 bash[24253]: cluster 2024-08-31T08:34:09.005497+0000 mgr.a (mgr.14388) 16556 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:10 smithi027 bash[22610]: cluster 2024-08-31T08:34:09.005497+0000 mgr.a (mgr.14388) 16556 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:10 smithi191 bash[24992]: cluster 2024-08-31T08:34:09.005497+0000 mgr.a (mgr.14388) 16556 : cluster [DBG] pgmap v11478: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:12 smithi163 bash[24253]: cluster 2024-08-31T08:34:11.006303+0000 mgr.a (mgr.14388) 16557 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:34:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:12 smithi027 bash[22610]: cluster 2024-08-31T08:34:11.006303+0000 mgr.a (mgr.14388) 16557 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:34:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:12 smithi191 bash[24992]: cluster 2024-08-31T08:34:11.006303+0000 mgr.a (mgr.14388) 16557 : cluster [DBG] pgmap v11479: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:34:13.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:13.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:13.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:34:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:13 smithi163 bash[24253]: cluster 2024-08-31T08:34:13.008253+0000 mgr.a (mgr.14388) 16558 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:13 smithi027 bash[22610]: cluster 2024-08-31T08:34:13.008253+0000 mgr.a (mgr.14388) 16558 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:13 smithi191 bash[24992]: cluster 2024-08-31T08:34:13.008253+0000 mgr.a (mgr.14388) 16558 : cluster [DBG] pgmap v11480: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:14.190 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:34:14.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:34:14.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:34:14.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:34:14.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:34:14.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:14 smithi163 bash[24253]: audit 2024-08-31T08:34:13.741111+0000 mgr.a (mgr.14388) 16559 : audit [DBG] from='client.357609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:14 smithi027 bash[22610]: audit 2024-08-31T08:34:13.741111+0000 mgr.a (mgr.14388) 16559 : audit [DBG] from='client.357609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:14 smithi191 bash[24992]: audit 2024-08-31T08:34:13.741111+0000 mgr.a (mgr.14388) 16559 : audit [DBG] from='client.357609 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:15 smithi163 bash[24253]: cluster 2024-08-31T08:34:15.009236+0000 mgr.a (mgr.14388) 16560 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:34:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:15 smithi027 bash[22610]: cluster 2024-08-31T08:34:15.009236+0000 mgr.a (mgr.14388) 16560 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:34:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:15 smithi191 bash[24992]: cluster 2024-08-31T08:34:15.009236+0000 mgr.a (mgr.14388) 16560 : cluster [DBG] pgmap v11481: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:34:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:18 smithi163 bash[24253]: cluster 2024-08-31T08:34:17.010022+0000 mgr.a (mgr.14388) 16561 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:34:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:18 smithi163 bash[24253]: audit 2024-08-31T08:34:17.680084+0000 mon.a (mon.0) 3044 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:34:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:18 smithi027 bash[22610]: cluster 2024-08-31T08:34:17.010022+0000 mgr.a (mgr.14388) 16561 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:34:18.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:18 smithi027 bash[22610]: audit 2024-08-31T08:34:17.680084+0000 mon.a (mon.0) 3044 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:34:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:18 smithi191 bash[24992]: cluster 2024-08-31T08:34:17.010022+0000 mgr.a (mgr.14388) 16561 : cluster [DBG] pgmap v11482: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:34:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:18 smithi191 bash[24992]: audit 2024-08-31T08:34:17.680084+0000 mon.a (mon.0) 3044 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:34:19.191 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:19.192 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:19.192 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:34:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:19 smithi163 bash[24253]: audit 2024-08-31T08:34:18.308241+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:34:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:19 smithi163 bash[24253]: audit 2024-08-31T08:34:18.313921+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:34:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:19 smithi163 bash[24253]: cluster 2024-08-31T08:34:19.011104+0000 mgr.a (mgr.14388) 16562 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:19 smithi163 bash[24253]: audit 2024-08-31T08:34:19.123751+0000 mon.a (mon.0) 3047 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:34:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:19 smithi163 bash[24253]: audit 2024-08-31T08:34:19.125299+0000 mon.a (mon.0) 3048 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:34:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:19 smithi163 bash[24253]: audit 2024-08-31T08:34:19.134286+0000 mon.a (mon.0) 3049 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:34:19.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:19 smithi163 bash[24253]: audit 2024-08-31T08:34:19.136956+0000 mon.a (mon.0) 3050 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:34:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:19 smithi027 bash[22610]: audit 2024-08-31T08:34:18.308241+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:34:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:19 smithi027 bash[22610]: audit 2024-08-31T08:34:18.313921+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:34:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:19 smithi027 bash[22610]: cluster 2024-08-31T08:34:19.011104+0000 mgr.a (mgr.14388) 16562 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:19 smithi027 bash[22610]: audit 2024-08-31T08:34:19.123751+0000 mon.a (mon.0) 3047 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:34:19.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:19 smithi027 bash[22610]: audit 2024-08-31T08:34:19.125299+0000 mon.a (mon.0) 3048 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:34:19.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:19 smithi027 bash[22610]: audit 2024-08-31T08:34:19.134286+0000 mon.a (mon.0) 3049 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:34:19.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:19 smithi027 bash[22610]: audit 2024-08-31T08:34:19.136956+0000 mon.a (mon.0) 3050 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:34:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:19 smithi191 bash[24992]: audit 2024-08-31T08:34:18.308241+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:34:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:19 smithi191 bash[24992]: audit 2024-08-31T08:34:18.313921+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:34:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:19 smithi191 bash[24992]: cluster 2024-08-31T08:34:19.011104+0000 mgr.a (mgr.14388) 16562 : cluster [DBG] pgmap v11483: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:19 smithi191 bash[24992]: audit 2024-08-31T08:34:19.123751+0000 mon.a (mon.0) 3047 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:34:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:19 smithi191 bash[24992]: audit 2024-08-31T08:34:19.125299+0000 mon.a (mon.0) 3048 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:34:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:19 smithi191 bash[24992]: audit 2024-08-31T08:34:19.134286+0000 mon.a (mon.0) 3049 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:34:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:19 smithi191 bash[24992]: audit 2024-08-31T08:34:19.136956+0000 mon.a (mon.0) 3050 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:34:20.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:34:19 smithi027 bash[22863]: debug 2024-08-31T08:34:19.867+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:34:20.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:34:19 smithi027 bash[22863]: debug 2024-08-31T08:34:19.879+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:34:20.270 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:34:20.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:34:20.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:34:20.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:34:20.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:34:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:20 smithi163 bash[24253]: audit 2024-08-31T08:34:19.139281+0000 mgr.a (mgr.14388) 16563 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:34:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:20 smithi163 bash[24253]: audit 2024-08-31T08:34:19.547552+0000 mgr.a (mgr.14388) 16564 : audit [DBG] from='client.357702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:20 smithi163 bash[24253]: audit 2024-08-31T08:34:19.872630+0000 mgr.a (mgr.14388) 16565 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:34:20.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:20 smithi163 bash[24253]: cephadm 2024-08-31T08:34:19.884042+0000 mgr.a (mgr.14388) 16566 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:34:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:20 smithi027 bash[22610]: audit 2024-08-31T08:34:19.139281+0000 mgr.a (mgr.14388) 16563 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:34:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:20 smithi027 bash[22610]: audit 2024-08-31T08:34:19.547552+0000 mgr.a (mgr.14388) 16564 : audit [DBG] from='client.357702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:20 smithi027 bash[22610]: audit 2024-08-31T08:34:19.872630+0000 mgr.a (mgr.14388) 16565 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:34:20.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:20 smithi027 bash[22610]: cephadm 2024-08-31T08:34:19.884042+0000 mgr.a (mgr.14388) 16566 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:34:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:20 smithi191 bash[24992]: audit 2024-08-31T08:34:19.139281+0000 mgr.a (mgr.14388) 16563 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:34:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:20 smithi191 bash[24992]: audit 2024-08-31T08:34:19.547552+0000 mgr.a (mgr.14388) 16564 : audit [DBG] from='client.357702 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:20 smithi191 bash[24992]: audit 2024-08-31T08:34:19.872630+0000 mgr.a (mgr.14388) 16565 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:34:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:20 smithi191 bash[24992]: cephadm 2024-08-31T08:34:19.884042+0000 mgr.a (mgr.14388) 16566 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:34:21.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:21 smithi163 bash[24253]: cluster 2024-08-31T08:34:21.012104+0000 mgr.a (mgr.14388) 16567 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:21 smithi027 bash[22610]: cluster 2024-08-31T08:34:21.012104+0000 mgr.a (mgr.14388) 16567 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:21 smithi191 bash[24992]: cluster 2024-08-31T08:34:21.012104+0000 mgr.a (mgr.14388) 16567 : cluster [DBG] pgmap v11484: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:24 smithi163 bash[24253]: cluster 2024-08-31T08:34:23.014448+0000 mgr.a (mgr.14388) 16568 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:24 smithi027 bash[22610]: cluster 2024-08-31T08:34:23.014448+0000 mgr.a (mgr.14388) 16568 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:24 smithi191 bash[24992]: cluster 2024-08-31T08:34:23.014448+0000 mgr.a (mgr.14388) 16568 : cluster [DBG] pgmap v11485: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:25.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:25.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:25.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:34:26.060 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:34:26.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:34:26.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:34:26.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:34:26.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:34:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:26 smithi163 bash[24253]: cluster 2024-08-31T08:34:25.015417+0000 mgr.a (mgr.14388) 16569 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:26 smithi027 bash[22610]: cluster 2024-08-31T08:34:25.015417+0000 mgr.a (mgr.14388) 16569 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:26 smithi191 bash[24992]: cluster 2024-08-31T08:34:25.015417+0000 mgr.a (mgr.14388) 16569 : cluster [DBG] pgmap v11486: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:27 smithi163 bash[24253]: audit 2024-08-31T08:34:25.608220+0000 mgr.a (mgr.14388) 16570 : audit [DBG] from='client.357867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:27 smithi027 bash[22610]: audit 2024-08-31T08:34:25.608220+0000 mgr.a (mgr.14388) 16570 : audit [DBG] from='client.357867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:27 smithi191 bash[24992]: audit 2024-08-31T08:34:25.608220+0000 mgr.a (mgr.14388) 16570 : audit [DBG] from='client.357867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:28 smithi163 bash[24253]: cluster 2024-08-31T08:34:27.016394+0000 mgr.a (mgr.14388) 16571 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:28 smithi027 bash[22610]: cluster 2024-08-31T08:34:27.016394+0000 mgr.a (mgr.14388) 16571 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:28 smithi191 bash[24992]: cluster 2024-08-31T08:34:27.016394+0000 mgr.a (mgr.14388) 16571 : cluster [DBG] pgmap v11487: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:29 smithi163 bash[24253]: cluster 2024-08-31T08:34:29.018634+0000 mgr.a (mgr.14388) 16572 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:29 smithi027 bash[22610]: cluster 2024-08-31T08:34:29.018634+0000 mgr.a (mgr.14388) 16572 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:29 smithi191 bash[24992]: cluster 2024-08-31T08:34:29.018634+0000 mgr.a (mgr.14388) 16572 : cluster [DBG] pgmap v11488: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:31.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:31.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:34:31.808 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:34:31.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:34:31.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:34:31.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:34:31.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:34:32.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:32 smithi163 bash[24253]: cluster 2024-08-31T08:34:31.019396+0000 mgr.a (mgr.14388) 16573 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:32 smithi027 bash[22610]: cluster 2024-08-31T08:34:31.019396+0000 mgr.a (mgr.14388) 16573 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:32 smithi191 bash[24992]: cluster 2024-08-31T08:34:31.019396+0000 mgr.a (mgr.14388) 16573 : cluster [DBG] pgmap v11489: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:33 smithi163 bash[24253]: audit 2024-08-31T08:34:31.391003+0000 mgr.a (mgr.14388) 16574 : audit [DBG] from='client.357945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:33 smithi027 bash[22610]: audit 2024-08-31T08:34:31.391003+0000 mgr.a (mgr.14388) 16574 : audit [DBG] from='client.357945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:33 smithi191 bash[24992]: audit 2024-08-31T08:34:31.391003+0000 mgr.a (mgr.14388) 16574 : audit [DBG] from='client.357945 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:34 smithi163 bash[24253]: cluster 2024-08-31T08:34:33.021642+0000 mgr.a (mgr.14388) 16575 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:34 smithi027 bash[22610]: cluster 2024-08-31T08:34:33.021642+0000 mgr.a (mgr.14388) 16575 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:34 smithi191 bash[24992]: cluster 2024-08-31T08:34:33.021642+0000 mgr.a (mgr.14388) 16575 : cluster [DBG] pgmap v11490: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:34:36.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:36 smithi163 bash[24253]: cluster 2024-08-31T08:34:35.022432+0000 mgr.a (mgr.14388) 16576 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:36 smithi027 bash[22610]: cluster 2024-08-31T08:34:35.022432+0000 mgr.a (mgr.14388) 16576 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:36 smithi191 bash[24992]: cluster 2024-08-31T08:34:35.022432+0000 mgr.a (mgr.14388) 16576 : cluster [DBG] pgmap v11491: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:36.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:36.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:36.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:34:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:37 smithi163 bash[24253]: cluster 2024-08-31T08:34:37.023195+0000 mgr.a (mgr.14388) 16577 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:37 smithi027 bash[22610]: cluster 2024-08-31T08:34:37.023195+0000 mgr.a (mgr.14388) 16577 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:37 smithi191 bash[24992]: cluster 2024-08-31T08:34:37.023195+0000 mgr.a (mgr.14388) 16577 : cluster [DBG] pgmap v11492: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:37.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:34:37.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:34:37.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:34:37.563 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:34:37.563 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:34:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:38 smithi163 bash[24253]: audit 2024-08-31T08:34:37.139586+0000 mgr.a (mgr.14388) 16578 : audit [DBG] from='client.358023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:38 smithi027 bash[22610]: audit 2024-08-31T08:34:37.139586+0000 mgr.a (mgr.14388) 16578 : audit [DBG] from='client.358023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:38 smithi191 bash[24992]: audit 2024-08-31T08:34:37.139586+0000 mgr.a (mgr.14388) 16578 : audit [DBG] from='client.358023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:39 smithi163 bash[24253]: cluster 2024-08-31T08:34:39.025552+0000 mgr.a (mgr.14388) 16579 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:34:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:39 smithi027 bash[22610]: cluster 2024-08-31T08:34:39.025552+0000 mgr.a (mgr.14388) 16579 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:34:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:39 smithi191 bash[24992]: cluster 2024-08-31T08:34:39.025552+0000 mgr.a (mgr.14388) 16579 : cluster [DBG] pgmap v11493: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:34:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:42 smithi163 bash[24253]: cluster 2024-08-31T08:34:41.026315+0000 mgr.a (mgr.14388) 16580 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:42 smithi027 bash[22610]: cluster 2024-08-31T08:34:41.026315+0000 mgr.a (mgr.14388) 16580 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:42 smithi191 bash[24992]: cluster 2024-08-31T08:34:41.026315+0000 mgr.a (mgr.14388) 16580 : cluster [DBG] pgmap v11494: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:42.565 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:34:43.333 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:34:43.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:34:43.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:34:43.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:34:43.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:34:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:43 smithi163 bash[24253]: audit 2024-08-31T08:34:42.902292+0000 mgr.a (mgr.14388) 16581 : audit [DBG] from='client.358098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:43 smithi163 bash[24253]: cluster 2024-08-31T08:34:43.027586+0000 mgr.a (mgr.14388) 16582 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:43 smithi027 bash[22610]: audit 2024-08-31T08:34:42.902292+0000 mgr.a (mgr.14388) 16581 : audit [DBG] from='client.358098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:43.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:43 smithi027 bash[22610]: cluster 2024-08-31T08:34:43.027586+0000 mgr.a (mgr.14388) 16582 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:43 smithi191 bash[24992]: audit 2024-08-31T08:34:42.902292+0000 mgr.a (mgr.14388) 16581 : audit [DBG] from='client.358098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:43 smithi191 bash[24992]: cluster 2024-08-31T08:34:43.027586+0000 mgr.a (mgr.14388) 16582 : cluster [DBG] pgmap v11495: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:46.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:46 smithi163 bash[24253]: cluster 2024-08-31T08:34:45.028607+0000 mgr.a (mgr.14388) 16583 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:34:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:46 smithi027 bash[22610]: cluster 2024-08-31T08:34:45.028607+0000 mgr.a (mgr.14388) 16583 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:34:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:46 smithi191 bash[24992]: cluster 2024-08-31T08:34:45.028607+0000 mgr.a (mgr.14388) 16583 : cluster [DBG] pgmap v11496: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:34:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:47 smithi163 bash[24253]: cluster 2024-08-31T08:34:47.029589+0000 mgr.a (mgr.14388) 16584 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:34:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:47 smithi027 bash[22610]: cluster 2024-08-31T08:34:47.029589+0000 mgr.a (mgr.14388) 16584 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:34:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:47 smithi191 bash[24992]: cluster 2024-08-31T08:34:47.029589+0000 mgr.a (mgr.14388) 16584 : cluster [DBG] pgmap v11497: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:34:48.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:48.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:48.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:34:49.125 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:34:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:34:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:34:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:34:49.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:34:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:50 smithi163 bash[24253]: audit 2024-08-31T08:34:48.672107+0000 mgr.a (mgr.14388) 16585 : audit [DBG] from='client.358173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:50 smithi163 bash[24253]: cluster 2024-08-31T08:34:49.031053+0000 mgr.a (mgr.14388) 16586 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:50 smithi027 bash[22610]: audit 2024-08-31T08:34:48.672107+0000 mgr.a (mgr.14388) 16585 : audit [DBG] from='client.358173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:50 smithi027 bash[22610]: cluster 2024-08-31T08:34:49.031053+0000 mgr.a (mgr.14388) 16586 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:50 smithi191 bash[24992]: audit 2024-08-31T08:34:48.672107+0000 mgr.a (mgr.14388) 16585 : audit [DBG] from='client.358173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:50 smithi191 bash[24992]: cluster 2024-08-31T08:34:49.031053+0000 mgr.a (mgr.14388) 16586 : cluster [DBG] pgmap v11498: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:51 smithi163 bash[24253]: cluster 2024-08-31T08:34:51.031773+0000 mgr.a (mgr.14388) 16587 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:34:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:51 smithi027 bash[22610]: cluster 2024-08-31T08:34:51.031773+0000 mgr.a (mgr.14388) 16587 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:34:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:51 smithi191 bash[24992]: cluster 2024-08-31T08:34:51.031773+0000 mgr.a (mgr.14388) 16587 : cluster [DBG] pgmap v11499: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:34:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:53 smithi163 bash[24253]: cluster 2024-08-31T08:34:53.033703+0000 mgr.a (mgr.14388) 16588 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:53 smithi027 bash[22610]: cluster 2024-08-31T08:34:53.033703+0000 mgr.a (mgr.14388) 16588 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:53 smithi191 bash[24992]: cluster 2024-08-31T08:34:53.033703+0000 mgr.a (mgr.14388) 16588 : cluster [DBG] pgmap v11500: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:54.127 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:54.127 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:54.128 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:34:54.908 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:34:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:34:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:34:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:34:54.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:34:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:55 smithi163 bash[24253]: audit 2024-08-31T08:34:54.463946+0000 mgr.a (mgr.14388) 16589 : audit [DBG] from='client.358248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:55 smithi163 bash[24253]: cluster 2024-08-31T08:34:55.034649+0000 mgr.a (mgr.14388) 16590 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:55 smithi027 bash[22610]: audit 2024-08-31T08:34:54.463946+0000 mgr.a (mgr.14388) 16589 : audit [DBG] from='client.358248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:55 smithi027 bash[22610]: cluster 2024-08-31T08:34:55.034649+0000 mgr.a (mgr.14388) 16590 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:55 smithi191 bash[24992]: audit 2024-08-31T08:34:54.463946+0000 mgr.a (mgr.14388) 16589 : audit [DBG] from='client.358248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:34:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:55 smithi191 bash[24992]: cluster 2024-08-31T08:34:55.034649+0000 mgr.a (mgr.14388) 16590 : cluster [DBG] pgmap v11501: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:57 smithi163 bash[24253]: cluster 2024-08-31T08:34:57.035464+0000 mgr.a (mgr.14388) 16591 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:57 smithi027 bash[22610]: cluster 2024-08-31T08:34:57.035464+0000 mgr.a (mgr.14388) 16591 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:57 smithi191 bash[24992]: cluster 2024-08-31T08:34:57.035464+0000 mgr.a (mgr.14388) 16591 : cluster [DBG] pgmap v11502: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:34:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:34:59 smithi163 bash[24253]: cluster 2024-08-31T08:34:59.037627+0000 mgr.a (mgr.14388) 16592 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:34:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:34:59 smithi027 bash[22610]: cluster 2024-08-31T08:34:59.037627+0000 mgr.a (mgr.14388) 16592 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:34:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:34:59 smithi191 bash[24992]: cluster 2024-08-31T08:34:59.037627+0000 mgr.a (mgr.14388) 16592 : cluster [DBG] pgmap v11503: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:34:59.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:34:59.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:34:59.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:00.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:00.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:00.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:00.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:00.689 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:01 smithi163 bash[24253]: audit 2024-08-31T08:35:00.244321+0000 mgr.a (mgr.14388) 16593 : audit [DBG] from='client.358326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:01 smithi163 bash[24253]: cluster 2024-08-31T08:35:01.038658+0000 mgr.a (mgr.14388) 16594 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:01 smithi027 bash[22610]: audit 2024-08-31T08:35:00.244321+0000 mgr.a (mgr.14388) 16593 : audit [DBG] from='client.358326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:01 smithi027 bash[22610]: cluster 2024-08-31T08:35:01.038658+0000 mgr.a (mgr.14388) 16594 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:01 smithi191 bash[24992]: audit 2024-08-31T08:35:00.244321+0000 mgr.a (mgr.14388) 16593 : audit [DBG] from='client.358326 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:01 smithi191 bash[24992]: cluster 2024-08-31T08:35:01.038658+0000 mgr.a (mgr.14388) 16594 : cluster [DBG] pgmap v11504: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:03 smithi163 bash[24253]: cluster 2024-08-31T08:35:03.040839+0000 mgr.a (mgr.14388) 16595 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:03 smithi027 bash[22610]: cluster 2024-08-31T08:35:03.040839+0000 mgr.a (mgr.14388) 16595 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:03.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:03 smithi191 bash[24992]: cluster 2024-08-31T08:35:03.040839+0000 mgr.a (mgr.14388) 16595 : cluster [DBG] pgmap v11505: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:05 smithi163 bash[24253]: cluster 2024-08-31T08:35:05.041588+0000 mgr.a (mgr.14388) 16596 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:05 smithi027 bash[22610]: cluster 2024-08-31T08:35:05.041588+0000 mgr.a (mgr.14388) 16596 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:05 smithi191 bash[24992]: cluster 2024-08-31T08:35:05.041588+0000 mgr.a (mgr.14388) 16596 : cluster [DBG] pgmap v11506: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:05.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:35:05.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:35:05.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:06 smithi163 bash[24253]: audit 2024-08-31T08:35:06.023427+0000 mgr.a (mgr.14388) 16597 : audit [DBG] from='client.358404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:06.457 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:06.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:06.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:06.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:06.457 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:06 smithi027 bash[22610]: audit 2024-08-31T08:35:06.023427+0000 mgr.a (mgr.14388) 16597 : audit [DBG] from='client.358404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:06 smithi191 bash[24992]: audit 2024-08-31T08:35:06.023427+0000 mgr.a (mgr.14388) 16597 : audit [DBG] from='client.358404 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:07 smithi163 bash[24253]: cluster 2024-08-31T08:35:07.042586+0000 mgr.a (mgr.14388) 16598 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:07 smithi027 bash[22610]: cluster 2024-08-31T08:35:07.042586+0000 mgr.a (mgr.14388) 16598 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:07 smithi191 bash[24992]: cluster 2024-08-31T08:35:07.042586+0000 mgr.a (mgr.14388) 16598 : cluster [DBG] pgmap v11507: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:09 smithi163 bash[24253]: cluster 2024-08-31T08:35:09.044831+0000 mgr.a (mgr.14388) 16599 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:09 smithi027 bash[22610]: cluster 2024-08-31T08:35:09.044831+0000 mgr.a (mgr.14388) 16599 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:09 smithi191 bash[24992]: cluster 2024-08-31T08:35:09.044831+0000 mgr.a (mgr.14388) 16599 : cluster [DBG] pgmap v11508: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:11 smithi163 bash[24253]: cluster 2024-08-31T08:35:11.045608+0000 mgr.a (mgr.14388) 16600 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:11.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:35:11.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:35:11.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:11 smithi027 bash[22610]: cluster 2024-08-31T08:35:11.045608+0000 mgr.a (mgr.14388) 16600 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:11 smithi191 bash[24992]: cluster 2024-08-31T08:35:11.045608+0000 mgr.a (mgr.14388) 16600 : cluster [DBG] pgmap v11509: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:12.212 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:12.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:12.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:12.212 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:12.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:12 smithi163 bash[24253]: audit 2024-08-31T08:35:11.793998+0000 mgr.a (mgr.14388) 16601 : audit [DBG] from='client.358482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:12 smithi027 bash[22610]: audit 2024-08-31T08:35:11.793998+0000 mgr.a (mgr.14388) 16601 : audit [DBG] from='client.358482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:12 smithi191 bash[24992]: audit 2024-08-31T08:35:11.793998+0000 mgr.a (mgr.14388) 16601 : audit [DBG] from='client.358482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:13 smithi163 bash[24253]: cluster 2024-08-31T08:35:13.047844+0000 mgr.a (mgr.14388) 16602 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:13 smithi027 bash[22610]: cluster 2024-08-31T08:35:13.047844+0000 mgr.a (mgr.14388) 16602 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:13 smithi191 bash[24992]: cluster 2024-08-31T08:35:13.047844+0000 mgr.a (mgr.14388) 16602 : cluster [DBG] pgmap v11510: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:15 smithi163 bash[24253]: cluster 2024-08-31T08:35:15.048608+0000 mgr.a (mgr.14388) 16603 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:15 smithi027 bash[22610]: cluster 2024-08-31T08:35:15.048608+0000 mgr.a (mgr.14388) 16603 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:15 smithi191 bash[24992]: cluster 2024-08-31T08:35:15.048608+0000 mgr.a (mgr.14388) 16603 : cluster [DBG] pgmap v11511: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:17.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:35:17.214 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:35:17.214 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:17 smithi163 bash[24253]: cluster 2024-08-31T08:35:17.049374+0000 mgr.a (mgr.14388) 16604 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:17 smithi027 bash[22610]: cluster 2024-08-31T08:35:17.049374+0000 mgr.a (mgr.14388) 16604 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:17 smithi191 bash[24992]: cluster 2024-08-31T08:35:17.049374+0000 mgr.a (mgr.14388) 16604 : cluster [DBG] pgmap v11512: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:17.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:17.957 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:18.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:18 smithi163 bash[24253]: audit 2024-08-31T08:35:17.546095+0000 mgr.a (mgr.14388) 16605 : audit [DBG] from='client.358560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:18 smithi027 bash[22610]: audit 2024-08-31T08:35:17.546095+0000 mgr.a (mgr.14388) 16605 : audit [DBG] from='client.358560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:18 smithi191 bash[24992]: audit 2024-08-31T08:35:17.546095+0000 mgr.a (mgr.14388) 16605 : audit [DBG] from='client.358560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:19 smithi163 bash[24253]: cluster 2024-08-31T08:35:19.051717+0000 mgr.a (mgr.14388) 16606 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T08:35:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:19 smithi027 bash[22610]: cluster 2024-08-31T08:35:19.051717+0000 mgr.a (mgr.14388) 16606 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T08:35:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:19 smithi191 bash[24992]: cluster 2024-08-31T08:35:19.051717+0000 mgr.a (mgr.14388) 16606 : cluster [DBG] pgmap v11513: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.6 KiB/s rd, 2 op/s 2024-08-31T08:35:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:20 smithi163 bash[24253]: audit 2024-08-31T08:35:19.939078+0000 mon.a (mon.0) 3051 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:35:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:20 smithi027 bash[22610]: audit 2024-08-31T08:35:19.939078+0000 mon.a (mon.0) 3051 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:35:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:20 smithi191 bash[24992]: audit 2024-08-31T08:35:19.939078+0000 mon.a (mon.0) 3051 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:35:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:21 smithi163 bash[24253]: audit 2024-08-31T08:35:20.557687+0000 mon.a (mon.0) 3052 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:21 smithi163 bash[24253]: audit 2024-08-31T08:35:20.562778+0000 mon.a (mon.0) 3053 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:21 smithi163 bash[24253]: audit 2024-08-31T08:35:20.567672+0000 mon.a (mon.0) 3054 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:21 smithi163 bash[24253]: audit 2024-08-31T08:35:20.573219+0000 mon.a (mon.0) 3055 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:21.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:21 smithi163 bash[24253]: cluster 2024-08-31T08:35:21.052502+0000 mgr.a (mgr.14388) 16607 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:35:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:21 smithi163 bash[24253]: audit 2024-08-31T08:35:21.370755+0000 mon.a (mon.0) 3056 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:35:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:21 smithi163 bash[24253]: audit 2024-08-31T08:35:21.372402+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:35:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:21 smithi163 bash[24253]: audit 2024-08-31T08:35:21.381423+0000 mon.a (mon.0) 3058 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:21.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:21 smithi163 bash[24253]: audit 2024-08-31T08:35:21.383815+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:35:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:21 smithi027 bash[22610]: audit 2024-08-31T08:35:20.557687+0000 mon.a (mon.0) 3052 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:21 smithi027 bash[22610]: audit 2024-08-31T08:35:20.562778+0000 mon.a (mon.0) 3053 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:21 smithi027 bash[22610]: audit 2024-08-31T08:35:20.567672+0000 mon.a (mon.0) 3054 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:21 smithi027 bash[22610]: audit 2024-08-31T08:35:20.573219+0000 mon.a (mon.0) 3055 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:21 smithi027 bash[22610]: cluster 2024-08-31T08:35:21.052502+0000 mgr.a (mgr.14388) 16607 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:35:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:21 smithi027 bash[22610]: audit 2024-08-31T08:35:21.370755+0000 mon.a (mon.0) 3056 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:35:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:21 smithi027 bash[22610]: audit 2024-08-31T08:35:21.372402+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:35:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:21 smithi027 bash[22610]: audit 2024-08-31T08:35:21.381423+0000 mon.a (mon.0) 3058 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:21 smithi027 bash[22610]: audit 2024-08-31T08:35:21.383815+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:35:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:21 smithi191 bash[24992]: audit 2024-08-31T08:35:20.557687+0000 mon.a (mon.0) 3052 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:21 smithi191 bash[24992]: audit 2024-08-31T08:35:20.562778+0000 mon.a (mon.0) 3053 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:21 smithi191 bash[24992]: audit 2024-08-31T08:35:20.567672+0000 mon.a (mon.0) 3054 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:21 smithi191 bash[24992]: audit 2024-08-31T08:35:20.573219+0000 mon.a (mon.0) 3055 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:22.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:21 smithi191 bash[24992]: cluster 2024-08-31T08:35:21.052502+0000 mgr.a (mgr.14388) 16607 : cluster [DBG] pgmap v11514: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T08:35:22.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:21 smithi191 bash[24992]: audit 2024-08-31T08:35:21.370755+0000 mon.a (mon.0) 3056 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:35:22.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:21 smithi191 bash[24992]: audit 2024-08-31T08:35:21.372402+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:35:22.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:21 smithi191 bash[24992]: audit 2024-08-31T08:35:21.381423+0000 mon.a (mon.0) 3058 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:35:22.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:21 smithi191 bash[24992]: audit 2024-08-31T08:35:21.383815+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:35:22.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:35:22 smithi027 bash[22863]: debug 2024-08-31T08:35:22.113+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:35:22.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:35:22 smithi027 bash[22863]: debug 2024-08-31T08:35:22.117+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:35:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:22 smithi163 bash[24253]: audit 2024-08-31T08:35:21.384803+0000 mgr.a (mgr.14388) 16608 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:35:22.958 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:35:22.959 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:35:22.959 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:22 smithi027 bash[22610]: audit 2024-08-31T08:35:21.384803+0000 mgr.a (mgr.14388) 16608 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:35:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:22 smithi191 bash[24992]: audit 2024-08-31T08:35:21.384803+0000 mgr.a (mgr.14388) 16608 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:35:23.743 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:23.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:23.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:23.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:23.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:23 smithi163 bash[24253]: audit 2024-08-31T08:35:22.117256+0000 mgr.a (mgr.14388) 16609 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:35:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:23 smithi163 bash[24253]: cephadm 2024-08-31T08:35:22.118861+0000 mgr.a (mgr.14388) 16610 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:35:23.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:23 smithi163 bash[24253]: cluster 2024-08-31T08:35:23.054427+0000 mgr.a (mgr.14388) 16611 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:35:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:23 smithi027 bash[22610]: audit 2024-08-31T08:35:22.117256+0000 mgr.a (mgr.14388) 16609 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:35:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:23 smithi027 bash[22610]: cephadm 2024-08-31T08:35:22.118861+0000 mgr.a (mgr.14388) 16610 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:35:23.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:23 smithi027 bash[22610]: cluster 2024-08-31T08:35:23.054427+0000 mgr.a (mgr.14388) 16611 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:35:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:23 smithi191 bash[24992]: audit 2024-08-31T08:35:22.117256+0000 mgr.a (mgr.14388) 16609 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:35:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:23 smithi191 bash[24992]: cephadm 2024-08-31T08:35:22.118861+0000 mgr.a (mgr.14388) 16610 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:35:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:23 smithi191 bash[24992]: cluster 2024-08-31T08:35:23.054427+0000 mgr.a (mgr.14388) 16611 : cluster [DBG] pgmap v11515: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:35:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:24 smithi163 bash[24253]: audit 2024-08-31T08:35:23.297230+0000 mgr.a (mgr.14388) 16612 : audit [DBG] from='client.358746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:24 smithi027 bash[22610]: audit 2024-08-31T08:35:23.297230+0000 mgr.a (mgr.14388) 16612 : audit [DBG] from='client.358746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:24 smithi191 bash[24992]: audit 2024-08-31T08:35:23.297230+0000 mgr.a (mgr.14388) 16612 : audit [DBG] from='client.358746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:25 smithi163 bash[24253]: cluster 2024-08-31T08:35:25.055385+0000 mgr.a (mgr.14388) 16613 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:35:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:25 smithi027 bash[22610]: cluster 2024-08-31T08:35:25.055385+0000 mgr.a (mgr.14388) 16613 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:35:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:25 smithi191 bash[24992]: cluster 2024-08-31T08:35:25.055385+0000 mgr.a (mgr.14388) 16613 : cluster [DBG] pgmap v11516: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:35:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:27 smithi163 bash[24253]: cluster 2024-08-31T08:35:27.056147+0000 mgr.a (mgr.14388) 16614 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:35:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:27 smithi027 bash[22610]: cluster 2024-08-31T08:35:27.056147+0000 mgr.a (mgr.14388) 16614 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:35:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:27 smithi191 bash[24992]: cluster 2024-08-31T08:35:27.056147+0000 mgr.a (mgr.14388) 16614 : cluster [DBG] pgmap v11517: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:35:28.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:35:28.745 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:35:28.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:29 smithi163 bash[24253]: cluster 2024-08-31T08:35:29.057519+0000 mgr.a (mgr.14388) 16615 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:35:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:29 smithi163 bash[24253]: audit 2024-08-31T08:35:29.078275+0000 mgr.a (mgr.14388) 16616 : audit [DBG] from='client.358824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:29 smithi027 bash[22610]: cluster 2024-08-31T08:35:29.057519+0000 mgr.a (mgr.14388) 16615 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:35:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:29 smithi027 bash[22610]: audit 2024-08-31T08:35:29.078275+0000 mgr.a (mgr.14388) 16616 : audit [DBG] from='client.358824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:29.524 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:29.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:29.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:29.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:29.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:29 smithi191 bash[24992]: cluster 2024-08-31T08:35:29.057519+0000 mgr.a (mgr.14388) 16615 : cluster [DBG] pgmap v11518: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:35:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:29 smithi191 bash[24992]: audit 2024-08-31T08:35:29.078275+0000 mgr.a (mgr.14388) 16616 : audit [DBG] from='client.358824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:31 smithi163 bash[24253]: cluster 2024-08-31T08:35:31.058379+0000 mgr.a (mgr.14388) 16617 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:35:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:31 smithi027 bash[22610]: cluster 2024-08-31T08:35:31.058379+0000 mgr.a (mgr.14388) 16617 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:35:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:31 smithi191 bash[24992]: cluster 2024-08-31T08:35:31.058379+0000 mgr.a (mgr.14388) 16617 : cluster [DBG] pgmap v11519: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 6.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:35:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:33 smithi163 bash[24253]: cluster 2024-08-31T08:35:33.060563+0000 mgr.a (mgr.14388) 16618 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:35:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:33 smithi027 bash[22610]: cluster 2024-08-31T08:35:33.060563+0000 mgr.a (mgr.14388) 16618 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:35:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:33 smithi191 bash[24992]: cluster 2024-08-31T08:35:33.060563+0000 mgr.a (mgr.14388) 16618 : cluster [DBG] pgmap v11520: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:35:34.526 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:35:34.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:35:34.527 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:35.292 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:35.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:35.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:35.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:35.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:35 smithi163 bash[24253]: audit 2024-08-31T08:35:34.863960+0000 mgr.a (mgr.14388) 16619 : audit [DBG] from='client.358899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:35 smithi163 bash[24253]: cluster 2024-08-31T08:35:35.061173+0000 mgr.a (mgr.14388) 16620 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:35 smithi027 bash[22610]: audit 2024-08-31T08:35:34.863960+0000 mgr.a (mgr.14388) 16619 : audit [DBG] from='client.358899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:35.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:35 smithi027 bash[22610]: cluster 2024-08-31T08:35:35.061173+0000 mgr.a (mgr.14388) 16620 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:35 smithi191 bash[24992]: audit 2024-08-31T08:35:34.863960+0000 mgr.a (mgr.14388) 16619 : audit [DBG] from='client.358899 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:35 smithi191 bash[24992]: cluster 2024-08-31T08:35:35.061173+0000 mgr.a (mgr.14388) 16620 : cluster [DBG] pgmap v11521: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:37 smithi163 bash[24253]: cluster 2024-08-31T08:35:37.062041+0000 mgr.a (mgr.14388) 16621 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:37 smithi027 bash[22610]: cluster 2024-08-31T08:35:37.062041+0000 mgr.a (mgr.14388) 16621 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:37 smithi191 bash[24992]: cluster 2024-08-31T08:35:37.062041+0000 mgr.a (mgr.14388) 16621 : cluster [DBG] pgmap v11522: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:39 smithi163 bash[24253]: cluster 2024-08-31T08:35:39.064192+0000 mgr.a (mgr.14388) 16622 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:39 smithi027 bash[22610]: cluster 2024-08-31T08:35:39.064192+0000 mgr.a (mgr.14388) 16622 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:39 smithi191 bash[24992]: cluster 2024-08-31T08:35:39.064192+0000 mgr.a (mgr.14388) 16622 : cluster [DBG] pgmap v11523: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:40.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:35:40.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:35:40.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:41.049 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:41.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:41.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:41.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:41.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:41 smithi163 bash[24253]: audit 2024-08-31T08:35:40.625489+0000 mgr.a (mgr.14388) 16623 : audit [DBG] from='client.358977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:41 smithi163 bash[24253]: cluster 2024-08-31T08:35:41.064747+0000 mgr.a (mgr.14388) 16624 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:41 smithi027 bash[22610]: audit 2024-08-31T08:35:40.625489+0000 mgr.a (mgr.14388) 16623 : audit [DBG] from='client.358977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:41 smithi027 bash[22610]: cluster 2024-08-31T08:35:41.064747+0000 mgr.a (mgr.14388) 16624 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:41 smithi191 bash[24992]: audit 2024-08-31T08:35:40.625489+0000 mgr.a (mgr.14388) 16623 : audit [DBG] from='client.358977 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:41 smithi191 bash[24992]: cluster 2024-08-31T08:35:41.064747+0000 mgr.a (mgr.14388) 16624 : cluster [DBG] pgmap v11524: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:43 smithi163 bash[24253]: cluster 2024-08-31T08:35:43.066867+0000 mgr.a (mgr.14388) 16625 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:43 smithi027 bash[22610]: cluster 2024-08-31T08:35:43.066867+0000 mgr.a (mgr.14388) 16625 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:43 smithi191 bash[24992]: cluster 2024-08-31T08:35:43.066867+0000 mgr.a (mgr.14388) 16625 : cluster [DBG] pgmap v11525: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:45 smithi163 bash[24253]: cluster 2024-08-31T08:35:45.067637+0000 mgr.a (mgr.14388) 16626 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:45 smithi027 bash[22610]: cluster 2024-08-31T08:35:45.067637+0000 mgr.a (mgr.14388) 16626 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:45 smithi191 bash[24992]: cluster 2024-08-31T08:35:45.067637+0000 mgr.a (mgr.14388) 16626 : cluster [DBG] pgmap v11526: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:46.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:35:46.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:35:46.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:46.796 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:46.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:46.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:46.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:46.797 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:47 smithi163 bash[24253]: audit 2024-08-31T08:35:46.380109+0000 mgr.a (mgr.14388) 16627 : audit [DBG] from='client.359055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:47 smithi163 bash[24253]: cluster 2024-08-31T08:35:47.068596+0000 mgr.a (mgr.14388) 16628 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:47 smithi027 bash[22610]: audit 2024-08-31T08:35:46.380109+0000 mgr.a (mgr.14388) 16627 : audit [DBG] from='client.359055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:47 smithi027 bash[22610]: cluster 2024-08-31T08:35:47.068596+0000 mgr.a (mgr.14388) 16628 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:47 smithi191 bash[24992]: audit 2024-08-31T08:35:46.380109+0000 mgr.a (mgr.14388) 16627 : audit [DBG] from='client.359055 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:47 smithi191 bash[24992]: cluster 2024-08-31T08:35:47.068596+0000 mgr.a (mgr.14388) 16628 : cluster [DBG] pgmap v11527: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:49 smithi163 bash[24253]: cluster 2024-08-31T08:35:49.070810+0000 mgr.a (mgr.14388) 16629 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:49 smithi027 bash[22610]: cluster 2024-08-31T08:35:49.070810+0000 mgr.a (mgr.14388) 16629 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:49 smithi191 bash[24992]: cluster 2024-08-31T08:35:49.070810+0000 mgr.a (mgr.14388) 16629 : cluster [DBG] pgmap v11528: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:51 smithi163 bash[24253]: cluster 2024-08-31T08:35:51.071723+0000 mgr.a (mgr.14388) 16630 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:51 smithi027 bash[22610]: cluster 2024-08-31T08:35:51.071723+0000 mgr.a (mgr.14388) 16630 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:51 smithi191 bash[24992]: cluster 2024-08-31T08:35:51.071723+0000 mgr.a (mgr.14388) 16630 : cluster [DBG] pgmap v11529: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:51.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:35:51.798 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:35:51.799 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:52.576 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:52.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:52.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:52.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:52.577 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:53 smithi163 bash[24253]: audit 2024-08-31T08:35:52.134332+0000 mgr.a (mgr.14388) 16631 : audit [DBG] from='client.359130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:53 smithi163 bash[24253]: cluster 2024-08-31T08:35:53.073977+0000 mgr.a (mgr.14388) 16632 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:53 smithi027 bash[22610]: audit 2024-08-31T08:35:52.134332+0000 mgr.a (mgr.14388) 16631 : audit [DBG] from='client.359130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:53 smithi027 bash[22610]: cluster 2024-08-31T08:35:53.073977+0000 mgr.a (mgr.14388) 16632 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:53 smithi191 bash[24992]: audit 2024-08-31T08:35:52.134332+0000 mgr.a (mgr.14388) 16631 : audit [DBG] from='client.359130 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:53 smithi191 bash[24992]: cluster 2024-08-31T08:35:53.073977+0000 mgr.a (mgr.14388) 16632 : cluster [DBG] pgmap v11530: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:35:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:55 smithi163 bash[24253]: cluster 2024-08-31T08:35:55.074828+0000 mgr.a (mgr.14388) 16633 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:55.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:55 smithi027 bash[22610]: cluster 2024-08-31T08:35:55.074828+0000 mgr.a (mgr.14388) 16633 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:55 smithi191 bash[24992]: cluster 2024-08-31T08:35:55.074828+0000 mgr.a (mgr.14388) 16633 : cluster [DBG] pgmap v11531: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:57 smithi163 bash[24253]: cluster 2024-08-31T08:35:57.075608+0000 mgr.a (mgr.14388) 16634 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:57 smithi027 bash[22610]: cluster 2024-08-31T08:35:57.075608+0000 mgr.a (mgr.14388) 16634 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:57 smithi191 bash[24992]: cluster 2024-08-31T08:35:57.075608+0000 mgr.a (mgr.14388) 16634 : cluster [DBG] pgmap v11532: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:57.578 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:35:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:35:57.579 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:35:58.359 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:35:58.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:35:58.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:35:58.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:35:58.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:35:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:58 smithi163 bash[24253]: audit 2024-08-31T08:35:57.911514+0000 mgr.a (mgr.14388) 16635 : audit [DBG] from='client.359208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:58 smithi027 bash[22610]: audit 2024-08-31T08:35:57.911514+0000 mgr.a (mgr.14388) 16635 : audit [DBG] from='client.359208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:58 smithi191 bash[24992]: audit 2024-08-31T08:35:57.911514+0000 mgr.a (mgr.14388) 16635 : audit [DBG] from='client.359208 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:35:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:35:59 smithi163 bash[24253]: cluster 2024-08-31T08:35:59.078371+0000 mgr.a (mgr.14388) 16636 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:35:59 smithi027 bash[22610]: cluster 2024-08-31T08:35:59.078371+0000 mgr.a (mgr.14388) 16636 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:35:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:35:59 smithi191 bash[24992]: cluster 2024-08-31T08:35:59.078371+0000 mgr.a (mgr.14388) 16636 : cluster [DBG] pgmap v11533: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:01 smithi163 bash[24253]: cluster 2024-08-31T08:36:01.079169+0000 mgr.a (mgr.14388) 16637 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:01.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:01 smithi027 bash[22610]: cluster 2024-08-31T08:36:01.079169+0000 mgr.a (mgr.14388) 16637 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:01 smithi191 bash[24992]: cluster 2024-08-31T08:36:01.079169+0000 mgr.a (mgr.14388) 16637 : cluster [DBG] pgmap v11534: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:03.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:36:03.362 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:36:03.362 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:36:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:03 smithi163 bash[24253]: cluster 2024-08-31T08:36:03.081061+0000 mgr.a (mgr.14388) 16638 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:03 smithi027 bash[22610]: cluster 2024-08-31T08:36:03.081061+0000 mgr.a (mgr.14388) 16638 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:03 smithi191 bash[24992]: cluster 2024-08-31T08:36:03.081061+0000 mgr.a (mgr.14388) 16638 : cluster [DBG] pgmap v11535: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:04.104 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:36:04.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:36:04.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:36:04.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:36:04.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:36:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:04 smithi163 bash[24253]: audit 2024-08-31T08:36:03.695298+0000 mgr.a (mgr.14388) 16639 : audit [DBG] from='client.359283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:04 smithi027 bash[22610]: audit 2024-08-31T08:36:03.695298+0000 mgr.a (mgr.14388) 16639 : audit [DBG] from='client.359283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:04.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:04 smithi191 bash[24992]: audit 2024-08-31T08:36:03.695298+0000 mgr.a (mgr.14388) 16639 : audit [DBG] from='client.359283 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:05 smithi163 bash[24253]: cluster 2024-08-31T08:36:05.081971+0000 mgr.a (mgr.14388) 16640 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:05 smithi027 bash[22610]: cluster 2024-08-31T08:36:05.081971+0000 mgr.a (mgr.14388) 16640 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:05 smithi191 bash[24992]: cluster 2024-08-31T08:36:05.081971+0000 mgr.a (mgr.14388) 16640 : cluster [DBG] pgmap v11536: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:07 smithi163 bash[24253]: cluster 2024-08-31T08:36:07.082782+0000 mgr.a (mgr.14388) 16641 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:36:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:07 smithi027 bash[22610]: cluster 2024-08-31T08:36:07.082782+0000 mgr.a (mgr.14388) 16641 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:36:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:07 smithi191 bash[24992]: cluster 2024-08-31T08:36:07.082782+0000 mgr.a (mgr.14388) 16641 : cluster [DBG] pgmap v11537: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:36:09.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:36:09.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:36:09.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:36:09.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:09 smithi163 bash[24253]: cluster 2024-08-31T08:36:09.084889+0000 mgr.a (mgr.14388) 16642 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:09 smithi027 bash[22610]: cluster 2024-08-31T08:36:09.084889+0000 mgr.a (mgr.14388) 16642 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:09 smithi191 bash[24992]: cluster 2024-08-31T08:36:09.084889+0000 mgr.a (mgr.14388) 16642 : cluster [DBG] pgmap v11538: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:09.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:36:09.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:36:09.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:36:09.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:36:09.884 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:36:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:10 smithi163 bash[24253]: audit 2024-08-31T08:36:09.443310+0000 mgr.a (mgr.14388) 16643 : audit [DBG] from='client.359355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:10 smithi027 bash[22610]: audit 2024-08-31T08:36:09.443310+0000 mgr.a (mgr.14388) 16643 : audit [DBG] from='client.359355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:10 smithi191 bash[24992]: audit 2024-08-31T08:36:09.443310+0000 mgr.a (mgr.14388) 16643 : audit [DBG] from='client.359355 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:11 smithi163 bash[24253]: cluster 2024-08-31T08:36:11.085768+0000 mgr.a (mgr.14388) 16644 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:11 smithi027 bash[22610]: cluster 2024-08-31T08:36:11.085768+0000 mgr.a (mgr.14388) 16644 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:11 smithi191 bash[24992]: cluster 2024-08-31T08:36:11.085768+0000 mgr.a (mgr.14388) 16644 : cluster [DBG] pgmap v11539: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:13 smithi163 bash[24253]: cluster 2024-08-31T08:36:13.087940+0000 mgr.a (mgr.14388) 16645 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:13 smithi027 bash[22610]: cluster 2024-08-31T08:36:13.087940+0000 mgr.a (mgr.14388) 16645 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:13.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:13 smithi191 bash[24992]: cluster 2024-08-31T08:36:13.087940+0000 mgr.a (mgr.14388) 16645 : cluster [DBG] pgmap v11540: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:14.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:36:15.331 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:36:15.331 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:36:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:15 smithi163 bash[24253]: cluster 2024-08-31T08:36:15.088662+0000 mgr.a (mgr.14388) 16646 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:15 smithi027 bash[22610]: cluster 2024-08-31T08:36:15.088662+0000 mgr.a (mgr.14388) 16646 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:15 smithi191 bash[24992]: cluster 2024-08-31T08:36:15.088662+0000 mgr.a (mgr.14388) 16646 : cluster [DBG] pgmap v11541: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:15.652 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:36:15.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:36:15.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:36:15.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:36:15.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:36:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:16 smithi163 bash[24253]: audit 2024-08-31T08:36:15.221938+0000 mgr.a (mgr.14388) 16647 : audit [DBG] from='client.359430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:16 smithi027 bash[22610]: audit 2024-08-31T08:36:15.221938+0000 mgr.a (mgr.14388) 16647 : audit [DBG] from='client.359430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:16 smithi191 bash[24992]: audit 2024-08-31T08:36:15.221938+0000 mgr.a (mgr.14388) 16647 : audit [DBG] from='client.359430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:17 smithi163 bash[24253]: cluster 2024-08-31T08:36:17.089556+0000 mgr.a (mgr.14388) 16648 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:17 smithi027 bash[22610]: cluster 2024-08-31T08:36:17.089556+0000 mgr.a (mgr.14388) 16648 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:17 smithi191 bash[24992]: cluster 2024-08-31T08:36:17.089556+0000 mgr.a (mgr.14388) 16648 : cluster [DBG] pgmap v11542: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:19 smithi163 bash[24253]: cluster 2024-08-31T08:36:19.091746+0000 mgr.a (mgr.14388) 16649 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:19 smithi027 bash[22610]: cluster 2024-08-31T08:36:19.091746+0000 mgr.a (mgr.14388) 16649 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:19 smithi191 bash[24992]: cluster 2024-08-31T08:36:19.091746+0000 mgr.a (mgr.14388) 16649 : cluster [DBG] pgmap v11543: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:20.654 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:36:20.655 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:36:20.655 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:36:21.435 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:36:21.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:36:21.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:36:21.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:36:21.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:36:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:21 smithi163 bash[24253]: audit 2024-08-31T08:36:20.988138+0000 mgr.a (mgr.14388) 16650 : audit [DBG] from='client.359505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:21 smithi163 bash[24253]: cluster 2024-08-31T08:36:21.092229+0000 mgr.a (mgr.14388) 16651 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:21 smithi027 bash[22610]: audit 2024-08-31T08:36:20.988138+0000 mgr.a (mgr.14388) 16650 : audit [DBG] from='client.359505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:21 smithi027 bash[22610]: cluster 2024-08-31T08:36:21.092229+0000 mgr.a (mgr.14388) 16651 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:21 smithi191 bash[24992]: audit 2024-08-31T08:36:20.988138+0000 mgr.a (mgr.14388) 16650 : audit [DBG] from='client.359505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:21 smithi191 bash[24992]: cluster 2024-08-31T08:36:21.092229+0000 mgr.a (mgr.14388) 16651 : cluster [DBG] pgmap v11544: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:22 smithi027 bash[22610]: audit 2024-08-31T08:36:22.170289+0000 mon.a (mon.0) 3060 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:36:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:22 smithi191 bash[24992]: audit 2024-08-31T08:36:22.170289+0000 mon.a (mon.0) 3060 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:36:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:22 smithi163 bash[24253]: audit 2024-08-31T08:36:22.170289+0000 mon.a (mon.0) 3060 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:36:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:23 smithi027 bash[22610]: audit 2024-08-31T08:36:23.038872+0000 mon.a (mon.0) 3061 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:36:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:23 smithi027 bash[22610]: audit 2024-08-31T08:36:23.040360+0000 mon.a (mon.0) 3062 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:36:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:23 smithi027 bash[22610]: audit 2024-08-31T08:36:23.050773+0000 mon.a (mon.0) 3063 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:36:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:23 smithi027 bash[22610]: audit 2024-08-31T08:36:23.055717+0000 mon.a (mon.0) 3064 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:36:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:23 smithi027 bash[22610]: audit 2024-08-31T08:36:23.058080+0000 mgr.a (mgr.14388) 16652 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:36:23.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:23 smithi027 bash[22610]: cluster 2024-08-31T08:36:23.094433+0000 mgr.a (mgr.14388) 16653 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:23 smithi191 bash[24992]: audit 2024-08-31T08:36:23.038872+0000 mon.a (mon.0) 3061 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:36:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:23 smithi191 bash[24992]: audit 2024-08-31T08:36:23.040360+0000 mon.a (mon.0) 3062 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:36:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:23 smithi191 bash[24992]: audit 2024-08-31T08:36:23.050773+0000 mon.a (mon.0) 3063 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:36:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:23 smithi191 bash[24992]: audit 2024-08-31T08:36:23.055717+0000 mon.a (mon.0) 3064 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:36:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:23 smithi191 bash[24992]: audit 2024-08-31T08:36:23.058080+0000 mgr.a (mgr.14388) 16652 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:36:23.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:23 smithi191 bash[24992]: cluster 2024-08-31T08:36:23.094433+0000 mgr.a (mgr.14388) 16653 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:23 smithi163 bash[24253]: audit 2024-08-31T08:36:23.038872+0000 mon.a (mon.0) 3061 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:36:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:23 smithi163 bash[24253]: audit 2024-08-31T08:36:23.040360+0000 mon.a (mon.0) 3062 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:36:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:23 smithi163 bash[24253]: audit 2024-08-31T08:36:23.050773+0000 mon.a (mon.0) 3063 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:36:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:23 smithi163 bash[24253]: audit 2024-08-31T08:36:23.055717+0000 mon.a (mon.0) 3064 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:36:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:23 smithi163 bash[24253]: audit 2024-08-31T08:36:23.058080+0000 mgr.a (mgr.14388) 16652 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:36:23.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:23 smithi163 bash[24253]: cluster 2024-08-31T08:36:23.094433+0000 mgr.a (mgr.14388) 16653 : cluster [DBG] pgmap v11545: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:24.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:36:23 smithi027 bash[22863]: debug 2024-08-31T08:36:23.808+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:36:24.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:36:23 smithi027 bash[22863]: debug 2024-08-31T08:36:23.808+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:36:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:25 smithi163 bash[24253]: audit 2024-08-31T08:36:23.810948+0000 mgr.a (mgr.14388) 16654 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:36:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:25 smithi163 bash[24253]: cephadm 2024-08-31T08:36:23.812653+0000 mgr.a (mgr.14388) 16655 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:36:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:25 smithi027 bash[22610]: audit 2024-08-31T08:36:23.810948+0000 mgr.a (mgr.14388) 16654 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:36:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:25 smithi027 bash[22610]: cephadm 2024-08-31T08:36:23.812653+0000 mgr.a (mgr.14388) 16655 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:36:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:25 smithi191 bash[24992]: audit 2024-08-31T08:36:23.810948+0000 mgr.a (mgr.14388) 16654 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:36:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:25 smithi191 bash[24992]: cephadm 2024-08-31T08:36:23.812653+0000 mgr.a (mgr.14388) 16655 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:36:26.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:36:26.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:36:26.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:36:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:26 smithi163 bash[24253]: cluster 2024-08-31T08:36:25.095341+0000 mgr.a (mgr.14388) 16656 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:26 smithi027 bash[22610]: cluster 2024-08-31T08:36:25.095341+0000 mgr.a (mgr.14388) 16656 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:26 smithi191 bash[24992]: cluster 2024-08-31T08:36:25.095341+0000 mgr.a (mgr.14388) 16656 : cluster [DBG] pgmap v11546: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:27.197 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:36:27.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:36:27.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:36:27.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:36:27.198 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:36:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:27 smithi163 bash[24253]: audit 2024-08-31T08:36:26.770248+0000 mgr.a (mgr.14388) 16657 : audit [DBG] from='client.359691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:27 smithi163 bash[24253]: cluster 2024-08-31T08:36:27.096212+0000 mgr.a (mgr.14388) 16658 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:27 smithi027 bash[22610]: audit 2024-08-31T08:36:26.770248+0000 mgr.a (mgr.14388) 16657 : audit [DBG] from='client.359691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:27.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:27 smithi027 bash[22610]: cluster 2024-08-31T08:36:27.096212+0000 mgr.a (mgr.14388) 16658 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:27 smithi191 bash[24992]: audit 2024-08-31T08:36:26.770248+0000 mgr.a (mgr.14388) 16657 : audit [DBG] from='client.359691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:27 smithi191 bash[24992]: cluster 2024-08-31T08:36:27.096212+0000 mgr.a (mgr.14388) 16658 : cluster [DBG] pgmap v11547: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:29 smithi163 bash[24253]: cluster 2024-08-31T08:36:29.098360+0000 mgr.a (mgr.14388) 16659 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:29 smithi027 bash[22610]: cluster 2024-08-31T08:36:29.098360+0000 mgr.a (mgr.14388) 16659 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:29 smithi191 bash[24992]: cluster 2024-08-31T08:36:29.098360+0000 mgr.a (mgr.14388) 16659 : cluster [DBG] pgmap v11548: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:31 smithi163 bash[24253]: cluster 2024-08-31T08:36:31.099143+0000 mgr.a (mgr.14388) 16660 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:31 smithi027 bash[22610]: cluster 2024-08-31T08:36:31.099143+0000 mgr.a (mgr.14388) 16660 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:31 smithi191 bash[24992]: cluster 2024-08-31T08:36:31.099143+0000 mgr.a (mgr.14388) 16660 : cluster [DBG] pgmap v11549: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:32.199 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:36:32.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:36:32.200 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:36:32.948 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:36:32.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:36:32.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:36:32.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:36:32.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:36:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:33 smithi163 bash[24253]: audit 2024-08-31T08:36:32.526404+0000 mgr.a (mgr.14388) 16661 : audit [DBG] from='client.359769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:33 smithi163 bash[24253]: cluster 2024-08-31T08:36:33.101450+0000 mgr.a (mgr.14388) 16662 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:33 smithi027 bash[22610]: audit 2024-08-31T08:36:32.526404+0000 mgr.a (mgr.14388) 16661 : audit [DBG] from='client.359769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:33 smithi027 bash[22610]: cluster 2024-08-31T08:36:33.101450+0000 mgr.a (mgr.14388) 16662 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:33 smithi191 bash[24992]: audit 2024-08-31T08:36:32.526404+0000 mgr.a (mgr.14388) 16661 : audit [DBG] from='client.359769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:33 smithi191 bash[24992]: cluster 2024-08-31T08:36:33.101450+0000 mgr.a (mgr.14388) 16662 : cluster [DBG] pgmap v11550: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:35 smithi163 bash[24253]: cluster 2024-08-31T08:36:35.102245+0000 mgr.a (mgr.14388) 16663 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:35 smithi027 bash[22610]: cluster 2024-08-31T08:36:35.102245+0000 mgr.a (mgr.14388) 16663 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:35 smithi191 bash[24992]: cluster 2024-08-31T08:36:35.102245+0000 mgr.a (mgr.14388) 16663 : cluster [DBG] pgmap v11551: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:37 smithi163 bash[24253]: cluster 2024-08-31T08:36:37.103190+0000 mgr.a (mgr.14388) 16664 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:37 smithi027 bash[22610]: cluster 2024-08-31T08:36:37.103190+0000 mgr.a (mgr.14388) 16664 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:37 smithi191 bash[24992]: cluster 2024-08-31T08:36:37.103190+0000 mgr.a (mgr.14388) 16664 : cluster [DBG] pgmap v11552: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:37.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:36:37.951 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:36:37.951 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:36:38.693 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:36:38.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:36:38.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:36:38.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:36:38.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:36:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:39 smithi163 bash[24253]: audit 2024-08-31T08:36:38.277772+0000 mgr.a (mgr.14388) 16665 : audit [DBG] from='client.359844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:39 smithi163 bash[24253]: cluster 2024-08-31T08:36:39.106089+0000 mgr.a (mgr.14388) 16666 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:39 smithi027 bash[22610]: audit 2024-08-31T08:36:38.277772+0000 mgr.a (mgr.14388) 16665 : audit [DBG] from='client.359844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:39 smithi027 bash[22610]: cluster 2024-08-31T08:36:39.106089+0000 mgr.a (mgr.14388) 16666 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:39 smithi191 bash[24992]: audit 2024-08-31T08:36:38.277772+0000 mgr.a (mgr.14388) 16665 : audit [DBG] from='client.359844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:39 smithi191 bash[24992]: cluster 2024-08-31T08:36:39.106089+0000 mgr.a (mgr.14388) 16666 : cluster [DBG] pgmap v11553: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:36:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:41 smithi163 bash[24253]: cluster 2024-08-31T08:36:41.106909+0000 mgr.a (mgr.14388) 16667 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:41 smithi027 bash[22610]: cluster 2024-08-31T08:36:41.106909+0000 mgr.a (mgr.14388) 16667 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:41 smithi191 bash[24992]: cluster 2024-08-31T08:36:41.106909+0000 mgr.a (mgr.14388) 16667 : cluster [DBG] pgmap v11554: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:43 smithi163 bash[24253]: cluster 2024-08-31T08:36:43.108863+0000 mgr.a (mgr.14388) 16668 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:43 smithi027 bash[22610]: cluster 2024-08-31T08:36:43.108863+0000 mgr.a (mgr.14388) 16668 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:43 smithi191 bash[24992]: cluster 2024-08-31T08:36:43.108863+0000 mgr.a (mgr.14388) 16668 : cluster [DBG] pgmap v11555: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:43.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:36:43.695 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:36:43.695 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:36:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:44 smithi163 bash[24253]: audit 2024-08-31T08:36:44.035102+0000 mgr.a (mgr.14388) 16669 : audit [DBG] from='client.359919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:44.469 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:36:44.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:36:44.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:36:44.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:36:44.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:36:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:44 smithi027 bash[22610]: audit 2024-08-31T08:36:44.035102+0000 mgr.a (mgr.14388) 16669 : audit [DBG] from='client.359919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:44 smithi191 bash[24992]: audit 2024-08-31T08:36:44.035102+0000 mgr.a (mgr.14388) 16669 : audit [DBG] from='client.359919 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:45 smithi163 bash[24253]: cluster 2024-08-31T08:36:45.109861+0000 mgr.a (mgr.14388) 16670 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:45 smithi027 bash[22610]: cluster 2024-08-31T08:36:45.109861+0000 mgr.a (mgr.14388) 16670 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:45 smithi191 bash[24992]: cluster 2024-08-31T08:36:45.109861+0000 mgr.a (mgr.14388) 16670 : cluster [DBG] pgmap v11556: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:36:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:47 smithi163 bash[24253]: cluster 2024-08-31T08:36:47.110637+0000 mgr.a (mgr.14388) 16671 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:36:47.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:47 smithi027 bash[22610]: cluster 2024-08-31T08:36:47.110637+0000 mgr.a (mgr.14388) 16671 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:36:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:47 smithi191 bash[24992]: cluster 2024-08-31T08:36:47.110637+0000 mgr.a (mgr.14388) 16671 : cluster [DBG] pgmap v11557: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:36:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:49 smithi163 bash[24253]: cluster 2024-08-31T08:36:49.112812+0000 mgr.a (mgr.14388) 16672 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:49.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:36:49.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:36:49.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:36:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:49 smithi027 bash[22610]: cluster 2024-08-31T08:36:49.112812+0000 mgr.a (mgr.14388) 16672 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:49 smithi191 bash[24992]: cluster 2024-08-31T08:36:49.112812+0000 mgr.a (mgr.14388) 16672 : cluster [DBG] pgmap v11558: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:50.239 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:36:50.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:36:50.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:36:50.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:36:50.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:36:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:50 smithi163 bash[24253]: audit 2024-08-31T08:36:49.806893+0000 mgr.a (mgr.14388) 16673 : audit [DBG] from='client.359994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:50.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:50 smithi027 bash[22610]: audit 2024-08-31T08:36:49.806893+0000 mgr.a (mgr.14388) 16673 : audit [DBG] from='client.359994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:50 smithi191 bash[24992]: audit 2024-08-31T08:36:49.806893+0000 mgr.a (mgr.14388) 16673 : audit [DBG] from='client.359994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:51 smithi163 bash[24253]: cluster 2024-08-31T08:36:51.113771+0000 mgr.a (mgr.14388) 16674 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:51 smithi027 bash[22610]: cluster 2024-08-31T08:36:51.113771+0000 mgr.a (mgr.14388) 16674 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:51 smithi191 bash[24992]: cluster 2024-08-31T08:36:51.113771+0000 mgr.a (mgr.14388) 16674 : cluster [DBG] pgmap v11559: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:54.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:54 smithi163 bash[24253]: cluster 2024-08-31T08:36:53.115962+0000 mgr.a (mgr.14388) 16675 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:54.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:54 smithi027 bash[22610]: cluster 2024-08-31T08:36:53.115962+0000 mgr.a (mgr.14388) 16675 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:54 smithi191 bash[24992]: cluster 2024-08-31T08:36:53.115962+0000 mgr.a (mgr.14388) 16675 : cluster [DBG] pgmap v11560: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:36:55.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:36:55.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:36:55.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:36:55.986 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:36:55.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:36:55.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:36:55.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:36:55.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:36:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:56 smithi163 bash[24253]: cluster 2024-08-31T08:36:55.116720+0000 mgr.a (mgr.14388) 16676 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:56.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:56 smithi163 bash[24253]: audit 2024-08-31T08:36:55.572422+0000 mgr.a (mgr.14388) 16677 : audit [DBG] from='client.360069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:56 smithi027 bash[22610]: cluster 2024-08-31T08:36:55.116720+0000 mgr.a (mgr.14388) 16676 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:56.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:56 smithi027 bash[22610]: audit 2024-08-31T08:36:55.572422+0000 mgr.a (mgr.14388) 16677 : audit [DBG] from='client.360069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:56 smithi191 bash[24992]: cluster 2024-08-31T08:36:55.116720+0000 mgr.a (mgr.14388) 16676 : cluster [DBG] pgmap v11561: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:56 smithi191 bash[24992]: audit 2024-08-31T08:36:55.572422+0000 mgr.a (mgr.14388) 16677 : audit [DBG] from='client.360069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:36:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:36:58 smithi163 bash[24253]: cluster 2024-08-31T08:36:57.117855+0000 mgr.a (mgr.14388) 16678 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:36:58 smithi027 bash[22610]: cluster 2024-08-31T08:36:57.117855+0000 mgr.a (mgr.14388) 16678 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:36:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:36:58 smithi191 bash[24992]: cluster 2024-08-31T08:36:57.117855+0000 mgr.a (mgr.14388) 16678 : cluster [DBG] pgmap v11562: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:00.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:00 smithi163 bash[24253]: cluster 2024-08-31T08:36:59.120151+0000 mgr.a (mgr.14388) 16679 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:00 smithi027 bash[22610]: cluster 2024-08-31T08:36:59.120151+0000 mgr.a (mgr.14388) 16679 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:00 smithi191 bash[24992]: cluster 2024-08-31T08:36:59.120151+0000 mgr.a (mgr.14388) 16679 : cluster [DBG] pgmap v11563: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:00.990 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:00.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:00.991 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:01.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:01.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:01.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:01.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:37:01.757 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:02 smithi163 bash[24253]: cluster 2024-08-31T08:37:01.120605+0000 mgr.a (mgr.14388) 16680 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:02 smithi163 bash[24253]: audit 2024-08-31T08:37:01.323676+0000 mgr.a (mgr.14388) 16681 : audit [DBG] from='client.360141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:02 smithi027 bash[22610]: cluster 2024-08-31T08:37:01.120605+0000 mgr.a (mgr.14388) 16680 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:02.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:02 smithi027 bash[22610]: audit 2024-08-31T08:37:01.323676+0000 mgr.a (mgr.14388) 16681 : audit [DBG] from='client.360141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:02 smithi191 bash[24992]: cluster 2024-08-31T08:37:01.120605+0000 mgr.a (mgr.14388) 16680 : cluster [DBG] pgmap v11564: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:02 smithi191 bash[24992]: audit 2024-08-31T08:37:01.323676+0000 mgr.a (mgr.14388) 16681 : audit [DBG] from='client.360141 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:04 smithi163 bash[24253]: cluster 2024-08-31T08:37:03.122947+0000 mgr.a (mgr.14388) 16682 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:04 smithi027 bash[22610]: cluster 2024-08-31T08:37:03.122947+0000 mgr.a (mgr.14388) 16682 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:04 smithi191 bash[24992]: cluster 2024-08-31T08:37:03.122947+0000 mgr.a (mgr.14388) 16682 : cluster [DBG] pgmap v11565: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:06 smithi163 bash[24253]: cluster 2024-08-31T08:37:05.123654+0000 mgr.a (mgr.14388) 16683 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:06 smithi027 bash[22610]: cluster 2024-08-31T08:37:05.123654+0000 mgr.a (mgr.14388) 16683 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:06.758 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:06.759 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:06.759 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:06 smithi191 bash[24992]: cluster 2024-08-31T08:37:05.123654+0000 mgr.a (mgr.14388) 16683 : cluster [DBG] pgmap v11566: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:07.533 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:37:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:07 smithi163 bash[24253]: audit 2024-08-31T08:37:07.092056+0000 mgr.a (mgr.14388) 16684 : audit [DBG] from='client.360219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:07 smithi027 bash[22610]: audit 2024-08-31T08:37:07.092056+0000 mgr.a (mgr.14388) 16684 : audit [DBG] from='client.360219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:07 smithi191 bash[24992]: audit 2024-08-31T08:37:07.092056+0000 mgr.a (mgr.14388) 16684 : audit [DBG] from='client.360219 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:08 smithi163 bash[24253]: cluster 2024-08-31T08:37:07.124795+0000 mgr.a (mgr.14388) 16685 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:08 smithi027 bash[22610]: cluster 2024-08-31T08:37:07.124795+0000 mgr.a (mgr.14388) 16685 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:08 smithi191 bash[24992]: cluster 2024-08-31T08:37:07.124795+0000 mgr.a (mgr.14388) 16685 : cluster [DBG] pgmap v11567: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:10 smithi163 bash[24253]: cluster 2024-08-31T08:37:09.127190+0000 mgr.a (mgr.14388) 16686 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:10 smithi027 bash[22610]: cluster 2024-08-31T08:37:09.127190+0000 mgr.a (mgr.14388) 16686 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:10 smithi191 bash[24992]: cluster 2024-08-31T08:37:09.127190+0000 mgr.a (mgr.14388) 16686 : cluster [DBG] pgmap v11568: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:12.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:12.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:12.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:12 smithi163 bash[24253]: cluster 2024-08-31T08:37:11.127975+0000 mgr.a (mgr.14388) 16687 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:12 smithi027 bash[22610]: cluster 2024-08-31T08:37:11.127975+0000 mgr.a (mgr.14388) 16687 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:12 smithi191 bash[24992]: cluster 2024-08-31T08:37:11.127975+0000 mgr.a (mgr.14388) 16687 : cluster [DBG] pgmap v11569: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:13.290 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:13.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:13.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:13.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:13.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:37:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:13 smithi027 bash[22610]: audit 2024-08-31T08:37:12.865463+0000 mgr.a (mgr.14388) 16688 : audit [DBG] from='client.360297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:13 smithi191 bash[24992]: audit 2024-08-31T08:37:12.865463+0000 mgr.a (mgr.14388) 16688 : audit [DBG] from='client.360297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:13.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:13 smithi163 bash[24253]: audit 2024-08-31T08:37:12.865463+0000 mgr.a (mgr.14388) 16688 : audit [DBG] from='client.360297 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:14 smithi027 bash[22610]: cluster 2024-08-31T08:37:13.130642+0000 mgr.a (mgr.14388) 16689 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:14 smithi191 bash[24992]: cluster 2024-08-31T08:37:13.130642+0000 mgr.a (mgr.14388) 16689 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:14 smithi163 bash[24253]: cluster 2024-08-31T08:37:13.130642+0000 mgr.a (mgr.14388) 16689 : cluster [DBG] pgmap v11570: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:16 smithi027 bash[22610]: cluster 2024-08-31T08:37:15.131693+0000 mgr.a (mgr.14388) 16690 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:16.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:16 smithi191 bash[24992]: cluster 2024-08-31T08:37:15.131693+0000 mgr.a (mgr.14388) 16690 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:16 smithi163 bash[24253]: cluster 2024-08-31T08:37:15.131693+0000 mgr.a (mgr.14388) 16690 : cluster [DBG] pgmap v11571: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:18.292 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:18.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:18.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:18 smithi027 bash[22610]: cluster 2024-08-31T08:37:17.132482+0000 mgr.a (mgr.14388) 16691 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:18 smithi191 bash[24992]: cluster 2024-08-31T08:37:17.132482+0000 mgr.a (mgr.14388) 16691 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:18 smithi163 bash[24253]: cluster 2024-08-31T08:37:17.132482+0000 mgr.a (mgr.14388) 16691 : cluster [DBG] pgmap v11572: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:19.068 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:19.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:19.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:19.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:19.069 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:37:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:19 smithi027 bash[22610]: audit 2024-08-31T08:37:18.627343+0000 mgr.a (mgr.14388) 16692 : audit [DBG] from='client.360375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:19 smithi191 bash[24992]: audit 2024-08-31T08:37:18.627343+0000 mgr.a (mgr.14388) 16692 : audit [DBG] from='client.360375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:19 smithi163 bash[24253]: audit 2024-08-31T08:37:18.627343+0000 mgr.a (mgr.14388) 16692 : audit [DBG] from='client.360375 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:20 smithi027 bash[22610]: cluster 2024-08-31T08:37:19.133684+0000 mgr.a (mgr.14388) 16693 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:20 smithi191 bash[24992]: cluster 2024-08-31T08:37:19.133684+0000 mgr.a (mgr.14388) 16693 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:20 smithi163 bash[24253]: cluster 2024-08-31T08:37:19.133684+0000 mgr.a (mgr.14388) 16693 : cluster [DBG] pgmap v11573: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:22 smithi027 bash[22610]: cluster 2024-08-31T08:37:21.134933+0000 mgr.a (mgr.14388) 16694 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:22 smithi191 bash[24992]: cluster 2024-08-31T08:37:21.134933+0000 mgr.a (mgr.14388) 16694 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:22 smithi163 bash[24253]: cluster 2024-08-31T08:37:21.134933+0000 mgr.a (mgr.14388) 16694 : cluster [DBG] pgmap v11574: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:24.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:24.070 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:24.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:24 smithi191 bash[24992]: cluster 2024-08-31T08:37:23.136954+0000 mgr.a (mgr.14388) 16695 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:24 smithi191 bash[24992]: audit 2024-08-31T08:37:23.869895+0000 mon.a (mon.0) 3065 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:37:24.855 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:24.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:24.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:24.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:24.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:37:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:24 smithi163 bash[24253]: cluster 2024-08-31T08:37:23.136954+0000 mgr.a (mgr.14388) 16695 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:24 smithi163 bash[24253]: audit 2024-08-31T08:37:23.869895+0000 mon.a (mon.0) 3065 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:37:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:24 smithi027 bash[22610]: cluster 2024-08-31T08:37:23.136954+0000 mgr.a (mgr.14388) 16695 : cluster [DBG] pgmap v11575: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:24 smithi027 bash[22610]: audit 2024-08-31T08:37:23.869895+0000 mon.a (mon.0) 3065 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:37:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:25 smithi191 bash[24992]: audit 2024-08-31T08:37:24.405810+0000 mgr.a (mgr.14388) 16696 : audit [DBG] from='client.360450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:25 smithi191 bash[24992]: audit 2024-08-31T08:37:24.731629+0000 mon.a (mon.0) 3066 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:37:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:25 smithi191 bash[24992]: audit 2024-08-31T08:37:24.732515+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:37:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:25 smithi191 bash[24992]: audit 2024-08-31T08:37:24.738432+0000 mon.a (mon.0) 3068 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:37:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:25 smithi191 bash[24992]: audit 2024-08-31T08:37:24.741015+0000 mon.a (mon.0) 3069 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:37:25.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:25 smithi191 bash[24992]: audit 2024-08-31T08:37:24.742085+0000 mgr.a (mgr.14388) 16697 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:37:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:25 smithi163 bash[24253]: audit 2024-08-31T08:37:24.405810+0000 mgr.a (mgr.14388) 16696 : audit [DBG] from='client.360450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:25 smithi163 bash[24253]: audit 2024-08-31T08:37:24.731629+0000 mon.a (mon.0) 3066 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:37:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:25 smithi163 bash[24253]: audit 2024-08-31T08:37:24.732515+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:37:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:25 smithi163 bash[24253]: audit 2024-08-31T08:37:24.738432+0000 mon.a (mon.0) 3068 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:37:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:25 smithi163 bash[24253]: audit 2024-08-31T08:37:24.741015+0000 mon.a (mon.0) 3069 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:37:25.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:25 smithi163 bash[24253]: audit 2024-08-31T08:37:24.742085+0000 mgr.a (mgr.14388) 16697 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:37:25.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:37:25 smithi027 bash[22863]: debug 2024-08-31T08:37:25.546+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:37:25.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:37:25 smithi027 bash[22863]: debug 2024-08-31T08:37:25.550+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:37:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:25 smithi027 bash[22610]: audit 2024-08-31T08:37:24.405810+0000 mgr.a (mgr.14388) 16696 : audit [DBG] from='client.360450 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:25 smithi027 bash[22610]: audit 2024-08-31T08:37:24.731629+0000 mon.a (mon.0) 3066 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:37:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:25 smithi027 bash[22610]: audit 2024-08-31T08:37:24.732515+0000 mon.a (mon.0) 3067 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:37:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:25 smithi027 bash[22610]: audit 2024-08-31T08:37:24.738432+0000 mon.a (mon.0) 3068 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:37:25.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:25 smithi027 bash[22610]: audit 2024-08-31T08:37:24.741015+0000 mon.a (mon.0) 3069 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:37:25.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:25 smithi027 bash[22610]: audit 2024-08-31T08:37:24.742085+0000 mgr.a (mgr.14388) 16697 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:37:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:26 smithi191 bash[24992]: cluster 2024-08-31T08:37:25.137507+0000 mgr.a (mgr.14388) 16698 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:26 smithi191 bash[24992]: audit 2024-08-31T08:37:25.550499+0000 mgr.a (mgr.14388) 16699 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:37:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:26 smithi191 bash[24992]: cephadm 2024-08-31T08:37:25.551866+0000 mgr.a (mgr.14388) 16700 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:37:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:26 smithi163 bash[24253]: cluster 2024-08-31T08:37:25.137507+0000 mgr.a (mgr.14388) 16698 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:26 smithi163 bash[24253]: audit 2024-08-31T08:37:25.550499+0000 mgr.a (mgr.14388) 16699 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:37:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:26 smithi163 bash[24253]: cephadm 2024-08-31T08:37:25.551866+0000 mgr.a (mgr.14388) 16700 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:37:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:26 smithi027 bash[22610]: cluster 2024-08-31T08:37:25.137507+0000 mgr.a (mgr.14388) 16698 : cluster [DBG] pgmap v11576: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:26 smithi027 bash[22610]: audit 2024-08-31T08:37:25.550499+0000 mgr.a (mgr.14388) 16699 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:37:27.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:26 smithi027 bash[22610]: cephadm 2024-08-31T08:37:25.551866+0000 mgr.a (mgr.14388) 16700 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:37:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:28 smithi191 bash[24992]: cluster 2024-08-31T08:37:27.138365+0000 mgr.a (mgr.14388) 16701 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:28 smithi163 bash[24253]: cluster 2024-08-31T08:37:27.138365+0000 mgr.a (mgr.14388) 16701 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:28 smithi027 bash[22610]: cluster 2024-08-31T08:37:27.138365+0000 mgr.a (mgr.14388) 16701 : cluster [DBG] pgmap v11577: 225 pgs: 225 active+clean; 589 KiB data, 169 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:29.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:29.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:29.857 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:30.633 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:30.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:30.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:30.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:30.633 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:37:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:30 smithi191 bash[24992]: cluster 2024-08-31T08:37:29.140596+0000 mgr.a (mgr.14388) 16702 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:30 smithi163 bash[24253]: cluster 2024-08-31T08:37:29.140596+0000 mgr.a (mgr.14388) 16702 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:30 smithi027 bash[22610]: cluster 2024-08-31T08:37:29.140596+0000 mgr.a (mgr.14388) 16702 : cluster [DBG] pgmap v11578: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:31 smithi191 bash[24992]: audit 2024-08-31T08:37:30.188187+0000 mgr.a (mgr.14388) 16703 : audit [DBG] from='client.360633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:31 smithi163 bash[24253]: audit 2024-08-31T08:37:30.188187+0000 mgr.a (mgr.14388) 16703 : audit [DBG] from='client.360633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:31 smithi027 bash[22610]: audit 2024-08-31T08:37:30.188187+0000 mgr.a (mgr.14388) 16703 : audit [DBG] from='client.360633 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:32 smithi191 bash[24992]: cluster 2024-08-31T08:37:31.141555+0000 mgr.a (mgr.14388) 16704 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:32 smithi163 bash[24253]: cluster 2024-08-31T08:37:31.141555+0000 mgr.a (mgr.14388) 16704 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:32 smithi027 bash[22610]: cluster 2024-08-31T08:37:31.141555+0000 mgr.a (mgr.14388) 16704 : cluster [DBG] pgmap v11579: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:34 smithi191 bash[24992]: cluster 2024-08-31T08:37:33.143748+0000 mgr.a (mgr.14388) 16705 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:34 smithi163 bash[24253]: cluster 2024-08-31T08:37:33.143748+0000 mgr.a (mgr.14388) 16705 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:34 smithi027 bash[22610]: cluster 2024-08-31T08:37:33.143748+0000 mgr.a (mgr.14388) 16705 : cluster [DBG] pgmap v11580: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:35.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:35.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:35.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:36.421 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:36.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:36.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:36.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:36.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:37:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:36 smithi191 bash[24992]: cluster 2024-08-31T08:37:35.144523+0000 mgr.a (mgr.14388) 16706 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:36 smithi191 bash[24992]: audit 2024-08-31T08:37:35.979506+0000 mgr.a (mgr.14388) 16707 : audit [DBG] from='client.360711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:36 smithi163 bash[24253]: cluster 2024-08-31T08:37:35.144523+0000 mgr.a (mgr.14388) 16706 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:36 smithi163 bash[24253]: audit 2024-08-31T08:37:35.979506+0000 mgr.a (mgr.14388) 16707 : audit [DBG] from='client.360711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:36 smithi027 bash[22610]: cluster 2024-08-31T08:37:35.144523+0000 mgr.a (mgr.14388) 16706 : cluster [DBG] pgmap v11581: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:37.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:36 smithi027 bash[22610]: audit 2024-08-31T08:37:35.979506+0000 mgr.a (mgr.14388) 16707 : audit [DBG] from='client.360711 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:38 smithi191 bash[24992]: cluster 2024-08-31T08:37:37.145641+0000 mgr.a (mgr.14388) 16708 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:38 smithi163 bash[24253]: cluster 2024-08-31T08:37:37.145641+0000 mgr.a (mgr.14388) 16708 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:38 smithi027 bash[22610]: cluster 2024-08-31T08:37:37.145641+0000 mgr.a (mgr.14388) 16708 : cluster [DBG] pgmap v11582: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:40 smithi191 bash[24992]: cluster 2024-08-31T08:37:39.148007+0000 mgr.a (mgr.14388) 16709 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:40 smithi163 bash[24253]: cluster 2024-08-31T08:37:39.148007+0000 mgr.a (mgr.14388) 16709 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:40 smithi027 bash[22610]: cluster 2024-08-31T08:37:39.148007+0000 mgr.a (mgr.14388) 16709 : cluster [DBG] pgmap v11583: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:37:41.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:41.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:41.423 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:42.190 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:42.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:42.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:42.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:42.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:37:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:42 smithi191 bash[24992]: cluster 2024-08-31T08:37:41.148756+0000 mgr.a (mgr.14388) 16710 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:42 smithi191 bash[24992]: audit 2024-08-31T08:37:41.759526+0000 mgr.a (mgr.14388) 16711 : audit [DBG] from='client.360789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:42 smithi163 bash[24253]: cluster 2024-08-31T08:37:41.148756+0000 mgr.a (mgr.14388) 16710 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:43.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:42 smithi163 bash[24253]: audit 2024-08-31T08:37:41.759526+0000 mgr.a (mgr.14388) 16711 : audit [DBG] from='client.360789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:42 smithi027 bash[22610]: cluster 2024-08-31T08:37:41.148756+0000 mgr.a (mgr.14388) 16710 : cluster [DBG] pgmap v11584: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:43.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:42 smithi027 bash[22610]: audit 2024-08-31T08:37:41.759526+0000 mgr.a (mgr.14388) 16711 : audit [DBG] from='client.360789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:44 smithi191 bash[24992]: cluster 2024-08-31T08:37:43.151075+0000 mgr.a (mgr.14388) 16712 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:44 smithi163 bash[24253]: cluster 2024-08-31T08:37:43.151075+0000 mgr.a (mgr.14388) 16712 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:44 smithi027 bash[22610]: cluster 2024-08-31T08:37:43.151075+0000 mgr.a (mgr.14388) 16712 : cluster [DBG] pgmap v11585: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:47.191 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:47.192 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:47.192 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:46 smithi163 bash[24253]: cluster 2024-08-31T08:37:45.151869+0000 mgr.a (mgr.14388) 16713 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:46 smithi027 bash[22610]: cluster 2024-08-31T08:37:45.151869+0000 mgr.a (mgr.14388) 16713 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:46 smithi191 bash[24992]: cluster 2024-08-31T08:37:45.151869+0000 mgr.a (mgr.14388) 16713 : cluster [DBG] pgmap v11586: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:47.942 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:47.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:47.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:47.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:47.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:37:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:48 smithi163 bash[24253]: cluster 2024-08-31T08:37:47.152637+0000 mgr.a (mgr.14388) 16714 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:48 smithi163 bash[24253]: audit 2024-08-31T08:37:47.525630+0000 mgr.a (mgr.14388) 16715 : audit [DBG] from='client.360867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:48 smithi027 bash[22610]: cluster 2024-08-31T08:37:47.152637+0000 mgr.a (mgr.14388) 16714 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:49.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:48 smithi027 bash[22610]: audit 2024-08-31T08:37:47.525630+0000 mgr.a (mgr.14388) 16715 : audit [DBG] from='client.360867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:48 smithi191 bash[24992]: cluster 2024-08-31T08:37:47.152637+0000 mgr.a (mgr.14388) 16714 : cluster [DBG] pgmap v11587: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:48 smithi191 bash[24992]: audit 2024-08-31T08:37:47.525630+0000 mgr.a (mgr.14388) 16715 : audit [DBG] from='client.360867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:50 smithi163 bash[24253]: cluster 2024-08-31T08:37:49.154985+0000 mgr.a (mgr.14388) 16716 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:50 smithi027 bash[22610]: cluster 2024-08-31T08:37:49.154985+0000 mgr.a (mgr.14388) 16716 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:50 smithi191 bash[24992]: cluster 2024-08-31T08:37:49.154985+0000 mgr.a (mgr.14388) 16716 : cluster [DBG] pgmap v11588: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:37:52.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:52.944 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:52.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:52 smithi163 bash[24253]: cluster 2024-08-31T08:37:51.155759+0000 mgr.a (mgr.14388) 16717 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:52 smithi027 bash[22610]: cluster 2024-08-31T08:37:51.155759+0000 mgr.a (mgr.14388) 16717 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:52 smithi191 bash[24992]: cluster 2024-08-31T08:37:51.155759+0000 mgr.a (mgr.14388) 16717 : cluster [DBG] pgmap v11589: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:53.697 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:53.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:53.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:53.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:53.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:37:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:54 smithi163 bash[24253]: cluster 2024-08-31T08:37:53.157697+0000 mgr.a (mgr.14388) 16718 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:55.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:54 smithi163 bash[24253]: audit 2024-08-31T08:37:53.275724+0000 mgr.a (mgr.14388) 16719 : audit [DBG] from='client.360942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:54 smithi027 bash[22610]: cluster 2024-08-31T08:37:53.157697+0000 mgr.a (mgr.14388) 16718 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:55.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:54 smithi027 bash[22610]: audit 2024-08-31T08:37:53.275724+0000 mgr.a (mgr.14388) 16719 : audit [DBG] from='client.360942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:54 smithi191 bash[24992]: cluster 2024-08-31T08:37:53.157697+0000 mgr.a (mgr.14388) 16718 : cluster [DBG] pgmap v11590: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:37:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:54 smithi191 bash[24992]: audit 2024-08-31T08:37:53.275724+0000 mgr.a (mgr.14388) 16719 : audit [DBG] from='client.360942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:37:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:56 smithi163 bash[24253]: cluster 2024-08-31T08:37:55.158628+0000 mgr.a (mgr.14388) 16720 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:56 smithi027 bash[22610]: cluster 2024-08-31T08:37:55.158628+0000 mgr.a (mgr.14388) 16720 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:56 smithi191 bash[24992]: cluster 2024-08-31T08:37:55.158628+0000 mgr.a (mgr.14388) 16720 : cluster [DBG] pgmap v11591: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:37:58.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:37:58.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:37:58.700 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:37:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:58 smithi163 bash[24253]: cluster 2024-08-31T08:37:57.159444+0000 mgr.a (mgr.14388) 16721 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:37:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:58 smithi027 bash[22610]: cluster 2024-08-31T08:37:57.159444+0000 mgr.a (mgr.14388) 16721 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:37:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:58 smithi191 bash[24992]: cluster 2024-08-31T08:37:57.159444+0000 mgr.a (mgr.14388) 16721 : cluster [DBG] pgmap v11592: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:37:59.475 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:37:59.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:37:59.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:37:59.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:37:59.476 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:37:59 smithi163 bash[24253]: audit 2024-08-31T08:37:59.032895+0000 mgr.a (mgr.14388) 16722 : audit [DBG] from='client.361020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:37:59 smithi027 bash[22610]: audit 2024-08-31T08:37:59.032895+0000 mgr.a (mgr.14388) 16722 : audit [DBG] from='client.361020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:37:59 smithi191 bash[24992]: audit 2024-08-31T08:37:59.032895+0000 mgr.a (mgr.14388) 16722 : audit [DBG] from='client.361020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:00 smithi163 bash[24253]: cluster 2024-08-31T08:37:59.160794+0000 mgr.a (mgr.14388) 16723 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:00 smithi027 bash[22610]: cluster 2024-08-31T08:37:59.160794+0000 mgr.a (mgr.14388) 16723 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:00 smithi191 bash[24992]: cluster 2024-08-31T08:37:59.160794+0000 mgr.a (mgr.14388) 16723 : cluster [DBG] pgmap v11593: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:02 smithi163 bash[24253]: cluster 2024-08-31T08:38:01.161666+0000 mgr.a (mgr.14388) 16724 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:38:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:02 smithi027 bash[22610]: cluster 2024-08-31T08:38:01.161666+0000 mgr.a (mgr.14388) 16724 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:38:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:02 smithi191 bash[24992]: cluster 2024-08-31T08:38:01.161666+0000 mgr.a (mgr.14388) 16724 : cluster [DBG] pgmap v11594: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:38:04.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:38:04.478 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:38:04.478 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:38:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:04 smithi163 bash[24253]: cluster 2024-08-31T08:38:03.163867+0000 mgr.a (mgr.14388) 16725 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:04 smithi027 bash[22610]: cluster 2024-08-31T08:38:03.163867+0000 mgr.a (mgr.14388) 16725 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:05.246 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:38:05.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:38:05.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:38:05.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:38:05.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:04 smithi191 bash[24992]: cluster 2024-08-31T08:38:03.163867+0000 mgr.a (mgr.14388) 16725 : cluster [DBG] pgmap v11595: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:05 smithi163 bash[24253]: audit 2024-08-31T08:38:04.818559+0000 mgr.a (mgr.14388) 16726 : audit [DBG] from='client.361095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:05 smithi027 bash[22610]: audit 2024-08-31T08:38:04.818559+0000 mgr.a (mgr.14388) 16726 : audit [DBG] from='client.361095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:05 smithi191 bash[24992]: audit 2024-08-31T08:38:04.818559+0000 mgr.a (mgr.14388) 16726 : audit [DBG] from='client.361095 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:06 smithi163 bash[24253]: cluster 2024-08-31T08:38:05.164494+0000 mgr.a (mgr.14388) 16727 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:06 smithi027 bash[22610]: cluster 2024-08-31T08:38:05.164494+0000 mgr.a (mgr.14388) 16727 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:06 smithi191 bash[24992]: cluster 2024-08-31T08:38:05.164494+0000 mgr.a (mgr.14388) 16727 : cluster [DBG] pgmap v11596: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:08 smithi163 bash[24253]: cluster 2024-08-31T08:38:07.165311+0000 mgr.a (mgr.14388) 16728 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:08 smithi027 bash[22610]: cluster 2024-08-31T08:38:07.165311+0000 mgr.a (mgr.14388) 16728 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:08 smithi191 bash[24992]: cluster 2024-08-31T08:38:07.165311+0000 mgr.a (mgr.14388) 16728 : cluster [DBG] pgmap v11597: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:10.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:38:10.249 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:38:10.249 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:38:11.035 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:38:11.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:38:11.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:38:11.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:38:11.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:10 smithi163 bash[24253]: cluster 2024-08-31T08:38:09.167585+0000 mgr.a (mgr.14388) 16729 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:10 smithi027 bash[22610]: cluster 2024-08-31T08:38:09.167585+0000 mgr.a (mgr.14388) 16729 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:10 smithi191 bash[24992]: cluster 2024-08-31T08:38:09.167585+0000 mgr.a (mgr.14388) 16729 : cluster [DBG] pgmap v11598: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:11 smithi163 bash[24253]: audit 2024-08-31T08:38:10.586912+0000 mgr.a (mgr.14388) 16730 : audit [DBG] from='client.361173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:11 smithi027 bash[22610]: audit 2024-08-31T08:38:10.586912+0000 mgr.a (mgr.14388) 16730 : audit [DBG] from='client.361173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:11 smithi191 bash[24992]: audit 2024-08-31T08:38:10.586912+0000 mgr.a (mgr.14388) 16730 : audit [DBG] from='client.361173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:12 smithi163 bash[24253]: cluster 2024-08-31T08:38:11.168564+0000 mgr.a (mgr.14388) 16731 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:12 smithi027 bash[22610]: cluster 2024-08-31T08:38:11.168564+0000 mgr.a (mgr.14388) 16731 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:12 smithi191 bash[24992]: cluster 2024-08-31T08:38:11.168564+0000 mgr.a (mgr.14388) 16731 : cluster [DBG] pgmap v11599: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:14 smithi163 bash[24253]: cluster 2024-08-31T08:38:13.170712+0000 mgr.a (mgr.14388) 16732 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:14 smithi027 bash[22610]: cluster 2024-08-31T08:38:13.170712+0000 mgr.a (mgr.14388) 16732 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:14 smithi191 bash[24992]: cluster 2024-08-31T08:38:13.170712+0000 mgr.a (mgr.14388) 16732 : cluster [DBG] pgmap v11600: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:16.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:38:16.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:38:16.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:38:16.775 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:38:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:38:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:38:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:38:16.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:17.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:16 smithi163 bash[24253]: cluster 2024-08-31T08:38:15.171524+0000 mgr.a (mgr.14388) 16733 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:16 smithi027 bash[22610]: cluster 2024-08-31T08:38:15.171524+0000 mgr.a (mgr.14388) 16733 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:16 smithi191 bash[24992]: cluster 2024-08-31T08:38:15.171524+0000 mgr.a (mgr.14388) 16733 : cluster [DBG] pgmap v11601: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:17 smithi163 bash[24253]: audit 2024-08-31T08:38:16.366617+0000 mgr.a (mgr.14388) 16734 : audit [DBG] from='client.361248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:17 smithi027 bash[22610]: audit 2024-08-31T08:38:16.366617+0000 mgr.a (mgr.14388) 16734 : audit [DBG] from='client.361248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:17 smithi191 bash[24992]: audit 2024-08-31T08:38:16.366617+0000 mgr.a (mgr.14388) 16734 : audit [DBG] from='client.361248 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:18 smithi163 bash[24253]: cluster 2024-08-31T08:38:17.172464+0000 mgr.a (mgr.14388) 16735 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:19.524 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:18 smithi191 bash[24992]: cluster 2024-08-31T08:38:17.172464+0000 mgr.a (mgr.14388) 16735 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:19.524 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:18 smithi027 bash[22610]: cluster 2024-08-31T08:38:17.172464+0000 mgr.a (mgr.14388) 16735 : cluster [DBG] pgmap v11602: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:20 smithi163 bash[24253]: cluster 2024-08-31T08:38:19.174674+0000 mgr.a (mgr.14388) 16736 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:20 smithi027 bash[22610]: cluster 2024-08-31T08:38:19.174674+0000 mgr.a (mgr.14388) 16736 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:20 smithi191 bash[24992]: cluster 2024-08-31T08:38:19.174674+0000 mgr.a (mgr.14388) 16736 : cluster [DBG] pgmap v11603: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:21.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:38:21.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:38:21.777 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:38:22.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:38:22.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:38:22.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:38:22.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:22.528 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:38:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:22 smithi163 bash[24253]: cluster 2024-08-31T08:38:21.175513+0000 mgr.a (mgr.14388) 16737 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:22 smithi163 bash[24253]: audit 2024-08-31T08:38:22.109785+0000 mgr.a (mgr.14388) 16738 : audit [DBG] from='client.361323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:22 smithi027 bash[22610]: cluster 2024-08-31T08:38:21.175513+0000 mgr.a (mgr.14388) 16737 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:23.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:22 smithi027 bash[22610]: audit 2024-08-31T08:38:22.109785+0000 mgr.a (mgr.14388) 16738 : audit [DBG] from='client.361323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:22 smithi191 bash[24992]: cluster 2024-08-31T08:38:21.175513+0000 mgr.a (mgr.14388) 16737 : cluster [DBG] pgmap v11604: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:22 smithi191 bash[24992]: audit 2024-08-31T08:38:22.109785+0000 mgr.a (mgr.14388) 16738 : audit [DBG] from='client.361323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:24 smithi163 bash[24253]: cluster 2024-08-31T08:38:23.177810+0000 mgr.a (mgr.14388) 16739 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:24 smithi027 bash[22610]: cluster 2024-08-31T08:38:23.177810+0000 mgr.a (mgr.14388) 16739 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:24 smithi191 bash[24992]: cluster 2024-08-31T08:38:23.177810+0000 mgr.a (mgr.14388) 16739 : cluster [DBG] pgmap v11605: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:26.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:25 smithi163 bash[24253]: audit 2024-08-31T08:38:25.601449+0000 mon.a (mon.0) 3070 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:38:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:25 smithi027 bash[22610]: audit 2024-08-31T08:38:25.601449+0000 mon.a (mon.0) 3070 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:38:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:25 smithi191 bash[24992]: audit 2024-08-31T08:38:25.601449+0000 mon.a (mon.0) 3070 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:38:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:26 smithi163 bash[24253]: cluster 2024-08-31T08:38:25.178576+0000 mgr.a (mgr.14388) 16740 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:26 smithi163 bash[24253]: audit 2024-08-31T08:38:26.433053+0000 mon.a (mon.0) 3071 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:38:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:26 smithi163 bash[24253]: audit 2024-08-31T08:38:26.434586+0000 mon.a (mon.0) 3072 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:38:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:26 smithi163 bash[24253]: audit 2024-08-31T08:38:26.441629+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:38:27.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:26 smithi163 bash[24253]: audit 2024-08-31T08:38:26.444235+0000 mon.a (mon.0) 3074 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:38:27.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:26 smithi027 bash[22610]: cluster 2024-08-31T08:38:25.178576+0000 mgr.a (mgr.14388) 16740 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:27.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:26 smithi027 bash[22610]: audit 2024-08-31T08:38:26.433053+0000 mon.a (mon.0) 3071 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:38:27.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:26 smithi027 bash[22610]: audit 2024-08-31T08:38:26.434586+0000 mon.a (mon.0) 3072 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:38:27.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:26 smithi027 bash[22610]: audit 2024-08-31T08:38:26.441629+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:38:27.201 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:26 smithi027 bash[22610]: audit 2024-08-31T08:38:26.444235+0000 mon.a (mon.0) 3074 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:38:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:26 smithi191 bash[24992]: cluster 2024-08-31T08:38:25.178576+0000 mgr.a (mgr.14388) 16740 : cluster [DBG] pgmap v11606: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:26 smithi191 bash[24992]: audit 2024-08-31T08:38:26.433053+0000 mon.a (mon.0) 3071 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:38:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:26 smithi191 bash[24992]: audit 2024-08-31T08:38:26.434586+0000 mon.a (mon.0) 3072 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:38:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:26 smithi191 bash[24992]: audit 2024-08-31T08:38:26.441629+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:38:27.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:26 smithi191 bash[24992]: audit 2024-08-31T08:38:26.444235+0000 mon.a (mon.0) 3074 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:38:27.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:38:27 smithi027 bash[22863]: debug 2024-08-31T08:38:27.196+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:38:27.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:38:27 smithi027 bash[22863]: debug 2024-08-31T08:38:27.196+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:38:27.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:38:27.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:38:27.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:38:28.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:27 smithi163 bash[24253]: audit 2024-08-31T08:38:26.446648+0000 mgr.a (mgr.14388) 16741 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:38:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:27 smithi027 bash[22610]: audit 2024-08-31T08:38:26.446648+0000 mgr.a (mgr.14388) 16741 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:38:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:27 smithi191 bash[24992]: audit 2024-08-31T08:38:26.446648+0000 mgr.a (mgr.14388) 16741 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:38:28.304 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:38:28.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:38:28.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:38:28.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:38:28.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:28 smithi163 bash[24253]: cluster 2024-08-31T08:38:27.179142+0000 mgr.a (mgr.14388) 16742 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:28 smithi163 bash[24253]: audit 2024-08-31T08:38:27.200284+0000 mgr.a (mgr.14388) 16743 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:38:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:28 smithi163 bash[24253]: cephadm 2024-08-31T08:38:27.201733+0000 mgr.a (mgr.14388) 16744 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:38:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:28 smithi163 bash[24253]: audit 2024-08-31T08:38:27.863161+0000 mgr.a (mgr.14388) 16745 : audit [DBG] from='client.361503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:28 smithi027 bash[22610]: cluster 2024-08-31T08:38:27.179142+0000 mgr.a (mgr.14388) 16742 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:28 smithi027 bash[22610]: audit 2024-08-31T08:38:27.200284+0000 mgr.a (mgr.14388) 16743 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:38:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:28 smithi027 bash[22610]: cephadm 2024-08-31T08:38:27.201733+0000 mgr.a (mgr.14388) 16744 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:38:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:28 smithi027 bash[22610]: audit 2024-08-31T08:38:27.863161+0000 mgr.a (mgr.14388) 16745 : audit [DBG] from='client.361503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:28 smithi191 bash[24992]: cluster 2024-08-31T08:38:27.179142+0000 mgr.a (mgr.14388) 16742 : cluster [DBG] pgmap v11607: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:28 smithi191 bash[24992]: audit 2024-08-31T08:38:27.200284+0000 mgr.a (mgr.14388) 16743 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:38:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:28 smithi191 bash[24992]: cephadm 2024-08-31T08:38:27.201733+0000 mgr.a (mgr.14388) 16744 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:38:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:28 smithi191 bash[24992]: audit 2024-08-31T08:38:27.863161+0000 mgr.a (mgr.14388) 16745 : audit [DBG] from='client.361503 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:31.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:30 smithi163 bash[24253]: cluster 2024-08-31T08:38:29.181895+0000 mgr.a (mgr.14388) 16746 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:38:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:30 smithi027 bash[22610]: cluster 2024-08-31T08:38:29.181895+0000 mgr.a (mgr.14388) 16746 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:38:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:30 smithi191 bash[24992]: cluster 2024-08-31T08:38:29.181895+0000 mgr.a (mgr.14388) 16746 : cluster [DBG] pgmap v11608: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:38:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:32 smithi163 bash[24253]: cluster 2024-08-31T08:38:31.182673+0000 mgr.a (mgr.14388) 16747 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:38:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:32 smithi027 bash[22610]: cluster 2024-08-31T08:38:31.182673+0000 mgr.a (mgr.14388) 16747 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:38:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:32 smithi191 bash[24992]: cluster 2024-08-31T08:38:31.182673+0000 mgr.a (mgr.14388) 16747 : cluster [DBG] pgmap v11609: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:38:33.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:38:33.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:38:33.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:38:34.078 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:38:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:38:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:38:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:38:34.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:34 smithi163 bash[24253]: cluster 2024-08-31T08:38:33.184558+0000 mgr.a (mgr.14388) 16748 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:38:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:34 smithi163 bash[24253]: audit 2024-08-31T08:38:33.640166+0000 mgr.a (mgr.14388) 16749 : audit [DBG] from='client.361575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:34 smithi027 bash[22610]: cluster 2024-08-31T08:38:33.184558+0000 mgr.a (mgr.14388) 16748 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:38:35.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:34 smithi027 bash[22610]: audit 2024-08-31T08:38:33.640166+0000 mgr.a (mgr.14388) 16749 : audit [DBG] from='client.361575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:34 smithi191 bash[24992]: cluster 2024-08-31T08:38:33.184558+0000 mgr.a (mgr.14388) 16748 : cluster [DBG] pgmap v11610: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:38:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:34 smithi191 bash[24992]: audit 2024-08-31T08:38:33.640166+0000 mgr.a (mgr.14388) 16749 : audit [DBG] from='client.361575 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:36 smithi163 bash[24253]: cluster 2024-08-31T08:38:35.185591+0000 mgr.a (mgr.14388) 16750 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:38:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:36 smithi027 bash[22610]: cluster 2024-08-31T08:38:35.185591+0000 mgr.a (mgr.14388) 16750 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:38:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:36 smithi191 bash[24992]: cluster 2024-08-31T08:38:35.185591+0000 mgr.a (mgr.14388) 16750 : cluster [DBG] pgmap v11611: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:38:39.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:38:39.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:38:39.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:38:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:38 smithi027 bash[22610]: cluster 2024-08-31T08:38:37.186576+0000 mgr.a (mgr.14388) 16751 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:38:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:38 smithi191 bash[24992]: cluster 2024-08-31T08:38:37.186576+0000 mgr.a (mgr.14388) 16751 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:38:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:38 smithi163 bash[24253]: cluster 2024-08-31T08:38:37.186576+0000 mgr.a (mgr.14388) 16751 : cluster [DBG] pgmap v11612: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:38:39.845 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:38:39.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:38:39.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:38:39.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:38:39.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:40 smithi027 bash[22610]: cluster 2024-08-31T08:38:39.187603+0000 mgr.a (mgr.14388) 16752 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:38:41.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:40 smithi027 bash[22610]: audit 2024-08-31T08:38:39.415499+0000 mgr.a (mgr.14388) 16753 : audit [DBG] from='client.361653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:40 smithi191 bash[24992]: cluster 2024-08-31T08:38:39.187603+0000 mgr.a (mgr.14388) 16752 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:38:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:40 smithi191 bash[24992]: audit 2024-08-31T08:38:39.415499+0000 mgr.a (mgr.14388) 16753 : audit [DBG] from='client.361653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:40 smithi163 bash[24253]: cluster 2024-08-31T08:38:39.187603+0000 mgr.a (mgr.14388) 16752 : cluster [DBG] pgmap v11613: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:38:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:40 smithi163 bash[24253]: audit 2024-08-31T08:38:39.415499+0000 mgr.a (mgr.14388) 16753 : audit [DBG] from='client.361653 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:42 smithi027 bash[22610]: cluster 2024-08-31T08:38:41.188473+0000 mgr.a (mgr.14388) 16754 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:42 smithi191 bash[24992]: cluster 2024-08-31T08:38:41.188473+0000 mgr.a (mgr.14388) 16754 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:43.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:42 smithi163 bash[24253]: cluster 2024-08-31T08:38:41.188473+0000 mgr.a (mgr.14388) 16754 : cluster [DBG] pgmap v11614: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:44.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:38:44.847 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:38:44.847 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:38:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:44 smithi027 bash[22610]: cluster 2024-08-31T08:38:43.190648+0000 mgr.a (mgr.14388) 16755 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:44 smithi191 bash[24992]: cluster 2024-08-31T08:38:43.190648+0000 mgr.a (mgr.14388) 16755 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:44 smithi163 bash[24253]: cluster 2024-08-31T08:38:43.190648+0000 mgr.a (mgr.14388) 16755 : cluster [DBG] pgmap v11615: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:45.596 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:38:45.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:38:45.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:38:45.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:38:45.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:46 smithi027 bash[22610]: audit 2024-08-31T08:38:45.180524+0000 mgr.a (mgr.14388) 16756 : audit [DBG] from='client.361731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:46 smithi027 bash[22610]: cluster 2024-08-31T08:38:45.196471+0000 mgr.a (mgr.14388) 16757 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:46 smithi191 bash[24992]: audit 2024-08-31T08:38:45.180524+0000 mgr.a (mgr.14388) 16756 : audit [DBG] from='client.361731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:46 smithi191 bash[24992]: cluster 2024-08-31T08:38:45.196471+0000 mgr.a (mgr.14388) 16757 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:46 smithi163 bash[24253]: audit 2024-08-31T08:38:45.180524+0000 mgr.a (mgr.14388) 16756 : audit [DBG] from='client.361731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:46 smithi163 bash[24253]: cluster 2024-08-31T08:38:45.196471+0000 mgr.a (mgr.14388) 16757 : cluster [DBG] pgmap v11616: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:48 smithi027 bash[22610]: cluster 2024-08-31T08:38:47.197637+0000 mgr.a (mgr.14388) 16758 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:48 smithi191 bash[24992]: cluster 2024-08-31T08:38:47.197637+0000 mgr.a (mgr.14388) 16758 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:48 smithi163 bash[24253]: cluster 2024-08-31T08:38:47.197637+0000 mgr.a (mgr.14388) 16758 : cluster [DBG] pgmap v11617: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:50.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:38:50.598 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:38:50.599 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:38:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:50 smithi027 bash[22610]: cluster 2024-08-31T08:38:49.199943+0000 mgr.a (mgr.14388) 16759 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:50 smithi191 bash[24992]: cluster 2024-08-31T08:38:49.199943+0000 mgr.a (mgr.14388) 16759 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:51.374 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:38:51.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:38:51.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:38:51.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:38:51.375 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:50 smithi163 bash[24253]: cluster 2024-08-31T08:38:49.199943+0000 mgr.a (mgr.14388) 16759 : cluster [DBG] pgmap v11618: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:51 smithi191 bash[24992]: audit 2024-08-31T08:38:50.932597+0000 mgr.a (mgr.14388) 16760 : audit [DBG] from='client.361809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:52.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:51 smithi163 bash[24253]: audit 2024-08-31T08:38:50.932597+0000 mgr.a (mgr.14388) 16760 : audit [DBG] from='client.361809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:51 smithi027 bash[22610]: audit 2024-08-31T08:38:50.932597+0000 mgr.a (mgr.14388) 16760 : audit [DBG] from='client.361809 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:52 smithi191 bash[24992]: cluster 2024-08-31T08:38:51.200547+0000 mgr.a (mgr.14388) 16761 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:52 smithi163 bash[24253]: cluster 2024-08-31T08:38:51.200547+0000 mgr.a (mgr.14388) 16761 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:52 smithi027 bash[22610]: cluster 2024-08-31T08:38:51.200547+0000 mgr.a (mgr.14388) 16761 : cluster [DBG] pgmap v11619: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:54 smithi191 bash[24992]: cluster 2024-08-31T08:38:53.202828+0000 mgr.a (mgr.14388) 16762 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:54 smithi163 bash[24253]: cluster 2024-08-31T08:38:53.202828+0000 mgr.a (mgr.14388) 16762 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:54 smithi027 bash[22610]: cluster 2024-08-31T08:38:53.202828+0000 mgr.a (mgr.14388) 16762 : cluster [DBG] pgmap v11620: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:38:56.376 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:38:56.377 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:38:56.377 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:38:57.154 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:38:57.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:38:57.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:38:57.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:38:57.155 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:38:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:56 smithi191 bash[24992]: cluster 2024-08-31T08:38:55.203602+0000 mgr.a (mgr.14388) 16763 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:56 smithi163 bash[24253]: cluster 2024-08-31T08:38:55.203602+0000 mgr.a (mgr.14388) 16763 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:56 smithi027 bash[22610]: cluster 2024-08-31T08:38:55.203602+0000 mgr.a (mgr.14388) 16763 : cluster [DBG] pgmap v11621: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:58 smithi191 bash[24992]: audit 2024-08-31T08:38:56.714752+0000 mgr.a (mgr.14388) 16764 : audit [DBG] from='client.361887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:58.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:58 smithi163 bash[24253]: audit 2024-08-31T08:38:56.714752+0000 mgr.a (mgr.14388) 16764 : audit [DBG] from='client.361887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:58 smithi027 bash[22610]: audit 2024-08-31T08:38:56.714752+0000 mgr.a (mgr.14388) 16764 : audit [DBG] from='client.361887 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:38:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:38:59 smithi191 bash[24992]: cluster 2024-08-31T08:38:57.204534+0000 mgr.a (mgr.14388) 16765 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:38:59 smithi163 bash[24253]: cluster 2024-08-31T08:38:57.204534+0000 mgr.a (mgr.14388) 16765 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:38:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:38:59 smithi027 bash[22610]: cluster 2024-08-31T08:38:57.204534+0000 mgr.a (mgr.14388) 16765 : cluster [DBG] pgmap v11622: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:01 smithi191 bash[24992]: cluster 2024-08-31T08:38:59.206907+0000 mgr.a (mgr.14388) 16766 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:01 smithi163 bash[24253]: cluster 2024-08-31T08:38:59.206907+0000 mgr.a (mgr.14388) 16766 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:01 smithi027 bash[22610]: cluster 2024-08-31T08:38:59.206907+0000 mgr.a (mgr.14388) 16766 : cluster [DBG] pgmap v11623: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:02.156 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:02.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:02.157 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:39:02.910 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:39:02.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:39:02.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:39:02.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:39:02.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:39:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:03 smithi191 bash[24992]: cluster 2024-08-31T08:39:01.207707+0000 mgr.a (mgr.14388) 16767 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:03 smithi163 bash[24253]: cluster 2024-08-31T08:39:01.207707+0000 mgr.a (mgr.14388) 16767 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:03 smithi027 bash[22610]: cluster 2024-08-31T08:39:01.207707+0000 mgr.a (mgr.14388) 16767 : cluster [DBG] pgmap v11624: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:04 smithi191 bash[24992]: audit 2024-08-31T08:39:02.488833+0000 mgr.a (mgr.14388) 16768 : audit [DBG] from='client.361965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:04.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:04 smithi163 bash[24253]: audit 2024-08-31T08:39:02.488833+0000 mgr.a (mgr.14388) 16768 : audit [DBG] from='client.361965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:04 smithi027 bash[22610]: audit 2024-08-31T08:39:02.488833+0000 mgr.a (mgr.14388) 16768 : audit [DBG] from='client.361965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:05 smithi191 bash[24992]: cluster 2024-08-31T08:39:03.209995+0000 mgr.a (mgr.14388) 16769 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:05 smithi163 bash[24253]: cluster 2024-08-31T08:39:03.209995+0000 mgr.a (mgr.14388) 16769 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:05 smithi027 bash[22610]: cluster 2024-08-31T08:39:03.209995+0000 mgr.a (mgr.14388) 16769 : cluster [DBG] pgmap v11625: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:07 smithi191 bash[24992]: cluster 2024-08-31T08:39:05.210793+0000 mgr.a (mgr.14388) 16770 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:07 smithi163 bash[24253]: cluster 2024-08-31T08:39:05.210793+0000 mgr.a (mgr.14388) 16770 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:07 smithi027 bash[22610]: cluster 2024-08-31T08:39:05.210793+0000 mgr.a (mgr.14388) 16770 : cluster [DBG] pgmap v11626: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:07.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:07.913 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:07.913 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:39:08.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:39:08.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:39:08.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:39:08.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:39:08.662 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:39:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:09 smithi191 bash[24992]: cluster 2024-08-31T08:39:07.211558+0000 mgr.a (mgr.14388) 16771 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:09 smithi163 bash[24253]: cluster 2024-08-31T08:39:07.211558+0000 mgr.a (mgr.14388) 16771 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:09 smithi027 bash[22610]: cluster 2024-08-31T08:39:07.211558+0000 mgr.a (mgr.14388) 16771 : cluster [DBG] pgmap v11627: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:10 smithi163 bash[24253]: audit 2024-08-31T08:39:08.242065+0000 mgr.a (mgr.14388) 16772 : audit [DBG] from='client.362043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:10 smithi027 bash[22610]: audit 2024-08-31T08:39:08.242065+0000 mgr.a (mgr.14388) 16772 : audit [DBG] from='client.362043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:10 smithi191 bash[24992]: audit 2024-08-31T08:39:08.242065+0000 mgr.a (mgr.14388) 16772 : audit [DBG] from='client.362043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:11 smithi163 bash[24253]: cluster 2024-08-31T08:39:09.214328+0000 mgr.a (mgr.14388) 16773 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:11 smithi027 bash[22610]: cluster 2024-08-31T08:39:09.214328+0000 mgr.a (mgr.14388) 16773 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:11 smithi191 bash[24992]: cluster 2024-08-31T08:39:09.214328+0000 mgr.a (mgr.14388) 16773 : cluster [DBG] pgmap v11628: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:13 smithi163 bash[24253]: cluster 2024-08-31T08:39:11.215133+0000 mgr.a (mgr.14388) 16774 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:39:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:13 smithi027 bash[22610]: cluster 2024-08-31T08:39:11.215133+0000 mgr.a (mgr.14388) 16774 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:39:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:13 smithi191 bash[24992]: cluster 2024-08-31T08:39:11.215133+0000 mgr.a (mgr.14388) 16774 : cluster [DBG] pgmap v11629: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:39:13.663 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:13.664 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:13.664 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:39:14.436 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:39:14.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:39:14.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:39:14.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:39:14.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:39:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:15 smithi163 bash[24253]: cluster 2024-08-31T08:39:13.217135+0000 mgr.a (mgr.14388) 16775 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:15 smithi163 bash[24253]: audit 2024-08-31T08:39:14.002262+0000 mgr.a (mgr.14388) 16776 : audit [DBG] from='client.362118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:15 smithi027 bash[22610]: cluster 2024-08-31T08:39:13.217135+0000 mgr.a (mgr.14388) 16775 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:15.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:15 smithi027 bash[22610]: audit 2024-08-31T08:39:14.002262+0000 mgr.a (mgr.14388) 16776 : audit [DBG] from='client.362118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:15 smithi191 bash[24992]: cluster 2024-08-31T08:39:13.217135+0000 mgr.a (mgr.14388) 16775 : cluster [DBG] pgmap v11630: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:15 smithi191 bash[24992]: audit 2024-08-31T08:39:14.002262+0000 mgr.a (mgr.14388) 16776 : audit [DBG] from='client.362118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:17 smithi163 bash[24253]: cluster 2024-08-31T08:39:15.218179+0000 mgr.a (mgr.14388) 16777 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:39:17.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:17 smithi027 bash[22610]: cluster 2024-08-31T08:39:15.218179+0000 mgr.a (mgr.14388) 16777 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:39:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:17 smithi191 bash[24992]: cluster 2024-08-31T08:39:15.218179+0000 mgr.a (mgr.14388) 16777 : cluster [DBG] pgmap v11631: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:39:19.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:19.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:19.438 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:39:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:19 smithi163 bash[24253]: cluster 2024-08-31T08:39:17.219025+0000 mgr.a (mgr.14388) 16778 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:39:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:19 smithi027 bash[22610]: cluster 2024-08-31T08:39:17.219025+0000 mgr.a (mgr.14388) 16778 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:39:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:19 smithi191 bash[24992]: cluster 2024-08-31T08:39:17.219025+0000 mgr.a (mgr.14388) 16778 : cluster [DBG] pgmap v11632: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:39:20.227 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:39:20.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:39:20.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:39:20.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:39:20.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:39:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:21 smithi163 bash[24253]: cluster 2024-08-31T08:39:19.221286+0000 mgr.a (mgr.14388) 16779 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:21 smithi163 bash[24253]: audit 2024-08-31T08:39:19.775594+0000 mgr.a (mgr.14388) 16780 : audit [DBG] from='client.362193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:21 smithi027 bash[22610]: cluster 2024-08-31T08:39:19.221286+0000 mgr.a (mgr.14388) 16779 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:21.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:21 smithi027 bash[22610]: audit 2024-08-31T08:39:19.775594+0000 mgr.a (mgr.14388) 16780 : audit [DBG] from='client.362193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:21 smithi191 bash[24992]: cluster 2024-08-31T08:39:19.221286+0000 mgr.a (mgr.14388) 16779 : cluster [DBG] pgmap v11633: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:21 smithi191 bash[24992]: audit 2024-08-31T08:39:19.775594+0000 mgr.a (mgr.14388) 16780 : audit [DBG] from='client.362193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:23 smithi163 bash[24253]: cluster 2024-08-31T08:39:21.222315+0000 mgr.a (mgr.14388) 16781 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:23 smithi027 bash[22610]: cluster 2024-08-31T08:39:21.222315+0000 mgr.a (mgr.14388) 16781 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:23 smithi191 bash[24992]: cluster 2024-08-31T08:39:21.222315+0000 mgr.a (mgr.14388) 16781 : cluster [DBG] pgmap v11634: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:25.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:25.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:25.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:39:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:25 smithi163 bash[24253]: cluster 2024-08-31T08:39:23.224710+0000 mgr.a (mgr.14388) 16782 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:25 smithi027 bash[22610]: cluster 2024-08-31T08:39:23.224710+0000 mgr.a (mgr.14388) 16782 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:25 smithi191 bash[24992]: cluster 2024-08-31T08:39:23.224710+0000 mgr.a (mgr.14388) 16782 : cluster [DBG] pgmap v11635: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:25.979 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:39:25.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:39:25.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:39:25.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:39:25.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:39:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:27 smithi163 bash[24253]: cluster 2024-08-31T08:39:25.225673+0000 mgr.a (mgr.14388) 16783 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:27 smithi163 bash[24253]: audit 2024-08-31T08:39:25.558393+0000 mgr.a (mgr.14388) 16784 : audit [DBG] from='client.362271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:27 smithi027 bash[22610]: cluster 2024-08-31T08:39:25.225673+0000 mgr.a (mgr.14388) 16783 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:27 smithi027 bash[22610]: audit 2024-08-31T08:39:25.558393+0000 mgr.a (mgr.14388) 16784 : audit [DBG] from='client.362271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:27 smithi191 bash[24992]: cluster 2024-08-31T08:39:25.225673+0000 mgr.a (mgr.14388) 16783 : cluster [DBG] pgmap v11636: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:27 smithi191 bash[24992]: audit 2024-08-31T08:39:25.558393+0000 mgr.a (mgr.14388) 16784 : audit [DBG] from='client.362271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:28 smithi163 bash[24253]: audit 2024-08-31T08:39:27.253548+0000 mon.a (mon.0) 3075 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:39:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:28 smithi027 bash[22610]: audit 2024-08-31T08:39:27.253548+0000 mon.a (mon.0) 3075 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:39:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:28 smithi191 bash[24992]: audit 2024-08-31T08:39:27.253548+0000 mon.a (mon.0) 3075 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:39:29.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:39:28 smithi027 bash[22863]: debug 2024-08-31T08:39:28.859+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:39:29.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:39:28 smithi027 bash[22863]: debug 2024-08-31T08:39:28.859+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:39:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:29 smithi027 bash[22610]: cluster 2024-08-31T08:39:27.226610+0000 mgr.a (mgr.14388) 16785 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:29 smithi027 bash[22610]: audit 2024-08-31T08:39:28.099754+0000 mon.a (mon.0) 3076 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:39:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:29 smithi027 bash[22610]: audit 2024-08-31T08:39:28.101292+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:39:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:29 smithi027 bash[22610]: audit 2024-08-31T08:39:28.110897+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:39:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:29 smithi027 bash[22610]: audit 2024-08-31T08:39:28.115617+0000 mon.a (mon.0) 3079 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:39:29.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:29 smithi027 bash[22610]: audit 2024-08-31T08:39:28.117996+0000 mgr.a (mgr.14388) 16786 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:39:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:29 smithi163 bash[24253]: cluster 2024-08-31T08:39:27.226610+0000 mgr.a (mgr.14388) 16785 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:29 smithi163 bash[24253]: audit 2024-08-31T08:39:28.099754+0000 mon.a (mon.0) 3076 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:39:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:29 smithi163 bash[24253]: audit 2024-08-31T08:39:28.101292+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:39:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:29 smithi163 bash[24253]: audit 2024-08-31T08:39:28.110897+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:39:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:29 smithi163 bash[24253]: audit 2024-08-31T08:39:28.115617+0000 mon.a (mon.0) 3079 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:39:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:29 smithi163 bash[24253]: audit 2024-08-31T08:39:28.117996+0000 mgr.a (mgr.14388) 16786 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:39:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:29 smithi191 bash[24992]: cluster 2024-08-31T08:39:27.226610+0000 mgr.a (mgr.14388) 16785 : cluster [DBG] pgmap v11637: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:29 smithi191 bash[24992]: audit 2024-08-31T08:39:28.099754+0000 mon.a (mon.0) 3076 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:39:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:29 smithi191 bash[24992]: audit 2024-08-31T08:39:28.101292+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:39:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:29 smithi191 bash[24992]: audit 2024-08-31T08:39:28.110897+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:39:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:29 smithi191 bash[24992]: audit 2024-08-31T08:39:28.115617+0000 mon.a (mon.0) 3079 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:39:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:29 smithi191 bash[24992]: audit 2024-08-31T08:39:28.117996+0000 mgr.a (mgr.14388) 16786 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:39:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:30 smithi163 bash[24253]: audit 2024-08-31T08:39:28.863162+0000 mgr.a (mgr.14388) 16787 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:39:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:30 smithi163 bash[24253]: cephadm 2024-08-31T08:39:28.864660+0000 mgr.a (mgr.14388) 16788 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:39:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:30 smithi027 bash[22610]: audit 2024-08-31T08:39:28.863162+0000 mgr.a (mgr.14388) 16787 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:39:30.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:30 smithi027 bash[22610]: cephadm 2024-08-31T08:39:28.864660+0000 mgr.a (mgr.14388) 16788 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:39:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:30 smithi191 bash[24992]: audit 2024-08-31T08:39:28.863162+0000 mgr.a (mgr.14388) 16787 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:39:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:30 smithi191 bash[24992]: cephadm 2024-08-31T08:39:28.864660+0000 mgr.a (mgr.14388) 16788 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:39:30.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:30.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:30.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:39:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:31 smithi163 bash[24253]: cluster 2024-08-31T08:39:29.229299+0000 mgr.a (mgr.14388) 16789 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:31 smithi027 bash[22610]: cluster 2024-08-31T08:39:29.229299+0000 mgr.a (mgr.14388) 16789 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:31 smithi191 bash[24992]: cluster 2024-08-31T08:39:29.229299+0000 mgr.a (mgr.14388) 16789 : cluster [DBG] pgmap v11638: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:39:31.716 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:39:31.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:39:31.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:39:31.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:39:31.717 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:39:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:33 smithi163 bash[24253]: cluster 2024-08-31T08:39:31.230173+0000 mgr.a (mgr.14388) 16790 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:33 smithi163 bash[24253]: audit 2024-08-31T08:39:31.311357+0000 mgr.a (mgr.14388) 16791 : audit [DBG] from='client.362451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:33 smithi027 bash[22610]: cluster 2024-08-31T08:39:31.230173+0000 mgr.a (mgr.14388) 16790 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:33.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:33 smithi027 bash[22610]: audit 2024-08-31T08:39:31.311357+0000 mgr.a (mgr.14388) 16791 : audit [DBG] from='client.362451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:33 smithi191 bash[24992]: cluster 2024-08-31T08:39:31.230173+0000 mgr.a (mgr.14388) 16790 : cluster [DBG] pgmap v11639: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:33 smithi191 bash[24992]: audit 2024-08-31T08:39:31.311357+0000 mgr.a (mgr.14388) 16791 : audit [DBG] from='client.362451 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:35.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:35 smithi163 bash[24253]: cluster 2024-08-31T08:39:33.232479+0000 mgr.a (mgr.14388) 16792 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T08:39:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:35 smithi027 bash[22610]: cluster 2024-08-31T08:39:33.232479+0000 mgr.a (mgr.14388) 16792 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T08:39:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:35 smithi191 bash[24992]: cluster 2024-08-31T08:39:33.232479+0000 mgr.a (mgr.14388) 16792 : cluster [DBG] pgmap v11640: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T08:39:36.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:36.719 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:36.719 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:39:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:37 smithi163 bash[24253]: cluster 2024-08-31T08:39:35.233262+0000 mgr.a (mgr.14388) 16793 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:37.473 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:39:37.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:39:37.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:39:37.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:39:37.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:39:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:37 smithi027 bash[22610]: cluster 2024-08-31T08:39:35.233262+0000 mgr.a (mgr.14388) 16793 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:37 smithi191 bash[24992]: cluster 2024-08-31T08:39:35.233262+0000 mgr.a (mgr.14388) 16793 : cluster [DBG] pgmap v11641: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:38 smithi163 bash[24253]: audit 2024-08-31T08:39:37.050435+0000 mgr.a (mgr.14388) 16794 : audit [DBG] from='client.362529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:38 smithi027 bash[22610]: audit 2024-08-31T08:39:37.050435+0000 mgr.a (mgr.14388) 16794 : audit [DBG] from='client.362529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:38 smithi191 bash[24992]: audit 2024-08-31T08:39:37.050435+0000 mgr.a (mgr.14388) 16794 : audit [DBG] from='client.362529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:39 smithi163 bash[24253]: cluster 2024-08-31T08:39:37.233789+0000 mgr.a (mgr.14388) 16795 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:39 smithi027 bash[22610]: cluster 2024-08-31T08:39:37.233789+0000 mgr.a (mgr.14388) 16795 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:39 smithi191 bash[24992]: cluster 2024-08-31T08:39:37.233789+0000 mgr.a (mgr.14388) 16795 : cluster [DBG] pgmap v11642: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:41 smithi163 bash[24253]: cluster 2024-08-31T08:39:39.236105+0000 mgr.a (mgr.14388) 16796 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T08:39:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:41 smithi027 bash[22610]: cluster 2024-08-31T08:39:39.236105+0000 mgr.a (mgr.14388) 16796 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T08:39:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:41 smithi191 bash[24992]: cluster 2024-08-31T08:39:39.236105+0000 mgr.a (mgr.14388) 16796 : cluster [DBG] pgmap v11643: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 8.4 KiB/s rd, 426 B/s wr, 8 op/s 2024-08-31T08:39:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:42.476 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:39:43.232 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:39:43.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:39:43.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:39:43.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:39:43.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:39:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:43 smithi163 bash[24253]: cluster 2024-08-31T08:39:41.236909+0000 mgr.a (mgr.14388) 16797 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:43 smithi027 bash[22610]: cluster 2024-08-31T08:39:41.236909+0000 mgr.a (mgr.14388) 16797 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:43 smithi191 bash[24992]: cluster 2024-08-31T08:39:41.236909+0000 mgr.a (mgr.14388) 16797 : cluster [DBG] pgmap v11644: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:44.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:44 smithi163 bash[24253]: audit 2024-08-31T08:39:42.806262+0000 mgr.a (mgr.14388) 16798 : audit [DBG] from='client.362604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:44 smithi027 bash[22610]: audit 2024-08-31T08:39:42.806262+0000 mgr.a (mgr.14388) 16798 : audit [DBG] from='client.362604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:44 smithi191 bash[24992]: audit 2024-08-31T08:39:42.806262+0000 mgr.a (mgr.14388) 16798 : audit [DBG] from='client.362604 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:45.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:45 smithi163 bash[24253]: cluster 2024-08-31T08:39:43.238208+0000 mgr.a (mgr.14388) 16799 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:45 smithi027 bash[22610]: cluster 2024-08-31T08:39:43.238208+0000 mgr.a (mgr.14388) 16799 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:45 smithi191 bash[24992]: cluster 2024-08-31T08:39:43.238208+0000 mgr.a (mgr.14388) 16799 : cluster [DBG] pgmap v11645: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:39:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:47 smithi163 bash[24253]: cluster 2024-08-31T08:39:45.238932+0000 mgr.a (mgr.14388) 16800 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:39:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:47 smithi027 bash[22610]: cluster 2024-08-31T08:39:45.238932+0000 mgr.a (mgr.14388) 16800 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:39:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:47 smithi191 bash[24992]: cluster 2024-08-31T08:39:45.238932+0000 mgr.a (mgr.14388) 16800 : cluster [DBG] pgmap v11646: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:39:48.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:48.234 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:48.235 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:39:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:48 smithi163 bash[24253]: cluster 2024-08-31T08:39:47.239712+0000 mgr.a (mgr.14388) 16801 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:39:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:48 smithi027 bash[22610]: cluster 2024-08-31T08:39:47.239712+0000 mgr.a (mgr.14388) 16801 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:39:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:48 smithi191 bash[24992]: cluster 2024-08-31T08:39:47.239712+0000 mgr.a (mgr.14388) 16801 : cluster [DBG] pgmap v11647: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:39:48.982 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:39:48.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:39:48.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:39:48.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:39:48.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:39:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:49 smithi163 bash[24253]: audit 2024-08-31T08:39:48.567637+0000 mgr.a (mgr.14388) 16802 : audit [DBG] from='client.362679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:49 smithi027 bash[22610]: audit 2024-08-31T08:39:48.567637+0000 mgr.a (mgr.14388) 16802 : audit [DBG] from='client.362679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:49 smithi191 bash[24992]: audit 2024-08-31T08:39:48.567637+0000 mgr.a (mgr.14388) 16802 : audit [DBG] from='client.362679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:50 smithi163 bash[24253]: cluster 2024-08-31T08:39:49.242344+0000 mgr.a (mgr.14388) 16803 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:50 smithi027 bash[22610]: cluster 2024-08-31T08:39:49.242344+0000 mgr.a (mgr.14388) 16803 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:50 smithi191 bash[24992]: cluster 2024-08-31T08:39:49.242344+0000 mgr.a (mgr.14388) 16803 : cluster [DBG] pgmap v11648: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:52 smithi163 bash[24253]: cluster 2024-08-31T08:39:51.243129+0000 mgr.a (mgr.14388) 16804 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:39:52.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:52 smithi027 bash[22610]: cluster 2024-08-31T08:39:51.243129+0000 mgr.a (mgr.14388) 16804 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:39:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:52 smithi191 bash[24992]: cluster 2024-08-31T08:39:51.243129+0000 mgr.a (mgr.14388) 16804 : cluster [DBG] pgmap v11649: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:39:53.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:53.984 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:53.984 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:39:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:54 smithi163 bash[24253]: cluster 2024-08-31T08:39:53.244979+0000 mgr.a (mgr.14388) 16805 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:54 smithi027 bash[22610]: cluster 2024-08-31T08:39:53.244979+0000 mgr.a (mgr.14388) 16805 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:54.765 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:39:54.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:39:54.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:39:54.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:39:54.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:39:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:54 smithi191 bash[24992]: cluster 2024-08-31T08:39:53.244979+0000 mgr.a (mgr.14388) 16805 : cluster [DBG] pgmap v11650: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:55 smithi163 bash[24253]: audit 2024-08-31T08:39:54.323525+0000 mgr.a (mgr.14388) 16806 : audit [DBG] from='client.362757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:55 smithi027 bash[22610]: audit 2024-08-31T08:39:54.323525+0000 mgr.a (mgr.14388) 16806 : audit [DBG] from='client.362757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:55 smithi191 bash[24992]: audit 2024-08-31T08:39:54.323525+0000 mgr.a (mgr.14388) 16806 : audit [DBG] from='client.362757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:39:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:56 smithi163 bash[24253]: cluster 2024-08-31T08:39:55.245882+0000 mgr.a (mgr.14388) 16807 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:56 smithi027 bash[22610]: cluster 2024-08-31T08:39:55.245882+0000 mgr.a (mgr.14388) 16807 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:56 smithi191 bash[24992]: cluster 2024-08-31T08:39:55.245882+0000 mgr.a (mgr.14388) 16807 : cluster [DBG] pgmap v11651: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:39:58 smithi163 bash[24253]: cluster 2024-08-31T08:39:57.246700+0000 mgr.a (mgr.14388) 16808 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:39:58 smithi027 bash[22610]: cluster 2024-08-31T08:39:57.246700+0000 mgr.a (mgr.14388) 16808 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:39:58 smithi191 bash[24992]: cluster 2024-08-31T08:39:57.246700+0000 mgr.a (mgr.14388) 16808 : cluster [DBG] pgmap v11652: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:39:59.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:39:59.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:39:59.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:00.540 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:00.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:00.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:00.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:00.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:00 smithi163 bash[24253]: cluster 2024-08-31T08:39:59.248913+0000 mgr.a (mgr.14388) 16809 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:00 smithi163 bash[24253]: cluster 2024-08-31T08:40:00.000145+0000 mon.a (mon.0) 3080 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:40:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:00 smithi163 bash[24253]: audit 2024-08-31T08:40:00.101282+0000 mgr.a (mgr.14388) 16810 : audit [DBG] from='client.362835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:00 smithi027 bash[22610]: cluster 2024-08-31T08:39:59.248913+0000 mgr.a (mgr.14388) 16809 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:00 smithi027 bash[22610]: cluster 2024-08-31T08:40:00.000145+0000 mon.a (mon.0) 3080 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:40:00.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:00 smithi027 bash[22610]: audit 2024-08-31T08:40:00.101282+0000 mgr.a (mgr.14388) 16810 : audit [DBG] from='client.362835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:00 smithi191 bash[24992]: cluster 2024-08-31T08:39:59.248913+0000 mgr.a (mgr.14388) 16809 : cluster [DBG] pgmap v11653: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:00 smithi191 bash[24992]: cluster 2024-08-31T08:40:00.000145+0000 mon.a (mon.0) 3080 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:40:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:00 smithi191 bash[24992]: audit 2024-08-31T08:40:00.101282+0000 mgr.a (mgr.14388) 16810 : audit [DBG] from='client.362835 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:02 smithi163 bash[24253]: cluster 2024-08-31T08:40:01.249973+0000 mgr.a (mgr.14388) 16811 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:02 smithi027 bash[22610]: cluster 2024-08-31T08:40:01.249973+0000 mgr.a (mgr.14388) 16811 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:02 smithi191 bash[24992]: cluster 2024-08-31T08:40:01.249973+0000 mgr.a (mgr.14388) 16811 : cluster [DBG] pgmap v11654: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:04 smithi163 bash[24253]: cluster 2024-08-31T08:40:03.252326+0000 mgr.a (mgr.14388) 16812 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:04 smithi027 bash[22610]: cluster 2024-08-31T08:40:03.252326+0000 mgr.a (mgr.14388) 16812 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:04 smithi191 bash[24992]: cluster 2024-08-31T08:40:03.252326+0000 mgr.a (mgr.14388) 16812 : cluster [DBG] pgmap v11655: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:05.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:40:05.542 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:40:05.542 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:06.290 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:06.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:06.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:06.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:06.290 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:06 smithi163 bash[24253]: cluster 2024-08-31T08:40:05.253259+0000 mgr.a (mgr.14388) 16813 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:06 smithi163 bash[24253]: audit 2024-08-31T08:40:05.874783+0000 mgr.a (mgr.14388) 16814 : audit [DBG] from='client.362910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:06 smithi027 bash[22610]: cluster 2024-08-31T08:40:05.253259+0000 mgr.a (mgr.14388) 16813 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:06 smithi027 bash[22610]: audit 2024-08-31T08:40:05.874783+0000 mgr.a (mgr.14388) 16814 : audit [DBG] from='client.362910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:06 smithi191 bash[24992]: cluster 2024-08-31T08:40:05.253259+0000 mgr.a (mgr.14388) 16813 : cluster [DBG] pgmap v11656: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:06 smithi191 bash[24992]: audit 2024-08-31T08:40:05.874783+0000 mgr.a (mgr.14388) 16814 : audit [DBG] from='client.362910 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:08 smithi163 bash[24253]: cluster 2024-08-31T08:40:07.254396+0000 mgr.a (mgr.14388) 16815 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:08 smithi027 bash[22610]: cluster 2024-08-31T08:40:07.254396+0000 mgr.a (mgr.14388) 16815 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:08 smithi191 bash[24992]: cluster 2024-08-31T08:40:07.254396+0000 mgr.a (mgr.14388) 16815 : cluster [DBG] pgmap v11657: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:10 smithi163 bash[24253]: cluster 2024-08-31T08:40:09.256838+0000 mgr.a (mgr.14388) 16816 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:10 smithi027 bash[22610]: cluster 2024-08-31T08:40:09.256838+0000 mgr.a (mgr.14388) 16816 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:10 smithi191 bash[24992]: cluster 2024-08-31T08:40:09.256838+0000 mgr.a (mgr.14388) 16816 : cluster [DBG] pgmap v11658: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:11.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:40:11.292 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:40:11.292 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:12.047 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:12.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:12.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:12.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:12.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:12 smithi163 bash[24253]: cluster 2024-08-31T08:40:11.257788+0000 mgr.a (mgr.14388) 16817 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:12 smithi163 bash[24253]: audit 2024-08-31T08:40:11.626417+0000 mgr.a (mgr.14388) 16818 : audit [DBG] from='client.362985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:12 smithi027 bash[22610]: cluster 2024-08-31T08:40:11.257788+0000 mgr.a (mgr.14388) 16817 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:12.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:12 smithi027 bash[22610]: audit 2024-08-31T08:40:11.626417+0000 mgr.a (mgr.14388) 16818 : audit [DBG] from='client.362985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:12 smithi191 bash[24992]: cluster 2024-08-31T08:40:11.257788+0000 mgr.a (mgr.14388) 16817 : cluster [DBG] pgmap v11659: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:12 smithi191 bash[24992]: audit 2024-08-31T08:40:11.626417+0000 mgr.a (mgr.14388) 16818 : audit [DBG] from='client.362985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:14.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:14 smithi163 bash[24253]: cluster 2024-08-31T08:40:13.260128+0000 mgr.a (mgr.14388) 16819 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:14 smithi027 bash[22610]: cluster 2024-08-31T08:40:13.260128+0000 mgr.a (mgr.14388) 16819 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:14 smithi191 bash[24992]: cluster 2024-08-31T08:40:13.260128+0000 mgr.a (mgr.14388) 16819 : cluster [DBG] pgmap v11660: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:16.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:16 smithi163 bash[24253]: cluster 2024-08-31T08:40:15.260928+0000 mgr.a (mgr.14388) 16820 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:16 smithi027 bash[22610]: cluster 2024-08-31T08:40:15.260928+0000 mgr.a (mgr.14388) 16820 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:16 smithi191 bash[24992]: cluster 2024-08-31T08:40:15.260928+0000 mgr.a (mgr.14388) 16820 : cluster [DBG] pgmap v11661: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:17.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:40:17.049 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:40:17.049 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:17.789 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:17.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:17.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:17.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:17.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:18 smithi163 bash[24253]: cluster 2024-08-31T08:40:17.261663+0000 mgr.a (mgr.14388) 16821 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:18.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:18 smithi163 bash[24253]: audit 2024-08-31T08:40:17.377788+0000 mgr.a (mgr.14388) 16822 : audit [DBG] from='client.363060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:18 smithi027 bash[22610]: cluster 2024-08-31T08:40:17.261663+0000 mgr.a (mgr.14388) 16821 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:18 smithi027 bash[22610]: audit 2024-08-31T08:40:17.377788+0000 mgr.a (mgr.14388) 16822 : audit [DBG] from='client.363060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:18 smithi191 bash[24992]: cluster 2024-08-31T08:40:17.261663+0000 mgr.a (mgr.14388) 16821 : cluster [DBG] pgmap v11662: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:18 smithi191 bash[24992]: audit 2024-08-31T08:40:17.377788+0000 mgr.a (mgr.14388) 16822 : audit [DBG] from='client.363060 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:20 smithi163 bash[24253]: cluster 2024-08-31T08:40:19.264104+0000 mgr.a (mgr.14388) 16823 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:20 smithi027 bash[22610]: cluster 2024-08-31T08:40:19.264104+0000 mgr.a (mgr.14388) 16823 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:20 smithi191 bash[24992]: cluster 2024-08-31T08:40:19.264104+0000 mgr.a (mgr.14388) 16823 : cluster [DBG] pgmap v11663: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:22.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:22 smithi163 bash[24253]: cluster 2024-08-31T08:40:21.264880+0000 mgr.a (mgr.14388) 16824 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:22 smithi027 bash[22610]: cluster 2024-08-31T08:40:21.264880+0000 mgr.a (mgr.14388) 16824 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:22 smithi191 bash[24992]: cluster 2024-08-31T08:40:21.264880+0000 mgr.a (mgr.14388) 16824 : cluster [DBG] pgmap v11664: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:22.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:40:22.792 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:40:22.792 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:23.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:23.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:23.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:23.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:23.572 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:23.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:23 smithi163 bash[24253]: audit 2024-08-31T08:40:23.127405+0000 mgr.a (mgr.14388) 16825 : audit [DBG] from='client.363138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:23 smithi027 bash[22610]: audit 2024-08-31T08:40:23.127405+0000 mgr.a (mgr.14388) 16825 : audit [DBG] from='client.363138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:23 smithi191 bash[24992]: audit 2024-08-31T08:40:23.127405+0000 mgr.a (mgr.14388) 16825 : audit [DBG] from='client.363138 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:24 smithi163 bash[24253]: cluster 2024-08-31T08:40:23.272300+0000 mgr.a (mgr.14388) 16826 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:24 smithi027 bash[22610]: cluster 2024-08-31T08:40:23.272300+0000 mgr.a (mgr.14388) 16826 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:24 smithi191 bash[24992]: cluster 2024-08-31T08:40:23.272300+0000 mgr.a (mgr.14388) 16826 : cluster [DBG] pgmap v11665: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:26.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:26 smithi163 bash[24253]: cluster 2024-08-31T08:40:25.273300+0000 mgr.a (mgr.14388) 16827 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:40:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:26 smithi027 bash[22610]: cluster 2024-08-31T08:40:25.273300+0000 mgr.a (mgr.14388) 16827 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:40:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:26 smithi191 bash[24992]: cluster 2024-08-31T08:40:25.273300+0000 mgr.a (mgr.14388) 16827 : cluster [DBG] pgmap v11666: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:40:28.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:40:28.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:40:28.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:28.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:28 smithi163 bash[24253]: cluster 2024-08-31T08:40:27.274111+0000 mgr.a (mgr.14388) 16828 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:40:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:28 smithi027 bash[22610]: cluster 2024-08-31T08:40:27.274111+0000 mgr.a (mgr.14388) 16828 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:40:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:28 smithi191 bash[24992]: cluster 2024-08-31T08:40:27.274111+0000 mgr.a (mgr.14388) 16828 : cluster [DBG] pgmap v11667: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:40:29.345 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:29.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:29.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:29.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:29.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:29 smithi163 bash[24253]: audit 2024-08-31T08:40:28.908803+0000 mgr.a (mgr.14388) 16829 : audit [DBG] from='client.363216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:29 smithi163 bash[24253]: audit 2024-08-31T08:40:28.928501+0000 mon.a (mon.0) 3081 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:40:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:29 smithi027 bash[22610]: audit 2024-08-31T08:40:28.908803+0000 mgr.a (mgr.14388) 16829 : audit [DBG] from='client.363216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:29 smithi027 bash[22610]: audit 2024-08-31T08:40:28.928501+0000 mon.a (mon.0) 3081 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:40:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:29 smithi191 bash[24992]: audit 2024-08-31T08:40:28.908803+0000 mgr.a (mgr.14388) 16829 : audit [DBG] from='client.363216 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:29 smithi191 bash[24992]: audit 2024-08-31T08:40:28.928501+0000 mon.a (mon.0) 3081 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:40:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:30 smithi163 bash[24253]: cluster 2024-08-31T08:40:29.275441+0000 mgr.a (mgr.14388) 16830 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:30 smithi027 bash[22610]: cluster 2024-08-31T08:40:29.275441+0000 mgr.a (mgr.14388) 16830 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:30 smithi191 bash[24992]: cluster 2024-08-31T08:40:29.275441+0000 mgr.a (mgr.14388) 16830 : cluster [DBG] pgmap v11668: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:32 smithi163 bash[24253]: cluster 2024-08-31T08:40:31.276190+0000 mgr.a (mgr.14388) 16831 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:40:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:32 smithi027 bash[22610]: cluster 2024-08-31T08:40:31.276190+0000 mgr.a (mgr.14388) 16831 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:40:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:32 smithi191 bash[24992]: cluster 2024-08-31T08:40:31.276190+0000 mgr.a (mgr.14388) 16831 : cluster [DBG] pgmap v11669: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:40:34.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:40:34.347 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:40:34.347 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:34 smithi163 bash[24253]: cluster 2024-08-31T08:40:33.278105+0000 mgr.a (mgr.14388) 16832 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:34 smithi163 bash[24253]: audit 2024-08-31T08:40:34.220996+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:34 smithi163 bash[24253]: audit 2024-08-31T08:40:34.225234+0000 mon.a (mon.0) 3083 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:34 smithi163 bash[24253]: audit 2024-08-31T08:40:34.256639+0000 mon.a (mon.0) 3084 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:34 smithi163 bash[24253]: audit 2024-08-31T08:40:34.264021+0000 mon.a (mon.0) 3085 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:34 smithi163 bash[24253]: audit 2024-08-31T08:40:34.267870+0000 mon.a (mon.0) 3086 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:34 smithi163 bash[24253]: audit 2024-08-31T08:40:34.275201+0000 mon.a (mon.0) 3087 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:34 smithi027 bash[22610]: cluster 2024-08-31T08:40:33.278105+0000 mgr.a (mgr.14388) 16832 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:34 smithi027 bash[22610]: audit 2024-08-31T08:40:34.220996+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:34 smithi027 bash[22610]: audit 2024-08-31T08:40:34.225234+0000 mon.a (mon.0) 3083 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:34 smithi027 bash[22610]: audit 2024-08-31T08:40:34.256639+0000 mon.a (mon.0) 3084 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:34 smithi027 bash[22610]: audit 2024-08-31T08:40:34.264021+0000 mon.a (mon.0) 3085 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:34 smithi027 bash[22610]: audit 2024-08-31T08:40:34.267870+0000 mon.a (mon.0) 3086 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:34 smithi027 bash[22610]: audit 2024-08-31T08:40:34.275201+0000 mon.a (mon.0) 3087 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:34 smithi191 bash[24992]: cluster 2024-08-31T08:40:33.278105+0000 mgr.a (mgr.14388) 16832 : cluster [DBG] pgmap v11670: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:34 smithi191 bash[24992]: audit 2024-08-31T08:40:34.220996+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:34 smithi191 bash[24992]: audit 2024-08-31T08:40:34.225234+0000 mon.a (mon.0) 3083 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:34 smithi191 bash[24992]: audit 2024-08-31T08:40:34.256639+0000 mon.a (mon.0) 3084 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:34 smithi191 bash[24992]: audit 2024-08-31T08:40:34.264021+0000 mon.a (mon.0) 3085 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:34 smithi191 bash[24992]: audit 2024-08-31T08:40:34.267870+0000 mon.a (mon.0) 3086 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:34 smithi191 bash[24992]: audit 2024-08-31T08:40:34.275201+0000 mon.a (mon.0) 3087 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:35.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:35.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:35.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:35.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:35.093 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:35 smithi163 bash[24253]: audit 2024-08-31T08:40:34.661536+0000 mgr.a (mgr.14388) 16833 : audit [DBG] from='client.363291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:35 smithi163 bash[24253]: audit 2024-08-31T08:40:35.004554+0000 mon.a (mon.0) 3088 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:40:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:35 smithi163 bash[24253]: audit 2024-08-31T08:40:35.005626+0000 mon.a (mon.0) 3089 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:40:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:35 smithi163 bash[24253]: audit 2024-08-31T08:40:35.011499+0000 mon.a (mon.0) 3090 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:35 smithi163 bash[24253]: audit 2024-08-31T08:40:35.013708+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:40:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:35 smithi163 bash[24253]: audit 2024-08-31T08:40:35.014914+0000 mgr.a (mgr.14388) 16834 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:40:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:35 smithi027 bash[22610]: audit 2024-08-31T08:40:34.661536+0000 mgr.a (mgr.14388) 16833 : audit [DBG] from='client.363291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:35 smithi027 bash[22610]: audit 2024-08-31T08:40:35.004554+0000 mon.a (mon.0) 3088 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:40:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:35 smithi027 bash[22610]: audit 2024-08-31T08:40:35.005626+0000 mon.a (mon.0) 3089 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:40:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:35 smithi027 bash[22610]: audit 2024-08-31T08:40:35.011499+0000 mon.a (mon.0) 3090 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:35 smithi027 bash[22610]: audit 2024-08-31T08:40:35.013708+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:40:35.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:35 smithi027 bash[22610]: audit 2024-08-31T08:40:35.014914+0000 mgr.a (mgr.14388) 16834 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:40:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:35 smithi191 bash[24992]: audit 2024-08-31T08:40:34.661536+0000 mgr.a (mgr.14388) 16833 : audit [DBG] from='client.363291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:35 smithi191 bash[24992]: audit 2024-08-31T08:40:35.004554+0000 mon.a (mon.0) 3088 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:40:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:35 smithi191 bash[24992]: audit 2024-08-31T08:40:35.005626+0000 mon.a (mon.0) 3089 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:40:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:35 smithi191 bash[24992]: audit 2024-08-31T08:40:35.011499+0000 mon.a (mon.0) 3090 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:40:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:35 smithi191 bash[24992]: audit 2024-08-31T08:40:35.013708+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:40:35.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:35 smithi191 bash[24992]: audit 2024-08-31T08:40:35.014914+0000 mgr.a (mgr.14388) 16834 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:40:36.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:40:35 smithi027 bash[22863]: debug 2024-08-31T08:40:35.785+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:40:36.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:40:35 smithi027 bash[22863]: debug 2024-08-31T08:40:35.789+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:40:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:37 smithi191 bash[24992]: cluster 2024-08-31T08:40:35.278843+0000 mgr.a (mgr.14388) 16835 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:37 smithi191 bash[24992]: audit 2024-08-31T08:40:35.789410+0000 mgr.a (mgr.14388) 16836 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:40:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:37 smithi191 bash[24992]: cephadm 2024-08-31T08:40:35.790831+0000 mgr.a (mgr.14388) 16837 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:40:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:37 smithi163 bash[24253]: cluster 2024-08-31T08:40:35.278843+0000 mgr.a (mgr.14388) 16835 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:37 smithi163 bash[24253]: audit 2024-08-31T08:40:35.789410+0000 mgr.a (mgr.14388) 16836 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:40:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:37 smithi163 bash[24253]: cephadm 2024-08-31T08:40:35.790831+0000 mgr.a (mgr.14388) 16837 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:40:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:37 smithi027 bash[22610]: cluster 2024-08-31T08:40:35.278843+0000 mgr.a (mgr.14388) 16835 : cluster [DBG] pgmap v11671: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:37 smithi027 bash[22610]: audit 2024-08-31T08:40:35.789410+0000 mgr.a (mgr.14388) 16836 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:40:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:37 smithi027 bash[22610]: cephadm 2024-08-31T08:40:35.790831+0000 mgr.a (mgr.14388) 16837 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:40:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:39 smithi191 bash[24992]: cluster 2024-08-31T08:40:37.279725+0000 mgr.a (mgr.14388) 16838 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:39 smithi163 bash[24253]: cluster 2024-08-31T08:40:37.279725+0000 mgr.a (mgr.14388) 16838 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:39 smithi027 bash[22610]: cluster 2024-08-31T08:40:37.279725+0000 mgr.a (mgr.14388) 16838 : cluster [DBG] pgmap v11672: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:40.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:40:40.095 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:40:40.095 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:40.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:40.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:40.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:40.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:40.875 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:41 smithi191 bash[24992]: cluster 2024-08-31T08:40:39.281947+0000 mgr.a (mgr.14388) 16839 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:41 smithi163 bash[24253]: cluster 2024-08-31T08:40:39.281947+0000 mgr.a (mgr.14388) 16839 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:41 smithi027 bash[22610]: cluster 2024-08-31T08:40:39.281947+0000 mgr.a (mgr.14388) 16839 : cluster [DBG] pgmap v11673: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:42 smithi191 bash[24992]: audit 2024-08-31T08:40:40.433548+0000 mgr.a (mgr.14388) 16840 : audit [DBG] from='client.363474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:42.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:42 smithi163 bash[24253]: audit 2024-08-31T08:40:40.433548+0000 mgr.a (mgr.14388) 16840 : audit [DBG] from='client.363474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:42 smithi027 bash[22610]: audit 2024-08-31T08:40:40.433548+0000 mgr.a (mgr.14388) 16840 : audit [DBG] from='client.363474 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:43 smithi191 bash[24992]: cluster 2024-08-31T08:40:41.282953+0000 mgr.a (mgr.14388) 16841 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:43 smithi163 bash[24253]: cluster 2024-08-31T08:40:41.282953+0000 mgr.a (mgr.14388) 16841 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:43 smithi027 bash[22610]: cluster 2024-08-31T08:40:41.282953+0000 mgr.a (mgr.14388) 16841 : cluster [DBG] pgmap v11674: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:45 smithi163 bash[24253]: cluster 2024-08-31T08:40:43.285153+0000 mgr.a (mgr.14388) 16842 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:45 smithi027 bash[22610]: cluster 2024-08-31T08:40:43.285153+0000 mgr.a (mgr.14388) 16842 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:45 smithi191 bash[24992]: cluster 2024-08-31T08:40:43.285153+0000 mgr.a (mgr.14388) 16842 : cluster [DBG] pgmap v11675: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:45.876 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:40:45.877 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:40:45.877 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:46.652 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:46.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:47.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:47 smithi163 bash[24253]: cluster 2024-08-31T08:40:45.285931+0000 mgr.a (mgr.14388) 16843 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:47 smithi027 bash[22610]: cluster 2024-08-31T08:40:45.285931+0000 mgr.a (mgr.14388) 16843 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:47 smithi191 bash[24992]: cluster 2024-08-31T08:40:45.285931+0000 mgr.a (mgr.14388) 16843 : cluster [DBG] pgmap v11676: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:48 smithi163 bash[24253]: audit 2024-08-31T08:40:46.210617+0000 mgr.a (mgr.14388) 16844 : audit [DBG] from='client.363546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:48 smithi027 bash[22610]: audit 2024-08-31T08:40:46.210617+0000 mgr.a (mgr.14388) 16844 : audit [DBG] from='client.363546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:48 smithi191 bash[24992]: audit 2024-08-31T08:40:46.210617+0000 mgr.a (mgr.14388) 16844 : audit [DBG] from='client.363546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:49 smithi163 bash[24253]: cluster 2024-08-31T08:40:47.287110+0000 mgr.a (mgr.14388) 16845 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:49 smithi027 bash[22610]: cluster 2024-08-31T08:40:47.287110+0000 mgr.a (mgr.14388) 16845 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:49 smithi191 bash[24992]: cluster 2024-08-31T08:40:47.287110+0000 mgr.a (mgr.14388) 16845 : cluster [DBG] pgmap v11677: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:51 smithi163 bash[24253]: cluster 2024-08-31T08:40:49.289428+0000 mgr.a (mgr.14388) 16846 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:51 smithi027 bash[22610]: cluster 2024-08-31T08:40:49.289428+0000 mgr.a (mgr.14388) 16846 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:51 smithi191 bash[24992]: cluster 2024-08-31T08:40:49.289428+0000 mgr.a (mgr.14388) 16846 : cluster [DBG] pgmap v11678: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:40:51.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:40:51.654 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:40:51.654 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:52.440 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:53 smithi163 bash[24253]: cluster 2024-08-31T08:40:51.290204+0000 mgr.a (mgr.14388) 16847 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:53 smithi163 bash[24253]: audit 2024-08-31T08:40:51.993168+0000 mgr.a (mgr.14388) 16848 : audit [DBG] from='client.363624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:53 smithi027 bash[22610]: cluster 2024-08-31T08:40:51.290204+0000 mgr.a (mgr.14388) 16847 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:53.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:53 smithi027 bash[22610]: audit 2024-08-31T08:40:51.993168+0000 mgr.a (mgr.14388) 16848 : audit [DBG] from='client.363624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:53 smithi191 bash[24992]: cluster 2024-08-31T08:40:51.290204+0000 mgr.a (mgr.14388) 16847 : cluster [DBG] pgmap v11679: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:53 smithi191 bash[24992]: audit 2024-08-31T08:40:51.993168+0000 mgr.a (mgr.14388) 16848 : audit [DBG] from='client.363624 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:55.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:55 smithi163 bash[24253]: cluster 2024-08-31T08:40:53.292586+0000 mgr.a (mgr.14388) 16849 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:55 smithi027 bash[22610]: cluster 2024-08-31T08:40:53.292586+0000 mgr.a (mgr.14388) 16849 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:55 smithi191 bash[24992]: cluster 2024-08-31T08:40:53.292586+0000 mgr.a (mgr.14388) 16849 : cluster [DBG] pgmap v11680: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:40:57.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:40:57.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:40:57.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:40:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:57 smithi163 bash[24253]: cluster 2024-08-31T08:40:55.293345+0000 mgr.a (mgr.14388) 16850 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:57 smithi027 bash[22610]: cluster 2024-08-31T08:40:55.293345+0000 mgr.a (mgr.14388) 16850 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:57 smithi191 bash[24992]: cluster 2024-08-31T08:40:55.293345+0000 mgr.a (mgr.14388) 16850 : cluster [DBG] pgmap v11681: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:58.220 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:40:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:40:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:40:58.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:40:58.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:40:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:59 smithi163 bash[24253]: cluster 2024-08-31T08:40:57.294124+0000 mgr.a (mgr.14388) 16851 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:40:59 smithi163 bash[24253]: audit 2024-08-31T08:40:57.773743+0000 mgr.a (mgr.14388) 16852 : audit [DBG] from='client.363699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:59 smithi027 bash[22610]: cluster 2024-08-31T08:40:57.294124+0000 mgr.a (mgr.14388) 16851 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:40:59 smithi027 bash[22610]: audit 2024-08-31T08:40:57.773743+0000 mgr.a (mgr.14388) 16852 : audit [DBG] from='client.363699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:40:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:59 smithi191 bash[24992]: cluster 2024-08-31T08:40:57.294124+0000 mgr.a (mgr.14388) 16851 : cluster [DBG] pgmap v11682: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:40:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:40:59 smithi191 bash[24992]: audit 2024-08-31T08:40:57.773743+0000 mgr.a (mgr.14388) 16852 : audit [DBG] from='client.363699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:01 smithi163 bash[24253]: cluster 2024-08-31T08:40:59.297067+0000 mgr.a (mgr.14388) 16853 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:41:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:01 smithi027 bash[22610]: cluster 2024-08-31T08:40:59.297067+0000 mgr.a (mgr.14388) 16853 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:41:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:01 smithi191 bash[24992]: cluster 2024-08-31T08:40:59.297067+0000 mgr.a (mgr.14388) 16853 : cluster [DBG] pgmap v11683: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:41:03.221 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:41:03.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:41:03.222 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:41:03.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:03 smithi163 bash[24253]: cluster 2024-08-31T08:41:01.297924+0000 mgr.a (mgr.14388) 16854 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:41:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:03 smithi027 bash[22610]: cluster 2024-08-31T08:41:01.297924+0000 mgr.a (mgr.14388) 16854 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:41:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:03 smithi191 bash[24992]: cluster 2024-08-31T08:41:01.297924+0000 mgr.a (mgr.14388) 16854 : cluster [DBG] pgmap v11684: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:41:04.003 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:41:04.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:41:04.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:41:04.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:41:04.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:41:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:05 smithi163 bash[24253]: cluster 2024-08-31T08:41:03.299894+0000 mgr.a (mgr.14388) 16855 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:05 smithi163 bash[24253]: audit 2024-08-31T08:41:03.555012+0000 mgr.a (mgr.14388) 16856 : audit [DBG] from='client.363777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:05 smithi027 bash[22610]: cluster 2024-08-31T08:41:03.299894+0000 mgr.a (mgr.14388) 16855 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:05.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:05 smithi027 bash[22610]: audit 2024-08-31T08:41:03.555012+0000 mgr.a (mgr.14388) 16856 : audit [DBG] from='client.363777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:05 smithi191 bash[24992]: cluster 2024-08-31T08:41:03.299894+0000 mgr.a (mgr.14388) 16855 : cluster [DBG] pgmap v11685: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:05 smithi191 bash[24992]: audit 2024-08-31T08:41:03.555012+0000 mgr.a (mgr.14388) 16856 : audit [DBG] from='client.363777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:07 smithi163 bash[24253]: cluster 2024-08-31T08:41:05.300861+0000 mgr.a (mgr.14388) 16857 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:41:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:07 smithi027 bash[22610]: cluster 2024-08-31T08:41:05.300861+0000 mgr.a (mgr.14388) 16857 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:41:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:07 smithi191 bash[24992]: cluster 2024-08-31T08:41:05.300861+0000 mgr.a (mgr.14388) 16857 : cluster [DBG] pgmap v11686: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:41:09.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:41:09.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:41:09.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:41:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:09 smithi163 bash[24253]: cluster 2024-08-31T08:41:07.301664+0000 mgr.a (mgr.14388) 16858 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:41:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:09 smithi027 bash[22610]: cluster 2024-08-31T08:41:07.301664+0000 mgr.a (mgr.14388) 16858 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:41:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:09 smithi191 bash[24992]: cluster 2024-08-31T08:41:07.301664+0000 mgr.a (mgr.14388) 16858 : cluster [DBG] pgmap v11687: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:41:09.742 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:41:09.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:41:09.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:41:09.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:41:09.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:41:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:11 smithi163 bash[24253]: cluster 2024-08-31T08:41:09.303812+0000 mgr.a (mgr.14388) 16859 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:11 smithi163 bash[24253]: audit 2024-08-31T08:41:09.335570+0000 mgr.a (mgr.14388) 16860 : audit [DBG] from='client.363855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:11 smithi027 bash[22610]: cluster 2024-08-31T08:41:09.303812+0000 mgr.a (mgr.14388) 16859 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:11.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:11 smithi027 bash[22610]: audit 2024-08-31T08:41:09.335570+0000 mgr.a (mgr.14388) 16860 : audit [DBG] from='client.363855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:11 smithi191 bash[24992]: cluster 2024-08-31T08:41:09.303812+0000 mgr.a (mgr.14388) 16859 : cluster [DBG] pgmap v11688: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:11 smithi191 bash[24992]: audit 2024-08-31T08:41:09.335570+0000 mgr.a (mgr.14388) 16860 : audit [DBG] from='client.363855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:13 smithi163 bash[24253]: cluster 2024-08-31T08:41:11.304736+0000 mgr.a (mgr.14388) 16861 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:41:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:13 smithi027 bash[22610]: cluster 2024-08-31T08:41:11.304736+0000 mgr.a (mgr.14388) 16861 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:41:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:13 smithi191 bash[24992]: cluster 2024-08-31T08:41:11.304736+0000 mgr.a (mgr.14388) 16861 : cluster [DBG] pgmap v11689: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:41:14.743 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:41:14.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:41:14.744 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:41:15.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:15 smithi163 bash[24253]: cluster 2024-08-31T08:41:13.306947+0000 mgr.a (mgr.14388) 16862 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:41:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:15 smithi027 bash[22610]: cluster 2024-08-31T08:41:13.306947+0000 mgr.a (mgr.14388) 16862 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:41:15.533 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:41:15.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:41:15.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:41:15.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:41:15.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:41:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:15 smithi191 bash[24992]: cluster 2024-08-31T08:41:13.306947+0000 mgr.a (mgr.14388) 16862 : cluster [DBG] pgmap v11690: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:41:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:16 smithi163 bash[24253]: audit 2024-08-31T08:41:15.081585+0000 mgr.a (mgr.14388) 16863 : audit [DBG] from='client.363933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:16 smithi027 bash[22610]: audit 2024-08-31T08:41:15.081585+0000 mgr.a (mgr.14388) 16863 : audit [DBG] from='client.363933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:16 smithi191 bash[24992]: audit 2024-08-31T08:41:15.081585+0000 mgr.a (mgr.14388) 16863 : audit [DBG] from='client.363933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:17 smithi163 bash[24253]: cluster 2024-08-31T08:41:15.307507+0000 mgr.a (mgr.14388) 16864 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:17 smithi027 bash[22610]: cluster 2024-08-31T08:41:15.307507+0000 mgr.a (mgr.14388) 16864 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:17 smithi191 bash[24992]: cluster 2024-08-31T08:41:15.307507+0000 mgr.a (mgr.14388) 16864 : cluster [DBG] pgmap v11691: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:19 smithi163 bash[24253]: cluster 2024-08-31T08:41:17.308413+0000 mgr.a (mgr.14388) 16865 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:19 smithi027 bash[22610]: cluster 2024-08-31T08:41:17.308413+0000 mgr.a (mgr.14388) 16865 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:19 smithi191 bash[24992]: cluster 2024-08-31T08:41:17.308413+0000 mgr.a (mgr.14388) 16865 : cluster [DBG] pgmap v11692: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:20.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:41:20.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:41:20.535 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:41:21.274 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:41:21.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:41:21.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:41:21.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:41:21.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:41:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:21 smithi163 bash[24253]: cluster 2024-08-31T08:41:19.310639+0000 mgr.a (mgr.14388) 16866 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:21 smithi027 bash[22610]: cluster 2024-08-31T08:41:19.310639+0000 mgr.a (mgr.14388) 16866 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:21 smithi191 bash[24992]: cluster 2024-08-31T08:41:19.310639+0000 mgr.a (mgr.14388) 16866 : cluster [DBG] pgmap v11693: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:22 smithi163 bash[24253]: audit 2024-08-31T08:41:20.861308+0000 mgr.a (mgr.14388) 16867 : audit [DBG] from='client.364005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:22 smithi027 bash[22610]: audit 2024-08-31T08:41:20.861308+0000 mgr.a (mgr.14388) 16867 : audit [DBG] from='client.364005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:22 smithi191 bash[24992]: audit 2024-08-31T08:41:20.861308+0000 mgr.a (mgr.14388) 16867 : audit [DBG] from='client.364005 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:23 smithi163 bash[24253]: cluster 2024-08-31T08:41:21.311230+0000 mgr.a (mgr.14388) 16868 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:23 smithi027 bash[22610]: cluster 2024-08-31T08:41:21.311230+0000 mgr.a (mgr.14388) 16868 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:23 smithi191 bash[24992]: cluster 2024-08-31T08:41:21.311230+0000 mgr.a (mgr.14388) 16868 : cluster [DBG] pgmap v11694: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:25 smithi163 bash[24253]: cluster 2024-08-31T08:41:23.313371+0000 mgr.a (mgr.14388) 16869 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:25 smithi027 bash[22610]: cluster 2024-08-31T08:41:23.313371+0000 mgr.a (mgr.14388) 16869 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:25 smithi191 bash[24992]: cluster 2024-08-31T08:41:23.313371+0000 mgr.a (mgr.14388) 16869 : cluster [DBG] pgmap v11695: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:26.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:41:26.276 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:41:26.276 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:41:27.026 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:41:27.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:41:27.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:41:27.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:41:27.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:41:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:27 smithi163 bash[24253]: cluster 2024-08-31T08:41:25.314124+0000 mgr.a (mgr.14388) 16870 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:27 smithi027 bash[22610]: cluster 2024-08-31T08:41:25.314124+0000 mgr.a (mgr.14388) 16870 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:27 smithi191 bash[24992]: cluster 2024-08-31T08:41:25.314124+0000 mgr.a (mgr.14388) 16870 : cluster [DBG] pgmap v11696: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:28 smithi163 bash[24253]: audit 2024-08-31T08:41:26.604235+0000 mgr.a (mgr.14388) 16871 : audit [DBG] from='client.364077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:28 smithi027 bash[22610]: audit 2024-08-31T08:41:26.604235+0000 mgr.a (mgr.14388) 16871 : audit [DBG] from='client.364077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:28 smithi191 bash[24992]: audit 2024-08-31T08:41:26.604235+0000 mgr.a (mgr.14388) 16871 : audit [DBG] from='client.364077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:29 smithi163 bash[24253]: cluster 2024-08-31T08:41:27.315083+0000 mgr.a (mgr.14388) 16872 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:29 smithi027 bash[22610]: cluster 2024-08-31T08:41:27.315083+0000 mgr.a (mgr.14388) 16872 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:29 smithi191 bash[24992]: cluster 2024-08-31T08:41:27.315083+0000 mgr.a (mgr.14388) 16872 : cluster [DBG] pgmap v11697: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:31 smithi163 bash[24253]: cluster 2024-08-31T08:41:29.317258+0000 mgr.a (mgr.14388) 16873 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:31 smithi027 bash[22610]: cluster 2024-08-31T08:41:29.317258+0000 mgr.a (mgr.14388) 16873 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:31 smithi191 bash[24992]: cluster 2024-08-31T08:41:29.317258+0000 mgr.a (mgr.14388) 16873 : cluster [DBG] pgmap v11698: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:32.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:41:32.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:41:32.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:41:32.814 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:41:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:41:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:41:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:41:32.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:41:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:33 smithi163 bash[24253]: cluster 2024-08-31T08:41:31.318066+0000 mgr.a (mgr.14388) 16874 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:33 smithi027 bash[22610]: cluster 2024-08-31T08:41:31.318066+0000 mgr.a (mgr.14388) 16874 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:33.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:33 smithi191 bash[24992]: cluster 2024-08-31T08:41:31.318066+0000 mgr.a (mgr.14388) 16874 : cluster [DBG] pgmap v11699: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:34.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:34 smithi163 bash[24253]: audit 2024-08-31T08:41:32.369664+0000 mgr.a (mgr.14388) 16875 : audit [DBG] from='client.364155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:34 smithi027 bash[22610]: audit 2024-08-31T08:41:32.369664+0000 mgr.a (mgr.14388) 16875 : audit [DBG] from='client.364155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:34 smithi191 bash[24992]: audit 2024-08-31T08:41:32.369664+0000 mgr.a (mgr.14388) 16875 : audit [DBG] from='client.364155 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:35 smithi163 bash[24253]: cluster 2024-08-31T08:41:33.320445+0000 mgr.a (mgr.14388) 16876 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:35 smithi027 bash[22610]: cluster 2024-08-31T08:41:33.320445+0000 mgr.a (mgr.14388) 16876 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:35 smithi191 bash[24992]: cluster 2024-08-31T08:41:33.320445+0000 mgr.a (mgr.14388) 16876 : cluster [DBG] pgmap v11700: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:36 smithi027 bash[22610]: cluster 2024-08-31T08:41:35.321265+0000 mgr.a (mgr.14388) 16877 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:36 smithi027 bash[22610]: audit 2024-08-31T08:41:35.841238+0000 mon.a (mon.0) 3092 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:41:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:36 smithi191 bash[24992]: cluster 2024-08-31T08:41:35.321265+0000 mgr.a (mgr.14388) 16877 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:36 smithi191 bash[24992]: audit 2024-08-31T08:41:35.841238+0000 mon.a (mon.0) 3092 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:41:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:36 smithi163 bash[24253]: cluster 2024-08-31T08:41:35.321265+0000 mgr.a (mgr.14388) 16877 : cluster [DBG] pgmap v11701: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:36.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:36 smithi163 bash[24253]: audit 2024-08-31T08:41:35.841238+0000 mon.a (mon.0) 3092 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:41:37.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:41:37 smithi027 bash[22863]: debug 2024-08-31T08:41:37.444+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:41:37.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:41:37 smithi027 bash[22863]: debug 2024-08-31T08:41:37.444+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:41:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:37 smithi027 bash[22610]: audit 2024-08-31T08:41:36.673014+0000 mon.a (mon.0) 3093 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:41:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:37 smithi027 bash[22610]: audit 2024-08-31T08:41:36.674897+0000 mon.a (mon.0) 3094 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:41:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:37 smithi027 bash[22610]: audit 2024-08-31T08:41:36.683528+0000 mon.a (mon.0) 3095 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:41:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:37 smithi027 bash[22610]: audit 2024-08-31T08:41:36.688197+0000 mon.a (mon.0) 3096 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:41:37.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:37 smithi027 bash[22610]: audit 2024-08-31T08:41:36.690437+0000 mgr.a (mgr.14388) 16878 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:41:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:37 smithi191 bash[24992]: audit 2024-08-31T08:41:36.673014+0000 mon.a (mon.0) 3093 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:41:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:37 smithi191 bash[24992]: audit 2024-08-31T08:41:36.674897+0000 mon.a (mon.0) 3094 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:41:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:37 smithi191 bash[24992]: audit 2024-08-31T08:41:36.683528+0000 mon.a (mon.0) 3095 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:41:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:37 smithi191 bash[24992]: audit 2024-08-31T08:41:36.688197+0000 mon.a (mon.0) 3096 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:41:37.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:37 smithi191 bash[24992]: audit 2024-08-31T08:41:36.690437+0000 mgr.a (mgr.14388) 16878 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:41:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:37 smithi163 bash[24253]: audit 2024-08-31T08:41:36.673014+0000 mon.a (mon.0) 3093 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:41:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:37 smithi163 bash[24253]: audit 2024-08-31T08:41:36.674897+0000 mon.a (mon.0) 3094 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:41:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:37 smithi163 bash[24253]: audit 2024-08-31T08:41:36.683528+0000 mon.a (mon.0) 3095 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:41:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:37 smithi163 bash[24253]: audit 2024-08-31T08:41:36.688197+0000 mon.a (mon.0) 3096 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:41:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:37 smithi163 bash[24253]: audit 2024-08-31T08:41:36.690437+0000 mgr.a (mgr.14388) 16878 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:41:37.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:41:37.816 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:41:37.816 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:41:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:38 smithi027 bash[22610]: cluster 2024-08-31T08:41:37.321745+0000 mgr.a (mgr.14388) 16879 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:38 smithi027 bash[22610]: audit 2024-08-31T08:41:37.448820+0000 mgr.a (mgr.14388) 16880 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:41:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:38 smithi027 bash[22610]: cephadm 2024-08-31T08:41:37.450408+0000 mgr.a (mgr.14388) 16881 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:41:38.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:38 smithi027 bash[22610]: audit 2024-08-31T08:41:38.151797+0000 mgr.a (mgr.14388) 16882 : audit [DBG] from='client.364338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:38 smithi191 bash[24992]: cluster 2024-08-31T08:41:37.321745+0000 mgr.a (mgr.14388) 16879 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:38 smithi191 bash[24992]: audit 2024-08-31T08:41:37.448820+0000 mgr.a (mgr.14388) 16880 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:41:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:38 smithi191 bash[24992]: cephadm 2024-08-31T08:41:37.450408+0000 mgr.a (mgr.14388) 16881 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:41:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:38 smithi191 bash[24992]: audit 2024-08-31T08:41:38.151797+0000 mgr.a (mgr.14388) 16882 : audit [DBG] from='client.364338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:38.592 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:41:38.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:41:38.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:41:38.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:41:38.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:41:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:38 smithi163 bash[24253]: cluster 2024-08-31T08:41:37.321745+0000 mgr.a (mgr.14388) 16879 : cluster [DBG] pgmap v11702: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:38 smithi163 bash[24253]: audit 2024-08-31T08:41:37.448820+0000 mgr.a (mgr.14388) 16880 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:41:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:38 smithi163 bash[24253]: cephadm 2024-08-31T08:41:37.450408+0000 mgr.a (mgr.14388) 16881 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:41:38.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:38 smithi163 bash[24253]: audit 2024-08-31T08:41:38.151797+0000 mgr.a (mgr.14388) 16882 : audit [DBG] from='client.364338 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:40 smithi163 bash[24253]: cluster 2024-08-31T08:41:39.324615+0000 mgr.a (mgr.14388) 16883 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:41:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:40 smithi027 bash[22610]: cluster 2024-08-31T08:41:39.324615+0000 mgr.a (mgr.14388) 16883 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:41:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:40 smithi191 bash[24992]: cluster 2024-08-31T08:41:39.324615+0000 mgr.a (mgr.14388) 16883 : cluster [DBG] pgmap v11703: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:41:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:42 smithi163 bash[24253]: cluster 2024-08-31T08:41:41.325426+0000 mgr.a (mgr.14388) 16884 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:41:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:42 smithi027 bash[22610]: cluster 2024-08-31T08:41:41.325426+0000 mgr.a (mgr.14388) 16884 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:41:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:42 smithi191 bash[24992]: cluster 2024-08-31T08:41:41.325426+0000 mgr.a (mgr.14388) 16884 : cluster [DBG] pgmap v11704: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:41:43.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:41:43.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:41:43.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:41:44.377 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:41:44.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:41:44.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:41:44.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:41:44.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:41:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:44 smithi163 bash[24253]: cluster 2024-08-31T08:41:43.327368+0000 mgr.a (mgr.14388) 16885 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:41:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:44 smithi163 bash[24253]: audit 2024-08-31T08:41:43.927195+0000 mgr.a (mgr.14388) 16886 : audit [DBG] from='client.364416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:44 smithi027 bash[22610]: cluster 2024-08-31T08:41:43.327368+0000 mgr.a (mgr.14388) 16885 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:41:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:44 smithi027 bash[22610]: audit 2024-08-31T08:41:43.927195+0000 mgr.a (mgr.14388) 16886 : audit [DBG] from='client.364416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:44 smithi191 bash[24992]: cluster 2024-08-31T08:41:43.327368+0000 mgr.a (mgr.14388) 16885 : cluster [DBG] pgmap v11705: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:41:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:44 smithi191 bash[24992]: audit 2024-08-31T08:41:43.927195+0000 mgr.a (mgr.14388) 16886 : audit [DBG] from='client.364416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:46 smithi163 bash[24253]: cluster 2024-08-31T08:41:45.328280+0000 mgr.a (mgr.14388) 16887 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:41:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:46 smithi027 bash[22610]: cluster 2024-08-31T08:41:45.328280+0000 mgr.a (mgr.14388) 16887 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:41:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:46 smithi191 bash[24992]: cluster 2024-08-31T08:41:45.328280+0000 mgr.a (mgr.14388) 16887 : cluster [DBG] pgmap v11706: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:41:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:48 smithi163 bash[24253]: cluster 2024-08-31T08:41:47.329075+0000 mgr.a (mgr.14388) 16888 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:41:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:48 smithi027 bash[22610]: cluster 2024-08-31T08:41:47.329075+0000 mgr.a (mgr.14388) 16888 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:41:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:48 smithi191 bash[24992]: cluster 2024-08-31T08:41:47.329075+0000 mgr.a (mgr.14388) 16888 : cluster [DBG] pgmap v11707: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:41:49.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:41:49.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:41:49.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:41:50.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:41:50.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:41:50.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:41:50.143 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:41:50.143 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:41:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:50 smithi163 bash[24253]: cluster 2024-08-31T08:41:49.331280+0000 mgr.a (mgr.14388) 16889 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:41:50.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:50 smithi163 bash[24253]: audit 2024-08-31T08:41:49.712360+0000 mgr.a (mgr.14388) 16890 : audit [DBG] from='client.364488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:50 smithi027 bash[22610]: cluster 2024-08-31T08:41:49.331280+0000 mgr.a (mgr.14388) 16889 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:41:50.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:50 smithi027 bash[22610]: audit 2024-08-31T08:41:49.712360+0000 mgr.a (mgr.14388) 16890 : audit [DBG] from='client.364488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:50 smithi191 bash[24992]: cluster 2024-08-31T08:41:49.331280+0000 mgr.a (mgr.14388) 16889 : cluster [DBG] pgmap v11708: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:41:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:50 smithi191 bash[24992]: audit 2024-08-31T08:41:49.712360+0000 mgr.a (mgr.14388) 16890 : audit [DBG] from='client.364488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:52 smithi163 bash[24253]: cluster 2024-08-31T08:41:51.332186+0000 mgr.a (mgr.14388) 16891 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:52 smithi027 bash[22610]: cluster 2024-08-31T08:41:51.332186+0000 mgr.a (mgr.14388) 16891 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:52 smithi191 bash[24992]: cluster 2024-08-31T08:41:51.332186+0000 mgr.a (mgr.14388) 16891 : cluster [DBG] pgmap v11709: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:54 smithi163 bash[24253]: cluster 2024-08-31T08:41:53.334320+0000 mgr.a (mgr.14388) 16892 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:54 smithi027 bash[22610]: cluster 2024-08-31T08:41:53.334320+0000 mgr.a (mgr.14388) 16892 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:54 smithi191 bash[24992]: cluster 2024-08-31T08:41:53.334320+0000 mgr.a (mgr.14388) 16892 : cluster [DBG] pgmap v11710: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:41:55.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:41:55.145 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:41:55.145 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:41:55.889 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:41:55.889 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:41:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:41:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:41:55.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:41:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:56 smithi163 bash[24253]: cluster 2024-08-31T08:41:55.334788+0000 mgr.a (mgr.14388) 16893 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:56.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:56 smithi163 bash[24253]: audit 2024-08-31T08:41:55.473806+0000 mgr.a (mgr.14388) 16894 : audit [DBG] from='client.364566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:56 smithi027 bash[22610]: cluster 2024-08-31T08:41:55.334788+0000 mgr.a (mgr.14388) 16893 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:56.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:56 smithi027 bash[22610]: audit 2024-08-31T08:41:55.473806+0000 mgr.a (mgr.14388) 16894 : audit [DBG] from='client.364566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:56 smithi191 bash[24992]: cluster 2024-08-31T08:41:55.334788+0000 mgr.a (mgr.14388) 16893 : cluster [DBG] pgmap v11711: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:56 smithi191 bash[24992]: audit 2024-08-31T08:41:55.473806+0000 mgr.a (mgr.14388) 16894 : audit [DBG] from='client.364566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:41:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:41:58 smithi163 bash[24253]: cluster 2024-08-31T08:41:57.335631+0000 mgr.a (mgr.14388) 16895 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:41:58 smithi027 bash[22610]: cluster 2024-08-31T08:41:57.335631+0000 mgr.a (mgr.14388) 16895 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:41:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:41:58 smithi191 bash[24992]: cluster 2024-08-31T08:41:57.335631+0000 mgr.a (mgr.14388) 16895 : cluster [DBG] pgmap v11712: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:00.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:00 smithi163 bash[24253]: cluster 2024-08-31T08:41:59.337855+0000 mgr.a (mgr.14388) 16896 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:42:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:00 smithi027 bash[22610]: cluster 2024-08-31T08:41:59.337855+0000 mgr.a (mgr.14388) 16896 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:42:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:00 smithi191 bash[24992]: cluster 2024-08-31T08:41:59.337855+0000 mgr.a (mgr.14388) 16896 : cluster [DBG] pgmap v11713: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:42:00.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:00.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:00.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:01.674 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:01.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:01.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:01.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:01.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:02 smithi163 bash[24253]: audit 2024-08-31T08:42:01.228631+0000 mgr.a (mgr.14388) 16897 : audit [DBG] from='client.364641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:02.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:02 smithi163 bash[24253]: cluster 2024-08-31T08:42:01.338358+0000 mgr.a (mgr.14388) 16898 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:02 smithi027 bash[22610]: audit 2024-08-31T08:42:01.228631+0000 mgr.a (mgr.14388) 16897 : audit [DBG] from='client.364641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:02.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:02 smithi027 bash[22610]: cluster 2024-08-31T08:42:01.338358+0000 mgr.a (mgr.14388) 16898 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:02 smithi191 bash[24992]: audit 2024-08-31T08:42:01.228631+0000 mgr.a (mgr.14388) 16897 : audit [DBG] from='client.364641 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:02 smithi191 bash[24992]: cluster 2024-08-31T08:42:01.338358+0000 mgr.a (mgr.14388) 16898 : cluster [DBG] pgmap v11714: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:04 smithi163 bash[24253]: cluster 2024-08-31T08:42:03.340554+0000 mgr.a (mgr.14388) 16899 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:42:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:04 smithi027 bash[22610]: cluster 2024-08-31T08:42:03.340554+0000 mgr.a (mgr.14388) 16899 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:42:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:04 smithi191 bash[24992]: cluster 2024-08-31T08:42:03.340554+0000 mgr.a (mgr.14388) 16899 : cluster [DBG] pgmap v11715: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:42:06.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:06.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:06.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:06 smithi163 bash[24253]: cluster 2024-08-31T08:42:05.341331+0000 mgr.a (mgr.14388) 16900 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:06 smithi027 bash[22610]: cluster 2024-08-31T08:42:05.341331+0000 mgr.a (mgr.14388) 16900 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:06 smithi191 bash[24992]: cluster 2024-08-31T08:42:05.341331+0000 mgr.a (mgr.14388) 16900 : cluster [DBG] pgmap v11716: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:07.461 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:07.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:07 smithi163 bash[24253]: audit 2024-08-31T08:42:07.008144+0000 mgr.a (mgr.14388) 16901 : audit [DBG] from='client.364716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:07 smithi027 bash[22610]: audit 2024-08-31T08:42:07.008144+0000 mgr.a (mgr.14388) 16901 : audit [DBG] from='client.364716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:07 smithi191 bash[24992]: audit 2024-08-31T08:42:07.008144+0000 mgr.a (mgr.14388) 16901 : audit [DBG] from='client.364716 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:08.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:08 smithi163 bash[24253]: cluster 2024-08-31T08:42:07.341848+0000 mgr.a (mgr.14388) 16902 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:08 smithi027 bash[22610]: cluster 2024-08-31T08:42:07.341848+0000 mgr.a (mgr.14388) 16902 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:08 smithi191 bash[24992]: cluster 2024-08-31T08:42:07.341848+0000 mgr.a (mgr.14388) 16902 : cluster [DBG] pgmap v11717: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:10 smithi027 bash[22610]: cluster 2024-08-31T08:42:09.344189+0000 mgr.a (mgr.14388) 16903 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:42:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:10 smithi191 bash[24992]: cluster 2024-08-31T08:42:09.344189+0000 mgr.a (mgr.14388) 16903 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:42:10.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:10 smithi163 bash[24253]: cluster 2024-08-31T08:42:09.344189+0000 mgr.a (mgr.14388) 16903 : cluster [DBG] pgmap v11718: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:42:12.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:12.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:12.463 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:12 smithi027 bash[22610]: cluster 2024-08-31T08:42:11.344959+0000 mgr.a (mgr.14388) 16904 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:12 smithi191 bash[24992]: cluster 2024-08-31T08:42:11.344959+0000 mgr.a (mgr.14388) 16904 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:12 smithi163 bash[24253]: cluster 2024-08-31T08:42:11.344959+0000 mgr.a (mgr.14388) 16904 : cluster [DBG] pgmap v11719: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:13.233 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:13.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:13.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:13.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:13.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:13 smithi027 bash[22610]: audit 2024-08-31T08:42:12.800370+0000 mgr.a (mgr.14388) 16905 : audit [DBG] from='client.364791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:13 smithi191 bash[24992]: audit 2024-08-31T08:42:12.800370+0000 mgr.a (mgr.14388) 16905 : audit [DBG] from='client.364791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:13 smithi163 bash[24253]: audit 2024-08-31T08:42:12.800370+0000 mgr.a (mgr.14388) 16905 : audit [DBG] from='client.364791 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:14 smithi027 bash[22610]: cluster 2024-08-31T08:42:13.347796+0000 mgr.a (mgr.14388) 16906 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:14.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:14 smithi191 bash[24992]: cluster 2024-08-31T08:42:13.347796+0000 mgr.a (mgr.14388) 16906 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:14 smithi163 bash[24253]: cluster 2024-08-31T08:42:13.347796+0000 mgr.a (mgr.14388) 16906 : cluster [DBG] pgmap v11720: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:16 smithi027 bash[22610]: cluster 2024-08-31T08:42:15.348585+0000 mgr.a (mgr.14388) 16907 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:42:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:16 smithi191 bash[24992]: cluster 2024-08-31T08:42:15.348585+0000 mgr.a (mgr.14388) 16907 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:42:16.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:16 smithi163 bash[24253]: cluster 2024-08-31T08:42:15.348585+0000 mgr.a (mgr.14388) 16907 : cluster [DBG] pgmap v11721: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:42:18.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:18.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:18.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:18 smithi027 bash[22610]: cluster 2024-08-31T08:42:17.349363+0000 mgr.a (mgr.14388) 16908 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:42:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:18 smithi191 bash[24992]: cluster 2024-08-31T08:42:17.349363+0000 mgr.a (mgr.14388) 16908 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:42:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:18 smithi163 bash[24253]: cluster 2024-08-31T08:42:17.349363+0000 mgr.a (mgr.14388) 16908 : cluster [DBG] pgmap v11722: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:42:19.011 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:19.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:19.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:19.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:19.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:19 smithi191 bash[24992]: audit 2024-08-31T08:42:18.575031+0000 mgr.a (mgr.14388) 16909 : audit [DBG] from='client.364869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:19.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:19 smithi163 bash[24253]: audit 2024-08-31T08:42:18.575031+0000 mgr.a (mgr.14388) 16909 : audit [DBG] from='client.364869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:19 smithi027 bash[22610]: audit 2024-08-31T08:42:18.575031+0000 mgr.a (mgr.14388) 16909 : audit [DBG] from='client.364869 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:20 smithi191 bash[24992]: cluster 2024-08-31T08:42:19.352202+0000 mgr.a (mgr.14388) 16910 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:20 smithi163 bash[24253]: cluster 2024-08-31T08:42:19.352202+0000 mgr.a (mgr.14388) 16910 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:20 smithi027 bash[22610]: cluster 2024-08-31T08:42:19.352202+0000 mgr.a (mgr.14388) 16910 : cluster [DBG] pgmap v11723: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:22 smithi191 bash[24992]: cluster 2024-08-31T08:42:21.352994+0000 mgr.a (mgr.14388) 16911 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:42:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:22 smithi163 bash[24253]: cluster 2024-08-31T08:42:21.352994+0000 mgr.a (mgr.14388) 16911 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:42:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:22 smithi027 bash[22610]: cluster 2024-08-31T08:42:21.352994+0000 mgr.a (mgr.14388) 16911 : cluster [DBG] pgmap v11724: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:42:24.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:24.013 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:24.013 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:24.773 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:24.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:24.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:24.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:24.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:24 smithi191 bash[24992]: cluster 2024-08-31T08:42:23.355066+0000 mgr.a (mgr.14388) 16912 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:24 smithi163 bash[24253]: cluster 2024-08-31T08:42:23.355066+0000 mgr.a (mgr.14388) 16912 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:24 smithi027 bash[22610]: cluster 2024-08-31T08:42:23.355066+0000 mgr.a (mgr.14388) 16912 : cluster [DBG] pgmap v11725: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:25 smithi191 bash[24992]: audit 2024-08-31T08:42:24.351355+0000 mgr.a (mgr.14388) 16913 : audit [DBG] from='client.364947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:25 smithi163 bash[24253]: audit 2024-08-31T08:42:24.351355+0000 mgr.a (mgr.14388) 16913 : audit [DBG] from='client.364947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:25 smithi027 bash[22610]: audit 2024-08-31T08:42:24.351355+0000 mgr.a (mgr.14388) 16913 : audit [DBG] from='client.364947 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:26 smithi191 bash[24992]: cluster 2024-08-31T08:42:25.355997+0000 mgr.a (mgr.14388) 16914 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:26 smithi163 bash[24253]: cluster 2024-08-31T08:42:25.355997+0000 mgr.a (mgr.14388) 16914 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:26 smithi027 bash[22610]: cluster 2024-08-31T08:42:25.355997+0000 mgr.a (mgr.14388) 16914 : cluster [DBG] pgmap v11726: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:28 smithi191 bash[24992]: cluster 2024-08-31T08:42:27.356802+0000 mgr.a (mgr.14388) 16915 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:28 smithi163 bash[24253]: cluster 2024-08-31T08:42:27.356802+0000 mgr.a (mgr.14388) 16915 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:28 smithi027 bash[22610]: cluster 2024-08-31T08:42:27.356802+0000 mgr.a (mgr.14388) 16915 : cluster [DBG] pgmap v11727: 225 pgs: 225 active+clean; 589 KiB data, 173 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:29.774 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:30.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:30.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:30.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:30.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:30.528 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:30 smithi191 bash[24992]: cluster 2024-08-31T08:42:29.359016+0000 mgr.a (mgr.14388) 16916 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:42:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:30 smithi191 bash[24992]: audit 2024-08-31T08:42:30.097711+0000 mgr.a (mgr.14388) 16917 : audit [DBG] from='client.365025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:30 smithi163 bash[24253]: cluster 2024-08-31T08:42:29.359016+0000 mgr.a (mgr.14388) 16916 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:42:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:30 smithi163 bash[24253]: audit 2024-08-31T08:42:30.097711+0000 mgr.a (mgr.14388) 16917 : audit [DBG] from='client.365025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:30 smithi027 bash[22610]: cluster 2024-08-31T08:42:29.359016+0000 mgr.a (mgr.14388) 16916 : cluster [DBG] pgmap v11728: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:42:30.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:30 smithi027 bash[22610]: audit 2024-08-31T08:42:30.097711+0000 mgr.a (mgr.14388) 16917 : audit [DBG] from='client.365025 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:32 smithi191 bash[24992]: cluster 2024-08-31T08:42:31.359990+0000 mgr.a (mgr.14388) 16918 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:42:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:32 smithi163 bash[24253]: cluster 2024-08-31T08:42:31.359990+0000 mgr.a (mgr.14388) 16918 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:42:32.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:32 smithi027 bash[22610]: cluster 2024-08-31T08:42:31.359990+0000 mgr.a (mgr.14388) 16918 : cluster [DBG] pgmap v11729: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:42:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:34 smithi191 bash[24992]: cluster 2024-08-31T08:42:33.362146+0000 mgr.a (mgr.14388) 16919 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:42:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:34 smithi163 bash[24253]: cluster 2024-08-31T08:42:33.362146+0000 mgr.a (mgr.14388) 16919 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:42:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:34 smithi027 bash[22610]: cluster 2024-08-31T08:42:33.362146+0000 mgr.a (mgr.14388) 16919 : cluster [DBG] pgmap v11730: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:42:35.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:35.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:36.299 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:36.299 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:36.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:36.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:36.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:36 smithi191 bash[24992]: cluster 2024-08-31T08:42:35.362942+0000 mgr.a (mgr.14388) 16920 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:42:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:36 smithi191 bash[24992]: audit 2024-08-31T08:42:35.865875+0000 mgr.a (mgr.14388) 16921 : audit [DBG] from='client.365103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:36 smithi163 bash[24253]: cluster 2024-08-31T08:42:35.362942+0000 mgr.a (mgr.14388) 16920 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:42:36.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:36 smithi163 bash[24253]: audit 2024-08-31T08:42:35.865875+0000 mgr.a (mgr.14388) 16921 : audit [DBG] from='client.365103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:36 smithi027 bash[22610]: cluster 2024-08-31T08:42:35.362942+0000 mgr.a (mgr.14388) 16920 : cluster [DBG] pgmap v11731: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:42:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:36 smithi027 bash[22610]: audit 2024-08-31T08:42:35.865875+0000 mgr.a (mgr.14388) 16921 : audit [DBG] from='client.365103 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:37 smithi163 bash[24253]: audit 2024-08-31T08:42:37.512476+0000 mon.a (mon.0) 3097 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:42:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:37 smithi027 bash[22610]: audit 2024-08-31T08:42:37.512476+0000 mon.a (mon.0) 3097 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:42:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:37 smithi191 bash[24992]: audit 2024-08-31T08:42:37.512476+0000 mon.a (mon.0) 3097 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:42:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:38 smithi163 bash[24253]: cluster 2024-08-31T08:42:37.363852+0000 mgr.a (mgr.14388) 16922 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:42:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:38 smithi163 bash[24253]: audit 2024-08-31T08:42:38.346963+0000 mon.a (mon.0) 3098 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:42:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:38 smithi163 bash[24253]: audit 2024-08-31T08:42:38.348358+0000 mon.a (mon.0) 3099 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:42:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:38 smithi163 bash[24253]: audit 2024-08-31T08:42:38.357121+0000 mon.a (mon.0) 3100 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:42:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:38 smithi163 bash[24253]: audit 2024-08-31T08:42:38.361945+0000 mon.a (mon.0) 3101 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:42:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:38 smithi027 bash[22610]: cluster 2024-08-31T08:42:37.363852+0000 mgr.a (mgr.14388) 16922 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:42:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:38 smithi027 bash[22610]: audit 2024-08-31T08:42:38.346963+0000 mon.a (mon.0) 3098 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:42:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:38 smithi027 bash[22610]: audit 2024-08-31T08:42:38.348358+0000 mon.a (mon.0) 3099 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:42:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:38 smithi027 bash[22610]: audit 2024-08-31T08:42:38.357121+0000 mon.a (mon.0) 3100 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:42:38.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:38 smithi027 bash[22610]: audit 2024-08-31T08:42:38.361945+0000 mon.a (mon.0) 3101 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:38 smithi191 bash[24992]: cluster 2024-08-31T08:42:37.363852+0000 mgr.a (mgr.14388) 16922 : cluster [DBG] pgmap v11732: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:38 smithi191 bash[24992]: audit 2024-08-31T08:42:38.346963+0000 mon.a (mon.0) 3098 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:38 smithi191 bash[24992]: audit 2024-08-31T08:42:38.348358+0000 mon.a (mon.0) 3099 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:38 smithi191 bash[24992]: audit 2024-08-31T08:42:38.357121+0000 mon.a (mon.0) 3100 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:42:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:38 smithi191 bash[24992]: audit 2024-08-31T08:42:38.361945+0000 mon.a (mon.0) 3101 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:42:39.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:42:39 smithi027 bash[22863]: debug 2024-08-31T08:42:39.114+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:42:39.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:42:39 smithi027 bash[22863]: debug 2024-08-31T08:42:39.114+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:42:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:39 smithi163 bash[24253]: audit 2024-08-31T08:42:38.364385+0000 mgr.a (mgr.14388) 16923 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:42:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:39 smithi163 bash[24253]: audit 2024-08-31T08:42:39.115214+0000 mgr.a (mgr.14388) 16924 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:42:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:39 smithi163 bash[24253]: cephadm 2024-08-31T08:42:39.117586+0000 mgr.a (mgr.14388) 16925 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:42:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:39 smithi027 bash[22610]: audit 2024-08-31T08:42:38.364385+0000 mgr.a (mgr.14388) 16923 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:42:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:39 smithi027 bash[22610]: audit 2024-08-31T08:42:39.115214+0000 mgr.a (mgr.14388) 16924 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:42:39.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:39 smithi027 bash[22610]: cephadm 2024-08-31T08:42:39.117586+0000 mgr.a (mgr.14388) 16925 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:42:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:39 smithi191 bash[24992]: audit 2024-08-31T08:42:38.364385+0000 mgr.a (mgr.14388) 16923 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:42:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:39 smithi191 bash[24992]: audit 2024-08-31T08:42:39.115214+0000 mgr.a (mgr.14388) 16924 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:42:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:39 smithi191 bash[24992]: cephadm 2024-08-31T08:42:39.117586+0000 mgr.a (mgr.14388) 16925 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:42:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:40 smithi163 bash[24253]: cluster 2024-08-31T08:42:39.366798+0000 mgr.a (mgr.14388) 16926 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:42:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:40 smithi027 bash[22610]: cluster 2024-08-31T08:42:39.366798+0000 mgr.a (mgr.14388) 16926 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:42:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:40 smithi191 bash[24992]: cluster 2024-08-31T08:42:39.366798+0000 mgr.a (mgr.14388) 16926 : cluster [DBG] pgmap v11733: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:42:41.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:41.301 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:41.301 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:42.092 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:42.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:42.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:42 smithi163 bash[24253]: cluster 2024-08-31T08:42:41.367320+0000 mgr.a (mgr.14388) 16927 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:42.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:42 smithi163 bash[24253]: audit 2024-08-31T08:42:41.639537+0000 mgr.a (mgr.14388) 16928 : audit [DBG] from='client.365286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:42 smithi027 bash[22610]: cluster 2024-08-31T08:42:41.367320+0000 mgr.a (mgr.14388) 16927 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:42 smithi027 bash[22610]: audit 2024-08-31T08:42:41.639537+0000 mgr.a (mgr.14388) 16928 : audit [DBG] from='client.365286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:42 smithi191 bash[24992]: cluster 2024-08-31T08:42:41.367320+0000 mgr.a (mgr.14388) 16927 : cluster [DBG] pgmap v11734: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:42:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:42 smithi191 bash[24992]: audit 2024-08-31T08:42:41.639537+0000 mgr.a (mgr.14388) 16928 : audit [DBG] from='client.365286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:44.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:44 smithi163 bash[24253]: cluster 2024-08-31T08:42:43.369524+0000 mgr.a (mgr.14388) 16929 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:42:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:44 smithi027 bash[22610]: cluster 2024-08-31T08:42:43.369524+0000 mgr.a (mgr.14388) 16929 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:42:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:44 smithi191 bash[24992]: cluster 2024-08-31T08:42:43.369524+0000 mgr.a (mgr.14388) 16929 : cluster [DBG] pgmap v11735: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:42:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:46 smithi163 bash[24253]: cluster 2024-08-31T08:42:45.370289+0000 mgr.a (mgr.14388) 16930 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:42:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:46 smithi027 bash[22610]: cluster 2024-08-31T08:42:45.370289+0000 mgr.a (mgr.14388) 16930 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:42:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:46 smithi191 bash[24992]: cluster 2024-08-31T08:42:45.370289+0000 mgr.a (mgr.14388) 16930 : cluster [DBG] pgmap v11736: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:42:47.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:47.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:47.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:47.868 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:47.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:48 smithi163 bash[24253]: cluster 2024-08-31T08:42:47.371076+0000 mgr.a (mgr.14388) 16931 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:42:48.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:48 smithi163 bash[24253]: audit 2024-08-31T08:42:47.423886+0000 mgr.a (mgr.14388) 16932 : audit [DBG] from='client.365361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:48 smithi027 bash[22610]: cluster 2024-08-31T08:42:47.371076+0000 mgr.a (mgr.14388) 16931 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:42:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:48 smithi027 bash[22610]: audit 2024-08-31T08:42:47.423886+0000 mgr.a (mgr.14388) 16932 : audit [DBG] from='client.365361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:48 smithi191 bash[24992]: cluster 2024-08-31T08:42:47.371076+0000 mgr.a (mgr.14388) 16931 : cluster [DBG] pgmap v11737: 225 pgs: 225 active+clean; 589 KiB data, 178 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:42:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:48 smithi191 bash[24992]: audit 2024-08-31T08:42:47.423886+0000 mgr.a (mgr.14388) 16932 : audit [DBG] from='client.365361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:50 smithi163 bash[24253]: cluster 2024-08-31T08:42:49.373414+0000 mgr.a (mgr.14388) 16933 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T08:42:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:50 smithi027 bash[22610]: cluster 2024-08-31T08:42:49.373414+0000 mgr.a (mgr.14388) 16933 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T08:42:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:50 smithi191 bash[24992]: cluster 2024-08-31T08:42:49.373414+0000 mgr.a (mgr.14388) 16933 : cluster [DBG] pgmap v11738: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T08:42:52.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:52.870 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:52.870 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:52 smithi163 bash[24253]: cluster 2024-08-31T08:42:51.374210+0000 mgr.a (mgr.14388) 16934 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:42:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:52 smithi027 bash[22610]: cluster 2024-08-31T08:42:51.374210+0000 mgr.a (mgr.14388) 16934 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:42:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:52 smithi191 bash[24992]: cluster 2024-08-31T08:42:51.374210+0000 mgr.a (mgr.14388) 16934 : cluster [DBG] pgmap v11739: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:42:53.637 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:53.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:53.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:53.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:53.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:54 smithi163 bash[24253]: audit 2024-08-31T08:42:53.202835+0000 mgr.a (mgr.14388) 16935 : audit [DBG] from='client.365439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:54 smithi163 bash[24253]: cluster 2024-08-31T08:42:53.377425+0000 mgr.a (mgr.14388) 16936 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:42:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:54 smithi027 bash[22610]: audit 2024-08-31T08:42:53.202835+0000 mgr.a (mgr.14388) 16935 : audit [DBG] from='client.365439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:54 smithi027 bash[22610]: cluster 2024-08-31T08:42:53.377425+0000 mgr.a (mgr.14388) 16936 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:42:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:54 smithi191 bash[24992]: audit 2024-08-31T08:42:53.202835+0000 mgr.a (mgr.14388) 16935 : audit [DBG] from='client.365439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:54 smithi191 bash[24992]: cluster 2024-08-31T08:42:53.377425+0000 mgr.a (mgr.14388) 16936 : cluster [DBG] pgmap v11740: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T08:42:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:56 smithi163 bash[24253]: cluster 2024-08-31T08:42:55.378396+0000 mgr.a (mgr.14388) 16937 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:42:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:56 smithi027 bash[22610]: cluster 2024-08-31T08:42:55.378396+0000 mgr.a (mgr.14388) 16937 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:42:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:56 smithi191 bash[24992]: cluster 2024-08-31T08:42:55.378396+0000 mgr.a (mgr.14388) 16937 : cluster [DBG] pgmap v11741: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:42:58.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:42:58.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:42:58.640 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:42:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:58 smithi163 bash[24253]: cluster 2024-08-31T08:42:57.379191+0000 mgr.a (mgr.14388) 16938 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:42:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:58 smithi027 bash[22610]: cluster 2024-08-31T08:42:57.379191+0000 mgr.a (mgr.14388) 16938 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:42:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:58 smithi191 bash[24992]: cluster 2024-08-31T08:42:57.379191+0000 mgr.a (mgr.14388) 16938 : cluster [DBG] pgmap v11742: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T08:42:59.391 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:42:59.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:42:59.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:42:59.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:42:59.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:42:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:42:59 smithi163 bash[24253]: audit 2024-08-31T08:42:58.974433+0000 mgr.a (mgr.14388) 16939 : audit [DBG] from='client.365517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:42:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:42:59 smithi027 bash[22610]: audit 2024-08-31T08:42:58.974433+0000 mgr.a (mgr.14388) 16939 : audit [DBG] from='client.365517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:42:59 smithi191 bash[24992]: audit 2024-08-31T08:42:58.974433+0000 mgr.a (mgr.14388) 16939 : audit [DBG] from='client.365517 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:00 smithi163 bash[24253]: cluster 2024-08-31T08:42:59.380557+0000 mgr.a (mgr.14388) 16940 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:43:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:00 smithi027 bash[22610]: cluster 2024-08-31T08:42:59.380557+0000 mgr.a (mgr.14388) 16940 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:43:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:00 smithi191 bash[24992]: cluster 2024-08-31T08:42:59.380557+0000 mgr.a (mgr.14388) 16940 : cluster [DBG] pgmap v11743: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:43:02.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:02 smithi163 bash[24253]: cluster 2024-08-31T08:43:01.381291+0000 mgr.a (mgr.14388) 16941 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:43:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:02 smithi027 bash[22610]: cluster 2024-08-31T08:43:01.381291+0000 mgr.a (mgr.14388) 16941 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:43:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:02 smithi191 bash[24992]: cluster 2024-08-31T08:43:01.381291+0000 mgr.a (mgr.14388) 16941 : cluster [DBG] pgmap v11744: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:43:04.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:43:04.393 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:43:04.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:43:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:04 smithi163 bash[24253]: cluster 2024-08-31T08:43:03.383230+0000 mgr.a (mgr.14388) 16942 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:43:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:04 smithi027 bash[22610]: cluster 2024-08-31T08:43:03.383230+0000 mgr.a (mgr.14388) 16942 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:43:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:04 smithi191 bash[24992]: cluster 2024-08-31T08:43:03.383230+0000 mgr.a (mgr.14388) 16942 : cluster [DBG] pgmap v11745: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:43:05.144 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:43:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:43:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:43:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:43:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:43:05.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:05 smithi163 bash[24253]: audit 2024-08-31T08:43:04.723192+0000 mgr.a (mgr.14388) 16943 : audit [DBG] from='client.365592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:05 smithi027 bash[22610]: audit 2024-08-31T08:43:04.723192+0000 mgr.a (mgr.14388) 16943 : audit [DBG] from='client.365592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:05 smithi191 bash[24992]: audit 2024-08-31T08:43:04.723192+0000 mgr.a (mgr.14388) 16943 : audit [DBG] from='client.365592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:06 smithi163 bash[24253]: cluster 2024-08-31T08:43:05.384066+0000 mgr.a (mgr.14388) 16944 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:06 smithi027 bash[22610]: cluster 2024-08-31T08:43:05.384066+0000 mgr.a (mgr.14388) 16944 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:06 smithi191 bash[24992]: cluster 2024-08-31T08:43:05.384066+0000 mgr.a (mgr.14388) 16944 : cluster [DBG] pgmap v11746: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:08 smithi163 bash[24253]: cluster 2024-08-31T08:43:07.384823+0000 mgr.a (mgr.14388) 16945 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:08 smithi027 bash[22610]: cluster 2024-08-31T08:43:07.384823+0000 mgr.a (mgr.14388) 16945 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:08 smithi191 bash[24992]: cluster 2024-08-31T08:43:07.384823+0000 mgr.a (mgr.14388) 16945 : cluster [DBG] pgmap v11747: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:10.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:43:10.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:43:10.146 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:43:10.897 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:43:10.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:43:10.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:43:10.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:43:10.897 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:43:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:10 smithi163 bash[24253]: cluster 2024-08-31T08:43:09.387038+0000 mgr.a (mgr.14388) 16946 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:10 smithi027 bash[22610]: cluster 2024-08-31T08:43:09.387038+0000 mgr.a (mgr.14388) 16946 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:10 smithi191 bash[24992]: cluster 2024-08-31T08:43:09.387038+0000 mgr.a (mgr.14388) 16946 : cluster [DBG] pgmap v11748: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:11.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:11 smithi163 bash[24253]: audit 2024-08-31T08:43:10.473241+0000 mgr.a (mgr.14388) 16947 : audit [DBG] from='client.365667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:11 smithi027 bash[22610]: audit 2024-08-31T08:43:10.473241+0000 mgr.a (mgr.14388) 16947 : audit [DBG] from='client.365667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:11 smithi191 bash[24992]: audit 2024-08-31T08:43:10.473241+0000 mgr.a (mgr.14388) 16947 : audit [DBG] from='client.365667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:12 smithi163 bash[24253]: cluster 2024-08-31T08:43:11.387886+0000 mgr.a (mgr.14388) 16948 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:12 smithi027 bash[22610]: cluster 2024-08-31T08:43:11.387886+0000 mgr.a (mgr.14388) 16948 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:12 smithi191 bash[24992]: cluster 2024-08-31T08:43:11.387886+0000 mgr.a (mgr.14388) 16948 : cluster [DBG] pgmap v11749: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:14 smithi163 bash[24253]: cluster 2024-08-31T08:43:13.390022+0000 mgr.a (mgr.14388) 16949 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:14 smithi027 bash[22610]: cluster 2024-08-31T08:43:13.390022+0000 mgr.a (mgr.14388) 16949 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:14 smithi191 bash[24992]: cluster 2024-08-31T08:43:13.390022+0000 mgr.a (mgr.14388) 16949 : cluster [DBG] pgmap v11750: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:15.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:43:15.899 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:43:15.899 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:43:16.681 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:43:16.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:43:16.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:43:16.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:43:16.682 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:43:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:16 smithi163 bash[24253]: cluster 2024-08-31T08:43:15.390787+0000 mgr.a (mgr.14388) 16950 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:16 smithi027 bash[22610]: cluster 2024-08-31T08:43:15.390787+0000 mgr.a (mgr.14388) 16950 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:16 smithi191 bash[24992]: cluster 2024-08-31T08:43:15.390787+0000 mgr.a (mgr.14388) 16950 : cluster [DBG] pgmap v11751: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:17 smithi163 bash[24253]: audit 2024-08-31T08:43:16.233801+0000 mgr.a (mgr.14388) 16951 : audit [DBG] from='client.365745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:17 smithi027 bash[22610]: audit 2024-08-31T08:43:16.233801+0000 mgr.a (mgr.14388) 16951 : audit [DBG] from='client.365745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:17 smithi191 bash[24992]: audit 2024-08-31T08:43:16.233801+0000 mgr.a (mgr.14388) 16951 : audit [DBG] from='client.365745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:18 smithi163 bash[24253]: cluster 2024-08-31T08:43:17.391648+0000 mgr.a (mgr.14388) 16952 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:18 smithi027 bash[22610]: cluster 2024-08-31T08:43:17.391648+0000 mgr.a (mgr.14388) 16952 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:18 smithi191 bash[24992]: cluster 2024-08-31T08:43:17.391648+0000 mgr.a (mgr.14388) 16952 : cluster [DBG] pgmap v11752: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:20 smithi163 bash[24253]: cluster 2024-08-31T08:43:19.393831+0000 mgr.a (mgr.14388) 16953 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:20 smithi027 bash[22610]: cluster 2024-08-31T08:43:19.393831+0000 mgr.a (mgr.14388) 16953 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:20 smithi191 bash[24992]: cluster 2024-08-31T08:43:19.393831+0000 mgr.a (mgr.14388) 16953 : cluster [DBG] pgmap v11753: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:21.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:43:21.684 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:43:21.684 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:43:22.477 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:43:22.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:43:22.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:43:22.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:43:22.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:43:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:22 smithi163 bash[24253]: cluster 2024-08-31T08:43:21.394583+0000 mgr.a (mgr.14388) 16954 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:22 smithi163 bash[24253]: audit 2024-08-31T08:43:22.027998+0000 mgr.a (mgr.14388) 16955 : audit [DBG] from='client.365820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:22 smithi027 bash[22610]: cluster 2024-08-31T08:43:21.394583+0000 mgr.a (mgr.14388) 16954 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:22.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:22 smithi027 bash[22610]: audit 2024-08-31T08:43:22.027998+0000 mgr.a (mgr.14388) 16955 : audit [DBG] from='client.365820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:22 smithi191 bash[24992]: cluster 2024-08-31T08:43:21.394583+0000 mgr.a (mgr.14388) 16954 : cluster [DBG] pgmap v11754: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:22 smithi191 bash[24992]: audit 2024-08-31T08:43:22.027998+0000 mgr.a (mgr.14388) 16955 : audit [DBG] from='client.365820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:24.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:24 smithi163 bash[24253]: cluster 2024-08-31T08:43:23.396816+0000 mgr.a (mgr.14388) 16956 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:24 smithi027 bash[22610]: cluster 2024-08-31T08:43:23.396816+0000 mgr.a (mgr.14388) 16956 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:24 smithi191 bash[24992]: cluster 2024-08-31T08:43:23.396816+0000 mgr.a (mgr.14388) 16956 : cluster [DBG] pgmap v11755: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:43:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:26 smithi163 bash[24253]: cluster 2024-08-31T08:43:25.397573+0000 mgr.a (mgr.14388) 16957 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:26 smithi027 bash[22610]: cluster 2024-08-31T08:43:25.397573+0000 mgr.a (mgr.14388) 16957 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:26 smithi191 bash[24992]: cluster 2024-08-31T08:43:25.397573+0000 mgr.a (mgr.14388) 16957 : cluster [DBG] pgmap v11756: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:27.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:43:27.479 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:43:27.479 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:43:28.228 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:43:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:43:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:43:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:43:28.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:43:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:28 smithi163 bash[24253]: cluster 2024-08-31T08:43:27.398336+0000 mgr.a (mgr.14388) 16958 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:28 smithi163 bash[24253]: audit 2024-08-31T08:43:27.811887+0000 mgr.a (mgr.14388) 16959 : audit [DBG] from='client.365898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:28 smithi027 bash[22610]: cluster 2024-08-31T08:43:27.398336+0000 mgr.a (mgr.14388) 16958 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:28 smithi027 bash[22610]: audit 2024-08-31T08:43:27.811887+0000 mgr.a (mgr.14388) 16959 : audit [DBG] from='client.365898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:28 smithi191 bash[24992]: cluster 2024-08-31T08:43:27.398336+0000 mgr.a (mgr.14388) 16958 : cluster [DBG] pgmap v11757: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:28 smithi191 bash[24992]: audit 2024-08-31T08:43:27.811887+0000 mgr.a (mgr.14388) 16959 : audit [DBG] from='client.365898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:30.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:30 smithi163 bash[24253]: cluster 2024-08-31T08:43:29.401054+0000 mgr.a (mgr.14388) 16960 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:30 smithi027 bash[22610]: cluster 2024-08-31T08:43:29.401054+0000 mgr.a (mgr.14388) 16960 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:30 smithi191 bash[24992]: cluster 2024-08-31T08:43:29.401054+0000 mgr.a (mgr.14388) 16960 : cluster [DBG] pgmap v11758: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:32 smithi163 bash[24253]: cluster 2024-08-31T08:43:31.401822+0000 mgr.a (mgr.14388) 16961 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:43:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:32 smithi027 bash[22610]: cluster 2024-08-31T08:43:31.401822+0000 mgr.a (mgr.14388) 16961 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:43:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:32 smithi191 bash[24992]: cluster 2024-08-31T08:43:31.401822+0000 mgr.a (mgr.14388) 16961 : cluster [DBG] pgmap v11759: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:43:33.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:43:33.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:43:33.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:43:34.014 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:43:34.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:43:34.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:43:34.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:43:34.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:43:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:34 smithi027 bash[22610]: cluster 2024-08-31T08:43:33.403676+0000 mgr.a (mgr.14388) 16962 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:34 smithi027 bash[22610]: audit 2024-08-31T08:43:33.564036+0000 mgr.a (mgr.14388) 16963 : audit [DBG] from='client.365976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:34 smithi191 bash[24992]: cluster 2024-08-31T08:43:33.403676+0000 mgr.a (mgr.14388) 16962 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:34 smithi191 bash[24992]: audit 2024-08-31T08:43:33.564036+0000 mgr.a (mgr.14388) 16963 : audit [DBG] from='client.365976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:34 smithi163 bash[24253]: cluster 2024-08-31T08:43:33.403676+0000 mgr.a (mgr.14388) 16962 : cluster [DBG] pgmap v11760: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:34 smithi163 bash[24253]: audit 2024-08-31T08:43:33.564036+0000 mgr.a (mgr.14388) 16963 : audit [DBG] from='client.365976 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:36 smithi027 bash[22610]: cluster 2024-08-31T08:43:35.404603+0000 mgr.a (mgr.14388) 16964 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:43:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:36 smithi191 bash[24992]: cluster 2024-08-31T08:43:35.404603+0000 mgr.a (mgr.14388) 16964 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:43:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:36 smithi163 bash[24253]: cluster 2024-08-31T08:43:35.404603+0000 mgr.a (mgr.14388) 16964 : cluster [DBG] pgmap v11761: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:43:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:38 smithi027 bash[22610]: cluster 2024-08-31T08:43:37.405324+0000 mgr.a (mgr.14388) 16965 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:43:39.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:43:39.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:43:39.017 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:43:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:38 smithi191 bash[24992]: cluster 2024-08-31T08:43:37.405324+0000 mgr.a (mgr.14388) 16965 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:43:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:38 smithi163 bash[24253]: cluster 2024-08-31T08:43:37.405324+0000 mgr.a (mgr.14388) 16965 : cluster [DBG] pgmap v11762: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:43:39.777 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:43:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:43:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:43:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:43:39.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:43:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:39 smithi027 bash[22610]: audit 2024-08-31T08:43:39.173617+0000 mon.a (mon.0) 3102 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:43:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:39 smithi191 bash[24992]: audit 2024-08-31T08:43:39.173617+0000 mon.a (mon.0) 3102 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:43:40.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:39 smithi163 bash[24253]: audit 2024-08-31T08:43:39.173617+0000 mon.a (mon.0) 3102 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:43:40.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:43:40 smithi027 bash[22863]: debug 2024-08-31T08:43:40.760+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:43:40.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:43:40 smithi027 bash[22863]: debug 2024-08-31T08:43:40.764+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:43:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:40 smithi027 bash[22610]: audit 2024-08-31T08:43:39.351179+0000 mgr.a (mgr.14388) 16966 : audit [DBG] from='client.366054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:40 smithi027 bash[22610]: cluster 2024-08-31T08:43:39.406954+0000 mgr.a (mgr.14388) 16967 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:40 smithi027 bash[22610]: audit 2024-08-31T08:43:40.001715+0000 mon.a (mon.0) 3103 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:43:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:40 smithi027 bash[22610]: audit 2024-08-31T08:43:40.003457+0000 mon.a (mon.0) 3104 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:43:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:40 smithi027 bash[22610]: audit 2024-08-31T08:43:40.014643+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:43:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:40 smithi027 bash[22610]: audit 2024-08-31T08:43:40.019426+0000 mon.a (mon.0) 3106 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:43:40.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:40 smithi027 bash[22610]: audit 2024-08-31T08:43:40.022177+0000 mgr.a (mgr.14388) 16968 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:43:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:40 smithi191 bash[24992]: audit 2024-08-31T08:43:39.351179+0000 mgr.a (mgr.14388) 16966 : audit [DBG] from='client.366054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:40 smithi191 bash[24992]: cluster 2024-08-31T08:43:39.406954+0000 mgr.a (mgr.14388) 16967 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:40 smithi191 bash[24992]: audit 2024-08-31T08:43:40.001715+0000 mon.a (mon.0) 3103 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:43:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:40 smithi191 bash[24992]: audit 2024-08-31T08:43:40.003457+0000 mon.a (mon.0) 3104 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:43:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:40 smithi191 bash[24992]: audit 2024-08-31T08:43:40.014643+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:43:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:40 smithi191 bash[24992]: audit 2024-08-31T08:43:40.019426+0000 mon.a (mon.0) 3106 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:43:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:40 smithi191 bash[24992]: audit 2024-08-31T08:43:40.022177+0000 mgr.a (mgr.14388) 16968 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:43:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:40 smithi163 bash[24253]: audit 2024-08-31T08:43:39.351179+0000 mgr.a (mgr.14388) 16966 : audit [DBG] from='client.366054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:40 smithi163 bash[24253]: cluster 2024-08-31T08:43:39.406954+0000 mgr.a (mgr.14388) 16967 : cluster [DBG] pgmap v11763: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:40 smithi163 bash[24253]: audit 2024-08-31T08:43:40.001715+0000 mon.a (mon.0) 3103 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:43:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:40 smithi163 bash[24253]: audit 2024-08-31T08:43:40.003457+0000 mon.a (mon.0) 3104 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:43:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:40 smithi163 bash[24253]: audit 2024-08-31T08:43:40.014643+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:43:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:40 smithi163 bash[24253]: audit 2024-08-31T08:43:40.019426+0000 mon.a (mon.0) 3106 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:43:41.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:40 smithi163 bash[24253]: audit 2024-08-31T08:43:40.022177+0000 mgr.a (mgr.14388) 16968 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:43:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:41 smithi027 bash[22610]: audit 2024-08-31T08:43:40.766539+0000 mgr.a (mgr.14388) 16969 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:43:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:41 smithi027 bash[22610]: cephadm 2024-08-31T08:43:40.768258+0000 mgr.a (mgr.14388) 16970 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:43:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:41 smithi191 bash[24992]: audit 2024-08-31T08:43:40.766539+0000 mgr.a (mgr.14388) 16969 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:43:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:41 smithi191 bash[24992]: cephadm 2024-08-31T08:43:40.768258+0000 mgr.a (mgr.14388) 16970 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:43:42.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:41 smithi163 bash[24253]: audit 2024-08-31T08:43:40.766539+0000 mgr.a (mgr.14388) 16969 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:43:42.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:41 smithi163 bash[24253]: cephadm 2024-08-31T08:43:40.768258+0000 mgr.a (mgr.14388) 16970 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:43:42.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:42 smithi027 bash[22610]: cluster 2024-08-31T08:43:41.407976+0000 mgr.a (mgr.14388) 16971 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:42 smithi191 bash[24992]: cluster 2024-08-31T08:43:41.407976+0000 mgr.a (mgr.14388) 16971 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:42 smithi163 bash[24253]: cluster 2024-08-31T08:43:41.407976+0000 mgr.a (mgr.14388) 16971 : cluster [DBG] pgmap v11764: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:44.779 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:43:44.780 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:43:44.780 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:43:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:44 smithi027 bash[22610]: cluster 2024-08-31T08:43:43.410157+0000 mgr.a (mgr.14388) 16972 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:44 smithi191 bash[24992]: cluster 2024-08-31T08:43:43.410157+0000 mgr.a (mgr.14388) 16972 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:44 smithi163 bash[24253]: cluster 2024-08-31T08:43:43.410157+0000 mgr.a (mgr.14388) 16972 : cluster [DBG] pgmap v11765: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:45.516 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:43:45.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:43:45.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:43:45.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:43:45.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:43:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:45 smithi191 bash[24992]: audit 2024-08-31T08:43:45.112059+0000 mgr.a (mgr.14388) 16973 : audit [DBG] from='client.366240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:46.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:45 smithi163 bash[24253]: audit 2024-08-31T08:43:45.112059+0000 mgr.a (mgr.14388) 16973 : audit [DBG] from='client.366240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:45 smithi027 bash[22610]: audit 2024-08-31T08:43:45.112059+0000 mgr.a (mgr.14388) 16973 : audit [DBG] from='client.366240 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:46 smithi191 bash[24992]: cluster 2024-08-31T08:43:45.410635+0000 mgr.a (mgr.14388) 16974 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:46 smithi163 bash[24253]: cluster 2024-08-31T08:43:45.410635+0000 mgr.a (mgr.14388) 16974 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:46 smithi027 bash[22610]: cluster 2024-08-31T08:43:45.410635+0000 mgr.a (mgr.14388) 16974 : cluster [DBG] pgmap v11766: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:48 smithi191 bash[24992]: cluster 2024-08-31T08:43:47.411521+0000 mgr.a (mgr.14388) 16975 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:48 smithi163 bash[24253]: cluster 2024-08-31T08:43:47.411521+0000 mgr.a (mgr.14388) 16975 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:48 smithi027 bash[22610]: cluster 2024-08-31T08:43:47.411521+0000 mgr.a (mgr.14388) 16975 : cluster [DBG] pgmap v11767: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:50.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:43:50.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:43:50.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:43:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:50 smithi191 bash[24992]: cluster 2024-08-31T08:43:49.413881+0000 mgr.a (mgr.14388) 16976 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:50 smithi163 bash[24253]: cluster 2024-08-31T08:43:49.413881+0000 mgr.a (mgr.14388) 16976 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:50 smithi027 bash[22610]: cluster 2024-08-31T08:43:49.413881+0000 mgr.a (mgr.14388) 16976 : cluster [DBG] pgmap v11768: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:51.313 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:43:51.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:43:51.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:43:51.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:43:51.314 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:43:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:51 smithi191 bash[24992]: audit 2024-08-31T08:43:50.857580+0000 mgr.a (mgr.14388) 16977 : audit [DBG] from='client.366315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:52.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:51 smithi163 bash[24253]: audit 2024-08-31T08:43:50.857580+0000 mgr.a (mgr.14388) 16977 : audit [DBG] from='client.366315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:51 smithi027 bash[22610]: audit 2024-08-31T08:43:50.857580+0000 mgr.a (mgr.14388) 16977 : audit [DBG] from='client.366315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:52 smithi191 bash[24992]: cluster 2024-08-31T08:43:51.414915+0000 mgr.a (mgr.14388) 16978 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:52 smithi163 bash[24253]: cluster 2024-08-31T08:43:51.414915+0000 mgr.a (mgr.14388) 16978 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:52 smithi027 bash[22610]: cluster 2024-08-31T08:43:51.414915+0000 mgr.a (mgr.14388) 16978 : cluster [DBG] pgmap v11769: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:54 smithi191 bash[24992]: cluster 2024-08-31T08:43:53.417071+0000 mgr.a (mgr.14388) 16979 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:54 smithi163 bash[24253]: cluster 2024-08-31T08:43:53.417071+0000 mgr.a (mgr.14388) 16979 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:54 smithi027 bash[22610]: cluster 2024-08-31T08:43:53.417071+0000 mgr.a (mgr.14388) 16979 : cluster [DBG] pgmap v11770: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:43:56.315 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:43:56.316 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:43:56.316 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:43:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:56 smithi191 bash[24992]: cluster 2024-08-31T08:43:55.417846+0000 mgr.a (mgr.14388) 16980 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:57.064 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:43:57.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:43:57.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:43:57.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:43:57.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:43:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:56 smithi163 bash[24253]: cluster 2024-08-31T08:43:55.417846+0000 mgr.a (mgr.14388) 16980 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:56 smithi027 bash[22610]: cluster 2024-08-31T08:43:55.417846+0000 mgr.a (mgr.14388) 16980 : cluster [DBG] pgmap v11771: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:57 smithi191 bash[24992]: audit 2024-08-31T08:43:56.643933+0000 mgr.a (mgr.14388) 16981 : audit [DBG] from='client.366390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:58.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:57 smithi163 bash[24253]: audit 2024-08-31T08:43:56.643933+0000 mgr.a (mgr.14388) 16981 : audit [DBG] from='client.366390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:57 smithi027 bash[22610]: audit 2024-08-31T08:43:56.643933+0000 mgr.a (mgr.14388) 16981 : audit [DBG] from='client.366390 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:43:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:43:58 smithi163 bash[24253]: cluster 2024-08-31T08:43:57.418826+0000 mgr.a (mgr.14388) 16982 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:43:58 smithi027 bash[22610]: cluster 2024-08-31T08:43:57.418826+0000 mgr.a (mgr.14388) 16982 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:43:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:43:58 smithi191 bash[24992]: cluster 2024-08-31T08:43:57.418826+0000 mgr.a (mgr.14388) 16982 : cluster [DBG] pgmap v11772: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:00 smithi163 bash[24253]: cluster 2024-08-31T08:43:59.421003+0000 mgr.a (mgr.14388) 16983 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:00 smithi027 bash[22610]: cluster 2024-08-31T08:43:59.421003+0000 mgr.a (mgr.14388) 16983 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:00 smithi191 bash[24992]: cluster 2024-08-31T08:43:59.421003+0000 mgr.a (mgr.14388) 16983 : cluster [DBG] pgmap v11773: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:02.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:02.066 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:44:02.836 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:44:02.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:44:02.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:44:02.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:44:02.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:44:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:02 smithi163 bash[24253]: cluster 2024-08-31T08:44:01.421755+0000 mgr.a (mgr.14388) 16984 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:02 smithi027 bash[22610]: cluster 2024-08-31T08:44:01.421755+0000 mgr.a (mgr.14388) 16984 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:02 smithi191 bash[24992]: cluster 2024-08-31T08:44:01.421755+0000 mgr.a (mgr.14388) 16984 : cluster [DBG] pgmap v11774: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:04.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:03 smithi163 bash[24253]: audit 2024-08-31T08:44:02.396372+0000 mgr.a (mgr.14388) 16985 : audit [DBG] from='client.366468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:03 smithi027 bash[22610]: audit 2024-08-31T08:44:02.396372+0000 mgr.a (mgr.14388) 16985 : audit [DBG] from='client.366468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:03 smithi191 bash[24992]: audit 2024-08-31T08:44:02.396372+0000 mgr.a (mgr.14388) 16985 : audit [DBG] from='client.366468 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:04 smithi163 bash[24253]: cluster 2024-08-31T08:44:03.424278+0000 mgr.a (mgr.14388) 16986 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:04 smithi027 bash[22610]: cluster 2024-08-31T08:44:03.424278+0000 mgr.a (mgr.14388) 16986 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:04 smithi191 bash[24992]: cluster 2024-08-31T08:44:03.424278+0000 mgr.a (mgr.14388) 16986 : cluster [DBG] pgmap v11775: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:06 smithi163 bash[24253]: cluster 2024-08-31T08:44:05.425238+0000 mgr.a (mgr.14388) 16987 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:06 smithi027 bash[22610]: cluster 2024-08-31T08:44:05.425238+0000 mgr.a (mgr.14388) 16987 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:06 smithi191 bash[24992]: cluster 2024-08-31T08:44:05.425238+0000 mgr.a (mgr.14388) 16987 : cluster [DBG] pgmap v11776: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:07.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:07.838 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:07.838 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:44:08.629 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:44:08.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:44:08.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:44:08.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:44:08.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:44:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:08 smithi163 bash[24253]: cluster 2024-08-31T08:44:07.426183+0000 mgr.a (mgr.14388) 16988 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:08 smithi163 bash[24253]: audit 2024-08-31T08:44:08.173925+0000 mgr.a (mgr.14388) 16989 : audit [DBG] from='client.366543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:08 smithi027 bash[22610]: cluster 2024-08-31T08:44:07.426183+0000 mgr.a (mgr.14388) 16988 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:08 smithi027 bash[22610]: audit 2024-08-31T08:44:08.173925+0000 mgr.a (mgr.14388) 16989 : audit [DBG] from='client.366543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:08 smithi191 bash[24992]: cluster 2024-08-31T08:44:07.426183+0000 mgr.a (mgr.14388) 16988 : cluster [DBG] pgmap v11777: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:08 smithi191 bash[24992]: audit 2024-08-31T08:44:08.173925+0000 mgr.a (mgr.14388) 16989 : audit [DBG] from='client.366543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:10 smithi163 bash[24253]: cluster 2024-08-31T08:44:09.429064+0000 mgr.a (mgr.14388) 16990 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:10 smithi027 bash[22610]: cluster 2024-08-31T08:44:09.429064+0000 mgr.a (mgr.14388) 16990 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:10 smithi191 bash[24992]: cluster 2024-08-31T08:44:09.429064+0000 mgr.a (mgr.14388) 16990 : cluster [DBG] pgmap v11778: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:12 smithi163 bash[24253]: cluster 2024-08-31T08:44:11.429870+0000 mgr.a (mgr.14388) 16991 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:12 smithi027 bash[22610]: cluster 2024-08-31T08:44:11.429870+0000 mgr.a (mgr.14388) 16991 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:12 smithi191 bash[24992]: cluster 2024-08-31T08:44:11.429870+0000 mgr.a (mgr.14388) 16991 : cluster [DBG] pgmap v11779: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:13.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:13.632 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:13.632 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:44:14.429 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:44:14.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:44:14.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:44:14.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:44:14.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:44:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:14 smithi163 bash[24253]: cluster 2024-08-31T08:44:13.431846+0000 mgr.a (mgr.14388) 16992 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:14 smithi163 bash[24253]: audit 2024-08-31T08:44:13.971771+0000 mgr.a (mgr.14388) 16993 : audit [DBG] from='client.366621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:14 smithi027 bash[22610]: cluster 2024-08-31T08:44:13.431846+0000 mgr.a (mgr.14388) 16992 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:15.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:14 smithi027 bash[22610]: audit 2024-08-31T08:44:13.971771+0000 mgr.a (mgr.14388) 16993 : audit [DBG] from='client.366621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:14 smithi191 bash[24992]: cluster 2024-08-31T08:44:13.431846+0000 mgr.a (mgr.14388) 16992 : cluster [DBG] pgmap v11780: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:14 smithi191 bash[24992]: audit 2024-08-31T08:44:13.971771+0000 mgr.a (mgr.14388) 16993 : audit [DBG] from='client.366621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:16 smithi163 bash[24253]: cluster 2024-08-31T08:44:15.432783+0000 mgr.a (mgr.14388) 16994 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:16 smithi027 bash[22610]: cluster 2024-08-31T08:44:15.432783+0000 mgr.a (mgr.14388) 16994 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:16 smithi191 bash[24992]: cluster 2024-08-31T08:44:15.432783+0000 mgr.a (mgr.14388) 16994 : cluster [DBG] pgmap v11781: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:18 smithi163 bash[24253]: cluster 2024-08-31T08:44:17.433601+0000 mgr.a (mgr.14388) 16995 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:44:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:18 smithi027 bash[22610]: cluster 2024-08-31T08:44:17.433601+0000 mgr.a (mgr.14388) 16995 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:44:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:18 smithi191 bash[24992]: cluster 2024-08-31T08:44:17.433601+0000 mgr.a (mgr.14388) 16995 : cluster [DBG] pgmap v11782: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:44:19.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:19.432 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:19.432 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:44:20.204 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:44:20.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:44:20.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:44:20.204 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:44:20.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:44:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:20 smithi163 bash[24253]: cluster 2024-08-31T08:44:19.436026+0000 mgr.a (mgr.14388) 16996 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:20 smithi163 bash[24253]: audit 2024-08-31T08:44:19.768317+0000 mgr.a (mgr.14388) 16997 : audit [DBG] from='client.366693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:20 smithi027 bash[22610]: cluster 2024-08-31T08:44:19.436026+0000 mgr.a (mgr.14388) 16996 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:20 smithi027 bash[22610]: audit 2024-08-31T08:44:19.768317+0000 mgr.a (mgr.14388) 16997 : audit [DBG] from='client.366693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:20 smithi191 bash[24992]: cluster 2024-08-31T08:44:19.436026+0000 mgr.a (mgr.14388) 16996 : cluster [DBG] pgmap v11783: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:20 smithi191 bash[24992]: audit 2024-08-31T08:44:19.768317+0000 mgr.a (mgr.14388) 16997 : audit [DBG] from='client.366693 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:22 smithi163 bash[24253]: cluster 2024-08-31T08:44:21.436978+0000 mgr.a (mgr.14388) 16998 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:22 smithi027 bash[22610]: cluster 2024-08-31T08:44:21.436978+0000 mgr.a (mgr.14388) 16998 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:22 smithi191 bash[24992]: cluster 2024-08-31T08:44:21.436978+0000 mgr.a (mgr.14388) 16998 : cluster [DBG] pgmap v11784: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:24 smithi163 bash[24253]: cluster 2024-08-31T08:44:23.439182+0000 mgr.a (mgr.14388) 16999 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:25.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:25.206 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:25.207 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:44:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:24 smithi027 bash[22610]: cluster 2024-08-31T08:44:23.439182+0000 mgr.a (mgr.14388) 16999 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:24 smithi191 bash[24992]: cluster 2024-08-31T08:44:23.439182+0000 mgr.a (mgr.14388) 16999 : cluster [DBG] pgmap v11785: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:25.978 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:44:25.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:44:25.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:44:25.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:44:25.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:44:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:26 smithi163 bash[24253]: cluster 2024-08-31T08:44:25.439892+0000 mgr.a (mgr.14388) 17000 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:26 smithi163 bash[24253]: audit 2024-08-31T08:44:25.542473+0000 mgr.a (mgr.14388) 17001 : audit [DBG] from='client.366768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:26 smithi027 bash[22610]: cluster 2024-08-31T08:44:25.439892+0000 mgr.a (mgr.14388) 17000 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:26 smithi027 bash[22610]: audit 2024-08-31T08:44:25.542473+0000 mgr.a (mgr.14388) 17001 : audit [DBG] from='client.366768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:26 smithi191 bash[24992]: cluster 2024-08-31T08:44:25.439892+0000 mgr.a (mgr.14388) 17000 : cluster [DBG] pgmap v11786: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:26 smithi191 bash[24992]: audit 2024-08-31T08:44:25.542473+0000 mgr.a (mgr.14388) 17001 : audit [DBG] from='client.366768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:28 smithi163 bash[24253]: cluster 2024-08-31T08:44:27.440813+0000 mgr.a (mgr.14388) 17002 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:28 smithi027 bash[22610]: cluster 2024-08-31T08:44:27.440813+0000 mgr.a (mgr.14388) 17002 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:28 smithi191 bash[24992]: cluster 2024-08-31T08:44:27.440813+0000 mgr.a (mgr.14388) 17002 : cluster [DBG] pgmap v11787: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:30.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:30.980 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:30.980 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:44:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:30 smithi163 bash[24253]: cluster 2024-08-31T08:44:29.443071+0000 mgr.a (mgr.14388) 17003 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:30 smithi027 bash[22610]: cluster 2024-08-31T08:44:29.443071+0000 mgr.a (mgr.14388) 17003 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:30 smithi191 bash[24992]: cluster 2024-08-31T08:44:29.443071+0000 mgr.a (mgr.14388) 17003 : cluster [DBG] pgmap v11788: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:31.730 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:44:31.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:44:31.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:44:31.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:44:31.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:44:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:32 smithi163 bash[24253]: audit 2024-08-31T08:44:31.310280+0000 mgr.a (mgr.14388) 17004 : audit [DBG] from='client.366843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:32 smithi163 bash[24253]: cluster 2024-08-31T08:44:31.446855+0000 mgr.a (mgr.14388) 17005 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:32 smithi027 bash[22610]: audit 2024-08-31T08:44:31.310280+0000 mgr.a (mgr.14388) 17004 : audit [DBG] from='client.366843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:33.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:32 smithi027 bash[22610]: cluster 2024-08-31T08:44:31.446855+0000 mgr.a (mgr.14388) 17005 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:32 smithi191 bash[24992]: audit 2024-08-31T08:44:31.310280+0000 mgr.a (mgr.14388) 17004 : audit [DBG] from='client.366843 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:32 smithi191 bash[24992]: cluster 2024-08-31T08:44:31.446855+0000 mgr.a (mgr.14388) 17005 : cluster [DBG] pgmap v11789: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:34 smithi163 bash[24253]: cluster 2024-08-31T08:44:33.449210+0000 mgr.a (mgr.14388) 17006 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:34 smithi027 bash[22610]: cluster 2024-08-31T08:44:33.449210+0000 mgr.a (mgr.14388) 17006 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:34 smithi191 bash[24992]: cluster 2024-08-31T08:44:33.449210+0000 mgr.a (mgr.14388) 17006 : cluster [DBG] pgmap v11790: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:36.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:36.733 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:36.733 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:44:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:36 smithi163 bash[24253]: cluster 2024-08-31T08:44:35.450000+0000 mgr.a (mgr.14388) 17007 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:36 smithi027 bash[22610]: cluster 2024-08-31T08:44:35.450000+0000 mgr.a (mgr.14388) 17007 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:36 smithi191 bash[24992]: cluster 2024-08-31T08:44:35.450000+0000 mgr.a (mgr.14388) 17007 : cluster [DBG] pgmap v11791: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:37.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:44:37.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:44:37.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:44:37.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:44:37.507 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:44:38.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:37 smithi163 bash[24253]: audit 2024-08-31T08:44:37.067200+0000 mgr.a (mgr.14388) 17008 : audit [DBG] from='client.366921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:37 smithi027 bash[22610]: audit 2024-08-31T08:44:37.067200+0000 mgr.a (mgr.14388) 17008 : audit [DBG] from='client.366921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:37 smithi191 bash[24992]: audit 2024-08-31T08:44:37.067200+0000 mgr.a (mgr.14388) 17008 : audit [DBG] from='client.366921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:38 smithi163 bash[24253]: cluster 2024-08-31T08:44:37.450511+0000 mgr.a (mgr.14388) 17009 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:38 smithi027 bash[22610]: cluster 2024-08-31T08:44:37.450511+0000 mgr.a (mgr.14388) 17009 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:38 smithi191 bash[24992]: cluster 2024-08-31T08:44:37.450511+0000 mgr.a (mgr.14388) 17009 : cluster [DBG] pgmap v11792: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:40 smithi163 bash[24253]: cluster 2024-08-31T08:44:39.452754+0000 mgr.a (mgr.14388) 17010 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:41.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:40 smithi163 bash[24253]: audit 2024-08-31T08:44:40.828129+0000 mon.a (mon.0) 3107 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:44:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:40 smithi027 bash[22610]: cluster 2024-08-31T08:44:39.452754+0000 mgr.a (mgr.14388) 17010 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:40 smithi027 bash[22610]: audit 2024-08-31T08:44:40.828129+0000 mon.a (mon.0) 3107 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:44:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:40 smithi191 bash[24992]: cluster 2024-08-31T08:44:39.452754+0000 mgr.a (mgr.14388) 17010 : cluster [DBG] pgmap v11793: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:44:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:40 smithi191 bash[24992]: audit 2024-08-31T08:44:40.828129+0000 mon.a (mon.0) 3107 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:44:42.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:42.508 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:42.508 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:44:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:42 smithi163 bash[24253]: audit 2024-08-31T08:44:41.447616+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:42 smithi163 bash[24253]: cluster 2024-08-31T08:44:41.453151+0000 mgr.a (mgr.14388) 17011 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:42 smithi163 bash[24253]: audit 2024-08-31T08:44:41.455131+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:42 smithi027 bash[22610]: audit 2024-08-31T08:44:41.447616+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:42 smithi027 bash[22610]: cluster 2024-08-31T08:44:41.453151+0000 mgr.a (mgr.14388) 17011 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:42 smithi027 bash[22610]: audit 2024-08-31T08:44:41.455131+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:42 smithi191 bash[24992]: audit 2024-08-31T08:44:41.447616+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:42 smithi191 bash[24992]: cluster 2024-08-31T08:44:41.453151+0000 mgr.a (mgr.14388) 17011 : cluster [DBG] pgmap v11794: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:42 smithi191 bash[24992]: audit 2024-08-31T08:44:41.455131+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:43.248 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:44:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:44:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:44:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:44:43.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:44:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:43 smithi027 bash[22610]: audit 2024-08-31T08:44:42.832905+0000 mgr.a (mgr.14388) 17012 : audit [DBG] from='client.366999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:43 smithi191 bash[24992]: audit 2024-08-31T08:44:42.832905+0000 mgr.a (mgr.14388) 17012 : audit [DBG] from='client.366999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:43 smithi163 bash[24253]: audit 2024-08-31T08:44:42.832905+0000 mgr.a (mgr.14388) 17012 : audit [DBG] from='client.366999 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:44 smithi191 bash[24992]: cluster 2024-08-31T08:44:43.456120+0000 mgr.a (mgr.14388) 17013 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:44 smithi163 bash[24253]: cluster 2024-08-31T08:44:43.456120+0000 mgr.a (mgr.14388) 17013 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:44 smithi027 bash[22610]: cluster 2024-08-31T08:44:43.456120+0000 mgr.a (mgr.14388) 17013 : cluster [DBG] pgmap v11795: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:46 smithi191 bash[24992]: cluster 2024-08-31T08:44:45.456934+0000 mgr.a (mgr.14388) 17014 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:46 smithi163 bash[24253]: cluster 2024-08-31T08:44:45.456934+0000 mgr.a (mgr.14388) 17014 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:46 smithi027 bash[22610]: cluster 2024-08-31T08:44:45.456934+0000 mgr.a (mgr.14388) 17014 : cluster [DBG] pgmap v11796: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:48.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:48.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:48.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:44:48.717 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:48 smithi027 bash[22610]: cluster 2024-08-31T08:44:47.457723+0000 mgr.a (mgr.14388) 17015 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:44:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:48 smithi191 bash[24992]: cluster 2024-08-31T08:44:47.457723+0000 mgr.a (mgr.14388) 17015 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:44:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:48 smithi163 bash[24253]: cluster 2024-08-31T08:44:47.457723+0000 mgr.a (mgr.14388) 17015 : cluster [DBG] pgmap v11797: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:44:49.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:44:49.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:44:49.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:44:49.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:44:49.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:44:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:49 smithi027 bash[22610]: audit 2024-08-31T08:44:48.590793+0000 mgr.a (mgr.14388) 17016 : audit [DBG] from='client.367074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:49 smithi191 bash[24992]: audit 2024-08-31T08:44:48.590793+0000 mgr.a (mgr.14388) 17016 : audit [DBG] from='client.367074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:49.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:49 smithi163 bash[24253]: audit 2024-08-31T08:44:48.590793+0000 mgr.a (mgr.14388) 17016 : audit [DBG] from='client.367074 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:50 smithi191 bash[24992]: cluster 2024-08-31T08:44:49.460644+0000 mgr.a (mgr.14388) 17017 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:50 smithi163 bash[24253]: cluster 2024-08-31T08:44:49.460644+0000 mgr.a (mgr.14388) 17017 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:50 smithi027 bash[22610]: cluster 2024-08-31T08:44:49.460644+0000 mgr.a (mgr.14388) 17017 : cluster [DBG] pgmap v11798: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:44:53.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:44:53 smithi027 bash[22863]: debug 2024-08-31T08:44:53.019+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:44:53.486 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:44:53 smithi027 bash[22863]: debug 2024-08-31T08:44:53.019+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:44:53.486 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:53 smithi027 bash[22610]: cluster 2024-08-31T08:44:51.461464+0000 mgr.a (mgr.14388) 17018 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:53.486 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:53 smithi027 bash[22610]: audit 2024-08-31T08:44:52.208696+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:53.486 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:53 smithi027 bash[22610]: audit 2024-08-31T08:44:52.217721+0000 mon.a (mon.0) 3111 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:53.487 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:53 smithi027 bash[22610]: audit 2024-08-31T08:44:52.219966+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:44:53.487 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:53 smithi027 bash[22610]: audit 2024-08-31T08:44:52.221809+0000 mon.a (mon.0) 3113 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:44:53.487 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:53 smithi027 bash[22610]: audit 2024-08-31T08:44:52.232457+0000 mon.a (mon.0) 3114 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:53.487 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:53 smithi027 bash[22610]: audit 2024-08-31T08:44:52.237649+0000 mon.a (mon.0) 3115 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:44:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:53 smithi191 bash[24992]: cluster 2024-08-31T08:44:51.461464+0000 mgr.a (mgr.14388) 17018 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:53 smithi191 bash[24992]: audit 2024-08-31T08:44:52.208696+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:53 smithi191 bash[24992]: audit 2024-08-31T08:44:52.217721+0000 mon.a (mon.0) 3111 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:53 smithi191 bash[24992]: audit 2024-08-31T08:44:52.219966+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:44:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:53 smithi191 bash[24992]: audit 2024-08-31T08:44:52.221809+0000 mon.a (mon.0) 3113 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:44:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:53 smithi191 bash[24992]: audit 2024-08-31T08:44:52.232457+0000 mon.a (mon.0) 3114 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:53 smithi191 bash[24992]: audit 2024-08-31T08:44:52.237649+0000 mon.a (mon.0) 3115 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:44:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:53 smithi163 bash[24253]: cluster 2024-08-31T08:44:51.461464+0000 mgr.a (mgr.14388) 17018 : cluster [DBG] pgmap v11799: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:44:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:53 smithi163 bash[24253]: audit 2024-08-31T08:44:52.208696+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:53 smithi163 bash[24253]: audit 2024-08-31T08:44:52.217721+0000 mon.a (mon.0) 3111 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:53 smithi163 bash[24253]: audit 2024-08-31T08:44:52.219966+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:44:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:53 smithi163 bash[24253]: audit 2024-08-31T08:44:52.221809+0000 mon.a (mon.0) 3113 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:44:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:53 smithi163 bash[24253]: audit 2024-08-31T08:44:52.232457+0000 mon.a (mon.0) 3114 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:44:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:53 smithi163 bash[24253]: audit 2024-08-31T08:44:52.237649+0000 mon.a (mon.0) 3115 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:44:54.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:54.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:54.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:44:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:54 smithi027 bash[22610]: audit 2024-08-31T08:44:52.239672+0000 mgr.a (mgr.14388) 17019 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:44:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:54 smithi027 bash[22610]: audit 2024-08-31T08:44:53.024226+0000 mgr.a (mgr.14388) 17020 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:44:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:54 smithi027 bash[22610]: cephadm 2024-08-31T08:44:53.026251+0000 mgr.a (mgr.14388) 17021 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:44:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:54 smithi191 bash[24992]: audit 2024-08-31T08:44:52.239672+0000 mgr.a (mgr.14388) 17019 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:44:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:54 smithi191 bash[24992]: audit 2024-08-31T08:44:53.024226+0000 mgr.a (mgr.14388) 17020 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:44:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:54 smithi191 bash[24992]: cephadm 2024-08-31T08:44:53.026251+0000 mgr.a (mgr.14388) 17021 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:44:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:54 smithi163 bash[24253]: audit 2024-08-31T08:44:52.239672+0000 mgr.a (mgr.14388) 17019 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:44:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:54 smithi163 bash[24253]: audit 2024-08-31T08:44:53.024226+0000 mgr.a (mgr.14388) 17020 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:44:54.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:54 smithi163 bash[24253]: cephadm 2024-08-31T08:44:53.026251+0000 mgr.a (mgr.14388) 17021 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:44:54.769 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:44:54.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:44:54.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:44:54.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:44:54.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:44:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:55 smithi027 bash[22610]: cluster 2024-08-31T08:44:53.463846+0000 mgr.a (mgr.14388) 17022 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:44:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:55 smithi191 bash[24992]: cluster 2024-08-31T08:44:53.463846+0000 mgr.a (mgr.14388) 17022 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:44:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:55 smithi163 bash[24253]: cluster 2024-08-31T08:44:53.463846+0000 mgr.a (mgr.14388) 17022 : cluster [DBG] pgmap v11800: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:44:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:56 smithi027 bash[22610]: audit 2024-08-31T08:44:54.352461+0000 mgr.a (mgr.14388) 17023 : audit [DBG] from='client.367257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:56 smithi191 bash[24992]: audit 2024-08-31T08:44:54.352461+0000 mgr.a (mgr.14388) 17023 : audit [DBG] from='client.367257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:56 smithi163 bash[24253]: audit 2024-08-31T08:44:54.352461+0000 mgr.a (mgr.14388) 17023 : audit [DBG] from='client.367257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:44:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:57 smithi027 bash[22610]: cluster 2024-08-31T08:44:55.464830+0000 mgr.a (mgr.14388) 17024 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:44:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:57 smithi191 bash[24992]: cluster 2024-08-31T08:44:55.464830+0000 mgr.a (mgr.14388) 17024 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:44:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:57 smithi163 bash[24253]: cluster 2024-08-31T08:44:55.464830+0000 mgr.a (mgr.14388) 17024 : cluster [DBG] pgmap v11801: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:44:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:44:58 smithi191 bash[24992]: cluster 2024-08-31T08:44:57.465643+0000 mgr.a (mgr.14388) 17025 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:44:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:44:58 smithi163 bash[24253]: cluster 2024-08-31T08:44:57.465643+0000 mgr.a (mgr.14388) 17025 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:44:58.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:44:58 smithi027 bash[22610]: cluster 2024-08-31T08:44:57.465643+0000 mgr.a (mgr.14388) 17025 : cluster [DBG] pgmap v11802: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:44:59.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:44:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:44:59.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:00.554 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:00.555 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:00 smithi191 bash[24992]: cluster 2024-08-31T08:44:59.467863+0000 mgr.a (mgr.14388) 17026 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:45:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:00 smithi191 bash[24992]: audit 2024-08-31T08:45:00.111281+0000 mgr.a (mgr.14388) 17027 : audit [DBG] from='client.367332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:00 smithi163 bash[24253]: cluster 2024-08-31T08:44:59.467863+0000 mgr.a (mgr.14388) 17026 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:45:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:00 smithi163 bash[24253]: audit 2024-08-31T08:45:00.111281+0000 mgr.a (mgr.14388) 17027 : audit [DBG] from='client.367332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:00 smithi027 bash[22610]: cluster 2024-08-31T08:44:59.467863+0000 mgr.a (mgr.14388) 17026 : cluster [DBG] pgmap v11803: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:45:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:00 smithi027 bash[22610]: audit 2024-08-31T08:45:00.111281+0000 mgr.a (mgr.14388) 17027 : audit [DBG] from='client.367332 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:02 smithi191 bash[24992]: cluster 2024-08-31T08:45:01.468817+0000 mgr.a (mgr.14388) 17028 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:45:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:02 smithi163 bash[24253]: cluster 2024-08-31T08:45:01.468817+0000 mgr.a (mgr.14388) 17028 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:45:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:02 smithi027 bash[22610]: cluster 2024-08-31T08:45:01.468817+0000 mgr.a (mgr.14388) 17028 : cluster [DBG] pgmap v11804: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:45:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:04 smithi191 bash[24992]: cluster 2024-08-31T08:45:03.470985+0000 mgr.a (mgr.14388) 17029 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:45:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:04 smithi163 bash[24253]: cluster 2024-08-31T08:45:03.470985+0000 mgr.a (mgr.14388) 17029 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:45:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:04 smithi027 bash[22610]: cluster 2024-08-31T08:45:03.470985+0000 mgr.a (mgr.14388) 17029 : cluster [DBG] pgmap v11805: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:45:05.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:45:05.557 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:45:05.557 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:06.333 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:06.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:06.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:06.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:06.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:06 smithi191 bash[24992]: cluster 2024-08-31T08:45:05.471698+0000 mgr.a (mgr.14388) 17030 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:45:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:06 smithi191 bash[24992]: audit 2024-08-31T08:45:05.895330+0000 mgr.a (mgr.14388) 17031 : audit [DBG] from='client.367407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:06 smithi163 bash[24253]: cluster 2024-08-31T08:45:05.471698+0000 mgr.a (mgr.14388) 17030 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:45:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:06 smithi163 bash[24253]: audit 2024-08-31T08:45:05.895330+0000 mgr.a (mgr.14388) 17031 : audit [DBG] from='client.367407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:06 smithi027 bash[22610]: cluster 2024-08-31T08:45:05.471698+0000 mgr.a (mgr.14388) 17030 : cluster [DBG] pgmap v11806: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:45:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:06 smithi027 bash[22610]: audit 2024-08-31T08:45:05.895330+0000 mgr.a (mgr.14388) 17031 : audit [DBG] from='client.367407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:08 smithi163 bash[24253]: cluster 2024-08-31T08:45:07.472616+0000 mgr.a (mgr.14388) 17032 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:45:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:08 smithi027 bash[22610]: cluster 2024-08-31T08:45:07.472616+0000 mgr.a (mgr.14388) 17032 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:45:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:08 smithi191 bash[24992]: cluster 2024-08-31T08:45:07.472616+0000 mgr.a (mgr.14388) 17032 : cluster [DBG] pgmap v11807: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:45:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:10 smithi163 bash[24253]: cluster 2024-08-31T08:45:09.474996+0000 mgr.a (mgr.14388) 17033 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T08:45:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:10 smithi027 bash[22610]: cluster 2024-08-31T08:45:09.474996+0000 mgr.a (mgr.14388) 17033 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T08:45:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:10 smithi191 bash[24992]: cluster 2024-08-31T08:45:09.474996+0000 mgr.a (mgr.14388) 17033 : cluster [DBG] pgmap v11808: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T08:45:11.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:45:11.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:45:11.336 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:12.079 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:12.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:12.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:12.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:12.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:12 smithi163 bash[24253]: cluster 2024-08-31T08:45:11.475578+0000 mgr.a (mgr.14388) 17034 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:12 smithi163 bash[24253]: audit 2024-08-31T08:45:11.665203+0000 mgr.a (mgr.14388) 17035 : audit [DBG] from='client.367482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:12 smithi027 bash[22610]: cluster 2024-08-31T08:45:11.475578+0000 mgr.a (mgr.14388) 17034 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:12 smithi027 bash[22610]: audit 2024-08-31T08:45:11.665203+0000 mgr.a (mgr.14388) 17035 : audit [DBG] from='client.367482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:12 smithi191 bash[24992]: cluster 2024-08-31T08:45:11.475578+0000 mgr.a (mgr.14388) 17034 : cluster [DBG] pgmap v11809: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:12 smithi191 bash[24992]: audit 2024-08-31T08:45:11.665203+0000 mgr.a (mgr.14388) 17035 : audit [DBG] from='client.367482 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:14 smithi163 bash[24253]: cluster 2024-08-31T08:45:13.477768+0000 mgr.a (mgr.14388) 17036 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:14 smithi027 bash[22610]: cluster 2024-08-31T08:45:13.477768+0000 mgr.a (mgr.14388) 17036 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:14 smithi191 bash[24992]: cluster 2024-08-31T08:45:13.477768+0000 mgr.a (mgr.14388) 17036 : cluster [DBG] pgmap v11810: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:16 smithi163 bash[24253]: cluster 2024-08-31T08:45:15.478554+0000 mgr.a (mgr.14388) 17037 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:16 smithi027 bash[22610]: cluster 2024-08-31T08:45:15.478554+0000 mgr.a (mgr.14388) 17037 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:16 smithi191 bash[24992]: cluster 2024-08-31T08:45:15.478554+0000 mgr.a (mgr.14388) 17037 : cluster [DBG] pgmap v11811: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:17.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:45:17.081 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:45:17.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:17.835 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:17.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:17.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:17.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:17.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:18 smithi163 bash[24253]: audit 2024-08-31T08:45:17.409424+0000 mgr.a (mgr.14388) 17038 : audit [DBG] from='client.367557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:18 smithi163 bash[24253]: cluster 2024-08-31T08:45:17.479168+0000 mgr.a (mgr.14388) 17039 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:18 smithi027 bash[22610]: audit 2024-08-31T08:45:17.409424+0000 mgr.a (mgr.14388) 17038 : audit [DBG] from='client.367557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:18 smithi027 bash[22610]: cluster 2024-08-31T08:45:17.479168+0000 mgr.a (mgr.14388) 17039 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:18 smithi191 bash[24992]: audit 2024-08-31T08:45:17.409424+0000 mgr.a (mgr.14388) 17038 : audit [DBG] from='client.367557 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:18 smithi191 bash[24992]: cluster 2024-08-31T08:45:17.479168+0000 mgr.a (mgr.14388) 17039 : cluster [DBG] pgmap v11812: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:20 smithi163 bash[24253]: cluster 2024-08-31T08:45:19.481400+0000 mgr.a (mgr.14388) 17040 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:20 smithi027 bash[22610]: cluster 2024-08-31T08:45:19.481400+0000 mgr.a (mgr.14388) 17040 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:20 smithi191 bash[24992]: cluster 2024-08-31T08:45:19.481400+0000 mgr.a (mgr.14388) 17040 : cluster [DBG] pgmap v11813: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:22.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:45:22.837 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:45:22.837 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:22 smithi163 bash[24253]: cluster 2024-08-31T08:45:21.482194+0000 mgr.a (mgr.14388) 17041 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:22 smithi027 bash[22610]: cluster 2024-08-31T08:45:21.482194+0000 mgr.a (mgr.14388) 17041 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:22 smithi191 bash[24992]: cluster 2024-08-31T08:45:21.482194+0000 mgr.a (mgr.14388) 17041 : cluster [DBG] pgmap v11814: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:23.592 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:23.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:23.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:23.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:23.592 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:23 smithi163 bash[24253]: audit 2024-08-31T08:45:23.165079+0000 mgr.a (mgr.14388) 17042 : audit [DBG] from='client.367635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:23 smithi027 bash[22610]: audit 2024-08-31T08:45:23.165079+0000 mgr.a (mgr.14388) 17042 : audit [DBG] from='client.367635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:23 smithi191 bash[24992]: audit 2024-08-31T08:45:23.165079+0000 mgr.a (mgr.14388) 17042 : audit [DBG] from='client.367635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:24 smithi163 bash[24253]: cluster 2024-08-31T08:45:23.492542+0000 mgr.a (mgr.14388) 17043 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:24 smithi027 bash[22610]: cluster 2024-08-31T08:45:23.492542+0000 mgr.a (mgr.14388) 17043 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:24 smithi191 bash[24992]: cluster 2024-08-31T08:45:23.492542+0000 mgr.a (mgr.14388) 17043 : cluster [DBG] pgmap v11815: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:26 smithi163 bash[24253]: cluster 2024-08-31T08:45:25.493448+0000 mgr.a (mgr.14388) 17044 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:45:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:26 smithi027 bash[22610]: cluster 2024-08-31T08:45:25.493448+0000 mgr.a (mgr.14388) 17044 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:45:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:26 smithi191 bash[24992]: cluster 2024-08-31T08:45:25.493448+0000 mgr.a (mgr.14388) 17044 : cluster [DBG] pgmap v11816: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:45:28.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:45:28.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:45:28.594 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:28 smithi163 bash[24253]: cluster 2024-08-31T08:45:27.494404+0000 mgr.a (mgr.14388) 17045 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:45:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:28 smithi027 bash[22610]: cluster 2024-08-31T08:45:27.494404+0000 mgr.a (mgr.14388) 17045 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:45:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:28 smithi191 bash[24992]: cluster 2024-08-31T08:45:27.494404+0000 mgr.a (mgr.14388) 17045 : cluster [DBG] pgmap v11817: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:45:29.349 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:29.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:29.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:29.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:29.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:29.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:29 smithi163 bash[24253]: audit 2024-08-31T08:45:28.929977+0000 mgr.a (mgr.14388) 17046 : audit [DBG] from='client.367713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:29 smithi027 bash[22610]: audit 2024-08-31T08:45:28.929977+0000 mgr.a (mgr.14388) 17046 : audit [DBG] from='client.367713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:29 smithi191 bash[24992]: audit 2024-08-31T08:45:28.929977+0000 mgr.a (mgr.14388) 17046 : audit [DBG] from='client.367713 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:30 smithi163 bash[24253]: cluster 2024-08-31T08:45:29.497311+0000 mgr.a (mgr.14388) 17047 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:30 smithi027 bash[22610]: cluster 2024-08-31T08:45:29.497311+0000 mgr.a (mgr.14388) 17047 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:30 smithi191 bash[24992]: cluster 2024-08-31T08:45:29.497311+0000 mgr.a (mgr.14388) 17047 : cluster [DBG] pgmap v11818: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:32 smithi163 bash[24253]: cluster 2024-08-31T08:45:31.498283+0000 mgr.a (mgr.14388) 17048 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:45:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:32 smithi027 bash[22610]: cluster 2024-08-31T08:45:31.498283+0000 mgr.a (mgr.14388) 17048 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:45:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:32 smithi191 bash[24992]: cluster 2024-08-31T08:45:31.498283+0000 mgr.a (mgr.14388) 17048 : cluster [DBG] pgmap v11819: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:45:34.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:45:34.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:45:34.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:34 smithi163 bash[24253]: cluster 2024-08-31T08:45:33.500376+0000 mgr.a (mgr.14388) 17049 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:34 smithi027 bash[22610]: cluster 2024-08-31T08:45:33.500376+0000 mgr.a (mgr.14388) 17049 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:34 smithi191 bash[24992]: cluster 2024-08-31T08:45:33.500376+0000 mgr.a (mgr.14388) 17049 : cluster [DBG] pgmap v11820: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:35.112 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:35.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:35.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:35.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:35.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:35 smithi163 bash[24253]: audit 2024-08-31T08:45:34.682070+0000 mgr.a (mgr.14388) 17050 : audit [DBG] from='client.367785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:35 smithi027 bash[22610]: audit 2024-08-31T08:45:34.682070+0000 mgr.a (mgr.14388) 17050 : audit [DBG] from='client.367785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:35 smithi191 bash[24992]: audit 2024-08-31T08:45:34.682070+0000 mgr.a (mgr.14388) 17050 : audit [DBG] from='client.367785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:36 smithi163 bash[24253]: cluster 2024-08-31T08:45:35.501524+0000 mgr.a (mgr.14388) 17051 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:36 smithi027 bash[22610]: cluster 2024-08-31T08:45:35.501524+0000 mgr.a (mgr.14388) 17051 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:36 smithi191 bash[24992]: cluster 2024-08-31T08:45:35.501524+0000 mgr.a (mgr.14388) 17051 : cluster [DBG] pgmap v11821: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:38 smithi163 bash[24253]: cluster 2024-08-31T08:45:37.502398+0000 mgr.a (mgr.14388) 17052 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:38 smithi027 bash[22610]: cluster 2024-08-31T08:45:37.502398+0000 mgr.a (mgr.14388) 17052 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:38 smithi191 bash[24992]: cluster 2024-08-31T08:45:37.502398+0000 mgr.a (mgr.14388) 17052 : cluster [DBG] pgmap v11822: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:40.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:45:40.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:45:40.115 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:40.902 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:40.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:40.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:40.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:40.903 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:40 smithi163 bash[24253]: cluster 2024-08-31T08:45:39.504624+0000 mgr.a (mgr.14388) 17053 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:40 smithi027 bash[22610]: cluster 2024-08-31T08:45:39.504624+0000 mgr.a (mgr.14388) 17053 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:40 smithi191 bash[24992]: cluster 2024-08-31T08:45:39.504624+0000 mgr.a (mgr.14388) 17053 : cluster [DBG] pgmap v11823: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:41 smithi163 bash[24253]: audit 2024-08-31T08:45:40.452256+0000 mgr.a (mgr.14388) 17054 : audit [DBG] from='client.367863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:41 smithi027 bash[22610]: audit 2024-08-31T08:45:40.452256+0000 mgr.a (mgr.14388) 17054 : audit [DBG] from='client.367863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:41 smithi191 bash[24992]: audit 2024-08-31T08:45:40.452256+0000 mgr.a (mgr.14388) 17054 : audit [DBG] from='client.367863 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:42 smithi163 bash[24253]: cluster 2024-08-31T08:45:41.505569+0000 mgr.a (mgr.14388) 17055 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:42 smithi027 bash[22610]: cluster 2024-08-31T08:45:41.505569+0000 mgr.a (mgr.14388) 17055 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:42 smithi191 bash[24992]: cluster 2024-08-31T08:45:41.505569+0000 mgr.a (mgr.14388) 17055 : cluster [DBG] pgmap v11824: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:44 smithi163 bash[24253]: cluster 2024-08-31T08:45:43.507735+0000 mgr.a (mgr.14388) 17056 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:44 smithi027 bash[22610]: cluster 2024-08-31T08:45:43.507735+0000 mgr.a (mgr.14388) 17056 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:44 smithi191 bash[24992]: cluster 2024-08-31T08:45:43.507735+0000 mgr.a (mgr.14388) 17056 : cluster [DBG] pgmap v11825: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:45:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:45:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:46.640 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:46.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:46.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:46.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:46.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:46.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:46 smithi163 bash[24253]: cluster 2024-08-31T08:45:45.508492+0000 mgr.a (mgr.14388) 17057 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:46.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:46 smithi163 bash[24253]: audit 2024-08-31T08:45:46.235173+0000 mgr.a (mgr.14388) 17058 : audit [DBG] from='client.367941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:46 smithi027 bash[22610]: cluster 2024-08-31T08:45:45.508492+0000 mgr.a (mgr.14388) 17057 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:46 smithi027 bash[22610]: audit 2024-08-31T08:45:46.235173+0000 mgr.a (mgr.14388) 17058 : audit [DBG] from='client.367941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:46 smithi191 bash[24992]: cluster 2024-08-31T08:45:45.508492+0000 mgr.a (mgr.14388) 17057 : cluster [DBG] pgmap v11826: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:46 smithi191 bash[24992]: audit 2024-08-31T08:45:46.235173+0000 mgr.a (mgr.14388) 17058 : audit [DBG] from='client.367941 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:48 smithi163 bash[24253]: cluster 2024-08-31T08:45:47.509386+0000 mgr.a (mgr.14388) 17059 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:48 smithi027 bash[22610]: cluster 2024-08-31T08:45:47.509386+0000 mgr.a (mgr.14388) 17059 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:48 smithi191 bash[24992]: cluster 2024-08-31T08:45:47.509386+0000 mgr.a (mgr.14388) 17059 : cluster [DBG] pgmap v11827: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:50 smithi163 bash[24253]: cluster 2024-08-31T08:45:49.511649+0000 mgr.a (mgr.14388) 17060 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:50 smithi027 bash[22610]: cluster 2024-08-31T08:45:49.511649+0000 mgr.a (mgr.14388) 17060 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:50 smithi191 bash[24992]: cluster 2024-08-31T08:45:49.511649+0000 mgr.a (mgr.14388) 17060 : cluster [DBG] pgmap v11828: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:51.642 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:45:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:45:51.643 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:52.402 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:52.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:52.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:52.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:52.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:52 smithi163 bash[24253]: cluster 2024-08-31T08:45:51.512398+0000 mgr.a (mgr.14388) 17061 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:52 smithi163 bash[24253]: audit 2024-08-31T08:45:51.974286+0000 mgr.a (mgr.14388) 17062 : audit [DBG] from='client.368019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:52 smithi027 bash[22610]: cluster 2024-08-31T08:45:51.512398+0000 mgr.a (mgr.14388) 17061 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:52 smithi027 bash[22610]: audit 2024-08-31T08:45:51.974286+0000 mgr.a (mgr.14388) 17062 : audit [DBG] from='client.368019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:52 smithi191 bash[24992]: cluster 2024-08-31T08:45:51.512398+0000 mgr.a (mgr.14388) 17061 : cluster [DBG] pgmap v11829: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:52 smithi191 bash[24992]: audit 2024-08-31T08:45:51.974286+0000 mgr.a (mgr.14388) 17062 : audit [DBG] from='client.368019 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:53 smithi163 bash[24253]: audit 2024-08-31T08:45:53.079298+0000 mon.a (mon.0) 3116 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:45:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:53 smithi027 bash[22610]: audit 2024-08-31T08:45:53.079298+0000 mon.a (mon.0) 3116 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:45:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:53 smithi191 bash[24992]: audit 2024-08-31T08:45:53.079298+0000 mon.a (mon.0) 3116 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:45:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:54 smithi163 bash[24253]: cluster 2024-08-31T08:45:53.514625+0000 mgr.a (mgr.14388) 17063 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:54 smithi163 bash[24253]: audit 2024-08-31T08:45:53.694193+0000 mon.a (mon.0) 3117 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:54 smithi163 bash[24253]: audit 2024-08-31T08:45:53.701071+0000 mon.a (mon.0) 3118 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:54 smithi163 bash[24253]: audit 2024-08-31T08:45:53.704203+0000 mon.a (mon.0) 3119 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:54 smithi163 bash[24253]: audit 2024-08-31T08:45:53.708536+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:54 smithi027 bash[22610]: cluster 2024-08-31T08:45:53.514625+0000 mgr.a (mgr.14388) 17063 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:54 smithi027 bash[22610]: audit 2024-08-31T08:45:53.694193+0000 mon.a (mon.0) 3117 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:54 smithi027 bash[22610]: audit 2024-08-31T08:45:53.701071+0000 mon.a (mon.0) 3118 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:54 smithi027 bash[22610]: audit 2024-08-31T08:45:53.704203+0000 mon.a (mon.0) 3119 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:54.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:54 smithi027 bash[22610]: audit 2024-08-31T08:45:53.708536+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:54 smithi191 bash[24992]: cluster 2024-08-31T08:45:53.514625+0000 mgr.a (mgr.14388) 17063 : cluster [DBG] pgmap v11830: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:45:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:54 smithi191 bash[24992]: audit 2024-08-31T08:45:53.694193+0000 mon.a (mon.0) 3117 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:55.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:54 smithi191 bash[24992]: audit 2024-08-31T08:45:53.701071+0000 mon.a (mon.0) 3118 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:55.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:54 smithi191 bash[24992]: audit 2024-08-31T08:45:53.704203+0000 mon.a (mon.0) 3119 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:55.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:54 smithi191 bash[24992]: audit 2024-08-31T08:45:53.708536+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:45:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:56 smithi027 bash[22610]: cluster 2024-08-31T08:45:55.515398+0000 mgr.a (mgr.14388) 17064 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:56 smithi191 bash[24992]: cluster 2024-08-31T08:45:55.515398+0000 mgr.a (mgr.14388) 17064 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:56 smithi163 bash[24253]: cluster 2024-08-31T08:45:55.515398+0000 mgr.a (mgr.14388) 17064 : cluster [DBG] pgmap v11831: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:57.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:45:57.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:45:57.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:45:58.172 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:45:58.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:45:58.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:45:58.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:45:58.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:45:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:58 smithi027 bash[22610]: cluster 2024-08-31T08:45:57.515871+0000 mgr.a (mgr.14388) 17065 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:45:58 smithi027 bash[22610]: audit 2024-08-31T08:45:57.742504+0000 mgr.a (mgr.14388) 17066 : audit [DBG] from='client.368097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:58 smithi191 bash[24992]: cluster 2024-08-31T08:45:57.515871+0000 mgr.a (mgr.14388) 17065 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:45:58 smithi191 bash[24992]: audit 2024-08-31T08:45:57.742504+0000 mgr.a (mgr.14388) 17066 : audit [DBG] from='client.368097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:45:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:58 smithi163 bash[24253]: cluster 2024-08-31T08:45:57.515871+0000 mgr.a (mgr.14388) 17065 : cluster [DBG] pgmap v11832: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:45:59.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:45:58 smithi163 bash[24253]: audit 2024-08-31T08:45:57.742504+0000 mgr.a (mgr.14388) 17066 : audit [DBG] from='client.368097 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:00.923 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:00 smithi163 bash[24253]: cluster 2024-08-31T08:45:59.518519+0000 mgr.a (mgr.14388) 17067 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:00 smithi027 bash[22610]: cluster 2024-08-31T08:45:59.518519+0000 mgr.a (mgr.14388) 17067 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:00 smithi191 bash[24992]: cluster 2024-08-31T08:45:59.518519+0000 mgr.a (mgr.14388) 17067 : cluster [DBG] pgmap v11833: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:02 smithi163 bash[24253]: cluster 2024-08-31T08:46:01.519350+0000 mgr.a (mgr.14388) 17068 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:02 smithi027 bash[22610]: cluster 2024-08-31T08:46:01.519350+0000 mgr.a (mgr.14388) 17068 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:02 smithi191 bash[24992]: cluster 2024-08-31T08:46:01.519350+0000 mgr.a (mgr.14388) 17068 : cluster [DBG] pgmap v11834: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:03.174 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:46:03.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:46:03.175 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:46:03.925 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:46:03.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:46:03.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:46:03.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:46:03.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:46:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:04 smithi163 bash[24253]: audit 2024-08-31T08:46:03.506797+0000 mgr.a (mgr.14388) 17069 : audit [DBG] from='client.368175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:04 smithi163 bash[24253]: cluster 2024-08-31T08:46:03.522392+0000 mgr.a (mgr.14388) 17070 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:04 smithi163 bash[24253]: audit 2024-08-31T08:46:03.872938+0000 mon.a (mon.0) 3121 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:04 smithi163 bash[24253]: audit 2024-08-31T08:46:03.878844+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:04 smithi163 bash[24253]: audit 2024-08-31T08:46:04.235921+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:04 smithi163 bash[24253]: audit 2024-08-31T08:46:04.244114+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:04 smithi163 bash[24253]: audit 2024-08-31T08:46:04.246478+0000 mon.a (mon.0) 3125 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:46:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:04 smithi163 bash[24253]: audit 2024-08-31T08:46:04.248361+0000 mon.a (mon.0) 3126 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:46:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:04 smithi163 bash[24253]: audit 2024-08-31T08:46:04.258698+0000 mon.a (mon.0) 3127 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:04 smithi163 bash[24253]: audit 2024-08-31T08:46:04.263824+0000 mon.a (mon.0) 3128 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:46:05.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:46:05 smithi027 bash[22863]: debug 2024-08-31T08:46:05.061+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:46:05.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:46:05 smithi027 bash[22863]: debug 2024-08-31T08:46:05.065+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:46:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:04 smithi027 bash[22610]: audit 2024-08-31T08:46:03.506797+0000 mgr.a (mgr.14388) 17069 : audit [DBG] from='client.368175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:04 smithi027 bash[22610]: cluster 2024-08-31T08:46:03.522392+0000 mgr.a (mgr.14388) 17070 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:04 smithi027 bash[22610]: audit 2024-08-31T08:46:03.872938+0000 mon.a (mon.0) 3121 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:04 smithi027 bash[22610]: audit 2024-08-31T08:46:03.878844+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:04 smithi027 bash[22610]: audit 2024-08-31T08:46:04.235921+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:04 smithi027 bash[22610]: audit 2024-08-31T08:46:04.244114+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:04 smithi027 bash[22610]: audit 2024-08-31T08:46:04.246478+0000 mon.a (mon.0) 3125 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:46:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:04 smithi027 bash[22610]: audit 2024-08-31T08:46:04.248361+0000 mon.a (mon.0) 3126 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:46:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:04 smithi027 bash[22610]: audit 2024-08-31T08:46:04.258698+0000 mon.a (mon.0) 3127 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:04 smithi027 bash[22610]: audit 2024-08-31T08:46:04.263824+0000 mon.a (mon.0) 3128 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:46:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:04 smithi191 bash[24992]: audit 2024-08-31T08:46:03.506797+0000 mgr.a (mgr.14388) 17069 : audit [DBG] from='client.368175 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:04 smithi191 bash[24992]: cluster 2024-08-31T08:46:03.522392+0000 mgr.a (mgr.14388) 17070 : cluster [DBG] pgmap v11835: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:04 smithi191 bash[24992]: audit 2024-08-31T08:46:03.872938+0000 mon.a (mon.0) 3121 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:04 smithi191 bash[24992]: audit 2024-08-31T08:46:03.878844+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:04 smithi191 bash[24992]: audit 2024-08-31T08:46:04.235921+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:04 smithi191 bash[24992]: audit 2024-08-31T08:46:04.244114+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:04 smithi191 bash[24992]: audit 2024-08-31T08:46:04.246478+0000 mon.a (mon.0) 3125 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:46:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:04 smithi191 bash[24992]: audit 2024-08-31T08:46:04.248361+0000 mon.a (mon.0) 3126 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:46:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:04 smithi191 bash[24992]: audit 2024-08-31T08:46:04.258698+0000 mon.a (mon.0) 3127 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:46:05.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:04 smithi191 bash[24992]: audit 2024-08-31T08:46:04.263824+0000 mon.a (mon.0) 3128 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:46:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:05 smithi163 bash[24253]: audit 2024-08-31T08:46:04.266559+0000 mgr.a (mgr.14388) 17071 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:46:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:05 smithi163 bash[24253]: audit 2024-08-31T08:46:05.065035+0000 mgr.a (mgr.14388) 17072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:46:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:05 smithi163 bash[24253]: cephadm 2024-08-31T08:46:05.066739+0000 mgr.a (mgr.14388) 17073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:46:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:05 smithi027 bash[22610]: audit 2024-08-31T08:46:04.266559+0000 mgr.a (mgr.14388) 17071 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:46:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:05 smithi027 bash[22610]: audit 2024-08-31T08:46:05.065035+0000 mgr.a (mgr.14388) 17072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:46:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:05 smithi027 bash[22610]: cephadm 2024-08-31T08:46:05.066739+0000 mgr.a (mgr.14388) 17073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:46:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:05 smithi191 bash[24992]: audit 2024-08-31T08:46:04.266559+0000 mgr.a (mgr.14388) 17071 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:46:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:05 smithi191 bash[24992]: audit 2024-08-31T08:46:05.065035+0000 mgr.a (mgr.14388) 17072 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:46:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:05 smithi191 bash[24992]: cephadm 2024-08-31T08:46:05.066739+0000 mgr.a (mgr.14388) 17073 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:46:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:06 smithi163 bash[24253]: cluster 2024-08-31T08:46:05.523371+0000 mgr.a (mgr.14388) 17074 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:06 smithi027 bash[22610]: cluster 2024-08-31T08:46:05.523371+0000 mgr.a (mgr.14388) 17074 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:06 smithi191 bash[24992]: cluster 2024-08-31T08:46:05.523371+0000 mgr.a (mgr.14388) 17074 : cluster [DBG] pgmap v11836: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:08.926 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:46:08.927 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:46:08.927 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:46:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:08 smithi163 bash[24253]: cluster 2024-08-31T08:46:07.524159+0000 mgr.a (mgr.14388) 17075 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:08 smithi027 bash[22610]: cluster 2024-08-31T08:46:07.524159+0000 mgr.a (mgr.14388) 17075 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:08 smithi191 bash[24992]: cluster 2024-08-31T08:46:07.524159+0000 mgr.a (mgr.14388) 17075 : cluster [DBG] pgmap v11837: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:09.691 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:46:09.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:46:09.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:46:09.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:46:09.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:46:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:10 smithi163 bash[24253]: audit 2024-08-31T08:46:09.260285+0000 mgr.a (mgr.14388) 17076 : audit [DBG] from='client.368361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:10 smithi163 bash[24253]: cluster 2024-08-31T08:46:09.527281+0000 mgr.a (mgr.14388) 17077 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:10 smithi027 bash[22610]: audit 2024-08-31T08:46:09.260285+0000 mgr.a (mgr.14388) 17076 : audit [DBG] from='client.368361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:10 smithi027 bash[22610]: cluster 2024-08-31T08:46:09.527281+0000 mgr.a (mgr.14388) 17077 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:10 smithi191 bash[24992]: audit 2024-08-31T08:46:09.260285+0000 mgr.a (mgr.14388) 17076 : audit [DBG] from='client.368361 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:10 smithi191 bash[24992]: cluster 2024-08-31T08:46:09.527281+0000 mgr.a (mgr.14388) 17077 : cluster [DBG] pgmap v11838: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:12 smithi163 bash[24253]: cluster 2024-08-31T08:46:11.528216+0000 mgr.a (mgr.14388) 17078 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:12 smithi027 bash[22610]: cluster 2024-08-31T08:46:11.528216+0000 mgr.a (mgr.14388) 17078 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:12 smithi191 bash[24992]: cluster 2024-08-31T08:46:11.528216+0000 mgr.a (mgr.14388) 17078 : cluster [DBG] pgmap v11839: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:14.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:46:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:46:14.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:46:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:14 smithi163 bash[24253]: cluster 2024-08-31T08:46:13.530383+0000 mgr.a (mgr.14388) 17079 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:14 smithi027 bash[22610]: cluster 2024-08-31T08:46:13.530383+0000 mgr.a (mgr.14388) 17079 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:14 smithi191 bash[24992]: cluster 2024-08-31T08:46:13.530383+0000 mgr.a (mgr.14388) 17079 : cluster [DBG] pgmap v11840: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:15.441 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:46:15.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:46:15.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:46:15.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:46:15.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:46:16.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:15 smithi163 bash[24253]: audit 2024-08-31T08:46:15.022481+0000 mgr.a (mgr.14388) 17080 : audit [DBG] from='client.368433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:15 smithi027 bash[22610]: audit 2024-08-31T08:46:15.022481+0000 mgr.a (mgr.14388) 17080 : audit [DBG] from='client.368433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:15 smithi191 bash[24992]: audit 2024-08-31T08:46:15.022481+0000 mgr.a (mgr.14388) 17080 : audit [DBG] from='client.368433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:16 smithi163 bash[24253]: cluster 2024-08-31T08:46:15.531316+0000 mgr.a (mgr.14388) 17081 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:16 smithi027 bash[22610]: cluster 2024-08-31T08:46:15.531316+0000 mgr.a (mgr.14388) 17081 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:16 smithi191 bash[24992]: cluster 2024-08-31T08:46:15.531316+0000 mgr.a (mgr.14388) 17081 : cluster [DBG] pgmap v11841: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:18 smithi163 bash[24253]: cluster 2024-08-31T08:46:17.532102+0000 mgr.a (mgr.14388) 17082 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:18 smithi027 bash[22610]: cluster 2024-08-31T08:46:17.532102+0000 mgr.a (mgr.14388) 17082 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:18 smithi191 bash[24992]: cluster 2024-08-31T08:46:17.532102+0000 mgr.a (mgr.14388) 17082 : cluster [DBG] pgmap v11842: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:20.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:46:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:46:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:46:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:20 smithi163 bash[24253]: cluster 2024-08-31T08:46:19.534298+0000 mgr.a (mgr.14388) 17083 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:21.221 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:46:21.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:46:21.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:46:21.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:46:21.222 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:46:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:20 smithi027 bash[22610]: cluster 2024-08-31T08:46:19.534298+0000 mgr.a (mgr.14388) 17083 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:20 smithi191 bash[24992]: cluster 2024-08-31T08:46:19.534298+0000 mgr.a (mgr.14388) 17083 : cluster [DBG] pgmap v11843: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:46:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:21 smithi163 bash[24253]: audit 2024-08-31T08:46:20.781761+0000 mgr.a (mgr.14388) 17084 : audit [DBG] from='client.368511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:21 smithi027 bash[22610]: audit 2024-08-31T08:46:20.781761+0000 mgr.a (mgr.14388) 17084 : audit [DBG] from='client.368511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:21 smithi191 bash[24992]: audit 2024-08-31T08:46:20.781761+0000 mgr.a (mgr.14388) 17084 : audit [DBG] from='client.368511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:22 smithi163 bash[24253]: cluster 2024-08-31T08:46:21.535232+0000 mgr.a (mgr.14388) 17085 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:22 smithi027 bash[22610]: cluster 2024-08-31T08:46:21.535232+0000 mgr.a (mgr.14388) 17085 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:22 smithi191 bash[24992]: cluster 2024-08-31T08:46:21.535232+0000 mgr.a (mgr.14388) 17085 : cluster [DBG] pgmap v11844: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:24 smithi163 bash[24253]: cluster 2024-08-31T08:46:23.537385+0000 mgr.a (mgr.14388) 17086 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:24 smithi027 bash[22610]: cluster 2024-08-31T08:46:23.537385+0000 mgr.a (mgr.14388) 17086 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:24 smithi191 bash[24992]: cluster 2024-08-31T08:46:23.537385+0000 mgr.a (mgr.14388) 17086 : cluster [DBG] pgmap v11845: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:26.223 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:46:26.224 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:46:26.224 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:46:26.993 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:46:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:46:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:46:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:46:26.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:46:27.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:26 smithi163 bash[24253]: cluster 2024-08-31T08:46:25.538147+0000 mgr.a (mgr.14388) 17087 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:26 smithi027 bash[22610]: cluster 2024-08-31T08:46:25.538147+0000 mgr.a (mgr.14388) 17087 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:26 smithi191 bash[24992]: cluster 2024-08-31T08:46:25.538147+0000 mgr.a (mgr.14388) 17087 : cluster [DBG] pgmap v11846: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:27 smithi027 bash[22610]: audit 2024-08-31T08:46:26.563315+0000 mgr.a (mgr.14388) 17088 : audit [DBG] from='client.368589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:27 smithi191 bash[24992]: audit 2024-08-31T08:46:26.563315+0000 mgr.a (mgr.14388) 17088 : audit [DBG] from='client.368589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:27 smithi163 bash[24253]: audit 2024-08-31T08:46:26.563315+0000 mgr.a (mgr.14388) 17088 : audit [DBG] from='client.368589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:28 smithi027 bash[22610]: cluster 2024-08-31T08:46:27.539039+0000 mgr.a (mgr.14388) 17089 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:28 smithi191 bash[24992]: cluster 2024-08-31T08:46:27.539039+0000 mgr.a (mgr.14388) 17089 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:28 smithi163 bash[24253]: cluster 2024-08-31T08:46:27.539039+0000 mgr.a (mgr.14388) 17089 : cluster [DBG] pgmap v11847: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:30 smithi027 bash[22610]: cluster 2024-08-31T08:46:29.541438+0000 mgr.a (mgr.14388) 17090 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:30 smithi191 bash[24992]: cluster 2024-08-31T08:46:29.541438+0000 mgr.a (mgr.14388) 17090 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:30 smithi163 bash[24253]: cluster 2024-08-31T08:46:29.541438+0000 mgr.a (mgr.14388) 17090 : cluster [DBG] pgmap v11848: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:31.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:46:31.996 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:46:31.996 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:46:32.771 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:46:32.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:46:32.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:46:32.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:46:32.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:46:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:32 smithi027 bash[22610]: cluster 2024-08-31T08:46:31.542371+0000 mgr.a (mgr.14388) 17091 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:32 smithi191 bash[24992]: cluster 2024-08-31T08:46:31.542371+0000 mgr.a (mgr.14388) 17091 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:32 smithi163 bash[24253]: cluster 2024-08-31T08:46:31.542371+0000 mgr.a (mgr.14388) 17091 : cluster [DBG] pgmap v11849: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:33 smithi027 bash[22610]: audit 2024-08-31T08:46:32.329398+0000 mgr.a (mgr.14388) 17092 : audit [DBG] from='client.368664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:33 smithi191 bash[24992]: audit 2024-08-31T08:46:32.329398+0000 mgr.a (mgr.14388) 17092 : audit [DBG] from='client.368664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:34.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:33 smithi163 bash[24253]: audit 2024-08-31T08:46:32.329398+0000 mgr.a (mgr.14388) 17092 : audit [DBG] from='client.368664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:34 smithi027 bash[22610]: cluster 2024-08-31T08:46:33.544723+0000 mgr.a (mgr.14388) 17093 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:34 smithi191 bash[24992]: cluster 2024-08-31T08:46:33.544723+0000 mgr.a (mgr.14388) 17093 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:34 smithi163 bash[24253]: cluster 2024-08-31T08:46:33.544723+0000 mgr.a (mgr.14388) 17093 : cluster [DBG] pgmap v11850: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:36 smithi027 bash[22610]: cluster 2024-08-31T08:46:35.545516+0000 mgr.a (mgr.14388) 17094 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:36 smithi191 bash[24992]: cluster 2024-08-31T08:46:35.545516+0000 mgr.a (mgr.14388) 17094 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:36 smithi163 bash[24253]: cluster 2024-08-31T08:46:35.545516+0000 mgr.a (mgr.14388) 17094 : cluster [DBG] pgmap v11851: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:37.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:46:37.774 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:46:37.774 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:46:38.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:46:38.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:46:38.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:46:38.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:46:38.520 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:46:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:38 smithi191 bash[24992]: cluster 2024-08-31T08:46:37.546281+0000 mgr.a (mgr.14388) 17095 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:38 smithi191 bash[24992]: audit 2024-08-31T08:46:38.102438+0000 mgr.a (mgr.14388) 17096 : audit [DBG] from='client.368742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:38 smithi163 bash[24253]: cluster 2024-08-31T08:46:37.546281+0000 mgr.a (mgr.14388) 17095 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:38 smithi163 bash[24253]: audit 2024-08-31T08:46:38.102438+0000 mgr.a (mgr.14388) 17096 : audit [DBG] from='client.368742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:38 smithi027 bash[22610]: cluster 2024-08-31T08:46:37.546281+0000 mgr.a (mgr.14388) 17095 : cluster [DBG] pgmap v11852: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:38 smithi027 bash[22610]: audit 2024-08-31T08:46:38.102438+0000 mgr.a (mgr.14388) 17096 : audit [DBG] from='client.368742 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:40 smithi191 bash[24992]: cluster 2024-08-31T08:46:39.549022+0000 mgr.a (mgr.14388) 17097 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:40 smithi163 bash[24253]: cluster 2024-08-31T08:46:39.549022+0000 mgr.a (mgr.14388) 17097 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:40 smithi027 bash[22610]: cluster 2024-08-31T08:46:39.549022+0000 mgr.a (mgr.14388) 17097 : cluster [DBG] pgmap v11853: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:42 smithi191 bash[24992]: cluster 2024-08-31T08:46:41.549933+0000 mgr.a (mgr.14388) 17098 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:42 smithi163 bash[24253]: cluster 2024-08-31T08:46:41.549933+0000 mgr.a (mgr.14388) 17098 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:42 smithi027 bash[22610]: cluster 2024-08-31T08:46:41.549933+0000 mgr.a (mgr.14388) 17098 : cluster [DBG] pgmap v11854: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:43.521 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:46:43.522 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:46:43.522 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:46:44.310 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:46:44.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:46:44.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:46:44.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:46:44.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:46:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:44 smithi191 bash[24992]: cluster 2024-08-31T08:46:43.551360+0000 mgr.a (mgr.14388) 17099 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:44 smithi191 bash[24992]: audit 2024-08-31T08:46:43.860891+0000 mgr.a (mgr.14388) 17100 : audit [DBG] from='client.368817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:44 smithi163 bash[24253]: cluster 2024-08-31T08:46:43.551360+0000 mgr.a (mgr.14388) 17099 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:45.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:44 smithi163 bash[24253]: audit 2024-08-31T08:46:43.860891+0000 mgr.a (mgr.14388) 17100 : audit [DBG] from='client.368817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:44 smithi027 bash[22610]: cluster 2024-08-31T08:46:43.551360+0000 mgr.a (mgr.14388) 17099 : cluster [DBG] pgmap v11855: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:44 smithi027 bash[22610]: audit 2024-08-31T08:46:43.860891+0000 mgr.a (mgr.14388) 17100 : audit [DBG] from='client.368817 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:47 smithi191 bash[24992]: cluster 2024-08-31T08:46:45.552203+0000 mgr.a (mgr.14388) 17101 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:47 smithi163 bash[24253]: cluster 2024-08-31T08:46:45.552203+0000 mgr.a (mgr.14388) 17101 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:47 smithi027 bash[22610]: cluster 2024-08-31T08:46:45.552203+0000 mgr.a (mgr.14388) 17101 : cluster [DBG] pgmap v11856: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:46:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:49 smithi191 bash[24992]: cluster 2024-08-31T08:46:47.552982+0000 mgr.a (mgr.14388) 17102 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:46:49.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:46:49.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:46:49.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:46:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:49 smithi163 bash[24253]: cluster 2024-08-31T08:46:47.552982+0000 mgr.a (mgr.14388) 17102 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:46:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:49 smithi027 bash[22610]: cluster 2024-08-31T08:46:47.552982+0000 mgr.a (mgr.14388) 17102 : cluster [DBG] pgmap v11857: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:46:50.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:46:50.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:46:50.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:46:50.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:46:50.063 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:46:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:51 smithi191 bash[24992]: cluster 2024-08-31T08:46:49.555122+0000 mgr.a (mgr.14388) 17103 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:51 smithi191 bash[24992]: audit 2024-08-31T08:46:49.645511+0000 mgr.a (mgr.14388) 17104 : audit [DBG] from='client.368892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:51 smithi163 bash[24253]: cluster 2024-08-31T08:46:49.555122+0000 mgr.a (mgr.14388) 17103 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:51 smithi163 bash[24253]: audit 2024-08-31T08:46:49.645511+0000 mgr.a (mgr.14388) 17104 : audit [DBG] from='client.368892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:51 smithi027 bash[22610]: cluster 2024-08-31T08:46:49.555122+0000 mgr.a (mgr.14388) 17103 : cluster [DBG] pgmap v11858: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:51 smithi027 bash[22610]: audit 2024-08-31T08:46:49.645511+0000 mgr.a (mgr.14388) 17104 : audit [DBG] from='client.368892 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:53 smithi191 bash[24992]: cluster 2024-08-31T08:46:51.556015+0000 mgr.a (mgr.14388) 17105 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:53 smithi163 bash[24253]: cluster 2024-08-31T08:46:51.556015+0000 mgr.a (mgr.14388) 17105 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:53 smithi027 bash[22610]: cluster 2024-08-31T08:46:51.556015+0000 mgr.a (mgr.14388) 17105 : cluster [DBG] pgmap v11859: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:55.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:46:55.064 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:46:55.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:46:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:55 smithi191 bash[24992]: cluster 2024-08-31T08:46:53.558192+0000 mgr.a (mgr.14388) 17106 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:55 smithi163 bash[24253]: cluster 2024-08-31T08:46:53.558192+0000 mgr.a (mgr.14388) 17106 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:55 smithi027 bash[22610]: cluster 2024-08-31T08:46:53.558192+0000 mgr.a (mgr.14388) 17106 : cluster [DBG] pgmap v11860: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:46:55.831 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:46:55.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:46:55.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:46:55.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:46:55.831 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:46:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:57 smithi191 bash[24992]: audit 2024-08-31T08:46:55.399719+0000 mgr.a (mgr.14388) 17107 : audit [DBG] from='client.368967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:57 smithi191 bash[24992]: cluster 2024-08-31T08:46:55.558759+0000 mgr.a (mgr.14388) 17108 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:57 smithi163 bash[24253]: audit 2024-08-31T08:46:55.399719+0000 mgr.a (mgr.14388) 17107 : audit [DBG] from='client.368967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:57 smithi163 bash[24253]: cluster 2024-08-31T08:46:55.558759+0000 mgr.a (mgr.14388) 17108 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:57 smithi027 bash[22610]: audit 2024-08-31T08:46:55.399719+0000 mgr.a (mgr.14388) 17107 : audit [DBG] from='client.368967 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:46:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:57 smithi027 bash[22610]: cluster 2024-08-31T08:46:55.558759+0000 mgr.a (mgr.14388) 17108 : cluster [DBG] pgmap v11861: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:46:59 smithi191 bash[24992]: cluster 2024-08-31T08:46:57.559623+0000 mgr.a (mgr.14388) 17109 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:46:59 smithi163 bash[24253]: cluster 2024-08-31T08:46:57.559623+0000 mgr.a (mgr.14388) 17109 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:46:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:46:59 smithi027 bash[22610]: cluster 2024-08-31T08:46:57.559623+0000 mgr.a (mgr.14388) 17109 : cluster [DBG] pgmap v11862: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:00.832 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:00.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:00.833 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:01 smithi191 bash[24992]: cluster 2024-08-31T08:46:59.561801+0000 mgr.a (mgr.14388) 17110 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:01 smithi163 bash[24253]: cluster 2024-08-31T08:46:59.561801+0000 mgr.a (mgr.14388) 17110 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:01 smithi027 bash[22610]: cluster 2024-08-31T08:46:59.561801+0000 mgr.a (mgr.14388) 17110 : cluster [DBG] pgmap v11863: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:01.581 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:01.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:01.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:01.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:01.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:02 smithi163 bash[24253]: audit 2024-08-31T08:47:01.162260+0000 mgr.a (mgr.14388) 17111 : audit [DBG] from='client.369045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:02 smithi027 bash[22610]: audit 2024-08-31T08:47:01.162260+0000 mgr.a (mgr.14388) 17111 : audit [DBG] from='client.369045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:02.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:02 smithi191 bash[24992]: audit 2024-08-31T08:47:01.162260+0000 mgr.a (mgr.14388) 17111 : audit [DBG] from='client.369045 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:03 smithi163 bash[24253]: cluster 2024-08-31T08:47:01.562307+0000 mgr.a (mgr.14388) 17112 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:03 smithi027 bash[22610]: cluster 2024-08-31T08:47:01.562307+0000 mgr.a (mgr.14388) 17112 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:03 smithi191 bash[24992]: cluster 2024-08-31T08:47:01.562307+0000 mgr.a (mgr.14388) 17112 : cluster [DBG] pgmap v11864: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:05 smithi163 bash[24253]: cluster 2024-08-31T08:47:03.564450+0000 mgr.a (mgr.14388) 17113 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:05 smithi027 bash[22610]: cluster 2024-08-31T08:47:03.564450+0000 mgr.a (mgr.14388) 17113 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:05 smithi191 bash[24992]: cluster 2024-08-31T08:47:03.564450+0000 mgr.a (mgr.14388) 17113 : cluster [DBG] pgmap v11865: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:06 smithi163 bash[24253]: audit 2024-08-31T08:47:05.129111+0000 mon.a (mon.0) 3129 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:47:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:06 smithi163 bash[24253]: audit 2024-08-31T08:47:05.983956+0000 mon.a (mon.0) 3130 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:47:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:06 smithi163 bash[24253]: audit 2024-08-31T08:47:05.985729+0000 mon.a (mon.0) 3131 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:47:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:06 smithi163 bash[24253]: audit 2024-08-31T08:47:05.996314+0000 mon.a (mon.0) 3132 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:47:06.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:06 smithi163 bash[24253]: audit 2024-08-31T08:47:05.999434+0000 mon.a (mon.0) 3133 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:47:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:06 smithi027 bash[22610]: audit 2024-08-31T08:47:05.129111+0000 mon.a (mon.0) 3129 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:47:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:06 smithi027 bash[22610]: audit 2024-08-31T08:47:05.983956+0000 mon.a (mon.0) 3130 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:47:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:06 smithi027 bash[22610]: audit 2024-08-31T08:47:05.985729+0000 mon.a (mon.0) 3131 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:47:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:06 smithi027 bash[22610]: audit 2024-08-31T08:47:05.996314+0000 mon.a (mon.0) 3132 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:47:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:06 smithi027 bash[22610]: audit 2024-08-31T08:47:05.999434+0000 mon.a (mon.0) 3133 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:47:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:06 smithi191 bash[24992]: audit 2024-08-31T08:47:05.129111+0000 mon.a (mon.0) 3129 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:47:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:06 smithi191 bash[24992]: audit 2024-08-31T08:47:05.983956+0000 mon.a (mon.0) 3130 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:47:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:06 smithi191 bash[24992]: audit 2024-08-31T08:47:05.985729+0000 mon.a (mon.0) 3131 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:47:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:06 smithi191 bash[24992]: audit 2024-08-31T08:47:05.996314+0000 mon.a (mon.0) 3132 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:47:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:06 smithi191 bash[24992]: audit 2024-08-31T08:47:05.999434+0000 mon.a (mon.0) 3133 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:47:06.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:06.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:06.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:07.059 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:47:06 smithi027 bash[22863]: debug 2024-08-31T08:47:06.759+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:47:07.059 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:47:06 smithi027 bash[22863]: debug 2024-08-31T08:47:06.763+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:47:07.338 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:07.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:07.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:07.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:07.338 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:07 smithi163 bash[24253]: cluster 2024-08-31T08:47:05.565185+0000 mgr.a (mgr.14388) 17114 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:07 smithi163 bash[24253]: audit 2024-08-31T08:47:06.001682+0000 mgr.a (mgr.14388) 17115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:47:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:07 smithi027 bash[22610]: cluster 2024-08-31T08:47:05.565185+0000 mgr.a (mgr.14388) 17114 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:07 smithi027 bash[22610]: audit 2024-08-31T08:47:06.001682+0000 mgr.a (mgr.14388) 17115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:47:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:07 smithi191 bash[24992]: cluster 2024-08-31T08:47:05.565185+0000 mgr.a (mgr.14388) 17114 : cluster [DBG] pgmap v11866: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:07 smithi191 bash[24992]: audit 2024-08-31T08:47:06.001682+0000 mgr.a (mgr.14388) 17115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:47:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:08 smithi163 bash[24253]: audit 2024-08-31T08:47:06.765506+0000 mgr.a (mgr.14388) 17116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:47:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:08 smithi163 bash[24253]: cephadm 2024-08-31T08:47:06.766769+0000 mgr.a (mgr.14388) 17117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:47:08.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:08 smithi163 bash[24253]: audit 2024-08-31T08:47:06.919081+0000 mgr.a (mgr.14388) 17118 : audit [DBG] from='client.369228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:08 smithi027 bash[22610]: audit 2024-08-31T08:47:06.765506+0000 mgr.a (mgr.14388) 17116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:47:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:08 smithi027 bash[22610]: cephadm 2024-08-31T08:47:06.766769+0000 mgr.a (mgr.14388) 17117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:47:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:08 smithi027 bash[22610]: audit 2024-08-31T08:47:06.919081+0000 mgr.a (mgr.14388) 17118 : audit [DBG] from='client.369228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:08 smithi191 bash[24992]: audit 2024-08-31T08:47:06.765506+0000 mgr.a (mgr.14388) 17116 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:47:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:08 smithi191 bash[24992]: cephadm 2024-08-31T08:47:06.766769+0000 mgr.a (mgr.14388) 17117 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:47:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:08 smithi191 bash[24992]: audit 2024-08-31T08:47:06.919081+0000 mgr.a (mgr.14388) 17118 : audit [DBG] from='client.369228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:09 smithi163 bash[24253]: cluster 2024-08-31T08:47:07.566008+0000 mgr.a (mgr.14388) 17119 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:09 smithi027 bash[22610]: cluster 2024-08-31T08:47:07.566008+0000 mgr.a (mgr.14388) 17119 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:09 smithi191 bash[24992]: cluster 2024-08-31T08:47:07.566008+0000 mgr.a (mgr.14388) 17119 : cluster [DBG] pgmap v11867: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:11 smithi163 bash[24253]: cluster 2024-08-31T08:47:09.568250+0000 mgr.a (mgr.14388) 17120 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:11 smithi027 bash[22610]: cluster 2024-08-31T08:47:09.568250+0000 mgr.a (mgr.14388) 17120 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:11 smithi191 bash[24992]: cluster 2024-08-31T08:47:09.568250+0000 mgr.a (mgr.14388) 17120 : cluster [DBG] pgmap v11868: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:12.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:12.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:12.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:13.108 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:13.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:13.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:13.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:13.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:13 smithi163 bash[24253]: cluster 2024-08-31T08:47:11.569006+0000 mgr.a (mgr.14388) 17121 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:13 smithi027 bash[22610]: cluster 2024-08-31T08:47:11.569006+0000 mgr.a (mgr.14388) 17121 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:13 smithi191 bash[24992]: cluster 2024-08-31T08:47:11.569006+0000 mgr.a (mgr.14388) 17121 : cluster [DBG] pgmap v11869: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:14 smithi163 bash[24253]: audit 2024-08-31T08:47:12.673138+0000 mgr.a (mgr.14388) 17122 : audit [DBG] from='client.369306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:14 smithi027 bash[22610]: audit 2024-08-31T08:47:12.673138+0000 mgr.a (mgr.14388) 17122 : audit [DBG] from='client.369306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:14 smithi191 bash[24992]: audit 2024-08-31T08:47:12.673138+0000 mgr.a (mgr.14388) 17122 : audit [DBG] from='client.369306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:15 smithi163 bash[24253]: cluster 2024-08-31T08:47:13.571737+0000 mgr.a (mgr.14388) 17123 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:15 smithi027 bash[22610]: cluster 2024-08-31T08:47:13.571737+0000 mgr.a (mgr.14388) 17123 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:15 smithi191 bash[24992]: cluster 2024-08-31T08:47:13.571737+0000 mgr.a (mgr.14388) 17123 : cluster [DBG] pgmap v11870: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:17 smithi163 bash[24253]: cluster 2024-08-31T08:47:15.572446+0000 mgr.a (mgr.14388) 17124 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:47:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:17 smithi027 bash[22610]: cluster 2024-08-31T08:47:15.572446+0000 mgr.a (mgr.14388) 17124 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:47:17.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:17 smithi191 bash[24992]: cluster 2024-08-31T08:47:15.572446+0000 mgr.a (mgr.14388) 17124 : cluster [DBG] pgmap v11871: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:47:18.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:18.292 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:18.292 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:18.874 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:18.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:18.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:18.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:18.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:19 smithi163 bash[24253]: cluster 2024-08-31T08:47:17.573232+0000 mgr.a (mgr.14388) 17125 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:47:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:19 smithi027 bash[22610]: cluster 2024-08-31T08:47:17.573232+0000 mgr.a (mgr.14388) 17125 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:47:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:19 smithi191 bash[24992]: cluster 2024-08-31T08:47:17.573232+0000 mgr.a (mgr.14388) 17125 : cluster [DBG] pgmap v11872: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:47:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:20 smithi163 bash[24253]: audit 2024-08-31T08:47:18.440169+0000 mgr.a (mgr.14388) 17126 : audit [DBG] from='client.369381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:20 smithi027 bash[22610]: audit 2024-08-31T08:47:18.440169+0000 mgr.a (mgr.14388) 17126 : audit [DBG] from='client.369381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:20 smithi191 bash[24992]: audit 2024-08-31T08:47:18.440169+0000 mgr.a (mgr.14388) 17126 : audit [DBG] from='client.369381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:21 smithi163 bash[24253]: cluster 2024-08-31T08:47:19.576088+0000 mgr.a (mgr.14388) 17127 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:21 smithi027 bash[22610]: cluster 2024-08-31T08:47:19.576088+0000 mgr.a (mgr.14388) 17127 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:21 smithi191 bash[24992]: cluster 2024-08-31T08:47:19.576088+0000 mgr.a (mgr.14388) 17127 : cluster [DBG] pgmap v11873: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:47:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:23 smithi163 bash[24253]: cluster 2024-08-31T08:47:21.576866+0000 mgr.a (mgr.14388) 17128 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:47:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:23 smithi027 bash[22610]: cluster 2024-08-31T08:47:21.576866+0000 mgr.a (mgr.14388) 17128 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:47:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:23 smithi191 bash[24992]: cluster 2024-08-31T08:47:21.576866+0000 mgr.a (mgr.14388) 17128 : cluster [DBG] pgmap v11874: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:47:23.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:24.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:24.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:24.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:24.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:24.630 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:25 smithi163 bash[24253]: cluster 2024-08-31T08:47:23.578996+0000 mgr.a (mgr.14388) 17129 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:25 smithi163 bash[24253]: audit 2024-08-31T08:47:24.209110+0000 mgr.a (mgr.14388) 17130 : audit [DBG] from='client.369453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:25 smithi027 bash[22610]: cluster 2024-08-31T08:47:23.578996+0000 mgr.a (mgr.14388) 17129 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:25 smithi027 bash[22610]: audit 2024-08-31T08:47:24.209110+0000 mgr.a (mgr.14388) 17130 : audit [DBG] from='client.369453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:25 smithi191 bash[24992]: cluster 2024-08-31T08:47:23.578996+0000 mgr.a (mgr.14388) 17129 : cluster [DBG] pgmap v11875: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:25 smithi191 bash[24992]: audit 2024-08-31T08:47:24.209110+0000 mgr.a (mgr.14388) 17130 : audit [DBG] from='client.369453 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:27 smithi163 bash[24253]: cluster 2024-08-31T08:47:25.579985+0000 mgr.a (mgr.14388) 17131 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:27 smithi027 bash[22610]: cluster 2024-08-31T08:47:25.579985+0000 mgr.a (mgr.14388) 17131 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:27 smithi191 bash[24992]: cluster 2024-08-31T08:47:25.579985+0000 mgr.a (mgr.14388) 17131 : cluster [DBG] pgmap v11876: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:29 smithi163 bash[24253]: cluster 2024-08-31T08:47:27.580776+0000 mgr.a (mgr.14388) 17132 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:29 smithi027 bash[22610]: cluster 2024-08-31T08:47:27.580776+0000 mgr.a (mgr.14388) 17132 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:29 smithi191 bash[24992]: cluster 2024-08-31T08:47:27.580776+0000 mgr.a (mgr.14388) 17132 : cluster [DBG] pgmap v11877: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:29.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:29.632 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:29.632 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:30.383 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:30.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:30.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:30.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:30.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:31 smithi163 bash[24253]: cluster 2024-08-31T08:47:29.583000+0000 mgr.a (mgr.14388) 17133 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:31 smithi163 bash[24253]: audit 2024-08-31T08:47:29.965011+0000 mgr.a (mgr.14388) 17134 : audit [DBG] from='client.369528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:31 smithi027 bash[22610]: cluster 2024-08-31T08:47:29.583000+0000 mgr.a (mgr.14388) 17133 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:31 smithi027 bash[22610]: audit 2024-08-31T08:47:29.965011+0000 mgr.a (mgr.14388) 17134 : audit [DBG] from='client.369528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:31 smithi191 bash[24992]: cluster 2024-08-31T08:47:29.583000+0000 mgr.a (mgr.14388) 17133 : cluster [DBG] pgmap v11878: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:31 smithi191 bash[24992]: audit 2024-08-31T08:47:29.965011+0000 mgr.a (mgr.14388) 17134 : audit [DBG] from='client.369528 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:33 smithi163 bash[24253]: cluster 2024-08-31T08:47:31.583914+0000 mgr.a (mgr.14388) 17135 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:33 smithi027 bash[22610]: cluster 2024-08-31T08:47:31.583914+0000 mgr.a (mgr.14388) 17135 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:33 smithi191 bash[24992]: cluster 2024-08-31T08:47:31.583914+0000 mgr.a (mgr.14388) 17135 : cluster [DBG] pgmap v11879: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:35.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:35.385 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:35.385 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:35 smithi163 bash[24253]: cluster 2024-08-31T08:47:33.586114+0000 mgr.a (mgr.14388) 17136 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:35 smithi027 bash[22610]: cluster 2024-08-31T08:47:33.586114+0000 mgr.a (mgr.14388) 17136 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:35 smithi191 bash[24992]: cluster 2024-08-31T08:47:33.586114+0000 mgr.a (mgr.14388) 17136 : cluster [DBG] pgmap v11880: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:36.171 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:36.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:36.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:36.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:36.172 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:37 smithi163 bash[24253]: cluster 2024-08-31T08:47:35.586852+0000 mgr.a (mgr.14388) 17137 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:37 smithi163 bash[24253]: audit 2024-08-31T08:47:35.722349+0000 mgr.a (mgr.14388) 17138 : audit [DBG] from='client.369603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:37 smithi027 bash[22610]: cluster 2024-08-31T08:47:35.586852+0000 mgr.a (mgr.14388) 17137 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:37 smithi027 bash[22610]: audit 2024-08-31T08:47:35.722349+0000 mgr.a (mgr.14388) 17138 : audit [DBG] from='client.369603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:37 smithi191 bash[24992]: cluster 2024-08-31T08:47:35.586852+0000 mgr.a (mgr.14388) 17137 : cluster [DBG] pgmap v11881: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:37 smithi191 bash[24992]: audit 2024-08-31T08:47:35.722349+0000 mgr.a (mgr.14388) 17138 : audit [DBG] from='client.369603 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:39 smithi163 bash[24253]: cluster 2024-08-31T08:47:37.587841+0000 mgr.a (mgr.14388) 17139 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:39 smithi027 bash[22610]: cluster 2024-08-31T08:47:37.587841+0000 mgr.a (mgr.14388) 17139 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:39 smithi191 bash[24992]: cluster 2024-08-31T08:47:37.587841+0000 mgr.a (mgr.14388) 17139 : cluster [DBG] pgmap v11882: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:41.173 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:41.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:41.174 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:41 smithi163 bash[24253]: cluster 2024-08-31T08:47:39.590089+0000 mgr.a (mgr.14388) 17140 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:41 smithi027 bash[22610]: cluster 2024-08-31T08:47:39.590089+0000 mgr.a (mgr.14388) 17140 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:41 smithi191 bash[24992]: cluster 2024-08-31T08:47:39.590089+0000 mgr.a (mgr.14388) 17140 : cluster [DBG] pgmap v11883: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:41.954 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:41.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:43 smithi163 bash[24253]: audit 2024-08-31T08:47:41.508318+0000 mgr.a (mgr.14388) 17141 : audit [DBG] from='client.369681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:43 smithi163 bash[24253]: cluster 2024-08-31T08:47:41.591082+0000 mgr.a (mgr.14388) 17142 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:43 smithi027 bash[22610]: audit 2024-08-31T08:47:41.508318+0000 mgr.a (mgr.14388) 17141 : audit [DBG] from='client.369681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:43 smithi027 bash[22610]: cluster 2024-08-31T08:47:41.591082+0000 mgr.a (mgr.14388) 17142 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:43 smithi191 bash[24992]: audit 2024-08-31T08:47:41.508318+0000 mgr.a (mgr.14388) 17141 : audit [DBG] from='client.369681 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:43 smithi191 bash[24992]: cluster 2024-08-31T08:47:41.591082+0000 mgr.a (mgr.14388) 17142 : cluster [DBG] pgmap v11884: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:45 smithi163 bash[24253]: cluster 2024-08-31T08:47:43.593439+0000 mgr.a (mgr.14388) 17143 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:45 smithi027 bash[22610]: cluster 2024-08-31T08:47:43.593439+0000 mgr.a (mgr.14388) 17143 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:45 smithi191 bash[24992]: cluster 2024-08-31T08:47:43.593439+0000 mgr.a (mgr.14388) 17143 : cluster [DBG] pgmap v11885: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:46.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:46.956 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:46.956 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:47 smithi163 bash[24253]: cluster 2024-08-31T08:47:45.594381+0000 mgr.a (mgr.14388) 17144 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:47 smithi027 bash[22610]: cluster 2024-08-31T08:47:45.594381+0000 mgr.a (mgr.14388) 17144 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:47 smithi191 bash[24992]: cluster 2024-08-31T08:47:45.594381+0000 mgr.a (mgr.14388) 17144 : cluster [DBG] pgmap v11886: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:47.739 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:47.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:47.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:47.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:47.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:49 smithi163 bash[24253]: audit 2024-08-31T08:47:47.293625+0000 mgr.a (mgr.14388) 17145 : audit [DBG] from='client.369759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:49 smithi163 bash[24253]: cluster 2024-08-31T08:47:47.594972+0000 mgr.a (mgr.14388) 17146 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:49 smithi027 bash[22610]: audit 2024-08-31T08:47:47.293625+0000 mgr.a (mgr.14388) 17145 : audit [DBG] from='client.369759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:49 smithi027 bash[22610]: cluster 2024-08-31T08:47:47.594972+0000 mgr.a (mgr.14388) 17146 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:49 smithi191 bash[24992]: audit 2024-08-31T08:47:47.293625+0000 mgr.a (mgr.14388) 17145 : audit [DBG] from='client.369759 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:49 smithi191 bash[24992]: cluster 2024-08-31T08:47:47.594972+0000 mgr.a (mgr.14388) 17146 : cluster [DBG] pgmap v11887: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:51 smithi163 bash[24253]: cluster 2024-08-31T08:47:49.597185+0000 mgr.a (mgr.14388) 17147 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:51.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:51 smithi027 bash[22610]: cluster 2024-08-31T08:47:49.597185+0000 mgr.a (mgr.14388) 17147 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:51 smithi191 bash[24992]: cluster 2024-08-31T08:47:49.597185+0000 mgr.a (mgr.14388) 17147 : cluster [DBG] pgmap v11888: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:47:52.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:53 smithi163 bash[24253]: cluster 2024-08-31T08:47:51.598001+0000 mgr.a (mgr.14388) 17148 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:53 smithi027 bash[22610]: cluster 2024-08-31T08:47:51.598001+0000 mgr.a (mgr.14388) 17148 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:53.495 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:53 smithi191 bash[24992]: cluster 2024-08-31T08:47:51.598001+0000 mgr.a (mgr.14388) 17148 : cluster [DBG] pgmap v11889: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:54 smithi163 bash[24253]: audit 2024-08-31T08:47:53.071013+0000 mgr.a (mgr.14388) 17149 : audit [DBG] from='client.369837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:54 smithi027 bash[22610]: audit 2024-08-31T08:47:53.071013+0000 mgr.a (mgr.14388) 17149 : audit [DBG] from='client.369837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:54 smithi191 bash[24992]: audit 2024-08-31T08:47:53.071013+0000 mgr.a (mgr.14388) 17149 : audit [DBG] from='client.369837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:47:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:55 smithi163 bash[24253]: cluster 2024-08-31T08:47:53.600812+0000 mgr.a (mgr.14388) 17150 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:55 smithi027 bash[22610]: cluster 2024-08-31T08:47:53.600812+0000 mgr.a (mgr.14388) 17150 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:55 smithi191 bash[24992]: cluster 2024-08-31T08:47:53.600812+0000 mgr.a (mgr.14388) 17150 : cluster [DBG] pgmap v11890: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:47:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:57 smithi027 bash[22610]: cluster 2024-08-31T08:47:55.601599+0000 mgr.a (mgr.14388) 17151 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:47:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:57 smithi191 bash[24992]: cluster 2024-08-31T08:47:55.601599+0000 mgr.a (mgr.14388) 17151 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:47:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:57 smithi163 bash[24253]: cluster 2024-08-31T08:47:55.601599+0000 mgr.a (mgr.14388) 17151 : cluster [DBG] pgmap v11891: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:47:58.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:47:58.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:47:58.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:47:59.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:47:59.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:47:59.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:47:59.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:47:59.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:47:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:47:59 smithi027 bash[22610]: cluster 2024-08-31T08:47:57.602384+0000 mgr.a (mgr.14388) 17152 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:47:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:47:59 smithi191 bash[24992]: cluster 2024-08-31T08:47:57.602384+0000 mgr.a (mgr.14388) 17152 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:47:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:47:59 smithi163 bash[24253]: cluster 2024-08-31T08:47:57.602384+0000 mgr.a (mgr.14388) 17152 : cluster [DBG] pgmap v11892: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:48:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:00 smithi027 bash[22610]: audit 2024-08-31T08:47:58.825372+0000 mgr.a (mgr.14388) 17153 : audit [DBG] from='client.369909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:00 smithi191 bash[24992]: audit 2024-08-31T08:47:58.825372+0000 mgr.a (mgr.14388) 17153 : audit [DBG] from='client.369909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:00.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:00 smithi163 bash[24253]: audit 2024-08-31T08:47:58.825372+0000 mgr.a (mgr.14388) 17153 : audit [DBG] from='client.369909 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:01 smithi027 bash[22610]: cluster 2024-08-31T08:47:59.605123+0000 mgr.a (mgr.14388) 17154 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:01 smithi191 bash[24992]: cluster 2024-08-31T08:47:59.605123+0000 mgr.a (mgr.14388) 17154 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:01 smithi163 bash[24253]: cluster 2024-08-31T08:47:59.605123+0000 mgr.a (mgr.14388) 17154 : cluster [DBG] pgmap v11893: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:03 smithi027 bash[22610]: cluster 2024-08-31T08:48:01.605907+0000 mgr.a (mgr.14388) 17155 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:03 smithi191 bash[24992]: cluster 2024-08-31T08:48:01.605907+0000 mgr.a (mgr.14388) 17155 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:03 smithi163 bash[24253]: cluster 2024-08-31T08:48:01.605907+0000 mgr.a (mgr.14388) 17155 : cluster [DBG] pgmap v11894: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:04.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:48:04.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:48:04.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:48:05.030 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:48:05.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:48:05.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:48:05.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:48:05.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:48:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:05 smithi027 bash[22610]: cluster 2024-08-31T08:48:03.607934+0000 mgr.a (mgr.14388) 17156 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:05 smithi191 bash[24992]: cluster 2024-08-31T08:48:03.607934+0000 mgr.a (mgr.14388) 17156 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:05 smithi163 bash[24253]: cluster 2024-08-31T08:48:03.607934+0000 mgr.a (mgr.14388) 17156 : cluster [DBG] pgmap v11895: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:06 smithi191 bash[24992]: audit 2024-08-31T08:48:04.590358+0000 mgr.a (mgr.14388) 17157 : audit [DBG] from='client.369987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:06 smithi163 bash[24253]: audit 2024-08-31T08:48:04.590358+0000 mgr.a (mgr.14388) 17157 : audit [DBG] from='client.369987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:06 smithi027 bash[22610]: audit 2024-08-31T08:48:04.590358+0000 mgr.a (mgr.14388) 17157 : audit [DBG] from='client.369987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:07 smithi191 bash[24992]: cluster 2024-08-31T08:48:05.608903+0000 mgr.a (mgr.14388) 17158 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:07 smithi191 bash[24992]: audit 2024-08-31T08:48:06.827735+0000 mon.a (mon.0) 3134 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:48:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:07 smithi163 bash[24253]: cluster 2024-08-31T08:48:05.608903+0000 mgr.a (mgr.14388) 17158 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:07 smithi163 bash[24253]: audit 2024-08-31T08:48:06.827735+0000 mon.a (mon.0) 3134 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:48:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:07 smithi027 bash[22610]: cluster 2024-08-31T08:48:05.608903+0000 mgr.a (mgr.14388) 17158 : cluster [DBG] pgmap v11896: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:07 smithi027 bash[22610]: audit 2024-08-31T08:48:06.827735+0000 mon.a (mon.0) 3134 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:48:09.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:48:08 smithi027 bash[22863]: debug 2024-08-31T08:48:08.937+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:48:09.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:48:08 smithi027 bash[22863]: debug 2024-08-31T08:48:08.941+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:48:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: cluster 2024-08-31T08:48:07.609435+0000 mgr.a (mgr.14388) 17159 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.152789+0000 mon.a (mon.0) 3135 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.158835+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.181076+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.186550+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.199711+0000 mon.a (mon.0) 3139 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.203324+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.204478+0000 mon.a (mon.0) 3141 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:48:09.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.205292+0000 mon.a (mon.0) 3142 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:48:09.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.209983+0000 mon.a (mon.0) 3143 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.212624+0000 mon.a (mon.0) 3144 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:48:09.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:09 smithi027 bash[22610]: audit 2024-08-31T08:48:08.213856+0000 mgr.a (mgr.14388) 17160 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:48:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: cluster 2024-08-31T08:48:07.609435+0000 mgr.a (mgr.14388) 17159 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.152789+0000 mon.a (mon.0) 3135 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.158835+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.181076+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.186550+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.199711+0000 mon.a (mon.0) 3139 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.203324+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.204478+0000 mon.a (mon.0) 3141 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:48:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.205292+0000 mon.a (mon.0) 3142 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:48:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.209983+0000 mon.a (mon.0) 3143 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.212624+0000 mon.a (mon.0) 3144 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:48:09.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:09 smithi163 bash[24253]: audit 2024-08-31T08:48:08.213856+0000 mgr.a (mgr.14388) 17160 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:48:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: cluster 2024-08-31T08:48:07.609435+0000 mgr.a (mgr.14388) 17159 : cluster [DBG] pgmap v11897: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.152789+0000 mon.a (mon.0) 3135 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.158835+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.181076+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.186550+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.199711+0000 mon.a (mon.0) 3139 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.203324+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.204478+0000 mon.a (mon.0) 3141 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:48:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.205292+0000 mon.a (mon.0) 3142 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:48:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.209983+0000 mon.a (mon.0) 3143 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:48:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.212624+0000 mon.a (mon.0) 3144 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:48:09.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:09 smithi191 bash[24992]: audit 2024-08-31T08:48:08.213856+0000 mgr.a (mgr.14388) 17160 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:48:10.031 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:48:10.032 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:48:10.032 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:48:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:10 smithi163 bash[24253]: audit 2024-08-31T08:48:08.941634+0000 mgr.a (mgr.14388) 17161 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:48:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:10 smithi163 bash[24253]: cephadm 2024-08-31T08:48:08.943042+0000 mgr.a (mgr.14388) 17162 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:48:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:10 smithi027 bash[22610]: audit 2024-08-31T08:48:08.941634+0000 mgr.a (mgr.14388) 17161 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:48:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:10 smithi027 bash[22610]: cephadm 2024-08-31T08:48:08.943042+0000 mgr.a (mgr.14388) 17162 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:48:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:10 smithi191 bash[24992]: audit 2024-08-31T08:48:08.941634+0000 mgr.a (mgr.14388) 17161 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:48:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:10 smithi191 bash[24992]: cephadm 2024-08-31T08:48:08.943042+0000 mgr.a (mgr.14388) 17162 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:48:10.798 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:48:10.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:48:10.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:48:10.798 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:48:10.799 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:48:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:11 smithi163 bash[24253]: cluster 2024-08-31T08:48:09.612256+0000 mgr.a (mgr.14388) 17163 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:11 smithi027 bash[22610]: cluster 2024-08-31T08:48:09.612256+0000 mgr.a (mgr.14388) 17163 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:11 smithi191 bash[24992]: cluster 2024-08-31T08:48:09.612256+0000 mgr.a (mgr.14388) 17163 : cluster [DBG] pgmap v11898: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:12 smithi163 bash[24253]: audit 2024-08-31T08:48:10.362961+0000 mgr.a (mgr.14388) 17164 : audit [DBG] from='client.370170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:12 smithi027 bash[22610]: audit 2024-08-31T08:48:10.362961+0000 mgr.a (mgr.14388) 17164 : audit [DBG] from='client.370170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:12 smithi191 bash[24992]: audit 2024-08-31T08:48:10.362961+0000 mgr.a (mgr.14388) 17164 : audit [DBG] from='client.370170 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:13.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:13 smithi163 bash[24253]: cluster 2024-08-31T08:48:11.613264+0000 mgr.a (mgr.14388) 17165 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:13 smithi027 bash[22610]: cluster 2024-08-31T08:48:11.613264+0000 mgr.a (mgr.14388) 17165 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:13 smithi191 bash[24992]: cluster 2024-08-31T08:48:11.613264+0000 mgr.a (mgr.14388) 17165 : cluster [DBG] pgmap v11899: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:15 smithi163 bash[24253]: cluster 2024-08-31T08:48:13.615523+0000 mgr.a (mgr.14388) 17166 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:15 smithi027 bash[22610]: cluster 2024-08-31T08:48:13.615523+0000 mgr.a (mgr.14388) 17166 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:15 smithi191 bash[24992]: cluster 2024-08-31T08:48:13.615523+0000 mgr.a (mgr.14388) 17166 : cluster [DBG] pgmap v11900: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:15.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:48:15.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:48:15.801 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:48:16.585 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:48:16.585 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:48:16.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:48:16.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:48:16.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:48:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:17 smithi163 bash[24253]: cluster 2024-08-31T08:48:15.616317+0000 mgr.a (mgr.14388) 17167 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:17 smithi163 bash[24253]: audit 2024-08-31T08:48:16.142903+0000 mgr.a (mgr.14388) 17168 : audit [DBG] from='client.370245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:17 smithi027 bash[22610]: cluster 2024-08-31T08:48:15.616317+0000 mgr.a (mgr.14388) 17167 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:17 smithi027 bash[22610]: audit 2024-08-31T08:48:16.142903+0000 mgr.a (mgr.14388) 17168 : audit [DBG] from='client.370245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:17 smithi191 bash[24992]: cluster 2024-08-31T08:48:15.616317+0000 mgr.a (mgr.14388) 17167 : cluster [DBG] pgmap v11901: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:17 smithi191 bash[24992]: audit 2024-08-31T08:48:16.142903+0000 mgr.a (mgr.14388) 17168 : audit [DBG] from='client.370245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:19 smithi163 bash[24253]: cluster 2024-08-31T08:48:17.617455+0000 mgr.a (mgr.14388) 17169 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:19 smithi027 bash[22610]: cluster 2024-08-31T08:48:17.617455+0000 mgr.a (mgr.14388) 17169 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:19 smithi191 bash[24992]: cluster 2024-08-31T08:48:17.617455+0000 mgr.a (mgr.14388) 17169 : cluster [DBG] pgmap v11902: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:21 smithi163 bash[24253]: cluster 2024-08-31T08:48:19.619772+0000 mgr.a (mgr.14388) 17170 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:21 smithi027 bash[22610]: cluster 2024-08-31T08:48:19.619772+0000 mgr.a (mgr.14388) 17170 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:21 smithi191 bash[24992]: cluster 2024-08-31T08:48:19.619772+0000 mgr.a (mgr.14388) 17170 : cluster [DBG] pgmap v11903: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:21.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:48:21.587 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:48:21.588 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:48:22.365 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:48:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:48:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:48:22.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:48:22.366 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:48:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:23 smithi163 bash[24253]: cluster 2024-08-31T08:48:21.620543+0000 mgr.a (mgr.14388) 17171 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:23 smithi163 bash[24253]: audit 2024-08-31T08:48:21.929163+0000 mgr.a (mgr.14388) 17172 : audit [DBG] from='client.370323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:23 smithi027 bash[22610]: cluster 2024-08-31T08:48:21.620543+0000 mgr.a (mgr.14388) 17171 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:23 smithi027 bash[22610]: audit 2024-08-31T08:48:21.929163+0000 mgr.a (mgr.14388) 17172 : audit [DBG] from='client.370323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:23 smithi191 bash[24992]: cluster 2024-08-31T08:48:21.620543+0000 mgr.a (mgr.14388) 17171 : cluster [DBG] pgmap v11904: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:23 smithi191 bash[24992]: audit 2024-08-31T08:48:21.929163+0000 mgr.a (mgr.14388) 17172 : audit [DBG] from='client.370323 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:25 smithi027 bash[22610]: cluster 2024-08-31T08:48:23.622927+0000 mgr.a (mgr.14388) 17173 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:25 smithi191 bash[24992]: cluster 2024-08-31T08:48:23.622927+0000 mgr.a (mgr.14388) 17173 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:25 smithi163 bash[24253]: cluster 2024-08-31T08:48:23.622927+0000 mgr.a (mgr.14388) 17173 : cluster [DBG] pgmap v11905: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:48:27.367 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:48:27.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:48:27.367 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:48:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:27 smithi027 bash[22610]: cluster 2024-08-31T08:48:25.623649+0000 mgr.a (mgr.14388) 17174 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:27 smithi191 bash[24992]: cluster 2024-08-31T08:48:25.623649+0000 mgr.a (mgr.14388) 17174 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:27 smithi163 bash[24253]: cluster 2024-08-31T08:48:25.623649+0000 mgr.a (mgr.14388) 17174 : cluster [DBG] pgmap v11906: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:28.148 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:48:28.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:48:28.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:48:28.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:48:28.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:48:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:29 smithi027 bash[22610]: cluster 2024-08-31T08:48:27.624371+0000 mgr.a (mgr.14388) 17175 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:29 smithi027 bash[22610]: audit 2024-08-31T08:48:27.706654+0000 mgr.a (mgr.14388) 17176 : audit [DBG] from='client.370398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:29 smithi191 bash[24992]: cluster 2024-08-31T08:48:27.624371+0000 mgr.a (mgr.14388) 17175 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:29 smithi191 bash[24992]: audit 2024-08-31T08:48:27.706654+0000 mgr.a (mgr.14388) 17176 : audit [DBG] from='client.370398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:29 smithi163 bash[24253]: cluster 2024-08-31T08:48:27.624371+0000 mgr.a (mgr.14388) 17175 : cluster [DBG] pgmap v11907: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:29 smithi163 bash[24253]: audit 2024-08-31T08:48:27.706654+0000 mgr.a (mgr.14388) 17176 : audit [DBG] from='client.370398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:31 smithi027 bash[22610]: cluster 2024-08-31T08:48:29.627149+0000 mgr.a (mgr.14388) 17177 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:31 smithi191 bash[24992]: cluster 2024-08-31T08:48:29.627149+0000 mgr.a (mgr.14388) 17177 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:31 smithi163 bash[24253]: cluster 2024-08-31T08:48:29.627149+0000 mgr.a (mgr.14388) 17177 : cluster [DBG] pgmap v11908: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:33.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:48:33.151 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:48:33.151 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:48:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:33 smithi027 bash[22610]: cluster 2024-08-31T08:48:31.627932+0000 mgr.a (mgr.14388) 17178 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:33 smithi191 bash[24992]: cluster 2024-08-31T08:48:31.627932+0000 mgr.a (mgr.14388) 17178 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:33 smithi163 bash[24253]: cluster 2024-08-31T08:48:31.627932+0000 mgr.a (mgr.14388) 17178 : cluster [DBG] pgmap v11909: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:33.932 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:48:33.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:48:33.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:48:33.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:48:33.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:48:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:35 smithi027 bash[22610]: audit 2024-08-31T08:48:33.484858+0000 mgr.a (mgr.14388) 17179 : audit [DBG] from='client.370476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:35 smithi027 bash[22610]: cluster 2024-08-31T08:48:33.634024+0000 mgr.a (mgr.14388) 17180 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:35 smithi191 bash[24992]: audit 2024-08-31T08:48:33.484858+0000 mgr.a (mgr.14388) 17179 : audit [DBG] from='client.370476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:35 smithi191 bash[24992]: cluster 2024-08-31T08:48:33.634024+0000 mgr.a (mgr.14388) 17180 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:35 smithi163 bash[24253]: audit 2024-08-31T08:48:33.484858+0000 mgr.a (mgr.14388) 17179 : audit [DBG] from='client.370476 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:35 smithi163 bash[24253]: cluster 2024-08-31T08:48:33.634024+0000 mgr.a (mgr.14388) 17180 : cluster [DBG] pgmap v11910: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:37 smithi191 bash[24992]: cluster 2024-08-31T08:48:35.634965+0000 mgr.a (mgr.14388) 17181 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:37 smithi163 bash[24253]: cluster 2024-08-31T08:48:35.634965+0000 mgr.a (mgr.14388) 17181 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:37 smithi027 bash[22610]: cluster 2024-08-31T08:48:35.634965+0000 mgr.a (mgr.14388) 17181 : cluster [DBG] pgmap v11911: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:38.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:48:38.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:48:38.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:48:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:39 smithi191 bash[24992]: cluster 2024-08-31T08:48:37.635762+0000 mgr.a (mgr.14388) 17182 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:39 smithi163 bash[24253]: cluster 2024-08-31T08:48:37.635762+0000 mgr.a (mgr.14388) 17182 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:39.708 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:48:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:48:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:48:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:48:39.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:48:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:39 smithi027 bash[22610]: cluster 2024-08-31T08:48:37.635762+0000 mgr.a (mgr.14388) 17182 : cluster [DBG] pgmap v11912: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:48:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:40 smithi191 bash[24992]: audit 2024-08-31T08:48:39.271080+0000 mgr.a (mgr.14388) 17183 : audit [DBG] from='client.370554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:40 smithi163 bash[24253]: audit 2024-08-31T08:48:39.271080+0000 mgr.a (mgr.14388) 17183 : audit [DBG] from='client.370554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:40 smithi027 bash[22610]: audit 2024-08-31T08:48:39.271080+0000 mgr.a (mgr.14388) 17183 : audit [DBG] from='client.370554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:41 smithi191 bash[24992]: cluster 2024-08-31T08:48:39.637422+0000 mgr.a (mgr.14388) 17184 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:41 smithi163 bash[24253]: cluster 2024-08-31T08:48:39.637422+0000 mgr.a (mgr.14388) 17184 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:41 smithi027 bash[22610]: cluster 2024-08-31T08:48:39.637422+0000 mgr.a (mgr.14388) 17184 : cluster [DBG] pgmap v11913: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:43 smithi191 bash[24992]: cluster 2024-08-31T08:48:41.638184+0000 mgr.a (mgr.14388) 17185 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:43 smithi163 bash[24253]: cluster 2024-08-31T08:48:41.638184+0000 mgr.a (mgr.14388) 17185 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:43 smithi027 bash[22610]: cluster 2024-08-31T08:48:41.638184+0000 mgr.a (mgr.14388) 17185 : cluster [DBG] pgmap v11914: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:44.709 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:48:44.710 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:48:44.710 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:48:45.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:48:45.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:48:45.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:48:45.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:48:45.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:48:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:45 smithi191 bash[24992]: cluster 2024-08-31T08:48:43.640231+0000 mgr.a (mgr.14388) 17186 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:45 smithi163 bash[24253]: cluster 2024-08-31T08:48:43.640231+0000 mgr.a (mgr.14388) 17186 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:45 smithi027 bash[22610]: cluster 2024-08-31T08:48:43.640231+0000 mgr.a (mgr.14388) 17186 : cluster [DBG] pgmap v11915: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:46 smithi191 bash[24992]: audit 2024-08-31T08:48:45.045299+0000 mgr.a (mgr.14388) 17187 : audit [DBG] from='client.370629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:46 smithi163 bash[24253]: audit 2024-08-31T08:48:45.045299+0000 mgr.a (mgr.14388) 17187 : audit [DBG] from='client.370629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:46 smithi027 bash[22610]: audit 2024-08-31T08:48:45.045299+0000 mgr.a (mgr.14388) 17187 : audit [DBG] from='client.370629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:47 smithi191 bash[24992]: cluster 2024-08-31T08:48:45.641164+0000 mgr.a (mgr.14388) 17188 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:47 smithi163 bash[24253]: cluster 2024-08-31T08:48:45.641164+0000 mgr.a (mgr.14388) 17188 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:47 smithi027 bash[22610]: cluster 2024-08-31T08:48:45.641164+0000 mgr.a (mgr.14388) 17188 : cluster [DBG] pgmap v11916: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:49 smithi191 bash[24992]: cluster 2024-08-31T08:48:47.641974+0000 mgr.a (mgr.14388) 17189 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:49 smithi163 bash[24253]: cluster 2024-08-31T08:48:47.641974+0000 mgr.a (mgr.14388) 17189 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:49 smithi027 bash[22610]: cluster 2024-08-31T08:48:47.641974+0000 mgr.a (mgr.14388) 17189 : cluster [DBG] pgmap v11917: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:50.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:48:50.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:48:51.275 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:48:51.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:48:51.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:48:51.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:48:51.276 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:48:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:51 smithi191 bash[24992]: cluster 2024-08-31T08:48:49.644196+0000 mgr.a (mgr.14388) 17190 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:51 smithi163 bash[24253]: cluster 2024-08-31T08:48:49.644196+0000 mgr.a (mgr.14388) 17190 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:51 smithi027 bash[22610]: cluster 2024-08-31T08:48:49.644196+0000 mgr.a (mgr.14388) 17190 : cluster [DBG] pgmap v11918: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:52 smithi191 bash[24992]: audit 2024-08-31T08:48:50.823838+0000 mgr.a (mgr.14388) 17191 : audit [DBG] from='client.370704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:52 smithi163 bash[24253]: audit 2024-08-31T08:48:50.823838+0000 mgr.a (mgr.14388) 17191 : audit [DBG] from='client.370704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:52 smithi027 bash[22610]: audit 2024-08-31T08:48:50.823838+0000 mgr.a (mgr.14388) 17191 : audit [DBG] from='client.370704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:53 smithi163 bash[24253]: cluster 2024-08-31T08:48:51.645186+0000 mgr.a (mgr.14388) 17192 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:53 smithi027 bash[22610]: cluster 2024-08-31T08:48:51.645186+0000 mgr.a (mgr.14388) 17192 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:53 smithi191 bash[24992]: cluster 2024-08-31T08:48:51.645186+0000 mgr.a (mgr.14388) 17192 : cluster [DBG] pgmap v11919: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:54.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:54 smithi163 bash[24253]: cluster 2024-08-31T08:48:53.647412+0000 mgr.a (mgr.14388) 17193 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:54 smithi027 bash[22610]: cluster 2024-08-31T08:48:53.647412+0000 mgr.a (mgr.14388) 17193 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:54 smithi191 bash[24992]: cluster 2024-08-31T08:48:53.647412+0000 mgr.a (mgr.14388) 17193 : cluster [DBG] pgmap v11920: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:48:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:48:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:48:56.278 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:48:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:56 smithi027 bash[22610]: cluster 2024-08-31T08:48:55.648190+0000 mgr.a (mgr.14388) 17194 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:56 smithi191 bash[24992]: cluster 2024-08-31T08:48:55.648190+0000 mgr.a (mgr.14388) 17194 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:57.047 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:48:57.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:48:57.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:48:57.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:48:57.048 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:48:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:56 smithi163 bash[24253]: cluster 2024-08-31T08:48:55.648190+0000 mgr.a (mgr.14388) 17194 : cluster [DBG] pgmap v11921: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:57 smithi027 bash[22610]: audit 2024-08-31T08:48:56.612198+0000 mgr.a (mgr.14388) 17195 : audit [DBG] from='client.370782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:57 smithi191 bash[24992]: audit 2024-08-31T08:48:56.612198+0000 mgr.a (mgr.14388) 17195 : audit [DBG] from='client.370782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:58.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:57 smithi163 bash[24253]: audit 2024-08-31T08:48:56.612198+0000 mgr.a (mgr.14388) 17195 : audit [DBG] from='client.370782 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:48:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:48:58 smithi027 bash[22610]: cluster 2024-08-31T08:48:57.649156+0000 mgr.a (mgr.14388) 17196 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:48:58 smithi191 bash[24992]: cluster 2024-08-31T08:48:57.649156+0000 mgr.a (mgr.14388) 17196 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:48:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:48:58 smithi163 bash[24253]: cluster 2024-08-31T08:48:57.649156+0000 mgr.a (mgr.14388) 17196 : cluster [DBG] pgmap v11922: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:00 smithi027 bash[22610]: cluster 2024-08-31T08:48:59.651445+0000 mgr.a (mgr.14388) 17197 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:00 smithi191 bash[24992]: cluster 2024-08-31T08:48:59.651445+0000 mgr.a (mgr.14388) 17197 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:00 smithi163 bash[24253]: cluster 2024-08-31T08:48:59.651445+0000 mgr.a (mgr.14388) 17197 : cluster [DBG] pgmap v11923: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:02.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:02.049 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:02.049 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:49:02.828 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:49:02.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:49:02.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:49:02.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:49:02.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:49:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:02 smithi027 bash[22610]: cluster 2024-08-31T08:49:01.652232+0000 mgr.a (mgr.14388) 17198 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:02 smithi191 bash[24992]: cluster 2024-08-31T08:49:01.652232+0000 mgr.a (mgr.14388) 17198 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:02 smithi163 bash[24253]: cluster 2024-08-31T08:49:01.652232+0000 mgr.a (mgr.14388) 17198 : cluster [DBG] pgmap v11924: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:03 smithi027 bash[22610]: audit 2024-08-31T08:49:02.383399+0000 mgr.a (mgr.14388) 17199 : audit [DBG] from='client.370860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:03 smithi191 bash[24992]: audit 2024-08-31T08:49:02.383399+0000 mgr.a (mgr.14388) 17199 : audit [DBG] from='client.370860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:04.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:03 smithi163 bash[24253]: audit 2024-08-31T08:49:02.383399+0000 mgr.a (mgr.14388) 17199 : audit [DBG] from='client.370860 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:04 smithi027 bash[22610]: cluster 2024-08-31T08:49:03.654539+0000 mgr.a (mgr.14388) 17200 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:04 smithi191 bash[24992]: cluster 2024-08-31T08:49:03.654539+0000 mgr.a (mgr.14388) 17200 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:04 smithi163 bash[24253]: cluster 2024-08-31T08:49:03.654539+0000 mgr.a (mgr.14388) 17200 : cluster [DBG] pgmap v11925: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:06 smithi191 bash[24992]: cluster 2024-08-31T08:49:05.655345+0000 mgr.a (mgr.14388) 17201 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:06 smithi163 bash[24253]: cluster 2024-08-31T08:49:05.655345+0000 mgr.a (mgr.14388) 17201 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:06 smithi027 bash[22610]: cluster 2024-08-31T08:49:05.655345+0000 mgr.a (mgr.14388) 17201 : cluster [DBG] pgmap v11926: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:07.830 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:07.831 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:07.831 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:49:08.621 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:49:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:49:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:49:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:49:08.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:49:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:08 smithi191 bash[24992]: cluster 2024-08-31T08:49:07.656106+0000 mgr.a (mgr.14388) 17202 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:08 smithi191 bash[24992]: audit 2024-08-31T08:49:08.170224+0000 mgr.a (mgr.14388) 17203 : audit [DBG] from='client.370938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:08 smithi163 bash[24253]: cluster 2024-08-31T08:49:07.656106+0000 mgr.a (mgr.14388) 17202 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:09.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:08 smithi163 bash[24253]: audit 2024-08-31T08:49:08.170224+0000 mgr.a (mgr.14388) 17203 : audit [DBG] from='client.370938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:08 smithi027 bash[22610]: cluster 2024-08-31T08:49:07.656106+0000 mgr.a (mgr.14388) 17202 : cluster [DBG] pgmap v11927: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:08 smithi027 bash[22610]: audit 2024-08-31T08:49:08.170224+0000 mgr.a (mgr.14388) 17203 : audit [DBG] from='client.370938 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:09 smithi191 bash[24992]: audit 2024-08-31T08:49:09.001667+0000 mon.a (mon.0) 3145 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:49:10.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:09 smithi163 bash[24253]: audit 2024-08-31T08:49:09.001667+0000 mon.a (mon.0) 3145 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:49:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:09 smithi027 bash[22610]: audit 2024-08-31T08:49:09.001667+0000 mon.a (mon.0) 3145 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:49:10.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:49:10 smithi027 bash[22863]: debug 2024-08-31T08:49:10.644+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:49:10.984 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:49:10 smithi027 bash[22863]: debug 2024-08-31T08:49:10.644+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:49:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:10 smithi027 bash[22610]: cluster 2024-08-31T08:49:09.658521+0000 mgr.a (mgr.14388) 17204 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:10 smithi027 bash[22610]: audit 2024-08-31T08:49:09.842702+0000 mon.a (mon.0) 3146 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:49:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:10 smithi027 bash[22610]: audit 2024-08-31T08:49:09.844077+0000 mon.a (mon.0) 3147 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:49:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:10 smithi027 bash[22610]: audit 2024-08-31T08:49:09.853659+0000 mon.a (mon.0) 3148 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:49:10.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:10 smithi027 bash[22610]: audit 2024-08-31T08:49:09.858446+0000 mon.a (mon.0) 3149 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:49:10.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:10 smithi027 bash[22610]: audit 2024-08-31T08:49:09.860840+0000 mgr.a (mgr.14388) 17205 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:49:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:10 smithi191 bash[24992]: cluster 2024-08-31T08:49:09.658521+0000 mgr.a (mgr.14388) 17204 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:10 smithi191 bash[24992]: audit 2024-08-31T08:49:09.842702+0000 mon.a (mon.0) 3146 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:49:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:10 smithi191 bash[24992]: audit 2024-08-31T08:49:09.844077+0000 mon.a (mon.0) 3147 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:49:11.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:10 smithi191 bash[24992]: audit 2024-08-31T08:49:09.853659+0000 mon.a (mon.0) 3148 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:49:11.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:10 smithi191 bash[24992]: audit 2024-08-31T08:49:09.858446+0000 mon.a (mon.0) 3149 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:49:11.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:10 smithi191 bash[24992]: audit 2024-08-31T08:49:09.860840+0000 mgr.a (mgr.14388) 17205 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:49:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:10 smithi163 bash[24253]: cluster 2024-08-31T08:49:09.658521+0000 mgr.a (mgr.14388) 17204 : cluster [DBG] pgmap v11928: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:10 smithi163 bash[24253]: audit 2024-08-31T08:49:09.842702+0000 mon.a (mon.0) 3146 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:49:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:10 smithi163 bash[24253]: audit 2024-08-31T08:49:09.844077+0000 mon.a (mon.0) 3147 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:49:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:10 smithi163 bash[24253]: audit 2024-08-31T08:49:09.853659+0000 mon.a (mon.0) 3148 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:49:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:10 smithi163 bash[24253]: audit 2024-08-31T08:49:09.858446+0000 mon.a (mon.0) 3149 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:49:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:10 smithi163 bash[24253]: audit 2024-08-31T08:49:09.860840+0000 mgr.a (mgr.14388) 17205 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:49:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:11 smithi191 bash[24992]: audit 2024-08-31T08:49:10.647474+0000 mgr.a (mgr.14388) 17206 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:49:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:11 smithi191 bash[24992]: cephadm 2024-08-31T08:49:10.648773+0000 mgr.a (mgr.14388) 17207 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:49:12.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:11 smithi163 bash[24253]: audit 2024-08-31T08:49:10.647474+0000 mgr.a (mgr.14388) 17206 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:49:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:11 smithi163 bash[24253]: cephadm 2024-08-31T08:49:10.648773+0000 mgr.a (mgr.14388) 17207 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:49:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:11 smithi027 bash[22610]: audit 2024-08-31T08:49:10.647474+0000 mgr.a (mgr.14388) 17206 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:49:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:11 smithi027 bash[22610]: cephadm 2024-08-31T08:49:10.648773+0000 mgr.a (mgr.14388) 17207 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:49:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:12 smithi191 bash[24992]: cluster 2024-08-31T08:49:11.659419+0000 mgr.a (mgr.14388) 17208 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:49:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:12 smithi163 bash[24253]: cluster 2024-08-31T08:49:11.659419+0000 mgr.a (mgr.14388) 17208 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:49:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:12 smithi027 bash[22610]: cluster 2024-08-31T08:49:11.659419+0000 mgr.a (mgr.14388) 17208 : cluster [DBG] pgmap v11929: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:49:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:13.624 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:49:14.383 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:49:14.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:49:14.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:49:14.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:49:14.383 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:49:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:14 smithi191 bash[24992]: cluster 2024-08-31T08:49:13.660982+0000 mgr.a (mgr.14388) 17209 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:14 smithi191 bash[24992]: audit 2024-08-31T08:49:13.958491+0000 mgr.a (mgr.14388) 17210 : audit [DBG] from='client.371124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:14 smithi163 bash[24253]: cluster 2024-08-31T08:49:13.660982+0000 mgr.a (mgr.14388) 17209 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:14 smithi163 bash[24253]: audit 2024-08-31T08:49:13.958491+0000 mgr.a (mgr.14388) 17210 : audit [DBG] from='client.371124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:14 smithi027 bash[22610]: cluster 2024-08-31T08:49:13.660982+0000 mgr.a (mgr.14388) 17209 : cluster [DBG] pgmap v11930: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:14 smithi027 bash[22610]: audit 2024-08-31T08:49:13.958491+0000 mgr.a (mgr.14388) 17210 : audit [DBG] from='client.371124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:16 smithi191 bash[24992]: cluster 2024-08-31T08:49:15.661841+0000 mgr.a (mgr.14388) 17211 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:49:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:16 smithi163 bash[24253]: cluster 2024-08-31T08:49:15.661841+0000 mgr.a (mgr.14388) 17211 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:49:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:16 smithi027 bash[22610]: cluster 2024-08-31T08:49:15.661841+0000 mgr.a (mgr.14388) 17211 : cluster [DBG] pgmap v11931: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:49:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:18 smithi191 bash[24992]: cluster 2024-08-31T08:49:17.662619+0000 mgr.a (mgr.14388) 17212 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:49:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:18 smithi163 bash[24253]: cluster 2024-08-31T08:49:17.662619+0000 mgr.a (mgr.14388) 17212 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:49:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:18 smithi027 bash[22610]: cluster 2024-08-31T08:49:17.662619+0000 mgr.a (mgr.14388) 17212 : cluster [DBG] pgmap v11932: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:49:19.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:19.385 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:19.385 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:49:20.175 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:49:20.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:49:20.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:49:20.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:49:20.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:49:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:20 smithi191 bash[24992]: cluster 2024-08-31T08:49:19.664672+0000 mgr.a (mgr.14388) 17213 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:20 smithi191 bash[24992]: audit 2024-08-31T08:49:19.726029+0000 mgr.a (mgr.14388) 17214 : audit [DBG] from='client.371199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:20 smithi163 bash[24253]: cluster 2024-08-31T08:49:19.664672+0000 mgr.a (mgr.14388) 17213 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:20 smithi163 bash[24253]: audit 2024-08-31T08:49:19.726029+0000 mgr.a (mgr.14388) 17214 : audit [DBG] from='client.371199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:20 smithi027 bash[22610]: cluster 2024-08-31T08:49:19.664672+0000 mgr.a (mgr.14388) 17213 : cluster [DBG] pgmap v11933: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:20 smithi027 bash[22610]: audit 2024-08-31T08:49:19.726029+0000 mgr.a (mgr.14388) 17214 : audit [DBG] from='client.371199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:22 smithi191 bash[24992]: cluster 2024-08-31T08:49:21.665551+0000 mgr.a (mgr.14388) 17215 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:22 smithi163 bash[24253]: cluster 2024-08-31T08:49:21.665551+0000 mgr.a (mgr.14388) 17215 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:22 smithi027 bash[22610]: cluster 2024-08-31T08:49:21.665551+0000 mgr.a (mgr.14388) 17215 : cluster [DBG] pgmap v11934: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:25.177 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:49:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:24 smithi163 bash[24253]: cluster 2024-08-31T08:49:23.667698+0000 mgr.a (mgr.14388) 17216 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:24 smithi027 bash[22610]: cluster 2024-08-31T08:49:23.667698+0000 mgr.a (mgr.14388) 17216 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:24 smithi191 bash[24992]: cluster 2024-08-31T08:49:23.667698+0000 mgr.a (mgr.14388) 17216 : cluster [DBG] pgmap v11935: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:49:25.953 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:49:25.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:49:25.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:49:25.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:49:25.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:49:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:26 smithi163 bash[24253]: audit 2024-08-31T08:49:25.513242+0000 mgr.a (mgr.14388) 17217 : audit [DBG] from='client.371277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:27.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:26 smithi163 bash[24253]: cluster 2024-08-31T08:49:25.668248+0000 mgr.a (mgr.14388) 17218 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:26 smithi027 bash[22610]: audit 2024-08-31T08:49:25.513242+0000 mgr.a (mgr.14388) 17217 : audit [DBG] from='client.371277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:26 smithi027 bash[22610]: cluster 2024-08-31T08:49:25.668248+0000 mgr.a (mgr.14388) 17218 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:26 smithi191 bash[24992]: audit 2024-08-31T08:49:25.513242+0000 mgr.a (mgr.14388) 17217 : audit [DBG] from='client.371277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:26 smithi191 bash[24992]: cluster 2024-08-31T08:49:25.668248+0000 mgr.a (mgr.14388) 17218 : cluster [DBG] pgmap v11936: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:28 smithi163 bash[24253]: cluster 2024-08-31T08:49:27.669115+0000 mgr.a (mgr.14388) 17219 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:28 smithi027 bash[22610]: cluster 2024-08-31T08:49:27.669115+0000 mgr.a (mgr.14388) 17219 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:28 smithi191 bash[24992]: cluster 2024-08-31T08:49:27.669115+0000 mgr.a (mgr.14388) 17219 : cluster [DBG] pgmap v11937: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:30.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:30.956 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:30.956 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:49:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:30 smithi163 bash[24253]: cluster 2024-08-31T08:49:29.671358+0000 mgr.a (mgr.14388) 17220 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:31.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:30 smithi027 bash[22610]: cluster 2024-08-31T08:49:29.671358+0000 mgr.a (mgr.14388) 17220 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:30 smithi191 bash[24992]: cluster 2024-08-31T08:49:29.671358+0000 mgr.a (mgr.14388) 17220 : cluster [DBG] pgmap v11938: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:31.706 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:49:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:49:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:49:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:49:31.706 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:49:32.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:31 smithi163 bash[24253]: audit 2024-08-31T08:49:31.288177+0000 mgr.a (mgr.14388) 17221 : audit [DBG] from='client.371352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:31 smithi027 bash[22610]: audit 2024-08-31T08:49:31.288177+0000 mgr.a (mgr.14388) 17221 : audit [DBG] from='client.371352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:31 smithi191 bash[24992]: audit 2024-08-31T08:49:31.288177+0000 mgr.a (mgr.14388) 17221 : audit [DBG] from='client.371352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:32 smithi163 bash[24253]: cluster 2024-08-31T08:49:31.671859+0000 mgr.a (mgr.14388) 17222 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:32 smithi027 bash[22610]: cluster 2024-08-31T08:49:31.671859+0000 mgr.a (mgr.14388) 17222 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:32 smithi191 bash[24992]: cluster 2024-08-31T08:49:31.671859+0000 mgr.a (mgr.14388) 17222 : cluster [DBG] pgmap v11939: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:34 smithi163 bash[24253]: cluster 2024-08-31T08:49:33.673971+0000 mgr.a (mgr.14388) 17223 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:34 smithi027 bash[22610]: cluster 2024-08-31T08:49:33.673971+0000 mgr.a (mgr.14388) 17223 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:34 smithi191 bash[24992]: cluster 2024-08-31T08:49:33.673971+0000 mgr.a (mgr.14388) 17223 : cluster [DBG] pgmap v11940: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:36.708 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:36.708 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:36.708 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:49:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:36 smithi163 bash[24253]: cluster 2024-08-31T08:49:35.674758+0000 mgr.a (mgr.14388) 17224 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:36 smithi027 bash[22610]: cluster 2024-08-31T08:49:35.674758+0000 mgr.a (mgr.14388) 17224 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:36 smithi191 bash[24992]: cluster 2024-08-31T08:49:35.674758+0000 mgr.a (mgr.14388) 17224 : cluster [DBG] pgmap v11941: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:37.473 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:49:37.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:49:37.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:49:37.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:49:37.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:49:38.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:37 smithi163 bash[24253]: audit 2024-08-31T08:49:37.042413+0000 mgr.a (mgr.14388) 17225 : audit [DBG] from='client.371430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:37 smithi027 bash[22610]: audit 2024-08-31T08:49:37.042413+0000 mgr.a (mgr.14388) 17225 : audit [DBG] from='client.371430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:37 smithi191 bash[24992]: audit 2024-08-31T08:49:37.042413+0000 mgr.a (mgr.14388) 17225 : audit [DBG] from='client.371430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:38 smithi163 bash[24253]: cluster 2024-08-31T08:49:37.675622+0000 mgr.a (mgr.14388) 17226 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:38 smithi027 bash[22610]: cluster 2024-08-31T08:49:37.675622+0000 mgr.a (mgr.14388) 17226 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:38 smithi191 bash[24992]: cluster 2024-08-31T08:49:37.675622+0000 mgr.a (mgr.14388) 17226 : cluster [DBG] pgmap v11942: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:40 smithi163 bash[24253]: cluster 2024-08-31T08:49:39.677834+0000 mgr.a (mgr.14388) 17227 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:40 smithi027 bash[22610]: cluster 2024-08-31T08:49:39.677834+0000 mgr.a (mgr.14388) 17227 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:40 smithi191 bash[24992]: cluster 2024-08-31T08:49:39.677834+0000 mgr.a (mgr.14388) 17227 : cluster [DBG] pgmap v11943: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:49:42.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:42.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:49:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:42 smithi163 bash[24253]: cluster 2024-08-31T08:49:41.678582+0000 mgr.a (mgr.14388) 17228 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:42 smithi027 bash[22610]: cluster 2024-08-31T08:49:41.678582+0000 mgr.a (mgr.14388) 17228 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:43.241 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:49:43.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:49:43.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:49:43.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:49:43.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:49:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:42 smithi191 bash[24992]: cluster 2024-08-31T08:49:41.678582+0000 mgr.a (mgr.14388) 17228 : cluster [DBG] pgmap v11944: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:43 smithi163 bash[24253]: audit 2024-08-31T08:49:42.813537+0000 mgr.a (mgr.14388) 17229 : audit [DBG] from='client.371508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:43 smithi027 bash[22610]: audit 2024-08-31T08:49:42.813537+0000 mgr.a (mgr.14388) 17229 : audit [DBG] from='client.371508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:43 smithi191 bash[24992]: audit 2024-08-31T08:49:42.813537+0000 mgr.a (mgr.14388) 17229 : audit [DBG] from='client.371508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:44 smithi163 bash[24253]: cluster 2024-08-31T08:49:43.681372+0000 mgr.a (mgr.14388) 17230 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:44 smithi027 bash[22610]: cluster 2024-08-31T08:49:43.681372+0000 mgr.a (mgr.14388) 17230 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:44 smithi191 bash[24992]: cluster 2024-08-31T08:49:43.681372+0000 mgr.a (mgr.14388) 17230 : cluster [DBG] pgmap v11945: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:46 smithi163 bash[24253]: cluster 2024-08-31T08:49:45.682138+0000 mgr.a (mgr.14388) 17231 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:49:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:46 smithi027 bash[22610]: cluster 2024-08-31T08:49:45.682138+0000 mgr.a (mgr.14388) 17231 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:49:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:46 smithi191 bash[24992]: cluster 2024-08-31T08:49:45.682138+0000 mgr.a (mgr.14388) 17231 : cluster [DBG] pgmap v11946: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:49:48.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:48.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:48.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:49:49.027 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:49:49.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:49:49.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:49:49.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:49:49.028 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:49:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:48 smithi163 bash[24253]: cluster 2024-08-31T08:49:47.682934+0000 mgr.a (mgr.14388) 17232 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:49:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:48 smithi027 bash[22610]: cluster 2024-08-31T08:49:47.682934+0000 mgr.a (mgr.14388) 17232 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:49:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:48 smithi191 bash[24992]: cluster 2024-08-31T08:49:47.682934+0000 mgr.a (mgr.14388) 17232 : cluster [DBG] pgmap v11947: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:49:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:49 smithi163 bash[24253]: audit 2024-08-31T08:49:48.578513+0000 mgr.a (mgr.14388) 17233 : audit [DBG] from='client.371586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:49 smithi027 bash[22610]: audit 2024-08-31T08:49:48.578513+0000 mgr.a (mgr.14388) 17233 : audit [DBG] from='client.371586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:49 smithi191 bash[24992]: audit 2024-08-31T08:49:48.578513+0000 mgr.a (mgr.14388) 17233 : audit [DBG] from='client.371586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:50 smithi163 bash[24253]: cluster 2024-08-31T08:49:49.685652+0000 mgr.a (mgr.14388) 17234 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:50 smithi027 bash[22610]: cluster 2024-08-31T08:49:49.685652+0000 mgr.a (mgr.14388) 17234 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:50 smithi191 bash[24992]: cluster 2024-08-31T08:49:49.685652+0000 mgr.a (mgr.14388) 17234 : cluster [DBG] pgmap v11948: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:52 smithi163 bash[24253]: cluster 2024-08-31T08:49:51.686434+0000 mgr.a (mgr.14388) 17235 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:49:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:52 smithi027 bash[22610]: cluster 2024-08-31T08:49:51.686434+0000 mgr.a (mgr.14388) 17235 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:49:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:52 smithi191 bash[24992]: cluster 2024-08-31T08:49:51.686434+0000 mgr.a (mgr.14388) 17235 : cluster [DBG] pgmap v11949: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:49:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:54.029 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:54.030 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:49:54.811 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:49:54.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:49:54.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:49:54.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:49:54.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:49:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:54 smithi163 bash[24253]: cluster 2024-08-31T08:49:53.688380+0000 mgr.a (mgr.14388) 17236 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:54 smithi027 bash[22610]: cluster 2024-08-31T08:49:53.688380+0000 mgr.a (mgr.14388) 17236 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:54 smithi191 bash[24992]: cluster 2024-08-31T08:49:53.688380+0000 mgr.a (mgr.14388) 17236 : cluster [DBG] pgmap v11950: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:56.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:55 smithi163 bash[24253]: audit 2024-08-31T08:49:54.361115+0000 mgr.a (mgr.14388) 17237 : audit [DBG] from='client.371661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:55 smithi027 bash[22610]: audit 2024-08-31T08:49:54.361115+0000 mgr.a (mgr.14388) 17237 : audit [DBG] from='client.371661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:55 smithi191 bash[24992]: audit 2024-08-31T08:49:54.361115+0000 mgr.a (mgr.14388) 17237 : audit [DBG] from='client.371661 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:49:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:56 smithi163 bash[24253]: cluster 2024-08-31T08:49:55.689275+0000 mgr.a (mgr.14388) 17238 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:56 smithi027 bash[22610]: cluster 2024-08-31T08:49:55.689275+0000 mgr.a (mgr.14388) 17238 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:57.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:56 smithi191 bash[24992]: cluster 2024-08-31T08:49:55.689275+0000 mgr.a (mgr.14388) 17238 : cluster [DBG] pgmap v11951: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:49:58 smithi163 bash[24253]: cluster 2024-08-31T08:49:57.690091+0000 mgr.a (mgr.14388) 17239 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:49:58 smithi027 bash[22610]: cluster 2024-08-31T08:49:57.690091+0000 mgr.a (mgr.14388) 17239 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:49:58 smithi191 bash[24992]: cluster 2024-08-31T08:49:57.690091+0000 mgr.a (mgr.14388) 17239 : cluster [DBG] pgmap v11952: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:49:59.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:49:59.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:49:59.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:00.570 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:00.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:00 smithi163 bash[24253]: cluster 2024-08-31T08:49:59.692453+0000 mgr.a (mgr.14388) 17240 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:00 smithi163 bash[24253]: cluster 2024-08-31T08:50:00.000118+0000 mon.a (mon.0) 3150 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:50:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:00 smithi163 bash[24253]: audit 2024-08-31T08:50:00.147425+0000 mgr.a (mgr.14388) 17241 : audit [DBG] from='client.371736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:00 smithi027 bash[22610]: cluster 2024-08-31T08:49:59.692453+0000 mgr.a (mgr.14388) 17240 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:00 smithi027 bash[22610]: cluster 2024-08-31T08:50:00.000118+0000 mon.a (mon.0) 3150 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:50:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:00 smithi027 bash[22610]: audit 2024-08-31T08:50:00.147425+0000 mgr.a (mgr.14388) 17241 : audit [DBG] from='client.371736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:00 smithi191 bash[24992]: cluster 2024-08-31T08:49:59.692453+0000 mgr.a (mgr.14388) 17240 : cluster [DBG] pgmap v11953: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:00 smithi191 bash[24992]: cluster 2024-08-31T08:50:00.000118+0000 mon.a (mon.0) 3150 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T08:50:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:00 smithi191 bash[24992]: audit 2024-08-31T08:50:00.147425+0000 mgr.a (mgr.14388) 17241 : audit [DBG] from='client.371736 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:02 smithi163 bash[24253]: cluster 2024-08-31T08:50:01.693379+0000 mgr.a (mgr.14388) 17242 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:02 smithi027 bash[22610]: cluster 2024-08-31T08:50:01.693379+0000 mgr.a (mgr.14388) 17242 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:02 smithi191 bash[24992]: cluster 2024-08-31T08:50:01.693379+0000 mgr.a (mgr.14388) 17242 : cluster [DBG] pgmap v11954: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:04 smithi163 bash[24253]: cluster 2024-08-31T08:50:03.695587+0000 mgr.a (mgr.14388) 17243 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:04 smithi027 bash[22610]: cluster 2024-08-31T08:50:03.695587+0000 mgr.a (mgr.14388) 17243 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:04 smithi191 bash[24992]: cluster 2024-08-31T08:50:03.695587+0000 mgr.a (mgr.14388) 17243 : cluster [DBG] pgmap v11955: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:05.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:50:05.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:50:05.573 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:06.342 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:06.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:06.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:06.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:06.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:06 smithi163 bash[24253]: cluster 2024-08-31T08:50:05.696289+0000 mgr.a (mgr.14388) 17244 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:06 smithi163 bash[24253]: audit 2024-08-31T08:50:05.910651+0000 mgr.a (mgr.14388) 17245 : audit [DBG] from='client.371811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:06 smithi027 bash[22610]: cluster 2024-08-31T08:50:05.696289+0000 mgr.a (mgr.14388) 17244 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:06 smithi027 bash[22610]: audit 2024-08-31T08:50:05.910651+0000 mgr.a (mgr.14388) 17245 : audit [DBG] from='client.371811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:06 smithi191 bash[24992]: cluster 2024-08-31T08:50:05.696289+0000 mgr.a (mgr.14388) 17244 : cluster [DBG] pgmap v11956: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:06 smithi191 bash[24992]: audit 2024-08-31T08:50:05.910651+0000 mgr.a (mgr.14388) 17245 : audit [DBG] from='client.371811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:08 smithi163 bash[24253]: cluster 2024-08-31T08:50:07.697224+0000 mgr.a (mgr.14388) 17246 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:08 smithi027 bash[22610]: cluster 2024-08-31T08:50:07.697224+0000 mgr.a (mgr.14388) 17246 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:08 smithi191 bash[24992]: cluster 2024-08-31T08:50:07.697224+0000 mgr.a (mgr.14388) 17246 : cluster [DBG] pgmap v11957: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:10 smithi163 bash[24253]: cluster 2024-08-31T08:50:09.699474+0000 mgr.a (mgr.14388) 17247 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:10 smithi163 bash[24253]: audit 2024-08-31T08:50:10.699903+0000 mon.a (mon.0) 3151 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:50:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:10 smithi027 bash[22610]: cluster 2024-08-31T08:50:09.699474+0000 mgr.a (mgr.14388) 17247 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:10 smithi027 bash[22610]: audit 2024-08-31T08:50:10.699903+0000 mon.a (mon.0) 3151 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:50:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:10 smithi191 bash[24992]: cluster 2024-08-31T08:50:09.699474+0000 mgr.a (mgr.14388) 17247 : cluster [DBG] pgmap v11958: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:10 smithi191 bash[24992]: audit 2024-08-31T08:50:10.699903+0000 mon.a (mon.0) 3151 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:50:11.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:50:11.344 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:50:11.344 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:12.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:11 smithi163 bash[24253]: audit 2024-08-31T08:50:11.534914+0000 mon.a (mon.0) 3152 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:50:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:11 smithi163 bash[24253]: audit 2024-08-31T08:50:11.536343+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:50:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:11 smithi163 bash[24253]: audit 2024-08-31T08:50:11.545869+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:50:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:11 smithi163 bash[24253]: audit 2024-08-31T08:50:11.548395+0000 mon.a (mon.0) 3155 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:50:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:11 smithi027 bash[22610]: audit 2024-08-31T08:50:11.534914+0000 mon.a (mon.0) 3152 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:50:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:11 smithi027 bash[22610]: audit 2024-08-31T08:50:11.536343+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:50:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:11 smithi027 bash[22610]: audit 2024-08-31T08:50:11.545869+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:50:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:11 smithi027 bash[22610]: audit 2024-08-31T08:50:11.548395+0000 mon.a (mon.0) 3155 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:50:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:11 smithi191 bash[24992]: audit 2024-08-31T08:50:11.534914+0000 mon.a (mon.0) 3152 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:50:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:11 smithi191 bash[24992]: audit 2024-08-31T08:50:11.536343+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:50:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:11 smithi191 bash[24992]: audit 2024-08-31T08:50:11.545869+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:50:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:11 smithi191 bash[24992]: audit 2024-08-31T08:50:11.548395+0000 mon.a (mon.0) 3155 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:50:12.683 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:12.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:12.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:12.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:12.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:12.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:50:12 smithi027 bash[22863]: debug 2024-08-31T08:50:12.274+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:50:12.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:50:12 smithi027 bash[22863]: debug 2024-08-31T08:50:12.286+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:50:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:12 smithi163 bash[24253]: audit 2024-08-31T08:50:11.550623+0000 mgr.a (mgr.14388) 17248 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:50:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:12 smithi163 bash[24253]: cluster 2024-08-31T08:50:11.700100+0000 mgr.a (mgr.14388) 17249 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:12 smithi163 bash[24253]: audit 2024-08-31T08:50:11.718113+0000 mgr.a (mgr.14388) 17250 : audit [DBG] from='client.371886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:12 smithi163 bash[24253]: audit 2024-08-31T08:50:12.282128+0000 mgr.a (mgr.14388) 17251 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:50:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:12 smithi163 bash[24253]: cephadm 2024-08-31T08:50:12.294404+0000 mgr.a (mgr.14388) 17252 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:50:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:12 smithi027 bash[22610]: audit 2024-08-31T08:50:11.550623+0000 mgr.a (mgr.14388) 17248 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:50:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:12 smithi027 bash[22610]: cluster 2024-08-31T08:50:11.700100+0000 mgr.a (mgr.14388) 17249 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:12 smithi027 bash[22610]: audit 2024-08-31T08:50:11.718113+0000 mgr.a (mgr.14388) 17250 : audit [DBG] from='client.371886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:12 smithi027 bash[22610]: audit 2024-08-31T08:50:12.282128+0000 mgr.a (mgr.14388) 17251 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:50:13.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:12 smithi027 bash[22610]: cephadm 2024-08-31T08:50:12.294404+0000 mgr.a (mgr.14388) 17252 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:50:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:12 smithi191 bash[24992]: audit 2024-08-31T08:50:11.550623+0000 mgr.a (mgr.14388) 17248 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:50:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:12 smithi191 bash[24992]: cluster 2024-08-31T08:50:11.700100+0000 mgr.a (mgr.14388) 17249 : cluster [DBG] pgmap v11959: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:12 smithi191 bash[24992]: audit 2024-08-31T08:50:11.718113+0000 mgr.a (mgr.14388) 17250 : audit [DBG] from='client.371886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:12 smithi191 bash[24992]: audit 2024-08-31T08:50:12.282128+0000 mgr.a (mgr.14388) 17251 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:50:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:12 smithi191 bash[24992]: cephadm 2024-08-31T08:50:12.294404+0000 mgr.a (mgr.14388) 17252 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:50:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:14 smithi163 bash[24253]: cluster 2024-08-31T08:50:13.702436+0000 mgr.a (mgr.14388) 17253 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:14 smithi027 bash[22610]: cluster 2024-08-31T08:50:13.702436+0000 mgr.a (mgr.14388) 17253 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:14 smithi191 bash[24992]: cluster 2024-08-31T08:50:13.702436+0000 mgr.a (mgr.14388) 17253 : cluster [DBG] pgmap v11960: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:16 smithi163 bash[24253]: cluster 2024-08-31T08:50:15.703285+0000 mgr.a (mgr.14388) 17254 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:16 smithi027 bash[22610]: cluster 2024-08-31T08:50:15.703285+0000 mgr.a (mgr.14388) 17254 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:16 smithi191 bash[24992]: cluster 2024-08-31T08:50:15.703285+0000 mgr.a (mgr.14388) 17254 : cluster [DBG] pgmap v11961: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:17.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:50:17.686 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:50:17.686 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:18.471 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:18.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:18.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:18.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:18.472 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:18 smithi163 bash[24253]: cluster 2024-08-31T08:50:17.704204+0000 mgr.a (mgr.14388) 17255 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:18 smithi163 bash[24253]: audit 2024-08-31T08:50:18.026251+0000 mgr.a (mgr.14388) 17256 : audit [DBG] from='client.372072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:18 smithi027 bash[22610]: cluster 2024-08-31T08:50:17.704204+0000 mgr.a (mgr.14388) 17255 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:18 smithi027 bash[22610]: audit 2024-08-31T08:50:18.026251+0000 mgr.a (mgr.14388) 17256 : audit [DBG] from='client.372072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:18 smithi191 bash[24992]: cluster 2024-08-31T08:50:17.704204+0000 mgr.a (mgr.14388) 17255 : cluster [DBG] pgmap v11962: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:18 smithi191 bash[24992]: audit 2024-08-31T08:50:18.026251+0000 mgr.a (mgr.14388) 17256 : audit [DBG] from='client.372072 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:20 smithi163 bash[24253]: cluster 2024-08-31T08:50:19.707058+0000 mgr.a (mgr.14388) 17257 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:20 smithi027 bash[22610]: cluster 2024-08-31T08:50:19.707058+0000 mgr.a (mgr.14388) 17257 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:20 smithi191 bash[24992]: cluster 2024-08-31T08:50:19.707058+0000 mgr.a (mgr.14388) 17257 : cluster [DBG] pgmap v11963: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:22 smithi027 bash[22610]: cluster 2024-08-31T08:50:21.707846+0000 mgr.a (mgr.14388) 17258 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:50:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:22 smithi191 bash[24992]: cluster 2024-08-31T08:50:21.707846+0000 mgr.a (mgr.14388) 17258 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:50:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:22 smithi163 bash[24253]: cluster 2024-08-31T08:50:21.707846+0000 mgr.a (mgr.14388) 17258 : cluster [DBG] pgmap v11964: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:50:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:50:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:50:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:24.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:24.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:24.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:24.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:24.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:24 smithi027 bash[22610]: cluster 2024-08-31T08:50:23.709781+0000 mgr.a (mgr.14388) 17259 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:24 smithi027 bash[22610]: audit 2024-08-31T08:50:23.809427+0000 mgr.a (mgr.14388) 17260 : audit [DBG] from='client.372150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:24 smithi191 bash[24992]: cluster 2024-08-31T08:50:23.709781+0000 mgr.a (mgr.14388) 17259 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:24 smithi191 bash[24992]: audit 2024-08-31T08:50:23.809427+0000 mgr.a (mgr.14388) 17260 : audit [DBG] from='client.372150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:24 smithi163 bash[24253]: cluster 2024-08-31T08:50:23.709781+0000 mgr.a (mgr.14388) 17259 : cluster [DBG] pgmap v11965: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:50:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:24 smithi163 bash[24253]: audit 2024-08-31T08:50:23.809427+0000 mgr.a (mgr.14388) 17260 : audit [DBG] from='client.372150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:26 smithi027 bash[22610]: cluster 2024-08-31T08:50:25.710793+0000 mgr.a (mgr.14388) 17261 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:50:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:26 smithi191 bash[24992]: cluster 2024-08-31T08:50:25.710793+0000 mgr.a (mgr.14388) 17261 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:50:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:26 smithi163 bash[24253]: cluster 2024-08-31T08:50:25.710793+0000 mgr.a (mgr.14388) 17261 : cluster [DBG] pgmap v11966: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:50:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:28 smithi027 bash[22610]: cluster 2024-08-31T08:50:27.711754+0000 mgr.a (mgr.14388) 17262 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:50:29.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:50:29.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:50:29.255 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:28 smithi191 bash[24992]: cluster 2024-08-31T08:50:27.711754+0000 mgr.a (mgr.14388) 17262 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:50:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:28 smithi163 bash[24253]: cluster 2024-08-31T08:50:27.711754+0000 mgr.a (mgr.14388) 17262 : cluster [DBG] pgmap v11967: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:50:30.039 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:30.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:30.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:30.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:30.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:30 smithi027 bash[22610]: audit 2024-08-31T08:50:29.590382+0000 mgr.a (mgr.14388) 17263 : audit [DBG] from='client.372228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:31.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:30 smithi027 bash[22610]: cluster 2024-08-31T08:50:29.713428+0000 mgr.a (mgr.14388) 17264 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:30 smithi191 bash[24992]: audit 2024-08-31T08:50:29.590382+0000 mgr.a (mgr.14388) 17263 : audit [DBG] from='client.372228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:30 smithi191 bash[24992]: cluster 2024-08-31T08:50:29.713428+0000 mgr.a (mgr.14388) 17264 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:30 smithi163 bash[24253]: audit 2024-08-31T08:50:29.590382+0000 mgr.a (mgr.14388) 17263 : audit [DBG] from='client.372228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:30 smithi163 bash[24253]: cluster 2024-08-31T08:50:29.713428+0000 mgr.a (mgr.14388) 17264 : cluster [DBG] pgmap v11968: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:32 smithi027 bash[22610]: cluster 2024-08-31T08:50:31.714291+0000 mgr.a (mgr.14388) 17265 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:32 smithi191 bash[24992]: cluster 2024-08-31T08:50:31.714291+0000 mgr.a (mgr.14388) 17265 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:32 smithi163 bash[24253]: cluster 2024-08-31T08:50:31.714291+0000 mgr.a (mgr.14388) 17265 : cluster [DBG] pgmap v11969: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:35.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:50:35.041 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:50:35.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:34 smithi027 bash[22610]: cluster 2024-08-31T08:50:33.716538+0000 mgr.a (mgr.14388) 17266 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:34 smithi191 bash[24992]: cluster 2024-08-31T08:50:33.716538+0000 mgr.a (mgr.14388) 17266 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:34 smithi163 bash[24253]: cluster 2024-08-31T08:50:33.716538+0000 mgr.a (mgr.14388) 17266 : cluster [DBG] pgmap v11970: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:35.790 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:35.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:35.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:35.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:35.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:36 smithi191 bash[24992]: audit 2024-08-31T08:50:35.370548+0000 mgr.a (mgr.14388) 17267 : audit [DBG] from='client.372303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:36 smithi191 bash[24992]: cluster 2024-08-31T08:50:35.717066+0000 mgr.a (mgr.14388) 17268 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:36 smithi163 bash[24253]: audit 2024-08-31T08:50:35.370548+0000 mgr.a (mgr.14388) 17267 : audit [DBG] from='client.372303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:37.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:36 smithi163 bash[24253]: cluster 2024-08-31T08:50:35.717066+0000 mgr.a (mgr.14388) 17268 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:36 smithi027 bash[22610]: audit 2024-08-31T08:50:35.370548+0000 mgr.a (mgr.14388) 17267 : audit [DBG] from='client.372303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:36 smithi027 bash[22610]: cluster 2024-08-31T08:50:35.717066+0000 mgr.a (mgr.14388) 17268 : cluster [DBG] pgmap v11971: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:38 smithi191 bash[24992]: cluster 2024-08-31T08:50:37.717811+0000 mgr.a (mgr.14388) 17269 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:38 smithi163 bash[24253]: cluster 2024-08-31T08:50:37.717811+0000 mgr.a (mgr.14388) 17269 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:38 smithi027 bash[22610]: cluster 2024-08-31T08:50:37.717811+0000 mgr.a (mgr.14388) 17269 : cluster [DBG] pgmap v11972: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:40.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:50:40.792 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:50:40.792 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:40 smithi191 bash[24992]: cluster 2024-08-31T08:50:39.719952+0000 mgr.a (mgr.14388) 17270 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:40 smithi163 bash[24253]: cluster 2024-08-31T08:50:39.719952+0000 mgr.a (mgr.14388) 17270 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:40 smithi027 bash[22610]: cluster 2024-08-31T08:50:39.719952+0000 mgr.a (mgr.14388) 17270 : cluster [DBG] pgmap v11973: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:41.536 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:41.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:41.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:41.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:41.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:41 smithi191 bash[24992]: audit 2024-08-31T08:50:41.122927+0000 mgr.a (mgr.14388) 17271 : audit [DBG] from='client.372381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:42.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:41 smithi163 bash[24253]: audit 2024-08-31T08:50:41.122927+0000 mgr.a (mgr.14388) 17271 : audit [DBG] from='client.372381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:41 smithi027 bash[22610]: audit 2024-08-31T08:50:41.122927+0000 mgr.a (mgr.14388) 17271 : audit [DBG] from='client.372381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:43 smithi191 bash[24992]: cluster 2024-08-31T08:50:41.720949+0000 mgr.a (mgr.14388) 17272 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:43 smithi163 bash[24253]: cluster 2024-08-31T08:50:41.720949+0000 mgr.a (mgr.14388) 17272 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:43 smithi027 bash[22610]: cluster 2024-08-31T08:50:41.720949+0000 mgr.a (mgr.14388) 17272 : cluster [DBG] pgmap v11974: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:45 smithi191 bash[24992]: cluster 2024-08-31T08:50:43.723146+0000 mgr.a (mgr.14388) 17273 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:45 smithi163 bash[24253]: cluster 2024-08-31T08:50:43.723146+0000 mgr.a (mgr.14388) 17273 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:45 smithi027 bash[22610]: cluster 2024-08-31T08:50:43.723146+0000 mgr.a (mgr.14388) 17273 : cluster [DBG] pgmap v11975: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:46.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:50:46.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:50:46.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:47.279 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:47.280 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:47.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:47 smithi191 bash[24992]: cluster 2024-08-31T08:50:45.724080+0000 mgr.a (mgr.14388) 17274 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:47 smithi163 bash[24253]: cluster 2024-08-31T08:50:45.724080+0000 mgr.a (mgr.14388) 17274 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:47 smithi027 bash[22610]: cluster 2024-08-31T08:50:45.724080+0000 mgr.a (mgr.14388) 17274 : cluster [DBG] pgmap v11976: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:48 smithi191 bash[24992]: audit 2024-08-31T08:50:46.867972+0000 mgr.a (mgr.14388) 17275 : audit [DBG] from='client.372459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:48.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:48 smithi163 bash[24253]: audit 2024-08-31T08:50:46.867972+0000 mgr.a (mgr.14388) 17275 : audit [DBG] from='client.372459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:48 smithi027 bash[22610]: audit 2024-08-31T08:50:46.867972+0000 mgr.a (mgr.14388) 17275 : audit [DBG] from='client.372459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:49 smithi191 bash[24992]: cluster 2024-08-31T08:50:47.725157+0000 mgr.a (mgr.14388) 17276 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:49 smithi163 bash[24253]: cluster 2024-08-31T08:50:47.725157+0000 mgr.a (mgr.14388) 17276 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:49 smithi027 bash[22610]: cluster 2024-08-31T08:50:47.725157+0000 mgr.a (mgr.14388) 17276 : cluster [DBG] pgmap v11977: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:51 smithi191 bash[24992]: cluster 2024-08-31T08:50:49.727529+0000 mgr.a (mgr.14388) 17277 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:51 smithi163 bash[24253]: cluster 2024-08-31T08:50:49.727529+0000 mgr.a (mgr.14388) 17277 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:51 smithi027 bash[22610]: cluster 2024-08-31T08:50:49.727529+0000 mgr.a (mgr.14388) 17277 : cluster [DBG] pgmap v11978: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:50:52.281 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:50:52.282 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:50:52.282 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:53.062 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:53.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:53.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:53 smithi191 bash[24992]: cluster 2024-08-31T08:50:51.728454+0000 mgr.a (mgr.14388) 17278 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:53.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:53 smithi163 bash[24253]: cluster 2024-08-31T08:50:51.728454+0000 mgr.a (mgr.14388) 17278 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:53 smithi027 bash[22610]: cluster 2024-08-31T08:50:51.728454+0000 mgr.a (mgr.14388) 17278 : cluster [DBG] pgmap v11979: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:50:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:54 smithi163 bash[24253]: audit 2024-08-31T08:50:52.617930+0000 mgr.a (mgr.14388) 17279 : audit [DBG] from='client.372534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:54 smithi027 bash[22610]: audit 2024-08-31T08:50:52.617930+0000 mgr.a (mgr.14388) 17279 : audit [DBG] from='client.372534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:54 smithi191 bash[24992]: audit 2024-08-31T08:50:52.617930+0000 mgr.a (mgr.14388) 17279 : audit [DBG] from='client.372534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:50:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:55 smithi163 bash[24253]: cluster 2024-08-31T08:50:53.730958+0000 mgr.a (mgr.14388) 17280 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:50:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:55 smithi027 bash[22610]: cluster 2024-08-31T08:50:53.730958+0000 mgr.a (mgr.14388) 17280 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:50:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:55 smithi191 bash[24992]: cluster 2024-08-31T08:50:53.730958+0000 mgr.a (mgr.14388) 17280 : cluster [DBG] pgmap v11980: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:50:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:56 smithi163 bash[24253]: cluster 2024-08-31T08:50:55.731777+0000 mgr.a (mgr.14388) 17281 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:50:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:56 smithi027 bash[22610]: cluster 2024-08-31T08:50:55.731777+0000 mgr.a (mgr.14388) 17281 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:50:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:56 smithi191 bash[24992]: cluster 2024-08-31T08:50:55.731777+0000 mgr.a (mgr.14388) 17281 : cluster [DBG] pgmap v11981: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:50:58.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:50:58.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:50:58.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:50:58.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:50:58.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:50:58.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:50:58.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:50:58.822 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:50:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:58 smithi163 bash[24253]: cluster 2024-08-31T08:50:57.732560+0000 mgr.a (mgr.14388) 17282 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:50:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:58 smithi027 bash[22610]: cluster 2024-08-31T08:50:57.732560+0000 mgr.a (mgr.14388) 17282 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:50:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:58 smithi191 bash[24992]: cluster 2024-08-31T08:50:57.732560+0000 mgr.a (mgr.14388) 17282 : cluster [DBG] pgmap v11982: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:51:00.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:50:59 smithi163 bash[24253]: audit 2024-08-31T08:50:58.391582+0000 mgr.a (mgr.14388) 17283 : audit [DBG] from='client.372612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:50:59 smithi027 bash[22610]: audit 2024-08-31T08:50:58.391582+0000 mgr.a (mgr.14388) 17283 : audit [DBG] from='client.372612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:50:59 smithi191 bash[24992]: audit 2024-08-31T08:50:58.391582+0000 mgr.a (mgr.14388) 17283 : audit [DBG] from='client.372612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:00 smithi163 bash[24253]: cluster 2024-08-31T08:50:59.735368+0000 mgr.a (mgr.14388) 17284 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:00 smithi027 bash[22610]: cluster 2024-08-31T08:50:59.735368+0000 mgr.a (mgr.14388) 17284 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:00 smithi191 bash[24992]: cluster 2024-08-31T08:50:59.735368+0000 mgr.a (mgr.14388) 17284 : cluster [DBG] pgmap v11983: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:02 smithi163 bash[24253]: cluster 2024-08-31T08:51:01.736152+0000 mgr.a (mgr.14388) 17285 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:51:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:02 smithi027 bash[22610]: cluster 2024-08-31T08:51:01.736152+0000 mgr.a (mgr.14388) 17285 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:51:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:02 smithi191 bash[24992]: cluster 2024-08-31T08:51:01.736152+0000 mgr.a (mgr.14388) 17285 : cluster [DBG] pgmap v11984: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:51:03.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:51:03.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:51:03.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:51:04.598 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:51:04.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:51:04.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:51:04.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:51:04.598 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:51:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:04 smithi163 bash[24253]: cluster 2024-08-31T08:51:03.738075+0000 mgr.a (mgr.14388) 17286 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:05.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:04 smithi163 bash[24253]: audit 2024-08-31T08:51:04.156323+0000 mgr.a (mgr.14388) 17287 : audit [DBG] from='client.372690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:04 smithi027 bash[22610]: cluster 2024-08-31T08:51:03.738075+0000 mgr.a (mgr.14388) 17286 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:04 smithi027 bash[22610]: audit 2024-08-31T08:51:04.156323+0000 mgr.a (mgr.14388) 17287 : audit [DBG] from='client.372690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:04 smithi191 bash[24992]: cluster 2024-08-31T08:51:03.738075+0000 mgr.a (mgr.14388) 17286 : cluster [DBG] pgmap v11985: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:04 smithi191 bash[24992]: audit 2024-08-31T08:51:04.156323+0000 mgr.a (mgr.14388) 17287 : audit [DBG] from='client.372690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:06 smithi163 bash[24253]: cluster 2024-08-31T08:51:05.739048+0000 mgr.a (mgr.14388) 17288 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:51:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:06 smithi027 bash[22610]: cluster 2024-08-31T08:51:05.739048+0000 mgr.a (mgr.14388) 17288 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:51:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:06 smithi191 bash[24992]: cluster 2024-08-31T08:51:05.739048+0000 mgr.a (mgr.14388) 17288 : cluster [DBG] pgmap v11986: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:51:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:08 smithi163 bash[24253]: cluster 2024-08-31T08:51:07.739848+0000 mgr.a (mgr.14388) 17289 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:51:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:08 smithi027 bash[22610]: cluster 2024-08-31T08:51:07.739848+0000 mgr.a (mgr.14388) 17289 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:51:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:08 smithi191 bash[24992]: cluster 2024-08-31T08:51:07.739848+0000 mgr.a (mgr.14388) 17289 : cluster [DBG] pgmap v11987: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:51:09.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:51:09.600 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:51:09.600 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:51:10.395 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:51:10.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:51:10.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:51:10.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:51:10.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:51:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:10 smithi163 bash[24253]: cluster 2024-08-31T08:51:09.741584+0000 mgr.a (mgr.14388) 17290 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:51:11.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:10 smithi163 bash[24253]: audit 2024-08-31T08:51:09.931801+0000 mgr.a (mgr.14388) 17291 : audit [DBG] from='client.372768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:10 smithi027 bash[22610]: cluster 2024-08-31T08:51:09.741584+0000 mgr.a (mgr.14388) 17290 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:51:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:10 smithi027 bash[22610]: audit 2024-08-31T08:51:09.931801+0000 mgr.a (mgr.14388) 17291 : audit [DBG] from='client.372768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:10 smithi191 bash[24992]: cluster 2024-08-31T08:51:09.741584+0000 mgr.a (mgr.14388) 17290 : cluster [DBG] pgmap v11988: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:51:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:10 smithi191 bash[24992]: audit 2024-08-31T08:51:09.931801+0000 mgr.a (mgr.14388) 17291 : audit [DBG] from='client.372768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:12 smithi163 bash[24253]: cluster 2024-08-31T08:51:11.742560+0000 mgr.a (mgr.14388) 17292 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:12 smithi163 bash[24253]: audit 2024-08-31T08:51:12.353241+0000 mon.a (mon.0) 3156 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:51:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:12 smithi027 bash[22610]: cluster 2024-08-31T08:51:11.742560+0000 mgr.a (mgr.14388) 17292 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:12 smithi027 bash[22610]: audit 2024-08-31T08:51:12.353241+0000 mon.a (mon.0) 3156 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:51:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:12 smithi191 bash[24992]: cluster 2024-08-31T08:51:11.742560+0000 mgr.a (mgr.14388) 17292 : cluster [DBG] pgmap v11989: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:12 smithi191 bash[24992]: audit 2024-08-31T08:51:12.353241+0000 mon.a (mon.0) 3156 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:51:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:14 smithi163 bash[24253]: cluster 2024-08-31T08:51:13.744712+0000 mgr.a (mgr.14388) 17293 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:14 smithi027 bash[22610]: cluster 2024-08-31T08:51:13.744712+0000 mgr.a (mgr.14388) 17293 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:14 smithi191 bash[24992]: cluster 2024-08-31T08:51:13.744712+0000 mgr.a (mgr.14388) 17293 : cluster [DBG] pgmap v11990: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:15.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:51:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:51:15.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:51:16.162 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:51:16.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:51:16.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:51:16.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:51:16.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:51:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:16 smithi163 bash[24253]: audit 2024-08-31T08:51:15.731148+0000 mgr.a (mgr.14388) 17294 : audit [DBG] from='client.372846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:16 smithi163 bash[24253]: cluster 2024-08-31T08:51:15.746070+0000 mgr.a (mgr.14388) 17295 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:16 smithi027 bash[22610]: audit 2024-08-31T08:51:15.731148+0000 mgr.a (mgr.14388) 17294 : audit [DBG] from='client.372846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:16 smithi027 bash[22610]: cluster 2024-08-31T08:51:15.746070+0000 mgr.a (mgr.14388) 17295 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:16 smithi191 bash[24992]: audit 2024-08-31T08:51:15.731148+0000 mgr.a (mgr.14388) 17294 : audit [DBG] from='client.372846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:16 smithi191 bash[24992]: cluster 2024-08-31T08:51:15.746070+0000 mgr.a (mgr.14388) 17295 : cluster [DBG] pgmap v11991: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: audit 2024-08-31T08:51:17.689126+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: audit 2024-08-31T08:51:17.693553+0000 mon.a (mon.0) 3158 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: audit 2024-08-31T08:51:17.707444+0000 mon.a (mon.0) 3159 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: audit 2024-08-31T08:51:17.711401+0000 mon.a (mon.0) 3160 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: audit 2024-08-31T08:51:17.731773+0000 mon.a (mon.0) 3161 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: audit 2024-08-31T08:51:17.736230+0000 mon.a (mon.0) 3162 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: cluster 2024-08-31T08:51:17.746666+0000 mgr.a (mgr.14388) 17296 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: audit 2024-08-31T08:51:18.471278+0000 mon.a (mon.0) 3163 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:51:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: audit 2024-08-31T08:51:18.473179+0000 mon.a (mon.0) 3164 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:51:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: audit 2024-08-31T08:51:18.483484+0000 mon.a (mon.0) 3165 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:18 smithi163 bash[24253]: audit 2024-08-31T08:51:18.488889+0000 mon.a (mon.0) 3166 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:51:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: audit 2024-08-31T08:51:17.689126+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: audit 2024-08-31T08:51:17.693553+0000 mon.a (mon.0) 3158 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: audit 2024-08-31T08:51:17.707444+0000 mon.a (mon.0) 3159 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: audit 2024-08-31T08:51:17.711401+0000 mon.a (mon.0) 3160 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: audit 2024-08-31T08:51:17.731773+0000 mon.a (mon.0) 3161 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: audit 2024-08-31T08:51:17.736230+0000 mon.a (mon.0) 3162 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: cluster 2024-08-31T08:51:17.746666+0000 mgr.a (mgr.14388) 17296 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: audit 2024-08-31T08:51:18.471278+0000 mon.a (mon.0) 3163 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:51:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: audit 2024-08-31T08:51:18.473179+0000 mon.a (mon.0) 3164 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:51:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: audit 2024-08-31T08:51:18.483484+0000 mon.a (mon.0) 3165 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:18.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:18 smithi027 bash[22610]: audit 2024-08-31T08:51:18.488889+0000 mon.a (mon.0) 3166 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:51:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: audit 2024-08-31T08:51:17.689126+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: audit 2024-08-31T08:51:17.693553+0000 mon.a (mon.0) 3158 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: audit 2024-08-31T08:51:17.707444+0000 mon.a (mon.0) 3159 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: audit 2024-08-31T08:51:17.711401+0000 mon.a (mon.0) 3160 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: audit 2024-08-31T08:51:17.731773+0000 mon.a (mon.0) 3161 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: audit 2024-08-31T08:51:17.736230+0000 mon.a (mon.0) 3162 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: cluster 2024-08-31T08:51:17.746666+0000 mgr.a (mgr.14388) 17296 : cluster [DBG] pgmap v11992: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: audit 2024-08-31T08:51:18.471278+0000 mon.a (mon.0) 3163 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:51:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: audit 2024-08-31T08:51:18.473179+0000 mon.a (mon.0) 3164 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:51:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: audit 2024-08-31T08:51:18.483484+0000 mon.a (mon.0) 3165 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:51:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:18 smithi191 bash[24992]: audit 2024-08-31T08:51:18.488889+0000 mon.a (mon.0) 3166 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:51:19.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:51:19 smithi027 bash[22863]: debug 2024-08-31T08:51:19.285+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:51:19.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:51:19 smithi027 bash[22863]: debug 2024-08-31T08:51:19.285+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:51:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:19 smithi191 bash[24992]: audit 2024-08-31T08:51:18.491246+0000 mgr.a (mgr.14388) 17297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:51:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:19 smithi191 bash[24992]: audit 2024-08-31T08:51:19.286848+0000 mgr.a (mgr.14388) 17298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:51:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:19 smithi191 bash[24992]: cephadm 2024-08-31T08:51:19.288354+0000 mgr.a (mgr.14388) 17299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:51:20.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:19 smithi163 bash[24253]: audit 2024-08-31T08:51:18.491246+0000 mgr.a (mgr.14388) 17297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:51:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:19 smithi163 bash[24253]: audit 2024-08-31T08:51:19.286848+0000 mgr.a (mgr.14388) 17298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:51:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:19 smithi163 bash[24253]: cephadm 2024-08-31T08:51:19.288354+0000 mgr.a (mgr.14388) 17299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:51:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:19 smithi027 bash[22610]: audit 2024-08-31T08:51:18.491246+0000 mgr.a (mgr.14388) 17297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:51:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:19 smithi027 bash[22610]: audit 2024-08-31T08:51:19.286848+0000 mgr.a (mgr.14388) 17298 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:51:20.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:19 smithi027 bash[22610]: cephadm 2024-08-31T08:51:19.288354+0000 mgr.a (mgr.14388) 17299 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:51:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:20 smithi191 bash[24992]: cluster 2024-08-31T08:51:19.749887+0000 mgr.a (mgr.14388) 17300 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:21.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:51:21.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:51:21.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:51:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:20 smithi163 bash[24253]: cluster 2024-08-31T08:51:19.749887+0000 mgr.a (mgr.14388) 17300 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:21.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:20 smithi027 bash[22610]: cluster 2024-08-31T08:51:19.749887+0000 mgr.a (mgr.14388) 17300 : cluster [DBG] pgmap v11993: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:21.939 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:51:21.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:51:21.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:51:21.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:51:21.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:51:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:22 smithi163 bash[24253]: audit 2024-08-31T08:51:21.498948+0000 mgr.a (mgr.14388) 17301 : audit [DBG] from='client.373029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:22 smithi163 bash[24253]: cluster 2024-08-31T08:51:21.750499+0000 mgr.a (mgr.14388) 17302 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:22 smithi027 bash[22610]: audit 2024-08-31T08:51:21.498948+0000 mgr.a (mgr.14388) 17301 : audit [DBG] from='client.373029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:22 smithi027 bash[22610]: cluster 2024-08-31T08:51:21.750499+0000 mgr.a (mgr.14388) 17302 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:22 smithi191 bash[24992]: audit 2024-08-31T08:51:21.498948+0000 mgr.a (mgr.14388) 17301 : audit [DBG] from='client.373029 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:22 smithi191 bash[24992]: cluster 2024-08-31T08:51:21.750499+0000 mgr.a (mgr.14388) 17302 : cluster [DBG] pgmap v11994: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:24 smithi163 bash[24253]: cluster 2024-08-31T08:51:23.752739+0000 mgr.a (mgr.14388) 17303 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:24 smithi027 bash[22610]: cluster 2024-08-31T08:51:23.752739+0000 mgr.a (mgr.14388) 17303 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:24 smithi191 bash[24992]: cluster 2024-08-31T08:51:23.752739+0000 mgr.a (mgr.14388) 17303 : cluster [DBG] pgmap v11995: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:26.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:51:26.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:51:26.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:51:27.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:26 smithi163 bash[24253]: cluster 2024-08-31T08:51:25.753509+0000 mgr.a (mgr.14388) 17304 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:26 smithi027 bash[22610]: cluster 2024-08-31T08:51:25.753509+0000 mgr.a (mgr.14388) 17304 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:26 smithi191 bash[24992]: cluster 2024-08-31T08:51:25.753509+0000 mgr.a (mgr.14388) 17304 : cluster [DBG] pgmap v11996: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:27.692 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:51:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:51:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:51:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:51:27.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:51:28.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:27 smithi163 bash[24253]: audit 2024-08-31T08:51:27.274416+0000 mgr.a (mgr.14388) 17305 : audit [DBG] from='client.373104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:27 smithi027 bash[22610]: audit 2024-08-31T08:51:27.274416+0000 mgr.a (mgr.14388) 17305 : audit [DBG] from='client.373104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:27 smithi191 bash[24992]: audit 2024-08-31T08:51:27.274416+0000 mgr.a (mgr.14388) 17305 : audit [DBG] from='client.373104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:29.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:28 smithi163 bash[24253]: cluster 2024-08-31T08:51:27.754388+0000 mgr.a (mgr.14388) 17306 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:29.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:28 smithi027 bash[22610]: cluster 2024-08-31T08:51:27.754388+0000 mgr.a (mgr.14388) 17306 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:28 smithi191 bash[24992]: cluster 2024-08-31T08:51:27.754388+0000 mgr.a (mgr.14388) 17306 : cluster [DBG] pgmap v11997: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:30 smithi163 bash[24253]: cluster 2024-08-31T08:51:29.756641+0000 mgr.a (mgr.14388) 17307 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:30 smithi027 bash[22610]: cluster 2024-08-31T08:51:29.756641+0000 mgr.a (mgr.14388) 17307 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:30 smithi191 bash[24992]: cluster 2024-08-31T08:51:29.756641+0000 mgr.a (mgr.14388) 17307 : cluster [DBG] pgmap v11998: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:32.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:51:32.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:51:32.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:51:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:32 smithi163 bash[24253]: cluster 2024-08-31T08:51:31.757402+0000 mgr.a (mgr.14388) 17308 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:32 smithi027 bash[22610]: cluster 2024-08-31T08:51:31.757402+0000 mgr.a (mgr.14388) 17308 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:32 smithi191 bash[24992]: cluster 2024-08-31T08:51:31.757402+0000 mgr.a (mgr.14388) 17308 : cluster [DBG] pgmap v11999: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:33.459 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:51:33.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:51:33.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:51:33.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:51:33.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:51:34.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:33 smithi163 bash[24253]: audit 2024-08-31T08:51:33.027988+0000 mgr.a (mgr.14388) 17309 : audit [DBG] from='client.373176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:33 smithi027 bash[22610]: audit 2024-08-31T08:51:33.027988+0000 mgr.a (mgr.14388) 17309 : audit [DBG] from='client.373176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:33 smithi191 bash[24992]: audit 2024-08-31T08:51:33.027988+0000 mgr.a (mgr.14388) 17309 : audit [DBG] from='client.373176 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:34 smithi163 bash[24253]: cluster 2024-08-31T08:51:33.760206+0000 mgr.a (mgr.14388) 17310 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:34 smithi027 bash[22610]: cluster 2024-08-31T08:51:33.760206+0000 mgr.a (mgr.14388) 17310 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:34 smithi191 bash[24992]: cluster 2024-08-31T08:51:33.760206+0000 mgr.a (mgr.14388) 17310 : cluster [DBG] pgmap v12000: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:51:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:36 smithi163 bash[24253]: cluster 2024-08-31T08:51:35.761124+0000 mgr.a (mgr.14388) 17311 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:51:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:36 smithi027 bash[22610]: cluster 2024-08-31T08:51:35.761124+0000 mgr.a (mgr.14388) 17311 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:51:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:36 smithi191 bash[24992]: cluster 2024-08-31T08:51:35.761124+0000 mgr.a (mgr.14388) 17311 : cluster [DBG] pgmap v12001: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:51:38.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:51:38.462 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:51:38.462 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:51:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:38 smithi163 bash[24253]: cluster 2024-08-31T08:51:37.762093+0000 mgr.a (mgr.14388) 17312 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:51:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:38 smithi027 bash[22610]: cluster 2024-08-31T08:51:37.762093+0000 mgr.a (mgr.14388) 17312 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:51:39.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:51:39.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:51:39.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:51:39.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:51:39.245 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:51:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:38 smithi191 bash[24992]: cluster 2024-08-31T08:51:37.762093+0000 mgr.a (mgr.14388) 17312 : cluster [DBG] pgmap v12002: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:51:40.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:39 smithi163 bash[24253]: audit 2024-08-31T08:51:38.797367+0000 mgr.a (mgr.14388) 17313 : audit [DBG] from='client.373245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:39 smithi027 bash[22610]: audit 2024-08-31T08:51:38.797367+0000 mgr.a (mgr.14388) 17313 : audit [DBG] from='client.373245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:39 smithi191 bash[24992]: audit 2024-08-31T08:51:38.797367+0000 mgr.a (mgr.14388) 17313 : audit [DBG] from='client.373245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:40 smithi163 bash[24253]: cluster 2024-08-31T08:51:39.764992+0000 mgr.a (mgr.14388) 17314 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:40 smithi027 bash[22610]: cluster 2024-08-31T08:51:39.764992+0000 mgr.a (mgr.14388) 17314 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:40 smithi191 bash[24992]: cluster 2024-08-31T08:51:39.764992+0000 mgr.a (mgr.14388) 17314 : cluster [DBG] pgmap v12003: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:42 smithi163 bash[24253]: cluster 2024-08-31T08:51:41.765767+0000 mgr.a (mgr.14388) 17315 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:51:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:42 smithi027 bash[22610]: cluster 2024-08-31T08:51:41.765767+0000 mgr.a (mgr.14388) 17315 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:51:43.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:42 smithi191 bash[24992]: cluster 2024-08-31T08:51:41.765767+0000 mgr.a (mgr.14388) 17315 : cluster [DBG] pgmap v12004: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:51:44.246 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:51:44.247 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:51:44.247 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:51:44.999 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:51:44.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:51:44.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:51:44.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:51:45.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:51:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:44 smithi163 bash[24253]: cluster 2024-08-31T08:51:43.767765+0000 mgr.a (mgr.14388) 17316 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:44 smithi027 bash[22610]: cluster 2024-08-31T08:51:43.767765+0000 mgr.a (mgr.14388) 17316 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:44 smithi191 bash[24992]: cluster 2024-08-31T08:51:43.767765+0000 mgr.a (mgr.14388) 17316 : cluster [DBG] pgmap v12005: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:46.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:45 smithi163 bash[24253]: audit 2024-08-31T08:51:44.578714+0000 mgr.a (mgr.14388) 17317 : audit [DBG] from='client.373320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:45 smithi027 bash[22610]: audit 2024-08-31T08:51:44.578714+0000 mgr.a (mgr.14388) 17317 : audit [DBG] from='client.373320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:45 smithi191 bash[24992]: audit 2024-08-31T08:51:44.578714+0000 mgr.a (mgr.14388) 17317 : audit [DBG] from='client.373320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:46 smithi163 bash[24253]: cluster 2024-08-31T08:51:45.768688+0000 mgr.a (mgr.14388) 17318 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:46 smithi027 bash[22610]: cluster 2024-08-31T08:51:45.768688+0000 mgr.a (mgr.14388) 17318 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:46 smithi191 bash[24992]: cluster 2024-08-31T08:51:45.768688+0000 mgr.a (mgr.14388) 17318 : cluster [DBG] pgmap v12006: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:48 smithi163 bash[24253]: cluster 2024-08-31T08:51:47.769488+0000 mgr.a (mgr.14388) 17319 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:48 smithi027 bash[22610]: cluster 2024-08-31T08:51:47.769488+0000 mgr.a (mgr.14388) 17319 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:48 smithi191 bash[24992]: cluster 2024-08-31T08:51:47.769488+0000 mgr.a (mgr.14388) 17319 : cluster [DBG] pgmap v12007: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:50.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:51:50.001 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:51:50.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:51:50.775 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:51:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:51:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:51:50.775 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:51:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:51:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:50 smithi163 bash[24253]: cluster 2024-08-31T08:51:49.771740+0000 mgr.a (mgr.14388) 17320 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:50 smithi027 bash[22610]: cluster 2024-08-31T08:51:49.771740+0000 mgr.a (mgr.14388) 17320 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:50 smithi191 bash[24992]: cluster 2024-08-31T08:51:49.771740+0000 mgr.a (mgr.14388) 17320 : cluster [DBG] pgmap v12008: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:52.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:51 smithi163 bash[24253]: audit 2024-08-31T08:51:50.339942+0000 mgr.a (mgr.14388) 17321 : audit [DBG] from='client.373398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:51 smithi027 bash[22610]: audit 2024-08-31T08:51:50.339942+0000 mgr.a (mgr.14388) 17321 : audit [DBG] from='client.373398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:51 smithi191 bash[24992]: audit 2024-08-31T08:51:50.339942+0000 mgr.a (mgr.14388) 17321 : audit [DBG] from='client.373398 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:52 smithi163 bash[24253]: cluster 2024-08-31T08:51:51.772695+0000 mgr.a (mgr.14388) 17322 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:52 smithi027 bash[22610]: cluster 2024-08-31T08:51:51.772695+0000 mgr.a (mgr.14388) 17322 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:52 smithi191 bash[24992]: cluster 2024-08-31T08:51:51.772695+0000 mgr.a (mgr.14388) 17322 : cluster [DBG] pgmap v12009: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:54 smithi163 bash[24253]: cluster 2024-08-31T08:51:53.774898+0000 mgr.a (mgr.14388) 17323 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:54 smithi027 bash[22610]: cluster 2024-08-31T08:51:53.774898+0000 mgr.a (mgr.14388) 17323 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:55.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:54 smithi191 bash[24992]: cluster 2024-08-31T08:51:53.774898+0000 mgr.a (mgr.14388) 17323 : cluster [DBG] pgmap v12010: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:51:55.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:51:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:51:55.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:51:56.522 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:51:56.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:51:56.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:51:56.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:51:56.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:51:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:56 smithi163 bash[24253]: cluster 2024-08-31T08:51:55.775651+0000 mgr.a (mgr.14388) 17324 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:56 smithi163 bash[24253]: audit 2024-08-31T08:51:56.106991+0000 mgr.a (mgr.14388) 17325 : audit [DBG] from='client.373473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:56 smithi027 bash[22610]: cluster 2024-08-31T08:51:55.775651+0000 mgr.a (mgr.14388) 17324 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:56 smithi027 bash[22610]: audit 2024-08-31T08:51:56.106991+0000 mgr.a (mgr.14388) 17325 : audit [DBG] from='client.373473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:56 smithi191 bash[24992]: cluster 2024-08-31T08:51:55.775651+0000 mgr.a (mgr.14388) 17324 : cluster [DBG] pgmap v12011: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:56 smithi191 bash[24992]: audit 2024-08-31T08:51:56.106991+0000 mgr.a (mgr.14388) 17325 : audit [DBG] from='client.373473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:51:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:51:58 smithi163 bash[24253]: cluster 2024-08-31T08:51:57.776626+0000 mgr.a (mgr.14388) 17326 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:51:58 smithi027 bash[22610]: cluster 2024-08-31T08:51:57.776626+0000 mgr.a (mgr.14388) 17326 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:51:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:51:58 smithi191 bash[24992]: cluster 2024-08-31T08:51:57.776626+0000 mgr.a (mgr.14388) 17326 : cluster [DBG] pgmap v12012: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:00 smithi163 bash[24253]: cluster 2024-08-31T08:51:59.778969+0000 mgr.a (mgr.14388) 17327 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:52:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:00 smithi027 bash[22610]: cluster 2024-08-31T08:51:59.778969+0000 mgr.a (mgr.14388) 17327 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:52:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:00 smithi191 bash[24992]: cluster 2024-08-31T08:51:59.778969+0000 mgr.a (mgr.14388) 17327 : cluster [DBG] pgmap v12013: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:52:01.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:01.524 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:01.524 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:02.306 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:52:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:52:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:52:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:52:02.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:52:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:02 smithi163 bash[24253]: cluster 2024-08-31T08:52:01.779751+0000 mgr.a (mgr.14388) 17328 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:03.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:02 smithi163 bash[24253]: audit 2024-08-31T08:52:01.864824+0000 mgr.a (mgr.14388) 17329 : audit [DBG] from='client.373551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:02 smithi027 bash[22610]: cluster 2024-08-31T08:52:01.779751+0000 mgr.a (mgr.14388) 17328 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:02 smithi027 bash[22610]: audit 2024-08-31T08:52:01.864824+0000 mgr.a (mgr.14388) 17329 : audit [DBG] from='client.373551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:02 smithi191 bash[24992]: cluster 2024-08-31T08:52:01.779751+0000 mgr.a (mgr.14388) 17328 : cluster [DBG] pgmap v12014: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:02 smithi191 bash[24992]: audit 2024-08-31T08:52:01.864824+0000 mgr.a (mgr.14388) 17329 : audit [DBG] from='client.373551 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:04 smithi163 bash[24253]: cluster 2024-08-31T08:52:03.782001+0000 mgr.a (mgr.14388) 17330 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:52:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:04 smithi027 bash[22610]: cluster 2024-08-31T08:52:03.782001+0000 mgr.a (mgr.14388) 17330 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:52:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:04 smithi191 bash[24992]: cluster 2024-08-31T08:52:03.782001+0000 mgr.a (mgr.14388) 17330 : cluster [DBG] pgmap v12015: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:52:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:06 smithi163 bash[24253]: cluster 2024-08-31T08:52:05.782822+0000 mgr.a (mgr.14388) 17331 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:06 smithi027 bash[22610]: cluster 2024-08-31T08:52:05.782822+0000 mgr.a (mgr.14388) 17331 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:06 smithi191 bash[24992]: cluster 2024-08-31T08:52:05.782822+0000 mgr.a (mgr.14388) 17331 : cluster [DBG] pgmap v12016: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:07.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:07.309 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:07.309 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:08.085 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:52:08.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:52:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:52:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:52:08.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:52:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:08 smithi027 bash[22610]: audit 2024-08-31T08:52:07.643247+0000 mgr.a (mgr.14388) 17332 : audit [DBG] from='client.373629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:08 smithi027 bash[22610]: cluster 2024-08-31T08:52:07.784138+0000 mgr.a (mgr.14388) 17333 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:08 smithi191 bash[24992]: audit 2024-08-31T08:52:07.643247+0000 mgr.a (mgr.14388) 17332 : audit [DBG] from='client.373629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:08 smithi191 bash[24992]: cluster 2024-08-31T08:52:07.784138+0000 mgr.a (mgr.14388) 17333 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:08 smithi163 bash[24253]: audit 2024-08-31T08:52:07.643247+0000 mgr.a (mgr.14388) 17332 : audit [DBG] from='client.373629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:08 smithi163 bash[24253]: cluster 2024-08-31T08:52:07.784138+0000 mgr.a (mgr.14388) 17333 : cluster [DBG] pgmap v12017: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:10 smithi027 bash[22610]: cluster 2024-08-31T08:52:09.786924+0000 mgr.a (mgr.14388) 17334 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:52:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:10 smithi191 bash[24992]: cluster 2024-08-31T08:52:09.786924+0000 mgr.a (mgr.14388) 17334 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:52:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:10 smithi163 bash[24253]: cluster 2024-08-31T08:52:09.786924+0000 mgr.a (mgr.14388) 17334 : cluster [DBG] pgmap v12018: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:52:13.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:13.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:13.087 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:12 smithi027 bash[22610]: cluster 2024-08-31T08:52:11.787759+0000 mgr.a (mgr.14388) 17335 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:52:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:12 smithi191 bash[24992]: cluster 2024-08-31T08:52:11.787759+0000 mgr.a (mgr.14388) 17335 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:52:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:12 smithi163 bash[24253]: cluster 2024-08-31T08:52:11.787759+0000 mgr.a (mgr.14388) 17335 : cluster [DBG] pgmap v12019: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:52:13.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:52:13.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:52:13.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:52:13.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:52:13.843 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:52:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:14 smithi027 bash[22610]: audit 2024-08-31T08:52:13.421933+0000 mgr.a (mgr.14388) 17336 : audit [DBG] from='client.373704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:14 smithi027 bash[22610]: cluster 2024-08-31T08:52:13.789088+0000 mgr.a (mgr.14388) 17337 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:14 smithi191 bash[24992]: audit 2024-08-31T08:52:13.421933+0000 mgr.a (mgr.14388) 17336 : audit [DBG] from='client.373704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:14 smithi191 bash[24992]: cluster 2024-08-31T08:52:13.789088+0000 mgr.a (mgr.14388) 17337 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:14 smithi163 bash[24253]: audit 2024-08-31T08:52:13.421933+0000 mgr.a (mgr.14388) 17336 : audit [DBG] from='client.373704 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:14 smithi163 bash[24253]: cluster 2024-08-31T08:52:13.789088+0000 mgr.a (mgr.14388) 17337 : cluster [DBG] pgmap v12020: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:16 smithi027 bash[22610]: cluster 2024-08-31T08:52:15.789807+0000 mgr.a (mgr.14388) 17338 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:52:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:16 smithi191 bash[24992]: cluster 2024-08-31T08:52:15.789807+0000 mgr.a (mgr.14388) 17338 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:52:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:16 smithi163 bash[24253]: cluster 2024-08-31T08:52:15.789807+0000 mgr.a (mgr.14388) 17338 : cluster [DBG] pgmap v12021: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:52:18.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:18.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:18.845 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:18 smithi027 bash[22610]: cluster 2024-08-31T08:52:17.790581+0000 mgr.a (mgr.14388) 17339 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:52:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:18 smithi191 bash[24992]: cluster 2024-08-31T08:52:17.790581+0000 mgr.a (mgr.14388) 17339 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:52:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:18 smithi163 bash[24253]: cluster 2024-08-31T08:52:17.790581+0000 mgr.a (mgr.14388) 17339 : cluster [DBG] pgmap v12022: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:52:19.615 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:52:19.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:52:19.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:52:19.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:52:19.616 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:52:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:19 smithi027 bash[22610]: audit 2024-08-31T08:52:19.176912+0000 mgr.a (mgr.14388) 17340 : audit [DBG] from='client.373779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:19 smithi027 bash[22610]: audit 2024-08-31T08:52:19.358773+0000 mon.a (mon.0) 3167 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:52:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:19 smithi191 bash[24992]: audit 2024-08-31T08:52:19.176912+0000 mgr.a (mgr.14388) 17340 : audit [DBG] from='client.373779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:19 smithi191 bash[24992]: audit 2024-08-31T08:52:19.358773+0000 mon.a (mon.0) 3167 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:52:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:19 smithi163 bash[24253]: audit 2024-08-31T08:52:19.176912+0000 mgr.a (mgr.14388) 17340 : audit [DBG] from='client.373779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:20.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:19 smithi163 bash[24253]: audit 2024-08-31T08:52:19.358773+0000 mon.a (mon.0) 3167 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:52:21.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:52:20 smithi027 bash[22863]: debug 2024-08-31T08:52:20.927+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:52:21.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:52:20 smithi027 bash[22863]: debug 2024-08-31T08:52:20.927+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:52:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:20 smithi027 bash[22610]: cluster 2024-08-31T08:52:19.793419+0000 mgr.a (mgr.14388) 17341 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:20 smithi027 bash[22610]: audit 2024-08-31T08:52:20.173472+0000 mon.a (mon.0) 3168 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:52:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:20 smithi027 bash[22610]: audit 2024-08-31T08:52:20.175637+0000 mon.a (mon.0) 3169 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:52:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:20 smithi027 bash[22610]: audit 2024-08-31T08:52:20.186661+0000 mon.a (mon.0) 3170 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:52:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:20 smithi027 bash[22610]: audit 2024-08-31T08:52:20.191615+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:52:21.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:20 smithi027 bash[22610]: audit 2024-08-31T08:52:20.194326+0000 mgr.a (mgr.14388) 17342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:52:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:20 smithi191 bash[24992]: cluster 2024-08-31T08:52:19.793419+0000 mgr.a (mgr.14388) 17341 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:20 smithi191 bash[24992]: audit 2024-08-31T08:52:20.173472+0000 mon.a (mon.0) 3168 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:52:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:20 smithi191 bash[24992]: audit 2024-08-31T08:52:20.175637+0000 mon.a (mon.0) 3169 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:52:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:20 smithi191 bash[24992]: audit 2024-08-31T08:52:20.186661+0000 mon.a (mon.0) 3170 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:52:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:20 smithi191 bash[24992]: audit 2024-08-31T08:52:20.191615+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:52:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:20 smithi191 bash[24992]: audit 2024-08-31T08:52:20.194326+0000 mgr.a (mgr.14388) 17342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:52:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:20 smithi163 bash[24253]: cluster 2024-08-31T08:52:19.793419+0000 mgr.a (mgr.14388) 17341 : cluster [DBG] pgmap v12023: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:20 smithi163 bash[24253]: audit 2024-08-31T08:52:20.173472+0000 mon.a (mon.0) 3168 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:52:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:20 smithi163 bash[24253]: audit 2024-08-31T08:52:20.175637+0000 mon.a (mon.0) 3169 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:52:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:20 smithi163 bash[24253]: audit 2024-08-31T08:52:20.186661+0000 mon.a (mon.0) 3170 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:52:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:20 smithi163 bash[24253]: audit 2024-08-31T08:52:20.191615+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:52:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:20 smithi163 bash[24253]: audit 2024-08-31T08:52:20.194326+0000 mgr.a (mgr.14388) 17342 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:52:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:21 smithi191 bash[24992]: audit 2024-08-31T08:52:20.931918+0000 mgr.a (mgr.14388) 17343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:52:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:21 smithi191 bash[24992]: cephadm 2024-08-31T08:52:20.933371+0000 mgr.a (mgr.14388) 17344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:52:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:21 smithi163 bash[24253]: audit 2024-08-31T08:52:20.931918+0000 mgr.a (mgr.14388) 17343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:52:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:21 smithi163 bash[24253]: cephadm 2024-08-31T08:52:20.933371+0000 mgr.a (mgr.14388) 17344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:52:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:21 smithi027 bash[22610]: audit 2024-08-31T08:52:20.931918+0000 mgr.a (mgr.14388) 17343 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:52:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:21 smithi027 bash[22610]: cephadm 2024-08-31T08:52:20.933371+0000 mgr.a (mgr.14388) 17344 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:52:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:22 smithi191 bash[24992]: cluster 2024-08-31T08:52:21.794425+0000 mgr.a (mgr.14388) 17345 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:52:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:22 smithi163 bash[24253]: cluster 2024-08-31T08:52:21.794425+0000 mgr.a (mgr.14388) 17345 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:52:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:22 smithi027 bash[22610]: cluster 2024-08-31T08:52:21.794425+0000 mgr.a (mgr.14388) 17345 : cluster [DBG] pgmap v12024: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:52:24.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:24.617 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:24.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:24 smithi191 bash[24992]: cluster 2024-08-31T08:52:23.796711+0000 mgr.a (mgr.14388) 17346 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:52:25.407 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:52:25.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:52:25.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:52:25.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:52:25.407 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:52:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:24 smithi163 bash[24253]: cluster 2024-08-31T08:52:23.796711+0000 mgr.a (mgr.14388) 17346 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:52:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:24 smithi027 bash[22610]: cluster 2024-08-31T08:52:23.796711+0000 mgr.a (mgr.14388) 17346 : cluster [DBG] pgmap v12025: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:52:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:26 smithi191 bash[24992]: audit 2024-08-31T08:52:24.953626+0000 mgr.a (mgr.14388) 17347 : audit [DBG] from='client.373965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:26 smithi163 bash[24253]: audit 2024-08-31T08:52:24.953626+0000 mgr.a (mgr.14388) 17347 : audit [DBG] from='client.373965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:26 smithi027 bash[22610]: audit 2024-08-31T08:52:24.953626+0000 mgr.a (mgr.14388) 17347 : audit [DBG] from='client.373965 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:27 smithi191 bash[24992]: cluster 2024-08-31T08:52:25.797669+0000 mgr.a (mgr.14388) 17348 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:52:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:27 smithi163 bash[24253]: cluster 2024-08-31T08:52:25.797669+0000 mgr.a (mgr.14388) 17348 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:52:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:27 smithi027 bash[22610]: cluster 2024-08-31T08:52:25.797669+0000 mgr.a (mgr.14388) 17348 : cluster [DBG] pgmap v12026: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:52:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:29 smithi191 bash[24992]: cluster 2024-08-31T08:52:27.798455+0000 mgr.a (mgr.14388) 17349 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:52:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:29 smithi163 bash[24253]: cluster 2024-08-31T08:52:27.798455+0000 mgr.a (mgr.14388) 17349 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:52:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:29 smithi027 bash[22610]: cluster 2024-08-31T08:52:27.798455+0000 mgr.a (mgr.14388) 17349 : cluster [DBG] pgmap v12027: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:52:30.408 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:30.409 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:30.409 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:31.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:52:31.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:52:31.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:52:31.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:52:31.162 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:52:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:31 smithi191 bash[24992]: cluster 2024-08-31T08:52:29.800677+0000 mgr.a (mgr.14388) 17350 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T08:52:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:31 smithi163 bash[24253]: cluster 2024-08-31T08:52:29.800677+0000 mgr.a (mgr.14388) 17350 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T08:52:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:31 smithi027 bash[22610]: cluster 2024-08-31T08:52:29.800677+0000 mgr.a (mgr.14388) 17350 : cluster [DBG] pgmap v12028: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T08:52:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:32 smithi191 bash[24992]: audit 2024-08-31T08:52:30.739779+0000 mgr.a (mgr.14388) 17351 : audit [DBG] from='client.374043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:32 smithi163 bash[24253]: audit 2024-08-31T08:52:30.739779+0000 mgr.a (mgr.14388) 17351 : audit [DBG] from='client.374043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:32 smithi027 bash[22610]: audit 2024-08-31T08:52:30.739779+0000 mgr.a (mgr.14388) 17351 : audit [DBG] from='client.374043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:33 smithi191 bash[24992]: cluster 2024-08-31T08:52:31.801623+0000 mgr.a (mgr.14388) 17352 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T08:52:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:33 smithi163 bash[24253]: cluster 2024-08-31T08:52:31.801623+0000 mgr.a (mgr.14388) 17352 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T08:52:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:33 smithi027 bash[22610]: cluster 2024-08-31T08:52:31.801623+0000 mgr.a (mgr.14388) 17352 : cluster [DBG] pgmap v12029: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T08:52:35.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:35 smithi191 bash[24992]: cluster 2024-08-31T08:52:33.803884+0000 mgr.a (mgr.14388) 17353 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T08:52:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:35 smithi163 bash[24253]: cluster 2024-08-31T08:52:33.803884+0000 mgr.a (mgr.14388) 17353 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T08:52:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:35 smithi027 bash[22610]: cluster 2024-08-31T08:52:33.803884+0000 mgr.a (mgr.14388) 17353 : cluster [DBG] pgmap v12030: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T08:52:36.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:36.163 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:36.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:36.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:52:36.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:52:36.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:52:36.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:52:36.933 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:52:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:37 smithi191 bash[24992]: cluster 2024-08-31T08:52:35.804637+0000 mgr.a (mgr.14388) 17354 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:52:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:37 smithi163 bash[24253]: cluster 2024-08-31T08:52:35.804637+0000 mgr.a (mgr.14388) 17354 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:52:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:37 smithi027 bash[22610]: cluster 2024-08-31T08:52:35.804637+0000 mgr.a (mgr.14388) 17354 : cluster [DBG] pgmap v12031: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:52:38.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:38 smithi163 bash[24253]: audit 2024-08-31T08:52:36.498131+0000 mgr.a (mgr.14388) 17355 : audit [DBG] from='client.374121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:38 smithi027 bash[22610]: audit 2024-08-31T08:52:36.498131+0000 mgr.a (mgr.14388) 17355 : audit [DBG] from='client.374121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:38 smithi191 bash[24992]: audit 2024-08-31T08:52:36.498131+0000 mgr.a (mgr.14388) 17355 : audit [DBG] from='client.374121 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:39 smithi163 bash[24253]: cluster 2024-08-31T08:52:37.805707+0000 mgr.a (mgr.14388) 17356 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:52:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:39 smithi027 bash[22610]: cluster 2024-08-31T08:52:37.805707+0000 mgr.a (mgr.14388) 17356 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:52:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:39 smithi191 bash[24992]: cluster 2024-08-31T08:52:37.805707+0000 mgr.a (mgr.14388) 17356 : cluster [DBG] pgmap v12032: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T08:52:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:41 smithi163 bash[24253]: cluster 2024-08-31T08:52:39.808152+0000 mgr.a (mgr.14388) 17357 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:52:41.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:41 smithi027 bash[22610]: cluster 2024-08-31T08:52:39.808152+0000 mgr.a (mgr.14388) 17357 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:52:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:41 smithi191 bash[24992]: cluster 2024-08-31T08:52:39.808152+0000 mgr.a (mgr.14388) 17357 : cluster [DBG] pgmap v12033: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T08:52:41.934 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:41.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:41.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:42.697 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:52:42.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:52:42.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:52:42.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:52:42.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:52:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:43 smithi163 bash[24253]: cluster 2024-08-31T08:52:41.809089+0000 mgr.a (mgr.14388) 17358 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:43 smithi163 bash[24253]: audit 2024-08-31T08:52:42.267794+0000 mgr.a (mgr.14388) 17359 : audit [DBG] from='client.374199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:43 smithi027 bash[22610]: cluster 2024-08-31T08:52:41.809089+0000 mgr.a (mgr.14388) 17358 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:43 smithi027 bash[22610]: audit 2024-08-31T08:52:42.267794+0000 mgr.a (mgr.14388) 17359 : audit [DBG] from='client.374199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:43 smithi191 bash[24992]: cluster 2024-08-31T08:52:41.809089+0000 mgr.a (mgr.14388) 17358 : cluster [DBG] pgmap v12034: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:43 smithi191 bash[24992]: audit 2024-08-31T08:52:42.267794+0000 mgr.a (mgr.14388) 17359 : audit [DBG] from='client.374199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:45 smithi163 bash[24253]: cluster 2024-08-31T08:52:43.811602+0000 mgr.a (mgr.14388) 17360 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:52:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:45 smithi027 bash[22610]: cluster 2024-08-31T08:52:43.811602+0000 mgr.a (mgr.14388) 17360 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:52:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:45 smithi191 bash[24992]: cluster 2024-08-31T08:52:43.811602+0000 mgr.a (mgr.14388) 17360 : cluster [DBG] pgmap v12035: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:52:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:47 smithi163 bash[24253]: cluster 2024-08-31T08:52:45.812402+0000 mgr.a (mgr.14388) 17361 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:47 smithi027 bash[22610]: cluster 2024-08-31T08:52:45.812402+0000 mgr.a (mgr.14388) 17361 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:47 smithi191 bash[24992]: cluster 2024-08-31T08:52:45.812402+0000 mgr.a (mgr.14388) 17361 : cluster [DBG] pgmap v12036: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:47.699 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:47.700 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:47.700 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:48.492 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:52:48.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:52:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:52:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:52:48.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:52:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:49 smithi163 bash[24253]: cluster 2024-08-31T08:52:47.812913+0000 mgr.a (mgr.14388) 17362 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:49.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:49 smithi163 bash[24253]: audit 2024-08-31T08:52:48.045242+0000 mgr.a (mgr.14388) 17363 : audit [DBG] from='client.374277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:49 smithi027 bash[22610]: cluster 2024-08-31T08:52:47.812913+0000 mgr.a (mgr.14388) 17362 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:49 smithi027 bash[22610]: audit 2024-08-31T08:52:48.045242+0000 mgr.a (mgr.14388) 17363 : audit [DBG] from='client.374277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:49 smithi191 bash[24992]: cluster 2024-08-31T08:52:47.812913+0000 mgr.a (mgr.14388) 17362 : cluster [DBG] pgmap v12037: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:52:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:49 smithi191 bash[24992]: audit 2024-08-31T08:52:48.045242+0000 mgr.a (mgr.14388) 17363 : audit [DBG] from='client.374277 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:51 smithi163 bash[24253]: cluster 2024-08-31T08:52:49.815661+0000 mgr.a (mgr.14388) 17364 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:52:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:51 smithi027 bash[22610]: cluster 2024-08-31T08:52:49.815661+0000 mgr.a (mgr.14388) 17364 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:52:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:51 smithi191 bash[24992]: cluster 2024-08-31T08:52:49.815661+0000 mgr.a (mgr.14388) 17364 : cluster [DBG] pgmap v12038: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:52:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:53 smithi163 bash[24253]: cluster 2024-08-31T08:52:51.816458+0000 mgr.a (mgr.14388) 17365 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:52:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:53 smithi027 bash[22610]: cluster 2024-08-31T08:52:51.816458+0000 mgr.a (mgr.14388) 17365 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:52:53.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:53.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:53 smithi191 bash[24992]: cluster 2024-08-31T08:52:51.816458+0000 mgr.a (mgr.14388) 17365 : cluster [DBG] pgmap v12039: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:52:54.241 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:52:54.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:52:54.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:52:54.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:52:54.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:52:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:55 smithi163 bash[24253]: cluster 2024-08-31T08:52:53.818350+0000 mgr.a (mgr.14388) 17366 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:52:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:55 smithi163 bash[24253]: audit 2024-08-31T08:52:53.829085+0000 mgr.a (mgr.14388) 17367 : audit [DBG] from='client.374352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:55 smithi027 bash[22610]: cluster 2024-08-31T08:52:53.818350+0000 mgr.a (mgr.14388) 17366 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:52:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:55 smithi027 bash[22610]: audit 2024-08-31T08:52:53.829085+0000 mgr.a (mgr.14388) 17367 : audit [DBG] from='client.374352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:55 smithi191 bash[24992]: cluster 2024-08-31T08:52:53.818350+0000 mgr.a (mgr.14388) 17366 : cluster [DBG] pgmap v12040: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:52:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:55 smithi191 bash[24992]: audit 2024-08-31T08:52:53.829085+0000 mgr.a (mgr.14388) 17367 : audit [DBG] from='client.374352 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:52:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:57 smithi163 bash[24253]: cluster 2024-08-31T08:52:55.819278+0000 mgr.a (mgr.14388) 17368 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:52:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:57 smithi027 bash[22610]: cluster 2024-08-31T08:52:55.819278+0000 mgr.a (mgr.14388) 17368 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:52:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:57 smithi191 bash[24992]: cluster 2024-08-31T08:52:55.819278+0000 mgr.a (mgr.14388) 17368 : cluster [DBG] pgmap v12041: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:52:59.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:52:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:52:59.244 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:52:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:52:59 smithi163 bash[24253]: cluster 2024-08-31T08:52:57.820074+0000 mgr.a (mgr.14388) 17369 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:52:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:52:59 smithi027 bash[22610]: cluster 2024-08-31T08:52:57.820074+0000 mgr.a (mgr.14388) 17369 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:52:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:52:59 smithi191 bash[24992]: cluster 2024-08-31T08:52:57.820074+0000 mgr.a (mgr.14388) 17369 : cluster [DBG] pgmap v12042: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T08:53:00.017 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:00.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:00.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:00.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:00.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:01 smithi163 bash[24253]: audit 2024-08-31T08:52:59.581555+0000 mgr.a (mgr.14388) 17370 : audit [DBG] from='client.374430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:01 smithi163 bash[24253]: cluster 2024-08-31T08:52:59.821707+0000 mgr.a (mgr.14388) 17371 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:53:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:01 smithi027 bash[22610]: audit 2024-08-31T08:52:59.581555+0000 mgr.a (mgr.14388) 17370 : audit [DBG] from='client.374430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:01 smithi027 bash[22610]: cluster 2024-08-31T08:52:59.821707+0000 mgr.a (mgr.14388) 17371 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:53:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:01 smithi191 bash[24992]: audit 2024-08-31T08:52:59.581555+0000 mgr.a (mgr.14388) 17370 : audit [DBG] from='client.374430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:01 smithi191 bash[24992]: cluster 2024-08-31T08:52:59.821707+0000 mgr.a (mgr.14388) 17371 : cluster [DBG] pgmap v12043: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T08:53:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:03 smithi163 bash[24253]: cluster 2024-08-31T08:53:01.822604+0000 mgr.a (mgr.14388) 17372 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:03 smithi027 bash[22610]: cluster 2024-08-31T08:53:01.822604+0000 mgr.a (mgr.14388) 17372 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:03 smithi191 bash[24992]: cluster 2024-08-31T08:53:01.822604+0000 mgr.a (mgr.14388) 17372 : cluster [DBG] pgmap v12044: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:05.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:53:05.019 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:53:05.020 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:53:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:05 smithi163 bash[24253]: cluster 2024-08-31T08:53:03.824846+0000 mgr.a (mgr.14388) 17373 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:05 smithi027 bash[22610]: cluster 2024-08-31T08:53:03.824846+0000 mgr.a (mgr.14388) 17373 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:05 smithi191 bash[24992]: cluster 2024-08-31T08:53:03.824846+0000 mgr.a (mgr.14388) 17373 : cluster [DBG] pgmap v12045: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:05.806 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:05.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:07 smithi163 bash[24253]: audit 2024-08-31T08:53:05.361766+0000 mgr.a (mgr.14388) 17374 : audit [DBG] from='client.374505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:07.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:07 smithi163 bash[24253]: cluster 2024-08-31T08:53:05.825429+0000 mgr.a (mgr.14388) 17375 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:07 smithi027 bash[22610]: audit 2024-08-31T08:53:05.361766+0000 mgr.a (mgr.14388) 17374 : audit [DBG] from='client.374505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:07 smithi027 bash[22610]: cluster 2024-08-31T08:53:05.825429+0000 mgr.a (mgr.14388) 17375 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:07 smithi191 bash[24992]: audit 2024-08-31T08:53:05.361766+0000 mgr.a (mgr.14388) 17374 : audit [DBG] from='client.374505 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:07 smithi191 bash[24992]: cluster 2024-08-31T08:53:05.825429+0000 mgr.a (mgr.14388) 17375 : cluster [DBG] pgmap v12046: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:09 smithi163 bash[24253]: cluster 2024-08-31T08:53:07.826163+0000 mgr.a (mgr.14388) 17376 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:09 smithi027 bash[22610]: cluster 2024-08-31T08:53:07.826163+0000 mgr.a (mgr.14388) 17376 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:09 smithi191 bash[24992]: cluster 2024-08-31T08:53:07.826163+0000 mgr.a (mgr.14388) 17376 : cluster [DBG] pgmap v12047: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:10.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:53:10.808 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:53:10.808 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:53:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:11 smithi163 bash[24253]: cluster 2024-08-31T08:53:09.828371+0000 mgr.a (mgr.14388) 17377 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:11 smithi027 bash[22610]: cluster 2024-08-31T08:53:09.828371+0000 mgr.a (mgr.14388) 17377 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:11 smithi191 bash[24992]: cluster 2024-08-31T08:53:09.828371+0000 mgr.a (mgr.14388) 17377 : cluster [DBG] pgmap v12048: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:11.585 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:11.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:11.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:11.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:11.586 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:12 smithi163 bash[24253]: audit 2024-08-31T08:53:11.143685+0000 mgr.a (mgr.14388) 17378 : audit [DBG] from='client.374580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:12.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:12 smithi027 bash[22610]: audit 2024-08-31T08:53:11.143685+0000 mgr.a (mgr.14388) 17378 : audit [DBG] from='client.374580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:12 smithi191 bash[24992]: audit 2024-08-31T08:53:11.143685+0000 mgr.a (mgr.14388) 17378 : audit [DBG] from='client.374580 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:13 smithi163 bash[24253]: cluster 2024-08-31T08:53:11.829350+0000 mgr.a (mgr.14388) 17379 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:13 smithi027 bash[22610]: cluster 2024-08-31T08:53:11.829350+0000 mgr.a (mgr.14388) 17379 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:13 smithi191 bash[24992]: cluster 2024-08-31T08:53:11.829350+0000 mgr.a (mgr.14388) 17379 : cluster [DBG] pgmap v12049: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:15 smithi163 bash[24253]: cluster 2024-08-31T08:53:13.831597+0000 mgr.a (mgr.14388) 17380 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:15 smithi027 bash[22610]: cluster 2024-08-31T08:53:13.831597+0000 mgr.a (mgr.14388) 17380 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:15.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:15 smithi191 bash[24992]: cluster 2024-08-31T08:53:13.831597+0000 mgr.a (mgr.14388) 17380 : cluster [DBG] pgmap v12050: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:16.587 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:53:16.588 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:53:16.588 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:53:17.369 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:17.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:17.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:17.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:17.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:17 smithi163 bash[24253]: cluster 2024-08-31T08:53:15.832361+0000 mgr.a (mgr.14388) 17381 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:17 smithi027 bash[22610]: cluster 2024-08-31T08:53:15.832361+0000 mgr.a (mgr.14388) 17381 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:17 smithi191 bash[24992]: cluster 2024-08-31T08:53:15.832361+0000 mgr.a (mgr.14388) 17381 : cluster [DBG] pgmap v12051: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:18 smithi163 bash[24253]: audit 2024-08-31T08:53:16.920625+0000 mgr.a (mgr.14388) 17382 : audit [DBG] from='client.374658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:18 smithi027 bash[22610]: audit 2024-08-31T08:53:16.920625+0000 mgr.a (mgr.14388) 17382 : audit [DBG] from='client.374658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:18 smithi191 bash[24992]: audit 2024-08-31T08:53:16.920625+0000 mgr.a (mgr.14388) 17382 : audit [DBG] from='client.374658 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:19 smithi163 bash[24253]: cluster 2024-08-31T08:53:17.833322+0000 mgr.a (mgr.14388) 17383 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:19 smithi027 bash[22610]: cluster 2024-08-31T08:53:17.833322+0000 mgr.a (mgr.14388) 17383 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:19 smithi191 bash[24992]: cluster 2024-08-31T08:53:17.833322+0000 mgr.a (mgr.14388) 17383 : cluster [DBG] pgmap v12052: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:21 smithi163 bash[24253]: cluster 2024-08-31T08:53:19.835587+0000 mgr.a (mgr.14388) 17384 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:21.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:21 smithi163 bash[24253]: audit 2024-08-31T08:53:20.988768+0000 mon.a (mon.0) 3172 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:53:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:21 smithi027 bash[22610]: cluster 2024-08-31T08:53:19.835587+0000 mgr.a (mgr.14388) 17384 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:21 smithi027 bash[22610]: audit 2024-08-31T08:53:20.988768+0000 mon.a (mon.0) 3172 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:53:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:21 smithi191 bash[24992]: cluster 2024-08-31T08:53:19.835587+0000 mgr.a (mgr.14388) 17384 : cluster [DBG] pgmap v12053: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:21 smithi191 bash[24992]: audit 2024-08-31T08:53:20.988768+0000 mon.a (mon.0) 3172 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:53:22.371 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:53:22.371 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:53:22.371 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:53:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:22 smithi163 bash[24253]: audit 2024-08-31T08:53:21.827862+0000 mon.a (mon.0) 3173 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:53:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:22 smithi163 bash[24253]: audit 2024-08-31T08:53:21.829443+0000 mon.a (mon.0) 3174 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:53:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:22 smithi163 bash[24253]: audit 2024-08-31T08:53:21.840389+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:53:22.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:22 smithi163 bash[24253]: audit 2024-08-31T08:53:21.845176+0000 mon.a (mon.0) 3176 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:53:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:22 smithi027 bash[22610]: audit 2024-08-31T08:53:21.827862+0000 mon.a (mon.0) 3173 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:53:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:22 smithi027 bash[22610]: audit 2024-08-31T08:53:21.829443+0000 mon.a (mon.0) 3174 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:53:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:22 smithi027 bash[22610]: audit 2024-08-31T08:53:21.840389+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:53:22.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:22 smithi027 bash[22610]: audit 2024-08-31T08:53:21.845176+0000 mon.a (mon.0) 3176 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:53:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:22 smithi191 bash[24992]: audit 2024-08-31T08:53:21.827862+0000 mon.a (mon.0) 3173 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:53:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:22 smithi191 bash[24992]: audit 2024-08-31T08:53:21.829443+0000 mon.a (mon.0) 3174 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:53:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:22 smithi191 bash[24992]: audit 2024-08-31T08:53:21.840389+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:53:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:22 smithi191 bash[24992]: audit 2024-08-31T08:53:21.845176+0000 mon.a (mon.0) 3176 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:53:22.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:53:22 smithi027 bash[22863]: debug 2024-08-31T08:53:22.573+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:53:22.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:53:22 smithi027 bash[22863]: debug 2024-08-31T08:53:22.577+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:53:23.108 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:23.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:23 smithi163 bash[24253]: cluster 2024-08-31T08:53:21.836341+0000 mgr.a (mgr.14388) 17385 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:23.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:23 smithi163 bash[24253]: audit 2024-08-31T08:53:21.847583+0000 mgr.a (mgr.14388) 17386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:53:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:23 smithi027 bash[22610]: cluster 2024-08-31T08:53:21.836341+0000 mgr.a (mgr.14388) 17385 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:23 smithi027 bash[22610]: audit 2024-08-31T08:53:21.847583+0000 mgr.a (mgr.14388) 17386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:53:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:23 smithi191 bash[24992]: cluster 2024-08-31T08:53:21.836341+0000 mgr.a (mgr.14388) 17385 : cluster [DBG] pgmap v12054: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:23 smithi191 bash[24992]: audit 2024-08-31T08:53:21.847583+0000 mgr.a (mgr.14388) 17386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:53:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:24 smithi163 bash[24253]: audit 2024-08-31T08:53:22.578618+0000 mgr.a (mgr.14388) 17387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:53:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:24 smithi163 bash[24253]: cephadm 2024-08-31T08:53:22.580346+0000 mgr.a (mgr.14388) 17388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:53:24.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:24 smithi163 bash[24253]: audit 2024-08-31T08:53:22.690194+0000 mgr.a (mgr.14388) 17389 : audit [DBG] from='client.374841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:24 smithi027 bash[22610]: audit 2024-08-31T08:53:22.578618+0000 mgr.a (mgr.14388) 17387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:53:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:24 smithi027 bash[22610]: cephadm 2024-08-31T08:53:22.580346+0000 mgr.a (mgr.14388) 17388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:53:24.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:24 smithi027 bash[22610]: audit 2024-08-31T08:53:22.690194+0000 mgr.a (mgr.14388) 17389 : audit [DBG] from='client.374841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:24 smithi191 bash[24992]: audit 2024-08-31T08:53:22.578618+0000 mgr.a (mgr.14388) 17387 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:53:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:24 smithi191 bash[24992]: cephadm 2024-08-31T08:53:22.580346+0000 mgr.a (mgr.14388) 17388 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:53:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:24 smithi191 bash[24992]: audit 2024-08-31T08:53:22.690194+0000 mgr.a (mgr.14388) 17389 : audit [DBG] from='client.374841 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:25 smithi163 bash[24253]: cluster 2024-08-31T08:53:23.839063+0000 mgr.a (mgr.14388) 17390 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:53:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:25 smithi027 bash[22610]: cluster 2024-08-31T08:53:23.839063+0000 mgr.a (mgr.14388) 17390 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:53:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:25 smithi191 bash[24992]: cluster 2024-08-31T08:53:23.839063+0000 mgr.a (mgr.14388) 17390 : cluster [DBG] pgmap v12055: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:53:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:27 smithi163 bash[24253]: cluster 2024-08-31T08:53:25.839828+0000 mgr.a (mgr.14388) 17391 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:53:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:27 smithi027 bash[22610]: cluster 2024-08-31T08:53:25.839828+0000 mgr.a (mgr.14388) 17391 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:53:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:27 smithi191 bash[24992]: cluster 2024-08-31T08:53:25.839828+0000 mgr.a (mgr.14388) 17391 : cluster [DBG] pgmap v12056: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:53:28.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:53:28.110 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:53:28.110 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:53:28.874 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:28.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:28.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:28.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:28.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:29 smithi163 bash[24253]: cluster 2024-08-31T08:53:27.840593+0000 mgr.a (mgr.14388) 17392 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:53:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:29 smithi027 bash[22610]: cluster 2024-08-31T08:53:27.840593+0000 mgr.a (mgr.14388) 17392 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:53:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:29 smithi191 bash[24992]: cluster 2024-08-31T08:53:27.840593+0000 mgr.a (mgr.14388) 17392 : cluster [DBG] pgmap v12057: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.3 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:53:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:30 smithi163 bash[24253]: audit 2024-08-31T08:53:28.439530+0000 mgr.a (mgr.14388) 17393 : audit [DBG] from='client.374916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:30 smithi027 bash[22610]: audit 2024-08-31T08:53:28.439530+0000 mgr.a (mgr.14388) 17393 : audit [DBG] from='client.374916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:30 smithi191 bash[24992]: audit 2024-08-31T08:53:28.439530+0000 mgr.a (mgr.14388) 17393 : audit [DBG] from='client.374916 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:31 smithi163 bash[24253]: cluster 2024-08-31T08:53:29.843243+0000 mgr.a (mgr.14388) 17394 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:53:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:31 smithi027 bash[22610]: cluster 2024-08-31T08:53:29.843243+0000 mgr.a (mgr.14388) 17394 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:53:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:31 smithi191 bash[24992]: cluster 2024-08-31T08:53:29.843243+0000 mgr.a (mgr.14388) 17394 : cluster [DBG] pgmap v12058: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:53:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:33 smithi163 bash[24253]: cluster 2024-08-31T08:53:31.844021+0000 mgr.a (mgr.14388) 17395 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:53:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:33 smithi027 bash[22610]: cluster 2024-08-31T08:53:31.844021+0000 mgr.a (mgr.14388) 17395 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:53:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:33 smithi191 bash[24992]: cluster 2024-08-31T08:53:31.844021+0000 mgr.a (mgr.14388) 17395 : cluster [DBG] pgmap v12059: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:53:33.876 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:53:33.876 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:53:33.876 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:53:34.655 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:34.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:34.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:34.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:34.655 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:35 smithi163 bash[24253]: cluster 2024-08-31T08:53:33.846037+0000 mgr.a (mgr.14388) 17396 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:53:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:35 smithi163 bash[24253]: audit 2024-08-31T08:53:34.209558+0000 mgr.a (mgr.14388) 17397 : audit [DBG] from='client.374994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:35 smithi027 bash[22610]: cluster 2024-08-31T08:53:33.846037+0000 mgr.a (mgr.14388) 17396 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:53:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:35 smithi027 bash[22610]: audit 2024-08-31T08:53:34.209558+0000 mgr.a (mgr.14388) 17397 : audit [DBG] from='client.374994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:35 smithi191 bash[24992]: cluster 2024-08-31T08:53:33.846037+0000 mgr.a (mgr.14388) 17396 : cluster [DBG] pgmap v12060: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:53:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:35 smithi191 bash[24992]: audit 2024-08-31T08:53:34.209558+0000 mgr.a (mgr.14388) 17397 : audit [DBG] from='client.374994 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:37 smithi027 bash[22610]: cluster 2024-08-31T08:53:35.846970+0000 mgr.a (mgr.14388) 17398 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:53:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:37 smithi191 bash[24992]: cluster 2024-08-31T08:53:35.846970+0000 mgr.a (mgr.14388) 17398 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:53:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:37 smithi163 bash[24253]: cluster 2024-08-31T08:53:35.846970+0000 mgr.a (mgr.14388) 17398 : cluster [DBG] pgmap v12061: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:53:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:39 smithi027 bash[22610]: cluster 2024-08-31T08:53:37.847693+0000 mgr.a (mgr.14388) 17399 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:53:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:39 smithi191 bash[24992]: cluster 2024-08-31T08:53:37.847693+0000 mgr.a (mgr.14388) 17399 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:53:39.656 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:53:39.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:53:39.657 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:53:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:39 smithi163 bash[24253]: cluster 2024-08-31T08:53:37.847693+0000 mgr.a (mgr.14388) 17399 : cluster [DBG] pgmap v12062: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:53:40.411 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:40.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:40.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:40.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:40.411 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:41 smithi027 bash[22610]: cluster 2024-08-31T08:53:39.849843+0000 mgr.a (mgr.14388) 17400 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:53:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:41 smithi027 bash[22610]: audit 2024-08-31T08:53:39.984952+0000 mgr.a (mgr.14388) 17401 : audit [DBG] from='client.375069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:41 smithi191 bash[24992]: cluster 2024-08-31T08:53:39.849843+0000 mgr.a (mgr.14388) 17400 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:53:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:41 smithi191 bash[24992]: audit 2024-08-31T08:53:39.984952+0000 mgr.a (mgr.14388) 17401 : audit [DBG] from='client.375069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:41 smithi163 bash[24253]: cluster 2024-08-31T08:53:39.849843+0000 mgr.a (mgr.14388) 17400 : cluster [DBG] pgmap v12063: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:53:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:41 smithi163 bash[24253]: audit 2024-08-31T08:53:39.984952+0000 mgr.a (mgr.14388) 17401 : audit [DBG] from='client.375069 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:43 smithi027 bash[22610]: cluster 2024-08-31T08:53:41.850776+0000 mgr.a (mgr.14388) 17402 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:43 smithi191 bash[24992]: cluster 2024-08-31T08:53:41.850776+0000 mgr.a (mgr.14388) 17402 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:43 smithi163 bash[24253]: cluster 2024-08-31T08:53:41.850776+0000 mgr.a (mgr.14388) 17402 : cluster [DBG] pgmap v12064: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:45.412 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:53:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:53:45.413 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:53:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:45 smithi027 bash[22610]: cluster 2024-08-31T08:53:43.853043+0000 mgr.a (mgr.14388) 17403 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:45.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:45 smithi191 bash[24992]: cluster 2024-08-31T08:53:43.853043+0000 mgr.a (mgr.14388) 17403 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:45 smithi163 bash[24253]: cluster 2024-08-31T08:53:43.853043+0000 mgr.a (mgr.14388) 17403 : cluster [DBG] pgmap v12065: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:46.180 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:46.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:46.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:46.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:46.180 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:47 smithi027 bash[22610]: audit 2024-08-31T08:53:45.748934+0000 mgr.a (mgr.14388) 17404 : audit [DBG] from='client.375144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:47 smithi027 bash[22610]: cluster 2024-08-31T08:53:45.853602+0000 mgr.a (mgr.14388) 17405 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:47 smithi191 bash[24992]: audit 2024-08-31T08:53:45.748934+0000 mgr.a (mgr.14388) 17404 : audit [DBG] from='client.375144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:47 smithi191 bash[24992]: cluster 2024-08-31T08:53:45.853602+0000 mgr.a (mgr.14388) 17405 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:47 smithi163 bash[24253]: audit 2024-08-31T08:53:45.748934+0000 mgr.a (mgr.14388) 17404 : audit [DBG] from='client.375144 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:47 smithi163 bash[24253]: cluster 2024-08-31T08:53:45.853602+0000 mgr.a (mgr.14388) 17405 : cluster [DBG] pgmap v12066: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:49 smithi027 bash[22610]: cluster 2024-08-31T08:53:47.854500+0000 mgr.a (mgr.14388) 17406 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:49 smithi191 bash[24992]: cluster 2024-08-31T08:53:47.854500+0000 mgr.a (mgr.14388) 17406 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:49 smithi163 bash[24253]: cluster 2024-08-31T08:53:47.854500+0000 mgr.a (mgr.14388) 17406 : cluster [DBG] pgmap v12067: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:51.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:53:51.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:53:51.182 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:53:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:51 smithi027 bash[22610]: cluster 2024-08-31T08:53:49.856727+0000 mgr.a (mgr.14388) 17407 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:51 smithi191 bash[24992]: cluster 2024-08-31T08:53:49.856727+0000 mgr.a (mgr.14388) 17407 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:51.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:51 smithi163 bash[24253]: cluster 2024-08-31T08:53:49.856727+0000 mgr.a (mgr.14388) 17407 : cluster [DBG] pgmap v12068: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:51.964 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:51.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:51.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:51.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:51.965 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:53 smithi191 bash[24992]: audit 2024-08-31T08:53:51.522181+0000 mgr.a (mgr.14388) 17408 : audit [DBG] from='client.375222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:53.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:53 smithi191 bash[24992]: cluster 2024-08-31T08:53:51.863673+0000 mgr.a (mgr.14388) 17409 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:53 smithi163 bash[24253]: audit 2024-08-31T08:53:51.522181+0000 mgr.a (mgr.14388) 17408 : audit [DBG] from='client.375222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:53 smithi163 bash[24253]: cluster 2024-08-31T08:53:51.863673+0000 mgr.a (mgr.14388) 17409 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:53 smithi027 bash[22610]: audit 2024-08-31T08:53:51.522181+0000 mgr.a (mgr.14388) 17408 : audit [DBG] from='client.375222 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:53.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:53 smithi027 bash[22610]: cluster 2024-08-31T08:53:51.863673+0000 mgr.a (mgr.14388) 17409 : cluster [DBG] pgmap v12069: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:55 smithi191 bash[24992]: cluster 2024-08-31T08:53:53.865915+0000 mgr.a (mgr.14388) 17410 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:55 smithi163 bash[24253]: cluster 2024-08-31T08:53:53.865915+0000 mgr.a (mgr.14388) 17410 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:55 smithi027 bash[22610]: cluster 2024-08-31T08:53:53.865915+0000 mgr.a (mgr.14388) 17410 : cluster [DBG] pgmap v12070: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:53:56.966 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:53:56.967 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:53:56.967 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:53:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:57 smithi191 bash[24992]: cluster 2024-08-31T08:53:55.866668+0000 mgr.a (mgr.14388) 17411 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:57 smithi163 bash[24253]: cluster 2024-08-31T08:53:55.866668+0000 mgr.a (mgr.14388) 17411 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:57 smithi027 bash[22610]: cluster 2024-08-31T08:53:55.866668+0000 mgr.a (mgr.14388) 17411 : cluster [DBG] pgmap v12071: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:57.749 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:53:57.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:53:57.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:53:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:53:57.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:53:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:58 smithi191 bash[24992]: audit 2024-08-31T08:53:57.308438+0000 mgr.a (mgr.14388) 17412 : audit [DBG] from='client.375294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:58 smithi163 bash[24253]: audit 2024-08-31T08:53:57.308438+0000 mgr.a (mgr.14388) 17412 : audit [DBG] from='client.375294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:58 smithi027 bash[22610]: audit 2024-08-31T08:53:57.308438+0000 mgr.a (mgr.14388) 17412 : audit [DBG] from='client.375294 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:53:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:53:59 smithi191 bash[24992]: cluster 2024-08-31T08:53:57.867413+0000 mgr.a (mgr.14388) 17413 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:53:59 smithi163 bash[24253]: cluster 2024-08-31T08:53:57.867413+0000 mgr.a (mgr.14388) 17413 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:53:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:53:59 smithi027 bash[22610]: cluster 2024-08-31T08:53:57.867413+0000 mgr.a (mgr.14388) 17413 : cluster [DBG] pgmap v12072: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:01 smithi191 bash[24992]: cluster 2024-08-31T08:53:59.869618+0000 mgr.a (mgr.14388) 17414 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:54:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:01 smithi163 bash[24253]: cluster 2024-08-31T08:53:59.869618+0000 mgr.a (mgr.14388) 17414 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:54:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:01 smithi027 bash[22610]: cluster 2024-08-31T08:53:59.869618+0000 mgr.a (mgr.14388) 17414 : cluster [DBG] pgmap v12073: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:54:02.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:54:02.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:54:02.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:54:03.538 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:54:03.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:54:03.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:54:03.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:54:03.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:54:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:03 smithi191 bash[24992]: cluster 2024-08-31T08:54:01.870360+0000 mgr.a (mgr.14388) 17415 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:03 smithi163 bash[24253]: cluster 2024-08-31T08:54:01.870360+0000 mgr.a (mgr.14388) 17415 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:03 smithi027 bash[22610]: cluster 2024-08-31T08:54:01.870360+0000 mgr.a (mgr.14388) 17415 : cluster [DBG] pgmap v12074: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:04 smithi191 bash[24992]: audit 2024-08-31T08:54:03.089134+0000 mgr.a (mgr.14388) 17416 : audit [DBG] from='client.375369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:04 smithi163 bash[24253]: audit 2024-08-31T08:54:03.089134+0000 mgr.a (mgr.14388) 17416 : audit [DBG] from='client.375369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:04 smithi027 bash[22610]: audit 2024-08-31T08:54:03.089134+0000 mgr.a (mgr.14388) 17416 : audit [DBG] from='client.375369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:05 smithi191 bash[24992]: cluster 2024-08-31T08:54:03.873069+0000 mgr.a (mgr.14388) 17417 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:05 smithi163 bash[24253]: cluster 2024-08-31T08:54:03.873069+0000 mgr.a (mgr.14388) 17417 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:05 smithi027 bash[22610]: cluster 2024-08-31T08:54:03.873069+0000 mgr.a (mgr.14388) 17417 : cluster [DBG] pgmap v12075: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:07 smithi191 bash[24992]: cluster 2024-08-31T08:54:05.873848+0000 mgr.a (mgr.14388) 17418 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:54:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:07 smithi163 bash[24253]: cluster 2024-08-31T08:54:05.873848+0000 mgr.a (mgr.14388) 17418 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:54:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:07 smithi027 bash[22610]: cluster 2024-08-31T08:54:05.873848+0000 mgr.a (mgr.14388) 17418 : cluster [DBG] pgmap v12076: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:54:08.539 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:54:08.540 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:54:08.540 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:54:09.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:54:09.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:54:09.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:54:09.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:54:09.301 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:54:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:09 smithi191 bash[24992]: cluster 2024-08-31T08:54:07.874529+0000 mgr.a (mgr.14388) 17419 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:54:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:09 smithi163 bash[24253]: cluster 2024-08-31T08:54:07.874529+0000 mgr.a (mgr.14388) 17419 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:54:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:09 smithi027 bash[22610]: cluster 2024-08-31T08:54:07.874529+0000 mgr.a (mgr.14388) 17419 : cluster [DBG] pgmap v12077: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:54:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:10 smithi191 bash[24992]: audit 2024-08-31T08:54:08.870310+0000 mgr.a (mgr.14388) 17420 : audit [DBG] from='client.375444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:10 smithi163 bash[24253]: audit 2024-08-31T08:54:08.870310+0000 mgr.a (mgr.14388) 17420 : audit [DBG] from='client.375444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:10 smithi027 bash[22610]: audit 2024-08-31T08:54:08.870310+0000 mgr.a (mgr.14388) 17420 : audit [DBG] from='client.375444 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:11 smithi163 bash[24253]: cluster 2024-08-31T08:54:09.877262+0000 mgr.a (mgr.14388) 17421 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:11 smithi027 bash[22610]: cluster 2024-08-31T08:54:09.877262+0000 mgr.a (mgr.14388) 17421 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:11 smithi191 bash[24992]: cluster 2024-08-31T08:54:09.877262+0000 mgr.a (mgr.14388) 17421 : cluster [DBG] pgmap v12078: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:13 smithi163 bash[24253]: cluster 2024-08-31T08:54:11.877970+0000 mgr.a (mgr.14388) 17422 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:54:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:13 smithi027 bash[22610]: cluster 2024-08-31T08:54:11.877970+0000 mgr.a (mgr.14388) 17422 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:54:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:13 smithi191 bash[24992]: cluster 2024-08-31T08:54:11.877970+0000 mgr.a (mgr.14388) 17422 : cluster [DBG] pgmap v12079: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:54:14.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:54:14.303 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:54:14.303 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:54:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:54:15.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:54:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:54:15.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:54:15.079 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:54:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:15 smithi163 bash[24253]: cluster 2024-08-31T08:54:13.879992+0000 mgr.a (mgr.14388) 17423 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:15 smithi027 bash[22610]: cluster 2024-08-31T08:54:13.879992+0000 mgr.a (mgr.14388) 17423 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:15 smithi191 bash[24992]: cluster 2024-08-31T08:54:13.879992+0000 mgr.a (mgr.14388) 17423 : cluster [DBG] pgmap v12080: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:16 smithi163 bash[24253]: audit 2024-08-31T08:54:14.637730+0000 mgr.a (mgr.14388) 17424 : audit [DBG] from='client.375519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:16 smithi027 bash[22610]: audit 2024-08-31T08:54:14.637730+0000 mgr.a (mgr.14388) 17424 : audit [DBG] from='client.375519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:16 smithi191 bash[24992]: audit 2024-08-31T08:54:14.637730+0000 mgr.a (mgr.14388) 17424 : audit [DBG] from='client.375519 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:17 smithi163 bash[24253]: cluster 2024-08-31T08:54:15.880873+0000 mgr.a (mgr.14388) 17425 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:17 smithi027 bash[22610]: cluster 2024-08-31T08:54:15.880873+0000 mgr.a (mgr.14388) 17425 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:17 smithi191 bash[24992]: cluster 2024-08-31T08:54:15.880873+0000 mgr.a (mgr.14388) 17425 : cluster [DBG] pgmap v12081: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:19.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:19 smithi163 bash[24253]: cluster 2024-08-31T08:54:17.881820+0000 mgr.a (mgr.14388) 17426 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:19 smithi027 bash[22610]: cluster 2024-08-31T08:54:17.881820+0000 mgr.a (mgr.14388) 17426 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:19 smithi191 bash[24992]: cluster 2024-08-31T08:54:17.881820+0000 mgr.a (mgr.14388) 17426 : cluster [DBG] pgmap v12082: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:20.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:54:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:54:20.081 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:54:20.856 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:54:20.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:54:20.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:54:20.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:54:20.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:54:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:21 smithi163 bash[24253]: cluster 2024-08-31T08:54:19.884199+0000 mgr.a (mgr.14388) 17427 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:54:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:21 smithi027 bash[22610]: cluster 2024-08-31T08:54:19.884199+0000 mgr.a (mgr.14388) 17427 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:54:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:21 smithi191 bash[24992]: cluster 2024-08-31T08:54:19.884199+0000 mgr.a (mgr.14388) 17427 : cluster [DBG] pgmap v12083: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:54:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:22 smithi163 bash[24253]: audit 2024-08-31T08:54:20.415026+0000 mgr.a (mgr.14388) 17428 : audit [DBG] from='client.375597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:22 smithi027 bash[22610]: audit 2024-08-31T08:54:20.415026+0000 mgr.a (mgr.14388) 17428 : audit [DBG] from='client.375597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:22 smithi191 bash[24992]: audit 2024-08-31T08:54:20.415026+0000 mgr.a (mgr.14388) 17428 : audit [DBG] from='client.375597 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:23 smithi163 bash[24253]: cluster 2024-08-31T08:54:21.885142+0000 mgr.a (mgr.14388) 17429 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:23 smithi163 bash[24253]: audit 2024-08-31T08:54:22.632638+0000 mon.a (mon.0) 3177 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:54:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:23 smithi027 bash[22610]: cluster 2024-08-31T08:54:21.885142+0000 mgr.a (mgr.14388) 17429 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:23 smithi027 bash[22610]: audit 2024-08-31T08:54:22.632638+0000 mon.a (mon.0) 3177 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:54:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:23 smithi191 bash[24992]: cluster 2024-08-31T08:54:21.885142+0000 mgr.a (mgr.14388) 17429 : cluster [DBG] pgmap v12084: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:23 smithi191 bash[24992]: audit 2024-08-31T08:54:22.632638+0000 mon.a (mon.0) 3177 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:54:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:24 smithi163 bash[24253]: audit 2024-08-31T08:54:23.478324+0000 mon.a (mon.0) 3178 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:54:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:24 smithi163 bash[24253]: audit 2024-08-31T08:54:23.479975+0000 mon.a (mon.0) 3179 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:54:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:24 smithi163 bash[24253]: audit 2024-08-31T08:54:23.490067+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:54:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:24 smithi163 bash[24253]: audit 2024-08-31T08:54:23.494854+0000 mon.a (mon.0) 3181 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:54:24.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:54:24 smithi027 bash[22863]: debug 2024-08-31T08:54:24.260+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:54:24.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:54:24 smithi027 bash[22863]: debug 2024-08-31T08:54:24.260+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:54:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:24 smithi027 bash[22610]: audit 2024-08-31T08:54:23.478324+0000 mon.a (mon.0) 3178 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:54:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:24 smithi027 bash[22610]: audit 2024-08-31T08:54:23.479975+0000 mon.a (mon.0) 3179 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:54:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:24 smithi027 bash[22610]: audit 2024-08-31T08:54:23.490067+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:54:24.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:24 smithi027 bash[22610]: audit 2024-08-31T08:54:23.494854+0000 mon.a (mon.0) 3181 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:54:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:24 smithi191 bash[24992]: audit 2024-08-31T08:54:23.478324+0000 mon.a (mon.0) 3178 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:54:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:24 smithi191 bash[24992]: audit 2024-08-31T08:54:23.479975+0000 mon.a (mon.0) 3179 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:54:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:24 smithi191 bash[24992]: audit 2024-08-31T08:54:23.490067+0000 mon.a (mon.0) 3180 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:54:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:24 smithi191 bash[24992]: audit 2024-08-31T08:54:23.494854+0000 mon.a (mon.0) 3181 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:54:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:25 smithi163 bash[24253]: audit 2024-08-31T08:54:23.496017+0000 mgr.a (mgr.14388) 17430 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:54:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:25 smithi163 bash[24253]: cluster 2024-08-31T08:54:23.886434+0000 mgr.a (mgr.14388) 17431 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:54:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:25 smithi163 bash[24253]: audit 2024-08-31T08:54:24.263146+0000 mgr.a (mgr.14388) 17432 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:54:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:25 smithi163 bash[24253]: cephadm 2024-08-31T08:54:24.264655+0000 mgr.a (mgr.14388) 17433 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:54:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:25 smithi027 bash[22610]: audit 2024-08-31T08:54:23.496017+0000 mgr.a (mgr.14388) 17430 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:54:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:25 smithi027 bash[22610]: cluster 2024-08-31T08:54:23.886434+0000 mgr.a (mgr.14388) 17431 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:54:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:25 smithi027 bash[22610]: audit 2024-08-31T08:54:24.263146+0000 mgr.a (mgr.14388) 17432 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:54:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:25 smithi027 bash[22610]: cephadm 2024-08-31T08:54:24.264655+0000 mgr.a (mgr.14388) 17433 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:54:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:25 smithi191 bash[24992]: audit 2024-08-31T08:54:23.496017+0000 mgr.a (mgr.14388) 17430 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:54:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:25 smithi191 bash[24992]: cluster 2024-08-31T08:54:23.886434+0000 mgr.a (mgr.14388) 17431 : cluster [DBG] pgmap v12085: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:54:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:25 smithi191 bash[24992]: audit 2024-08-31T08:54:24.263146+0000 mgr.a (mgr.14388) 17432 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:54:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:25 smithi191 bash[24992]: cephadm 2024-08-31T08:54:24.264655+0000 mgr.a (mgr.14388) 17433 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:54:25.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:54:25.862 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:54:25.863 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:54:26.613 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:54:26.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:54:26.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:54:26.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:54:26.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:54:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:27 smithi163 bash[24253]: cluster 2024-08-31T08:54:25.887309+0000 mgr.a (mgr.14388) 17434 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:27 smithi163 bash[24253]: audit 2024-08-31T08:54:26.188058+0000 mgr.a (mgr.14388) 17435 : audit [DBG] from='client.375783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:27 smithi027 bash[22610]: cluster 2024-08-31T08:54:25.887309+0000 mgr.a (mgr.14388) 17434 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:27 smithi027 bash[22610]: audit 2024-08-31T08:54:26.188058+0000 mgr.a (mgr.14388) 17435 : audit [DBG] from='client.375783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:27 smithi191 bash[24992]: cluster 2024-08-31T08:54:25.887309+0000 mgr.a (mgr.14388) 17434 : cluster [DBG] pgmap v12086: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:27 smithi191 bash[24992]: audit 2024-08-31T08:54:26.188058+0000 mgr.a (mgr.14388) 17435 : audit [DBG] from='client.375783 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:29 smithi163 bash[24253]: cluster 2024-08-31T08:54:27.888204+0000 mgr.a (mgr.14388) 17436 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:29 smithi027 bash[22610]: cluster 2024-08-31T08:54:27.888204+0000 mgr.a (mgr.14388) 17436 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:29 smithi191 bash[24992]: cluster 2024-08-31T08:54:27.888204+0000 mgr.a (mgr.14388) 17436 : cluster [DBG] pgmap v12087: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:31.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:54:31.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:54:31.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:54:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:31 smithi163 bash[24253]: cluster 2024-08-31T08:54:29.890461+0000 mgr.a (mgr.14388) 17437 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:31 smithi027 bash[22610]: cluster 2024-08-31T08:54:29.890461+0000 mgr.a (mgr.14388) 17437 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:31 smithi191 bash[24992]: cluster 2024-08-31T08:54:29.890461+0000 mgr.a (mgr.14388) 17437 : cluster [DBG] pgmap v12088: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:32.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:54:32.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:54:32.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:54:32.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:54:32.361 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:54:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:33 smithi163 bash[24253]: cluster 2024-08-31T08:54:31.891201+0000 mgr.a (mgr.14388) 17438 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:33 smithi163 bash[24253]: audit 2024-08-31T08:54:31.942181+0000 mgr.a (mgr.14388) 17439 : audit [DBG] from='client.375861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:33 smithi027 bash[22610]: cluster 2024-08-31T08:54:31.891201+0000 mgr.a (mgr.14388) 17438 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:33 smithi027 bash[22610]: audit 2024-08-31T08:54:31.942181+0000 mgr.a (mgr.14388) 17439 : audit [DBG] from='client.375861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:33 smithi191 bash[24992]: cluster 2024-08-31T08:54:31.891201+0000 mgr.a (mgr.14388) 17438 : cluster [DBG] pgmap v12089: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:33 smithi191 bash[24992]: audit 2024-08-31T08:54:31.942181+0000 mgr.a (mgr.14388) 17439 : audit [DBG] from='client.375861 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:35 smithi163 bash[24253]: cluster 2024-08-31T08:54:33.893573+0000 mgr.a (mgr.14388) 17440 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:35 smithi027 bash[22610]: cluster 2024-08-31T08:54:33.893573+0000 mgr.a (mgr.14388) 17440 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:35 smithi191 bash[24992]: cluster 2024-08-31T08:54:33.893573+0000 mgr.a (mgr.14388) 17440 : cluster [DBG] pgmap v12090: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:37.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:54:37.362 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:54:37.362 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:54:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:37 smithi163 bash[24253]: cluster 2024-08-31T08:54:35.894507+0000 mgr.a (mgr.14388) 17441 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:37 smithi027 bash[22610]: cluster 2024-08-31T08:54:35.894507+0000 mgr.a (mgr.14388) 17441 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:37 smithi191 bash[24992]: cluster 2024-08-31T08:54:35.894507+0000 mgr.a (mgr.14388) 17441 : cluster [DBG] pgmap v12091: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:38.111 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:54:38.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:54:38.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:54:38.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:54:38.112 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:54:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:39 smithi163 bash[24253]: audit 2024-08-31T08:54:37.695672+0000 mgr.a (mgr.14388) 17442 : audit [DBG] from='client.375939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:39.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:39 smithi163 bash[24253]: cluster 2024-08-31T08:54:37.895066+0000 mgr.a (mgr.14388) 17443 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:39 smithi027 bash[22610]: audit 2024-08-31T08:54:37.695672+0000 mgr.a (mgr.14388) 17442 : audit [DBG] from='client.375939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:39 smithi027 bash[22610]: cluster 2024-08-31T08:54:37.895066+0000 mgr.a (mgr.14388) 17443 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:39 smithi191 bash[24992]: audit 2024-08-31T08:54:37.695672+0000 mgr.a (mgr.14388) 17442 : audit [DBG] from='client.375939 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:39 smithi191 bash[24992]: cluster 2024-08-31T08:54:37.895066+0000 mgr.a (mgr.14388) 17443 : cluster [DBG] pgmap v12092: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:40 smithi163 bash[24253]: cluster 2024-08-31T08:54:39.897986+0000 mgr.a (mgr.14388) 17444 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:40 smithi027 bash[22610]: cluster 2024-08-31T08:54:39.897986+0000 mgr.a (mgr.14388) 17444 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:40 smithi191 bash[24992]: cluster 2024-08-31T08:54:39.897986+0000 mgr.a (mgr.14388) 17444 : cluster [DBG] pgmap v12093: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:54:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:54:43.113 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:54:43.114 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:54:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:42 smithi027 bash[22610]: cluster 2024-08-31T08:54:41.898847+0000 mgr.a (mgr.14388) 17445 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:54:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:42 smithi191 bash[24992]: cluster 2024-08-31T08:54:41.898847+0000 mgr.a (mgr.14388) 17445 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:54:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:42 smithi163 bash[24253]: cluster 2024-08-31T08:54:41.898847+0000 mgr.a (mgr.14388) 17445 : cluster [DBG] pgmap v12094: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:54:43.884 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:54:43.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:54:43.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:54:43.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:54:43.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:54:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:44 smithi027 bash[22610]: audit 2024-08-31T08:54:43.446060+0000 mgr.a (mgr.14388) 17446 : audit [DBG] from='client.376017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:44 smithi027 bash[22610]: cluster 2024-08-31T08:54:43.900117+0000 mgr.a (mgr.14388) 17447 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:44 smithi191 bash[24992]: audit 2024-08-31T08:54:43.446060+0000 mgr.a (mgr.14388) 17446 : audit [DBG] from='client.376017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:44 smithi191 bash[24992]: cluster 2024-08-31T08:54:43.900117+0000 mgr.a (mgr.14388) 17447 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:44 smithi163 bash[24253]: audit 2024-08-31T08:54:43.446060+0000 mgr.a (mgr.14388) 17446 : audit [DBG] from='client.376017 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:44 smithi163 bash[24253]: cluster 2024-08-31T08:54:43.900117+0000 mgr.a (mgr.14388) 17447 : cluster [DBG] pgmap v12095: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:46 smithi027 bash[22610]: cluster 2024-08-31T08:54:45.900840+0000 mgr.a (mgr.14388) 17448 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:54:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:46 smithi191 bash[24992]: cluster 2024-08-31T08:54:45.900840+0000 mgr.a (mgr.14388) 17448 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:54:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:46 smithi163 bash[24253]: cluster 2024-08-31T08:54:45.900840+0000 mgr.a (mgr.14388) 17448 : cluster [DBG] pgmap v12096: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:54:48.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:54:48.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:54:48.887 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:54:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:49 smithi163 bash[24253]: cluster 2024-08-31T08:54:47.901610+0000 mgr.a (mgr.14388) 17449 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:54:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:49 smithi027 bash[22610]: cluster 2024-08-31T08:54:47.901610+0000 mgr.a (mgr.14388) 17449 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:54:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:49 smithi191 bash[24992]: cluster 2024-08-31T08:54:47.901610+0000 mgr.a (mgr.14388) 17449 : cluster [DBG] pgmap v12097: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:54:49.674 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:54:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:54:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:54:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:54:49.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:54:50.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:50 smithi163 bash[24253]: audit 2024-08-31T08:54:49.227623+0000 mgr.a (mgr.14388) 17450 : audit [DBG] from='client.376092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:50 smithi027 bash[22610]: audit 2024-08-31T08:54:49.227623+0000 mgr.a (mgr.14388) 17450 : audit [DBG] from='client.376092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:50 smithi191 bash[24992]: audit 2024-08-31T08:54:49.227623+0000 mgr.a (mgr.14388) 17450 : audit [DBG] from='client.376092 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:51 smithi163 bash[24253]: cluster 2024-08-31T08:54:49.904454+0000 mgr.a (mgr.14388) 17451 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:51 smithi027 bash[22610]: cluster 2024-08-31T08:54:49.904454+0000 mgr.a (mgr.14388) 17451 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:51 smithi191 bash[24992]: cluster 2024-08-31T08:54:49.904454+0000 mgr.a (mgr.14388) 17451 : cluster [DBG] pgmap v12098: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:53 smithi163 bash[24253]: cluster 2024-08-31T08:54:51.905235+0000 mgr.a (mgr.14388) 17452 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:54:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:53 smithi027 bash[22610]: cluster 2024-08-31T08:54:51.905235+0000 mgr.a (mgr.14388) 17452 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:54:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:53 smithi191 bash[24992]: cluster 2024-08-31T08:54:51.905235+0000 mgr.a (mgr.14388) 17452 : cluster [DBG] pgmap v12099: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:54:54.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:54:54.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:54:54.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:54:55.465 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:54:55.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:54:55.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:54:55.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:54:55.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:54:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:55 smithi027 bash[22610]: cluster 2024-08-31T08:54:53.907295+0000 mgr.a (mgr.14388) 17453 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:54:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:55 smithi191 bash[24992]: cluster 2024-08-31T08:54:53.907295+0000 mgr.a (mgr.14388) 17453 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:54:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:55 smithi163 bash[24253]: cluster 2024-08-31T08:54:53.907295+0000 mgr.a (mgr.14388) 17453 : cluster [DBG] pgmap v12100: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:54:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:56 smithi027 bash[22610]: audit 2024-08-31T08:54:55.015371+0000 mgr.a (mgr.14388) 17454 : audit [DBG] from='client.376164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:56 smithi191 bash[24992]: audit 2024-08-31T08:54:55.015371+0000 mgr.a (mgr.14388) 17454 : audit [DBG] from='client.376164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:56 smithi163 bash[24253]: audit 2024-08-31T08:54:55.015371+0000 mgr.a (mgr.14388) 17454 : audit [DBG] from='client.376164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:54:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:57 smithi027 bash[22610]: cluster 2024-08-31T08:54:55.908257+0000 mgr.a (mgr.14388) 17455 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:57 smithi191 bash[24992]: cluster 2024-08-31T08:54:55.908257+0000 mgr.a (mgr.14388) 17455 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:57 smithi163 bash[24253]: cluster 2024-08-31T08:54:55.908257+0000 mgr.a (mgr.14388) 17455 : cluster [DBG] pgmap v12101: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:54:59 smithi027 bash[22610]: cluster 2024-08-31T08:54:57.909051+0000 mgr.a (mgr.14388) 17456 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:54:59 smithi191 bash[24992]: cluster 2024-08-31T08:54:57.909051+0000 mgr.a (mgr.14388) 17456 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:54:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:54:59 smithi163 bash[24253]: cluster 2024-08-31T08:54:57.909051+0000 mgr.a (mgr.14388) 17456 : cluster [DBG] pgmap v12102: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:00.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:00.468 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:00.468 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:01.247 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:01.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:01.247 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:01.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:01.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:01 smithi027 bash[22610]: cluster 2024-08-31T08:54:59.911314+0000 mgr.a (mgr.14388) 17457 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:01.512 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:01 smithi163 bash[24253]: cluster 2024-08-31T08:54:59.911314+0000 mgr.a (mgr.14388) 17457 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:01 smithi191 bash[24992]: cluster 2024-08-31T08:54:59.911314+0000 mgr.a (mgr.14388) 17457 : cluster [DBG] pgmap v12103: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:02 smithi027 bash[22610]: audit 2024-08-31T08:55:00.801642+0000 mgr.a (mgr.14388) 17458 : audit [DBG] from='client.376242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:02 smithi191 bash[24992]: audit 2024-08-31T08:55:00.801642+0000 mgr.a (mgr.14388) 17458 : audit [DBG] from='client.376242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:02.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:02 smithi163 bash[24253]: audit 2024-08-31T08:55:00.801642+0000 mgr.a (mgr.14388) 17458 : audit [DBG] from='client.376242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:03 smithi027 bash[22610]: cluster 2024-08-31T08:55:01.912278+0000 mgr.a (mgr.14388) 17459 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:03 smithi191 bash[24992]: cluster 2024-08-31T08:55:01.912278+0000 mgr.a (mgr.14388) 17459 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:03 smithi163 bash[24253]: cluster 2024-08-31T08:55:01.912278+0000 mgr.a (mgr.14388) 17459 : cluster [DBG] pgmap v12104: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:05 smithi191 bash[24992]: cluster 2024-08-31T08:55:03.914575+0000 mgr.a (mgr.14388) 17460 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:05 smithi163 bash[24253]: cluster 2024-08-31T08:55:03.914575+0000 mgr.a (mgr.14388) 17460 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:05 smithi027 bash[22610]: cluster 2024-08-31T08:55:03.914575+0000 mgr.a (mgr.14388) 17460 : cluster [DBG] pgmap v12105: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:06.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:06.249 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:06.249 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:07.016 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:07.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:07.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:07.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:07.017 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:07 smithi191 bash[24992]: cluster 2024-08-31T08:55:05.915361+0000 mgr.a (mgr.14388) 17461 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:07 smithi163 bash[24253]: cluster 2024-08-31T08:55:05.915361+0000 mgr.a (mgr.14388) 17461 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:07 smithi027 bash[22610]: cluster 2024-08-31T08:55:05.915361+0000 mgr.a (mgr.14388) 17461 : cluster [DBG] pgmap v12106: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:08 smithi191 bash[24992]: audit 2024-08-31T08:55:06.583076+0000 mgr.a (mgr.14388) 17462 : audit [DBG] from='client.376320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:08 smithi163 bash[24253]: audit 2024-08-31T08:55:06.583076+0000 mgr.a (mgr.14388) 17462 : audit [DBG] from='client.376320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:08 smithi027 bash[22610]: audit 2024-08-31T08:55:06.583076+0000 mgr.a (mgr.14388) 17462 : audit [DBG] from='client.376320 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:09 smithi191 bash[24992]: cluster 2024-08-31T08:55:07.916249+0000 mgr.a (mgr.14388) 17463 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:09 smithi163 bash[24253]: cluster 2024-08-31T08:55:07.916249+0000 mgr.a (mgr.14388) 17463 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:09 smithi027 bash[22610]: cluster 2024-08-31T08:55:07.916249+0000 mgr.a (mgr.14388) 17463 : cluster [DBG] pgmap v12107: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:11 smithi191 bash[24992]: cluster 2024-08-31T08:55:09.918464+0000 mgr.a (mgr.14388) 17464 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:11 smithi163 bash[24253]: cluster 2024-08-31T08:55:09.918464+0000 mgr.a (mgr.14388) 17464 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:11 smithi027 bash[22610]: cluster 2024-08-31T08:55:09.918464+0000 mgr.a (mgr.14388) 17464 : cluster [DBG] pgmap v12108: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:12.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:12.019 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:12.019 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:12.764 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:12.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:12.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:12.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:12.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:13 smithi191 bash[24992]: cluster 2024-08-31T08:55:11.919268+0000 mgr.a (mgr.14388) 17465 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:13 smithi191 bash[24992]: audit 2024-08-31T08:55:12.352162+0000 mgr.a (mgr.14388) 17466 : audit [DBG] from='client.376395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:13 smithi163 bash[24253]: cluster 2024-08-31T08:55:11.919268+0000 mgr.a (mgr.14388) 17465 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:13.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:13 smithi163 bash[24253]: audit 2024-08-31T08:55:12.352162+0000 mgr.a (mgr.14388) 17466 : audit [DBG] from='client.376395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:13 smithi027 bash[22610]: cluster 2024-08-31T08:55:11.919268+0000 mgr.a (mgr.14388) 17465 : cluster [DBG] pgmap v12109: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:13 smithi027 bash[22610]: audit 2024-08-31T08:55:12.352162+0000 mgr.a (mgr.14388) 17466 : audit [DBG] from='client.376395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:15 smithi191 bash[24992]: cluster 2024-08-31T08:55:13.921686+0000 mgr.a (mgr.14388) 17467 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:15 smithi163 bash[24253]: cluster 2024-08-31T08:55:13.921686+0000 mgr.a (mgr.14388) 17467 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:15 smithi027 bash[22610]: cluster 2024-08-31T08:55:13.921686+0000 mgr.a (mgr.14388) 17467 : cluster [DBG] pgmap v12110: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:17 smithi191 bash[24992]: cluster 2024-08-31T08:55:15.922616+0000 mgr.a (mgr.14388) 17468 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:17 smithi163 bash[24253]: cluster 2024-08-31T08:55:15.922616+0000 mgr.a (mgr.14388) 17468 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:17 smithi027 bash[22610]: cluster 2024-08-31T08:55:15.922616+0000 mgr.a (mgr.14388) 17468 : cluster [DBG] pgmap v12111: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:17.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:17.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:17.766 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:18.513 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:18.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:18.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:18.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:18.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:19 smithi191 bash[24992]: cluster 2024-08-31T08:55:17.923275+0000 mgr.a (mgr.14388) 17469 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:19 smithi191 bash[24992]: audit 2024-08-31T08:55:18.097699+0000 mgr.a (mgr.14388) 17470 : audit [DBG] from='client.376473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:19.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:19 smithi163 bash[24253]: cluster 2024-08-31T08:55:17.923275+0000 mgr.a (mgr.14388) 17469 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:19 smithi163 bash[24253]: audit 2024-08-31T08:55:18.097699+0000 mgr.a (mgr.14388) 17470 : audit [DBG] from='client.376473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:19 smithi027 bash[22610]: cluster 2024-08-31T08:55:17.923275+0000 mgr.a (mgr.14388) 17469 : cluster [DBG] pgmap v12112: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:19 smithi027 bash[22610]: audit 2024-08-31T08:55:18.097699+0000 mgr.a (mgr.14388) 17470 : audit [DBG] from='client.376473 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:21 smithi191 bash[24992]: cluster 2024-08-31T08:55:19.926101+0000 mgr.a (mgr.14388) 17471 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:21 smithi163 bash[24253]: cluster 2024-08-31T08:55:19.926101+0000 mgr.a (mgr.14388) 17471 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:21 smithi027 bash[22610]: cluster 2024-08-31T08:55:19.926101+0000 mgr.a (mgr.14388) 17471 : cluster [DBG] pgmap v12113: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:23.515 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:23.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:23.516 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:23 smithi191 bash[24992]: cluster 2024-08-31T08:55:21.926888+0000 mgr.a (mgr.14388) 17472 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:55:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:23 smithi163 bash[24253]: cluster 2024-08-31T08:55:21.926888+0000 mgr.a (mgr.14388) 17472 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:55:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:23 smithi027 bash[22610]: cluster 2024-08-31T08:55:21.926888+0000 mgr.a (mgr.14388) 17472 : cluster [DBG] pgmap v12114: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:55:24.284 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:24.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:24.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:24.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:24.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:25 smithi191 bash[24992]: audit 2024-08-31T08:55:23.847866+0000 mgr.a (mgr.14388) 17473 : audit [DBG] from='client.376548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:25 smithi191 bash[24992]: cluster 2024-08-31T08:55:23.928253+0000 mgr.a (mgr.14388) 17474 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:25 smithi191 bash[24992]: audit 2024-08-31T08:55:24.320619+0000 mon.a (mon.0) 3182 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:55:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:25 smithi191 bash[24992]: audit 2024-08-31T08:55:24.853097+0000 mon.a (mon.0) 3183 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:55:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:25 smithi191 bash[24992]: audit 2024-08-31T08:55:24.858566+0000 mon.a (mon.0) 3184 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:55:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:25 smithi163 bash[24253]: audit 2024-08-31T08:55:23.847866+0000 mgr.a (mgr.14388) 17473 : audit [DBG] from='client.376548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:25 smithi163 bash[24253]: cluster 2024-08-31T08:55:23.928253+0000 mgr.a (mgr.14388) 17474 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:25 smithi163 bash[24253]: audit 2024-08-31T08:55:24.320619+0000 mon.a (mon.0) 3182 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:55:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:25 smithi163 bash[24253]: audit 2024-08-31T08:55:24.853097+0000 mon.a (mon.0) 3183 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:55:25.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:25 smithi163 bash[24253]: audit 2024-08-31T08:55:24.858566+0000 mon.a (mon.0) 3184 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:55:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:25 smithi027 bash[22610]: audit 2024-08-31T08:55:23.847866+0000 mgr.a (mgr.14388) 17473 : audit [DBG] from='client.376548 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:25 smithi027 bash[22610]: cluster 2024-08-31T08:55:23.928253+0000 mgr.a (mgr.14388) 17474 : cluster [DBG] pgmap v12115: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:25 smithi027 bash[22610]: audit 2024-08-31T08:55:24.320619+0000 mon.a (mon.0) 3182 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:55:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:25 smithi027 bash[22610]: audit 2024-08-31T08:55:24.853097+0000 mon.a (mon.0) 3183 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:55:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:25 smithi027 bash[22610]: audit 2024-08-31T08:55:24.858566+0000 mon.a (mon.0) 3184 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:55:26.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:55:26 smithi027 bash[22863]: debug 2024-08-31T08:55:26.222+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:55:26.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:55:26 smithi027 bash[22863]: debug 2024-08-31T08:55:26.222+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:55:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:26 smithi027 bash[22610]: audit 2024-08-31T08:55:25.454063+0000 mon.a (mon.0) 3185 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:55:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:26 smithi027 bash[22610]: audit 2024-08-31T08:55:25.455642+0000 mon.a (mon.0) 3186 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:55:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:26 smithi027 bash[22610]: audit 2024-08-31T08:55:25.466824+0000 mon.a (mon.0) 3187 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:55:26.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:26 smithi027 bash[22610]: audit 2024-08-31T08:55:25.471440+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:55:26.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:26 smithi163 bash[24253]: audit 2024-08-31T08:55:25.454063+0000 mon.a (mon.0) 3185 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:55:26.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:26 smithi163 bash[24253]: audit 2024-08-31T08:55:25.455642+0000 mon.a (mon.0) 3186 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:55:26.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:26 smithi163 bash[24253]: audit 2024-08-31T08:55:25.466824+0000 mon.a (mon.0) 3187 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:55:26.704 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:26 smithi163 bash[24253]: audit 2024-08-31T08:55:25.471440+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:55:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:26 smithi191 bash[24992]: audit 2024-08-31T08:55:25.454063+0000 mon.a (mon.0) 3185 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:55:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:26 smithi191 bash[24992]: audit 2024-08-31T08:55:25.455642+0000 mon.a (mon.0) 3186 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:55:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:26 smithi191 bash[24992]: audit 2024-08-31T08:55:25.466824+0000 mon.a (mon.0) 3187 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:55:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:26 smithi191 bash[24992]: audit 2024-08-31T08:55:25.471440+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:55:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:27 smithi163 bash[24253]: audit 2024-08-31T08:55:25.473828+0000 mgr.a (mgr.14388) 17475 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:55:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:27 smithi163 bash[24253]: cluster 2024-08-31T08:55:25.928772+0000 mgr.a (mgr.14388) 17476 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:55:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:27 smithi163 bash[24253]: audit 2024-08-31T08:55:26.224905+0000 mgr.a (mgr.14388) 17477 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:55:27.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:27 smithi163 bash[24253]: cephadm 2024-08-31T08:55:26.226480+0000 mgr.a (mgr.14388) 17478 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:55:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:27 smithi027 bash[22610]: audit 2024-08-31T08:55:25.473828+0000 mgr.a (mgr.14388) 17475 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:55:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:27 smithi027 bash[22610]: cluster 2024-08-31T08:55:25.928772+0000 mgr.a (mgr.14388) 17476 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:55:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:27 smithi027 bash[22610]: audit 2024-08-31T08:55:26.224905+0000 mgr.a (mgr.14388) 17477 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:55:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:27 smithi027 bash[22610]: cephadm 2024-08-31T08:55:26.226480+0000 mgr.a (mgr.14388) 17478 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:55:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:27 smithi191 bash[24992]: audit 2024-08-31T08:55:25.473828+0000 mgr.a (mgr.14388) 17475 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:55:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:27 smithi191 bash[24992]: cluster 2024-08-31T08:55:25.928772+0000 mgr.a (mgr.14388) 17476 : cluster [DBG] pgmap v12116: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:55:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:27 smithi191 bash[24992]: audit 2024-08-31T08:55:26.224905+0000 mgr.a (mgr.14388) 17477 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:55:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:27 smithi191 bash[24992]: cephadm 2024-08-31T08:55:26.226480+0000 mgr.a (mgr.14388) 17478 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:55:29.285 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:29.286 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:29.286 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:29 smithi163 bash[24253]: cluster 2024-08-31T08:55:27.929587+0000 mgr.a (mgr.14388) 17479 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:55:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:29 smithi027 bash[22610]: cluster 2024-08-31T08:55:27.929587+0000 mgr.a (mgr.14388) 17479 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:55:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:29 smithi191 bash[24992]: cluster 2024-08-31T08:55:27.929587+0000 mgr.a (mgr.14388) 17479 : cluster [DBG] pgmap v12117: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:55:30.024 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:30.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:30.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:30.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:30.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:31 smithi163 bash[24253]: audit 2024-08-31T08:55:29.617767+0000 mgr.a (mgr.14388) 17480 : audit [DBG] from='client.376731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:31 smithi163 bash[24253]: cluster 2024-08-31T08:55:29.931972+0000 mgr.a (mgr.14388) 17481 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:31 smithi027 bash[22610]: audit 2024-08-31T08:55:29.617767+0000 mgr.a (mgr.14388) 17480 : audit [DBG] from='client.376731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:31 smithi027 bash[22610]: cluster 2024-08-31T08:55:29.931972+0000 mgr.a (mgr.14388) 17481 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:31 smithi191 bash[24992]: audit 2024-08-31T08:55:29.617767+0000 mgr.a (mgr.14388) 17480 : audit [DBG] from='client.376731 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:31 smithi191 bash[24992]: cluster 2024-08-31T08:55:29.931972+0000 mgr.a (mgr.14388) 17481 : cluster [DBG] pgmap v12118: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:33 smithi163 bash[24253]: cluster 2024-08-31T08:55:31.932773+0000 mgr.a (mgr.14388) 17482 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:33 smithi027 bash[22610]: cluster 2024-08-31T08:55:31.932773+0000 mgr.a (mgr.14388) 17482 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:33 smithi191 bash[24992]: cluster 2024-08-31T08:55:31.932773+0000 mgr.a (mgr.14388) 17482 : cluster [DBG] pgmap v12119: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:35.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:35.027 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:35.027 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:35 smithi163 bash[24253]: cluster 2024-08-31T08:55:33.934864+0000 mgr.a (mgr.14388) 17483 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:35 smithi027 bash[22610]: cluster 2024-08-31T08:55:33.934864+0000 mgr.a (mgr.14388) 17483 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:35 smithi191 bash[24992]: cluster 2024-08-31T08:55:33.934864+0000 mgr.a (mgr.14388) 17483 : cluster [DBG] pgmap v12120: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:35.820 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:35.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:35.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:35.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:35.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:36 smithi163 bash[24253]: audit 2024-08-31T08:55:35.368908+0000 mgr.a (mgr.14388) 17484 : audit [DBG] from='client.376806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:36 smithi027 bash[22610]: audit 2024-08-31T08:55:35.368908+0000 mgr.a (mgr.14388) 17484 : audit [DBG] from='client.376806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:36 smithi191 bash[24992]: audit 2024-08-31T08:55:35.368908+0000 mgr.a (mgr.14388) 17484 : audit [DBG] from='client.376806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:37 smithi163 bash[24253]: cluster 2024-08-31T08:55:35.935866+0000 mgr.a (mgr.14388) 17485 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:37 smithi027 bash[22610]: cluster 2024-08-31T08:55:35.935866+0000 mgr.a (mgr.14388) 17485 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:37 smithi191 bash[24992]: cluster 2024-08-31T08:55:35.935866+0000 mgr.a (mgr.14388) 17485 : cluster [DBG] pgmap v12121: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:39 smithi163 bash[24253]: cluster 2024-08-31T08:55:37.936666+0000 mgr.a (mgr.14388) 17486 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:39 smithi027 bash[22610]: cluster 2024-08-31T08:55:37.936666+0000 mgr.a (mgr.14388) 17486 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:39 smithi191 bash[24992]: cluster 2024-08-31T08:55:37.936666+0000 mgr.a (mgr.14388) 17486 : cluster [DBG] pgmap v12122: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:40.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:40.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:40.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:41.571 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:41.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:41.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:41.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:41.572 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:41 smithi163 bash[24253]: cluster 2024-08-31T08:55:39.938947+0000 mgr.a (mgr.14388) 17487 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:41 smithi027 bash[22610]: cluster 2024-08-31T08:55:39.938947+0000 mgr.a (mgr.14388) 17487 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:41 smithi191 bash[24992]: cluster 2024-08-31T08:55:39.938947+0000 mgr.a (mgr.14388) 17487 : cluster [DBG] pgmap v12123: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:55:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:42 smithi163 bash[24253]: audit 2024-08-31T08:55:41.155689+0000 mgr.a (mgr.14388) 17488 : audit [DBG] from='client.376878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:42 smithi027 bash[22610]: audit 2024-08-31T08:55:41.155689+0000 mgr.a (mgr.14388) 17488 : audit [DBG] from='client.376878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:42 smithi191 bash[24992]: audit 2024-08-31T08:55:41.155689+0000 mgr.a (mgr.14388) 17488 : audit [DBG] from='client.376878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:43 smithi163 bash[24253]: cluster 2024-08-31T08:55:41.939861+0000 mgr.a (mgr.14388) 17489 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:43 smithi027 bash[22610]: cluster 2024-08-31T08:55:41.939861+0000 mgr.a (mgr.14388) 17489 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:43 smithi191 bash[24992]: cluster 2024-08-31T08:55:41.939861+0000 mgr.a (mgr.14388) 17489 : cluster [DBG] pgmap v12124: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:45 smithi163 bash[24253]: cluster 2024-08-31T08:55:43.942164+0000 mgr.a (mgr.14388) 17490 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:45 smithi027 bash[22610]: cluster 2024-08-31T08:55:43.942164+0000 mgr.a (mgr.14388) 17490 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:45 smithi191 bash[24992]: cluster 2024-08-31T08:55:43.942164+0000 mgr.a (mgr.14388) 17490 : cluster [DBG] pgmap v12125: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:46.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:46.574 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:46.574 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:47.335 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:47.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:47.335 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:47.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:47 smithi163 bash[24253]: cluster 2024-08-31T08:55:45.942947+0000 mgr.a (mgr.14388) 17491 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:47 smithi027 bash[22610]: cluster 2024-08-31T08:55:45.942947+0000 mgr.a (mgr.14388) 17491 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:47 smithi191 bash[24992]: cluster 2024-08-31T08:55:45.942947+0000 mgr.a (mgr.14388) 17491 : cluster [DBG] pgmap v12126: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:48 smithi163 bash[24253]: audit 2024-08-31T08:55:46.910264+0000 mgr.a (mgr.14388) 17492 : audit [DBG] from='client.376953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:48 smithi027 bash[22610]: audit 2024-08-31T08:55:46.910264+0000 mgr.a (mgr.14388) 17492 : audit [DBG] from='client.376953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:48 smithi191 bash[24992]: audit 2024-08-31T08:55:46.910264+0000 mgr.a (mgr.14388) 17492 : audit [DBG] from='client.376953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:49 smithi163 bash[24253]: cluster 2024-08-31T08:55:47.943810+0000 mgr.a (mgr.14388) 17493 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:49 smithi027 bash[22610]: cluster 2024-08-31T08:55:47.943810+0000 mgr.a (mgr.14388) 17493 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:49 smithi191 bash[24992]: cluster 2024-08-31T08:55:47.943810+0000 mgr.a (mgr.14388) 17493 : cluster [DBG] pgmap v12127: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:51 smithi163 bash[24253]: cluster 2024-08-31T08:55:49.946036+0000 mgr.a (mgr.14388) 17494 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:51 smithi027 bash[22610]: cluster 2024-08-31T08:55:49.946036+0000 mgr.a (mgr.14388) 17494 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:51 smithi191 bash[24992]: cluster 2024-08-31T08:55:49.946036+0000 mgr.a (mgr.14388) 17494 : cluster [DBG] pgmap v12128: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:55:52.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:52.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:52.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:53.074 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:53.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:53 smithi163 bash[24253]: cluster 2024-08-31T08:55:51.946831+0000 mgr.a (mgr.14388) 17495 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:53 smithi027 bash[22610]: cluster 2024-08-31T08:55:51.946831+0000 mgr.a (mgr.14388) 17495 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:53 smithi191 bash[24992]: cluster 2024-08-31T08:55:51.946831+0000 mgr.a (mgr.14388) 17495 : cluster [DBG] pgmap v12129: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:55:54.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:54 smithi163 bash[24253]: audit 2024-08-31T08:55:52.659873+0000 mgr.a (mgr.14388) 17496 : audit [DBG] from='client.377031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:54 smithi027 bash[22610]: audit 2024-08-31T08:55:52.659873+0000 mgr.a (mgr.14388) 17496 : audit [DBG] from='client.377031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:54 smithi191 bash[24992]: audit 2024-08-31T08:55:52.659873+0000 mgr.a (mgr.14388) 17496 : audit [DBG] from='client.377031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:55 smithi163 bash[24253]: cluster 2024-08-31T08:55:53.949179+0000 mgr.a (mgr.14388) 17497 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:55:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:55 smithi027 bash[22610]: cluster 2024-08-31T08:55:53.949179+0000 mgr.a (mgr.14388) 17497 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:55:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:55 smithi191 bash[24992]: cluster 2024-08-31T08:55:53.949179+0000 mgr.a (mgr.14388) 17497 : cluster [DBG] pgmap v12130: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:55:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:57 smithi163 bash[24253]: cluster 2024-08-31T08:55:55.949971+0000 mgr.a (mgr.14388) 17498 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:55:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:57 smithi027 bash[22610]: cluster 2024-08-31T08:55:55.949971+0000 mgr.a (mgr.14388) 17498 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:55:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:57 smithi191 bash[24992]: cluster 2024-08-31T08:55:55.949971+0000 mgr.a (mgr.14388) 17498 : cluster [DBG] pgmap v12131: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:55:58.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:55:58.076 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:55:58.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:55:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:58 smithi163 bash[24253]: cluster 2024-08-31T08:55:57.950712+0000 mgr.a (mgr.14388) 17499 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:55:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:58 smithi027 bash[22610]: cluster 2024-08-31T08:55:57.950712+0000 mgr.a (mgr.14388) 17499 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:55:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:58 smithi191 bash[24992]: cluster 2024-08-31T08:55:57.950712+0000 mgr.a (mgr.14388) 17499 : cluster [DBG] pgmap v12132: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:55:58.851 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:55:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:55:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:55:58.851 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:55:58.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:55:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:55:59 smithi163 bash[24253]: audit 2024-08-31T08:55:58.415083+0000 mgr.a (mgr.14388) 17500 : audit [DBG] from='client.377109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:55:59 smithi027 bash[22610]: audit 2024-08-31T08:55:58.415083+0000 mgr.a (mgr.14388) 17500 : audit [DBG] from='client.377109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:55:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:55:59 smithi191 bash[24992]: audit 2024-08-31T08:55:58.415083+0000 mgr.a (mgr.14388) 17500 : audit [DBG] from='client.377109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:00.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:00 smithi163 bash[24253]: cluster 2024-08-31T08:55:59.953436+0000 mgr.a (mgr.14388) 17501 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:00 smithi027 bash[22610]: cluster 2024-08-31T08:55:59.953436+0000 mgr.a (mgr.14388) 17501 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:00 smithi191 bash[24992]: cluster 2024-08-31T08:55:59.953436+0000 mgr.a (mgr.14388) 17501 : cluster [DBG] pgmap v12133: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:03 smithi191 bash[24992]: cluster 2024-08-31T08:56:01.954223+0000 mgr.a (mgr.14388) 17502 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:56:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:03 smithi163 bash[24253]: cluster 2024-08-31T08:56:01.954223+0000 mgr.a (mgr.14388) 17502 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:56:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:03 smithi027 bash[22610]: cluster 2024-08-31T08:56:01.954223+0000 mgr.a (mgr.14388) 17502 : cluster [DBG] pgmap v12134: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:56:03.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:56:03.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:56:03.853 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:56:04.592 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:56:04.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:56:04.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:56:04.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:56:04.593 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:56:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:05 smithi191 bash[24992]: cluster 2024-08-31T08:56:03.955228+0000 mgr.a (mgr.14388) 17503 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:05 smithi191 bash[24992]: audit 2024-08-31T08:56:04.181308+0000 mgr.a (mgr.14388) 17504 : audit [DBG] from='client.377187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:05 smithi163 bash[24253]: cluster 2024-08-31T08:56:03.955228+0000 mgr.a (mgr.14388) 17503 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:05.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:05 smithi163 bash[24253]: audit 2024-08-31T08:56:04.181308+0000 mgr.a (mgr.14388) 17504 : audit [DBG] from='client.377187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:05 smithi027 bash[22610]: cluster 2024-08-31T08:56:03.955228+0000 mgr.a (mgr.14388) 17503 : cluster [DBG] pgmap v12135: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:05 smithi027 bash[22610]: audit 2024-08-31T08:56:04.181308+0000 mgr.a (mgr.14388) 17504 : audit [DBG] from='client.377187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:07 smithi191 bash[24992]: cluster 2024-08-31T08:56:05.956079+0000 mgr.a (mgr.14388) 17505 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:56:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:07 smithi163 bash[24253]: cluster 2024-08-31T08:56:05.956079+0000 mgr.a (mgr.14388) 17505 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:56:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:07 smithi027 bash[22610]: cluster 2024-08-31T08:56:05.956079+0000 mgr.a (mgr.14388) 17505 : cluster [DBG] pgmap v12136: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:56:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:09 smithi191 bash[24992]: cluster 2024-08-31T08:56:07.957037+0000 mgr.a (mgr.14388) 17506 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:56:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:09 smithi163 bash[24253]: cluster 2024-08-31T08:56:07.957037+0000 mgr.a (mgr.14388) 17506 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:56:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:09 smithi027 bash[22610]: cluster 2024-08-31T08:56:07.957037+0000 mgr.a (mgr.14388) 17506 : cluster [DBG] pgmap v12137: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:56:09.594 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:56:09.595 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:56:09.595 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:56:10.346 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:56:10.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:56:10.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:56:10.347 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:56:10.347 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:56:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:11 smithi191 bash[24992]: audit 2024-08-31T08:56:09.930355+0000 mgr.a (mgr.14388) 17507 : audit [DBG] from='client.377265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:11 smithi191 bash[24992]: cluster 2024-08-31T08:56:09.960058+0000 mgr.a (mgr.14388) 17508 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:56:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:11 smithi163 bash[24253]: audit 2024-08-31T08:56:09.930355+0000 mgr.a (mgr.14388) 17507 : audit [DBG] from='client.377265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:11.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:11 smithi163 bash[24253]: cluster 2024-08-31T08:56:09.960058+0000 mgr.a (mgr.14388) 17508 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:56:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:11 smithi027 bash[22610]: audit 2024-08-31T08:56:09.930355+0000 mgr.a (mgr.14388) 17507 : audit [DBG] from='client.377265 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:11 smithi027 bash[22610]: cluster 2024-08-31T08:56:09.960058+0000 mgr.a (mgr.14388) 17508 : cluster [DBG] pgmap v12138: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:56:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:13 smithi191 bash[24992]: cluster 2024-08-31T08:56:11.961213+0000 mgr.a (mgr.14388) 17509 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:13 smithi163 bash[24253]: cluster 2024-08-31T08:56:11.961213+0000 mgr.a (mgr.14388) 17509 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:13 smithi027 bash[22610]: cluster 2024-08-31T08:56:11.961213+0000 mgr.a (mgr.14388) 17509 : cluster [DBG] pgmap v12139: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:15 smithi191 bash[24992]: cluster 2024-08-31T08:56:13.963631+0000 mgr.a (mgr.14388) 17510 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:15.348 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:56:15.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:56:15.349 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:56:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:15 smithi163 bash[24253]: cluster 2024-08-31T08:56:13.963631+0000 mgr.a (mgr.14388) 17510 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:15 smithi027 bash[22610]: cluster 2024-08-31T08:56:13.963631+0000 mgr.a (mgr.14388) 17510 : cluster [DBG] pgmap v12140: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:16.135 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:56:16.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:56:16.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:56:16.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:56:16.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:56:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:17 smithi163 bash[24253]: audit 2024-08-31T08:56:15.687403+0000 mgr.a (mgr.14388) 17511 : audit [DBG] from='client.377343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:17.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:17 smithi163 bash[24253]: cluster 2024-08-31T08:56:15.964206+0000 mgr.a (mgr.14388) 17512 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:17 smithi027 bash[22610]: audit 2024-08-31T08:56:15.687403+0000 mgr.a (mgr.14388) 17511 : audit [DBG] from='client.377343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:17 smithi027 bash[22610]: cluster 2024-08-31T08:56:15.964206+0000 mgr.a (mgr.14388) 17512 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:17 smithi191 bash[24992]: audit 2024-08-31T08:56:15.687403+0000 mgr.a (mgr.14388) 17511 : audit [DBG] from='client.377343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:17 smithi191 bash[24992]: cluster 2024-08-31T08:56:15.964206+0000 mgr.a (mgr.14388) 17512 : cluster [DBG] pgmap v12141: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:19 smithi163 bash[24253]: cluster 2024-08-31T08:56:17.965193+0000 mgr.a (mgr.14388) 17513 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:19 smithi027 bash[22610]: cluster 2024-08-31T08:56:17.965193+0000 mgr.a (mgr.14388) 17513 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:19 smithi191 bash[24992]: cluster 2024-08-31T08:56:17.965193+0000 mgr.a (mgr.14388) 17513 : cluster [DBG] pgmap v12142: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:21.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:56:21.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:56:21.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:56:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:21 smithi163 bash[24253]: cluster 2024-08-31T08:56:19.967591+0000 mgr.a (mgr.14388) 17514 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:21 smithi027 bash[22610]: cluster 2024-08-31T08:56:19.967591+0000 mgr.a (mgr.14388) 17514 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:21 smithi191 bash[24992]: cluster 2024-08-31T08:56:19.967591+0000 mgr.a (mgr.14388) 17514 : cluster [DBG] pgmap v12143: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:21.887 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:56:21.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:56:21.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:56:21.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:56:21.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:56:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:23 smithi163 bash[24253]: audit 2024-08-31T08:56:21.464654+0000 mgr.a (mgr.14388) 17515 : audit [DBG] from='client.377421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:23 smithi163 bash[24253]: cluster 2024-08-31T08:56:21.968108+0000 mgr.a (mgr.14388) 17516 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:23 smithi027 bash[22610]: audit 2024-08-31T08:56:21.464654+0000 mgr.a (mgr.14388) 17515 : audit [DBG] from='client.377421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:23 smithi027 bash[22610]: cluster 2024-08-31T08:56:21.968108+0000 mgr.a (mgr.14388) 17516 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:23 smithi191 bash[24992]: audit 2024-08-31T08:56:21.464654+0000 mgr.a (mgr.14388) 17515 : audit [DBG] from='client.377421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:23.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:23 smithi191 bash[24992]: cluster 2024-08-31T08:56:21.968108+0000 mgr.a (mgr.14388) 17516 : cluster [DBG] pgmap v12144: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:25 smithi163 bash[24253]: cluster 2024-08-31T08:56:23.970296+0000 mgr.a (mgr.14388) 17517 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:25.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:25 smithi027 bash[22610]: cluster 2024-08-31T08:56:23.970296+0000 mgr.a (mgr.14388) 17517 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:25.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:25 smithi191 bash[24992]: cluster 2024-08-31T08:56:23.970296+0000 mgr.a (mgr.14388) 17517 : cluster [DBG] pgmap v12145: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:26.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:56:26.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:56:26.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:56:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:27 smithi163 bash[24253]: cluster 2024-08-31T08:56:25.971094+0000 mgr.a (mgr.14388) 17518 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:27 smithi163 bash[24253]: audit 2024-08-31T08:56:26.281216+0000 mon.a (mon.0) 3189 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:56:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:27 smithi163 bash[24253]: audit 2024-08-31T08:56:26.895030+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:27 smithi163 bash[24253]: audit 2024-08-31T08:56:26.900491+0000 mon.a (mon.0) 3191 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:27 smithi163 bash[24253]: audit 2024-08-31T08:56:26.904329+0000 mon.a (mon.0) 3192 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:27 smithi163 bash[24253]: audit 2024-08-31T08:56:26.909861+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:27 smithi027 bash[22610]: cluster 2024-08-31T08:56:25.971094+0000 mgr.a (mgr.14388) 17518 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:27 smithi027 bash[22610]: audit 2024-08-31T08:56:26.281216+0000 mon.a (mon.0) 3189 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:56:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:27 smithi027 bash[22610]: audit 2024-08-31T08:56:26.895030+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:27 smithi027 bash[22610]: audit 2024-08-31T08:56:26.900491+0000 mon.a (mon.0) 3191 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:27 smithi027 bash[22610]: audit 2024-08-31T08:56:26.904329+0000 mon.a (mon.0) 3192 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:27 smithi027 bash[22610]: audit 2024-08-31T08:56:26.909861+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:27 smithi191 bash[24992]: cluster 2024-08-31T08:56:25.971094+0000 mgr.a (mgr.14388) 17518 : cluster [DBG] pgmap v12146: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:27 smithi191 bash[24992]: audit 2024-08-31T08:56:26.281216+0000 mon.a (mon.0) 3189 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:56:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:27 smithi191 bash[24992]: audit 2024-08-31T08:56:26.895030+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:27 smithi191 bash[24992]: audit 2024-08-31T08:56:26.900491+0000 mon.a (mon.0) 3191 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:27 smithi191 bash[24992]: audit 2024-08-31T08:56:26.904329+0000 mon.a (mon.0) 3192 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:27 smithi191 bash[24992]: audit 2024-08-31T08:56:26.909861+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:27.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:56:27.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:56:27.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:56:27.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:56:27.650 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:56:28.346 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:28 smithi027 bash[22610]: audit 2024-08-31T08:56:27.217590+0000 mgr.a (mgr.14388) 17519 : audit [DBG] from='client.377496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:28.346 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:28 smithi027 bash[22610]: audit 2024-08-31T08:56:27.589603+0000 mon.a (mon.0) 3194 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:56:28.346 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:28 smithi027 bash[22610]: audit 2024-08-31T08:56:27.590549+0000 mon.a (mon.0) 3195 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:56:28.346 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:28 smithi027 bash[22610]: audit 2024-08-31T08:56:27.595985+0000 mon.a (mon.0) 3196 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:28.347 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:28 smithi027 bash[22610]: audit 2024-08-31T08:56:27.598534+0000 mon.a (mon.0) 3197 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:56:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:28 smithi163 bash[24253]: audit 2024-08-31T08:56:27.217590+0000 mgr.a (mgr.14388) 17519 : audit [DBG] from='client.377496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:28 smithi163 bash[24253]: audit 2024-08-31T08:56:27.589603+0000 mon.a (mon.0) 3194 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:56:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:28 smithi163 bash[24253]: audit 2024-08-31T08:56:27.590549+0000 mon.a (mon.0) 3195 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:56:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:28 smithi163 bash[24253]: audit 2024-08-31T08:56:27.595985+0000 mon.a (mon.0) 3196 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:28.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:28 smithi163 bash[24253]: audit 2024-08-31T08:56:27.598534+0000 mon.a (mon.0) 3197 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:56:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:28 smithi191 bash[24992]: audit 2024-08-31T08:56:27.217590+0000 mgr.a (mgr.14388) 17519 : audit [DBG] from='client.377496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:28 smithi191 bash[24992]: audit 2024-08-31T08:56:27.589603+0000 mon.a (mon.0) 3194 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:56:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:28 smithi191 bash[24992]: audit 2024-08-31T08:56:27.590549+0000 mon.a (mon.0) 3195 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:56:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:28 smithi191 bash[24992]: audit 2024-08-31T08:56:27.595985+0000 mon.a (mon.0) 3196 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:56:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:28 smithi191 bash[24992]: audit 2024-08-31T08:56:27.598534+0000 mon.a (mon.0) 3197 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:56:28.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:56:28 smithi027 bash[22863]: debug 2024-08-31T08:56:28.341+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:56:28.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:56:28 smithi027 bash[22863]: debug 2024-08-31T08:56:28.345+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:56:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:29 smithi163 bash[24253]: audit 2024-08-31T08:56:27.600012+0000 mgr.a (mgr.14388) 17520 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:56:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:29 smithi163 bash[24253]: cluster 2024-08-31T08:56:27.971679+0000 mgr.a (mgr.14388) 17521 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:29 smithi163 bash[24253]: audit 2024-08-31T08:56:28.345939+0000 mgr.a (mgr.14388) 17522 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:56:29.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:29 smithi163 bash[24253]: cephadm 2024-08-31T08:56:28.347245+0000 mgr.a (mgr.14388) 17523 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:56:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:29 smithi027 bash[22610]: audit 2024-08-31T08:56:27.600012+0000 mgr.a (mgr.14388) 17520 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:56:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:29 smithi027 bash[22610]: cluster 2024-08-31T08:56:27.971679+0000 mgr.a (mgr.14388) 17521 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:29 smithi027 bash[22610]: audit 2024-08-31T08:56:28.345939+0000 mgr.a (mgr.14388) 17522 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:56:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:29 smithi027 bash[22610]: cephadm 2024-08-31T08:56:28.347245+0000 mgr.a (mgr.14388) 17523 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:56:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:29 smithi191 bash[24992]: audit 2024-08-31T08:56:27.600012+0000 mgr.a (mgr.14388) 17520 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:56:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:29 smithi191 bash[24992]: cluster 2024-08-31T08:56:27.971679+0000 mgr.a (mgr.14388) 17521 : cluster [DBG] pgmap v12147: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:29 smithi191 bash[24992]: audit 2024-08-31T08:56:28.345939+0000 mgr.a (mgr.14388) 17522 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:56:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:29 smithi191 bash[24992]: cephadm 2024-08-31T08:56:28.347245+0000 mgr.a (mgr.14388) 17523 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:56:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:31 smithi163 bash[24253]: cluster 2024-08-31T08:56:29.974355+0000 mgr.a (mgr.14388) 17524 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:56:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:31 smithi027 bash[22610]: cluster 2024-08-31T08:56:29.974355+0000 mgr.a (mgr.14388) 17524 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:56:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:31 smithi191 bash[24992]: cluster 2024-08-31T08:56:29.974355+0000 mgr.a (mgr.14388) 17524 : cluster [DBG] pgmap v12148: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:56:32.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:56:32.652 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:56:32.653 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:56:33.401 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:56:33.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:56:33.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:56:33.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:56:33.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:56:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:33 smithi163 bash[24253]: cluster 2024-08-31T08:56:31.975164+0000 mgr.a (mgr.14388) 17525 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T08:56:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:33 smithi027 bash[22610]: cluster 2024-08-31T08:56:31.975164+0000 mgr.a (mgr.14388) 17525 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T08:56:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:33 smithi191 bash[24992]: cluster 2024-08-31T08:56:31.975164+0000 mgr.a (mgr.14388) 17525 : cluster [DBG] pgmap v12149: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T08:56:34.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:34 smithi163 bash[24253]: audit 2024-08-31T08:56:32.988930+0000 mgr.a (mgr.14388) 17526 : audit [DBG] from='client.377679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:34 smithi027 bash[22610]: audit 2024-08-31T08:56:32.988930+0000 mgr.a (mgr.14388) 17526 : audit [DBG] from='client.377679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:34 smithi191 bash[24992]: audit 2024-08-31T08:56:32.988930+0000 mgr.a (mgr.14388) 17526 : audit [DBG] from='client.377679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:35 smithi163 bash[24253]: cluster 2024-08-31T08:56:33.978148+0000 mgr.a (mgr.14388) 17527 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:56:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:35 smithi027 bash[22610]: cluster 2024-08-31T08:56:33.978148+0000 mgr.a (mgr.14388) 17527 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:56:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:35 smithi191 bash[24992]: cluster 2024-08-31T08:56:33.978148+0000 mgr.a (mgr.14388) 17527 : cluster [DBG] pgmap v12150: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:56:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:37 smithi163 bash[24253]: cluster 2024-08-31T08:56:35.979169+0000 mgr.a (mgr.14388) 17528 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:56:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:37 smithi027 bash[22610]: cluster 2024-08-31T08:56:35.979169+0000 mgr.a (mgr.14388) 17528 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:56:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:37 smithi191 bash[24992]: cluster 2024-08-31T08:56:35.979169+0000 mgr.a (mgr.14388) 17528 : cluster [DBG] pgmap v12151: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:56:38.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:56:38.403 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:56:38.403 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:56:39.162 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:56:39.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:56:39.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:56:39.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:56:39.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:56:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:39 smithi163 bash[24253]: cluster 2024-08-31T08:56:37.980094+0000 mgr.a (mgr.14388) 17529 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:56:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:39 smithi027 bash[22610]: cluster 2024-08-31T08:56:37.980094+0000 mgr.a (mgr.14388) 17529 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:56:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:39 smithi191 bash[24992]: cluster 2024-08-31T08:56:37.980094+0000 mgr.a (mgr.14388) 17529 : cluster [DBG] pgmap v12152: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:56:40.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:40 smithi163 bash[24253]: audit 2024-08-31T08:56:38.735732+0000 mgr.a (mgr.14388) 17530 : audit [DBG] from='client.377754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:40 smithi027 bash[22610]: audit 2024-08-31T08:56:38.735732+0000 mgr.a (mgr.14388) 17530 : audit [DBG] from='client.377754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:40 smithi191 bash[24992]: audit 2024-08-31T08:56:38.735732+0000 mgr.a (mgr.14388) 17530 : audit [DBG] from='client.377754 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:41 smithi163 bash[24253]: cluster 2024-08-31T08:56:39.982868+0000 mgr.a (mgr.14388) 17531 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:56:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:41 smithi027 bash[22610]: cluster 2024-08-31T08:56:39.982868+0000 mgr.a (mgr.14388) 17531 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:56:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:41 smithi191 bash[24992]: cluster 2024-08-31T08:56:39.982868+0000 mgr.a (mgr.14388) 17531 : cluster [DBG] pgmap v12153: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:56:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:43 smithi163 bash[24253]: cluster 2024-08-31T08:56:41.983685+0000 mgr.a (mgr.14388) 17532 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:56:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:43 smithi027 bash[22610]: cluster 2024-08-31T08:56:41.983685+0000 mgr.a (mgr.14388) 17532 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:56:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:43 smithi191 bash[24992]: cluster 2024-08-31T08:56:41.983685+0000 mgr.a (mgr.14388) 17532 : cluster [DBG] pgmap v12154: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:56:44.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:56:44.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:56:44.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:56:44.951 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:56:44.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:56:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:56:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:56:44.952 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:56:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:45 smithi163 bash[24253]: cluster 2024-08-31T08:56:43.985702+0000 mgr.a (mgr.14388) 17533 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:56:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:45 smithi027 bash[22610]: cluster 2024-08-31T08:56:43.985702+0000 mgr.a (mgr.14388) 17533 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:56:45.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:45 smithi191 bash[24992]: cluster 2024-08-31T08:56:43.985702+0000 mgr.a (mgr.14388) 17533 : cluster [DBG] pgmap v12155: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:56:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:46 smithi163 bash[24253]: audit 2024-08-31T08:56:44.503015+0000 mgr.a (mgr.14388) 17534 : audit [DBG] from='client.377829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:46 smithi027 bash[22610]: audit 2024-08-31T08:56:44.503015+0000 mgr.a (mgr.14388) 17534 : audit [DBG] from='client.377829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:46 smithi191 bash[24992]: audit 2024-08-31T08:56:44.503015+0000 mgr.a (mgr.14388) 17534 : audit [DBG] from='client.377829 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:47 smithi163 bash[24253]: cluster 2024-08-31T08:56:45.986602+0000 mgr.a (mgr.14388) 17535 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:47 smithi027 bash[22610]: cluster 2024-08-31T08:56:45.986602+0000 mgr.a (mgr.14388) 17535 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:47.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:47 smithi191 bash[24992]: cluster 2024-08-31T08:56:45.986602+0000 mgr.a (mgr.14388) 17535 : cluster [DBG] pgmap v12156: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:49 smithi163 bash[24253]: cluster 2024-08-31T08:56:47.987438+0000 mgr.a (mgr.14388) 17536 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:49 smithi027 bash[22610]: cluster 2024-08-31T08:56:47.987438+0000 mgr.a (mgr.14388) 17536 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:49 smithi191 bash[24992]: cluster 2024-08-31T08:56:47.987438+0000 mgr.a (mgr.14388) 17536 : cluster [DBG] pgmap v12157: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:56:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:56:49.953 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:56:50.725 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:56:50.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:56:50.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:56:50.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:56:50.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:56:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:51 smithi163 bash[24253]: cluster 2024-08-31T08:56:49.988999+0000 mgr.a (mgr.14388) 17537 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:51.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:51 smithi163 bash[24253]: audit 2024-08-31T08:56:50.293088+0000 mgr.a (mgr.14388) 17538 : audit [DBG] from='client.377907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:51 smithi027 bash[22610]: cluster 2024-08-31T08:56:49.988999+0000 mgr.a (mgr.14388) 17537 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:51 smithi027 bash[22610]: audit 2024-08-31T08:56:50.293088+0000 mgr.a (mgr.14388) 17538 : audit [DBG] from='client.377907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:51 smithi191 bash[24992]: cluster 2024-08-31T08:56:49.988999+0000 mgr.a (mgr.14388) 17537 : cluster [DBG] pgmap v12158: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:51 smithi191 bash[24992]: audit 2024-08-31T08:56:50.293088+0000 mgr.a (mgr.14388) 17538 : audit [DBG] from='client.377907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:53 smithi163 bash[24253]: cluster 2024-08-31T08:56:51.989884+0000 mgr.a (mgr.14388) 17539 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:53 smithi027 bash[22610]: cluster 2024-08-31T08:56:51.989884+0000 mgr.a (mgr.14388) 17539 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:53 smithi191 bash[24992]: cluster 2024-08-31T08:56:51.989884+0000 mgr.a (mgr.14388) 17539 : cluster [DBG] pgmap v12159: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:55 smithi163 bash[24253]: cluster 2024-08-31T08:56:53.992129+0000 mgr.a (mgr.14388) 17540 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:55 smithi027 bash[22610]: cluster 2024-08-31T08:56:53.992129+0000 mgr.a (mgr.14388) 17540 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:55 smithi191 bash[24992]: cluster 2024-08-31T08:56:53.992129+0000 mgr.a (mgr.14388) 17540 : cluster [DBG] pgmap v12160: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:55.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:56:55.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:56:55.727 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:56:56.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:56:56.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:56:56.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:56:56.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:56:56.485 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:56:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:57 smithi163 bash[24253]: cluster 2024-08-31T08:56:55.992864+0000 mgr.a (mgr.14388) 17541 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:57 smithi163 bash[24253]: audit 2024-08-31T08:56:56.059209+0000 mgr.a (mgr.14388) 17542 : audit [DBG] from='client.377982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:57 smithi027 bash[22610]: cluster 2024-08-31T08:56:55.992864+0000 mgr.a (mgr.14388) 17541 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:57 smithi027 bash[22610]: audit 2024-08-31T08:56:56.059209+0000 mgr.a (mgr.14388) 17542 : audit [DBG] from='client.377982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:57 smithi191 bash[24992]: cluster 2024-08-31T08:56:55.992864+0000 mgr.a (mgr.14388) 17541 : cluster [DBG] pgmap v12161: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:56:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:57 smithi191 bash[24992]: audit 2024-08-31T08:56:56.059209+0000 mgr.a (mgr.14388) 17542 : audit [DBG] from='client.377982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:56:59.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:56:59 smithi163 bash[24253]: cluster 2024-08-31T08:56:57.995055+0000 mgr.a (mgr.14388) 17543 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:56:59 smithi027 bash[22610]: cluster 2024-08-31T08:56:57.995055+0000 mgr.a (mgr.14388) 17543 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:56:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:56:59 smithi191 bash[24992]: cluster 2024-08-31T08:56:57.995055+0000 mgr.a (mgr.14388) 17543 : cluster [DBG] pgmap v12162: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:57:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:01 smithi163 bash[24253]: cluster 2024-08-31T08:56:59.995874+0000 mgr.a (mgr.14388) 17544 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:57:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:01 smithi027 bash[22610]: cluster 2024-08-31T08:56:59.995874+0000 mgr.a (mgr.14388) 17544 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:57:01.486 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:01.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:01.487 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:01 smithi191 bash[24992]: cluster 2024-08-31T08:56:59.995874+0000 mgr.a (mgr.14388) 17544 : cluster [DBG] pgmap v12163: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:57:02.230 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:02.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:02.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:02.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:02.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:57:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:03 smithi163 bash[24253]: audit 2024-08-31T08:57:01.818755+0000 mgr.a (mgr.14388) 17545 : audit [DBG] from='client.378057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:03 smithi163 bash[24253]: cluster 2024-08-31T08:57:01.996593+0000 mgr.a (mgr.14388) 17546 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:03 smithi027 bash[22610]: audit 2024-08-31T08:57:01.818755+0000 mgr.a (mgr.14388) 17545 : audit [DBG] from='client.378057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:03 smithi027 bash[22610]: cluster 2024-08-31T08:57:01.996593+0000 mgr.a (mgr.14388) 17546 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:03 smithi191 bash[24992]: audit 2024-08-31T08:57:01.818755+0000 mgr.a (mgr.14388) 17545 : audit [DBG] from='client.378057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:03 smithi191 bash[24992]: cluster 2024-08-31T08:57:01.996593+0000 mgr.a (mgr.14388) 17546 : cluster [DBG] pgmap v12164: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:05 smithi163 bash[24253]: cluster 2024-08-31T08:57:03.998898+0000 mgr.a (mgr.14388) 17547 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:57:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:05 smithi027 bash[22610]: cluster 2024-08-31T08:57:03.998898+0000 mgr.a (mgr.14388) 17547 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:57:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:05 smithi191 bash[24992]: cluster 2024-08-31T08:57:03.998898+0000 mgr.a (mgr.14388) 17547 : cluster [DBG] pgmap v12165: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:57:07.231 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:07.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:07.232 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:07 smithi163 bash[24253]: cluster 2024-08-31T08:57:05.999688+0000 mgr.a (mgr.14388) 17548 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:07 smithi027 bash[22610]: cluster 2024-08-31T08:57:05.999688+0000 mgr.a (mgr.14388) 17548 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:07 smithi191 bash[24992]: cluster 2024-08-31T08:57:05.999688+0000 mgr.a (mgr.14388) 17548 : cluster [DBG] pgmap v12166: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:07.984 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:07.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:07.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:07.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:07.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:57:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:09 smithi163 bash[24253]: audit 2024-08-31T08:57:07.564344+0000 mgr.a (mgr.14388) 17549 : audit [DBG] from='client.378132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:09 smithi163 bash[24253]: cluster 2024-08-31T08:57:08.001133+0000 mgr.a (mgr.14388) 17550 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:57:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:09 smithi027 bash[22610]: audit 2024-08-31T08:57:07.564344+0000 mgr.a (mgr.14388) 17549 : audit [DBG] from='client.378132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:09 smithi027 bash[22610]: cluster 2024-08-31T08:57:08.001133+0000 mgr.a (mgr.14388) 17550 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:57:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:09 smithi191 bash[24992]: audit 2024-08-31T08:57:07.564344+0000 mgr.a (mgr.14388) 17549 : audit [DBG] from='client.378132 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:09 smithi191 bash[24992]: cluster 2024-08-31T08:57:08.001133+0000 mgr.a (mgr.14388) 17550 : cluster [DBG] pgmap v12167: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T08:57:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:11 smithi163 bash[24253]: cluster 2024-08-31T08:57:10.001874+0000 mgr.a (mgr.14388) 17551 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:57:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:11 smithi027 bash[22610]: cluster 2024-08-31T08:57:10.001874+0000 mgr.a (mgr.14388) 17551 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:57:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:11 smithi191 bash[24992]: cluster 2024-08-31T08:57:10.001874+0000 mgr.a (mgr.14388) 17551 : cluster [DBG] pgmap v12168: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:57:12.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:12.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:12.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:13 smithi163 bash[24253]: cluster 2024-08-31T08:57:12.002656+0000 mgr.a (mgr.14388) 17552 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:57:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:13 smithi027 bash[22610]: cluster 2024-08-31T08:57:12.002656+0000 mgr.a (mgr.14388) 17552 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:57:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:13 smithi191 bash[24992]: cluster 2024-08-31T08:57:12.002656+0000 mgr.a (mgr.14388) 17552 : cluster [DBG] pgmap v12169: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T08:57:13.775 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:13.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:13.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:13.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:13.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:57:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:14 smithi027 bash[22610]: audit 2024-08-31T08:57:13.326845+0000 mgr.a (mgr.14388) 17553 : audit [DBG] from='client.378207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:14 smithi191 bash[24992]: audit 2024-08-31T08:57:13.326845+0000 mgr.a (mgr.14388) 17553 : audit [DBG] from='client.378207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:14.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:14 smithi163 bash[24253]: audit 2024-08-31T08:57:13.326845+0000 mgr.a (mgr.14388) 17553 : audit [DBG] from='client.378207 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:15 smithi027 bash[22610]: cluster 2024-08-31T08:57:14.005443+0000 mgr.a (mgr.14388) 17554 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:15 smithi191 bash[24992]: cluster 2024-08-31T08:57:14.005443+0000 mgr.a (mgr.14388) 17554 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:15 smithi163 bash[24253]: cluster 2024-08-31T08:57:14.005443+0000 mgr.a (mgr.14388) 17554 : cluster [DBG] pgmap v12170: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:17 smithi027 bash[22610]: cluster 2024-08-31T08:57:16.006245+0000 mgr.a (mgr.14388) 17555 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:57:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:17 smithi191 bash[24992]: cluster 2024-08-31T08:57:16.006245+0000 mgr.a (mgr.14388) 17555 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:57:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:17 smithi163 bash[24253]: cluster 2024-08-31T08:57:16.006245+0000 mgr.a (mgr.14388) 17555 : cluster [DBG] pgmap v12171: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:57:18.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:18.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:18.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:19 smithi027 bash[22610]: cluster 2024-08-31T08:57:18.008163+0000 mgr.a (mgr.14388) 17556 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:19 smithi191 bash[24992]: cluster 2024-08-31T08:57:18.008163+0000 mgr.a (mgr.14388) 17556 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:19.550 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:19.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:19.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:19.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:19.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:57:19.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:19 smithi163 bash[24253]: cluster 2024-08-31T08:57:18.008163+0000 mgr.a (mgr.14388) 17556 : cluster [DBG] pgmap v12172: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:20.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:20 smithi027 bash[22610]: audit 2024-08-31T08:57:19.115429+0000 mgr.a (mgr.14388) 17557 : audit [DBG] from='client.378282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:20 smithi191 bash[24992]: audit 2024-08-31T08:57:19.115429+0000 mgr.a (mgr.14388) 17557 : audit [DBG] from='client.378282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:20 smithi163 bash[24253]: audit 2024-08-31T08:57:19.115429+0000 mgr.a (mgr.14388) 17557 : audit [DBG] from='client.378282 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:21 smithi027 bash[22610]: cluster 2024-08-31T08:57:20.009037+0000 mgr.a (mgr.14388) 17558 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:57:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:21 smithi191 bash[24992]: cluster 2024-08-31T08:57:20.009037+0000 mgr.a (mgr.14388) 17558 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:57:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:21 smithi163 bash[24253]: cluster 2024-08-31T08:57:20.009037+0000 mgr.a (mgr.14388) 17558 : cluster [DBG] pgmap v12173: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:57:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:23 smithi027 bash[22610]: cluster 2024-08-31T08:57:22.009861+0000 mgr.a (mgr.14388) 17559 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:57:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:23 smithi191 bash[24992]: cluster 2024-08-31T08:57:22.009861+0000 mgr.a (mgr.14388) 17559 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:57:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:23 smithi163 bash[24253]: cluster 2024-08-31T08:57:22.009861+0000 mgr.a (mgr.14388) 17559 : cluster [DBG] pgmap v12174: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T08:57:24.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:24.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:24.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:25.311 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:25.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:25.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:25.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:25.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:57:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:25 smithi191 bash[24992]: cluster 2024-08-31T08:57:24.012150+0000 mgr.a (mgr.14388) 17560 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:57:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:25 smithi163 bash[24253]: cluster 2024-08-31T08:57:24.012150+0000 mgr.a (mgr.14388) 17560 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:57:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:25 smithi027 bash[22610]: cluster 2024-08-31T08:57:24.012150+0000 mgr.a (mgr.14388) 17560 : cluster [DBG] pgmap v12175: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T08:57:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:26 smithi191 bash[24992]: audit 2024-08-31T08:57:24.884982+0000 mgr.a (mgr.14388) 17561 : audit [DBG] from='client.378357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:26 smithi163 bash[24253]: audit 2024-08-31T08:57:24.884982+0000 mgr.a (mgr.14388) 17561 : audit [DBG] from='client.378357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:26 smithi027 bash[22610]: audit 2024-08-31T08:57:24.884982+0000 mgr.a (mgr.14388) 17561 : audit [DBG] from='client.378357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:27 smithi191 bash[24992]: cluster 2024-08-31T08:57:26.013089+0000 mgr.a (mgr.14388) 17562 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:27 smithi163 bash[24253]: cluster 2024-08-31T08:57:26.013089+0000 mgr.a (mgr.14388) 17562 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:27 smithi027 bash[22610]: cluster 2024-08-31T08:57:26.013089+0000 mgr.a (mgr.14388) 17562 : cluster [DBG] pgmap v12176: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:29 smithi191 bash[24992]: cluster 2024-08-31T08:57:28.015399+0000 mgr.a (mgr.14388) 17563 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:57:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:29 smithi191 bash[24992]: audit 2024-08-31T08:57:28.398073+0000 mon.a (mon.0) 3198 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:57:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:29 smithi191 bash[24992]: audit 2024-08-31T08:57:29.236619+0000 mon.a (mon.0) 3199 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:57:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:29 smithi191 bash[24992]: audit 2024-08-31T08:57:29.238345+0000 mon.a (mon.0) 3200 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:57:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:29 smithi163 bash[24253]: cluster 2024-08-31T08:57:28.015399+0000 mgr.a (mgr.14388) 17563 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:57:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:29 smithi163 bash[24253]: audit 2024-08-31T08:57:28.398073+0000 mon.a (mon.0) 3198 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:57:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:29 smithi163 bash[24253]: audit 2024-08-31T08:57:29.236619+0000 mon.a (mon.0) 3199 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:57:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:29 smithi163 bash[24253]: audit 2024-08-31T08:57:29.238345+0000 mon.a (mon.0) 3200 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:57:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:29 smithi027 bash[22610]: cluster 2024-08-31T08:57:28.015399+0000 mgr.a (mgr.14388) 17563 : cluster [DBG] pgmap v12177: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:57:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:29 smithi027 bash[22610]: audit 2024-08-31T08:57:28.398073+0000 mon.a (mon.0) 3198 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:57:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:29 smithi027 bash[22610]: audit 2024-08-31T08:57:29.236619+0000 mon.a (mon.0) 3199 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:57:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:29 smithi027 bash[22610]: audit 2024-08-31T08:57:29.238345+0000 mon.a (mon.0) 3200 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:57:30.260 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:57:30 smithi027 bash[22863]: debug 2024-08-31T08:57:29.995+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:57:30.261 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:57:30 smithi027 bash[22863]: debug 2024-08-31T08:57:29.995+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:57:30.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:30.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:30.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:30 smithi191 bash[24992]: audit 2024-08-31T08:57:29.248727+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:57:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:30 smithi191 bash[24992]: audit 2024-08-31T08:57:29.256571+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:57:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:30 smithi191 bash[24992]: audit 2024-08-31T08:57:29.258920+0000 mgr.a (mgr.14388) 17564 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:57:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:30 smithi163 bash[24253]: audit 2024-08-31T08:57:29.248727+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:57:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:30 smithi163 bash[24253]: audit 2024-08-31T08:57:29.256571+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:57:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:30 smithi163 bash[24253]: audit 2024-08-31T08:57:29.258920+0000 mgr.a (mgr.14388) 17564 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:57:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:30 smithi027 bash[22610]: audit 2024-08-31T08:57:29.248727+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:57:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:30 smithi027 bash[22610]: audit 2024-08-31T08:57:29.256571+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:57:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:30 smithi027 bash[22610]: audit 2024-08-31T08:57:29.258920+0000 mgr.a (mgr.14388) 17564 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:57:31.044 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:31.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:31.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:31.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:31.044 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:57:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:31 smithi191 bash[24992]: audit 2024-08-31T08:57:30.000197+0000 mgr.a (mgr.14388) 17565 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:57:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:31 smithi191 bash[24992]: cephadm 2024-08-31T08:57:30.001582+0000 mgr.a (mgr.14388) 17566 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:57:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:31 smithi191 bash[24992]: cluster 2024-08-31T08:57:30.015969+0000 mgr.a (mgr.14388) 17567 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:31 smithi163 bash[24253]: audit 2024-08-31T08:57:30.000197+0000 mgr.a (mgr.14388) 17565 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:57:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:31 smithi163 bash[24253]: cephadm 2024-08-31T08:57:30.001582+0000 mgr.a (mgr.14388) 17566 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:57:31.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:31 smithi163 bash[24253]: cluster 2024-08-31T08:57:30.015969+0000 mgr.a (mgr.14388) 17567 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:31 smithi027 bash[22610]: audit 2024-08-31T08:57:30.000197+0000 mgr.a (mgr.14388) 17565 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:57:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:31 smithi027 bash[22610]: cephadm 2024-08-31T08:57:30.001582+0000 mgr.a (mgr.14388) 17566 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:57:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:31 smithi027 bash[22610]: cluster 2024-08-31T08:57:30.015969+0000 mgr.a (mgr.14388) 17567 : cluster [DBG] pgmap v12178: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:32 smithi191 bash[24992]: audit 2024-08-31T08:57:30.634272+0000 mgr.a (mgr.14388) 17568 : audit [DBG] from='client.378537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:32 smithi163 bash[24253]: audit 2024-08-31T08:57:30.634272+0000 mgr.a (mgr.14388) 17568 : audit [DBG] from='client.378537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:32 smithi027 bash[22610]: audit 2024-08-31T08:57:30.634272+0000 mgr.a (mgr.14388) 17568 : audit [DBG] from='client.378537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:33 smithi191 bash[24992]: cluster 2024-08-31T08:57:32.016841+0000 mgr.a (mgr.14388) 17569 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:33 smithi163 bash[24253]: cluster 2024-08-31T08:57:32.016841+0000 mgr.a (mgr.14388) 17569 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:33 smithi027 bash[22610]: cluster 2024-08-31T08:57:32.016841+0000 mgr.a (mgr.14388) 17569 : cluster [DBG] pgmap v12179: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:35 smithi191 bash[24992]: cluster 2024-08-31T08:57:34.019100+0000 mgr.a (mgr.14388) 17570 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:35 smithi163 bash[24253]: cluster 2024-08-31T08:57:34.019100+0000 mgr.a (mgr.14388) 17570 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:35 smithi027 bash[22610]: cluster 2024-08-31T08:57:34.019100+0000 mgr.a (mgr.14388) 17570 : cluster [DBG] pgmap v12180: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:36.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:36.046 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:36.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:36.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:36.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:36.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:36.805 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:57:36.805 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:37 smithi191 bash[24992]: cluster 2024-08-31T08:57:36.019873+0000 mgr.a (mgr.14388) 17571 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:37 smithi191 bash[24992]: audit 2024-08-31T08:57:36.380139+0000 mgr.a (mgr.14388) 17572 : audit [DBG] from='client.378615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:37 smithi163 bash[24253]: cluster 2024-08-31T08:57:36.019873+0000 mgr.a (mgr.14388) 17571 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:37 smithi163 bash[24253]: audit 2024-08-31T08:57:36.380139+0000 mgr.a (mgr.14388) 17572 : audit [DBG] from='client.378615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:37 smithi027 bash[22610]: cluster 2024-08-31T08:57:36.019873+0000 mgr.a (mgr.14388) 17571 : cluster [DBG] pgmap v12181: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:37 smithi027 bash[22610]: audit 2024-08-31T08:57:36.380139+0000 mgr.a (mgr.14388) 17572 : audit [DBG] from='client.378615 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:39 smithi191 bash[24992]: cluster 2024-08-31T08:57:38.022054+0000 mgr.a (mgr.14388) 17573 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:39 smithi163 bash[24253]: cluster 2024-08-31T08:57:38.022054+0000 mgr.a (mgr.14388) 17573 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:39 smithi027 bash[22610]: cluster 2024-08-31T08:57:38.022054+0000 mgr.a (mgr.14388) 17573 : cluster [DBG] pgmap v12182: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:41 smithi163 bash[24253]: cluster 2024-08-31T08:57:40.022887+0000 mgr.a (mgr.14388) 17574 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:41 smithi027 bash[22610]: cluster 2024-08-31T08:57:40.022887+0000 mgr.a (mgr.14388) 17574 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:41 smithi191 bash[24992]: cluster 2024-08-31T08:57:40.022887+0000 mgr.a (mgr.14388) 17574 : cluster [DBG] pgmap v12183: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:41.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:41.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:41.807 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:42.557 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:42.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:42.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:42.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:42.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:57:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:43 smithi163 bash[24253]: cluster 2024-08-31T08:57:42.023416+0000 mgr.a (mgr.14388) 17575 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:43 smithi163 bash[24253]: audit 2024-08-31T08:57:42.135833+0000 mgr.a (mgr.14388) 17576 : audit [DBG] from='client.378690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:43 smithi027 bash[22610]: cluster 2024-08-31T08:57:42.023416+0000 mgr.a (mgr.14388) 17575 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:43 smithi027 bash[22610]: audit 2024-08-31T08:57:42.135833+0000 mgr.a (mgr.14388) 17576 : audit [DBG] from='client.378690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:43 smithi191 bash[24992]: cluster 2024-08-31T08:57:42.023416+0000 mgr.a (mgr.14388) 17575 : cluster [DBG] pgmap v12184: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:43 smithi191 bash[24992]: audit 2024-08-31T08:57:42.135833+0000 mgr.a (mgr.14388) 17576 : audit [DBG] from='client.378690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:45 smithi163 bash[24253]: cluster 2024-08-31T08:57:44.025698+0000 mgr.a (mgr.14388) 17577 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:45 smithi027 bash[22610]: cluster 2024-08-31T08:57:44.025698+0000 mgr.a (mgr.14388) 17577 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:45 smithi191 bash[24992]: cluster 2024-08-31T08:57:44.025698+0000 mgr.a (mgr.14388) 17577 : cluster [DBG] pgmap v12185: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:57:47.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:47.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:47.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:47 smithi163 bash[24253]: cluster 2024-08-31T08:57:46.026472+0000 mgr.a (mgr.14388) 17578 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:47 smithi027 bash[22610]: cluster 2024-08-31T08:57:46.026472+0000 mgr.a (mgr.14388) 17578 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:47 smithi191 bash[24992]: cluster 2024-08-31T08:57:46.026472+0000 mgr.a (mgr.14388) 17578 : cluster [DBG] pgmap v12186: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:48.303 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:48.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:48.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:48.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:48.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:57:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:49 smithi163 bash[24253]: audit 2024-08-31T08:57:47.894414+0000 mgr.a (mgr.14388) 17579 : audit [DBG] from='client.378768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:49 smithi163 bash[24253]: cluster 2024-08-31T08:57:48.027799+0000 mgr.a (mgr.14388) 17580 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:49 smithi027 bash[22610]: audit 2024-08-31T08:57:47.894414+0000 mgr.a (mgr.14388) 17579 : audit [DBG] from='client.378768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:49 smithi027 bash[22610]: cluster 2024-08-31T08:57:48.027799+0000 mgr.a (mgr.14388) 17580 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:49 smithi191 bash[24992]: audit 2024-08-31T08:57:47.894414+0000 mgr.a (mgr.14388) 17579 : audit [DBG] from='client.378768 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:49 smithi191 bash[24992]: cluster 2024-08-31T08:57:48.027799+0000 mgr.a (mgr.14388) 17580 : cluster [DBG] pgmap v12187: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:51 smithi163 bash[24253]: cluster 2024-08-31T08:57:50.028674+0000 mgr.a (mgr.14388) 17581 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:57:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:51 smithi027 bash[22610]: cluster 2024-08-31T08:57:50.028674+0000 mgr.a (mgr.14388) 17581 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:57:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:51 smithi191 bash[24992]: cluster 2024-08-31T08:57:50.028674+0000 mgr.a (mgr.14388) 17581 : cluster [DBG] pgmap v12188: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:57:53.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:53.305 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:53.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:53 smithi163 bash[24253]: cluster 2024-08-31T08:57:52.029478+0000 mgr.a (mgr.14388) 17582 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:57:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:53 smithi027 bash[22610]: cluster 2024-08-31T08:57:52.029478+0000 mgr.a (mgr.14388) 17582 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:57:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:53 smithi191 bash[24992]: cluster 2024-08-31T08:57:52.029478+0000 mgr.a (mgr.14388) 17582 : cluster [DBG] pgmap v12189: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:57:54.082 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:54.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:54.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:54.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:54.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:57:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:55 smithi163 bash[24253]: audit 2024-08-31T08:57:53.638234+0000 mgr.a (mgr.14388) 17583 : audit [DBG] from='client.378846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:55 smithi163 bash[24253]: cluster 2024-08-31T08:57:54.030879+0000 mgr.a (mgr.14388) 17584 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:55 smithi027 bash[22610]: audit 2024-08-31T08:57:53.638234+0000 mgr.a (mgr.14388) 17583 : audit [DBG] from='client.378846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:55 smithi027 bash[22610]: cluster 2024-08-31T08:57:54.030879+0000 mgr.a (mgr.14388) 17584 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:55 smithi191 bash[24992]: audit 2024-08-31T08:57:53.638234+0000 mgr.a (mgr.14388) 17583 : audit [DBG] from='client.378846 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:57:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:55 smithi191 bash[24992]: cluster 2024-08-31T08:57:54.030879+0000 mgr.a (mgr.14388) 17584 : cluster [DBG] pgmap v12190: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:56 smithi191 bash[24992]: cluster 2024-08-31T08:57:56.031609+0000 mgr.a (mgr.14388) 17585 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:57:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:56 smithi163 bash[24253]: cluster 2024-08-31T08:57:56.031609+0000 mgr.a (mgr.14388) 17585 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:57:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:56 smithi027 bash[22610]: cluster 2024-08-31T08:57:56.031609+0000 mgr.a (mgr.14388) 17585 : cluster [DBG] pgmap v12191: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:57:59.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:57:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:57:59.084 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:57:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:57:59 smithi163 bash[24253]: cluster 2024-08-31T08:57:58.033637+0000 mgr.a (mgr.14388) 17586 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:57:59 smithi027 bash[22610]: cluster 2024-08-31T08:57:58.033637+0000 mgr.a (mgr.14388) 17586 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:57:59 smithi191 bash[24992]: cluster 2024-08-31T08:57:58.033637+0000 mgr.a (mgr.14388) 17586 : cluster [DBG] pgmap v12192: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:57:59.869 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:57:59.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:57:59.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:57:59.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:57:59.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:01 smithi163 bash[24253]: audit 2024-08-31T08:57:59.421328+0000 mgr.a (mgr.14388) 17587 : audit [DBG] from='client.378921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:01.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:01 smithi163 bash[24253]: cluster 2024-08-31T08:58:00.034440+0000 mgr.a (mgr.14388) 17588 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:01 smithi027 bash[22610]: audit 2024-08-31T08:57:59.421328+0000 mgr.a (mgr.14388) 17587 : audit [DBG] from='client.378921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:01 smithi027 bash[22610]: cluster 2024-08-31T08:58:00.034440+0000 mgr.a (mgr.14388) 17588 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:01 smithi191 bash[24992]: audit 2024-08-31T08:57:59.421328+0000 mgr.a (mgr.14388) 17587 : audit [DBG] from='client.378921 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:01 smithi191 bash[24992]: cluster 2024-08-31T08:58:00.034440+0000 mgr.a (mgr.14388) 17588 : cluster [DBG] pgmap v12193: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:03 smithi163 bash[24253]: cluster 2024-08-31T08:58:02.035242+0000 mgr.a (mgr.14388) 17589 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:03 smithi027 bash[22610]: cluster 2024-08-31T08:58:02.035242+0000 mgr.a (mgr.14388) 17589 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:03 smithi191 bash[24992]: cluster 2024-08-31T08:58:02.035242+0000 mgr.a (mgr.14388) 17589 : cluster [DBG] pgmap v12194: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:04.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:58:04.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:58:04.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:58:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:05 smithi163 bash[24253]: cluster 2024-08-31T08:58:04.037456+0000 mgr.a (mgr.14388) 17590 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:05 smithi027 bash[22610]: cluster 2024-08-31T08:58:04.037456+0000 mgr.a (mgr.14388) 17590 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:05 smithi191 bash[24992]: cluster 2024-08-31T08:58:04.037456+0000 mgr.a (mgr.14388) 17590 : cluster [DBG] pgmap v12195: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:05.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:58:05.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:58:05.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:58:05.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:05.628 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:58:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:06 smithi163 bash[24253]: audit 2024-08-31T08:58:05.205661+0000 mgr.a (mgr.14388) 17591 : audit [DBG] from='client.378996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:06 smithi027 bash[22610]: audit 2024-08-31T08:58:05.205661+0000 mgr.a (mgr.14388) 17591 : audit [DBG] from='client.378996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:06 smithi191 bash[24992]: audit 2024-08-31T08:58:05.205661+0000 mgr.a (mgr.14388) 17591 : audit [DBG] from='client.378996 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:07 smithi163 bash[24253]: cluster 2024-08-31T08:58:06.038365+0000 mgr.a (mgr.14388) 17592 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:07 smithi027 bash[22610]: cluster 2024-08-31T08:58:06.038365+0000 mgr.a (mgr.14388) 17592 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:07 smithi191 bash[24992]: cluster 2024-08-31T08:58:06.038365+0000 mgr.a (mgr.14388) 17592 : cluster [DBG] pgmap v12196: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:09 smithi163 bash[24253]: cluster 2024-08-31T08:58:08.040528+0000 mgr.a (mgr.14388) 17593 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:09 smithi027 bash[22610]: cluster 2024-08-31T08:58:08.040528+0000 mgr.a (mgr.14388) 17593 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:09 smithi191 bash[24992]: cluster 2024-08-31T08:58:08.040528+0000 mgr.a (mgr.14388) 17593 : cluster [DBG] pgmap v12197: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:10.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:58:10.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:58:10.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:58:11.388 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:58:11.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:58:11.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:58:11.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:58:11.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:11 smithi163 bash[24253]: cluster 2024-08-31T08:58:10.041295+0000 mgr.a (mgr.14388) 17594 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:11 smithi027 bash[22610]: cluster 2024-08-31T08:58:10.041295+0000 mgr.a (mgr.14388) 17594 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:11 smithi191 bash[24992]: cluster 2024-08-31T08:58:10.041295+0000 mgr.a (mgr.14388) 17594 : cluster [DBG] pgmap v12198: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:12 smithi163 bash[24253]: audit 2024-08-31T08:58:10.962920+0000 mgr.a (mgr.14388) 17595 : audit [DBG] from='client.379071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:12 smithi027 bash[22610]: audit 2024-08-31T08:58:10.962920+0000 mgr.a (mgr.14388) 17595 : audit [DBG] from='client.379071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:12 smithi191 bash[24992]: audit 2024-08-31T08:58:10.962920+0000 mgr.a (mgr.14388) 17595 : audit [DBG] from='client.379071 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:13 smithi163 bash[24253]: cluster 2024-08-31T08:58:12.042417+0000 mgr.a (mgr.14388) 17596 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:13 smithi027 bash[22610]: cluster 2024-08-31T08:58:12.042417+0000 mgr.a (mgr.14388) 17596 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:13 smithi191 bash[24992]: cluster 2024-08-31T08:58:12.042417+0000 mgr.a (mgr.14388) 17596 : cluster [DBG] pgmap v12199: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:15 smithi163 bash[24253]: cluster 2024-08-31T08:58:14.044852+0000 mgr.a (mgr.14388) 17597 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:15 smithi027 bash[22610]: cluster 2024-08-31T08:58:14.044852+0000 mgr.a (mgr.14388) 17597 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:15 smithi191 bash[24992]: cluster 2024-08-31T08:58:14.044852+0000 mgr.a (mgr.14388) 17597 : cluster [DBG] pgmap v12200: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:16.390 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:58:16.390 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:58:16.391 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:58:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:16 smithi191 bash[24992]: cluster 2024-08-31T08:58:16.045812+0000 mgr.a (mgr.14388) 17598 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:17.165 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:58:17.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:58:17.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:58:17.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:58:17.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:16 smithi163 bash[24253]: cluster 2024-08-31T08:58:16.045812+0000 mgr.a (mgr.14388) 17598 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:16 smithi027 bash[22610]: cluster 2024-08-31T08:58:16.045812+0000 mgr.a (mgr.14388) 17598 : cluster [DBG] pgmap v12201: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:17 smithi191 bash[24992]: audit 2024-08-31T08:58:16.725673+0000 mgr.a (mgr.14388) 17599 : audit [DBG] from='client.379146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:18.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:17 smithi163 bash[24253]: audit 2024-08-31T08:58:16.725673+0000 mgr.a (mgr.14388) 17599 : audit [DBG] from='client.379146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:17 smithi027 bash[22610]: audit 2024-08-31T08:58:16.725673+0000 mgr.a (mgr.14388) 17599 : audit [DBG] from='client.379146 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:18 smithi191 bash[24992]: cluster 2024-08-31T08:58:18.048160+0000 mgr.a (mgr.14388) 17600 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:18 smithi163 bash[24253]: cluster 2024-08-31T08:58:18.048160+0000 mgr.a (mgr.14388) 17600 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:18 smithi027 bash[22610]: cluster 2024-08-31T08:58:18.048160+0000 mgr.a (mgr.14388) 17600 : cluster [DBG] pgmap v12202: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:21 smithi163 bash[24253]: cluster 2024-08-31T08:58:20.048952+0000 mgr.a (mgr.14388) 17601 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:21 smithi027 bash[22610]: cluster 2024-08-31T08:58:20.048952+0000 mgr.a (mgr.14388) 17601 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:21 smithi191 bash[24992]: cluster 2024-08-31T08:58:20.048952+0000 mgr.a (mgr.14388) 17601 : cluster [DBG] pgmap v12203: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:22.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:58:22.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:58:22.167 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:58:22.948 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:58:22.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:58:22.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:58:22.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:58:22.949 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:23 smithi163 bash[24253]: cluster 2024-08-31T08:58:22.049891+0000 mgr.a (mgr.14388) 17602 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:23 smithi027 bash[22610]: cluster 2024-08-31T08:58:22.049891+0000 mgr.a (mgr.14388) 17602 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:23 smithi191 bash[24992]: cluster 2024-08-31T08:58:22.049891+0000 mgr.a (mgr.14388) 17602 : cluster [DBG] pgmap v12204: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:24 smithi163 bash[24253]: audit 2024-08-31T08:58:22.502430+0000 mgr.a (mgr.14388) 17603 : audit [DBG] from='client.379224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:24 smithi027 bash[22610]: audit 2024-08-31T08:58:22.502430+0000 mgr.a (mgr.14388) 17603 : audit [DBG] from='client.379224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:24 smithi191 bash[24992]: audit 2024-08-31T08:58:22.502430+0000 mgr.a (mgr.14388) 17603 : audit [DBG] from='client.379224 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:25 smithi163 bash[24253]: cluster 2024-08-31T08:58:24.052507+0000 mgr.a (mgr.14388) 17604 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:58:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:25 smithi027 bash[22610]: cluster 2024-08-31T08:58:24.052507+0000 mgr.a (mgr.14388) 17604 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:58:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:25 smithi191 bash[24992]: cluster 2024-08-31T08:58:24.052507+0000 mgr.a (mgr.14388) 17604 : cluster [DBG] pgmap v12205: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T08:58:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:27 smithi163 bash[24253]: cluster 2024-08-31T08:58:26.053318+0000 mgr.a (mgr.14388) 17605 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:58:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:27 smithi027 bash[22610]: cluster 2024-08-31T08:58:26.053318+0000 mgr.a (mgr.14388) 17605 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:58:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:27 smithi191 bash[24992]: cluster 2024-08-31T08:58:26.053318+0000 mgr.a (mgr.14388) 17605 : cluster [DBG] pgmap v12206: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T08:58:27.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:58:27.950 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:58:27.950 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:58:28.725 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:58:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:58:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:58:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:58:28.726 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:29 smithi163 bash[24253]: cluster 2024-08-31T08:58:28.054253+0000 mgr.a (mgr.14388) 17606 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:29 smithi163 bash[24253]: audit 2024-08-31T08:58:28.285836+0000 mgr.a (mgr.14388) 17607 : audit [DBG] from='client.379299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:29 smithi027 bash[22610]: cluster 2024-08-31T08:58:28.054253+0000 mgr.a (mgr.14388) 17606 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:29 smithi027 bash[22610]: audit 2024-08-31T08:58:28.285836+0000 mgr.a (mgr.14388) 17607 : audit [DBG] from='client.379299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:29 smithi191 bash[24992]: cluster 2024-08-31T08:58:28.054253+0000 mgr.a (mgr.14388) 17606 : cluster [DBG] pgmap v12207: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:29 smithi191 bash[24992]: audit 2024-08-31T08:58:28.285836+0000 mgr.a (mgr.14388) 17607 : audit [DBG] from='client.379299 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:30 smithi163 bash[24253]: audit 2024-08-31T08:58:30.060903+0000 mon.a (mon.0) 3203 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:58:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:30 smithi027 bash[22610]: audit 2024-08-31T08:58:30.060903+0000 mon.a (mon.0) 3203 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:58:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:30 smithi191 bash[24992]: audit 2024-08-31T08:58:30.060903+0000 mon.a (mon.0) 3203 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:58:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:31 smithi163 bash[24253]: cluster 2024-08-31T08:58:30.055197+0000 mgr.a (mgr.14388) 17608 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:58:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:31 smithi163 bash[24253]: audit 2024-08-31T08:58:30.907391+0000 mon.a (mon.0) 3204 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:58:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:31 smithi163 bash[24253]: audit 2024-08-31T08:58:30.908640+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:58:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:31 smithi163 bash[24253]: audit 2024-08-31T08:58:30.918427+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:58:31.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:31 smithi163 bash[24253]: audit 2024-08-31T08:58:30.920732+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:58:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:31 smithi027 bash[22610]: cluster 2024-08-31T08:58:30.055197+0000 mgr.a (mgr.14388) 17608 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:58:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:31 smithi027 bash[22610]: audit 2024-08-31T08:58:30.907391+0000 mon.a (mon.0) 3204 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:58:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:31 smithi027 bash[22610]: audit 2024-08-31T08:58:30.908640+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:58:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:31 smithi027 bash[22610]: audit 2024-08-31T08:58:30.918427+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:58:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:31 smithi027 bash[22610]: audit 2024-08-31T08:58:30.920732+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:58:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:31 smithi191 bash[24992]: cluster 2024-08-31T08:58:30.055197+0000 mgr.a (mgr.14388) 17608 : cluster [DBG] pgmap v12208: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:58:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:31 smithi191 bash[24992]: audit 2024-08-31T08:58:30.907391+0000 mon.a (mon.0) 3204 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:58:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:31 smithi191 bash[24992]: audit 2024-08-31T08:58:30.908640+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:58:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:31 smithi191 bash[24992]: audit 2024-08-31T08:58:30.918427+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:58:31.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:31 smithi191 bash[24992]: audit 2024-08-31T08:58:30.920732+0000 mon.a (mon.0) 3207 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:58:31.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:58:31 smithi027 bash[22863]: debug 2024-08-31T08:58:31.653+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:58:31.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:58:31 smithi027 bash[22863]: debug 2024-08-31T08:58:31.653+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:58:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:32 smithi163 bash[24253]: audit 2024-08-31T08:58:30.923173+0000 mgr.a (mgr.14388) 17609 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:58:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:32 smithi027 bash[22610]: audit 2024-08-31T08:58:30.923173+0000 mgr.a (mgr.14388) 17609 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:58:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:32 smithi191 bash[24992]: audit 2024-08-31T08:58:30.923173+0000 mgr.a (mgr.14388) 17609 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:58:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:33 smithi163 bash[24253]: audit 2024-08-31T08:58:31.656968+0000 mgr.a (mgr.14388) 17610 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:58:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:33 smithi163 bash[24253]: cephadm 2024-08-31T08:58:31.658643+0000 mgr.a (mgr.14388) 17611 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:58:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:33 smithi163 bash[24253]: cluster 2024-08-31T08:58:32.056147+0000 mgr.a (mgr.14388) 17612 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:58:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:33 smithi027 bash[22610]: audit 2024-08-31T08:58:31.656968+0000 mgr.a (mgr.14388) 17610 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:58:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:33 smithi027 bash[22610]: cephadm 2024-08-31T08:58:31.658643+0000 mgr.a (mgr.14388) 17611 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:58:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:33 smithi027 bash[22610]: cluster 2024-08-31T08:58:32.056147+0000 mgr.a (mgr.14388) 17612 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:58:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:33 smithi191 bash[24992]: audit 2024-08-31T08:58:31.656968+0000 mgr.a (mgr.14388) 17610 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:58:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:33 smithi191 bash[24992]: cephadm 2024-08-31T08:58:31.658643+0000 mgr.a (mgr.14388) 17611 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:58:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:33 smithi191 bash[24992]: cluster 2024-08-31T08:58:32.056147+0000 mgr.a (mgr.14388) 17612 : cluster [DBG] pgmap v12209: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:58:33.727 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:58:33.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:58:33.728 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:58:34.466 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:58:34.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:58:34.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:58:34.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:58:34.466 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:35 smithi163 bash[24253]: audit 2024-08-31T08:58:34.052123+0000 mgr.a (mgr.14388) 17613 : audit [DBG] from='client.379479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:35 smithi163 bash[24253]: cluster 2024-08-31T08:58:34.071973+0000 mgr.a (mgr.14388) 17614 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:35 smithi027 bash[22610]: audit 2024-08-31T08:58:34.052123+0000 mgr.a (mgr.14388) 17613 : audit [DBG] from='client.379479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:35 smithi027 bash[22610]: cluster 2024-08-31T08:58:34.071973+0000 mgr.a (mgr.14388) 17614 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:35 smithi191 bash[24992]: audit 2024-08-31T08:58:34.052123+0000 mgr.a (mgr.14388) 17613 : audit [DBG] from='client.379479 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:35 smithi191 bash[24992]: cluster 2024-08-31T08:58:34.071973+0000 mgr.a (mgr.14388) 17614 : cluster [DBG] pgmap v12210: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:37 smithi163 bash[24253]: cluster 2024-08-31T08:58:36.073201+0000 mgr.a (mgr.14388) 17615 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 425 B/s wr, 6 op/s 2024-08-31T08:58:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:37 smithi027 bash[22610]: cluster 2024-08-31T08:58:36.073201+0000 mgr.a (mgr.14388) 17615 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 425 B/s wr, 6 op/s 2024-08-31T08:58:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:37 smithi191 bash[24992]: cluster 2024-08-31T08:58:36.073201+0000 mgr.a (mgr.14388) 17615 : cluster [DBG] pgmap v12211: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 425 B/s wr, 6 op/s 2024-08-31T08:58:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:39 smithi163 bash[24253]: cluster 2024-08-31T08:58:38.075548+0000 mgr.a (mgr.14388) 17616 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:39.467 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:58:39.468 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:58:39.468 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:58:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:39 smithi027 bash[22610]: cluster 2024-08-31T08:58:38.075548+0000 mgr.a (mgr.14388) 17616 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:39 smithi191 bash[24992]: cluster 2024-08-31T08:58:38.075548+0000 mgr.a (mgr.14388) 17616 : cluster [DBG] pgmap v12212: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:40.233 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:58:40.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:58:40.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:58:40.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:58:40.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:41 smithi163 bash[24253]: audit 2024-08-31T08:58:39.808424+0000 mgr.a (mgr.14388) 17617 : audit [DBG] from='client.379554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:41.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:41 smithi163 bash[24253]: cluster 2024-08-31T08:58:40.076171+0000 mgr.a (mgr.14388) 17618 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:41 smithi027 bash[22610]: audit 2024-08-31T08:58:39.808424+0000 mgr.a (mgr.14388) 17617 : audit [DBG] from='client.379554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:41 smithi027 bash[22610]: cluster 2024-08-31T08:58:40.076171+0000 mgr.a (mgr.14388) 17618 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:41 smithi191 bash[24992]: audit 2024-08-31T08:58:39.808424+0000 mgr.a (mgr.14388) 17617 : audit [DBG] from='client.379554 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:41 smithi191 bash[24992]: cluster 2024-08-31T08:58:40.076171+0000 mgr.a (mgr.14388) 17618 : cluster [DBG] pgmap v12213: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:43.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:43 smithi163 bash[24253]: cluster 2024-08-31T08:58:42.077018+0000 mgr.a (mgr.14388) 17619 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:43 smithi027 bash[22610]: cluster 2024-08-31T08:58:42.077018+0000 mgr.a (mgr.14388) 17619 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:43 smithi191 bash[24992]: cluster 2024-08-31T08:58:42.077018+0000 mgr.a (mgr.14388) 17619 : cluster [DBG] pgmap v12214: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:45.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:58:45.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:58:45.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:58:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:45 smithi163 bash[24253]: cluster 2024-08-31T08:58:44.079285+0000 mgr.a (mgr.14388) 17620 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:45 smithi027 bash[22610]: cluster 2024-08-31T08:58:44.079285+0000 mgr.a (mgr.14388) 17620 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:45.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:45 smithi191 bash[24992]: cluster 2024-08-31T08:58:44.079285+0000 mgr.a (mgr.14388) 17620 : cluster [DBG] pgmap v12215: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T08:58:46.012 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:58:46.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:58:46.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:58:46.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:58:46.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:47 smithi163 bash[24253]: audit 2024-08-31T08:58:45.568263+0000 mgr.a (mgr.14388) 17621 : audit [DBG] from='client.379626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:47 smithi163 bash[24253]: cluster 2024-08-31T08:58:46.080361+0000 mgr.a (mgr.14388) 17622 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:47 smithi027 bash[22610]: audit 2024-08-31T08:58:45.568263+0000 mgr.a (mgr.14388) 17621 : audit [DBG] from='client.379626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:47 smithi027 bash[22610]: cluster 2024-08-31T08:58:46.080361+0000 mgr.a (mgr.14388) 17622 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:47 smithi191 bash[24992]: audit 2024-08-31T08:58:45.568263+0000 mgr.a (mgr.14388) 17621 : audit [DBG] from='client.379626 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:47 smithi191 bash[24992]: cluster 2024-08-31T08:58:46.080361+0000 mgr.a (mgr.14388) 17622 : cluster [DBG] pgmap v12216: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:49 smithi163 bash[24253]: cluster 2024-08-31T08:58:48.082659+0000 mgr.a (mgr.14388) 17623 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:49 smithi027 bash[22610]: cluster 2024-08-31T08:58:48.082659+0000 mgr.a (mgr.14388) 17623 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:49 smithi191 bash[24992]: cluster 2024-08-31T08:58:48.082659+0000 mgr.a (mgr.14388) 17623 : cluster [DBG] pgmap v12217: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:51.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:58:51.014 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:58:51.014 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:58:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:51 smithi163 bash[24253]: cluster 2024-08-31T08:58:50.083639+0000 mgr.a (mgr.14388) 17624 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:51 smithi027 bash[22610]: cluster 2024-08-31T08:58:50.083639+0000 mgr.a (mgr.14388) 17624 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:51 smithi191 bash[24992]: cluster 2024-08-31T08:58:50.083639+0000 mgr.a (mgr.14388) 17624 : cluster [DBG] pgmap v12218: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:51.761 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:58:51.761 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:58:51.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:58:51.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:58:51.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:52 smithi027 bash[22610]: audit 2024-08-31T08:58:51.344191+0000 mgr.a (mgr.14388) 17625 : audit [DBG] from='client.379701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:52 smithi191 bash[24992]: audit 2024-08-31T08:58:51.344191+0000 mgr.a (mgr.14388) 17625 : audit [DBG] from='client.379701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:52 smithi163 bash[24253]: audit 2024-08-31T08:58:51.344191+0000 mgr.a (mgr.14388) 17625 : audit [DBG] from='client.379701 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:53 smithi027 bash[22610]: cluster 2024-08-31T08:58:52.084615+0000 mgr.a (mgr.14388) 17626 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:53.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:53 smithi191 bash[24992]: cluster 2024-08-31T08:58:52.084615+0000 mgr.a (mgr.14388) 17626 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:53 smithi163 bash[24253]: cluster 2024-08-31T08:58:52.084615+0000 mgr.a (mgr.14388) 17626 : cluster [DBG] pgmap v12219: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:55 smithi027 bash[22610]: cluster 2024-08-31T08:58:54.086872+0000 mgr.a (mgr.14388) 17627 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:55.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:55 smithi191 bash[24992]: cluster 2024-08-31T08:58:54.086872+0000 mgr.a (mgr.14388) 17627 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:55 smithi163 bash[24253]: cluster 2024-08-31T08:58:54.086872+0000 mgr.a (mgr.14388) 17627 : cluster [DBG] pgmap v12220: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:56.763 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:58:56.763 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:58:56.764 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:58:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:57 smithi027 bash[22610]: cluster 2024-08-31T08:58:56.087638+0000 mgr.a (mgr.14388) 17628 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:57.528 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:58:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:58:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:58:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:58:57.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:58:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:57 smithi191 bash[24992]: cluster 2024-08-31T08:58:56.087638+0000 mgr.a (mgr.14388) 17628 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:57 smithi163 bash[24253]: cluster 2024-08-31T08:58:56.087638+0000 mgr.a (mgr.14388) 17628 : cluster [DBG] pgmap v12221: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:58:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:58 smithi027 bash[22610]: audit 2024-08-31T08:58:57.096854+0000 mgr.a (mgr.14388) 17629 : audit [DBG] from='client.379776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:58 smithi191 bash[24992]: audit 2024-08-31T08:58:57.096854+0000 mgr.a (mgr.14388) 17629 : audit [DBG] from='client.379776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:58 smithi163 bash[24253]: audit 2024-08-31T08:58:57.096854+0000 mgr.a (mgr.14388) 17629 : audit [DBG] from='client.379776 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:58:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:58:59 smithi027 bash[22610]: cluster 2024-08-31T08:58:58.089913+0000 mgr.a (mgr.14388) 17630 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:58:59 smithi191 bash[24992]: cluster 2024-08-31T08:58:58.089913+0000 mgr.a (mgr.14388) 17630 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:58:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:58:59 smithi163 bash[24253]: cluster 2024-08-31T08:58:58.089913+0000 mgr.a (mgr.14388) 17630 : cluster [DBG] pgmap v12222: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:01 smithi027 bash[22610]: cluster 2024-08-31T08:59:00.090701+0000 mgr.a (mgr.14388) 17631 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:01 smithi191 bash[24992]: cluster 2024-08-31T08:59:00.090701+0000 mgr.a (mgr.14388) 17631 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:01 smithi163 bash[24253]: cluster 2024-08-31T08:59:00.090701+0000 mgr.a (mgr.14388) 17631 : cluster [DBG] pgmap v12223: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:02.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:59:02.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:59:02.530 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:59:03.306 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:59:03.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:59:03.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:59:03.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:59:03.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:59:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:03 smithi027 bash[22610]: cluster 2024-08-31T08:59:02.091536+0000 mgr.a (mgr.14388) 17632 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:03.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:03 smithi191 bash[24992]: cluster 2024-08-31T08:59:02.091536+0000 mgr.a (mgr.14388) 17632 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:03 smithi163 bash[24253]: cluster 2024-08-31T08:59:02.091536+0000 mgr.a (mgr.14388) 17632 : cluster [DBG] pgmap v12224: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:04 smithi191 bash[24992]: audit 2024-08-31T08:59:02.864324+0000 mgr.a (mgr.14388) 17633 : audit [DBG] from='client.379854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:04 smithi163 bash[24253]: audit 2024-08-31T08:59:02.864324+0000 mgr.a (mgr.14388) 17633 : audit [DBG] from='client.379854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:04 smithi027 bash[22610]: audit 2024-08-31T08:59:02.864324+0000 mgr.a (mgr.14388) 17633 : audit [DBG] from='client.379854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:05 smithi191 bash[24992]: cluster 2024-08-31T08:59:04.094439+0000 mgr.a (mgr.14388) 17634 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:05 smithi163 bash[24253]: cluster 2024-08-31T08:59:04.094439+0000 mgr.a (mgr.14388) 17634 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:05 smithi027 bash[22610]: cluster 2024-08-31T08:59:04.094439+0000 mgr.a (mgr.14388) 17634 : cluster [DBG] pgmap v12225: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:07 smithi191 bash[24992]: cluster 2024-08-31T08:59:06.095260+0000 mgr.a (mgr.14388) 17635 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:59:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:07 smithi163 bash[24253]: cluster 2024-08-31T08:59:06.095260+0000 mgr.a (mgr.14388) 17635 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:59:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:07 smithi027 bash[22610]: cluster 2024-08-31T08:59:06.095260+0000 mgr.a (mgr.14388) 17635 : cluster [DBG] pgmap v12226: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:59:08.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:59:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:59:08.308 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:59:09.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:59:09.074 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:59:09.075 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:59:09.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:59:09.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:59:09.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:09 smithi191 bash[24992]: cluster 2024-08-31T08:59:08.097096+0000 mgr.a (mgr.14388) 17636 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:09 smithi163 bash[24253]: cluster 2024-08-31T08:59:08.097096+0000 mgr.a (mgr.14388) 17636 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:09 smithi027 bash[22610]: cluster 2024-08-31T08:59:08.097096+0000 mgr.a (mgr.14388) 17636 : cluster [DBG] pgmap v12227: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:10 smithi191 bash[24992]: audit 2024-08-31T08:59:08.645139+0000 mgr.a (mgr.14388) 17637 : audit [DBG] from='client.379929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:10 smithi163 bash[24253]: audit 2024-08-31T08:59:08.645139+0000 mgr.a (mgr.14388) 17637 : audit [DBG] from='client.379929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:10 smithi027 bash[22610]: audit 2024-08-31T08:59:08.645139+0000 mgr.a (mgr.14388) 17637 : audit [DBG] from='client.379929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:11 smithi191 bash[24992]: cluster 2024-08-31T08:59:10.098063+0000 mgr.a (mgr.14388) 17638 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:59:11.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:11 smithi163 bash[24253]: cluster 2024-08-31T08:59:10.098063+0000 mgr.a (mgr.14388) 17638 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:59:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:11 smithi027 bash[22610]: cluster 2024-08-31T08:59:10.098063+0000 mgr.a (mgr.14388) 17638 : cluster [DBG] pgmap v12228: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T08:59:13.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:13 smithi191 bash[24992]: cluster 2024-08-31T08:59:12.098879+0000 mgr.a (mgr.14388) 17639 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:59:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:13 smithi163 bash[24253]: cluster 2024-08-31T08:59:12.098879+0000 mgr.a (mgr.14388) 17639 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:59:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:13 smithi027 bash[22610]: cluster 2024-08-31T08:59:12.098879+0000 mgr.a (mgr.14388) 17639 : cluster [DBG] pgmap v12229: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T08:59:14.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:59:14.076 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:59:14.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:59:14.841 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:59:14.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:59:14.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:59:14.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:59:14.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:59:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:15 smithi191 bash[24992]: cluster 2024-08-31T08:59:14.100240+0000 mgr.a (mgr.14388) 17640 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:15 smithi191 bash[24992]: audit 2024-08-31T08:59:14.410463+0000 mgr.a (mgr.14388) 17641 : audit [DBG] from='client.380004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:15 smithi163 bash[24253]: cluster 2024-08-31T08:59:14.100240+0000 mgr.a (mgr.14388) 17640 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:15 smithi163 bash[24253]: audit 2024-08-31T08:59:14.410463+0000 mgr.a (mgr.14388) 17641 : audit [DBG] from='client.380004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:15 smithi027 bash[22610]: cluster 2024-08-31T08:59:14.100240+0000 mgr.a (mgr.14388) 17640 : cluster [DBG] pgmap v12230: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:15 smithi027 bash[22610]: audit 2024-08-31T08:59:14.410463+0000 mgr.a (mgr.14388) 17641 : audit [DBG] from='client.380004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:17 smithi191 bash[24992]: cluster 2024-08-31T08:59:16.101281+0000 mgr.a (mgr.14388) 17642 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:17 smithi163 bash[24253]: cluster 2024-08-31T08:59:16.101281+0000 mgr.a (mgr.14388) 17642 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:17 smithi027 bash[22610]: cluster 2024-08-31T08:59:16.101281+0000 mgr.a (mgr.14388) 17642 : cluster [DBG] pgmap v12231: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:19 smithi191 bash[24992]: cluster 2024-08-31T08:59:18.103640+0000 mgr.a (mgr.14388) 17643 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:19.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:19 smithi163 bash[24253]: cluster 2024-08-31T08:59:18.103640+0000 mgr.a (mgr.14388) 17643 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:19 smithi027 bash[22610]: cluster 2024-08-31T08:59:18.103640+0000 mgr.a (mgr.14388) 17643 : cluster [DBG] pgmap v12232: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:19.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:59:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:59:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:59:20.603 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:59:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:59:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:59:20.604 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:59:20.604 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:59:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:21 smithi191 bash[24992]: cluster 2024-08-31T08:59:20.104559+0000 mgr.a (mgr.14388) 17644 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:21 smithi191 bash[24992]: audit 2024-08-31T08:59:20.177229+0000 mgr.a (mgr.14388) 17645 : audit [DBG] from='client.380082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:21 smithi163 bash[24253]: cluster 2024-08-31T08:59:20.104559+0000 mgr.a (mgr.14388) 17644 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:21 smithi163 bash[24253]: audit 2024-08-31T08:59:20.177229+0000 mgr.a (mgr.14388) 17645 : audit [DBG] from='client.380082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:21 smithi027 bash[22610]: cluster 2024-08-31T08:59:20.104559+0000 mgr.a (mgr.14388) 17644 : cluster [DBG] pgmap v12233: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:21 smithi027 bash[22610]: audit 2024-08-31T08:59:20.177229+0000 mgr.a (mgr.14388) 17645 : audit [DBG] from='client.380082 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:23 smithi163 bash[24253]: cluster 2024-08-31T08:59:22.105519+0000 mgr.a (mgr.14388) 17646 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:23 smithi027 bash[22610]: cluster 2024-08-31T08:59:22.105519+0000 mgr.a (mgr.14388) 17646 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:23 smithi191 bash[24992]: cluster 2024-08-31T08:59:22.105519+0000 mgr.a (mgr.14388) 17646 : cluster [DBG] pgmap v12234: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:25.605 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:59:25.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:59:25.606 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:59:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:25 smithi163 bash[24253]: cluster 2024-08-31T08:59:24.107759+0000 mgr.a (mgr.14388) 17647 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:25 smithi027 bash[22610]: cluster 2024-08-31T08:59:24.107759+0000 mgr.a (mgr.14388) 17647 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:25 smithi191 bash[24992]: cluster 2024-08-31T08:59:24.107759+0000 mgr.a (mgr.14388) 17647 : cluster [DBG] pgmap v12235: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:26.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:59:26.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:59:26.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:59:26.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:59:26.356 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:59:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:27 smithi163 bash[24253]: audit 2024-08-31T08:59:25.936957+0000 mgr.a (mgr.14388) 17648 : audit [DBG] from='client.380160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:27 smithi163 bash[24253]: cluster 2024-08-31T08:59:26.108542+0000 mgr.a (mgr.14388) 17649 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:27 smithi027 bash[22610]: audit 2024-08-31T08:59:25.936957+0000 mgr.a (mgr.14388) 17648 : audit [DBG] from='client.380160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:27 smithi027 bash[22610]: cluster 2024-08-31T08:59:26.108542+0000 mgr.a (mgr.14388) 17649 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:27 smithi191 bash[24992]: audit 2024-08-31T08:59:25.936957+0000 mgr.a (mgr.14388) 17648 : audit [DBG] from='client.380160 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:27.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:27 smithi191 bash[24992]: cluster 2024-08-31T08:59:26.108542+0000 mgr.a (mgr.14388) 17649 : cluster [DBG] pgmap v12236: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:29 smithi163 bash[24253]: cluster 2024-08-31T08:59:28.110776+0000 mgr.a (mgr.14388) 17650 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:29 smithi027 bash[22610]: cluster 2024-08-31T08:59:28.110776+0000 mgr.a (mgr.14388) 17650 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:29 smithi191 bash[24992]: cluster 2024-08-31T08:59:28.110776+0000 mgr.a (mgr.14388) 17650 : cluster [DBG] pgmap v12237: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:31.357 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:59:31.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:59:31.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:59:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:31 smithi163 bash[24253]: cluster 2024-08-31T08:59:30.111564+0000 mgr.a (mgr.14388) 17651 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:31 smithi027 bash[22610]: cluster 2024-08-31T08:59:30.111564+0000 mgr.a (mgr.14388) 17651 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:31 smithi191 bash[24992]: cluster 2024-08-31T08:59:30.111564+0000 mgr.a (mgr.14388) 17651 : cluster [DBG] pgmap v12238: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:32.124 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:59:32.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:59:32.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:59:32.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:59:32.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:59:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:32 smithi163 bash[24253]: audit 2024-08-31T08:59:31.711871+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:59:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:32 smithi027 bash[22610]: audit 2024-08-31T08:59:31.711871+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:59:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:32 smithi191 bash[24992]: audit 2024-08-31T08:59:31.711871+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T08:59:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:33 smithi163 bash[24253]: audit 2024-08-31T08:59:31.689905+0000 mgr.a (mgr.14388) 17652 : audit [DBG] from='client.380238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:33.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:33 smithi163 bash[24253]: cluster 2024-08-31T08:59:32.112146+0000 mgr.a (mgr.14388) 17653 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:33.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:33 smithi163 bash[24253]: audit 2024-08-31T08:59:32.528799+0000 mon.a (mon.0) 3209 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:59:33.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:33 smithi163 bash[24253]: audit 2024-08-31T08:59:32.530843+0000 mon.a (mon.0) 3210 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:59:33.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:33 smithi163 bash[24253]: audit 2024-08-31T08:59:32.541973+0000 mon.a (mon.0) 3211 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:59:33.702 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:33 smithi163 bash[24253]: audit 2024-08-31T08:59:32.546816+0000 mon.a (mon.0) 3212 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:59:33.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:59:33 smithi027 bash[22863]: debug 2024-08-31T08:59:33.296+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:59:33.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 08:59:33 smithi027 bash[22863]: debug 2024-08-31T08:59:33.296+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:59:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:33 smithi027 bash[22610]: audit 2024-08-31T08:59:31.689905+0000 mgr.a (mgr.14388) 17652 : audit [DBG] from='client.380238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:33 smithi027 bash[22610]: cluster 2024-08-31T08:59:32.112146+0000 mgr.a (mgr.14388) 17653 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:33 smithi027 bash[22610]: audit 2024-08-31T08:59:32.528799+0000 mon.a (mon.0) 3209 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:59:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:33 smithi027 bash[22610]: audit 2024-08-31T08:59:32.530843+0000 mon.a (mon.0) 3210 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:59:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:33 smithi027 bash[22610]: audit 2024-08-31T08:59:32.541973+0000 mon.a (mon.0) 3211 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:59:33.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:33 smithi027 bash[22610]: audit 2024-08-31T08:59:32.546816+0000 mon.a (mon.0) 3212 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:59:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:33 smithi191 bash[24992]: audit 2024-08-31T08:59:31.689905+0000 mgr.a (mgr.14388) 17652 : audit [DBG] from='client.380238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:33 smithi191 bash[24992]: cluster 2024-08-31T08:59:32.112146+0000 mgr.a (mgr.14388) 17653 : cluster [DBG] pgmap v12239: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:33 smithi191 bash[24992]: audit 2024-08-31T08:59:32.528799+0000 mon.a (mon.0) 3209 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T08:59:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:33 smithi191 bash[24992]: audit 2024-08-31T08:59:32.530843+0000 mon.a (mon.0) 3210 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T08:59:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:33 smithi191 bash[24992]: audit 2024-08-31T08:59:32.541973+0000 mon.a (mon.0) 3211 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T08:59:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:33 smithi191 bash[24992]: audit 2024-08-31T08:59:32.546816+0000 mon.a (mon.0) 3212 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:59:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:34 smithi163 bash[24253]: audit 2024-08-31T08:59:32.547981+0000 mgr.a (mgr.14388) 17654 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:59:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:34 smithi163 bash[24253]: audit 2024-08-31T08:59:33.299459+0000 mgr.a (mgr.14388) 17655 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:59:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:34 smithi163 bash[24253]: cephadm 2024-08-31T08:59:33.301397+0000 mgr.a (mgr.14388) 17656 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:59:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:34 smithi027 bash[22610]: audit 2024-08-31T08:59:32.547981+0000 mgr.a (mgr.14388) 17654 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:59:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:34 smithi027 bash[22610]: audit 2024-08-31T08:59:33.299459+0000 mgr.a (mgr.14388) 17655 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:59:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:34 smithi027 bash[22610]: cephadm 2024-08-31T08:59:33.301397+0000 mgr.a (mgr.14388) 17656 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:59:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:34 smithi191 bash[24992]: audit 2024-08-31T08:59:32.547981+0000 mgr.a (mgr.14388) 17654 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T08:59:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:34 smithi191 bash[24992]: audit 2024-08-31T08:59:33.299459+0000 mgr.a (mgr.14388) 17655 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T08:59:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:34 smithi191 bash[24992]: cephadm 2024-08-31T08:59:33.301397+0000 mgr.a (mgr.14388) 17656 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T08:59:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:35 smithi163 bash[24253]: cluster 2024-08-31T08:59:34.114965+0000 mgr.a (mgr.14388) 17657 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:59:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:35 smithi027 bash[22610]: cluster 2024-08-31T08:59:34.114965+0000 mgr.a (mgr.14388) 17657 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:59:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:35 smithi191 bash[24992]: cluster 2024-08-31T08:59:34.114965+0000 mgr.a (mgr.14388) 17657 : cluster [DBG] pgmap v12240: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T08:59:37.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:59:37.127 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:59:37.127 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:59:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:37 smithi163 bash[24253]: cluster 2024-08-31T08:59:36.115751+0000 mgr.a (mgr.14388) 17658 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T08:59:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:37 smithi027 bash[22610]: cluster 2024-08-31T08:59:36.115751+0000 mgr.a (mgr.14388) 17658 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T08:59:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:37 smithi191 bash[24992]: cluster 2024-08-31T08:59:36.115751+0000 mgr.a (mgr.14388) 17658 : cluster [DBG] pgmap v12241: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T08:59:37.913 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:59:37.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:59:37.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:59:37.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:59:37.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:59:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:39 smithi163 bash[24253]: audit 2024-08-31T08:59:37.462955+0000 mgr.a (mgr.14388) 17659 : audit [DBG] from='client.380424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:39 smithi163 bash[24253]: cluster 2024-08-31T08:59:38.118181+0000 mgr.a (mgr.14388) 17660 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:59:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:39 smithi027 bash[22610]: audit 2024-08-31T08:59:37.462955+0000 mgr.a (mgr.14388) 17659 : audit [DBG] from='client.380424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:39 smithi027 bash[22610]: cluster 2024-08-31T08:59:38.118181+0000 mgr.a (mgr.14388) 17660 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:59:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:39 smithi191 bash[24992]: audit 2024-08-31T08:59:37.462955+0000 mgr.a (mgr.14388) 17659 : audit [DBG] from='client.380424 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:39 smithi191 bash[24992]: cluster 2024-08-31T08:59:38.118181+0000 mgr.a (mgr.14388) 17660 : cluster [DBG] pgmap v12242: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:59:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:41 smithi163 bash[24253]: cluster 2024-08-31T08:59:40.118993+0000 mgr.a (mgr.14388) 17661 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:59:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:41 smithi027 bash[22610]: cluster 2024-08-31T08:59:40.118993+0000 mgr.a (mgr.14388) 17661 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:59:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:41 smithi191 bash[24992]: cluster 2024-08-31T08:59:40.118993+0000 mgr.a (mgr.14388) 17661 : cluster [DBG] pgmap v12243: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:59:42.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:59:42.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:59:42.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:59:43.692 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:59:43.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:59:43.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:59:43.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:59:43.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:59:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:43 smithi163 bash[24253]: cluster 2024-08-31T08:59:42.119787+0000 mgr.a (mgr.14388) 17662 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:59:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:43 smithi027 bash[22610]: cluster 2024-08-31T08:59:42.119787+0000 mgr.a (mgr.14388) 17662 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:59:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:43 smithi191 bash[24992]: cluster 2024-08-31T08:59:42.119787+0000 mgr.a (mgr.14388) 17662 : cluster [DBG] pgmap v12244: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T08:59:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:44 smithi163 bash[24253]: audit 2024-08-31T08:59:43.248798+0000 mgr.a (mgr.14388) 17663 : audit [DBG] from='client.380496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:44 smithi027 bash[22610]: audit 2024-08-31T08:59:43.248798+0000 mgr.a (mgr.14388) 17663 : audit [DBG] from='client.380496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:44 smithi191 bash[24992]: audit 2024-08-31T08:59:43.248798+0000 mgr.a (mgr.14388) 17663 : audit [DBG] from='client.380496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:45 smithi163 bash[24253]: cluster 2024-08-31T08:59:44.122797+0000 mgr.a (mgr.14388) 17664 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:59:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:45 smithi027 bash[22610]: cluster 2024-08-31T08:59:44.122797+0000 mgr.a (mgr.14388) 17664 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:59:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:45 smithi191 bash[24992]: cluster 2024-08-31T08:59:44.122797+0000 mgr.a (mgr.14388) 17664 : cluster [DBG] pgmap v12245: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T08:59:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:47 smithi163 bash[24253]: cluster 2024-08-31T08:59:46.123645+0000 mgr.a (mgr.14388) 17665 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:59:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:47 smithi027 bash[22610]: cluster 2024-08-31T08:59:46.123645+0000 mgr.a (mgr.14388) 17665 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:59:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:47 smithi191 bash[24992]: cluster 2024-08-31T08:59:46.123645+0000 mgr.a (mgr.14388) 17665 : cluster [DBG] pgmap v12246: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T08:59:48.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:59:48.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:59:48.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:59:49.479 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:59:49.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:59:49.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:59:49.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:59:49.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:59:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:49 smithi163 bash[24253]: cluster 2024-08-31T08:59:48.125585+0000 mgr.a (mgr.14388) 17666 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T08:59:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:49 smithi027 bash[22610]: cluster 2024-08-31T08:59:48.125585+0000 mgr.a (mgr.14388) 17666 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T08:59:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:49 smithi191 bash[24992]: cluster 2024-08-31T08:59:48.125585+0000 mgr.a (mgr.14388) 17666 : cluster [DBG] pgmap v12247: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T08:59:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:50 smithi163 bash[24253]: audit 2024-08-31T08:59:49.029419+0000 mgr.a (mgr.14388) 17667 : audit [DBG] from='client.380568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:50 smithi027 bash[22610]: audit 2024-08-31T08:59:49.029419+0000 mgr.a (mgr.14388) 17667 : audit [DBG] from='client.380568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:50 smithi191 bash[24992]: audit 2024-08-31T08:59:49.029419+0000 mgr.a (mgr.14388) 17667 : audit [DBG] from='client.380568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:51 smithi163 bash[24253]: cluster 2024-08-31T08:59:50.126536+0000 mgr.a (mgr.14388) 17668 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:59:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:51 smithi027 bash[22610]: cluster 2024-08-31T08:59:50.126536+0000 mgr.a (mgr.14388) 17668 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:59:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:51 smithi191 bash[24992]: cluster 2024-08-31T08:59:50.126536+0000 mgr.a (mgr.14388) 17668 : cluster [DBG] pgmap v12248: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:59:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:53 smithi163 bash[24253]: cluster 2024-08-31T08:59:52.127382+0000 mgr.a (mgr.14388) 17669 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:59:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:53 smithi027 bash[22610]: cluster 2024-08-31T08:59:52.127382+0000 mgr.a (mgr.14388) 17669 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:59:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:53 smithi191 bash[24992]: cluster 2024-08-31T08:59:52.127382+0000 mgr.a (mgr.14388) 17669 : cluster [DBG] pgmap v12249: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T08:59:54.480 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T08:59:54.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T08:59:54.481 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T08:59:55.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T08:59:55.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T08:59:55.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T08:59:55.263 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T08:59:55.263 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T08:59:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:55 smithi163 bash[24253]: cluster 2024-08-31T08:59:54.129610+0000 mgr.a (mgr.14388) 17670 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:59:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:55 smithi027 bash[22610]: cluster 2024-08-31T08:59:54.129610+0000 mgr.a (mgr.14388) 17670 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:59:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:55 smithi191 bash[24992]: cluster 2024-08-31T08:59:54.129610+0000 mgr.a (mgr.14388) 17670 : cluster [DBG] pgmap v12250: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T08:59:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:56 smithi163 bash[24253]: audit 2024-08-31T08:59:54.817742+0000 mgr.a (mgr.14388) 17671 : audit [DBG] from='client.380640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:56 smithi027 bash[22610]: audit 2024-08-31T08:59:54.817742+0000 mgr.a (mgr.14388) 17671 : audit [DBG] from='client.380640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:56 smithi191 bash[24992]: audit 2024-08-31T08:59:54.817742+0000 mgr.a (mgr.14388) 17671 : audit [DBG] from='client.380640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T08:59:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:57 smithi163 bash[24253]: cluster 2024-08-31T08:59:56.130575+0000 mgr.a (mgr.14388) 17672 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:57 smithi027 bash[22610]: cluster 2024-08-31T08:59:56.130575+0000 mgr.a (mgr.14388) 17672 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:57 smithi191 bash[24992]: cluster 2024-08-31T08:59:56.130575+0000 mgr.a (mgr.14388) 17672 : cluster [DBG] pgmap v12251: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T08:59:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 08:59:59 smithi163 bash[24253]: cluster 2024-08-31T08:59:58.132831+0000 mgr.a (mgr.14388) 17673 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 08:59:59 smithi027 bash[22610]: cluster 2024-08-31T08:59:58.132831+0000 mgr.a (mgr.14388) 17673 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T08:59:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 08:59:59 smithi191 bash[24992]: cluster 2024-08-31T08:59:58.132831+0000 mgr.a (mgr.14388) 17673 : cluster [DBG] pgmap v12252: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:00.264 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:00.265 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:00.265 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:00.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:00 smithi163 bash[24253]: cluster 2024-08-31T09:00:00.000158+0000 mon.a (mon.0) 3213 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:00:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:00 smithi027 bash[22610]: cluster 2024-08-31T09:00:00.000158+0000 mon.a (mon.0) 3213 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:00:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:00 smithi191 bash[24992]: cluster 2024-08-31T09:00:00.000158+0000 mon.a (mon.0) 3213 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:00:01.009 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:01.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:01.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:01.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:01.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:01 smithi163 bash[24253]: cluster 2024-08-31T09:00:00.133759+0000 mgr.a (mgr.14388) 17674 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:01 smithi027 bash[22610]: cluster 2024-08-31T09:00:00.133759+0000 mgr.a (mgr.14388) 17674 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:01 smithi191 bash[24992]: cluster 2024-08-31T09:00:00.133759+0000 mgr.a (mgr.14388) 17674 : cluster [DBG] pgmap v12253: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:02.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:02 smithi163 bash[24253]: audit 2024-08-31T09:00:00.593538+0000 mgr.a (mgr.14388) 17675 : audit [DBG] from='client.380718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:02 smithi027 bash[22610]: audit 2024-08-31T09:00:00.593538+0000 mgr.a (mgr.14388) 17675 : audit [DBG] from='client.380718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:02 smithi191 bash[24992]: audit 2024-08-31T09:00:00.593538+0000 mgr.a (mgr.14388) 17675 : audit [DBG] from='client.380718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:03 smithi163 bash[24253]: cluster 2024-08-31T09:00:02.134881+0000 mgr.a (mgr.14388) 17676 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:03 smithi027 bash[22610]: cluster 2024-08-31T09:00:02.134881+0000 mgr.a (mgr.14388) 17676 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:03 smithi191 bash[24992]: cluster 2024-08-31T09:00:02.134881+0000 mgr.a (mgr.14388) 17676 : cluster [DBG] pgmap v12254: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:05 smithi163 bash[24253]: cluster 2024-08-31T09:00:04.137292+0000 mgr.a (mgr.14388) 17677 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:05 smithi027 bash[22610]: cluster 2024-08-31T09:00:04.137292+0000 mgr.a (mgr.14388) 17677 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:05 smithi191 bash[24992]: cluster 2024-08-31T09:00:04.137292+0000 mgr.a (mgr.14388) 17677 : cluster [DBG] pgmap v12255: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:06.011 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:06.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:06.012 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:06.782 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:06.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:06.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:06.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:06.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:07 smithi163 bash[24253]: cluster 2024-08-31T09:00:06.137881+0000 mgr.a (mgr.14388) 17678 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:07 smithi163 bash[24253]: audit 2024-08-31T09:00:06.345890+0000 mgr.a (mgr.14388) 17679 : audit [DBG] from='client.380793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:07 smithi027 bash[22610]: cluster 2024-08-31T09:00:06.137881+0000 mgr.a (mgr.14388) 17678 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:07 smithi027 bash[22610]: audit 2024-08-31T09:00:06.345890+0000 mgr.a (mgr.14388) 17679 : audit [DBG] from='client.380793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:07 smithi191 bash[24992]: cluster 2024-08-31T09:00:06.137881+0000 mgr.a (mgr.14388) 17678 : cluster [DBG] pgmap v12256: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:07 smithi191 bash[24992]: audit 2024-08-31T09:00:06.345890+0000 mgr.a (mgr.14388) 17679 : audit [DBG] from='client.380793 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:09 smithi163 bash[24253]: cluster 2024-08-31T09:00:08.140063+0000 mgr.a (mgr.14388) 17680 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:09 smithi027 bash[22610]: cluster 2024-08-31T09:00:08.140063+0000 mgr.a (mgr.14388) 17680 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:09 smithi191 bash[24992]: cluster 2024-08-31T09:00:08.140063+0000 mgr.a (mgr.14388) 17680 : cluster [DBG] pgmap v12257: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:11 smithi163 bash[24253]: cluster 2024-08-31T09:00:10.140847+0000 mgr.a (mgr.14388) 17681 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:11 smithi027 bash[22610]: cluster 2024-08-31T09:00:10.140847+0000 mgr.a (mgr.14388) 17681 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:11.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:11.785 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:11.785 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:11 smithi191 bash[24992]: cluster 2024-08-31T09:00:10.140847+0000 mgr.a (mgr.14388) 17681 : cluster [DBG] pgmap v12258: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:12.549 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:12.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:12.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:12.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:12.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:13 smithi163 bash[24253]: audit 2024-08-31T09:00:12.117668+0000 mgr.a (mgr.14388) 17682 : audit [DBG] from='client.380865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:13 smithi163 bash[24253]: cluster 2024-08-31T09:00:12.141808+0000 mgr.a (mgr.14388) 17683 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:13 smithi027 bash[22610]: audit 2024-08-31T09:00:12.117668+0000 mgr.a (mgr.14388) 17682 : audit [DBG] from='client.380865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:13 smithi027 bash[22610]: cluster 2024-08-31T09:00:12.141808+0000 mgr.a (mgr.14388) 17683 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:13 smithi191 bash[24992]: audit 2024-08-31T09:00:12.117668+0000 mgr.a (mgr.14388) 17682 : audit [DBG] from='client.380865 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:13 smithi191 bash[24992]: cluster 2024-08-31T09:00:12.141808+0000 mgr.a (mgr.14388) 17683 : cluster [DBG] pgmap v12259: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:14 smithi191 bash[24992]: cluster 2024-08-31T09:00:14.144251+0000 mgr.a (mgr.14388) 17684 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:14 smithi163 bash[24253]: cluster 2024-08-31T09:00:14.144251+0000 mgr.a (mgr.14388) 17684 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:14 smithi027 bash[22610]: cluster 2024-08-31T09:00:14.144251+0000 mgr.a (mgr.14388) 17684 : cluster [DBG] pgmap v12260: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:17 smithi027 bash[22610]: cluster 2024-08-31T09:00:16.145007+0000 mgr.a (mgr.14388) 17685 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:17 smithi191 bash[24992]: cluster 2024-08-31T09:00:16.145007+0000 mgr.a (mgr.14388) 17685 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:17.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:17.551 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:17.551 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:17 smithi163 bash[24253]: cluster 2024-08-31T09:00:16.145007+0000 mgr.a (mgr.14388) 17685 : cluster [DBG] pgmap v12261: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:18.325 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:18.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:18.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:18.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:18.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:19 smithi027 bash[22610]: audit 2024-08-31T09:00:17.890321+0000 mgr.a (mgr.14388) 17686 : audit [DBG] from='client.380937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:19 smithi027 bash[22610]: cluster 2024-08-31T09:00:18.146402+0000 mgr.a (mgr.14388) 17687 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:19 smithi191 bash[24992]: audit 2024-08-31T09:00:17.890321+0000 mgr.a (mgr.14388) 17686 : audit [DBG] from='client.380937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:19 smithi191 bash[24992]: cluster 2024-08-31T09:00:18.146402+0000 mgr.a (mgr.14388) 17687 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:19.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:19 smithi163 bash[24253]: audit 2024-08-31T09:00:17.890321+0000 mgr.a (mgr.14388) 17686 : audit [DBG] from='client.380937 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:19.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:19 smithi163 bash[24253]: cluster 2024-08-31T09:00:18.146402+0000 mgr.a (mgr.14388) 17687 : cluster [DBG] pgmap v12262: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:21 smithi027 bash[22610]: cluster 2024-08-31T09:00:20.147277+0000 mgr.a (mgr.14388) 17688 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:00:21.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:21 smithi191 bash[24992]: cluster 2024-08-31T09:00:20.147277+0000 mgr.a (mgr.14388) 17688 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:00:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:21 smithi163 bash[24253]: cluster 2024-08-31T09:00:20.147277+0000 mgr.a (mgr.14388) 17688 : cluster [DBG] pgmap v12263: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:00:23.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:23.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:23 smithi027 bash[22610]: cluster 2024-08-31T09:00:22.148063+0000 mgr.a (mgr.14388) 17689 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:00:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:23 smithi191 bash[24992]: cluster 2024-08-31T09:00:22.148063+0000 mgr.a (mgr.14388) 17689 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:00:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:23 smithi163 bash[24253]: cluster 2024-08-31T09:00:22.148063+0000 mgr.a (mgr.14388) 17689 : cluster [DBG] pgmap v12264: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:00:24.079 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:24.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:24.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:24.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:24.080 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:25 smithi027 bash[22610]: audit 2024-08-31T09:00:23.659175+0000 mgr.a (mgr.14388) 17690 : audit [DBG] from='client.381015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:25 smithi027 bash[22610]: cluster 2024-08-31T09:00:24.149751+0000 mgr.a (mgr.14388) 17691 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:25 smithi191 bash[24992]: audit 2024-08-31T09:00:23.659175+0000 mgr.a (mgr.14388) 17690 : audit [DBG] from='client.381015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:25.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:25 smithi191 bash[24992]: cluster 2024-08-31T09:00:24.149751+0000 mgr.a (mgr.14388) 17691 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:25 smithi163 bash[24253]: audit 2024-08-31T09:00:23.659175+0000 mgr.a (mgr.14388) 17690 : audit [DBG] from='client.381015 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:25 smithi163 bash[24253]: cluster 2024-08-31T09:00:24.149751+0000 mgr.a (mgr.14388) 17691 : cluster [DBG] pgmap v12265: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:27 smithi027 bash[22610]: cluster 2024-08-31T09:00:26.150512+0000 mgr.a (mgr.14388) 17692 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:00:27.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:27 smithi191 bash[24992]: cluster 2024-08-31T09:00:26.150512+0000 mgr.a (mgr.14388) 17692 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:00:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:27 smithi163 bash[24253]: cluster 2024-08-31T09:00:26.150512+0000 mgr.a (mgr.14388) 17692 : cluster [DBG] pgmap v12266: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:00:29.081 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:29.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:29.082 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:29 smithi027 bash[22610]: cluster 2024-08-31T09:00:28.152549+0000 mgr.a (mgr.14388) 17693 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:29 smithi191 bash[24992]: cluster 2024-08-31T09:00:28.152549+0000 mgr.a (mgr.14388) 17693 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:29 smithi163 bash[24253]: cluster 2024-08-31T09:00:28.152549+0000 mgr.a (mgr.14388) 17693 : cluster [DBG] pgmap v12267: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:29.828 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:29.828 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:29.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:29.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:29.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:30 smithi191 bash[24992]: audit 2024-08-31T09:00:29.412617+0000 mgr.a (mgr.14388) 17694 : audit [DBG] from='client.381090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:30 smithi163 bash[24253]: audit 2024-08-31T09:00:29.412617+0000 mgr.a (mgr.14388) 17694 : audit [DBG] from='client.381090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:30 smithi027 bash[22610]: audit 2024-08-31T09:00:29.412617+0000 mgr.a (mgr.14388) 17694 : audit [DBG] from='client.381090 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:31 smithi191 bash[24992]: cluster 2024-08-31T09:00:30.153667+0000 mgr.a (mgr.14388) 17695 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:31 smithi163 bash[24253]: cluster 2024-08-31T09:00:30.153667+0000 mgr.a (mgr.14388) 17695 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:31 smithi027 bash[22610]: cluster 2024-08-31T09:00:30.153667+0000 mgr.a (mgr.14388) 17695 : cluster [DBG] pgmap v12268: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:33.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:33 smithi191 bash[24992]: cluster 2024-08-31T09:00:32.154638+0000 mgr.a (mgr.14388) 17696 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:33 smithi163 bash[24253]: cluster 2024-08-31T09:00:32.154638+0000 mgr.a (mgr.14388) 17696 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:33 smithi027 bash[22610]: cluster 2024-08-31T09:00:32.154638+0000 mgr.a (mgr.14388) 17696 : cluster [DBG] pgmap v12269: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:34 smithi191 bash[24992]: audit 2024-08-31T09:00:33.356787+0000 mon.a (mon.0) 3214 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:00:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:34 smithi191 bash[24992]: audit 2024-08-31T09:00:34.195839+0000 mon.a (mon.0) 3215 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:00:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:34 smithi191 bash[24992]: audit 2024-08-31T09:00:34.197824+0000 mon.a (mon.0) 3216 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:00:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:34 smithi191 bash[24992]: audit 2024-08-31T09:00:34.208854+0000 mon.a (mon.0) 3217 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:00:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:34 smithi191 bash[24992]: audit 2024-08-31T09:00:34.212008+0000 mon.a (mon.0) 3218 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:00:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:34 smithi163 bash[24253]: audit 2024-08-31T09:00:33.356787+0000 mon.a (mon.0) 3214 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:00:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:34 smithi163 bash[24253]: audit 2024-08-31T09:00:34.195839+0000 mon.a (mon.0) 3215 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:00:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:34 smithi163 bash[24253]: audit 2024-08-31T09:00:34.197824+0000 mon.a (mon.0) 3216 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:00:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:34 smithi163 bash[24253]: audit 2024-08-31T09:00:34.208854+0000 mon.a (mon.0) 3217 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:00:34.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:34 smithi163 bash[24253]: audit 2024-08-31T09:00:34.212008+0000 mon.a (mon.0) 3218 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:00:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:34 smithi027 bash[22610]: audit 2024-08-31T09:00:33.356787+0000 mon.a (mon.0) 3214 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:00:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:34 smithi027 bash[22610]: audit 2024-08-31T09:00:34.195839+0000 mon.a (mon.0) 3215 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:00:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:34 smithi027 bash[22610]: audit 2024-08-31T09:00:34.197824+0000 mon.a (mon.0) 3216 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:00:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:34 smithi027 bash[22610]: audit 2024-08-31T09:00:34.208854+0000 mon.a (mon.0) 3217 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:00:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:34 smithi027 bash[22610]: audit 2024-08-31T09:00:34.212008+0000 mon.a (mon.0) 3218 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:00:34.829 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:34.830 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:34.830 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:35.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:00:34 smithi027 bash[22863]: debug 2024-08-31T09:00:34.942+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:00:35.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:00:34 smithi027 bash[22863]: debug 2024-08-31T09:00:34.946+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:00:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:35 smithi191 bash[24992]: cluster 2024-08-31T09:00:34.156959+0000 mgr.a (mgr.14388) 17697 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:35 smithi191 bash[24992]: audit 2024-08-31T09:00:34.213463+0000 mgr.a (mgr.14388) 17698 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:00:35.552 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:35.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:35.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:35.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:35.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:35 smithi163 bash[24253]: cluster 2024-08-31T09:00:34.156959+0000 mgr.a (mgr.14388) 17697 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:35 smithi163 bash[24253]: audit 2024-08-31T09:00:34.213463+0000 mgr.a (mgr.14388) 17698 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:00:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:35 smithi027 bash[22610]: cluster 2024-08-31T09:00:34.156959+0000 mgr.a (mgr.14388) 17697 : cluster [DBG] pgmap v12270: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:35 smithi027 bash[22610]: audit 2024-08-31T09:00:34.213463+0000 mgr.a (mgr.14388) 17698 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:00:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:36 smithi191 bash[24992]: audit 2024-08-31T09:00:34.945781+0000 mgr.a (mgr.14388) 17699 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:00:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:36 smithi191 bash[24992]: cephadm 2024-08-31T09:00:34.946980+0000 mgr.a (mgr.14388) 17700 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:00:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:36 smithi191 bash[24992]: audit 2024-08-31T09:00:35.137605+0000 mgr.a (mgr.14388) 17701 : audit [DBG] from='client.381273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:36 smithi163 bash[24253]: audit 2024-08-31T09:00:34.945781+0000 mgr.a (mgr.14388) 17699 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:00:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:36 smithi163 bash[24253]: cephadm 2024-08-31T09:00:34.946980+0000 mgr.a (mgr.14388) 17700 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:00:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:36 smithi163 bash[24253]: audit 2024-08-31T09:00:35.137605+0000 mgr.a (mgr.14388) 17701 : audit [DBG] from='client.381273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:36 smithi027 bash[22610]: audit 2024-08-31T09:00:34.945781+0000 mgr.a (mgr.14388) 17699 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:00:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:36 smithi027 bash[22610]: cephadm 2024-08-31T09:00:34.946980+0000 mgr.a (mgr.14388) 17700 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:00:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:36 smithi027 bash[22610]: audit 2024-08-31T09:00:35.137605+0000 mgr.a (mgr.14388) 17701 : audit [DBG] from='client.381273 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:37 smithi191 bash[24992]: cluster 2024-08-31T09:00:36.157905+0000 mgr.a (mgr.14388) 17702 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:37 smithi163 bash[24253]: cluster 2024-08-31T09:00:36.157905+0000 mgr.a (mgr.14388) 17702 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:37 smithi027 bash[22610]: cluster 2024-08-31T09:00:36.157905+0000 mgr.a (mgr.14388) 17702 : cluster [DBG] pgmap v12271: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:39 smithi191 bash[24992]: cluster 2024-08-31T09:00:38.160088+0000 mgr.a (mgr.14388) 17703 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:39 smithi163 bash[24253]: cluster 2024-08-31T09:00:38.160088+0000 mgr.a (mgr.14388) 17703 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:39 smithi027 bash[22610]: cluster 2024-08-31T09:00:38.160088+0000 mgr.a (mgr.14388) 17703 : cluster [DBG] pgmap v12272: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:40.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:40.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:40.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:41.308 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:41.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:41.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:41.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:41.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:41.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:41 smithi191 bash[24992]: cluster 2024-08-31T09:00:40.160858+0000 mgr.a (mgr.14388) 17704 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:41 smithi163 bash[24253]: cluster 2024-08-31T09:00:40.160858+0000 mgr.a (mgr.14388) 17704 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:41 smithi027 bash[22610]: cluster 2024-08-31T09:00:40.160858+0000 mgr.a (mgr.14388) 17704 : cluster [DBG] pgmap v12273: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:42 smithi191 bash[24992]: audit 2024-08-31T09:00:40.879478+0000 mgr.a (mgr.14388) 17705 : audit [DBG] from='client.381351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:42 smithi163 bash[24253]: audit 2024-08-31T09:00:40.879478+0000 mgr.a (mgr.14388) 17705 : audit [DBG] from='client.381351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:42 smithi027 bash[22610]: audit 2024-08-31T09:00:40.879478+0000 mgr.a (mgr.14388) 17705 : audit [DBG] from='client.381351 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:43 smithi191 bash[24992]: cluster 2024-08-31T09:00:42.161921+0000 mgr.a (mgr.14388) 17706 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:43 smithi163 bash[24253]: cluster 2024-08-31T09:00:42.161921+0000 mgr.a (mgr.14388) 17706 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:43 smithi027 bash[22610]: cluster 2024-08-31T09:00:42.161921+0000 mgr.a (mgr.14388) 17706 : cluster [DBG] pgmap v12274: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:45 smithi163 bash[24253]: cluster 2024-08-31T09:00:44.164197+0000 mgr.a (mgr.14388) 17707 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:45 smithi027 bash[22610]: cluster 2024-08-31T09:00:44.164197+0000 mgr.a (mgr.14388) 17707 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:45 smithi191 bash[24992]: cluster 2024-08-31T09:00:44.164197+0000 mgr.a (mgr.14388) 17707 : cluster [DBG] pgmap v12275: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:46.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:46.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:46.311 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:47.060 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:47.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:47.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:47.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:47.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:47 smithi163 bash[24253]: cluster 2024-08-31T09:00:46.164979+0000 mgr.a (mgr.14388) 17708 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:47 smithi027 bash[22610]: cluster 2024-08-31T09:00:46.164979+0000 mgr.a (mgr.14388) 17708 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:47 smithi191 bash[24992]: cluster 2024-08-31T09:00:46.164979+0000 mgr.a (mgr.14388) 17708 : cluster [DBG] pgmap v12276: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:48 smithi163 bash[24253]: audit 2024-08-31T09:00:46.641583+0000 mgr.a (mgr.14388) 17709 : audit [DBG] from='client.381429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:48 smithi027 bash[22610]: audit 2024-08-31T09:00:46.641583+0000 mgr.a (mgr.14388) 17709 : audit [DBG] from='client.381429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:48 smithi191 bash[24992]: audit 2024-08-31T09:00:46.641583+0000 mgr.a (mgr.14388) 17709 : audit [DBG] from='client.381429 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:49 smithi163 bash[24253]: cluster 2024-08-31T09:00:48.167363+0000 mgr.a (mgr.14388) 17710 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:49 smithi027 bash[22610]: cluster 2024-08-31T09:00:48.167363+0000 mgr.a (mgr.14388) 17710 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:49 smithi191 bash[24992]: cluster 2024-08-31T09:00:48.167363+0000 mgr.a (mgr.14388) 17710 : cluster [DBG] pgmap v12277: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:00:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:51 smithi163 bash[24253]: cluster 2024-08-31T09:00:50.168170+0000 mgr.a (mgr.14388) 17711 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:51 smithi027 bash[22610]: cluster 2024-08-31T09:00:50.168170+0000 mgr.a (mgr.14388) 17711 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:51 smithi191 bash[24992]: cluster 2024-08-31T09:00:50.168170+0000 mgr.a (mgr.14388) 17711 : cluster [DBG] pgmap v12278: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:52.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:52.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:52.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:52.843 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:52.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:52.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:52.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:52.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:53 smithi163 bash[24253]: cluster 2024-08-31T09:00:52.168585+0000 mgr.a (mgr.14388) 17712 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:53 smithi163 bash[24253]: audit 2024-08-31T09:00:52.398004+0000 mgr.a (mgr.14388) 17713 : audit [DBG] from='client.381507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:53 smithi027 bash[22610]: cluster 2024-08-31T09:00:52.168585+0000 mgr.a (mgr.14388) 17712 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:53 smithi027 bash[22610]: audit 2024-08-31T09:00:52.398004+0000 mgr.a (mgr.14388) 17713 : audit [DBG] from='client.381507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:53 smithi191 bash[24992]: cluster 2024-08-31T09:00:52.168585+0000 mgr.a (mgr.14388) 17712 : cluster [DBG] pgmap v12279: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:53 smithi191 bash[24992]: audit 2024-08-31T09:00:52.398004+0000 mgr.a (mgr.14388) 17713 : audit [DBG] from='client.381507 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:55 smithi163 bash[24253]: cluster 2024-08-31T09:00:54.170870+0000 mgr.a (mgr.14388) 17714 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:55 smithi027 bash[22610]: cluster 2024-08-31T09:00:54.170870+0000 mgr.a (mgr.14388) 17714 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:55 smithi191 bash[24992]: cluster 2024-08-31T09:00:54.170870+0000 mgr.a (mgr.14388) 17714 : cluster [DBG] pgmap v12280: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:00:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:57 smithi163 bash[24253]: cluster 2024-08-31T09:00:56.171672+0000 mgr.a (mgr.14388) 17715 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:57 smithi027 bash[22610]: cluster 2024-08-31T09:00:56.171672+0000 mgr.a (mgr.14388) 17715 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:57 smithi191 bash[24992]: cluster 2024-08-31T09:00:56.171672+0000 mgr.a (mgr.14388) 17715 : cluster [DBG] pgmap v12281: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:00:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:00:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:00:58.626 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:00:58.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:00:58.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:00:58.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:00:58.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:00:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:59 smithi163 bash[24253]: cluster 2024-08-31T09:00:58.173622+0000 mgr.a (mgr.14388) 17716 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:00:59 smithi163 bash[24253]: audit 2024-08-31T09:00:58.186096+0000 mgr.a (mgr.14388) 17717 : audit [DBG] from='client.381579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:59 smithi027 bash[22610]: cluster 2024-08-31T09:00:58.173622+0000 mgr.a (mgr.14388) 17716 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:00:59 smithi027 bash[22610]: audit 2024-08-31T09:00:58.186096+0000 mgr.a (mgr.14388) 17717 : audit [DBG] from='client.381579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:00:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:59 smithi191 bash[24992]: cluster 2024-08-31T09:00:58.173622+0000 mgr.a (mgr.14388) 17716 : cluster [DBG] pgmap v12282: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:00:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:00:59 smithi191 bash[24992]: audit 2024-08-31T09:00:58.186096+0000 mgr.a (mgr.14388) 17717 : audit [DBG] from='client.381579 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:01 smithi163 bash[24253]: cluster 2024-08-31T09:01:00.174479+0000 mgr.a (mgr.14388) 17718 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:01:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:01 smithi027 bash[22610]: cluster 2024-08-31T09:01:00.174479+0000 mgr.a (mgr.14388) 17718 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:01:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:01 smithi191 bash[24992]: cluster 2024-08-31T09:01:00.174479+0000 mgr.a (mgr.14388) 17718 : cluster [DBG] pgmap v12283: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:01:03.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:01:03.628 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:01:03.628 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:01:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:03 smithi163 bash[24253]: cluster 2024-08-31T09:01:02.175283+0000 mgr.a (mgr.14388) 17719 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:01:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:03 smithi027 bash[22610]: cluster 2024-08-31T09:01:02.175283+0000 mgr.a (mgr.14388) 17719 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:01:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:03 smithi191 bash[24992]: cluster 2024-08-31T09:01:02.175283+0000 mgr.a (mgr.14388) 17719 : cluster [DBG] pgmap v12284: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:01:04.401 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:01:04.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:01:04.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:01:04.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:01:04.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:01:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:05 smithi163 bash[24253]: audit 2024-08-31T09:01:03.966001+0000 mgr.a (mgr.14388) 17720 : audit [DBG] from='client.381657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:05 smithi163 bash[24253]: cluster 2024-08-31T09:01:04.176657+0000 mgr.a (mgr.14388) 17721 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:05 smithi027 bash[22610]: audit 2024-08-31T09:01:03.966001+0000 mgr.a (mgr.14388) 17720 : audit [DBG] from='client.381657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:05 smithi027 bash[22610]: cluster 2024-08-31T09:01:04.176657+0000 mgr.a (mgr.14388) 17721 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:05 smithi191 bash[24992]: audit 2024-08-31T09:01:03.966001+0000 mgr.a (mgr.14388) 17720 : audit [DBG] from='client.381657 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:05 smithi191 bash[24992]: cluster 2024-08-31T09:01:04.176657+0000 mgr.a (mgr.14388) 17721 : cluster [DBG] pgmap v12285: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:07 smithi163 bash[24253]: cluster 2024-08-31T09:01:06.177527+0000 mgr.a (mgr.14388) 17722 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:01:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:07 smithi027 bash[22610]: cluster 2024-08-31T09:01:06.177527+0000 mgr.a (mgr.14388) 17722 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:01:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:07 smithi191 bash[24992]: cluster 2024-08-31T09:01:06.177527+0000 mgr.a (mgr.14388) 17722 : cluster [DBG] pgmap v12286: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:01:09.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:01:09.403 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:01:09.403 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:01:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:09 smithi163 bash[24253]: cluster 2024-08-31T09:01:08.179634+0000 mgr.a (mgr.14388) 17723 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:09 smithi027 bash[22610]: cluster 2024-08-31T09:01:08.179634+0000 mgr.a (mgr.14388) 17723 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:09 smithi191 bash[24992]: cluster 2024-08-31T09:01:08.179634+0000 mgr.a (mgr.14388) 17723 : cluster [DBG] pgmap v12287: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:10.158 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:01:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:01:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:01:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:01:10.158 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:01:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:11 smithi163 bash[24253]: audit 2024-08-31T09:01:09.735573+0000 mgr.a (mgr.14388) 17724 : audit [DBG] from='client.381735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:11 smithi163 bash[24253]: cluster 2024-08-31T09:01:10.180131+0000 mgr.a (mgr.14388) 17725 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:11 smithi027 bash[22610]: audit 2024-08-31T09:01:09.735573+0000 mgr.a (mgr.14388) 17724 : audit [DBG] from='client.381735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:11 smithi027 bash[22610]: cluster 2024-08-31T09:01:10.180131+0000 mgr.a (mgr.14388) 17725 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:11 smithi191 bash[24992]: audit 2024-08-31T09:01:09.735573+0000 mgr.a (mgr.14388) 17724 : audit [DBG] from='client.381735 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:11 smithi191 bash[24992]: cluster 2024-08-31T09:01:10.180131+0000 mgr.a (mgr.14388) 17725 : cluster [DBG] pgmap v12288: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:13 smithi163 bash[24253]: cluster 2024-08-31T09:01:12.180880+0000 mgr.a (mgr.14388) 17726 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:13 smithi027 bash[22610]: cluster 2024-08-31T09:01:12.180880+0000 mgr.a (mgr.14388) 17726 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:13 smithi191 bash[24992]: cluster 2024-08-31T09:01:12.180880+0000 mgr.a (mgr.14388) 17726 : cluster [DBG] pgmap v12289: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:15.159 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:01:15.160 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:01:15.160 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:01:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:15 smithi163 bash[24253]: cluster 2024-08-31T09:01:14.183137+0000 mgr.a (mgr.14388) 17727 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:15 smithi027 bash[22610]: cluster 2024-08-31T09:01:14.183137+0000 mgr.a (mgr.14388) 17727 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:15 smithi191 bash[24992]: cluster 2024-08-31T09:01:14.183137+0000 mgr.a (mgr.14388) 17727 : cluster [DBG] pgmap v12290: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:15.912 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:01:15.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:01:15.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:01:15.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:01:15.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:01:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:17 smithi163 bash[24253]: audit 2024-08-31T09:01:15.491467+0000 mgr.a (mgr.14388) 17728 : audit [DBG] from='client.381813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:17 smithi163 bash[24253]: cluster 2024-08-31T09:01:16.183976+0000 mgr.a (mgr.14388) 17729 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:17 smithi027 bash[22610]: audit 2024-08-31T09:01:15.491467+0000 mgr.a (mgr.14388) 17728 : audit [DBG] from='client.381813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:17 smithi027 bash[22610]: cluster 2024-08-31T09:01:16.183976+0000 mgr.a (mgr.14388) 17729 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:17 smithi191 bash[24992]: audit 2024-08-31T09:01:15.491467+0000 mgr.a (mgr.14388) 17728 : audit [DBG] from='client.381813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:17 smithi191 bash[24992]: cluster 2024-08-31T09:01:16.183976+0000 mgr.a (mgr.14388) 17729 : cluster [DBG] pgmap v12291: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:19.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:19 smithi163 bash[24253]: cluster 2024-08-31T09:01:18.186046+0000 mgr.a (mgr.14388) 17730 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:19 smithi027 bash[22610]: cluster 2024-08-31T09:01:18.186046+0000 mgr.a (mgr.14388) 17730 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:19 smithi191 bash[24992]: cluster 2024-08-31T09:01:18.186046+0000 mgr.a (mgr.14388) 17730 : cluster [DBG] pgmap v12292: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:01:20.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:01:21.689 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:01:21.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:01:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:21 smithi163 bash[24253]: cluster 2024-08-31T09:01:20.186825+0000 mgr.a (mgr.14388) 17731 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:21 smithi027 bash[22610]: cluster 2024-08-31T09:01:20.186825+0000 mgr.a (mgr.14388) 17731 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:21 smithi191 bash[24992]: cluster 2024-08-31T09:01:20.186825+0000 mgr.a (mgr.14388) 17731 : cluster [DBG] pgmap v12293: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:22 smithi163 bash[24253]: audit 2024-08-31T09:01:21.251208+0000 mgr.a (mgr.14388) 17732 : audit [DBG] from='client.381891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:22 smithi027 bash[22610]: audit 2024-08-31T09:01:21.251208+0000 mgr.a (mgr.14388) 17732 : audit [DBG] from='client.381891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:22 smithi191 bash[24992]: audit 2024-08-31T09:01:21.251208+0000 mgr.a (mgr.14388) 17732 : audit [DBG] from='client.381891 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:23 smithi163 bash[24253]: cluster 2024-08-31T09:01:22.187699+0000 mgr.a (mgr.14388) 17733 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:23 smithi027 bash[22610]: cluster 2024-08-31T09:01:22.187699+0000 mgr.a (mgr.14388) 17733 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:23 smithi191 bash[24992]: cluster 2024-08-31T09:01:22.187699+0000 mgr.a (mgr.14388) 17733 : cluster [DBG] pgmap v12294: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:25 smithi163 bash[24253]: cluster 2024-08-31T09:01:24.189893+0000 mgr.a (mgr.14388) 17734 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:25 smithi027 bash[22610]: cluster 2024-08-31T09:01:24.189893+0000 mgr.a (mgr.14388) 17734 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:25 smithi191 bash[24992]: cluster 2024-08-31T09:01:24.189893+0000 mgr.a (mgr.14388) 17734 : cluster [DBG] pgmap v12295: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:26.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:01:26.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:01:26.691 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:01:27.462 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:01:27.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:01:27.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:01:27.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:01:27.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:01:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:27 smithi163 bash[24253]: cluster 2024-08-31T09:01:26.190623+0000 mgr.a (mgr.14388) 17735 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:27 smithi027 bash[22610]: cluster 2024-08-31T09:01:26.190623+0000 mgr.a (mgr.14388) 17735 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:27 smithi191 bash[24992]: cluster 2024-08-31T09:01:26.190623+0000 mgr.a (mgr.14388) 17735 : cluster [DBG] pgmap v12296: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:28 smithi163 bash[24253]: audit 2024-08-31T09:01:27.024256+0000 mgr.a (mgr.14388) 17736 : audit [DBG] from='client.381969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:28 smithi027 bash[22610]: audit 2024-08-31T09:01:27.024256+0000 mgr.a (mgr.14388) 17736 : audit [DBG] from='client.381969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:28 smithi191 bash[24992]: audit 2024-08-31T09:01:27.024256+0000 mgr.a (mgr.14388) 17736 : audit [DBG] from='client.381969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:29 smithi163 bash[24253]: cluster 2024-08-31T09:01:28.192838+0000 mgr.a (mgr.14388) 17737 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:29 smithi027 bash[22610]: cluster 2024-08-31T09:01:28.192838+0000 mgr.a (mgr.14388) 17737 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:29 smithi191 bash[24992]: cluster 2024-08-31T09:01:28.192838+0000 mgr.a (mgr.14388) 17737 : cluster [DBG] pgmap v12297: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:31 smithi163 bash[24253]: cluster 2024-08-31T09:01:30.193587+0000 mgr.a (mgr.14388) 17738 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:31 smithi027 bash[22610]: cluster 2024-08-31T09:01:30.193587+0000 mgr.a (mgr.14388) 17738 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:31 smithi191 bash[24992]: cluster 2024-08-31T09:01:30.193587+0000 mgr.a (mgr.14388) 17738 : cluster [DBG] pgmap v12298: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:32.463 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:01:32.464 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:01:32.465 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:01:33.235 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:01:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:01:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:01:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:01:33.235 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:01:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:33 smithi163 bash[24253]: cluster 2024-08-31T09:01:32.194330+0000 mgr.a (mgr.14388) 17739 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:33 smithi027 bash[22610]: cluster 2024-08-31T09:01:32.194330+0000 mgr.a (mgr.14388) 17739 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:33 smithi191 bash[24992]: cluster 2024-08-31T09:01:32.194330+0000 mgr.a (mgr.14388) 17739 : cluster [DBG] pgmap v12299: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:34 smithi163 bash[24253]: audit 2024-08-31T09:01:32.799667+0000 mgr.a (mgr.14388) 17740 : audit [DBG] from='client.382044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:34 smithi027 bash[22610]: audit 2024-08-31T09:01:32.799667+0000 mgr.a (mgr.14388) 17740 : audit [DBG] from='client.382044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:34 smithi191 bash[24992]: audit 2024-08-31T09:01:32.799667+0000 mgr.a (mgr.14388) 17740 : audit [DBG] from='client.382044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:35 smithi163 bash[24253]: cluster 2024-08-31T09:01:34.197103+0000 mgr.a (mgr.14388) 17741 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:35 smithi163 bash[24253]: audit 2024-08-31T09:01:34.995143+0000 mon.a (mon.0) 3219 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:01:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:35 smithi027 bash[22610]: cluster 2024-08-31T09:01:34.197103+0000 mgr.a (mgr.14388) 17741 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:35 smithi027 bash[22610]: audit 2024-08-31T09:01:34.995143+0000 mon.a (mon.0) 3219 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:01:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:35 smithi191 bash[24992]: cluster 2024-08-31T09:01:34.197103+0000 mgr.a (mgr.14388) 17741 : cluster [DBG] pgmap v12300: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:35 smithi191 bash[24992]: audit 2024-08-31T09:01:34.995143+0000 mon.a (mon.0) 3219 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:01:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:37 smithi163 bash[24253]: cluster 2024-08-31T09:01:36.197858+0000 mgr.a (mgr.14388) 17742 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:01:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:37 smithi027 bash[22610]: cluster 2024-08-31T09:01:36.197858+0000 mgr.a (mgr.14388) 17742 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:01:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:37 smithi191 bash[24992]: cluster 2024-08-31T09:01:36.197858+0000 mgr.a (mgr.14388) 17742 : cluster [DBG] pgmap v12301: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:01:38.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:01:38.237 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:01:38.237 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:01:39.009 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:01:39.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:01:39.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:01:39.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:01:39.009 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:01:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:39 smithi163 bash[24253]: cluster 2024-08-31T09:01:38.199862+0000 mgr.a (mgr.14388) 17743 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:39 smithi027 bash[22610]: cluster 2024-08-31T09:01:38.199862+0000 mgr.a (mgr.14388) 17743 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:39 smithi191 bash[24992]: cluster 2024-08-31T09:01:38.199862+0000 mgr.a (mgr.14388) 17743 : cluster [DBG] pgmap v12302: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:40 smithi163 bash[24253]: audit 2024-08-31T09:01:38.570141+0000 mgr.a (mgr.14388) 17744 : audit [DBG] from='client.382122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:40 smithi163 bash[24253]: audit 2024-08-31T09:01:40.353840+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:40 smithi163 bash[24253]: audit 2024-08-31T09:01:40.358196+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:40 smithi163 bash[24253]: audit 2024-08-31T09:01:40.366611+0000 mon.a (mon.0) 3222 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:40 smithi163 bash[24253]: audit 2024-08-31T09:01:40.370201+0000 mon.a (mon.0) 3223 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:40 smithi163 bash[24253]: audit 2024-08-31T09:01:40.374498+0000 mon.a (mon.0) 3224 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:40 smithi163 bash[24253]: audit 2024-08-31T09:01:40.378421+0000 mon.a (mon.0) 3225 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:40 smithi027 bash[22610]: audit 2024-08-31T09:01:38.570141+0000 mgr.a (mgr.14388) 17744 : audit [DBG] from='client.382122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:40 smithi027 bash[22610]: audit 2024-08-31T09:01:40.353840+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:40 smithi027 bash[22610]: audit 2024-08-31T09:01:40.358196+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:40 smithi027 bash[22610]: audit 2024-08-31T09:01:40.366611+0000 mon.a (mon.0) 3222 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:40 smithi027 bash[22610]: audit 2024-08-31T09:01:40.370201+0000 mon.a (mon.0) 3223 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:40 smithi027 bash[22610]: audit 2024-08-31T09:01:40.374498+0000 mon.a (mon.0) 3224 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:40 smithi027 bash[22610]: audit 2024-08-31T09:01:40.378421+0000 mon.a (mon.0) 3225 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:40 smithi191 bash[24992]: audit 2024-08-31T09:01:38.570141+0000 mgr.a (mgr.14388) 17744 : audit [DBG] from='client.382122 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:40 smithi191 bash[24992]: audit 2024-08-31T09:01:40.353840+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:40 smithi191 bash[24992]: audit 2024-08-31T09:01:40.358196+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:40 smithi191 bash[24992]: audit 2024-08-31T09:01:40.366611+0000 mon.a (mon.0) 3222 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:40 smithi191 bash[24992]: audit 2024-08-31T09:01:40.370201+0000 mon.a (mon.0) 3223 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:40 smithi191 bash[24992]: audit 2024-08-31T09:01:40.374498+0000 mon.a (mon.0) 3224 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:40 smithi191 bash[24992]: audit 2024-08-31T09:01:40.378421+0000 mon.a (mon.0) 3225 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:41 smithi163 bash[24253]: cluster 2024-08-31T09:01:40.200342+0000 mgr.a (mgr.14388) 17745 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:01:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:41 smithi163 bash[24253]: audit 2024-08-31T09:01:41.128013+0000 mon.a (mon.0) 3226 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:01:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:41 smithi163 bash[24253]: audit 2024-08-31T09:01:41.129783+0000 mon.a (mon.0) 3227 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:01:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:41 smithi163 bash[24253]: audit 2024-08-31T09:01:41.139955+0000 mon.a (mon.0) 3228 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:41.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:41 smithi163 bash[24253]: audit 2024-08-31T09:01:41.144637+0000 mon.a (mon.0) 3229 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:01:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:41 smithi027 bash[22610]: cluster 2024-08-31T09:01:40.200342+0000 mgr.a (mgr.14388) 17745 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:01:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:41 smithi027 bash[22610]: audit 2024-08-31T09:01:41.128013+0000 mon.a (mon.0) 3226 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:01:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:41 smithi027 bash[22610]: audit 2024-08-31T09:01:41.129783+0000 mon.a (mon.0) 3227 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:01:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:41 smithi027 bash[22610]: audit 2024-08-31T09:01:41.139955+0000 mon.a (mon.0) 3228 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:41 smithi027 bash[22610]: audit 2024-08-31T09:01:41.144637+0000 mon.a (mon.0) 3229 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:01:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:41 smithi191 bash[24992]: cluster 2024-08-31T09:01:40.200342+0000 mgr.a (mgr.14388) 17745 : cluster [DBG] pgmap v12303: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:01:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:41 smithi191 bash[24992]: audit 2024-08-31T09:01:41.128013+0000 mon.a (mon.0) 3226 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:01:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:41 smithi191 bash[24992]: audit 2024-08-31T09:01:41.129783+0000 mon.a (mon.0) 3227 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:01:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:41 smithi191 bash[24992]: audit 2024-08-31T09:01:41.139955+0000 mon.a (mon.0) 3228 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:01:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:41 smithi191 bash[24992]: audit 2024-08-31T09:01:41.144637+0000 mon.a (mon.0) 3229 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:01:42.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:01:41 smithi027 bash[22863]: debug 2024-08-31T09:01:41.888+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:01:42.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:01:41 smithi027 bash[22863]: debug 2024-08-31T09:01:41.888+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:01:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:42 smithi027 bash[22610]: audit 2024-08-31T09:01:41.145765+0000 mgr.a (mgr.14388) 17746 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:01:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:42 smithi191 bash[24992]: audit 2024-08-31T09:01:41.145765+0000 mgr.a (mgr.14388) 17746 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:01:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:42 smithi163 bash[24253]: audit 2024-08-31T09:01:41.145765+0000 mgr.a (mgr.14388) 17746 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:01:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:43 smithi027 bash[22610]: audit 2024-08-31T09:01:41.890960+0000 mgr.a (mgr.14388) 17747 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:01:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:43 smithi027 bash[22610]: cephadm 2024-08-31T09:01:41.892430+0000 mgr.a (mgr.14388) 17748 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:01:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:43 smithi027 bash[22610]: cluster 2024-08-31T09:01:42.201153+0000 mgr.a (mgr.14388) 17749 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:01:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:43 smithi191 bash[24992]: audit 2024-08-31T09:01:41.890960+0000 mgr.a (mgr.14388) 17747 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:01:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:43 smithi191 bash[24992]: cephadm 2024-08-31T09:01:41.892430+0000 mgr.a (mgr.14388) 17748 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:01:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:43 smithi191 bash[24992]: cluster 2024-08-31T09:01:42.201153+0000 mgr.a (mgr.14388) 17749 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:01:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:43 smithi163 bash[24253]: audit 2024-08-31T09:01:41.890960+0000 mgr.a (mgr.14388) 17747 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:01:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:43 smithi163 bash[24253]: cephadm 2024-08-31T09:01:41.892430+0000 mgr.a (mgr.14388) 17748 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:01:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:43 smithi163 bash[24253]: cluster 2024-08-31T09:01:42.201153+0000 mgr.a (mgr.14388) 17749 : cluster [DBG] pgmap v12304: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:01:44.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:01:44.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:01:44.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:01:44.784 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:01:44.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:01:44.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:01:44.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:01:44.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:01:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:45 smithi027 bash[22610]: cluster 2024-08-31T09:01:44.203307+0000 mgr.a (mgr.14388) 17750 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:45 smithi027 bash[22610]: audit 2024-08-31T09:01:44.348906+0000 mgr.a (mgr.14388) 17751 : audit [DBG] from='client.382308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:45 smithi191 bash[24992]: cluster 2024-08-31T09:01:44.203307+0000 mgr.a (mgr.14388) 17750 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:45 smithi191 bash[24992]: audit 2024-08-31T09:01:44.348906+0000 mgr.a (mgr.14388) 17751 : audit [DBG] from='client.382308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:45 smithi163 bash[24253]: cluster 2024-08-31T09:01:44.203307+0000 mgr.a (mgr.14388) 17750 : cluster [DBG] pgmap v12305: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:45 smithi163 bash[24253]: audit 2024-08-31T09:01:44.348906+0000 mgr.a (mgr.14388) 17751 : audit [DBG] from='client.382308 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:47 smithi027 bash[22610]: cluster 2024-08-31T09:01:46.204262+0000 mgr.a (mgr.14388) 17752 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:47 smithi191 bash[24992]: cluster 2024-08-31T09:01:46.204262+0000 mgr.a (mgr.14388) 17752 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:47 smithi163 bash[24253]: cluster 2024-08-31T09:01:46.204262+0000 mgr.a (mgr.14388) 17752 : cluster [DBG] pgmap v12306: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:49 smithi027 bash[22610]: cluster 2024-08-31T09:01:48.206389+0000 mgr.a (mgr.14388) 17753 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:49.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:01:49.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:01:49.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:01:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:49 smithi191 bash[24992]: cluster 2024-08-31T09:01:48.206389+0000 mgr.a (mgr.14388) 17753 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:49.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:49 smithi163 bash[24253]: cluster 2024-08-31T09:01:48.206389+0000 mgr.a (mgr.14388) 17753 : cluster [DBG] pgmap v12307: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:50.536 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:01:50.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:01:50.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:01:50.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:01:50.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:01:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:51 smithi027 bash[22610]: audit 2024-08-31T09:01:50.123901+0000 mgr.a (mgr.14388) 17754 : audit [DBG] from='client.382383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:51 smithi027 bash[22610]: cluster 2024-08-31T09:01:50.206874+0000 mgr.a (mgr.14388) 17755 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:51 smithi191 bash[24992]: audit 2024-08-31T09:01:50.123901+0000 mgr.a (mgr.14388) 17754 : audit [DBG] from='client.382383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:51 smithi191 bash[24992]: cluster 2024-08-31T09:01:50.206874+0000 mgr.a (mgr.14388) 17755 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:51 smithi163 bash[24253]: audit 2024-08-31T09:01:50.123901+0000 mgr.a (mgr.14388) 17754 : audit [DBG] from='client.382383 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:51 smithi163 bash[24253]: cluster 2024-08-31T09:01:50.206874+0000 mgr.a (mgr.14388) 17755 : cluster [DBG] pgmap v12308: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:53 smithi027 bash[22610]: cluster 2024-08-31T09:01:52.207802+0000 mgr.a (mgr.14388) 17756 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:53 smithi191 bash[24992]: cluster 2024-08-31T09:01:52.207802+0000 mgr.a (mgr.14388) 17756 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:53 smithi163 bash[24253]: cluster 2024-08-31T09:01:52.207802+0000 mgr.a (mgr.14388) 17756 : cluster [DBG] pgmap v12309: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:55.538 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:01:55.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:01:55.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:01:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:55 smithi027 bash[22610]: cluster 2024-08-31T09:01:54.210052+0000 mgr.a (mgr.14388) 17757 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:55 smithi191 bash[24992]: cluster 2024-08-31T09:01:54.210052+0000 mgr.a (mgr.14388) 17757 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:55 smithi163 bash[24253]: cluster 2024-08-31T09:01:54.210052+0000 mgr.a (mgr.14388) 17757 : cluster [DBG] pgmap v12310: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:01:56.296 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:01:56.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:01:56.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:01:56.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:01:56.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:01:56.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:56 smithi191 bash[24992]: audit 2024-08-31T09:01:55.873935+0000 mgr.a (mgr.14388) 17758 : audit [DBG] from='client.382455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:56.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:56 smithi191 bash[24992]: cluster 2024-08-31T09:01:56.210599+0000 mgr.a (mgr.14388) 17759 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:56 smithi163 bash[24253]: audit 2024-08-31T09:01:55.873935+0000 mgr.a (mgr.14388) 17758 : audit [DBG] from='client.382455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:56 smithi163 bash[24253]: cluster 2024-08-31T09:01:56.210599+0000 mgr.a (mgr.14388) 17759 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:56 smithi027 bash[22610]: audit 2024-08-31T09:01:55.873935+0000 mgr.a (mgr.14388) 17758 : audit [DBG] from='client.382455 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:01:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:56 smithi027 bash[22610]: cluster 2024-08-31T09:01:56.210599+0000 mgr.a (mgr.14388) 17759 : cluster [DBG] pgmap v12311: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:01:59.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:01:59 smithi191 bash[24992]: cluster 2024-08-31T09:01:58.212708+0000 mgr.a (mgr.14388) 17760 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:01:59 smithi163 bash[24253]: cluster 2024-08-31T09:01:58.212708+0000 mgr.a (mgr.14388) 17760 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:01:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:01:59 smithi027 bash[22610]: cluster 2024-08-31T09:01:58.212708+0000 mgr.a (mgr.14388) 17760 : cluster [DBG] pgmap v12312: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:02:01.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:01.298 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:01.298 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:01 smithi191 bash[24992]: cluster 2024-08-31T09:02:00.213464+0000 mgr.a (mgr.14388) 17761 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:01 smithi163 bash[24253]: cluster 2024-08-31T09:02:00.213464+0000 mgr.a (mgr.14388) 17761 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:01 smithi027 bash[22610]: cluster 2024-08-31T09:02:00.213464+0000 mgr.a (mgr.14388) 17761 : cluster [DBG] pgmap v12313: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:02.084 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:02.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:03 smithi191 bash[24992]: audit 2024-08-31T09:02:01.637526+0000 mgr.a (mgr.14388) 17762 : audit [DBG] from='client.382533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:03 smithi191 bash[24992]: cluster 2024-08-31T09:02:02.214079+0000 mgr.a (mgr.14388) 17763 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:03 smithi163 bash[24253]: audit 2024-08-31T09:02:01.637526+0000 mgr.a (mgr.14388) 17762 : audit [DBG] from='client.382533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:03 smithi163 bash[24253]: cluster 2024-08-31T09:02:02.214079+0000 mgr.a (mgr.14388) 17763 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:03 smithi027 bash[22610]: audit 2024-08-31T09:02:01.637526+0000 mgr.a (mgr.14388) 17762 : audit [DBG] from='client.382533 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:03 smithi027 bash[22610]: cluster 2024-08-31T09:02:02.214079+0000 mgr.a (mgr.14388) 17763 : cluster [DBG] pgmap v12314: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:05 smithi191 bash[24992]: cluster 2024-08-31T09:02:04.216330+0000 mgr.a (mgr.14388) 17764 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:02:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:05 smithi163 bash[24253]: cluster 2024-08-31T09:02:04.216330+0000 mgr.a (mgr.14388) 17764 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:02:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:05 smithi027 bash[22610]: cluster 2024-08-31T09:02:04.216330+0000 mgr.a (mgr.14388) 17764 : cluster [DBG] pgmap v12315: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:02:07.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:07.086 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:07.086 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:07 smithi163 bash[24253]: cluster 2024-08-31T09:02:06.217087+0000 mgr.a (mgr.14388) 17765 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:07.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:07 smithi027 bash[22610]: cluster 2024-08-31T09:02:06.217087+0000 mgr.a (mgr.14388) 17765 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:07 smithi191 bash[24992]: cluster 2024-08-31T09:02:06.217087+0000 mgr.a (mgr.14388) 17765 : cluster [DBG] pgmap v12316: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:07.857 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:07.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:07.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:07.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:07.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:08 smithi163 bash[24253]: audit 2024-08-31T09:02:07.420928+0000 mgr.a (mgr.14388) 17766 : audit [DBG] from='client.382605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:08 smithi027 bash[22610]: audit 2024-08-31T09:02:07.420928+0000 mgr.a (mgr.14388) 17766 : audit [DBG] from='client.382605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:08 smithi191 bash[24992]: audit 2024-08-31T09:02:07.420928+0000 mgr.a (mgr.14388) 17766 : audit [DBG] from='client.382605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:09 smithi163 bash[24253]: cluster 2024-08-31T09:02:08.219346+0000 mgr.a (mgr.14388) 17767 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:02:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:09 smithi027 bash[22610]: cluster 2024-08-31T09:02:08.219346+0000 mgr.a (mgr.14388) 17767 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:02:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:09 smithi191 bash[24992]: cluster 2024-08-31T09:02:08.219346+0000 mgr.a (mgr.14388) 17767 : cluster [DBG] pgmap v12317: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:02:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:11 smithi163 bash[24253]: cluster 2024-08-31T09:02:10.220186+0000 mgr.a (mgr.14388) 17768 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:11 smithi027 bash[22610]: cluster 2024-08-31T09:02:10.220186+0000 mgr.a (mgr.14388) 17768 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:11 smithi191 bash[24992]: cluster 2024-08-31T09:02:10.220186+0000 mgr.a (mgr.14388) 17768 : cluster [DBG] pgmap v12318: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:12.859 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:12.860 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:13.628 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:13.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:13.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:13.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:13.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:13 smithi163 bash[24253]: cluster 2024-08-31T09:02:12.220976+0000 mgr.a (mgr.14388) 17769 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:13 smithi027 bash[22610]: cluster 2024-08-31T09:02:12.220976+0000 mgr.a (mgr.14388) 17769 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:13 smithi191 bash[24992]: cluster 2024-08-31T09:02:12.220976+0000 mgr.a (mgr.14388) 17769 : cluster [DBG] pgmap v12319: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:14.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:14 smithi163 bash[24253]: audit 2024-08-31T09:02:13.202715+0000 mgr.a (mgr.14388) 17770 : audit [DBG] from='client.382683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:14 smithi027 bash[22610]: audit 2024-08-31T09:02:13.202715+0000 mgr.a (mgr.14388) 17770 : audit [DBG] from='client.382683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:14 smithi191 bash[24992]: audit 2024-08-31T09:02:13.202715+0000 mgr.a (mgr.14388) 17770 : audit [DBG] from='client.382683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:15 smithi163 bash[24253]: cluster 2024-08-31T09:02:14.223842+0000 mgr.a (mgr.14388) 17771 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:15 smithi027 bash[22610]: cluster 2024-08-31T09:02:14.223842+0000 mgr.a (mgr.14388) 17771 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:15 smithi191 bash[24992]: cluster 2024-08-31T09:02:14.223842+0000 mgr.a (mgr.14388) 17771 : cluster [DBG] pgmap v12320: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:17 smithi163 bash[24253]: cluster 2024-08-31T09:02:16.224633+0000 mgr.a (mgr.14388) 17772 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:02:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:17 smithi027 bash[22610]: cluster 2024-08-31T09:02:16.224633+0000 mgr.a (mgr.14388) 17772 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:02:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:17 smithi191 bash[24992]: cluster 2024-08-31T09:02:16.224633+0000 mgr.a (mgr.14388) 17772 : cluster [DBG] pgmap v12321: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:02:18.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:18.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:18.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:19.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:19.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:19.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:19.424 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:19.424 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:19.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:19 smithi163 bash[24253]: cluster 2024-08-31T09:02:18.226687+0000 mgr.a (mgr.14388) 17773 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:19 smithi027 bash[22610]: cluster 2024-08-31T09:02:18.226687+0000 mgr.a (mgr.14388) 17773 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:19 smithi191 bash[24992]: cluster 2024-08-31T09:02:18.226687+0000 mgr.a (mgr.14388) 17773 : cluster [DBG] pgmap v12322: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:20 smithi163 bash[24253]: audit 2024-08-31T09:02:18.972042+0000 mgr.a (mgr.14388) 17774 : audit [DBG] from='client.382761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:20 smithi027 bash[22610]: audit 2024-08-31T09:02:18.972042+0000 mgr.a (mgr.14388) 17774 : audit [DBG] from='client.382761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:20 smithi191 bash[24992]: audit 2024-08-31T09:02:18.972042+0000 mgr.a (mgr.14388) 17774 : audit [DBG] from='client.382761 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:21 smithi163 bash[24253]: cluster 2024-08-31T09:02:20.227670+0000 mgr.a (mgr.14388) 17775 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:02:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:21 smithi027 bash[22610]: cluster 2024-08-31T09:02:20.227670+0000 mgr.a (mgr.14388) 17775 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:02:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:21 smithi191 bash[24992]: cluster 2024-08-31T09:02:20.227670+0000 mgr.a (mgr.14388) 17775 : cluster [DBG] pgmap v12323: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:02:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:23 smithi163 bash[24253]: cluster 2024-08-31T09:02:22.228490+0000 mgr.a (mgr.14388) 17776 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:02:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:23 smithi027 bash[22610]: cluster 2024-08-31T09:02:22.228490+0000 mgr.a (mgr.14388) 17776 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:02:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:23 smithi191 bash[24992]: cluster 2024-08-31T09:02:22.228490+0000 mgr.a (mgr.14388) 17776 : cluster [DBG] pgmap v12324: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:02:24.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:24.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:24.426 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:25.175 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:25.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:25.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:25.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:25.176 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:25 smithi163 bash[24253]: cluster 2024-08-31T09:02:24.230712+0000 mgr.a (mgr.14388) 17777 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:25 smithi027 bash[22610]: cluster 2024-08-31T09:02:24.230712+0000 mgr.a (mgr.14388) 17777 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:25 smithi191 bash[24992]: cluster 2024-08-31T09:02:24.230712+0000 mgr.a (mgr.14388) 17777 : cluster [DBG] pgmap v12325: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:26 smithi163 bash[24253]: audit 2024-08-31T09:02:24.759034+0000 mgr.a (mgr.14388) 17778 : audit [DBG] from='client.382839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:26 smithi027 bash[22610]: audit 2024-08-31T09:02:24.759034+0000 mgr.a (mgr.14388) 17778 : audit [DBG] from='client.382839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:26 smithi191 bash[24992]: audit 2024-08-31T09:02:24.759034+0000 mgr.a (mgr.14388) 17778 : audit [DBG] from='client.382839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:27 smithi163 bash[24253]: cluster 2024-08-31T09:02:26.231664+0000 mgr.a (mgr.14388) 17779 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:27 smithi027 bash[22610]: cluster 2024-08-31T09:02:26.231664+0000 mgr.a (mgr.14388) 17779 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:27 smithi191 bash[24992]: cluster 2024-08-31T09:02:26.231664+0000 mgr.a (mgr.14388) 17779 : cluster [DBG] pgmap v12326: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:29 smithi163 bash[24253]: cluster 2024-08-31T09:02:28.233816+0000 mgr.a (mgr.14388) 17780 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:02:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:29 smithi027 bash[22610]: cluster 2024-08-31T09:02:28.233816+0000 mgr.a (mgr.14388) 17780 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:02:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:29 smithi191 bash[24992]: cluster 2024-08-31T09:02:28.233816+0000 mgr.a (mgr.14388) 17780 : cluster [DBG] pgmap v12327: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:02:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:30.177 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:30.938 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:30.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:30.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:30.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:30.939 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:31 smithi163 bash[24253]: cluster 2024-08-31T09:02:30.234571+0000 mgr.a (mgr.14388) 17781 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:02:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:31 smithi027 bash[22610]: cluster 2024-08-31T09:02:30.234571+0000 mgr.a (mgr.14388) 17781 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:02:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:31 smithi191 bash[24992]: cluster 2024-08-31T09:02:30.234571+0000 mgr.a (mgr.14388) 17781 : cluster [DBG] pgmap v12328: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:02:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:32 smithi163 bash[24253]: audit 2024-08-31T09:02:30.508211+0000 mgr.a (mgr.14388) 17782 : audit [DBG] from='client.382914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:32 smithi027 bash[22610]: audit 2024-08-31T09:02:30.508211+0000 mgr.a (mgr.14388) 17782 : audit [DBG] from='client.382914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:32 smithi191 bash[24992]: audit 2024-08-31T09:02:30.508211+0000 mgr.a (mgr.14388) 17782 : audit [DBG] from='client.382914 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:33 smithi163 bash[24253]: cluster 2024-08-31T09:02:32.235546+0000 mgr.a (mgr.14388) 17783 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:02:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:33 smithi027 bash[22610]: cluster 2024-08-31T09:02:32.235546+0000 mgr.a (mgr.14388) 17783 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:02:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:33 smithi191 bash[24992]: cluster 2024-08-31T09:02:32.235546+0000 mgr.a (mgr.14388) 17783 : cluster [DBG] pgmap v12329: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:02:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:35 smithi163 bash[24253]: cluster 2024-08-31T09:02:34.237800+0000 mgr.a (mgr.14388) 17784 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:02:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:35 smithi027 bash[22610]: cluster 2024-08-31T09:02:34.237800+0000 mgr.a (mgr.14388) 17784 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:02:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:35 smithi191 bash[24992]: cluster 2024-08-31T09:02:34.237800+0000 mgr.a (mgr.14388) 17784 : cluster [DBG] pgmap v12330: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:02:35.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:35.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:35.941 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:36.690 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:36.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:36.690 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:36.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:36.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:37 smithi163 bash[24253]: cluster 2024-08-31T09:02:36.238532+0000 mgr.a (mgr.14388) 17785 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:02:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:37 smithi163 bash[24253]: audit 2024-08-31T09:02:36.273582+0000 mgr.a (mgr.14388) 17786 : audit [DBG] from='client.382992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:37 smithi027 bash[22610]: cluster 2024-08-31T09:02:36.238532+0000 mgr.a (mgr.14388) 17785 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:02:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:37 smithi027 bash[22610]: audit 2024-08-31T09:02:36.273582+0000 mgr.a (mgr.14388) 17786 : audit [DBG] from='client.382992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:37 smithi191 bash[24992]: cluster 2024-08-31T09:02:36.238532+0000 mgr.a (mgr.14388) 17785 : cluster [DBG] pgmap v12331: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:02:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:37 smithi191 bash[24992]: audit 2024-08-31T09:02:36.273582+0000 mgr.a (mgr.14388) 17786 : audit [DBG] from='client.382992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:39 smithi163 bash[24253]: cluster 2024-08-31T09:02:38.240785+0000 mgr.a (mgr.14388) 17787 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:02:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:39 smithi027 bash[22610]: cluster 2024-08-31T09:02:38.240785+0000 mgr.a (mgr.14388) 17787 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:02:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:39 smithi191 bash[24992]: cluster 2024-08-31T09:02:38.240785+0000 mgr.a (mgr.14388) 17787 : cluster [DBG] pgmap v12332: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:02:41.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:41.692 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:41.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:41 smithi163 bash[24253]: cluster 2024-08-31T09:02:40.241587+0000 mgr.a (mgr.14388) 17788 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:41 smithi027 bash[22610]: cluster 2024-08-31T09:02:40.241587+0000 mgr.a (mgr.14388) 17788 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:41 smithi191 bash[24992]: cluster 2024-08-31T09:02:40.241587+0000 mgr.a (mgr.14388) 17788 : cluster [DBG] pgmap v12333: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:42.501 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:42.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:42.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:42.501 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:42.502 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:42 smithi163 bash[24253]: audit 2024-08-31T09:02:41.944457+0000 mon.a (mon.0) 3230 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:02:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:42 smithi027 bash[22610]: audit 2024-08-31T09:02:41.944457+0000 mon.a (mon.0) 3230 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:02:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:42 smithi191 bash[24992]: audit 2024-08-31T09:02:41.944457+0000 mon.a (mon.0) 3230 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:02:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:43 smithi163 bash[24253]: audit 2024-08-31T09:02:42.054197+0000 mgr.a (mgr.14388) 17789 : audit [DBG] from='client.383070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:43 smithi163 bash[24253]: cluster 2024-08-31T09:02:42.242205+0000 mgr.a (mgr.14388) 17790 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:43 smithi163 bash[24253]: audit 2024-08-31T09:02:42.747581+0000 mon.a (mon.0) 3231 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:02:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:43 smithi163 bash[24253]: audit 2024-08-31T09:02:42.749446+0000 mon.a (mon.0) 3232 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:02:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:43 smithi163 bash[24253]: audit 2024-08-31T09:02:42.759152+0000 mon.a (mon.0) 3233 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:02:43.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:43 smithi163 bash[24253]: audit 2024-08-31T09:02:42.763847+0000 mon.a (mon.0) 3234 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:02:43.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:02:43 smithi027 bash[22863]: debug 2024-08-31T09:02:43.491+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:02:43.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:02:43 smithi027 bash[22863]: debug 2024-08-31T09:02:43.491+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:02:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:43 smithi027 bash[22610]: audit 2024-08-31T09:02:42.054197+0000 mgr.a (mgr.14388) 17789 : audit [DBG] from='client.383070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:43 smithi027 bash[22610]: cluster 2024-08-31T09:02:42.242205+0000 mgr.a (mgr.14388) 17790 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:43 smithi027 bash[22610]: audit 2024-08-31T09:02:42.747581+0000 mon.a (mon.0) 3231 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:02:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:43 smithi027 bash[22610]: audit 2024-08-31T09:02:42.749446+0000 mon.a (mon.0) 3232 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:02:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:43 smithi027 bash[22610]: audit 2024-08-31T09:02:42.759152+0000 mon.a (mon.0) 3233 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:02:43.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:43 smithi027 bash[22610]: audit 2024-08-31T09:02:42.763847+0000 mon.a (mon.0) 3234 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:02:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:43 smithi191 bash[24992]: audit 2024-08-31T09:02:42.054197+0000 mgr.a (mgr.14388) 17789 : audit [DBG] from='client.383070 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:43 smithi191 bash[24992]: cluster 2024-08-31T09:02:42.242205+0000 mgr.a (mgr.14388) 17790 : cluster [DBG] pgmap v12334: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:02:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:43 smithi191 bash[24992]: audit 2024-08-31T09:02:42.747581+0000 mon.a (mon.0) 3231 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:02:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:43 smithi191 bash[24992]: audit 2024-08-31T09:02:42.749446+0000 mon.a (mon.0) 3232 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:02:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:43 smithi191 bash[24992]: audit 2024-08-31T09:02:42.759152+0000 mon.a (mon.0) 3233 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:02:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:43 smithi191 bash[24992]: audit 2024-08-31T09:02:42.763847+0000 mon.a (mon.0) 3234 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:02:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:44 smithi163 bash[24253]: audit 2024-08-31T09:02:42.766605+0000 mgr.a (mgr.14388) 17791 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:02:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:44 smithi027 bash[22610]: audit 2024-08-31T09:02:42.766605+0000 mgr.a (mgr.14388) 17791 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:02:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:44 smithi191 bash[24992]: audit 2024-08-31T09:02:42.766605+0000 mgr.a (mgr.14388) 17791 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:02:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:45 smithi163 bash[24253]: audit 2024-08-31T09:02:43.496940+0000 mgr.a (mgr.14388) 17792 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:02:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:45 smithi163 bash[24253]: cephadm 2024-08-31T09:02:43.498174+0000 mgr.a (mgr.14388) 17793 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:02:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:45 smithi163 bash[24253]: cluster 2024-08-31T09:02:44.245109+0000 mgr.a (mgr.14388) 17794 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T09:02:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:45 smithi027 bash[22610]: audit 2024-08-31T09:02:43.496940+0000 mgr.a (mgr.14388) 17792 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:02:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:45 smithi027 bash[22610]: cephadm 2024-08-31T09:02:43.498174+0000 mgr.a (mgr.14388) 17793 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:02:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:45 smithi027 bash[22610]: cluster 2024-08-31T09:02:44.245109+0000 mgr.a (mgr.14388) 17794 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T09:02:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:45 smithi191 bash[24992]: audit 2024-08-31T09:02:43.496940+0000 mgr.a (mgr.14388) 17792 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:02:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:45 smithi191 bash[24992]: cephadm 2024-08-31T09:02:43.498174+0000 mgr.a (mgr.14388) 17793 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:02:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:45 smithi191 bash[24992]: cluster 2024-08-31T09:02:44.245109+0000 mgr.a (mgr.14388) 17794 : cluster [DBG] pgmap v12335: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T09:02:47.503 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:47.503 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:47.504 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:47 smithi163 bash[24253]: cluster 2024-08-31T09:02:46.245905+0000 mgr.a (mgr.14388) 17795 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:02:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:47 smithi027 bash[22610]: cluster 2024-08-31T09:02:46.245905+0000 mgr.a (mgr.14388) 17795 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:02:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:47 smithi191 bash[24992]: cluster 2024-08-31T09:02:46.245905+0000 mgr.a (mgr.14388) 17795 : cluster [DBG] pgmap v12336: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:02:48.268 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:48.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:48.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:48.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:48.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:49 smithi163 bash[24253]: audit 2024-08-31T09:02:47.827309+0000 mgr.a (mgr.14388) 17796 : audit [DBG] from='client.383256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:49 smithi163 bash[24253]: cluster 2024-08-31T09:02:48.247629+0000 mgr.a (mgr.14388) 17797 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 9.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-31T09:02:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:49 smithi027 bash[22610]: audit 2024-08-31T09:02:47.827309+0000 mgr.a (mgr.14388) 17796 : audit [DBG] from='client.383256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:49 smithi027 bash[22610]: cluster 2024-08-31T09:02:48.247629+0000 mgr.a (mgr.14388) 17797 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 9.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-31T09:02:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:49 smithi191 bash[24992]: audit 2024-08-31T09:02:47.827309+0000 mgr.a (mgr.14388) 17796 : audit [DBG] from='client.383256 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:49 smithi191 bash[24992]: cluster 2024-08-31T09:02:48.247629+0000 mgr.a (mgr.14388) 17797 : cluster [DBG] pgmap v12337: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 9.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-08-31T09:02:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:51 smithi163 bash[24253]: cluster 2024-08-31T09:02:50.248560+0000 mgr.a (mgr.14388) 17798 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 8.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-31T09:02:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:51 smithi027 bash[22610]: cluster 2024-08-31T09:02:50.248560+0000 mgr.a (mgr.14388) 17798 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 8.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-31T09:02:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:51 smithi191 bash[24992]: cluster 2024-08-31T09:02:50.248560+0000 mgr.a (mgr.14388) 17798 : cluster [DBG] pgmap v12338: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 8.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-31T09:02:53.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:53.271 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:53.271 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:53 smithi163 bash[24253]: cluster 2024-08-31T09:02:52.249526+0000 mgr.a (mgr.14388) 17799 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 8.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-31T09:02:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:53 smithi027 bash[22610]: cluster 2024-08-31T09:02:52.249526+0000 mgr.a (mgr.14388) 17799 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 8.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-31T09:02:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:53 smithi191 bash[24992]: cluster 2024-08-31T09:02:52.249526+0000 mgr.a (mgr.14388) 17799 : cluster [DBG] pgmap v12339: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 8.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-08-31T09:02:54.023 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:54.024 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:55 smithi163 bash[24253]: audit 2024-08-31T09:02:53.607054+0000 mgr.a (mgr.14388) 17800 : audit [DBG] from='client.383334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:55.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:55 smithi163 bash[24253]: cluster 2024-08-31T09:02:54.252392+0000 mgr.a (mgr.14388) 17801 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T09:02:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:55 smithi027 bash[22610]: audit 2024-08-31T09:02:53.607054+0000 mgr.a (mgr.14388) 17800 : audit [DBG] from='client.383334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:55 smithi027 bash[22610]: cluster 2024-08-31T09:02:54.252392+0000 mgr.a (mgr.14388) 17801 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T09:02:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:55 smithi191 bash[24992]: audit 2024-08-31T09:02:53.607054+0000 mgr.a (mgr.14388) 17800 : audit [DBG] from='client.383334 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:02:55.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:55 smithi191 bash[24992]: cluster 2024-08-31T09:02:54.252392+0000 mgr.a (mgr.14388) 17801 : cluster [DBG] pgmap v12340: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T09:02:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:57 smithi027 bash[22610]: cluster 2024-08-31T09:02:56.253217+0000 mgr.a (mgr.14388) 17802 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:02:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:57 smithi191 bash[24992]: cluster 2024-08-31T09:02:56.253217+0000 mgr.a (mgr.14388) 17802 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:02:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:57 smithi163 bash[24253]: cluster 2024-08-31T09:02:56.253217+0000 mgr.a (mgr.14388) 17802 : cluster [DBG] pgmap v12341: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:02:59.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:02:59.026 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:02:59.026 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:02:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:02:59 smithi027 bash[22610]: cluster 2024-08-31T09:02:58.255122+0000 mgr.a (mgr.14388) 17803 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T09:02:59.768 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:02:59.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:02:59.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:02:59.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:02:59.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:02:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:02:59 smithi191 bash[24992]: cluster 2024-08-31T09:02:58.255122+0000 mgr.a (mgr.14388) 17803 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T09:02:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:02:59 smithi163 bash[24253]: cluster 2024-08-31T09:02:58.255122+0000 mgr.a (mgr.14388) 17803 : cluster [DBG] pgmap v12342: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 60 op/s 2024-08-31T09:03:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:00 smithi027 bash[22610]: audit 2024-08-31T09:02:59.353521+0000 mgr.a (mgr.14388) 17804 : audit [DBG] from='client.383409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:00 smithi191 bash[24992]: audit 2024-08-31T09:02:59.353521+0000 mgr.a (mgr.14388) 17804 : audit [DBG] from='client.383409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:00 smithi163 bash[24253]: audit 2024-08-31T09:02:59.353521+0000 mgr.a (mgr.14388) 17804 : audit [DBG] from='client.383409 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:01 smithi027 bash[22610]: cluster 2024-08-31T09:03:00.256109+0000 mgr.a (mgr.14388) 17805 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T09:03:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:01 smithi191 bash[24992]: cluster 2024-08-31T09:03:00.256109+0000 mgr.a (mgr.14388) 17805 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T09:03:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:01 smithi163 bash[24253]: cluster 2024-08-31T09:03:00.256109+0000 mgr.a (mgr.14388) 17805 : cluster [DBG] pgmap v12343: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T09:03:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:03 smithi027 bash[22610]: cluster 2024-08-31T09:03:02.256901+0000 mgr.a (mgr.14388) 17806 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T09:03:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:03 smithi191 bash[24992]: cluster 2024-08-31T09:03:02.256901+0000 mgr.a (mgr.14388) 17806 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T09:03:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:03 smithi163 bash[24253]: cluster 2024-08-31T09:03:02.256901+0000 mgr.a (mgr.14388) 17806 : cluster [DBG] pgmap v12344: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 31 KiB/s rd, 0 B/s wr, 50 op/s 2024-08-31T09:03:04.769 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:03:04.770 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:03:04.770 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:03:05.533 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:03:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:03:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:03:05.533 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:03:05.534 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:03:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:05 smithi027 bash[22610]: cluster 2024-08-31T09:03:04.259129+0000 mgr.a (mgr.14388) 17807 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 51 op/s 2024-08-31T09:03:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:05 smithi191 bash[24992]: cluster 2024-08-31T09:03:04.259129+0000 mgr.a (mgr.14388) 17807 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 51 op/s 2024-08-31T09:03:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:05 smithi163 bash[24253]: cluster 2024-08-31T09:03:04.259129+0000 mgr.a (mgr.14388) 17807 : cluster [DBG] pgmap v12345: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 32 KiB/s rd, 0 B/s wr, 51 op/s 2024-08-31T09:03:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:06 smithi027 bash[22610]: audit 2024-08-31T09:03:05.103466+0000 mgr.a (mgr.14388) 17808 : audit [DBG] from='client.383487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:06 smithi191 bash[24992]: audit 2024-08-31T09:03:05.103466+0000 mgr.a (mgr.14388) 17808 : audit [DBG] from='client.383487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:06 smithi163 bash[24253]: audit 2024-08-31T09:03:05.103466+0000 mgr.a (mgr.14388) 17808 : audit [DBG] from='client.383487 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:07 smithi191 bash[24992]: cluster 2024-08-31T09:03:06.260083+0000 mgr.a (mgr.14388) 17809 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:07 smithi163 bash[24253]: cluster 2024-08-31T09:03:06.260083+0000 mgr.a (mgr.14388) 17809 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:07 smithi027 bash[22610]: cluster 2024-08-31T09:03:06.260083+0000 mgr.a (mgr.14388) 17809 : cluster [DBG] pgmap v12346: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:09 smithi191 bash[24992]: cluster 2024-08-31T09:03:08.262353+0000 mgr.a (mgr.14388) 17810 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:09 smithi163 bash[24253]: cluster 2024-08-31T09:03:08.262353+0000 mgr.a (mgr.14388) 17810 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:09 smithi027 bash[22610]: cluster 2024-08-31T09:03:08.262353+0000 mgr.a (mgr.14388) 17810 : cluster [DBG] pgmap v12347: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:10.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:03:10.536 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:03:10.536 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:03:11.306 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:03:11.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:03:11.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:03:11.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:03:11.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:03:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:11 smithi191 bash[24992]: cluster 2024-08-31T09:03:10.263168+0000 mgr.a (mgr.14388) 17811 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:11 smithi163 bash[24253]: cluster 2024-08-31T09:03:10.263168+0000 mgr.a (mgr.14388) 17811 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:11 smithi027 bash[22610]: cluster 2024-08-31T09:03:10.263168+0000 mgr.a (mgr.14388) 17811 : cluster [DBG] pgmap v12348: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:12 smithi191 bash[24992]: audit 2024-08-31T09:03:10.870643+0000 mgr.a (mgr.14388) 17812 : audit [DBG] from='client.383565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:12 smithi163 bash[24253]: audit 2024-08-31T09:03:10.870643+0000 mgr.a (mgr.14388) 17812 : audit [DBG] from='client.383565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:12 smithi027 bash[22610]: audit 2024-08-31T09:03:10.870643+0000 mgr.a (mgr.14388) 17812 : audit [DBG] from='client.383565 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:13 smithi191 bash[24992]: cluster 2024-08-31T09:03:12.264127+0000 mgr.a (mgr.14388) 17813 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:13 smithi163 bash[24253]: cluster 2024-08-31T09:03:12.264127+0000 mgr.a (mgr.14388) 17813 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:13 smithi027 bash[22610]: cluster 2024-08-31T09:03:12.264127+0000 mgr.a (mgr.14388) 17813 : cluster [DBG] pgmap v12349: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:14 smithi191 bash[24992]: cluster 2024-08-31T09:03:14.266346+0000 mgr.a (mgr.14388) 17814 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:14 smithi163 bash[24253]: cluster 2024-08-31T09:03:14.266346+0000 mgr.a (mgr.14388) 17814 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:14 smithi027 bash[22610]: cluster 2024-08-31T09:03:14.266346+0000 mgr.a (mgr.14388) 17814 : cluster [DBG] pgmap v12350: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:16.308 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:03:16.309 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:03:16.309 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:03:17.097 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:03:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:03:17.097 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:03:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:03:17.098 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:03:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:17 smithi163 bash[24253]: cluster 2024-08-31T09:03:16.267119+0000 mgr.a (mgr.14388) 17815 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:17 smithi027 bash[22610]: cluster 2024-08-31T09:03:16.267119+0000 mgr.a (mgr.14388) 17815 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:17 smithi191 bash[24992]: cluster 2024-08-31T09:03:16.267119+0000 mgr.a (mgr.14388) 17815 : cluster [DBG] pgmap v12351: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:18 smithi163 bash[24253]: audit 2024-08-31T09:03:16.648096+0000 mgr.a (mgr.14388) 17816 : audit [DBG] from='client.383640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:18 smithi027 bash[22610]: audit 2024-08-31T09:03:16.648096+0000 mgr.a (mgr.14388) 17816 : audit [DBG] from='client.383640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:18 smithi191 bash[24992]: audit 2024-08-31T09:03:16.648096+0000 mgr.a (mgr.14388) 17816 : audit [DBG] from='client.383640 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:19.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:19 smithi163 bash[24253]: cluster 2024-08-31T09:03:18.269366+0000 mgr.a (mgr.14388) 17817 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:19 smithi027 bash[22610]: cluster 2024-08-31T09:03:18.269366+0000 mgr.a (mgr.14388) 17817 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:19 smithi191 bash[24992]: cluster 2024-08-31T09:03:18.269366+0000 mgr.a (mgr.14388) 17817 : cluster [DBG] pgmap v12352: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:21 smithi163 bash[24253]: cluster 2024-08-31T09:03:20.270139+0000 mgr.a (mgr.14388) 17818 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:21 smithi027 bash[22610]: cluster 2024-08-31T09:03:20.270139+0000 mgr.a (mgr.14388) 17818 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:21 smithi191 bash[24992]: cluster 2024-08-31T09:03:20.270139+0000 mgr.a (mgr.14388) 17818 : cluster [DBG] pgmap v12353: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:22.099 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:03:22.099 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:03:22.100 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:03:22.853 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:03:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:03:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:03:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:03:22.854 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:03:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:23 smithi163 bash[24253]: cluster 2024-08-31T09:03:22.270681+0000 mgr.a (mgr.14388) 17819 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:23 smithi163 bash[24253]: audit 2024-08-31T09:03:22.431966+0000 mgr.a (mgr.14388) 17820 : audit [DBG] from='client.383718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:23 smithi027 bash[22610]: cluster 2024-08-31T09:03:22.270681+0000 mgr.a (mgr.14388) 17819 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:23 smithi027 bash[22610]: audit 2024-08-31T09:03:22.431966+0000 mgr.a (mgr.14388) 17820 : audit [DBG] from='client.383718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:23 smithi191 bash[24992]: cluster 2024-08-31T09:03:22.270681+0000 mgr.a (mgr.14388) 17819 : cluster [DBG] pgmap v12354: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:23 smithi191 bash[24992]: audit 2024-08-31T09:03:22.431966+0000 mgr.a (mgr.14388) 17820 : audit [DBG] from='client.383718 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:25.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:25 smithi163 bash[24253]: cluster 2024-08-31T09:03:24.273027+0000 mgr.a (mgr.14388) 17821 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:25 smithi027 bash[22610]: cluster 2024-08-31T09:03:24.273027+0000 mgr.a (mgr.14388) 17821 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:25 smithi191 bash[24992]: cluster 2024-08-31T09:03:24.273027+0000 mgr.a (mgr.14388) 17821 : cluster [DBG] pgmap v12355: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:27 smithi163 bash[24253]: cluster 2024-08-31T09:03:26.273813+0000 mgr.a (mgr.14388) 17822 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:27 smithi027 bash[22610]: cluster 2024-08-31T09:03:26.273813+0000 mgr.a (mgr.14388) 17822 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:27 smithi191 bash[24992]: cluster 2024-08-31T09:03:26.273813+0000 mgr.a (mgr.14388) 17822 : cluster [DBG] pgmap v12356: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:27.855 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:03:27.855 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:03:27.856 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:03:28.634 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:03:28.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:03:28.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:03:28.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:03:28.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:03:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:29 smithi163 bash[24253]: audit 2024-08-31T09:03:28.191259+0000 mgr.a (mgr.14388) 17823 : audit [DBG] from='client.383796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:29 smithi163 bash[24253]: cluster 2024-08-31T09:03:28.275244+0000 mgr.a (mgr.14388) 17824 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:29 smithi027 bash[22610]: audit 2024-08-31T09:03:28.191259+0000 mgr.a (mgr.14388) 17823 : audit [DBG] from='client.383796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:29 smithi027 bash[22610]: cluster 2024-08-31T09:03:28.275244+0000 mgr.a (mgr.14388) 17824 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:29 smithi191 bash[24992]: audit 2024-08-31T09:03:28.191259+0000 mgr.a (mgr.14388) 17823 : audit [DBG] from='client.383796 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:29 smithi191 bash[24992]: cluster 2024-08-31T09:03:28.275244+0000 mgr.a (mgr.14388) 17824 : cluster [DBG] pgmap v12357: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:31 smithi163 bash[24253]: cluster 2024-08-31T09:03:30.276116+0000 mgr.a (mgr.14388) 17825 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:03:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:31 smithi027 bash[22610]: cluster 2024-08-31T09:03:30.276116+0000 mgr.a (mgr.14388) 17825 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:03:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:31 smithi191 bash[24992]: cluster 2024-08-31T09:03:30.276116+0000 mgr.a (mgr.14388) 17825 : cluster [DBG] pgmap v12358: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:03:33.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:03:33.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:03:33.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:03:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:33 smithi163 bash[24253]: cluster 2024-08-31T09:03:32.277067+0000 mgr.a (mgr.14388) 17826 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:03:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:33 smithi027 bash[22610]: cluster 2024-08-31T09:03:32.277067+0000 mgr.a (mgr.14388) 17826 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:03:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:33 smithi191 bash[24992]: cluster 2024-08-31T09:03:32.277067+0000 mgr.a (mgr.14388) 17826 : cluster [DBG] pgmap v12359: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:03:34.391 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:03:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:03:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:03:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:03:34.392 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:03:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:35 smithi163 bash[24253]: audit 2024-08-31T09:03:33.967903+0000 mgr.a (mgr.14388) 17827 : audit [DBG] from='client.383874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:35 smithi163 bash[24253]: cluster 2024-08-31T09:03:34.278479+0000 mgr.a (mgr.14388) 17828 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:35 smithi027 bash[22610]: audit 2024-08-31T09:03:33.967903+0000 mgr.a (mgr.14388) 17827 : audit [DBG] from='client.383874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:35 smithi027 bash[22610]: cluster 2024-08-31T09:03:34.278479+0000 mgr.a (mgr.14388) 17828 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:35 smithi191 bash[24992]: audit 2024-08-31T09:03:33.967903+0000 mgr.a (mgr.14388) 17827 : audit [DBG] from='client.383874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:35 smithi191 bash[24992]: cluster 2024-08-31T09:03:34.278479+0000 mgr.a (mgr.14388) 17828 : cluster [DBG] pgmap v12360: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:37 smithi163 bash[24253]: cluster 2024-08-31T09:03:36.279357+0000 mgr.a (mgr.14388) 17829 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:03:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:37 smithi027 bash[22610]: cluster 2024-08-31T09:03:36.279357+0000 mgr.a (mgr.14388) 17829 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:03:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:37 smithi191 bash[24992]: cluster 2024-08-31T09:03:36.279357+0000 mgr.a (mgr.14388) 17829 : cluster [DBG] pgmap v12361: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:03:39.393 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:03:39.393 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:03:39.394 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:03:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:39 smithi163 bash[24253]: cluster 2024-08-31T09:03:38.281468+0000 mgr.a (mgr.14388) 17830 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:39 smithi027 bash[22610]: cluster 2024-08-31T09:03:38.281468+0000 mgr.a (mgr.14388) 17830 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:39 smithi191 bash[24992]: cluster 2024-08-31T09:03:38.281468+0000 mgr.a (mgr.14388) 17830 : cluster [DBG] pgmap v12362: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:40.140 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:03:40.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:03:40.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:03:40.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:03:40.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:03:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:41 smithi163 bash[24253]: audit 2024-08-31T09:03:39.723802+0000 mgr.a (mgr.14388) 17831 : audit [DBG] from='client.383952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:41 smithi163 bash[24253]: cluster 2024-08-31T09:03:40.282457+0000 mgr.a (mgr.14388) 17832 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:41 smithi027 bash[22610]: audit 2024-08-31T09:03:39.723802+0000 mgr.a (mgr.14388) 17831 : audit [DBG] from='client.383952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:41 smithi027 bash[22610]: cluster 2024-08-31T09:03:40.282457+0000 mgr.a (mgr.14388) 17832 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:41 smithi191 bash[24992]: audit 2024-08-31T09:03:39.723802+0000 mgr.a (mgr.14388) 17831 : audit [DBG] from='client.383952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:41 smithi191 bash[24992]: cluster 2024-08-31T09:03:40.282457+0000 mgr.a (mgr.14388) 17832 : cluster [DBG] pgmap v12363: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:43 smithi163 bash[24253]: cluster 2024-08-31T09:03:42.283272+0000 mgr.a (mgr.14388) 17833 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:43 smithi027 bash[22610]: cluster 2024-08-31T09:03:42.283272+0000 mgr.a (mgr.14388) 17833 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:43 smithi191 bash[24992]: cluster 2024-08-31T09:03:42.283272+0000 mgr.a (mgr.14388) 17833 : cluster [DBG] pgmap v12364: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:44 smithi163 bash[24253]: audit 2024-08-31T09:03:43.556223+0000 mon.a (mon.0) 3235 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:03:44.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:44 smithi027 bash[22610]: audit 2024-08-31T09:03:43.556223+0000 mon.a (mon.0) 3235 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:03:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:44 smithi191 bash[24992]: audit 2024-08-31T09:03:43.556223+0000 mon.a (mon.0) 3235 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:03:45.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:03:45.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:03:45.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:03:45.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:03:45 smithi027 bash[22863]: debug 2024-08-31T09:03:45.157+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:03:45.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:03:45 smithi027 bash[22863]: debug 2024-08-31T09:03:45.157+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:03:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:45 smithi027 bash[22610]: cluster 2024-08-31T09:03:44.284255+0000 mgr.a (mgr.14388) 17834 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:45 smithi027 bash[22610]: audit 2024-08-31T09:03:44.402957+0000 mon.a (mon.0) 3236 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:03:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:45 smithi027 bash[22610]: audit 2024-08-31T09:03:44.404565+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:03:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:45 smithi027 bash[22610]: audit 2024-08-31T09:03:44.411473+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:03:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:45 smithi027 bash[22610]: audit 2024-08-31T09:03:44.414322+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:03:45.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:45 smithi027 bash[22610]: audit 2024-08-31T09:03:44.416629+0000 mgr.a (mgr.14388) 17835 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:03:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:45 smithi163 bash[24253]: cluster 2024-08-31T09:03:44.284255+0000 mgr.a (mgr.14388) 17834 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:45 smithi163 bash[24253]: audit 2024-08-31T09:03:44.402957+0000 mon.a (mon.0) 3236 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:03:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:45 smithi163 bash[24253]: audit 2024-08-31T09:03:44.404565+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:03:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:45 smithi163 bash[24253]: audit 2024-08-31T09:03:44.411473+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:03:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:45 smithi163 bash[24253]: audit 2024-08-31T09:03:44.414322+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:03:45.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:45 smithi163 bash[24253]: audit 2024-08-31T09:03:44.416629+0000 mgr.a (mgr.14388) 17835 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:03:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:45 smithi191 bash[24992]: cluster 2024-08-31T09:03:44.284255+0000 mgr.a (mgr.14388) 17834 : cluster [DBG] pgmap v12365: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:03:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:45 smithi191 bash[24992]: audit 2024-08-31T09:03:44.402957+0000 mon.a (mon.0) 3236 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:03:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:45 smithi191 bash[24992]: audit 2024-08-31T09:03:44.404565+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:03:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:45 smithi191 bash[24992]: audit 2024-08-31T09:03:44.411473+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:03:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:45 smithi191 bash[24992]: audit 2024-08-31T09:03:44.414322+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:03:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:45 smithi191 bash[24992]: audit 2024-08-31T09:03:44.416629+0000 mgr.a (mgr.14388) 17835 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:03:45.867 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:03:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:03:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:03:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:03:45.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:03:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:46 smithi163 bash[24253]: audit 2024-08-31T09:03:45.160187+0000 mgr.a (mgr.14388) 17836 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:03:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:46 smithi163 bash[24253]: cephadm 2024-08-31T09:03:45.161597+0000 mgr.a (mgr.14388) 17837 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:03:46.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:46 smithi163 bash[24253]: audit 2024-08-31T09:03:45.461868+0000 mgr.a (mgr.14388) 17838 : audit [DBG] from='client.384126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:46 smithi027 bash[22610]: audit 2024-08-31T09:03:45.160187+0000 mgr.a (mgr.14388) 17836 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:03:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:46 smithi027 bash[22610]: cephadm 2024-08-31T09:03:45.161597+0000 mgr.a (mgr.14388) 17837 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:03:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:46 smithi027 bash[22610]: audit 2024-08-31T09:03:45.461868+0000 mgr.a (mgr.14388) 17838 : audit [DBG] from='client.384126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:46 smithi191 bash[24992]: audit 2024-08-31T09:03:45.160187+0000 mgr.a (mgr.14388) 17836 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:03:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:46 smithi191 bash[24992]: cephadm 2024-08-31T09:03:45.161597+0000 mgr.a (mgr.14388) 17837 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:03:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:46 smithi191 bash[24992]: audit 2024-08-31T09:03:45.461868+0000 mgr.a (mgr.14388) 17838 : audit [DBG] from='client.384126 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:47 smithi163 bash[24253]: cluster 2024-08-31T09:03:46.285348+0000 mgr.a (mgr.14388) 17839 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:47 smithi027 bash[22610]: cluster 2024-08-31T09:03:46.285348+0000 mgr.a (mgr.14388) 17839 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:47 smithi191 bash[24992]: cluster 2024-08-31T09:03:46.285348+0000 mgr.a (mgr.14388) 17839 : cluster [DBG] pgmap v12366: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:03:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:49 smithi163 bash[24253]: cluster 2024-08-31T09:03:48.287686+0000 mgr.a (mgr.14388) 17840 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:49 smithi027 bash[22610]: cluster 2024-08-31T09:03:48.287686+0000 mgr.a (mgr.14388) 17840 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:49 smithi191 bash[24992]: cluster 2024-08-31T09:03:48.287686+0000 mgr.a (mgr.14388) 17840 : cluster [DBG] pgmap v12367: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:50.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:03:50.869 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:03:50.870 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:03:51.615 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:03:51.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:03:51.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:03:51.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:03:51.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:03:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:51 smithi163 bash[24253]: cluster 2024-08-31T09:03:50.288651+0000 mgr.a (mgr.14388) 17841 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:51 smithi027 bash[22610]: cluster 2024-08-31T09:03:50.288651+0000 mgr.a (mgr.14388) 17841 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:51 smithi191 bash[24992]: cluster 2024-08-31T09:03:50.288651+0000 mgr.a (mgr.14388) 17841 : cluster [DBG] pgmap v12368: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:52 smithi163 bash[24253]: audit 2024-08-31T09:03:51.196110+0000 mgr.a (mgr.14388) 17842 : audit [DBG] from='client.384204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:52 smithi027 bash[22610]: audit 2024-08-31T09:03:51.196110+0000 mgr.a (mgr.14388) 17842 : audit [DBG] from='client.384204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:52 smithi191 bash[24992]: audit 2024-08-31T09:03:51.196110+0000 mgr.a (mgr.14388) 17842 : audit [DBG] from='client.384204 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:53 smithi163 bash[24253]: cluster 2024-08-31T09:03:52.289667+0000 mgr.a (mgr.14388) 17843 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:53 smithi027 bash[22610]: cluster 2024-08-31T09:03:52.289667+0000 mgr.a (mgr.14388) 17843 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:53 smithi191 bash[24992]: cluster 2024-08-31T09:03:52.289667+0000 mgr.a (mgr.14388) 17843 : cluster [DBG] pgmap v12369: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:55 smithi163 bash[24253]: cluster 2024-08-31T09:03:54.291956+0000 mgr.a (mgr.14388) 17844 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:55 smithi027 bash[22610]: cluster 2024-08-31T09:03:54.291956+0000 mgr.a (mgr.14388) 17844 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:55 smithi191 bash[24992]: cluster 2024-08-31T09:03:54.291956+0000 mgr.a (mgr.14388) 17844 : cluster [DBG] pgmap v12370: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:56.617 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:03:56.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:03:56.618 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:03:57.367 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:03:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:03:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:03:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:03:57.368 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:03:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:57 smithi163 bash[24253]: cluster 2024-08-31T09:03:56.292708+0000 mgr.a (mgr.14388) 17845 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:57 smithi027 bash[22610]: cluster 2024-08-31T09:03:56.292708+0000 mgr.a (mgr.14388) 17845 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:57 smithi191 bash[24992]: cluster 2024-08-31T09:03:56.292708+0000 mgr.a (mgr.14388) 17845 : cluster [DBG] pgmap v12371: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:58 smithi163 bash[24253]: audit 2024-08-31T09:03:56.948915+0000 mgr.a (mgr.14388) 17846 : audit [DBG] from='client.384279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:58 smithi027 bash[22610]: audit 2024-08-31T09:03:56.948915+0000 mgr.a (mgr.14388) 17846 : audit [DBG] from='client.384279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:58 smithi191 bash[24992]: audit 2024-08-31T09:03:56.948915+0000 mgr.a (mgr.14388) 17846 : audit [DBG] from='client.384279 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:03:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:03:59 smithi163 bash[24253]: cluster 2024-08-31T09:03:58.295074+0000 mgr.a (mgr.14388) 17847 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:03:59 smithi027 bash[22610]: cluster 2024-08-31T09:03:58.295074+0000 mgr.a (mgr.14388) 17847 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:03:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:03:59 smithi191 bash[24992]: cluster 2024-08-31T09:03:58.295074+0000 mgr.a (mgr.14388) 17847 : cluster [DBG] pgmap v12372: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:01 smithi027 bash[22610]: cluster 2024-08-31T09:04:00.296051+0000 mgr.a (mgr.14388) 17848 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:01 smithi191 bash[24992]: cluster 2024-08-31T09:04:00.296051+0000 mgr.a (mgr.14388) 17848 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:01 smithi163 bash[24253]: cluster 2024-08-31T09:04:00.296051+0000 mgr.a (mgr.14388) 17848 : cluster [DBG] pgmap v12373: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:02.369 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:04:02.370 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:04:02.370 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:04:03.139 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:04:03.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:04:03.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:04:03.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:04:03.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:04:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:03 smithi027 bash[22610]: cluster 2024-08-31T09:04:02.297005+0000 mgr.a (mgr.14388) 17849 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:03 smithi191 bash[24992]: cluster 2024-08-31T09:04:02.297005+0000 mgr.a (mgr.14388) 17849 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:03 smithi163 bash[24253]: cluster 2024-08-31T09:04:02.297005+0000 mgr.a (mgr.14388) 17849 : cluster [DBG] pgmap v12374: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:04 smithi027 bash[22610]: audit 2024-08-31T09:04:02.707100+0000 mgr.a (mgr.14388) 17850 : audit [DBG] from='client.384357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:04 smithi191 bash[24992]: audit 2024-08-31T09:04:02.707100+0000 mgr.a (mgr.14388) 17850 : audit [DBG] from='client.384357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:04 smithi163 bash[24253]: audit 2024-08-31T09:04:02.707100+0000 mgr.a (mgr.14388) 17850 : audit [DBG] from='client.384357 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:05 smithi027 bash[22610]: cluster 2024-08-31T09:04:04.299914+0000 mgr.a (mgr.14388) 17851 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:05 smithi191 bash[24992]: cluster 2024-08-31T09:04:04.299914+0000 mgr.a (mgr.14388) 17851 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:05 smithi163 bash[24253]: cluster 2024-08-31T09:04:04.299914+0000 mgr.a (mgr.14388) 17851 : cluster [DBG] pgmap v12375: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:07 smithi027 bash[22610]: cluster 2024-08-31T09:04:06.300858+0000 mgr.a (mgr.14388) 17852 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:04:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:07 smithi191 bash[24992]: cluster 2024-08-31T09:04:06.300858+0000 mgr.a (mgr.14388) 17852 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:04:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:07 smithi163 bash[24253]: cluster 2024-08-31T09:04:06.300858+0000 mgr.a (mgr.14388) 17852 : cluster [DBG] pgmap v12376: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:04:08.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:04:08.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:04:08.141 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:04:08.893 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:04:08.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:04:08.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:04:08.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:04:08.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:04:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:09 smithi027 bash[22610]: cluster 2024-08-31T09:04:08.302360+0000 mgr.a (mgr.14388) 17853 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:09 smithi027 bash[22610]: audit 2024-08-31T09:04:08.474206+0000 mgr.a (mgr.14388) 17854 : audit [DBG] from='client.384432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:09 smithi191 bash[24992]: cluster 2024-08-31T09:04:08.302360+0000 mgr.a (mgr.14388) 17853 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:09 smithi191 bash[24992]: audit 2024-08-31T09:04:08.474206+0000 mgr.a (mgr.14388) 17854 : audit [DBG] from='client.384432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:09 smithi163 bash[24253]: cluster 2024-08-31T09:04:08.302360+0000 mgr.a (mgr.14388) 17853 : cluster [DBG] pgmap v12377: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:09 smithi163 bash[24253]: audit 2024-08-31T09:04:08.474206+0000 mgr.a (mgr.14388) 17854 : audit [DBG] from='client.384432 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:11 smithi027 bash[22610]: cluster 2024-08-31T09:04:10.303329+0000 mgr.a (mgr.14388) 17855 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:04:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:11 smithi191 bash[24992]: cluster 2024-08-31T09:04:10.303329+0000 mgr.a (mgr.14388) 17855 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:04:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:11 smithi163 bash[24253]: cluster 2024-08-31T09:04:10.303329+0000 mgr.a (mgr.14388) 17855 : cluster [DBG] pgmap v12378: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:04:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:13 smithi191 bash[24992]: cluster 2024-08-31T09:04:12.304111+0000 mgr.a (mgr.14388) 17856 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:04:13.894 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:04:13.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:04:13.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:04:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:13 smithi163 bash[24253]: cluster 2024-08-31T09:04:12.304111+0000 mgr.a (mgr.14388) 17856 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:04:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:13 smithi027 bash[22610]: cluster 2024-08-31T09:04:12.304111+0000 mgr.a (mgr.14388) 17856 : cluster [DBG] pgmap v12379: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:04:14.660 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:04:14.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:04:14.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:04:14.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:04:14.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:04:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:15 smithi191 bash[24992]: audit 2024-08-31T09:04:14.228833+0000 mgr.a (mgr.14388) 17857 : audit [DBG] from='client.384510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:15 smithi191 bash[24992]: cluster 2024-08-31T09:04:14.305551+0000 mgr.a (mgr.14388) 17858 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:15 smithi163 bash[24253]: audit 2024-08-31T09:04:14.228833+0000 mgr.a (mgr.14388) 17857 : audit [DBG] from='client.384510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:15 smithi163 bash[24253]: cluster 2024-08-31T09:04:14.305551+0000 mgr.a (mgr.14388) 17858 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:15 smithi027 bash[22610]: audit 2024-08-31T09:04:14.228833+0000 mgr.a (mgr.14388) 17857 : audit [DBG] from='client.384510 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:15 smithi027 bash[22610]: cluster 2024-08-31T09:04:14.305551+0000 mgr.a (mgr.14388) 17858 : cluster [DBG] pgmap v12380: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:17 smithi191 bash[24992]: cluster 2024-08-31T09:04:16.306395+0000 mgr.a (mgr.14388) 17859 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:17.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:17 smithi163 bash[24253]: cluster 2024-08-31T09:04:16.306395+0000 mgr.a (mgr.14388) 17859 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:17 smithi027 bash[22610]: cluster 2024-08-31T09:04:16.306395+0000 mgr.a (mgr.14388) 17859 : cluster [DBG] pgmap v12381: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:04:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:04:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:04:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:19 smithi191 bash[24992]: cluster 2024-08-31T09:04:18.308553+0000 mgr.a (mgr.14388) 17860 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:19 smithi163 bash[24253]: cluster 2024-08-31T09:04:18.308553+0000 mgr.a (mgr.14388) 17860 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:19 smithi027 bash[22610]: cluster 2024-08-31T09:04:18.308553+0000 mgr.a (mgr.14388) 17860 : cluster [DBG] pgmap v12382: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:20.446 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:04:20.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:04:20.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:04:20.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:04:20.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:04:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:21 smithi191 bash[24992]: audit 2024-08-31T09:04:19.997873+0000 mgr.a (mgr.14388) 17861 : audit [DBG] from='client.384588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:21 smithi191 bash[24992]: cluster 2024-08-31T09:04:20.309114+0000 mgr.a (mgr.14388) 17862 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:21 smithi163 bash[24253]: audit 2024-08-31T09:04:19.997873+0000 mgr.a (mgr.14388) 17861 : audit [DBG] from='client.384588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:21 smithi163 bash[24253]: cluster 2024-08-31T09:04:20.309114+0000 mgr.a (mgr.14388) 17862 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:21 smithi027 bash[22610]: audit 2024-08-31T09:04:19.997873+0000 mgr.a (mgr.14388) 17861 : audit [DBG] from='client.384588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:21 smithi027 bash[22610]: cluster 2024-08-31T09:04:20.309114+0000 mgr.a (mgr.14388) 17862 : cluster [DBG] pgmap v12383: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:23 smithi191 bash[24992]: cluster 2024-08-31T09:04:22.310126+0000 mgr.a (mgr.14388) 17863 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:23 smithi163 bash[24253]: cluster 2024-08-31T09:04:22.310126+0000 mgr.a (mgr.14388) 17863 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:23 smithi027 bash[22610]: cluster 2024-08-31T09:04:22.310126+0000 mgr.a (mgr.14388) 17863 : cluster [DBG] pgmap v12384: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:04:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:04:25.448 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:04:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:25 smithi191 bash[24992]: cluster 2024-08-31T09:04:24.312403+0000 mgr.a (mgr.14388) 17864 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:25 smithi163 bash[24253]: cluster 2024-08-31T09:04:24.312403+0000 mgr.a (mgr.14388) 17864 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:25 smithi027 bash[22610]: cluster 2024-08-31T09:04:24.312403+0000 mgr.a (mgr.14388) 17864 : cluster [DBG] pgmap v12385: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:26.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:04:26.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:04:26.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:04:26.230 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:04:26.231 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:04:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:26 smithi163 bash[24253]: audit 2024-08-31T09:04:25.783558+0000 mgr.a (mgr.14388) 17865 : audit [DBG] from='client.384663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:26.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:26 smithi163 bash[24253]: cluster 2024-08-31T09:04:26.313350+0000 mgr.a (mgr.14388) 17866 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:26 smithi027 bash[22610]: audit 2024-08-31T09:04:25.783558+0000 mgr.a (mgr.14388) 17865 : audit [DBG] from='client.384663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:26 smithi027 bash[22610]: cluster 2024-08-31T09:04:26.313350+0000 mgr.a (mgr.14388) 17866 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:26 smithi191 bash[24992]: audit 2024-08-31T09:04:25.783558+0000 mgr.a (mgr.14388) 17865 : audit [DBG] from='client.384663 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:26 smithi191 bash[24992]: cluster 2024-08-31T09:04:26.313350+0000 mgr.a (mgr.14388) 17866 : cluster [DBG] pgmap v12386: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:29 smithi163 bash[24253]: cluster 2024-08-31T09:04:28.315508+0000 mgr.a (mgr.14388) 17867 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:29 smithi027 bash[22610]: cluster 2024-08-31T09:04:28.315508+0000 mgr.a (mgr.14388) 17867 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:29 smithi191 bash[24992]: cluster 2024-08-31T09:04:28.315508+0000 mgr.a (mgr.14388) 17867 : cluster [DBG] pgmap v12387: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:31.232 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:04:31.233 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:04:31.233 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:04:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:31 smithi163 bash[24253]: cluster 2024-08-31T09:04:30.316281+0000 mgr.a (mgr.14388) 17868 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:31 smithi027 bash[22610]: cluster 2024-08-31T09:04:30.316281+0000 mgr.a (mgr.14388) 17868 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:31 smithi191 bash[24992]: cluster 2024-08-31T09:04:30.316281+0000 mgr.a (mgr.14388) 17868 : cluster [DBG] pgmap v12388: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:31.981 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:04:31.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:04:31.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:04:31.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:04:31.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:04:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:33 smithi163 bash[24253]: audit 2024-08-31T09:04:31.560134+0000 mgr.a (mgr.14388) 17869 : audit [DBG] from='client.384741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:33 smithi163 bash[24253]: cluster 2024-08-31T09:04:32.317153+0000 mgr.a (mgr.14388) 17870 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:33 smithi027 bash[22610]: audit 2024-08-31T09:04:31.560134+0000 mgr.a (mgr.14388) 17869 : audit [DBG] from='client.384741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:33 smithi027 bash[22610]: cluster 2024-08-31T09:04:32.317153+0000 mgr.a (mgr.14388) 17870 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:33 smithi191 bash[24992]: audit 2024-08-31T09:04:31.560134+0000 mgr.a (mgr.14388) 17869 : audit [DBG] from='client.384741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:33 smithi191 bash[24992]: cluster 2024-08-31T09:04:32.317153+0000 mgr.a (mgr.14388) 17870 : cluster [DBG] pgmap v12389: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:35 smithi163 bash[24253]: cluster 2024-08-31T09:04:34.319434+0000 mgr.a (mgr.14388) 17871 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:35 smithi027 bash[22610]: cluster 2024-08-31T09:04:34.319434+0000 mgr.a (mgr.14388) 17871 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:35 smithi191 bash[24992]: cluster 2024-08-31T09:04:34.319434+0000 mgr.a (mgr.14388) 17871 : cluster [DBG] pgmap v12390: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:36.983 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:04:36.984 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:04:36.984 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:04:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:37 smithi163 bash[24253]: cluster 2024-08-31T09:04:36.320197+0000 mgr.a (mgr.14388) 17872 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:37 smithi027 bash[22610]: cluster 2024-08-31T09:04:36.320197+0000 mgr.a (mgr.14388) 17872 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:37.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:04:37.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:04:37.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:04:37.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:04:37.756 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:04:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:37 smithi191 bash[24992]: cluster 2024-08-31T09:04:36.320197+0000 mgr.a (mgr.14388) 17872 : cluster [DBG] pgmap v12391: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:38 smithi163 bash[24253]: audit 2024-08-31T09:04:37.320199+0000 mgr.a (mgr.14388) 17873 : audit [DBG] from='client.384816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:38 smithi027 bash[22610]: audit 2024-08-31T09:04:37.320199+0000 mgr.a (mgr.14388) 17873 : audit [DBG] from='client.384816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:38 smithi191 bash[24992]: audit 2024-08-31T09:04:37.320199+0000 mgr.a (mgr.14388) 17873 : audit [DBG] from='client.384816 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:39.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:39 smithi163 bash[24253]: cluster 2024-08-31T09:04:38.322566+0000 mgr.a (mgr.14388) 17874 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:39.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:39 smithi027 bash[22610]: cluster 2024-08-31T09:04:38.322566+0000 mgr.a (mgr.14388) 17874 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:39 smithi191 bash[24992]: cluster 2024-08-31T09:04:38.322566+0000 mgr.a (mgr.14388) 17874 : cluster [DBG] pgmap v12392: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:04:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:41 smithi163 bash[24253]: cluster 2024-08-31T09:04:40.323524+0000 mgr.a (mgr.14388) 17875 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:41 smithi027 bash[22610]: cluster 2024-08-31T09:04:40.323524+0000 mgr.a (mgr.14388) 17875 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:41 smithi191 bash[24992]: cluster 2024-08-31T09:04:40.323524+0000 mgr.a (mgr.14388) 17875 : cluster [DBG] pgmap v12393: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:04:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:04:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:04:43.511 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:04:43.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:04:43.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:04:43.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:04:43.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:04:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:43 smithi163 bash[24253]: cluster 2024-08-31T09:04:42.324478+0000 mgr.a (mgr.14388) 17876 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:43 smithi027 bash[22610]: cluster 2024-08-31T09:04:42.324478+0000 mgr.a (mgr.14388) 17876 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:43 smithi191 bash[24992]: cluster 2024-08-31T09:04:42.324478+0000 mgr.a (mgr.14388) 17876 : cluster [DBG] pgmap v12394: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:44.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:44 smithi163 bash[24253]: audit 2024-08-31T09:04:43.087372+0000 mgr.a (mgr.14388) 17877 : audit [DBG] from='client.384894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:44 smithi027 bash[22610]: audit 2024-08-31T09:04:43.087372+0000 mgr.a (mgr.14388) 17877 : audit [DBG] from='client.384894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:44 smithi191 bash[24992]: audit 2024-08-31T09:04:43.087372+0000 mgr.a (mgr.14388) 17877 : audit [DBG] from='client.384894 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:45 smithi163 bash[24253]: cluster 2024-08-31T09:04:44.327313+0000 mgr.a (mgr.14388) 17878 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:45.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:45 smithi163 bash[24253]: audit 2024-08-31T09:04:45.213744+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:04:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:45 smithi027 bash[22610]: cluster 2024-08-31T09:04:44.327313+0000 mgr.a (mgr.14388) 17878 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:45.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:45 smithi027 bash[22610]: audit 2024-08-31T09:04:45.213744+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:04:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:45 smithi191 bash[24992]: cluster 2024-08-31T09:04:44.327313+0000 mgr.a (mgr.14388) 17878 : cluster [DBG] pgmap v12395: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:04:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:45 smithi191 bash[24992]: audit 2024-08-31T09:04:45.213744+0000 mon.a (mon.0) 3240 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:04:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:46 smithi163 bash[24253]: audit 2024-08-31T09:04:46.079375+0000 mon.a (mon.0) 3241 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:04:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:46 smithi163 bash[24253]: audit 2024-08-31T09:04:46.081057+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:04:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:46 smithi163 bash[24253]: audit 2024-08-31T09:04:46.092430+0000 mon.a (mon.0) 3243 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:04:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:46 smithi163 bash[24253]: audit 2024-08-31T09:04:46.095103+0000 mon.a (mon.0) 3244 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:04:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:46 smithi163 bash[24253]: audit 2024-08-31T09:04:46.096272+0000 mgr.a (mgr.14388) 17879 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:04:47.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:46 smithi163 bash[24253]: cluster 2024-08-31T09:04:46.327854+0000 mgr.a (mgr.14388) 17880 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:04:47.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:04:46 smithi027 bash[22863]: debug 2024-08-31T09:04:46.836+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:04:47.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:04:46 smithi027 bash[22863]: debug 2024-08-31T09:04:46.836+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:04:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:46 smithi027 bash[22610]: audit 2024-08-31T09:04:46.079375+0000 mon.a (mon.0) 3241 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:04:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:46 smithi027 bash[22610]: audit 2024-08-31T09:04:46.081057+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:04:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:46 smithi027 bash[22610]: audit 2024-08-31T09:04:46.092430+0000 mon.a (mon.0) 3243 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:04:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:46 smithi027 bash[22610]: audit 2024-08-31T09:04:46.095103+0000 mon.a (mon.0) 3244 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:04:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:46 smithi027 bash[22610]: audit 2024-08-31T09:04:46.096272+0000 mgr.a (mgr.14388) 17879 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:04:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:46 smithi027 bash[22610]: cluster 2024-08-31T09:04:46.327854+0000 mgr.a (mgr.14388) 17880 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:04:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:46 smithi191 bash[24992]: audit 2024-08-31T09:04:46.079375+0000 mon.a (mon.0) 3241 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:04:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:46 smithi191 bash[24992]: audit 2024-08-31T09:04:46.081057+0000 mon.a (mon.0) 3242 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:04:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:46 smithi191 bash[24992]: audit 2024-08-31T09:04:46.092430+0000 mon.a (mon.0) 3243 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:04:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:46 smithi191 bash[24992]: audit 2024-08-31T09:04:46.095103+0000 mon.a (mon.0) 3244 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:04:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:46 smithi191 bash[24992]: audit 2024-08-31T09:04:46.096272+0000 mgr.a (mgr.14388) 17879 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:04:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:46 smithi191 bash[24992]: cluster 2024-08-31T09:04:46.327854+0000 mgr.a (mgr.14388) 17880 : cluster [DBG] pgmap v12396: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:04:48.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:48 smithi163 bash[24253]: audit 2024-08-31T09:04:46.840291+0000 mgr.a (mgr.14388) 17881 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:04:48.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:48 smithi163 bash[24253]: cephadm 2024-08-31T09:04:46.841756+0000 mgr.a (mgr.14388) 17882 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:04:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:48 smithi027 bash[22610]: audit 2024-08-31T09:04:46.840291+0000 mgr.a (mgr.14388) 17881 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:04:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:48 smithi027 bash[22610]: cephadm 2024-08-31T09:04:46.841756+0000 mgr.a (mgr.14388) 17882 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:04:48.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:04:48.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:04:48.513 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:04:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:48 smithi191 bash[24992]: audit 2024-08-31T09:04:46.840291+0000 mgr.a (mgr.14388) 17881 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:04:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:48 smithi191 bash[24992]: cephadm 2024-08-31T09:04:46.841756+0000 mgr.a (mgr.14388) 17882 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:04:49.282 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:04:49.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:04:49.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:04:49.282 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:04:49.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:04:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:49 smithi163 bash[24253]: cluster 2024-08-31T09:04:48.330116+0000 mgr.a (mgr.14388) 17883 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:49 smithi027 bash[22610]: cluster 2024-08-31T09:04:48.330116+0000 mgr.a (mgr.14388) 17883 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:49 smithi191 bash[24992]: cluster 2024-08-31T09:04:48.330116+0000 mgr.a (mgr.14388) 17883 : cluster [DBG] pgmap v12397: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:50.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:50 smithi163 bash[24253]: audit 2024-08-31T09:04:48.844000+0000 mgr.a (mgr.14388) 17884 : audit [DBG] from='client.385077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:50 smithi027 bash[22610]: audit 2024-08-31T09:04:48.844000+0000 mgr.a (mgr.14388) 17884 : audit [DBG] from='client.385077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:50 smithi191 bash[24992]: audit 2024-08-31T09:04:48.844000+0000 mgr.a (mgr.14388) 17884 : audit [DBG] from='client.385077 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:51 smithi163 bash[24253]: cluster 2024-08-31T09:04:50.331084+0000 mgr.a (mgr.14388) 17885 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:04:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:51 smithi027 bash[22610]: cluster 2024-08-31T09:04:50.331084+0000 mgr.a (mgr.14388) 17885 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:04:51.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:51 smithi191 bash[24992]: cluster 2024-08-31T09:04:50.331084+0000 mgr.a (mgr.14388) 17885 : cluster [DBG] pgmap v12398: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:04:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:53 smithi163 bash[24253]: cluster 2024-08-31T09:04:52.331842+0000 mgr.a (mgr.14388) 17886 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:04:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:53 smithi027 bash[22610]: cluster 2024-08-31T09:04:52.331842+0000 mgr.a (mgr.14388) 17886 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:04:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:53 smithi191 bash[24992]: cluster 2024-08-31T09:04:52.331842+0000 mgr.a (mgr.14388) 17886 : cluster [DBG] pgmap v12399: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:04:54.283 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:04:54.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:04:54.284 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:04:55.075 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:04:55.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:04:55.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:04:55.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:04:55.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:04:55.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:55 smithi163 bash[24253]: cluster 2024-08-31T09:04:54.334027+0000 mgr.a (mgr.14388) 17887 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:55 smithi027 bash[22610]: cluster 2024-08-31T09:04:54.334027+0000 mgr.a (mgr.14388) 17887 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:55 smithi191 bash[24992]: cluster 2024-08-31T09:04:54.334027+0000 mgr.a (mgr.14388) 17887 : cluster [DBG] pgmap v12400: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:56 smithi163 bash[24253]: audit 2024-08-31T09:04:54.623899+0000 mgr.a (mgr.14388) 17888 : audit [DBG] from='client.385152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:56 smithi027 bash[22610]: audit 2024-08-31T09:04:54.623899+0000 mgr.a (mgr.14388) 17888 : audit [DBG] from='client.385152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:56 smithi191 bash[24992]: audit 2024-08-31T09:04:54.623899+0000 mgr.a (mgr.14388) 17888 : audit [DBG] from='client.385152 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:04:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:57 smithi163 bash[24253]: cluster 2024-08-31T09:04:56.335107+0000 mgr.a (mgr.14388) 17889 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:57 smithi027 bash[22610]: cluster 2024-08-31T09:04:56.335107+0000 mgr.a (mgr.14388) 17889 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:57 smithi191 bash[24992]: cluster 2024-08-31T09:04:56.335107+0000 mgr.a (mgr.14388) 17889 : cluster [DBG] pgmap v12401: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:04:59 smithi163 bash[24253]: cluster 2024-08-31T09:04:58.337282+0000 mgr.a (mgr.14388) 17890 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:04:59 smithi027 bash[22610]: cluster 2024-08-31T09:04:58.337282+0000 mgr.a (mgr.14388) 17890 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:04:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:04:59 smithi191 bash[24992]: cluster 2024-08-31T09:04:58.337282+0000 mgr.a (mgr.14388) 17890 : cluster [DBG] pgmap v12402: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:05:00.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:00.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:00.078 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:00.816 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:00.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:00.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:00.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:00.816 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:01.689 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:01 smithi027 bash[22610]: cluster 2024-08-31T09:05:00.337734+0000 mgr.a (mgr.14388) 17891 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:01.689 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:01 smithi027 bash[22610]: audit 2024-08-31T09:05:00.409435+0000 mgr.a (mgr.14388) 17892 : audit [DBG] from='client.385230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:01 smithi163 bash[24253]: cluster 2024-08-31T09:05:00.337734+0000 mgr.a (mgr.14388) 17891 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:01.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:01 smithi163 bash[24253]: audit 2024-08-31T09:05:00.409435+0000 mgr.a (mgr.14388) 17892 : audit [DBG] from='client.385230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:01 smithi191 bash[24992]: cluster 2024-08-31T09:05:00.337734+0000 mgr.a (mgr.14388) 17891 : cluster [DBG] pgmap v12403: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:01.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:01 smithi191 bash[24992]: audit 2024-08-31T09:05:00.409435+0000 mgr.a (mgr.14388) 17892 : audit [DBG] from='client.385230 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:03.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:03 smithi163 bash[24253]: cluster 2024-08-31T09:05:02.338601+0000 mgr.a (mgr.14388) 17893 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:03 smithi027 bash[22610]: cluster 2024-08-31T09:05:02.338601+0000 mgr.a (mgr.14388) 17893 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:03 smithi191 bash[24992]: cluster 2024-08-31T09:05:02.338601+0000 mgr.a (mgr.14388) 17893 : cluster [DBG] pgmap v12404: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:05 smithi163 bash[24253]: cluster 2024-08-31T09:05:04.340797+0000 mgr.a (mgr.14388) 17894 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:05 smithi027 bash[22610]: cluster 2024-08-31T09:05:04.340797+0000 mgr.a (mgr.14388) 17894 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:05 smithi191 bash[24992]: cluster 2024-08-31T09:05:04.340797+0000 mgr.a (mgr.14388) 17894 : cluster [DBG] pgmap v12405: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:05.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:05.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:05.818 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:06.597 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:06.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:06.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:06.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:06.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:07 smithi163 bash[24253]: audit 2024-08-31T09:05:06.149672+0000 mgr.a (mgr.14388) 17895 : audit [DBG] from='client.385305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:07 smithi163 bash[24253]: cluster 2024-08-31T09:05:06.341334+0000 mgr.a (mgr.14388) 17896 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:07 smithi027 bash[22610]: audit 2024-08-31T09:05:06.149672+0000 mgr.a (mgr.14388) 17895 : audit [DBG] from='client.385305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:07 smithi027 bash[22610]: cluster 2024-08-31T09:05:06.341334+0000 mgr.a (mgr.14388) 17896 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:07 smithi191 bash[24992]: audit 2024-08-31T09:05:06.149672+0000 mgr.a (mgr.14388) 17895 : audit [DBG] from='client.385305 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:07 smithi191 bash[24992]: cluster 2024-08-31T09:05:06.341334+0000 mgr.a (mgr.14388) 17896 : cluster [DBG] pgmap v12406: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:09 smithi163 bash[24253]: cluster 2024-08-31T09:05:08.343575+0000 mgr.a (mgr.14388) 17897 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:09 smithi027 bash[22610]: cluster 2024-08-31T09:05:08.343575+0000 mgr.a (mgr.14388) 17897 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:09 smithi191 bash[24992]: cluster 2024-08-31T09:05:08.343575+0000 mgr.a (mgr.14388) 17897 : cluster [DBG] pgmap v12407: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:11.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:11.599 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:11.599 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:11 smithi163 bash[24253]: cluster 2024-08-31T09:05:10.344347+0000 mgr.a (mgr.14388) 17898 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:11 smithi027 bash[22610]: cluster 2024-08-31T09:05:10.344347+0000 mgr.a (mgr.14388) 17898 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:11 smithi191 bash[24992]: cluster 2024-08-31T09:05:10.344347+0000 mgr.a (mgr.14388) 17898 : cluster [DBG] pgmap v12408: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:12.352 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:12.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:12.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:12.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:12.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:13 smithi163 bash[24253]: audit 2024-08-31T09:05:11.933747+0000 mgr.a (mgr.14388) 17899 : audit [DBG] from='client.385374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:13.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:13 smithi163 bash[24253]: cluster 2024-08-31T09:05:12.344791+0000 mgr.a (mgr.14388) 17900 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:13 smithi027 bash[22610]: audit 2024-08-31T09:05:11.933747+0000 mgr.a (mgr.14388) 17899 : audit [DBG] from='client.385374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:13 smithi027 bash[22610]: cluster 2024-08-31T09:05:12.344791+0000 mgr.a (mgr.14388) 17900 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:13 smithi191 bash[24992]: audit 2024-08-31T09:05:11.933747+0000 mgr.a (mgr.14388) 17899 : audit [DBG] from='client.385374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:13 smithi191 bash[24992]: cluster 2024-08-31T09:05:12.344791+0000 mgr.a (mgr.14388) 17900 : cluster [DBG] pgmap v12409: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:15 smithi163 bash[24253]: cluster 2024-08-31T09:05:14.346951+0000 mgr.a (mgr.14388) 17901 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:15 smithi027 bash[22610]: cluster 2024-08-31T09:05:14.346951+0000 mgr.a (mgr.14388) 17901 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:15 smithi191 bash[24992]: cluster 2024-08-31T09:05:14.346951+0000 mgr.a (mgr.14388) 17901 : cluster [DBG] pgmap v12410: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:17.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:17.355 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:17.355 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:17 smithi027 bash[22610]: cluster 2024-08-31T09:05:16.347684+0000 mgr.a (mgr.14388) 17902 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:17 smithi191 bash[24992]: cluster 2024-08-31T09:05:16.347684+0000 mgr.a (mgr.14388) 17902 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:17.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:17 smithi163 bash[24253]: cluster 2024-08-31T09:05:16.347684+0000 mgr.a (mgr.14388) 17902 : cluster [DBG] pgmap v12411: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:18.107 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:18.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:18.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:18.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:18.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:19 smithi027 bash[22610]: audit 2024-08-31T09:05:17.688578+0000 mgr.a (mgr.14388) 17903 : audit [DBG] from='client.385452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:19 smithi027 bash[22610]: cluster 2024-08-31T09:05:18.350378+0000 mgr.a (mgr.14388) 17904 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:05:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:19 smithi191 bash[24992]: audit 2024-08-31T09:05:17.688578+0000 mgr.a (mgr.14388) 17903 : audit [DBG] from='client.385452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:19 smithi191 bash[24992]: cluster 2024-08-31T09:05:18.350378+0000 mgr.a (mgr.14388) 17904 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:05:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:19 smithi163 bash[24253]: audit 2024-08-31T09:05:17.688578+0000 mgr.a (mgr.14388) 17903 : audit [DBG] from='client.385452 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:19 smithi163 bash[24253]: cluster 2024-08-31T09:05:18.350378+0000 mgr.a (mgr.14388) 17904 : cluster [DBG] pgmap v12412: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:05:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:21 smithi027 bash[22610]: cluster 2024-08-31T09:05:20.351192+0000 mgr.a (mgr.14388) 17905 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:05:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:21 smithi191 bash[24992]: cluster 2024-08-31T09:05:20.351192+0000 mgr.a (mgr.14388) 17905 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:05:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:21 smithi163 bash[24253]: cluster 2024-08-31T09:05:20.351192+0000 mgr.a (mgr.14388) 17905 : cluster [DBG] pgmap v12413: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:05:23.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:23.110 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:23.110 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:23 smithi027 bash[22610]: cluster 2024-08-31T09:05:22.351967+0000 mgr.a (mgr.14388) 17906 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:05:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:23 smithi191 bash[24992]: cluster 2024-08-31T09:05:22.351967+0000 mgr.a (mgr.14388) 17906 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:05:23.890 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:23.890 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:23 smithi163 bash[24253]: cluster 2024-08-31T09:05:22.351967+0000 mgr.a (mgr.14388) 17906 : cluster [DBG] pgmap v12414: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:05:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:24 smithi027 bash[22610]: audit 2024-08-31T09:05:23.448473+0000 mgr.a (mgr.14388) 17907 : audit [DBG] from='client.385530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:24 smithi191 bash[24992]: audit 2024-08-31T09:05:23.448473+0000 mgr.a (mgr.14388) 17907 : audit [DBG] from='client.385530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:24 smithi163 bash[24253]: audit 2024-08-31T09:05:23.448473+0000 mgr.a (mgr.14388) 17907 : audit [DBG] from='client.385530 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:25.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:25 smithi027 bash[22610]: cluster 2024-08-31T09:05:24.354862+0000 mgr.a (mgr.14388) 17908 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:25 smithi191 bash[24992]: cluster 2024-08-31T09:05:24.354862+0000 mgr.a (mgr.14388) 17908 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:25 smithi163 bash[24253]: cluster 2024-08-31T09:05:24.354862+0000 mgr.a (mgr.14388) 17908 : cluster [DBG] pgmap v12415: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:27 smithi027 bash[22610]: cluster 2024-08-31T09:05:26.355650+0000 mgr.a (mgr.14388) 17909 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:05:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:27 smithi191 bash[24992]: cluster 2024-08-31T09:05:26.355650+0000 mgr.a (mgr.14388) 17909 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:05:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:27 smithi163 bash[24253]: cluster 2024-08-31T09:05:26.355650+0000 mgr.a (mgr.14388) 17909 : cluster [DBG] pgmap v12416: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:05:28.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:28.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:28.892 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:29.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:29.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:29.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:29.660 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:29.660 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:29 smithi027 bash[22610]: cluster 2024-08-31T09:05:28.357564+0000 mgr.a (mgr.14388) 17910 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:29.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:29 smithi191 bash[24992]: cluster 2024-08-31T09:05:28.357564+0000 mgr.a (mgr.14388) 17910 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:29 smithi163 bash[24253]: cluster 2024-08-31T09:05:28.357564+0000 mgr.a (mgr.14388) 17910 : cluster [DBG] pgmap v12417: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:30 smithi191 bash[24992]: audit 2024-08-31T09:05:29.226133+0000 mgr.a (mgr.14388) 17911 : audit [DBG] from='client.385608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:30 smithi163 bash[24253]: audit 2024-08-31T09:05:29.226133+0000 mgr.a (mgr.14388) 17911 : audit [DBG] from='client.385608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:30 smithi027 bash[22610]: audit 2024-08-31T09:05:29.226133+0000 mgr.a (mgr.14388) 17911 : audit [DBG] from='client.385608 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:31 smithi191 bash[24992]: cluster 2024-08-31T09:05:30.358559+0000 mgr.a (mgr.14388) 17912 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:05:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:31 smithi163 bash[24253]: cluster 2024-08-31T09:05:30.358559+0000 mgr.a (mgr.14388) 17912 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:05:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:31 smithi027 bash[22610]: cluster 2024-08-31T09:05:30.358559+0000 mgr.a (mgr.14388) 17912 : cluster [DBG] pgmap v12418: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:05:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:33 smithi191 bash[24992]: cluster 2024-08-31T09:05:32.359373+0000 mgr.a (mgr.14388) 17913 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:05:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:33 smithi163 bash[24253]: cluster 2024-08-31T09:05:32.359373+0000 mgr.a (mgr.14388) 17913 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:05:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:33 smithi027 bash[22610]: cluster 2024-08-31T09:05:32.359373+0000 mgr.a (mgr.14388) 17913 : cluster [DBG] pgmap v12419: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:05:34.661 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:34.662 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:35.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:35.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:35.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:35.437 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:35.437 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:35 smithi191 bash[24992]: cluster 2024-08-31T09:05:34.361580+0000 mgr.a (mgr.14388) 17914 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:05:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:35 smithi163 bash[24253]: cluster 2024-08-31T09:05:34.361580+0000 mgr.a (mgr.14388) 17914 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:05:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:35 smithi027 bash[22610]: cluster 2024-08-31T09:05:34.361580+0000 mgr.a (mgr.14388) 17914 : cluster [DBG] pgmap v12420: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:05:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:36 smithi191 bash[24992]: audit 2024-08-31T09:05:34.997958+0000 mgr.a (mgr.14388) 17915 : audit [DBG] from='client.385683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:36 smithi163 bash[24253]: audit 2024-08-31T09:05:34.997958+0000 mgr.a (mgr.14388) 17915 : audit [DBG] from='client.385683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:36 smithi027 bash[22610]: audit 2024-08-31T09:05:34.997958+0000 mgr.a (mgr.14388) 17915 : audit [DBG] from='client.385683 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:37.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:37 smithi191 bash[24992]: cluster 2024-08-31T09:05:36.362560+0000 mgr.a (mgr.14388) 17916 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:37 smithi163 bash[24253]: cluster 2024-08-31T09:05:36.362560+0000 mgr.a (mgr.14388) 17916 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:37 smithi027 bash[22610]: cluster 2024-08-31T09:05:36.362560+0000 mgr.a (mgr.14388) 17916 : cluster [DBG] pgmap v12421: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:39.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:39 smithi191 bash[24992]: cluster 2024-08-31T09:05:38.364680+0000 mgr.a (mgr.14388) 17917 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:39 smithi163 bash[24253]: cluster 2024-08-31T09:05:38.364680+0000 mgr.a (mgr.14388) 17917 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:39 smithi027 bash[22610]: cluster 2024-08-31T09:05:38.364680+0000 mgr.a (mgr.14388) 17917 : cluster [DBG] pgmap v12422: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:40.438 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:40.439 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:40.439 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:41.232 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:41.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:41.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:41.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:41.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:41 smithi191 bash[24992]: cluster 2024-08-31T09:05:40.365468+0000 mgr.a (mgr.14388) 17918 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:41 smithi163 bash[24253]: cluster 2024-08-31T09:05:40.365468+0000 mgr.a (mgr.14388) 17918 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:41 smithi027 bash[22610]: cluster 2024-08-31T09:05:40.365468+0000 mgr.a (mgr.14388) 17918 : cluster [DBG] pgmap v12423: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:42 smithi191 bash[24992]: audit 2024-08-31T09:05:40.776628+0000 mgr.a (mgr.14388) 17919 : audit [DBG] from='client.385758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:42 smithi163 bash[24253]: audit 2024-08-31T09:05:40.776628+0000 mgr.a (mgr.14388) 17919 : audit [DBG] from='client.385758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:42 smithi027 bash[22610]: audit 2024-08-31T09:05:40.776628+0000 mgr.a (mgr.14388) 17919 : audit [DBG] from='client.385758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:43 smithi191 bash[24992]: cluster 2024-08-31T09:05:42.366470+0000 mgr.a (mgr.14388) 17920 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:43 smithi163 bash[24253]: cluster 2024-08-31T09:05:42.366470+0000 mgr.a (mgr.14388) 17920 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:43 smithi027 bash[22610]: cluster 2024-08-31T09:05:42.366470+0000 mgr.a (mgr.14388) 17920 : cluster [DBG] pgmap v12424: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:44 smithi163 bash[24253]: cluster 2024-08-31T09:05:44.368743+0000 mgr.a (mgr.14388) 17921 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:44 smithi027 bash[22610]: cluster 2024-08-31T09:05:44.368743+0000 mgr.a (mgr.14388) 17921 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:44 smithi191 bash[24992]: cluster 2024-08-31T09:05:44.368743+0000 mgr.a (mgr.14388) 17921 : cluster [DBG] pgmap v12425: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:46.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:46.771 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:46.771 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:46.998 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:46.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:46.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:46.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:46.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:47 smithi163 bash[24253]: cluster 2024-08-31T09:05:46.369186+0000 mgr.a (mgr.14388) 17922 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:47 smithi163 bash[24253]: audit 2024-08-31T09:05:46.897606+0000 mon.a (mon.0) 3245 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:05:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:47 smithi027 bash[22610]: cluster 2024-08-31T09:05:46.369186+0000 mgr.a (mgr.14388) 17922 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:47 smithi027 bash[22610]: audit 2024-08-31T09:05:46.897606+0000 mon.a (mon.0) 3245 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:05:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:47 smithi191 bash[24992]: cluster 2024-08-31T09:05:46.369186+0000 mgr.a (mgr.14388) 17922 : cluster [DBG] pgmap v12426: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:47 smithi191 bash[24992]: audit 2024-08-31T09:05:46.897606+0000 mon.a (mon.0) 3245 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:05:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:48 smithi163 bash[24253]: audit 2024-08-31T09:05:46.565980+0000 mgr.a (mgr.14388) 17923 : audit [DBG] from='client.385833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:48 smithi163 bash[24253]: audit 2024-08-31T09:05:47.433343+0000 mon.a (mon.0) 3246 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:05:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:48 smithi163 bash[24253]: audit 2024-08-31T09:05:47.437925+0000 mon.a (mon.0) 3247 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:05:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:48 smithi163 bash[24253]: audit 2024-08-31T09:05:48.079591+0000 mon.a (mon.0) 3248 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:05:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:48 smithi163 bash[24253]: audit 2024-08-31T09:05:48.080660+0000 mon.a (mon.0) 3249 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:05:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:48 smithi163 bash[24253]: audit 2024-08-31T09:05:48.086711+0000 mon.a (mon.0) 3250 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:05:48.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:48 smithi163 bash[24253]: audit 2024-08-31T09:05:48.091048+0000 mon.a (mon.0) 3251 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:05:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:48 smithi027 bash[22610]: audit 2024-08-31T09:05:46.565980+0000 mgr.a (mgr.14388) 17923 : audit [DBG] from='client.385833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:48 smithi027 bash[22610]: audit 2024-08-31T09:05:47.433343+0000 mon.a (mon.0) 3246 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:05:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:48 smithi027 bash[22610]: audit 2024-08-31T09:05:47.437925+0000 mon.a (mon.0) 3247 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:05:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:48 smithi027 bash[22610]: audit 2024-08-31T09:05:48.079591+0000 mon.a (mon.0) 3248 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:05:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:48 smithi027 bash[22610]: audit 2024-08-31T09:05:48.080660+0000 mon.a (mon.0) 3249 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:05:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:48 smithi027 bash[22610]: audit 2024-08-31T09:05:48.086711+0000 mon.a (mon.0) 3250 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:05:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:48 smithi027 bash[22610]: audit 2024-08-31T09:05:48.091048+0000 mon.a (mon.0) 3251 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:05:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:48 smithi191 bash[24992]: audit 2024-08-31T09:05:46.565980+0000 mgr.a (mgr.14388) 17923 : audit [DBG] from='client.385833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:48 smithi191 bash[24992]: audit 2024-08-31T09:05:47.433343+0000 mon.a (mon.0) 3246 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:05:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:48 smithi191 bash[24992]: audit 2024-08-31T09:05:47.437925+0000 mon.a (mon.0) 3247 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:05:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:48 smithi191 bash[24992]: audit 2024-08-31T09:05:48.079591+0000 mon.a (mon.0) 3248 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:05:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:48 smithi191 bash[24992]: audit 2024-08-31T09:05:48.080660+0000 mon.a (mon.0) 3249 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:05:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:48 smithi191 bash[24992]: audit 2024-08-31T09:05:48.086711+0000 mon.a (mon.0) 3250 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:05:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:48 smithi191 bash[24992]: audit 2024-08-31T09:05:48.091048+0000 mon.a (mon.0) 3251 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:05:49.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:05:48 smithi027 bash[22863]: debug 2024-08-31T09:05:48.842+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:05:49.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:05:48 smithi027 bash[22863]: debug 2024-08-31T09:05:48.842+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:05:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:49 smithi163 bash[24253]: audit 2024-08-31T09:05:48.092101+0000 mgr.a (mgr.14388) 17924 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:05:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:49 smithi163 bash[24253]: cluster 2024-08-31T09:05:48.370466+0000 mgr.a (mgr.14388) 17925 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:49 smithi027 bash[22610]: audit 2024-08-31T09:05:48.092101+0000 mgr.a (mgr.14388) 17924 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:05:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:49 smithi027 bash[22610]: cluster 2024-08-31T09:05:48.370466+0000 mgr.a (mgr.14388) 17925 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:49 smithi191 bash[24992]: audit 2024-08-31T09:05:48.092101+0000 mgr.a (mgr.14388) 17924 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:05:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:49 smithi191 bash[24992]: cluster 2024-08-31T09:05:48.370466+0000 mgr.a (mgr.14388) 17925 : cluster [DBG] pgmap v12427: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:05:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:50 smithi163 bash[24253]: audit 2024-08-31T09:05:48.842981+0000 mgr.a (mgr.14388) 17926 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:05:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:50 smithi163 bash[24253]: cephadm 2024-08-31T09:05:48.844522+0000 mgr.a (mgr.14388) 17927 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:05:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:50 smithi027 bash[22610]: audit 2024-08-31T09:05:48.842981+0000 mgr.a (mgr.14388) 17926 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:05:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:50 smithi027 bash[22610]: cephadm 2024-08-31T09:05:48.844522+0000 mgr.a (mgr.14388) 17927 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:05:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:50 smithi191 bash[24992]: audit 2024-08-31T09:05:48.842981+0000 mgr.a (mgr.14388) 17926 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:05:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:50 smithi191 bash[24992]: cephadm 2024-08-31T09:05:48.844522+0000 mgr.a (mgr.14388) 17927 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:05:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:51 smithi163 bash[24253]: cluster 2024-08-31T09:05:50.371368+0000 mgr.a (mgr.14388) 17928 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:51.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:51 smithi027 bash[22610]: cluster 2024-08-31T09:05:50.371368+0000 mgr.a (mgr.14388) 17928 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:51 smithi191 bash[24992]: cluster 2024-08-31T09:05:50.371368+0000 mgr.a (mgr.14388) 17928 : cluster [DBG] pgmap v12428: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:52.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:52.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:52.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:52.740 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:52.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:52.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:53 smithi027 bash[22610]: audit 2024-08-31T09:05:52.334078+0000 mgr.a (mgr.14388) 17929 : audit [DBG] from='client.386010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:53 smithi027 bash[22610]: cluster 2024-08-31T09:05:52.372256+0000 mgr.a (mgr.14388) 17930 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:53.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:53 smithi191 bash[24992]: audit 2024-08-31T09:05:52.334078+0000 mgr.a (mgr.14388) 17929 : audit [DBG] from='client.386010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:53 smithi191 bash[24992]: cluster 2024-08-31T09:05:52.372256+0000 mgr.a (mgr.14388) 17930 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:53 smithi163 bash[24253]: audit 2024-08-31T09:05:52.334078+0000 mgr.a (mgr.14388) 17929 : audit [DBG] from='client.386010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:53 smithi163 bash[24253]: cluster 2024-08-31T09:05:52.372256+0000 mgr.a (mgr.14388) 17930 : cluster [DBG] pgmap v12429: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:05:55.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:55 smithi027 bash[22610]: cluster 2024-08-31T09:05:54.374634+0000 mgr.a (mgr.14388) 17931 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:05:55.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:55 smithi191 bash[24992]: cluster 2024-08-31T09:05:54.374634+0000 mgr.a (mgr.14388) 17931 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:05:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:55 smithi163 bash[24253]: cluster 2024-08-31T09:05:54.374634+0000 mgr.a (mgr.14388) 17931 : cluster [DBG] pgmap v12430: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:05:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:57 smithi027 bash[22610]: cluster 2024-08-31T09:05:56.375450+0000 mgr.a (mgr.14388) 17932 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:05:57.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:05:57.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:05:57.742 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:05:57.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:57 smithi191 bash[24992]: cluster 2024-08-31T09:05:56.375450+0000 mgr.a (mgr.14388) 17932 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:05:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:57 smithi163 bash[24253]: cluster 2024-08-31T09:05:56.375450+0000 mgr.a (mgr.14388) 17932 : cluster [DBG] pgmap v12431: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:05:58.492 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:05:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:05:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:05:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:05:58.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:05:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:59 smithi027 bash[22610]: audit 2024-08-31T09:05:58.075440+0000 mgr.a (mgr.14388) 17933 : audit [DBG] from='client.386088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:05:59 smithi027 bash[22610]: cluster 2024-08-31T09:05:58.377048+0000 mgr.a (mgr.14388) 17934 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:05:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:59 smithi191 bash[24992]: audit 2024-08-31T09:05:58.075440+0000 mgr.a (mgr.14388) 17933 : audit [DBG] from='client.386088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:05:59 smithi191 bash[24992]: cluster 2024-08-31T09:05:58.377048+0000 mgr.a (mgr.14388) 17934 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:05:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:59 smithi163 bash[24253]: audit 2024-08-31T09:05:58.075440+0000 mgr.a (mgr.14388) 17933 : audit [DBG] from='client.386088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:05:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:05:59 smithi163 bash[24253]: cluster 2024-08-31T09:05:58.377048+0000 mgr.a (mgr.14388) 17934 : cluster [DBG] pgmap v12432: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:01 smithi027 bash[22610]: cluster 2024-08-31T09:06:00.377944+0000 mgr.a (mgr.14388) 17935 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:06:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:01 smithi191 bash[24992]: cluster 2024-08-31T09:06:00.377944+0000 mgr.a (mgr.14388) 17935 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:06:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:01 smithi163 bash[24253]: cluster 2024-08-31T09:06:00.377944+0000 mgr.a (mgr.14388) 17935 : cluster [DBG] pgmap v12433: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:06:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:06:03.494 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:06:03.494 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:06:03.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:03 smithi027 bash[22610]: cluster 2024-08-31T09:06:02.378754+0000 mgr.a (mgr.14388) 17936 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:06:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:03 smithi191 bash[24992]: cluster 2024-08-31T09:06:02.378754+0000 mgr.a (mgr.14388) 17936 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:06:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:03 smithi163 bash[24253]: cluster 2024-08-31T09:06:02.378754+0000 mgr.a (mgr.14388) 17936 : cluster [DBG] pgmap v12434: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:06:04.269 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:06:04.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:06:04.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:06:04.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:06:04.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:06:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:05 smithi027 bash[22610]: audit 2024-08-31T09:06:03.827458+0000 mgr.a (mgr.14388) 17937 : audit [DBG] from='client.386166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:05 smithi027 bash[22610]: cluster 2024-08-31T09:06:04.381642+0000 mgr.a (mgr.14388) 17938 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:05 smithi191 bash[24992]: audit 2024-08-31T09:06:03.827458+0000 mgr.a (mgr.14388) 17937 : audit [DBG] from='client.386166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:05 smithi191 bash[24992]: cluster 2024-08-31T09:06:04.381642+0000 mgr.a (mgr.14388) 17938 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:05 smithi163 bash[24253]: audit 2024-08-31T09:06:03.827458+0000 mgr.a (mgr.14388) 17937 : audit [DBG] from='client.386166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:05 smithi163 bash[24253]: cluster 2024-08-31T09:06:04.381642+0000 mgr.a (mgr.14388) 17938 : cluster [DBG] pgmap v12435: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:07 smithi027 bash[22610]: cluster 2024-08-31T09:06:06.382445+0000 mgr.a (mgr.14388) 17939 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:06:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:07 smithi191 bash[24992]: cluster 2024-08-31T09:06:06.382445+0000 mgr.a (mgr.14388) 17939 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:06:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:07 smithi163 bash[24253]: cluster 2024-08-31T09:06:06.382445+0000 mgr.a (mgr.14388) 17939 : cluster [DBG] pgmap v12436: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:06:09.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:06:09.271 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:06:09.271 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:06:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:09 smithi191 bash[24992]: cluster 2024-08-31T09:06:08.384368+0000 mgr.a (mgr.14388) 17940 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:09 smithi163 bash[24253]: cluster 2024-08-31T09:06:08.384368+0000 mgr.a (mgr.14388) 17940 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:09.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:09 smithi027 bash[22610]: cluster 2024-08-31T09:06:08.384368+0000 mgr.a (mgr.14388) 17940 : cluster [DBG] pgmap v12437: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:10.045 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:06:10.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:06:10.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:06:10.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:06:10.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:06:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:11 smithi191 bash[24992]: audit 2024-08-31T09:06:09.607294+0000 mgr.a (mgr.14388) 17941 : audit [DBG] from='client.386244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:11 smithi191 bash[24992]: cluster 2024-08-31T09:06:10.385320+0000 mgr.a (mgr.14388) 17942 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:11 smithi163 bash[24253]: audit 2024-08-31T09:06:09.607294+0000 mgr.a (mgr.14388) 17941 : audit [DBG] from='client.386244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:11 smithi163 bash[24253]: cluster 2024-08-31T09:06:10.385320+0000 mgr.a (mgr.14388) 17942 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:11 smithi027 bash[22610]: audit 2024-08-31T09:06:09.607294+0000 mgr.a (mgr.14388) 17941 : audit [DBG] from='client.386244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:11 smithi027 bash[22610]: cluster 2024-08-31T09:06:10.385320+0000 mgr.a (mgr.14388) 17942 : cluster [DBG] pgmap v12438: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:13 smithi191 bash[24992]: cluster 2024-08-31T09:06:12.386154+0000 mgr.a (mgr.14388) 17943 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:13 smithi163 bash[24253]: cluster 2024-08-31T09:06:12.386154+0000 mgr.a (mgr.14388) 17943 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:13 smithi027 bash[22610]: cluster 2024-08-31T09:06:12.386154+0000 mgr.a (mgr.14388) 17943 : cluster [DBG] pgmap v12439: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:15.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:06:15.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:06:15.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:06:15.787 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:06:15.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:06:15.787 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:06:15.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:06:15.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:06:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:15 smithi191 bash[24992]: cluster 2024-08-31T09:06:14.388411+0000 mgr.a (mgr.14388) 17944 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:15 smithi163 bash[24253]: cluster 2024-08-31T09:06:14.388411+0000 mgr.a (mgr.14388) 17944 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:15 smithi027 bash[22610]: cluster 2024-08-31T09:06:14.388411+0000 mgr.a (mgr.14388) 17944 : cluster [DBG] pgmap v12440: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:16 smithi191 bash[24992]: audit 2024-08-31T09:06:15.380806+0000 mgr.a (mgr.14388) 17945 : audit [DBG] from='client.386319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:16 smithi163 bash[24253]: audit 2024-08-31T09:06:15.380806+0000 mgr.a (mgr.14388) 17945 : audit [DBG] from='client.386319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:16 smithi027 bash[22610]: audit 2024-08-31T09:06:15.380806+0000 mgr.a (mgr.14388) 17945 : audit [DBG] from='client.386319 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:17.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:17 smithi191 bash[24992]: cluster 2024-08-31T09:06:16.389579+0000 mgr.a (mgr.14388) 17946 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:17.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:17 smithi163 bash[24253]: cluster 2024-08-31T09:06:16.389579+0000 mgr.a (mgr.14388) 17946 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:17 smithi027 bash[22610]: cluster 2024-08-31T09:06:16.389579+0000 mgr.a (mgr.14388) 17946 : cluster [DBG] pgmap v12441: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:19 smithi191 bash[24992]: cluster 2024-08-31T09:06:18.391906+0000 mgr.a (mgr.14388) 17947 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:19 smithi163 bash[24253]: cluster 2024-08-31T09:06:18.391906+0000 mgr.a (mgr.14388) 17947 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:19 smithi027 bash[22610]: cluster 2024-08-31T09:06:18.391906+0000 mgr.a (mgr.14388) 17947 : cluster [DBG] pgmap v12442: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:20.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:06:20.789 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:06:20.789 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:06:21.579 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:06:21.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:06:21.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:06:21.579 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:06:21.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:06:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:21 smithi191 bash[24992]: cluster 2024-08-31T09:06:20.392860+0000 mgr.a (mgr.14388) 17948 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:21 smithi163 bash[24253]: cluster 2024-08-31T09:06:20.392860+0000 mgr.a (mgr.14388) 17948 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:21 smithi027 bash[22610]: cluster 2024-08-31T09:06:20.392860+0000 mgr.a (mgr.14388) 17948 : cluster [DBG] pgmap v12443: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:22 smithi191 bash[24992]: audit 2024-08-31T09:06:21.129424+0000 mgr.a (mgr.14388) 17949 : audit [DBG] from='client.386397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:22 smithi163 bash[24253]: audit 2024-08-31T09:06:21.129424+0000 mgr.a (mgr.14388) 17949 : audit [DBG] from='client.386397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:22 smithi027 bash[22610]: audit 2024-08-31T09:06:21.129424+0000 mgr.a (mgr.14388) 17949 : audit [DBG] from='client.386397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:23 smithi191 bash[24992]: cluster 2024-08-31T09:06:22.393876+0000 mgr.a (mgr.14388) 17950 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:23 smithi163 bash[24253]: cluster 2024-08-31T09:06:22.393876+0000 mgr.a (mgr.14388) 17950 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:23 smithi027 bash[22610]: cluster 2024-08-31T09:06:22.393876+0000 mgr.a (mgr.14388) 17950 : cluster [DBG] pgmap v12444: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:25.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:25 smithi191 bash[24992]: cluster 2024-08-31T09:06:24.396200+0000 mgr.a (mgr.14388) 17951 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:25.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:25 smithi163 bash[24253]: cluster 2024-08-31T09:06:24.396200+0000 mgr.a (mgr.14388) 17951 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:25 smithi027 bash[22610]: cluster 2024-08-31T09:06:24.396200+0000 mgr.a (mgr.14388) 17951 : cluster [DBG] pgmap v12445: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:26.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:06:26.581 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:06:26.582 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:06:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:26 smithi163 bash[24253]: cluster 2024-08-31T09:06:26.397012+0000 mgr.a (mgr.14388) 17952 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:26 smithi027 bash[22610]: cluster 2024-08-31T09:06:26.397012+0000 mgr.a (mgr.14388) 17952 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:26 smithi191 bash[24992]: cluster 2024-08-31T09:06:26.397012+0000 mgr.a (mgr.14388) 17952 : cluster [DBG] pgmap v12446: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:27.353 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:06:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:06:27.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:06:27.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:06:27.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:06:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:27 smithi163 bash[24253]: audit 2024-08-31T09:06:26.917814+0000 mgr.a (mgr.14388) 17953 : audit [DBG] from='client.386469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:27.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:27 smithi027 bash[22610]: audit 2024-08-31T09:06:26.917814+0000 mgr.a (mgr.14388) 17953 : audit [DBG] from='client.386469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:27 smithi191 bash[24992]: audit 2024-08-31T09:06:26.917814+0000 mgr.a (mgr.14388) 17953 : audit [DBG] from='client.386469 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:28 smithi163 bash[24253]: cluster 2024-08-31T09:06:28.399355+0000 mgr.a (mgr.14388) 17954 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:28 smithi027 bash[22610]: cluster 2024-08-31T09:06:28.399355+0000 mgr.a (mgr.14388) 17954 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:28 smithi191 bash[24992]: cluster 2024-08-31T09:06:28.399355+0000 mgr.a (mgr.14388) 17954 : cluster [DBG] pgmap v12447: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:06:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:31 smithi027 bash[22610]: cluster 2024-08-31T09:06:30.400151+0000 mgr.a (mgr.14388) 17955 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:31 smithi191 bash[24992]: cluster 2024-08-31T09:06:30.400151+0000 mgr.a (mgr.14388) 17955 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:31 smithi163 bash[24253]: cluster 2024-08-31T09:06:30.400151+0000 mgr.a (mgr.14388) 17955 : cluster [DBG] pgmap v12448: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:32.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:06:32.356 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:06:32.356 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:06:33.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:06:33.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:06:33.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:06:33.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:06:33.133 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:06:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:33 smithi027 bash[22610]: cluster 2024-08-31T09:06:32.400738+0000 mgr.a (mgr.14388) 17956 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:33 smithi191 bash[24992]: cluster 2024-08-31T09:06:32.400738+0000 mgr.a (mgr.14388) 17956 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:33 smithi163 bash[24253]: cluster 2024-08-31T09:06:32.400738+0000 mgr.a (mgr.14388) 17956 : cluster [DBG] pgmap v12449: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:34 smithi027 bash[22610]: audit 2024-08-31T09:06:32.688781+0000 mgr.a (mgr.14388) 17957 : audit [DBG] from='client.386544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:34 smithi191 bash[24992]: audit 2024-08-31T09:06:32.688781+0000 mgr.a (mgr.14388) 17957 : audit [DBG] from='client.386544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:34 smithi163 bash[24253]: audit 2024-08-31T09:06:32.688781+0000 mgr.a (mgr.14388) 17957 : audit [DBG] from='client.386544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:35 smithi027 bash[22610]: cluster 2024-08-31T09:06:34.403508+0000 mgr.a (mgr.14388) 17958 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:06:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:35 smithi191 bash[24992]: cluster 2024-08-31T09:06:34.403508+0000 mgr.a (mgr.14388) 17958 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:06:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:35 smithi163 bash[24253]: cluster 2024-08-31T09:06:34.403508+0000 mgr.a (mgr.14388) 17958 : cluster [DBG] pgmap v12450: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:06:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:37 smithi191 bash[24992]: cluster 2024-08-31T09:06:36.404302+0000 mgr.a (mgr.14388) 17959 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:06:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:37 smithi163 bash[24253]: cluster 2024-08-31T09:06:36.404302+0000 mgr.a (mgr.14388) 17959 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:06:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:37 smithi027 bash[22610]: cluster 2024-08-31T09:06:36.404302+0000 mgr.a (mgr.14388) 17959 : cluster [DBG] pgmap v12451: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:06:38.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:06:38.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:06:38.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:06:38.913 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:06:38.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:06:38.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:06:38.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:06:38.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:06:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:39 smithi191 bash[24992]: cluster 2024-08-31T09:06:38.405847+0000 mgr.a (mgr.14388) 17960 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:39 smithi191 bash[24992]: audit 2024-08-31T09:06:38.467424+0000 mgr.a (mgr.14388) 17961 : audit [DBG] from='client.386622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:39 smithi163 bash[24253]: cluster 2024-08-31T09:06:38.405847+0000 mgr.a (mgr.14388) 17960 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:39.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:39 smithi163 bash[24253]: audit 2024-08-31T09:06:38.467424+0000 mgr.a (mgr.14388) 17961 : audit [DBG] from='client.386622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:39 smithi027 bash[22610]: cluster 2024-08-31T09:06:38.405847+0000 mgr.a (mgr.14388) 17960 : cluster [DBG] pgmap v12452: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:39 smithi027 bash[22610]: audit 2024-08-31T09:06:38.467424+0000 mgr.a (mgr.14388) 17961 : audit [DBG] from='client.386622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:41 smithi191 bash[24992]: cluster 2024-08-31T09:06:40.406749+0000 mgr.a (mgr.14388) 17962 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:06:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:41 smithi163 bash[24253]: cluster 2024-08-31T09:06:40.406749+0000 mgr.a (mgr.14388) 17962 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:06:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:41 smithi027 bash[22610]: cluster 2024-08-31T09:06:40.406749+0000 mgr.a (mgr.14388) 17962 : cluster [DBG] pgmap v12453: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:06:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:43 smithi191 bash[24992]: cluster 2024-08-31T09:06:42.407543+0000 mgr.a (mgr.14388) 17963 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:06:43.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:06:43.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:06:43.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:06:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:43 smithi163 bash[24253]: cluster 2024-08-31T09:06:42.407543+0000 mgr.a (mgr.14388) 17963 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:06:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:43 smithi027 bash[22610]: cluster 2024-08-31T09:06:42.407543+0000 mgr.a (mgr.14388) 17963 : cluster [DBG] pgmap v12454: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:06:44.691 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:06:44.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:06:44.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:06:44.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:06:44.691 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:06:45.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:45 smithi191 bash[24992]: audit 2024-08-31T09:06:44.253957+0000 mgr.a (mgr.14388) 17964 : audit [DBG] from='client.386700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:45 smithi191 bash[24992]: cluster 2024-08-31T09:06:44.408899+0000 mgr.a (mgr.14388) 17965 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:45 smithi163 bash[24253]: audit 2024-08-31T09:06:44.253957+0000 mgr.a (mgr.14388) 17964 : audit [DBG] from='client.386700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:45 smithi163 bash[24253]: cluster 2024-08-31T09:06:44.408899+0000 mgr.a (mgr.14388) 17965 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:45 smithi027 bash[22610]: audit 2024-08-31T09:06:44.253957+0000 mgr.a (mgr.14388) 17964 : audit [DBG] from='client.386700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:45 smithi027 bash[22610]: cluster 2024-08-31T09:06:44.408899+0000 mgr.a (mgr.14388) 17965 : cluster [DBG] pgmap v12455: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:47 smithi191 bash[24992]: cluster 2024-08-31T09:06:46.409759+0000 mgr.a (mgr.14388) 17966 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:06:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:47 smithi163 bash[24253]: cluster 2024-08-31T09:06:46.409759+0000 mgr.a (mgr.14388) 17966 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:06:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:47 smithi027 bash[22610]: cluster 2024-08-31T09:06:46.409759+0000 mgr.a (mgr.14388) 17966 : cluster [DBG] pgmap v12456: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:06:49.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:06:49.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:06:49.693 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:06:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:49 smithi191 bash[24992]: cluster 2024-08-31T09:06:48.412057+0000 mgr.a (mgr.14388) 17967 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:06:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:49 smithi191 bash[24992]: audit 2024-08-31T09:06:48.896772+0000 mon.a (mon.0) 3252 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:06:49.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:49 smithi163 bash[24253]: cluster 2024-08-31T09:06:48.412057+0000 mgr.a (mgr.14388) 17967 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:06:49.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:49 smithi163 bash[24253]: audit 2024-08-31T09:06:48.896772+0000 mon.a (mon.0) 3252 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:06:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:49 smithi027 bash[22610]: cluster 2024-08-31T09:06:48.412057+0000 mgr.a (mgr.14388) 17967 : cluster [DBG] pgmap v12457: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:06:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:49 smithi027 bash[22610]: audit 2024-08-31T09:06:48.896772+0000 mon.a (mon.0) 3252 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:06:50.481 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:06:50.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:06:50.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:06:50.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:06:50.481 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:06:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:50 smithi191 bash[24992]: audit 2024-08-31T09:06:49.523969+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:50 smithi191 bash[24992]: audit 2024-08-31T09:06:49.529483+0000 mon.a (mon.0) 3254 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:50 smithi191 bash[24992]: audit 2024-08-31T09:06:49.534712+0000 mon.a (mon.0) 3255 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:50 smithi191 bash[24992]: audit 2024-08-31T09:06:49.538467+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:50 smithi191 bash[24992]: audit 2024-08-31T09:06:50.349865+0000 mon.a (mon.0) 3257 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:06:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:50 smithi191 bash[24992]: audit 2024-08-31T09:06:50.350737+0000 mon.a (mon.0) 3258 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:06:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:50 smithi191 bash[24992]: audit 2024-08-31T09:06:50.356117+0000 mon.a (mon.0) 3259 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:50 smithi191 bash[24992]: audit 2024-08-31T09:06:50.358392+0000 mon.a (mon.0) 3260 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:06:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:50 smithi163 bash[24253]: audit 2024-08-31T09:06:49.523969+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:50 smithi163 bash[24253]: audit 2024-08-31T09:06:49.529483+0000 mon.a (mon.0) 3254 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:50 smithi163 bash[24253]: audit 2024-08-31T09:06:49.534712+0000 mon.a (mon.0) 3255 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:50 smithi163 bash[24253]: audit 2024-08-31T09:06:49.538467+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:50 smithi163 bash[24253]: audit 2024-08-31T09:06:50.349865+0000 mon.a (mon.0) 3257 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:06:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:50 smithi163 bash[24253]: audit 2024-08-31T09:06:50.350737+0000 mon.a (mon.0) 3258 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:06:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:50 smithi163 bash[24253]: audit 2024-08-31T09:06:50.356117+0000 mon.a (mon.0) 3259 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:50 smithi163 bash[24253]: audit 2024-08-31T09:06:50.358392+0000 mon.a (mon.0) 3260 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:06:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:50 smithi027 bash[22610]: audit 2024-08-31T09:06:49.523969+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:50 smithi027 bash[22610]: audit 2024-08-31T09:06:49.529483+0000 mon.a (mon.0) 3254 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:50 smithi027 bash[22610]: audit 2024-08-31T09:06:49.534712+0000 mon.a (mon.0) 3255 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:50 smithi027 bash[22610]: audit 2024-08-31T09:06:49.538467+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:50 smithi027 bash[22610]: audit 2024-08-31T09:06:50.349865+0000 mon.a (mon.0) 3257 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:06:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:50 smithi027 bash[22610]: audit 2024-08-31T09:06:50.350737+0000 mon.a (mon.0) 3258 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:06:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:50 smithi027 bash[22610]: audit 2024-08-31T09:06:50.356117+0000 mon.a (mon.0) 3259 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:06:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:50 smithi027 bash[22610]: audit 2024-08-31T09:06:50.358392+0000 mon.a (mon.0) 3260 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:06:51.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:06:51 smithi027 bash[22863]: debug 2024-08-31T09:06:51.160+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:06:51.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:06:51 smithi027 bash[22863]: debug 2024-08-31T09:06:51.160+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:06:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:51 smithi191 bash[24992]: audit 2024-08-31T09:06:50.025101+0000 mgr.a (mgr.14388) 17968 : audit [DBG] from='client.386772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:51 smithi191 bash[24992]: audit 2024-08-31T09:06:50.359611+0000 mgr.a (mgr.14388) 17969 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:06:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:51 smithi191 bash[24992]: cluster 2024-08-31T09:06:50.412901+0000 mgr.a (mgr.14388) 17970 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:51 smithi163 bash[24253]: audit 2024-08-31T09:06:50.025101+0000 mgr.a (mgr.14388) 17968 : audit [DBG] from='client.386772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:51 smithi163 bash[24253]: audit 2024-08-31T09:06:50.359611+0000 mgr.a (mgr.14388) 17969 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:06:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:51 smithi163 bash[24253]: cluster 2024-08-31T09:06:50.412901+0000 mgr.a (mgr.14388) 17970 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:51 smithi027 bash[22610]: audit 2024-08-31T09:06:50.025101+0000 mgr.a (mgr.14388) 17968 : audit [DBG] from='client.386772 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:51 smithi027 bash[22610]: audit 2024-08-31T09:06:50.359611+0000 mgr.a (mgr.14388) 17969 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:06:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:51 smithi027 bash[22610]: cluster 2024-08-31T09:06:50.412901+0000 mgr.a (mgr.14388) 17970 : cluster [DBG] pgmap v12458: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:52 smithi191 bash[24992]: audit 2024-08-31T09:06:51.163730+0000 mgr.a (mgr.14388) 17971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:06:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:52 smithi191 bash[24992]: cephadm 2024-08-31T09:06:51.165002+0000 mgr.a (mgr.14388) 17972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:06:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:52 smithi163 bash[24253]: audit 2024-08-31T09:06:51.163730+0000 mgr.a (mgr.14388) 17971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:06:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:52 smithi163 bash[24253]: cephadm 2024-08-31T09:06:51.165002+0000 mgr.a (mgr.14388) 17972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:06:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:52 smithi027 bash[22610]: audit 2024-08-31T09:06:51.163730+0000 mgr.a (mgr.14388) 17971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:06:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:52 smithi027 bash[22610]: cephadm 2024-08-31T09:06:51.165002+0000 mgr.a (mgr.14388) 17972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:06:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:53 smithi163 bash[24253]: cluster 2024-08-31T09:06:52.413840+0000 mgr.a (mgr.14388) 17973 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:53 smithi027 bash[22610]: cluster 2024-08-31T09:06:52.413840+0000 mgr.a (mgr.14388) 17973 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:53 smithi191 bash[24992]: cluster 2024-08-31T09:06:52.413840+0000 mgr.a (mgr.14388) 17973 : cluster [DBG] pgmap v12459: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:06:55.482 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:06:55.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:06:55.483 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:06:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:55 smithi163 bash[24253]: cluster 2024-08-31T09:06:54.416150+0000 mgr.a (mgr.14388) 17974 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:55 smithi027 bash[22610]: cluster 2024-08-31T09:06:54.416150+0000 mgr.a (mgr.14388) 17974 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:55 smithi191 bash[24992]: cluster 2024-08-31T09:06:54.416150+0000 mgr.a (mgr.14388) 17974 : cluster [DBG] pgmap v12460: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:56.227 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:06:56.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:06:56.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:06:56.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:06:56.228 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:06:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:56 smithi163 bash[24253]: audit 2024-08-31T09:06:55.814778+0000 mgr.a (mgr.14388) 17975 : audit [DBG] from='client.386955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:56 smithi163 bash[24253]: cluster 2024-08-31T09:06:56.417140+0000 mgr.a (mgr.14388) 17976 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:56 smithi027 bash[22610]: audit 2024-08-31T09:06:55.814778+0000 mgr.a (mgr.14388) 17975 : audit [DBG] from='client.386955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:56 smithi027 bash[22610]: cluster 2024-08-31T09:06:56.417140+0000 mgr.a (mgr.14388) 17976 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:56 smithi191 bash[24992]: audit 2024-08-31T09:06:55.814778+0000 mgr.a (mgr.14388) 17975 : audit [DBG] from='client.386955 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:06:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:56 smithi191 bash[24992]: cluster 2024-08-31T09:06:56.417140+0000 mgr.a (mgr.14388) 17976 : cluster [DBG] pgmap v12461: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:06:59 smithi027 bash[22610]: cluster 2024-08-31T09:06:58.419357+0000 mgr.a (mgr.14388) 17977 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:06:59 smithi191 bash[24992]: cluster 2024-08-31T09:06:58.419357+0000 mgr.a (mgr.14388) 17977 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:06:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:06:59 smithi163 bash[24253]: cluster 2024-08-31T09:06:58.419357+0000 mgr.a (mgr.14388) 17977 : cluster [DBG] pgmap v12462: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:01.229 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:01.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:01.230 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:01.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:01 smithi027 bash[22610]: cluster 2024-08-31T09:07:00.420186+0000 mgr.a (mgr.14388) 17978 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:01.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:01 smithi191 bash[24992]: cluster 2024-08-31T09:07:00.420186+0000 mgr.a (mgr.14388) 17978 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:01 smithi163 bash[24253]: cluster 2024-08-31T09:07:00.420186+0000 mgr.a (mgr.14388) 17978 : cluster [DBG] pgmap v12463: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:01.998 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:01.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:01.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:01.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:01.998 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:03 smithi191 bash[24992]: audit 2024-08-31T09:07:01.562320+0000 mgr.a (mgr.14388) 17979 : audit [DBG] from='client.387033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:03.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:03 smithi191 bash[24992]: cluster 2024-08-31T09:07:02.421170+0000 mgr.a (mgr.14388) 17980 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:03 smithi163 bash[24253]: audit 2024-08-31T09:07:01.562320+0000 mgr.a (mgr.14388) 17979 : audit [DBG] from='client.387033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:03 smithi163 bash[24253]: cluster 2024-08-31T09:07:02.421170+0000 mgr.a (mgr.14388) 17980 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:03 smithi027 bash[22610]: audit 2024-08-31T09:07:01.562320+0000 mgr.a (mgr.14388) 17979 : audit [DBG] from='client.387033 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:03 smithi027 bash[22610]: cluster 2024-08-31T09:07:02.421170+0000 mgr.a (mgr.14388) 17980 : cluster [DBG] pgmap v12464: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:05 smithi191 bash[24992]: cluster 2024-08-31T09:07:04.423461+0000 mgr.a (mgr.14388) 17981 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:05 smithi163 bash[24253]: cluster 2024-08-31T09:07:04.423461+0000 mgr.a (mgr.14388) 17981 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:05 smithi027 bash[22610]: cluster 2024-08-31T09:07:04.423461+0000 mgr.a (mgr.14388) 17981 : cluster [DBG] pgmap v12465: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:06.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:07.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:07.000 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:07.743 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:07.744 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:07 smithi191 bash[24992]: cluster 2024-08-31T09:07:06.424216+0000 mgr.a (mgr.14388) 17982 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:07 smithi163 bash[24253]: cluster 2024-08-31T09:07:06.424216+0000 mgr.a (mgr.14388) 17982 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:07 smithi027 bash[22610]: cluster 2024-08-31T09:07:06.424216+0000 mgr.a (mgr.14388) 17982 : cluster [DBG] pgmap v12466: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:08 smithi191 bash[24992]: audit 2024-08-31T09:07:07.327711+0000 mgr.a (mgr.14388) 17983 : audit [DBG] from='client.387108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:08 smithi163 bash[24253]: audit 2024-08-31T09:07:07.327711+0000 mgr.a (mgr.14388) 17983 : audit [DBG] from='client.387108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:08 smithi027 bash[22610]: audit 2024-08-31T09:07:07.327711+0000 mgr.a (mgr.14388) 17983 : audit [DBG] from='client.387108 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:09 smithi191 bash[24992]: cluster 2024-08-31T09:07:08.426493+0000 mgr.a (mgr.14388) 17984 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:09 smithi163 bash[24253]: cluster 2024-08-31T09:07:08.426493+0000 mgr.a (mgr.14388) 17984 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:09 smithi027 bash[22610]: cluster 2024-08-31T09:07:08.426493+0000 mgr.a (mgr.14388) 17984 : cluster [DBG] pgmap v12467: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:11 smithi191 bash[24992]: cluster 2024-08-31T09:07:10.427283+0000 mgr.a (mgr.14388) 17985 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:11 smithi163 bash[24253]: cluster 2024-08-31T09:07:10.427283+0000 mgr.a (mgr.14388) 17985 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:11 smithi027 bash[22610]: cluster 2024-08-31T09:07:10.427283+0000 mgr.a (mgr.14388) 17985 : cluster [DBG] pgmap v12468: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:12.745 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:12.745 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:12.746 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:13.498 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:13.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:13.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:13.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:13.499 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:13.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:13 smithi191 bash[24992]: cluster 2024-08-31T09:07:12.428069+0000 mgr.a (mgr.14388) 17986 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:13 smithi163 bash[24253]: cluster 2024-08-31T09:07:12.428069+0000 mgr.a (mgr.14388) 17986 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:13 smithi027 bash[22610]: cluster 2024-08-31T09:07:12.428069+0000 mgr.a (mgr.14388) 17986 : cluster [DBG] pgmap v12469: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:14 smithi191 bash[24992]: audit 2024-08-31T09:07:13.079412+0000 mgr.a (mgr.14388) 17987 : audit [DBG] from='client.387186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:14 smithi163 bash[24253]: audit 2024-08-31T09:07:13.079412+0000 mgr.a (mgr.14388) 17987 : audit [DBG] from='client.387186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:14 smithi027 bash[22610]: audit 2024-08-31T09:07:13.079412+0000 mgr.a (mgr.14388) 17987 : audit [DBG] from='client.387186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:15 smithi191 bash[24992]: cluster 2024-08-31T09:07:14.430853+0000 mgr.a (mgr.14388) 17988 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:15 smithi163 bash[24253]: cluster 2024-08-31T09:07:14.430853+0000 mgr.a (mgr.14388) 17988 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:15 smithi027 bash[22610]: cluster 2024-08-31T09:07:14.430853+0000 mgr.a (mgr.14388) 17988 : cluster [DBG] pgmap v12470: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:17 smithi191 bash[24992]: cluster 2024-08-31T09:07:16.431620+0000 mgr.a (mgr.14388) 17989 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:07:17.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:17 smithi163 bash[24253]: cluster 2024-08-31T09:07:16.431620+0000 mgr.a (mgr.14388) 17989 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:07:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:17 smithi027 bash[22610]: cluster 2024-08-31T09:07:16.431620+0000 mgr.a (mgr.14388) 17989 : cluster [DBG] pgmap v12471: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:07:18.500 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:18.501 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:19.244 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:19.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:19.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:19.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:19.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:19.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:19 smithi191 bash[24992]: cluster 2024-08-31T09:07:18.433552+0000 mgr.a (mgr.14388) 17990 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:19 smithi163 bash[24253]: cluster 2024-08-31T09:07:18.433552+0000 mgr.a (mgr.14388) 17990 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:19 smithi027 bash[22610]: cluster 2024-08-31T09:07:18.433552+0000 mgr.a (mgr.14388) 17990 : cluster [DBG] pgmap v12472: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:20 smithi163 bash[24253]: audit 2024-08-31T09:07:18.832262+0000 mgr.a (mgr.14388) 17991 : audit [DBG] from='client.387264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:20 smithi027 bash[22610]: audit 2024-08-31T09:07:18.832262+0000 mgr.a (mgr.14388) 17991 : audit [DBG] from='client.387264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:20 smithi191 bash[24992]: audit 2024-08-31T09:07:18.832262+0000 mgr.a (mgr.14388) 17991 : audit [DBG] from='client.387264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:21 smithi163 bash[24253]: cluster 2024-08-31T09:07:20.434455+0000 mgr.a (mgr.14388) 17992 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:07:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:21 smithi027 bash[22610]: cluster 2024-08-31T09:07:20.434455+0000 mgr.a (mgr.14388) 17992 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:07:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:21 smithi191 bash[24992]: cluster 2024-08-31T09:07:20.434455+0000 mgr.a (mgr.14388) 17992 : cluster [DBG] pgmap v12473: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:07:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:23 smithi163 bash[24253]: cluster 2024-08-31T09:07:22.435255+0000 mgr.a (mgr.14388) 17993 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:07:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:23 smithi027 bash[22610]: cluster 2024-08-31T09:07:22.435255+0000 mgr.a (mgr.14388) 17993 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:07:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:23 smithi191 bash[24992]: cluster 2024-08-31T09:07:22.435255+0000 mgr.a (mgr.14388) 17993 : cluster [DBG] pgmap v12474: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:07:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:24.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:24.246 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:25.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:25.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:25.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:25.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:25.020 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:25 smithi163 bash[24253]: cluster 2024-08-31T09:07:24.436631+0000 mgr.a (mgr.14388) 17994 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:25 smithi027 bash[22610]: cluster 2024-08-31T09:07:24.436631+0000 mgr.a (mgr.14388) 17994 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:25 smithi191 bash[24992]: cluster 2024-08-31T09:07:24.436631+0000 mgr.a (mgr.14388) 17994 : cluster [DBG] pgmap v12475: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:26 smithi163 bash[24253]: audit 2024-08-31T09:07:24.586985+0000 mgr.a (mgr.14388) 17995 : audit [DBG] from='client.387342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:26 smithi027 bash[22610]: audit 2024-08-31T09:07:24.586985+0000 mgr.a (mgr.14388) 17995 : audit [DBG] from='client.387342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:26 smithi191 bash[24992]: audit 2024-08-31T09:07:24.586985+0000 mgr.a (mgr.14388) 17995 : audit [DBG] from='client.387342 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:27 smithi163 bash[24253]: cluster 2024-08-31T09:07:26.437494+0000 mgr.a (mgr.14388) 17996 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:27 smithi027 bash[22610]: cluster 2024-08-31T09:07:26.437494+0000 mgr.a (mgr.14388) 17996 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:27 smithi191 bash[24992]: cluster 2024-08-31T09:07:26.437494+0000 mgr.a (mgr.14388) 17996 : cluster [DBG] pgmap v12476: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:28 smithi163 bash[24253]: cluster 2024-08-31T09:07:28.439668+0000 mgr.a (mgr.14388) 17997 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:28 smithi027 bash[22610]: cluster 2024-08-31T09:07:28.439668+0000 mgr.a (mgr.14388) 17997 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:28 smithi191 bash[24992]: cluster 2024-08-31T09:07:28.439668+0000 mgr.a (mgr.14388) 17997 : cluster [DBG] pgmap v12477: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:30.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:30.022 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:30.022 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:30.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:30.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:30.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:30.791 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:30.792 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:31.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:31 smithi191 bash[24992]: audit 2024-08-31T09:07:30.355530+0000 mgr.a (mgr.14388) 17998 : audit [DBG] from='client.387420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:31 smithi191 bash[24992]: cluster 2024-08-31T09:07:30.440317+0000 mgr.a (mgr.14388) 17999 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:31 smithi163 bash[24253]: audit 2024-08-31T09:07:30.355530+0000 mgr.a (mgr.14388) 17998 : audit [DBG] from='client.387420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:31 smithi163 bash[24253]: cluster 2024-08-31T09:07:30.440317+0000 mgr.a (mgr.14388) 17999 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:31 smithi027 bash[22610]: audit 2024-08-31T09:07:30.355530+0000 mgr.a (mgr.14388) 17998 : audit [DBG] from='client.387420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:31 smithi027 bash[22610]: cluster 2024-08-31T09:07:30.440317+0000 mgr.a (mgr.14388) 17999 : cluster [DBG] pgmap v12478: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:33.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:33 smithi191 bash[24992]: cluster 2024-08-31T09:07:32.441198+0000 mgr.a (mgr.14388) 18000 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:33 smithi163 bash[24253]: cluster 2024-08-31T09:07:32.441198+0000 mgr.a (mgr.14388) 18000 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:33 smithi027 bash[22610]: cluster 2024-08-31T09:07:32.441198+0000 mgr.a (mgr.14388) 18000 : cluster [DBG] pgmap v12479: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:35.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:35 smithi191 bash[24992]: cluster 2024-08-31T09:07:34.443472+0000 mgr.a (mgr.14388) 18001 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:35.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:35.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:35.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:35 smithi163 bash[24253]: cluster 2024-08-31T09:07:34.443472+0000 mgr.a (mgr.14388) 18001 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:35 smithi027 bash[22610]: cluster 2024-08-31T09:07:34.443472+0000 mgr.a (mgr.14388) 18001 : cluster [DBG] pgmap v12480: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:36.589 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:36.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:36.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:36.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:36.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:37 smithi191 bash[24992]: audit 2024-08-31T09:07:36.144479+0000 mgr.a (mgr.14388) 18002 : audit [DBG] from='client.387492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:37 smithi191 bash[24992]: cluster 2024-08-31T09:07:36.444011+0000 mgr.a (mgr.14388) 18003 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:37 smithi163 bash[24253]: audit 2024-08-31T09:07:36.144479+0000 mgr.a (mgr.14388) 18002 : audit [DBG] from='client.387492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:37 smithi163 bash[24253]: cluster 2024-08-31T09:07:36.444011+0000 mgr.a (mgr.14388) 18003 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:37 smithi027 bash[22610]: audit 2024-08-31T09:07:36.144479+0000 mgr.a (mgr.14388) 18002 : audit [DBG] from='client.387492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:37 smithi027 bash[22610]: cluster 2024-08-31T09:07:36.444011+0000 mgr.a (mgr.14388) 18003 : cluster [DBG] pgmap v12481: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:39 smithi191 bash[24992]: cluster 2024-08-31T09:07:38.446241+0000 mgr.a (mgr.14388) 18004 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:39 smithi163 bash[24253]: cluster 2024-08-31T09:07:38.446241+0000 mgr.a (mgr.14388) 18004 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:39 smithi027 bash[22610]: cluster 2024-08-31T09:07:38.446241+0000 mgr.a (mgr.14388) 18004 : cluster [DBG] pgmap v12482: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:41.591 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:41.591 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:41.592 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:41 smithi191 bash[24992]: cluster 2024-08-31T09:07:40.447045+0000 mgr.a (mgr.14388) 18005 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:41 smithi163 bash[24253]: cluster 2024-08-31T09:07:40.447045+0000 mgr.a (mgr.14388) 18005 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:41 smithi027 bash[22610]: cluster 2024-08-31T09:07:40.447045+0000 mgr.a (mgr.14388) 18005 : cluster [DBG] pgmap v12483: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:42.376 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:42.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:42.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:42.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:42.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:43.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:43 smithi191 bash[24992]: audit 2024-08-31T09:07:41.927077+0000 mgr.a (mgr.14388) 18006 : audit [DBG] from='client.387570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:43 smithi191 bash[24992]: cluster 2024-08-31T09:07:42.448005+0000 mgr.a (mgr.14388) 18007 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:43 smithi163 bash[24253]: audit 2024-08-31T09:07:41.927077+0000 mgr.a (mgr.14388) 18006 : audit [DBG] from='client.387570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:43.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:43 smithi163 bash[24253]: cluster 2024-08-31T09:07:42.448005+0000 mgr.a (mgr.14388) 18007 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:43 smithi027 bash[22610]: audit 2024-08-31T09:07:41.927077+0000 mgr.a (mgr.14388) 18006 : audit [DBG] from='client.387570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:43 smithi027 bash[22610]: cluster 2024-08-31T09:07:42.448005+0000 mgr.a (mgr.14388) 18007 : cluster [DBG] pgmap v12484: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:45 smithi191 bash[24992]: cluster 2024-08-31T09:07:44.450239+0000 mgr.a (mgr.14388) 18008 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:45 smithi163 bash[24253]: cluster 2024-08-31T09:07:44.450239+0000 mgr.a (mgr.14388) 18008 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:45 smithi027 bash[22610]: cluster 2024-08-31T09:07:44.450239+0000 mgr.a (mgr.14388) 18008 : cluster [DBG] pgmap v12485: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:07:47.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:47.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:47.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:47.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:47 smithi191 bash[24992]: cluster 2024-08-31T09:07:46.451009+0000 mgr.a (mgr.14388) 18009 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:47 smithi163 bash[24253]: cluster 2024-08-31T09:07:46.451009+0000 mgr.a (mgr.14388) 18009 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:47 smithi027 bash[22610]: cluster 2024-08-31T09:07:46.451009+0000 mgr.a (mgr.14388) 18009 : cluster [DBG] pgmap v12486: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:07:48.128 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:48.128 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:49 smithi191 bash[24992]: audit 2024-08-31T09:07:47.715980+0000 mgr.a (mgr.14388) 18010 : audit [DBG] from='client.387648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:49.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:49 smithi191 bash[24992]: cluster 2024-08-31T09:07:48.453792+0000 mgr.a (mgr.14388) 18011 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:07:49.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:49 smithi163 bash[24253]: audit 2024-08-31T09:07:47.715980+0000 mgr.a (mgr.14388) 18010 : audit [DBG] from='client.387648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:49.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:49 smithi163 bash[24253]: cluster 2024-08-31T09:07:48.453792+0000 mgr.a (mgr.14388) 18011 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:07:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:49 smithi027 bash[22610]: audit 2024-08-31T09:07:47.715980+0000 mgr.a (mgr.14388) 18010 : audit [DBG] from='client.387648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:49 smithi027 bash[22610]: cluster 2024-08-31T09:07:48.453792+0000 mgr.a (mgr.14388) 18011 : cluster [DBG] pgmap v12487: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:07:51.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:51 smithi191 bash[24992]: cluster 2024-08-31T09:07:50.454559+0000 mgr.a (mgr.14388) 18012 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:07:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:51 smithi191 bash[24992]: audit 2024-08-31T09:07:51.214983+0000 mon.a (mon.0) 3261 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:07:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:51 smithi163 bash[24253]: cluster 2024-08-31T09:07:50.454559+0000 mgr.a (mgr.14388) 18012 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:07:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:51 smithi163 bash[24253]: audit 2024-08-31T09:07:51.214983+0000 mon.a (mon.0) 3261 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:07:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:51 smithi027 bash[22610]: cluster 2024-08-31T09:07:50.454559+0000 mgr.a (mgr.14388) 18012 : cluster [DBG] pgmap v12488: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:07:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:51 smithi027 bash[22610]: audit 2024-08-31T09:07:51.214983+0000 mon.a (mon.0) 3261 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:07:52.802 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:52 smithi027 bash[22610]: audit 2024-08-31T09:07:52.040520+0000 mon.a (mon.0) 3262 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:07:52.802 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:52 smithi027 bash[22610]: audit 2024-08-31T09:07:52.042267+0000 mon.a (mon.0) 3263 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:07:52.802 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:52 smithi027 bash[22610]: audit 2024-08-31T09:07:52.052635+0000 mon.a (mon.0) 3264 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:07:52.803 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:52 smithi027 bash[22610]: audit 2024-08-31T09:07:52.057357+0000 mon.a (mon.0) 3265 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:07:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:52 smithi163 bash[24253]: audit 2024-08-31T09:07:52.040520+0000 mon.a (mon.0) 3262 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:07:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:52 smithi163 bash[24253]: audit 2024-08-31T09:07:52.042267+0000 mon.a (mon.0) 3263 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:07:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:52 smithi163 bash[24253]: audit 2024-08-31T09:07:52.052635+0000 mon.a (mon.0) 3264 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:07:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:52 smithi163 bash[24253]: audit 2024-08-31T09:07:52.057357+0000 mon.a (mon.0) 3265 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:07:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:52 smithi191 bash[24992]: audit 2024-08-31T09:07:52.040520+0000 mon.a (mon.0) 3262 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:07:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:52 smithi191 bash[24992]: audit 2024-08-31T09:07:52.042267+0000 mon.a (mon.0) 3263 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:07:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:52 smithi191 bash[24992]: audit 2024-08-31T09:07:52.052635+0000 mon.a (mon.0) 3264 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:07:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:52 smithi191 bash[24992]: audit 2024-08-31T09:07:52.057357+0000 mon.a (mon.0) 3265 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:07:53.129 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:53.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:53.130 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:53.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:07:52 smithi027 bash[22863]: debug 2024-08-31T09:07:52.795+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:07:53.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:07:52 smithi027 bash[22863]: debug 2024-08-31T09:07:52.799+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:07:53.867 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:53.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:53.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:53.867 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:53.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:53.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:53 smithi163 bash[24253]: audit 2024-08-31T09:07:52.059754+0000 mgr.a (mgr.14388) 18013 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:07:53.953 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:53 smithi163 bash[24253]: cluster 2024-08-31T09:07:52.455031+0000 mgr.a (mgr.14388) 18014 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:07:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:53 smithi027 bash[22610]: audit 2024-08-31T09:07:52.059754+0000 mgr.a (mgr.14388) 18013 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:07:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:53 smithi027 bash[22610]: cluster 2024-08-31T09:07:52.455031+0000 mgr.a (mgr.14388) 18014 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:07:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:53 smithi191 bash[24992]: audit 2024-08-31T09:07:52.059754+0000 mgr.a (mgr.14388) 18013 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:07:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:53 smithi191 bash[24992]: cluster 2024-08-31T09:07:52.455031+0000 mgr.a (mgr.14388) 18014 : cluster [DBG] pgmap v12489: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:07:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:54 smithi163 bash[24253]: audit 2024-08-31T09:07:52.802601+0000 mgr.a (mgr.14388) 18015 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:07:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:54 smithi163 bash[24253]: cephadm 2024-08-31T09:07:52.803802+0000 mgr.a (mgr.14388) 18016 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:07:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:54 smithi163 bash[24253]: audit 2024-08-31T09:07:53.451425+0000 mgr.a (mgr.14388) 18017 : audit [DBG] from='client.387834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:54 smithi027 bash[22610]: audit 2024-08-31T09:07:52.802601+0000 mgr.a (mgr.14388) 18015 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:07:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:54 smithi027 bash[22610]: cephadm 2024-08-31T09:07:52.803802+0000 mgr.a (mgr.14388) 18016 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:07:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:54 smithi027 bash[22610]: audit 2024-08-31T09:07:53.451425+0000 mgr.a (mgr.14388) 18017 : audit [DBG] from='client.387834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:54 smithi191 bash[24992]: audit 2024-08-31T09:07:52.802601+0000 mgr.a (mgr.14388) 18015 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:07:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:54 smithi191 bash[24992]: cephadm 2024-08-31T09:07:52.803802+0000 mgr.a (mgr.14388) 18016 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:07:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:54 smithi191 bash[24992]: audit 2024-08-31T09:07:53.451425+0000 mgr.a (mgr.14388) 18017 : audit [DBG] from='client.387834 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:55 smithi163 bash[24253]: cluster 2024-08-31T09:07:54.457690+0000 mgr.a (mgr.14388) 18018 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:55 smithi027 bash[22610]: cluster 2024-08-31T09:07:54.457690+0000 mgr.a (mgr.14388) 18018 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:55 smithi191 bash[24992]: cluster 2024-08-31T09:07:54.457690+0000 mgr.a (mgr.14388) 18018 : cluster [DBG] pgmap v12490: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:57 smithi163 bash[24253]: cluster 2024-08-31T09:07:56.458475+0000 mgr.a (mgr.14388) 18019 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:07:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:57 smithi027 bash[22610]: cluster 2024-08-31T09:07:56.458475+0000 mgr.a (mgr.14388) 18019 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:07:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:57 smithi191 bash[24992]: cluster 2024-08-31T09:07:56.458475+0000 mgr.a (mgr.14388) 18019 : cluster [DBG] pgmap v12491: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:07:58.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:07:58.869 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:07:58.869 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:07:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:58 smithi163 bash[24253]: cluster 2024-08-31T09:07:58.460384+0000 mgr.a (mgr.14388) 18020 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:58 smithi027 bash[22610]: cluster 2024-08-31T09:07:58.460384+0000 mgr.a (mgr.14388) 18020 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:58 smithi191 bash[24992]: cluster 2024-08-31T09:07:58.460384+0000 mgr.a (mgr.14388) 18020 : cluster [DBG] pgmap v12492: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:07:59.630 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:07:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:07:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:07:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:07:59.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:07:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:07:59 smithi163 bash[24253]: audit 2024-08-31T09:07:59.201391+0000 mgr.a (mgr.14388) 18021 : audit [DBG] from='client.387912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:07:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:07:59 smithi027 bash[22610]: audit 2024-08-31T09:07:59.201391+0000 mgr.a (mgr.14388) 18021 : audit [DBG] from='client.387912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:07:59 smithi191 bash[24992]: audit 2024-08-31T09:07:59.201391+0000 mgr.a (mgr.14388) 18021 : audit [DBG] from='client.387912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:00 smithi163 bash[24253]: cluster 2024-08-31T09:08:00.461451+0000 mgr.a (mgr.14388) 18022 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:08:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:00 smithi027 bash[22610]: cluster 2024-08-31T09:08:00.461451+0000 mgr.a (mgr.14388) 18022 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:08:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:00 smithi191 bash[24992]: cluster 2024-08-31T09:08:00.461451+0000 mgr.a (mgr.14388) 18022 : cluster [DBG] pgmap v12493: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:08:03.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:03 smithi191 bash[24992]: cluster 2024-08-31T09:08:02.462401+0000 mgr.a (mgr.14388) 18023 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:08:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:03 smithi163 bash[24253]: cluster 2024-08-31T09:08:02.462401+0000 mgr.a (mgr.14388) 18023 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:08:03.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:03 smithi027 bash[22610]: cluster 2024-08-31T09:08:02.462401+0000 mgr.a (mgr.14388) 18023 : cluster [DBG] pgmap v12494: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:08:04.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:08:04.632 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:08:04.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:08:05.401 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:08:05.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:08:05.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:08:05.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:08:05.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:08:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:05 smithi191 bash[24992]: cluster 2024-08-31T09:08:04.464787+0000 mgr.a (mgr.14388) 18024 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:08:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:05 smithi163 bash[24253]: cluster 2024-08-31T09:08:04.464787+0000 mgr.a (mgr.14388) 18024 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:08:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:05 smithi027 bash[22610]: cluster 2024-08-31T09:08:04.464787+0000 mgr.a (mgr.14388) 18024 : cluster [DBG] pgmap v12495: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:08:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:06 smithi191 bash[24992]: audit 2024-08-31T09:08:04.965847+0000 mgr.a (mgr.14388) 18025 : audit [DBG] from='client.387990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:06 smithi163 bash[24253]: audit 2024-08-31T09:08:04.965847+0000 mgr.a (mgr.14388) 18025 : audit [DBG] from='client.387990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:06 smithi027 bash[22610]: audit 2024-08-31T09:08:04.965847+0000 mgr.a (mgr.14388) 18025 : audit [DBG] from='client.387990 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:07 smithi191 bash[24992]: cluster 2024-08-31T09:08:06.465820+0000 mgr.a (mgr.14388) 18026 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:07 smithi163 bash[24253]: cluster 2024-08-31T09:08:06.465820+0000 mgr.a (mgr.14388) 18026 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:07 smithi027 bash[22610]: cluster 2024-08-31T09:08:06.465820+0000 mgr.a (mgr.14388) 18026 : cluster [DBG] pgmap v12496: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:09 smithi163 bash[24253]: cluster 2024-08-31T09:08:08.468133+0000 mgr.a (mgr.14388) 18027 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:09 smithi027 bash[22610]: cluster 2024-08-31T09:08:08.468133+0000 mgr.a (mgr.14388) 18027 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:09 smithi191 bash[24992]: cluster 2024-08-31T09:08:08.468133+0000 mgr.a (mgr.14388) 18027 : cluster [DBG] pgmap v12497: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:10.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:08:10.403 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:08:10.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:08:11.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:08:11.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:08:11.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:08:11.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:08:11.163 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:08:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:11 smithi163 bash[24253]: cluster 2024-08-31T09:08:10.469064+0000 mgr.a (mgr.14388) 18028 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:11 smithi027 bash[22610]: cluster 2024-08-31T09:08:10.469064+0000 mgr.a (mgr.14388) 18028 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:11 smithi191 bash[24992]: cluster 2024-08-31T09:08:10.469064+0000 mgr.a (mgr.14388) 18028 : cluster [DBG] pgmap v12498: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:12 smithi163 bash[24253]: audit 2024-08-31T09:08:10.747855+0000 mgr.a (mgr.14388) 18029 : audit [DBG] from='client.388068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:12 smithi027 bash[22610]: audit 2024-08-31T09:08:10.747855+0000 mgr.a (mgr.14388) 18029 : audit [DBG] from='client.388068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:12 smithi191 bash[24992]: audit 2024-08-31T09:08:10.747855+0000 mgr.a (mgr.14388) 18029 : audit [DBG] from='client.388068 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:13 smithi163 bash[24253]: cluster 2024-08-31T09:08:12.469985+0000 mgr.a (mgr.14388) 18030 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:13 smithi027 bash[22610]: cluster 2024-08-31T09:08:12.469985+0000 mgr.a (mgr.14388) 18030 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:13 smithi191 bash[24992]: cluster 2024-08-31T09:08:12.469985+0000 mgr.a (mgr.14388) 18030 : cluster [DBG] pgmap v12499: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:15 smithi163 bash[24253]: cluster 2024-08-31T09:08:14.472219+0000 mgr.a (mgr.14388) 18031 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:15 smithi027 bash[22610]: cluster 2024-08-31T09:08:14.472219+0000 mgr.a (mgr.14388) 18031 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:15 smithi191 bash[24992]: cluster 2024-08-31T09:08:14.472219+0000 mgr.a (mgr.14388) 18031 : cluster [DBG] pgmap v12500: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:16.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:08:16.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:08:16.165 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:08:16.929 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:08:16.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:08:16.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:08:16.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:08:16.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:08:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:17 smithi163 bash[24253]: cluster 2024-08-31T09:08:16.472962+0000 mgr.a (mgr.14388) 18032 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:17.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:17 smithi163 bash[24253]: audit 2024-08-31T09:08:16.499827+0000 mgr.a (mgr.14388) 18033 : audit [DBG] from='client.388143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:17 smithi027 bash[22610]: cluster 2024-08-31T09:08:16.472962+0000 mgr.a (mgr.14388) 18032 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:17 smithi027 bash[22610]: audit 2024-08-31T09:08:16.499827+0000 mgr.a (mgr.14388) 18033 : audit [DBG] from='client.388143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:17 smithi191 bash[24992]: cluster 2024-08-31T09:08:16.472962+0000 mgr.a (mgr.14388) 18032 : cluster [DBG] pgmap v12501: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:17 smithi191 bash[24992]: audit 2024-08-31T09:08:16.499827+0000 mgr.a (mgr.14388) 18033 : audit [DBG] from='client.388143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:18 smithi163 bash[24253]: cluster 2024-08-31T09:08:18.475221+0000 mgr.a (mgr.14388) 18034 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:18 smithi027 bash[22610]: cluster 2024-08-31T09:08:18.475221+0000 mgr.a (mgr.14388) 18034 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:18 smithi191 bash[24992]: cluster 2024-08-31T09:08:18.475221+0000 mgr.a (mgr.14388) 18034 : cluster [DBG] pgmap v12502: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:21 smithi191 bash[24992]: cluster 2024-08-31T09:08:20.476164+0000 mgr.a (mgr.14388) 18035 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:21.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:08:21.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:08:21.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:08:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:21 smithi163 bash[24253]: cluster 2024-08-31T09:08:20.476164+0000 mgr.a (mgr.14388) 18035 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:21 smithi027 bash[22610]: cluster 2024-08-31T09:08:20.476164+0000 mgr.a (mgr.14388) 18035 : cluster [DBG] pgmap v12503: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:22.701 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:08:22.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:08:22.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:08:22.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:08:22.702 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:08:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:23 smithi191 bash[24992]: audit 2024-08-31T09:08:22.266735+0000 mgr.a (mgr.14388) 18036 : audit [DBG] from='client.388215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:23 smithi191 bash[24992]: cluster 2024-08-31T09:08:22.476695+0000 mgr.a (mgr.14388) 18037 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:23 smithi163 bash[24253]: audit 2024-08-31T09:08:22.266735+0000 mgr.a (mgr.14388) 18036 : audit [DBG] from='client.388215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:23 smithi163 bash[24253]: cluster 2024-08-31T09:08:22.476695+0000 mgr.a (mgr.14388) 18037 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:23 smithi027 bash[22610]: audit 2024-08-31T09:08:22.266735+0000 mgr.a (mgr.14388) 18036 : audit [DBG] from='client.388215 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:23 smithi027 bash[22610]: cluster 2024-08-31T09:08:22.476695+0000 mgr.a (mgr.14388) 18037 : cluster [DBG] pgmap v12504: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:25 smithi163 bash[24253]: cluster 2024-08-31T09:08:24.479005+0000 mgr.a (mgr.14388) 18038 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:25 smithi027 bash[22610]: cluster 2024-08-31T09:08:24.479005+0000 mgr.a (mgr.14388) 18038 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:25 smithi191 bash[24992]: cluster 2024-08-31T09:08:24.479005+0000 mgr.a (mgr.14388) 18038 : cluster [DBG] pgmap v12505: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:27.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:08:27.704 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:08:27.704 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:08:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:27 smithi163 bash[24253]: cluster 2024-08-31T09:08:26.479789+0000 mgr.a (mgr.14388) 18039 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:27 smithi027 bash[22610]: cluster 2024-08-31T09:08:26.479789+0000 mgr.a (mgr.14388) 18039 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:27 smithi191 bash[24992]: cluster 2024-08-31T09:08:26.479789+0000 mgr.a (mgr.14388) 18039 : cluster [DBG] pgmap v12506: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:28.453 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:08:28.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:08:28.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:08:28.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:08:28.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:08:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:29 smithi163 bash[24253]: audit 2024-08-31T09:08:28.036123+0000 mgr.a (mgr.14388) 18040 : audit [DBG] from='client.388290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:29 smithi163 bash[24253]: cluster 2024-08-31T09:08:28.482389+0000 mgr.a (mgr.14388) 18041 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:29 smithi027 bash[22610]: audit 2024-08-31T09:08:28.036123+0000 mgr.a (mgr.14388) 18040 : audit [DBG] from='client.388290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:29 smithi027 bash[22610]: cluster 2024-08-31T09:08:28.482389+0000 mgr.a (mgr.14388) 18041 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:29 smithi191 bash[24992]: audit 2024-08-31T09:08:28.036123+0000 mgr.a (mgr.14388) 18040 : audit [DBG] from='client.388290 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:29 smithi191 bash[24992]: cluster 2024-08-31T09:08:28.482389+0000 mgr.a (mgr.14388) 18041 : cluster [DBG] pgmap v12507: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:31 smithi163 bash[24253]: cluster 2024-08-31T09:08:30.483182+0000 mgr.a (mgr.14388) 18042 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:08:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:31 smithi027 bash[22610]: cluster 2024-08-31T09:08:30.483182+0000 mgr.a (mgr.14388) 18042 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:08:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:31 smithi191 bash[24992]: cluster 2024-08-31T09:08:30.483182+0000 mgr.a (mgr.14388) 18042 : cluster [DBG] pgmap v12508: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:08:33.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:08:33.455 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:08:33.455 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:08:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:33 smithi163 bash[24253]: cluster 2024-08-31T09:08:32.483944+0000 mgr.a (mgr.14388) 18043 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:08:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:33 smithi027 bash[22610]: cluster 2024-08-31T09:08:32.483944+0000 mgr.a (mgr.14388) 18043 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:08:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:33 smithi191 bash[24992]: cluster 2024-08-31T09:08:32.483944+0000 mgr.a (mgr.14388) 18043 : cluster [DBG] pgmap v12509: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:08:34.200 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:08:34.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:08:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:35 smithi163 bash[24253]: audit 2024-08-31T09:08:33.787319+0000 mgr.a (mgr.14388) 18044 : audit [DBG] from='client.388365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:35 smithi163 bash[24253]: cluster 2024-08-31T09:08:34.486606+0000 mgr.a (mgr.14388) 18045 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:35 smithi027 bash[22610]: audit 2024-08-31T09:08:33.787319+0000 mgr.a (mgr.14388) 18044 : audit [DBG] from='client.388365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:35 smithi027 bash[22610]: cluster 2024-08-31T09:08:34.486606+0000 mgr.a (mgr.14388) 18045 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:35 smithi191 bash[24992]: audit 2024-08-31T09:08:33.787319+0000 mgr.a (mgr.14388) 18044 : audit [DBG] from='client.388365 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:35 smithi191 bash[24992]: cluster 2024-08-31T09:08:34.486606+0000 mgr.a (mgr.14388) 18045 : cluster [DBG] pgmap v12510: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:36 smithi163 bash[24253]: cluster 2024-08-31T09:08:36.487375+0000 mgr.a (mgr.14388) 18046 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:08:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:36 smithi027 bash[22610]: cluster 2024-08-31T09:08:36.487375+0000 mgr.a (mgr.14388) 18046 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:08:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:36 smithi191 bash[24992]: cluster 2024-08-31T09:08:36.487375+0000 mgr.a (mgr.14388) 18046 : cluster [DBG] pgmap v12511: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:08:39.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:08:39.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:08:39.203 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:08:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:39 smithi163 bash[24253]: cluster 2024-08-31T09:08:38.489266+0000 mgr.a (mgr.14388) 18047 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:39 smithi027 bash[22610]: cluster 2024-08-31T09:08:38.489266+0000 mgr.a (mgr.14388) 18047 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:39.985 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:08:39.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:08:39.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:08:39.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:08:39.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:08:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:39 smithi191 bash[24992]: cluster 2024-08-31T09:08:38.489266+0000 mgr.a (mgr.14388) 18047 : cluster [DBG] pgmap v12512: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:40 smithi163 bash[24253]: audit 2024-08-31T09:08:39.539494+0000 mgr.a (mgr.14388) 18048 : audit [DBG] from='client.388443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:40 smithi027 bash[22610]: audit 2024-08-31T09:08:39.539494+0000 mgr.a (mgr.14388) 18048 : audit [DBG] from='client.388443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:40 smithi191 bash[24992]: audit 2024-08-31T09:08:39.539494+0000 mgr.a (mgr.14388) 18048 : audit [DBG] from='client.388443 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:41 smithi163 bash[24253]: cluster 2024-08-31T09:08:40.490157+0000 mgr.a (mgr.14388) 18049 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:41 smithi027 bash[22610]: cluster 2024-08-31T09:08:40.490157+0000 mgr.a (mgr.14388) 18049 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:41 smithi191 bash[24992]: cluster 2024-08-31T09:08:40.490157+0000 mgr.a (mgr.14388) 18049 : cluster [DBG] pgmap v12513: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:43 smithi163 bash[24253]: cluster 2024-08-31T09:08:42.490977+0000 mgr.a (mgr.14388) 18050 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:43 smithi027 bash[22610]: cluster 2024-08-31T09:08:42.490977+0000 mgr.a (mgr.14388) 18050 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:43 smithi191 bash[24992]: cluster 2024-08-31T09:08:42.490977+0000 mgr.a (mgr.14388) 18050 : cluster [DBG] pgmap v12514: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:44.986 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:08:44.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:08:44.987 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:08:45.745 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:08:45.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:08:45.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:08:45.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:08:45.746 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:08:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:45 smithi163 bash[24253]: cluster 2024-08-31T09:08:44.493181+0000 mgr.a (mgr.14388) 18051 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:45 smithi027 bash[22610]: cluster 2024-08-31T09:08:44.493181+0000 mgr.a (mgr.14388) 18051 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:45 smithi191 bash[24992]: cluster 2024-08-31T09:08:44.493181+0000 mgr.a (mgr.14388) 18051 : cluster [DBG] pgmap v12515: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:46 smithi163 bash[24253]: audit 2024-08-31T09:08:45.318563+0000 mgr.a (mgr.14388) 18052 : audit [DBG] from='client.388521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:46 smithi027 bash[22610]: audit 2024-08-31T09:08:45.318563+0000 mgr.a (mgr.14388) 18052 : audit [DBG] from='client.388521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:46 smithi191 bash[24992]: audit 2024-08-31T09:08:45.318563+0000 mgr.a (mgr.14388) 18052 : audit [DBG] from='client.388521 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:47 smithi163 bash[24253]: cluster 2024-08-31T09:08:46.494051+0000 mgr.a (mgr.14388) 18053 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:47 smithi027 bash[22610]: cluster 2024-08-31T09:08:46.494051+0000 mgr.a (mgr.14388) 18053 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:47 smithi191 bash[24992]: cluster 2024-08-31T09:08:46.494051+0000 mgr.a (mgr.14388) 18053 : cluster [DBG] pgmap v12516: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:48 smithi163 bash[24253]: cluster 2024-08-31T09:08:48.496230+0000 mgr.a (mgr.14388) 18054 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:48 smithi027 bash[22610]: cluster 2024-08-31T09:08:48.496230+0000 mgr.a (mgr.14388) 18054 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:48 smithi191 bash[24992]: cluster 2024-08-31T09:08:48.496230+0000 mgr.a (mgr.14388) 18054 : cluster [DBG] pgmap v12517: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:50.747 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:08:50.748 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:08:50.748 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:08:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:08:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:08:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:08:51.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:08:51.487 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:08:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:51 smithi163 bash[24253]: cluster 2024-08-31T09:08:50.497007+0000 mgr.a (mgr.14388) 18055 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:51 smithi027 bash[22610]: cluster 2024-08-31T09:08:50.497007+0000 mgr.a (mgr.14388) 18055 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:51 smithi191 bash[24992]: cluster 2024-08-31T09:08:50.497007+0000 mgr.a (mgr.14388) 18055 : cluster [DBG] pgmap v12518: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:52 smithi163 bash[24253]: audit 2024-08-31T09:08:51.077562+0000 mgr.a (mgr.14388) 18056 : audit [DBG] from='client.388599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:52 smithi027 bash[22610]: audit 2024-08-31T09:08:51.077562+0000 mgr.a (mgr.14388) 18056 : audit [DBG] from='client.388599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:52 smithi191 bash[24992]: audit 2024-08-31T09:08:51.077562+0000 mgr.a (mgr.14388) 18056 : audit [DBG] from='client.388599 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:53 smithi163 bash[24253]: cluster 2024-08-31T09:08:52.497922+0000 mgr.a (mgr.14388) 18057 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:53 smithi163 bash[24253]: audit 2024-08-31T09:08:52.855367+0000 mon.a (mon.0) 3266 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:08:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:53 smithi027 bash[22610]: cluster 2024-08-31T09:08:52.497922+0000 mgr.a (mgr.14388) 18057 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:53 smithi027 bash[22610]: audit 2024-08-31T09:08:52.855367+0000 mon.a (mon.0) 3266 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:08:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:53 smithi191 bash[24992]: cluster 2024-08-31T09:08:52.497922+0000 mgr.a (mgr.14388) 18057 : cluster [DBG] pgmap v12519: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:53 smithi191 bash[24992]: audit 2024-08-31T09:08:52.855367+0000 mon.a (mon.0) 3266 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:08:54.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:08:54 smithi027 bash[22863]: debug 2024-08-31T09:08:54.465+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:08:54.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:08:54 smithi027 bash[22863]: debug 2024-08-31T09:08:54.469+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:08:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:54 smithi027 bash[22610]: audit 2024-08-31T09:08:53.698518+0000 mon.a (mon.0) 3267 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:08:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:54 smithi027 bash[22610]: audit 2024-08-31T09:08:53.700176+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:08:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:54 smithi027 bash[22610]: audit 2024-08-31T09:08:53.711891+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:08:54.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:54 smithi027 bash[22610]: audit 2024-08-31T09:08:53.717290+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:08:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:54 smithi163 bash[24253]: audit 2024-08-31T09:08:53.698518+0000 mon.a (mon.0) 3267 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:08:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:54 smithi163 bash[24253]: audit 2024-08-31T09:08:53.700176+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:08:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:54 smithi163 bash[24253]: audit 2024-08-31T09:08:53.711891+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:08:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:54 smithi163 bash[24253]: audit 2024-08-31T09:08:53.717290+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:08:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:54 smithi191 bash[24992]: audit 2024-08-31T09:08:53.698518+0000 mon.a (mon.0) 3267 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:08:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:54 smithi191 bash[24992]: audit 2024-08-31T09:08:53.700176+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:08:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:54 smithi191 bash[24992]: audit 2024-08-31T09:08:53.711891+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:08:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:54 smithi191 bash[24992]: audit 2024-08-31T09:08:53.717290+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:08:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:55 smithi163 bash[24253]: audit 2024-08-31T09:08:53.719828+0000 mgr.a (mgr.14388) 18058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:08:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:55 smithi163 bash[24253]: audit 2024-08-31T09:08:54.470432+0000 mgr.a (mgr.14388) 18059 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:08:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:55 smithi163 bash[24253]: cephadm 2024-08-31T09:08:54.472027+0000 mgr.a (mgr.14388) 18060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:08:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:55 smithi163 bash[24253]: cluster 2024-08-31T09:08:54.499913+0000 mgr.a (mgr.14388) 18061 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:55 smithi027 bash[22610]: audit 2024-08-31T09:08:53.719828+0000 mgr.a (mgr.14388) 18058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:08:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:55 smithi027 bash[22610]: audit 2024-08-31T09:08:54.470432+0000 mgr.a (mgr.14388) 18059 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:08:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:55 smithi027 bash[22610]: cephadm 2024-08-31T09:08:54.472027+0000 mgr.a (mgr.14388) 18060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:08:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:55 smithi027 bash[22610]: cluster 2024-08-31T09:08:54.499913+0000 mgr.a (mgr.14388) 18061 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:55 smithi191 bash[24992]: audit 2024-08-31T09:08:53.719828+0000 mgr.a (mgr.14388) 18058 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:08:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:55 smithi191 bash[24992]: audit 2024-08-31T09:08:54.470432+0000 mgr.a (mgr.14388) 18059 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:08:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:55 smithi191 bash[24992]: cephadm 2024-08-31T09:08:54.472027+0000 mgr.a (mgr.14388) 18060 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:08:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:55 smithi191 bash[24992]: cluster 2024-08-31T09:08:54.499913+0000 mgr.a (mgr.14388) 18061 : cluster [DBG] pgmap v12520: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:08:56.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:08:56.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:08:56.489 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:08:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:56 smithi163 bash[24253]: cluster 2024-08-31T09:08:56.500588+0000 mgr.a (mgr.14388) 18062 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:56 smithi027 bash[22610]: cluster 2024-08-31T09:08:56.500588+0000 mgr.a (mgr.14388) 18062 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:56 smithi191 bash[24992]: cluster 2024-08-31T09:08:56.500588+0000 mgr.a (mgr.14388) 18062 : cluster [DBG] pgmap v12521: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:08:57.274 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:08:57.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:08:57.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:08:57.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:08:57.274 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:08:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:57 smithi163 bash[24253]: audit 2024-08-31T09:08:56.825789+0000 mgr.a (mgr.14388) 18063 : audit [DBG] from='client.388785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:57 smithi027 bash[22610]: audit 2024-08-31T09:08:56.825789+0000 mgr.a (mgr.14388) 18063 : audit [DBG] from='client.388785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:57 smithi191 bash[24992]: audit 2024-08-31T09:08:56.825789+0000 mgr.a (mgr.14388) 18063 : audit [DBG] from='client.388785 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:08:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:08:58 smithi163 bash[24253]: cluster 2024-08-31T09:08:58.502811+0000 mgr.a (mgr.14388) 18064 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:08:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:08:58 smithi027 bash[22610]: cluster 2024-08-31T09:08:58.502811+0000 mgr.a (mgr.14388) 18064 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:08:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:08:58 smithi191 bash[24992]: cluster 2024-08-31T09:08:58.502811+0000 mgr.a (mgr.14388) 18064 : cluster [DBG] pgmap v12522: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:01 smithi163 bash[24253]: cluster 2024-08-31T09:09:00.503578+0000 mgr.a (mgr.14388) 18065 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:01 smithi027 bash[22610]: cluster 2024-08-31T09:09:00.503578+0000 mgr.a (mgr.14388) 18065 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:01 smithi191 bash[24992]: cluster 2024-08-31T09:09:00.503578+0000 mgr.a (mgr.14388) 18065 : cluster [DBG] pgmap v12523: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:02.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:09:02.276 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:09:02.276 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:09:03.025 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:09:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:09:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:09:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:09:03.026 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:09:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:03 smithi163 bash[24253]: cluster 2024-08-31T09:09:02.504283+0000 mgr.a (mgr.14388) 18066 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:03 smithi027 bash[22610]: cluster 2024-08-31T09:09:02.504283+0000 mgr.a (mgr.14388) 18066 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:03 smithi191 bash[24992]: cluster 2024-08-31T09:09:02.504283+0000 mgr.a (mgr.14388) 18066 : cluster [DBG] pgmap v12524: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:04 smithi163 bash[24253]: audit 2024-08-31T09:09:02.607729+0000 mgr.a (mgr.14388) 18067 : audit [DBG] from='client.388857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:04 smithi027 bash[22610]: audit 2024-08-31T09:09:02.607729+0000 mgr.a (mgr.14388) 18067 : audit [DBG] from='client.388857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:04 smithi191 bash[24992]: audit 2024-08-31T09:09:02.607729+0000 mgr.a (mgr.14388) 18067 : audit [DBG] from='client.388857 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:05 smithi163 bash[24253]: cluster 2024-08-31T09:09:04.506685+0000 mgr.a (mgr.14388) 18068 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:05 smithi027 bash[22610]: cluster 2024-08-31T09:09:04.506685+0000 mgr.a (mgr.14388) 18068 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:05 smithi191 bash[24992]: cluster 2024-08-31T09:09:04.506685+0000 mgr.a (mgr.14388) 18068 : cluster [DBG] pgmap v12525: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:06 smithi163 bash[24253]: cluster 2024-08-31T09:09:06.507562+0000 mgr.a (mgr.14388) 18069 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:09:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:06 smithi027 bash[22610]: cluster 2024-08-31T09:09:06.507562+0000 mgr.a (mgr.14388) 18069 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:09:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:06 smithi191 bash[24992]: cluster 2024-08-31T09:09:06.507562+0000 mgr.a (mgr.14388) 18069 : cluster [DBG] pgmap v12526: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:09:08.027 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:09:08.028 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:09:08.028 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:09:08.793 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:09:08.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:09:08.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:09:08.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:09:08.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:09:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:09 smithi163 bash[24253]: audit 2024-08-31T09:09:08.361184+0000 mgr.a (mgr.14388) 18070 : audit [DBG] from='client.388935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:09 smithi163 bash[24253]: cluster 2024-08-31T09:09:08.509013+0000 mgr.a (mgr.14388) 18071 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:09 smithi027 bash[22610]: audit 2024-08-31T09:09:08.361184+0000 mgr.a (mgr.14388) 18070 : audit [DBG] from='client.388935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:09 smithi027 bash[22610]: cluster 2024-08-31T09:09:08.509013+0000 mgr.a (mgr.14388) 18071 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:09 smithi191 bash[24992]: audit 2024-08-31T09:09:08.361184+0000 mgr.a (mgr.14388) 18070 : audit [DBG] from='client.388935 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:09 smithi191 bash[24992]: cluster 2024-08-31T09:09:08.509013+0000 mgr.a (mgr.14388) 18071 : cluster [DBG] pgmap v12527: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:11 smithi163 bash[24253]: cluster 2024-08-31T09:09:10.509976+0000 mgr.a (mgr.14388) 18072 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:09:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:11 smithi027 bash[22610]: cluster 2024-08-31T09:09:10.509976+0000 mgr.a (mgr.14388) 18072 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:09:12.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:11 smithi191 bash[24992]: cluster 2024-08-31T09:09:10.509976+0000 mgr.a (mgr.14388) 18072 : cluster [DBG] pgmap v12528: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:09:13.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:09:13.795 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:09:13.795 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:09:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:13 smithi163 bash[24253]: cluster 2024-08-31T09:09:12.510791+0000 mgr.a (mgr.14388) 18073 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:09:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:13 smithi027 bash[22610]: cluster 2024-08-31T09:09:12.510791+0000 mgr.a (mgr.14388) 18073 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:09:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:13 smithi191 bash[24992]: cluster 2024-08-31T09:09:12.510791+0000 mgr.a (mgr.14388) 18073 : cluster [DBG] pgmap v12529: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:09:14.550 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:09:14.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:09:14.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:09:14.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:09:14.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:09:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:14 smithi163 bash[24253]: audit 2024-08-31T09:09:14.128076+0000 mgr.a (mgr.14388) 18074 : audit [DBG] from='client.389010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:14 smithi163 bash[24253]: cluster 2024-08-31T09:09:14.512182+0000 mgr.a (mgr.14388) 18075 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:14 smithi027 bash[22610]: audit 2024-08-31T09:09:14.128076+0000 mgr.a (mgr.14388) 18074 : audit [DBG] from='client.389010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:14 smithi027 bash[22610]: cluster 2024-08-31T09:09:14.512182+0000 mgr.a (mgr.14388) 18075 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:14 smithi191 bash[24992]: audit 2024-08-31T09:09:14.128076+0000 mgr.a (mgr.14388) 18074 : audit [DBG] from='client.389010 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:14 smithi191 bash[24992]: cluster 2024-08-31T09:09:14.512182+0000 mgr.a (mgr.14388) 18075 : cluster [DBG] pgmap v12530: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:17.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:17 smithi163 bash[24253]: cluster 2024-08-31T09:09:16.512934+0000 mgr.a (mgr.14388) 18076 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:09:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:17 smithi027 bash[22610]: cluster 2024-08-31T09:09:16.512934+0000 mgr.a (mgr.14388) 18076 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:09:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:17 smithi191 bash[24992]: cluster 2024-08-31T09:09:16.512934+0000 mgr.a (mgr.14388) 18076 : cluster [DBG] pgmap v12531: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:09:19.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:09:19.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:09:19.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:09:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:19 smithi163 bash[24253]: cluster 2024-08-31T09:09:18.514874+0000 mgr.a (mgr.14388) 18077 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:09:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:19 smithi027 bash[22610]: cluster 2024-08-31T09:09:18.514874+0000 mgr.a (mgr.14388) 18077 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:09:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:19 smithi191 bash[24992]: cluster 2024-08-31T09:09:18.514874+0000 mgr.a (mgr.14388) 18077 : cluster [DBG] pgmap v12532: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:09:20.305 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:09:20.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:09:20.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:09:20.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:09:20.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:09:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:20 smithi163 bash[24253]: audit 2024-08-31T09:09:19.889084+0000 mgr.a (mgr.14388) 18078 : audit [DBG] from='client.389088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:20 smithi163 bash[24253]: cluster 2024-08-31T09:09:20.515817+0000 mgr.a (mgr.14388) 18079 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:20 smithi027 bash[22610]: audit 2024-08-31T09:09:19.889084+0000 mgr.a (mgr.14388) 18078 : audit [DBG] from='client.389088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:20 smithi027 bash[22610]: cluster 2024-08-31T09:09:20.515817+0000 mgr.a (mgr.14388) 18079 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:20 smithi191 bash[24992]: audit 2024-08-31T09:09:19.889084+0000 mgr.a (mgr.14388) 18078 : audit [DBG] from='client.389088 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:20 smithi191 bash[24992]: cluster 2024-08-31T09:09:20.515817+0000 mgr.a (mgr.14388) 18079 : cluster [DBG] pgmap v12533: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:23 smithi163 bash[24253]: cluster 2024-08-31T09:09:22.516633+0000 mgr.a (mgr.14388) 18080 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:23 smithi027 bash[22610]: cluster 2024-08-31T09:09:22.516633+0000 mgr.a (mgr.14388) 18080 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:23 smithi191 bash[24992]: cluster 2024-08-31T09:09:22.516633+0000 mgr.a (mgr.14388) 18080 : cluster [DBG] pgmap v12534: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:24 smithi163 bash[24253]: cluster 2024-08-31T09:09:24.518924+0000 mgr.a (mgr.14388) 18081 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:24 smithi027 bash[22610]: cluster 2024-08-31T09:09:24.518924+0000 mgr.a (mgr.14388) 18081 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:24 smithi191 bash[24992]: cluster 2024-08-31T09:09:24.518924+0000 mgr.a (mgr.14388) 18081 : cluster [DBG] pgmap v12535: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:25.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:09:25.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:09:25.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:09:26.094 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:09:26.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:09:26.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:09:26.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:09:26.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:09:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:27 smithi163 bash[24253]: audit 2024-08-31T09:09:25.642592+0000 mgr.a (mgr.14388) 18082 : audit [DBG] from='client.389166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:27 smithi163 bash[24253]: cluster 2024-08-31T09:09:26.519919+0000 mgr.a (mgr.14388) 18083 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:27 smithi027 bash[22610]: audit 2024-08-31T09:09:25.642592+0000 mgr.a (mgr.14388) 18082 : audit [DBG] from='client.389166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:27 smithi027 bash[22610]: cluster 2024-08-31T09:09:26.519919+0000 mgr.a (mgr.14388) 18083 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:27 smithi191 bash[24992]: audit 2024-08-31T09:09:25.642592+0000 mgr.a (mgr.14388) 18082 : audit [DBG] from='client.389166 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:27 smithi191 bash[24992]: cluster 2024-08-31T09:09:26.519919+0000 mgr.a (mgr.14388) 18083 : cluster [DBG] pgmap v12536: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:28 smithi163 bash[24253]: cluster 2024-08-31T09:09:28.522118+0000 mgr.a (mgr.14388) 18084 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:28 smithi027 bash[22610]: cluster 2024-08-31T09:09:28.522118+0000 mgr.a (mgr.14388) 18084 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:28 smithi191 bash[24992]: cluster 2024-08-31T09:09:28.522118+0000 mgr.a (mgr.14388) 18084 : cluster [DBG] pgmap v12537: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:30 smithi163 bash[24253]: cluster 2024-08-31T09:09:30.522918+0000 mgr.a (mgr.14388) 18085 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:30 smithi027 bash[22610]: cluster 2024-08-31T09:09:30.522918+0000 mgr.a (mgr.14388) 18085 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:30 smithi191 bash[24992]: cluster 2024-08-31T09:09:30.522918+0000 mgr.a (mgr.14388) 18085 : cluster [DBG] pgmap v12538: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:31.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:09:31.096 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:09:31.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:09:31.882 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:09:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:09:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:09:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:09:31.882 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:09:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:31 smithi163 bash[24253]: audit 2024-08-31T09:09:31.436945+0000 mgr.a (mgr.14388) 18086 : audit [DBG] from='client.389244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:31 smithi027 bash[22610]: audit 2024-08-31T09:09:31.436945+0000 mgr.a (mgr.14388) 18086 : audit [DBG] from='client.389244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:31 smithi191 bash[24992]: audit 2024-08-31T09:09:31.436945+0000 mgr.a (mgr.14388) 18086 : audit [DBG] from='client.389244 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:32 smithi163 bash[24253]: cluster 2024-08-31T09:09:32.523909+0000 mgr.a (mgr.14388) 18087 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:32 smithi027 bash[22610]: cluster 2024-08-31T09:09:32.523909+0000 mgr.a (mgr.14388) 18087 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:32 smithi191 bash[24992]: cluster 2024-08-31T09:09:32.523909+0000 mgr.a (mgr.14388) 18087 : cluster [DBG] pgmap v12539: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:34 smithi163 bash[24253]: cluster 2024-08-31T09:09:34.526119+0000 mgr.a (mgr.14388) 18088 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:34 smithi027 bash[22610]: cluster 2024-08-31T09:09:34.526119+0000 mgr.a (mgr.14388) 18088 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:34 smithi191 bash[24992]: cluster 2024-08-31T09:09:34.526119+0000 mgr.a (mgr.14388) 18088 : cluster [DBG] pgmap v12540: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:36.883 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:09:36.884 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:09:36.884 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:09:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:36 smithi163 bash[24253]: cluster 2024-08-31T09:09:36.526926+0000 mgr.a (mgr.14388) 18089 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:36 smithi027 bash[22610]: cluster 2024-08-31T09:09:36.526926+0000 mgr.a (mgr.14388) 18089 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:36 smithi191 bash[24992]: cluster 2024-08-31T09:09:36.526926+0000 mgr.a (mgr.14388) 18089 : cluster [DBG] pgmap v12541: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:37.643 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:09:37.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:09:37.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:09:37.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:09:37.643 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:09:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:37 smithi163 bash[24253]: audit 2024-08-31T09:09:37.218194+0000 mgr.a (mgr.14388) 18090 : audit [DBG] from='client.389322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:37 smithi027 bash[22610]: audit 2024-08-31T09:09:37.218194+0000 mgr.a (mgr.14388) 18090 : audit [DBG] from='client.389322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:37 smithi191 bash[24992]: audit 2024-08-31T09:09:37.218194+0000 mgr.a (mgr.14388) 18090 : audit [DBG] from='client.389322 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:38 smithi163 bash[24253]: cluster 2024-08-31T09:09:38.529214+0000 mgr.a (mgr.14388) 18091 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:38 smithi027 bash[22610]: cluster 2024-08-31T09:09:38.529214+0000 mgr.a (mgr.14388) 18091 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:38 smithi191 bash[24992]: cluster 2024-08-31T09:09:38.529214+0000 mgr.a (mgr.14388) 18091 : cluster [DBG] pgmap v12542: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:09:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:40 smithi163 bash[24253]: cluster 2024-08-31T09:09:40.529992+0000 mgr.a (mgr.14388) 18092 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:40 smithi027 bash[22610]: cluster 2024-08-31T09:09:40.529992+0000 mgr.a (mgr.14388) 18092 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:40 smithi191 bash[24992]: cluster 2024-08-31T09:09:40.529992+0000 mgr.a (mgr.14388) 18092 : cluster [DBG] pgmap v12543: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:42.644 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:09:42.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:09:42.645 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:09:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:42 smithi163 bash[24253]: cluster 2024-08-31T09:09:42.530763+0000 mgr.a (mgr.14388) 18093 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:42 smithi027 bash[22610]: cluster 2024-08-31T09:09:42.530763+0000 mgr.a (mgr.14388) 18093 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:42 smithi191 bash[24992]: cluster 2024-08-31T09:09:42.530763+0000 mgr.a (mgr.14388) 18093 : cluster [DBG] pgmap v12544: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:43.421 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:09:43.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:09:43.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:09:43.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:09:43.422 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:09:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:43 smithi163 bash[24253]: audit 2024-08-31T09:09:42.979507+0000 mgr.a (mgr.14388) 18094 : audit [DBG] from='client.389397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:43 smithi027 bash[22610]: audit 2024-08-31T09:09:42.979507+0000 mgr.a (mgr.14388) 18094 : audit [DBG] from='client.389397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:43 smithi191 bash[24992]: audit 2024-08-31T09:09:42.979507+0000 mgr.a (mgr.14388) 18094 : audit [DBG] from='client.389397 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:44 smithi163 bash[24253]: cluster 2024-08-31T09:09:44.533610+0000 mgr.a (mgr.14388) 18095 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:44 smithi027 bash[22610]: cluster 2024-08-31T09:09:44.533610+0000 mgr.a (mgr.14388) 18095 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:44 smithi191 bash[24992]: cluster 2024-08-31T09:09:44.533610+0000 mgr.a (mgr.14388) 18095 : cluster [DBG] pgmap v12545: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:46 smithi163 bash[24253]: cluster 2024-08-31T09:09:46.534446+0000 mgr.a (mgr.14388) 18096 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:09:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:46 smithi027 bash[22610]: cluster 2024-08-31T09:09:46.534446+0000 mgr.a (mgr.14388) 18096 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:09:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:46 smithi191 bash[24992]: cluster 2024-08-31T09:09:46.534446+0000 mgr.a (mgr.14388) 18096 : cluster [DBG] pgmap v12546: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:09:48.423 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:09:48.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:09:48.424 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:09:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:48 smithi163 bash[24253]: cluster 2024-08-31T09:09:48.535798+0000 mgr.a (mgr.14388) 18097 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:48 smithi027 bash[22610]: cluster 2024-08-31T09:09:48.535798+0000 mgr.a (mgr.14388) 18097 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:48 smithi191 bash[24992]: cluster 2024-08-31T09:09:48.535798+0000 mgr.a (mgr.14388) 18097 : cluster [DBG] pgmap v12547: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:49.210 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:09:49.210 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:09:49.210 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:09:49.210 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:09:49.210 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:09:49.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:49 smithi163 bash[24253]: audit 2024-08-31T09:09:48.761867+0000 mgr.a (mgr.14388) 18098 : audit [DBG] from='client.389472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:49 smithi027 bash[22610]: audit 2024-08-31T09:09:48.761867+0000 mgr.a (mgr.14388) 18098 : audit [DBG] from='client.389472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:49 smithi191 bash[24992]: audit 2024-08-31T09:09:48.761867+0000 mgr.a (mgr.14388) 18098 : audit [DBG] from='client.389472 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:50 smithi163 bash[24253]: cluster 2024-08-31T09:09:50.536870+0000 mgr.a (mgr.14388) 18099 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:09:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:50 smithi027 bash[22610]: cluster 2024-08-31T09:09:50.536870+0000 mgr.a (mgr.14388) 18099 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:09:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:50 smithi191 bash[24992]: cluster 2024-08-31T09:09:50.536870+0000 mgr.a (mgr.14388) 18099 : cluster [DBG] pgmap v12548: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:09:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:52 smithi163 bash[24253]: cluster 2024-08-31T09:09:52.537693+0000 mgr.a (mgr.14388) 18100 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:09:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:52 smithi027 bash[22610]: cluster 2024-08-31T09:09:52.537693+0000 mgr.a (mgr.14388) 18100 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:09:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:52 smithi191 bash[24992]: cluster 2024-08-31T09:09:52.537693+0000 mgr.a (mgr.14388) 18100 : cluster [DBG] pgmap v12549: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:09:54.211 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:09:54.212 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:09:54.212 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:09:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:54 smithi163 bash[24253]: audit 2024-08-31T09:09:54.528965+0000 mon.a (mon.0) 3271 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:09:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:54 smithi027 bash[22610]: audit 2024-08-31T09:09:54.528965+0000 mon.a (mon.0) 3271 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:09:55.000 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:09:55.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:09:55.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:09:55.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:09:55.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:09:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:54 smithi191 bash[24992]: audit 2024-08-31T09:09:54.528965+0000 mon.a (mon.0) 3271 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:09:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:55 smithi163 bash[24253]: cluster 2024-08-31T09:09:54.540674+0000 mgr.a (mgr.14388) 18101 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:55 smithi163 bash[24253]: audit 2024-08-31T09:09:54.547865+0000 mgr.a (mgr.14388) 18102 : audit [DBG] from='client.389550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:55 smithi163 bash[24253]: audit 2024-08-31T09:09:55.377476+0000 mon.a (mon.0) 3272 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:09:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:55 smithi163 bash[24253]: audit 2024-08-31T09:09:55.379450+0000 mon.a (mon.0) 3273 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:09:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:55 smithi163 bash[24253]: audit 2024-08-31T09:09:55.389869+0000 mon.a (mon.0) 3274 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:09:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:55 smithi163 bash[24253]: audit 2024-08-31T09:09:55.394705+0000 mon.a (mon.0) 3275 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:09:55.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:55 smithi163 bash[24253]: audit 2024-08-31T09:09:55.397137+0000 mgr.a (mgr.14388) 18103 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:09:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:55 smithi027 bash[22610]: cluster 2024-08-31T09:09:54.540674+0000 mgr.a (mgr.14388) 18101 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:55 smithi027 bash[22610]: audit 2024-08-31T09:09:54.547865+0000 mgr.a (mgr.14388) 18102 : audit [DBG] from='client.389550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:55 smithi027 bash[22610]: audit 2024-08-31T09:09:55.377476+0000 mon.a (mon.0) 3272 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:09:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:55 smithi027 bash[22610]: audit 2024-08-31T09:09:55.379450+0000 mon.a (mon.0) 3273 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:09:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:55 smithi027 bash[22610]: audit 2024-08-31T09:09:55.389869+0000 mon.a (mon.0) 3274 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:09:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:55 smithi027 bash[22610]: audit 2024-08-31T09:09:55.394705+0000 mon.a (mon.0) 3275 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:09:55.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:55 smithi027 bash[22610]: audit 2024-08-31T09:09:55.397137+0000 mgr.a (mgr.14388) 18103 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:09:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:55 smithi191 bash[24992]: cluster 2024-08-31T09:09:54.540674+0000 mgr.a (mgr.14388) 18101 : cluster [DBG] pgmap v12550: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:55 smithi191 bash[24992]: audit 2024-08-31T09:09:54.547865+0000 mgr.a (mgr.14388) 18102 : audit [DBG] from='client.389550 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:09:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:55 smithi191 bash[24992]: audit 2024-08-31T09:09:55.377476+0000 mon.a (mon.0) 3272 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:09:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:55 smithi191 bash[24992]: audit 2024-08-31T09:09:55.379450+0000 mon.a (mon.0) 3273 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:09:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:55 smithi191 bash[24992]: audit 2024-08-31T09:09:55.389869+0000 mon.a (mon.0) 3274 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:09:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:55 smithi191 bash[24992]: audit 2024-08-31T09:09:55.394705+0000 mon.a (mon.0) 3275 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:09:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:55 smithi191 bash[24992]: audit 2024-08-31T09:09:55.397137+0000 mgr.a (mgr.14388) 18103 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:09:56.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:09:56 smithi027 bash[22863]: debug 2024-08-31T09:09:56.132+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:09:56.484 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:09:56 smithi027 bash[22863]: debug 2024-08-31T09:09:56.136+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:09:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:56 smithi163 bash[24253]: audit 2024-08-31T09:09:56.137280+0000 mgr.a (mgr.14388) 18104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:09:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:56 smithi163 bash[24253]: cephadm 2024-08-31T09:09:56.138938+0000 mgr.a (mgr.14388) 18105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:09:56.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:56 smithi163 bash[24253]: cluster 2024-08-31T09:09:56.541679+0000 mgr.a (mgr.14388) 18106 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:56 smithi027 bash[22610]: audit 2024-08-31T09:09:56.137280+0000 mgr.a (mgr.14388) 18104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:09:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:56 smithi027 bash[22610]: cephadm 2024-08-31T09:09:56.138938+0000 mgr.a (mgr.14388) 18105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:09:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:56 smithi027 bash[22610]: cluster 2024-08-31T09:09:56.541679+0000 mgr.a (mgr.14388) 18106 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:56 smithi191 bash[24992]: audit 2024-08-31T09:09:56.137280+0000 mgr.a (mgr.14388) 18104 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:09:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:56 smithi191 bash[24992]: cephadm 2024-08-31T09:09:56.138938+0000 mgr.a (mgr.14388) 18105 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:09:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:56 smithi191 bash[24992]: cluster 2024-08-31T09:09:56.541679+0000 mgr.a (mgr.14388) 18106 : cluster [DBG] pgmap v12551: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:09:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:09:58 smithi163 bash[24253]: cluster 2024-08-31T09:09:58.543870+0000 mgr.a (mgr.14388) 18107 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:09:58 smithi027 bash[22610]: cluster 2024-08-31T09:09:58.543870+0000 mgr.a (mgr.14388) 18107 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:09:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:09:58 smithi191 bash[24992]: cluster 2024-08-31T09:09:58.543870+0000 mgr.a (mgr.14388) 18107 : cluster [DBG] pgmap v12552: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:00.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:00.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:00.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:00 smithi163 bash[24253]: cluster 2024-08-31T09:10:00.000149+0000 mon.a (mon.0) 3276 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:10:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:00 smithi027 bash[22610]: cluster 2024-08-31T09:10:00.000149+0000 mon.a (mon.0) 3276 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:10:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:00 smithi191 bash[24992]: cluster 2024-08-31T09:10:00.000149+0000 mon.a (mon.0) 3276 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:10:00.760 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:00.760 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:00.760 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:00.760 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:00.760 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:01 smithi163 bash[24253]: audit 2024-08-31T09:10:00.334536+0000 mgr.a (mgr.14388) 18108 : audit [DBG] from='client.389733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:01 smithi163 bash[24253]: cluster 2024-08-31T09:10:00.544401+0000 mgr.a (mgr.14388) 18109 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:01 smithi027 bash[22610]: audit 2024-08-31T09:10:00.334536+0000 mgr.a (mgr.14388) 18108 : audit [DBG] from='client.389733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:01 smithi027 bash[22610]: cluster 2024-08-31T09:10:00.544401+0000 mgr.a (mgr.14388) 18109 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:01 smithi191 bash[24992]: audit 2024-08-31T09:10:00.334536+0000 mgr.a (mgr.14388) 18108 : audit [DBG] from='client.389733 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:01.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:01 smithi191 bash[24992]: cluster 2024-08-31T09:10:00.544401+0000 mgr.a (mgr.14388) 18109 : cluster [DBG] pgmap v12553: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:02 smithi163 bash[24253]: cluster 2024-08-31T09:10:02.545261+0000 mgr.a (mgr.14388) 18110 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:02 smithi027 bash[22610]: cluster 2024-08-31T09:10:02.545261+0000 mgr.a (mgr.14388) 18110 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:02 smithi191 bash[24992]: cluster 2024-08-31T09:10:02.545261+0000 mgr.a (mgr.14388) 18110 : cluster [DBG] pgmap v12554: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:04 smithi163 bash[24253]: cluster 2024-08-31T09:10:04.547505+0000 mgr.a (mgr.14388) 18111 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:04 smithi027 bash[22610]: cluster 2024-08-31T09:10:04.547505+0000 mgr.a (mgr.14388) 18111 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:04 smithi191 bash[24992]: cluster 2024-08-31T09:10:04.547505+0000 mgr.a (mgr.14388) 18111 : cluster [DBG] pgmap v12555: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:05.762 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:05.762 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:05.763 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:06.517 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:06.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:06.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:06.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:06.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:06 smithi163 bash[24253]: audit 2024-08-31T09:10:06.094087+0000 mgr.a (mgr.14388) 18112 : audit [DBG] from='client.389811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:06 smithi163 bash[24253]: cluster 2024-08-31T09:10:06.548386+0000 mgr.a (mgr.14388) 18113 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:06 smithi027 bash[22610]: audit 2024-08-31T09:10:06.094087+0000 mgr.a (mgr.14388) 18112 : audit [DBG] from='client.389811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:06 smithi027 bash[22610]: cluster 2024-08-31T09:10:06.548386+0000 mgr.a (mgr.14388) 18113 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:06 smithi191 bash[24992]: audit 2024-08-31T09:10:06.094087+0000 mgr.a (mgr.14388) 18112 : audit [DBG] from='client.389811 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:06 smithi191 bash[24992]: cluster 2024-08-31T09:10:06.548386+0000 mgr.a (mgr.14388) 18113 : cluster [DBG] pgmap v12556: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:08 smithi163 bash[24253]: cluster 2024-08-31T09:10:08.550527+0000 mgr.a (mgr.14388) 18114 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:08 smithi027 bash[22610]: cluster 2024-08-31T09:10:08.550527+0000 mgr.a (mgr.14388) 18114 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:08 smithi191 bash[24992]: cluster 2024-08-31T09:10:08.550527+0000 mgr.a (mgr.14388) 18114 : cluster [DBG] pgmap v12557: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:10 smithi163 bash[24253]: cluster 2024-08-31T09:10:10.551293+0000 mgr.a (mgr.14388) 18115 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:10 smithi027 bash[22610]: cluster 2024-08-31T09:10:10.551293+0000 mgr.a (mgr.14388) 18115 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:10 smithi191 bash[24992]: cluster 2024-08-31T09:10:10.551293+0000 mgr.a (mgr.14388) 18115 : cluster [DBG] pgmap v12558: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:11.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:11.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:11.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:12.305 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:12.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:12.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:12.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:12.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:12 smithi163 bash[24253]: audit 2024-08-31T09:10:11.858910+0000 mgr.a (mgr.14388) 18116 : audit [DBG] from='client.389886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:12.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:12 smithi163 bash[24253]: cluster 2024-08-31T09:10:12.552279+0000 mgr.a (mgr.14388) 18117 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:12 smithi027 bash[22610]: audit 2024-08-31T09:10:11.858910+0000 mgr.a (mgr.14388) 18116 : audit [DBG] from='client.389886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:12 smithi027 bash[22610]: cluster 2024-08-31T09:10:12.552279+0000 mgr.a (mgr.14388) 18117 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:12 smithi191 bash[24992]: audit 2024-08-31T09:10:11.858910+0000 mgr.a (mgr.14388) 18116 : audit [DBG] from='client.389886 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:12 smithi191 bash[24992]: cluster 2024-08-31T09:10:12.552279+0000 mgr.a (mgr.14388) 18117 : cluster [DBG] pgmap v12559: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:14 smithi163 bash[24253]: cluster 2024-08-31T09:10:14.554475+0000 mgr.a (mgr.14388) 18118 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:14 smithi027 bash[22610]: cluster 2024-08-31T09:10:14.554475+0000 mgr.a (mgr.14388) 18118 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:14 smithi191 bash[24992]: cluster 2024-08-31T09:10:14.554475+0000 mgr.a (mgr.14388) 18118 : cluster [DBG] pgmap v12560: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:16 smithi163 bash[24253]: cluster 2024-08-31T09:10:16.555249+0000 mgr.a (mgr.14388) 18119 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:16 smithi027 bash[22610]: cluster 2024-08-31T09:10:16.555249+0000 mgr.a (mgr.14388) 18119 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:16 smithi191 bash[24992]: cluster 2024-08-31T09:10:16.555249+0000 mgr.a (mgr.14388) 18119 : cluster [DBG] pgmap v12561: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:17.306 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:17.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:17.307 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:18.090 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:18.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:18.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:18.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:18.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:18 smithi163 bash[24253]: audit 2024-08-31T09:10:17.643492+0000 mgr.a (mgr.14388) 18120 : audit [DBG] from='client.389961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:18 smithi163 bash[24253]: cluster 2024-08-31T09:10:18.557652+0000 mgr.a (mgr.14388) 18121 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:10:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:18 smithi027 bash[22610]: audit 2024-08-31T09:10:17.643492+0000 mgr.a (mgr.14388) 18120 : audit [DBG] from='client.389961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:18 smithi027 bash[22610]: cluster 2024-08-31T09:10:18.557652+0000 mgr.a (mgr.14388) 18121 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:10:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:18 smithi191 bash[24992]: audit 2024-08-31T09:10:17.643492+0000 mgr.a (mgr.14388) 18120 : audit [DBG] from='client.389961 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:18 smithi191 bash[24992]: cluster 2024-08-31T09:10:18.557652+0000 mgr.a (mgr.14388) 18121 : cluster [DBG] pgmap v12562: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:10:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:20 smithi163 bash[24253]: cluster 2024-08-31T09:10:20.558463+0000 mgr.a (mgr.14388) 18122 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:10:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:20 smithi027 bash[22610]: cluster 2024-08-31T09:10:20.558463+0000 mgr.a (mgr.14388) 18122 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:10:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:20 smithi191 bash[24992]: cluster 2024-08-31T09:10:20.558463+0000 mgr.a (mgr.14388) 18122 : cluster [DBG] pgmap v12563: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:10:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:22 smithi163 bash[24253]: cluster 2024-08-31T09:10:22.559267+0000 mgr.a (mgr.14388) 18123 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:10:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:22 smithi027 bash[22610]: cluster 2024-08-31T09:10:22.559267+0000 mgr.a (mgr.14388) 18123 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:10:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:22 smithi191 bash[24992]: cluster 2024-08-31T09:10:22.559267+0000 mgr.a (mgr.14388) 18123 : cluster [DBG] pgmap v12564: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:10:23.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:23.092 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:23.093 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:23.890 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:23.891 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:23 smithi163 bash[24253]: audit 2024-08-31T09:10:23.427184+0000 mgr.a (mgr.14388) 18124 : audit [DBG] from='client.390036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:23 smithi027 bash[22610]: audit 2024-08-31T09:10:23.427184+0000 mgr.a (mgr.14388) 18124 : audit [DBG] from='client.390036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:23 smithi191 bash[24992]: audit 2024-08-31T09:10:23.427184+0000 mgr.a (mgr.14388) 18124 : audit [DBG] from='client.390036 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:24 smithi163 bash[24253]: cluster 2024-08-31T09:10:24.562185+0000 mgr.a (mgr.14388) 18125 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:24 smithi027 bash[22610]: cluster 2024-08-31T09:10:24.562185+0000 mgr.a (mgr.14388) 18125 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:24 smithi191 bash[24992]: cluster 2024-08-31T09:10:24.562185+0000 mgr.a (mgr.14388) 18125 : cluster [DBG] pgmap v12565: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:26 smithi163 bash[24253]: cluster 2024-08-31T09:10:26.563032+0000 mgr.a (mgr.14388) 18126 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:10:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:26 smithi027 bash[22610]: cluster 2024-08-31T09:10:26.563032+0000 mgr.a (mgr.14388) 18126 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:10:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:26 smithi191 bash[24992]: cluster 2024-08-31T09:10:26.563032+0000 mgr.a (mgr.14388) 18126 : cluster [DBG] pgmap v12566: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:10:28.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:28.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:28.893 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:28 smithi163 bash[24253]: cluster 2024-08-31T09:10:28.564979+0000 mgr.a (mgr.14388) 18127 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:28 smithi027 bash[22610]: cluster 2024-08-31T09:10:28.564979+0000 mgr.a (mgr.14388) 18127 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:28 smithi191 bash[24992]: cluster 2024-08-31T09:10:28.564979+0000 mgr.a (mgr.14388) 18127 : cluster [DBG] pgmap v12567: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:29.664 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:29.664 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:29.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:29.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:29.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:29 smithi163 bash[24253]: audit 2024-08-31T09:10:29.227549+0000 mgr.a (mgr.14388) 18128 : audit [DBG] from='client.390114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:29 smithi027 bash[22610]: audit 2024-08-31T09:10:29.227549+0000 mgr.a (mgr.14388) 18128 : audit [DBG] from='client.390114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:29 smithi191 bash[24992]: audit 2024-08-31T09:10:29.227549+0000 mgr.a (mgr.14388) 18128 : audit [DBG] from='client.390114 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:30 smithi163 bash[24253]: cluster 2024-08-31T09:10:30.566109+0000 mgr.a (mgr.14388) 18129 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:10:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:30 smithi027 bash[22610]: cluster 2024-08-31T09:10:30.566109+0000 mgr.a (mgr.14388) 18129 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:10:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:30 smithi191 bash[24992]: cluster 2024-08-31T09:10:30.566109+0000 mgr.a (mgr.14388) 18129 : cluster [DBG] pgmap v12568: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:10:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:32 smithi163 bash[24253]: cluster 2024-08-31T09:10:32.567201+0000 mgr.a (mgr.14388) 18130 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:10:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:32 smithi027 bash[22610]: cluster 2024-08-31T09:10:32.567201+0000 mgr.a (mgr.14388) 18130 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:10:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:32 smithi191 bash[24992]: cluster 2024-08-31T09:10:32.567201+0000 mgr.a (mgr.14388) 18130 : cluster [DBG] pgmap v12569: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:10:34.665 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:34.666 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:34.666 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:34 smithi163 bash[24253]: cluster 2024-08-31T09:10:34.569526+0000 mgr.a (mgr.14388) 18131 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:10:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:34 smithi027 bash[22610]: cluster 2024-08-31T09:10:34.569526+0000 mgr.a (mgr.14388) 18131 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:10:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:34 smithi191 bash[24992]: cluster 2024-08-31T09:10:34.569526+0000 mgr.a (mgr.14388) 18131 : cluster [DBG] pgmap v12570: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:10:35.433 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:35.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:35 smithi163 bash[24253]: audit 2024-08-31T09:10:34.999661+0000 mgr.a (mgr.14388) 18132 : audit [DBG] from='client.390192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:35 smithi027 bash[22610]: audit 2024-08-31T09:10:34.999661+0000 mgr.a (mgr.14388) 18132 : audit [DBG] from='client.390192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:35 smithi191 bash[24992]: audit 2024-08-31T09:10:34.999661+0000 mgr.a (mgr.14388) 18132 : audit [DBG] from='client.390192 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:36 smithi163 bash[24253]: cluster 2024-08-31T09:10:36.570579+0000 mgr.a (mgr.14388) 18133 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:36 smithi027 bash[22610]: cluster 2024-08-31T09:10:36.570579+0000 mgr.a (mgr.14388) 18133 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:36 smithi191 bash[24992]: cluster 2024-08-31T09:10:36.570579+0000 mgr.a (mgr.14388) 18133 : cluster [DBG] pgmap v12571: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:38 smithi163 bash[24253]: cluster 2024-08-31T09:10:38.572806+0000 mgr.a (mgr.14388) 18134 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:38 smithi027 bash[22610]: cluster 2024-08-31T09:10:38.572806+0000 mgr.a (mgr.14388) 18134 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:38 smithi191 bash[24992]: cluster 2024-08-31T09:10:38.572806+0000 mgr.a (mgr.14388) 18134 : cluster [DBG] pgmap v12572: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:40.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:40.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:40.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:40 smithi163 bash[24253]: cluster 2024-08-31T09:10:40.573513+0000 mgr.a (mgr.14388) 18135 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:40 smithi027 bash[22610]: cluster 2024-08-31T09:10:40.573513+0000 mgr.a (mgr.14388) 18135 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:40 smithi191 bash[24992]: cluster 2024-08-31T09:10:40.573513+0000 mgr.a (mgr.14388) 18135 : cluster [DBG] pgmap v12573: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:41.224 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:41.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:41.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:41.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:41.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:41 smithi163 bash[24253]: audit 2024-08-31T09:10:40.774142+0000 mgr.a (mgr.14388) 18136 : audit [DBG] from='client.390270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:41 smithi027 bash[22610]: audit 2024-08-31T09:10:40.774142+0000 mgr.a (mgr.14388) 18136 : audit [DBG] from='client.390270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:41 smithi191 bash[24992]: audit 2024-08-31T09:10:40.774142+0000 mgr.a (mgr.14388) 18136 : audit [DBG] from='client.390270 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:42 smithi163 bash[24253]: cluster 2024-08-31T09:10:42.574410+0000 mgr.a (mgr.14388) 18137 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:42 smithi027 bash[22610]: cluster 2024-08-31T09:10:42.574410+0000 mgr.a (mgr.14388) 18137 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:42 smithi191 bash[24992]: cluster 2024-08-31T09:10:42.574410+0000 mgr.a (mgr.14388) 18137 : cluster [DBG] pgmap v12574: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:44 smithi163 bash[24253]: cluster 2024-08-31T09:10:44.576642+0000 mgr.a (mgr.14388) 18138 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:44 smithi027 bash[22610]: cluster 2024-08-31T09:10:44.576642+0000 mgr.a (mgr.14388) 18138 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:44 smithi191 bash[24992]: cluster 2024-08-31T09:10:44.576642+0000 mgr.a (mgr.14388) 18138 : cluster [DBG] pgmap v12575: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:46.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:46.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:46.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:46 smithi163 bash[24253]: audit 2024-08-31T09:10:46.561077+0000 mgr.a (mgr.14388) 18139 : audit [DBG] from='client.390348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:46 smithi163 bash[24253]: cluster 2024-08-31T09:10:46.577827+0000 mgr.a (mgr.14388) 18140 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:46 smithi027 bash[22610]: audit 2024-08-31T09:10:46.561077+0000 mgr.a (mgr.14388) 18139 : audit [DBG] from='client.390348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:46 smithi027 bash[22610]: cluster 2024-08-31T09:10:46.577827+0000 mgr.a (mgr.14388) 18140 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:46.999 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:47.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:47.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:47.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:47.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:46 smithi191 bash[24992]: audit 2024-08-31T09:10:46.561077+0000 mgr.a (mgr.14388) 18139 : audit [DBG] from='client.390348 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:46 smithi191 bash[24992]: cluster 2024-08-31T09:10:46.577827+0000 mgr.a (mgr.14388) 18140 : cluster [DBG] pgmap v12576: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:48 smithi163 bash[24253]: cluster 2024-08-31T09:10:48.580171+0000 mgr.a (mgr.14388) 18141 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:48 smithi027 bash[22610]: cluster 2024-08-31T09:10:48.580171+0000 mgr.a (mgr.14388) 18141 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:48 smithi191 bash[24992]: cluster 2024-08-31T09:10:48.580171+0000 mgr.a (mgr.14388) 18141 : cluster [DBG] pgmap v12577: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:50.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:50 smithi163 bash[24253]: cluster 2024-08-31T09:10:50.580948+0000 mgr.a (mgr.14388) 18142 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:50 smithi027 bash[22610]: cluster 2024-08-31T09:10:50.580948+0000 mgr.a (mgr.14388) 18142 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:50 smithi191 bash[24992]: cluster 2024-08-31T09:10:50.580948+0000 mgr.a (mgr.14388) 18142 : cluster [DBG] pgmap v12578: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:52.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:52.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:52.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:52.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:52.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:52.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:52.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:52.793 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:52 smithi163 bash[24253]: audit 2024-08-31T09:10:52.337434+0000 mgr.a (mgr.14388) 18143 : audit [DBG] from='client.390420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:52 smithi163 bash[24253]: cluster 2024-08-31T09:10:52.581723+0000 mgr.a (mgr.14388) 18144 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:52 smithi027 bash[22610]: audit 2024-08-31T09:10:52.337434+0000 mgr.a (mgr.14388) 18143 : audit [DBG] from='client.390420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:52 smithi027 bash[22610]: cluster 2024-08-31T09:10:52.581723+0000 mgr.a (mgr.14388) 18144 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:52 smithi191 bash[24992]: audit 2024-08-31T09:10:52.337434+0000 mgr.a (mgr.14388) 18143 : audit [DBG] from='client.390420 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:52 smithi191 bash[24992]: cluster 2024-08-31T09:10:52.581723+0000 mgr.a (mgr.14388) 18144 : cluster [DBG] pgmap v12579: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:54 smithi163 bash[24253]: cluster 2024-08-31T09:10:54.584092+0000 mgr.a (mgr.14388) 18145 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:54 smithi027 bash[22610]: cluster 2024-08-31T09:10:54.584092+0000 mgr.a (mgr.14388) 18145 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:54 smithi191 bash[24992]: cluster 2024-08-31T09:10:54.584092+0000 mgr.a (mgr.14388) 18145 : cluster [DBG] pgmap v12580: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:10:56.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:56 smithi191 bash[24992]: audit 2024-08-31T09:10:56.193180+0000 mon.a (mon.0) 3277 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:10:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:56 smithi163 bash[24253]: audit 2024-08-31T09:10:56.193180+0000 mon.a (mon.0) 3277 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:10:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:56 smithi027 bash[22610]: audit 2024-08-31T09:10:56.193180+0000 mon.a (mon.0) 3277 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:10:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:57 smithi191 bash[24992]: cluster 2024-08-31T09:10:56.584824+0000 mgr.a (mgr.14388) 18146 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:57 smithi191 bash[24992]: audit 2024-08-31T09:10:57.020608+0000 mon.a (mon.0) 3278 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:10:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:57 smithi191 bash[24992]: audit 2024-08-31T09:10:57.022483+0000 mon.a (mon.0) 3279 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:10:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:57 smithi191 bash[24992]: audit 2024-08-31T09:10:57.034036+0000 mon.a (mon.0) 3280 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:10:57.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:57 smithi191 bash[24992]: audit 2024-08-31T09:10:57.038884+0000 mon.a (mon.0) 3281 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:10:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:57 smithi163 bash[24253]: cluster 2024-08-31T09:10:56.584824+0000 mgr.a (mgr.14388) 18146 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:57.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:57 smithi163 bash[24253]: audit 2024-08-31T09:10:57.020608+0000 mon.a (mon.0) 3278 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:10:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:57 smithi163 bash[24253]: audit 2024-08-31T09:10:57.022483+0000 mon.a (mon.0) 3279 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:10:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:57 smithi163 bash[24253]: audit 2024-08-31T09:10:57.034036+0000 mon.a (mon.0) 3280 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:10:57.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:57 smithi163 bash[24253]: audit 2024-08-31T09:10:57.038884+0000 mon.a (mon.0) 3281 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:10:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:57 smithi027 bash[22610]: cluster 2024-08-31T09:10:56.584824+0000 mgr.a (mgr.14388) 18146 : cluster [DBG] pgmap v12581: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:10:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:57 smithi027 bash[22610]: audit 2024-08-31T09:10:57.020608+0000 mon.a (mon.0) 3278 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:10:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:57 smithi027 bash[22610]: audit 2024-08-31T09:10:57.022483+0000 mon.a (mon.0) 3279 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:10:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:57 smithi027 bash[22610]: audit 2024-08-31T09:10:57.034036+0000 mon.a (mon.0) 3280 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:10:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:57 smithi027 bash[22610]: audit 2024-08-31T09:10:57.038884+0000 mon.a (mon.0) 3281 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:10:57.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:10:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:10:57.795 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:10:58.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:10:57 smithi027 bash[22863]: debug 2024-08-31T09:10:57.834+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:10:58.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:10:57 smithi027 bash[22863]: debug 2024-08-31T09:10:57.834+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:10:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:58 smithi191 bash[24992]: audit 2024-08-31T09:10:57.041123+0000 mgr.a (mgr.14388) 18147 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:10:58.564 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:10:58.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:10:58.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:10:58.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:10:58.564 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:10:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:58 smithi163 bash[24253]: audit 2024-08-31T09:10:57.041123+0000 mgr.a (mgr.14388) 18147 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:10:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:58 smithi027 bash[22610]: audit 2024-08-31T09:10:57.041123+0000 mgr.a (mgr.14388) 18147 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:10:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:59 smithi191 bash[24992]: audit 2024-08-31T09:10:57.836188+0000 mgr.a (mgr.14388) 18148 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:10:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:59 smithi191 bash[24992]: cephadm 2024-08-31T09:10:57.837751+0000 mgr.a (mgr.14388) 18149 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:10:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:59 smithi191 bash[24992]: audit 2024-08-31T09:10:58.115901+0000 mgr.a (mgr.14388) 18150 : audit [DBG] from='client.390606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:10:59 smithi191 bash[24992]: cluster 2024-08-31T09:10:58.586079+0000 mgr.a (mgr.14388) 18151 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:59 smithi163 bash[24253]: audit 2024-08-31T09:10:57.836188+0000 mgr.a (mgr.14388) 18148 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:10:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:59 smithi163 bash[24253]: cephadm 2024-08-31T09:10:57.837751+0000 mgr.a (mgr.14388) 18149 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:10:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:59 smithi163 bash[24253]: audit 2024-08-31T09:10:58.115901+0000 mgr.a (mgr.14388) 18150 : audit [DBG] from='client.390606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:59.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:10:59 smithi163 bash[24253]: cluster 2024-08-31T09:10:58.586079+0000 mgr.a (mgr.14388) 18151 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:10:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:59 smithi027 bash[22610]: audit 2024-08-31T09:10:57.836188+0000 mgr.a (mgr.14388) 18148 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:10:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:59 smithi027 bash[22610]: cephadm 2024-08-31T09:10:57.837751+0000 mgr.a (mgr.14388) 18149 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:10:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:59 smithi027 bash[22610]: audit 2024-08-31T09:10:58.115901+0000 mgr.a (mgr.14388) 18150 : audit [DBG] from='client.390606 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:10:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:10:59 smithi027 bash[22610]: cluster 2024-08-31T09:10:58.586079+0000 mgr.a (mgr.14388) 18151 : cluster [DBG] pgmap v12582: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:11:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:00 smithi163 bash[24253]: cluster 2024-08-31T09:11:00.586839+0000 mgr.a (mgr.14388) 18152 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:11:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:00 smithi027 bash[22610]: cluster 2024-08-31T09:11:00.586839+0000 mgr.a (mgr.14388) 18152 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:11:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:00 smithi191 bash[24992]: cluster 2024-08-31T09:11:00.586839+0000 mgr.a (mgr.14388) 18152 : cluster [DBG] pgmap v12583: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:11:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:02 smithi163 bash[24253]: cluster 2024-08-31T09:11:02.587603+0000 mgr.a (mgr.14388) 18153 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:11:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:02 smithi027 bash[22610]: cluster 2024-08-31T09:11:02.587603+0000 mgr.a (mgr.14388) 18153 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:11:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:02 smithi191 bash[24992]: cluster 2024-08-31T09:11:02.587603+0000 mgr.a (mgr.14388) 18153 : cluster [DBG] pgmap v12584: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:11:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:11:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:11:03.566 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:11:04.350 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:11:04.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:11:04.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:11:04.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:11:04.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:11:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:04 smithi163 bash[24253]: audit 2024-08-31T09:11:03.906235+0000 mgr.a (mgr.14388) 18154 : audit [DBG] from='client.390684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:04 smithi163 bash[24253]: cluster 2024-08-31T09:11:04.590345+0000 mgr.a (mgr.14388) 18155 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:11:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:04 smithi027 bash[22610]: audit 2024-08-31T09:11:03.906235+0000 mgr.a (mgr.14388) 18154 : audit [DBG] from='client.390684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:04 smithi027 bash[22610]: cluster 2024-08-31T09:11:04.590345+0000 mgr.a (mgr.14388) 18155 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:11:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:04 smithi191 bash[24992]: audit 2024-08-31T09:11:03.906235+0000 mgr.a (mgr.14388) 18154 : audit [DBG] from='client.390684 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:04 smithi191 bash[24992]: cluster 2024-08-31T09:11:04.590345+0000 mgr.a (mgr.14388) 18155 : cluster [DBG] pgmap v12585: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:11:06.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:06 smithi163 bash[24253]: cluster 2024-08-31T09:11:06.591147+0000 mgr.a (mgr.14388) 18156 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:11:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:06 smithi027 bash[22610]: cluster 2024-08-31T09:11:06.591147+0000 mgr.a (mgr.14388) 18156 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:11:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:06 smithi191 bash[24992]: cluster 2024-08-31T09:11:06.591147+0000 mgr.a (mgr.14388) 18156 : cluster [DBG] pgmap v12586: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:11:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:08 smithi163 bash[24253]: cluster 2024-08-31T09:11:08.593062+0000 mgr.a (mgr.14388) 18157 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:11:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:08 smithi027 bash[22610]: cluster 2024-08-31T09:11:08.593062+0000 mgr.a (mgr.14388) 18157 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:11:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:08 smithi191 bash[24992]: cluster 2024-08-31T09:11:08.593062+0000 mgr.a (mgr.14388) 18157 : cluster [DBG] pgmap v12587: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:11:09.351 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:11:09.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:11:09.352 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:11:10.107 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:11:10.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:11:10.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:11:10.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:11:10.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:11:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:10 smithi163 bash[24253]: audit 2024-08-31T09:11:09.688141+0000 mgr.a (mgr.14388) 18158 : audit [DBG] from='client.390762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:10 smithi163 bash[24253]: cluster 2024-08-31T09:11:10.593966+0000 mgr.a (mgr.14388) 18159 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:10 smithi027 bash[22610]: audit 2024-08-31T09:11:09.688141+0000 mgr.a (mgr.14388) 18158 : audit [DBG] from='client.390762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:10 smithi027 bash[22610]: cluster 2024-08-31T09:11:10.593966+0000 mgr.a (mgr.14388) 18159 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:11.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:10 smithi191 bash[24992]: audit 2024-08-31T09:11:09.688141+0000 mgr.a (mgr.14388) 18158 : audit [DBG] from='client.390762 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:11.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:10 smithi191 bash[24992]: cluster 2024-08-31T09:11:10.593966+0000 mgr.a (mgr.14388) 18159 : cluster [DBG] pgmap v12588: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:12 smithi163 bash[24253]: cluster 2024-08-31T09:11:12.594787+0000 mgr.a (mgr.14388) 18160 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:12 smithi027 bash[22610]: cluster 2024-08-31T09:11:12.594787+0000 mgr.a (mgr.14388) 18160 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:12 smithi191 bash[24992]: cluster 2024-08-31T09:11:12.594787+0000 mgr.a (mgr.14388) 18160 : cluster [DBG] pgmap v12589: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:15.108 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:11:15.109 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:11:15.109 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:11:15.856 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:11:15.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:11:15.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:11:15.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:11:15.856 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:11:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:15 smithi163 bash[24253]: cluster 2024-08-31T09:11:14.596938+0000 mgr.a (mgr.14388) 18161 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:15 smithi163 bash[24253]: audit 2024-08-31T09:11:15.438903+0000 mgr.a (mgr.14388) 18162 : audit [DBG] from='client.390837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:15 smithi027 bash[22610]: cluster 2024-08-31T09:11:14.596938+0000 mgr.a (mgr.14388) 18161 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:15 smithi027 bash[22610]: audit 2024-08-31T09:11:15.438903+0000 mgr.a (mgr.14388) 18162 : audit [DBG] from='client.390837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:15 smithi191 bash[24992]: cluster 2024-08-31T09:11:14.596938+0000 mgr.a (mgr.14388) 18161 : cluster [DBG] pgmap v12590: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:15 smithi191 bash[24992]: audit 2024-08-31T09:11:15.438903+0000 mgr.a (mgr.14388) 18162 : audit [DBG] from='client.390837 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:17.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:17 smithi163 bash[24253]: cluster 2024-08-31T09:11:16.597985+0000 mgr.a (mgr.14388) 18163 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:17.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:17 smithi027 bash[22610]: cluster 2024-08-31T09:11:16.597985+0000 mgr.a (mgr.14388) 18163 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:17 smithi191 bash[24992]: cluster 2024-08-31T09:11:16.597985+0000 mgr.a (mgr.14388) 18163 : cluster [DBG] pgmap v12591: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:19 smithi163 bash[24253]: cluster 2024-08-31T09:11:18.600196+0000 mgr.a (mgr.14388) 18164 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:19 smithi027 bash[22610]: cluster 2024-08-31T09:11:18.600196+0000 mgr.a (mgr.14388) 18164 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:20.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:19 smithi191 bash[24992]: cluster 2024-08-31T09:11:18.600196+0000 mgr.a (mgr.14388) 18164 : cluster [DBG] pgmap v12592: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:20.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:11:20.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:11:20.858 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:11:21.595 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:11:21.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:11:21.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:11:21.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:11:21.596 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:11:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:21 smithi163 bash[24253]: cluster 2024-08-31T09:11:20.601095+0000 mgr.a (mgr.14388) 18165 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:21 smithi163 bash[24253]: audit 2024-08-31T09:11:21.186589+0000 mgr.a (mgr.14388) 18166 : audit [DBG] from='client.390912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:21 smithi027 bash[22610]: cluster 2024-08-31T09:11:20.601095+0000 mgr.a (mgr.14388) 18165 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:21 smithi027 bash[22610]: audit 2024-08-31T09:11:21.186589+0000 mgr.a (mgr.14388) 18166 : audit [DBG] from='client.390912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:21 smithi191 bash[24992]: cluster 2024-08-31T09:11:20.601095+0000 mgr.a (mgr.14388) 18165 : cluster [DBG] pgmap v12593: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:21 smithi191 bash[24992]: audit 2024-08-31T09:11:21.186589+0000 mgr.a (mgr.14388) 18166 : audit [DBG] from='client.390912 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:23 smithi163 bash[24253]: cluster 2024-08-31T09:11:22.602013+0000 mgr.a (mgr.14388) 18167 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:23 smithi027 bash[22610]: cluster 2024-08-31T09:11:22.602013+0000 mgr.a (mgr.14388) 18167 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:24.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:23 smithi191 bash[24992]: cluster 2024-08-31T09:11:22.602013+0000 mgr.a (mgr.14388) 18167 : cluster [DBG] pgmap v12594: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:25 smithi163 bash[24253]: cluster 2024-08-31T09:11:24.604252+0000 mgr.a (mgr.14388) 18168 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:25.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:25 smithi027 bash[22610]: cluster 2024-08-31T09:11:24.604252+0000 mgr.a (mgr.14388) 18168 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:25 smithi191 bash[24992]: cluster 2024-08-31T09:11:24.604252+0000 mgr.a (mgr.14388) 18168 : cluster [DBG] pgmap v12595: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:26.597 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:11:26.600 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:11:26.600 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:11:27.385 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:11:27.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:11:27.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:11:27.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:11:27.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:11:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:27 smithi163 bash[24253]: cluster 2024-08-31T09:11:26.604892+0000 mgr.a (mgr.14388) 18169 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:27 smithi163 bash[24253]: audit 2024-08-31T09:11:26.935040+0000 mgr.a (mgr.14388) 18170 : audit [DBG] from='client.390987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:27 smithi027 bash[22610]: cluster 2024-08-31T09:11:26.604892+0000 mgr.a (mgr.14388) 18169 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:27 smithi027 bash[22610]: audit 2024-08-31T09:11:26.935040+0000 mgr.a (mgr.14388) 18170 : audit [DBG] from='client.390987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:27 smithi191 bash[24992]: cluster 2024-08-31T09:11:26.604892+0000 mgr.a (mgr.14388) 18169 : cluster [DBG] pgmap v12596: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:27 smithi191 bash[24992]: audit 2024-08-31T09:11:26.935040+0000 mgr.a (mgr.14388) 18170 : audit [DBG] from='client.390987 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:29 smithi163 bash[24253]: cluster 2024-08-31T09:11:28.607072+0000 mgr.a (mgr.14388) 18171 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:29 smithi027 bash[22610]: cluster 2024-08-31T09:11:28.607072+0000 mgr.a (mgr.14388) 18171 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:29 smithi191 bash[24992]: cluster 2024-08-31T09:11:28.607072+0000 mgr.a (mgr.14388) 18171 : cluster [DBG] pgmap v12597: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:31 smithi163 bash[24253]: cluster 2024-08-31T09:11:30.607822+0000 mgr.a (mgr.14388) 18172 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:31 smithi027 bash[22610]: cluster 2024-08-31T09:11:30.607822+0000 mgr.a (mgr.14388) 18172 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:31 smithi191 bash[24992]: cluster 2024-08-31T09:11:30.607822+0000 mgr.a (mgr.14388) 18172 : cluster [DBG] pgmap v12598: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:32.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:11:32.387 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:11:32.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:11:33.169 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:11:33.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:11:33.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:11:33.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:11:33.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:11:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:33 smithi163 bash[24253]: cluster 2024-08-31T09:11:32.608699+0000 mgr.a (mgr.14388) 18173 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:33 smithi163 bash[24253]: audit 2024-08-31T09:11:32.726716+0000 mgr.a (mgr.14388) 18174 : audit [DBG] from='client.391065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:33.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:33 smithi027 bash[22610]: cluster 2024-08-31T09:11:32.608699+0000 mgr.a (mgr.14388) 18173 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:33.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:33 smithi027 bash[22610]: audit 2024-08-31T09:11:32.726716+0000 mgr.a (mgr.14388) 18174 : audit [DBG] from='client.391065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:33 smithi191 bash[24992]: cluster 2024-08-31T09:11:32.608699+0000 mgr.a (mgr.14388) 18173 : cluster [DBG] pgmap v12599: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:33 smithi191 bash[24992]: audit 2024-08-31T09:11:32.726716+0000 mgr.a (mgr.14388) 18174 : audit [DBG] from='client.391065 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:35 smithi163 bash[24253]: cluster 2024-08-31T09:11:34.611390+0000 mgr.a (mgr.14388) 18175 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:11:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:35 smithi027 bash[22610]: cluster 2024-08-31T09:11:34.611390+0000 mgr.a (mgr.14388) 18175 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:11:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:35 smithi191 bash[24992]: cluster 2024-08-31T09:11:34.611390+0000 mgr.a (mgr.14388) 18175 : cluster [DBG] pgmap v12600: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:11:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:37 smithi027 bash[22610]: cluster 2024-08-31T09:11:36.612174+0000 mgr.a (mgr.14388) 18176 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:11:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:37 smithi191 bash[24992]: cluster 2024-08-31T09:11:36.612174+0000 mgr.a (mgr.14388) 18176 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:11:38.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:11:38.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:11:38.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:11:38.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:37 smithi163 bash[24253]: cluster 2024-08-31T09:11:36.612174+0000 mgr.a (mgr.14388) 18176 : cluster [DBG] pgmap v12601: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:11:38.936 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:11:38.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:11:38.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:11:38.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:11:38.936 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:11:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:38 smithi027 bash[22610]: audit 2024-08-31T09:11:38.509730+0000 mgr.a (mgr.14388) 18177 : audit [DBG] from='client.391143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:38 smithi191 bash[24992]: audit 2024-08-31T09:11:38.509730+0000 mgr.a (mgr.14388) 18177 : audit [DBG] from='client.391143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:38 smithi163 bash[24253]: audit 2024-08-31T09:11:38.509730+0000 mgr.a (mgr.14388) 18177 : audit [DBG] from='client.391143 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:39 smithi027 bash[22610]: cluster 2024-08-31T09:11:38.613386+0000 mgr.a (mgr.14388) 18178 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:39 smithi191 bash[24992]: cluster 2024-08-31T09:11:38.613386+0000 mgr.a (mgr.14388) 18178 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:40.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:39 smithi163 bash[24253]: cluster 2024-08-31T09:11:38.613386+0000 mgr.a (mgr.14388) 18178 : cluster [DBG] pgmap v12602: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:42.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:41 smithi163 bash[24253]: cluster 2024-08-31T09:11:40.614223+0000 mgr.a (mgr.14388) 18179 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:11:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:41 smithi027 bash[22610]: cluster 2024-08-31T09:11:40.614223+0000 mgr.a (mgr.14388) 18179 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:11:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:41 smithi191 bash[24992]: cluster 2024-08-31T09:11:40.614223+0000 mgr.a (mgr.14388) 18179 : cluster [DBG] pgmap v12603: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:11:43.937 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:11:43.938 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:11:43.938 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:11:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:43 smithi163 bash[24253]: cluster 2024-08-31T09:11:42.615023+0000 mgr.a (mgr.14388) 18180 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:11:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:43 smithi027 bash[22610]: cluster 2024-08-31T09:11:42.615023+0000 mgr.a (mgr.14388) 18180 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:11:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:43 smithi191 bash[24992]: cluster 2024-08-31T09:11:42.615023+0000 mgr.a (mgr.14388) 18180 : cluster [DBG] pgmap v12604: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:11:44.687 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:11:44.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:11:44.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:11:44.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:11:44.688 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:11:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:44 smithi163 bash[24253]: audit 2024-08-31T09:11:44.270493+0000 mgr.a (mgr.14388) 18181 : audit [DBG] from='client.391221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:44 smithi027 bash[22610]: audit 2024-08-31T09:11:44.270493+0000 mgr.a (mgr.14388) 18181 : audit [DBG] from='client.391221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:45.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:44 smithi191 bash[24992]: audit 2024-08-31T09:11:44.270493+0000 mgr.a (mgr.14388) 18181 : audit [DBG] from='client.391221 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:46.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:45 smithi163 bash[24253]: cluster 2024-08-31T09:11:44.616271+0000 mgr.a (mgr.14388) 18182 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:45 smithi027 bash[22610]: cluster 2024-08-31T09:11:44.616271+0000 mgr.a (mgr.14388) 18182 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:45 smithi191 bash[24992]: cluster 2024-08-31T09:11:44.616271+0000 mgr.a (mgr.14388) 18182 : cluster [DBG] pgmap v12605: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:47 smithi027 bash[22610]: cluster 2024-08-31T09:11:46.616989+0000 mgr.a (mgr.14388) 18183 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:11:48.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:47 smithi191 bash[24992]: cluster 2024-08-31T09:11:46.616989+0000 mgr.a (mgr.14388) 18183 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:11:48.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:47 smithi163 bash[24253]: cluster 2024-08-31T09:11:46.616989+0000 mgr.a (mgr.14388) 18183 : cluster [DBG] pgmap v12606: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:11:49.689 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:11:49.689 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:11:49.690 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:11:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:49 smithi027 bash[22610]: cluster 2024-08-31T09:11:48.618943+0000 mgr.a (mgr.14388) 18184 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:11:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:49 smithi191 bash[24992]: cluster 2024-08-31T09:11:48.618943+0000 mgr.a (mgr.14388) 18184 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:11:50.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:49 smithi163 bash[24253]: cluster 2024-08-31T09:11:48.618943+0000 mgr.a (mgr.14388) 18184 : cluster [DBG] pgmap v12607: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:11:50.450 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:11:50.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:11:50.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:11:50.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:11:50.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:11:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:50 smithi027 bash[22610]: audit 2024-08-31T09:11:50.022619+0000 mgr.a (mgr.14388) 18185 : audit [DBG] from='client.391296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:51.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:50 smithi191 bash[24992]: audit 2024-08-31T09:11:50.022619+0000 mgr.a (mgr.14388) 18185 : audit [DBG] from='client.391296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:50 smithi163 bash[24253]: audit 2024-08-31T09:11:50.022619+0000 mgr.a (mgr.14388) 18185 : audit [DBG] from='client.391296 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:51 smithi027 bash[22610]: cluster 2024-08-31T09:11:50.619886+0000 mgr.a (mgr.14388) 18186 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:52.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:51 smithi191 bash[24992]: cluster 2024-08-31T09:11:50.619886+0000 mgr.a (mgr.14388) 18186 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:51 smithi163 bash[24253]: cluster 2024-08-31T09:11:50.619886+0000 mgr.a (mgr.14388) 18186 : cluster [DBG] pgmap v12608: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:53 smithi027 bash[22610]: cluster 2024-08-31T09:11:52.620647+0000 mgr.a (mgr.14388) 18187 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:53 smithi191 bash[24992]: cluster 2024-08-31T09:11:52.620647+0000 mgr.a (mgr.14388) 18187 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:53 smithi163 bash[24253]: cluster 2024-08-31T09:11:52.620647+0000 mgr.a (mgr.14388) 18187 : cluster [DBG] pgmap v12609: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:55.452 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:11:55.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:11:55.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:11:56.225 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:11:56.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:11:56.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:11:56.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:11:56.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:11:56.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:55 smithi027 bash[22610]: cluster 2024-08-31T09:11:54.622847+0000 mgr.a (mgr.14388) 18188 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:55 smithi191 bash[24992]: cluster 2024-08-31T09:11:54.622847+0000 mgr.a (mgr.14388) 18188 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:56.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:55 smithi163 bash[24253]: cluster 2024-08-31T09:11:54.622847+0000 mgr.a (mgr.14388) 18188 : cluster [DBG] pgmap v12610: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:11:57.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:56 smithi191 bash[24992]: audit 2024-08-31T09:11:55.788698+0000 mgr.a (mgr.14388) 18189 : audit [DBG] from='client.391374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:56 smithi163 bash[24253]: audit 2024-08-31T09:11:55.788698+0000 mgr.a (mgr.14388) 18189 : audit [DBG] from='client.391374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:56 smithi027 bash[22610]: audit 2024-08-31T09:11:55.788698+0000 mgr.a (mgr.14388) 18189 : audit [DBG] from='client.391374 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:11:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:57 smithi191 bash[24992]: cluster 2024-08-31T09:11:56.623698+0000 mgr.a (mgr.14388) 18190 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:57 smithi191 bash[24992]: audit 2024-08-31T09:11:57.893690+0000 mon.a (mon.0) 3282 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:11:58.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:57 smithi163 bash[24253]: cluster 2024-08-31T09:11:56.623698+0000 mgr.a (mgr.14388) 18190 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:58.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:57 smithi163 bash[24253]: audit 2024-08-31T09:11:57.893690+0000 mon.a (mon.0) 3282 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:11:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:57 smithi027 bash[22610]: cluster 2024-08-31T09:11:56.623698+0000 mgr.a (mgr.14388) 18190 : cluster [DBG] pgmap v12611: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:11:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:57 smithi027 bash[22610]: audit 2024-08-31T09:11:57.893690+0000 mon.a (mon.0) 3282 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:12:00.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:11:59 smithi191 bash[24992]: cluster 2024-08-31T09:11:58.625979+0000 mgr.a (mgr.14388) 18191 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:12:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:11:59 smithi163 bash[24253]: cluster 2024-08-31T09:11:58.625979+0000 mgr.a (mgr.14388) 18191 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:12:00.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:11:59 smithi027 bash[22610]: cluster 2024-08-31T09:11:58.625979+0000 mgr.a (mgr.14388) 18191 : cluster [DBG] pgmap v12612: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:12:01.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:01.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:01.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:01.992 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:01.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:01.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:01.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:01.992 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:12:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:01 smithi191 bash[24992]: cluster 2024-08-31T09:12:00.626836+0000 mgr.a (mgr.14388) 18192 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:01 smithi191 bash[24992]: audit 2024-08-31T09:12:01.558501+0000 mgr.a (mgr.14388) 18193 : audit [DBG] from='client.391446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:01 smithi163 bash[24253]: cluster 2024-08-31T09:12:00.626836+0000 mgr.a (mgr.14388) 18192 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:01 smithi163 bash[24253]: audit 2024-08-31T09:12:01.558501+0000 mgr.a (mgr.14388) 18193 : audit [DBG] from='client.391446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:01 smithi027 bash[22610]: cluster 2024-08-31T09:12:00.626836+0000 mgr.a (mgr.14388) 18192 : cluster [DBG] pgmap v12613: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:01 smithi027 bash[22610]: audit 2024-08-31T09:12:01.558501+0000 mgr.a (mgr.14388) 18193 : audit [DBG] from='client.391446 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: cluster 2024-08-31T09:12:02.627890+0000 mgr.a (mgr.14388) 18194 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: audit 2024-08-31T09:12:03.228467+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: audit 2024-08-31T09:12:03.233103+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: audit 2024-08-31T09:12:03.262273+0000 mon.a (mon.0) 3285 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: audit 2024-08-31T09:12:03.266104+0000 mon.a (mon.0) 3286 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: audit 2024-08-31T09:12:03.271654+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: audit 2024-08-31T09:12:03.277637+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: audit 2024-08-31T09:12:04.003249+0000 mon.a (mon.0) 3289 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:12:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: audit 2024-08-31T09:12:04.004863+0000 mon.a (mon.0) 3290 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:12:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: audit 2024-08-31T09:12:04.014279+0000 mon.a (mon.0) 3291 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22610]: audit 2024-08-31T09:12:04.019056+0000 mon.a (mon.0) 3292 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: cluster 2024-08-31T09:12:02.627890+0000 mgr.a (mgr.14388) 18194 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: audit 2024-08-31T09:12:03.228467+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: audit 2024-08-31T09:12:03.233103+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: audit 2024-08-31T09:12:03.262273+0000 mon.a (mon.0) 3285 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: audit 2024-08-31T09:12:03.266104+0000 mon.a (mon.0) 3286 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: audit 2024-08-31T09:12:03.271654+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: audit 2024-08-31T09:12:03.277637+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: audit 2024-08-31T09:12:04.003249+0000 mon.a (mon.0) 3289 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: audit 2024-08-31T09:12:04.004863+0000 mon.a (mon.0) 3290 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: audit 2024-08-31T09:12:04.014279+0000 mon.a (mon.0) 3291 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:04 smithi191 bash[24992]: audit 2024-08-31T09:12:04.019056+0000 mon.a (mon.0) 3292 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:12:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: cluster 2024-08-31T09:12:02.627890+0000 mgr.a (mgr.14388) 18194 : cluster [DBG] pgmap v12614: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: audit 2024-08-31T09:12:03.228467+0000 mon.a (mon.0) 3283 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: audit 2024-08-31T09:12:03.233103+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: audit 2024-08-31T09:12:03.262273+0000 mon.a (mon.0) 3285 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: audit 2024-08-31T09:12:03.266104+0000 mon.a (mon.0) 3286 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: audit 2024-08-31T09:12:03.271654+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: audit 2024-08-31T09:12:03.277637+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: audit 2024-08-31T09:12:04.003249+0000 mon.a (mon.0) 3289 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: audit 2024-08-31T09:12:04.004863+0000 mon.a (mon.0) 3290 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: audit 2024-08-31T09:12:04.014279+0000 mon.a (mon.0) 3291 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:12:04.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:04 smithi163 bash[24253]: audit 2024-08-31T09:12:04.019056+0000 mon.a (mon.0) 3292 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:12:05.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22863]: debug 2024-08-31T09:12:04.756+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:12:05.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:12:04 smithi027 bash[22863]: debug 2024-08-31T09:12:04.760+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:12:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:05 smithi191 bash[24992]: audit 2024-08-31T09:12:04.021342+0000 mgr.a (mgr.14388) 18195 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:12:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:05 smithi163 bash[24253]: audit 2024-08-31T09:12:04.021342+0000 mgr.a (mgr.14388) 18195 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:12:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:05 smithi027 bash[22610]: audit 2024-08-31T09:12:04.021342+0000 mgr.a (mgr.14388) 18195 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:12:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:06 smithi191 bash[24992]: cluster 2024-08-31T09:12:04.629289+0000 mgr.a (mgr.14388) 18196 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:12:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:06 smithi191 bash[24992]: audit 2024-08-31T09:12:04.762581+0000 mgr.a (mgr.14388) 18197 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:12:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:06 smithi191 bash[24992]: cephadm 2024-08-31T09:12:04.764513+0000 mgr.a (mgr.14388) 18198 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:12:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:06 smithi163 bash[24253]: cluster 2024-08-31T09:12:04.629289+0000 mgr.a (mgr.14388) 18196 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:12:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:06 smithi163 bash[24253]: audit 2024-08-31T09:12:04.762581+0000 mgr.a (mgr.14388) 18197 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:12:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:06 smithi163 bash[24253]: cephadm 2024-08-31T09:12:04.764513+0000 mgr.a (mgr.14388) 18198 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:12:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:06 smithi027 bash[22610]: cluster 2024-08-31T09:12:04.629289+0000 mgr.a (mgr.14388) 18196 : cluster [DBG] pgmap v12615: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:12:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:06 smithi027 bash[22610]: audit 2024-08-31T09:12:04.762581+0000 mgr.a (mgr.14388) 18197 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:12:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:06 smithi027 bash[22610]: cephadm 2024-08-31T09:12:04.764513+0000 mgr.a (mgr.14388) 18198 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:12:06.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:06.994 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:06.994 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:07.783 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:07.783 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:07.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:07.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:07.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:12:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:08 smithi191 bash[24992]: cluster 2024-08-31T09:12:06.630134+0000 mgr.a (mgr.14388) 18199 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:08 smithi191 bash[24992]: audit 2024-08-31T09:12:07.331933+0000 mgr.a (mgr.14388) 18200 : audit [DBG] from='client.391629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:08 smithi163 bash[24253]: cluster 2024-08-31T09:12:06.630134+0000 mgr.a (mgr.14388) 18199 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:08 smithi163 bash[24253]: audit 2024-08-31T09:12:07.331933+0000 mgr.a (mgr.14388) 18200 : audit [DBG] from='client.391629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:08 smithi027 bash[22610]: cluster 2024-08-31T09:12:06.630134+0000 mgr.a (mgr.14388) 18199 : cluster [DBG] pgmap v12616: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:08 smithi027 bash[22610]: audit 2024-08-31T09:12:07.331933+0000 mgr.a (mgr.14388) 18200 : audit [DBG] from='client.391629 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:10 smithi191 bash[24992]: cluster 2024-08-31T09:12:08.632497+0000 mgr.a (mgr.14388) 18201 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:10 smithi163 bash[24253]: cluster 2024-08-31T09:12:08.632497+0000 mgr.a (mgr.14388) 18201 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:10 smithi027 bash[22610]: cluster 2024-08-31T09:12:08.632497+0000 mgr.a (mgr.14388) 18201 : cluster [DBG] pgmap v12617: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:12 smithi191 bash[24992]: cluster 2024-08-31T09:12:10.633263+0000 mgr.a (mgr.14388) 18202 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:12 smithi163 bash[24253]: cluster 2024-08-31T09:12:10.633263+0000 mgr.a (mgr.14388) 18202 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:12 smithi027 bash[22610]: cluster 2024-08-31T09:12:10.633263+0000 mgr.a (mgr.14388) 18202 : cluster [DBG] pgmap v12618: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:12.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:12.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:12.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:13.535 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:13.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:13.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:13.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:13.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:12:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:14 smithi191 bash[24992]: cluster 2024-08-31T09:12:12.633964+0000 mgr.a (mgr.14388) 18203 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:14 smithi191 bash[24992]: audit 2024-08-31T09:12:13.113174+0000 mgr.a (mgr.14388) 18204 : audit [DBG] from='client.391707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:14.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:14 smithi163 bash[24253]: cluster 2024-08-31T09:12:12.633964+0000 mgr.a (mgr.14388) 18203 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:14.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:14 smithi163 bash[24253]: audit 2024-08-31T09:12:13.113174+0000 mgr.a (mgr.14388) 18204 : audit [DBG] from='client.391707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:14 smithi027 bash[22610]: cluster 2024-08-31T09:12:12.633964+0000 mgr.a (mgr.14388) 18203 : cluster [DBG] pgmap v12619: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:14 smithi027 bash[22610]: audit 2024-08-31T09:12:13.113174+0000 mgr.a (mgr.14388) 18204 : audit [DBG] from='client.391707 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:16 smithi191 bash[24992]: cluster 2024-08-31T09:12:14.636745+0000 mgr.a (mgr.14388) 18205 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:16 smithi163 bash[24253]: cluster 2024-08-31T09:12:14.636745+0000 mgr.a (mgr.14388) 18205 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:16 smithi027 bash[22610]: cluster 2024-08-31T09:12:14.636745+0000 mgr.a (mgr.14388) 18205 : cluster [DBG] pgmap v12620: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:18.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:18.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:18.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:18 smithi191 bash[24992]: cluster 2024-08-31T09:12:16.637525+0000 mgr.a (mgr.14388) 18206 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:12:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:18 smithi163 bash[24253]: cluster 2024-08-31T09:12:16.637525+0000 mgr.a (mgr.14388) 18206 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:12:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:18 smithi027 bash[22610]: cluster 2024-08-31T09:12:16.637525+0000 mgr.a (mgr.14388) 18206 : cluster [DBG] pgmap v12621: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:12:19.283 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:19.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:19.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:19.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:19.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:12:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:20 smithi191 bash[24992]: cluster 2024-08-31T09:12:18.638814+0000 mgr.a (mgr.14388) 18207 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:20 smithi191 bash[24992]: audit 2024-08-31T09:12:18.866536+0000 mgr.a (mgr.14388) 18208 : audit [DBG] from='client.391779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:20 smithi163 bash[24253]: cluster 2024-08-31T09:12:18.638814+0000 mgr.a (mgr.14388) 18207 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:20 smithi163 bash[24253]: audit 2024-08-31T09:12:18.866536+0000 mgr.a (mgr.14388) 18208 : audit [DBG] from='client.391779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:20 smithi027 bash[22610]: cluster 2024-08-31T09:12:18.638814+0000 mgr.a (mgr.14388) 18207 : cluster [DBG] pgmap v12622: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:12:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:20 smithi027 bash[22610]: audit 2024-08-31T09:12:18.866536+0000 mgr.a (mgr.14388) 18208 : audit [DBG] from='client.391779 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:22 smithi191 bash[24992]: cluster 2024-08-31T09:12:20.639669+0000 mgr.a (mgr.14388) 18209 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:12:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:22 smithi163 bash[24253]: cluster 2024-08-31T09:12:20.639669+0000 mgr.a (mgr.14388) 18209 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:12:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:22 smithi027 bash[22610]: cluster 2024-08-31T09:12:20.639669+0000 mgr.a (mgr.14388) 18209 : cluster [DBG] pgmap v12623: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:12:24.284 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:24.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:24.285 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:24 smithi191 bash[24992]: cluster 2024-08-31T09:12:22.640493+0000 mgr.a (mgr.14388) 18210 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:12:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:24 smithi163 bash[24253]: cluster 2024-08-31T09:12:22.640493+0000 mgr.a (mgr.14388) 18210 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:12:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:24 smithi027 bash[22610]: cluster 2024-08-31T09:12:22.640493+0000 mgr.a (mgr.14388) 18210 : cluster [DBG] pgmap v12624: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:12:25.039 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:25.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:25.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:25.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:25.040 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:12:26.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:26 smithi191 bash[24992]: audit 2024-08-31T09:12:24.618511+0000 mgr.a (mgr.14388) 18211 : audit [DBG] from='client.391854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:26 smithi191 bash[24992]: cluster 2024-08-31T09:12:24.642465+0000 mgr.a (mgr.14388) 18212 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 28 op/s 2024-08-31T09:12:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:26 smithi163 bash[24253]: audit 2024-08-31T09:12:24.618511+0000 mgr.a (mgr.14388) 18211 : audit [DBG] from='client.391854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:26 smithi163 bash[24253]: cluster 2024-08-31T09:12:24.642465+0000 mgr.a (mgr.14388) 18212 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 28 op/s 2024-08-31T09:12:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:26 smithi027 bash[22610]: audit 2024-08-31T09:12:24.618511+0000 mgr.a (mgr.14388) 18211 : audit [DBG] from='client.391854 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:26 smithi027 bash[22610]: cluster 2024-08-31T09:12:24.642465+0000 mgr.a (mgr.14388) 18212 : cluster [DBG] pgmap v12625: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 28 op/s 2024-08-31T09:12:28.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:28 smithi191 bash[24992]: cluster 2024-08-31T09:12:26.643535+0000 mgr.a (mgr.14388) 18213 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 28 op/s 2024-08-31T09:12:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:28 smithi163 bash[24253]: cluster 2024-08-31T09:12:26.643535+0000 mgr.a (mgr.14388) 18213 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 28 op/s 2024-08-31T09:12:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:28 smithi027 bash[22610]: cluster 2024-08-31T09:12:26.643535+0000 mgr.a (mgr.14388) 18213 : cluster [DBG] pgmap v12626: 225 pgs: 225 active+clean; 589 KiB data, 243 MiB used, 268 GiB / 268 GiB avail; 18 KiB/s rd, 0 B/s wr, 28 op/s 2024-08-31T09:12:30.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:30.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:30.042 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:30 smithi163 bash[24253]: cluster 2024-08-31T09:12:28.645824+0000 mgr.a (mgr.14388) 18214 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T09:12:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:30 smithi027 bash[22610]: cluster 2024-08-31T09:12:28.645824+0000 mgr.a (mgr.14388) 18214 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T09:12:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:30 smithi191 bash[24992]: cluster 2024-08-31T09:12:28.645824+0000 mgr.a (mgr.14388) 18214 : cluster [DBG] pgmap v12627: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T09:12:30.813 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:30.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:30.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:30.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:30.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:12:31.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:31 smithi163 bash[24253]: audit 2024-08-31T09:12:30.378063+0000 mgr.a (mgr.14388) 18215 : audit [DBG] from='client.391929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:31.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:31 smithi027 bash[22610]: audit 2024-08-31T09:12:30.378063+0000 mgr.a (mgr.14388) 18215 : audit [DBG] from='client.391929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:31 smithi191 bash[24992]: audit 2024-08-31T09:12:30.378063+0000 mgr.a (mgr.14388) 18215 : audit [DBG] from='client.391929 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:32 smithi163 bash[24253]: cluster 2024-08-31T09:12:30.646688+0000 mgr.a (mgr.14388) 18216 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T09:12:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:32 smithi027 bash[22610]: cluster 2024-08-31T09:12:30.646688+0000 mgr.a (mgr.14388) 18216 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T09:12:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:32 smithi191 bash[24992]: cluster 2024-08-31T09:12:30.646688+0000 mgr.a (mgr.14388) 18216 : cluster [DBG] pgmap v12628: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T09:12:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:34 smithi163 bash[24253]: cluster 2024-08-31T09:12:32.647732+0000 mgr.a (mgr.14388) 18217 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T09:12:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:34 smithi027 bash[22610]: cluster 2024-08-31T09:12:32.647732+0000 mgr.a (mgr.14388) 18217 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T09:12:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:34 smithi191 bash[24992]: cluster 2024-08-31T09:12:32.647732+0000 mgr.a (mgr.14388) 18217 : cluster [DBG] pgmap v12629: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 22 KiB/s rd, 0 B/s wr, 34 op/s 2024-08-31T09:12:35.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:35.816 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:35.816 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:36.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:36.599 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:36.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:36.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:36.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:12:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:36 smithi163 bash[24253]: cluster 2024-08-31T09:12:34.650126+0000 mgr.a (mgr.14388) 18218 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T09:12:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:36 smithi027 bash[22610]: cluster 2024-08-31T09:12:34.650126+0000 mgr.a (mgr.14388) 18218 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T09:12:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:36 smithi191 bash[24992]: cluster 2024-08-31T09:12:34.650126+0000 mgr.a (mgr.14388) 18218 : cluster [DBG] pgmap v12630: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 35 op/s 2024-08-31T09:12:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:37 smithi163 bash[24253]: audit 2024-08-31T09:12:36.150640+0000 mgr.a (mgr.14388) 18219 : audit [DBG] from='client.392007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:37 smithi027 bash[22610]: audit 2024-08-31T09:12:36.150640+0000 mgr.a (mgr.14388) 18219 : audit [DBG] from='client.392007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:37 smithi191 bash[24992]: audit 2024-08-31T09:12:36.150640+0000 mgr.a (mgr.14388) 18219 : audit [DBG] from='client.392007 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:38 smithi163 bash[24253]: cluster 2024-08-31T09:12:36.651139+0000 mgr.a (mgr.14388) 18220 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:12:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:38 smithi027 bash[22610]: cluster 2024-08-31T09:12:36.651139+0000 mgr.a (mgr.14388) 18220 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:12:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:38 smithi191 bash[24992]: cluster 2024-08-31T09:12:36.651139+0000 mgr.a (mgr.14388) 18220 : cluster [DBG] pgmap v12631: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:12:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:40 smithi163 bash[24253]: cluster 2024-08-31T09:12:38.653361+0000 mgr.a (mgr.14388) 18221 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:12:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:40 smithi027 bash[22610]: cluster 2024-08-31T09:12:38.653361+0000 mgr.a (mgr.14388) 18221 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:12:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:40 smithi191 bash[24992]: cluster 2024-08-31T09:12:38.653361+0000 mgr.a (mgr.14388) 18221 : cluster [DBG] pgmap v12632: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:12:41.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:41.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:41.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:42.348 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:42.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:42.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:42.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:42.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:12:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:42 smithi163 bash[24253]: cluster 2024-08-31T09:12:40.654135+0000 mgr.a (mgr.14388) 18222 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:42 smithi027 bash[22610]: cluster 2024-08-31T09:12:40.654135+0000 mgr.a (mgr.14388) 18222 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:42 smithi191 bash[24992]: cluster 2024-08-31T09:12:40.654135+0000 mgr.a (mgr.14388) 18222 : cluster [DBG] pgmap v12633: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:43.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:43 smithi163 bash[24253]: audit 2024-08-31T09:12:41.933885+0000 mgr.a (mgr.14388) 18223 : audit [DBG] from='client.392085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:43.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:43 smithi027 bash[22610]: audit 2024-08-31T09:12:41.933885+0000 mgr.a (mgr.14388) 18223 : audit [DBG] from='client.392085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:43.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:43 smithi191 bash[24992]: audit 2024-08-31T09:12:41.933885+0000 mgr.a (mgr.14388) 18223 : audit [DBG] from='client.392085 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:44 smithi163 bash[24253]: cluster 2024-08-31T09:12:42.655116+0000 mgr.a (mgr.14388) 18224 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:44 smithi027 bash[22610]: cluster 2024-08-31T09:12:42.655116+0000 mgr.a (mgr.14388) 18224 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:44 smithi191 bash[24992]: cluster 2024-08-31T09:12:42.655116+0000 mgr.a (mgr.14388) 18224 : cluster [DBG] pgmap v12634: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:46 smithi163 bash[24253]: cluster 2024-08-31T09:12:44.657379+0000 mgr.a (mgr.14388) 18225 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:12:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:46 smithi027 bash[22610]: cluster 2024-08-31T09:12:44.657379+0000 mgr.a (mgr.14388) 18225 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:12:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:46 smithi191 bash[24992]: cluster 2024-08-31T09:12:44.657379+0000 mgr.a (mgr.14388) 18225 : cluster [DBG] pgmap v12635: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:12:47.350 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:47.350 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:47.351 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:48.140 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:48.140 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:48.141 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:12:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:48 smithi163 bash[24253]: cluster 2024-08-31T09:12:46.658184+0000 mgr.a (mgr.14388) 18226 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:48 smithi027 bash[22610]: cluster 2024-08-31T09:12:46.658184+0000 mgr.a (mgr.14388) 18226 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:48 smithi191 bash[24992]: cluster 2024-08-31T09:12:46.658184+0000 mgr.a (mgr.14388) 18226 : cluster [DBG] pgmap v12636: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:49.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:49 smithi163 bash[24253]: audit 2024-08-31T09:12:47.687632+0000 mgr.a (mgr.14388) 18227 : audit [DBG] from='client.392163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:49.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:49 smithi027 bash[22610]: audit 2024-08-31T09:12:47.687632+0000 mgr.a (mgr.14388) 18227 : audit [DBG] from='client.392163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:49.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:49 smithi191 bash[24992]: audit 2024-08-31T09:12:47.687632+0000 mgr.a (mgr.14388) 18227 : audit [DBG] from='client.392163 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:50 smithi163 bash[24253]: cluster 2024-08-31T09:12:48.661545+0000 mgr.a (mgr.14388) 18228 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:50 smithi027 bash[22610]: cluster 2024-08-31T09:12:48.661545+0000 mgr.a (mgr.14388) 18228 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:50 smithi191 bash[24992]: cluster 2024-08-31T09:12:48.661545+0000 mgr.a (mgr.14388) 18228 : cluster [DBG] pgmap v12637: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:12:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:52 smithi163 bash[24253]: cluster 2024-08-31T09:12:50.662385+0000 mgr.a (mgr.14388) 18229 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:12:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:52 smithi027 bash[22610]: cluster 2024-08-31T09:12:50.662385+0000 mgr.a (mgr.14388) 18229 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:12:52.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:52 smithi191 bash[24992]: cluster 2024-08-31T09:12:50.662385+0000 mgr.a (mgr.14388) 18229 : cluster [DBG] pgmap v12638: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:12:53.142 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:53.142 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:53.143 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:53.913 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:53.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:53.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:12:54.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:54 smithi163 bash[24253]: cluster 2024-08-31T09:12:52.663202+0000 mgr.a (mgr.14388) 18230 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:12:54.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:54 smithi163 bash[24253]: audit 2024-08-31T09:12:53.477292+0000 mgr.a (mgr.14388) 18231 : audit [DBG] from='client.392238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:54 smithi027 bash[22610]: cluster 2024-08-31T09:12:52.663202+0000 mgr.a (mgr.14388) 18230 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:12:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:54 smithi027 bash[22610]: audit 2024-08-31T09:12:53.477292+0000 mgr.a (mgr.14388) 18231 : audit [DBG] from='client.392238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:54.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:54 smithi191 bash[24992]: cluster 2024-08-31T09:12:52.663202+0000 mgr.a (mgr.14388) 18230 : cluster [DBG] pgmap v12639: 225 pgs: 225 active+clean; 589 KiB data, 226 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:12:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:54 smithi191 bash[24992]: audit 2024-08-31T09:12:53.477292+0000 mgr.a (mgr.14388) 18231 : audit [DBG] from='client.392238 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:12:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:56 smithi163 bash[24253]: cluster 2024-08-31T09:12:54.666178+0000 mgr.a (mgr.14388) 18232 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:12:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:56 smithi027 bash[22610]: cluster 2024-08-31T09:12:54.666178+0000 mgr.a (mgr.14388) 18232 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:12:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:56 smithi191 bash[24992]: cluster 2024-08-31T09:12:54.666178+0000 mgr.a (mgr.14388) 18232 : cluster [DBG] pgmap v12640: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:12:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:12:58 smithi163 bash[24253]: cluster 2024-08-31T09:12:56.667045+0000 mgr.a (mgr.14388) 18233 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:12:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:12:58 smithi027 bash[22610]: cluster 2024-08-31T09:12:56.667045+0000 mgr.a (mgr.14388) 18233 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:12:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:12:58 smithi191 bash[24992]: cluster 2024-08-31T09:12:56.667045+0000 mgr.a (mgr.14388) 18233 : cluster [DBG] pgmap v12641: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:12:58.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:12:58.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:12:58.915 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:12:59.685 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:12:59.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:12:59.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:12:59.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:12:59.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:00.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:00 smithi163 bash[24253]: cluster 2024-08-31T09:12:58.669150+0000 mgr.a (mgr.14388) 18234 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:13:00.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:00 smithi163 bash[24253]: audit 2024-08-31T09:12:59.249335+0000 mgr.a (mgr.14388) 18235 : audit [DBG] from='client.392310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:00 smithi027 bash[22610]: cluster 2024-08-31T09:12:58.669150+0000 mgr.a (mgr.14388) 18234 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:13:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:00 smithi027 bash[22610]: audit 2024-08-31T09:12:59.249335+0000 mgr.a (mgr.14388) 18235 : audit [DBG] from='client.392310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:00 smithi191 bash[24992]: cluster 2024-08-31T09:12:58.669150+0000 mgr.a (mgr.14388) 18234 : cluster [DBG] pgmap v12642: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:13:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:00 smithi191 bash[24992]: audit 2024-08-31T09:12:59.249335+0000 mgr.a (mgr.14388) 18235 : audit [DBG] from='client.392310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:02.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:02 smithi163 bash[24253]: cluster 2024-08-31T09:13:00.670272+0000 mgr.a (mgr.14388) 18236 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:13:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:02 smithi027 bash[22610]: cluster 2024-08-31T09:13:00.670272+0000 mgr.a (mgr.14388) 18236 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:13:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:02 smithi191 bash[24992]: cluster 2024-08-31T09:13:00.670272+0000 mgr.a (mgr.14388) 18236 : cluster [DBG] pgmap v12643: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:13:04.687 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:13:04.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:13:04.688 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:13:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:04 smithi163 bash[24253]: cluster 2024-08-31T09:13:02.671231+0000 mgr.a (mgr.14388) 18237 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:13:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:04 smithi027 bash[22610]: cluster 2024-08-31T09:13:02.671231+0000 mgr.a (mgr.14388) 18237 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:13:04.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:04 smithi191 bash[24992]: cluster 2024-08-31T09:13:02.671231+0000 mgr.a (mgr.14388) 18237 : cluster [DBG] pgmap v12644: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:13:05.529 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:13:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:13:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:13:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:13:05.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:05 smithi163 bash[24253]: audit 2024-08-31T09:13:04.817651+0000 mon.a (mon.0) 3293 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:13:05.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:05 smithi027 bash[22610]: audit 2024-08-31T09:13:04.817651+0000 mon.a (mon.0) 3293 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:13:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:05 smithi191 bash[24992]: audit 2024-08-31T09:13:04.817651+0000 mon.a (mon.0) 3293 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:13:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:06 smithi163 bash[24253]: cluster 2024-08-31T09:13:04.673600+0000 mgr.a (mgr.14388) 18238 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:13:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:06 smithi163 bash[24253]: audit 2024-08-31T09:13:05.051462+0000 mgr.a (mgr.14388) 18239 : audit [DBG] from='client.392385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:06 smithi163 bash[24253]: audit 2024-08-31T09:13:05.638636+0000 mon.a (mon.0) 3294 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:13:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:06 smithi163 bash[24253]: audit 2024-08-31T09:13:05.640430+0000 mon.a (mon.0) 3295 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:13:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:06 smithi163 bash[24253]: audit 2024-08-31T09:13:05.649095+0000 mon.a (mon.0) 3296 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:13:06.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:06 smithi163 bash[24253]: audit 2024-08-31T09:13:05.653833+0000 mon.a (mon.0) 3297 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:13:06.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:13:06 smithi027 bash[22863]: debug 2024-08-31T09:13:06.379+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:13:06.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:13:06 smithi027 bash[22863]: debug 2024-08-31T09:13:06.379+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:13:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:06 smithi027 bash[22610]: cluster 2024-08-31T09:13:04.673600+0000 mgr.a (mgr.14388) 18238 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:13:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:06 smithi027 bash[22610]: audit 2024-08-31T09:13:05.051462+0000 mgr.a (mgr.14388) 18239 : audit [DBG] from='client.392385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:06 smithi027 bash[22610]: audit 2024-08-31T09:13:05.638636+0000 mon.a (mon.0) 3294 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:13:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:06 smithi027 bash[22610]: audit 2024-08-31T09:13:05.640430+0000 mon.a (mon.0) 3295 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:13:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:06 smithi027 bash[22610]: audit 2024-08-31T09:13:05.649095+0000 mon.a (mon.0) 3296 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:13:06.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:06 smithi027 bash[22610]: audit 2024-08-31T09:13:05.653833+0000 mon.a (mon.0) 3297 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:13:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:06 smithi191 bash[24992]: cluster 2024-08-31T09:13:04.673600+0000 mgr.a (mgr.14388) 18238 : cluster [DBG] pgmap v12645: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:13:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:06 smithi191 bash[24992]: audit 2024-08-31T09:13:05.051462+0000 mgr.a (mgr.14388) 18239 : audit [DBG] from='client.392385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:06 smithi191 bash[24992]: audit 2024-08-31T09:13:05.638636+0000 mon.a (mon.0) 3294 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:13:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:06 smithi191 bash[24992]: audit 2024-08-31T09:13:05.640430+0000 mon.a (mon.0) 3295 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:13:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:06 smithi191 bash[24992]: audit 2024-08-31T09:13:05.649095+0000 mon.a (mon.0) 3296 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:13:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:06 smithi191 bash[24992]: audit 2024-08-31T09:13:05.653833+0000 mon.a (mon.0) 3297 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:13:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:07 smithi163 bash[24253]: audit 2024-08-31T09:13:05.656563+0000 mgr.a (mgr.14388) 18240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:13:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:07 smithi163 bash[24253]: audit 2024-08-31T09:13:06.383727+0000 mgr.a (mgr.14388) 18241 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:13:07.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:07 smithi163 bash[24253]: cephadm 2024-08-31T09:13:06.384932+0000 mgr.a (mgr.14388) 18242 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:13:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:07 smithi027 bash[22610]: audit 2024-08-31T09:13:05.656563+0000 mgr.a (mgr.14388) 18240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:13:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:07 smithi027 bash[22610]: audit 2024-08-31T09:13:06.383727+0000 mgr.a (mgr.14388) 18241 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:13:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:07 smithi027 bash[22610]: cephadm 2024-08-31T09:13:06.384932+0000 mgr.a (mgr.14388) 18242 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:13:07.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:07 smithi191 bash[24992]: audit 2024-08-31T09:13:05.656563+0000 mgr.a (mgr.14388) 18240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:13:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:07 smithi191 bash[24992]: audit 2024-08-31T09:13:06.383727+0000 mgr.a (mgr.14388) 18241 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:13:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:07 smithi191 bash[24992]: cephadm 2024-08-31T09:13:06.384932+0000 mgr.a (mgr.14388) 18242 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:13:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:08 smithi163 bash[24253]: cluster 2024-08-31T09:13:06.674533+0000 mgr.a (mgr.14388) 18243 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:08 smithi027 bash[22610]: cluster 2024-08-31T09:13:06.674533+0000 mgr.a (mgr.14388) 18243 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:08 smithi191 bash[24992]: cluster 2024-08-31T09:13:06.674533+0000 mgr.a (mgr.14388) 18243 : cluster [DBG] pgmap v12646: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:10.531 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:13:10.532 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:13:10.532 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:13:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:10 smithi163 bash[24253]: cluster 2024-08-31T09:13:08.676736+0000 mgr.a (mgr.14388) 18244 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:10 smithi027 bash[22610]: cluster 2024-08-31T09:13:08.676736+0000 mgr.a (mgr.14388) 18244 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:10.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:10 smithi191 bash[24992]: cluster 2024-08-31T09:13:08.676736+0000 mgr.a (mgr.14388) 18244 : cluster [DBG] pgmap v12647: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:11.303 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:13:11.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:13:11.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:13:11.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:13:11.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:12 smithi163 bash[24253]: cluster 2024-08-31T09:13:10.677249+0000 mgr.a (mgr.14388) 18245 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:12.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:12 smithi163 bash[24253]: audit 2024-08-31T09:13:10.865763+0000 mgr.a (mgr.14388) 18246 : audit [DBG] from='client.392568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:12 smithi027 bash[22610]: cluster 2024-08-31T09:13:10.677249+0000 mgr.a (mgr.14388) 18245 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:12 smithi027 bash[22610]: audit 2024-08-31T09:13:10.865763+0000 mgr.a (mgr.14388) 18246 : audit [DBG] from='client.392568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:12 smithi191 bash[24992]: cluster 2024-08-31T09:13:10.677249+0000 mgr.a (mgr.14388) 18245 : cluster [DBG] pgmap v12648: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:12 smithi191 bash[24992]: audit 2024-08-31T09:13:10.865763+0000 mgr.a (mgr.14388) 18246 : audit [DBG] from='client.392568 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:14.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:14 smithi163 bash[24253]: cluster 2024-08-31T09:13:12.678217+0000 mgr.a (mgr.14388) 18247 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:14 smithi027 bash[22610]: cluster 2024-08-31T09:13:12.678217+0000 mgr.a (mgr.14388) 18247 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:14 smithi191 bash[24992]: cluster 2024-08-31T09:13:12.678217+0000 mgr.a (mgr.14388) 18247 : cluster [DBG] pgmap v12649: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:16.305 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:13:16.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:13:16.306 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:13:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:16 smithi163 bash[24253]: cluster 2024-08-31T09:13:14.680531+0000 mgr.a (mgr.14388) 18248 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:16 smithi027 bash[22610]: cluster 2024-08-31T09:13:14.680531+0000 mgr.a (mgr.14388) 18248 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:16 smithi191 bash[24992]: cluster 2024-08-31T09:13:14.680531+0000 mgr.a (mgr.14388) 18248 : cluster [DBG] pgmap v12650: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:17.082 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:13:17.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:13:17.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:13:17.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:13:17.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:18 smithi163 bash[24253]: audit 2024-08-31T09:13:16.640690+0000 mgr.a (mgr.14388) 18249 : audit [DBG] from='client.392643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:18 smithi163 bash[24253]: cluster 2024-08-31T09:13:16.681570+0000 mgr.a (mgr.14388) 18250 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:18 smithi027 bash[22610]: audit 2024-08-31T09:13:16.640690+0000 mgr.a (mgr.14388) 18249 : audit [DBG] from='client.392643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:18 smithi027 bash[22610]: cluster 2024-08-31T09:13:16.681570+0000 mgr.a (mgr.14388) 18250 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:18 smithi191 bash[24992]: audit 2024-08-31T09:13:16.640690+0000 mgr.a (mgr.14388) 18249 : audit [DBG] from='client.392643 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:18 smithi191 bash[24992]: cluster 2024-08-31T09:13:16.681570+0000 mgr.a (mgr.14388) 18250 : cluster [DBG] pgmap v12651: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:20 smithi163 bash[24253]: cluster 2024-08-31T09:13:18.683941+0000 mgr.a (mgr.14388) 18251 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:20 smithi027 bash[22610]: cluster 2024-08-31T09:13:18.683941+0000 mgr.a (mgr.14388) 18251 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:20 smithi191 bash[24992]: cluster 2024-08-31T09:13:18.683941+0000 mgr.a (mgr.14388) 18251 : cluster [DBG] pgmap v12652: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:13:22.084 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:13:22.085 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:13:22.085 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:13:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:22 smithi163 bash[24253]: cluster 2024-08-31T09:13:20.684715+0000 mgr.a (mgr.14388) 18252 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:22.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:22 smithi027 bash[22610]: cluster 2024-08-31T09:13:20.684715+0000 mgr.a (mgr.14388) 18252 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:22 smithi191 bash[24992]: cluster 2024-08-31T09:13:20.684715+0000 mgr.a (mgr.14388) 18252 : cluster [DBG] pgmap v12653: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:22.824 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:13:22.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:13:22.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:13:22.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:13:22.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:23.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:23 smithi027 bash[22610]: audit 2024-08-31T09:13:22.414043+0000 mgr.a (mgr.14388) 18253 : audit [DBG] from='client.392721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:23.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:23 smithi191 bash[24992]: audit 2024-08-31T09:13:22.414043+0000 mgr.a (mgr.14388) 18253 : audit [DBG] from='client.392721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:23 smithi163 bash[24253]: audit 2024-08-31T09:13:22.414043+0000 mgr.a (mgr.14388) 18253 : audit [DBG] from='client.392721 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:24 smithi027 bash[22610]: cluster 2024-08-31T09:13:22.685224+0000 mgr.a (mgr.14388) 18254 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:24 smithi191 bash[24992]: cluster 2024-08-31T09:13:22.685224+0000 mgr.a (mgr.14388) 18254 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:24 smithi163 bash[24253]: cluster 2024-08-31T09:13:22.685224+0000 mgr.a (mgr.14388) 18254 : cluster [DBG] pgmap v12654: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:26 smithi027 bash[22610]: cluster 2024-08-31T09:13:24.687564+0000 mgr.a (mgr.14388) 18255 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:26 smithi191 bash[24992]: cluster 2024-08-31T09:13:24.687564+0000 mgr.a (mgr.14388) 18255 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:26 smithi163 bash[24253]: cluster 2024-08-31T09:13:24.687564+0000 mgr.a (mgr.14388) 18255 : cluster [DBG] pgmap v12655: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:27.825 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:13:27.826 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:13:27.827 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:13:28.627 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:13:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:13:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:13:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:13:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:28 smithi027 bash[22610]: cluster 2024-08-31T09:13:26.688499+0000 mgr.a (mgr.14388) 18256 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:28 smithi191 bash[24992]: cluster 2024-08-31T09:13:26.688499+0000 mgr.a (mgr.14388) 18256 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:28 smithi163 bash[24253]: cluster 2024-08-31T09:13:26.688499+0000 mgr.a (mgr.14388) 18256 : cluster [DBG] pgmap v12656: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:29 smithi027 bash[22610]: audit 2024-08-31T09:13:28.185951+0000 mgr.a (mgr.14388) 18257 : audit [DBG] from='client.392799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:29 smithi191 bash[24992]: audit 2024-08-31T09:13:28.185951+0000 mgr.a (mgr.14388) 18257 : audit [DBG] from='client.392799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:29 smithi163 bash[24253]: audit 2024-08-31T09:13:28.185951+0000 mgr.a (mgr.14388) 18257 : audit [DBG] from='client.392799 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:30 smithi027 bash[22610]: cluster 2024-08-31T09:13:28.689828+0000 mgr.a (mgr.14388) 18258 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:30 smithi191 bash[24992]: cluster 2024-08-31T09:13:28.689828+0000 mgr.a (mgr.14388) 18258 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:30 smithi163 bash[24253]: cluster 2024-08-31T09:13:28.689828+0000 mgr.a (mgr.14388) 18258 : cluster [DBG] pgmap v12657: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:32 smithi191 bash[24992]: cluster 2024-08-31T09:13:30.690569+0000 mgr.a (mgr.14388) 18259 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:13:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:32 smithi163 bash[24253]: cluster 2024-08-31T09:13:30.690569+0000 mgr.a (mgr.14388) 18259 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:13:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:32 smithi027 bash[22610]: cluster 2024-08-31T09:13:30.690569+0000 mgr.a (mgr.14388) 18259 : cluster [DBG] pgmap v12658: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:13:33.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:13:33.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:13:33.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:13:34.380 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:13:34.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:13:34.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:13:34.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:13:34.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:34 smithi191 bash[24992]: cluster 2024-08-31T09:13:32.691373+0000 mgr.a (mgr.14388) 18260 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:13:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:34 smithi163 bash[24253]: cluster 2024-08-31T09:13:32.691373+0000 mgr.a (mgr.14388) 18260 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:13:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:34 smithi027 bash[22610]: cluster 2024-08-31T09:13:32.691373+0000 mgr.a (mgr.14388) 18260 : cluster [DBG] pgmap v12659: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:13:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:35 smithi191 bash[24992]: audit 2024-08-31T09:13:33.959204+0000 mgr.a (mgr.14388) 18261 : audit [DBG] from='client.392877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:35 smithi163 bash[24253]: audit 2024-08-31T09:13:33.959204+0000 mgr.a (mgr.14388) 18261 : audit [DBG] from='client.392877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:35 smithi027 bash[22610]: audit 2024-08-31T09:13:33.959204+0000 mgr.a (mgr.14388) 18261 : audit [DBG] from='client.392877 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:36 smithi191 bash[24992]: cluster 2024-08-31T09:13:34.694113+0000 mgr.a (mgr.14388) 18262 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:36 smithi163 bash[24253]: cluster 2024-08-31T09:13:34.694113+0000 mgr.a (mgr.14388) 18262 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:36 smithi027 bash[22610]: cluster 2024-08-31T09:13:34.694113+0000 mgr.a (mgr.14388) 18262 : cluster [DBG] pgmap v12660: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:38 smithi191 bash[24992]: cluster 2024-08-31T09:13:36.695074+0000 mgr.a (mgr.14388) 18263 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:13:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:38 smithi163 bash[24253]: cluster 2024-08-31T09:13:36.695074+0000 mgr.a (mgr.14388) 18263 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:13:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:38 smithi027 bash[22610]: cluster 2024-08-31T09:13:36.695074+0000 mgr.a (mgr.14388) 18263 : cluster [DBG] pgmap v12661: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:13:39.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:13:39.383 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:13:39.383 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:13:40.138 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:13:40.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:13:40.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:13:40.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:13:40.138 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:40 smithi191 bash[24992]: cluster 2024-08-31T09:13:38.697234+0000 mgr.a (mgr.14388) 18264 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:40 smithi163 bash[24253]: cluster 2024-08-31T09:13:38.697234+0000 mgr.a (mgr.14388) 18264 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:40 smithi027 bash[22610]: cluster 2024-08-31T09:13:38.697234+0000 mgr.a (mgr.14388) 18264 : cluster [DBG] pgmap v12662: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:41.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:41 smithi191 bash[24992]: audit 2024-08-31T09:13:39.715055+0000 mgr.a (mgr.14388) 18265 : audit [DBG] from='client.392949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:41 smithi163 bash[24253]: audit 2024-08-31T09:13:39.715055+0000 mgr.a (mgr.14388) 18265 : audit [DBG] from='client.392949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:41 smithi027 bash[22610]: audit 2024-08-31T09:13:39.715055+0000 mgr.a (mgr.14388) 18265 : audit [DBG] from='client.392949 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:42 smithi191 bash[24992]: cluster 2024-08-31T09:13:40.698199+0000 mgr.a (mgr.14388) 18266 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:42 smithi163 bash[24253]: cluster 2024-08-31T09:13:40.698199+0000 mgr.a (mgr.14388) 18266 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:42 smithi027 bash[22610]: cluster 2024-08-31T09:13:40.698199+0000 mgr.a (mgr.14388) 18266 : cluster [DBG] pgmap v12663: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:44 smithi191 bash[24992]: cluster 2024-08-31T09:13:42.699023+0000 mgr.a (mgr.14388) 18267 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:44 smithi163 bash[24253]: cluster 2024-08-31T09:13:42.699023+0000 mgr.a (mgr.14388) 18267 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:44 smithi027 bash[22610]: cluster 2024-08-31T09:13:42.699023+0000 mgr.a (mgr.14388) 18267 : cluster [DBG] pgmap v12664: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:45.139 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:13:45.140 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:13:45.140 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:13:45.920 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:13:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:13:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:13:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:13:45.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:46 smithi191 bash[24992]: cluster 2024-08-31T09:13:44.701219+0000 mgr.a (mgr.14388) 18268 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:46 smithi191 bash[24992]: audit 2024-08-31T09:13:45.475084+0000 mgr.a (mgr.14388) 18269 : audit [DBG] from='client.393024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:46 smithi163 bash[24253]: cluster 2024-08-31T09:13:44.701219+0000 mgr.a (mgr.14388) 18268 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:46 smithi163 bash[24253]: audit 2024-08-31T09:13:45.475084+0000 mgr.a (mgr.14388) 18269 : audit [DBG] from='client.393024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:46 smithi027 bash[22610]: cluster 2024-08-31T09:13:44.701219+0000 mgr.a (mgr.14388) 18268 : cluster [DBG] pgmap v12665: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:46 smithi027 bash[22610]: audit 2024-08-31T09:13:45.475084+0000 mgr.a (mgr.14388) 18269 : audit [DBG] from='client.393024 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:48 smithi191 bash[24992]: cluster 2024-08-31T09:13:46.702192+0000 mgr.a (mgr.14388) 18270 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:48 smithi163 bash[24253]: cluster 2024-08-31T09:13:46.702192+0000 mgr.a (mgr.14388) 18270 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:48 smithi027 bash[22610]: cluster 2024-08-31T09:13:46.702192+0000 mgr.a (mgr.14388) 18270 : cluster [DBG] pgmap v12666: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:50.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:13:50.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:13:50.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:13:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:50 smithi163 bash[24253]: cluster 2024-08-31T09:13:48.704475+0000 mgr.a (mgr.14388) 18271 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:50 smithi027 bash[22610]: cluster 2024-08-31T09:13:48.704475+0000 mgr.a (mgr.14388) 18271 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:50 smithi191 bash[24992]: cluster 2024-08-31T09:13:48.704475+0000 mgr.a (mgr.14388) 18271 : cluster [DBG] pgmap v12667: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:51.667 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:13:51.668 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:13:51.668 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:13:51.668 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:13:51.668 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:52 smithi163 bash[24253]: cluster 2024-08-31T09:13:50.705281+0000 mgr.a (mgr.14388) 18272 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:52.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:52 smithi163 bash[24253]: audit 2024-08-31T09:13:51.255811+0000 mgr.a (mgr.14388) 18273 : audit [DBG] from='client.393102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:52 smithi027 bash[22610]: cluster 2024-08-31T09:13:50.705281+0000 mgr.a (mgr.14388) 18272 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:52 smithi027 bash[22610]: audit 2024-08-31T09:13:51.255811+0000 mgr.a (mgr.14388) 18273 : audit [DBG] from='client.393102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:52 smithi191 bash[24992]: cluster 2024-08-31T09:13:50.705281+0000 mgr.a (mgr.14388) 18272 : cluster [DBG] pgmap v12668: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:52 smithi191 bash[24992]: audit 2024-08-31T09:13:51.255811+0000 mgr.a (mgr.14388) 18273 : audit [DBG] from='client.393102 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:54 smithi163 bash[24253]: cluster 2024-08-31T09:13:52.706271+0000 mgr.a (mgr.14388) 18274 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:54 smithi027 bash[22610]: cluster 2024-08-31T09:13:52.706271+0000 mgr.a (mgr.14388) 18274 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:54 smithi191 bash[24992]: cluster 2024-08-31T09:13:52.706271+0000 mgr.a (mgr.14388) 18274 : cluster [DBG] pgmap v12669: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:56.669 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:13:56.670 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:13:56.670 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:13:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:56 smithi163 bash[24253]: cluster 2024-08-31T09:13:54.708534+0000 mgr.a (mgr.14388) 18275 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:56 smithi027 bash[22610]: cluster 2024-08-31T09:13:54.708534+0000 mgr.a (mgr.14388) 18275 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:56 smithi191 bash[24992]: cluster 2024-08-31T09:13:54.708534+0000 mgr.a (mgr.14388) 18275 : cluster [DBG] pgmap v12670: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:13:57.450 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:13:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:13:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:13:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:13:57.450 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:13:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:58 smithi163 bash[24253]: cluster 2024-08-31T09:13:56.709239+0000 mgr.a (mgr.14388) 18276 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:13:58 smithi163 bash[24253]: audit 2024-08-31T09:13:57.009629+0000 mgr.a (mgr.14388) 18277 : audit [DBG] from='client.393177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:58 smithi027 bash[22610]: cluster 2024-08-31T09:13:56.709239+0000 mgr.a (mgr.14388) 18276 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:13:58 smithi027 bash[22610]: audit 2024-08-31T09:13:57.009629+0000 mgr.a (mgr.14388) 18277 : audit [DBG] from='client.393177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:13:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:58 smithi191 bash[24992]: cluster 2024-08-31T09:13:56.709239+0000 mgr.a (mgr.14388) 18276 : cluster [DBG] pgmap v12671: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:13:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:13:58 smithi191 bash[24992]: audit 2024-08-31T09:13:57.009629+0000 mgr.a (mgr.14388) 18277 : audit [DBG] from='client.393177 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:00 smithi163 bash[24253]: cluster 2024-08-31T09:13:58.711556+0000 mgr.a (mgr.14388) 18278 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:00 smithi027 bash[22610]: cluster 2024-08-31T09:13:58.711556+0000 mgr.a (mgr.14388) 18278 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:00 smithi191 bash[24992]: cluster 2024-08-31T09:13:58.711556+0000 mgr.a (mgr.14388) 18278 : cluster [DBG] pgmap v12672: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:02.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:14:02.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:14:02.452 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:14:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:02 smithi163 bash[24253]: cluster 2024-08-31T09:14:00.712333+0000 mgr.a (mgr.14388) 18279 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:02 smithi027 bash[22610]: cluster 2024-08-31T09:14:00.712333+0000 mgr.a (mgr.14388) 18279 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:03.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:02 smithi191 bash[24992]: cluster 2024-08-31T09:14:00.712333+0000 mgr.a (mgr.14388) 18279 : cluster [DBG] pgmap v12673: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:03.196 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:14:03.196 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:14:03.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:14:03.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:14:03.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:14:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:04 smithi163 bash[24253]: cluster 2024-08-31T09:14:02.712838+0000 mgr.a (mgr.14388) 18280 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:04 smithi163 bash[24253]: audit 2024-08-31T09:14:02.787554+0000 mgr.a (mgr.14388) 18281 : audit [DBG] from='client.393252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:04 smithi027 bash[22610]: cluster 2024-08-31T09:14:02.712838+0000 mgr.a (mgr.14388) 18280 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:04 smithi027 bash[22610]: audit 2024-08-31T09:14:02.787554+0000 mgr.a (mgr.14388) 18281 : audit [DBG] from='client.393252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:04 smithi191 bash[24992]: cluster 2024-08-31T09:14:02.712838+0000 mgr.a (mgr.14388) 18280 : cluster [DBG] pgmap v12674: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:04 smithi191 bash[24992]: audit 2024-08-31T09:14:02.787554+0000 mgr.a (mgr.14388) 18281 : audit [DBG] from='client.393252 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:06 smithi163 bash[24253]: cluster 2024-08-31T09:14:04.715656+0000 mgr.a (mgr.14388) 18282 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:06 smithi163 bash[24253]: audit 2024-08-31T09:14:06.437607+0000 mon.a (mon.0) 3298 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:14:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:06 smithi027 bash[22610]: cluster 2024-08-31T09:14:04.715656+0000 mgr.a (mgr.14388) 18282 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:06 smithi027 bash[22610]: audit 2024-08-31T09:14:06.437607+0000 mon.a (mon.0) 3298 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:14:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:06 smithi191 bash[24992]: cluster 2024-08-31T09:14:04.715656+0000 mgr.a (mgr.14388) 18282 : cluster [DBG] pgmap v12675: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:06 smithi191 bash[24992]: audit 2024-08-31T09:14:06.437607+0000 mon.a (mon.0) 3298 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:14:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:07 smithi163 bash[24253]: audit 2024-08-31T09:14:07.278945+0000 mon.a (mon.0) 3299 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:14:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:07 smithi163 bash[24253]: audit 2024-08-31T09:14:07.280503+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:14:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:07 smithi163 bash[24253]: audit 2024-08-31T09:14:07.287244+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:14:07.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:07 smithi163 bash[24253]: audit 2024-08-31T09:14:07.292043+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:14:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:07 smithi027 bash[22610]: audit 2024-08-31T09:14:07.278945+0000 mon.a (mon.0) 3299 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:14:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:07 smithi027 bash[22610]: audit 2024-08-31T09:14:07.280503+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:14:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:07 smithi027 bash[22610]: audit 2024-08-31T09:14:07.287244+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:14:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:07 smithi027 bash[22610]: audit 2024-08-31T09:14:07.292043+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:14:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:07 smithi191 bash[24992]: audit 2024-08-31T09:14:07.278945+0000 mon.a (mon.0) 3299 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:14:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:07 smithi191 bash[24992]: audit 2024-08-31T09:14:07.280503+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:14:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:07 smithi191 bash[24992]: audit 2024-08-31T09:14:07.287244+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:14:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:07 smithi191 bash[24992]: audit 2024-08-31T09:14:07.292043+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:14:08.197 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:14:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:14:08.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:14:08.486 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:14:08 smithi027 bash[22863]: debug 2024-08-31T09:14:08.041+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:14:08.486 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:14:08 smithi027 bash[22863]: debug 2024-08-31T09:14:08.045+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:14:08.928 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:14:08.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:14:08.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:14:08.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:14:08.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:14:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:08 smithi163 bash[24253]: cluster 2024-08-31T09:14:06.716454+0000 mgr.a (mgr.14388) 18283 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:14:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:08 smithi163 bash[24253]: audit 2024-08-31T09:14:07.294311+0000 mgr.a (mgr.14388) 18284 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:14:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:08 smithi027 bash[22610]: cluster 2024-08-31T09:14:06.716454+0000 mgr.a (mgr.14388) 18283 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:14:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:08 smithi027 bash[22610]: audit 2024-08-31T09:14:07.294311+0000 mgr.a (mgr.14388) 18284 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:14:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:08 smithi191 bash[24992]: cluster 2024-08-31T09:14:06.716454+0000 mgr.a (mgr.14388) 18283 : cluster [DBG] pgmap v12676: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:14:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:08 smithi191 bash[24992]: audit 2024-08-31T09:14:07.294311+0000 mgr.a (mgr.14388) 18284 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:14:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:09 smithi163 bash[24253]: audit 2024-08-31T09:14:08.045700+0000 mgr.a (mgr.14388) 18285 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:14:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:09 smithi163 bash[24253]: cephadm 2024-08-31T09:14:08.047168+0000 mgr.a (mgr.14388) 18286 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:14:09.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:09 smithi163 bash[24253]: audit 2024-08-31T09:14:08.515405+0000 mgr.a (mgr.14388) 18287 : audit [DBG] from='client.393435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:09 smithi027 bash[22610]: audit 2024-08-31T09:14:08.045700+0000 mgr.a (mgr.14388) 18285 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:14:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:09 smithi027 bash[22610]: cephadm 2024-08-31T09:14:08.047168+0000 mgr.a (mgr.14388) 18286 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:14:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:09 smithi027 bash[22610]: audit 2024-08-31T09:14:08.515405+0000 mgr.a (mgr.14388) 18287 : audit [DBG] from='client.393435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:09 smithi191 bash[24992]: audit 2024-08-31T09:14:08.045700+0000 mgr.a (mgr.14388) 18285 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:14:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:09 smithi191 bash[24992]: cephadm 2024-08-31T09:14:08.047168+0000 mgr.a (mgr.14388) 18286 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:14:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:09 smithi191 bash[24992]: audit 2024-08-31T09:14:08.515405+0000 mgr.a (mgr.14388) 18287 : audit [DBG] from='client.393435 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:10 smithi163 bash[24253]: cluster 2024-08-31T09:14:08.717846+0000 mgr.a (mgr.14388) 18288 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T09:14:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:10 smithi027 bash[22610]: cluster 2024-08-31T09:14:08.717846+0000 mgr.a (mgr.14388) 18288 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T09:14:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:10 smithi191 bash[24992]: cluster 2024-08-31T09:14:08.717846+0000 mgr.a (mgr.14388) 18288 : cluster [DBG] pgmap v12677: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T09:14:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:12 smithi163 bash[24253]: cluster 2024-08-31T09:14:10.718693+0000 mgr.a (mgr.14388) 18289 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T09:14:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:12 smithi027 bash[22610]: cluster 2024-08-31T09:14:10.718693+0000 mgr.a (mgr.14388) 18289 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T09:14:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:12 smithi191 bash[24992]: cluster 2024-08-31T09:14:10.718693+0000 mgr.a (mgr.14388) 18289 : cluster [DBG] pgmap v12678: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T09:14:13.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:14:13.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:14:13.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:14:14.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:14:14.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:14:14.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:14:14.713 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:14:14.713 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:14:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:14 smithi163 bash[24253]: cluster 2024-08-31T09:14:12.719505+0000 mgr.a (mgr.14388) 18290 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T09:14:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:14 smithi027 bash[22610]: cluster 2024-08-31T09:14:12.719505+0000 mgr.a (mgr.14388) 18290 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T09:14:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:14 smithi191 bash[24992]: cluster 2024-08-31T09:14:12.719505+0000 mgr.a (mgr.14388) 18290 : cluster [DBG] pgmap v12679: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-31T09:14:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:15 smithi163 bash[24253]: audit 2024-08-31T09:14:14.265700+0000 mgr.a (mgr.14388) 18291 : audit [DBG] from='client.393513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:15 smithi027 bash[22610]: audit 2024-08-31T09:14:14.265700+0000 mgr.a (mgr.14388) 18291 : audit [DBG] from='client.393513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:15 smithi191 bash[24992]: audit 2024-08-31T09:14:14.265700+0000 mgr.a (mgr.14388) 18291 : audit [DBG] from='client.393513 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:16 smithi163 bash[24253]: cluster 2024-08-31T09:14:14.720978+0000 mgr.a (mgr.14388) 18292 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:14:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:16 smithi027 bash[22610]: cluster 2024-08-31T09:14:14.720978+0000 mgr.a (mgr.14388) 18292 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:14:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:16 smithi191 bash[24992]: cluster 2024-08-31T09:14:14.720978+0000 mgr.a (mgr.14388) 18292 : cluster [DBG] pgmap v12680: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:14:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:18 smithi163 bash[24253]: cluster 2024-08-31T09:14:16.721743+0000 mgr.a (mgr.14388) 18293 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:14:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:18 smithi027 bash[22610]: cluster 2024-08-31T09:14:16.721743+0000 mgr.a (mgr.14388) 18293 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:14:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:18 smithi191 bash[24992]: cluster 2024-08-31T09:14:16.721743+0000 mgr.a (mgr.14388) 18293 : cluster [DBG] pgmap v12681: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:14:19.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:14:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:14:19.715 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:14:20.494 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:14:20.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:14:20.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:14:20.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:14:20.495 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:14:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:20 smithi163 bash[24253]: cluster 2024-08-31T09:14:18.723756+0000 mgr.a (mgr.14388) 18294 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:14:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:20 smithi027 bash[22610]: cluster 2024-08-31T09:14:18.723756+0000 mgr.a (mgr.14388) 18294 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:14:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:20 smithi191 bash[24992]: cluster 2024-08-31T09:14:18.723756+0000 mgr.a (mgr.14388) 18294 : cluster [DBG] pgmap v12682: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:14:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:21 smithi163 bash[24253]: audit 2024-08-31T09:14:20.051803+0000 mgr.a (mgr.14388) 18295 : audit [DBG] from='client.393588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:21 smithi027 bash[22610]: audit 2024-08-31T09:14:20.051803+0000 mgr.a (mgr.14388) 18295 : audit [DBG] from='client.393588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:22.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:21 smithi191 bash[24992]: audit 2024-08-31T09:14:20.051803+0000 mgr.a (mgr.14388) 18295 : audit [DBG] from='client.393588 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:22 smithi163 bash[24253]: cluster 2024-08-31T09:14:20.724880+0000 mgr.a (mgr.14388) 18296 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T09:14:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:22 smithi027 bash[22610]: cluster 2024-08-31T09:14:20.724880+0000 mgr.a (mgr.14388) 18296 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T09:14:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:22 smithi191 bash[24992]: cluster 2024-08-31T09:14:20.724880+0000 mgr.a (mgr.14388) 18296 : cluster [DBG] pgmap v12683: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T09:14:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:24 smithi163 bash[24253]: cluster 2024-08-31T09:14:22.725894+0000 mgr.a (mgr.14388) 18297 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T09:14:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:24 smithi027 bash[22610]: cluster 2024-08-31T09:14:22.725894+0000 mgr.a (mgr.14388) 18297 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T09:14:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:24 smithi191 bash[24992]: cluster 2024-08-31T09:14:22.725894+0000 mgr.a (mgr.14388) 18297 : cluster [DBG] pgmap v12684: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T09:14:25.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:14:25.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:14:25.497 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:14:26.248 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:14:26.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:14:26.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:14:26.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:14:26.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:14:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:26 smithi163 bash[24253]: cluster 2024-08-31T09:14:24.728206+0000 mgr.a (mgr.14388) 18298 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T09:14:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:26 smithi027 bash[22610]: cluster 2024-08-31T09:14:24.728206+0000 mgr.a (mgr.14388) 18298 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T09:14:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:26 smithi191 bash[24992]: cluster 2024-08-31T09:14:24.728206+0000 mgr.a (mgr.14388) 18298 : cluster [DBG] pgmap v12685: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T09:14:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:27 smithi163 bash[24253]: audit 2024-08-31T09:14:25.831476+0000 mgr.a (mgr.14388) 18299 : audit [DBG] from='client.393666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:27 smithi027 bash[22610]: audit 2024-08-31T09:14:25.831476+0000 mgr.a (mgr.14388) 18299 : audit [DBG] from='client.393666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:27 smithi191 bash[24992]: audit 2024-08-31T09:14:25.831476+0000 mgr.a (mgr.14388) 18299 : audit [DBG] from='client.393666 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:28 smithi163 bash[24253]: cluster 2024-08-31T09:14:26.729202+0000 mgr.a (mgr.14388) 18300 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:28 smithi027 bash[22610]: cluster 2024-08-31T09:14:26.729202+0000 mgr.a (mgr.14388) 18300 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:28 smithi191 bash[24992]: cluster 2024-08-31T09:14:26.729202+0000 mgr.a (mgr.14388) 18300 : cluster [DBG] pgmap v12686: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:29 smithi163 bash[24253]: cluster 2024-08-31T09:14:28.731450+0000 mgr.a (mgr.14388) 18301 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:29 smithi027 bash[22610]: cluster 2024-08-31T09:14:28.731450+0000 mgr.a (mgr.14388) 18301 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:30.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:29 smithi191 bash[24992]: cluster 2024-08-31T09:14:28.731450+0000 mgr.a (mgr.14388) 18301 : cluster [DBG] pgmap v12687: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:31.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:14:31.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:14:31.251 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:14:32.013 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:14:32.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:14:32.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:14:32.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:14:32.014 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:14:32.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:31 smithi163 bash[24253]: cluster 2024-08-31T09:14:30.732249+0000 mgr.a (mgr.14388) 18302 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:32.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:31 smithi163 bash[24253]: audit 2024-08-31T09:14:31.575121+0000 mgr.a (mgr.14388) 18303 : audit [DBG] from='client.393741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:31 smithi027 bash[22610]: cluster 2024-08-31T09:14:30.732249+0000 mgr.a (mgr.14388) 18302 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:31 smithi027 bash[22610]: audit 2024-08-31T09:14:31.575121+0000 mgr.a (mgr.14388) 18303 : audit [DBG] from='client.393741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:31 smithi191 bash[24992]: cluster 2024-08-31T09:14:30.732249+0000 mgr.a (mgr.14388) 18302 : cluster [DBG] pgmap v12688: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:31 smithi191 bash[24992]: audit 2024-08-31T09:14:31.575121+0000 mgr.a (mgr.14388) 18303 : audit [DBG] from='client.393741 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:34.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:33 smithi163 bash[24253]: cluster 2024-08-31T09:14:32.733202+0000 mgr.a (mgr.14388) 18304 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:33 smithi027 bash[22610]: cluster 2024-08-31T09:14:32.733202+0000 mgr.a (mgr.14388) 18304 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:33 smithi191 bash[24992]: cluster 2024-08-31T09:14:32.733202+0000 mgr.a (mgr.14388) 18304 : cluster [DBG] pgmap v12689: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:36.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:35 smithi163 bash[24253]: cluster 2024-08-31T09:14:34.735446+0000 mgr.a (mgr.14388) 18305 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:35 smithi027 bash[22610]: cluster 2024-08-31T09:14:34.735446+0000 mgr.a (mgr.14388) 18305 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:35 smithi191 bash[24992]: cluster 2024-08-31T09:14:34.735446+0000 mgr.a (mgr.14388) 18305 : cluster [DBG] pgmap v12690: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:37.015 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:14:37.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:14:37.016 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:14:37.771 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:14:37.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:14:37.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:14:37.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:14:37.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:14:38.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:37 smithi163 bash[24253]: cluster 2024-08-31T09:14:36.736198+0000 mgr.a (mgr.14388) 18306 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:38.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:37 smithi163 bash[24253]: audit 2024-08-31T09:14:37.344693+0000 mgr.a (mgr.14388) 18307 : audit [DBG] from='client.393813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:37 smithi027 bash[22610]: cluster 2024-08-31T09:14:36.736198+0000 mgr.a (mgr.14388) 18306 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:37 smithi027 bash[22610]: audit 2024-08-31T09:14:37.344693+0000 mgr.a (mgr.14388) 18307 : audit [DBG] from='client.393813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:37 smithi191 bash[24992]: cluster 2024-08-31T09:14:36.736198+0000 mgr.a (mgr.14388) 18306 : cluster [DBG] pgmap v12691: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:37 smithi191 bash[24992]: audit 2024-08-31T09:14:37.344693+0000 mgr.a (mgr.14388) 18307 : audit [DBG] from='client.393813 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:40.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:39 smithi163 bash[24253]: cluster 2024-08-31T09:14:38.738437+0000 mgr.a (mgr.14388) 18308 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:39 smithi027 bash[22610]: cluster 2024-08-31T09:14:38.738437+0000 mgr.a (mgr.14388) 18308 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:40.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:39 smithi191 bash[24992]: cluster 2024-08-31T09:14:38.738437+0000 mgr.a (mgr.14388) 18308 : cluster [DBG] pgmap v12692: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:14:42.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:41 smithi163 bash[24253]: cluster 2024-08-31T09:14:40.739393+0000 mgr.a (mgr.14388) 18309 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:41 smithi027 bash[22610]: cluster 2024-08-31T09:14:40.739393+0000 mgr.a (mgr.14388) 18309 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:42.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:41 smithi191 bash[24992]: cluster 2024-08-31T09:14:40.739393+0000 mgr.a (mgr.14388) 18309 : cluster [DBG] pgmap v12693: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:42.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:14:42.773 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:14:42.774 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:14:43.540 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:14:43.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:14:43.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:14:43.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:14:43.540 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:14:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:43 smithi163 bash[24253]: cluster 2024-08-31T09:14:42.740341+0000 mgr.a (mgr.14388) 18310 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:44.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:43 smithi163 bash[24253]: audit 2024-08-31T09:14:43.110413+0000 mgr.a (mgr.14388) 18311 : audit [DBG] from='client.393888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:43 smithi027 bash[22610]: cluster 2024-08-31T09:14:42.740341+0000 mgr.a (mgr.14388) 18310 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:43 smithi027 bash[22610]: audit 2024-08-31T09:14:43.110413+0000 mgr.a (mgr.14388) 18311 : audit [DBG] from='client.393888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:43 smithi191 bash[24992]: cluster 2024-08-31T09:14:42.740341+0000 mgr.a (mgr.14388) 18310 : cluster [DBG] pgmap v12694: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:43 smithi191 bash[24992]: audit 2024-08-31T09:14:43.110413+0000 mgr.a (mgr.14388) 18311 : audit [DBG] from='client.393888 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:46.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:45 smithi163 bash[24253]: cluster 2024-08-31T09:14:44.743366+0000 mgr.a (mgr.14388) 18312 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:45 smithi027 bash[22610]: cluster 2024-08-31T09:14:44.743366+0000 mgr.a (mgr.14388) 18312 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:46.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:45 smithi191 bash[24992]: cluster 2024-08-31T09:14:44.743366+0000 mgr.a (mgr.14388) 18312 : cluster [DBG] pgmap v12695: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:48.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:47 smithi163 bash[24253]: cluster 2024-08-31T09:14:46.744159+0000 mgr.a (mgr.14388) 18313 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:14:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:47 smithi027 bash[22610]: cluster 2024-08-31T09:14:46.744159+0000 mgr.a (mgr.14388) 18313 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:14:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:47 smithi191 bash[24992]: cluster 2024-08-31T09:14:46.744159+0000 mgr.a (mgr.14388) 18313 : cluster [DBG] pgmap v12696: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:14:48.541 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:14:48.542 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:14:48.543 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:14:49.326 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:14:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:14:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:14:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:14:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:14:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:49 smithi163 bash[24253]: cluster 2024-08-31T09:14:48.745414+0000 mgr.a (mgr.14388) 18314 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:49 smithi163 bash[24253]: audit 2024-08-31T09:14:48.883357+0000 mgr.a (mgr.14388) 18315 : audit [DBG] from='client.393963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:49 smithi027 bash[22610]: cluster 2024-08-31T09:14:48.745414+0000 mgr.a (mgr.14388) 18314 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:49 smithi027 bash[22610]: audit 2024-08-31T09:14:48.883357+0000 mgr.a (mgr.14388) 18315 : audit [DBG] from='client.393963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:49 smithi191 bash[24992]: cluster 2024-08-31T09:14:48.745414+0000 mgr.a (mgr.14388) 18314 : cluster [DBG] pgmap v12697: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:49 smithi191 bash[24992]: audit 2024-08-31T09:14:48.883357+0000 mgr.a (mgr.14388) 18315 : audit [DBG] from='client.393963 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:52.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:51 smithi163 bash[24253]: cluster 2024-08-31T09:14:50.746262+0000 mgr.a (mgr.14388) 18316 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:14:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:51 smithi027 bash[22610]: cluster 2024-08-31T09:14:50.746262+0000 mgr.a (mgr.14388) 18316 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:14:52.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:51 smithi191 bash[24992]: cluster 2024-08-31T09:14:50.746262+0000 mgr.a (mgr.14388) 18316 : cluster [DBG] pgmap v12698: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:14:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:53 smithi163 bash[24253]: cluster 2024-08-31T09:14:52.747062+0000 mgr.a (mgr.14388) 18317 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:14:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:53 smithi027 bash[22610]: cluster 2024-08-31T09:14:52.747062+0000 mgr.a (mgr.14388) 18317 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:14:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:53 smithi191 bash[24992]: cluster 2024-08-31T09:14:52.747062+0000 mgr.a (mgr.14388) 18317 : cluster [DBG] pgmap v12699: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:14:54.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:14:54.329 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:14:54.329 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:14:55.116 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:14:55.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:14:55.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:14:55.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:14:55.117 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:14:56.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:55 smithi163 bash[24253]: audit 2024-08-31T09:14:54.667076+0000 mgr.a (mgr.14388) 18318 : audit [DBG] from='client.394041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:56.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:55 smithi163 bash[24253]: cluster 2024-08-31T09:14:54.748429+0000 mgr.a (mgr.14388) 18319 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:55 smithi027 bash[22610]: audit 2024-08-31T09:14:54.667076+0000 mgr.a (mgr.14388) 18318 : audit [DBG] from='client.394041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:55 smithi027 bash[22610]: cluster 2024-08-31T09:14:54.748429+0000 mgr.a (mgr.14388) 18319 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:55 smithi191 bash[24992]: audit 2024-08-31T09:14:54.667076+0000 mgr.a (mgr.14388) 18318 : audit [DBG] from='client.394041 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:14:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:55 smithi191 bash[24992]: cluster 2024-08-31T09:14:54.748429+0000 mgr.a (mgr.14388) 18319 : cluster [DBG] pgmap v12700: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:58.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:57 smithi163 bash[24253]: cluster 2024-08-31T09:14:56.749273+0000 mgr.a (mgr.14388) 18320 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:57 smithi027 bash[22610]: cluster 2024-08-31T09:14:56.749273+0000 mgr.a (mgr.14388) 18320 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:14:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:57 smithi191 bash[24992]: cluster 2024-08-31T09:14:56.749273+0000 mgr.a (mgr.14388) 18320 : cluster [DBG] pgmap v12701: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:00.118 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:00.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:00.119 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:00.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:14:59 smithi163 bash[24253]: cluster 2024-08-31T09:14:58.751459+0000 mgr.a (mgr.14388) 18321 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:14:59 smithi027 bash[22610]: cluster 2024-08-31T09:14:58.751459+0000 mgr.a (mgr.14388) 18321 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:14:59 smithi191 bash[24992]: cluster 2024-08-31T09:14:58.751459+0000 mgr.a (mgr.14388) 18321 : cluster [DBG] pgmap v12702: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:00.900 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:00.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:00.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:00.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:00.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:00 smithi163 bash[24253]: audit 2024-08-31T09:15:00.451469+0000 mgr.a (mgr.14388) 18322 : audit [DBG] from='client.394119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:00 smithi027 bash[22610]: audit 2024-08-31T09:15:00.451469+0000 mgr.a (mgr.14388) 18322 : audit [DBG] from='client.394119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:00 smithi191 bash[24992]: audit 2024-08-31T09:15:00.451469+0000 mgr.a (mgr.14388) 18322 : audit [DBG] from='client.394119 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:01 smithi027 bash[22610]: cluster 2024-08-31T09:15:00.752018+0000 mgr.a (mgr.14388) 18323 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:01 smithi163 bash[24253]: cluster 2024-08-31T09:15:00.752018+0000 mgr.a (mgr.14388) 18323 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:02.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:01 smithi191 bash[24992]: cluster 2024-08-31T09:15:00.752018+0000 mgr.a (mgr.14388) 18323 : cluster [DBG] pgmap v12703: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:04.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:03 smithi163 bash[24253]: cluster 2024-08-31T09:15:02.752882+0000 mgr.a (mgr.14388) 18324 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:03 smithi027 bash[22610]: cluster 2024-08-31T09:15:02.752882+0000 mgr.a (mgr.14388) 18324 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:04.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:03 smithi191 bash[24992]: cluster 2024-08-31T09:15:02.752882+0000 mgr.a (mgr.14388) 18324 : cluster [DBG] pgmap v12704: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:05.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:05.902 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:05.902 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:06.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:05 smithi163 bash[24253]: cluster 2024-08-31T09:15:04.755139+0000 mgr.a (mgr.14388) 18325 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:05 smithi027 bash[22610]: cluster 2024-08-31T09:15:04.755139+0000 mgr.a (mgr.14388) 18325 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:05 smithi191 bash[24992]: cluster 2024-08-31T09:15:04.755139+0000 mgr.a (mgr.14388) 18325 : cluster [DBG] pgmap v12705: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:06.680 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:06.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:06 smithi163 bash[24253]: audit 2024-08-31T09:15:06.242940+0000 mgr.a (mgr.14388) 18326 : audit [DBG] from='client.394197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:06 smithi027 bash[22610]: audit 2024-08-31T09:15:06.242940+0000 mgr.a (mgr.14388) 18326 : audit [DBG] from='client.394197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:06 smithi191 bash[24992]: audit 2024-08-31T09:15:06.242940+0000 mgr.a (mgr.14388) 18326 : audit [DBG] from='client.394197 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:08.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:07 smithi163 bash[24253]: cluster 2024-08-31T09:15:06.756048+0000 mgr.a (mgr.14388) 18327 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:07 smithi027 bash[22610]: cluster 2024-08-31T09:15:06.756048+0000 mgr.a (mgr.14388) 18327 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:07 smithi191 bash[24992]: cluster 2024-08-31T09:15:06.756048+0000 mgr.a (mgr.14388) 18327 : cluster [DBG] pgmap v12706: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:08 smithi163 bash[24253]: audit 2024-08-31T09:15:08.098903+0000 mon.a (mon.0) 3303 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:15:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:08 smithi027 bash[22610]: audit 2024-08-31T09:15:08.098903+0000 mon.a (mon.0) 3303 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:15:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:08 smithi191 bash[24992]: audit 2024-08-31T09:15:08.098903+0000 mon.a (mon.0) 3303 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:15:10.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:09 smithi163 bash[24253]: cluster 2024-08-31T09:15:08.757425+0000 mgr.a (mgr.14388) 18328 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:09 smithi027 bash[22610]: cluster 2024-08-31T09:15:08.757425+0000 mgr.a (mgr.14388) 18328 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:10.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:09 smithi191 bash[24992]: cluster 2024-08-31T09:15:08.757425+0000 mgr.a (mgr.14388) 18328 : cluster [DBG] pgmap v12707: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:11.681 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:11.682 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:11.682 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:12.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:11 smithi163 bash[24253]: cluster 2024-08-31T09:15:10.758155+0000 mgr.a (mgr.14388) 18329 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:11 smithi027 bash[22610]: cluster 2024-08-31T09:15:10.758155+0000 mgr.a (mgr.14388) 18329 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:12.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:11 smithi191 bash[24992]: cluster 2024-08-31T09:15:10.758155+0000 mgr.a (mgr.14388) 18329 : cluster [DBG] pgmap v12708: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:12.420 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:12.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:12.420 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:12.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:12.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:12 smithi163 bash[24253]: audit 2024-08-31T09:15:12.017172+0000 mgr.a (mgr.14388) 18330 : audit [DBG] from='client.394272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:12 smithi027 bash[22610]: audit 2024-08-31T09:15:12.017172+0000 mgr.a (mgr.14388) 18330 : audit [DBG] from='client.394272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:13.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:12 smithi191 bash[24992]: audit 2024-08-31T09:15:12.017172+0000 mgr.a (mgr.14388) 18330 : audit [DBG] from='client.394272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:14.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:13 smithi163 bash[24253]: cluster 2024-08-31T09:15:12.759074+0000 mgr.a (mgr.14388) 18331 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:13 smithi027 bash[22610]: cluster 2024-08-31T09:15:12.759074+0000 mgr.a (mgr.14388) 18331 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:14.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:13 smithi191 bash[24992]: cluster 2024-08-31T09:15:12.759074+0000 mgr.a (mgr.14388) 18331 : cluster [DBG] pgmap v12709: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:16.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:15 smithi163 bash[24253]: cluster 2024-08-31T09:15:14.761329+0000 mgr.a (mgr.14388) 18332 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:15 smithi027 bash[22610]: cluster 2024-08-31T09:15:14.761329+0000 mgr.a (mgr.14388) 18332 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:15 smithi191 bash[24992]: cluster 2024-08-31T09:15:14.761329+0000 mgr.a (mgr.14388) 18332 : cluster [DBG] pgmap v12710: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:17.421 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:17.422 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:18.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:17 smithi163 bash[24253]: cluster 2024-08-31T09:15:16.762021+0000 mgr.a (mgr.14388) 18333 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:18.206 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:17 smithi027 bash[22610]: cluster 2024-08-31T09:15:16.762021+0000 mgr.a (mgr.14388) 18333 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:18.218 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:18.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:18.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:18.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:18.219 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:17 smithi191 bash[24992]: cluster 2024-08-31T09:15:16.762021+0000 mgr.a (mgr.14388) 18333 : cluster [DBG] pgmap v12711: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:18 smithi163 bash[24253]: audit 2024-08-31T09:15:17.796216+0000 mgr.a (mgr.14388) 18334 : audit [DBG] from='client.394347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:18 smithi163 bash[24253]: audit 2024-08-31T09:15:18.887638+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:15:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:18 smithi163 bash[24253]: audit 2024-08-31T09:15:18.897023+0000 mon.a (mon.0) 3305 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:15:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:18 smithi163 bash[24253]: audit 2024-08-31T09:15:18.899436+0000 mon.a (mon.0) 3306 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:15:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:18 smithi163 bash[24253]: audit 2024-08-31T09:15:18.901096+0000 mon.a (mon.0) 3307 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:15:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:18 smithi027 bash[22610]: audit 2024-08-31T09:15:17.796216+0000 mgr.a (mgr.14388) 18334 : audit [DBG] from='client.394347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:18 smithi027 bash[22610]: audit 2024-08-31T09:15:18.887638+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:15:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:18 smithi027 bash[22610]: audit 2024-08-31T09:15:18.897023+0000 mon.a (mon.0) 3305 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:15:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:18 smithi027 bash[22610]: audit 2024-08-31T09:15:18.899436+0000 mon.a (mon.0) 3306 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:15:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:18 smithi027 bash[22610]: audit 2024-08-31T09:15:18.901096+0000 mon.a (mon.0) 3307 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:15:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:18 smithi191 bash[24992]: audit 2024-08-31T09:15:17.796216+0000 mgr.a (mgr.14388) 18334 : audit [DBG] from='client.394347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:18 smithi191 bash[24992]: audit 2024-08-31T09:15:18.887638+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:15:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:18 smithi191 bash[24992]: audit 2024-08-31T09:15:18.897023+0000 mon.a (mon.0) 3305 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:15:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:18 smithi191 bash[24992]: audit 2024-08-31T09:15:18.899436+0000 mon.a (mon.0) 3306 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:15:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:18 smithi191 bash[24992]: audit 2024-08-31T09:15:18.901096+0000 mon.a (mon.0) 3307 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:15:19.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:15:19 smithi027 bash[22863]: debug 2024-08-31T09:15:19.679+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:15:20.173 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:15:19 smithi027 bash[22863]: debug 2024-08-31T09:15:19.683+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:15:20.173 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:19 smithi027 bash[22610]: cluster 2024-08-31T09:15:18.764816+0000 mgr.a (mgr.14388) 18335 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:20.173 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:19 smithi027 bash[22610]: audit 2024-08-31T09:15:18.912520+0000 mon.a (mon.0) 3308 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:15:20.173 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:19 smithi027 bash[22610]: audit 2024-08-31T09:15:18.919594+0000 mon.a (mon.0) 3309 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:15:20.173 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:19 smithi027 bash[22610]: audit 2024-08-31T09:15:18.922219+0000 mgr.a (mgr.14388) 18336 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:15:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:19 smithi163 bash[24253]: cluster 2024-08-31T09:15:18.764816+0000 mgr.a (mgr.14388) 18335 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:19 smithi163 bash[24253]: audit 2024-08-31T09:15:18.912520+0000 mon.a (mon.0) 3308 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:15:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:19 smithi163 bash[24253]: audit 2024-08-31T09:15:18.919594+0000 mon.a (mon.0) 3309 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:15:20.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:19 smithi163 bash[24253]: audit 2024-08-31T09:15:18.922219+0000 mgr.a (mgr.14388) 18336 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:15:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:19 smithi191 bash[24992]: cluster 2024-08-31T09:15:18.764816+0000 mgr.a (mgr.14388) 18335 : cluster [DBG] pgmap v12712: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:19 smithi191 bash[24992]: audit 2024-08-31T09:15:18.912520+0000 mon.a (mon.0) 3308 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:15:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:19 smithi191 bash[24992]: audit 2024-08-31T09:15:18.919594+0000 mon.a (mon.0) 3309 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:15:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:19 smithi191 bash[24992]: audit 2024-08-31T09:15:18.922219+0000 mgr.a (mgr.14388) 18336 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:15:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:20 smithi163 bash[24253]: audit 2024-08-31T09:15:19.686486+0000 mgr.a (mgr.14388) 18337 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:15:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:20 smithi163 bash[24253]: cephadm 2024-08-31T09:15:19.688150+0000 mgr.a (mgr.14388) 18338 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:15:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:20 smithi027 bash[22610]: audit 2024-08-31T09:15:19.686486+0000 mgr.a (mgr.14388) 18337 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:15:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:20 smithi027 bash[22610]: cephadm 2024-08-31T09:15:19.688150+0000 mgr.a (mgr.14388) 18338 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:15:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:20 smithi191 bash[24992]: audit 2024-08-31T09:15:19.686486+0000 mgr.a (mgr.14388) 18337 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:15:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:20 smithi191 bash[24992]: cephadm 2024-08-31T09:15:19.688150+0000 mgr.a (mgr.14388) 18338 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:15:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:21 smithi163 bash[24253]: cluster 2024-08-31T09:15:20.765697+0000 mgr.a (mgr.14388) 18339 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:15:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:21 smithi027 bash[22610]: cluster 2024-08-31T09:15:20.765697+0000 mgr.a (mgr.14388) 18339 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:15:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:21 smithi191 bash[24992]: cluster 2024-08-31T09:15:20.765697+0000 mgr.a (mgr.14388) 18339 : cluster [DBG] pgmap v12713: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:15:23.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:23.221 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:23.221 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:23.978 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:23.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:23.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:23.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:23.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:24.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:23 smithi163 bash[24253]: cluster 2024-08-31T09:15:22.766469+0000 mgr.a (mgr.14388) 18340 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:15:24.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:23 smithi163 bash[24253]: audit 2024-08-31T09:15:23.549916+0000 mgr.a (mgr.14388) 18341 : audit [DBG] from='client.394527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:23 smithi027 bash[22610]: cluster 2024-08-31T09:15:22.766469+0000 mgr.a (mgr.14388) 18340 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:15:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:23 smithi027 bash[22610]: audit 2024-08-31T09:15:23.549916+0000 mgr.a (mgr.14388) 18341 : audit [DBG] from='client.394527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:24.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:23 smithi191 bash[24992]: cluster 2024-08-31T09:15:22.766469+0000 mgr.a (mgr.14388) 18340 : cluster [DBG] pgmap v12714: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:15:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:23 smithi191 bash[24992]: audit 2024-08-31T09:15:23.549916+0000 mgr.a (mgr.14388) 18341 : audit [DBG] from='client.394527 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:26.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:25 smithi163 bash[24253]: cluster 2024-08-31T09:15:24.769224+0000 mgr.a (mgr.14388) 18342 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:25 smithi027 bash[22610]: cluster 2024-08-31T09:15:24.769224+0000 mgr.a (mgr.14388) 18342 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:25 smithi191 bash[24992]: cluster 2024-08-31T09:15:24.769224+0000 mgr.a (mgr.14388) 18342 : cluster [DBG] pgmap v12715: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:28.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:27 smithi163 bash[24253]: cluster 2024-08-31T09:15:26.770009+0000 mgr.a (mgr.14388) 18343 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:15:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:27 smithi027 bash[22610]: cluster 2024-08-31T09:15:26.770009+0000 mgr.a (mgr.14388) 18343 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:15:28.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:27 smithi191 bash[24992]: cluster 2024-08-31T09:15:26.770009+0000 mgr.a (mgr.14388) 18343 : cluster [DBG] pgmap v12716: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:15:28.979 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:28.980 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:28.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:29.767 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:29.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:29.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:29.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:29.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:29 smithi027 bash[22610]: cluster 2024-08-31T09:15:28.772050+0000 mgr.a (mgr.14388) 18344 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:29 smithi027 bash[22610]: audit 2024-08-31T09:15:29.318153+0000 mgr.a (mgr.14388) 18345 : audit [DBG] from='client.394605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:29 smithi191 bash[24992]: cluster 2024-08-31T09:15:28.772050+0000 mgr.a (mgr.14388) 18344 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:29 smithi191 bash[24992]: audit 2024-08-31T09:15:29.318153+0000 mgr.a (mgr.14388) 18345 : audit [DBG] from='client.394605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:29 smithi163 bash[24253]: cluster 2024-08-31T09:15:28.772050+0000 mgr.a (mgr.14388) 18344 : cluster [DBG] pgmap v12717: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:30.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:29 smithi163 bash[24253]: audit 2024-08-31T09:15:29.318153+0000 mgr.a (mgr.14388) 18345 : audit [DBG] from='client.394605 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:31 smithi027 bash[22610]: cluster 2024-08-31T09:15:30.772928+0000 mgr.a (mgr.14388) 18346 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:32.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:31 smithi191 bash[24992]: cluster 2024-08-31T09:15:30.772928+0000 mgr.a (mgr.14388) 18346 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:31 smithi163 bash[24253]: cluster 2024-08-31T09:15:30.772928+0000 mgr.a (mgr.14388) 18346 : cluster [DBG] pgmap v12718: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:34.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:33 smithi027 bash[22610]: cluster 2024-08-31T09:15:32.773717+0000 mgr.a (mgr.14388) 18347 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:33 smithi191 bash[24992]: cluster 2024-08-31T09:15:32.773717+0000 mgr.a (mgr.14388) 18347 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:34.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:33 smithi163 bash[24253]: cluster 2024-08-31T09:15:32.773717+0000 mgr.a (mgr.14388) 18347 : cluster [DBG] pgmap v12719: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:34.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:34.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:34.769 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:35.512 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:35.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:35.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:35.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:35.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:35 smithi027 bash[22610]: cluster 2024-08-31T09:15:34.775995+0000 mgr.a (mgr.14388) 18348 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:35 smithi027 bash[22610]: audit 2024-08-31T09:15:35.101525+0000 mgr.a (mgr.14388) 18349 : audit [DBG] from='client.394680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:35 smithi191 bash[24992]: cluster 2024-08-31T09:15:34.775995+0000 mgr.a (mgr.14388) 18348 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:35 smithi191 bash[24992]: audit 2024-08-31T09:15:35.101525+0000 mgr.a (mgr.14388) 18349 : audit [DBG] from='client.394680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:35 smithi163 bash[24253]: cluster 2024-08-31T09:15:34.775995+0000 mgr.a (mgr.14388) 18348 : cluster [DBG] pgmap v12720: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:15:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:35 smithi163 bash[24253]: audit 2024-08-31T09:15:35.101525+0000 mgr.a (mgr.14388) 18349 : audit [DBG] from='client.394680 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:37 smithi027 bash[22610]: cluster 2024-08-31T09:15:36.776916+0000 mgr.a (mgr.14388) 18350 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:37 smithi191 bash[24992]: cluster 2024-08-31T09:15:36.776916+0000 mgr.a (mgr.14388) 18350 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:37 smithi163 bash[24253]: cluster 2024-08-31T09:15:36.776916+0000 mgr.a (mgr.14388) 18350 : cluster [DBG] pgmap v12721: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:39 smithi027 bash[22610]: cluster 2024-08-31T09:15:38.779195+0000 mgr.a (mgr.14388) 18351 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:39 smithi191 bash[24992]: cluster 2024-08-31T09:15:38.779195+0000 mgr.a (mgr.14388) 18351 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:40.458 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:39 smithi163 bash[24253]: cluster 2024-08-31T09:15:38.779195+0000 mgr.a (mgr.14388) 18351 : cluster [DBG] pgmap v12722: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:40.514 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:40.515 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:40.516 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:41.293 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:41.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:41.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:41.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:41.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:41 smithi027 bash[22610]: cluster 2024-08-31T09:15:40.779940+0000 mgr.a (mgr.14388) 18352 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:41 smithi027 bash[22610]: audit 2024-08-31T09:15:40.850511+0000 mgr.a (mgr.14388) 18353 : audit [DBG] from='client.394758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:41 smithi191 bash[24992]: cluster 2024-08-31T09:15:40.779940+0000 mgr.a (mgr.14388) 18352 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:41 smithi191 bash[24992]: audit 2024-08-31T09:15:40.850511+0000 mgr.a (mgr.14388) 18353 : audit [DBG] from='client.394758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:42.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:41 smithi163 bash[24253]: cluster 2024-08-31T09:15:40.779940+0000 mgr.a (mgr.14388) 18352 : cluster [DBG] pgmap v12723: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:42.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:41 smithi163 bash[24253]: audit 2024-08-31T09:15:40.850511+0000 mgr.a (mgr.14388) 18353 : audit [DBG] from='client.394758 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:43 smithi027 bash[22610]: cluster 2024-08-31T09:15:42.780813+0000 mgr.a (mgr.14388) 18354 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:43 smithi191 bash[24992]: cluster 2024-08-31T09:15:42.780813+0000 mgr.a (mgr.14388) 18354 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:44.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:43 smithi163 bash[24253]: cluster 2024-08-31T09:15:42.780813+0000 mgr.a (mgr.14388) 18354 : cluster [DBG] pgmap v12724: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:45 smithi191 bash[24992]: cluster 2024-08-31T09:15:44.783070+0000 mgr.a (mgr.14388) 18355 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:46.294 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:46.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:46.295 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:45 smithi163 bash[24253]: cluster 2024-08-31T09:15:44.783070+0000 mgr.a (mgr.14388) 18355 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:45 smithi027 bash[22610]: cluster 2024-08-31T09:15:44.783070+0000 mgr.a (mgr.14388) 18355 : cluster [DBG] pgmap v12725: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:47.088 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:47.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:47.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:47.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:47.089 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:46 smithi191 bash[24992]: audit 2024-08-31T09:15:46.635812+0000 mgr.a (mgr.14388) 18356 : audit [DBG] from='client.394833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:46 smithi163 bash[24253]: audit 2024-08-31T09:15:46.635812+0000 mgr.a (mgr.14388) 18356 : audit [DBG] from='client.394833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:46 smithi027 bash[22610]: audit 2024-08-31T09:15:46.635812+0000 mgr.a (mgr.14388) 18356 : audit [DBG] from='client.394833 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:47 smithi191 bash[24992]: cluster 2024-08-31T09:15:46.783867+0000 mgr.a (mgr.14388) 18357 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:48.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:47 smithi163 bash[24253]: cluster 2024-08-31T09:15:46.783867+0000 mgr.a (mgr.14388) 18357 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:47 smithi027 bash[22610]: cluster 2024-08-31T09:15:46.783867+0000 mgr.a (mgr.14388) 18357 : cluster [DBG] pgmap v12726: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:50.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:50 smithi191 bash[24992]: cluster 2024-08-31T09:15:48.786208+0000 mgr.a (mgr.14388) 18358 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:50.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:50 smithi163 bash[24253]: cluster 2024-08-31T09:15:48.786208+0000 mgr.a (mgr.14388) 18358 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:50 smithi027 bash[22610]: cluster 2024-08-31T09:15:48.786208+0000 mgr.a (mgr.14388) 18358 : cluster [DBG] pgmap v12727: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:52.090 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:52.091 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:52 smithi191 bash[24992]: cluster 2024-08-31T09:15:50.787063+0000 mgr.a (mgr.14388) 18359 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:52 smithi163 bash[24253]: cluster 2024-08-31T09:15:50.787063+0000 mgr.a (mgr.14388) 18359 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:52 smithi027 bash[22610]: cluster 2024-08-31T09:15:50.787063+0000 mgr.a (mgr.14388) 18359 : cluster [DBG] pgmap v12728: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:52.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:52.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:52.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:52.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:52.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:53 smithi191 bash[24992]: audit 2024-08-31T09:15:52.426546+0000 mgr.a (mgr.14388) 18360 : audit [DBG] from='client.394908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:53 smithi163 bash[24253]: audit 2024-08-31T09:15:52.426546+0000 mgr.a (mgr.14388) 18360 : audit [DBG] from='client.394908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:53 smithi027 bash[22610]: audit 2024-08-31T09:15:52.426546+0000 mgr.a (mgr.14388) 18360 : audit [DBG] from='client.394908 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:54.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:54 smithi191 bash[24992]: cluster 2024-08-31T09:15:52.787579+0000 mgr.a (mgr.14388) 18361 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:54 smithi163 bash[24253]: cluster 2024-08-31T09:15:52.787579+0000 mgr.a (mgr.14388) 18361 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:54 smithi027 bash[22610]: cluster 2024-08-31T09:15:52.787579+0000 mgr.a (mgr.14388) 18361 : cluster [DBG] pgmap v12729: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:56.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:56 smithi191 bash[24992]: cluster 2024-08-31T09:15:54.789764+0000 mgr.a (mgr.14388) 18362 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:56.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:56 smithi163 bash[24253]: cluster 2024-08-31T09:15:54.789764+0000 mgr.a (mgr.14388) 18362 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:56 smithi027 bash[22610]: cluster 2024-08-31T09:15:54.789764+0000 mgr.a (mgr.14388) 18362 : cluster [DBG] pgmap v12730: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:15:57.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:15:57.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:15:57.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:15:58.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:58 smithi191 bash[24992]: cluster 2024-08-31T09:15:56.790540+0000 mgr.a (mgr.14388) 18363 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:58.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:58 smithi163 bash[24253]: cluster 2024-08-31T09:15:56.790540+0000 mgr.a (mgr.14388) 18363 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:58.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:58 smithi027 bash[22610]: cluster 2024-08-31T09:15:56.790540+0000 mgr.a (mgr.14388) 18363 : cluster [DBG] pgmap v12731: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:15:58.636 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:15:58.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:15:58.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:15:58.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:15:58.636 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:15:59.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:15:59 smithi191 bash[24992]: audit 2024-08-31T09:15:58.206495+0000 mgr.a (mgr.14388) 18364 : audit [DBG] from='client.394986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:15:59 smithi163 bash[24253]: audit 2024-08-31T09:15:58.206495+0000 mgr.a (mgr.14388) 18364 : audit [DBG] from='client.394986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:15:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:15:59 smithi027 bash[22610]: audit 2024-08-31T09:15:58.206495+0000 mgr.a (mgr.14388) 18364 : audit [DBG] from='client.394986 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:00 smithi191 bash[24992]: cluster 2024-08-31T09:15:58.793209+0000 mgr.a (mgr.14388) 18365 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:00 smithi163 bash[24253]: cluster 2024-08-31T09:15:58.793209+0000 mgr.a (mgr.14388) 18365 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:00 smithi027 bash[22610]: cluster 2024-08-31T09:15:58.793209+0000 mgr.a (mgr.14388) 18365 : cluster [DBG] pgmap v12732: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:02 smithi163 bash[24253]: cluster 2024-08-31T09:16:00.793971+0000 mgr.a (mgr.14388) 18366 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:16:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:02 smithi027 bash[22610]: cluster 2024-08-31T09:16:00.793971+0000 mgr.a (mgr.14388) 18366 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:16:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:02 smithi191 bash[24992]: cluster 2024-08-31T09:16:00.793971+0000 mgr.a (mgr.14388) 18366 : cluster [DBG] pgmap v12733: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:16:03.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:16:03.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:16:03.638 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:16:04.388 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:16:04.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:16:04.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:16:04.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:16:04.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:16:04.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:04 smithi163 bash[24253]: cluster 2024-08-31T09:16:02.794748+0000 mgr.a (mgr.14388) 18367 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:16:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:04 smithi027 bash[22610]: cluster 2024-08-31T09:16:02.794748+0000 mgr.a (mgr.14388) 18367 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:16:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:04 smithi191 bash[24992]: cluster 2024-08-31T09:16:02.794748+0000 mgr.a (mgr.14388) 18367 : cluster [DBG] pgmap v12734: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:16:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:05 smithi163 bash[24253]: audit 2024-08-31T09:16:03.968858+0000 mgr.a (mgr.14388) 18368 : audit [DBG] from='client.395061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:05 smithi027 bash[22610]: audit 2024-08-31T09:16:03.968858+0000 mgr.a (mgr.14388) 18368 : audit [DBG] from='client.395061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:05.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:05 smithi191 bash[24992]: audit 2024-08-31T09:16:03.968858+0000 mgr.a (mgr.14388) 18368 : audit [DBG] from='client.395061 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:06 smithi163 bash[24253]: cluster 2024-08-31T09:16:04.797647+0000 mgr.a (mgr.14388) 18369 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:06 smithi027 bash[22610]: cluster 2024-08-31T09:16:04.797647+0000 mgr.a (mgr.14388) 18369 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:06 smithi191 bash[24992]: cluster 2024-08-31T09:16:04.797647+0000 mgr.a (mgr.14388) 18369 : cluster [DBG] pgmap v12735: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:08 smithi163 bash[24253]: cluster 2024-08-31T09:16:06.798582+0000 mgr.a (mgr.14388) 18370 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:16:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:08 smithi027 bash[22610]: cluster 2024-08-31T09:16:06.798582+0000 mgr.a (mgr.14388) 18370 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:16:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:08 smithi191 bash[24992]: cluster 2024-08-31T09:16:06.798582+0000 mgr.a (mgr.14388) 18370 : cluster [DBG] pgmap v12736: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:16:09.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:16:09.390 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:16:09.390 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:16:10.169 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:16:10.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:16:10.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:16:10.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:16:10.170 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:16:10.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:10 smithi163 bash[24253]: cluster 2024-08-31T09:16:08.800610+0000 mgr.a (mgr.14388) 18371 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:10.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:10 smithi027 bash[22610]: cluster 2024-08-31T09:16:08.800610+0000 mgr.a (mgr.14388) 18371 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:10 smithi191 bash[24992]: cluster 2024-08-31T09:16:08.800610+0000 mgr.a (mgr.14388) 18371 : cluster [DBG] pgmap v12737: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:11 smithi163 bash[24253]: audit 2024-08-31T09:16:09.727226+0000 mgr.a (mgr.14388) 18372 : audit [DBG] from='client.395136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:11 smithi027 bash[22610]: audit 2024-08-31T09:16:09.727226+0000 mgr.a (mgr.14388) 18372 : audit [DBG] from='client.395136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:11 smithi191 bash[24992]: audit 2024-08-31T09:16:09.727226+0000 mgr.a (mgr.14388) 18372 : audit [DBG] from='client.395136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:12 smithi163 bash[24253]: cluster 2024-08-31T09:16:10.801527+0000 mgr.a (mgr.14388) 18373 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:12 smithi027 bash[22610]: cluster 2024-08-31T09:16:10.801527+0000 mgr.a (mgr.14388) 18373 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:12 smithi191 bash[24992]: cluster 2024-08-31T09:16:10.801527+0000 mgr.a (mgr.14388) 18373 : cluster [DBG] pgmap v12738: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:14 smithi163 bash[24253]: cluster 2024-08-31T09:16:12.802321+0000 mgr.a (mgr.14388) 18374 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:14 smithi027 bash[22610]: cluster 2024-08-31T09:16:12.802321+0000 mgr.a (mgr.14388) 18374 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:14 smithi191 bash[24992]: cluster 2024-08-31T09:16:12.802321+0000 mgr.a (mgr.14388) 18374 : cluster [DBG] pgmap v12739: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:15.171 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:16:15.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:16:15.172 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:16:15.946 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:16:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:16:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:16:15.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:16:15.947 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:16:16.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:16 smithi163 bash[24253]: cluster 2024-08-31T09:16:14.804541+0000 mgr.a (mgr.14388) 18375 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:16.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:16 smithi163 bash[24253]: audit 2024-08-31T09:16:15.504894+0000 mgr.a (mgr.14388) 18376 : audit [DBG] from='client.395214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:16 smithi027 bash[22610]: cluster 2024-08-31T09:16:14.804541+0000 mgr.a (mgr.14388) 18375 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:16 smithi027 bash[22610]: audit 2024-08-31T09:16:15.504894+0000 mgr.a (mgr.14388) 18376 : audit [DBG] from='client.395214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:16 smithi191 bash[24992]: cluster 2024-08-31T09:16:14.804541+0000 mgr.a (mgr.14388) 18375 : cluster [DBG] pgmap v12740: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:16 smithi191 bash[24992]: audit 2024-08-31T09:16:15.504894+0000 mgr.a (mgr.14388) 18376 : audit [DBG] from='client.395214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:18 smithi163 bash[24253]: cluster 2024-08-31T09:16:16.805527+0000 mgr.a (mgr.14388) 18377 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:18 smithi027 bash[22610]: cluster 2024-08-31T09:16:16.805527+0000 mgr.a (mgr.14388) 18377 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:18 smithi191 bash[24992]: cluster 2024-08-31T09:16:16.805527+0000 mgr.a (mgr.14388) 18377 : cluster [DBG] pgmap v12741: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:20 smithi163 bash[24253]: cluster 2024-08-31T09:16:18.807783+0000 mgr.a (mgr.14388) 18378 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:20 smithi163 bash[24253]: audit 2024-08-31T09:16:19.752114+0000 mon.a (mon.0) 3310 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:16:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:20 smithi027 bash[22610]: cluster 2024-08-31T09:16:18.807783+0000 mgr.a (mgr.14388) 18378 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:20 smithi027 bash[22610]: audit 2024-08-31T09:16:19.752114+0000 mon.a (mon.0) 3310 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:16:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:20 smithi191 bash[24992]: cluster 2024-08-31T09:16:18.807783+0000 mgr.a (mgr.14388) 18378 : cluster [DBG] pgmap v12742: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:20 smithi191 bash[24992]: audit 2024-08-31T09:16:19.752114+0000 mon.a (mon.0) 3310 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:16:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:16:20.948 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:16:20.949 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:16:21.695 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:16:21.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:16:21.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:16:21.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:16:21.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:16:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:21 smithi163 bash[24253]: audit 2024-08-31T09:16:20.384593+0000 mon.a (mon.0) 3311 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:21 smithi163 bash[24253]: audit 2024-08-31T09:16:20.388876+0000 mon.a (mon.0) 3312 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:21 smithi027 bash[22610]: audit 2024-08-31T09:16:20.384593+0000 mon.a (mon.0) 3311 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:21 smithi027 bash[22610]: audit 2024-08-31T09:16:20.388876+0000 mon.a (mon.0) 3312 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:21 smithi191 bash[24992]: audit 2024-08-31T09:16:20.384593+0000 mon.a (mon.0) 3311 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:21 smithi191 bash[24992]: audit 2024-08-31T09:16:20.388876+0000 mon.a (mon.0) 3312 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:22 smithi163 bash[24253]: cluster 2024-08-31T09:16:20.808632+0000 mgr.a (mgr.14388) 18379 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:22 smithi163 bash[24253]: audit 2024-08-31T09:16:21.273253+0000 mgr.a (mgr.14388) 18380 : audit [DBG] from='client.395292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:22 smithi027 bash[22610]: cluster 2024-08-31T09:16:20.808632+0000 mgr.a (mgr.14388) 18379 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:22 smithi027 bash[22610]: audit 2024-08-31T09:16:21.273253+0000 mgr.a (mgr.14388) 18380 : audit [DBG] from='client.395292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:22 smithi191 bash[24992]: cluster 2024-08-31T09:16:20.808632+0000 mgr.a (mgr.14388) 18379 : cluster [DBG] pgmap v12743: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:22 smithi191 bash[24992]: audit 2024-08-31T09:16:21.273253+0000 mgr.a (mgr.14388) 18380 : audit [DBG] from='client.395292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:24 smithi163 bash[24253]: cluster 2024-08-31T09:16:22.809634+0000 mgr.a (mgr.14388) 18381 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:24 smithi027 bash[22610]: cluster 2024-08-31T09:16:22.809634+0000 mgr.a (mgr.14388) 18381 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:24 smithi191 bash[24992]: cluster 2024-08-31T09:16:22.809634+0000 mgr.a (mgr.14388) 18381 : cluster [DBG] pgmap v12744: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:26.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:16:26.697 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:16:26.698 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:16:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:26 smithi163 bash[24253]: cluster 2024-08-31T09:16:24.811890+0000 mgr.a (mgr.14388) 18382 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:26 smithi027 bash[22610]: cluster 2024-08-31T09:16:24.811890+0000 mgr.a (mgr.14388) 18382 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:26 smithi191 bash[24992]: cluster 2024-08-31T09:16:24.811890+0000 mgr.a (mgr.14388) 18382 : cluster [DBG] pgmap v12745: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:27.440 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:16:27.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:16:27.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:16:27.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:16:27.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:16:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:28 smithi163 bash[24253]: cluster 2024-08-31T09:16:26.812367+0000 mgr.a (mgr.14388) 18383 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:28 smithi163 bash[24253]: audit 2024-08-31T09:16:27.018869+0000 mgr.a (mgr.14388) 18384 : audit [DBG] from='client.395364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:28 smithi027 bash[22610]: cluster 2024-08-31T09:16:26.812367+0000 mgr.a (mgr.14388) 18383 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:28 smithi027 bash[22610]: audit 2024-08-31T09:16:27.018869+0000 mgr.a (mgr.14388) 18384 : audit [DBG] from='client.395364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:28 smithi191 bash[24992]: cluster 2024-08-31T09:16:26.812367+0000 mgr.a (mgr.14388) 18383 : cluster [DBG] pgmap v12746: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:28 smithi191 bash[24992]: audit 2024-08-31T09:16:27.018869+0000 mgr.a (mgr.14388) 18384 : audit [DBG] from='client.395364 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:30 smithi163 bash[24253]: cluster 2024-08-31T09:16:28.814747+0000 mgr.a (mgr.14388) 18385 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:30 smithi163 bash[24253]: audit 2024-08-31T09:16:29.795976+0000 mon.a (mon.0) 3313 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:30.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:30 smithi163 bash[24253]: audit 2024-08-31T09:16:29.804559+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:30.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:30 smithi027 bash[22610]: cluster 2024-08-31T09:16:28.814747+0000 mgr.a (mgr.14388) 18385 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:30 smithi027 bash[22610]: audit 2024-08-31T09:16:29.795976+0000 mon.a (mon.0) 3313 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:30 smithi027 bash[22610]: audit 2024-08-31T09:16:29.804559+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:30 smithi191 bash[24992]: cluster 2024-08-31T09:16:28.814747+0000 mgr.a (mgr.14388) 18385 : cluster [DBG] pgmap v12747: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:30 smithi191 bash[24992]: audit 2024-08-31T09:16:29.795976+0000 mon.a (mon.0) 3313 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:30 smithi191 bash[24992]: audit 2024-08-31T09:16:29.804559+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:31.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:16:31 smithi027 bash[22863]: debug 2024-08-31T09:16:31.377+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:16:31.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:16:31 smithi027 bash[22863]: debug 2024-08-31T09:16:31.377+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:16:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:31 smithi027 bash[22610]: audit 2024-08-31T09:16:30.555843+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:31 smithi027 bash[22610]: audit 2024-08-31T09:16:30.564959+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:31 smithi027 bash[22610]: audit 2024-08-31T09:16:30.567467+0000 mon.a (mon.0) 3317 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:16:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:31 smithi027 bash[22610]: audit 2024-08-31T09:16:30.569685+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:16:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:31 smithi027 bash[22610]: audit 2024-08-31T09:16:30.581159+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:31 smithi027 bash[22610]: audit 2024-08-31T09:16:30.586981+0000 mon.a (mon.0) 3320 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:16:31.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:31 smithi027 bash[22610]: audit 2024-08-31T09:16:30.589514+0000 mgr.a (mgr.14388) 18386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:16:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:31 smithi163 bash[24253]: audit 2024-08-31T09:16:30.555843+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:31 smithi163 bash[24253]: audit 2024-08-31T09:16:30.564959+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:31 smithi163 bash[24253]: audit 2024-08-31T09:16:30.567467+0000 mon.a (mon.0) 3317 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:16:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:31 smithi163 bash[24253]: audit 2024-08-31T09:16:30.569685+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:16:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:31 smithi163 bash[24253]: audit 2024-08-31T09:16:30.581159+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:31 smithi163 bash[24253]: audit 2024-08-31T09:16:30.586981+0000 mon.a (mon.0) 3320 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:16:31.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:31 smithi163 bash[24253]: audit 2024-08-31T09:16:30.589514+0000 mgr.a (mgr.14388) 18386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:16:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:31 smithi191 bash[24992]: audit 2024-08-31T09:16:30.555843+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:31 smithi191 bash[24992]: audit 2024-08-31T09:16:30.564959+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:31 smithi191 bash[24992]: audit 2024-08-31T09:16:30.567467+0000 mon.a (mon.0) 3317 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:16:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:31 smithi191 bash[24992]: audit 2024-08-31T09:16:30.569685+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:16:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:31 smithi191 bash[24992]: audit 2024-08-31T09:16:30.581159+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:16:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:31 smithi191 bash[24992]: audit 2024-08-31T09:16:30.586981+0000 mon.a (mon.0) 3320 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:16:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:31 smithi191 bash[24992]: audit 2024-08-31T09:16:30.589514+0000 mgr.a (mgr.14388) 18386 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:16:32.442 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:16:32.443 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:16:32.443 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:16:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:32 smithi163 bash[24253]: cluster 2024-08-31T09:16:30.815438+0000 mgr.a (mgr.14388) 18387 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:32 smithi163 bash[24253]: audit 2024-08-31T09:16:31.378835+0000 mgr.a (mgr.14388) 18388 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:16:32.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:32 smithi163 bash[24253]: cephadm 2024-08-31T09:16:31.380455+0000 mgr.a (mgr.14388) 18389 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:16:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:32 smithi027 bash[22610]: cluster 2024-08-31T09:16:30.815438+0000 mgr.a (mgr.14388) 18387 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:32 smithi027 bash[22610]: audit 2024-08-31T09:16:31.378835+0000 mgr.a (mgr.14388) 18388 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:16:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:32 smithi027 bash[22610]: cephadm 2024-08-31T09:16:31.380455+0000 mgr.a (mgr.14388) 18389 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:16:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:32 smithi191 bash[24992]: cluster 2024-08-31T09:16:30.815438+0000 mgr.a (mgr.14388) 18387 : cluster [DBG] pgmap v12748: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:32 smithi191 bash[24992]: audit 2024-08-31T09:16:31.378835+0000 mgr.a (mgr.14388) 18388 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:16:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:32 smithi191 bash[24992]: cephadm 2024-08-31T09:16:31.380455+0000 mgr.a (mgr.14388) 18389 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:16:33.224 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:16:33.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:16:33.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:16:33.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:16:33.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:16:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:34 smithi163 bash[24253]: audit 2024-08-31T09:16:32.784212+0000 mgr.a (mgr.14388) 18390 : audit [DBG] from='client.395538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:34 smithi163 bash[24253]: cluster 2024-08-31T09:16:32.825908+0000 mgr.a (mgr.14388) 18391 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:34 smithi027 bash[22610]: audit 2024-08-31T09:16:32.784212+0000 mgr.a (mgr.14388) 18390 : audit [DBG] from='client.395538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:34 smithi027 bash[22610]: cluster 2024-08-31T09:16:32.825908+0000 mgr.a (mgr.14388) 18391 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:34 smithi191 bash[24992]: audit 2024-08-31T09:16:32.784212+0000 mgr.a (mgr.14388) 18390 : audit [DBG] from='client.395538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:34 smithi191 bash[24992]: cluster 2024-08-31T09:16:32.825908+0000 mgr.a (mgr.14388) 18391 : cluster [DBG] pgmap v12749: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:36 smithi163 bash[24253]: cluster 2024-08-31T09:16:34.828706+0000 mgr.a (mgr.14388) 18392 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:16:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:36 smithi027 bash[22610]: cluster 2024-08-31T09:16:34.828706+0000 mgr.a (mgr.14388) 18392 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:16:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:36 smithi191 bash[24992]: cluster 2024-08-31T09:16:34.828706+0000 mgr.a (mgr.14388) 18392 : cluster [DBG] pgmap v12750: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:16:38.226 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:16:38.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:16:38.227 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:16:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:38 smithi163 bash[24253]: cluster 2024-08-31T09:16:36.829491+0000 mgr.a (mgr.14388) 18393 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-08-31T09:16:38.971 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:16:38.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:16:38.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:16:38.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:16:38.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:16:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:38 smithi027 bash[22610]: cluster 2024-08-31T09:16:36.829491+0000 mgr.a (mgr.14388) 18393 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-08-31T09:16:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:38 smithi191 bash[24992]: cluster 2024-08-31T09:16:36.829491+0000 mgr.a (mgr.14388) 18393 : cluster [DBG] pgmap v12751: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 425 B/s wr, 6 op/s 2024-08-31T09:16:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:39 smithi163 bash[24253]: audit 2024-08-31T09:16:38.559251+0000 mgr.a (mgr.14388) 18394 : audit [DBG] from='client.395613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:39 smithi027 bash[22610]: audit 2024-08-31T09:16:38.559251+0000 mgr.a (mgr.14388) 18394 : audit [DBG] from='client.395613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:40.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:39 smithi191 bash[24992]: audit 2024-08-31T09:16:38.559251+0000 mgr.a (mgr.14388) 18394 : audit [DBG] from='client.395613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:40 smithi163 bash[24253]: cluster 2024-08-31T09:16:38.830834+0000 mgr.a (mgr.14388) 18395 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:16:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:40 smithi027 bash[22610]: cluster 2024-08-31T09:16:38.830834+0000 mgr.a (mgr.14388) 18395 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:16:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:40 smithi191 bash[24992]: cluster 2024-08-31T09:16:38.830834+0000 mgr.a (mgr.14388) 18395 : cluster [DBG] pgmap v12752: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:16:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:42 smithi163 bash[24253]: cluster 2024-08-31T09:16:40.831650+0000 mgr.a (mgr.14388) 18396 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:16:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:42 smithi027 bash[22610]: cluster 2024-08-31T09:16:40.831650+0000 mgr.a (mgr.14388) 18396 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:16:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:42 smithi191 bash[24992]: cluster 2024-08-31T09:16:40.831650+0000 mgr.a (mgr.14388) 18396 : cluster [DBG] pgmap v12753: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:16:43.973 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:16:43.973 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:16:43.974 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:16:44.747 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:16:44.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:16:44.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:16:44.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:16:44.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:16:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:44 smithi163 bash[24253]: cluster 2024-08-31T09:16:42.832485+0000 mgr.a (mgr.14388) 18397 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:16:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:44 smithi027 bash[22610]: cluster 2024-08-31T09:16:42.832485+0000 mgr.a (mgr.14388) 18397 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:16:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:44 smithi191 bash[24992]: cluster 2024-08-31T09:16:42.832485+0000 mgr.a (mgr.14388) 18397 : cluster [DBG] pgmap v12754: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:16:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:45 smithi163 bash[24253]: audit 2024-08-31T09:16:44.310031+0000 mgr.a (mgr.14388) 18398 : audit [DBG] from='client.395691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:45 smithi027 bash[22610]: audit 2024-08-31T09:16:44.310031+0000 mgr.a (mgr.14388) 18398 : audit [DBG] from='client.395691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:45 smithi191 bash[24992]: audit 2024-08-31T09:16:44.310031+0000 mgr.a (mgr.14388) 18398 : audit [DBG] from='client.395691 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:46 smithi163 bash[24253]: cluster 2024-08-31T09:16:44.835327+0000 mgr.a (mgr.14388) 18399 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:16:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:46 smithi027 bash[22610]: cluster 2024-08-31T09:16:44.835327+0000 mgr.a (mgr.14388) 18399 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:16:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:46 smithi191 bash[24992]: cluster 2024-08-31T09:16:44.835327+0000 mgr.a (mgr.14388) 18399 : cluster [DBG] pgmap v12755: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:16:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:48 smithi163 bash[24253]: cluster 2024-08-31T09:16:46.836070+0000 mgr.a (mgr.14388) 18400 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:48 smithi027 bash[22610]: cluster 2024-08-31T09:16:46.836070+0000 mgr.a (mgr.14388) 18400 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:48 smithi191 bash[24992]: cluster 2024-08-31T09:16:46.836070+0000 mgr.a (mgr.14388) 18400 : cluster [DBG] pgmap v12756: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:49.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:16:49.749 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:16:49.750 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:16:50.529 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:16:50.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:16:50.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:16:50.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:16:50.529 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:16:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:50 smithi163 bash[24253]: cluster 2024-08-31T09:16:48.838080+0000 mgr.a (mgr.14388) 18401 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:50 smithi027 bash[22610]: cluster 2024-08-31T09:16:48.838080+0000 mgr.a (mgr.14388) 18401 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:50 smithi191 bash[24992]: cluster 2024-08-31T09:16:48.838080+0000 mgr.a (mgr.14388) 18401 : cluster [DBG] pgmap v12757: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:51 smithi163 bash[24253]: audit 2024-08-31T09:16:50.088145+0000 mgr.a (mgr.14388) 18402 : audit [DBG] from='client.395769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:51 smithi027 bash[22610]: audit 2024-08-31T09:16:50.088145+0000 mgr.a (mgr.14388) 18402 : audit [DBG] from='client.395769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:51 smithi191 bash[24992]: audit 2024-08-31T09:16:50.088145+0000 mgr.a (mgr.14388) 18402 : audit [DBG] from='client.395769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:52 smithi163 bash[24253]: cluster 2024-08-31T09:16:50.839041+0000 mgr.a (mgr.14388) 18403 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:52 smithi027 bash[22610]: cluster 2024-08-31T09:16:50.839041+0000 mgr.a (mgr.14388) 18403 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:52 smithi191 bash[24992]: cluster 2024-08-31T09:16:50.839041+0000 mgr.a (mgr.14388) 18403 : cluster [DBG] pgmap v12758: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:54 smithi163 bash[24253]: cluster 2024-08-31T09:16:52.839784+0000 mgr.a (mgr.14388) 18404 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:54 smithi027 bash[22610]: cluster 2024-08-31T09:16:52.839784+0000 mgr.a (mgr.14388) 18404 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:54 smithi191 bash[24992]: cluster 2024-08-31T09:16:52.839784+0000 mgr.a (mgr.14388) 18404 : cluster [DBG] pgmap v12759: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:55.530 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:16:55.531 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:16:55.531 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:16:56.311 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:16:56.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:16:56.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:16:56.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:16:56.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:16:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:56 smithi163 bash[24253]: cluster 2024-08-31T09:16:54.842010+0000 mgr.a (mgr.14388) 18405 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:56 smithi027 bash[22610]: cluster 2024-08-31T09:16:54.842010+0000 mgr.a (mgr.14388) 18405 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:56 smithi191 bash[24992]: cluster 2024-08-31T09:16:54.842010+0000 mgr.a (mgr.14388) 18405 : cluster [DBG] pgmap v12760: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:16:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:57 smithi163 bash[24253]: audit 2024-08-31T09:16:55.869500+0000 mgr.a (mgr.14388) 18406 : audit [DBG] from='client.395847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:57 smithi027 bash[22610]: audit 2024-08-31T09:16:55.869500+0000 mgr.a (mgr.14388) 18406 : audit [DBG] from='client.395847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:57 smithi191 bash[24992]: audit 2024-08-31T09:16:55.869500+0000 mgr.a (mgr.14388) 18406 : audit [DBG] from='client.395847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:16:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:16:58 smithi163 bash[24253]: cluster 2024-08-31T09:16:56.842979+0000 mgr.a (mgr.14388) 18407 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:16:58 smithi027 bash[22610]: cluster 2024-08-31T09:16:56.842979+0000 mgr.a (mgr.14388) 18407 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:16:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:16:58 smithi191 bash[24992]: cluster 2024-08-31T09:16:56.842979+0000 mgr.a (mgr.14388) 18407 : cluster [DBG] pgmap v12761: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:00 smithi163 bash[24253]: cluster 2024-08-31T09:16:58.845217+0000 mgr.a (mgr.14388) 18408 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:00 smithi027 bash[22610]: cluster 2024-08-31T09:16:58.845217+0000 mgr.a (mgr.14388) 18408 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:00 smithi191 bash[24992]: cluster 2024-08-31T09:16:58.845217+0000 mgr.a (mgr.14388) 18408 : cluster [DBG] pgmap v12762: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:01.312 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:01.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:01.313 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:02.092 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:02.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:02.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:02.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:02.093 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:17:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:02 smithi163 bash[24253]: cluster 2024-08-31T09:17:00.845985+0000 mgr.a (mgr.14388) 18409 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:02 smithi163 bash[24253]: audit 2024-08-31T09:17:01.648611+0000 mgr.a (mgr.14388) 18410 : audit [DBG] from='client.395922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:02 smithi027 bash[22610]: cluster 2024-08-31T09:17:00.845985+0000 mgr.a (mgr.14388) 18409 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:02 smithi027 bash[22610]: audit 2024-08-31T09:17:01.648611+0000 mgr.a (mgr.14388) 18410 : audit [DBG] from='client.395922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:02 smithi191 bash[24992]: cluster 2024-08-31T09:17:00.845985+0000 mgr.a (mgr.14388) 18409 : cluster [DBG] pgmap v12763: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:02 smithi191 bash[24992]: audit 2024-08-31T09:17:01.648611+0000 mgr.a (mgr.14388) 18410 : audit [DBG] from='client.395922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:04 smithi163 bash[24253]: cluster 2024-08-31T09:17:02.846949+0000 mgr.a (mgr.14388) 18411 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:04 smithi027 bash[22610]: cluster 2024-08-31T09:17:02.846949+0000 mgr.a (mgr.14388) 18411 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:04 smithi191 bash[24992]: cluster 2024-08-31T09:17:02.846949+0000 mgr.a (mgr.14388) 18411 : cluster [DBG] pgmap v12764: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:06 smithi163 bash[24253]: cluster 2024-08-31T09:17:04.849192+0000 mgr.a (mgr.14388) 18412 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:06 smithi027 bash[22610]: cluster 2024-08-31T09:17:04.849192+0000 mgr.a (mgr.14388) 18412 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:06 smithi191 bash[24992]: cluster 2024-08-31T09:17:04.849192+0000 mgr.a (mgr.14388) 18412 : cluster [DBG] pgmap v12765: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:07.094 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:07.095 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:07.095 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:07.843 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:07.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:07.843 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:07.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:07.844 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:17:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:08 smithi163 bash[24253]: cluster 2024-08-31T09:17:06.849948+0000 mgr.a (mgr.14388) 18413 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:08 smithi163 bash[24253]: audit 2024-08-31T09:17:07.426373+0000 mgr.a (mgr.14388) 18414 : audit [DBG] from='client.396000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:08 smithi027 bash[22610]: cluster 2024-08-31T09:17:06.849948+0000 mgr.a (mgr.14388) 18413 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:08 smithi027 bash[22610]: audit 2024-08-31T09:17:07.426373+0000 mgr.a (mgr.14388) 18414 : audit [DBG] from='client.396000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:08 smithi191 bash[24992]: cluster 2024-08-31T09:17:06.849948+0000 mgr.a (mgr.14388) 18413 : cluster [DBG] pgmap v12766: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:08 smithi191 bash[24992]: audit 2024-08-31T09:17:07.426373+0000 mgr.a (mgr.14388) 18414 : audit [DBG] from='client.396000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:09 smithi191 bash[24992]: cluster 2024-08-31T09:17:08.852345+0000 mgr.a (mgr.14388) 18415 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:10.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:09 smithi163 bash[24253]: cluster 2024-08-31T09:17:08.852345+0000 mgr.a (mgr.14388) 18415 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:09 smithi027 bash[22610]: cluster 2024-08-31T09:17:08.852345+0000 mgr.a (mgr.14388) 18415 : cluster [DBG] pgmap v12767: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:12 smithi191 bash[24992]: cluster 2024-08-31T09:17:10.853109+0000 mgr.a (mgr.14388) 18416 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:12 smithi163 bash[24253]: cluster 2024-08-31T09:17:10.853109+0000 mgr.a (mgr.14388) 18416 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:12 smithi027 bash[22610]: cluster 2024-08-31T09:17:10.853109+0000 mgr.a (mgr.14388) 18416 : cluster [DBG] pgmap v12768: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:12.845 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:12.846 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:13.608 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:13.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:13.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:13.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:13.609 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:17:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:14 smithi191 bash[24992]: cluster 2024-08-31T09:17:12.853863+0000 mgr.a (mgr.14388) 18417 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:14 smithi191 bash[24992]: audit 2024-08-31T09:17:13.178406+0000 mgr.a (mgr.14388) 18418 : audit [DBG] from='client.396078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:14 smithi163 bash[24253]: cluster 2024-08-31T09:17:12.853863+0000 mgr.a (mgr.14388) 18417 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:14 smithi163 bash[24253]: audit 2024-08-31T09:17:13.178406+0000 mgr.a (mgr.14388) 18418 : audit [DBG] from='client.396078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:14 smithi027 bash[22610]: cluster 2024-08-31T09:17:12.853863+0000 mgr.a (mgr.14388) 18417 : cluster [DBG] pgmap v12769: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:14 smithi027 bash[22610]: audit 2024-08-31T09:17:13.178406+0000 mgr.a (mgr.14388) 18418 : audit [DBG] from='client.396078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:16.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:16 smithi191 bash[24992]: cluster 2024-08-31T09:17:14.856743+0000 mgr.a (mgr.14388) 18419 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:16.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:16 smithi163 bash[24253]: cluster 2024-08-31T09:17:14.856743+0000 mgr.a (mgr.14388) 18419 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:16 smithi027 bash[22610]: cluster 2024-08-31T09:17:14.856743+0000 mgr.a (mgr.14388) 18419 : cluster [DBG] pgmap v12770: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:18.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:18 smithi191 bash[24992]: cluster 2024-08-31T09:17:16.857703+0000 mgr.a (mgr.14388) 18420 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:18 smithi163 bash[24253]: cluster 2024-08-31T09:17:16.857703+0000 mgr.a (mgr.14388) 18420 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:18 smithi027 bash[22610]: cluster 2024-08-31T09:17:16.857703+0000 mgr.a (mgr.14388) 18420 : cluster [DBG] pgmap v12771: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:18.610 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:18.611 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:18.611 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:19.386 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:19.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:19.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:19.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:19.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:17:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:20 smithi191 bash[24992]: cluster 2024-08-31T09:17:18.859699+0000 mgr.a (mgr.14388) 18421 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:20 smithi191 bash[24992]: audit 2024-08-31T09:17:18.944735+0000 mgr.a (mgr.14388) 18422 : audit [DBG] from='client.396153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:20 smithi163 bash[24253]: cluster 2024-08-31T09:17:18.859699+0000 mgr.a (mgr.14388) 18421 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:20 smithi163 bash[24253]: audit 2024-08-31T09:17:18.944735+0000 mgr.a (mgr.14388) 18422 : audit [DBG] from='client.396153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:20 smithi027 bash[22610]: cluster 2024-08-31T09:17:18.859699+0000 mgr.a (mgr.14388) 18421 : cluster [DBG] pgmap v12772: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:20 smithi027 bash[22610]: audit 2024-08-31T09:17:18.944735+0000 mgr.a (mgr.14388) 18422 : audit [DBG] from='client.396153 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:22 smithi191 bash[24992]: cluster 2024-08-31T09:17:20.860598+0000 mgr.a (mgr.14388) 18423 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:22 smithi163 bash[24253]: cluster 2024-08-31T09:17:20.860598+0000 mgr.a (mgr.14388) 18423 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:22 smithi027 bash[22610]: cluster 2024-08-31T09:17:20.860598+0000 mgr.a (mgr.14388) 18423 : cluster [DBG] pgmap v12773: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:24 smithi163 bash[24253]: cluster 2024-08-31T09:17:22.861378+0000 mgr.a (mgr.14388) 18424 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:17:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:24 smithi027 bash[22610]: cluster 2024-08-31T09:17:22.861378+0000 mgr.a (mgr.14388) 18424 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:17:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:24 smithi191 bash[24992]: cluster 2024-08-31T09:17:22.861378+0000 mgr.a (mgr.14388) 18424 : cluster [DBG] pgmap v12774: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:17:25.125 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:25.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:25.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:25.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:25.125 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:17:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:26 smithi163 bash[24253]: audit 2024-08-31T09:17:24.715670+0000 mgr.a (mgr.14388) 18425 : audit [DBG] from='client.396231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:26 smithi163 bash[24253]: cluster 2024-08-31T09:17:24.862931+0000 mgr.a (mgr.14388) 18426 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:26 smithi027 bash[22610]: audit 2024-08-31T09:17:24.715670+0000 mgr.a (mgr.14388) 18425 : audit [DBG] from='client.396231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:26 smithi027 bash[22610]: cluster 2024-08-31T09:17:24.862931+0000 mgr.a (mgr.14388) 18426 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:26 smithi191 bash[24992]: audit 2024-08-31T09:17:24.715670+0000 mgr.a (mgr.14388) 18425 : audit [DBG] from='client.396231 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:26 smithi191 bash[24992]: cluster 2024-08-31T09:17:24.862931+0000 mgr.a (mgr.14388) 18426 : cluster [DBG] pgmap v12775: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:28 smithi163 bash[24253]: cluster 2024-08-31T09:17:26.863807+0000 mgr.a (mgr.14388) 18427 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:28.880 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:28 smithi191 bash[24992]: cluster 2024-08-31T09:17:26.863807+0000 mgr.a (mgr.14388) 18427 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:28.880 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:28 smithi027 bash[22610]: cluster 2024-08-31T09:17:26.863807+0000 mgr.a (mgr.14388) 18427 : cluster [DBG] pgmap v12776: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:30.126 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:30.127 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:30.127 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:30 smithi163 bash[24253]: cluster 2024-08-31T09:17:28.866016+0000 mgr.a (mgr.14388) 18428 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:30.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:30 smithi027 bash[22610]: cluster 2024-08-31T09:17:28.866016+0000 mgr.a (mgr.14388) 18428 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:30 smithi191 bash[24992]: cluster 2024-08-31T09:17:28.866016+0000 mgr.a (mgr.14388) 18428 : cluster [DBG] pgmap v12777: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:30.898 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:30.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:30.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:30.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:30.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:17:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:31 smithi163 bash[24253]: audit 2024-08-31T09:17:30.460379+0000 mgr.a (mgr.14388) 18429 : audit [DBG] from='client.396306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:31 smithi027 bash[22610]: audit 2024-08-31T09:17:30.460379+0000 mgr.a (mgr.14388) 18429 : audit [DBG] from='client.396306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:31 smithi191 bash[24992]: audit 2024-08-31T09:17:30.460379+0000 mgr.a (mgr.14388) 18429 : audit [DBG] from='client.396306 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:32 smithi163 bash[24253]: cluster 2024-08-31T09:17:30.866558+0000 mgr.a (mgr.14388) 18430 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:32 smithi163 bash[24253]: audit 2024-08-31T09:17:31.450936+0000 mon.a (mon.0) 3321 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:17:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:32 smithi163 bash[24253]: audit 2024-08-31T09:17:32.063687+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:32 smithi027 bash[22610]: cluster 2024-08-31T09:17:30.866558+0000 mgr.a (mgr.14388) 18430 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:32 smithi027 bash[22610]: audit 2024-08-31T09:17:31.450936+0000 mon.a (mon.0) 3321 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:17:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:32 smithi027 bash[22610]: audit 2024-08-31T09:17:32.063687+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:32 smithi191 bash[24992]: cluster 2024-08-31T09:17:30.866558+0000 mgr.a (mgr.14388) 18430 : cluster [DBG] pgmap v12778: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:32 smithi191 bash[24992]: audit 2024-08-31T09:17:31.450936+0000 mon.a (mon.0) 3321 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:17:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:32 smithi191 bash[24992]: audit 2024-08-31T09:17:32.063687+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:33 smithi163 bash[24253]: audit 2024-08-31T09:17:32.068826+0000 mon.a (mon.0) 3323 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:33 smithi163 bash[24253]: audit 2024-08-31T09:17:32.075038+0000 mon.a (mon.0) 3324 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:33 smithi163 bash[24253]: audit 2024-08-31T09:17:32.081041+0000 mon.a (mon.0) 3325 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:33 smithi163 bash[24253]: audit 2024-08-31T09:17:32.839846+0000 mon.a (mon.0) 3326 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:17:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:33 smithi163 bash[24253]: audit 2024-08-31T09:17:32.841629+0000 mon.a (mon.0) 3327 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:17:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:33 smithi163 bash[24253]: audit 2024-08-31T09:17:32.852435+0000 mon.a (mon.0) 3328 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:33 smithi163 bash[24253]: audit 2024-08-31T09:17:32.857090+0000 mon.a (mon.0) 3329 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:17:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:33 smithi027 bash[22610]: audit 2024-08-31T09:17:32.068826+0000 mon.a (mon.0) 3323 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:33 smithi027 bash[22610]: audit 2024-08-31T09:17:32.075038+0000 mon.a (mon.0) 3324 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:33 smithi027 bash[22610]: audit 2024-08-31T09:17:32.081041+0000 mon.a (mon.0) 3325 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:33 smithi027 bash[22610]: audit 2024-08-31T09:17:32.839846+0000 mon.a (mon.0) 3326 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:17:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:33 smithi027 bash[22610]: audit 2024-08-31T09:17:32.841629+0000 mon.a (mon.0) 3327 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:17:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:33 smithi027 bash[22610]: audit 2024-08-31T09:17:32.852435+0000 mon.a (mon.0) 3328 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:33 smithi027 bash[22610]: audit 2024-08-31T09:17:32.857090+0000 mon.a (mon.0) 3329 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:17:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:33 smithi191 bash[24992]: audit 2024-08-31T09:17:32.068826+0000 mon.a (mon.0) 3323 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:33 smithi191 bash[24992]: audit 2024-08-31T09:17:32.075038+0000 mon.a (mon.0) 3324 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:33 smithi191 bash[24992]: audit 2024-08-31T09:17:32.081041+0000 mon.a (mon.0) 3325 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:33 smithi191 bash[24992]: audit 2024-08-31T09:17:32.839846+0000 mon.a (mon.0) 3326 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:17:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:33 smithi191 bash[24992]: audit 2024-08-31T09:17:32.841629+0000 mon.a (mon.0) 3327 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:17:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:33 smithi191 bash[24992]: audit 2024-08-31T09:17:32.852435+0000 mon.a (mon.0) 3328 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:17:33.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:33 smithi191 bash[24992]: audit 2024-08-31T09:17:32.857090+0000 mon.a (mon.0) 3329 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:17:33.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:17:33 smithi027 bash[22863]: debug 2024-08-31T09:17:33.600+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:17:33.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:17:33 smithi027 bash[22863]: debug 2024-08-31T09:17:33.600+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:17:34.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:34 smithi163 bash[24253]: audit 2024-08-31T09:17:32.859564+0000 mgr.a (mgr.14388) 18431 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:17:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:34 smithi163 bash[24253]: cluster 2024-08-31T09:17:32.879439+0000 mgr.a (mgr.14388) 18432 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:34 smithi163 bash[24253]: audit 2024-08-31T09:17:33.604017+0000 mgr.a (mgr.14388) 18433 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:17:34.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:34 smithi163 bash[24253]: cephadm 2024-08-31T09:17:33.605330+0000 mgr.a (mgr.14388) 18434 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:17:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:34 smithi027 bash[22610]: audit 2024-08-31T09:17:32.859564+0000 mgr.a (mgr.14388) 18431 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:17:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:34 smithi027 bash[22610]: cluster 2024-08-31T09:17:32.879439+0000 mgr.a (mgr.14388) 18432 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:34 smithi027 bash[22610]: audit 2024-08-31T09:17:33.604017+0000 mgr.a (mgr.14388) 18433 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:17:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:34 smithi027 bash[22610]: cephadm 2024-08-31T09:17:33.605330+0000 mgr.a (mgr.14388) 18434 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:17:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:34 smithi191 bash[24992]: audit 2024-08-31T09:17:32.859564+0000 mgr.a (mgr.14388) 18431 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:17:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:34 smithi191 bash[24992]: cluster 2024-08-31T09:17:32.879439+0000 mgr.a (mgr.14388) 18432 : cluster [DBG] pgmap v12779: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:34 smithi191 bash[24992]: audit 2024-08-31T09:17:33.604017+0000 mgr.a (mgr.14388) 18433 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:17:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:34 smithi191 bash[24992]: cephadm 2024-08-31T09:17:33.605330+0000 mgr.a (mgr.14388) 18434 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:17:35.900 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:35.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:35.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:36 smithi163 bash[24253]: cluster 2024-08-31T09:17:34.882281+0000 mgr.a (mgr.14388) 18435 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:36 smithi027 bash[22610]: cluster 2024-08-31T09:17:34.882281+0000 mgr.a (mgr.14388) 18435 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:36 smithi191 bash[24992]: cluster 2024-08-31T09:17:34.882281+0000 mgr.a (mgr.14388) 18435 : cluster [DBG] pgmap v12780: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:17:36.650 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:36.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:36.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:36.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:36.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:17:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:37 smithi163 bash[24253]: audit 2024-08-31T09:17:36.231039+0000 mgr.a (mgr.14388) 18436 : audit [DBG] from='client.396492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:37 smithi027 bash[22610]: audit 2024-08-31T09:17:36.231039+0000 mgr.a (mgr.14388) 18436 : audit [DBG] from='client.396492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:37.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:37 smithi191 bash[24992]: audit 2024-08-31T09:17:36.231039+0000 mgr.a (mgr.14388) 18436 : audit [DBG] from='client.396492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:38 smithi163 bash[24253]: cluster 2024-08-31T09:17:36.883232+0000 mgr.a (mgr.14388) 18437 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:38 smithi027 bash[22610]: cluster 2024-08-31T09:17:36.883232+0000 mgr.a (mgr.14388) 18437 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:38 smithi191 bash[24992]: cluster 2024-08-31T09:17:36.883232+0000 mgr.a (mgr.14388) 18437 : cluster [DBG] pgmap v12781: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:17:40.452 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:40 smithi163 bash[24253]: cluster 2024-08-31T09:17:38.885484+0000 mgr.a (mgr.14388) 18438 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:17:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:40 smithi027 bash[22610]: cluster 2024-08-31T09:17:38.885484+0000 mgr.a (mgr.14388) 18438 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:17:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:40 smithi191 bash[24992]: cluster 2024-08-31T09:17:38.885484+0000 mgr.a (mgr.14388) 18438 : cluster [DBG] pgmap v12782: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:17:41.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:41.653 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:41.653 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:42.430 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:42.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:42.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:42.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:42.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:17:42.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:42 smithi163 bash[24253]: cluster 2024-08-31T09:17:40.886255+0000 mgr.a (mgr.14388) 18439 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:17:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:42 smithi027 bash[22610]: cluster 2024-08-31T09:17:40.886255+0000 mgr.a (mgr.14388) 18439 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:17:42.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:42 smithi191 bash[24992]: cluster 2024-08-31T09:17:40.886255+0000 mgr.a (mgr.14388) 18439 : cluster [DBG] pgmap v12783: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:17:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:43 smithi163 bash[24253]: audit 2024-08-31T09:17:41.989313+0000 mgr.a (mgr.14388) 18440 : audit [DBG] from='client.396570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:43 smithi027 bash[22610]: audit 2024-08-31T09:17:41.989313+0000 mgr.a (mgr.14388) 18440 : audit [DBG] from='client.396570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:43 smithi191 bash[24992]: audit 2024-08-31T09:17:41.989313+0000 mgr.a (mgr.14388) 18440 : audit [DBG] from='client.396570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:44.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:44 smithi163 bash[24253]: cluster 2024-08-31T09:17:42.887966+0000 mgr.a (mgr.14388) 18441 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:17:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:44 smithi027 bash[22610]: cluster 2024-08-31T09:17:42.887966+0000 mgr.a (mgr.14388) 18441 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:17:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:44 smithi191 bash[24992]: cluster 2024-08-31T09:17:42.887966+0000 mgr.a (mgr.14388) 18441 : cluster [DBG] pgmap v12784: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:17:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:46 smithi163 bash[24253]: cluster 2024-08-31T09:17:44.889634+0000 mgr.a (mgr.14388) 18442 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:17:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:46 smithi027 bash[22610]: cluster 2024-08-31T09:17:44.889634+0000 mgr.a (mgr.14388) 18442 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:17:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:46 smithi191 bash[24992]: cluster 2024-08-31T09:17:44.889634+0000 mgr.a (mgr.14388) 18442 : cluster [DBG] pgmap v12785: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:17:47.432 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:47.433 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:47.433 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:48.176 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:48.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:48.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:48.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:48.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:17:48.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:48 smithi163 bash[24253]: cluster 2024-08-31T09:17:46.890413+0000 mgr.a (mgr.14388) 18443 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:17:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:48 smithi027 bash[22610]: cluster 2024-08-31T09:17:46.890413+0000 mgr.a (mgr.14388) 18443 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:17:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:48 smithi191 bash[24992]: cluster 2024-08-31T09:17:46.890413+0000 mgr.a (mgr.14388) 18443 : cluster [DBG] pgmap v12786: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:17:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:49 smithi163 bash[24253]: audit 2024-08-31T09:17:47.762836+0000 mgr.a (mgr.14388) 18444 : audit [DBG] from='client.396645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:49 smithi027 bash[22610]: audit 2024-08-31T09:17:47.762836+0000 mgr.a (mgr.14388) 18444 : audit [DBG] from='client.396645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:49.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:49 smithi191 bash[24992]: audit 2024-08-31T09:17:47.762836+0000 mgr.a (mgr.14388) 18444 : audit [DBG] from='client.396645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:50.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:50 smithi163 bash[24253]: cluster 2024-08-31T09:17:48.893296+0000 mgr.a (mgr.14388) 18445 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:17:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:50 smithi027 bash[22610]: cluster 2024-08-31T09:17:48.893296+0000 mgr.a (mgr.14388) 18445 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:17:50.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:50 smithi191 bash[24992]: cluster 2024-08-31T09:17:48.893296+0000 mgr.a (mgr.14388) 18445 : cluster [DBG] pgmap v12787: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:17:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:52 smithi163 bash[24253]: cluster 2024-08-31T09:17:50.894068+0000 mgr.a (mgr.14388) 18446 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:52 smithi027 bash[22610]: cluster 2024-08-31T09:17:50.894068+0000 mgr.a (mgr.14388) 18446 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:52.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:52 smithi191 bash[24992]: cluster 2024-08-31T09:17:50.894068+0000 mgr.a (mgr.14388) 18446 : cluster [DBG] pgmap v12788: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:53.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:53.179 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:53.179 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:53.944 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:53.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:53.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:53.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:53.945 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:17:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:54 smithi163 bash[24253]: cluster 2024-08-31T09:17:52.895287+0000 mgr.a (mgr.14388) 18447 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:17:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:54 smithi163 bash[24253]: audit 2024-08-31T09:17:53.515181+0000 mgr.a (mgr.14388) 18448 : audit [DBG] from='client.396720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:54 smithi027 bash[22610]: cluster 2024-08-31T09:17:52.895287+0000 mgr.a (mgr.14388) 18447 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:17:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:54 smithi027 bash[22610]: audit 2024-08-31T09:17:53.515181+0000 mgr.a (mgr.14388) 18448 : audit [DBG] from='client.396720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:54 smithi191 bash[24992]: cluster 2024-08-31T09:17:52.895287+0000 mgr.a (mgr.14388) 18447 : cluster [DBG] pgmap v12789: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:17:54.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:54 smithi191 bash[24992]: audit 2024-08-31T09:17:53.515181+0000 mgr.a (mgr.14388) 18448 : audit [DBG] from='client.396720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:17:56.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:56 smithi163 bash[24253]: cluster 2024-08-31T09:17:54.897662+0000 mgr.a (mgr.14388) 18449 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:17:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:56 smithi027 bash[22610]: cluster 2024-08-31T09:17:54.897662+0000 mgr.a (mgr.14388) 18449 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:17:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:56 smithi191 bash[24992]: cluster 2024-08-31T09:17:54.897662+0000 mgr.a (mgr.14388) 18449 : cluster [DBG] pgmap v12790: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:17:58.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:17:58 smithi163 bash[24253]: cluster 2024-08-31T09:17:56.898631+0000 mgr.a (mgr.14388) 18450 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:17:58 smithi027 bash[22610]: cluster 2024-08-31T09:17:56.898631+0000 mgr.a (mgr.14388) 18450 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:58.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:17:58 smithi191 bash[24992]: cluster 2024-08-31T09:17:56.898631+0000 mgr.a (mgr.14388) 18450 : cluster [DBG] pgmap v12791: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:17:58.946 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:17:58.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:17:58.947 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:17:59.717 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:17:59.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:17:59.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:17:59.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:17:59.718 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:00 smithi163 bash[24253]: cluster 2024-08-31T09:17:58.900710+0000 mgr.a (mgr.14388) 18451 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:00 smithi163 bash[24253]: audit 2024-08-31T09:17:59.284935+0000 mgr.a (mgr.14388) 18452 : audit [DBG] from='client.396798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:00 smithi027 bash[22610]: cluster 2024-08-31T09:17:58.900710+0000 mgr.a (mgr.14388) 18451 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:00 smithi027 bash[22610]: audit 2024-08-31T09:17:59.284935+0000 mgr.a (mgr.14388) 18452 : audit [DBG] from='client.396798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:00 smithi191 bash[24992]: cluster 2024-08-31T09:17:58.900710+0000 mgr.a (mgr.14388) 18451 : cluster [DBG] pgmap v12792: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:00.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:00 smithi191 bash[24992]: audit 2024-08-31T09:17:59.284935+0000 mgr.a (mgr.14388) 18452 : audit [DBG] from='client.396798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:02 smithi163 bash[24253]: cluster 2024-08-31T09:18:00.901756+0000 mgr.a (mgr.14388) 18453 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:02 smithi027 bash[22610]: cluster 2024-08-31T09:18:00.901756+0000 mgr.a (mgr.14388) 18453 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:02 smithi191 bash[24992]: cluster 2024-08-31T09:18:00.901756+0000 mgr.a (mgr.14388) 18453 : cluster [DBG] pgmap v12793: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:04.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:04 smithi163 bash[24253]: cluster 2024-08-31T09:18:02.903334+0000 mgr.a (mgr.14388) 18454 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:18:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:04 smithi027 bash[22610]: cluster 2024-08-31T09:18:02.903334+0000 mgr.a (mgr.14388) 18454 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:18:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:04 smithi191 bash[24992]: cluster 2024-08-31T09:18:02.903334+0000 mgr.a (mgr.14388) 18454 : cluster [DBG] pgmap v12794: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:18:04.719 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:18:04.720 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:18:04.720 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:18:05.473 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:18:05.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:18:05.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:18:05.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:18:05.473 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:06 smithi163 bash[24253]: cluster 2024-08-31T09:18:04.905035+0000 mgr.a (mgr.14388) 18455 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:18:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:06 smithi163 bash[24253]: audit 2024-08-31T09:18:05.046062+0000 mgr.a (mgr.14388) 18456 : audit [DBG] from='client.396873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:06 smithi027 bash[22610]: cluster 2024-08-31T09:18:04.905035+0000 mgr.a (mgr.14388) 18455 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:18:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:06 smithi027 bash[22610]: audit 2024-08-31T09:18:05.046062+0000 mgr.a (mgr.14388) 18456 : audit [DBG] from='client.396873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:06 smithi191 bash[24992]: cluster 2024-08-31T09:18:04.905035+0000 mgr.a (mgr.14388) 18455 : cluster [DBG] pgmap v12795: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:18:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:06 smithi191 bash[24992]: audit 2024-08-31T09:18:05.046062+0000 mgr.a (mgr.14388) 18456 : audit [DBG] from='client.396873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:08 smithi163 bash[24253]: cluster 2024-08-31T09:18:06.905917+0000 mgr.a (mgr.14388) 18457 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:08 smithi027 bash[22610]: cluster 2024-08-31T09:18:06.905917+0000 mgr.a (mgr.14388) 18457 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:08 smithi191 bash[24992]: cluster 2024-08-31T09:18:06.905917+0000 mgr.a (mgr.14388) 18457 : cluster [DBG] pgmap v12796: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:10.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:10 smithi163 bash[24253]: cluster 2024-08-31T09:18:08.908174+0000 mgr.a (mgr.14388) 18458 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:18:10.474 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:18:10.475 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:18:10.476 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:18:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:10 smithi027 bash[22610]: cluster 2024-08-31T09:18:08.908174+0000 mgr.a (mgr.14388) 18458 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:18:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:10 smithi191 bash[24992]: cluster 2024-08-31T09:18:08.908174+0000 mgr.a (mgr.14388) 18458 : cluster [DBG] pgmap v12797: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:18:11.258 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:18:11.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:18:11.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:18:11.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:18:11.259 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:12 smithi163 bash[24253]: audit 2024-08-31T09:18:10.809246+0000 mgr.a (mgr.14388) 18459 : audit [DBG] from='client.396948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:12 smithi163 bash[24253]: cluster 2024-08-31T09:18:10.908826+0000 mgr.a (mgr.14388) 18460 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:12 smithi027 bash[22610]: audit 2024-08-31T09:18:10.809246+0000 mgr.a (mgr.14388) 18459 : audit [DBG] from='client.396948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:12 smithi027 bash[22610]: cluster 2024-08-31T09:18:10.908826+0000 mgr.a (mgr.14388) 18460 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:12 smithi191 bash[24992]: audit 2024-08-31T09:18:10.809246+0000 mgr.a (mgr.14388) 18459 : audit [DBG] from='client.396948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:12 smithi191 bash[24992]: cluster 2024-08-31T09:18:10.908826+0000 mgr.a (mgr.14388) 18460 : cluster [DBG] pgmap v12798: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:14 smithi163 bash[24253]: cluster 2024-08-31T09:18:12.910244+0000 mgr.a (mgr.14388) 18461 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:18:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:14 smithi027 bash[22610]: cluster 2024-08-31T09:18:12.910244+0000 mgr.a (mgr.14388) 18461 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:18:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:14 smithi191 bash[24992]: cluster 2024-08-31T09:18:12.910244+0000 mgr.a (mgr.14388) 18461 : cluster [DBG] pgmap v12799: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:18:16.260 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:18:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:18:16.261 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:18:16.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:16 smithi163 bash[24253]: cluster 2024-08-31T09:18:14.911904+0000 mgr.a (mgr.14388) 18462 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:18:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:16 smithi027 bash[22610]: cluster 2024-08-31T09:18:14.911904+0000 mgr.a (mgr.14388) 18462 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:18:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:16 smithi191 bash[24992]: cluster 2024-08-31T09:18:14.911904+0000 mgr.a (mgr.14388) 18462 : cluster [DBG] pgmap v12800: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:18:17.045 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:18:17.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:18:17.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:18:17.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:18:17.045 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:17 smithi027 bash[22610]: audit 2024-08-31T09:18:16.595476+0000 mgr.a (mgr.14388) 18463 : audit [DBG] from='client.397023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:17 smithi191 bash[24992]: audit 2024-08-31T09:18:16.595476+0000 mgr.a (mgr.14388) 18463 : audit [DBG] from='client.397023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:17.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:17 smithi163 bash[24253]: audit 2024-08-31T09:18:16.595476+0000 mgr.a (mgr.14388) 18463 : audit [DBG] from='client.397023 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:18 smithi027 bash[22610]: cluster 2024-08-31T09:18:16.912377+0000 mgr.a (mgr.14388) 18464 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:18 smithi191 bash[24992]: cluster 2024-08-31T09:18:16.912377+0000 mgr.a (mgr.14388) 18464 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:18 smithi163 bash[24253]: cluster 2024-08-31T09:18:16.912377+0000 mgr.a (mgr.14388) 18464 : cluster [DBG] pgmap v12801: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:20 smithi027 bash[22610]: cluster 2024-08-31T09:18:18.914668+0000 mgr.a (mgr.14388) 18465 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:18:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:20 smithi191 bash[24992]: cluster 2024-08-31T09:18:18.914668+0000 mgr.a (mgr.14388) 18465 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:18:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:20 smithi163 bash[24253]: cluster 2024-08-31T09:18:18.914668+0000 mgr.a (mgr.14388) 18465 : cluster [DBG] pgmap v12802: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:18:22.046 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:18:22.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:18:22.047 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:18:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:22 smithi027 bash[22610]: cluster 2024-08-31T09:18:20.915486+0000 mgr.a (mgr.14388) 18466 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:22 smithi191 bash[24992]: cluster 2024-08-31T09:18:20.915486+0000 mgr.a (mgr.14388) 18466 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:22 smithi163 bash[24253]: cluster 2024-08-31T09:18:20.915486+0000 mgr.a (mgr.14388) 18466 : cluster [DBG] pgmap v12803: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:22.833 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:18:22.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:18:22.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:18:22.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:18:22.833 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:23 smithi027 bash[22610]: audit 2024-08-31T09:18:22.387690+0000 mgr.a (mgr.14388) 18467 : audit [DBG] from='client.397101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:23 smithi191 bash[24992]: audit 2024-08-31T09:18:22.387690+0000 mgr.a (mgr.14388) 18467 : audit [DBG] from='client.397101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:23.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:23 smithi163 bash[24253]: audit 2024-08-31T09:18:22.387690+0000 mgr.a (mgr.14388) 18467 : audit [DBG] from='client.397101 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:24 smithi027 bash[22610]: cluster 2024-08-31T09:18:22.917137+0000 mgr.a (mgr.14388) 18468 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:18:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:24 smithi191 bash[24992]: cluster 2024-08-31T09:18:22.917137+0000 mgr.a (mgr.14388) 18468 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:18:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:24 smithi163 bash[24253]: cluster 2024-08-31T09:18:22.917137+0000 mgr.a (mgr.14388) 18468 : cluster [DBG] pgmap v12804: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:18:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:26 smithi027 bash[22610]: cluster 2024-08-31T09:18:24.919161+0000 mgr.a (mgr.14388) 18469 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:18:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:26 smithi191 bash[24992]: cluster 2024-08-31T09:18:24.919161+0000 mgr.a (mgr.14388) 18469 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:18:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:26 smithi163 bash[24253]: cluster 2024-08-31T09:18:24.919161+0000 mgr.a (mgr.14388) 18469 : cluster [DBG] pgmap v12805: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:18:27.835 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:18:27.835 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:18:27.835 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:18:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:28 smithi191 bash[24992]: cluster 2024-08-31T09:18:26.919948+0000 mgr.a (mgr.14388) 18470 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:28.626 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:18:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:18:28.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:18:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:18:28.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:28 smithi163 bash[24253]: cluster 2024-08-31T09:18:26.919948+0000 mgr.a (mgr.14388) 18470 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:28 smithi027 bash[22610]: cluster 2024-08-31T09:18:26.919948+0000 mgr.a (mgr.14388) 18470 : cluster [DBG] pgmap v12806: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:29.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:29 smithi191 bash[24992]: audit 2024-08-31T09:18:28.172226+0000 mgr.a (mgr.14388) 18471 : audit [DBG] from='client.397179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:29.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:29 smithi163 bash[24253]: audit 2024-08-31T09:18:28.172226+0000 mgr.a (mgr.14388) 18471 : audit [DBG] from='client.397179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:29.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:29 smithi027 bash[22610]: audit 2024-08-31T09:18:28.172226+0000 mgr.a (mgr.14388) 18471 : audit [DBG] from='client.397179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:30 smithi191 bash[24992]: cluster 2024-08-31T09:18:28.922847+0000 mgr.a (mgr.14388) 18472 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:30 smithi163 bash[24253]: cluster 2024-08-31T09:18:28.922847+0000 mgr.a (mgr.14388) 18472 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:30 smithi027 bash[22610]: cluster 2024-08-31T09:18:28.922847+0000 mgr.a (mgr.14388) 18472 : cluster [DBG] pgmap v12807: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:32 smithi191 bash[24992]: cluster 2024-08-31T09:18:30.923702+0000 mgr.a (mgr.14388) 18473 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:18:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:32 smithi163 bash[24253]: cluster 2024-08-31T09:18:30.923702+0000 mgr.a (mgr.14388) 18473 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:18:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:32 smithi027 bash[22610]: cluster 2024-08-31T09:18:30.923702+0000 mgr.a (mgr.14388) 18473 : cluster [DBG] pgmap v12808: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:18:33.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:18:33.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:18:33.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:18:34.452 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:18:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:18:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:18:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:18:34.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:34.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:34 smithi191 bash[24992]: cluster 2024-08-31T09:18:32.925248+0000 mgr.a (mgr.14388) 18474 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T09:18:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:34 smithi191 bash[24992]: audit 2024-08-31T09:18:33.656812+0000 mon.a (mon.0) 3330 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:18:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:34 smithi163 bash[24253]: cluster 2024-08-31T09:18:32.925248+0000 mgr.a (mgr.14388) 18474 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T09:18:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:34 smithi163 bash[24253]: audit 2024-08-31T09:18:33.656812+0000 mon.a (mon.0) 3330 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:18:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:34 smithi027 bash[22610]: cluster 2024-08-31T09:18:32.925248+0000 mgr.a (mgr.14388) 18474 : cluster [DBG] pgmap v12809: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-08-31T09:18:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:34 smithi027 bash[22610]: audit 2024-08-31T09:18:33.656812+0000 mon.a (mon.0) 3330 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:18:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:33.981314+0000 mgr.a (mgr.14388) 18475 : audit [DBG] from='client.397251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:34.964145+0000 mon.a (mon.0) 3331 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:34.971456+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:34.974851+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:34.978550+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:34.994673+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:34.998608+0000 mon.a (mon.0) 3336 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:34.999772+0000 mon.a (mon.0) 3337 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:18:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:35.000563+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:18:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:35.005516+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:35 smithi191 bash[24992]: audit 2024-08-31T09:18:35.008073+0000 mon.a (mon.0) 3340 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:18:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:33.981314+0000 mgr.a (mgr.14388) 18475 : audit [DBG] from='client.397251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:34.964145+0000 mon.a (mon.0) 3331 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:34.971456+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:34.974851+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:34.978550+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:34.994673+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:34.998608+0000 mon.a (mon.0) 3336 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:34.999772+0000 mon.a (mon.0) 3337 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:18:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:35.000563+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:18:35.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:35.005516+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:35 smithi163 bash[24253]: audit 2024-08-31T09:18:35.008073+0000 mon.a (mon.0) 3340 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:33.981314+0000 mgr.a (mgr.14388) 18475 : audit [DBG] from='client.397251 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:34.964145+0000 mon.a (mon.0) 3331 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:34.971456+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:34.974851+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:34.978550+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:34.994673+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:34.998608+0000 mon.a (mon.0) 3336 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:34.999772+0000 mon.a (mon.0) 3337 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:35.000563+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:35.005516+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:18:35.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22610]: audit 2024-08-31T09:18:35.008073+0000 mon.a (mon.0) 3340 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:18:36.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22863]: debug 2024-08-31T09:18:35.742+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:18:36.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:18:35 smithi027 bash[22863]: debug 2024-08-31T09:18:35.742+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:18:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:36 smithi191 bash[24992]: cluster 2024-08-31T09:18:34.927000+0000 mgr.a (mgr.14388) 18476 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:18:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:36 smithi191 bash[24992]: audit 2024-08-31T09:18:35.009307+0000 mgr.a (mgr.14388) 18477 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:18:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:36 smithi163 bash[24253]: cluster 2024-08-31T09:18:34.927000+0000 mgr.a (mgr.14388) 18476 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:18:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:36 smithi163 bash[24253]: audit 2024-08-31T09:18:35.009307+0000 mgr.a (mgr.14388) 18477 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:18:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:36 smithi027 bash[22610]: cluster 2024-08-31T09:18:34.927000+0000 mgr.a (mgr.14388) 18476 : cluster [DBG] pgmap v12810: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:18:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:36 smithi027 bash[22610]: audit 2024-08-31T09:18:35.009307+0000 mgr.a (mgr.14388) 18477 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:18:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:37 smithi191 bash[24992]: audit 2024-08-31T09:18:35.743562+0000 mgr.a (mgr.14388) 18478 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:18:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:37 smithi191 bash[24992]: cephadm 2024-08-31T09:18:35.744877+0000 mgr.a (mgr.14388) 18479 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:18:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:37 smithi163 bash[24253]: audit 2024-08-31T09:18:35.743562+0000 mgr.a (mgr.14388) 18478 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:18:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:37 smithi163 bash[24253]: cephadm 2024-08-31T09:18:35.744877+0000 mgr.a (mgr.14388) 18479 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:18:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:37 smithi027 bash[22610]: audit 2024-08-31T09:18:35.743562+0000 mgr.a (mgr.14388) 18478 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:18:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:37 smithi027 bash[22610]: cephadm 2024-08-31T09:18:35.744877+0000 mgr.a (mgr.14388) 18479 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:18:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:38 smithi191 bash[24992]: cluster 2024-08-31T09:18:36.927908+0000 mgr.a (mgr.14388) 18480 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:18:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:38 smithi163 bash[24253]: cluster 2024-08-31T09:18:36.927908+0000 mgr.a (mgr.14388) 18480 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:18:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:38 smithi027 bash[22610]: cluster 2024-08-31T09:18:36.927908+0000 mgr.a (mgr.14388) 18480 : cluster [DBG] pgmap v12811: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:18:39.454 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:18:39.455 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:18:39.455 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:18:40.240 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:18:40.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:18:40.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:18:40.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:18:40.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:40 smithi191 bash[24992]: cluster 2024-08-31T09:18:38.930108+0000 mgr.a (mgr.14388) 18481 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:40 smithi163 bash[24253]: cluster 2024-08-31T09:18:38.930108+0000 mgr.a (mgr.14388) 18481 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:40 smithi027 bash[22610]: cluster 2024-08-31T09:18:38.930108+0000 mgr.a (mgr.14388) 18481 : cluster [DBG] pgmap v12812: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:41 smithi163 bash[24253]: audit 2024-08-31T09:18:39.792646+0000 mgr.a (mgr.14388) 18482 : audit [DBG] from='client.397431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:41 smithi027 bash[22610]: audit 2024-08-31T09:18:39.792646+0000 mgr.a (mgr.14388) 18482 : audit [DBG] from='client.397431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:41 smithi191 bash[24992]: audit 2024-08-31T09:18:39.792646+0000 mgr.a (mgr.14388) 18482 : audit [DBG] from='client.397431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:42 smithi163 bash[24253]: cluster 2024-08-31T09:18:40.931022+0000 mgr.a (mgr.14388) 18483 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:42 smithi027 bash[22610]: cluster 2024-08-31T09:18:40.931022+0000 mgr.a (mgr.14388) 18483 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:42 smithi191 bash[24992]: cluster 2024-08-31T09:18:40.931022+0000 mgr.a (mgr.14388) 18483 : cluster [DBG] pgmap v12813: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:44 smithi163 bash[24253]: cluster 2024-08-31T09:18:42.933166+0000 mgr.a (mgr.14388) 18484 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:44 smithi027 bash[22610]: cluster 2024-08-31T09:18:42.933166+0000 mgr.a (mgr.14388) 18484 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:44 smithi191 bash[24992]: cluster 2024-08-31T09:18:42.933166+0000 mgr.a (mgr.14388) 18484 : cluster [DBG] pgmap v12814: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:45.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:18:45.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:18:45.242 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:18:45.995 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:18:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:18:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:18:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:18:45.995 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:46 smithi163 bash[24253]: cluster 2024-08-31T09:18:44.933928+0000 mgr.a (mgr.14388) 18485 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:46 smithi163 bash[24253]: audit 2024-08-31T09:18:45.577162+0000 mgr.a (mgr.14388) 18486 : audit [DBG] from='client.397506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:46 smithi027 bash[22610]: cluster 2024-08-31T09:18:44.933928+0000 mgr.a (mgr.14388) 18485 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:46 smithi027 bash[22610]: audit 2024-08-31T09:18:45.577162+0000 mgr.a (mgr.14388) 18486 : audit [DBG] from='client.397506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:46.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:46 smithi191 bash[24992]: cluster 2024-08-31T09:18:44.933928+0000 mgr.a (mgr.14388) 18485 : cluster [DBG] pgmap v12815: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.1 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:46 smithi191 bash[24992]: audit 2024-08-31T09:18:45.577162+0000 mgr.a (mgr.14388) 18486 : audit [DBG] from='client.397506 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:48 smithi163 bash[24253]: cluster 2024-08-31T09:18:46.934976+0000 mgr.a (mgr.14388) 18487 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:48 smithi027 bash[22610]: cluster 2024-08-31T09:18:46.934976+0000 mgr.a (mgr.14388) 18487 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:48 smithi191 bash[24992]: cluster 2024-08-31T09:18:46.934976+0000 mgr.a (mgr.14388) 18487 : cluster [DBG] pgmap v12816: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:50 smithi163 bash[24253]: cluster 2024-08-31T09:18:48.937197+0000 mgr.a (mgr.14388) 18488 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:50 smithi027 bash[22610]: cluster 2024-08-31T09:18:48.937197+0000 mgr.a (mgr.14388) 18488 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:50 smithi191 bash[24992]: cluster 2024-08-31T09:18:48.937197+0000 mgr.a (mgr.14388) 18488 : cluster [DBG] pgmap v12817: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:18:50.997 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:18:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:18:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:18:51.768 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:18:51.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:18:51.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:18:51.768 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:18:51.769 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:52 smithi163 bash[24253]: cluster 2024-08-31T09:18:50.937959+0000 mgr.a (mgr.14388) 18489 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:52 smithi163 bash[24253]: audit 2024-08-31T09:18:51.329193+0000 mgr.a (mgr.14388) 18490 : audit [DBG] from='client.397581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:52 smithi027 bash[22610]: cluster 2024-08-31T09:18:50.937959+0000 mgr.a (mgr.14388) 18489 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:52 smithi027 bash[22610]: audit 2024-08-31T09:18:51.329193+0000 mgr.a (mgr.14388) 18490 : audit [DBG] from='client.397581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:52 smithi191 bash[24992]: cluster 2024-08-31T09:18:50.937959+0000 mgr.a (mgr.14388) 18489 : cluster [DBG] pgmap v12818: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:52 smithi191 bash[24992]: audit 2024-08-31T09:18:51.329193+0000 mgr.a (mgr.14388) 18490 : audit [DBG] from='client.397581 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:54.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:54 smithi163 bash[24253]: cluster 2024-08-31T09:18:52.940180+0000 mgr.a (mgr.14388) 18491 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:18:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:54 smithi027 bash[22610]: cluster 2024-08-31T09:18:52.940180+0000 mgr.a (mgr.14388) 18491 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:18:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:54 smithi191 bash[24992]: cluster 2024-08-31T09:18:52.940180+0000 mgr.a (mgr.14388) 18491 : cluster [DBG] pgmap v12819: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:18:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:56 smithi163 bash[24253]: cluster 2024-08-31T09:18:54.940944+0000 mgr.a (mgr.14388) 18492 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:56 smithi027 bash[22610]: cluster 2024-08-31T09:18:54.940944+0000 mgr.a (mgr.14388) 18492 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:56.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:18:56.770 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:18:56.770 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:18:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:56 smithi191 bash[24992]: cluster 2024-08-31T09:18:54.940944+0000 mgr.a (mgr.14388) 18492 : cluster [DBG] pgmap v12820: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:57.535 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:18:57.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:18:57.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:18:57.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:18:57.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:18:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:58 smithi163 bash[24253]: cluster 2024-08-31T09:18:56.941673+0000 mgr.a (mgr.14388) 18493 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:58.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:18:58 smithi163 bash[24253]: audit 2024-08-31T09:18:57.102869+0000 mgr.a (mgr.14388) 18494 : audit [DBG] from='client.397659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:58 smithi027 bash[22610]: cluster 2024-08-31T09:18:56.941673+0000 mgr.a (mgr.14388) 18493 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:18:58 smithi027 bash[22610]: audit 2024-08-31T09:18:57.102869+0000 mgr.a (mgr.14388) 18494 : audit [DBG] from='client.397659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:18:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:58 smithi191 bash[24992]: cluster 2024-08-31T09:18:56.941673+0000 mgr.a (mgr.14388) 18493 : cluster [DBG] pgmap v12821: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:18:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:18:58 smithi191 bash[24992]: audit 2024-08-31T09:18:57.102869+0000 mgr.a (mgr.14388) 18494 : audit [DBG] from='client.397659 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:00.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:00 smithi163 bash[24253]: cluster 2024-08-31T09:18:58.943984+0000 mgr.a (mgr.14388) 18495 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:00 smithi027 bash[22610]: cluster 2024-08-31T09:18:58.943984+0000 mgr.a (mgr.14388) 18495 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:00 smithi191 bash[24992]: cluster 2024-08-31T09:18:58.943984+0000 mgr.a (mgr.14388) 18495 : cluster [DBG] pgmap v12822: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:02.537 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:19:02.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:19:02.538 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:19:02.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:02 smithi163 bash[24253]: cluster 2024-08-31T09:19:00.944730+0000 mgr.a (mgr.14388) 18496 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:02 smithi027 bash[22610]: cluster 2024-08-31T09:19:00.944730+0000 mgr.a (mgr.14388) 18496 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:02 smithi191 bash[24992]: cluster 2024-08-31T09:19:00.944730+0000 mgr.a (mgr.14388) 18496 : cluster [DBG] pgmap v12823: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:03.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:19:03.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:19:03.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:19:03.299 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:19:03.299 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:19:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:04 smithi163 bash[24253]: audit 2024-08-31T09:19:02.868999+0000 mgr.a (mgr.14388) 18497 : audit [DBG] from='client.397734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:04 smithi163 bash[24253]: cluster 2024-08-31T09:19:02.945874+0000 mgr.a (mgr.14388) 18498 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:04 smithi027 bash[22610]: audit 2024-08-31T09:19:02.868999+0000 mgr.a (mgr.14388) 18497 : audit [DBG] from='client.397734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:04 smithi027 bash[22610]: cluster 2024-08-31T09:19:02.945874+0000 mgr.a (mgr.14388) 18498 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:04 smithi191 bash[24992]: audit 2024-08-31T09:19:02.868999+0000 mgr.a (mgr.14388) 18497 : audit [DBG] from='client.397734 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:04 smithi191 bash[24992]: cluster 2024-08-31T09:19:02.945874+0000 mgr.a (mgr.14388) 18498 : cluster [DBG] pgmap v12824: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:06 smithi163 bash[24253]: cluster 2024-08-31T09:19:04.946669+0000 mgr.a (mgr.14388) 18499 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:19:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:06 smithi027 bash[22610]: cluster 2024-08-31T09:19:04.946669+0000 mgr.a (mgr.14388) 18499 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:19:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:06 smithi191 bash[24992]: cluster 2024-08-31T09:19:04.946669+0000 mgr.a (mgr.14388) 18499 : cluster [DBG] pgmap v12825: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:19:08.300 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:19:08.300 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:19:08.301 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:19:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:08 smithi163 bash[24253]: cluster 2024-08-31T09:19:06.947463+0000 mgr.a (mgr.14388) 18500 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:19:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:08 smithi027 bash[22610]: cluster 2024-08-31T09:19:06.947463+0000 mgr.a (mgr.14388) 18500 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:19:08.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:08 smithi191 bash[24992]: cluster 2024-08-31T09:19:06.947463+0000 mgr.a (mgr.14388) 18500 : cluster [DBG] pgmap v12826: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:19:09.065 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:19:09.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:19:09.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:19:09.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:19:09.065 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:19:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:09 smithi163 bash[24253]: audit 2024-08-31T09:19:08.634294+0000 mgr.a (mgr.14388) 18501 : audit [DBG] from='client.397812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:09 smithi027 bash[22610]: audit 2024-08-31T09:19:08.634294+0000 mgr.a (mgr.14388) 18501 : audit [DBG] from='client.397812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:09.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:09 smithi191 bash[24992]: audit 2024-08-31T09:19:08.634294+0000 mgr.a (mgr.14388) 18501 : audit [DBG] from='client.397812 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:10 smithi163 bash[24253]: cluster 2024-08-31T09:19:08.948826+0000 mgr.a (mgr.14388) 18502 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:10 smithi027 bash[22610]: cluster 2024-08-31T09:19:08.948826+0000 mgr.a (mgr.14388) 18502 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:10 smithi191 bash[24992]: cluster 2024-08-31T09:19:08.948826+0000 mgr.a (mgr.14388) 18502 : cluster [DBG] pgmap v12827: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:12 smithi163 bash[24253]: cluster 2024-08-31T09:19:10.949668+0000 mgr.a (mgr.14388) 18503 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:19:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:12 smithi027 bash[22610]: cluster 2024-08-31T09:19:10.949668+0000 mgr.a (mgr.14388) 18503 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:19:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:12 smithi191 bash[24992]: cluster 2024-08-31T09:19:10.949668+0000 mgr.a (mgr.14388) 18503 : cluster [DBG] pgmap v12828: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:19:14.066 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:19:14.067 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:19:14.067 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:19:14.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:14 smithi163 bash[24253]: cluster 2024-08-31T09:19:12.951787+0000 mgr.a (mgr.14388) 18504 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:14.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:14 smithi027 bash[22610]: cluster 2024-08-31T09:19:12.951787+0000 mgr.a (mgr.14388) 18504 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:14 smithi191 bash[24992]: cluster 2024-08-31T09:19:12.951787+0000 mgr.a (mgr.14388) 18504 : cluster [DBG] pgmap v12829: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:14.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:19:14.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:19:14.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:19:14.848 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:19:14.848 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:19:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:15 smithi163 bash[24253]: audit 2024-08-31T09:19:14.411579+0000 mgr.a (mgr.14388) 18505 : audit [DBG] from='client.397890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:15 smithi027 bash[22610]: audit 2024-08-31T09:19:14.411579+0000 mgr.a (mgr.14388) 18505 : audit [DBG] from='client.397890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:15.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:15 smithi191 bash[24992]: audit 2024-08-31T09:19:14.411579+0000 mgr.a (mgr.14388) 18505 : audit [DBG] from='client.397890 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:16 smithi163 bash[24253]: cluster 2024-08-31T09:19:14.952706+0000 mgr.a (mgr.14388) 18506 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:16 smithi027 bash[22610]: cluster 2024-08-31T09:19:14.952706+0000 mgr.a (mgr.14388) 18506 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:16 smithi191 bash[24992]: cluster 2024-08-31T09:19:14.952706+0000 mgr.a (mgr.14388) 18506 : cluster [DBG] pgmap v12830: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:18 smithi163 bash[24253]: cluster 2024-08-31T09:19:16.953475+0000 mgr.a (mgr.14388) 18507 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:18 smithi027 bash[22610]: cluster 2024-08-31T09:19:16.953475+0000 mgr.a (mgr.14388) 18507 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:18 smithi191 bash[24992]: cluster 2024-08-31T09:19:16.953475+0000 mgr.a (mgr.14388) 18507 : cluster [DBG] pgmap v12831: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:19.849 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:19:19.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:19:19.850 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:19:20.637 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:19:20.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:19:20.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:19:20.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:19:20.641 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:19:20.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:20 smithi163 bash[24253]: cluster 2024-08-31T09:19:18.955689+0000 mgr.a (mgr.14388) 18508 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:20 smithi027 bash[22610]: cluster 2024-08-31T09:19:18.955689+0000 mgr.a (mgr.14388) 18508 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:20 smithi191 bash[24992]: cluster 2024-08-31T09:19:18.955689+0000 mgr.a (mgr.14388) 18508 : cluster [DBG] pgmap v12832: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:21.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:21 smithi163 bash[24253]: audit 2024-08-31T09:19:20.186405+0000 mgr.a (mgr.14388) 18509 : audit [DBG] from='client.397968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:21 smithi027 bash[22610]: audit 2024-08-31T09:19:20.186405+0000 mgr.a (mgr.14388) 18509 : audit [DBG] from='client.397968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:21 smithi191 bash[24992]: audit 2024-08-31T09:19:20.186405+0000 mgr.a (mgr.14388) 18509 : audit [DBG] from='client.397968 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:22 smithi163 bash[24253]: cluster 2024-08-31T09:19:20.956557+0000 mgr.a (mgr.14388) 18510 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:22 smithi027 bash[22610]: cluster 2024-08-31T09:19:20.956557+0000 mgr.a (mgr.14388) 18510 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:22 smithi191 bash[24992]: cluster 2024-08-31T09:19:20.956557+0000 mgr.a (mgr.14388) 18510 : cluster [DBG] pgmap v12833: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:24 smithi163 bash[24253]: cluster 2024-08-31T09:19:22.958715+0000 mgr.a (mgr.14388) 18511 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:24 smithi027 bash[22610]: cluster 2024-08-31T09:19:22.958715+0000 mgr.a (mgr.14388) 18511 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:24 smithi191 bash[24992]: cluster 2024-08-31T09:19:22.958715+0000 mgr.a (mgr.14388) 18511 : cluster [DBG] pgmap v12834: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:25.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:19:25.639 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:19:25.639 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:19:26.387 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:19:26.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:19:26.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:19:26.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:19:26.388 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:19:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:26 smithi163 bash[24253]: cluster 2024-08-31T09:19:24.959478+0000 mgr.a (mgr.14388) 18512 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:26 smithi027 bash[22610]: cluster 2024-08-31T09:19:24.959478+0000 mgr.a (mgr.14388) 18512 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:26 smithi191 bash[24992]: cluster 2024-08-31T09:19:24.959478+0000 mgr.a (mgr.14388) 18512 : cluster [DBG] pgmap v12835: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:27.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:27 smithi163 bash[24253]: audit 2024-08-31T09:19:25.973177+0000 mgr.a (mgr.14388) 18513 : audit [DBG] from='client.398046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:27.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:27 smithi027 bash[22610]: audit 2024-08-31T09:19:25.973177+0000 mgr.a (mgr.14388) 18513 : audit [DBG] from='client.398046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:27 smithi191 bash[24992]: audit 2024-08-31T09:19:25.973177+0000 mgr.a (mgr.14388) 18513 : audit [DBG] from='client.398046 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:28 smithi163 bash[24253]: cluster 2024-08-31T09:19:26.960363+0000 mgr.a (mgr.14388) 18514 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:28 smithi027 bash[22610]: cluster 2024-08-31T09:19:26.960363+0000 mgr.a (mgr.14388) 18514 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:28.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:28 smithi191 bash[24992]: cluster 2024-08-31T09:19:26.960363+0000 mgr.a (mgr.14388) 18514 : cluster [DBG] pgmap v12836: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:30 smithi163 bash[24253]: cluster 2024-08-31T09:19:28.962578+0000 mgr.a (mgr.14388) 18515 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:30 smithi027 bash[22610]: cluster 2024-08-31T09:19:28.962578+0000 mgr.a (mgr.14388) 18515 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:30 smithi191 bash[24992]: cluster 2024-08-31T09:19:28.962578+0000 mgr.a (mgr.14388) 18515 : cluster [DBG] pgmap v12837: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:31.389 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:19:31.390 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:19:31.390 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:19:32.164 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:19:32.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:19:32.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:19:32.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:19:32.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:19:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:32 smithi163 bash[24253]: cluster 2024-08-31T09:19:30.963350+0000 mgr.a (mgr.14388) 18516 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:32 smithi027 bash[22610]: cluster 2024-08-31T09:19:30.963350+0000 mgr.a (mgr.14388) 18516 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:32 smithi191 bash[24992]: cluster 2024-08-31T09:19:30.963350+0000 mgr.a (mgr.14388) 18516 : cluster [DBG] pgmap v12838: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:33.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:33 smithi163 bash[24253]: audit 2024-08-31T09:19:31.726459+0000 mgr.a (mgr.14388) 18517 : audit [DBG] from='client.398124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:33.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:33 smithi027 bash[22610]: audit 2024-08-31T09:19:31.726459+0000 mgr.a (mgr.14388) 18517 : audit [DBG] from='client.398124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:33 smithi191 bash[24992]: audit 2024-08-31T09:19:31.726459+0000 mgr.a (mgr.14388) 18517 : audit [DBG] from='client.398124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:34 smithi163 bash[24253]: cluster 2024-08-31T09:19:32.965572+0000 mgr.a (mgr.14388) 18518 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:34 smithi027 bash[22610]: cluster 2024-08-31T09:19:32.965572+0000 mgr.a (mgr.14388) 18518 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:34 smithi191 bash[24992]: cluster 2024-08-31T09:19:32.965572+0000 mgr.a (mgr.14388) 18518 : cluster [DBG] pgmap v12839: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:19:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:36 smithi163 bash[24253]: cluster 2024-08-31T09:19:34.966307+0000 mgr.a (mgr.14388) 18519 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:36 smithi163 bash[24253]: audit 2024-08-31T09:19:35.817846+0000 mon.a (mon.0) 3341 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:19:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:36 smithi027 bash[22610]: cluster 2024-08-31T09:19:34.966307+0000 mgr.a (mgr.14388) 18519 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:36 smithi027 bash[22610]: audit 2024-08-31T09:19:35.817846+0000 mon.a (mon.0) 3341 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:19:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:36 smithi191 bash[24992]: cluster 2024-08-31T09:19:34.966307+0000 mgr.a (mgr.14388) 18519 : cluster [DBG] pgmap v12840: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:36 smithi191 bash[24992]: audit 2024-08-31T09:19:35.817846+0000 mon.a (mon.0) 3341 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:19:37.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:19:37.166 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:19:37.166 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:19:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:37 smithi163 bash[24253]: audit 2024-08-31T09:19:36.659516+0000 mon.a (mon.0) 3342 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:19:37.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:37 smithi163 bash[24253]: audit 2024-08-31T09:19:36.661461+0000 mon.a (mon.0) 3343 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:19:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:37 smithi163 bash[24253]: audit 2024-08-31T09:19:36.670065+0000 mon.a (mon.0) 3344 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:19:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:37 smithi163 bash[24253]: audit 2024-08-31T09:19:36.674789+0000 mon.a (mon.0) 3345 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:19:37.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:37 smithi163 bash[24253]: audit 2024-08-31T09:19:36.676992+0000 mgr.a (mgr.14388) 18520 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:19:37.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:19:37 smithi027 bash[22863]: debug 2024-08-31T09:19:37.425+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:19:37.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:19:37 smithi027 bash[22863]: debug 2024-08-31T09:19:37.429+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:19:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:37 smithi027 bash[22610]: audit 2024-08-31T09:19:36.659516+0000 mon.a (mon.0) 3342 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:19:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:37 smithi027 bash[22610]: audit 2024-08-31T09:19:36.661461+0000 mon.a (mon.0) 3343 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:19:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:37 smithi027 bash[22610]: audit 2024-08-31T09:19:36.670065+0000 mon.a (mon.0) 3344 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:19:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:37 smithi027 bash[22610]: audit 2024-08-31T09:19:36.674789+0000 mon.a (mon.0) 3345 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:19:37.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:37 smithi027 bash[22610]: audit 2024-08-31T09:19:36.676992+0000 mgr.a (mgr.14388) 18520 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:19:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:37 smithi191 bash[24992]: audit 2024-08-31T09:19:36.659516+0000 mon.a (mon.0) 3342 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:19:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:37 smithi191 bash[24992]: audit 2024-08-31T09:19:36.661461+0000 mon.a (mon.0) 3343 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:19:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:37 smithi191 bash[24992]: audit 2024-08-31T09:19:36.670065+0000 mon.a (mon.0) 3344 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:19:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:37 smithi191 bash[24992]: audit 2024-08-31T09:19:36.674789+0000 mon.a (mon.0) 3345 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:19:37.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:37 smithi191 bash[24992]: audit 2024-08-31T09:19:36.676992+0000 mgr.a (mgr.14388) 18520 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:19:37.904 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:19:37.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:19:37.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:19:37.905 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:19:37.905 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:19:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:38 smithi163 bash[24253]: cluster 2024-08-31T09:19:36.966801+0000 mgr.a (mgr.14388) 18521 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:38 smithi163 bash[24253]: audit 2024-08-31T09:19:37.430219+0000 mgr.a (mgr.14388) 18522 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:19:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:38 smithi163 bash[24253]: cephadm 2024-08-31T09:19:37.431519+0000 mgr.a (mgr.14388) 18523 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:19:38.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:38 smithi163 bash[24253]: audit 2024-08-31T09:19:37.496233+0000 mgr.a (mgr.14388) 18524 : audit [DBG] from='client.398292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:38 smithi027 bash[22610]: cluster 2024-08-31T09:19:36.966801+0000 mgr.a (mgr.14388) 18521 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:38 smithi027 bash[22610]: audit 2024-08-31T09:19:37.430219+0000 mgr.a (mgr.14388) 18522 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:19:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:38 smithi027 bash[22610]: cephadm 2024-08-31T09:19:37.431519+0000 mgr.a (mgr.14388) 18523 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:19:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:38 smithi027 bash[22610]: audit 2024-08-31T09:19:37.496233+0000 mgr.a (mgr.14388) 18524 : audit [DBG] from='client.398292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:38 smithi191 bash[24992]: cluster 2024-08-31T09:19:36.966801+0000 mgr.a (mgr.14388) 18521 : cluster [DBG] pgmap v12841: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:38 smithi191 bash[24992]: audit 2024-08-31T09:19:37.430219+0000 mgr.a (mgr.14388) 18522 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:19:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:38 smithi191 bash[24992]: cephadm 2024-08-31T09:19:37.431519+0000 mgr.a (mgr.14388) 18523 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:19:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:38 smithi191 bash[24992]: audit 2024-08-31T09:19:37.496233+0000 mgr.a (mgr.14388) 18524 : audit [DBG] from='client.398292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:40 smithi163 bash[24253]: cluster 2024-08-31T09:19:38.969032+0000 mgr.a (mgr.14388) 18525 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:40 smithi027 bash[22610]: cluster 2024-08-31T09:19:38.969032+0000 mgr.a (mgr.14388) 18525 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:40 smithi191 bash[24992]: cluster 2024-08-31T09:19:38.969032+0000 mgr.a (mgr.14388) 18525 : cluster [DBG] pgmap v12842: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:42.906 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:19:42.907 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:19:42.907 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:19:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:42 smithi163 bash[24253]: cluster 2024-08-31T09:19:40.969841+0000 mgr.a (mgr.14388) 18526 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:42 smithi027 bash[22610]: cluster 2024-08-31T09:19:40.969841+0000 mgr.a (mgr.14388) 18526 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:42 smithi191 bash[24992]: cluster 2024-08-31T09:19:40.969841+0000 mgr.a (mgr.14388) 18526 : cluster [DBG] pgmap v12843: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:43.658 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:19:43.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:19:43.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:19:43.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:19:43.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:19:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:44 smithi163 bash[24253]: cluster 2024-08-31T09:19:42.971873+0000 mgr.a (mgr.14388) 18527 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:44 smithi163 bash[24253]: audit 2024-08-31T09:19:43.239691+0000 mgr.a (mgr.14388) 18528 : audit [DBG] from='client.398385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:44 smithi027 bash[22610]: cluster 2024-08-31T09:19:42.971873+0000 mgr.a (mgr.14388) 18527 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:44 smithi027 bash[22610]: audit 2024-08-31T09:19:43.239691+0000 mgr.a (mgr.14388) 18528 : audit [DBG] from='client.398385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:44 smithi191 bash[24992]: cluster 2024-08-31T09:19:42.971873+0000 mgr.a (mgr.14388) 18527 : cluster [DBG] pgmap v12844: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:44 smithi191 bash[24992]: audit 2024-08-31T09:19:43.239691+0000 mgr.a (mgr.14388) 18528 : audit [DBG] from='client.398385 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:46 smithi163 bash[24253]: cluster 2024-08-31T09:19:44.972830+0000 mgr.a (mgr.14388) 18529 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:19:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:46 smithi027 bash[22610]: cluster 2024-08-31T09:19:44.972830+0000 mgr.a (mgr.14388) 18529 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:19:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:46 smithi191 bash[24992]: cluster 2024-08-31T09:19:44.972830+0000 mgr.a (mgr.14388) 18529 : cluster [DBG] pgmap v12845: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:19:48.659 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:19:48.660 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:19:48.660 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:19:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:48 smithi163 bash[24253]: cluster 2024-08-31T09:19:46.973621+0000 mgr.a (mgr.14388) 18530 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:19:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:48 smithi027 bash[22610]: cluster 2024-08-31T09:19:46.973621+0000 mgr.a (mgr.14388) 18530 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:19:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:48 smithi191 bash[24992]: cluster 2024-08-31T09:19:46.973621+0000 mgr.a (mgr.14388) 18530 : cluster [DBG] pgmap v12846: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:19:49.396 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:19:49.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:19:49.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:19:49.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:19:49.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:19:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:50 smithi163 bash[24253]: cluster 2024-08-31T09:19:48.975722+0000 mgr.a (mgr.14388) 18531 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:50 smithi163 bash[24253]: audit 2024-08-31T09:19:48.987024+0000 mgr.a (mgr.14388) 18532 : audit [DBG] from='client.398460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:50 smithi027 bash[22610]: cluster 2024-08-31T09:19:48.975722+0000 mgr.a (mgr.14388) 18531 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:50 smithi027 bash[22610]: audit 2024-08-31T09:19:48.987024+0000 mgr.a (mgr.14388) 18532 : audit [DBG] from='client.398460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:50 smithi191 bash[24992]: cluster 2024-08-31T09:19:48.975722+0000 mgr.a (mgr.14388) 18531 : cluster [DBG] pgmap v12847: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:19:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:50 smithi191 bash[24992]: audit 2024-08-31T09:19:48.987024+0000 mgr.a (mgr.14388) 18532 : audit [DBG] from='client.398460 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:52 smithi027 bash[22610]: cluster 2024-08-31T09:19:50.976651+0000 mgr.a (mgr.14388) 18533 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:19:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:52 smithi191 bash[24992]: cluster 2024-08-31T09:19:50.976651+0000 mgr.a (mgr.14388) 18533 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:19:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:52 smithi163 bash[24253]: cluster 2024-08-31T09:19:50.976651+0000 mgr.a (mgr.14388) 18533 : cluster [DBG] pgmap v12848: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:19:54.398 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:19:54.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:19:54.399 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:19:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:54 smithi027 bash[22610]: cluster 2024-08-31T09:19:52.978801+0000 mgr.a (mgr.14388) 18534 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:54 smithi191 bash[24992]: cluster 2024-08-31T09:19:52.978801+0000 mgr.a (mgr.14388) 18534 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:55.189 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:19:55.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:19:55.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:19:55.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:19:55.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:19:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:54 smithi163 bash[24253]: cluster 2024-08-31T09:19:52.978801+0000 mgr.a (mgr.14388) 18534 : cluster [DBG] pgmap v12849: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:56 smithi027 bash[22610]: audit 2024-08-31T09:19:54.737092+0000 mgr.a (mgr.14388) 18535 : audit [DBG] from='client.398538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:56 smithi027 bash[22610]: cluster 2024-08-31T09:19:54.983454+0000 mgr.a (mgr.14388) 18536 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:56 smithi191 bash[24992]: audit 2024-08-31T09:19:54.737092+0000 mgr.a (mgr.14388) 18535 : audit [DBG] from='client.398538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:56 smithi191 bash[24992]: cluster 2024-08-31T09:19:54.983454+0000 mgr.a (mgr.14388) 18536 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:56 smithi163 bash[24253]: audit 2024-08-31T09:19:54.737092+0000 mgr.a (mgr.14388) 18535 : audit [DBG] from='client.398538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:19:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:56 smithi163 bash[24253]: cluster 2024-08-31T09:19:54.983454+0000 mgr.a (mgr.14388) 18536 : cluster [DBG] pgmap v12850: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:19:58 smithi027 bash[22610]: cluster 2024-08-31T09:19:56.984358+0000 mgr.a (mgr.14388) 18537 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:19:58 smithi191 bash[24992]: cluster 2024-08-31T09:19:56.984358+0000 mgr.a (mgr.14388) 18537 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:19:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:19:58 smithi163 bash[24253]: cluster 2024-08-31T09:19:56.984358+0000 mgr.a (mgr.14388) 18537 : cluster [DBG] pgmap v12851: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:00.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:00.191 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:00.191 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:00.967 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:00.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:00.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:00.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:00.968 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:00 smithi027 bash[22610]: cluster 2024-08-31T09:19:58.986602+0000 mgr.a (mgr.14388) 18538 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:00.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:00 smithi027 bash[22610]: cluster 2024-08-31T09:20:00.000122+0000 mon.a (mon.0) 3346 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:20:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:00 smithi191 bash[24992]: cluster 2024-08-31T09:19:58.986602+0000 mgr.a (mgr.14388) 18538 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:00 smithi191 bash[24992]: cluster 2024-08-31T09:20:00.000122+0000 mon.a (mon.0) 3346 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:20:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:00 smithi163 bash[24253]: cluster 2024-08-31T09:19:58.986602+0000 mgr.a (mgr.14388) 18538 : cluster [DBG] pgmap v12852: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:00 smithi163 bash[24253]: cluster 2024-08-31T09:20:00.000122+0000 mon.a (mon.0) 3346 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:20:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:01 smithi027 bash[22610]: audit 2024-08-31T09:20:00.525806+0000 mgr.a (mgr.14388) 18539 : audit [DBG] from='client.398616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:02.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:01 smithi191 bash[24992]: audit 2024-08-31T09:20:00.525806+0000 mgr.a (mgr.14388) 18539 : audit [DBG] from='client.398616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:01 smithi163 bash[24253]: audit 2024-08-31T09:20:00.525806+0000 mgr.a (mgr.14388) 18539 : audit [DBG] from='client.398616 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:02 smithi027 bash[22610]: cluster 2024-08-31T09:20:00.987398+0000 mgr.a (mgr.14388) 18540 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:02 smithi191 bash[24992]: cluster 2024-08-31T09:20:00.987398+0000 mgr.a (mgr.14388) 18540 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:02 smithi163 bash[24253]: cluster 2024-08-31T09:20:00.987398+0000 mgr.a (mgr.14388) 18540 : cluster [DBG] pgmap v12853: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:03 smithi191 bash[24992]: cluster 2024-08-31T09:20:02.989527+0000 mgr.a (mgr.14388) 18541 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:04.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:03 smithi163 bash[24253]: cluster 2024-08-31T09:20:02.989527+0000 mgr.a (mgr.14388) 18541 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:03 smithi027 bash[22610]: cluster 2024-08-31T09:20:02.989527+0000 mgr.a (mgr.14388) 18541 : cluster [DBG] pgmap v12854: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:05.969 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:05.970 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:05.970 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:06 smithi163 bash[24253]: cluster 2024-08-31T09:20:04.990288+0000 mgr.a (mgr.14388) 18542 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:06.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:06 smithi027 bash[22610]: cluster 2024-08-31T09:20:04.990288+0000 mgr.a (mgr.14388) 18542 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:06 smithi191 bash[24992]: cluster 2024-08-31T09:20:04.990288+0000 mgr.a (mgr.14388) 18542 : cluster [DBG] pgmap v12855: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:06.770 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:06.770 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:07 smithi163 bash[24253]: audit 2024-08-31T09:20:06.311292+0000 mgr.a (mgr.14388) 18543 : audit [DBG] from='client.398694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:07 smithi027 bash[22610]: audit 2024-08-31T09:20:06.311292+0000 mgr.a (mgr.14388) 18543 : audit [DBG] from='client.398694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:07 smithi191 bash[24992]: audit 2024-08-31T09:20:06.311292+0000 mgr.a (mgr.14388) 18543 : audit [DBG] from='client.398694 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:08 smithi163 bash[24253]: cluster 2024-08-31T09:20:06.991210+0000 mgr.a (mgr.14388) 18544 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:08 smithi027 bash[22610]: cluster 2024-08-31T09:20:06.991210+0000 mgr.a (mgr.14388) 18544 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:08 smithi191 bash[24992]: cluster 2024-08-31T09:20:06.991210+0000 mgr.a (mgr.14388) 18544 : cluster [DBG] pgmap v12856: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:10.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:10 smithi163 bash[24253]: cluster 2024-08-31T09:20:08.993431+0000 mgr.a (mgr.14388) 18545 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:10 smithi027 bash[22610]: cluster 2024-08-31T09:20:08.993431+0000 mgr.a (mgr.14388) 18545 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:10 smithi191 bash[24992]: cluster 2024-08-31T09:20:08.993431+0000 mgr.a (mgr.14388) 18545 : cluster [DBG] pgmap v12857: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:11.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:11.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:11.772 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:12 smithi163 bash[24253]: cluster 2024-08-31T09:20:10.994183+0000 mgr.a (mgr.14388) 18546 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:12 smithi027 bash[22610]: cluster 2024-08-31T09:20:10.994183+0000 mgr.a (mgr.14388) 18546 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:12 smithi191 bash[24992]: cluster 2024-08-31T09:20:10.994183+0000 mgr.a (mgr.14388) 18546 : cluster [DBG] pgmap v12858: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:12.546 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:12.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:12.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:12.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:12.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:13 smithi163 bash[24253]: audit 2024-08-31T09:20:12.107614+0000 mgr.a (mgr.14388) 18547 : audit [DBG] from='client.398769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:13 smithi027 bash[22610]: audit 2024-08-31T09:20:12.107614+0000 mgr.a (mgr.14388) 18547 : audit [DBG] from='client.398769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:13 smithi191 bash[24992]: audit 2024-08-31T09:20:12.107614+0000 mgr.a (mgr.14388) 18547 : audit [DBG] from='client.398769 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:14 smithi163 bash[24253]: cluster 2024-08-31T09:20:12.996489+0000 mgr.a (mgr.14388) 18548 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:14 smithi027 bash[22610]: cluster 2024-08-31T09:20:12.996489+0000 mgr.a (mgr.14388) 18548 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:14 smithi191 bash[24992]: cluster 2024-08-31T09:20:12.996489+0000 mgr.a (mgr.14388) 18548 : cluster [DBG] pgmap v12859: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:16.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:16 smithi163 bash[24253]: cluster 2024-08-31T09:20:14.997311+0000 mgr.a (mgr.14388) 18549 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:16 smithi027 bash[22610]: cluster 2024-08-31T09:20:14.997311+0000 mgr.a (mgr.14388) 18549 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:16 smithi191 bash[24992]: cluster 2024-08-31T09:20:14.997311+0000 mgr.a (mgr.14388) 18549 : cluster [DBG] pgmap v12860: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:17.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:17.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:17.549 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:18.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:18.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:18.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:18.301 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:18.301 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:18 smithi163 bash[24253]: cluster 2024-08-31T09:20:16.998104+0000 mgr.a (mgr.14388) 18550 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:18 smithi027 bash[22610]: cluster 2024-08-31T09:20:16.998104+0000 mgr.a (mgr.14388) 18550 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:18 smithi191 bash[24992]: cluster 2024-08-31T09:20:16.998104+0000 mgr.a (mgr.14388) 18550 : cluster [DBG] pgmap v12861: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:19 smithi163 bash[24253]: audit 2024-08-31T09:20:17.878573+0000 mgr.a (mgr.14388) 18551 : audit [DBG] from='client.398847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:19.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:19 smithi027 bash[22610]: audit 2024-08-31T09:20:17.878573+0000 mgr.a (mgr.14388) 18551 : audit [DBG] from='client.398847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:19.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:19 smithi191 bash[24992]: audit 2024-08-31T09:20:17.878573+0000 mgr.a (mgr.14388) 18551 : audit [DBG] from='client.398847 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:20 smithi163 bash[24253]: cluster 2024-08-31T09:20:19.000991+0000 mgr.a (mgr.14388) 18552 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:20 smithi027 bash[22610]: cluster 2024-08-31T09:20:19.000991+0000 mgr.a (mgr.14388) 18552 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:20.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:20 smithi191 bash[24992]: cluster 2024-08-31T09:20:19.000991+0000 mgr.a (mgr.14388) 18552 : cluster [DBG] pgmap v12862: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:22 smithi163 bash[24253]: cluster 2024-08-31T09:20:21.001766+0000 mgr.a (mgr.14388) 18553 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:20:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:22 smithi027 bash[22610]: cluster 2024-08-31T09:20:21.001766+0000 mgr.a (mgr.14388) 18553 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:20:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:22 smithi191 bash[24992]: cluster 2024-08-31T09:20:21.001766+0000 mgr.a (mgr.14388) 18553 : cluster [DBG] pgmap v12863: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:20:23.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:23.303 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:23.303 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:24.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:24.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:24.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:24.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:24.086 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:24 smithi163 bash[24253]: cluster 2024-08-31T09:20:23.003683+0000 mgr.a (mgr.14388) 18554 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:24 smithi163 bash[24253]: audit 2024-08-31T09:20:23.639534+0000 mgr.a (mgr.14388) 18555 : audit [DBG] from='client.398925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:24 smithi027 bash[22610]: cluster 2024-08-31T09:20:23.003683+0000 mgr.a (mgr.14388) 18554 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:24 smithi027 bash[22610]: audit 2024-08-31T09:20:23.639534+0000 mgr.a (mgr.14388) 18555 : audit [DBG] from='client.398925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:24 smithi191 bash[24992]: cluster 2024-08-31T09:20:23.003683+0000 mgr.a (mgr.14388) 18554 : cluster [DBG] pgmap v12864: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:24 smithi191 bash[24992]: audit 2024-08-31T09:20:23.639534+0000 mgr.a (mgr.14388) 18555 : audit [DBG] from='client.398925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:26 smithi163 bash[24253]: cluster 2024-08-31T09:20:25.004553+0000 mgr.a (mgr.14388) 18556 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:20:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:26 smithi027 bash[22610]: cluster 2024-08-31T09:20:25.004553+0000 mgr.a (mgr.14388) 18556 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:20:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:26 smithi191 bash[24992]: cluster 2024-08-31T09:20:25.004553+0000 mgr.a (mgr.14388) 18556 : cluster [DBG] pgmap v12865: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:20:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:28 smithi163 bash[24253]: cluster 2024-08-31T09:20:27.005325+0000 mgr.a (mgr.14388) 18557 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:20:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:28 smithi027 bash[22610]: cluster 2024-08-31T09:20:27.005325+0000 mgr.a (mgr.14388) 18557 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:20:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:28 smithi191 bash[24992]: cluster 2024-08-31T09:20:27.005325+0000 mgr.a (mgr.14388) 18557 : cluster [DBG] pgmap v12866: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:20:29.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:29.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:29.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:29.876 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:29.876 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:29.876 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:29.876 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:29.876 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:30 smithi163 bash[24253]: cluster 2024-08-31T09:20:29.007517+0000 mgr.a (mgr.14388) 18558 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:30 smithi163 bash[24253]: audit 2024-08-31T09:20:29.424416+0000 mgr.a (mgr.14388) 18559 : audit [DBG] from='client.399000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:30 smithi027 bash[22610]: cluster 2024-08-31T09:20:29.007517+0000 mgr.a (mgr.14388) 18558 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:30 smithi027 bash[22610]: audit 2024-08-31T09:20:29.424416+0000 mgr.a (mgr.14388) 18559 : audit [DBG] from='client.399000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:30 smithi191 bash[24992]: cluster 2024-08-31T09:20:29.007517+0000 mgr.a (mgr.14388) 18558 : cluster [DBG] pgmap v12867: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:30 smithi191 bash[24992]: audit 2024-08-31T09:20:29.424416+0000 mgr.a (mgr.14388) 18559 : audit [DBG] from='client.399000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:32 smithi163 bash[24253]: cluster 2024-08-31T09:20:31.008436+0000 mgr.a (mgr.14388) 18560 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:32 smithi027 bash[22610]: cluster 2024-08-31T09:20:31.008436+0000 mgr.a (mgr.14388) 18560 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:32.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:32 smithi191 bash[24992]: cluster 2024-08-31T09:20:31.008436+0000 mgr.a (mgr.14388) 18560 : cluster [DBG] pgmap v12868: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:34.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:34 smithi163 bash[24253]: cluster 2024-08-31T09:20:33.010563+0000 mgr.a (mgr.14388) 18561 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:34 smithi027 bash[22610]: cluster 2024-08-31T09:20:33.010563+0000 mgr.a (mgr.14388) 18561 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:34 smithi191 bash[24992]: cluster 2024-08-31T09:20:33.010563+0000 mgr.a (mgr.14388) 18561 : cluster [DBG] pgmap v12869: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:34.878 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:34.878 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:34.879 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:35.625 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:35.625 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:35.626 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:36 smithi163 bash[24253]: cluster 2024-08-31T09:20:35.011023+0000 mgr.a (mgr.14388) 18562 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:36 smithi163 bash[24253]: audit 2024-08-31T09:20:35.209824+0000 mgr.a (mgr.14388) 18563 : audit [DBG] from='client.399078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:36 smithi027 bash[22610]: cluster 2024-08-31T09:20:35.011023+0000 mgr.a (mgr.14388) 18562 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:36 smithi027 bash[22610]: audit 2024-08-31T09:20:35.209824+0000 mgr.a (mgr.14388) 18563 : audit [DBG] from='client.399078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:36 smithi191 bash[24992]: cluster 2024-08-31T09:20:35.011023+0000 mgr.a (mgr.14388) 18562 : cluster [DBG] pgmap v12870: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:36 smithi191 bash[24992]: audit 2024-08-31T09:20:35.209824+0000 mgr.a (mgr.14388) 18563 : audit [DBG] from='client.399078 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:38 smithi163 bash[24253]: cluster 2024-08-31T09:20:37.011818+0000 mgr.a (mgr.14388) 18564 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:38 smithi163 bash[24253]: audit 2024-08-31T09:20:37.483233+0000 mon.a (mon.0) 3347 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:20:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:38 smithi027 bash[22610]: cluster 2024-08-31T09:20:37.011818+0000 mgr.a (mgr.14388) 18564 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:38 smithi027 bash[22610]: audit 2024-08-31T09:20:37.483233+0000 mon.a (mon.0) 3347 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:20:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:38 smithi191 bash[24992]: cluster 2024-08-31T09:20:37.011818+0000 mgr.a (mgr.14388) 18564 : cluster [DBG] pgmap v12871: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:38 smithi191 bash[24992]: audit 2024-08-31T09:20:37.483233+0000 mon.a (mon.0) 3347 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:20:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:39 smithi163 bash[24253]: audit 2024-08-31T09:20:38.313872+0000 mon.a (mon.0) 3348 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:20:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:39 smithi163 bash[24253]: audit 2024-08-31T09:20:38.315539+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:20:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:39 smithi163 bash[24253]: audit 2024-08-31T09:20:38.325395+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:20:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:39 smithi163 bash[24253]: audit 2024-08-31T09:20:38.330213+0000 mon.a (mon.0) 3351 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:20:39.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:39 smithi163 bash[24253]: audit 2024-08-31T09:20:38.332579+0000 mgr.a (mgr.14388) 18565 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:20:39.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:20:39 smithi027 bash[22863]: debug 2024-08-31T09:20:39.059+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:20:39.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:20:39 smithi027 bash[22863]: debug 2024-08-31T09:20:39.059+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:20:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:39 smithi027 bash[22610]: audit 2024-08-31T09:20:38.313872+0000 mon.a (mon.0) 3348 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:20:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:39 smithi027 bash[22610]: audit 2024-08-31T09:20:38.315539+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:20:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:39 smithi027 bash[22610]: audit 2024-08-31T09:20:38.325395+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:20:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:39 smithi027 bash[22610]: audit 2024-08-31T09:20:38.330213+0000 mon.a (mon.0) 3351 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:20:39.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:39 smithi027 bash[22610]: audit 2024-08-31T09:20:38.332579+0000 mgr.a (mgr.14388) 18565 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:20:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:39 smithi191 bash[24992]: audit 2024-08-31T09:20:38.313872+0000 mon.a (mon.0) 3348 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:20:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:39 smithi191 bash[24992]: audit 2024-08-31T09:20:38.315539+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:20:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:39 smithi191 bash[24992]: audit 2024-08-31T09:20:38.325395+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:20:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:39 smithi191 bash[24992]: audit 2024-08-31T09:20:38.330213+0000 mon.a (mon.0) 3351 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:20:39.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:39 smithi191 bash[24992]: audit 2024-08-31T09:20:38.332579+0000 mgr.a (mgr.14388) 18565 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:20:40.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:40.627 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:40.627 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:40 smithi163 bash[24253]: cluster 2024-08-31T09:20:39.013041+0000 mgr.a (mgr.14388) 18566 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:40 smithi163 bash[24253]: audit 2024-08-31T09:20:39.064472+0000 mgr.a (mgr.14388) 18567 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:20:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:40 smithi163 bash[24253]: cephadm 2024-08-31T09:20:39.065601+0000 mgr.a (mgr.14388) 18568 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:20:40.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:40 smithi027 bash[22610]: cluster 2024-08-31T09:20:39.013041+0000 mgr.a (mgr.14388) 18566 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:40 smithi027 bash[22610]: audit 2024-08-31T09:20:39.064472+0000 mgr.a (mgr.14388) 18567 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:20:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:40 smithi027 bash[22610]: cephadm 2024-08-31T09:20:39.065601+0000 mgr.a (mgr.14388) 18568 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:20:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:40 smithi191 bash[24992]: cluster 2024-08-31T09:20:39.013041+0000 mgr.a (mgr.14388) 18566 : cluster [DBG] pgmap v12872: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:20:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:40 smithi191 bash[24992]: audit 2024-08-31T09:20:39.064472+0000 mgr.a (mgr.14388) 18567 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:20:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:40 smithi191 bash[24992]: cephadm 2024-08-31T09:20:39.065601+0000 mgr.a (mgr.14388) 18568 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:20:41.395 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:41.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:41.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:41.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:41.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:42 smithi163 bash[24253]: audit 2024-08-31T09:20:40.961143+0000 mgr.a (mgr.14388) 18569 : audit [DBG] from='client.399261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:42.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:42 smithi163 bash[24253]: cluster 2024-08-31T09:20:41.013652+0000 mgr.a (mgr.14388) 18570 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:42 smithi027 bash[22610]: audit 2024-08-31T09:20:40.961143+0000 mgr.a (mgr.14388) 18569 : audit [DBG] from='client.399261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:42 smithi027 bash[22610]: cluster 2024-08-31T09:20:41.013652+0000 mgr.a (mgr.14388) 18570 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:42 smithi191 bash[24992]: audit 2024-08-31T09:20:40.961143+0000 mgr.a (mgr.14388) 18569 : audit [DBG] from='client.399261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:42 smithi191 bash[24992]: cluster 2024-08-31T09:20:41.013652+0000 mgr.a (mgr.14388) 18570 : cluster [DBG] pgmap v12873: 225 pgs: 225 active+clean; 589 KiB data, 210 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:44 smithi163 bash[24253]: cluster 2024-08-31T09:20:43.015924+0000 mgr.a (mgr.14388) 18571 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:44 smithi027 bash[22610]: cluster 2024-08-31T09:20:43.015924+0000 mgr.a (mgr.14388) 18571 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:44 smithi191 bash[24992]: cluster 2024-08-31T09:20:43.015924+0000 mgr.a (mgr.14388) 18571 : cluster [DBG] pgmap v12874: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:46.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:46.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:46.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:46 smithi163 bash[24253]: cluster 2024-08-31T09:20:45.016695+0000 mgr.a (mgr.14388) 18572 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:46 smithi027 bash[22610]: cluster 2024-08-31T09:20:45.016695+0000 mgr.a (mgr.14388) 18572 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:46 smithi191 bash[24992]: cluster 2024-08-31T09:20:45.016695+0000 mgr.a (mgr.14388) 18572 : cluster [DBG] pgmap v12875: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:47.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:47.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:47.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:47.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:47.132 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:47 smithi163 bash[24253]: audit 2024-08-31T09:20:46.724945+0000 mgr.a (mgr.14388) 18573 : audit [DBG] from='client.399336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:47 smithi027 bash[22610]: audit 2024-08-31T09:20:46.724945+0000 mgr.a (mgr.14388) 18573 : audit [DBG] from='client.399336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:47 smithi191 bash[24992]: audit 2024-08-31T09:20:46.724945+0000 mgr.a (mgr.14388) 18573 : audit [DBG] from='client.399336 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:48 smithi163 bash[24253]: cluster 2024-08-31T09:20:47.017310+0000 mgr.a (mgr.14388) 18574 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:48 smithi027 bash[22610]: cluster 2024-08-31T09:20:47.017310+0000 mgr.a (mgr.14388) 18574 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:48 smithi191 bash[24992]: cluster 2024-08-31T09:20:47.017310+0000 mgr.a (mgr.14388) 18574 : cluster [DBG] pgmap v12876: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:50 smithi163 bash[24253]: cluster 2024-08-31T09:20:49.019646+0000 mgr.a (mgr.14388) 18575 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:50 smithi027 bash[22610]: cluster 2024-08-31T09:20:49.019646+0000 mgr.a (mgr.14388) 18575 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:50 smithi191 bash[24992]: cluster 2024-08-31T09:20:49.019646+0000 mgr.a (mgr.14388) 18575 : cluster [DBG] pgmap v12877: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:52.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:52.134 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:52.134 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:52 smithi163 bash[24253]: cluster 2024-08-31T09:20:51.020420+0000 mgr.a (mgr.14388) 18576 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:52.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:52 smithi027 bash[22610]: cluster 2024-08-31T09:20:51.020420+0000 mgr.a (mgr.14388) 18576 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:52 smithi191 bash[24992]: cluster 2024-08-31T09:20:51.020420+0000 mgr.a (mgr.14388) 18576 : cluster [DBG] pgmap v12878: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:52.909 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:52.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:52.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:52.909 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:52.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:53.701 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:53 smithi163 bash[24253]: audit 2024-08-31T09:20:52.469593+0000 mgr.a (mgr.14388) 18577 : audit [DBG] from='client.399408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:53 smithi027 bash[22610]: audit 2024-08-31T09:20:52.469593+0000 mgr.a (mgr.14388) 18577 : audit [DBG] from='client.399408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:53 smithi191 bash[24992]: audit 2024-08-31T09:20:52.469593+0000 mgr.a (mgr.14388) 18577 : audit [DBG] from='client.399408 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:54.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:54 smithi163 bash[24253]: cluster 2024-08-31T09:20:53.022677+0000 mgr.a (mgr.14388) 18578 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:54 smithi027 bash[22610]: cluster 2024-08-31T09:20:53.022677+0000 mgr.a (mgr.14388) 18578 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:54 smithi191 bash[24992]: cluster 2024-08-31T09:20:53.022677+0000 mgr.a (mgr.14388) 18578 : cluster [DBG] pgmap v12879: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:20:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:56 smithi163 bash[24253]: cluster 2024-08-31T09:20:55.023451+0000 mgr.a (mgr.14388) 18579 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:56 smithi027 bash[22610]: cluster 2024-08-31T09:20:55.023451+0000 mgr.a (mgr.14388) 18579 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:56.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:56 smithi191 bash[24992]: cluster 2024-08-31T09:20:55.023451+0000 mgr.a (mgr.14388) 18579 : cluster [DBG] pgmap v12880: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:57.910 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:20:57.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:20:57.911 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:20:58.671 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:20:58.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:20:58.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:20:58.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:20:58.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:20:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:58 smithi163 bash[24253]: cluster 2024-08-31T09:20:57.024239+0000 mgr.a (mgr.14388) 18580 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:58 smithi027 bash[22610]: cluster 2024-08-31T09:20:57.024239+0000 mgr.a (mgr.14388) 18580 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:58.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:58 smithi191 bash[24992]: cluster 2024-08-31T09:20:57.024239+0000 mgr.a (mgr.14388) 18580 : cluster [DBG] pgmap v12881: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:20:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:20:59 smithi163 bash[24253]: audit 2024-08-31T09:20:58.248341+0000 mgr.a (mgr.14388) 18581 : audit [DBG] from='client.399486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:20:59 smithi027 bash[22610]: audit 2024-08-31T09:20:58.248341+0000 mgr.a (mgr.14388) 18581 : audit [DBG] from='client.399486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:20:59.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:20:59 smithi191 bash[24992]: audit 2024-08-31T09:20:58.248341+0000 mgr.a (mgr.14388) 18581 : audit [DBG] from='client.399486 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:00.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:00 smithi163 bash[24253]: cluster 2024-08-31T09:20:59.027045+0000 mgr.a (mgr.14388) 18582 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:00 smithi027 bash[22610]: cluster 2024-08-31T09:20:59.027045+0000 mgr.a (mgr.14388) 18582 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:00 smithi191 bash[24992]: cluster 2024-08-31T09:20:59.027045+0000 mgr.a (mgr.14388) 18582 : cluster [DBG] pgmap v12882: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:02.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:02 smithi163 bash[24253]: cluster 2024-08-31T09:21:01.027826+0000 mgr.a (mgr.14388) 18583 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:02 smithi027 bash[22610]: cluster 2024-08-31T09:21:01.027826+0000 mgr.a (mgr.14388) 18583 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:02 smithi191 bash[24992]: cluster 2024-08-31T09:21:01.027826+0000 mgr.a (mgr.14388) 18583 : cluster [DBG] pgmap v12883: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:03.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:21:03.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:21:03.674 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:21:04.444 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:21:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:21:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:21:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:21:04.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:21:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:04 smithi163 bash[24253]: cluster 2024-08-31T09:21:03.029762+0000 mgr.a (mgr.14388) 18584 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:04 smithi027 bash[22610]: cluster 2024-08-31T09:21:03.029762+0000 mgr.a (mgr.14388) 18584 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:04 smithi191 bash[24992]: cluster 2024-08-31T09:21:03.029762+0000 mgr.a (mgr.14388) 18584 : cluster [DBG] pgmap v12884: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:05 smithi163 bash[24253]: audit 2024-08-31T09:21:04.006715+0000 mgr.a (mgr.14388) 18585 : audit [DBG] from='client.399561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:05 smithi027 bash[22610]: audit 2024-08-31T09:21:04.006715+0000 mgr.a (mgr.14388) 18585 : audit [DBG] from='client.399561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:05.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:05 smithi191 bash[24992]: audit 2024-08-31T09:21:04.006715+0000 mgr.a (mgr.14388) 18585 : audit [DBG] from='client.399561 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:06 smithi163 bash[24253]: cluster 2024-08-31T09:21:05.030744+0000 mgr.a (mgr.14388) 18586 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:06 smithi027 bash[22610]: cluster 2024-08-31T09:21:05.030744+0000 mgr.a (mgr.14388) 18586 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:06 smithi191 bash[24992]: cluster 2024-08-31T09:21:05.030744+0000 mgr.a (mgr.14388) 18586 : cluster [DBG] pgmap v12885: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:08 smithi163 bash[24253]: cluster 2024-08-31T09:21:07.031464+0000 mgr.a (mgr.14388) 18587 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:21:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:08 smithi027 bash[22610]: cluster 2024-08-31T09:21:07.031464+0000 mgr.a (mgr.14388) 18587 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:21:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:08 smithi191 bash[24992]: cluster 2024-08-31T09:21:07.031464+0000 mgr.a (mgr.14388) 18587 : cluster [DBG] pgmap v12886: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:21:09.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:21:09.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:21:09.446 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:21:10.190 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:21:10.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:21:10.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:21:10.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:21:10.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:21:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:10 smithi163 bash[24253]: cluster 2024-08-31T09:21:09.033619+0000 mgr.a (mgr.14388) 18588 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:10 smithi027 bash[22610]: cluster 2024-08-31T09:21:09.033619+0000 mgr.a (mgr.14388) 18588 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:10 smithi191 bash[24992]: cluster 2024-08-31T09:21:09.033619+0000 mgr.a (mgr.14388) 18588 : cluster [DBG] pgmap v12887: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:11 smithi163 bash[24253]: audit 2024-08-31T09:21:09.779253+0000 mgr.a (mgr.14388) 18589 : audit [DBG] from='client.399639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:11 smithi027 bash[22610]: audit 2024-08-31T09:21:09.779253+0000 mgr.a (mgr.14388) 18589 : audit [DBG] from='client.399639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:11.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:11 smithi191 bash[24992]: audit 2024-08-31T09:21:09.779253+0000 mgr.a (mgr.14388) 18589 : audit [DBG] from='client.399639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:12 smithi163 bash[24253]: cluster 2024-08-31T09:21:11.034541+0000 mgr.a (mgr.14388) 18590 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:12 smithi027 bash[22610]: cluster 2024-08-31T09:21:11.034541+0000 mgr.a (mgr.14388) 18590 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:12 smithi191 bash[24992]: cluster 2024-08-31T09:21:11.034541+0000 mgr.a (mgr.14388) 18590 : cluster [DBG] pgmap v12888: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:14.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:14 smithi163 bash[24253]: cluster 2024-08-31T09:21:13.036663+0000 mgr.a (mgr.14388) 18591 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:14 smithi027 bash[22610]: cluster 2024-08-31T09:21:13.036663+0000 mgr.a (mgr.14388) 18591 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:14.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:14 smithi191 bash[24992]: cluster 2024-08-31T09:21:13.036663+0000 mgr.a (mgr.14388) 18591 : cluster [DBG] pgmap v12889: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:15.191 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:21:15.192 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:21:15.192 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:21:15.942 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:21:15.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:21:15.942 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:21:15.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:21:15.943 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:21:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:16 smithi163 bash[24253]: cluster 2024-08-31T09:21:15.037410+0000 mgr.a (mgr.14388) 18592 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:16 smithi163 bash[24253]: audit 2024-08-31T09:21:15.523530+0000 mgr.a (mgr.14388) 18593 : audit [DBG] from='client.399717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:16 smithi027 bash[22610]: cluster 2024-08-31T09:21:15.037410+0000 mgr.a (mgr.14388) 18592 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:16 smithi027 bash[22610]: audit 2024-08-31T09:21:15.523530+0000 mgr.a (mgr.14388) 18593 : audit [DBG] from='client.399717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:16.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:16 smithi191 bash[24992]: cluster 2024-08-31T09:21:15.037410+0000 mgr.a (mgr.14388) 18592 : cluster [DBG] pgmap v12890: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:16 smithi191 bash[24992]: audit 2024-08-31T09:21:15.523530+0000 mgr.a (mgr.14388) 18593 : audit [DBG] from='client.399717 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:18 smithi163 bash[24253]: cluster 2024-08-31T09:21:17.038512+0000 mgr.a (mgr.14388) 18594 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:18 smithi027 bash[22610]: cluster 2024-08-31T09:21:17.038512+0000 mgr.a (mgr.14388) 18594 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:18.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:18 smithi191 bash[24992]: cluster 2024-08-31T09:21:17.038512+0000 mgr.a (mgr.14388) 18594 : cluster [DBG] pgmap v12891: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:20 smithi027 bash[22610]: cluster 2024-08-31T09:21:19.040926+0000 mgr.a (mgr.14388) 18595 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:20 smithi191 bash[24992]: cluster 2024-08-31T09:21:19.040926+0000 mgr.a (mgr.14388) 18595 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:20.944 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:21:20.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:21:20.945 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:21:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:20 smithi163 bash[24253]: cluster 2024-08-31T09:21:19.040926+0000 mgr.a (mgr.14388) 18595 : cluster [DBG] pgmap v12892: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:21.724 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:21:21.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:21:21.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:21:21.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:21:21.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:21:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:22 smithi027 bash[22610]: cluster 2024-08-31T09:21:21.041528+0000 mgr.a (mgr.14388) 18596 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:22 smithi027 bash[22610]: audit 2024-08-31T09:21:21.284029+0000 mgr.a (mgr.14388) 18597 : audit [DBG] from='client.399795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:22 smithi191 bash[24992]: cluster 2024-08-31T09:21:21.041528+0000 mgr.a (mgr.14388) 18596 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:22 smithi191 bash[24992]: audit 2024-08-31T09:21:21.284029+0000 mgr.a (mgr.14388) 18597 : audit [DBG] from='client.399795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:22 smithi163 bash[24253]: cluster 2024-08-31T09:21:21.041528+0000 mgr.a (mgr.14388) 18596 : cluster [DBG] pgmap v12893: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:22.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:22 smithi163 bash[24253]: audit 2024-08-31T09:21:21.284029+0000 mgr.a (mgr.14388) 18597 : audit [DBG] from='client.399795 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:24 smithi027 bash[22610]: cluster 2024-08-31T09:21:23.043783+0000 mgr.a (mgr.14388) 18598 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:24 smithi191 bash[24992]: cluster 2024-08-31T09:21:23.043783+0000 mgr.a (mgr.14388) 18598 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:24 smithi163 bash[24253]: cluster 2024-08-31T09:21:23.043783+0000 mgr.a (mgr.14388) 18598 : cluster [DBG] pgmap v12894: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:26.725 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:21:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:21:26.726 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:21:26.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:26 smithi027 bash[22610]: cluster 2024-08-31T09:21:25.044549+0000 mgr.a (mgr.14388) 18599 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:26.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:26 smithi191 bash[24992]: cluster 2024-08-31T09:21:25.044549+0000 mgr.a (mgr.14388) 18599 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:26 smithi163 bash[24253]: cluster 2024-08-31T09:21:25.044549+0000 mgr.a (mgr.14388) 18599 : cluster [DBG] pgmap v12895: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:27.507 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:21:27.507 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:21:27.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:21:27.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:21:27.508 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:21:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:28 smithi027 bash[22610]: cluster 2024-08-31T09:21:27.045266+0000 mgr.a (mgr.14388) 18600 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:28 smithi027 bash[22610]: audit 2024-08-31T09:21:27.061608+0000 mgr.a (mgr.14388) 18601 : audit [DBG] from='client.399870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:28 smithi191 bash[24992]: cluster 2024-08-31T09:21:27.045266+0000 mgr.a (mgr.14388) 18600 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:28 smithi191 bash[24992]: audit 2024-08-31T09:21:27.061608+0000 mgr.a (mgr.14388) 18601 : audit [DBG] from='client.399870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:28 smithi163 bash[24253]: cluster 2024-08-31T09:21:27.045266+0000 mgr.a (mgr.14388) 18600 : cluster [DBG] pgmap v12896: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:28.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:28 smithi163 bash[24253]: audit 2024-08-31T09:21:27.061608+0000 mgr.a (mgr.14388) 18601 : audit [DBG] from='client.399870 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:30 smithi027 bash[22610]: cluster 2024-08-31T09:21:29.047629+0000 mgr.a (mgr.14388) 18602 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:30 smithi191 bash[24992]: cluster 2024-08-31T09:21:29.047629+0000 mgr.a (mgr.14388) 18602 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:30 smithi163 bash[24253]: cluster 2024-08-31T09:21:29.047629+0000 mgr.a (mgr.14388) 18602 : cluster [DBG] pgmap v12897: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:21:32.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:21:32.509 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:21:32.510 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:21:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:32 smithi027 bash[22610]: cluster 2024-08-31T09:21:31.048389+0000 mgr.a (mgr.14388) 18603 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:32 smithi191 bash[24992]: cluster 2024-08-31T09:21:31.048389+0000 mgr.a (mgr.14388) 18603 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:32 smithi163 bash[24253]: cluster 2024-08-31T09:21:31.048389+0000 mgr.a (mgr.14388) 18603 : cluster [DBG] pgmap v12898: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:33.252 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:21:33.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:21:33.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:21:33.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:21:33.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:21:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:34 smithi027 bash[22610]: audit 2024-08-31T09:21:32.842349+0000 mgr.a (mgr.14388) 18604 : audit [DBG] from='client.399948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:34 smithi027 bash[22610]: cluster 2024-08-31T09:21:33.055441+0000 mgr.a (mgr.14388) 18605 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:34.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:34 smithi191 bash[24992]: audit 2024-08-31T09:21:32.842349+0000 mgr.a (mgr.14388) 18604 : audit [DBG] from='client.399948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:34 smithi191 bash[24992]: cluster 2024-08-31T09:21:33.055441+0000 mgr.a (mgr.14388) 18605 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:34 smithi163 bash[24253]: audit 2024-08-31T09:21:32.842349+0000 mgr.a (mgr.14388) 18604 : audit [DBG] from='client.399948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:34 smithi163 bash[24253]: cluster 2024-08-31T09:21:33.055441+0000 mgr.a (mgr.14388) 18605 : cluster [DBG] pgmap v12899: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:36.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:36 smithi191 bash[24992]: cluster 2024-08-31T09:21:35.056333+0000 mgr.a (mgr.14388) 18606 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:36 smithi163 bash[24253]: cluster 2024-08-31T09:21:35.056333+0000 mgr.a (mgr.14388) 18606 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:36 smithi027 bash[22610]: cluster 2024-08-31T09:21:35.056333+0000 mgr.a (mgr.14388) 18606 : cluster [DBG] pgmap v12900: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:38.253 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:21:38.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:21:38.254 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:21:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:38 smithi191 bash[24992]: cluster 2024-08-31T09:21:37.057116+0000 mgr.a (mgr.14388) 18607 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:38 smithi163 bash[24253]: cluster 2024-08-31T09:21:37.057116+0000 mgr.a (mgr.14388) 18607 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:38 smithi027 bash[22610]: cluster 2024-08-31T09:21:37.057116+0000 mgr.a (mgr.14388) 18607 : cluster [DBG] pgmap v12901: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:39.004 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:21:39.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:21:39.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:21:39.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:21:39.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:21:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:39 smithi191 bash[24992]: audit 2024-08-31T09:21:38.583550+0000 mgr.a (mgr.14388) 18608 : audit [DBG] from='client.400020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:39 smithi191 bash[24992]: audit 2024-08-31T09:21:39.118568+0000 mon.a (mon.0) 3352 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:21:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:39 smithi163 bash[24253]: audit 2024-08-31T09:21:38.583550+0000 mgr.a (mgr.14388) 18608 : audit [DBG] from='client.400020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:39 smithi163 bash[24253]: audit 2024-08-31T09:21:39.118568+0000 mon.a (mon.0) 3352 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:21:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:39 smithi027 bash[22610]: audit 2024-08-31T09:21:38.583550+0000 mgr.a (mgr.14388) 18608 : audit [DBG] from='client.400020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:39 smithi027 bash[22610]: audit 2024-08-31T09:21:39.118568+0000 mon.a (mon.0) 3352 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:21:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:40 smithi191 bash[24992]: cluster 2024-08-31T09:21:39.059865+0000 mgr.a (mgr.14388) 18609 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:40 smithi191 bash[24992]: audit 2024-08-31T09:21:39.954672+0000 mon.a (mon.0) 3353 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:21:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:40 smithi191 bash[24992]: audit 2024-08-31T09:21:39.956185+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:21:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:40 smithi191 bash[24992]: audit 2024-08-31T09:21:39.965236+0000 mon.a (mon.0) 3355 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:21:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:40 smithi191 bash[24992]: audit 2024-08-31T09:21:39.970190+0000 mon.a (mon.0) 3356 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:21:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:40 smithi163 bash[24253]: cluster 2024-08-31T09:21:39.059865+0000 mgr.a (mgr.14388) 18609 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:40 smithi163 bash[24253]: audit 2024-08-31T09:21:39.954672+0000 mon.a (mon.0) 3353 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:21:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:40 smithi163 bash[24253]: audit 2024-08-31T09:21:39.956185+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:21:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:40 smithi163 bash[24253]: audit 2024-08-31T09:21:39.965236+0000 mon.a (mon.0) 3355 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:21:40.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:40 smithi163 bash[24253]: audit 2024-08-31T09:21:39.970190+0000 mon.a (mon.0) 3356 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:21:40.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:21:40 smithi027 bash[22863]: debug 2024-08-31T09:21:40.709+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:21:40.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:21:40 smithi027 bash[22863]: debug 2024-08-31T09:21:40.709+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:21:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:40 smithi027 bash[22610]: cluster 2024-08-31T09:21:39.059865+0000 mgr.a (mgr.14388) 18609 : cluster [DBG] pgmap v12902: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:40 smithi027 bash[22610]: audit 2024-08-31T09:21:39.954672+0000 mon.a (mon.0) 3353 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:21:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:40 smithi027 bash[22610]: audit 2024-08-31T09:21:39.956185+0000 mon.a (mon.0) 3354 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:21:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:40 smithi027 bash[22610]: audit 2024-08-31T09:21:39.965236+0000 mon.a (mon.0) 3355 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:21:40.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:40 smithi027 bash[22610]: audit 2024-08-31T09:21:39.970190+0000 mon.a (mon.0) 3356 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:21:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:41 smithi191 bash[24992]: audit 2024-08-31T09:21:39.972816+0000 mgr.a (mgr.14388) 18610 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:21:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:41 smithi191 bash[24992]: audit 2024-08-31T09:21:40.711447+0000 mgr.a (mgr.14388) 18611 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:21:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:41 smithi191 bash[24992]: cephadm 2024-08-31T09:21:40.712594+0000 mgr.a (mgr.14388) 18612 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:21:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:41 smithi163 bash[24253]: audit 2024-08-31T09:21:39.972816+0000 mgr.a (mgr.14388) 18610 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:21:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:41 smithi163 bash[24253]: audit 2024-08-31T09:21:40.711447+0000 mgr.a (mgr.14388) 18611 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:21:41.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:41 smithi163 bash[24253]: cephadm 2024-08-31T09:21:40.712594+0000 mgr.a (mgr.14388) 18612 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:21:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:41 smithi027 bash[22610]: audit 2024-08-31T09:21:39.972816+0000 mgr.a (mgr.14388) 18610 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:21:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:41 smithi027 bash[22610]: audit 2024-08-31T09:21:40.711447+0000 mgr.a (mgr.14388) 18611 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:21:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:41 smithi027 bash[22610]: cephadm 2024-08-31T09:21:40.712594+0000 mgr.a (mgr.14388) 18612 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:21:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:42 smithi191 bash[24992]: cluster 2024-08-31T09:21:41.060789+0000 mgr.a (mgr.14388) 18613 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:42 smithi163 bash[24253]: cluster 2024-08-31T09:21:41.060789+0000 mgr.a (mgr.14388) 18613 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:42 smithi027 bash[22610]: cluster 2024-08-31T09:21:41.060789+0000 mgr.a (mgr.14388) 18613 : cluster [DBG] pgmap v12903: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:21:44.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:21:44.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:21:44.007 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:21:44.749 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:21:44.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:21:44.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:21:44.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:21:44.750 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:21:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:44 smithi191 bash[24992]: cluster 2024-08-31T09:21:43.062981+0000 mgr.a (mgr.14388) 18614 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:44 smithi163 bash[24253]: cluster 2024-08-31T09:21:43.062981+0000 mgr.a (mgr.14388) 18614 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:44 smithi027 bash[22610]: cluster 2024-08-31T09:21:43.062981+0000 mgr.a (mgr.14388) 18614 : cluster [DBG] pgmap v12904: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:45 smithi191 bash[24992]: audit 2024-08-31T09:21:44.337371+0000 mgr.a (mgr.14388) 18615 : audit [DBG] from='client.400203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:45 smithi163 bash[24253]: audit 2024-08-31T09:21:44.337371+0000 mgr.a (mgr.14388) 18615 : audit [DBG] from='client.400203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:45 smithi027 bash[22610]: audit 2024-08-31T09:21:44.337371+0000 mgr.a (mgr.14388) 18615 : audit [DBG] from='client.400203 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:46 smithi191 bash[24992]: cluster 2024-08-31T09:21:45.063847+0000 mgr.a (mgr.14388) 18616 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:46 smithi163 bash[24253]: cluster 2024-08-31T09:21:45.063847+0000 mgr.a (mgr.14388) 18616 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:46 smithi027 bash[22610]: cluster 2024-08-31T09:21:45.063847+0000 mgr.a (mgr.14388) 18616 : cluster [DBG] pgmap v12905: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:48 smithi191 bash[24992]: cluster 2024-08-31T09:21:47.064625+0000 mgr.a (mgr.14388) 18617 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:48 smithi163 bash[24253]: cluster 2024-08-31T09:21:47.064625+0000 mgr.a (mgr.14388) 18617 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:48 smithi027 bash[22610]: cluster 2024-08-31T09:21:47.064625+0000 mgr.a (mgr.14388) 18617 : cluster [DBG] pgmap v12906: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:49.751 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:21:49.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:21:49.752 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:21:50.527 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:21:50.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:21:50.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:21:50.527 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:21:50.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:21:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:50 smithi191 bash[24992]: cluster 2024-08-31T09:21:49.066895+0000 mgr.a (mgr.14388) 18618 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:50 smithi163 bash[24253]: cluster 2024-08-31T09:21:49.066895+0000 mgr.a (mgr.14388) 18618 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:50 smithi027 bash[22610]: cluster 2024-08-31T09:21:49.066895+0000 mgr.a (mgr.14388) 18618 : cluster [DBG] pgmap v12907: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:51 smithi163 bash[24253]: audit 2024-08-31T09:21:50.086646+0000 mgr.a (mgr.14388) 18619 : audit [DBG] from='client.400281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:51 smithi027 bash[22610]: audit 2024-08-31T09:21:50.086646+0000 mgr.a (mgr.14388) 18619 : audit [DBG] from='client.400281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:51 smithi191 bash[24992]: audit 2024-08-31T09:21:50.086646+0000 mgr.a (mgr.14388) 18619 : audit [DBG] from='client.400281 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:52 smithi163 bash[24253]: cluster 2024-08-31T09:21:51.067964+0000 mgr.a (mgr.14388) 18620 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:52 smithi027 bash[22610]: cluster 2024-08-31T09:21:51.067964+0000 mgr.a (mgr.14388) 18620 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:52 smithi191 bash[24992]: cluster 2024-08-31T09:21:51.067964+0000 mgr.a (mgr.14388) 18620 : cluster [DBG] pgmap v12908: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:54 smithi163 bash[24253]: cluster 2024-08-31T09:21:53.070270+0000 mgr.a (mgr.14388) 18621 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:54 smithi027 bash[22610]: cluster 2024-08-31T09:21:53.070270+0000 mgr.a (mgr.14388) 18621 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:54 smithi191 bash[24992]: cluster 2024-08-31T09:21:53.070270+0000 mgr.a (mgr.14388) 18621 : cluster [DBG] pgmap v12909: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:21:55.528 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:21:55.529 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:21:55.529 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:21:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:21:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:21:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:21:56.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:21:56.277 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:21:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:56 smithi163 bash[24253]: cluster 2024-08-31T09:21:55.071249+0000 mgr.a (mgr.14388) 18622 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:56 smithi027 bash[22610]: cluster 2024-08-31T09:21:55.071249+0000 mgr.a (mgr.14388) 18622 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:56 smithi191 bash[24992]: cluster 2024-08-31T09:21:55.071249+0000 mgr.a (mgr.14388) 18622 : cluster [DBG] pgmap v12910: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:57 smithi163 bash[24253]: audit 2024-08-31T09:21:55.857364+0000 mgr.a (mgr.14388) 18623 : audit [DBG] from='client.400359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:57 smithi027 bash[22610]: audit 2024-08-31T09:21:55.857364+0000 mgr.a (mgr.14388) 18623 : audit [DBG] from='client.400359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:57 smithi191 bash[24992]: audit 2024-08-31T09:21:55.857364+0000 mgr.a (mgr.14388) 18623 : audit [DBG] from='client.400359 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:21:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:21:58 smithi163 bash[24253]: cluster 2024-08-31T09:21:57.072184+0000 mgr.a (mgr.14388) 18624 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:21:58 smithi027 bash[22610]: cluster 2024-08-31T09:21:57.072184+0000 mgr.a (mgr.14388) 18624 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:21:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:21:58 smithi191 bash[24992]: cluster 2024-08-31T09:21:57.072184+0000 mgr.a (mgr.14388) 18624 : cluster [DBG] pgmap v12911: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:00 smithi163 bash[24253]: cluster 2024-08-31T09:21:59.074368+0000 mgr.a (mgr.14388) 18625 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:00 smithi027 bash[22610]: cluster 2024-08-31T09:21:59.074368+0000 mgr.a (mgr.14388) 18625 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:00 smithi191 bash[24992]: cluster 2024-08-31T09:21:59.074368+0000 mgr.a (mgr.14388) 18625 : cluster [DBG] pgmap v12912: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:01.278 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:01.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:01.279 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:02.059 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:02.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:02.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:02.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:02.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:22:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:02 smithi163 bash[24253]: cluster 2024-08-31T09:22:01.075144+0000 mgr.a (mgr.14388) 18626 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:02 smithi163 bash[24253]: audit 2024-08-31T09:22:01.615514+0000 mgr.a (mgr.14388) 18627 : audit [DBG] from='client.400437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:02 smithi027 bash[22610]: cluster 2024-08-31T09:22:01.075144+0000 mgr.a (mgr.14388) 18626 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:02 smithi027 bash[22610]: audit 2024-08-31T09:22:01.615514+0000 mgr.a (mgr.14388) 18627 : audit [DBG] from='client.400437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:02 smithi191 bash[24992]: cluster 2024-08-31T09:22:01.075144+0000 mgr.a (mgr.14388) 18626 : cluster [DBG] pgmap v12913: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:02 smithi191 bash[24992]: audit 2024-08-31T09:22:01.615514+0000 mgr.a (mgr.14388) 18627 : audit [DBG] from='client.400437 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:04 smithi163 bash[24253]: cluster 2024-08-31T09:22:03.077323+0000 mgr.a (mgr.14388) 18628 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:04 smithi027 bash[22610]: cluster 2024-08-31T09:22:03.077323+0000 mgr.a (mgr.14388) 18628 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:04 smithi191 bash[24992]: cluster 2024-08-31T09:22:03.077323+0000 mgr.a (mgr.14388) 18628 : cluster [DBG] pgmap v12914: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:06 smithi163 bash[24253]: cluster 2024-08-31T09:22:05.078111+0000 mgr.a (mgr.14388) 18629 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:06 smithi027 bash[22610]: cluster 2024-08-31T09:22:05.078111+0000 mgr.a (mgr.14388) 18629 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:06 smithi191 bash[24992]: cluster 2024-08-31T09:22:05.078111+0000 mgr.a (mgr.14388) 18629 : cluster [DBG] pgmap v12915: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:07.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:07.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:07.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:07.841 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:07.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:07.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:07.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:07.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:22:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:08 smithi163 bash[24253]: cluster 2024-08-31T09:22:07.078655+0000 mgr.a (mgr.14388) 18630 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:08.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:08 smithi163 bash[24253]: audit 2024-08-31T09:22:07.395014+0000 mgr.a (mgr.14388) 18631 : audit [DBG] from='client.400512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:08 smithi027 bash[22610]: cluster 2024-08-31T09:22:07.078655+0000 mgr.a (mgr.14388) 18630 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:08 smithi027 bash[22610]: audit 2024-08-31T09:22:07.395014+0000 mgr.a (mgr.14388) 18631 : audit [DBG] from='client.400512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:08 smithi191 bash[24992]: cluster 2024-08-31T09:22:07.078655+0000 mgr.a (mgr.14388) 18630 : cluster [DBG] pgmap v12916: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:08 smithi191 bash[24992]: audit 2024-08-31T09:22:07.395014+0000 mgr.a (mgr.14388) 18631 : audit [DBG] from='client.400512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:10 smithi163 bash[24253]: cluster 2024-08-31T09:22:09.080875+0000 mgr.a (mgr.14388) 18632 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:10 smithi027 bash[22610]: cluster 2024-08-31T09:22:09.080875+0000 mgr.a (mgr.14388) 18632 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:10 smithi191 bash[24992]: cluster 2024-08-31T09:22:09.080875+0000 mgr.a (mgr.14388) 18632 : cluster [DBG] pgmap v12917: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:12.842 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:12.843 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:12.843 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:12 smithi163 bash[24253]: cluster 2024-08-31T09:22:11.081636+0000 mgr.a (mgr.14388) 18633 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:12.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:12 smithi027 bash[22610]: cluster 2024-08-31T09:22:11.081636+0000 mgr.a (mgr.14388) 18633 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:12 smithi191 bash[24992]: cluster 2024-08-31T09:22:11.081636+0000 mgr.a (mgr.14388) 18633 : cluster [DBG] pgmap v12918: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:13.622 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:13.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:22:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:14 smithi163 bash[24253]: cluster 2024-08-31T09:22:13.083605+0000 mgr.a (mgr.14388) 18634 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:14 smithi163 bash[24253]: audit 2024-08-31T09:22:13.177560+0000 mgr.a (mgr.14388) 18635 : audit [DBG] from='client.400590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:14 smithi027 bash[22610]: cluster 2024-08-31T09:22:13.083605+0000 mgr.a (mgr.14388) 18634 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:14 smithi027 bash[22610]: audit 2024-08-31T09:22:13.177560+0000 mgr.a (mgr.14388) 18635 : audit [DBG] from='client.400590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:14 smithi191 bash[24992]: cluster 2024-08-31T09:22:13.083605+0000 mgr.a (mgr.14388) 18634 : cluster [DBG] pgmap v12919: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:14 smithi191 bash[24992]: audit 2024-08-31T09:22:13.177560+0000 mgr.a (mgr.14388) 18635 : audit [DBG] from='client.400590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:16 smithi163 bash[24253]: cluster 2024-08-31T09:22:15.084502+0000 mgr.a (mgr.14388) 18636 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:22:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:16 smithi027 bash[22610]: cluster 2024-08-31T09:22:15.084502+0000 mgr.a (mgr.14388) 18636 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:22:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:16 smithi191 bash[24992]: cluster 2024-08-31T09:22:15.084502+0000 mgr.a (mgr.14388) 18636 : cluster [DBG] pgmap v12920: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:22:18.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:18.625 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:18.625 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:18 smithi163 bash[24253]: cluster 2024-08-31T09:22:17.085294+0000 mgr.a (mgr.14388) 18637 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:22:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:18 smithi027 bash[22610]: cluster 2024-08-31T09:22:17.085294+0000 mgr.a (mgr.14388) 18637 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:22:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:18 smithi191 bash[24992]: cluster 2024-08-31T09:22:17.085294+0000 mgr.a (mgr.14388) 18637 : cluster [DBG] pgmap v12921: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:22:19.386 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:19.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:19.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:19.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:19.386 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:22:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:20 smithi163 bash[24253]: audit 2024-08-31T09:22:18.952859+0000 mgr.a (mgr.14388) 18638 : audit [DBG] from='client.400668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:20 smithi163 bash[24253]: cluster 2024-08-31T09:22:19.095261+0000 mgr.a (mgr.14388) 18639 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:20 smithi027 bash[22610]: audit 2024-08-31T09:22:18.952859+0000 mgr.a (mgr.14388) 18638 : audit [DBG] from='client.400668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:20 smithi027 bash[22610]: cluster 2024-08-31T09:22:19.095261+0000 mgr.a (mgr.14388) 18639 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:20 smithi191 bash[24992]: audit 2024-08-31T09:22:18.952859+0000 mgr.a (mgr.14388) 18638 : audit [DBG] from='client.400668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:20 smithi191 bash[24992]: cluster 2024-08-31T09:22:19.095261+0000 mgr.a (mgr.14388) 18639 : cluster [DBG] pgmap v12922: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:22 smithi163 bash[24253]: cluster 2024-08-31T09:22:21.096139+0000 mgr.a (mgr.14388) 18640 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:22:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:22 smithi027 bash[22610]: cluster 2024-08-31T09:22:21.096139+0000 mgr.a (mgr.14388) 18640 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:22:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:22 smithi191 bash[24992]: cluster 2024-08-31T09:22:21.096139+0000 mgr.a (mgr.14388) 18640 : cluster [DBG] pgmap v12923: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:22:24.387 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:24.388 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:24.389 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:24 smithi163 bash[24253]: cluster 2024-08-31T09:22:23.098268+0000 mgr.a (mgr.14388) 18641 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:24 smithi027 bash[22610]: cluster 2024-08-31T09:22:23.098268+0000 mgr.a (mgr.14388) 18641 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:24 smithi191 bash[24992]: cluster 2024-08-31T09:22:23.098268+0000 mgr.a (mgr.14388) 18641 : cluster [DBG] pgmap v12924: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:25.132 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:25.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:25.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:25.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:25.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:22:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:25 smithi163 bash[24253]: audit 2024-08-31T09:22:24.719738+0000 mgr.a (mgr.14388) 18642 : audit [DBG] from='client.400743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:25 smithi027 bash[22610]: audit 2024-08-31T09:22:24.719738+0000 mgr.a (mgr.14388) 18642 : audit [DBG] from='client.400743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:26.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:25 smithi191 bash[24992]: audit 2024-08-31T09:22:24.719738+0000 mgr.a (mgr.14388) 18642 : audit [DBG] from='client.400743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:26 smithi163 bash[24253]: cluster 2024-08-31T09:22:25.098827+0000 mgr.a (mgr.14388) 18643 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:26 smithi027 bash[22610]: cluster 2024-08-31T09:22:25.098827+0000 mgr.a (mgr.14388) 18643 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:26 smithi191 bash[24992]: cluster 2024-08-31T09:22:25.098827+0000 mgr.a (mgr.14388) 18643 : cluster [DBG] pgmap v12925: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:28 smithi163 bash[24253]: cluster 2024-08-31T09:22:27.099573+0000 mgr.a (mgr.14388) 18644 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:28 smithi027 bash[22610]: cluster 2024-08-31T09:22:27.099573+0000 mgr.a (mgr.14388) 18644 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:28 smithi191 bash[24992]: cluster 2024-08-31T09:22:27.099573+0000 mgr.a (mgr.14388) 18644 : cluster [DBG] pgmap v12926: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:30.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:30.134 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:30.134 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:30.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:30.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:22:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:30 smithi163 bash[24253]: cluster 2024-08-31T09:22:29.101838+0000 mgr.a (mgr.14388) 18645 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:22:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:30 smithi027 bash[22610]: cluster 2024-08-31T09:22:29.101838+0000 mgr.a (mgr.14388) 18645 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:22:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:30 smithi191 bash[24992]: cluster 2024-08-31T09:22:29.101838+0000 mgr.a (mgr.14388) 18645 : cluster [DBG] pgmap v12927: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:22:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:31 smithi163 bash[24253]: audit 2024-08-31T09:22:30.467954+0000 mgr.a (mgr.14388) 18646 : audit [DBG] from='client.400818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:31 smithi027 bash[22610]: audit 2024-08-31T09:22:30.467954+0000 mgr.a (mgr.14388) 18646 : audit [DBG] from='client.400818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:31 smithi191 bash[24992]: audit 2024-08-31T09:22:30.467954+0000 mgr.a (mgr.14388) 18646 : audit [DBG] from='client.400818 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:32 smithi163 bash[24253]: cluster 2024-08-31T09:22:31.102773+0000 mgr.a (mgr.14388) 18647 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:22:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:32 smithi027 bash[22610]: cluster 2024-08-31T09:22:31.102773+0000 mgr.a (mgr.14388) 18647 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:22:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:32 smithi191 bash[24992]: cluster 2024-08-31T09:22:31.102773+0000 mgr.a (mgr.14388) 18647 : cluster [DBG] pgmap v12928: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:22:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:34 smithi163 bash[24253]: cluster 2024-08-31T09:22:33.104904+0000 mgr.a (mgr.14388) 18648 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:22:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:34 smithi027 bash[22610]: cluster 2024-08-31T09:22:33.104904+0000 mgr.a (mgr.14388) 18648 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:22:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:34 smithi191 bash[24992]: cluster 2024-08-31T09:22:33.104904+0000 mgr.a (mgr.14388) 18648 : cluster [DBG] pgmap v12929: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:22:35.875 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:35.876 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:35.876 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:36.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:36.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:36.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:36.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:36.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:22:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:36 smithi163 bash[24253]: cluster 2024-08-31T09:22:35.105678+0000 mgr.a (mgr.14388) 18649 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:22:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:36 smithi027 bash[22610]: cluster 2024-08-31T09:22:35.105678+0000 mgr.a (mgr.14388) 18649 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:22:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:36 smithi191 bash[24992]: cluster 2024-08-31T09:22:35.105678+0000 mgr.a (mgr.14388) 18649 : cluster [DBG] pgmap v12930: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:22:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:37 smithi163 bash[24253]: audit 2024-08-31T09:22:36.213115+0000 mgr.a (mgr.14388) 18650 : audit [DBG] from='client.400896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:37 smithi027 bash[22610]: audit 2024-08-31T09:22:36.213115+0000 mgr.a (mgr.14388) 18650 : audit [DBG] from='client.400896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:37 smithi191 bash[24992]: audit 2024-08-31T09:22:36.213115+0000 mgr.a (mgr.14388) 18650 : audit [DBG] from='client.400896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:38 smithi163 bash[24253]: cluster 2024-08-31T09:22:37.106572+0000 mgr.a (mgr.14388) 18651 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:22:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:38 smithi027 bash[22610]: cluster 2024-08-31T09:22:37.106572+0000 mgr.a (mgr.14388) 18651 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:22:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:38 smithi191 bash[24992]: cluster 2024-08-31T09:22:37.106572+0000 mgr.a (mgr.14388) 18651 : cluster [DBG] pgmap v12931: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:22:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:40 smithi163 bash[24253]: cluster 2024-08-31T09:22:39.108808+0000 mgr.a (mgr.14388) 18652 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:22:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:40 smithi027 bash[22610]: cluster 2024-08-31T09:22:39.108808+0000 mgr.a (mgr.14388) 18652 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:22:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:40 smithi191 bash[24992]: cluster 2024-08-31T09:22:39.108808+0000 mgr.a (mgr.14388) 18652 : cluster [DBG] pgmap v12932: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:22:41.672 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:41.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:41.673 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:41 smithi163 bash[24253]: audit 2024-08-31T09:22:40.770211+0000 mon.a (mon.0) 3357 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:22:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:41 smithi027 bash[22610]: audit 2024-08-31T09:22:40.770211+0000 mon.a (mon.0) 3357 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:22:42.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:41 smithi191 bash[24992]: audit 2024-08-31T09:22:40.770211+0000 mon.a (mon.0) 3357 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:22:42.435 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:42.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:42.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:42.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:42.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:22:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:42 smithi163 bash[24253]: cluster 2024-08-31T09:22:41.109522+0000 mgr.a (mgr.14388) 18653 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:42 smithi027 bash[22610]: cluster 2024-08-31T09:22:41.109522+0000 mgr.a (mgr.14388) 18653 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:42 smithi191 bash[24992]: cluster 2024-08-31T09:22:41.109522+0000 mgr.a (mgr.14388) 18653 : cluster [DBG] pgmap v12933: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:43 smithi163 bash[24253]: audit 2024-08-31T09:22:42.008953+0000 mgr.a (mgr.14388) 18654 : audit [DBG] from='client.400974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:43 smithi027 bash[22610]: audit 2024-08-31T09:22:42.008953+0000 mgr.a (mgr.14388) 18654 : audit [DBG] from='client.400974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:43 smithi191 bash[24992]: audit 2024-08-31T09:22:42.008953+0000 mgr.a (mgr.14388) 18654 : audit [DBG] from='client.400974 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:44 smithi163 bash[24253]: cluster 2024-08-31T09:22:43.111786+0000 mgr.a (mgr.14388) 18655 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:44 smithi027 bash[22610]: cluster 2024-08-31T09:22:43.111786+0000 mgr.a (mgr.14388) 18655 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:44 smithi191 bash[24992]: cluster 2024-08-31T09:22:43.111786+0000 mgr.a (mgr.14388) 18655 : cluster [DBG] pgmap v12934: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:22:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:46 smithi163 bash[24253]: cluster 2024-08-31T09:22:45.112595+0000 mgr.a (mgr.14388) 18656 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:46 smithi163 bash[24253]: audit 2024-08-31T09:22:46.128794+0000 mon.a (mon.0) 3358 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:46 smithi163 bash[24253]: audit 2024-08-31T09:22:46.133158+0000 mon.a (mon.0) 3359 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:46 smithi163 bash[24253]: audit 2024-08-31T09:22:46.152802+0000 mon.a (mon.0) 3360 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:46 smithi163 bash[24253]: audit 2024-08-31T09:22:46.158215+0000 mon.a (mon.0) 3361 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:46 smithi163 bash[24253]: audit 2024-08-31T09:22:46.163046+0000 mon.a (mon.0) 3362 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:46 smithi163 bash[24253]: audit 2024-08-31T09:22:46.168703+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:46 smithi027 bash[22610]: cluster 2024-08-31T09:22:45.112595+0000 mgr.a (mgr.14388) 18656 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:46 smithi027 bash[22610]: audit 2024-08-31T09:22:46.128794+0000 mon.a (mon.0) 3358 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:46 smithi027 bash[22610]: audit 2024-08-31T09:22:46.133158+0000 mon.a (mon.0) 3359 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:46 smithi027 bash[22610]: audit 2024-08-31T09:22:46.152802+0000 mon.a (mon.0) 3360 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:46 smithi027 bash[22610]: audit 2024-08-31T09:22:46.158215+0000 mon.a (mon.0) 3361 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:46 smithi027 bash[22610]: audit 2024-08-31T09:22:46.163046+0000 mon.a (mon.0) 3362 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:46.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:46 smithi027 bash[22610]: audit 2024-08-31T09:22:46.168703+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:46 smithi191 bash[24992]: cluster 2024-08-31T09:22:45.112595+0000 mgr.a (mgr.14388) 18656 : cluster [DBG] pgmap v12935: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:46 smithi191 bash[24992]: audit 2024-08-31T09:22:46.128794+0000 mon.a (mon.0) 3358 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:46 smithi191 bash[24992]: audit 2024-08-31T09:22:46.133158+0000 mon.a (mon.0) 3359 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:46 smithi191 bash[24992]: audit 2024-08-31T09:22:46.152802+0000 mon.a (mon.0) 3360 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:46 smithi191 bash[24992]: audit 2024-08-31T09:22:46.158215+0000 mon.a (mon.0) 3361 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:46 smithi191 bash[24992]: audit 2024-08-31T09:22:46.163046+0000 mon.a (mon.0) 3362 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:46 smithi191 bash[24992]: audit 2024-08-31T09:22:46.168703+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:47.436 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:47.436 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:47.437 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:47.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:22:47 smithi027 bash[22863]: debug 2024-08-31T09:22:47.676+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:22:47.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:22:47 smithi027 bash[22863]: debug 2024-08-31T09:22:47.676+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:22:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:47 smithi027 bash[22610]: audit 2024-08-31T09:22:46.909326+0000 mon.a (mon.0) 3364 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:22:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:47 smithi027 bash[22610]: audit 2024-08-31T09:22:46.910673+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:22:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:47 smithi027 bash[22610]: audit 2024-08-31T09:22:46.920712+0000 mon.a (mon.0) 3366 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:47 smithi027 bash[22610]: audit 2024-08-31T09:22:46.923419+0000 mon.a (mon.0) 3367 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:22:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:47 smithi191 bash[24992]: audit 2024-08-31T09:22:46.909326+0000 mon.a (mon.0) 3364 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:22:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:47 smithi191 bash[24992]: audit 2024-08-31T09:22:46.910673+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:22:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:47 smithi191 bash[24992]: audit 2024-08-31T09:22:46.920712+0000 mon.a (mon.0) 3366 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:47 smithi191 bash[24992]: audit 2024-08-31T09:22:46.923419+0000 mon.a (mon.0) 3367 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:22:48.181 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:48.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:48.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:48.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:48.181 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:22:48.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:47 smithi163 bash[24253]: audit 2024-08-31T09:22:46.909326+0000 mon.a (mon.0) 3364 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:22:48.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:47 smithi163 bash[24253]: audit 2024-08-31T09:22:46.910673+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:22:48.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:47 smithi163 bash[24253]: audit 2024-08-31T09:22:46.920712+0000 mon.a (mon.0) 3366 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:22:48.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:47 smithi163 bash[24253]: audit 2024-08-31T09:22:46.923419+0000 mon.a (mon.0) 3367 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:22:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:48 smithi027 bash[22610]: audit 2024-08-31T09:22:46.924549+0000 mgr.a (mgr.14388) 18657 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:22:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:48 smithi027 bash[22610]: cluster 2024-08-31T09:22:47.113124+0000 mgr.a (mgr.14388) 18658 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:48 smithi027 bash[22610]: audit 2024-08-31T09:22:47.681428+0000 mgr.a (mgr.14388) 18659 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:22:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:48 smithi027 bash[22610]: cephadm 2024-08-31T09:22:47.682668+0000 mgr.a (mgr.14388) 18660 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:22:48.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:48 smithi027 bash[22610]: audit 2024-08-31T09:22:47.767146+0000 mgr.a (mgr.14388) 18661 : audit [DBG] from='client.401142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:49.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:48 smithi191 bash[24992]: audit 2024-08-31T09:22:46.924549+0000 mgr.a (mgr.14388) 18657 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:22:49.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:48 smithi191 bash[24992]: cluster 2024-08-31T09:22:47.113124+0000 mgr.a (mgr.14388) 18658 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:49.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:48 smithi191 bash[24992]: audit 2024-08-31T09:22:47.681428+0000 mgr.a (mgr.14388) 18659 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:22:49.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:48 smithi191 bash[24992]: cephadm 2024-08-31T09:22:47.682668+0000 mgr.a (mgr.14388) 18660 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:22:49.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:48 smithi191 bash[24992]: audit 2024-08-31T09:22:47.767146+0000 mgr.a (mgr.14388) 18661 : audit [DBG] from='client.401142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:48 smithi163 bash[24253]: audit 2024-08-31T09:22:46.924549+0000 mgr.a (mgr.14388) 18657 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:22:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:48 smithi163 bash[24253]: cluster 2024-08-31T09:22:47.113124+0000 mgr.a (mgr.14388) 18658 : cluster [DBG] pgmap v12936: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:22:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:48 smithi163 bash[24253]: audit 2024-08-31T09:22:47.681428+0000 mgr.a (mgr.14388) 18659 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:22:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:48 smithi163 bash[24253]: cephadm 2024-08-31T09:22:47.682668+0000 mgr.a (mgr.14388) 18660 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:22:49.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:48 smithi163 bash[24253]: audit 2024-08-31T09:22:47.767146+0000 mgr.a (mgr.14388) 18661 : audit [DBG] from='client.401142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:50 smithi027 bash[22610]: cluster 2024-08-31T09:22:49.115909+0000 mgr.a (mgr.14388) 18662 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:22:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:50 smithi191 bash[24992]: cluster 2024-08-31T09:22:49.115909+0000 mgr.a (mgr.14388) 18662 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:22:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:50 smithi163 bash[24253]: cluster 2024-08-31T09:22:49.115909+0000 mgr.a (mgr.14388) 18662 : cluster [DBG] pgmap v12937: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:22:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:52 smithi027 bash[22610]: cluster 2024-08-31T09:22:51.116697+0000 mgr.a (mgr.14388) 18663 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:22:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:52 smithi191 bash[24992]: cluster 2024-08-31T09:22:51.116697+0000 mgr.a (mgr.14388) 18663 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:22:53.182 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:53.183 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:53.183 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:52 smithi163 bash[24253]: cluster 2024-08-31T09:22:51.116697+0000 mgr.a (mgr.14388) 18663 : cluster [DBG] pgmap v12938: 225 pgs: 225 active+clean; 589 KiB data, 214 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:22:53.970 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:53.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:53.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:53.970 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:53.971 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:22:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:54 smithi027 bash[22610]: cluster 2024-08-31T09:22:53.118649+0000 mgr.a (mgr.14388) 18664 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:22:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:54 smithi027 bash[22610]: audit 2024-08-31T09:22:53.518576+0000 mgr.a (mgr.14388) 18665 : audit [DBG] from='client.401235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:54 smithi191 bash[24992]: cluster 2024-08-31T09:22:53.118649+0000 mgr.a (mgr.14388) 18664 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:22:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:54 smithi191 bash[24992]: audit 2024-08-31T09:22:53.518576+0000 mgr.a (mgr.14388) 18665 : audit [DBG] from='client.401235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:54 smithi163 bash[24253]: cluster 2024-08-31T09:22:53.118649+0000 mgr.a (mgr.14388) 18664 : cluster [DBG] pgmap v12939: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:22:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:54 smithi163 bash[24253]: audit 2024-08-31T09:22:53.518576+0000 mgr.a (mgr.14388) 18665 : audit [DBG] from='client.401235 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:22:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:56 smithi027 bash[22610]: cluster 2024-08-31T09:22:55.119617+0000 mgr.a (mgr.14388) 18666 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:22:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:56 smithi191 bash[24992]: cluster 2024-08-31T09:22:55.119617+0000 mgr.a (mgr.14388) 18666 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:22:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:56 smithi163 bash[24253]: cluster 2024-08-31T09:22:55.119617+0000 mgr.a (mgr.14388) 18666 : cluster [DBG] pgmap v12940: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:22:58.972 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:22:58.972 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:22:58.973 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:22:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:22:58 smithi027 bash[22610]: cluster 2024-08-31T09:22:57.120385+0000 mgr.a (mgr.14388) 18667 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:22:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:22:58 smithi191 bash[24992]: cluster 2024-08-31T09:22:57.120385+0000 mgr.a (mgr.14388) 18667 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:22:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:22:58 smithi163 bash[24253]: cluster 2024-08-31T09:22:57.120385+0000 mgr.a (mgr.14388) 18667 : cluster [DBG] pgmap v12941: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:22:59.747 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:22:59.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:22:59.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:22:59.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:22:59.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:00 smithi027 bash[22610]: cluster 2024-08-31T09:22:59.122538+0000 mgr.a (mgr.14388) 18668 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:23:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:00 smithi027 bash[22610]: audit 2024-08-31T09:22:59.306765+0000 mgr.a (mgr.14388) 18669 : audit [DBG] from='client.401313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:00 smithi191 bash[24992]: cluster 2024-08-31T09:22:59.122538+0000 mgr.a (mgr.14388) 18668 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:23:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:00 smithi191 bash[24992]: audit 2024-08-31T09:22:59.306765+0000 mgr.a (mgr.14388) 18669 : audit [DBG] from='client.401313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:00 smithi163 bash[24253]: cluster 2024-08-31T09:22:59.122538+0000 mgr.a (mgr.14388) 18668 : cluster [DBG] pgmap v12942: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 39 KiB/s rd, 426 B/s wr, 59 op/s 2024-08-31T09:23:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:00 smithi163 bash[24253]: audit 2024-08-31T09:22:59.306765+0000 mgr.a (mgr.14388) 18669 : audit [DBG] from='client.401313 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:02 smithi027 bash[22610]: cluster 2024-08-31T09:23:01.123444+0000 mgr.a (mgr.14388) 18670 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:23:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:02 smithi191 bash[24992]: cluster 2024-08-31T09:23:01.123444+0000 mgr.a (mgr.14388) 18670 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:23:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:02 smithi163 bash[24253]: cluster 2024-08-31T09:23:01.123444+0000 mgr.a (mgr.14388) 18670 : cluster [DBG] pgmap v12943: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:23:04.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:23:04.750 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:23:04.750 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:23:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:04 smithi191 bash[24992]: cluster 2024-08-31T09:23:03.125616+0000 mgr.a (mgr.14388) 18671 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:23:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:04 smithi163 bash[24253]: cluster 2024-08-31T09:23:03.125616+0000 mgr.a (mgr.14388) 18671 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:23:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:04 smithi027 bash[22610]: cluster 2024-08-31T09:23:03.125616+0000 mgr.a (mgr.14388) 18671 : cluster [DBG] pgmap v12944: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:23:05.496 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:23:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:23:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:23:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:23:05.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:06 smithi191 bash[24992]: audit 2024-08-31T09:23:05.077165+0000 mgr.a (mgr.14388) 18672 : audit [DBG] from='client.401388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:06 smithi191 bash[24992]: cluster 2024-08-31T09:23:05.126378+0000 mgr.a (mgr.14388) 18673 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:06 smithi163 bash[24253]: audit 2024-08-31T09:23:05.077165+0000 mgr.a (mgr.14388) 18672 : audit [DBG] from='client.401388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:06 smithi163 bash[24253]: cluster 2024-08-31T09:23:05.126378+0000 mgr.a (mgr.14388) 18673 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:06 smithi027 bash[22610]: audit 2024-08-31T09:23:05.077165+0000 mgr.a (mgr.14388) 18672 : audit [DBG] from='client.401388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:06 smithi027 bash[22610]: cluster 2024-08-31T09:23:05.126378+0000 mgr.a (mgr.14388) 18673 : cluster [DBG] pgmap v12945: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:08 smithi191 bash[24992]: cluster 2024-08-31T09:23:07.127307+0000 mgr.a (mgr.14388) 18674 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:08 smithi163 bash[24253]: cluster 2024-08-31T09:23:07.127307+0000 mgr.a (mgr.14388) 18674 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:08 smithi027 bash[22610]: cluster 2024-08-31T09:23:07.127307+0000 mgr.a (mgr.14388) 18674 : cluster [DBG] pgmap v12946: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:10.498 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:23:10.498 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:23:10.499 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:23:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:10 smithi191 bash[24992]: cluster 2024-08-31T09:23:09.129536+0000 mgr.a (mgr.14388) 18675 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:10 smithi163 bash[24253]: cluster 2024-08-31T09:23:09.129536+0000 mgr.a (mgr.14388) 18675 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:10 smithi027 bash[22610]: cluster 2024-08-31T09:23:09.129536+0000 mgr.a (mgr.14388) 18675 : cluster [DBG] pgmap v12947: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:11.256 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:23:11.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:23:11.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:23:11.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:23:11.257 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:12 smithi191 bash[24992]: audit 2024-08-31T09:23:10.833251+0000 mgr.a (mgr.14388) 18676 : audit [DBG] from='client.401466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:12 smithi191 bash[24992]: cluster 2024-08-31T09:23:11.129978+0000 mgr.a (mgr.14388) 18677 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:12 smithi163 bash[24253]: audit 2024-08-31T09:23:10.833251+0000 mgr.a (mgr.14388) 18676 : audit [DBG] from='client.401466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:12 smithi163 bash[24253]: cluster 2024-08-31T09:23:11.129978+0000 mgr.a (mgr.14388) 18677 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:12 smithi027 bash[22610]: audit 2024-08-31T09:23:10.833251+0000 mgr.a (mgr.14388) 18676 : audit [DBG] from='client.401466 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:12 smithi027 bash[22610]: cluster 2024-08-31T09:23:11.129978+0000 mgr.a (mgr.14388) 18677 : cluster [DBG] pgmap v12948: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:14 smithi191 bash[24992]: cluster 2024-08-31T09:23:13.132159+0000 mgr.a (mgr.14388) 18678 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:14 smithi163 bash[24253]: cluster 2024-08-31T09:23:13.132159+0000 mgr.a (mgr.14388) 18678 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:14 smithi027 bash[22610]: cluster 2024-08-31T09:23:13.132159+0000 mgr.a (mgr.14388) 18678 : cluster [DBG] pgmap v12949: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:16.258 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:23:16.259 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:23:16.259 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:23:17.012 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:23:17.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:23:17.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:23:17.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:23:17.012 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:16 smithi191 bash[24992]: cluster 2024-08-31T09:23:15.132935+0000 mgr.a (mgr.14388) 18679 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:16 smithi163 bash[24253]: cluster 2024-08-31T09:23:15.132935+0000 mgr.a (mgr.14388) 18679 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:16 smithi027 bash[22610]: cluster 2024-08-31T09:23:15.132935+0000 mgr.a (mgr.14388) 18679 : cluster [DBG] pgmap v12950: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:17 smithi191 bash[24992]: audit 2024-08-31T09:23:16.589584+0000 mgr.a (mgr.14388) 18680 : audit [DBG] from='client.401544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:18.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:17 smithi163 bash[24253]: audit 2024-08-31T09:23:16.589584+0000 mgr.a (mgr.14388) 18680 : audit [DBG] from='client.401544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:17 smithi027 bash[22610]: audit 2024-08-31T09:23:16.589584+0000 mgr.a (mgr.14388) 18680 : audit [DBG] from='client.401544 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:18 smithi191 bash[24992]: cluster 2024-08-31T09:23:17.133809+0000 mgr.a (mgr.14388) 18681 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:18 smithi163 bash[24253]: cluster 2024-08-31T09:23:17.133809+0000 mgr.a (mgr.14388) 18681 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:18 smithi027 bash[22610]: cluster 2024-08-31T09:23:17.133809+0000 mgr.a (mgr.14388) 18681 : cluster [DBG] pgmap v12951: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:20 smithi191 bash[24992]: cluster 2024-08-31T09:23:19.136053+0000 mgr.a (mgr.14388) 18682 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:20 smithi163 bash[24253]: cluster 2024-08-31T09:23:19.136053+0000 mgr.a (mgr.14388) 18682 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:20 smithi027 bash[22610]: cluster 2024-08-31T09:23:19.136053+0000 mgr.a (mgr.14388) 18682 : cluster [DBG] pgmap v12952: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:22.013 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:23:22.014 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:23:22.014 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:23:22.788 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:23:22.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:23:22.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:23:22.789 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:22.789 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:23:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:22 smithi191 bash[24992]: cluster 2024-08-31T09:23:21.136852+0000 mgr.a (mgr.14388) 18683 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:22 smithi163 bash[24253]: cluster 2024-08-31T09:23:21.136852+0000 mgr.a (mgr.14388) 18683 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:22 smithi027 bash[22610]: cluster 2024-08-31T09:23:21.136852+0000 mgr.a (mgr.14388) 18683 : cluster [DBG] pgmap v12953: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:24.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:23 smithi163 bash[24253]: audit 2024-08-31T09:23:22.348947+0000 mgr.a (mgr.14388) 18684 : audit [DBG] from='client.401622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:23 smithi027 bash[22610]: audit 2024-08-31T09:23:22.348947+0000 mgr.a (mgr.14388) 18684 : audit [DBG] from='client.401622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:23 smithi191 bash[24992]: audit 2024-08-31T09:23:22.348947+0000 mgr.a (mgr.14388) 18684 : audit [DBG] from='client.401622 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:24 smithi163 bash[24253]: cluster 2024-08-31T09:23:23.139331+0000 mgr.a (mgr.14388) 18685 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:24 smithi027 bash[22610]: cluster 2024-08-31T09:23:23.139331+0000 mgr.a (mgr.14388) 18685 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:24 smithi191 bash[24992]: cluster 2024-08-31T09:23:23.139331+0000 mgr.a (mgr.14388) 18685 : cluster [DBG] pgmap v12954: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:26.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:25 smithi163 bash[24253]: cluster 2024-08-31T09:23:25.140129+0000 mgr.a (mgr.14388) 18686 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:25 smithi027 bash[22610]: cluster 2024-08-31T09:23:25.140129+0000 mgr.a (mgr.14388) 18686 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:25 smithi191 bash[24992]: cluster 2024-08-31T09:23:25.140129+0000 mgr.a (mgr.14388) 18686 : cluster [DBG] pgmap v12955: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:27.790 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:23:27.791 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:23:27.791 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:23:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:28 smithi163 bash[24253]: cluster 2024-08-31T09:23:27.140888+0000 mgr.a (mgr.14388) 18687 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:28.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:28 smithi027 bash[22610]: cluster 2024-08-31T09:23:27.140888+0000 mgr.a (mgr.14388) 18687 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:28 smithi191 bash[24992]: cluster 2024-08-31T09:23:27.140888+0000 mgr.a (mgr.14388) 18687 : cluster [DBG] pgmap v12956: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:28.559 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:23:28.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:23:28.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:23:28.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:23:28.559 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:29 smithi027 bash[22610]: audit 2024-08-31T09:23:28.123979+0000 mgr.a (mgr.14388) 18688 : audit [DBG] from='client.401700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:29 smithi191 bash[24992]: audit 2024-08-31T09:23:28.123979+0000 mgr.a (mgr.14388) 18688 : audit [DBG] from='client.401700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:29.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:29 smithi163 bash[24253]: audit 2024-08-31T09:23:28.123979+0000 mgr.a (mgr.14388) 18688 : audit [DBG] from='client.401700 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:30 smithi027 bash[22610]: cluster 2024-08-31T09:23:29.143785+0000 mgr.a (mgr.14388) 18689 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:30 smithi191 bash[24992]: cluster 2024-08-31T09:23:29.143785+0000 mgr.a (mgr.14388) 18689 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:30 smithi163 bash[24253]: cluster 2024-08-31T09:23:29.143785+0000 mgr.a (mgr.14388) 18689 : cluster [DBG] pgmap v12957: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:32 smithi027 bash[22610]: cluster 2024-08-31T09:23:31.144564+0000 mgr.a (mgr.14388) 18690 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:23:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:32 smithi191 bash[24992]: cluster 2024-08-31T09:23:31.144564+0000 mgr.a (mgr.14388) 18690 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:23:32.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:32 smithi163 bash[24253]: cluster 2024-08-31T09:23:31.144564+0000 mgr.a (mgr.14388) 18690 : cluster [DBG] pgmap v12958: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:23:33.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:23:33.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:23:33.561 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:23:34.339 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:23:34.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:23:34.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:23:34.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:23:34.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:34 smithi027 bash[22610]: cluster 2024-08-31T09:23:33.146501+0000 mgr.a (mgr.14388) 18691 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:34 smithi191 bash[24992]: cluster 2024-08-31T09:23:33.146501+0000 mgr.a (mgr.14388) 18691 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:34 smithi163 bash[24253]: cluster 2024-08-31T09:23:33.146501+0000 mgr.a (mgr.14388) 18691 : cluster [DBG] pgmap v12959: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:35 smithi027 bash[22610]: audit 2024-08-31T09:23:33.898842+0000 mgr.a (mgr.14388) 18692 : audit [DBG] from='client.401778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:35.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:35 smithi191 bash[24992]: audit 2024-08-31T09:23:33.898842+0000 mgr.a (mgr.14388) 18692 : audit [DBG] from='client.401778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:35.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:35 smithi163 bash[24253]: audit 2024-08-31T09:23:33.898842+0000 mgr.a (mgr.14388) 18692 : audit [DBG] from='client.401778 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:36.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:36 smithi027 bash[22610]: cluster 2024-08-31T09:23:35.147463+0000 mgr.a (mgr.14388) 18693 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:23:36.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:36 smithi191 bash[24992]: cluster 2024-08-31T09:23:35.147463+0000 mgr.a (mgr.14388) 18693 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:23:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:36 smithi163 bash[24253]: cluster 2024-08-31T09:23:35.147463+0000 mgr.a (mgr.14388) 18693 : cluster [DBG] pgmap v12960: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:23:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:38 smithi027 bash[22610]: cluster 2024-08-31T09:23:37.148411+0000 mgr.a (mgr.14388) 18694 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:23:38.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:38 smithi191 bash[24992]: cluster 2024-08-31T09:23:37.148411+0000 mgr.a (mgr.14388) 18694 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:23:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:38 smithi163 bash[24253]: cluster 2024-08-31T09:23:37.148411+0000 mgr.a (mgr.14388) 18694 : cluster [DBG] pgmap v12961: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:23:39.341 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:23:39.342 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:23:39.342 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:23:40.091 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:23:40.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:23:40.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:23:40.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:23:40.091 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:40.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:40 smithi191 bash[24992]: cluster 2024-08-31T09:23:39.150809+0000 mgr.a (mgr.14388) 18695 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:40 smithi191 bash[24992]: audit 2024-08-31T09:23:39.669467+0000 mgr.a (mgr.14388) 18696 : audit [DBG] from='client.401850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:40 smithi163 bash[24253]: cluster 2024-08-31T09:23:39.150809+0000 mgr.a (mgr.14388) 18695 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:40 smithi163 bash[24253]: audit 2024-08-31T09:23:39.669467+0000 mgr.a (mgr.14388) 18696 : audit [DBG] from='client.401850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:40 smithi027 bash[22610]: cluster 2024-08-31T09:23:39.150809+0000 mgr.a (mgr.14388) 18695 : cluster [DBG] pgmap v12962: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:40 smithi027 bash[22610]: audit 2024-08-31T09:23:39.669467+0000 mgr.a (mgr.14388) 18696 : audit [DBG] from='client.401850 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:42 smithi191 bash[24992]: cluster 2024-08-31T09:23:41.151819+0000 mgr.a (mgr.14388) 18697 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:42 smithi163 bash[24253]: cluster 2024-08-31T09:23:41.151819+0000 mgr.a (mgr.14388) 18697 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:42 smithi027 bash[22610]: cluster 2024-08-31T09:23:41.151819+0000 mgr.a (mgr.14388) 18697 : cluster [DBG] pgmap v12963: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:44 smithi191 bash[24992]: cluster 2024-08-31T09:23:43.153950+0000 mgr.a (mgr.14388) 18698 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:44 smithi163 bash[24253]: cluster 2024-08-31T09:23:43.153950+0000 mgr.a (mgr.14388) 18698 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:44 smithi027 bash[22610]: cluster 2024-08-31T09:23:43.153950+0000 mgr.a (mgr.14388) 18698 : cluster [DBG] pgmap v12964: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:45.092 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:23:45.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:23:45.094 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:23:45.836 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:23:45.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:23:45.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:23:45.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:23:45.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:46 smithi191 bash[24992]: cluster 2024-08-31T09:23:45.154713+0000 mgr.a (mgr.14388) 18699 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:46 smithi191 bash[24992]: audit 2024-08-31T09:23:45.424419+0000 mgr.a (mgr.14388) 18700 : audit [DBG] from='client.401928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:46 smithi163 bash[24253]: cluster 2024-08-31T09:23:45.154713+0000 mgr.a (mgr.14388) 18699 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:46 smithi163 bash[24253]: audit 2024-08-31T09:23:45.424419+0000 mgr.a (mgr.14388) 18700 : audit [DBG] from='client.401928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:46 smithi027 bash[22610]: cluster 2024-08-31T09:23:45.154713+0000 mgr.a (mgr.14388) 18699 : cluster [DBG] pgmap v12965: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:46 smithi027 bash[22610]: audit 2024-08-31T09:23:45.424419+0000 mgr.a (mgr.14388) 18700 : audit [DBG] from='client.401928 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:48 smithi191 bash[24992]: cluster 2024-08-31T09:23:47.155671+0000 mgr.a (mgr.14388) 18701 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:48 smithi191 bash[24992]: audit 2024-08-31T09:23:47.734434+0000 mon.a (mon.0) 3368 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:23:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:48 smithi163 bash[24253]: cluster 2024-08-31T09:23:47.155671+0000 mgr.a (mgr.14388) 18701 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:48 smithi163 bash[24253]: audit 2024-08-31T09:23:47.734434+0000 mon.a (mon.0) 3368 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:23:48.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:48 smithi027 bash[22610]: cluster 2024-08-31T09:23:47.155671+0000 mgr.a (mgr.14388) 18701 : cluster [DBG] pgmap v12966: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:48 smithi027 bash[22610]: audit 2024-08-31T09:23:47.734434+0000 mon.a (mon.0) 3368 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:23:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:49 smithi191 bash[24992]: audit 2024-08-31T09:23:48.578802+0000 mon.a (mon.0) 3369 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:23:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:49 smithi191 bash[24992]: audit 2024-08-31T09:23:48.580487+0000 mon.a (mon.0) 3370 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:23:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:49 smithi191 bash[24992]: audit 2024-08-31T09:23:48.590983+0000 mon.a (mon.0) 3371 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:23:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:49 smithi191 bash[24992]: audit 2024-08-31T09:23:48.595832+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:23:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:49 smithi191 bash[24992]: audit 2024-08-31T09:23:48.597172+0000 mgr.a (mgr.14388) 18702 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:23:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:49 smithi163 bash[24253]: audit 2024-08-31T09:23:48.578802+0000 mon.a (mon.0) 3369 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:23:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:49 smithi163 bash[24253]: audit 2024-08-31T09:23:48.580487+0000 mon.a (mon.0) 3370 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:23:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:49 smithi163 bash[24253]: audit 2024-08-31T09:23:48.590983+0000 mon.a (mon.0) 3371 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:23:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:49 smithi163 bash[24253]: audit 2024-08-31T09:23:48.595832+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:23:49.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:49 smithi163 bash[24253]: audit 2024-08-31T09:23:48.597172+0000 mgr.a (mgr.14388) 18702 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:23:49.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:23:49 smithi027 bash[22863]: debug 2024-08-31T09:23:49.338+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:23:49.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:23:49 smithi027 bash[22863]: debug 2024-08-31T09:23:49.338+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:23:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:49 smithi027 bash[22610]: audit 2024-08-31T09:23:48.578802+0000 mon.a (mon.0) 3369 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:23:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:49 smithi027 bash[22610]: audit 2024-08-31T09:23:48.580487+0000 mon.a (mon.0) 3370 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:23:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:49 smithi027 bash[22610]: audit 2024-08-31T09:23:48.590983+0000 mon.a (mon.0) 3371 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:23:49.734 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:49 smithi027 bash[22610]: audit 2024-08-31T09:23:48.595832+0000 mon.a (mon.0) 3372 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:23:49.735 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:49 smithi027 bash[22610]: audit 2024-08-31T09:23:48.597172+0000 mgr.a (mgr.14388) 18702 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:23:50.837 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:23:50.838 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:23:50.838 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:23:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:50 smithi163 bash[24253]: cluster 2024-08-31T09:23:49.157004+0000 mgr.a (mgr.14388) 18703 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:50 smithi163 bash[24253]: audit 2024-08-31T09:23:49.339535+0000 mgr.a (mgr.14388) 18704 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:23:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:50 smithi163 bash[24253]: cephadm 2024-08-31T09:23:49.340796+0000 mgr.a (mgr.14388) 18705 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:23:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:50 smithi027 bash[22610]: cluster 2024-08-31T09:23:49.157004+0000 mgr.a (mgr.14388) 18703 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:50 smithi027 bash[22610]: audit 2024-08-31T09:23:49.339535+0000 mgr.a (mgr.14388) 18704 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:23:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:50 smithi027 bash[22610]: cephadm 2024-08-31T09:23:49.340796+0000 mgr.a (mgr.14388) 18705 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:23:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:50 smithi191 bash[24992]: cluster 2024-08-31T09:23:49.157004+0000 mgr.a (mgr.14388) 18703 : cluster [DBG] pgmap v12967: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:23:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:50 smithi191 bash[24992]: audit 2024-08-31T09:23:49.339535+0000 mgr.a (mgr.14388) 18704 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:23:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:50 smithi191 bash[24992]: cephadm 2024-08-31T09:23:49.340796+0000 mgr.a (mgr.14388) 18705 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:23:51.621 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:23:51.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:23:51.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:23:51.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:23:51.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:52 smithi163 bash[24253]: cluster 2024-08-31T09:23:51.157710+0000 mgr.a (mgr.14388) 18706 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:52 smithi163 bash[24253]: audit 2024-08-31T09:23:51.178068+0000 mgr.a (mgr.14388) 18707 : audit [DBG] from='client.402111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:52 smithi027 bash[22610]: cluster 2024-08-31T09:23:51.157710+0000 mgr.a (mgr.14388) 18706 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:52 smithi027 bash[22610]: audit 2024-08-31T09:23:51.178068+0000 mgr.a (mgr.14388) 18707 : audit [DBG] from='client.402111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:52 smithi191 bash[24992]: cluster 2024-08-31T09:23:51.157710+0000 mgr.a (mgr.14388) 18706 : cluster [DBG] pgmap v12968: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:23:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:52 smithi191 bash[24992]: audit 2024-08-31T09:23:51.178068+0000 mgr.a (mgr.14388) 18707 : audit [DBG] from='client.402111 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:54 smithi163 bash[24253]: cluster 2024-08-31T09:23:53.160020+0000 mgr.a (mgr.14388) 18708 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:23:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:54 smithi027 bash[22610]: cluster 2024-08-31T09:23:53.160020+0000 mgr.a (mgr.14388) 18708 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:23:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:54 smithi191 bash[24992]: cluster 2024-08-31T09:23:53.160020+0000 mgr.a (mgr.14388) 18708 : cluster [DBG] pgmap v12969: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:23:56.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:23:56.624 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:23:56.624 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:23:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:56 smithi163 bash[24253]: cluster 2024-08-31T09:23:55.160804+0000 mgr.a (mgr.14388) 18709 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:23:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:56 smithi027 bash[22610]: cluster 2024-08-31T09:23:55.160804+0000 mgr.a (mgr.14388) 18709 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:23:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:56 smithi191 bash[24992]: cluster 2024-08-31T09:23:55.160804+0000 mgr.a (mgr.14388) 18709 : cluster [DBG] pgmap v12970: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:23:57.396 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:23:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:23:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:23:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:23:57.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:23:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:58 smithi163 bash[24253]: audit 2024-08-31T09:23:56.965325+0000 mgr.a (mgr.14388) 18710 : audit [DBG] from='client.402186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:23:58 smithi163 bash[24253]: cluster 2024-08-31T09:23:57.161513+0000 mgr.a (mgr.14388) 18711 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:23:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:58 smithi027 bash[22610]: audit 2024-08-31T09:23:56.965325+0000 mgr.a (mgr.14388) 18710 : audit [DBG] from='client.402186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:23:58 smithi027 bash[22610]: cluster 2024-08-31T09:23:57.161513+0000 mgr.a (mgr.14388) 18711 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:23:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:58 smithi191 bash[24992]: audit 2024-08-31T09:23:56.965325+0000 mgr.a (mgr.14388) 18710 : audit [DBG] from='client.402186 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:23:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:23:58 smithi191 bash[24992]: cluster 2024-08-31T09:23:57.161513+0000 mgr.a (mgr.14388) 18711 : cluster [DBG] pgmap v12971: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:00 smithi163 bash[24253]: cluster 2024-08-31T09:23:59.163818+0000 mgr.a (mgr.14388) 18712 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:00 smithi027 bash[22610]: cluster 2024-08-31T09:23:59.163818+0000 mgr.a (mgr.14388) 18712 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:00 smithi191 bash[24992]: cluster 2024-08-31T09:23:59.163818+0000 mgr.a (mgr.14388) 18712 : cluster [DBG] pgmap v12972: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:02.397 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:24:02.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:24:02.398 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:24:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:02 smithi163 bash[24253]: cluster 2024-08-31T09:24:01.164603+0000 mgr.a (mgr.14388) 18713 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:02 smithi027 bash[22610]: cluster 2024-08-31T09:24:01.164603+0000 mgr.a (mgr.14388) 18713 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:02 smithi191 bash[24992]: cluster 2024-08-31T09:24:01.164603+0000 mgr.a (mgr.14388) 18713 : cluster [DBG] pgmap v12973: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:03.159 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:24:03.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:24:03.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:24:03.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:24:03.160 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:24:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:03 smithi163 bash[24253]: audit 2024-08-31T09:24:02.730647+0000 mgr.a (mgr.14388) 18714 : audit [DBG] from='client.402264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:03 smithi027 bash[22610]: audit 2024-08-31T09:24:02.730647+0000 mgr.a (mgr.14388) 18714 : audit [DBG] from='client.402264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:04.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:03 smithi191 bash[24992]: audit 2024-08-31T09:24:02.730647+0000 mgr.a (mgr.14388) 18714 : audit [DBG] from='client.402264 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:04 smithi163 bash[24253]: cluster 2024-08-31T09:24:03.166127+0000 mgr.a (mgr.14388) 18715 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:04 smithi027 bash[22610]: cluster 2024-08-31T09:24:03.166127+0000 mgr.a (mgr.14388) 18715 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:04 smithi191 bash[24992]: cluster 2024-08-31T09:24:03.166127+0000 mgr.a (mgr.14388) 18715 : cluster [DBG] pgmap v12974: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:06 smithi163 bash[24253]: cluster 2024-08-31T09:24:05.166904+0000 mgr.a (mgr.14388) 18716 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:24:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:06 smithi027 bash[22610]: cluster 2024-08-31T09:24:05.166904+0000 mgr.a (mgr.14388) 18716 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:24:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:06 smithi191 bash[24992]: cluster 2024-08-31T09:24:05.166904+0000 mgr.a (mgr.14388) 18716 : cluster [DBG] pgmap v12975: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:24:08.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:24:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:24:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:24:08.940 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:24:08.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:24:08.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:24:08.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:24:08.940 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:24:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:08 smithi163 bash[24253]: cluster 2024-08-31T09:24:07.167647+0000 mgr.a (mgr.14388) 18717 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:24:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:08 smithi027 bash[22610]: cluster 2024-08-31T09:24:07.167647+0000 mgr.a (mgr.14388) 18717 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:24:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:08 smithi191 bash[24992]: cluster 2024-08-31T09:24:07.167647+0000 mgr.a (mgr.14388) 18717 : cluster [DBG] pgmap v12976: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:24:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:09 smithi163 bash[24253]: audit 2024-08-31T09:24:08.495400+0000 mgr.a (mgr.14388) 18718 : audit [DBG] from='client.402339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:09 smithi027 bash[22610]: audit 2024-08-31T09:24:08.495400+0000 mgr.a (mgr.14388) 18718 : audit [DBG] from='client.402339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:10.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:09 smithi191 bash[24992]: audit 2024-08-31T09:24:08.495400+0000 mgr.a (mgr.14388) 18718 : audit [DBG] from='client.402339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:10 smithi163 bash[24253]: cluster 2024-08-31T09:24:09.170367+0000 mgr.a (mgr.14388) 18719 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:10 smithi027 bash[22610]: cluster 2024-08-31T09:24:09.170367+0000 mgr.a (mgr.14388) 18719 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:10 smithi191 bash[24992]: cluster 2024-08-31T09:24:09.170367+0000 mgr.a (mgr.14388) 18719 : cluster [DBG] pgmap v12977: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:12 smithi163 bash[24253]: cluster 2024-08-31T09:24:11.171206+0000 mgr.a (mgr.14388) 18720 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:24:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:12 smithi027 bash[22610]: cluster 2024-08-31T09:24:11.171206+0000 mgr.a (mgr.14388) 18720 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:24:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:12 smithi191 bash[24992]: cluster 2024-08-31T09:24:11.171206+0000 mgr.a (mgr.14388) 18720 : cluster [DBG] pgmap v12978: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:24:13.941 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:24:13.942 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:24:13.942 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:24:14.697 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:24:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:24:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:24:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:24:14.697 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:24:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:14 smithi163 bash[24253]: cluster 2024-08-31T09:24:13.173142+0000 mgr.a (mgr.14388) 18721 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:14 smithi027 bash[22610]: cluster 2024-08-31T09:24:13.173142+0000 mgr.a (mgr.14388) 18721 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:14 smithi191 bash[24992]: cluster 2024-08-31T09:24:13.173142+0000 mgr.a (mgr.14388) 18721 : cluster [DBG] pgmap v12979: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:15 smithi163 bash[24253]: audit 2024-08-31T09:24:14.273510+0000 mgr.a (mgr.14388) 18722 : audit [DBG] from='client.402414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:15 smithi027 bash[22610]: audit 2024-08-31T09:24:14.273510+0000 mgr.a (mgr.14388) 18722 : audit [DBG] from='client.402414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:15 smithi191 bash[24992]: audit 2024-08-31T09:24:14.273510+0000 mgr.a (mgr.14388) 18722 : audit [DBG] from='client.402414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:16 smithi163 bash[24253]: cluster 2024-08-31T09:24:15.174118+0000 mgr.a (mgr.14388) 18723 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:24:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:16 smithi027 bash[22610]: cluster 2024-08-31T09:24:15.174118+0000 mgr.a (mgr.14388) 18723 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:24:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:16 smithi191 bash[24992]: cluster 2024-08-31T09:24:15.174118+0000 mgr.a (mgr.14388) 18723 : cluster [DBG] pgmap v12980: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:24:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:18 smithi163 bash[24253]: cluster 2024-08-31T09:24:17.174969+0000 mgr.a (mgr.14388) 18724 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:24:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:18 smithi027 bash[22610]: cluster 2024-08-31T09:24:17.174969+0000 mgr.a (mgr.14388) 18724 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:24:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:18 smithi191 bash[24992]: cluster 2024-08-31T09:24:17.174969+0000 mgr.a (mgr.14388) 18724 : cluster [DBG] pgmap v12981: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:24:19.698 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:24:19.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:24:19.699 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:24:20.483 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:24:20.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:24:20.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:24:20.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:24:20.483 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:24:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:20 smithi163 bash[24253]: cluster 2024-08-31T09:24:19.177216+0000 mgr.a (mgr.14388) 18725 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:24:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:20 smithi027 bash[22610]: cluster 2024-08-31T09:24:19.177216+0000 mgr.a (mgr.14388) 18725 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:24:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:20 smithi191 bash[24992]: cluster 2024-08-31T09:24:19.177216+0000 mgr.a (mgr.14388) 18725 : cluster [DBG] pgmap v12982: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:24:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:21 smithi163 bash[24253]: audit 2024-08-31T09:24:20.037193+0000 mgr.a (mgr.14388) 18726 : audit [DBG] from='client.402492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:21 smithi027 bash[22610]: audit 2024-08-31T09:24:20.037193+0000 mgr.a (mgr.14388) 18726 : audit [DBG] from='client.402492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:21 smithi191 bash[24992]: audit 2024-08-31T09:24:20.037193+0000 mgr.a (mgr.14388) 18726 : audit [DBG] from='client.402492 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:22 smithi163 bash[24253]: cluster 2024-08-31T09:24:21.178189+0000 mgr.a (mgr.14388) 18727 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:22 smithi027 bash[22610]: cluster 2024-08-31T09:24:21.178189+0000 mgr.a (mgr.14388) 18727 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:22 smithi191 bash[24992]: cluster 2024-08-31T09:24:21.178189+0000 mgr.a (mgr.14388) 18727 : cluster [DBG] pgmap v12983: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:24 smithi163 bash[24253]: cluster 2024-08-31T09:24:23.180367+0000 mgr.a (mgr.14388) 18728 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:24 smithi027 bash[22610]: cluster 2024-08-31T09:24:23.180367+0000 mgr.a (mgr.14388) 18728 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:24 smithi191 bash[24992]: cluster 2024-08-31T09:24:23.180367+0000 mgr.a (mgr.14388) 18728 : cluster [DBG] pgmap v12984: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:25.484 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:24:25.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:24:25.485 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:24:26.254 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:24:26.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:24:26.254 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:24:26.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:24:26.255 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:24:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:26 smithi163 bash[24253]: cluster 2024-08-31T09:24:25.181178+0000 mgr.a (mgr.14388) 18729 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:26 smithi027 bash[22610]: cluster 2024-08-31T09:24:25.181178+0000 mgr.a (mgr.14388) 18729 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:26 smithi191 bash[24992]: cluster 2024-08-31T09:24:25.181178+0000 mgr.a (mgr.14388) 18729 : cluster [DBG] pgmap v12985: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:27 smithi027 bash[22610]: audit 2024-08-31T09:24:25.817261+0000 mgr.a (mgr.14388) 18730 : audit [DBG] from='client.402567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:28.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:27 smithi191 bash[24992]: audit 2024-08-31T09:24:25.817261+0000 mgr.a (mgr.14388) 18730 : audit [DBG] from='client.402567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:28.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:27 smithi163 bash[24253]: audit 2024-08-31T09:24:25.817261+0000 mgr.a (mgr.14388) 18730 : audit [DBG] from='client.402567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:28 smithi027 bash[22610]: cluster 2024-08-31T09:24:27.182083+0000 mgr.a (mgr.14388) 18731 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:28 smithi191 bash[24992]: cluster 2024-08-31T09:24:27.182083+0000 mgr.a (mgr.14388) 18731 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:28 smithi163 bash[24253]: cluster 2024-08-31T09:24:27.182083+0000 mgr.a (mgr.14388) 18731 : cluster [DBG] pgmap v12986: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:30 smithi027 bash[22610]: cluster 2024-08-31T09:24:29.184367+0000 mgr.a (mgr.14388) 18732 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:30 smithi191 bash[24992]: cluster 2024-08-31T09:24:29.184367+0000 mgr.a (mgr.14388) 18732 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:30 smithi163 bash[24253]: cluster 2024-08-31T09:24:29.184367+0000 mgr.a (mgr.14388) 18732 : cluster [DBG] pgmap v12987: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:31.256 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:24:31.256 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:24:31.257 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:24:32.004 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:24:32.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:24:32.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:24:32.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:24:32.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:24:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:32 smithi027 bash[22610]: cluster 2024-08-31T09:24:31.185185+0000 mgr.a (mgr.14388) 18733 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:32 smithi027 bash[22610]: audit 2024-08-31T09:24:31.585007+0000 mgr.a (mgr.14388) 18734 : audit [DBG] from='client.402645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:32 smithi191 bash[24992]: cluster 2024-08-31T09:24:31.185185+0000 mgr.a (mgr.14388) 18733 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:33.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:32 smithi191 bash[24992]: audit 2024-08-31T09:24:31.585007+0000 mgr.a (mgr.14388) 18734 : audit [DBG] from='client.402645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:32 smithi163 bash[24253]: cluster 2024-08-31T09:24:31.185185+0000 mgr.a (mgr.14388) 18733 : cluster [DBG] pgmap v12988: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:32 smithi163 bash[24253]: audit 2024-08-31T09:24:31.585007+0000 mgr.a (mgr.14388) 18734 : audit [DBG] from='client.402645 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:34 smithi027 bash[22610]: cluster 2024-08-31T09:24:33.187517+0000 mgr.a (mgr.14388) 18735 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:34 smithi191 bash[24992]: cluster 2024-08-31T09:24:33.187517+0000 mgr.a (mgr.14388) 18735 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:34 smithi163 bash[24253]: cluster 2024-08-31T09:24:33.187517+0000 mgr.a (mgr.14388) 18735 : cluster [DBG] pgmap v12989: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:36 smithi027 bash[22610]: cluster 2024-08-31T09:24:35.188299+0000 mgr.a (mgr.14388) 18736 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:37.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:24:37.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:24:37.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:24:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:36 smithi191 bash[24992]: cluster 2024-08-31T09:24:35.188299+0000 mgr.a (mgr.14388) 18736 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:36 smithi163 bash[24253]: cluster 2024-08-31T09:24:35.188299+0000 mgr.a (mgr.14388) 18736 : cluster [DBG] pgmap v12990: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:37.755 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:24:37.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:24:37.755 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:24:37.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:24:37.756 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:24:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:38 smithi191 bash[24992]: cluster 2024-08-31T09:24:37.188980+0000 mgr.a (mgr.14388) 18737 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:38 smithi191 bash[24992]: audit 2024-08-31T09:24:37.338666+0000 mgr.a (mgr.14388) 18738 : audit [DBG] from='client.402720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:38 smithi163 bash[24253]: cluster 2024-08-31T09:24:37.188980+0000 mgr.a (mgr.14388) 18737 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:38 smithi163 bash[24253]: audit 2024-08-31T09:24:37.338666+0000 mgr.a (mgr.14388) 18738 : audit [DBG] from='client.402720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:38 smithi027 bash[22610]: cluster 2024-08-31T09:24:37.188980+0000 mgr.a (mgr.14388) 18737 : cluster [DBG] pgmap v12991: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:38 smithi027 bash[22610]: audit 2024-08-31T09:24:37.338666+0000 mgr.a (mgr.14388) 18738 : audit [DBG] from='client.402720 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:40 smithi191 bash[24992]: cluster 2024-08-31T09:24:39.191381+0000 mgr.a (mgr.14388) 18739 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:40 smithi163 bash[24253]: cluster 2024-08-31T09:24:39.191381+0000 mgr.a (mgr.14388) 18739 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:40 smithi027 bash[22610]: cluster 2024-08-31T09:24:39.191381+0000 mgr.a (mgr.14388) 18739 : cluster [DBG] pgmap v12992: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:24:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:24:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:24:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:24:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:42 smithi191 bash[24992]: cluster 2024-08-31T09:24:41.192188+0000 mgr.a (mgr.14388) 18740 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:42 smithi163 bash[24253]: cluster 2024-08-31T09:24:41.192188+0000 mgr.a (mgr.14388) 18740 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:42 smithi027 bash[22610]: cluster 2024-08-31T09:24:41.192188+0000 mgr.a (mgr.14388) 18740 : cluster [DBG] pgmap v12993: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:43.534 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:24:43.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:24:43.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:24:43.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:24:43.535 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:24:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:44 smithi191 bash[24992]: audit 2024-08-31T09:24:43.092331+0000 mgr.a (mgr.14388) 18741 : audit [DBG] from='client.402798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:44 smithi191 bash[24992]: cluster 2024-08-31T09:24:43.193496+0000 mgr.a (mgr.14388) 18742 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:44 smithi163 bash[24253]: audit 2024-08-31T09:24:43.092331+0000 mgr.a (mgr.14388) 18741 : audit [DBG] from='client.402798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:45.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:44 smithi163 bash[24253]: cluster 2024-08-31T09:24:43.193496+0000 mgr.a (mgr.14388) 18742 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:44 smithi027 bash[22610]: audit 2024-08-31T09:24:43.092331+0000 mgr.a (mgr.14388) 18741 : audit [DBG] from='client.402798 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:44 smithi027 bash[22610]: cluster 2024-08-31T09:24:43.193496+0000 mgr.a (mgr.14388) 18742 : cluster [DBG] pgmap v12994: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:46 smithi191 bash[24992]: cluster 2024-08-31T09:24:45.194370+0000 mgr.a (mgr.14388) 18743 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:24:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:46 smithi163 bash[24253]: cluster 2024-08-31T09:24:45.194370+0000 mgr.a (mgr.14388) 18743 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:24:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:46 smithi027 bash[22610]: cluster 2024-08-31T09:24:45.194370+0000 mgr.a (mgr.14388) 18743 : cluster [DBG] pgmap v12995: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:24:48.536 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:24:48.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:24:48.537 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:24:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:48 smithi191 bash[24992]: cluster 2024-08-31T09:24:47.195178+0000 mgr.a (mgr.14388) 18744 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:24:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:48 smithi163 bash[24253]: cluster 2024-08-31T09:24:47.195178+0000 mgr.a (mgr.14388) 18744 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:24:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:48 smithi027 bash[22610]: cluster 2024-08-31T09:24:47.195178+0000 mgr.a (mgr.14388) 18744 : cluster [DBG] pgmap v12996: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:24:49.327 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:24:49.327 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:24:49.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:24:49.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:24:49.328 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:24:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:49 smithi191 bash[24992]: audit 2024-08-31T09:24:49.391884+0000 mon.a (mon.0) 3373 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:24:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:49 smithi163 bash[24253]: audit 2024-08-31T09:24:49.391884+0000 mon.a (mon.0) 3373 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:24:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:49 smithi027 bash[22610]: audit 2024-08-31T09:24:49.391884+0000 mon.a (mon.0) 3373 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:24:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:50 smithi191 bash[24992]: audit 2024-08-31T09:24:48.875016+0000 mgr.a (mgr.14388) 18745 : audit [DBG] from='client.402876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:50 smithi191 bash[24992]: cluster 2024-08-31T09:24:49.196586+0000 mgr.a (mgr.14388) 18746 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:50 smithi191 bash[24992]: audit 2024-08-31T09:24:50.154198+0000 mon.a (mon.0) 3374 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:24:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:50 smithi191 bash[24992]: audit 2024-08-31T09:24:50.155649+0000 mon.a (mon.0) 3375 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:24:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:50 smithi191 bash[24992]: audit 2024-08-31T09:24:50.164815+0000 mon.a (mon.0) 3376 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:24:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:50 smithi191 bash[24992]: audit 2024-08-31T09:24:50.168032+0000 mon.a (mon.0) 3377 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:24:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:50 smithi163 bash[24253]: audit 2024-08-31T09:24:48.875016+0000 mgr.a (mgr.14388) 18745 : audit [DBG] from='client.402876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:50 smithi163 bash[24253]: cluster 2024-08-31T09:24:49.196586+0000 mgr.a (mgr.14388) 18746 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:50 smithi163 bash[24253]: audit 2024-08-31T09:24:50.154198+0000 mon.a (mon.0) 3374 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:24:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:50 smithi163 bash[24253]: audit 2024-08-31T09:24:50.155649+0000 mon.a (mon.0) 3375 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:24:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:50 smithi163 bash[24253]: audit 2024-08-31T09:24:50.164815+0000 mon.a (mon.0) 3376 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:24:51.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:50 smithi163 bash[24253]: audit 2024-08-31T09:24:50.168032+0000 mon.a (mon.0) 3377 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:24:51.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:24:50 smithi027 bash[22863]: debug 2024-08-31T09:24:50.912+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:24:51.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:24:50 smithi027 bash[22863]: debug 2024-08-31T09:24:50.912+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:24:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:50 smithi027 bash[22610]: audit 2024-08-31T09:24:48.875016+0000 mgr.a (mgr.14388) 18745 : audit [DBG] from='client.402876 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:50 smithi027 bash[22610]: cluster 2024-08-31T09:24:49.196586+0000 mgr.a (mgr.14388) 18746 : cluster [DBG] pgmap v12997: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:24:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:50 smithi027 bash[22610]: audit 2024-08-31T09:24:50.154198+0000 mon.a (mon.0) 3374 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:24:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:50 smithi027 bash[22610]: audit 2024-08-31T09:24:50.155649+0000 mon.a (mon.0) 3375 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:24:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:50 smithi027 bash[22610]: audit 2024-08-31T09:24:50.164815+0000 mon.a (mon.0) 3376 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:24:51.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:50 smithi027 bash[22610]: audit 2024-08-31T09:24:50.168032+0000 mon.a (mon.0) 3377 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:24:52.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:51 smithi191 bash[24992]: audit 2024-08-31T09:24:50.170468+0000 mgr.a (mgr.14388) 18747 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:24:52.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:51 smithi163 bash[24253]: audit 2024-08-31T09:24:50.170468+0000 mgr.a (mgr.14388) 18747 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:24:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:51 smithi027 bash[22610]: audit 2024-08-31T09:24:50.170468+0000 mgr.a (mgr.14388) 18747 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:24:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:52 smithi191 bash[24992]: audit 2024-08-31T09:24:50.916694+0000 mgr.a (mgr.14388) 18748 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:24:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:52 smithi191 bash[24992]: cephadm 2024-08-31T09:24:50.918358+0000 mgr.a (mgr.14388) 18749 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:24:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:52 smithi191 bash[24992]: cluster 2024-08-31T09:24:51.197480+0000 mgr.a (mgr.14388) 18750 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:24:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:52 smithi163 bash[24253]: audit 2024-08-31T09:24:50.916694+0000 mgr.a (mgr.14388) 18748 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:24:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:52 smithi163 bash[24253]: cephadm 2024-08-31T09:24:50.918358+0000 mgr.a (mgr.14388) 18749 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:24:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:52 smithi163 bash[24253]: cluster 2024-08-31T09:24:51.197480+0000 mgr.a (mgr.14388) 18750 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:24:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:52 smithi027 bash[22610]: audit 2024-08-31T09:24:50.916694+0000 mgr.a (mgr.14388) 18748 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:24:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:52 smithi027 bash[22610]: cephadm 2024-08-31T09:24:50.918358+0000 mgr.a (mgr.14388) 18749 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:24:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:52 smithi027 bash[22610]: cluster 2024-08-31T09:24:51.197480+0000 mgr.a (mgr.14388) 18750 : cluster [DBG] pgmap v12998: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:24:54.329 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:24:54.329 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:24:54.330 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:24:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:54 smithi191 bash[24992]: cluster 2024-08-31T09:24:53.199774+0000 mgr.a (mgr.14388) 18751 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:55.086 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:24:55.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:24:55.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:24:55.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:24:55.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:24:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:54 smithi163 bash[24253]: cluster 2024-08-31T09:24:53.199774+0000 mgr.a (mgr.14388) 18751 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:54 smithi027 bash[22610]: cluster 2024-08-31T09:24:53.199774+0000 mgr.a (mgr.14388) 18751 : cluster [DBG] pgmap v12999: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:56.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:55 smithi191 bash[24992]: audit 2024-08-31T09:24:54.659203+0000 mgr.a (mgr.14388) 18752 : audit [DBG] from='client.403056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:56.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:55 smithi163 bash[24253]: audit 2024-08-31T09:24:54.659203+0000 mgr.a (mgr.14388) 18752 : audit [DBG] from='client.403056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:55 smithi027 bash[22610]: audit 2024-08-31T09:24:54.659203+0000 mgr.a (mgr.14388) 18752 : audit [DBG] from='client.403056 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:24:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:56 smithi163 bash[24253]: cluster 2024-08-31T09:24:55.200735+0000 mgr.a (mgr.14388) 18753 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:56 smithi027 bash[22610]: cluster 2024-08-31T09:24:55.200735+0000 mgr.a (mgr.14388) 18753 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:57.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:56 smithi191 bash[24992]: cluster 2024-08-31T09:24:55.200735+0000 mgr.a (mgr.14388) 18753 : cluster [DBG] pgmap v13000: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:24:58 smithi163 bash[24253]: cluster 2024-08-31T09:24:57.201522+0000 mgr.a (mgr.14388) 18754 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:24:58 smithi027 bash[22610]: cluster 2024-08-31T09:24:57.201522+0000 mgr.a (mgr.14388) 18754 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:24:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:24:58 smithi191 bash[24992]: cluster 2024-08-31T09:24:57.201522+0000 mgr.a (mgr.14388) 18754 : cluster [DBG] pgmap v13001: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:00.087 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:00.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:00.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:00.840 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:00.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:00.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:00.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:00.840 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:00 smithi163 bash[24253]: cluster 2024-08-31T09:24:59.203766+0000 mgr.a (mgr.14388) 18755 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:00 smithi027 bash[22610]: cluster 2024-08-31T09:24:59.203766+0000 mgr.a (mgr.14388) 18755 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:00 smithi191 bash[24992]: cluster 2024-08-31T09:24:59.203766+0000 mgr.a (mgr.14388) 18755 : cluster [DBG] pgmap v13002: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:01 smithi027 bash[22610]: audit 2024-08-31T09:25:00.419775+0000 mgr.a (mgr.14388) 18756 : audit [DBG] from='client.403134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:01 smithi163 bash[24253]: audit 2024-08-31T09:25:00.419775+0000 mgr.a (mgr.14388) 18756 : audit [DBG] from='client.403134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:01 smithi191 bash[24992]: audit 2024-08-31T09:25:00.419775+0000 mgr.a (mgr.14388) 18756 : audit [DBG] from='client.403134 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:02 smithi163 bash[24253]: cluster 2024-08-31T09:25:01.204675+0000 mgr.a (mgr.14388) 18757 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:02 smithi027 bash[22610]: cluster 2024-08-31T09:25:01.204675+0000 mgr.a (mgr.14388) 18757 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:03.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:02 smithi191 bash[24992]: cluster 2024-08-31T09:25:01.204675+0000 mgr.a (mgr.14388) 18757 : cluster [DBG] pgmap v13003: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:04 smithi163 bash[24253]: cluster 2024-08-31T09:25:03.206910+0000 mgr.a (mgr.14388) 18758 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:04 smithi027 bash[22610]: cluster 2024-08-31T09:25:03.206910+0000 mgr.a (mgr.14388) 18758 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:04 smithi191 bash[24992]: cluster 2024-08-31T09:25:03.206910+0000 mgr.a (mgr.14388) 18758 : cluster [DBG] pgmap v13004: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:05.841 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:05.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:05.842 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:06.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:05 smithi163 bash[24253]: cluster 2024-08-31T09:25:05.207628+0000 mgr.a (mgr.14388) 18759 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:06.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:05 smithi027 bash[22610]: cluster 2024-08-31T09:25:05.207628+0000 mgr.a (mgr.14388) 18759 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:05 smithi191 bash[24992]: cluster 2024-08-31T09:25:05.207628+0000 mgr.a (mgr.14388) 18759 : cluster [DBG] pgmap v13005: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:06.581 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:06.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:06.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:06.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:06.582 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:06 smithi163 bash[24253]: audit 2024-08-31T09:25:06.166017+0000 mgr.a (mgr.14388) 18760 : audit [DBG] from='client.403206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:06 smithi027 bash[22610]: audit 2024-08-31T09:25:06.166017+0000 mgr.a (mgr.14388) 18760 : audit [DBG] from='client.403206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:06 smithi191 bash[24992]: audit 2024-08-31T09:25:06.166017+0000 mgr.a (mgr.14388) 18760 : audit [DBG] from='client.403206 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:08.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:07 smithi163 bash[24253]: cluster 2024-08-31T09:25:07.208590+0000 mgr.a (mgr.14388) 18761 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:07 smithi027 bash[22610]: cluster 2024-08-31T09:25:07.208590+0000 mgr.a (mgr.14388) 18761 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:08.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:07 smithi191 bash[24992]: cluster 2024-08-31T09:25:07.208590+0000 mgr.a (mgr.14388) 18761 : cluster [DBG] pgmap v13006: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:10.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:10 smithi191 bash[24992]: cluster 2024-08-31T09:25:09.210822+0000 mgr.a (mgr.14388) 18762 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:10 smithi163 bash[24253]: cluster 2024-08-31T09:25:09.210822+0000 mgr.a (mgr.14388) 18762 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:10 smithi027 bash[22610]: cluster 2024-08-31T09:25:09.210822+0000 mgr.a (mgr.14388) 18762 : cluster [DBG] pgmap v13007: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:11.583 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:11.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:11.583 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:12.359 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:12.359 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:12.360 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:12 smithi163 bash[24253]: cluster 2024-08-31T09:25:11.211582+0000 mgr.a (mgr.14388) 18763 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:12 smithi027 bash[22610]: cluster 2024-08-31T09:25:11.211582+0000 mgr.a (mgr.14388) 18763 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:12 smithi191 bash[24992]: cluster 2024-08-31T09:25:11.211582+0000 mgr.a (mgr.14388) 18763 : cluster [DBG] pgmap v13008: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:13 smithi163 bash[24253]: audit 2024-08-31T09:25:11.922376+0000 mgr.a (mgr.14388) 18764 : audit [DBG] from='client.403278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:13 smithi027 bash[22610]: audit 2024-08-31T09:25:11.922376+0000 mgr.a (mgr.14388) 18764 : audit [DBG] from='client.403278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:13 smithi191 bash[24992]: audit 2024-08-31T09:25:11.922376+0000 mgr.a (mgr.14388) 18764 : audit [DBG] from='client.403278 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:14 smithi163 bash[24253]: cluster 2024-08-31T09:25:13.213883+0000 mgr.a (mgr.14388) 18765 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:14 smithi027 bash[22610]: cluster 2024-08-31T09:25:13.213883+0000 mgr.a (mgr.14388) 18765 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:14.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:14 smithi191 bash[24992]: cluster 2024-08-31T09:25:13.213883+0000 mgr.a (mgr.14388) 18765 : cluster [DBG] pgmap v13009: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:16 smithi191 bash[24992]: cluster 2024-08-31T09:25:15.214650+0000 mgr.a (mgr.14388) 18766 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:16 smithi163 bash[24253]: cluster 2024-08-31T09:25:15.214650+0000 mgr.a (mgr.14388) 18766 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:16 smithi027 bash[22610]: cluster 2024-08-31T09:25:15.214650+0000 mgr.a (mgr.14388) 18766 : cluster [DBG] pgmap v13010: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:17.361 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:17.362 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:17.362 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:18.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:18.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:18.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:18.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:18.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:18 smithi191 bash[24992]: cluster 2024-08-31T09:25:17.215435+0000 mgr.a (mgr.14388) 18767 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:18 smithi191 bash[24992]: audit 2024-08-31T09:25:17.692382+0000 mgr.a (mgr.14388) 18768 : audit [DBG] from='client.403353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:18 smithi163 bash[24253]: cluster 2024-08-31T09:25:17.215435+0000 mgr.a (mgr.14388) 18767 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:18.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:18 smithi163 bash[24253]: audit 2024-08-31T09:25:17.692382+0000 mgr.a (mgr.14388) 18768 : audit [DBG] from='client.403353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:18 smithi027 bash[22610]: cluster 2024-08-31T09:25:17.215435+0000 mgr.a (mgr.14388) 18767 : cluster [DBG] pgmap v13011: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:18 smithi027 bash[22610]: audit 2024-08-31T09:25:17.692382+0000 mgr.a (mgr.14388) 18768 : audit [DBG] from='client.403353 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:20 smithi191 bash[24992]: cluster 2024-08-31T09:25:19.217789+0000 mgr.a (mgr.14388) 18769 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:25:20.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:20 smithi163 bash[24253]: cluster 2024-08-31T09:25:19.217789+0000 mgr.a (mgr.14388) 18769 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:25:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:20 smithi027 bash[22610]: cluster 2024-08-31T09:25:19.217789+0000 mgr.a (mgr.14388) 18769 : cluster [DBG] pgmap v13012: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:25:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:22 smithi191 bash[24992]: cluster 2024-08-31T09:25:21.218605+0000 mgr.a (mgr.14388) 18770 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:25:22.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:22 smithi163 bash[24253]: cluster 2024-08-31T09:25:21.218605+0000 mgr.a (mgr.14388) 18770 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:25:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:22 smithi027 bash[22610]: cluster 2024-08-31T09:25:21.218605+0000 mgr.a (mgr.14388) 18770 : cluster [DBG] pgmap v13013: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:25:23.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:23.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:23.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:23.872 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:24.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:24 smithi163 bash[24253]: cluster 2024-08-31T09:25:23.219620+0000 mgr.a (mgr.14388) 18771 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:24.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:24 smithi163 bash[24253]: audit 2024-08-31T09:25:23.439858+0000 mgr.a (mgr.14388) 18772 : audit [DBG] from='client.403431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:24 smithi027 bash[22610]: cluster 2024-08-31T09:25:23.219620+0000 mgr.a (mgr.14388) 18771 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:24 smithi027 bash[22610]: audit 2024-08-31T09:25:23.439858+0000 mgr.a (mgr.14388) 18772 : audit [DBG] from='client.403431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:24 smithi191 bash[24992]: cluster 2024-08-31T09:25:23.219620+0000 mgr.a (mgr.14388) 18771 : cluster [DBG] pgmap v13014: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:24 smithi191 bash[24992]: audit 2024-08-31T09:25:23.439858+0000 mgr.a (mgr.14388) 18772 : audit [DBG] from='client.403431 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:26.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:26 smithi163 bash[24253]: cluster 2024-08-31T09:25:25.220619+0000 mgr.a (mgr.14388) 18773 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:25:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:26 smithi027 bash[22610]: cluster 2024-08-31T09:25:25.220619+0000 mgr.a (mgr.14388) 18773 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:25:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:26 smithi191 bash[24992]: cluster 2024-08-31T09:25:25.220619+0000 mgr.a (mgr.14388) 18773 : cluster [DBG] pgmap v13015: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:25:28.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:28 smithi163 bash[24253]: cluster 2024-08-31T09:25:27.221606+0000 mgr.a (mgr.14388) 18774 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:25:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:28 smithi027 bash[22610]: cluster 2024-08-31T09:25:27.221606+0000 mgr.a (mgr.14388) 18774 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:25:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:28 smithi191 bash[24992]: cluster 2024-08-31T09:25:27.221606+0000 mgr.a (mgr.14388) 18774 : cluster [DBG] pgmap v13016: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:25:28.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:28.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:28.874 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:29.623 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:30 smithi163 bash[24253]: audit 2024-08-31T09:25:29.203748+0000 mgr.a (mgr.14388) 18775 : audit [DBG] from='client.403509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:30.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:30 smithi163 bash[24253]: cluster 2024-08-31T09:25:29.223739+0000 mgr.a (mgr.14388) 18776 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:30 smithi027 bash[22610]: audit 2024-08-31T09:25:29.203748+0000 mgr.a (mgr.14388) 18775 : audit [DBG] from='client.403509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:30 smithi027 bash[22610]: cluster 2024-08-31T09:25:29.223739+0000 mgr.a (mgr.14388) 18776 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:30 smithi191 bash[24992]: audit 2024-08-31T09:25:29.203748+0000 mgr.a (mgr.14388) 18775 : audit [DBG] from='client.403509 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:30 smithi191 bash[24992]: cluster 2024-08-31T09:25:29.223739+0000 mgr.a (mgr.14388) 18776 : cluster [DBG] pgmap v13017: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:32.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:32 smithi163 bash[24253]: cluster 2024-08-31T09:25:31.224573+0000 mgr.a (mgr.14388) 18777 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:25:32.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:32 smithi027 bash[22610]: cluster 2024-08-31T09:25:31.224573+0000 mgr.a (mgr.14388) 18777 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:25:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:32 smithi191 bash[24992]: cluster 2024-08-31T09:25:31.224573+0000 mgr.a (mgr.14388) 18777 : cluster [DBG] pgmap v13018: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:25:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:34.625 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:34.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:34 smithi163 bash[24253]: cluster 2024-08-31T09:25:33.226751+0000 mgr.a (mgr.14388) 18778 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:25:34.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:34 smithi027 bash[22610]: cluster 2024-08-31T09:25:33.226751+0000 mgr.a (mgr.14388) 18778 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:25:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:34 smithi191 bash[24992]: cluster 2024-08-31T09:25:33.226751+0000 mgr.a (mgr.14388) 18778 : cluster [DBG] pgmap v13019: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:25:35.403 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:35.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:35.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:35.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:35.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:36 smithi163 bash[24253]: audit 2024-08-31T09:25:34.961091+0000 mgr.a (mgr.14388) 18779 : audit [DBG] from='client.403587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:36.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:36 smithi163 bash[24253]: cluster 2024-08-31T09:25:35.227403+0000 mgr.a (mgr.14388) 18780 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:36 smithi027 bash[22610]: audit 2024-08-31T09:25:34.961091+0000 mgr.a (mgr.14388) 18779 : audit [DBG] from='client.403587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:36.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:36 smithi027 bash[22610]: cluster 2024-08-31T09:25:35.227403+0000 mgr.a (mgr.14388) 18780 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:36 smithi191 bash[24992]: audit 2024-08-31T09:25:34.961091+0000 mgr.a (mgr.14388) 18779 : audit [DBG] from='client.403587 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:36 smithi191 bash[24992]: cluster 2024-08-31T09:25:35.227403+0000 mgr.a (mgr.14388) 18780 : cluster [DBG] pgmap v13020: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:38 smithi163 bash[24253]: cluster 2024-08-31T09:25:37.228293+0000 mgr.a (mgr.14388) 18781 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:38 smithi027 bash[22610]: cluster 2024-08-31T09:25:37.228293+0000 mgr.a (mgr.14388) 18781 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:38 smithi191 bash[24992]: cluster 2024-08-31T09:25:37.228293+0000 mgr.a (mgr.14388) 18781 : cluster [DBG] pgmap v13021: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:40.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:40.405 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:40.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:40 smithi163 bash[24253]: cluster 2024-08-31T09:25:39.230522+0000 mgr.a (mgr.14388) 18782 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:40 smithi027 bash[22610]: cluster 2024-08-31T09:25:39.230522+0000 mgr.a (mgr.14388) 18782 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:40 smithi191 bash[24992]: cluster 2024-08-31T09:25:39.230522+0000 mgr.a (mgr.14388) 18782 : cluster [DBG] pgmap v13022: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:41.149 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:41.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:41.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:41.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:41.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:41 smithi163 bash[24253]: audit 2024-08-31T09:25:40.728869+0000 mgr.a (mgr.14388) 18783 : audit [DBG] from='client.403665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:41 smithi027 bash[22610]: audit 2024-08-31T09:25:40.728869+0000 mgr.a (mgr.14388) 18783 : audit [DBG] from='client.403665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:41 smithi191 bash[24992]: audit 2024-08-31T09:25:40.728869+0000 mgr.a (mgr.14388) 18783 : audit [DBG] from='client.403665 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:42 smithi163 bash[24253]: cluster 2024-08-31T09:25:41.231104+0000 mgr.a (mgr.14388) 18784 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:42 smithi027 bash[22610]: cluster 2024-08-31T09:25:41.231104+0000 mgr.a (mgr.14388) 18784 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:42.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:42 smithi191 bash[24992]: cluster 2024-08-31T09:25:41.231104+0000 mgr.a (mgr.14388) 18784 : cluster [DBG] pgmap v13023: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:44 smithi163 bash[24253]: cluster 2024-08-31T09:25:43.233105+0000 mgr.a (mgr.14388) 18785 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:44 smithi027 bash[22610]: cluster 2024-08-31T09:25:43.233105+0000 mgr.a (mgr.14388) 18785 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:44 smithi191 bash[24992]: cluster 2024-08-31T09:25:43.233105+0000 mgr.a (mgr.14388) 18785 : cluster [DBG] pgmap v13024: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:46.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:46.152 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:46.152 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:46 smithi163 bash[24253]: cluster 2024-08-31T09:25:45.233881+0000 mgr.a (mgr.14388) 18786 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:46.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:46 smithi027 bash[22610]: cluster 2024-08-31T09:25:45.233881+0000 mgr.a (mgr.14388) 18786 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:46 smithi191 bash[24992]: cluster 2024-08-31T09:25:45.233881+0000 mgr.a (mgr.14388) 18786 : cluster [DBG] pgmap v13025: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:46.930 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:46.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:46.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:46.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:46.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:47 smithi163 bash[24253]: audit 2024-08-31T09:25:46.489320+0000 mgr.a (mgr.14388) 18787 : audit [DBG] from='client.403743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:47.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:47 smithi027 bash[22610]: audit 2024-08-31T09:25:46.489320+0000 mgr.a (mgr.14388) 18787 : audit [DBG] from='client.403743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:47.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:47 smithi191 bash[24992]: audit 2024-08-31T09:25:46.489320+0000 mgr.a (mgr.14388) 18787 : audit [DBG] from='client.403743 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:48 smithi163 bash[24253]: cluster 2024-08-31T09:25:47.234859+0000 mgr.a (mgr.14388) 18788 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:48 smithi027 bash[22610]: cluster 2024-08-31T09:25:47.234859+0000 mgr.a (mgr.14388) 18788 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:48.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:48 smithi191 bash[24992]: cluster 2024-08-31T09:25:47.234859+0000 mgr.a (mgr.14388) 18788 : cluster [DBG] pgmap v13026: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:50 smithi163 bash[24253]: cluster 2024-08-31T09:25:49.237157+0000 mgr.a (mgr.14388) 18789 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:50 smithi027 bash[22610]: cluster 2024-08-31T09:25:49.237157+0000 mgr.a (mgr.14388) 18789 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:50.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:50 smithi191 bash[24992]: cluster 2024-08-31T09:25:49.237157+0000 mgr.a (mgr.14388) 18789 : cluster [DBG] pgmap v13027: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:25:51.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:51 smithi163 bash[24253]: audit 2024-08-31T09:25:50.973225+0000 mon.a (mon.0) 3378 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:25:51.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:51 smithi027 bash[22610]: audit 2024-08-31T09:25:50.973225+0000 mon.a (mon.0) 3378 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:25:51.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:51 smithi191 bash[24992]: audit 2024-08-31T09:25:50.973225+0000 mon.a (mon.0) 3378 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:25:51.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:51.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:51.931 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:52 smithi163 bash[24253]: cluster 2024-08-31T09:25:51.237947+0000 mgr.a (mgr.14388) 18790 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:52 smithi163 bash[24253]: audit 2024-08-31T09:25:51.816616+0000 mon.a (mon.0) 3379 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:25:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:52 smithi163 bash[24253]: audit 2024-08-31T09:25:51.818224+0000 mon.a (mon.0) 3380 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:25:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:52 smithi163 bash[24253]: audit 2024-08-31T09:25:51.827304+0000 mon.a (mon.0) 3381 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:25:52.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:52 smithi163 bash[24253]: audit 2024-08-31T09:25:51.832054+0000 mon.a (mon.0) 3382 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:25:52.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:25:52 smithi027 bash[22863]: debug 2024-08-31T09:25:52.599+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:25:52.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:25:52 smithi027 bash[22863]: debug 2024-08-31T09:25:52.611+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:25:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:52 smithi027 bash[22610]: cluster 2024-08-31T09:25:51.237947+0000 mgr.a (mgr.14388) 18790 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:52 smithi027 bash[22610]: audit 2024-08-31T09:25:51.816616+0000 mon.a (mon.0) 3379 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:25:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:52 smithi027 bash[22610]: audit 2024-08-31T09:25:51.818224+0000 mon.a (mon.0) 3380 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:25:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:52 smithi027 bash[22610]: audit 2024-08-31T09:25:51.827304+0000 mon.a (mon.0) 3381 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:25:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:52 smithi027 bash[22610]: audit 2024-08-31T09:25:51.832054+0000 mon.a (mon.0) 3382 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:25:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:52 smithi191 bash[24992]: cluster 2024-08-31T09:25:51.237947+0000 mgr.a (mgr.14388) 18790 : cluster [DBG] pgmap v13028: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:25:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:52 smithi191 bash[24992]: audit 2024-08-31T09:25:51.816616+0000 mon.a (mon.0) 3379 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:25:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:52 smithi191 bash[24992]: audit 2024-08-31T09:25:51.818224+0000 mon.a (mon.0) 3380 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:25:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:52 smithi191 bash[24992]: audit 2024-08-31T09:25:51.827304+0000 mon.a (mon.0) 3381 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:25:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:52 smithi191 bash[24992]: audit 2024-08-31T09:25:51.832054+0000 mon.a (mon.0) 3382 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:25:53.004 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:53.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:53.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:53.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:53.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:53 smithi163 bash[24253]: audit 2024-08-31T09:25:51.834431+0000 mgr.a (mgr.14388) 18791 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:25:53.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:53 smithi163 bash[24253]: audit 2024-08-31T09:25:52.288008+0000 mgr.a (mgr.14388) 18792 : audit [DBG] from='client.403839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:53 smithi163 bash[24253]: audit 2024-08-31T09:25:52.603036+0000 mgr.a (mgr.14388) 18793 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:25:53.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:53 smithi163 bash[24253]: cephadm 2024-08-31T09:25:52.618608+0000 mgr.a (mgr.14388) 18794 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:25:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:53 smithi027 bash[22610]: audit 2024-08-31T09:25:51.834431+0000 mgr.a (mgr.14388) 18791 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:25:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:53 smithi027 bash[22610]: audit 2024-08-31T09:25:52.288008+0000 mgr.a (mgr.14388) 18792 : audit [DBG] from='client.403839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:53 smithi027 bash[22610]: audit 2024-08-31T09:25:52.603036+0000 mgr.a (mgr.14388) 18793 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:25:53.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:53 smithi027 bash[22610]: cephadm 2024-08-31T09:25:52.618608+0000 mgr.a (mgr.14388) 18794 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:25:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:53 smithi191 bash[24992]: audit 2024-08-31T09:25:51.834431+0000 mgr.a (mgr.14388) 18791 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:25:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:53 smithi191 bash[24992]: audit 2024-08-31T09:25:52.288008+0000 mgr.a (mgr.14388) 18792 : audit [DBG] from='client.403839 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:53 smithi191 bash[24992]: audit 2024-08-31T09:25:52.603036+0000 mgr.a (mgr.14388) 18793 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:25:53.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:53 smithi191 bash[24992]: cephadm 2024-08-31T09:25:52.618608+0000 mgr.a (mgr.14388) 18794 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:25:54.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:54 smithi163 bash[24253]: cluster 2024-08-31T09:25:53.240238+0000 mgr.a (mgr.14388) 18795 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:54 smithi027 bash[22610]: cluster 2024-08-31T09:25:53.240238+0000 mgr.a (mgr.14388) 18795 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:54 smithi191 bash[24992]: cluster 2024-08-31T09:25:53.240238+0000 mgr.a (mgr.14388) 18795 : cluster [DBG] pgmap v13029: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:56.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:56 smithi163 bash[24253]: cluster 2024-08-31T09:25:55.241054+0000 mgr.a (mgr.14388) 18796 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:56 smithi027 bash[22610]: cluster 2024-08-31T09:25:55.241054+0000 mgr.a (mgr.14388) 18796 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:56 smithi191 bash[24992]: cluster 2024-08-31T09:25:55.241054+0000 mgr.a (mgr.14388) 18796 : cluster [DBG] pgmap v13030: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:58.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:25:58.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:25:58.006 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:25:58.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:58 smithi163 bash[24253]: cluster 2024-08-31T09:25:57.241836+0000 mgr.a (mgr.14388) 18797 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:58.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:58 smithi027 bash[22610]: cluster 2024-08-31T09:25:57.241836+0000 mgr.a (mgr.14388) 18797 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:58.780 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:25:58.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:25:58.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:25:58.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:25:58.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:25:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:58 smithi191 bash[24992]: cluster 2024-08-31T09:25:57.241836+0000 mgr.a (mgr.14388) 18797 : cluster [DBG] pgmap v13031: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:25:59.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:25:59 smithi163 bash[24253]: audit 2024-08-31T09:25:58.340709+0000 mgr.a (mgr.14388) 18798 : audit [DBG] from='client.404004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:25:59 smithi027 bash[22610]: audit 2024-08-31T09:25:58.340709+0000 mgr.a (mgr.14388) 18798 : audit [DBG] from='client.404004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:25:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:25:59 smithi191 bash[24992]: audit 2024-08-31T09:25:58.340709+0000 mgr.a (mgr.14388) 18798 : audit [DBG] from='client.404004 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:00.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:00 smithi163 bash[24253]: cluster 2024-08-31T09:25:59.244603+0000 mgr.a (mgr.14388) 18799 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:26:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:00 smithi027 bash[22610]: cluster 2024-08-31T09:25:59.244603+0000 mgr.a (mgr.14388) 18799 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:26:00.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:00 smithi191 bash[24992]: cluster 2024-08-31T09:25:59.244603+0000 mgr.a (mgr.14388) 18799 : cluster [DBG] pgmap v13032: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:26:02.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:02 smithi163 bash[24253]: cluster 2024-08-31T09:26:01.245371+0000 mgr.a (mgr.14388) 18800 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:26:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:02 smithi027 bash[22610]: cluster 2024-08-31T09:26:01.245371+0000 mgr.a (mgr.14388) 18800 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:26:02.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:02 smithi191 bash[24992]: cluster 2024-08-31T09:26:01.245371+0000 mgr.a (mgr.14388) 18800 : cluster [DBG] pgmap v13033: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:26:03.782 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:26:03.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:26:03.783 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:26:04.573 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:26:04.573 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:26:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:26:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:26:04.574 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:26:04.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:04 smithi163 bash[24253]: cluster 2024-08-31T09:26:03.247269+0000 mgr.a (mgr.14388) 18801 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:26:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:04 smithi027 bash[22610]: cluster 2024-08-31T09:26:03.247269+0000 mgr.a (mgr.14388) 18801 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:26:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:04 smithi191 bash[24992]: cluster 2024-08-31T09:26:03.247269+0000 mgr.a (mgr.14388) 18801 : cluster [DBG] pgmap v13034: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:26:05.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:05 smithi163 bash[24253]: audit 2024-08-31T09:26:04.118370+0000 mgr.a (mgr.14388) 18802 : audit [DBG] from='client.404076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:05.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:05 smithi027 bash[22610]: audit 2024-08-31T09:26:04.118370+0000 mgr.a (mgr.14388) 18802 : audit [DBG] from='client.404076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:05 smithi191 bash[24992]: audit 2024-08-31T09:26:04.118370+0000 mgr.a (mgr.14388) 18802 : audit [DBG] from='client.404076 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:06.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:06 smithi163 bash[24253]: cluster 2024-08-31T09:26:05.248165+0000 mgr.a (mgr.14388) 18803 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:26:06.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:06 smithi027 bash[22610]: cluster 2024-08-31T09:26:05.248165+0000 mgr.a (mgr.14388) 18803 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:26:06.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:06 smithi191 bash[24992]: cluster 2024-08-31T09:26:05.248165+0000 mgr.a (mgr.14388) 18803 : cluster [DBG] pgmap v13035: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:26:08.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:08 smithi163 bash[24253]: cluster 2024-08-31T09:26:07.248925+0000 mgr.a (mgr.14388) 18804 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:26:08.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:08 smithi027 bash[22610]: cluster 2024-08-31T09:26:07.248925+0000 mgr.a (mgr.14388) 18804 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:26:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:08 smithi191 bash[24992]: cluster 2024-08-31T09:26:07.248925+0000 mgr.a (mgr.14388) 18804 : cluster [DBG] pgmap v13036: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:26:09.575 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:26:09.575 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:26:09.576 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:26:10.319 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:26:10.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:26:10.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:26:10.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:26:10.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:26:10.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:10 smithi163 bash[24253]: cluster 2024-08-31T09:26:09.251168+0000 mgr.a (mgr.14388) 18805 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:10 smithi027 bash[22610]: cluster 2024-08-31T09:26:09.251168+0000 mgr.a (mgr.14388) 18805 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:10 smithi191 bash[24992]: cluster 2024-08-31T09:26:09.251168+0000 mgr.a (mgr.14388) 18805 : cluster [DBG] pgmap v13037: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:11 smithi163 bash[24253]: audit 2024-08-31T09:26:09.905889+0000 mgr.a (mgr.14388) 18806 : audit [DBG] from='client.404154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:11 smithi027 bash[22610]: audit 2024-08-31T09:26:09.905889+0000 mgr.a (mgr.14388) 18806 : audit [DBG] from='client.404154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:11 smithi191 bash[24992]: audit 2024-08-31T09:26:09.905889+0000 mgr.a (mgr.14388) 18806 : audit [DBG] from='client.404154 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:12 smithi163 bash[24253]: cluster 2024-08-31T09:26:11.252044+0000 mgr.a (mgr.14388) 18807 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:12 smithi027 bash[22610]: cluster 2024-08-31T09:26:11.252044+0000 mgr.a (mgr.14388) 18807 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:12 smithi191 bash[24992]: cluster 2024-08-31T09:26:11.252044+0000 mgr.a (mgr.14388) 18807 : cluster [DBG] pgmap v13038: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:14 smithi027 bash[22610]: cluster 2024-08-31T09:26:13.254302+0000 mgr.a (mgr.14388) 18808 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:14 smithi191 bash[24992]: cluster 2024-08-31T09:26:13.254302+0000 mgr.a (mgr.14388) 18808 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:14 smithi163 bash[24253]: cluster 2024-08-31T09:26:13.254302+0000 mgr.a (mgr.14388) 18808 : cluster [DBG] pgmap v13039: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:15.321 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:26:15.322 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:26:15.322 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:26:16.103 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:26:16.103 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:26:16.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:26:16.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:26:16.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:26:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:16 smithi027 bash[22610]: cluster 2024-08-31T09:26:15.255117+0000 mgr.a (mgr.14388) 18809 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:16 smithi027 bash[22610]: audit 2024-08-31T09:26:15.659423+0000 mgr.a (mgr.14388) 18810 : audit [DBG] from='client.404232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:16 smithi191 bash[24992]: cluster 2024-08-31T09:26:15.255117+0000 mgr.a (mgr.14388) 18809 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:16 smithi191 bash[24992]: audit 2024-08-31T09:26:15.659423+0000 mgr.a (mgr.14388) 18810 : audit [DBG] from='client.404232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:16 smithi163 bash[24253]: cluster 2024-08-31T09:26:15.255117+0000 mgr.a (mgr.14388) 18809 : cluster [DBG] pgmap v13040: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:16 smithi163 bash[24253]: audit 2024-08-31T09:26:15.659423+0000 mgr.a (mgr.14388) 18810 : audit [DBG] from='client.404232 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:18 smithi027 bash[22610]: cluster 2024-08-31T09:26:17.256171+0000 mgr.a (mgr.14388) 18811 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:18 smithi191 bash[24992]: cluster 2024-08-31T09:26:17.256171+0000 mgr.a (mgr.14388) 18811 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:18 smithi163 bash[24253]: cluster 2024-08-31T09:26:17.256171+0000 mgr.a (mgr.14388) 18811 : cluster [DBG] pgmap v13041: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:20.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:20 smithi027 bash[22610]: cluster 2024-08-31T09:26:19.258446+0000 mgr.a (mgr.14388) 18812 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:20.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:20 smithi191 bash[24992]: cluster 2024-08-31T09:26:19.258446+0000 mgr.a (mgr.14388) 18812 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:20 smithi163 bash[24253]: cluster 2024-08-31T09:26:19.258446+0000 mgr.a (mgr.14388) 18812 : cluster [DBG] pgmap v13042: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:21.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:26:21.105 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:26:21.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:26:21.884 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:26:21.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:26:21.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:26:21.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:26:21.884 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:26:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:22 smithi027 bash[22610]: cluster 2024-08-31T09:26:21.259031+0000 mgr.a (mgr.14388) 18813 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:22 smithi027 bash[22610]: audit 2024-08-31T09:26:21.441168+0000 mgr.a (mgr.14388) 18814 : audit [DBG] from='client.404310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:22 smithi191 bash[24992]: cluster 2024-08-31T09:26:21.259031+0000 mgr.a (mgr.14388) 18813 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:22 smithi191 bash[24992]: audit 2024-08-31T09:26:21.441168+0000 mgr.a (mgr.14388) 18814 : audit [DBG] from='client.404310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:22 smithi163 bash[24253]: cluster 2024-08-31T09:26:21.259031+0000 mgr.a (mgr.14388) 18813 : cluster [DBG] pgmap v13043: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:22 smithi163 bash[24253]: audit 2024-08-31T09:26:21.441168+0000 mgr.a (mgr.14388) 18814 : audit [DBG] from='client.404310 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:24 smithi027 bash[22610]: cluster 2024-08-31T09:26:23.261235+0000 mgr.a (mgr.14388) 18815 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:24.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:24 smithi191 bash[24992]: cluster 2024-08-31T09:26:23.261235+0000 mgr.a (mgr.14388) 18815 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:24 smithi163 bash[24253]: cluster 2024-08-31T09:26:23.261235+0000 mgr.a (mgr.14388) 18815 : cluster [DBG] pgmap v13044: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:26 smithi027 bash[22610]: cluster 2024-08-31T09:26:25.261992+0000 mgr.a (mgr.14388) 18816 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:26 smithi191 bash[24992]: cluster 2024-08-31T09:26:25.261992+0000 mgr.a (mgr.14388) 18816 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:26.885 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:26:26.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:26:26.886 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:26:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:26 smithi163 bash[24253]: cluster 2024-08-31T09:26:25.261992+0000 mgr.a (mgr.14388) 18816 : cluster [DBG] pgmap v13045: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:27.657 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:26:27.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:26:27.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:26:27.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:26:27.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:26:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:28 smithi027 bash[22610]: audit 2024-08-31T09:26:27.218806+0000 mgr.a (mgr.14388) 18817 : audit [DBG] from='client.404388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:28.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:28 smithi027 bash[22610]: cluster 2024-08-31T09:26:27.262785+0000 mgr.a (mgr.14388) 18818 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:28 smithi191 bash[24992]: audit 2024-08-31T09:26:27.218806+0000 mgr.a (mgr.14388) 18817 : audit [DBG] from='client.404388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:28 smithi191 bash[24992]: cluster 2024-08-31T09:26:27.262785+0000 mgr.a (mgr.14388) 18818 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:28 smithi163 bash[24253]: audit 2024-08-31T09:26:27.218806+0000 mgr.a (mgr.14388) 18817 : audit [DBG] from='client.404388 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:28 smithi163 bash[24253]: cluster 2024-08-31T09:26:27.262785+0000 mgr.a (mgr.14388) 18818 : cluster [DBG] pgmap v13046: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:30.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:30 smithi027 bash[22610]: cluster 2024-08-31T09:26:29.265063+0000 mgr.a (mgr.14388) 18819 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:30.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:30 smithi191 bash[24992]: cluster 2024-08-31T09:26:29.265063+0000 mgr.a (mgr.14388) 18819 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:30 smithi163 bash[24253]: cluster 2024-08-31T09:26:29.265063+0000 mgr.a (mgr.14388) 18819 : cluster [DBG] pgmap v13047: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:32.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:26:32.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:26:32.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:26:32.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:32 smithi191 bash[24992]: cluster 2024-08-31T09:26:31.265812+0000 mgr.a (mgr.14388) 18820 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:32 smithi163 bash[24253]: cluster 2024-08-31T09:26:31.265812+0000 mgr.a (mgr.14388) 18820 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:32 smithi027 bash[22610]: cluster 2024-08-31T09:26:31.265812+0000 mgr.a (mgr.14388) 18820 : cluster [DBG] pgmap v13048: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:33.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:26:33.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:26:33.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:26:33.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:26:33.404 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:26:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:34 smithi191 bash[24992]: audit 2024-08-31T09:26:32.988320+0000 mgr.a (mgr.14388) 18821 : audit [DBG] from='client.404463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:34 smithi191 bash[24992]: cluster 2024-08-31T09:26:33.267328+0000 mgr.a (mgr.14388) 18822 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:34 smithi163 bash[24253]: audit 2024-08-31T09:26:32.988320+0000 mgr.a (mgr.14388) 18821 : audit [DBG] from='client.404463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:34 smithi163 bash[24253]: cluster 2024-08-31T09:26:33.267328+0000 mgr.a (mgr.14388) 18822 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:34 smithi027 bash[22610]: audit 2024-08-31T09:26:32.988320+0000 mgr.a (mgr.14388) 18821 : audit [DBG] from='client.404463 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:34 smithi027 bash[22610]: cluster 2024-08-31T09:26:33.267328+0000 mgr.a (mgr.14388) 18822 : cluster [DBG] pgmap v13049: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:36 smithi191 bash[24992]: cluster 2024-08-31T09:26:35.268174+0000 mgr.a (mgr.14388) 18823 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:26:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:36 smithi163 bash[24253]: cluster 2024-08-31T09:26:35.268174+0000 mgr.a (mgr.14388) 18823 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:26:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:36 smithi027 bash[22610]: cluster 2024-08-31T09:26:35.268174+0000 mgr.a (mgr.14388) 18823 : cluster [DBG] pgmap v13050: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:26:38.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:26:38.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:26:38.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:26:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:38 smithi191 bash[24992]: cluster 2024-08-31T09:26:37.268922+0000 mgr.a (mgr.14388) 18824 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:26:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:38 smithi163 bash[24253]: cluster 2024-08-31T09:26:37.268922+0000 mgr.a (mgr.14388) 18824 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:26:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:38 smithi027 bash[22610]: cluster 2024-08-31T09:26:37.268922+0000 mgr.a (mgr.14388) 18824 : cluster [DBG] pgmap v13051: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:26:39.150 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:26:39.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:26:39.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:26:39.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:26:39.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:26:39.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:39 smithi191 bash[24992]: audit 2024-08-31T09:26:38.738891+0000 mgr.a (mgr.14388) 18825 : audit [DBG] from='client.404538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:39 smithi163 bash[24253]: audit 2024-08-31T09:26:38.738891+0000 mgr.a (mgr.14388) 18825 : audit [DBG] from='client.404538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:39 smithi027 bash[22610]: audit 2024-08-31T09:26:38.738891+0000 mgr.a (mgr.14388) 18825 : audit [DBG] from='client.404538 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:40 smithi191 bash[24992]: cluster 2024-08-31T09:26:39.271606+0000 mgr.a (mgr.14388) 18826 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:40 smithi163 bash[24253]: cluster 2024-08-31T09:26:39.271606+0000 mgr.a (mgr.14388) 18826 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:40 smithi027 bash[22610]: cluster 2024-08-31T09:26:39.271606+0000 mgr.a (mgr.14388) 18826 : cluster [DBG] pgmap v13052: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:42 smithi191 bash[24992]: cluster 2024-08-31T09:26:41.272381+0000 mgr.a (mgr.14388) 18827 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:26:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:42 smithi163 bash[24253]: cluster 2024-08-31T09:26:41.272381+0000 mgr.a (mgr.14388) 18827 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:26:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:42 smithi027 bash[22610]: cluster 2024-08-31T09:26:41.272381+0000 mgr.a (mgr.14388) 18827 : cluster [DBG] pgmap v13053: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:26:44.152 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:26:44.152 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:26:44.153 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:26:44.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:44 smithi191 bash[24992]: cluster 2024-08-31T09:26:43.274282+0000 mgr.a (mgr.14388) 18828 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:44.920 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:26:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:26:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:26:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:26:44.921 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:26:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:44 smithi163 bash[24253]: cluster 2024-08-31T09:26:43.274282+0000 mgr.a (mgr.14388) 18828 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:44 smithi027 bash[22610]: cluster 2024-08-31T09:26:43.274282+0000 mgr.a (mgr.14388) 18828 : cluster [DBG] pgmap v13054: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:45.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:45 smithi191 bash[24992]: audit 2024-08-31T09:26:44.486859+0000 mgr.a (mgr.14388) 18829 : audit [DBG] from='client.404613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:45 smithi163 bash[24253]: audit 2024-08-31T09:26:44.486859+0000 mgr.a (mgr.14388) 18829 : audit [DBG] from='client.404613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:45 smithi027 bash[22610]: audit 2024-08-31T09:26:44.486859+0000 mgr.a (mgr.14388) 18829 : audit [DBG] from='client.404613 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:46 smithi191 bash[24992]: cluster 2024-08-31T09:26:45.275148+0000 mgr.a (mgr.14388) 18830 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:46 smithi163 bash[24253]: cluster 2024-08-31T09:26:45.275148+0000 mgr.a (mgr.14388) 18830 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:46 smithi027 bash[22610]: cluster 2024-08-31T09:26:45.275148+0000 mgr.a (mgr.14388) 18830 : cluster [DBG] pgmap v13055: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:48 smithi191 bash[24992]: cluster 2024-08-31T09:26:47.275904+0000 mgr.a (mgr.14388) 18831 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:48 smithi163 bash[24253]: cluster 2024-08-31T09:26:47.275904+0000 mgr.a (mgr.14388) 18831 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:48 smithi027 bash[22610]: cluster 2024-08-31T09:26:47.275904+0000 mgr.a (mgr.14388) 18831 : cluster [DBG] pgmap v13056: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:49.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:26:49.923 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:26:49.923 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:26:50.685 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:26:50.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:26:50.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:26:50.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:26:50.685 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:26:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:50 smithi163 bash[24253]: cluster 2024-08-31T09:26:49.278097+0000 mgr.a (mgr.14388) 18832 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:50 smithi027 bash[22610]: cluster 2024-08-31T09:26:49.278097+0000 mgr.a (mgr.14388) 18832 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:50 smithi191 bash[24992]: cluster 2024-08-31T09:26:49.278097+0000 mgr.a (mgr.14388) 18832 : cluster [DBG] pgmap v13057: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:51 smithi163 bash[24253]: audit 2024-08-31T09:26:50.257754+0000 mgr.a (mgr.14388) 18833 : audit [DBG] from='client.404688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:51 smithi027 bash[22610]: audit 2024-08-31T09:26:50.257754+0000 mgr.a (mgr.14388) 18833 : audit [DBG] from='client.404688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:51 smithi191 bash[24992]: audit 2024-08-31T09:26:50.257754+0000 mgr.a (mgr.14388) 18833 : audit [DBG] from='client.404688 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:52 smithi163 bash[24253]: cluster 2024-08-31T09:26:51.279010+0000 mgr.a (mgr.14388) 18834 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:52 smithi027 bash[22610]: cluster 2024-08-31T09:26:51.279010+0000 mgr.a (mgr.14388) 18834 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:52 smithi191 bash[24992]: cluster 2024-08-31T09:26:51.279010+0000 mgr.a (mgr.14388) 18834 : cluster [DBG] pgmap v13058: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:53 smithi163 bash[24253]: audit 2024-08-31T09:26:52.671215+0000 mon.a (mon.0) 3383 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:26:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:53 smithi163 bash[24253]: audit 2024-08-31T09:26:53.296597+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:26:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:53 smithi163 bash[24253]: audit 2024-08-31T09:26:53.300153+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:26:53.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:53 smithi027 bash[22610]: audit 2024-08-31T09:26:52.671215+0000 mon.a (mon.0) 3383 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:26:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:53 smithi027 bash[22610]: audit 2024-08-31T09:26:53.296597+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:26:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:53 smithi027 bash[22610]: audit 2024-08-31T09:26:53.300153+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:26:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:53 smithi191 bash[24992]: audit 2024-08-31T09:26:52.671215+0000 mon.a (mon.0) 3383 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:26:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:53 smithi191 bash[24992]: audit 2024-08-31T09:26:53.296597+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:26:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:53 smithi191 bash[24992]: audit 2024-08-31T09:26:53.300153+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:26:54.821 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:54 smithi027 bash[22610]: cluster 2024-08-31T09:26:53.280359+0000 mgr.a (mgr.14388) 18835 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:54.821 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:54 smithi027 bash[22610]: audit 2024-08-31T09:26:54.072038+0000 mon.a (mon.0) 3386 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:26:54.821 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:54 smithi027 bash[22610]: audit 2024-08-31T09:26:54.073443+0000 mon.a (mon.0) 3387 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:26:54.821 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:54 smithi027 bash[22610]: audit 2024-08-31T09:26:54.083003+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:26:54.821 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:54 smithi027 bash[22610]: audit 2024-08-31T09:26:54.087548+0000 mon.a (mon.0) 3389 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:26:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:54 smithi163 bash[24253]: cluster 2024-08-31T09:26:53.280359+0000 mgr.a (mgr.14388) 18835 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:54 smithi163 bash[24253]: audit 2024-08-31T09:26:54.072038+0000 mon.a (mon.0) 3386 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:26:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:54 smithi163 bash[24253]: audit 2024-08-31T09:26:54.073443+0000 mon.a (mon.0) 3387 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:26:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:54 smithi163 bash[24253]: audit 2024-08-31T09:26:54.083003+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:26:54.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:54 smithi163 bash[24253]: audit 2024-08-31T09:26:54.087548+0000 mon.a (mon.0) 3389 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:26:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:54 smithi191 bash[24992]: cluster 2024-08-31T09:26:53.280359+0000 mgr.a (mgr.14388) 18835 : cluster [DBG] pgmap v13059: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:26:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:54 smithi191 bash[24992]: audit 2024-08-31T09:26:54.072038+0000 mon.a (mon.0) 3386 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:26:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:54 smithi191 bash[24992]: audit 2024-08-31T09:26:54.073443+0000 mon.a (mon.0) 3387 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:26:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:54 smithi191 bash[24992]: audit 2024-08-31T09:26:54.083003+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:26:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:54 smithi191 bash[24992]: audit 2024-08-31T09:26:54.087548+0000 mon.a (mon.0) 3389 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:26:55.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:26:54 smithi027 bash[22863]: debug 2024-08-31T09:26:54.817+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:26:55.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:26:54 smithi027 bash[22863]: debug 2024-08-31T09:26:54.821+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:26:55.686 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:26:55.687 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:26:55.687 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:26:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:55 smithi163 bash[24253]: audit 2024-08-31T09:26:54.089861+0000 mgr.a (mgr.14388) 18836 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:26:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:55 smithi163 bash[24253]: audit 2024-08-31T09:26:54.821226+0000 mgr.a (mgr.14388) 18837 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:26:55.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:55 smithi163 bash[24253]: cephadm 2024-08-31T09:26:54.823086+0000 mgr.a (mgr.14388) 18838 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:26:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:55 smithi027 bash[22610]: audit 2024-08-31T09:26:54.089861+0000 mgr.a (mgr.14388) 18836 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:26:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:55 smithi027 bash[22610]: audit 2024-08-31T09:26:54.821226+0000 mgr.a (mgr.14388) 18837 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:26:55.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:55 smithi027 bash[22610]: cephadm 2024-08-31T09:26:54.823086+0000 mgr.a (mgr.14388) 18838 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:26:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:55 smithi191 bash[24992]: audit 2024-08-31T09:26:54.089861+0000 mgr.a (mgr.14388) 18836 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:26:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:55 smithi191 bash[24992]: audit 2024-08-31T09:26:54.821226+0000 mgr.a (mgr.14388) 18837 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:26:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:55 smithi191 bash[24992]: cephadm 2024-08-31T09:26:54.823086+0000 mgr.a (mgr.14388) 18838 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:26:56.468 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:26:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:26:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:26:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:26:56.468 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:26:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:56 smithi163 bash[24253]: cluster 2024-08-31T09:26:55.281266+0000 mgr.a (mgr.14388) 18839 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:56 smithi027 bash[22610]: cluster 2024-08-31T09:26:55.281266+0000 mgr.a (mgr.14388) 18839 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:56 smithi191 bash[24992]: cluster 2024-08-31T09:26:55.281266+0000 mgr.a (mgr.14388) 18839 : cluster [DBG] pgmap v13060: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:57 smithi163 bash[24253]: audit 2024-08-31T09:26:56.023422+0000 mgr.a (mgr.14388) 18840 : audit [DBG] from='client.404874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:57 smithi027 bash[22610]: audit 2024-08-31T09:26:56.023422+0000 mgr.a (mgr.14388) 18840 : audit [DBG] from='client.404874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:57 smithi191 bash[24992]: audit 2024-08-31T09:26:56.023422+0000 mgr.a (mgr.14388) 18840 : audit [DBG] from='client.404874 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:26:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:26:58 smithi163 bash[24253]: cluster 2024-08-31T09:26:57.282311+0000 mgr.a (mgr.14388) 18841 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:26:58 smithi027 bash[22610]: cluster 2024-08-31T09:26:57.282311+0000 mgr.a (mgr.14388) 18841 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:26:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:26:58 smithi191 bash[24992]: cluster 2024-08-31T09:26:57.282311+0000 mgr.a (mgr.14388) 18841 : cluster [DBG] pgmap v13061: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:00.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:00 smithi163 bash[24253]: cluster 2024-08-31T09:26:59.284518+0000 mgr.a (mgr.14388) 18842 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:00 smithi027 bash[22610]: cluster 2024-08-31T09:26:59.284518+0000 mgr.a (mgr.14388) 18842 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:00 smithi191 bash[24992]: cluster 2024-08-31T09:26:59.284518+0000 mgr.a (mgr.14388) 18842 : cluster [DBG] pgmap v13062: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:01.469 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:01.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:01.470 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:02.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:02.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:02.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:02.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:27:02.250 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:02 smithi163 bash[24253]: cluster 2024-08-31T09:27:01.285298+0000 mgr.a (mgr.14388) 18843 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:02 smithi163 bash[24253]: audit 2024-08-31T09:27:01.807303+0000 mgr.a (mgr.14388) 18844 : audit [DBG] from='client.404952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:02 smithi027 bash[22610]: cluster 2024-08-31T09:27:01.285298+0000 mgr.a (mgr.14388) 18843 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:02 smithi027 bash[22610]: audit 2024-08-31T09:27:01.807303+0000 mgr.a (mgr.14388) 18844 : audit [DBG] from='client.404952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:02 smithi191 bash[24992]: cluster 2024-08-31T09:27:01.285298+0000 mgr.a (mgr.14388) 18843 : cluster [DBG] pgmap v13063: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:02 smithi191 bash[24992]: audit 2024-08-31T09:27:01.807303+0000 mgr.a (mgr.14388) 18844 : audit [DBG] from='client.404952 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:04 smithi163 bash[24253]: cluster 2024-08-31T09:27:03.287630+0000 mgr.a (mgr.14388) 18845 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:04 smithi027 bash[22610]: cluster 2024-08-31T09:27:03.287630+0000 mgr.a (mgr.14388) 18845 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:04 smithi191 bash[24992]: cluster 2024-08-31T09:27:03.287630+0000 mgr.a (mgr.14388) 18845 : cluster [DBG] pgmap v13064: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:06 smithi163 bash[24253]: cluster 2024-08-31T09:27:05.288430+0000 mgr.a (mgr.14388) 18846 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:06 smithi027 bash[22610]: cluster 2024-08-31T09:27:05.288430+0000 mgr.a (mgr.14388) 18846 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:06 smithi191 bash[24992]: cluster 2024-08-31T09:27:05.288430+0000 mgr.a (mgr.14388) 18846 : cluster [DBG] pgmap v13065: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:07.252 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:07.252 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:07.253 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:08.018 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:08.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:08.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:08.018 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:08.019 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:27:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:08 smithi163 bash[24253]: cluster 2024-08-31T09:27:07.289219+0000 mgr.a (mgr.14388) 18847 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:08 smithi163 bash[24253]: audit 2024-08-31T09:27:07.583955+0000 mgr.a (mgr.14388) 18848 : audit [DBG] from='client.405030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:08 smithi027 bash[22610]: cluster 2024-08-31T09:27:07.289219+0000 mgr.a (mgr.14388) 18847 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:08 smithi027 bash[22610]: audit 2024-08-31T09:27:07.583955+0000 mgr.a (mgr.14388) 18848 : audit [DBG] from='client.405030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:08 smithi191 bash[24992]: cluster 2024-08-31T09:27:07.289219+0000 mgr.a (mgr.14388) 18847 : cluster [DBG] pgmap v13066: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:08 smithi191 bash[24992]: audit 2024-08-31T09:27:07.583955+0000 mgr.a (mgr.14388) 18848 : audit [DBG] from='client.405030 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:10 smithi163 bash[24253]: cluster 2024-08-31T09:27:09.291725+0000 mgr.a (mgr.14388) 18849 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:10 smithi027 bash[22610]: cluster 2024-08-31T09:27:09.291725+0000 mgr.a (mgr.14388) 18849 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:10 smithi191 bash[24992]: cluster 2024-08-31T09:27:09.291725+0000 mgr.a (mgr.14388) 18849 : cluster [DBG] pgmap v13067: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:27:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:12 smithi163 bash[24253]: cluster 2024-08-31T09:27:11.292515+0000 mgr.a (mgr.14388) 18850 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:27:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:12 smithi027 bash[22610]: cluster 2024-08-31T09:27:11.292515+0000 mgr.a (mgr.14388) 18850 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:27:13.020 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:13.021 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:13.021 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:12 smithi191 bash[24992]: cluster 2024-08-31T09:27:11.292515+0000 mgr.a (mgr.14388) 18850 : cluster [DBG] pgmap v13068: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:27:13.776 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:13.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:13.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:13.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:13.776 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:27:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:14 smithi163 bash[24253]: cluster 2024-08-31T09:27:13.294473+0000 mgr.a (mgr.14388) 18851 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:14 smithi163 bash[24253]: audit 2024-08-31T09:27:13.356493+0000 mgr.a (mgr.14388) 18852 : audit [DBG] from='client.405105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:14 smithi027 bash[22610]: cluster 2024-08-31T09:27:13.294473+0000 mgr.a (mgr.14388) 18851 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:14 smithi027 bash[22610]: audit 2024-08-31T09:27:13.356493+0000 mgr.a (mgr.14388) 18852 : audit [DBG] from='client.405105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:14 smithi191 bash[24992]: cluster 2024-08-31T09:27:13.294473+0000 mgr.a (mgr.14388) 18851 : cluster [DBG] pgmap v13069: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:14 smithi191 bash[24992]: audit 2024-08-31T09:27:13.356493+0000 mgr.a (mgr.14388) 18852 : audit [DBG] from='client.405105 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:16 smithi163 bash[24253]: cluster 2024-08-31T09:27:15.295609+0000 mgr.a (mgr.14388) 18853 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:27:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:16 smithi027 bash[22610]: cluster 2024-08-31T09:27:15.295609+0000 mgr.a (mgr.14388) 18853 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:27:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:16 smithi191 bash[24992]: cluster 2024-08-31T09:27:15.295609+0000 mgr.a (mgr.14388) 18853 : cluster [DBG] pgmap v13070: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:27:18.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:18.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:18.778 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:18 smithi163 bash[24253]: cluster 2024-08-31T09:27:17.296603+0000 mgr.a (mgr.14388) 18854 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:27:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:18 smithi027 bash[22610]: cluster 2024-08-31T09:27:17.296603+0000 mgr.a (mgr.14388) 18854 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:27:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:18 smithi191 bash[24992]: cluster 2024-08-31T09:27:17.296603+0000 mgr.a (mgr.14388) 18854 : cluster [DBG] pgmap v13071: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:27:19.557 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:19.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:19.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:19.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:19.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:27:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:20 smithi163 bash[24253]: audit 2024-08-31T09:27:19.112149+0000 mgr.a (mgr.14388) 18855 : audit [DBG] from='client.405183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:20.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:20 smithi163 bash[24253]: cluster 2024-08-31T09:27:19.298045+0000 mgr.a (mgr.14388) 18856 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:20 smithi027 bash[22610]: audit 2024-08-31T09:27:19.112149+0000 mgr.a (mgr.14388) 18855 : audit [DBG] from='client.405183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:20 smithi027 bash[22610]: cluster 2024-08-31T09:27:19.298045+0000 mgr.a (mgr.14388) 18856 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:20 smithi191 bash[24992]: audit 2024-08-31T09:27:19.112149+0000 mgr.a (mgr.14388) 18855 : audit [DBG] from='client.405183 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:20 smithi191 bash[24992]: cluster 2024-08-31T09:27:19.298045+0000 mgr.a (mgr.14388) 18856 : cluster [DBG] pgmap v13072: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:22 smithi163 bash[24253]: cluster 2024-08-31T09:27:21.298952+0000 mgr.a (mgr.14388) 18857 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:27:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:22 smithi027 bash[22610]: cluster 2024-08-31T09:27:21.298952+0000 mgr.a (mgr.14388) 18857 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:27:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:22 smithi191 bash[24992]: cluster 2024-08-31T09:27:21.298952+0000 mgr.a (mgr.14388) 18857 : cluster [DBG] pgmap v13073: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:27:24.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:24.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:24.559 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:24 smithi163 bash[24253]: cluster 2024-08-31T09:27:23.301109+0000 mgr.a (mgr.14388) 18858 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:27:24.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:24 smithi027 bash[22610]: cluster 2024-08-31T09:27:23.301109+0000 mgr.a (mgr.14388) 18858 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:27:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:24 smithi191 bash[24992]: cluster 2024-08-31T09:27:23.301109+0000 mgr.a (mgr.14388) 18858 : cluster [DBG] pgmap v13074: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:27:25.316 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:25.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:25.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:25.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:25.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:27:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:26 smithi163 bash[24253]: audit 2024-08-31T09:27:24.888336+0000 mgr.a (mgr.14388) 18859 : audit [DBG] from='client.405261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:26 smithi163 bash[24253]: cluster 2024-08-31T09:27:25.301597+0000 mgr.a (mgr.14388) 18860 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:26 smithi027 bash[22610]: audit 2024-08-31T09:27:24.888336+0000 mgr.a (mgr.14388) 18859 : audit [DBG] from='client.405261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:26 smithi027 bash[22610]: cluster 2024-08-31T09:27:25.301597+0000 mgr.a (mgr.14388) 18860 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:26 smithi191 bash[24992]: audit 2024-08-31T09:27:24.888336+0000 mgr.a (mgr.14388) 18859 : audit [DBG] from='client.405261 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:26 smithi191 bash[24992]: cluster 2024-08-31T09:27:25.301597+0000 mgr.a (mgr.14388) 18860 : cluster [DBG] pgmap v13075: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:28 smithi163 bash[24253]: cluster 2024-08-31T09:27:27.302355+0000 mgr.a (mgr.14388) 18861 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:28 smithi027 bash[22610]: cluster 2024-08-31T09:27:27.302355+0000 mgr.a (mgr.14388) 18861 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:28 smithi191 bash[24992]: cluster 2024-08-31T09:27:27.302355+0000 mgr.a (mgr.14388) 18861 : cluster [DBG] pgmap v13076: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:30.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:30.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:30.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:30 smithi163 bash[24253]: cluster 2024-08-31T09:27:29.304638+0000 mgr.a (mgr.14388) 18862 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:30 smithi027 bash[22610]: cluster 2024-08-31T09:27:29.304638+0000 mgr.a (mgr.14388) 18862 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:30 smithi191 bash[24992]: cluster 2024-08-31T09:27:29.304638+0000 mgr.a (mgr.14388) 18862 : cluster [DBG] pgmap v13077: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:31.103 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:31.104 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:27:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:31 smithi163 bash[24253]: audit 2024-08-31T09:27:30.652633+0000 mgr.a (mgr.14388) 18863 : audit [DBG] from='client.405339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:31 smithi027 bash[22610]: audit 2024-08-31T09:27:30.652633+0000 mgr.a (mgr.14388) 18863 : audit [DBG] from='client.405339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:31 smithi191 bash[24992]: audit 2024-08-31T09:27:30.652633+0000 mgr.a (mgr.14388) 18863 : audit [DBG] from='client.405339 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:32 smithi163 bash[24253]: cluster 2024-08-31T09:27:31.305620+0000 mgr.a (mgr.14388) 18864 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:32 smithi027 bash[22610]: cluster 2024-08-31T09:27:31.305620+0000 mgr.a (mgr.14388) 18864 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:32 smithi191 bash[24992]: cluster 2024-08-31T09:27:31.305620+0000 mgr.a (mgr.14388) 18864 : cluster [DBG] pgmap v13078: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:34 smithi163 bash[24253]: cluster 2024-08-31T09:27:33.307778+0000 mgr.a (mgr.14388) 18865 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:34 smithi027 bash[22610]: cluster 2024-08-31T09:27:33.307778+0000 mgr.a (mgr.14388) 18865 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:34 smithi191 bash[24992]: cluster 2024-08-31T09:27:33.307778+0000 mgr.a (mgr.14388) 18865 : cluster [DBG] pgmap v13079: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:36.105 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:36.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:36.106 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:36.891 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:36.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:36.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:36.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:36.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:27:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:36 smithi163 bash[24253]: cluster 2024-08-31T09:27:35.308554+0000 mgr.a (mgr.14388) 18866 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:36 smithi027 bash[22610]: cluster 2024-08-31T09:27:35.308554+0000 mgr.a (mgr.14388) 18866 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:36 smithi191 bash[24992]: cluster 2024-08-31T09:27:35.308554+0000 mgr.a (mgr.14388) 18866 : cluster [DBG] pgmap v13080: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:37 smithi163 bash[24253]: audit 2024-08-31T09:27:36.443675+0000 mgr.a (mgr.14388) 18867 : audit [DBG] from='client.405414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:37 smithi027 bash[22610]: audit 2024-08-31T09:27:36.443675+0000 mgr.a (mgr.14388) 18867 : audit [DBG] from='client.405414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:37 smithi191 bash[24992]: audit 2024-08-31T09:27:36.443675+0000 mgr.a (mgr.14388) 18867 : audit [DBG] from='client.405414 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:38 smithi163 bash[24253]: cluster 2024-08-31T09:27:37.309516+0000 mgr.a (mgr.14388) 18868 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:38 smithi027 bash[22610]: cluster 2024-08-31T09:27:37.309516+0000 mgr.a (mgr.14388) 18868 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:38 smithi191 bash[24992]: cluster 2024-08-31T09:27:37.309516+0000 mgr.a (mgr.14388) 18868 : cluster [DBG] pgmap v13081: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:40 smithi163 bash[24253]: cluster 2024-08-31T09:27:39.311796+0000 mgr.a (mgr.14388) 18869 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:40 smithi027 bash[22610]: cluster 2024-08-31T09:27:39.311796+0000 mgr.a (mgr.14388) 18869 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:40 smithi191 bash[24992]: cluster 2024-08-31T09:27:39.311796+0000 mgr.a (mgr.14388) 18869 : cluster [DBG] pgmap v13082: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:41.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:41.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:41.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:42.673 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:42.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:42.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:42.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:42.673 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:27:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:42 smithi027 bash[22610]: cluster 2024-08-31T09:27:41.312577+0000 mgr.a (mgr.14388) 18870 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:42 smithi191 bash[24992]: cluster 2024-08-31T09:27:41.312577+0000 mgr.a (mgr.14388) 18870 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:42 smithi163 bash[24253]: cluster 2024-08-31T09:27:41.312577+0000 mgr.a (mgr.14388) 18870 : cluster [DBG] pgmap v13083: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:43 smithi027 bash[22610]: audit 2024-08-31T09:27:42.238382+0000 mgr.a (mgr.14388) 18871 : audit [DBG] from='client.145495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:43 smithi191 bash[24992]: audit 2024-08-31T09:27:42.238382+0000 mgr.a (mgr.14388) 18871 : audit [DBG] from='client.145495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:43 smithi163 bash[24253]: audit 2024-08-31T09:27:42.238382+0000 mgr.a (mgr.14388) 18871 : audit [DBG] from='client.145495 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:44 smithi027 bash[22610]: cluster 2024-08-31T09:27:43.315045+0000 mgr.a (mgr.14388) 18872 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:44 smithi191 bash[24992]: cluster 2024-08-31T09:27:43.315045+0000 mgr.a (mgr.14388) 18872 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:44 smithi163 bash[24253]: cluster 2024-08-31T09:27:43.315045+0000 mgr.a (mgr.14388) 18872 : cluster [DBG] pgmap v13084: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:27:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:46 smithi027 bash[22610]: cluster 2024-08-31T09:27:45.315988+0000 mgr.a (mgr.14388) 18873 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:46 smithi191 bash[24992]: cluster 2024-08-31T09:27:45.315988+0000 mgr.a (mgr.14388) 18873 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:46 smithi163 bash[24253]: cluster 2024-08-31T09:27:45.315988+0000 mgr.a (mgr.14388) 18873 : cluster [DBG] pgmap v13085: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:47.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:47.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:47.675 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:48.445 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:48.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:48.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:48.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:48.446 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:27:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:48 smithi027 bash[22610]: cluster 2024-08-31T09:27:47.316924+0000 mgr.a (mgr.14388) 18874 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:48 smithi191 bash[24992]: cluster 2024-08-31T09:27:47.316924+0000 mgr.a (mgr.14388) 18874 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:48 smithi163 bash[24253]: cluster 2024-08-31T09:27:47.316924+0000 mgr.a (mgr.14388) 18874 : cluster [DBG] pgmap v13086: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:49 smithi027 bash[22610]: audit 2024-08-31T09:27:48.013226+0000 mgr.a (mgr.14388) 18875 : audit [DBG] from='client.405567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:49 smithi191 bash[24992]: audit 2024-08-31T09:27:48.013226+0000 mgr.a (mgr.14388) 18875 : audit [DBG] from='client.405567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:49 smithi163 bash[24253]: audit 2024-08-31T09:27:48.013226+0000 mgr.a (mgr.14388) 18875 : audit [DBG] from='client.405567 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:50 smithi191 bash[24992]: cluster 2024-08-31T09:27:49.319850+0000 mgr.a (mgr.14388) 18876 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:50 smithi163 bash[24253]: cluster 2024-08-31T09:27:49.319850+0000 mgr.a (mgr.14388) 18876 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:50 smithi027 bash[22610]: cluster 2024-08-31T09:27:49.319850+0000 mgr.a (mgr.14388) 18876 : cluster [DBG] pgmap v13087: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:52 smithi191 bash[24992]: cluster 2024-08-31T09:27:51.320637+0000 mgr.a (mgr.14388) 18877 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:27:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:52 smithi163 bash[24253]: cluster 2024-08-31T09:27:51.320637+0000 mgr.a (mgr.14388) 18877 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:27:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:52 smithi027 bash[22610]: cluster 2024-08-31T09:27:51.320637+0000 mgr.a (mgr.14388) 18877 : cluster [DBG] pgmap v13088: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:27:53.447 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:53.448 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:53.448 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:54.201 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:27:54.202 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:54 smithi191 bash[24992]: cluster 2024-08-31T09:27:53.322572+0000 mgr.a (mgr.14388) 18878 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:54 smithi191 bash[24992]: audit 2024-08-31T09:27:53.782397+0000 mgr.a (mgr.14388) 18879 : audit [DBG] from='client.405639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:54 smithi163 bash[24253]: cluster 2024-08-31T09:27:53.322572+0000 mgr.a (mgr.14388) 18878 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:54 smithi163 bash[24253]: audit 2024-08-31T09:27:53.782397+0000 mgr.a (mgr.14388) 18879 : audit [DBG] from='client.405639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:54 smithi027 bash[22610]: cluster 2024-08-31T09:27:53.322572+0000 mgr.a (mgr.14388) 18878 : cluster [DBG] pgmap v13089: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:27:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:54 smithi027 bash[22610]: audit 2024-08-31T09:27:53.782397+0000 mgr.a (mgr.14388) 18879 : audit [DBG] from='client.405639 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:27:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:55 smithi191 bash[24992]: audit 2024-08-31T09:27:54.883401+0000 mon.a (mon.0) 3390 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:27:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:55 smithi191 bash[24992]: audit 2024-08-31T09:27:55.504067+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:55 smithi191 bash[24992]: audit 2024-08-31T09:27:55.508313+0000 mon.a (mon.0) 3392 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:55 smithi191 bash[24992]: audit 2024-08-31T09:27:55.512950+0000 mon.a (mon.0) 3393 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:55 smithi191 bash[24992]: audit 2024-08-31T09:27:55.517407+0000 mon.a (mon.0) 3394 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:55 smithi163 bash[24253]: audit 2024-08-31T09:27:54.883401+0000 mon.a (mon.0) 3390 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:27:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:55 smithi163 bash[24253]: audit 2024-08-31T09:27:55.504067+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:55 smithi163 bash[24253]: audit 2024-08-31T09:27:55.508313+0000 mon.a (mon.0) 3392 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:55 smithi163 bash[24253]: audit 2024-08-31T09:27:55.512950+0000 mon.a (mon.0) 3393 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:55 smithi163 bash[24253]: audit 2024-08-31T09:27:55.517407+0000 mon.a (mon.0) 3394 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:55 smithi027 bash[22610]: audit 2024-08-31T09:27:54.883401+0000 mon.a (mon.0) 3390 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:27:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:55 smithi027 bash[22610]: audit 2024-08-31T09:27:55.504067+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:55 smithi027 bash[22610]: audit 2024-08-31T09:27:55.508313+0000 mon.a (mon.0) 3392 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:55 smithi027 bash[22610]: audit 2024-08-31T09:27:55.512950+0000 mon.a (mon.0) 3393 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:55 smithi027 bash[22610]: audit 2024-08-31T09:27:55.517407+0000 mon.a (mon.0) 3394 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:56 smithi191 bash[24992]: cluster 2024-08-31T09:27:55.323504+0000 mgr.a (mgr.14388) 18880 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:27:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:56 smithi191 bash[24992]: audit 2024-08-31T09:27:56.356768+0000 mon.a (mon.0) 3395 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:27:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:56 smithi191 bash[24992]: audit 2024-08-31T09:27:56.358114+0000 mon.a (mon.0) 3396 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:27:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:56 smithi191 bash[24992]: audit 2024-08-31T09:27:56.368225+0000 mon.a (mon.0) 3397 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:57.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:56 smithi191 bash[24992]: audit 2024-08-31T09:27:56.372976+0000 mon.a (mon.0) 3398 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:27:57.167 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:56 smithi027 bash[22610]: cluster 2024-08-31T09:27:55.323504+0000 mgr.a (mgr.14388) 18880 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:27:57.167 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:56 smithi027 bash[22610]: audit 2024-08-31T09:27:56.356768+0000 mon.a (mon.0) 3395 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:27:57.167 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:56 smithi027 bash[22610]: audit 2024-08-31T09:27:56.358114+0000 mon.a (mon.0) 3396 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:27:57.167 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:56 smithi027 bash[22610]: audit 2024-08-31T09:27:56.368225+0000 mon.a (mon.0) 3397 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:57.168 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:56 smithi027 bash[22610]: audit 2024-08-31T09:27:56.372976+0000 mon.a (mon.0) 3398 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:27:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:56 smithi163 bash[24253]: cluster 2024-08-31T09:27:55.323504+0000 mgr.a (mgr.14388) 18880 : cluster [DBG] pgmap v13090: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:27:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:56 smithi163 bash[24253]: audit 2024-08-31T09:27:56.356768+0000 mon.a (mon.0) 3395 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:27:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:56 smithi163 bash[24253]: audit 2024-08-31T09:27:56.358114+0000 mon.a (mon.0) 3396 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:27:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:56 smithi163 bash[24253]: audit 2024-08-31T09:27:56.368225+0000 mon.a (mon.0) 3397 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:27:57.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:56 smithi163 bash[24253]: audit 2024-08-31T09:27:56.372976+0000 mon.a (mon.0) 3398 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:27:57.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:27:57 smithi027 bash[22863]: debug 2024-08-31T09:27:57.164+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:27:57.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:27:57 smithi027 bash[22863]: debug 2024-08-31T09:27:57.164+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:27:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:57 smithi191 bash[24992]: audit 2024-08-31T09:27:56.375361+0000 mgr.a (mgr.14388) 18881 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:27:58.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:57 smithi163 bash[24253]: audit 2024-08-31T09:27:56.375361+0000 mgr.a (mgr.14388) 18881 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:27:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:57 smithi027 bash[22610]: audit 2024-08-31T09:27:56.375361+0000 mgr.a (mgr.14388) 18881 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:27:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:58 smithi191 bash[24992]: audit 2024-08-31T09:27:57.167423+0000 mgr.a (mgr.14388) 18882 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:27:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:58 smithi191 bash[24992]: cephadm 2024-08-31T09:27:57.169296+0000 mgr.a (mgr.14388) 18883 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:27:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:27:58 smithi191 bash[24992]: cluster 2024-08-31T09:27:57.324490+0000 mgr.a (mgr.14388) 18884 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:27:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:58 smithi163 bash[24253]: audit 2024-08-31T09:27:57.167423+0000 mgr.a (mgr.14388) 18882 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:27:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:58 smithi163 bash[24253]: cephadm 2024-08-31T09:27:57.169296+0000 mgr.a (mgr.14388) 18883 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:27:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:27:58 smithi163 bash[24253]: cluster 2024-08-31T09:27:57.324490+0000 mgr.a (mgr.14388) 18884 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:27:59.202 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:27:59.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:27:59.204 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:27:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:58 smithi027 bash[22610]: audit 2024-08-31T09:27:57.167423+0000 mgr.a (mgr.14388) 18882 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:27:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:58 smithi027 bash[22610]: cephadm 2024-08-31T09:27:57.169296+0000 mgr.a (mgr.14388) 18883 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:27:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:27:58 smithi027 bash[22610]: cluster 2024-08-31T09:27:57.324490+0000 mgr.a (mgr.14388) 18884 : cluster [DBG] pgmap v13091: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:27:59.949 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:27:59.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:27:59.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:27:59.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:27:59.950 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:00 smithi191 bash[24992]: cluster 2024-08-31T09:27:59.325588+0000 mgr.a (mgr.14388) 18885 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:00 smithi191 bash[24992]: audit 2024-08-31T09:27:59.535021+0000 mgr.a (mgr.14388) 18886 : audit [DBG] from='client.405819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:00 smithi163 bash[24253]: cluster 2024-08-31T09:27:59.325588+0000 mgr.a (mgr.14388) 18885 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:00 smithi163 bash[24253]: audit 2024-08-31T09:27:59.535021+0000 mgr.a (mgr.14388) 18886 : audit [DBG] from='client.405819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:00 smithi027 bash[22610]: cluster 2024-08-31T09:27:59.325588+0000 mgr.a (mgr.14388) 18885 : cluster [DBG] pgmap v13092: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:00 smithi027 bash[22610]: audit 2024-08-31T09:27:59.535021+0000 mgr.a (mgr.14388) 18886 : audit [DBG] from='client.405819 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:02 smithi191 bash[24992]: cluster 2024-08-31T09:28:01.326423+0000 mgr.a (mgr.14388) 18887 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:02 smithi163 bash[24253]: cluster 2024-08-31T09:28:01.326423+0000 mgr.a (mgr.14388) 18887 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:02 smithi027 bash[22610]: cluster 2024-08-31T09:28:01.326423+0000 mgr.a (mgr.14388) 18887 : cluster [DBG] pgmap v13093: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:04.951 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:28:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:28:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:28:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:04 smithi191 bash[24992]: cluster 2024-08-31T09:28:03.328588+0000 mgr.a (mgr.14388) 18888 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:04 smithi163 bash[24253]: cluster 2024-08-31T09:28:03.328588+0000 mgr.a (mgr.14388) 18888 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:04 smithi027 bash[22610]: cluster 2024-08-31T09:28:03.328588+0000 mgr.a (mgr.14388) 18888 : cluster [DBG] pgmap v13094: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:05.719 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:28:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:28:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:28:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:28:05.720 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:06 smithi163 bash[24253]: audit 2024-08-31T09:28:05.283671+0000 mgr.a (mgr.14388) 18889 : audit [DBG] from='client.405897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:06 smithi163 bash[24253]: cluster 2024-08-31T09:28:05.329180+0000 mgr.a (mgr.14388) 18890 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:06 smithi027 bash[22610]: audit 2024-08-31T09:28:05.283671+0000 mgr.a (mgr.14388) 18889 : audit [DBG] from='client.405897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:06 smithi027 bash[22610]: cluster 2024-08-31T09:28:05.329180+0000 mgr.a (mgr.14388) 18890 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:06 smithi191 bash[24992]: audit 2024-08-31T09:28:05.283671+0000 mgr.a (mgr.14388) 18889 : audit [DBG] from='client.405897 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:06 smithi191 bash[24992]: cluster 2024-08-31T09:28:05.329180+0000 mgr.a (mgr.14388) 18890 : cluster [DBG] pgmap v13095: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:08 smithi163 bash[24253]: cluster 2024-08-31T09:28:07.330057+0000 mgr.a (mgr.14388) 18891 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:08 smithi027 bash[22610]: cluster 2024-08-31T09:28:07.330057+0000 mgr.a (mgr.14388) 18891 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:08 smithi191 bash[24992]: cluster 2024-08-31T09:28:07.330057+0000 mgr.a (mgr.14388) 18891 : cluster [DBG] pgmap v13096: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:10.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:28:10.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:28:10.722 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:28:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:10 smithi163 bash[24253]: cluster 2024-08-31T09:28:09.332323+0000 mgr.a (mgr.14388) 18892 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:10 smithi027 bash[22610]: cluster 2024-08-31T09:28:09.332323+0000 mgr.a (mgr.14388) 18892 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:10 smithi191 bash[24992]: cluster 2024-08-31T09:28:09.332323+0000 mgr.a (mgr.14388) 18892 : cluster [DBG] pgmap v13097: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:28:11.511 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:28:11.511 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:28:11.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:28:11.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:28:11.512 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:12 smithi163 bash[24253]: audit 2024-08-31T09:28:11.059982+0000 mgr.a (mgr.14388) 18893 : audit [DBG] from='client.405969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:12 smithi163 bash[24253]: cluster 2024-08-31T09:28:11.333155+0000 mgr.a (mgr.14388) 18894 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:12 smithi027 bash[22610]: audit 2024-08-31T09:28:11.059982+0000 mgr.a (mgr.14388) 18893 : audit [DBG] from='client.405969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:12 smithi027 bash[22610]: cluster 2024-08-31T09:28:11.333155+0000 mgr.a (mgr.14388) 18894 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:12 smithi191 bash[24992]: audit 2024-08-31T09:28:11.059982+0000 mgr.a (mgr.14388) 18893 : audit [DBG] from='client.405969 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:12 smithi191 bash[24992]: cluster 2024-08-31T09:28:11.333155+0000 mgr.a (mgr.14388) 18894 : cluster [DBG] pgmap v13098: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:15.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:14 smithi163 bash[24253]: cluster 2024-08-31T09:28:13.335450+0000 mgr.a (mgr.14388) 18895 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:14 smithi027 bash[22610]: cluster 2024-08-31T09:28:13.335450+0000 mgr.a (mgr.14388) 18895 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:14 smithi191 bash[24992]: cluster 2024-08-31T09:28:13.335450+0000 mgr.a (mgr.14388) 18895 : cluster [DBG] pgmap v13099: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:16.513 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:28:16.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:28:16.514 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:28:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:16 smithi163 bash[24253]: cluster 2024-08-31T09:28:15.336232+0000 mgr.a (mgr.14388) 18896 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:16 smithi027 bash[22610]: cluster 2024-08-31T09:28:15.336232+0000 mgr.a (mgr.14388) 18896 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:17.269 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:28:17.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:28:17.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:28:17.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:28:17.270 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:16 smithi191 bash[24992]: cluster 2024-08-31T09:28:15.336232+0000 mgr.a (mgr.14388) 18896 : cluster [DBG] pgmap v13100: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:18.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:17 smithi163 bash[24253]: audit 2024-08-31T09:28:16.848574+0000 mgr.a (mgr.14388) 18897 : audit [DBG] from='client.406044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:17 smithi027 bash[22610]: audit 2024-08-31T09:28:16.848574+0000 mgr.a (mgr.14388) 18897 : audit [DBG] from='client.406044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:17 smithi191 bash[24992]: audit 2024-08-31T09:28:16.848574+0000 mgr.a (mgr.14388) 18897 : audit [DBG] from='client.406044 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:18 smithi163 bash[24253]: cluster 2024-08-31T09:28:17.337197+0000 mgr.a (mgr.14388) 18898 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:18 smithi027 bash[22610]: cluster 2024-08-31T09:28:17.337197+0000 mgr.a (mgr.14388) 18898 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:18 smithi191 bash[24992]: cluster 2024-08-31T09:28:17.337197+0000 mgr.a (mgr.14388) 18898 : cluster [DBG] pgmap v13101: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:20 smithi163 bash[24253]: cluster 2024-08-31T09:28:19.339475+0000 mgr.a (mgr.14388) 18899 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:20 smithi027 bash[22610]: cluster 2024-08-31T09:28:19.339475+0000 mgr.a (mgr.14388) 18899 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:20 smithi191 bash[24992]: cluster 2024-08-31T09:28:19.339475+0000 mgr.a (mgr.14388) 18899 : cluster [DBG] pgmap v13102: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:22.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:28:22.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:28:22.272 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:28:23.051 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:28:23.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:28:23.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:28:23.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:28:23.051 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:22 smithi163 bash[24253]: cluster 2024-08-31T09:28:21.340234+0000 mgr.a (mgr.14388) 18900 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:22 smithi027 bash[22610]: cluster 2024-08-31T09:28:21.340234+0000 mgr.a (mgr.14388) 18900 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:22 smithi191 bash[24992]: cluster 2024-08-31T09:28:21.340234+0000 mgr.a (mgr.14388) 18900 : cluster [DBG] pgmap v13103: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:24.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:23 smithi163 bash[24253]: audit 2024-08-31T09:28:22.610834+0000 mgr.a (mgr.14388) 18901 : audit [DBG] from='client.406116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:23 smithi027 bash[22610]: audit 2024-08-31T09:28:22.610834+0000 mgr.a (mgr.14388) 18901 : audit [DBG] from='client.406116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:23 smithi191 bash[24992]: audit 2024-08-31T09:28:22.610834+0000 mgr.a (mgr.14388) 18901 : audit [DBG] from='client.406116 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:24 smithi163 bash[24253]: cluster 2024-08-31T09:28:23.342660+0000 mgr.a (mgr.14388) 18902 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:28:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:24 smithi027 bash[22610]: cluster 2024-08-31T09:28:23.342660+0000 mgr.a (mgr.14388) 18902 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:28:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:24 smithi191 bash[24992]: cluster 2024-08-31T09:28:23.342660+0000 mgr.a (mgr.14388) 18902 : cluster [DBG] pgmap v13104: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:28:27.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:26 smithi163 bash[24253]: cluster 2024-08-31T09:28:25.343491+0000 mgr.a (mgr.14388) 18903 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:28:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:26 smithi027 bash[22610]: cluster 2024-08-31T09:28:25.343491+0000 mgr.a (mgr.14388) 18903 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:28:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:26 smithi191 bash[24992]: cluster 2024-08-31T09:28:25.343491+0000 mgr.a (mgr.14388) 18903 : cluster [DBG] pgmap v13105: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:28:28.052 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:28:28.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:28:28.053 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:28:28.806 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:28:28.806 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:28:28.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:28:28.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:28:28.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:28 smithi163 bash[24253]: cluster 2024-08-31T09:28:27.344244+0000 mgr.a (mgr.14388) 18904 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:28:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:28 smithi027 bash[22610]: cluster 2024-08-31T09:28:27.344244+0000 mgr.a (mgr.14388) 18904 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:28:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:28 smithi191 bash[24992]: cluster 2024-08-31T09:28:27.344244+0000 mgr.a (mgr.14388) 18904 : cluster [DBG] pgmap v13106: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:28:30.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:29 smithi163 bash[24253]: audit 2024-08-31T09:28:28.380971+0000 mgr.a (mgr.14388) 18905 : audit [DBG] from='client.406194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:29 smithi027 bash[22610]: audit 2024-08-31T09:28:28.380971+0000 mgr.a (mgr.14388) 18905 : audit [DBG] from='client.406194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:29 smithi191 bash[24992]: audit 2024-08-31T09:28:28.380971+0000 mgr.a (mgr.14388) 18905 : audit [DBG] from='client.406194 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:30 smithi163 bash[24253]: cluster 2024-08-31T09:28:29.347246+0000 mgr.a (mgr.14388) 18906 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:30 smithi027 bash[22610]: cluster 2024-08-31T09:28:29.347246+0000 mgr.a (mgr.14388) 18906 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:30 smithi191 bash[24992]: cluster 2024-08-31T09:28:29.347246+0000 mgr.a (mgr.14388) 18906 : cluster [DBG] pgmap v13107: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:32 smithi163 bash[24253]: cluster 2024-08-31T09:28:31.348077+0000 mgr.a (mgr.14388) 18907 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:28:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:32 smithi027 bash[22610]: cluster 2024-08-31T09:28:31.348077+0000 mgr.a (mgr.14388) 18907 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:28:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:32 smithi191 bash[24992]: cluster 2024-08-31T09:28:31.348077+0000 mgr.a (mgr.14388) 18907 : cluster [DBG] pgmap v13108: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:28:33.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:28:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:28:33.809 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:28:34.560 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:28:34.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:28:34.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:28:34.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:28:34.560 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:34 smithi163 bash[24253]: cluster 2024-08-31T09:28:33.350000+0000 mgr.a (mgr.14388) 18908 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:34 smithi027 bash[22610]: cluster 2024-08-31T09:28:33.350000+0000 mgr.a (mgr.14388) 18908 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:34 smithi191 bash[24992]: cluster 2024-08-31T09:28:33.350000+0000 mgr.a (mgr.14388) 18908 : cluster [DBG] pgmap v13109: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:36.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:35 smithi163 bash[24253]: audit 2024-08-31T09:28:34.139843+0000 mgr.a (mgr.14388) 18909 : audit [DBG] from='client.406272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:36.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:35 smithi163 bash[24253]: cluster 2024-08-31T09:28:35.350968+0000 mgr.a (mgr.14388) 18910 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:28:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:35 smithi027 bash[22610]: audit 2024-08-31T09:28:34.139843+0000 mgr.a (mgr.14388) 18909 : audit [DBG] from='client.406272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:35 smithi027 bash[22610]: cluster 2024-08-31T09:28:35.350968+0000 mgr.a (mgr.14388) 18910 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:28:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:35 smithi191 bash[24992]: audit 2024-08-31T09:28:34.139843+0000 mgr.a (mgr.14388) 18909 : audit [DBG] from='client.406272 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:35 smithi191 bash[24992]: cluster 2024-08-31T09:28:35.350968+0000 mgr.a (mgr.14388) 18910 : cluster [DBG] pgmap v13110: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:28:38.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:38 smithi163 bash[24253]: cluster 2024-08-31T09:28:37.351696+0000 mgr.a (mgr.14388) 18911 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:28:38.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:38 smithi027 bash[22610]: cluster 2024-08-31T09:28:37.351696+0000 mgr.a (mgr.14388) 18911 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:28:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:38 smithi191 bash[24992]: cluster 2024-08-31T09:28:37.351696+0000 mgr.a (mgr.14388) 18911 : cluster [DBG] pgmap v13111: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:28:39.561 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:28:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:28:39.562 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:28:40.316 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:28:40.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:28:40.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:28:40.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:28:40.316 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:40.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:40 smithi163 bash[24253]: cluster 2024-08-31T09:28:39.353883+0000 mgr.a (mgr.14388) 18912 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:28:40.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:40 smithi027 bash[22610]: cluster 2024-08-31T09:28:39.353883+0000 mgr.a (mgr.14388) 18912 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:28:40.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:40 smithi191 bash[24992]: cluster 2024-08-31T09:28:39.353883+0000 mgr.a (mgr.14388) 18912 : cluster [DBG] pgmap v13112: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:28:41.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:41 smithi163 bash[24253]: audit 2024-08-31T09:28:39.895416+0000 mgr.a (mgr.14388) 18913 : audit [DBG] from='client.406347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:41.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:41 smithi027 bash[22610]: audit 2024-08-31T09:28:39.895416+0000 mgr.a (mgr.14388) 18913 : audit [DBG] from='client.406347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:41.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:41 smithi191 bash[24992]: audit 2024-08-31T09:28:39.895416+0000 mgr.a (mgr.14388) 18913 : audit [DBG] from='client.406347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:42 smithi163 bash[24253]: cluster 2024-08-31T09:28:41.354786+0000 mgr.a (mgr.14388) 18914 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:42.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:42 smithi027 bash[22610]: cluster 2024-08-31T09:28:41.354786+0000 mgr.a (mgr.14388) 18914 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:42 smithi191 bash[24992]: cluster 2024-08-31T09:28:41.354786+0000 mgr.a (mgr.14388) 18914 : cluster [DBG] pgmap v13113: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:44.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:44 smithi163 bash[24253]: cluster 2024-08-31T09:28:43.356922+0000 mgr.a (mgr.14388) 18915 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:44.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:44 smithi027 bash[22610]: cluster 2024-08-31T09:28:43.356922+0000 mgr.a (mgr.14388) 18915 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:44 smithi191 bash[24992]: cluster 2024-08-31T09:28:43.356922+0000 mgr.a (mgr.14388) 18915 : cluster [DBG] pgmap v13114: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:45.317 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:28:45.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:28:45.318 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:28:46.109 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:28:46.109 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:28:46.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:28:46.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:28:46.110 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:46 smithi163 bash[24253]: cluster 2024-08-31T09:28:45.357474+0000 mgr.a (mgr.14388) 18916 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:46.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:46 smithi163 bash[24253]: audit 2024-08-31T09:28:45.657602+0000 mgr.a (mgr.14388) 18917 : audit [DBG] from='client.406425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:46 smithi027 bash[22610]: cluster 2024-08-31T09:28:45.357474+0000 mgr.a (mgr.14388) 18916 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:46.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:46 smithi027 bash[22610]: audit 2024-08-31T09:28:45.657602+0000 mgr.a (mgr.14388) 18917 : audit [DBG] from='client.406425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:46 smithi191 bash[24992]: cluster 2024-08-31T09:28:45.357474+0000 mgr.a (mgr.14388) 18916 : cluster [DBG] pgmap v13115: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:46 smithi191 bash[24992]: audit 2024-08-31T09:28:45.657602+0000 mgr.a (mgr.14388) 18917 : audit [DBG] from='client.406425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:48 smithi163 bash[24253]: cluster 2024-08-31T09:28:47.358374+0000 mgr.a (mgr.14388) 18918 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:48 smithi027 bash[22610]: cluster 2024-08-31T09:28:47.358374+0000 mgr.a (mgr.14388) 18918 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:48 smithi191 bash[24992]: cluster 2024-08-31T09:28:47.358374+0000 mgr.a (mgr.14388) 18918 : cluster [DBG] pgmap v13116: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:50.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:50 smithi163 bash[24253]: cluster 2024-08-31T09:28:49.360613+0000 mgr.a (mgr.14388) 18919 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:50.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:50 smithi027 bash[22610]: cluster 2024-08-31T09:28:49.360613+0000 mgr.a (mgr.14388) 18919 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:50 smithi191 bash[24992]: cluster 2024-08-31T09:28:49.360613+0000 mgr.a (mgr.14388) 18919 : cluster [DBG] pgmap v13117: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:51.111 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:28:51.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:28:51.112 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:28:51.873 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:28:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:28:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:28:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:28:51.873 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:52 smithi163 bash[24253]: cluster 2024-08-31T09:28:51.361349+0000 mgr.a (mgr.14388) 18920 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:52 smithi163 bash[24253]: audit 2024-08-31T09:28:51.450807+0000 mgr.a (mgr.14388) 18921 : audit [DBG] from='client.406500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:52 smithi027 bash[22610]: cluster 2024-08-31T09:28:51.361349+0000 mgr.a (mgr.14388) 18920 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:52 smithi027 bash[22610]: audit 2024-08-31T09:28:51.450807+0000 mgr.a (mgr.14388) 18921 : audit [DBG] from='client.406500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:52 smithi191 bash[24992]: cluster 2024-08-31T09:28:51.361349+0000 mgr.a (mgr.14388) 18920 : cluster [DBG] pgmap v13118: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:52 smithi191 bash[24992]: audit 2024-08-31T09:28:51.450807+0000 mgr.a (mgr.14388) 18921 : audit [DBG] from='client.406500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:54.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:54 smithi163 bash[24253]: cluster 2024-08-31T09:28:53.363613+0000 mgr.a (mgr.14388) 18922 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:54.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:54 smithi027 bash[22610]: cluster 2024-08-31T09:28:53.363613+0000 mgr.a (mgr.14388) 18922 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:54.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:54 smithi191 bash[24992]: cluster 2024-08-31T09:28:53.363613+0000 mgr.a (mgr.14388) 18922 : cluster [DBG] pgmap v13119: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:28:56.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:56 smithi027 bash[22610]: cluster 2024-08-31T09:28:55.364376+0000 mgr.a (mgr.14388) 18923 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:56.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:56 smithi191 bash[24992]: cluster 2024-08-31T09:28:55.364376+0000 mgr.a (mgr.14388) 18923 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:56.874 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:28:56.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:28:56.875 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:28:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:56 smithi163 bash[24253]: cluster 2024-08-31T09:28:55.364376+0000 mgr.a (mgr.14388) 18923 : cluster [DBG] pgmap v13120: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:57.637 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:28:57.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:28:57.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:28:57.637 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:28:57.638 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:28:57.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:57 smithi027 bash[22610]: audit 2024-08-31T09:28:57.230549+0000 mon.a (mon.0) 3399 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:28:57.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:57 smithi191 bash[24992]: audit 2024-08-31T09:28:57.230549+0000 mon.a (mon.0) 3399 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:28:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:57 smithi163 bash[24253]: audit 2024-08-31T09:28:57.230549+0000 mon.a (mon.0) 3399 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:28:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:58 smithi027 bash[22610]: audit 2024-08-31T09:28:57.206546+0000 mgr.a (mgr.14388) 18924 : audit [DBG] from='client.406578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:58 smithi027 bash[22610]: cluster 2024-08-31T09:28:57.365021+0000 mgr.a (mgr.14388) 18925 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:58 smithi027 bash[22610]: audit 2024-08-31T09:28:58.027381+0000 mon.a (mon.0) 3400 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:28:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:58 smithi027 bash[22610]: audit 2024-08-31T09:28:58.029187+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:28:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:58 smithi027 bash[22610]: audit 2024-08-31T09:28:58.039750+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:28:58.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:58 smithi027 bash[22610]: audit 2024-08-31T09:28:58.044986+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:28:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:58 smithi191 bash[24992]: audit 2024-08-31T09:28:57.206546+0000 mgr.a (mgr.14388) 18924 : audit [DBG] from='client.406578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:58 smithi191 bash[24992]: cluster 2024-08-31T09:28:57.365021+0000 mgr.a (mgr.14388) 18925 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:58 smithi191 bash[24992]: audit 2024-08-31T09:28:58.027381+0000 mon.a (mon.0) 3400 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:28:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:58 smithi191 bash[24992]: audit 2024-08-31T09:28:58.029187+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:28:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:58 smithi191 bash[24992]: audit 2024-08-31T09:28:58.039750+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:28:58.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:58 smithi191 bash[24992]: audit 2024-08-31T09:28:58.044986+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:28:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:58 smithi163 bash[24253]: audit 2024-08-31T09:28:57.206546+0000 mgr.a (mgr.14388) 18924 : audit [DBG] from='client.406578 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:28:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:58 smithi163 bash[24253]: cluster 2024-08-31T09:28:57.365021+0000 mgr.a (mgr.14388) 18925 : cluster [DBG] pgmap v13121: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:28:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:58 smithi163 bash[24253]: audit 2024-08-31T09:28:58.027381+0000 mon.a (mon.0) 3400 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:28:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:58 smithi163 bash[24253]: audit 2024-08-31T09:28:58.029187+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:28:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:58 smithi163 bash[24253]: audit 2024-08-31T09:28:58.039750+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:28:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:58 smithi163 bash[24253]: audit 2024-08-31T09:28:58.044986+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:28:59.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:28:58 smithi027 bash[22863]: debug 2024-08-31T09:28:58.766+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:28:59.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:28:58 smithi027 bash[22863]: debug 2024-08-31T09:28:58.770+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:28:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:59 smithi027 bash[22610]: audit 2024-08-31T09:28:58.047533+0000 mgr.a (mgr.14388) 18926 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:28:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:59 smithi027 bash[22610]: audit 2024-08-31T09:28:58.769766+0000 mgr.a (mgr.14388) 18927 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:28:59.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:28:59 smithi027 bash[22610]: cephadm 2024-08-31T09:28:58.771076+0000 mgr.a (mgr.14388) 18928 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:28:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:59 smithi191 bash[24992]: audit 2024-08-31T09:28:58.047533+0000 mgr.a (mgr.14388) 18926 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:28:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:59 smithi191 bash[24992]: audit 2024-08-31T09:28:58.769766+0000 mgr.a (mgr.14388) 18927 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:28:59.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:28:59 smithi191 bash[24992]: cephadm 2024-08-31T09:28:58.771076+0000 mgr.a (mgr.14388) 18928 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:28:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:59 smithi163 bash[24253]: audit 2024-08-31T09:28:58.047533+0000 mgr.a (mgr.14388) 18926 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:28:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:59 smithi163 bash[24253]: audit 2024-08-31T09:28:58.769766+0000 mgr.a (mgr.14388) 18927 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:28:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:28:59 smithi163 bash[24253]: cephadm 2024-08-31T09:28:58.771076+0000 mgr.a (mgr.14388) 18928 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:29:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:00 smithi027 bash[22610]: cluster 2024-08-31T09:28:59.367722+0000 mgr.a (mgr.14388) 18929 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:00.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:00 smithi191 bash[24992]: cluster 2024-08-31T09:28:59.367722+0000 mgr.a (mgr.14388) 18929 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:00 smithi163 bash[24253]: cluster 2024-08-31T09:28:59.367722+0000 mgr.a (mgr.14388) 18929 : cluster [DBG] pgmap v13122: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:02.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:29:02.639 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:29:02.639 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:29:02.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:02 smithi027 bash[22610]: cluster 2024-08-31T09:29:01.368483+0000 mgr.a (mgr.14388) 18930 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:02.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:02 smithi191 bash[24992]: cluster 2024-08-31T09:29:01.368483+0000 mgr.a (mgr.14388) 18930 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:02 smithi163 bash[24253]: cluster 2024-08-31T09:29:01.368483+0000 mgr.a (mgr.14388) 18930 : cluster [DBG] pgmap v13123: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:03.418 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:29:03.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:29:03.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:29:03.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:29:03.418 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:29:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:04 smithi027 bash[22610]: audit 2024-08-31T09:29:02.978813+0000 mgr.a (mgr.14388) 18931 : audit [DBG] from='client.406764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:04.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:04 smithi027 bash[22610]: cluster 2024-08-31T09:29:03.369784+0000 mgr.a (mgr.14388) 18932 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:29:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:04 smithi191 bash[24992]: audit 2024-08-31T09:29:02.978813+0000 mgr.a (mgr.14388) 18931 : audit [DBG] from='client.406764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:04 smithi191 bash[24992]: cluster 2024-08-31T09:29:03.369784+0000 mgr.a (mgr.14388) 18932 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:29:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:04 smithi163 bash[24253]: audit 2024-08-31T09:29:02.978813+0000 mgr.a (mgr.14388) 18931 : audit [DBG] from='client.406764 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:04 smithi163 bash[24253]: cluster 2024-08-31T09:29:03.369784+0000 mgr.a (mgr.14388) 18932 : cluster [DBG] pgmap v13124: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:29:06.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:06 smithi191 bash[24992]: cluster 2024-08-31T09:29:05.370521+0000 mgr.a (mgr.14388) 18933 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:29:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:06 smithi163 bash[24253]: cluster 2024-08-31T09:29:05.370521+0000 mgr.a (mgr.14388) 18933 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:29:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:06 smithi027 bash[22610]: cluster 2024-08-31T09:29:05.370521+0000 mgr.a (mgr.14388) 18933 : cluster [DBG] pgmap v13125: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:29:08.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:29:08.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:29:08.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:29:08.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:08 smithi191 bash[24992]: cluster 2024-08-31T09:29:07.371274+0000 mgr.a (mgr.14388) 18934 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:29:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:08 smithi163 bash[24253]: cluster 2024-08-31T09:29:07.371274+0000 mgr.a (mgr.14388) 18934 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:29:08.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:08 smithi027 bash[22610]: cluster 2024-08-31T09:29:07.371274+0000 mgr.a (mgr.14388) 18934 : cluster [DBG] pgmap v13126: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:29:09.187 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:29:09.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:29:09.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:29:09.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:29:09.187 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:29:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:09 smithi191 bash[24992]: audit 2024-08-31T09:29:08.756066+0000 mgr.a (mgr.14388) 18935 : audit [DBG] from='client.406842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:09 smithi163 bash[24253]: audit 2024-08-31T09:29:08.756066+0000 mgr.a (mgr.14388) 18935 : audit [DBG] from='client.406842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:09 smithi027 bash[22610]: audit 2024-08-31T09:29:08.756066+0000 mgr.a (mgr.14388) 18935 : audit [DBG] from='client.406842 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:10 smithi191 bash[24992]: cluster 2024-08-31T09:29:09.374076+0000 mgr.a (mgr.14388) 18936 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:29:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:10 smithi163 bash[24253]: cluster 2024-08-31T09:29:09.374076+0000 mgr.a (mgr.14388) 18936 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:29:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:10 smithi027 bash[22610]: cluster 2024-08-31T09:29:09.374076+0000 mgr.a (mgr.14388) 18936 : cluster [DBG] pgmap v13127: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:29:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:12 smithi163 bash[24253]: cluster 2024-08-31T09:29:11.374868+0000 mgr.a (mgr.14388) 18937 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:29:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:12 smithi027 bash[22610]: cluster 2024-08-31T09:29:11.374868+0000 mgr.a (mgr.14388) 18937 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:29:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:12 smithi191 bash[24992]: cluster 2024-08-31T09:29:11.374868+0000 mgr.a (mgr.14388) 18937 : cluster [DBG] pgmap v13128: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:29:14.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:29:14.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:29:14.189 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:29:14.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:14 smithi163 bash[24253]: cluster 2024-08-31T09:29:13.376742+0000 mgr.a (mgr.14388) 18938 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:29:14.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:14 smithi027 bash[22610]: cluster 2024-08-31T09:29:13.376742+0000 mgr.a (mgr.14388) 18938 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:29:14.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:14 smithi191 bash[24992]: cluster 2024-08-31T09:29:13.376742+0000 mgr.a (mgr.14388) 18938 : cluster [DBG] pgmap v13129: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:29:14.983 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:29:14.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:29:14.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:29:14.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:29:14.984 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:29:15.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:15 smithi163 bash[24253]: audit 2024-08-31T09:29:14.528933+0000 mgr.a (mgr.14388) 18939 : audit [DBG] from='client.406920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:15 smithi027 bash[22610]: audit 2024-08-31T09:29:14.528933+0000 mgr.a (mgr.14388) 18939 : audit [DBG] from='client.406920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:15 smithi191 bash[24992]: audit 2024-08-31T09:29:14.528933+0000 mgr.a (mgr.14388) 18939 : audit [DBG] from='client.406920 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:16.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:16 smithi163 bash[24253]: cluster 2024-08-31T09:29:15.377708+0000 mgr.a (mgr.14388) 18940 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:16 smithi027 bash[22610]: cluster 2024-08-31T09:29:15.377708+0000 mgr.a (mgr.14388) 18940 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:16 smithi191 bash[24992]: cluster 2024-08-31T09:29:15.377708+0000 mgr.a (mgr.14388) 18940 : cluster [DBG] pgmap v13130: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:18.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:18 smithi027 bash[22610]: cluster 2024-08-31T09:29:17.378505+0000 mgr.a (mgr.14388) 18941 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:18.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:18 smithi191 bash[24992]: cluster 2024-08-31T09:29:17.378505+0000 mgr.a (mgr.14388) 18941 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:18 smithi163 bash[24253]: cluster 2024-08-31T09:29:17.378505+0000 mgr.a (mgr.14388) 18941 : cluster [DBG] pgmap v13131: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:19.985 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:29:19.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:29:19.986 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:29:20.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:20 smithi027 bash[22610]: cluster 2024-08-31T09:29:19.380706+0000 mgr.a (mgr.14388) 18942 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:20.764 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:29:20.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:29:20.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:29:20.764 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:29:20.765 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:29:20.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:20 smithi191 bash[24992]: cluster 2024-08-31T09:29:19.380706+0000 mgr.a (mgr.14388) 18942 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:20 smithi163 bash[24253]: cluster 2024-08-31T09:29:19.380706+0000 mgr.a (mgr.14388) 18942 : cluster [DBG] pgmap v13132: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:21.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:21 smithi027 bash[22610]: audit 2024-08-31T09:29:20.321768+0000 mgr.a (mgr.14388) 18943 : audit [DBG] from='client.406992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:21.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:21 smithi191 bash[24992]: audit 2024-08-31T09:29:20.321768+0000 mgr.a (mgr.14388) 18943 : audit [DBG] from='client.406992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:21 smithi163 bash[24253]: audit 2024-08-31T09:29:20.321768+0000 mgr.a (mgr.14388) 18943 : audit [DBG] from='client.406992 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:22.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:22 smithi027 bash[22610]: cluster 2024-08-31T09:29:21.381601+0000 mgr.a (mgr.14388) 18944 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:22.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:22 smithi191 bash[24992]: cluster 2024-08-31T09:29:21.381601+0000 mgr.a (mgr.14388) 18944 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:22 smithi163 bash[24253]: cluster 2024-08-31T09:29:21.381601+0000 mgr.a (mgr.14388) 18944 : cluster [DBG] pgmap v13133: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:24.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:24 smithi027 bash[22610]: cluster 2024-08-31T09:29:23.383741+0000 mgr.a (mgr.14388) 18945 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:24.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:24 smithi191 bash[24992]: cluster 2024-08-31T09:29:23.383741+0000 mgr.a (mgr.14388) 18945 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:24 smithi163 bash[24253]: cluster 2024-08-31T09:29:23.383741+0000 mgr.a (mgr.14388) 18945 : cluster [DBG] pgmap v13134: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:25.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:29:25.767 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:29:25.767 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:29:26.516 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:29:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:29:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:29:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:29:26.517 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:29:26.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:26 smithi027 bash[22610]: cluster 2024-08-31T09:29:25.384501+0000 mgr.a (mgr.14388) 18946 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:26.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:26 smithi191 bash[24992]: cluster 2024-08-31T09:29:25.384501+0000 mgr.a (mgr.14388) 18946 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:26 smithi163 bash[24253]: cluster 2024-08-31T09:29:25.384501+0000 mgr.a (mgr.14388) 18946 : cluster [DBG] pgmap v13135: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:27 smithi191 bash[24992]: audit 2024-08-31T09:29:26.099118+0000 mgr.a (mgr.14388) 18947 : audit [DBG] from='client.407067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:27 smithi163 bash[24253]: audit 2024-08-31T09:29:26.099118+0000 mgr.a (mgr.14388) 18947 : audit [DBG] from='client.407067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:27 smithi027 bash[22610]: audit 2024-08-31T09:29:26.099118+0000 mgr.a (mgr.14388) 18947 : audit [DBG] from='client.407067 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:28 smithi191 bash[24992]: cluster 2024-08-31T09:29:27.385558+0000 mgr.a (mgr.14388) 18948 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:28 smithi163 bash[24253]: cluster 2024-08-31T09:29:27.385558+0000 mgr.a (mgr.14388) 18948 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:28 smithi027 bash[22610]: cluster 2024-08-31T09:29:27.385558+0000 mgr.a (mgr.14388) 18948 : cluster [DBG] pgmap v13136: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:30.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:30 smithi191 bash[24992]: cluster 2024-08-31T09:29:29.387827+0000 mgr.a (mgr.14388) 18949 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:30 smithi163 bash[24253]: cluster 2024-08-31T09:29:29.387827+0000 mgr.a (mgr.14388) 18949 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:30 smithi027 bash[22610]: cluster 2024-08-31T09:29:29.387827+0000 mgr.a (mgr.14388) 18949 : cluster [DBG] pgmap v13137: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:31.518 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:29:31.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:29:31.519 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:29:32.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:29:32.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:29:32.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:29:32.307 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:29:32.308 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:29:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:32 smithi191 bash[24992]: cluster 2024-08-31T09:29:31.388565+0000 mgr.a (mgr.14388) 18950 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:32.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:32 smithi191 bash[24992]: audit 2024-08-31T09:29:31.862105+0000 mgr.a (mgr.14388) 18951 : audit [DBG] from='client.407142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:32 smithi163 bash[24253]: cluster 2024-08-31T09:29:31.388565+0000 mgr.a (mgr.14388) 18950 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:32 smithi163 bash[24253]: audit 2024-08-31T09:29:31.862105+0000 mgr.a (mgr.14388) 18951 : audit [DBG] from='client.407142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:32 smithi027 bash[22610]: cluster 2024-08-31T09:29:31.388565+0000 mgr.a (mgr.14388) 18950 : cluster [DBG] pgmap v13138: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:32 smithi027 bash[22610]: audit 2024-08-31T09:29:31.862105+0000 mgr.a (mgr.14388) 18951 : audit [DBG] from='client.407142 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:34 smithi191 bash[24992]: cluster 2024-08-31T09:29:33.390840+0000 mgr.a (mgr.14388) 18952 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:34 smithi163 bash[24253]: cluster 2024-08-31T09:29:33.390840+0000 mgr.a (mgr.14388) 18952 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:34 smithi027 bash[22610]: cluster 2024-08-31T09:29:33.390840+0000 mgr.a (mgr.14388) 18952 : cluster [DBG] pgmap v13139: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:29:36.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:36 smithi191 bash[24992]: cluster 2024-08-31T09:29:35.391618+0000 mgr.a (mgr.14388) 18953 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:36 smithi163 bash[24253]: cluster 2024-08-31T09:29:35.391618+0000 mgr.a (mgr.14388) 18953 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:36 smithi027 bash[22610]: cluster 2024-08-31T09:29:35.391618+0000 mgr.a (mgr.14388) 18953 : cluster [DBG] pgmap v13140: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:37.309 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:29:37.310 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:29:37.310 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:29:38.062 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:29:38.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:29:38.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:29:38.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:29:38.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:29:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:38 smithi191 bash[24992]: cluster 2024-08-31T09:29:37.392232+0000 mgr.a (mgr.14388) 18954 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:38 smithi191 bash[24992]: audit 2024-08-31T09:29:37.639629+0000 mgr.a (mgr.14388) 18955 : audit [DBG] from='client.407214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:38 smithi163 bash[24253]: cluster 2024-08-31T09:29:37.392232+0000 mgr.a (mgr.14388) 18954 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:38 smithi163 bash[24253]: audit 2024-08-31T09:29:37.639629+0000 mgr.a (mgr.14388) 18955 : audit [DBG] from='client.407214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:38 smithi027 bash[22610]: cluster 2024-08-31T09:29:37.392232+0000 mgr.a (mgr.14388) 18954 : cluster [DBG] pgmap v13141: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:38 smithi027 bash[22610]: audit 2024-08-31T09:29:37.639629+0000 mgr.a (mgr.14388) 18955 : audit [DBG] from='client.407214 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:40.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:40 smithi191 bash[24992]: cluster 2024-08-31T09:29:39.394599+0000 mgr.a (mgr.14388) 18956 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:29:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:40 smithi163 bash[24253]: cluster 2024-08-31T09:29:39.394599+0000 mgr.a (mgr.14388) 18956 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:29:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:40 smithi027 bash[22610]: cluster 2024-08-31T09:29:39.394599+0000 mgr.a (mgr.14388) 18956 : cluster [DBG] pgmap v13142: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:29:42.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:42 smithi191 bash[24992]: cluster 2024-08-31T09:29:41.395359+0000 mgr.a (mgr.14388) 18957 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:29:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:42 smithi163 bash[24253]: cluster 2024-08-31T09:29:41.395359+0000 mgr.a (mgr.14388) 18957 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:29:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:42 smithi027 bash[22610]: cluster 2024-08-31T09:29:41.395359+0000 mgr.a (mgr.14388) 18957 : cluster [DBG] pgmap v13143: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:29:43.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:29:43.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:29:43.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:29:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:29:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:29:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:29:43.814 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:29:43.814 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:29:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:44 smithi191 bash[24992]: cluster 2024-08-31T09:29:43.397267+0000 mgr.a (mgr.14388) 18958 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:44 smithi191 bash[24992]: audit 2024-08-31T09:29:43.398811+0000 mgr.a (mgr.14388) 18959 : audit [DBG] from='client.407292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:44 smithi163 bash[24253]: cluster 2024-08-31T09:29:43.397267+0000 mgr.a (mgr.14388) 18958 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:44 smithi163 bash[24253]: audit 2024-08-31T09:29:43.398811+0000 mgr.a (mgr.14388) 18959 : audit [DBG] from='client.407292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:44 smithi027 bash[22610]: cluster 2024-08-31T09:29:43.397267+0000 mgr.a (mgr.14388) 18958 : cluster [DBG] pgmap v13144: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:44 smithi027 bash[22610]: audit 2024-08-31T09:29:43.398811+0000 mgr.a (mgr.14388) 18959 : audit [DBG] from='client.407292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:46.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:46 smithi191 bash[24992]: cluster 2024-08-31T09:29:45.398162+0000 mgr.a (mgr.14388) 18960 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:29:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:46 smithi163 bash[24253]: cluster 2024-08-31T09:29:45.398162+0000 mgr.a (mgr.14388) 18960 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:29:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:46 smithi027 bash[22610]: cluster 2024-08-31T09:29:45.398162+0000 mgr.a (mgr.14388) 18960 : cluster [DBG] pgmap v13145: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:29:48.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:48 smithi191 bash[24992]: cluster 2024-08-31T09:29:47.399089+0000 mgr.a (mgr.14388) 18961 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:29:48.815 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:29:48.816 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:29:48.816 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:29:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:48 smithi163 bash[24253]: cluster 2024-08-31T09:29:47.399089+0000 mgr.a (mgr.14388) 18961 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:29:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:48 smithi027 bash[22610]: cluster 2024-08-31T09:29:47.399089+0000 mgr.a (mgr.14388) 18961 : cluster [DBG] pgmap v13146: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:29:49.565 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:29:49.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:29:49.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:29:49.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:29:49.565 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:29:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:50 smithi191 bash[24992]: audit 2024-08-31T09:29:49.141205+0000 mgr.a (mgr.14388) 18962 : audit [DBG] from='client.407370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:50.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:50 smithi191 bash[24992]: cluster 2024-08-31T09:29:49.400437+0000 mgr.a (mgr.14388) 18963 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:50 smithi163 bash[24253]: audit 2024-08-31T09:29:49.141205+0000 mgr.a (mgr.14388) 18962 : audit [DBG] from='client.407370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:50 smithi163 bash[24253]: cluster 2024-08-31T09:29:49.400437+0000 mgr.a (mgr.14388) 18963 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:50 smithi027 bash[22610]: audit 2024-08-31T09:29:49.141205+0000 mgr.a (mgr.14388) 18962 : audit [DBG] from='client.407370 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:50 smithi027 bash[22610]: cluster 2024-08-31T09:29:49.400437+0000 mgr.a (mgr.14388) 18963 : cluster [DBG] pgmap v13147: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:52 smithi191 bash[24992]: cluster 2024-08-31T09:29:51.401444+0000 mgr.a (mgr.14388) 18964 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:29:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:52 smithi163 bash[24253]: cluster 2024-08-31T09:29:51.401444+0000 mgr.a (mgr.14388) 18964 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:29:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:52 smithi027 bash[22610]: cluster 2024-08-31T09:29:51.401444+0000 mgr.a (mgr.14388) 18964 : cluster [DBG] pgmap v13148: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:29:54.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:29:54.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:29:54.567 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:29:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:54 smithi163 bash[24253]: cluster 2024-08-31T09:29:53.403791+0000 mgr.a (mgr.14388) 18965 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:29:54.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:54 smithi027 bash[22610]: cluster 2024-08-31T09:29:53.403791+0000 mgr.a (mgr.14388) 18965 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:29:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:54 smithi191 bash[24992]: cluster 2024-08-31T09:29:53.403791+0000 mgr.a (mgr.14388) 18965 : cluster [DBG] pgmap v13149: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:29:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:29:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:29:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:29:55.325 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:29:55.325 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:29:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:56 smithi163 bash[24253]: audit 2024-08-31T09:29:54.907995+0000 mgr.a (mgr.14388) 18966 : audit [DBG] from='client.407445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:56 smithi163 bash[24253]: cluster 2024-08-31T09:29:55.404769+0000 mgr.a (mgr.14388) 18967 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:56 smithi027 bash[22610]: audit 2024-08-31T09:29:54.907995+0000 mgr.a (mgr.14388) 18966 : audit [DBG] from='client.407445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:56 smithi027 bash[22610]: cluster 2024-08-31T09:29:55.404769+0000 mgr.a (mgr.14388) 18967 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:56 smithi191 bash[24992]: audit 2024-08-31T09:29:54.907995+0000 mgr.a (mgr.14388) 18966 : audit [DBG] from='client.407445 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:29:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:56 smithi191 bash[24992]: cluster 2024-08-31T09:29:55.404769+0000 mgr.a (mgr.14388) 18967 : cluster [DBG] pgmap v13150: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:58 smithi163 bash[24253]: cluster 2024-08-31T09:29:57.405577+0000 mgr.a (mgr.14388) 18968 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:58.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:58 smithi027 bash[22610]: cluster 2024-08-31T09:29:57.405577+0000 mgr.a (mgr.14388) 18968 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:58 smithi191 bash[24992]: cluster 2024-08-31T09:29:57.405577+0000 mgr.a (mgr.14388) 18968 : cluster [DBG] pgmap v13151: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:29:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:29:59 smithi163 bash[24253]: audit 2024-08-31T09:29:58.822820+0000 mon.a (mon.0) 3404 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:29:59.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:29:59 smithi027 bash[22610]: audit 2024-08-31T09:29:58.822820+0000 mon.a (mon.0) 3404 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:30:00.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:29:59 smithi191 bash[24992]: audit 2024-08-31T09:29:58.822820+0000 mon.a (mon.0) 3404 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:30:00.326 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:00.326 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:00.327 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:00.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:30:00 smithi027 bash[22863]: debug 2024-08-31T09:30:00.420+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:30:00.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:30:00 smithi027 bash[22863]: debug 2024-08-31T09:30:00.424+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:30:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:00 smithi027 bash[22610]: cluster 2024-08-31T09:29:59.407006+0000 mgr.a (mgr.14388) 18969 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:00 smithi027 bash[22610]: audit 2024-08-31T09:29:59.662221+0000 mon.a (mon.0) 3405 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:30:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:00 smithi027 bash[22610]: audit 2024-08-31T09:29:59.663735+0000 mon.a (mon.0) 3406 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:30:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:00 smithi027 bash[22610]: audit 2024-08-31T09:29:59.675513+0000 mon.a (mon.0) 3407 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:30:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:00 smithi027 bash[22610]: audit 2024-08-31T09:29:59.680909+0000 mon.a (mon.0) 3408 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:30:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:00 smithi027 bash[22610]: audit 2024-08-31T09:29:59.683259+0000 mgr.a (mgr.14388) 18970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:30:00.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:00 smithi027 bash[22610]: cluster 2024-08-31T09:30:00.000078+0000 mon.a (mon.0) 3409 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:30:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:00 smithi163 bash[24253]: cluster 2024-08-31T09:29:59.407006+0000 mgr.a (mgr.14388) 18969 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:00 smithi163 bash[24253]: audit 2024-08-31T09:29:59.662221+0000 mon.a (mon.0) 3405 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:30:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:00 smithi163 bash[24253]: audit 2024-08-31T09:29:59.663735+0000 mon.a (mon.0) 3406 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:30:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:00 smithi163 bash[24253]: audit 2024-08-31T09:29:59.675513+0000 mon.a (mon.0) 3407 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:30:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:00 smithi163 bash[24253]: audit 2024-08-31T09:29:59.680909+0000 mon.a (mon.0) 3408 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:30:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:00 smithi163 bash[24253]: audit 2024-08-31T09:29:59.683259+0000 mgr.a (mgr.14388) 18970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:30:00.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:00 smithi163 bash[24253]: cluster 2024-08-31T09:30:00.000078+0000 mon.a (mon.0) 3409 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:30:01.036 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:01.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:01.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:01.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:01.037 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:00 smithi191 bash[24992]: cluster 2024-08-31T09:29:59.407006+0000 mgr.a (mgr.14388) 18969 : cluster [DBG] pgmap v13152: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:00 smithi191 bash[24992]: audit 2024-08-31T09:29:59.662221+0000 mon.a (mon.0) 3405 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:30:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:00 smithi191 bash[24992]: audit 2024-08-31T09:29:59.663735+0000 mon.a (mon.0) 3406 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:30:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:00 smithi191 bash[24992]: audit 2024-08-31T09:29:59.675513+0000 mon.a (mon.0) 3407 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:30:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:00 smithi191 bash[24992]: audit 2024-08-31T09:29:59.680909+0000 mon.a (mon.0) 3408 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:30:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:00 smithi191 bash[24992]: audit 2024-08-31T09:29:59.683259+0000 mgr.a (mgr.14388) 18970 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:30:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:00 smithi191 bash[24992]: cluster 2024-08-31T09:30:00.000078+0000 mon.a (mon.0) 3409 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:30:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:01 smithi163 bash[24253]: audit 2024-08-31T09:30:00.425722+0000 mgr.a (mgr.14388) 18971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:30:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:01 smithi163 bash[24253]: cephadm 2024-08-31T09:30:00.427004+0000 mgr.a (mgr.14388) 18972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:30:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:01 smithi163 bash[24253]: audit 2024-08-31T09:30:00.633507+0000 mgr.a (mgr.14388) 18973 : audit [DBG] from='client.407628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:01 smithi027 bash[22610]: audit 2024-08-31T09:30:00.425722+0000 mgr.a (mgr.14388) 18971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:30:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:01 smithi027 bash[22610]: cephadm 2024-08-31T09:30:00.427004+0000 mgr.a (mgr.14388) 18972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:30:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:01 smithi027 bash[22610]: audit 2024-08-31T09:30:00.633507+0000 mgr.a (mgr.14388) 18973 : audit [DBG] from='client.407628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:01 smithi191 bash[24992]: audit 2024-08-31T09:30:00.425722+0000 mgr.a (mgr.14388) 18971 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:30:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:01 smithi191 bash[24992]: cephadm 2024-08-31T09:30:00.427004+0000 mgr.a (mgr.14388) 18972 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:30:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:01 smithi191 bash[24992]: audit 2024-08-31T09:30:00.633507+0000 mgr.a (mgr.14388) 18973 : audit [DBG] from='client.407628 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:02 smithi163 bash[24253]: cluster 2024-08-31T09:30:01.407795+0000 mgr.a (mgr.14388) 18974 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:02 smithi027 bash[22610]: cluster 2024-08-31T09:30:01.407795+0000 mgr.a (mgr.14388) 18974 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:02 smithi191 bash[24992]: cluster 2024-08-31T09:30:01.407795+0000 mgr.a (mgr.14388) 18974 : cluster [DBG] pgmap v13153: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:04 smithi163 bash[24253]: cluster 2024-08-31T09:30:03.409935+0000 mgr.a (mgr.14388) 18975 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:04 smithi027 bash[22610]: cluster 2024-08-31T09:30:03.409935+0000 mgr.a (mgr.14388) 18975 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:04 smithi191 bash[24992]: cluster 2024-08-31T09:30:03.409935+0000 mgr.a (mgr.14388) 18975 : cluster [DBG] pgmap v13154: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:06.039 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:06.040 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:06.819 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:06.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:06.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:06.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:06.819 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:06 smithi163 bash[24253]: cluster 2024-08-31T09:30:05.410690+0000 mgr.a (mgr.14388) 18976 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:06.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:06 smithi027 bash[22610]: cluster 2024-08-31T09:30:05.410690+0000 mgr.a (mgr.14388) 18976 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:06 smithi191 bash[24992]: cluster 2024-08-31T09:30:05.410690+0000 mgr.a (mgr.14388) 18976 : cluster [DBG] pgmap v13155: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:07 smithi163 bash[24253]: audit 2024-08-31T09:30:06.375392+0000 mgr.a (mgr.14388) 18977 : audit [DBG] from='client.407703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:07 smithi027 bash[22610]: audit 2024-08-31T09:30:06.375392+0000 mgr.a (mgr.14388) 18977 : audit [DBG] from='client.407703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:08.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:07 smithi191 bash[24992]: audit 2024-08-31T09:30:06.375392+0000 mgr.a (mgr.14388) 18977 : audit [DBG] from='client.407703 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:08 smithi163 bash[24253]: cluster 2024-08-31T09:30:07.411579+0000 mgr.a (mgr.14388) 18978 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:08 smithi027 bash[22610]: cluster 2024-08-31T09:30:07.411579+0000 mgr.a (mgr.14388) 18978 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:09.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:08 smithi191 bash[24992]: cluster 2024-08-31T09:30:07.411579+0000 mgr.a (mgr.14388) 18978 : cluster [DBG] pgmap v13156: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:10 smithi163 bash[24253]: cluster 2024-08-31T09:30:09.413815+0000 mgr.a (mgr.14388) 18979 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:10 smithi027 bash[22610]: cluster 2024-08-31T09:30:09.413815+0000 mgr.a (mgr.14388) 18979 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:10 smithi191 bash[24992]: cluster 2024-08-31T09:30:09.413815+0000 mgr.a (mgr.14388) 18979 : cluster [DBG] pgmap v13157: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:11.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:11.821 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:11.821 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:12.568 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:12.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:12.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:12.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:12.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:12 smithi163 bash[24253]: cluster 2024-08-31T09:30:11.414599+0000 mgr.a (mgr.14388) 18980 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:12 smithi027 bash[22610]: cluster 2024-08-31T09:30:11.414599+0000 mgr.a (mgr.14388) 18980 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:12 smithi191 bash[24992]: cluster 2024-08-31T09:30:11.414599+0000 mgr.a (mgr.14388) 18980 : cluster [DBG] pgmap v13158: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:13 smithi163 bash[24253]: audit 2024-08-31T09:30:12.154233+0000 mgr.a (mgr.14388) 18981 : audit [DBG] from='client.407781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:13 smithi027 bash[22610]: audit 2024-08-31T09:30:12.154233+0000 mgr.a (mgr.14388) 18981 : audit [DBG] from='client.407781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:13 smithi191 bash[24992]: audit 2024-08-31T09:30:12.154233+0000 mgr.a (mgr.14388) 18981 : audit [DBG] from='client.407781 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:14 smithi163 bash[24253]: cluster 2024-08-31T09:30:13.416837+0000 mgr.a (mgr.14388) 18982 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:14 smithi027 bash[22610]: cluster 2024-08-31T09:30:13.416837+0000 mgr.a (mgr.14388) 18982 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:14 smithi191 bash[24992]: cluster 2024-08-31T09:30:13.416837+0000 mgr.a (mgr.14388) 18982 : cluster [DBG] pgmap v13159: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:30:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:16 smithi163 bash[24253]: cluster 2024-08-31T09:30:15.417609+0000 mgr.a (mgr.14388) 18983 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:16 smithi027 bash[22610]: cluster 2024-08-31T09:30:15.417609+0000 mgr.a (mgr.14388) 18983 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:16 smithi191 bash[24992]: cluster 2024-08-31T09:30:15.417609+0000 mgr.a (mgr.14388) 18983 : cluster [DBG] pgmap v13160: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:17.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:17.570 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:17.571 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:18.352 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:18.353 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:18 smithi163 bash[24253]: cluster 2024-08-31T09:30:17.418357+0000 mgr.a (mgr.14388) 18984 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:18 smithi027 bash[22610]: cluster 2024-08-31T09:30:17.418357+0000 mgr.a (mgr.14388) 18984 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:18 smithi191 bash[24992]: cluster 2024-08-31T09:30:17.418357+0000 mgr.a (mgr.14388) 18984 : cluster [DBG] pgmap v13161: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:19 smithi163 bash[24253]: audit 2024-08-31T09:30:17.910822+0000 mgr.a (mgr.14388) 18985 : audit [DBG] from='client.407853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:19 smithi027 bash[22610]: audit 2024-08-31T09:30:17.910822+0000 mgr.a (mgr.14388) 18985 : audit [DBG] from='client.407853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:19 smithi191 bash[24992]: audit 2024-08-31T09:30:17.910822+0000 mgr.a (mgr.14388) 18985 : audit [DBG] from='client.407853 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:20 smithi163 bash[24253]: cluster 2024-08-31T09:30:19.421135+0000 mgr.a (mgr.14388) 18986 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:20.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:20 smithi027 bash[22610]: cluster 2024-08-31T09:30:19.421135+0000 mgr.a (mgr.14388) 18986 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:20 smithi191 bash[24992]: cluster 2024-08-31T09:30:19.421135+0000 mgr.a (mgr.14388) 18986 : cluster [DBG] pgmap v13162: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:22 smithi163 bash[24253]: cluster 2024-08-31T09:30:21.421901+0000 mgr.a (mgr.14388) 18987 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:30:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:22 smithi027 bash[22610]: cluster 2024-08-31T09:30:21.421901+0000 mgr.a (mgr.14388) 18987 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:30:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:22 smithi191 bash[24992]: cluster 2024-08-31T09:30:21.421901+0000 mgr.a (mgr.14388) 18987 : cluster [DBG] pgmap v13163: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:30:23.354 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:23.355 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:23.355 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:24.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:24.136 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:24 smithi163 bash[24253]: cluster 2024-08-31T09:30:23.423847+0000 mgr.a (mgr.14388) 18988 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:24 smithi163 bash[24253]: audit 2024-08-31T09:30:23.696394+0000 mgr.a (mgr.14388) 18989 : audit [DBG] from='client.407931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:24 smithi027 bash[22610]: cluster 2024-08-31T09:30:23.423847+0000 mgr.a (mgr.14388) 18988 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:24 smithi027 bash[22610]: audit 2024-08-31T09:30:23.696394+0000 mgr.a (mgr.14388) 18989 : audit [DBG] from='client.407931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:24 smithi191 bash[24992]: cluster 2024-08-31T09:30:23.423847+0000 mgr.a (mgr.14388) 18988 : cluster [DBG] pgmap v13164: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:24 smithi191 bash[24992]: audit 2024-08-31T09:30:23.696394+0000 mgr.a (mgr.14388) 18989 : audit [DBG] from='client.407931 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:26 smithi163 bash[24253]: cluster 2024-08-31T09:30:25.424759+0000 mgr.a (mgr.14388) 18990 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:30:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:26 smithi027 bash[22610]: cluster 2024-08-31T09:30:25.424759+0000 mgr.a (mgr.14388) 18990 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:30:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:26 smithi191 bash[24992]: cluster 2024-08-31T09:30:25.424759+0000 mgr.a (mgr.14388) 18990 : cluster [DBG] pgmap v13165: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:30:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:28 smithi163 bash[24253]: cluster 2024-08-31T09:30:27.425555+0000 mgr.a (mgr.14388) 18991 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:30:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:28 smithi027 bash[22610]: cluster 2024-08-31T09:30:27.425555+0000 mgr.a (mgr.14388) 18991 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:30:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:28 smithi191 bash[24992]: cluster 2024-08-31T09:30:27.425555+0000 mgr.a (mgr.14388) 18991 : cluster [DBG] pgmap v13166: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:30:29.137 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:29.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:29.138 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:29.923 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:29.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:29.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:29.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:29.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:30 smithi163 bash[24253]: cluster 2024-08-31T09:30:29.426922+0000 mgr.a (mgr.14388) 18992 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:30 smithi163 bash[24253]: audit 2024-08-31T09:30:29.478328+0000 mgr.a (mgr.14388) 18993 : audit [DBG] from='client.408009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:30 smithi027 bash[22610]: cluster 2024-08-31T09:30:29.426922+0000 mgr.a (mgr.14388) 18992 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:30 smithi027 bash[22610]: audit 2024-08-31T09:30:29.478328+0000 mgr.a (mgr.14388) 18993 : audit [DBG] from='client.408009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:30 smithi191 bash[24992]: cluster 2024-08-31T09:30:29.426922+0000 mgr.a (mgr.14388) 18992 : cluster [DBG] pgmap v13167: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:30 smithi191 bash[24992]: audit 2024-08-31T09:30:29.478328+0000 mgr.a (mgr.14388) 18993 : audit [DBG] from='client.408009 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:32 smithi163 bash[24253]: cluster 2024-08-31T09:30:31.427795+0000 mgr.a (mgr.14388) 18994 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:32.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:32 smithi027 bash[22610]: cluster 2024-08-31T09:30:31.427795+0000 mgr.a (mgr.14388) 18994 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:32 smithi191 bash[24992]: cluster 2024-08-31T09:30:31.427795+0000 mgr.a (mgr.14388) 18994 : cluster [DBG] pgmap v13168: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:34.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:34.926 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:34.926 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:34 smithi163 bash[24253]: cluster 2024-08-31T09:30:33.429965+0000 mgr.a (mgr.14388) 18995 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:34 smithi027 bash[22610]: cluster 2024-08-31T09:30:33.429965+0000 mgr.a (mgr.14388) 18995 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:34 smithi191 bash[24992]: cluster 2024-08-31T09:30:33.429965+0000 mgr.a (mgr.14388) 18995 : cluster [DBG] pgmap v13169: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:35.722 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:35.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:35.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:35.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:35.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:36 smithi163 bash[24253]: audit 2024-08-31T09:30:35.267049+0000 mgr.a (mgr.14388) 18996 : audit [DBG] from='client.408087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:36 smithi163 bash[24253]: cluster 2024-08-31T09:30:35.430597+0000 mgr.a (mgr.14388) 18997 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:36 smithi027 bash[22610]: audit 2024-08-31T09:30:35.267049+0000 mgr.a (mgr.14388) 18996 : audit [DBG] from='client.408087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:36 smithi027 bash[22610]: cluster 2024-08-31T09:30:35.430597+0000 mgr.a (mgr.14388) 18997 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:36 smithi191 bash[24992]: audit 2024-08-31T09:30:35.267049+0000 mgr.a (mgr.14388) 18996 : audit [DBG] from='client.408087 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:36 smithi191 bash[24992]: cluster 2024-08-31T09:30:35.430597+0000 mgr.a (mgr.14388) 18997 : cluster [DBG] pgmap v13170: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:38 smithi163 bash[24253]: cluster 2024-08-31T09:30:37.431718+0000 mgr.a (mgr.14388) 18998 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:38.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:38 smithi027 bash[22610]: cluster 2024-08-31T09:30:37.431718+0000 mgr.a (mgr.14388) 18998 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:39.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:38 smithi191 bash[24992]: cluster 2024-08-31T09:30:37.431718+0000 mgr.a (mgr.14388) 18998 : cluster [DBG] pgmap v13171: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:40.724 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:40.725 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:40.725 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:40 smithi163 bash[24253]: cluster 2024-08-31T09:30:39.434099+0000 mgr.a (mgr.14388) 18999 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:40 smithi027 bash[22610]: cluster 2024-08-31T09:30:39.434099+0000 mgr.a (mgr.14388) 18999 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:40 smithi191 bash[24992]: cluster 2024-08-31T09:30:39.434099+0000 mgr.a (mgr.14388) 18999 : cluster [DBG] pgmap v13172: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:41.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:41.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:41.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:41.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:41.493 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:42 smithi163 bash[24253]: audit 2024-08-31T09:30:41.056570+0000 mgr.a (mgr.14388) 19000 : audit [DBG] from='client.408165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:42 smithi163 bash[24253]: cluster 2024-08-31T09:30:41.434657+0000 mgr.a (mgr.14388) 19001 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:42 smithi027 bash[22610]: audit 2024-08-31T09:30:41.056570+0000 mgr.a (mgr.14388) 19000 : audit [DBG] from='client.408165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:42 smithi027 bash[22610]: cluster 2024-08-31T09:30:41.434657+0000 mgr.a (mgr.14388) 19001 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:42 smithi191 bash[24992]: audit 2024-08-31T09:30:41.056570+0000 mgr.a (mgr.14388) 19000 : audit [DBG] from='client.408165 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:42 smithi191 bash[24992]: cluster 2024-08-31T09:30:41.434657+0000 mgr.a (mgr.14388) 19001 : cluster [DBG] pgmap v13173: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:44 smithi163 bash[24253]: cluster 2024-08-31T09:30:43.436741+0000 mgr.a (mgr.14388) 19002 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:44 smithi027 bash[22610]: cluster 2024-08-31T09:30:43.436741+0000 mgr.a (mgr.14388) 19002 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:44 smithi191 bash[24992]: cluster 2024-08-31T09:30:43.436741+0000 mgr.a (mgr.14388) 19002 : cluster [DBG] pgmap v13174: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:46.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:46.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:46.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:46 smithi163 bash[24253]: cluster 2024-08-31T09:30:45.437535+0000 mgr.a (mgr.14388) 19003 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:46.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:46 smithi027 bash[22610]: cluster 2024-08-31T09:30:45.437535+0000 mgr.a (mgr.14388) 19003 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:46 smithi191 bash[24992]: cluster 2024-08-31T09:30:45.437535+0000 mgr.a (mgr.14388) 19003 : cluster [DBG] pgmap v13175: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:47.275 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:47.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:47.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:47.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:47.275 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:47 smithi163 bash[24253]: audit 2024-08-31T09:30:46.827876+0000 mgr.a (mgr.14388) 19004 : audit [DBG] from='client.408237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:47.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:47 smithi027 bash[22610]: audit 2024-08-31T09:30:46.827876+0000 mgr.a (mgr.14388) 19004 : audit [DBG] from='client.408237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:47 smithi191 bash[24992]: audit 2024-08-31T09:30:46.827876+0000 mgr.a (mgr.14388) 19004 : audit [DBG] from='client.408237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:48 smithi163 bash[24253]: cluster 2024-08-31T09:30:47.438505+0000 mgr.a (mgr.14388) 19005 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:48 smithi027 bash[22610]: cluster 2024-08-31T09:30:47.438505+0000 mgr.a (mgr.14388) 19005 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:48 smithi191 bash[24992]: cluster 2024-08-31T09:30:47.438505+0000 mgr.a (mgr.14388) 19005 : cluster [DBG] pgmap v13176: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:50 smithi027 bash[22610]: cluster 2024-08-31T09:30:49.440763+0000 mgr.a (mgr.14388) 19006 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:50 smithi191 bash[24992]: cluster 2024-08-31T09:30:49.440763+0000 mgr.a (mgr.14388) 19006 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:50 smithi163 bash[24253]: cluster 2024-08-31T09:30:49.440763+0000 mgr.a (mgr.14388) 19006 : cluster [DBG] pgmap v13177: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:30:52.277 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:52.277 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:52.278 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:52.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:52 smithi027 bash[22610]: cluster 2024-08-31T09:30:51.441542+0000 mgr.a (mgr.14388) 19007 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:53.036 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:53.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:53.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:53.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:53.036 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:52 smithi191 bash[24992]: cluster 2024-08-31T09:30:51.441542+0000 mgr.a (mgr.14388) 19007 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:52 smithi163 bash[24253]: cluster 2024-08-31T09:30:51.441542+0000 mgr.a (mgr.14388) 19007 : cluster [DBG] pgmap v13178: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:30:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:53 smithi027 bash[22610]: audit 2024-08-31T09:30:52.608935+0000 mgr.a (mgr.14388) 19008 : audit [DBG] from='client.408312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:53 smithi191 bash[24992]: audit 2024-08-31T09:30:52.608935+0000 mgr.a (mgr.14388) 19008 : audit [DBG] from='client.408312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:54.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:53 smithi163 bash[24253]: audit 2024-08-31T09:30:52.608935+0000 mgr.a (mgr.14388) 19008 : audit [DBG] from='client.408312 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:30:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:54 smithi027 bash[22610]: cluster 2024-08-31T09:30:53.444122+0000 mgr.a (mgr.14388) 19009 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:30:55.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:54 smithi191 bash[24992]: cluster 2024-08-31T09:30:53.444122+0000 mgr.a (mgr.14388) 19009 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:30:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:54 smithi163 bash[24253]: cluster 2024-08-31T09:30:53.444122+0000 mgr.a (mgr.14388) 19009 : cluster [DBG] pgmap v13179: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:30:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:56 smithi027 bash[22610]: cluster 2024-08-31T09:30:55.444985+0000 mgr.a (mgr.14388) 19010 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:30:57.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:56 smithi191 bash[24992]: cluster 2024-08-31T09:30:55.444985+0000 mgr.a (mgr.14388) 19010 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:30:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:56 smithi163 bash[24253]: cluster 2024-08-31T09:30:55.444985+0000 mgr.a (mgr.14388) 19010 : cluster [DBG] pgmap v13180: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:30:58.038 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:30:58.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:30:58.038 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:30:58.817 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:30:58.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:30:58.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:30:58.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:30:58.817 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:30:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:58 smithi027 bash[22610]: cluster 2024-08-31T09:30:57.445772+0000 mgr.a (mgr.14388) 19011 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:30:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:58 smithi191 bash[24992]: cluster 2024-08-31T09:30:57.445772+0000 mgr.a (mgr.14388) 19011 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:30:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:58 smithi163 bash[24253]: cluster 2024-08-31T09:30:57.445772+0000 mgr.a (mgr.14388) 19011 : cluster [DBG] pgmap v13181: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:31:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:30:59 smithi191 bash[24992]: audit 2024-08-31T09:30:58.375933+0000 mgr.a (mgr.14388) 19012 : audit [DBG] from='client.408387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:00.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:30:59 smithi163 bash[24253]: audit 2024-08-31T09:30:58.375933+0000 mgr.a (mgr.14388) 19012 : audit [DBG] from='client.408387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:30:59 smithi027 bash[22610]: audit 2024-08-31T09:30:58.375933+0000 mgr.a (mgr.14388) 19012 : audit [DBG] from='client.408387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:00 smithi191 bash[24992]: cluster 2024-08-31T09:30:59.448728+0000 mgr.a (mgr.14388) 19013 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:00 smithi191 bash[24992]: audit 2024-08-31T09:31:00.477461+0000 mon.a (mon.0) 3410 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:31:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:00 smithi163 bash[24253]: cluster 2024-08-31T09:30:59.448728+0000 mgr.a (mgr.14388) 19013 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:00 smithi163 bash[24253]: audit 2024-08-31T09:31:00.477461+0000 mon.a (mon.0) 3410 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:31:01.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:00 smithi027 bash[22610]: cluster 2024-08-31T09:30:59.448728+0000 mgr.a (mgr.14388) 19013 : cluster [DBG] pgmap v13182: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:00 smithi027 bash[22610]: audit 2024-08-31T09:31:00.477461+0000 mon.a (mon.0) 3410 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:31:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:01 smithi191 bash[24992]: audit 2024-08-31T09:31:01.326148+0000 mon.a (mon.0) 3411 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:31:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:01 smithi191 bash[24992]: audit 2024-08-31T09:31:01.327850+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:31:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:01 smithi191 bash[24992]: audit 2024-08-31T09:31:01.337974+0000 mon.a (mon.0) 3413 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:31:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:01 smithi191 bash[24992]: audit 2024-08-31T09:31:01.342766+0000 mon.a (mon.0) 3414 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:31:02.123 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:01 smithi027 bash[22610]: audit 2024-08-31T09:31:01.326148+0000 mon.a (mon.0) 3411 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:31:02.123 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:01 smithi027 bash[22610]: audit 2024-08-31T09:31:01.327850+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:31:02.123 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:01 smithi027 bash[22610]: audit 2024-08-31T09:31:01.337974+0000 mon.a (mon.0) 3413 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:31:02.123 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:01 smithi027 bash[22610]: audit 2024-08-31T09:31:01.342766+0000 mon.a (mon.0) 3414 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:31:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:01 smithi163 bash[24253]: audit 2024-08-31T09:31:01.326148+0000 mon.a (mon.0) 3411 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:31:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:01 smithi163 bash[24253]: audit 2024-08-31T09:31:01.327850+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:31:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:01 smithi163 bash[24253]: audit 2024-08-31T09:31:01.337974+0000 mon.a (mon.0) 3413 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:31:02.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:01 smithi163 bash[24253]: audit 2024-08-31T09:31:01.342766+0000 mon.a (mon.0) 3414 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:31:02.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:31:02 smithi027 bash[22863]: debug 2024-08-31T09:31:02.119+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:31:02.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:31:02 smithi027 bash[22863]: debug 2024-08-31T09:31:02.119+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:31:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:02 smithi191 bash[24992]: audit 2024-08-31T09:31:01.345196+0000 mgr.a (mgr.14388) 19014 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:31:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:02 smithi191 bash[24992]: cluster 2024-08-31T09:31:01.449361+0000 mgr.a (mgr.14388) 19015 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:31:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:02 smithi163 bash[24253]: audit 2024-08-31T09:31:01.345196+0000 mgr.a (mgr.14388) 19014 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:31:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:02 smithi163 bash[24253]: cluster 2024-08-31T09:31:01.449361+0000 mgr.a (mgr.14388) 19015 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:31:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:02 smithi027 bash[22610]: audit 2024-08-31T09:31:01.345196+0000 mgr.a (mgr.14388) 19014 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:31:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:02 smithi027 bash[22610]: cluster 2024-08-31T09:31:01.449361+0000 mgr.a (mgr.14388) 19015 : cluster [DBG] pgmap v13183: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:31:03.818 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:31:03.819 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:31:03.819 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:31:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:03 smithi191 bash[24992]: audit 2024-08-31T09:31:02.123548+0000 mgr.a (mgr.14388) 19016 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:31:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:03 smithi191 bash[24992]: cephadm 2024-08-31T09:31:02.124992+0000 mgr.a (mgr.14388) 19017 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:31:04.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:03 smithi163 bash[24253]: audit 2024-08-31T09:31:02.123548+0000 mgr.a (mgr.14388) 19016 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:31:04.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:03 smithi163 bash[24253]: cephadm 2024-08-31T09:31:02.124992+0000 mgr.a (mgr.14388) 19017 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:31:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:03 smithi027 bash[22610]: audit 2024-08-31T09:31:02.123548+0000 mgr.a (mgr.14388) 19016 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:31:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:03 smithi027 bash[22610]: cephadm 2024-08-31T09:31:02.124992+0000 mgr.a (mgr.14388) 19017 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:31:04.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:31:04.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:31:04.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:31:04.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:31:04.601 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:31:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:04 smithi191 bash[24992]: cluster 2024-08-31T09:31:03.451631+0000 mgr.a (mgr.14388) 19018 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:04 smithi163 bash[24253]: cluster 2024-08-31T09:31:03.451631+0000 mgr.a (mgr.14388) 19018 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:04 smithi027 bash[22610]: cluster 2024-08-31T09:31:03.451631+0000 mgr.a (mgr.14388) 19018 : cluster [DBG] pgmap v13184: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:05 smithi191 bash[24992]: audit 2024-08-31T09:31:04.152556+0000 mgr.a (mgr.14388) 19019 : audit [DBG] from='client.408570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:06.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:05 smithi163 bash[24253]: audit 2024-08-31T09:31:04.152556+0000 mgr.a (mgr.14388) 19019 : audit [DBG] from='client.408570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:05 smithi027 bash[22610]: audit 2024-08-31T09:31:04.152556+0000 mgr.a (mgr.14388) 19019 : audit [DBG] from='client.408570 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:06 smithi191 bash[24992]: cluster 2024-08-31T09:31:05.452604+0000 mgr.a (mgr.14388) 19020 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:31:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:06 smithi163 bash[24253]: cluster 2024-08-31T09:31:05.452604+0000 mgr.a (mgr.14388) 19020 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:31:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:06 smithi027 bash[22610]: cluster 2024-08-31T09:31:05.452604+0000 mgr.a (mgr.14388) 19020 : cluster [DBG] pgmap v13185: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:31:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:08 smithi191 bash[24992]: cluster 2024-08-31T09:31:07.453373+0000 mgr.a (mgr.14388) 19021 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:31:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:08 smithi163 bash[24253]: cluster 2024-08-31T09:31:07.453373+0000 mgr.a (mgr.14388) 19021 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:31:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:08 smithi027 bash[22610]: cluster 2024-08-31T09:31:07.453373+0000 mgr.a (mgr.14388) 19021 : cluster [DBG] pgmap v13186: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:31:09.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:31:09.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:31:09.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:31:10.372 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:31:10.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:31:10.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:31:10.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:31:10.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:31:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:10 smithi191 bash[24992]: cluster 2024-08-31T09:31:09.455592+0000 mgr.a (mgr.14388) 19022 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:10 smithi163 bash[24253]: cluster 2024-08-31T09:31:09.455592+0000 mgr.a (mgr.14388) 19022 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:10 smithi027 bash[22610]: cluster 2024-08-31T09:31:09.455592+0000 mgr.a (mgr.14388) 19022 : cluster [DBG] pgmap v13187: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:11 smithi191 bash[24992]: audit 2024-08-31T09:31:09.943082+0000 mgr.a (mgr.14388) 19023 : audit [DBG] from='client.408648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:12.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:11 smithi163 bash[24253]: audit 2024-08-31T09:31:09.943082+0000 mgr.a (mgr.14388) 19023 : audit [DBG] from='client.408648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:11 smithi027 bash[22610]: audit 2024-08-31T09:31:09.943082+0000 mgr.a (mgr.14388) 19023 : audit [DBG] from='client.408648 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:12 smithi191 bash[24992]: cluster 2024-08-31T09:31:11.456486+0000 mgr.a (mgr.14388) 19024 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:12 smithi163 bash[24253]: cluster 2024-08-31T09:31:11.456486+0000 mgr.a (mgr.14388) 19024 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:12 smithi027 bash[22610]: cluster 2024-08-31T09:31:11.456486+0000 mgr.a (mgr.14388) 19024 : cluster [DBG] pgmap v13188: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:14 smithi191 bash[24992]: cluster 2024-08-31T09:31:13.458618+0000 mgr.a (mgr.14388) 19025 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:14 smithi163 bash[24253]: cluster 2024-08-31T09:31:13.458618+0000 mgr.a (mgr.14388) 19025 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:14 smithi027 bash[22610]: cluster 2024-08-31T09:31:13.458618+0000 mgr.a (mgr.14388) 19025 : cluster [DBG] pgmap v13189: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:31:15.373 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:31:15.374 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:31:15.374 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:31:16.161 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:31:16.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:31:16.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:31:16.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:31:16.162 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:31:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:16 smithi163 bash[24253]: cluster 2024-08-31T09:31:15.459354+0000 mgr.a (mgr.14388) 19026 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:16 smithi163 bash[24253]: audit 2024-08-31T09:31:15.711853+0000 mgr.a (mgr.14388) 19027 : audit [DBG] from='client.408726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:16 smithi027 bash[22610]: cluster 2024-08-31T09:31:15.459354+0000 mgr.a (mgr.14388) 19026 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:16 smithi027 bash[22610]: audit 2024-08-31T09:31:15.711853+0000 mgr.a (mgr.14388) 19027 : audit [DBG] from='client.408726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:16 smithi191 bash[24992]: cluster 2024-08-31T09:31:15.459354+0000 mgr.a (mgr.14388) 19026 : cluster [DBG] pgmap v13190: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:16 smithi191 bash[24992]: audit 2024-08-31T09:31:15.711853+0000 mgr.a (mgr.14388) 19027 : audit [DBG] from='client.408726 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:18 smithi163 bash[24253]: cluster 2024-08-31T09:31:17.460324+0000 mgr.a (mgr.14388) 19028 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:18 smithi027 bash[22610]: cluster 2024-08-31T09:31:17.460324+0000 mgr.a (mgr.14388) 19028 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:18 smithi191 bash[24992]: cluster 2024-08-31T09:31:17.460324+0000 mgr.a (mgr.14388) 19028 : cluster [DBG] pgmap v13191: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:21.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:31:21.163 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:31:21.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:31:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:20 smithi163 bash[24253]: cluster 2024-08-31T09:31:19.462539+0000 mgr.a (mgr.14388) 19029 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:20 smithi027 bash[22610]: cluster 2024-08-31T09:31:19.462539+0000 mgr.a (mgr.14388) 19029 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:20 smithi191 bash[24992]: cluster 2024-08-31T09:31:19.462539+0000 mgr.a (mgr.14388) 19029 : cluster [DBG] pgmap v13192: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:21.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:31:21.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:31:21.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:31:21.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:31:21.913 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:31:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:22 smithi163 bash[24253]: cluster 2024-08-31T09:31:21.463460+0000 mgr.a (mgr.14388) 19030 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:22 smithi163 bash[24253]: audit 2024-08-31T09:31:21.493991+0000 mgr.a (mgr.14388) 19031 : audit [DBG] from='client.408801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:22 smithi027 bash[22610]: cluster 2024-08-31T09:31:21.463460+0000 mgr.a (mgr.14388) 19030 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:22 smithi027 bash[22610]: audit 2024-08-31T09:31:21.493991+0000 mgr.a (mgr.14388) 19031 : audit [DBG] from='client.408801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:22 smithi191 bash[24992]: cluster 2024-08-31T09:31:21.463460+0000 mgr.a (mgr.14388) 19030 : cluster [DBG] pgmap v13193: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:22 smithi191 bash[24992]: audit 2024-08-31T09:31:21.493991+0000 mgr.a (mgr.14388) 19031 : audit [DBG] from='client.408801 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:24 smithi163 bash[24253]: cluster 2024-08-31T09:31:23.465726+0000 mgr.a (mgr.14388) 19032 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:24 smithi027 bash[22610]: cluster 2024-08-31T09:31:23.465726+0000 mgr.a (mgr.14388) 19032 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:24 smithi191 bash[24992]: cluster 2024-08-31T09:31:23.465726+0000 mgr.a (mgr.14388) 19032 : cluster [DBG] pgmap v13194: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:31:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:31:26.914 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:31:27.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:26 smithi163 bash[24253]: cluster 2024-08-31T09:31:25.466512+0000 mgr.a (mgr.14388) 19033 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:26 smithi027 bash[22610]: cluster 2024-08-31T09:31:25.466512+0000 mgr.a (mgr.14388) 19033 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:26 smithi191 bash[24992]: cluster 2024-08-31T09:31:25.466512+0000 mgr.a (mgr.14388) 19033 : cluster [DBG] pgmap v13195: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:27.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:31:27.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:31:27.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:31:27.683 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:31:27.683 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:31:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:28 smithi163 bash[24253]: audit 2024-08-31T09:31:27.247841+0000 mgr.a (mgr.14388) 19034 : audit [DBG] from='client.408879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:28 smithi163 bash[24253]: cluster 2024-08-31T09:31:27.467010+0000 mgr.a (mgr.14388) 19035 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:28 smithi027 bash[22610]: audit 2024-08-31T09:31:27.247841+0000 mgr.a (mgr.14388) 19034 : audit [DBG] from='client.408879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:28 smithi027 bash[22610]: cluster 2024-08-31T09:31:27.467010+0000 mgr.a (mgr.14388) 19035 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:28 smithi191 bash[24992]: audit 2024-08-31T09:31:27.247841+0000 mgr.a (mgr.14388) 19034 : audit [DBG] from='client.408879 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:28 smithi191 bash[24992]: cluster 2024-08-31T09:31:27.467010+0000 mgr.a (mgr.14388) 19035 : cluster [DBG] pgmap v13196: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:30 smithi163 bash[24253]: cluster 2024-08-31T09:31:29.469285+0000 mgr.a (mgr.14388) 19036 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:31.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:30 smithi027 bash[22610]: cluster 2024-08-31T09:31:29.469285+0000 mgr.a (mgr.14388) 19036 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:30 smithi191 bash[24992]: cluster 2024-08-31T09:31:29.469285+0000 mgr.a (mgr.14388) 19036 : cluster [DBG] pgmap v13197: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:32.684 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:31:32.685 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:31:32.685 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:31:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:32 smithi163 bash[24253]: cluster 2024-08-31T09:31:31.470053+0000 mgr.a (mgr.14388) 19037 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:32 smithi027 bash[22610]: cluster 2024-08-31T09:31:31.470053+0000 mgr.a (mgr.14388) 19037 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:32 smithi191 bash[24992]: cluster 2024-08-31T09:31:31.470053+0000 mgr.a (mgr.14388) 19037 : cluster [DBG] pgmap v13198: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:33.458 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:31:33.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:31:33.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:31:33.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:31:33.459 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:31:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:34 smithi163 bash[24253]: audit 2024-08-31T09:31:33.022907+0000 mgr.a (mgr.14388) 19038 : audit [DBG] from='client.408954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:34 smithi163 bash[24253]: cluster 2024-08-31T09:31:33.471337+0000 mgr.a (mgr.14388) 19039 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:34 smithi027 bash[22610]: audit 2024-08-31T09:31:33.022907+0000 mgr.a (mgr.14388) 19038 : audit [DBG] from='client.408954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:34 smithi027 bash[22610]: cluster 2024-08-31T09:31:33.471337+0000 mgr.a (mgr.14388) 19039 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:34 smithi191 bash[24992]: audit 2024-08-31T09:31:33.022907+0000 mgr.a (mgr.14388) 19038 : audit [DBG] from='client.408954 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:34 smithi191 bash[24992]: cluster 2024-08-31T09:31:33.471337+0000 mgr.a (mgr.14388) 19039 : cluster [DBG] pgmap v13199: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:36 smithi163 bash[24253]: cluster 2024-08-31T09:31:35.472072+0000 mgr.a (mgr.14388) 19040 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:31:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:36 smithi027 bash[22610]: cluster 2024-08-31T09:31:35.472072+0000 mgr.a (mgr.14388) 19040 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:31:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:36 smithi191 bash[24992]: cluster 2024-08-31T09:31:35.472072+0000 mgr.a (mgr.14388) 19040 : cluster [DBG] pgmap v13200: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:31:38.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:31:38.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:31:38.461 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:31:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:38 smithi163 bash[24253]: cluster 2024-08-31T09:31:37.472846+0000 mgr.a (mgr.14388) 19041 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:31:39.213 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:31:39.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:31:39.213 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:31:39.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:31:39.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:31:39.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:38 smithi027 bash[22610]: cluster 2024-08-31T09:31:37.472846+0000 mgr.a (mgr.14388) 19041 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:31:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:38 smithi191 bash[24992]: cluster 2024-08-31T09:31:37.472846+0000 mgr.a (mgr.14388) 19041 : cluster [DBG] pgmap v13201: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:31:40.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:39 smithi163 bash[24253]: audit 2024-08-31T09:31:38.790650+0000 mgr.a (mgr.14388) 19042 : audit [DBG] from='client.409032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:39 smithi027 bash[22610]: audit 2024-08-31T09:31:38.790650+0000 mgr.a (mgr.14388) 19042 : audit [DBG] from='client.409032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:39 smithi191 bash[24992]: audit 2024-08-31T09:31:38.790650+0000 mgr.a (mgr.14388) 19042 : audit [DBG] from='client.409032 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:40 smithi163 bash[24253]: cluster 2024-08-31T09:31:39.475802+0000 mgr.a (mgr.14388) 19043 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:41.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:40 smithi027 bash[22610]: cluster 2024-08-31T09:31:39.475802+0000 mgr.a (mgr.14388) 19043 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:40 smithi191 bash[24992]: cluster 2024-08-31T09:31:39.475802+0000 mgr.a (mgr.14388) 19043 : cluster [DBG] pgmap v13202: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:42 smithi027 bash[22610]: cluster 2024-08-31T09:31:41.476627+0000 mgr.a (mgr.14388) 19044 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:31:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:42 smithi191 bash[24992]: cluster 2024-08-31T09:31:41.476627+0000 mgr.a (mgr.14388) 19044 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:31:42.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:42 smithi163 bash[24253]: cluster 2024-08-31T09:31:41.476627+0000 mgr.a (mgr.14388) 19044 : cluster [DBG] pgmap v13203: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:31:44.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:31:44.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:31:44.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:31:44.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:44 smithi191 bash[24992]: cluster 2024-08-31T09:31:43.478518+0000 mgr.a (mgr.14388) 19045 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:44 smithi163 bash[24253]: cluster 2024-08-31T09:31:43.478518+0000 mgr.a (mgr.14388) 19045 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:44.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:44 smithi027 bash[22610]: cluster 2024-08-31T09:31:43.478518+0000 mgr.a (mgr.14388) 19045 : cluster [DBG] pgmap v13204: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:44.992 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:31:44.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:31:44.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:31:44.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:31:44.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:31:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:45 smithi163 bash[24253]: audit 2024-08-31T09:31:44.548740+0000 mgr.a (mgr.14388) 19046 : audit [DBG] from='client.409110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:45.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:45 smithi027 bash[22610]: audit 2024-08-31T09:31:44.548740+0000 mgr.a (mgr.14388) 19046 : audit [DBG] from='client.409110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:45 smithi191 bash[24992]: audit 2024-08-31T09:31:44.548740+0000 mgr.a (mgr.14388) 19046 : audit [DBG] from='client.409110 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:46 smithi163 bash[24253]: cluster 2024-08-31T09:31:45.479502+0000 mgr.a (mgr.14388) 19047 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:46 smithi027 bash[22610]: cluster 2024-08-31T09:31:45.479502+0000 mgr.a (mgr.14388) 19047 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:46 smithi191 bash[24992]: cluster 2024-08-31T09:31:45.479502+0000 mgr.a (mgr.14388) 19047 : cluster [DBG] pgmap v13205: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:48.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:48 smithi163 bash[24253]: cluster 2024-08-31T09:31:47.480284+0000 mgr.a (mgr.14388) 19048 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:48.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:48 smithi027 bash[22610]: cluster 2024-08-31T09:31:47.480284+0000 mgr.a (mgr.14388) 19048 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:48 smithi191 bash[24992]: cluster 2024-08-31T09:31:47.480284+0000 mgr.a (mgr.14388) 19048 : cluster [DBG] pgmap v13206: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:49.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:31:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:31:49.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:31:50.779 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:31:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:31:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:31:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:31:50.780 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:31:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:50 smithi163 bash[24253]: cluster 2024-08-31T09:31:49.482499+0000 mgr.a (mgr.14388) 19049 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:50.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:50 smithi027 bash[22610]: cluster 2024-08-31T09:31:49.482499+0000 mgr.a (mgr.14388) 19049 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:50 smithi191 bash[24992]: cluster 2024-08-31T09:31:49.482499+0000 mgr.a (mgr.14388) 19049 : cluster [DBG] pgmap v13207: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:51 smithi163 bash[24253]: audit 2024-08-31T09:31:50.331179+0000 mgr.a (mgr.14388) 19050 : audit [DBG] from='client.409185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:51 smithi027 bash[22610]: audit 2024-08-31T09:31:50.331179+0000 mgr.a (mgr.14388) 19050 : audit [DBG] from='client.409185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:52.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:51 smithi191 bash[24992]: audit 2024-08-31T09:31:50.331179+0000 mgr.a (mgr.14388) 19050 : audit [DBG] from='client.409185 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:52.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:52 smithi163 bash[24253]: cluster 2024-08-31T09:31:51.483401+0000 mgr.a (mgr.14388) 19051 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:52 smithi027 bash[22610]: cluster 2024-08-31T09:31:51.483401+0000 mgr.a (mgr.14388) 19051 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:53.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:52 smithi191 bash[24992]: cluster 2024-08-31T09:31:51.483401+0000 mgr.a (mgr.14388) 19051 : cluster [DBG] pgmap v13208: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:54.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:54 smithi163 bash[24253]: cluster 2024-08-31T09:31:53.485581+0000 mgr.a (mgr.14388) 19052 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:54 smithi027 bash[22610]: cluster 2024-08-31T09:31:53.485581+0000 mgr.a (mgr.14388) 19052 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:54 smithi191 bash[24992]: cluster 2024-08-31T09:31:53.485581+0000 mgr.a (mgr.14388) 19052 : cluster [DBG] pgmap v13209: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:31:55.781 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:31:55.782 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:31:55.782 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:31:56.556 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:31:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:31:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:31:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:31:56.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:31:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:56 smithi163 bash[24253]: cluster 2024-08-31T09:31:55.486357+0000 mgr.a (mgr.14388) 19053 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:56 smithi027 bash[22610]: cluster 2024-08-31T09:31:55.486357+0000 mgr.a (mgr.14388) 19053 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:56 smithi191 bash[24992]: cluster 2024-08-31T09:31:55.486357+0000 mgr.a (mgr.14388) 19053 : cluster [DBG] pgmap v13210: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:57 smithi163 bash[24253]: audit 2024-08-31T09:31:56.119709+0000 mgr.a (mgr.14388) 19054 : audit [DBG] from='client.409260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:57 smithi027 bash[22610]: audit 2024-08-31T09:31:56.119709+0000 mgr.a (mgr.14388) 19054 : audit [DBG] from='client.409260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:57 smithi191 bash[24992]: audit 2024-08-31T09:31:56.119709+0000 mgr.a (mgr.14388) 19054 : audit [DBG] from='client.409260 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:31:58.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:31:58 smithi163 bash[24253]: cluster 2024-08-31T09:31:57.487319+0000 mgr.a (mgr.14388) 19055 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:31:58 smithi027 bash[22610]: cluster 2024-08-31T09:31:57.487319+0000 mgr.a (mgr.14388) 19055 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:31:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:31:58 smithi191 bash[24992]: cluster 2024-08-31T09:31:57.487319+0000 mgr.a (mgr.14388) 19055 : cluster [DBG] pgmap v13211: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:00.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:00 smithi163 bash[24253]: cluster 2024-08-31T09:31:59.489535+0000 mgr.a (mgr.14388) 19056 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:32:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:00 smithi027 bash[22610]: cluster 2024-08-31T09:31:59.489535+0000 mgr.a (mgr.14388) 19056 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:32:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:00 smithi191 bash[24992]: cluster 2024-08-31T09:31:59.489535+0000 mgr.a (mgr.14388) 19056 : cluster [DBG] pgmap v13212: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:32:01.558 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:01.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:01.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:32:02.338 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:32:02.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:32:02.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:32:02.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:32:02.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:32:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:02 smithi163 bash[24253]: cluster 2024-08-31T09:32:01.490334+0000 mgr.a (mgr.14388) 19057 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:02 smithi163 bash[24253]: audit 2024-08-31T09:32:01.894346+0000 mgr.a (mgr.14388) 19058 : audit [DBG] from='client.409335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:02 smithi163 bash[24253]: audit 2024-08-31T09:32:02.186373+0000 mon.a (mon.0) 3415 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:32:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:02 smithi027 bash[22610]: cluster 2024-08-31T09:32:01.490334+0000 mgr.a (mgr.14388) 19057 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:02 smithi027 bash[22610]: audit 2024-08-31T09:32:01.894346+0000 mgr.a (mgr.14388) 19058 : audit [DBG] from='client.409335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:02 smithi027 bash[22610]: audit 2024-08-31T09:32:02.186373+0000 mon.a (mon.0) 3415 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:32:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:02 smithi191 bash[24992]: cluster 2024-08-31T09:32:01.490334+0000 mgr.a (mgr.14388) 19057 : cluster [DBG] pgmap v13213: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:02 smithi191 bash[24992]: audit 2024-08-31T09:32:01.894346+0000 mgr.a (mgr.14388) 19058 : audit [DBG] from='client.409335 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:02 smithi191 bash[24992]: audit 2024-08-31T09:32:02.186373+0000 mon.a (mon.0) 3415 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:32:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:03 smithi163 bash[24253]: audit 2024-08-31T09:32:02.974891+0000 mon.a (mon.0) 3416 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:32:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:03 smithi163 bash[24253]: audit 2024-08-31T09:32:02.976653+0000 mon.a (mon.0) 3417 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:32:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:03 smithi163 bash[24253]: audit 2024-08-31T09:32:02.987677+0000 mon.a (mon.0) 3418 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:32:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:03 smithi163 bash[24253]: audit 2024-08-31T09:32:02.992894+0000 mon.a (mon.0) 3419 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:32:03.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:32:03 smithi027 bash[22863]: debug 2024-08-31T09:32:03.725+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:32:03.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:32:03 smithi027 bash[22863]: debug 2024-08-31T09:32:03.729+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:32:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:03 smithi027 bash[22610]: audit 2024-08-31T09:32:02.974891+0000 mon.a (mon.0) 3416 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:32:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:03 smithi027 bash[22610]: audit 2024-08-31T09:32:02.976653+0000 mon.a (mon.0) 3417 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:32:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:03 smithi027 bash[22610]: audit 2024-08-31T09:32:02.987677+0000 mon.a (mon.0) 3418 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:32:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:03 smithi027 bash[22610]: audit 2024-08-31T09:32:02.992894+0000 mon.a (mon.0) 3419 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:32:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:03 smithi191 bash[24992]: audit 2024-08-31T09:32:02.974891+0000 mon.a (mon.0) 3416 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:32:04.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:03 smithi191 bash[24992]: audit 2024-08-31T09:32:02.976653+0000 mon.a (mon.0) 3417 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:32:04.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:03 smithi191 bash[24992]: audit 2024-08-31T09:32:02.987677+0000 mon.a (mon.0) 3418 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:32:04.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:03 smithi191 bash[24992]: audit 2024-08-31T09:32:02.992894+0000 mon.a (mon.0) 3419 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:32:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:04 smithi163 bash[24253]: audit 2024-08-31T09:32:02.995268+0000 mgr.a (mgr.14388) 19059 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:32:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:04 smithi163 bash[24253]: cluster 2024-08-31T09:32:03.491563+0000 mgr.a (mgr.14388) 19060 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:32:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:04 smithi163 bash[24253]: audit 2024-08-31T09:32:03.730203+0000 mgr.a (mgr.14388) 19061 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:32:04.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:04 smithi163 bash[24253]: cephadm 2024-08-31T09:32:03.731778+0000 mgr.a (mgr.14388) 19062 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:32:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:04 smithi027 bash[22610]: audit 2024-08-31T09:32:02.995268+0000 mgr.a (mgr.14388) 19059 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:32:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:04 smithi027 bash[22610]: cluster 2024-08-31T09:32:03.491563+0000 mgr.a (mgr.14388) 19060 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:32:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:04 smithi027 bash[22610]: audit 2024-08-31T09:32:03.730203+0000 mgr.a (mgr.14388) 19061 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:32:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:04 smithi027 bash[22610]: cephadm 2024-08-31T09:32:03.731778+0000 mgr.a (mgr.14388) 19062 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:32:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:04 smithi191 bash[24992]: audit 2024-08-31T09:32:02.995268+0000 mgr.a (mgr.14388) 19059 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:32:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:04 smithi191 bash[24992]: cluster 2024-08-31T09:32:03.491563+0000 mgr.a (mgr.14388) 19060 : cluster [DBG] pgmap v13214: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:32:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:04 smithi191 bash[24992]: audit 2024-08-31T09:32:03.730203+0000 mgr.a (mgr.14388) 19061 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:32:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:04 smithi191 bash[24992]: cephadm 2024-08-31T09:32:03.731778+0000 mgr.a (mgr.14388) 19062 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:32:06.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:06 smithi163 bash[24253]: cluster 2024-08-31T09:32:05.492555+0000 mgr.a (mgr.14388) 19063 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:06.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:06 smithi027 bash[22610]: cluster 2024-08-31T09:32:05.492555+0000 mgr.a (mgr.14388) 19063 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:07.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:06 smithi191 bash[24992]: cluster 2024-08-31T09:32:05.492555+0000 mgr.a (mgr.14388) 19063 : cluster [DBG] pgmap v13215: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:07.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:07.341 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:07.341 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:32:08.113 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:32:08.113 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:32:08.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:32:08.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:32:08.114 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:32:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:08 smithi163 bash[24253]: cluster 2024-08-31T09:32:07.493279+0000 mgr.a (mgr.14388) 19064 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:08 smithi163 bash[24253]: audit 2024-08-31T09:32:07.674832+0000 mgr.a (mgr.14388) 19065 : audit [DBG] from='client.409512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:08 smithi027 bash[22610]: cluster 2024-08-31T09:32:07.493279+0000 mgr.a (mgr.14388) 19064 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:08 smithi027 bash[22610]: audit 2024-08-31T09:32:07.674832+0000 mgr.a (mgr.14388) 19065 : audit [DBG] from='client.409512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:08 smithi191 bash[24992]: cluster 2024-08-31T09:32:07.493279+0000 mgr.a (mgr.14388) 19064 : cluster [DBG] pgmap v13216: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:08 smithi191 bash[24992]: audit 2024-08-31T09:32:07.674832+0000 mgr.a (mgr.14388) 19065 : audit [DBG] from='client.409512 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:10 smithi163 bash[24253]: cluster 2024-08-31T09:32:09.495721+0000 mgr.a (mgr.14388) 19066 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:32:10.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:10 smithi027 bash[22610]: cluster 2024-08-31T09:32:09.495721+0000 mgr.a (mgr.14388) 19066 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:32:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:10 smithi191 bash[24992]: cluster 2024-08-31T09:32:09.495721+0000 mgr.a (mgr.14388) 19066 : cluster [DBG] pgmap v13217: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:32:12.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:12 smithi163 bash[24253]: cluster 2024-08-31T09:32:11.496476+0000 mgr.a (mgr.14388) 19067 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:32:12.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:12 smithi027 bash[22610]: cluster 2024-08-31T09:32:11.496476+0000 mgr.a (mgr.14388) 19067 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:32:13.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:12 smithi191 bash[24992]: cluster 2024-08-31T09:32:11.496476+0000 mgr.a (mgr.14388) 19067 : cluster [DBG] pgmap v13218: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:32:13.115 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:13.115 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:13.116 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:32:13.870 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:32:13.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:32:13.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:32:13.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:32:13.871 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:32:14.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:14 smithi163 bash[24253]: audit 2024-08-31T09:32:13.449374+0000 mgr.a (mgr.14388) 19068 : audit [DBG] from='client.409590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:15.047 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:14 smithi163 bash[24253]: cluster 2024-08-31T09:32:13.498909+0000 mgr.a (mgr.14388) 19069 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:32:15.048 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:14 smithi191 bash[24992]: audit 2024-08-31T09:32:13.449374+0000 mgr.a (mgr.14388) 19068 : audit [DBG] from='client.409590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:15.048 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:14 smithi191 bash[24992]: cluster 2024-08-31T09:32:13.498909+0000 mgr.a (mgr.14388) 19069 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:32:15.048 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:14 smithi027 bash[22610]: audit 2024-08-31T09:32:13.449374+0000 mgr.a (mgr.14388) 19068 : audit [DBG] from='client.409590 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:15.048 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:14 smithi027 bash[22610]: cluster 2024-08-31T09:32:13.498909+0000 mgr.a (mgr.14388) 19069 : cluster [DBG] pgmap v13219: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:32:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:16 smithi163 bash[24253]: cluster 2024-08-31T09:32:15.499813+0000 mgr.a (mgr.14388) 19070 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:32:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:16 smithi027 bash[22610]: cluster 2024-08-31T09:32:15.499813+0000 mgr.a (mgr.14388) 19070 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:32:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:16 smithi191 bash[24992]: cluster 2024-08-31T09:32:15.499813+0000 mgr.a (mgr.14388) 19070 : cluster [DBG] pgmap v13220: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:32:18.872 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:18.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:18.872 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:32:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:18 smithi163 bash[24253]: cluster 2024-08-31T09:32:17.500606+0000 mgr.a (mgr.14388) 19071 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:32:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:18 smithi027 bash[22610]: cluster 2024-08-31T09:32:17.500606+0000 mgr.a (mgr.14388) 19071 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:32:19.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:18 smithi191 bash[24992]: cluster 2024-08-31T09:32:17.500606+0000 mgr.a (mgr.14388) 19071 : cluster [DBG] pgmap v13221: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:32:19.649 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:32:19.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:32:19.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:32:19.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:32:19.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:32:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:20 smithi163 bash[24253]: audit 2024-08-31T09:32:19.204184+0000 mgr.a (mgr.14388) 19072 : audit [DBG] from='client.409668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:20 smithi163 bash[24253]: cluster 2024-08-31T09:32:19.502013+0000 mgr.a (mgr.14388) 19073 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:32:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:20 smithi027 bash[22610]: audit 2024-08-31T09:32:19.204184+0000 mgr.a (mgr.14388) 19072 : audit [DBG] from='client.409668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:20 smithi027 bash[22610]: cluster 2024-08-31T09:32:19.502013+0000 mgr.a (mgr.14388) 19073 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:32:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:20 smithi191 bash[24992]: audit 2024-08-31T09:32:19.204184+0000 mgr.a (mgr.14388) 19072 : audit [DBG] from='client.409668 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:20 smithi191 bash[24992]: cluster 2024-08-31T09:32:19.502013+0000 mgr.a (mgr.14388) 19073 : cluster [DBG] pgmap v13222: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:32:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:22 smithi163 bash[24253]: cluster 2024-08-31T09:32:21.502911+0000 mgr.a (mgr.14388) 19074 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:32:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:22 smithi027 bash[22610]: cluster 2024-08-31T09:32:21.502911+0000 mgr.a (mgr.14388) 19074 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:32:23.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:22 smithi191 bash[24992]: cluster 2024-08-31T09:32:21.502911+0000 mgr.a (mgr.14388) 19074 : cluster [DBG] pgmap v13223: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:32:24.651 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:24.652 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:24.652 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:32:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:24 smithi163 bash[24253]: cluster 2024-08-31T09:32:23.505055+0000 mgr.a (mgr.14388) 19075 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:32:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:24 smithi027 bash[22610]: cluster 2024-08-31T09:32:23.505055+0000 mgr.a (mgr.14388) 19075 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:32:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:24 smithi191 bash[24992]: cluster 2024-08-31T09:32:23.505055+0000 mgr.a (mgr.14388) 19075 : cluster [DBG] pgmap v13224: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:32:25.433 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:32:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:32:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:32:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:32:25.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:32:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:26 smithi163 bash[24253]: audit 2024-08-31T09:32:24.990654+0000 mgr.a (mgr.14388) 19076 : audit [DBG] from='client.409746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:26 smithi163 bash[24253]: cluster 2024-08-31T09:32:25.505702+0000 mgr.a (mgr.14388) 19077 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:26 smithi027 bash[22610]: audit 2024-08-31T09:32:24.990654+0000 mgr.a (mgr.14388) 19076 : audit [DBG] from='client.409746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:26.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:26 smithi027 bash[22610]: cluster 2024-08-31T09:32:25.505702+0000 mgr.a (mgr.14388) 19077 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:26 smithi191 bash[24992]: audit 2024-08-31T09:32:24.990654+0000 mgr.a (mgr.14388) 19076 : audit [DBG] from='client.409746 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:27.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:26 smithi191 bash[24992]: cluster 2024-08-31T09:32:25.505702+0000 mgr.a (mgr.14388) 19077 : cluster [DBG] pgmap v13225: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:28 smithi163 bash[24253]: cluster 2024-08-31T09:32:27.506471+0000 mgr.a (mgr.14388) 19078 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:28 smithi027 bash[22610]: cluster 2024-08-31T09:32:27.506471+0000 mgr.a (mgr.14388) 19078 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:28 smithi191 bash[24992]: cluster 2024-08-31T09:32:27.506471+0000 mgr.a (mgr.14388) 19078 : cluster [DBG] pgmap v13226: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:30.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:30.434 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:30.434 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:32:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:30 smithi163 bash[24253]: cluster 2024-08-31T09:32:29.508734+0000 mgr.a (mgr.14388) 19079 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:32:30.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:30 smithi027 bash[22610]: cluster 2024-08-31T09:32:29.508734+0000 mgr.a (mgr.14388) 19079 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:32:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:30 smithi191 bash[24992]: cluster 2024-08-31T09:32:29.508734+0000 mgr.a (mgr.14388) 19079 : cluster [DBG] pgmap v13227: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:32:31.218 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:32:31.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:32:31.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:32:31.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:32:31.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:32:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:31 smithi163 bash[24253]: audit 2024-08-31T09:32:30.767732+0000 mgr.a (mgr.14388) 19080 : audit [DBG] from='client.409824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:31 smithi027 bash[22610]: audit 2024-08-31T09:32:30.767732+0000 mgr.a (mgr.14388) 19080 : audit [DBG] from='client.409824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:32.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:31 smithi191 bash[24992]: audit 2024-08-31T09:32:30.767732+0000 mgr.a (mgr.14388) 19080 : audit [DBG] from='client.409824 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:32 smithi163 bash[24253]: cluster 2024-08-31T09:32:31.509737+0000 mgr.a (mgr.14388) 19081 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:32:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:32 smithi027 bash[22610]: cluster 2024-08-31T09:32:31.509737+0000 mgr.a (mgr.14388) 19081 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:32:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:32 smithi191 bash[24992]: cluster 2024-08-31T09:32:31.509737+0000 mgr.a (mgr.14388) 19081 : cluster [DBG] pgmap v13228: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:32:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:34 smithi163 bash[24253]: cluster 2024-08-31T09:32:33.511923+0000 mgr.a (mgr.14388) 19082 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:32:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:34 smithi027 bash[22610]: cluster 2024-08-31T09:32:33.511923+0000 mgr.a (mgr.14388) 19082 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:32:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:34 smithi191 bash[24992]: cluster 2024-08-31T09:32:33.511923+0000 mgr.a (mgr.14388) 19082 : cluster [DBG] pgmap v13229: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:32:36.220 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:36.220 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:36.220 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:32:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:36 smithi163 bash[24253]: cluster 2024-08-31T09:32:35.512695+0000 mgr.a (mgr.14388) 19083 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:32:36.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:36 smithi027 bash[22610]: cluster 2024-08-31T09:32:35.512695+0000 mgr.a (mgr.14388) 19083 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:32:37.005 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:32:37.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:32:37.005 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:32:37.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:32:37.006 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:32:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:36 smithi191 bash[24992]: cluster 2024-08-31T09:32:35.512695+0000 mgr.a (mgr.14388) 19083 : cluster [DBG] pgmap v13230: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:32:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:37 smithi163 bash[24253]: audit 2024-08-31T09:32:36.561536+0000 mgr.a (mgr.14388) 19084 : audit [DBG] from='client.409896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:37.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:37 smithi027 bash[22610]: audit 2024-08-31T09:32:36.561536+0000 mgr.a (mgr.14388) 19084 : audit [DBG] from='client.409896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:38.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:37 smithi191 bash[24992]: audit 2024-08-31T09:32:36.561536+0000 mgr.a (mgr.14388) 19084 : audit [DBG] from='client.409896 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:38 smithi163 bash[24253]: cluster 2024-08-31T09:32:37.513683+0000 mgr.a (mgr.14388) 19085 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:32:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:38 smithi027 bash[22610]: cluster 2024-08-31T09:32:37.513683+0000 mgr.a (mgr.14388) 19085 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:32:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:38 smithi191 bash[24992]: cluster 2024-08-31T09:32:37.513683+0000 mgr.a (mgr.14388) 19085 : cluster [DBG] pgmap v13231: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T09:32:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:40 smithi027 bash[22610]: cluster 2024-08-31T09:32:39.515970+0000 mgr.a (mgr.14388) 19086 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:32:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:40 smithi191 bash[24992]: cluster 2024-08-31T09:32:39.515970+0000 mgr.a (mgr.14388) 19086 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:32:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:40 smithi163 bash[24253]: cluster 2024-08-31T09:32:39.515970+0000 mgr.a (mgr.14388) 19086 : cluster [DBG] pgmap v13232: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T09:32:42.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:42.008 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:42.008 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:32:42.783 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:32:42.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:32:42.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:32:42.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:32:42.784 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:32:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:42 smithi027 bash[22610]: cluster 2024-08-31T09:32:41.516743+0000 mgr.a (mgr.14388) 19087 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:42 smithi191 bash[24992]: cluster 2024-08-31T09:32:41.516743+0000 mgr.a (mgr.14388) 19087 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:42 smithi163 bash[24253]: cluster 2024-08-31T09:32:41.516743+0000 mgr.a (mgr.14388) 19087 : cluster [DBG] pgmap v13233: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:43 smithi027 bash[22610]: audit 2024-08-31T09:32:42.341184+0000 mgr.a (mgr.14388) 19088 : audit [DBG] from='client.409971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:43 smithi191 bash[24992]: audit 2024-08-31T09:32:42.341184+0000 mgr.a (mgr.14388) 19088 : audit [DBG] from='client.409971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:43 smithi163 bash[24253]: audit 2024-08-31T09:32:42.341184+0000 mgr.a (mgr.14388) 19088 : audit [DBG] from='client.409971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:44 smithi027 bash[22610]: cluster 2024-08-31T09:32:43.518978+0000 mgr.a (mgr.14388) 19089 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:32:45.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:44 smithi191 bash[24992]: cluster 2024-08-31T09:32:43.518978+0000 mgr.a (mgr.14388) 19089 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:32:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:44 smithi163 bash[24253]: cluster 2024-08-31T09:32:43.518978+0000 mgr.a (mgr.14388) 19089 : cluster [DBG] pgmap v13234: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:32:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:46 smithi027 bash[22610]: cluster 2024-08-31T09:32:45.519898+0000 mgr.a (mgr.14388) 19090 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:46 smithi191 bash[24992]: cluster 2024-08-31T09:32:45.519898+0000 mgr.a (mgr.14388) 19090 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:46 smithi163 bash[24253]: cluster 2024-08-31T09:32:45.519898+0000 mgr.a (mgr.14388) 19090 : cluster [DBG] pgmap v13235: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:47.785 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:47.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:47.786 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:32:48.545 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:32:48.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:32:48.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:32:48.546 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:32:48.546 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:32:48.985 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:48 smithi027 bash[22610]: cluster 2024-08-31T09:32:47.520816+0000 mgr.a (mgr.14388) 19091 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:48 smithi191 bash[24992]: cluster 2024-08-31T09:32:47.520816+0000 mgr.a (mgr.14388) 19091 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:48 smithi163 bash[24253]: cluster 2024-08-31T09:32:47.520816+0000 mgr.a (mgr.14388) 19091 : cluster [DBG] pgmap v13236: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:50.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:49 smithi191 bash[24992]: audit 2024-08-31T09:32:48.119276+0000 mgr.a (mgr.14388) 19092 : audit [DBG] from='client.410043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:49 smithi163 bash[24253]: audit 2024-08-31T09:32:48.119276+0000 mgr.a (mgr.14388) 19092 : audit [DBG] from='client.410043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:49 smithi027 bash[22610]: audit 2024-08-31T09:32:48.119276+0000 mgr.a (mgr.14388) 19092 : audit [DBG] from='client.410043 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:51.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:50 smithi191 bash[24992]: cluster 2024-08-31T09:32:49.523639+0000 mgr.a (mgr.14388) 19093 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:50 smithi163 bash[24253]: cluster 2024-08-31T09:32:49.523639+0000 mgr.a (mgr.14388) 19093 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:51.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:50 smithi027 bash[22610]: cluster 2024-08-31T09:32:49.523639+0000 mgr.a (mgr.14388) 19093 : cluster [DBG] pgmap v13237: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:32:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:52 smithi191 bash[24992]: cluster 2024-08-31T09:32:51.524393+0000 mgr.a (mgr.14388) 19094 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:32:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:52 smithi163 bash[24253]: cluster 2024-08-31T09:32:51.524393+0000 mgr.a (mgr.14388) 19094 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:32:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:52 smithi027 bash[22610]: cluster 2024-08-31T09:32:51.524393+0000 mgr.a (mgr.14388) 19094 : cluster [DBG] pgmap v13238: 225 pgs: 225 active+clean; 589 KiB data, 222 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:32:53.547 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:53.547 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:53.548 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:32:54.335 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:32:54.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:32:54.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:32:54.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:32:54.336 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:32:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:54 smithi191 bash[24992]: cluster 2024-08-31T09:32:53.526322+0000 mgr.a (mgr.14388) 19095 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:32:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:54 smithi191 bash[24992]: audit 2024-08-31T09:32:53.885491+0000 mgr.a (mgr.14388) 19096 : audit [DBG] from='client.410118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:54 smithi163 bash[24253]: cluster 2024-08-31T09:32:53.526322+0000 mgr.a (mgr.14388) 19095 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:32:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:54 smithi163 bash[24253]: audit 2024-08-31T09:32:53.885491+0000 mgr.a (mgr.14388) 19096 : audit [DBG] from='client.410118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:54 smithi027 bash[22610]: cluster 2024-08-31T09:32:53.526322+0000 mgr.a (mgr.14388) 19095 : cluster [DBG] pgmap v13239: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:32:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:54 smithi027 bash[22610]: audit 2024-08-31T09:32:53.885491+0000 mgr.a (mgr.14388) 19096 : audit [DBG] from='client.410118 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:32:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:56 smithi191 bash[24992]: cluster 2024-08-31T09:32:55.527244+0000 mgr.a (mgr.14388) 19097 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:32:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:56 smithi163 bash[24253]: cluster 2024-08-31T09:32:55.527244+0000 mgr.a (mgr.14388) 19097 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:32:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:56 smithi027 bash[22610]: cluster 2024-08-31T09:32:55.527244+0000 mgr.a (mgr.14388) 19097 : cluster [DBG] pgmap v13240: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:32:59.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:32:58 smithi191 bash[24992]: cluster 2024-08-31T09:32:57.528031+0000 mgr.a (mgr.14388) 19098 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:32:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:32:58 smithi163 bash[24253]: cluster 2024-08-31T09:32:57.528031+0000 mgr.a (mgr.14388) 19098 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:32:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:32:58 smithi027 bash[22610]: cluster 2024-08-31T09:32:57.528031+0000 mgr.a (mgr.14388) 19098 : cluster [DBG] pgmap v13241: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:32:59.337 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:32:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:32:59.338 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:00.132 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:00.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:00 smithi191 bash[24992]: cluster 2024-08-31T09:32:59.529703+0000 mgr.a (mgr.14388) 19099 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:33:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:00 smithi191 bash[24992]: audit 2024-08-31T09:32:59.675479+0000 mgr.a (mgr.14388) 19100 : audit [DBG] from='client.410193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:00 smithi163 bash[24253]: cluster 2024-08-31T09:32:59.529703+0000 mgr.a (mgr.14388) 19099 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:33:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:00 smithi163 bash[24253]: audit 2024-08-31T09:32:59.675479+0000 mgr.a (mgr.14388) 19100 : audit [DBG] from='client.410193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:00 smithi027 bash[22610]: cluster 2024-08-31T09:32:59.529703+0000 mgr.a (mgr.14388) 19099 : cluster [DBG] pgmap v13242: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:33:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:00 smithi027 bash[22610]: audit 2024-08-31T09:32:59.675479+0000 mgr.a (mgr.14388) 19100 : audit [DBG] from='client.410193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:02 smithi191 bash[24992]: cluster 2024-08-31T09:33:01.530786+0000 mgr.a (mgr.14388) 19101 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:33:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:02 smithi163 bash[24253]: cluster 2024-08-31T09:33:01.530786+0000 mgr.a (mgr.14388) 19101 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:33:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:02 smithi027 bash[22610]: cluster 2024-08-31T09:33:01.530786+0000 mgr.a (mgr.14388) 19101 : cluster [DBG] pgmap v13243: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:33:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:04 smithi191 bash[24992]: cluster 2024-08-31T09:33:03.532984+0000 mgr.a (mgr.14388) 19102 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:33:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:04 smithi191 bash[24992]: audit 2024-08-31T09:33:03.782799+0000 mon.a (mon.0) 3420 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:33:05.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:33:05.134 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:33:05.134 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:04 smithi163 bash[24253]: cluster 2024-08-31T09:33:03.532984+0000 mgr.a (mgr.14388) 19102 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:33:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:04 smithi163 bash[24253]: audit 2024-08-31T09:33:03.782799+0000 mon.a (mon.0) 3420 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:33:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:04 smithi027 bash[22610]: cluster 2024-08-31T09:33:03.532984+0000 mgr.a (mgr.14388) 19102 : cluster [DBG] pgmap v13244: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:33:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:04 smithi027 bash[22610]: audit 2024-08-31T09:33:03.782799+0000 mon.a (mon.0) 3420 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:33:05.886 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:05.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:05.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:05.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:05.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:06 smithi191 bash[24992]: audit 2024-08-31T09:33:05.461713+0000 mgr.a (mgr.14388) 19103 : audit [DBG] from='client.410271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:06 smithi191 bash[24992]: cluster 2024-08-31T09:33:05.533701+0000 mgr.a (mgr.14388) 19104 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:06 smithi163 bash[24253]: audit 2024-08-31T09:33:05.461713+0000 mgr.a (mgr.14388) 19103 : audit [DBG] from='client.410271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:06 smithi163 bash[24253]: cluster 2024-08-31T09:33:05.533701+0000 mgr.a (mgr.14388) 19104 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:06 smithi027 bash[22610]: audit 2024-08-31T09:33:05.461713+0000 mgr.a (mgr.14388) 19103 : audit [DBG] from='client.410271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:06 smithi027 bash[22610]: cluster 2024-08-31T09:33:05.533701+0000 mgr.a (mgr.14388) 19104 : cluster [DBG] pgmap v13245: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:08 smithi191 bash[24992]: cluster 2024-08-31T09:33:07.534550+0000 mgr.a (mgr.14388) 19105 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:08 smithi163 bash[24253]: cluster 2024-08-31T09:33:07.534550+0000 mgr.a (mgr.14388) 19105 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:08 smithi027 bash[22610]: cluster 2024-08-31T09:33:07.534550+0000 mgr.a (mgr.14388) 19105 : cluster [DBG] pgmap v13246: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.129338+0000 mon.a (mon.0) 3421 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.135060+0000 mon.a (mon.0) 3422 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.146757+0000 mon.a (mon.0) 3423 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.151614+0000 mon.a (mon.0) 3424 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.157899+0000 mon.a (mon.0) 3425 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.164830+0000 mon.a (mon.0) 3426 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: cluster 2024-08-31T09:33:09.536658+0000 mgr.a (mgr.14388) 19106 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.893150+0000 mon.a (mon.0) 3427 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.894791+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.904980+0000 mon.a (mon.0) 3429 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.909758+0000 mon.a (mon.0) 3430 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:33:10.451 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:10 smithi163 bash[24253]: audit 2024-08-31T09:33:09.912104+0000 mgr.a (mgr.14388) 19107 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:33:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.129338+0000 mon.a (mon.0) 3421 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.135060+0000 mon.a (mon.0) 3422 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.146757+0000 mon.a (mon.0) 3423 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.151614+0000 mon.a (mon.0) 3424 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.157899+0000 mon.a (mon.0) 3425 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.164830+0000 mon.a (mon.0) 3426 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: cluster 2024-08-31T09:33:09.536658+0000 mgr.a (mgr.14388) 19106 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.893150+0000 mon.a (mon.0) 3427 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.894791+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.904980+0000 mon.a (mon.0) 3429 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.909758+0000 mon.a (mon.0) 3430 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:33:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22610]: audit 2024-08-31T09:33:09.912104+0000 mgr.a (mgr.14388) 19107 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.129338+0000 mon.a (mon.0) 3421 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.135060+0000 mon.a (mon.0) 3422 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.146757+0000 mon.a (mon.0) 3423 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.151614+0000 mon.a (mon.0) 3424 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.157899+0000 mon.a (mon.0) 3425 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.164830+0000 mon.a (mon.0) 3426 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: cluster 2024-08-31T09:33:09.536658+0000 mgr.a (mgr.14388) 19106 : cluster [DBG] pgmap v13247: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.893150+0000 mon.a (mon.0) 3427 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:33:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.894791+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:33:10.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.904980+0000 mon.a (mon.0) 3429 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:33:10.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.909758+0000 mon.a (mon.0) 3430 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:33:10.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:10 smithi191 bash[24992]: audit 2024-08-31T09:33:09.912104+0000 mgr.a (mgr.14388) 19107 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:33:10.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:33:10.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:33:10.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:10.982 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22863]: debug 2024-08-31T09:33:10.652+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:33:10.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:33:10 smithi027 bash[22863]: debug 2024-08-31T09:33:10.652+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:33:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:11 smithi163 bash[24253]: audit 2024-08-31T09:33:10.656622+0000 mgr.a (mgr.14388) 19108 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:33:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:11 smithi163 bash[24253]: cephadm 2024-08-31T09:33:10.657963+0000 mgr.a (mgr.14388) 19109 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:33:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:11 smithi027 bash[22610]: audit 2024-08-31T09:33:10.656622+0000 mgr.a (mgr.14388) 19108 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:33:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:11 smithi027 bash[22610]: cephadm 2024-08-31T09:33:10.657963+0000 mgr.a (mgr.14388) 19109 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:33:11.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:11 smithi191 bash[24992]: audit 2024-08-31T09:33:10.656622+0000 mgr.a (mgr.14388) 19108 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:33:11.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:11 smithi191 bash[24992]: cephadm 2024-08-31T09:33:10.657963+0000 mgr.a (mgr.14388) 19109 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:33:11.628 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:11.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:11.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:11.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:11.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:12 smithi191 bash[24992]: audit 2024-08-31T09:33:11.217986+0000 mgr.a (mgr.14388) 19110 : audit [DBG] from='client.410454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:12 smithi191 bash[24992]: cluster 2024-08-31T09:33:11.537339+0000 mgr.a (mgr.14388) 19111 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:12 smithi163 bash[24253]: audit 2024-08-31T09:33:11.217986+0000 mgr.a (mgr.14388) 19110 : audit [DBG] from='client.410454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:12 smithi163 bash[24253]: cluster 2024-08-31T09:33:11.537339+0000 mgr.a (mgr.14388) 19111 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:12 smithi027 bash[22610]: audit 2024-08-31T09:33:11.217986+0000 mgr.a (mgr.14388) 19110 : audit [DBG] from='client.410454 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:12 smithi027 bash[22610]: cluster 2024-08-31T09:33:11.537339+0000 mgr.a (mgr.14388) 19111 : cluster [DBG] pgmap v13248: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:14 smithi163 bash[24253]: cluster 2024-08-31T09:33:13.539479+0000 mgr.a (mgr.14388) 19112 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:14 smithi027 bash[22610]: cluster 2024-08-31T09:33:13.539479+0000 mgr.a (mgr.14388) 19112 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:14 smithi191 bash[24992]: cluster 2024-08-31T09:33:13.539479+0000 mgr.a (mgr.14388) 19112 : cluster [DBG] pgmap v13249: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:16.630 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:33:16.630 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:33:16.631 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:16 smithi163 bash[24253]: cluster 2024-08-31T09:33:15.540243+0000 mgr.a (mgr.14388) 19113 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:16.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:16 smithi027 bash[22610]: cluster 2024-08-31T09:33:15.540243+0000 mgr.a (mgr.14388) 19113 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:17.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:16 smithi191 bash[24992]: cluster 2024-08-31T09:33:15.540243+0000 mgr.a (mgr.14388) 19113 : cluster [DBG] pgmap v13250: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:17.395 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:17.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:17.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:17.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:17.395 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:18 smithi163 bash[24253]: audit 2024-08-31T09:33:16.964901+0000 mgr.a (mgr.14388) 19114 : audit [DBG] from='client.410529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:18.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:18 smithi163 bash[24253]: cluster 2024-08-31T09:33:17.541181+0000 mgr.a (mgr.14388) 19115 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:18 smithi027 bash[22610]: audit 2024-08-31T09:33:16.964901+0000 mgr.a (mgr.14388) 19114 : audit [DBG] from='client.410529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:18.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:18 smithi027 bash[22610]: cluster 2024-08-31T09:33:17.541181+0000 mgr.a (mgr.14388) 19115 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:18 smithi191 bash[24992]: audit 2024-08-31T09:33:16.964901+0000 mgr.a (mgr.14388) 19114 : audit [DBG] from='client.410529 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:19.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:18 smithi191 bash[24992]: cluster 2024-08-31T09:33:17.541181+0000 mgr.a (mgr.14388) 19115 : cluster [DBG] pgmap v13251: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:20 smithi163 bash[24253]: cluster 2024-08-31T09:33:19.543427+0000 mgr.a (mgr.14388) 19116 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:20 smithi027 bash[22610]: cluster 2024-08-31T09:33:19.543427+0000 mgr.a (mgr.14388) 19116 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:21.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:20 smithi191 bash[24992]: cluster 2024-08-31T09:33:19.543427+0000 mgr.a (mgr.14388) 19116 : cluster [DBG] pgmap v13252: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:22.396 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:33:22.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:33:22.397 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:22 smithi163 bash[24253]: cluster 2024-08-31T09:33:21.544196+0000 mgr.a (mgr.14388) 19117 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:22 smithi027 bash[22610]: cluster 2024-08-31T09:33:21.544196+0000 mgr.a (mgr.14388) 19117 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:22 smithi191 bash[24992]: cluster 2024-08-31T09:33:21.544196+0000 mgr.a (mgr.14388) 19117 : cluster [DBG] pgmap v13253: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:23.149 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:23.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:23.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:23.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:23.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:23 smithi163 bash[24253]: audit 2024-08-31T09:33:22.728629+0000 mgr.a (mgr.14388) 19118 : audit [DBG] from='client.410607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:23 smithi027 bash[22610]: audit 2024-08-31T09:33:22.728629+0000 mgr.a (mgr.14388) 19118 : audit [DBG] from='client.410607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:23 smithi191 bash[24992]: audit 2024-08-31T09:33:22.728629+0000 mgr.a (mgr.14388) 19118 : audit [DBG] from='client.410607 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:24 smithi163 bash[24253]: cluster 2024-08-31T09:33:23.546476+0000 mgr.a (mgr.14388) 19119 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:24 smithi027 bash[22610]: cluster 2024-08-31T09:33:23.546476+0000 mgr.a (mgr.14388) 19119 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:24 smithi191 bash[24992]: cluster 2024-08-31T09:33:23.546476+0000 mgr.a (mgr.14388) 19119 : cluster [DBG] pgmap v13254: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:33:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:26 smithi163 bash[24253]: cluster 2024-08-31T09:33:25.547287+0000 mgr.a (mgr.14388) 19120 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:33:26.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:26 smithi027 bash[22610]: cluster 2024-08-31T09:33:25.547287+0000 mgr.a (mgr.14388) 19120 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:33:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:26 smithi191 bash[24992]: cluster 2024-08-31T09:33:25.547287+0000 mgr.a (mgr.14388) 19120 : cluster [DBG] pgmap v13255: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:33:28.151 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:33:28.151 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:33:28.152 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:28.915 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:28.915 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:28.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:28.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:28.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:28 smithi163 bash[24253]: cluster 2024-08-31T09:33:27.548067+0000 mgr.a (mgr.14388) 19121 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:33:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:28 smithi027 bash[22610]: cluster 2024-08-31T09:33:27.548067+0000 mgr.a (mgr.14388) 19121 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:33:29.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:28 smithi191 bash[24992]: cluster 2024-08-31T09:33:27.548067+0000 mgr.a (mgr.14388) 19121 : cluster [DBG] pgmap v13256: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:33:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:29 smithi163 bash[24253]: audit 2024-08-31T09:33:28.481489+0000 mgr.a (mgr.14388) 19122 : audit [DBG] from='client.410685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:29 smithi027 bash[22610]: audit 2024-08-31T09:33:28.481489+0000 mgr.a (mgr.14388) 19122 : audit [DBG] from='client.410685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:29 smithi191 bash[24992]: audit 2024-08-31T09:33:28.481489+0000 mgr.a (mgr.14388) 19122 : audit [DBG] from='client.410685 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:30.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:30 smithi163 bash[24253]: cluster 2024-08-31T09:33:29.550935+0000 mgr.a (mgr.14388) 19123 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:30 smithi027 bash[22610]: cluster 2024-08-31T09:33:29.550935+0000 mgr.a (mgr.14388) 19123 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:30 smithi191 bash[24992]: cluster 2024-08-31T09:33:29.550935+0000 mgr.a (mgr.14388) 19123 : cluster [DBG] pgmap v13257: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:32.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:32 smithi163 bash[24253]: cluster 2024-08-31T09:33:31.551837+0000 mgr.a (mgr.14388) 19124 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:33:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:32 smithi027 bash[22610]: cluster 2024-08-31T09:33:31.551837+0000 mgr.a (mgr.14388) 19124 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:33:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:32 smithi191 bash[24992]: cluster 2024-08-31T09:33:31.551837+0000 mgr.a (mgr.14388) 19124 : cluster [DBG] pgmap v13258: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:33:33.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:33:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:33:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:34.657 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:34.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:34.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:34.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:34.657 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:34 smithi163 bash[24253]: cluster 2024-08-31T09:33:33.553776+0000 mgr.a (mgr.14388) 19125 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:34 smithi027 bash[22610]: cluster 2024-08-31T09:33:33.553776+0000 mgr.a (mgr.14388) 19125 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:34 smithi191 bash[24992]: cluster 2024-08-31T09:33:33.553776+0000 mgr.a (mgr.14388) 19125 : cluster [DBG] pgmap v13259: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:35 smithi163 bash[24253]: audit 2024-08-31T09:33:34.246603+0000 mgr.a (mgr.14388) 19126 : audit [DBG] from='client.410757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:35 smithi027 bash[22610]: audit 2024-08-31T09:33:34.246603+0000 mgr.a (mgr.14388) 19126 : audit [DBG] from='client.410757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:35 smithi191 bash[24992]: audit 2024-08-31T09:33:34.246603+0000 mgr.a (mgr.14388) 19126 : audit [DBG] from='client.410757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:36 smithi163 bash[24253]: cluster 2024-08-31T09:33:35.554644+0000 mgr.a (mgr.14388) 19127 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:33:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:36 smithi027 bash[22610]: cluster 2024-08-31T09:33:35.554644+0000 mgr.a (mgr.14388) 19127 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:33:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:36 smithi191 bash[24992]: cluster 2024-08-31T09:33:35.554644+0000 mgr.a (mgr.14388) 19127 : cluster [DBG] pgmap v13260: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:33:38.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:38 smithi163 bash[24253]: cluster 2024-08-31T09:33:37.555445+0000 mgr.a (mgr.14388) 19128 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:33:38.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:38 smithi027 bash[22610]: cluster 2024-08-31T09:33:37.555445+0000 mgr.a (mgr.14388) 19128 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:33:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:38 smithi191 bash[24992]: cluster 2024-08-31T09:33:37.555445+0000 mgr.a (mgr.14388) 19128 : cluster [DBG] pgmap v13261: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:33:39.658 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:33:39.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:33:39.659 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:40.443 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:40.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:40.443 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:40.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:40.444 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:40.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:40 smithi163 bash[24253]: cluster 2024-08-31T09:33:39.557630+0000 mgr.a (mgr.14388) 19129 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:33:40.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:40 smithi027 bash[22610]: cluster 2024-08-31T09:33:39.557630+0000 mgr.a (mgr.14388) 19129 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:33:41.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:40 smithi191 bash[24992]: cluster 2024-08-31T09:33:39.557630+0000 mgr.a (mgr.14388) 19129 : cluster [DBG] pgmap v13262: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:33:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:41 smithi163 bash[24253]: audit 2024-08-31T09:33:39.998446+0000 mgr.a (mgr.14388) 19130 : audit [DBG] from='client.410832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:41 smithi027 bash[22610]: audit 2024-08-31T09:33:39.998446+0000 mgr.a (mgr.14388) 19130 : audit [DBG] from='client.410832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:41 smithi191 bash[24992]: audit 2024-08-31T09:33:39.998446+0000 mgr.a (mgr.14388) 19130 : audit [DBG] from='client.410832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:42.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:42 smithi163 bash[24253]: cluster 2024-08-31T09:33:41.558521+0000 mgr.a (mgr.14388) 19131 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:42.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:42 smithi027 bash[22610]: cluster 2024-08-31T09:33:41.558521+0000 mgr.a (mgr.14388) 19131 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:42 smithi191 bash[24992]: cluster 2024-08-31T09:33:41.558521+0000 mgr.a (mgr.14388) 19131 : cluster [DBG] pgmap v13263: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:44.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:44 smithi163 bash[24253]: cluster 2024-08-31T09:33:43.560658+0000 mgr.a (mgr.14388) 19132 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:44.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:44 smithi027 bash[22610]: cluster 2024-08-31T09:33:43.560658+0000 mgr.a (mgr.14388) 19132 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:44 smithi191 bash[24992]: cluster 2024-08-31T09:33:43.560658+0000 mgr.a (mgr.14388) 19132 : cluster [DBG] pgmap v13264: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:45.445 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:33:45.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:33:45.445 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:46.223 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:46.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:46.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:46.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:46.224 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:46 smithi163 bash[24253]: cluster 2024-08-31T09:33:45.561123+0000 mgr.a (mgr.14388) 19133 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:46.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:46 smithi163 bash[24253]: audit 2024-08-31T09:33:45.781197+0000 mgr.a (mgr.14388) 19134 : audit [DBG] from='client.410904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:46 smithi027 bash[22610]: cluster 2024-08-31T09:33:45.561123+0000 mgr.a (mgr.14388) 19133 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:46.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:46 smithi027 bash[22610]: audit 2024-08-31T09:33:45.781197+0000 mgr.a (mgr.14388) 19134 : audit [DBG] from='client.410904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:46 smithi191 bash[24992]: cluster 2024-08-31T09:33:45.561123+0000 mgr.a (mgr.14388) 19133 : cluster [DBG] pgmap v13265: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:47.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:46 smithi191 bash[24992]: audit 2024-08-31T09:33:45.781197+0000 mgr.a (mgr.14388) 19134 : audit [DBG] from='client.410904 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:48.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:48 smithi027 bash[22610]: cluster 2024-08-31T09:33:47.561947+0000 mgr.a (mgr.14388) 19135 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:49.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:48 smithi191 bash[24992]: cluster 2024-08-31T09:33:47.561947+0000 mgr.a (mgr.14388) 19135 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:48 smithi163 bash[24253]: cluster 2024-08-31T09:33:47.561947+0000 mgr.a (mgr.14388) 19135 : cluster [DBG] pgmap v13266: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:50 smithi027 bash[22610]: cluster 2024-08-31T09:33:49.564174+0000 mgr.a (mgr.14388) 19136 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:50 smithi191 bash[24992]: cluster 2024-08-31T09:33:49.564174+0000 mgr.a (mgr.14388) 19136 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:50 smithi163 bash[24253]: cluster 2024-08-31T09:33:49.564174+0000 mgr.a (mgr.14388) 19136 : cluster [DBG] pgmap v13267: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:51.225 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:33:51.225 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:33:51.226 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:51.959 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:51.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:51.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:51.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:51.960 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:52 smithi027 bash[22610]: audit 2024-08-31T09:33:51.553068+0000 mgr.a (mgr.14388) 19137 : audit [DBG] from='client.410982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:52.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:52 smithi027 bash[22610]: cluster 2024-08-31T09:33:51.569501+0000 mgr.a (mgr.14388) 19138 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:52 smithi191 bash[24992]: audit 2024-08-31T09:33:51.553068+0000 mgr.a (mgr.14388) 19137 : audit [DBG] from='client.410982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:52 smithi191 bash[24992]: cluster 2024-08-31T09:33:51.569501+0000 mgr.a (mgr.14388) 19138 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:52 smithi163 bash[24253]: audit 2024-08-31T09:33:51.553068+0000 mgr.a (mgr.14388) 19137 : audit [DBG] from='client.410982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:52 smithi163 bash[24253]: cluster 2024-08-31T09:33:51.569501+0000 mgr.a (mgr.14388) 19138 : cluster [DBG] pgmap v13268: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:54.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:54 smithi027 bash[22610]: cluster 2024-08-31T09:33:53.572066+0000 mgr.a (mgr.14388) 19139 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:54 smithi191 bash[24992]: cluster 2024-08-31T09:33:53.572066+0000 mgr.a (mgr.14388) 19139 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:54 smithi163 bash[24253]: cluster 2024-08-31T09:33:53.572066+0000 mgr.a (mgr.14388) 19139 : cluster [DBG] pgmap v13269: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:33:56.961 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:33:56.962 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:33:56.963 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:33:56.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:56 smithi027 bash[22610]: cluster 2024-08-31T09:33:55.572868+0000 mgr.a (mgr.14388) 19140 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:56 smithi191 bash[24992]: cluster 2024-08-31T09:33:55.572868+0000 mgr.a (mgr.14388) 19140 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:56 smithi163 bash[24253]: cluster 2024-08-31T09:33:55.572868+0000 mgr.a (mgr.14388) 19140 : cluster [DBG] pgmap v13270: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:57.721 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:33:57.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:33:57.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:33:57.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:33:57.721 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:33:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:58 smithi027 bash[22610]: audit 2024-08-31T09:33:57.293667+0000 mgr.a (mgr.14388) 19141 : audit [DBG] from='client.411054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:58.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:33:58 smithi027 bash[22610]: cluster 2024-08-31T09:33:57.573335+0000 mgr.a (mgr.14388) 19142 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:58 smithi191 bash[24992]: audit 2024-08-31T09:33:57.293667+0000 mgr.a (mgr.14388) 19141 : audit [DBG] from='client.411054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:33:58 smithi191 bash[24992]: cluster 2024-08-31T09:33:57.573335+0000 mgr.a (mgr.14388) 19142 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:33:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:58 smithi163 bash[24253]: audit 2024-08-31T09:33:57.293667+0000 mgr.a (mgr.14388) 19141 : audit [DBG] from='client.411054 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:33:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:33:58 smithi163 bash[24253]: cluster 2024-08-31T09:33:57.573335+0000 mgr.a (mgr.14388) 19142 : cluster [DBG] pgmap v13271: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:00 smithi027 bash[22610]: cluster 2024-08-31T09:33:59.575728+0000 mgr.a (mgr.14388) 19143 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:34:01.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:00 smithi191 bash[24992]: cluster 2024-08-31T09:33:59.575728+0000 mgr.a (mgr.14388) 19143 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:34:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:00 smithi163 bash[24253]: cluster 2024-08-31T09:33:59.575728+0000 mgr.a (mgr.14388) 19143 : cluster [DBG] pgmap v13272: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:34:02.723 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:34:02.723 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:34:02.723 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:34:02.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:02 smithi027 bash[22610]: cluster 2024-08-31T09:34:01.576565+0000 mgr.a (mgr.14388) 19144 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:02 smithi191 bash[24992]: cluster 2024-08-31T09:34:01.576565+0000 mgr.a (mgr.14388) 19144 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:02 smithi163 bash[24253]: cluster 2024-08-31T09:34:01.576565+0000 mgr.a (mgr.14388) 19144 : cluster [DBG] pgmap v13273: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:03.493 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:34:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:34:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:34:03.493 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:34:03.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:34:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:04 smithi191 bash[24992]: audit 2024-08-31T09:34:03.059746+0000 mgr.a (mgr.14388) 19145 : audit [DBG] from='client.411129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:04 smithi191 bash[24992]: cluster 2024-08-31T09:34:03.579480+0000 mgr.a (mgr.14388) 19146 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:04 smithi163 bash[24253]: audit 2024-08-31T09:34:03.059746+0000 mgr.a (mgr.14388) 19145 : audit [DBG] from='client.411129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:04 smithi163 bash[24253]: cluster 2024-08-31T09:34:03.579480+0000 mgr.a (mgr.14388) 19146 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:04 smithi027 bash[22610]: audit 2024-08-31T09:34:03.059746+0000 mgr.a (mgr.14388) 19145 : audit [DBG] from='client.411129 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:04 smithi027 bash[22610]: cluster 2024-08-31T09:34:03.579480+0000 mgr.a (mgr.14388) 19146 : cluster [DBG] pgmap v13274: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:06 smithi191 bash[24992]: cluster 2024-08-31T09:34:05.580409+0000 mgr.a (mgr.14388) 19147 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:34:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:06 smithi163 bash[24253]: cluster 2024-08-31T09:34:05.580409+0000 mgr.a (mgr.14388) 19147 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:34:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:06 smithi027 bash[22610]: cluster 2024-08-31T09:34:05.580409+0000 mgr.a (mgr.14388) 19147 : cluster [DBG] pgmap v13275: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:34:08.494 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:34:08.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:34:08.495 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:34:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:08 smithi191 bash[24992]: cluster 2024-08-31T09:34:07.581160+0000 mgr.a (mgr.14388) 19148 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:34:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:08 smithi163 bash[24253]: cluster 2024-08-31T09:34:07.581160+0000 mgr.a (mgr.14388) 19148 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:34:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:08 smithi027 bash[22610]: cluster 2024-08-31T09:34:07.581160+0000 mgr.a (mgr.14388) 19148 : cluster [DBG] pgmap v13276: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:34:09.238 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:34:09.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:34:09.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:34:09.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:34:09.239 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:34:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:09 smithi191 bash[24992]: audit 2024-08-31T09:34:08.829411+0000 mgr.a (mgr.14388) 19149 : audit [DBG] from='client.411201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:10.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:09 smithi163 bash[24253]: audit 2024-08-31T09:34:08.829411+0000 mgr.a (mgr.14388) 19149 : audit [DBG] from='client.411201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:09 smithi027 bash[22610]: audit 2024-08-31T09:34:08.829411+0000 mgr.a (mgr.14388) 19149 : audit [DBG] from='client.411201 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:10 smithi191 bash[24992]: cluster 2024-08-31T09:34:09.584002+0000 mgr.a (mgr.14388) 19150 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:11.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:10 smithi191 bash[24992]: audit 2024-08-31T09:34:10.707356+0000 mon.a (mon.0) 3431 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:34:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:10 smithi163 bash[24253]: cluster 2024-08-31T09:34:09.584002+0000 mgr.a (mgr.14388) 19150 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:10 smithi163 bash[24253]: audit 2024-08-31T09:34:10.707356+0000 mon.a (mon.0) 3431 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:34:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:10 smithi027 bash[22610]: cluster 2024-08-31T09:34:09.584002+0000 mgr.a (mgr.14388) 19150 : cluster [DBG] pgmap v13277: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:10 smithi027 bash[22610]: audit 2024-08-31T09:34:10.707356+0000 mon.a (mon.0) 3431 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:34:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:11 smithi191 bash[24992]: audit 2024-08-31T09:34:11.546848+0000 mon.a (mon.0) 3432 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:34:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:11 smithi191 bash[24992]: audit 2024-08-31T09:34:11.548571+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:34:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:11 smithi191 bash[24992]: audit 2024-08-31T09:34:11.558639+0000 mon.a (mon.0) 3434 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:34:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:11 smithi191 bash[24992]: audit 2024-08-31T09:34:11.561649+0000 mon.a (mon.0) 3435 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:34:12.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:11 smithi163 bash[24253]: audit 2024-08-31T09:34:11.546848+0000 mon.a (mon.0) 3432 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:34:12.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:11 smithi163 bash[24253]: audit 2024-08-31T09:34:11.548571+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:34:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:11 smithi163 bash[24253]: audit 2024-08-31T09:34:11.558639+0000 mon.a (mon.0) 3434 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:34:12.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:11 smithi163 bash[24253]: audit 2024-08-31T09:34:11.561649+0000 mon.a (mon.0) 3435 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:34:12.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:11 smithi027 bash[22610]: audit 2024-08-31T09:34:11.546848+0000 mon.a (mon.0) 3432 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:34:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:11 smithi027 bash[22610]: audit 2024-08-31T09:34:11.548571+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:34:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:11 smithi027 bash[22610]: audit 2024-08-31T09:34:11.558639+0000 mon.a (mon.0) 3434 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:34:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:11 smithi027 bash[22610]: audit 2024-08-31T09:34:11.561649+0000 mon.a (mon.0) 3435 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:34:12.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:34:12 smithi027 bash[22863]: debug 2024-08-31T09:34:12.350+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:34:12.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:34:12 smithi027 bash[22863]: debug 2024-08-31T09:34:12.350+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:34:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:12 smithi191 bash[24992]: audit 2024-08-31T09:34:11.564066+0000 mgr.a (mgr.14388) 19151 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:34:13.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:12 smithi191 bash[24992]: cluster 2024-08-31T09:34:11.585488+0000 mgr.a (mgr.14388) 19152 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:34:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:12 smithi163 bash[24253]: audit 2024-08-31T09:34:11.564066+0000 mgr.a (mgr.14388) 19151 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:34:13.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:12 smithi163 bash[24253]: cluster 2024-08-31T09:34:11.585488+0000 mgr.a (mgr.14388) 19152 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:34:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:12 smithi027 bash[22610]: audit 2024-08-31T09:34:11.564066+0000 mgr.a (mgr.14388) 19151 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:34:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:12 smithi027 bash[22610]: cluster 2024-08-31T09:34:11.585488+0000 mgr.a (mgr.14388) 19152 : cluster [DBG] pgmap v13278: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:34:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:13 smithi191 bash[24992]: audit 2024-08-31T09:34:12.352102+0000 mgr.a (mgr.14388) 19153 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:34:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:13 smithi191 bash[24992]: cephadm 2024-08-31T09:34:12.353791+0000 mgr.a (mgr.14388) 19154 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:34:14.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:13 smithi163 bash[24253]: audit 2024-08-31T09:34:12.352102+0000 mgr.a (mgr.14388) 19153 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:34:14.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:13 smithi163 bash[24253]: cephadm 2024-08-31T09:34:12.353791+0000 mgr.a (mgr.14388) 19154 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:34:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:13 smithi027 bash[22610]: audit 2024-08-31T09:34:12.352102+0000 mgr.a (mgr.14388) 19153 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:34:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:13 smithi027 bash[22610]: cephadm 2024-08-31T09:34:12.353791+0000 mgr.a (mgr.14388) 19154 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:34:14.240 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:34:14.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:34:14.241 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:34:15.021 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:34:15.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:34:15.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:34:15.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:34:15.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:34:15.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:14 smithi191 bash[24992]: cluster 2024-08-31T09:34:13.587931+0000 mgr.a (mgr.14388) 19155 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:14 smithi163 bash[24253]: cluster 2024-08-31T09:34:13.587931+0000 mgr.a (mgr.14388) 19155 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:14 smithi027 bash[22610]: cluster 2024-08-31T09:34:13.587931+0000 mgr.a (mgr.14388) 19155 : cluster [DBG] pgmap v13279: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:15 smithi191 bash[24992]: audit 2024-08-31T09:34:14.580663+0000 mgr.a (mgr.14388) 19156 : audit [DBG] from='client.411387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:16.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:15 smithi163 bash[24253]: audit 2024-08-31T09:34:14.580663+0000 mgr.a (mgr.14388) 19156 : audit [DBG] from='client.411387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:15 smithi027 bash[22610]: audit 2024-08-31T09:34:14.580663+0000 mgr.a (mgr.14388) 19156 : audit [DBG] from='client.411387 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:16 smithi191 bash[24992]: cluster 2024-08-31T09:34:15.588962+0000 mgr.a (mgr.14388) 19157 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:16 smithi163 bash[24253]: cluster 2024-08-31T09:34:15.588962+0000 mgr.a (mgr.14388) 19157 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:16 smithi027 bash[22610]: cluster 2024-08-31T09:34:15.588962+0000 mgr.a (mgr.14388) 19157 : cluster [DBG] pgmap v13280: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:18 smithi163 bash[24253]: cluster 2024-08-31T09:34:17.589950+0000 mgr.a (mgr.14388) 19158 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:18 smithi027 bash[22610]: cluster 2024-08-31T09:34:17.589950+0000 mgr.a (mgr.14388) 19158 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:18 smithi191 bash[24992]: cluster 2024-08-31T09:34:17.589950+0000 mgr.a (mgr.14388) 19158 : cluster [DBG] pgmap v13281: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:20.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:34:20.023 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:34:20.024 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:34:20.771 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:34:20.771 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:34:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:34:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:34:20.772 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:34:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:20 smithi163 bash[24253]: cluster 2024-08-31T09:34:19.592214+0000 mgr.a (mgr.14388) 19159 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:20 smithi027 bash[22610]: cluster 2024-08-31T09:34:19.592214+0000 mgr.a (mgr.14388) 19159 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:20 smithi191 bash[24992]: cluster 2024-08-31T09:34:19.592214+0000 mgr.a (mgr.14388) 19159 : cluster [DBG] pgmap v13282: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:21 smithi163 bash[24253]: audit 2024-08-31T09:34:20.357566+0000 mgr.a (mgr.14388) 19160 : audit [DBG] from='client.411465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:21 smithi027 bash[22610]: audit 2024-08-31T09:34:20.357566+0000 mgr.a (mgr.14388) 19160 : audit [DBG] from='client.411465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:21 smithi191 bash[24992]: audit 2024-08-31T09:34:20.357566+0000 mgr.a (mgr.14388) 19160 : audit [DBG] from='client.411465 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:22 smithi163 bash[24253]: cluster 2024-08-31T09:34:21.593303+0000 mgr.a (mgr.14388) 19161 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:22 smithi027 bash[22610]: cluster 2024-08-31T09:34:21.593303+0000 mgr.a (mgr.14388) 19161 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:22 smithi191 bash[24992]: cluster 2024-08-31T09:34:21.593303+0000 mgr.a (mgr.14388) 19161 : cluster [DBG] pgmap v13283: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:24 smithi163 bash[24253]: cluster 2024-08-31T09:34:23.595517+0000 mgr.a (mgr.14388) 19162 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:24 smithi027 bash[22610]: cluster 2024-08-31T09:34:23.595517+0000 mgr.a (mgr.14388) 19162 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:24 smithi191 bash[24992]: cluster 2024-08-31T09:34:23.595517+0000 mgr.a (mgr.14388) 19162 : cluster [DBG] pgmap v13284: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:34:25.773 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:34:25.774 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:34:25.774 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:34:26.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:34:26.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:34:26.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:34:26.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:34:26.552 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:34:27.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:26 smithi163 bash[24253]: cluster 2024-08-31T09:34:25.596311+0000 mgr.a (mgr.14388) 19163 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:26 smithi027 bash[22610]: cluster 2024-08-31T09:34:25.596311+0000 mgr.a (mgr.14388) 19163 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:26 smithi191 bash[24992]: cluster 2024-08-31T09:34:25.596311+0000 mgr.a (mgr.14388) 19163 : cluster [DBG] pgmap v13285: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:28.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:27 smithi163 bash[24253]: audit 2024-08-31T09:34:26.112368+0000 mgr.a (mgr.14388) 19164 : audit [DBG] from='client.411543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:27 smithi027 bash[22610]: audit 2024-08-31T09:34:26.112368+0000 mgr.a (mgr.14388) 19164 : audit [DBG] from='client.411543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:27 smithi191 bash[24992]: audit 2024-08-31T09:34:26.112368+0000 mgr.a (mgr.14388) 19164 : audit [DBG] from='client.411543 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:28 smithi163 bash[24253]: cluster 2024-08-31T09:34:27.597275+0000 mgr.a (mgr.14388) 19165 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:28 smithi027 bash[22610]: cluster 2024-08-31T09:34:27.597275+0000 mgr.a (mgr.14388) 19165 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:28 smithi191 bash[24992]: cluster 2024-08-31T09:34:27.597275+0000 mgr.a (mgr.14388) 19165 : cluster [DBG] pgmap v13286: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:30 smithi163 bash[24253]: cluster 2024-08-31T09:34:29.599530+0000 mgr.a (mgr.14388) 19166 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:34:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:30 smithi027 bash[22610]: cluster 2024-08-31T09:34:29.599530+0000 mgr.a (mgr.14388) 19166 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:34:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:30 smithi191 bash[24992]: cluster 2024-08-31T09:34:29.599530+0000 mgr.a (mgr.14388) 19166 : cluster [DBG] pgmap v13287: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:34:31.553 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:34:31.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:34:31.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:34:32.309 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:34:32.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:34:32.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:34:32.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:34:32.310 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:34:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:32 smithi163 bash[24253]: cluster 2024-08-31T09:34:31.600128+0000 mgr.a (mgr.14388) 19167 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:32 smithi163 bash[24253]: audit 2024-08-31T09:34:31.886143+0000 mgr.a (mgr.14388) 19168 : audit [DBG] from='client.411621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:32 smithi027 bash[22610]: cluster 2024-08-31T09:34:31.600128+0000 mgr.a (mgr.14388) 19167 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:32 smithi027 bash[22610]: audit 2024-08-31T09:34:31.886143+0000 mgr.a (mgr.14388) 19168 : audit [DBG] from='client.411621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:32 smithi191 bash[24992]: cluster 2024-08-31T09:34:31.600128+0000 mgr.a (mgr.14388) 19167 : cluster [DBG] pgmap v13288: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:32 smithi191 bash[24992]: audit 2024-08-31T09:34:31.886143+0000 mgr.a (mgr.14388) 19168 : audit [DBG] from='client.411621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:34 smithi163 bash[24253]: cluster 2024-08-31T09:34:33.602492+0000 mgr.a (mgr.14388) 19169 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:34:35.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:34 smithi027 bash[22610]: cluster 2024-08-31T09:34:33.602492+0000 mgr.a (mgr.14388) 19169 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:34:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:34 smithi191 bash[24992]: cluster 2024-08-31T09:34:33.602492+0000 mgr.a (mgr.14388) 19169 : cluster [DBG] pgmap v13289: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:34:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:36 smithi163 bash[24253]: cluster 2024-08-31T09:34:35.603291+0000 mgr.a (mgr.14388) 19170 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:36 smithi027 bash[22610]: cluster 2024-08-31T09:34:35.603291+0000 mgr.a (mgr.14388) 19170 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:36 smithi191 bash[24992]: cluster 2024-08-31T09:34:35.603291+0000 mgr.a (mgr.14388) 19170 : cluster [DBG] pgmap v13290: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:37.311 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:34:37.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:34:37.312 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:34:38.081 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:34:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:34:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:34:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:34:38.082 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:34:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:38 smithi163 bash[24253]: cluster 2024-08-31T09:34:37.604094+0000 mgr.a (mgr.14388) 19171 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:38 smithi163 bash[24253]: audit 2024-08-31T09:34:37.643456+0000 mgr.a (mgr.14388) 19172 : audit [DBG] from='client.411699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:38 smithi027 bash[22610]: cluster 2024-08-31T09:34:37.604094+0000 mgr.a (mgr.14388) 19171 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:38 smithi027 bash[22610]: audit 2024-08-31T09:34:37.643456+0000 mgr.a (mgr.14388) 19172 : audit [DBG] from='client.411699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:39.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:38 smithi191 bash[24992]: cluster 2024-08-31T09:34:37.604094+0000 mgr.a (mgr.14388) 19171 : cluster [DBG] pgmap v13291: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:39.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:38 smithi191 bash[24992]: audit 2024-08-31T09:34:37.643456+0000 mgr.a (mgr.14388) 19172 : audit [DBG] from='client.411699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:40 smithi163 bash[24253]: cluster 2024-08-31T09:34:39.606608+0000 mgr.a (mgr.14388) 19173 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:34:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:40 smithi027 bash[22610]: cluster 2024-08-31T09:34:39.606608+0000 mgr.a (mgr.14388) 19173 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:34:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:40 smithi191 bash[24992]: cluster 2024-08-31T09:34:39.606608+0000 mgr.a (mgr.14388) 19173 : cluster [DBG] pgmap v13292: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-08-31T09:34:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:34:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:34:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:34:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:42 smithi163 bash[24253]: cluster 2024-08-31T09:34:41.607396+0000 mgr.a (mgr.14388) 19174 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:34:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:42 smithi027 bash[22610]: cluster 2024-08-31T09:34:41.607396+0000 mgr.a (mgr.14388) 19174 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:34:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:42 smithi191 bash[24992]: cluster 2024-08-31T09:34:41.607396+0000 mgr.a (mgr.14388) 19174 : cluster [DBG] pgmap v13293: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:34:43.869 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:34:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:34:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:34:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:34:43.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:34:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:44 smithi163 bash[24253]: audit 2024-08-31T09:34:43.418787+0000 mgr.a (mgr.14388) 19175 : audit [DBG] from='client.411777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:44 smithi163 bash[24253]: cluster 2024-08-31T09:34:43.609265+0000 mgr.a (mgr.14388) 19176 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:44 smithi027 bash[22610]: audit 2024-08-31T09:34:43.418787+0000 mgr.a (mgr.14388) 19175 : audit [DBG] from='client.411777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:44 smithi027 bash[22610]: cluster 2024-08-31T09:34:43.609265+0000 mgr.a (mgr.14388) 19176 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:44 smithi191 bash[24992]: audit 2024-08-31T09:34:43.418787+0000 mgr.a (mgr.14388) 19175 : audit [DBG] from='client.411777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:44 smithi191 bash[24992]: cluster 2024-08-31T09:34:43.609265+0000 mgr.a (mgr.14388) 19176 : cluster [DBG] pgmap v13294: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:46 smithi163 bash[24253]: cluster 2024-08-31T09:34:45.610331+0000 mgr.a (mgr.14388) 19177 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:34:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:46 smithi027 bash[22610]: cluster 2024-08-31T09:34:45.610331+0000 mgr.a (mgr.14388) 19177 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:34:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:46 smithi191 bash[24992]: cluster 2024-08-31T09:34:45.610331+0000 mgr.a (mgr.14388) 19177 : cluster [DBG] pgmap v13295: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:34:48.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:34:48.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:34:48.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:34:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:48 smithi163 bash[24253]: cluster 2024-08-31T09:34:47.611313+0000 mgr.a (mgr.14388) 19178 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:34:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:48 smithi027 bash[22610]: cluster 2024-08-31T09:34:47.611313+0000 mgr.a (mgr.14388) 19178 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:34:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:48 smithi191 bash[24992]: cluster 2024-08-31T09:34:47.611313+0000 mgr.a (mgr.14388) 19178 : cluster [DBG] pgmap v13296: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:34:49.634 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:34:49.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:34:49.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:34:49.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:34:49.634 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:34:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:50 smithi163 bash[24253]: audit 2024-08-31T09:34:49.206435+0000 mgr.a (mgr.14388) 19179 : audit [DBG] from='client.411852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:50 smithi163 bash[24253]: cluster 2024-08-31T09:34:49.612894+0000 mgr.a (mgr.14388) 19180 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:50 smithi027 bash[22610]: audit 2024-08-31T09:34:49.206435+0000 mgr.a (mgr.14388) 19179 : audit [DBG] from='client.411852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:50 smithi027 bash[22610]: cluster 2024-08-31T09:34:49.612894+0000 mgr.a (mgr.14388) 19180 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:50 smithi191 bash[24992]: audit 2024-08-31T09:34:49.206435+0000 mgr.a (mgr.14388) 19179 : audit [DBG] from='client.411852 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:50 smithi191 bash[24992]: cluster 2024-08-31T09:34:49.612894+0000 mgr.a (mgr.14388) 19180 : cluster [DBG] pgmap v13297: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:34:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:52 smithi163 bash[24253]: cluster 2024-08-31T09:34:51.613645+0000 mgr.a (mgr.14388) 19181 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:34:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:52 smithi027 bash[22610]: cluster 2024-08-31T09:34:51.613645+0000 mgr.a (mgr.14388) 19181 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:34:53.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:52 smithi191 bash[24992]: cluster 2024-08-31T09:34:51.613645+0000 mgr.a (mgr.14388) 19181 : cluster [DBG] pgmap v13298: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:34:54.635 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:34:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:34:54.636 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:34:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:54 smithi163 bash[24253]: cluster 2024-08-31T09:34:53.615561+0000 mgr.a (mgr.14388) 19182 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-08-31T09:34:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:54 smithi027 bash[22610]: cluster 2024-08-31T09:34:53.615561+0000 mgr.a (mgr.14388) 19182 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-08-31T09:34:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:54 smithi191 bash[24992]: cluster 2024-08-31T09:34:53.615561+0000 mgr.a (mgr.14388) 19182 : cluster [DBG] pgmap v13299: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 2 op/s 2024-08-31T09:34:55.378 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:34:55.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:34:55.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:34:55.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:34:55.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:34:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:56 smithi163 bash[24253]: audit 2024-08-31T09:34:54.967115+0000 mgr.a (mgr.14388) 19183 : audit [DBG] from='client.411930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:56 smithi163 bash[24253]: cluster 2024-08-31T09:34:55.616502+0000 mgr.a (mgr.14388) 19184 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:34:57.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:56 smithi027 bash[22610]: audit 2024-08-31T09:34:54.967115+0000 mgr.a (mgr.14388) 19183 : audit [DBG] from='client.411930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:56 smithi027 bash[22610]: cluster 2024-08-31T09:34:55.616502+0000 mgr.a (mgr.14388) 19184 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:34:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:56 smithi191 bash[24992]: audit 2024-08-31T09:34:54.967115+0000 mgr.a (mgr.14388) 19183 : audit [DBG] from='client.411930 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:34:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:56 smithi191 bash[24992]: cluster 2024-08-31T09:34:55.616502+0000 mgr.a (mgr.14388) 19184 : cluster [DBG] pgmap v13300: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:34:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:34:58 smithi163 bash[24253]: cluster 2024-08-31T09:34:57.617347+0000 mgr.a (mgr.14388) 19185 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:34:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:34:58 smithi027 bash[22610]: cluster 2024-08-31T09:34:57.617347+0000 mgr.a (mgr.14388) 19185 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:34:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:34:58 smithi191 bash[24992]: cluster 2024-08-31T09:34:57.617347+0000 mgr.a (mgr.14388) 19185 : cluster [DBG] pgmap v13301: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:35:00.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:00.380 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:00.380 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:01.133 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:01.133 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:01.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:01.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:01.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:00 smithi163 bash[24253]: cluster 2024-08-31T09:34:59.619556+0000 mgr.a (mgr.14388) 19186 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T09:35:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:00 smithi027 bash[22610]: cluster 2024-08-31T09:34:59.619556+0000 mgr.a (mgr.14388) 19186 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T09:35:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:00 smithi191 bash[24992]: cluster 2024-08-31T09:34:59.619556+0000 mgr.a (mgr.14388) 19186 : cluster [DBG] pgmap v13302: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T09:35:01.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:01 smithi027 bash[22610]: audit 2024-08-31T09:35:00.711562+0000 mgr.a (mgr.14388) 19187 : audit [DBG] from='client.412008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:01 smithi163 bash[24253]: audit 2024-08-31T09:35:00.711562+0000 mgr.a (mgr.14388) 19187 : audit [DBG] from='client.412008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:01 smithi191 bash[24992]: audit 2024-08-31T09:35:00.711562+0000 mgr.a (mgr.14388) 19187 : audit [DBG] from='client.412008 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:02 smithi163 bash[24253]: cluster 2024-08-31T09:35:01.620511+0000 mgr.a (mgr.14388) 19188 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:35:03.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:02 smithi027 bash[22610]: cluster 2024-08-31T09:35:01.620511+0000 mgr.a (mgr.14388) 19188 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:35:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:02 smithi191 bash[24992]: cluster 2024-08-31T09:35:01.620511+0000 mgr.a (mgr.14388) 19188 : cluster [DBG] pgmap v13303: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:35:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:04 smithi163 bash[24253]: cluster 2024-08-31T09:35:03.622654+0000 mgr.a (mgr.14388) 19189 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T09:35:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:04 smithi027 bash[22610]: cluster 2024-08-31T09:35:03.622654+0000 mgr.a (mgr.14388) 19189 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T09:35:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:04 smithi191 bash[24992]: cluster 2024-08-31T09:35:03.622654+0000 mgr.a (mgr.14388) 19189 : cluster [DBG] pgmap v13304: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 3.2 KiB/s rd, 2 op/s 2024-08-31T09:35:06.134 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:06.135 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:06.886 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:06.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:06.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:06.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:06.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:06 smithi163 bash[24253]: cluster 2024-08-31T09:35:05.623392+0000 mgr.a (mgr.14388) 19190 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:06 smithi027 bash[22610]: cluster 2024-08-31T09:35:05.623392+0000 mgr.a (mgr.14388) 19190 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:06 smithi191 bash[24992]: cluster 2024-08-31T09:35:05.623392+0000 mgr.a (mgr.14388) 19190 : cluster [DBG] pgmap v13305: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:08.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:07 smithi163 bash[24253]: audit 2024-08-31T09:35:06.470437+0000 mgr.a (mgr.14388) 19191 : audit [DBG] from='client.412086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:07 smithi027 bash[22610]: audit 2024-08-31T09:35:06.470437+0000 mgr.a (mgr.14388) 19191 : audit [DBG] from='client.412086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:07 smithi191 bash[24992]: audit 2024-08-31T09:35:06.470437+0000 mgr.a (mgr.14388) 19191 : audit [DBG] from='client.412086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:08 smithi163 bash[24253]: cluster 2024-08-31T09:35:07.624313+0000 mgr.a (mgr.14388) 19192 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:08 smithi027 bash[22610]: cluster 2024-08-31T09:35:07.624313+0000 mgr.a (mgr.14388) 19192 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:08 smithi191 bash[24992]: cluster 2024-08-31T09:35:07.624313+0000 mgr.a (mgr.14388) 19192 : cluster [DBG] pgmap v13306: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:10 smithi163 bash[24253]: cluster 2024-08-31T09:35:09.626548+0000 mgr.a (mgr.14388) 19193 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:10 smithi027 bash[22610]: cluster 2024-08-31T09:35:09.626548+0000 mgr.a (mgr.14388) 19193 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:10 smithi191 bash[24992]: cluster 2024-08-31T09:35:09.626548+0000 mgr.a (mgr.14388) 19193 : cluster [DBG] pgmap v13307: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:11.888 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:11.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:11.889 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:12.673 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:12.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:12.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:12.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:12.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:12 smithi163 bash[24253]: cluster 2024-08-31T09:35:11.627305+0000 mgr.a (mgr.14388) 19194 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:12 smithi163 bash[24253]: audit 2024-08-31T09:35:12.410447+0000 mon.a (mon.0) 3436 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:35:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:12 smithi027 bash[22610]: cluster 2024-08-31T09:35:11.627305+0000 mgr.a (mgr.14388) 19194 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:12 smithi027 bash[22610]: audit 2024-08-31T09:35:12.410447+0000 mon.a (mon.0) 3436 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:35:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:12 smithi191 bash[24992]: cluster 2024-08-31T09:35:11.627305+0000 mgr.a (mgr.14388) 19194 : cluster [DBG] pgmap v13308: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:12 smithi191 bash[24992]: audit 2024-08-31T09:35:12.410447+0000 mon.a (mon.0) 3436 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:35:14.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:13 smithi163 bash[24253]: audit 2024-08-31T09:35:12.229801+0000 mgr.a (mgr.14388) 19195 : audit [DBG] from='client.412164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:14.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:13 smithi163 bash[24253]: audit 2024-08-31T09:35:13.225770+0000 mon.a (mon.0) 3437 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:35:14.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:13 smithi163 bash[24253]: audit 2024-08-31T09:35:13.227932+0000 mon.a (mon.0) 3438 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:35:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:13 smithi163 bash[24253]: audit 2024-08-31T09:35:13.238985+0000 mon.a (mon.0) 3439 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:35:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:13 smithi163 bash[24253]: audit 2024-08-31T09:35:13.244135+0000 mon.a (mon.0) 3440 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:35:14.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:35:13 smithi027 bash[22863]: debug 2024-08-31T09:35:13.972+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:35:14.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:35:13 smithi027 bash[22863]: debug 2024-08-31T09:35:13.976+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:35:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:13 smithi027 bash[22610]: audit 2024-08-31T09:35:12.229801+0000 mgr.a (mgr.14388) 19195 : audit [DBG] from='client.412164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:13 smithi027 bash[22610]: audit 2024-08-31T09:35:13.225770+0000 mon.a (mon.0) 3437 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:35:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:13 smithi027 bash[22610]: audit 2024-08-31T09:35:13.227932+0000 mon.a (mon.0) 3438 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:35:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:13 smithi027 bash[22610]: audit 2024-08-31T09:35:13.238985+0000 mon.a (mon.0) 3439 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:35:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:13 smithi027 bash[22610]: audit 2024-08-31T09:35:13.244135+0000 mon.a (mon.0) 3440 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:35:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:13 smithi191 bash[24992]: audit 2024-08-31T09:35:12.229801+0000 mgr.a (mgr.14388) 19195 : audit [DBG] from='client.412164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:13 smithi191 bash[24992]: audit 2024-08-31T09:35:13.225770+0000 mon.a (mon.0) 3437 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:35:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:13 smithi191 bash[24992]: audit 2024-08-31T09:35:13.227932+0000 mon.a (mon.0) 3438 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:35:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:13 smithi191 bash[24992]: audit 2024-08-31T09:35:13.238985+0000 mon.a (mon.0) 3439 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:35:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:13 smithi191 bash[24992]: audit 2024-08-31T09:35:13.244135+0000 mon.a (mon.0) 3440 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:35:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:14 smithi163 bash[24253]: audit 2024-08-31T09:35:13.246655+0000 mgr.a (mgr.14388) 19196 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:35:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:14 smithi163 bash[24253]: cluster 2024-08-31T09:35:13.628600+0000 mgr.a (mgr.14388) 19197 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:14 smithi027 bash[22610]: audit 2024-08-31T09:35:13.246655+0000 mgr.a (mgr.14388) 19196 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:35:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:14 smithi027 bash[22610]: cluster 2024-08-31T09:35:13.628600+0000 mgr.a (mgr.14388) 19197 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:14 smithi191 bash[24992]: audit 2024-08-31T09:35:13.246655+0000 mgr.a (mgr.14388) 19196 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:35:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:14 smithi191 bash[24992]: cluster 2024-08-31T09:35:13.628600+0000 mgr.a (mgr.14388) 19197 : cluster [DBG] pgmap v13309: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:16.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:15 smithi163 bash[24253]: audit 2024-08-31T09:35:13.978660+0000 mgr.a (mgr.14388) 19198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:35:16.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:15 smithi163 bash[24253]: cephadm 2024-08-31T09:35:13.979661+0000 mgr.a (mgr.14388) 19199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:35:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:15 smithi027 bash[22610]: audit 2024-08-31T09:35:13.978660+0000 mgr.a (mgr.14388) 19198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:35:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:15 smithi027 bash[22610]: cephadm 2024-08-31T09:35:13.979661+0000 mgr.a (mgr.14388) 19199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:35:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:15 smithi191 bash[24992]: audit 2024-08-31T09:35:13.978660+0000 mgr.a (mgr.14388) 19198 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:35:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:15 smithi191 bash[24992]: cephadm 2024-08-31T09:35:13.979661+0000 mgr.a (mgr.14388) 19199 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:35:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:16 smithi163 bash[24253]: cluster 2024-08-31T09:35:15.629449+0000 mgr.a (mgr.14388) 19200 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:16 smithi027 bash[22610]: cluster 2024-08-31T09:35:15.629449+0000 mgr.a (mgr.14388) 19200 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:17.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:16 smithi191 bash[24992]: cluster 2024-08-31T09:35:15.629449+0000 mgr.a (mgr.14388) 19200 : cluster [DBG] pgmap v13310: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:17.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:17.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:17.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:18.460 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:18.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:18.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:18.460 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:18.461 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:18 smithi027 bash[22610]: cluster 2024-08-31T09:35:17.630216+0000 mgr.a (mgr.14388) 19201 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:19.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:18 smithi191 bash[24992]: cluster 2024-08-31T09:35:17.630216+0000 mgr.a (mgr.14388) 19201 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:18 smithi163 bash[24253]: cluster 2024-08-31T09:35:17.630216+0000 mgr.a (mgr.14388) 19201 : cluster [DBG] pgmap v13311: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:19 smithi027 bash[22610]: audit 2024-08-31T09:35:18.014630+0000 mgr.a (mgr.14388) 19202 : audit [DBG] from='client.412347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:19 smithi191 bash[24992]: audit 2024-08-31T09:35:18.014630+0000 mgr.a (mgr.14388) 19202 : audit [DBG] from='client.412347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:19 smithi163 bash[24253]: audit 2024-08-31T09:35:18.014630+0000 mgr.a (mgr.14388) 19202 : audit [DBG] from='client.412347 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:20 smithi027 bash[22610]: cluster 2024-08-31T09:35:19.633034+0000 mgr.a (mgr.14388) 19203 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:35:21.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:20 smithi191 bash[24992]: cluster 2024-08-31T09:35:19.633034+0000 mgr.a (mgr.14388) 19203 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:35:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:20 smithi163 bash[24253]: cluster 2024-08-31T09:35:19.633034+0000 mgr.a (mgr.14388) 19203 : cluster [DBG] pgmap v13312: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:35:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:21 smithi027 bash[22610]: cluster 2024-08-31T09:35:21.633832+0000 mgr.a (mgr.14388) 19204 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:35:22.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:21 smithi191 bash[24992]: cluster 2024-08-31T09:35:21.633832+0000 mgr.a (mgr.14388) 19204 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:35:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:21 smithi163 bash[24253]: cluster 2024-08-31T09:35:21.633832+0000 mgr.a (mgr.14388) 19204 : cluster [DBG] pgmap v13313: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:35:23.462 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:23.462 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:23.462 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:24.217 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:24.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:24 smithi163 bash[24253]: cluster 2024-08-31T09:35:23.635812+0000 mgr.a (mgr.14388) 19205 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:35:24.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:24 smithi163 bash[24253]: audit 2024-08-31T09:35:23.799616+0000 mgr.a (mgr.14388) 19206 : audit [DBG] from='client.412425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:24 smithi027 bash[22610]: cluster 2024-08-31T09:35:23.635812+0000 mgr.a (mgr.14388) 19205 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:35:24.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:24 smithi027 bash[22610]: audit 2024-08-31T09:35:23.799616+0000 mgr.a (mgr.14388) 19206 : audit [DBG] from='client.412425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:25.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:24 smithi191 bash[24992]: cluster 2024-08-31T09:35:23.635812+0000 mgr.a (mgr.14388) 19205 : cluster [DBG] pgmap v13314: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:35:25.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:24 smithi191 bash[24992]: audit 2024-08-31T09:35:23.799616+0000 mgr.a (mgr.14388) 19206 : audit [DBG] from='client.412425 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:26.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:26 smithi163 bash[24253]: cluster 2024-08-31T09:35:25.636733+0000 mgr.a (mgr.14388) 19207 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:35:26.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:26 smithi027 bash[22610]: cluster 2024-08-31T09:35:25.636733+0000 mgr.a (mgr.14388) 19207 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:35:27.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:26 smithi191 bash[24992]: cluster 2024-08-31T09:35:25.636733+0000 mgr.a (mgr.14388) 19207 : cluster [DBG] pgmap v13315: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:35:28.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:28 smithi027 bash[22610]: cluster 2024-08-31T09:35:27.637511+0000 mgr.a (mgr.14388) 19208 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:35:29.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:28 smithi191 bash[24992]: cluster 2024-08-31T09:35:27.637511+0000 mgr.a (mgr.14388) 19208 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:35:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:28 smithi163 bash[24253]: cluster 2024-08-31T09:35:27.637511+0000 mgr.a (mgr.14388) 19208 : cluster [DBG] pgmap v13316: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:35:29.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:29.219 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:29.219 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:30.007 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:30 smithi027 bash[22610]: audit 2024-08-31T09:35:29.554117+0000 mgr.a (mgr.14388) 19209 : audit [DBG] from='client.412500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:30.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:30 smithi027 bash[22610]: cluster 2024-08-31T09:35:29.639101+0000 mgr.a (mgr.14388) 19210 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:35:31.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:30 smithi191 bash[24992]: audit 2024-08-31T09:35:29.554117+0000 mgr.a (mgr.14388) 19209 : audit [DBG] from='client.412500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:31.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:30 smithi191 bash[24992]: cluster 2024-08-31T09:35:29.639101+0000 mgr.a (mgr.14388) 19210 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:35:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:30 smithi163 bash[24253]: audit 2024-08-31T09:35:29.554117+0000 mgr.a (mgr.14388) 19209 : audit [DBG] from='client.412500 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:30 smithi163 bash[24253]: cluster 2024-08-31T09:35:29.639101+0000 mgr.a (mgr.14388) 19210 : cluster [DBG] pgmap v13317: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:35:32.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:32 smithi027 bash[22610]: cluster 2024-08-31T09:35:31.639958+0000 mgr.a (mgr.14388) 19211 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:33.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:32 smithi191 bash[24992]: cluster 2024-08-31T09:35:31.639958+0000 mgr.a (mgr.14388) 19211 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:32 smithi163 bash[24253]: cluster 2024-08-31T09:35:31.639958+0000 mgr.a (mgr.14388) 19211 : cluster [DBG] pgmap v13318: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:34 smithi027 bash[22610]: cluster 2024-08-31T09:35:33.642106+0000 mgr.a (mgr.14388) 19212 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:35.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:35.009 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:35.009 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:35.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:34 smithi191 bash[24992]: cluster 2024-08-31T09:35:33.642106+0000 mgr.a (mgr.14388) 19212 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:34 smithi163 bash[24253]: cluster 2024-08-31T09:35:33.642106+0000 mgr.a (mgr.14388) 19212 : cluster [DBG] pgmap v13319: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:35.765 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:35.766 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:36 smithi027 bash[22610]: audit 2024-08-31T09:35:35.339804+0000 mgr.a (mgr.14388) 19213 : audit [DBG] from='client.412569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:36 smithi027 bash[22610]: cluster 2024-08-31T09:35:35.642714+0000 mgr.a (mgr.14388) 19214 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:37.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:36 smithi191 bash[24992]: audit 2024-08-31T09:35:35.339804+0000 mgr.a (mgr.14388) 19213 : audit [DBG] from='client.412569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:36 smithi191 bash[24992]: cluster 2024-08-31T09:35:35.642714+0000 mgr.a (mgr.14388) 19214 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:36 smithi163 bash[24253]: audit 2024-08-31T09:35:35.339804+0000 mgr.a (mgr.14388) 19213 : audit [DBG] from='client.412569 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:36 smithi163 bash[24253]: cluster 2024-08-31T09:35:35.642714+0000 mgr.a (mgr.14388) 19214 : cluster [DBG] pgmap v13320: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:39.036 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:38 smithi027 bash[22610]: cluster 2024-08-31T09:35:37.643560+0000 mgr.a (mgr.14388) 19215 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:39.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:38 smithi191 bash[24992]: cluster 2024-08-31T09:35:37.643560+0000 mgr.a (mgr.14388) 19215 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:38 smithi163 bash[24253]: cluster 2024-08-31T09:35:37.643560+0000 mgr.a (mgr.14388) 19215 : cluster [DBG] pgmap v13321: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:40.767 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:40.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:40.768 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:40.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:40 smithi027 bash[22610]: cluster 2024-08-31T09:35:39.645715+0000 mgr.a (mgr.14388) 19216 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:41.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:40 smithi191 bash[24992]: cluster 2024-08-31T09:35:39.645715+0000 mgr.a (mgr.14388) 19216 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:40 smithi163 bash[24253]: cluster 2024-08-31T09:35:39.645715+0000 mgr.a (mgr.14388) 19216 : cluster [DBG] pgmap v13322: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:41.523 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:41.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:41.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:41.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:41.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:42 smithi027 bash[22610]: audit 2024-08-31T09:35:41.098623+0000 mgr.a (mgr.14388) 19217 : audit [DBG] from='client.412644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:42.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:42 smithi027 bash[22610]: cluster 2024-08-31T09:35:41.646694+0000 mgr.a (mgr.14388) 19218 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:43.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:42 smithi191 bash[24992]: audit 2024-08-31T09:35:41.098623+0000 mgr.a (mgr.14388) 19217 : audit [DBG] from='client.412644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:43.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:42 smithi191 bash[24992]: cluster 2024-08-31T09:35:41.646694+0000 mgr.a (mgr.14388) 19218 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:42 smithi163 bash[24253]: audit 2024-08-31T09:35:41.098623+0000 mgr.a (mgr.14388) 19217 : audit [DBG] from='client.412644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:42 smithi163 bash[24253]: cluster 2024-08-31T09:35:41.646694+0000 mgr.a (mgr.14388) 19218 : cluster [DBG] pgmap v13323: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:45.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:44 smithi191 bash[24992]: cluster 2024-08-31T09:35:43.648802+0000 mgr.a (mgr.14388) 19219 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:44 smithi163 bash[24253]: cluster 2024-08-31T09:35:43.648802+0000 mgr.a (mgr.14388) 19219 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:44 smithi027 bash[22610]: cluster 2024-08-31T09:35:43.648802+0000 mgr.a (mgr.14388) 19219 : cluster [DBG] pgmap v13324: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:46.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:46.525 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:46.525 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:47.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:46 smithi191 bash[24992]: cluster 2024-08-31T09:35:45.649570+0000 mgr.a (mgr.14388) 19220 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:46 smithi163 bash[24253]: cluster 2024-08-31T09:35:45.649570+0000 mgr.a (mgr.14388) 19220 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:46 smithi027 bash[22610]: cluster 2024-08-31T09:35:45.649570+0000 mgr.a (mgr.14388) 19220 : cluster [DBG] pgmap v13325: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:47.291 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:47.291 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:48.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:47 smithi191 bash[24992]: audit 2024-08-31T09:35:46.863037+0000 mgr.a (mgr.14388) 19221 : audit [DBG] from='client.412722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:48.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:47 smithi163 bash[24253]: audit 2024-08-31T09:35:46.863037+0000 mgr.a (mgr.14388) 19221 : audit [DBG] from='client.412722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:47 smithi027 bash[22610]: audit 2024-08-31T09:35:46.863037+0000 mgr.a (mgr.14388) 19221 : audit [DBG] from='client.412722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:49.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:48 smithi191 bash[24992]: cluster 2024-08-31T09:35:47.650536+0000 mgr.a (mgr.14388) 19222 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:48 smithi163 bash[24253]: cluster 2024-08-31T09:35:47.650536+0000 mgr.a (mgr.14388) 19222 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:48 smithi027 bash[22610]: cluster 2024-08-31T09:35:47.650536+0000 mgr.a (mgr.14388) 19222 : cluster [DBG] pgmap v13326: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:50 smithi191 bash[24992]: cluster 2024-08-31T09:35:49.652785+0000 mgr.a (mgr.14388) 19223 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:50 smithi163 bash[24253]: cluster 2024-08-31T09:35:49.652785+0000 mgr.a (mgr.14388) 19223 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:50 smithi027 bash[22610]: cluster 2024-08-31T09:35:49.652785+0000 mgr.a (mgr.14388) 19223 : cluster [DBG] pgmap v13327: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:35:52.293 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:52.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:52.293 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:53.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:52 smithi191 bash[24992]: cluster 2024-08-31T09:35:51.653548+0000 mgr.a (mgr.14388) 19224 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:53.049 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:53.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:53.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:53.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:53.049 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:52 smithi163 bash[24253]: cluster 2024-08-31T09:35:51.653548+0000 mgr.a (mgr.14388) 19224 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:52 smithi027 bash[22610]: cluster 2024-08-31T09:35:51.653548+0000 mgr.a (mgr.14388) 19224 : cluster [DBG] pgmap v13328: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:35:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:53 smithi191 bash[24992]: audit 2024-08-31T09:35:52.630436+0000 mgr.a (mgr.14388) 19225 : audit [DBG] from='client.412800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:54.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:53 smithi163 bash[24253]: audit 2024-08-31T09:35:52.630436+0000 mgr.a (mgr.14388) 19225 : audit [DBG] from='client.412800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:53 smithi027 bash[22610]: audit 2024-08-31T09:35:52.630436+0000 mgr.a (mgr.14388) 19225 : audit [DBG] from='client.412800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:35:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:54 smithi191 bash[24992]: cluster 2024-08-31T09:35:53.655898+0000 mgr.a (mgr.14388) 19226 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:35:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:54 smithi163 bash[24253]: cluster 2024-08-31T09:35:53.655898+0000 mgr.a (mgr.14388) 19226 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:35:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:54 smithi027 bash[22610]: cluster 2024-08-31T09:35:53.655898+0000 mgr.a (mgr.14388) 19226 : cluster [DBG] pgmap v13329: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:35:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:56 smithi191 bash[24992]: cluster 2024-08-31T09:35:55.656692+0000 mgr.a (mgr.14388) 19227 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:35:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:56 smithi163 bash[24253]: cluster 2024-08-31T09:35:55.656692+0000 mgr.a (mgr.14388) 19227 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:35:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:56 smithi027 bash[22610]: cluster 2024-08-31T09:35:55.656692+0000 mgr.a (mgr.14388) 19227 : cluster [DBG] pgmap v13330: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:35:58.050 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:35:58.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:35:58.051 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:35:58.799 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:35:58.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:35:58.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:35:58.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:35:58.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:35:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:58 smithi191 bash[24992]: cluster 2024-08-31T09:35:57.657433+0000 mgr.a (mgr.14388) 19228 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:35:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:58 smithi163 bash[24253]: cluster 2024-08-31T09:35:57.657433+0000 mgr.a (mgr.14388) 19228 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:35:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:58 smithi027 bash[22610]: cluster 2024-08-31T09:35:57.657433+0000 mgr.a (mgr.14388) 19228 : cluster [DBG] pgmap v13331: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:36:00.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:35:59 smithi163 bash[24253]: audit 2024-08-31T09:35:58.387247+0000 mgr.a (mgr.14388) 19229 : audit [DBG] from='client.412878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:35:59 smithi027 bash[22610]: audit 2024-08-31T09:35:58.387247+0000 mgr.a (mgr.14388) 19229 : audit [DBG] from='client.412878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:35:59 smithi191 bash[24992]: audit 2024-08-31T09:35:58.387247+0000 mgr.a (mgr.14388) 19229 : audit [DBG] from='client.412878 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:00 smithi163 bash[24253]: cluster 2024-08-31T09:35:59.660199+0000 mgr.a (mgr.14388) 19230 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:00 smithi027 bash[22610]: cluster 2024-08-31T09:35:59.660199+0000 mgr.a (mgr.14388) 19230 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:00 smithi191 bash[24992]: cluster 2024-08-31T09:35:59.660199+0000 mgr.a (mgr.14388) 19230 : cluster [DBG] pgmap v13332: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:02 smithi163 bash[24253]: cluster 2024-08-31T09:36:01.660965+0000 mgr.a (mgr.14388) 19231 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:36:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:02 smithi027 bash[22610]: cluster 2024-08-31T09:36:01.660965+0000 mgr.a (mgr.14388) 19231 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:36:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:02 smithi191 bash[24992]: cluster 2024-08-31T09:36:01.660965+0000 mgr.a (mgr.14388) 19231 : cluster [DBG] pgmap v13333: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:36:03.800 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:36:03.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:36:03.800 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:36:04.551 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:36:04.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:36:04.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:36:04.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:36:04.551 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:36:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:04 smithi163 bash[24253]: cluster 2024-08-31T09:36:03.662872+0000 mgr.a (mgr.14388) 19232 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:04 smithi027 bash[22610]: cluster 2024-08-31T09:36:03.662872+0000 mgr.a (mgr.14388) 19232 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:04 smithi191 bash[24992]: cluster 2024-08-31T09:36:03.662872+0000 mgr.a (mgr.14388) 19232 : cluster [DBG] pgmap v13334: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:06.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:05 smithi163 bash[24253]: audit 2024-08-31T09:36:04.133698+0000 mgr.a (mgr.14388) 19233 : audit [DBG] from='client.412953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:05 smithi027 bash[22610]: audit 2024-08-31T09:36:04.133698+0000 mgr.a (mgr.14388) 19233 : audit [DBG] from='client.412953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:05 smithi191 bash[24992]: audit 2024-08-31T09:36:04.133698+0000 mgr.a (mgr.14388) 19233 : audit [DBG] from='client.412953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:06 smithi163 bash[24253]: cluster 2024-08-31T09:36:05.663749+0000 mgr.a (mgr.14388) 19234 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T09:36:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:06 smithi027 bash[22610]: cluster 2024-08-31T09:36:05.663749+0000 mgr.a (mgr.14388) 19234 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T09:36:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:06 smithi191 bash[24992]: cluster 2024-08-31T09:36:05.663749+0000 mgr.a (mgr.14388) 19234 : cluster [DBG] pgmap v13335: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T09:36:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:08 smithi163 bash[24253]: cluster 2024-08-31T09:36:07.664496+0000 mgr.a (mgr.14388) 19235 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T09:36:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:08 smithi027 bash[22610]: cluster 2024-08-31T09:36:07.664496+0000 mgr.a (mgr.14388) 19235 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T09:36:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:08 smithi191 bash[24992]: cluster 2024-08-31T09:36:07.664496+0000 mgr.a (mgr.14388) 19235 : cluster [DBG] pgmap v13336: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-08-31T09:36:09.552 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:36:09.553 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:36:09.554 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:36:10.333 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:36:10.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:36:10.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:36:10.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:36:10.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:36:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:10 smithi163 bash[24253]: cluster 2024-08-31T09:36:09.665570+0000 mgr.a (mgr.14388) 19236 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:36:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:10 smithi163 bash[24253]: audit 2024-08-31T09:36:09.891547+0000 mgr.a (mgr.14388) 19237 : audit [DBG] from='client.413031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:10 smithi027 bash[22610]: cluster 2024-08-31T09:36:09.665570+0000 mgr.a (mgr.14388) 19236 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:36:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:10 smithi027 bash[22610]: audit 2024-08-31T09:36:09.891547+0000 mgr.a (mgr.14388) 19237 : audit [DBG] from='client.413031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:10 smithi191 bash[24992]: cluster 2024-08-31T09:36:09.665570+0000 mgr.a (mgr.14388) 19236 : cluster [DBG] pgmap v13337: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:36:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:10 smithi191 bash[24992]: audit 2024-08-31T09:36:09.891547+0000 mgr.a (mgr.14388) 19237 : audit [DBG] from='client.413031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:12 smithi163 bash[24253]: cluster 2024-08-31T09:36:11.666415+0000 mgr.a (mgr.14388) 19238 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:12 smithi027 bash[22610]: cluster 2024-08-31T09:36:11.666415+0000 mgr.a (mgr.14388) 19238 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:12 smithi191 bash[24992]: cluster 2024-08-31T09:36:11.666415+0000 mgr.a (mgr.14388) 19238 : cluster [DBG] pgmap v13338: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:14.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:14 smithi027 bash[22610]: cluster 2024-08-31T09:36:13.668560+0000 mgr.a (mgr.14388) 19239 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:36:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:14 smithi027 bash[22610]: audit 2024-08-31T09:36:14.029118+0000 mon.a (mon.0) 3441 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:36:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:14 smithi191 bash[24992]: cluster 2024-08-31T09:36:13.668560+0000 mgr.a (mgr.14388) 19239 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:36:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:14 smithi191 bash[24992]: audit 2024-08-31T09:36:14.029118+0000 mon.a (mon.0) 3441 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:36:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:14 smithi163 bash[24253]: cluster 2024-08-31T09:36:13.668560+0000 mgr.a (mgr.14388) 19239 : cluster [DBG] pgmap v13339: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:36:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:14 smithi163 bash[24253]: audit 2024-08-31T09:36:14.029118+0000 mon.a (mon.0) 3441 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:36:15.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:36:15.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:36:15.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:36:15.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:36:15 smithi027 bash[22863]: debug 2024-08-31T09:36:15.611+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:36:15.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:36:15 smithi027 bash[22863]: debug 2024-08-31T09:36:15.611+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:36:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:15 smithi027 bash[22610]: audit 2024-08-31T09:36:14.855256+0000 mon.a (mon.0) 3442 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:36:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:15 smithi027 bash[22610]: audit 2024-08-31T09:36:14.856506+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:36:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:15 smithi027 bash[22610]: audit 2024-08-31T09:36:14.866957+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:36:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:15 smithi027 bash[22610]: audit 2024-08-31T09:36:14.869459+0000 mon.a (mon.0) 3445 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:36:15.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:15 smithi027 bash[22610]: audit 2024-08-31T09:36:14.871741+0000 mgr.a (mgr.14388) 19240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:36:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:15 smithi191 bash[24992]: audit 2024-08-31T09:36:14.855256+0000 mon.a (mon.0) 3442 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:36:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:15 smithi191 bash[24992]: audit 2024-08-31T09:36:14.856506+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:36:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:15 smithi191 bash[24992]: audit 2024-08-31T09:36:14.866957+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:36:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:15 smithi191 bash[24992]: audit 2024-08-31T09:36:14.869459+0000 mon.a (mon.0) 3445 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:36:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:15 smithi191 bash[24992]: audit 2024-08-31T09:36:14.871741+0000 mgr.a (mgr.14388) 19240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:36:16.062 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:36:16.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:36:16.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:36:16.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:36:16.063 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:36:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:15 smithi163 bash[24253]: audit 2024-08-31T09:36:14.855256+0000 mon.a (mon.0) 3442 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:36:16.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:15 smithi163 bash[24253]: audit 2024-08-31T09:36:14.856506+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:36:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:15 smithi163 bash[24253]: audit 2024-08-31T09:36:14.866957+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:36:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:15 smithi163 bash[24253]: audit 2024-08-31T09:36:14.869459+0000 mon.a (mon.0) 3445 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:36:16.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:15 smithi163 bash[24253]: audit 2024-08-31T09:36:14.871741+0000 mgr.a (mgr.14388) 19240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:36:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:16 smithi163 bash[24253]: audit 2024-08-31T09:36:15.615401+0000 mgr.a (mgr.14388) 19241 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:36:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:16 smithi163 bash[24253]: cephadm 2024-08-31T09:36:15.616581+0000 mgr.a (mgr.14388) 19242 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:36:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:16 smithi163 bash[24253]: audit 2024-08-31T09:36:15.658466+0000 mgr.a (mgr.14388) 19243 : audit [DBG] from='client.413199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:16 smithi163 bash[24253]: cluster 2024-08-31T09:36:15.670776+0000 mgr.a (mgr.14388) 19244 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:16 smithi027 bash[22610]: audit 2024-08-31T09:36:15.615401+0000 mgr.a (mgr.14388) 19241 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:36:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:16 smithi027 bash[22610]: cephadm 2024-08-31T09:36:15.616581+0000 mgr.a (mgr.14388) 19242 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:36:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:16 smithi027 bash[22610]: audit 2024-08-31T09:36:15.658466+0000 mgr.a (mgr.14388) 19243 : audit [DBG] from='client.413199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:16 smithi027 bash[22610]: cluster 2024-08-31T09:36:15.670776+0000 mgr.a (mgr.14388) 19244 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:16 smithi191 bash[24992]: audit 2024-08-31T09:36:15.615401+0000 mgr.a (mgr.14388) 19241 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:36:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:16 smithi191 bash[24992]: cephadm 2024-08-31T09:36:15.616581+0000 mgr.a (mgr.14388) 19242 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:36:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:16 smithi191 bash[24992]: audit 2024-08-31T09:36:15.658466+0000 mgr.a (mgr.14388) 19243 : audit [DBG] from='client.413199 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:16 smithi191 bash[24992]: cluster 2024-08-31T09:36:15.670776+0000 mgr.a (mgr.14388) 19244 : cluster [DBG] pgmap v13340: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:18 smithi163 bash[24253]: cluster 2024-08-31T09:36:17.671975+0000 mgr.a (mgr.14388) 19245 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:18 smithi027 bash[22610]: cluster 2024-08-31T09:36:17.671975+0000 mgr.a (mgr.14388) 19245 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:18 smithi191 bash[24992]: cluster 2024-08-31T09:36:17.671975+0000 mgr.a (mgr.14388) 19245 : cluster [DBG] pgmap v13341: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:21.064 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:36:21.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:36:21.065 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:36:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:20 smithi163 bash[24253]: cluster 2024-08-31T09:36:19.674225+0000 mgr.a (mgr.14388) 19246 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:20 smithi027 bash[22610]: cluster 2024-08-31T09:36:19.674225+0000 mgr.a (mgr.14388) 19246 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:21.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:20 smithi191 bash[24992]: cluster 2024-08-31T09:36:19.674225+0000 mgr.a (mgr.14388) 19246 : cluster [DBG] pgmap v13342: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:21.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:36:21.807 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:36:21.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:36:21.808 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:36:21.808 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:36:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:22 smithi163 bash[24253]: audit 2024-08-31T09:36:21.398442+0000 mgr.a (mgr.14388) 19247 : audit [DBG] from='client.413292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:22 smithi163 bash[24253]: cluster 2024-08-31T09:36:21.674823+0000 mgr.a (mgr.14388) 19248 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:22 smithi027 bash[22610]: audit 2024-08-31T09:36:21.398442+0000 mgr.a (mgr.14388) 19247 : audit [DBG] from='client.413292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:22 smithi027 bash[22610]: cluster 2024-08-31T09:36:21.674823+0000 mgr.a (mgr.14388) 19248 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:22 smithi191 bash[24992]: audit 2024-08-31T09:36:21.398442+0000 mgr.a (mgr.14388) 19247 : audit [DBG] from='client.413292 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:22 smithi191 bash[24992]: cluster 2024-08-31T09:36:21.674823+0000 mgr.a (mgr.14388) 19248 : cluster [DBG] pgmap v13343: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:24 smithi163 bash[24253]: cluster 2024-08-31T09:36:23.677053+0000 mgr.a (mgr.14388) 19249 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:25.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:24 smithi027 bash[22610]: cluster 2024-08-31T09:36:23.677053+0000 mgr.a (mgr.14388) 19249 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:24 smithi191 bash[24992]: cluster 2024-08-31T09:36:23.677053+0000 mgr.a (mgr.14388) 19249 : cluster [DBG] pgmap v13344: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:26.809 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:36:26.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:36:26.810 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:36:27.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:26 smithi163 bash[24253]: cluster 2024-08-31T09:36:25.677810+0000 mgr.a (mgr.14388) 19250 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:26 smithi027 bash[22610]: cluster 2024-08-31T09:36:25.677810+0000 mgr.a (mgr.14388) 19250 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:26 smithi191 bash[24992]: cluster 2024-08-31T09:36:25.677810+0000 mgr.a (mgr.14388) 19250 : cluster [DBG] pgmap v13345: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:27.548 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:36:27.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:36:27.548 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:36:27.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:36:27.549 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:36:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:28 smithi163 bash[24253]: audit 2024-08-31T09:36:27.141920+0000 mgr.a (mgr.14388) 19251 : audit [DBG] from='client.413367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:28 smithi163 bash[24253]: cluster 2024-08-31T09:36:27.678762+0000 mgr.a (mgr.14388) 19252 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:28 smithi027 bash[22610]: audit 2024-08-31T09:36:27.141920+0000 mgr.a (mgr.14388) 19251 : audit [DBG] from='client.413367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:28 smithi027 bash[22610]: cluster 2024-08-31T09:36:27.678762+0000 mgr.a (mgr.14388) 19252 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:28 smithi191 bash[24992]: audit 2024-08-31T09:36:27.141920+0000 mgr.a (mgr.14388) 19251 : audit [DBG] from='client.413367 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:28 smithi191 bash[24992]: cluster 2024-08-31T09:36:27.678762+0000 mgr.a (mgr.14388) 19252 : cluster [DBG] pgmap v13346: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:30 smithi163 bash[24253]: cluster 2024-08-31T09:36:29.681185+0000 mgr.a (mgr.14388) 19253 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:30 smithi027 bash[22610]: cluster 2024-08-31T09:36:29.681185+0000 mgr.a (mgr.14388) 19253 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:30 smithi191 bash[24992]: cluster 2024-08-31T09:36:29.681185+0000 mgr.a (mgr.14388) 19253 : cluster [DBG] pgmap v13347: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:36:32.550 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:36:32.550 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:36:32.550 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:36:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:32 smithi163 bash[24253]: cluster 2024-08-31T09:36:31.682137+0000 mgr.a (mgr.14388) 19254 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:32 smithi027 bash[22610]: cluster 2024-08-31T09:36:31.682137+0000 mgr.a (mgr.14388) 19254 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:32 smithi191 bash[24992]: cluster 2024-08-31T09:36:31.682137+0000 mgr.a (mgr.14388) 19254 : cluster [DBG] pgmap v13348: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:33.333 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:36:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:36:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:36:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:36:33.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:36:34.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:33 smithi163 bash[24253]: audit 2024-08-31T09:36:32.890840+0000 mgr.a (mgr.14388) 19255 : audit [DBG] from='client.413439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:33 smithi027 bash[22610]: audit 2024-08-31T09:36:32.890840+0000 mgr.a (mgr.14388) 19255 : audit [DBG] from='client.413439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:33 smithi191 bash[24992]: audit 2024-08-31T09:36:32.890840+0000 mgr.a (mgr.14388) 19255 : audit [DBG] from='client.413439 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:34 smithi163 bash[24253]: cluster 2024-08-31T09:36:33.685108+0000 mgr.a (mgr.14388) 19256 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:36:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:34 smithi027 bash[22610]: cluster 2024-08-31T09:36:33.685108+0000 mgr.a (mgr.14388) 19256 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:36:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:34 smithi191 bash[24992]: cluster 2024-08-31T09:36:33.685108+0000 mgr.a (mgr.14388) 19256 : cluster [DBG] pgmap v13349: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:36:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:36 smithi163 bash[24253]: cluster 2024-08-31T09:36:35.685900+0000 mgr.a (mgr.14388) 19257 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:36:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:36 smithi027 bash[22610]: cluster 2024-08-31T09:36:35.685900+0000 mgr.a (mgr.14388) 19257 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:36:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:36 smithi191 bash[24992]: cluster 2024-08-31T09:36:35.685900+0000 mgr.a (mgr.14388) 19257 : cluster [DBG] pgmap v13350: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:36:38.334 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:36:38.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:36:38.335 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:36:39.119 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:36:39.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:36:39.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:36:39.119 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:36:39.120 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:36:39.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:38 smithi163 bash[24253]: cluster 2024-08-31T09:36:37.686827+0000 mgr.a (mgr.14388) 19258 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:36:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:38 smithi027 bash[22610]: cluster 2024-08-31T09:36:37.686827+0000 mgr.a (mgr.14388) 19258 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:36:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:38 smithi191 bash[24992]: cluster 2024-08-31T09:36:37.686827+0000 mgr.a (mgr.14388) 19258 : cluster [DBG] pgmap v13351: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:36:40.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:39 smithi163 bash[24253]: audit 2024-08-31T09:36:38.668102+0000 mgr.a (mgr.14388) 19259 : audit [DBG] from='client.413514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:39 smithi027 bash[22610]: audit 2024-08-31T09:36:38.668102+0000 mgr.a (mgr.14388) 19259 : audit [DBG] from='client.413514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:39 smithi191 bash[24992]: audit 2024-08-31T09:36:38.668102+0000 mgr.a (mgr.14388) 19259 : audit [DBG] from='client.413514 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:40 smithi163 bash[24253]: cluster 2024-08-31T09:36:39.689516+0000 mgr.a (mgr.14388) 19260 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:41.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:40 smithi027 bash[22610]: cluster 2024-08-31T09:36:39.689516+0000 mgr.a (mgr.14388) 19260 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:40 smithi191 bash[24992]: cluster 2024-08-31T09:36:39.689516+0000 mgr.a (mgr.14388) 19260 : cluster [DBG] pgmap v13352: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:42 smithi163 bash[24253]: cluster 2024-08-31T09:36:41.690319+0000 mgr.a (mgr.14388) 19261 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:36:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:42 smithi027 bash[22610]: cluster 2024-08-31T09:36:41.690319+0000 mgr.a (mgr.14388) 19261 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:36:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:42 smithi191 bash[24992]: cluster 2024-08-31T09:36:41.690319+0000 mgr.a (mgr.14388) 19261 : cluster [DBG] pgmap v13353: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:36:44.121 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:36:44.122 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:36:44.122 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:36:44.898 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:36:44.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:36:44.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:36:44.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:36:44.898 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:36:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:44 smithi163 bash[24253]: cluster 2024-08-31T09:36:43.692301+0000 mgr.a (mgr.14388) 19262 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:44 smithi027 bash[22610]: cluster 2024-08-31T09:36:43.692301+0000 mgr.a (mgr.14388) 19262 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:44 smithi191 bash[24992]: cluster 2024-08-31T09:36:43.692301+0000 mgr.a (mgr.14388) 19262 : cluster [DBG] pgmap v13354: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:46.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:45 smithi027 bash[22610]: audit 2024-08-31T09:36:44.456871+0000 mgr.a (mgr.14388) 19263 : audit [DBG] from='client.413592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:45 smithi191 bash[24992]: audit 2024-08-31T09:36:44.456871+0000 mgr.a (mgr.14388) 19263 : audit [DBG] from='client.413592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:45 smithi163 bash[24253]: audit 2024-08-31T09:36:44.456871+0000 mgr.a (mgr.14388) 19263 : audit [DBG] from='client.413592 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:46 smithi027 bash[22610]: cluster 2024-08-31T09:36:45.693218+0000 mgr.a (mgr.14388) 19264 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:36:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:46 smithi191 bash[24992]: cluster 2024-08-31T09:36:45.693218+0000 mgr.a (mgr.14388) 19264 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:36:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:46 smithi163 bash[24253]: cluster 2024-08-31T09:36:45.693218+0000 mgr.a (mgr.14388) 19264 : cluster [DBG] pgmap v13355: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:36:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:48 smithi027 bash[22610]: cluster 2024-08-31T09:36:47.693989+0000 mgr.a (mgr.14388) 19265 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:36:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:48 smithi191 bash[24992]: cluster 2024-08-31T09:36:47.693989+0000 mgr.a (mgr.14388) 19265 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:36:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:48 smithi163 bash[24253]: cluster 2024-08-31T09:36:47.693989+0000 mgr.a (mgr.14388) 19265 : cluster [DBG] pgmap v13356: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:36:49.899 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:36:49.900 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:36:49.901 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:36:50.651 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:36:50.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:36:50.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:36:50.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:36:50.652 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:36:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:50 smithi027 bash[22610]: cluster 2024-08-31T09:36:49.696216+0000 mgr.a (mgr.14388) 19266 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:36:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:50 smithi191 bash[24992]: cluster 2024-08-31T09:36:49.696216+0000 mgr.a (mgr.14388) 19266 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:36:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:50 smithi163 bash[24253]: cluster 2024-08-31T09:36:49.696216+0000 mgr.a (mgr.14388) 19266 : cluster [DBG] pgmap v13357: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:36:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:51 smithi027 bash[22610]: audit 2024-08-31T09:36:50.232609+0000 mgr.a (mgr.14388) 19267 : audit [DBG] from='client.413667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:51 smithi191 bash[24992]: audit 2024-08-31T09:36:50.232609+0000 mgr.a (mgr.14388) 19267 : audit [DBG] from='client.413667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:51 smithi163 bash[24253]: audit 2024-08-31T09:36:50.232609+0000 mgr.a (mgr.14388) 19267 : audit [DBG] from='client.413667 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:52 smithi027 bash[22610]: cluster 2024-08-31T09:36:51.697112+0000 mgr.a (mgr.14388) 19268 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:52 smithi191 bash[24992]: cluster 2024-08-31T09:36:51.697112+0000 mgr.a (mgr.14388) 19268 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:52 smithi163 bash[24253]: cluster 2024-08-31T09:36:51.697112+0000 mgr.a (mgr.14388) 19268 : cluster [DBG] pgmap v13358: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:54 smithi191 bash[24992]: cluster 2024-08-31T09:36:53.699294+0000 mgr.a (mgr.14388) 19269 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:36:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:54 smithi163 bash[24253]: cluster 2024-08-31T09:36:53.699294+0000 mgr.a (mgr.14388) 19269 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:36:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:54 smithi027 bash[22610]: cluster 2024-08-31T09:36:53.699294+0000 mgr.a (mgr.14388) 19269 : cluster [DBG] pgmap v13359: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:36:55.653 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:36:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:36:55.654 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:36:56.404 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:36:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:36:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:36:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:36:56.404 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:36:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:56 smithi191 bash[24992]: cluster 2024-08-31T09:36:55.700047+0000 mgr.a (mgr.14388) 19270 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:56 smithi163 bash[24253]: cluster 2024-08-31T09:36:55.700047+0000 mgr.a (mgr.14388) 19270 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:56 smithi027 bash[22610]: cluster 2024-08-31T09:36:55.700047+0000 mgr.a (mgr.14388) 19270 : cluster [DBG] pgmap v13360: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:58.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:57 smithi191 bash[24992]: audit 2024-08-31T09:36:55.985103+0000 mgr.a (mgr.14388) 19271 : audit [DBG] from='client.413745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:58.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:57 smithi163 bash[24253]: audit 2024-08-31T09:36:55.985103+0000 mgr.a (mgr.14388) 19271 : audit [DBG] from='client.413745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:57 smithi027 bash[22610]: audit 2024-08-31T09:36:55.985103+0000 mgr.a (mgr.14388) 19271 : audit [DBG] from='client.413745 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:36:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:36:58 smithi191 bash[24992]: cluster 2024-08-31T09:36:57.700900+0000 mgr.a (mgr.14388) 19272 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:36:58 smithi163 bash[24253]: cluster 2024-08-31T09:36:57.700900+0000 mgr.a (mgr.14388) 19272 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:36:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:36:58 smithi027 bash[22610]: cluster 2024-08-31T09:36:57.700900+0000 mgr.a (mgr.14388) 19272 : cluster [DBG] pgmap v13361: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:00 smithi191 bash[24992]: cluster 2024-08-31T09:36:59.703141+0000 mgr.a (mgr.14388) 19273 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:00 smithi163 bash[24253]: cluster 2024-08-31T09:36:59.703141+0000 mgr.a (mgr.14388) 19273 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:00 smithi027 bash[22610]: cluster 2024-08-31T09:36:59.703141+0000 mgr.a (mgr.14388) 19273 : cluster [DBG] pgmap v13362: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:01.405 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:01.406 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:02.167 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:02.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:02.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:02.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:02.167 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:37:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:02 smithi191 bash[24992]: cluster 2024-08-31T09:37:01.703858+0000 mgr.a (mgr.14388) 19274 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:02 smithi191 bash[24992]: audit 2024-08-31T09:37:01.737364+0000 mgr.a (mgr.14388) 19275 : audit [DBG] from='client.413820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:02 smithi163 bash[24253]: cluster 2024-08-31T09:37:01.703858+0000 mgr.a (mgr.14388) 19274 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:02 smithi163 bash[24253]: audit 2024-08-31T09:37:01.737364+0000 mgr.a (mgr.14388) 19275 : audit [DBG] from='client.413820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:02 smithi027 bash[22610]: cluster 2024-08-31T09:37:01.703858+0000 mgr.a (mgr.14388) 19274 : cluster [DBG] pgmap v13363: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:02 smithi027 bash[22610]: audit 2024-08-31T09:37:01.737364+0000 mgr.a (mgr.14388) 19275 : audit [DBG] from='client.413820 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:05.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:04 smithi191 bash[24992]: cluster 2024-08-31T09:37:03.706080+0000 mgr.a (mgr.14388) 19276 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:04 smithi163 bash[24253]: cluster 2024-08-31T09:37:03.706080+0000 mgr.a (mgr.14388) 19276 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:04 smithi027 bash[22610]: cluster 2024-08-31T09:37:03.706080+0000 mgr.a (mgr.14388) 19276 : cluster [DBG] pgmap v13364: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:07.168 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:07.169 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:07.169 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:06 smithi163 bash[24253]: cluster 2024-08-31T09:37:05.706848+0000 mgr.a (mgr.14388) 19277 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:06 smithi027 bash[22610]: cluster 2024-08-31T09:37:05.706848+0000 mgr.a (mgr.14388) 19277 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:06 smithi191 bash[24992]: cluster 2024-08-31T09:37:05.706848+0000 mgr.a (mgr.14388) 19277 : cluster [DBG] pgmap v13365: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:07.916 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:07.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:07.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:07.916 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:07.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:37:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:08 smithi163 bash[24253]: audit 2024-08-31T09:37:07.497520+0000 mgr.a (mgr.14388) 19278 : audit [DBG] from='client.413898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:08 smithi163 bash[24253]: cluster 2024-08-31T09:37:07.707389+0000 mgr.a (mgr.14388) 19279 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:08 smithi027 bash[22610]: audit 2024-08-31T09:37:07.497520+0000 mgr.a (mgr.14388) 19278 : audit [DBG] from='client.413898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:08 smithi027 bash[22610]: cluster 2024-08-31T09:37:07.707389+0000 mgr.a (mgr.14388) 19279 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:08 smithi191 bash[24992]: audit 2024-08-31T09:37:07.497520+0000 mgr.a (mgr.14388) 19278 : audit [DBG] from='client.413898 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:08 smithi191 bash[24992]: cluster 2024-08-31T09:37:07.707389+0000 mgr.a (mgr.14388) 19279 : cluster [DBG] pgmap v13366: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:10 smithi163 bash[24253]: cluster 2024-08-31T09:37:09.709714+0000 mgr.a (mgr.14388) 19280 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:10 smithi027 bash[22610]: cluster 2024-08-31T09:37:09.709714+0000 mgr.a (mgr.14388) 19280 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:10 smithi191 bash[24992]: cluster 2024-08-31T09:37:09.709714+0000 mgr.a (mgr.14388) 19280 : cluster [DBG] pgmap v13367: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:12 smithi163 bash[24253]: cluster 2024-08-31T09:37:11.710506+0000 mgr.a (mgr.14388) 19281 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:12 smithi027 bash[22610]: cluster 2024-08-31T09:37:11.710506+0000 mgr.a (mgr.14388) 19281 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:12 smithi191 bash[24992]: cluster 2024-08-31T09:37:11.710506+0000 mgr.a (mgr.14388) 19281 : cluster [DBG] pgmap v13368: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:12.917 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:12.918 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:12.918 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:13.679 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:13.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:13.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:13.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:13.679 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:37:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:14 smithi191 bash[24992]: audit 2024-08-31T09:37:13.252001+0000 mgr.a (mgr.14388) 19282 : audit [DBG] from='client.413973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:14 smithi191 bash[24992]: cluster 2024-08-31T09:37:13.711802+0000 mgr.a (mgr.14388) 19283 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:14 smithi163 bash[24253]: audit 2024-08-31T09:37:13.252001+0000 mgr.a (mgr.14388) 19282 : audit [DBG] from='client.413973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:14 smithi163 bash[24253]: cluster 2024-08-31T09:37:13.711802+0000 mgr.a (mgr.14388) 19283 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:14 smithi027 bash[22610]: audit 2024-08-31T09:37:13.252001+0000 mgr.a (mgr.14388) 19282 : audit [DBG] from='client.413973 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:14 smithi027 bash[22610]: cluster 2024-08-31T09:37:13.711802+0000 mgr.a (mgr.14388) 19283 : cluster [DBG] pgmap v13369: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:15 smithi191 bash[24992]: audit 2024-08-31T09:37:15.677236+0000 mon.a (mon.0) 3446 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:37:16.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:15 smithi163 bash[24253]: audit 2024-08-31T09:37:15.677236+0000 mon.a (mon.0) 3446 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:37:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:15 smithi027 bash[22610]: audit 2024-08-31T09:37:15.677236+0000 mon.a (mon.0) 3446 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:37:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:16 smithi191 bash[24992]: cluster 2024-08-31T09:37:15.712520+0000 mgr.a (mgr.14388) 19284 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:37:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:16 smithi191 bash[24992]: audit 2024-08-31T09:37:16.304968+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:37:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:16 smithi191 bash[24992]: audit 2024-08-31T09:37:16.310452+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:37:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:16 smithi163 bash[24253]: cluster 2024-08-31T09:37:15.712520+0000 mgr.a (mgr.14388) 19284 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:37:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:16 smithi163 bash[24253]: audit 2024-08-31T09:37:16.304968+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:37:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:16 smithi163 bash[24253]: audit 2024-08-31T09:37:16.310452+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:37:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:16 smithi027 bash[22610]: cluster 2024-08-31T09:37:15.712520+0000 mgr.a (mgr.14388) 19284 : cluster [DBG] pgmap v13370: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:37:17.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:16 smithi027 bash[22610]: audit 2024-08-31T09:37:16.304968+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:37:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:16 smithi027 bash[22610]: audit 2024-08-31T09:37:16.310452+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:37:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:17 smithi191 bash[24992]: audit 2024-08-31T09:37:17.067285+0000 mon.a (mon.0) 3449 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:37:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:17 smithi191 bash[24992]: audit 2024-08-31T09:37:17.068205+0000 mon.a (mon.0) 3450 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:37:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:17 smithi191 bash[24992]: audit 2024-08-31T09:37:17.074007+0000 mon.a (mon.0) 3451 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:37:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:17 smithi191 bash[24992]: audit 2024-08-31T09:37:17.076675+0000 mon.a (mon.0) 3452 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:37:18.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:17 smithi163 bash[24253]: audit 2024-08-31T09:37:17.067285+0000 mon.a (mon.0) 3449 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:37:18.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:17 smithi163 bash[24253]: audit 2024-08-31T09:37:17.068205+0000 mon.a (mon.0) 3450 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:37:18.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:17 smithi163 bash[24253]: audit 2024-08-31T09:37:17.074007+0000 mon.a (mon.0) 3451 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:37:18.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:17 smithi163 bash[24253]: audit 2024-08-31T09:37:17.076675+0000 mon.a (mon.0) 3452 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:37:18.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:37:17 smithi027 bash[22863]: debug 2024-08-31T09:37:17.821+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:37:18.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:37:17 smithi027 bash[22863]: debug 2024-08-31T09:37:17.825+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:37:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:17 smithi027 bash[22610]: audit 2024-08-31T09:37:17.067285+0000 mon.a (mon.0) 3449 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:37:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:17 smithi027 bash[22610]: audit 2024-08-31T09:37:17.068205+0000 mon.a (mon.0) 3450 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:37:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:17 smithi027 bash[22610]: audit 2024-08-31T09:37:17.074007+0000 mon.a (mon.0) 3451 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:37:18.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:17 smithi027 bash[22610]: audit 2024-08-31T09:37:17.076675+0000 mon.a (mon.0) 3452 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:37:18.680 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:18.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:18.681 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:18 smithi191 bash[24992]: audit 2024-08-31T09:37:17.078980+0000 mgr.a (mgr.14388) 19285 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:37:19.040 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:18 smithi191 bash[24992]: cluster 2024-08-31T09:37:17.713026+0000 mgr.a (mgr.14388) 19286 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:37:19.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:18 smithi191 bash[24992]: audit 2024-08-31T09:37:17.826570+0000 mgr.a (mgr.14388) 19287 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:37:19.041 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:18 smithi191 bash[24992]: cephadm 2024-08-31T09:37:17.828398+0000 mgr.a (mgr.14388) 19288 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:37:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:18 smithi163 bash[24253]: audit 2024-08-31T09:37:17.078980+0000 mgr.a (mgr.14388) 19285 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:37:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:18 smithi163 bash[24253]: cluster 2024-08-31T09:37:17.713026+0000 mgr.a (mgr.14388) 19286 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:37:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:18 smithi163 bash[24253]: audit 2024-08-31T09:37:17.826570+0000 mgr.a (mgr.14388) 19287 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:37:19.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:18 smithi163 bash[24253]: cephadm 2024-08-31T09:37:17.828398+0000 mgr.a (mgr.14388) 19288 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:37:19.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:18 smithi027 bash[22610]: audit 2024-08-31T09:37:17.078980+0000 mgr.a (mgr.14388) 19285 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:37:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:18 smithi027 bash[22610]: cluster 2024-08-31T09:37:17.713026+0000 mgr.a (mgr.14388) 19286 : cluster [DBG] pgmap v13371: 225 pgs: 225 active+clean; 589 KiB data, 230 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:37:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:18 smithi027 bash[22610]: audit 2024-08-31T09:37:17.826570+0000 mgr.a (mgr.14388) 19287 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:37:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:18 smithi027 bash[22610]: cephadm 2024-08-31T09:37:17.828398+0000 mgr.a (mgr.14388) 19288 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:37:19.433 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:19.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:19.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:19.433 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:19.434 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:37:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:20 smithi163 bash[24253]: audit 2024-08-31T09:37:19.009204+0000 mgr.a (mgr.14388) 19289 : audit [DBG] from='client.414159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:20 smithi163 bash[24253]: cluster 2024-08-31T09:37:19.715832+0000 mgr.a (mgr.14388) 19290 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:20 smithi027 bash[22610]: audit 2024-08-31T09:37:19.009204+0000 mgr.a (mgr.14388) 19289 : audit [DBG] from='client.414159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:20 smithi027 bash[22610]: cluster 2024-08-31T09:37:19.715832+0000 mgr.a (mgr.14388) 19290 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:20 smithi191 bash[24992]: audit 2024-08-31T09:37:19.009204+0000 mgr.a (mgr.14388) 19289 : audit [DBG] from='client.414159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:20 smithi191 bash[24992]: cluster 2024-08-31T09:37:19.715832+0000 mgr.a (mgr.14388) 19290 : cluster [DBG] pgmap v13372: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:22 smithi163 bash[24253]: cluster 2024-08-31T09:37:21.716601+0000 mgr.a (mgr.14388) 19291 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:37:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:22 smithi027 bash[22610]: cluster 2024-08-31T09:37:21.716601+0000 mgr.a (mgr.14388) 19291 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:37:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:22 smithi191 bash[24992]: cluster 2024-08-31T09:37:21.716601+0000 mgr.a (mgr.14388) 19291 : cluster [DBG] pgmap v13373: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:37:24.435 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:24.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:24.435 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:25.190 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:25.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:25.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:25.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:25.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:37:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:24 smithi163 bash[24253]: cluster 2024-08-31T09:37:23.718507+0000 mgr.a (mgr.14388) 19292 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:24 smithi027 bash[22610]: cluster 2024-08-31T09:37:23.718507+0000 mgr.a (mgr.14388) 19292 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:24 smithi191 bash[24992]: cluster 2024-08-31T09:37:23.718507+0000 mgr.a (mgr.14388) 19292 : cluster [DBG] pgmap v13374: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:26.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:25 smithi163 bash[24253]: audit 2024-08-31T09:37:24.768144+0000 mgr.a (mgr.14388) 19293 : audit [DBG] from='client.414237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:25 smithi027 bash[22610]: audit 2024-08-31T09:37:24.768144+0000 mgr.a (mgr.14388) 19293 : audit [DBG] from='client.414237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:26.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:25 smithi191 bash[24992]: audit 2024-08-31T09:37:24.768144+0000 mgr.a (mgr.14388) 19293 : audit [DBG] from='client.414237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:27.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:26 smithi163 bash[24253]: cluster 2024-08-31T09:37:25.719401+0000 mgr.a (mgr.14388) 19294 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:27.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:26 smithi027 bash[22610]: cluster 2024-08-31T09:37:25.719401+0000 mgr.a (mgr.14388) 19294 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:26 smithi191 bash[24992]: cluster 2024-08-31T09:37:25.719401+0000 mgr.a (mgr.14388) 19294 : cluster [DBG] pgmap v13375: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:28 smithi163 bash[24253]: cluster 2024-08-31T09:37:27.720167+0000 mgr.a (mgr.14388) 19295 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:28 smithi027 bash[22610]: cluster 2024-08-31T09:37:27.720167+0000 mgr.a (mgr.14388) 19295 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:28 smithi191 bash[24992]: cluster 2024-08-31T09:37:27.720167+0000 mgr.a (mgr.14388) 19295 : cluster [DBG] pgmap v13376: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:30.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:30.192 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:30.193 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:30.956 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:30.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:30.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:30.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:30.956 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:37:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:30 smithi163 bash[24253]: cluster 2024-08-31T09:37:29.722456+0000 mgr.a (mgr.14388) 19296 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:30 smithi027 bash[22610]: cluster 2024-08-31T09:37:29.722456+0000 mgr.a (mgr.14388) 19296 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:30 smithi191 bash[24992]: cluster 2024-08-31T09:37:29.722456+0000 mgr.a (mgr.14388) 19296 : cluster [DBG] pgmap v13377: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:37:32.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:31 smithi163 bash[24253]: audit 2024-08-31T09:37:30.528634+0000 mgr.a (mgr.14388) 19297 : audit [DBG] from='client.414315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:31 smithi027 bash[22610]: audit 2024-08-31T09:37:30.528634+0000 mgr.a (mgr.14388) 19297 : audit [DBG] from='client.414315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:31 smithi191 bash[24992]: audit 2024-08-31T09:37:30.528634+0000 mgr.a (mgr.14388) 19297 : audit [DBG] from='client.414315 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:32 smithi163 bash[24253]: cluster 2024-08-31T09:37:31.723384+0000 mgr.a (mgr.14388) 19298 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:32 smithi027 bash[22610]: cluster 2024-08-31T09:37:31.723384+0000 mgr.a (mgr.14388) 19298 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:33.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:32 smithi191 bash[24992]: cluster 2024-08-31T09:37:31.723384+0000 mgr.a (mgr.14388) 19298 : cluster [DBG] pgmap v13378: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:34 smithi163 bash[24253]: cluster 2024-08-31T09:37:33.725490+0000 mgr.a (mgr.14388) 19299 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:34 smithi027 bash[22610]: cluster 2024-08-31T09:37:33.725490+0000 mgr.a (mgr.14388) 19299 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:34 smithi191 bash[24992]: cluster 2024-08-31T09:37:33.725490+0000 mgr.a (mgr.14388) 19299 : cluster [DBG] pgmap v13379: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:35.957 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:35.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:35.958 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:36.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:36.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:36.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:36.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:37:36.738 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:36 smithi163 bash[24253]: cluster 2024-08-31T09:37:35.726229+0000 mgr.a (mgr.14388) 19300 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:37.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:36 smithi027 bash[22610]: cluster 2024-08-31T09:37:35.726229+0000 mgr.a (mgr.14388) 19300 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:37.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:36 smithi191 bash[24992]: cluster 2024-08-31T09:37:35.726229+0000 mgr.a (mgr.14388) 19300 : cluster [DBG] pgmap v13380: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:38.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:37 smithi163 bash[24253]: audit 2024-08-31T09:37:36.298212+0000 mgr.a (mgr.14388) 19301 : audit [DBG] from='client.414393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:37 smithi027 bash[22610]: audit 2024-08-31T09:37:36.298212+0000 mgr.a (mgr.14388) 19301 : audit [DBG] from='client.414393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:37 smithi191 bash[24992]: audit 2024-08-31T09:37:36.298212+0000 mgr.a (mgr.14388) 19301 : audit [DBG] from='client.414393 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:38 smithi163 bash[24253]: cluster 2024-08-31T09:37:37.727212+0000 mgr.a (mgr.14388) 19302 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:38 smithi027 bash[22610]: cluster 2024-08-31T09:37:37.727212+0000 mgr.a (mgr.14388) 19302 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:38 smithi191 bash[24992]: cluster 2024-08-31T09:37:37.727212+0000 mgr.a (mgr.14388) 19302 : cluster [DBG] pgmap v13381: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:40 smithi163 bash[24253]: cluster 2024-08-31T09:37:39.729448+0000 mgr.a (mgr.14388) 19303 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:41.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:40 smithi027 bash[22610]: cluster 2024-08-31T09:37:39.729448+0000 mgr.a (mgr.14388) 19303 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:41.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:40 smithi191 bash[24992]: cluster 2024-08-31T09:37:39.729448+0000 mgr.a (mgr.14388) 19303 : cluster [DBG] pgmap v13382: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:41.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:41.740 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:41.740 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:42.509 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:37:42.509 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:42 smithi163 bash[24253]: cluster 2024-08-31T09:37:41.730213+0000 mgr.a (mgr.14388) 19304 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:42 smithi027 bash[22610]: cluster 2024-08-31T09:37:41.730213+0000 mgr.a (mgr.14388) 19304 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:42 smithi191 bash[24992]: cluster 2024-08-31T09:37:41.730213+0000 mgr.a (mgr.14388) 19304 : cluster [DBG] pgmap v13383: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:43 smithi163 bash[24253]: audit 2024-08-31T09:37:42.080768+0000 mgr.a (mgr.14388) 19305 : audit [DBG] from='client.414471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:44.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:43 smithi027 bash[22610]: audit 2024-08-31T09:37:42.080768+0000 mgr.a (mgr.14388) 19305 : audit [DBG] from='client.414471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:44.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:43 smithi191 bash[24992]: audit 2024-08-31T09:37:42.080768+0000 mgr.a (mgr.14388) 19305 : audit [DBG] from='client.414471 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:44 smithi163 bash[24253]: cluster 2024-08-31T09:37:43.732717+0000 mgr.a (mgr.14388) 19306 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:44 smithi027 bash[22610]: cluster 2024-08-31T09:37:43.732717+0000 mgr.a (mgr.14388) 19306 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:45.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:44 smithi191 bash[24992]: cluster 2024-08-31T09:37:43.732717+0000 mgr.a (mgr.14388) 19306 : cluster [DBG] pgmap v13384: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:37:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:46 smithi163 bash[24253]: cluster 2024-08-31T09:37:45.733684+0000 mgr.a (mgr.14388) 19307 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:46 smithi027 bash[22610]: cluster 2024-08-31T09:37:45.733684+0000 mgr.a (mgr.14388) 19307 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:46 smithi191 bash[24992]: cluster 2024-08-31T09:37:45.733684+0000 mgr.a (mgr.14388) 19307 : cluster [DBG] pgmap v13385: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:47.510 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:47.511 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:47.511 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:48.287 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:48.287 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:37:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:48 smithi163 bash[24253]: cluster 2024-08-31T09:37:47.734593+0000 mgr.a (mgr.14388) 19308 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:48 smithi163 bash[24253]: audit 2024-08-31T09:37:47.849957+0000 mgr.a (mgr.14388) 19309 : audit [DBG] from='client.414546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:48 smithi027 bash[22610]: cluster 2024-08-31T09:37:47.734593+0000 mgr.a (mgr.14388) 19308 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:48 smithi027 bash[22610]: audit 2024-08-31T09:37:47.849957+0000 mgr.a (mgr.14388) 19309 : audit [DBG] from='client.414546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:49.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:48 smithi191 bash[24992]: cluster 2024-08-31T09:37:47.734593+0000 mgr.a (mgr.14388) 19308 : cluster [DBG] pgmap v13386: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:48 smithi191 bash[24992]: audit 2024-08-31T09:37:47.849957+0000 mgr.a (mgr.14388) 19309 : audit [DBG] from='client.414546 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:50 smithi163 bash[24253]: cluster 2024-08-31T09:37:49.737478+0000 mgr.a (mgr.14388) 19310 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:37:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:50 smithi027 bash[22610]: cluster 2024-08-31T09:37:49.737478+0000 mgr.a (mgr.14388) 19310 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:37:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:50 smithi191 bash[24992]: cluster 2024-08-31T09:37:49.737478+0000 mgr.a (mgr.14388) 19310 : cluster [DBG] pgmap v13387: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:37:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:52 smithi163 bash[24253]: cluster 2024-08-31T09:37:51.738420+0000 mgr.a (mgr.14388) 19311 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:37:53.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:52 smithi027 bash[22610]: cluster 2024-08-31T09:37:51.738420+0000 mgr.a (mgr.14388) 19311 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:37:53.288 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:53.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:52 smithi191 bash[24992]: cluster 2024-08-31T09:37:51.738420+0000 mgr.a (mgr.14388) 19311 : cluster [DBG] pgmap v13388: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:37:53.289 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:53.289 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:54.076 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:54.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:54.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:54.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:54.076 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:37:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:54 smithi163 bash[24253]: audit 2024-08-31T09:37:53.623922+0000 mgr.a (mgr.14388) 19312 : audit [DBG] from='client.414621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:54 smithi163 bash[24253]: cluster 2024-08-31T09:37:53.739737+0000 mgr.a (mgr.14388) 19313 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:54 smithi027 bash[22610]: audit 2024-08-31T09:37:53.623922+0000 mgr.a (mgr.14388) 19312 : audit [DBG] from='client.414621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:54 smithi027 bash[22610]: cluster 2024-08-31T09:37:53.739737+0000 mgr.a (mgr.14388) 19313 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:54 smithi191 bash[24992]: audit 2024-08-31T09:37:53.623922+0000 mgr.a (mgr.14388) 19312 : audit [DBG] from='client.414621 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:37:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:54 smithi191 bash[24992]: cluster 2024-08-31T09:37:53.739737+0000 mgr.a (mgr.14388) 19313 : cluster [DBG] pgmap v13389: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:37:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:56 smithi163 bash[24253]: cluster 2024-08-31T09:37:55.740649+0000 mgr.a (mgr.14388) 19314 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:37:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:56 smithi027 bash[22610]: cluster 2024-08-31T09:37:55.740649+0000 mgr.a (mgr.14388) 19314 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:37:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:56 smithi191 bash[24992]: cluster 2024-08-31T09:37:55.740649+0000 mgr.a (mgr.14388) 19314 : cluster [DBG] pgmap v13390: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:37:59.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:37:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:37:59.078 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:37:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:37:58 smithi163 bash[24253]: cluster 2024-08-31T09:37:57.741470+0000 mgr.a (mgr.14388) 19315 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:37:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:37:58 smithi027 bash[22610]: cluster 2024-08-31T09:37:57.741470+0000 mgr.a (mgr.14388) 19315 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:37:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:37:58 smithi191 bash[24992]: cluster 2024-08-31T09:37:57.741470+0000 mgr.a (mgr.14388) 19315 : cluster [DBG] pgmap v13391: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:37:59.861 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:37:59.861 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:37:59.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:37:59.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:37:59.862 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:00 smithi163 bash[24253]: audit 2024-08-31T09:37:59.416328+0000 mgr.a (mgr.14388) 19316 : audit [DBG] from='client.414699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:00 smithi163 bash[24253]: cluster 2024-08-31T09:37:59.742788+0000 mgr.a (mgr.14388) 19317 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:00 smithi027 bash[22610]: audit 2024-08-31T09:37:59.416328+0000 mgr.a (mgr.14388) 19316 : audit [DBG] from='client.414699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:00 smithi027 bash[22610]: cluster 2024-08-31T09:37:59.742788+0000 mgr.a (mgr.14388) 19317 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:00 smithi191 bash[24992]: audit 2024-08-31T09:37:59.416328+0000 mgr.a (mgr.14388) 19316 : audit [DBG] from='client.414699 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:00 smithi191 bash[24992]: cluster 2024-08-31T09:37:59.742788+0000 mgr.a (mgr.14388) 19317 : cluster [DBG] pgmap v13392: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:02 smithi163 bash[24253]: cluster 2024-08-31T09:38:01.743625+0000 mgr.a (mgr.14388) 19318 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:38:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:02 smithi027 bash[22610]: cluster 2024-08-31T09:38:01.743625+0000 mgr.a (mgr.14388) 19318 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:38:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:02 smithi191 bash[24992]: cluster 2024-08-31T09:38:01.743625+0000 mgr.a (mgr.14388) 19318 : cluster [DBG] pgmap v13393: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:38:04.863 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:38:04.864 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:38:04.866 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:38:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:04 smithi163 bash[24253]: cluster 2024-08-31T09:38:03.745950+0000 mgr.a (mgr.14388) 19319 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:38:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:04 smithi027 bash[22610]: cluster 2024-08-31T09:38:03.745950+0000 mgr.a (mgr.14388) 19319 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:38:05.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:04 smithi191 bash[24992]: cluster 2024-08-31T09:38:03.745950+0000 mgr.a (mgr.14388) 19319 : cluster [DBG] pgmap v13394: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:38:05.639 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:38:05.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:38:05.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:38:05.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:38:05.639 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:06 smithi163 bash[24253]: audit 2024-08-31T09:38:05.201030+0000 mgr.a (mgr.14388) 19320 : audit [DBG] from='client.414777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:07.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:06 smithi163 bash[24253]: cluster 2024-08-31T09:38:05.746932+0000 mgr.a (mgr.14388) 19321 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:06 smithi027 bash[22610]: audit 2024-08-31T09:38:05.201030+0000 mgr.a (mgr.14388) 19320 : audit [DBG] from='client.414777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:06 smithi027 bash[22610]: cluster 2024-08-31T09:38:05.746932+0000 mgr.a (mgr.14388) 19321 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:06 smithi191 bash[24992]: audit 2024-08-31T09:38:05.201030+0000 mgr.a (mgr.14388) 19320 : audit [DBG] from='client.414777 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:06 smithi191 bash[24992]: cluster 2024-08-31T09:38:05.746932+0000 mgr.a (mgr.14388) 19321 : cluster [DBG] pgmap v13395: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:08 smithi163 bash[24253]: cluster 2024-08-31T09:38:07.747723+0000 mgr.a (mgr.14388) 19322 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:08 smithi027 bash[22610]: cluster 2024-08-31T09:38:07.747723+0000 mgr.a (mgr.14388) 19322 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:08 smithi191 bash[24992]: cluster 2024-08-31T09:38:07.747723+0000 mgr.a (mgr.14388) 19322 : cluster [DBG] pgmap v13396: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:10.640 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:38:10.641 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:38:10.641 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:38:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:10 smithi163 bash[24253]: cluster 2024-08-31T09:38:09.749928+0000 mgr.a (mgr.14388) 19323 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:11.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:10 smithi027 bash[22610]: cluster 2024-08-31T09:38:09.749928+0000 mgr.a (mgr.14388) 19323 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:10 smithi191 bash[24992]: cluster 2024-08-31T09:38:09.749928+0000 mgr.a (mgr.14388) 19323 : cluster [DBG] pgmap v13397: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:11.384 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:38:11.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:38:11.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:38:11.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:38:11.384 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:12.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:11 smithi163 bash[24253]: audit 2024-08-31T09:38:10.963042+0000 mgr.a (mgr.14388) 19324 : audit [DBG] from='client.414855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:11 smithi027 bash[22610]: audit 2024-08-31T09:38:10.963042+0000 mgr.a (mgr.14388) 19324 : audit [DBG] from='client.414855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:11 smithi191 bash[24992]: audit 2024-08-31T09:38:10.963042+0000 mgr.a (mgr.14388) 19324 : audit [DBG] from='client.414855 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:12 smithi163 bash[24253]: cluster 2024-08-31T09:38:11.750839+0000 mgr.a (mgr.14388) 19325 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:12 smithi027 bash[22610]: cluster 2024-08-31T09:38:11.750839+0000 mgr.a (mgr.14388) 19325 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:12 smithi191 bash[24992]: cluster 2024-08-31T09:38:11.750839+0000 mgr.a (mgr.14388) 19325 : cluster [DBG] pgmap v13398: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:14 smithi163 bash[24253]: cluster 2024-08-31T09:38:13.752926+0000 mgr.a (mgr.14388) 19326 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:14 smithi027 bash[22610]: cluster 2024-08-31T09:38:13.752926+0000 mgr.a (mgr.14388) 19326 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:14 smithi191 bash[24992]: cluster 2024-08-31T09:38:13.752926+0000 mgr.a (mgr.14388) 19326 : cluster [DBG] pgmap v13399: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:16.385 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:38:16.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:38:16.386 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:38:17.164 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:38:17.164 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:38:17.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:38:17.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:38:17.165 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:16 smithi163 bash[24253]: cluster 2024-08-31T09:38:15.753701+0000 mgr.a (mgr.14388) 19327 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:16 smithi027 bash[22610]: cluster 2024-08-31T09:38:15.753701+0000 mgr.a (mgr.14388) 19327 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:16 smithi191 bash[24992]: cluster 2024-08-31T09:38:15.753701+0000 mgr.a (mgr.14388) 19327 : cluster [DBG] pgmap v13400: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:17 smithi027 bash[22610]: audit 2024-08-31T09:38:16.724543+0000 mgr.a (mgr.14388) 19328 : audit [DBG] from='client.414933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:17 smithi027 bash[22610]: audit 2024-08-31T09:38:17.886658+0000 mon.a (mon.0) 3453 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:38:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:17 smithi191 bash[24992]: audit 2024-08-31T09:38:16.724543+0000 mgr.a (mgr.14388) 19328 : audit [DBG] from='client.414933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:17 smithi191 bash[24992]: audit 2024-08-31T09:38:17.886658+0000 mon.a (mon.0) 3453 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:38:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:17 smithi163 bash[24253]: audit 2024-08-31T09:38:16.724543+0000 mgr.a (mgr.14388) 19328 : audit [DBG] from='client.414933 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:17 smithi163 bash[24253]: audit 2024-08-31T09:38:17.886658+0000 mon.a (mon.0) 3453 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:38:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:18 smithi027 bash[22610]: cluster 2024-08-31T09:38:17.754707+0000 mgr.a (mgr.14388) 19329 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:18 smithi027 bash[22610]: audit 2024-08-31T09:38:18.503841+0000 mon.a (mon.0) 3454 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:18 smithi027 bash[22610]: audit 2024-08-31T09:38:18.507785+0000 mon.a (mon.0) 3455 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:18 smithi027 bash[22610]: audit 2024-08-31T09:38:18.513576+0000 mon.a (mon.0) 3456 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:18 smithi027 bash[22610]: audit 2024-08-31T09:38:18.518130+0000 mon.a (mon.0) 3457 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:18 smithi191 bash[24992]: cluster 2024-08-31T09:38:17.754707+0000 mgr.a (mgr.14388) 19329 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:18 smithi191 bash[24992]: audit 2024-08-31T09:38:18.503841+0000 mon.a (mon.0) 3454 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:18 smithi191 bash[24992]: audit 2024-08-31T09:38:18.507785+0000 mon.a (mon.0) 3455 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:18 smithi191 bash[24992]: audit 2024-08-31T09:38:18.513576+0000 mon.a (mon.0) 3456 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:18 smithi191 bash[24992]: audit 2024-08-31T09:38:18.518130+0000 mon.a (mon.0) 3457 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:18 smithi163 bash[24253]: cluster 2024-08-31T09:38:17.754707+0000 mgr.a (mgr.14388) 19329 : cluster [DBG] pgmap v13401: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:18 smithi163 bash[24253]: audit 2024-08-31T09:38:18.503841+0000 mon.a (mon.0) 3454 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:18 smithi163 bash[24253]: audit 2024-08-31T09:38:18.507785+0000 mon.a (mon.0) 3455 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:18 smithi163 bash[24253]: audit 2024-08-31T09:38:18.513576+0000 mon.a (mon.0) 3456 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:19.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:18 smithi163 bash[24253]: audit 2024-08-31T09:38:18.518130+0000 mon.a (mon.0) 3457 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:19 smithi027 bash[22610]: audit 2024-08-31T09:38:19.261662+0000 mon.a (mon.0) 3458 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:38:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:19 smithi027 bash[22610]: audit 2024-08-31T09:38:19.263016+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:38:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:19 smithi027 bash[22610]: audit 2024-08-31T09:38:19.273744+0000 mon.a (mon.0) 3460 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:19 smithi027 bash[22610]: audit 2024-08-31T09:38:19.276382+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:38:20.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:38:20 smithi027 bash[22863]: debug 2024-08-31T09:38:20.011+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:38:20.234 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:38:20 smithi027 bash[22863]: debug 2024-08-31T09:38:20.011+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:38:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:19 smithi191 bash[24992]: audit 2024-08-31T09:38:19.261662+0000 mon.a (mon.0) 3458 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:38:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:19 smithi191 bash[24992]: audit 2024-08-31T09:38:19.263016+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:38:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:19 smithi191 bash[24992]: audit 2024-08-31T09:38:19.273744+0000 mon.a (mon.0) 3460 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:19 smithi191 bash[24992]: audit 2024-08-31T09:38:19.276382+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:38:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:19 smithi163 bash[24253]: audit 2024-08-31T09:38:19.261662+0000 mon.a (mon.0) 3458 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:38:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:19 smithi163 bash[24253]: audit 2024-08-31T09:38:19.263016+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:38:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:19 smithi163 bash[24253]: audit 2024-08-31T09:38:19.273744+0000 mon.a (mon.0) 3460 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:38:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:19 smithi163 bash[24253]: audit 2024-08-31T09:38:19.276382+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:38:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:20 smithi027 bash[22610]: audit 2024-08-31T09:38:19.278550+0000 mgr.a (mgr.14388) 19330 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:38:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:20 smithi027 bash[22610]: cluster 2024-08-31T09:38:19.756501+0000 mgr.a (mgr.14388) 19331 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:20 smithi191 bash[24992]: audit 2024-08-31T09:38:19.278550+0000 mgr.a (mgr.14388) 19330 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:38:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:20 smithi191 bash[24992]: cluster 2024-08-31T09:38:19.756501+0000 mgr.a (mgr.14388) 19331 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:20 smithi163 bash[24253]: audit 2024-08-31T09:38:19.278550+0000 mgr.a (mgr.14388) 19330 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:38:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:20 smithi163 bash[24253]: cluster 2024-08-31T09:38:19.756501+0000 mgr.a (mgr.14388) 19331 : cluster [DBG] pgmap v13402: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:22.166 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:38:22.198 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:38:22.199 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:38:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:21 smithi027 bash[22610]: audit 2024-08-31T09:38:20.017022+0000 mgr.a (mgr.14388) 19332 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:38:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:21 smithi027 bash[22610]: cephadm 2024-08-31T09:38:20.018617+0000 mgr.a (mgr.14388) 19333 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:38:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:21 smithi191 bash[24992]: audit 2024-08-31T09:38:20.017022+0000 mgr.a (mgr.14388) 19332 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:38:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:21 smithi191 bash[24992]: cephadm 2024-08-31T09:38:20.018617+0000 mgr.a (mgr.14388) 19333 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:38:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:21 smithi163 bash[24253]: audit 2024-08-31T09:38:20.017022+0000 mgr.a (mgr.14388) 19332 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:38:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:21 smithi163 bash[24253]: cephadm 2024-08-31T09:38:20.018617+0000 mgr.a (mgr.14388) 19333 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:38:22.933 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:38:22.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:38:22.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:38:22.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:38:22.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:22 smithi027 bash[22610]: cluster 2024-08-31T09:38:21.757360+0000 mgr.a (mgr.14388) 19334 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:22 smithi191 bash[24992]: cluster 2024-08-31T09:38:21.757360+0000 mgr.a (mgr.14388) 19334 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:22 smithi163 bash[24253]: cluster 2024-08-31T09:38:21.757360+0000 mgr.a (mgr.14388) 19334 : cluster [DBG] pgmap v13403: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:23 smithi027 bash[22610]: audit 2024-08-31T09:38:22.501683+0000 mgr.a (mgr.14388) 19335 : audit [DBG] from='client.415113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:23 smithi191 bash[24992]: audit 2024-08-31T09:38:22.501683+0000 mgr.a (mgr.14388) 19335 : audit [DBG] from='client.415113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:23 smithi163 bash[24253]: audit 2024-08-31T09:38:22.501683+0000 mgr.a (mgr.14388) 19335 : audit [DBG] from='client.415113 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:24 smithi191 bash[24992]: cluster 2024-08-31T09:38:23.759744+0000 mgr.a (mgr.14388) 19336 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:24 smithi163 bash[24253]: cluster 2024-08-31T09:38:23.759744+0000 mgr.a (mgr.14388) 19336 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:24 smithi027 bash[22610]: cluster 2024-08-31T09:38:23.759744+0000 mgr.a (mgr.14388) 19336 : cluster [DBG] pgmap v13404: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:26 smithi191 bash[24992]: cluster 2024-08-31T09:38:25.760529+0000 mgr.a (mgr.14388) 19337 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:26 smithi163 bash[24253]: cluster 2024-08-31T09:38:25.760529+0000 mgr.a (mgr.14388) 19337 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:26 smithi027 bash[22610]: cluster 2024-08-31T09:38:25.760529+0000 mgr.a (mgr.14388) 19337 : cluster [DBG] pgmap v13405: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:27.935 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:38:27.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:38:27.935 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:38:28.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:38:28.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:38:28.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:38:28.714 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:28.715 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:38:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:28 smithi191 bash[24992]: cluster 2024-08-31T09:38:27.761245+0000 mgr.a (mgr.14388) 19338 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:28 smithi163 bash[24253]: cluster 2024-08-31T09:38:27.761245+0000 mgr.a (mgr.14388) 19338 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:28 smithi027 bash[22610]: cluster 2024-08-31T09:38:27.761245+0000 mgr.a (mgr.14388) 19338 : cluster [DBG] pgmap v13406: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:30 smithi191 bash[24992]: audit 2024-08-31T09:38:28.276118+0000 mgr.a (mgr.14388) 19339 : audit [DBG] from='client.415191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:30 smithi163 bash[24253]: audit 2024-08-31T09:38:28.276118+0000 mgr.a (mgr.14388) 19339 : audit [DBG] from='client.415191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:30 smithi027 bash[22610]: audit 2024-08-31T09:38:28.276118+0000 mgr.a (mgr.14388) 19339 : audit [DBG] from='client.415191 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:31 smithi191 bash[24992]: cluster 2024-08-31T09:38:29.764095+0000 mgr.a (mgr.14388) 19340 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:31 smithi163 bash[24253]: cluster 2024-08-31T09:38:29.764095+0000 mgr.a (mgr.14388) 19340 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:31.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:31 smithi027 bash[22610]: cluster 2024-08-31T09:38:29.764095+0000 mgr.a (mgr.14388) 19340 : cluster [DBG] pgmap v13407: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:32 smithi191 bash[24992]: cluster 2024-08-31T09:38:31.764900+0000 mgr.a (mgr.14388) 19341 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:38:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:32 smithi163 bash[24253]: cluster 2024-08-31T09:38:31.764900+0000 mgr.a (mgr.14388) 19341 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:38:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:32 smithi027 bash[22610]: cluster 2024-08-31T09:38:31.764900+0000 mgr.a (mgr.14388) 19341 : cluster [DBG] pgmap v13408: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:38:33.715 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:38:33.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:38:33.716 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:38:34.490 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:38:34.490 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:38:34.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:38:34.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:38:34.491 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:34 smithi163 bash[24253]: cluster 2024-08-31T09:38:33.766915+0000 mgr.a (mgr.14388) 19342 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:34 smithi027 bash[22610]: cluster 2024-08-31T09:38:33.766915+0000 mgr.a (mgr.14388) 19342 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:34 smithi191 bash[24992]: cluster 2024-08-31T09:38:33.766915+0000 mgr.a (mgr.14388) 19342 : cluster [DBG] pgmap v13409: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:38:36.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:35 smithi163 bash[24253]: audit 2024-08-31T09:38:34.055549+0000 mgr.a (mgr.14388) 19343 : audit [DBG] from='client.415269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:35 smithi027 bash[22610]: audit 2024-08-31T09:38:34.055549+0000 mgr.a (mgr.14388) 19343 : audit [DBG] from='client.415269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:36.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:35 smithi191 bash[24992]: audit 2024-08-31T09:38:34.055549+0000 mgr.a (mgr.14388) 19343 : audit [DBG] from='client.415269 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:36 smithi163 bash[24253]: cluster 2024-08-31T09:38:35.767796+0000 mgr.a (mgr.14388) 19344 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:38:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:36 smithi027 bash[22610]: cluster 2024-08-31T09:38:35.767796+0000 mgr.a (mgr.14388) 19344 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:38:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:36 smithi191 bash[24992]: cluster 2024-08-31T09:38:35.767796+0000 mgr.a (mgr.14388) 19344 : cluster [DBG] pgmap v13410: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:38:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:38 smithi163 bash[24253]: cluster 2024-08-31T09:38:37.768523+0000 mgr.a (mgr.14388) 19345 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:38:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:38 smithi027 bash[22610]: cluster 2024-08-31T09:38:37.768523+0000 mgr.a (mgr.14388) 19345 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:38:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:38 smithi191 bash[24992]: cluster 2024-08-31T09:38:37.768523+0000 mgr.a (mgr.14388) 19345 : cluster [DBG] pgmap v13411: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:38:39.492 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:38:39.492 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:38:39.492 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:38:40.271 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:38:40.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:38:40.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:38:40.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:38:40.271 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:40 smithi163 bash[24253]: cluster 2024-08-31T09:38:39.770622+0000 mgr.a (mgr.14388) 19346 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:40 smithi163 bash[24253]: audit 2024-08-31T09:38:39.829990+0000 mgr.a (mgr.14388) 19347 : audit [DBG] from='client.415341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:40 smithi027 bash[22610]: cluster 2024-08-31T09:38:39.770622+0000 mgr.a (mgr.14388) 19346 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:40 smithi027 bash[22610]: audit 2024-08-31T09:38:39.829990+0000 mgr.a (mgr.14388) 19347 : audit [DBG] from='client.415341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:40 smithi191 bash[24992]: cluster 2024-08-31T09:38:39.770622+0000 mgr.a (mgr.14388) 19346 : cluster [DBG] pgmap v13412: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:40 smithi191 bash[24992]: audit 2024-08-31T09:38:39.829990+0000 mgr.a (mgr.14388) 19347 : audit [DBG] from='client.415341 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:42 smithi163 bash[24253]: cluster 2024-08-31T09:38:41.771551+0000 mgr.a (mgr.14388) 19348 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:42 smithi027 bash[22610]: cluster 2024-08-31T09:38:41.771551+0000 mgr.a (mgr.14388) 19348 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:42 smithi191 bash[24992]: cluster 2024-08-31T09:38:41.771551+0000 mgr.a (mgr.14388) 19348 : cluster [DBG] pgmap v13413: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:44 smithi163 bash[24253]: cluster 2024-08-31T09:38:43.773713+0000 mgr.a (mgr.14388) 19349 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:44 smithi027 bash[22610]: cluster 2024-08-31T09:38:43.773713+0000 mgr.a (mgr.14388) 19349 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:45.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:38:45.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:38:45.273 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:38:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:44 smithi191 bash[24992]: cluster 2024-08-31T09:38:43.773713+0000 mgr.a (mgr.14388) 19349 : cluster [DBG] pgmap v13414: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:46.068 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:38:46.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:38:46.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:38:46.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:38:46.068 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:46 smithi163 bash[24253]: audit 2024-08-31T09:38:45.609792+0000 mgr.a (mgr.14388) 19350 : audit [DBG] from='client.415416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:46 smithi163 bash[24253]: cluster 2024-08-31T09:38:45.774450+0000 mgr.a (mgr.14388) 19351 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:46 smithi027 bash[22610]: audit 2024-08-31T09:38:45.609792+0000 mgr.a (mgr.14388) 19350 : audit [DBG] from='client.415416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:46 smithi027 bash[22610]: cluster 2024-08-31T09:38:45.774450+0000 mgr.a (mgr.14388) 19351 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:46 smithi191 bash[24992]: audit 2024-08-31T09:38:45.609792+0000 mgr.a (mgr.14388) 19350 : audit [DBG] from='client.415416 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:46 smithi191 bash[24992]: cluster 2024-08-31T09:38:45.774450+0000 mgr.a (mgr.14388) 19351 : cluster [DBG] pgmap v13415: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:48 smithi163 bash[24253]: cluster 2024-08-31T09:38:47.775434+0000 mgr.a (mgr.14388) 19352 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:48 smithi027 bash[22610]: cluster 2024-08-31T09:38:47.775434+0000 mgr.a (mgr.14388) 19352 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:48 smithi191 bash[24992]: cluster 2024-08-31T09:38:47.775434+0000 mgr.a (mgr.14388) 19352 : cluster [DBG] pgmap v13416: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:51.070 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:38:51.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:38:51.071 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:38:51.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:50 smithi163 bash[24253]: cluster 2024-08-31T09:38:49.777665+0000 mgr.a (mgr.14388) 19353 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:50 smithi027 bash[22610]: cluster 2024-08-31T09:38:49.777665+0000 mgr.a (mgr.14388) 19353 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:50 smithi191 bash[24992]: cluster 2024-08-31T09:38:49.777665+0000 mgr.a (mgr.14388) 19353 : cluster [DBG] pgmap v13417: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:51.846 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:38:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:38:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:38:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:38:51.846 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:53.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:52 smithi163 bash[24253]: audit 2024-08-31T09:38:51.404459+0000 mgr.a (mgr.14388) 19354 : audit [DBG] from='client.415488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:53.201 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:52 smithi163 bash[24253]: cluster 2024-08-31T09:38:51.778196+0000 mgr.a (mgr.14388) 19355 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:52 smithi027 bash[22610]: audit 2024-08-31T09:38:51.404459+0000 mgr.a (mgr.14388) 19354 : audit [DBG] from='client.415488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:52 smithi027 bash[22610]: cluster 2024-08-31T09:38:51.778196+0000 mgr.a (mgr.14388) 19355 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:52 smithi191 bash[24992]: audit 2024-08-31T09:38:51.404459+0000 mgr.a (mgr.14388) 19354 : audit [DBG] from='client.415488 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:52 smithi191 bash[24992]: cluster 2024-08-31T09:38:51.778196+0000 mgr.a (mgr.14388) 19355 : cluster [DBG] pgmap v13418: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:54 smithi163 bash[24253]: cluster 2024-08-31T09:38:53.781064+0000 mgr.a (mgr.14388) 19356 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:54 smithi027 bash[22610]: cluster 2024-08-31T09:38:53.781064+0000 mgr.a (mgr.14388) 19356 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:54 smithi191 bash[24992]: cluster 2024-08-31T09:38:53.781064+0000 mgr.a (mgr.14388) 19356 : cluster [DBG] pgmap v13419: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:38:56.847 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:38:56.848 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:38:56.848 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:38:57.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:56 smithi163 bash[24253]: cluster 2024-08-31T09:38:55.781859+0000 mgr.a (mgr.14388) 19357 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:56 smithi027 bash[22610]: cluster 2024-08-31T09:38:55.781859+0000 mgr.a (mgr.14388) 19357 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:56 smithi191 bash[24992]: cluster 2024-08-31T09:38:55.781859+0000 mgr.a (mgr.14388) 19357 : cluster [DBG] pgmap v13420: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:57.627 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:38:57.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:38:57.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:38:57.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:38:57.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:38:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:58 smithi163 bash[24253]: audit 2024-08-31T09:38:57.185109+0000 mgr.a (mgr.14388) 19358 : audit [DBG] from='client.415566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:59.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:38:58 smithi163 bash[24253]: cluster 2024-08-31T09:38:57.782861+0000 mgr.a (mgr.14388) 19359 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:58 smithi027 bash[22610]: audit 2024-08-31T09:38:57.185109+0000 mgr.a (mgr.14388) 19358 : audit [DBG] from='client.415566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:38:58 smithi027 bash[22610]: cluster 2024-08-31T09:38:57.782861+0000 mgr.a (mgr.14388) 19359 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:38:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:58 smithi191 bash[24992]: audit 2024-08-31T09:38:57.185109+0000 mgr.a (mgr.14388) 19358 : audit [DBG] from='client.415566 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:38:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:38:58 smithi191 bash[24992]: cluster 2024-08-31T09:38:57.782861+0000 mgr.a (mgr.14388) 19359 : cluster [DBG] pgmap v13421: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:00 smithi163 bash[24253]: cluster 2024-08-31T09:38:59.785093+0000 mgr.a (mgr.14388) 19360 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:39:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:00 smithi027 bash[22610]: cluster 2024-08-31T09:38:59.785093+0000 mgr.a (mgr.14388) 19360 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:39:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:00 smithi191 bash[24992]: cluster 2024-08-31T09:38:59.785093+0000 mgr.a (mgr.14388) 19360 : cluster [DBG] pgmap v13422: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:39:02.629 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:39:02.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:39:02.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:39:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:02 smithi163 bash[24253]: cluster 2024-08-31T09:39:01.785802+0000 mgr.a (mgr.14388) 19361 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:02 smithi027 bash[22610]: cluster 2024-08-31T09:39:01.785802+0000 mgr.a (mgr.14388) 19361 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:02 smithi191 bash[24992]: cluster 2024-08-31T09:39:01.785802+0000 mgr.a (mgr.14388) 19361 : cluster [DBG] pgmap v13423: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:03.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:39:03.401 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:39:03.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:39:03.402 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:39:03.402 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:39:04.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:03 smithi163 bash[24253]: audit 2024-08-31T09:39:02.968565+0000 mgr.a (mgr.14388) 19362 : audit [DBG] from='client.415644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:03 smithi027 bash[22610]: audit 2024-08-31T09:39:02.968565+0000 mgr.a (mgr.14388) 19362 : audit [DBG] from='client.415644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:03 smithi191 bash[24992]: audit 2024-08-31T09:39:02.968565+0000 mgr.a (mgr.14388) 19362 : audit [DBG] from='client.415644 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:04 smithi163 bash[24253]: cluster 2024-08-31T09:39:03.788785+0000 mgr.a (mgr.14388) 19363 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:39:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:04 smithi027 bash[22610]: cluster 2024-08-31T09:39:03.788785+0000 mgr.a (mgr.14388) 19363 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:39:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:04 smithi191 bash[24992]: cluster 2024-08-31T09:39:03.788785+0000 mgr.a (mgr.14388) 19363 : cluster [DBG] pgmap v13424: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:39:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:06 smithi163 bash[24253]: cluster 2024-08-31T09:39:05.789810+0000 mgr.a (mgr.14388) 19364 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:39:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:06 smithi027 bash[22610]: cluster 2024-08-31T09:39:05.789810+0000 mgr.a (mgr.14388) 19364 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:39:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:06 smithi191 bash[24992]: cluster 2024-08-31T09:39:05.789810+0000 mgr.a (mgr.14388) 19364 : cluster [DBG] pgmap v13425: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:39:08.403 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:39:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:39:08.404 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:39:09.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:39:09.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:39:09.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:39:09.161 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:39:09.162 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:39:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:08 smithi163 bash[24253]: cluster 2024-08-31T09:39:07.790594+0000 mgr.a (mgr.14388) 19365 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:39:09.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:08 smithi027 bash[22610]: cluster 2024-08-31T09:39:07.790594+0000 mgr.a (mgr.14388) 19365 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:39:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:08 smithi191 bash[24992]: cluster 2024-08-31T09:39:07.790594+0000 mgr.a (mgr.14388) 19365 : cluster [DBG] pgmap v13426: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:39:10.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:09 smithi163 bash[24253]: audit 2024-08-31T09:39:08.734546+0000 mgr.a (mgr.14388) 19366 : audit [DBG] from='client.415722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:09 smithi027 bash[22610]: audit 2024-08-31T09:39:08.734546+0000 mgr.a (mgr.14388) 19366 : audit [DBG] from='client.415722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:09 smithi191 bash[24992]: audit 2024-08-31T09:39:08.734546+0000 mgr.a (mgr.14388) 19366 : audit [DBG] from='client.415722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:11.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:10 smithi163 bash[24253]: cluster 2024-08-31T09:39:09.793443+0000 mgr.a (mgr.14388) 19367 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:10 smithi027 bash[22610]: cluster 2024-08-31T09:39:09.793443+0000 mgr.a (mgr.14388) 19367 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:10 smithi191 bash[24992]: cluster 2024-08-31T09:39:09.793443+0000 mgr.a (mgr.14388) 19367 : cluster [DBG] pgmap v13427: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:12 smithi163 bash[24253]: cluster 2024-08-31T09:39:11.794212+0000 mgr.a (mgr.14388) 19368 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:39:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:12 smithi027 bash[22610]: cluster 2024-08-31T09:39:11.794212+0000 mgr.a (mgr.14388) 19368 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:39:12.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:12 smithi191 bash[24992]: cluster 2024-08-31T09:39:11.794212+0000 mgr.a (mgr.14388) 19368 : cluster [DBG] pgmap v13428: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:39:14.163 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:39:14.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:39:14.164 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:39:14.923 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:39:14.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:39:14.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:39:14.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:39:14.924 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:39:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:14 smithi163 bash[24253]: cluster 2024-08-31T09:39:13.796171+0000 mgr.a (mgr.14388) 19369 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:15.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:14 smithi027 bash[22610]: cluster 2024-08-31T09:39:13.796171+0000 mgr.a (mgr.14388) 19369 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:14 smithi191 bash[24992]: cluster 2024-08-31T09:39:13.796171+0000 mgr.a (mgr.14388) 19369 : cluster [DBG] pgmap v13429: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:16.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:15 smithi163 bash[24253]: audit 2024-08-31T09:39:14.496337+0000 mgr.a (mgr.14388) 19370 : audit [DBG] from='client.415800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:15 smithi027 bash[22610]: audit 2024-08-31T09:39:14.496337+0000 mgr.a (mgr.14388) 19370 : audit [DBG] from='client.415800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:15 smithi191 bash[24992]: audit 2024-08-31T09:39:14.496337+0000 mgr.a (mgr.14388) 19370 : audit [DBG] from='client.415800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:17.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:16 smithi163 bash[24253]: cluster 2024-08-31T09:39:15.797116+0000 mgr.a (mgr.14388) 19371 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:39:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:16 smithi027 bash[22610]: cluster 2024-08-31T09:39:15.797116+0000 mgr.a (mgr.14388) 19371 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:39:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:16 smithi191 bash[24992]: cluster 2024-08-31T09:39:15.797116+0000 mgr.a (mgr.14388) 19371 : cluster [DBG] pgmap v13430: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:39:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:18 smithi163 bash[24253]: cluster 2024-08-31T09:39:17.797908+0000 mgr.a (mgr.14388) 19372 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:39:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:18 smithi027 bash[22610]: cluster 2024-08-31T09:39:17.797908+0000 mgr.a (mgr.14388) 19372 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:39:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:18 smithi191 bash[24992]: cluster 2024-08-31T09:39:17.797908+0000 mgr.a (mgr.14388) 19372 : cluster [DBG] pgmap v13431: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:39:19.925 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:39:19.925 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:39:19.925 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:39:20.691 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:39:20.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:39:20.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:39:20.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:39:20.692 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:39:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:20 smithi163 bash[24253]: cluster 2024-08-31T09:39:19.800118+0000 mgr.a (mgr.14388) 19373 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:39:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:20 smithi163 bash[24253]: audit 2024-08-31T09:39:20.075349+0000 mon.a (mon.0) 3462 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:39:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:20 smithi163 bash[24253]: audit 2024-08-31T09:39:20.864003+0000 mon.a (mon.0) 3463 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:39:21.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:20 smithi163 bash[24253]: audit 2024-08-31T09:39:20.865055+0000 mon.a (mon.0) 3464 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:39:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:20 smithi027 bash[22610]: cluster 2024-08-31T09:39:19.800118+0000 mgr.a (mgr.14388) 19373 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:39:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:20 smithi027 bash[22610]: audit 2024-08-31T09:39:20.075349+0000 mon.a (mon.0) 3462 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:39:21.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:20 smithi027 bash[22610]: audit 2024-08-31T09:39:20.864003+0000 mon.a (mon.0) 3463 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:39:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:20 smithi027 bash[22610]: audit 2024-08-31T09:39:20.865055+0000 mon.a (mon.0) 3464 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:39:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:20 smithi191 bash[24992]: cluster 2024-08-31T09:39:19.800118+0000 mgr.a (mgr.14388) 19373 : cluster [DBG] pgmap v13432: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:39:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:20 smithi191 bash[24992]: audit 2024-08-31T09:39:20.075349+0000 mon.a (mon.0) 3462 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:39:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:20 smithi191 bash[24992]: audit 2024-08-31T09:39:20.864003+0000 mon.a (mon.0) 3463 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:39:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:20 smithi191 bash[24992]: audit 2024-08-31T09:39:20.865055+0000 mon.a (mon.0) 3464 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:39:21.877 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:39:21 smithi027 bash[22863]: debug 2024-08-31T09:39:21.598+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:39:21.877 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:39:21 smithi027 bash[22863]: debug 2024-08-31T09:39:21.602+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:39:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:21 smithi163 bash[24253]: audit 2024-08-31T09:39:20.263443+0000 mgr.a (mgr.14388) 19374 : audit [DBG] from='client.415875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:21 smithi163 bash[24253]: audit 2024-08-31T09:39:20.873148+0000 mon.a (mon.0) 3465 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:39:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:21 smithi163 bash[24253]: audit 2024-08-31T09:39:20.878161+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:39:22.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:21 smithi163 bash[24253]: audit 2024-08-31T09:39:20.879157+0000 mgr.a (mgr.14388) 19375 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:39:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:21 smithi027 bash[22610]: audit 2024-08-31T09:39:20.263443+0000 mgr.a (mgr.14388) 19374 : audit [DBG] from='client.415875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:21 smithi027 bash[22610]: audit 2024-08-31T09:39:20.873148+0000 mon.a (mon.0) 3465 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:39:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:21 smithi027 bash[22610]: audit 2024-08-31T09:39:20.878161+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:39:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:21 smithi027 bash[22610]: audit 2024-08-31T09:39:20.879157+0000 mgr.a (mgr.14388) 19375 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:39:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:21 smithi191 bash[24992]: audit 2024-08-31T09:39:20.263443+0000 mgr.a (mgr.14388) 19374 : audit [DBG] from='client.415875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:21 smithi191 bash[24992]: audit 2024-08-31T09:39:20.873148+0000 mon.a (mon.0) 3465 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:39:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:21 smithi191 bash[24992]: audit 2024-08-31T09:39:20.878161+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:39:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:21 smithi191 bash[24992]: audit 2024-08-31T09:39:20.879157+0000 mgr.a (mgr.14388) 19375 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:39:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:22 smithi163 bash[24253]: audit 2024-08-31T09:39:21.602663+0000 mgr.a (mgr.14388) 19376 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:39:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:22 smithi163 bash[24253]: cephadm 2024-08-31T09:39:21.603926+0000 mgr.a (mgr.14388) 19377 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:39:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:22 smithi163 bash[24253]: cluster 2024-08-31T09:39:21.801078+0000 mgr.a (mgr.14388) 19378 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:22 smithi027 bash[22610]: audit 2024-08-31T09:39:21.602663+0000 mgr.a (mgr.14388) 19376 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:39:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:22 smithi027 bash[22610]: cephadm 2024-08-31T09:39:21.603926+0000 mgr.a (mgr.14388) 19377 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:39:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:22 smithi027 bash[22610]: cluster 2024-08-31T09:39:21.801078+0000 mgr.a (mgr.14388) 19378 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:22 smithi191 bash[24992]: audit 2024-08-31T09:39:21.602663+0000 mgr.a (mgr.14388) 19376 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:39:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:22 smithi191 bash[24992]: cephadm 2024-08-31T09:39:21.603926+0000 mgr.a (mgr.14388) 19377 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:39:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:22 smithi191 bash[24992]: cluster 2024-08-31T09:39:21.801078+0000 mgr.a (mgr.14388) 19378 : cluster [DBG] pgmap v13433: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:24 smithi163 bash[24253]: cluster 2024-08-31T09:39:23.803269+0000 mgr.a (mgr.14388) 19379 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:24 smithi027 bash[22610]: cluster 2024-08-31T09:39:23.803269+0000 mgr.a (mgr.14388) 19379 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:24 smithi191 bash[24992]: cluster 2024-08-31T09:39:23.803269+0000 mgr.a (mgr.14388) 19379 : cluster [DBG] pgmap v13434: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:25.693 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:39:25.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:39:25.694 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:39:26.469 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:39:26.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:39:26.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:39:26.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:39:26.470 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:39:27.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:26 smithi163 bash[24253]: cluster 2024-08-31T09:39:25.803757+0000 mgr.a (mgr.14388) 19380 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:26 smithi027 bash[22610]: cluster 2024-08-31T09:39:25.803757+0000 mgr.a (mgr.14388) 19380 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:27.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:26 smithi191 bash[24992]: cluster 2024-08-31T09:39:25.803757+0000 mgr.a (mgr.14388) 19380 : cluster [DBG] pgmap v13435: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:28.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:27 smithi163 bash[24253]: audit 2024-08-31T09:39:26.033434+0000 mgr.a (mgr.14388) 19381 : audit [DBG] from='client.416058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:27 smithi027 bash[22610]: audit 2024-08-31T09:39:26.033434+0000 mgr.a (mgr.14388) 19381 : audit [DBG] from='client.416058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:27 smithi191 bash[24992]: audit 2024-08-31T09:39:26.033434+0000 mgr.a (mgr.14388) 19381 : audit [DBG] from='client.416058 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:28 smithi163 bash[24253]: cluster 2024-08-31T09:39:27.804719+0000 mgr.a (mgr.14388) 19382 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:29.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:28 smithi027 bash[22610]: cluster 2024-08-31T09:39:27.804719+0000 mgr.a (mgr.14388) 19382 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:29.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:28 smithi191 bash[24992]: cluster 2024-08-31T09:39:27.804719+0000 mgr.a (mgr.14388) 19382 : cluster [DBG] pgmap v13436: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:30 smithi163 bash[24253]: cluster 2024-08-31T09:39:29.807158+0000 mgr.a (mgr.14388) 19383 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:30 smithi027 bash[22610]: cluster 2024-08-31T09:39:29.807158+0000 mgr.a (mgr.14388) 19383 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:30 smithi191 bash[24992]: cluster 2024-08-31T09:39:29.807158+0000 mgr.a (mgr.14388) 19383 : cluster [DBG] pgmap v13437: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:39:31.471 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:39:31.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:39:31.472 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:39:32.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:39:32.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:39:32.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:39:32.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:39:32.215 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:39:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:32 smithi163 bash[24253]: audit 2024-08-31T09:39:31.805549+0000 mgr.a (mgr.14388) 19384 : audit [DBG] from='client.416136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:32 smithi163 bash[24253]: cluster 2024-08-31T09:39:31.821556+0000 mgr.a (mgr.14388) 19385 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:39:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:32 smithi027 bash[22610]: audit 2024-08-31T09:39:31.805549+0000 mgr.a (mgr.14388) 19384 : audit [DBG] from='client.416136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:32 smithi027 bash[22610]: cluster 2024-08-31T09:39:31.821556+0000 mgr.a (mgr.14388) 19385 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:39:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:32 smithi191 bash[24992]: audit 2024-08-31T09:39:31.805549+0000 mgr.a (mgr.14388) 19384 : audit [DBG] from='client.416136 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:32 smithi191 bash[24992]: cluster 2024-08-31T09:39:31.821556+0000 mgr.a (mgr.14388) 19385 : cluster [DBG] pgmap v13438: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:39:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:34 smithi163 bash[24253]: cluster 2024-08-31T09:39:33.823929+0000 mgr.a (mgr.14388) 19386 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:39:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:34 smithi027 bash[22610]: cluster 2024-08-31T09:39:33.823929+0000 mgr.a (mgr.14388) 19386 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:39:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:34 smithi191 bash[24992]: cluster 2024-08-31T09:39:33.823929+0000 mgr.a (mgr.14388) 19386 : cluster [DBG] pgmap v13439: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 425 B/s wr, 7 op/s 2024-08-31T09:39:37.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:36 smithi163 bash[24253]: cluster 2024-08-31T09:39:35.824894+0000 mgr.a (mgr.14388) 19387 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:37.216 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:39:37.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:39:37.217 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:39:37.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:36 smithi027 bash[22610]: cluster 2024-08-31T09:39:35.824894+0000 mgr.a (mgr.14388) 19387 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:36 smithi191 bash[24992]: cluster 2024-08-31T09:39:35.824894+0000 mgr.a (mgr.14388) 19387 : cluster [DBG] pgmap v13440: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:38.002 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:39:38.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:39:38.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:39:38.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:39:38.003 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:39:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:38 smithi163 bash[24253]: audit 2024-08-31T09:39:37.551992+0000 mgr.a (mgr.14388) 19388 : audit [DBG] from='client.416211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:39.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:38 smithi163 bash[24253]: cluster 2024-08-31T09:39:37.825467+0000 mgr.a (mgr.14388) 19389 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:38 smithi027 bash[22610]: audit 2024-08-31T09:39:37.551992+0000 mgr.a (mgr.14388) 19388 : audit [DBG] from='client.416211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:38 smithi027 bash[22610]: cluster 2024-08-31T09:39:37.825467+0000 mgr.a (mgr.14388) 19389 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:38 smithi191 bash[24992]: audit 2024-08-31T09:39:37.551992+0000 mgr.a (mgr.14388) 19388 : audit [DBG] from='client.416211 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:38 smithi191 bash[24992]: cluster 2024-08-31T09:39:37.825467+0000 mgr.a (mgr.14388) 19389 : cluster [DBG] pgmap v13441: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:40 smithi163 bash[24253]: cluster 2024-08-31T09:39:39.827902+0000 mgr.a (mgr.14388) 19390 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:39:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:40 smithi027 bash[22610]: cluster 2024-08-31T09:39:39.827902+0000 mgr.a (mgr.14388) 19390 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:39:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:40 smithi191 bash[24992]: cluster 2024-08-31T09:39:39.827902+0000 mgr.a (mgr.14388) 19390 : cluster [DBG] pgmap v13442: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:39:43.004 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:39:43.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:39:43.005 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:39:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:42 smithi163 bash[24253]: cluster 2024-08-31T09:39:41.828878+0000 mgr.a (mgr.14388) 19391 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:42 smithi027 bash[22610]: cluster 2024-08-31T09:39:41.828878+0000 mgr.a (mgr.14388) 19391 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:42 smithi191 bash[24992]: cluster 2024-08-31T09:39:41.828878+0000 mgr.a (mgr.14388) 19391 : cluster [DBG] pgmap v13443: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:43.777 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:39:43.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:39:43.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:39:43.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:39:43.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:39:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:44 smithi163 bash[24253]: audit 2024-08-31T09:39:43.344266+0000 mgr.a (mgr.14388) 19392 : audit [DBG] from='client.416286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:45.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:44 smithi163 bash[24253]: cluster 2024-08-31T09:39:43.830115+0000 mgr.a (mgr.14388) 19393 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:45.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:44 smithi027 bash[22610]: audit 2024-08-31T09:39:43.344266+0000 mgr.a (mgr.14388) 19392 : audit [DBG] from='client.416286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:45.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:44 smithi027 bash[22610]: cluster 2024-08-31T09:39:43.830115+0000 mgr.a (mgr.14388) 19393 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:44 smithi191 bash[24992]: audit 2024-08-31T09:39:43.344266+0000 mgr.a (mgr.14388) 19392 : audit [DBG] from='client.416286 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:44 smithi191 bash[24992]: cluster 2024-08-31T09:39:43.830115+0000 mgr.a (mgr.14388) 19393 : cluster [DBG] pgmap v13444: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:46 smithi163 bash[24253]: cluster 2024-08-31T09:39:45.830859+0000 mgr.a (mgr.14388) 19394 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:39:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:46 smithi027 bash[22610]: cluster 2024-08-31T09:39:45.830859+0000 mgr.a (mgr.14388) 19394 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:39:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:46 smithi191 bash[24992]: cluster 2024-08-31T09:39:45.830859+0000 mgr.a (mgr.14388) 19394 : cluster [DBG] pgmap v13445: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:39:48.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:39:48.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:39:48.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:39:49.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:48 smithi163 bash[24253]: cluster 2024-08-31T09:39:47.831604+0000 mgr.a (mgr.14388) 19395 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:39:49.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:48 smithi027 bash[22610]: cluster 2024-08-31T09:39:47.831604+0000 mgr.a (mgr.14388) 19395 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:39:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:48 smithi191 bash[24992]: cluster 2024-08-31T09:39:47.831604+0000 mgr.a (mgr.14388) 19395 : cluster [DBG] pgmap v13446: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:39:49.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:39:49.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:39:49.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:39:49.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:39:49.522 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:39:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:50 smithi027 bash[22610]: audit 2024-08-31T09:39:49.113968+0000 mgr.a (mgr.14388) 19396 : audit [DBG] from='client.416358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:50 smithi027 bash[22610]: cluster 2024-08-31T09:39:49.834388+0000 mgr.a (mgr.14388) 19397 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:50 smithi191 bash[24992]: audit 2024-08-31T09:39:49.113968+0000 mgr.a (mgr.14388) 19396 : audit [DBG] from='client.416358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:50 smithi191 bash[24992]: cluster 2024-08-31T09:39:49.834388+0000 mgr.a (mgr.14388) 19397 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:50 smithi163 bash[24253]: audit 2024-08-31T09:39:49.113968+0000 mgr.a (mgr.14388) 19396 : audit [DBG] from='client.416358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:50 smithi163 bash[24253]: cluster 2024-08-31T09:39:49.834388+0000 mgr.a (mgr.14388) 19397 : cluster [DBG] pgmap v13447: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:52 smithi027 bash[22610]: cluster 2024-08-31T09:39:51.835186+0000 mgr.a (mgr.14388) 19398 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:39:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:52 smithi191 bash[24992]: cluster 2024-08-31T09:39:51.835186+0000 mgr.a (mgr.14388) 19398 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:39:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:52 smithi163 bash[24253]: cluster 2024-08-31T09:39:51.835186+0000 mgr.a (mgr.14388) 19398 : cluster [DBG] pgmap v13448: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:39:54.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:39:54.524 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:39:54.524 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:39:55.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:54 smithi027 bash[22610]: cluster 2024-08-31T09:39:53.837124+0000 mgr.a (mgr.14388) 19399 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:54 smithi191 bash[24992]: cluster 2024-08-31T09:39:53.837124+0000 mgr.a (mgr.14388) 19399 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:55.296 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:39:55.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:39:55.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:39:55.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:39:55.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:39:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:54 smithi163 bash[24253]: cluster 2024-08-31T09:39:53.837124+0000 mgr.a (mgr.14388) 19399 : cluster [DBG] pgmap v13449: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:55 smithi027 bash[22610]: audit 2024-08-31T09:39:54.863578+0000 mgr.a (mgr.14388) 19400 : audit [DBG] from='client.416430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:55 smithi191 bash[24992]: audit 2024-08-31T09:39:54.863578+0000 mgr.a (mgr.14388) 19400 : audit [DBG] from='client.416430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:56.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:55 smithi163 bash[24253]: audit 2024-08-31T09:39:54.863578+0000 mgr.a (mgr.14388) 19400 : audit [DBG] from='client.416430 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:39:57.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:56 smithi027 bash[22610]: cluster 2024-08-31T09:39:55.838112+0000 mgr.a (mgr.14388) 19401 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:56 smithi191 bash[24992]: cluster 2024-08-31T09:39:55.838112+0000 mgr.a (mgr.14388) 19401 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:56 smithi163 bash[24253]: cluster 2024-08-31T09:39:55.838112+0000 mgr.a (mgr.14388) 19401 : cluster [DBG] pgmap v13450: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:39:58 smithi027 bash[22610]: cluster 2024-08-31T09:39:57.838928+0000 mgr.a (mgr.14388) 19402 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:39:58 smithi191 bash[24992]: cluster 2024-08-31T09:39:57.838928+0000 mgr.a (mgr.14388) 19402 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:39:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:39:58 smithi163 bash[24253]: cluster 2024-08-31T09:39:57.838928+0000 mgr.a (mgr.14388) 19402 : cluster [DBG] pgmap v13451: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:00.298 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:00.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:00.299 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:01.075 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:01.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:01.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:01.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:01.075 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:00 smithi027 bash[22610]: cluster 2024-08-31T09:39:59.841042+0000 mgr.a (mgr.14388) 19403 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:01.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:00 smithi027 bash[22610]: cluster 2024-08-31T09:40:00.000149+0000 mon.a (mon.0) 3467 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:40:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:00 smithi191 bash[24992]: cluster 2024-08-31T09:39:59.841042+0000 mgr.a (mgr.14388) 19403 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:00 smithi191 bash[24992]: cluster 2024-08-31T09:40:00.000149+0000 mon.a (mon.0) 3467 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:40:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:00 smithi163 bash[24253]: cluster 2024-08-31T09:39:59.841042+0000 mgr.a (mgr.14388) 19403 : cluster [DBG] pgmap v13452: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:00 smithi163 bash[24253]: cluster 2024-08-31T09:40:00.000149+0000 mon.a (mon.0) 3467 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:40:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:01 smithi027 bash[22610]: audit 2024-08-31T09:40:00.636909+0000 mgr.a (mgr.14388) 19404 : audit [DBG] from='client.416508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:01 smithi191 bash[24992]: audit 2024-08-31T09:40:00.636909+0000 mgr.a (mgr.14388) 19404 : audit [DBG] from='client.416508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:01 smithi163 bash[24253]: audit 2024-08-31T09:40:00.636909+0000 mgr.a (mgr.14388) 19404 : audit [DBG] from='client.416508 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:02 smithi191 bash[24992]: cluster 2024-08-31T09:40:01.841927+0000 mgr.a (mgr.14388) 19405 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:02 smithi163 bash[24253]: cluster 2024-08-31T09:40:01.841927+0000 mgr.a (mgr.14388) 19405 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:02 smithi027 bash[22610]: cluster 2024-08-31T09:40:01.841927+0000 mgr.a (mgr.14388) 19405 : cluster [DBG] pgmap v13453: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:04 smithi191 bash[24992]: cluster 2024-08-31T09:40:03.844177+0000 mgr.a (mgr.14388) 19406 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:04 smithi163 bash[24253]: cluster 2024-08-31T09:40:03.844177+0000 mgr.a (mgr.14388) 19406 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:04 smithi027 bash[22610]: cluster 2024-08-31T09:40:03.844177+0000 mgr.a (mgr.14388) 19406 : cluster [DBG] pgmap v13454: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:06.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:06.077 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:06.078 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:06.822 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:06.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:06 smithi191 bash[24992]: cluster 2024-08-31T09:40:05.844976+0000 mgr.a (mgr.14388) 19407 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:06 smithi163 bash[24253]: cluster 2024-08-31T09:40:05.844976+0000 mgr.a (mgr.14388) 19407 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:06 smithi027 bash[22610]: cluster 2024-08-31T09:40:05.844976+0000 mgr.a (mgr.14388) 19407 : cluster [DBG] pgmap v13455: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:08 smithi191 bash[24992]: audit 2024-08-31T09:40:06.406357+0000 mgr.a (mgr.14388) 19408 : audit [DBG] from='client.416586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:08 smithi163 bash[24253]: audit 2024-08-31T09:40:06.406357+0000 mgr.a (mgr.14388) 19408 : audit [DBG] from='client.416586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:08 smithi027 bash[22610]: audit 2024-08-31T09:40:06.406357+0000 mgr.a (mgr.14388) 19408 : audit [DBG] from='client.416586 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:09 smithi191 bash[24992]: cluster 2024-08-31T09:40:07.845812+0000 mgr.a (mgr.14388) 19409 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:09 smithi163 bash[24253]: cluster 2024-08-31T09:40:07.845812+0000 mgr.a (mgr.14388) 19409 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:09 smithi027 bash[22610]: cluster 2024-08-31T09:40:07.845812+0000 mgr.a (mgr.14388) 19409 : cluster [DBG] pgmap v13456: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:11 smithi191 bash[24992]: cluster 2024-08-31T09:40:09.848066+0000 mgr.a (mgr.14388) 19410 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:11 smithi163 bash[24253]: cluster 2024-08-31T09:40:09.848066+0000 mgr.a (mgr.14388) 19410 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:11 smithi027 bash[22610]: cluster 2024-08-31T09:40:09.848066+0000 mgr.a (mgr.14388) 19410 : cluster [DBG] pgmap v13457: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:11.823 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:11.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:11.824 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:12.569 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:12.569 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:12.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:12.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:12.570 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:13 smithi191 bash[24992]: cluster 2024-08-31T09:40:11.848847+0000 mgr.a (mgr.14388) 19411 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:13 smithi163 bash[24253]: cluster 2024-08-31T09:40:11.848847+0000 mgr.a (mgr.14388) 19411 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:13.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:13 smithi027 bash[22610]: cluster 2024-08-31T09:40:11.848847+0000 mgr.a (mgr.14388) 19411 : cluster [DBG] pgmap v13458: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:14 smithi191 bash[24992]: audit 2024-08-31T09:40:12.159795+0000 mgr.a (mgr.14388) 19412 : audit [DBG] from='client.416664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:14 smithi163 bash[24253]: audit 2024-08-31T09:40:12.159795+0000 mgr.a (mgr.14388) 19412 : audit [DBG] from='client.416664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:14 smithi027 bash[22610]: audit 2024-08-31T09:40:12.159795+0000 mgr.a (mgr.14388) 19412 : audit [DBG] from='client.416664 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:15 smithi191 bash[24992]: cluster 2024-08-31T09:40:13.851123+0000 mgr.a (mgr.14388) 19413 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:15 smithi163 bash[24253]: cluster 2024-08-31T09:40:13.851123+0000 mgr.a (mgr.14388) 19413 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:15 smithi027 bash[22610]: cluster 2024-08-31T09:40:13.851123+0000 mgr.a (mgr.14388) 19413 : cluster [DBG] pgmap v13459: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:16 smithi191 bash[24992]: cluster 2024-08-31T09:40:15.851869+0000 mgr.a (mgr.14388) 19414 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:16.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:16 smithi163 bash[24253]: cluster 2024-08-31T09:40:15.851869+0000 mgr.a (mgr.14388) 19414 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:16 smithi027 bash[22610]: cluster 2024-08-31T09:40:15.851869+0000 mgr.a (mgr.14388) 19414 : cluster [DBG] pgmap v13460: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:17.571 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:17.572 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:17.572 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:18.332 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:18.332 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:18.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:18.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:18.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:18 smithi163 bash[24253]: cluster 2024-08-31T09:40:17.852586+0000 mgr.a (mgr.14388) 19415 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:19.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:18 smithi163 bash[24253]: audit 2024-08-31T09:40:17.907316+0000 mgr.a (mgr.14388) 19416 : audit [DBG] from='client.416739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:18 smithi027 bash[22610]: cluster 2024-08-31T09:40:17.852586+0000 mgr.a (mgr.14388) 19415 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:18 smithi027 bash[22610]: audit 2024-08-31T09:40:17.907316+0000 mgr.a (mgr.14388) 19416 : audit [DBG] from='client.416739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:18 smithi191 bash[24992]: cluster 2024-08-31T09:40:17.852586+0000 mgr.a (mgr.14388) 19415 : cluster [DBG] pgmap v13461: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:18 smithi191 bash[24992]: audit 2024-08-31T09:40:17.907316+0000 mgr.a (mgr.14388) 19416 : audit [DBG] from='client.416739 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:21.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:20 smithi163 bash[24253]: cluster 2024-08-31T09:40:19.855433+0000 mgr.a (mgr.14388) 19417 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:40:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:20 smithi027 bash[22610]: cluster 2024-08-31T09:40:19.855433+0000 mgr.a (mgr.14388) 19417 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:40:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:20 smithi191 bash[24992]: cluster 2024-08-31T09:40:19.855433+0000 mgr.a (mgr.14388) 19417 : cluster [DBG] pgmap v13462: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:40:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:21 smithi163 bash[24253]: audit 2024-08-31T09:40:21.652636+0000 mon.a (mon.0) 3468 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:40:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:21 smithi027 bash[22610]: audit 2024-08-31T09:40:21.652636+0000 mon.a (mon.0) 3468 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:40:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:21 smithi191 bash[24992]: audit 2024-08-31T09:40:21.652636+0000 mon.a (mon.0) 3468 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:40:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:22 smithi163 bash[24253]: cluster 2024-08-31T09:40:21.856230+0000 mgr.a (mgr.14388) 19418 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:40:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:22 smithi163 bash[24253]: audit 2024-08-31T09:40:22.490874+0000 mon.a (mon.0) 3469 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:40:23.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:22 smithi163 bash[24253]: audit 2024-08-31T09:40:22.492335+0000 mon.a (mon.0) 3470 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:40:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:22 smithi163 bash[24253]: audit 2024-08-31T09:40:22.501680+0000 mon.a (mon.0) 3471 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:40:23.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:22 smithi163 bash[24253]: audit 2024-08-31T09:40:22.504225+0000 mon.a (mon.0) 3472 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:40:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:22 smithi027 bash[22610]: cluster 2024-08-31T09:40:21.856230+0000 mgr.a (mgr.14388) 19418 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:40:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:22 smithi027 bash[22610]: audit 2024-08-31T09:40:22.490874+0000 mon.a (mon.0) 3469 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:40:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:22 smithi027 bash[22610]: audit 2024-08-31T09:40:22.492335+0000 mon.a (mon.0) 3470 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:40:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:22 smithi027 bash[22610]: audit 2024-08-31T09:40:22.501680+0000 mon.a (mon.0) 3471 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:40:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:22 smithi027 bash[22610]: audit 2024-08-31T09:40:22.504225+0000 mon.a (mon.0) 3472 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:40:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:22 smithi191 bash[24992]: cluster 2024-08-31T09:40:21.856230+0000 mgr.a (mgr.14388) 19418 : cluster [DBG] pgmap v13463: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:40:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:22 smithi191 bash[24992]: audit 2024-08-31T09:40:22.490874+0000 mon.a (mon.0) 3469 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:40:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:22 smithi191 bash[24992]: audit 2024-08-31T09:40:22.492335+0000 mon.a (mon.0) 3470 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:40:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:22 smithi191 bash[24992]: audit 2024-08-31T09:40:22.501680+0000 mon.a (mon.0) 3471 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:40:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:22 smithi191 bash[24992]: audit 2024-08-31T09:40:22.504225+0000 mon.a (mon.0) 3472 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:40:23.333 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:23.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:23.334 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:23.732 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:40:23 smithi027 bash[22863]: debug 2024-08-31T09:40:23.248+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:40:23.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:40:23 smithi027 bash[22863]: debug 2024-08-31T09:40:23.248+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:40:24.077 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:24.077 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:24.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:24.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:24.078 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:24.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:23 smithi163 bash[24253]: audit 2024-08-31T09:40:22.506592+0000 mgr.a (mgr.14388) 19419 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:40:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:23 smithi027 bash[22610]: audit 2024-08-31T09:40:22.506592+0000 mgr.a (mgr.14388) 19419 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:40:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:23 smithi191 bash[24992]: audit 2024-08-31T09:40:22.506592+0000 mgr.a (mgr.14388) 19419 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:40:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:24 smithi163 bash[24253]: audit 2024-08-31T09:40:23.251306+0000 mgr.a (mgr.14388) 19420 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:40:25.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:24 smithi163 bash[24253]: cephadm 2024-08-31T09:40:23.252578+0000 mgr.a (mgr.14388) 19421 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:40:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:24 smithi163 bash[24253]: audit 2024-08-31T09:40:23.658745+0000 mgr.a (mgr.14388) 19422 : audit [DBG] from='client.416925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:25.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:24 smithi163 bash[24253]: cluster 2024-08-31T09:40:23.857670+0000 mgr.a (mgr.14388) 19423 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T09:40:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:24 smithi027 bash[22610]: audit 2024-08-31T09:40:23.251306+0000 mgr.a (mgr.14388) 19420 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:40:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:24 smithi027 bash[22610]: cephadm 2024-08-31T09:40:23.252578+0000 mgr.a (mgr.14388) 19421 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:40:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:24 smithi027 bash[22610]: audit 2024-08-31T09:40:23.658745+0000 mgr.a (mgr.14388) 19422 : audit [DBG] from='client.416925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:24 smithi027 bash[22610]: cluster 2024-08-31T09:40:23.857670+0000 mgr.a (mgr.14388) 19423 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T09:40:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:24 smithi191 bash[24992]: audit 2024-08-31T09:40:23.251306+0000 mgr.a (mgr.14388) 19420 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:40:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:24 smithi191 bash[24992]: cephadm 2024-08-31T09:40:23.252578+0000 mgr.a (mgr.14388) 19421 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:40:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:24 smithi191 bash[24992]: audit 2024-08-31T09:40:23.658745+0000 mgr.a (mgr.14388) 19422 : audit [DBG] from='client.416925 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:24 smithi191 bash[24992]: cluster 2024-08-31T09:40:23.857670+0000 mgr.a (mgr.14388) 19423 : cluster [DBG] pgmap v13464: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 5.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T09:40:27.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:26 smithi163 bash[24253]: cluster 2024-08-31T09:40:25.858553+0000 mgr.a (mgr.14388) 19424 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T09:40:27.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:26 smithi027 bash[22610]: cluster 2024-08-31T09:40:25.858553+0000 mgr.a (mgr.14388) 19424 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T09:40:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:26 smithi191 bash[24992]: cluster 2024-08-31T09:40:25.858553+0000 mgr.a (mgr.14388) 19424 : cluster [DBG] pgmap v13465: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T09:40:29.079 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:29.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:29.080 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:29.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:28 smithi163 bash[24253]: cluster 2024-08-31T09:40:27.859340+0000 mgr.a (mgr.14388) 19425 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T09:40:29.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:28 smithi027 bash[22610]: cluster 2024-08-31T09:40:27.859340+0000 mgr.a (mgr.14388) 19425 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T09:40:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:28 smithi191 bash[24992]: cluster 2024-08-31T09:40:27.859340+0000 mgr.a (mgr.14388) 19425 : cluster [DBG] pgmap v13466: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-08-31T09:40:29.857 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:29.857 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:29.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:29.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:29.858 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:30 smithi163 bash[24253]: audit 2024-08-31T09:40:29.417822+0000 mgr.a (mgr.14388) 19426 : audit [DBG] from='client.417003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:31.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:30 smithi163 bash[24253]: cluster 2024-08-31T09:40:29.860758+0000 mgr.a (mgr.14388) 19427 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:40:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:30 smithi027 bash[22610]: audit 2024-08-31T09:40:29.417822+0000 mgr.a (mgr.14388) 19426 : audit [DBG] from='client.417003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:31.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:30 smithi027 bash[22610]: cluster 2024-08-31T09:40:29.860758+0000 mgr.a (mgr.14388) 19427 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:40:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:30 smithi191 bash[24992]: audit 2024-08-31T09:40:29.417822+0000 mgr.a (mgr.14388) 19426 : audit [DBG] from='client.417003 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:30 smithi191 bash[24992]: cluster 2024-08-31T09:40:29.860758+0000 mgr.a (mgr.14388) 19427 : cluster [DBG] pgmap v13467: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:40:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:32 smithi027 bash[22610]: cluster 2024-08-31T09:40:31.861501+0000 mgr.a (mgr.14388) 19428 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:40:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:32 smithi191 bash[24992]: cluster 2024-08-31T09:40:31.861501+0000 mgr.a (mgr.14388) 19428 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:40:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:32 smithi163 bash[24253]: cluster 2024-08-31T09:40:31.861501+0000 mgr.a (mgr.14388) 19428 : cluster [DBG] pgmap v13468: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:40:34.859 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:34.860 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:34.860 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:34 smithi027 bash[22610]: cluster 2024-08-31T09:40:33.863610+0000 mgr.a (mgr.14388) 19429 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:40:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:34 smithi191 bash[24992]: cluster 2024-08-31T09:40:33.863610+0000 mgr.a (mgr.14388) 19429 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:40:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:34 smithi163 bash[24253]: cluster 2024-08-31T09:40:33.863610+0000 mgr.a (mgr.14388) 19429 : cluster [DBG] pgmap v13469: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:40:35.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:35.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:35.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:35.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:35.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:36 smithi027 bash[22610]: audit 2024-08-31T09:40:35.190527+0000 mgr.a (mgr.14388) 19430 : audit [DBG] from='client.417081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:36 smithi027 bash[22610]: cluster 2024-08-31T09:40:35.864509+0000 mgr.a (mgr.14388) 19431 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T09:40:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:36 smithi191 bash[24992]: audit 2024-08-31T09:40:35.190527+0000 mgr.a (mgr.14388) 19430 : audit [DBG] from='client.417081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:36 smithi191 bash[24992]: cluster 2024-08-31T09:40:35.864509+0000 mgr.a (mgr.14388) 19431 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T09:40:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:36 smithi163 bash[24253]: audit 2024-08-31T09:40:35.190527+0000 mgr.a (mgr.14388) 19430 : audit [DBG] from='client.417081 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:36 smithi163 bash[24253]: cluster 2024-08-31T09:40:35.864509+0000 mgr.a (mgr.14388) 19431 : cluster [DBG] pgmap v13470: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T09:40:39.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:38 smithi027 bash[22610]: cluster 2024-08-31T09:40:37.865269+0000 mgr.a (mgr.14388) 19432 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T09:40:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:38 smithi191 bash[24992]: cluster 2024-08-31T09:40:37.865269+0000 mgr.a (mgr.14388) 19432 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T09:40:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:38 smithi163 bash[24253]: cluster 2024-08-31T09:40:37.865269+0000 mgr.a (mgr.14388) 19432 : cluster [DBG] pgmap v13471: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 3.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-08-31T09:40:40.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:40.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:40.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:41.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:40 smithi027 bash[22610]: cluster 2024-08-31T09:40:39.867592+0000 mgr.a (mgr.14388) 19433 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T09:40:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:40 smithi191 bash[24992]: cluster 2024-08-31T09:40:39.867592+0000 mgr.a (mgr.14388) 19433 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T09:40:41.343 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:41.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:41.343 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:41.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:41.344 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:40 smithi163 bash[24253]: cluster 2024-08-31T09:40:39.867592+0000 mgr.a (mgr.14388) 19433 : cluster [DBG] pgmap v13472: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-08-31T09:40:42.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:41 smithi027 bash[22610]: audit 2024-08-31T09:40:40.932330+0000 mgr.a (mgr.14388) 19434 : audit [DBG] from='client.417159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:41 smithi191 bash[24992]: audit 2024-08-31T09:40:40.932330+0000 mgr.a (mgr.14388) 19434 : audit [DBG] from='client.417159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:42.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:41 smithi163 bash[24253]: audit 2024-08-31T09:40:40.932330+0000 mgr.a (mgr.14388) 19434 : audit [DBG] from='client.417159 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:42 smithi027 bash[22610]: cluster 2024-08-31T09:40:41.868492+0000 mgr.a (mgr.14388) 19435 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:42 smithi191 bash[24992]: cluster 2024-08-31T09:40:41.868492+0000 mgr.a (mgr.14388) 19435 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:42 smithi163 bash[24253]: cluster 2024-08-31T09:40:41.868492+0000 mgr.a (mgr.14388) 19435 : cluster [DBG] pgmap v13473: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:44 smithi191 bash[24992]: cluster 2024-08-31T09:40:43.870675+0000 mgr.a (mgr.14388) 19436 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:44 smithi163 bash[24253]: cluster 2024-08-31T09:40:43.870675+0000 mgr.a (mgr.14388) 19436 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:44 smithi027 bash[22610]: cluster 2024-08-31T09:40:43.870675+0000 mgr.a (mgr.14388) 19436 : cluster [DBG] pgmap v13474: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:46.345 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:46.346 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:46.346 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:47.095 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:47.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:47.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:47.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:47.095 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:46 smithi191 bash[24992]: cluster 2024-08-31T09:40:45.871431+0000 mgr.a (mgr.14388) 19437 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:46 smithi163 bash[24253]: cluster 2024-08-31T09:40:45.871431+0000 mgr.a (mgr.14388) 19437 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:46 smithi027 bash[22610]: cluster 2024-08-31T09:40:45.871431+0000 mgr.a (mgr.14388) 19437 : cluster [DBG] pgmap v13475: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:47 smithi191 bash[24992]: audit 2024-08-31T09:40:46.676668+0000 mgr.a (mgr.14388) 19438 : audit [DBG] from='client.417237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:48.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:47 smithi163 bash[24253]: audit 2024-08-31T09:40:46.676668+0000 mgr.a (mgr.14388) 19438 : audit [DBG] from='client.417237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:48.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:47 smithi027 bash[22610]: audit 2024-08-31T09:40:46.676668+0000 mgr.a (mgr.14388) 19438 : audit [DBG] from='client.417237 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:49 smithi191 bash[24992]: cluster 2024-08-31T09:40:47.872329+0000 mgr.a (mgr.14388) 19439 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:49 smithi163 bash[24253]: cluster 2024-08-31T09:40:47.872329+0000 mgr.a (mgr.14388) 19439 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:49 smithi027 bash[22610]: cluster 2024-08-31T09:40:47.872329+0000 mgr.a (mgr.14388) 19439 : cluster [DBG] pgmap v13476: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:51 smithi191 bash[24992]: cluster 2024-08-31T09:40:49.874679+0000 mgr.a (mgr.14388) 19440 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:51 smithi163 bash[24253]: cluster 2024-08-31T09:40:49.874679+0000 mgr.a (mgr.14388) 19440 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:51 smithi027 bash[22610]: cluster 2024-08-31T09:40:49.874679+0000 mgr.a (mgr.14388) 19440 : cluster [DBG] pgmap v13477: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:52.096 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:52.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:52.097 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:52.866 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:52.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:52.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:52.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:52.866 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:53 smithi191 bash[24992]: cluster 2024-08-31T09:40:51.875651+0000 mgr.a (mgr.14388) 19441 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:53 smithi163 bash[24253]: cluster 2024-08-31T09:40:51.875651+0000 mgr.a (mgr.14388) 19441 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:53 smithi027 bash[22610]: cluster 2024-08-31T09:40:51.875651+0000 mgr.a (mgr.14388) 19441 : cluster [DBG] pgmap v13478: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:54 smithi191 bash[24992]: audit 2024-08-31T09:40:52.428845+0000 mgr.a (mgr.14388) 19442 : audit [DBG] from='client.417309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:54 smithi163 bash[24253]: audit 2024-08-31T09:40:52.428845+0000 mgr.a (mgr.14388) 19442 : audit [DBG] from='client.417309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:54.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:54 smithi027 bash[22610]: audit 2024-08-31T09:40:52.428845+0000 mgr.a (mgr.14388) 19442 : audit [DBG] from='client.417309 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:40:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:55 smithi191 bash[24992]: cluster 2024-08-31T09:40:53.877916+0000 mgr.a (mgr.14388) 19443 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:55 smithi163 bash[24253]: cluster 2024-08-31T09:40:53.877916+0000 mgr.a (mgr.14388) 19443 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:55 smithi027 bash[22610]: cluster 2024-08-31T09:40:53.877916+0000 mgr.a (mgr.14388) 19443 : cluster [DBG] pgmap v13479: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:40:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:57 smithi191 bash[24992]: cluster 2024-08-31T09:40:55.878690+0000 mgr.a (mgr.14388) 19444 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:57 smithi163 bash[24253]: cluster 2024-08-31T09:40:55.878690+0000 mgr.a (mgr.14388) 19444 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:57 smithi027 bash[22610]: cluster 2024-08-31T09:40:55.878690+0000 mgr.a (mgr.14388) 19444 : cluster [DBG] pgmap v13480: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:57.868 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:40:57.868 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:40:57.868 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:40:58.631 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:40:58.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:40:58.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:40:58.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:40:58.631 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:40:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:40:59 smithi191 bash[24992]: cluster 2024-08-31T09:40:57.879394+0000 mgr.a (mgr.14388) 19445 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:40:59 smithi163 bash[24253]: cluster 2024-08-31T09:40:57.879394+0000 mgr.a (mgr.14388) 19445 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:40:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:40:59 smithi027 bash[22610]: cluster 2024-08-31T09:40:57.879394+0000 mgr.a (mgr.14388) 19445 : cluster [DBG] pgmap v13481: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:00 smithi191 bash[24992]: audit 2024-08-31T09:40:58.206239+0000 mgr.a (mgr.14388) 19446 : audit [DBG] from='client.417384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:00 smithi191 bash[24992]: cluster 2024-08-31T09:40:59.882074+0000 mgr.a (mgr.14388) 19447 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:00 smithi163 bash[24253]: audit 2024-08-31T09:40:58.206239+0000 mgr.a (mgr.14388) 19446 : audit [DBG] from='client.417384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:00 smithi163 bash[24253]: cluster 2024-08-31T09:40:59.882074+0000 mgr.a (mgr.14388) 19447 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:00 smithi027 bash[22610]: audit 2024-08-31T09:40:58.206239+0000 mgr.a (mgr.14388) 19446 : audit [DBG] from='client.417384 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:00 smithi027 bash[22610]: cluster 2024-08-31T09:40:59.882074+0000 mgr.a (mgr.14388) 19447 : cluster [DBG] pgmap v13482: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:02 smithi163 bash[24253]: cluster 2024-08-31T09:41:01.882809+0000 mgr.a (mgr.14388) 19448 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:41:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:02 smithi027 bash[22610]: cluster 2024-08-31T09:41:01.882809+0000 mgr.a (mgr.14388) 19448 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:41:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:02 smithi191 bash[24992]: cluster 2024-08-31T09:41:01.882809+0000 mgr.a (mgr.14388) 19448 : cluster [DBG] pgmap v13483: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:41:03.632 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:41:03.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:41:03.633 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:41:04.377 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:41:04.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:41:04.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:41:04.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:41:04.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:41:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:04 smithi163 bash[24253]: cluster 2024-08-31T09:41:03.884709+0000 mgr.a (mgr.14388) 19449 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:04 smithi163 bash[24253]: audit 2024-08-31T09:41:03.964063+0000 mgr.a (mgr.14388) 19450 : audit [DBG] from='client.417462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:05.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:04 smithi027 bash[22610]: cluster 2024-08-31T09:41:03.884709+0000 mgr.a (mgr.14388) 19449 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:05.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:04 smithi027 bash[22610]: audit 2024-08-31T09:41:03.964063+0000 mgr.a (mgr.14388) 19450 : audit [DBG] from='client.417462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:04 smithi191 bash[24992]: cluster 2024-08-31T09:41:03.884709+0000 mgr.a (mgr.14388) 19449 : cluster [DBG] pgmap v13484: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:04 smithi191 bash[24992]: audit 2024-08-31T09:41:03.964063+0000 mgr.a (mgr.14388) 19450 : audit [DBG] from='client.417462 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:06 smithi163 bash[24253]: cluster 2024-08-31T09:41:05.885602+0000 mgr.a (mgr.14388) 19451 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:41:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:06 smithi027 bash[22610]: cluster 2024-08-31T09:41:05.885602+0000 mgr.a (mgr.14388) 19451 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:41:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:06 smithi191 bash[24992]: cluster 2024-08-31T09:41:05.885602+0000 mgr.a (mgr.14388) 19451 : cluster [DBG] pgmap v13485: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:41:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:08 smithi027 bash[22610]: cluster 2024-08-31T09:41:07.886469+0000 mgr.a (mgr.14388) 19452 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:41:09.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:08 smithi191 bash[24992]: cluster 2024-08-31T09:41:07.886469+0000 mgr.a (mgr.14388) 19452 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:41:09.379 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:41:09.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:41:09.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:41:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:08 smithi163 bash[24253]: cluster 2024-08-31T09:41:07.886469+0000 mgr.a (mgr.14388) 19452 : cluster [DBG] pgmap v13486: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:41:10.177 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:41:10.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:41:10.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:41:10.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:41:10.178 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:41:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:10 smithi027 bash[22610]: audit 2024-08-31T09:41:09.713821+0000 mgr.a (mgr.14388) 19453 : audit [DBG] from='client.417537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:11.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:10 smithi027 bash[22610]: cluster 2024-08-31T09:41:09.888190+0000 mgr.a (mgr.14388) 19454 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:10 smithi191 bash[24992]: audit 2024-08-31T09:41:09.713821+0000 mgr.a (mgr.14388) 19453 : audit [DBG] from='client.417537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:10 smithi191 bash[24992]: cluster 2024-08-31T09:41:09.888190+0000 mgr.a (mgr.14388) 19454 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:10 smithi163 bash[24253]: audit 2024-08-31T09:41:09.713821+0000 mgr.a (mgr.14388) 19453 : audit [DBG] from='client.417537 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:10 smithi163 bash[24253]: cluster 2024-08-31T09:41:09.888190+0000 mgr.a (mgr.14388) 19454 : cluster [DBG] pgmap v13487: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:12 smithi163 bash[24253]: cluster 2024-08-31T09:41:11.889198+0000 mgr.a (mgr.14388) 19455 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:12 smithi027 bash[22610]: cluster 2024-08-31T09:41:11.889198+0000 mgr.a (mgr.14388) 19455 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:12 smithi191 bash[24992]: cluster 2024-08-31T09:41:11.889198+0000 mgr.a (mgr.14388) 19455 : cluster [DBG] pgmap v13488: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:15.179 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:41:15.179 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:41:15.180 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:41:15.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:14 smithi163 bash[24253]: cluster 2024-08-31T09:41:13.891413+0000 mgr.a (mgr.14388) 19456 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:15.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:14 smithi027 bash[22610]: cluster 2024-08-31T09:41:13.891413+0000 mgr.a (mgr.14388) 19456 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:15.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:14 smithi191 bash[24992]: cluster 2024-08-31T09:41:13.891413+0000 mgr.a (mgr.14388) 19456 : cluster [DBG] pgmap v13489: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:15.931 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:41:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:41:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:41:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:41:15.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:41:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:16 smithi027 bash[22610]: audit 2024-08-31T09:41:15.505973+0000 mgr.a (mgr.14388) 19457 : audit [DBG] from='client.417612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:17.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:16 smithi027 bash[22610]: cluster 2024-08-31T09:41:15.892064+0000 mgr.a (mgr.14388) 19458 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:16 smithi191 bash[24992]: audit 2024-08-31T09:41:15.505973+0000 mgr.a (mgr.14388) 19457 : audit [DBG] from='client.417612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:17.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:16 smithi191 bash[24992]: cluster 2024-08-31T09:41:15.892064+0000 mgr.a (mgr.14388) 19458 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:16 smithi163 bash[24253]: audit 2024-08-31T09:41:15.505973+0000 mgr.a (mgr.14388) 19457 : audit [DBG] from='client.417612 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:16 smithi163 bash[24253]: cluster 2024-08-31T09:41:15.892064+0000 mgr.a (mgr.14388) 19458 : cluster [DBG] pgmap v13490: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:19.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:18 smithi027 bash[22610]: cluster 2024-08-31T09:41:17.892815+0000 mgr.a (mgr.14388) 19459 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:19.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:18 smithi191 bash[24992]: cluster 2024-08-31T09:41:17.892815+0000 mgr.a (mgr.14388) 19459 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:18 smithi163 bash[24253]: cluster 2024-08-31T09:41:17.892815+0000 mgr.a (mgr.14388) 19459 : cluster [DBG] pgmap v13491: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:20.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:41:20.933 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:41:20.933 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:41:21.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:20 smithi027 bash[22610]: cluster 2024-08-31T09:41:19.895063+0000 mgr.a (mgr.14388) 19460 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:21.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:20 smithi191 bash[24992]: cluster 2024-08-31T09:41:19.895063+0000 mgr.a (mgr.14388) 19460 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:20 smithi163 bash[24253]: cluster 2024-08-31T09:41:19.895063+0000 mgr.a (mgr.14388) 19460 : cluster [DBG] pgmap v13492: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:21.693 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:41:21.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:41:21.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:41:21.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:41:21.694 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:41:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:22 smithi027 bash[22610]: audit 2024-08-31T09:41:21.271298+0000 mgr.a (mgr.14388) 19461 : audit [DBG] from='client.417690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:23.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:22 smithi027 bash[22610]: cluster 2024-08-31T09:41:21.896047+0000 mgr.a (mgr.14388) 19462 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:23.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:22 smithi191 bash[24992]: audit 2024-08-31T09:41:21.271298+0000 mgr.a (mgr.14388) 19461 : audit [DBG] from='client.417690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:22 smithi191 bash[24992]: cluster 2024-08-31T09:41:21.896047+0000 mgr.a (mgr.14388) 19462 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:22 smithi163 bash[24253]: audit 2024-08-31T09:41:21.271298+0000 mgr.a (mgr.14388) 19461 : audit [DBG] from='client.417690 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:22 smithi163 bash[24253]: cluster 2024-08-31T09:41:21.896047+0000 mgr.a (mgr.14388) 19462 : cluster [DBG] pgmap v13493: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:24.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:23 smithi027 bash[22610]: audit 2024-08-31T09:41:23.301838+0000 mon.a (mon.0) 3473 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:41:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:23 smithi191 bash[24992]: audit 2024-08-31T09:41:23.301838+0000 mon.a (mon.0) 3473 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:41:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:23 smithi163 bash[24253]: audit 2024-08-31T09:41:23.301838+0000 mon.a (mon.0) 3473 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:41:25.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:41:24 smithi027 bash[22863]: debug 2024-08-31T09:41:24.899+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:41:25.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:41:24 smithi027 bash[22863]: debug 2024-08-31T09:41:24.899+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:41:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:24 smithi027 bash[22610]: cluster 2024-08-31T09:41:23.897031+0000 mgr.a (mgr.14388) 19463 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:24 smithi027 bash[22610]: audit 2024-08-31T09:41:24.129808+0000 mon.a (mon.0) 3474 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:41:25.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:24 smithi027 bash[22610]: audit 2024-08-31T09:41:24.131753+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:41:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:24 smithi027 bash[22610]: audit 2024-08-31T09:41:24.142415+0000 mon.a (mon.0) 3476 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:41:25.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:24 smithi027 bash[22610]: audit 2024-08-31T09:41:24.147768+0000 mon.a (mon.0) 3477 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:41:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:24 smithi191 bash[24992]: cluster 2024-08-31T09:41:23.897031+0000 mgr.a (mgr.14388) 19463 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:24 smithi191 bash[24992]: audit 2024-08-31T09:41:24.129808+0000 mon.a (mon.0) 3474 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:41:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:24 smithi191 bash[24992]: audit 2024-08-31T09:41:24.131753+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:41:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:24 smithi191 bash[24992]: audit 2024-08-31T09:41:24.142415+0000 mon.a (mon.0) 3476 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:41:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:24 smithi191 bash[24992]: audit 2024-08-31T09:41:24.147768+0000 mon.a (mon.0) 3477 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:41:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:24 smithi163 bash[24253]: cluster 2024-08-31T09:41:23.897031+0000 mgr.a (mgr.14388) 19463 : cluster [DBG] pgmap v13494: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:24 smithi163 bash[24253]: audit 2024-08-31T09:41:24.129808+0000 mon.a (mon.0) 3474 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:41:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:24 smithi163 bash[24253]: audit 2024-08-31T09:41:24.131753+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:41:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:24 smithi163 bash[24253]: audit 2024-08-31T09:41:24.142415+0000 mon.a (mon.0) 3476 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:41:25.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:24 smithi163 bash[24253]: audit 2024-08-31T09:41:24.147768+0000 mon.a (mon.0) 3477 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:41:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:25 smithi191 bash[24992]: audit 2024-08-31T09:41:24.149998+0000 mgr.a (mgr.14388) 19464 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:41:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:25 smithi191 bash[24992]: audit 2024-08-31T09:41:24.904461+0000 mgr.a (mgr.14388) 19465 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:41:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:25 smithi191 bash[24992]: cephadm 2024-08-31T09:41:24.905953+0000 mgr.a (mgr.14388) 19466 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:41:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:25 smithi163 bash[24253]: audit 2024-08-31T09:41:24.149998+0000 mgr.a (mgr.14388) 19464 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:41:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:25 smithi163 bash[24253]: audit 2024-08-31T09:41:24.904461+0000 mgr.a (mgr.14388) 19465 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:41:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:25 smithi163 bash[24253]: cephadm 2024-08-31T09:41:24.905953+0000 mgr.a (mgr.14388) 19466 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:41:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:25 smithi027 bash[22610]: audit 2024-08-31T09:41:24.149998+0000 mgr.a (mgr.14388) 19464 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:41:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:25 smithi027 bash[22610]: audit 2024-08-31T09:41:24.904461+0000 mgr.a (mgr.14388) 19465 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:41:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:25 smithi027 bash[22610]: cephadm 2024-08-31T09:41:24.905953+0000 mgr.a (mgr.14388) 19466 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:41:26.695 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:41:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:41:26.696 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:41:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:26 smithi191 bash[24992]: cluster 2024-08-31T09:41:25.897914+0000 mgr.a (mgr.14388) 19467 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:26 smithi163 bash[24253]: cluster 2024-08-31T09:41:25.897914+0000 mgr.a (mgr.14388) 19467 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:26 smithi027 bash[22610]: cluster 2024-08-31T09:41:25.897914+0000 mgr.a (mgr.14388) 19467 : cluster [DBG] pgmap v13495: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:27.485 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:41:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:41:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:41:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:41:27.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:41:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:28 smithi191 bash[24992]: audit 2024-08-31T09:41:27.038850+0000 mgr.a (mgr.14388) 19468 : audit [DBG] from='client.417873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:28 smithi191 bash[24992]: cluster 2024-08-31T09:41:27.898916+0000 mgr.a (mgr.14388) 19469 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:28 smithi163 bash[24253]: audit 2024-08-31T09:41:27.038850+0000 mgr.a (mgr.14388) 19468 : audit [DBG] from='client.417873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:28 smithi163 bash[24253]: cluster 2024-08-31T09:41:27.898916+0000 mgr.a (mgr.14388) 19469 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:28 smithi027 bash[22610]: audit 2024-08-31T09:41:27.038850+0000 mgr.a (mgr.14388) 19468 : audit [DBG] from='client.417873 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:29.484 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:28 smithi027 bash[22610]: cluster 2024-08-31T09:41:27.898916+0000 mgr.a (mgr.14388) 19469 : cluster [DBG] pgmap v13496: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:30 smithi191 bash[24992]: cluster 2024-08-31T09:41:29.901150+0000 mgr.a (mgr.14388) 19470 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:30 smithi163 bash[24253]: cluster 2024-08-31T09:41:29.901150+0000 mgr.a (mgr.14388) 19470 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:31.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:30 smithi027 bash[22610]: cluster 2024-08-31T09:41:29.901150+0000 mgr.a (mgr.14388) 19470 : cluster [DBG] pgmap v13497: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:32.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:41:32.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:41:32.488 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:41:33.240 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:41:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:41:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:41:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:41:33.241 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:41:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:32 smithi191 bash[24992]: cluster 2024-08-31T09:41:31.901921+0000 mgr.a (mgr.14388) 19471 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:32 smithi163 bash[24253]: cluster 2024-08-31T09:41:31.901921+0000 mgr.a (mgr.14388) 19471 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:33.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:32 smithi027 bash[22610]: cluster 2024-08-31T09:41:31.901921+0000 mgr.a (mgr.14388) 19471 : cluster [DBG] pgmap v13498: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:34 smithi191 bash[24992]: audit 2024-08-31T09:41:32.819967+0000 mgr.a (mgr.14388) 19472 : audit [DBG] from='client.417948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:34.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:34 smithi163 bash[24253]: audit 2024-08-31T09:41:32.819967+0000 mgr.a (mgr.14388) 19472 : audit [DBG] from='client.417948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:34 smithi027 bash[22610]: audit 2024-08-31T09:41:32.819967+0000 mgr.a (mgr.14388) 19472 : audit [DBG] from='client.417948 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:35 smithi191 bash[24992]: cluster 2024-08-31T09:41:33.904411+0000 mgr.a (mgr.14388) 19473 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:35 smithi163 bash[24253]: cluster 2024-08-31T09:41:33.904411+0000 mgr.a (mgr.14388) 19473 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:35.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:35 smithi027 bash[22610]: cluster 2024-08-31T09:41:33.904411+0000 mgr.a (mgr.14388) 19473 : cluster [DBG] pgmap v13499: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:37 smithi191 bash[24992]: cluster 2024-08-31T09:41:35.905385+0000 mgr.a (mgr.14388) 19474 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:41:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:37 smithi163 bash[24253]: cluster 2024-08-31T09:41:35.905385+0000 mgr.a (mgr.14388) 19474 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:41:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:37 smithi027 bash[22610]: cluster 2024-08-31T09:41:35.905385+0000 mgr.a (mgr.14388) 19474 : cluster [DBG] pgmap v13500: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:41:38.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:41:38.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:41:38.243 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:41:38.979 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:41:38.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:41:38.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:41:38.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:41:38.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:41:39.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:39 smithi191 bash[24992]: cluster 2024-08-31T09:41:37.906343+0000 mgr.a (mgr.14388) 19475 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:41:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:39 smithi163 bash[24253]: cluster 2024-08-31T09:41:37.906343+0000 mgr.a (mgr.14388) 19475 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:41:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:39 smithi027 bash[22610]: cluster 2024-08-31T09:41:37.906343+0000 mgr.a (mgr.14388) 19475 : cluster [DBG] pgmap v13501: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:41:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:40 smithi191 bash[24992]: audit 2024-08-31T09:41:38.571780+0000 mgr.a (mgr.14388) 19476 : audit [DBG] from='client.418026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:40.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:40 smithi163 bash[24253]: audit 2024-08-31T09:41:38.571780+0000 mgr.a (mgr.14388) 19476 : audit [DBG] from='client.418026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:40 smithi027 bash[22610]: audit 2024-08-31T09:41:38.571780+0000 mgr.a (mgr.14388) 19476 : audit [DBG] from='client.418026 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:41 smithi191 bash[24992]: cluster 2024-08-31T09:41:39.909333+0000 mgr.a (mgr.14388) 19477 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:41 smithi163 bash[24253]: cluster 2024-08-31T09:41:39.909333+0000 mgr.a (mgr.14388) 19477 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:41 smithi027 bash[22610]: cluster 2024-08-31T09:41:39.909333+0000 mgr.a (mgr.14388) 19477 : cluster [DBG] pgmap v13502: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:41:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:43 smithi191 bash[24992]: cluster 2024-08-31T09:41:41.910356+0000 mgr.a (mgr.14388) 19478 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:41:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:43 smithi163 bash[24253]: cluster 2024-08-31T09:41:41.910356+0000 mgr.a (mgr.14388) 19478 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:41:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:43 smithi027 bash[22610]: cluster 2024-08-31T09:41:41.910356+0000 mgr.a (mgr.14388) 19478 : cluster [DBG] pgmap v13503: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:41:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:41:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:41:43.981 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:41:44.730 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:41:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:41:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:41:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:41:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:41:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:45 smithi191 bash[24992]: cluster 2024-08-31T09:41:43.912500+0000 mgr.a (mgr.14388) 19479 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:45 smithi163 bash[24253]: cluster 2024-08-31T09:41:43.912500+0000 mgr.a (mgr.14388) 19479 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:45 smithi027 bash[22610]: cluster 2024-08-31T09:41:43.912500+0000 mgr.a (mgr.14388) 19479 : cluster [DBG] pgmap v13504: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:46 smithi163 bash[24253]: audit 2024-08-31T09:41:44.311029+0000 mgr.a (mgr.14388) 19480 : audit [DBG] from='client.418104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:46 smithi163 bash[24253]: cluster 2024-08-31T09:41:45.913482+0000 mgr.a (mgr.14388) 19481 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:41:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:46 smithi027 bash[22610]: audit 2024-08-31T09:41:44.311029+0000 mgr.a (mgr.14388) 19480 : audit [DBG] from='client.418104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:46 smithi027 bash[22610]: cluster 2024-08-31T09:41:45.913482+0000 mgr.a (mgr.14388) 19481 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:41:46.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:46 smithi191 bash[24992]: audit 2024-08-31T09:41:44.311029+0000 mgr.a (mgr.14388) 19480 : audit [DBG] from='client.418104 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:46 smithi191 bash[24992]: cluster 2024-08-31T09:41:45.913482+0000 mgr.a (mgr.14388) 19481 : cluster [DBG] pgmap v13505: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:41:49.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:48 smithi027 bash[22610]: cluster 2024-08-31T09:41:47.914288+0000 mgr.a (mgr.14388) 19482 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:41:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:48 smithi191 bash[24992]: cluster 2024-08-31T09:41:47.914288+0000 mgr.a (mgr.14388) 19482 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:41:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:48 smithi163 bash[24253]: cluster 2024-08-31T09:41:47.914288+0000 mgr.a (mgr.14388) 19482 : cluster [DBG] pgmap v13506: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-08-31T09:41:49.732 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:41:49.733 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:41:49.733 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:41:50.477 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:41:50.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:41:50.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:41:50.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:41:50.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:41:51.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:50 smithi027 bash[22610]: cluster 2024-08-31T09:41:49.916459+0000 mgr.a (mgr.14388) 19483 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:41:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:50 smithi191 bash[24992]: cluster 2024-08-31T09:41:49.916459+0000 mgr.a (mgr.14388) 19483 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:41:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:50 smithi163 bash[24253]: cluster 2024-08-31T09:41:49.916459+0000 mgr.a (mgr.14388) 19483 : cluster [DBG] pgmap v13507: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 2 op/s 2024-08-31T09:41:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:51 smithi027 bash[22610]: audit 2024-08-31T09:41:50.063708+0000 mgr.a (mgr.14388) 19484 : audit [DBG] from='client.418179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:51 smithi191 bash[24992]: audit 2024-08-31T09:41:50.063708+0000 mgr.a (mgr.14388) 19484 : audit [DBG] from='client.418179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:51 smithi163 bash[24253]: audit 2024-08-31T09:41:50.063708+0000 mgr.a (mgr.14388) 19484 : audit [DBG] from='client.418179 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:52 smithi191 bash[24992]: cluster 2024-08-31T09:41:51.917621+0000 mgr.a (mgr.14388) 19485 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:52 smithi163 bash[24253]: cluster 2024-08-31T09:41:51.917621+0000 mgr.a (mgr.14388) 19485 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:52 smithi027 bash[22610]: cluster 2024-08-31T09:41:51.917621+0000 mgr.a (mgr.14388) 19485 : cluster [DBG] pgmap v13508: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:54 smithi191 bash[24992]: cluster 2024-08-31T09:41:53.919880+0000 mgr.a (mgr.14388) 19486 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:54 smithi163 bash[24253]: cluster 2024-08-31T09:41:53.919880+0000 mgr.a (mgr.14388) 19486 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:55.479 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:41:55.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:41:55.480 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:41:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:54 smithi027 bash[22610]: cluster 2024-08-31T09:41:53.919880+0000 mgr.a (mgr.14388) 19486 : cluster [DBG] pgmap v13509: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:56.267 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:41:56.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:41:56.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:41:56.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:41:56.268 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:41:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:56 smithi191 bash[24992]: audit 2024-08-31T09:41:55.821530+0000 mgr.a (mgr.14388) 19487 : audit [DBG] from='client.418257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:56 smithi191 bash[24992]: cluster 2024-08-31T09:41:55.920379+0000 mgr.a (mgr.14388) 19488 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:56 smithi163 bash[24253]: audit 2024-08-31T09:41:55.821530+0000 mgr.a (mgr.14388) 19487 : audit [DBG] from='client.418257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:56 smithi163 bash[24253]: cluster 2024-08-31T09:41:55.920379+0000 mgr.a (mgr.14388) 19488 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:56 smithi027 bash[22610]: audit 2024-08-31T09:41:55.821530+0000 mgr.a (mgr.14388) 19487 : audit [DBG] from='client.418257 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:41:57.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:56 smithi027 bash[22610]: cluster 2024-08-31T09:41:55.920379+0000 mgr.a (mgr.14388) 19488 : cluster [DBG] pgmap v13510: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:41:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:41:59 smithi191 bash[24992]: cluster 2024-08-31T09:41:57.922557+0000 mgr.a (mgr.14388) 19489 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:41:59 smithi163 bash[24253]: cluster 2024-08-31T09:41:57.922557+0000 mgr.a (mgr.14388) 19489 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:41:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:41:59 smithi027 bash[22610]: cluster 2024-08-31T09:41:57.922557+0000 mgr.a (mgr.14388) 19489 : cluster [DBG] pgmap v13511: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:01.269 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:01.270 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:01.270 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:01.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:01 smithi191 bash[24992]: cluster 2024-08-31T09:41:59.923447+0000 mgr.a (mgr.14388) 19490 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:01 smithi163 bash[24253]: cluster 2024-08-31T09:41:59.923447+0000 mgr.a (mgr.14388) 19490 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:01 smithi027 bash[22610]: cluster 2024-08-31T09:41:59.923447+0000 mgr.a (mgr.14388) 19490 : cluster [DBG] pgmap v13512: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:02.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:02.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:02.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:02.008 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:42:02.009 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:03 smithi191 bash[24992]: audit 2024-08-31T09:42:01.595913+0000 mgr.a (mgr.14388) 19491 : audit [DBG] from='client.418329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:03 smithi191 bash[24992]: cluster 2024-08-31T09:42:01.924003+0000 mgr.a (mgr.14388) 19492 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:03 smithi163 bash[24253]: audit 2024-08-31T09:42:01.595913+0000 mgr.a (mgr.14388) 19491 : audit [DBG] from='client.418329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:03 smithi163 bash[24253]: cluster 2024-08-31T09:42:01.924003+0000 mgr.a (mgr.14388) 19492 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:03 smithi027 bash[22610]: audit 2024-08-31T09:42:01.595913+0000 mgr.a (mgr.14388) 19491 : audit [DBG] from='client.418329 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:03 smithi027 bash[22610]: cluster 2024-08-31T09:42:01.924003+0000 mgr.a (mgr.14388) 19492 : cluster [DBG] pgmap v13513: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:05.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:05 smithi191 bash[24992]: cluster 2024-08-31T09:42:03.926197+0000 mgr.a (mgr.14388) 19493 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:05 smithi163 bash[24253]: cluster 2024-08-31T09:42:03.926197+0000 mgr.a (mgr.14388) 19493 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:05.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:05 smithi027 bash[22610]: cluster 2024-08-31T09:42:03.926197+0000 mgr.a (mgr.14388) 19493 : cluster [DBG] pgmap v13514: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:07.010 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:07.010 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:07.011 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:07.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:07 smithi191 bash[24992]: cluster 2024-08-31T09:42:05.927000+0000 mgr.a (mgr.14388) 19494 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:07 smithi163 bash[24253]: cluster 2024-08-31T09:42:05.927000+0000 mgr.a (mgr.14388) 19494 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:07.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:07 smithi027 bash[22610]: cluster 2024-08-31T09:42:05.927000+0000 mgr.a (mgr.14388) 19494 : cluster [DBG] pgmap v13515: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:07.777 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:07.777 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:42:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:09 smithi191 bash[24992]: audit 2024-08-31T09:42:07.348337+0000 mgr.a (mgr.14388) 19495 : audit [DBG] from='client.418407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:09.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:09 smithi191 bash[24992]: cluster 2024-08-31T09:42:07.929190+0000 mgr.a (mgr.14388) 19496 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:09 smithi163 bash[24253]: audit 2024-08-31T09:42:07.348337+0000 mgr.a (mgr.14388) 19495 : audit [DBG] from='client.418407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:09 smithi163 bash[24253]: cluster 2024-08-31T09:42:07.929190+0000 mgr.a (mgr.14388) 19496 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:09.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:09 smithi027 bash[22610]: audit 2024-08-31T09:42:07.348337+0000 mgr.a (mgr.14388) 19495 : audit [DBG] from='client.418407 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:09 smithi027 bash[22610]: cluster 2024-08-31T09:42:07.929190+0000 mgr.a (mgr.14388) 19496 : cluster [DBG] pgmap v13516: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:11.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:11 smithi191 bash[24992]: cluster 2024-08-31T09:42:09.929959+0000 mgr.a (mgr.14388) 19497 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:11 smithi163 bash[24253]: cluster 2024-08-31T09:42:09.929959+0000 mgr.a (mgr.14388) 19497 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:11.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:11 smithi027 bash[22610]: cluster 2024-08-31T09:42:09.929959+0000 mgr.a (mgr.14388) 19497 : cluster [DBG] pgmap v13517: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:12.778 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:12.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:12.779 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:13 smithi191 bash[24992]: cluster 2024-08-31T09:42:11.930741+0000 mgr.a (mgr.14388) 19498 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:13 smithi163 bash[24253]: cluster 2024-08-31T09:42:11.930741+0000 mgr.a (mgr.14388) 19498 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:13 smithi027 bash[22610]: cluster 2024-08-31T09:42:11.930741+0000 mgr.a (mgr.14388) 19498 : cluster [DBG] pgmap v13518: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:13.555 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:13.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:13.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:13.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:13.556 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:42:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:15 smithi191 bash[24992]: audit 2024-08-31T09:42:13.119891+0000 mgr.a (mgr.14388) 19499 : audit [DBG] from='client.418485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:15.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:15 smithi191 bash[24992]: cluster 2024-08-31T09:42:13.933535+0000 mgr.a (mgr.14388) 19500 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:15 smithi163 bash[24253]: audit 2024-08-31T09:42:13.119891+0000 mgr.a (mgr.14388) 19499 : audit [DBG] from='client.418485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:15 smithi163 bash[24253]: cluster 2024-08-31T09:42:13.933535+0000 mgr.a (mgr.14388) 19500 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:15 smithi027 bash[22610]: audit 2024-08-31T09:42:13.119891+0000 mgr.a (mgr.14388) 19499 : audit [DBG] from='client.418485 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:15 smithi027 bash[22610]: cluster 2024-08-31T09:42:13.933535+0000 mgr.a (mgr.14388) 19500 : cluster [DBG] pgmap v13519: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:17 smithi163 bash[24253]: cluster 2024-08-31T09:42:15.934304+0000 mgr.a (mgr.14388) 19501 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:17.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:17 smithi027 bash[22610]: cluster 2024-08-31T09:42:15.934304+0000 mgr.a (mgr.14388) 19501 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:17.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:17 smithi191 bash[24992]: cluster 2024-08-31T09:42:15.934304+0000 mgr.a (mgr.14388) 19501 : cluster [DBG] pgmap v13520: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:18.557 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:18.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:18.558 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:19.338 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:19.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:19.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:19.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:19.339 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:42:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:19 smithi163 bash[24253]: cluster 2024-08-31T09:42:17.936219+0000 mgr.a (mgr.14388) 19502 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:19 smithi027 bash[22610]: cluster 2024-08-31T09:42:17.936219+0000 mgr.a (mgr.14388) 19502 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:19 smithi191 bash[24992]: cluster 2024-08-31T09:42:17.936219+0000 mgr.a (mgr.14388) 19502 : cluster [DBG] pgmap v13521: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:20 smithi163 bash[24253]: audit 2024-08-31T09:42:18.893458+0000 mgr.a (mgr.14388) 19503 : audit [DBG] from='client.418560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:20 smithi163 bash[24253]: cluster 2024-08-31T09:42:19.937178+0000 mgr.a (mgr.14388) 19504 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:20 smithi027 bash[22610]: audit 2024-08-31T09:42:18.893458+0000 mgr.a (mgr.14388) 19503 : audit [DBG] from='client.418560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:20 smithi027 bash[22610]: cluster 2024-08-31T09:42:19.937178+0000 mgr.a (mgr.14388) 19504 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:20 smithi191 bash[24992]: audit 2024-08-31T09:42:18.893458+0000 mgr.a (mgr.14388) 19503 : audit [DBG] from='client.418560 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:20 smithi191 bash[24992]: cluster 2024-08-31T09:42:19.937178+0000 mgr.a (mgr.14388) 19504 : cluster [DBG] pgmap v13522: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:23.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:22 smithi191 bash[24992]: cluster 2024-08-31T09:42:21.937992+0000 mgr.a (mgr.14388) 19505 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:42:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:22 smithi163 bash[24253]: cluster 2024-08-31T09:42:21.937992+0000 mgr.a (mgr.14388) 19505 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:42:23.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:22 smithi027 bash[22610]: cluster 2024-08-31T09:42:21.937992+0000 mgr.a (mgr.14388) 19505 : cluster [DBG] pgmap v13523: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:42:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:24.340 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:24.341 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:25.101 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:25.101 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:42:25.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:24 smithi191 bash[24992]: cluster 2024-08-31T09:42:23.940257+0000 mgr.a (mgr.14388) 19506 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:25.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:24 smithi191 bash[24992]: audit 2024-08-31T09:42:24.966641+0000 mon.a (mon.0) 3478 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:42:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:24 smithi163 bash[24253]: cluster 2024-08-31T09:42:23.940257+0000 mgr.a (mgr.14388) 19506 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:25.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:24 smithi163 bash[24253]: audit 2024-08-31T09:42:24.966641+0000 mon.a (mon.0) 3478 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:42:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:24 smithi027 bash[22610]: cluster 2024-08-31T09:42:23.940257+0000 mgr.a (mgr.14388) 19506 : cluster [DBG] pgmap v13524: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:25.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:24 smithi027 bash[22610]: audit 2024-08-31T09:42:24.966641+0000 mon.a (mon.0) 3478 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:42:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:26 smithi191 bash[24992]: audit 2024-08-31T09:42:24.673704+0000 mgr.a (mgr.14388) 19507 : audit [DBG] from='client.418635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:26 smithi191 bash[24992]: audit 2024-08-31T09:42:25.738410+0000 mon.a (mon.0) 3479 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:42:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:26 smithi191 bash[24992]: audit 2024-08-31T09:42:25.739970+0000 mon.a (mon.0) 3480 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:42:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:26 smithi191 bash[24992]: audit 2024-08-31T09:42:25.747852+0000 mon.a (mon.0) 3481 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:42:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:26 smithi191 bash[24992]: audit 2024-08-31T09:42:25.753071+0000 mon.a (mon.0) 3482 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:42:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:26 smithi163 bash[24253]: audit 2024-08-31T09:42:24.673704+0000 mgr.a (mgr.14388) 19507 : audit [DBG] from='client.418635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:26 smithi163 bash[24253]: audit 2024-08-31T09:42:25.738410+0000 mon.a (mon.0) 3479 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:42:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:26 smithi163 bash[24253]: audit 2024-08-31T09:42:25.739970+0000 mon.a (mon.0) 3480 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:42:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:26 smithi163 bash[24253]: audit 2024-08-31T09:42:25.747852+0000 mon.a (mon.0) 3481 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:42:26.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:26 smithi163 bash[24253]: audit 2024-08-31T09:42:25.753071+0000 mon.a (mon.0) 3482 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:42:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:25 smithi027 bash[22610]: audit 2024-08-31T09:42:24.673704+0000 mgr.a (mgr.14388) 19507 : audit [DBG] from='client.418635 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:25 smithi027 bash[22610]: audit 2024-08-31T09:42:25.738410+0000 mon.a (mon.0) 3479 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:42:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:25 smithi027 bash[22610]: audit 2024-08-31T09:42:25.739970+0000 mon.a (mon.0) 3480 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:42:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:25 smithi027 bash[22610]: audit 2024-08-31T09:42:25.747852+0000 mon.a (mon.0) 3481 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:42:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:26 smithi027 bash[22610]: audit 2024-08-31T09:42:25.753071+0000 mon.a (mon.0) 3482 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:42:26.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:42:26 smithi027 bash[22863]: debug 2024-08-31T09:42:26.485+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:42:26.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:42:26 smithi027 bash[22863]: debug 2024-08-31T09:42:26.485+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:42:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:27 smithi191 bash[24992]: audit 2024-08-31T09:42:25.755752+0000 mgr.a (mgr.14388) 19508 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:42:27.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:27 smithi191 bash[24992]: cluster 2024-08-31T09:42:25.940790+0000 mgr.a (mgr.14388) 19509 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:27 smithi163 bash[24253]: audit 2024-08-31T09:42:25.755752+0000 mgr.a (mgr.14388) 19508 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:42:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:27 smithi163 bash[24253]: cluster 2024-08-31T09:42:25.940790+0000 mgr.a (mgr.14388) 19509 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:27.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:27 smithi027 bash[22610]: audit 2024-08-31T09:42:25.755752+0000 mgr.a (mgr.14388) 19508 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:42:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:27 smithi027 bash[22610]: cluster 2024-08-31T09:42:25.940790+0000 mgr.a (mgr.14388) 19509 : cluster [DBG] pgmap v13525: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:28 smithi191 bash[24992]: audit 2024-08-31T09:42:26.486845+0000 mgr.a (mgr.14388) 19510 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:42:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:28 smithi191 bash[24992]: cephadm 2024-08-31T09:42:26.488107+0000 mgr.a (mgr.14388) 19511 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:42:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:28 smithi163 bash[24253]: audit 2024-08-31T09:42:26.486845+0000 mgr.a (mgr.14388) 19510 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:42:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:28 smithi163 bash[24253]: cephadm 2024-08-31T09:42:26.488107+0000 mgr.a (mgr.14388) 19511 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:42:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:28 smithi027 bash[22610]: audit 2024-08-31T09:42:26.486845+0000 mgr.a (mgr.14388) 19510 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:42:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:28 smithi027 bash[22610]: cephadm 2024-08-31T09:42:26.488107+0000 mgr.a (mgr.14388) 19511 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:42:29.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:29 smithi191 bash[24992]: cluster 2024-08-31T09:42:27.943056+0000 mgr.a (mgr.14388) 19512 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T09:42:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:29 smithi163 bash[24253]: cluster 2024-08-31T09:42:27.943056+0000 mgr.a (mgr.14388) 19512 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T09:42:29.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:29 smithi027 bash[22610]: cluster 2024-08-31T09:42:27.943056+0000 mgr.a (mgr.14388) 19512 : cluster [DBG] pgmap v13526: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T09:42:30.102 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:30.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:30.103 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:30.868 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:30.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:30.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:30.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:30.869 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:42:31.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:31 smithi191 bash[24992]: cluster 2024-08-31T09:42:29.944011+0000 mgr.a (mgr.14388) 19513 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T09:42:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:31 smithi163 bash[24253]: cluster 2024-08-31T09:42:29.944011+0000 mgr.a (mgr.14388) 19513 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T09:42:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:31 smithi027 bash[22610]: cluster 2024-08-31T09:42:29.944011+0000 mgr.a (mgr.14388) 19513 : cluster [DBG] pgmap v13527: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T09:42:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:32 smithi191 bash[24992]: audit 2024-08-31T09:42:30.438323+0000 mgr.a (mgr.14388) 19514 : audit [DBG] from='client.418821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:32 smithi163 bash[24253]: audit 2024-08-31T09:42:30.438323+0000 mgr.a (mgr.14388) 19514 : audit [DBG] from='client.418821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:32.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:32 smithi027 bash[22610]: audit 2024-08-31T09:42:30.438323+0000 mgr.a (mgr.14388) 19514 : audit [DBG] from='client.418821 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:33 smithi191 bash[24992]: cluster 2024-08-31T09:42:31.945023+0000 mgr.a (mgr.14388) 19515 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T09:42:33.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:33 smithi163 bash[24253]: cluster 2024-08-31T09:42:31.945023+0000 mgr.a (mgr.14388) 19515 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T09:42:33.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:33 smithi027 bash[22610]: cluster 2024-08-31T09:42:31.945023+0000 mgr.a (mgr.14388) 19515 : cluster [DBG] pgmap v13528: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T09:42:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:35 smithi191 bash[24992]: cluster 2024-08-31T09:42:33.947461+0000 mgr.a (mgr.14388) 19516 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T09:42:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:35 smithi163 bash[24253]: cluster 2024-08-31T09:42:33.947461+0000 mgr.a (mgr.14388) 19516 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T09:42:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:35 smithi027 bash[22610]: cluster 2024-08-31T09:42:33.947461+0000 mgr.a (mgr.14388) 19516 : cluster [DBG] pgmap v13529: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T09:42:35.870 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:35.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:35.871 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:36.599 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:36.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:36.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:36.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:36.600 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:42:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:37 smithi191 bash[24992]: cluster 2024-08-31T09:42:35.948265+0000 mgr.a (mgr.14388) 19517 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T09:42:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:37 smithi163 bash[24253]: cluster 2024-08-31T09:42:35.948265+0000 mgr.a (mgr.14388) 19517 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T09:42:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:37 smithi027 bash[22610]: cluster 2024-08-31T09:42:35.948265+0000 mgr.a (mgr.14388) 19517 : cluster [DBG] pgmap v13530: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 426 B/s wr, 13 op/s 2024-08-31T09:42:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:38 smithi163 bash[24253]: audit 2024-08-31T09:42:36.197086+0000 mgr.a (mgr.14388) 19518 : audit [DBG] from='client.418893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:38 smithi027 bash[22610]: audit 2024-08-31T09:42:36.197086+0000 mgr.a (mgr.14388) 19518 : audit [DBG] from='client.418893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:38 smithi191 bash[24992]: audit 2024-08-31T09:42:36.197086+0000 mgr.a (mgr.14388) 19518 : audit [DBG] from='client.418893 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:39 smithi163 bash[24253]: cluster 2024-08-31T09:42:37.950536+0000 mgr.a (mgr.14388) 19519 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T09:42:39.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:39 smithi027 bash[22610]: cluster 2024-08-31T09:42:37.950536+0000 mgr.a (mgr.14388) 19519 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T09:42:39.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:39 smithi191 bash[24992]: cluster 2024-08-31T09:42:37.950536+0000 mgr.a (mgr.14388) 19519 : cluster [DBG] pgmap v13531: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 426 B/s wr, 14 op/s 2024-08-31T09:42:40.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:40 smithi163 bash[24253]: cluster 2024-08-31T09:42:39.951326+0000 mgr.a (mgr.14388) 19520 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:40.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:40 smithi027 bash[22610]: cluster 2024-08-31T09:42:39.951326+0000 mgr.a (mgr.14388) 19520 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:40 smithi191 bash[24992]: cluster 2024-08-31T09:42:39.951326+0000 mgr.a (mgr.14388) 19520 : cluster [DBG] pgmap v13532: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:41.601 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:41.601 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:41.602 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:42.379 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:42.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:42.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:42.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:42.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:42:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:43 smithi191 bash[24992]: audit 2024-08-31T09:42:41.942094+0000 mgr.a (mgr.14388) 19521 : audit [DBG] from='client.418971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:43 smithi191 bash[24992]: cluster 2024-08-31T09:42:41.954322+0000 mgr.a (mgr.14388) 19522 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:43 smithi163 bash[24253]: audit 2024-08-31T09:42:41.942094+0000 mgr.a (mgr.14388) 19521 : audit [DBG] from='client.418971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:43 smithi163 bash[24253]: cluster 2024-08-31T09:42:41.954322+0000 mgr.a (mgr.14388) 19522 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:43 smithi027 bash[22610]: audit 2024-08-31T09:42:41.942094+0000 mgr.a (mgr.14388) 19521 : audit [DBG] from='client.418971 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:43.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:43 smithi027 bash[22610]: cluster 2024-08-31T09:42:41.954322+0000 mgr.a (mgr.14388) 19522 : cluster [DBG] pgmap v13533: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:45.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:45 smithi191 bash[24992]: cluster 2024-08-31T09:42:43.956698+0000 mgr.a (mgr.14388) 19523 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:45.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:45 smithi163 bash[24253]: cluster 2024-08-31T09:42:43.956698+0000 mgr.a (mgr.14388) 19523 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:45.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:45 smithi027 bash[22610]: cluster 2024-08-31T09:42:43.956698+0000 mgr.a (mgr.14388) 19523 : cluster [DBG] pgmap v13534: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:42:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:47 smithi191 bash[24992]: cluster 2024-08-31T09:42:45.957520+0000 mgr.a (mgr.14388) 19524 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:47.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:47.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:47.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:47 smithi163 bash[24253]: cluster 2024-08-31T09:42:45.957520+0000 mgr.a (mgr.14388) 19524 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:47.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:47 smithi027 bash[22610]: cluster 2024-08-31T09:42:45.957520+0000 mgr.a (mgr.14388) 19524 : cluster [DBG] pgmap v13535: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:48.131 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:48.131 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:42:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:49 smithi191 bash[24992]: audit 2024-08-31T09:42:47.712333+0000 mgr.a (mgr.14388) 19525 : audit [DBG] from='client.419049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:49.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:49 smithi191 bash[24992]: cluster 2024-08-31T09:42:47.959106+0000 mgr.a (mgr.14388) 19526 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:49 smithi163 bash[24253]: audit 2024-08-31T09:42:47.712333+0000 mgr.a (mgr.14388) 19525 : audit [DBG] from='client.419049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:49 smithi163 bash[24253]: cluster 2024-08-31T09:42:47.959106+0000 mgr.a (mgr.14388) 19526 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:49 smithi027 bash[22610]: audit 2024-08-31T09:42:47.712333+0000 mgr.a (mgr.14388) 19525 : audit [DBG] from='client.419049 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:49.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:49 smithi027 bash[22610]: cluster 2024-08-31T09:42:47.959106+0000 mgr.a (mgr.14388) 19526 : cluster [DBG] pgmap v13536: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:42:51.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:51 smithi191 bash[24992]: cluster 2024-08-31T09:42:49.959969+0000 mgr.a (mgr.14388) 19527 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:51 smithi163 bash[24253]: cluster 2024-08-31T09:42:49.959969+0000 mgr.a (mgr.14388) 19527 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:51 smithi027 bash[22610]: cluster 2024-08-31T09:42:49.959969+0000 mgr.a (mgr.14388) 19527 : cluster [DBG] pgmap v13537: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:52.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:52 smithi163 bash[24253]: cluster 2024-08-31T09:42:51.960733+0000 mgr.a (mgr.14388) 19528 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:52.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:52 smithi027 bash[22610]: cluster 2024-08-31T09:42:51.960733+0000 mgr.a (mgr.14388) 19528 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:52.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:52 smithi191 bash[24992]: cluster 2024-08-31T09:42:51.960733+0000 mgr.a (mgr.14388) 19528 : cluster [DBG] pgmap v13538: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:42:53.132 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:53.133 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:53.134 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:53.911 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:53.911 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:53.912 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:42:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:55 smithi191 bash[24992]: audit 2024-08-31T09:42:53.468641+0000 mgr.a (mgr.14388) 19529 : audit [DBG] from='client.419124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:55.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:55 smithi191 bash[24992]: cluster 2024-08-31T09:42:53.963220+0000 mgr.a (mgr.14388) 19530 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:42:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:55 smithi163 bash[24253]: audit 2024-08-31T09:42:53.468641+0000 mgr.a (mgr.14388) 19529 : audit [DBG] from='client.419124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:55 smithi163 bash[24253]: cluster 2024-08-31T09:42:53.963220+0000 mgr.a (mgr.14388) 19530 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:42:55.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:55 smithi027 bash[22610]: audit 2024-08-31T09:42:53.468641+0000 mgr.a (mgr.14388) 19529 : audit [DBG] from='client.419124 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:42:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:55 smithi027 bash[22610]: cluster 2024-08-31T09:42:53.963220+0000 mgr.a (mgr.14388) 19530 : cluster [DBG] pgmap v13539: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:42:57.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:57 smithi191 bash[24992]: cluster 2024-08-31T09:42:55.964020+0000 mgr.a (mgr.14388) 19531 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:42:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:57 smithi163 bash[24253]: cluster 2024-08-31T09:42:55.964020+0000 mgr.a (mgr.14388) 19531 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:42:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:57 smithi027 bash[22610]: cluster 2024-08-31T09:42:55.964020+0000 mgr.a (mgr.14388) 19531 : cluster [DBG] pgmap v13540: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 33 KiB/s rd, 0 B/s wr, 53 op/s 2024-08-31T09:42:58.913 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:42:58.913 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:42:58.913 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:42:59.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:42:59 smithi191 bash[24992]: cluster 2024-08-31T09:42:57.966018+0000 mgr.a (mgr.14388) 19532 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:42:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:42:59 smithi163 bash[24253]: cluster 2024-08-31T09:42:57.966018+0000 mgr.a (mgr.14388) 19532 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:42:59.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:42:59 smithi027 bash[22610]: cluster 2024-08-31T09:42:57.966018+0000 mgr.a (mgr.14388) 19532 : cluster [DBG] pgmap v13541: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:42:59.670 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:42:59.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:42:59.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:42:59.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:42:59.670 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:01 smithi191 bash[24992]: audit 2024-08-31T09:42:59.245678+0000 mgr.a (mgr.14388) 19533 : audit [DBG] from='client.419202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:01 smithi191 bash[24992]: cluster 2024-08-31T09:42:59.966973+0000 mgr.a (mgr.14388) 19534 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:43:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:01 smithi163 bash[24253]: audit 2024-08-31T09:42:59.245678+0000 mgr.a (mgr.14388) 19533 : audit [DBG] from='client.419202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:01 smithi163 bash[24253]: cluster 2024-08-31T09:42:59.966973+0000 mgr.a (mgr.14388) 19534 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:43:01.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:01 smithi027 bash[22610]: audit 2024-08-31T09:42:59.245678+0000 mgr.a (mgr.14388) 19533 : audit [DBG] from='client.419202 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:01 smithi027 bash[22610]: cluster 2024-08-31T09:42:59.966973+0000 mgr.a (mgr.14388) 19534 : cluster [DBG] pgmap v13542: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:43:03.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:03 smithi191 bash[24992]: cluster 2024-08-31T09:43:01.967778+0000 mgr.a (mgr.14388) 19535 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:43:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:03 smithi163 bash[24253]: cluster 2024-08-31T09:43:01.967778+0000 mgr.a (mgr.14388) 19535 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:43:03.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:03 smithi027 bash[22610]: cluster 2024-08-31T09:43:01.967778+0000 mgr.a (mgr.14388) 19535 : cluster [DBG] pgmap v13543: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 54 op/s 2024-08-31T09:43:04.671 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:43:04.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:43:04.672 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:43:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:05 smithi163 bash[24253]: cluster 2024-08-31T09:43:03.970011+0000 mgr.a (mgr.14388) 19536 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:43:05.451 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:43:05.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:43:05.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:43:05.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:43:05.451 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:05 smithi027 bash[22610]: cluster 2024-08-31T09:43:03.970011+0000 mgr.a (mgr.14388) 19536 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:43:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:05 smithi191 bash[24992]: cluster 2024-08-31T09:43:03.970011+0000 mgr.a (mgr.14388) 19536 : cluster [DBG] pgmap v13544: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 0 B/s wr, 55 op/s 2024-08-31T09:43:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:06 smithi163 bash[24253]: audit 2024-08-31T09:43:05.006604+0000 mgr.a (mgr.14388) 19537 : audit [DBG] from='client.419280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:06 smithi027 bash[22610]: audit 2024-08-31T09:43:05.006604+0000 mgr.a (mgr.14388) 19537 : audit [DBG] from='client.419280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:06 smithi191 bash[24992]: audit 2024-08-31T09:43:05.006604+0000 mgr.a (mgr.14388) 19537 : audit [DBG] from='client.419280 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:07 smithi163 bash[24253]: cluster 2024-08-31T09:43:05.971056+0000 mgr.a (mgr.14388) 19538 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:07 smithi027 bash[22610]: cluster 2024-08-31T09:43:05.971056+0000 mgr.a (mgr.14388) 19538 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:07.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:07 smithi191 bash[24992]: cluster 2024-08-31T09:43:05.971056+0000 mgr.a (mgr.14388) 19538 : cluster [DBG] pgmap v13545: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:08 smithi163 bash[24253]: cluster 2024-08-31T09:43:07.973181+0000 mgr.a (mgr.14388) 19539 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:08 smithi027 bash[22610]: cluster 2024-08-31T09:43:07.973181+0000 mgr.a (mgr.14388) 19539 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:08.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:08 smithi191 bash[24992]: cluster 2024-08-31T09:43:07.973181+0000 mgr.a (mgr.14388) 19539 : cluster [DBG] pgmap v13546: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:10.453 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:43:10.453 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:43:10.454 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:43:11.216 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:43:11.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:43:11.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:43:11.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:43:11.217 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:11.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:11 smithi191 bash[24992]: cluster 2024-08-31T09:43:09.973940+0000 mgr.a (mgr.14388) 19540 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:11.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:11 smithi163 bash[24253]: cluster 2024-08-31T09:43:09.973940+0000 mgr.a (mgr.14388) 19540 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:11.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:11 smithi027 bash[22610]: cluster 2024-08-31T09:43:09.973940+0000 mgr.a (mgr.14388) 19540 : cluster [DBG] pgmap v13547: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:12.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:12 smithi163 bash[24253]: audit 2024-08-31T09:43:10.785694+0000 mgr.a (mgr.14388) 19541 : audit [DBG] from='client.419358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:12.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:12 smithi027 bash[22610]: audit 2024-08-31T09:43:10.785694+0000 mgr.a (mgr.14388) 19541 : audit [DBG] from='client.419358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:12.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:12 smithi191 bash[24992]: audit 2024-08-31T09:43:10.785694+0000 mgr.a (mgr.14388) 19541 : audit [DBG] from='client.419358 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:13.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:13 smithi163 bash[24253]: cluster 2024-08-31T09:43:11.975069+0000 mgr.a (mgr.14388) 19542 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:13.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:13 smithi027 bash[22610]: cluster 2024-08-31T09:43:11.975069+0000 mgr.a (mgr.14388) 19542 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:13.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:13 smithi191 bash[24992]: cluster 2024-08-31T09:43:11.975069+0000 mgr.a (mgr.14388) 19542 : cluster [DBG] pgmap v13548: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:15 smithi163 bash[24253]: cluster 2024-08-31T09:43:13.977363+0000 mgr.a (mgr.14388) 19543 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:15 smithi027 bash[22610]: cluster 2024-08-31T09:43:13.977363+0000 mgr.a (mgr.14388) 19543 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:15.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:15 smithi191 bash[24992]: cluster 2024-08-31T09:43:13.977363+0000 mgr.a (mgr.14388) 19543 : cluster [DBG] pgmap v13549: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:16.218 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:43:16.219 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:43:16.219 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:43:16.976 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:43:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:43:16.976 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:43:16.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:43:16.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:17.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:17 smithi163 bash[24253]: cluster 2024-08-31T09:43:15.978306+0000 mgr.a (mgr.14388) 19544 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:17.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:17 smithi027 bash[22610]: cluster 2024-08-31T09:43:15.978306+0000 mgr.a (mgr.14388) 19544 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:17.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:17 smithi191 bash[24992]: cluster 2024-08-31T09:43:15.978306+0000 mgr.a (mgr.14388) 19544 : cluster [DBG] pgmap v13550: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:18 smithi163 bash[24253]: audit 2024-08-31T09:43:16.551070+0000 mgr.a (mgr.14388) 19545 : audit [DBG] from='client.419433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:18.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:18 smithi027 bash[22610]: audit 2024-08-31T09:43:16.551070+0000 mgr.a (mgr.14388) 19545 : audit [DBG] from='client.419433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:18.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:18 smithi191 bash[24992]: audit 2024-08-31T09:43:16.551070+0000 mgr.a (mgr.14388) 19545 : audit [DBG] from='client.419433 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:19.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:19 smithi163 bash[24253]: cluster 2024-08-31T09:43:17.980736+0000 mgr.a (mgr.14388) 19546 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:19.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:19 smithi027 bash[22610]: cluster 2024-08-31T09:43:17.980736+0000 mgr.a (mgr.14388) 19546 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:19.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:19 smithi191 bash[24992]: cluster 2024-08-31T09:43:17.980736+0000 mgr.a (mgr.14388) 19546 : cluster [DBG] pgmap v13551: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:21.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:21 smithi163 bash[24253]: cluster 2024-08-31T09:43:19.981558+0000 mgr.a (mgr.14388) 19547 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:21.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:21 smithi027 bash[22610]: cluster 2024-08-31T09:43:19.981558+0000 mgr.a (mgr.14388) 19547 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:21.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:21 smithi191 bash[24992]: cluster 2024-08-31T09:43:19.981558+0000 mgr.a (mgr.14388) 19547 : cluster [DBG] pgmap v13552: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:21.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:43:21.978 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:43:21.979 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:43:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:22 smithi163 bash[24253]: cluster 2024-08-31T09:43:21.982262+0000 mgr.a (mgr.14388) 19548 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:22 smithi027 bash[22610]: cluster 2024-08-31T09:43:21.982262+0000 mgr.a (mgr.14388) 19548 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:22.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:22 smithi191 bash[24992]: cluster 2024-08-31T09:43:21.982262+0000 mgr.a (mgr.14388) 19548 : cluster [DBG] pgmap v13553: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:22.741 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:43:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:43:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:43:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:43:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:23.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:23 smithi163 bash[24253]: audit 2024-08-31T09:43:22.316405+0000 mgr.a (mgr.14388) 19549 : audit [DBG] from='client.419511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:23.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:23 smithi027 bash[22610]: audit 2024-08-31T09:43:22.316405+0000 mgr.a (mgr.14388) 19549 : audit [DBG] from='client.419511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:23.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:23 smithi191 bash[24992]: audit 2024-08-31T09:43:22.316405+0000 mgr.a (mgr.14388) 19549 : audit [DBG] from='client.419511 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:24 smithi163 bash[24253]: cluster 2024-08-31T09:43:23.984569+0000 mgr.a (mgr.14388) 19550 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:24 smithi027 bash[22610]: cluster 2024-08-31T09:43:23.984569+0000 mgr.a (mgr.14388) 19550 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:24.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:24 smithi191 bash[24992]: cluster 2024-08-31T09:43:23.984569+0000 mgr.a (mgr.14388) 19550 : cluster [DBG] pgmap v13554: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:27 smithi163 bash[24253]: cluster 2024-08-31T09:43:25.985328+0000 mgr.a (mgr.14388) 19551 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:27.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:27 smithi163 bash[24253]: audit 2024-08-31T09:43:26.540884+0000 mon.a (mon.0) 3483 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:43:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:27 smithi027 bash[22610]: cluster 2024-08-31T09:43:25.985328+0000 mgr.a (mgr.14388) 19551 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:27.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:27 smithi027 bash[22610]: audit 2024-08-31T09:43:26.540884+0000 mon.a (mon.0) 3483 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:43:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:27 smithi191 bash[24992]: cluster 2024-08-31T09:43:25.985328+0000 mgr.a (mgr.14388) 19551 : cluster [DBG] pgmap v13555: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:27.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:27 smithi191 bash[24992]: audit 2024-08-31T09:43:26.540884+0000 mon.a (mon.0) 3483 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:43:27.742 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:43:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:43:27.743 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:43:28.496 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:43:28.496 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:43:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:43:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:43:28.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:29.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:29 smithi163 bash[24253]: cluster 2024-08-31T09:43:27.987222+0000 mgr.a (mgr.14388) 19552 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:29.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:29 smithi027 bash[22610]: cluster 2024-08-31T09:43:27.987222+0000 mgr.a (mgr.14388) 19552 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:29.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:29 smithi191 bash[24992]: cluster 2024-08-31T09:43:27.987222+0000 mgr.a (mgr.14388) 19552 : cluster [DBG] pgmap v13556: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:30 smithi163 bash[24253]: audit 2024-08-31T09:43:28.071553+0000 mgr.a (mgr.14388) 19553 : audit [DBG] from='client.419589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:30 smithi027 bash[22610]: audit 2024-08-31T09:43:28.071553+0000 mgr.a (mgr.14388) 19553 : audit [DBG] from='client.419589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:30.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:30 smithi191 bash[24992]: audit 2024-08-31T09:43:28.071553+0000 mgr.a (mgr.14388) 19553 : audit [DBG] from='client.419589 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:31.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:31 smithi163 bash[24253]: cluster 2024-08-31T09:43:29.988116+0000 mgr.a (mgr.14388) 19554 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:43:31.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:31 smithi027 bash[22610]: cluster 2024-08-31T09:43:29.988116+0000 mgr.a (mgr.14388) 19554 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:43:31.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:31 smithi191 bash[24992]: cluster 2024-08-31T09:43:29.988116+0000 mgr.a (mgr.14388) 19554 : cluster [DBG] pgmap v13557: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:43:33.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: audit 2024-08-31T09:43:31.898659+0000 mon.a (mon.0) 3484 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: audit 2024-08-31T09:43:31.905031+0000 mon.a (mon.0) 3485 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: audit 2024-08-31T09:43:31.918095+0000 mon.a (mon.0) 3486 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: audit 2024-08-31T09:43:31.923943+0000 mon.a (mon.0) 3487 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: audit 2024-08-31T09:43:31.927904+0000 mon.a (mon.0) 3488 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: audit 2024-08-31T09:43:31.931976+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: cluster 2024-08-31T09:43:31.988890+0000 mgr.a (mgr.14388) 19555 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:43:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: audit 2024-08-31T09:43:32.677792+0000 mon.a (mon.0) 3490 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:43:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: audit 2024-08-31T09:43:32.679299+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:43:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: audit 2024-08-31T09:43:32.689831+0000 mon.a (mon.0) 3492 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:32 smithi163 bash[24253]: audit 2024-08-31T09:43:32.695145+0000 mon.a (mon.0) 3493 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:43:33.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: audit 2024-08-31T09:43:31.898659+0000 mon.a (mon.0) 3484 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: audit 2024-08-31T09:43:31.905031+0000 mon.a (mon.0) 3485 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: audit 2024-08-31T09:43:31.918095+0000 mon.a (mon.0) 3486 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: audit 2024-08-31T09:43:31.923943+0000 mon.a (mon.0) 3487 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: audit 2024-08-31T09:43:31.927904+0000 mon.a (mon.0) 3488 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: audit 2024-08-31T09:43:31.931976+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: cluster 2024-08-31T09:43:31.988890+0000 mgr.a (mgr.14388) 19555 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:43:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: audit 2024-08-31T09:43:32.677792+0000 mon.a (mon.0) 3490 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:43:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: audit 2024-08-31T09:43:32.679299+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:43:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: audit 2024-08-31T09:43:32.689831+0000 mon.a (mon.0) 3492 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:32 smithi027 bash[22610]: audit 2024-08-31T09:43:32.695145+0000 mon.a (mon.0) 3493 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:43:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: audit 2024-08-31T09:43:31.898659+0000 mon.a (mon.0) 3484 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: audit 2024-08-31T09:43:31.905031+0000 mon.a (mon.0) 3485 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: audit 2024-08-31T09:43:31.918095+0000 mon.a (mon.0) 3486 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: audit 2024-08-31T09:43:31.923943+0000 mon.a (mon.0) 3487 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: audit 2024-08-31T09:43:31.927904+0000 mon.a (mon.0) 3488 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: audit 2024-08-31T09:43:31.931976+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: cluster 2024-08-31T09:43:31.988890+0000 mgr.a (mgr.14388) 19555 : cluster [DBG] pgmap v13558: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:43:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: audit 2024-08-31T09:43:32.677792+0000 mon.a (mon.0) 3490 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:43:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: audit 2024-08-31T09:43:32.679299+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:43:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: audit 2024-08-31T09:43:32.689831+0000 mon.a (mon.0) 3492 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:43:33.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:32 smithi191 bash[24992]: audit 2024-08-31T09:43:32.695145+0000 mon.a (mon.0) 3493 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:43:33.497 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:43:33.498 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:43:33.498 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:43:33.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:43:33 smithi027 bash[22863]: debug 2024-08-31T09:43:33.451+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:43:33.733 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:43:33 smithi027 bash[22863]: debug 2024-08-31T09:43:33.455+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:43:34.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:33 smithi163 bash[24253]: audit 2024-08-31T09:43:32.697418+0000 mgr.a (mgr.14388) 19556 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:43:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:33 smithi027 bash[22610]: audit 2024-08-31T09:43:32.697418+0000 mgr.a (mgr.14388) 19556 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:43:34.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:43:34.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:43:34.242 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:43:34.243 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:34.243 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:43:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:33 smithi191 bash[24992]: audit 2024-08-31T09:43:32.697418+0000 mgr.a (mgr.14388) 19556 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:43:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:34 smithi163 bash[24253]: audit 2024-08-31T09:43:33.457139+0000 mgr.a (mgr.14388) 19557 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:43:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:34 smithi163 bash[24253]: cephadm 2024-08-31T09:43:33.458748+0000 mgr.a (mgr.14388) 19558 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:43:35.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:34 smithi163 bash[24253]: audit 2024-08-31T09:43:33.824793+0000 mgr.a (mgr.14388) 19559 : audit [DBG] from='client.419766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:35.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:34 smithi163 bash[24253]: cluster 2024-08-31T09:43:33.990226+0000 mgr.a (mgr.14388) 19560 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:43:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:34 smithi027 bash[22610]: audit 2024-08-31T09:43:33.457139+0000 mgr.a (mgr.14388) 19557 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:43:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:34 smithi027 bash[22610]: cephadm 2024-08-31T09:43:33.458748+0000 mgr.a (mgr.14388) 19558 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:43:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:34 smithi027 bash[22610]: audit 2024-08-31T09:43:33.824793+0000 mgr.a (mgr.14388) 19559 : audit [DBG] from='client.419766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:35.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:34 smithi027 bash[22610]: cluster 2024-08-31T09:43:33.990226+0000 mgr.a (mgr.14388) 19560 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:43:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:34 smithi191 bash[24992]: audit 2024-08-31T09:43:33.457139+0000 mgr.a (mgr.14388) 19557 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:43:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:34 smithi191 bash[24992]: cephadm 2024-08-31T09:43:33.458748+0000 mgr.a (mgr.14388) 19558 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:43:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:34 smithi191 bash[24992]: audit 2024-08-31T09:43:33.824793+0000 mgr.a (mgr.14388) 19559 : audit [DBG] from='client.419766 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:35.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:34 smithi191 bash[24992]: cluster 2024-08-31T09:43:33.990226+0000 mgr.a (mgr.14388) 19560 : cluster [DBG] pgmap v13559: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 1 op/s 2024-08-31T09:43:37.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:37 smithi163 bash[24253]: cluster 2024-08-31T09:43:35.991099+0000 mgr.a (mgr.14388) 19561 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:43:37.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:37 smithi027 bash[22610]: cluster 2024-08-31T09:43:35.991099+0000 mgr.a (mgr.14388) 19561 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:43:37.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:37 smithi191 bash[24992]: cluster 2024-08-31T09:43:35.991099+0000 mgr.a (mgr.14388) 19561 : cluster [DBG] pgmap v13560: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-08-31T09:43:39.244 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:43:39.245 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:43:39.245 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:43:39.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:39 smithi163 bash[24253]: cluster 2024-08-31T09:43:37.993213+0000 mgr.a (mgr.14388) 19562 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:39.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:39 smithi027 bash[22610]: cluster 2024-08-31T09:43:37.993213+0000 mgr.a (mgr.14388) 19562 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:39.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:39 smithi191 bash[24992]: cluster 2024-08-31T09:43:37.993213+0000 mgr.a (mgr.14388) 19562 : cluster [DBG] pgmap v13561: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:39.980 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:43:39.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:43:39.980 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:43:39.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:43:39.981 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:41 smithi163 bash[24253]: audit 2024-08-31T09:43:39.565188+0000 mgr.a (mgr.14388) 19563 : audit [DBG] from='client.419844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:41 smithi163 bash[24253]: cluster 2024-08-31T09:43:39.993823+0000 mgr.a (mgr.14388) 19564 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:41 smithi027 bash[22610]: audit 2024-08-31T09:43:39.565188+0000 mgr.a (mgr.14388) 19563 : audit [DBG] from='client.419844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:41 smithi027 bash[22610]: cluster 2024-08-31T09:43:39.993823+0000 mgr.a (mgr.14388) 19564 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:41 smithi191 bash[24992]: audit 2024-08-31T09:43:39.565188+0000 mgr.a (mgr.14388) 19563 : audit [DBG] from='client.419844 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:41 smithi191 bash[24992]: cluster 2024-08-31T09:43:39.993823+0000 mgr.a (mgr.14388) 19564 : cluster [DBG] pgmap v13562: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:43 smithi163 bash[24253]: cluster 2024-08-31T09:43:41.994519+0000 mgr.a (mgr.14388) 19565 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:43 smithi027 bash[22610]: cluster 2024-08-31T09:43:41.994519+0000 mgr.a (mgr.14388) 19565 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:43.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:43 smithi191 bash[24992]: cluster 2024-08-31T09:43:41.994519+0000 mgr.a (mgr.14388) 19565 : cluster [DBG] pgmap v13563: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:44.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:44 smithi163 bash[24253]: cluster 2024-08-31T09:43:43.996772+0000 mgr.a (mgr.14388) 19566 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:44 smithi027 bash[22610]: cluster 2024-08-31T09:43:43.996772+0000 mgr.a (mgr.14388) 19566 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:44 smithi191 bash[24992]: cluster 2024-08-31T09:43:43.996772+0000 mgr.a (mgr.14388) 19566 : cluster [DBG] pgmap v13564: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:44.982 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:43:44.982 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:43:44.983 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:43:45.737 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:43:45.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:43:45.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:43:45.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:43:45.737 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:47 smithi163 bash[24253]: audit 2024-08-31T09:43:45.312755+0000 mgr.a (mgr.14388) 19567 : audit [DBG] from='client.419922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:47.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:47 smithi163 bash[24253]: cluster 2024-08-31T09:43:45.997729+0000 mgr.a (mgr.14388) 19568 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:43:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:47 smithi027 bash[22610]: audit 2024-08-31T09:43:45.312755+0000 mgr.a (mgr.14388) 19567 : audit [DBG] from='client.419922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:47 smithi027 bash[22610]: cluster 2024-08-31T09:43:45.997729+0000 mgr.a (mgr.14388) 19568 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:43:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:47 smithi191 bash[24992]: audit 2024-08-31T09:43:45.312755+0000 mgr.a (mgr.14388) 19567 : audit [DBG] from='client.419922 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:47 smithi191 bash[24992]: cluster 2024-08-31T09:43:45.997729+0000 mgr.a (mgr.14388) 19568 : cluster [DBG] pgmap v13565: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:43:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:49 smithi163 bash[24253]: cluster 2024-08-31T09:43:47.999893+0000 mgr.a (mgr.14388) 19569 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:49 smithi027 bash[22610]: cluster 2024-08-31T09:43:47.999893+0000 mgr.a (mgr.14388) 19569 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:49 smithi191 bash[24992]: cluster 2024-08-31T09:43:47.999893+0000 mgr.a (mgr.14388) 19569 : cluster [DBG] pgmap v13566: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:43:50.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:50 smithi163 bash[24253]: cluster 2024-08-31T09:43:50.000622+0000 mgr.a (mgr.14388) 19570 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:50.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:50 smithi027 bash[22610]: cluster 2024-08-31T09:43:50.000622+0000 mgr.a (mgr.14388) 19570 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:50 smithi191 bash[24992]: cluster 2024-08-31T09:43:50.000622+0000 mgr.a (mgr.14388) 19570 : cluster [DBG] pgmap v13567: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:50.738 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:43:50.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:43:50.739 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:43:51.523 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:43:51.523 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:43:51.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:43:51.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:43:51.524 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:53 smithi163 bash[24253]: audit 2024-08-31T09:43:51.075476+0000 mgr.a (mgr.14388) 19571 : audit [DBG] from='client.420000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:53 smithi163 bash[24253]: cluster 2024-08-31T09:43:52.001539+0000 mgr.a (mgr.14388) 19572 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:53 smithi027 bash[22610]: audit 2024-08-31T09:43:51.075476+0000 mgr.a (mgr.14388) 19571 : audit [DBG] from='client.420000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:53 smithi027 bash[22610]: cluster 2024-08-31T09:43:52.001539+0000 mgr.a (mgr.14388) 19572 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:53 smithi191 bash[24992]: audit 2024-08-31T09:43:51.075476+0000 mgr.a (mgr.14388) 19571 : audit [DBG] from='client.420000 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:53 smithi191 bash[24992]: cluster 2024-08-31T09:43:52.001539+0000 mgr.a (mgr.14388) 19572 : cluster [DBG] pgmap v13568: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:55 smithi163 bash[24253]: cluster 2024-08-31T09:43:54.003924+0000 mgr.a (mgr.14388) 19573 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:55 smithi027 bash[22610]: cluster 2024-08-31T09:43:54.003924+0000 mgr.a (mgr.14388) 19573 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:55 smithi191 bash[24992]: cluster 2024-08-31T09:43:54.003924+0000 mgr.a (mgr.14388) 19573 : cluster [DBG] pgmap v13569: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:56.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:56 smithi163 bash[24253]: cluster 2024-08-31T09:43:56.004706+0000 mgr.a (mgr.14388) 19574 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:56 smithi027 bash[22610]: cluster 2024-08-31T09:43:56.004706+0000 mgr.a (mgr.14388) 19574 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:56.525 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:43:56.525 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:43:56.526 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:43:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:56 smithi191 bash[24992]: cluster 2024-08-31T09:43:56.004706+0000 mgr.a (mgr.14388) 19574 : cluster [DBG] pgmap v13570: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:43:57.272 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:43:57.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:43:57.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:43:57.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:43:57.272 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:43:57.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:57 smithi163 bash[24253]: audit 2024-08-31T09:43:56.858018+0000 mgr.a (mgr.14388) 19575 : audit [DBG] from='client.420075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:57 smithi027 bash[22610]: audit 2024-08-31T09:43:56.858018+0000 mgr.a (mgr.14388) 19575 : audit [DBG] from='client.420075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:57.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:57 smithi191 bash[24992]: audit 2024-08-31T09:43:56.858018+0000 mgr.a (mgr.14388) 19575 : audit [DBG] from='client.420075 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:43:58.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:43:58 smithi163 bash[24253]: cluster 2024-08-31T09:43:58.006952+0000 mgr.a (mgr.14388) 19576 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:43:58 smithi027 bash[22610]: cluster 2024-08-31T09:43:58.006952+0000 mgr.a (mgr.14388) 19576 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:43:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:43:58 smithi191 bash[24992]: cluster 2024-08-31T09:43:58.006952+0000 mgr.a (mgr.14388) 19576 : cluster [DBG] pgmap v13571: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:00 smithi163 bash[24253]: cluster 2024-08-31T09:44:00.007747+0000 mgr.a (mgr.14388) 19577 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:00 smithi027 bash[22610]: cluster 2024-08-31T09:44:00.007747+0000 mgr.a (mgr.14388) 19577 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:00 smithi191 bash[24992]: cluster 2024-08-31T09:44:00.007747+0000 mgr.a (mgr.14388) 19577 : cluster [DBG] pgmap v13572: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:02.273 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:44:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:44:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:44:03.053 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:44:03.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:44:03.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:44:03.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:44:03.053 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:44:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:03 smithi163 bash[24253]: cluster 2024-08-31T09:44:02.008492+0000 mgr.a (mgr.14388) 19578 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:03 smithi027 bash[22610]: cluster 2024-08-31T09:44:02.008492+0000 mgr.a (mgr.14388) 19578 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:03 smithi191 bash[24992]: cluster 2024-08-31T09:44:02.008492+0000 mgr.a (mgr.14388) 19578 : cluster [DBG] pgmap v13573: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:04.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:04 smithi163 bash[24253]: audit 2024-08-31T09:44:02.611606+0000 mgr.a (mgr.14388) 19579 : audit [DBG] from='client.420150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:04.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:04 smithi163 bash[24253]: cluster 2024-08-31T09:44:04.011246+0000 mgr.a (mgr.14388) 19580 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:04 smithi027 bash[22610]: audit 2024-08-31T09:44:02.611606+0000 mgr.a (mgr.14388) 19579 : audit [DBG] from='client.420150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:04.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:04 smithi027 bash[22610]: cluster 2024-08-31T09:44:04.011246+0000 mgr.a (mgr.14388) 19580 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:04 smithi191 bash[24992]: audit 2024-08-31T09:44:02.611606+0000 mgr.a (mgr.14388) 19579 : audit [DBG] from='client.420150 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:04.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:04 smithi191 bash[24992]: cluster 2024-08-31T09:44:04.011246+0000 mgr.a (mgr.14388) 19580 : cluster [DBG] pgmap v13574: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:06 smithi163 bash[24253]: cluster 2024-08-31T09:44:06.011967+0000 mgr.a (mgr.14388) 19581 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:44:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:06 smithi027 bash[22610]: cluster 2024-08-31T09:44:06.011967+0000 mgr.a (mgr.14388) 19581 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:44:06.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:06 smithi191 bash[24992]: cluster 2024-08-31T09:44:06.011967+0000 mgr.a (mgr.14388) 19581 : cluster [DBG] pgmap v13575: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:44:08.055 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:44:08.055 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:44:08.056 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:44:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:08 smithi163 bash[24253]: cluster 2024-08-31T09:44:08.013860+0000 mgr.a (mgr.14388) 19582 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:08.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:08 smithi027 bash[22610]: cluster 2024-08-31T09:44:08.013860+0000 mgr.a (mgr.14388) 19582 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:08 smithi191 bash[24992]: cluster 2024-08-31T09:44:08.013860+0000 mgr.a (mgr.14388) 19582 : cluster [DBG] pgmap v13576: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:08.819 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:44:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:44:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:44:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:44:08.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:44:09.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:09 smithi163 bash[24253]: audit 2024-08-31T09:44:08.391034+0000 mgr.a (mgr.14388) 19583 : audit [DBG] from='client.420228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:09.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:09 smithi027 bash[22610]: audit 2024-08-31T09:44:08.391034+0000 mgr.a (mgr.14388) 19583 : audit [DBG] from='client.420228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:09.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:09 smithi191 bash[24992]: audit 2024-08-31T09:44:08.391034+0000 mgr.a (mgr.14388) 19583 : audit [DBG] from='client.420228 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:10.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:10 smithi163 bash[24253]: cluster 2024-08-31T09:44:10.014791+0000 mgr.a (mgr.14388) 19584 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:44:10.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:10 smithi027 bash[22610]: cluster 2024-08-31T09:44:10.014791+0000 mgr.a (mgr.14388) 19584 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:44:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:10 smithi191 bash[24992]: cluster 2024-08-31T09:44:10.014791+0000 mgr.a (mgr.14388) 19584 : cluster [DBG] pgmap v13577: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:44:12.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:12 smithi163 bash[24253]: cluster 2024-08-31T09:44:12.015605+0000 mgr.a (mgr.14388) 19585 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:44:12.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:12 smithi027 bash[22610]: cluster 2024-08-31T09:44:12.015605+0000 mgr.a (mgr.14388) 19585 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:44:12.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:12 smithi191 bash[24992]: cluster 2024-08-31T09:44:12.015605+0000 mgr.a (mgr.14388) 19585 : cluster [DBG] pgmap v13578: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:44:13.824 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:44:13.825 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:44:13.825 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:44:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:14 smithi163 bash[24253]: cluster 2024-08-31T09:44:14.017925+0000 mgr.a (mgr.14388) 19586 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:14.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:14 smithi027 bash[22610]: cluster 2024-08-31T09:44:14.017925+0000 mgr.a (mgr.14388) 19586 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:14 smithi191 bash[24992]: cluster 2024-08-31T09:44:14.017925+0000 mgr.a (mgr.14388) 19586 : cluster [DBG] pgmap v13579: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:14.613 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:44:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:44:14.613 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:44:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:44:14.614 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:44:15.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:15 smithi163 bash[24253]: audit 2024-08-31T09:44:14.166774+0000 mgr.a (mgr.14388) 19587 : audit [DBG] from='client.420303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:15.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:15 smithi027 bash[22610]: audit 2024-08-31T09:44:14.166774+0000 mgr.a (mgr.14388) 19587 : audit [DBG] from='client.420303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:15.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:15 smithi191 bash[24992]: audit 2024-08-31T09:44:14.166774+0000 mgr.a (mgr.14388) 19587 : audit [DBG] from='client.420303 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:16.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:16 smithi163 bash[24253]: cluster 2024-08-31T09:44:16.018876+0000 mgr.a (mgr.14388) 19588 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:16 smithi027 bash[22610]: cluster 2024-08-31T09:44:16.018876+0000 mgr.a (mgr.14388) 19588 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:16.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:16 smithi191 bash[24992]: cluster 2024-08-31T09:44:16.018876+0000 mgr.a (mgr.14388) 19588 : cluster [DBG] pgmap v13580: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:18 smithi163 bash[24253]: cluster 2024-08-31T09:44:18.020974+0000 mgr.a (mgr.14388) 19589 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:18 smithi027 bash[22610]: cluster 2024-08-31T09:44:18.020974+0000 mgr.a (mgr.14388) 19589 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:18 smithi191 bash[24992]: cluster 2024-08-31T09:44:18.020974+0000 mgr.a (mgr.14388) 19589 : cluster [DBG] pgmap v13581: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:19.615 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:44:19.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:44:19.616 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:44:20.355 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:44:20.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:44:20.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:44:20.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:44:20.355 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:44:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:20 smithi163 bash[24253]: audit 2024-08-31T09:44:19.947005+0000 mgr.a (mgr.14388) 19590 : audit [DBG] from='client.420381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:20 smithi163 bash[24253]: cluster 2024-08-31T09:44:20.021509+0000 mgr.a (mgr.14388) 19591 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:20 smithi027 bash[22610]: audit 2024-08-31T09:44:19.947005+0000 mgr.a (mgr.14388) 19590 : audit [DBG] from='client.420381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:20.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:20 smithi027 bash[22610]: cluster 2024-08-31T09:44:20.021509+0000 mgr.a (mgr.14388) 19591 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:20 smithi191 bash[24992]: audit 2024-08-31T09:44:19.947005+0000 mgr.a (mgr.14388) 19590 : audit [DBG] from='client.420381 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:20 smithi191 bash[24992]: cluster 2024-08-31T09:44:20.021509+0000 mgr.a (mgr.14388) 19591 : cluster [DBG] pgmap v13582: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:22 smithi163 bash[24253]: cluster 2024-08-31T09:44:22.022352+0000 mgr.a (mgr.14388) 19592 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:22.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:22 smithi027 bash[22610]: cluster 2024-08-31T09:44:22.022352+0000 mgr.a (mgr.14388) 19592 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:22 smithi191 bash[24992]: cluster 2024-08-31T09:44:22.022352+0000 mgr.a (mgr.14388) 19592 : cluster [DBG] pgmap v13583: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:24 smithi163 bash[24253]: cluster 2024-08-31T09:44:24.024581+0000 mgr.a (mgr.14388) 19593 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:24.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:24 smithi027 bash[22610]: cluster 2024-08-31T09:44:24.024581+0000 mgr.a (mgr.14388) 19593 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:24 smithi191 bash[24992]: cluster 2024-08-31T09:44:24.024581+0000 mgr.a (mgr.14388) 19593 : cluster [DBG] pgmap v13584: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:25.356 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:44:25.357 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:44:25.358 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:44:26.145 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:44:26.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:44:26.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:44:26.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:44:26.145 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:44:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:26 smithi163 bash[24253]: audit 2024-08-31T09:44:25.697933+0000 mgr.a (mgr.14388) 19594 : audit [DBG] from='client.420459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:26 smithi163 bash[24253]: cluster 2024-08-31T09:44:26.025197+0000 mgr.a (mgr.14388) 19595 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:26.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:26 smithi027 bash[22610]: audit 2024-08-31T09:44:25.697933+0000 mgr.a (mgr.14388) 19594 : audit [DBG] from='client.420459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:26 smithi027 bash[22610]: cluster 2024-08-31T09:44:26.025197+0000 mgr.a (mgr.14388) 19595 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:26 smithi191 bash[24992]: audit 2024-08-31T09:44:25.697933+0000 mgr.a (mgr.14388) 19594 : audit [DBG] from='client.420459 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:26 smithi191 bash[24992]: cluster 2024-08-31T09:44:26.025197+0000 mgr.a (mgr.14388) 19595 : cluster [DBG] pgmap v13585: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:28 smithi163 bash[24253]: cluster 2024-08-31T09:44:28.027418+0000 mgr.a (mgr.14388) 19596 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:28 smithi027 bash[22610]: cluster 2024-08-31T09:44:28.027418+0000 mgr.a (mgr.14388) 19596 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:28 smithi191 bash[24992]: cluster 2024-08-31T09:44:28.027418+0000 mgr.a (mgr.14388) 19596 : cluster [DBG] pgmap v13586: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:30 smithi163 bash[24253]: cluster 2024-08-31T09:44:30.028220+0000 mgr.a (mgr.14388) 19597 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:30 smithi027 bash[22610]: cluster 2024-08-31T09:44:30.028220+0000 mgr.a (mgr.14388) 19597 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:30 smithi191 bash[24992]: cluster 2024-08-31T09:44:30.028220+0000 mgr.a (mgr.14388) 19597 : cluster [DBG] pgmap v13587: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:31.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:44:31.147 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:44:31.147 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:44:31.929 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:44:31.929 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:44:31.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:44:31.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:44:31.930 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:44:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:32 smithi163 bash[24253]: audit 2024-08-31T09:44:31.482198+0000 mgr.a (mgr.14388) 19598 : audit [DBG] from='client.420534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:32 smithi163 bash[24253]: cluster 2024-08-31T09:44:32.029123+0000 mgr.a (mgr.14388) 19599 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:32 smithi027 bash[22610]: audit 2024-08-31T09:44:31.482198+0000 mgr.a (mgr.14388) 19598 : audit [DBG] from='client.420534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:32 smithi027 bash[22610]: cluster 2024-08-31T09:44:32.029123+0000 mgr.a (mgr.14388) 19599 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:32 smithi191 bash[24992]: audit 2024-08-31T09:44:31.482198+0000 mgr.a (mgr.14388) 19598 : audit [DBG] from='client.420534 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:32 smithi191 bash[24992]: cluster 2024-08-31T09:44:32.029123+0000 mgr.a (mgr.14388) 19599 : cluster [DBG] pgmap v13588: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:33 smithi163 bash[24253]: audit 2024-08-31T09:44:33.512794+0000 mon.a (mon.0) 3494 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:44:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:33 smithi027 bash[22610]: audit 2024-08-31T09:44:33.512794+0000 mon.a (mon.0) 3494 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:44:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:33 smithi191 bash[24992]: audit 2024-08-31T09:44:33.512794+0000 mon.a (mon.0) 3494 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:44:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:34 smithi163 bash[24253]: cluster 2024-08-31T09:44:34.031278+0000 mgr.a (mgr.14388) 19600 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:34 smithi163 bash[24253]: audit 2024-08-31T09:44:34.348541+0000 mon.a (mon.0) 3495 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:44:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:34 smithi163 bash[24253]: audit 2024-08-31T09:44:34.350349+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:44:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:34 smithi163 bash[24253]: audit 2024-08-31T09:44:34.360997+0000 mon.a (mon.0) 3497 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:44:34.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:34 smithi163 bash[24253]: audit 2024-08-31T09:44:34.365997+0000 mon.a (mon.0) 3498 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:44:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:34 smithi027 bash[22610]: cluster 2024-08-31T09:44:34.031278+0000 mgr.a (mgr.14388) 19600 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:34 smithi027 bash[22610]: audit 2024-08-31T09:44:34.348541+0000 mon.a (mon.0) 3495 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:44:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:34 smithi027 bash[22610]: audit 2024-08-31T09:44:34.350349+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:44:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:34 smithi027 bash[22610]: audit 2024-08-31T09:44:34.360997+0000 mon.a (mon.0) 3497 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:44:34.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:34 smithi027 bash[22610]: audit 2024-08-31T09:44:34.365997+0000 mon.a (mon.0) 3498 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:44:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:34 smithi191 bash[24992]: cluster 2024-08-31T09:44:34.031278+0000 mgr.a (mgr.14388) 19600 : cluster [DBG] pgmap v13589: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:34 smithi191 bash[24992]: audit 2024-08-31T09:44:34.348541+0000 mon.a (mon.0) 3495 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:44:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:34 smithi191 bash[24992]: audit 2024-08-31T09:44:34.350349+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:44:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:34 smithi191 bash[24992]: audit 2024-08-31T09:44:34.360997+0000 mon.a (mon.0) 3497 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:44:35.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:34 smithi191 bash[24992]: audit 2024-08-31T09:44:34.365997+0000 mon.a (mon.0) 3498 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:44:35.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:44:35 smithi027 bash[22863]: debug 2024-08-31T09:44:35.114+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:44:35.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:44:35 smithi027 bash[22863]: debug 2024-08-31T09:44:35.118+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:44:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:35 smithi163 bash[24253]: audit 2024-08-31T09:44:34.368334+0000 mgr.a (mgr.14388) 19601 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:44:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:35 smithi027 bash[22610]: audit 2024-08-31T09:44:34.368334+0000 mgr.a (mgr.14388) 19601 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:44:36.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:35 smithi191 bash[24992]: audit 2024-08-31T09:44:34.368334+0000 mgr.a (mgr.14388) 19601 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:44:36.931 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:44:36.932 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:44:36.932 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:44:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:36 smithi163 bash[24253]: audit 2024-08-31T09:44:35.117915+0000 mgr.a (mgr.14388) 19602 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:44:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:36 smithi163 bash[24253]: cephadm 2024-08-31T09:44:35.119339+0000 mgr.a (mgr.14388) 19603 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:44:36.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:36 smithi163 bash[24253]: cluster 2024-08-31T09:44:36.032189+0000 mgr.a (mgr.14388) 19604 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:36 smithi027 bash[22610]: audit 2024-08-31T09:44:35.117915+0000 mgr.a (mgr.14388) 19602 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:44:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:36 smithi027 bash[22610]: cephadm 2024-08-31T09:44:35.119339+0000 mgr.a (mgr.14388) 19603 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:44:36.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:36 smithi027 bash[22610]: cluster 2024-08-31T09:44:36.032189+0000 mgr.a (mgr.14388) 19604 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:36 smithi191 bash[24992]: audit 2024-08-31T09:44:35.117915+0000 mgr.a (mgr.14388) 19602 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:44:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:36 smithi191 bash[24992]: cephadm 2024-08-31T09:44:35.119339+0000 mgr.a (mgr.14388) 19603 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:44:37.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:36 smithi191 bash[24992]: cluster 2024-08-31T09:44:36.032189+0000 mgr.a (mgr.14388) 19604 : cluster [DBG] pgmap v13590: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:37.703 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:44:37.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:44:37.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:44:37.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:44:37.703 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:44:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:38 smithi163 bash[24253]: audit 2024-08-31T09:44:37.260829+0000 mgr.a (mgr.14388) 19605 : audit [DBG] from='client.420714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:38 smithi163 bash[24253]: cluster 2024-08-31T09:44:38.034450+0000 mgr.a (mgr.14388) 19606 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:38.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:38 smithi027 bash[22610]: audit 2024-08-31T09:44:37.260829+0000 mgr.a (mgr.14388) 19605 : audit [DBG] from='client.420714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:38 smithi027 bash[22610]: cluster 2024-08-31T09:44:38.034450+0000 mgr.a (mgr.14388) 19606 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:38 smithi191 bash[24992]: audit 2024-08-31T09:44:37.260829+0000 mgr.a (mgr.14388) 19605 : audit [DBG] from='client.420714 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:38 smithi191 bash[24992]: cluster 2024-08-31T09:44:38.034450+0000 mgr.a (mgr.14388) 19606 : cluster [DBG] pgmap v13591: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:40.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:40 smithi163 bash[24253]: cluster 2024-08-31T09:44:40.035240+0000 mgr.a (mgr.14388) 19607 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:40 smithi027 bash[22610]: cluster 2024-08-31T09:44:40.035240+0000 mgr.a (mgr.14388) 19607 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:40 smithi191 bash[24992]: cluster 2024-08-31T09:44:40.035240+0000 mgr.a (mgr.14388) 19607 : cluster [DBG] pgmap v13592: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:42.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:42 smithi163 bash[24253]: cluster 2024-08-31T09:44:42.035999+0000 mgr.a (mgr.14388) 19608 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:42.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:42 smithi027 bash[22610]: cluster 2024-08-31T09:44:42.035999+0000 mgr.a (mgr.14388) 19608 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:42 smithi191 bash[24992]: cluster 2024-08-31T09:44:42.035999+0000 mgr.a (mgr.14388) 19608 : cluster [DBG] pgmap v13593: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:42.704 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:44:42.705 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:44:42.705 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:44:43.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:43 smithi163 bash[24253]: audit 2024-08-31T09:44:43.041025+0000 mgr.a (mgr.14388) 19609 : audit [DBG] from='client.420789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:43.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:43 smithi027 bash[22610]: audit 2024-08-31T09:44:43.041025+0000 mgr.a (mgr.14388) 19609 : audit [DBG] from='client.420789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:43.487 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:44:43.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:44:43.487 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:44:43.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:44:43.488 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:44:43.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:43 smithi191 bash[24992]: audit 2024-08-31T09:44:43.041025+0000 mgr.a (mgr.14388) 19609 : audit [DBG] from='client.420789 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:44.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:44 smithi163 bash[24253]: cluster 2024-08-31T09:44:44.038805+0000 mgr.a (mgr.14388) 19610 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:44.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:44 smithi027 bash[22610]: cluster 2024-08-31T09:44:44.038805+0000 mgr.a (mgr.14388) 19610 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:44.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:44 smithi191 bash[24992]: cluster 2024-08-31T09:44:44.038805+0000 mgr.a (mgr.14388) 19610 : cluster [DBG] pgmap v13594: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:46 smithi163 bash[24253]: cluster 2024-08-31T09:44:46.039515+0000 mgr.a (mgr.14388) 19611 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:44:46.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:46 smithi027 bash[22610]: cluster 2024-08-31T09:44:46.039515+0000 mgr.a (mgr.14388) 19611 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:44:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:46 smithi191 bash[24992]: cluster 2024-08-31T09:44:46.039515+0000 mgr.a (mgr.14388) 19611 : cluster [DBG] pgmap v13595: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:44:48.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:48 smithi163 bash[24253]: cluster 2024-08-31T09:44:48.041546+0000 mgr.a (mgr.14388) 19612 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:48.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:48 smithi027 bash[22610]: cluster 2024-08-31T09:44:48.041546+0000 mgr.a (mgr.14388) 19612 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:48.489 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:44:48.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:44:48.490 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:44:48.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:48 smithi191 bash[24992]: cluster 2024-08-31T09:44:48.041546+0000 mgr.a (mgr.14388) 19612 : cluster [DBG] pgmap v13596: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:44:49.261 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:44:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:44:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:44:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:44:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:44:49.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:49 smithi163 bash[24253]: audit 2024-08-31T09:44:48.826628+0000 mgr.a (mgr.14388) 19613 : audit [DBG] from='client.420867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:49.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:49 smithi027 bash[22610]: audit 2024-08-31T09:44:48.826628+0000 mgr.a (mgr.14388) 19613 : audit [DBG] from='client.420867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:49.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:49 smithi191 bash[24992]: audit 2024-08-31T09:44:48.826628+0000 mgr.a (mgr.14388) 19613 : audit [DBG] from='client.420867 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:50.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:50 smithi163 bash[24253]: cluster 2024-08-31T09:44:50.042516+0000 mgr.a (mgr.14388) 19614 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:44:50.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:50 smithi027 bash[22610]: cluster 2024-08-31T09:44:50.042516+0000 mgr.a (mgr.14388) 19614 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:44:50.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:50 smithi191 bash[24992]: cluster 2024-08-31T09:44:50.042516+0000 mgr.a (mgr.14388) 19614 : cluster [DBG] pgmap v13597: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:44:52.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:52 smithi163 bash[24253]: cluster 2024-08-31T09:44:52.043301+0000 mgr.a (mgr.14388) 19615 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:44:52.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:52 smithi027 bash[22610]: cluster 2024-08-31T09:44:52.043301+0000 mgr.a (mgr.14388) 19615 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:44:52.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:52 smithi191 bash[24992]: cluster 2024-08-31T09:44:52.043301+0000 mgr.a (mgr.14388) 19615 : cluster [DBG] pgmap v13598: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:44:54.263 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:44:54.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:44:54.264 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:44:54.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:54 smithi163 bash[24253]: cluster 2024-08-31T09:44:54.045464+0000 mgr.a (mgr.14388) 19616 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:54.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:54 smithi027 bash[22610]: cluster 2024-08-31T09:44:54.045464+0000 mgr.a (mgr.14388) 19616 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:54.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:54 smithi191 bash[24992]: cluster 2024-08-31T09:44:54.045464+0000 mgr.a (mgr.14388) 19616 : cluster [DBG] pgmap v13599: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:55.041 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:44:55.041 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:44:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:44:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:44:55.042 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:44:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:55 smithi163 bash[24253]: audit 2024-08-31T09:44:54.599903+0000 mgr.a (mgr.14388) 19617 : audit [DBG] from='client.420942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:55 smithi027 bash[22610]: audit 2024-08-31T09:44:54.599903+0000 mgr.a (mgr.14388) 19617 : audit [DBG] from='client.420942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:55 smithi191 bash[24992]: audit 2024-08-31T09:44:54.599903+0000 mgr.a (mgr.14388) 19617 : audit [DBG] from='client.420942 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:44:56.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:56 smithi163 bash[24253]: cluster 2024-08-31T09:44:56.046569+0000 mgr.a (mgr.14388) 19618 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:56.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:56 smithi027 bash[22610]: cluster 2024-08-31T09:44:56.046569+0000 mgr.a (mgr.14388) 19618 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:56.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:56 smithi191 bash[24992]: cluster 2024-08-31T09:44:56.046569+0000 mgr.a (mgr.14388) 19618 : cluster [DBG] pgmap v13600: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:44:58.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:44:58 smithi163 bash[24253]: cluster 2024-08-31T09:44:58.048872+0000 mgr.a (mgr.14388) 19619 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:58.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:44:58 smithi027 bash[22610]: cluster 2024-08-31T09:44:58.048872+0000 mgr.a (mgr.14388) 19619 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:44:58.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:44:58 smithi191 bash[24992]: cluster 2024-08-31T09:44:58.048872+0000 mgr.a (mgr.14388) 19619 : cluster [DBG] pgmap v13601: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:00.043 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:00.044 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:00.044 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:00 smithi163 bash[24253]: cluster 2024-08-31T09:45:00.049587+0000 mgr.a (mgr.14388) 19620 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:00.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:00 smithi027 bash[22610]: cluster 2024-08-31T09:45:00.049587+0000 mgr.a (mgr.14388) 19620 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:00.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:00 smithi191 bash[24992]: cluster 2024-08-31T09:45:00.049587+0000 mgr.a (mgr.14388) 19620 : cluster [DBG] pgmap v13602: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:00.834 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:00.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:00.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:00.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:00.834 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:01.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:01 smithi191 bash[24992]: audit 2024-08-31T09:45:00.377760+0000 mgr.a (mgr.14388) 19621 : audit [DBG] from='client.421020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:01 smithi163 bash[24253]: audit 2024-08-31T09:45:00.377760+0000 mgr.a (mgr.14388) 19621 : audit [DBG] from='client.421020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:01 smithi027 bash[22610]: audit 2024-08-31T09:45:00.377760+0000 mgr.a (mgr.14388) 19621 : audit [DBG] from='client.421020 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:02 smithi163 bash[24253]: cluster 2024-08-31T09:45:02.050564+0000 mgr.a (mgr.14388) 19622 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:02.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:02 smithi027 bash[22610]: cluster 2024-08-31T09:45:02.050564+0000 mgr.a (mgr.14388) 19622 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:02.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:02 smithi191 bash[24992]: cluster 2024-08-31T09:45:02.050564+0000 mgr.a (mgr.14388) 19622 : cluster [DBG] pgmap v13603: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:04.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:04 smithi163 bash[24253]: cluster 2024-08-31T09:45:04.052833+0000 mgr.a (mgr.14388) 19623 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:04.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:04 smithi027 bash[22610]: cluster 2024-08-31T09:45:04.052833+0000 mgr.a (mgr.14388) 19623 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:04.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:04 smithi191 bash[24992]: cluster 2024-08-31T09:45:04.052833+0000 mgr.a (mgr.14388) 19623 : cluster [DBG] pgmap v13604: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:05.836 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:06.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:06 smithi163 bash[24253]: cluster 2024-08-31T09:45:06.053615+0000 mgr.a (mgr.14388) 19624 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:06.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:06 smithi027 bash[22610]: cluster 2024-08-31T09:45:06.053615+0000 mgr.a (mgr.14388) 19624 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:06.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:06 smithi191 bash[24992]: cluster 2024-08-31T09:45:06.053615+0000 mgr.a (mgr.14388) 19624 : cluster [DBG] pgmap v13605: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:06.619 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:06.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:06.619 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:06.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:06.620 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:07.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:07 smithi163 bash[24253]: audit 2024-08-31T09:45:06.173628+0000 mgr.a (mgr.14388) 19625 : audit [DBG] from='client.421098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:07.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:07 smithi027 bash[22610]: audit 2024-08-31T09:45:06.173628+0000 mgr.a (mgr.14388) 19625 : audit [DBG] from='client.421098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:07.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:07 smithi191 bash[24992]: audit 2024-08-31T09:45:06.173628+0000 mgr.a (mgr.14388) 19625 : audit [DBG] from='client.421098 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:08.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:08 smithi163 bash[24253]: cluster 2024-08-31T09:45:08.056312+0000 mgr.a (mgr.14388) 19626 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:08.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:08 smithi027 bash[22610]: cluster 2024-08-31T09:45:08.056312+0000 mgr.a (mgr.14388) 19626 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:08.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:08 smithi191 bash[24992]: cluster 2024-08-31T09:45:08.056312+0000 mgr.a (mgr.14388) 19626 : cluster [DBG] pgmap v13606: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:10.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:10 smithi163 bash[24253]: cluster 2024-08-31T09:45:10.057130+0000 mgr.a (mgr.14388) 19627 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:10.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:10 smithi027 bash[22610]: cluster 2024-08-31T09:45:10.057130+0000 mgr.a (mgr.14388) 19627 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:10.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:10 smithi191 bash[24992]: cluster 2024-08-31T09:45:10.057130+0000 mgr.a (mgr.14388) 19627 : cluster [DBG] pgmap v13607: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:11.621 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:11.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:11.622 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:12.370 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:12.371 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:12 smithi163 bash[24253]: audit 2024-08-31T09:45:11.951220+0000 mgr.a (mgr.14388) 19628 : audit [DBG] from='client.421173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:12.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:12 smithi163 bash[24253]: cluster 2024-08-31T09:45:12.057615+0000 mgr.a (mgr.14388) 19629 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:12.732 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:12 smithi027 bash[22610]: audit 2024-08-31T09:45:11.951220+0000 mgr.a (mgr.14388) 19628 : audit [DBG] from='client.421173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:12.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:12 smithi027 bash[22610]: cluster 2024-08-31T09:45:12.057615+0000 mgr.a (mgr.14388) 19629 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:12 smithi191 bash[24992]: audit 2024-08-31T09:45:11.951220+0000 mgr.a (mgr.14388) 19628 : audit [DBG] from='client.421173 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:12.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:12 smithi191 bash[24992]: cluster 2024-08-31T09:45:12.057615+0000 mgr.a (mgr.14388) 19629 : cluster [DBG] pgmap v13608: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:14.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:14 smithi163 bash[24253]: cluster 2024-08-31T09:45:14.060059+0000 mgr.a (mgr.14388) 19630 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:14.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:14 smithi027 bash[22610]: cluster 2024-08-31T09:45:14.060059+0000 mgr.a (mgr.14388) 19630 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:14.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:14 smithi191 bash[24992]: cluster 2024-08-31T09:45:14.060059+0000 mgr.a (mgr.14388) 19630 : cluster [DBG] pgmap v13609: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:16.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:16 smithi163 bash[24253]: cluster 2024-08-31T09:45:16.061025+0000 mgr.a (mgr.14388) 19631 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:16.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:16 smithi027 bash[22610]: cluster 2024-08-31T09:45:16.061025+0000 mgr.a (mgr.14388) 19631 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:16.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:16 smithi191 bash[24992]: cluster 2024-08-31T09:45:16.061025+0000 mgr.a (mgr.14388) 19631 : cluster [DBG] pgmap v13610: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:17.372 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:17.372 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:17.373 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:18.135 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:18.135 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:18 smithi163 bash[24253]: audit 2024-08-31T09:45:17.707315+0000 mgr.a (mgr.14388) 19632 : audit [DBG] from='client.421245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:18.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:18 smithi163 bash[24253]: cluster 2024-08-31T09:45:18.062384+0000 mgr.a (mgr.14388) 19633 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:18 smithi027 bash[22610]: audit 2024-08-31T09:45:17.707315+0000 mgr.a (mgr.14388) 19632 : audit [DBG] from='client.421245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:18.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:18 smithi027 bash[22610]: cluster 2024-08-31T09:45:18.062384+0000 mgr.a (mgr.14388) 19633 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:18 smithi191 bash[24992]: audit 2024-08-31T09:45:17.707315+0000 mgr.a (mgr.14388) 19632 : audit [DBG] from='client.421245 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:18.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:18 smithi191 bash[24992]: cluster 2024-08-31T09:45:18.062384+0000 mgr.a (mgr.14388) 19633 : cluster [DBG] pgmap v13611: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:20.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:20 smithi163 bash[24253]: cluster 2024-08-31T09:45:20.063151+0000 mgr.a (mgr.14388) 19634 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:45:20.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:20 smithi027 bash[22610]: cluster 2024-08-31T09:45:20.063151+0000 mgr.a (mgr.14388) 19634 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:45:20.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:20 smithi191 bash[24992]: cluster 2024-08-31T09:45:20.063151+0000 mgr.a (mgr.14388) 19634 : cluster [DBG] pgmap v13612: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:45:22.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:22 smithi163 bash[24253]: cluster 2024-08-31T09:45:22.063858+0000 mgr.a (mgr.14388) 19635 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:45:22.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:22 smithi027 bash[22610]: cluster 2024-08-31T09:45:22.063858+0000 mgr.a (mgr.14388) 19635 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:45:22.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:22 smithi191 bash[24992]: cluster 2024-08-31T09:45:22.063858+0000 mgr.a (mgr.14388) 19635 : cluster [DBG] pgmap v13613: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:45:23.136 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:23.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:23.137 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:23.892 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:23.892 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:24 smithi163 bash[24253]: audit 2024-08-31T09:45:23.467347+0000 mgr.a (mgr.14388) 19636 : audit [DBG] from='client.421317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:24.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:24 smithi163 bash[24253]: cluster 2024-08-31T09:45:24.066635+0000 mgr.a (mgr.14388) 19637 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:24 smithi027 bash[22610]: audit 2024-08-31T09:45:23.467347+0000 mgr.a (mgr.14388) 19636 : audit [DBG] from='client.421317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:24.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:24 smithi027 bash[22610]: cluster 2024-08-31T09:45:24.066635+0000 mgr.a (mgr.14388) 19637 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:24 smithi191 bash[24992]: audit 2024-08-31T09:45:23.467347+0000 mgr.a (mgr.14388) 19636 : audit [DBG] from='client.421317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:24.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:24 smithi191 bash[24992]: cluster 2024-08-31T09:45:24.066635+0000 mgr.a (mgr.14388) 19637 : cluster [DBG] pgmap v13614: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:26.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:26 smithi163 bash[24253]: cluster 2024-08-31T09:45:26.067450+0000 mgr.a (mgr.14388) 19638 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:45:26.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:26 smithi027 bash[22610]: cluster 2024-08-31T09:45:26.067450+0000 mgr.a (mgr.14388) 19638 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:45:26.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:26 smithi191 bash[24992]: cluster 2024-08-31T09:45:26.067450+0000 mgr.a (mgr.14388) 19638 : cluster [DBG] pgmap v13615: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:45:28.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:28 smithi163 bash[24253]: cluster 2024-08-31T09:45:28.069354+0000 mgr.a (mgr.14388) 19639 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:28.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:28 smithi027 bash[22610]: cluster 2024-08-31T09:45:28.069354+0000 mgr.a (mgr.14388) 19639 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:28.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:28 smithi191 bash[24992]: cluster 2024-08-31T09:45:28.069354+0000 mgr.a (mgr.14388) 19639 : cluster [DBG] pgmap v13616: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:28.893 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:28.894 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:28.895 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:29.648 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:29.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:29.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:29.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:29.649 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:30 smithi163 bash[24253]: audit 2024-08-31T09:45:29.225137+0000 mgr.a (mgr.14388) 19640 : audit [DBG] from='client.421395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:30.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:30 smithi163 bash[24253]: cluster 2024-08-31T09:45:30.070335+0000 mgr.a (mgr.14388) 19641 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:30 smithi027 bash[22610]: audit 2024-08-31T09:45:29.225137+0000 mgr.a (mgr.14388) 19640 : audit [DBG] from='client.421395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:30.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:30 smithi027 bash[22610]: cluster 2024-08-31T09:45:30.070335+0000 mgr.a (mgr.14388) 19641 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:30 smithi191 bash[24992]: audit 2024-08-31T09:45:29.225137+0000 mgr.a (mgr.14388) 19640 : audit [DBG] from='client.421395 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:30.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:30 smithi191 bash[24992]: cluster 2024-08-31T09:45:30.070335+0000 mgr.a (mgr.14388) 19641 : cluster [DBG] pgmap v13617: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:32.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:32 smithi163 bash[24253]: cluster 2024-08-31T09:45:32.071138+0000 mgr.a (mgr.14388) 19642 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:32.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:32 smithi027 bash[22610]: cluster 2024-08-31T09:45:32.071138+0000 mgr.a (mgr.14388) 19642 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:32.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:32 smithi191 bash[24992]: cluster 2024-08-31T09:45:32.071138+0000 mgr.a (mgr.14388) 19642 : cluster [DBG] pgmap v13618: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:34.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:34 smithi163 bash[24253]: cluster 2024-08-31T09:45:34.073286+0000 mgr.a (mgr.14388) 19643 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:34.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:34 smithi027 bash[22610]: cluster 2024-08-31T09:45:34.073286+0000 mgr.a (mgr.14388) 19643 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:34.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:34 smithi191 bash[24992]: cluster 2024-08-31T09:45:34.073286+0000 mgr.a (mgr.14388) 19643 : cluster [DBG] pgmap v13619: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:34.650 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:34.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:34.651 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:35.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:35.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:35.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:35.440 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:35.440 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:35.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:35 smithi163 bash[24253]: audit 2024-08-31T09:45:34.988939+0000 mgr.a (mgr.14388) 19644 : audit [DBG] from='client.421470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:35.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:35 smithi027 bash[22610]: audit 2024-08-31T09:45:34.988939+0000 mgr.a (mgr.14388) 19644 : audit [DBG] from='client.421470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:35.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:35 smithi191 bash[24992]: audit 2024-08-31T09:45:34.988939+0000 mgr.a (mgr.14388) 19644 : audit [DBG] from='client.421470 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:36 smithi163 bash[24253]: audit 2024-08-31T09:45:35.172981+0000 mon.a (mon.0) 3499 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:45:36.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:36 smithi163 bash[24253]: cluster 2024-08-31T09:45:36.074138+0000 mgr.a (mgr.14388) 19645 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:36 smithi027 bash[22610]: audit 2024-08-31T09:45:35.172981+0000 mon.a (mon.0) 3499 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:45:36.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:36 smithi027 bash[22610]: cluster 2024-08-31T09:45:36.074138+0000 mgr.a (mgr.14388) 19645 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:36 smithi191 bash[24992]: audit 2024-08-31T09:45:35.172981+0000 mon.a (mon.0) 3499 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:45:36.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:36 smithi191 bash[24992]: cluster 2024-08-31T09:45:36.074138+0000 mgr.a (mgr.14388) 19645 : cluster [DBG] pgmap v13620: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:38.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:38 smithi163 bash[24253]: cluster 2024-08-31T09:45:38.076331+0000 mgr.a (mgr.14388) 19646 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:38.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:38 smithi027 bash[22610]: cluster 2024-08-31T09:45:38.076331+0000 mgr.a (mgr.14388) 19646 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:38.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:38 smithi191 bash[24992]: cluster 2024-08-31T09:45:38.076331+0000 mgr.a (mgr.14388) 19646 : cluster [DBG] pgmap v13621: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:40.441 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:40.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:40.442 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:40.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:40 smithi163 bash[24253]: cluster 2024-08-31T09:45:40.077099+0000 mgr.a (mgr.14388) 19647 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:40.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:40 smithi027 bash[22610]: cluster 2024-08-31T09:45:40.077099+0000 mgr.a (mgr.14388) 19647 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:40.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:40 smithi191 bash[24992]: cluster 2024-08-31T09:45:40.077099+0000 mgr.a (mgr.14388) 19647 : cluster [DBG] pgmap v13622: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:41.192 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:41.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:41.192 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:41.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:41.193 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:41.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:41 smithi163 bash[24253]: audit 2024-08-31T09:45:40.771787+0000 mgr.a (mgr.14388) 19648 : audit [DBG] from='client.421545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:41.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:41 smithi027 bash[22610]: audit 2024-08-31T09:45:40.771787+0000 mgr.a (mgr.14388) 19648 : audit [DBG] from='client.421545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:41.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:41 smithi191 bash[24992]: audit 2024-08-31T09:45:40.771787+0000 mgr.a (mgr.14388) 19648 : audit [DBG] from='client.421545 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:42.403 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:42 smithi027 bash[22610]: cluster 2024-08-31T09:45:42.078081+0000 mgr.a (mgr.14388) 19649 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:42.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:42 smithi163 bash[24253]: cluster 2024-08-31T09:45:42.078081+0000 mgr.a (mgr.14388) 19649 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:42.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:42 smithi191 bash[24992]: cluster 2024-08-31T09:45:42.078081+0000 mgr.a (mgr.14388) 19649 : cluster [DBG] pgmap v13623: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:44.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:44 smithi163 bash[24253]: cluster 2024-08-31T09:45:44.080404+0000 mgr.a (mgr.14388) 19650 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:44 smithi027 bash[22610]: cluster 2024-08-31T09:45:44.080404+0000 mgr.a (mgr.14388) 19650 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:44.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:44 smithi191 bash[24992]: cluster 2024-08-31T09:45:44.080404+0000 mgr.a (mgr.14388) 19650 : cluster [DBG] pgmap v13624: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:45:46.194 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:46.194 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:46.194 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:46.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:46 smithi163 bash[24253]: cluster 2024-08-31T09:45:46.081143+0000 mgr.a (mgr.14388) 19651 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:46.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:46 smithi027 bash[22610]: cluster 2024-08-31T09:45:46.081143+0000 mgr.a (mgr.14388) 19651 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:46.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:46 smithi191 bash[24992]: cluster 2024-08-31T09:45:46.081143+0000 mgr.a (mgr.14388) 19651 : cluster [DBG] pgmap v13625: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:45:47.425 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:47.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:47.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:47.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:47.425 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:47.482 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22863]: debug 2024-08-31T09:45:47.004+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22863]: debug 2024-08-31T09:45:47.016+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22610]: audit 2024-08-31T09:45:46.233251+0000 mon.a (mon.0) 3500 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22610]: audit 2024-08-31T09:45:46.239635+0000 mon.a (mon.0) 3501 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22610]: audit 2024-08-31T09:45:46.241356+0000 mon.a (mon.0) 3502 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22610]: audit 2024-08-31T09:45:46.242649+0000 mon.a (mon.0) 3503 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22610]: audit 2024-08-31T09:45:46.250953+0000 mon.a (mon.0) 3504 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22610]: audit 2024-08-31T09:45:46.254170+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22610]: audit 2024-08-31T09:45:46.255487+0000 mgr.a (mgr.14388) 19652 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22610]: audit 2024-08-31T09:45:46.542596+0000 mgr.a (mgr.14388) 19653 : audit [DBG] from='client.421623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22610]: audit 2024-08-31T09:45:47.009282+0000 mgr.a (mgr.14388) 19654 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:45:47.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:47 smithi027 bash[22610]: cephadm 2024-08-31T09:45:47.020481+0000 mgr.a (mgr.14388) 19655 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:45:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:47 smithi191 bash[24992]: audit 2024-08-31T09:45:46.233251+0000 mon.a (mon.0) 3500 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:45:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:47 smithi191 bash[24992]: audit 2024-08-31T09:45:46.239635+0000 mon.a (mon.0) 3501 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:45:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:47 smithi191 bash[24992]: audit 2024-08-31T09:45:46.241356+0000 mon.a (mon.0) 3502 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:45:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:47 smithi191 bash[24992]: audit 2024-08-31T09:45:46.242649+0000 mon.a (mon.0) 3503 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:45:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:47 smithi191 bash[24992]: audit 2024-08-31T09:45:46.250953+0000 mon.a (mon.0) 3504 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:45:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:47 smithi191 bash[24992]: audit 2024-08-31T09:45:46.254170+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:45:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:47 smithi191 bash[24992]: audit 2024-08-31T09:45:46.255487+0000 mgr.a (mgr.14388) 19652 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:45:47.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:47 smithi191 bash[24992]: audit 2024-08-31T09:45:46.542596+0000 mgr.a (mgr.14388) 19653 : audit [DBG] from='client.421623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:47 smithi191 bash[24992]: audit 2024-08-31T09:45:47.009282+0000 mgr.a (mgr.14388) 19654 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:45:47.540 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:47 smithi191 bash[24992]: cephadm 2024-08-31T09:45:47.020481+0000 mgr.a (mgr.14388) 19655 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:45:47.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:47 smithi163 bash[24253]: audit 2024-08-31T09:45:46.233251+0000 mon.a (mon.0) 3500 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:45:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:47 smithi163 bash[24253]: audit 2024-08-31T09:45:46.239635+0000 mon.a (mon.0) 3501 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:45:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:47 smithi163 bash[24253]: audit 2024-08-31T09:45:46.241356+0000 mon.a (mon.0) 3502 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:45:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:47 smithi163 bash[24253]: audit 2024-08-31T09:45:46.242649+0000 mon.a (mon.0) 3503 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:45:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:47 smithi163 bash[24253]: audit 2024-08-31T09:45:46.250953+0000 mon.a (mon.0) 3504 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:45:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:47 smithi163 bash[24253]: audit 2024-08-31T09:45:46.254170+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:45:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:47 smithi163 bash[24253]: audit 2024-08-31T09:45:46.255487+0000 mgr.a (mgr.14388) 19652 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:45:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:47 smithi163 bash[24253]: audit 2024-08-31T09:45:46.542596+0000 mgr.a (mgr.14388) 19653 : audit [DBG] from='client.421623 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:47 smithi163 bash[24253]: audit 2024-08-31T09:45:47.009282+0000 mgr.a (mgr.14388) 19654 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:45:47.700 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:47 smithi163 bash[24253]: cephadm 2024-08-31T09:45:47.020481+0000 mgr.a (mgr.14388) 19655 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:45:48.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:48 smithi191 bash[24992]: cluster 2024-08-31T09:45:48.083513+0000 mgr.a (mgr.14388) 19656 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:48.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:48 smithi163 bash[24253]: cluster 2024-08-31T09:45:48.083513+0000 mgr.a (mgr.14388) 19656 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:48.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:48 smithi027 bash[22610]: cluster 2024-08-31T09:45:48.083513+0000 mgr.a (mgr.14388) 19656 : cluster [DBG] pgmap v13626: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:51.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:51 smithi163 bash[24253]: cluster 2024-08-31T09:45:50.084289+0000 mgr.a (mgr.14388) 19657 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:51.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:51 smithi027 bash[22610]: cluster 2024-08-31T09:45:50.084289+0000 mgr.a (mgr.14388) 19657 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:51.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:51 smithi191 bash[24992]: cluster 2024-08-31T09:45:50.084289+0000 mgr.a (mgr.14388) 19657 : cluster [DBG] pgmap v13627: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:52.426 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:53.213 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:53.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:53.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:53.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:53.214 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:53 smithi163 bash[24253]: cluster 2024-08-31T09:45:52.085136+0000 mgr.a (mgr.14388) 19658 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:53.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:53 smithi163 bash[24253]: audit 2024-08-31T09:45:52.762840+0000 mgr.a (mgr.14388) 19659 : audit [DBG] from='client.421806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:53.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:53 smithi027 bash[22610]: cluster 2024-08-31T09:45:52.085136+0000 mgr.a (mgr.14388) 19658 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:53.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:53 smithi027 bash[22610]: audit 2024-08-31T09:45:52.762840+0000 mgr.a (mgr.14388) 19659 : audit [DBG] from='client.421806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:53 smithi191 bash[24992]: cluster 2024-08-31T09:45:52.085136+0000 mgr.a (mgr.14388) 19658 : cluster [DBG] pgmap v13628: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:53.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:53 smithi191 bash[24992]: audit 2024-08-31T09:45:52.762840+0000 mgr.a (mgr.14388) 19659 : audit [DBG] from='client.421806 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:55.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:55 smithi163 bash[24253]: cluster 2024-08-31T09:45:54.088030+0000 mgr.a (mgr.14388) 19660 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:55.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:55 smithi027 bash[22610]: cluster 2024-08-31T09:45:54.088030+0000 mgr.a (mgr.14388) 19660 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:55.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:55 smithi191 bash[24992]: cluster 2024-08-31T09:45:54.088030+0000 mgr.a (mgr.14388) 19660 : cluster [DBG] pgmap v13629: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:57.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:57 smithi163 bash[24253]: cluster 2024-08-31T09:45:56.088827+0000 mgr.a (mgr.14388) 19661 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:45:57.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:57 smithi027 bash[22610]: cluster 2024-08-31T09:45:56.088827+0000 mgr.a (mgr.14388) 19661 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:45:57.538 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:57 smithi191 bash[24992]: cluster 2024-08-31T09:45:56.088827+0000 mgr.a (mgr.14388) 19661 : cluster [DBG] pgmap v13630: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:45:58.215 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:45:58.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:45:58.216 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:45:58.993 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:45:58.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:45:58.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:45:58.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:45:58.993 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:45:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:59 smithi163 bash[24253]: cluster 2024-08-31T09:45:58.090909+0000 mgr.a (mgr.14388) 19662 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:45:59 smithi163 bash[24253]: audit 2024-08-31T09:45:58.551507+0000 mgr.a (mgr.14388) 19663 : audit [DBG] from='client.421884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:59 smithi027 bash[22610]: cluster 2024-08-31T09:45:58.090909+0000 mgr.a (mgr.14388) 19662 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:59.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:45:59 smithi027 bash[22610]: audit 2024-08-31T09:45:58.551507+0000 mgr.a (mgr.14388) 19663 : audit [DBG] from='client.421884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:45:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:59 smithi191 bash[24992]: cluster 2024-08-31T09:45:58.090909+0000 mgr.a (mgr.14388) 19662 : cluster [DBG] pgmap v13631: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:45:59.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:45:59 smithi191 bash[24992]: audit 2024-08-31T09:45:58.551507+0000 mgr.a (mgr.14388) 19663 : audit [DBG] from='client.421884 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:01.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:01 smithi163 bash[24253]: cluster 2024-08-31T09:46:00.091988+0000 mgr.a (mgr.14388) 19664 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:46:01.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:01 smithi027 bash[22610]: cluster 2024-08-31T09:46:00.091988+0000 mgr.a (mgr.14388) 19664 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:46:01.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:01 smithi191 bash[24992]: cluster 2024-08-31T09:46:00.091988+0000 mgr.a (mgr.14388) 19664 : cluster [DBG] pgmap v13632: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:46:03.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:03 smithi163 bash[24253]: cluster 2024-08-31T09:46:02.092806+0000 mgr.a (mgr.14388) 19665 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:46:03.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:03 smithi027 bash[22610]: cluster 2024-08-31T09:46:02.092806+0000 mgr.a (mgr.14388) 19665 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:46:03.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:03 smithi191 bash[24992]: cluster 2024-08-31T09:46:02.092806+0000 mgr.a (mgr.14388) 19665 : cluster [DBG] pgmap v13633: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:46:03.994 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:46:03.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:46:03.995 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:46:04.748 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:46:04.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:46:04.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:46:04.748 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:46:04.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:46:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:05 smithi163 bash[24253]: cluster 2024-08-31T09:46:04.094000+0000 mgr.a (mgr.14388) 19666 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:05.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:05 smithi163 bash[24253]: audit 2024-08-31T09:46:04.328968+0000 mgr.a (mgr.14388) 19667 : audit [DBG] from='client.421962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:05 smithi027 bash[22610]: cluster 2024-08-31T09:46:04.094000+0000 mgr.a (mgr.14388) 19666 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:05.483 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:05 smithi027 bash[22610]: audit 2024-08-31T09:46:04.328968+0000 mgr.a (mgr.14388) 19667 : audit [DBG] from='client.421962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:05 smithi191 bash[24992]: cluster 2024-08-31T09:46:04.094000+0000 mgr.a (mgr.14388) 19666 : cluster [DBG] pgmap v13634: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:05.539 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:05 smithi191 bash[24992]: audit 2024-08-31T09:46:04.328968+0000 mgr.a (mgr.14388) 19667 : audit [DBG] from='client.421962 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:07.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:07 smithi163 bash[24253]: cluster 2024-08-31T09:46:06.094869+0000 mgr.a (mgr.14388) 19668 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:07.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:07 smithi027 bash[22610]: cluster 2024-08-31T09:46:06.094869+0000 mgr.a (mgr.14388) 19668 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:07.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:07 smithi191 bash[24992]: cluster 2024-08-31T09:46:06.094869+0000 mgr.a (mgr.14388) 19668 : cluster [DBG] pgmap v13635: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:09.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:09 smithi163 bash[24253]: cluster 2024-08-31T09:46:08.097044+0000 mgr.a (mgr.14388) 19669 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:09.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:09 smithi027 bash[22610]: cluster 2024-08-31T09:46:08.097044+0000 mgr.a (mgr.14388) 19669 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:09.749 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:46:09.750 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:46:09.750 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:46:09.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:09 smithi191 bash[24992]: cluster 2024-08-31T09:46:08.097044+0000 mgr.a (mgr.14388) 19669 : cluster [DBG] pgmap v13636: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:10.505 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:46:10.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:46:10.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:46:10.505 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:46:10.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:46:10.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:10 smithi163 bash[24253]: audit 2024-08-31T09:46:10.084028+0000 mgr.a (mgr.14388) 19670 : audit [DBG] from='client.422037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:10.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:10 smithi027 bash[22610]: audit 2024-08-31T09:46:10.084028+0000 mgr.a (mgr.14388) 19670 : audit [DBG] from='client.422037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:10.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:10 smithi191 bash[24992]: audit 2024-08-31T09:46:10.084028+0000 mgr.a (mgr.14388) 19670 : audit [DBG] from='client.422037 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:11.699 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:11 smithi163 bash[24253]: cluster 2024-08-31T09:46:10.098403+0000 mgr.a (mgr.14388) 19671 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:11.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:11 smithi027 bash[22610]: cluster 2024-08-31T09:46:10.098403+0000 mgr.a (mgr.14388) 19671 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:11.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:11 smithi191 bash[24992]: cluster 2024-08-31T09:46:10.098403+0000 mgr.a (mgr.14388) 19671 : cluster [DBG] pgmap v13637: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:13.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:13 smithi027 bash[22610]: cluster 2024-08-31T09:46:12.099624+0000 mgr.a (mgr.14388) 19672 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:13.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:13 smithi191 bash[24992]: cluster 2024-08-31T09:46:12.099624+0000 mgr.a (mgr.14388) 19672 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:13 smithi163 bash[24253]: cluster 2024-08-31T09:46:12.099624+0000 mgr.a (mgr.14388) 19672 : cluster [DBG] pgmap v13638: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:15.506 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:46:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:46:15.507 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:46:15.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:15 smithi027 bash[22610]: cluster 2024-08-31T09:46:14.101852+0000 mgr.a (mgr.14388) 19673 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:15.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:15 smithi191 bash[24992]: cluster 2024-08-31T09:46:14.101852+0000 mgr.a (mgr.14388) 19673 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:15 smithi163 bash[24253]: cluster 2024-08-31T09:46:14.101852+0000 mgr.a (mgr.14388) 19673 : cluster [DBG] pgmap v13639: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:16.295 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:46:16.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:46:16.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:46:16.295 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:46:16.296 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:46:16.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:16 smithi027 bash[22610]: audit 2024-08-31T09:46:15.845840+0000 mgr.a (mgr.14388) 19674 : audit [DBG] from='client.422115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:16.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:16 smithi191 bash[24992]: audit 2024-08-31T09:46:15.845840+0000 mgr.a (mgr.14388) 19674 : audit [DBG] from='client.422115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:16 smithi163 bash[24253]: audit 2024-08-31T09:46:15.845840+0000 mgr.a (mgr.14388) 19674 : audit [DBG] from='client.422115 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:17.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:17 smithi027 bash[22610]: cluster 2024-08-31T09:46:16.102393+0000 mgr.a (mgr.14388) 19675 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:17.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:17 smithi191 bash[24992]: cluster 2024-08-31T09:46:16.102393+0000 mgr.a (mgr.14388) 19675 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:17.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:17 smithi163 bash[24253]: cluster 2024-08-31T09:46:16.102393+0000 mgr.a (mgr.14388) 19675 : cluster [DBG] pgmap v13640: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:19.733 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:19 smithi027 bash[22610]: cluster 2024-08-31T09:46:18.104741+0000 mgr.a (mgr.14388) 19676 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:19.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:19 smithi191 bash[24992]: cluster 2024-08-31T09:46:18.104741+0000 mgr.a (mgr.14388) 19676 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:19 smithi163 bash[24253]: cluster 2024-08-31T09:46:18.104741+0000 mgr.a (mgr.14388) 19676 : cluster [DBG] pgmap v13641: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:46:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:46:21.297 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:46:21.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:21 smithi191 bash[24992]: cluster 2024-08-31T09:46:20.105652+0000 mgr.a (mgr.14388) 19677 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:21 smithi163 bash[24253]: cluster 2024-08-31T09:46:20.105652+0000 mgr.a (mgr.14388) 19677 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:21.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:21 smithi027 bash[22610]: cluster 2024-08-31T09:46:20.105652+0000 mgr.a (mgr.14388) 19677 : cluster [DBG] pgmap v13642: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:22.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:46:22.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:46:22.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:46:22.085 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:46:22.085 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:46:22.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:22 smithi191 bash[24992]: audit 2024-08-31T09:46:21.631360+0000 mgr.a (mgr.14388) 19678 : audit [DBG] from='client.422193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:22 smithi163 bash[24253]: audit 2024-08-31T09:46:21.631360+0000 mgr.a (mgr.14388) 19678 : audit [DBG] from='client.422193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:22 smithi027 bash[22610]: audit 2024-08-31T09:46:21.631360+0000 mgr.a (mgr.14388) 19678 : audit [DBG] from='client.422193 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:23.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:23 smithi191 bash[24992]: cluster 2024-08-31T09:46:22.106340+0000 mgr.a (mgr.14388) 19679 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:23 smithi163 bash[24253]: cluster 2024-08-31T09:46:22.106340+0000 mgr.a (mgr.14388) 19679 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:23 smithi027 bash[22610]: cluster 2024-08-31T09:46:22.106340+0000 mgr.a (mgr.14388) 19679 : cluster [DBG] pgmap v13643: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:25.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:25 smithi191 bash[24992]: cluster 2024-08-31T09:46:24.108535+0000 mgr.a (mgr.14388) 19680 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:25 smithi163 bash[24253]: cluster 2024-08-31T09:46:24.108535+0000 mgr.a (mgr.14388) 19680 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:25 smithi027 bash[22610]: cluster 2024-08-31T09:46:24.108535+0000 mgr.a (mgr.14388) 19680 : cluster [DBG] pgmap v13644: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:27.086 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:46:27.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:46:27.088 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:46:27.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:27 smithi191 bash[24992]: cluster 2024-08-31T09:46:26.109277+0000 mgr.a (mgr.14388) 19681 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:27.851 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:46:27.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:46:27.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:46:27.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:46:27.852 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:46:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:27 smithi163 bash[24253]: cluster 2024-08-31T09:46:26.109277+0000 mgr.a (mgr.14388) 19681 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:27.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:27 smithi027 bash[22610]: cluster 2024-08-31T09:46:26.109277+0000 mgr.a (mgr.14388) 19681 : cluster [DBG] pgmap v13645: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:28.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:28 smithi191 bash[24992]: audit 2024-08-31T09:46:27.419026+0000 mgr.a (mgr.14388) 19682 : audit [DBG] from='client.422271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:28.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:28 smithi163 bash[24253]: audit 2024-08-31T09:46:27.419026+0000 mgr.a (mgr.14388) 19682 : audit [DBG] from='client.422271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:28.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:28 smithi027 bash[22610]: audit 2024-08-31T09:46:27.419026+0000 mgr.a (mgr.14388) 19682 : audit [DBG] from='client.422271 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:29.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:29 smithi191 bash[24992]: cluster 2024-08-31T09:46:28.111525+0000 mgr.a (mgr.14388) 19683 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:29 smithi163 bash[24253]: cluster 2024-08-31T09:46:28.111525+0000 mgr.a (mgr.14388) 19683 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:29 smithi027 bash[22610]: cluster 2024-08-31T09:46:28.111525+0000 mgr.a (mgr.14388) 19683 : cluster [DBG] pgmap v13646: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:31.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:31 smithi191 bash[24992]: cluster 2024-08-31T09:46:30.112289+0000 mgr.a (mgr.14388) 19684 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:31 smithi163 bash[24253]: cluster 2024-08-31T09:46:30.112289+0000 mgr.a (mgr.14388) 19684 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:31 smithi027 bash[22610]: cluster 2024-08-31T09:46:30.112289+0000 mgr.a (mgr.14388) 19684 : cluster [DBG] pgmap v13647: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:32.853 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:46:32.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:46:32.854 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:46:33.610 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:46:33.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:46:33.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:46:33.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:46:33.611 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:46:33.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:33 smithi191 bash[24992]: cluster 2024-08-31T09:46:32.113040+0000 mgr.a (mgr.14388) 19685 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:33 smithi163 bash[24253]: cluster 2024-08-31T09:46:32.113040+0000 mgr.a (mgr.14388) 19685 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:33.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:33 smithi027 bash[22610]: cluster 2024-08-31T09:46:32.113040+0000 mgr.a (mgr.14388) 19685 : cluster [DBG] pgmap v13648: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:34.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:34 smithi191 bash[24992]: audit 2024-08-31T09:46:33.185039+0000 mgr.a (mgr.14388) 19686 : audit [DBG] from='client.422343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:34.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:34 smithi163 bash[24253]: audit 2024-08-31T09:46:33.185039+0000 mgr.a (mgr.14388) 19686 : audit [DBG] from='client.422343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:34.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:34 smithi027 bash[22610]: audit 2024-08-31T09:46:33.185039+0000 mgr.a (mgr.14388) 19686 : audit [DBG] from='client.422343 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:35.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:35 smithi191 bash[24992]: cluster 2024-08-31T09:46:34.115982+0000 mgr.a (mgr.14388) 19687 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:35 smithi163 bash[24253]: cluster 2024-08-31T09:46:34.115982+0000 mgr.a (mgr.14388) 19687 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:35.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:35 smithi027 bash[22610]: cluster 2024-08-31T09:46:34.115982+0000 mgr.a (mgr.14388) 19687 : cluster [DBG] pgmap v13649: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:37.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:37 smithi163 bash[24253]: cluster 2024-08-31T09:46:36.116768+0000 mgr.a (mgr.14388) 19688 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:46:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:37 smithi027 bash[22610]: cluster 2024-08-31T09:46:36.116768+0000 mgr.a (mgr.14388) 19688 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:46:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:37 smithi191 bash[24992]: cluster 2024-08-31T09:46:36.116768+0000 mgr.a (mgr.14388) 19688 : cluster [DBG] pgmap v13650: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:46:38.612 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:46:38.613 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:46:38.613 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:46:39.364 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:46:39.364 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:46:39.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:46:39.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:46:39.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:46:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:39 smithi163 bash[24253]: cluster 2024-08-31T09:46:38.118657+0000 mgr.a (mgr.14388) 19689 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:39 smithi163 bash[24253]: audit 2024-08-31T09:46:38.943127+0000 mgr.a (mgr.14388) 19690 : audit [DBG] from='client.422421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:39 smithi027 bash[22610]: cluster 2024-08-31T09:46:38.118657+0000 mgr.a (mgr.14388) 19689 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:39 smithi027 bash[22610]: audit 2024-08-31T09:46:38.943127+0000 mgr.a (mgr.14388) 19690 : audit [DBG] from='client.422421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:39 smithi191 bash[24992]: cluster 2024-08-31T09:46:38.118657+0000 mgr.a (mgr.14388) 19689 : cluster [DBG] pgmap v13651: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:39 smithi191 bash[24992]: audit 2024-08-31T09:46:38.943127+0000 mgr.a (mgr.14388) 19690 : audit [DBG] from='client.422421 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:41 smithi163 bash[24253]: cluster 2024-08-31T09:46:40.119614+0000 mgr.a (mgr.14388) 19691 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:46:41.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:41 smithi027 bash[22610]: cluster 2024-08-31T09:46:40.119614+0000 mgr.a (mgr.14388) 19691 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:46:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:41 smithi191 bash[24992]: cluster 2024-08-31T09:46:40.119614+0000 mgr.a (mgr.14388) 19691 : cluster [DBG] pgmap v13652: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:46:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:43 smithi163 bash[24253]: cluster 2024-08-31T09:46:42.120417+0000 mgr.a (mgr.14388) 19692 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:46:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:43 smithi027 bash[22610]: cluster 2024-08-31T09:46:42.120417+0000 mgr.a (mgr.14388) 19692 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:46:44.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:43 smithi191 bash[24992]: cluster 2024-08-31T09:46:42.120417+0000 mgr.a (mgr.14388) 19692 : cluster [DBG] pgmap v13653: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:46:44.365 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:46:44.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:46:44.366 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:46:45.147 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:46:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:46:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:46:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:46:45.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:46:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:45 smithi163 bash[24253]: cluster 2024-08-31T09:46:44.122647+0000 mgr.a (mgr.14388) 19693 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:45 smithi163 bash[24253]: audit 2024-08-31T09:46:44.703030+0000 mgr.a (mgr.14388) 19694 : audit [DBG] from='client.422496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:45 smithi027 bash[22610]: cluster 2024-08-31T09:46:44.122647+0000 mgr.a (mgr.14388) 19693 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:45 smithi027 bash[22610]: audit 2024-08-31T09:46:44.703030+0000 mgr.a (mgr.14388) 19694 : audit [DBG] from='client.422496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:45 smithi191 bash[24992]: cluster 2024-08-31T09:46:44.122647+0000 mgr.a (mgr.14388) 19693 : cluster [DBG] pgmap v13654: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:45 smithi191 bash[24992]: audit 2024-08-31T09:46:44.703030+0000 mgr.a (mgr.14388) 19694 : audit [DBG] from='client.422496 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:47 smithi163 bash[24253]: cluster 2024-08-31T09:46:46.123563+0000 mgr.a (mgr.14388) 19695 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:47 smithi163 bash[24253]: audit 2024-08-31T09:46:47.073896+0000 mon.a (mon.0) 3506 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:46:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:47 smithi027 bash[22610]: cluster 2024-08-31T09:46:46.123563+0000 mgr.a (mgr.14388) 19695 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:47 smithi027 bash[22610]: audit 2024-08-31T09:46:47.073896+0000 mon.a (mon.0) 3506 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:46:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:47 smithi191 bash[24992]: cluster 2024-08-31T09:46:46.123563+0000 mgr.a (mgr.14388) 19695 : cluster [DBG] pgmap v13655: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:47 smithi191 bash[24992]: audit 2024-08-31T09:46:47.073896+0000 mon.a (mon.0) 3506 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:46:49.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:49 smithi163 bash[24253]: cluster 2024-08-31T09:46:48.125695+0000 mgr.a (mgr.14388) 19696 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:49.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:49 smithi027 bash[22610]: cluster 2024-08-31T09:46:48.125695+0000 mgr.a (mgr.14388) 19696 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:49 smithi191 bash[24992]: cluster 2024-08-31T09:46:48.125695+0000 mgr.a (mgr.14388) 19696 : cluster [DBG] pgmap v13656: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:50.148 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:46:50.149 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:46:50.149 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:46:50.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:46:50.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:46:50.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:46:50.901 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:46:50.901 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:46:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:51 smithi163 bash[24253]: cluster 2024-08-31T09:46:50.126459+0000 mgr.a (mgr.14388) 19697 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:51 smithi163 bash[24253]: audit 2024-08-31T09:46:50.475352+0000 mgr.a (mgr.14388) 19698 : audit [DBG] from='client.422574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:51 smithi027 bash[22610]: cluster 2024-08-31T09:46:50.126459+0000 mgr.a (mgr.14388) 19697 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:51.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:51 smithi027 bash[22610]: audit 2024-08-31T09:46:50.475352+0000 mgr.a (mgr.14388) 19698 : audit [DBG] from='client.422574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:51 smithi191 bash[24992]: cluster 2024-08-31T09:46:50.126459+0000 mgr.a (mgr.14388) 19697 : cluster [DBG] pgmap v13657: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:51 smithi191 bash[24992]: audit 2024-08-31T09:46:50.475352+0000 mgr.a (mgr.14388) 19698 : audit [DBG] from='client.422574 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:53 smithi163 bash[24253]: cluster 2024-08-31T09:46:52.127533+0000 mgr.a (mgr.14388) 19699 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:53 smithi027 bash[22610]: cluster 2024-08-31T09:46:52.127533+0000 mgr.a (mgr.14388) 19699 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:53 smithi191 bash[24992]: cluster 2024-08-31T09:46:52.127533+0000 mgr.a (mgr.14388) 19699 : cluster [DBG] pgmap v13658: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:55.858 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:55 smithi191 bash[24992]: cluster 2024-08-31T09:46:54.129835+0000 mgr.a (mgr.14388) 19700 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:55.902 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:46:55.903 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:46:55.903 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:46:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:55 smithi163 bash[24253]: cluster 2024-08-31T09:46:54.129835+0000 mgr.a (mgr.14388) 19700 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:55 smithi027 bash[22610]: cluster 2024-08-31T09:46:54.129835+0000 mgr.a (mgr.14388) 19700 : cluster [DBG] pgmap v13659: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:56.673 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:46:56.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:46:56.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:46:56.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:46:56.674 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:46:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:57 smithi163 bash[24253]: cluster 2024-08-31T09:46:56.130554+0000 mgr.a (mgr.14388) 19701 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:57 smithi163 bash[24253]: audit 2024-08-31T09:46:56.241428+0000 mgr.a (mgr.14388) 19702 : audit [DBG] from='client.422649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:57 smithi027 bash[22610]: cluster 2024-08-31T09:46:56.130554+0000 mgr.a (mgr.14388) 19701 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:57 smithi027 bash[22610]: audit 2024-08-31T09:46:56.241428+0000 mgr.a (mgr.14388) 19702 : audit [DBG] from='client.422649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:57 smithi191 bash[24992]: cluster 2024-08-31T09:46:56.130554+0000 mgr.a (mgr.14388) 19701 : cluster [DBG] pgmap v13660: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:46:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:57 smithi191 bash[24992]: audit 2024-08-31T09:46:56.241428+0000 mgr.a (mgr.14388) 19702 : audit [DBG] from='client.422649 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:46:58.949 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:58 smithi027 bash[22610]: audit 2024-08-31T09:46:57.601728+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:58.950 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:58 smithi027 bash[22610]: audit 2024-08-31T09:46:57.610103+0000 mon.a (mon.0) 3508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:58.950 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:58 smithi027 bash[22610]: audit 2024-08-31T09:46:58.135677+0000 mon.a (mon.0) 3509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:58.950 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:58 smithi027 bash[22610]: audit 2024-08-31T09:46:58.145233+0000 mon.a (mon.0) 3510 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:58.950 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:58 smithi027 bash[22610]: audit 2024-08-31T09:46:58.147579+0000 mon.a (mon.0) 3511 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:46:58.950 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:58 smithi027 bash[22610]: audit 2024-08-31T09:46:58.149796+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:46:58.950 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:58 smithi027 bash[22610]: audit 2024-08-31T09:46:58.161479+0000 mon.a (mon.0) 3513 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:58.950 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:58 smithi027 bash[22610]: audit 2024-08-31T09:46:58.167145+0000 mon.a (mon.0) 3514 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:46:58.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:58 smithi163 bash[24253]: audit 2024-08-31T09:46:57.601728+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:58 smithi163 bash[24253]: audit 2024-08-31T09:46:57.610103+0000 mon.a (mon.0) 3508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:58 smithi163 bash[24253]: audit 2024-08-31T09:46:58.135677+0000 mon.a (mon.0) 3509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:58 smithi163 bash[24253]: audit 2024-08-31T09:46:58.145233+0000 mon.a (mon.0) 3510 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:58 smithi163 bash[24253]: audit 2024-08-31T09:46:58.147579+0000 mon.a (mon.0) 3511 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:46:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:58 smithi163 bash[24253]: audit 2024-08-31T09:46:58.149796+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:46:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:58 smithi163 bash[24253]: audit 2024-08-31T09:46:58.161479+0000 mon.a (mon.0) 3513 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:58.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:58 smithi163 bash[24253]: audit 2024-08-31T09:46:58.167145+0000 mon.a (mon.0) 3514 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:46:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:58 smithi191 bash[24992]: audit 2024-08-31T09:46:57.601728+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:58 smithi191 bash[24992]: audit 2024-08-31T09:46:57.610103+0000 mon.a (mon.0) 3508 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:58 smithi191 bash[24992]: audit 2024-08-31T09:46:58.135677+0000 mon.a (mon.0) 3509 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:58 smithi191 bash[24992]: audit 2024-08-31T09:46:58.145233+0000 mon.a (mon.0) 3510 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:58 smithi191 bash[24992]: audit 2024-08-31T09:46:58.147579+0000 mon.a (mon.0) 3511 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:46:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:58 smithi191 bash[24992]: audit 2024-08-31T09:46:58.149796+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:46:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:58 smithi191 bash[24992]: audit 2024-08-31T09:46:58.161479+0000 mon.a (mon.0) 3513 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:46:59.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:58 smithi191 bash[24992]: audit 2024-08-31T09:46:58.167145+0000 mon.a (mon.0) 3514 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:46:59.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:46:58 smithi027 bash[22863]: debug 2024-08-31T09:46:58.946+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:46:59.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:46:58 smithi027 bash[22863]: debug 2024-08-31T09:46:58.950+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:46:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:59 smithi163 bash[24253]: cluster 2024-08-31T09:46:58.133005+0000 mgr.a (mgr.14388) 19703 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:59.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:59 smithi163 bash[24253]: audit 2024-08-31T09:46:58.169555+0000 mgr.a (mgr.14388) 19704 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:46:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:59 smithi163 bash[24253]: audit 2024-08-31T09:46:58.949791+0000 mgr.a (mgr.14388) 19705 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:46:59.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:46:59 smithi163 bash[24253]: cephadm 2024-08-31T09:46:58.951350+0000 mgr.a (mgr.14388) 19706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:46:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:59 smithi027 bash[22610]: cluster 2024-08-31T09:46:58.133005+0000 mgr.a (mgr.14388) 19703 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:46:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:59 smithi027 bash[22610]: audit 2024-08-31T09:46:58.169555+0000 mgr.a (mgr.14388) 19704 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:46:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:59 smithi027 bash[22610]: audit 2024-08-31T09:46:58.949791+0000 mgr.a (mgr.14388) 19705 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:46:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:46:59 smithi027 bash[22610]: cephadm 2024-08-31T09:46:58.951350+0000 mgr.a (mgr.14388) 19706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:47:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:59 smithi191 bash[24992]: cluster 2024-08-31T09:46:58.133005+0000 mgr.a (mgr.14388) 19703 : cluster [DBG] pgmap v13661: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:59 smithi191 bash[24992]: audit 2024-08-31T09:46:58.169555+0000 mgr.a (mgr.14388) 19704 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:47:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:59 smithi191 bash[24992]: audit 2024-08-31T09:46:58.949791+0000 mgr.a (mgr.14388) 19705 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:47:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:46:59 smithi191 bash[24992]: cephadm 2024-08-31T09:46:58.951350+0000 mgr.a (mgr.14388) 19706 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:47:01.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:01.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:01.676 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:47:01.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:01 smithi163 bash[24253]: cluster 2024-08-31T09:47:00.133856+0000 mgr.a (mgr.14388) 19707 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:01 smithi027 bash[22610]: cluster 2024-08-31T09:47:00.133856+0000 mgr.a (mgr.14388) 19707 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:01 smithi191 bash[24992]: cluster 2024-08-31T09:47:00.133856+0000 mgr.a (mgr.14388) 19707 : cluster [DBG] pgmap v13662: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:02.429 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:47:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:47:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:47:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:47:02.430 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:47:02.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:02 smithi163 bash[24253]: audit 2024-08-31T09:47:02.010463+0000 mgr.a (mgr.14388) 19708 : audit [DBG] from='client.422832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:02 smithi027 bash[22610]: audit 2024-08-31T09:47:02.010463+0000 mgr.a (mgr.14388) 19708 : audit [DBG] from='client.422832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:03.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:02 smithi191 bash[24992]: audit 2024-08-31T09:47:02.010463+0000 mgr.a (mgr.14388) 19708 : audit [DBG] from='client.422832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:03.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:03 smithi163 bash[24253]: cluster 2024-08-31T09:47:02.134384+0000 mgr.a (mgr.14388) 19709 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:03.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:03 smithi027 bash[22610]: cluster 2024-08-31T09:47:02.134384+0000 mgr.a (mgr.14388) 19709 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:03 smithi191 bash[24992]: cluster 2024-08-31T09:47:02.134384+0000 mgr.a (mgr.14388) 19709 : cluster [DBG] pgmap v13663: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:05 smithi163 bash[24253]: cluster 2024-08-31T09:47:04.136716+0000 mgr.a (mgr.14388) 19710 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:05.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:05 smithi027 bash[22610]: cluster 2024-08-31T09:47:04.136716+0000 mgr.a (mgr.14388) 19710 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:06.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:05 smithi191 bash[24992]: cluster 2024-08-31T09:47:04.136716+0000 mgr.a (mgr.14388) 19710 : cluster [DBG] pgmap v13664: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:07.431 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:07.432 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:07.432 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:47:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:07 smithi163 bash[24253]: cluster 2024-08-31T09:47:06.137504+0000 mgr.a (mgr.14388) 19711 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:07.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:07 smithi027 bash[22610]: cluster 2024-08-31T09:47:06.137504+0000 mgr.a (mgr.14388) 19711 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:07 smithi191 bash[24992]: cluster 2024-08-31T09:47:06.137504+0000 mgr.a (mgr.14388) 19711 : cluster [DBG] pgmap v13665: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:08.188 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:47:08.188 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:47:08.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:47:08.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:47:08.189 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:47:08.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:08 smithi163 bash[24253]: audit 2024-08-31T09:47:07.763042+0000 mgr.a (mgr.14388) 19712 : audit [DBG] from='client.422907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:08.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:08 smithi027 bash[22610]: audit 2024-08-31T09:47:07.763042+0000 mgr.a (mgr.14388) 19712 : audit [DBG] from='client.422907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:08 smithi191 bash[24992]: audit 2024-08-31T09:47:07.763042+0000 mgr.a (mgr.14388) 19712 : audit [DBG] from='client.422907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:09 smithi163 bash[24253]: cluster 2024-08-31T09:47:08.138777+0000 mgr.a (mgr.14388) 19713 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:09 smithi027 bash[22610]: cluster 2024-08-31T09:47:08.138777+0000 mgr.a (mgr.14388) 19713 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:09 smithi191 bash[24992]: cluster 2024-08-31T09:47:08.138777+0000 mgr.a (mgr.14388) 19713 : cluster [DBG] pgmap v13666: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:11 smithi163 bash[24253]: cluster 2024-08-31T09:47:10.139494+0000 mgr.a (mgr.14388) 19714 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:47:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:11 smithi027 bash[22610]: cluster 2024-08-31T09:47:10.139494+0000 mgr.a (mgr.14388) 19714 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:47:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:11 smithi191 bash[24992]: cluster 2024-08-31T09:47:10.139494+0000 mgr.a (mgr.14388) 19714 : cluster [DBG] pgmap v13667: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:47:13.190 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:13.190 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:13.191 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:47:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:13 smithi163 bash[24253]: cluster 2024-08-31T09:47:12.140254+0000 mgr.a (mgr.14388) 19715 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:47:13.977 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:47:13.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:47:13.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:47:13.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:47:13.977 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:47:13.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:13 smithi027 bash[22610]: cluster 2024-08-31T09:47:12.140254+0000 mgr.a (mgr.14388) 19715 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:47:14.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:13 smithi191 bash[24992]: cluster 2024-08-31T09:47:12.140254+0000 mgr.a (mgr.14388) 19715 : cluster [DBG] pgmap v13668: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:47:14.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:14 smithi163 bash[24253]: audit 2024-08-31T09:47:13.528900+0000 mgr.a (mgr.14388) 19716 : audit [DBG] from='client.422982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:14.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:14 smithi027 bash[22610]: audit 2024-08-31T09:47:13.528900+0000 mgr.a (mgr.14388) 19716 : audit [DBG] from='client.422982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:15.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:14 smithi191 bash[24992]: audit 2024-08-31T09:47:13.528900+0000 mgr.a (mgr.14388) 19716 : audit [DBG] from='client.422982 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:15 smithi163 bash[24253]: cluster 2024-08-31T09:47:14.143172+0000 mgr.a (mgr.14388) 19717 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:15 smithi027 bash[22610]: cluster 2024-08-31T09:47:14.143172+0000 mgr.a (mgr.14388) 19717 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:16.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:15 smithi191 bash[24992]: cluster 2024-08-31T09:47:14.143172+0000 mgr.a (mgr.14388) 19717 : cluster [DBG] pgmap v13669: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:47:17.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:17 smithi163 bash[24253]: cluster 2024-08-31T09:47:16.143955+0000 mgr.a (mgr.14388) 19718 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:17 smithi027 bash[22610]: cluster 2024-08-31T09:47:16.143955+0000 mgr.a (mgr.14388) 19718 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:18.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:17 smithi191 bash[24992]: cluster 2024-08-31T09:47:16.143955+0000 mgr.a (mgr.14388) 19718 : cluster [DBG] pgmap v13670: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:18.978 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:18.979 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:18.979 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:47:19.738 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:47:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:47:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:47:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:47:19.739 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:47:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:19 smithi163 bash[24253]: cluster 2024-08-31T09:47:18.145847+0000 mgr.a (mgr.14388) 19719 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:19.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:19 smithi027 bash[22610]: cluster 2024-08-31T09:47:18.145847+0000 mgr.a (mgr.14388) 19719 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:19 smithi191 bash[24992]: cluster 2024-08-31T09:47:18.145847+0000 mgr.a (mgr.14388) 19719 : cluster [DBG] pgmap v13671: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:20.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:20 smithi163 bash[24253]: audit 2024-08-31T09:47:19.311627+0000 mgr.a (mgr.14388) 19720 : audit [DBG] from='client.423057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:20.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:20 smithi027 bash[22610]: audit 2024-08-31T09:47:19.311627+0000 mgr.a (mgr.14388) 19720 : audit [DBG] from='client.423057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:21.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:20 smithi191 bash[24992]: audit 2024-08-31T09:47:19.311627+0000 mgr.a (mgr.14388) 19720 : audit [DBG] from='client.423057 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:21 smithi163 bash[24253]: cluster 2024-08-31T09:47:20.146815+0000 mgr.a (mgr.14388) 19721 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:21.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:21 smithi027 bash[22610]: cluster 2024-08-31T09:47:20.146815+0000 mgr.a (mgr.14388) 19721 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:21 smithi191 bash[24992]: cluster 2024-08-31T09:47:20.146815+0000 mgr.a (mgr.14388) 19721 : cluster [DBG] pgmap v13672: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:23 smithi163 bash[24253]: cluster 2024-08-31T09:47:22.147574+0000 mgr.a (mgr.14388) 19722 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:23.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:23 smithi027 bash[22610]: cluster 2024-08-31T09:47:22.147574+0000 mgr.a (mgr.14388) 19722 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:23 smithi191 bash[24992]: cluster 2024-08-31T09:47:22.147574+0000 mgr.a (mgr.14388) 19722 : cluster [DBG] pgmap v13673: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:24.740 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:24.741 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:24.741 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:47:25.477 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:47:25.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:47:25.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:47:25.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:47:25.477 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:47:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:25 smithi163 bash[24253]: cluster 2024-08-31T09:47:24.149786+0000 mgr.a (mgr.14388) 19723 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:25 smithi163 bash[24253]: audit 2024-08-31T09:47:25.066593+0000 mgr.a (mgr.14388) 19724 : audit [DBG] from='client.423135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:25 smithi027 bash[22610]: cluster 2024-08-31T09:47:24.149786+0000 mgr.a (mgr.14388) 19723 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:25.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:25 smithi027 bash[22610]: audit 2024-08-31T09:47:25.066593+0000 mgr.a (mgr.14388) 19724 : audit [DBG] from='client.423135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:25 smithi191 bash[24992]: cluster 2024-08-31T09:47:24.149786+0000 mgr.a (mgr.14388) 19723 : cluster [DBG] pgmap v13674: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:25 smithi191 bash[24992]: audit 2024-08-31T09:47:25.066593+0000 mgr.a (mgr.14388) 19724 : audit [DBG] from='client.423135 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:27 smithi163 bash[24253]: cluster 2024-08-31T09:47:26.150697+0000 mgr.a (mgr.14388) 19725 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:27 smithi027 bash[22610]: cluster 2024-08-31T09:47:26.150697+0000 mgr.a (mgr.14388) 19725 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:27 smithi191 bash[24992]: cluster 2024-08-31T09:47:26.150697+0000 mgr.a (mgr.14388) 19725 : cluster [DBG] pgmap v13675: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:29 smithi163 bash[24253]: cluster 2024-08-31T09:47:28.152896+0000 mgr.a (mgr.14388) 19726 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:29 smithi027 bash[22610]: cluster 2024-08-31T09:47:28.152896+0000 mgr.a (mgr.14388) 19726 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:29 smithi191 bash[24992]: cluster 2024-08-31T09:47:28.152896+0000 mgr.a (mgr.14388) 19726 : cluster [DBG] pgmap v13676: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:30.478 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:30.479 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:30.479 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:47:31.248 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:47:31.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:47:31.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:47:31.248 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:47:31.249 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:47:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:31 smithi027 bash[22610]: cluster 2024-08-31T09:47:30.153674+0000 mgr.a (mgr.14388) 19727 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:31.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:31 smithi027 bash[22610]: audit 2024-08-31T09:47:30.818169+0000 mgr.a (mgr.14388) 19728 : audit [DBG] from='client.423213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:31 smithi191 bash[24992]: cluster 2024-08-31T09:47:30.153674+0000 mgr.a (mgr.14388) 19727 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:31 smithi191 bash[24992]: audit 2024-08-31T09:47:30.818169+0000 mgr.a (mgr.14388) 19728 : audit [DBG] from='client.423213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:32.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:31 smithi163 bash[24253]: cluster 2024-08-31T09:47:30.153674+0000 mgr.a (mgr.14388) 19727 : cluster [DBG] pgmap v13677: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:32.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:31 smithi163 bash[24253]: audit 2024-08-31T09:47:30.818169+0000 mgr.a (mgr.14388) 19728 : audit [DBG] from='client.423213 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:33 smithi027 bash[22610]: cluster 2024-08-31T09:47:32.154789+0000 mgr.a (mgr.14388) 19729 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:34.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:33 smithi191 bash[24992]: cluster 2024-08-31T09:47:32.154789+0000 mgr.a (mgr.14388) 19729 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:34.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:33 smithi163 bash[24253]: cluster 2024-08-31T09:47:32.154789+0000 mgr.a (mgr.14388) 19729 : cluster [DBG] pgmap v13678: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:35 smithi027 bash[22610]: cluster 2024-08-31T09:47:34.157145+0000 mgr.a (mgr.14388) 19730 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:35 smithi191 bash[24992]: cluster 2024-08-31T09:47:34.157145+0000 mgr.a (mgr.14388) 19730 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:36.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:35 smithi163 bash[24253]: cluster 2024-08-31T09:47:34.157145+0000 mgr.a (mgr.14388) 19730 : cluster [DBG] pgmap v13679: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:36.250 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:36.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:36.250 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:47:37.029 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:47:37.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:47:37.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:47:37.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:47:37.029 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:47:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:37 smithi027 bash[22610]: cluster 2024-08-31T09:47:36.158097+0000 mgr.a (mgr.14388) 19731 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:37 smithi027 bash[22610]: audit 2024-08-31T09:47:36.582087+0000 mgr.a (mgr.14388) 19732 : audit [DBG] from='client.423291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:37 smithi191 bash[24992]: cluster 2024-08-31T09:47:36.158097+0000 mgr.a (mgr.14388) 19731 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:37 smithi191 bash[24992]: audit 2024-08-31T09:47:36.582087+0000 mgr.a (mgr.14388) 19732 : audit [DBG] from='client.423291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:38.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:37 smithi163 bash[24253]: cluster 2024-08-31T09:47:36.158097+0000 mgr.a (mgr.14388) 19731 : cluster [DBG] pgmap v13680: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:38.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:37 smithi163 bash[24253]: audit 2024-08-31T09:47:36.582087+0000 mgr.a (mgr.14388) 19732 : audit [DBG] from='client.423291 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:39 smithi027 bash[22610]: cluster 2024-08-31T09:47:38.160393+0000 mgr.a (mgr.14388) 19733 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:39 smithi191 bash[24992]: cluster 2024-08-31T09:47:38.160393+0000 mgr.a (mgr.14388) 19733 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:40.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:39 smithi163 bash[24253]: cluster 2024-08-31T09:47:38.160393+0000 mgr.a (mgr.14388) 19733 : cluster [DBG] pgmap v13681: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:41 smithi027 bash[22610]: cluster 2024-08-31T09:47:40.161157+0000 mgr.a (mgr.14388) 19734 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:42.030 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:42.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:42.031 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:47:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:41 smithi191 bash[24992]: cluster 2024-08-31T09:47:40.161157+0000 mgr.a (mgr.14388) 19734 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:42.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:41 smithi163 bash[24253]: cluster 2024-08-31T09:47:40.161157+0000 mgr.a (mgr.14388) 19734 : cluster [DBG] pgmap v13682: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:42.820 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:47:42.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:47:42.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:47:42.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:47:42.820 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:47:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:43 smithi027 bash[22610]: cluster 2024-08-31T09:47:42.161689+0000 mgr.a (mgr.14388) 19735 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:43.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:43 smithi027 bash[22610]: audit 2024-08-31T09:47:42.372684+0000 mgr.a (mgr.14388) 19736 : audit [DBG] from='client.423369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:43 smithi191 bash[24992]: cluster 2024-08-31T09:47:42.161689+0000 mgr.a (mgr.14388) 19735 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:43 smithi191 bash[24992]: audit 2024-08-31T09:47:42.372684+0000 mgr.a (mgr.14388) 19736 : audit [DBG] from='client.423369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:43 smithi163 bash[24253]: cluster 2024-08-31T09:47:42.161689+0000 mgr.a (mgr.14388) 19735 : cluster [DBG] pgmap v13683: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:43 smithi163 bash[24253]: audit 2024-08-31T09:47:42.372684+0000 mgr.a (mgr.14388) 19736 : audit [DBG] from='client.423369 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:45 smithi027 bash[22610]: cluster 2024-08-31T09:47:44.164134+0000 mgr.a (mgr.14388) 19737 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:45 smithi191 bash[24992]: cluster 2024-08-31T09:47:44.164134+0000 mgr.a (mgr.14388) 19737 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:46.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:45 smithi163 bash[24253]: cluster 2024-08-31T09:47:44.164134+0000 mgr.a (mgr.14388) 19737 : cluster [DBG] pgmap v13684: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:47:47.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:47.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:47.822 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:47:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:47 smithi191 bash[24992]: cluster 2024-08-31T09:47:46.165050+0000 mgr.a (mgr.14388) 19738 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:48.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:47 smithi163 bash[24253]: cluster 2024-08-31T09:47:46.165050+0000 mgr.a (mgr.14388) 19738 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:48.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:47 smithi027 bash[22610]: cluster 2024-08-31T09:47:46.165050+0000 mgr.a (mgr.14388) 19738 : cluster [DBG] pgmap v13685: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:48.588 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:47:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:47:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:47:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:47:48.589 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:47:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:49 smithi191 bash[24992]: audit 2024-08-31T09:47:48.159010+0000 mgr.a (mgr.14388) 19739 : audit [DBG] from='client.423447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:49 smithi191 bash[24992]: cluster 2024-08-31T09:47:48.176677+0000 mgr.a (mgr.14388) 19740 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:49 smithi163 bash[24253]: audit 2024-08-31T09:47:48.159010+0000 mgr.a (mgr.14388) 19739 : audit [DBG] from='client.423447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:49 smithi163 bash[24253]: cluster 2024-08-31T09:47:48.176677+0000 mgr.a (mgr.14388) 19740 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:50.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:49 smithi027 bash[22610]: audit 2024-08-31T09:47:48.159010+0000 mgr.a (mgr.14388) 19739 : audit [DBG] from='client.423447 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:49 smithi027 bash[22610]: cluster 2024-08-31T09:47:48.176677+0000 mgr.a (mgr.14388) 19740 : cluster [DBG] pgmap v13686: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:51 smithi191 bash[24992]: cluster 2024-08-31T09:47:50.177769+0000 mgr.a (mgr.14388) 19741 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:52.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:51 smithi163 bash[24253]: cluster 2024-08-31T09:47:50.177769+0000 mgr.a (mgr.14388) 19741 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:52.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:51 smithi027 bash[22610]: cluster 2024-08-31T09:47:50.177769+0000 mgr.a (mgr.14388) 19741 : cluster [DBG] pgmap v13687: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:53.590 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:53.591 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:53.591 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:47:54.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:53 smithi191 bash[24992]: cluster 2024-08-31T09:47:52.178540+0000 mgr.a (mgr.14388) 19742 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:54.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:53 smithi163 bash[24253]: cluster 2024-08-31T09:47:52.178540+0000 mgr.a (mgr.14388) 19742 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:54.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:53 smithi027 bash[22610]: cluster 2024-08-31T09:47:52.178540+0000 mgr.a (mgr.14388) 19742 : cluster [DBG] pgmap v13688: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:54.376 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:47:54.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:47:54.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:47:54.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:47:54.377 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:47:55.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:54 smithi191 bash[24992]: audit 2024-08-31T09:47:53.929501+0000 mgr.a (mgr.14388) 19743 : audit [DBG] from='client.423525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:55.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:54 smithi163 bash[24253]: audit 2024-08-31T09:47:53.929501+0000 mgr.a (mgr.14388) 19743 : audit [DBG] from='client.423525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:55.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:54 smithi027 bash[22610]: audit 2024-08-31T09:47:53.929501+0000 mgr.a (mgr.14388) 19743 : audit [DBG] from='client.423525 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:47:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:55 smithi191 bash[24992]: cluster 2024-08-31T09:47:54.180221+0000 mgr.a (mgr.14388) 19744 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:56.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:55 smithi163 bash[24253]: cluster 2024-08-31T09:47:54.180221+0000 mgr.a (mgr.14388) 19744 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:55 smithi027 bash[22610]: cluster 2024-08-31T09:47:54.180221+0000 mgr.a (mgr.14388) 19744 : cluster [DBG] pgmap v13689: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:47:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:57 smithi191 bash[24992]: cluster 2024-08-31T09:47:56.181104+0000 mgr.a (mgr.14388) 19745 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:58.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:57 smithi163 bash[24253]: cluster 2024-08-31T09:47:56.181104+0000 mgr.a (mgr.14388) 19745 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:57 smithi027 bash[22610]: cluster 2024-08-31T09:47:56.181104+0000 mgr.a (mgr.14388) 19745 : cluster [DBG] pgmap v13690: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:47:59.378 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:47:59.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:47:59.379 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:59 smithi191 bash[24992]: cluster 2024-08-31T09:47:58.183246+0000 mgr.a (mgr.14388) 19746 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:59 smithi191 bash[24992]: audit 2024-08-31T09:47:59.004832+0000 mon.a (mon.0) 3515 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:48:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:59 smithi191 bash[24992]: audit 2024-08-31T09:47:59.632684+0000 mon.a (mon.0) 3516 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:48:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:47:59 smithi191 bash[24992]: audit 2024-08-31T09:47:59.642762+0000 mon.a (mon.0) 3517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:48:00.146 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:00.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:00.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:00.146 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:00.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:00.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:59 smithi163 bash[24253]: cluster 2024-08-31T09:47:58.183246+0000 mgr.a (mgr.14388) 19746 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:00.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:59 smithi163 bash[24253]: audit 2024-08-31T09:47:59.004832+0000 mon.a (mon.0) 3515 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:48:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:59 smithi163 bash[24253]: audit 2024-08-31T09:47:59.632684+0000 mon.a (mon.0) 3516 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:48:00.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:47:59 smithi163 bash[24253]: audit 2024-08-31T09:47:59.642762+0000 mon.a (mon.0) 3517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:48:00.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:59 smithi027 bash[22610]: cluster 2024-08-31T09:47:58.183246+0000 mgr.a (mgr.14388) 19746 : cluster [DBG] pgmap v13691: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:59 smithi027 bash[22610]: audit 2024-08-31T09:47:59.004832+0000 mon.a (mon.0) 3515 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:48:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:59 smithi027 bash[22610]: audit 2024-08-31T09:47:59.632684+0000 mon.a (mon.0) 3516 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:48:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:47:59 smithi027 bash[22610]: audit 2024-08-31T09:47:59.642762+0000 mon.a (mon.0) 3517 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:48:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:00 smithi191 bash[24992]: audit 2024-08-31T09:47:59.709883+0000 mgr.a (mgr.14388) 19747 : audit [DBG] from='client.423600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:00 smithi191 bash[24992]: audit 2024-08-31T09:48:00.421588+0000 mon.a (mon.0) 3518 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:48:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:00 smithi191 bash[24992]: audit 2024-08-31T09:48:00.422873+0000 mon.a (mon.0) 3519 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:48:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:00 smithi191 bash[24992]: audit 2024-08-31T09:48:00.428716+0000 mon.a (mon.0) 3520 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:48:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:00 smithi191 bash[24992]: audit 2024-08-31T09:48:00.431189+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:48:01.157 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:00 smithi027 bash[22610]: audit 2024-08-31T09:47:59.709883+0000 mgr.a (mgr.14388) 19747 : audit [DBG] from='client.423600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:01.157 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:00 smithi027 bash[22610]: audit 2024-08-31T09:48:00.421588+0000 mon.a (mon.0) 3518 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:48:01.157 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:00 smithi027 bash[22610]: audit 2024-08-31T09:48:00.422873+0000 mon.a (mon.0) 3519 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:48:01.157 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:00 smithi027 bash[22610]: audit 2024-08-31T09:48:00.428716+0000 mon.a (mon.0) 3520 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:48:01.157 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:00 smithi027 bash[22610]: audit 2024-08-31T09:48:00.431189+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:48:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:00 smithi163 bash[24253]: audit 2024-08-31T09:47:59.709883+0000 mgr.a (mgr.14388) 19747 : audit [DBG] from='client.423600 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:00 smithi163 bash[24253]: audit 2024-08-31T09:48:00.421588+0000 mon.a (mon.0) 3518 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:48:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:00 smithi163 bash[24253]: audit 2024-08-31T09:48:00.422873+0000 mon.a (mon.0) 3519 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:48:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:00 smithi163 bash[24253]: audit 2024-08-31T09:48:00.428716+0000 mon.a (mon.0) 3520 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:48:01.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:00 smithi163 bash[24253]: audit 2024-08-31T09:48:00.431189+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:48:01.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:48:01 smithi027 bash[22863]: debug 2024-08-31T09:48:01.152+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:48:01.483 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:48:01 smithi027 bash[22863]: debug 2024-08-31T09:48:01.156+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:48:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:01 smithi191 bash[24992]: cluster 2024-08-31T09:48:00.183726+0000 mgr.a (mgr.14388) 19748 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:01 smithi191 bash[24992]: audit 2024-08-31T09:48:00.433809+0000 mgr.a (mgr.14388) 19749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:48:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:01 smithi163 bash[24253]: cluster 2024-08-31T09:48:00.183726+0000 mgr.a (mgr.14388) 19748 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:01 smithi163 bash[24253]: audit 2024-08-31T09:48:00.433809+0000 mgr.a (mgr.14388) 19749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:48:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:01 smithi027 bash[22610]: cluster 2024-08-31T09:48:00.183726+0000 mgr.a (mgr.14388) 19748 : cluster [DBG] pgmap v13692: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:01 smithi027 bash[22610]: audit 2024-08-31T09:48:00.433809+0000 mgr.a (mgr.14388) 19749 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:48:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:02 smithi191 bash[24992]: audit 2024-08-31T09:48:01.157642+0000 mgr.a (mgr.14388) 19750 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:48:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:02 smithi191 bash[24992]: cephadm 2024-08-31T09:48:01.158878+0000 mgr.a (mgr.14388) 19751 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:48:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:02 smithi163 bash[24253]: audit 2024-08-31T09:48:01.157642+0000 mgr.a (mgr.14388) 19750 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:48:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:02 smithi163 bash[24253]: cephadm 2024-08-31T09:48:01.158878+0000 mgr.a (mgr.14388) 19751 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:48:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:02 smithi027 bash[22610]: audit 2024-08-31T09:48:01.157642+0000 mgr.a (mgr.14388) 19750 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:48:03.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:02 smithi027 bash[22610]: cephadm 2024-08-31T09:48:01.158878+0000 mgr.a (mgr.14388) 19751 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:48:04.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:03 smithi163 bash[24253]: cluster 2024-08-31T09:48:02.184575+0000 mgr.a (mgr.14388) 19752 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:04.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:03 smithi027 bash[22610]: cluster 2024-08-31T09:48:02.184575+0000 mgr.a (mgr.14388) 19752 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:04.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:03 smithi191 bash[24992]: cluster 2024-08-31T09:48:02.184575+0000 mgr.a (mgr.14388) 19752 : cluster [DBG] pgmap v13693: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:05.147 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:48:05.148 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:48:05.149 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:05.920 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:05.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:05.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:05.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:05.920 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:06.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:05 smithi163 bash[24253]: cluster 2024-08-31T09:48:04.186744+0000 mgr.a (mgr.14388) 19753 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:06.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:05 smithi027 bash[22610]: cluster 2024-08-31T09:48:04.186744+0000 mgr.a (mgr.14388) 19753 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:06.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:05 smithi191 bash[24992]: cluster 2024-08-31T09:48:04.186744+0000 mgr.a (mgr.14388) 19753 : cluster [DBG] pgmap v13694: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:06 smithi163 bash[24253]: audit 2024-08-31T09:48:05.483722+0000 mgr.a (mgr.14388) 19754 : audit [DBG] from='client.423780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:06 smithi027 bash[22610]: audit 2024-08-31T09:48:05.483722+0000 mgr.a (mgr.14388) 19754 : audit [DBG] from='client.423780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:07.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:06 smithi191 bash[24992]: audit 2024-08-31T09:48:05.483722+0000 mgr.a (mgr.14388) 19754 : audit [DBG] from='client.423780 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:08.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:07 smithi163 bash[24253]: cluster 2024-08-31T09:48:06.187619+0000 mgr.a (mgr.14388) 19755 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:07 smithi027 bash[22610]: cluster 2024-08-31T09:48:06.187619+0000 mgr.a (mgr.14388) 19755 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:08.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:07 smithi191 bash[24992]: cluster 2024-08-31T09:48:06.187619+0000 mgr.a (mgr.14388) 19755 : cluster [DBG] pgmap v13695: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:10.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:09 smithi163 bash[24253]: cluster 2024-08-31T09:48:08.189647+0000 mgr.a (mgr.14388) 19756 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:10.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:09 smithi027 bash[22610]: cluster 2024-08-31T09:48:08.189647+0000 mgr.a (mgr.14388) 19756 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:10.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:09 smithi191 bash[24992]: cluster 2024-08-31T09:48:08.189647+0000 mgr.a (mgr.14388) 19756 : cluster [DBG] pgmap v13696: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:10.922 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:48:10.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:48:10.922 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:11.666 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:11.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:11.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:11.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:11.666 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:12.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:11 smithi163 bash[24253]: cluster 2024-08-31T09:48:10.190558+0000 mgr.a (mgr.14388) 19757 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:11 smithi027 bash[22610]: cluster 2024-08-31T09:48:10.190558+0000 mgr.a (mgr.14388) 19757 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:12.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:11 smithi191 bash[24992]: cluster 2024-08-31T09:48:10.190558+0000 mgr.a (mgr.14388) 19757 : cluster [DBG] pgmap v13697: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:13.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:12 smithi163 bash[24253]: audit 2024-08-31T09:48:11.253974+0000 mgr.a (mgr.14388) 19758 : audit [DBG] from='client.423858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:13.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:12 smithi027 bash[22610]: audit 2024-08-31T09:48:11.253974+0000 mgr.a (mgr.14388) 19758 : audit [DBG] from='client.423858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:13.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:12 smithi191 bash[24992]: audit 2024-08-31T09:48:11.253974+0000 mgr.a (mgr.14388) 19758 : audit [DBG] from='client.423858 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:14.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:13 smithi163 bash[24253]: cluster 2024-08-31T09:48:12.191470+0000 mgr.a (mgr.14388) 19759 : cluster [DBG] pgmap v13698: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:13 smithi027 bash[22610]: cluster 2024-08-31T09:48:12.191470+0000 mgr.a (mgr.14388) 19759 : cluster [DBG] pgmap v13698: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:14.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:13 smithi191 bash[24992]: cluster 2024-08-31T09:48:12.191470+0000 mgr.a (mgr.14388) 19759 : cluster [DBG] pgmap v13698: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:16.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:15 smithi163 bash[24253]: cluster 2024-08-31T09:48:14.193675+0000 mgr.a (mgr.14388) 19760 : cluster [DBG] pgmap v13699: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:15 smithi027 bash[22610]: cluster 2024-08-31T09:48:14.193675+0000 mgr.a (mgr.14388) 19760 : cluster [DBG] pgmap v13699: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:16.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:15 smithi191 bash[24992]: cluster 2024-08-31T09:48:14.193675+0000 mgr.a (mgr.14388) 19760 : cluster [DBG] pgmap v13699: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:48:16.667 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:48:16.668 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:48:16.668 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:17.417 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:17.417 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:18.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:17 smithi163 bash[24253]: cluster 2024-08-31T09:48:16.194436+0000 mgr.a (mgr.14388) 19761 : cluster [DBG] pgmap v13700: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:18.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:17 smithi163 bash[24253]: audit 2024-08-31T09:48:16.991947+0000 mgr.a (mgr.14388) 19762 : audit [DBG] from='client.423936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:17 smithi027 bash[22610]: cluster 2024-08-31T09:48:16.194436+0000 mgr.a (mgr.14388) 19761 : cluster [DBG] pgmap v13700: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:17 smithi027 bash[22610]: audit 2024-08-31T09:48:16.991947+0000 mgr.a (mgr.14388) 19762 : audit [DBG] from='client.423936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:17 smithi191 bash[24992]: cluster 2024-08-31T09:48:16.194436+0000 mgr.a (mgr.14388) 19761 : cluster [DBG] pgmap v13700: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:18.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:17 smithi191 bash[24992]: audit 2024-08-31T09:48:16.991947+0000 mgr.a (mgr.14388) 19762 : audit [DBG] from='client.423936 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:20.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:19 smithi163 bash[24253]: cluster 2024-08-31T09:48:18.196730+0000 mgr.a (mgr.14388) 19763 : cluster [DBG] pgmap v13701: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:19 smithi027 bash[22610]: cluster 2024-08-31T09:48:18.196730+0000 mgr.a (mgr.14388) 19763 : cluster [DBG] pgmap v13701: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:20.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:19 smithi191 bash[24992]: cluster 2024-08-31T09:48:18.196730+0000 mgr.a (mgr.14388) 19763 : cluster [DBG] pgmap v13701: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:21 smithi163 bash[24253]: cluster 2024-08-31T09:48:20.197471+0000 mgr.a (mgr.14388) 19764 : cluster [DBG] pgmap v13702: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:22.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:21 smithi027 bash[22610]: cluster 2024-08-31T09:48:20.197471+0000 mgr.a (mgr.14388) 19764 : cluster [DBG] pgmap v13702: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:22.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:21 smithi191 bash[24992]: cluster 2024-08-31T09:48:20.197471+0000 mgr.a (mgr.14388) 19764 : cluster [DBG] pgmap v13702: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:22.419 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:48:22.419 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:48:22.420 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:23.175 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:23.176 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:24.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:23 smithi163 bash[24253]: cluster 2024-08-31T09:48:22.198242+0000 mgr.a (mgr.14388) 19765 : cluster [DBG] pgmap v13703: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:24.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:23 smithi163 bash[24253]: audit 2024-08-31T09:48:22.754782+0000 mgr.a (mgr.14388) 19766 : audit [DBG] from='client.424014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:23 smithi027 bash[22610]: cluster 2024-08-31T09:48:22.198242+0000 mgr.a (mgr.14388) 19765 : cluster [DBG] pgmap v13703: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:23 smithi027 bash[22610]: audit 2024-08-31T09:48:22.754782+0000 mgr.a (mgr.14388) 19766 : audit [DBG] from='client.424014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:23 smithi191 bash[24992]: cluster 2024-08-31T09:48:22.198242+0000 mgr.a (mgr.14388) 19765 : cluster [DBG] pgmap v13703: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:23 smithi191 bash[24992]: audit 2024-08-31T09:48:22.754782+0000 mgr.a (mgr.14388) 19766 : audit [DBG] from='client.424014 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:26.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:25 smithi163 bash[24253]: cluster 2024-08-31T09:48:24.201043+0000 mgr.a (mgr.14388) 19767 : cluster [DBG] pgmap v13704: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:25 smithi027 bash[22610]: cluster 2024-08-31T09:48:24.201043+0000 mgr.a (mgr.14388) 19767 : cluster [DBG] pgmap v13704: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:25 smithi191 bash[24992]: cluster 2024-08-31T09:48:24.201043+0000 mgr.a (mgr.14388) 19767 : cluster [DBG] pgmap v13704: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:28.177 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:48:28.177 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:48:28.178 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:28.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:27 smithi163 bash[24253]: cluster 2024-08-31T09:48:26.201942+0000 mgr.a (mgr.14388) 19768 : cluster [DBG] pgmap v13705: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:48:28.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:27 smithi027 bash[22610]: cluster 2024-08-31T09:48:26.201942+0000 mgr.a (mgr.14388) 19768 : cluster [DBG] pgmap v13705: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:48:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:27 smithi191 bash[24992]: cluster 2024-08-31T09:48:26.201942+0000 mgr.a (mgr.14388) 19768 : cluster [DBG] pgmap v13705: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:48:28.953 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:28.953 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:28.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:28.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:28.954 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:30.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:29 smithi163 bash[24253]: cluster 2024-08-31T09:48:28.203527+0000 mgr.a (mgr.14388) 19769 : cluster [DBG] pgmap v13706: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:30.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:29 smithi163 bash[24253]: audit 2024-08-31T09:48:28.513357+0000 mgr.a (mgr.14388) 19770 : audit [DBG] from='client.424086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:29 smithi027 bash[22610]: cluster 2024-08-31T09:48:28.203527+0000 mgr.a (mgr.14388) 19769 : cluster [DBG] pgmap v13706: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:29 smithi027 bash[22610]: audit 2024-08-31T09:48:28.513357+0000 mgr.a (mgr.14388) 19770 : audit [DBG] from='client.424086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:29 smithi191 bash[24992]: cluster 2024-08-31T09:48:28.203527+0000 mgr.a (mgr.14388) 19769 : cluster [DBG] pgmap v13706: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:29 smithi191 bash[24992]: audit 2024-08-31T09:48:28.513357+0000 mgr.a (mgr.14388) 19770 : audit [DBG] from='client.424086 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:32.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:31 smithi163 bash[24253]: cluster 2024-08-31T09:48:30.204459+0000 mgr.a (mgr.14388) 19771 : cluster [DBG] pgmap v13707: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:48:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:31 smithi027 bash[22610]: cluster 2024-08-31T09:48:30.204459+0000 mgr.a (mgr.14388) 19771 : cluster [DBG] pgmap v13707: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:48:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:31 smithi191 bash[24992]: cluster 2024-08-31T09:48:30.204459+0000 mgr.a (mgr.14388) 19771 : cluster [DBG] pgmap v13707: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:48:33.955 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:48:33.955 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:48:33.955 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:34.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:33 smithi163 bash[24253]: cluster 2024-08-31T09:48:32.205258+0000 mgr.a (mgr.14388) 19772 : cluster [DBG] pgmap v13708: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:48:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:33 smithi027 bash[22610]: cluster 2024-08-31T09:48:32.205258+0000 mgr.a (mgr.14388) 19772 : cluster [DBG] pgmap v13708: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:48:34.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:33 smithi191 bash[24992]: cluster 2024-08-31T09:48:32.205258+0000 mgr.a (mgr.14388) 19772 : cluster [DBG] pgmap v13708: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:48:34.729 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:34.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:34.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:34.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:34.730 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:36.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:35 smithi163 bash[24253]: cluster 2024-08-31T09:48:34.207579+0000 mgr.a (mgr.14388) 19773 : cluster [DBG] pgmap v13709: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:36.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:35 smithi163 bash[24253]: audit 2024-08-31T09:48:34.291059+0000 mgr.a (mgr.14388) 19774 : audit [DBG] from='client.424164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:35 smithi027 bash[22610]: cluster 2024-08-31T09:48:34.207579+0000 mgr.a (mgr.14388) 19773 : cluster [DBG] pgmap v13709: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:36.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:35 smithi027 bash[22610]: audit 2024-08-31T09:48:34.291059+0000 mgr.a (mgr.14388) 19774 : audit [DBG] from='client.424164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:35 smithi191 bash[24992]: cluster 2024-08-31T09:48:34.207579+0000 mgr.a (mgr.14388) 19773 : cluster [DBG] pgmap v13709: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:35 smithi191 bash[24992]: audit 2024-08-31T09:48:34.291059+0000 mgr.a (mgr.14388) 19774 : audit [DBG] from='client.424164 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:38.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:37 smithi163 bash[24253]: cluster 2024-08-31T09:48:36.208485+0000 mgr.a (mgr.14388) 19775 : cluster [DBG] pgmap v13710: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:38.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:37 smithi027 bash[22610]: cluster 2024-08-31T09:48:36.208485+0000 mgr.a (mgr.14388) 19775 : cluster [DBG] pgmap v13710: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:38.288 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:37 smithi191 bash[24992]: cluster 2024-08-31T09:48:36.208485+0000 mgr.a (mgr.14388) 19775 : cluster [DBG] pgmap v13710: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:39.731 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:48:39.732 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:48:39.732 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:40.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:39 smithi163 bash[24253]: cluster 2024-08-31T09:48:38.210802+0000 mgr.a (mgr.14388) 19776 : cluster [DBG] pgmap v13711: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:40.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:39 smithi027 bash[22610]: cluster 2024-08-31T09:48:38.210802+0000 mgr.a (mgr.14388) 19776 : cluster [DBG] pgmap v13711: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:39 smithi191 bash[24992]: cluster 2024-08-31T09:48:38.210802+0000 mgr.a (mgr.14388) 19776 : cluster [DBG] pgmap v13711: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:40.520 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:40.520 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:40.521 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:40.521 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:40.521 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:41.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:40 smithi163 bash[24253]: audit 2024-08-31T09:48:40.074089+0000 mgr.a (mgr.14388) 19777 : audit [DBG] from='client.424242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:41.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:40 smithi027 bash[22610]: audit 2024-08-31T09:48:40.074089+0000 mgr.a (mgr.14388) 19777 : audit [DBG] from='client.424242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:41.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:40 smithi191 bash[24992]: audit 2024-08-31T09:48:40.074089+0000 mgr.a (mgr.14388) 19777 : audit [DBG] from='client.424242 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:42.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:41 smithi163 bash[24253]: cluster 2024-08-31T09:48:40.219662+0000 mgr.a (mgr.14388) 19778 : cluster [DBG] pgmap v13712: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:41 smithi027 bash[22610]: cluster 2024-08-31T09:48:40.219662+0000 mgr.a (mgr.14388) 19778 : cluster [DBG] pgmap v13712: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:41 smithi191 bash[24992]: cluster 2024-08-31T09:48:40.219662+0000 mgr.a (mgr.14388) 19778 : cluster [DBG] pgmap v13712: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:43 smithi163 bash[24253]: cluster 2024-08-31T09:48:42.220663+0000 mgr.a (mgr.14388) 19779 : cluster [DBG] pgmap v13713: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:43 smithi027 bash[22610]: cluster 2024-08-31T09:48:42.220663+0000 mgr.a (mgr.14388) 19779 : cluster [DBG] pgmap v13713: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:43 smithi191 bash[24992]: cluster 2024-08-31T09:48:42.220663+0000 mgr.a (mgr.14388) 19779 : cluster [DBG] pgmap v13713: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:48:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:48:45.522 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:46.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:45 smithi163 bash[24253]: cluster 2024-08-31T09:48:44.222984+0000 mgr.a (mgr.14388) 19780 : cluster [DBG] pgmap v13714: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:46.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:45 smithi027 bash[22610]: cluster 2024-08-31T09:48:44.222984+0000 mgr.a (mgr.14388) 19780 : cluster [DBG] pgmap v13714: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:46.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:45 smithi191 bash[24992]: cluster 2024-08-31T09:48:44.222984+0000 mgr.a (mgr.14388) 19780 : cluster [DBG] pgmap v13714: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:46.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:46.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:46.302 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:46.303 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:46.303 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:47.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:46 smithi163 bash[24253]: audit 2024-08-31T09:48:45.858207+0000 mgr.a (mgr.14388) 19781 : audit [DBG] from='client.424317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:47.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:46 smithi027 bash[22610]: audit 2024-08-31T09:48:45.858207+0000 mgr.a (mgr.14388) 19781 : audit [DBG] from='client.424317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:47.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:46 smithi191 bash[24992]: audit 2024-08-31T09:48:45.858207+0000 mgr.a (mgr.14388) 19781 : audit [DBG] from='client.424317 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:48.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:47 smithi163 bash[24253]: cluster 2024-08-31T09:48:46.223506+0000 mgr.a (mgr.14388) 19782 : cluster [DBG] pgmap v13715: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:48.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:47 smithi027 bash[22610]: cluster 2024-08-31T09:48:46.223506+0000 mgr.a (mgr.14388) 19782 : cluster [DBG] pgmap v13715: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:48.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:47 smithi191 bash[24992]: cluster 2024-08-31T09:48:46.223506+0000 mgr.a (mgr.14388) 19782 : cluster [DBG] pgmap v13715: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:50.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:49 smithi163 bash[24253]: cluster 2024-08-31T09:48:48.225835+0000 mgr.a (mgr.14388) 19783 : cluster [DBG] pgmap v13716: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:50.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:49 smithi027 bash[22610]: cluster 2024-08-31T09:48:48.225835+0000 mgr.a (mgr.14388) 19783 : cluster [DBG] pgmap v13716: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:50.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:49 smithi191 bash[24992]: cluster 2024-08-31T09:48:48.225835+0000 mgr.a (mgr.14388) 19783 : cluster [DBG] pgmap v13716: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:51.304 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:48:51.305 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:48:51.305 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:52.060 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:52.060 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:52.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:52.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:52.061 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:52.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:51 smithi163 bash[24253]: cluster 2024-08-31T09:48:50.226813+0000 mgr.a (mgr.14388) 19784 : cluster [DBG] pgmap v13717: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:52.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:51 smithi027 bash[22610]: cluster 2024-08-31T09:48:50.226813+0000 mgr.a (mgr.14388) 19784 : cluster [DBG] pgmap v13717: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:52.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:51 smithi191 bash[24992]: cluster 2024-08-31T09:48:50.226813+0000 mgr.a (mgr.14388) 19784 : cluster [DBG] pgmap v13717: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:53.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:52 smithi163 bash[24253]: audit 2024-08-31T09:48:51.635561+0000 mgr.a (mgr.14388) 19785 : audit [DBG] from='client.424392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:53.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:52 smithi027 bash[22610]: audit 2024-08-31T09:48:51.635561+0000 mgr.a (mgr.14388) 19785 : audit [DBG] from='client.424392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:53.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:52 smithi191 bash[24992]: audit 2024-08-31T09:48:51.635561+0000 mgr.a (mgr.14388) 19785 : audit [DBG] from='client.424392 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:54.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:53 smithi163 bash[24253]: cluster 2024-08-31T09:48:52.227783+0000 mgr.a (mgr.14388) 19786 : cluster [DBG] pgmap v13718: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:54.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:53 smithi027 bash[22610]: cluster 2024-08-31T09:48:52.227783+0000 mgr.a (mgr.14388) 19786 : cluster [DBG] pgmap v13718: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:54.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:53 smithi191 bash[24992]: cluster 2024-08-31T09:48:52.227783+0000 mgr.a (mgr.14388) 19786 : cluster [DBG] pgmap v13718: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:56.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:55 smithi163 bash[24253]: cluster 2024-08-31T09:48:54.230071+0000 mgr.a (mgr.14388) 19787 : cluster [DBG] pgmap v13719: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:56.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:55 smithi027 bash[22610]: cluster 2024-08-31T09:48:54.230071+0000 mgr.a (mgr.14388) 19787 : cluster [DBG] pgmap v13719: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:56.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:55 smithi191 bash[24992]: cluster 2024-08-31T09:48:54.230071+0000 mgr.a (mgr.14388) 19787 : cluster [DBG] pgmap v13719: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:48:57.062 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:48:57.062 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:48:57.063 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:48:57.820 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:48:57.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:48:57.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:48:57.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:48:57.821 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:48:58.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:57 smithi163 bash[24253]: cluster 2024-08-31T09:48:56.230855+0000 mgr.a (mgr.14388) 19788 : cluster [DBG] pgmap v13720: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:58.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:57 smithi027 bash[22610]: cluster 2024-08-31T09:48:56.230855+0000 mgr.a (mgr.14388) 19788 : cluster [DBG] pgmap v13720: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:58.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:57 smithi191 bash[24992]: cluster 2024-08-31T09:48:56.230855+0000 mgr.a (mgr.14388) 19788 : cluster [DBG] pgmap v13720: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:48:59.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:58 smithi027 bash[22610]: audit 2024-08-31T09:48:57.399838+0000 mgr.a (mgr.14388) 19789 : audit [DBG] from='client.424467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:59.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:58 smithi191 bash[24992]: audit 2024-08-31T09:48:57.399838+0000 mgr.a (mgr.14388) 19789 : audit [DBG] from='client.424467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:48:59.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:58 smithi163 bash[24253]: audit 2024-08-31T09:48:57.399838+0000 mgr.a (mgr.14388) 19789 : audit [DBG] from='client.424467 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:00.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:48:59 smithi027 bash[22610]: cluster 2024-08-31T09:48:58.233239+0000 mgr.a (mgr.14388) 19790 : cluster [DBG] pgmap v13721: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:00.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:48:59 smithi191 bash[24992]: cluster 2024-08-31T09:48:58.233239+0000 mgr.a (mgr.14388) 19790 : cluster [DBG] pgmap v13721: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:00.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:48:59 smithi163 bash[24253]: cluster 2024-08-31T09:48:58.233239+0000 mgr.a (mgr.14388) 19790 : cluster [DBG] pgmap v13721: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:01 smithi027 bash[22610]: cluster 2024-08-31T09:49:00.234141+0000 mgr.a (mgr.14388) 19791 : cluster [DBG] pgmap v13722: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:01 smithi027 bash[22610]: audit 2024-08-31T09:49:01.211602+0000 mon.a (mon.0) 3522 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:49:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:01 smithi027 bash[22610]: audit 2024-08-31T09:49:01.820923+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:01 smithi027 bash[22610]: audit 2024-08-31T09:49:01.825037+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:01 smithi027 bash[22610]: audit 2024-08-31T09:49:01.829733+0000 mon.a (mon.0) 3525 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:01 smithi027 bash[22610]: audit 2024-08-31T09:49:01.834790+0000 mon.a (mon.0) 3526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:01 smithi191 bash[24992]: cluster 2024-08-31T09:49:00.234141+0000 mgr.a (mgr.14388) 19791 : cluster [DBG] pgmap v13722: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:02.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:01 smithi191 bash[24992]: audit 2024-08-31T09:49:01.211602+0000 mon.a (mon.0) 3522 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:49:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:01 smithi191 bash[24992]: audit 2024-08-31T09:49:01.820923+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:01 smithi191 bash[24992]: audit 2024-08-31T09:49:01.825037+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:01 smithi191 bash[24992]: audit 2024-08-31T09:49:01.829733+0000 mon.a (mon.0) 3525 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.290 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:01 smithi191 bash[24992]: audit 2024-08-31T09:49:01.834790+0000 mon.a (mon.0) 3526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:01 smithi163 bash[24253]: cluster 2024-08-31T09:49:00.234141+0000 mgr.a (mgr.14388) 19791 : cluster [DBG] pgmap v13722: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:01 smithi163 bash[24253]: audit 2024-08-31T09:49:01.211602+0000 mon.a (mon.0) 3522 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:49:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:01 smithi163 bash[24253]: audit 2024-08-31T09:49:01.820923+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.449 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:01 smithi163 bash[24253]: audit 2024-08-31T09:49:01.825037+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:01 smithi163 bash[24253]: audit 2024-08-31T09:49:01.829733+0000 mon.a (mon.0) 3525 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.450 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:01 smithi163 bash[24253]: audit 2024-08-31T09:49:01.834790+0000 mon.a (mon.0) 3526 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:02.822 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:49:02.823 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:49:02.823 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:49:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: cluster 2024-08-31T09:49:02.234707+0000 mgr.a (mgr.14388) 19792 : cluster [DBG] pgmap v13723: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:02.529333+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:02.537390+0000 mon.a (mon.0) 3528 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:02.999864+0000 mon.a (mon.0) 3529 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:03.008772+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:03.040646+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:03.048375+0000 mon.a (mon.0) 3532 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:03.050049+0000 mon.a (mon.0) 3533 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:49:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:03.051499+0000 mon.a (mon.0) 3534 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:49:03.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:03.061083+0000 mon.a (mon.0) 3535 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:03.064186+0000 mon.a (mon.0) 3536 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:49:03.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:03 smithi191 bash[24992]: audit 2024-08-31T09:49:03.066337+0000 mgr.a (mgr.14388) 19793 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:49:03.818 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: cluster 2024-08-31T09:49:02.234707+0000 mgr.a (mgr.14388) 19792 : cluster [DBG] pgmap v13723: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:03.818 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:02.529333+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.818 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:02.537390+0000 mon.a (mon.0) 3528 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.818 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:02.999864+0000 mon.a (mon.0) 3529 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.818 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:03.008772+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.818 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:03.040646+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.818 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:03.048375+0000 mon.a (mon.0) 3532 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.819 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:03.050049+0000 mon.a (mon.0) 3533 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:49:03.819 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:03.051499+0000 mon.a (mon.0) 3534 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:49:03.819 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:03.061083+0000 mon.a (mon.0) 3535 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.819 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:03.064186+0000 mon.a (mon.0) 3536 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:49:03.819 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22610]: audit 2024-08-31T09:49:03.066337+0000 mgr.a (mgr.14388) 19793 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: cluster 2024-08-31T09:49:02.234707+0000 mgr.a (mgr.14388) 19792 : cluster [DBG] pgmap v13723: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:02.529333+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:02.537390+0000 mon.a (mon.0) 3528 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:02.999864+0000 mon.a (mon.0) 3529 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:03.008772+0000 mon.a (mon.0) 3530 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:03.040646+0000 mon.a (mon.0) 3531 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:03.048375+0000 mon.a (mon.0) 3532 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:03.050049+0000 mon.a (mon.0) 3533 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:03.051499+0000 mon.a (mon.0) 3534 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:03.061083+0000 mon.a (mon.0) 3535 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:49:03.950 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:03.064186+0000 mon.a (mon.0) 3536 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:49:03.951 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:03 smithi163 bash[24253]: audit 2024-08-31T09:49:03.066337+0000 mgr.a (mgr.14388) 19793 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:49:04.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22863]: debug 2024-08-31T09:49:03.811+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:49:04.233 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:49:03 smithi027 bash[22863]: debug 2024-08-31T09:49:03.827+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:49:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:49:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:49:04.233 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:49:04.234 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:49:04.234 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:49:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:04 smithi191 bash[24992]: audit 2024-08-31T09:49:03.165535+0000 mgr.a (mgr.14388) 19794 : audit [DBG] from='client.424542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:04 smithi191 bash[24992]: audit 2024-08-31T09:49:03.818339+0000 mgr.a (mgr.14388) 19795 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:49:04.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:04 smithi191 bash[24992]: cephadm 2024-08-31T09:49:03.831068+0000 mgr.a (mgr.14388) 19796 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:49:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:04 smithi163 bash[24253]: audit 2024-08-31T09:49:03.165535+0000 mgr.a (mgr.14388) 19794 : audit [DBG] from='client.424542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:04 smithi163 bash[24253]: audit 2024-08-31T09:49:03.818339+0000 mgr.a (mgr.14388) 19795 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:49:04.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:04 smithi163 bash[24253]: cephadm 2024-08-31T09:49:03.831068+0000 mgr.a (mgr.14388) 19796 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:49:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:04 smithi027 bash[22610]: audit 2024-08-31T09:49:03.165535+0000 mgr.a (mgr.14388) 19794 : audit [DBG] from='client.424542 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:04 smithi027 bash[22610]: audit 2024-08-31T09:49:03.818339+0000 mgr.a (mgr.14388) 19795 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:49:04.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:04 smithi027 bash[22610]: cephadm 2024-08-31T09:49:03.831068+0000 mgr.a (mgr.14388) 19796 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:49:05.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:05 smithi191 bash[24992]: cluster 2024-08-31T09:49:04.236074+0000 mgr.a (mgr.14388) 19797 : cluster [DBG] pgmap v13724: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:05.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:05 smithi163 bash[24253]: cluster 2024-08-31T09:49:04.236074+0000 mgr.a (mgr.14388) 19797 : cluster [DBG] pgmap v13724: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:05 smithi027 bash[22610]: cluster 2024-08-31T09:49:04.236074+0000 mgr.a (mgr.14388) 19797 : cluster [DBG] pgmap v13724: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:07.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:07 smithi163 bash[24253]: cluster 2024-08-31T09:49:06.236771+0000 mgr.a (mgr.14388) 19798 : cluster [DBG] pgmap v13725: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:49:07.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:07 smithi027 bash[22610]: cluster 2024-08-31T09:49:06.236771+0000 mgr.a (mgr.14388) 19798 : cluster [DBG] pgmap v13725: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:49:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:07 smithi191 bash[24992]: cluster 2024-08-31T09:49:06.236771+0000 mgr.a (mgr.14388) 19798 : cluster [DBG] pgmap v13725: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:49:09.236 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:49:09.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:49:09.236 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:49:09.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:09 smithi163 bash[24253]: cluster 2024-08-31T09:49:08.238782+0000 mgr.a (mgr.14388) 19799 : cluster [DBG] pgmap v13726: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:09.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:09 smithi027 bash[22610]: cluster 2024-08-31T09:49:08.238782+0000 mgr.a (mgr.14388) 19799 : cluster [DBG] pgmap v13726: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:10.021 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:49:10.021 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:49:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:49:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:49:10.022 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:49:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:09 smithi191 bash[24992]: cluster 2024-08-31T09:49:08.238782+0000 mgr.a (mgr.14388) 19799 : cluster [DBG] pgmap v13726: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:10.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:10 smithi163 bash[24253]: audit 2024-08-31T09:49:09.579121+0000 mgr.a (mgr.14388) 19800 : audit [DBG] from='client.424722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:10.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:10 smithi027 bash[22610]: audit 2024-08-31T09:49:09.579121+0000 mgr.a (mgr.14388) 19800 : audit [DBG] from='client.424722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:11.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:10 smithi191 bash[24992]: audit 2024-08-31T09:49:09.579121+0000 mgr.a (mgr.14388) 19800 : audit [DBG] from='client.424722 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:11.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:11 smithi163 bash[24253]: cluster 2024-08-31T09:49:10.239663+0000 mgr.a (mgr.14388) 19801 : cluster [DBG] pgmap v13727: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:49:11.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:11 smithi027 bash[22610]: cluster 2024-08-31T09:49:10.239663+0000 mgr.a (mgr.14388) 19801 : cluster [DBG] pgmap v13727: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:49:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:11 smithi191 bash[24992]: cluster 2024-08-31T09:49:10.239663+0000 mgr.a (mgr.14388) 19801 : cluster [DBG] pgmap v13727: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:49:13.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:13 smithi163 bash[24253]: cluster 2024-08-31T09:49:12.240440+0000 mgr.a (mgr.14388) 19802 : cluster [DBG] pgmap v13728: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:49:13.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:13 smithi027 bash[22610]: cluster 2024-08-31T09:49:12.240440+0000 mgr.a (mgr.14388) 19802 : cluster [DBG] pgmap v13728: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:49:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:13 smithi191 bash[24992]: cluster 2024-08-31T09:49:12.240440+0000 mgr.a (mgr.14388) 19802 : cluster [DBG] pgmap v13728: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:49:15.023 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:49:15.024 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:49:15.024 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:49:15.812 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:49:15.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:49:15.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:49:15.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:49:15.812 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:49:15.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:15 smithi163 bash[24253]: cluster 2024-08-31T09:49:14.242696+0000 mgr.a (mgr.14388) 19803 : cluster [DBG] pgmap v13729: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:15.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:15 smithi027 bash[22610]: cluster 2024-08-31T09:49:14.242696+0000 mgr.a (mgr.14388) 19803 : cluster [DBG] pgmap v13729: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:15 smithi191 bash[24992]: cluster 2024-08-31T09:49:14.242696+0000 mgr.a (mgr.14388) 19803 : cluster [DBG] pgmap v13729: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:16.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:16 smithi163 bash[24253]: audit 2024-08-31T09:49:15.357860+0000 mgr.a (mgr.14388) 19804 : audit [DBG] from='client.424800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:16.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:16 smithi027 bash[22610]: audit 2024-08-31T09:49:15.357860+0000 mgr.a (mgr.14388) 19804 : audit [DBG] from='client.424800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:17.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:16 smithi191 bash[24992]: audit 2024-08-31T09:49:15.357860+0000 mgr.a (mgr.14388) 19804 : audit [DBG] from='client.424800 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:17.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:17 smithi163 bash[24253]: cluster 2024-08-31T09:49:16.243671+0000 mgr.a (mgr.14388) 19805 : cluster [DBG] pgmap v13730: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:17.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:17 smithi027 bash[22610]: cluster 2024-08-31T09:49:16.243671+0000 mgr.a (mgr.14388) 19805 : cluster [DBG] pgmap v13730: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:17 smithi191 bash[24992]: cluster 2024-08-31T09:49:16.243671+0000 mgr.a (mgr.14388) 19805 : cluster [DBG] pgmap v13730: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:19.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:19 smithi163 bash[24253]: cluster 2024-08-31T09:49:18.245874+0000 mgr.a (mgr.14388) 19806 : cluster [DBG] pgmap v13731: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:19.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:19 smithi027 bash[22610]: cluster 2024-08-31T09:49:18.245874+0000 mgr.a (mgr.14388) 19806 : cluster [DBG] pgmap v13731: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:19 smithi191 bash[24992]: cluster 2024-08-31T09:49:18.245874+0000 mgr.a (mgr.14388) 19806 : cluster [DBG] pgmap v13731: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:49:20.813 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:49:20.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:49:20.814 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:49:21.565 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:49:21.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:49:21.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:49:21.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:49:21.566 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:49:21.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:21 smithi163 bash[24253]: cluster 2024-08-31T09:49:20.246642+0000 mgr.a (mgr.14388) 19807 : cluster [DBG] pgmap v13732: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:21.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:21 smithi027 bash[22610]: cluster 2024-08-31T09:49:20.246642+0000 mgr.a (mgr.14388) 19807 : cluster [DBG] pgmap v13732: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:21 smithi191 bash[24992]: cluster 2024-08-31T09:49:20.246642+0000 mgr.a (mgr.14388) 19807 : cluster [DBG] pgmap v13732: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:22.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:22 smithi163 bash[24253]: audit 2024-08-31T09:49:21.141744+0000 mgr.a (mgr.14388) 19808 : audit [DBG] from='client.424875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:22.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:22 smithi027 bash[22610]: audit 2024-08-31T09:49:21.141744+0000 mgr.a (mgr.14388) 19808 : audit [DBG] from='client.424875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:23.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:22 smithi191 bash[24992]: audit 2024-08-31T09:49:21.141744+0000 mgr.a (mgr.14388) 19808 : audit [DBG] from='client.424875 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:23.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:23 smithi163 bash[24253]: cluster 2024-08-31T09:49:22.247570+0000 mgr.a (mgr.14388) 19809 : cluster [DBG] pgmap v13733: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:23.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:23 smithi027 bash[22610]: cluster 2024-08-31T09:49:22.247570+0000 mgr.a (mgr.14388) 19809 : cluster [DBG] pgmap v13733: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:24.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:23 smithi191 bash[24992]: cluster 2024-08-31T09:49:22.247570+0000 mgr.a (mgr.14388) 19809 : cluster [DBG] pgmap v13733: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:25.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:25 smithi163 bash[24253]: cluster 2024-08-31T09:49:24.249814+0000 mgr.a (mgr.14388) 19810 : cluster [DBG] pgmap v13734: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:25.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:25 smithi027 bash[22610]: cluster 2024-08-31T09:49:24.249814+0000 mgr.a (mgr.14388) 19810 : cluster [DBG] pgmap v13734: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:26.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:25 smithi191 bash[24992]: cluster 2024-08-31T09:49:24.249814+0000 mgr.a (mgr.14388) 19810 : cluster [DBG] pgmap v13734: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:26.567 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:49:26.568 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:49:26.568 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:49:27.319 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:49:27.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:49:27.319 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:49:27.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:49:27.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:49:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:27 smithi163 bash[24253]: cluster 2024-08-31T09:49:26.250588+0000 mgr.a (mgr.14388) 19811 : cluster [DBG] pgmap v13735: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:27.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:27 smithi163 bash[24253]: audit 2024-08-31T09:49:26.891409+0000 mgr.a (mgr.14388) 19812 : audit [DBG] from='client.424953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:27 smithi027 bash[22610]: cluster 2024-08-31T09:49:26.250588+0000 mgr.a (mgr.14388) 19811 : cluster [DBG] pgmap v13735: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:27.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:27 smithi027 bash[22610]: audit 2024-08-31T09:49:26.891409+0000 mgr.a (mgr.14388) 19812 : audit [DBG] from='client.424953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:27 smithi191 bash[24992]: cluster 2024-08-31T09:49:26.250588+0000 mgr.a (mgr.14388) 19811 : cluster [DBG] pgmap v13735: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:28.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:27 smithi191 bash[24992]: audit 2024-08-31T09:49:26.891409+0000 mgr.a (mgr.14388) 19812 : audit [DBG] from='client.424953 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:29.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:29 smithi163 bash[24253]: cluster 2024-08-31T09:49:28.252975+0000 mgr.a (mgr.14388) 19813 : cluster [DBG] pgmap v13736: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:29.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:29 smithi027 bash[22610]: cluster 2024-08-31T09:49:28.252975+0000 mgr.a (mgr.14388) 19813 : cluster [DBG] pgmap v13736: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:30.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:29 smithi191 bash[24992]: cluster 2024-08-31T09:49:28.252975+0000 mgr.a (mgr.14388) 19813 : cluster [DBG] pgmap v13736: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:31.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:31 smithi163 bash[24253]: cluster 2024-08-31T09:49:30.253763+0000 mgr.a (mgr.14388) 19814 : cluster [DBG] pgmap v13737: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:31.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:31 smithi027 bash[22610]: cluster 2024-08-31T09:49:30.253763+0000 mgr.a (mgr.14388) 19814 : cluster [DBG] pgmap v13737: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:32.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:31 smithi191 bash[24992]: cluster 2024-08-31T09:49:30.253763+0000 mgr.a (mgr.14388) 19814 : cluster [DBG] pgmap v13737: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:32.320 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:49:32.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:49:32.321 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:49:33.106 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:49:33.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:49:33.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:49:33.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:49:33.106 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:49:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:33 smithi163 bash[24253]: cluster 2024-08-31T09:49:32.254527+0000 mgr.a (mgr.14388) 19815 : cluster [DBG] pgmap v13738: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:33.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:33 smithi163 bash[24253]: audit 2024-08-31T09:49:32.658897+0000 mgr.a (mgr.14388) 19816 : audit [DBG] from='client.425031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:33 smithi027 bash[22610]: cluster 2024-08-31T09:49:32.254527+0000 mgr.a (mgr.14388) 19815 : cluster [DBG] pgmap v13738: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:33.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:33 smithi027 bash[22610]: audit 2024-08-31T09:49:32.658897+0000 mgr.a (mgr.14388) 19816 : audit [DBG] from='client.425031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:33 smithi191 bash[24992]: cluster 2024-08-31T09:49:32.254527+0000 mgr.a (mgr.14388) 19815 : cluster [DBG] pgmap v13738: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:34.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:33 smithi191 bash[24992]: audit 2024-08-31T09:49:32.658897+0000 mgr.a (mgr.14388) 19816 : audit [DBG] from='client.425031 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:35.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:35 smithi163 bash[24253]: cluster 2024-08-31T09:49:34.257432+0000 mgr.a (mgr.14388) 19817 : cluster [DBG] pgmap v13739: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:49:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:35 smithi027 bash[22610]: cluster 2024-08-31T09:49:34.257432+0000 mgr.a (mgr.14388) 19817 : cluster [DBG] pgmap v13739: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:49:36.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:35 smithi191 bash[24992]: cluster 2024-08-31T09:49:34.257432+0000 mgr.a (mgr.14388) 19817 : cluster [DBG] pgmap v13739: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 1 op/s 2024-08-31T09:49:37.952 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:37 smithi163 bash[24253]: cluster 2024-08-31T09:49:36.258203+0000 mgr.a (mgr.14388) 19818 : cluster [DBG] pgmap v13740: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:49:37.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:37 smithi027 bash[22610]: cluster 2024-08-31T09:49:36.258203+0000 mgr.a (mgr.14388) 19818 : cluster [DBG] pgmap v13740: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:49:38.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:37 smithi191 bash[24992]: cluster 2024-08-31T09:49:36.258203+0000 mgr.a (mgr.14388) 19818 : cluster [DBG] pgmap v13740: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-08-31T09:49:38.107 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:49:38.108 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:49:38.108 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:49:38.885 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:49:38.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:49:38.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:49:38.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:49:38.886 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:49:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:39 smithi163 bash[24253]: cluster 2024-08-31T09:49:38.260053+0000 mgr.a (mgr.14388) 19819 : cluster [DBG] pgmap v13741: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:39.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:39 smithi163 bash[24253]: audit 2024-08-31T09:49:38.440440+0000 mgr.a (mgr.14388) 19820 : audit [DBG] from='client.425109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:39 smithi027 bash[22610]: cluster 2024-08-31T09:49:38.260053+0000 mgr.a (mgr.14388) 19819 : cluster [DBG] pgmap v13741: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:39.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:39 smithi027 bash[22610]: audit 2024-08-31T09:49:38.440440+0000 mgr.a (mgr.14388) 19820 : audit [DBG] from='client.425109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:39 smithi191 bash[24992]: cluster 2024-08-31T09:49:38.260053+0000 mgr.a (mgr.14388) 19819 : cluster [DBG] pgmap v13741: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:40.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:39 smithi191 bash[24992]: audit 2024-08-31T09:49:38.440440+0000 mgr.a (mgr.14388) 19820 : audit [DBG] from='client.425109 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:41.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:41 smithi163 bash[24253]: cluster 2024-08-31T09:49:40.260953+0000 mgr.a (mgr.14388) 19821 : cluster [DBG] pgmap v13742: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:49:41.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:41 smithi027 bash[22610]: cluster 2024-08-31T09:49:40.260953+0000 mgr.a (mgr.14388) 19821 : cluster [DBG] pgmap v13742: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:49:42.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:41 smithi191 bash[24992]: cluster 2024-08-31T09:49:40.260953+0000 mgr.a (mgr.14388) 19821 : cluster [DBG] pgmap v13742: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:49:43.887 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:49:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:49:43.888 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:49:43.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:43 smithi163 bash[24253]: cluster 2024-08-31T09:49:42.261737+0000 mgr.a (mgr.14388) 19822 : cluster [DBG] pgmap v13743: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:49:43.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:43 smithi027 bash[22610]: cluster 2024-08-31T09:49:42.261737+0000 mgr.a (mgr.14388) 19822 : cluster [DBG] pgmap v13743: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:49:44.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:43 smithi191 bash[24992]: cluster 2024-08-31T09:49:42.261737+0000 mgr.a (mgr.14388) 19822 : cluster [DBG] pgmap v13743: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 938 B/s rd, 0 op/s 2024-08-31T09:49:44.626 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:49:44.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:49:44.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:49:44.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:49:44.627 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:49:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:45 smithi163 bash[24253]: audit 2024-08-31T09:49:44.219047+0000 mgr.a (mgr.14388) 19823 : audit [DBG] from='client.425187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:45.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:45 smithi163 bash[24253]: cluster 2024-08-31T09:49:44.264688+0000 mgr.a (mgr.14388) 19824 : cluster [DBG] pgmap v13744: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:45 smithi027 bash[22610]: audit 2024-08-31T09:49:44.219047+0000 mgr.a (mgr.14388) 19823 : audit [DBG] from='client.425187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:45.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:45 smithi027 bash[22610]: cluster 2024-08-31T09:49:44.264688+0000 mgr.a (mgr.14388) 19824 : cluster [DBG] pgmap v13744: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:46.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:45 smithi191 bash[24992]: audit 2024-08-31T09:49:44.219047+0000 mgr.a (mgr.14388) 19823 : audit [DBG] from='client.425187 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:46.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:45 smithi191 bash[24992]: cluster 2024-08-31T09:49:44.264688+0000 mgr.a (mgr.14388) 19824 : cluster [DBG] pgmap v13744: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:47.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:47 smithi163 bash[24253]: cluster 2024-08-31T09:49:46.265641+0000 mgr.a (mgr.14388) 19825 : cluster [DBG] pgmap v13745: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:49:47.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:47 smithi027 bash[22610]: cluster 2024-08-31T09:49:46.265641+0000 mgr.a (mgr.14388) 19825 : cluster [DBG] pgmap v13745: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:49:48.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:47 smithi191 bash[24992]: cluster 2024-08-31T09:49:46.265641+0000 mgr.a (mgr.14388) 19825 : cluster [DBG] pgmap v13745: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-08-31T09:49:49.628 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:49:49.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:49:49.629 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:49:49.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:49 smithi163 bash[24253]: cluster 2024-08-31T09:49:48.267834+0000 mgr.a (mgr.14388) 19826 : cluster [DBG] pgmap v13746: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:49:49.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:49 smithi027 bash[22610]: cluster 2024-08-31T09:49:48.267834+0000 mgr.a (mgr.14388) 19826 : cluster [DBG] pgmap v13746: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:49:50.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:49 smithi191 bash[24992]: cluster 2024-08-31T09:49:48.267834+0000 mgr.a (mgr.14388) 19826 : cluster [DBG] pgmap v13746: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-08-31T09:49:50.380 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:49:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:49:50.380 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:49:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:49:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:49:50.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:50 smithi163 bash[24253]: audit 2024-08-31T09:49:49.965831+0000 mgr.a (mgr.14388) 19827 : audit [DBG] from='client.425262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:50.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:50 smithi027 bash[22610]: audit 2024-08-31T09:49:49.965831+0000 mgr.a (mgr.14388) 19827 : audit [DBG] from='client.425262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:51.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:50 smithi191 bash[24992]: audit 2024-08-31T09:49:49.965831+0000 mgr.a (mgr.14388) 19827 : audit [DBG] from='client.425262 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:51.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:51 smithi163 bash[24253]: cluster 2024-08-31T09:49:50.268301+0000 mgr.a (mgr.14388) 19828 : cluster [DBG] pgmap v13747: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:51.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:51 smithi027 bash[22610]: cluster 2024-08-31T09:49:50.268301+0000 mgr.a (mgr.14388) 19828 : cluster [DBG] pgmap v13747: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:52.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:51 smithi191 bash[24992]: cluster 2024-08-31T09:49:50.268301+0000 mgr.a (mgr.14388) 19828 : cluster [DBG] pgmap v13747: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:53.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:53 smithi163 bash[24253]: cluster 2024-08-31T09:49:52.269151+0000 mgr.a (mgr.14388) 19829 : cluster [DBG] pgmap v13748: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:53.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:53 smithi027 bash[22610]: cluster 2024-08-31T09:49:52.269151+0000 mgr.a (mgr.14388) 19829 : cluster [DBG] pgmap v13748: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:54.038 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:53 smithi191 bash[24992]: cluster 2024-08-31T09:49:52.269151+0000 mgr.a (mgr.14388) 19829 : cluster [DBG] pgmap v13748: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:55.382 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:49:55.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:49:55.382 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:49:55.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:55 smithi163 bash[24253]: cluster 2024-08-31T09:49:54.271403+0000 mgr.a (mgr.14388) 19830 : cluster [DBG] pgmap v13749: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:55.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:55 smithi027 bash[22610]: cluster 2024-08-31T09:49:54.271403+0000 mgr.a (mgr.14388) 19830 : cluster [DBG] pgmap v13749: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:56.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:55 smithi191 bash[24992]: cluster 2024-08-31T09:49:54.271403+0000 mgr.a (mgr.14388) 19830 : cluster [DBG] pgmap v13749: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:49:56.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:49:56.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:49:56.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:49:56.149 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:49:56.149 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:49:56.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:56 smithi163 bash[24253]: audit 2024-08-31T09:49:55.719182+0000 mgr.a (mgr.14388) 19831 : audit [DBG] from='client.425340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:56.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:56 smithi027 bash[22610]: audit 2024-08-31T09:49:55.719182+0000 mgr.a (mgr.14388) 19831 : audit [DBG] from='client.425340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:57.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:56 smithi191 bash[24992]: audit 2024-08-31T09:49:55.719182+0000 mgr.a (mgr.14388) 19831 : audit [DBG] from='client.425340 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:49:57.949 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:57 smithi163 bash[24253]: cluster 2024-08-31T09:49:56.272520+0000 mgr.a (mgr.14388) 19832 : cluster [DBG] pgmap v13750: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:57.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:57 smithi027 bash[22610]: cluster 2024-08-31T09:49:56.272520+0000 mgr.a (mgr.14388) 19832 : cluster [DBG] pgmap v13750: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:58.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:57 smithi191 bash[24992]: cluster 2024-08-31T09:49:56.272520+0000 mgr.a (mgr.14388) 19832 : cluster [DBG] pgmap v13750: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:49:59.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:49:59 smithi027 bash[22610]: cluster 2024-08-31T09:49:58.274682+0000 mgr.a (mgr.14388) 19833 : cluster [DBG] pgmap v13751: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:00.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:49:59 smithi191 bash[24992]: cluster 2024-08-31T09:49:58.274682+0000 mgr.a (mgr.14388) 19833 : cluster [DBG] pgmap v13751: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:00.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:49:59 smithi163 bash[24253]: cluster 2024-08-31T09:49:58.274682+0000 mgr.a (mgr.14388) 19833 : cluster [DBG] pgmap v13751: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:00.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:00 smithi027 bash[22610]: cluster 2024-08-31T09:50:00.000159+0000 mon.a (mon.0) 3537 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:50:01.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:00 smithi191 bash[24992]: cluster 2024-08-31T09:50:00.000159+0000 mon.a (mon.0) 3537 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:50:01.150 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:50:01.151 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:50:01.151 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:50:01.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:00 smithi163 bash[24253]: cluster 2024-08-31T09:50:00.000159+0000 mon.a (mon.0) 3537 : cluster [WRN] overall HEALTH_WARN Cannot update rgw endpoints, error: {err} 2024-08-31T09:50:01.932 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:50:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:50:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:50:01.932 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:50:01.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:50:01.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:01 smithi027 bash[22610]: cluster 2024-08-31T09:50:00.275488+0000 mgr.a (mgr.14388) 19834 : cluster [DBG] pgmap v13752: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:02.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:01 smithi191 bash[24992]: cluster 2024-08-31T09:50:00.275488+0000 mgr.a (mgr.14388) 19834 : cluster [DBG] pgmap v13752: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:02.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:01 smithi163 bash[24253]: cluster 2024-08-31T09:50:00.275488+0000 mgr.a (mgr.14388) 19834 : cluster [DBG] pgmap v13752: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:02.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:02 smithi027 bash[22610]: audit 2024-08-31T09:50:01.487996+0000 mgr.a (mgr.14388) 19835 : audit [DBG] from='client.425418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:03.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:02 smithi191 bash[24992]: audit 2024-08-31T09:50:01.487996+0000 mgr.a (mgr.14388) 19835 : audit [DBG] from='client.425418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:03.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:02 smithi163 bash[24253]: audit 2024-08-31T09:50:01.487996+0000 mgr.a (mgr.14388) 19835 : audit [DBG] from='client.425418 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:03.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:03 smithi027 bash[22610]: cluster 2024-08-31T09:50:02.276451+0000 mgr.a (mgr.14388) 19836 : cluster [DBG] pgmap v13753: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:04.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:03 smithi191 bash[24992]: cluster 2024-08-31T09:50:02.276451+0000 mgr.a (mgr.14388) 19836 : cluster [DBG] pgmap v13753: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:04.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:03 smithi163 bash[24253]: cluster 2024-08-31T09:50:02.276451+0000 mgr.a (mgr.14388) 19836 : cluster [DBG] pgmap v13753: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:04.982 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:04 smithi027 bash[22610]: audit 2024-08-31T09:50:03.893512+0000 mon.a (mon.0) 3538 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:50:05.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:04 smithi191 bash[24992]: audit 2024-08-31T09:50:03.893512+0000 mon.a (mon.0) 3538 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:50:05.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:04 smithi163 bash[24253]: audit 2024-08-31T09:50:03.893512+0000 mon.a (mon.0) 3538 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-31T09:50:05.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:50:05 smithi027 bash[22863]: debug 2024-08-31T09:50:05.517+0000 7f9ca2115640 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:50:05.983 INFO:journalctl@ceph.mgr.a.smithi027.stdout:Aug 31 09:50:05 smithi027 bash[22863]: debug 2024-08-31T09:50:05.521+0000 7f9cbaa06640 -1 log_channel(cephadm) log [ERR] : Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:50:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:05 smithi027 bash[22610]: cluster 2024-08-31T09:50:04.278626+0000 mgr.a (mgr.14388) 19837 : cluster [DBG] pgmap v13754: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:05 smithi027 bash[22610]: audit 2024-08-31T09:50:04.751560+0000 mon.a (mon.0) 3539 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:50:05.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:05 smithi027 bash[22610]: audit 2024-08-31T09:50:04.753388+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:50:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:05 smithi027 bash[22610]: audit 2024-08-31T09:50:04.763922+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:50:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:05 smithi027 bash[22610]: audit 2024-08-31T09:50:04.768958+0000 mon.a (mon.0) 3542 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:50:05.984 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:05 smithi027 bash[22610]: audit 2024-08-31T09:50:04.771337+0000 mgr.a (mgr.14388) 19838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:50:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:05 smithi191 bash[24992]: cluster 2024-08-31T09:50:04.278626+0000 mgr.a (mgr.14388) 19837 : cluster [DBG] pgmap v13754: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:05 smithi191 bash[24992]: audit 2024-08-31T09:50:04.751560+0000 mon.a (mon.0) 3539 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:50:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:05 smithi191 bash[24992]: audit 2024-08-31T09:50:04.753388+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:50:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:05 smithi191 bash[24992]: audit 2024-08-31T09:50:04.763922+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:50:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:05 smithi191 bash[24992]: audit 2024-08-31T09:50:04.768958+0000 mon.a (mon.0) 3542 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:50:06.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:05 smithi191 bash[24992]: audit 2024-08-31T09:50:04.771337+0000 mgr.a (mgr.14388) 19838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:50:06.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:05 smithi163 bash[24253]: cluster 2024-08-31T09:50:04.278626+0000 mgr.a (mgr.14388) 19837 : cluster [DBG] pgmap v13754: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:05 smithi163 bash[24253]: audit 2024-08-31T09:50:04.751560+0000 mon.a (mon.0) 3539 : audit [DBG] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-31T09:50:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:05 smithi163 bash[24253]: audit 2024-08-31T09:50:04.753388+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-31T09:50:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:05 smithi163 bash[24253]: audit 2024-08-31T09:50:04.763922+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' 2024-08-31T09:50:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:05 smithi163 bash[24253]: audit 2024-08-31T09:50:04.768958+0000 mon.a (mon.0) 3542 : audit [INF] from='mgr.14388 172.21.15.27:0/122307948' entity='mgr.a' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:50:06.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:05 smithi163 bash[24253]: audit 2024-08-31T09:50:04.771337+0000 mgr.a (mgr.14388) 19838 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: dispatch 2024-08-31T09:50:06.933 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:50:06.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:50:06.934 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:50:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:06 smithi191 bash[24992]: audit 2024-08-31T09:50:05.521151+0000 mgr.a (mgr.14388) 19839 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:50:07.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:06 smithi191 bash[24992]: cephadm 2024-08-31T09:50:05.523260+0000 mgr.a (mgr.14388) 19840 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:50:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:06 smithi163 bash[24253]: audit 2024-08-31T09:50:05.521151+0000 mgr.a (mgr.14388) 19839 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:50:07.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:06 smithi163 bash[24253]: cephadm 2024-08-31T09:50:05.523260+0000 mgr.a (mgr.14388) 19840 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:50:07.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:06 smithi027 bash[22610]: audit 2024-08-31T09:50:05.521151+0000 mgr.a (mgr.14388) 19839 : audit [INF] from='mon.0 -' entity='mon.' cmd=[{"prefix": "rgw zone modify", "realm_name": "myrealm1", "zonegroup_name": "myzonegroup1", "zone_name": "myzone1", "realm_token": "ewogICAgInJlYWxtX25hbWUiOiAibXlyZWFsbTEiLAogICAgInJlYWxtX2lkIjogIjM0ZDVlNmZjLTJjOWEtNGY2OC1hNDdlLTJhYTAwOGVkNzBjYyIsCiAgICAiZW5kcG9pbnQiOiBudWxsLAogICAgImFjY2Vzc19rZXkiOiAiRFgyQkJUQ1VMRkVJT0hTUldHNUwiLAogICAgInNlY3JldCI6ICIxNEFIN09QUTFkR3o0R096OGxrWFFoZlJBYm9vbnBKOUxBYmlKVVVmIgp9", "zone_endpoints": ["http://smithi163:5500", "http://smithi191:5500"]}]: access denied 2024-08-31T09:50:07.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:06 smithi027 bash[22610]: cephadm 2024-08-31T09:50:05.523260+0000 mgr.a (mgr.14388) 19840 : cephadm [ERR] Error when trying to update rgw zone: access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2024-08-31T09:50:07.675 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:50:07.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:50:07.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:50:07.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:50:07.675 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:50:08.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:07 smithi191 bash[24992]: cluster 2024-08-31T09:50:06.279645+0000 mgr.a (mgr.14388) 19841 : cluster [DBG] pgmap v13755: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:08.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:07 smithi163 bash[24253]: cluster 2024-08-31T09:50:06.279645+0000 mgr.a (mgr.14388) 19841 : cluster [DBG] pgmap v13755: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:08.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:07 smithi027 bash[22610]: cluster 2024-08-31T09:50:06.279645+0000 mgr.a (mgr.14388) 19841 : cluster [DBG] pgmap v13755: 225 pgs: 225 active+clean; 589 KiB data, 234 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:09.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:08 smithi191 bash[24992]: audit 2024-08-31T09:50:07.259924+0000 mgr.a (mgr.14388) 19842 : audit [DBG] from='client.425601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:09.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:08 smithi163 bash[24253]: audit 2024-08-31T09:50:07.259924+0000 mgr.a (mgr.14388) 19842 : audit [DBG] from='client.425601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:09.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:08 smithi027 bash[22610]: audit 2024-08-31T09:50:07.259924+0000 mgr.a (mgr.14388) 19842 : audit [DBG] from='client.425601 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:10.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:09 smithi191 bash[24992]: cluster 2024-08-31T09:50:08.282032+0000 mgr.a (mgr.14388) 19843 : cluster [DBG] pgmap v13756: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:10.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:09 smithi163 bash[24253]: cluster 2024-08-31T09:50:08.282032+0000 mgr.a (mgr.14388) 19843 : cluster [DBG] pgmap v13756: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:10.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:09 smithi027 bash[22610]: cluster 2024-08-31T09:50:08.282032+0000 mgr.a (mgr.14388) 19843 : cluster [DBG] pgmap v13756: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:12.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:11 smithi191 bash[24992]: cluster 2024-08-31T09:50:10.282847+0000 mgr.a (mgr.14388) 19844 : cluster [DBG] pgmap v13757: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:12.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:11 smithi163 bash[24253]: cluster 2024-08-31T09:50:10.282847+0000 mgr.a (mgr.14388) 19844 : cluster [DBG] pgmap v13757: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:12.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:11 smithi027 bash[22610]: cluster 2024-08-31T09:50:10.282847+0000 mgr.a (mgr.14388) 19844 : cluster [DBG] pgmap v13757: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:12.676 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:50:12.677 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:50:12.677 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:50:13.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:50:13.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:50:13.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:50:13.456 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:50:13.457 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:50:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:13 smithi191 bash[24992]: cluster 2024-08-31T09:50:12.283598+0000 mgr.a (mgr.14388) 19845 : cluster [DBG] pgmap v13758: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:14.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:13 smithi191 bash[24992]: audit 2024-08-31T09:50:13.013844+0000 mgr.a (mgr.14388) 19846 : audit [DBG] from='client.425679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:14.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:13 smithi163 bash[24253]: cluster 2024-08-31T09:50:12.283598+0000 mgr.a (mgr.14388) 19845 : cluster [DBG] pgmap v13758: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:14.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:13 smithi163 bash[24253]: audit 2024-08-31T09:50:13.013844+0000 mgr.a (mgr.14388) 19846 : audit [DBG] from='client.425679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:13 smithi027 bash[22610]: cluster 2024-08-31T09:50:12.283598+0000 mgr.a (mgr.14388) 19845 : cluster [DBG] pgmap v13758: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:14.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:13 smithi027 bash[22610]: audit 2024-08-31T09:50:13.013844+0000 mgr.a (mgr.14388) 19846 : audit [DBG] from='client.425679 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:16.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:15 smithi191 bash[24992]: cluster 2024-08-31T09:50:14.286604+0000 mgr.a (mgr.14388) 19847 : cluster [DBG] pgmap v13759: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:16.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:15 smithi163 bash[24253]: cluster 2024-08-31T09:50:14.286604+0000 mgr.a (mgr.14388) 19847 : cluster [DBG] pgmap v13759: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:16.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:15 smithi027 bash[22610]: cluster 2024-08-31T09:50:14.286604+0000 mgr.a (mgr.14388) 19847 : cluster [DBG] pgmap v13759: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:18.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:17 smithi191 bash[24992]: cluster 2024-08-31T09:50:16.287618+0000 mgr.a (mgr.14388) 19848 : cluster [DBG] pgmap v13760: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:50:18.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:17 smithi163 bash[24253]: cluster 2024-08-31T09:50:16.287618+0000 mgr.a (mgr.14388) 19848 : cluster [DBG] pgmap v13760: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:50:18.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:17 smithi027 bash[22610]: cluster 2024-08-31T09:50:16.287618+0000 mgr.a (mgr.14388) 19848 : cluster [DBG] pgmap v13760: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 6.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-31T09:50:18.458 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:50:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:50:18.459 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:50:19.205 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:50:19.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:50:19.205 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:50:19.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:50:19.206 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:50:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:19 smithi191 bash[24992]: cluster 2024-08-31T09:50:18.289777+0000 mgr.a (mgr.14388) 19849 : cluster [DBG] pgmap v13761: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:20.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:19 smithi191 bash[24992]: audit 2024-08-31T09:50:18.789173+0000 mgr.a (mgr.14388) 19850 : audit [DBG] from='client.425757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:20.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:19 smithi163 bash[24253]: cluster 2024-08-31T09:50:18.289777+0000 mgr.a (mgr.14388) 19849 : cluster [DBG] pgmap v13761: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:20.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:19 smithi163 bash[24253]: audit 2024-08-31T09:50:18.789173+0000 mgr.a (mgr.14388) 19850 : audit [DBG] from='client.425757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:19 smithi027 bash[22610]: cluster 2024-08-31T09:50:18.289777+0000 mgr.a (mgr.14388) 19849 : cluster [DBG] pgmap v13761: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 7.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-08-31T09:50:20.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:19 smithi027 bash[22610]: audit 2024-08-31T09:50:18.789173+0000 mgr.a (mgr.14388) 19850 : audit [DBG] from='client.425757 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:22.039 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:21 smithi191 bash[24992]: cluster 2024-08-31T09:50:20.290702+0000 mgr.a (mgr.14388) 19851 : cluster [DBG] pgmap v13762: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:50:22.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:21 smithi163 bash[24253]: cluster 2024-08-31T09:50:20.290702+0000 mgr.a (mgr.14388) 19851 : cluster [DBG] pgmap v13762: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:50:22.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:21 smithi027 bash[22610]: cluster 2024-08-31T09:50:20.290702+0000 mgr.a (mgr.14388) 19851 : cluster [DBG] pgmap v13762: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:50:24.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:23 smithi163 bash[24253]: cluster 2024-08-31T09:50:22.291489+0000 mgr.a (mgr.14388) 19852 : cluster [DBG] pgmap v13763: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:50:24.207 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:50:24.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:50:24.208 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:50:24.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:23 smithi027 bash[22610]: cluster 2024-08-31T09:50:22.291489+0000 mgr.a (mgr.14388) 19852 : cluster [DBG] pgmap v13763: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:50:24.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:23 smithi191 bash[24992]: cluster 2024-08-31T09:50:22.291489+0000 mgr.a (mgr.14388) 19852 : cluster [DBG] pgmap v13763: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 937 B/s rd, 0 op/s 2024-08-31T09:50:24.999 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:50:24.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:50:24.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:50:24.999 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:50:25.000 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:50:26.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:25 smithi163 bash[24253]: cluster 2024-08-31T09:50:24.293461+0000 mgr.a (mgr.14388) 19853 : cluster [DBG] pgmap v13764: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:26.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:25 smithi163 bash[24253]: audit 2024-08-31T09:50:24.545392+0000 mgr.a (mgr.14388) 19854 : audit [DBG] from='client.425832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:25 smithi027 bash[22610]: cluster 2024-08-31T09:50:24.293461+0000 mgr.a (mgr.14388) 19853 : cluster [DBG] pgmap v13764: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:26.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:25 smithi027 bash[22610]: audit 2024-08-31T09:50:24.545392+0000 mgr.a (mgr.14388) 19854 : audit [DBG] from='client.425832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:25 smithi191 bash[24992]: cluster 2024-08-31T09:50:24.293461+0000 mgr.a (mgr.14388) 19853 : cluster [DBG] pgmap v13764: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:26.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:25 smithi191 bash[24992]: audit 2024-08-31T09:50:24.545392+0000 mgr.a (mgr.14388) 19854 : audit [DBG] from='client.425832 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:28.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:27 smithi163 bash[24253]: cluster 2024-08-31T09:50:26.294526+0000 mgr.a (mgr.14388) 19855 : cluster [DBG] pgmap v13765: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:28.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:27 smithi027 bash[22610]: cluster 2024-08-31T09:50:26.294526+0000 mgr.a (mgr.14388) 19855 : cluster [DBG] pgmap v13765: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:28.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:27 smithi191 bash[24992]: cluster 2024-08-31T09:50:26.294526+0000 mgr.a (mgr.14388) 19855 : cluster [DBG] pgmap v13765: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:30.001 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:50:30.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:50:30.002 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:50:30.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:29 smithi163 bash[24253]: cluster 2024-08-31T09:50:28.296891+0000 mgr.a (mgr.14388) 19856 : cluster [DBG] pgmap v13766: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:30.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:29 smithi027 bash[22610]: cluster 2024-08-31T09:50:28.296891+0000 mgr.a (mgr.14388) 19856 : cluster [DBG] pgmap v13766: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:30.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:29 smithi191 bash[24992]: cluster 2024-08-31T09:50:28.296891+0000 mgr.a (mgr.14388) 19856 : cluster [DBG] pgmap v13766: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:30.792 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:50:30.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:50:30.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:50:30.792 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:50:30.793 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:50:32.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:31 smithi163 bash[24253]: cluster 2024-08-31T09:50:30.297641+0000 mgr.a (mgr.14388) 19857 : cluster [DBG] pgmap v13767: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:32.200 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:31 smithi163 bash[24253]: audit 2024-08-31T09:50:30.339653+0000 mgr.a (mgr.14388) 19858 : audit [DBG] from='client.425907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:31 smithi027 bash[22610]: cluster 2024-08-31T09:50:30.297641+0000 mgr.a (mgr.14388) 19857 : cluster [DBG] pgmap v13767: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:32.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:31 smithi027 bash[22610]: audit 2024-08-31T09:50:30.339653+0000 mgr.a (mgr.14388) 19858 : audit [DBG] from='client.425907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:31 smithi191 bash[24992]: cluster 2024-08-31T09:50:30.297641+0000 mgr.a (mgr.14388) 19857 : cluster [DBG] pgmap v13767: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:32.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:31 smithi191 bash[24992]: audit 2024-08-31T09:50:30.339653+0000 mgr.a (mgr.14388) 19858 : audit [DBG] from='client.425907 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:34.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:33 smithi163 bash[24253]: cluster 2024-08-31T09:50:32.298762+0000 mgr.a (mgr.14388) 19859 : cluster [DBG] pgmap v13768: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:34.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:33 smithi027 bash[22610]: cluster 2024-08-31T09:50:32.298762+0000 mgr.a (mgr.14388) 19859 : cluster [DBG] pgmap v13768: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:34.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:33 smithi191 bash[24992]: cluster 2024-08-31T09:50:32.298762+0000 mgr.a (mgr.14388) 19859 : cluster [DBG] pgmap v13768: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:35.794 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:50:35.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:50:35.794 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:50:36.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:35 smithi163 bash[24253]: cluster 2024-08-31T09:50:34.300995+0000 mgr.a (mgr.14388) 19860 : cluster [DBG] pgmap v13769: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:36.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:35 smithi027 bash[22610]: cluster 2024-08-31T09:50:34.300995+0000 mgr.a (mgr.14388) 19860 : cluster [DBG] pgmap v13769: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:36.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:35 smithi191 bash[24992]: cluster 2024-08-31T09:50:34.300995+0000 mgr.a (mgr.14388) 19860 : cluster [DBG] pgmap v13769: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:36.579 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:50:36.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:50:36.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:50:36.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:50:36.580 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:50:37.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:36 smithi163 bash[24253]: audit 2024-08-31T09:50:36.132202+0000 mgr.a (mgr.14388) 19861 : audit [DBG] from='client.425985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:37.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:36 smithi027 bash[22610]: audit 2024-08-31T09:50:36.132202+0000 mgr.a (mgr.14388) 19861 : audit [DBG] from='client.425985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:37.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:36 smithi191 bash[24992]: audit 2024-08-31T09:50:36.132202+0000 mgr.a (mgr.14388) 19861 : audit [DBG] from='client.425985 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:38.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:37 smithi163 bash[24253]: cluster 2024-08-31T09:50:36.301561+0000 mgr.a (mgr.14388) 19862 : cluster [DBG] pgmap v13770: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:38.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:37 smithi027 bash[22610]: cluster 2024-08-31T09:50:36.301561+0000 mgr.a (mgr.14388) 19862 : cluster [DBG] pgmap v13770: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:38.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:37 smithi191 bash[24992]: cluster 2024-08-31T09:50:36.301561+0000 mgr.a (mgr.14388) 19862 : cluster [DBG] pgmap v13770: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:40.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:39 smithi163 bash[24253]: cluster 2024-08-31T09:50:38.304122+0000 mgr.a (mgr.14388) 19863 : cluster [DBG] pgmap v13771: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:40.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:39 smithi027 bash[22610]: cluster 2024-08-31T09:50:38.304122+0000 mgr.a (mgr.14388) 19863 : cluster [DBG] pgmap v13771: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:40.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:39 smithi191 bash[24992]: cluster 2024-08-31T09:50:38.304122+0000 mgr.a (mgr.14388) 19863 : cluster [DBG] pgmap v13771: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 2 op/s 2024-08-31T09:50:41.581 INFO:teuthology.orchestra.run.smithi027.stderr:+ true 2024-08-31T09:50:41.582 INFO:teuthology.orchestra.run.smithi027.stderr:++ ceph rgw realm tokens 2024-08-31T09:50:41.582 INFO:teuthology.orchestra.run.smithi027.stderr:++ jq -r '.[0].token' 2024-08-31T09:50:42.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:41 smithi163 bash[24253]: cluster 2024-08-31T09:50:40.304894+0000 mgr.a (mgr.14388) 19864 : cluster [DBG] pgmap v13772: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:42.232 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:41 smithi027 bash[22610]: cluster 2024-08-31T09:50:40.304894+0000 mgr.a (mgr.14388) 19864 : cluster [DBG] pgmap v13772: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:42.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:41 smithi191 bash[24992]: cluster 2024-08-31T09:50:40.304894+0000 mgr.a (mgr.14388) 19864 : cluster [DBG] pgmap v13772: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:42.349 INFO:teuthology.orchestra.run.smithi027.stdout:master zone has no endpoint 2024-08-31T09:50:42.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ TOKEN='master zone has no endpoint' 2024-08-31T09:50:42.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ echo master zone has no endpoint 2024-08-31T09:50:42.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ '[' 'master zone has no endpoint' '!=' 'master zone has no endpoint' ']' 2024-08-31T09:50:42.349 INFO:teuthology.orchestra.run.smithi027.stderr:+ sleep 5 2024-08-31T09:50:43.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:42 smithi163 bash[24253]: audit 2024-08-31T09:50:41.913777+0000 mgr.a (mgr.14388) 19865 : audit [DBG] from='client.426063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:43.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:42 smithi027 bash[22610]: audit 2024-08-31T09:50:41.913777+0000 mgr.a (mgr.14388) 19865 : audit [DBG] from='client.426063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:43.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:42 smithi191 bash[24992]: audit 2024-08-31T09:50:41.913777+0000 mgr.a (mgr.14388) 19865 : audit [DBG] from='client.426063 -' entity='client.admin' cmd=[{"prefix": "rgw realm tokens", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T09:50:44.199 INFO:journalctl@ceph.mon.b.smithi163.stdout:Aug 31 09:50:43 smithi163 bash[24253]: cluster 2024-08-31T09:50:42.305582+0000 mgr.a (mgr.14388) 19866 : cluster [DBG] pgmap v13773: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:44.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Aug 31 09:50:43 smithi027 bash[22610]: cluster 2024-08-31T09:50:42.305582+0000 mgr.a (mgr.14388) 19866 : cluster [DBG] pgmap v13773: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:44.289 INFO:journalctl@ceph.mon.c.smithi191.stdout:Aug 31 09:50:43 smithi191 bash[24992]: cluster 2024-08-31T09:50:42.305582+0000 mgr.a (mgr.14388) 19866 : cluster [DBG] pgmap v13773: 225 pgs: 225 active+clean; 589 KiB data, 239 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-08-31T09:50:45.965 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-08-31T09:50:45.966 DEBUG:teuthology.task.console_log:Killing console logger for smithi027 2024-08-31T09:50:45.967 DEBUG:teuthology.task.console_log:Killing console logger for smithi163 2024-08-31T09:50:45.967 DEBUG:teuthology.task.console_log:Killing console logger for smithi191 2024-08-31T09:50:45.968 DEBUG:teuthology.exit:Finished running handlers